2024-09-19T08:31:39.766 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T08:31:39.790 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T08:31:39.885 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911866 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/misc}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7911866' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 subvols: create: 2 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.dir_split install: ceph: flavor: default sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync syntax: v2 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1747 sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 sleep_before_teardown: 0 subset: 176/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi019.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP9yykWWS9Pq1/huoWCDkQBaHo6V82w3x3PQqCMupH39nbpSjQg2H5rcSLTnag+IALT5NqsU/5CMqHrX2q/tJbg= smithi155.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHGRcL+rlg5BQOiJt/ygP6zwVc/LePHYbEj1+VKvLTlWLdjELNJ1ZGTazpAtYEy21+t2k1FgKHhY52WZTxnsn/4= smithi203.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEvlWH6djbDPcaFdAFdLpd6IuHEcQ3UoKHsz49864xISkO7N4XjYPqTHc5rovbp3IGKebOzhG1Cb7EtUzloT68o= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - fs/misc teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-19T08:31:39.885 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa; will attempt to use it 2024-09-19T08:31:39.886 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks 2024-09-19T08:31:39.886 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T08:31:39.888 INFO:teuthology.task.internal:Checking packages... 2024-09-19T08:31:39.916 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2f599a46ad10e37c929e5c43da2f6907ddcd1961' 2024-09-19T08:31:39.917 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T08:31:39.917 INFO:teuthology.packaging:ref: None 2024-09-19T08:31:39.917 INFO:teuthology.packaging:tag: None 2024-09-19T08:31:39.917 INFO:teuthology.packaging:branch: squid 2024-09-19T08:31:39.917 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:31:39.917 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-19T08:31:40.147 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-363.g6fad5dd7 2024-09-19T08:31:40.149 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T08:31:40.155 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T08:31:40.156 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T08:31:40.207 INFO:teuthology.task.internal:Saving configuration 2024-09-19T08:31:40.228 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T08:31:40.256 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T08:31:40.282 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi019.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911866', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 08:26:29.741314', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP9yykWWS9Pq1/huoWCDkQBaHo6V82w3x3PQqCMupH39nbpSjQg2H5rcSLTnag+IALT5NqsU/5CMqHrX2q/tJbg='} 2024-09-19T08:31:40.303 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi155.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911866', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 08:26:29.743163', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHGRcL+rlg5BQOiJt/ygP6zwVc/LePHYbEj1+VKvLTlWLdjELNJ1ZGTazpAtYEy21+t2k1FgKHhY52WZTxnsn/4='} 2024-09-19T08:31:40.326 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911866', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 08:26:29.744642', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEvlWH6djbDPcaFdAFdLpd6IuHEcQ3UoKHsz49864xISkO7N4XjYPqTHc5rovbp3IGKebOzhG1Cb7EtUzloT68o='} 2024-09-19T08:31:40.326 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T08:31:40.334 INFO:teuthology.task.internal:roles: ubuntu@smithi019.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-19T08:31:40.334 INFO:teuthology.task.internal:roles: ubuntu@smithi155.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-19T08:31:40.334 INFO:teuthology.task.internal:roles: ubuntu@smithi203.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-19T08:31:40.334 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T08:31:40.469 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f77d5d87be0>, signals=[15]) 2024-09-19T08:31:40.469 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T08:31:40.477 INFO:teuthology.task.internal:Opening connections... 2024-09-19T08:31:40.477 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi019.front.sepia.ceph.com 2024-09-19T08:31:40.478 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:31:40.561 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi155.front.sepia.ceph.com 2024-09-19T08:31:40.562 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:31:40.641 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi203.front.sepia.ceph.com 2024-09-19T08:31:40.642 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:31:40.716 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T08:31:40.724 DEBUG:teuthology.orchestra.run.smithi019:> uname -m 2024-09-19T08:31:40.743 INFO:teuthology.orchestra.run.smithi019.stdout:x86_64 2024-09-19T08:31:40.744 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release 2024-09-19T08:31:40.801 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Stream" 2024-09-19T08:31:40.801 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="9" 2024-09-19T08:31:40.801 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos" 2024-09-19T08:31:40.801 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora" 2024-09-19T08:31:40.801 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="9" 2024-09-19T08:31:40.802 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el9" 2024-09-19T08:31:40.802 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T08:31:40.802 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31" 2024-09-19T08:31:40.802 INFO:teuthology.orchestra.run.smithi019.stdout:LOGO="fedora-logo-icon" 2024-09-19T08:31:40.802 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T08:31:40.802 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://centos.org/" 2024-09-19T08:31:40.802 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T08:31:40.802 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T08:31:40.802 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T08:31:40.803 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server 2024-09-19T08:31:40.828 DEBUG:teuthology.orchestra.run.smithi155:> uname -m 2024-09-19T08:31:40.848 INFO:teuthology.orchestra.run.smithi155.stdout:x86_64 2024-09-19T08:31:40.848 DEBUG:teuthology.orchestra.run.smithi155:> cat /etc/os-release 2024-09-19T08:31:40.907 INFO:teuthology.orchestra.run.smithi155.stdout:NAME="CentOS Stream" 2024-09-19T08:31:40.907 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION="9" 2024-09-19T08:31:40.907 INFO:teuthology.orchestra.run.smithi155.stdout:ID="centos" 2024-09-19T08:31:40.907 INFO:teuthology.orchestra.run.smithi155.stdout:ID_LIKE="rhel fedora" 2024-09-19T08:31:40.907 INFO:teuthology.orchestra.run.smithi155.stdout:VERSION_ID="9" 2024-09-19T08:31:40.907 INFO:teuthology.orchestra.run.smithi155.stdout:PLATFORM_ID="platform:el9" 2024-09-19T08:31:40.908 INFO:teuthology.orchestra.run.smithi155.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T08:31:40.908 INFO:teuthology.orchestra.run.smithi155.stdout:ANSI_COLOR="0;31" 2024-09-19T08:31:40.908 INFO:teuthology.orchestra.run.smithi155.stdout:LOGO="fedora-logo-icon" 2024-09-19T08:31:40.908 INFO:teuthology.orchestra.run.smithi155.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T08:31:40.908 INFO:teuthology.orchestra.run.smithi155.stdout:HOME_URL="https://centos.org/" 2024-09-19T08:31:40.908 INFO:teuthology.orchestra.run.smithi155.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T08:31:40.908 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T08:31:40.908 INFO:teuthology.orchestra.run.smithi155.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T08:31:40.908 INFO:teuthology.lock.ops:Updating smithi155.front.sepia.ceph.com on lock server 2024-09-19T08:31:40.935 DEBUG:teuthology.orchestra.run.smithi203:> uname -m 2024-09-19T08:31:40.954 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64 2024-09-19T08:31:40.954 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2024-09-19T08:31:41.012 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream" 2024-09-19T08:31:41.012 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="9" 2024-09-19T08:31:41.012 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos" 2024-09-19T08:31:41.012 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora" 2024-09-19T08:31:41.012 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="9" 2024-09-19T08:31:41.012 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el9" 2024-09-19T08:31:41.013 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T08:31:41.013 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31" 2024-09-19T08:31:41.013 INFO:teuthology.orchestra.run.smithi203.stdout:LOGO="fedora-logo-icon" 2024-09-19T08:31:41.013 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T08:31:41.013 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/" 2024-09-19T08:31:41.013 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T08:31:41.013 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T08:31:41.013 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T08:31:41.014 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2024-09-19T08:31:41.044 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T08:31:41.053 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T08:31:41.079 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T08:31:41.080 DEBUG:teuthology.orchestra.run.smithi019:> test '!' -e /home/ubuntu/cephtest 2024-09-19T08:31:41.082 DEBUG:teuthology.orchestra.run.smithi155:> test '!' -e /home/ubuntu/cephtest 2024-09-19T08:31:41.085 DEBUG:teuthology.orchestra.run.smithi203:> test '!' -e /home/ubuntu/cephtest 2024-09-19T08:31:41.105 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T08:31:41.131 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T08:31:41.131 DEBUG:teuthology.orchestra.run.smithi019:> test -z $(ls -A /var/lib/ceph) 2024-09-19T08:31:41.139 DEBUG:teuthology.orchestra.run.smithi155:> test -z $(ls -A /var/lib/ceph) 2024-09-19T08:31:41.143 DEBUG:teuthology.orchestra.run.smithi203:> test -z $(ls -A /var/lib/ceph) 2024-09-19T08:31:41.227 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T08:31:41.312 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T08:31:41.327 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-19T08:31:41.327 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-09-19T08:31:41.327 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-09-19T08:31:41.328 DEBUG:teuthology.orchestra.run.smithi019:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T08:31:41.345 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:31:41.346 DEBUG:teuthology.orchestra.run.smithi019:> uname -r 2024-09-19T08:31:41.404 INFO:teuthology.orchestra.run.smithi019.stdout:5.14.0-503.el9.x86_64 2024-09-19T08:31:41.404 INFO:teuthology.task.kernel:Running kernel on smithi019: 5.14.0-503.el9.x86_64 2024-09-19T08:31:41.404 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum install -y kernel 2024-09-19T08:31:43.837 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.3 MB 00:00 2024-09-19T08:31:46.397 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - AppStream 14 MB/s | 20 MB 00:01 2024-09-19T08:31:51.131 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - CRB 7.7 MB/s | 6.5 MB 00:00 2024-09-19T08:31:52.640 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - Extras packages 82 kB/s | 19 kB 00:00 2024-09-19T08:31:53.462 INFO:teuthology.orchestra.run.smithi019.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-19T08:31:59.042 INFO:teuthology.orchestra.run.smithi019.stdout:lab-extras 23 kB/s | 1.7 kB 00:00 2024-09-19T08:32:01.132 INFO:teuthology.orchestra.run.smithi019.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T08:32:01.132 INFO:teuthology.orchestra.run.smithi019.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T08:32:01.213 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-09-19T08:32:01.221 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-09-19T08:32:01.221 INFO:teuthology.orchestra.run.smithi019.stdout: Package Architecture Version Repository Size 2024-09-19T08:32:01.221 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-09-19T08:32:01.221 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2024-09-19T08:32:01.221 INFO:teuthology.orchestra.run.smithi019.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T08:32:01.221 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2024-09-19T08:32:01.221 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T08:32:01.221 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T08:32:01.221 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T08:32:01.221 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:32:01.221 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2024-09-19T08:32:01.221 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-09-19T08:32:01.221 INFO:teuthology.orchestra.run.smithi019.stdout:Install 4 Packages 2024-09-19T08:32:01.222 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:32:01.222 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 79 M 2024-09-19T08:32:01.222 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 126 M 2024-09-19T08:32:01.222 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2024-09-19T08:32:01.485 INFO:teuthology.orchestra.run.smithi019.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 230 kB/s | 36 kB 00:00 2024-09-19T08:32:08.193 INFO:teuthology.orchestra.run.smithi019.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 2.3 MB/s | 16 MB 00:06 2024-09-19T08:32:09.243 INFO:teuthology.orchestra.run.smithi019.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 3.7 MB/s | 29 MB 00:07 2024-09-19T08:32:09.552 INFO:teuthology.orchestra.run.smithi019.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 4.2 MB/s | 35 MB 00:08 2024-09-19T08:32:09.552 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:32:09.552 INFO:teuthology.orchestra.run.smithi019.stdout:Total 9.5 MB/s | 79 MB 00:08 2024-09-19T08:32:10.259 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2024-09-19T08:32:10.640 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2024-09-19T08:32:10.641 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2024-09-19T08:32:11.665 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2024-09-19T08:32:11.665 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2024-09-19T08:32:14.227 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2024-09-19T08:32:14.914 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T08:32:14.995 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:32:17.752 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:32:17.873 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:32:22.993 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:32:23.032 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:32:28.166 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:33:07.389 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:33:07.429 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:33:07.754 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:33:07.754 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T08:33:07.754 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T08:33:07.754 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T08:33:08.598 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T08:33:08.598 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:33:08.599 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2024-09-19T08:33:08.599 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T08:33:08.599 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T08:33:08.599 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T08:33:08.599 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T08:33:08.599 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:33:08.599 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-09-19T08:33:08.951 DEBUG:teuthology.orchestra.run.smithi019:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T08:33:09.044 INFO:teuthology.orchestra.run.smithi019.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T08:33:09.044 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T08:33:09.044 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T08:33:09.044 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T08:33:09.045 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T08:33:09.045 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-09-19T08:33:09.045 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi019.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T08:33:09.045 DEBUG:teuthology.orchestra.run.smithi019:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T08:33:09.104 INFO:teuthology.orchestra.run.smithi019.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T08:33:09.105 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T08:33:09.105 DEBUG:teuthology.orchestra.run.smithi019:> sudo rpm -qi grub2-tools 2024-09-19T08:33:09.148 INFO:teuthology.orchestra.run.smithi019.stdout:Name : grub2-tools 2024-09-19T08:33:09.148 INFO:teuthology.orchestra.run.smithi019.stdout:Epoch : 1 2024-09-19T08:33:09.148 INFO:teuthology.orchestra.run.smithi019.stdout:Version : 2.06 2024-09-19T08:33:09.148 INFO:teuthology.orchestra.run.smithi019.stdout:Release : 82.el9 2024-09-19T08:33:09.148 INFO:teuthology.orchestra.run.smithi019.stdout:Architecture: x86_64 2024-09-19T08:33:09.148 INFO:teuthology.orchestra.run.smithi019.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T08:33:09.148 INFO:teuthology.orchestra.run.smithi019.stdout:Group : Unspecified 2024-09-19T08:33:09.148 INFO:teuthology.orchestra.run.smithi019.stdout:Size : 8274670 2024-09-19T08:33:09.149 INFO:teuthology.orchestra.run.smithi019.stdout:License : GPLv3+ 2024-09-19T08:33:09.149 INFO:teuthology.orchestra.run.smithi019.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T08:33:09.149 INFO:teuthology.orchestra.run.smithi019.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T08:33:09.149 INFO:teuthology.orchestra.run.smithi019.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T08:33:09.149 INFO:teuthology.orchestra.run.smithi019.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T08:33:09.149 INFO:teuthology.orchestra.run.smithi019.stdout:Packager : builder@centos.org 2024-09-19T08:33:09.149 INFO:teuthology.orchestra.run.smithi019.stdout:Vendor : CentOS 2024-09-19T08:33:09.149 INFO:teuthology.orchestra.run.smithi019.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T08:33:09.149 INFO:teuthology.orchestra.run.smithi019.stdout:Summary : Support tools for GRUB. 2024-09-19T08:33:09.149 INFO:teuthology.orchestra.run.smithi019.stdout:Description : 2024-09-19T08:33:09.149 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:33:09.149 INFO:teuthology.orchestra.run.smithi019.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T08:33:09.149 INFO:teuthology.orchestra.run.smithi019.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T08:33:09.149 INFO:teuthology.orchestra.run.smithi019.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T08:33:09.150 INFO:teuthology.orchestra.run.smithi019.stdout:hardware devices. 2024-09-19T08:33:09.150 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:33:09.150 INFO:teuthology.orchestra.run.smithi019.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T08:33:09.151 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T08:33:09.151 INFO:teuthology.task.kernel:Updating grub on smithi019 to boot 5.14.0-508.el9.x86_64 2024-09-19T08:33:09.151 DEBUG:teuthology.orchestra.run.smithi019:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T08:33:09.944 INFO:teuthology.orchestra.run.smithi019.stderr:Generating grub configuration file ... 2024-09-19T08:33:11.254 INFO:teuthology.orchestra.run.smithi019.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T08:33:11.273 INFO:teuthology.orchestra.run.smithi019.stderr:done 2024-09-19T08:33:11.275 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2024-09-19T08:33:11.290 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.luiGWqzf0Y 2024-09-19T08:33:11.291 DEBUG:teuthology.orchestra.run.smithi019:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.luiGWqzf0Y 2024-09-19T08:33:11.356 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.luiGWqzf0Y 2024-09-19T08:33:11.502 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.luiGWqzf0Y is 6KB 2024-09-19T08:33:11.552 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.luiGWqzf0Y 2024-09-19T08:33:11.568 DEBUG:teuthology.orchestra.run.smithi019:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T08:33:11.630 INFO:teuthology.orchestra.run.smithi019.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T08:33:11.630 INFO:teuthology.orchestra.run.smithi019.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T08:33:11.631 INFO:teuthology.orchestra.run.smithi019.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T08:33:11.631 INFO:teuthology.orchestra.run.smithi019.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T08:33:11.632 DEBUG:teuthology.orchestra.run.smithi019:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T08:33:11.792 DEBUG:teuthology.orchestra.run.smithi019:> sudo shutdown -r now 2024-09-19T08:33:41.795 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-19T08:33:41.796 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-19T08:33:41.797 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:34:00.125 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.19 2024-09-19T08:34:09.126 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-19T08:34:09.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:35:09.130 DEBUG:teuthology.orchestra.remote:timed out 2024-09-19T08:35:21.131 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-19T08:35:21.132 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:35:21.410 DEBUG:teuthology.orchestra.run.smithi019:> true 2024-09-19T08:35:21.764 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-19T08:35:21.764 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-508.el9.x86_64"... 2024-09-19T08:35:21.765 DEBUG:teuthology.orchestra.run.smithi019:> uname -r 2024-09-19T08:35:21.781 INFO:teuthology.orchestra.run.smithi019.stdout:5.14.0-508.el9.x86_64 2024-09-19T08:35:21.781 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T08:35:21.781 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T08:35:21.781 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T08:35:22.783 DEBUG:teuthology.parallel:result is None 2024-09-19T08:35:22.783 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T08:35:22.813 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T08:35:22.813 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T08:35:22.816 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T08:35:22.819 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T08:35:22.837 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T08:35:22.861 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T08:35:22.993 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T08:35:22.993 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T08:35:22.996 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T08:35:22.999 DEBUG:teuthology.orchestra.run.smithi203:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T08:35:23.357 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T08:35:23.488 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T08:35:23.488 DEBUG:teuthology.orchestra.run.smithi155:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T08:35:23.506 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:35:23.506 DEBUG:teuthology.orchestra.run.smithi203:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T08:35:23.523 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:35:23.524 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T08:35:23.527 DEBUG:teuthology.orchestra.run.smithi155:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T08:35:23.549 DEBUG:teuthology.orchestra.run.smithi203:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T08:35:23.585 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:35:23.608 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:35:23.622 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:35:23.626 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:35:23.637 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:35:23.642 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T08:35:23.644 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T08:35:23.654 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T08:35:23.654 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T08:35:23.658 DEBUG:teuthology.orchestra.run.smithi155:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T08:35:23.661 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T08:35:23.689 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T08:35:23.698 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T08:35:23.699 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T08:35:23.727 DEBUG:teuthology.orchestra.run.smithi155:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T08:35:23.729 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T08:35:23.745 DEBUG:teuthology.orchestra.run.smithi019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:35:23.827 DEBUG:teuthology.orchestra.run.smithi019:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:35:23.877 DEBUG:teuthology.orchestra.run.smithi019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:35:23.964 DEBUG:teuthology.orchestra.run.smithi019:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:35:24.003 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-19T08:35:24.003 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T08:35:24.069 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:35:24.115 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:35:24.168 DEBUG:teuthology.orchestra.run.smithi155:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:35:24.252 DEBUG:teuthology.orchestra.run.smithi155:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:35:24.296 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-19T08:35:24.296 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T08:35:24.364 DEBUG:teuthology.orchestra.run.smithi203:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:35:24.409 DEBUG:teuthology.orchestra.run.smithi203:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T08:35:24.469 DEBUG:teuthology.orchestra.run.smithi203:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:35:24.555 DEBUG:teuthology.orchestra.run.smithi203:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T08:35:24.599 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-19T08:35:24.599 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T08:35:24.667 DEBUG:teuthology.orchestra.run.smithi019:> sudo service rsyslog restart 2024-09-19T08:35:24.670 DEBUG:teuthology.orchestra.run.smithi155:> sudo service rsyslog restart 2024-09-19T08:35:24.672 DEBUG:teuthology.orchestra.run.smithi203:> sudo service rsyslog restart 2024-09-19T08:35:24.712 INFO:teuthology.orchestra.run.smithi155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:35:24.718 INFO:teuthology.orchestra.run.smithi019.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:35:24.750 INFO:teuthology.orchestra.run.smithi203.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T08:35:25.214 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T08:35:25.221 INFO:teuthology.task.internal:Starting timer... 2024-09-19T08:35:25.221 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T08:35:25.269 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T08:35:25.317 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-19T08:35:25.318 DEBUG:teuthology.orchestra.run.smithi019:> sudo service auditd rotate 2024-09-19T08:35:25.377 INFO:teuthology.orchestra.run.smithi019.stdout:Rotating logs: 2024-09-19T08:35:25.379 DEBUG:teuthology.orchestra.run.smithi155:> sudo service auditd rotate 2024-09-19T08:35:25.436 INFO:teuthology.orchestra.run.smithi155.stdout:Rotating logs: 2024-09-19T08:35:25.438 DEBUG:teuthology.orchestra.run.smithi203:> sudo service auditd rotate 2024-09-19T08:35:25.497 INFO:teuthology.orchestra.run.smithi203.stdout:Rotating logs: 2024-09-19T08:35:25.499 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T08:35:25.499 DEBUG:teuthology.orchestra.run.smithi019:> /usr/sbin/getenforce 2024-09-19T08:35:25.525 INFO:teuthology.orchestra.run.smithi019.stdout:Permissive 2024-09-19T08:35:25.525 DEBUG:teuthology.orchestra.run.smithi155:> /usr/sbin/getenforce 2024-09-19T08:35:25.549 INFO:teuthology.orchestra.run.smithi155.stdout:Permissive 2024-09-19T08:35:25.549 DEBUG:teuthology.orchestra.run.smithi203:> /usr/sbin/getenforce 2024-09-19T08:35:25.569 INFO:teuthology.orchestra.run.smithi203.stdout:Permissive 2024-09-19T08:35:25.570 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi019.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi155.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi203.front.sepia.ceph.com': 'permissive'} 2024-09-19T08:35:25.570 DEBUG:teuthology.orchestra.run.smithi019:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:35:25.599 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:35:25.599 DEBUG:teuthology.orchestra.run.smithi155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:35:25.629 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:35:25.629 DEBUG:teuthology.orchestra.run.smithi203:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T08:35:25.657 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:35:25.658 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T08:35:25.658 DEBUG:teuthology.orchestra.run.smithi019:> sudo /usr/sbin/setenforce permissive 2024-09-19T08:35:25.691 DEBUG:teuthology.orchestra.run.smithi155:> sudo /usr/sbin/setenforce permissive 2024-09-19T08:35:25.720 DEBUG:teuthology.orchestra.run.smithi203:> sudo /usr/sbin/setenforce permissive 2024-09-19T08:35:25.760 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T08:35:25.769 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T08:35:25.780 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T08:35:25.781 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi019.front.sepia.ceph.com,smithi155.front.sepia.ceph.com,smithi203.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T08:39:27.549 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi019.front.sepia.ceph.com'), Remote(name='ubuntu@smithi155.front.sepia.ceph.com'), Remote(name='ubuntu@smithi203.front.sepia.ceph.com')] 2024-09-19T08:39:27.551 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-19T08:39:27.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:39:27.633 DEBUG:teuthology.orchestra.run.smithi019:> true 2024-09-19T08:39:27.718 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-19T08:39:27.718 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-09-19T08:39:27.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi155.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:39:27.797 DEBUG:teuthology.orchestra.run.smithi155:> true 2024-09-19T08:39:27.873 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi155.front.sepia.ceph.com' 2024-09-19T08:39:27.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-09-19T08:39:27.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T08:39:27.950 DEBUG:teuthology.orchestra.run.smithi203:> true 2024-09-19T08:39:28.040 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-09-19T08:39:28.042 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T08:39:28.053 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T08:39:28.054 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T08:39:28.054 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:39:28.057 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T08:39:28.057 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:39:28.059 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T08:39:28.059 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T08:39:28.086 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T08:39:28.089 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T08:39:28.101 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T08:39:28.104 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T08:39:28.110 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T08:39:28.125 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T08:39:28.128 INFO:teuthology.orchestra.run.smithi019.stderr:sudo: ntpd: command not found 2024-09-19T08:39:28.128 INFO:teuthology.orchestra.run.smithi155.stderr:sudo: ntpd: command not found 2024-09-19T08:39:28.140 INFO:teuthology.orchestra.run.smithi019.stdout:506 Cannot talk to daemon 2024-09-19T08:39:28.140 INFO:teuthology.orchestra.run.smithi155.stdout:506 Cannot talk to daemon 2024-09-19T08:39:28.149 INFO:teuthology.orchestra.run.smithi203.stderr:sudo: ntpd: command not found 2024-09-19T08:39:28.154 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T08:39:28.155 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T08:39:28.160 INFO:teuthology.orchestra.run.smithi203.stdout:506 Cannot talk to daemon 2024-09-19T08:39:28.168 INFO:teuthology.orchestra.run.smithi155.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T08:39:28.170 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T08:39:28.175 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T08:39:28.189 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T08:39:28.226 INFO:teuthology.orchestra.run.smithi155.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:39:28.227 INFO:teuthology.orchestra.run.smithi019.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:39:28.230 INFO:teuthology.orchestra.run.smithi155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:39:28.230 INFO:teuthology.orchestra.run.smithi155.stdout:=============================================================================== 2024-09-19T08:39:28.230 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:39:28.230 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:39:28.230 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:39:28.230 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:39:28.232 INFO:teuthology.orchestra.run.smithi019.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:39:28.232 INFO:teuthology.orchestra.run.smithi019.stdout:=============================================================================== 2024-09-19T08:39:28.232 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:39:28.232 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:39:28.232 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:39:28.232 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:39:28.243 INFO:teuthology.orchestra.run.smithi203.stderr:bash: line 1: ntpq: command not found 2024-09-19T08:39:28.247 INFO:teuthology.orchestra.run.smithi203.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T08:39:28.247 INFO:teuthology.orchestra.run.smithi203.stdout:=============================================================================== 2024-09-19T08:39:28.247 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:39:28.247 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:39:28.247 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:39:28.247 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T08:39:28.248 INFO:teuthology.run_tasks:Running task install... 2024-09-19T08:39:28.256 DEBUG:teuthology.task.install:project ceph 2024-09-19T08:39:28.257 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}} 2024-09-19T08:39:28.257 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T08:39:28.257 INFO:teuthology.task.install:Using flavor: default 2024-09-19T08:39:28.262 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T08:39:28.262 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-19T08:39:28.263 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T08:39:28.263 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:39:28.266 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T08:39:28.266 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:39:28.267 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T08:39:28.267 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:39:28.409 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T08:39:28.409 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T08:39:28.417 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T08:39:28.417 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T08:39:28.427 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T08:39:28.427 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T08:39:28.521 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T08:39:28.521 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-19T08:39:28.521 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T08:39:28.527 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T08:39:28.528 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-19T08:39:28.528 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T08:39:28.539 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T08:39:28.539 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-19T08:39:28.539 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T08:39:28.549 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T08:39:28.549 DEBUG:teuthology.orchestra.run.smithi019:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T08:39:28.553 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T08:39:28.554 DEBUG:teuthology.orchestra.run.smithi203:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T08:39:28.565 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T08:39:28.565 DEBUG:teuthology.orchestra.run.smithi155:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T08:39:28.617 DEBUG:teuthology.orchestra.run.smithi019:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T08:39:28.619 DEBUG:teuthology.orchestra.run.smithi203:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T08:39:28.631 DEBUG:teuthology.orchestra.run.smithi155:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T08:39:28.694 DEBUG:teuthology.orchestra.run.smithi019:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T08:39:28.695 DEBUG:teuthology.orchestra.run.smithi203:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T08:39:28.706 DEBUG:teuthology.orchestra.run.smithi155:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T08:39:28.759 INFO:teuthology.orchestra.run.smithi019.stdout:check_obsoletes = 1 2024-09-19T08:39:28.760 INFO:teuthology.orchestra.run.smithi203.stdout:check_obsoletes = 1 2024-09-19T08:39:28.761 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum clean all 2024-09-19T08:39:28.762 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum clean all 2024-09-19T08:39:28.770 INFO:teuthology.orchestra.run.smithi155.stdout:check_obsoletes = 1 2024-09-19T08:39:28.772 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum clean all 2024-09-19T08:39:28.985 INFO:teuthology.orchestra.run.smithi203.stdout:45 files removed 2024-09-19T08:39:28.997 INFO:teuthology.orchestra.run.smithi019.stdout:45 files removed 2024-09-19T08:39:28.997 INFO:teuthology.orchestra.run.smithi155.stdout:45 files removed 2024-09-19T08:39:29.013 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T08:39:29.025 DEBUG:teuthology.orchestra.run.smithi155:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T08:39:29.025 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T08:39:29.550 INFO:teuthology.orchestra.run.smithi203.stdout:ceph packages for x86_64 323 kB/s | 84 kB 00:00 2024-09-19T08:39:29.567 INFO:teuthology.orchestra.run.smithi155.stdout:ceph packages for x86_64 315 kB/s | 84 kB 00:00 2024-09-19T08:39:29.592 INFO:teuthology.orchestra.run.smithi019.stdout:ceph packages for x86_64 313 kB/s | 84 kB 00:00 2024-09-19T08:39:29.834 INFO:teuthology.orchestra.run.smithi203.stdout:ceph noarch packages 48 kB/s | 12 kB 00:00 2024-09-19T08:39:29.851 INFO:teuthology.orchestra.run.smithi155.stdout:ceph noarch packages 48 kB/s | 12 kB 00:00 2024-09-19T08:39:29.984 INFO:teuthology.orchestra.run.smithi019.stdout:ceph noarch packages 34 kB/s | 12 kB 00:00 2024-09-19T08:39:30.101 INFO:teuthology.orchestra.run.smithi203.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-19T08:39:30.110 INFO:teuthology.orchestra.run.smithi155.stdout:ceph source packages 8.5 kB/s | 1.9 kB 00:00 2024-09-19T08:39:30.252 INFO:teuthology.orchestra.run.smithi019.stdout:ceph source packages 8.3 kB/s | 1.9 kB 00:00 2024-09-19T08:39:30.694 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.3 MB 00:00 2024-09-19T08:39:32.173 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.3 MB 00:01 2024-09-19T08:39:32.620 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-19T08:39:33.185 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - BaseOS 2.7 MB/s | 8.3 MB 00:03 2024-09-19T08:39:33.944 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - AppStream 33 MB/s | 20 MB 00:00 2024-09-19T08:39:37.363 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - CRB 7.3 MB/s | 6.5 MB 00:00 2024-09-19T08:39:38.346 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-09-19T08:39:38.822 INFO:teuthology.orchestra.run.smithi155.stdout:CentOS Stream 9 - Extras packages 77 kB/s | 19 kB 00:00 2024-09-19T08:39:38.860 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - AppStream 4.5 MB/s | 20 MB 00:04 2024-09-19T08:39:39.813 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - Extras packages 103 kB/s | 19 kB 00:00 2024-09-19T08:39:40.020 INFO:teuthology.orchestra.run.smithi155.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-19T08:39:40.959 INFO:teuthology.orchestra.run.smithi019.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-19T08:39:43.545 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - CRB 7.7 MB/s | 6.5 MB 00:00 2024-09-19T08:39:45.196 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 19 kB 00:00 2024-09-19T08:39:45.415 INFO:teuthology.orchestra.run.smithi155.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-19T08:39:46.151 INFO:teuthology.orchestra.run.smithi203.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-19T08:39:46.599 INFO:teuthology.orchestra.run.smithi019.stdout:lab-extras 41 kB/s | 1.7 kB 00:00 2024-09-19T08:39:47.560 INFO:teuthology.orchestra.run.smithi155.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:39:47.560 INFO:teuthology.orchestra.run.smithi155.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:39:47.572 INFO:teuthology.orchestra.run.smithi155.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T08:39:47.572 INFO:teuthology.orchestra.run.smithi155.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T08:39:47.573 INFO:teuthology.orchestra.run.smithi155.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T08:39:47.574 INFO:teuthology.orchestra.run.smithi155.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T08:39:47.576 INFO:teuthology.orchestra.run.smithi155.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T08:39:47.578 INFO:teuthology.orchestra.run.smithi155.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T08:39:47.579 INFO:teuthology.orchestra.run.smithi155.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T08:39:47.642 INFO:teuthology.orchestra.run.smithi155.stdout:Dependencies resolved. 2024-09-19T08:39:47.652 INFO:teuthology.orchestra.run.smithi155.stdout:====================================================================================== 2024-09-19T08:39:47.653 INFO:teuthology.orchestra.run.smithi155.stdout: Package Arch Version Repository Size 2024-09-19T08:39:47.653 INFO:teuthology.orchestra.run.smithi155.stdout:====================================================================================== 2024-09-19T08:39:47.653 INFO:teuthology.orchestra.run.smithi155.stdout:Installing: 2024-09-19T08:39:47.653 INFO:teuthology.orchestra.run.smithi155.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T08:39:47.653 INFO:teuthology.orchestra.run.smithi155.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T08:39:47.653 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T08:39:47.653 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T08:39:47.653 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T08:39:47.653 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T08:39:47.653 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T08:39:47.653 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T08:39:47.653 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T08:39:47.654 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T08:39:47.654 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T08:39:47.654 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T08:39:47.654 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T08:39:47.654 INFO:teuthology.orchestra.run.smithi155.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T08:39:47.654 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T08:39:47.654 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T08:39:47.654 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T08:39:47.654 INFO:teuthology.orchestra.run.smithi155.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T08:39:47.654 INFO:teuthology.orchestra.run.smithi155.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T08:39:47.654 INFO:teuthology.orchestra.run.smithi155.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T08:39:47.654 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T08:39:47.655 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T08:39:47.655 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T08:39:47.655 INFO:teuthology.orchestra.run.smithi155.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T08:39:47.655 INFO:teuthology.orchestra.run.smithi155.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T08:39:47.655 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T08:39:47.655 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T08:39:47.655 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T08:39:47.655 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T08:39:47.655 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T08:39:47.655 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T08:39:47.655 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T08:39:47.655 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T08:39:47.655 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T08:39:47.656 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T08:39:47.656 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T08:39:47.656 INFO:teuthology.orchestra.run.smithi155.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T08:39:47.656 INFO:teuthology.orchestra.run.smithi155.stdout:Upgrading: 2024-09-19T08:39:47.656 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T08:39:47.656 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T08:39:47.656 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T08:39:47.656 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T08:39:47.656 INFO:teuthology.orchestra.run.smithi155.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T08:39:47.656 INFO:teuthology.orchestra.run.smithi155.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T08:39:47.656 INFO:teuthology.orchestra.run.smithi155.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T08:39:47.656 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T08:39:47.657 INFO:teuthology.orchestra.run.smithi155.stdout:Installing dependencies: 2024-09-19T08:39:47.657 INFO:teuthology.orchestra.run.smithi155.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T08:39:47.657 INFO:teuthology.orchestra.run.smithi155.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T08:39:47.657 INFO:teuthology.orchestra.run.smithi155.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T08:39:47.657 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T08:39:47.657 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T08:39:47.657 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T08:39:47.657 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T08:39:47.657 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T08:39:47.657 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T08:39:47.657 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T08:39:47.657 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T08:39:47.657 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T08:39:47.658 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T08:39:47.658 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T08:39:47.658 INFO:teuthology.orchestra.run.smithi155.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T08:39:47.658 INFO:teuthology.orchestra.run.smithi155.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T08:39:47.658 INFO:teuthology.orchestra.run.smithi155.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T08:39:47.658 INFO:teuthology.orchestra.run.smithi155.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T08:39:47.658 INFO:teuthology.orchestra.run.smithi155.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T08:39:47.658 INFO:teuthology.orchestra.run.smithi155.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T08:39:47.658 INFO:teuthology.orchestra.run.smithi155.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T08:39:47.658 INFO:teuthology.orchestra.run.smithi155.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T08:39:47.658 INFO:teuthology.orchestra.run.smithi155.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T08:39:47.658 INFO:teuthology.orchestra.run.smithi155.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T08:39:47.658 INFO:teuthology.orchestra.run.smithi155.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T08:39:47.659 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T08:39:47.659 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T08:39:47.659 INFO:teuthology.orchestra.run.smithi155.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T08:39:47.659 INFO:teuthology.orchestra.run.smithi155.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T08:39:47.659 INFO:teuthology.orchestra.run.smithi155.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T08:39:47.659 INFO:teuthology.orchestra.run.smithi155.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T08:39:47.659 INFO:teuthology.orchestra.run.smithi155.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T08:39:47.659 INFO:teuthology.orchestra.run.smithi155.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T08:39:47.659 INFO:teuthology.orchestra.run.smithi155.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T08:39:47.659 INFO:teuthology.orchestra.run.smithi155.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T08:39:47.659 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T08:39:47.659 INFO:teuthology.orchestra.run.smithi155.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T08:39:47.660 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T08:39:47.660 INFO:teuthology.orchestra.run.smithi155.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T08:39:47.660 INFO:teuthology.orchestra.run.smithi155.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T08:39:47.660 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T08:39:47.660 INFO:teuthology.orchestra.run.smithi155.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T08:39:47.660 INFO:teuthology.orchestra.run.smithi155.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T08:39:47.660 INFO:teuthology.orchestra.run.smithi155.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T08:39:47.660 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T08:39:47.660 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T08:39:47.660 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T08:39:47.660 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T08:39:47.660 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T08:39:47.660 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T08:39:47.661 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T08:39:47.661 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T08:39:47.661 INFO:teuthology.orchestra.run.smithi155.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T08:39:47.661 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T08:39:47.661 INFO:teuthology.orchestra.run.smithi155.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T08:39:47.661 INFO:teuthology.orchestra.run.smithi155.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T08:39:47.661 INFO:teuthology.orchestra.run.smithi155.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T08:39:47.661 INFO:teuthology.orchestra.run.smithi155.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T08:39:47.661 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T08:39:47.661 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T08:39:47.661 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T08:39:47.661 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T08:39:47.661 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T08:39:47.662 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T08:39:47.662 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T08:39:47.662 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T08:39:47.662 INFO:teuthology.orchestra.run.smithi155.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T08:39:47.662 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T08:39:47.662 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T08:39:47.662 INFO:teuthology.orchestra.run.smithi155.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T08:39:47.662 INFO:teuthology.orchestra.run.smithi155.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T08:39:47.662 INFO:teuthology.orchestra.run.smithi155.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T08:39:47.662 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T08:39:47.662 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T08:39:47.662 INFO:teuthology.orchestra.run.smithi155.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T08:39:47.662 INFO:teuthology.orchestra.run.smithi155.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T08:39:47.662 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T08:39:47.663 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T08:39:47.663 INFO:teuthology.orchestra.run.smithi155.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T08:39:47.663 INFO:teuthology.orchestra.run.smithi155.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T08:39:47.663 INFO:teuthology.orchestra.run.smithi155.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T08:39:47.663 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T08:39:47.663 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T08:39:47.663 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T08:39:47.663 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T08:39:47.663 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T08:39:47.663 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T08:39:47.663 INFO:teuthology.orchestra.run.smithi155.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T08:39:47.663 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T08:39:47.663 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T08:39:47.663 INFO:teuthology.orchestra.run.smithi155.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T08:39:47.664 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T08:39:47.664 INFO:teuthology.orchestra.run.smithi155.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T08:39:47.664 INFO:teuthology.orchestra.run.smithi155.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T08:39:47.664 INFO:teuthology.orchestra.run.smithi155.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T08:39:47.664 INFO:teuthology.orchestra.run.smithi155.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T08:39:47.664 INFO:teuthology.orchestra.run.smithi155.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T08:39:47.664 INFO:teuthology.orchestra.run.smithi155.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T08:39:47.664 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T08:39:47.664 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T08:39:47.664 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T08:39:47.664 INFO:teuthology.orchestra.run.smithi155.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T08:39:47.664 INFO:teuthology.orchestra.run.smithi155.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T08:39:47.664 INFO:teuthology.orchestra.run.smithi155.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T08:39:47.665 INFO:teuthology.orchestra.run.smithi155.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T08:39:47.665 INFO:teuthology.orchestra.run.smithi155.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T08:39:47.665 INFO:teuthology.orchestra.run.smithi155.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T08:39:47.665 INFO:teuthology.orchestra.run.smithi155.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T08:39:47.665 INFO:teuthology.orchestra.run.smithi155.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T08:39:47.665 INFO:teuthology.orchestra.run.smithi155.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T08:39:47.665 INFO:teuthology.orchestra.run.smithi155.stdout:Installing weak dependencies: 2024-09-19T08:39:47.665 INFO:teuthology.orchestra.run.smithi155.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T08:39:47.665 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T08:39:47.665 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction Summary 2024-09-19T08:39:47.665 INFO:teuthology.orchestra.run.smithi155.stdout:====================================================================================== 2024-09-19T08:39:47.665 INFO:teuthology.orchestra.run.smithi155.stdout:Install 148 Packages 2024-09-19T08:39:47.665 INFO:teuthology.orchestra.run.smithi155.stdout:Upgrade 8 Packages 2024-09-19T08:39:47.666 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T08:39:47.666 INFO:teuthology.orchestra.run.smithi155.stdout:Total download size: 226 M 2024-09-19T08:39:47.666 INFO:teuthology.orchestra.run.smithi155.stdout:Downloading Packages: 2024-09-19T08:39:48.567 INFO:teuthology.orchestra.run.smithi155.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 24 kB/s | 6.6 kB 00:00 2024-09-19T08:39:48.878 INFO:teuthology.orchestra.run.smithi019.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:39:48.879 INFO:teuthology.orchestra.run.smithi019.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:39:48.891 INFO:teuthology.orchestra.run.smithi019.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T08:39:48.892 INFO:teuthology.orchestra.run.smithi019.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T08:39:48.893 INFO:teuthology.orchestra.run.smithi019.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T08:39:48.894 INFO:teuthology.orchestra.run.smithi019.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T08:39:48.896 INFO:teuthology.orchestra.run.smithi019.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T08:39:48.899 INFO:teuthology.orchestra.run.smithi019.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T08:39:48.899 INFO:teuthology.orchestra.run.smithi019.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T08:39:48.967 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-09-19T08:39:48.987 INFO:teuthology.orchestra.run.smithi019.stdout:====================================================================================== 2024-09-19T08:39:48.987 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2024-09-19T08:39:48.987 INFO:teuthology.orchestra.run.smithi019.stdout:====================================================================================== 2024-09-19T08:39:48.988 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2024-09-19T08:39:48.988 INFO:teuthology.orchestra.run.smithi019.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T08:39:48.988 INFO:teuthology.orchestra.run.smithi019.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T08:39:48.988 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T08:39:48.988 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T08:39:48.988 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T08:39:48.988 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T08:39:48.988 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T08:39:48.988 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T08:39:48.989 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T08:39:48.989 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T08:39:48.989 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T08:39:48.989 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T08:39:48.989 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T08:39:48.989 INFO:teuthology.orchestra.run.smithi019.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T08:39:48.989 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T08:39:48.989 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T08:39:48.989 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T08:39:48.990 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T08:39:48.990 INFO:teuthology.orchestra.run.smithi019.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T08:39:48.990 INFO:teuthology.orchestra.run.smithi019.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T08:39:48.990 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T08:39:48.990 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T08:39:48.990 INFO:teuthology.orchestra.run.smithi019.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T08:39:48.990 INFO:teuthology.orchestra.run.smithi019.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T08:39:48.990 INFO:teuthology.orchestra.run.smithi019.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T08:39:48.990 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T08:39:48.990 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T08:39:48.990 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T08:39:48.990 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T08:39:48.990 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T08:39:48.991 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T08:39:48.991 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T08:39:48.991 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T08:39:48.991 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T08:39:48.991 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T08:39:48.991 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T08:39:48.991 INFO:teuthology.orchestra.run.smithi019.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T08:39:48.991 INFO:teuthology.orchestra.run.smithi019.stdout:Upgrading: 2024-09-19T08:39:48.991 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T08:39:48.991 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T08:39:48.991 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T08:39:48.991 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T08:39:48.991 INFO:teuthology.orchestra.run.smithi019.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T08:39:48.992 INFO:teuthology.orchestra.run.smithi019.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T08:39:48.992 INFO:teuthology.orchestra.run.smithi019.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T08:39:48.992 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T08:39:48.992 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2024-09-19T08:39:48.992 INFO:teuthology.orchestra.run.smithi019.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T08:39:48.992 INFO:teuthology.orchestra.run.smithi019.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T08:39:48.992 INFO:teuthology.orchestra.run.smithi019.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T08:39:48.992 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T08:39:48.992 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T08:39:48.992 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T08:39:48.992 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T08:39:48.992 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T08:39:48.992 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T08:39:48.993 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T08:39:48.993 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T08:39:48.993 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T08:39:48.993 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T08:39:48.993 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T08:39:48.993 INFO:teuthology.orchestra.run.smithi019.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T08:39:48.993 INFO:teuthology.orchestra.run.smithi019.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T08:39:48.993 INFO:teuthology.orchestra.run.smithi019.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T08:39:48.993 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T08:39:48.993 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T08:39:48.993 INFO:teuthology.orchestra.run.smithi019.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T08:39:48.993 INFO:teuthology.orchestra.run.smithi019.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T08:39:48.993 INFO:teuthology.orchestra.run.smithi019.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T08:39:48.993 INFO:teuthology.orchestra.run.smithi019.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T08:39:48.994 INFO:teuthology.orchestra.run.smithi019.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T08:39:48.994 INFO:teuthology.orchestra.run.smithi019.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T08:39:48.994 INFO:teuthology.orchestra.run.smithi019.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T08:39:48.994 INFO:teuthology.orchestra.run.smithi019.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T08:39:48.994 INFO:teuthology.orchestra.run.smithi019.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T08:39:48.994 INFO:teuthology.orchestra.run.smithi019.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T08:39:48.994 INFO:teuthology.orchestra.run.smithi019.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T08:39:48.994 INFO:teuthology.orchestra.run.smithi019.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T08:39:48.994 INFO:teuthology.orchestra.run.smithi019.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T08:39:48.994 INFO:teuthology.orchestra.run.smithi019.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T08:39:48.994 INFO:teuthology.orchestra.run.smithi019.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T08:39:48.994 INFO:teuthology.orchestra.run.smithi019.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T08:39:48.994 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T08:39:48.994 INFO:teuthology.orchestra.run.smithi019.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T08:39:48.995 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T08:39:48.995 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T08:39:48.995 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T08:39:48.995 INFO:teuthology.orchestra.run.smithi019.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T08:39:48.995 INFO:teuthology.orchestra.run.smithi019.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T08:39:48.995 INFO:teuthology.orchestra.run.smithi019.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T08:39:48.995 INFO:teuthology.orchestra.run.smithi019.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T08:39:48.995 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T08:39:48.995 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T08:39:48.995 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T08:39:48.995 INFO:teuthology.orchestra.run.smithi019.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T08:39:48.995 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T08:39:48.995 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T08:39:48.996 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T08:39:48.996 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T08:39:48.996 INFO:teuthology.orchestra.run.smithi019.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T08:39:48.996 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T08:39:48.996 INFO:teuthology.orchestra.run.smithi019.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T08:39:48.996 INFO:teuthology.orchestra.run.smithi019.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T08:39:48.996 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T08:39:48.996 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T08:39:48.996 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T08:39:48.996 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T08:39:48.996 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T08:39:48.996 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T08:39:48.996 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T08:39:48.997 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T08:39:48.997 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T08:39:48.997 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T08:39:48.997 INFO:teuthology.orchestra.run.smithi019.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T08:39:48.997 INFO:teuthology.orchestra.run.smithi019.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T08:39:48.997 INFO:teuthology.orchestra.run.smithi019.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T08:39:48.997 INFO:teuthology.orchestra.run.smithi019.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T08:39:48.997 INFO:teuthology.orchestra.run.smithi019.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T08:39:48.997 INFO:teuthology.orchestra.run.smithi019.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T08:39:48.997 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T08:39:48.997 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T08:39:48.997 INFO:teuthology.orchestra.run.smithi019.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T08:39:48.997 INFO:teuthology.orchestra.run.smithi019.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T08:39:48.998 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T08:39:48.998 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T08:39:48.998 INFO:teuthology.orchestra.run.smithi019.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T08:39:48.998 INFO:teuthology.orchestra.run.smithi019.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T08:39:48.998 INFO:teuthology.orchestra.run.smithi019.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T08:39:48.998 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T08:39:48.998 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T08:39:48.998 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T08:39:48.998 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T08:39:48.998 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T08:39:48.998 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T08:39:48.998 INFO:teuthology.orchestra.run.smithi019.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T08:39:48.999 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T08:39:48.999 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T08:39:48.999 INFO:teuthology.orchestra.run.smithi019.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T08:39:48.999 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T08:39:48.999 INFO:teuthology.orchestra.run.smithi019.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T08:39:48.999 INFO:teuthology.orchestra.run.smithi019.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T08:39:48.999 INFO:teuthology.orchestra.run.smithi019.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T08:39:48.999 INFO:teuthology.orchestra.run.smithi019.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T08:39:48.999 INFO:teuthology.orchestra.run.smithi019.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T08:39:48.999 INFO:teuthology.orchestra.run.smithi019.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T08:39:48.999 INFO:teuthology.orchestra.run.smithi019.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T08:39:48.999 INFO:teuthology.orchestra.run.smithi019.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T08:39:48.999 INFO:teuthology.orchestra.run.smithi019.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T08:39:49.000 INFO:teuthology.orchestra.run.smithi019.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T08:39:49.000 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T08:39:49.000 INFO:teuthology.orchestra.run.smithi019.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T08:39:49.000 INFO:teuthology.orchestra.run.smithi019.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T08:39:49.000 INFO:teuthology.orchestra.run.smithi019.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T08:39:49.000 INFO:teuthology.orchestra.run.smithi019.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T08:39:49.000 INFO:teuthology.orchestra.run.smithi019.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T08:39:49.000 INFO:teuthology.orchestra.run.smithi019.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T08:39:49.000 INFO:teuthology.orchestra.run.smithi019.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T08:39:49.000 INFO:teuthology.orchestra.run.smithi019.stdout:Installing weak dependencies: 2024-09-19T08:39:49.000 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T08:39:49.000 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:39:49.000 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2024-09-19T08:39:49.001 INFO:teuthology.orchestra.run.smithi019.stdout:====================================================================================== 2024-09-19T08:39:49.001 INFO:teuthology.orchestra.run.smithi019.stdout:Install 148 Packages 2024-09-19T08:39:49.001 INFO:teuthology.orchestra.run.smithi019.stdout:Upgrade 8 Packages 2024-09-19T08:39:49.001 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:39:49.001 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 226 M 2024-09-19T08:39:49.001 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2024-09-19T08:39:49.084 INFO:teuthology.orchestra.run.smithi155.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 896 kB 00:00 2024-09-19T08:39:49.151 INFO:teuthology.orchestra.run.smithi155.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 2.1 MB/s | 145 kB 00:00 2024-09-19T08:39:49.518 INFO:teuthology.orchestra.run.smithi155.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 4.4 MB/s | 5.4 MB 00:01 2024-09-19T08:39:49.541 INFO:teuthology.orchestra.run.smithi019.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 54 kB/s | 6.6 kB 00:00 2024-09-19T08:39:49.560 INFO:teuthology.orchestra.run.smithi155.stdout:(5/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 5.8 MB/s | 2.4 MB 00:00 2024-09-19T08:39:49.668 INFO:teuthology.orchestra.run.smithi155.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 10 MB/s | 1.5 MB 00:00 2024-09-19T08:39:49.800 INFO:teuthology.orchestra.run.smithi019.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 3.4 MB/s | 896 kB 00:00 2024-09-19T08:39:49.900 INFO:teuthology.orchestra.run.smithi019.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.4 MB/s | 145 kB 00:00 2024-09-19T08:39:50.652 INFO:teuthology.orchestra.run.smithi155.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 4.3 MB/s | 4.7 MB 00:01 2024-09-19T08:39:50.717 INFO:teuthology.orchestra.run.smithi019.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 4.2 MB/s | 5.4 MB 00:01 2024-09-19T08:39:50.934 INFO:teuthology.orchestra.run.smithi019.stdout:(5/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 2.3 MB/s | 2.4 MB 00:01 2024-09-19T08:39:50.976 INFO:teuthology.orchestra.run.smithi019.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 5.9 MB/s | 1.5 MB 00:00 2024-09-19T08:39:51.260 INFO:teuthology.orchestra.run.smithi155.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 7.2 MB/s | 21 MB 00:02 2024-09-19T08:39:51.310 INFO:teuthology.orchestra.run.smithi155.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 506 kB/s | 25 kB 00:00 2024-09-19T08:39:51.564 INFO:teuthology.orchestra.run.smithi203.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-19T08:39:51.728 INFO:teuthology.orchestra.run.smithi155.stdout:(10/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 8.2 MB/s | 17 MB 00:02 2024-09-19T08:39:51.794 INFO:teuthology.orchestra.run.smithi155.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 3.3 MB/s | 228 kB 00:00 2024-09-19T08:39:51.843 INFO:teuthology.orchestra.run.smithi019.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 5.2 MB/s | 4.7 MB 00:00 2024-09-19T08:39:51.844 INFO:teuthology.orchestra.run.smithi155.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 542 kB/s | 27 kB 00:00 2024-09-19T08:39:51.911 INFO:teuthology.orchestra.run.smithi155.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 476 kB/s | 32 kB 00:00 2024-09-19T08:39:52.037 INFO:teuthology.orchestra.run.smithi155.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 5.9 MB/s | 751 kB 00:00 2024-09-19T08:39:52.112 INFO:teuthology.orchestra.run.smithi155.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.1 MB/s | 163 kB 00:00 2024-09-19T08:39:52.171 INFO:teuthology.orchestra.run.smithi155.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 2.1 MB/s | 127 kB 00:00 2024-09-19T08:39:52.279 INFO:teuthology.orchestra.run.smithi155.stdout:(17/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 6.5 MB/s | 11 MB 00:01 2024-09-19T08:39:52.305 INFO:teuthology.orchestra.run.smithi155.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 3.7 MB/s | 506 kB 00:00 2024-09-19T08:39:52.372 INFO:teuthology.orchestra.run.smithi155.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 675 kB/s | 45 kB 00:00 2024-09-19T08:39:52.431 INFO:teuthology.orchestra.run.smithi155.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 2.3 MB/s | 136 kB 00:00 2024-09-19T08:39:52.481 INFO:teuthology.orchestra.run.smithi155.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 3.2 MB/s | 161 kB 00:00 2024-09-19T08:39:52.531 INFO:teuthology.orchestra.run.smithi155.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 6.2 MB/s | 320 kB 00:00 2024-09-19T08:39:52.585 INFO:teuthology.orchestra.run.smithi019.stdout:(8/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86_ 10 MB/s | 17 MB 00:01 2024-09-19T08:39:52.590 INFO:teuthology.orchestra.run.smithi155.stdout:(23/156): python3-rbd-19.1.1-361.g2f599a46.el9. 5.0 MB/s | 300 kB 00:00 2024-09-19T08:39:52.626 INFO:teuthology.orchestra.run.smithi019.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 607 kB/s | 25 kB 00:00 2024-09-19T08:39:52.640 INFO:teuthology.orchestra.run.smithi155.stdout:(24/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T08:39:52.707 INFO:teuthology.orchestra.run.smithi155.stdout:(25/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.2 MB/s | 85 kB 00:00 2024-09-19T08:39:52.983 INFO:teuthology.orchestra.run.smithi155.stdout:(26/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 7.6 MB/s | 5.3 MB 00:00 2024-09-19T08:39:53.050 INFO:teuthology.orchestra.run.smithi155.stdout:(27/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 9.1 MB/s | 3.1 MB 00:00 2024-09-19T08:39:53.052 INFO:teuthology.orchestra.run.smithi019.stdout:(10/156): ceph-common-19.1.1-361.g2f599a46.el9. 5.8 MB/s | 21 MB 00:03 2024-09-19T08:39:53.075 INFO:teuthology.orchestra.run.smithi155.stdout:(28/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 1.8 MB/s | 171 kB 00:00 2024-09-19T08:39:53.092 INFO:teuthology.orchestra.run.smithi155.stdout:(29/156): ceph-grafana-dashboards-19.1.1-361.g2 760 kB/s | 32 kB 00:00 2024-09-19T08:39:53.134 INFO:teuthology.orchestra.run.smithi155.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.4 MB/s | 146 kB 00:00 2024-09-19T08:39:53.144 INFO:teuthology.orchestra.run.smithi019.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 2.4 MB/s | 228 kB 00:00 2024-09-19T08:39:53.202 INFO:teuthology.orchestra.run.smithi019.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 465 kB/s | 27 kB 00:00 2024-09-19T08:39:53.261 INFO:teuthology.orchestra.run.smithi019.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 543 kB/s | 32 kB 00:00 2024-09-19T08:39:53.428 INFO:teuthology.orchestra.run.smithi019.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 4.4 MB/s | 751 kB 00:00 2024-09-19T08:39:53.476 INFO:teuthology.orchestra.run.smithi155.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 9.3 MB/s | 3.6 MB 00:00 2024-09-19T08:39:53.511 INFO:teuthology.orchestra.run.smithi019.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 1.9 MB/s | 163 kB 00:00 2024-09-19T08:39:53.560 INFO:teuthology.orchestra.run.smithi155.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.9 MB/s | 249 kB 00:00 2024-09-19T08:39:53.595 INFO:teuthology.orchestra.run.smithi019.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 1.5 MB/s | 127 kB 00:00 2024-09-19T08:39:53.635 INFO:teuthology.orchestra.run.smithi155.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 657 kB/s | 49 kB 00:00 2024-09-19T08:39:53.710 INFO:teuthology.orchestra.run.smithi203.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:39:53.710 INFO:teuthology.orchestra.run.smithi155.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 219 kB/s | 16 kB 00:00 2024-09-19T08:39:53.711 INFO:teuthology.orchestra.run.smithi203.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T08:39:53.723 INFO:teuthology.orchestra.run.smithi203.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T08:39:53.724 INFO:teuthology.orchestra.run.smithi203.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T08:39:53.725 INFO:teuthology.orchestra.run.smithi203.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T08:39:53.726 INFO:teuthology.orchestra.run.smithi203.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T08:39:53.728 INFO:teuthology.orchestra.run.smithi203.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T08:39:53.729 INFO:teuthology.orchestra.run.smithi019.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 3.7 MB/s | 506 kB 00:00 2024-09-19T08:39:53.731 INFO:teuthology.orchestra.run.smithi203.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T08:39:53.732 INFO:teuthology.orchestra.run.smithi203.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T08:39:53.785 INFO:teuthology.orchestra.run.smithi155.stdout:(35/156): ceph-volume-19.1.1-361.g2f599a46.el9. 3.7 MB/s | 285 kB 00:00 2024-09-19T08:39:53.797 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-09-19T08:39:53.821 INFO:teuthology.orchestra.run.smithi203.stdout:====================================================================================== 2024-09-19T08:39:53.821 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repository Size 2024-09-19T08:39:53.821 INFO:teuthology.orchestra.run.smithi203.stdout:====================================================================================== 2024-09-19T08:39:53.822 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-09-19T08:39:53.822 INFO:teuthology.orchestra.run.smithi203.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T08:39:53.822 INFO:teuthology.orchestra.run.smithi203.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T08:39:53.822 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T08:39:53.822 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T08:39:53.822 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T08:39:53.822 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T08:39:53.822 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T08:39:53.822 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T08:39:53.822 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T08:39:53.823 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T08:39:53.823 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T08:39:53.823 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T08:39:53.823 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T08:39:53.823 INFO:teuthology.orchestra.run.smithi203.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T08:39:53.823 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T08:39:53.823 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T08:39:53.823 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T08:39:53.823 INFO:teuthology.orchestra.run.smithi203.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T08:39:53.823 INFO:teuthology.orchestra.run.smithi203.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T08:39:53.823 INFO:teuthology.orchestra.run.smithi203.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T08:39:53.824 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T08:39:53.824 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T08:39:53.824 INFO:teuthology.orchestra.run.smithi203.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T08:39:53.824 INFO:teuthology.orchestra.run.smithi203.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T08:39:53.824 INFO:teuthology.orchestra.run.smithi203.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T08:39:53.824 INFO:teuthology.orchestra.run.smithi203.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T08:39:53.824 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T08:39:53.824 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T08:39:53.824 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T08:39:53.824 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T08:39:53.825 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T08:39:53.825 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T08:39:53.825 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T08:39:53.825 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T08:39:53.825 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T08:39:53.825 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T08:39:53.825 INFO:teuthology.orchestra.run.smithi203.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T08:39:53.825 INFO:teuthology.orchestra.run.smithi203.stdout:Upgrading: 2024-09-19T08:39:53.825 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T08:39:53.825 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T08:39:53.826 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T08:39:53.826 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T08:39:53.826 INFO:teuthology.orchestra.run.smithi203.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T08:39:53.826 INFO:teuthology.orchestra.run.smithi203.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T08:39:53.826 INFO:teuthology.orchestra.run.smithi203.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T08:39:53.826 INFO:teuthology.orchestra.run.smithi203.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T08:39:53.826 INFO:teuthology.orchestra.run.smithi203.stdout:Installing dependencies: 2024-09-19T08:39:53.826 INFO:teuthology.orchestra.run.smithi203.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T08:39:53.826 INFO:teuthology.orchestra.run.smithi203.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T08:39:53.826 INFO:teuthology.orchestra.run.smithi203.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T08:39:53.827 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T08:39:53.827 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T08:39:53.827 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T08:39:53.827 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T08:39:53.827 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T08:39:53.827 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T08:39:53.827 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T08:39:53.827 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T08:39:53.827 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T08:39:53.827 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T08:39:53.827 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T08:39:53.827 INFO:teuthology.orchestra.run.smithi203.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T08:39:53.828 INFO:teuthology.orchestra.run.smithi203.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T08:39:53.828 INFO:teuthology.orchestra.run.smithi203.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T08:39:53.828 INFO:teuthology.orchestra.run.smithi203.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T08:39:53.828 INFO:teuthology.orchestra.run.smithi203.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T08:39:53.828 INFO:teuthology.orchestra.run.smithi203.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T08:39:53.828 INFO:teuthology.orchestra.run.smithi203.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T08:39:53.828 INFO:teuthology.orchestra.run.smithi203.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T08:39:53.828 INFO:teuthology.orchestra.run.smithi203.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T08:39:53.828 INFO:teuthology.orchestra.run.smithi203.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T08:39:53.828 INFO:teuthology.orchestra.run.smithi203.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T08:39:53.828 INFO:teuthology.orchestra.run.smithi203.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T08:39:53.828 INFO:teuthology.orchestra.run.smithi203.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T08:39:53.829 INFO:teuthology.orchestra.run.smithi203.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T08:39:53.829 INFO:teuthology.orchestra.run.smithi203.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T08:39:53.829 INFO:teuthology.orchestra.run.smithi203.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T08:39:53.829 INFO:teuthology.orchestra.run.smithi203.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T08:39:53.829 INFO:teuthology.orchestra.run.smithi203.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T08:39:53.829 INFO:teuthology.orchestra.run.smithi203.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T08:39:53.829 INFO:teuthology.orchestra.run.smithi203.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T08:39:53.829 INFO:teuthology.orchestra.run.smithi203.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T08:39:53.829 INFO:teuthology.orchestra.run.smithi203.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T08:39:53.829 INFO:teuthology.orchestra.run.smithi203.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T08:39:53.829 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T08:39:53.829 INFO:teuthology.orchestra.run.smithi203.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T08:39:53.830 INFO:teuthology.orchestra.run.smithi203.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T08:39:53.830 INFO:teuthology.orchestra.run.smithi203.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T08:39:53.830 INFO:teuthology.orchestra.run.smithi203.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T08:39:53.830 INFO:teuthology.orchestra.run.smithi203.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T08:39:53.830 INFO:teuthology.orchestra.run.smithi203.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T08:39:53.830 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T08:39:53.830 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T08:39:53.830 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T08:39:53.830 INFO:teuthology.orchestra.run.smithi203.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T08:39:53.830 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T08:39:53.830 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T08:39:53.831 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T08:39:53.831 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T08:39:53.831 INFO:teuthology.orchestra.run.smithi203.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T08:39:53.831 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T08:39:53.831 INFO:teuthology.orchestra.run.smithi203.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T08:39:53.831 INFO:teuthology.orchestra.run.smithi203.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T08:39:53.831 INFO:teuthology.orchestra.run.smithi203.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T08:39:53.831 INFO:teuthology.orchestra.run.smithi203.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T08:39:53.831 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T08:39:53.831 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T08:39:53.831 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T08:39:53.832 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T08:39:53.832 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T08:39:53.832 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T08:39:53.832 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T08:39:53.832 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T08:39:53.832 INFO:teuthology.orchestra.run.smithi203.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T08:39:53.832 INFO:teuthology.orchestra.run.smithi203.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T08:39:53.832 INFO:teuthology.orchestra.run.smithi203.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T08:39:53.832 INFO:teuthology.orchestra.run.smithi203.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T08:39:53.832 INFO:teuthology.orchestra.run.smithi203.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T08:39:53.832 INFO:teuthology.orchestra.run.smithi203.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T08:39:53.833 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T08:39:53.833 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T08:39:53.833 INFO:teuthology.orchestra.run.smithi203.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T08:39:53.833 INFO:teuthology.orchestra.run.smithi203.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T08:39:53.833 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T08:39:53.833 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T08:39:53.833 INFO:teuthology.orchestra.run.smithi203.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T08:39:53.833 INFO:teuthology.orchestra.run.smithi203.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T08:39:53.833 INFO:teuthology.orchestra.run.smithi203.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T08:39:53.833 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T08:39:53.833 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T08:39:53.834 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T08:39:53.834 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T08:39:53.834 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T08:39:53.834 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T08:39:53.834 INFO:teuthology.orchestra.run.smithi203.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T08:39:53.834 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T08:39:53.834 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T08:39:53.834 INFO:teuthology.orchestra.run.smithi203.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T08:39:53.834 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T08:39:53.834 INFO:teuthology.orchestra.run.smithi203.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T08:39:53.834 INFO:teuthology.orchestra.run.smithi203.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T08:39:53.834 INFO:teuthology.orchestra.run.smithi203.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T08:39:53.835 INFO:teuthology.orchestra.run.smithi203.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T08:39:53.835 INFO:teuthology.orchestra.run.smithi203.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T08:39:53.835 INFO:teuthology.orchestra.run.smithi203.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T08:39:53.835 INFO:teuthology.orchestra.run.smithi203.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T08:39:53.835 INFO:teuthology.orchestra.run.smithi203.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T08:39:53.835 INFO:teuthology.orchestra.run.smithi203.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T08:39:53.835 INFO:teuthology.orchestra.run.smithi203.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T08:39:53.835 INFO:teuthology.orchestra.run.smithi203.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T08:39:53.835 INFO:teuthology.orchestra.run.smithi203.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T08:39:53.835 INFO:teuthology.orchestra.run.smithi203.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T08:39:53.835 INFO:teuthology.orchestra.run.smithi203.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T08:39:53.836 INFO:teuthology.orchestra.run.smithi203.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T08:39:53.836 INFO:teuthology.orchestra.run.smithi203.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T08:39:53.836 INFO:teuthology.orchestra.run.smithi203.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T08:39:53.836 INFO:teuthology.orchestra.run.smithi203.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T08:39:53.836 INFO:teuthology.orchestra.run.smithi203.stdout:Installing weak dependencies: 2024-09-19T08:39:53.836 INFO:teuthology.orchestra.run.smithi203.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T08:39:53.836 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T08:39:53.836 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-09-19T08:39:53.836 INFO:teuthology.orchestra.run.smithi203.stdout:====================================================================================== 2024-09-19T08:39:53.836 INFO:teuthology.orchestra.run.smithi203.stdout:Install 148 Packages 2024-09-19T08:39:53.836 INFO:teuthology.orchestra.run.smithi203.stdout:Upgrade 8 Packages 2024-09-19T08:39:53.837 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T08:39:53.837 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 226 M 2024-09-19T08:39:53.837 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-09-19T08:39:53.919 INFO:teuthology.orchestra.run.smithi155.stdout:(36/156): cephadm-19.1.1-361.g2f599a46.el9.noar 5.6 MB/s | 765 kB 00:00 2024-09-19T08:39:53.986 INFO:teuthology.orchestra.run.smithi155.stdout:(37/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 273 kB/s | 18 kB 00:00 2024-09-19T08:39:54.046 INFO:teuthology.orchestra.run.smithi019.stdout:(18/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 4.8 MB/s | 11 MB 00:02 2024-09-19T08:39:54.061 INFO:teuthology.orchestra.run.smithi155.stdout:(38/156): fuse-2.9.9-16.el9.x86_64.rpm 1.0 MB/s | 80 kB 00:00 2024-09-19T08:39:54.113 INFO:teuthology.orchestra.run.smithi019.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 675 kB/s | 45 kB 00:00 2024-09-19T08:39:54.170 INFO:teuthology.orchestra.run.smithi155.stdout:(39/156): libgfortran-11.5.0-2.el9.x86_64.rpm 7.2 MB/s | 801 kB 00:00 2024-09-19T08:39:54.180 INFO:teuthology.orchestra.run.smithi019.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 2.0 MB/s | 136 kB 00:00 2024-09-19T08:39:54.247 INFO:teuthology.orchestra.run.smithi019.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 2.4 MB/s | 161 kB 00:00 2024-09-19T08:39:54.274 INFO:teuthology.orchestra.run.smithi155.stdout:(40/156): ceph-mgr-diskprediction-local-19.1.1- 6.5 MB/s | 7.4 MB 00:01 2024-09-19T08:39:54.316 INFO:teuthology.orchestra.run.smithi155.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-19T08:39:54.347 INFO:teuthology.orchestra.run.smithi019.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 3.1 MB/s | 320 kB 00:00 2024-09-19T08:39:54.383 INFO:teuthology.orchestra.run.smithi155.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-09-19T08:39:54.430 INFO:teuthology.orchestra.run.smithi019.stdout:(23/156): python3-rbd-19.1.1-361.g2f599a46.el9. 3.5 MB/s | 300 kB 00:00 2024-09-19T08:39:54.441 INFO:teuthology.orchestra.run.smithi155.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 9.8 MB/s | 1.2 MB 00:00 2024-09-19T08:39:54.475 INFO:teuthology.orchestra.run.smithi155.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2024-09-19T08:39:54.514 INFO:teuthology.orchestra.run.smithi019.stdout:(24/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 6.8 MB/s | 5.3 MB 00:00 2024-09-19T08:39:54.526 INFO:teuthology.orchestra.run.smithi155.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-09-19T08:39:54.539 INFO:teuthology.orchestra.run.smithi019.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 913 kB/s | 99 kB 00:00 2024-09-19T08:39:54.565 INFO:teuthology.orchestra.run.smithi019.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T08:39:54.567 INFO:teuthology.orchestra.run.smithi155.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-09-19T08:39:54.618 INFO:teuthology.orchestra.run.smithi155.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-19T08:39:54.623 INFO:teuthology.orchestra.run.smithi019.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.9 MB/s | 171 kB 00:00 2024-09-19T08:39:54.674 INFO:teuthology.orchestra.run.smithi019.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 637 kB/s | 32 kB 00:00 2024-09-19T08:39:54.732 INFO:teuthology.orchestra.run.smithi019.stdout:(29/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.5 MB/s | 146 kB 00:00 2024-09-19T08:39:54.735 INFO:teuthology.orchestra.run.smithi155.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 4.0 MB/s | 689 kB 00:00 2024-09-19T08:39:54.766 INFO:teuthology.orchestra.run.smithi203.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 46 kB/s | 6.6 kB 00:00 2024-09-19T08:39:54.794 INFO:teuthology.orchestra.run.smithi155.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 5.3 MB/s | 943 kB 00:00 2024-09-19T08:39:54.827 INFO:teuthology.orchestra.run.smithi155.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.1 MB/s | 107 kB 00:00 2024-09-19T08:39:54.853 INFO:teuthology.orchestra.run.smithi155.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 369 kB/s | 22 kB 00:00 2024-09-19T08:39:54.893 INFO:teuthology.orchestra.run.smithi155.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 313 kB 00:00 2024-09-19T08:39:54.920 INFO:teuthology.orchestra.run.smithi155.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 488 kB/s | 33 kB 00:00 2024-09-19T08:39:54.962 INFO:teuthology.orchestra.run.smithi155.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 435 kB/s | 18 kB 00:00 2024-09-19T08:39:55.003 INFO:teuthology.orchestra.run.smithi155.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 268 kB/s | 11 kB 00:00 2024-09-19T08:39:55.024 INFO:teuthology.orchestra.run.smithi019.stdout:(30/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 6.4 MB/s | 3.1 MB 00:00 2024-09-19T08:39:55.070 INFO:teuthology.orchestra.run.smithi155.stdout:(56/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 160 kB 00:00 2024-09-19T08:39:55.112 INFO:teuthology.orchestra.run.smithi155.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-19T08:39:55.133 INFO:teuthology.orchestra.run.smithi203.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 2.4 MB/s | 896 kB 00:00 2024-09-19T08:39:55.171 INFO:teuthology.orchestra.run.smithi155.stdout:(58/156): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-19T08:39:55.210 INFO:teuthology.orchestra.run.smithi019.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 7.5 MB/s | 3.6 MB 00:00 2024-09-19T08:39:55.225 INFO:teuthology.orchestra.run.smithi203.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.5 MB/s | 145 kB 00:00 2024-09-19T08:39:55.292 INFO:teuthology.orchestra.run.smithi019.stdout:(32/156): ceph-mgr-modules-core-19.1.1-361.g2f5 3.0 MB/s | 249 kB 00:00 2024-09-19T08:39:55.355 INFO:teuthology.orchestra.run.smithi155.stdout:(59/156): libtool-2.4.6-46.el9.x86_64.rpm 3.1 MB/s | 581 kB 00:00 2024-09-19T08:39:55.358 INFO:teuthology.orchestra.run.smithi019.stdout:(33/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 742 kB/s | 49 kB 00:00 2024-09-19T08:39:55.397 INFO:teuthology.orchestra.run.smithi155.stdout:(60/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 585 kB/s | 24 kB 00:00 2024-09-19T08:39:55.417 INFO:teuthology.orchestra.run.smithi019.stdout:(34/156): ceph-prometheus-alerts-19.1.1-361.g2f 281 kB/s | 16 kB 00:00 2024-09-19T08:39:55.447 INFO:teuthology.orchestra.run.smithi155.stdout:(61/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 950 kB/s | 47 kB 00:00 2024-09-19T08:39:55.484 INFO:teuthology.orchestra.run.smithi019.stdout:(35/156): ceph-volume-19.1.1-361.g2f599a46.el9. 4.2 MB/s | 285 kB 00:00 2024-09-19T08:39:55.547 INFO:teuthology.orchestra.run.smithi155.stdout:(62/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.9 MB/s | 292 kB 00:00 2024-09-19T08:39:55.614 INFO:teuthology.orchestra.run.smithi155.stdout:(63/156): lua-5.4.4-4.el9.x86_64.rpm 2.8 MB/s | 188 kB 00:00 2024-09-19T08:39:55.642 INFO:teuthology.orchestra.run.smithi019.stdout:(36/156): cephadm-19.1.1-361.g2f599a46.el9.noar 4.7 MB/s | 765 kB 00:00 2024-09-19T08:39:55.656 INFO:teuthology.orchestra.run.smithi155.stdout:(64/156): openblas-0.3.26-2.el9.x86_64.rpm 921 kB/s | 38 kB 00:00 2024-09-19T08:39:55.709 INFO:teuthology.orchestra.run.smithi019.stdout:(37/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 274 kB/s | 18 kB 00:00 2024-09-19T08:39:55.798 INFO:teuthology.orchestra.run.smithi155.stdout:(65/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.3 MB/s | 3.0 MB 00:00 2024-09-19T08:39:55.800 INFO:teuthology.orchestra.run.smithi203.stdout:(4/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 4.1 MB/s | 2.4 MB 00:00 2024-09-19T08:39:55.926 INFO:teuthology.orchestra.run.smithi203.stdout:(5/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 4.2 MB/s | 5.4 MB 00:01 2024-09-19T08:39:56.084 INFO:teuthology.orchestra.run.smithi203.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 5.4 MB/s | 1.5 MB 00:00 2024-09-19T08:39:56.332 INFO:teuthology.orchestra.run.smithi155.stdout:(66/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 9.7 MB/s | 49 MB 00:05 2024-09-19T08:39:56.385 INFO:teuthology.orchestra.run.smithi019.stdout:(38/156): ceph-mgr-diskprediction-local-19.1.1- 5.4 MB/s | 7.4 MB 00:01 2024-09-19T08:39:56.410 INFO:teuthology.orchestra.run.smithi019.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 114 kB/s | 80 kB 00:00 2024-09-19T08:39:56.418 INFO:teuthology.orchestra.run.smithi203.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 9.6 MB/s | 4.7 MB 00:00 2024-09-19T08:39:56.724 INFO:teuthology.orchestra.run.smithi155.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 4.1 MB/s | 1.6 MB 00:00 2024-09-19T08:39:56.958 INFO:teuthology.orchestra.run.smithi155.stdout:(68/156): postgresql-contrib-13.16-1.el9.x86_64 3.8 MB/s | 910 kB 00:00 2024-09-19T08:39:57.033 INFO:teuthology.orchestra.run.smithi155.stdout:(69/156): postgresql-private-libs-13.16-1.el9.x 1.8 MB/s | 137 kB 00:00 2024-09-19T08:39:57.118 INFO:teuthology.orchestra.run.smithi203.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 8.5 MB/s | 21 MB 00:02 2024-09-19T08:39:57.160 INFO:teuthology.orchestra.run.smithi203.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 605 kB/s | 25 kB 00:00 2024-09-19T08:39:57.217 INFO:teuthology.orchestra.run.smithi155.stdout:(70/156): openblas-openmp-0.3.26-2.el9.x86_64.r 3.2 MB/s | 4.9 MB 00:01 2024-09-19T08:39:57.236 INFO:teuthology.orchestra.run.smithi019.stdout:(40/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 11 MB/s | 49 MB 00:04 2024-09-19T08:39:57.277 INFO:teuthology.orchestra.run.smithi203.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 12 MB/s | 11 MB 00:00 2024-09-19T08:39:57.325 INFO:teuthology.orchestra.run.smithi155.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 2.9 MB/s | 4.4 MB 00:01 2024-09-19T08:39:57.352 INFO:teuthology.orchestra.run.smithi203.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 3.0 MB/s | 228 kB 00:00 2024-09-19T08:39:57.384 INFO:teuthology.orchestra.run.smithi155.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-19T08:39:57.511 INFO:teuthology.orchestra.run.smithi203.stdout:(12/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 12 MB/s | 17 MB 00:01 2024-09-19T08:39:57.536 INFO:teuthology.orchestra.run.smithi203.stdout:(13/156): cephfs-shell-19.1.1-361.g2f599a46.el9 147 kB/s | 27 kB 00:00 2024-09-19T08:39:57.561 INFO:teuthology.orchestra.run.smithi203.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 635 kB/s | 32 kB 00:00 2024-09-19T08:39:57.576 INFO:teuthology.orchestra.run.smithi155.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 2.8 MB/s | 1.0 MB 00:00 2024-09-19T08:39:57.594 INFO:teuthology.orchestra.run.smithi019.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 161 kB/s | 191 kB 00:01 2024-09-19T08:39:57.595 INFO:teuthology.orchestra.run.smithi203.stdout:(15/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 13 MB/s | 751 kB 00:00 2024-09-19T08:39:57.609 INFO:teuthology.orchestra.run.smithi155.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.8 MB/s | 61 kB 00:00 2024-09-19T08:39:57.620 INFO:teuthology.orchestra.run.smithi203.stdout:(16/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.7 MB/s | 163 kB 00:00 2024-09-19T08:39:57.646 INFO:teuthology.orchestra.run.smithi203.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 2.5 MB/s | 127 kB 00:00 2024-09-19T08:39:57.671 INFO:teuthology.orchestra.run.smithi203.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 9.8 MB/s | 506 kB 00:00 2024-09-19T08:39:57.701 INFO:teuthology.orchestra.run.smithi155.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-09-19T08:39:57.721 INFO:teuthology.orchestra.run.smithi203.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 904 kB/s | 45 kB 00:00 2024-09-19T08:39:57.785 INFO:teuthology.orchestra.run.smithi155.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-09-19T08:39:57.797 INFO:teuthology.orchestra.run.smithi203.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.8 MB/s | 136 kB 00:00 2024-09-19T08:39:57.818 INFO:teuthology.orchestra.run.smithi155.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 774 kB/s | 26 kB 00:00 2024-09-19T08:39:57.852 INFO:teuthology.orchestra.run.smithi155.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 575 kB/s | 19 kB 00:00 2024-09-19T08:39:57.914 INFO:teuthology.orchestra.run.smithi203.stdout:(21/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 20 MB/s | 5.3 MB 00:00 2024-09-19T08:39:57.939 INFO:teuthology.orchestra.run.smithi203.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 1.1 MB/s | 161 kB 00:00 2024-09-19T08:39:57.952 INFO:teuthology.orchestra.run.smithi155.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-09-19T08:39:57.972 INFO:teuthology.orchestra.run.smithi203.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 5.4 MB/s | 320 kB 00:00 2024-09-19T08:39:57.994 INFO:teuthology.orchestra.run.smithi019.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 334 kB/s | 253 kB 00:00 2024-09-19T08:39:57.995 INFO:teuthology.orchestra.run.smithi155.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 837 kB/s | 35 kB 00:00 2024-09-19T08:39:57.998 INFO:teuthology.orchestra.run.smithi203.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 5.0 MB/s | 300 kB 00:00 2024-09-19T08:39:58.023 INFO:teuthology.orchestra.run.smithi203.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T08:39:58.048 INFO:teuthology.orchestra.run.smithi203.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T08:39:58.099 INFO:teuthology.orchestra.run.smithi203.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 3.3 MB/s | 171 kB 00:00 2024-09-19T08:39:58.128 INFO:teuthology.orchestra.run.smithi019.stdout:(43/156): libgfortran-11.5.0-2.el9.x86_64.rpm 460 kB/s | 801 kB 00:01 2024-09-19T08:39:58.153 INFO:teuthology.orchestra.run.smithi155.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 5.2 MB/s | 5.8 MB 00:01 2024-09-19T08:39:58.166 INFO:teuthology.orchestra.run.smithi203.stdout:(28/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 22 MB/s | 3.1 MB 00:00 2024-09-19T08:39:58.191 INFO:teuthology.orchestra.run.smithi203.stdout:(29/156): ceph-grafana-dashboards-19.1.1-361.g2 347 kB/s | 32 kB 00:00 2024-09-19T08:39:58.195 INFO:teuthology.orchestra.run.smithi155.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.9 MB/s | 250 kB 00:00 2024-09-19T08:39:58.225 INFO:teuthology.orchestra.run.smithi203.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.4 MB/s | 146 kB 00:00 2024-09-19T08:39:58.237 INFO:teuthology.orchestra.run.smithi155.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 5.2 MB/s | 222 kB 00:00 2024-09-19T08:39:58.295 INFO:teuthology.orchestra.run.smithi155.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-09-19T08:39:58.337 INFO:teuthology.orchestra.run.smithi155.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-19T08:39:58.379 INFO:teuthology.orchestra.run.smithi155.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 6.3 MB/s | 269 kB 00:00 2024-09-19T08:39:58.421 INFO:teuthology.orchestra.run.smithi155.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.7 MB/s | 159 kB 00:00 2024-09-19T08:39:58.463 INFO:teuthology.orchestra.run.smithi155.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 6.5 MB/s | 279 kB 00:00 2024-09-19T08:39:58.505 INFO:teuthology.orchestra.run.smithi155.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-19T08:39:58.533 INFO:teuthology.orchestra.run.smithi203.stdout:(31/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 10 MB/s | 3.6 MB 00:00 2024-09-19T08:39:58.547 INFO:teuthology.orchestra.run.smithi155.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 54 kB 00:00 2024-09-19T08:39:58.578 INFO:teuthology.orchestra.run.smithi019.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 1.2 MB/s | 1.2 MB 00:00 2024-09-19T08:39:58.634 INFO:teuthology.orchestra.run.smithi203.stdout:(32/156): ceph-mgr-diskprediction-local-19.1.1- 18 MB/s | 7.4 MB 00:00 2024-09-19T08:39:58.670 INFO:teuthology.orchestra.run.smithi019.stdout:(45/156): python3-ply-3.11-14.el9.noarch.rpm 158 kB/s | 106 kB 00:00 2024-09-19T08:39:58.676 INFO:teuthology.orchestra.run.smithi203.stdout:(33/156): ceph-mgr-modules-core-19.1.1-361.g2f5 1.7 MB/s | 249 kB 00:00 2024-09-19T08:39:58.701 INFO:teuthology.orchestra.run.smithi203.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 739 kB/s | 49 kB 00:00 2024-09-19T08:39:58.726 INFO:teuthology.orchestra.run.smithi203.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 328 kB/s | 16 kB 00:00 2024-09-19T08:39:58.752 INFO:teuthology.orchestra.run.smithi203.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 5.5 MB/s | 285 kB 00:00 2024-09-19T08:39:58.786 INFO:teuthology.orchestra.run.smithi203.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 13 MB/s | 765 kB 00:00 2024-09-19T08:39:58.811 INFO:teuthology.orchestra.run.smithi203.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 311 kB/s | 18 kB 00:00 2024-09-19T08:39:58.829 INFO:teuthology.orchestra.run.smithi019.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 193 kB/s | 135 kB 00:00 2024-09-19T08:39:58.873 INFO:teuthology.orchestra.run.smithi155.stdout:(91/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 50 MB/s | 16 MB 00:00 2024-09-19T08:39:58.953 INFO:teuthology.orchestra.run.smithi203.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 478 kB/s | 80 kB 00:00 2024-09-19T08:39:58.964 INFO:teuthology.orchestra.run.smithi155.stdout:(92/156): python3-babel-2.9.1-2.el9.noarch.rpm 3.8 MB/s | 6.0 MB 00:01 2024-09-19T08:39:58.982 INFO:teuthology.orchestra.run.smithi155.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 384 kB/s | 42 kB 00:00 2024-09-19T08:39:58.998 INFO:teuthology.orchestra.run.smithi155.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.3 MB/s | 44 kB 00:00 2024-09-19T08:39:59.024 INFO:teuthology.orchestra.run.smithi155.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 5.1 MB/s | 221 kB 00:00 2024-09-19T08:39:59.036 INFO:teuthology.orchestra.run.smithi203.stdout:(40/156): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-19T08:39:59.041 INFO:teuthology.orchestra.run.smithi155.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 850 kB/s | 36 kB 00:00 2024-09-19T08:39:59.060 INFO:teuthology.orchestra.run.smithi155.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-19T08:39:59.062 INFO:teuthology.orchestra.run.smithi203.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 3.1 MB/s | 801 kB 00:00 2024-09-19T08:39:59.091 INFO:teuthology.orchestra.run.smithi155.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-19T08:39:59.108 INFO:teuthology.orchestra.run.smithi155.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-19T08:39:59.175 INFO:teuthology.orchestra.run.smithi155.stdout:(100/156): python3-numpy-1.20.1-5.el9.x86_64.rp 4.3 MB/s | 5.1 MB 00:01 2024-09-19T08:39:59.201 INFO:teuthology.orchestra.run.smithi155.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 878 kB/s | 96 kB 00:00 2024-09-19T08:39:59.217 INFO:teuthology.orchestra.run.smithi155.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 584 kB/s | 64 kB 00:00 2024-09-19T08:39:59.234 INFO:teuthology.orchestra.run.smithi155.stdout:(103/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 763 kB/s | 45 kB 00:00 2024-09-19T08:39:59.285 INFO:teuthology.orchestra.run.smithi155.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-19T08:39:59.301 INFO:teuthology.orchestra.run.smithi155.stdout:(105/156): lua-devel-5.4.4-4.el9.x86_64.rpm 222 kB/s | 22 kB 00:00 2024-09-19T08:39:59.327 INFO:teuthology.orchestra.run.smithi155.stdout:(106/156): gperftools-libs-2.9.1-3.el9.x86_64.r 7.2 MB/s | 308 kB 00:00 2024-09-19T08:39:59.344 INFO:teuthology.orchestra.run.smithi155.stdout:(107/156): grpc-data-1.46.7-10.el9.noarch.rpm 463 kB/s | 19 kB 00:00 2024-09-19T08:39:59.346 INFO:teuthology.orchestra.run.smithi019.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 163 kB/s | 125 kB 00:00 2024-09-19T08:39:59.377 INFO:teuthology.orchestra.run.smithi155.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 972 kB/s | 26 kB 00:00 2024-09-19T08:39:59.411 INFO:teuthology.orchestra.run.smithi155.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.5 MB/s | 49 kB 00:00 2024-09-19T08:39:59.429 INFO:teuthology.orchestra.run.smithi019.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 283 kB/s | 215 kB 00:00 2024-09-19T08:39:59.437 INFO:teuthology.orchestra.run.smithi155.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-19T08:39:59.462 INFO:teuthology.orchestra.run.smithi155.stdout:(111/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.7 MB/s | 863 kB 00:00 2024-09-19T08:39:59.487 INFO:teuthology.orchestra.run.smithi155.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-19T08:39:59.562 INFO:teuthology.orchestra.run.smithi155.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 7.8 MB/s | 548 kB 00:00 2024-09-19T08:39:59.596 INFO:teuthology.orchestra.run.smithi155.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.3 MB/s | 43 kB 00:00 2024-09-19T08:39:59.630 INFO:teuthology.orchestra.run.smithi155.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 968 kB/s | 32 kB 00:00 2024-09-19T08:39:59.655 INFO:teuthology.orchestra.run.smithi155.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 565 kB/s | 14 kB 00:00 2024-09-19T08:39:59.662 INFO:teuthology.orchestra.run.smithi203.stdout:(42/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 19 MB/s | 49 MB 00:02 2024-09-19T08:39:59.680 INFO:teuthology.orchestra.run.smithi155.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-19T08:39:59.687 INFO:teuthology.orchestra.run.smithi203.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 389 kB/s | 253 kB 00:00 2024-09-19T08:39:59.714 INFO:teuthology.orchestra.run.smithi155.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 11 MB/s | 358 kB 00:00 2024-09-19T08:39:59.729 INFO:teuthology.orchestra.run.smithi203.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 1.8 MB/s | 1.2 MB 00:00 2024-09-19T08:39:59.747 INFO:teuthology.orchestra.run.smithi155.stdout:(119/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 2.9 MB/s | 839 kB 00:00 2024-09-19T08:39:59.771 INFO:teuthology.orchestra.run.smithi203.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-09-19T08:39:59.773 INFO:teuthology.orchestra.run.smithi155.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.0 MB/s | 303 kB 00:00 2024-09-19T08:39:59.779 INFO:teuthology.orchestra.run.smithi019.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 731 kB/s | 689 kB 00:00 2024-09-19T08:39:59.806 INFO:teuthology.orchestra.run.smithi155.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-19T08:39:59.813 INFO:teuthology.orchestra.run.smithi203.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-09-19T08:39:59.838 INFO:teuthology.orchestra.run.smithi203.stdout:(47/156): python3-ply-3.11-14.el9.noarch.rpm 606 kB/s | 106 kB 00:00 2024-09-19T08:39:59.840 INFO:teuthology.orchestra.run.smithi155.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-19T08:39:59.864 INFO:teuthology.orchestra.run.smithi203.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-19T08:39:59.865 INFO:teuthology.orchestra.run.smithi155.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 432 kB/s | 11 kB 00:00 2024-09-19T08:39:59.890 INFO:teuthology.orchestra.run.smithi155.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 700 kB/s | 18 kB 00:00 2024-09-19T08:39:59.908 INFO:teuthology.orchestra.run.smithi155.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 1.3 MB/s | 23 kB 00:00 2024-09-19T08:39:59.950 INFO:teuthology.orchestra.run.smithi155.stdout:(126/156): python3-grpcio-1.46.7-10.el9.x86_64. 12 MB/s | 2.0 MB 00:00 2024-09-19T08:39:59.967 INFO:teuthology.orchestra.run.smithi155.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 332 kB/s | 19 kB 00:00 2024-09-19T08:39:59.984 INFO:teuthology.orchestra.run.smithi155.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 585 kB/s | 20 kB 00:00 2024-09-19T08:39:59.997 INFO:teuthology.orchestra.run.smithi203.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 802 kB/s | 107 kB 00:00 2024-09-19T08:40:00.000 INFO:teuthology.orchestra.run.smithi155.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-19T08:40:00.026 INFO:teuthology.orchestra.run.smithi155.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T08:40:00.039 INFO:teuthology.orchestra.run.smithi203.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 3.0 MB/s | 689 kB 00:00 2024-09-19T08:40:00.065 INFO:teuthology.orchestra.run.smithi203.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 324 kB/s | 22 kB 00:00 2024-09-19T08:40:00.093 INFO:teuthology.orchestra.run.smithi155.stdout:(131/156): libarrow-9.0.0-11.el9.x86_64.rpm 5.8 MB/s | 4.4 MB 00:00 2024-09-19T08:40:00.105 INFO:teuthology.orchestra.run.smithi019.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 158 kB/s | 107 kB 00:00 2024-09-19T08:40:00.107 INFO:teuthology.orchestra.run.smithi203.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 3.4 MB/s | 943 kB 00:00 2024-09-19T08:40:00.110 INFO:teuthology.orchestra.run.smithi155.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 688 kB/s | 58 kB 00:00 2024-09-19T08:40:00.127 INFO:teuthology.orchestra.run.smithi155.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 996 kB/s | 16 kB 00:00 2024-09-19T08:40:00.132 INFO:teuthology.orchestra.run.smithi203.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 313 kB 00:00 2024-09-19T08:40:00.152 INFO:teuthology.orchestra.run.smithi155.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 4.5 MB/s | 272 kB 00:00 2024-09-19T08:40:00.157 INFO:teuthology.orchestra.run.smithi203.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 354 kB/s | 33 kB 00:00 2024-09-19T08:40:00.177 INFO:teuthology.orchestra.run.smithi155.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-09-19T08:40:00.194 INFO:teuthology.orchestra.run.smithi155.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 672 kB/s | 28 kB 00:00 2024-09-19T08:40:00.199 INFO:teuthology.orchestra.run.smithi203.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 439 kB/s | 18 kB 00:00 2024-09-19T08:40:00.211 INFO:teuthology.orchestra.run.smithi155.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 912 kB/s | 31 kB 00:00 2024-09-19T08:40:00.224 INFO:teuthology.orchestra.run.smithi203.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 167 kB/s | 11 kB 00:00 2024-09-19T08:40:00.245 INFO:teuthology.orchestra.run.smithi155.stdout:(138/156): python3-kubernetes-26.1.0-2.el9.noar 3.7 MB/s | 1.0 MB 00:00 2024-09-19T08:40:00.258 INFO:teuthology.orchestra.run.smithi203.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-19T08:40:00.263 INFO:teuthology.orchestra.run.smithi019.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 943 kB 00:00 2024-09-19T08:40:00.270 INFO:teuthology.orchestra.run.smithi155.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-19T08:40:00.284 INFO:teuthology.orchestra.run.smithi203.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 770 kB/s | 45 kB 00:00 2024-09-19T08:40:00.295 INFO:teuthology.orchestra.run.smithi155.stdout:(140/156): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-19T08:40:00.321 INFO:teuthology.orchestra.run.smithi155.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 472 kB/s | 36 kB 00:00 2024-09-19T08:40:00.334 INFO:teuthology.orchestra.run.smithi203.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-09-19T08:40:00.346 INFO:teuthology.orchestra.run.smithi155.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 985 kB/s | 74 kB 00:00 2024-09-19T08:40:00.366 INFO:teuthology.orchestra.run.smithi203.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 662 kB 00:00 2024-09-19T08:40:00.371 INFO:teuthology.orchestra.run.smithi155.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-19T08:40:00.372 INFO:teuthology.orchestra.run.smithi019.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 37 kB/s | 22 kB 00:00 2024-09-19T08:40:00.391 INFO:teuthology.orchestra.run.smithi203.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 431 kB/s | 24 kB 00:00 2024-09-19T08:40:00.396 INFO:teuthology.orchestra.run.smithi155.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-19T08:40:00.416 INFO:teuthology.orchestra.run.smithi203.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-19T08:40:00.422 INFO:teuthology.orchestra.run.smithi155.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-19T08:40:00.442 INFO:teuthology.orchestra.run.smithi203.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-19T08:40:00.447 INFO:teuthology.orchestra.run.smithi155.stdout:(146/156): python3-werkzeug-2.0.3-3.el9.1.noarc 4.1 MB/s | 427 kB 00:00 2024-09-19T08:40:00.467 INFO:teuthology.orchestra.run.smithi203.stdout:(64/156): libtool-2.4.6-46.el9.x86_64.rpm 3.1 MB/s | 581 kB 00:00 2024-09-19T08:40:00.473 INFO:teuthology.orchestra.run.smithi155.stdout:(147/156): re2-20211101-20.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-09-19T08:40:00.492 INFO:teuthology.orchestra.run.smithi203.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 767 kB/s | 38 kB 00:00 2024-09-19T08:40:00.517 INFO:teuthology.orchestra.run.smithi203.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-09-19T08:40:00.523 INFO:teuthology.orchestra.run.smithi155.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-19T08:40:00.610 INFO:teuthology.orchestra.run.smithi203.stdout:(67/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-19T08:40:00.660 INFO:teuthology.orchestra.run.smithi203.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-19T08:40:00.665 INFO:teuthology.orchestra.run.smithi155.stdout:(149/156): NetworkManager-1.51.0-1.el9.x86_64.r 16 MB/s | 2.3 MB 00:00 2024-09-19T08:40:00.702 INFO:teuthology.orchestra.run.smithi203.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 9.6 MB/s | 910 kB 00:00 2024-09-19T08:40:00.755 INFO:teuthology.orchestra.run.smithi203.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.4 MB/s | 137 kB 00:00 2024-09-19T08:40:00.806 INFO:teuthology.orchestra.run.smithi019.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 60 kB/s | 33 kB 00:00 2024-09-19T08:40:00.815 INFO:teuthology.orchestra.run.smithi155.stdout:(150/156): NetworkManager-libnm-1.51.0-1.el9.x8 12 MB/s | 1.8 MB 00:00 2024-09-19T08:40:00.828 INFO:teuthology.orchestra.run.smithi203.stdout:(71/156): openblas-openmp-0.3.26-2.el9.x86_64.r 14 MB/s | 4.9 MB 00:00 2024-09-19T08:40:00.861 INFO:teuthology.orchestra.run.smithi203.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 9.5 MB/s | 1.0 MB 00:00 2024-09-19T08:40:00.887 INFO:teuthology.orchestra.run.smithi203.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-19T08:40:00.890 INFO:teuthology.orchestra.run.smithi155.stdout:(151/156): librbd1-19.1.1-361.g2f599a46.el9.x86 7.6 MB/s | 3.2 MB 00:00 2024-09-19T08:40:00.915 INFO:teuthology.orchestra.run.smithi155.stdout:(152/156): NetworkManager-team-1.51.0-1.el9.x86 409 kB/s | 41 kB 00:00 2024-09-19T08:40:00.937 INFO:teuthology.orchestra.run.smithi203.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-19T08:40:00.981 INFO:teuthology.orchestra.run.smithi019.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 358 kB/s | 313 kB 00:00 2024-09-19T08:40:01.008 INFO:teuthology.orchestra.run.smithi155.stdout:(153/156): librados2-19.1.1-361.g2f599a46.el9.x 6.1 MB/s | 3.4 MB 00:00 2024-09-19T08:40:01.012 INFO:teuthology.orchestra.run.smithi203.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 19 MB/s | 5.8 MB 00:00 2024-09-19T08:40:01.033 INFO:teuthology.orchestra.run.smithi155.stdout:(154/156): NetworkManager-tui-1.51.0-1.el9.x86_ 1.7 MB/s | 249 kB 00:00 2024-09-19T08:40:01.037 INFO:teuthology.orchestra.run.smithi203.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-19T08:40:01.063 INFO:teuthology.orchestra.run.smithi203.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-19T08:40:01.088 INFO:teuthology.orchestra.run.smithi203.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-09-19T08:40:01.113 INFO:teuthology.orchestra.run.smithi203.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-09-19T08:40:01.139 INFO:teuthology.orchestra.run.smithi203.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-19T08:40:01.164 INFO:teuthology.orchestra.run.smithi203.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 691 kB/s | 35 kB 00:00 2024-09-19T08:40:01.200 INFO:teuthology.orchestra.run.smithi155.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 4.8 MB/s | 1.4 MB 00:00 2024-09-19T08:40:01.256 INFO:teuthology.orchestra.run.smithi203.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-19T08:40:01.281 INFO:teuthology.orchestra.run.smithi203.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.1 MB/s | 250 kB 00:00 2024-09-19T08:40:01.306 INFO:teuthology.orchestra.run.smithi203.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-19T08:40:01.314 INFO:teuthology.orchestra.run.smithi019.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 36 kB/s | 18 kB 00:00 2024-09-19T08:40:01.332 INFO:teuthology.orchestra.run.smithi203.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-19T08:40:01.349 INFO:teuthology.orchestra.run.smithi203.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-09-19T08:40:01.383 INFO:teuthology.orchestra.run.smithi203.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-19T08:40:01.408 INFO:teuthology.orchestra.run.smithi203.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-09-19T08:40:01.457 INFO:teuthology.orchestra.run.smithi019.stdout:(56/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.8 MB/s | 3.0 MB 00:01 2024-09-19T08:40:01.473 INFO:teuthology.orchestra.run.smithi019.stdout:(57/156): libaio-devel-0.3.111-13.el9.x86_64.rp 23 kB/s | 11 kB 00:00 2024-09-19T08:40:01.475 INFO:teuthology.orchestra.run.smithi203.stdout:(89/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 15 MB/s | 5.1 MB 00:00 2024-09-19T08:40:01.492 INFO:teuthology.orchestra.run.smithi203.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 610 kB/s | 51 kB 00:00 2024-09-19T08:40:01.517 INFO:teuthology.orchestra.run.smithi203.stdout:(91/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.0 MB/s | 279 kB 00:00 2024-09-19T08:40:01.534 INFO:teuthology.orchestra.run.smithi203.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 913 kB/s | 54 kB 00:00 2024-09-19T08:40:01.542 INFO:teuthology.orchestra.run.smithi155.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 4.5 MB/s | 2.4 MB 00:00 2024-09-19T08:40:01.547 INFO:teuthology.orchestra.run.smithi155.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:40:01.547 INFO:teuthology.orchestra.run.smithi155.stdout:Total 16 MB/s | 226 MB 00:13 2024-09-19T08:40:01.559 INFO:teuthology.orchestra.run.smithi203.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 997 kB/s | 42 kB 00:00 2024-09-19T08:40:01.576 INFO:teuthology.orchestra.run.smithi203.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-09-19T08:40:01.618 INFO:teuthology.orchestra.run.smithi203.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-19T08:40:01.644 INFO:teuthology.orchestra.run.smithi203.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 535 kB/s | 36 kB 00:00 2024-09-19T08:40:01.669 INFO:teuthology.orchestra.run.smithi203.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-19T08:40:01.694 INFO:teuthology.orchestra.run.smithi203.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-19T08:40:01.720 INFO:teuthology.orchestra.run.smithi203.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-19T08:40:01.745 INFO:teuthology.orchestra.run.smithi203.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-19T08:40:01.770 INFO:teuthology.orchestra.run.smithi203.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-19T08:40:01.796 INFO:teuthology.orchestra.run.smithi203.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-09-19T08:40:01.880 INFO:teuthology.orchestra.run.smithi203.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-09-19T08:40:02.032 INFO:teuthology.orchestra.run.smithi019.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 79 kB/s | 45 kB 00:00 2024-09-19T08:40:02.046 INFO:teuthology.orchestra.run.smithi203.stdout:(104/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-09-19T08:40:02.088 INFO:teuthology.orchestra.run.smithi203.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 2.6 MB/s | 548 kB 00:00 2024-09-19T08:40:02.113 INFO:teuthology.orchestra.run.smithi203.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 848 kB/s | 19 kB 00:00 2024-09-19T08:40:02.147 INFO:teuthology.orchestra.run.smithi203.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.4 MB/s | 863 kB 00:00 2024-09-19T08:40:02.157 INFO:teuthology.orchestra.run.smithi019.stdout:(59/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 190 kB/s | 160 kB 00:00 2024-09-19T08:40:02.181 INFO:teuthology.orchestra.run.smithi203.stdout:(108/156): gperftools-libs-2.9.1-3.el9.x86_64.r 2.2 MB/s | 308 kB 00:00 2024-09-19T08:40:02.206 INFO:teuthology.orchestra.run.smithi203.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 2.0 MB/s | 49 kB 00:00 2024-09-19T08:40:02.231 INFO:teuthology.orchestra.run.smithi203.stdout:(110/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 310 kB/s | 26 kB 00:00 2024-09-19T08:40:02.265 INFO:teuthology.orchestra.run.smithi203.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-09-19T08:40:02.299 INFO:teuthology.orchestra.run.smithi203.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-19T08:40:02.340 INFO:teuthology.orchestra.run.smithi203.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-09-19T08:40:02.366 INFO:teuthology.orchestra.run.smithi203.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T08:40:02.391 INFO:teuthology.orchestra.run.smithi203.stdout:(115/156): python3-asyncssh-2.13.2-5.el9.noarch 5.8 MB/s | 548 kB 00:00 2024-09-19T08:40:02.416 INFO:teuthology.orchestra.run.smithi019.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 703 kB/s | 662 kB 00:00 2024-09-19T08:40:02.416 INFO:teuthology.orchestra.run.smithi203.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 641 kB/s | 32 kB 00:00 2024-09-19T08:40:02.442 INFO:teuthology.orchestra.run.smithi203.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-19T08:40:02.467 INFO:teuthology.orchestra.run.smithi203.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-19T08:40:02.492 INFO:teuthology.orchestra.run.smithi203.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-19T08:40:02.518 INFO:teuthology.orchestra.run.smithi203.stdout:(120/156): python3-google-auth-2.34.0-1.el9.noa 8.6 MB/s | 220 kB 00:00 2024-09-19T08:40:02.543 INFO:teuthology.orchestra.run.smithi203.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-09-19T08:40:02.586 INFO:teuthology.orchestra.run.smithi203.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-09-19T08:40:02.611 INFO:teuthology.orchestra.run.smithi203.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-19T08:40:02.678 INFO:teuthology.orchestra.run.smithi203.stdout:(124/156): libarrow-9.0.0-11.el9.x86_64.rpm 7.8 MB/s | 4.4 MB 00:00 2024-09-19T08:40:02.691 INFO:teuthology.orchestra.run.smithi019.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 46 kB/s | 24 kB 00:00 2024-09-19T08:40:02.694 INFO:teuthology.orchestra.run.smithi203.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 211 kB/s | 18 kB 00:00 2024-09-19T08:40:02.712 INFO:teuthology.orchestra.run.smithi203.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 692 kB/s | 23 kB 00:00 2024-09-19T08:40:02.729 INFO:teuthology.orchestra.run.smithi203.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 577 kB/s | 19 kB 00:00 2024-09-19T08:40:02.754 INFO:teuthology.orchestra.run.smithi203.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 469 kB/s | 20 kB 00:00 2024-09-19T08:40:02.772 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction check 2024-09-19T08:40:02.779 INFO:teuthology.orchestra.run.smithi203.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T08:40:02.796 INFO:teuthology.orchestra.run.smithi203.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 4.7 MB/s | 79 kB 00:00 2024-09-19T08:40:02.821 INFO:teuthology.orchestra.run.smithi203.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T08:40:02.855 INFO:teuthology.orchestra.run.smithi203.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-19T08:40:02.889 INFO:teuthology.orchestra.run.smithi203.stdout:(133/156): python3-grpcio-1.46.7-10.el9.x86_64. 5.5 MB/s | 2.0 MB 00:00 2024-09-19T08:40:02.908 INFO:teuthology.orchestra.run.smithi019.stdout:(62/156): libtool-2.4.6-46.el9.x86_64.rpm 664 kB/s | 581 kB 00:00 2024-09-19T08:40:02.922 INFO:teuthology.orchestra.run.smithi203.stdout:(134/156): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-09-19T08:40:02.924 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction check succeeded. 2024-09-19T08:40:02.925 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction test 2024-09-19T08:40:02.947 INFO:teuthology.orchestra.run.smithi203.stdout:(135/156): python3-portend-3.1.0-2.el9.noarch.r 178 kB/s | 16 kB 00:00 2024-09-19T08:40:02.973 INFO:teuthology.orchestra.run.smithi203.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-09-19T08:40:02.991 INFO:teuthology.orchestra.run.smithi019.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 82 kB/s | 47 kB 00:00 2024-09-19T08:40:02.998 INFO:teuthology.orchestra.run.smithi203.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 562 kB/s | 28 kB 00:00 2024-09-19T08:40:03.024 INFO:teuthology.orchestra.run.smithi203.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2024-09-19T08:40:03.049 INFO:teuthology.orchestra.run.smithi203.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-19T08:40:03.074 INFO:teuthology.orchestra.run.smithi203.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-19T08:40:03.099 INFO:teuthology.orchestra.run.smithi203.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-19T08:40:03.125 INFO:teuthology.orchestra.run.smithi203.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-19T08:40:03.150 INFO:teuthology.orchestra.run.smithi203.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-19T08:40:03.175 INFO:teuthology.orchestra.run.smithi203.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-19T08:40:03.201 INFO:teuthology.orchestra.run.smithi203.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-19T08:40:03.218 INFO:teuthology.orchestra.run.smithi203.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-19T08:40:03.252 INFO:teuthology.orchestra.run.smithi203.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-19T08:40:03.310 INFO:teuthology.orchestra.run.smithi203.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-19T08:40:03.525 INFO:teuthology.orchestra.run.smithi019.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 351 kB/s | 292 kB 00:00 2024-09-19T08:40:03.559 INFO:teuthology.orchestra.run.smithi019.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 68 kB/s | 38 kB 00:00 2024-09-19T08:40:03.651 INFO:teuthology.orchestra.run.smithi019.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 254 kB/s | 188 kB 00:00 2024-09-19T08:40:03.685 INFO:teuthology.orchestra.run.smithi203.stdout:(149/156): NetworkManager-1.51.0-1.el9.x86_64.r 6.3 MB/s | 2.3 MB 00:00 2024-09-19T08:40:03.761 INFO:teuthology.orchestra.run.smithi203.stdout:(150/156): librados2-19.1.1-361.g2f599a46.el9.x 6.3 MB/s | 3.4 MB 00:00 2024-09-19T08:40:03.811 INFO:teuthology.orchestra.run.smithi203.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 820 kB/s | 41 kB 00:00 2024-09-19T08:40:03.895 INFO:teuthology.orchestra.run.smithi203.stdout:(152/156): NetworkManager-tui-1.51.0-1.el9.x86_ 2.9 MB/s | 249 kB 00:00 2024-09-19T08:40:03.970 INFO:teuthology.orchestra.run.smithi203.stdout:(153/156): NetworkManager-libnm-1.51.0-1.el9.x8 6.4 MB/s | 1.8 MB 00:00 2024-09-19T08:40:04.145 INFO:teuthology.orchestra.run.smithi203.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 5.4 MB/s | 1.4 MB 00:00 2024-09-19T08:40:04.329 INFO:teuthology.orchestra.run.smithi203.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 6.7 MB/s | 2.4 MB 00:00 2024-09-19T08:40:04.587 INFO:teuthology.orchestra.run.smithi203.stdout:(156/156): librbd1-19.1.1-361.g2f599a46.el9.x86 2.4 MB/s | 3.2 MB 00:01 2024-09-19T08:40:04.593 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:40:04.593 INFO:teuthology.orchestra.run.smithi203.stdout:Total 21 MB/s | 226 MB 00:10 2024-09-19T08:40:04.651 INFO:teuthology.orchestra.run.smithi019.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 4.4 MB/s | 4.9 MB 00:01 2024-09-19T08:40:04.693 INFO:teuthology.orchestra.run.smithi019.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 1.5 MB/s | 1.6 MB 00:01 2024-09-19T08:40:04.729 INFO:teuthology.orchestra.run.smithi155.stdout:Transaction test succeeded. 2024-09-19T08:40:04.729 INFO:teuthology.orchestra.run.smithi155.stdout:Running transaction 2024-09-19T08:40:04.768 INFO:teuthology.orchestra.run.smithi019.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 3.7 MB/s | 4.4 MB 00:01 2024-09-19T08:40:05.393 INFO:teuthology.orchestra.run.smithi019.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 196 kB/s | 137 kB 00:00 2024-09-19T08:40:05.677 INFO:teuthology.orchestra.run.smithi019.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 887 kB/s | 910 kB 00:01 2024-09-19T08:40:05.853 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-09-19T08:40:05.944 INFO:teuthology.orchestra.run.smithi019.stdout:(72/156): postgresql-server-13.16-1.el9.x86_64. 4.9 MB/s | 5.8 MB 00:01 2024-09-19T08:40:06.006 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-09-19T08:40:06.006 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-09-19T08:40:06.386 INFO:teuthology.orchestra.run.smithi019.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 123 kB/s | 87 kB 00:00 2024-09-19T08:40:06.436 INFO:teuthology.orchestra.run.smithi019.stdout:(74/156): protobuf-3.14.0-13.el9.x86_64.rpm 992 kB/s | 1.0 MB 00:01 2024-09-19T08:40:07.003 INFO:teuthology.orchestra.run.smithi019.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 99 kB/s | 61 kB 00:00 2024-09-19T08:40:07.095 INFO:teuthology.orchestra.run.smithi019.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 5.2 MB/s | 6.0 MB 00:01 2024-09-19T08:40:07.204 INFO:teuthology.orchestra.run.smithi019.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 319 kB/s | 245 kB 00:00 2024-09-19T08:40:07.679 INFO:teuthology.orchestra.run.smithi019.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 44 kB/s | 26 kB 00:00 2024-09-19T08:40:07.696 INFO:teuthology.orchestra.run.smithi019.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 39 kB/s | 19 kB 00:00 2024-09-19T08:40:07.779 INFO:teuthology.orchestra.run.smithi019.stdout:(80/156): python3-jinja2-2.11.3-6.el9.noarch.rp 320 kB/s | 248 kB 00:00 2024-09-19T08:40:07.868 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-09-19T08:40:07.869 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-09-19T08:40:08.296 INFO:teuthology.orchestra.run.smithi019.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 58 kB/s | 35 kB 00:00 2024-09-19T08:40:08.438 INFO:teuthology.orchestra.run.smithi019.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 227 kB/s | 172 kB 00:00 2024-09-19T08:40:08.989 INFO:teuthology.orchestra.run.smithi019.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.2 MB/s | 5.1 MB 00:01 2024-09-19T08:40:09.105 INFO:teuthology.orchestra.run.smithi019.stdout:(84/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 310 kB/s | 250 kB 00:00 2024-09-19T08:40:09.214 INFO:teuthology.orchestra.run.smithi019.stdout:(85/156): python3-oauthlib-3.1.1-5.el9.noarch.r 287 kB/s | 222 kB 00:00 2024-09-19T08:40:09.740 INFO:teuthology.orchestra.run.smithi019.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 103 kB/s | 77 kB 00:00 2024-09-19T08:40:09.756 INFO:teuthology.orchestra.run.smithi019.stdout:(87/156): python3-prettytable-0.7.2-27.el9.noar 65 kB/s | 42 kB 00:00 2024-09-19T08:40:10.048 INFO:teuthology.orchestra.run.smithi019.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 323 kB/s | 269 kB 00:00 2024-09-19T08:40:10.465 INFO:teuthology.orchestra.run.smithi019.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 219 kB/s | 159 kB 00:00 2024-09-19T08:40:10.532 INFO:teuthology.orchestra.run.smithi019.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 359 kB/s | 279 kB 00:00 2024-09-19T08:40:10.691 INFO:teuthology.orchestra.run.smithi019.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 79 kB/s | 51 kB 00:00 2024-09-19T08:40:10.998 INFO:teuthology.orchestra.run.smithi155.stdout: Preparing : 1/1 2024-09-19T08:40:11.124 INFO:teuthology.orchestra.run.smithi019.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 81 kB/s | 54 kB 00:00 2024-09-19T08:40:11.137 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T08:40:11.185 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T08:40:11.238 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T08:40:11.266 INFO:teuthology.orchestra.run.smithi019.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 72 kB/s | 42 kB 00:00 2024-09-19T08:40:11.272 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T08:40:11.297 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T08:40:11.341 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T08:40:11.702 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T08:40:11.725 INFO:teuthology.orchestra.run.smithi019.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 74 kB/s | 44 kB 00:00 2024-09-19T08:40:11.848 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:40:11.958 INFO:teuthology.orchestra.run.smithi019.stdout:(95/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-19T08:40:12.067 INFO:teuthology.orchestra.run.smithi019.stdout:(96/156): qatlib-24.02.0-1.el9.x86_64.rpm 276 kB/s | 221 kB 00:00 2024-09-19T08:40:12.188 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:40:12.216 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:40:12.290 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:40:12.323 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:40:12.375 INFO:teuthology.orchestra.run.smithi019.stdout:(97/156): qatlib-service-24.02.0-1.el9.x86_64.r 55 kB/s | 36 kB 00:00 2024-09-19T08:40:12.468 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T08:40:12.526 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T08:40:12.534 INFO:teuthology.orchestra.run.smithi019.stdout:(98/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 82 kB/s | 47 kB 00:00 2024-09-19T08:40:12.554 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:40:12.641 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:40:12.671 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:40:12.734 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:40:12.756 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:40:12.779 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:40:12.868 INFO:teuthology.orchestra.run.smithi019.stdout:(99/156): socat-1.7.4.1-6.el9.x86_64.rpm 380 kB/s | 304 kB 00:00 2024-09-19T08:40:12.966 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:40:13.043 INFO:teuthology.orchestra.run.smithi019.stdout:(100/156): uuid-1.6.2-55.el9.x86_64.rpm 87 kB/s | 58 kB 00:00 2024-09-19T08:40:13.092 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:40:13.185 INFO:teuthology.orchestra.run.smithi019.stdout:(101/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 147 kB/s | 96 kB 00:00 2024-09-19T08:40:13.204 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T08:40:13.298 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:40:13.381 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:40:13.485 INFO:teuthology.orchestra.run.smithi019.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 103 kB/s | 64 kB 00:00 2024-09-19T08:40:13.510 INFO:teuthology.orchestra.run.smithi019.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 69 kB/s | 22 kB 00:00 2024-09-19T08:40:13.561 INFO:teuthology.orchestra.run.smithi019.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-19T08:40:13.600 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:40:13.604 INFO:teuthology.orchestra.run.smithi019.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 7.0 MB/s | 308 kB 00:00 2024-09-19T08:40:13.653 INFO:teuthology.orchestra.run.smithi019.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 398 kB/s | 19 kB 00:00 2024-09-19T08:40:13.678 INFO:teuthology.orchestra.run.smithi019.stdout:(107/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 70 kB/s | 45 kB 00:00 2024-09-19T08:40:13.702 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T08:40:13.729 INFO:teuthology.orchestra.run.smithi019.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 520 kB/s | 26 kB 00:00 2024-09-19T08:40:13.762 INFO:teuthology.orchestra.run.smithi019.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-19T08:40:13.796 INFO:teuthology.orchestra.run.smithi019.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-19T08:40:13.805 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T08:40:13.829 INFO:teuthology.orchestra.run.smithi019.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 4.5 MB/s | 151 kB 00:00 2024-09-19T08:40:13.836 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T08:40:13.870 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T08:40:13.896 INFO:teuthology.orchestra.run.smithi019.stdout:(112/156): libarrow-9.0.0-11.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-19T08:40:13.935 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T08:40:13.938 INFO:teuthology.orchestra.run.smithi019.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-19T08:40:13.964 INFO:teuthology.orchestra.run.smithi019.stdout:(114/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 6.1 MB/s | 839 kB 00:00 2024-09-19T08:40:13.979 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T08:40:13.989 INFO:teuthology.orchestra.run.smithi019.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 864 kB/s | 43 kB 00:00 2024-09-19T08:40:14.012 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T08:40:14.014 INFO:teuthology.orchestra.run.smithi019.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 641 kB/s | 32 kB 00:00 2024-09-19T08:40:14.039 INFO:teuthology.orchestra.run.smithi019.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 282 kB/s | 14 kB 00:00 2024-09-19T08:40:14.055 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T08:40:14.073 INFO:teuthology.orchestra.run.smithi019.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-19T08:40:14.088 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T08:40:14.098 INFO:teuthology.orchestra.run.smithi019.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-19T08:40:14.119 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T08:40:14.188 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T08:40:14.242 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T08:40:14.268 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-09-19T08:40:14.280 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T08:40:14.310 INFO:teuthology.orchestra.run.smithi019.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.2 MB/s | 303 kB 00:00 2024-09-19T08:40:14.315 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T08:40:14.340 INFO:teuthology.orchestra.run.smithi019.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 909 kB/s | 220 kB 00:00 2024-09-19T08:40:14.358 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T08:40:14.374 INFO:teuthology.orchestra.run.smithi019.stdout:(122/156): protobuf-compiler-3.14.0-13.el9.x86_ 971 kB/s | 863 kB 00:00 2024-09-19T08:40:14.392 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T08:40:14.400 INFO:teuthology.orchestra.run.smithi019.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-09-19T08:40:14.427 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T08:40:14.433 INFO:teuthology.orchestra.run.smithi019.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 675 kB/s | 18 kB 00:00 2024-09-19T08:40:14.458 INFO:teuthology.orchestra.run.smithi019.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 1.0 MB/s | 23 kB 00:00 2024-09-19T08:40:14.470 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T08:40:14.475 INFO:teuthology.orchestra.run.smithi019.stdout:(126/156): python3-jaraco-8.2.1-3.el9.noarch.rp 106 kB/s | 11 kB 00:00 2024-09-19T08:40:14.489 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T08:40:14.492 INFO:teuthology.orchestra.run.smithi019.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 579 kB/s | 19 kB 00:00 2024-09-19T08:40:14.499 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T08:40:14.509 INFO:teuthology.orchestra.run.smithi019.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 586 kB/s | 20 kB 00:00 2024-09-19T08:40:14.526 INFO:teuthology.orchestra.run.smithi019.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-19T08:40:14.551 INFO:teuthology.orchestra.run.smithi019.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T08:40:14.568 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T08:40:14.577 INFO:teuthology.orchestra.run.smithi019.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T08:40:14.619 INFO:teuthology.orchestra.run.smithi019.stdout:(132/156): python3-pecan-1.4.2-3.el9.noarch.rpm 6.4 MB/s | 272 kB 00:00 2024-09-19T08:40:14.622 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T08:40:14.661 INFO:teuthology.orchestra.run.smithi019.stdout:(133/156): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-09-19T08:40:14.661 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T08:40:14.686 INFO:teuthology.orchestra.run.smithi019.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 244 kB/s | 16 kB 00:00 2024-09-19T08:40:14.696 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T08:40:14.701 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T08:40:14.726 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T08:40:14.737 INFO:teuthology.orchestra.run.smithi019.stdout:(135/156): python3-grpcio-1.46.7-10.el9.x86_64. 4.8 MB/s | 2.0 MB 00:00 2024-09-19T08:40:14.762 INFO:teuthology.orchestra.run.smithi019.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 375 kB/s | 28 kB 00:00 2024-09-19T08:40:14.779 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T08:40:14.787 INFO:teuthology.orchestra.run.smithi019.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 613 kB/s | 31 kB 00:00 2024-09-19T08:40:14.812 INFO:teuthology.orchestra.run.smithi019.stdout:(138/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 595 kB/s | 90 kB 00:00 2024-09-19T08:40:14.829 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T08:40:14.846 INFO:teuthology.orchestra.run.smithi019.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-19T08:40:14.871 INFO:teuthology.orchestra.run.smithi019.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 609 kB/s | 36 kB 00:00 2024-09-19T08:40:14.883 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T08:40:14.905 INFO:teuthology.orchestra.run.smithi019.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.2 MB/s | 74 kB 00:00 2024-09-19T08:40:14.930 INFO:teuthology.orchestra.run.smithi019.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 1.1 MB/s | 188 kB 00:00 2024-09-19T08:40:14.955 INFO:teuthology.orchestra.run.smithi019.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-19T08:40:14.981 INFO:teuthology.orchestra.run.smithi019.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 799 kB/s | 20 kB 00:00 2024-09-19T08:40:15.014 INFO:teuthology.orchestra.run.smithi019.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.6 MB/s | 230 kB 00:00 2024-09-19T08:40:15.039 INFO:teuthology.orchestra.run.smithi019.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-19T08:40:15.065 INFO:teuthology.orchestra.run.smithi019.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-09-19T08:40:15.113 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T08:40:15.123 INFO:teuthology.orchestra.run.smithi019.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-19T08:40:15.360 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:40:15.382 INFO:teuthology.orchestra.run.smithi019.stdout:(149/156): librbd1-19.1.1-361.g2f599a46.el9.x86 10 MB/s | 3.2 MB 00:00 2024-09-19T08:40:15.404 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T08:40:15.483 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:40:15.487 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T08:40:15.499 INFO:teuthology.orchestra.run.smithi019.stdout:(150/156): librados2-19.1.1-361.g2f599a46.el9.x 7.4 MB/s | 3.4 MB 00:00 2024-09-19T08:40:15.516 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T08:40:15.520 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:40:15.558 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T08:40:15.596 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T08:40:15.612 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:40:15.638 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T08:40:15.641 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:40:15.792 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T08:40:15.796 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T08:40:15.839 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T08:40:15.867 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T08:40:15.867 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:40:15.921 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T08:40:15.953 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:40:15.976 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:40:15.994 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T08:40:16.026 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T08:40:16.031 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:40:16.061 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:40:16.061 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T08:40:16.074 INFO:teuthology.orchestra.run.smithi019.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 71 kB/s | 41 kB 00:00 2024-09-19T08:40:16.085 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:40:16.104 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T08:40:16.140 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T08:40:16.183 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T08:40:16.216 INFO:teuthology.orchestra.run.smithi019.stdout:(152/156): NetworkManager-1.51.0-1.el9.x86_64.r 2.1 MB/s | 2.3 MB 00:01 2024-09-19T08:40:16.226 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T08:40:16.280 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:40:16.362 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T08:40:16.402 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T08:40:16.417 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:40:16.444 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T08:40:16.500 INFO:teuthology.orchestra.run.smithi019.stdout:(153/156): NetworkManager-libnm-1.51.0-1.el9.x8 1.6 MB/s | 1.8 MB 00:01 2024-09-19T08:40:16.546 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T08:40:16.568 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T08:40:16.586 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T08:40:16.625 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T08:40:16.651 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T08:40:16.667 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:40:16.675 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T08:40:16.737 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:40:16.749 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T08:40:16.833 INFO:teuthology.orchestra.run.smithi019.stdout:(154/156): NetworkManager-tui-1.51.0-1.el9.x86_ 328 kB/s | 249 kB 00:00 2024-09-19T08:40:16.886 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T08:40:16.925 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T08:40:16.953 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T08:40:16.957 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:40:16.987 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T08:40:17.026 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T08:40:17.058 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T08:40:17.063 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T08:40:17.088 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T08:40:17.122 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T08:40:17.156 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T08:40:17.161 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T08:40:17.192 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T08:40:17.198 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T08:40:17.232 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T08:40:17.235 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T08:40:17.259 INFO:teuthology.orchestra.run.smithi019.stdout:(155/156): openssl-3.2.2-6.el9.x86_64.rpm 1.3 MB/s | 1.4 MB 00:01 2024-09-19T08:40:17.300 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T08:40:17.319 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T08:40:17.344 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T08:40:17.376 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T08:40:17.420 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T08:40:17.453 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T08:40:17.461 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T08:40:17.481 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T08:40:17.525 INFO:teuthology.orchestra.run.smithi019.stdout:(156/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.3 MB/s | 2.4 MB 00:01 2024-09-19T08:40:17.533 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:40:17.533 INFO:teuthology.orchestra.run.smithi019.stdout:Total 7.9 MB/s | 226 MB 00:28 2024-09-19T08:40:17.550 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T08:40:17.602 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T08:40:17.613 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T08:40:17.642 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T08:40:17.677 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T08:40:17.709 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T08:40:17.761 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T08:40:17.770 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T08:40:17.797 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T08:40:17.840 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T08:40:17.869 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T08:40:17.932 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T08:40:17.979 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T08:40:18.054 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T08:40:18.194 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T08:40:18.248 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T08:40:18.496 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T08:40:18.542 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T08:40:18.575 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T08:40:18.674 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T08:40:18.722 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T08:40:18.757 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2024-09-19T08:40:18.767 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T08:40:18.771 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T08:40:18.853 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T08:40:18.854 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T08:40:18.882 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T08:40:18.889 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T08:40:18.917 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T08:40:18.927 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2024-09-19T08:40:18.927 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2024-09-19T08:40:18.955 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T08:40:19.021 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T08:40:19.071 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T08:40:19.101 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T08:40:19.172 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T08:40:19.187 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T08:40:19.233 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T08:40:19.287 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T08:40:19.361 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T08:40:19.393 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T08:40:19.429 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T08:40:19.475 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T08:40:19.512 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T08:40:19.555 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T08:40:19.597 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T08:40:19.740 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T08:40:19.831 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T08:40:19.891 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T08:40:19.941 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T08:40:19.943 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T08:40:20.044 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T08:40:20.083 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T08:40:20.123 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T08:40:20.149 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T08:40:20.174 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T08:40:20.240 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T08:40:20.366 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T08:40:20.424 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T08:40:20.451 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T08:40:20.485 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T08:40:20.525 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T08:40:20.557 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T08:40:20.587 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T08:40:20.621 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T08:40:20.655 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T08:40:20.688 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T08:40:20.722 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T08:40:20.809 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T08:40:20.861 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T08:40:20.892 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T08:40:20.995 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T08:40:21.052 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T08:40:21.172 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T08:40:21.250 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T08:40:21.275 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2024-09-19T08:40:21.275 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2024-09-19T08:40:21.277 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T08:40:21.311 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T08:40:21.623 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T08:40:21.657 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:40:21.731 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:40:21.762 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T08:40:21.768 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T08:40:21.797 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T08:40:21.816 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T08:40:21.850 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T08:40:21.948 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T08:40:22.013 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T08:40:22.058 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T08:40:22.138 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T08:40:22.172 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T08:40:22.290 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T08:40:22.355 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T08:40:22.360 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:40:22.384 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T08:40:22.431 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:40:22.461 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T08:40:22.462 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T08:40:23.094 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T08:40:23.215 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T08:40:24.430 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T08:40:24.532 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T08:40:24.560 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T08:40:24.593 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T08:40:24.693 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:40:24.725 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:40:24.903 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T08:40:24.948 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:40:25.038 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:40:25.070 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T08:40:25.105 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T08:40:25.275 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:40:25.312 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:40:25.408 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:40:25.408 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T08:40:25.409 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T08:40:25.409 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T08:40:25.464 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:40:25.586 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T08:40:25.618 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:40:25.689 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:40:25.720 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T08:40:27.809 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2024-09-19T08:40:27.921 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T08:40:27.961 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T08:40:28.024 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T08:40:28.065 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T08:40:28.098 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T08:40:28.149 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T08:40:28.338 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:40:28.375 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:40:28.497 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T08:40:28.616 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:40:28.732 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:40:28.758 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:40:28.851 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:40:28.892 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:40:28.925 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:40:28.962 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:40:29.063 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:40:29.063 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T08:40:29.063 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T08:40:29.063 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T08:40:29.084 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T08:40:29.097 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:40:29.144 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T08:40:29.171 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:40:29.277 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:40:29.305 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:40:29.368 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T08:40:29.390 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:40:29.414 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T08:40:29.618 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:40:29.782 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T08:40:29.905 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T08:40:30.008 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:40:30.081 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:40:30.310 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T08:40:30.422 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T08:40:30.521 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T08:40:30.567 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T08:40:30.605 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T08:40:30.681 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T08:40:30.732 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T08:40:30.772 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T08:40:30.815 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T08:40:30.848 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T08:40:30.875 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T08:40:30.947 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T08:40:31.007 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T08:40:31.036 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T08:40:31.080 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T08:40:31.158 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T08:40:31.190 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T08:40:31.234 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T08:40:31.262 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T08:40:31.338 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T08:40:31.386 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T08:40:31.473 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T08:40:31.617 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T08:40:31.681 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T08:40:32.244 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T08:40:32.328 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T08:40:32.362 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T08:40:32.406 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T08:40:32.444 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T08:40:32.487 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T08:40:32.677 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T08:40:32.738 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T08:40:32.795 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T08:40:32.869 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T08:40:32.906 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T08:40:32.942 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T08:40:32.993 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T08:40:33.024 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T08:40:33.076 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T08:40:33.127 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T08:40:33.271 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T08:40:33.312 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T08:40:33.353 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T08:40:33.461 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T08:40:33.495 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T08:40:33.536 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T08:40:33.568 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T08:40:33.593 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T08:40:33.697 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T08:40:33.834 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T08:40:33.884 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T08:40:33.912 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T08:40:33.954 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T08:40:33.997 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T08:40:34.037 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T08:40:34.067 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T08:40:34.101 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T08:40:34.135 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T08:40:34.185 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T08:40:34.219 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T08:40:34.311 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T08:40:34.359 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T08:40:34.398 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T08:40:34.507 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T08:40:34.566 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T08:40:35.347 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T08:40:35.395 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T08:40:35.429 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T08:40:35.545 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T08:40:35.602 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T08:40:35.648 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T08:40:35.739 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T08:40:35.773 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T08:40:35.964 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T08:40:35.987 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T08:40:36.067 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T08:40:36.766 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T08:40:36.892 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T08:40:37.144 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:40:37.144 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /sys 2024-09-19T08:40:37.144 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /proc 2024-09-19T08:40:37.145 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /mnt 2024-09-19T08:40:37.145 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /var/tmp 2024-09-19T08:40:37.145 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /home 2024-09-19T08:40:37.145 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /root 2024-09-19T08:40:37.145 INFO:teuthology.orchestra.run.smithi155.stdout:skipping the directory /tmp 2024-09-19T08:40:37.145 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T08:40:37.328 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:40:37.344 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:40:37.344 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:40:37.344 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T08:40:37.344 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T08:40:38.219 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T08:40:38.302 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T08:40:38.330 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T08:40:38.363 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T08:40:38.697 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T08:40:38.742 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:40:38.814 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:40:38.834 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T08:40:38.841 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:40:38.842 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:40:38.842 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T08:40:38.842 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:40:38.842 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:40:38.842 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T08:40:38.864 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T08:40:38.911 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T08:40:39.065 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:40:39.088 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:40:39.088 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:40:39.088 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T08:40:39.088 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:40:39.088 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:40:39.089 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T08:40:39.416 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T08:40:39.445 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:40:39.517 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T08:40:39.524 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:40:39.546 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T08:40:39.548 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:40:39.548 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:40:39.548 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T08:40:39.548 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:40:39.548 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:40:39.548 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T08:40:39.654 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T08:40:39.711 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T08:40:39.774 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T08:40:39.961 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T08:40:40.009 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T08:40:40.085 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T08:40:40.174 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T08:40:40.322 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T08:40:40.367 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T08:40:40.399 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T08:40:40.427 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T08:40:40.875 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:40:40.901 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:40:40.932 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T08:40:40.994 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T08:40:41.032 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:40:41.247 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:40:41.247 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /sys 2024-09-19T08:40:41.247 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /proc 2024-09-19T08:40:41.247 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /mnt 2024-09-19T08:40:41.247 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /var/tmp 2024-09-19T08:40:41.247 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /home 2024-09-19T08:40:41.247 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /root 2024-09-19T08:40:41.247 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /tmp 2024-09-19T08:40:41.247 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T08:40:41.423 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:40:41.441 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:40:41.441 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:40:41.441 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T08:40:41.441 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T08:40:41.925 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:40:41.960 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:40:42.084 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:40:42.118 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:40:42.545 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T08:40:42.580 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:40:42.671 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T08:40:42.671 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T08:40:42.671 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T08:40:42.671 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:40:42.706 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:40:42.943 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:40:42.969 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:40:42.970 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:40:42.970 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T08:40:42.970 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:40:42.970 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:40:42.970 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T08:40:43.087 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:40:43.118 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:40:43.202 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:40:43.221 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:40:43.225 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:40:43.225 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:40:43.225 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T08:40:43.225 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:40:43.225 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:40:43.226 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T08:40:43.380 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T08:40:43.412 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:40:43.436 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:40:43.436 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:40:43.436 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T08:40:43.436 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:40:43.436 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:40:43.436 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T08:40:43.488 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:40:43.499 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:40:43.598 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T08:40:43.643 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T08:40:43.669 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:40:43.693 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:40:43.693 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:40:43.693 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T08:40:43.693 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:40:43.693 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:40:43.693 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T08:40:43.799 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T08:40:43.857 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T08:40:43.921 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T08:40:44.108 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T08:40:44.154 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T08:40:44.232 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T08:40:44.329 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T08:40:44.472 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T08:40:44.546 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T08:40:44.564 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T08:40:44.578 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T08:40:44.598 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:40:44.614 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T08:40:44.622 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:40:44.622 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:40:44.622 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T08:40:44.622 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:40:44.622 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:40:44.623 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T08:40:44.666 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:40:44.689 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:40:44.689 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:40:44.689 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T08:40:44.689 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T08:40:44.741 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:40:44.765 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:40:44.765 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:40:44.765 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T08:40:44.765 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:40:44.765 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:40:44.765 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T08:40:44.994 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:40:45.022 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:40:45.053 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T08:40:45.067 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:40:45.091 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:40:45.091 INFO:teuthology.orchestra.run.smithi155.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:40:45.091 INFO:teuthology.orchestra.run.smithi155.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T08:40:45.091 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:40:45.091 INFO:teuthology.orchestra.run.smithi155.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:40:45.091 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T08:40:45.115 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T08:40:45.145 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:40:46.196 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:40:46.230 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:40:47.195 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:40:47.222 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:40:47.328 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:40:47.493 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T08:40:47.524 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:40:47.548 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:40:47.549 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:40:47.549 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T08:40:47.549 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:40:47.549 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:40:47.549 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T08:40:47.600 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:40:47.612 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:40:47.710 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T08:40:47.756 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T08:40:48.684 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T08:40:48.720 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:40:48.743 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:40:48.743 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:40:48.744 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T08:40:48.744 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:40:48.744 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:40:48.744 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T08:40:48.787 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:40:48.810 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:40:48.810 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:40:48.810 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T08:40:48.810 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T08:40:48.855 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:40:48.878 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:40:48.878 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:40:48.878 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T08:40:48.879 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:40:48.879 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:40:48.879 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T08:40:49.180 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:40:49.203 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:40:49.204 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:40:49.204 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T08:40:49.204 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:40:49.204 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:40:49.204 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T08:40:49.638 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T08:40:49.679 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T08:40:49.720 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T08:40:49.752 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T08:40:49.779 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T08:40:49.964 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T08:40:50.010 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T08:40:50.040 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T08:40:50.069 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T08:40:50.116 INFO:teuthology.orchestra.run.smithi155.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T08:40:50.705 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:40:50.756 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:40:50.777 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:40:51.655 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T08:40:51.753 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T08:40:51.794 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T08:40:51.876 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T08:40:51.906 INFO:teuthology.orchestra.run.smithi155.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T08:40:51.931 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T08:40:51.957 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T08:40:51.958 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:40:52.042 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:40:52.042 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:40:52.126 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:40:52.151 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T08:40:52.156 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:40:52.156 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:40:52.336 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:40:52.336 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:40:52.428 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:40:52.492 INFO:teuthology.orchestra.run.smithi155.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:40:53.759 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T08:40:53.800 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T08:40:53.841 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T08:40:53.874 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T08:40:53.901 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T08:40:54.083 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T08:40:54.132 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T08:40:54.162 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T08:40:54.192 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T08:40:54.246 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T08:40:54.870 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:40:54.912 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:40:54.933 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:40:55.048 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T08:40:55.048 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /sys 2024-09-19T08:40:55.048 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /proc 2024-09-19T08:40:55.048 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /mnt 2024-09-19T08:40:55.048 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /var/tmp 2024-09-19T08:40:55.048 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /home 2024-09-19T08:40:55.048 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /root 2024-09-19T08:40:55.048 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /tmp 2024-09-19T08:40:55.048 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:40:55.220 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:40:55.236 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T08:40:55.237 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:40:55.237 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T08:40:55.237 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:40:55.781 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T08:40:55.877 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T08:40:55.909 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T08:40:56.000 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T08:40:56.047 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T08:40:56.073 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T08:40:56.098 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T08:40:56.098 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:40:56.191 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:40:56.191 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:40:56.277 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:40:56.300 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T08:40:56.306 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:40:56.306 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:40:56.477 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:40:56.480 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:40:56.569 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:40:56.632 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:40:56.780 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:40:56.808 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T08:40:56.808 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:40:56.809 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T08:40:56.809 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:40:56.809 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T08:40:56.809 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:40:57.057 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:40:57.081 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T08:40:57.082 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:40:57.082 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T08:40:57.082 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:40:57.082 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T08:40:57.082 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:40:57.541 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:40:57.566 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T08:40:57.566 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:40:57.566 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T08:40:57.566 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:40:57.567 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T08:40:57.567 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:40:57.672 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T08:40:57.730 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T08:40:57.803 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T08:40:57.997 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T08:40:58.042 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T08:40:58.123 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T08:40:58.224 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T08:40:58.232 INFO:teuthology.orchestra.run.smithi155.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:40:58.232 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T08:40:58.232 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T08:40:58.232 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T08:40:58.232 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T08:40:58.232 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T08:40:58.232 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T08:40:58.232 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T08:40:58.232 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:40:58.232 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:40:58.233 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:40:58.233 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T08:40:58.233 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T08:40:58.233 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:40:58.233 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T08:40:58.233 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T08:40:58.233 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T08:40:58.233 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T08:40:58.233 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T08:40:58.233 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T08:40:58.233 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T08:40:58.233 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T08:40:58.234 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T08:40:58.234 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T08:40:58.234 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T08:40:58.234 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T08:40:58.234 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T08:40:58.234 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T08:40:58.234 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T08:40:58.234 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T08:40:58.234 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T08:40:58.234 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T08:40:58.234 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T08:40:58.234 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T08:40:58.234 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T08:40:58.234 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T08:40:58.235 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T08:40:58.235 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T08:40:58.235 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T08:40:58.235 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T08:40:58.235 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T08:40:58.235 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T08:40:58.235 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T08:40:58.235 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T08:40:58.235 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T08:40:58.235 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T08:40:58.235 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T08:40:58.235 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T08:40:58.236 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T08:40:58.236 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T08:40:58.236 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T08:40:58.236 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T08:40:58.236 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T08:40:58.236 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T08:40:58.236 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T08:40:58.236 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T08:40:58.236 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T08:40:58.236 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T08:40:58.236 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T08:40:58.236 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T08:40:58.236 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T08:40:58.237 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T08:40:58.237 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T08:40:58.237 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T08:40:58.237 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T08:40:58.237 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T08:40:58.237 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T08:40:58.237 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T08:40:58.237 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T08:40:58.237 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T08:40:58.237 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T08:40:58.237 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T08:40:58.237 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T08:40:58.238 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T08:40:58.238 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T08:40:58.238 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T08:40:58.238 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T08:40:58.238 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T08:40:58.238 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T08:40:58.238 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T08:40:58.238 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T08:40:58.238 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T08:40:58.238 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T08:40:58.238 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T08:40:58.238 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T08:40:58.238 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T08:40:58.239 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T08:40:58.239 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T08:40:58.239 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T08:40:58.239 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T08:40:58.239 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T08:40:58.239 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T08:40:58.239 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T08:40:58.239 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T08:40:58.239 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T08:40:58.239 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T08:40:58.239 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T08:40:58.239 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T08:40:58.239 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T08:40:58.240 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T08:40:58.240 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T08:40:58.240 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T08:40:58.240 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T08:40:58.240 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T08:40:58.240 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T08:40:58.240 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T08:40:58.240 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T08:40:58.240 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T08:40:58.240 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T08:40:58.240 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T08:40:58.240 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T08:40:58.241 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T08:40:58.241 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T08:40:58.241 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T08:40:58.241 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T08:40:58.241 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T08:40:58.241 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T08:40:58.241 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T08:40:58.241 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T08:40:58.241 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T08:40:58.241 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T08:40:58.241 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T08:40:58.241 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T08:40:58.241 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T08:40:58.241 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T08:40:58.242 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T08:40:58.242 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T08:40:58.242 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T08:40:58.242 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T08:40:58.242 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T08:40:58.242 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T08:40:58.242 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T08:40:58.242 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T08:40:58.242 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T08:40:58.242 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T08:40:58.242 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T08:40:58.242 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T08:40:58.242 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T08:40:58.242 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T08:40:58.243 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T08:40:58.243 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T08:40:58.243 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T08:40:58.243 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T08:40:58.243 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T08:40:58.243 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T08:40:58.243 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T08:40:58.243 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T08:40:58.243 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T08:40:58.243 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T08:40:58.243 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T08:40:58.243 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T08:40:58.243 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T08:40:58.244 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T08:40:58.244 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T08:40:58.244 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T08:40:58.244 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T08:40:58.244 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T08:40:58.244 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T08:40:58.244 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T08:40:58.244 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T08:40:58.244 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T08:40:58.244 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T08:40:58.244 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T08:40:58.244 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T08:40:58.373 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T08:40:58.418 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T08:40:58.457 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T08:40:58.485 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T08:40:58.932 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:40:58.959 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T08:40:58.990 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T08:40:59.056 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T08:40:59.081 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:41:00.193 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T08:41:00.225 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:41:01.058 INFO:teuthology.orchestra.run.smithi155.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:41:01.058 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T08:41:01.058 INFO:teuthology.orchestra.run.smithi155.stdout:Upgraded: 2024-09-19T08:41:01.058 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T08:41:01.058 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T08:41:01.058 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T08:41:01.058 INFO:teuthology.orchestra.run.smithi155.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T08:41:01.058 INFO:teuthology.orchestra.run.smithi155.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:01.059 INFO:teuthology.orchestra.run.smithi155.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:01.059 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T08:41:01.059 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T08:41:01.059 INFO:teuthology.orchestra.run.smithi155.stdout:Installed: 2024-09-19T08:41:01.059 INFO:teuthology.orchestra.run.smithi155.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T08:41:01.059 INFO:teuthology.orchestra.run.smithi155.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T08:41:01.059 INFO:teuthology.orchestra.run.smithi155.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T08:41:01.059 INFO:teuthology.orchestra.run.smithi155.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T08:41:01.059 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:01.059 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:01.059 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:01.059 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:01.059 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:41:01.060 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:01.060 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:01.060 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:01.060 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:41:01.060 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:41:01.060 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:41:01.060 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:41:01.060 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:41:01.060 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:01.060 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:01.060 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:41:01.060 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:01.060 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:01.061 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:01.061 INFO:teuthology.orchestra.run.smithi155.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:41:01.061 INFO:teuthology.orchestra.run.smithi155.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:41:01.061 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:01.061 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:01.061 INFO:teuthology.orchestra.run.smithi155.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:41:01.061 INFO:teuthology.orchestra.run.smithi155.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T08:41:01.061 INFO:teuthology.orchestra.run.smithi155.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T08:41:01.061 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T08:41:01.061 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T08:41:01.061 INFO:teuthology.orchestra.run.smithi155.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T08:41:01.061 INFO:teuthology.orchestra.run.smithi155.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T08:41:01.062 INFO:teuthology.orchestra.run.smithi155.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T08:41:01.062 INFO:teuthology.orchestra.run.smithi155.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T08:41:01.062 INFO:teuthology.orchestra.run.smithi155.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T08:41:01.062 INFO:teuthology.orchestra.run.smithi155.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T08:41:01.062 INFO:teuthology.orchestra.run.smithi155.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T08:41:01.062 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:01.062 INFO:teuthology.orchestra.run.smithi155.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:01.062 INFO:teuthology.orchestra.run.smithi155.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:01.062 INFO:teuthology.orchestra.run.smithi155.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T08:41:01.062 INFO:teuthology.orchestra.run.smithi155.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T08:41:01.062 INFO:teuthology.orchestra.run.smithi155.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T08:41:01.062 INFO:teuthology.orchestra.run.smithi155.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T08:41:01.062 INFO:teuthology.orchestra.run.smithi155.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T08:41:01.062 INFO:teuthology.orchestra.run.smithi155.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:01.063 INFO:teuthology.orchestra.run.smithi155.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:01.063 INFO:teuthology.orchestra.run.smithi155.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T08:41:01.063 INFO:teuthology.orchestra.run.smithi155.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:01.063 INFO:teuthology.orchestra.run.smithi155.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T08:41:01.063 INFO:teuthology.orchestra.run.smithi155.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T08:41:01.063 INFO:teuthology.orchestra.run.smithi155.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T08:41:01.063 INFO:teuthology.orchestra.run.smithi155.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T08:41:01.063 INFO:teuthology.orchestra.run.smithi155.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T08:41:01.063 INFO:teuthology.orchestra.run.smithi155.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T08:41:01.063 INFO:teuthology.orchestra.run.smithi155.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T08:41:01.063 INFO:teuthology.orchestra.run.smithi155.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T08:41:01.063 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T08:41:01.063 INFO:teuthology.orchestra.run.smithi155.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T08:41:01.063 INFO:teuthology.orchestra.run.smithi155.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T08:41:01.064 INFO:teuthology.orchestra.run.smithi155.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T08:41:01.064 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T08:41:01.064 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T08:41:01.064 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T08:41:01.064 INFO:teuthology.orchestra.run.smithi155.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T08:41:01.064 INFO:teuthology.orchestra.run.smithi155.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T08:41:01.064 INFO:teuthology.orchestra.run.smithi155.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T08:41:01.064 INFO:teuthology.orchestra.run.smithi155.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T08:41:01.064 INFO:teuthology.orchestra.run.smithi155.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T08:41:01.064 INFO:teuthology.orchestra.run.smithi155.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T08:41:01.064 INFO:teuthology.orchestra.run.smithi155.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T08:41:01.064 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T08:41:01.064 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:01.065 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:01.065 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:01.065 INFO:teuthology.orchestra.run.smithi155.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T08:41:01.065 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T08:41:01.065 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T08:41:01.065 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T08:41:01.065 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T08:41:01.065 INFO:teuthology.orchestra.run.smithi155.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T08:41:01.065 INFO:teuthology.orchestra.run.smithi155.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T08:41:01.065 INFO:teuthology.orchestra.run.smithi155.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T08:41:01.065 INFO:teuthology.orchestra.run.smithi155.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T08:41:01.065 INFO:teuthology.orchestra.run.smithi155.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T08:41:01.065 INFO:teuthology.orchestra.run.smithi155.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T08:41:01.066 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T08:41:01.066 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T08:41:01.066 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T08:41:01.066 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T08:41:01.066 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T08:41:01.066 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T08:41:01.066 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T08:41:01.066 INFO:teuthology.orchestra.run.smithi155.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T08:41:01.066 INFO:teuthology.orchestra.run.smithi155.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T08:41:01.066 INFO:teuthology.orchestra.run.smithi155.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T08:41:01.066 INFO:teuthology.orchestra.run.smithi155.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T08:41:01.066 INFO:teuthology.orchestra.run.smithi155.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T08:41:01.066 INFO:teuthology.orchestra.run.smithi155.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T08:41:01.066 INFO:teuthology.orchestra.run.smithi155.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T08:41:01.066 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T08:41:01.067 INFO:teuthology.orchestra.run.smithi155.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T08:41:01.067 INFO:teuthology.orchestra.run.smithi155.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T08:41:01.067 INFO:teuthology.orchestra.run.smithi155.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T08:41:01.067 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T08:41:01.067 INFO:teuthology.orchestra.run.smithi155.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T08:41:01.067 INFO:teuthology.orchestra.run.smithi155.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T08:41:01.067 INFO:teuthology.orchestra.run.smithi155.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T08:41:01.067 INFO:teuthology.orchestra.run.smithi155.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T08:41:01.067 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T08:41:01.067 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T08:41:01.067 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T08:41:01.067 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T08:41:01.067 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T08:41:01.067 INFO:teuthology.orchestra.run.smithi155.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T08:41:01.068 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:01.068 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:01.068 INFO:teuthology.orchestra.run.smithi155.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T08:41:01.068 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T08:41:01.068 INFO:teuthology.orchestra.run.smithi155.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T08:41:01.068 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:01.068 INFO:teuthology.orchestra.run.smithi155.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T08:41:01.068 INFO:teuthology.orchestra.run.smithi155.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T08:41:01.068 INFO:teuthology.orchestra.run.smithi155.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T08:41:01.068 INFO:teuthology.orchestra.run.smithi155.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T08:41:01.068 INFO:teuthology.orchestra.run.smithi155.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T08:41:01.068 INFO:teuthology.orchestra.run.smithi155.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T08:41:01.069 INFO:teuthology.orchestra.run.smithi155.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T08:41:01.069 INFO:teuthology.orchestra.run.smithi155.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T08:41:01.069 INFO:teuthology.orchestra.run.smithi155.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T08:41:01.069 INFO:teuthology.orchestra.run.smithi155.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T08:41:01.069 INFO:teuthology.orchestra.run.smithi155.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T08:41:01.069 INFO:teuthology.orchestra.run.smithi155.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T08:41:01.069 INFO:teuthology.orchestra.run.smithi155.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T08:41:01.069 INFO:teuthology.orchestra.run.smithi155.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T08:41:01.069 INFO:teuthology.orchestra.run.smithi155.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T08:41:01.069 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:01.069 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:01.069 INFO:teuthology.orchestra.run.smithi155.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:01.069 INFO:teuthology.orchestra.run.smithi155.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T08:41:01.070 INFO:teuthology.orchestra.run.smithi155.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T08:41:01.070 INFO:teuthology.orchestra.run.smithi155.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T08:41:01.070 INFO:teuthology.orchestra.run.smithi155.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T08:41:01.070 INFO:teuthology.orchestra.run.smithi155.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T08:41:01.070 INFO:teuthology.orchestra.run.smithi155.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T08:41:01.070 INFO:teuthology.orchestra.run.smithi155.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T08:41:01.070 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T08:41:01.070 INFO:teuthology.orchestra.run.smithi155.stdout:Complete! 2024-09-19T08:41:01.238 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T08:41:01.267 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:41:01.375 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T08:41:01.460 DEBUG:teuthology.parallel:result is None 2024-09-19T08:41:01.546 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T08:41:01.578 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:41:01.602 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T08:41:01.602 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:41:01.602 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T08:41:01.602 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:41:01.602 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T08:41:01.603 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:41:01.653 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:41:01.665 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T08:41:01.767 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T08:41:01.826 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T08:41:02.364 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:41:02.365 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T08:41:02.365 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T08:41:02.365 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T08:41:02.365 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T08:41:02.365 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T08:41:02.365 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T08:41:02.365 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T08:41:02.365 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:41:02.365 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:41:02.365 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:41:02.365 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T08:41:02.366 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T08:41:02.366 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:41:02.366 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T08:41:02.366 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T08:41:02.366 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T08:41:02.366 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T08:41:02.366 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T08:41:02.366 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T08:41:02.366 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T08:41:02.366 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T08:41:02.366 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T08:41:02.366 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T08:41:02.367 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T08:41:02.367 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T08:41:02.367 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T08:41:02.367 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T08:41:02.367 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T08:41:02.367 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T08:41:02.367 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T08:41:02.367 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T08:41:02.367 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T08:41:02.367 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T08:41:02.367 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T08:41:02.367 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T08:41:02.379 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T08:41:02.379 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T08:41:02.379 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T08:41:02.379 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T08:41:02.379 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T08:41:02.379 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T08:41:02.379 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T08:41:02.379 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T08:41:02.379 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T08:41:02.380 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T08:41:02.380 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T08:41:02.380 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T08:41:02.380 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T08:41:02.380 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T08:41:02.380 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T08:41:02.380 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T08:41:02.380 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T08:41:02.380 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T08:41:02.380 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T08:41:02.380 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T08:41:02.380 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T08:41:02.381 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T08:41:02.381 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T08:41:02.381 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T08:41:02.381 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T08:41:02.381 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T08:41:02.381 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T08:41:02.381 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T08:41:02.381 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T08:41:02.381 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T08:41:02.381 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T08:41:02.381 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T08:41:02.381 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T08:41:02.381 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T08:41:02.382 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T08:41:02.382 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T08:41:02.382 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T08:41:02.382 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T08:41:02.382 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T08:41:02.382 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T08:41:02.382 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T08:41:02.382 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T08:41:02.382 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T08:41:02.382 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T08:41:02.382 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T08:41:02.382 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T08:41:02.382 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T08:41:02.383 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T08:41:02.383 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T08:41:02.383 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T08:41:02.383 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T08:41:02.383 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T08:41:02.383 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T08:41:02.383 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T08:41:02.383 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T08:41:02.383 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T08:41:02.383 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T08:41:02.383 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T08:41:02.383 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T08:41:02.383 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T08:41:02.383 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T08:41:02.384 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T08:41:02.384 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T08:41:02.384 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T08:41:02.384 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T08:41:02.384 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T08:41:02.384 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T08:41:02.384 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T08:41:02.384 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T08:41:02.384 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T08:41:02.384 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T08:41:02.384 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T08:41:02.384 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T08:41:02.384 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T08:41:02.384 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T08:41:02.385 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T08:41:02.385 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T08:41:02.385 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T08:41:02.385 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T08:41:02.385 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T08:41:02.385 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T08:41:02.385 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T08:41:02.385 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T08:41:02.385 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T08:41:02.385 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T08:41:02.385 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T08:41:02.385 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T08:41:02.385 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T08:41:02.385 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T08:41:02.386 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T08:41:02.386 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T08:41:02.386 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T08:41:02.386 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T08:41:02.386 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T08:41:02.386 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T08:41:02.386 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T08:41:02.386 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T08:41:02.386 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T08:41:02.386 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T08:41:02.386 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T08:41:02.386 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T08:41:02.386 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T08:41:02.387 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T08:41:02.387 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T08:41:02.387 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T08:41:02.387 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T08:41:02.387 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T08:41:02.387 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T08:41:02.387 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T08:41:02.387 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T08:41:02.387 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T08:41:02.387 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T08:41:02.387 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T08:41:02.387 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T08:41:02.387 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T08:41:02.388 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T08:41:02.388 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T08:41:02.388 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T08:41:02.388 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T08:41:02.388 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T08:41:02.388 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T08:41:02.388 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T08:41:02.388 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T08:41:02.388 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T08:41:02.388 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T08:41:02.388 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T08:41:02.388 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T08:41:02.388 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T08:41:02.803 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T08:41:02.839 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:41:02.864 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T08:41:02.864 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:41:02.864 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T08:41:02.864 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:41:02.864 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T08:41:02.864 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:41:02.906 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:41:02.930 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T08:41:02.930 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:41:02.930 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T08:41:02.930 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:41:02.990 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:41:03.015 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T08:41:03.015 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:41:03.015 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T08:41:03.015 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:41:03.015 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T08:41:03.015 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:41:03.341 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:41:03.366 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T08:41:03.366 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T08:41:03.366 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T08:41:03.367 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:41:03.367 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T08:41:03.367 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:41:05.215 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:41:05.215 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T08:41:05.215 INFO:teuthology.orchestra.run.smithi203.stdout:Upgraded: 2024-09-19T08:41:05.215 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T08:41:05.215 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T08:41:05.215 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T08:41:05.215 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T08:41:05.215 INFO:teuthology.orchestra.run.smithi203.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:05.215 INFO:teuthology.orchestra.run.smithi203.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:05.215 INFO:teuthology.orchestra.run.smithi203.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T08:41:05.216 INFO:teuthology.orchestra.run.smithi203.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T08:41:05.216 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-09-19T08:41:05.216 INFO:teuthology.orchestra.run.smithi203.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T08:41:05.216 INFO:teuthology.orchestra.run.smithi203.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T08:41:05.216 INFO:teuthology.orchestra.run.smithi203.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T08:41:05.216 INFO:teuthology.orchestra.run.smithi203.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T08:41:05.216 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:05.216 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:05.216 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:05.216 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:05.216 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:41:05.216 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:05.216 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:05.216 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:05.217 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:41:05.217 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:41:05.217 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:41:05.217 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:41:05.217 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:41:05.217 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:05.217 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:05.217 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:41:05.217 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:05.217 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:05.217 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:05.217 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:41:05.217 INFO:teuthology.orchestra.run.smithi203.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:41:05.217 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:05.218 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:05.218 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:41:05.218 INFO:teuthology.orchestra.run.smithi203.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T08:41:05.218 INFO:teuthology.orchestra.run.smithi203.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T08:41:05.218 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T08:41:05.218 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T08:41:05.218 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T08:41:05.218 INFO:teuthology.orchestra.run.smithi203.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T08:41:05.218 INFO:teuthology.orchestra.run.smithi203.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T08:41:05.218 INFO:teuthology.orchestra.run.smithi203.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T08:41:05.218 INFO:teuthology.orchestra.run.smithi203.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T08:41:05.218 INFO:teuthology.orchestra.run.smithi203.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T08:41:05.218 INFO:teuthology.orchestra.run.smithi203.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T08:41:05.219 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:05.219 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:05.219 INFO:teuthology.orchestra.run.smithi203.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:05.219 INFO:teuthology.orchestra.run.smithi203.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T08:41:05.219 INFO:teuthology.orchestra.run.smithi203.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T08:41:05.219 INFO:teuthology.orchestra.run.smithi203.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T08:41:05.219 INFO:teuthology.orchestra.run.smithi203.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T08:41:05.219 INFO:teuthology.orchestra.run.smithi203.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T08:41:05.219 INFO:teuthology.orchestra.run.smithi203.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:05.220 INFO:teuthology.orchestra.run.smithi203.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:05.220 INFO:teuthology.orchestra.run.smithi203.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T08:41:05.220 INFO:teuthology.orchestra.run.smithi203.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:05.220 INFO:teuthology.orchestra.run.smithi203.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T08:41:05.220 INFO:teuthology.orchestra.run.smithi203.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T08:41:05.220 INFO:teuthology.orchestra.run.smithi203.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T08:41:05.220 INFO:teuthology.orchestra.run.smithi203.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T08:41:05.220 INFO:teuthology.orchestra.run.smithi203.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T08:41:05.220 INFO:teuthology.orchestra.run.smithi203.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T08:41:05.220 INFO:teuthology.orchestra.run.smithi203.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T08:41:05.220 INFO:teuthology.orchestra.run.smithi203.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T08:41:05.220 INFO:teuthology.orchestra.run.smithi203.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T08:41:05.221 INFO:teuthology.orchestra.run.smithi203.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T08:41:05.221 INFO:teuthology.orchestra.run.smithi203.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T08:41:05.221 INFO:teuthology.orchestra.run.smithi203.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T08:41:05.221 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T08:41:05.221 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T08:41:05.221 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T08:41:05.221 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T08:41:05.221 INFO:teuthology.orchestra.run.smithi203.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T08:41:05.221 INFO:teuthology.orchestra.run.smithi203.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T08:41:05.221 INFO:teuthology.orchestra.run.smithi203.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T08:41:05.221 INFO:teuthology.orchestra.run.smithi203.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T08:41:05.221 INFO:teuthology.orchestra.run.smithi203.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T08:41:05.221 INFO:teuthology.orchestra.run.smithi203.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T08:41:05.222 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T08:41:05.222 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:05.222 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:05.222 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:05.222 INFO:teuthology.orchestra.run.smithi203.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T08:41:05.222 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T08:41:05.222 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T08:41:05.222 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T08:41:05.222 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T08:41:05.222 INFO:teuthology.orchestra.run.smithi203.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T08:41:05.222 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T08:41:05.222 INFO:teuthology.orchestra.run.smithi203.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T08:41:05.222 INFO:teuthology.orchestra.run.smithi203.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T08:41:05.222 INFO:teuthology.orchestra.run.smithi203.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T08:41:05.223 INFO:teuthology.orchestra.run.smithi203.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T08:41:05.223 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T08:41:05.223 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T08:41:05.223 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T08:41:05.223 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T08:41:05.223 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T08:41:05.223 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T08:41:05.223 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T08:41:05.223 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T08:41:05.223 INFO:teuthology.orchestra.run.smithi203.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T08:41:05.223 INFO:teuthology.orchestra.run.smithi203.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T08:41:05.223 INFO:teuthology.orchestra.run.smithi203.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T08:41:05.223 INFO:teuthology.orchestra.run.smithi203.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T08:41:05.223 INFO:teuthology.orchestra.run.smithi203.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T08:41:05.224 INFO:teuthology.orchestra.run.smithi203.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T08:41:05.224 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T08:41:05.224 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T08:41:05.224 INFO:teuthology.orchestra.run.smithi203.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T08:41:05.224 INFO:teuthology.orchestra.run.smithi203.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T08:41:05.224 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T08:41:05.224 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T08:41:05.224 INFO:teuthology.orchestra.run.smithi203.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T08:41:05.224 INFO:teuthology.orchestra.run.smithi203.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T08:41:05.224 INFO:teuthology.orchestra.run.smithi203.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T08:41:05.224 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T08:41:05.224 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T08:41:05.224 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T08:41:05.225 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T08:41:05.225 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T08:41:05.225 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T08:41:05.225 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:05.225 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:05.225 INFO:teuthology.orchestra.run.smithi203.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T08:41:05.225 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T08:41:05.225 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T08:41:05.225 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:05.225 INFO:teuthology.orchestra.run.smithi203.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T08:41:05.225 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T08:41:05.226 INFO:teuthology.orchestra.run.smithi203.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T08:41:05.226 INFO:teuthology.orchestra.run.smithi203.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T08:41:05.226 INFO:teuthology.orchestra.run.smithi203.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T08:41:05.226 INFO:teuthology.orchestra.run.smithi203.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T08:41:05.226 INFO:teuthology.orchestra.run.smithi203.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T08:41:05.226 INFO:teuthology.orchestra.run.smithi203.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T08:41:05.226 INFO:teuthology.orchestra.run.smithi203.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T08:41:05.226 INFO:teuthology.orchestra.run.smithi203.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T08:41:05.226 INFO:teuthology.orchestra.run.smithi203.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T08:41:05.226 INFO:teuthology.orchestra.run.smithi203.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T08:41:05.226 INFO:teuthology.orchestra.run.smithi203.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T08:41:05.226 INFO:teuthology.orchestra.run.smithi203.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T08:41:05.226 INFO:teuthology.orchestra.run.smithi203.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T08:41:05.227 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:05.227 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:05.227 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:05.227 INFO:teuthology.orchestra.run.smithi203.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T08:41:05.227 INFO:teuthology.orchestra.run.smithi203.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T08:41:05.227 INFO:teuthology.orchestra.run.smithi203.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T08:41:05.227 INFO:teuthology.orchestra.run.smithi203.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T08:41:05.227 INFO:teuthology.orchestra.run.smithi203.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T08:41:05.227 INFO:teuthology.orchestra.run.smithi203.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T08:41:05.228 INFO:teuthology.orchestra.run.smithi203.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T08:41:05.228 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T08:41:05.228 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-09-19T08:41:05.661 DEBUG:teuthology.parallel:result is None 2024-09-19T08:41:08.195 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T08:41:08.237 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T08:41:08.278 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T08:41:08.309 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T08:41:08.337 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T08:41:08.544 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T08:41:08.592 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T08:41:08.622 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T08:41:08.652 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T08:41:08.698 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T08:41:09.388 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:41:09.428 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:41:09.450 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T08:41:10.351 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T08:41:10.441 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T08:41:10.487 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T08:41:10.586 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T08:41:10.619 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T08:41:10.646 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T08:41:10.679 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T08:41:10.679 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:41:10.763 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T08:41:10.763 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:41:10.839 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T08:41:10.864 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T08:41:10.869 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:41:10.869 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:41:11.049 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T08:41:11.050 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:41:11.133 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T08:41:11.202 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:41:16.823 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:41:16.823 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T08:41:16.823 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T08:41:16.823 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T08:41:16.823 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T08:41:16.823 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T08:41:16.823 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T08:41:16.823 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T08:41:16.823 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T08:41:16.824 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T08:41:16.824 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T08:41:16.824 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T08:41:16.824 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T08:41:16.824 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T08:41:16.824 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T08:41:16.824 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T08:41:16.824 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T08:41:16.824 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T08:41:16.824 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T08:41:16.825 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T08:41:16.825 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T08:41:16.825 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T08:41:16.825 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T08:41:16.825 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T08:41:16.825 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T08:41:16.825 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T08:41:16.825 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T08:41:16.825 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T08:41:16.838 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T08:41:16.838 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T08:41:16.838 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T08:41:16.838 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T08:41:16.839 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T08:41:16.839 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T08:41:16.839 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T08:41:16.839 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T08:41:16.839 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T08:41:16.839 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T08:41:16.839 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T08:41:16.839 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T08:41:16.839 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T08:41:16.839 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T08:41:16.839 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T08:41:16.839 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T08:41:16.839 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T08:41:16.840 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T08:41:16.840 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T08:41:16.840 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T08:41:16.840 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T08:41:16.840 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T08:41:16.840 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T08:41:16.840 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T08:41:16.840 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T08:41:16.840 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T08:41:16.840 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T08:41:16.840 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T08:41:16.841 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T08:41:16.841 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T08:41:16.841 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T08:41:16.841 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T08:41:16.841 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T08:41:16.841 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T08:41:16.841 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T08:41:16.841 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T08:41:16.841 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T08:41:16.841 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T08:41:16.841 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T08:41:16.841 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T08:41:16.842 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T08:41:16.842 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T08:41:16.842 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T08:41:16.842 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T08:41:16.842 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T08:41:16.842 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T08:41:16.842 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T08:41:16.842 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T08:41:16.842 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T08:41:16.842 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T08:41:16.842 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T08:41:16.842 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T08:41:16.843 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T08:41:16.843 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T08:41:16.843 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T08:41:16.843 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T08:41:16.843 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T08:41:16.843 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T08:41:16.843 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T08:41:16.843 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T08:41:16.843 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T08:41:16.843 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T08:41:16.843 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T08:41:16.843 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T08:41:16.844 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T08:41:16.844 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T08:41:16.844 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T08:41:16.844 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T08:41:16.844 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T08:41:16.844 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T08:41:16.844 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T08:41:16.844 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T08:41:16.844 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T08:41:16.844 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T08:41:16.844 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T08:41:16.845 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T08:41:16.845 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T08:41:16.845 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T08:41:16.845 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T08:41:16.845 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T08:41:16.845 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T08:41:16.845 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T08:41:16.845 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T08:41:16.845 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T08:41:16.845 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T08:41:16.845 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T08:41:16.846 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T08:41:16.846 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T08:41:16.846 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T08:41:16.846 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T08:41:16.846 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T08:41:16.846 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T08:41:16.846 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T08:41:16.846 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T08:41:16.846 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T08:41:16.846 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T08:41:16.847 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T08:41:16.847 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T08:41:16.847 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T08:41:16.847 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T08:41:16.847 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T08:41:16.847 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T08:41:16.847 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T08:41:16.847 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T08:41:16.847 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T08:41:16.847 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T08:41:16.847 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T08:41:16.847 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T08:41:16.848 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T08:41:16.848 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T08:41:16.848 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T08:41:16.848 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T08:41:16.848 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T08:41:16.848 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T08:41:16.848 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T08:41:16.848 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T08:41:16.848 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T08:41:16.848 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T08:41:16.848 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T08:41:16.848 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T08:41:16.849 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T08:41:16.849 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T08:41:16.849 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T08:41:16.849 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T08:41:16.849 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T08:41:16.849 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T08:41:16.849 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T08:41:16.849 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T08:41:16.849 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T08:41:16.849 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T08:41:16.849 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T08:41:16.849 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T08:41:16.849 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T08:41:16.850 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T08:41:16.850 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T08:41:16.850 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T08:41:19.801 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T08:41:19.801 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:41:19.801 INFO:teuthology.orchestra.run.smithi019.stdout:Upgraded: 2024-09-19T08:41:19.802 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T08:41:19.802 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T08:41:19.802 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T08:41:19.802 INFO:teuthology.orchestra.run.smithi019.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T08:41:19.802 INFO:teuthology.orchestra.run.smithi019.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:19.802 INFO:teuthology.orchestra.run.smithi019.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:19.802 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T08:41:19.802 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T08:41:19.802 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2024-09-19T08:41:19.802 INFO:teuthology.orchestra.run.smithi019.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T08:41:19.802 INFO:teuthology.orchestra.run.smithi019.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T08:41:19.802 INFO:teuthology.orchestra.run.smithi019.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T08:41:19.803 INFO:teuthology.orchestra.run.smithi019.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T08:41:19.803 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:19.803 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:19.803 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:19.803 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:19.803 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:41:19.803 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:19.803 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:19.803 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:19.803 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:41:19.803 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:41:19.803 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:41:19.803 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:41:19.804 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:41:19.804 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:19.804 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:19.804 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:41:19.804 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:19.804 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:19.804 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:19.804 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:41:19.804 INFO:teuthology.orchestra.run.smithi019.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:41:19.804 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:19.804 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:19.804 INFO:teuthology.orchestra.run.smithi019.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T08:41:19.805 INFO:teuthology.orchestra.run.smithi019.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T08:41:19.805 INFO:teuthology.orchestra.run.smithi019.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T08:41:19.805 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T08:41:19.805 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T08:41:19.805 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T08:41:19.805 INFO:teuthology.orchestra.run.smithi019.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T08:41:19.805 INFO:teuthology.orchestra.run.smithi019.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T08:41:19.805 INFO:teuthology.orchestra.run.smithi019.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T08:41:19.805 INFO:teuthology.orchestra.run.smithi019.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T08:41:19.805 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T08:41:19.805 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T08:41:19.805 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:19.805 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:19.805 INFO:teuthology.orchestra.run.smithi019.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:19.806 INFO:teuthology.orchestra.run.smithi019.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T08:41:19.806 INFO:teuthology.orchestra.run.smithi019.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T08:41:19.806 INFO:teuthology.orchestra.run.smithi019.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T08:41:19.806 INFO:teuthology.orchestra.run.smithi019.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T08:41:19.806 INFO:teuthology.orchestra.run.smithi019.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T08:41:19.806 INFO:teuthology.orchestra.run.smithi019.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:19.806 INFO:teuthology.orchestra.run.smithi019.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:19.806 INFO:teuthology.orchestra.run.smithi019.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T08:41:19.806 INFO:teuthology.orchestra.run.smithi019.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:19.806 INFO:teuthology.orchestra.run.smithi019.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T08:41:19.806 INFO:teuthology.orchestra.run.smithi019.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T08:41:19.806 INFO:teuthology.orchestra.run.smithi019.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T08:41:19.806 INFO:teuthology.orchestra.run.smithi019.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T08:41:19.807 INFO:teuthology.orchestra.run.smithi019.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T08:41:19.807 INFO:teuthology.orchestra.run.smithi019.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T08:41:19.807 INFO:teuthology.orchestra.run.smithi019.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T08:41:19.807 INFO:teuthology.orchestra.run.smithi019.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T08:41:19.807 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T08:41:19.807 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T08:41:19.807 INFO:teuthology.orchestra.run.smithi019.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T08:41:19.807 INFO:teuthology.orchestra.run.smithi019.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T08:41:19.807 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T08:41:19.807 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T08:41:19.807 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T08:41:19.807 INFO:teuthology.orchestra.run.smithi019.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T08:41:19.807 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T08:41:19.808 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T08:41:19.808 INFO:teuthology.orchestra.run.smithi019.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T08:41:19.808 INFO:teuthology.orchestra.run.smithi019.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T08:41:19.808 INFO:teuthology.orchestra.run.smithi019.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T08:41:19.808 INFO:teuthology.orchestra.run.smithi019.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T08:41:19.808 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T08:41:19.808 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:19.808 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:19.808 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:19.808 INFO:teuthology.orchestra.run.smithi019.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T08:41:19.808 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T08:41:19.808 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T08:41:19.808 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T08:41:19.808 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T08:41:19.809 INFO:teuthology.orchestra.run.smithi019.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T08:41:19.809 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T08:41:19.809 INFO:teuthology.orchestra.run.smithi019.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T08:41:19.809 INFO:teuthology.orchestra.run.smithi019.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T08:41:19.809 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T08:41:19.809 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T08:41:19.809 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T08:41:19.809 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T08:41:19.809 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T08:41:19.809 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T08:41:19.809 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T08:41:19.809 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T08:41:19.810 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T08:41:19.810 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T08:41:19.810 INFO:teuthology.orchestra.run.smithi019.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T08:41:19.810 INFO:teuthology.orchestra.run.smithi019.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T08:41:19.810 INFO:teuthology.orchestra.run.smithi019.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T08:41:19.810 INFO:teuthology.orchestra.run.smithi019.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T08:41:19.810 INFO:teuthology.orchestra.run.smithi019.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T08:41:19.810 INFO:teuthology.orchestra.run.smithi019.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T08:41:19.810 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T08:41:19.810 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T08:41:19.810 INFO:teuthology.orchestra.run.smithi019.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T08:41:19.810 INFO:teuthology.orchestra.run.smithi019.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T08:41:19.810 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T08:41:19.811 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T08:41:19.811 INFO:teuthology.orchestra.run.smithi019.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T08:41:19.811 INFO:teuthology.orchestra.run.smithi019.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T08:41:19.811 INFO:teuthology.orchestra.run.smithi019.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T08:41:19.811 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T08:41:19.811 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T08:41:19.811 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T08:41:19.811 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T08:41:19.811 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T08:41:19.811 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T08:41:19.811 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:19.811 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:19.811 INFO:teuthology.orchestra.run.smithi019.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T08:41:19.812 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T08:41:19.812 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T08:41:19.812 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:19.812 INFO:teuthology.orchestra.run.smithi019.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T08:41:19.812 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T08:41:19.812 INFO:teuthology.orchestra.run.smithi019.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T08:41:19.812 INFO:teuthology.orchestra.run.smithi019.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T08:41:19.812 INFO:teuthology.orchestra.run.smithi019.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T08:41:19.812 INFO:teuthology.orchestra.run.smithi019.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T08:41:19.812 INFO:teuthology.orchestra.run.smithi019.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T08:41:19.812 INFO:teuthology.orchestra.run.smithi019.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T08:41:19.812 INFO:teuthology.orchestra.run.smithi019.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T08:41:19.812 INFO:teuthology.orchestra.run.smithi019.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T08:41:19.812 INFO:teuthology.orchestra.run.smithi019.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T08:41:19.813 INFO:teuthology.orchestra.run.smithi019.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T08:41:19.813 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T08:41:19.813 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T08:41:19.813 INFO:teuthology.orchestra.run.smithi019.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T08:41:19.813 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:19.813 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:19.813 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T08:41:19.813 INFO:teuthology.orchestra.run.smithi019.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T08:41:19.813 INFO:teuthology.orchestra.run.smithi019.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T08:41:19.813 INFO:teuthology.orchestra.run.smithi019.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T08:41:19.813 INFO:teuthology.orchestra.run.smithi019.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T08:41:19.813 INFO:teuthology.orchestra.run.smithi019.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T08:41:19.813 INFO:teuthology.orchestra.run.smithi019.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T08:41:19.814 INFO:teuthology.orchestra.run.smithi019.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T08:41:19.814 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:41:19.814 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-09-19T08:41:20.227 DEBUG:teuthology.parallel:result is None 2024-09-19T08:41:20.228 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:41:20.374 DEBUG:teuthology.orchestra.run.smithi019:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T08:41:20.397 INFO:teuthology.orchestra.run.smithi019.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T08:41:20.398 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T08:41:20.398 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T08:41:20.400 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:41:20.546 DEBUG:teuthology.orchestra.run.smithi155:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T08:41:20.572 INFO:teuthology.orchestra.run.smithi155.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T08:41:20.573 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T08:41:20.573 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T08:41:20.575 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:41:20.718 DEBUG:teuthology.orchestra.run.smithi203:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T08:41:20.745 INFO:teuthology.orchestra.run.smithi203.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T08:41:20.745 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T08:41:20.745 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T08:41:20.747 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T08:41:20.747 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-19T08:41:20.747 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T08:41:20.777 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-19T08:41:20.777 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T08:41:20.810 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-19T08:41:20.810 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T08:41:20.841 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T08:41:20.842 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-19T08:41:20.842 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T08:41:20.869 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T08:41:20.936 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-19T08:41:20.936 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T08:41:20.963 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T08:41:21.029 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-19T08:41:21.029 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T08:41:21.059 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T08:41:21.128 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T08:41:21.128 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-19T08:41:21.128 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T08:41:21.155 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T08:41:21.222 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-19T08:41:21.222 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T08:41:21.248 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T08:41:21.319 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-19T08:41:21.320 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T08:41:21.345 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T08:41:21.410 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T08:41:21.410 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-19T08:41:21.410 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T08:41:21.438 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T08:41:21.505 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-19T08:41:21.505 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T08:41:21.531 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T08:41:21.596 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-19T08:41:21.596 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T08:41:21.621 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T08:41:21.686 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-19T08:41:21.784 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'subvols': {'create': 2}} 2024-09-19T08:41:21.784 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:41:21.785 INFO:tasks.cephadm:Cluster fsid is f26c9d84-7662-11ef-bceb-c7b262605968 2024-09-19T08:41:21.785 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-19T08:41:21.785 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.19', 'mon.b': '172.21.15.155', 'mon.c': '172.21.15.203'} 2024-09-19T08:41:21.785 INFO:tasks.cephadm:First mon is mon.a on smithi019 2024-09-19T08:41:21.785 INFO:tasks.cephadm:First mgr is x 2024-09-19T08:41:21.785 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-19T08:41:21.786 DEBUG:teuthology.orchestra.run.smithi019:> sudo hostname $(hostname -s) 2024-09-19T08:41:21.814 DEBUG:teuthology.orchestra.run.smithi155:> sudo hostname $(hostname -s) 2024-09-19T08:41:21.839 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname $(hostname -s) 2024-09-19T08:41:21.864 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-19T08:41:21.865 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:41:22.009 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56106/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-361-g2f599a46', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-361.g2f599a46'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-18 17:52:24.287651', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-19T08:41:22.152 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref squid, sha1 2f599a46ad10e37c929e5c43da2f6907ddcd1961 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:41:22.154 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T08:41:22.154 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T08:41:22.154 DEBUG:teuthology.orchestra.run.smithi019:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T08:41:22.546 INFO:teuthology.orchestra.run.smithi019.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 08:41 /home/ubuntu/cephtest/cephadm 2024-09-19T08:41:22.546 DEBUG:teuthology.orchestra.run.smithi155:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T08:41:22.930 INFO:teuthology.orchestra.run.smithi155.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 08:41 /home/ubuntu/cephtest/cephadm 2024-09-19T08:41:22.930 DEBUG:teuthology.orchestra.run.smithi203:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T08:41:23.292 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 08:41 /home/ubuntu/cephtest/cephadm 2024-09-19T08:41:23.292 DEBUG:teuthology.orchestra.run.smithi019:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T08:41:23.313 DEBUG:teuthology.orchestra.run.smithi155:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T08:41:23.332 DEBUG:teuthology.orchestra.run.smithi203:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T08:41:23.364 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 on all hosts... 2024-09-19T08:41:23.364 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T08:41:23.367 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T08:41:23.375 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T08:41:24.896 INFO:teuthology.orchestra.run.smithi203.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T08:41:24.945 INFO:teuthology.orchestra.run.smithi155.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T08:41:24.950 INFO:teuthology.orchestra.run.smithi019.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T08:41:58.198 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:41:58.198 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T08:41:58.198 INFO:teuthology.orchestra.run.smithi019.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T08:41:58.198 INFO:teuthology.orchestra.run.smithi019.stdout: "repo_digests": [ 2024-09-19T08:41:58.198 INFO:teuthology.orchestra.run.smithi019.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T08:41:58.199 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-19T08:41:58.199 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:42:11.045 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-09-19T08:42:11.045 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T08:42:11.045 INFO:teuthology.orchestra.run.smithi155.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T08:42:11.045 INFO:teuthology.orchestra.run.smithi155.stdout: "repo_digests": [ 2024-09-19T08:42:11.045 INFO:teuthology.orchestra.run.smithi155.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T08:42:11.045 INFO:teuthology.orchestra.run.smithi155.stdout: ] 2024-09-19T08:42:11.045 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-09-19T08:42:14.423 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-19T08:42:14.424 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T08:42:14.424 INFO:teuthology.orchestra.run.smithi203.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T08:42:14.424 INFO:teuthology.orchestra.run.smithi203.stdout: "repo_digests": [ 2024-09-19T08:42:14.424 INFO:teuthology.orchestra.run.smithi203.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T08:42:14.424 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-09-19T08:42:14.424 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-19T08:42:14.448 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /etc/ceph 2024-09-19T08:42:14.482 DEBUG:teuthology.orchestra.run.smithi155:> sudo mkdir -p /etc/ceph 2024-09-19T08:42:14.516 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /etc/ceph 2024-09-19T08:42:14.543 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 777 /etc/ceph 2024-09-19T08:42:14.572 DEBUG:teuthology.orchestra.run.smithi155:> sudo chmod 777 /etc/ceph 2024-09-19T08:42:14.601 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 777 /etc/ceph 2024-09-19T08:42:14.626 INFO:tasks.cephadm:Writing seed config... 2024-09-19T08:42:14.627 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-19T08:42:14.628 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-19T08:42:14.628 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-19T08:42:14.628 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-19T08:42:14.628 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-19T08:42:14.628 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-09-19T08:42:14.628 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-19T08:42:14.628 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-19T08:42:14.628 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-19T08:42:14.628 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-19T08:42:14.628 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-19T08:42:14.628 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-19T08:42:14.628 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-19T08:42:14.628 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-19T08:42:14.628 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-19T08:42:14.629 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-19T08:42:14.629 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-19T08:42:14.632 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-19T08:42:14.632 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-09-19T08:42:14.632 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-19T08:42:14.632 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-19T08:42:14.633 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-19T08:42:14.633 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-19T08:42:14.633 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-19T08:42:14.633 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-19T08:42:14.633 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-19T08:42:14.633 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-19T08:42:14.633 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-19T08:42:14.633 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-19T08:42:14.633 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-19T08:42:14.633 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-19T08:42:14.634 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-19T08:42:14.634 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-19T08:42:14.634 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-19T08:42:14.634 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-19T08:42:14.634 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-19T08:42:14.634 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-19T08:42:14.634 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-19T08:42:14.634 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-19T08:42:14.634 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-19T08:42:14.634 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-19T08:42:14.634 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-19T08:42:14.634 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-19T08:42:14.634 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-19T08:42:14.634 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-19T08:42:14.635 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-19T08:42:14.635 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-19T08:42:14.635 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-19T08:42:14.636 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-19T08:42:14.636 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-19T08:42:14.653 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = f26c9d84-7662-11ef-bceb-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-19T08:42:14.654 DEBUG:teuthology.orchestra.run.smithi019:mon.a> sudo journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mon.a.service 2024-09-19T08:42:14.696 DEBUG:teuthology.orchestra.run.smithi019:mgr.x> sudo journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mgr.x.service 2024-09-19T08:42:14.739 INFO:tasks.cephadm:Bootstrapping... 2024-09-19T08:42:14.739 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 -v bootstrap --fsid f26c9d84-7662-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.19 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:42:14.952 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-09-19T08:42:14.952 INFO:teuthology.orchestra.run.smithi019.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961', '-v', 'bootstrap', '--fsid', 'f26c9d84-7662-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.19', '--skip-admin-label'] 2024-09-19T08:42:14.953 INFO:teuthology.orchestra.run.smithi019.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-19T08:42:14.953 INFO:teuthology.orchestra.run.smithi019.stdout:Verifying podman|docker is present... 2024-09-19T08:42:14.977 INFO:teuthology.orchestra.run.smithi019.stdout:/bin/podman: stdout 5.2.2 2024-09-19T08:42:14.977 INFO:teuthology.orchestra.run.smithi019.stdout:Verifying lvm2 is present... 2024-09-19T08:42:14.977 INFO:teuthology.orchestra.run.smithi019.stdout:Verifying time synchronization is in place... 2024-09-19T08:42:14.985 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T08:42:14.985 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T08:42:14.992 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T08:42:14.992 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout inactive 2024-09-19T08:42:14.999 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout enabled 2024-09-19T08:42:15.005 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout active 2024-09-19T08:42:15.005 INFO:teuthology.orchestra.run.smithi019.stdout:Unit chronyd.service is enabled and running 2024-09-19T08:42:15.005 INFO:teuthology.orchestra.run.smithi019.stdout:Repeating the final host check... 2024-09-19T08:42:15.028 INFO:teuthology.orchestra.run.smithi019.stdout:/bin/podman: stdout 5.2.2 2024-09-19T08:42:15.029 INFO:teuthology.orchestra.run.smithi019.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-19T08:42:15.029 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl is present 2024-09-19T08:42:15.029 INFO:teuthology.orchestra.run.smithi019.stdout:lvcreate is present 2024-09-19T08:42:15.035 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T08:42:15.035 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T08:42:15.041 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T08:42:15.041 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout inactive 2024-09-19T08:42:15.048 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout enabled 2024-09-19T08:42:15.055 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout active 2024-09-19T08:42:15.055 INFO:teuthology.orchestra.run.smithi019.stdout:Unit chronyd.service is enabled and running 2024-09-19T08:42:15.055 INFO:teuthology.orchestra.run.smithi019.stdout:Host looks OK 2024-09-19T08:42:15.055 INFO:teuthology.orchestra.run.smithi019.stdout:Cluster fsid: f26c9d84-7662-11ef-bceb-c7b262605968 2024-09-19T08:42:15.056 INFO:teuthology.orchestra.run.smithi019.stdout:Acquiring lock 140657137357824 on /run/cephadm/f26c9d84-7662-11ef-bceb-c7b262605968.lock 2024-09-19T08:42:15.056 INFO:teuthology.orchestra.run.smithi019.stdout:Lock 140657137357824 acquired on /run/cephadm/f26c9d84-7662-11ef-bceb-c7b262605968.lock 2024-09-19T08:42:15.056 INFO:teuthology.orchestra.run.smithi019.stdout:Verifying IP 172.21.15.19 port 3300 ... 2024-09-19T08:42:15.057 INFO:teuthology.orchestra.run.smithi019.stdout:Verifying IP 172.21.15.19 port 6789 ... 2024-09-19T08:42:15.057 INFO:teuthology.orchestra.run.smithi019.stdout:Base mon IP(s) is [172.21.15.19:3300, 172.21.15.19:6789], mon addrv is [v2:172.21.15.19:3300,v1:172.21.15.19:6789] 2024-09-19T08:42:15.060 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.19 metric 100 2024-09-19T08:42:15.060 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.19 metric 100 2024-09-19T08:42:15.062 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-19T08:42:15.062 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-19T08:42:15.062 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1794sec hoplimit 64 pref medium 2024-09-19T08:42:15.065 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-19T08:42:15.065 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-19T08:42:15.065 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T08:42:15.065 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-19T08:42:15.066 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:161e/64 scope link 2024-09-19T08:42:15.066 INFO:teuthology.orchestra.run.smithi019.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T08:42:15.066 INFO:teuthology.orchestra.run.smithi019.stdout:Mon IP `172.21.15.19` is in CIDR network `172.21.0.0/20` 2024-09-19T08:42:15.066 INFO:teuthology.orchestra.run.smithi019.stdout:Mon IP `172.21.15.19` is in CIDR network `172.21.0.0/20` 2024-09-19T08:42:15.066 INFO:teuthology.orchestra.run.smithi019.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-19T08:42:15.067 INFO:teuthology.orchestra.run.smithi019.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-19T08:42:15.067 INFO:teuthology.orchestra.run.smithi019.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T08:42:15.531 INFO:teuthology.orchestra.run.smithi019.stdout:/bin/podman: stdout d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T08:42:15.531 INFO:teuthology.orchestra.run.smithi019.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T08:42:15.531 INFO:teuthology.orchestra.run.smithi019.stdout:/bin/podman: stderr Getting image source signatures 2024-09-19T08:42:15.531 INFO:teuthology.orchestra.run.smithi019.stdout:/bin/podman: stderr Copying blob sha256:c4221751d16d26d2a4b7031ebd71ecffffff13c8cf7401cf95ce80dab3b6d67a 2024-09-19T08:42:15.532 INFO:teuthology.orchestra.run.smithi019.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-19T08:42:15.532 INFO:teuthology.orchestra.run.smithi019.stdout:/bin/podman: stderr Copying config sha256:d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T08:42:15.532 INFO:teuthology.orchestra.run.smithi019.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-19T08:42:16.502 INFO:teuthology.orchestra.run.smithi019.stdout:ceph: stdout ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T08:42:16.503 INFO:teuthology.orchestra.run.smithi019.stdout:Ceph version: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T08:42:16.503 INFO:teuthology.orchestra.run.smithi019.stdout:Extracting ceph user uid/gid from container image... 2024-09-19T08:42:17.392 INFO:teuthology.orchestra.run.smithi019.stdout:stat: stdout 167 167 2024-09-19T08:42:17.392 INFO:teuthology.orchestra.run.smithi019.stdout:Creating initial keys... 2024-09-19T08:42:18.397 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph-authtool: stdout AQDp4+tmfhhVKRAATRGqxIGMJdfLPU1jUYSP5Q== 2024-09-19T08:42:21.849 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph-authtool: stdout AQDq4+tmBHCbKBAAOGJq5sngPDd5lPiXHkt+5g== 2024-09-19T08:42:28.893 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph-authtool: stdout AQDw4+tmZ5BTMhAAPEhbKU6c9ipBljEjQ2AB5A== 2024-09-19T08:42:28.894 INFO:teuthology.orchestra.run.smithi019.stdout:Creating initial monmap... 2024-09-19T08:42:29.915 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T08:42:29.916 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-19T08:42:29.916 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to f26c9d84-7662-11ef-bceb-c7b262605968 2024-09-19T08:42:29.917 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T08:42:29.917 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool for a [v2:172.21.15.19:3300,v1:172.21.15.19:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T08:42:29.917 INFO:teuthology.orchestra.run.smithi019.stdout:setting min_mon_release = quincy 2024-09-19T08:42:29.917 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/monmaptool: set fsid to f26c9d84-7662-11ef-bceb-c7b262605968 2024-09-19T08:42:29.917 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T08:42:29.917 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:42:29.917 INFO:teuthology.orchestra.run.smithi019.stdout:Creating mon... 2024-09-19T08:42:30.880 INFO:teuthology.orchestra.run.smithi019.stdout:create mon.a on 2024-09-19T08:42:31.091 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-19T08:42:31.278 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-19T08:42:31.483 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-f26c9d84-7662-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-f26c9d84-7662-11ef-bceb-c7b262605968.target. 2024-09-19T08:42:31.483 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-f26c9d84-7662-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-f26c9d84-7662-11ef-bceb-c7b262605968.target. 2024-09-19T08:42:31.719 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mon.a 2024-09-19T08:42:31.719 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-19T08:42:31.888 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f26c9d84-7662-11ef-bceb-c7b262605968.target.wants/ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-f26c9d84-7662-11ef-bceb-c7b262605968@.service. 2024-09-19T08:42:32.366 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:32 smithi019 ceph-mon[30610]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T08:42:32.366 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:32 smithi019 bash[30591]: 8e6f37371aff2d363603044ef8f253aee5c8e54b8e7f790beea63c4766034fe8 2024-09-19T08:42:32.380 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T08:42:32.381 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout disabled 2024-09-19T08:42:32.387 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T08:42:32.387 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout inactive 2024-09-19T08:42:32.387 INFO:teuthology.orchestra.run.smithi019.stdout:firewalld.service is not enabled 2024-09-19T08:42:32.388 INFO:teuthology.orchestra.run.smithi019.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T08:42:32.388 INFO:teuthology.orchestra.run.smithi019.stdout:Waiting for mon to start... 2024-09-19T08:42:32.388 INFO:teuthology.orchestra.run.smithi019.stdout:Waiting for mon... 2024-09-19T08:42:32.622 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:32 smithi019 systemd[1]: Started Ceph mon.a for f26c9d84-7662-11ef-bceb-c7b262605968. 2024-09-19T08:42:33.314 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout cluster: 2024-09-19T08:42:33.314 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout id: f26c9d84-7662-11ef-bceb-c7b262605968 2024-09-19T08:42:33.314 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-19T08:42:33.314 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-09-19T08:42:33.315 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout services: 2024-09-19T08:42:33.315 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.564389s) 2024-09-19T08:42:33.315 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-19T08:42:33.315 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-19T08:42:33.315 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-09-19T08:42:33.315 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout data: 2024-09-19T08:42:33.315 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-19T08:42:33.315 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-19T08:42:33.315 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-19T08:42:33.315 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout pgs: 2024-09-19T08:42:33.315 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-09-19T08:42:33.315 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.815+0000 7fc7159f1640 1 Processor -- start 2024-09-19T08:42:33.315 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.815+0000 7fc7159f1640 1 -- start start 2024-09-19T08:42:33.315 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.815+0000 7fc7159f1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7101081a0 0x7fc71010a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:33.316 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.815+0000 7fc7159f1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc71007be70 con 0x7fc7101081a0 2024-09-19T08:42:33.316 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.816+0000 7fc70effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7101081a0 0x7fc71010a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:33.316 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.816+0000 7fc70effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7101081a0 0x7fc71010a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52806/0 (socket says 172.21.15.19:52806) 2024-09-19T08:42:33.316 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.816+0000 7fc70effd640 1 -- 172.21.15.19:0/1176773093 learned_addr learned my addr 172.21.15.19:0/1176773093 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:42:33.316 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.816+0000 7fc70effd640 1 -- 172.21.15.19:0/1176773093 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc71010aad0 con 0x7fc7101081a0 2024-09-19T08:42:33.316 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.818+0000 7fc70effd640 1 --2- 172.21.15.19:0/1176773093 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7101081a0 0x7fc71010a590 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc700009820 tx=0x7fc70002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf7932f1fe1df542 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:33.316 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.818+0000 7fc70e7fc640 1 -- 172.21.15.19:0/1176773093 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc700037070 con 0x7fc7101081a0 2024-09-19T08:42:33.316 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.818+0000 7fc70e7fc640 1 -- 172.21.15.19:0/1176773093 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc700032440 con 0x7fc7101081a0 2024-09-19T08:42:33.316 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.818+0000 7fc70e7fc640 1 -- 172.21.15.19:0/1176773093 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc700032740 con 0x7fc7101081a0 2024-09-19T08:42:33.316 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.819+0000 7fc7159f1640 1 -- 172.21.15.19:0/1176773093 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7101081a0 msgr2=0x7fc71010a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:33.316 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.819+0000 7fc7159f1640 1 --2- 172.21.15.19:0/1176773093 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7101081a0 0x7fc71010a590 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc700009820 tx=0x7fc70002a270 comp rx=0 tx=0).stop 2024-09-19T08:42:33.317 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.819+0000 7fc7159f1640 1 -- 172.21.15.19:0/1176773093 shutdown_connections 2024-09-19T08:42:33.317 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.819+0000 7fc7159f1640 1 --2- 172.21.15.19:0/1176773093 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7101081a0 0x7fc71010a590 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:33.317 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.819+0000 7fc7159f1640 1 -- 172.21.15.19:0/1176773093 >> 172.21.15.19:0/1176773093 conn(0x7fc710101da0 msgr2=0x7fc7101041c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:33.317 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.819+0000 7fc7159f1640 1 -- 172.21.15.19:0/1176773093 shutdown_connections 2024-09-19T08:42:33.317 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.819+0000 7fc7159f1640 1 -- 172.21.15.19:0/1176773093 wait complete. 2024-09-19T08:42:33.317 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.820+0000 7fc7159f1640 1 Processor -- start 2024-09-19T08:42:33.317 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.820+0000 7fc7159f1640 1 -- start start 2024-09-19T08:42:33.317 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.820+0000 7fc7159f1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7101081a0 0x7fc710107a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:33.317 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.820+0000 7fc7159f1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc71010afb0 con 0x7fc7101081a0 2024-09-19T08:42:33.317 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.820+0000 7fc70effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7101081a0 0x7fc710107a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:33.317 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.820+0000 7fc70effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7101081a0 0x7fc710107a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52808/0 (socket says 172.21.15.19:52808) 2024-09-19T08:42:33.318 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.820+0000 7fc70effd640 1 -- 172.21.15.19:0/2810377905 learned_addr learned my addr 172.21.15.19:0/2810377905 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:42:33.318 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.820+0000 7fc70effd640 1 -- 172.21.15.19:0/2810377905 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc710107f60 con 0x7fc7101081a0 2024-09-19T08:42:33.318 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.821+0000 7fc70effd640 1 --2- 172.21.15.19:0/2810377905 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7101081a0 0x7fc710107a20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc7000090b0 tx=0x7fc7000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:33.318 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.821+0000 7fc7149ef640 1 -- 172.21.15.19:0/2810377905 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc700041070 con 0x7fc7101081a0 2024-09-19T08:42:33.318 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.821+0000 7fc7149ef640 1 -- 172.21.15.19:0/2810377905 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc70003c7a0 con 0x7fc7101081a0 2024-09-19T08:42:33.318 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.821+0000 7fc7159f1640 1 -- 172.21.15.19:0/2810377905 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc710106150 con 0x7fc7101081a0 2024-09-19T08:42:33.318 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.821+0000 7fc7149ef640 1 -- 172.21.15.19:0/2810377905 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc700037040 con 0x7fc7101081a0 2024-09-19T08:42:33.318 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.821+0000 7fc7159f1640 1 -- 172.21.15.19:0/2810377905 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc710106690 con 0x7fc7101081a0 2024-09-19T08:42:33.318 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.821+0000 7fc7149ef640 1 -- 172.21.15.19:0/2810377905 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc700044070 con 0x7fc7101081a0 2024-09-19T08:42:33.318 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.821+0000 7fc7149ef640 1 -- 172.21.15.19:0/2810377905 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc70003d3f0 con 0x7fc7101081a0 2024-09-19T08:42:33.318 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.822+0000 7fc7159f1640 1 -- 172.21.15.19:0/2810377905 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc710108600 con 0x7fc7101081a0 2024-09-19T08:42:33.318 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.824+0000 7fc7149ef640 1 -- 172.21.15.19:0/2810377905 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc700046450 con 0x7fc7101081a0 2024-09-19T08:42:33.318 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.885+0000 7fc7159f1640 1 -- 172.21.15.19:0/2810377905 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fc7101948e0 con 0x7fc7101081a0 2024-09-19T08:42:33.319 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.886+0000 7fc7149ef640 1 -- 172.21.15.19:0/2810377905 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7fc700046630 con 0x7fc7101081a0 2024-09-19T08:42:33.319 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.887+0000 7fc7159f1640 1 -- 172.21.15.19:0/2810377905 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7101081a0 msgr2=0x7fc710107a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:33.319 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.887+0000 7fc7159f1640 1 --2- 172.21.15.19:0/2810377905 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7101081a0 0x7fc710107a20 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc7000090b0 tx=0x7fc7000046c0 comp rx=0 tx=0).stop 2024-09-19T08:42:33.319 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.887+0000 7fc7159f1640 1 -- 172.21.15.19:0/2810377905 shutdown_connections 2024-09-19T08:42:33.319 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.887+0000 7fc7159f1640 1 --2- 172.21.15.19:0/2810377905 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7101081a0 0x7fc710107a20 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:33.319 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.887+0000 7fc7159f1640 1 -- 172.21.15.19:0/2810377905 >> 172.21.15.19:0/2810377905 conn(0x7fc710101da0 msgr2=0x7fc710102e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:33.319 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.887+0000 7fc7159f1640 1 -- 172.21.15.19:0/2810377905 shutdown_connections 2024-09-19T08:42:33.319 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:32.887+0000 7fc7159f1640 1 -- 172.21.15.19:0/2810377905 wait complete. 2024-09-19T08:42:33.319 INFO:teuthology.orchestra.run.smithi019.stdout:mon is available 2024-09-19T08:42:33.319 INFO:teuthology.orchestra.run.smithi019.stdout:Assimilating anything we can from ceph.conf... 2024-09-19T08:42:33.563 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:33 smithi019 ceph-mon[30610]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T08:42:33.564 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:33 smithi019 ceph-mon[30610]: monmap epoch 1 2024-09-19T08:42:33.564 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:33 smithi019 ceph-mon[30610]: fsid f26c9d84-7662-11ef-bceb-c7b262605968 2024-09-19T08:42:33.564 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:33 smithi019 ceph-mon[30610]: last_changed 2024-09-19T08:42:29.207639+0000 2024-09-19T08:42:33.564 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:33 smithi019 ceph-mon[30610]: created 2024-09-19T08:42:29.207639+0000 2024-09-19T08:42:33.564 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:33 smithi019 ceph-mon[30610]: min_mon_release 19 (squid) 2024-09-19T08:42:33.564 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:33 smithi019 ceph-mon[30610]: election_strategy: 1 2024-09-19T08:42:33.564 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:33 smithi019 ceph-mon[30610]: 0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-19T08:42:33.564 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:33 smithi019 ceph-mon[30610]: fsmap 2024-09-19T08:42:33.564 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:33 smithi019 ceph-mon[30610]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T08:42:33.564 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:33 smithi019 ceph-mon[30610]: mgrmap e1: no daemons active 2024-09-19T08:42:33.564 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:33 smithi019 ceph-mon[30610]: from='client.? 172.21.15.19:0/2810377905' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-19T08:42:34.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:34 smithi019 ceph-mon[30610]: from='client.? 172.21.15.19:0/2376737653' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T08:42:34.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:34 smithi019 ceph-mon[30610]: from='client.? 172.21.15.19:0/2376737653' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-19T08:42:36.848 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-09-19T08:42:36.848 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T08:42:36.848 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout fsid = f26c9d84-7662-11ef-bceb-c7b262605968 2024-09-19T08:42:36.848 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.19:3300,v1:172.21.15.19:6789] 2024-09-19T08:42:36.848 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T08:42:36.849 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T08:42:36.849 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T08:42:36.849 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T08:42:36.849 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-09-19T08:42:36.849 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T08:42:36.849 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T08:42:36.849 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-09-19T08:42:36.849 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T08:42:36.849 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T08:42:36.849 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T08:42:36.849 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T08:42:36.849 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T08:42:36.849 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T08:42:36.849 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.730+0000 7fa68ec66640 1 Processor -- start 2024-09-19T08:42:36.850 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.730+0000 7fa68ec66640 1 -- start start 2024-09-19T08:42:36.850 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.731+0000 7fa68ec66640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6881076e0 0x7fa688107ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:36.850 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.731+0000 7fa68ec66640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa6881080b0 con 0x7fa6881076e0 2024-09-19T08:42:36.850 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.731+0000 7fa68ca02640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6881076e0 0x7fa688107ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:36.850 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.731+0000 7fa68ca02640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6881076e0 0x7fa688107ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52820/0 (socket says 172.21.15.19:52820) 2024-09-19T08:42:36.850 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.731+0000 7fa68ca02640 1 -- 172.21.15.19:0/1891348583 learned_addr learned my addr 172.21.15.19:0/1891348583 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:42:36.850 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.731+0000 7fa68ca02640 1 -- 172.21.15.19:0/1891348583 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6881088e0 con 0x7fa6881076e0 2024-09-19T08:42:36.850 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.732+0000 7fa68ca02640 1 --2- 172.21.15.19:0/1891348583 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6881076e0 0x7fa688107ae0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fa67c009820 tx=0x7fa67c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c4c5d8361ef09d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:36.850 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.732+0000 7fa6877fe640 1 -- 172.21.15.19:0/1891348583 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa67c037070 con 0x7fa6881076e0 2024-09-19T08:42:36.850 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.732+0000 7fa6877fe640 1 -- 172.21.15.19:0/1891348583 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa67c032440 con 0x7fa6881076e0 2024-09-19T08:42:36.850 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.732+0000 7fa6877fe640 1 -- 172.21.15.19:0/1891348583 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa67c032740 con 0x7fa6881076e0 2024-09-19T08:42:36.850 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.733+0000 7fa68ec66640 1 -- 172.21.15.19:0/1891348583 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6881076e0 msgr2=0x7fa688107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:36.851 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.733+0000 7fa68ec66640 1 --2- 172.21.15.19:0/1891348583 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6881076e0 0x7fa688107ae0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fa67c009820 tx=0x7fa67c02a270 comp rx=0 tx=0).stop 2024-09-19T08:42:36.851 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.733+0000 7fa68ec66640 1 -- 172.21.15.19:0/1891348583 shutdown_connections 2024-09-19T08:42:36.851 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.733+0000 7fa68ec66640 1 --2- 172.21.15.19:0/1891348583 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6881076e0 0x7fa688107ae0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:36.851 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.733+0000 7fa68ec66640 1 -- 172.21.15.19:0/1891348583 >> 172.21.15.19:0/1891348583 conn(0x7fa688102e90 msgr2=0x7fa6881052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:36.851 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.733+0000 7fa68ec66640 1 -- 172.21.15.19:0/1891348583 shutdown_connections 2024-09-19T08:42:36.851 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.733+0000 7fa68ec66640 1 -- 172.21.15.19:0/1891348583 wait complete. 2024-09-19T08:42:36.851 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.733+0000 7fa68ec66640 1 Processor -- start 2024-09-19T08:42:36.851 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.734+0000 7fa68ec66640 1 -- start start 2024-09-19T08:42:36.851 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.734+0000 7fa68ec66640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6881076e0 0x7fa68819aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:36.851 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.734+0000 7fa68ec66640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa688108e80 con 0x7fa6881076e0 2024-09-19T08:42:36.851 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.734+0000 7fa68ca02640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6881076e0 0x7fa68819aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:36.851 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.734+0000 7fa68ca02640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6881076e0 0x7fa68819aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52826/0 (socket says 172.21.15.19:52826) 2024-09-19T08:42:36.851 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.734+0000 7fa68ca02640 1 -- 172.21.15.19:0/2376737653 learned_addr learned my addr 172.21.15.19:0/2376737653 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:42:36.852 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.734+0000 7fa68ca02640 1 -- 172.21.15.19:0/2376737653 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa68819b3f0 con 0x7fa6881076e0 2024-09-19T08:42:36.852 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.734+0000 7fa68ca02640 1 --2- 172.21.15.19:0/2376737653 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6881076e0 0x7fa68819aeb0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fa67c0090b0 tx=0x7fa67c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:36.852 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.734+0000 7fa685ffb640 1 -- 172.21.15.19:0/2376737653 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa67c041070 con 0x7fa6881076e0 2024-09-19T08:42:36.852 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.735+0000 7fa685ffb640 1 -- 172.21.15.19:0/2376737653 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa67c03c7a0 con 0x7fa6881076e0 2024-09-19T08:42:36.852 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.735+0000 7fa68ec66640 1 -- 172.21.15.19:0/2376737653 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa68819b680 con 0x7fa6881076e0 2024-09-19T08:42:36.852 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.735+0000 7fa685ffb640 1 -- 172.21.15.19:0/2376737653 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa67c037040 con 0x7fa6881076e0 2024-09-19T08:42:36.852 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.735+0000 7fa68ec66640 1 -- 172.21.15.19:0/2376737653 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa68819e370 con 0x7fa6881076e0 2024-09-19T08:42:36.852 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.735+0000 7fa685ffb640 1 -- 172.21.15.19:0/2376737653 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa67c044070 con 0x7fa6881076e0 2024-09-19T08:42:36.852 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.735+0000 7fa685ffb640 1 -- 172.21.15.19:0/2376737653 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa67c03d3f0 con 0x7fa6881076e0 2024-09-19T08:42:36.852 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.736+0000 7fa68ec66640 1 -- 172.21.15.19:0/2376737653 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6881094d0 con 0x7fa6881076e0 2024-09-19T08:42:36.852 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.738+0000 7fa685ffb640 1 -- 172.21.15.19:0/2376737653 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fa67c046450 con 0x7fa6881076e0 2024-09-19T08:42:36.852 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.798+0000 7fa68ec66640 1 -- 172.21.15.19:0/2376737653 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fa68802d940 con 0x7fa6881076e0 2024-09-19T08:42:36.852 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.801+0000 7fa685ffb640 1 -- 172.21.15.19:0/2376737653 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7fa67c046630 con 0x7fa6881076e0 2024-09-19T08:42:36.853 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.801+0000 7fa685ffb640 1 -- 172.21.15.19:0/2376737653 <== mon.0 v2:172.21.15.19:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa67c056070 con 0x7fa6881076e0 2024-09-19T08:42:36.853 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.802+0000 7fa68ec66640 1 -- 172.21.15.19:0/2376737653 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6881076e0 msgr2=0x7fa68819aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:36.853 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.802+0000 7fa68ec66640 1 --2- 172.21.15.19:0/2376737653 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6881076e0 0x7fa68819aeb0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fa67c0090b0 tx=0x7fa67c0046c0 comp rx=0 tx=0).stop 2024-09-19T08:42:36.853 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.802+0000 7fa68ec66640 1 -- 172.21.15.19:0/2376737653 shutdown_connections 2024-09-19T08:42:36.853 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.802+0000 7fa68ec66640 1 --2- 172.21.15.19:0/2376737653 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6881076e0 0x7fa68819aeb0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:36.853 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.802+0000 7fa68ec66640 1 -- 172.21.15.19:0/2376737653 >> 172.21.15.19:0/2376737653 conn(0x7fa688102e90 msgr2=0x7fa68818f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:36.853 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.802+0000 7fa68ec66640 1 -- 172.21.15.19:0/2376737653 shutdown_connections 2024-09-19T08:42:36.853 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:33.802+0000 7fa68ec66640 1 -- 172.21.15.19:0/2376737653 wait complete. 2024-09-19T08:42:36.853 INFO:teuthology.orchestra.run.smithi019.stdout:Generating new minimal ceph.conf... 2024-09-19T08:42:37.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:37 smithi019 ceph-mon[30610]: from='client.? 172.21.15.19:0/3695334744' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:42:37.936 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.277+0000 7f69d8abd640 1 Processor -- start 2024-09-19T08:42:37.937 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.277+0000 7f69d8abd640 1 -- start start 2024-09-19T08:42:37.937 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.278+0000 7f69d8abd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69d407dee0 0x7f69d407c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:37.937 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.278+0000 7f69d8abd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f69d407c910 con 0x7f69d407dee0 2024-09-19T08:42:37.937 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.278+0000 7f69d259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69d407dee0 0x7f69d407c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:37.937 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.278+0000 7f69d259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69d407dee0 0x7f69d407c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53404/0 (socket says 172.21.15.19:53404) 2024-09-19T08:42:37.937 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.278+0000 7f69d259c640 1 -- 172.21.15.19:0/4141609515 learned_addr learned my addr 172.21.15.19:0/4141609515 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:42:37.937 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.278+0000 7f69d259c640 1 -- 172.21.15.19:0/4141609515 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69d407ca90 con 0x7f69d407dee0 2024-09-19T08:42:37.937 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.279+0000 7f69d259c640 1 --2- 172.21.15.19:0/4141609515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69d407dee0 0x7f69d407c340 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f69c4009820 tx=0x7f69c402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f08e647ce698cc05 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:37.937 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.279+0000 7f69d159a640 1 -- 172.21.15.19:0/4141609515 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69c4037070 con 0x7f69d407dee0 2024-09-19T08:42:37.937 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.279+0000 7f69d159a640 1 -- 172.21.15.19:0/4141609515 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f69c4032900 con 0x7f69d407dee0 2024-09-19T08:42:37.937 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.279+0000 7f69d159a640 1 -- 172.21.15.19:0/4141609515 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69c4030850 con 0x7f69d407dee0 2024-09-19T08:42:37.937 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.280+0000 7f69d8abd640 1 -- 172.21.15.19:0/4141609515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69d407dee0 msgr2=0x7f69d407c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:37.938 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.280+0000 7f69d8abd640 1 --2- 172.21.15.19:0/4141609515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69d407dee0 0x7f69d407c340 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f69c4009820 tx=0x7f69c402a270 comp rx=0 tx=0).stop 2024-09-19T08:42:37.938 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.280+0000 7f69d8abd640 1 -- 172.21.15.19:0/4141609515 shutdown_connections 2024-09-19T08:42:37.938 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.280+0000 7f69d8abd640 1 --2- 172.21.15.19:0/4141609515 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69d407dee0 0x7f69d407c340 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:37.938 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.280+0000 7f69d8abd640 1 -- 172.21.15.19:0/4141609515 >> 172.21.15.19:0/4141609515 conn(0x7f69d4102ed0 msgr2=0x7f69d41052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:37.938 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.280+0000 7f69d8abd640 1 -- 172.21.15.19:0/4141609515 shutdown_connections 2024-09-19T08:42:37.938 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.280+0000 7f69d8abd640 1 -- 172.21.15.19:0/4141609515 wait complete. 2024-09-19T08:42:37.938 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.281+0000 7f69d8abd640 1 Processor -- start 2024-09-19T08:42:37.938 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.281+0000 7f69d8abd640 1 -- start start 2024-09-19T08:42:37.938 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.281+0000 7f69d8abd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69d407dee0 0x7f69d419d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:37.938 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.281+0000 7f69d8abd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f69d410dd10 con 0x7f69d407dee0 2024-09-19T08:42:37.938 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.281+0000 7f69d259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69d407dee0 0x7f69d419d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:37.938 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.281+0000 7f69d259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69d407dee0 0x7f69d419d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53412/0 (socket says 172.21.15.19:53412) 2024-09-19T08:42:37.939 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.281+0000 7f69d259c640 1 -- 172.21.15.19:0/3695334744 learned_addr learned my addr 172.21.15.19:0/3695334744 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:42:37.939 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.281+0000 7f69d259c640 1 -- 172.21.15.19:0/3695334744 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69d419de40 con 0x7f69d407dee0 2024-09-19T08:42:37.939 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.282+0000 7f69d259c640 1 --2- 172.21.15.19:0/3695334744 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69d407dee0 0x7f69d419d900 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f69c4009940 tx=0x7f69c40326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:37.939 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.282+0000 7f69c37fe640 1 -- 172.21.15.19:0/3695334744 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69c4042070 con 0x7f69d407dee0 2024-09-19T08:42:37.939 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.282+0000 7f69c37fe640 1 -- 172.21.15.19:0/3695334744 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f69c4032be0 con 0x7f69d407dee0 2024-09-19T08:42:37.939 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.282+0000 7f69d8abd640 1 -- 172.21.15.19:0/3695334744 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69d419e0d0 con 0x7f69d407dee0 2024-09-19T08:42:37.939 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.282+0000 7f69c37fe640 1 -- 172.21.15.19:0/3695334744 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69c4037040 con 0x7f69d407dee0 2024-09-19T08:42:37.939 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.282+0000 7f69d8abd640 1 -- 172.21.15.19:0/3695334744 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69d41a0dc0 con 0x7f69d407dee0 2024-09-19T08:42:37.939 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.282+0000 7f69c37fe640 1 -- 172.21.15.19:0/3695334744 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f69c4045070 con 0x7f69d407dee0 2024-09-19T08:42:37.939 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.282+0000 7f69c37fe640 1 -- 172.21.15.19:0/3695334744 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f69c40479f0 con 0x7f69d407dee0 2024-09-19T08:42:37.939 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.283+0000 7f69d8abd640 1 -- 172.21.15.19:0/3695334744 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69d407c3c0 con 0x7f69d407dee0 2024-09-19T08:42:37.939 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.285+0000 7f69c37fe640 1 -- 172.21.15.19:0/3695334744 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f69c4032d90 con 0x7f69d407dee0 2024-09-19T08:42:37.939 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.345+0000 7f69d8abd640 1 -- 172.21.15.19:0/3695334744 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f69d41a0f90 con 0x7f69d407dee0 2024-09-19T08:42:37.940 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.346+0000 7f69c37fe640 1 -- 172.21.15.19:0/3695334744 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f69c403d430 con 0x7f69d407dee0 2024-09-19T08:42:37.940 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.347+0000 7f69d8abd640 1 -- 172.21.15.19:0/3695334744 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69d407dee0 msgr2=0x7f69d419d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:37.940 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.347+0000 7f69d8abd640 1 --2- 172.21.15.19:0/3695334744 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69d407dee0 0x7f69d419d900 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f69c4009940 tx=0x7f69c40326e0 comp rx=0 tx=0).stop 2024-09-19T08:42:37.940 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.347+0000 7f69d8abd640 1 -- 172.21.15.19:0/3695334744 shutdown_connections 2024-09-19T08:42:37.940 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.347+0000 7f69d8abd640 1 --2- 172.21.15.19:0/3695334744 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f69d407dee0 0x7f69d419d900 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:37.940 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.347+0000 7f69d8abd640 1 -- 172.21.15.19:0/3695334744 >> 172.21.15.19:0/3695334744 conn(0x7f69d4102ed0 msgr2=0x7f69d4103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:37.940 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.347+0000 7f69d8abd640 1 -- 172.21.15.19:0/3695334744 shutdown_connections 2024-09-19T08:42:37.940 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:37.347+0000 7f69d8abd640 1 -- 172.21.15.19:0/3695334744 wait complete. 2024-09-19T08:42:37.940 INFO:teuthology.orchestra.run.smithi019.stdout:Restarting the monitor... 2024-09-19T08:42:38.225 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:37 smithi019 systemd[1]: Stopping Ceph mon.a for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T08:42:38.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:38 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mon-a[30606]: 2024-09-19T08:42:38.224+0000 7ff09aff2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T08:42:38.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:38 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mon-a[30606]: 2024-09-19T08:42:38.224+0000 7ff09aff2640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-19T08:42:38.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:38 smithi019 podman[30853]: 2024-09-19 08:42:38.317581302 +0000 UTC m=+0.198091311 container died 8e6f37371aff2d363603044ef8f253aee5c8e54b8e7f790beea63c4766034fe8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mon-a, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:42:38.834 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:38 smithi019 podman[30853]: 2024-09-19 08:42:38.649884673 +0000 UTC m=+0.530394675 container cleanup 8e6f37371aff2d363603044ef8f253aee5c8e54b8e7f790beea63c4766034fe8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:42:38.834 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:38 smithi019 bash[30853]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mon-a 2024-09-19T08:42:39.098 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:38 smithi019 podman[30866]: 2024-09-19 08:42:38.834645816 +0000 UTC m=+0.505957103 container remove 8e6f37371aff2d363603044ef8f253aee5c8e54b8e7f790beea63c4766034fe8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4) 2024-09-19T08:42:39.099 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 systemd[1]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-19T08:42:39.099 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 systemd[1]: Stopped Ceph mon.a for f26c9d84-7662-11ef-bceb-c7b262605968. 2024-09-19T08:42:39.099 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 systemd[1]: Starting Ceph mon.a for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T08:42:39.377 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 podman[30957]: 2024-09-19 08:42:39.277278064 +0000 UTC m=+0.108726921 container create 2c489516c9ba6b602856940abbb705674af09db6dbc36bcdeb12831ca6749885 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mon-a, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T08:42:39.377 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 podman[30957]: 2024-09-19 08:42:39.192276201 +0000 UTC m=+0.023725010 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:42:39.558 INFO:teuthology.orchestra.run.smithi019.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-19T08:42:39.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 podman[30957]: 2024-09-19 08:42:39.479645301 +0000 UTC m=+0.311094112 container init 2c489516c9ba6b602856940abbb705674af09db6dbc36bcdeb12831ca6749885 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-19T08:42:39.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 podman[30957]: 2024-09-19 08:42:39.482946199 +0000 UTC m=+0.314395009 container start 2c489516c9ba6b602856940abbb705674af09db6dbc36bcdeb12831ca6749885 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mon-a, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T08:42:39.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T08:42:39.772 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T08:42:39.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: pidfile_write: ignore empty --pid-file 2024-09-19T08:42:39.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: load: jerasure load: lrc 2024-09-19T08:42:39.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: RocksDB version: 7.9.2 2024-09-19T08:42:39.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Git sha 0 2024-09-19T08:42:39.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T08:42:39.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: DB SUMMARY 2024-09-19T08:42:39.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: DB Session ID: UR1X10XC1SN1W1GU10WW 2024-09-19T08:42:39.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: CURRENT file: CURRENT 2024-09-19T08:42:39.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T08:42:39.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-19T08:42:39.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-19T08:42:39.774 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105974 ; 2024-09-19T08:42:39.774 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.error_if_exists: 0 2024-09-19T08:42:39.774 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.create_if_missing: 0 2024-09-19T08:42:39.774 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.paranoid_checks: 1 2024-09-19T08:42:39.774 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T08:42:39.774 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T08:42:39.774 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T08:42:39.774 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.env: 0x56175f271940 2024-09-19T08:42:39.774 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T08:42:39.774 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.info_log: 0x56176038d6e0 2024-09-19T08:42:39.774 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T08:42:39.774 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.statistics: (nil) 2024-09-19T08:42:39.774 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.use_fsync: 0 2024-09-19T08:42:39.775 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.max_log_file_size: 0 2024-09-19T08:42:39.775 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T08:42:39.775 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T08:42:39.775 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T08:42:39.775 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T08:42:39.775 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.allow_fallocate: 1 2024-09-19T08:42:39.775 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T08:42:39.775 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T08:42:39.775 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.use_direct_reads: 0 2024-09-19T08:42:39.775 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T08:42:39.775 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T08:42:39.776 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.db_log_dir: 2024-09-19T08:42:39.776 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.wal_dir: 2024-09-19T08:42:39.776 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T08:42:39.776 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T08:42:39.776 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T08:42:39.776 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T08:42:39.776 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T08:42:39.776 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T08:42:39.776 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T08:42:39.777 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T08:42:39.777 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.write_buffer_manager: 0x56176039cdc0 2024-09-19T08:42:39.777 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T08:42:39.777 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T08:42:39.777 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T08:42:39.777 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T08:42:39.777 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T08:42:39.777 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T08:42:39.777 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T08:42:39.777 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T08:42:39.777 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.unordered_write: 0 2024-09-19T08:42:39.777 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T08:42:39.777 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T08:42:39.777 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T08:42:39.778 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T08:42:39.778 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.row_cache: None 2024-09-19T08:42:39.778 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.wal_filter: None 2024-09-19T08:42:39.778 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T08:42:39.779 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T08:42:39.779 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.two_write_queues: 0 2024-09-19T08:42:39.779 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T08:42:39.779 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.wal_compression: 0 2024-09-19T08:42:39.779 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.atomic_flush: 0 2024-09-19T08:42:39.779 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T08:42:39.779 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T08:42:39.780 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T08:42:39.780 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.log_readahead_size: 0 2024-09-19T08:42:39.780 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T08:42:39.780 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T08:42:39.780 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T08:42:39.780 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T08:42:39.780 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T08:42:39.780 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T08:42:39.780 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T08:42:39.780 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.max_background_jobs: 2 2024-09-19T08:42:39.780 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.max_background_compactions: -1 2024-09-19T08:42:39.780 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.max_subcompactions: 1 2024-09-19T08:42:39.780 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T08:42:39.780 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T08:42:39.781 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T08:42:39.781 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T08:42:39.781 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T08:42:39.781 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T08:42:39.781 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T08:42:39.781 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T08:42:39.781 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.max_open_files: -1 2024-09-19T08:42:39.781 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T08:42:39.781 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T08:42:39.781 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T08:42:39.781 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T08:42:39.781 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.max_background_flushes: -1 2024-09-19T08:42:39.781 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Compression algorithms supported: 2024-09-19T08:42:39.782 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: kZSTD supported: 0 2024-09-19T08:42:39.782 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: kXpressCompression supported: 0 2024-09-19T08:42:39.782 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: kBZip2Compression supported: 0 2024-09-19T08:42:39.782 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T08:42:39.782 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: kLZ4Compression supported: 1 2024-09-19T08:42:39.782 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: kZlibCompression supported: 1 2024-09-19T08:42:39.782 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T08:42:39.783 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: kSnappyCompression supported: 1 2024-09-19T08:42:39.783 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T08:42:39.783 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T08:42:39.783 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-19T08:42:39.783 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T08:42:39.783 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T08:42:39.783 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.merge_operator: 2024-09-19T08:42:39.783 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.compaction_filter: None 2024-09-19T08:42:39.783 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T08:42:39.783 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T08:42:39.783 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T08:42:39.783 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T08:42:39.783 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56176038d320) 2024-09-19T08:42:39.783 INFO:journalctl@ceph.mon.a.smithi019.stdout: cache_index_and_filter_blocks: 1 2024-09-19T08:42:39.783 INFO:journalctl@ceph.mon.a.smithi019.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T08:42:39.784 INFO:journalctl@ceph.mon.a.smithi019.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T08:42:39.784 INFO:journalctl@ceph.mon.a.smithi019.stdout: pin_top_level_index_and_filter: 1 2024-09-19T08:42:39.784 INFO:journalctl@ceph.mon.a.smithi019.stdout: index_type: 0 2024-09-19T08:42:39.784 INFO:journalctl@ceph.mon.a.smithi019.stdout: data_block_index_type: 0 2024-09-19T08:42:39.784 INFO:journalctl@ceph.mon.a.smithi019.stdout: index_shortening: 1 2024-09-19T08:42:39.784 INFO:journalctl@ceph.mon.a.smithi019.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T08:42:39.784 INFO:journalctl@ceph.mon.a.smithi019.stdout: checksum: 4 2024-09-19T08:42:39.784 INFO:journalctl@ceph.mon.a.smithi019.stdout: no_block_cache: 0 2024-09-19T08:42:39.784 INFO:journalctl@ceph.mon.a.smithi019.stdout: block_cache: 0x5617603811f0 2024-09-19T08:42:39.784 INFO:journalctl@ceph.mon.a.smithi019.stdout: block_cache_name: BinnedLRUCache 2024-09-19T08:42:39.784 INFO:journalctl@ceph.mon.a.smithi019.stdout: block_cache_options: 2024-09-19T08:42:39.784 INFO:journalctl@ceph.mon.a.smithi019.stdout: capacity : 536870912 2024-09-19T08:42:39.784 INFO:journalctl@ceph.mon.a.smithi019.stdout: num_shard_bits : 4 2024-09-19T08:42:39.784 INFO:journalctl@ceph.mon.a.smithi019.stdout: strict_capacity_limit : 0 2024-09-19T08:42:39.785 INFO:journalctl@ceph.mon.a.smithi019.stdout: high_pri_pool_ratio: 0.000 2024-09-19T08:42:39.785 INFO:journalctl@ceph.mon.a.smithi019.stdout: block_cache_compressed: (nil) 2024-09-19T08:42:39.785 INFO:journalctl@ceph.mon.a.smithi019.stdout: persistent_cache: (nil) 2024-09-19T08:42:39.785 INFO:journalctl@ceph.mon.a.smithi019.stdout: block_size: 4096 2024-09-19T08:42:39.785 INFO:journalctl@ceph.mon.a.smithi019.stdout: block_size_deviation: 10 2024-09-19T08:42:39.785 INFO:journalctl@ceph.mon.a.smithi019.stdout: block_restart_interval: 16 2024-09-19T08:42:39.785 INFO:journalctl@ceph.mon.a.smithi019.stdout: index_block_restart_interval: 1 2024-09-19T08:42:39.785 INFO:journalctl@ceph.mon.a.smithi019.stdout: metadata_block_size: 4096 2024-09-19T08:42:39.785 INFO:journalctl@ceph.mon.a.smithi019.stdout: partition_filters: 0 2024-09-19T08:42:39.785 INFO:journalctl@ceph.mon.a.smithi019.stdout: use_delta_encoding: 1 2024-09-19T08:42:39.785 INFO:journalctl@ceph.mon.a.smithi019.stdout: filter_policy: bloomfilter 2024-09-19T08:42:39.785 INFO:journalctl@ceph.mon.a.smithi019.stdout: whole_key_filtering: 1 2024-09-19T08:42:39.785 INFO:journalctl@ceph.mon.a.smithi019.stdout: verify_compression: 0 2024-09-19T08:42:39.785 INFO:journalctl@ceph.mon.a.smithi019.stdout: read_amp_bytes_per_bit: 0 2024-09-19T08:42:39.785 INFO:journalctl@ceph.mon.a.smithi019.stdout: format_version: 5 2024-09-19T08:42:39.786 INFO:journalctl@ceph.mon.a.smithi019.stdout: enable_index_compression: 1 2024-09-19T08:42:39.786 INFO:journalctl@ceph.mon.a.smithi019.stdout: block_align: 0 2024-09-19T08:42:39.786 INFO:journalctl@ceph.mon.a.smithi019.stdout: max_auto_readahead_size: 262144 2024-09-19T08:42:39.786 INFO:journalctl@ceph.mon.a.smithi019.stdout: prepopulate_block_cache: 0 2024-09-19T08:42:39.786 INFO:journalctl@ceph.mon.a.smithi019.stdout: initial_auto_readahead_size: 8192 2024-09-19T08:42:39.786 INFO:journalctl@ceph.mon.a.smithi019.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T08:42:39.786 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T08:42:39.786 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T08:42:39.786 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.compression: NoCompression 2024-09-19T08:42:39.786 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T08:42:39.786 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T08:42:39.786 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T08:42:39.786 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.num_levels: 7 2024-09-19T08:42:39.786 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T08:42:39.787 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T08:42:39.787 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T08:42:39.787 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T08:42:39.787 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T08:42:39.787 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T08:42:39.787 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T08:42:39.787 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T08:42:39.787 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T08:42:39.787 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T08:42:39.787 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T08:42:39.787 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T08:42:39.787 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T08:42:39.787 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T08:42:39.787 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T08:42:39.787 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T08:42:39.788 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T08:42:39.788 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T08:42:39.788 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T08:42:39.788 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T08:42:39.788 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T08:42:39.788 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T08:42:39.788 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T08:42:39.788 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T08:42:39.788 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T08:42:39.788 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T08:42:39.788 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T08:42:39.789 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T08:42:39.789 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T08:42:39.789 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T08:42:39.789 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T08:42:39.789 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T08:42:39.789 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T08:42:39.789 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T08:42:39.789 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T08:42:39.789 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T08:42:39.789 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T08:42:39.790 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T08:42:39.790 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T08:42:39.790 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T08:42:39.790 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T08:42:39.790 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T08:42:39.790 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T08:42:39.790 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T08:42:39.790 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T08:42:39.790 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T08:42:39.790 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T08:42:39.790 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T08:42:39.790 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T08:42:39.790 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T08:42:39.790 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T08:42:39.790 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T08:42:39.791 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T08:42:39.791 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T08:42:39.791 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.inplace_update_support: 0 2024-09-19T08:42:39.791 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T08:42:39.791 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T08:42:39.791 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T08:42:39.791 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T08:42:39.791 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.bloom_locality: 0 2024-09-19T08:42:39.792 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.max_successive_merges: 0 2024-09-19T08:42:39.792 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T08:42:39.792 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T08:42:39.792 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T08:42:39.792 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T08:42:39.792 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.ttl: 2592000 2024-09-19T08:42:39.792 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T08:42:39.792 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T08:42:39.792 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T08:42:39.792 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.enable_blob_files: false 2024-09-19T08:42:39.792 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.min_blob_size: 0 2024-09-19T08:42:39.793 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T08:42:39.793 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T08:42:39.793 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T08:42:39.793 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T08:42:39.793 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T08:42:39.793 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T08:42:39.793 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T08:42:39.793 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T08:42:39.793 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-19T08:42:39.793 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-19T08:42:39.793 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 727ec4a2-730a-4ea4-a711-36aa5f0d49b3 2024-09-19T08:42:39.794 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726735359510252, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-19T08:42:39.794 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-19T08:42:39.794 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726735359511360, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100989, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 330, "table_properties": {"data_size": 98874, "index_size": 307, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14453, "raw_average_key_size": 50, "raw_value_size": 91046, "raw_average_value_size": 315, "num_data_blocks": 12, "num_entries": 289, "num_filter_entries": 289, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726735359, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "727ec4a2-730a-4ea4-a711-36aa5f0d49b3", "db_session_id": "UR1X10XC1SN1W1GU10WW", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-19T08:42:39.794 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726735359511466, "job": 1, "event": "recovery_finished"} 2024-09-19T08:42:39.794 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-19T08:42:39.794 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T08:42:39.794 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5617603aee00 2024-09-19T08:42:39.794 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: DB pointer 0x5617604aa000 2024-09-19T08:42:39.794 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T08:42:39.795 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T08:42:39.795 INFO:journalctl@ceph.mon.a.smithi019.stdout: ** DB Stats ** 2024-09-19T08:42:39.795 INFO:journalctl@ceph.mon.a.smithi019.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T08:42:39.795 INFO:journalctl@ceph.mon.a.smithi019.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T08:42:39.795 INFO:journalctl@ceph.mon.a.smithi019.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T08:42:39.795 INFO:journalctl@ceph.mon.a.smithi019.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T08:42:39.795 INFO:journalctl@ceph.mon.a.smithi019.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T08:42:39.795 INFO:journalctl@ceph.mon.a.smithi019.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T08:42:39.795 INFO:journalctl@ceph.mon.a.smithi019.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T08:42:39.795 INFO:journalctl@ceph.mon.a.smithi019.stdout: 2024-09-19T08:42:39.795 INFO:journalctl@ceph.mon.a.smithi019.stdout: ** Compaction Stats [default] ** 2024-09-19T08:42:39.795 INFO:journalctl@ceph.mon.a.smithi019.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T08:42:39.795 INFO:journalctl@ceph.mon.a.smithi019.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T08:42:39.795 INFO:journalctl@ceph.mon.a.smithi019.stdout: L0 2/0 100.48 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 139.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:42:39.796 INFO:journalctl@ceph.mon.a.smithi019.stdout: Sum 2/0 100.48 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 139.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:42:39.796 INFO:journalctl@ceph.mon.a.smithi019.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 139.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:42:39.796 INFO:journalctl@ceph.mon.a.smithi019.stdout: 2024-09-19T08:42:39.796 INFO:journalctl@ceph.mon.a.smithi019.stdout: ** Compaction Stats [default] ** 2024-09-19T08:42:39.796 INFO:journalctl@ceph.mon.a.smithi019.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T08:42:39.796 INFO:journalctl@ceph.mon.a.smithi019.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T08:42:39.796 INFO:journalctl@ceph.mon.a.smithi019.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 139.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T08:42:39.796 INFO:journalctl@ceph.mon.a.smithi019.stdout: 2024-09-19T08:42:39.796 INFO:journalctl@ceph.mon.a.smithi019.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T08:42:39.796 INFO:journalctl@ceph.mon.a.smithi019.stdout: 2024-09-19T08:42:39.796 INFO:journalctl@ceph.mon.a.smithi019.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T08:42:39.796 INFO:journalctl@ceph.mon.a.smithi019.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T08:42:39.796 INFO:journalctl@ceph.mon.a.smithi019.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T08:42:39.797 INFO:journalctl@ceph.mon.a.smithi019.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T08:42:39.797 INFO:journalctl@ceph.mon.a.smithi019.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T08:42:39.797 INFO:journalctl@ceph.mon.a.smithi019.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T08:42:39.797 INFO:journalctl@ceph.mon.a.smithi019.stdout: Cumulative compaction: 0.00 GB write, 29.19 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T08:42:39.797 INFO:journalctl@ceph.mon.a.smithi019.stdout: Interval compaction: 0.00 GB write, 29.19 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T08:42:39.797 INFO:journalctl@ceph.mon.a.smithi019.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T08:42:39.797 INFO:journalctl@ceph.mon.a.smithi019.stdout: Block cache BinnedLRUCache@0x5617603811f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-19T08:42:39.797 INFO:journalctl@ceph.mon.a.smithi019.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-19T08:42:39.797 INFO:journalctl@ceph.mon.a.smithi019.stdout: 2024-09-19T08:42:39.797 INFO:journalctl@ceph.mon.a.smithi019.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T08:42:39.798 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: starting mon.a rank 0 at public addrs [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] at bind addrs [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid f26c9d84-7662-11ef-bceb-c7b262605968 2024-09-19T08:42:39.798 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: mon.a@-1(???) e1 preinit fsid f26c9d84-7662-11ef-bceb-c7b262605968 2024-09-19T08:42:39.798 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: mon.a@-1(???).mds e1 new map 2024-09-19T08:42:39.798 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: mon.a@-1(???).mds e1 print_map 2024-09-19T08:42:39.798 INFO:journalctl@ceph.mon.a.smithi019.stdout: e1 2024-09-19T08:42:39.798 INFO:journalctl@ceph.mon.a.smithi019.stdout: btime 2024-09-19T08:42:32:323860+0000 2024-09-19T08:42:39.798 INFO:journalctl@ceph.mon.a.smithi019.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T08:42:39.798 INFO:journalctl@ceph.mon.a.smithi019.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T08:42:39.798 INFO:journalctl@ceph.mon.a.smithi019.stdout: legacy client fscid: -1 2024-09-19T08:42:39.798 INFO:journalctl@ceph.mon.a.smithi019.stdout: 2024-09-19T08:42:39.798 INFO:journalctl@ceph.mon.a.smithi019.stdout: No filesystems configured 2024-09-19T08:42:39.798 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T08:42:39.798 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:42:39.798 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:42:39.798 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:42:39.799 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-19T08:42:39.799 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 bash[30957]: 2c489516c9ba6b602856940abbb705674af09db6dbc36bcdeb12831ca6749885 2024-09-19T08:42:39.799 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 systemd[1]: Started Ceph mon.a for f26c9d84-7662-11ef-bceb-c7b262605968. 2024-09-19T08:42:39.799 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T08:42:39.799 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: monmap epoch 1 2024-09-19T08:42:39.799 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: fsid f26c9d84-7662-11ef-bceb-c7b262605968 2024-09-19T08:42:39.799 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: last_changed 2024-09-19T08:42:29.207639+0000 2024-09-19T08:42:39.799 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: created 2024-09-19T08:42:29.207639+0000 2024-09-19T08:42:39.799 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: min_mon_release 19 (squid) 2024-09-19T08:42:39.799 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: election_strategy: 1 2024-09-19T08:42:39.799 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: 0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-19T08:42:39.799 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: fsmap 2024-09-19T08:42:39.799 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T08:42:39.799 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:39 smithi019 ceph-mon[30976]: mgrmap e1: no daemons active 2024-09-19T08:42:40.597 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:39.965+0000 7f602fc5f640 1 Processor -- start 2024-09-19T08:42:40.601 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:39.965+0000 7f602fc5f640 1 -- start start 2024-09-19T08:42:40.601 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:39.965+0000 7f602fc5f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60281076e0 0x7f6028107ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:40.601 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:39.965+0000 7f602fc5f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f60281080b0 con 0x7f60281076e0 2024-09-19T08:42:40.601 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:39.966+0000 7f602d9fb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60281076e0 0x7f6028107ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:40.601 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:39.966+0000 7f602d9fb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60281076e0 0x7f6028107ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53418/0 (socket says 172.21.15.19:53418) 2024-09-19T08:42:40.601 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:39.966+0000 7f602d9fb640 1 -- 172.21.15.19:0/2049913268 learned_addr learned my addr 172.21.15.19:0/2049913268 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:42:40.601 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:39.966+0000 7f602d9fb640 1 -- 172.21.15.19:0/2049913268 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6028108890 con 0x7f60281076e0 2024-09-19T08:42:40.601 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:39.968+0000 7f602d9fb640 1 --2- 172.21.15.19:0/2049913268 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60281076e0 0x7f6028107ae0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6024009820 tx=0x7f602402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1246b593775b4b89 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:40.602 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:39.968+0000 7f602c9f9640 1 -- 172.21.15.19:0/2049913268 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6024037070 con 0x7f60281076e0 2024-09-19T08:42:40.602 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:39.968+0000 7f602c9f9640 1 -- 172.21.15.19:0/2049913268 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6024032900 con 0x7f60281076e0 2024-09-19T08:42:40.602 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:39.968+0000 7f602c9f9640 1 -- 172.21.15.19:0/2049913268 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6024030850 con 0x7f60281076e0 2024-09-19T08:42:40.602 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:39.969+0000 7f602fc5f640 1 -- 172.21.15.19:0/2049913268 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60281076e0 msgr2=0x7f6028107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:40.602 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:39.969+0000 7f602fc5f640 1 --2- 172.21.15.19:0/2049913268 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60281076e0 0x7f6028107ae0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6024009820 tx=0x7f602402a270 comp rx=0 tx=0).stop 2024-09-19T08:42:40.602 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:39.969+0000 7f602fc5f640 1 -- 172.21.15.19:0/2049913268 shutdown_connections 2024-09-19T08:42:40.602 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:39.969+0000 7f602fc5f640 1 --2- 172.21.15.19:0/2049913268 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60281076e0 0x7f6028107ae0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:40.602 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:39.969+0000 7f602fc5f640 1 -- 172.21.15.19:0/2049913268 >> 172.21.15.19:0/2049913268 conn(0x7f6028102e90 msgr2=0x7f60281052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:40.602 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:39.969+0000 7f602fc5f640 1 -- 172.21.15.19:0/2049913268 shutdown_connections 2024-09-19T08:42:40.602 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:39.969+0000 7f602fc5f640 1 -- 172.21.15.19:0/2049913268 wait complete. 2024-09-19T08:42:40.602 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:39.969+0000 7f602fc5f640 1 Processor -- start 2024-09-19T08:42:40.602 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:39.970+0000 7f602fc5f640 1 -- start start 2024-09-19T08:42:40.602 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:39.970+0000 7f602fc5f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60281076e0 0x7f602819b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:40.602 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:39.970+0000 7f602fc5f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f602810bc40 con 0x7f60281076e0 2024-09-19T08:42:40.603 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:39.970+0000 7f602d9fb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60281076e0 0x7f602819b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:40.603 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:39.970+0000 7f602d9fb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60281076e0 0x7f602819b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53430/0 (socket says 172.21.15.19:53430) 2024-09-19T08:42:40.603 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:39.970+0000 7f602d9fb640 1 -- 172.21.15.19:0/575891438 learned_addr learned my addr 172.21.15.19:0/575891438 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:42:40.603 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:39.970+0000 7f602d9fb640 1 -- 172.21.15.19:0/575891438 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f602819bc60 con 0x7f60281076e0 2024-09-19T08:42:40.603 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:39.970+0000 7f602d9fb640 1 --2- 172.21.15.19:0/575891438 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60281076e0 0x7f602819b720 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6024009940 tx=0x7f60240326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:40.603 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:39.970+0000 7f601effd640 1 -- 172.21.15.19:0/575891438 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6024042070 con 0x7f60281076e0 2024-09-19T08:42:40.603 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:39.970+0000 7f601effd640 1 -- 172.21.15.19:0/575891438 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6024032be0 con 0x7f60281076e0 2024-09-19T08:42:40.603 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:39.970+0000 7f602fc5f640 1 -- 172.21.15.19:0/575891438 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f602819bef0 con 0x7f60281076e0 2024-09-19T08:42:40.603 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:39.970+0000 7f601effd640 1 -- 172.21.15.19:0/575891438 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6024037040 con 0x7f60281076e0 2024-09-19T08:42:40.603 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:39.970+0000 7f602fc5f640 1 -- 172.21.15.19:0/575891438 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f602819ebe0 con 0x7f60281076e0 2024-09-19T08:42:40.603 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:39.971+0000 7f601effd640 1 -- 172.21.15.19:0/575891438 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6024045070 con 0x7f60281076e0 2024-09-19T08:42:40.603 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:39.971+0000 7f601effd640 1 -- 172.21.15.19:0/575891438 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f60240479f0 con 0x7f60281076e0 2024-09-19T08:42:40.603 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:39.971+0000 7f602fc5f640 1 -- 172.21.15.19:0/575891438 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f602810bdc0 con 0x7f60281076e0 2024-09-19T08:42:40.603 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:39.974+0000 7f601effd640 1 -- 172.21.15.19:0/575891438 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f6024032d90 con 0x7f60281076e0 2024-09-19T08:42:40.604 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:40.034+0000 7f602fc5f640 1 -- 172.21.15.19:0/575891438 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f6028107b60 con 0x7f60281076e0 2024-09-19T08:42:40.604 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:40.038+0000 7f601effd640 1 -- 172.21.15.19:0/575891438 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f602403d430 con 0x7f60281076e0 2024-09-19T08:42:40.604 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:40.039+0000 7f602fc5f640 1 -- 172.21.15.19:0/575891438 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60281076e0 msgr2=0x7f602819b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:40.604 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:40.039+0000 7f602fc5f640 1 --2- 172.21.15.19:0/575891438 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60281076e0 0x7f602819b720 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6024009940 tx=0x7f60240326e0 comp rx=0 tx=0).stop 2024-09-19T08:42:40.604 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:40.039+0000 7f602fc5f640 1 -- 172.21.15.19:0/575891438 shutdown_connections 2024-09-19T08:42:40.604 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:40.039+0000 7f602fc5f640 1 --2- 172.21.15.19:0/575891438 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60281076e0 0x7f602819b720 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:40.604 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:40.039+0000 7f602fc5f640 1 -- 172.21.15.19:0/575891438 >> 172.21.15.19:0/575891438 conn(0x7f6028102e90 msgr2=0x7f6028103b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:40.604 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:40.039+0000 7f602fc5f640 1 -- 172.21.15.19:0/575891438 shutdown_connections 2024-09-19T08:42:40.604 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:40.039+0000 7f602fc5f640 1 -- 172.21.15.19:0/575891438 wait complete. 2024-09-19T08:42:40.604 INFO:teuthology.orchestra.run.smithi019.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-19T08:42:40.626 INFO:teuthology.orchestra.run.smithi019.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:42:40.627 INFO:teuthology.orchestra.run.smithi019.stdout:Creating mgr... 2024-09-19T08:42:40.627 INFO:teuthology.orchestra.run.smithi019.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-19T08:42:40.627 INFO:teuthology.orchestra.run.smithi019.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-19T08:42:40.891 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mgr.x 2024-09-19T08:42:40.891 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-19T08:42:41.049 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f26c9d84-7662-11ef-bceb-c7b262605968.target.wants/ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-f26c9d84-7662-11ef-bceb-c7b262605968@.service. 2024-09-19T08:42:41.271 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:41 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/575891438' entity='client.admin' 2024-09-19T08:42:41.271 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:41 smithi019 systemd[1]: Starting Ceph mgr.x for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T08:42:41.540 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:41 smithi019 podman[31186]: 2024-09-19 08:42:41.27197423 +0000 UTC m=+0.105410895 container create b2a9fb49f940394e6d77befbfac18a641bfdbdcb3f484a233c5fd23958dc324d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:42:41.540 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:41 smithi019 podman[31186]: 2024-09-19 08:42:41.182896851 +0000 UTC m=+0.016333520 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T08:42:41.541 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:41 smithi019 podman[31186]: 2024-09-19 08:42:41.46593795 +0000 UTC m=+0.299374619 container init b2a9fb49f940394e6d77befbfac18a641bfdbdcb3f484a233c5fd23958dc324d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True) 2024-09-19T08:42:41.541 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:41 smithi019 podman[31186]: 2024-09-19 08:42:41.468875661 +0000 UTC m=+0.302312327 container start b2a9fb49f940394e6d77befbfac18a641bfdbdcb3f484a233c5fd23958dc324d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-19T08:42:41.541 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:41 smithi019 bash[31186]: b2a9fb49f940394e6d77befbfac18a641bfdbdcb3f484a233c5fd23958dc324d 2024-09-19T08:42:41.555 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T08:42:41.555 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout disabled 2024-09-19T08:42:41.562 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T08:42:41.562 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout inactive 2024-09-19T08:42:41.562 INFO:teuthology.orchestra.run.smithi019.stdout:firewalld.service is not enabled 2024-09-19T08:42:41.563 INFO:teuthology.orchestra.run.smithi019.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T08:42:41.572 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T08:42:41.572 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout disabled 2024-09-19T08:42:41.579 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T08:42:41.579 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout inactive 2024-09-19T08:42:41.579 INFO:teuthology.orchestra.run.smithi019.stdout:firewalld.service is not enabled 2024-09-19T08:42:41.580 INFO:teuthology.orchestra.run.smithi019.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-19T08:42:41.580 INFO:teuthology.orchestra.run.smithi019.stdout:Waiting for mgr to start... 2024-09-19T08:42:41.580 INFO:teuthology.orchestra.run.smithi019.stdout:Waiting for mgr... 2024-09-19T08:42:41.814 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:41 smithi019 systemd[1]: Started Ceph mgr.x for f26c9d84-7662-11ef-bceb-c7b262605968. 2024-09-19T08:42:41.814 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:41 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:41.594+0000 7f7622b87040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T08:42:41.814 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:41 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:41.655+0000 7f7622b87040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:42:41.814 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:41 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:41.813+0000 7f7622b87040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:42:42.068 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:41 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:41.885+0000 7f7622b87040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:42:42.068 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:42 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:42.045+0000 7f7622b87040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:42:42.531 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:42 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1907303086' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T08:42:42.531 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:42 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:42.197+0000 7f7622b87040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:42:42.531 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:42 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:42.530+0000 7f7622b87040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:42:42.793 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:42 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:42.597+0000 7f7622b87040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:42:42.793 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:42 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:42.792+0000 7f7622b87040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:42:43.020 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-09-19T08:42:43.021 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:42:43.021 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "fsid": "f26c9d84-7662-11ef-bceb-c7b262605968", 2024-09-19T08:42:43.021 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T08:42:43.021 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T08:42:43.021 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T08:42:43.021 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T08:42:43.021 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:42:43.021 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T08:42:43.021 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T08:42:43.021 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 0 2024-09-19T08:42:43.021 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:42:43.021 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T08:42:43.022 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T08:42:43.022 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:42:43.022 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-19T08:42:43.022 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T08:42:43.022 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:42:43.022 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T08:42:43.022 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T08:42:43.022 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:42:43.022 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T08:42:43.022 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:42:43.022 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T08:42:43.022 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T08:42:43.022 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T08:42:43.023 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T08:42:43.023 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T08:42:43.023 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T08:42:43.023 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:42:43.023 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T08:42:43.023 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T08:42:43.023 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T08:42:43.023 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T08:42:43.023 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T08:42:43.023 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T08:42:43.023 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T08:42:43.023 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T08:42:43.023 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T08:42:43.023 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:42:43.024 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T08:42:43.024 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:42:43.024 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T08:42:32:323860+0000", 2024-09-19T08:42:43.024 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T08:42:43.024 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T08:42:43.024 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:42:43.024 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T08:42:43.024 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T08:42:43.024 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T08:42:43.024 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T08:42:43.024 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T08:42:43.024 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T08:42:43.025 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T08:42:43.025 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:42:43.025 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:42:43.025 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:42:43.025 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T08:42:43.025 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:42:43.025 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T08:42:32.324572+0000", 2024-09-19T08:42:43.025 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:42:43.025 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:42:43.025 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T08:42:43.025 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:42:43.025 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.007+0000 7f78282cd640 1 Processor -- start 2024-09-19T08:42:43.025 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.007+0000 7f78282cd640 1 -- start start 2024-09-19T08:42:43.026 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.008+0000 7f78282cd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7820108170 0x7f782010a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:43.026 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.008+0000 7f78282cd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f782007be50 con 0x7f7820108170 2024-09-19T08:42:43.026 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.008+0000 7f7826069640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7820108170 0x7f782010a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:43.026 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.008+0000 7f7826069640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7820108170 0x7f782010a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53452/0 (socket says 172.21.15.19:53452) 2024-09-19T08:42:43.026 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.008+0000 7f7826069640 1 -- 172.21.15.19:0/2423780282 learned_addr learned my addr 172.21.15.19:0/2423780282 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:42:43.026 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.008+0000 7f7826069640 1 -- 172.21.15.19:0/2423780282 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f782010aaa0 con 0x7f7820108170 2024-09-19T08:42:43.026 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.009+0000 7f7826069640 1 --2- 172.21.15.19:0/2423780282 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7820108170 0x7f782010a560 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f781c009820 tx=0x7f781c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cbc7d7742b5264 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:43.026 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.009+0000 7f7825067640 1 -- 172.21.15.19:0/2423780282 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f781c037070 con 0x7f7820108170 2024-09-19T08:42:43.026 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.009+0000 7f7825067640 1 -- 172.21.15.19:0/2423780282 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f781c032900 con 0x7f7820108170 2024-09-19T08:42:43.027 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.009+0000 7f7825067640 1 -- 172.21.15.19:0/2423780282 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f781c030850 con 0x7f7820108170 2024-09-19T08:42:43.027 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.010+0000 7f78282cd640 1 -- 172.21.15.19:0/2423780282 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7820108170 msgr2=0x7f782010a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:43.027 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.010+0000 7f78282cd640 1 --2- 172.21.15.19:0/2423780282 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7820108170 0x7f782010a560 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f781c009820 tx=0x7f781c02a270 comp rx=0 tx=0).stop 2024-09-19T08:42:43.027 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.010+0000 7f78282cd640 1 -- 172.21.15.19:0/2423780282 shutdown_connections 2024-09-19T08:42:43.027 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.010+0000 7f78282cd640 1 --2- 172.21.15.19:0/2423780282 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7820108170 0x7f782010a560 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:43.027 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.010+0000 7f78282cd640 1 -- 172.21.15.19:0/2423780282 >> 172.21.15.19:0/2423780282 conn(0x7f7820101d10 msgr2=0x7f7820104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:43.027 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.010+0000 7f78282cd640 1 -- 172.21.15.19:0/2423780282 shutdown_connections 2024-09-19T08:42:43.027 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.010+0000 7f78282cd640 1 -- 172.21.15.19:0/2423780282 wait complete. 2024-09-19T08:42:43.027 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.011+0000 7f78282cd640 1 Processor -- start 2024-09-19T08:42:43.027 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.011+0000 7f78282cd640 1 -- start start 2024-09-19T08:42:43.027 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.011+0000 7f78282cd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7820108170 0x7f782019b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:43.027 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.011+0000 7f78282cd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f782010ba80 con 0x7f7820108170 2024-09-19T08:42:43.027 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.011+0000 7f7826069640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7820108170 0x7f782019b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:43.027 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.011+0000 7f7826069640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7820108170 0x7f782019b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53454/0 (socket says 172.21.15.19:53454) 2024-09-19T08:42:43.028 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.011+0000 7f7826069640 1 -- 172.21.15.19:0/1907303086 learned_addr learned my addr 172.21.15.19:0/1907303086 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:42:43.028 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.011+0000 7f7826069640 1 -- 172.21.15.19:0/1907303086 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f782019bbd0 con 0x7f7820108170 2024-09-19T08:42:43.028 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.012+0000 7f7826069640 1 --2- 172.21.15.19:0/1907303086 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7820108170 0x7f782019b690 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f781c032ce0 tx=0x7f781c032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:43.028 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.012+0000 7f78137fe640 1 -- 172.21.15.19:0/1907303086 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f781c042070 con 0x7f7820108170 2024-09-19T08:42:43.028 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.012+0000 7f78137fe640 1 -- 172.21.15.19:0/1907303086 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f781c0308c0 con 0x7f7820108170 2024-09-19T08:42:43.028 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.012+0000 7f78282cd640 1 -- 172.21.15.19:0/1907303086 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f782019be60 con 0x7f7820108170 2024-09-19T08:42:43.028 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.012+0000 7f78137fe640 1 -- 172.21.15.19:0/1907303086 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f781c037040 con 0x7f7820108170 2024-09-19T08:42:43.028 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.012+0000 7f78282cd640 1 -- 172.21.15.19:0/1907303086 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f782019eb50 con 0x7f7820108170 2024-09-19T08:42:43.028 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.012+0000 7f78137fe640 1 -- 172.21.15.19:0/1907303086 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f781c045070 con 0x7f7820108170 2024-09-19T08:42:43.028 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.012+0000 7f78137fe640 1 -- 172.21.15.19:0/1907303086 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f781c047c10 con 0x7f7820108170 2024-09-19T08:42:43.028 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.013+0000 7f78282cd640 1 -- 172.21.15.19:0/1907303086 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78201085d0 con 0x7f7820108170 2024-09-19T08:42:43.028 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.015+0000 7f78137fe640 1 -- 172.21.15.19:0/1907303086 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f781c03c850 con 0x7f7820108170 2024-09-19T08:42:43.028 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.078+0000 7f78282cd640 1 -- 172.21.15.19:0/1907303086 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f782019f0d0 con 0x7f7820108170 2024-09-19T08:42:43.029 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.078+0000 7f78137fe640 1 -- 172.21.15.19:0/1907303086 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f781c03ca30 con 0x7f7820108170 2024-09-19T08:42:43.029 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.079+0000 7f78282cd640 1 -- 172.21.15.19:0/1907303086 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7820108170 msgr2=0x7f782019b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:43.029 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.079+0000 7f78282cd640 1 --2- 172.21.15.19:0/1907303086 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7820108170 0x7f782019b690 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f781c032ce0 tx=0x7f781c032d10 comp rx=0 tx=0).stop 2024-09-19T08:42:43.029 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.079+0000 7f78282cd640 1 -- 172.21.15.19:0/1907303086 shutdown_connections 2024-09-19T08:42:43.029 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.079+0000 7f78282cd640 1 --2- 172.21.15.19:0/1907303086 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7820108170 0x7f782019b690 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:43.029 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.079+0000 7f78282cd640 1 -- 172.21.15.19:0/1907303086 >> 172.21.15.19:0/1907303086 conn(0x7f7820101d10 msgr2=0x7f78201028c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:43.029 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.079+0000 7f78282cd640 1 -- 172.21.15.19:0/1907303086 shutdown_connections 2024-09-19T08:42:43.029 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:42.080+0000 7f78282cd640 1 -- 172.21.15.19:0/1907303086 wait complete. 2024-09-19T08:42:43.029 INFO:teuthology.orchestra.run.smithi019.stdout:mgr not available, waiting (1/15)... 2024-09-19T08:42:44.068 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:43 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:43.722+0000 7f7622b87040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:42:44.068 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:43 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:43.793+0000 7f7622b87040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:42:44.818 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:44 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:44.550+0000 7f7622b87040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:42:44.818 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:44 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:44.671+0000 7f7622b87040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:42:45.112 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:44 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:44.820+0000 7f7622b87040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:42:45.113 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:44 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:44.883+0000 7f7622b87040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:42:45.113 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:45 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:45.041+0000 7f7622b87040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:42:45.113 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:45 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:45.113+0000 7f7622b87040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:42:45.383 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:45 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:45.177+0000 7f7622b87040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:42:45.384 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:45 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:45.347+0000 7f7622b87040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:42:45.642 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:45 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/4055187976' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T08:42:45.642 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:45 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:45.417+0000 7f7622b87040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:42:45.642 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:45 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:45.489+0000 7f7622b87040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:42:45.642 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:45 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:45.579+0000 7f7622b87040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:42:45.642 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:45 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:45.642+0000 7f7622b87040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:42:45.987 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:45 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:45.705+0000 7f7622b87040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:42:46.258 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-09-19T08:42:46.259 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:42:46.259 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "fsid": "f26c9d84-7662-11ef-bceb-c7b262605968", 2024-09-19T08:42:46.259 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T08:42:46.259 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T08:42:46.259 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T08:42:46.259 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T08:42:46.259 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:42:46.259 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T08:42:46.259 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T08:42:46.259 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 0 2024-09-19T08:42:46.259 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:42:46.259 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T08:42:46.259 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T08:42:46.259 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:42:46.260 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2024-09-19T08:42:46.260 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T08:42:46.260 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:42:46.260 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T08:42:46.260 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T08:42:46.260 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:42:46.260 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T08:42:46.260 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:42:46.260 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T08:42:46.260 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T08:42:46.260 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T08:42:46.260 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T08:42:46.261 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T08:42:46.261 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T08:42:46.261 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:42:46.261 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T08:42:46.261 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T08:42:46.261 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T08:42:46.261 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T08:42:46.261 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T08:42:46.261 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T08:42:46.261 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T08:42:46.261 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T08:42:46.261 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T08:42:46.261 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:42:46.262 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T08:42:46.262 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:42:46.262 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T08:42:32:323860+0000", 2024-09-19T08:42:46.262 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T08:42:46.262 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T08:42:46.262 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:42:46.262 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T08:42:46.262 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T08:42:46.262 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T08:42:46.262 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T08:42:46.262 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T08:42:46.262 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T08:42:46.262 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T08:42:46.262 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:42:46.263 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:42:46.263 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:42:46.263 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T08:42:46.263 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:42:46.263 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T08:42:32.324572+0000", 2024-09-19T08:42:46.263 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:42:46.263 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:42:46.263 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T08:42:46.263 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:42:46.263 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.464+0000 7faf12f87640 1 Processor -- start 2024-09-19T08:42:46.263 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.464+0000 7faf12f87640 1 -- start start 2024-09-19T08:42:46.263 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.464+0000 7faf12f87640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf0c108120 0x7faf0c10a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:46.263 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.464+0000 7faf12f87640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7faf0c07be90 con 0x7faf0c108120 2024-09-19T08:42:46.264 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.464+0000 7faf10d23640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf0c108120 0x7faf0c10a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:46.264 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.464+0000 7faf10d23640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf0c108120 0x7faf0c10a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56894/0 (socket says 172.21.15.19:56894) 2024-09-19T08:42:46.264 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.464+0000 7faf10d23640 1 -- 172.21.15.19:0/2342525496 learned_addr learned my addr 172.21.15.19:0/2342525496 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:42:46.264 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.465+0000 7faf10d23640 1 -- 172.21.15.19:0/2342525496 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf0c10aa50 con 0x7faf0c108120 2024-09-19T08:42:46.264 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.465+0000 7faf10d23640 1 --2- 172.21.15.19:0/2342525496 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf0c108120 0x7faf0c10a510 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7faf00009820 tx=0x7faf0002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b968e8bbc76e45b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:46.264 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.465+0000 7faf0b7fe640 1 -- 172.21.15.19:0/2342525496 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf00037070 con 0x7faf0c108120 2024-09-19T08:42:46.264 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.466+0000 7faf0b7fe640 1 -- 172.21.15.19:0/2342525496 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faf00032900 con 0x7faf0c108120 2024-09-19T08:42:46.264 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.466+0000 7faf0b7fe640 1 -- 172.21.15.19:0/2342525496 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf00030850 con 0x7faf0c108120 2024-09-19T08:42:46.264 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.466+0000 7faf12f87640 1 -- 172.21.15.19:0/2342525496 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf0c108120 msgr2=0x7faf0c10a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:46.264 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.466+0000 7faf12f87640 1 --2- 172.21.15.19:0/2342525496 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf0c108120 0x7faf0c10a510 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7faf00009820 tx=0x7faf0002a270 comp rx=0 tx=0).stop 2024-09-19T08:42:46.264 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.466+0000 7faf12f87640 1 -- 172.21.15.19:0/2342525496 shutdown_connections 2024-09-19T08:42:46.264 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.466+0000 7faf12f87640 1 --2- 172.21.15.19:0/2342525496 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf0c108120 0x7faf0c10a510 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:46.264 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.466+0000 7faf12f87640 1 -- 172.21.15.19:0/2342525496 >> 172.21.15.19:0/2342525496 conn(0x7faf0c101d20 msgr2=0x7faf0c104140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:46.265 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.466+0000 7faf12f87640 1 -- 172.21.15.19:0/2342525496 shutdown_connections 2024-09-19T08:42:46.265 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.466+0000 7faf12f87640 1 -- 172.21.15.19:0/2342525496 wait complete. 2024-09-19T08:42:46.265 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.467+0000 7faf12f87640 1 Processor -- start 2024-09-19T08:42:46.265 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.467+0000 7faf12f87640 1 -- start start 2024-09-19T08:42:46.265 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.467+0000 7faf12f87640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf0c108120 0x7faf0c1079a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:46.265 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.467+0000 7faf12f87640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7faf0c10ba90 con 0x7faf0c108120 2024-09-19T08:42:46.265 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.467+0000 7faf10d23640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf0c108120 0x7faf0c1079a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:46.265 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.467+0000 7faf10d23640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf0c108120 0x7faf0c1079a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56908/0 (socket says 172.21.15.19:56908) 2024-09-19T08:42:46.265 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.467+0000 7faf10d23640 1 -- 172.21.15.19:0/4055187976 learned_addr learned my addr 172.21.15.19:0/4055187976 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:42:46.265 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.467+0000 7faf10d23640 1 -- 172.21.15.19:0/4055187976 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf0c107ee0 con 0x7faf0c108120 2024-09-19T08:42:46.265 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.468+0000 7faf10d23640 1 --2- 172.21.15.19:0/4055187976 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf0c108120 0x7faf0c1079a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7faf00032ce0 tx=0x7faf00032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:46.265 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.468+0000 7faf09ffb640 1 -- 172.21.15.19:0/4055187976 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf00042070 con 0x7faf0c108120 2024-09-19T08:42:46.266 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.468+0000 7faf09ffb640 1 -- 172.21.15.19:0/4055187976 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faf000308c0 con 0x7faf0c108120 2024-09-19T08:42:46.266 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.468+0000 7faf12f87640 1 -- 172.21.15.19:0/4055187976 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf0c1060d0 con 0x7faf0c108120 2024-09-19T08:42:46.266 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.468+0000 7faf09ffb640 1 -- 172.21.15.19:0/4055187976 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faf00037040 con 0x7faf0c108120 2024-09-19T08:42:46.266 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.468+0000 7faf12f87640 1 -- 172.21.15.19:0/4055187976 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf0c106610 con 0x7faf0c108120 2024-09-19T08:42:46.266 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.468+0000 7faf09ffb640 1 -- 172.21.15.19:0/4055187976 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7faf00045070 con 0x7faf0c108120 2024-09-19T08:42:46.266 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.468+0000 7faf09ffb640 1 -- 172.21.15.19:0/4055187976 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7faf00047b80 con 0x7faf0c108120 2024-09-19T08:42:46.266 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.469+0000 7faf12f87640 1 -- 172.21.15.19:0/4055187976 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf0c108580 con 0x7faf0c108120 2024-09-19T08:42:46.266 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.471+0000 7faf09ffb640 1 -- 172.21.15.19:0/4055187976 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7faf00047e20 con 0x7faf0c108120 2024-09-19T08:42:46.266 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.534+0000 7faf12f87640 1 -- 172.21.15.19:0/4055187976 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7faf0c106b40 con 0x7faf0c108120 2024-09-19T08:42:46.266 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.534+0000 7faf09ffb640 1 -- 172.21.15.19:0/4055187976 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7faf0003c740 con 0x7faf0c108120 2024-09-19T08:42:46.266 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.535+0000 7faf12f87640 1 -- 172.21.15.19:0/4055187976 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf0c108120 msgr2=0x7faf0c1079a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:46.266 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.535+0000 7faf12f87640 1 --2- 172.21.15.19:0/4055187976 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf0c108120 0x7faf0c1079a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7faf00032ce0 tx=0x7faf00032d10 comp rx=0 tx=0).stop 2024-09-19T08:42:46.266 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.535+0000 7faf12f87640 1 -- 172.21.15.19:0/4055187976 shutdown_connections 2024-09-19T08:42:46.266 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.535+0000 7faf12f87640 1 --2- 172.21.15.19:0/4055187976 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf0c108120 0x7faf0c1079a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:46.267 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.535+0000 7faf12f87640 1 -- 172.21.15.19:0/4055187976 >> 172.21.15.19:0/4055187976 conn(0x7faf0c101d20 msgr2=0x7faf0c1028e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:46.267 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.535+0000 7faf12f87640 1 -- 172.21.15.19:0/4055187976 shutdown_connections 2024-09-19T08:42:46.267 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:45.535+0000 7faf12f87640 1 -- 172.21.15.19:0/4055187976 wait complete. 2024-09-19T08:42:46.267 INFO:teuthology.orchestra.run.smithi019.stdout:mgr not available, waiting (2/15)... 2024-09-19T08:42:46.818 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:46 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:46.540+0000 7f7622b87040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:42:46.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:46 smithi019 ceph-mon[30976]: Activating manager daemon x 2024-09-19T08:42:46.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:46 smithi019 ceph-mon[30976]: mgrmap e2: x(active, starting, since 0.00316391s) 2024-09-19T08:42:46.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:46 smithi019 ceph-mon[30976]: from='mgr.14100 172.21.15.19:0/2380637472' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T08:42:46.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:46 smithi019 ceph-mon[30976]: from='mgr.14100 172.21.15.19:0/2380637472' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T08:42:46.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:46 smithi019 ceph-mon[30976]: from='mgr.14100 172.21.15.19:0/2380637472' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T08:42:46.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:46 smithi019 ceph-mon[30976]: from='mgr.14100 172.21.15.19:0/2380637472' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:42:46.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:46 smithi019 ceph-mon[30976]: from='mgr.14100 172.21.15.19:0/2380637472' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T08:42:46.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:46 smithi019 ceph-mon[30976]: Manager daemon x is now available 2024-09-19T08:42:46.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:46 smithi019 ceph-mon[30976]: from='mgr.14100 172.21.15.19:0/2380637472' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T08:42:46.820 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:46 smithi019 ceph-mon[30976]: from='mgr.14100 172.21.15.19:0/2380637472' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T08:42:46.820 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:46 smithi019 ceph-mon[30976]: from='mgr.14100 172.21.15.19:0/2380637472' entity='mgr.x' 2024-09-19T08:42:46.820 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:46 smithi019 ceph-mon[30976]: from='mgr.14100 172.21.15.19:0/2380637472' entity='mgr.x' 2024-09-19T08:42:46.820 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:46 smithi019 ceph-mon[30976]: from='mgr.14100 172.21.15.19:0/2380637472' entity='mgr.x' 2024-09-19T08:42:48.649 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:48 smithi019 ceph-mon[30976]: mgrmap e3: x(active, since 1.00715s) 2024-09-19T08:42:49.499 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-09-19T08:42:49.499 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:42:49.499 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "fsid": "f26c9d84-7662-11ef-bceb-c7b262605968", 2024-09-19T08:42:49.499 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T08:42:49.499 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T08:42:49.500 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T08:42:49.500 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T08:42:49.500 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:42:49.500 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T08:42:49.500 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T08:42:49.500 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 0 2024-09-19T08:42:49.500 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:42:49.500 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T08:42:49.500 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T08:42:49.500 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:42:49.500 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-09-19T08:42:49.500 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T08:42:49.500 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:42:49.501 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T08:42:49.501 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T08:42:49.501 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:42:49.501 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T08:42:49.501 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:42:49.501 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T08:42:49.501 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T08:42:49.501 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T08:42:49.501 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T08:42:49.501 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T08:42:49.501 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T08:42:49.501 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:42:49.501 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T08:42:49.502 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T08:42:49.502 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T08:42:49.502 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T08:42:49.502 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T08:42:49.502 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T08:42:49.502 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T08:42:49.502 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T08:42:49.502 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T08:42:49.502 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:42:49.502 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T08:42:49.502 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:42:49.502 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T08:42:32:323860+0000", 2024-09-19T08:42:49.502 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T08:42:49.503 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T08:42:49.503 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:42:49.503 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T08:42:49.503 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T08:42:49.503 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T08:42:49.503 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T08:42:49.503 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T08:42:49.503 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T08:42:49.503 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T08:42:49.503 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ], 2024-09-19T08:42:49.503 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:42:49.503 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:42:49.503 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T08:42:49.503 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T08:42:49.504 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T08:42:32.324572+0000", 2024-09-19T08:42:49.504 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T08:42:49.504 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout }, 2024-09-19T08:42:49.504 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T08:42:49.504 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:42:49.504 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.671+0000 7f9090975640 1 Processor -- start 2024-09-19T08:42:49.504 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.671+0000 7f9090975640 1 -- start start 2024-09-19T08:42:49.504 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.671+0000 7f9090975640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f908c107720 0x7f908c107b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:49.504 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.671+0000 7f9090975640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f908c1080f0 con 0x7f908c107720 2024-09-19T08:42:49.504 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.672+0000 7f908a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f908c107720 0x7f908c107b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:49.504 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.672+0000 7f908a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f908c107720 0x7f908c107b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56984/0 (socket says 172.21.15.19:56984) 2024-09-19T08:42:49.504 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.672+0000 7f908a59c640 1 -- 172.21.15.19:0/1611524979 learned_addr learned my addr 172.21.15.19:0/1611524979 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:42:49.504 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.672+0000 7f908a59c640 1 -- 172.21.15.19:0/1611524979 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f908c108920 con 0x7f908c107720 2024-09-19T08:42:49.505 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.673+0000 7f908a59c640 1 --2- 172.21.15.19:0/1611524979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f908c107720 0x7f908c107b20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f907c009820 tx=0x7f907c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d383a31100823f5d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:49.505 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.673+0000 7f908959a640 1 -- 172.21.15.19:0/1611524979 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f907c037070 con 0x7f908c107720 2024-09-19T08:42:49.505 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.673+0000 7f908959a640 1 -- 172.21.15.19:0/1611524979 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f907c032900 con 0x7f908c107720 2024-09-19T08:42:49.505 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.673+0000 7f908959a640 1 -- 172.21.15.19:0/1611524979 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f907c030850 con 0x7f908c107720 2024-09-19T08:42:49.505 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.673+0000 7f9090975640 1 -- 172.21.15.19:0/1611524979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f908c107720 msgr2=0x7f908c107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:49.505 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.673+0000 7f9090975640 1 --2- 172.21.15.19:0/1611524979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f908c107720 0x7f908c107b20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f907c009820 tx=0x7f907c02a270 comp rx=0 tx=0).stop 2024-09-19T08:42:49.505 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.674+0000 7f9090975640 1 -- 172.21.15.19:0/1611524979 shutdown_connections 2024-09-19T08:42:49.505 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.674+0000 7f9090975640 1 --2- 172.21.15.19:0/1611524979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f908c107720 0x7f908c107b20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:49.505 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.674+0000 7f9090975640 1 -- 172.21.15.19:0/1611524979 >> 172.21.15.19:0/1611524979 conn(0x7f908c102ed0 msgr2=0x7f908c1052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:49.505 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.674+0000 7f9090975640 1 -- 172.21.15.19:0/1611524979 shutdown_connections 2024-09-19T08:42:49.505 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.674+0000 7f9090975640 1 -- 172.21.15.19:0/1611524979 wait complete. 2024-09-19T08:42:49.505 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.674+0000 7f9090975640 1 Processor -- start 2024-09-19T08:42:49.505 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.675+0000 7f9090975640 1 -- start start 2024-09-19T08:42:49.506 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.675+0000 7f9090975640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f908c107720 0x7f908c19d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:49.506 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.675+0000 7f9090975640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f908c10bcd0 con 0x7f908c107720 2024-09-19T08:42:49.506 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.675+0000 7f908a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f908c107720 0x7f908c19d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:49.506 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.675+0000 7f908a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f908c107720 0x7f908c19d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56988/0 (socket says 172.21.15.19:56988) 2024-09-19T08:42:49.506 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.675+0000 7f908a59c640 1 -- 172.21.15.19:0/867936967 learned_addr learned my addr 172.21.15.19:0/867936967 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:42:49.506 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.675+0000 7f908a59c640 1 -- 172.21.15.19:0/867936967 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f908c19de70 con 0x7f908c107720 2024-09-19T08:42:49.506 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.675+0000 7f908a59c640 1 --2- 172.21.15.19:0/867936967 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f908c107720 0x7f908c19d930 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f907c0097f0 tx=0x7f907c030ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:49.506 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.676+0000 7f907b7fe640 1 -- 172.21.15.19:0/867936967 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f907c042070 con 0x7f908c107720 2024-09-19T08:42:49.506 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.676+0000 7f9090975640 1 -- 172.21.15.19:0/867936967 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f908c19e100 con 0x7f908c107720 2024-09-19T08:42:49.506 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.676+0000 7f907b7fe640 1 -- 172.21.15.19:0/867936967 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f907c032ca0 con 0x7f908c107720 2024-09-19T08:42:49.506 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.676+0000 7f907b7fe640 1 -- 172.21.15.19:0/867936967 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f907c037040 con 0x7f908c107720 2024-09-19T08:42:49.506 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.676+0000 7f9090975640 1 -- 172.21.15.19:0/867936967 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f908c1a0df0 con 0x7f908c107720 2024-09-19T08:42:49.506 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.677+0000 7f907b7fe640 1 -- 172.21.15.19:0/867936967 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f907c045070 con 0x7f908c107720 2024-09-19T08:42:49.506 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.677+0000 7f9090975640 1 -- 172.21.15.19:0/867936967 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f908c107ba0 con 0x7f908c107720 2024-09-19T08:42:49.507 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.677+0000 7f907b7fe640 1 --2- 172.21.15.19:0/867936967 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7f9074039160 0x7f907403b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:49.507 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.677+0000 7f907b7fe640 1 -- 172.21.15.19:0/867936967 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f907c06c0c0 con 0x7f908c107720 2024-09-19T08:42:49.507 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.677+0000 7f9089d9b640 1 --2- 172.21.15.19:0/867936967 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7f9074039160 0x7f907403b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:49.507 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.677+0000 7f9089d9b640 1 --2- 172.21.15.19:0/867936967 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7f9074039160 0x7f907403b620 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f90800098c0 tx=0x7f9080006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:49.507 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.682+0000 7f907b7fe640 1 -- 172.21.15.19:0/867936967 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f907c04b170 con 0x7f908c107720 2024-09-19T08:42:49.507 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.924+0000 7f9090975640 1 -- 172.21.15.19:0/867936967 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f908c1a1470 con 0x7f908c107720 2024-09-19T08:42:49.507 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.924+0000 7f907b7fe640 1 -- 172.21.15.19:0/867936967 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f907c03d430 con 0x7f908c107720 2024-09-19T08:42:49.507 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.927+0000 7f9090975640 1 -- 172.21.15.19:0/867936967 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7f9074039160 msgr2=0x7f907403b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:49.507 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.927+0000 7f9090975640 1 --2- 172.21.15.19:0/867936967 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7f9074039160 0x7f907403b620 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f90800098c0 tx=0x7f9080006db0 comp rx=0 tx=0).stop 2024-09-19T08:42:49.507 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.927+0000 7f9090975640 1 -- 172.21.15.19:0/867936967 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f908c107720 msgr2=0x7f908c19d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:49.507 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.927+0000 7f9090975640 1 --2- 172.21.15.19:0/867936967 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f908c107720 0x7f908c19d930 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f907c0097f0 tx=0x7f907c030ec0 comp rx=0 tx=0).stop 2024-09-19T08:42:49.507 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.927+0000 7f9090975640 1 -- 172.21.15.19:0/867936967 shutdown_connections 2024-09-19T08:42:49.507 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.927+0000 7f9090975640 1 --2- 172.21.15.19:0/867936967 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7f9074039160 0x7f907403b620 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:49.508 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.927+0000 7f9090975640 1 --2- 172.21.15.19:0/867936967 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f908c107720 0x7f908c19d930 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:49.508 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.927+0000 7f9090975640 1 -- 172.21.15.19:0/867936967 >> 172.21.15.19:0/867936967 conn(0x7f908c102ed0 msgr2=0x7f908c103a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:49.508 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.927+0000 7f9090975640 1 -- 172.21.15.19:0/867936967 shutdown_connections 2024-09-19T08:42:49.508 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:48.927+0000 7f9090975640 1 -- 172.21.15.19:0/867936967 wait complete. 2024-09-19T08:42:49.508 INFO:teuthology.orchestra.run.smithi019.stdout:mgr is available 2024-09-19T08:42:49.731 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:49 smithi019 ceph-mon[30976]: mgrmap e4: x(active, since 2s) 2024-09-19T08:42:49.731 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:49 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/867936967' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T08:42:50.735 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:50 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/4232825005' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T08:42:50.744 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-09-19T08:42:50.744 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T08:42:50.744 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout fsid = f26c9d84-7662-11ef-bceb-c7b262605968 2024-09-19T08:42:50.744 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.19:3300,v1:172.21.15.19:6789] 2024-09-19T08:42:50.744 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T08:42:50.744 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T08:42:50.744 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T08:42:50.744 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T08:42:50.744 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-09-19T08:42:50.744 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T08:42:50.744 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T08:42:50.745 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 2024-09-19T08:42:50.745 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T08:42:50.745 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T08:42:50.745 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T08:42:50.745 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T08:42:50.745 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T08:42:50.745 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T08:42:50.745 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.910+0000 7f4fc630d640 1 Processor -- start 2024-09-19T08:42:50.745 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.910+0000 7f4fc630d640 1 -- start start 2024-09-19T08:42:50.745 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.911+0000 7f4fc630d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fc01098e0 0x7f4fc0109ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:50.745 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.911+0000 7f4fc630d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc010a2b0 con 0x7f4fc01098e0 2024-09-19T08:42:50.745 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.911+0000 7f4fbffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fc01098e0 0x7f4fc0109ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:50.745 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.911+0000 7f4fbffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fc01098e0 0x7f4fc0109ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57000/0 (socket says 172.21.15.19:57000) 2024-09-19T08:42:50.746 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.911+0000 7f4fbffff640 1 -- 172.21.15.19:0/976536689 learned_addr learned my addr 172.21.15.19:0/976536689 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:42:50.746 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.911+0000 7f4fbffff640 1 -- 172.21.15.19:0/976536689 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc010aae0 con 0x7f4fc01098e0 2024-09-19T08:42:50.746 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.912+0000 7f4fbffff640 1 --2- 172.21.15.19:0/976536689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fc01098e0 0x7f4fc0109ce0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4fb0009820 tx=0x7f4fb002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6440126fc431904 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:50.746 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.912+0000 7f4fbeffd640 1 -- 172.21.15.19:0/976536689 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fb0037070 con 0x7f4fc01098e0 2024-09-19T08:42:50.746 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.912+0000 7f4fbeffd640 1 -- 172.21.15.19:0/976536689 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4fb0032900 con 0x7f4fc01098e0 2024-09-19T08:42:50.746 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.912+0000 7f4fbeffd640 1 -- 172.21.15.19:0/976536689 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fb0030850 con 0x7f4fc01098e0 2024-09-19T08:42:50.746 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.913+0000 7f4fc630d640 1 -- 172.21.15.19:0/976536689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fc01098e0 msgr2=0x7f4fc0109ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:50.746 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.913+0000 7f4fc630d640 1 --2- 172.21.15.19:0/976536689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fc01098e0 0x7f4fc0109ce0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4fb0009820 tx=0x7f4fb002a270 comp rx=0 tx=0).stop 2024-09-19T08:42:50.746 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.913+0000 7f4fc630d640 1 -- 172.21.15.19:0/976536689 shutdown_connections 2024-09-19T08:42:50.746 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.913+0000 7f4fc630d640 1 --2- 172.21.15.19:0/976536689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fc01098e0 0x7f4fc0109ce0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:50.746 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.913+0000 7f4fc630d640 1 -- 172.21.15.19:0/976536689 >> 172.21.15.19:0/976536689 conn(0x7f4fc007ceb0 msgr2=0x7f4fc007d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:50.746 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.913+0000 7f4fc630d640 1 -- 172.21.15.19:0/976536689 shutdown_connections 2024-09-19T08:42:50.746 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.913+0000 7f4fc630d640 1 -- 172.21.15.19:0/976536689 wait complete. 2024-09-19T08:42:50.747 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.913+0000 7f4fc630d640 1 Processor -- start 2024-09-19T08:42:50.747 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.913+0000 7f4fc630d640 1 -- start start 2024-09-19T08:42:50.747 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.914+0000 7f4fc630d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fc01098e0 0x7f4fc019d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:50.747 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.914+0000 7f4fc630d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc010de90 con 0x7f4fc01098e0 2024-09-19T08:42:50.747 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.914+0000 7f4fbffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fc01098e0 0x7f4fc019d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:50.747 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.914+0000 7f4fbffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fc01098e0 0x7f4fc019d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57002/0 (socket says 172.21.15.19:57002) 2024-09-19T08:42:50.747 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.914+0000 7f4fbffff640 1 -- 172.21.15.19:0/4232825005 learned_addr learned my addr 172.21.15.19:0/4232825005 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:42:50.747 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.914+0000 7f4fbffff640 1 -- 172.21.15.19:0/4232825005 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc019dec0 con 0x7f4fc01098e0 2024-09-19T08:42:50.747 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.914+0000 7f4fbffff640 1 --2- 172.21.15.19:0/4232825005 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fc01098e0 0x7f4fc019d980 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4fb0009940 tx=0x7f4fb0032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:50.747 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.914+0000 7f4fbd7fa640 1 -- 172.21.15.19:0/4232825005 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fb0042070 con 0x7f4fc01098e0 2024-09-19T08:42:50.747 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.914+0000 7f4fbd7fa640 1 -- 172.21.15.19:0/4232825005 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4fb00308c0 con 0x7f4fc01098e0 2024-09-19T08:42:50.747 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.914+0000 7f4fc630d640 1 -- 172.21.15.19:0/4232825005 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fc019e150 con 0x7f4fc01098e0 2024-09-19T08:42:50.747 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.914+0000 7f4fbd7fa640 1 -- 172.21.15.19:0/4232825005 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4fb0037040 con 0x7f4fc01098e0 2024-09-19T08:42:50.747 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.914+0000 7f4fc630d640 1 -- 172.21.15.19:0/4232825005 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fc01a0e40 con 0x7f4fc01098e0 2024-09-19T08:42:50.748 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.915+0000 7f4fbd7fa640 1 -- 172.21.15.19:0/4232825005 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f4fb0045070 con 0x7f4fc01098e0 2024-09-19T08:42:50.748 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.916+0000 7f4fc630d640 1 -- 172.21.15.19:0/4232825005 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fc010e010 con 0x7f4fc01098e0 2024-09-19T08:42:50.748 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.916+0000 7f4fbd7fa640 1 --2- 172.21.15.19:0/4232825005 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7f4fa80391b0 0x7f4fa803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:50.748 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.916+0000 7f4fbd7fa640 1 -- 172.21.15.19:0/4232825005 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4fb006c3f0 con 0x7f4fc01098e0 2024-09-19T08:42:50.748 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.916+0000 7f4fbf7fe640 1 --2- 172.21.15.19:0/4232825005 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7f4fa80391b0 0x7f4fa803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:50.748 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.916+0000 7f4fbf7fe640 1 --2- 172.21.15.19:0/4232825005 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7f4fa80391b0 0x7f4fa803b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4fb40098c0 tx=0x7f4fb4006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:50.748 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:49.921+0000 7f4fbd7fa640 1 -- 172.21.15.19:0/4232825005 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4fb0045360 con 0x7f4fc01098e0 2024-09-19T08:42:50.748 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:50.094+0000 7f4fc630d640 1 -- 172.21.15.19:0/4232825005 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f4fc0109d60 con 0x7f4fc01098e0 2024-09-19T08:42:50.748 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:50.095+0000 7f4fbd7fa640 1 -- 172.21.15.19:0/4232825005 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7f4fb006be10 con 0x7f4fc01098e0 2024-09-19T08:42:50.748 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:50.097+0000 7f4fc630d640 1 -- 172.21.15.19:0/4232825005 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7f4fa80391b0 msgr2=0x7f4fa803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:50.748 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:50.097+0000 7f4fc630d640 1 --2- 172.21.15.19:0/4232825005 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7f4fa80391b0 0x7f4fa803b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4fb40098c0 tx=0x7f4fb4006db0 comp rx=0 tx=0).stop 2024-09-19T08:42:50.748 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:50.097+0000 7f4fc630d640 1 -- 172.21.15.19:0/4232825005 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fc01098e0 msgr2=0x7f4fc019d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:50.748 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:50.097+0000 7f4fc630d640 1 --2- 172.21.15.19:0/4232825005 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fc01098e0 0x7f4fc019d980 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4fb0009940 tx=0x7f4fb0032ce0 comp rx=0 tx=0).stop 2024-09-19T08:42:50.748 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:50.098+0000 7f4fc630d640 1 -- 172.21.15.19:0/4232825005 shutdown_connections 2024-09-19T08:42:50.749 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:50.098+0000 7f4fc630d640 1 --2- 172.21.15.19:0/4232825005 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7f4fa80391b0 0x7f4fa803b670 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:50.749 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:50.098+0000 7f4fc630d640 1 --2- 172.21.15.19:0/4232825005 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4fc01098e0 0x7f4fc019d980 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:50.749 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:50.098+0000 7f4fc630d640 1 -- 172.21.15.19:0/4232825005 >> 172.21.15.19:0/4232825005 conn(0x7f4fc007ceb0 msgr2=0x7f4fc01075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:50.749 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:50.098+0000 7f4fc630d640 1 -- 172.21.15.19:0/4232825005 shutdown_connections 2024-09-19T08:42:50.749 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:50.098+0000 7f4fc630d640 1 -- 172.21.15.19:0/4232825005 wait complete. 2024-09-19T08:42:50.749 INFO:teuthology.orchestra.run.smithi019.stdout:Enabling cephadm module... 2024-09-19T08:42:51.698 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:51 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/4170375769' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-19T08:42:51.699 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:51 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: ignoring --setuser ceph since I am not root 2024-09-19T08:42:51.699 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:51 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: ignoring --setgroup ceph since I am not root 2024-09-19T08:42:51.699 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:51 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:51.699+0000 7fde7a84c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T08:42:51.983 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:51 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:51.758+0000 7fde7a84c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:42:51.984 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:51 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:51.915+0000 7fde7a84c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:42:51.984 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:51 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:51.984+0000 7fde7a84c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:42:52.174 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.164+0000 7fd072142640 1 Processor -- start 2024-09-19T08:42:52.174 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.164+0000 7fd072142640 1 -- start start 2024-09-19T08:42:52.174 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.164+0000 7fd072142640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd06c107720 0x7fd06c107b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:52.174 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.164+0000 7fd072142640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd06c1080f0 con 0x7fd06c107720 2024-09-19T08:42:52.174 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.164+0000 7fd06b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd06c107720 0x7fd06c107b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:52.174 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.164+0000 7fd06b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd06c107720 0x7fd06c107b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57006/0 (socket says 172.21.15.19:57006) 2024-09-19T08:42:52.174 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.164+0000 7fd06b7fe640 1 -- 172.21.15.19:0/1895967723 learned_addr learned my addr 172.21.15.19:0/1895967723 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:42:52.174 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.164+0000 7fd06b7fe640 1 -- 172.21.15.19:0/1895967723 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd06c108920 con 0x7fd06c107720 2024-09-19T08:42:52.175 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.165+0000 7fd06b7fe640 1 --2- 172.21.15.19:0/1895967723 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd06c107720 0x7fd06c107b20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd05c009820 tx=0x7fd05c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86abc5dcd3e95ceb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:52.175 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.165+0000 7fd06a7fc640 1 -- 172.21.15.19:0/1895967723 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd05c037070 con 0x7fd06c107720 2024-09-19T08:42:52.175 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.165+0000 7fd06a7fc640 1 -- 172.21.15.19:0/1895967723 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd05c032900 con 0x7fd06c107720 2024-09-19T08:42:52.175 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.165+0000 7fd06a7fc640 1 -- 172.21.15.19:0/1895967723 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd05c030850 con 0x7fd06c107720 2024-09-19T08:42:52.175 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.166+0000 7fd072142640 1 -- 172.21.15.19:0/1895967723 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd06c107720 msgr2=0x7fd06c107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:52.175 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.166+0000 7fd072142640 1 --2- 172.21.15.19:0/1895967723 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd06c107720 0x7fd06c107b20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd05c009820 tx=0x7fd05c02a270 comp rx=0 tx=0).stop 2024-09-19T08:42:52.175 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.166+0000 7fd072142640 1 -- 172.21.15.19:0/1895967723 shutdown_connections 2024-09-19T08:42:52.175 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.166+0000 7fd072142640 1 --2- 172.21.15.19:0/1895967723 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd06c107720 0x7fd06c107b20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:52.175 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.166+0000 7fd072142640 1 -- 172.21.15.19:0/1895967723 >> 172.21.15.19:0/1895967723 conn(0x7fd06c102ed0 msgr2=0x7fd06c1052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:52.175 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.166+0000 7fd072142640 1 -- 172.21.15.19:0/1895967723 shutdown_connections 2024-09-19T08:42:52.175 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.166+0000 7fd072142640 1 -- 172.21.15.19:0/1895967723 wait complete. 2024-09-19T08:42:52.175 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.167+0000 7fd072142640 1 Processor -- start 2024-09-19T08:42:52.175 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.167+0000 7fd072142640 1 -- start start 2024-09-19T08:42:52.176 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.167+0000 7fd072142640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd06c107720 0x7fd06c19b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:52.176 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.167+0000 7fd072142640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd06c10bcd0 con 0x7fd06c107720 2024-09-19T08:42:52.176 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.167+0000 7fd06b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd06c107720 0x7fd06c19b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:52.176 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.167+0000 7fd06b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd06c107720 0x7fd06c19b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57014/0 (socket says 172.21.15.19:57014) 2024-09-19T08:42:52.176 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.167+0000 7fd06b7fe640 1 -- 172.21.15.19:0/4170375769 learned_addr learned my addr 172.21.15.19:0/4170375769 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:42:52.176 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.168+0000 7fd06b7fe640 1 -- 172.21.15.19:0/4170375769 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd06c19bc60 con 0x7fd06c107720 2024-09-19T08:42:52.176 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.168+0000 7fd06b7fe640 1 --2- 172.21.15.19:0/4170375769 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd06c107720 0x7fd06c19b720 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd05c009940 tx=0x7fd05c0326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:52.176 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.168+0000 7fd068ff9640 1 -- 172.21.15.19:0/4170375769 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd05c042070 con 0x7fd06c107720 2024-09-19T08:42:52.176 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.168+0000 7fd068ff9640 1 -- 172.21.15.19:0/4170375769 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd05c032be0 con 0x7fd06c107720 2024-09-19T08:42:52.176 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.168+0000 7fd072142640 1 -- 172.21.15.19:0/4170375769 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd06c19bef0 con 0x7fd06c107720 2024-09-19T08:42:52.176 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.168+0000 7fd068ff9640 1 -- 172.21.15.19:0/4170375769 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd05c037040 con 0x7fd06c107720 2024-09-19T08:42:52.177 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.168+0000 7fd072142640 1 -- 172.21.15.19:0/4170375769 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd06c19ebe0 con 0x7fd06c107720 2024-09-19T08:42:52.177 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.169+0000 7fd068ff9640 1 -- 172.21.15.19:0/4170375769 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7fd05c045070 con 0x7fd06c107720 2024-09-19T08:42:52.177 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.169+0000 7fd068ff9640 1 --2- 172.21.15.19:0/4170375769 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7fd0540391b0 0x7fd05403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:52.177 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.169+0000 7fd068ff9640 1 -- 172.21.15.19:0/4170375769 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd05c06c490 con 0x7fd06c107720 2024-09-19T08:42:52.177 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.169+0000 7fd06affd640 1 --2- 172.21.15.19:0/4170375769 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7fd0540391b0 0x7fd05403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:52.177 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.169+0000 7fd072142640 1 -- 172.21.15.19:0/4170375769 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd06c107ba0 con 0x7fd06c107720 2024-09-19T08:42:52.177 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.170+0000 7fd06affd640 1 --2- 172.21.15.19:0/4170375769 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7fd0540391b0 0x7fd05403b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd0600098c0 tx=0x7fd060006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:52.177 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.174+0000 7fd068ff9640 1 -- 172.21.15.19:0/4170375769 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd05c045360 con 0x7fd06c107720 2024-09-19T08:42:52.177 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.398+0000 7fd072142640 1 -- 172.21.15.19:0/4170375769 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7fd06c19f190 con 0x7fd06c107720 2024-09-19T08:42:52.177 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.557+0000 7fd068ff9640 1 -- 172.21.15.19:0/4170375769 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7fd05c03adf0 con 0x7fd06c107720 2024-09-19T08:42:52.177 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.558+0000 7fd068ff9640 1 -- 172.21.15.19:0/4170375769 <== mon.0 v2:172.21.15.19:3300/0 8 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7fd05c062090 con 0x7fd06c107720 2024-09-19T08:42:52.177 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.559+0000 7fd072142640 1 -- 172.21.15.19:0/4170375769 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7fd0540391b0 msgr2=0x7fd05403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:52.177 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.559+0000 7fd072142640 1 --2- 172.21.15.19:0/4170375769 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7fd0540391b0 0x7fd05403b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd0600098c0 tx=0x7fd060006db0 comp rx=0 tx=0).stop 2024-09-19T08:42:52.178 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.559+0000 7fd072142640 1 -- 172.21.15.19:0/4170375769 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd06c107720 msgr2=0x7fd06c19b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:52.178 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.559+0000 7fd072142640 1 --2- 172.21.15.19:0/4170375769 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd06c107720 0x7fd06c19b720 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd05c009940 tx=0x7fd05c0326e0 comp rx=0 tx=0).stop 2024-09-19T08:42:52.178 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.559+0000 7fd072142640 1 -- 172.21.15.19:0/4170375769 shutdown_connections 2024-09-19T08:42:52.178 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.559+0000 7fd072142640 1 --2- 172.21.15.19:0/4170375769 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7fd0540391b0 0x7fd05403b670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:52.178 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.560+0000 7fd072142640 1 --2- 172.21.15.19:0/4170375769 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd06c107720 0x7fd06c19b720 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:52.178 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.560+0000 7fd072142640 1 -- 172.21.15.19:0/4170375769 >> 172.21.15.19:0/4170375769 conn(0x7fd06c102ed0 msgr2=0x7fd06c103ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:52.178 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.560+0000 7fd072142640 1 -- 172.21.15.19:0/4170375769 shutdown_connections 2024-09-19T08:42:52.178 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:51.560+0000 7fd072142640 1 -- 172.21.15.19:0/4170375769 wait complete. 2024-09-19T08:42:52.292 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:52 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:52.138+0000 7fde7a84c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:42:52.292 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:52 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:52.292+0000 7fde7a84c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:42:52.817 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:52 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/4170375769' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-19T08:42:52.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:52 smithi019 ceph-mon[30976]: mgrmap e5: x(active, since 5s) 2024-09-19T08:42:52.818 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:52 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:52.631+0000 7fde7a84c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:42:52.818 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:52 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:52.696+0000 7fde7a84c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:42:53.068 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:52 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:52.895+0000 7fde7a84c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:42:53.407 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:42:53.407 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-19T08:42:53.407 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T08:42:53.408 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T08:42:53.408 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T08:42:53.408 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:42:53.408 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.583+0000 7f9234589640 1 Processor -- start 2024-09-19T08:42:53.408 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.583+0000 7f9234589640 1 -- start start 2024-09-19T08:42:53.408 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.583+0000 7f9234589640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f922c105f40 0x7f922c106340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:53.408 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.583+0000 7f9234589640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f922c07be90 con 0x7f922c105f40 2024-09-19T08:42:53.408 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.584+0000 7f9232325640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f922c105f40 0x7f922c106340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:53.408 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.584+0000 7f9232325640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f922c105f40 0x7f922c106340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57038/0 (socket says 172.21.15.19:57038) 2024-09-19T08:42:53.408 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.584+0000 7f9232325640 1 -- 172.21.15.19:0/4150510208 learned_addr learned my addr 172.21.15.19:0/4150510208 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:42:53.408 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.584+0000 7f9232325640 1 -- 172.21.15.19:0/4150510208 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f922c106880 con 0x7f922c105f40 2024-09-19T08:42:53.408 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.585+0000 7f9232325640 1 --2- 172.21.15.19:0/4150510208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f922c105f40 0x7f922c106340 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9228009820 tx=0x7f922802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aef1194df1c1a6a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:53.408 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.585+0000 7f9231323640 1 -- 172.21.15.19:0/4150510208 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9228037070 con 0x7f922c105f40 2024-09-19T08:42:53.409 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.585+0000 7f9231323640 1 -- 172.21.15.19:0/4150510208 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9228032900 con 0x7f922c105f40 2024-09-19T08:42:53.409 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.585+0000 7f9231323640 1 -- 172.21.15.19:0/4150510208 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9228030850 con 0x7f922c105f40 2024-09-19T08:42:53.409 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.585+0000 7f9234589640 1 -- 172.21.15.19:0/4150510208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f922c105f40 msgr2=0x7f922c106340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:53.409 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.585+0000 7f9234589640 1 --2- 172.21.15.19:0/4150510208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f922c105f40 0x7f922c106340 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9228009820 tx=0x7f922802a270 comp rx=0 tx=0).stop 2024-09-19T08:42:53.409 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.586+0000 7f9234589640 1 -- 172.21.15.19:0/4150510208 shutdown_connections 2024-09-19T08:42:53.409 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.586+0000 7f9234589640 1 --2- 172.21.15.19:0/4150510208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f922c105f40 0x7f922c106340 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:53.409 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.586+0000 7f9234589640 1 -- 172.21.15.19:0/4150510208 >> 172.21.15.19:0/4150510208 conn(0x7f922c101d50 msgr2=0x7f922c104170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:53.409 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.586+0000 7f9234589640 1 -- 172.21.15.19:0/4150510208 shutdown_connections 2024-09-19T08:42:53.409 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.586+0000 7f9234589640 1 -- 172.21.15.19:0/4150510208 wait complete. 2024-09-19T08:42:53.409 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.586+0000 7f9234589640 1 Processor -- start 2024-09-19T08:42:53.409 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.586+0000 7f9234589640 1 -- start start 2024-09-19T08:42:53.409 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.586+0000 7f9234589640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f922c105f40 0x7f922c19d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:53.409 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.586+0000 7f9234589640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f922c107980 con 0x7f922c105f40 2024-09-19T08:42:53.410 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.587+0000 7f9232325640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f922c105f40 0x7f922c19d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:53.410 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.587+0000 7f9232325640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f922c105f40 0x7f922c19d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57052/0 (socket says 172.21.15.19:57052) 2024-09-19T08:42:53.410 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.587+0000 7f9232325640 1 -- 172.21.15.19:0/3651532065 learned_addr learned my addr 172.21.15.19:0/3651532065 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:42:53.410 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.587+0000 7f9232325640 1 -- 172.21.15.19:0/3651532065 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f922c19de60 con 0x7f922c105f40 2024-09-19T08:42:53.410 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.587+0000 7f9232325640 1 --2- 172.21.15.19:0/3651532065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f922c105f40 0x7f922c19d920 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9228031000 tx=0x7f92280326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:53.410 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.587+0000 7f92237fe640 1 -- 172.21.15.19:0/3651532065 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9228042070 con 0x7f922c105f40 2024-09-19T08:42:53.410 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.587+0000 7f92237fe640 1 -- 172.21.15.19:0/3651532065 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9228032be0 con 0x7f922c105f40 2024-09-19T08:42:53.410 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.587+0000 7f9234589640 1 -- 172.21.15.19:0/3651532065 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f922c19e0f0 con 0x7f922c105f40 2024-09-19T08:42:53.410 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.587+0000 7f92237fe640 1 -- 172.21.15.19:0/3651532065 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9228037040 con 0x7f922c105f40 2024-09-19T08:42:53.410 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.587+0000 7f9234589640 1 -- 172.21.15.19:0/3651532065 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f922c1a0de0 con 0x7f922c105f40 2024-09-19T08:42:53.410 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.588+0000 7f92237fe640 1 -- 172.21.15.19:0/3651532065 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f9228045070 con 0x7f922c105f40 2024-09-19T08:42:53.410 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.588+0000 7f9234589640 1 -- 172.21.15.19:0/3651532065 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f922c106340 con 0x7f922c105f40 2024-09-19T08:42:53.410 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.588+0000 7f92237fe640 1 --2- 172.21.15.19:0/3651532065 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7f9218039200 0x7f921803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:53.411 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.588+0000 7f9231b24640 1 -- 172.21.15.19:0/3651532065 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7f9218039200 msgr2=0x7f921803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.19:6800/1764769529 2024-09-19T08:42:53.411 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.588+0000 7f92237fe640 1 -- 172.21.15.19:0/3651532065 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f922806c3f0 con 0x7f922c105f40 2024-09-19T08:42:53.411 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.588+0000 7f9231b24640 1 --2- 172.21.15.19:0/3651532065 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7f9218039200 0x7f921803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:42:53.411 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.593+0000 7f92237fe640 1 -- 172.21.15.19:0/3651532065 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f922803a380 con 0x7f922c105f40 2024-09-19T08:42:53.411 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.789+0000 7f9231b24640 1 -- 172.21.15.19:0/3651532065 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7f9218039200 msgr2=0x7f921803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.19:6800/1764769529 2024-09-19T08:42:53.411 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.789+0000 7f9231b24640 1 --2- 172.21.15.19:0/3651532065 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7f9218039200 0x7f921803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T08:42:53.411 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.818+0000 7f9234589640 1 -- 172.21.15.19:0/3651532065 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f922c1a0fb0 con 0x7f922c105f40 2024-09-19T08:42:53.411 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.818+0000 7f92237fe640 1 -- 172.21.15.19:0/3651532065 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f922804c070 con 0x7f922c105f40 2024-09-19T08:42:53.411 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.820+0000 7f9234589640 1 -- 172.21.15.19:0/3651532065 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7f9218039200 msgr2=0x7f921803b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:42:53.411 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.820+0000 7f9234589640 1 --2- 172.21.15.19:0/3651532065 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7f9218039200 0x7f921803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:53.411 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.820+0000 7f9234589640 1 -- 172.21.15.19:0/3651532065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f922c105f40 msgr2=0x7f922c19d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:53.411 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.820+0000 7f9234589640 1 --2- 172.21.15.19:0/3651532065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f922c105f40 0x7f922c19d920 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9228031000 tx=0x7f92280326e0 comp rx=0 tx=0).stop 2024-09-19T08:42:53.411 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.820+0000 7f9234589640 1 -- 172.21.15.19:0/3651532065 shutdown_connections 2024-09-19T08:42:53.412 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.820+0000 7f9234589640 1 --2- 172.21.15.19:0/3651532065 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7f9218039200 0x7f921803b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:53.412 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.820+0000 7f9234589640 1 --2- 172.21.15.19:0/3651532065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f922c105f40 0x7f922c19d920 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:53.412 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.820+0000 7f9234589640 1 -- 172.21.15.19:0/3651532065 >> 172.21.15.19:0/3651532065 conn(0x7f922c101d50 msgr2=0x7f922c191c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:53.412 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.820+0000 7f9234589640 1 -- 172.21.15.19:0/3651532065 shutdown_connections 2024-09-19T08:42:53.412 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:52.820+0000 7f9234589640 1 -- 172.21.15.19:0/3651532065 wait complete. 2024-09-19T08:42:53.412 INFO:teuthology.orchestra.run.smithi019.stdout:Waiting for the mgr to restart... 2024-09-19T08:42:53.412 INFO:teuthology.orchestra.run.smithi019.stdout:Waiting for mgr epoch 5... 2024-09-19T08:42:53.712 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:53 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3651532065' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T08:42:53.999 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:53 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:53.831+0000 7fde7a84c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:42:53.999 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:53 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:53.901+0000 7fde7a84c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:42:54.770 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:54 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:54.650+0000 7fde7a84c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:42:54.771 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:54 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:54.771+0000 7fde7a84c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:42:55.068 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:54 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:54.920+0000 7fde7a84c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:42:55.068 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:54 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:54.984+0000 7fde7a84c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:42:55.440 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:55 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:55.140+0000 7fde7a84c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:42:55.440 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:55 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:55.211+0000 7fde7a84c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:42:55.440 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:55 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:55.274+0000 7fde7a84c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:42:55.440 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:55 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:55.440+0000 7fde7a84c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:42:55.726 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:55 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:55.508+0000 7fde7a84c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:42:55.726 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:55 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:55.577+0000 7fde7a84c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:42:55.726 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:55 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:55.664+0000 7fde7a84c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:42:55.726 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:55 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:55.726+0000 7fde7a84c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:42:56.068 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:55 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:55.787+0000 7fde7a84c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:42:57.068 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:56 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:56.617+0000 7fde7a84c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:42:57.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:56 smithi019 ceph-mon[30976]: Active manager daemon x restarted 2024-09-19T08:42:57.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:56 smithi019 ceph-mon[30976]: Activating manager daemon x 2024-09-19T08:42:57.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:56 smithi019 ceph-mon[30976]: osdmap e2: 0 total, 0 up, 0 in 2024-09-19T08:42:57.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:56 smithi019 ceph-mon[30976]: mgrmap e6: x(active, starting, since 0.00342772s) 2024-09-19T08:42:57.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:56 smithi019 ceph-mon[30976]: from='mgr.14118 172.21.15.19:0/2034466589' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:42:57.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:56 smithi019 ceph-mon[30976]: from='mgr.14118 172.21.15.19:0/2034466589' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T08:42:57.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:56 smithi019 ceph-mon[30976]: from='mgr.14118 172.21.15.19:0/2034466589' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T08:42:57.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:56 smithi019 ceph-mon[30976]: from='mgr.14118 172.21.15.19:0/2034466589' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T08:42:57.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:56 smithi019 ceph-mon[30976]: from='mgr.14118 172.21.15.19:0/2034466589' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T08:42:57.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:56 smithi019 ceph-mon[30976]: Manager daemon x is now available 2024-09-19T08:42:57.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:56 smithi019 ceph-mon[30976]: from='mgr.14118 172.21.15.19:0/2034466589' entity='mgr.x' 2024-09-19T08:42:57.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:56 smithi019 ceph-mon[30976]: from='mgr.14118 172.21.15.19:0/2034466589' entity='mgr.x' 2024-09-19T08:42:57.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:56 smithi019 ceph-mon[30976]: from='mgr.14118 172.21.15.19:0/2034466589' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:42:57.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:56 smithi019 ceph-mon[30976]: from='mgr.14118 172.21.15.19:0/2034466589' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:42:57.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:56 smithi019 ceph-mon[30976]: from='mgr.14118 172.21.15.19:0/2034466589' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T08:42:57.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:56 smithi019 ceph-mon[30976]: from='mgr.14118 172.21.15.19:0/2034466589' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T08:42:58.224 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:42:58.224 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-19T08:42:58.224 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T08:42:58.224 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:42:58.225 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.793+0000 7f4063ff8640 1 Processor -- start 2024-09-19T08:42:58.225 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.793+0000 7f4063ff8640 1 -- start start 2024-09-19T08:42:58.225 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.794+0000 7f4063ff8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f405c108180 0x7f405c10a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:58.225 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.794+0000 7f4063ff8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f405c07be80 con 0x7f405c108180 2024-09-19T08:42:58.225 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.794+0000 7f4061d94640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f405c108180 0x7f405c10a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:58.225 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.794+0000 7f4061d94640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f405c108180 0x7f405c10a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57054/0 (socket says 172.21.15.19:57054) 2024-09-19T08:42:58.225 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.794+0000 7f4061d94640 1 -- 172.21.15.19:0/3308169108 learned_addr learned my addr 172.21.15.19:0/3308169108 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:42:58.225 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.794+0000 7f4061d94640 1 -- 172.21.15.19:0/3308169108 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f405c10aab0 con 0x7f405c108180 2024-09-19T08:42:58.225 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.795+0000 7f4061d94640 1 --2- 172.21.15.19:0/3308169108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f405c108180 0x7f405c10a570 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4058009820 tx=0x7f405802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b758b27be2fbd51a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:58.225 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.795+0000 7f4060d92640 1 -- 172.21.15.19:0/3308169108 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4058037070 con 0x7f405c108180 2024-09-19T08:42:58.225 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.795+0000 7f4060d92640 1 -- 172.21.15.19:0/3308169108 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4058032900 con 0x7f405c108180 2024-09-19T08:42:58.225 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.795+0000 7f4060d92640 1 -- 172.21.15.19:0/3308169108 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4058030850 con 0x7f405c108180 2024-09-19T08:42:58.225 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.796+0000 7f4063ff8640 1 -- 172.21.15.19:0/3308169108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f405c108180 msgr2=0x7f405c10a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:58.226 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.796+0000 7f4063ff8640 1 --2- 172.21.15.19:0/3308169108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f405c108180 0x7f405c10a570 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4058009820 tx=0x7f405802a270 comp rx=0 tx=0).stop 2024-09-19T08:42:58.226 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.796+0000 7f4063ff8640 1 -- 172.21.15.19:0/3308169108 shutdown_connections 2024-09-19T08:42:58.226 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.796+0000 7f4063ff8640 1 --2- 172.21.15.19:0/3308169108 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f405c108180 0x7f405c10a570 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:58.226 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.796+0000 7f4063ff8640 1 -- 172.21.15.19:0/3308169108 >> 172.21.15.19:0/3308169108 conn(0x7f405c101da0 msgr2=0x7f405c1041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:58.226 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.796+0000 7f4063ff8640 1 -- 172.21.15.19:0/3308169108 shutdown_connections 2024-09-19T08:42:58.226 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.796+0000 7f4063ff8640 1 -- 172.21.15.19:0/3308169108 wait complete. 2024-09-19T08:42:58.226 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.796+0000 7f4063ff8640 1 Processor -- start 2024-09-19T08:42:58.226 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.796+0000 7f4063ff8640 1 -- start start 2024-09-19T08:42:58.226 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.797+0000 7f4063ff8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f405c108180 0x7f405c107a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:58.226 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.797+0000 7f4063ff8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f405c10baf0 con 0x7f405c108180 2024-09-19T08:42:58.226 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.797+0000 7f4061d94640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f405c108180 0x7f405c107a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:58.226 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.797+0000 7f4061d94640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f405c108180 0x7f405c107a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57068/0 (socket says 172.21.15.19:57068) 2024-09-19T08:42:58.226 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.797+0000 7f4061d94640 1 -- 172.21.15.19:0/1414615789 learned_addr learned my addr 172.21.15.19:0/1414615789 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:42:58.227 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.797+0000 7f4061d94640 1 -- 172.21.15.19:0/1414615789 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f405c107f40 con 0x7f405c108180 2024-09-19T08:42:58.227 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.797+0000 7f4061d94640 1 --2- 172.21.15.19:0/1414615789 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f405c108180 0x7f405c107a00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4058031000 tx=0x7f40580326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:58.227 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.797+0000 7f404effd640 1 -- 172.21.15.19:0/1414615789 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4058042070 con 0x7f405c108180 2024-09-19T08:42:58.227 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.797+0000 7f404effd640 1 -- 172.21.15.19:0/1414615789 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4058032be0 con 0x7f405c108180 2024-09-19T08:42:58.227 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.797+0000 7f4063ff8640 1 -- 172.21.15.19:0/1414615789 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f405c106130 con 0x7f405c108180 2024-09-19T08:42:58.227 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.797+0000 7f404effd640 1 -- 172.21.15.19:0/1414615789 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4058037040 con 0x7f405c108180 2024-09-19T08:42:58.227 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.797+0000 7f4063ff8640 1 -- 172.21.15.19:0/1414615789 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f405c106670 con 0x7f405c108180 2024-09-19T08:42:58.227 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.798+0000 7f404effd640 1 -- 172.21.15.19:0/1414615789 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f4058045070 con 0x7f405c108180 2024-09-19T08:42:58.227 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.798+0000 7f404effd640 1 --2- 172.21.15.19:0/1414615789 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7f40480391b0 0x7f404803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:58.227 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.798+0000 7f4063ff8640 1 -- 172.21.15.19:0/1414615789 --> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f405c1085e0 con 0x7f40480391b0 2024-09-19T08:42:58.227 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.798+0000 7f404effd640 1 -- 172.21.15.19:0/1414615789 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f405806c450 con 0x7f405c108180 2024-09-19T08:42:58.228 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.798+0000 7f4061593640 1 -- 172.21.15.19:0/1414615789 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7f40480391b0 msgr2=0x7f404803b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.19:6800/1764769529 2024-09-19T08:42:58.228 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:53.799+0000 7f4061593640 1 --2- 172.21.15.19:0/1414615789 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7f40480391b0 0x7f404803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:42:58.228 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:54.000+0000 7f4061593640 1 -- 172.21.15.19:0/1414615789 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7f40480391b0 msgr2=0x7f404803b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.19:6800/1764769529 2024-09-19T08:42:58.228 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:54.000+0000 7f4061593640 1 --2- 172.21.15.19:0/1414615789 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7f40480391b0 0x7f404803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T08:42:58.228 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:54.401+0000 7f4061593640 1 -- 172.21.15.19:0/1414615789 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7f40480391b0 msgr2=0x7f404803b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.19:6800/1764769529 2024-09-19T08:42:58.228 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:54.401+0000 7f4061593640 1 --2- 172.21.15.19:0/1414615789 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7f40480391b0 0x7f404803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T08:42:58.228 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:55.202+0000 7f4061593640 1 -- 172.21.15.19:0/1414615789 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7f40480391b0 msgr2=0x7f404803b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.19:6800/1764769529 2024-09-19T08:42:58.228 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:55.202+0000 7f4061593640 1 --2- 172.21.15.19:0/1414615789 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7f40480391b0 0x7f404803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T08:42:58.228 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:56.620+0000 7f404effd640 1 -- 172.21.15.19:0/1414615789 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mgrmap(e 6) ==== 46228+0+0 (secure 0 0 0) 0x7f405806af10 con 0x7f405c108180 2024-09-19T08:42:58.228 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:56.620+0000 7f404effd640 1 -- 172.21.15.19:0/1414615789 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7f40480391b0 msgr2=0x7f404803b670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:42:58.228 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:56.620+0000 7f404effd640 1 --2- 172.21.15.19:0/1414615789 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7f40480391b0 0x7f404803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:58.228 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:57.621+0000 7f404effd640 1 -- 172.21.15.19:0/1414615789 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f405803ccd0 con 0x7f405c108180 2024-09-19T08:42:58.228 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:57.622+0000 7f404effd640 1 --2- 172.21.15.19:0/1414615789 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f404803c8f0 0x7f404803ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:58.229 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:57.622+0000 7f404effd640 1 -- 172.21.15.19:0/1414615789 --> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f405802dec0 con 0x7f404803c8f0 2024-09-19T08:42:58.229 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:57.622+0000 7f4061593640 1 --2- 172.21.15.19:0/1414615789 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f404803c8f0 0x7f404803ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:58.229 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:57.623+0000 7f4061593640 1 --2- 172.21.15.19:0/1414615789 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f404803c8f0 0x7f404803ece0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4050003980 tx=0x7f4050006e10 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:58.229 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:57.624+0000 7f404effd640 1 -- 172.21.15.19:0/1414615789 <== mgr.14118 v2:172.21.15.19:6800/4266644067 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f405802dec0 con 0x7f404803c8f0 2024-09-19T08:42:58.229 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:57.630+0000 7f4063ff8640 1 -- 172.21.15.19:0/1414615789 --> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f405c103100 con 0x7f404803c8f0 2024-09-19T08:42:58.229 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:57.631+0000 7f404effd640 1 -- 172.21.15.19:0/1414615789 <== mgr.14118 v2:172.21.15.19:6800/4266644067 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f405c103100 con 0x7f404803c8f0 2024-09-19T08:42:58.229 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:57.631+0000 7f4063ff8640 1 -- 172.21.15.19:0/1414615789 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f404803c8f0 msgr2=0x7f404803ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:58.229 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:57.631+0000 7f4063ff8640 1 --2- 172.21.15.19:0/1414615789 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f404803c8f0 0x7f404803ece0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4050003980 tx=0x7f4050006e10 comp rx=0 tx=0).stop 2024-09-19T08:42:58.229 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:57.631+0000 7f4063ff8640 1 -- 172.21.15.19:0/1414615789 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f405c108180 msgr2=0x7f405c107a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:58.229 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:57.631+0000 7f4063ff8640 1 --2- 172.21.15.19:0/1414615789 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f405c108180 0x7f405c107a00 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f4058031000 tx=0x7f40580326e0 comp rx=0 tx=0).stop 2024-09-19T08:42:58.229 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:57.631+0000 7f4063ff8640 1 -- 172.21.15.19:0/1414615789 shutdown_connections 2024-09-19T08:42:58.229 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:57.631+0000 7f4063ff8640 1 --2- 172.21.15.19:0/1414615789 >> [v2:172.21.15.19:6800/1764769529,v1:172.21.15.19:6801/1764769529] conn(0x7f40480391b0 0x7f404803b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:58.229 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:57.631+0000 7f4063ff8640 1 --2- 172.21.15.19:0/1414615789 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f404803c8f0 0x7f404803ece0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:58.230 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:57.631+0000 7f4063ff8640 1 --2- 172.21.15.19:0/1414615789 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f405c108180 0x7f405c107a00 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:58.230 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:57.631+0000 7f4063ff8640 1 -- 172.21.15.19:0/1414615789 >> 172.21.15.19:0/1414615789 conn(0x7f405c101da0 msgr2=0x7f405c1029f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:58.230 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:57.631+0000 7f4063ff8640 1 -- 172.21.15.19:0/1414615789 shutdown_connections 2024-09-19T08:42:58.230 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:57.631+0000 7f4063ff8640 1 -- 172.21.15.19:0/1414615789 wait complete. 2024-09-19T08:42:58.230 INFO:teuthology.orchestra.run.smithi019.stdout:mgr epoch 5 is available 2024-09-19T08:42:58.230 INFO:teuthology.orchestra.run.smithi019.stdout:Setting orchestrator backend to cephadm... 2024-09-19T08:42:58.551 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:58 smithi019 ceph-mon[30976]: Found migration_current of "None". Setting to last migration. 2024-09-19T08:42:58.551 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:58 smithi019 ceph-mon[30976]: from='mgr.14118 172.21.15.19:0/2034466589' entity='mgr.x' 2024-09-19T08:42:58.551 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:58 smithi019 ceph-mon[30976]: from='mgr.14118 172.21.15.19:0/2034466589' entity='mgr.x' 2024-09-19T08:42:58.551 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:58 smithi019 ceph-mon[30976]: mgrmap e7: x(active, since 1.00557s) 2024-09-19T08:42:59.446 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:59 smithi019 ceph-mon[30976]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T08:42:59.447 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:59 smithi019 ceph-mon[30976]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T08:42:59.447 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:59 smithi019 ceph-mon[30976]: from='mgr.14118 172.21.15.19:0/2034466589' entity='mgr.x' 2024-09-19T08:42:59.447 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:42:59 smithi019 ceph-mon[30976]: from='mgr.14118 172.21.15.19:0/2034466589' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:42:59.447 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:59 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:59.258+0000 7fdde7371640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:08:42:59] ENGINE Error in HTTPServer.serve 2024-09-19T08:42:59.447 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:59 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: Traceback (most recent call last): 2024-09-19T08:42:59.447 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:59 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:42:59.448 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:59 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: self._connections.run(self.expiration_interval) 2024-09-19T08:42:59.448 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:59 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:42:59.448 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:59 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: self._run(expiration_interval) 2024-09-19T08:42:59.448 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:59 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:42:59.448 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:59 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:42:59.448 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:59 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:42:59.448 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:59 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:42:59.448 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:59 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:42:59.448 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:59 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: s = self.context.wrap_socket( 2024-09-19T08:42:59.448 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:59 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:42:59.448 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:59 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: return self.sslsocket_class._create( 2024-09-19T08:42:59.448 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:59 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:42:59.449 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:59 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: self.do_handshake() 2024-09-19T08:42:59.449 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:59 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:42:59.449 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:59 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: self._sslobj.do_handshake() 2024-09-19T08:42:59.449 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:59 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:42:59.449 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:42:59 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:42:59.454 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.632+0000 7f9f3fd04640 1 Processor -- start 2024-09-19T08:42:59.454 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.632+0000 7f9f3fd04640 1 -- start start 2024-09-19T08:42:59.454 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.632+0000 7f9f3fd04640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f38105f80 0x7f9f38106380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:59.454 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.632+0000 7f9f3fd04640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9f3807be30 con 0x7f9f38105f80 2024-09-19T08:42:59.454 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.632+0000 7f9f3daa0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f38105f80 0x7f9f38106380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:59.455 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.632+0000 7f9f3daa0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f38105f80 0x7f9f38106380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45616/0 (socket says 172.21.15.19:45616) 2024-09-19T08:42:59.455 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.632+0000 7f9f3daa0640 1 -- 172.21.15.19:0/3182129972 learned_addr learned my addr 172.21.15.19:0/3182129972 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:42:59.455 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.633+0000 7f9f3daa0640 1 -- 172.21.15.19:0/3182129972 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f381068c0 con 0x7f9f38105f80 2024-09-19T08:42:59.455 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.633+0000 7f9f3daa0640 1 --2- 172.21.15.19:0/3182129972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f38105f80 0x7f9f38106380 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9f34009820 tx=0x7f9f3402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ffae9b3c4206524 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:59.455 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.634+0000 7f9f3ca9e640 1 -- 172.21.15.19:0/3182129972 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f34037070 con 0x7f9f38105f80 2024-09-19T08:42:59.455 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.634+0000 7f9f3ca9e640 1 -- 172.21.15.19:0/3182129972 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9f34032900 con 0x7f9f38105f80 2024-09-19T08:42:59.455 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.634+0000 7f9f3ca9e640 1 -- 172.21.15.19:0/3182129972 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f34030850 con 0x7f9f38105f80 2024-09-19T08:42:59.455 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.634+0000 7f9f3fd04640 1 -- 172.21.15.19:0/3182129972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f38105f80 msgr2=0x7f9f38106380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:59.455 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.634+0000 7f9f3fd04640 1 --2- 172.21.15.19:0/3182129972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f38105f80 0x7f9f38106380 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f9f34009820 tx=0x7f9f3402a270 comp rx=0 tx=0).stop 2024-09-19T08:42:59.455 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.634+0000 7f9f3fd04640 1 -- 172.21.15.19:0/3182129972 shutdown_connections 2024-09-19T08:42:59.455 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.634+0000 7f9f3fd04640 1 --2- 172.21.15.19:0/3182129972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f38105f80 0x7f9f38106380 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:59.455 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.634+0000 7f9f3fd04640 1 -- 172.21.15.19:0/3182129972 >> 172.21.15.19:0/3182129972 conn(0x7f9f38101d10 msgr2=0x7f9f38104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:59.455 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.634+0000 7f9f3fd04640 1 -- 172.21.15.19:0/3182129972 shutdown_connections 2024-09-19T08:42:59.456 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.634+0000 7f9f3fd04640 1 -- 172.21.15.19:0/3182129972 wait complete. 2024-09-19T08:42:59.456 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.635+0000 7f9f3fd04640 1 Processor -- start 2024-09-19T08:42:59.456 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.635+0000 7f9f3fd04640 1 -- start start 2024-09-19T08:42:59.456 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.635+0000 7f9f3fd04640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f38105f80 0x7f9f3819d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:59.456 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.635+0000 7f9f3fd04640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9f381079c0 con 0x7f9f38105f80 2024-09-19T08:42:59.456 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.635+0000 7f9f3daa0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f38105f80 0x7f9f3819d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:59.456 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.635+0000 7f9f3daa0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f38105f80 0x7f9f3819d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45626/0 (socket says 172.21.15.19:45626) 2024-09-19T08:42:59.456 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.635+0000 7f9f3daa0640 1 -- 172.21.15.19:0/961801058 learned_addr learned my addr 172.21.15.19:0/961801058 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:42:59.456 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.636+0000 7f9f3daa0640 1 -- 172.21.15.19:0/961801058 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f3819dd90 con 0x7f9f38105f80 2024-09-19T08:42:59.456 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.636+0000 7f9f3daa0640 1 --2- 172.21.15.19:0/961801058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f38105f80 0x7f9f3819d850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9f340097f0 tx=0x7f9f34030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:59.456 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.636+0000 7f9f2effd640 1 -- 172.21.15.19:0/961801058 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f34037040 con 0x7f9f38105f80 2024-09-19T08:42:59.456 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.636+0000 7f9f3fd04640 1 -- 172.21.15.19:0/961801058 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f3819e020 con 0x7f9f38105f80 2024-09-19T08:42:59.456 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.636+0000 7f9f2effd640 1 -- 172.21.15.19:0/961801058 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9f34040070 con 0x7f9f38105f80 2024-09-19T08:42:59.457 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.636+0000 7f9f2effd640 1 -- 172.21.15.19:0/961801058 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f3403a390 con 0x7f9f38105f80 2024-09-19T08:42:59.457 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.636+0000 7f9f3fd04640 1 -- 172.21.15.19:0/961801058 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f381a0d10 con 0x7f9f38105f80 2024-09-19T08:42:59.457 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.637+0000 7f9f3fd04640 1 -- 172.21.15.19:0/961801058 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f38106380 con 0x7f9f38105f80 2024-09-19T08:42:59.457 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.637+0000 7f9f2effd640 1 -- 172.21.15.19:0/961801058 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f9f3403b430 con 0x7f9f38105f80 2024-09-19T08:42:59.457 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.637+0000 7f9f2effd640 1 --2- 172.21.15.19:0/961801058 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f9f240390a0 0x7f9f2403b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:42:59.457 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.637+0000 7f9f2effd640 1 -- 172.21.15.19:0/961801058 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f9f3406c5c0 con 0x7f9f38105f80 2024-09-19T08:42:59.457 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.638+0000 7f9f3d29f640 1 --2- 172.21.15.19:0/961801058 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f9f240390a0 0x7f9f2403b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:42:59.457 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.638+0000 7f9f3d29f640 1 --2- 172.21.15.19:0/961801058 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f9f240390a0 0x7f9f2403b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9f280098c0 tx=0x7f9f28006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:42:59.457 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.643+0000 7f9f2effd640 1 -- 172.21.15.19:0/961801058 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9f34032900 con 0x7f9f38105f80 2024-09-19T08:42:59.457 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.836+0000 7f9f3fd04640 1 -- 172.21.15.19:0/961801058 --> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f9f3802da60 con 0x7f9f240390a0 2024-09-19T08:42:59.457 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.840+0000 7f9f2effd640 1 -- 172.21.15.19:0/961801058 <== mgr.14118 v2:172.21.15.19:6800/4266644067 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9f3802da60 con 0x7f9f240390a0 2024-09-19T08:42:59.457 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.843+0000 7f9f3fd04640 1 -- 172.21.15.19:0/961801058 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f9f240390a0 msgr2=0x7f9f2403b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:59.457 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.843+0000 7f9f3fd04640 1 --2- 172.21.15.19:0/961801058 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f9f240390a0 0x7f9f2403b560 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9f280098c0 tx=0x7f9f28006db0 comp rx=0 tx=0).stop 2024-09-19T08:42:59.457 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.843+0000 7f9f3fd04640 1 -- 172.21.15.19:0/961801058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f38105f80 msgr2=0x7f9f3819d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:42:59.458 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.843+0000 7f9f3fd04640 1 --2- 172.21.15.19:0/961801058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f38105f80 0x7f9f3819d850 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9f340097f0 tx=0x7f9f34030d80 comp rx=0 tx=0).stop 2024-09-19T08:42:59.458 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.843+0000 7f9f3fd04640 1 -- 172.21.15.19:0/961801058 shutdown_connections 2024-09-19T08:42:59.458 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.843+0000 7f9f3fd04640 1 --2- 172.21.15.19:0/961801058 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f9f240390a0 0x7f9f2403b560 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:59.458 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.843+0000 7f9f3fd04640 1 --2- 172.21.15.19:0/961801058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f38105f80 0x7f9f3819d850 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:42:59.458 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.843+0000 7f9f3fd04640 1 -- 172.21.15.19:0/961801058 >> 172.21.15.19:0/961801058 conn(0x7f9f38101d10 msgr2=0x7f9f38194530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:42:59.458 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.843+0000 7f9f3fd04640 1 -- 172.21.15.19:0/961801058 shutdown_connections 2024-09-19T08:42:59.458 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:58.843+0000 7f9f3fd04640 1 -- 172.21.15.19:0/961801058 wait complete. 2024-09-19T08:43:00.245 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:00 smithi019 ceph-mon[30976]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:43:00.245 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:00 smithi019 ceph-mon[30976]: [19/Sep/2024:08:42:59] ENGINE Bus STARTING 2024-09-19T08:43:00.245 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:00 smithi019 ceph-mon[30976]: mgrmap e8: x(active, since 2s) 2024-09-19T08:43:00.245 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:00 smithi019 ceph-mon[30976]: [19/Sep/2024:08:42:59] ENGINE Serving on https://172.21.15.19:7150 2024-09-19T08:43:00.245 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:00 smithi019 ceph-mon[30976]: [19/Sep/2024:08:42:59] ENGINE Error in HTTPServer.serve 2024-09-19T08:43:00.245 INFO:journalctl@ceph.mon.a.smithi019.stdout: Traceback (most recent call last): 2024-09-19T08:43:00.245 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:43:00.246 INFO:journalctl@ceph.mon.a.smithi019.stdout: self._connections.run(self.expiration_interval) 2024-09-19T08:43:00.246 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:43:00.246 INFO:journalctl@ceph.mon.a.smithi019.stdout: self._run(expiration_interval) 2024-09-19T08:43:00.246 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:43:00.246 INFO:journalctl@ceph.mon.a.smithi019.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:43:00.246 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:43:00.246 INFO:journalctl@ceph.mon.a.smithi019.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:43:00.246 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:43:00.246 INFO:journalctl@ceph.mon.a.smithi019.stdout: s = self.context.wrap_socket( 2024-09-19T08:43:00.246 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:43:00.247 INFO:journalctl@ceph.mon.a.smithi019.stdout: return self.sslsocket_class._create( 2024-09-19T08:43:00.247 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:43:00.247 INFO:journalctl@ceph.mon.a.smithi019.stdout: self.do_handshake() 2024-09-19T08:43:00.247 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:43:00.247 INFO:journalctl@ceph.mon.a.smithi019.stdout: self._sslobj.do_handshake() 2024-09-19T08:43:00.247 INFO:journalctl@ceph.mon.a.smithi019.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:43:00.247 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:00 smithi019 ceph-mon[30976]: [19/Sep/2024:08:42:59] ENGINE Serving on http://172.21.15.19:8765 2024-09-19T08:43:00.247 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:00 smithi019 ceph-mon[30976]: [19/Sep/2024:08:42:59] ENGINE Bus STARTED 2024-09-19T08:43:00.247 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:00 smithi019 ceph-mon[30976]: from='mgr.14118 172.21.15.19:0/2034466589' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:43:00.820 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-19T08:43:00.820 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.889+0000 7f548c8c6640 1 Processor -- start 2024-09-19T08:43:00.820 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.889+0000 7f548c8c6640 1 -- start start 2024-09-19T08:43:00.820 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.890+0000 7f548c8c6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5488108200 0x7f548810a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:00.820 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.890+0000 7f548c8c6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f548807be00 con 0x7f5488108200 2024-09-19T08:43:00.820 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.890+0000 7f548659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5488108200 0x7f548810a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:00.820 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.890+0000 7f548659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5488108200 0x7f548810a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45636/0 (socket says 172.21.15.19:45636) 2024-09-19T08:43:00.820 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.890+0000 7f548659c640 1 -- 172.21.15.19:0/3092626221 learned_addr learned my addr 172.21.15.19:0/3092626221 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:43:00.821 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.890+0000 7f548659c640 1 -- 172.21.15.19:0/3092626221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f548810ab30 con 0x7f5488108200 2024-09-19T08:43:00.821 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.891+0000 7f548659c640 1 --2- 172.21.15.19:0/3092626221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5488108200 0x7f548810a5f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5478009820 tx=0x7f547802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b05eec5d90d6d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:00.821 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.891+0000 7f5485d9b640 1 -- 172.21.15.19:0/3092626221 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5478037070 con 0x7f5488108200 2024-09-19T08:43:00.821 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.891+0000 7f5485d9b640 1 -- 172.21.15.19:0/3092626221 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5478032900 con 0x7f5488108200 2024-09-19T08:43:00.821 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.891+0000 7f5485d9b640 1 -- 172.21.15.19:0/3092626221 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5478030850 con 0x7f5488108200 2024-09-19T08:43:00.821 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.892+0000 7f548c8c6640 1 -- 172.21.15.19:0/3092626221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5488108200 msgr2=0x7f548810a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:00.821 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.892+0000 7f548c8c6640 1 --2- 172.21.15.19:0/3092626221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5488108200 0x7f548810a5f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5478009820 tx=0x7f547802a270 comp rx=0 tx=0).stop 2024-09-19T08:43:00.821 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.892+0000 7f548c8c6640 1 -- 172.21.15.19:0/3092626221 shutdown_connections 2024-09-19T08:43:00.821 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.892+0000 7f548c8c6640 1 --2- 172.21.15.19:0/3092626221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5488108200 0x7f548810a5f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:00.821 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.892+0000 7f548c8c6640 1 -- 172.21.15.19:0/3092626221 >> 172.21.15.19:0/3092626221 conn(0x7f5488101da0 msgr2=0x7f54881041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:00.821 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.892+0000 7f548c8c6640 1 -- 172.21.15.19:0/3092626221 shutdown_connections 2024-09-19T08:43:00.821 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.892+0000 7f548c8c6640 1 -- 172.21.15.19:0/3092626221 wait complete. 2024-09-19T08:43:00.821 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.892+0000 7f548c8c6640 1 Processor -- start 2024-09-19T08:43:00.822 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.893+0000 7f548c8c6640 1 -- start start 2024-09-19T08:43:00.822 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.893+0000 7f548c8c6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5488108200 0x7f548819b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:00.822 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.893+0000 7f548c8c6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f548810bab0 con 0x7f5488108200 2024-09-19T08:43:00.822 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.893+0000 7f548659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5488108200 0x7f548819b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:00.822 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.893+0000 7f548659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5488108200 0x7f548819b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45640/0 (socket says 172.21.15.19:45640) 2024-09-19T08:43:00.822 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.893+0000 7f548659c640 1 -- 172.21.15.19:0/1794983856 learned_addr learned my addr 172.21.15.19:0/1794983856 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:43:00.822 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.893+0000 7f548659c640 1 -- 172.21.15.19:0/1794983856 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f548819bc30 con 0x7f5488108200 2024-09-19T08:43:00.822 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.893+0000 7f548659c640 1 --2- 172.21.15.19:0/1794983856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5488108200 0x7f548819b6f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5478031000 tx=0x7f54780326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:00.822 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.894+0000 7f547f7fe640 1 -- 172.21.15.19:0/1794983856 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5478042070 con 0x7f5488108200 2024-09-19T08:43:00.822 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.894+0000 7f547f7fe640 1 -- 172.21.15.19:0/1794983856 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5478032be0 con 0x7f5488108200 2024-09-19T08:43:00.822 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.894+0000 7f548c8c6640 1 -- 172.21.15.19:0/1794983856 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f548819bec0 con 0x7f5488108200 2024-09-19T08:43:00.822 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.894+0000 7f547f7fe640 1 -- 172.21.15.19:0/1794983856 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5478037040 con 0x7f5488108200 2024-09-19T08:43:00.822 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.894+0000 7f548c8c6640 1 -- 172.21.15.19:0/1794983856 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f548819ebb0 con 0x7f5488108200 2024-09-19T08:43:00.823 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.895+0000 7f547f7fe640 1 -- 172.21.15.19:0/1794983856 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f5478045070 con 0x7f5488108200 2024-09-19T08:43:00.823 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.895+0000 7f548c8c6640 1 -- 172.21.15.19:0/1794983856 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5488108660 con 0x7f5488108200 2024-09-19T08:43:00.823 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.895+0000 7f547f7fe640 1 --2- 172.21.15.19:0/1794983856 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f54740391b0 0x7f547403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:00.823 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.895+0000 7f547f7fe640 1 -- 172.21.15.19:0/1794983856 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f547806c2f0 con 0x7f5488108200 2024-09-19T08:43:00.823 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.895+0000 7f547ffff640 1 --2- 172.21.15.19:0/1794983856 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f54740391b0 0x7f547403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:00.823 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.896+0000 7f547ffff640 1 --2- 172.21.15.19:0/1794983856 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f54740391b0 0x7f547403b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f54700098c0 tx=0x7f5470006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:00.823 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:42:59.900+0000 7f547f7fe640 1 -- 172.21.15.19:0/1794983856 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5478042210 con 0x7f5488108200 2024-09-19T08:43:00.823 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:00.080+0000 7f548c8c6640 1 -- 172.21.15.19:0/1794983856 --> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f54881030a0 con 0x7f54740391b0 2024-09-19T08:43:00.823 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:00.081+0000 7f547f7fe640 1 -- 172.21.15.19:0/1794983856 <== mgr.14118 v2:172.21.15.19:6800/4266644067 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f54881030a0 con 0x7f54740391b0 2024-09-19T08:43:00.823 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:00.083+0000 7f548c8c6640 1 -- 172.21.15.19:0/1794983856 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f54740391b0 msgr2=0x7f547403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:00.823 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:00.083+0000 7f548c8c6640 1 --2- 172.21.15.19:0/1794983856 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f54740391b0 0x7f547403b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f54700098c0 tx=0x7f5470006db0 comp rx=0 tx=0).stop 2024-09-19T08:43:00.823 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:00.083+0000 7f548c8c6640 1 -- 172.21.15.19:0/1794983856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5488108200 msgr2=0x7f548819b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:00.823 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:00.083+0000 7f548c8c6640 1 --2- 172.21.15.19:0/1794983856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5488108200 0x7f548819b6f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5478031000 tx=0x7f54780326e0 comp rx=0 tx=0).stop 2024-09-19T08:43:00.824 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:00.083+0000 7f548c8c6640 1 -- 172.21.15.19:0/1794983856 shutdown_connections 2024-09-19T08:43:00.824 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:00.083+0000 7f548c8c6640 1 --2- 172.21.15.19:0/1794983856 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f54740391b0 0x7f547403b670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:00.824 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:00.083+0000 7f548c8c6640 1 --2- 172.21.15.19:0/1794983856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5488108200 0x7f548819b6f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:00.824 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:00.083+0000 7f548c8c6640 1 -- 172.21.15.19:0/1794983856 >> 172.21.15.19:0/1794983856 conn(0x7f5488101da0 msgr2=0x7f5488102990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:00.824 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:00.083+0000 7f548c8c6640 1 -- 172.21.15.19:0/1794983856 shutdown_connections 2024-09-19T08:43:00.824 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:00.083+0000 7f548c8c6640 1 -- 172.21.15.19:0/1794983856 wait complete. 2024-09-19T08:43:00.824 INFO:teuthology.orchestra.run.smithi019.stdout:Generating ssh key... 2024-09-19T08:43:01.433 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:01 smithi019 ceph-mon[30976]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:43:01.821 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:01 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: Generating public/private rsa key pair. 2024-09-19T08:43:01.821 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:01 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: Your identification has been saved in /tmp/tmp10ikfxsz/key 2024-09-19T08:43:01.821 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:01 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: Your public key has been saved in /tmp/tmp10ikfxsz/key.pub 2024-09-19T08:43:01.822 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:01 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: The key fingerprint is: 2024-09-19T08:43:01.822 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:01 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: SHA256:hCnpK+V+9KmnxzI5ZKTOHIthwokbMUnoIfGsVND/fg4 ceph-f26c9d84-7662-11ef-bceb-c7b262605968 2024-09-19T08:43:01.822 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:01 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: The key's randomart image is: 2024-09-19T08:43:01.822 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:01 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: +---[RSA 3072]----+ 2024-09-19T08:43:01.822 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:01 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: |ooo. | 2024-09-19T08:43:01.822 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:01 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: |o=.. . o | 2024-09-19T08:43:01.822 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:01 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: |+o+ + o . | 2024-09-19T08:43:01.822 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:01 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: |=o . o.. | 2024-09-19T08:43:01.822 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:01 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: |+o. oo. S | 2024-09-19T08:43:01.822 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:01 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: |+oooo.+. | 2024-09-19T08:43:01.822 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:01 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: | =.*o*.E . | 2024-09-19T08:43:01.822 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:01 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: |. .o= *.B. | 2024-09-19T08:43:01.823 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:01 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: | ..oOo. | 2024-09-19T08:43:01.823 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:01 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: +----[SHA256]-----+ 2024-09-19T08:43:02.107 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.244+0000 7f6b178e7640 1 Processor -- start 2024-09-19T08:43:02.107 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.244+0000 7f6b178e7640 1 -- start start 2024-09-19T08:43:02.107 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.244+0000 7f6b178e7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b101065d0 0x7f6b101069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:02.107 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.244+0000 7f6b178e7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6b10106fa0 con 0x7f6b101065d0 2024-09-19T08:43:02.107 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.245+0000 7f6b15683640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b101065d0 0x7f6b101069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:02.107 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.245+0000 7f6b15683640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b101065d0 0x7f6b101069d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45656/0 (socket says 172.21.15.19:45656) 2024-09-19T08:43:02.107 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.245+0000 7f6b15683640 1 -- 172.21.15.19:0/4166015282 learned_addr learned my addr 172.21.15.19:0/4166015282 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:43:02.108 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.245+0000 7f6b15683640 1 -- 172.21.15.19:0/4166015282 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b101077d0 con 0x7f6b101065d0 2024-09-19T08:43:02.108 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.246+0000 7f6b15683640 1 --2- 172.21.15.19:0/4166015282 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b101065d0 0x7f6b101069d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c009820 tx=0x7f6b0c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcdee1b7a5f23cb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:02.108 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.247+0000 7f6b07fff640 1 -- 172.21.15.19:0/4166015282 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b0c037070 con 0x7f6b101065d0 2024-09-19T08:43:02.108 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.247+0000 7f6b07fff640 1 -- 172.21.15.19:0/4166015282 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6b0c032900 con 0x7f6b101065d0 2024-09-19T08:43:02.108 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.248+0000 7f6b07fff640 1 -- 172.21.15.19:0/4166015282 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b0c030850 con 0x7f6b101065d0 2024-09-19T08:43:02.108 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.248+0000 7f6b178e7640 1 -- 172.21.15.19:0/4166015282 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b101065d0 msgr2=0x7f6b101069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:02.108 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.248+0000 7f6b178e7640 1 --2- 172.21.15.19:0/4166015282 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b101065d0 0x7f6b101069d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c009820 tx=0x7f6b0c02a270 comp rx=0 tx=0).stop 2024-09-19T08:43:02.108 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.248+0000 7f6b178e7640 1 -- 172.21.15.19:0/4166015282 shutdown_connections 2024-09-19T08:43:02.108 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.248+0000 7f6b178e7640 1 --2- 172.21.15.19:0/4166015282 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b101065d0 0x7f6b101069d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:02.108 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.248+0000 7f6b178e7640 1 -- 172.21.15.19:0/4166015282 >> 172.21.15.19:0/4166015282 conn(0x7f6b10101da0 msgr2=0x7f6b101041c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:02.108 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.248+0000 7f6b178e7640 1 -- 172.21.15.19:0/4166015282 shutdown_connections 2024-09-19T08:43:02.108 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.248+0000 7f6b178e7640 1 -- 172.21.15.19:0/4166015282 wait complete. 2024-09-19T08:43:02.109 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.249+0000 7f6b178e7640 1 Processor -- start 2024-09-19T08:43:02.109 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.249+0000 7f6b178e7640 1 -- start start 2024-09-19T08:43:02.109 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.249+0000 7f6b178e7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b101065d0 0x7f6b10191800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:02.109 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.249+0000 7f6b178e7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6b1010ab80 con 0x7f6b101065d0 2024-09-19T08:43:02.109 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.249+0000 7f6b15683640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b101065d0 0x7f6b10191800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:02.109 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.249+0000 7f6b15683640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b101065d0 0x7f6b10191800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45664/0 (socket says 172.21.15.19:45664) 2024-09-19T08:43:02.109 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.249+0000 7f6b15683640 1 -- 172.21.15.19:0/720173799 learned_addr learned my addr 172.21.15.19:0/720173799 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:43:02.109 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.250+0000 7f6b15683640 1 -- 172.21.15.19:0/720173799 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b10191d40 con 0x7f6b101065d0 2024-09-19T08:43:02.109 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.250+0000 7f6b15683640 1 --2- 172.21.15.19:0/720173799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b101065d0 0x7f6b10191800 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c0097f0 tx=0x7f6b0c030dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:02.109 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.250+0000 7f6b067fc640 1 -- 172.21.15.19:0/720173799 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b0c042070 con 0x7f6b101065d0 2024-09-19T08:43:02.109 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.250+0000 7f6b067fc640 1 -- 172.21.15.19:0/720173799 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6b0c032be0 con 0x7f6b101065d0 2024-09-19T08:43:02.109 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.250+0000 7f6b178e7640 1 -- 172.21.15.19:0/720173799 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b1018ff30 con 0x7f6b101065d0 2024-09-19T08:43:02.109 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.250+0000 7f6b067fc640 1 -- 172.21.15.19:0/720173799 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b0c037040 con 0x7f6b101065d0 2024-09-19T08:43:02.109 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.250+0000 7f6b178e7640 1 -- 172.21.15.19:0/720173799 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b10190470 con 0x7f6b101065d0 2024-09-19T08:43:02.110 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.251+0000 7f6b067fc640 1 -- 172.21.15.19:0/720173799 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f6b0c045070 con 0x7f6b101065d0 2024-09-19T08:43:02.110 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.251+0000 7f6b178e7640 1 -- 172.21.15.19:0/720173799 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b10106a50 con 0x7f6b101065d0 2024-09-19T08:43:02.110 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.251+0000 7f6b067fc640 1 --2- 172.21.15.19:0/720173799 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f6afc039200 0x7f6afc03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:02.110 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.251+0000 7f6b067fc640 1 -- 172.21.15.19:0/720173799 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6b0c06c0f0 con 0x7f6b101065d0 2024-09-19T08:43:02.110 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.251+0000 7f6b14e82640 1 --2- 172.21.15.19:0/720173799 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f6afc039200 0x7f6afc03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:02.110 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.252+0000 7f6b14e82640 1 --2- 172.21.15.19:0/720173799 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f6afc039200 0x7f6afc03b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6b000098c0 tx=0x7f6b00006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:02.110 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.256+0000 7f6b067fc640 1 -- 172.21.15.19:0/720173799 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6b0c045360 con 0x7f6b101065d0 2024-09-19T08:43:02.110 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.434+0000 7f6b178e7640 1 -- 172.21.15.19:0/720173799 --> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f6b10195630 con 0x7f6afc039200 2024-09-19T08:43:02.110 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.524+0000 7f6b067fc640 1 -- 172.21.15.19:0/720173799 <== mgr.14118 v2:172.21.15.19:6800/4266644067 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6b10195630 con 0x7f6afc039200 2024-09-19T08:43:02.110 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.526+0000 7f6b178e7640 1 -- 172.21.15.19:0/720173799 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f6afc039200 msgr2=0x7f6afc03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:02.110 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.526+0000 7f6b178e7640 1 --2- 172.21.15.19:0/720173799 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f6afc039200 0x7f6afc03b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6b000098c0 tx=0x7f6b00006db0 comp rx=0 tx=0).stop 2024-09-19T08:43:02.110 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.526+0000 7f6b178e7640 1 -- 172.21.15.19:0/720173799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b101065d0 msgr2=0x7f6b10191800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:02.110 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.526+0000 7f6b178e7640 1 --2- 172.21.15.19:0/720173799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b101065d0 0x7f6b10191800 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c0097f0 tx=0x7f6b0c030dd0 comp rx=0 tx=0).stop 2024-09-19T08:43:02.111 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.526+0000 7f6b178e7640 1 -- 172.21.15.19:0/720173799 shutdown_connections 2024-09-19T08:43:02.111 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.526+0000 7f6b178e7640 1 --2- 172.21.15.19:0/720173799 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f6afc039200 0x7f6afc03b6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:02.111 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.526+0000 7f6b178e7640 1 --2- 172.21.15.19:0/720173799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6b101065d0 0x7f6b10191800 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:02.111 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.526+0000 7f6b178e7640 1 -- 172.21.15.19:0/720173799 >> 172.21.15.19:0/720173799 conn(0x7f6b10101da0 msgr2=0x7f6b10102d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:02.111 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.526+0000 7f6b178e7640 1 -- 172.21.15.19:0/720173799 shutdown_connections 2024-09-19T08:43:02.111 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:01.526+0000 7f6b178e7640 1 -- 172.21.15.19:0/720173799 wait complete. 2024-09-19T08:43:02.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:02 smithi019 ceph-mon[30976]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:43:02.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:02 smithi019 ceph-mon[30976]: Generating ssh key... 2024-09-19T08:43:02.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:02 smithi019 ceph-mon[30976]: from='mgr.14118 172.21.15.19:0/2034466589' entity='mgr.x' 2024-09-19T08:43:02.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:02 smithi019 ceph-mon[30976]: from='mgr.14118 172.21.15.19:0/2034466589' entity='mgr.x' 2024-09-19T08:43:03.325 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbxPw5mebZVdLuKRB/6k/ikm/VNDGI+IsxM+APD/Pkxq7EAK/2vi1vNfMGvK/RTO6ibxmPw989OpsicUmFUL1WMWn7EE9AuQNmIX3nsc8FtDfz5dGaxFEVF7ID2gf/nMzbO/Wt69aVgHAztYmjgEioxpvvmu8FuN6G5GnFA1hfVBFLAPwEP03EqONWQj/PbT9SkJVfe0OCL1+43RLgVg+hdjn0Y/LluhEM/XAGONV2bsXiWEonPWte6WtkPlDdg78K9KG4GZu6b5W1axKTYFen25L7CQOECbwv6hNknQsZ82KGdXUyi2hBBuo2F0WUjUNv0lqMCzGDO5oHg8iEYRGnG546TXqx5Ceq3SX2GWpM00DFFNM2j/OlrNesHxaqLvlwkQA0iZiyR6ez3K/83sPNYVRlrl8xomFxS8N0Y8I1CabknV6tX6S3yENCnfddG6sAVkBHIzPrr7+2OQ8ZmxhH0NbkMx3kLCrKHvb8YWAVvLxxdswFMtANq9yi/QxSU7E= ceph-f26c9d84-7662-11ef-bceb-c7b262605968 2024-09-19T08:43:03.325 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.498+0000 7fb5c9bf9640 1 Processor -- start 2024-09-19T08:43:03.326 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.498+0000 7fb5c9bf9640 1 -- start start 2024-09-19T08:43:03.326 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.498+0000 7fb5c9bf9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb5c4107720 0x7fb5c4107b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:03.326 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.498+0000 7fb5c9bf9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c41080f0 con 0x7fb5c4107720 2024-09-19T08:43:03.326 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.499+0000 7fb5c37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb5c4107720 0x7fb5c4107b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:03.326 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.499+0000 7fb5c37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb5c4107720 0x7fb5c4107b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45676/0 (socket says 172.21.15.19:45676) 2024-09-19T08:43:03.326 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.499+0000 7fb5c37fe640 1 -- 172.21.15.19:0/1637584237 learned_addr learned my addr 172.21.15.19:0/1637584237 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:43:03.326 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.499+0000 7fb5c37fe640 1 -- 172.21.15.19:0/1637584237 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c4108920 con 0x7fb5c4107720 2024-09-19T08:43:03.326 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.500+0000 7fb5c37fe640 1 --2- 172.21.15.19:0/1637584237 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb5c4107720 0x7fb5c4107b20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4009e80 tx=0x7fb5b402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7a7b2a966ea31aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:03.326 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.500+0000 7fb5c27fc640 1 -- 172.21.15.19:0/1637584237 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5b4036070 con 0x7fb5c4107720 2024-09-19T08:43:03.326 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.500+0000 7fb5c27fc640 1 -- 172.21.15.19:0/1637584237 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb5b40318c0 con 0x7fb5c4107720 2024-09-19T08:43:03.327 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.500+0000 7fb5c27fc640 1 -- 172.21.15.19:0/1637584237 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5b4007ab0 con 0x7fb5c4107720 2024-09-19T08:43:03.327 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.500+0000 7fb5c9bf9640 1 -- 172.21.15.19:0/1637584237 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb5c4107720 msgr2=0x7fb5c4107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:03.327 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.500+0000 7fb5c9bf9640 1 --2- 172.21.15.19:0/1637584237 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb5c4107720 0x7fb5c4107b20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4009e80 tx=0x7fb5b402a7a0 comp rx=0 tx=0).stop 2024-09-19T08:43:03.327 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.501+0000 7fb5c9bf9640 1 -- 172.21.15.19:0/1637584237 shutdown_connections 2024-09-19T08:43:03.327 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.501+0000 7fb5c9bf9640 1 --2- 172.21.15.19:0/1637584237 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb5c4107720 0x7fb5c4107b20 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:03.327 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.501+0000 7fb5c9bf9640 1 -- 172.21.15.19:0/1637584237 >> 172.21.15.19:0/1637584237 conn(0x7fb5c4102ed0 msgr2=0x7fb5c41052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:03.327 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.501+0000 7fb5c9bf9640 1 -- 172.21.15.19:0/1637584237 shutdown_connections 2024-09-19T08:43:03.327 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.501+0000 7fb5c9bf9640 1 -- 172.21.15.19:0/1637584237 wait complete. 2024-09-19T08:43:03.327 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.501+0000 7fb5c9bf9640 1 Processor -- start 2024-09-19T08:43:03.327 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.502+0000 7fb5c9bf9640 1 -- start start 2024-09-19T08:43:03.327 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.502+0000 7fb5c9bf9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb5c4107720 0x7fb5c407db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:03.327 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.502+0000 7fb5c9bf9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb5c410bcd0 con 0x7fb5c4107720 2024-09-19T08:43:03.327 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.502+0000 7fb5c37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb5c4107720 0x7fb5c407db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:03.328 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.502+0000 7fb5c37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb5c4107720 0x7fb5c407db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45686/0 (socket says 172.21.15.19:45686) 2024-09-19T08:43:03.328 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.502+0000 7fb5c37fe640 1 -- 172.21.15.19:0/3143571247 learned_addr learned my addr 172.21.15.19:0/3143571247 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:43:03.328 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.502+0000 7fb5c37fe640 1 -- 172.21.15.19:0/3143571247 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5c407e0d0 con 0x7fb5c4107720 2024-09-19T08:43:03.328 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.502+0000 7fb5c37fe640 1 --2- 172.21.15.19:0/3143571247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb5c4107720 0x7fb5c407db90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4007ce0 tx=0x7fb5b4031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:03.328 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.503+0000 7fb5c0ff9640 1 -- 172.21.15.19:0/3143571247 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5b4036050 con 0x7fb5c4107720 2024-09-19T08:43:03.328 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.503+0000 7fb5c9bf9640 1 -- 172.21.15.19:0/3143571247 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5c407c2c0 con 0x7fb5c4107720 2024-09-19T08:43:03.328 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.503+0000 7fb5c0ff9640 1 -- 172.21.15.19:0/3143571247 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb5b4042070 con 0x7fb5c4107720 2024-09-19T08:43:03.328 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.503+0000 7fb5c0ff9640 1 -- 172.21.15.19:0/3143571247 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb5b403d8a0 con 0x7fb5c4107720 2024-09-19T08:43:03.328 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.503+0000 7fb5c9bf9640 1 -- 172.21.15.19:0/3143571247 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5c407c800 con 0x7fb5c4107720 2024-09-19T08:43:03.328 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.504+0000 7fb5c0ff9640 1 -- 172.21.15.19:0/3143571247 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fb5b403b610 con 0x7fb5c4107720 2024-09-19T08:43:03.328 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.504+0000 7fb5c0ff9640 1 --2- 172.21.15.19:0/3143571247 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7fb5ac0391b0 0x7fb5ac03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:03.328 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.504+0000 7fb5c9bf9640 1 -- 172.21.15.19:0/3143571247 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5c4107ba0 con 0x7fb5c4107720 2024-09-19T08:43:03.329 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.504+0000 7fb5c0ff9640 1 -- 172.21.15.19:0/3143571247 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb5b4007e00 con 0x7fb5c4107720 2024-09-19T08:43:03.329 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.504+0000 7fb5c2ffd640 1 --2- 172.21.15.19:0/3143571247 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7fb5ac0391b0 0x7fb5ac03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:03.329 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.504+0000 7fb5c2ffd640 1 --2- 172.21.15.19:0/3143571247 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7fb5ac0391b0 0x7fb5ac03b670 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb5b80098c0 tx=0x7fb5b8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:03.329 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.509+0000 7fb5c0ff9640 1 -- 172.21.15.19:0/3143571247 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb5b4007310 con 0x7fb5c4107720 2024-09-19T08:43:03.329 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.687+0000 7fb5c9bf9640 1 -- 172.21.15.19:0/3143571247 --> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7fb5c407d150 con 0x7fb5ac0391b0 2024-09-19T08:43:03.329 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.688+0000 7fb5c0ff9640 1 -- 172.21.15.19:0/3143571247 <== mgr.14118 v2:172.21.15.19:6800/4266644067 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7fb5c407d150 con 0x7fb5ac0391b0 2024-09-19T08:43:03.329 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.690+0000 7fb5c9bf9640 1 -- 172.21.15.19:0/3143571247 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7fb5ac0391b0 msgr2=0x7fb5ac03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:03.329 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.690+0000 7fb5c9bf9640 1 --2- 172.21.15.19:0/3143571247 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7fb5ac0391b0 0x7fb5ac03b670 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fb5b80098c0 tx=0x7fb5b8006db0 comp rx=0 tx=0).stop 2024-09-19T08:43:03.329 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.690+0000 7fb5c9bf9640 1 -- 172.21.15.19:0/3143571247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb5c4107720 msgr2=0x7fb5c407db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:03.329 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.690+0000 7fb5c9bf9640 1 --2- 172.21.15.19:0/3143571247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb5c4107720 0x7fb5c407db90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fb5b4007ce0 tx=0x7fb5b4031ca0 comp rx=0 tx=0).stop 2024-09-19T08:43:03.329 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.690+0000 7fb5c9bf9640 1 -- 172.21.15.19:0/3143571247 shutdown_connections 2024-09-19T08:43:03.329 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.690+0000 7fb5c9bf9640 1 --2- 172.21.15.19:0/3143571247 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7fb5ac0391b0 0x7fb5ac03b670 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:03.329 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.690+0000 7fb5c9bf9640 1 --2- 172.21.15.19:0/3143571247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb5c4107720 0x7fb5c407db90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:03.330 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.690+0000 7fb5c9bf9640 1 -- 172.21.15.19:0/3143571247 >> 172.21.15.19:0/3143571247 conn(0x7fb5c4102ed0 msgr2=0x7fb5c4103a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:03.330 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.690+0000 7fb5c9bf9640 1 -- 172.21.15.19:0/3143571247 shutdown_connections 2024-09-19T08:43:03.330 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:02.690+0000 7fb5c9bf9640 1 -- 172.21.15.19:0/3143571247 wait complete. 2024-09-19T08:43:03.330 INFO:teuthology.orchestra.run.smithi019.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-19T08:43:03.330 INFO:teuthology.orchestra.run.smithi019.stdout:Adding key to root@localhost authorized_keys... 2024-09-19T08:43:03.330 INFO:teuthology.orchestra.run.smithi019.stdout:Adding host smithi019... 2024-09-19T08:43:03.938 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:03 smithi019 ceph-mon[30976]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:43:04.985 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:04 smithi019 ceph-mon[30976]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi019", "addr": "172.21.15.19", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:43:05.908 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:05 smithi019 ceph-mon[30976]: Deploying cephadm binary to smithi019 2024-09-19T08:43:08.448 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout Added host 'smithi019' with addr '172.21.15.19' 2024-09-19T08:43:08.448 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.745+0000 7f4bfa097640 1 Processor -- start 2024-09-19T08:43:08.448 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.745+0000 7f4bfa097640 1 -- start start 2024-09-19T08:43:08.449 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.745+0000 7f4bfa097640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf4108180 0x7f4bf410a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:08.449 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.745+0000 7f4bfa097640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf407be90 con 0x7f4bf4108180 2024-09-19T08:43:08.449 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.745+0000 7f4bf37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf4108180 0x7f4bf410a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:08.449 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.745+0000 7f4bf37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf4108180 0x7f4bf410a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45698/0 (socket says 172.21.15.19:45698) 2024-09-19T08:43:08.449 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.745+0000 7f4bf37fe640 1 -- 172.21.15.19:0/3004409165 learned_addr learned my addr 172.21.15.19:0/3004409165 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:43:08.449 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.746+0000 7f4bf37fe640 1 -- 172.21.15.19:0/3004409165 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bf410aab0 con 0x7f4bf4108180 2024-09-19T08:43:08.449 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.746+0000 7f4bf37fe640 1 --2- 172.21.15.19:0/3004409165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf4108180 0x7f4bf410a570 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4be4009820 tx=0x7f4be402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4d2a4700f243d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:08.449 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.746+0000 7f4bf2ffd640 1 -- 172.21.15.19:0/3004409165 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4be4037070 con 0x7f4bf4108180 2024-09-19T08:43:08.449 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.746+0000 7f4bf2ffd640 1 -- 172.21.15.19:0/3004409165 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4be4032900 con 0x7f4bf4108180 2024-09-19T08:43:08.449 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.746+0000 7f4bf2ffd640 1 -- 172.21.15.19:0/3004409165 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4be4030850 con 0x7f4bf4108180 2024-09-19T08:43:08.449 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.747+0000 7f4bfa097640 1 -- 172.21.15.19:0/3004409165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf4108180 msgr2=0x7f4bf410a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:08.449 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.747+0000 7f4bfa097640 1 --2- 172.21.15.19:0/3004409165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf4108180 0x7f4bf410a570 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4be4009820 tx=0x7f4be402a270 comp rx=0 tx=0).stop 2024-09-19T08:43:08.449 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.747+0000 7f4bfa097640 1 -- 172.21.15.19:0/3004409165 shutdown_connections 2024-09-19T08:43:08.450 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.747+0000 7f4bfa097640 1 --2- 172.21.15.19:0/3004409165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf4108180 0x7f4bf410a570 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:08.450 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.747+0000 7f4bfa097640 1 -- 172.21.15.19:0/3004409165 >> 172.21.15.19:0/3004409165 conn(0x7f4bf4101da0 msgr2=0x7f4bf41041c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:08.450 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.747+0000 7f4bfa097640 1 -- 172.21.15.19:0/3004409165 shutdown_connections 2024-09-19T08:43:08.450 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.747+0000 7f4bfa097640 1 -- 172.21.15.19:0/3004409165 wait complete. 2024-09-19T08:43:08.450 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.748+0000 7f4bfa097640 1 Processor -- start 2024-09-19T08:43:08.450 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.748+0000 7f4bfa097640 1 -- start start 2024-09-19T08:43:08.450 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.748+0000 7f4bfa097640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf4108180 0x7f4bf419b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:08.450 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.748+0000 7f4bfa097640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4bf410baf0 con 0x7f4bf4108180 2024-09-19T08:43:08.450 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.748+0000 7f4bf37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf4108180 0x7f4bf419b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:08.450 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.748+0000 7f4bf37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf4108180 0x7f4bf419b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45708/0 (socket says 172.21.15.19:45708) 2024-09-19T08:43:08.450 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.748+0000 7f4bf37fe640 1 -- 172.21.15.19:0/3991570344 learned_addr learned my addr 172.21.15.19:0/3991570344 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:43:08.450 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.748+0000 7f4bf37fe640 1 -- 172.21.15.19:0/3991570344 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bf419bbd0 con 0x7f4bf4108180 2024-09-19T08:43:08.450 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.749+0000 7f4bf37fe640 1 --2- 172.21.15.19:0/3991570344 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf4108180 0x7f4bf419b690 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4be40097f0 tx=0x7f4be4030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:08.451 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.749+0000 7f4bf17fa640 1 -- 172.21.15.19:0/3991570344 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4be4037040 con 0x7f4bf4108180 2024-09-19T08:43:08.451 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.749+0000 7f4bfa097640 1 -- 172.21.15.19:0/3991570344 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bf419be60 con 0x7f4bf4108180 2024-09-19T08:43:08.451 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.749+0000 7f4bf17fa640 1 -- 172.21.15.19:0/3991570344 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4be4040070 con 0x7f4bf4108180 2024-09-19T08:43:08.451 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.749+0000 7f4bf17fa640 1 -- 172.21.15.19:0/3991570344 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4be403a390 con 0x7f4bf4108180 2024-09-19T08:43:08.451 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.749+0000 7f4bfa097640 1 -- 172.21.15.19:0/3991570344 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bf419eb50 con 0x7f4bf4108180 2024-09-19T08:43:08.451 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.750+0000 7f4bf17fa640 1 -- 172.21.15.19:0/3991570344 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f4be403a6b0 con 0x7f4bf4108180 2024-09-19T08:43:08.451 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.750+0000 7f4bfa097640 1 -- 172.21.15.19:0/3991570344 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bf41085e0 con 0x7f4bf4108180 2024-09-19T08:43:08.451 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.750+0000 7f4bf17fa640 1 --2- 172.21.15.19:0/3991570344 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f4be00391b0 0x7f4be003b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:08.451 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.750+0000 7f4bf17fa640 1 -- 172.21.15.19:0/3991570344 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4be406c900 con 0x7f4bf4108180 2024-09-19T08:43:08.451 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.750+0000 7f4bebfff640 1 --2- 172.21.15.19:0/3991570344 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f4be00391b0 0x7f4be003b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:08.451 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.751+0000 7f4bebfff640 1 --2- 172.21.15.19:0/3991570344 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f4be00391b0 0x7f4be003b670 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc0098c0 tx=0x7f4bdc006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:08.451 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.755+0000 7f4bf17fa640 1 -- 172.21.15.19:0/3991570344 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4be4043c60 con 0x7f4bf4108180 2024-09-19T08:43:08.451 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:03.939+0000 7f4bfa097640 1 -- 172.21.15.19:0/3991570344 --> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi019", "addr": "172.21.15.19", "target": ["mon-mgr", ""]}) -- 0x7f4bf4103040 con 0x7f4be00391b0 2024-09-19T08:43:08.451 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:07.861+0000 7f4bf17fa640 1 -- 172.21.15.19:0/3991570344 <== mgr.14118 v2:172.21.15.19:6800/4266644067 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f4bf4103040 con 0x7f4be00391b0 2024-09-19T08:43:08.452 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:07.864+0000 7f4bfa097640 1 -- 172.21.15.19:0/3991570344 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f4be00391b0 msgr2=0x7f4be003b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:08.452 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:07.864+0000 7f4bfa097640 1 --2- 172.21.15.19:0/3991570344 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f4be00391b0 0x7f4be003b670 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc0098c0 tx=0x7f4bdc006db0 comp rx=0 tx=0).stop 2024-09-19T08:43:08.452 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:07.864+0000 7f4bfa097640 1 -- 172.21.15.19:0/3991570344 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf4108180 msgr2=0x7f4bf419b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:08.452 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:07.864+0000 7f4bfa097640 1 --2- 172.21.15.19:0/3991570344 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf4108180 0x7f4bf419b690 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4be40097f0 tx=0x7f4be4030d80 comp rx=0 tx=0).stop 2024-09-19T08:43:08.452 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:07.864+0000 7f4bfa097640 1 -- 172.21.15.19:0/3991570344 shutdown_connections 2024-09-19T08:43:08.452 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:07.864+0000 7f4bfa097640 1 --2- 172.21.15.19:0/3991570344 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f4be00391b0 0x7f4be003b670 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:08.452 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:07.864+0000 7f4bfa097640 1 --2- 172.21.15.19:0/3991570344 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4bf4108180 0x7f4bf419b690 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:08.452 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:07.864+0000 7f4bfa097640 1 -- 172.21.15.19:0/3991570344 >> 172.21.15.19:0/3991570344 conn(0x7f4bf4101da0 msgr2=0x7f4bf4102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:08.452 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:07.864+0000 7f4bfa097640 1 -- 172.21.15.19:0/3991570344 shutdown_connections 2024-09-19T08:43:08.452 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:07.864+0000 7f4bfa097640 1 -- 172.21.15.19:0/3991570344 wait complete. 2024-09-19T08:43:08.452 INFO:teuthology.orchestra.run.smithi019.stdout:Deploying unmanaged mon service... 2024-09-19T08:43:09.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:08 smithi019 ceph-mon[30976]: from='mgr.14118 172.21.15.19:0/2034466589' entity='mgr.x' 2024-09-19T08:43:09.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:08 smithi019 ceph-mon[30976]: Added host smithi019 2024-09-19T08:43:09.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:08 smithi019 ceph-mon[30976]: from='mgr.14118 172.21.15.19:0/2034466589' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:43:09.916 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-19T08:43:09.916 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.915+0000 7ffb32b50640 1 Processor -- start 2024-09-19T08:43:09.916 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.916+0000 7ffb32b50640 1 -- start start 2024-09-19T08:43:09.916 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.916+0000 7ffb32b50640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb2c105f90 0x7ffb2c106390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:09.916 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.916+0000 7ffb32b50640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ffb2c07be70 con 0x7ffb2c105f90 2024-09-19T08:43:09.916 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.916+0000 7ffb308ec640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb2c105f90 0x7ffb2c106390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:09.916 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.916+0000 7ffb308ec640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb2c105f90 0x7ffb2c106390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49552/0 (socket says 172.21.15.19:49552) 2024-09-19T08:43:09.916 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.916+0000 7ffb308ec640 1 -- 172.21.15.19:0/3858218367 learned_addr learned my addr 172.21.15.19:0/3858218367 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:43:09.916 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.916+0000 7ffb308ec640 1 -- 172.21.15.19:0/3858218367 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb2c1068d0 con 0x7ffb2c105f90 2024-09-19T08:43:09.916 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.917+0000 7ffb308ec640 1 --2- 172.21.15.19:0/3858218367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb2c105f90 0x7ffb2c106390 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffb20009820 tx=0x7ffb2002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a23cf6ae18c2d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:09.917 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.917+0000 7ffb2b7fe640 1 -- 172.21.15.19:0/3858218367 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb20037070 con 0x7ffb2c105f90 2024-09-19T08:43:09.917 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.918+0000 7ffb2b7fe640 1 -- 172.21.15.19:0/3858218367 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffb20032900 con 0x7ffb2c105f90 2024-09-19T08:43:09.917 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.918+0000 7ffb2b7fe640 1 -- 172.21.15.19:0/3858218367 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb20030850 con 0x7ffb2c105f90 2024-09-19T08:43:09.917 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.918+0000 7ffb32b50640 1 -- 172.21.15.19:0/3858218367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb2c105f90 msgr2=0x7ffb2c106390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:09.917 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.918+0000 7ffb32b50640 1 --2- 172.21.15.19:0/3858218367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb2c105f90 0x7ffb2c106390 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ffb20009820 tx=0x7ffb2002a270 comp rx=0 tx=0).stop 2024-09-19T08:43:09.917 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.918+0000 7ffb32b50640 1 -- 172.21.15.19:0/3858218367 shutdown_connections 2024-09-19T08:43:09.917 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.918+0000 7ffb32b50640 1 --2- 172.21.15.19:0/3858218367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb2c105f90 0x7ffb2c106390 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:09.917 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.918+0000 7ffb32b50640 1 -- 172.21.15.19:0/3858218367 >> 172.21.15.19:0/3858218367 conn(0x7ffb2c101da0 msgr2=0x7ffb2c1041c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:09.917 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.918+0000 7ffb32b50640 1 -- 172.21.15.19:0/3858218367 shutdown_connections 2024-09-19T08:43:09.917 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.918+0000 7ffb32b50640 1 -- 172.21.15.19:0/3858218367 wait complete. 2024-09-19T08:43:09.917 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.919+0000 7ffb32b50640 1 Processor -- start 2024-09-19T08:43:09.917 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.919+0000 7ffb32b50640 1 -- start start 2024-09-19T08:43:09.918 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.919+0000 7ffb32b50640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb2c105f90 0x7ffb2c19d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:09.918 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.919+0000 7ffb32b50640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ffb2c1079d0 con 0x7ffb2c105f90 2024-09-19T08:43:09.918 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.919+0000 7ffb308ec640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb2c105f90 0x7ffb2c19d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:09.918 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.919+0000 7ffb308ec640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb2c105f90 0x7ffb2c19d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49556/0 (socket says 172.21.15.19:49556) 2024-09-19T08:43:09.918 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.919+0000 7ffb308ec640 1 -- 172.21.15.19:0/1636807799 learned_addr learned my addr 172.21.15.19:0/1636807799 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:43:09.918 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.919+0000 7ffb308ec640 1 -- 172.21.15.19:0/1636807799 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb2c19ddf0 con 0x7ffb2c105f90 2024-09-19T08:43:09.918 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.920+0000 7ffb308ec640 1 --2- 172.21.15.19:0/1636807799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb2c105f90 0x7ffb2c19d8b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ffb20032ce0 tx=0x7ffb20032d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:09.918 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.920+0000 7ffb29ffb640 1 -- 172.21.15.19:0/1636807799 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb20042070 con 0x7ffb2c105f90 2024-09-19T08:43:09.918 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.920+0000 7ffb29ffb640 1 -- 172.21.15.19:0/1636807799 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ffb200308c0 con 0x7ffb2c105f90 2024-09-19T08:43:09.918 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.920+0000 7ffb32b50640 1 -- 172.21.15.19:0/1636807799 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb2c19e080 con 0x7ffb2c105f90 2024-09-19T08:43:09.918 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.920+0000 7ffb29ffb640 1 -- 172.21.15.19:0/1636807799 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb20037040 con 0x7ffb2c105f90 2024-09-19T08:43:09.918 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.920+0000 7ffb32b50640 1 -- 172.21.15.19:0/1636807799 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb2c1a0d70 con 0x7ffb2c105f90 2024-09-19T08:43:09.918 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.921+0000 7ffb29ffb640 1 -- 172.21.15.19:0/1636807799 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7ffb20045070 con 0x7ffb2c105f90 2024-09-19T08:43:09.919 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.921+0000 7ffb32b50640 1 -- 172.21.15.19:0/1636807799 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb2c106390 con 0x7ffb2c105f90 2024-09-19T08:43:09.919 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.921+0000 7ffb29ffb640 1 --2- 172.21.15.19:0/1636807799 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7ffb1c039200 0x7ffb1c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:09.919 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.921+0000 7ffb29ffb640 1 -- 172.21.15.19:0/1636807799 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ffb2006c350 con 0x7ffb2c105f90 2024-09-19T08:43:09.919 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.921+0000 7ffb2bfff640 1 --2- 172.21.15.19:0/1636807799 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7ffb1c039200 0x7ffb1c03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:09.919 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.922+0000 7ffb2bfff640 1 --2- 172.21.15.19:0/1636807799 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7ffb1c039200 0x7ffb1c03b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffb180098c0 tx=0x7ffb18006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:09.919 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:08.926+0000 7ffb29ffb640 1 -- 172.21.15.19:0/1636807799 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffb20045520 con 0x7ffb2c105f90 2024-09-19T08:43:09.919 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:09.132+0000 7ffb32b50640 1 -- 172.21.15.19:0/1636807799 --> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7ffb2c02dab0 con 0x7ffb1c039200 2024-09-19T08:43:09.919 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:09.137+0000 7ffb29ffb640 1 -- 172.21.15.19:0/1636807799 <== mgr.14118 v2:172.21.15.19:6800/4266644067 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7ffb2c02dab0 con 0x7ffb1c039200 2024-09-19T08:43:09.919 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:09.139+0000 7ffb32b50640 1 -- 172.21.15.19:0/1636807799 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7ffb1c039200 msgr2=0x7ffb1c03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:09.919 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:09.139+0000 7ffb32b50640 1 --2- 172.21.15.19:0/1636807799 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7ffb1c039200 0x7ffb1c03b6c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffb180098c0 tx=0x7ffb18006db0 comp rx=0 tx=0).stop 2024-09-19T08:43:09.919 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:09.139+0000 7ffb32b50640 1 -- 172.21.15.19:0/1636807799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb2c105f90 msgr2=0x7ffb2c19d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:09.919 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:09.139+0000 7ffb32b50640 1 --2- 172.21.15.19:0/1636807799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb2c105f90 0x7ffb2c19d8b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ffb20032ce0 tx=0x7ffb20032d10 comp rx=0 tx=0).stop 2024-09-19T08:43:09.919 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:09.139+0000 7ffb32b50640 1 -- 172.21.15.19:0/1636807799 shutdown_connections 2024-09-19T08:43:09.920 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:09.139+0000 7ffb32b50640 1 --2- 172.21.15.19:0/1636807799 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7ffb1c039200 0x7ffb1c03b6c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:09.920 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:09.139+0000 7ffb32b50640 1 --2- 172.21.15.19:0/1636807799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb2c105f90 0x7ffb2c19d8b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:09.920 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:09.139+0000 7ffb32b50640 1 -- 172.21.15.19:0/1636807799 >> 172.21.15.19:0/1636807799 conn(0x7ffb2c101da0 msgr2=0x7ffb2c194530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:09.920 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:09.139+0000 7ffb32b50640 1 -- 172.21.15.19:0/1636807799 shutdown_connections 2024-09-19T08:43:09.920 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:09.139+0000 7ffb32b50640 1 -- 172.21.15.19:0/1636807799 wait complete. 2024-09-19T08:43:09.920 INFO:teuthology.orchestra.run.smithi019.stdout:Deploying unmanaged mgr service... 2024-09-19T08:43:10.227 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:10 smithi019 ceph-mon[30976]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:43:10.227 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:10 smithi019 ceph-mon[30976]: Saving service mon spec with placement count:5 2024-09-19T08:43:10.227 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:10 smithi019 ceph-mon[30976]: from='mgr.14118 172.21.15.19:0/2034466589' entity='mgr.x' 2024-09-19T08:43:11.627 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:11 smithi019 ceph-mon[30976]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:43:11.627 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:11 smithi019 ceph-mon[30976]: Saving service mgr spec with placement count:2 2024-09-19T08:43:11.627 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:11 smithi019 ceph-mon[30976]: from='mgr.14118 172.21.15.19:0/2034466589' entity='mgr.x' 2024-09-19T08:43:12.011 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-19T08:43:12.011 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.312+0000 7fa6a3c3c640 1 Processor -- start 2024-09-19T08:43:12.011 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.312+0000 7fa6a3c3c640 1 -- start start 2024-09-19T08:43:12.011 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.312+0000 7fa6a3c3c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa69c1076e0 0x7fa69c107ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:12.012 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.312+0000 7fa6a3c3c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa69c1080b0 con 0x7fa69c1076e0 2024-09-19T08:43:12.012 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.313+0000 7fa6a19d8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa69c1076e0 0x7fa69c107ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:12.012 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.313+0000 7fa6a19d8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa69c1076e0 0x7fa69c107ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49558/0 (socket says 172.21.15.19:49558) 2024-09-19T08:43:12.012 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.313+0000 7fa6a19d8640 1 -- 172.21.15.19:0/868875627 learned_addr learned my addr 172.21.15.19:0/868875627 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:43:12.012 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.313+0000 7fa6a19d8640 1 -- 172.21.15.19:0/868875627 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa69c1088e0 con 0x7fa69c1076e0 2024-09-19T08:43:12.012 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.314+0000 7fa6a19d8640 1 --2- 172.21.15.19:0/868875627 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa69c1076e0 0x7fa69c107ae0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa698009820 tx=0x7fa69802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac63f696fc5245d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:12.012 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.314+0000 7fa6a09d6640 1 -- 172.21.15.19:0/868875627 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa698037070 con 0x7fa69c1076e0 2024-09-19T08:43:12.012 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.314+0000 7fa6a09d6640 1 -- 172.21.15.19:0/868875627 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa698032900 con 0x7fa69c1076e0 2024-09-19T08:43:12.012 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.314+0000 7fa6a09d6640 1 -- 172.21.15.19:0/868875627 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa698030850 con 0x7fa69c1076e0 2024-09-19T08:43:12.012 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.314+0000 7fa6a3c3c640 1 -- 172.21.15.19:0/868875627 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa69c1076e0 msgr2=0x7fa69c107ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:12.012 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.314+0000 7fa6a3c3c640 1 --2- 172.21.15.19:0/868875627 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa69c1076e0 0x7fa69c107ae0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa698009820 tx=0x7fa69802a270 comp rx=0 tx=0).stop 2024-09-19T08:43:12.012 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.314+0000 7fa6a3c3c640 1 -- 172.21.15.19:0/868875627 shutdown_connections 2024-09-19T08:43:12.013 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.314+0000 7fa6a3c3c640 1 --2- 172.21.15.19:0/868875627 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa69c1076e0 0x7fa69c107ae0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:12.013 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.314+0000 7fa6a3c3c640 1 -- 172.21.15.19:0/868875627 >> 172.21.15.19:0/868875627 conn(0x7fa69c102e90 msgr2=0x7fa69c1052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:12.013 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.314+0000 7fa6a3c3c640 1 -- 172.21.15.19:0/868875627 shutdown_connections 2024-09-19T08:43:12.013 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.314+0000 7fa6a3c3c640 1 -- 172.21.15.19:0/868875627 wait complete. 2024-09-19T08:43:12.013 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.315+0000 7fa6a3c3c640 1 Processor -- start 2024-09-19T08:43:12.013 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.315+0000 7fa6a3c3c640 1 -- start start 2024-09-19T08:43:12.013 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.315+0000 7fa6a3c3c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa69c1076e0 0x7fa69c19d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:12.013 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.315+0000 7fa6a3c3c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa69c10bc90 con 0x7fa69c1076e0 2024-09-19T08:43:12.013 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.315+0000 7fa6a19d8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa69c1076e0 0x7fa69c19d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:12.013 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.315+0000 7fa6a19d8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa69c1076e0 0x7fa69c19d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49572/0 (socket says 172.21.15.19:49572) 2024-09-19T08:43:12.013 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.315+0000 7fa6a19d8640 1 -- 172.21.15.19:0/1139655167 learned_addr learned my addr 172.21.15.19:0/1139655167 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:43:12.013 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.316+0000 7fa6a19d8640 1 -- 172.21.15.19:0/1139655167 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa69c19dec0 con 0x7fa69c1076e0 2024-09-19T08:43:12.013 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.316+0000 7fa6a19d8640 1 --2- 172.21.15.19:0/1139655167 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa69c1076e0 0x7fa69c19d980 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa698009940 tx=0x7fa6980326e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:12.014 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.316+0000 7fa692ffd640 1 -- 172.21.15.19:0/1139655167 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa698042070 con 0x7fa69c1076e0 2024-09-19T08:43:12.014 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.316+0000 7fa692ffd640 1 -- 172.21.15.19:0/1139655167 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa698032be0 con 0x7fa69c1076e0 2024-09-19T08:43:12.014 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.316+0000 7fa692ffd640 1 -- 172.21.15.19:0/1139655167 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa698037040 con 0x7fa69c1076e0 2024-09-19T08:43:12.014 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.316+0000 7fa6a3c3c640 1 -- 172.21.15.19:0/1139655167 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa69c19e150 con 0x7fa69c1076e0 2024-09-19T08:43:12.014 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.316+0000 7fa6a3c3c640 1 -- 172.21.15.19:0/1139655167 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa69c1a0e40 con 0x7fa69c1076e0 2024-09-19T08:43:12.014 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.317+0000 7fa692ffd640 1 -- 172.21.15.19:0/1139655167 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fa698045070 con 0x7fa69c1076e0 2024-09-19T08:43:12.014 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.317+0000 7fa6a3c3c640 1 -- 172.21.15.19:0/1139655167 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa69c10be10 con 0x7fa69c1076e0 2024-09-19T08:43:12.014 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.317+0000 7fa692ffd640 1 --2- 172.21.15.19:0/1139655167 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7fa688039200 0x7fa68803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:12.014 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.317+0000 7fa692ffd640 1 -- 172.21.15.19:0/1139655167 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa69806c180 con 0x7fa69c1076e0 2024-09-19T08:43:12.014 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.317+0000 7fa6a11d7640 1 --2- 172.21.15.19:0/1139655167 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7fa688039200 0x7fa68803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:12.014 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.318+0000 7fa6a11d7640 1 --2- 172.21.15.19:0/1139655167 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7fa688039200 0x7fa68803b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa68c0098c0 tx=0x7fa68c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:12.014 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.322+0000 7fa692ffd640 1 -- 172.21.15.19:0/1139655167 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa69804b170 con 0x7fa69c1076e0 2024-09-19T08:43:12.014 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.519+0000 7fa6a3c3c640 1 -- 172.21.15.19:0/1139655167 --> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fa69c104100 con 0x7fa688039200 2024-09-19T08:43:12.014 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.523+0000 7fa692ffd640 1 -- 172.21.15.19:0/1139655167 <== mgr.14118 v2:172.21.15.19:6800/4266644067 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fa69c104100 con 0x7fa688039200 2024-09-19T08:43:12.015 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.525+0000 7fa6a3c3c640 1 -- 172.21.15.19:0/1139655167 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7fa688039200 msgr2=0x7fa68803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:12.015 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.525+0000 7fa6a3c3c640 1 --2- 172.21.15.19:0/1139655167 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7fa688039200 0x7fa68803b6c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa68c0098c0 tx=0x7fa68c006db0 comp rx=0 tx=0).stop 2024-09-19T08:43:12.015 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.525+0000 7fa6a3c3c640 1 -- 172.21.15.19:0/1139655167 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa69c1076e0 msgr2=0x7fa69c19d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:12.015 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.525+0000 7fa6a3c3c640 1 --2- 172.21.15.19:0/1139655167 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa69c1076e0 0x7fa69c19d980 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa698009940 tx=0x7fa6980326e0 comp rx=0 tx=0).stop 2024-09-19T08:43:12.015 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.525+0000 7fa6a3c3c640 1 -- 172.21.15.19:0/1139655167 shutdown_connections 2024-09-19T08:43:12.015 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.525+0000 7fa6a3c3c640 1 --2- 172.21.15.19:0/1139655167 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7fa688039200 0x7fa68803b6c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:12.015 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.525+0000 7fa6a3c3c640 1 --2- 172.21.15.19:0/1139655167 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa69c1076e0 0x7fa69c19d980 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:12.015 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.525+0000 7fa6a3c3c640 1 -- 172.21.15.19:0/1139655167 >> 172.21.15.19:0/1139655167 conn(0x7fa69c102e90 msgr2=0x7fa69c1039f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:12.015 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.525+0000 7fa6a3c3c640 1 -- 172.21.15.19:0/1139655167 shutdown_connections 2024-09-19T08:43:12.015 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:10.525+0000 7fa6a3c3c640 1 -- 172.21.15.19:0/1139655167 wait complete. 2024-09-19T08:43:12.941 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:12 smithi019 ceph-mon[30976]: from='mgr.14118 172.21.15.19:0/2034466589' entity='mgr.x' 2024-09-19T08:43:12.941 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:12 smithi019 ceph-mon[30976]: from='mgr.14118 172.21.15.19:0/2034466589' entity='mgr.x' 2024-09-19T08:43:12.941 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:12 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3339168544' entity='client.admin' 2024-09-19T08:43:13.887 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.416+0000 7f318a5a7640 1 Processor -- start 2024-09-19T08:43:13.887 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.417+0000 7f318a5a7640 1 -- start start 2024-09-19T08:43:13.887 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.417+0000 7f318a5a7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3184107720 0x7f3184107b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:13.887 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.417+0000 7f318a5a7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f31841080f0 con 0x7f3184107720 2024-09-19T08:43:13.887 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.417+0000 7f3183fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3184107720 0x7f3184107b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:13.888 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.417+0000 7f3183fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3184107720 0x7f3184107b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49586/0 (socket says 172.21.15.19:49586) 2024-09-19T08:43:13.888 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.417+0000 7f3183fff640 1 -- 172.21.15.19:0/1540720192 learned_addr learned my addr 172.21.15.19:0/1540720192 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:43:13.888 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.417+0000 7f3183fff640 1 -- 172.21.15.19:0/1540720192 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3184108920 con 0x7f3184107720 2024-09-19T08:43:13.888 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.418+0000 7f3183fff640 1 --2- 172.21.15.19:0/1540720192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3184107720 0x7f3184107b20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3174009820 tx=0x7f317402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=811c649ed9b7952 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:13.888 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.418+0000 7f3182ffd640 1 -- 172.21.15.19:0/1540720192 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3174037070 con 0x7f3184107720 2024-09-19T08:43:13.888 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.418+0000 7f3182ffd640 1 -- 172.21.15.19:0/1540720192 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3174032920 con 0x7f3184107720 2024-09-19T08:43:13.888 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.418+0000 7f3182ffd640 1 -- 172.21.15.19:0/1540720192 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3174030810 con 0x7f3184107720 2024-09-19T08:43:13.888 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.419+0000 7f318a5a7640 1 -- 172.21.15.19:0/1540720192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3184107720 msgr2=0x7f3184107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:13.888 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.419+0000 7f318a5a7640 1 --2- 172.21.15.19:0/1540720192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3184107720 0x7f3184107b20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3174009820 tx=0x7f317402a270 comp rx=0 tx=0).stop 2024-09-19T08:43:13.888 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.419+0000 7f318a5a7640 1 -- 172.21.15.19:0/1540720192 shutdown_connections 2024-09-19T08:43:13.888 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.419+0000 7f318a5a7640 1 --2- 172.21.15.19:0/1540720192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3184107720 0x7f3184107b20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:13.888 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.419+0000 7f318a5a7640 1 -- 172.21.15.19:0/1540720192 >> 172.21.15.19:0/1540720192 conn(0x7f3184102ed0 msgr2=0x7f31841052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:13.888 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.419+0000 7f318a5a7640 1 -- 172.21.15.19:0/1540720192 shutdown_connections 2024-09-19T08:43:13.889 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.419+0000 7f318a5a7640 1 -- 172.21.15.19:0/1540720192 wait complete. 2024-09-19T08:43:13.889 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.419+0000 7f318a5a7640 1 Processor -- start 2024-09-19T08:43:13.889 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.419+0000 7f318a5a7640 1 -- start start 2024-09-19T08:43:13.889 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.420+0000 7f318a5a7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3184107720 0x7f318419b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:13.889 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.420+0000 7f318a5a7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f318410bcd0 con 0x7f3184107720 2024-09-19T08:43:13.889 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.420+0000 7f3183fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3184107720 0x7f318419b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:13.889 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.420+0000 7f3183fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3184107720 0x7f318419b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49594/0 (socket says 172.21.15.19:49594) 2024-09-19T08:43:13.889 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.420+0000 7f3183fff640 1 -- 172.21.15.19:0/3339168544 learned_addr learned my addr 172.21.15.19:0/3339168544 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:43:13.889 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.420+0000 7f3183fff640 1 -- 172.21.15.19:0/3339168544 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f318419bc80 con 0x7f3184107720 2024-09-19T08:43:13.889 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.420+0000 7f3183fff640 1 --2- 172.21.15.19:0/3339168544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3184107720 0x7f318419b740 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3174030560 tx=0x7f3174032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:13.889 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.420+0000 7f31817fa640 1 -- 172.21.15.19:0/3339168544 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3174037040 con 0x7f3184107720 2024-09-19T08:43:13.889 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.421+0000 7f31817fa640 1 -- 172.21.15.19:0/3339168544 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3174040070 con 0x7f3184107720 2024-09-19T08:43:13.889 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.421+0000 7f318a5a7640 1 -- 172.21.15.19:0/3339168544 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f318419bf10 con 0x7f3184107720 2024-09-19T08:43:13.889 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.421+0000 7f31817fa640 1 -- 172.21.15.19:0/3339168544 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f317403a6d0 con 0x7f3184107720 2024-09-19T08:43:13.890 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.421+0000 7f318a5a7640 1 -- 172.21.15.19:0/3339168544 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f318419ec00 con 0x7f3184107720 2024-09-19T08:43:13.890 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.422+0000 7f318a5a7640 1 -- 172.21.15.19:0/3339168544 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3184107ba0 con 0x7f3184107720 2024-09-19T08:43:13.890 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.422+0000 7f31817fa640 1 -- 172.21.15.19:0/3339168544 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f317403bb20 con 0x7f3184107720 2024-09-19T08:43:13.890 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.422+0000 7f31817fa640 1 --2- 172.21.15.19:0/3339168544 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f316c039200 0x7f316c03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:13.890 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.422+0000 7f31817fa640 1 -- 172.21.15.19:0/3339168544 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f317406c7b0 con 0x7f3184107720 2024-09-19T08:43:13.890 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.422+0000 7f31837fe640 1 --2- 172.21.15.19:0/3339168544 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f316c039200 0x7f316c03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:13.890 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.423+0000 7f31837fe640 1 --2- 172.21.15.19:0/3339168544 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f316c039200 0x7f316c03b6c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f31780098c0 tx=0x7f3178006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:13.890 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.427+0000 7f31817fa640 1 -- 172.21.15.19:0/3339168544 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f31740328f0 con 0x7f3184107720 2024-09-19T08:43:13.890 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.629+0000 7f318a5a7640 1 -- 172.21.15.19:0/3339168544 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f318419f1f0 con 0x7f3184107720 2024-09-19T08:43:13.890 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.631+0000 7f31817fa640 1 -- 172.21.15.19:0/3339168544 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f317404a200 con 0x7f3184107720 2024-09-19T08:43:13.890 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.634+0000 7f318a5a7640 1 -- 172.21.15.19:0/3339168544 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f316c039200 msgr2=0x7f316c03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:13.890 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.634+0000 7f318a5a7640 1 --2- 172.21.15.19:0/3339168544 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f316c039200 0x7f316c03b6c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f31780098c0 tx=0x7f3178006db0 comp rx=0 tx=0).stop 2024-09-19T08:43:13.890 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.634+0000 7f318a5a7640 1 -- 172.21.15.19:0/3339168544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3184107720 msgr2=0x7f318419b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:13.890 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.634+0000 7f318a5a7640 1 --2- 172.21.15.19:0/3339168544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3184107720 0x7f318419b740 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3174030560 tx=0x7f3174032670 comp rx=0 tx=0).stop 2024-09-19T08:43:13.890 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.634+0000 7f318a5a7640 1 -- 172.21.15.19:0/3339168544 shutdown_connections 2024-09-19T08:43:13.891 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.634+0000 7f318a5a7640 1 --2- 172.21.15.19:0/3339168544 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f316c039200 0x7f316c03b6c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:13.891 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.634+0000 7f318a5a7640 1 --2- 172.21.15.19:0/3339168544 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3184107720 0x7f318419b740 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:13.891 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.634+0000 7f318a5a7640 1 -- 172.21.15.19:0/3339168544 >> 172.21.15.19:0/3339168544 conn(0x7f3184102ed0 msgr2=0x7f3184103ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:13.891 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.634+0000 7f318a5a7640 1 -- 172.21.15.19:0/3339168544 shutdown_connections 2024-09-19T08:43:13.891 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:12.634+0000 7f318a5a7640 1 -- 172.21.15.19:0/3339168544 wait complete. 2024-09-19T08:43:14.471 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:14 smithi019 ceph-mon[30976]: from='mgr.14118 172.21.15.19:0/2034466589' entity='mgr.x' 2024-09-19T08:43:15.119 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.258+0000 7fc9c2b9a640 1 Processor -- start 2024-09-19T08:43:15.119 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.258+0000 7fc9c2b9a640 1 -- start start 2024-09-19T08:43:15.119 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.258+0000 7fc9c2b9a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9bc1065d0 0x7fc9bc1069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:15.119 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.258+0000 7fc9c2b9a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc9bc106fa0 con 0x7fc9bc1065d0 2024-09-19T08:43:15.119 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.258+0000 7fc9c0936640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9bc1065d0 0x7fc9bc1069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:15.120 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.259+0000 7fc9c0936640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9bc1065d0 0x7fc9bc1069d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49596/0 (socket says 172.21.15.19:49596) 2024-09-19T08:43:15.120 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.259+0000 7fc9c0936640 1 -- 172.21.15.19:0/2371239132 learned_addr learned my addr 172.21.15.19:0/2371239132 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:43:15.120 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.259+0000 7fc9c0936640 1 -- 172.21.15.19:0/2371239132 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9bc1077d0 con 0x7fc9bc1065d0 2024-09-19T08:43:15.120 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.259+0000 7fc9c0936640 1 --2- 172.21.15.19:0/2371239132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9bc1065d0 0x7fc9bc1069d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac009820 tx=0x7fc9ac02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f05a5b35b7fda4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:15.120 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.260+0000 7fc9bb7fe640 1 -- 172.21.15.19:0/2371239132 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9ac037070 con 0x7fc9bc1065d0 2024-09-19T08:43:15.120 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.260+0000 7fc9bb7fe640 1 -- 172.21.15.19:0/2371239132 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9ac032920 con 0x7fc9bc1065d0 2024-09-19T08:43:15.120 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.260+0000 7fc9bb7fe640 1 -- 172.21.15.19:0/2371239132 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9ac030810 con 0x7fc9bc1065d0 2024-09-19T08:43:15.120 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.260+0000 7fc9c2b9a640 1 -- 172.21.15.19:0/2371239132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9bc1065d0 msgr2=0x7fc9bc1069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:15.120 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.260+0000 7fc9c2b9a640 1 --2- 172.21.15.19:0/2371239132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9bc1065d0 0x7fc9bc1069d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac009820 tx=0x7fc9ac02a270 comp rx=0 tx=0).stop 2024-09-19T08:43:15.120 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.260+0000 7fc9c2b9a640 1 -- 172.21.15.19:0/2371239132 shutdown_connections 2024-09-19T08:43:15.120 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.260+0000 7fc9c2b9a640 1 --2- 172.21.15.19:0/2371239132 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9bc1065d0 0x7fc9bc1069d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:15.120 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.260+0000 7fc9c2b9a640 1 -- 172.21.15.19:0/2371239132 >> 172.21.15.19:0/2371239132 conn(0x7fc9bc101da0 msgr2=0x7fc9bc1041c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:15.120 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.260+0000 7fc9c2b9a640 1 -- 172.21.15.19:0/2371239132 shutdown_connections 2024-09-19T08:43:15.121 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.260+0000 7fc9c2b9a640 1 -- 172.21.15.19:0/2371239132 wait complete. 2024-09-19T08:43:15.121 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.261+0000 7fc9c2b9a640 1 Processor -- start 2024-09-19T08:43:15.121 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.261+0000 7fc9c2b9a640 1 -- start start 2024-09-19T08:43:15.121 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.261+0000 7fc9c2b9a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9bc1065d0 0x7fc9bc19b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:15.121 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.261+0000 7fc9c2b9a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc9bc10ab80 con 0x7fc9bc1065d0 2024-09-19T08:43:15.121 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.261+0000 7fc9c0936640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9bc1065d0 0x7fc9bc19b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:15.121 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.261+0000 7fc9c0936640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9bc1065d0 0x7fc9bc19b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49610/0 (socket says 172.21.15.19:49610) 2024-09-19T08:43:15.121 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.261+0000 7fc9c0936640 1 -- 172.21.15.19:0/52983539 learned_addr learned my addr 172.21.15.19:0/52983539 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:43:15.121 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.261+0000 7fc9c0936640 1 -- 172.21.15.19:0/52983539 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9bc19bc50 con 0x7fc9bc1065d0 2024-09-19T08:43:15.121 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.262+0000 7fc9c0936640 1 --2- 172.21.15.19:0/52983539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9bc1065d0 0x7fc9bc19b710 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0097f0 tx=0x7fc9ac0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:15.121 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.262+0000 7fc9b9ffb640 1 -- 172.21.15.19:0/52983539 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9ac037040 con 0x7fc9bc1065d0 2024-09-19T08:43:15.121 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.262+0000 7fc9b9ffb640 1 -- 172.21.15.19:0/52983539 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc9ac030cc0 con 0x7fc9bc1065d0 2024-09-19T08:43:15.121 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.262+0000 7fc9b9ffb640 1 -- 172.21.15.19:0/52983539 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9ac03a640 con 0x7fc9bc1065d0 2024-09-19T08:43:15.121 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.262+0000 7fc9c2b9a640 1 -- 172.21.15.19:0/52983539 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9bc19bee0 con 0x7fc9bc1065d0 2024-09-19T08:43:15.122 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.262+0000 7fc9c2b9a640 1 -- 172.21.15.19:0/52983539 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9bc19ebd0 con 0x7fc9bc1065d0 2024-09-19T08:43:15.122 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.263+0000 7fc9b9ffb640 1 -- 172.21.15.19:0/52983539 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fc9ac03b3f0 con 0x7fc9bc1065d0 2024-09-19T08:43:15.122 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.263+0000 7fc9c2b9a640 1 -- 172.21.15.19:0/52983539 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9bc10ad00 con 0x7fc9bc1065d0 2024-09-19T08:43:15.122 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.263+0000 7fc9b9ffb640 1 --2- 172.21.15.19:0/52983539 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7fc9a4039200 0x7fc9a403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:15.122 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.263+0000 7fc9b9ffb640 1 -- 172.21.15.19:0/52983539 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc9ac06c7a0 con 0x7fc9bc1065d0 2024-09-19T08:43:15.122 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.263+0000 7fc9bbfff640 1 --2- 172.21.15.19:0/52983539 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7fc9a4039200 0x7fc9a403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:15.122 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.264+0000 7fc9bbfff640 1 --2- 172.21.15.19:0/52983539 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7fc9a4039200 0x7fc9a403b6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc9b00098c0 tx=0x7fc9b0006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:15.122 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.268+0000 7fc9b9ffb640 1 -- 172.21.15.19:0/52983539 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc9ac042e10 con 0x7fc9bc1065d0 2024-09-19T08:43:15.122 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.471+0000 7fc9c2b9a640 1 -- 172.21.15.19:0/52983539 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fc9bc106a50 con 0x7fc9bc1065d0 2024-09-19T08:43:15.122 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.475+0000 7fc9b9ffb640 1 -- 172.21.15.19:0/52983539 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fc9ac0328c0 con 0x7fc9bc1065d0 2024-09-19T08:43:15.122 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.477+0000 7fc9c2b9a640 1 -- 172.21.15.19:0/52983539 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7fc9a4039200 msgr2=0x7fc9a403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:15.122 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.477+0000 7fc9c2b9a640 1 --2- 172.21.15.19:0/52983539 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7fc9a4039200 0x7fc9a403b6c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc9b00098c0 tx=0x7fc9b0006db0 comp rx=0 tx=0).stop 2024-09-19T08:43:15.122 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.477+0000 7fc9c2b9a640 1 -- 172.21.15.19:0/52983539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9bc1065d0 msgr2=0x7fc9bc19b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:15.123 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.477+0000 7fc9c2b9a640 1 --2- 172.21.15.19:0/52983539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9bc1065d0 0x7fc9bc19b710 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0097f0 tx=0x7fc9ac0327b0 comp rx=0 tx=0).stop 2024-09-19T08:43:15.123 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.477+0000 7fc9c2b9a640 1 -- 172.21.15.19:0/52983539 shutdown_connections 2024-09-19T08:43:15.123 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.477+0000 7fc9c2b9a640 1 --2- 172.21.15.19:0/52983539 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7fc9a4039200 0x7fc9a403b6c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:15.123 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.477+0000 7fc9c2b9a640 1 --2- 172.21.15.19:0/52983539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc9bc1065d0 0x7fc9bc19b710 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:15.123 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.477+0000 7fc9c2b9a640 1 -- 172.21.15.19:0/52983539 >> 172.21.15.19:0/52983539 conn(0x7fc9bc101da0 msgr2=0x7fc9bc102cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:15.123 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.477+0000 7fc9c2b9a640 1 -- 172.21.15.19:0/52983539 shutdown_connections 2024-09-19T08:43:15.123 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:14.477+0000 7fc9c2b9a640 1 -- 172.21.15.19:0/52983539 wait complete. 2024-09-19T08:43:15.123 INFO:teuthology.orchestra.run.smithi019.stdout:Enabling the dashboard module... 2024-09-19T08:43:15.794 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:15 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/52983539' entity='client.admin' 2024-09-19T08:43:17.021 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:16 smithi019 ceph-mon[30976]: from='mgr.14118 172.21.15.19:0/2034466589' entity='mgr.x' 2024-09-19T08:43:17.021 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:16 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1359954214' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-19T08:43:17.021 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:16 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: ignoring --setuser ceph since I am not root 2024-09-19T08:43:17.021 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:16 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: ignoring --setgroup ceph since I am not root 2024-09-19T08:43:17.021 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:16 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:43:16.807+0000 7f9b98c62040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T08:43:17.021 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:16 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:43:16.866+0000 7f9b98c62040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:43:17.021 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:17 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:43:17.021+0000 7f9b98c62040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:43:17.318 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:17 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:43:17.091+0000 7f9b98c62040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:43:17.318 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:17 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:43:17.246+0000 7f9b98c62040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:43:17.652 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:17 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:43:17.394+0000 7f9b98c62040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:43:17.707 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.555+0000 7fe17cc8d640 1 Processor -- start 2024-09-19T08:43:17.708 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.555+0000 7fe17cc8d640 1 -- start start 2024-09-19T08:43:17.708 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.555+0000 7fe17cc8d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe178108180 0x7fe17810a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:17.708 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.555+0000 7fe17cc8d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe17807be90 con 0x7fe178108180 2024-09-19T08:43:17.708 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.556+0000 7fe17659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe178108180 0x7fe17810a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:17.708 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.556+0000 7fe17659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe178108180 0x7fe17810a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38146/0 (socket says 172.21.15.19:38146) 2024-09-19T08:43:17.708 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.556+0000 7fe17659c640 1 -- 172.21.15.19:0/4280160197 learned_addr learned my addr 172.21.15.19:0/4280160197 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:43:17.708 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.556+0000 7fe17659c640 1 -- 172.21.15.19:0/4280160197 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe17810aab0 con 0x7fe178108180 2024-09-19T08:43:17.708 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.557+0000 7fe17659c640 1 --2- 172.21.15.19:0/4280160197 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe178108180 0x7fe17810a570 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe168009820 tx=0x7fe16802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a4a12c4810456eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:17.708 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.557+0000 7fe175d9b640 1 -- 172.21.15.19:0/4280160197 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe168037070 con 0x7fe178108180 2024-09-19T08:43:17.708 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.557+0000 7fe175d9b640 1 -- 172.21.15.19:0/4280160197 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe168032920 con 0x7fe178108180 2024-09-19T08:43:17.709 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.557+0000 7fe175d9b640 1 -- 172.21.15.19:0/4280160197 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe168030810 con 0x7fe178108180 2024-09-19T08:43:17.709 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.557+0000 7fe17cc8d640 1 -- 172.21.15.19:0/4280160197 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe178108180 msgr2=0x7fe17810a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:17.709 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.557+0000 7fe17cc8d640 1 --2- 172.21.15.19:0/4280160197 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe178108180 0x7fe17810a570 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe168009820 tx=0x7fe16802a270 comp rx=0 tx=0).stop 2024-09-19T08:43:17.709 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.557+0000 7fe17cc8d640 1 -- 172.21.15.19:0/4280160197 shutdown_connections 2024-09-19T08:43:17.709 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.557+0000 7fe17cc8d640 1 --2- 172.21.15.19:0/4280160197 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe178108180 0x7fe17810a570 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:17.709 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.557+0000 7fe17cc8d640 1 -- 172.21.15.19:0/4280160197 >> 172.21.15.19:0/4280160197 conn(0x7fe178101da0 msgr2=0x7fe1781041c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:17.709 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.557+0000 7fe17cc8d640 1 -- 172.21.15.19:0/4280160197 shutdown_connections 2024-09-19T08:43:17.709 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.557+0000 7fe17cc8d640 1 -- 172.21.15.19:0/4280160197 wait complete. 2024-09-19T08:43:17.709 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.558+0000 7fe17cc8d640 1 Processor -- start 2024-09-19T08:43:17.709 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.558+0000 7fe17cc8d640 1 -- start start 2024-09-19T08:43:17.709 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.559+0000 7fe17cc8d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe178108180 0x7fe178107a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:17.709 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.559+0000 7fe17cc8d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe17810bb30 con 0x7fe178108180 2024-09-19T08:43:17.709 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.559+0000 7fe17659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe178108180 0x7fe178107a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:17.710 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.559+0000 7fe17659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe178108180 0x7fe178107a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38158/0 (socket says 172.21.15.19:38158) 2024-09-19T08:43:17.710 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.559+0000 7fe17659c640 1 -- 172.21.15.19:0/1359954214 learned_addr learned my addr 172.21.15.19:0/1359954214 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:43:17.710 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.559+0000 7fe17659c640 1 -- 172.21.15.19:0/1359954214 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe178107f40 con 0x7fe178108180 2024-09-19T08:43:17.710 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.559+0000 7fe17659c640 1 --2- 172.21.15.19:0/1359954214 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe178108180 0x7fe178107a00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe168030380 tx=0x7fe168032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:17.710 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.559+0000 7fe16ffff640 1 -- 172.21.15.19:0/1359954214 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe168037040 con 0x7fe178108180 2024-09-19T08:43:17.710 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.559+0000 7fe16ffff640 1 -- 172.21.15.19:0/1359954214 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe168040070 con 0x7fe178108180 2024-09-19T08:43:17.710 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.559+0000 7fe17cc8d640 1 -- 172.21.15.19:0/1359954214 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe178106130 con 0x7fe178108180 2024-09-19T08:43:17.710 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.559+0000 7fe16ffff640 1 -- 172.21.15.19:0/1359954214 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe16803a7b0 con 0x7fe178108180 2024-09-19T08:43:17.710 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.559+0000 7fe17cc8d640 1 -- 172.21.15.19:0/1359954214 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe178106670 con 0x7fe178108180 2024-09-19T08:43:17.710 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.561+0000 7fe16ffff640 1 -- 172.21.15.19:0/1359954214 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fe16803aa30 con 0x7fe178108180 2024-09-19T08:43:17.710 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.561+0000 7fe17cc8d640 1 -- 172.21.15.19:0/1359954214 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1781085e0 con 0x7fe178108180 2024-09-19T08:43:17.710 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.561+0000 7fe16ffff640 1 --2- 172.21.15.19:0/1359954214 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7fe1640391b0 0x7fe16403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:17.710 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.561+0000 7fe16ffff640 1 -- 172.21.15.19:0/1359954214 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe16806c900 con 0x7fe178108180 2024-09-19T08:43:17.711 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.561+0000 7fe16dd9b640 1 --2- 172.21.15.19:0/1359954214 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7fe1640391b0 0x7fe16403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:17.711 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.561+0000 7fe16dd9b640 1 --2- 172.21.15.19:0/1359954214 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7fe1640391b0 0x7fe16403b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe1600098c0 tx=0x7fe160006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:17.711 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.566+0000 7fe16ffff640 1 -- 172.21.15.19:0/1359954214 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe168044c70 con 0x7fe178108180 2024-09-19T08:43:17.711 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:15.794+0000 7fe17cc8d640 1 -- 172.21.15.19:0/1359954214 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fe178106e10 con 0x7fe178108180 2024-09-19T08:43:17.711 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:16.652+0000 7fe16ffff640 1 -- 172.21.15.19:0/1359954214 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fe168041270 con 0x7fe178108180 2024-09-19T08:43:17.711 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:16.654+0000 7fe16ffff640 1 -- 172.21.15.19:0/1359954214 <== mon.0 v2:172.21.15.19:3300/0 8 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7fe168045980 con 0x7fe178108180 2024-09-19T08:43:17.711 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:16.655+0000 7fe17cc8d640 1 -- 172.21.15.19:0/1359954214 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7fe1640391b0 msgr2=0x7fe16403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:17.711 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:16.655+0000 7fe17cc8d640 1 --2- 172.21.15.19:0/1359954214 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7fe1640391b0 0x7fe16403b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fe1600098c0 tx=0x7fe160006db0 comp rx=0 tx=0).stop 2024-09-19T08:43:17.711 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:16.655+0000 7fe17cc8d640 1 -- 172.21.15.19:0/1359954214 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe178108180 msgr2=0x7fe178107a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:17.711 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:16.655+0000 7fe17cc8d640 1 --2- 172.21.15.19:0/1359954214 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe178108180 0x7fe178107a00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe168030380 tx=0x7fe168032670 comp rx=0 tx=0).stop 2024-09-19T08:43:17.711 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:16.655+0000 7fe17cc8d640 1 -- 172.21.15.19:0/1359954214 shutdown_connections 2024-09-19T08:43:17.711 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:16.655+0000 7fe17cc8d640 1 --2- 172.21.15.19:0/1359954214 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7fe1640391b0 0x7fe16403b670 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:17.712 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:16.655+0000 7fe17cc8d640 1 --2- 172.21.15.19:0/1359954214 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe178108180 0x7fe178107a00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:17.712 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:16.655+0000 7fe17cc8d640 1 -- 172.21.15.19:0/1359954214 >> 172.21.15.19:0/1359954214 conn(0x7fe178101da0 msgr2=0x7fe178102930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:17.712 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:16.656+0000 7fe17cc8d640 1 -- 172.21.15.19:0/1359954214 shutdown_connections 2024-09-19T08:43:17.712 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:16.656+0000 7fe17cc8d640 1 -- 172.21.15.19:0/1359954214 wait complete. 2024-09-19T08:43:17.987 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:17 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1359954214' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-19T08:43:17.987 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:17 smithi019 ceph-mon[30976]: mgrmap e9: x(active, since 20s) 2024-09-19T08:43:17.988 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:17 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:43:17.727+0000 7f9b98c62040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:43:17.988 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:17 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:43:17.791+0000 7f9b98c62040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:43:18.319 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:17 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:43:17.989+0000 7f9b98c62040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:43:18.932 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:18 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1922957288' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T08:43:19.055 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:43:19.056 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-19T08:43:19.056 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T08:43:19.056 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T08:43:19.056 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T08:43:19.056 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:43:19.056 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.192+0000 7f4104dd1640 1 Processor -- start 2024-09-19T08:43:19.056 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.192+0000 7f4104dd1640 1 -- start start 2024-09-19T08:43:19.056 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.192+0000 7f4104dd1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41001080f0 0x7f410010a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:19.056 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.192+0000 7f4104dd1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f410007bed0 con 0x7f41001080f0 2024-09-19T08:43:19.056 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.192+0000 7f40fe59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41001080f0 0x7f410010a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:19.057 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.193+0000 7f40fe59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41001080f0 0x7f410010a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38188/0 (socket says 172.21.15.19:38188) 2024-09-19T08:43:19.057 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.193+0000 7f40fe59c640 1 -- 172.21.15.19:0/4273927462 learned_addr learned my addr 172.21.15.19:0/4273927462 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:43:19.057 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.193+0000 7f40fe59c640 1 -- 172.21.15.19:0/4273927462 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f410010aa20 con 0x7f41001080f0 2024-09-19T08:43:19.057 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.193+0000 7f40fe59c640 1 --2- 172.21.15.19:0/4273927462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41001080f0 0x7f410010a4e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f40f0009820 tx=0x7f40f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48de600e5b703f63 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:19.058 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.194+0000 7f40fd59a640 1 -- 172.21.15.19:0/4273927462 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f0037070 con 0x7f41001080f0 2024-09-19T08:43:19.058 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.194+0000 7f40fd59a640 1 -- 172.21.15.19:0/4273927462 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40f0032920 con 0x7f41001080f0 2024-09-19T08:43:19.058 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.194+0000 7f40fd59a640 1 -- 172.21.15.19:0/4273927462 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f0030810 con 0x7f41001080f0 2024-09-19T08:43:19.058 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.194+0000 7f4104dd1640 1 -- 172.21.15.19:0/4273927462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41001080f0 msgr2=0x7f410010a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:19.058 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.194+0000 7f4104dd1640 1 --2- 172.21.15.19:0/4273927462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41001080f0 0x7f410010a4e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f40f0009820 tx=0x7f40f002a270 comp rx=0 tx=0).stop 2024-09-19T08:43:19.058 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.194+0000 7f4104dd1640 1 -- 172.21.15.19:0/4273927462 shutdown_connections 2024-09-19T08:43:19.058 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.194+0000 7f4104dd1640 1 --2- 172.21.15.19:0/4273927462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41001080f0 0x7f410010a4e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:19.058 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.194+0000 7f4104dd1640 1 -- 172.21.15.19:0/4273927462 >> 172.21.15.19:0/4273927462 conn(0x7f4100101d10 msgr2=0x7f4100104150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:19.058 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.194+0000 7f4104dd1640 1 -- 172.21.15.19:0/4273927462 shutdown_connections 2024-09-19T08:43:19.058 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.195+0000 7f4104dd1640 1 -- 172.21.15.19:0/4273927462 wait complete. 2024-09-19T08:43:19.058 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.195+0000 7f4104dd1640 1 Processor -- start 2024-09-19T08:43:19.058 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.195+0000 7f4104dd1640 1 -- start start 2024-09-19T08:43:19.058 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.195+0000 7f4104dd1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41001080f0 0x7f410019b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:19.058 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.195+0000 7f4104dd1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f410010bb00 con 0x7f41001080f0 2024-09-19T08:43:19.059 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.196+0000 7f40fe59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41001080f0 0x7f410019b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:19.059 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.196+0000 7f40fe59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41001080f0 0x7f410019b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38194/0 (socket says 172.21.15.19:38194) 2024-09-19T08:43:19.059 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.196+0000 7f40fe59c640 1 -- 172.21.15.19:0/1922957288 learned_addr learned my addr 172.21.15.19:0/1922957288 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:43:19.059 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.196+0000 7f40fe59c640 1 -- 172.21.15.19:0/1922957288 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f410019bbd0 con 0x7f41001080f0 2024-09-19T08:43:19.059 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.196+0000 7f40fe59c640 1 --2- 172.21.15.19:0/1922957288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41001080f0 0x7f410019b690 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f40f0030380 tx=0x7f40f0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:19.059 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.196+0000 7f40ef7fe640 1 -- 172.21.15.19:0/1922957288 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f0037040 con 0x7f41001080f0 2024-09-19T08:43:19.059 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.196+0000 7f40ef7fe640 1 -- 172.21.15.19:0/1922957288 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40f0040070 con 0x7f41001080f0 2024-09-19T08:43:19.059 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.196+0000 7f40ef7fe640 1 -- 172.21.15.19:0/1922957288 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40f003a7b0 con 0x7f41001080f0 2024-09-19T08:43:19.059 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.196+0000 7f4104dd1640 1 -- 172.21.15.19:0/1922957288 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f410019be60 con 0x7f41001080f0 2024-09-19T08:43:19.059 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.196+0000 7f4104dd1640 1 -- 172.21.15.19:0/1922957288 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f410019eb50 con 0x7f41001080f0 2024-09-19T08:43:19.059 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.197+0000 7f40ef7fe640 1 -- 172.21.15.19:0/1922957288 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f40f003a9e0 con 0x7f41001080f0 2024-09-19T08:43:19.059 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.198+0000 7f40ef7fe640 1 --2- 172.21.15.19:0/1922957288 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f40e8039260 0x7f40e803b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:19.059 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.198+0000 7f4104dd1640 1 -- 172.21.15.19:0/1922957288 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4100108550 con 0x7f41001080f0 2024-09-19T08:43:19.060 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.198+0000 7f40fdd9b640 1 -- 172.21.15.19:0/1922957288 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f40e8039260 msgr2=0x7f40e803b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.19:6800/4266644067 2024-09-19T08:43:19.060 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.198+0000 7f40ef7fe640 1 -- 172.21.15.19:0/1922957288 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f40f006c920 con 0x7f41001080f0 2024-09-19T08:43:19.060 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.198+0000 7f40fdd9b640 1 --2- 172.21.15.19:0/1922957288 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f40e8039260 0x7f40e803b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:43:19.060 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.202+0000 7f40ef7fe640 1 -- 172.21.15.19:0/1922957288 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f40f0044c70 con 0x7f41001080f0 2024-09-19T08:43:19.060 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.399+0000 7f40fdd9b640 1 -- 172.21.15.19:0/1922957288 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f40e8039260 msgr2=0x7f40e803b720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.19:6800/4266644067 2024-09-19T08:43:19.060 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.399+0000 7f40fdd9b640 1 --2- 172.21.15.19:0/1922957288 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f40e8039260 0x7f40e803b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T08:43:19.061 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.426+0000 7f4104dd1640 1 -- 172.21.15.19:0/1922957288 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f410019f110 con 0x7f41001080f0 2024-09-19T08:43:19.061 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.426+0000 7f40ef7fe640 1 -- 172.21.15.19:0/1922957288 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f40f0041270 con 0x7f41001080f0 2024-09-19T08:43:19.061 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.428+0000 7f4104dd1640 1 -- 172.21.15.19:0/1922957288 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f40e8039260 msgr2=0x7f40e803b720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:43:19.061 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.428+0000 7f4104dd1640 1 --2- 172.21.15.19:0/1922957288 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f40e8039260 0x7f40e803b720 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:19.061 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.428+0000 7f4104dd1640 1 -- 172.21.15.19:0/1922957288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41001080f0 msgr2=0x7f410019b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:19.061 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.428+0000 7f4104dd1640 1 --2- 172.21.15.19:0/1922957288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41001080f0 0x7f410019b690 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f40f0030380 tx=0x7f40f0032670 comp rx=0 tx=0).stop 2024-09-19T08:43:19.061 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.429+0000 7f4104dd1640 1 -- 172.21.15.19:0/1922957288 shutdown_connections 2024-09-19T08:43:19.061 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.429+0000 7f4104dd1640 1 --2- 172.21.15.19:0/1922957288 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7f40e8039260 0x7f40e803b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:19.061 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.429+0000 7f4104dd1640 1 --2- 172.21.15.19:0/1922957288 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f41001080f0 0x7f410019b690 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:19.062 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.429+0000 7f4104dd1640 1 -- 172.21.15.19:0/1922957288 >> 172.21.15.19:0/1922957288 conn(0x7f4100101d10 msgr2=0x7f41001028f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:19.062 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.429+0000 7f4104dd1640 1 -- 172.21.15.19:0/1922957288 shutdown_connections 2024-09-19T08:43:19.062 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:18.429+0000 7f4104dd1640 1 -- 172.21.15.19:0/1922957288 wait complete. 2024-09-19T08:43:19.062 INFO:teuthology.orchestra.run.smithi019.stdout:Waiting for the mgr to restart... 2024-09-19T08:43:19.062 INFO:teuthology.orchestra.run.smithi019.stdout:Waiting for mgr epoch 9... 2024-09-19T08:43:19.272 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:18 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:43:18.932+0000 7f9b98c62040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:43:19.272 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:19 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:43:19.003+0000 7f9b98c62040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:43:20.035 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:19 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:43:19.765+0000 7f9b98c62040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:43:20.035 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:19 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:43:19.885+0000 7f9b98c62040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:43:20.318 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:20 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:43:20.035+0000 7f9b98c62040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:43:20.318 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:20 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:43:20.099+0000 7f9b98c62040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:43:20.318 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:20 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:43:20.255+0000 7f9b98c62040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:43:20.622 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:20 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:43:20.326+0000 7f9b98c62040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:43:20.622 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:20 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:43:20.389+0000 7f9b98c62040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:43:20.622 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:20 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:43:20.554+0000 7f9b98c62040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:43:20.622 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:20 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:43:20.622+0000 7f9b98c62040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:43:20.901 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:20 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:43:20.692+0000 7f9b98c62040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:43:20.901 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:20 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:43:20.778+0000 7f9b98c62040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:43:20.901 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:20 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:43:20.840+0000 7f9b98c62040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:43:20.902 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:20 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:43:20.902+0000 7f9b98c62040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:43:21.981 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:21 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:43:21.730+0000 7f9b98c62040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:43:21.981 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:21 smithi019 ceph-mon[30976]: Active manager daemon x restarted 2024-09-19T08:43:21.981 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:21 smithi019 ceph-mon[30976]: Activating manager daemon x 2024-09-19T08:43:21.981 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:21 smithi019 ceph-mon[30976]: osdmap e3: 0 total, 0 up, 0 in 2024-09-19T08:43:21.981 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:21 smithi019 ceph-mon[30976]: mgrmap e10: x(active, starting, since 0.00346824s) 2024-09-19T08:43:21.981 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:21 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:43:21.981 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:21 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T08:43:21.982 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:21 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T08:43:21.982 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:21 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T08:43:21.982 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:21 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T08:43:21.982 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:21 smithi019 ceph-mon[30976]: Manager daemon x is now available 2024-09-19T08:43:21.982 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:21 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:43:21.982 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:21 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T08:43:21.982 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:21 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T08:43:23.330 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout { 2024-09-19T08:43:23.330 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-19T08:43:23.330 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T08:43:23.331 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout } 2024-09-19T08:43:23.331 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.464+0000 7fb7db81c640 1 Processor -- start 2024-09-19T08:43:23.331 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.464+0000 7fb7db81c640 1 -- start start 2024-09-19T08:43:23.331 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.464+0000 7fb7db81c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7d41081e0 0x7fb7d410a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:23.331 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.464+0000 7fb7db81c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d407be50 con 0x7fb7d41081e0 2024-09-19T08:43:23.331 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.464+0000 7fb7d95b8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7d41081e0 0x7fb7d410a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:23.331 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.464+0000 7fb7d95b8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7d41081e0 0x7fb7d410a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38202/0 (socket says 172.21.15.19:38202) 2024-09-19T08:43:23.331 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.464+0000 7fb7d95b8640 1 -- 172.21.15.19:0/2980263470 learned_addr learned my addr 172.21.15.19:0/2980263470 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:43:23.331 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.465+0000 7fb7d95b8640 1 -- 172.21.15.19:0/2980263470 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7d410ab10 con 0x7fb7d41081e0 2024-09-19T08:43:23.331 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.465+0000 7fb7d95b8640 1 --2- 172.21.15.19:0/2980263470 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7d41081e0 0x7fb7d410a5d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0009820 tx=0x7fb7d002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dc755e81c952ee8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:23.331 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.465+0000 7fb7cbfff640 1 -- 172.21.15.19:0/2980263470 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7d0037070 con 0x7fb7d41081e0 2024-09-19T08:43:23.331 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.465+0000 7fb7cbfff640 1 -- 172.21.15.19:0/2980263470 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7d0032920 con 0x7fb7d41081e0 2024-09-19T08:43:23.332 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.465+0000 7fb7cbfff640 1 -- 172.21.15.19:0/2980263470 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7d0030810 con 0x7fb7d41081e0 2024-09-19T08:43:23.332 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.466+0000 7fb7db81c640 1 -- 172.21.15.19:0/2980263470 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7d41081e0 msgr2=0x7fb7d410a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:23.332 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.466+0000 7fb7db81c640 1 --2- 172.21.15.19:0/2980263470 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7d41081e0 0x7fb7d410a5d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0009820 tx=0x7fb7d002a270 comp rx=0 tx=0).stop 2024-09-19T08:43:23.332 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.466+0000 7fb7db81c640 1 -- 172.21.15.19:0/2980263470 shutdown_connections 2024-09-19T08:43:23.332 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.466+0000 7fb7db81c640 1 --2- 172.21.15.19:0/2980263470 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7d41081e0 0x7fb7d410a5d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:23.332 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.466+0000 7fb7db81c640 1 -- 172.21.15.19:0/2980263470 >> 172.21.15.19:0/2980263470 conn(0x7fb7d4101dc0 msgr2=0x7fb7d41041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:23.332 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.466+0000 7fb7db81c640 1 -- 172.21.15.19:0/2980263470 shutdown_connections 2024-09-19T08:43:23.332 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.466+0000 7fb7db81c640 1 -- 172.21.15.19:0/2980263470 wait complete. 2024-09-19T08:43:23.332 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.467+0000 7fb7db81c640 1 Processor -- start 2024-09-19T08:43:23.332 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.467+0000 7fb7db81c640 1 -- start start 2024-09-19T08:43:23.332 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.467+0000 7fb7db81c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7d41081e0 0x7fb7d4107a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:23.332 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.467+0000 7fb7db81c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d410bb30 con 0x7fb7d41081e0 2024-09-19T08:43:23.333 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.467+0000 7fb7d95b8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7d41081e0 0x7fb7d4107a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:23.333 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.467+0000 7fb7d95b8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7d41081e0 0x7fb7d4107a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38218/0 (socket says 172.21.15.19:38218) 2024-09-19T08:43:23.333 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.467+0000 7fb7d95b8640 1 -- 172.21.15.19:0/351713155 learned_addr learned my addr 172.21.15.19:0/351713155 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:43:23.333 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.467+0000 7fb7d95b8640 1 -- 172.21.15.19:0/351713155 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7d4107fa0 con 0x7fb7d41081e0 2024-09-19T08:43:23.333 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.468+0000 7fb7d95b8640 1 --2- 172.21.15.19:0/351713155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7d41081e0 0x7fb7d4107a60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0030420 tx=0x7fb7d0032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:23.333 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.468+0000 7fb7ca7fc640 1 -- 172.21.15.19:0/351713155 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7d0037040 con 0x7fb7d41081e0 2024-09-19T08:43:23.333 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.468+0000 7fb7ca7fc640 1 -- 172.21.15.19:0/351713155 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7d0040070 con 0x7fb7d41081e0 2024-09-19T08:43:23.333 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.468+0000 7fb7ca7fc640 1 -- 172.21.15.19:0/351713155 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7d003a6e0 con 0x7fb7d41081e0 2024-09-19T08:43:23.333 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.468+0000 7fb7db81c640 1 -- 172.21.15.19:0/351713155 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7d4106190 con 0x7fb7d41081e0 2024-09-19T08:43:23.333 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.468+0000 7fb7db81c640 1 -- 172.21.15.19:0/351713155 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7d41066d0 con 0x7fb7d41081e0 2024-09-19T08:43:23.333 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.469+0000 7fb7ca7fc640 1 -- 172.21.15.19:0/351713155 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7fb7d003bb20 con 0x7fb7d41081e0 2024-09-19T08:43:23.333 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.469+0000 7fb7ca7fc640 1 --2- 172.21.15.19:0/351713155 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7fb7c0039200 0x7fb7c003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:23.333 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.469+0000 7fb7ca7fc640 1 -- 172.21.15.19:0/351713155 --> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb7c003bdd0 con 0x7fb7c0039200 2024-09-19T08:43:23.333 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.469+0000 7fb7ca7fc640 1 -- 172.21.15.19:0/351713155 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb7d006c940 con 0x7fb7d41081e0 2024-09-19T08:43:23.334 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.469+0000 7fb7d8db7640 1 -- 172.21.15.19:0/351713155 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7fb7c0039200 msgr2=0x7fb7c003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.19:6800/4266644067 2024-09-19T08:43:23.334 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.469+0000 7fb7d8db7640 1 --2- 172.21.15.19:0/351713155 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7fb7c0039200 0x7fb7c003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:43:23.334 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.670+0000 7fb7d8db7640 1 -- 172.21.15.19:0/351713155 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7fb7c0039200 msgr2=0x7fb7c003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.19:6800/4266644067 2024-09-19T08:43:23.334 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:19.670+0000 7fb7d8db7640 1 --2- 172.21.15.19:0/351713155 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7fb7c0039200 0x7fb7c003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T08:43:23.334 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:20.071+0000 7fb7d8db7640 1 -- 172.21.15.19:0/351713155 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7fb7c0039200 msgr2=0x7fb7c003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.19:6800/4266644067 2024-09-19T08:43:23.334 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:20.071+0000 7fb7d8db7640 1 --2- 172.21.15.19:0/351713155 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7fb7c0039200 0x7fb7c003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T08:43:23.334 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:20.872+0000 7fb7d8db7640 1 -- 172.21.15.19:0/351713155 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7fb7c0039200 msgr2=0x7fb7c003b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.19:6800/4266644067 2024-09-19T08:43:23.334 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:20.872+0000 7fb7d8db7640 1 --2- 172.21.15.19:0/351713155 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7fb7c0039200 0x7fb7c003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T08:43:23.334 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:21.734+0000 7fb7ca7fc640 1 -- 172.21.15.19:0/351713155 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mgrmap(e 10) ==== 46241+0+0 (secure 0 0 0) 0x7fb7d006b3f0 con 0x7fb7d41081e0 2024-09-19T08:43:23.334 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:21.734+0000 7fb7ca7fc640 1 -- 172.21.15.19:0/351713155 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7fb7c0039200 msgr2=0x7fb7c003b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:43:23.334 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:21.734+0000 7fb7ca7fc640 1 --2- 172.21.15.19:0/351713155 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7fb7c0039200 0x7fb7c003b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:23.334 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:22.735+0000 7fb7ca7fc640 1 -- 172.21.15.19:0/351713155 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7fb7d003b420 con 0x7fb7d41081e0 2024-09-19T08:43:23.334 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:22.735+0000 7fb7ca7fc640 1 --2- 172.21.15.19:0/351713155 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb7c003ccc0 0x7fb7c003f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:23.334 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:22.735+0000 7fb7ca7fc640 1 -- 172.21.15.19:0/351713155 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb7d0065a60 con 0x7fb7c003ccc0 2024-09-19T08:43:23.335 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:22.736+0000 7fb7d8db7640 1 --2- 172.21.15.19:0/351713155 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb7c003ccc0 0x7fb7c003f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:23.335 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:22.737+0000 7fb7d8db7640 1 --2- 172.21.15.19:0/351713155 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb7c003ccc0 0x7fb7c003f0b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fb7c4003980 tx=0x7fb7c4006e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:23.335 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:22.738+0000 7fb7ca7fc640 1 -- 172.21.15.19:0/351713155 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fb7d0065a60 con 0x7fb7c003ccc0 2024-09-19T08:43:23.335 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:22.747+0000 7fb7db81c640 1 -- 172.21.15.19:0/351713155 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fb7d4108640 con 0x7fb7c003ccc0 2024-09-19T08:43:23.335 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:22.747+0000 7fb7ca7fc640 1 -- 172.21.15.19:0/351713155 <== mgr.14150 v2:172.21.15.19:6800/1181234346 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7fb7d4108640 con 0x7fb7c003ccc0 2024-09-19T08:43:23.335 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:22.748+0000 7fb7db81c640 1 -- 172.21.15.19:0/351713155 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb7c003ccc0 msgr2=0x7fb7c003f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:23.335 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:22.748+0000 7fb7db81c640 1 --2- 172.21.15.19:0/351713155 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb7c003ccc0 0x7fb7c003f0b0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fb7c4003980 tx=0x7fb7c4006e10 comp rx=0 tx=0).stop 2024-09-19T08:43:23.335 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:22.748+0000 7fb7db81c640 1 -- 172.21.15.19:0/351713155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7d41081e0 msgr2=0x7fb7d4107a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:23.335 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:22.748+0000 7fb7db81c640 1 --2- 172.21.15.19:0/351713155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7d41081e0 0x7fb7d4107a60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0030420 tx=0x7fb7d0032670 comp rx=0 tx=0).stop 2024-09-19T08:43:23.335 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:22.748+0000 7fb7db81c640 1 -- 172.21.15.19:0/351713155 shutdown_connections 2024-09-19T08:43:23.335 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:22.748+0000 7fb7db81c640 1 --2- 172.21.15.19:0/351713155 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb7c003ccc0 0x7fb7c003f0b0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:23.335 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:22.748+0000 7fb7db81c640 1 --2- 172.21.15.19:0/351713155 >> [v2:172.21.15.19:6800/4266644067,v1:172.21.15.19:6801/4266644067] conn(0x7fb7c0039200 0x7fb7c003b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:23.335 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:22.748+0000 7fb7db81c640 1 --2- 172.21.15.19:0/351713155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7d41081e0 0x7fb7d4107a60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:23.336 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:22.748+0000 7fb7db81c640 1 -- 172.21.15.19:0/351713155 >> 172.21.15.19:0/351713155 conn(0x7fb7d4101dc0 msgr2=0x7fb7d41029a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:23.336 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:22.748+0000 7fb7db81c640 1 -- 172.21.15.19:0/351713155 shutdown_connections 2024-09-19T08:43:23.336 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:22.748+0000 7fb7db81c640 1 -- 172.21.15.19:0/351713155 wait complete. 2024-09-19T08:43:23.336 INFO:teuthology.orchestra.run.smithi019.stdout:mgr epoch 9 is available 2024-09-19T08:43:23.336 INFO:teuthology.orchestra.run.smithi019.stdout:Generating a dashboard self-signed certificate... 2024-09-19T08:43:23.951 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:23 smithi019 ceph-mon[30976]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T08:43:23.951 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:23 smithi019 ceph-mon[30976]: mgrmap e11: x(active, since 1.00622s) 2024-09-19T08:43:23.952 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:23 smithi019 ceph-mon[30976]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T08:43:24.319 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:23 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:43:23.965+0000 7f9b03f76640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:08:43:23] ENGINE Error in HTTPServer.serve 2024-09-19T08:43:24.319 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:23 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: Traceback (most recent call last): 2024-09-19T08:43:24.319 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:23 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:43:24.319 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:23 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: self._connections.run(self.expiration_interval) 2024-09-19T08:43:24.319 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:23 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:43:24.319 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:23 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: self._run(expiration_interval) 2024-09-19T08:43:24.319 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:23 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:43:24.319 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:23 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:43:24.319 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:23 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:43:24.320 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:23 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:43:24.320 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:23 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:43:24.320 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:23 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: s = self.context.wrap_socket( 2024-09-19T08:43:24.320 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:23 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:43:24.320 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:23 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: return self.sslsocket_class._create( 2024-09-19T08:43:24.320 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:23 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:43:24.320 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:23 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: self.do_handshake() 2024-09-19T08:43:24.320 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:23 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:43:24.320 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:23 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: self._sslobj.do_handshake() 2024-09-19T08:43:24.320 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:23 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:43:24.320 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:43:23 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:43:24.663 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-19T08:43:24.664 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.756+0000 7fc136ff9640 1 Processor -- start 2024-09-19T08:43:24.664 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.756+0000 7fc136ff9640 1 -- start start 2024-09-19T08:43:24.664 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.756+0000 7fc136ff9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1301065a0 0x7fc1301069a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:24.664 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.756+0000 7fc136ff9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc130106f70 con 0x7fc1301065a0 2024-09-19T08:43:24.664 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.757+0000 7fc134d95640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1301065a0 0x7fc1301069a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:24.664 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.757+0000 7fc134d95640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1301065a0 0x7fc1301069a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38270/0 (socket says 172.21.15.19:38270) 2024-09-19T08:43:24.664 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.757+0000 7fc134d95640 1 -- 172.21.15.19:0/1096298368 learned_addr learned my addr 172.21.15.19:0/1096298368 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:43:24.664 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.757+0000 7fc134d95640 1 -- 172.21.15.19:0/1096298368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1301077a0 con 0x7fc1301065a0 2024-09-19T08:43:24.664 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.758+0000 7fc134d95640 1 --2- 172.21.15.19:0/1096298368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1301065a0 0x7fc1301069a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc12c009820 tx=0x7fc12c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=635a7ed5071156ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:24.664 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.758+0000 7fc1277fe640 1 -- 172.21.15.19:0/1096298368 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc12c037070 con 0x7fc1301065a0 2024-09-19T08:43:24.665 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.758+0000 7fc1277fe640 1 -- 172.21.15.19:0/1096298368 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc12c032920 con 0x7fc1301065a0 2024-09-19T08:43:24.665 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.758+0000 7fc1277fe640 1 -- 172.21.15.19:0/1096298368 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc12c030810 con 0x7fc1301065a0 2024-09-19T08:43:24.665 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.758+0000 7fc136ff9640 1 -- 172.21.15.19:0/1096298368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1301065a0 msgr2=0x7fc1301069a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:24.665 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.758+0000 7fc136ff9640 1 --2- 172.21.15.19:0/1096298368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1301065a0 0x7fc1301069a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc12c009820 tx=0x7fc12c02a270 comp rx=0 tx=0).stop 2024-09-19T08:43:24.666 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.758+0000 7fc136ff9640 1 -- 172.21.15.19:0/1096298368 shutdown_connections 2024-09-19T08:43:24.666 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.758+0000 7fc136ff9640 1 --2- 172.21.15.19:0/1096298368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1301065a0 0x7fc1301069a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:24.666 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.758+0000 7fc136ff9640 1 -- 172.21.15.19:0/1096298368 >> 172.21.15.19:0/1096298368 conn(0x7fc130101d50 msgr2=0x7fc130104170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:24.666 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.758+0000 7fc136ff9640 1 -- 172.21.15.19:0/1096298368 shutdown_connections 2024-09-19T08:43:24.666 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.759+0000 7fc136ff9640 1 -- 172.21.15.19:0/1096298368 wait complete. 2024-09-19T08:43:24.667 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.759+0000 7fc136ff9640 1 Processor -- start 2024-09-19T08:43:24.667 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.759+0000 7fc136ff9640 1 -- start start 2024-09-19T08:43:24.667 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.759+0000 7fc136ff9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1301065a0 0x7fc13019b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:24.667 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.759+0000 7fc136ff9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc13010ab50 con 0x7fc1301065a0 2024-09-19T08:43:24.667 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.759+0000 7fc134d95640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1301065a0 0x7fc13019b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:24.668 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.759+0000 7fc134d95640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1301065a0 0x7fc13019b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38286/0 (socket says 172.21.15.19:38286) 2024-09-19T08:43:24.668 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.759+0000 7fc134d95640 1 -- 172.21.15.19:0/4286494606 learned_addr learned my addr 172.21.15.19:0/4286494606 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:43:24.668 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.760+0000 7fc134d95640 1 -- 172.21.15.19:0/4286494606 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc13019bcd0 con 0x7fc1301065a0 2024-09-19T08:43:24.668 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.760+0000 7fc134d95640 1 --2- 172.21.15.19:0/4286494606 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1301065a0 0x7fc13019b790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc12c030560 tx=0x7fc12c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:24.668 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.760+0000 7fc125ffb640 1 -- 172.21.15.19:0/4286494606 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc12c037040 con 0x7fc1301065a0 2024-09-19T08:43:24.668 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.760+0000 7fc136ff9640 1 -- 172.21.15.19:0/4286494606 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc13019bf60 con 0x7fc1301065a0 2024-09-19T08:43:24.669 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.760+0000 7fc125ffb640 1 -- 172.21.15.19:0/4286494606 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc12c040070 con 0x7fc1301065a0 2024-09-19T08:43:24.669 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.760+0000 7fc125ffb640 1 -- 172.21.15.19:0/4286494606 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc12c03a6d0 con 0x7fc1301065a0 2024-09-19T08:43:24.669 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.760+0000 7fc136ff9640 1 -- 172.21.15.19:0/4286494606 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc13019ec50 con 0x7fc1301065a0 2024-09-19T08:43:24.669 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.761+0000 7fc125ffb640 1 -- 172.21.15.19:0/4286494606 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7fc12c03a940 con 0x7fc1301065a0 2024-09-19T08:43:24.669 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.761+0000 7fc125ffb640 1 --2- 172.21.15.19:0/4286494606 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc118039200 0x7fc11803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:24.669 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.761+0000 7fc125ffb640 1 -- 172.21.15.19:0/4286494606 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc12c06cad0 con 0x7fc1301065a0 2024-09-19T08:43:24.669 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.761+0000 7fc127fff640 1 --2- 172.21.15.19:0/4286494606 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc118039200 0x7fc11803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:24.669 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.762+0000 7fc136ff9640 1 -- 172.21.15.19:0/4286494606 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc13010acd0 con 0x7fc1301065a0 2024-09-19T08:43:24.669 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.762+0000 7fc127fff640 1 --2- 172.21.15.19:0/4286494606 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc118039200 0x7fc11803b6c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc1200098c0 tx=0x7fc120006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:24.670 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.770+0000 7fc125ffb640 1 -- 172.21.15.19:0/4286494606 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc12c06ce20 con 0x7fc1301065a0 2024-09-19T08:43:24.670 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:23.952+0000 7fc136ff9640 1 -- 172.21.15.19:0/4286494606 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fc13002d970 con 0x7fc118039200 2024-09-19T08:43:24.670 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:24.019+0000 7fc125ffb640 1 -- 172.21.15.19:0/4286494606 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fc13002d970 con 0x7fc118039200 2024-09-19T08:43:24.670 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:24.021+0000 7fc136ff9640 1 -- 172.21.15.19:0/4286494606 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc118039200 msgr2=0x7fc11803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:24.670 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:24.021+0000 7fc136ff9640 1 --2- 172.21.15.19:0/4286494606 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc118039200 0x7fc11803b6c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc1200098c0 tx=0x7fc120006db0 comp rx=0 tx=0).stop 2024-09-19T08:43:24.670 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:24.021+0000 7fc136ff9640 1 -- 172.21.15.19:0/4286494606 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1301065a0 msgr2=0x7fc13019b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:24.670 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:24.021+0000 7fc136ff9640 1 --2- 172.21.15.19:0/4286494606 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1301065a0 0x7fc13019b790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc12c030560 tx=0x7fc12c032670 comp rx=0 tx=0).stop 2024-09-19T08:43:24.670 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:24.021+0000 7fc136ff9640 1 -- 172.21.15.19:0/4286494606 shutdown_connections 2024-09-19T08:43:24.671 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:24.021+0000 7fc136ff9640 1 --2- 172.21.15.19:0/4286494606 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc118039200 0x7fc11803b6c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:24.671 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:24.021+0000 7fc136ff9640 1 --2- 172.21.15.19:0/4286494606 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1301065a0 0x7fc13019b790 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:24.671 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:24.021+0000 7fc136ff9640 1 -- 172.21.15.19:0/4286494606 >> 172.21.15.19:0/4286494606 conn(0x7fc130101d50 msgr2=0x7fc130102d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:24.671 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:24.021+0000 7fc136ff9640 1 -- 172.21.15.19:0/4286494606 shutdown_connections 2024-09-19T08:43:24.671 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:24.021+0000 7fc136ff9640 1 -- 172.21.15.19:0/4286494606 wait complete. 2024-09-19T08:43:24.671 INFO:teuthology.orchestra.run.smithi019.stdout:Creating initial admin user... 2024-09-19T08:43:24.910 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:24 smithi019 ceph-mon[30976]: mgrmap e12: x(active, since 2s) 2024-09-19T08:43:24.910 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:24 smithi019 ceph-mon[30976]: [19/Sep/2024:08:43:23] ENGINE Bus STARTING 2024-09-19T08:43:24.910 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:24 smithi019 ceph-mon[30976]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:43:24.910 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:24 smithi019 ceph-mon[30976]: [19/Sep/2024:08:43:23] ENGINE Serving on https://172.21.15.19:7150 2024-09-19T08:43:24.910 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:24 smithi019 ceph-mon[30976]: [19/Sep/2024:08:43:23] ENGINE Error in HTTPServer.serve 2024-09-19T08:43:24.910 INFO:journalctl@ceph.mon.a.smithi019.stdout: Traceback (most recent call last): 2024-09-19T08:43:24.910 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T08:43:24.910 INFO:journalctl@ceph.mon.a.smithi019.stdout: self._connections.run(self.expiration_interval) 2024-09-19T08:43:24.910 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T08:43:24.911 INFO:journalctl@ceph.mon.a.smithi019.stdout: self._run(expiration_interval) 2024-09-19T08:43:24.911 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T08:43:24.911 INFO:journalctl@ceph.mon.a.smithi019.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T08:43:24.911 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T08:43:24.911 INFO:journalctl@ceph.mon.a.smithi019.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T08:43:24.911 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T08:43:24.912 INFO:journalctl@ceph.mon.a.smithi019.stdout: s = self.context.wrap_socket( 2024-09-19T08:43:24.912 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T08:43:24.912 INFO:journalctl@ceph.mon.a.smithi019.stdout: return self.sslsocket_class._create( 2024-09-19T08:43:24.912 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T08:43:24.912 INFO:journalctl@ceph.mon.a.smithi019.stdout: self.do_handshake() 2024-09-19T08:43:24.912 INFO:journalctl@ceph.mon.a.smithi019.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T08:43:24.912 INFO:journalctl@ceph.mon.a.smithi019.stdout: self._sslobj.do_handshake() 2024-09-19T08:43:24.912 INFO:journalctl@ceph.mon.a.smithi019.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T08:43:24.912 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:24 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:43:24.912 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:24 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:43:24.912 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:24 smithi019 ceph-mon[30976]: [19/Sep/2024:08:43:24] ENGINE Serving on http://172.21.15.19:8765 2024-09-19T08:43:24.912 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:24 smithi019 ceph-mon[30976]: [19/Sep/2024:08:43:24] ENGINE Bus STARTED 2024-09-19T08:43:24.912 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:24 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:43:26.195 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$OmszkGj6qyLKri0N/vAkvOzRfYw3H8s/BrYdpAAtizPkHU2lvo0ru", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726735405, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-19T08:43:26.195 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.110+0000 7ff150917640 1 Processor -- start 2024-09-19T08:43:26.195 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.110+0000 7ff150917640 1 -- start start 2024-09-19T08:43:26.195 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.110+0000 7ff150917640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff14c107690 0x7ff14c107a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:26.195 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.110+0000 7ff150917640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff14c108060 con 0x7ff14c107690 2024-09-19T08:43:26.195 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.111+0000 7ff14a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff14c107690 0x7ff14c107a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:26.195 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.111+0000 7ff14a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff14c107690 0x7ff14c107a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38300/0 (socket says 172.21.15.19:38300) 2024-09-19T08:43:26.195 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.111+0000 7ff14a59c640 1 -- 172.21.15.19:0/3981775669 learned_addr learned my addr 172.21.15.19:0/3981775669 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:43:26.195 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.111+0000 7ff14a59c640 1 -- 172.21.15.19:0/3981775669 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff14c108890 con 0x7ff14c107690 2024-09-19T08:43:26.196 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.112+0000 7ff14a59c640 1 --2- 172.21.15.19:0/3981775669 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff14c107690 0x7ff14c107a90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff13c009820 tx=0x7ff13c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e3b690523f1baf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:26.196 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.112+0000 7ff149d9b640 1 -- 172.21.15.19:0/3981775669 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff13c037070 con 0x7ff14c107690 2024-09-19T08:43:26.196 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.112+0000 7ff149d9b640 1 -- 172.21.15.19:0/3981775669 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff13c032920 con 0x7ff14c107690 2024-09-19T08:43:26.196 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.112+0000 7ff149d9b640 1 -- 172.21.15.19:0/3981775669 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff13c030810 con 0x7ff14c107690 2024-09-19T08:43:26.196 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.113+0000 7ff150917640 1 -- 172.21.15.19:0/3981775669 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff14c107690 msgr2=0x7ff14c107a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:26.196 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.113+0000 7ff150917640 1 --2- 172.21.15.19:0/3981775669 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff14c107690 0x7ff14c107a90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff13c009820 tx=0x7ff13c02a270 comp rx=0 tx=0).stop 2024-09-19T08:43:26.196 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.113+0000 7ff150917640 1 -- 172.21.15.19:0/3981775669 shutdown_connections 2024-09-19T08:43:26.196 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.113+0000 7ff150917640 1 --2- 172.21.15.19:0/3981775669 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff14c107690 0x7ff14c107a90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:26.196 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.113+0000 7ff150917640 1 -- 172.21.15.19:0/3981775669 >> 172.21.15.19:0/3981775669 conn(0x7ff14c102e00 msgr2=0x7ff14c105260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:26.196 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.113+0000 7ff150917640 1 -- 172.21.15.19:0/3981775669 shutdown_connections 2024-09-19T08:43:26.196 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.113+0000 7ff150917640 1 -- 172.21.15.19:0/3981775669 wait complete. 2024-09-19T08:43:26.196 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.114+0000 7ff150917640 1 Processor -- start 2024-09-19T08:43:26.196 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.114+0000 7ff150917640 1 -- start start 2024-09-19T08:43:26.197 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.114+0000 7ff150917640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff14c107690 0x7ff14c07db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:26.197 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.114+0000 7ff150917640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff14c10bc40 con 0x7ff14c107690 2024-09-19T08:43:26.197 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.114+0000 7ff14a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff14c107690 0x7ff14c07db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:26.197 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.114+0000 7ff14a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff14c107690 0x7ff14c07db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38306/0 (socket says 172.21.15.19:38306) 2024-09-19T08:43:26.197 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.114+0000 7ff14a59c640 1 -- 172.21.15.19:0/2086130979 learned_addr learned my addr 172.21.15.19:0/2086130979 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:43:26.197 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.114+0000 7ff14a59c640 1 -- 172.21.15.19:0/2086130979 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff14c07e0d0 con 0x7ff14c107690 2024-09-19T08:43:26.197 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.115+0000 7ff14a59c640 1 --2- 172.21.15.19:0/2086130979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff14c107690 0x7ff14c07db90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff13c030560 tx=0x7ff13c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:26.197 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.115+0000 7ff1437fe640 1 -- 172.21.15.19:0/2086130979 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff13c037040 con 0x7ff14c107690 2024-09-19T08:43:26.197 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.115+0000 7ff150917640 1 -- 172.21.15.19:0/2086130979 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff14c07c2c0 con 0x7ff14c107690 2024-09-19T08:43:26.197 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.115+0000 7ff1437fe640 1 -- 172.21.15.19:0/2086130979 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff13c040070 con 0x7ff14c107690 2024-09-19T08:43:26.197 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.115+0000 7ff1437fe640 1 -- 172.21.15.19:0/2086130979 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff13c03a740 con 0x7ff14c107690 2024-09-19T08:43:26.197 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.115+0000 7ff150917640 1 -- 172.21.15.19:0/2086130979 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff14c07c800 con 0x7ff14c107690 2024-09-19T08:43:26.197 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.116+0000 7ff1437fe640 1 -- 172.21.15.19:0/2086130979 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7ff13c03a9b0 con 0x7ff14c107690 2024-09-19T08:43:26.197 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.116+0000 7ff1437fe640 1 --2- 172.21.15.19:0/2086130979 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff138039200 0x7ff13803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:26.198 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.116+0000 7ff1437fe640 1 -- 172.21.15.19:0/2086130979 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff13c06da40 con 0x7ff14c107690 2024-09-19T08:43:26.198 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.116+0000 7ff143fff640 1 --2- 172.21.15.19:0/2086130979 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff138039200 0x7ff13803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:26.198 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.116+0000 7ff150917640 1 -- 172.21.15.19:0/2086130979 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff14c10bdc0 con 0x7ff14c107690 2024-09-19T08:43:26.198 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.116+0000 7ff143fff640 1 --2- 172.21.15.19:0/2086130979 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff138039200 0x7ff13803b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff1340098c0 tx=0x7ff134006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:26.198 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.125+0000 7ff1437fe640 1 -- 172.21.15.19:0/2086130979 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff13c042e30 con 0x7ff14c107690 2024-09-19T08:43:26.198 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.341+0000 7ff150917640 1 -- 172.21.15.19:0/2086130979 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7ff14c07cdb0 con 0x7ff138039200 2024-09-19T08:43:26.198 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.590+0000 7ff1437fe640 1 -- 172.21.15.19:0/2086130979 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7ff14c07cdb0 con 0x7ff138039200 2024-09-19T08:43:26.198 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.592+0000 7ff150917640 1 -- 172.21.15.19:0/2086130979 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff138039200 msgr2=0x7ff13803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:26.198 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.592+0000 7ff150917640 1 --2- 172.21.15.19:0/2086130979 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff138039200 0x7ff13803b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff1340098c0 tx=0x7ff134006db0 comp rx=0 tx=0).stop 2024-09-19T08:43:26.198 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.592+0000 7ff150917640 1 -- 172.21.15.19:0/2086130979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff14c107690 msgr2=0x7ff14c07db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:26.198 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.592+0000 7ff150917640 1 --2- 172.21.15.19:0/2086130979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff14c107690 0x7ff14c07db90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff13c030560 tx=0x7ff13c032670 comp rx=0 tx=0).stop 2024-09-19T08:43:26.198 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.592+0000 7ff150917640 1 -- 172.21.15.19:0/2086130979 shutdown_connections 2024-09-19T08:43:26.198 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.592+0000 7ff150917640 1 --2- 172.21.15.19:0/2086130979 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff138039200 0x7ff13803b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:26.199 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.592+0000 7ff150917640 1 --2- 172.21.15.19:0/2086130979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff14c107690 0x7ff14c07db90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:26.199 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.592+0000 7ff150917640 1 -- 172.21.15.19:0/2086130979 >> 172.21.15.19:0/2086130979 conn(0x7ff14c102e00 msgr2=0x7ff14c1039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:26.199 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.592+0000 7ff150917640 1 -- 172.21.15.19:0/2086130979 shutdown_connections 2024-09-19T08:43:26.199 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:25.592+0000 7ff150917640 1 -- 172.21.15.19:0/2086130979 wait complete. 2024-09-19T08:43:26.199 INFO:teuthology.orchestra.run.smithi019.stdout:Fetching dashboard port number... 2024-09-19T08:43:26.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:26 smithi019 ceph-mon[30976]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:43:26.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:26 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:43:26.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:26 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:43:27.780 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:27 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/258615901' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-19T08:43:28.375 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stdout 8443 2024-09-19T08:43:28.375 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.572+0000 7f5b8caa3640 1 Processor -- start 2024-09-19T08:43:28.375 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.572+0000 7f5b8caa3640 1 -- start start 2024-09-19T08:43:28.375 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.573+0000 7f5b8caa3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b88108180 0x7f5b8810a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:28.375 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.573+0000 7f5b8caa3640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8807be90 con 0x7f5b88108180 2024-09-19T08:43:28.375 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.573+0000 7f5b8659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b88108180 0x7f5b8810a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:28.376 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.573+0000 7f5b8659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b88108180 0x7f5b8810a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49958/0 (socket says 172.21.15.19:49958) 2024-09-19T08:43:28.376 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.573+0000 7f5b8659c640 1 -- 172.21.15.19:0/1436381417 learned_addr learned my addr 172.21.15.19:0/1436381417 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:43:28.376 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.573+0000 7f5b8659c640 1 -- 172.21.15.19:0/1436381417 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b8810aab0 con 0x7f5b88108180 2024-09-19T08:43:28.376 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.574+0000 7f5b8659c640 1 --2- 172.21.15.19:0/1436381417 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b88108180 0x7f5b8810a570 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5b78009820 tx=0x7f5b7802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae6d2b0a48c4712 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:28.376 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.575+0000 7f5b8559a640 1 -- 172.21.15.19:0/1436381417 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b78037070 con 0x7f5b88108180 2024-09-19T08:43:28.376 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.575+0000 7f5b8559a640 1 -- 172.21.15.19:0/1436381417 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b78032920 con 0x7f5b88108180 2024-09-19T08:43:28.376 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.575+0000 7f5b8559a640 1 -- 172.21.15.19:0/1436381417 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b78030810 con 0x7f5b88108180 2024-09-19T08:43:28.376 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.575+0000 7f5b8caa3640 1 -- 172.21.15.19:0/1436381417 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b88108180 msgr2=0x7f5b8810a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:28.376 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.575+0000 7f5b8caa3640 1 --2- 172.21.15.19:0/1436381417 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b88108180 0x7f5b8810a570 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5b78009820 tx=0x7f5b7802a270 comp rx=0 tx=0).stop 2024-09-19T08:43:28.376 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.576+0000 7f5b8caa3640 1 -- 172.21.15.19:0/1436381417 shutdown_connections 2024-09-19T08:43:28.377 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.576+0000 7f5b8caa3640 1 --2- 172.21.15.19:0/1436381417 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b88108180 0x7f5b8810a570 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:28.377 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.576+0000 7f5b8caa3640 1 -- 172.21.15.19:0/1436381417 >> 172.21.15.19:0/1436381417 conn(0x7f5b88101da0 msgr2=0x7f5b881041c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:28.377 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.576+0000 7f5b8caa3640 1 -- 172.21.15.19:0/1436381417 shutdown_connections 2024-09-19T08:43:28.377 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.576+0000 7f5b8caa3640 1 -- 172.21.15.19:0/1436381417 wait complete. 2024-09-19T08:43:28.377 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.576+0000 7f5b8caa3640 1 Processor -- start 2024-09-19T08:43:28.377 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.576+0000 7f5b8caa3640 1 -- start start 2024-09-19T08:43:28.377 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.577+0000 7f5b8caa3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b88108180 0x7f5b88107a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:28.377 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.577+0000 7f5b8caa3640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5b8810bb30 con 0x7f5b88108180 2024-09-19T08:43:28.377 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.577+0000 7f5b8659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b88108180 0x7f5b88107a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:28.377 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.577+0000 7f5b8659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b88108180 0x7f5b88107a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49962/0 (socket says 172.21.15.19:49962) 2024-09-19T08:43:28.377 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.577+0000 7f5b8659c640 1 -- 172.21.15.19:0/258615901 learned_addr learned my addr 172.21.15.19:0/258615901 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:43:28.378 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.577+0000 7f5b8659c640 1 -- 172.21.15.19:0/258615901 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b88107f40 con 0x7f5b88108180 2024-09-19T08:43:28.378 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.577+0000 7f5b8659c640 1 --2- 172.21.15.19:0/258615901 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b88108180 0x7f5b88107a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5b78030380 tx=0x7f5b78032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:28.378 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.577+0000 7f5b777fe640 1 -- 172.21.15.19:0/258615901 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b78037040 con 0x7f5b88108180 2024-09-19T08:43:28.378 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.578+0000 7f5b8caa3640 1 -- 172.21.15.19:0/258615901 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b88106130 con 0x7f5b88108180 2024-09-19T08:43:28.378 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.578+0000 7f5b777fe640 1 -- 172.21.15.19:0/258615901 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5b78040070 con 0x7f5b88108180 2024-09-19T08:43:28.378 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.578+0000 7f5b777fe640 1 -- 172.21.15.19:0/258615901 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5b7803a7b0 con 0x7f5b88108180 2024-09-19T08:43:28.378 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.578+0000 7f5b8caa3640 1 -- 172.21.15.19:0/258615901 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b88106670 con 0x7f5b88108180 2024-09-19T08:43:28.378 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.579+0000 7f5b777fe640 1 -- 172.21.15.19:0/258615901 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f5b7803aa30 con 0x7f5b88108180 2024-09-19T08:43:28.378 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.579+0000 7f5b777fe640 1 --2- 172.21.15.19:0/258615901 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5b70039200 0x7f5b7003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:28.378 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.579+0000 7f5b777fe640 1 -- 172.21.15.19:0/258615901 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f5b7806ca40 con 0x7f5b88108180 2024-09-19T08:43:28.378 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.579+0000 7f5b8caa3640 1 -- 172.21.15.19:0/258615901 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b881085e0 con 0x7f5b88108180 2024-09-19T08:43:28.378 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.579+0000 7f5b85d9b640 1 --2- 172.21.15.19:0/258615901 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5b70039200 0x7f5b7003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:28.379 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.579+0000 7f5b85d9b640 1 --2- 172.21.15.19:0/258615901 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5b70039200 0x7f5b7003b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c0098c0 tx=0x7f5b7c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:28.379 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.584+0000 7f5b777fe640 1 -- 172.21.15.19:0/258615901 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5b78044c70 con 0x7f5b88108180 2024-09-19T08:43:28.379 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.761+0000 7f5b8caa3640 1 -- 172.21.15.19:0/258615901 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f5b88106cf0 con 0x7f5b88108180 2024-09-19T08:43:28.379 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.761+0000 7f5b777fe640 1 -- 172.21.15.19:0/258615901 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f5b78041270 con 0x7f5b88108180 2024-09-19T08:43:28.379 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.763+0000 7f5b8caa3640 1 -- 172.21.15.19:0/258615901 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5b70039200 msgr2=0x7f5b7003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:28.379 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.763+0000 7f5b8caa3640 1 --2- 172.21.15.19:0/258615901 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5b70039200 0x7f5b7003b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c0098c0 tx=0x7f5b7c006db0 comp rx=0 tx=0).stop 2024-09-19T08:43:28.379 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.763+0000 7f5b8caa3640 1 -- 172.21.15.19:0/258615901 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b88108180 msgr2=0x7f5b88107a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:28.379 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.763+0000 7f5b8caa3640 1 --2- 172.21.15.19:0/258615901 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b88108180 0x7f5b88107a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5b78030380 tx=0x7f5b78032670 comp rx=0 tx=0).stop 2024-09-19T08:43:28.379 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.763+0000 7f5b8caa3640 1 -- 172.21.15.19:0/258615901 shutdown_connections 2024-09-19T08:43:28.380 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.763+0000 7f5b8caa3640 1 --2- 172.21.15.19:0/258615901 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5b70039200 0x7f5b7003b6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:28.380 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.763+0000 7f5b8caa3640 1 --2- 172.21.15.19:0/258615901 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5b88108180 0x7f5b88107a00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:28.380 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.763+0000 7f5b8caa3640 1 -- 172.21.15.19:0/258615901 >> 172.21.15.19:0/258615901 conn(0x7f5b88101da0 msgr2=0x7f5b881028e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:28.380 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.763+0000 7f5b8caa3640 1 -- 172.21.15.19:0/258615901 shutdown_connections 2024-09-19T08:43:28.380 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:26.763+0000 7f5b8caa3640 1 -- 172.21.15.19:0/258615901 wait complete. 2024-09-19T08:43:28.385 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T08:43:28.385 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout disabled 2024-09-19T08:43:28.394 INFO:teuthology.orchestra.run.smithi019.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T08:43:28.394 INFO:teuthology.orchestra.run.smithi019.stdout:systemctl: stdout inactive 2024-09-19T08:43:28.394 INFO:teuthology.orchestra.run.smithi019.stdout:firewalld.service is not enabled 2024-09-19T08:43:28.395 INFO:teuthology.orchestra.run.smithi019.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-19T08:43:28.395 INFO:teuthology.orchestra.run.smithi019.stdout:Ceph Dashboard is now available at: 2024-09-19T08:43:28.396 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:43:28.396 INFO:teuthology.orchestra.run.smithi019.stdout: URL: https://smithi019.front.sepia.ceph.com:8443/ 2024-09-19T08:43:28.396 INFO:teuthology.orchestra.run.smithi019.stdout: User: admin 2024-09-19T08:43:28.396 INFO:teuthology.orchestra.run.smithi019.stdout: Password: opbrq2yzrz 2024-09-19T08:43:28.396 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:43:28.396 INFO:teuthology.orchestra.run.smithi019.stdout:Saving cluster configuration to /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/config directory 2024-09-19T08:43:29.681 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:29 smithi019 ceph-mon[30976]: mgrmap e13: x(active, since 6s) 2024-09-19T08:43:29.682 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:29 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/64025853' entity='client.admin' 2024-09-19T08:43:29.690 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.827+0000 7f250f06a640 1 Processor -- start 2024-09-19T08:43:29.690 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.827+0000 7f250f06a640 1 -- start start 2024-09-19T08:43:29.690 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.827+0000 7f250f06a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2508107720 0x7f2508107b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:29.690 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.828+0000 7f250f06a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f25081080f0 con 0x7f2508107720 2024-09-19T08:43:29.690 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.828+0000 7f250ce06640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2508107720 0x7f2508107b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:29.690 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.828+0000 7f250ce06640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2508107720 0x7f2508107b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49970/0 (socket says 172.21.15.19:49970) 2024-09-19T08:43:29.690 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.828+0000 7f250ce06640 1 -- 172.21.15.19:0/615364200 learned_addr learned my addr 172.21.15.19:0/615364200 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:43:29.690 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.828+0000 7f250ce06640 1 -- 172.21.15.19:0/615364200 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2508108920 con 0x7f2508107720 2024-09-19T08:43:29.690 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.829+0000 7f250ce06640 1 --2- 172.21.15.19:0/615364200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2508107720 0x7f2508107b20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f24f8009820 tx=0x7f24f802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a975acac3362a8bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:29.691 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.829+0000 7f25077fe640 1 -- 172.21.15.19:0/615364200 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24f8037070 con 0x7f2508107720 2024-09-19T08:43:29.691 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.829+0000 7f25077fe640 1 -- 172.21.15.19:0/615364200 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24f8032920 con 0x7f2508107720 2024-09-19T08:43:29.691 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.829+0000 7f25077fe640 1 -- 172.21.15.19:0/615364200 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24f8030810 con 0x7f2508107720 2024-09-19T08:43:29.691 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.830+0000 7f250f06a640 1 -- 172.21.15.19:0/615364200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2508107720 msgr2=0x7f2508107b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:29.691 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.830+0000 7f250f06a640 1 --2- 172.21.15.19:0/615364200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2508107720 0x7f2508107b20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f24f8009820 tx=0x7f24f802a270 comp rx=0 tx=0).stop 2024-09-19T08:43:29.691 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.830+0000 7f250f06a640 1 -- 172.21.15.19:0/615364200 shutdown_connections 2024-09-19T08:43:29.691 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.830+0000 7f250f06a640 1 --2- 172.21.15.19:0/615364200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2508107720 0x7f2508107b20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:29.691 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.830+0000 7f250f06a640 1 -- 172.21.15.19:0/615364200 >> 172.21.15.19:0/615364200 conn(0x7f2508102ed0 msgr2=0x7f25081052f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:29.691 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.830+0000 7f250f06a640 1 -- 172.21.15.19:0/615364200 shutdown_connections 2024-09-19T08:43:29.691 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.830+0000 7f250f06a640 1 -- 172.21.15.19:0/615364200 wait complete. 2024-09-19T08:43:29.691 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.830+0000 7f250f06a640 1 Processor -- start 2024-09-19T08:43:29.691 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.830+0000 7f250f06a640 1 -- start start 2024-09-19T08:43:29.692 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.831+0000 7f250f06a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2508107720 0x7f250819b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:29.692 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.831+0000 7f250f06a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f250810bcd0 con 0x7f2508107720 2024-09-19T08:43:29.692 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.831+0000 7f250ce06640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2508107720 0x7f250819b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:29.692 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.831+0000 7f250ce06640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2508107720 0x7f250819b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49982/0 (socket says 172.21.15.19:49982) 2024-09-19T08:43:29.692 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.831+0000 7f250ce06640 1 -- 172.21.15.19:0/64025853 learned_addr learned my addr 172.21.15.19:0/64025853 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:43:29.692 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.831+0000 7f250ce06640 1 -- 172.21.15.19:0/64025853 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f250819bc80 con 0x7f2508107720 2024-09-19T08:43:29.692 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.831+0000 7f250ce06640 1 --2- 172.21.15.19:0/64025853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2508107720 0x7f250819b740 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f24f80097f0 tx=0x7f24f80327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:29.692 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.831+0000 7f2505ffb640 1 -- 172.21.15.19:0/64025853 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24f8037040 con 0x7f2508107720 2024-09-19T08:43:29.692 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.831+0000 7f250f06a640 1 -- 172.21.15.19:0/64025853 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f250819bf10 con 0x7f2508107720 2024-09-19T08:43:29.692 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.831+0000 7f2505ffb640 1 -- 172.21.15.19:0/64025853 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f24f8030c40 con 0x7f2508107720 2024-09-19T08:43:29.692 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.831+0000 7f2505ffb640 1 -- 172.21.15.19:0/64025853 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24f803a5b0 con 0x7f2508107720 2024-09-19T08:43:29.693 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.832+0000 7f250f06a640 1 -- 172.21.15.19:0/64025853 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f250819ec00 con 0x7f2508107720 2024-09-19T08:43:29.693 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.833+0000 7f2505ffb640 1 -- 172.21.15.19:0/64025853 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f24f803a7f0 con 0x7f2508107720 2024-09-19T08:43:29.693 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.833+0000 7f250f06a640 1 -- 172.21.15.19:0/64025853 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2508107ba0 con 0x7f2508107720 2024-09-19T08:43:29.693 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.833+0000 7f2505ffb640 1 --2- 172.21.15.19:0/64025853 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f24f00392a0 0x7f24f003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:29.693 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.833+0000 7f2505ffb640 1 -- 172.21.15.19:0/64025853 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f24f806c9e0 con 0x7f2508107720 2024-09-19T08:43:29.693 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.833+0000 7f2507fff640 1 --2- 172.21.15.19:0/64025853 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f24f00392a0 0x7f24f003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:29.693 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.834+0000 7f2507fff640 1 --2- 172.21.15.19:0/64025853 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f24f00392a0 0x7f24f003b760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f24fc0098c0 tx=0x7f24fc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:29.693 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:28.838+0000 7f2505ffb640 1 -- 172.21.15.19:0/64025853 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f24f8039950 con 0x7f2508107720 2024-09-19T08:43:29.693 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:29.105+0000 7f250f06a640 1 -- 172.21.15.19:0/64025853 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f250819f1f0 con 0x7f2508107720 2024-09-19T08:43:29.693 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:29.108+0000 7f2505ffb640 1 -- 172.21.15.19:0/64025853 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7f24f8031c30 con 0x7f2508107720 2024-09-19T08:43:29.693 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-19T08:43:29.693 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:29.110+0000 7f250f06a640 1 -- 172.21.15.19:0/64025853 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f24f00392a0 msgr2=0x7f24f003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:29.693 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:29.110+0000 7f250f06a640 1 --2- 172.21.15.19:0/64025853 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f24f00392a0 0x7f24f003b760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f24fc0098c0 tx=0x7f24fc006db0 comp rx=0 tx=0).stop 2024-09-19T08:43:29.694 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:29.110+0000 7f250f06a640 1 -- 172.21.15.19:0/64025853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2508107720 msgr2=0x7f250819b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:29.694 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:29.110+0000 7f250f06a640 1 --2- 172.21.15.19:0/64025853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2508107720 0x7f250819b740 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f24f80097f0 tx=0x7f24f80327b0 comp rx=0 tx=0).stop 2024-09-19T08:43:29.694 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:29.110+0000 7f250f06a640 1 -- 172.21.15.19:0/64025853 shutdown_connections 2024-09-19T08:43:29.694 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:29.110+0000 7f250f06a640 1 --2- 172.21.15.19:0/64025853 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f24f00392a0 0x7f24f003b760 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:29.694 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:29.110+0000 7f250f06a640 1 --2- 172.21.15.19:0/64025853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2508107720 0x7f250819b740 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:29.694 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:29.110+0000 7f250f06a640 1 -- 172.21.15.19:0/64025853 >> 172.21.15.19:0/64025853 conn(0x7f2508102ed0 msgr2=0x7f2508103ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:29.694 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:29.110+0000 7f250f06a640 1 -- 172.21.15.19:0/64025853 shutdown_connections 2024-09-19T08:43:29.694 INFO:teuthology.orchestra.run.smithi019.stdout:/usr/bin/ceph: stderr 2024-09-19T08:43:29.110+0000 7f250f06a640 1 -- 172.21.15.19:0/64025853 wait complete. 2024-09-19T08:43:29.694 INFO:teuthology.orchestra.run.smithi019.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-19T08:43:29.694 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:43:29.694 INFO:teuthology.orchestra.run.smithi019.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-19T08:43:29.694 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:43:29.694 INFO:teuthology.orchestra.run.smithi019.stdout:Or, if you are only running a single cluster on this host: 2024-09-19T08:43:29.695 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:43:29.695 INFO:teuthology.orchestra.run.smithi019.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-19T08:43:29.695 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:43:29.695 INFO:teuthology.orchestra.run.smithi019.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-19T08:43:29.695 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:43:29.695 INFO:teuthology.orchestra.run.smithi019.stdout: ceph telemetry on 2024-09-19T08:43:29.695 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:43:29.695 INFO:teuthology.orchestra.run.smithi019.stdout:For more information see: 2024-09-19T08:43:29.695 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:43:29.695 INFO:teuthology.orchestra.run.smithi019.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-19T08:43:29.695 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:43:29.695 INFO:teuthology.orchestra.run.smithi019.stdout:Bootstrap complete. 2024-09-19T08:43:29.733 INFO:tasks.cephadm:Fetching config... 2024-09-19T08:43:29.733 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-19T08:43:29.733 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-19T08:43:29.750 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-19T08:43:29.750 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-19T08:43:29.750 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-19T08:43:29.806 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-19T08:43:29.806 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-19T08:43:29.806 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-19T08:43:29.874 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-19T08:43:29.875 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-19T08:43:29.875 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-19T08:43:29.930 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-19T08:43:29.931 DEBUG:teuthology.orchestra.run.smithi019:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbxPw5mebZVdLuKRB/6k/ikm/VNDGI+IsxM+APD/Pkxq7EAK/2vi1vNfMGvK/RTO6ibxmPw989OpsicUmFUL1WMWn7EE9AuQNmIX3nsc8FtDfz5dGaxFEVF7ID2gf/nMzbO/Wt69aVgHAztYmjgEioxpvvmu8FuN6G5GnFA1hfVBFLAPwEP03EqONWQj/PbT9SkJVfe0OCL1+43RLgVg+hdjn0Y/LluhEM/XAGONV2bsXiWEonPWte6WtkPlDdg78K9KG4GZu6b5W1axKTYFen25L7CQOECbwv6hNknQsZ82KGdXUyi2hBBuo2F0WUjUNv0lqMCzGDO5oHg8iEYRGnG546TXqx5Ceq3SX2GWpM00DFFNM2j/OlrNesHxaqLvlwkQA0iZiyR6ez3K/83sPNYVRlrl8xomFxS8N0Y8I1CabknV6tX6S3yENCnfddG6sAVkBHIzPrr7+2OQ8ZmxhH0NbkMx3kLCrKHvb8YWAVvLxxdswFMtANq9yi/QxSU7E= ceph-f26c9d84-7662-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T08:43:30.010 INFO:teuthology.orchestra.run.smithi019.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbxPw5mebZVdLuKRB/6k/ikm/VNDGI+IsxM+APD/Pkxq7EAK/2vi1vNfMGvK/RTO6ibxmPw989OpsicUmFUL1WMWn7EE9AuQNmIX3nsc8FtDfz5dGaxFEVF7ID2gf/nMzbO/Wt69aVgHAztYmjgEioxpvvmu8FuN6G5GnFA1hfVBFLAPwEP03EqONWQj/PbT9SkJVfe0OCL1+43RLgVg+hdjn0Y/LluhEM/XAGONV2bsXiWEonPWte6WtkPlDdg78K9KG4GZu6b5W1axKTYFen25L7CQOECbwv6hNknQsZ82KGdXUyi2hBBuo2F0WUjUNv0lqMCzGDO5oHg8iEYRGnG546TXqx5Ceq3SX2GWpM00DFFNM2j/OlrNesHxaqLvlwkQA0iZiyR6ez3K/83sPNYVRlrl8xomFxS8N0Y8I1CabknV6tX6S3yENCnfddG6sAVkBHIzPrr7+2OQ8ZmxhH0NbkMx3kLCrKHvb8YWAVvLxxdswFMtANq9yi/QxSU7E= ceph-f26c9d84-7662-11ef-bceb-c7b262605968 2024-09-19T08:43:30.022 DEBUG:teuthology.orchestra.run.smithi155:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbxPw5mebZVdLuKRB/6k/ikm/VNDGI+IsxM+APD/Pkxq7EAK/2vi1vNfMGvK/RTO6ibxmPw989OpsicUmFUL1WMWn7EE9AuQNmIX3nsc8FtDfz5dGaxFEVF7ID2gf/nMzbO/Wt69aVgHAztYmjgEioxpvvmu8FuN6G5GnFA1hfVBFLAPwEP03EqONWQj/PbT9SkJVfe0OCL1+43RLgVg+hdjn0Y/LluhEM/XAGONV2bsXiWEonPWte6WtkPlDdg78K9KG4GZu6b5W1axKTYFen25L7CQOECbwv6hNknQsZ82KGdXUyi2hBBuo2F0WUjUNv0lqMCzGDO5oHg8iEYRGnG546TXqx5Ceq3SX2GWpM00DFFNM2j/OlrNesHxaqLvlwkQA0iZiyR6ez3K/83sPNYVRlrl8xomFxS8N0Y8I1CabknV6tX6S3yENCnfddG6sAVkBHIzPrr7+2OQ8ZmxhH0NbkMx3kLCrKHvb8YWAVvLxxdswFMtANq9yi/QxSU7E= ceph-f26c9d84-7662-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T08:43:30.064 INFO:teuthology.orchestra.run.smithi155.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbxPw5mebZVdLuKRB/6k/ikm/VNDGI+IsxM+APD/Pkxq7EAK/2vi1vNfMGvK/RTO6ibxmPw989OpsicUmFUL1WMWn7EE9AuQNmIX3nsc8FtDfz5dGaxFEVF7ID2gf/nMzbO/Wt69aVgHAztYmjgEioxpvvmu8FuN6G5GnFA1hfVBFLAPwEP03EqONWQj/PbT9SkJVfe0OCL1+43RLgVg+hdjn0Y/LluhEM/XAGONV2bsXiWEonPWte6WtkPlDdg78K9KG4GZu6b5W1axKTYFen25L7CQOECbwv6hNknQsZ82KGdXUyi2hBBuo2F0WUjUNv0lqMCzGDO5oHg8iEYRGnG546TXqx5Ceq3SX2GWpM00DFFNM2j/OlrNesHxaqLvlwkQA0iZiyR6ez3K/83sPNYVRlrl8xomFxS8N0Y8I1CabknV6tX6S3yENCnfddG6sAVkBHIzPrr7+2OQ8ZmxhH0NbkMx3kLCrKHvb8YWAVvLxxdswFMtANq9yi/QxSU7E= ceph-f26c9d84-7662-11ef-bceb-c7b262605968 2024-09-19T08:43:30.077 DEBUG:teuthology.orchestra.run.smithi203:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbxPw5mebZVdLuKRB/6k/ikm/VNDGI+IsxM+APD/Pkxq7EAK/2vi1vNfMGvK/RTO6ibxmPw989OpsicUmFUL1WMWn7EE9AuQNmIX3nsc8FtDfz5dGaxFEVF7ID2gf/nMzbO/Wt69aVgHAztYmjgEioxpvvmu8FuN6G5GnFA1hfVBFLAPwEP03EqONWQj/PbT9SkJVfe0OCL1+43RLgVg+hdjn0Y/LluhEM/XAGONV2bsXiWEonPWte6WtkPlDdg78K9KG4GZu6b5W1axKTYFen25L7CQOECbwv6hNknQsZ82KGdXUyi2hBBuo2F0WUjUNv0lqMCzGDO5oHg8iEYRGnG546TXqx5Ceq3SX2GWpM00DFFNM2j/OlrNesHxaqLvlwkQA0iZiyR6ez3K/83sPNYVRlrl8xomFxS8N0Y8I1CabknV6tX6S3yENCnfddG6sAVkBHIzPrr7+2OQ8ZmxhH0NbkMx3kLCrKHvb8YWAVvLxxdswFMtANq9yi/QxSU7E= ceph-f26c9d84-7662-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T08:43:30.120 INFO:teuthology.orchestra.run.smithi203.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCbxPw5mebZVdLuKRB/6k/ikm/VNDGI+IsxM+APD/Pkxq7EAK/2vi1vNfMGvK/RTO6ibxmPw989OpsicUmFUL1WMWn7EE9AuQNmIX3nsc8FtDfz5dGaxFEVF7ID2gf/nMzbO/Wt69aVgHAztYmjgEioxpvvmu8FuN6G5GnFA1hfVBFLAPwEP03EqONWQj/PbT9SkJVfe0OCL1+43RLgVg+hdjn0Y/LluhEM/XAGONV2bsXiWEonPWte6WtkPlDdg78K9KG4GZu6b5W1axKTYFen25L7CQOECbwv6hNknQsZ82KGdXUyi2hBBuo2F0WUjUNv0lqMCzGDO5oHg8iEYRGnG546TXqx5Ceq3SX2GWpM00DFFNM2j/OlrNesHxaqLvlwkQA0iZiyR6ez3K/83sPNYVRlrl8xomFxS8N0Y8I1CabknV6tX6S3yENCnfddG6sAVkBHIzPrr7+2OQ8ZmxhH0NbkMx3kLCrKHvb8YWAVvLxxdswFMtANq9yi/QxSU7E= ceph-f26c9d84-7662-11ef-bceb-c7b262605968 2024-09-19T08:43:30.132 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-19T08:43:30.398 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:31.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:30.867+0000 7f397eceb640 1 -- 172.21.15.19:0/3612804368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3978100540 msgr2=0x7f3978100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:31.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:30.867+0000 7f397eceb640 1 --2- 172.21.15.19:0/3612804368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3978100540 0x7f3978100940 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f396c009880 tx=0x7f396c02a5d0 comp rx=0 tx=0).stop 2024-09-19T08:43:31.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:30.867+0000 7f397eceb640 1 -- 172.21.15.19:0/3612804368 shutdown_connections 2024-09-19T08:43:31.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:30.867+0000 7f397eceb640 1 --2- 172.21.15.19:0/3612804368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3978100540 0x7f3978100940 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:31.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:30.867+0000 7f397eceb640 1 -- 172.21.15.19:0/3612804368 >> 172.21.15.19:0/3612804368 conn(0x7f39780fbcd0 msgr2=0x7f39780fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:31.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:30.867+0000 7f397eceb640 1 -- 172.21.15.19:0/3612804368 shutdown_connections 2024-09-19T08:43:31.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:30.867+0000 7f397eceb640 1 -- 172.21.15.19:0/3612804368 wait complete. 2024-09-19T08:43:31.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:30.868+0000 7f397eceb640 1 Processor -- start 2024-09-19T08:43:31.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:30.868+0000 7f397eceb640 1 -- start start 2024-09-19T08:43:31.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:30.868+0000 7f397eceb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3978100540 0x7f397818d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:31.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:30.868+0000 7f397eceb640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f39781065f0 con 0x7f3978100540 2024-09-19T08:43:31.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:30.868+0000 7f397ca87640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3978100540 0x7f397818d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:31.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:30.868+0000 7f397ca87640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3978100540 0x7f397818d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49998/0 (socket says 172.21.15.19:49998) 2024-09-19T08:43:31.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:30.868+0000 7f397ca87640 1 -- 172.21.15.19:0/3195116591 learned_addr learned my addr 172.21.15.19:0/3195116591 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:43:31.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:30.868+0000 7f397ca87640 1 -- 172.21.15.19:0/3195116591 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f397818dc60 con 0x7f3978100540 2024-09-19T08:43:31.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:30.868+0000 7f397ca87640 1 --2- 172.21.15.19:0/3195116591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3978100540 0x7f397818d720 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f396c004f60 tx=0x7f396c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:31.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:30.869+0000 7f3975ffb640 1 -- 172.21.15.19:0/3195116591 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f396c03f070 con 0x7f3978100540 2024-09-19T08:43:31.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:30.869+0000 7f3975ffb640 1 -- 172.21.15.19:0/3195116591 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f396c004d40 con 0x7f3978100540 2024-09-19T08:43:31.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:30.869+0000 7f397eceb640 1 -- 172.21.15.19:0/3195116591 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f397818be50 con 0x7f3978100540 2024-09-19T08:43:31.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:30.869+0000 7f3975ffb640 1 -- 172.21.15.19:0/3195116591 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f396c035030 con 0x7f3978100540 2024-09-19T08:43:31.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:30.869+0000 7f397eceb640 1 -- 172.21.15.19:0/3195116591 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f397818c390 con 0x7f3978100540 2024-09-19T08:43:31.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:30.870+0000 7f3975ffb640 1 -- 172.21.15.19:0/3195116591 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f396c042070 con 0x7f3978100540 2024-09-19T08:43:31.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:30.870+0000 7f3975ffb640 1 --2- 172.21.15.19:0/3195116591 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f39680392a0 0x7f396803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:31.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:30.870+0000 7f3975ffb640 1 -- 172.21.15.19:0/3195116591 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f396c072020 con 0x7f3978100540 2024-09-19T08:43:31.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:30.870+0000 7f397eceb640 1 -- 172.21.15.19:0/3195116591 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3978106d70 con 0x7f3978100540 2024-09-19T08:43:31.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:30.870+0000 7f3977fff640 1 --2- 172.21.15.19:0/3195116591 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f39680392a0 0x7f396803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:31.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:30.871+0000 7f3977fff640 1 --2- 172.21.15.19:0/3195116591 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f39680392a0 0x7f396803b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f39640098c0 tx=0x7f3964006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:31.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:30.875+0000 7f3975ffb640 1 -- 172.21.15.19:0/3195116591 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f396c003e10 con 0x7f3978100540 2024-09-19T08:43:31.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:31.055+0000 7f397eceb640 1 -- 172.21.15.19:0/3195116591 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f39781009c0 con 0x7f3978100540 2024-09-19T08:43:31.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:31.057+0000 7f3975ffb640 1 -- 172.21.15.19:0/3195116591 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f396c039d70 con 0x7f3978100540 2024-09-19T08:43:31.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:31.060+0000 7f397eceb640 1 -- 172.21.15.19:0/3195116591 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f39680392a0 msgr2=0x7f396803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:31.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:31.060+0000 7f397eceb640 1 --2- 172.21.15.19:0/3195116591 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f39680392a0 0x7f396803b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f39640098c0 tx=0x7f3964006db0 comp rx=0 tx=0).stop 2024-09-19T08:43:31.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:31.060+0000 7f397eceb640 1 -- 172.21.15.19:0/3195116591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3978100540 msgr2=0x7f397818d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:31.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:31.060+0000 7f397eceb640 1 --2- 172.21.15.19:0/3195116591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3978100540 0x7f397818d720 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f396c004f60 tx=0x7f396c0048f0 comp rx=0 tx=0).stop 2024-09-19T08:43:31.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:31.060+0000 7f397eceb640 1 -- 172.21.15.19:0/3195116591 shutdown_connections 2024-09-19T08:43:31.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:31.060+0000 7f397eceb640 1 --2- 172.21.15.19:0/3195116591 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f39680392a0 0x7f396803b760 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:31.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:31.060+0000 7f397eceb640 1 --2- 172.21.15.19:0/3195116591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3978100540 0x7f397818d720 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:31.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:31.060+0000 7f397eceb640 1 -- 172.21.15.19:0/3195116591 >> 172.21.15.19:0/3195116591 conn(0x7f39780fbcd0 msgr2=0x7f39780fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:31.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:31.060+0000 7f397eceb640 1 -- 172.21.15.19:0/3195116591 shutdown_connections 2024-09-19T08:43:31.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:31.060+0000 7f397eceb640 1 -- 172.21.15.19:0/3195116591 wait complete. 2024-09-19T08:43:32.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:32 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3195116591' entity='client.admin' 2024-09-19T08:43:32.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:32 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:43:32.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:32 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:43:32.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:32 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi019", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:43:32.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:32 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:43:32.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:32 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:43:32.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:32 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:43:32.364 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-19T08:43:32.364 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-19T08:43:32.617 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:33.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.145+0000 7f115467d640 1 -- 172.21.15.19:0/3996000984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f114c102150 msgr2=0x7f114c104540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:33.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.145+0000 7f115467d640 1 --2- 172.21.15.19:0/3996000984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f114c102150 0x7f114c104540 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1148009880 tx=0x7f114802a5d0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.145+0000 7f115467d640 1 -- 172.21.15.19:0/3996000984 shutdown_connections 2024-09-19T08:43:33.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.145+0000 7f115467d640 1 --2- 172.21.15.19:0/3996000984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f114c102150 0x7f114c104540 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.145+0000 7f115467d640 1 -- 172.21.15.19:0/3996000984 >> 172.21.15.19:0/3996000984 conn(0x7f114c0fbcd0 msgr2=0x7f114c0fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:33.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.145+0000 7f115467d640 1 -- 172.21.15.19:0/3996000984 shutdown_connections 2024-09-19T08:43:33.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.145+0000 7f115467d640 1 -- 172.21.15.19:0/3996000984 wait complete. 2024-09-19T08:43:33.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.146+0000 7f115467d640 1 Processor -- start 2024-09-19T08:43:33.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.146+0000 7f115467d640 1 -- start start 2024-09-19T08:43:33.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.146+0000 7f115467d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f114c102150 0x7f114c198f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:33.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.146+0000 7f115467d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f114c1076d0 con 0x7f114c102150 2024-09-19T08:43:33.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.146+0000 7f1152419640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f114c102150 0x7f114c198f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:33.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.146+0000 7f1152419640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f114c102150 0x7f114c198f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50014/0 (socket says 172.21.15.19:50014) 2024-09-19T08:43:33.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.146+0000 7f1152419640 1 -- 172.21.15.19:0/3607454531 learned_addr learned my addr 172.21.15.19:0/3607454531 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:43:33.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.146+0000 7f1152419640 1 -- 172.21.15.19:0/3607454531 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f114c199480 con 0x7f114c102150 2024-09-19T08:43:33.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.147+0000 7f1152419640 1 --2- 172.21.15.19:0/3607454531 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f114c102150 0x7f114c198f40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1148004f60 tx=0x7f11480048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:33.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.147+0000 7f11437fe640 1 -- 172.21.15.19:0/3607454531 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f114803f070 con 0x7f114c102150 2024-09-19T08:43:33.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.147+0000 7f11437fe640 1 -- 172.21.15.19:0/3607454531 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1148003ad0 con 0x7f114c102150 2024-09-19T08:43:33.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.147+0000 7f115467d640 1 -- 172.21.15.19:0/3607454531 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f114c199710 con 0x7f114c102150 2024-09-19T08:43:33.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.147+0000 7f11437fe640 1 -- 172.21.15.19:0/3607454531 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1148035030 con 0x7f114c102150 2024-09-19T08:43:33.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.147+0000 7f115467d640 1 -- 172.21.15.19:0/3607454531 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f114c19c400 con 0x7f114c102150 2024-09-19T08:43:33.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.148+0000 7f11437fe640 1 -- 172.21.15.19:0/3607454531 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f1148042070 con 0x7f114c102150 2024-09-19T08:43:33.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.148+0000 7f115467d640 1 -- 172.21.15.19:0/3607454531 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f114c107e50 con 0x7f114c102150 2024-09-19T08:43:33.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.148+0000 7f11437fe640 1 --2- 172.21.15.19:0/3607454531 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1138039300 0x7f113803b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:33.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.148+0000 7f11437fe640 1 -- 172.21.15.19:0/3607454531 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f114806d100 con 0x7f114c102150 2024-09-19T08:43:33.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.148+0000 7f1151c18640 1 --2- 172.21.15.19:0/3607454531 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1138039300 0x7f113803b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:33.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.148+0000 7f1151c18640 1 --2- 172.21.15.19:0/3607454531 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1138039300 0x7f113803b7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f113c0098c0 tx=0x7f113c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:33.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.153+0000 7f11437fe640 1 -- 172.21.15.19:0/3607454531 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1148030d90 con 0x7f114c102150 2024-09-19T08:43:33.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.331+0000 7f115467d640 1 -- 172.21.15.19:0/3607454531 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f114c02d830 con 0x7f1138039300 2024-09-19T08:43:33.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.335+0000 7f11437fe640 1 -- 172.21.15.19:0/3607454531 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f114c02d830 con 0x7f1138039300 2024-09-19T08:43:33.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.337+0000 7f115467d640 1 -- 172.21.15.19:0/3607454531 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1138039300 msgr2=0x7f113803b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:33.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.337+0000 7f115467d640 1 --2- 172.21.15.19:0/3607454531 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1138039300 0x7f113803b7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f113c0098c0 tx=0x7f113c006db0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.337+0000 7f115467d640 1 -- 172.21.15.19:0/3607454531 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f114c102150 msgr2=0x7f114c198f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:33.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.337+0000 7f115467d640 1 --2- 172.21.15.19:0/3607454531 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f114c102150 0x7f114c198f40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1148004f60 tx=0x7f11480048f0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.337+0000 7f115467d640 1 -- 172.21.15.19:0/3607454531 shutdown_connections 2024-09-19T08:43:33.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.337+0000 7f115467d640 1 --2- 172.21.15.19:0/3607454531 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1138039300 0x7f113803b7c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.337+0000 7f115467d640 1 --2- 172.21.15.19:0/3607454531 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f114c102150 0x7f114c198f40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:33.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.337+0000 7f115467d640 1 -- 172.21.15.19:0/3607454531 >> 172.21.15.19:0/3607454531 conn(0x7f114c0fbcd0 msgr2=0x7f114c0fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:33.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.337+0000 7f115467d640 1 -- 172.21.15.19:0/3607454531 shutdown_connections 2024-09-19T08:43:33.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:33.337+0000 7f115467d640 1 -- 172.21.15.19:0/3607454531 wait complete. 2024-09-19T08:43:34.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:34 smithi019 ceph-mon[30976]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:43:34.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:34 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:43:34.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:34 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:43:34.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:34 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:43:34.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:34 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:43:34.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:34 smithi019 ceph-mon[30976]: Updating smithi019:/etc/ceph/ceph.conf 2024-09-19T08:43:34.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:34 smithi019 ceph-mon[30976]: Updating smithi019:/var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:43:34.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:34 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:43:34.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:34 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:43:34.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:34 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:43:34.684 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi155 2024-09-19T08:43:34.684 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-19T08:43:34.684 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/etc/ceph/ceph.conf 2024-09-19T08:43:34.703 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-19T08:43:34.703 DEBUG:teuthology.orchestra.run.smithi155:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:43:34.767 INFO:tasks.cephadm:Adding host smithi155 to orchestrator... 2024-09-19T08:43:34.768 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph orch host add smithi155 2024-09-19T08:43:35.022 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:35.468 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:35 smithi019 ceph-mon[30976]: Updating smithi019:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:43:35.468 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:35 smithi019 ceph-mon[30976]: Updating smithi019:/var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:43:35.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:35.468+0000 7f021e6ac640 1 -- 172.21.15.19:0/3515848528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0218107660 msgr2=0x7f0218107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:35.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:35.468+0000 7f021e6ac640 1 --2- 172.21.15.19:0/3515848528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0218107660 0x7f0218107a40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0208009880 tx=0x7f020802a5d0 comp rx=0 tx=0).stop 2024-09-19T08:43:35.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:35.468+0000 7f021e6ac640 1 -- 172.21.15.19:0/3515848528 shutdown_connections 2024-09-19T08:43:35.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:35.468+0000 7f021e6ac640 1 --2- 172.21.15.19:0/3515848528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0218107660 0x7f0218107a40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:35.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:35.468+0000 7f021e6ac640 1 -- 172.21.15.19:0/3515848528 >> 172.21.15.19:0/3515848528 conn(0x7f02180fd290 msgr2=0x7f02180ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:35.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:35.468+0000 7f021e6ac640 1 -- 172.21.15.19:0/3515848528 shutdown_connections 2024-09-19T08:43:35.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:35.468+0000 7f021e6ac640 1 -- 172.21.15.19:0/3515848528 wait complete. 2024-09-19T08:43:35.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:35.469+0000 7f021e6ac640 1 Processor -- start 2024-09-19T08:43:35.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:35.469+0000 7f021e6ac640 1 -- start start 2024-09-19T08:43:35.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:35.469+0000 7f021e6ac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0218107660 0x7f02181970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:35.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:35.469+0000 7f021e6ac640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f021810bc90 con 0x7f0218107660 2024-09-19T08:43:35.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:35.470+0000 7f0217fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0218107660 0x7f02181970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:35.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:35.470+0000 7f0217fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0218107660 0x7f02181970c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48760/0 (socket says 172.21.15.19:48760) 2024-09-19T08:43:35.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:35.470+0000 7f0217fff640 1 -- 172.21.15.19:0/1548570728 learned_addr learned my addr 172.21.15.19:0/1548570728 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:43:35.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:35.470+0000 7f0217fff640 1 -- 172.21.15.19:0/1548570728 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0218197600 con 0x7f0218107660 2024-09-19T08:43:35.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:35.470+0000 7f0217fff640 1 --2- 172.21.15.19:0/1548570728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0218107660 0x7f02181970c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0208009230 tx=0x7f0208003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:35.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:35.470+0000 7f02157fa640 1 -- 172.21.15.19:0/1548570728 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f020803f070 con 0x7f0218107660 2024-09-19T08:43:35.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:35.470+0000 7f02157fa640 1 -- 172.21.15.19:0/1548570728 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f020803bc80 con 0x7f0218107660 2024-09-19T08:43:35.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:35.470+0000 7f021e6ac640 1 -- 172.21.15.19:0/1548570728 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0218197890 con 0x7f0218107660 2024-09-19T08:43:35.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:35.470+0000 7f02157fa640 1 -- 172.21.15.19:0/1548570728 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0208035030 con 0x7f0218107660 2024-09-19T08:43:35.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:35.470+0000 7f021e6ac640 1 -- 172.21.15.19:0/1548570728 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f021819b990 con 0x7f0218107660 2024-09-19T08:43:35.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:35.471+0000 7f02157fa640 1 -- 172.21.15.19:0/1548570728 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f0208042070 con 0x7f0218107660 2024-09-19T08:43:35.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:35.471+0000 7f02157fa640 1 --2- 172.21.15.19:0/1548570728 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f0200039300 0x7f020003b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:35.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:35.471+0000 7f021e6ac640 1 -- 172.21.15.19:0/1548570728 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0218102cd0 con 0x7f0218107660 2024-09-19T08:43:35.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:35.471+0000 7f02157fa640 1 -- 172.21.15.19:0/1548570728 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f020806cf90 con 0x7f0218107660 2024-09-19T08:43:35.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:35.471+0000 7f02177fe640 1 --2- 172.21.15.19:0/1548570728 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f0200039300 0x7f020003b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:35.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:35.472+0000 7f02177fe640 1 --2- 172.21.15.19:0/1548570728 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f0200039300 0x7f020003b7c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f020c0098c0 tx=0x7f020c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:35.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:35.476+0000 7f02157fa640 1 -- 172.21.15.19:0/1548570728 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f02080314c0 con 0x7f0218107660 2024-09-19T08:43:35.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:35.656+0000 7f021e6ac640 1 -- 172.21.15.19:0/1548570728 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi155", "target": ["mon-mgr", ""]}) -- 0x7f0218107b20 con 0x7f0200039300 2024-09-19T08:43:36.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:36 smithi019 ceph-mon[30976]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi155", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:43:38.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:37 smithi019 ceph-mon[30976]: Deploying cephadm binary to smithi155 2024-09-19T08:43:39.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:39.461+0000 7f02157fa640 1 -- 172.21.15.19:0/1548570728 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f0218107b20 con 0x7f0200039300 2024-09-19T08:43:39.462 INFO:teuthology.orchestra.run.smithi019.stdout:Added host 'smithi155' with addr '172.21.15.155' 2024-09-19T08:43:39.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:39.463+0000 7f021e6ac640 1 -- 172.21.15.19:0/1548570728 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f0200039300 msgr2=0x7f020003b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:39.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:39.463+0000 7f021e6ac640 1 --2- 172.21.15.19:0/1548570728 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f0200039300 0x7f020003b7c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f020c0098c0 tx=0x7f020c006db0 comp rx=0 tx=0).stop 2024-09-19T08:43:39.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:39.463+0000 7f021e6ac640 1 -- 172.21.15.19:0/1548570728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0218107660 msgr2=0x7f02181970c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:39.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:39.463+0000 7f021e6ac640 1 --2- 172.21.15.19:0/1548570728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0218107660 0x7f02181970c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0208009230 tx=0x7f0208003d40 comp rx=0 tx=0).stop 2024-09-19T08:43:39.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:39.464+0000 7f021e6ac640 1 -- 172.21.15.19:0/1548570728 shutdown_connections 2024-09-19T08:43:39.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:39.464+0000 7f021e6ac640 1 --2- 172.21.15.19:0/1548570728 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f0200039300 0x7f020003b7c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:39.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:39.464+0000 7f021e6ac640 1 --2- 172.21.15.19:0/1548570728 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0218107660 0x7f02181970c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:39.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:39.464+0000 7f021e6ac640 1 -- 172.21.15.19:0/1548570728 >> 172.21.15.19:0/1548570728 conn(0x7f02180fd290 msgr2=0x7f02180febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:39.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:39.464+0000 7f021e6ac640 1 -- 172.21.15.19:0/1548570728 shutdown_connections 2024-09-19T08:43:39.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:39.464+0000 7f021e6ac640 1 -- 172.21.15.19:0/1548570728 wait complete. 2024-09-19T08:43:40.083 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T08:43:40.344 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:40.771 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:40 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:43:40.771 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:40 smithi019 ceph-mon[30976]: Added host smithi155 2024-09-19T08:43:40.771 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:40 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:43:40.771 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:40 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:43:40.771 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:40 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:43:40.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.770+0000 7f5721420640 1 -- 172.21.15.19:0/3833269893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f571c1027d0 msgr2=0x7f571c102bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:40.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.770+0000 7f5721420640 1 --2- 172.21.15.19:0/3833269893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f571c1027d0 0x7f571c102bb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f570c009c10 tx=0x7f570c02aa10 comp rx=0 tx=0).stop 2024-09-19T08:43:40.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.770+0000 7f5721420640 1 -- 172.21.15.19:0/3833269893 shutdown_connections 2024-09-19T08:43:40.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.770+0000 7f5721420640 1 --2- 172.21.15.19:0/3833269893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f571c1027d0 0x7f571c102bb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:40.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.770+0000 7f5721420640 1 -- 172.21.15.19:0/3833269893 >> 172.21.15.19:0/3833269893 conn(0x7f571c077310 msgr2=0x7f571c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:40.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.770+0000 7f5721420640 1 -- 172.21.15.19:0/3833269893 shutdown_connections 2024-09-19T08:43:40.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.770+0000 7f5721420640 1 -- 172.21.15.19:0/3833269893 wait complete. 2024-09-19T08:43:40.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.771+0000 7f5721420640 1 Processor -- start 2024-09-19T08:43:40.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.771+0000 7f5721420640 1 -- start start 2024-09-19T08:43:40.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.771+0000 7f5721420640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f571c1027d0 0x7f571c100430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:40.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.772+0000 7f5721420640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f571c10bc80 con 0x7f571c1027d0 2024-09-19T08:43:40.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.772+0000 7f571affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f571c1027d0 0x7f571c100430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:40.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.772+0000 7f571affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f571c1027d0 0x7f571c100430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48792/0 (socket says 172.21.15.19:48792) 2024-09-19T08:43:40.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.772+0000 7f571affd640 1 -- 172.21.15.19:0/2157646242 learned_addr learned my addr 172.21.15.19:0/2157646242 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:43:40.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.772+0000 7f571affd640 1 -- 172.21.15.19:0/2157646242 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f571c102320 con 0x7f571c1027d0 2024-09-19T08:43:40.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.772+0000 7f571affd640 1 --2- 172.21.15.19:0/2157646242 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f571c1027d0 0x7f571c100430 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f570c005dd0 tx=0x7f570c030c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:40.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.772+0000 7f5703fff640 1 -- 172.21.15.19:0/2157646242 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f570c034070 con 0x7f571c1027d0 2024-09-19T08:43:40.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.772+0000 7f5703fff640 1 -- 172.21.15.19:0/2157646242 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f570c02f8c0 con 0x7f571c1027d0 2024-09-19T08:43:40.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.772+0000 7f5721420640 1 -- 172.21.15.19:0/2157646242 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f571c100970 con 0x7f571c1027d0 2024-09-19T08:43:40.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.773+0000 7f5703fff640 1 -- 172.21.15.19:0/2157646242 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f570c004520 con 0x7f571c1027d0 2024-09-19T08:43:40.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.773+0000 7f5721420640 1 -- 172.21.15.19:0/2157646242 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f571c100d70 con 0x7f571c1027d0 2024-09-19T08:43:40.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.773+0000 7f5703fff640 1 -- 172.21.15.19:0/2157646242 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f570c037020 con 0x7f571c1027d0 2024-09-19T08:43:40.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.773+0000 7f5721420640 1 -- 172.21.15.19:0/2157646242 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f571c069ef0 con 0x7f571c1027d0 2024-09-19T08:43:40.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.774+0000 7f5703fff640 1 --2- 172.21.15.19:0/2157646242 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5704039300 0x7f570403b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:40.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.774+0000 7f5703fff640 1 -- 172.21.15.19:0/2157646242 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f570c06d180 con 0x7f571c1027d0 2024-09-19T08:43:40.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.774+0000 7f571a7fc640 1 --2- 172.21.15.19:0/2157646242 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5704039300 0x7f570403b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:40.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.774+0000 7f571a7fc640 1 --2- 172.21.15.19:0/2157646242 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5704039300 0x7f570403b7c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f57100098c0 tx=0x7f5710006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:40.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.779+0000 7f5703fff640 1 -- 172.21.15.19:0/2157646242 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f570c03f070 con 0x7f571c1027d0 2024-09-19T08:43:40.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.974+0000 7f5721420640 1 -- 172.21.15.19:0/2157646242 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f571c1019d0 con 0x7f5704039300 2024-09-19T08:43:40.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.975+0000 7f5703fff640 1 -- 172.21.15.19:0/2157646242 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7f571c1019d0 con 0x7f5704039300 2024-09-19T08:43:40.975 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:43:40.976 INFO:teuthology.orchestra.run.smithi019.stdout:[{"addr": "172.21.15.19", "hostname": "smithi019", "labels": [], "status": ""}, {"addr": "172.21.15.155", "hostname": "smithi155", "labels": [], "status": ""}] 2024-09-19T08:43:40.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.977+0000 7f5721420640 1 -- 172.21.15.19:0/2157646242 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5704039300 msgr2=0x7f570403b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:40.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.977+0000 7f5721420640 1 --2- 172.21.15.19:0/2157646242 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5704039300 0x7f570403b7c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f57100098c0 tx=0x7f5710006db0 comp rx=0 tx=0).stop 2024-09-19T08:43:40.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.977+0000 7f5721420640 1 -- 172.21.15.19:0/2157646242 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f571c1027d0 msgr2=0x7f571c100430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:40.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.977+0000 7f5721420640 1 --2- 172.21.15.19:0/2157646242 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f571c1027d0 0x7f571c100430 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f570c005dd0 tx=0x7f570c030c30 comp rx=0 tx=0).stop 2024-09-19T08:43:40.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.977+0000 7f5721420640 1 -- 172.21.15.19:0/2157646242 shutdown_connections 2024-09-19T08:43:40.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.977+0000 7f5721420640 1 --2- 172.21.15.19:0/2157646242 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5704039300 0x7f570403b7c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:40.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.977+0000 7f5721420640 1 --2- 172.21.15.19:0/2157646242 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f571c1027d0 0x7f571c100430 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:40.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.977+0000 7f5721420640 1 -- 172.21.15.19:0/2157646242 >> 172.21.15.19:0/2157646242 conn(0x7f571c077310 msgr2=0x7f571c105560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:40.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.977+0000 7f5721420640 1 -- 172.21.15.19:0/2157646242 shutdown_connections 2024-09-19T08:43:40.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:40.977+0000 7f5721420640 1 -- 172.21.15.19:0/2157646242 wait complete. 2024-09-19T08:43:41.620 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi203 2024-09-19T08:43:41.620 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-19T08:43:41.620 DEBUG:teuthology.orchestra.run.smithi203:> dd of=/etc/ceph/ceph.conf 2024-09-19T08:43:41.640 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-19T08:43:41.640 DEBUG:teuthology.orchestra.run.smithi203:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:43:41.698 INFO:tasks.cephadm:Adding host smithi203 to orchestrator... 2024-09-19T08:43:41.699 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph orch host add smithi203 2024-09-19T08:43:41.949 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:42.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:41 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:43:42.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:41 smithi019 ceph-mon[30976]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:43:42.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:42.378+0000 7f7453eb3640 1 -- 172.21.15.19:0/2219008305 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f744c107660 msgr2=0x7f744c107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:42.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:42.378+0000 7f7453eb3640 1 --2- 172.21.15.19:0/2219008305 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f744c107660 0x7f744c107a40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7448009880 tx=0x7f744802a5d0 comp rx=0 tx=0).stop 2024-09-19T08:43:42.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:42.378+0000 7f7453eb3640 1 -- 172.21.15.19:0/2219008305 shutdown_connections 2024-09-19T08:43:42.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:42.378+0000 7f7453eb3640 1 --2- 172.21.15.19:0/2219008305 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f744c107660 0x7f744c107a40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:42.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:42.378+0000 7f7453eb3640 1 -- 172.21.15.19:0/2219008305 >> 172.21.15.19:0/2219008305 conn(0x7f744c0fd290 msgr2=0x7f744c0ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:42.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:42.378+0000 7f7453eb3640 1 -- 172.21.15.19:0/2219008305 shutdown_connections 2024-09-19T08:43:42.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:42.378+0000 7f7453eb3640 1 -- 172.21.15.19:0/2219008305 wait complete. 2024-09-19T08:43:42.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:42.379+0000 7f7453eb3640 1 Processor -- start 2024-09-19T08:43:42.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:42.379+0000 7f7453eb3640 1 -- start start 2024-09-19T08:43:42.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:42.379+0000 7f7453eb3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f744c107660 0x7f744c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:42.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:42.379+0000 7f7453eb3640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f744c10bc90 con 0x7f744c107660 2024-09-19T08:43:42.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:42.379+0000 7f7451c4f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f744c107660 0x7f744c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:42.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:42.379+0000 7f7451c4f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f744c107660 0x7f744c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48822/0 (socket says 172.21.15.19:48822) 2024-09-19T08:43:42.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:42.379+0000 7f7451c4f640 1 -- 172.21.15.19:0/2963126142 learned_addr learned my addr 172.21.15.19:0/2963126142 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:43:42.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:42.379+0000 7f7451c4f640 1 -- 172.21.15.19:0/2963126142 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f744c0763e0 con 0x7f744c107660 2024-09-19T08:43:42.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:42.379+0000 7f7451c4f640 1 --2- 172.21.15.19:0/2963126142 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f744c107660 0x7f744c0744f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7448009230 tx=0x7f7448003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:42.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:42.380+0000 7f7442ffd640 1 -- 172.21.15.19:0/2963126142 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f744803f070 con 0x7f744c107660 2024-09-19T08:43:42.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:42.380+0000 7f7442ffd640 1 -- 172.21.15.19:0/2963126142 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f744803bc80 con 0x7f744c107660 2024-09-19T08:43:42.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:42.380+0000 7f7453eb3640 1 -- 172.21.15.19:0/2963126142 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f744c074a30 con 0x7f744c107660 2024-09-19T08:43:42.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:42.380+0000 7f7442ffd640 1 -- 172.21.15.19:0/2963126142 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7448035030 con 0x7f744c107660 2024-09-19T08:43:42.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:42.380+0000 7f7453eb3640 1 -- 172.21.15.19:0/2963126142 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f744c074ef0 con 0x7f744c107660 2024-09-19T08:43:42.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:42.381+0000 7f7442ffd640 1 -- 172.21.15.19:0/2963126142 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f7448042070 con 0x7f744c107660 2024-09-19T08:43:42.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:42.381+0000 7f7453eb3640 1 -- 172.21.15.19:0/2963126142 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f744c102cd0 con 0x7f744c107660 2024-09-19T08:43:42.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:42.381+0000 7f7442ffd640 1 --2- 172.21.15.19:0/2963126142 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7438039300 0x7f743803b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:42.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:42.381+0000 7f7442ffd640 1 -- 172.21.15.19:0/2963126142 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f744806cd70 con 0x7f744c107660 2024-09-19T08:43:42.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:42.381+0000 7f745144e640 1 --2- 172.21.15.19:0/2963126142 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7438039300 0x7f743803b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:42.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:42.381+0000 7f745144e640 1 --2- 172.21.15.19:0/2963126142 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7438039300 0x7f743803b7c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f743c0098c0 tx=0x7f743c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:42.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:42.386+0000 7f7442ffd640 1 -- 172.21.15.19:0/2963126142 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7448071070 con 0x7f744c107660 2024-09-19T08:43:42.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:42.564+0000 7f7453eb3640 1 -- 172.21.15.19:0/2963126142 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi203", "target": ["mon-mgr", ""]}) -- 0x7f744c075a20 con 0x7f7438039300 2024-09-19T08:43:43.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:42 smithi019 ceph-mon[30976]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:43:43.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:42 smithi019 ceph-mon[30976]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi203", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:43:44.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:44 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:43:44.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:44 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:43:44.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:44 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:43:44.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:44 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:43:44.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:44 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi155", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:43:44.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:44 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:43:44.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:44 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:43:44.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:44 smithi019 ceph-mon[30976]: Updating smithi155:/etc/ceph/ceph.conf 2024-09-19T08:43:44.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:44 smithi019 ceph-mon[30976]: Deploying cephadm binary to smithi203 2024-09-19T08:43:44.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:44 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:43:44.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:44 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:43:44.820 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:44 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:43:45.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:45 smithi019 ceph-mon[30976]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:43:45.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:45 smithi019 ceph-mon[30976]: Updating smithi155:/var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:43:45.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:45 smithi019 ceph-mon[30976]: Updating smithi155:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:43:45.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:45 smithi019 ceph-mon[30976]: Updating smithi155:/var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:43:46.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:46.442+0000 7f7442ffd640 1 -- 172.21.15.19:0/2963126142 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f744c075a20 con 0x7f7438039300 2024-09-19T08:43:46.442 INFO:teuthology.orchestra.run.smithi019.stdout:Added host 'smithi203' with addr '172.21.15.203' 2024-09-19T08:43:46.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:46.444+0000 7f7453eb3640 1 -- 172.21.15.19:0/2963126142 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7438039300 msgr2=0x7f743803b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:46.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:46.444+0000 7f7453eb3640 1 --2- 172.21.15.19:0/2963126142 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7438039300 0x7f743803b7c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f743c0098c0 tx=0x7f743c006db0 comp rx=0 tx=0).stop 2024-09-19T08:43:46.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:46.444+0000 7f7453eb3640 1 -- 172.21.15.19:0/2963126142 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f744c107660 msgr2=0x7f744c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:46.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:46.444+0000 7f7453eb3640 1 --2- 172.21.15.19:0/2963126142 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f744c107660 0x7f744c0744f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7448009230 tx=0x7f7448003d40 comp rx=0 tx=0).stop 2024-09-19T08:43:46.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:46.444+0000 7f7453eb3640 1 -- 172.21.15.19:0/2963126142 shutdown_connections 2024-09-19T08:43:46.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:46.444+0000 7f7453eb3640 1 --2- 172.21.15.19:0/2963126142 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7438039300 0x7f743803b7c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:46.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:46.444+0000 7f7453eb3640 1 --2- 172.21.15.19:0/2963126142 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f744c107660 0x7f744c0744f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:46.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:46.444+0000 7f7453eb3640 1 -- 172.21.15.19:0/2963126142 >> 172.21.15.19:0/2963126142 conn(0x7f744c0fd290 msgr2=0x7f744c0febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:46.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:46.444+0000 7f7453eb3640 1 -- 172.21.15.19:0/2963126142 shutdown_connections 2024-09-19T08:43:46.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:46.444+0000 7f7453eb3640 1 -- 172.21.15.19:0/2963126142 wait complete. 2024-09-19T08:43:47.104 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T08:43:47.355 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:47.758 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:47 smithi019 ceph-mon[30976]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:43:47.759 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:47 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:43:47.759 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:47 smithi019 ceph-mon[30976]: Added host smithi203 2024-09-19T08:43:47.759 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:47 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:43:47.759 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:47 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:43:47.759 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:47 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:43:47.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.757+0000 7f33dee3a640 1 -- 172.21.15.19:0/3656315203 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33d8102730 msgr2=0x7f33d8102b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:47.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.757+0000 7f33dee3a640 1 --2- 172.21.15.19:0/3656315203 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33d8102730 0x7f33d8102b10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f33d0009c10 tx=0x7f33d002aa10 comp rx=0 tx=0).stop 2024-09-19T08:43:47.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.757+0000 7f33dee3a640 1 -- 172.21.15.19:0/3656315203 shutdown_connections 2024-09-19T08:43:47.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.757+0000 7f33dee3a640 1 --2- 172.21.15.19:0/3656315203 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33d8102730 0x7f33d8102b10 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:47.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.757+0000 7f33dee3a640 1 -- 172.21.15.19:0/3656315203 >> 172.21.15.19:0/3656315203 conn(0x7f33d8077310 msgr2=0x7f33d80fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:47.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.757+0000 7f33dee3a640 1 -- 172.21.15.19:0/3656315203 shutdown_connections 2024-09-19T08:43:47.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.757+0000 7f33dee3a640 1 -- 172.21.15.19:0/3656315203 wait complete. 2024-09-19T08:43:47.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.758+0000 7f33dee3a640 1 Processor -- start 2024-09-19T08:43:47.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.758+0000 7f33dee3a640 1 -- start start 2024-09-19T08:43:47.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.758+0000 7f33dee3a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33d8102730 0x7f33d81971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:47.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.758+0000 7f33dee3a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f33d810bc80 con 0x7f33d8102730 2024-09-19T08:43:47.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.758+0000 7f33dcbd6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33d8102730 0x7f33d81971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:47.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.759+0000 7f33dcbd6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33d8102730 0x7f33d81971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39232/0 (socket says 172.21.15.19:39232) 2024-09-19T08:43:47.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.759+0000 7f33dcbd6640 1 -- 172.21.15.19:0/3606389019 learned_addr learned my addr 172.21.15.19:0/3606389019 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:43:47.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.759+0000 7f33dcbd6640 1 -- 172.21.15.19:0/3606389019 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33d81976f0 con 0x7f33d8102730 2024-09-19T08:43:47.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.759+0000 7f33dcbd6640 1 --2- 172.21.15.19:0/3606389019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33d8102730 0x7f33d81971b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f33d0005dd0 tx=0x7f33d0030c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:47.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.759+0000 7f33d5ffb640 1 -- 172.21.15.19:0/3606389019 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33d0034070 con 0x7f33d8102730 2024-09-19T08:43:47.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.759+0000 7f33d5ffb640 1 -- 172.21.15.19:0/3606389019 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f33d002f8c0 con 0x7f33d8102730 2024-09-19T08:43:47.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.759+0000 7f33dee3a640 1 -- 172.21.15.19:0/3606389019 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33d8197980 con 0x7f33d8102730 2024-09-19T08:43:47.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.759+0000 7f33d5ffb640 1 -- 172.21.15.19:0/3606389019 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33d0004520 con 0x7f33d8102730 2024-09-19T08:43:47.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.760+0000 7f33dee3a640 1 -- 172.21.15.19:0/3606389019 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33d8197d20 con 0x7f33d8102730 2024-09-19T08:43:47.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.761+0000 7f33d5ffb640 1 -- 172.21.15.19:0/3606389019 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f33d0037020 con 0x7f33d8102730 2024-09-19T08:43:47.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.761+0000 7f33d5ffb640 1 --2- 172.21.15.19:0/3606389019 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f33c0039300 0x7f33c003b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:47.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.761+0000 7f33d5ffb640 1 -- 172.21.15.19:0/3606389019 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f33d006d1e0 con 0x7f33d8102730 2024-09-19T08:43:47.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.761+0000 7f33d7fff640 1 --2- 172.21.15.19:0/3606389019 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f33c0039300 0x7f33c003b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:47.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.761+0000 7f33dee3a640 1 -- 172.21.15.19:0/3606389019 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33d8069f90 con 0x7f33d8102730 2024-09-19T08:43:47.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.761+0000 7f33d7fff640 1 --2- 172.21.15.19:0/3606389019 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f33c0039300 0x7f33c003b7c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f33cc0098c0 tx=0x7f33cc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:47.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.766+0000 7f33d5ffb640 1 -- 172.21.15.19:0/3606389019 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f33d003f070 con 0x7f33d8102730 2024-09-19T08:43:47.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.946+0000 7f33dee3a640 1 -- 172.21.15.19:0/3606389019 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f33d8198540 con 0x7f33c0039300 2024-09-19T08:43:47.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.947+0000 7f33d5ffb640 1 -- 172.21.15.19:0/3606389019 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7f33d8198540 con 0x7f33c0039300 2024-09-19T08:43:47.947 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:43:47.948 INFO:teuthology.orchestra.run.smithi019.stdout:[{"addr": "172.21.15.19", "hostname": "smithi019", "labels": [], "status": ""}, {"addr": "172.21.15.155", "hostname": "smithi155", "labels": [], "status": ""}, {"addr": "172.21.15.203", "hostname": "smithi203", "labels": [], "status": ""}] 2024-09-19T08:43:47.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.949+0000 7f33dee3a640 1 -- 172.21.15.19:0/3606389019 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f33c0039300 msgr2=0x7f33c003b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:47.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.949+0000 7f33dee3a640 1 --2- 172.21.15.19:0/3606389019 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f33c0039300 0x7f33c003b7c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f33cc0098c0 tx=0x7f33cc006db0 comp rx=0 tx=0).stop 2024-09-19T08:43:47.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.949+0000 7f33dee3a640 1 -- 172.21.15.19:0/3606389019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33d8102730 msgr2=0x7f33d81971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:47.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.949+0000 7f33dee3a640 1 --2- 172.21.15.19:0/3606389019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33d8102730 0x7f33d81971b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f33d0005dd0 tx=0x7f33d0030c30 comp rx=0 tx=0).stop 2024-09-19T08:43:47.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.949+0000 7f33dee3a640 1 -- 172.21.15.19:0/3606389019 shutdown_connections 2024-09-19T08:43:47.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.949+0000 7f33dee3a640 1 --2- 172.21.15.19:0/3606389019 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f33c0039300 0x7f33c003b7c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:47.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.949+0000 7f33dee3a640 1 --2- 172.21.15.19:0/3606389019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f33d8102730 0x7f33d81971b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:47.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.949+0000 7f33dee3a640 1 -- 172.21.15.19:0/3606389019 >> 172.21.15.19:0/3606389019 conn(0x7f33d8077310 msgr2=0x7f33d81034b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:47.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.949+0000 7f33dee3a640 1 -- 172.21.15.19:0/3606389019 shutdown_connections 2024-09-19T08:43:47.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:47.949+0000 7f33dee3a640 1 -- 172.21.15.19:0/3606389019 wait complete. 2024-09-19T08:43:48.602 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-19T08:43:48.602 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-19T08:43:48.851 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:43:48.963 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:48 smithi019 ceph-mon[30976]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:43:48.964 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:48 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:43:48.964 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:48 smithi019 ceph-mon[30976]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:43:49.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.266+0000 7f8eb4ed8640 1 -- 172.21.15.19:0/3608029649 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8eb0102790 msgr2=0x7f8eb0102b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:49.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.266+0000 7f8eb4ed8640 1 --2- 172.21.15.19:0/3608029649 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8eb0102790 0x7f8eb0102b70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8ea0009810 tx=0x7f8ea002a540 comp rx=0 tx=0).stop 2024-09-19T08:43:49.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.266+0000 7f8eb4ed8640 1 -- 172.21.15.19:0/3608029649 shutdown_connections 2024-09-19T08:43:49.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.266+0000 7f8eb4ed8640 1 --2- 172.21.15.19:0/3608029649 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8eb0102790 0x7f8eb0102b70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:49.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.266+0000 7f8eb4ed8640 1 -- 172.21.15.19:0/3608029649 >> 172.21.15.19:0/3608029649 conn(0x7f8eb0077310 msgr2=0x7f8eb00fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:49.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.266+0000 7f8eb4ed8640 1 -- 172.21.15.19:0/3608029649 shutdown_connections 2024-09-19T08:43:49.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.266+0000 7f8eb4ed8640 1 -- 172.21.15.19:0/3608029649 wait complete. 2024-09-19T08:43:49.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.267+0000 7f8eb4ed8640 1 Processor -- start 2024-09-19T08:43:49.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.267+0000 7f8eb4ed8640 1 -- start start 2024-09-19T08:43:49.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.267+0000 7f8eb4ed8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8eb0102790 0x7f8eb01003f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:49.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.267+0000 7f8eb4ed8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb010bc80 con 0x7f8eb0102790 2024-09-19T08:43:49.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.267+0000 7f8eae59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8eb0102790 0x7f8eb01003f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:49.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.267+0000 7f8eae59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8eb0102790 0x7f8eb01003f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39250/0 (socket says 172.21.15.19:39250) 2024-09-19T08:43:49.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.267+0000 7f8eae59c640 1 -- 172.21.15.19:0/713377940 learned_addr learned my addr 172.21.15.19:0/713377940 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:43:49.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.268+0000 7f8eae59c640 1 -- 172.21.15.19:0/713377940 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb01022e0 con 0x7f8eb0102790 2024-09-19T08:43:49.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.268+0000 7f8eae59c640 1 --2- 172.21.15.19:0/713377940 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8eb0102790 0x7f8eb01003f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00045e0 tx=0x7f8ea0004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:49.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.268+0000 7f8e9f7fe640 1 -- 172.21.15.19:0/713377940 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ea0030e70 con 0x7f8eb0102790 2024-09-19T08:43:49.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.268+0000 7f8e9f7fe640 1 -- 172.21.15.19:0/713377940 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ea00318e0 con 0x7f8eb0102790 2024-09-19T08:43:49.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.268+0000 7f8eb4ed8640 1 -- 172.21.15.19:0/713377940 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eb0100930 con 0x7f8eb0102790 2024-09-19T08:43:49.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.268+0000 7f8e9f7fe640 1 -- 172.21.15.19:0/713377940 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ea00049c0 con 0x7f8eb0102790 2024-09-19T08:43:49.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.268+0000 7f8eb4ed8640 1 -- 172.21.15.19:0/713377940 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eb0100df0 con 0x7f8eb0102790 2024-09-19T08:43:49.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.269+0000 7f8e9f7fe640 1 -- 172.21.15.19:0/713377940 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f8ea0039040 con 0x7f8eb0102790 2024-09-19T08:43:49.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.269+0000 7f8eb4ed8640 1 -- 172.21.15.19:0/713377940 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8eb0069f30 con 0x7f8eb0102790 2024-09-19T08:43:49.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.269+0000 7f8e9f7fe640 1 --2- 172.21.15.19:0/713377940 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8e980392a0 0x7f8e9803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:49.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.269+0000 7f8e9f7fe640 1 -- 172.21.15.19:0/713377940 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8ea006d690 con 0x7f8eb0102790 2024-09-19T08:43:49.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.269+0000 7f8eadd9b640 1 --2- 172.21.15.19:0/713377940 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8e980392a0 0x7f8e9803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:49.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.270+0000 7f8eadd9b640 1 --2- 172.21.15.19:0/713377940 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8e980392a0 0x7f8e9803b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40098c0 tx=0x7f8ea4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:49.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.274+0000 7f8e9f7fe640 1 -- 172.21.15.19:0/713377940 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8ea0040030 con 0x7f8eb0102790 2024-09-19T08:43:49.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.456+0000 7f8eb4ed8640 1 -- 172.21.15.19:0/713377940 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f8eb0101920 con 0x7f8eb0102790 2024-09-19T08:43:49.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.786+0000 7f8e9f7fe640 1 -- 172.21.15.19:0/713377940 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f8ea0037d70 con 0x7f8eb0102790 2024-09-19T08:43:49.787 INFO:teuthology.orchestra.run.smithi019.stderr:adjusted tunables profile to default 2024-09-19T08:43:49.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.788+0000 7f8eb4ed8640 1 -- 172.21.15.19:0/713377940 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8e980392a0 msgr2=0x7f8e9803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:49.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.788+0000 7f8eb4ed8640 1 --2- 172.21.15.19:0/713377940 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8e980392a0 0x7f8e9803b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40098c0 tx=0x7f8ea4006db0 comp rx=0 tx=0).stop 2024-09-19T08:43:49.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.788+0000 7f8eb4ed8640 1 -- 172.21.15.19:0/713377940 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8eb0102790 msgr2=0x7f8eb01003f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:49.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.788+0000 7f8eb4ed8640 1 --2- 172.21.15.19:0/713377940 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8eb0102790 0x7f8eb01003f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00045e0 tx=0x7f8ea0004610 comp rx=0 tx=0).stop 2024-09-19T08:43:49.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.788+0000 7f8eb4ed8640 1 -- 172.21.15.19:0/713377940 shutdown_connections 2024-09-19T08:43:49.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.788+0000 7f8eb4ed8640 1 --2- 172.21.15.19:0/713377940 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8e980392a0 0x7f8e9803b760 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:49.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.788+0000 7f8eb4ed8640 1 --2- 172.21.15.19:0/713377940 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8eb0102790 0x7f8eb01003f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:49.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.788+0000 7f8eb4ed8640 1 -- 172.21.15.19:0/713377940 >> 172.21.15.19:0/713377940 conn(0x7f8eb0077310 msgr2=0x7f8eb0103510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:49.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.788+0000 7f8eb4ed8640 1 -- 172.21.15.19:0/713377940 shutdown_connections 2024-09-19T08:43:49.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:43:49.788+0000 7f8eb4ed8640 1 -- 172.21.15.19:0/713377940 wait complete. 2024-09-19T08:43:50.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:49 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/713377940' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T08:43:50.453 INFO:tasks.cephadm:Adding mon.a on smithi019 2024-09-19T08:43:50.454 INFO:tasks.cephadm:Adding mon.b on smithi155 2024-09-19T08:43:50.454 INFO:tasks.cephadm:Adding mon.c on smithi203 2024-09-19T08:43:50.454 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi019:172.21.15.19=a;smithi155:172.21.15.155=b;smithi203:172.21.15.203=c' 2024-09-19T08:43:50.696 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T08:43:50.742 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T08:43:51.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:50 smithi019 ceph-mon[30976]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:43:51.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:50 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/713377940' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T08:43:51.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:50 smithi019 ceph-mon[30976]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:43:51.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:50 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:43:51.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:50 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:43:51.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:50 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:43:51.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:50 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:43:51.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:50 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi203", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:43:51.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:50 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:43:51.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:50 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:43:51.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:50 smithi019 ceph-mon[30976]: Updating smithi203:/etc/ceph/ceph.conf 2024-09-19T08:43:51.316 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.276+0000 7f87256b9640 1 -- 172.21.15.203:0/1223562997 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8720100540 msgr2=0x7f8720100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:51.316 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.276+0000 7f87256b9640 1 --2- 172.21.15.203:0/1223562997 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8720100540 0x7f8720100940 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8710009880 tx=0x7f871002a5d0 comp rx=0 tx=0).stop 2024-09-19T08:43:51.317 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.276+0000 7f87256b9640 1 -- 172.21.15.203:0/1223562997 shutdown_connections 2024-09-19T08:43:51.317 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.276+0000 7f87256b9640 1 --2- 172.21.15.203:0/1223562997 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8720100540 0x7f8720100940 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:51.317 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.276+0000 7f87256b9640 1 -- 172.21.15.203:0/1223562997 >> 172.21.15.203:0/1223562997 conn(0x7f87200fbcd0 msgr2=0x7f87200fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:51.317 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.276+0000 7f87256b9640 1 -- 172.21.15.203:0/1223562997 shutdown_connections 2024-09-19T08:43:51.317 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.276+0000 7f87256b9640 1 -- 172.21.15.203:0/1223562997 wait complete. 2024-09-19T08:43:51.318 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.277+0000 7f87256b9640 1 Processor -- start 2024-09-19T08:43:51.318 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.277+0000 7f87256b9640 1 -- start start 2024-09-19T08:43:51.318 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.277+0000 7f87256b9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8720100540 0x7f8720196d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:51.318 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.277+0000 7f87256b9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f87201065f0 con 0x7f8720100540 2024-09-19T08:43:51.318 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.277+0000 7f871effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8720100540 0x7f8720196d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:51.318 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.277+0000 7f871effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8720100540 0x7f8720196d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.203:48300/0 (socket says 172.21.15.203:48300) 2024-09-19T08:43:51.319 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.277+0000 7f871effd640 1 -- 172.21.15.203:0/2390455506 learned_addr learned my addr 172.21.15.203:0/2390455506 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-19T08:43:51.319 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.278+0000 7f871effd640 1 -- 172.21.15.203:0/2390455506 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8720197290 con 0x7f8720100540 2024-09-19T08:43:51.319 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.278+0000 7f871effd640 1 --2- 172.21.15.203:0/2390455506 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8720100540 0x7f8720196d50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8710004f60 tx=0x7f87100048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:51.319 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.278+0000 7f8707fff640 1 -- 172.21.15.203:0/2390455506 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f871003f070 con 0x7f8720100540 2024-09-19T08:43:51.319 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.278+0000 7f87256b9640 1 -- 172.21.15.203:0/2390455506 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8720197520 con 0x7f8720100540 2024-09-19T08:43:51.319 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.278+0000 7f8707fff640 1 -- 172.21.15.203:0/2390455506 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8710004d40 con 0x7f8720100540 2024-09-19T08:43:51.320 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.278+0000 7f8707fff640 1 -- 172.21.15.203:0/2390455506 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8710035030 con 0x7f8720100540 2024-09-19T08:43:51.320 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.278+0000 7f87256b9640 1 -- 172.21.15.203:0/2390455506 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f872019a210 con 0x7f8720100540 2024-09-19T08:43:51.320 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.279+0000 7f87256b9640 1 -- 172.21.15.203:0/2390455506 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8720106d70 con 0x7f8720100540 2024-09-19T08:43:51.320 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.280+0000 7f8707fff640 1 -- 172.21.15.203:0/2390455506 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f8710042070 con 0x7f8720100540 2024-09-19T08:43:51.320 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.280+0000 7f8707fff640 1 --2- 172.21.15.203:0/2390455506 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f87080392a0 0x7f870803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:51.321 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.280+0000 7f8707fff640 1 -- 172.21.15.203:0/2390455506 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f871006d0b0 con 0x7f8720100540 2024-09-19T08:43:51.321 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.281+0000 7f871e7fc640 1 --2- 172.21.15.203:0/2390455506 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f87080392a0 0x7f870803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:51.321 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.284+0000 7f871e7fc640 1 --2- 172.21.15.203:0/2390455506 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f87080392a0 0x7f870803b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f87140098c0 tx=0x7f8714006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:51.321 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.287+0000 7f8707fff640 1 -- 172.21.15.203:0/2390455506 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f871004a260 con 0x7f8720100540 2024-09-19T08:43:51.476 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.476+0000 7f87256b9640 1 -- 172.21.15.203:0/2390455506 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi019:172.21.15.19=a;smithi155:172.21.15.155=b;smithi203:172.21.15.203=c", "target": ["mon-mgr", ""]}) -- 0x7f87200fd5f0 con 0x7f87080392a0 2024-09-19T08:43:51.482 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.481+0000 7f8707fff640 1 -- 172.21.15.203:0/2390455506 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f87200fd5f0 con 0x7f87080392a0 2024-09-19T08:43:51.482 INFO:teuthology.orchestra.run.smithi203.stdout:Scheduled mon update... 2024-09-19T08:43:51.484 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.483+0000 7f87256b9640 1 -- 172.21.15.203:0/2390455506 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f87080392a0 msgr2=0x7f870803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:51.484 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.483+0000 7f87256b9640 1 --2- 172.21.15.203:0/2390455506 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f87080392a0 0x7f870803b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f87140098c0 tx=0x7f8714006db0 comp rx=0 tx=0).stop 2024-09-19T08:43:51.484 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.483+0000 7f87256b9640 1 -- 172.21.15.203:0/2390455506 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8720100540 msgr2=0x7f8720196d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:51.484 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.483+0000 7f87256b9640 1 --2- 172.21.15.203:0/2390455506 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8720100540 0x7f8720196d50 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8710004f60 tx=0x7f87100048f0 comp rx=0 tx=0).stop 2024-09-19T08:43:51.484 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.483+0000 7f87256b9640 1 -- 172.21.15.203:0/2390455506 shutdown_connections 2024-09-19T08:43:51.484 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.483+0000 7f87256b9640 1 --2- 172.21.15.203:0/2390455506 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f87080392a0 0x7f870803b760 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:51.484 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.483+0000 7f87256b9640 1 --2- 172.21.15.203:0/2390455506 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8720100540 0x7f8720196d50 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:51.485 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.483+0000 7f87256b9640 1 -- 172.21.15.203:0/2390455506 >> 172.21.15.203:0/2390455506 conn(0x7f87200fbcd0 msgr2=0x7f87200fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:51.485 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.484+0000 7f87256b9640 1 -- 172.21.15.203:0/2390455506 shutdown_connections 2024-09-19T08:43:51.485 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:51.484+0000 7f87256b9640 1 -- 172.21.15.203:0/2390455506 wait complete. 2024-09-19T08:43:52.065 DEBUG:teuthology.orchestra.run.smithi155:mon.b> sudo journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mon.b.service 2024-09-19T08:43:52.069 DEBUG:teuthology.orchestra.run.smithi203:mon.c> sudo journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mon.c.service 2024-09-19T08:43:52.073 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T08:43:52.073 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:43:52.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:52 smithi019 ceph-mon[30976]: Updating smithi203:/var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:43:52.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:52 smithi019 ceph-mon[30976]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:43:52.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:52 smithi019 ceph-mon[30976]: Updating smithi203:/var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:43:52.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:52 smithi019 ceph-mon[30976]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi019:172.21.15.19=a;smithi155:172.21.15.155=b;smithi203:172.21.15.203=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:43:52.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:52 smithi019 ceph-mon[30976]: Saving service mon spec with placement smithi019:172.21.15.19=a;smithi155:172.21.15.155=b;smithi203:172.21.15.203=c;count:3 2024-09-19T08:43:52.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:52 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:43:52.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:52 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:43:52.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:52 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:43:52.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:52 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:43:52.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:52 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:43:52.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:52 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:43:52.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:52 smithi019 ceph-mon[30976]: Deploying daemon mon.c on smithi203 2024-09-19T08:43:53.649 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:43:53.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:53 smithi019 ceph-mon[30976]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:43:54.562 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.534+0000 7fc1da02e640 1 -- 172.21.15.203:0/2202630641 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1d4107660 msgr2=0x7fc1d4107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:54.562 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.534+0000 7fc1da02e640 1 --2- 172.21.15.203:0/2202630641 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1d4107660 0x7fc1d4107a40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4009880 tx=0x7fc1c402a5d0 comp rx=0 tx=0).stop 2024-09-19T08:43:54.563 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.534+0000 7fc1da02e640 1 -- 172.21.15.203:0/2202630641 shutdown_connections 2024-09-19T08:43:54.563 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.534+0000 7fc1da02e640 1 --2- 172.21.15.203:0/2202630641 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1d4107660 0x7fc1d4107a40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:54.563 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.534+0000 7fc1da02e640 1 -- 172.21.15.203:0/2202630641 >> 172.21.15.203:0/2202630641 conn(0x7fc1d40fd290 msgr2=0x7fc1d40ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:54.563 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.534+0000 7fc1da02e640 1 -- 172.21.15.203:0/2202630641 shutdown_connections 2024-09-19T08:43:54.563 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.534+0000 7fc1da02e640 1 -- 172.21.15.203:0/2202630641 wait complete. 2024-09-19T08:43:54.563 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.535+0000 7fc1da02e640 1 Processor -- start 2024-09-19T08:43:54.563 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.535+0000 7fc1da02e640 1 -- start start 2024-09-19T08:43:54.563 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.536+0000 7fc1da02e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1d4107660 0x7fc1d4197130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:54.563 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.536+0000 7fc1da02e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc1d410bc90 con 0x7fc1d4107660 2024-09-19T08:43:54.563 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.536+0000 7fc1d37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1d4107660 0x7fc1d4197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:54.563 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.536+0000 7fc1d37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1d4107660 0x7fc1d4197130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.203:48318/0 (socket says 172.21.15.203:48318) 2024-09-19T08:43:54.563 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.536+0000 7fc1d37fe640 1 -- 172.21.15.203:0/1269126449 learned_addr learned my addr 172.21.15.203:0/1269126449 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-19T08:43:54.563 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.536+0000 7fc1d37fe640 1 -- 172.21.15.203:0/1269126449 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1d4197670 con 0x7fc1d4107660 2024-09-19T08:43:54.564 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.537+0000 7fc1d37fe640 1 --2- 172.21.15.203:0/1269126449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1d4107660 0x7fc1d4197130 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4009230 tx=0x7fc1c4003d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:54.564 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.537+0000 7fc1d0ff9640 1 -- 172.21.15.203:0/1269126449 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1c403f070 con 0x7fc1d4107660 2024-09-19T08:43:54.564 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.537+0000 7fc1da02e640 1 -- 172.21.15.203:0/1269126449 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1d4197900 con 0x7fc1d4107660 2024-09-19T08:43:54.564 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.537+0000 7fc1d0ff9640 1 -- 172.21.15.203:0/1269126449 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc1c403bc80 con 0x7fc1d4107660 2024-09-19T08:43:54.564 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.537+0000 7fc1d0ff9640 1 -- 172.21.15.203:0/1269126449 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1c4035030 con 0x7fc1d4107660 2024-09-19T08:43:54.564 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.537+0000 7fc1da02e640 1 -- 172.21.15.203:0/1269126449 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1d419ba00 con 0x7fc1d4107660 2024-09-19T08:43:54.564 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.538+0000 7fc1d0ff9640 1 -- 172.21.15.203:0/1269126449 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fc1c4042070 con 0x7fc1d4107660 2024-09-19T08:43:54.564 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.538+0000 7fc1da02e640 1 -- 172.21.15.203:0/1269126449 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1d4102cd0 con 0x7fc1d4107660 2024-09-19T08:43:54.564 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.538+0000 7fc1d0ff9640 1 --2- 172.21.15.203:0/1269126449 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc1bc0392a0 0x7fc1bc03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:43:54.564 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.538+0000 7fc1d0ff9640 1 -- 172.21.15.203:0/1269126449 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc1c406d180 con 0x7fc1d4107660 2024-09-19T08:43:54.564 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.539+0000 7fc1d2ffd640 1 --2- 172.21.15.203:0/1269126449 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc1bc0392a0 0x7fc1bc03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:43:54.564 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.539+0000 7fc1d2ffd640 1 --2- 172.21.15.203:0/1269126449 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc1bc0392a0 0x7fc1bc03b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc1c80098c0 tx=0x7fc1c8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:43:54.564 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.543+0000 7fc1d0ff9640 1 -- 172.21.15.203:0/1269126449 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc1c404c350 con 0x7fc1d4107660 2024-09-19T08:43:54.793 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.788+0000 7fc1da02e640 1 -- 172.21.15.203:0/1269126449 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fc1d4198490 con 0x7fc1d4107660 2024-09-19T08:43:54.793 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.789+0000 7fc1d0ff9640 1 -- 172.21.15.203:0/1269126449 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7fc1c4031e20 con 0x7fc1d4107660 2024-09-19T08:43:54.793 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T08:43:54.793 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":1,"fsid":"f26c9d84-7662-11ef-bceb-c7b262605968","modified":"2024-09-19T08:42:29.207639Z","created":"2024-09-19T08:42:29.207639Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:3300","nonce":0},{"type":"v1","addr":"172.21.15.19:6789","nonce":0}]},"addr":"172.21.15.19:6789/0","public_addr":"172.21.15.19:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T08:43:54.794 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 1 2024-09-19T08:43:54.794 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.791+0000 7fc1da02e640 1 -- 172.21.15.203:0/1269126449 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc1bc0392a0 msgr2=0x7fc1bc03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:54.794 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.791+0000 7fc1da02e640 1 --2- 172.21.15.203:0/1269126449 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc1bc0392a0 0x7fc1bc03b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc1c80098c0 tx=0x7fc1c8006db0 comp rx=0 tx=0).stop 2024-09-19T08:43:54.794 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.791+0000 7fc1da02e640 1 -- 172.21.15.203:0/1269126449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1d4107660 msgr2=0x7fc1d4197130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:43:54.794 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.791+0000 7fc1da02e640 1 --2- 172.21.15.203:0/1269126449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1d4107660 0x7fc1d4197130 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc1c4009230 tx=0x7fc1c4003d40 comp rx=0 tx=0).stop 2024-09-19T08:43:54.794 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.791+0000 7fc1da02e640 1 -- 172.21.15.203:0/1269126449 shutdown_connections 2024-09-19T08:43:54.794 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.791+0000 7fc1da02e640 1 --2- 172.21.15.203:0/1269126449 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc1bc0392a0 0x7fc1bc03b760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:54.794 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.791+0000 7fc1da02e640 1 --2- 172.21.15.203:0/1269126449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1d4107660 0x7fc1d4197130 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:43:54.795 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.791+0000 7fc1da02e640 1 -- 172.21.15.203:0/1269126449 >> 172.21.15.203:0/1269126449 conn(0x7fc1d40fd290 msgr2=0x7fc1d40feb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:43:54.795 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.791+0000 7fc1da02e640 1 -- 172.21.15.203:0/1269126449 shutdown_connections 2024-09-19T08:43:54.795 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:43:54.792+0000 7fc1da02e640 1 -- 172.21.15.203:0/1269126449 wait complete. 2024-09-19T08:43:55.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:55 smithi019 ceph-mon[30976]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:43:55.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:43:55 smithi019 ceph-mon[30976]: from='client.? 172.21.15.203:0/1269126449' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:43:56.410 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T08:43:56.410 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:43:56.665 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:44:01.225 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:00 smithi019 ceph-mon[30976]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:01.225 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:00 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:44:01.225 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:00 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:44:01.225 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:00 smithi019 ceph-mon[30976]: mon.a calling monitor election 2024-09-19T08:44:01.226 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:00 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:44:01.226 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:00 smithi019 ceph-mon[30976]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:01.226 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:00 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:44:01.226 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:00 smithi019 ceph-mon[30976]: mon.c calling monitor election 2024-09-19T08:44:01.226 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:00 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:44:01.226 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:00 smithi019 ceph-mon[30976]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:01.226 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:00 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:44:01.226 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:00 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:44:01.226 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:00 smithi019 ceph-mon[30976]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T08:44:01.226 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:00 smithi019 ceph-mon[30976]: monmap epoch 2 2024-09-19T08:44:01.226 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:00 smithi019 ceph-mon[30976]: fsid f26c9d84-7662-11ef-bceb-c7b262605968 2024-09-19T08:44:01.226 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:00 smithi019 ceph-mon[30976]: last_changed 2024-09-19T08:43:55.819479+0000 2024-09-19T08:44:01.226 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:00 smithi019 ceph-mon[30976]: created 2024-09-19T08:42:29.207639+0000 2024-09-19T08:44:01.226 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:00 smithi019 ceph-mon[30976]: min_mon_release 19 (squid) 2024-09-19T08:44:01.227 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:00 smithi019 ceph-mon[30976]: election_strategy: 1 2024-09-19T08:44:01.227 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:00 smithi019 ceph-mon[30976]: 0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-19T08:44:01.227 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:00 smithi019 ceph-mon[30976]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.c 2024-09-19T08:44:01.227 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:00 smithi019 ceph-mon[30976]: fsmap 2024-09-19T08:44:01.227 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:00 smithi019 ceph-mon[30976]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:44:01.227 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:00 smithi019 ceph-mon[30976]: mgrmap e13: x(active, since 39s) 2024-09-19T08:44:01.227 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:00 smithi019 ceph-mon[30976]: overall HEALTH_OK 2024-09-19T08:44:01.227 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:00 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:01.227 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:00 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:01.227 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:00 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:01.227 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:00 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:44:01.227 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:00 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:01.541 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.539+0000 7f030c8c7640 1 -- 172.21.15.203:0/675468000 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02f0003530 msgr2=0x7f02f00059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:01.541 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.539+0000 7f030c8c7640 1 --2- 172.21.15.203:0/675468000 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02f0003530 0x7f02f00059c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f03081016a0 tx=0x7f02f802c490 comp rx=0 tx=0).stop 2024-09-19T08:44:01.541 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.540+0000 7f030c8c7640 1 -- 172.21.15.203:0/675468000 shutdown_connections 2024-09-19T08:44:01.541 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.540+0000 7f030c8c7640 1 --2- 172.21.15.203:0/675468000 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02f0003530 0x7f02f00059c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:01.541 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.540+0000 7f030c8c7640 1 -- 172.21.15.203:0/675468000 >> 172.21.15.203:0/675468000 conn(0x7f03080fc220 msgr2=0x7f03080fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:01.541 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.540+0000 7f030c8c7640 1 -- 172.21.15.203:0/675468000 shutdown_connections 2024-09-19T08:44:01.541 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.540+0000 7f030c8c7640 1 -- 172.21.15.203:0/675468000 wait complete. 2024-09-19T08:44:01.543 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.541+0000 7f030c8c7640 1 Processor -- start 2024-09-19T08:44:01.543 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.541+0000 7f030c8c7640 1 -- start start 2024-09-19T08:44:01.543 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.541+0000 7f030c8c7640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02f0003530 0x7f0308199480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:01.543 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.541+0000 7f030c8c7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03081999c0 0x7f030819dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:01.543 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.541+0000 7f030c8c7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0308108670 con 0x7f03081999c0 2024-09-19T08:44:01.543 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.541+0000 7f030c8c7640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f03081084f0 con 0x7f02f0003530 2024-09-19T08:44:01.543 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.542+0000 7f030659c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02f0003530 0x7f0308199480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:01.544 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.542+0000 7f0305d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03081999c0 0x7f030819dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:01.544 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.542+0000 7f030659c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02f0003530 0x7f0308199480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:45158/0 (socket says 172.21.15.203:45158) 2024-09-19T08:44:01.544 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.542+0000 7f0305d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03081999c0 0x7f030819dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.203:39078/0 (socket says 172.21.15.203:39078) 2024-09-19T08:44:01.544 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.542+0000 7f030659c640 1 -- 172.21.15.203:0/4234809421 learned_addr learned my addr 172.21.15.203:0/4234809421 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-19T08:44:01.544 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.542+0000 7f030659c640 1 -- 172.21.15.203:0/4234809421 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02f0003530 msgr2=0x7f0308199480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T08:44:01.544 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.542+0000 7f030659c640 1 -- 172.21.15.203:0/4234809421 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02f0003530 msgr2=0x7f0308199480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T08:44:01.544 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.542+0000 7f030659c640 1 --2- 172.21.15.203:0/4234809421 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02f0003530 0x7f0308199480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:44:01.544 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.542+0000 7f030659c640 1 --2- 172.21.15.203:0/4234809421 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02f0003530 0x7f0308199480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:44:01.544 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.542+0000 7f0305d9b640 1 -- 172.21.15.203:0/4234809421 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02f0003530 msgr2=0x7f0308199480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:44:01.544 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.542+0000 7f0305d9b640 1 --2- 172.21.15.203:0/4234809421 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02f0003530 0x7f0308199480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:01.544 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.542+0000 7f0305d9b640 1 -- 172.21.15.203:0/4234809421 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0308199fe0 con 0x7f03081999c0 2024-09-19T08:44:01.544 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.542+0000 7f0305d9b640 1 --2- 172.21.15.203:0/4234809421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03081999c0 0x7f030819dd50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f02fc00b3d0 tx=0x7f02fc00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:01.544 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.542+0000 7f02f77fe640 1 -- 172.21.15.203:0/4234809421 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f02fc011630 con 0x7f03081999c0 2024-09-19T08:44:01.545 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.543+0000 7f02f77fe640 1 -- 172.21.15.203:0/4234809421 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02fc011cb0 con 0x7f03081999c0 2024-09-19T08:44:01.545 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.543+0000 7f030c8c7640 1 -- 172.21.15.203:0/4234809421 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f030819e290 con 0x7f03081999c0 2024-09-19T08:44:01.545 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.543+0000 7f02f77fe640 1 -- 172.21.15.203:0/4234809421 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f02fc010df0 con 0x7f03081999c0 2024-09-19T08:44:01.545 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.543+0000 7f030c8c7640 1 -- 172.21.15.203:0/4234809421 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f030819e850 con 0x7f03081999c0 2024-09-19T08:44:01.545 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.544+0000 7f02f77fe640 1 -- 172.21.15.203:0/4234809421 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f02fc018020 con 0x7f03081999c0 2024-09-19T08:44:01.546 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.544+0000 7f030c8c7640 1 -- 172.21.15.203:0/4234809421 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f030819eb60 con 0x7f03081999c0 2024-09-19T08:44:01.546 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.544+0000 7f02f77fe640 1 --2- 172.21.15.203:0/4234809421 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f02e8039090 0x7f02e803b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:01.546 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.544+0000 7f02f77fe640 1 -- 172.21.15.203:0/4234809421 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f02fc04bf70 con 0x7f03081999c0 2024-09-19T08:44:01.546 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.544+0000 7f030659c640 1 --2- 172.21.15.203:0/4234809421 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f02e8039090 0x7f02e803b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:01.546 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.545+0000 7f030659c640 1 --2- 172.21.15.203:0/4234809421 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f02e8039090 0x7f02e803b550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f02f8012c10 tx=0x7f02f80323a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:01.553 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.553+0000 7f02f77fe640 1 -- 172.21.15.203:0/4234809421 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f02fc01f020 con 0x7f03081999c0 2024-09-19T08:44:01.789 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.788+0000 7f030c8c7640 1 -- 172.21.15.203:0/4234809421 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f030819a840 con 0x7f03081999c0 2024-09-19T08:44:01.789 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.789+0000 7f02f77fe640 1 -- 172.21.15.203:0/4234809421 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f02fc018310 con 0x7f03081999c0 2024-09-19T08:44:01.789 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T08:44:01.790 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":2,"fsid":"f26c9d84-7662-11ef-bceb-c7b262605968","modified":"2024-09-19T08:43:55.819479Z","created":"2024-09-19T08:42:29.207639Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:3300","nonce":0},{"type":"v1","addr":"172.21.15.19:6789","nonce":0}]},"addr":"172.21.15.19:6789/0","public_addr":"172.21.15.19:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:3300","nonce":0},{"type":"v1","addr":"172.21.15.203:6789","nonce":0}]},"addr":"172.21.15.203:6789/0","public_addr":"172.21.15.203:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T08:44:01.790 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 2 2024-09-19T08:44:01.792 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.791+0000 7f030c8c7640 1 -- 172.21.15.203:0/4234809421 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f02e8039090 msgr2=0x7f02e803b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:01.792 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.791+0000 7f030c8c7640 1 --2- 172.21.15.203:0/4234809421 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f02e8039090 0x7f02e803b550 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f02f8012c10 tx=0x7f02f80323a0 comp rx=0 tx=0).stop 2024-09-19T08:44:01.792 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.791+0000 7f030c8c7640 1 -- 172.21.15.203:0/4234809421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03081999c0 msgr2=0x7f030819dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:01.792 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.791+0000 7f030c8c7640 1 --2- 172.21.15.203:0/4234809421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03081999c0 0x7f030819dd50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f02fc00b3d0 tx=0x7f02fc00b890 comp rx=0 tx=0).stop 2024-09-19T08:44:01.792 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.791+0000 7f030c8c7640 1 -- 172.21.15.203:0/4234809421 shutdown_connections 2024-09-19T08:44:01.792 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.791+0000 7f030c8c7640 1 --2- 172.21.15.203:0/4234809421 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f02e8039090 0x7f02e803b550 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:01.792 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.791+0000 7f030c8c7640 1 --2- 172.21.15.203:0/4234809421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f03081999c0 0x7f030819dd50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:01.792 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.791+0000 7f030c8c7640 1 --2- 172.21.15.203:0/4234809421 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02f0003530 0x7f0308199480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:01.792 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.791+0000 7f030c8c7640 1 -- 172.21.15.203:0/4234809421 >> 172.21.15.203:0/4234809421 conn(0x7f03080fc220 msgr2=0x7f030806a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:01.792 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.791+0000 7f030c8c7640 1 -- 172.21.15.203:0/4234809421 shutdown_connections 2024-09-19T08:44:01.792 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:01.791+0000 7f030c8c7640 1 -- 172.21.15.203:0/4234809421 wait complete. 2024-09-19T08:44:02.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:01 smithi019 ceph-mon[30976]: Deploying daemon mon.b on smithi155 2024-09-19T08:44:02.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:01 smithi019 ceph-mon[30976]: from='client.? 172.21.15.203:0/4234809421' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:44:02.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:01 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:44:03.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:02 smithi203 ceph-mon[35450]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:03.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:02 smithi019 ceph-mon[30976]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:03.395 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T08:44:03.396 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:44:03.645 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:44:04.053 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.049+0000 7fe4fdc22640 1 -- 172.21.15.203:0/3940021022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4f8074590 msgr2=0x7fe4f8074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:04.053 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.049+0000 7fe4fdc22640 1 --2- 172.21.15.203:0/3940021022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4f8074590 0x7fe4f8074970 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe4e8009880 tx=0x7fe4e802a670 comp rx=0 tx=0).stop 2024-09-19T08:44:04.053 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.049+0000 7fe4fdc22640 1 -- 172.21.15.203:0/3940021022 shutdown_connections 2024-09-19T08:44:04.053 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.049+0000 7fe4fdc22640 1 --2- 172.21.15.203:0/3940021022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4f8074590 0x7fe4f8074970 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:04.053 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.049+0000 7fe4fdc22640 1 -- 172.21.15.203:0/3940021022 >> 172.21.15.203:0/3940021022 conn(0x7fe4f80fd320 msgr2=0x7fe4f80ff740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:04.053 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.049+0000 7fe4fdc22640 1 -- 172.21.15.203:0/3940021022 shutdown_connections 2024-09-19T08:44:04.053 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.049+0000 7fe4fdc22640 1 -- 172.21.15.203:0/3940021022 wait complete. 2024-09-19T08:44:04.053 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.050+0000 7fe4fdc22640 1 Processor -- start 2024-09-19T08:44:04.053 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.050+0000 7fe4fdc22640 1 -- start start 2024-09-19T08:44:04.053 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.050+0000 7fe4fdc22640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4f8074590 0x7fe4f81a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:04.053 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.050+0000 7fe4fdc22640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4f81a3be0 0x7fe4f819d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:04.054 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.050+0000 7fe4fdc22640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f8112380 con 0x7fe4f81a3be0 2024-09-19T08:44:04.054 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.050+0000 7fe4fdc22640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f8112200 con 0x7fe4f8074590 2024-09-19T08:44:04.054 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.050+0000 7fe4f77fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4f8074590 0x7fe4f81a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:04.054 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.050+0000 7fe4f77fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4f8074590 0x7fe4f81a36a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:45164/0 (socket says 172.21.15.203:45164) 2024-09-19T08:44:04.054 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.050+0000 7fe4f77fe640 1 -- 172.21.15.203:0/3112636400 learned_addr learned my addr 172.21.15.203:0/3112636400 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-19T08:44:04.054 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.050+0000 7fe4f77fe640 1 -- 172.21.15.203:0/3112636400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4f8074590 msgr2=0x7fe4f81a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T08:44:04.054 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.050+0000 7fe4f77fe640 1 -- 172.21.15.203:0/3112636400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4f8074590 msgr2=0x7fe4f81a36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T08:44:04.054 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.050+0000 7fe4f77fe640 1 --2- 172.21.15.203:0/3112636400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4f8074590 0x7fe4f81a36a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:44:04.054 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.050+0000 7fe4f77fe640 1 --2- 172.21.15.203:0/3112636400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4f8074590 0x7fe4f81a36a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:44:04.054 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.051+0000 7fe4f6ffd640 1 --2- 172.21.15.203:0/3112636400 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4f81a3be0 0x7fe4f819d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:04.054 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.051+0000 7fe4f6ffd640 1 -- 172.21.15.203:0/3112636400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4f8074590 msgr2=0x7fe4f81a36a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:44:04.054 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.051+0000 7fe4f6ffd640 1 --2- 172.21.15.203:0/3112636400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4f8074590 0x7fe4f81a36a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:04.054 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.051+0000 7fe4f6ffd640 1 -- 172.21.15.203:0/3112636400 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f81a41f0 con 0x7fe4f81a3be0 2024-09-19T08:44:04.055 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.051+0000 7fe4f6ffd640 1 --2- 172.21.15.203:0/3112636400 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4f81a3be0 0x7fe4f819d860 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec00b3d0 tx=0x7fe4ec00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:04.055 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.051+0000 7fe4f4ff9640 1 -- 172.21.15.203:0/3112636400 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fe4ec011630 con 0x7fe4f81a3be0 2024-09-19T08:44:04.055 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.051+0000 7fe4f4ff9640 1 -- 172.21.15.203:0/3112636400 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4ec011cb0 con 0x7fe4f81a3be0 2024-09-19T08:44:04.055 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.051+0000 7fe4fdc22640 1 -- 172.21.15.203:0/3112636400 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4f819dda0 con 0x7fe4f81a3be0 2024-09-19T08:44:04.055 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.051+0000 7fe4f4ff9640 1 -- 172.21.15.203:0/3112636400 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fe4ec010df0 con 0x7fe4f81a3be0 2024-09-19T08:44:04.055 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.051+0000 7fe4fdc22640 1 -- 172.21.15.203:0/3112636400 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4f819e330 con 0x7fe4f81a3be0 2024-09-19T08:44:04.056 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.053+0000 7fe4f4ff9640 1 -- 172.21.15.203:0/3112636400 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fe4ec018020 con 0x7fe4f81a3be0 2024-09-19T08:44:04.056 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.053+0000 7fe4fdc22640 1 -- 172.21.15.203:0/3112636400 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4f8075cd0 con 0x7fe4f81a3be0 2024-09-19T08:44:04.056 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.053+0000 7fe4f4ff9640 1 --2- 172.21.15.203:0/3112636400 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe4e0039090 0x7fe4e003b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:04.056 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.053+0000 7fe4f4ff9640 1 -- 172.21.15.203:0/3112636400 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe4ec04c060 con 0x7fe4f81a3be0 2024-09-19T08:44:04.057 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.053+0000 7fe4f77fe640 1 --2- 172.21.15.203:0/3112636400 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe4e0039090 0x7fe4e003b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:04.057 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.053+0000 7fe4f77fe640 1 --2- 172.21.15.203:0/3112636400 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe4e0039090 0x7fe4e003b550 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe4e80096c0 tx=0x7fe4e8031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:04.058 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.058+0000 7fe4f4ff9640 1 -- 172.21.15.203:0/3112636400 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe4ec01f020 con 0x7fe4f81a3be0 2024-09-19T08:44:04.287 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.286+0000 7fe4fdc22640 1 -- 172.21.15.203:0/3112636400 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fe4f819ed90 con 0x7fe4f81a3be0 2024-09-19T08:44:04.287 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.287+0000 7fe4f4ff9640 1 -- 172.21.15.203:0/3112636400 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7fe4ec018310 con 0x7fe4f81a3be0 2024-09-19T08:44:04.288 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T08:44:04.288 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":2,"fsid":"f26c9d84-7662-11ef-bceb-c7b262605968","modified":"2024-09-19T08:43:55.819479Z","created":"2024-09-19T08:42:29.207639Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:3300","nonce":0},{"type":"v1","addr":"172.21.15.19:6789","nonce":0}]},"addr":"172.21.15.19:6789/0","public_addr":"172.21.15.19:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:3300","nonce":0},{"type":"v1","addr":"172.21.15.203:6789","nonce":0}]},"addr":"172.21.15.203:6789/0","public_addr":"172.21.15.203:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T08:44:04.288 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 2 2024-09-19T08:44:04.290 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.289+0000 7fe4fdc22640 1 -- 172.21.15.203:0/3112636400 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe4e0039090 msgr2=0x7fe4e003b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:04.290 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.289+0000 7fe4fdc22640 1 --2- 172.21.15.203:0/3112636400 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe4e0039090 0x7fe4e003b550 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fe4e80096c0 tx=0x7fe4e8031400 comp rx=0 tx=0).stop 2024-09-19T08:44:04.290 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.289+0000 7fe4fdc22640 1 -- 172.21.15.203:0/3112636400 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4f81a3be0 msgr2=0x7fe4f819d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:04.290 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.289+0000 7fe4fdc22640 1 --2- 172.21.15.203:0/3112636400 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4f81a3be0 0x7fe4f819d860 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec00b3d0 tx=0x7fe4ec00b890 comp rx=0 tx=0).stop 2024-09-19T08:44:04.290 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.289+0000 7fe4fdc22640 1 -- 172.21.15.203:0/3112636400 shutdown_connections 2024-09-19T08:44:04.290 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.289+0000 7fe4fdc22640 1 --2- 172.21.15.203:0/3112636400 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe4e0039090 0x7fe4e003b550 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:04.290 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.289+0000 7fe4fdc22640 1 --2- 172.21.15.203:0/3112636400 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4f81a3be0 0x7fe4f819d860 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:04.290 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.289+0000 7fe4fdc22640 1 --2- 172.21.15.203:0/3112636400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4f8074590 0x7fe4f81a36a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:04.290 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.289+0000 7fe4fdc22640 1 -- 172.21.15.203:0/3112636400 >> 172.21.15.203:0/3112636400 conn(0x7fe4f80fd320 msgr2=0x7fe4f80fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:04.290 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.289+0000 7fe4fdc22640 1 -- 172.21.15.203:0/3112636400 shutdown_connections 2024-09-19T08:44:04.291 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:04.289+0000 7fe4fdc22640 1 -- 172.21.15.203:0/3112636400 wait complete. 2024-09-19T08:44:04.497 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 podman[34903]: 2024-09-19 08:44:04.476467591 +0000 UTC m=+0.345821826 container start 8405faf5060a2edf5680c2717a46178f0ed60058a826c21778a808a6051e139c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mon-b, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=) 2024-09-19T08:44:04.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T08:44:04.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T08:44:04.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: pidfile_write: ignore empty --pid-file 2024-09-19T08:44:04.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: load: jerasure load: lrc 2024-09-19T08:44:04.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: RocksDB version: 7.9.2 2024-09-19T08:44:04.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Git sha 0 2024-09-19T08:44:04.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T08:44:04.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: DB SUMMARY 2024-09-19T08:44:04.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: DB Session ID: C1ZDFA7S7HELTZNGC74H 2024-09-19T08:44:04.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: CURRENT file: CURRENT 2024-09-19T08:44:04.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T08:44:04.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-19T08:44:04.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-19T08:44:04.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-09-19T08:44:04.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.error_if_exists: 0 2024-09-19T08:44:04.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.create_if_missing: 0 2024-09-19T08:44:04.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.paranoid_checks: 1 2024-09-19T08:44:04.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T08:44:04.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T08:44:04.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T08:44:04.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.env: 0x55ec60a56940 2024-09-19T08:44:04.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T08:44:04.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.info_log: 0x55ec61de96e0 2024-09-19T08:44:04.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T08:44:04.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.statistics: (nil) 2024-09-19T08:44:04.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.use_fsync: 0 2024-09-19T08:44:04.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.max_log_file_size: 0 2024-09-19T08:44:04.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T08:44:04.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T08:44:04.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T08:44:04.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T08:44:04.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.allow_fallocate: 1 2024-09-19T08:44:04.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T08:44:04.926 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T08:44:04.926 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.use_direct_reads: 0 2024-09-19T08:44:04.926 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T08:44:04.926 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T08:44:04.926 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.db_log_dir: 2024-09-19T08:44:04.926 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.wal_dir: 2024-09-19T08:44:04.926 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T08:44:04.928 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T08:44:04.928 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T08:44:04.928 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T08:44:04.928 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T08:44:04.928 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T08:44:04.928 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T08:44:04.928 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T08:44:04.928 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.write_buffer_manager: 0x55ec61df8dc0 2024-09-19T08:44:04.928 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T08:44:04.928 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T08:44:04.929 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T08:44:04.929 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T08:44:04.929 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T08:44:04.929 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T08:44:04.929 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T08:44:04.929 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T08:44:04.929 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.unordered_write: 0 2024-09-19T08:44:04.929 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T08:44:04.929 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T08:44:04.929 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T08:44:04.929 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T08:44:04.929 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.row_cache: None 2024-09-19T08:44:04.929 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.wal_filter: None 2024-09-19T08:44:04.930 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T08:44:04.930 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T08:44:04.930 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.two_write_queues: 0 2024-09-19T08:44:04.930 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T08:44:04.930 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.wal_compression: 0 2024-09-19T08:44:04.930 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.atomic_flush: 0 2024-09-19T08:44:04.930 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T08:44:04.930 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T08:44:04.930 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T08:44:04.930 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.log_readahead_size: 0 2024-09-19T08:44:04.930 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T08:44:04.930 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T08:44:04.930 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T08:44:04.931 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T08:44:04.931 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T08:44:04.931 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T08:44:04.931 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T08:44:04.931 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.max_background_jobs: 2 2024-09-19T08:44:04.931 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.max_background_compactions: -1 2024-09-19T08:44:04.931 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.max_subcompactions: 1 2024-09-19T08:44:04.931 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T08:44:04.931 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T08:44:04.931 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T08:44:04.931 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T08:44:04.931 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T08:44:04.931 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T08:44:04.932 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T08:44:04.932 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T08:44:04.932 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.max_open_files: -1 2024-09-19T08:44:04.932 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T08:44:04.932 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T08:44:04.932 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T08:44:04.932 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T08:44:04.932 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.max_background_flushes: -1 2024-09-19T08:44:04.932 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Compression algorithms supported: 2024-09-19T08:44:04.932 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: kZSTD supported: 0 2024-09-19T08:44:04.932 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: kXpressCompression supported: 0 2024-09-19T08:44:04.932 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: kBZip2Compression supported: 0 2024-09-19T08:44:04.932 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T08:44:04.932 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: kLZ4Compression supported: 1 2024-09-19T08:44:04.933 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: kZlibCompression supported: 1 2024-09-19T08:44:04.933 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T08:44:04.933 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: kSnappyCompression supported: 1 2024-09-19T08:44:04.933 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T08:44:04.933 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T08:44:04.933 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-19T08:44:04.933 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T08:44:04.933 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T08:44:04.933 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.merge_operator: 2024-09-19T08:44:04.933 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.compaction_filter: None 2024-09-19T08:44:04.933 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T08:44:04.933 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T08:44:04.933 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T08:44:04.934 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T08:44:04.934 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ec61de9320) 2024-09-19T08:44:04.934 INFO:journalctl@ceph.mon.b.smithi155.stdout: cache_index_and_filter_blocks: 1 2024-09-19T08:44:04.934 INFO:journalctl@ceph.mon.b.smithi155.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T08:44:04.934 INFO:journalctl@ceph.mon.b.smithi155.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T08:44:04.934 INFO:journalctl@ceph.mon.b.smithi155.stdout: pin_top_level_index_and_filter: 1 2024-09-19T08:44:04.934 INFO:journalctl@ceph.mon.b.smithi155.stdout: index_type: 0 2024-09-19T08:44:04.934 INFO:journalctl@ceph.mon.b.smithi155.stdout: data_block_index_type: 0 2024-09-19T08:44:04.934 INFO:journalctl@ceph.mon.b.smithi155.stdout: index_shortening: 1 2024-09-19T08:44:04.934 INFO:journalctl@ceph.mon.b.smithi155.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T08:44:04.934 INFO:journalctl@ceph.mon.b.smithi155.stdout: checksum: 4 2024-09-19T08:44:04.934 INFO:journalctl@ceph.mon.b.smithi155.stdout: no_block_cache: 0 2024-09-19T08:44:04.934 INFO:journalctl@ceph.mon.b.smithi155.stdout: block_cache: 0x55ec61ddd1f0 2024-09-19T08:44:04.935 INFO:journalctl@ceph.mon.b.smithi155.stdout: block_cache_name: BinnedLRUCache 2024-09-19T08:44:04.935 INFO:journalctl@ceph.mon.b.smithi155.stdout: block_cache_options: 2024-09-19T08:44:04.935 INFO:journalctl@ceph.mon.b.smithi155.stdout: capacity : 536870912 2024-09-19T08:44:04.935 INFO:journalctl@ceph.mon.b.smithi155.stdout: num_shard_bits : 4 2024-09-19T08:44:04.935 INFO:journalctl@ceph.mon.b.smithi155.stdout: strict_capacity_limit : 0 2024-09-19T08:44:04.935 INFO:journalctl@ceph.mon.b.smithi155.stdout: high_pri_pool_ratio: 0.000 2024-09-19T08:44:04.935 INFO:journalctl@ceph.mon.b.smithi155.stdout: block_cache_compressed: (nil) 2024-09-19T08:44:04.935 INFO:journalctl@ceph.mon.b.smithi155.stdout: persistent_cache: (nil) 2024-09-19T08:44:04.935 INFO:journalctl@ceph.mon.b.smithi155.stdout: block_size: 4096 2024-09-19T08:44:04.935 INFO:journalctl@ceph.mon.b.smithi155.stdout: block_size_deviation: 10 2024-09-19T08:44:04.935 INFO:journalctl@ceph.mon.b.smithi155.stdout: block_restart_interval: 16 2024-09-19T08:44:04.935 INFO:journalctl@ceph.mon.b.smithi155.stdout: index_block_restart_interval: 1 2024-09-19T08:44:04.935 INFO:journalctl@ceph.mon.b.smithi155.stdout: metadata_block_size: 4096 2024-09-19T08:44:04.935 INFO:journalctl@ceph.mon.b.smithi155.stdout: partition_filters: 0 2024-09-19T08:44:04.936 INFO:journalctl@ceph.mon.b.smithi155.stdout: use_delta_encoding: 1 2024-09-19T08:44:04.936 INFO:journalctl@ceph.mon.b.smithi155.stdout: filter_policy: bloomfilter 2024-09-19T08:44:04.936 INFO:journalctl@ceph.mon.b.smithi155.stdout: whole_key_filtering: 1 2024-09-19T08:44:04.936 INFO:journalctl@ceph.mon.b.smithi155.stdout: verify_compression: 0 2024-09-19T08:44:04.936 INFO:journalctl@ceph.mon.b.smithi155.stdout: read_amp_bytes_per_bit: 0 2024-09-19T08:44:04.936 INFO:journalctl@ceph.mon.b.smithi155.stdout: format_version: 5 2024-09-19T08:44:04.936 INFO:journalctl@ceph.mon.b.smithi155.stdout: enable_index_compression: 1 2024-09-19T08:44:04.936 INFO:journalctl@ceph.mon.b.smithi155.stdout: block_align: 0 2024-09-19T08:44:04.936 INFO:journalctl@ceph.mon.b.smithi155.stdout: max_auto_readahead_size: 262144 2024-09-19T08:44:04.936 INFO:journalctl@ceph.mon.b.smithi155.stdout: prepopulate_block_cache: 0 2024-09-19T08:44:04.936 INFO:journalctl@ceph.mon.b.smithi155.stdout: initial_auto_readahead_size: 8192 2024-09-19T08:44:04.936 INFO:journalctl@ceph.mon.b.smithi155.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T08:44:04.936 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T08:44:04.937 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T08:44:04.937 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.compression: NoCompression 2024-09-19T08:44:04.937 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T08:44:04.937 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T08:44:04.937 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T08:44:04.937 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.num_levels: 7 2024-09-19T08:44:04.937 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T08:44:04.937 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T08:44:04.937 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T08:44:04.937 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T08:44:04.937 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T08:44:04.937 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T08:44:04.937 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T08:44:04.937 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T08:44:04.938 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T08:44:04.938 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T08:44:04.938 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T08:44:04.938 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T08:44:04.938 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T08:44:04.938 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T08:44:04.938 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T08:44:04.938 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T08:44:04.938 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T08:44:04.938 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T08:44:04.938 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T08:44:04.938 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T08:44:04.938 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T08:44:04.938 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T08:44:04.939 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T08:44:04.939 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T08:44:04.939 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T08:44:04.939 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T08:44:04.939 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T08:44:04.939 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T08:44:04.939 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T08:44:04.939 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T08:44:04.939 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T08:44:04.939 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T08:44:04.939 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T08:44:04.939 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T08:44:04.939 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T08:44:04.940 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T08:44:04.940 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T08:44:04.940 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T08:44:04.940 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T08:44:04.940 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T08:44:04.940 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T08:44:04.940 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T08:44:04.940 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T08:44:04.940 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T08:44:04.940 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T08:44:04.940 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T08:44:04.940 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T08:44:04.940 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T08:44:04.940 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T08:44:04.941 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T08:44:04.941 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T08:44:04.941 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T08:44:04.941 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T08:44:04.941 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T08:44:04.941 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.inplace_update_support: 0 2024-09-19T08:44:04.941 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T08:44:04.941 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T08:44:04.941 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T08:44:04.941 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T08:44:04.941 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.bloom_locality: 0 2024-09-19T08:44:04.941 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.max_successive_merges: 0 2024-09-19T08:44:04.941 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T08:44:04.941 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T08:44:04.942 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T08:44:04.942 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T08:44:04.942 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.ttl: 2592000 2024-09-19T08:44:04.942 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T08:44:04.942 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T08:44:04.942 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T08:44:04.942 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.enable_blob_files: false 2024-09-19T08:44:04.942 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.min_blob_size: 0 2024-09-19T08:44:04.942 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T08:44:04.942 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T08:44:04.942 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T08:44:04.942 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T08:44:04.942 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T08:44:04.942 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T08:44:04.943 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T08:44:04.943 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T08:44:04.943 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-19T08:44:04.943 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-19T08:44:04.943 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 0006c428-9c3e-4127-9563-93ea0301dca9 2024-09-19T08:44:04.943 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726735444503621, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-19T08:44:04.943 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-19T08:44:04.943 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726735444504035, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726735444, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "0006c428-9c3e-4127-9563-93ea0301dca9", "db_session_id": "C1ZDFA7S7HELTZNGC74H", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-19T08:44:04.943 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726735444504127, "job": 1, "event": "recovery_finished"} 2024-09-19T08:44:04.943 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-19T08:44:04.943 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T08:44:04.943 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55ec61e0ae00 2024-09-19T08:44:04.943 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: DB pointer 0x55ec61f06000 2024-09-19T08:44:04.943 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T08:44:04.944 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T08:44:04.944 INFO:journalctl@ceph.mon.b.smithi155.stdout: ** DB Stats ** 2024-09-19T08:44:04.944 INFO:journalctl@ceph.mon.b.smithi155.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T08:44:04.944 INFO:journalctl@ceph.mon.b.smithi155.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T08:44:04.944 INFO:journalctl@ceph.mon.b.smithi155.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T08:44:04.944 INFO:journalctl@ceph.mon.b.smithi155.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T08:44:04.944 INFO:journalctl@ceph.mon.b.smithi155.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T08:44:04.944 INFO:journalctl@ceph.mon.b.smithi155.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T08:44:04.944 INFO:journalctl@ceph.mon.b.smithi155.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T08:44:04.944 INFO:journalctl@ceph.mon.b.smithi155.stdout: 2024-09-19T08:44:04.944 INFO:journalctl@ceph.mon.b.smithi155.stdout: ** Compaction Stats [default] ** 2024-09-19T08:44:04.944 INFO:journalctl@ceph.mon.b.smithi155.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T08:44:04.944 INFO:journalctl@ceph.mon.b.smithi155.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T08:44:04.944 INFO:journalctl@ceph.mon.b.smithi155.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T08:44:04.945 INFO:journalctl@ceph.mon.b.smithi155.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T08:44:04.945 INFO:journalctl@ceph.mon.b.smithi155.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T08:44:04.945 INFO:journalctl@ceph.mon.b.smithi155.stdout: 2024-09-19T08:44:04.945 INFO:journalctl@ceph.mon.b.smithi155.stdout: ** Compaction Stats [default] ** 2024-09-19T08:44:04.945 INFO:journalctl@ceph.mon.b.smithi155.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T08:44:04.945 INFO:journalctl@ceph.mon.b.smithi155.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T08:44:04.945 INFO:journalctl@ceph.mon.b.smithi155.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.3 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T08:44:04.945 INFO:journalctl@ceph.mon.b.smithi155.stdout: 2024-09-19T08:44:04.945 INFO:journalctl@ceph.mon.b.smithi155.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T08:44:04.945 INFO:journalctl@ceph.mon.b.smithi155.stdout: 2024-09-19T08:44:04.945 INFO:journalctl@ceph.mon.b.smithi155.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T08:44:04.945 INFO:journalctl@ceph.mon.b.smithi155.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T08:44:04.945 INFO:journalctl@ceph.mon.b.smithi155.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T08:44:04.946 INFO:journalctl@ceph.mon.b.smithi155.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T08:44:04.946 INFO:journalctl@ceph.mon.b.smithi155.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T08:44:04.946 INFO:journalctl@ceph.mon.b.smithi155.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T08:44:04.946 INFO:journalctl@ceph.mon.b.smithi155.stdout: Cumulative compaction: 0.00 GB write, 0.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T08:44:04.946 INFO:journalctl@ceph.mon.b.smithi155.stdout: Interval compaction: 0.00 GB write, 0.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T08:44:04.946 INFO:journalctl@ceph.mon.b.smithi155.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T08:44:04.946 INFO:journalctl@ceph.mon.b.smithi155.stdout: Block cache BinnedLRUCache@0x55ec61ddd1f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-19T08:44:04.946 INFO:journalctl@ceph.mon.b.smithi155.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-19T08:44:04.946 INFO:journalctl@ceph.mon.b.smithi155.stdout: 2024-09-19T08:44:04.946 INFO:journalctl@ceph.mon.b.smithi155.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T08:44:04.946 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-19T08:44:04.946 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: using public_addr v2:172.21.15.155:0/0 -> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] 2024-09-19T08:44:04.946 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: starting mon.b rank -1 at public addrs [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] at bind addrs [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid f26c9d84-7662-11ef-bceb-c7b262605968 2024-09-19T08:44:04.946 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: mon.b@-1(???) e0 preinit fsid f26c9d84-7662-11ef-bceb-c7b262605968 2024-09-19T08:44:04.947 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: mon.b@-1(synchronizing).mds e1 new map 2024-09-19T08:44:04.947 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-19T08:44:04.947 INFO:journalctl@ceph.mon.b.smithi155.stdout: e1 2024-09-19T08:44:04.947 INFO:journalctl@ceph.mon.b.smithi155.stdout: btime 2024-09-19T08:42:32:323860+0000 2024-09-19T08:44:04.947 INFO:journalctl@ceph.mon.b.smithi155.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T08:44:04.947 INFO:journalctl@ceph.mon.b.smithi155.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T08:44:04.947 INFO:journalctl@ceph.mon.b.smithi155.stdout: legacy client fscid: -1 2024-09-19T08:44:04.947 INFO:journalctl@ceph.mon.b.smithi155.stdout: 2024-09-19T08:44:04.947 INFO:journalctl@ceph.mon.b.smithi155.stdout: No filesystems configured 2024-09-19T08:44:04.947 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-19T08:44:04.947 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-19T08:44:04.947 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-19T08:44:04.947 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-19T08:44:04.948 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-19T08:44:04.948 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-19T08:44:04.948 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T08:44:04.948 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:44:04.948 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:44:04.948 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T08:44:04.948 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:04.948 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:04.948 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:44:04.948 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/713377940' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T08:44:04.948 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:04.948 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/713377940' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T08:44:04.948 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:44:04.949 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:04.949 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:04.949 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:04.949 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:04.949 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi203", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:04.949 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:04.949 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:44:04.949 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: Updating smithi203:/etc/ceph/ceph.conf 2024-09-19T08:44:04.949 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: Updating smithi203:/var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:44:04.949 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:44:04.949 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: Updating smithi203:/var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T08:44:04.949 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi019:172.21.15.19=a;smithi155:172.21.15.155=b;smithi203:172.21.15.203=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:04.949 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: Saving service mon spec with placement smithi019:172.21.15.19=a;smithi155:172.21.15.155=b;smithi203:172.21.15.203=c;count:3 2024-09-19T08:44:04.949 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:04.950 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:04.950 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:04.950 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:04.950 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:44:04.950 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:04.950 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: Deploying daemon mon.c on smithi203 2024-09-19T08:44:04.950 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:04.950 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:04.950 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: from='client.? 172.21.15.203:0/1269126449' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:44:04.950 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:04.950 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:44:04.951 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:44:04.951 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: mon.a calling monitor election 2024-09-19T08:44:04.951 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:44:04.951 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:04.951 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:44:04.951 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: mon.c calling monitor election 2024-09-19T08:44:04.951 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:44:04.951 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:04.951 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:44:04.951 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:44:04.951 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T08:44:04.951 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: monmap epoch 2 2024-09-19T08:44:04.951 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: fsid f26c9d84-7662-11ef-bceb-c7b262605968 2024-09-19T08:44:04.951 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: last_changed 2024-09-19T08:43:55.819479+0000 2024-09-19T08:44:04.952 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: created 2024-09-19T08:42:29.207639+0000 2024-09-19T08:44:04.952 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: min_mon_release 19 (squid) 2024-09-19T08:44:04.952 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: election_strategy: 1 2024-09-19T08:44:04.952 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: 0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-19T08:44:04.952 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.c 2024-09-19T08:44:04.952 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: fsmap 2024-09-19T08:44:04.952 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:44:04.952 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: mgrmap e13: x(active, since 39s) 2024-09-19T08:44:04.952 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: overall HEALTH_OK 2024-09-19T08:44:04.952 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:04.952 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:04.952 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:04.952 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:44:04.953 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:04.953 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: Deploying daemon mon.b on smithi155 2024-09-19T08:44:04.953 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: from='client.? 172.21.15.203:0/4234809421' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:44:04.953 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:44:04.953 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:04.953 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 ceph-mon[34921]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-19T08:44:04.953 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 bash[34903]: 8405faf5060a2edf5680c2717a46178f0ed60058a826c21778a808a6051e139c 2024-09-19T08:44:04.953 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:04 smithi155 systemd[1]: Started Ceph mon.b for f26c9d84-7662-11ef-bceb-c7b262605968. 2024-09-19T08:44:05.859 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T08:44:05.859 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T08:44:06.110 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:44:09.697 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.697+0000 7fe0dd6c8640 1 -- 172.21.15.203:0/1944617616 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0c4003530 msgr2=0x7fe0c40059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:09.698 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.697+0000 7fe0dd6c8640 1 --2- 172.21.15.203:0/1944617616 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0c4003530 0x7fe0c40059c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe0d8102b40 tx=0x7fe0c802c150 comp rx=0 tx=0).stop 2024-09-19T08:44:09.698 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.697+0000 7fe0dd6c8640 1 -- 172.21.15.203:0/1944617616 shutdown_connections 2024-09-19T08:44:09.698 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.697+0000 7fe0dd6c8640 1 --2- 172.21.15.203:0/1944617616 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0c4003530 0x7fe0c40059c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:09.698 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.697+0000 7fe0dd6c8640 1 -- 172.21.15.203:0/1944617616 >> 172.21.15.203:0/1944617616 conn(0x7fe0d80fd3b0 msgr2=0x7fe0d80ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:09.698 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.698+0000 7fe0dd6c8640 1 -- 172.21.15.203:0/1944617616 shutdown_connections 2024-09-19T08:44:09.698 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.698+0000 7fe0dd6c8640 1 -- 172.21.15.203:0/1944617616 wait complete. 2024-09-19T08:44:09.698 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.698+0000 7fe0dd6c8640 1 Processor -- start 2024-09-19T08:44:09.700 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.699+0000 7fe0dd6c8640 1 -- start start 2024-09-19T08:44:09.700 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.699+0000 7fe0dd6c8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0c4003530 0x7fe0d80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:09.700 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.699+0000 7fe0dd6c8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0d8074a30 0x7fe0d8074e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:09.700 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.699+0000 7fe0dd6c8640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0d81a3530 0x7fe0d81a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:09.700 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.699+0000 7fe0dd6c8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d81097d0 con 0x7fe0d8074a30 2024-09-19T08:44:09.700 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.699+0000 7fe0dd6c8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d8109650 con 0x7fe0c4003530 2024-09-19T08:44:09.700 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.699+0000 7fe0dd6c8640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe0d8109950 con 0x7fe0d81a3530 2024-09-19T08:44:09.701 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.699+0000 7fe0d77fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0d81a3530 0x7fe0d81a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:09.701 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.699+0000 7fe0d6ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0c4003530 0x7fe0d80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:09.701 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.699+0000 7fe0d77fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0d81a3530 0x7fe0d81a5920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:45178/0 (socket says 172.21.15.203:45178) 2024-09-19T08:44:09.701 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.699+0000 7fe0d77fe640 1 -- 172.21.15.203:0/2039545907 learned_addr learned my addr 172.21.15.203:0/2039545907 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-19T08:44:09.701 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.699+0000 7fe0ce7fc640 1 --2- 172.21.15.203:0/2039545907 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0d8074a30 0x7fe0d8074e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:09.701 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.699+0000 7fe0d77fe640 1 -- 172.21.15.203:0/2039545907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0d81a3530 msgr2=0x7fe0d81a5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-19T08:44:09.701 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.699+0000 7fe0d77fe640 1 -- 172.21.15.203:0/2039545907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0d81a3530 msgr2=0x7fe0d81a5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T08:44:09.701 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.699+0000 7fe0d77fe640 1 --2- 172.21.15.203:0/2039545907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0d81a3530 0x7fe0d81a5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:44:09.701 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.699+0000 7fe0d6ffd640 1 -- 172.21.15.203:0/2039545907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0c4003530 msgr2=0x7fe0d80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T08:44:09.701 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.699+0000 7fe0d6ffd640 1 -- 172.21.15.203:0/2039545907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0c4003530 msgr2=0x7fe0d80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T08:44:09.701 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.699+0000 7fe0d6ffd640 1 --2- 172.21.15.203:0/2039545907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0c4003530 0x7fe0d80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T08:44:09.701 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.699+0000 7fe0d6ffd640 1 --2- 172.21.15.203:0/2039545907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0c4003530 0x7fe0d80744f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:44:09.702 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.699+0000 7fe0d77fe640 1 --2- 172.21.15.203:0/2039545907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0d81a3530 0x7fe0d81a5920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T08:44:09.702 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.700+0000 7fe0ce7fc640 1 -- 172.21.15.203:0/2039545907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0d81a3530 msgr2=0x7fe0d81a5920 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:44:09.702 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.700+0000 7fe0ce7fc640 1 --2- 172.21.15.203:0/2039545907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0d81a3530 0x7fe0d81a5920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:09.702 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.700+0000 7fe0ce7fc640 1 -- 172.21.15.203:0/2039545907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0c4003530 msgr2=0x7fe0d80744f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T08:44:09.702 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.700+0000 7fe0ce7fc640 1 --2- 172.21.15.203:0/2039545907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0c4003530 0x7fe0d80744f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:09.702 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.700+0000 7fe0ce7fc640 1 -- 172.21.15.203:0/2039545907 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0d81a5ff0 con 0x7fe0d8074a30 2024-09-19T08:44:09.702 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.700+0000 7fe0ce7fc640 1 --2- 172.21.15.203:0/2039545907 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0d8074a30 0x7fe0d8074e90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe0c000b450 tx=0x7fe0c000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:09.702 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.700+0000 7fe0d4ff9640 1 -- 172.21.15.203:0/2039545907 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0004230 con 0x7fe0d8074a30 2024-09-19T08:44:09.702 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.700+0000 7fe0d4ff9640 1 -- 172.21.15.203:0/2039545907 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe0c00043d0 con 0x7fe0d8074a30 2024-09-19T08:44:09.702 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.700+0000 7fe0dd6c8640 1 -- 172.21.15.203:0/2039545907 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0d81a62e0 con 0x7fe0d8074a30 2024-09-19T08:44:09.702 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.700+0000 7fe0d4ff9640 1 -- 172.21.15.203:0/2039545907 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c0003cb0 con 0x7fe0d8074a30 2024-09-19T08:44:09.702 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.700+0000 7fe0dd6c8640 1 -- 172.21.15.203:0/2039545907 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0d81a6870 con 0x7fe0d8074a30 2024-09-19T08:44:09.703 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.701+0000 7fe0d4ff9640 1 -- 172.21.15.203:0/2039545907 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fe0c000f050 con 0x7fe0d8074a30 2024-09-19T08:44:09.703 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.702+0000 7fe0d4ff9640 1 --2- 172.21.15.203:0/2039545907 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe0b8039730 0x7fe0b803bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:09.703 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.702+0000 7fe0d4ff9640 1 -- 172.21.15.203:0/2039545907 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fe0c004c130 con 0x7fe0d8074a30 2024-09-19T08:44:09.703 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.702+0000 7fe0dd6c8640 1 -- 172.21.15.203:0/2039545907 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0d810a900 con 0x7fe0d8074a30 2024-09-19T08:44:09.703 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.702+0000 7fe0d6ffd640 1 --2- 172.21.15.203:0/2039545907 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe0b8039730 0x7fe0b803bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:09.704 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.702+0000 7fe0d6ffd640 1 --2- 172.21.15.203:0/2039545907 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe0b8039730 0x7fe0b803bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8005dc0 tx=0x7fe0c8005d10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:09.706 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.707+0000 7fe0d4ff9640 1 -- 172.21.15.203:0/2039545907 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe0c000d040 con 0x7fe0d8074a30 2024-09-19T08:44:09.951 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.951+0000 7fe0dd6c8640 1 -- 172.21.15.203:0/2039545907 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fe0d8106070 con 0x7fe0d8074a30 2024-09-19T08:44:09.951 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:09 smithi203 ceph-mon[35450]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:09.951 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:09 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:44:09.951 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:09 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:44:09.951 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:09 smithi203 ceph-mon[35450]: mon.c calling monitor election 2024-09-19T08:44:09.952 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:09 smithi203 ceph-mon[35450]: mon.a calling monitor election 2024-09-19T08:44:09.952 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:09 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:44:09.952 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:09 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:44:09.952 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:09 smithi203 ceph-mon[35450]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:09.952 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:09 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:44:09.952 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:09 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:44:09.952 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:09 smithi203 ceph-mon[35450]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:09.952 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:09 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:44:09.952 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:09 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:44:09.952 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:09 smithi203 ceph-mon[35450]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T08:44:09.952 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:09 smithi203 ceph-mon[35450]: monmap epoch 3 2024-09-19T08:44:09.953 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:09 smithi203 ceph-mon[35450]: fsid f26c9d84-7662-11ef-bceb-c7b262605968 2024-09-19T08:44:09.953 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:09 smithi203 ceph-mon[35450]: last_changed 2024-09-19T08:44:04.528847+0000 2024-09-19T08:44:09.953 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:09 smithi203 ceph-mon[35450]: created 2024-09-19T08:42:29.207639+0000 2024-09-19T08:44:09.953 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:09 smithi203 ceph-mon[35450]: min_mon_release 19 (squid) 2024-09-19T08:44:09.953 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:09 smithi203 ceph-mon[35450]: election_strategy: 1 2024-09-19T08:44:09.953 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:09 smithi203 ceph-mon[35450]: 0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-19T08:44:09.953 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:09 smithi203 ceph-mon[35450]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.c 2024-09-19T08:44:09.953 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:09 smithi203 ceph-mon[35450]: 2: [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon.b 2024-09-19T08:44:09.953 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:09 smithi203 ceph-mon[35450]: fsmap 2024-09-19T08:44:09.953 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:09 smithi203 ceph-mon[35450]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:44:09.953 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:09 smithi203 ceph-mon[35450]: mgrmap e13: x(active, since 47s) 2024-09-19T08:44:09.953 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:09 smithi203 ceph-mon[35450]: overall HEALTH_OK 2024-09-19T08:44:09.954 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:09 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:09.954 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:09 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:09.954 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:09 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:09.954 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:09 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:09.954 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.952+0000 7fe0d4ff9640 1 -- 172.21.15.203:0/2039545907 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1283 (secure 0 0 0) 0x7fe0c000d540 con 0x7fe0d8074a30 2024-09-19T08:44:09.954 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T08:44:09.955 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":3,"fsid":"f26c9d84-7662-11ef-bceb-c7b262605968","modified":"2024-09-19T08:44:04.528847Z","created":"2024-09-19T08:42:29.207639Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:3300","nonce":0},{"type":"v1","addr":"172.21.15.19:6789","nonce":0}]},"addr":"172.21.15.19:6789/0","public_addr":"172.21.15.19:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:3300","nonce":0},{"type":"v1","addr":"172.21.15.203:6789","nonce":0}]},"addr":"172.21.15.203:6789/0","public_addr":"172.21.15.203:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:3300","nonce":0},{"type":"v1","addr":"172.21.15.155:6789","nonce":0}]},"addr":"172.21.15.155:6789/0","public_addr":"172.21.15.155:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T08:44:09.955 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 3 2024-09-19T08:44:09.955 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.954+0000 7fe0dd6c8640 1 -- 172.21.15.203:0/2039545907 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe0b8039730 msgr2=0x7fe0b803bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:09.956 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.954+0000 7fe0dd6c8640 1 --2- 172.21.15.203:0/2039545907 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe0b8039730 0x7fe0b803bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8005dc0 tx=0x7fe0c8005d10 comp rx=0 tx=0).stop 2024-09-19T08:44:09.956 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.954+0000 7fe0dd6c8640 1 -- 172.21.15.203:0/2039545907 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0d8074a30 msgr2=0x7fe0d8074e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:09.956 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.954+0000 7fe0dd6c8640 1 --2- 172.21.15.203:0/2039545907 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0d8074a30 0x7fe0d8074e90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe0c000b450 tx=0x7fe0c000b910 comp rx=0 tx=0).stop 2024-09-19T08:44:09.956 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.954+0000 7fe0dd6c8640 1 -- 172.21.15.203:0/2039545907 shutdown_connections 2024-09-19T08:44:09.956 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.954+0000 7fe0dd6c8640 1 --2- 172.21.15.203:0/2039545907 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe0b8039730 0x7fe0b803bbf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:09.956 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.954+0000 7fe0dd6c8640 1 --2- 172.21.15.203:0/2039545907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0d81a3530 0x7fe0d81a5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:09.956 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.954+0000 7fe0dd6c8640 1 --2- 172.21.15.203:0/2039545907 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0d8074a30 0x7fe0d8074e90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:09.956 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.954+0000 7fe0dd6c8640 1 --2- 172.21.15.203:0/2039545907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe0c4003530 0x7fe0d80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:09.956 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.954+0000 7fe0dd6c8640 1 -- 172.21.15.203:0/2039545907 >> 172.21.15.203:0/2039545907 conn(0x7fe0d80fd3b0 msgr2=0x7fe0d80ff2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:09.956 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.954+0000 7fe0dd6c8640 1 -- 172.21.15.203:0/2039545907 shutdown_connections 2024-09-19T08:44:09.956 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:09.954+0000 7fe0dd6c8640 1 -- 172.21.15.203:0/2039545907 wait complete. 2024-09-19T08:44:10.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:09 smithi019 ceph-mon[30976]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:10.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:09 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:44:10.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:09 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:44:10.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:09 smithi019 ceph-mon[30976]: mon.c calling monitor election 2024-09-19T08:44:10.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:09 smithi019 ceph-mon[30976]: mon.a calling monitor election 2024-09-19T08:44:10.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:09 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:44:10.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:09 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:44:10.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:09 smithi019 ceph-mon[30976]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:10.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:09 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:44:10.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:09 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:44:10.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:09 smithi019 ceph-mon[30976]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:10.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:09 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:44:10.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:09 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:44:10.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:09 smithi019 ceph-mon[30976]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T08:44:10.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:09 smithi019 ceph-mon[30976]: monmap epoch 3 2024-09-19T08:44:10.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:09 smithi019 ceph-mon[30976]: fsid f26c9d84-7662-11ef-bceb-c7b262605968 2024-09-19T08:44:10.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:09 smithi019 ceph-mon[30976]: last_changed 2024-09-19T08:44:04.528847+0000 2024-09-19T08:44:10.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:09 smithi019 ceph-mon[30976]: created 2024-09-19T08:42:29.207639+0000 2024-09-19T08:44:10.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:09 smithi019 ceph-mon[30976]: min_mon_release 19 (squid) 2024-09-19T08:44:10.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:09 smithi019 ceph-mon[30976]: election_strategy: 1 2024-09-19T08:44:10.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:09 smithi019 ceph-mon[30976]: 0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-19T08:44:10.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:09 smithi019 ceph-mon[30976]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.c 2024-09-19T08:44:10.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:09 smithi019 ceph-mon[30976]: 2: [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon.b 2024-09-19T08:44:10.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:09 smithi019 ceph-mon[30976]: fsmap 2024-09-19T08:44:10.071 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:09 smithi019 ceph-mon[30976]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:44:10.071 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:09 smithi019 ceph-mon[30976]: mgrmap e13: x(active, since 47s) 2024-09-19T08:44:10.071 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:09 smithi019 ceph-mon[30976]: overall HEALTH_OK 2024-09-19T08:44:10.071 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:09 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:10.071 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:09 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:10.071 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:09 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:10.071 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:09 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:10.516 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-19T08:44:10.516 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-19T08:44:10.782 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:10.792 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:10 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:44:10.792 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:10 smithi203 ceph-mon[35450]: from='client.? 172.21.15.203:0/2039545907' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:44:10.792 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:10 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:44:10.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:10 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:44:10.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:10 smithi019 ceph-mon[30976]: from='client.? 172.21.15.203:0/2039545907' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:44:10.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:10 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:44:11.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.246+0000 7f7ce9fcf640 1 -- 172.21.15.19:0/4005520886 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ce4107660 msgr2=0x7f7ce4107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:11.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.246+0000 7f7ce9fcf640 1 --2- 172.21.15.19:0/4005520886 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ce4107660 0x7f7ce4107a40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4009880 tx=0x7f7cd402a5d0 comp rx=0 tx=0).stop 2024-09-19T08:44:11.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.246+0000 7f7ce9fcf640 1 -- 172.21.15.19:0/4005520886 shutdown_connections 2024-09-19T08:44:11.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.246+0000 7f7ce9fcf640 1 --2- 172.21.15.19:0/4005520886 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ce4107660 0x7f7ce4107a40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:11.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.246+0000 7f7ce9fcf640 1 -- 172.21.15.19:0/4005520886 >> 172.21.15.19:0/4005520886 conn(0x7f7ce40fd290 msgr2=0x7f7ce40ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:11.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.246+0000 7f7ce9fcf640 1 -- 172.21.15.19:0/4005520886 shutdown_connections 2024-09-19T08:44:11.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.246+0000 7f7ce9fcf640 1 -- 172.21.15.19:0/4005520886 wait complete. 2024-09-19T08:44:11.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.247+0000 7f7ce9fcf640 1 Processor -- start 2024-09-19T08:44:11.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.247+0000 7f7ce9fcf640 1 -- start start 2024-09-19T08:44:11.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.247+0000 7f7ce9fcf640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ce4107660 0x7f7ce4199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:11.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.247+0000 7f7ce9fcf640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ce4199ab0 0x7f7ce419de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:11.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.247+0000 7f7ce9fcf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ce419e380 0x7f7ce419e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:11.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.247+0000 7f7ce9fcf640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce410bc90 con 0x7f7ce419e380 2024-09-19T08:44:11.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.247+0000 7f7ce9fcf640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce410bb10 con 0x7f7ce4107660 2024-09-19T08:44:11.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.247+0000 7f7ce9fcf640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce410be10 con 0x7f7ce4199ab0 2024-09-19T08:44:11.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.247+0000 7f7ce3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ce419e380 0x7f7ce419e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:11.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.248+0000 7f7ce3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ce419e380 0x7f7ce419e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58722/0 (socket says 172.21.15.19:58722) 2024-09-19T08:44:11.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.248+0000 7f7ce3fff640 1 -- 172.21.15.19:0/1802717700 learned_addr learned my addr 172.21.15.19:0/1802717700 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:44:11.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.248+0000 7f7ce2ffd640 1 --2- 172.21.15.19:0/1802717700 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ce4199ab0 0x7f7ce419de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:11.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.248+0000 7f7ce3fff640 1 -- 172.21.15.19:0/1802717700 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ce4199ab0 msgr2=0x7f7ce419de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:11.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.248+0000 7f7ce3fff640 1 --2- 172.21.15.19:0/1802717700 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ce4199ab0 0x7f7ce419de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:11.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.248+0000 7f7ce3fff640 1 -- 172.21.15.19:0/1802717700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ce4107660 msgr2=0x7f7ce4199570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:11.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.248+0000 7f7ce37fe640 1 --2- 172.21.15.19:0/1802717700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ce4107660 0x7f7ce4199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:11.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.248+0000 7f7ce3fff640 1 --2- 172.21.15.19:0/1802717700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ce4107660 0x7f7ce4199570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:11.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.248+0000 7f7ce3fff640 1 -- 172.21.15.19:0/1802717700 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ce41a60f0 con 0x7f7ce419e380 2024-09-19T08:44:11.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.248+0000 7f7ce2ffd640 1 --2- 172.21.15.19:0/1802717700 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ce4199ab0 0x7f7ce419de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:44:11.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.248+0000 7f7ce37fe640 1 --2- 172.21.15.19:0/1802717700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ce4107660 0x7f7ce4199570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:44:11.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.248+0000 7f7ce3fff640 1 --2- 172.21.15.19:0/1802717700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ce419e380 0x7f7ce419e830 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc00ba50 tx=0x7f7cdc00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:11.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.248+0000 7f7ce0ff9640 1 -- 172.21.15.19:0/1802717700 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cdc019070 con 0x7f7ce419e380 2024-09-19T08:44:11.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.248+0000 7f7ce0ff9640 1 -- 172.21.15.19:0/1802717700 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7cdc00cbe0 con 0x7f7ce419e380 2024-09-19T08:44:11.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.248+0000 7f7ce0ff9640 1 -- 172.21.15.19:0/1802717700 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cdc0076a0 con 0x7f7ce419e380 2024-09-19T08:44:11.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.248+0000 7f7ce9fcf640 1 -- 172.21.15.19:0/1802717700 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ce41a6320 con 0x7f7ce419e380 2024-09-19T08:44:11.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.248+0000 7f7ce9fcf640 1 -- 172.21.15.19:0/1802717700 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ce41a68b0 con 0x7f7ce419e380 2024-09-19T08:44:11.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.249+0000 7f7ce0ff9640 1 -- 172.21.15.19:0/1802717700 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f7cdc01c070 con 0x7f7ce419e380 2024-09-19T08:44:11.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.249+0000 7f7ce0ff9640 1 --2- 172.21.15.19:0/1802717700 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7ccc039730 0x7f7ccc03bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:11.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.249+0000 7f7ce0ff9640 1 -- 172.21.15.19:0/1802717700 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f7cdc04bcd0 con 0x7f7ce419e380 2024-09-19T08:44:11.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.249+0000 7f7ce37fe640 1 --2- 172.21.15.19:0/1802717700 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7ccc039730 0x7f7ccc03bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:11.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.249+0000 7f7ce9fcf640 1 -- 172.21.15.19:0/1802717700 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ce4107ac0 con 0x7f7ce419e380 2024-09-19T08:44:11.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.250+0000 7f7ce37fe640 1 --2- 172.21.15.19:0/1802717700 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7ccc039730 0x7f7ccc03bbf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4005ab0 tx=0x7f7cd4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:11.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.254+0000 7f7ce0ff9640 1 -- 172.21.15.19:0/1802717700 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7cdc01ce40 con 0x7f7ce419e380 2024-09-19T08:44:11.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.434+0000 7f7ce9fcf640 1 -- 172.21.15.19:0/1802717700 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f7ce41a6b40 con 0x7f7ce419e380 2024-09-19T08:44:11.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.435+0000 7f7ce0ff9640 1 -- 172.21.15.19:0/1802717700 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7f7cdc012e50 con 0x7f7ce419e380 2024-09-19T08:44:11.436 INFO:teuthology.orchestra.run.smithi019.stdout:# minimal ceph.conf for f26c9d84-7662-11ef-bceb-c7b262605968 2024-09-19T08:44:11.436 INFO:teuthology.orchestra.run.smithi019.stdout:[global] 2024-09-19T08:44:11.436 INFO:teuthology.orchestra.run.smithi019.stdout: fsid = f26c9d84-7662-11ef-bceb-c7b262605968 2024-09-19T08:44:11.436 INFO:teuthology.orchestra.run.smithi019.stdout: mon_host = [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-09-19T08:44:11.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.437+0000 7f7ce9fcf640 1 -- 172.21.15.19:0/1802717700 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7ccc039730 msgr2=0x7f7ccc03bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:11.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.437+0000 7f7ce9fcf640 1 --2- 172.21.15.19:0/1802717700 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7ccc039730 0x7f7ccc03bbf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4005ab0 tx=0x7f7cd4005a20 comp rx=0 tx=0).stop 2024-09-19T08:44:11.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.437+0000 7f7ce9fcf640 1 -- 172.21.15.19:0/1802717700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ce419e380 msgr2=0x7f7ce419e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:11.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.437+0000 7f7ce9fcf640 1 --2- 172.21.15.19:0/1802717700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ce419e380 0x7f7ce419e830 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc00ba50 tx=0x7f7cdc00bf10 comp rx=0 tx=0).stop 2024-09-19T08:44:11.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.438+0000 7f7ce9fcf640 1 -- 172.21.15.19:0/1802717700 shutdown_connections 2024-09-19T08:44:11.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.438+0000 7f7ce9fcf640 1 --2- 172.21.15.19:0/1802717700 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7ccc039730 0x7f7ccc03bbf0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:11.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.438+0000 7f7ce9fcf640 1 --2- 172.21.15.19:0/1802717700 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ce4199ab0 0x7f7ce419de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:11.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.438+0000 7f7ce9fcf640 1 --2- 172.21.15.19:0/1802717700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ce419e380 0x7f7ce419e830 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:11.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.438+0000 7f7ce9fcf640 1 --2- 172.21.15.19:0/1802717700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ce4107660 0x7f7ce4199570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:11.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.438+0000 7f7ce9fcf640 1 -- 172.21.15.19:0/1802717700 >> 172.21.15.19:0/1802717700 conn(0x7f7ce40fd290 msgr2=0x7f7ce4074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:11.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.438+0000 7f7ce9fcf640 1 -- 172.21.15.19:0/1802717700 shutdown_connections 2024-09-19T08:44:11.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:11.438+0000 7f7ce9fcf640 1 -- 172.21.15.19:0/1802717700 wait complete. 2024-09-19T08:44:11.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:11 smithi155 ceph-mon[34921]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:11.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:11 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:44:11.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:11 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:44:11.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:11 smithi155 ceph-mon[34921]: mon.c calling monitor election 2024-09-19T08:44:11.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:11 smithi155 ceph-mon[34921]: mon.a calling monitor election 2024-09-19T08:44:11.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:11 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:44:11.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:11 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:44:11.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:11 smithi155 ceph-mon[34921]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:11.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:11 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:44:11.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:11 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:44:11.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:11 smithi155 ceph-mon[34921]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:11.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:11 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:44:11.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:11 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:44:11.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:11 smithi155 ceph-mon[34921]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T08:44:11.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:11 smithi155 ceph-mon[34921]: monmap epoch 3 2024-09-19T08:44:11.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:11 smithi155 ceph-mon[34921]: fsid f26c9d84-7662-11ef-bceb-c7b262605968 2024-09-19T08:44:11.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:11 smithi155 ceph-mon[34921]: last_changed 2024-09-19T08:44:04.528847+0000 2024-09-19T08:44:11.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:11 smithi155 ceph-mon[34921]: created 2024-09-19T08:42:29.207639+0000 2024-09-19T08:44:11.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:11 smithi155 ceph-mon[34921]: min_mon_release 19 (squid) 2024-09-19T08:44:11.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:11 smithi155 ceph-mon[34921]: election_strategy: 1 2024-09-19T08:44:11.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:11 smithi155 ceph-mon[34921]: 0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-19T08:44:11.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:11 smithi155 ceph-mon[34921]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.c 2024-09-19T08:44:11.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:11 smithi155 ceph-mon[34921]: 2: [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon.b 2024-09-19T08:44:11.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:11 smithi155 ceph-mon[34921]: fsmap 2024-09-19T08:44:11.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:11 smithi155 ceph-mon[34921]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:44:11.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:11 smithi155 ceph-mon[34921]: mgrmap e13: x(active, since 47s) 2024-09-19T08:44:11.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:11 smithi155 ceph-mon[34921]: overall HEALTH_OK 2024-09-19T08:44:11.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:11 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:11.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:11 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:11.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:11 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:11.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:11 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:11.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:11 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:44:11.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:11 smithi155 ceph-mon[34921]: from='client.? 172.21.15.203:0/2039545907' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T08:44:11.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:11 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:44:12.255 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-19T08:44:12.256 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-19T08:44:12.256 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T08:44:12.285 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-19T08:44:12.285 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:44:12.352 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-19T08:44:12.352 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T08:44:12.376 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: mon.b calling monitor election 2024-09-19T08:44:12.376 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: Updating smithi019:/etc/ceph/ceph.conf 2024-09-19T08:44:12.376 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: Updating smithi155:/etc/ceph/ceph.conf 2024-09-19T08:44:12.376 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: Updating smithi203:/etc/ceph/ceph.conf 2024-09-19T08:44:12.376 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: Updating smithi203:/var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:44:12.376 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: Updating smithi019:/var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:44:12.377 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: Updating smithi155:/var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:44:12.377 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: mon.b calling monitor election 2024-09-19T08:44:12.377 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: mon.c calling monitor election 2024-09-19T08:44:12.381 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: mon.a calling monitor election 2024-09-19T08:44:12.381 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T08:44:12.381 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: monmap epoch 3 2024-09-19T08:44:12.381 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: fsid f26c9d84-7662-11ef-bceb-c7b262605968 2024-09-19T08:44:12.381 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: last_changed 2024-09-19T08:44:04.528847+0000 2024-09-19T08:44:12.381 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: created 2024-09-19T08:42:29.207639+0000 2024-09-19T08:44:12.381 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: min_mon_release 19 (squid) 2024-09-19T08:44:12.381 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: election_strategy: 1 2024-09-19T08:44:12.381 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: 0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-19T08:44:12.381 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.c 2024-09-19T08:44:12.381 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: 2: [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon.b 2024-09-19T08:44:12.381 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: fsmap 2024-09-19T08:44:12.381 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:44:12.382 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: mgrmap e13: x(active, since 49s) 2024-09-19T08:44:12.382 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: overall HEALTH_OK 2024-09-19T08:44:12.382 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:12.382 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:12.382 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:12.382 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:12.382 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:12.382 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:12.382 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:12.382 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:12.382 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:12.382 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:12.382 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:12.382 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:12.382 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:44:12.383 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:44:12.383 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:12 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:12.384 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-19T08:44:12.384 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:44:12.450 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-19T08:44:12.450 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T08:44:12.477 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-19T08:44:12.477 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T08:44:12.496 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: mon.b calling monitor election 2024-09-19T08:44:12.496 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: Updating smithi019:/etc/ceph/ceph.conf 2024-09-19T08:44:12.496 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: Updating smithi155:/etc/ceph/ceph.conf 2024-09-19T08:44:12.496 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: Updating smithi203:/etc/ceph/ceph.conf 2024-09-19T08:44:12.496 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: Updating smithi203:/var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:44:12.497 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: Updating smithi019:/var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:44:12.497 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: Updating smithi155:/var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:44:12.497 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: mon.b calling monitor election 2024-09-19T08:44:12.497 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: mon.c calling monitor election 2024-09-19T08:44:12.497 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: mon.a calling monitor election 2024-09-19T08:44:12.497 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T08:44:12.497 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: monmap epoch 3 2024-09-19T08:44:12.497 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: fsid f26c9d84-7662-11ef-bceb-c7b262605968 2024-09-19T08:44:12.497 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: last_changed 2024-09-19T08:44:04.528847+0000 2024-09-19T08:44:12.497 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: created 2024-09-19T08:42:29.207639+0000 2024-09-19T08:44:12.497 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: min_mon_release 19 (squid) 2024-09-19T08:44:12.497 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: election_strategy: 1 2024-09-19T08:44:12.497 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: 0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-19T08:44:12.497 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.c 2024-09-19T08:44:12.498 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: 2: [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon.b 2024-09-19T08:44:12.498 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: fsmap 2024-09-19T08:44:12.498 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:44:12.498 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: mgrmap e13: x(active, since 49s) 2024-09-19T08:44:12.498 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: overall HEALTH_OK 2024-09-19T08:44:12.498 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:12.498 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:12.498 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:12.498 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:12.498 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:12.498 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:12.498 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:12.498 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:12.498 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:12.499 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:12.499 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:12.499 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:12.499 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:44:12.499 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:44:12.499 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:12 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:12.539 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: mon.b calling monitor election 2024-09-19T08:44:12.540 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: Updating smithi019:/etc/ceph/ceph.conf 2024-09-19T08:44:12.540 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: Updating smithi155:/etc/ceph/ceph.conf 2024-09-19T08:44:12.540 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: Updating smithi203:/etc/ceph/ceph.conf 2024-09-19T08:44:12.540 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: Updating smithi203:/var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:44:12.540 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: Updating smithi019:/var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:44:12.540 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: Updating smithi155:/var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T08:44:12.540 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: mon.b calling monitor election 2024-09-19T08:44:12.540 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: mon.c calling monitor election 2024-09-19T08:44:12.540 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: mon.a calling monitor election 2024-09-19T08:44:12.540 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T08:44:12.540 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: monmap epoch 3 2024-09-19T08:44:12.540 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: fsid f26c9d84-7662-11ef-bceb-c7b262605968 2024-09-19T08:44:12.541 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: last_changed 2024-09-19T08:44:04.528847+0000 2024-09-19T08:44:12.541 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: created 2024-09-19T08:42:29.207639+0000 2024-09-19T08:44:12.541 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: min_mon_release 19 (squid) 2024-09-19T08:44:12.541 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: election_strategy: 1 2024-09-19T08:44:12.541 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: 0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-19T08:44:12.541 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.c 2024-09-19T08:44:12.541 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: 2: [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] mon.b 2024-09-19T08:44:12.541 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: fsmap 2024-09-19T08:44:12.541 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T08:44:12.541 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: mgrmap e13: x(active, since 49s) 2024-09-19T08:44:12.541 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: overall HEALTH_OK 2024-09-19T08:44:12.541 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:12.541 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:12.541 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:12.542 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:12.542 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:12.542 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:12.542 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:12.542 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:12.542 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:12.542 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:12.542 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:12.542 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:12.542 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:44:12.542 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:44:12.542 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:12 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:12.543 INFO:tasks.cephadm:Adding mgr.x on smithi019 2024-09-19T08:44:12.544 INFO:tasks.cephadm:Adding mgr.y on smithi155 2024-09-19T08:44:12.544 INFO:tasks.cephadm:Adding mgr.z on smithi203 2024-09-19T08:44:12.544 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi019=x;smithi155=y;smithi203=z' 2024-09-19T08:44:12.826 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:44:13.250 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.245+0000 7fc4e1b18640 1 -- 172.21.15.203:0/2030297774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4dc102180 msgr2=0x7fc4dc104570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:13.250 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.245+0000 7fc4e1b18640 1 --2- 172.21.15.203:0/2030297774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4dc102180 0x7fc4dc104570 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc009880 tx=0x7fc4cc02a5d0 comp rx=0 tx=0).stop 2024-09-19T08:44:13.251 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.245+0000 7fc4e1b18640 1 -- 172.21.15.203:0/2030297774 shutdown_connections 2024-09-19T08:44:13.251 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.245+0000 7fc4e1b18640 1 --2- 172.21.15.203:0/2030297774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4dc102180 0x7fc4dc104570 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:13.251 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.245+0000 7fc4e1b18640 1 -- 172.21.15.203:0/2030297774 >> 172.21.15.203:0/2030297774 conn(0x7fc4dc0fbda0 msgr2=0x7fc4dc0fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:13.251 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.246+0000 7fc4e1b18640 1 -- 172.21.15.203:0/2030297774 shutdown_connections 2024-09-19T08:44:13.251 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.246+0000 7fc4e1b18640 1 -- 172.21.15.203:0/2030297774 wait complete. 2024-09-19T08:44:13.251 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.246+0000 7fc4e1b18640 1 Processor -- start 2024-09-19T08:44:13.251 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.246+0000 7fc4e1b18640 1 -- start start 2024-09-19T08:44:13.251 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.246+0000 7fc4e1b18640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4dc102180 0x7fc4dc196f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:13.251 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.246+0000 7fc4e1b18640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4dc197460 0x7fc4dc19c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:13.251 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.246+0000 7fc4e1b18640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4dc1978e0 0x7fc4dc19ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:13.251 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.246+0000 7fc4e1b18640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc4dc107740 con 0x7fc4dc1978e0 2024-09-19T08:44:13.251 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.246+0000 7fc4e1b18640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc4dc1075c0 con 0x7fc4dc197460 2024-09-19T08:44:13.251 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.246+0000 7fc4e1b18640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc4dc1078c0 con 0x7fc4dc102180 2024-09-19T08:44:13.252 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.247+0000 7fc4db7fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4dc102180 0x7fc4dc196f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:13.252 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.247+0000 7fc4db7fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4dc102180 0x7fc4dc196f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:57968/0 (socket says 172.21.15.203:57968) 2024-09-19T08:44:13.252 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.247+0000 7fc4db7fe640 1 -- 172.21.15.203:0/780546340 learned_addr learned my addr 172.21.15.203:0/780546340 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-19T08:44:13.252 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.247+0000 7fc4dbfff640 1 --2- 172.21.15.203:0/780546340 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4dc1978e0 0x7fc4dc19ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:13.252 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.247+0000 7fc4daffd640 1 --2- 172.21.15.203:0/780546340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4dc197460 0x7fc4dc19c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:13.252 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.247+0000 7fc4dbfff640 1 -- 172.21.15.203:0/780546340 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4dc102180 msgr2=0x7fc4dc196f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:13.252 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.247+0000 7fc4dbfff640 1 --2- 172.21.15.203:0/780546340 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4dc102180 0x7fc4dc196f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:13.252 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.247+0000 7fc4dbfff640 1 -- 172.21.15.203:0/780546340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4dc197460 msgr2=0x7fc4dc19c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:13.252 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.247+0000 7fc4dbfff640 1 --2- 172.21.15.203:0/780546340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4dc197460 0x7fc4dc19c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:13.252 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.247+0000 7fc4dbfff640 1 -- 172.21.15.203:0/780546340 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4dc19f320 con 0x7fc4dc1978e0 2024-09-19T08:44:13.252 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.247+0000 7fc4daffd640 1 --2- 172.21.15.203:0/780546340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4dc197460 0x7fc4dc19c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:44:13.252 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.247+0000 7fc4db7fe640 1 --2- 172.21.15.203:0/780546340 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4dc102180 0x7fc4dc196f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:44:13.252 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.247+0000 7fc4dbfff640 1 --2- 172.21.15.203:0/780546340 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4dc1978e0 0x7fc4dc19ea60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc4d400bd50 tx=0x7fc4d400be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:13.253 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.247+0000 7fc4d8ff9640 1 -- 172.21.15.203:0/780546340 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d4019070 con 0x7fc4dc1978e0 2024-09-19T08:44:13.253 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.247+0000 7fc4d8ff9640 1 -- 172.21.15.203:0/780546340 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4d4014920 con 0x7fc4dc1978e0 2024-09-19T08:44:13.253 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.247+0000 7fc4e1b18640 1 -- 172.21.15.203:0/780546340 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4dc19f610 con 0x7fc4dc1978e0 2024-09-19T08:44:13.253 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.247+0000 7fc4d8ff9640 1 -- 172.21.15.203:0/780546340 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4d4012990 con 0x7fc4dc1978e0 2024-09-19T08:44:13.253 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.247+0000 7fc4e1b18640 1 -- 172.21.15.203:0/780546340 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4dc19fb80 con 0x7fc4dc1978e0 2024-09-19T08:44:13.253 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.248+0000 7fc4d8ff9640 1 -- 172.21.15.203:0/780546340 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fc4d401c070 con 0x7fc4dc1978e0 2024-09-19T08:44:13.253 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.248+0000 7fc4e1b18640 1 -- 172.21.15.203:0/780546340 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4dc190500 con 0x7fc4dc1978e0 2024-09-19T08:44:13.253 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.249+0000 7fc4d8ff9640 1 --2- 172.21.15.203:0/780546340 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc4c4039730 0x7fc4c403bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:13.253 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.249+0000 7fc4d8ff9640 1 -- 172.21.15.203:0/780546340 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc4d404c090 con 0x7fc4dc1978e0 2024-09-19T08:44:13.253 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.249+0000 7fc4db7fe640 1 --2- 172.21.15.203:0/780546340 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc4c4039730 0x7fc4c403bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:13.253 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.249+0000 7fc4db7fe640 1 --2- 172.21.15.203:0/780546340 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc4c4039730 0x7fc4c403bbf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc02abc0 tx=0x7fc4cc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:13.254 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.254+0000 7fc4d8ff9640 1 -- 172.21.15.203:0/780546340 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc4d4012bb0 con 0x7fc4dc1978e0 2024-09-19T08:44:13.431 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.431+0000 7fc4e1b18640 1 -- 172.21.15.203:0/780546340 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi019=x;smithi155=y;smithi203=z", "target": ["mon-mgr", ""]}) -- 0x7fc4dc0626c0 con 0x7fc4c4039730 2024-09-19T08:44:13.435 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.436+0000 7fc4d8ff9640 1 -- 172.21.15.203:0/780546340 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fc4dc0626c0 con 0x7fc4c4039730 2024-09-19T08:44:13.435 INFO:teuthology.orchestra.run.smithi203.stdout:Scheduled mgr update... 2024-09-19T08:44:13.438 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.438+0000 7fc4e1b18640 1 -- 172.21.15.203:0/780546340 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc4c4039730 msgr2=0x7fc4c403bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:13.438 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.438+0000 7fc4e1b18640 1 --2- 172.21.15.203:0/780546340 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc4c4039730 0x7fc4c403bbf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc02abc0 tx=0x7fc4cc0058d0 comp rx=0 tx=0).stop 2024-09-19T08:44:13.438 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.438+0000 7fc4e1b18640 1 -- 172.21.15.203:0/780546340 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4dc1978e0 msgr2=0x7fc4dc19ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:13.438 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.438+0000 7fc4e1b18640 1 --2- 172.21.15.203:0/780546340 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4dc1978e0 0x7fc4dc19ea60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc4d400bd50 tx=0x7fc4d400be40 comp rx=0 tx=0).stop 2024-09-19T08:44:13.438 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.438+0000 7fc4e1b18640 1 -- 172.21.15.203:0/780546340 shutdown_connections 2024-09-19T08:44:13.438 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.438+0000 7fc4e1b18640 1 --2- 172.21.15.203:0/780546340 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc4c4039730 0x7fc4c403bbf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:13.439 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.438+0000 7fc4e1b18640 1 --2- 172.21.15.203:0/780546340 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4dc1978e0 0x7fc4dc19ea60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:13.439 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.438+0000 7fc4e1b18640 1 --2- 172.21.15.203:0/780546340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4dc197460 0x7fc4dc19c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:13.439 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.438+0000 7fc4e1b18640 1 --2- 172.21.15.203:0/780546340 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4dc102180 0x7fc4dc196f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:13.439 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.438+0000 7fc4e1b18640 1 -- 172.21.15.203:0/780546340 >> 172.21.15.203:0/780546340 conn(0x7fc4dc0fbda0 msgr2=0x7fc4dc0fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:13.439 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.438+0000 7fc4e1b18640 1 -- 172.21.15.203:0/780546340 shutdown_connections 2024-09-19T08:44:13.439 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:44:13.438+0000 7fc4e1b18640 1 -- 172.21.15.203:0/780546340 wait complete. 2024-09-19T08:44:13.529 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:13 smithi019 ceph-mon[30976]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:13.530 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:13 smithi019 ceph-mon[30976]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T08:44:13.530 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:13 smithi019 ceph-mon[30976]: Reconfiguring daemon mon.a on smithi019 2024-09-19T08:44:13.530 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:13 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:44:13.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:13 smithi155 ceph-mon[34921]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:13.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:13 smithi155 ceph-mon[34921]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T08:44:13.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:13 smithi155 ceph-mon[34921]: Reconfiguring daemon mon.a on smithi019 2024-09-19T08:44:13.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:13 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:44:13.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:13 smithi203 ceph-mon[35450]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:13.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:13 smithi203 ceph-mon[35450]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T08:44:13.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:13 smithi203 ceph-mon[35450]: Reconfiguring daemon mon.a on smithi019 2024-09-19T08:44:13.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:13 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:44:13.818 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:44:13 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:44:13.528+0000 7f9b3796b640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-19T08:44:14.029 DEBUG:teuthology.orchestra.run.smithi155:mgr.y> sudo journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mgr.y.service 2024-09-19T08:44:14.031 DEBUG:teuthology.orchestra.run.smithi203:mgr.z> sudo journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mgr.z.service 2024-09-19T08:44:14.034 INFO:tasks.cephadm:Deploying OSDs... 2024-09-19T08:44:14.034 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-19T08:44:14.034 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T08:44:14.054 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T08:44:14.054 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_1 2024-09-19T08:44:14.113 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T08:44:14.113 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:44:14.113 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-19T08:44:14.113 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:44:14.113 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:44:14.113 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-09-19 08:43:32.890027466 +0000 2024-09-19T08:44:14.113 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-09-19 08:39:01.321816980 +0000 2024-09-19T08:44:14.113 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-09-19 08:39:01.321816980 +0000 2024-09-19T08:44:14.113 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-09-19 08:39:01.321816980 +0000 2024-09-19T08:44:14.114 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T08:44:14.182 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-09-19T08:44:14.182 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-09-19T08:44:14.182 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000216082 s, 2.4 MB/s 2024-09-19T08:44:14.183 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T08:44:14.242 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_2 2024-09-19T08:44:14.299 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T08:44:14.299 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:44:14.299 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-19T08:44:14.299 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:44:14.299 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:44:14.300 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-09-19 08:43:32.922027211 +0000 2024-09-19T08:44:14.300 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-09-19 08:39:01.699813928 +0000 2024-09-19T08:44:14.300 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-09-19 08:39:01.699813928 +0000 2024-09-19T08:44:14.300 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-09-19 08:39:01.699813928 +0000 2024-09-19T08:44:14.300 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T08:44:14.366 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-09-19T08:44:14.366 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-09-19T08:44:14.366 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000198339 s, 2.6 MB/s 2024-09-19T08:44:14.367 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T08:44:14.425 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_3 2024-09-19T08:44:14.483 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T08:44:14.483 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:44:14.483 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-19T08:44:14.483 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:44:14.483 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:44:14.483 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-09-19 08:43:32.952026972 +0000 2024-09-19T08:44:14.484 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-09-19 08:39:02.018811352 +0000 2024-09-19T08:44:14.484 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-09-19 08:39:02.018811352 +0000 2024-09-19T08:44:14.484 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-09-19 08:39:02.018811352 +0000 2024-09-19T08:44:14.484 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T08:44:14.546 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:14 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:14.546 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:14 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:14.546 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:14 smithi019 ceph-mon[30976]: Reconfiguring mon.b (monmap changed)... 2024-09-19T08:44:14.546 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:14 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:44:14.546 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:14 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:44:14.546 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:14 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:14.547 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:14 smithi019 ceph-mon[30976]: Reconfiguring daemon mon.b on smithi155 2024-09-19T08:44:14.547 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:14 smithi019 ceph-mon[30976]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi019=x;smithi155=y;smithi203=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:14.547 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:14 smithi019 ceph-mon[30976]: Saving service mgr spec with placement smithi019=x;smithi155=y;smithi203=z;count:3 2024-09-19T08:44:14.547 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:14 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:14.549 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-09-19T08:44:14.549 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-09-19T08:44:14.549 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000186988 s, 2.7 MB/s 2024-09-19T08:44:14.550 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T08:44:14.607 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_4 2024-09-19T08:44:14.664 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T08:44:14.664 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:44:14.665 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-19T08:44:14.665 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:44:14.665 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:44:14.665 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-09-19 08:43:32.982026733 +0000 2024-09-19T08:44:14.665 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-09-19 08:39:02.343808727 +0000 2024-09-19T08:44:14.665 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-09-19 08:39:02.343808727 +0000 2024-09-19T08:44:14.665 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-09-19 08:39:02.343808727 +0000 2024-09-19T08:44:14.665 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T08:44:14.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:14 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:14.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:14 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:14.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:14 smithi155 ceph-mon[34921]: Reconfiguring mon.b (monmap changed)... 2024-09-19T08:44:14.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:14 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:44:14.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:14 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:44:14.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:14 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:14.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:14 smithi155 ceph-mon[34921]: Reconfiguring daemon mon.b on smithi155 2024-09-19T08:44:14.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:14 smithi155 ceph-mon[34921]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi019=x;smithi155=y;smithi203=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:14.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:14 smithi155 ceph-mon[34921]: Saving service mgr spec with placement smithi019=x;smithi155=y;smithi203=z;count:3 2024-09-19T08:44:14.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:14 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:14.729 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-09-19T08:44:14.729 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-09-19T08:44:14.729 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000185351 s, 2.8 MB/s 2024-09-19T08:44:14.730 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T08:44:14.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:14 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:14.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:14 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:14.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:14 smithi203 ceph-mon[35450]: Reconfiguring mon.b (monmap changed)... 2024-09-19T08:44:14.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:14 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:44:14.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:14 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:44:14.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:14 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:14.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:14 smithi203 ceph-mon[35450]: Reconfiguring daemon mon.b on smithi155 2024-09-19T08:44:14.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:14 smithi203 ceph-mon[35450]: from='client.14211 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi019=x;smithi155=y;smithi203=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:14.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:14 smithi203 ceph-mon[35450]: Saving service mgr spec with placement smithi019=x;smithi155=y;smithi203=z;count:3 2024-09-19T08:44:14.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:14 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:14.788 DEBUG:teuthology.orchestra.run.smithi155:> set -ex 2024-09-19T08:44:14.788 DEBUG:teuthology.orchestra.run.smithi155:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T08:44:14.805 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T08:44:14.805 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_1 2024-09-19T08:44:14.861 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T08:44:14.862 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:44:14.862 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-19T08:44:14.862 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:44:14.862 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:44:14.862 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-09-19 08:44:03.942113082 +0000 2024-09-19T08:44:14.862 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-09-19 08:39:04.827937265 +0000 2024-09-19T08:44:14.862 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-09-19 08:39:04.827937265 +0000 2024-09-19T08:44:14.862 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2024-09-19 08:39:04.827937265 +0000 2024-09-19T08:44:14.862 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T08:44:14.926 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-09-19T08:44:14.926 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-09-19T08:44:14.926 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000272096 s, 1.9 MB/s 2024-09-19T08:44:14.927 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T08:44:14.984 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_2 2024-09-19T08:44:15.041 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T08:44:15.042 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:44:15.042 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-19T08:44:15.042 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:44:15.042 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:44:15.042 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-09-19 08:44:03.942113082 +0000 2024-09-19T08:44:15.042 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-09-19 08:39:05.155930291 +0000 2024-09-19T08:44:15.042 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-09-19 08:39:05.155930291 +0000 2024-09-19T08:44:15.042 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2024-09-19 08:39:05.155930291 +0000 2024-09-19T08:44:15.043 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T08:44:15.105 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-09-19T08:44:15.106 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-09-19T08:44:15.106 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000205882 s, 2.5 MB/s 2024-09-19T08:44:15.107 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T08:44:15.163 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_3 2024-09-19T08:44:15.219 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T08:44:15.219 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:44:15.219 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-19T08:44:15.219 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:44:15.219 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:44:15.219 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-09-19 08:44:03.943113061 +0000 2024-09-19T08:44:15.220 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-09-19 08:39:05.504922870 +0000 2024-09-19T08:44:15.220 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-09-19 08:39:05.504922870 +0000 2024-09-19T08:44:15.220 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2024-09-19 08:39:05.504922870 +0000 2024-09-19T08:44:15.220 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T08:44:15.283 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-09-19T08:44:15.283 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-09-19T08:44:15.283 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.000218787 s, 2.3 MB/s 2024-09-19T08:44:15.284 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T08:44:15.341 DEBUG:teuthology.orchestra.run.smithi155:> stat /dev/vg_nvme/lv_4 2024-09-19T08:44:15.397 INFO:teuthology.orchestra.run.smithi155.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T08:44:15.397 INFO:teuthology.orchestra.run.smithi155.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:44:15.397 INFO:teuthology.orchestra.run.smithi155.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-19T08:44:15.397 INFO:teuthology.orchestra.run.smithi155.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:44:15.397 INFO:teuthology.orchestra.run.smithi155.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:44:15.397 INFO:teuthology.orchestra.run.smithi155.stdout:Access: 2024-09-19 08:44:03.943113061 +0000 2024-09-19T08:44:15.397 INFO:teuthology.orchestra.run.smithi155.stdout:Modify: 2024-09-19 08:39:05.831915917 +0000 2024-09-19T08:44:15.397 INFO:teuthology.orchestra.run.smithi155.stdout:Change: 2024-09-19 08:39:05.831915917 +0000 2024-09-19T08:44:15.397 INFO:teuthology.orchestra.run.smithi155.stdout: Birth: 2024-09-19 08:39:05.831915917 +0000 2024-09-19T08:44:15.398 DEBUG:teuthology.orchestra.run.smithi155:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T08:44:15.460 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records in 2024-09-19T08:44:15.461 INFO:teuthology.orchestra.run.smithi155.stderr:1+0 records out 2024-09-19T08:44:15.461 INFO:teuthology.orchestra.run.smithi155.stderr:512 bytes copied, 0.0002543 s, 2.0 MB/s 2024-09-19T08:44:15.462 DEBUG:teuthology.orchestra.run.smithi155:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T08:44:15.518 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-09-19T08:44:15.518 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T08:44:15.535 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T08:44:15.535 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_1 2024-09-19T08:44:15.591 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T08:44:15.591 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:44:15.591 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-19T08:44:15.591 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:44:15.591 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:44:15.591 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-09-19 08:43:54.940815713 +0000 2024-09-19T08:44:15.591 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-09-19 08:39:08.064043097 +0000 2024-09-19T08:44:15.591 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-09-19 08:39:08.064043097 +0000 2024-09-19T08:44:15.591 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-09-19 08:39:08.064043097 +0000 2024-09-19T08:44:15.592 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T08:44:15.657 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:15 smithi203 ceph-mon[35450]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:15.657 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:15 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:15.657 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:15 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:15.657 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:15 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:44:15.658 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:15 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:44:15.658 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:15 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:15.658 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-09-19T08:44:15.659 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-09-19T08:44:15.659 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000218778 s, 2.3 MB/s 2024-09-19T08:44:15.659 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T08:44:15.716 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_2 2024-09-19T08:44:15.771 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T08:44:15.772 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:44:15.772 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 5h/5d Inode: 682 Links: 1 2024-09-19T08:44:15.772 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:44:15.772 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:44:15.772 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-09-19 08:43:54.941815688 +0000 2024-09-19T08:44:15.772 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-09-19 08:39:08.386034868 +0000 2024-09-19T08:44:15.772 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-09-19 08:39:08.386034868 +0000 2024-09-19T08:44:15.772 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-09-19 08:39:08.386034868 +0000 2024-09-19T08:44:15.772 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T08:44:15.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:15 smithi019 ceph-mon[30976]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:15.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:15 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:15.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:15 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:15.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:15 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:44:15.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:15 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:44:15.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:15 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:15.835 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-09-19T08:44:15.835 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-09-19T08:44:15.836 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000214167 s, 2.4 MB/s 2024-09-19T08:44:15.837 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T08:44:15.893 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_3 2024-09-19T08:44:15.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:15 smithi155 ceph-mon[34921]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:15.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:15 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:15.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:15 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:15.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:15 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T08:44:15.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:15 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T08:44:15.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:15 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:15.948 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T08:44:15.948 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:44:15.949 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-19T08:44:15.949 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:44:15.949 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:44:15.949 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-09-19 08:43:54.941815688 +0000 2024-09-19T08:44:15.949 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-09-19 08:39:08.738025873 +0000 2024-09-19T08:44:15.949 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-09-19 08:39:08.738025873 +0000 2024-09-19T08:44:15.949 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-09-19 08:39:08.738025873 +0000 2024-09-19T08:44:15.949 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T08:44:16.012 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-09-19T08:44:16.012 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-09-19T08:44:16.012 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000213189 s, 2.4 MB/s 2024-09-19T08:44:16.013 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T08:44:16.072 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_4 2024-09-19T08:44:16.128 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T08:44:16.128 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T08:44:16.128 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-19T08:44:16.129 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:44:16.129 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T08:44:16.129 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-09-19 08:43:54.941815688 +0000 2024-09-19T08:44:16.129 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-09-19 08:39:09.060017644 +0000 2024-09-19T08:44:16.129 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-09-19 08:39:09.060017644 +0000 2024-09-19T08:44:16.129 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-09-19 08:39:09.060017644 +0000 2024-09-19T08:44:16.129 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T08:44:16.193 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-09-19T08:44:16.193 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-09-19T08:44:16.194 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000209843 s, 2.4 MB/s 2024-09-19T08:44:16.195 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T08:44:16.251 INFO:tasks.cephadm:Deploying osd.0 on smithi019 with /dev/vg_nvme/lv_4... 2024-09-19T08:44:16.252 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T08:44:16.510 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:16.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:16 smithi019 ceph-mon[30976]: Reconfiguring mon.c (monmap changed)... 2024-09-19T08:44:16.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:16 smithi019 ceph-mon[30976]: Reconfiguring daemon mon.c on smithi203 2024-09-19T08:44:16.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:16 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:16.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:16 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:16.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:16 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:44:16.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:16 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:16.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:16 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:44:16.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:16 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:16.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:16 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:44:16.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:16 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:44:16.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:16 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:44:16.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:16 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:16.719 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:16 smithi203 ceph-mon[35450]: Reconfiguring mon.c (monmap changed)... 2024-09-19T08:44:16.720 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:16 smithi203 ceph-mon[35450]: Reconfiguring daemon mon.c on smithi203 2024-09-19T08:44:16.720 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:16 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:16.720 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:16 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:16.720 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:16 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:44:16.720 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:16 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:16.720 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:16 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:44:16.720 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:16 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:16.720 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:16 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:44:16.720 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:16 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:44:16.720 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:16 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:44:16.720 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:16 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:16.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:16 smithi155 ceph-mon[34921]: Reconfiguring mon.c (monmap changed)... 2024-09-19T08:44:16.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:16 smithi155 ceph-mon[34921]: Reconfiguring daemon mon.c on smithi203 2024-09-19T08:44:16.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:16 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:16.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:16 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:16.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:16 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:44:16.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:16 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:16.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:16 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:44:16.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:16 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:16.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:16 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:44:16.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:16 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:44:16.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:16 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:44:16.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:16 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:17.687 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:17 smithi203 ceph-mon[35450]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:17.688 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:17 smithi203 ceph-mon[35450]: Deploying daemon mgr.z on smithi203 2024-09-19T08:44:17.785 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:17 smithi019 ceph-mon[30976]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:17.786 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:17 smithi019 ceph-mon[30976]: Deploying daemon mgr.z on smithi203 2024-09-19T08:44:17.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:17 smithi155 ceph-mon[34921]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:17.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:17 smithi155 ceph-mon[34921]: Deploying daemon mgr.z on smithi203 2024-09-19T08:44:17.981 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:44:17 smithi203 systemd[1]: Starting Ceph mgr.z for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T08:44:18.379 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:44:18 smithi203 podman[37263]: 2024-09-19 08:44:17.970370446 +0000 UTC m=+0.015384183 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:44:18.380 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:44:18 smithi203 podman[37263]: 2024-09-19 08:44:18.077319283 +0000 UTC m=+0.122333062 container create 48cdd72c29a0054964c79e331510eb3d2153a1acf8b7c85636d3f278b036ab10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-z, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True) 2024-09-19T08:44:18.380 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:44:18 smithi203 podman[37263]: 2024-09-19 08:44:18.279841365 +0000 UTC m=+0.324855102 container init 48cdd72c29a0054964c79e331510eb3d2153a1acf8b7c85636d3f278b036ab10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-z, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:44:18.380 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:44:18 smithi203 podman[37263]: 2024-09-19 08:44:18.282573313 +0000 UTC m=+0.327587061 container start 48cdd72c29a0054964c79e331510eb3d2153a1acf8b7c85636d3f278b036ab10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-z, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T08:44:18.380 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:44:18 smithi203 ceph-mgr[37282]: -- 172.21.15.203:0/2203048763 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5559d96ef0e0 con 0x5559d96cd400 2024-09-19T08:44:18.680 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:44:18 smithi203 bash[37263]: 48cdd72c29a0054964c79e331510eb3d2153a1acf8b7c85636d3f278b036ab10 2024-09-19T08:44:18.680 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:44:18 smithi203 systemd[1]: Started Ceph mgr.z for f26c9d84-7662-11ef-bceb-c7b262605968. 2024-09-19T08:44:18.680 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:44:18 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-z[37278]: 2024-09-19T08:44:18.403+0000 7fc83a05b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T08:44:18.680 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:44:18 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-z[37278]: 2024-09-19T08:44:18.465+0000 7fc83a05b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:44:18.680 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:44:18 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-z[37278]: 2024-09-19T08:44:18.614+0000 7fc83a05b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:44:18.680 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:44:18 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-z[37278]: 2024-09-19T08:44:18.680+0000 7fc83a05b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:44:18.965 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:44:18 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-z[37278]: 2024-09-19T08:44:18.827+0000 7fc83a05b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:44:18.965 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:44:18 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-z[37278]: 2024-09-19T08:44:18.965+0000 7fc83a05b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:44:19.041 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:44:19.070 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi019:vg_nvme/lv_4 2024-09-19T08:44:19.326 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:44:19.587 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:19 smithi155 ceph-mon[34921]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:19.587 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:19 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:19.587 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:19 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:19.588 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:19 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:19.588 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:19 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:44:19.588 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:19 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:44:19.588 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:19 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:44:19.588 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:19 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:19.588 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:19 smithi155 ceph-mon[34921]: Deploying daemon mgr.y on smithi155 2024-09-19T08:44:19.697 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:19 smithi019 ceph-mon[30976]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:19.698 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:19 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:19.698 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:19 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:19.698 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:19 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:19.698 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:19 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:44:19.698 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:19 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:44:19.698 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:19 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:44:19.698 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:19 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:19.698 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:19 smithi019 ceph-mon[30976]: Deploying daemon mgr.y on smithi155 2024-09-19T08:44:19.731 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:44:19 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-z[37278]: 2024-09-19T08:44:19.278+0000 7fc83a05b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:44:19.732 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:44:19 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-z[37278]: 2024-09-19T08:44:19.340+0000 7fc83a05b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:44:19.732 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:44:19 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-z[37278]: 2024-09-19T08:44:19.522+0000 7fc83a05b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:44:19.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:19 smithi203 ceph-mon[35450]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:19.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:19 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:19.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:19 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:19.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:19 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:19.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:19 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:44:19.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:19 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T08:44:19.733 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:19 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:44:19.733 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:19 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:19.733 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:19 smithi203 ceph-mon[35450]: Deploying daemon mgr.y on smithi155 2024-09-19T08:44:19.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.780+0000 7f2ff2912640 1 -- 172.21.15.19:0/1298260792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fec1079a0 msgr2=0x7f2fec109d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:19.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.780+0000 7f2ff2912640 1 --2- 172.21.15.19:0/1298260792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fec1079a0 0x7f2fec109d90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2fe4009ca0 tx=0x7f2fe402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:44:19.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.780+0000 7f2ff2912640 1 -- 172.21.15.19:0/1298260792 shutdown_connections 2024-09-19T08:44:19.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.780+0000 7f2ff2912640 1 --2- 172.21.15.19:0/1298260792 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2fec105070 0x7f2fec107460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:19.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.780+0000 7f2ff2912640 1 --2- 172.21.15.19:0/1298260792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fec1079a0 0x7f2fec109d90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:19.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.780+0000 7f2ff2912640 1 --2- 172.21.15.19:0/1298260792 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2fec102740 0x7f2fec104b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:19.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.780+0000 7f2ff2912640 1 -- 172.21.15.19:0/1298260792 >> 172.21.15.19:0/1298260792 conn(0x7f2fec0fc2a0 msgr2=0x7f2fec0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:19.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.780+0000 7f2ff2912640 1 -- 172.21.15.19:0/1298260792 shutdown_connections 2024-09-19T08:44:19.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.780+0000 7f2ff2912640 1 -- 172.21.15.19:0/1298260792 wait complete. 2024-09-19T08:44:19.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.780+0000 7f2ff2912640 1 Processor -- start 2024-09-19T08:44:19.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.780+0000 7f2ff2912640 1 -- start start 2024-09-19T08:44:19.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.781+0000 7f2ff2912640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2fec102740 0x7f2fec1020a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:19.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.781+0000 7f2ff2912640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fec105070 0x7f2fec1006f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:19.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.781+0000 7f2ff2912640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2fec1079a0 0x7f2fec100c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:19.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.781+0000 7f2ff2912640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2fec10d8c0 con 0x7f2fec105070 2024-09-19T08:44:19.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.781+0000 7f2ff2912640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2fec10d740 con 0x7f2fec102740 2024-09-19T08:44:19.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.781+0000 7f2ff2912640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2fec10da40 con 0x7f2fec1079a0 2024-09-19T08:44:19.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.781+0000 7f2feb7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fec105070 0x7f2fec1006f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:19.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.781+0000 7f2feb7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fec105070 0x7f2fec1006f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56940/0 (socket says 172.21.15.19:56940) 2024-09-19T08:44:19.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.781+0000 7f2feb7fe640 1 -- 172.21.15.19:0/1135676057 learned_addr learned my addr 172.21.15.19:0/1135676057 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:44:19.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.781+0000 7f2ff0eaf640 1 --2- 172.21.15.19:0/1135676057 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2fec1079a0 0x7f2fec100c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:19.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.781+0000 7f2febfff640 1 --2- 172.21.15.19:0/1135676057 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2fec102740 0x7f2fec1020a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:19.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.781+0000 7f2feb7fe640 1 -- 172.21.15.19:0/1135676057 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2fec1079a0 msgr2=0x7f2fec100c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:19.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.781+0000 7f2feb7fe640 1 --2- 172.21.15.19:0/1135676057 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2fec1079a0 0x7f2fec100c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:19.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.781+0000 7f2feb7fe640 1 -- 172.21.15.19:0/1135676057 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2fec102740 msgr2=0x7f2fec1020a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:19.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.781+0000 7f2feb7fe640 1 --2- 172.21.15.19:0/1135676057 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2fec102740 0x7f2fec1020a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:19.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.781+0000 7f2feb7fe640 1 -- 172.21.15.19:0/1135676057 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fec1014f0 con 0x7f2fec105070 2024-09-19T08:44:19.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.782+0000 7f2feb7fe640 1 --2- 172.21.15.19:0/1135676057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fec105070 0x7f2fec1006f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2fe000e9f0 tx=0x7f2fe000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:19.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.782+0000 7f2fe97fa640 1 -- 172.21.15.19:0/1135676057 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe000ccc0 con 0x7f2fec105070 2024-09-19T08:44:19.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.782+0000 7f2fe97fa640 1 -- 172.21.15.19:0/1135676057 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2fe0005500 con 0x7f2fec105070 2024-09-19T08:44:19.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.782+0000 7f2ff2912640 1 -- 172.21.15.19:0/1135676057 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fec1a1fb0 con 0x7f2fec105070 2024-09-19T08:44:19.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.782+0000 7f2fe97fa640 1 -- 172.21.15.19:0/1135676057 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0010690 con 0x7f2fec105070 2024-09-19T08:44:19.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.782+0000 7f2ff2912640 1 -- 172.21.15.19:0/1135676057 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fec1a2410 con 0x7f2fec105070 2024-09-19T08:44:19.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.783+0000 7f2fe97fa640 1 -- 172.21.15.19:0/1135676057 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f2fe0010830 con 0x7f2fec105070 2024-09-19T08:44:19.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.783+0000 7f2ff2912640 1 -- 172.21.15.19:0/1135676057 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fec0fdd90 con 0x7f2fec105070 2024-09-19T08:44:19.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.783+0000 7f2fe97fa640 1 --2- 172.21.15.19:0/1135676057 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2fd40394d0 0x7f2fd403b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:19.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.783+0000 7f2fe97fa640 1 -- 172.21.15.19:0/1135676057 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2fe004cca0 con 0x7f2fec105070 2024-09-19T08:44:19.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.783+0000 7f2febfff640 1 --2- 172.21.15.19:0/1135676057 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2fd40394d0 0x7f2fd403b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:19.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.783+0000 7f2febfff640 1 --2- 172.21.15.19:0/1135676057 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2fd40394d0 0x7f2fd403b990 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc00abe0 tx=0x7f2fdc00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:19.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.788+0000 7f2fe97fa640 1 -- 172.21.15.19:0/1135676057 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2fe00203a0 con 0x7f2fec105070 2024-09-19T08:44:19.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:19.974+0000 7f2ff2912640 1 -- 172.21.15.19:0/1135676057 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f2fec062630 con 0x7f2fd40394d0 2024-09-19T08:44:20.563 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:20 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:44:20.563 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:20 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:44:20.563 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:20 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:20.713 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:20 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:44:20.713 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:20 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:44:20.714 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:20 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:20.731 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:44:20 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-z[37278]: 2024-09-19T08:44:20.398+0000 7fc83a05b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:44:20.731 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:44:20 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-z[37278]: 2024-09-19T08:44:20.466+0000 7fc83a05b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:44:20.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:20 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:44:20.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:20 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:44:20.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:20 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:20.922 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:44:20 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-y[36281]: 2024-09-19T08:44:20.844+0000 7f42c3a80040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T08:44:21.378 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:44:21 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-y[36281]: 2024-09-19T08:44:21.000+0000 7f42c3a80040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T08:44:21.379 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:44:21 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-y[36281]: 2024-09-19T08:44:21.069+0000 7f42c3a80040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T08:44:21.379 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:44:21 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-y[36281]: 2024-09-19T08:44:21.229+0000 7f42c3a80040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:44:21.379 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:44:21 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-y[36281]: 2024-09-19T08:44:21.378+0000 7f42c3a80040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T08:44:21.462 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:44:21 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-z[37278]: 2024-09-19T08:44:21.211+0000 7fc83a05b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:44:21.462 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:44:21 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-z[37278]: 2024-09-19T08:44:21.338+0000 7fc83a05b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:44:21.584 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:21 smithi019 ceph-mon[30976]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:21.584 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:21 smithi019 ceph-mon[30976]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:21.584 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:21 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:21.584 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:21 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:21.585 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:21 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:21.585 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:21 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:21.585 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:21 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:44:21.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:21 smithi155 ceph-mon[34921]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:21.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:21 smithi155 ceph-mon[34921]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:21.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:21 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:21.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:21 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:21.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:21 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:21.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:21 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:21.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:21 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:44:21.732 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:44:21 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-z[37278]: 2024-09-19T08:44:21.482+0000 7fc83a05b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:44:21.732 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:44:21 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-z[37278]: 2024-09-19T08:44:21.546+0000 7fc83a05b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:44:21.732 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:44:21 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-z[37278]: 2024-09-19T08:44:21.703+0000 7fc83a05b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:44:21.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:21 smithi203 ceph-mon[35450]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:21.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:21 smithi203 ceph-mon[35450]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:21.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:21 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:21.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:21 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:21.733 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:21 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:21.733 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:21 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:21.733 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:21 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:44:21.963 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:44:21 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-y[36281]: 2024-09-19T08:44:21.706+0000 7f42c3a80040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T08:44:21.963 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:44:21 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-y[36281]: 2024-09-19T08:44:21.767+0000 7f42c3a80040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T08:44:22.000 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:44:21 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-z[37278]: 2024-09-19T08:44:21.773+0000 7fc83a05b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:44:22.000 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:44:21 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-z[37278]: 2024-09-19T08:44:21.833+0000 7fc83a05b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:44:22.000 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:44:22 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-z[37278]: 2024-09-19T08:44:22.000+0000 7fc83a05b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:44:22.277 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:44:22 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-z[37278]: 2024-09-19T08:44:22.068+0000 7fc83a05b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:44:22.278 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:44:22 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-z[37278]: 2024-09-19T08:44:22.137+0000 7fc83a05b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:44:22.278 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:44:22 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-z[37278]: 2024-09-19T08:44:22.219+0000 7fc83a05b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:44:22.278 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:44:22 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-z[37278]: 2024-09-19T08:44:22.278+0000 7fc83a05b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:44:22.423 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:44:21 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-y[36281]: 2024-09-19T08:44:21.963+0000 7f42c3a80040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T08:44:22.731 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:44:22 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-z[37278]: 2024-09-19T08:44:22.337+0000 7fc83a05b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:44:22.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:22 smithi019 ceph-mon[30976]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:22.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:22 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:22.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:22 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:22.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:22 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:22.820 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:22 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:22.820 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:22 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:22.820 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:22 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:22.821 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:22 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:44:22.821 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:22 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:22.821 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:22 smithi019 ceph-mon[30976]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T08:44:22.821 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:22 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:44:22.821 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:22 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:44:22.822 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:22 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:22.822 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:22 smithi019 ceph-mon[30976]: Reconfiguring daemon mgr.x on smithi019 2024-09-19T08:44:22.822 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:22 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3447523324' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "81c7bb06-5b13-4ee0-9290-d779faac1b91"}]: dispatch 2024-09-19T08:44:22.823 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:22 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3447523324' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "81c7bb06-5b13-4ee0-9290-d779faac1b91"}]': finished 2024-09-19T08:44:22.823 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:22 smithi019 ceph-mon[30976]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T08:44:22.823 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:22 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:44:23.121 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:22 smithi203 ceph-mon[35450]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:23.122 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:22 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:23.122 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:22 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:23.122 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:22 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:23.122 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:22 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:23.122 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:22 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:23.122 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:22 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:23.122 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:22 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:44:23.122 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:22 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:23.122 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:22 smithi203 ceph-mon[35450]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T08:44:23.122 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:22 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:44:23.122 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:22 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:44:23.122 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:22 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:23.122 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:22 smithi203 ceph-mon[35450]: Reconfiguring daemon mgr.x on smithi019 2024-09-19T08:44:23.122 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:22 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3447523324' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "81c7bb06-5b13-4ee0-9290-d779faac1b91"}]: dispatch 2024-09-19T08:44:23.123 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:22 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3447523324' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "81c7bb06-5b13-4ee0-9290-d779faac1b91"}]': finished 2024-09-19T08:44:23.123 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:22 smithi203 ceph-mon[35450]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T08:44:23.123 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:22 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:44:23.173 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:44:22 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-y[36281]: 2024-09-19T08:44:22.853+0000 7f42c3a80040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T08:44:23.173 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:44:22 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-y[36281]: 2024-09-19T08:44:22.920+0000 7f42c3a80040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T08:44:23.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:22 smithi155 ceph-mon[34921]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:23.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:22 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:23.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:22 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:23.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:22 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:23.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:22 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:23.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:22 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:23.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:22 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:23.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:22 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:44:23.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:22 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:23.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:22 smithi155 ceph-mon[34921]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T08:44:23.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:22 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T08:44:23.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:22 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T08:44:23.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:22 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:23.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:22 smithi155 ceph-mon[34921]: Reconfiguring daemon mgr.x on smithi019 2024-09-19T08:44:23.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:22 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3447523324' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "81c7bb06-5b13-4ee0-9290-d779faac1b91"}]: dispatch 2024-09-19T08:44:23.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:22 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3447523324' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "81c7bb06-5b13-4ee0-9290-d779faac1b91"}]': finished 2024-09-19T08:44:23.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:22 smithi155 ceph-mon[34921]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T08:44:23.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:22 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:44:23.481 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 08:44:23 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-z[37278]: 2024-09-19T08:44:23.121+0000 7fc83a05b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:44:23.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:23.792+0000 7f2fe97fa640 1 -- 172.21.15.19:0/1135676057 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mgrmap(e 14) ==== 92408+0+0 (secure 0 0 0) 0x7f2fe0021960 con 0x7f2fec105070 2024-09-19T08:44:23.898 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:23 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3599253756' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:44:23.899 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:23 smithi155 ceph-mon[34921]: Standby manager daemon z started 2024-09-19T08:44:23.899 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:23 smithi155 ceph-mon[34921]: from='mgr.? 172.21.15.203:0/1609549768' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T08:44:23.899 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:23 smithi155 ceph-mon[34921]: from='mgr.? 172.21.15.203:0/1609549768' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:44:23.899 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:23 smithi155 ceph-mon[34921]: from='mgr.? 172.21.15.203:0/1609549768' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T08:44:23.899 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:23 smithi155 ceph-mon[34921]: from='mgr.? 172.21.15.203:0/1609549768' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:44:23.899 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:44:23 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-y[36281]: 2024-09-19T08:44:23.639+0000 7f42c3a80040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T08:44:23.899 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:44:23 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-y[36281]: 2024-09-19T08:44:23.754+0000 7f42c3a80040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T08:44:23.899 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:44:23 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-y[36281]: 2024-09-19T08:44:23.898+0000 7f42c3a80040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T08:44:24.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:23 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3599253756' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:44:24.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:23 smithi019 ceph-mon[30976]: Standby manager daemon z started 2024-09-19T08:44:24.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:23 smithi019 ceph-mon[30976]: from='mgr.? 172.21.15.203:0/1609549768' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T08:44:24.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:23 smithi019 ceph-mon[30976]: from='mgr.? 172.21.15.203:0/1609549768' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:44:24.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:23 smithi019 ceph-mon[30976]: from='mgr.? 172.21.15.203:0/1609549768' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T08:44:24.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:23 smithi019 ceph-mon[30976]: from='mgr.? 172.21.15.203:0/1609549768' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:44:24.173 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:44:23 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-y[36281]: 2024-09-19T08:44:23.959+0000 7f42c3a80040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T08:44:24.173 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:44:24 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-y[36281]: 2024-09-19T08:44:24.107+0000 7f42c3a80040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T08:44:24.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:23 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3599253756' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:44:24.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:23 smithi203 ceph-mon[35450]: Standby manager daemon z started 2024-09-19T08:44:24.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:23 smithi203 ceph-mon[35450]: from='mgr.? 172.21.15.203:0/1609549768' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T08:44:24.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:23 smithi203 ceph-mon[35450]: from='mgr.? 172.21.15.203:0/1609549768' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:44:24.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:23 smithi203 ceph-mon[35450]: from='mgr.? 172.21.15.203:0/1609549768' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T08:44:24.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:23 smithi203 ceph-mon[35450]: from='mgr.? 172.21.15.203:0/1609549768' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:44:24.459 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:44:24 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-y[36281]: 2024-09-19T08:44:24.174+0000 7f42c3a80040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T08:44:24.459 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:44:24 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-y[36281]: 2024-09-19T08:44:24.234+0000 7f42c3a80040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T08:44:24.459 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:44:24 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-y[36281]: 2024-09-19T08:44:24.394+0000 7f42c3a80040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T08:44:24.460 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:44:24 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-y[36281]: 2024-09-19T08:44:24.459+0000 7f42c3a80040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T08:44:24.729 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:44:24 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-y[36281]: 2024-09-19T08:44:24.526+0000 7f42c3a80040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T08:44:24.729 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:44:24 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-y[36281]: 2024-09-19T08:44:24.608+0000 7f42c3a80040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T08:44:24.729 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:44:24 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-y[36281]: 2024-09-19T08:44:24.668+0000 7f42c3a80040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T08:44:24.729 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:44:24 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-y[36281]: 2024-09-19T08:44:24.729+0000 7f42c3a80040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T08:44:25.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:24 smithi019 ceph-mon[30976]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:25.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:24 smithi019 ceph-mon[30976]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-19T08:44:25.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:24 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T08:44:25.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:24 smithi155 ceph-mon[34921]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:25.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:24 smithi155 ceph-mon[34921]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-19T08:44:25.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:24 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T08:44:25.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:24 smithi203 ceph-mon[35450]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:25.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:24 smithi203 ceph-mon[35450]: mgrmap e14: x(active, since 62s), standbys: z 2024-09-19T08:44:25.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:24 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T08:44:25.791 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 08:44:25 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-y[36281]: 2024-09-19T08:44:25.519+0000 7f42c3a80040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T08:44:25.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:25.800+0000 7f2fe97fa640 1 -- 172.21.15.19:0/1135676057 <== mon.0 v2:172.21.15.19:3300/0 8 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f2fe001f340 con 0x7f2fec105070 2024-09-19T08:44:26.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:25 smithi019 ceph-mon[30976]: Standby manager daemon y started 2024-09-19T08:44:26.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:25 smithi019 ceph-mon[30976]: from='mgr.? 172.21.15.155:0/3851480223' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T08:44:26.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:25 smithi019 ceph-mon[30976]: from='mgr.? 172.21.15.155:0/3851480223' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:44:26.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:25 smithi019 ceph-mon[30976]: from='mgr.? 172.21.15.155:0/3851480223' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T08:44:26.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:25 smithi019 ceph-mon[30976]: from='mgr.? 172.21.15.155:0/3851480223' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:44:26.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:25 smithi155 ceph-mon[34921]: Standby manager daemon y started 2024-09-19T08:44:26.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:25 smithi155 ceph-mon[34921]: from='mgr.? 172.21.15.155:0/3851480223' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T08:44:26.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:25 smithi155 ceph-mon[34921]: from='mgr.? 172.21.15.155:0/3851480223' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:44:26.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:25 smithi155 ceph-mon[34921]: from='mgr.? 172.21.15.155:0/3851480223' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T08:44:26.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:25 smithi155 ceph-mon[34921]: from='mgr.? 172.21.15.155:0/3851480223' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:44:26.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:25 smithi203 ceph-mon[35450]: Standby manager daemon y started 2024-09-19T08:44:26.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:25 smithi203 ceph-mon[35450]: from='mgr.? 172.21.15.155:0/3851480223' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T08:44:26.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:25 smithi203 ceph-mon[35450]: from='mgr.? 172.21.15.155:0/3851480223' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T08:44:26.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:25 smithi203 ceph-mon[35450]: from='mgr.? 172.21.15.155:0/3851480223' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T08:44:26.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:25 smithi203 ceph-mon[35450]: from='mgr.? 172.21.15.155:0/3851480223' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T08:44:26.998 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:26 smithi019 ceph-mon[30976]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:26.999 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:26 smithi019 ceph-mon[30976]: mgrmap e15: x(active, since 64s), standbys: z, y 2024-09-19T08:44:26.999 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:26 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T08:44:27.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:26 smithi155 ceph-mon[34921]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:27.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:26 smithi155 ceph-mon[34921]: mgrmap e15: x(active, since 64s), standbys: z, y 2024-09-19T08:44:27.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:26 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T08:44:27.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:26 smithi203 ceph-mon[35450]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:27.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:26 smithi203 ceph-mon[35450]: mgrmap e15: x(active, since 64s), standbys: z, y 2024-09-19T08:44:27.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:26 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T08:44:29.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:28 smithi019 ceph-mon[30976]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:29.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:28 smithi155 ceph-mon[34921]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:29.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:28 smithi203 ceph-mon[35450]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:30.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:30 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:30.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:30 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:30.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:30 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:44:30.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:30 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:30.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:30 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:44:30.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:30 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:30.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:30 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:30.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:30 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:30.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:30 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:44:30.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:30 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:30.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:30 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:44:30.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:30 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:30.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:30 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:30.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:30 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:30.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:30 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:44:30.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:30 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:30.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:30 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:44:30.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:30 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:31.301 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:31 smithi019 ceph-mon[30976]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:31.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:31 smithi203 ceph-mon[35450]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:31.574 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:31 smithi155 ceph-mon[34921]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:32.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:32 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T08:44:32.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:32 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:32.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:32 smithi203 ceph-mon[35450]: Deploying daemon osd.0 on smithi019 2024-09-19T08:44:32.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:32 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T08:44:32.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:32 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:32.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:32 smithi019 ceph-mon[30976]: Deploying daemon osd.0 on smithi019 2024-09-19T08:44:32.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:32 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T08:44:32.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:32 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:32.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:32 smithi155 ceph-mon[34921]: Deploying daemon osd.0 on smithi019 2024-09-19T08:44:33.274 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:33 smithi019 ceph-mon[30976]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:33.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:33 smithi203 ceph-mon[35450]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:33.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:33 smithi155 ceph-mon[34921]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:35.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:35 smithi203 ceph-mon[35450]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:35.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:35 smithi019 ceph-mon[30976]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:35.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:35 smithi155 ceph-mon[34921]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:37.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:37 smithi203 ceph-mon[35450]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:37.487 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:37 smithi019 ceph-mon[30976]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:37.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:37 smithi155 ceph-mon[34921]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:38.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:38 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:44:38.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:38 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:38.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:38 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:38.520 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:38 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:44:38.520 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:38 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:38.520 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:38 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:38.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:38 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:44:38.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:38 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:38.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:38 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:39.448 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:39 smithi019 ceph-mon[30976]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:39.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:39 smithi203 ceph-mon[35450]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:39.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:39 smithi155 ceph-mon[34921]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:41.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:41.358+0000 7f2fe97fa640 1 -- 172.21.15.19:0/1135676057 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2fec062630 con 0x7f2fd40394d0 2024-09-19T08:44:41.359 INFO:teuthology.orchestra.run.smithi019.stdout:Created osd(s) 0 on host 'smithi019' 2024-09-19T08:44:41.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:41.360+0000 7f2ff2912640 1 -- 172.21.15.19:0/1135676057 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2fd40394d0 msgr2=0x7f2fd403b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:41.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:41.360+0000 7f2ff2912640 1 --2- 172.21.15.19:0/1135676057 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2fd40394d0 0x7f2fd403b990 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc00abe0 tx=0x7f2fdc00a2d0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:41.360+0000 7f2ff2912640 1 -- 172.21.15.19:0/1135676057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fec105070 msgr2=0x7f2fec1006f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:41.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:41.360+0000 7f2ff2912640 1 --2- 172.21.15.19:0/1135676057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fec105070 0x7f2fec1006f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2fe000e9f0 tx=0x7f2fe000edf0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:41.360+0000 7f2ff2912640 1 -- 172.21.15.19:0/1135676057 shutdown_connections 2024-09-19T08:44:41.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:41.360+0000 7f2ff2912640 1 --2- 172.21.15.19:0/1135676057 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2fd40394d0 0x7f2fd403b990 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:41.360+0000 7f2ff2912640 1 --2- 172.21.15.19:0/1135676057 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2fec1079a0 0x7f2fec100c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:41.360+0000 7f2ff2912640 1 --2- 172.21.15.19:0/1135676057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2fec105070 0x7f2fec1006f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:41.360+0000 7f2ff2912640 1 --2- 172.21.15.19:0/1135676057 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2fec102740 0x7f2fec1020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:41.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:41.360+0000 7f2ff2912640 1 -- 172.21.15.19:0/1135676057 >> 172.21.15.19:0/1135676057 conn(0x7f2fec0fc2a0 msgr2=0x7f2fec103000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:41.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:41.361+0000 7f2ff2912640 1 -- 172.21.15.19:0/1135676057 shutdown_connections 2024-09-19T08:44:41.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:44:41.361+0000 7f2ff2912640 1 -- 172.21.15.19:0/1135676057 wait complete. 2024-09-19T08:44:41.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:41 smithi019 ceph-mon[30976]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:41.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:41 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:41.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:41 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:41.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:41 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:41.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:41 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:44:41.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:41 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:41.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:41 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:44:41.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:41 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:41.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:41 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:41.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:41 smithi155 ceph-mon[34921]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:41.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:41 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:41.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:41 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:41.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:41 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:41.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:41 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:44:41.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:41 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:41.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:41 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:44:41.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:41 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:41.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:41 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:41.967 DEBUG:teuthology.orchestra.run.smithi019:osd.0> sudo journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@osd.0.service 2024-09-19T08:44:41.969 INFO:tasks.cephadm:Deploying osd.1 on smithi155 with /dev/vg_nvme/lv_4... 2024-09-19T08:44:41.969 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T08:44:41.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:41 smithi203 ceph-mon[35450]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:41.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:41 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:41.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:41 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:41.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:41 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:41.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:41 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:44:41.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:41 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:41.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:41 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:44:41.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:41 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:41.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:41 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:42.210 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:44:43.759 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:43 smithi019 ceph-mon[30976]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:43.760 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 19 08:44:43 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-0[44431]: 2024-09-19T08:44:43.617+0000 7f748c014640 -1 osd.0 0 log_to_monitors true 2024-09-19T08:44:43.864 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:43 smithi155 ceph-mon[34921]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:43.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:43 smithi203 ceph-mon[35450]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:44.566 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:44 smithi155 ceph-mon[34921]: from='osd.0 [v2:172.21.15.19:6802/3397146732,v1:172.21.15.19:6803/3397146732]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T08:44:44.568 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T08:44:44.594 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi155:vg_nvme/lv_4 2024-09-19T08:44:44.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:44 smithi019 ceph-mon[30976]: from='osd.0 [v2:172.21.15.19:6802/3397146732,v1:172.21.15.19:6803/3397146732]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T08:44:44.841 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:44:44.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:44 smithi203 ceph-mon[35450]: from='osd.0 [v2:172.21.15.19:6802/3397146732,v1:172.21.15.19:6803/3397146732]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T08:44:45.288 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.280+0000 7fe397c3c640 1 -- 172.21.15.155:0/1352972397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3901026c0 msgr2=0x7fe390108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:45.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.280+0000 7fe397c3c640 1 --2- 172.21.15.155:0/1352972397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3901026c0 0x7fe390108f50 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe388009900 tx=0x7fe38802a410 comp rx=0 tx=0).stop 2024-09-19T08:44:45.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.280+0000 7fe397c3c640 1 -- 172.21.15.155:0/1352972397 shutdown_connections 2024-09-19T08:44:45.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.280+0000 7fe397c3c640 1 --2- 172.21.15.155:0/1352972397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3901026c0 0x7fe390108f50 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:45.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.280+0000 7fe397c3c640 1 --2- 172.21.15.155:0/1352972397 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe390101d00 0x7fe390102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:45.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.280+0000 7fe397c3c640 1 --2- 172.21.15.155:0/1352972397 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe390100b00 0x7fe390100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:45.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.280+0000 7fe397c3c640 1 -- 172.21.15.155:0/1352972397 >> 172.21.15.155:0/1352972397 conn(0x7fe3900fc270 msgr2=0x7fe3900fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:44:45.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.280+0000 7fe397c3c640 1 -- 172.21.15.155:0/1352972397 shutdown_connections 2024-09-19T08:44:45.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.280+0000 7fe397c3c640 1 -- 172.21.15.155:0/1352972397 wait complete. 2024-09-19T08:44:45.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.281+0000 7fe397c3c640 1 Processor -- start 2024-09-19T08:44:45.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.281+0000 7fe397c3c640 1 -- start start 2024-09-19T08:44:45.289 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.281+0000 7fe397c3c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe390100b00 0x7fe390196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:45.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.281+0000 7fe397c3c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe390101d00 0x7fe390197400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:45.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.281+0000 7fe397c3c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3901026c0 0x7fe39019e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:45.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.281+0000 7fe397c3c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe39010c800 con 0x7fe3901026c0 2024-09-19T08:44:45.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.281+0000 7fe397c3c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe39010c680 con 0x7fe390101d00 2024-09-19T08:44:45.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.281+0000 7fe397c3c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe39010c980 con 0x7fe390100b00 2024-09-19T08:44:45.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.281+0000 7fe3951d7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe390101d00 0x7fe390197400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:45.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.281+0000 7fe3951d7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe390101d00 0x7fe390197400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:57676/0 (socket says 172.21.15.155:57676) 2024-09-19T08:44:45.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.281+0000 7fe3951d7640 1 -- 172.21.15.155:0/811097911 learned_addr learned my addr 172.21.15.155:0/811097911 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-19T08:44:45.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.281+0000 7fe3959d8640 1 --2- 172.21.15.155:0/811097911 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe390100b00 0x7fe390196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:45.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.281+0000 7fe3961d9640 1 --2- 172.21.15.155:0/811097911 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3901026c0 0x7fe39019e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:45.290 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.282+0000 7fe3951d7640 1 -- 172.21.15.155:0/811097911 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe390100b00 msgr2=0x7fe390196ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:45.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.282+0000 7fe3951d7640 1 --2- 172.21.15.155:0/811097911 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe390100b00 0x7fe390196ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:45.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.282+0000 7fe3951d7640 1 -- 172.21.15.155:0/811097911 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3901026c0 msgr2=0x7fe39019e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:44:45.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.282+0000 7fe3951d7640 1 --2- 172.21.15.155:0/811097911 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3901026c0 0x7fe39019e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:44:45.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.282+0000 7fe3951d7640 1 -- 172.21.15.155:0/811097911 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe39019eaf0 con 0x7fe390101d00 2024-09-19T08:44:45.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.282+0000 7fe3951d7640 1 --2- 172.21.15.155:0/811097911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe390101d00 0x7fe390197400 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe38400b4a0 tx=0x7fe38400b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:45.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.282+0000 7fe38effd640 1 -- 172.21.15.155:0/811097911 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe384014070 con 0x7fe390101d00 2024-09-19T08:44:45.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.282+0000 7fe397c3c640 1 -- 172.21.15.155:0/811097911 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe39019ede0 con 0x7fe390101d00 2024-09-19T08:44:45.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.282+0000 7fe38effd640 1 -- 172.21.15.155:0/811097911 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe384010af0 con 0x7fe390101d00 2024-09-19T08:44:45.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.282+0000 7fe38effd640 1 -- 172.21.15.155:0/811097911 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe384017d10 con 0x7fe390101d00 2024-09-19T08:44:45.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.282+0000 7fe397c3c640 1 -- 172.21.15.155:0/811097911 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe39019f310 con 0x7fe390101d00 2024-09-19T08:44:45.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.283+0000 7fe397c3c640 1 -- 172.21.15.155:0/811097911 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe390107fa0 con 0x7fe390101d00 2024-09-19T08:44:45.291 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.284+0000 7fe38effd640 1 -- 172.21.15.155:0/811097911 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7fe384017070 con 0x7fe390101d00 2024-09-19T08:44:45.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.285+0000 7fe38effd640 1 --2- 172.21.15.155:0/811097911 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe3780a31e0 0x7fe3780a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:44:45.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.285+0000 7fe38effd640 1 -- 172.21.15.155:0/811097911 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1361+0+0 (secure 0 0 0) 0x7fe3840cd2f0 con 0x7fe390101d00 2024-09-19T08:44:45.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.285+0000 7fe3959d8640 1 --2- 172.21.15.155:0/811097911 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe3780a31e0 0x7fe3780a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:44:45.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.286+0000 7fe3959d8640 1 --2- 172.21.15.155:0/811097911 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe3780a31e0 0x7fe3780a56a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe380005c40 tx=0x7fe38000a590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:44:45.292 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.288+0000 7fe38effd640 1 -- 172.21.15.155:0/811097911 <== mon.2 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe38409b5c0 con 0x7fe390101d00 2024-09-19T08:44:45.465 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:44:45.465+0000 7fe397c3c640 1 -- 172.21.15.155:0/811097911 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fe390062630 con 0x7fe3780a31e0 2024-09-19T08:44:45.818 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 19 08:44:45 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-0[44431]: 2024-09-19T08:44:45.515+0000 7f7487f97640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T08:44:45.819 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 19 08:44:45 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-0[44431]: 2024-09-19T08:44:45.521+0000 7f7483dbf640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:44:45.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:45 smithi019 ceph-mon[30976]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:45.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:45 smithi019 ceph-mon[30976]: from='osd.0 [v2:172.21.15.19:6802/3397146732,v1:172.21.15.19:6803/3397146732]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T08:44:45.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:45 smithi019 ceph-mon[30976]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T08:44:45.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:45 smithi019 ceph-mon[30976]: from='osd.0 [v2:172.21.15.19:6802/3397146732,v1:172.21.15.19:6803/3397146732]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]: dispatch 2024-09-19T08:44:45.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:45 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:44:45.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:45 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:45.820 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:45 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:45.820 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:45 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:45.820 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:45 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:45.820 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:45 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:45.820 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:45 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:44:45.820 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:45 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:45.820 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:45 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:44:45.820 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:45 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:44:45.820 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:45 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:45.867 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:45 smithi155 ceph-mon[34921]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:45.867 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:45 smithi155 ceph-mon[34921]: from='osd.0 [v2:172.21.15.19:6802/3397146732,v1:172.21.15.19:6803/3397146732]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T08:44:45.867 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:45 smithi155 ceph-mon[34921]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T08:44:45.867 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:45 smithi155 ceph-mon[34921]: from='osd.0 [v2:172.21.15.19:6802/3397146732,v1:172.21.15.19:6803/3397146732]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]: dispatch 2024-09-19T08:44:45.867 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:45 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:44:45.868 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:45 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:45.868 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:45 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:45.868 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:45 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:45.868 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:45 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:45.868 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:45 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:45.868 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:45 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:44:45.868 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:45 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:45.868 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:45 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:44:45.868 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:45 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:44:45.868 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:45 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:45.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:45 smithi203 ceph-mon[35450]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:45.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:45 smithi203 ceph-mon[35450]: from='osd.0 [v2:172.21.15.19:6802/3397146732,v1:172.21.15.19:6803/3397146732]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T08:44:45.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:45 smithi203 ceph-mon[35450]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T08:44:45.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:45 smithi203 ceph-mon[35450]: from='osd.0 [v2:172.21.15.19:6802/3397146732,v1:172.21.15.19:6803/3397146732]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]: dispatch 2024-09-19T08:44:45.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:45 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:44:45.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:45 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:45.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:45 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:45.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:45 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:44:45.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:45 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:45.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:45 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:45.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:45 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:44:45.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:45 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:44:45.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:45 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:44:45.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:45 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:44:45.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:45 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:46.808 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:46 smithi155 ceph-mon[34921]: Detected new or changed devices on smithi019 2024-09-19T08:44:46.808 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:46 smithi155 ceph-mon[34921]: Adjusting osd_memory_target on smithi019 to 17092M 2024-09-19T08:44:46.808 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:46 smithi155 ceph-mon[34921]: from='client.24134 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:46.808 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:46 smithi155 ceph-mon[34921]: from='osd.0 [v2:172.21.15.19:6802/3397146732,v1:172.21.15.19:6803/3397146732]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-09-19T08:44:46.808 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:46 smithi155 ceph-mon[34921]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T08:44:46.808 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:46 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:44:46.808 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:46 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:44:46.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:46 smithi019 ceph-mon[30976]: Detected new or changed devices on smithi019 2024-09-19T08:44:46.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:46 smithi019 ceph-mon[30976]: Adjusting osd_memory_target on smithi019 to 17092M 2024-09-19T08:44:46.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:46 smithi019 ceph-mon[30976]: from='client.24134 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:46.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:46 smithi019 ceph-mon[30976]: from='osd.0 [v2:172.21.15.19:6802/3397146732,v1:172.21.15.19:6803/3397146732]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-09-19T08:44:46.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:46 smithi019 ceph-mon[30976]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T08:44:46.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:46 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:44:46.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:46 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:44:46.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:46 smithi203 ceph-mon[35450]: Detected new or changed devices on smithi019 2024-09-19T08:44:46.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:46 smithi203 ceph-mon[35450]: Adjusting osd_memory_target on smithi019 to 17092M 2024-09-19T08:44:46.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:46 smithi203 ceph-mon[35450]: from='client.24134 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:44:46.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:46 smithi203 ceph-mon[35450]: from='osd.0 [v2:172.21.15.19:6802/3397146732,v1:172.21.15.19:6803/3397146732]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-09-19T08:44:46.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:46 smithi203 ceph-mon[35450]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T08:44:46.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:46 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:44:46.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:46 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:44:47.821 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:47 smithi019 ceph-mon[30976]: purged_snaps scrub starts 2024-09-19T08:44:47.821 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:47 smithi019 ceph-mon[30976]: purged_snaps scrub ok 2024-09-19T08:44:47.821 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:47 smithi019 ceph-mon[30976]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:47.821 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:47 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:44:47.821 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:47 smithi019 ceph-mon[30976]: osd.0 [v2:172.21.15.19:6802/3397146732,v1:172.21.15.19:6803/3397146732] boot 2024-09-19T08:44:47.821 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:47 smithi019 ceph-mon[30976]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T08:44:47.821 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:47 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:44:47.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:47 smithi155 ceph-mon[34921]: purged_snaps scrub starts 2024-09-19T08:44:47.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:47 smithi155 ceph-mon[34921]: purged_snaps scrub ok 2024-09-19T08:44:47.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:47 smithi155 ceph-mon[34921]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:47.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:47 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:44:47.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:47 smithi155 ceph-mon[34921]: osd.0 [v2:172.21.15.19:6802/3397146732,v1:172.21.15.19:6803/3397146732] boot 2024-09-19T08:44:47.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:47 smithi155 ceph-mon[34921]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T08:44:47.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:47 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:44:47.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:47 smithi203 ceph-mon[35450]: purged_snaps scrub starts 2024-09-19T08:44:47.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:47 smithi203 ceph-mon[35450]: purged_snaps scrub ok 2024-09-19T08:44:47.984 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:47 smithi203 ceph-mon[35450]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T08:44:47.984 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:47 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:44:47.984 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:47 smithi203 ceph-mon[35450]: osd.0 [v2:172.21.15.19:6802/3397146732,v1:172.21.15.19:6803/3397146732] boot 2024-09-19T08:44:47.984 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:47 smithi203 ceph-mon[35450]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T08:44:47.984 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:47 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T08:44:48.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:48 smithi155 ceph-mon[34921]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T08:44:48.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:48 smithi155 ceph-mon[34921]: from='client.? 172.21.15.155:0/292584214' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "24c145e6-5252-4708-8f25-5ce041e8251e"}]: dispatch 2024-09-19T08:44:48.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:48 smithi155 ceph-mon[34921]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "24c145e6-5252-4708-8f25-5ce041e8251e"}]: dispatch 2024-09-19T08:44:48.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:48 smithi155 ceph-mon[34921]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "24c145e6-5252-4708-8f25-5ce041e8251e"}]': finished 2024-09-19T08:44:48.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:48 smithi155 ceph-mon[34921]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T08:44:48.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:48 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:44:48.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:48 smithi155 ceph-mon[34921]: from='client.? 172.21.15.155:0/3903102296' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:44:48.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:48 smithi019 ceph-mon[30976]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T08:44:48.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:48 smithi019 ceph-mon[30976]: from='client.? 172.21.15.155:0/292584214' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "24c145e6-5252-4708-8f25-5ce041e8251e"}]: dispatch 2024-09-19T08:44:48.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:48 smithi019 ceph-mon[30976]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "24c145e6-5252-4708-8f25-5ce041e8251e"}]: dispatch 2024-09-19T08:44:48.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:48 smithi019 ceph-mon[30976]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "24c145e6-5252-4708-8f25-5ce041e8251e"}]': finished 2024-09-19T08:44:48.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:48 smithi019 ceph-mon[30976]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T08:44:48.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:48 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:44:48.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:48 smithi019 ceph-mon[30976]: from='client.? 172.21.15.155:0/3903102296' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:44:48.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:48 smithi203 ceph-mon[35450]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T08:44:48.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:48 smithi203 ceph-mon[35450]: from='client.? 172.21.15.155:0/292584214' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "24c145e6-5252-4708-8f25-5ce041e8251e"}]: dispatch 2024-09-19T08:44:48.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:48 smithi203 ceph-mon[35450]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "24c145e6-5252-4708-8f25-5ce041e8251e"}]: dispatch 2024-09-19T08:44:48.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:48 smithi203 ceph-mon[35450]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "24c145e6-5252-4708-8f25-5ce041e8251e"}]': finished 2024-09-19T08:44:48.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:48 smithi203 ceph-mon[35450]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T08:44:48.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:48 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:44:48.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:48 smithi203 ceph-mon[35450]: from='client.? 172.21.15.155:0/3903102296' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:44:49.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:49 smithi019 ceph-mon[30976]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:44:49.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:49 smithi155 ceph-mon[34921]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:44:49.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:49 smithi203 ceph-mon[35450]: pgmap v42: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:44:51.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:51 smithi019 ceph-mon[30976]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:44:51.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:51 smithi155 ceph-mon[34921]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:44:51.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:51 smithi203 ceph-mon[35450]: pgmap v44: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:44:53.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:53 smithi019 ceph-mon[30976]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:44:53.921 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:53 smithi155 ceph-mon[34921]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:44:53.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:53 smithi203 ceph-mon[35450]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:44:55.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:55 smithi019 ceph-mon[30976]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:44:55.894 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:55 smithi155 ceph-mon[34921]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:44:55.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:55 smithi203 ceph-mon[35450]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:44:56.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:56 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T08:44:56.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:56 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:56.855 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:56 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T08:44:56.855 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:56 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:56.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:56 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T08:44:56.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:56 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:44:57.778 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:57 smithi155 ceph-mon[34921]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:44:57.778 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:57 smithi155 ceph-mon[34921]: Deploying daemon osd.1 on smithi155 2024-09-19T08:44:57.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:57 smithi019 ceph-mon[30976]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:44:57.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:57 smithi019 ceph-mon[30976]: Deploying daemon osd.1 on smithi155 2024-09-19T08:44:57.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:57 smithi203 ceph-mon[35450]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:44:57.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:57 smithi203 ceph-mon[35450]: Deploying daemon osd.1 on smithi155 2024-09-19T08:44:59.644 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:44:59 smithi155 ceph-mon[34921]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:44:59.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:44:59 smithi019 ceph-mon[30976]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:44:59.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:44:59 smithi203 ceph-mon[35450]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:45:01.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:01 smithi019 ceph-mon[30976]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:45:01.872 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:01 smithi155 ceph-mon[34921]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:45:01.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:01 smithi203 ceph-mon[35450]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:45:02.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:02 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:45:02.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:02 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:02.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:02 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:02.898 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:02 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:45:02.898 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:02 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:02.898 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:02 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:02.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:02 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:45:02.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:02 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:02.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:02 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:03.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:03 smithi019 ceph-mon[30976]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:45:03.890 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:03 smithi155 ceph-mon[34921]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:45:03.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:03 smithi203 ceph-mon[35450]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:45:05.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:05 smithi019 ceph-mon[30976]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:45:05.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:05 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:05.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:05 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:05.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:05 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:45:05.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:05 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:45:05.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:05 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:05.842 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:05 smithi155 ceph-mon[34921]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:45:05.842 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:05 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:05.842 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:05 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:05.842 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:05 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:45:05.842 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:05 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:45:05.842 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:05 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:05.886 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:45:05.886+0000 7fe38effd640 1 -- 172.21.15.155:0/811097911 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe390062630 con 0x7fe3780a31e0 2024-09-19T08:45:05.886 INFO:teuthology.orchestra.run.smithi155.stdout:Created osd(s) 1 on host 'smithi155' 2024-09-19T08:45:05.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:45:05.889+0000 7fe397c3c640 1 -- 172.21.15.155:0/811097911 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe3780a31e0 msgr2=0x7fe3780a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:05.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:45:05.889+0000 7fe397c3c640 1 --2- 172.21.15.155:0/811097911 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe3780a31e0 0x7fe3780a56a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe380005c40 tx=0x7fe38000a590 comp rx=0 tx=0).stop 2024-09-19T08:45:05.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:45:05.889+0000 7fe397c3c640 1 -- 172.21.15.155:0/811097911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe390101d00 msgr2=0x7fe390197400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:05.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:45:05.889+0000 7fe397c3c640 1 --2- 172.21.15.155:0/811097911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe390101d00 0x7fe390197400 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe38400b4a0 tx=0x7fe38400b960 comp rx=0 tx=0).stop 2024-09-19T08:45:05.889 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:45:05.889+0000 7fe397c3c640 1 -- 172.21.15.155:0/811097911 shutdown_connections 2024-09-19T08:45:05.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:45:05.889+0000 7fe397c3c640 1 --2- 172.21.15.155:0/811097911 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe3780a31e0 0x7fe3780a56a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:05.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:45:05.889+0000 7fe397c3c640 1 --2- 172.21.15.155:0/811097911 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3901026c0 0x7fe39019e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:05.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:45:05.889+0000 7fe397c3c640 1 --2- 172.21.15.155:0/811097911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe390101d00 0x7fe390197400 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:05.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:45:05.889+0000 7fe397c3c640 1 --2- 172.21.15.155:0/811097911 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe390100b00 0x7fe390196ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:05.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:45:05.889+0000 7fe397c3c640 1 -- 172.21.15.155:0/811097911 >> 172.21.15.155:0/811097911 conn(0x7fe3900fc270 msgr2=0x7fe390105170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:05.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:45:05.889+0000 7fe397c3c640 1 -- 172.21.15.155:0/811097911 shutdown_connections 2024-09-19T08:45:05.890 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:45:05.889+0000 7fe397c3c640 1 -- 172.21.15.155:0/811097911 wait complete. 2024-09-19T08:45:05.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:05 smithi203 ceph-mon[35450]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:45:05.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:05 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:05.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:05 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:05.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:05 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:45:05.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:05 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:45:05.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:05 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:06.504 DEBUG:teuthology.orchestra.run.smithi155:osd.1> sudo journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@osd.1.service 2024-09-19T08:45:06.507 INFO:tasks.cephadm:Deploying osd.2 on smithi203 with /dev/vg_nvme/lv_4... 2024-09-19T08:45:06.508 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T08:45:06.761 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:45:06.798 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:06 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:45:06.798 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:06 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:06.798 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:06 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:06.856 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:06 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:45:06.857 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:06 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:06.857 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:06 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:07.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:06 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:45:07.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:06 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:07.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:06 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:07.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:07 smithi155 ceph-mon[34921]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:45:07.860 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:07 smithi203 ceph-mon[35450]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:45:08.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:07 smithi019 ceph-mon[30976]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:45:08.579 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 08:45:08 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-1[39384]: 2024-09-19T08:45:08.290+0000 7fbe5ccc6640 -1 osd.1 0 log_to_monitors true 2024-09-19T08:45:08.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:08 smithi203 ceph-mon[35450]: from='osd.1 [v2:172.21.15.155:6800/2011043685,v1:172.21.15.155:6801/2011043685]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:45:08.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:08 smithi203 ceph-mon[35450]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:45:08.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:08 smithi155 ceph-mon[34921]: from='osd.1 [v2:172.21.15.155:6800/2011043685,v1:172.21.15.155:6801/2011043685]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:45:08.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:08 smithi155 ceph-mon[34921]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:45:08.931 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T08:45:08.955 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi203:vg_nvme/lv_4 2024-09-19T08:45:09.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:08 smithi019 ceph-mon[30976]: from='osd.1 [v2:172.21.15.155:6800/2011043685,v1:172.21.15.155:6801/2011043685]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:45:09.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:08 smithi019 ceph-mon[30976]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T08:45:09.196 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:45:09.666 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.642+0000 7f608782a640 1 -- 172.21.15.203:0/3400668623 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60801026c0 msgr2=0x7f6080108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:09.666 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.642+0000 7f608782a640 1 --2- 172.21.15.203:0/3400668623 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60801026c0 0x7f6080108f50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6078009ca0 tx=0x7f607802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:45:09.666 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.642+0000 7f608782a640 1 -- 172.21.15.203:0/3400668623 shutdown_connections 2024-09-19T08:45:09.666 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.642+0000 7f608782a640 1 --2- 172.21.15.203:0/3400668623 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60801026c0 0x7f6080108f50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:09.666 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.642+0000 7f608782a640 1 --2- 172.21.15.203:0/3400668623 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6080101d00 0x7f6080102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:09.666 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.642+0000 7f608782a640 1 --2- 172.21.15.203:0/3400668623 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6080100b00 0x7f6080100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:09.666 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.642+0000 7f608782a640 1 -- 172.21.15.203:0/3400668623 >> 172.21.15.203:0/3400668623 conn(0x7f60800fc270 msgr2=0x7f60800fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:09.666 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.642+0000 7f608782a640 1 -- 172.21.15.203:0/3400668623 shutdown_connections 2024-09-19T08:45:09.667 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.643+0000 7f608782a640 1 -- 172.21.15.203:0/3400668623 wait complete. 2024-09-19T08:45:09.667 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.643+0000 7f608782a640 1 Processor -- start 2024-09-19T08:45:09.667 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.643+0000 7f608782a640 1 -- start start 2024-09-19T08:45:09.667 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.643+0000 7f608782a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6080100b00 0x7f608006b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:09.667 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.643+0000 7f608782a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6080101d00 0x7f608019cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:09.667 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.643+0000 7f608782a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60801026c0 0x7f608019f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:09.667 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.643+0000 7f608782a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f608010c760 con 0x7f6080101d00 2024-09-19T08:45:09.667 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.643+0000 7f608782a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f608010c5e0 con 0x7f60801026c0 2024-09-19T08:45:09.667 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.643+0000 7f608782a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f608010c8e0 con 0x7f6080100b00 2024-09-19T08:45:09.667 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.643+0000 7f60855c6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6080100b00 0x7f608006b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:09.667 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.644+0000 7f60855c6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6080100b00 0x7f608006b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:49858/0 (socket says 172.21.15.203:49858) 2024-09-19T08:45:09.667 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.644+0000 7f60855c6640 1 -- 172.21.15.203:0/57602060 learned_addr learned my addr 172.21.15.203:0/57602060 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-19T08:45:09.668 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.644+0000 7f6085dc7640 1 --2- 172.21.15.203:0/57602060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60801026c0 0x7f608019f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:09.668 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.644+0000 7f6084dc5640 1 --2- 172.21.15.203:0/57602060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6080101d00 0x7f608019cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:09.668 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.644+0000 7f60855c6640 1 -- 172.21.15.203:0/57602060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60801026c0 msgr2=0x7f608019f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:09.668 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.644+0000 7f60855c6640 1 --2- 172.21.15.203:0/57602060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60801026c0 0x7f608019f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:09.668 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.644+0000 7f60855c6640 1 -- 172.21.15.203:0/57602060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6080101d00 msgr2=0x7f608019cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:09.668 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.644+0000 7f60855c6640 1 --2- 172.21.15.203:0/57602060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6080101d00 0x7f608019cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:09.668 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.644+0000 7f60855c6640 1 -- 172.21.15.203:0/57602060 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f608019fb60 con 0x7f6080100b00 2024-09-19T08:45:09.668 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.644+0000 7f6084dc5640 1 --2- 172.21.15.203:0/57602060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6080101d00 0x7f608019cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:45:09.668 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.644+0000 7f60855c6640 1 --2- 172.21.15.203:0/57602060 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6080100b00 0x7f608006b2f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f607c00d770 tx=0x7f607c00dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:09.668 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.644+0000 7f60767fc640 1 -- 172.21.15.203:0/57602060 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607c017070 con 0x7f6080100b00 2024-09-19T08:45:09.668 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.644+0000 7f608782a640 1 -- 172.21.15.203:0/57602060 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f608019fdf0 con 0x7f6080100b00 2024-09-19T08:45:09.668 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.644+0000 7f60767fc640 1 -- 172.21.15.203:0/57602060 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f607c009c30 con 0x7f6080100b00 2024-09-19T08:45:09.668 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.644+0000 7f60767fc640 1 -- 172.21.15.203:0/57602060 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607c003dd0 con 0x7f6080100b00 2024-09-19T08:45:09.669 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.644+0000 7f608782a640 1 -- 172.21.15.203:0/57602060 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60801a02a0 con 0x7f6080100b00 2024-09-19T08:45:09.669 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.645+0000 7f608782a640 1 -- 172.21.15.203:0/57602060 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6080107fa0 con 0x7f6080100b00 2024-09-19T08:45:09.669 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.646+0000 7f60767fc640 1 -- 172.21.15.203:0/57602060 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f607c003f70 con 0x7f6080100b00 2024-09-19T08:45:09.669 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.647+0000 7f60767fc640 1 --2- 172.21.15.203:0/57602060 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f606c0a31b0 0x7f606c0a5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:09.669 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.647+0000 7f60767fc640 1 -- 172.21.15.203:0/57602060 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7f607c0cd900 con 0x7f6080100b00 2024-09-19T08:45:09.669 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.647+0000 7f6084dc5640 1 --2- 172.21.15.203:0/57602060 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f606c0a31b0 0x7f606c0a5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:09.669 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.648+0000 7f6084dc5640 1 --2- 172.21.15.203:0/57602060 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f606c0a31b0 0x7f606c0a5670 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f60700058c0 tx=0x7f6070005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:09.669 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.652+0000 7f60767fc640 1 -- 172.21.15.203:0/57602060 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f607c09bf90 con 0x7f6080100b00 2024-09-19T08:45:09.673 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 08:45:09 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-1[39384]: 2024-09-19T08:45:09.590+0000 7fbe58c49640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T08:45:09.673 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 08:45:09 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-1[39384]: 2024-09-19T08:45:09.593+0000 7fbe54a71640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:45:09.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:09 smithi155 ceph-mon[34921]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:45:09.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:09 smithi155 ceph-mon[34921]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T08:45:09.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:09 smithi155 ceph-mon[34921]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T08:45:09.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:09 smithi155 ceph-mon[34921]: from='osd.1 [v2:172.21.15.155:6800/2011043685,v1:172.21.15.155:6801/2011043685]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:45:09.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:09 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:45:09.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:09 smithi155 ceph-mon[34921]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:45:09.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:09 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:09.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:09 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:09.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:09 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:45:09.674 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:09 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:09.674 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:09 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:45:09.674 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:09 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:45:09.674 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:09 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:09.835 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:09.834+0000 7f608782a640 1 -- 172.21.15.203:0/57602060 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f6080062630 con 0x7f606c0a31b0 2024-09-19T08:45:09.835 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:09 smithi203 ceph-mon[35450]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:45:09.836 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:09 smithi203 ceph-mon[35450]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T08:45:09.836 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:09 smithi203 ceph-mon[35450]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T08:45:09.836 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:09 smithi203 ceph-mon[35450]: from='osd.1 [v2:172.21.15.155:6800/2011043685,v1:172.21.15.155:6801/2011043685]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:45:09.836 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:09 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:45:09.836 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:09 smithi203 ceph-mon[35450]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:45:09.836 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:09 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:09.836 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:09 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:09.836 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:09 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:45:09.836 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:09 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:09.836 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:09 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:45:09.836 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:09 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:45:09.836 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:09 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:10.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:09 smithi019 ceph-mon[30976]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:45:10.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:09 smithi019 ceph-mon[30976]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T08:45:10.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:09 smithi019 ceph-mon[30976]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T08:45:10.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:09 smithi019 ceph-mon[30976]: from='osd.1 [v2:172.21.15.155:6800/2011043685,v1:172.21.15.155:6801/2011043685]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:45:10.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:09 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:45:10.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:09 smithi019 ceph-mon[30976]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:45:10.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:09 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:10.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:09 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:10.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:09 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:45:10.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:09 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:10.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:09 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:45:10.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:09 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:45:10.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:09 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:10.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:10 smithi155 ceph-mon[34921]: Detected new or changed devices on smithi155 2024-09-19T08:45:10.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:10 smithi155 ceph-mon[34921]: Adjusting osd_memory_target on smithi155 to 17088M 2024-09-19T08:45:10.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:10 smithi155 ceph-mon[34921]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-19T08:45:10.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:10 smithi155 ceph-mon[34921]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T08:45:10.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:10 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:45:10.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:10 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:45:10.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:10 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:45:10.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:10 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:45:10.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:10 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:45:10.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:10 smithi203 ceph-mon[35450]: Detected new or changed devices on smithi155 2024-09-19T08:45:10.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:10 smithi203 ceph-mon[35450]: Adjusting osd_memory_target on smithi155 to 17088M 2024-09-19T08:45:10.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:10 smithi203 ceph-mon[35450]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-19T08:45:10.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:10 smithi203 ceph-mon[35450]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T08:45:10.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:10 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:45:10.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:10 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:45:10.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:10 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:45:10.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:10 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:45:10.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:10 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:45:11.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:10 smithi019 ceph-mon[30976]: Detected new or changed devices on smithi155 2024-09-19T08:45:11.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:10 smithi019 ceph-mon[30976]: Adjusting osd_memory_target on smithi155 to 17088M 2024-09-19T08:45:11.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:10 smithi019 ceph-mon[30976]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-19T08:45:11.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:10 smithi019 ceph-mon[30976]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T08:45:11.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:10 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:45:11.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:10 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:45:11.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:10 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:45:11.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:10 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:45:11.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:10 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:45:11.717 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:11 smithi203 ceph-mon[35450]: purged_snaps scrub starts 2024-09-19T08:45:11.717 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:11 smithi203 ceph-mon[35450]: purged_snaps scrub ok 2024-09-19T08:45:11.717 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:11 smithi203 ceph-mon[35450]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:45:11.717 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:11 smithi203 ceph-mon[35450]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:45:11.717 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:11 smithi203 ceph-mon[35450]: osd.1 [v2:172.21.15.155:6800/2011043685,v1:172.21.15.155:6801/2011043685] boot 2024-09-19T08:45:11.717 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:11 smithi203 ceph-mon[35450]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T08:45:11.717 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:11 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:45:11.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:11 smithi155 ceph-mon[34921]: purged_snaps scrub starts 2024-09-19T08:45:11.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:11 smithi155 ceph-mon[34921]: purged_snaps scrub ok 2024-09-19T08:45:11.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:11 smithi155 ceph-mon[34921]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:45:11.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:11 smithi155 ceph-mon[34921]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:45:11.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:11 smithi155 ceph-mon[34921]: osd.1 [v2:172.21.15.155:6800/2011043685,v1:172.21.15.155:6801/2011043685] boot 2024-09-19T08:45:11.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:11 smithi155 ceph-mon[34921]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T08:45:11.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:11 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:45:12.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:11 smithi019 ceph-mon[30976]: purged_snaps scrub starts 2024-09-19T08:45:12.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:11 smithi019 ceph-mon[30976]: purged_snaps scrub ok 2024-09-19T08:45:12.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:11 smithi019 ceph-mon[30976]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-09-19T08:45:12.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:11 smithi019 ceph-mon[30976]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:45:12.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:11 smithi019 ceph-mon[30976]: osd.1 [v2:172.21.15.155:6800/2011043685,v1:172.21.15.155:6801/2011043685] boot 2024-09-19T08:45:12.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:11 smithi019 ceph-mon[30976]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T08:45:12.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:11 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T08:45:12.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:12 smithi019 ceph-mon[30976]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T08:45:12.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:12 smithi019 ceph-mon[30976]: from='client.? 172.21.15.203:0/439456002' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "99cefd33-0675-495f-8871-2e6fdead0c3a"}]: dispatch 2024-09-19T08:45:12.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:12 smithi019 ceph-mon[30976]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "99cefd33-0675-495f-8871-2e6fdead0c3a"}]: dispatch 2024-09-19T08:45:12.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:12 smithi019 ceph-mon[30976]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "99cefd33-0675-495f-8871-2e6fdead0c3a"}]': finished 2024-09-19T08:45:12.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:12 smithi019 ceph-mon[30976]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T08:45:12.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:12 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:45:12.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:12 smithi019 ceph-mon[30976]: from='client.? 172.21.15.203:0/3568423417' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:45:12.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:12 smithi155 ceph-mon[34921]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T08:45:12.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:12 smithi155 ceph-mon[34921]: from='client.? 172.21.15.203:0/439456002' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "99cefd33-0675-495f-8871-2e6fdead0c3a"}]: dispatch 2024-09-19T08:45:12.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:12 smithi155 ceph-mon[34921]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "99cefd33-0675-495f-8871-2e6fdead0c3a"}]: dispatch 2024-09-19T08:45:12.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:12 smithi155 ceph-mon[34921]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "99cefd33-0675-495f-8871-2e6fdead0c3a"}]': finished 2024-09-19T08:45:12.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:12 smithi155 ceph-mon[34921]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T08:45:12.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:12 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:45:12.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:12 smithi155 ceph-mon[34921]: from='client.? 172.21.15.203:0/3568423417' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:45:12.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:12 smithi203 ceph-mon[35450]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T08:45:12.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:12 smithi203 ceph-mon[35450]: from='client.? 172.21.15.203:0/439456002' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "99cefd33-0675-495f-8871-2e6fdead0c3a"}]: dispatch 2024-09-19T08:45:12.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:12 smithi203 ceph-mon[35450]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "99cefd33-0675-495f-8871-2e6fdead0c3a"}]: dispatch 2024-09-19T08:45:12.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:12 smithi203 ceph-mon[35450]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "99cefd33-0675-495f-8871-2e6fdead0c3a"}]': finished 2024-09-19T08:45:12.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:12 smithi203 ceph-mon[35450]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T08:45:12.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:12 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:45:12.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:12 smithi203 ceph-mon[35450]: from='client.? 172.21.15.203:0/3568423417' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:45:13.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:13 smithi155 ceph-mon[34921]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:45:13.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:13 smithi203 ceph-mon[35450]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:45:14.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:13 smithi019 ceph-mon[30976]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:45:15.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:15 smithi155 ceph-mon[34921]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:45:15.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:15 smithi203 ceph-mon[35450]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:45:16.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:15 smithi019 ceph-mon[30976]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:45:17.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:17 smithi203 ceph-mon[35450]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:45:17.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:17 smithi155 ceph-mon[34921]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:45:18.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:17 smithi019 ceph-mon[30976]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:45:19.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:19 smithi203 ceph-mon[35450]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:45:19.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:19 smithi155 ceph-mon[34921]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:45:20.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:19 smithi019 ceph-mon[30976]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:45:20.849 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:20 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T08:45:20.849 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:20 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:45:20.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:20 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T08:45:20.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:20 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:45:21.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:20 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T08:45:21.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:20 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:45:21.814 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:21 smithi203 ceph-mon[35450]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:45:21.814 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:21 smithi203 ceph-mon[35450]: Deploying daemon osd.2 on smithi203 2024-09-19T08:45:21.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:21 smithi155 ceph-mon[34921]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:45:21.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:21 smithi155 ceph-mon[34921]: Deploying daemon osd.2 on smithi203 2024-09-19T08:45:22.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:21 smithi019 ceph-mon[30976]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:45:22.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:21 smithi019 ceph-mon[30976]: Deploying daemon osd.2 on smithi203 2024-09-19T08:45:23.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:23 smithi203 ceph-mon[35450]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:45:23.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:23 smithi155 ceph-mon[34921]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:45:24.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:23 smithi019 ceph-mon[30976]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:45:25.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:25 smithi155 ceph-mon[34921]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:45:25.934 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:25 smithi203 ceph-mon[35450]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:45:26.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:25 smithi019 ceph-mon[30976]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:45:26.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:26 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:45:26.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:26 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:26.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:26 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:26.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:26 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:45:26.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:26 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:26.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:26 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:27.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:26 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:45:27.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:26 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:27.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:26 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:27.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:27 smithi155 ceph-mon[34921]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:45:27.923 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:27 smithi203 ceph-mon[35450]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:45:28.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:27 smithi019 ceph-mon[30976]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:45:29.855 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:29 smithi203 ceph-mon[35450]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:45:29.855 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:29 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:29.856 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:29 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:29.856 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:29 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:45:29.856 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:29 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:45:29.856 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:29 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:29.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:29 smithi155 ceph-mon[34921]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:45:29.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:29 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:29.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:29 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:29.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:29 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:45:29.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:29 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:45:29.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:29 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:30.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:29 smithi019 ceph-mon[30976]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:45:30.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:29 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:30.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:29 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:30.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:29 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:45:30.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:29 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:45:30.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:29 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:30.163 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:30.163+0000 7f60767fc640 1 -- 172.21.15.203:0/57602060 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6080062630 con 0x7f606c0a31b0 2024-09-19T08:45:30.163 INFO:teuthology.orchestra.run.smithi203.stdout:Created osd(s) 2 on host 'smithi203' 2024-09-19T08:45:30.165 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:30.166+0000 7f608782a640 1 -- 172.21.15.203:0/57602060 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f606c0a31b0 msgr2=0x7f606c0a5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:30.166 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:30.166+0000 7f608782a640 1 --2- 172.21.15.203:0/57602060 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f606c0a31b0 0x7f606c0a5670 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f60700058c0 tx=0x7f6070005850 comp rx=0 tx=0).stop 2024-09-19T08:45:30.166 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:30.166+0000 7f608782a640 1 -- 172.21.15.203:0/57602060 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6080100b00 msgr2=0x7f608006b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:30.166 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:30.166+0000 7f608782a640 1 --2- 172.21.15.203:0/57602060 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6080100b00 0x7f608006b2f0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f607c00d770 tx=0x7f607c00dc30 comp rx=0 tx=0).stop 2024-09-19T08:45:30.166 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:30.166+0000 7f608782a640 1 -- 172.21.15.203:0/57602060 shutdown_connections 2024-09-19T08:45:30.166 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:30.166+0000 7f608782a640 1 --2- 172.21.15.203:0/57602060 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f606c0a31b0 0x7f606c0a5670 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.166 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:30.166+0000 7f608782a640 1 --2- 172.21.15.203:0/57602060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60801026c0 0x7f608019f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.166 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:30.166+0000 7f608782a640 1 --2- 172.21.15.203:0/57602060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6080101d00 0x7f608019cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.166 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:30.166+0000 7f608782a640 1 --2- 172.21.15.203:0/57602060 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6080100b00 0x7f608006b2f0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:30.166 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:30.166+0000 7f608782a640 1 -- 172.21.15.203:0/57602060 >> 172.21.15.203:0/57602060 conn(0x7f60800fc270 msgr2=0x7f6080105170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:30.166 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:30.166+0000 7f608782a640 1 -- 172.21.15.203:0/57602060 shutdown_connections 2024-09-19T08:45:30.166 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:45:30.166+0000 7f608782a640 1 -- 172.21.15.203:0/57602060 wait complete. 2024-09-19T08:45:30.754 DEBUG:teuthology.orchestra.run.smithi203:osd.2> sudo journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@osd.2.service 2024-09-19T08:45:30.756 INFO:tasks.cephadm:Deploying osd.3 on smithi019 with /dev/vg_nvme/lv_3... 2024-09-19T08:45:30.756 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T08:45:30.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:30 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:45:30.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:30 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:30.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:30 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:30.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:30 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:45:30.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:30 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:30.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:30 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:31.007 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:45:31.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:30 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:45:31.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:30 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:31.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:30 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:31.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:31 smithi203 ceph-mon[35450]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:45:31.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:31 smithi019 ceph-mon[30976]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:45:31.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:31 smithi155 ceph-mon[34921]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:45:32.362 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 08:45:32 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-2[40419]: 2024-09-19T08:45:32.243+0000 7f9ce653c640 -1 osd.2 0 log_to_monitors true 2024-09-19T08:45:32.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:32 smithi203 ceph-mon[35450]: from='osd.2 [v2:172.21.15.203:6800/3358994623,v1:172.21.15.203:6801/3358994623]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:45:32.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:32 smithi203 ceph-mon[35450]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:45:32.816 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:32 smithi019 ceph-mon[30976]: from='osd.2 [v2:172.21.15.203:6800/3358994623,v1:172.21.15.203:6801/3358994623]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:45:32.816 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:32 smithi019 ceph-mon[30976]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:45:32.839 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:32 smithi155 ceph-mon[34921]: from='osd.2 [v2:172.21.15.203:6800/3358994623,v1:172.21.15.203:6801/3358994623]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:45:32.839 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:32 smithi155 ceph-mon[34921]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T08:45:33.807 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 08:45:33 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-2[40419]: 2024-09-19T08:45:33.592+0000 7f9ce24bf640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T08:45:33.808 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 08:45:33 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-2[40419]: 2024-09-19T08:45:33.597+0000 7f9cde2e7640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:45:33.808 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:33 smithi203 ceph-mon[35450]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:45:33.808 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:33 smithi203 ceph-mon[35450]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T08:45:33.808 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:33 smithi203 ceph-mon[35450]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T08:45:33.808 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:33 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:45:33.808 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:33 smithi203 ceph-mon[35450]: from='osd.2 [v2:172.21.15.203:6800/3358994623,v1:172.21.15.203:6801/3358994623]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:45:33.808 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:33 smithi203 ceph-mon[35450]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:45:33.808 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:33 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:33.809 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:33 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:33.809 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:33 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:45:33.809 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:33 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:33.809 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:33 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:45:33.809 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:33 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:45:33.809 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:33 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:33.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:33 smithi019 ceph-mon[30976]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:45:33.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:33 smithi019 ceph-mon[30976]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T08:45:33.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:33 smithi019 ceph-mon[30976]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T08:45:33.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:33 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:45:33.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:33 smithi019 ceph-mon[30976]: from='osd.2 [v2:172.21.15.203:6800/3358994623,v1:172.21.15.203:6801/3358994623]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:45:33.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:33 smithi019 ceph-mon[30976]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:45:33.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:33 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:33.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:33 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:33.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:33 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:45:33.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:33 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:33.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:33 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:45:33.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:33 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:45:33.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:33 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:33.824 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:45:33.861 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi019:vg_nvme/lv_3 2024-09-19T08:45:33.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:33 smithi155 ceph-mon[34921]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:45:33.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:33 smithi155 ceph-mon[34921]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T08:45:33.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:33 smithi155 ceph-mon[34921]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T08:45:33.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:33 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:45:33.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:33 smithi155 ceph-mon[34921]: from='osd.2 [v2:172.21.15.203:6800/3358994623,v1:172.21.15.203:6801/3358994623]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:45:33.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:33 smithi155 ceph-mon[34921]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:45:33.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:33 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:33.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:33 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:33.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:33 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:45:33.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:33 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:33.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:33 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:45:33.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:33 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:45:33.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:33 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:34.123 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:45:34.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.599+0000 7f02359fc640 1 -- 172.21.15.19:0/1628527139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0230107960 msgr2=0x7f0230109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:34.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.599+0000 7f02359fc640 1 --2- 172.21.15.19:0/1628527139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0230107960 0x7f0230109d50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0228009ca0 tx=0x7f022802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:45:34.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.599+0000 7f02359fc640 1 -- 172.21.15.19:0/1628527139 shutdown_connections 2024-09-19T08:45:34.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.599+0000 7f02359fc640 1 --2- 172.21.15.19:0/1628527139 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0230107960 0x7f0230109d50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:34.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.599+0000 7f02359fc640 1 --2- 172.21.15.19:0/1628527139 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0230105030 0x7f0230107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:34.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.599+0000 7f02359fc640 1 --2- 172.21.15.19:0/1628527139 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0230102700 0x7f0230104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:34.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.599+0000 7f02359fc640 1 -- 172.21.15.19:0/1628527139 >> 172.21.15.19:0/1628527139 conn(0x7f02300fc280 msgr2=0x7f02300fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:34.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.599+0000 7f02359fc640 1 -- 172.21.15.19:0/1628527139 shutdown_connections 2024-09-19T08:45:34.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.599+0000 7f02359fc640 1 -- 172.21.15.19:0/1628527139 wait complete. 2024-09-19T08:45:34.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.599+0000 7f02359fc640 1 Processor -- start 2024-09-19T08:45:34.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.600+0000 7f02359fc640 1 -- start start 2024-09-19T08:45:34.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.600+0000 7f02359fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0230102700 0x7f0230197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:34.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.600+0000 7f02359fc640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0230105030 0x7f02301983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:34.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.600+0000 7f02359fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0230107960 0x7f023019f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:34.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.600+0000 7f02359fc640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f023010d860 con 0x7f0230107960 2024-09-19T08:45:34.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.600+0000 7f02359fc640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f023010d6e0 con 0x7f0230102700 2024-09-19T08:45:34.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.600+0000 7f02359fc640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f023010d9e0 con 0x7f0230105030 2024-09-19T08:45:34.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.600+0000 7f022f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0230107960 0x7f023019f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:34.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.600+0000 7f022f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0230107960 0x7f023019f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53480/0 (socket says 172.21.15.19:53480) 2024-09-19T08:45:34.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.600+0000 7f022f7fe640 1 -- 172.21.15.19:0/938519892 learned_addr learned my addr 172.21.15.19:0/938519892 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:45:34.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.600+0000 7f022e7fc640 1 --2- 172.21.15.19:0/938519892 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0230105030 0x7f02301983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:34.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.600+0000 7f022effd640 1 --2- 172.21.15.19:0/938519892 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0230102700 0x7f0230197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:34.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.600+0000 7f022f7fe640 1 -- 172.21.15.19:0/938519892 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0230105030 msgr2=0x7f02301983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:34.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.600+0000 7f022f7fe640 1 --2- 172.21.15.19:0/938519892 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0230105030 0x7f02301983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:34.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.600+0000 7f022f7fe640 1 -- 172.21.15.19:0/938519892 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0230102700 msgr2=0x7f0230197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:34.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.600+0000 7f022f7fe640 1 --2- 172.21.15.19:0/938519892 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0230102700 0x7f0230197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:34.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.600+0000 7f022f7fe640 1 -- 172.21.15.19:0/938519892 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f023019fae0 con 0x7f0230107960 2024-09-19T08:45:34.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.600+0000 7f022e7fc640 1 --2- 172.21.15.19:0/938519892 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0230105030 0x7f02301983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:45:34.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.601+0000 7f022f7fe640 1 --2- 172.21.15.19:0/938519892 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0230107960 0x7f023019f470 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0228031ae0 tx=0x7f0228031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:34.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.601+0000 7f02349fa640 1 -- 172.21.15.19:0/938519892 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0228003b70 con 0x7f0230107960 2024-09-19T08:45:34.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.601+0000 7f02359fc640 1 -- 172.21.15.19:0/938519892 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f023019fd70 con 0x7f0230107960 2024-09-19T08:45:34.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.601+0000 7f02349fa640 1 -- 172.21.15.19:0/938519892 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0228003d10 con 0x7f0230107960 2024-09-19T08:45:34.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.601+0000 7f02349fa640 1 -- 172.21.15.19:0/938519892 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f022802fc40 con 0x7f0230107960 2024-09-19T08:45:34.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.601+0000 7f02359fc640 1 -- 172.21.15.19:0/938519892 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02301a0250 con 0x7f0230107960 2024-09-19T08:45:34.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.602+0000 7f02359fc640 1 -- 172.21.15.19:0/938519892 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02300fdd70 con 0x7f0230107960 2024-09-19T08:45:34.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.603+0000 7f02349fa640 1 -- 172.21.15.19:0/938519892 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f0228004050 con 0x7f0230107960 2024-09-19T08:45:34.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.604+0000 7f02349fa640 1 --2- 172.21.15.19:0/938519892 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f02180a31e0 0x7f02180a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:45:34.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.604+0000 7f022effd640 1 --2- 172.21.15.19:0/938519892 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f02180a31e0 0x7f02180a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:45:34.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.604+0000 7f02349fa640 1 -- 172.21.15.19:0/938519892 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2851+0+0 (secure 0 0 0) 0x7f02280ef420 con 0x7f0230107960 2024-09-19T08:45:34.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.604+0000 7f022effd640 1 --2- 172.21.15.19:0/938519892 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f02180a31e0 0x7f02180a56a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0220009bd0 tx=0x7f0220005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:45:34.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.608+0000 7f02349fa640 1 -- 172.21.15.19:0/938519892 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f02280bd890 con 0x7f0230107960 2024-09-19T08:45:34.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:34.793+0000 7f02359fc640 1 -- 172.21.15.19:0/938519892 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f0230062630 con 0x7f02180a31e0 2024-09-19T08:45:34.792 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:34 smithi019 ceph-mon[30976]: Detected new or changed devices on smithi203 2024-09-19T08:45:34.793 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:34 smithi019 ceph-mon[30976]: Adjusting osd_memory_target on smithi203 to 17088M 2024-09-19T08:45:34.793 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:34 smithi019 ceph-mon[30976]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-19T08:45:34.793 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:34 smithi019 ceph-mon[30976]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T08:45:34.793 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:34 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:45:34.793 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:34 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:45:34.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:34 smithi155 ceph-mon[34921]: Detected new or changed devices on smithi203 2024-09-19T08:45:34.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:34 smithi155 ceph-mon[34921]: Adjusting osd_memory_target on smithi203 to 17088M 2024-09-19T08:45:34.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:34 smithi155 ceph-mon[34921]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-19T08:45:34.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:34 smithi155 ceph-mon[34921]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T08:45:34.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:34 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:45:34.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:34 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:45:34.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:34 smithi203 ceph-mon[35450]: Detected new or changed devices on smithi203 2024-09-19T08:45:34.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:34 smithi203 ceph-mon[35450]: Adjusting osd_memory_target on smithi203 to 17088M 2024-09-19T08:45:34.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:34 smithi203 ceph-mon[35450]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-19T08:45:34.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:34 smithi203 ceph-mon[35450]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T08:45:34.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:34 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:45:34.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:34 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:45:35.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:35 smithi019 ceph-mon[30976]: purged_snaps scrub starts 2024-09-19T08:45:35.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:35 smithi019 ceph-mon[30976]: purged_snaps scrub ok 2024-09-19T08:45:35.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:35 smithi019 ceph-mon[30976]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:45:35.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:35 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:45:35.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:35 smithi019 ceph-mon[30976]: osd.2 [v2:172.21.15.203:6800/3358994623,v1:172.21.15.203:6801/3358994623] boot 2024-09-19T08:45:35.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:35 smithi019 ceph-mon[30976]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T08:45:35.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:35 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:45:35.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:35 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:45:35.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:35 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:45:35.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:35 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:45:35.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:35 smithi155 ceph-mon[34921]: purged_snaps scrub starts 2024-09-19T08:45:35.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:35 smithi155 ceph-mon[34921]: purged_snaps scrub ok 2024-09-19T08:45:35.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:35 smithi155 ceph-mon[34921]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:45:35.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:35 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:45:35.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:35 smithi155 ceph-mon[34921]: osd.2 [v2:172.21.15.203:6800/3358994623,v1:172.21.15.203:6801/3358994623] boot 2024-09-19T08:45:35.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:35 smithi155 ceph-mon[34921]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T08:45:35.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:35 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:45:35.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:35 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:45:35.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:35 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:45:35.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:35 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:45:35.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:35 smithi203 ceph-mon[35450]: purged_snaps scrub starts 2024-09-19T08:45:35.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:35 smithi203 ceph-mon[35450]: purged_snaps scrub ok 2024-09-19T08:45:35.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:35 smithi203 ceph-mon[35450]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-09-19T08:45:35.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:35 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:45:35.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:35 smithi203 ceph-mon[35450]: osd.2 [v2:172.21.15.203:6800/3358994623,v1:172.21.15.203:6801/3358994623] boot 2024-09-19T08:45:35.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:35 smithi203 ceph-mon[35450]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T08:45:35.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:35 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T08:45:35.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:35 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:45:35.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:35 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:45:35.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:35 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:45:36.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:36 smithi019 ceph-mon[30976]: from='client.14289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:45:36.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:36 smithi019 ceph-mon[30976]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T08:45:36.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:36 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:45:36.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:36 smithi155 ceph-mon[34921]: from='client.14289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:45:36.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:36 smithi155 ceph-mon[34921]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T08:45:36.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:36 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:45:36.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:36 smithi203 ceph-mon[35450]: from='client.14289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:45:36.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:36 smithi203 ceph-mon[35450]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T08:45:36.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:36 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:45:37.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:37 smithi019 ceph-mon[30976]: pgmap v76: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:45:37.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:37 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T08:45:37.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:37 smithi019 ceph-mon[30976]: osdmap e20: 3 total, 3 up, 3 in 2024-09-19T08:45:37.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:37 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:45:37.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:37 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1838462914' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8f46c16c-f17e-484a-8b66-6dbf135f34c3"}]: dispatch 2024-09-19T08:45:37.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:37 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T08:45:37.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:37 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1838462914' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8f46c16c-f17e-484a-8b66-6dbf135f34c3"}]': finished 2024-09-19T08:45:37.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:37 smithi019 ceph-mon[30976]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T08:45:37.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:37 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:45:37.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:37 smithi155 ceph-mon[34921]: pgmap v76: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:45:37.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:37 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T08:45:37.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:37 smithi155 ceph-mon[34921]: osdmap e20: 3 total, 3 up, 3 in 2024-09-19T08:45:37.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:37 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:45:37.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:37 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1838462914' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8f46c16c-f17e-484a-8b66-6dbf135f34c3"}]: dispatch 2024-09-19T08:45:37.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:37 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T08:45:37.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:37 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1838462914' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8f46c16c-f17e-484a-8b66-6dbf135f34c3"}]': finished 2024-09-19T08:45:37.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:37 smithi155 ceph-mon[34921]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T08:45:37.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:37 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:45:37.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:37 smithi203 ceph-mon[35450]: pgmap v76: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:45:37.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:37 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T08:45:37.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:37 smithi203 ceph-mon[35450]: osdmap e20: 3 total, 3 up, 3 in 2024-09-19T08:45:37.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:37 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T08:45:37.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:37 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1838462914' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8f46c16c-f17e-484a-8b66-6dbf135f34c3"}]: dispatch 2024-09-19T08:45:37.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:37 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T08:45:37.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:37 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1838462914' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8f46c16c-f17e-484a-8b66-6dbf135f34c3"}]': finished 2024-09-19T08:45:37.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:37 smithi203 ceph-mon[35450]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T08:45:37.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:37 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:45:38.309 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 19 08:45:37 smithi019 sudo[49300]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:45:38.309 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 19 08:45:37 smithi019 sudo[49300]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:45:38.309 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 19 08:45:37 smithi019 sudo[49300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:45:38.309 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 19 08:45:37 smithi019 sudo[49300]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:45:38.568 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 19 08:45:38 smithi019 sudo[49349]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:45:38.568 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 19 08:45:38 smithi019 sudo[49349]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:45:38.569 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 19 08:45:38 smithi019 sudo[49349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:45:38.569 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 19 08:45:38 smithi019 sudo[49349]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:45:38.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:38.619+0000 7f02349fa640 1 -- 172.21.15.19:0/938519892 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f02280b9800 con 0x7f0230107960 2024-09-19T08:45:38.834 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:38 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/172176400' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:45:38.835 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:38 smithi155 ceph-mon[34921]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T08:45:38.835 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:38 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:45:38.835 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:38 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:38.835 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 08:45:38 smithi155 sudo[43522]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:45:38.835 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 08:45:38 smithi155 sudo[43522]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:45:38.835 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 08:45:38 smithi155 sudo[43522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:45:38.835 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 08:45:38 smithi155 sudo[43522]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:45:38.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:38 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/172176400' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:45:38.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:38 smithi203 ceph-mon[35450]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T08:45:38.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:38 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:45:38.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:38 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:39.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:38 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/172176400' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:45:39.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:38 smithi019 ceph-mon[30976]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T08:45:39.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:38 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:45:39.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:38 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:39.172 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 08:45:38 smithi155 sudo[43525]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:45:39.173 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 08:45:38 smithi155 sudo[43525]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:45:39.173 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 08:45:38 smithi155 sudo[43525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:45:39.173 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 08:45:38 smithi155 sudo[43525]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:45:39.364 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 08:45:39 smithi203 sudo[44456]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:45:39.364 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 08:45:39 smithi203 sudo[44456]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:45:39.364 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 08:45:39 smithi203 sudo[44456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:45:39.364 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 08:45:39 smithi203 sudo[44456]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:45:39.732 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 08:45:39 smithi203 sudo[44459]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:45:39.732 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 08:45:39 smithi203 sudo[44459]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:45:39.732 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 08:45:39 smithi203 sudo[44459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:45:39.732 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 08:45:39 smithi203 sudo[44459]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:45:40.286 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:39 smithi019 sudo[49724]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:45:40.286 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:39 smithi019 sudo[49724]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:45:40.286 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:39 smithi019 sudo[49724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:45:40.286 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:39 smithi019 sudo[49724]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:45:40.550 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:40 smithi203 ceph-mon[35450]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:45:40.550 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:40 smithi203 ceph-mon[35450]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T08:45:40.550 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:40 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:40.550 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:40 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:40.550 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:40 smithi203 ceph-mon[35450]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:45:40.550 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:40 smithi203 sudo[44462]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:45:40.550 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:40 smithi203 sudo[44462]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:45:40.550 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:40 smithi203 sudo[44462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:45:40.550 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:40 smithi203 sudo[44462]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:45:40.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:40 smithi019 sudo[49730]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:45:40.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:40 smithi019 sudo[49730]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:45:40.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:40 smithi019 sudo[49730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:45:40.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:40 smithi019 sudo[49730]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:45:40.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:40 smithi019 ceph-mon[30976]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:45:40.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:40 smithi019 ceph-mon[30976]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T08:45:40.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:40 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:40.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:40 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:40.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:40 smithi019 ceph-mon[30976]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:45:40.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:40 smithi155 ceph-mon[34921]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:45:40.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:40 smithi155 ceph-mon[34921]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T08:45:40.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:40 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:40.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:40 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:40.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:40 smithi155 ceph-mon[34921]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:45:40.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:40 smithi203 sudo[44465]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:45:40.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:40 smithi203 sudo[44465]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:45:40.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:40 smithi203 sudo[44465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:45:40.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:40 smithi203 sudo[44465]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:45:41.287 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:41 smithi155 sudo[43528]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T08:45:41.287 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:41 smithi155 sudo[43528]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:45:41.287 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:41 smithi155 sudo[43528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:45:41.288 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:41 smithi155 sudo[43528]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:45:41.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:41 smithi019 ceph-mon[30976]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:45:41.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:41 smithi019 ceph-mon[30976]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:45:41.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:41 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:45:41.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:41 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:45:41.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:41 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:45:41.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:41 smithi019 ceph-mon[30976]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:45:41.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:41 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:45:41.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:41 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:45:41.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:41 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:45:41.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:41 smithi019 ceph-mon[30976]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:45:41.570 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:41 smithi019 ceph-mon[30976]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:45:41.570 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:41 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:45:41.570 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:41 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:45:41.570 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:41 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:45:41.570 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:41 smithi019 ceph-mon[30976]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:45:41.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:41 smithi155 sudo[43531]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T08:45:41.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:41 smithi155 sudo[43531]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T08:45:41.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:41 smithi155 sudo[43531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T08:45:41.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:41 smithi155 sudo[43531]: pam_unix(sudo:session): session closed for user root 2024-09-19T08:45:41.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:41 smithi155 ceph-mon[34921]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:45:41.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:41 smithi155 ceph-mon[34921]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:45:41.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:41 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:45:41.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:41 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:45:41.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:41 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:45:41.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:41 smithi155 ceph-mon[34921]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:45:41.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:41 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:45:41.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:41 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:45:41.674 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:41 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:45:41.674 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:41 smithi155 ceph-mon[34921]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:45:41.674 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:41 smithi155 ceph-mon[34921]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:45:41.674 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:41 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:45:41.674 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:41 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:45:41.674 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:41 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:45:41.674 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:41 smithi155 ceph-mon[34921]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:45:41.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:41 smithi203 ceph-mon[35450]: pgmap v81: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:45:41.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:41 smithi203 ceph-mon[35450]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:45:41.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:41 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:45:41.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:41 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:45:41.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:41 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:45:41.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:41 smithi203 ceph-mon[35450]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:45:41.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:41 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:45:41.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:41 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:45:41.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:41 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:45:41.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:41 smithi203 ceph-mon[35450]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:45:41.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:41 smithi203 ceph-mon[35450]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T08:45:41.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:41 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T08:45:41.733 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:41 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T08:45:41.733 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:41 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T08:45:41.733 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:41 smithi203 ceph-mon[35450]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T08:45:43.564 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:43 smithi155 ceph-mon[34921]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:45:43.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:43 smithi019 ceph-mon[30976]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:45:43.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:43 smithi203 ceph-mon[35450]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:45:45.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:45 smithi019 ceph-mon[30976]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:45:45.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:45 smithi155 ceph-mon[34921]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:45:45.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:45 smithi203 ceph-mon[35450]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:45:46.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:46 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T08:45:46.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:46 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:45:46.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:46 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T08:45:46.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:46 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:45:46.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:46 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T08:45:46.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:46 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:45:47.402 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:47 smithi019 ceph-mon[30976]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:45:47.402 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:47 smithi019 ceph-mon[30976]: Deploying daemon osd.3 on smithi019 2024-09-19T08:45:47.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:47 smithi155 ceph-mon[34921]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:45:47.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:47 smithi155 ceph-mon[34921]: Deploying daemon osd.3 on smithi019 2024-09-19T08:45:47.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:47 smithi203 ceph-mon[35450]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:45:47.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:47 smithi203 ceph-mon[35450]: Deploying daemon osd.3 on smithi019 2024-09-19T08:45:49.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:49 smithi019 ceph-mon[30976]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:45:49.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:49 smithi155 ceph-mon[34921]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:45:49.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:49 smithi203 ceph-mon[35450]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:45:51.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:51 smithi155 ceph-mon[34921]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:45:51.676 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:51 smithi019 ceph-mon[30976]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:45:51.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:51 smithi203 ceph-mon[35450]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:45:53.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:53 smithi019 ceph-mon[30976]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:45:53.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:53 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:45:53.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:53 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:53.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:53 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:53.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:53 smithi155 ceph-mon[34921]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:45:53.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:53 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:45:53.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:53 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:53.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:53 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:53.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:53 smithi203 ceph-mon[35450]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:45:53.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:53 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:45:53.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:53 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:53.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:53 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:55.677 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:55 smithi155 ceph-mon[34921]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:45:55.677 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:55 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:55.677 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:55 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:55.677 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:55 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:45:55.677 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:55 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:45:55.677 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:55 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:55.721 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:55 smithi019 ceph-mon[30976]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:45:55.721 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:55 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:55.721 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:55 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:55.721 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:55 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:45:55.721 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:55 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:45:55.721 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:55 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:55.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:55 smithi203 ceph-mon[35450]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:45:55.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:55 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:55.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:55 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:55.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:55 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:45:55.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:55 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:45:55.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:55 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:56.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:56.403+0000 7f02349fa640 1 -- 172.21.15.19:0/938519892 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f0230062630 con 0x7f02180a31e0 2024-09-19T08:45:56.404 INFO:teuthology.orchestra.run.smithi019.stdout:Created osd(s) 3 on host 'smithi019' 2024-09-19T08:45:56.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:56.406+0000 7f02359fc640 1 -- 172.21.15.19:0/938519892 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f02180a31e0 msgr2=0x7f02180a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:56.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:56.406+0000 7f02359fc640 1 --2- 172.21.15.19:0/938519892 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f02180a31e0 0x7f02180a56a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0220009bd0 tx=0x7f0220005f90 comp rx=0 tx=0).stop 2024-09-19T08:45:56.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:56.406+0000 7f02359fc640 1 -- 172.21.15.19:0/938519892 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0230107960 msgr2=0x7f023019f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:45:56.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:56.406+0000 7f02359fc640 1 --2- 172.21.15.19:0/938519892 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0230107960 0x7f023019f470 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f0228031ae0 tx=0x7f0228031ee0 comp rx=0 tx=0).stop 2024-09-19T08:45:56.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:56.406+0000 7f02359fc640 1 -- 172.21.15.19:0/938519892 shutdown_connections 2024-09-19T08:45:56.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:56.406+0000 7f02359fc640 1 --2- 172.21.15.19:0/938519892 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f02180a31e0 0x7f02180a56a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:56.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:56.406+0000 7f02359fc640 1 --2- 172.21.15.19:0/938519892 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0230105030 0x7f02301983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:56.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:56.406+0000 7f02359fc640 1 --2- 172.21.15.19:0/938519892 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0230107960 0x7f023019f470 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:56.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:56.406+0000 7f02359fc640 1 --2- 172.21.15.19:0/938519892 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0230102700 0x7f0230197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:45:56.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:56.406+0000 7f02359fc640 1 -- 172.21.15.19:0/938519892 >> 172.21.15.19:0/938519892 conn(0x7f02300fc280 msgr2=0x7f0230102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:45:56.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:56.406+0000 7f02359fc640 1 -- 172.21.15.19:0/938519892 shutdown_connections 2024-09-19T08:45:56.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:45:56.406+0000 7f02359fc640 1 -- 172.21.15.19:0/938519892 wait complete. 2024-09-19T08:45:57.082 DEBUG:teuthology.orchestra.run.smithi019:osd.3> sudo journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@osd.3.service 2024-09-19T08:45:57.085 INFO:tasks.cephadm:Deploying osd.4 on smithi155 with /dev/vg_nvme/lv_3... 2024-09-19T08:45:57.085 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T08:45:57.340 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:45:57.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:57 smithi155 ceph-mon[34921]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:45:57.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:57 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:45:57.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:57 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:57.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:57 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:57.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:57 smithi203 ceph-mon[35450]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:45:57.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:57 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:45:57.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:57 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:57.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:57 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:57.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:57 smithi019 ceph-mon[30976]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:45:57.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:57 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:45:57.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:57 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:57.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:57 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:45:58.513 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 19 08:45:58 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-3[51303]: 2024-09-19T08:45:58.399+0000 7f774e4e0640 -1 osd.3 0 log_to_monitors true 2024-09-19T08:45:59.450 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:59 smithi155 ceph-mon[34921]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:45:59.450 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:45:59 smithi155 ceph-mon[34921]: from='osd.3 [v2:172.21.15.19:6810/176445576,v1:172.21.15.19:6811/176445576]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T08:45:59.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:59 smithi019 ceph-mon[30976]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:45:59.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:45:59 smithi019 ceph-mon[30976]: from='osd.3 [v2:172.21.15.19:6810/176445576,v1:172.21.15.19:6811/176445576]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T08:45:59.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:59 smithi203 ceph-mon[35450]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:45:59.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:45:59 smithi203 ceph-mon[35450]: from='osd.3 [v2:172.21.15.19:6810/176445576,v1:172.21.15.19:6811/176445576]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T08:46:00.071 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T08:46:00.097 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi155:vg_nvme/lv_3 2024-09-19T08:46:00.343 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:00 smithi155 ceph-mon[34921]: from='osd.3 [v2:172.21.15.19:6810/176445576,v1:172.21.15.19:6811/176445576]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T08:46:00.344 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:00 smithi155 ceph-mon[34921]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T08:46:00.344 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:00 smithi155 ceph-mon[34921]: from='osd.3 [v2:172.21.15.19:6810/176445576,v1:172.21.15.19:6811/176445576]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]: dispatch 2024-09-19T08:46:00.344 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:00 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:46:00.344 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:00 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:00.344 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:00 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:00.344 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:00 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:46:00.344 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:00 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:46:00.344 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:00 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:00.344 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:00 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:46:00.344 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:00 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:46:00.344 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:00 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:00.345 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:46:00.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:00 smithi203 ceph-mon[35450]: from='osd.3 [v2:172.21.15.19:6810/176445576,v1:172.21.15.19:6811/176445576]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T08:46:00.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:00 smithi203 ceph-mon[35450]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T08:46:00.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:00 smithi203 ceph-mon[35450]: from='osd.3 [v2:172.21.15.19:6810/176445576,v1:172.21.15.19:6811/176445576]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]: dispatch 2024-09-19T08:46:00.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:00 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:46:00.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:00 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:00.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:00 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:00.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:00 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:46:00.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:00 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:46:00.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:00 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:00.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:00 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:46:00.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:00 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:46:00.733 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:00 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:00.781 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:00 smithi019 ceph-mon[30976]: from='osd.3 [v2:172.21.15.19:6810/176445576,v1:172.21.15.19:6811/176445576]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T08:46:00.781 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:00 smithi019 ceph-mon[30976]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T08:46:00.782 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:00 smithi019 ceph-mon[30976]: from='osd.3 [v2:172.21.15.19:6810/176445576,v1:172.21.15.19:6811/176445576]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]: dispatch 2024-09-19T08:46:00.782 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:00 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:46:00.782 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:00 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:00.782 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:00 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:00.782 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:00 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:46:00.782 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:00 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:46:00.782 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:00 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:00.782 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:00 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:46:00.782 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:00 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:46:00.782 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:00 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:00.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.797+0000 7f3afcb13640 1 -- 172.21.15.155:0/1165369313 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3af81026d0 msgr2=0x7f3af8108f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:00.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.797+0000 7f3afcb13640 1 --2- 172.21.15.155:0/1165369313 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3af81026d0 0x7f3af8108f60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3af0009ca0 tx=0x7f3af002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:46:00.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.797+0000 7f3afcb13640 1 -- 172.21.15.155:0/1165369313 shutdown_connections 2024-09-19T08:46:00.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.797+0000 7f3afcb13640 1 --2- 172.21.15.155:0/1165369313 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3af8101d10 0x7f3af8102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:00.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.797+0000 7f3afcb13640 1 --2- 172.21.15.155:0/1165369313 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3af81026d0 0x7f3af8108f60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:00.821 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.797+0000 7f3afcb13640 1 --2- 172.21.15.155:0/1165369313 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3af8100b10 0x7f3af8100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:00.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.797+0000 7f3afcb13640 1 -- 172.21.15.155:0/1165369313 >> 172.21.15.155:0/1165369313 conn(0x7f3af80fc2a0 msgr2=0x7f3af80fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:00.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.797+0000 7f3afcb13640 1 -- 172.21.15.155:0/1165369313 shutdown_connections 2024-09-19T08:46:00.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.797+0000 7f3afcb13640 1 -- 172.21.15.155:0/1165369313 wait complete. 2024-09-19T08:46:00.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.798+0000 7f3afcb13640 1 Processor -- start 2024-09-19T08:46:00.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.798+0000 7f3afcb13640 1 -- start start 2024-09-19T08:46:00.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.798+0000 7f3afcb13640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3af8100b10 0x7f3af810b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:00.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.798+0000 7f3afcb13640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3af8101d10 0x7f3af8109ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:00.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.798+0000 7f3afcb13640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3af81026d0 0x7f3af810a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:00.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.798+0000 7f3afcb13640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3af810d920 con 0x7f3af8100b10 2024-09-19T08:46:00.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.798+0000 7f3afcb13640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3af810d7a0 con 0x7f3af8101d10 2024-09-19T08:46:00.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.798+0000 7f3afcb13640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3af810daa0 con 0x7f3af81026d0 2024-09-19T08:46:00.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.798+0000 7f3af5d9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3af8101d10 0x7f3af8109ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:00.822 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.798+0000 7f3af5d9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3af8101d10 0x7f3af8109ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:44004/0 (socket says 172.21.15.155:44004) 2024-09-19T08:46:00.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.798+0000 7f3af5d9b640 1 -- 172.21.15.155:0/548304374 learned_addr learned my addr 172.21.15.155:0/548304374 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-19T08:46:00.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.798+0000 7f3af659c640 1 --2- 172.21.15.155:0/548304374 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3af8100b10 0x7f3af810b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:00.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.798+0000 7f3af6d9d640 1 --2- 172.21.15.155:0/548304374 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3af81026d0 0x7f3af810a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:00.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.798+0000 7f3af5d9b640 1 -- 172.21.15.155:0/548304374 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3af81026d0 msgr2=0x7f3af810a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:00.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.798+0000 7f3af5d9b640 1 --2- 172.21.15.155:0/548304374 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3af81026d0 0x7f3af810a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:00.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.798+0000 7f3af5d9b640 1 -- 172.21.15.155:0/548304374 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3af8100b10 msgr2=0x7f3af810b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:00.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.798+0000 7f3af5d9b640 1 --2- 172.21.15.155:0/548304374 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3af8100b10 0x7f3af810b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:00.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.798+0000 7f3af5d9b640 1 -- 172.21.15.155:0/548304374 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3af810a8e0 con 0x7f3af8101d10 2024-09-19T08:46:00.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.799+0000 7f3af5d9b640 1 --2- 172.21.15.155:0/548304374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3af8101d10 0x7f3af8109ae0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3ae800d770 tx=0x7f3ae800dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:00.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.799+0000 7f3aef7fe640 1 -- 172.21.15.155:0/548304374 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae8017070 con 0x7f3af8101d10 2024-09-19T08:46:00.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.799+0000 7f3aef7fe640 1 -- 172.21.15.155:0/548304374 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3ae8005500 con 0x7f3af8101d10 2024-09-19T08:46:00.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.799+0000 7f3afcb13640 1 -- 172.21.15.155:0/548304374 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3af81a1fd0 con 0x7f3af8101d10 2024-09-19T08:46:00.823 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.799+0000 7f3aef7fe640 1 -- 172.21.15.155:0/548304374 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ae8004e00 con 0x7f3af8101d10 2024-09-19T08:46:00.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.799+0000 7f3afcb13640 1 -- 172.21.15.155:0/548304374 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3af81a2430 con 0x7f3af8101d10 2024-09-19T08:46:00.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.800+0000 7f3afcb13640 1 -- 172.21.15.155:0/548304374 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3af8107ec0 con 0x7f3af8101d10 2024-09-19T08:46:00.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.801+0000 7f3aef7fe640 1 -- 172.21.15.155:0/548304374 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f3ae8004fa0 con 0x7f3af8101d10 2024-09-19T08:46:00.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.802+0000 7f3aef7fe640 1 --2- 172.21.15.155:0/548304374 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3ae40a3240 0x7f3ae40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:00.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.802+0000 7f3aef7fe640 1 -- 172.21.15.155:0/548304374 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 3389+0+0 (secure 0 0 0) 0x7f3ae80ce000 con 0x7f3af8101d10 2024-09-19T08:46:00.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.802+0000 7f3af659c640 1 --2- 172.21.15.155:0/548304374 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3ae40a3240 0x7f3ae40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:00.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.802+0000 7f3af659c640 1 --2- 172.21.15.155:0/548304374 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3ae40a3240 0x7f3ae40a5700 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3af8101b70 tx=0x7f3ae000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:00.824 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.806+0000 7f3aef7fe640 1 -- 172.21.15.155:0/548304374 <== mon.2 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3ae809c060 con 0x7f3af8101d10 2024-09-19T08:46:00.982 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:00.982+0000 7f3afcb13640 1 -- 172.21.15.155:0/548304374 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f3af8062630 con 0x7f3ae40a3240 2024-09-19T08:46:01.068 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 19 08:46:00 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-3[51303]: 2024-09-19T08:46:00.780+0000 7f774ac77640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T08:46:01.068 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 19 08:46:00 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-3[51303]: 2024-09-19T08:46:00.786+0000 7f7742283640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:46:01.633 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:01 smithi203 ceph-mon[35450]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:46:01.633 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:01 smithi203 ceph-mon[35450]: Detected new or changed devices on smithi019 2024-09-19T08:46:01.633 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:01 smithi203 ceph-mon[35450]: Adjusting osd_memory_target on smithi019 to 8546M 2024-09-19T08:46:01.633 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:01 smithi203 ceph-mon[35450]: from='osd.3 [v2:172.21.15.19:6810/176445576,v1:172.21.15.19:6811/176445576]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-09-19T08:46:01.633 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:01 smithi203 ceph-mon[35450]: osdmap e24: 4 total, 3 up, 4 in 2024-09-19T08:46:01.633 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:01 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:46:01.634 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:01 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:46:01.634 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:01 smithi203 ceph-mon[35450]: from='osd.3 [v2:172.21.15.19:6810/176445576,v1:172.21.15.19:6811/176445576]' entity='osd.3' 2024-09-19T08:46:01.634 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:01 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:46:01.634 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:01 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:46:01.634 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:01 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:46:01.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:01 smithi155 ceph-mon[34921]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:46:01.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:01 smithi155 ceph-mon[34921]: Detected new or changed devices on smithi019 2024-09-19T08:46:01.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:01 smithi155 ceph-mon[34921]: Adjusting osd_memory_target on smithi019 to 8546M 2024-09-19T08:46:01.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:01 smithi155 ceph-mon[34921]: from='osd.3 [v2:172.21.15.19:6810/176445576,v1:172.21.15.19:6811/176445576]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-09-19T08:46:01.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:01 smithi155 ceph-mon[34921]: osdmap e24: 4 total, 3 up, 4 in 2024-09-19T08:46:01.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:01 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:46:01.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:01 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:46:01.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:01 smithi155 ceph-mon[34921]: from='osd.3 [v2:172.21.15.19:6810/176445576,v1:172.21.15.19:6811/176445576]' entity='osd.3' 2024-09-19T08:46:01.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:01 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:46:01.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:01 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:46:01.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:01 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:46:01.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:01 smithi019 ceph-mon[30976]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2024-09-19T08:46:01.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:01 smithi019 ceph-mon[30976]: Detected new or changed devices on smithi019 2024-09-19T08:46:01.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:01 smithi019 ceph-mon[30976]: Adjusting osd_memory_target on smithi019 to 8546M 2024-09-19T08:46:01.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:01 smithi019 ceph-mon[30976]: from='osd.3 [v2:172.21.15.19:6810/176445576,v1:172.21.15.19:6811/176445576]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-09-19T08:46:01.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:01 smithi019 ceph-mon[30976]: osdmap e24: 4 total, 3 up, 4 in 2024-09-19T08:46:01.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:01 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:46:01.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:01 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:46:01.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:01 smithi019 ceph-mon[30976]: from='osd.3 [v2:172.21.15.19:6810/176445576,v1:172.21.15.19:6811/176445576]' entity='osd.3' 2024-09-19T08:46:01.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:01 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:46:01.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:01 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:46:01.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:01 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:46:02.647 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:02 smithi155 ceph-mon[34921]: purged_snaps scrub starts 2024-09-19T08:46:02.647 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:02 smithi155 ceph-mon[34921]: purged_snaps scrub ok 2024-09-19T08:46:02.647 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:02 smithi155 ceph-mon[34921]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:46:02.647 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:02 smithi155 ceph-mon[34921]: osd.3 [v2:172.21.15.19:6810/176445576,v1:172.21.15.19:6811/176445576] boot 2024-09-19T08:46:02.647 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:02 smithi155 ceph-mon[34921]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T08:46:02.647 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:02 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:46:02.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:02 smithi203 ceph-mon[35450]: purged_snaps scrub starts 2024-09-19T08:46:02.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:02 smithi203 ceph-mon[35450]: purged_snaps scrub ok 2024-09-19T08:46:02.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:02 smithi203 ceph-mon[35450]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:46:02.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:02 smithi203 ceph-mon[35450]: osd.3 [v2:172.21.15.19:6810/176445576,v1:172.21.15.19:6811/176445576] boot 2024-09-19T08:46:02.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:02 smithi203 ceph-mon[35450]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T08:46:02.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:02 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:46:02.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:02 smithi019 ceph-mon[30976]: purged_snaps scrub starts 2024-09-19T08:46:02.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:02 smithi019 ceph-mon[30976]: purged_snaps scrub ok 2024-09-19T08:46:02.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:02 smithi019 ceph-mon[30976]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:46:02.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:02 smithi019 ceph-mon[30976]: osd.3 [v2:172.21.15.19:6810/176445576,v1:172.21.15.19:6811/176445576] boot 2024-09-19T08:46:02.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:02 smithi019 ceph-mon[30976]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T08:46:02.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:02 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T08:46:03.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:03 smithi155 ceph-mon[34921]: pgmap v95: 1 pgs: 1 remapped+peering; 577 KiB data, 114 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:46:03.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:03 smithi155 ceph-mon[34921]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T08:46:03.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:03 smithi155 ceph-mon[34921]: from='client.? 172.21.15.155:0/3151018578' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "411b0423-1317-4e82-bc01-b5f55b391bc7"}]: dispatch 2024-09-19T08:46:03.614 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:03 smithi155 ceph-mon[34921]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "411b0423-1317-4e82-bc01-b5f55b391bc7"}]: dispatch 2024-09-19T08:46:03.615 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:03 smithi155 ceph-mon[34921]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "411b0423-1317-4e82-bc01-b5f55b391bc7"}]': finished 2024-09-19T08:46:03.615 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:03 smithi155 ceph-mon[34921]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T08:46:03.615 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:03 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:46:03.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:03 smithi203 ceph-mon[35450]: pgmap v95: 1 pgs: 1 remapped+peering; 577 KiB data, 114 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:46:03.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:03 smithi203 ceph-mon[35450]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T08:46:03.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:03 smithi203 ceph-mon[35450]: from='client.? 172.21.15.155:0/3151018578' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "411b0423-1317-4e82-bc01-b5f55b391bc7"}]: dispatch 2024-09-19T08:46:03.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:03 smithi203 ceph-mon[35450]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "411b0423-1317-4e82-bc01-b5f55b391bc7"}]: dispatch 2024-09-19T08:46:03.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:03 smithi203 ceph-mon[35450]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "411b0423-1317-4e82-bc01-b5f55b391bc7"}]': finished 2024-09-19T08:46:03.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:03 smithi203 ceph-mon[35450]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T08:46:03.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:03 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:46:03.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:03 smithi019 ceph-mon[30976]: pgmap v95: 1 pgs: 1 remapped+peering; 577 KiB data, 114 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:46:03.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:03 smithi019 ceph-mon[30976]: osdmap e26: 4 total, 4 up, 4 in 2024-09-19T08:46:03.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:03 smithi019 ceph-mon[30976]: from='client.? 172.21.15.155:0/3151018578' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "411b0423-1317-4e82-bc01-b5f55b391bc7"}]: dispatch 2024-09-19T08:46:03.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:03 smithi019 ceph-mon[30976]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "411b0423-1317-4e82-bc01-b5f55b391bc7"}]: dispatch 2024-09-19T08:46:03.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:03 smithi019 ceph-mon[30976]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "411b0423-1317-4e82-bc01-b5f55b391bc7"}]': finished 2024-09-19T08:46:03.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:03 smithi019 ceph-mon[30976]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T08:46:03.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:03 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:46:04.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:04 smithi155 ceph-mon[34921]: from='client.? 172.21.15.155:0/261620722' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:46:04.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:04 smithi203 ceph-mon[35450]: from='client.? 172.21.15.155:0/261620722' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:46:04.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:04 smithi019 ceph-mon[30976]: from='client.? 172.21.15.155:0/261620722' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:46:05.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:05 smithi155 ceph-mon[34921]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 114 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:46:05.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:05 smithi155 ceph-mon[34921]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T08:46:05.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:05 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:46:05.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:05 smithi203 ceph-mon[35450]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 114 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:46:05.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:05 smithi203 ceph-mon[35450]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T08:46:05.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:05 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:46:05.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:05 smithi019 ceph-mon[30976]: pgmap v98: 1 pgs: 1 remapped+peering; 577 KiB data, 114 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:46:05.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:05 smithi019 ceph-mon[30976]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T08:46:05.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:05 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:46:06.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:06 smithi155 ceph-mon[34921]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T08:46:06.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:06 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:46:06.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:06 smithi203 ceph-mon[35450]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T08:46:06.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:06 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:46:06.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:06 smithi019 ceph-mon[30976]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T08:46:06.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:06 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:46:07.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:07 smithi155 ceph-mon[34921]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 114 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:46:07.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:07 smithi203 ceph-mon[35450]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 114 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:46:07.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:07 smithi019 ceph-mon[30976]: pgmap v101: 1 pgs: 1 remapped+peering; 577 KiB data, 114 MiB used, 357 GiB / 358 GiB avail 2024-09-19T08:46:09.658 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:09 smithi155 ceph-mon[34921]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-19T08:46:09.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:09 smithi203 ceph-mon[35450]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-19T08:46:09.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:09 smithi019 ceph-mon[30976]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-09-19T08:46:11.671 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:11 smithi155 ceph-mon[34921]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-19T08:46:11.671 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:11 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T08:46:11.671 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:11 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:46:11.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:11 smithi203 ceph-mon[35450]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-19T08:46:11.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:11 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T08:46:11.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:11 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:46:11.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:11 smithi019 ceph-mon[30976]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-19T08:46:11.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:11 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T08:46:11.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:11 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:46:12.644 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:12 smithi155 ceph-mon[34921]: Deploying daemon osd.4 on smithi155 2024-09-19T08:46:12.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:12 smithi203 ceph-mon[35450]: Deploying daemon osd.4 on smithi155 2024-09-19T08:46:12.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:12 smithi019 ceph-mon[30976]: Deploying daemon osd.4 on smithi155 2024-09-19T08:46:13.617 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:13 smithi155 ceph-mon[34921]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:46:13.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:13 smithi203 ceph-mon[35450]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:46:13.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:13 smithi019 ceph-mon[30976]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T08:46:15.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:15 smithi155 ceph-mon[34921]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-19T08:46:15.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:15 smithi203 ceph-mon[35450]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-19T08:46:15.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:15 smithi019 ceph-mon[30976]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-19T08:46:17.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:17 smithi155 ceph-mon[34921]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-19T08:46:17.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:17 smithi203 ceph-mon[35450]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-19T08:46:17.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:17 smithi019 ceph-mon[30976]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-19T08:46:18.627 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:18 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:46:18.627 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:18 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:18.627 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:18 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:18.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:18 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:46:18.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:18 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:18.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:18 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:18.821 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:18 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:46:18.822 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:18 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:18.822 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:18 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:19.800 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:19 smithi155 ceph-mon[34921]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:46:19.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:19 smithi019 ceph-mon[30976]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:46:19.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:19 smithi203 ceph-mon[35450]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:46:20.904 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:20.904+0000 7f3aef7fe640 1 -- 172.21.15.155:0/548304374 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3af8062630 con 0x7f3ae40a3240 2024-09-19T08:46:20.905 INFO:teuthology.orchestra.run.smithi155.stdout:Created osd(s) 4 on host 'smithi155' 2024-09-19T08:46:20.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:20.906+0000 7f3afcb13640 1 -- 172.21.15.155:0/548304374 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3ae40a3240 msgr2=0x7f3ae40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:20.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:20.906+0000 7f3afcb13640 1 --2- 172.21.15.155:0/548304374 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3ae40a3240 0x7f3ae40a5700 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3af8101b70 tx=0x7f3ae000b390 comp rx=0 tx=0).stop 2024-09-19T08:46:20.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:20.906+0000 7f3afcb13640 1 -- 172.21.15.155:0/548304374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3af8101d10 msgr2=0x7f3af8109ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:20.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:20.906+0000 7f3afcb13640 1 --2- 172.21.15.155:0/548304374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3af8101d10 0x7f3af8109ae0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3ae800d770 tx=0x7f3ae800dc30 comp rx=0 tx=0).stop 2024-09-19T08:46:20.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:20.906+0000 7f3afcb13640 1 -- 172.21.15.155:0/548304374 shutdown_connections 2024-09-19T08:46:20.908 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:20.906+0000 7f3afcb13640 1 --2- 172.21.15.155:0/548304374 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3ae40a3240 0x7f3ae40a5700 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:20.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:20.906+0000 7f3afcb13640 1 --2- 172.21.15.155:0/548304374 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3af81026d0 0x7f3af810a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:20.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:20.906+0000 7f3afcb13640 1 --2- 172.21.15.155:0/548304374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3af8101d10 0x7f3af8109ae0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:20.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:20.906+0000 7f3afcb13640 1 --2- 172.21.15.155:0/548304374 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3af8100b10 0x7f3af810b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:20.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:20.906+0000 7f3afcb13640 1 -- 172.21.15.155:0/548304374 >> 172.21.15.155:0/548304374 conn(0x7f3af80fc2a0 msgr2=0x7f3af8105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:20.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:20.906+0000 7f3afcb13640 1 -- 172.21.15.155:0/548304374 shutdown_connections 2024-09-19T08:46:20.909 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:46:20.906+0000 7f3afcb13640 1 -- 172.21.15.155:0/548304374 wait complete. 2024-09-19T08:46:21.565 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:21 smithi155 ceph-mon[34921]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-19T08:46:21.565 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:21 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:21.566 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:21 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:21.593 DEBUG:teuthology.orchestra.run.smithi155:osd.4> sudo journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@osd.4.service 2024-09-19T08:46:21.596 INFO:tasks.cephadm:Deploying osd.5 on smithi203 with /dev/vg_nvme/lv_3... 2024-09-19T08:46:21.596 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T08:46:21.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:21 smithi019 ceph-mon[30976]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-19T08:46:21.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:21 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:21.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:21 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:21.850 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:46:21.965 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:21 smithi203 ceph-mon[35450]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-19T08:46:21.965 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:21 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:21.965 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:21 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:22.913 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:22 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:22.914 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:22 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:23.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:22 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:23.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:22 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:23.121 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:22 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:23.122 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:22 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:23.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:23 smithi203 ceph-mon[35450]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-19T08:46:24.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:23 smithi019 ceph-mon[30976]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-19T08:46:24.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:23 smithi155 ceph-mon[34921]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-19T08:46:24.173 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 08:46:23 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-4[46282]: 2024-09-19T08:46:23.789+0000 7f6449a2a640 -1 osd.4 0 log_to_monitors true 2024-09-19T08:46:24.224 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T08:46:24.250 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi203:vg_nvme/lv_3 2024-09-19T08:46:24.500 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:46:24.858 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:24 smithi203 ceph-mon[35450]: from='osd.4 [v2:172.21.15.155:6808/2163087792,v1:172.21.15.155:6809/2163087792]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:46:24.858 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:24 smithi203 ceph-mon[35450]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:46:24.904 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:24 smithi155 ceph-mon[34921]: from='osd.4 [v2:172.21.15.155:6808/2163087792,v1:172.21.15.155:6809/2163087792]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:46:24.904 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:24 smithi155 ceph-mon[34921]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:46:24.962 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.946+0000 7fa54fe23640 1 -- 172.21.15.203:0/3818504896 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa548105790 msgr2=0x7fa548105c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:24.962 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.946+0000 7fa54fe23640 1 --2- 172.21.15.203:0/3818504896 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa548105790 0x7fa548105c40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa540009ca0 tx=0x7fa54002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:46:24.962 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.946+0000 7fa54fe23640 1 -- 172.21.15.203:0/3818504896 shutdown_connections 2024-09-19T08:46:24.962 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.946+0000 7fa54fe23640 1 --2- 172.21.15.203:0/3818504896 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa548105790 0x7fa548105c40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:24.962 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.946+0000 7fa54fe23640 1 --2- 172.21.15.203:0/3818504896 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa548102de0 0x7fa548105250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:24.962 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.946+0000 7fa54fe23640 1 --2- 172.21.15.203:0/3818504896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa548100490 0x7fa5481028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:24.963 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.946+0000 7fa54fe23640 1 -- 172.21.15.203:0/3818504896 >> 172.21.15.203:0/3818504896 conn(0x7fa5480fc2a0 msgr2=0x7fa5480fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:24.963 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.946+0000 7fa54fe23640 1 -- 172.21.15.203:0/3818504896 shutdown_connections 2024-09-19T08:46:24.963 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.946+0000 7fa54fe23640 1 -- 172.21.15.203:0/3818504896 wait complete. 2024-09-19T08:46:24.963 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.947+0000 7fa54fe23640 1 Processor -- start 2024-09-19T08:46:24.963 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.947+0000 7fa54fe23640 1 -- start start 2024-09-19T08:46:24.963 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.947+0000 7fa54fe23640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa548100490 0x7fa54819e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:24.963 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.947+0000 7fa54fe23640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa548102de0 0x7fa54819e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:24.963 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.947+0000 7fa54fe23640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa548105790 0x7fa5481a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:24.963 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.947+0000 7fa54fe23640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa548113ea0 con 0x7fa548102de0 2024-09-19T08:46:24.963 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.947+0000 7fa54fe23640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa548113d20 con 0x7fa548100490 2024-09-19T08:46:24.963 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.947+0000 7fa54fe23640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa548114020 con 0x7fa548105790 2024-09-19T08:46:24.963 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.947+0000 7fa54e3c0640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa548105790 0x7fa5481a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:24.964 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.947+0000 7fa54e3c0640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa548105790 0x7fa5481a59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:55550/0 (socket says 172.21.15.203:55550) 2024-09-19T08:46:24.964 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.947+0000 7fa54e3c0640 1 -- 172.21.15.203:0/334377580 learned_addr learned my addr 172.21.15.203:0/334377580 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-19T08:46:24.964 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.947+0000 7fa54d3be640 1 --2- 172.21.15.203:0/334377580 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa548102de0 0x7fa54819e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:24.964 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.947+0000 7fa54dbbf640 1 --2- 172.21.15.203:0/334377580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa548100490 0x7fa54819e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:24.964 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.948+0000 7fa54e3c0640 1 -- 172.21.15.203:0/334377580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa548100490 msgr2=0x7fa54819e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:24.964 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.948+0000 7fa54e3c0640 1 --2- 172.21.15.203:0/334377580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa548100490 0x7fa54819e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:24.964 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.948+0000 7fa54e3c0640 1 -- 172.21.15.203:0/334377580 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa548102de0 msgr2=0x7fa54819e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:24.965 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.948+0000 7fa54e3c0640 1 --2- 172.21.15.203:0/334377580 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa548102de0 0x7fa54819e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:24.965 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.948+0000 7fa54e3c0640 1 -- 172.21.15.203:0/334377580 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5481a6060 con 0x7fa548105790 2024-09-19T08:46:24.965 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.948+0000 7fa54d3be640 1 --2- 172.21.15.203:0/334377580 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa548102de0 0x7fa54819e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:46:24.965 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.948+0000 7fa54e3c0640 1 --2- 172.21.15.203:0/334377580 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa548105790 0x7fa5481a59f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa540031ae0 tx=0x7fa540031ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:24.965 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.948+0000 7fa53effd640 1 -- 172.21.15.203:0/334377580 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa540003b70 con 0x7fa548105790 2024-09-19T08:46:24.965 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.948+0000 7fa54fe23640 1 -- 172.21.15.203:0/334377580 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5481a62f0 con 0x7fa548105790 2024-09-19T08:46:24.965 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.948+0000 7fa53effd640 1 -- 172.21.15.203:0/334377580 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa540003d10 con 0x7fa548105790 2024-09-19T08:46:24.965 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.948+0000 7fa53effd640 1 -- 172.21.15.203:0/334377580 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54002fc40 con 0x7fa548105790 2024-09-19T08:46:24.965 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.948+0000 7fa54fe23640 1 -- 172.21.15.203:0/334377580 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5481a6830 con 0x7fa548105790 2024-09-19T08:46:24.965 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.949+0000 7fa54fe23640 1 -- 172.21.15.203:0/334377580 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5480fdd90 con 0x7fa548105790 2024-09-19T08:46:24.965 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.950+0000 7fa53effd640 1 -- 172.21.15.203:0/334377580 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fa540004050 con 0x7fa548105790 2024-09-19T08:46:24.965 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.951+0000 7fa53effd640 1 --2- 172.21.15.203:0/334377580 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa5340a3270 0x7fa5340a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:24.966 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.951+0000 7fa53effd640 1 -- 172.21.15.203:0/334377580 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 3805+0+0 (secure 0 0 0) 0x7fa5400ef860 con 0x7fa548105790 2024-09-19T08:46:24.966 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.951+0000 7fa54dbbf640 1 --2- 172.21.15.203:0/334377580 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa5340a3270 0x7fa5340a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:24.966 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.952+0000 7fa54dbbf640 1 --2- 172.21.15.203:0/334377580 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa5340a3270 0x7fa5340a5730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa544009bd0 tx=0x7fa544005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:24.966 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:24.958+0000 7fa53effd640 1 -- 172.21.15.203:0/334377580 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa5400bd7a0 con 0x7fa548105790 2024-09-19T08:46:25.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:24 smithi019 ceph-mon[30976]: from='osd.4 [v2:172.21.15.155:6808/2163087792,v1:172.21.15.155:6809/2163087792]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:46:25.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:24 smithi019 ceph-mon[30976]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T08:46:25.139 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:25.140+0000 7fa54fe23640 1 -- 172.21.15.203:0/334377580 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fa548062630 con 0x7fa5340a3270 2024-09-19T08:46:25.787 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:25 smithi203 ceph-mon[35450]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-19T08:46:25.787 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:25 smithi203 ceph-mon[35450]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T08:46:25.787 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:25 smithi203 ceph-mon[35450]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T08:46:25.787 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:25 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:46:25.787 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:25 smithi203 ceph-mon[35450]: from='osd.4 [v2:172.21.15.155:6808/2163087792,v1:172.21.15.155:6809/2163087792]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:46:25.788 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:25 smithi203 ceph-mon[35450]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:46:25.788 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:25 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:25.788 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:25 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:25.788 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:25 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:46:25.788 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:25 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:46:25.788 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:25 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:25.788 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:25 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:46:25.788 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:25 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:46:25.788 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:25 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:25.788 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:25 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:46:25.788 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:25 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:46:25.788 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:25 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:46:25.789 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:25 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:25.789 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:25 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:46:25.789 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:25 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:46:25.789 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:25 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:46:26.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:25 smithi019 ceph-mon[30976]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-19T08:46:26.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:25 smithi019 ceph-mon[30976]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T08:46:26.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:25 smithi019 ceph-mon[30976]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T08:46:26.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:25 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:46:26.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:25 smithi019 ceph-mon[30976]: from='osd.4 [v2:172.21.15.155:6808/2163087792,v1:172.21.15.155:6809/2163087792]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:46:26.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:25 smithi019 ceph-mon[30976]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:46:26.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:25 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:26.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:25 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:26.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:25 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:46:26.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:25 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:46:26.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:25 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:26.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:25 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:46:26.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:25 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:46:26.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:25 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:26.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:25 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:46:26.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:25 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:46:26.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:25 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:46:26.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:25 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:26.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:25 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:46:26.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:25 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:46:26.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:25 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:46:26.172 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 08:46:25 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-4[46282]: 2024-09-19T08:46:25.726+0000 7f64459ad640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T08:46:26.173 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 08:46:25 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-4[46282]: 2024-09-19T08:46:25.732+0000 7f64417d5640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:46:26.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:25 smithi155 ceph-mon[34921]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-19T08:46:26.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:25 smithi155 ceph-mon[34921]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T08:46:26.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:25 smithi155 ceph-mon[34921]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T08:46:26.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:25 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:46:26.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:25 smithi155 ceph-mon[34921]: from='osd.4 [v2:172.21.15.155:6808/2163087792,v1:172.21.15.155:6809/2163087792]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:46:26.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:25 smithi155 ceph-mon[34921]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:46:26.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:25 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:26.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:25 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:26.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:25 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:46:26.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:25 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:46:26.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:25 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:26.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:25 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:46:26.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:25 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:46:26.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:25 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:26.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:25 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:46:26.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:25 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:46:26.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:25 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:46:26.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:25 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:26.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:25 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:46:26.175 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:25 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:46:26.175 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:25 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:46:27.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:26 smithi019 ceph-mon[30976]: Detected new or changed devices on smithi155 2024-09-19T08:46:27.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:26 smithi019 ceph-mon[30976]: Adjusting osd_memory_target on smithi155 to 8544M 2024-09-19T08:46:27.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:26 smithi019 ceph-mon[30976]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:46:27.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:26 smithi019 ceph-mon[30976]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-19T08:46:27.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:26 smithi019 ceph-mon[30976]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T08:46:27.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:26 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:46:27.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:26 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:46:27.083 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:26 smithi203 ceph-mon[35450]: Detected new or changed devices on smithi155 2024-09-19T08:46:27.083 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:26 smithi203 ceph-mon[35450]: Adjusting osd_memory_target on smithi155 to 8544M 2024-09-19T08:46:27.084 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:26 smithi203 ceph-mon[35450]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:46:27.084 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:26 smithi203 ceph-mon[35450]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-19T08:46:27.084 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:26 smithi203 ceph-mon[35450]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T08:46:27.084 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:26 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:46:27.084 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:26 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:46:27.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:26 smithi155 ceph-mon[34921]: Detected new or changed devices on smithi155 2024-09-19T08:46:27.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:26 smithi155 ceph-mon[34921]: Adjusting osd_memory_target on smithi155 to 8544M 2024-09-19T08:46:27.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:26 smithi155 ceph-mon[34921]: from='client.24235 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:46:27.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:26 smithi155 ceph-mon[34921]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-19T08:46:27.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:26 smithi155 ceph-mon[34921]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T08:46:27.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:26 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:46:27.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:26 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:46:27.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:27 smithi203 ceph-mon[35450]: purged_snaps scrub starts 2024-09-19T08:46:27.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:27 smithi203 ceph-mon[35450]: purged_snaps scrub ok 2024-09-19T08:46:27.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:27 smithi203 ceph-mon[35450]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-19T08:46:27.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:27 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:46:27.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:27 smithi203 ceph-mon[35450]: osd.4 [v2:172.21.15.155:6808/2163087792,v1:172.21.15.155:6809/2163087792] boot 2024-09-19T08:46:27.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:27 smithi203 ceph-mon[35450]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T08:46:27.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:27 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:46:27.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:27 smithi203 ceph-mon[35450]: from='client.? 172.21.15.203:0/3400844452' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "057c073e-569f-4c6e-9602-e1169ad4dd8e"}]: dispatch 2024-09-19T08:46:27.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:27 smithi203 ceph-mon[35450]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "057c073e-569f-4c6e-9602-e1169ad4dd8e"}]: dispatch 2024-09-19T08:46:27.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:27 smithi203 ceph-mon[35450]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "057c073e-569f-4c6e-9602-e1169ad4dd8e"}]': finished 2024-09-19T08:46:27.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:27 smithi203 ceph-mon[35450]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T08:46:27.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:27 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:46:28.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:27 smithi019 ceph-mon[30976]: purged_snaps scrub starts 2024-09-19T08:46:28.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:27 smithi019 ceph-mon[30976]: purged_snaps scrub ok 2024-09-19T08:46:28.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:27 smithi019 ceph-mon[30976]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-19T08:46:28.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:27 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:46:28.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:27 smithi019 ceph-mon[30976]: osd.4 [v2:172.21.15.155:6808/2163087792,v1:172.21.15.155:6809/2163087792] boot 2024-09-19T08:46:28.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:27 smithi019 ceph-mon[30976]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T08:46:28.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:27 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:46:28.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:27 smithi019 ceph-mon[30976]: from='client.? 172.21.15.203:0/3400844452' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "057c073e-569f-4c6e-9602-e1169ad4dd8e"}]: dispatch 2024-09-19T08:46:28.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:27 smithi019 ceph-mon[30976]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "057c073e-569f-4c6e-9602-e1169ad4dd8e"}]: dispatch 2024-09-19T08:46:28.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:27 smithi019 ceph-mon[30976]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "057c073e-569f-4c6e-9602-e1169ad4dd8e"}]': finished 2024-09-19T08:46:28.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:27 smithi019 ceph-mon[30976]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T08:46:28.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:27 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:46:28.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:27 smithi155 ceph-mon[34921]: purged_snaps scrub starts 2024-09-19T08:46:28.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:27 smithi155 ceph-mon[34921]: purged_snaps scrub ok 2024-09-19T08:46:28.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:27 smithi155 ceph-mon[34921]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-09-19T08:46:28.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:27 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:46:28.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:27 smithi155 ceph-mon[34921]: osd.4 [v2:172.21.15.155:6808/2163087792,v1:172.21.15.155:6809/2163087792] boot 2024-09-19T08:46:28.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:27 smithi155 ceph-mon[34921]: osdmap e32: 5 total, 5 up, 5 in 2024-09-19T08:46:28.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:27 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T08:46:28.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:27 smithi155 ceph-mon[34921]: from='client.? 172.21.15.203:0/3400844452' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "057c073e-569f-4c6e-9602-e1169ad4dd8e"}]: dispatch 2024-09-19T08:46:28.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:27 smithi155 ceph-mon[34921]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "057c073e-569f-4c6e-9602-e1169ad4dd8e"}]: dispatch 2024-09-19T08:46:28.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:27 smithi155 ceph-mon[34921]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "057c073e-569f-4c6e-9602-e1169ad4dd8e"}]': finished 2024-09-19T08:46:28.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:27 smithi155 ceph-mon[34921]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T08:46:28.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:27 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:46:29.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:28 smithi019 ceph-mon[30976]: from='client.? 172.21.15.203:0/3691807075' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:46:29.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:28 smithi155 ceph-mon[34921]: from='client.? 172.21.15.203:0/3691807075' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:46:29.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:28 smithi203 ceph-mon[35450]: from='client.? 172.21.15.203:0/3691807075' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:46:30.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:29 smithi019 ceph-mon[30976]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:46:30.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:29 smithi155 ceph-mon[34921]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:46:30.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:29 smithi203 ceph-mon[35450]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:46:31.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:30 smithi019 ceph-mon[30976]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:46:31.075 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:30 smithi155 ceph-mon[34921]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:46:31.133 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:30 smithi203 ceph-mon[35450]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 137 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:46:32.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:32 smithi203 ceph-mon[35450]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:46:33.157 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:32 smithi019 ceph-mon[30976]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:46:33.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:32 smithi155 ceph-mon[34921]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:46:35.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:34 smithi155 ceph-mon[34921]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:46:35.195 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:34 smithi203 ceph-mon[35450]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:46:35.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:34 smithi019 ceph-mon[30976]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:46:37.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:36 smithi155 ceph-mon[34921]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:46:37.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:36 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T08:46:37.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:36 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:46:37.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:36 smithi155 ceph-mon[34921]: Deploying daemon osd.5 on smithi203 2024-09-19T08:46:37.223 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:36 smithi203 ceph-mon[35450]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:46:37.223 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:36 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T08:46:37.223 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:36 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:46:37.223 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:36 smithi203 ceph-mon[35450]: Deploying daemon osd.5 on smithi203 2024-09-19T08:46:37.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:36 smithi019 ceph-mon[30976]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:46:37.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:36 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T08:46:37.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:36 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:46:37.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:36 smithi019 ceph-mon[30976]: Deploying daemon osd.5 on smithi203 2024-09-19T08:46:38.957 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:38 smithi203 ceph-mon[35450]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:46:39.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:38 smithi155 ceph-mon[34921]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:46:39.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:38 smithi019 ceph-mon[30976]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:46:41.156 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:40 smithi203 ceph-mon[35450]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:46:41.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:40 smithi155 ceph-mon[34921]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:46:41.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:40 smithi019 ceph-mon[30976]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:46:43.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:42 smithi155 ceph-mon[34921]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:46:43.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:42 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:46:43.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:42 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:43.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:42 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:43.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:42 smithi203 ceph-mon[35450]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:46:43.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:42 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:46:43.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:42 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:43.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:42 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:43.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:42 smithi019 ceph-mon[30976]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:46:43.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:42 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:46:43.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:42 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:43.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:42 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:45.680 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:45 smithi203 ceph-mon[35450]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:46:45.680 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:45 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:45.680 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:45 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:45.680 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:45 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:46:45.680 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:45 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:46:45.680 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:45 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:45.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:45 smithi155 ceph-mon[34921]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:46:45.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:45 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:45.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:45 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:45.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:45 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:46:45.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:45 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:46:45.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:45 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:46.014 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:46.014+0000 7fa53effd640 1 -- 172.21.15.203:0/334377580 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa548062630 con 0x7fa5340a3270 2024-09-19T08:46:46.014 INFO:teuthology.orchestra.run.smithi203.stdout:Created osd(s) 5 on host 'smithi203' 2024-09-19T08:46:46.017 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:46.016+0000 7fa54fe23640 1 -- 172.21.15.203:0/334377580 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa5340a3270 msgr2=0x7fa5340a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:46.017 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:46.016+0000 7fa54fe23640 1 --2- 172.21.15.203:0/334377580 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa5340a3270 0x7fa5340a5730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa544009bd0 tx=0x7fa544005f90 comp rx=0 tx=0).stop 2024-09-19T08:46:46.017 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:46.016+0000 7fa54fe23640 1 -- 172.21.15.203:0/334377580 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa548105790 msgr2=0x7fa5481a59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:46.017 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:46.016+0000 7fa54fe23640 1 --2- 172.21.15.203:0/334377580 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa548105790 0x7fa5481a59f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa540031ae0 tx=0x7fa540031ee0 comp rx=0 tx=0).stop 2024-09-19T08:46:46.017 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:46.016+0000 7fa54fe23640 1 -- 172.21.15.203:0/334377580 shutdown_connections 2024-09-19T08:46:46.017 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:46.016+0000 7fa54fe23640 1 --2- 172.21.15.203:0/334377580 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa5340a3270 0x7fa5340a5730 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:46.017 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:46.016+0000 7fa54fe23640 1 --2- 172.21.15.203:0/334377580 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa548105790 0x7fa5481a59f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:46.018 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:46.016+0000 7fa54fe23640 1 --2- 172.21.15.203:0/334377580 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa548102de0 0x7fa54819e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:46.018 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:46.016+0000 7fa54fe23640 1 --2- 172.21.15.203:0/334377580 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa548100490 0x7fa54819e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:46.018 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:46.016+0000 7fa54fe23640 1 -- 172.21.15.203:0/334377580 >> 172.21.15.203:0/334377580 conn(0x7fa5480fc2a0 msgr2=0x7fa548100d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:46.018 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:46.017+0000 7fa54fe23640 1 -- 172.21.15.203:0/334377580 shutdown_connections 2024-09-19T08:46:46.018 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:46:46.017+0000 7fa54fe23640 1 -- 172.21.15.203:0/334377580 wait complete. 2024-09-19T08:46:46.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:45 smithi019 ceph-mon[30976]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:46:46.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:45 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:46.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:45 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:46.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:45 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:46:46.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:45 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:46:46.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:45 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:46.697 DEBUG:teuthology.orchestra.run.smithi203:osd.5> sudo journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@osd.5.service 2024-09-19T08:46:46.700 INFO:tasks.cephadm:Deploying osd.6 on smithi019 with /dev/vg_nvme/lv_2... 2024-09-19T08:46:46.701 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T08:46:46.854 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:46 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:46:46.854 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:46 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:46.854 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:46 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:46.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:46 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:46:46.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:46 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:46.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:46 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:46.969 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:46:47.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:46 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:46:47.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:46 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:47.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:46 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:47.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:47 smithi019 ceph-mon[30976]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:46:47.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:47 smithi155 ceph-mon[34921]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:46:47.953 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:47 smithi203 ceph-mon[35450]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:46:48.231 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:46:48 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T08:46:48.148+0000 7f2b6d280640 -1 osd.5 0 log_to_monitors true 2024-09-19T08:46:48.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:48 smithi019 ceph-mon[30976]: from='osd.5 [v2:172.21.15.203:6808/334881465,v1:172.21.15.203:6809/334881465]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:46:48.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:48 smithi019 ceph-mon[30976]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:46:48.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:48 smithi155 ceph-mon[34921]: from='osd.5 [v2:172.21.15.203:6808/334881465,v1:172.21.15.203:6809/334881465]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:46:48.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:48 smithi155 ceph-mon[34921]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:46:48.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:48 smithi203 ceph-mon[35450]: from='osd.5 [v2:172.21.15.203:6808/334881465,v1:172.21.15.203:6809/334881465]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:46:48.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:48 smithi203 ceph-mon[35450]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T08:46:49.546 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:46:49.573 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi019:vg_nvme/lv_2 2024-09-19T08:46:49.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:49 smithi019 ceph-mon[30976]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:46:49.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:49 smithi019 ceph-mon[30976]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T08:46:49.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:49 smithi019 ceph-mon[30976]: from='osd.5 [v2:172.21.15.203:6808/334881465,v1:172.21.15.203:6809/334881465]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:46:49.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:49 smithi019 ceph-mon[30976]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T08:46:49.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:49 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:46:49.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:49 smithi019 ceph-mon[30976]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:46:49.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:49 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:49.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:49 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:49.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:49 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:46:49.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:49 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:46:49.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:49 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:49.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:49 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:46:49.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:49 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:46:49.820 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:49 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:49.841 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:46:49.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:49 smithi155 ceph-mon[34921]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:46:49.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:49 smithi155 ceph-mon[34921]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T08:46:49.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:49 smithi155 ceph-mon[34921]: from='osd.5 [v2:172.21.15.203:6808/334881465,v1:172.21.15.203:6809/334881465]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:46:49.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:49 smithi155 ceph-mon[34921]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T08:46:49.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:49 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:46:49.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:49 smithi155 ceph-mon[34921]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:46:49.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:49 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:49.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:49 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:49.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:49 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:46:49.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:49 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:46:49.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:49 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:49.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:49 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:46:49.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:49 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:46:49.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:49 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:49.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:49 smithi203 ceph-mon[35450]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:46:49.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:49 smithi203 ceph-mon[35450]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T08:46:49.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:49 smithi203 ceph-mon[35450]: from='osd.5 [v2:172.21.15.203:6808/334881465,v1:172.21.15.203:6809/334881465]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:46:49.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:49 smithi203 ceph-mon[35450]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T08:46:49.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:49 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:46:49.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:49 smithi203 ceph-mon[35450]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:46:49.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:49 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:49.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:49 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:49.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:49 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:46:49.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:49 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:46:49.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:49 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:49.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:49 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:46:49.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:49 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:46:49.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:49 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:46:50.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.317+0000 7f4af5de9640 1 -- 172.21.15.19:0/2718178419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4af01078c0 msgr2=0x7f4af0109d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:50.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.317+0000 7f4af5de9640 1 --2- 172.21.15.19:0/2718178419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4af01078c0 0x7f4af0109d10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8009ca0 tx=0x7f4ae802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:46:50.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.318+0000 7f4af5de9640 1 -- 172.21.15.19:0/2718178419 shutdown_connections 2024-09-19T08:46:50.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.318+0000 7f4af5de9640 1 --2- 172.21.15.19:0/2718178419 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4af0104f90 0x7f4af0107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:50.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.318+0000 7f4af5de9640 1 --2- 172.21.15.19:0/2718178419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4af01078c0 0x7f4af0109d10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:50.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.318+0000 7f4af5de9640 1 --2- 172.21.15.19:0/2718178419 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4af0102660 0x7f4af0104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:50.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.318+0000 7f4af5de9640 1 -- 172.21.15.19:0/2718178419 >> 172.21.15.19:0/2718178419 conn(0x7f4af00fc280 msgr2=0x7f4af00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:46:50.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.318+0000 7f4af5de9640 1 -- 172.21.15.19:0/2718178419 shutdown_connections 2024-09-19T08:46:50.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.318+0000 7f4af5de9640 1 -- 172.21.15.19:0/2718178419 wait complete. 2024-09-19T08:46:50.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.318+0000 7f4af5de9640 1 Processor -- start 2024-09-19T08:46:50.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.318+0000 7f4af5de9640 1 -- start start 2024-09-19T08:46:50.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.319+0000 7f4af5de9640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4af0102660 0x7f4af0197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:50.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.319+0000 7f4af5de9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4af0104f90 0x7f4af0198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:50.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.319+0000 7f4af5de9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4af01078c0 0x7f4af019f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:50.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.319+0000 7f4af5de9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4af010d880 con 0x7f4af01078c0 2024-09-19T08:46:50.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.319+0000 7f4af5de9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4af010d700 con 0x7f4af0104f90 2024-09-19T08:46:50.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.319+0000 7f4af5de9640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4af010da00 con 0x7f4af0102660 2024-09-19T08:46:50.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.319+0000 7f4aeffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4af01078c0 0x7f4af019f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:50.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.319+0000 7f4aeffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4af01078c0 0x7f4af019f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34896/0 (socket says 172.21.15.19:34896) 2024-09-19T08:46:50.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.319+0000 7f4aeffff640 1 -- 172.21.15.19:0/2205977786 learned_addr learned my addr 172.21.15.19:0/2205977786 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:46:50.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.319+0000 7f4aef7fe640 1 --2- 172.21.15.19:0/2205977786 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4af0102660 0x7f4af0197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:50.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.319+0000 7f4aeeffd640 1 --2- 172.21.15.19:0/2205977786 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4af0104f90 0x7f4af0198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:50.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.319+0000 7f4aeffff640 1 -- 172.21.15.19:0/2205977786 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4af0102660 msgr2=0x7f4af0197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:50.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.319+0000 7f4aeffff640 1 --2- 172.21.15.19:0/2205977786 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4af0102660 0x7f4af0197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:50.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.319+0000 7f4aeffff640 1 -- 172.21.15.19:0/2205977786 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4af0104f90 msgr2=0x7f4af0198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:46:50.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.319+0000 7f4aeffff640 1 --2- 172.21.15.19:0/2205977786 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4af0104f90 0x7f4af0198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:46:50.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.319+0000 7f4aeffff640 1 -- 172.21.15.19:0/2205977786 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4af019fb10 con 0x7f4af01078c0 2024-09-19T08:46:50.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.319+0000 7f4aef7fe640 1 --2- 172.21.15.19:0/2205977786 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4af0102660 0x7f4af0197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:46:50.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.319+0000 7f4aeeffd640 1 --2- 172.21.15.19:0/2205977786 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4af0104f90 0x7f4af0198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:46:50.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.319+0000 7f4aeffff640 1 --2- 172.21.15.19:0/2205977786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4af01078c0 0x7f4af019f4a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8031ae0 tx=0x7f4ae8031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:50.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.320+0000 7f4aecff9640 1 -- 172.21.15.19:0/2205977786 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae8003b70 con 0x7f4af01078c0 2024-09-19T08:46:50.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.320+0000 7f4af5de9640 1 -- 172.21.15.19:0/2205977786 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4af019fda0 con 0x7f4af01078c0 2024-09-19T08:46:50.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.320+0000 7f4aecff9640 1 -- 172.21.15.19:0/2205977786 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ae8003d10 con 0x7f4af01078c0 2024-09-19T08:46:50.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.320+0000 7f4aecff9640 1 -- 172.21.15.19:0/2205977786 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ae802fc40 con 0x7f4af01078c0 2024-09-19T08:46:50.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.320+0000 7f4af5de9640 1 -- 172.21.15.19:0/2205977786 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4af01a0250 con 0x7f4af01078c0 2024-09-19T08:46:50.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.321+0000 7f4af5de9640 1 -- 172.21.15.19:0/2205977786 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4af00fdd70 con 0x7f4af01078c0 2024-09-19T08:46:50.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.322+0000 7f4aecff9640 1 -- 172.21.15.19:0/2205977786 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f4ae8004050 con 0x7f4af01078c0 2024-09-19T08:46:50.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.323+0000 7f4aecff9640 1 --2- 172.21.15.19:0/2205977786 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4ad80a3270 0x7f4ad80a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:46:50.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.323+0000 7f4aecff9640 1 -- 172.21.15.19:0/2205977786 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4566+0+0 (secure 0 0 0) 0x7f4ae80efdd0 con 0x7f4af01078c0 2024-09-19T08:46:50.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.323+0000 7f4aef7fe640 1 --2- 172.21.15.19:0/2205977786 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4ad80a3270 0x7f4ad80a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:46:50.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.323+0000 7f4aef7fe640 1 --2- 172.21.15.19:0/2205977786 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4ad80a3270 0x7f4ad80a5730 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0009fc0 tx=0x7f4ae0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:46:50.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.327+0000 7f4aecff9640 1 -- 172.21.15.19:0/2205977786 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4ae80bd990 con 0x7f4af01078c0 2024-09-19T08:46:50.481 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:46:49 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T08:46:49.993+0000 7f2b69a17640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T08:46:50.481 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 08:46:50 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T08:46:50.000+0000 7f2b61023640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:46:50.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:46:50.515+0000 7f4af5de9640 1 -- 172.21.15.19:0/2205977786 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f4af0062630 con 0x7f4ad80a3270 2024-09-19T08:46:50.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:50 smithi019 ceph-mon[30976]: Detected new or changed devices on smithi203 2024-09-19T08:46:50.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:50 smithi019 ceph-mon[30976]: Adjusting osd_memory_target on smithi203 to 8544M 2024-09-19T08:46:50.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:50 smithi019 ceph-mon[30976]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-19T08:46:50.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:50 smithi019 ceph-mon[30976]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T08:46:50.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:50 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:46:50.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:50 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:46:50.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:50 smithi019 ceph-mon[30976]: from='osd.5 ' entity='osd.5' 2024-09-19T08:46:50.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:50 smithi019 ceph-mon[30976]: osd.5 [v2:172.21.15.203:6808/334881465,v1:172.21.15.203:6809/334881465] boot 2024-09-19T08:46:50.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:50 smithi019 ceph-mon[30976]: osdmap e36: 6 total, 6 up, 6 in 2024-09-19T08:46:50.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:50 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:46:50.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:50 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:46:50.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:50 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:46:50.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:50 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:46:50.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:50 smithi155 ceph-mon[34921]: Detected new or changed devices on smithi203 2024-09-19T08:46:50.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:50 smithi155 ceph-mon[34921]: Adjusting osd_memory_target on smithi203 to 8544M 2024-09-19T08:46:50.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:50 smithi155 ceph-mon[34921]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-19T08:46:50.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:50 smithi155 ceph-mon[34921]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T08:46:50.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:50 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:46:50.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:50 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:46:50.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:50 smithi155 ceph-mon[34921]: from='osd.5 ' entity='osd.5' 2024-09-19T08:46:50.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:50 smithi155 ceph-mon[34921]: osd.5 [v2:172.21.15.203:6808/334881465,v1:172.21.15.203:6809/334881465] boot 2024-09-19T08:46:50.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:50 smithi155 ceph-mon[34921]: osdmap e36: 6 total, 6 up, 6 in 2024-09-19T08:46:50.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:50 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:46:50.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:50 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:46:50.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:50 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:46:50.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:50 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:46:50.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:50 smithi203 ceph-mon[35450]: Detected new or changed devices on smithi203 2024-09-19T08:46:50.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:50 smithi203 ceph-mon[35450]: Adjusting osd_memory_target on smithi203 to 8544M 2024-09-19T08:46:50.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:50 smithi203 ceph-mon[35450]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-19T08:46:50.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:50 smithi203 ceph-mon[35450]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T08:46:50.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:50 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:46:50.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:50 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:46:50.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:50 smithi203 ceph-mon[35450]: from='osd.5 ' entity='osd.5' 2024-09-19T08:46:50.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:50 smithi203 ceph-mon[35450]: osd.5 [v2:172.21.15.203:6808/334881465,v1:172.21.15.203:6809/334881465] boot 2024-09-19T08:46:50.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:50 smithi203 ceph-mon[35450]: osdmap e36: 6 total, 6 up, 6 in 2024-09-19T08:46:50.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:50 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T08:46:50.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:50 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:46:50.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:50 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:46:50.984 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:50 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:46:51.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:51 smithi155 ceph-mon[34921]: purged_snaps scrub starts 2024-09-19T08:46:51.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:51 smithi155 ceph-mon[34921]: purged_snaps scrub ok 2024-09-19T08:46:51.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:51 smithi155 ceph-mon[34921]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:46:51.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:51 smithi155 ceph-mon[34921]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:46:51.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:51 smithi155 ceph-mon[34921]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T08:46:51.979 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:51 smithi019 ceph-mon[30976]: purged_snaps scrub starts 2024-09-19T08:46:51.979 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:51 smithi019 ceph-mon[30976]: purged_snaps scrub ok 2024-09-19T08:46:51.979 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:51 smithi019 ceph-mon[30976]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:46:51.979 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:51 smithi019 ceph-mon[30976]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:46:51.979 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:51 smithi019 ceph-mon[30976]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T08:46:51.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:51 smithi203 ceph-mon[35450]: purged_snaps scrub starts 2024-09-19T08:46:51.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:51 smithi203 ceph-mon[35450]: purged_snaps scrub ok 2024-09-19T08:46:51.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:51 smithi203 ceph-mon[35450]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 138 MiB used, 447 GiB / 447 GiB avail 2024-09-19T08:46:51.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:51 smithi203 ceph-mon[35450]: from='client.14367 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:46:51.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:51 smithi203 ceph-mon[35450]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T08:46:53.505 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:53 smithi019 ceph-mon[30976]: pgmap v132: 1 pgs: 1 remapped+peering; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:46:53.505 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:53 smithi019 ceph-mon[30976]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T08:46:53.506 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:53 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3587806158' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "40418f13-823e-4f94-a427-84781abbcb5e"}]: dispatch 2024-09-19T08:46:53.506 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:53 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3587806158' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "40418f13-823e-4f94-a427-84781abbcb5e"}]': finished 2024-09-19T08:46:53.506 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:53 smithi019 ceph-mon[30976]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T08:46:53.506 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:53 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:46:53.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:53 smithi155 ceph-mon[34921]: pgmap v132: 1 pgs: 1 remapped+peering; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:46:53.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:53 smithi155 ceph-mon[34921]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T08:46:53.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:53 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3587806158' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "40418f13-823e-4f94-a427-84781abbcb5e"}]: dispatch 2024-09-19T08:46:53.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:53 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3587806158' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "40418f13-823e-4f94-a427-84781abbcb5e"}]': finished 2024-09-19T08:46:53.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:53 smithi155 ceph-mon[34921]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T08:46:53.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:53 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:46:53.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:53 smithi203 ceph-mon[35450]: pgmap v132: 1 pgs: 1 remapped+peering; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:46:53.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:53 smithi203 ceph-mon[35450]: osdmap e38: 6 total, 6 up, 6 in 2024-09-19T08:46:53.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:53 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3587806158' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "40418f13-823e-4f94-a427-84781abbcb5e"}]: dispatch 2024-09-19T08:46:53.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:53 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3587806158' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "40418f13-823e-4f94-a427-84781abbcb5e"}]': finished 2024-09-19T08:46:53.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:53 smithi203 ceph-mon[35450]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T08:46:53.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:53 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:46:54.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:54 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3387211140' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:46:54.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:54 smithi019 ceph-mon[30976]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T08:46:54.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:54 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:46:54.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:54 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3387211140' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:46:54.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:54 smithi155 ceph-mon[34921]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T08:46:54.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:54 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:46:54.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:54 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3387211140' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:46:54.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:54 smithi203 ceph-mon[35450]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T08:46:54.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:54 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:46:55.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:55 smithi155 ceph-mon[34921]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:46:55.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:55 smithi203 ceph-mon[35450]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:46:55.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:55 smithi019 ceph-mon[30976]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:46:57.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:57 smithi019 ceph-mon[30976]: pgmap v137: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:46:57.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:57 smithi155 ceph-mon[34921]: pgmap v137: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:46:57.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:57 smithi203 ceph-mon[35450]: pgmap v137: 1 pgs: 1 remapped+peering; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:46:59.447 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:46:59 smithi019 ceph-mon[30976]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T08:46:59.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:46:59 smithi155 ceph-mon[34921]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T08:46:59.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:46:59 smithi203 ceph-mon[35450]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T08:47:01.583 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:01 smithi019 ceph-mon[30976]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-19T08:47:01.583 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:01 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T08:47:01.583 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:01 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:47:01.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:01 smithi155 ceph-mon[34921]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-19T08:47:01.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:01 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T08:47:01.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:01 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:47:01.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:01 smithi203 ceph-mon[35450]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-19T08:47:01.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:01 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T08:47:01.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:01 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:47:02.397 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:02 smithi019 ceph-mon[30976]: Deploying daemon osd.6 on smithi019 2024-09-19T08:47:02.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:02 smithi155 ceph-mon[34921]: Deploying daemon osd.6 on smithi019 2024-09-19T08:47:02.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:02 smithi203 ceph-mon[35450]: Deploying daemon osd.6 on smithi019 2024-09-19T08:47:03.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:03 smithi019 ceph-mon[30976]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-19T08:47:03.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:03 smithi155 ceph-mon[34921]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-19T08:47:03.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:03 smithi203 ceph-mon[35450]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-09-19T08:47:05.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:05 smithi155 ceph-mon[34921]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T08:47:05.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:05 smithi203 ceph-mon[35450]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T08:47:05.782 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:05 smithi019 ceph-mon[30976]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T08:47:07.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:07 smithi155 ceph-mon[34921]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T08:47:07.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:07 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:47:07.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:07 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:07.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:07 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:07.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:07 smithi203 ceph-mon[35450]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T08:47:07.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:07 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:47:07.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:07 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:07.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:07 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:07.739 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:07 smithi019 ceph-mon[30976]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T08:47:07.739 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:07 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:47:07.740 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:07 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:07.740 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:07 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:09.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:09 smithi155 ceph-mon[34921]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:47:09.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:09 smithi203 ceph-mon[35450]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:47:09.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:09 smithi019 ceph-mon[30976]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:47:10.704 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:10 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:10.704 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:10 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:10.705 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:10 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:47:10.705 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:10 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:47:10.705 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:10 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:10.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:47:10.748+0000 7f4aecff9640 1 -- 172.21.15.19:0/2205977786 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4af0062630 con 0x7f4ad80a3270 2024-09-19T08:47:10.747 INFO:teuthology.orchestra.run.smithi019.stdout:Created osd(s) 6 on host 'smithi019' 2024-09-19T08:47:10.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:47:10.750+0000 7f4af5de9640 1 -- 172.21.15.19:0/2205977786 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4ad80a3270 msgr2=0x7f4ad80a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:10.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:47:10.750+0000 7f4af5de9640 1 --2- 172.21.15.19:0/2205977786 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4ad80a3270 0x7f4ad80a5730 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4ae0009fc0 tx=0x7f4ae0005f90 comp rx=0 tx=0).stop 2024-09-19T08:47:10.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:47:10.750+0000 7f4af5de9640 1 -- 172.21.15.19:0/2205977786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4af01078c0 msgr2=0x7f4af019f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:10.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:47:10.750+0000 7f4af5de9640 1 --2- 172.21.15.19:0/2205977786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4af01078c0 0x7f4af019f4a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4ae8031ae0 tx=0x7f4ae8031ee0 comp rx=0 tx=0).stop 2024-09-19T08:47:10.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:47:10.750+0000 7f4af5de9640 1 -- 172.21.15.19:0/2205977786 shutdown_connections 2024-09-19T08:47:10.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:47:10.750+0000 7f4af5de9640 1 --2- 172.21.15.19:0/2205977786 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4ad80a3270 0x7f4ad80a5730 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:10.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:47:10.750+0000 7f4af5de9640 1 --2- 172.21.15.19:0/2205977786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4af01078c0 0x7f4af019f4a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:10.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:47:10.750+0000 7f4af5de9640 1 --2- 172.21.15.19:0/2205977786 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4af0104f90 0x7f4af0198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:10.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:47:10.750+0000 7f4af5de9640 1 --2- 172.21.15.19:0/2205977786 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4af0102660 0x7f4af0197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:10.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:47:10.750+0000 7f4af5de9640 1 -- 172.21.15.19:0/2205977786 >> 172.21.15.19:0/2205977786 conn(0x7f4af00fc280 msgr2=0x7f4af0102f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:10.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:47:10.750+0000 7f4af5de9640 1 -- 172.21.15.19:0/2205977786 shutdown_connections 2024-09-19T08:47:10.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:47:10.750+0000 7f4af5de9640 1 -- 172.21.15.19:0/2205977786 wait complete. 2024-09-19T08:47:10.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:10 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:10.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:10 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:10.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:10 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:47:10.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:10 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:47:10.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:10 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:10.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:10 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:10.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:10 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:10.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:10 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:47:10.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:10 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:47:10.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:10 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:11.387 DEBUG:teuthology.orchestra.run.smithi019:osd.6> sudo journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@osd.6.service 2024-09-19T08:47:11.390 INFO:tasks.cephadm:Deploying osd.7 on smithi155 with /dev/vg_nvme/lv_2... 2024-09-19T08:47:11.390 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T08:47:11.647 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:47:11.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:11 smithi155 ceph-mon[34921]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:47:11.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:11 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:47:11.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:11 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:11.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:11 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:11.938 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:11 smithi019 ceph-mon[30976]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:47:11.938 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:11 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:47:11.938 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:11 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:11.938 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:11 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:11.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:11 smithi203 ceph-mon[35450]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:47:11.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:11 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:47:11.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:11 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:11.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:11 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:12.801 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:12 smithi019 ceph-mon[30976]: from='osd.6 [v2:172.21.15.19:6818/2669779791,v1:172.21.15.19:6819/2669779791]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T08:47:12.802 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 08:47:12 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T08:47:12.539+0000 7f7e00631640 -1 osd.6 0 log_to_monitors true 2024-09-19T08:47:12.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:12 smithi155 ceph-mon[34921]: from='osd.6 [v2:172.21.15.19:6818/2669779791,v1:172.21.15.19:6819/2669779791]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T08:47:12.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:12 smithi203 ceph-mon[35450]: from='osd.6 [v2:172.21.15.19:6818/2669779791,v1:172.21.15.19:6819/2669779791]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T08:47:13.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:13 smithi155 ceph-mon[34921]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:47:13.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:13 smithi155 ceph-mon[34921]: from='osd.6 [v2:172.21.15.19:6818/2669779791,v1:172.21.15.19:6819/2669779791]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T08:47:13.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:13 smithi155 ceph-mon[34921]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T08:47:13.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:13 smithi155 ceph-mon[34921]: from='osd.6 [v2:172.21.15.19:6818/2669779791,v1:172.21.15.19:6819/2669779791]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]: dispatch 2024-09-19T08:47:13.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:13 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:47:13.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:13 smithi203 ceph-mon[35450]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:47:13.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:13 smithi203 ceph-mon[35450]: from='osd.6 [v2:172.21.15.19:6818/2669779791,v1:172.21.15.19:6819/2669779791]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T08:47:13.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:13 smithi203 ceph-mon[35450]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T08:47:13.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:13 smithi203 ceph-mon[35450]: from='osd.6 [v2:172.21.15.19:6818/2669779791,v1:172.21.15.19:6819/2669779791]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]: dispatch 2024-09-19T08:47:13.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:13 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:47:14.069 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 08:47:13 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T08:47:13.668+0000 7f7dfc5b4640 -1 osd.6 0 waiting for initial osdmap 2024-09-19T08:47:14.069 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 08:47:13 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T08:47:13.676+0000 7f7df83dc640 -1 osd.6 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:47:14.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:13 smithi019 ceph-mon[30976]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:47:14.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:13 smithi019 ceph-mon[30976]: from='osd.6 [v2:172.21.15.19:6818/2669779791,v1:172.21.15.19:6819/2669779791]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T08:47:14.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:13 smithi019 ceph-mon[30976]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T08:47:14.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:13 smithi019 ceph-mon[30976]: from='osd.6 [v2:172.21.15.19:6818/2669779791,v1:172.21.15.19:6819/2669779791]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]: dispatch 2024-09-19T08:47:14.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:13 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:47:14.477 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T08:47:14.507 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi155:vg_nvme/lv_2 2024-09-19T08:47:14.765 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:47:14.796 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:14 smithi155 ceph-mon[34921]: from='osd.6 [v2:172.21.15.19:6818/2669779791,v1:172.21.15.19:6819/2669779791]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-09-19T08:47:14.796 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:14 smithi155 ceph-mon[34921]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T08:47:14.796 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:14 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:47:14.796 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:14 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:47:14.796 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:14 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:14.796 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:14 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:14.796 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:14 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:47:14.796 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:14 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:47:14.796 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:14 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:47:14.797 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:14 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:14.797 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:14 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:47:14.797 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:14 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:47:14.797 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:14 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:14.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:14 smithi019 ceph-mon[30976]: from='osd.6 [v2:172.21.15.19:6818/2669779791,v1:172.21.15.19:6819/2669779791]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-09-19T08:47:14.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:14 smithi019 ceph-mon[30976]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T08:47:14.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:14 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:47:14.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:14 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:47:14.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:14 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:14.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:14 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:14.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:14 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:47:14.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:14 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:47:14.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:14 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:47:14.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:14 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:14.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:14 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:47:14.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:14 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:47:14.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:14 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:14.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:14 smithi203 ceph-mon[35450]: from='osd.6 [v2:172.21.15.19:6818/2669779791,v1:172.21.15.19:6819/2669779791]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-09-19T08:47:14.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:14 smithi203 ceph-mon[35450]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T08:47:14.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:14 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:47:14.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:14 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:47:14.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:14 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:14.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:14 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:14.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:14 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:47:14.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:14 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:47:14.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:14 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:47:14.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:14 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:14.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:14 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:47:14.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:14 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:47:14.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:14 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:15.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.237+0000 7fe5d9df0640 1 -- 172.21.15.155:0/3158169706 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5d4102660 msgr2=0x7fe5d4104a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:15.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.237+0000 7fe5d9df0640 1 --2- 172.21.15.155:0/3158169706 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5d4102660 0x7fe5d4104a50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4009900 tx=0x7fe5c402a410 comp rx=0 tx=0).stop 2024-09-19T08:47:15.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.237+0000 7fe5d9df0640 1 -- 172.21.15.155:0/3158169706 shutdown_connections 2024-09-19T08:47:15.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.237+0000 7fe5d9df0640 1 --2- 172.21.15.155:0/3158169706 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe5d41078c0 0x7fe5d4109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:15.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.237+0000 7fe5d9df0640 1 --2- 172.21.15.155:0/3158169706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5d4104f90 0x7fe5d4107380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:15.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.237+0000 7fe5d9df0640 1 --2- 172.21.15.155:0/3158169706 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5d4102660 0x7fe5d4104a50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:15.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.237+0000 7fe5d9df0640 1 -- 172.21.15.155:0/3158169706 >> 172.21.15.155:0/3158169706 conn(0x7fe5d40fc280 msgr2=0x7fe5d40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:15.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.237+0000 7fe5d9df0640 1 -- 172.21.15.155:0/3158169706 shutdown_connections 2024-09-19T08:47:15.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.237+0000 7fe5d9df0640 1 -- 172.21.15.155:0/3158169706 wait complete. 2024-09-19T08:47:15.244 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.238+0000 7fe5d9df0640 1 Processor -- start 2024-09-19T08:47:15.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.238+0000 7fe5d9df0640 1 -- start start 2024-09-19T08:47:15.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.238+0000 7fe5d9df0640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe5d4102660 0x7fe5d4197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:15.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.238+0000 7fe5d9df0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5d4104f90 0x7fe5d4198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:15.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.239+0000 7fe5d9df0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5d41078c0 0x7fe5d419f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:15.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.239+0000 7fe5d9df0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d410d890 con 0x7fe5d4104f90 2024-09-19T08:47:15.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.239+0000 7fe5d9df0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d410d710 con 0x7fe5d41078c0 2024-09-19T08:47:15.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.239+0000 7fe5d9df0640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d410da10 con 0x7fe5d4102660 2024-09-19T08:47:15.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.239+0000 7fe5d3fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5d41078c0 0x7fe5d419f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:15.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.239+0000 7fe5d3fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5d41078c0 0x7fe5d419f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:56820/0 (socket says 172.21.15.155:56820) 2024-09-19T08:47:15.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.239+0000 7fe5d3fff640 1 -- 172.21.15.155:0/1583796507 learned_addr learned my addr 172.21.15.155:0/1583796507 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-19T08:47:15.245 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.239+0000 7fe5d37fe640 1 --2- 172.21.15.155:0/1583796507 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe5d4102660 0x7fe5d4197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:15.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.239+0000 7fe5d2ffd640 1 --2- 172.21.15.155:0/1583796507 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5d4104f90 0x7fe5d4198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:15.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.239+0000 7fe5d3fff640 1 -- 172.21.15.155:0/1583796507 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe5d4102660 msgr2=0x7fe5d4197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:15.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.239+0000 7fe5d3fff640 1 --2- 172.21.15.155:0/1583796507 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe5d4102660 0x7fe5d4197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:15.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.239+0000 7fe5d3fff640 1 -- 172.21.15.155:0/1583796507 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5d4104f90 msgr2=0x7fe5d4198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:15.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.239+0000 7fe5d3fff640 1 --2- 172.21.15.155:0/1583796507 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5d4104f90 0x7fe5d4198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:15.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.239+0000 7fe5d3fff640 1 -- 172.21.15.155:0/1583796507 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d419fb50 con 0x7fe5d41078c0 2024-09-19T08:47:15.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.239+0000 7fe5d2ffd640 1 --2- 172.21.15.155:0/1583796507 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5d4104f90 0x7fe5d4198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:47:15.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.239+0000 7fe5d3fff640 1 --2- 172.21.15.155:0/1583796507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5d41078c0 0x7fe5d419f4e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc00eaa0 tx=0x7fe5cc00ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:15.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.239+0000 7fe5d0ff9640 1 -- 172.21.15.155:0/1583796507 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc00cdb0 con 0x7fe5d41078c0 2024-09-19T08:47:15.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.239+0000 7fe5d0ff9640 1 -- 172.21.15.155:0/1583796507 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5cc005020 con 0x7fe5d41078c0 2024-09-19T08:47:15.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.239+0000 7fe5d9df0640 1 -- 172.21.15.155:0/1583796507 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5d419fe40 con 0x7fe5d41078c0 2024-09-19T08:47:15.246 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.239+0000 7fe5d0ff9640 1 -- 172.21.15.155:0/1583796507 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5cc0116b0 con 0x7fe5d41078c0 2024-09-19T08:47:15.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.239+0000 7fe5d9df0640 1 -- 172.21.15.155:0/1583796507 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5d41a0340 con 0x7fe5d41078c0 2024-09-19T08:47:15.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.240+0000 7fe5d9df0640 1 -- 172.21.15.155:0/1583796507 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5d40fdd70 con 0x7fe5d41078c0 2024-09-19T08:47:15.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.242+0000 7fe5d0ff9640 1 -- 172.21.15.155:0/1583796507 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe5cc005560 con 0x7fe5d41078c0 2024-09-19T08:47:15.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.242+0000 7fe5d0ff9640 1 --2- 172.21.15.155:0/1583796507 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe5bc0a32f0 0x7fe5bc0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:15.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.242+0000 7fe5d0ff9640 1 -- 172.21.15.155:0/1583796507 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 4965+0+0 (secure 0 0 0) 0x7fe5cc0cf100 con 0x7fe5d41078c0 2024-09-19T08:47:15.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.243+0000 7fe5d37fe640 1 --2- 172.21.15.155:0/1583796507 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe5bc0a32f0 0x7fe5bc0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:15.247 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.243+0000 7fe5d37fe640 1 --2- 172.21.15.155:0/1583796507 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe5bc0a32f0 0x7fe5bc0a57b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe5c40314e0 tx=0x7fe5c4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:15.250 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.250+0000 7fe5d0ff9640 1 -- 172.21.15.155:0/1583796507 <== mon.2 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe5cc016030 con 0x7fe5d41078c0 2024-09-19T08:47:15.428 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:15.428+0000 7fe5d9df0640 1 -- 172.21.15.155:0/1583796507 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fe5d4062630 con 0x7fe5bc0a32f0 2024-09-19T08:47:15.797 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:15 smithi155 ceph-mon[34921]: purged_snaps scrub starts 2024-09-19T08:47:15.797 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:15 smithi155 ceph-mon[34921]: purged_snaps scrub ok 2024-09-19T08:47:15.797 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:15 smithi155 ceph-mon[34921]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:47:15.797 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:15 smithi155 ceph-mon[34921]: Detected new or changed devices on smithi019 2024-09-19T08:47:15.797 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:15 smithi155 ceph-mon[34921]: Adjusting osd_memory_target on smithi019 to 5697M 2024-09-19T08:47:15.797 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:15 smithi155 ceph-mon[34921]: osd.6 [v2:172.21.15.19:6818/2669779791,v1:172.21.15.19:6819/2669779791] boot 2024-09-19T08:47:15.797 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:15 smithi155 ceph-mon[34921]: osdmap e43: 7 total, 7 up, 7 in 2024-09-19T08:47:15.797 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:15 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:47:15.797 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:15 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:47:15.797 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:15 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:47:15.798 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:15 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:47:15.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:15 smithi203 ceph-mon[35450]: purged_snaps scrub starts 2024-09-19T08:47:15.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:15 smithi203 ceph-mon[35450]: purged_snaps scrub ok 2024-09-19T08:47:15.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:15 smithi203 ceph-mon[35450]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:47:15.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:15 smithi203 ceph-mon[35450]: Detected new or changed devices on smithi019 2024-09-19T08:47:15.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:15 smithi203 ceph-mon[35450]: Adjusting osd_memory_target on smithi019 to 5697M 2024-09-19T08:47:15.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:15 smithi203 ceph-mon[35450]: osd.6 [v2:172.21.15.19:6818/2669779791,v1:172.21.15.19:6819/2669779791] boot 2024-09-19T08:47:15.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:15 smithi203 ceph-mon[35450]: osdmap e43: 7 total, 7 up, 7 in 2024-09-19T08:47:15.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:15 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:47:15.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:15 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:47:15.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:15 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:47:15.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:15 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:47:16.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:15 smithi019 ceph-mon[30976]: purged_snaps scrub starts 2024-09-19T08:47:16.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:15 smithi019 ceph-mon[30976]: purged_snaps scrub ok 2024-09-19T08:47:16.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:15 smithi019 ceph-mon[30976]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-09-19T08:47:16.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:15 smithi019 ceph-mon[30976]: Detected new or changed devices on smithi019 2024-09-19T08:47:16.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:15 smithi019 ceph-mon[30976]: Adjusting osd_memory_target on smithi019 to 5697M 2024-09-19T08:47:16.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:15 smithi019 ceph-mon[30976]: osd.6 [v2:172.21.15.19:6818/2669779791,v1:172.21.15.19:6819/2669779791] boot 2024-09-19T08:47:16.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:15 smithi019 ceph-mon[30976]: osdmap e43: 7 total, 7 up, 7 in 2024-09-19T08:47:16.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:15 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T08:47:16.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:15 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:47:16.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:15 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:47:16.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:15 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:47:16.875 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:16 smithi155 ceph-mon[34921]: from='client.24275 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:47:16.875 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:16 smithi155 ceph-mon[34921]: osdmap e44: 7 total, 7 up, 7 in 2024-09-19T08:47:16.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:16 smithi203 ceph-mon[35450]: from='client.24275 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:47:16.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:16 smithi203 ceph-mon[35450]: osdmap e44: 7 total, 7 up, 7 in 2024-09-19T08:47:17.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:16 smithi019 ceph-mon[30976]: from='client.24275 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:47:17.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:16 smithi019 ceph-mon[30976]: osdmap e44: 7 total, 7 up, 7 in 2024-09-19T08:47:17.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:17 smithi155 ceph-mon[34921]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:17.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:17 smithi203 ceph-mon[35450]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:18.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:17 smithi019 ceph-mon[30976]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:18.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:18 smithi155 ceph-mon[34921]: from='client.? 172.21.15.155:0/2662322600' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad15f762-aeab-4167-a63d-6c9f9b89b9c0"}]: dispatch 2024-09-19T08:47:18.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:18 smithi155 ceph-mon[34921]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad15f762-aeab-4167-a63d-6c9f9b89b9c0"}]: dispatch 2024-09-19T08:47:18.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:18 smithi155 ceph-mon[34921]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ad15f762-aeab-4167-a63d-6c9f9b89b9c0"}]': finished 2024-09-19T08:47:18.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:18 smithi155 ceph-mon[34921]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T08:47:18.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:18 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:47:18.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:18 smithi155 ceph-mon[34921]: from='client.? 172.21.15.155:0/379857849' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:47:18.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:18 smithi203 ceph-mon[35450]: from='client.? 172.21.15.155:0/2662322600' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad15f762-aeab-4167-a63d-6c9f9b89b9c0"}]: dispatch 2024-09-19T08:47:18.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:18 smithi203 ceph-mon[35450]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad15f762-aeab-4167-a63d-6c9f9b89b9c0"}]: dispatch 2024-09-19T08:47:18.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:18 smithi203 ceph-mon[35450]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ad15f762-aeab-4167-a63d-6c9f9b89b9c0"}]': finished 2024-09-19T08:47:18.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:18 smithi203 ceph-mon[35450]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T08:47:18.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:18 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:47:18.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:18 smithi203 ceph-mon[35450]: from='client.? 172.21.15.155:0/379857849' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:47:19.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:18 smithi019 ceph-mon[30976]: from='client.? 172.21.15.155:0/2662322600' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad15f762-aeab-4167-a63d-6c9f9b89b9c0"}]: dispatch 2024-09-19T08:47:19.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:18 smithi019 ceph-mon[30976]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad15f762-aeab-4167-a63d-6c9f9b89b9c0"}]: dispatch 2024-09-19T08:47:19.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:18 smithi019 ceph-mon[30976]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ad15f762-aeab-4167-a63d-6c9f9b89b9c0"}]': finished 2024-09-19T08:47:19.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:18 smithi019 ceph-mon[30976]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T08:47:19.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:18 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:47:19.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:18 smithi019 ceph-mon[30976]: from='client.? 172.21.15.155:0/379857849' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:47:19.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:19 smithi203 ceph-mon[35450]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:20.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:19 smithi019 ceph-mon[30976]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:20.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:19 smithi155 ceph-mon[34921]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:21.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:21 smithi203 ceph-mon[35450]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:22.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:21 smithi019 ceph-mon[30976]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:22.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:21 smithi155 ceph-mon[34921]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:23.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:23 smithi203 ceph-mon[35450]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:24.037 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:23 smithi155 ceph-mon[34921]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:24.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:23 smithi019 ceph-mon[30976]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:25.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:25 smithi203 ceph-mon[35450]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:26.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:25 smithi019 ceph-mon[30976]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:26.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:25 smithi155 ceph-mon[34921]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:26.892 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:26 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T08:47:26.892 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:26 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:47:26.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:26 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T08:47:26.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:26 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:47:27.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:26 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T08:47:27.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:26 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:47:27.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:27 smithi155 ceph-mon[34921]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:27.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:27 smithi155 ceph-mon[34921]: Deploying daemon osd.7 on smithi155 2024-09-19T08:47:27.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:27 smithi203 ceph-mon[35450]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:27.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:27 smithi203 ceph-mon[35450]: Deploying daemon osd.7 on smithi155 2024-09-19T08:47:28.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:27 smithi019 ceph-mon[30976]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:28.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:27 smithi019 ceph-mon[30976]: Deploying daemon osd.7 on smithi155 2024-09-19T08:47:29.857 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:29 smithi155 ceph-mon[34921]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:29.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:29 smithi203 ceph-mon[35450]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:30.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:29 smithi019 ceph-mon[30976]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:31.962 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:31 smithi155 ceph-mon[34921]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:31.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:31 smithi203 ceph-mon[35450]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:32.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:31 smithi019 ceph-mon[30976]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:32.980 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:32 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:47:32.981 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:32 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:32.981 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:32 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:32.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:32 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:47:32.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:32 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:32.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:32 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:33.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:32 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:47:33.096 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:32 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:33.097 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:32 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:33.980 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:33 smithi155 ceph-mon[34921]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:33.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:33 smithi203 ceph-mon[35450]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:34.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:33 smithi019 ceph-mon[30976]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:35.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:35 smithi155 ceph-mon[34921]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:35.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:35 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:35.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:35 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:35.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:35 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:47:35.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:35 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:47:35.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:35 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:36.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:35 smithi019 ceph-mon[30976]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:36.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:35 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:36.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:35 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:36.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:35 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:47:36.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:35 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:47:36.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:35 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:36.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:35 smithi203 ceph-mon[35450]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:36.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:35 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:36.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:35 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:36.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:35 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:47:36.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:35 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:47:36.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:35 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:36.359 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:36.359+0000 7fe5d0ff9640 1 -- 172.21.15.155:0/1583796507 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe5d4062630 con 0x7fe5bc0a32f0 2024-09-19T08:47:36.359 INFO:teuthology.orchestra.run.smithi155.stdout:Created osd(s) 7 on host 'smithi155' 2024-09-19T08:47:36.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:36.361+0000 7fe5d9df0640 1 -- 172.21.15.155:0/1583796507 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe5bc0a32f0 msgr2=0x7fe5bc0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:36.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:36.361+0000 7fe5d9df0640 1 --2- 172.21.15.155:0/1583796507 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe5bc0a32f0 0x7fe5bc0a57b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe5c40314e0 tx=0x7fe5c4000bc0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:36.361+0000 7fe5d9df0640 1 -- 172.21.15.155:0/1583796507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5d41078c0 msgr2=0x7fe5d419f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:36.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:36.361+0000 7fe5d9df0640 1 --2- 172.21.15.155:0/1583796507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5d41078c0 0x7fe5d419f4e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe5cc00eaa0 tx=0x7fe5cc00ef60 comp rx=0 tx=0).stop 2024-09-19T08:47:36.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:36.361+0000 7fe5d9df0640 1 -- 172.21.15.155:0/1583796507 shutdown_connections 2024-09-19T08:47:36.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:36.361+0000 7fe5d9df0640 1 --2- 172.21.15.155:0/1583796507 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe5bc0a32f0 0x7fe5bc0a57b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.364 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:36.361+0000 7fe5d9df0640 1 --2- 172.21.15.155:0/1583796507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5d41078c0 0x7fe5d419f4e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:36.361+0000 7fe5d9df0640 1 --2- 172.21.15.155:0/1583796507 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5d4104f90 0x7fe5d4198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:36.361+0000 7fe5d9df0640 1 --2- 172.21.15.155:0/1583796507 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe5d4102660 0x7fe5d4197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:36.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:36.361+0000 7fe5d9df0640 1 -- 172.21.15.155:0/1583796507 >> 172.21.15.155:0/1583796507 conn(0x7fe5d40fc280 msgr2=0x7fe5d4102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:36.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:36.361+0000 7fe5d9df0640 1 -- 172.21.15.155:0/1583796507 shutdown_connections 2024-09-19T08:47:36.365 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:47:36.361+0000 7fe5d9df0640 1 -- 172.21.15.155:0/1583796507 wait complete. 2024-09-19T08:47:37.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:36 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:47:37.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:36 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:37.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:36 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:37.070 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:36 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:47:37.070 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:36 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:37.070 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:36 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:37.104 DEBUG:teuthology.orchestra.run.smithi155:osd.7> sudo journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@osd.7.service 2024-09-19T08:47:37.107 INFO:tasks.cephadm:Deploying osd.8 on smithi203 with /dev/vg_nvme/lv_2... 2024-09-19T08:47:37.107 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T08:47:37.135 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:36 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:47:37.135 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:36 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:37.135 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:36 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:37.360 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:47:37.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:37 smithi155 ceph-mon[34921]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:38.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:37 smithi019 ceph-mon[30976]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:38.412 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:37 smithi203 ceph-mon[35450]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:38.574 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:47:38 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T08:47:38.426+0000 7fbd8fbd7640 -1 osd.7 0 log_to_monitors true 2024-09-19T08:47:38.785 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:38 smithi203 ceph-mon[35450]: from='osd.7 [v2:172.21.15.155:6816/3169455907,v1:172.21.15.155:6817/3169455907]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:47:38.785 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:38 smithi203 ceph-mon[35450]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:47:38.856 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:38 smithi155 ceph-mon[34921]: from='osd.7 [v2:172.21.15.155:6816/3169455907,v1:172.21.15.155:6817/3169455907]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:47:38.856 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:38 smithi155 ceph-mon[34921]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:47:39.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:38 smithi019 ceph-mon[30976]: from='osd.7 [v2:172.21.15.155:6816/3169455907,v1:172.21.15.155:6817/3169455907]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:47:39.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:38 smithi019 ceph-mon[30976]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T08:47:39.894 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:39 smithi203 ceph-mon[35450]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:39.895 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:39 smithi203 ceph-mon[35450]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T08:47:39.895 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:39 smithi203 ceph-mon[35450]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T08:47:39.895 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:39 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:47:39.895 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:39 smithi203 ceph-mon[35450]: from='osd.7 [v2:172.21.15.155:6816/3169455907,v1:172.21.15.155:6817/3169455907]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:47:39.895 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:39 smithi203 ceph-mon[35450]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:47:39.897 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T08:47:39.930 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi203:vg_nvme/lv_2 2024-09-19T08:47:40.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:39 smithi019 ceph-mon[30976]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:40.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:39 smithi019 ceph-mon[30976]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T08:47:40.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:39 smithi019 ceph-mon[30976]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T08:47:40.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:39 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:47:40.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:39 smithi019 ceph-mon[30976]: from='osd.7 [v2:172.21.15.155:6816/3169455907,v1:172.21.15.155:6817/3169455907]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:47:40.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:39 smithi019 ceph-mon[30976]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:47:40.143 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:47:39 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T08:47:39.759+0000 7fbd8bb5a640 -1 osd.7 0 waiting for initial osdmap 2024-09-19T08:47:40.143 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 08:47:39 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T08:47:39.769+0000 7fbd87982640 -1 osd.7 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:47:40.143 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:39 smithi155 ceph-mon[34921]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:40.143 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:39 smithi155 ceph-mon[34921]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T08:47:40.144 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:39 smithi155 ceph-mon[34921]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T08:47:40.144 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:39 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:47:40.144 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:39 smithi155 ceph-mon[34921]: from='osd.7 [v2:172.21.15.155:6816/3169455907,v1:172.21.15.155:6817/3169455907]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:47:40.144 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:39 smithi155 ceph-mon[34921]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:47:40.227 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:47:40.715 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.691+0000 7f684014b640 1 -- 172.21.15.203:0/983563189 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6838104f90 msgr2=0x7f6838107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:40.715 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.691+0000 7f684014b640 1 --2- 172.21.15.203:0/983563189 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6838104f90 0x7f6838107380 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6834009900 tx=0x7f683402a410 comp rx=0 tx=0).stop 2024-09-19T08:47:40.715 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.691+0000 7f684014b640 1 -- 172.21.15.203:0/983563189 shutdown_connections 2024-09-19T08:47:40.715 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.691+0000 7f684014b640 1 --2- 172.21.15.203:0/983563189 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6838104f90 0x7f6838107380 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.715 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.691+0000 7f684014b640 1 --2- 172.21.15.203:0/983563189 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68381078c0 0x7f6838109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.715 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.691+0000 7f684014b640 1 --2- 172.21.15.203:0/983563189 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6838102660 0x7f6838104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.715 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.691+0000 7f684014b640 1 -- 172.21.15.203:0/983563189 >> 172.21.15.203:0/983563189 conn(0x7f68380fc280 msgr2=0x7f68380fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:47:40.715 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.691+0000 7f684014b640 1 -- 172.21.15.203:0/983563189 shutdown_connections 2024-09-19T08:47:40.715 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.691+0000 7f684014b640 1 -- 172.21.15.203:0/983563189 wait complete. 2024-09-19T08:47:40.715 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.691+0000 7f684014b640 1 Processor -- start 2024-09-19T08:47:40.716 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.691+0000 7f684014b640 1 -- start start 2024-09-19T08:47:40.716 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.692+0000 7f684014b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6838102660 0x7f6838197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:40.716 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.692+0000 7f684014b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6838104f90 0x7f68381984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:40.716 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.692+0000 7f684014b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68381078c0 0x7f683819f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:40.716 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.692+0000 7f684014b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f683810d860 con 0x7f6838104f90 2024-09-19T08:47:40.716 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.692+0000 7f684014b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f683810d6e0 con 0x7f6838102660 2024-09-19T08:47:40.716 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.692+0000 7f684014b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f683810d9e0 con 0x7f68381078c0 2024-09-19T08:47:40.716 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.692+0000 7f683e6e8640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68381078c0 0x7f683819f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:40.716 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.692+0000 7f683e6e8640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68381078c0 0x7f683819f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:36820/0 (socket says 172.21.15.203:36820) 2024-09-19T08:47:40.716 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.692+0000 7f683e6e8640 1 -- 172.21.15.203:0/1744419695 learned_addr learned my addr 172.21.15.203:0/1744419695 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-19T08:47:40.716 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.692+0000 7f683dee7640 1 --2- 172.21.15.203:0/1744419695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6838102660 0x7f6838197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:40.716 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.692+0000 7f683d6e6640 1 --2- 172.21.15.203:0/1744419695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6838104f90 0x7f68381984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:40.717 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.692+0000 7f683e6e8640 1 -- 172.21.15.203:0/1744419695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6838102660 msgr2=0x7f6838197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:40.717 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.692+0000 7f683e6e8640 1 --2- 172.21.15.203:0/1744419695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6838102660 0x7f6838197f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.717 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.692+0000 7f683e6e8640 1 -- 172.21.15.203:0/1744419695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6838104f90 msgr2=0x7f68381984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:47:40.717 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.692+0000 7f683e6e8640 1 --2- 172.21.15.203:0/1744419695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6838104f90 0x7f68381984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:47:40.717 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.692+0000 7f683e6e8640 1 -- 172.21.15.203:0/1744419695 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f683819fba0 con 0x7f68381078c0 2024-09-19T08:47:40.717 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.692+0000 7f683d6e6640 1 --2- 172.21.15.203:0/1744419695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6838104f90 0x7f68381984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:47:40.717 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.692+0000 7f683e6e8640 1 --2- 172.21.15.203:0/1744419695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68381078c0 0x7f683819f530 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6830009fd0 tx=0x7f683000b260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:40.717 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.692+0000 7f682effd640 1 -- 172.21.15.203:0/1744419695 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6830017070 con 0x7f68381078c0 2024-09-19T08:47:40.717 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.692+0000 7f682effd640 1 -- 172.21.15.203:0/1744419695 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6830003e50 con 0x7f68381078c0 2024-09-19T08:47:40.717 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.692+0000 7f684014b640 1 -- 172.21.15.203:0/1744419695 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f683819fe90 con 0x7f68381078c0 2024-09-19T08:47:40.717 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.692+0000 7f682effd640 1 -- 172.21.15.203:0/1744419695 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68300106c0 con 0x7f68381078c0 2024-09-19T08:47:40.717 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.693+0000 7f684014b640 1 -- 172.21.15.203:0/1744419695 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68381a02f0 con 0x7f68381078c0 2024-09-19T08:47:40.717 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.694+0000 7f684014b640 1 -- 172.21.15.203:0/1744419695 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68380fdd70 con 0x7f68381078c0 2024-09-19T08:47:40.718 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.695+0000 7f682effd640 1 -- 172.21.15.203:0/1744419695 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f6830003970 con 0x7f68381078c0 2024-09-19T08:47:40.718 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.695+0000 7f682effd640 1 --2- 172.21.15.203:0/1744419695 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f68240a3270 0x7f68240a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:47:40.718 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.695+0000 7f682effd640 1 -- 172.21.15.203:0/1744419695 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5430+0+0 (secure 0 0 0) 0x7f68300cebc0 con 0x7f68381078c0 2024-09-19T08:47:40.718 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.696+0000 7f683dee7640 1 --2- 172.21.15.203:0/1744419695 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f68240a3270 0x7f68240a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:47:40.718 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.696+0000 7f683dee7640 1 --2- 172.21.15.203:0/1744419695 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f68240a3270 0x7f68240a5730 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6828009b60 tx=0x7f6828005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:47:40.718 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.699+0000 7f682effd640 1 -- 172.21.15.203:0/1744419695 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f683009c420 con 0x7f68381078c0 2024-09-19T08:47:40.873 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:47:40.874+0000 7f684014b640 1 -- 172.21.15.203:0/1744419695 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f6838062630 con 0x7f68240a3270 2024-09-19T08:47:40.874 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:40 smithi203 ceph-mon[35450]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-19T08:47:40.874 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:40 smithi203 ceph-mon[35450]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T08:47:40.874 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:40 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:47:40.874 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:40 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:47:40.874 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:40 smithi203 ceph-mon[35450]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:40.874 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:40 smithi203 ceph-mon[35450]: Detected new or changed devices on smithi155 2024-09-19T08:47:40.874 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:40 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:40.874 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:40 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:40.874 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:40 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:47:40.875 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:40 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:47:40.875 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:40 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:47:40.875 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:40 smithi203 ceph-mon[35450]: Adjusting osd_memory_target on smithi155 to 5696M 2024-09-19T08:47:40.875 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:40 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:40.875 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:40 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:47:40.875 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:40 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:47:40.875 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:40 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:40.875 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:40 smithi203 ceph-mon[35450]: osd.7 [v2:172.21.15.155:6816/3169455907,v1:172.21.15.155:6817/3169455907] boot 2024-09-19T08:47:40.875 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:40 smithi203 ceph-mon[35450]: osdmap e48: 8 total, 8 up, 8 in 2024-09-19T08:47:40.875 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:40 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:47:41.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:40 smithi019 ceph-mon[30976]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-19T08:47:41.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:40 smithi019 ceph-mon[30976]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T08:47:41.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:40 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:47:41.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:40 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:47:41.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:40 smithi019 ceph-mon[30976]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:41.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:40 smithi019 ceph-mon[30976]: Detected new or changed devices on smithi155 2024-09-19T08:47:41.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:40 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:41.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:40 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:41.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:40 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:47:41.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:40 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:47:41.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:40 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:47:41.072 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:40 smithi019 ceph-mon[30976]: Adjusting osd_memory_target on smithi155 to 5696M 2024-09-19T08:47:41.072 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:40 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:41.072 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:40 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:47:41.072 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:40 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:47:41.072 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:40 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:41.072 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:40 smithi019 ceph-mon[30976]: osd.7 [v2:172.21.15.155:6816/3169455907,v1:172.21.15.155:6817/3169455907] boot 2024-09-19T08:47:41.072 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:40 smithi019 ceph-mon[30976]: osdmap e48: 8 total, 8 up, 8 in 2024-09-19T08:47:41.073 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:40 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:47:41.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:40 smithi155 ceph-mon[34921]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-19T08:47:41.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:40 smithi155 ceph-mon[34921]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T08:47:41.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:40 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:47:41.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:40 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:47:41.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:40 smithi155 ceph-mon[34921]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 196 MiB used, 626 GiB / 626 GiB avail 2024-09-19T08:47:41.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:40 smithi155 ceph-mon[34921]: Detected new or changed devices on smithi155 2024-09-19T08:47:41.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:40 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:41.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:40 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:41.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:40 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:47:41.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:40 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:47:41.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:40 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:47:41.175 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:40 smithi155 ceph-mon[34921]: Adjusting osd_memory_target on smithi155 to 5696M 2024-09-19T08:47:41.175 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:40 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:41.175 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:40 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:47:41.175 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:40 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:47:41.175 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:40 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:41.175 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:40 smithi155 ceph-mon[34921]: osd.7 [v2:172.21.15.155:6816/3169455907,v1:172.21.15.155:6817/3169455907] boot 2024-09-19T08:47:41.175 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:40 smithi155 ceph-mon[34921]: osdmap e48: 8 total, 8 up, 8 in 2024-09-19T08:47:41.175 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:40 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T08:47:41.939 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:41 smithi203 ceph-mon[35450]: purged_snaps scrub starts 2024-09-19T08:47:41.939 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:41 smithi203 ceph-mon[35450]: purged_snaps scrub ok 2024-09-19T08:47:41.939 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:41 smithi203 ceph-mon[35450]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:47:41.939 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:41 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:47:41.939 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:41 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:47:41.939 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:41 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:47:41.939 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:41 smithi203 ceph-mon[35450]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T08:47:42.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:41 smithi019 ceph-mon[30976]: purged_snaps scrub starts 2024-09-19T08:47:42.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:41 smithi019 ceph-mon[30976]: purged_snaps scrub ok 2024-09-19T08:47:42.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:41 smithi019 ceph-mon[30976]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:47:42.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:41 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:47:42.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:41 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:47:42.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:41 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:47:42.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:41 smithi019 ceph-mon[30976]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T08:47:42.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:41 smithi155 ceph-mon[34921]: purged_snaps scrub starts 2024-09-19T08:47:42.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:41 smithi155 ceph-mon[34921]: purged_snaps scrub ok 2024-09-19T08:47:42.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:41 smithi155 ceph-mon[34921]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:47:42.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:41 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:47:42.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:41 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:47:42.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:41 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:47:42.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:41 smithi155 ceph-mon[34921]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T08:47:43.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:43 smithi155 ceph-mon[34921]: pgmap v169: 1 pgs: 1 remapped; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:47:43.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:43 smithi155 ceph-mon[34921]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T08:47:43.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:43 smithi155 ceph-mon[34921]: from='client.? 172.21.15.203:0/1403328531' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23cf8ea2-29d6-43d8-a05b-7822f4bbf254"}]: dispatch 2024-09-19T08:47:43.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:43 smithi155 ceph-mon[34921]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23cf8ea2-29d6-43d8-a05b-7822f4bbf254"}]: dispatch 2024-09-19T08:47:43.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:43 smithi155 ceph-mon[34921]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23cf8ea2-29d6-43d8-a05b-7822f4bbf254"}]': finished 2024-09-19T08:47:43.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:43 smithi155 ceph-mon[34921]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T08:47:43.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:43 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:47:43.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:43 smithi203 ceph-mon[35450]: pgmap v169: 1 pgs: 1 remapped; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:47:43.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:43 smithi203 ceph-mon[35450]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T08:47:43.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:43 smithi203 ceph-mon[35450]: from='client.? 172.21.15.203:0/1403328531' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23cf8ea2-29d6-43d8-a05b-7822f4bbf254"}]: dispatch 2024-09-19T08:47:43.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:43 smithi203 ceph-mon[35450]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23cf8ea2-29d6-43d8-a05b-7822f4bbf254"}]: dispatch 2024-09-19T08:47:43.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:43 smithi203 ceph-mon[35450]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23cf8ea2-29d6-43d8-a05b-7822f4bbf254"}]': finished 2024-09-19T08:47:43.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:43 smithi203 ceph-mon[35450]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T08:47:43.733 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:43 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:47:43.743 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:43 smithi019 ceph-mon[30976]: pgmap v169: 1 pgs: 1 remapped; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:47:43.743 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:43 smithi019 ceph-mon[30976]: osdmap e50: 8 total, 8 up, 8 in 2024-09-19T08:47:43.743 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:43 smithi019 ceph-mon[30976]: from='client.? 172.21.15.203:0/1403328531' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23cf8ea2-29d6-43d8-a05b-7822f4bbf254"}]: dispatch 2024-09-19T08:47:43.743 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:43 smithi019 ceph-mon[30976]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "23cf8ea2-29d6-43d8-a05b-7822f4bbf254"}]: dispatch 2024-09-19T08:47:43.743 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:43 smithi019 ceph-mon[30976]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "23cf8ea2-29d6-43d8-a05b-7822f4bbf254"}]': finished 2024-09-19T08:47:43.743 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:43 smithi019 ceph-mon[30976]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T08:47:43.743 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:43 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:47:44.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:44 smithi155 ceph-mon[34921]: from='client.? 172.21.15.203:0/402414640' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:47:44.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:44 smithi155 ceph-mon[34921]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T08:47:44.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:44 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:47:44.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:44 smithi203 ceph-mon[35450]: from='client.? 172.21.15.203:0/402414640' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:47:44.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:44 smithi203 ceph-mon[35450]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T08:47:44.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:44 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:47:44.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:44 smithi019 ceph-mon[30976]: from='client.? 172.21.15.203:0/402414640' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:47:44.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:44 smithi019 ceph-mon[30976]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T08:47:44.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:44 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:47:45.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:45 smithi155 ceph-mon[34921]: pgmap v172: 1 pgs: 1 remapped; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:47:45.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:45 smithi203 ceph-mon[35450]: pgmap v172: 1 pgs: 1 remapped; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:47:45.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:45 smithi019 ceph-mon[30976]: pgmap v172: 1 pgs: 1 remapped; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:47:47.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:47 smithi155 ceph-mon[34921]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:47:47.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:47 smithi203 ceph-mon[35450]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:47:47.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:47 smithi019 ceph-mon[30976]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:47:49.616 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:49 smithi203 ceph-mon[35450]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:47:49.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:49 smithi155 ceph-mon[34921]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:47:49.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:49 smithi019 ceph-mon[30976]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:47:51.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:51 smithi155 ceph-mon[34921]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:47:51.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:51 smithi203 ceph-mon[35450]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:47:51.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:51 smithi019 ceph-mon[30976]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:47:52.449 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:52 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T08:47:52.449 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:52 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:47:52.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:52 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T08:47:52.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:52 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:47:52.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:52 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T08:47:52.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:52 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:47:53.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:53 smithi203 ceph-mon[35450]: Deploying daemon osd.8 on smithi203 2024-09-19T08:47:53.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:53 smithi203 ceph-mon[35450]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:47:53.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:53 smithi155 ceph-mon[34921]: Deploying daemon osd.8 on smithi203 2024-09-19T08:47:53.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:53 smithi155 ceph-mon[34921]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:47:53.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:53 smithi019 ceph-mon[30976]: Deploying daemon osd.8 on smithi203 2024-09-19T08:47:53.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:53 smithi019 ceph-mon[30976]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:47:55.414 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:55 smithi203 ceph-mon[35450]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:47:55.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:55 smithi155 ceph-mon[34921]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:47:55.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:55 smithi019 ceph-mon[30976]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:47:57.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:57 smithi203 ceph-mon[35450]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:47:57.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:57 smithi155 ceph-mon[34921]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:47:57.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:57 smithi019 ceph-mon[30976]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:47:58.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:58 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:47:58.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:58 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:58.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:58 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:58.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:58 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:47:58.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:58 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:58.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:58 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:58.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:58 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:47:58.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:58 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:58.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:58 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:47:59.661 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:47:59 smithi203 ceph-mon[35450]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:47:59.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:47:59 smithi155 ceph-mon[34921]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:47:59.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:47:59 smithi019 ceph-mon[30976]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:48:01.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:01 smithi203 ceph-mon[35450]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:48:01.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:01 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:01.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:01 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:01.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:01 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:01.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:01 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:01.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:01 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:01.555 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:01.555+0000 7f682effd640 1 -- 172.21.15.203:0/1744419695 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6838062630 con 0x7f68240a3270 2024-09-19T08:48:01.556 INFO:teuthology.orchestra.run.smithi203.stdout:Created osd(s) 8 on host 'smithi203' 2024-09-19T08:48:01.558 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:01.557+0000 7f684014b640 1 -- 172.21.15.203:0/1744419695 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f68240a3270 msgr2=0x7f68240a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:01.558 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:01.557+0000 7f684014b640 1 --2- 172.21.15.203:0/1744419695 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f68240a3270 0x7f68240a5730 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6828009b60 tx=0x7f6828005f90 comp rx=0 tx=0).stop 2024-09-19T08:48:01.558 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:01.557+0000 7f684014b640 1 -- 172.21.15.203:0/1744419695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68381078c0 msgr2=0x7f683819f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:01.558 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:01.557+0000 7f684014b640 1 --2- 172.21.15.203:0/1744419695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68381078c0 0x7f683819f530 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6830009fd0 tx=0x7f683000b260 comp rx=0 tx=0).stop 2024-09-19T08:48:01.558 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:01.558+0000 7f684014b640 1 -- 172.21.15.203:0/1744419695 shutdown_connections 2024-09-19T08:48:01.558 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:01.558+0000 7f684014b640 1 --2- 172.21.15.203:0/1744419695 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f68240a3270 0x7f68240a5730 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:01.559 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:01.558+0000 7f684014b640 1 --2- 172.21.15.203:0/1744419695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68381078c0 0x7f683819f530 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:01.559 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:01.558+0000 7f684014b640 1 --2- 172.21.15.203:0/1744419695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6838104f90 0x7f68381984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:01.559 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:01.558+0000 7f684014b640 1 --2- 172.21.15.203:0/1744419695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6838102660 0x7f6838197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:01.559 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:01.558+0000 7f684014b640 1 -- 172.21.15.203:0/1744419695 >> 172.21.15.203:0/1744419695 conn(0x7f68380fc280 msgr2=0x7f6838103020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:01.559 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:01.558+0000 7f684014b640 1 -- 172.21.15.203:0/1744419695 shutdown_connections 2024-09-19T08:48:01.559 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:01.558+0000 7f684014b640 1 -- 172.21.15.203:0/1744419695 wait complete. 2024-09-19T08:48:01.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:01 smithi019 ceph-mon[30976]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:48:01.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:01 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:01.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:01 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:01.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:01 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:01.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:01 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:01.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:01 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:01.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:01 smithi155 ceph-mon[34921]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:48:01.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:01 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:01.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:01 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:01.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:01 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:01.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:01 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:01.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:01 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:02.227 DEBUG:teuthology.orchestra.run.smithi203:osd.8> sudo journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@osd.8.service 2024-09-19T08:48:02.229 INFO:tasks.cephadm:Deploying osd.9 on smithi019 with /dev/vg_nvme/lv_1... 2024-09-19T08:48:02.229 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T08:48:02.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:02 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:02.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:02 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:02.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:02 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:02.495 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:48:02.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:02 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:02.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:02 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:02.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:02 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:02.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:02 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:02.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:02 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:02.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:02 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:03.694 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:03 smithi203 ceph-mon[35450]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:48:03.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:03 smithi019 ceph-mon[30976]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:48:03.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:03 smithi155 ceph-mon[34921]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:48:04.408 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:48:04 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T08:48:04.124+0000 7ff2a55c3640 -1 osd.8 0 log_to_monitors true 2024-09-19T08:48:04.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:04 smithi203 ceph-mon[35450]: from='osd.8 [v2:172.21.15.203:6816/1062999528,v1:172.21.15.203:6817/1062999528]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:48:04.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:04 smithi203 ceph-mon[35450]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:48:04.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:04 smithi019 ceph-mon[30976]: from='osd.8 [v2:172.21.15.203:6816/1062999528,v1:172.21.15.203:6817/1062999528]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:48:04.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:04 smithi019 ceph-mon[30976]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:48:04.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:04 smithi155 ceph-mon[34921]: from='osd.8 [v2:172.21.15.203:6816/1062999528,v1:172.21.15.203:6817/1062999528]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:48:04.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:04 smithi155 ceph-mon[34921]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T08:48:05.429 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:48:05.456 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi019:vg_nvme/lv_1 2024-09-19T08:48:05.713 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:48:05.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:05 smithi019 ceph-mon[30976]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:48:05.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:05 smithi019 ceph-mon[30976]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T08:48:05.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:05 smithi019 ceph-mon[30976]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T08:48:05.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:05 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:48:05.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:05 smithi019 ceph-mon[30976]: from='osd.8 [v2:172.21.15.203:6816/1062999528,v1:172.21.15.203:6817/1062999528]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:48:05.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:05 smithi019 ceph-mon[30976]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:48:05.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:05 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:05.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:05 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:05.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:05 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:05.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:05 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:05.820 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:05 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:05.820 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:05 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:05.820 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:05 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:05.820 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:05 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:05.820 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:05 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:05.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:05 smithi155 ceph-mon[34921]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:48:05.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:05 smithi155 ceph-mon[34921]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T08:48:05.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:05 smithi155 ceph-mon[34921]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T08:48:05.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:05 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:48:05.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:05 smithi155 ceph-mon[34921]: from='osd.8 [v2:172.21.15.203:6816/1062999528,v1:172.21.15.203:6817/1062999528]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:48:05.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:05 smithi155 ceph-mon[34921]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:48:05.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:05 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:05.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:05 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:05.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:05 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:05.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:05 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:05.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:05 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:05.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:05 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:05.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:05 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:05.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:05 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:05.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:05 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:05.973 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:05 smithi203 ceph-mon[35450]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:48:05.973 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:05 smithi203 ceph-mon[35450]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T08:48:05.973 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:05 smithi203 ceph-mon[35450]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T08:48:05.973 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:05 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:48:05.974 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:05 smithi203 ceph-mon[35450]: from='osd.8 [v2:172.21.15.203:6816/1062999528,v1:172.21.15.203:6817/1062999528]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:48:05.974 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:05 smithi203 ceph-mon[35450]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:48:05.974 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:05 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:05.974 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:05 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:05.974 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:05 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:05.974 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:05 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:05.974 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:05 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:05.974 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:05 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:05.974 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:05 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:05.974 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:05 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:05.974 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:05 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:06.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.182+0000 7f4f9a13e640 1 -- 172.21.15.19:0/612995577 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f941037c0 msgr2=0x7f4f9410a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:06.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.182+0000 7f4f9a13e640 1 --2- 172.21.15.19:0/612995577 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f941037c0 0x7f4f9410a050 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c009ca0 tx=0x7f4f8c02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:48:06.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.182+0000 7f4f9a13e640 1 -- 172.21.15.19:0/612995577 shutdown_connections 2024-09-19T08:48:06.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.182+0000 7f4f9a13e640 1 --2- 172.21.15.19:0/612995577 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f94102e00 0x7f4f94103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:06.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.182+0000 7f4f9a13e640 1 --2- 172.21.15.19:0/612995577 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f941037c0 0x7f4f9410a050 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:06.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.182+0000 7f4f9a13e640 1 --2- 172.21.15.19:0/612995577 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f94101c00 0x7f4f94102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:06.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.182+0000 7f4f9a13e640 1 -- 172.21.15.19:0/612995577 >> 172.21.15.19:0/612995577 conn(0x7f4f940fd390 msgr2=0x7f4f940ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:06.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.182+0000 7f4f9a13e640 1 -- 172.21.15.19:0/612995577 shutdown_connections 2024-09-19T08:48:06.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.182+0000 7f4f9a13e640 1 -- 172.21.15.19:0/612995577 wait complete. 2024-09-19T08:48:06.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.183+0000 7f4f9a13e640 1 Processor -- start 2024-09-19T08:48:06.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.183+0000 7f4f9a13e640 1 -- start start 2024-09-19T08:48:06.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.183+0000 7f4f9a13e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f94101c00 0x7f4f94197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:06.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.183+0000 7f4f9a13e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f94102e00 0x7f4f941983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:06.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.183+0000 7f4f9a13e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f941037c0 0x7f4f9419f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:06.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.183+0000 7f4f9a13e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9410d860 con 0x7f4f94102e00 2024-09-19T08:48:06.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.183+0000 7f4f9a13e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9410d6e0 con 0x7f4f941037c0 2024-09-19T08:48:06.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.183+0000 7f4f9a13e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9410d9e0 con 0x7f4f94101c00 2024-09-19T08:48:06.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.183+0000 7f4f92ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f94102e00 0x7f4f941983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:06.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.183+0000 7f4f92ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f94102e00 0x7f4f941983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49208/0 (socket says 172.21.15.19:49208) 2024-09-19T08:48:06.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.183+0000 7f4f92ffd640 1 -- 172.21.15.19:0/523404156 learned_addr learned my addr 172.21.15.19:0/523404156 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:48:06.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.184+0000 7f4f937fe640 1 --2- 172.21.15.19:0/523404156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f94101c00 0x7f4f94197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:06.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.184+0000 7f4f93fff640 1 --2- 172.21.15.19:0/523404156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f941037c0 0x7f4f9419f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:06.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.184+0000 7f4f92ffd640 1 -- 172.21.15.19:0/523404156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f94101c00 msgr2=0x7f4f94197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:06.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.184+0000 7f4f92ffd640 1 --2- 172.21.15.19:0/523404156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f94101c00 0x7f4f94197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:06.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.184+0000 7f4f92ffd640 1 -- 172.21.15.19:0/523404156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f941037c0 msgr2=0x7f4f9419f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:06.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.184+0000 7f4f92ffd640 1 --2- 172.21.15.19:0/523404156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f941037c0 0x7f4f9419f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:06.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.184+0000 7f4f92ffd640 1 -- 172.21.15.19:0/523404156 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f9419fab0 con 0x7f4f94102e00 2024-09-19T08:48:06.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.184+0000 7f4f93fff640 1 --2- 172.21.15.19:0/523404156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f941037c0 0x7f4f9419f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:48:06.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.184+0000 7f4f92ffd640 1 --2- 172.21.15.19:0/523404156 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f94102e00 0x7f4f941983c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4f8800d950 tx=0x7f4f8800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:06.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.184+0000 7f4f90ff9640 1 -- 172.21.15.19:0/523404156 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f88017030 con 0x7f4f94102e00 2024-09-19T08:48:06.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.184+0000 7f4f9a13e640 1 -- 172.21.15.19:0/523404156 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f9419fda0 con 0x7f4f94102e00 2024-09-19T08:48:06.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.184+0000 7f4f90ff9640 1 -- 172.21.15.19:0/523404156 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f88004020 con 0x7f4f94102e00 2024-09-19T08:48:06.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.184+0000 7f4f90ff9640 1 -- 172.21.15.19:0/523404156 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f880047a0 con 0x7f4f94102e00 2024-09-19T08:48:06.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.184+0000 7f4f9a13e640 1 -- 172.21.15.19:0/523404156 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f941a0260 con 0x7f4f94102e00 2024-09-19T08:48:06.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.185+0000 7f4f9a13e640 1 -- 172.21.15.19:0/523404156 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f94109000 con 0x7f4f94102e00 2024-09-19T08:48:06.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.186+0000 7f4f90ff9640 1 -- 172.21.15.19:0/523404156 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f4f880041d0 con 0x7f4f94102e00 2024-09-19T08:48:06.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.187+0000 7f4f90ff9640 1 --2- 172.21.15.19:0/523404156 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4f7c0a3270 0x7f4f7c0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:06.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.187+0000 7f4f937fe640 1 --2- 172.21.15.19:0/523404156 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4f7c0a3270 0x7f4f7c0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:06.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.187+0000 7f4f90ff9640 1 -- 172.21.15.19:0/523404156 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5549+0+0 (secure 0 0 0) 0x7f4f880ce7e0 con 0x7f4f94102e00 2024-09-19T08:48:06.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.188+0000 7f4f937fe640 1 --2- 172.21.15.19:0/523404156 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4f7c0a3270 0x7f4f7c0a5730 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4f94102c60 tx=0x7f4f8400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:06.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.191+0000 7f4f90ff9640 1 -- 172.21.15.19:0/523404156 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4f8809bfd0 con 0x7f4f94102e00 2024-09-19T08:48:06.231 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:48:05 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T08:48:05.972+0000 7ff2a1546640 -1 osd.8 0 waiting for initial osdmap 2024-09-19T08:48:06.231 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 08:48:05 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T08:48:05.983+0000 7ff299366640 -1 osd.8 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:48:06.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:06.376+0000 7f4f9a13e640 1 -- 172.21.15.19:0/523404156 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f4f94062630 con 0x7f4f7c0a3270 2024-09-19T08:48:06.795 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:06 smithi019 ceph-mon[30976]: Detected new or changed devices on smithi203 2024-09-19T08:48:06.795 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:06 smithi019 ceph-mon[30976]: Adjusting osd_memory_target on smithi203 to 5696M 2024-09-19T08:48:06.795 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:06 smithi019 ceph-mon[30976]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-19T08:48:06.795 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:06 smithi019 ceph-mon[30976]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T08:48:06.796 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:06 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:48:06.796 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:06 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:48:06.796 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:06 smithi019 ceph-mon[30976]: from='osd.8 ' entity='osd.8' 2024-09-19T08:48:06.796 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:06 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:48:06.796 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:06 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:48:06.796 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:06 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:06.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:06 smithi155 ceph-mon[34921]: Detected new or changed devices on smithi203 2024-09-19T08:48:06.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:06 smithi155 ceph-mon[34921]: Adjusting osd_memory_target on smithi203 to 5696M 2024-09-19T08:48:06.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:06 smithi155 ceph-mon[34921]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-19T08:48:06.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:06 smithi155 ceph-mon[34921]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T08:48:06.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:06 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:48:06.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:06 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:48:06.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:06 smithi155 ceph-mon[34921]: from='osd.8 ' entity='osd.8' 2024-09-19T08:48:06.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:06 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:48:06.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:06 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:48:06.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:06 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:06.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:06 smithi203 ceph-mon[35450]: Detected new or changed devices on smithi203 2024-09-19T08:48:06.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:06 smithi203 ceph-mon[35450]: Adjusting osd_memory_target on smithi203 to 5696M 2024-09-19T08:48:06.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:06 smithi203 ceph-mon[35450]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-19T08:48:06.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:06 smithi203 ceph-mon[35450]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T08:48:06.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:06 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:48:06.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:06 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:48:06.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:06 smithi203 ceph-mon[35450]: from='osd.8 ' entity='osd.8' 2024-09-19T08:48:06.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:06 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:48:06.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:06 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:48:06.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:06 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:07.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:07 smithi155 ceph-mon[34921]: purged_snaps scrub starts 2024-09-19T08:48:07.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:07 smithi155 ceph-mon[34921]: purged_snaps scrub ok 2024-09-19T08:48:07.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:07 smithi155 ceph-mon[34921]: pgmap v186: 1 pgs: 1 peering; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:48:07.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:07 smithi155 ceph-mon[34921]: from='client.14427 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:48:07.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:07 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:48:07.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:07 smithi155 ceph-mon[34921]: osd.8 [v2:172.21.15.203:6816/1062999528,v1:172.21.15.203:6817/1062999528] boot 2024-09-19T08:48:07.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:07 smithi155 ceph-mon[34921]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T08:48:07.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:07 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:48:07.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:07 smithi203 ceph-mon[35450]: purged_snaps scrub starts 2024-09-19T08:48:07.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:07 smithi203 ceph-mon[35450]: purged_snaps scrub ok 2024-09-19T08:48:07.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:07 smithi203 ceph-mon[35450]: pgmap v186: 1 pgs: 1 peering; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:48:07.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:07 smithi203 ceph-mon[35450]: from='client.14427 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:48:07.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:07 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:48:07.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:07 smithi203 ceph-mon[35450]: osd.8 [v2:172.21.15.203:6816/1062999528,v1:172.21.15.203:6817/1062999528] boot 2024-09-19T08:48:07.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:07 smithi203 ceph-mon[35450]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T08:48:07.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:07 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:48:08.064 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:07 smithi019 ceph-mon[30976]: purged_snaps scrub starts 2024-09-19T08:48:08.064 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:07 smithi019 ceph-mon[30976]: purged_snaps scrub ok 2024-09-19T08:48:08.064 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:07 smithi019 ceph-mon[30976]: pgmap v186: 1 pgs: 1 peering; 577 KiB data, 223 MiB used, 715 GiB / 715 GiB avail 2024-09-19T08:48:08.064 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:07 smithi019 ceph-mon[30976]: from='client.14427 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi019:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:48:08.064 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:07 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:48:08.065 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:07 smithi019 ceph-mon[30976]: osd.8 [v2:172.21.15.203:6816/1062999528,v1:172.21.15.203:6817/1062999528] boot 2024-09-19T08:48:08.065 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:07 smithi019 ceph-mon[30976]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T08:48:08.065 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:07 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T08:48:08.794 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:08 smithi019 ceph-mon[30976]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T08:48:08.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:08 smithi155 ceph-mon[34921]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T08:48:08.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:08 smithi203 ceph-mon[35450]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T08:48:09.706 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:09 smithi019 ceph-mon[30976]: pgmap v189: 1 pgs: 1 peering; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:48:09.706 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:09 smithi019 ceph-mon[30976]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T08:48:09.706 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:09 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/2717976464' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e851e605-2d17-4fbf-b783-2138133edd06"}]: dispatch 2024-09-19T08:48:09.706 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:09 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/2717976464' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e851e605-2d17-4fbf-b783-2138133edd06"}]': finished 2024-09-19T08:48:09.706 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:09 smithi019 ceph-mon[30976]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T08:48:09.707 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:09 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:48:09.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:09 smithi155 ceph-mon[34921]: pgmap v189: 1 pgs: 1 peering; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:48:09.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:09 smithi155 ceph-mon[34921]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T08:48:09.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:09 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/2717976464' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e851e605-2d17-4fbf-b783-2138133edd06"}]: dispatch 2024-09-19T08:48:09.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:09 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/2717976464' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e851e605-2d17-4fbf-b783-2138133edd06"}]': finished 2024-09-19T08:48:09.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:09 smithi155 ceph-mon[34921]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T08:48:09.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:09 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:48:09.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:09 smithi203 ceph-mon[35450]: pgmap v189: 1 pgs: 1 peering; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:48:09.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:09 smithi203 ceph-mon[35450]: osdmap e57: 9 total, 9 up, 9 in 2024-09-19T08:48:09.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:09 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/2717976464' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e851e605-2d17-4fbf-b783-2138133edd06"}]: dispatch 2024-09-19T08:48:09.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:09 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/2717976464' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e851e605-2d17-4fbf-b783-2138133edd06"}]': finished 2024-09-19T08:48:09.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:09 smithi203 ceph-mon[35450]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T08:48:09.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:09 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:48:10.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:10 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3305444512' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:48:10.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:10 smithi155 ceph-mon[34921]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T08:48:10.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:10 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:48:10.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:10 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3305444512' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:48:10.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:10 smithi203 ceph-mon[35450]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T08:48:10.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:10 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:48:11.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:10 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3305444512' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:48:11.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:10 smithi019 ceph-mon[30976]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T08:48:11.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:10 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:48:11.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:11 smithi155 ceph-mon[34921]: pgmap v192: 1 pgs: 1 peering; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:48:11.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:11 smithi203 ceph-mon[35450]: pgmap v192: 1 pgs: 1 peering; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:48:12.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:11 smithi019 ceph-mon[30976]: pgmap v192: 1 pgs: 1 peering; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:48:13.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:13 smithi155 ceph-mon[34921]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 137 KiB/s, 0 objects/s recovering 2024-09-19T08:48:13.986 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:13 smithi203 ceph-mon[35450]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 137 KiB/s, 0 objects/s recovering 2024-09-19T08:48:14.047 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:13 smithi019 ceph-mon[30976]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 137 KiB/s, 0 objects/s recovering 2024-09-19T08:48:15.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:15 smithi019 ceph-mon[30976]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T08:48:15.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:15 smithi155 ceph-mon[34921]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T08:48:15.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:15 smithi203 ceph-mon[35450]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T08:48:17.793 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:17 smithi019 ceph-mon[30976]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-19T08:48:17.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:17 smithi155 ceph-mon[34921]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-19T08:48:17.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:17 smithi203 ceph-mon[35450]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 80 KiB/s, 0 objects/s recovering 2024-09-19T08:48:18.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:18 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T08:48:18.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:18 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:18.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:18 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T08:48:18.958 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:18 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:18.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:18 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T08:48:18.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:18 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:19.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:19 smithi019 ceph-mon[30976]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-19T08:48:19.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:19 smithi019 ceph-mon[30976]: Deploying daemon osd.9 on smithi019 2024-09-19T08:48:19.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:19 smithi155 ceph-mon[34921]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-19T08:48:19.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:19 smithi155 ceph-mon[34921]: Deploying daemon osd.9 on smithi019 2024-09-19T08:48:19.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:19 smithi203 ceph-mon[35450]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-09-19T08:48:19.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:19 smithi203 ceph-mon[35450]: Deploying daemon osd.9 on smithi019 2024-09-19T08:48:21.798 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:21 smithi019 ceph-mon[30976]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T08:48:21.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:21 smithi155 ceph-mon[34921]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T08:48:21.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:21 smithi203 ceph-mon[35450]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T08:48:23.738 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:23 smithi019 ceph-mon[30976]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T08:48:23.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:23 smithi155 ceph-mon[34921]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T08:48:23.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:23 smithi203 ceph-mon[35450]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T08:48:24.816 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:24 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:24.816 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:24 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:24.817 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:24 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:24.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:24 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:24.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:24 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:24.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:24 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:24.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:24 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:24.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:24 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:24.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:24 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:25.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:25 smithi019 ceph-mon[30976]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:48:25.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:25 smithi155 ceph-mon[34921]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:48:25.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:25 smithi203 ceph-mon[35450]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:48:27.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:27 smithi155 ceph-mon[34921]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:48:27.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:27 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:27.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:27 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:27.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:27 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:27.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:27 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:27.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:27 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:27.979 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:27 smithi019 ceph-mon[30976]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:48:27.980 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:27 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:27.980 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:27 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:27.980 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:27 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:27.980 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:27 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:27.980 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:27 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:27.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:27 smithi203 ceph-mon[35450]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:48:27.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:27 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:27.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:27 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:27.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:27 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:27.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:27 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:27.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:27 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:28.022 INFO:teuthology.orchestra.run.smithi019.stdout:Created osd(s) 9 on host 'smithi019' 2024-09-19T08:48:28.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:28.021+0000 7f4f90ff9640 1 -- 172.21.15.19:0/523404156 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4f94062630 con 0x7f4f7c0a3270 2024-09-19T08:48:28.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:28.024+0000 7f4f9a13e640 1 -- 172.21.15.19:0/523404156 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4f7c0a3270 msgr2=0x7f4f7c0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:28.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:28.024+0000 7f4f9a13e640 1 --2- 172.21.15.19:0/523404156 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4f7c0a3270 0x7f4f7c0a5730 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4f94102c60 tx=0x7f4f8400a2d0 comp rx=0 tx=0).stop 2024-09-19T08:48:28.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:28.024+0000 7f4f9a13e640 1 -- 172.21.15.19:0/523404156 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f94102e00 msgr2=0x7f4f941983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:28.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:28.024+0000 7f4f9a13e640 1 --2- 172.21.15.19:0/523404156 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f94102e00 0x7f4f941983c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4f8800d950 tx=0x7f4f8800de10 comp rx=0 tx=0).stop 2024-09-19T08:48:28.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:28.024+0000 7f4f9a13e640 1 -- 172.21.15.19:0/523404156 shutdown_connections 2024-09-19T08:48:28.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:28.024+0000 7f4f9a13e640 1 --2- 172.21.15.19:0/523404156 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4f7c0a3270 0x7f4f7c0a5730 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:28.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:28.024+0000 7f4f9a13e640 1 --2- 172.21.15.19:0/523404156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f941037c0 0x7f4f9419f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:28.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:28.024+0000 7f4f9a13e640 1 --2- 172.21.15.19:0/523404156 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f94102e00 0x7f4f941983c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:28.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:28.024+0000 7f4f9a13e640 1 --2- 172.21.15.19:0/523404156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f94101c00 0x7f4f94197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:28.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:28.024+0000 7f4f9a13e640 1 -- 172.21.15.19:0/523404156 >> 172.21.15.19:0/523404156 conn(0x7f4f940fd390 msgr2=0x7f4f941061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:28.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:28.024+0000 7f4f9a13e640 1 -- 172.21.15.19:0/523404156 shutdown_connections 2024-09-19T08:48:28.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:48:28.024+0000 7f4f9a13e640 1 -- 172.21.15.19:0/523404156 wait complete. 2024-09-19T08:48:28.726 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:28 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:28.726 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:28 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:28.726 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:28 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:28.755 DEBUG:teuthology.orchestra.run.smithi019:osd.9> sudo journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@osd.9.service 2024-09-19T08:48:28.758 INFO:tasks.cephadm:Deploying osd.10 on smithi155 with /dev/vg_nvme/lv_1... 2024-09-19T08:48:28.758 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T08:48:28.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:28 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:28.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:28 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:28.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:28 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:28.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:28 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:28.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:28 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:28.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:28 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:29.014 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:48:29.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:29 smithi019 ceph-mon[30976]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:48:29.819 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 08:48:29 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T08:48:29.670+0000 7f2bf55e3640 -1 osd.9 0 log_to_monitors true 2024-09-19T08:48:29.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:29 smithi155 ceph-mon[34921]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:48:29.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:29 smithi203 ceph-mon[35450]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:48:30.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:30 smithi155 ceph-mon[34921]: from='osd.9 [v2:172.21.15.19:6826/574664786,v1:172.21.15.19:6827/574664786]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T08:48:30.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:30 smithi203 ceph-mon[35450]: from='osd.9 [v2:172.21.15.19:6826/574664786,v1:172.21.15.19:6827/574664786]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T08:48:31.003 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:30 smithi019 ceph-mon[30976]: from='osd.9 [v2:172.21.15.19:6826/574664786,v1:172.21.15.19:6827/574664786]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T08:48:31.819 INFO:teuthology.orchestra.run.smithi155.stdout: 2024-09-19T08:48:31.845 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi155:vg_nvme/lv_1 2024-09-19T08:48:31.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:31 smithi155 ceph-mon[34921]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:48:31.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:31 smithi155 ceph-mon[34921]: from='osd.9 [v2:172.21.15.19:6826/574664786,v1:172.21.15.19:6827/574664786]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T08:48:31.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:31 smithi155 ceph-mon[34921]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T08:48:31.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:31 smithi155 ceph-mon[34921]: from='osd.9 [v2:172.21.15.19:6826/574664786,v1:172.21.15.19:6827/574664786]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]: dispatch 2024-09-19T08:48:31.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:31 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:48:31.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:31 smithi203 ceph-mon[35450]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:48:31.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:31 smithi203 ceph-mon[35450]: from='osd.9 [v2:172.21.15.19:6826/574664786,v1:172.21.15.19:6827/574664786]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T08:48:31.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:31 smithi203 ceph-mon[35450]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T08:48:31.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:31 smithi203 ceph-mon[35450]: from='osd.9 [v2:172.21.15.19:6826/574664786,v1:172.21.15.19:6827/574664786]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]: dispatch 2024-09-19T08:48:31.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:31 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:48:32.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:31 smithi019 ceph-mon[30976]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:48:32.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:31 smithi019 ceph-mon[30976]: from='osd.9 [v2:172.21.15.19:6826/574664786,v1:172.21.15.19:6827/574664786]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T08:48:32.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:31 smithi019 ceph-mon[30976]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T08:48:32.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:31 smithi019 ceph-mon[30976]: from='osd.9 [v2:172.21.15.19:6826/574664786,v1:172.21.15.19:6827/574664786]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]: dispatch 2024-09-19T08:48:32.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:31 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:48:32.101 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T08:48:32.568 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 08:48:32 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T08:48:32.096+0000 7f2bf1566640 -1 osd.9 0 waiting for initial osdmap 2024-09-19T08:48:32.568 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 08:48:32 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T08:48:32.108+0000 7f2be9386640 -1 osd.9 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:48:32.611 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.594+0000 7f4602a95640 1 -- 172.21.15.155:0/4143485001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45fc1026c0 msgr2=0x7f45fc108f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:32.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.594+0000 7f4602a95640 1 --2- 172.21.15.155:0/4143485001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45fc1026c0 0x7f45fc108f50 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f45f4009ca0 tx=0x7f45f402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:48:32.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.594+0000 7f4602a95640 1 -- 172.21.15.155:0/4143485001 shutdown_connections 2024-09-19T08:48:32.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.594+0000 7f4602a95640 1 --2- 172.21.15.155:0/4143485001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45fc1026c0 0x7f45fc108f50 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:32.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.594+0000 7f4602a95640 1 --2- 172.21.15.155:0/4143485001 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45fc101d00 0x7f45fc102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:32.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.594+0000 7f4602a95640 1 --2- 172.21.15.155:0/4143485001 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f45fc100b00 0x7f45fc100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:32.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.594+0000 7f4602a95640 1 -- 172.21.15.155:0/4143485001 >> 172.21.15.155:0/4143485001 conn(0x7f45fc0fc290 msgr2=0x7f45fc0fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:32.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.595+0000 7f4602a95640 1 -- 172.21.15.155:0/4143485001 shutdown_connections 2024-09-19T08:48:32.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.595+0000 7f4602a95640 1 -- 172.21.15.155:0/4143485001 wait complete. 2024-09-19T08:48:32.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.595+0000 7f4602a95640 1 Processor -- start 2024-09-19T08:48:32.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.595+0000 7f4602a95640 1 -- start start 2024-09-19T08:48:32.612 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.595+0000 7f4602a95640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45fc100b00 0x7f45fc06b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:32.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.595+0000 7f4602a95640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45fc101d00 0x7f45fc19cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:32.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.595+0000 7f4602a95640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f45fc1026c0 0x7f45fc19f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:32.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.595+0000 7f4602a95640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f45fc10c780 con 0x7f45fc100b00 2024-09-19T08:48:32.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.595+0000 7f4602a95640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f45fc10c600 con 0x7f45fc101d00 2024-09-19T08:48:32.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.595+0000 7f4602a95640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f45fc10c900 con 0x7f45fc1026c0 2024-09-19T08:48:32.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.595+0000 7f45fbfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45fc101d00 0x7f45fc19cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:32.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.596+0000 7f45fbfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45fc101d00 0x7f45fc19cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.155:37902/0 (socket says 172.21.15.155:37902) 2024-09-19T08:48:32.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.596+0000 7f45fbfff640 1 -- 172.21.15.155:0/1984439408 learned_addr learned my addr 172.21.15.155:0/1984439408 (peer_addr_for_me v2:172.21.15.155:0/0) 2024-09-19T08:48:32.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.596+0000 7f4600831640 1 --2- 172.21.15.155:0/1984439408 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45fc100b00 0x7f45fc06b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:32.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.596+0000 7f4601032640 1 --2- 172.21.15.155:0/1984439408 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f45fc1026c0 0x7f45fc19f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:32.613 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.596+0000 7f45fbfff640 1 -- 172.21.15.155:0/1984439408 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f45fc1026c0 msgr2=0x7f45fc19f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:32.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.596+0000 7f45fbfff640 1 --2- 172.21.15.155:0/1984439408 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f45fc1026c0 0x7f45fc19f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:32.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.596+0000 7f45fbfff640 1 -- 172.21.15.155:0/1984439408 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45fc100b00 msgr2=0x7f45fc06b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:32.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.596+0000 7f45fbfff640 1 --2- 172.21.15.155:0/1984439408 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45fc100b00 0x7f45fc06b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:32.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.596+0000 7f45fbfff640 1 -- 172.21.15.155:0/1984439408 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45fc19fb30 con 0x7f45fc101d00 2024-09-19T08:48:32.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.596+0000 7f45fbfff640 1 --2- 172.21.15.155:0/1984439408 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45fc101d00 0x7f45fc19cc00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f45e800d950 tx=0x7f45e800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:32.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.596+0000 7f45f9ffb640 1 -- 172.21.15.155:0/1984439408 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e8017070 con 0x7f45fc101d00 2024-09-19T08:48:32.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.596+0000 7f4602a95640 1 -- 172.21.15.155:0/1984439408 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45fc19fdc0 con 0x7f45fc101d00 2024-09-19T08:48:32.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.596+0000 7f45f9ffb640 1 -- 172.21.15.155:0/1984439408 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45e8009c30 con 0x7f45fc101d00 2024-09-19T08:48:32.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.596+0000 7f45f9ffb640 1 -- 172.21.15.155:0/1984439408 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e800f6b0 con 0x7f45fc101d00 2024-09-19T08:48:32.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.596+0000 7f4602a95640 1 -- 172.21.15.155:0/1984439408 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45fc1a0270 con 0x7f45fc101d00 2024-09-19T08:48:32.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.597+0000 7f4602a95640 1 -- 172.21.15.155:0/1984439408 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45fc107f50 con 0x7f45fc101d00 2024-09-19T08:48:32.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.598+0000 7f45f9ffb640 1 -- 172.21.15.155:0/1984439408 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f45e80109d0 con 0x7f45fc101d00 2024-09-19T08:48:32.614 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.599+0000 7f45f9ffb640 1 --2- 172.21.15.155:0/1984439408 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f45ec0a3240 0x7f45ec0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:32.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.599+0000 7f4600831640 1 --2- 172.21.15.155:0/1984439408 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f45ec0a3240 0x7f45ec0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:32.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.599+0000 7f45f9ffb640 1 -- 172.21.15.155:0/1984439408 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 5981+0+0 (secure 0 0 0) 0x7f45e80ceb70 con 0x7f45fc101d00 2024-09-19T08:48:32.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.600+0000 7f4600831640 1 --2- 172.21.15.155:0/1984439408 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f45ec0a3240 0x7f45ec0a5700 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f45fc101b60 tx=0x7f45f0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:32.615 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.604+0000 7f45f9ffb640 1 -- 172.21.15.155:0/1984439408 <== mon.2 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f45e8009de0 con 0x7f45fc101d00 2024-09-19T08:48:32.782 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:32.782+0000 7f4602a95640 1 -- 172.21.15.155:0/1984439408 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f45fc062630 con 0x7f45ec0a3240 2024-09-19T08:48:32.782 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:32 smithi155 ceph-mon[34921]: from='osd.9 [v2:172.21.15.19:6826/574664786,v1:172.21.15.19:6827/574664786]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-09-19T08:48:32.782 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:32 smithi155 ceph-mon[34921]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T08:48:32.782 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:32 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:48:32.782 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:32 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:48:32.783 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:32 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:32.783 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:32 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:32.783 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:32 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:32.783 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:32 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:32.783 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:32 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:32.783 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:32 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:32.783 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:32 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:32.783 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:32 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:32.783 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:32 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:32.783 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:32 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:32.783 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:32 smithi155 ceph-mon[34921]: from='osd.9 [v2:172.21.15.19:6826/574664786,v1:172.21.15.19:6827/574664786]' entity='osd.9' 2024-09-19T08:48:32.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:32 smithi203 ceph-mon[35450]: from='osd.9 [v2:172.21.15.19:6826/574664786,v1:172.21.15.19:6827/574664786]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-09-19T08:48:32.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:32 smithi203 ceph-mon[35450]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T08:48:32.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:32 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:48:32.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:32 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:48:32.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:32 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:32.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:32 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:32.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:32 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:32.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:32 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:32.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:32 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:32.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:32 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:32.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:32 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:32.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:32 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:32.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:32 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:32.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:32 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:32.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:32 smithi203 ceph-mon[35450]: from='osd.9 [v2:172.21.15.19:6826/574664786,v1:172.21.15.19:6827/574664786]' entity='osd.9' 2024-09-19T08:48:33.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:32 smithi019 ceph-mon[30976]: from='osd.9 [v2:172.21.15.19:6826/574664786,v1:172.21.15.19:6827/574664786]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi019", "root=default"]}]': finished 2024-09-19T08:48:33.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:32 smithi019 ceph-mon[30976]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T08:48:33.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:32 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:48:33.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:32 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:48:33.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:32 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:33.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:32 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:33.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:32 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:33.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:32 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:33.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:32 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:33.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:32 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:33.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:32 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:33.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:32 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:33.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:32 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:33.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:32 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:33.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:32 smithi019 ceph-mon[30976]: from='osd.9 [v2:172.21.15.19:6826/574664786,v1:172.21.15.19:6827/574664786]' entity='osd.9' 2024-09-19T08:48:33.892 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:33 smithi155 ceph-mon[34921]: purged_snaps scrub starts 2024-09-19T08:48:33.892 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:33 smithi155 ceph-mon[34921]: purged_snaps scrub ok 2024-09-19T08:48:33.892 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:33 smithi155 ceph-mon[34921]: Detected new or changed devices on smithi019 2024-09-19T08:48:33.892 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:33 smithi155 ceph-mon[34921]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:48:33.892 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:33 smithi155 ceph-mon[34921]: Adjusting osd_memory_target on smithi019 to 4273M 2024-09-19T08:48:33.892 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:33 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:48:33.892 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:33 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:48:33.892 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:33 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:48:33.893 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:33 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:33.893 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:33 smithi155 ceph-mon[34921]: osd.9 [v2:172.21.15.19:6826/574664786,v1:172.21.15.19:6827/574664786] boot 2024-09-19T08:48:33.893 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:33 smithi155 ceph-mon[34921]: osdmap e62: 10 total, 10 up, 10 in 2024-09-19T08:48:33.893 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:33 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:48:33.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:33 smithi203 ceph-mon[35450]: purged_snaps scrub starts 2024-09-19T08:48:33.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:33 smithi203 ceph-mon[35450]: purged_snaps scrub ok 2024-09-19T08:48:33.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:33 smithi203 ceph-mon[35450]: Detected new or changed devices on smithi019 2024-09-19T08:48:33.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:33 smithi203 ceph-mon[35450]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:48:33.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:33 smithi203 ceph-mon[35450]: Adjusting osd_memory_target on smithi019 to 4273M 2024-09-19T08:48:33.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:33 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:48:33.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:33 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:48:33.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:33 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:48:33.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:33 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:33.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:33 smithi203 ceph-mon[35450]: osd.9 [v2:172.21.15.19:6826/574664786,v1:172.21.15.19:6827/574664786] boot 2024-09-19T08:48:33.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:33 smithi203 ceph-mon[35450]: osdmap e62: 10 total, 10 up, 10 in 2024-09-19T08:48:33.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:33 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:48:34.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:33 smithi019 ceph-mon[30976]: purged_snaps scrub starts 2024-09-19T08:48:34.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:33 smithi019 ceph-mon[30976]: purged_snaps scrub ok 2024-09-19T08:48:34.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:33 smithi019 ceph-mon[30976]: Detected new or changed devices on smithi019 2024-09-19T08:48:34.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:33 smithi019 ceph-mon[30976]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-09-19T08:48:34.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:33 smithi019 ceph-mon[30976]: Adjusting osd_memory_target on smithi019 to 4273M 2024-09-19T08:48:34.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:33 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:48:34.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:33 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:48:34.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:33 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:48:34.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:33 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:34.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:33 smithi019 ceph-mon[30976]: osd.9 [v2:172.21.15.19:6826/574664786,v1:172.21.15.19:6827/574664786] boot 2024-09-19T08:48:34.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:33 smithi019 ceph-mon[30976]: osdmap e62: 10 total, 10 up, 10 in 2024-09-19T08:48:34.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:33 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T08:48:34.829 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:34 smithi155 ceph-mon[34921]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:48:34.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:34 smithi203 ceph-mon[35450]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:48:35.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:34 smithi019 ceph-mon[30976]: from='client.24347 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi155:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:48:35.877 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:35 smithi155 ceph-mon[34921]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:48:35.878 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:35 smithi155 ceph-mon[34921]: osdmap e63: 10 total, 10 up, 10 in 2024-09-19T08:48:35.878 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:35 smithi155 ceph-mon[34921]: from='client.? 172.21.15.155:0/546229538' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc770717-91bd-4494-9103-6db8214b5872"}]: dispatch 2024-09-19T08:48:35.878 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:35 smithi155 ceph-mon[34921]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc770717-91bd-4494-9103-6db8214b5872"}]: dispatch 2024-09-19T08:48:35.878 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:35 smithi155 ceph-mon[34921]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cc770717-91bd-4494-9103-6db8214b5872"}]': finished 2024-09-19T08:48:35.878 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:35 smithi155 ceph-mon[34921]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T08:48:35.878 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:35 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:48:35.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:35 smithi203 ceph-mon[35450]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:48:35.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:35 smithi203 ceph-mon[35450]: osdmap e63: 10 total, 10 up, 10 in 2024-09-19T08:48:35.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:35 smithi203 ceph-mon[35450]: from='client.? 172.21.15.155:0/546229538' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc770717-91bd-4494-9103-6db8214b5872"}]: dispatch 2024-09-19T08:48:35.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:35 smithi203 ceph-mon[35450]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc770717-91bd-4494-9103-6db8214b5872"}]: dispatch 2024-09-19T08:48:35.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:35 smithi203 ceph-mon[35450]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cc770717-91bd-4494-9103-6db8214b5872"}]': finished 2024-09-19T08:48:35.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:35 smithi203 ceph-mon[35450]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T08:48:35.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:35 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:48:36.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:35 smithi019 ceph-mon[30976]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:48:36.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:35 smithi019 ceph-mon[30976]: osdmap e63: 10 total, 10 up, 10 in 2024-09-19T08:48:36.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:35 smithi019 ceph-mon[30976]: from='client.? 172.21.15.155:0/546229538' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc770717-91bd-4494-9103-6db8214b5872"}]: dispatch 2024-09-19T08:48:36.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:35 smithi019 ceph-mon[30976]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc770717-91bd-4494-9103-6db8214b5872"}]: dispatch 2024-09-19T08:48:36.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:35 smithi019 ceph-mon[30976]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cc770717-91bd-4494-9103-6db8214b5872"}]': finished 2024-09-19T08:48:36.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:35 smithi019 ceph-mon[30976]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T08:48:36.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:35 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:48:36.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:36 smithi203 ceph-mon[35450]: from='client.? 172.21.15.155:0/80368124' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:48:37.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:36 smithi019 ceph-mon[30976]: from='client.? 172.21.15.155:0/80368124' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:48:37.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:36 smithi155 ceph-mon[34921]: from='client.? 172.21.15.155:0/80368124' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:48:37.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:37 smithi203 ceph-mon[35450]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:48:38.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:37 smithi019 ceph-mon[30976]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:48:38.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:37 smithi155 ceph-mon[34921]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 286 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:48:39.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:39 smithi203 ceph-mon[35450]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:48:40.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:39 smithi019 ceph-mon[30976]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:48:40.099 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:39 smithi155 ceph-mon[34921]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:48:41.846 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:41 smithi155 ceph-mon[34921]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:48:41.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:41 smithi203 ceph-mon[35450]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:48:42.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:41 smithi019 ceph-mon[30976]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:48:43.947 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:43 smithi155 ceph-mon[34921]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:48:43.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:43 smithi203 ceph-mon[35450]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:48:44.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:43 smithi019 ceph-mon[30976]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:48:44.828 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:44 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T08:48:44.828 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:44 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:44.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:44 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T08:48:44.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:44 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:45.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:44 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T08:48:45.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:44 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:45.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:45 smithi155 ceph-mon[34921]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:48:45.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:45 smithi155 ceph-mon[34921]: Deploying daemon osd.10 on smithi155 2024-09-19T08:48:45.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:45 smithi203 ceph-mon[35450]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:48:45.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:45 smithi203 ceph-mon[35450]: Deploying daemon osd.10 on smithi155 2024-09-19T08:48:46.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:45 smithi019 ceph-mon[30976]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:48:46.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:45 smithi019 ceph-mon[30976]: Deploying daemon osd.10 on smithi155 2024-09-19T08:48:47.970 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:47 smithi155 ceph-mon[34921]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:48:47.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:47 smithi203 ceph-mon[35450]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:48:48.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:47 smithi019 ceph-mon[30976]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:48:49.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:49 smithi155 ceph-mon[34921]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:48:49.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:49 smithi203 ceph-mon[35450]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:48:50.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:49 smithi019 ceph-mon[30976]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:48:50.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:50 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:50.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:50 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:50.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:50 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:50.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:50 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:50.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:50 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:50.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:50 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:51.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:50 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:51.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:50 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:51.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:50 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:51.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:51 smithi203 ceph-mon[35450]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:48:52.065 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:51 smithi155 ceph-mon[34921]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:48:52.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:51 smithi019 ceph-mon[30976]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:48:53.955 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:53.955+0000 7f45f9ffb640 1 -- 172.21.15.155:0/1984439408 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f45fc062630 con 0x7f45ec0a3240 2024-09-19T08:48:53.956 INFO:teuthology.orchestra.run.smithi155.stdout:Created osd(s) 10 on host 'smithi155' 2024-09-19T08:48:53.956 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:53 smithi155 ceph-mon[34921]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:48:53.956 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:53 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:53.956 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:53 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:53.956 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:53 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:53.956 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:53 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:53.956 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:53 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:53.957 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:53.957+0000 7f4602a95640 1 -- 172.21.15.155:0/1984439408 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f45ec0a3240 msgr2=0x7f45ec0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:53.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:53.957+0000 7f4602a95640 1 --2- 172.21.15.155:0/1984439408 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f45ec0a3240 0x7f45ec0a5700 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f45fc101b60 tx=0x7f45f0005f90 comp rx=0 tx=0).stop 2024-09-19T08:48:53.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:53.957+0000 7f4602a95640 1 -- 172.21.15.155:0/1984439408 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45fc101d00 msgr2=0x7f45fc19cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:53.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:53.957+0000 7f4602a95640 1 --2- 172.21.15.155:0/1984439408 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45fc101d00 0x7f45fc19cc00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f45e800d950 tx=0x7f45e800de10 comp rx=0 tx=0).stop 2024-09-19T08:48:53.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:53.958+0000 7f4602a95640 1 -- 172.21.15.155:0/1984439408 shutdown_connections 2024-09-19T08:48:53.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:53.958+0000 7f4602a95640 1 --2- 172.21.15.155:0/1984439408 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f45ec0a3240 0x7f45ec0a5700 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:53.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:53.958+0000 7f4602a95640 1 --2- 172.21.15.155:0/1984439408 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f45fc1026c0 0x7f45fc19f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:53.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:53.958+0000 7f4602a95640 1 --2- 172.21.15.155:0/1984439408 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45fc101d00 0x7f45fc19cc00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:53.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:53.958+0000 7f4602a95640 1 --2- 172.21.15.155:0/1984439408 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45fc100b00 0x7f45fc06b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:53.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:53.958+0000 7f4602a95640 1 -- 172.21.15.155:0/1984439408 >> 172.21.15.155:0/1984439408 conn(0x7f45fc0fc290 msgr2=0x7f45fc105120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:53.958 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:53.958+0000 7f4602a95640 1 -- 172.21.15.155:0/1984439408 shutdown_connections 2024-09-19T08:48:53.959 INFO:teuthology.orchestra.run.smithi155.stderr:2024-09-19T08:48:53.958+0000 7f4602a95640 1 -- 172.21.15.155:0/1984439408 wait complete. 2024-09-19T08:48:53.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:53 smithi203 ceph-mon[35450]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:48:53.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:53 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:53.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:53 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:53.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:53 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:53.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:53 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:53.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:53 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:54.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:53 smithi019 ceph-mon[30976]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:48:54.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:53 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:54.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:53 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:54.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:53 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:54.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:53 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:54.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:53 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:54.686 DEBUG:teuthology.orchestra.run.smithi155:osd.10> sudo journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@osd.10.service 2024-09-19T08:48:54.689 INFO:tasks.cephadm:Deploying osd.11 on smithi203 with /dev/vg_nvme/lv_1... 2024-09-19T08:48:54.689 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T08:48:54.911 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:54 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:54.911 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:54 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:54.911 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:54 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:54.947 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:48:54.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:54 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:54.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:54 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:54.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:54 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:55.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:54 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:48:55.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:54 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:55.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:54 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:55.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:55 smithi203 ceph-mon[35450]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:48:55.983 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:55 smithi155 ceph-mon[34921]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:48:56.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:55 smithi019 ceph-mon[30976]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:48:56.299 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:48:55 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T08:48:55.982+0000 7f5a2bb57640 -1 osd.10 0 log_to_monitors true 2024-09-19T08:48:56.950 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:56 smithi203 ceph-mon[35450]: from='osd.10 [v2:172.21.15.155:6824/2242158832,v1:172.21.15.155:6825/2242158832]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T08:48:56.950 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:56 smithi203 ceph-mon[35450]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T08:48:57.059 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:56 smithi155 ceph-mon[34921]: from='osd.10 [v2:172.21.15.155:6824/2242158832,v1:172.21.15.155:6825/2242158832]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T08:48:57.059 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:56 smithi155 ceph-mon[34921]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T08:48:57.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:56 smithi019 ceph-mon[30976]: from='osd.10 [v2:172.21.15.155:6824/2242158832,v1:172.21.15.155:6825/2242158832]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T08:48:57.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:56 smithi019 ceph-mon[30976]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T08:48:57.680 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-09-19T08:48:57.711 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi203:vg_nvme/lv_1 2024-09-19T08:48:57.972 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:48:57.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:57 smithi203 ceph-mon[35450]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:48:57.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:57 smithi203 ceph-mon[35450]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T08:48:57.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:57 smithi203 ceph-mon[35450]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T08:48:57.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:57 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:48:57.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:57 smithi203 ceph-mon[35450]: from='osd.10 [v2:172.21.15.155:6824/2242158832,v1:172.21.15.155:6825/2242158832]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:48:57.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:57 smithi203 ceph-mon[35450]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:48:58.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:57 smithi019 ceph-mon[30976]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:48:58.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:57 smithi019 ceph-mon[30976]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T08:48:58.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:57 smithi019 ceph-mon[30976]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T08:48:58.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:57 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:48:58.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:57 smithi019 ceph-mon[30976]: from='osd.10 [v2:172.21.15.155:6824/2242158832,v1:172.21.15.155:6825/2242158832]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:48:58.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:57 smithi019 ceph-mon[30976]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:48:58.140 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:57 smithi155 ceph-mon[34921]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:48:58.140 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:57 smithi155 ceph-mon[34921]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T08:48:58.140 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:57 smithi155 ceph-mon[34921]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T08:48:58.140 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:57 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:48:58.141 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:57 smithi155 ceph-mon[34921]: from='osd.10 [v2:172.21.15.155:6824/2242158832,v1:172.21.15.155:6825/2242158832]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:48:58.141 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:57 smithi155 ceph-mon[34921]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]: dispatch 2024-09-19T08:48:58.422 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:48:58 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T08:48:58.138+0000 7f5a27ada640 -1 osd.10 0 waiting for initial osdmap 2024-09-19T08:48:58.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 08:48:58 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T08:48:58.149+0000 7f5a1f8fa640 -1 osd.10 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:48:58.464 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.440+0000 7f9a8d3ba640 1 -- 172.21.15.203:0/3642969042 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a88104f90 msgr2=0x7f9a88107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:58.464 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.440+0000 7f9a8d3ba640 1 --2- 172.21.15.203:0/3642969042 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a88104f90 0x7f9a88107380 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9a70009900 tx=0x7f9a7002a410 comp rx=0 tx=0).stop 2024-09-19T08:48:58.464 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.440+0000 7f9a8d3ba640 1 -- 172.21.15.203:0/3642969042 shutdown_connections 2024-09-19T08:48:58.464 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.440+0000 7f9a8d3ba640 1 --2- 172.21.15.203:0/3642969042 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a88104f90 0x7f9a88107380 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:58.464 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.440+0000 7f9a8d3ba640 1 --2- 172.21.15.203:0/3642969042 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a881078c0 0x7f9a88109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:58.464 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.440+0000 7f9a8d3ba640 1 --2- 172.21.15.203:0/3642969042 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a88102660 0x7f9a88104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:58.464 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.440+0000 7f9a8d3ba640 1 -- 172.21.15.203:0/3642969042 >> 172.21.15.203:0/3642969042 conn(0x7f9a880fc280 msgr2=0x7f9a880fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:48:58.464 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.440+0000 7f9a8d3ba640 1 -- 172.21.15.203:0/3642969042 shutdown_connections 2024-09-19T08:48:58.464 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.440+0000 7f9a8d3ba640 1 -- 172.21.15.203:0/3642969042 wait complete. 2024-09-19T08:48:58.465 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.440+0000 7f9a8d3ba640 1 Processor -- start 2024-09-19T08:48:58.465 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.441+0000 7f9a8d3ba640 1 -- start start 2024-09-19T08:48:58.465 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.441+0000 7f9a8d3ba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a88102660 0x7f9a88197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:58.465 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.441+0000 7f9a8d3ba640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a88104f90 0x7f9a88198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:58.465 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.441+0000 7f9a8d3ba640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a881078c0 0x7f9a8819f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:58.465 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.441+0000 7f9a8d3ba640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8810d860 con 0x7f9a88102660 2024-09-19T08:48:58.465 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.441+0000 7f9a8d3ba640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8810d6e0 con 0x7f9a88104f90 2024-09-19T08:48:58.465 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.441+0000 7f9a8d3ba640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8810d9e0 con 0x7f9a881078c0 2024-09-19T08:48:58.465 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.441+0000 7f9a877fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a881078c0 0x7f9a8819f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:58.465 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.441+0000 7f9a877fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a881078c0 0x7f9a8819f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:41282/0 (socket says 172.21.15.203:41282) 2024-09-19T08:48:58.465 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.441+0000 7f9a877fe640 1 -- 172.21.15.203:0/1464796353 learned_addr learned my addr 172.21.15.203:0/1464796353 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-19T08:48:58.465 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.441+0000 7f9a867fc640 1 --2- 172.21.15.203:0/1464796353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a88104f90 0x7f9a88198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:58.466 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.441+0000 7f9a86ffd640 1 --2- 172.21.15.203:0/1464796353 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a88102660 0x7f9a88197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:58.466 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.441+0000 7f9a877fe640 1 -- 172.21.15.203:0/1464796353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a88104f90 msgr2=0x7f9a88198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:58.466 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.441+0000 7f9a877fe640 1 --2- 172.21.15.203:0/1464796353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a88104f90 0x7f9a88198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:58.466 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.441+0000 7f9a877fe640 1 -- 172.21.15.203:0/1464796353 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a88102660 msgr2=0x7f9a88197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:48:58.466 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.441+0000 7f9a877fe640 1 --2- 172.21.15.203:0/1464796353 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a88102660 0x7f9a88197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:48:58.466 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.441+0000 7f9a877fe640 1 -- 172.21.15.203:0/1464796353 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a8819fb70 con 0x7f9a881078c0 2024-09-19T08:48:58.466 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.441+0000 7f9a867fc640 1 --2- 172.21.15.203:0/1464796353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a88104f90 0x7f9a88198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:48:58.466 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.441+0000 7f9a877fe640 1 --2- 172.21.15.203:0/1464796353 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a881078c0 0x7f9a8819f500 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9a8000d750 tx=0x7f9a8000dc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:58.466 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.442+0000 7f9a7ffff640 1 -- 172.21.15.203:0/1464796353 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a80017070 con 0x7f9a881078c0 2024-09-19T08:48:58.466 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.442+0000 7f9a8d3ba640 1 -- 172.21.15.203:0/1464796353 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a8819fe60 con 0x7f9a881078c0 2024-09-19T08:48:58.466 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.442+0000 7f9a7ffff640 1 -- 172.21.15.203:0/1464796353 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a80005500 con 0x7f9a881078c0 2024-09-19T08:48:58.466 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.442+0000 7f9a7ffff640 1 -- 172.21.15.203:0/1464796353 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a80004d90 con 0x7f9a881078c0 2024-09-19T08:48:58.466 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.442+0000 7f9a8d3ba640 1 -- 172.21.15.203:0/1464796353 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a881a02c0 con 0x7f9a881078c0 2024-09-19T08:48:58.466 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.443+0000 7f9a8d3ba640 1 -- 172.21.15.203:0/1464796353 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a880fdd70 con 0x7f9a881078c0 2024-09-19T08:48:58.467 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.444+0000 7f9a7ffff640 1 -- 172.21.15.203:0/1464796353 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f9a80004f30 con 0x7f9a881078c0 2024-09-19T08:48:58.467 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.445+0000 7f9a7ffff640 1 --2- 172.21.15.203:0/1464796353 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9a740a3270 0x7f9a740a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:48:58.467 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.445+0000 7f9a7ffff640 1 -- 172.21.15.203:0/1464796353 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6414+0+0 (secure 0 0 0) 0x7f9a800cee70 con 0x7f9a881078c0 2024-09-19T08:48:58.467 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.445+0000 7f9a86ffd640 1 --2- 172.21.15.203:0/1464796353 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9a740a3270 0x7f9a740a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:48:58.467 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.445+0000 7f9a86ffd640 1 --2- 172.21.15.203:0/1464796353 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9a740a3270 0x7f9a740a5730 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9a78005fd0 tx=0x7f9a78009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:48:58.467 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.448+0000 7f9a7ffff640 1 -- 172.21.15.203:0/1464796353 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9a8009bcb0 con 0x7f9a881078c0 2024-09-19T08:48:58.622 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:48:58.622+0000 7f9a8d3ba640 1 -- 172.21.15.203:0/1464796353 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f9a88062630 con 0x7f9a740a3270 2024-09-19T08:48:58.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:58 smithi203 ceph-mon[35450]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-19T08:48:58.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:58 smithi203 ceph-mon[35450]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T08:48:58.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:58 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:48:58.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:58 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:48:58.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:58 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:58.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:58 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:58.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:58 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:58.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:58 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:58.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:58 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:58.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:58 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:58.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:58 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:58.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:58 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:58.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:58 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:58.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:58 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:58.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:58 smithi203 ceph-mon[35450]: from='osd.10 ' entity='osd.10' 2024-09-19T08:48:58.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:58 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:48:58.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:58 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:48:58.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:58 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:59.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:58 smithi019 ceph-mon[30976]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-19T08:48:59.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:58 smithi019 ceph-mon[30976]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T08:48:59.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:58 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:48:59.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:58 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:48:59.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:58 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:59.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:58 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:59.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:58 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:59.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:58 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:59.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:58 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:59.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:58 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:59.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:58 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:59.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:58 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:59.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:58 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:59.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:58 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:59.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:58 smithi019 ceph-mon[30976]: from='osd.10 ' entity='osd.10' 2024-09-19T08:48:59.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:58 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:48:59.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:58 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:48:59.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:58 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:59.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:58 smithi155 ceph-mon[34921]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi155", "root=default"]}]': finished 2024-09-19T08:48:59.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:58 smithi155 ceph-mon[34921]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T08:48:59.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:58 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:48:59.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:58 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:48:59.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:58 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:59.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:58 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:59.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:58 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:59.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:58 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:59.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:58 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:59.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:58 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:48:59.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:58 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:59.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:58 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:48:59.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:58 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:48:59.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:58 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:48:59.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:58 smithi155 ceph-mon[34921]: from='osd.10 ' entity='osd.10' 2024-09-19T08:48:59.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:58 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T08:48:59.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:58 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T08:48:59.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:58 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:00.057 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:59 smithi203 ceph-mon[35450]: purged_snaps scrub starts 2024-09-19T08:49:00.057 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:59 smithi203 ceph-mon[35450]: purged_snaps scrub ok 2024-09-19T08:49:00.057 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:59 smithi203 ceph-mon[35450]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:49:00.057 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:59 smithi203 ceph-mon[35450]: Detected new or changed devices on smithi155 2024-09-19T08:49:00.057 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:59 smithi203 ceph-mon[35450]: Adjusting osd_memory_target on smithi155 to 4272M 2024-09-19T08:49:00.057 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:59 smithi203 ceph-mon[35450]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:49:00.057 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:59 smithi203 ceph-mon[35450]: osd.10 [v2:172.21.15.155:6824/2242158832,v1:172.21.15.155:6825/2242158832] boot 2024-09-19T08:49:00.057 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:59 smithi203 ceph-mon[35450]: osdmap e67: 11 total, 11 up, 11 in 2024-09-19T08:49:00.058 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:59 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:49:00.058 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:48:59 smithi203 ceph-mon[35450]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T08:49:00.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:59 smithi019 ceph-mon[30976]: purged_snaps scrub starts 2024-09-19T08:49:00.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:59 smithi019 ceph-mon[30976]: purged_snaps scrub ok 2024-09-19T08:49:00.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:59 smithi019 ceph-mon[30976]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:49:00.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:59 smithi019 ceph-mon[30976]: Detected new or changed devices on smithi155 2024-09-19T08:49:00.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:59 smithi019 ceph-mon[30976]: Adjusting osd_memory_target on smithi155 to 4272M 2024-09-19T08:49:00.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:59 smithi019 ceph-mon[30976]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:49:00.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:59 smithi019 ceph-mon[30976]: osd.10 [v2:172.21.15.155:6824/2242158832,v1:172.21.15.155:6825/2242158832] boot 2024-09-19T08:49:00.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:59 smithi019 ceph-mon[30976]: osdmap e67: 11 total, 11 up, 11 in 2024-09-19T08:49:00.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:59 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:49:00.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:48:59 smithi019 ceph-mon[30976]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T08:49:00.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:59 smithi155 ceph-mon[34921]: purged_snaps scrub starts 2024-09-19T08:49:00.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:59 smithi155 ceph-mon[34921]: purged_snaps scrub ok 2024-09-19T08:49:00.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:59 smithi155 ceph-mon[34921]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 287 MiB used, 894 GiB / 894 GiB avail 2024-09-19T08:49:00.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:59 smithi155 ceph-mon[34921]: Detected new or changed devices on smithi155 2024-09-19T08:49:00.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:59 smithi155 ceph-mon[34921]: Adjusting osd_memory_target on smithi155 to 4272M 2024-09-19T08:49:00.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:59 smithi155 ceph-mon[34921]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:49:00.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:59 smithi155 ceph-mon[34921]: osd.10 [v2:172.21.15.155:6824/2242158832,v1:172.21.15.155:6825/2242158832] boot 2024-09-19T08:49:00.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:59 smithi155 ceph-mon[34921]: osdmap e67: 11 total, 11 up, 11 in 2024-09-19T08:49:00.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:59 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T08:49:00.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:48:59 smithi155 ceph-mon[34921]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T08:49:01.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:01 smithi203 ceph-mon[35450]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:49:01.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:01 smithi203 ceph-mon[35450]: osdmap e69: 11 total, 11 up, 11 in 2024-09-19T08:49:01.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:01 smithi203 ceph-mon[35450]: from='client.? 172.21.15.203:0/58432406' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c237db9-5d79-47bc-8ff6-60d09d721d5d"}]: dispatch 2024-09-19T08:49:01.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:01 smithi203 ceph-mon[35450]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c237db9-5d79-47bc-8ff6-60d09d721d5d"}]: dispatch 2024-09-19T08:49:01.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:01 smithi203 ceph-mon[35450]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c237db9-5d79-47bc-8ff6-60d09d721d5d"}]': finished 2024-09-19T08:49:01.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:01 smithi203 ceph-mon[35450]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T08:49:01.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:01 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:49:01.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:01 smithi203 ceph-mon[35450]: from='client.? 172.21.15.203:0/2893547758' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:49:01.994 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:01 smithi155 ceph-mon[34921]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:49:01.994 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:01 smithi155 ceph-mon[34921]: osdmap e69: 11 total, 11 up, 11 in 2024-09-19T08:49:01.994 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:01 smithi155 ceph-mon[34921]: from='client.? 172.21.15.203:0/58432406' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c237db9-5d79-47bc-8ff6-60d09d721d5d"}]: dispatch 2024-09-19T08:49:01.994 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:01 smithi155 ceph-mon[34921]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c237db9-5d79-47bc-8ff6-60d09d721d5d"}]: dispatch 2024-09-19T08:49:01.994 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:01 smithi155 ceph-mon[34921]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c237db9-5d79-47bc-8ff6-60d09d721d5d"}]': finished 2024-09-19T08:49:01.994 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:01 smithi155 ceph-mon[34921]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T08:49:01.995 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:01 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:49:01.995 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:01 smithi155 ceph-mon[34921]: from='client.? 172.21.15.203:0/2893547758' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:49:02.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:01 smithi019 ceph-mon[30976]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:49:02.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:01 smithi019 ceph-mon[30976]: osdmap e69: 11 total, 11 up, 11 in 2024-09-19T08:49:02.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:01 smithi019 ceph-mon[30976]: from='client.? 172.21.15.203:0/58432406' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c237db9-5d79-47bc-8ff6-60d09d721d5d"}]: dispatch 2024-09-19T08:49:02.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:01 smithi019 ceph-mon[30976]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6c237db9-5d79-47bc-8ff6-60d09d721d5d"}]: dispatch 2024-09-19T08:49:02.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:01 smithi019 ceph-mon[30976]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6c237db9-5d79-47bc-8ff6-60d09d721d5d"}]': finished 2024-09-19T08:49:02.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:01 smithi019 ceph-mon[30976]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T08:49:02.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:01 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:49:02.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:01 smithi019 ceph-mon[30976]: from='client.? 172.21.15.203:0/2893547758' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T08:49:03.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:03 smithi019 ceph-mon[30976]: pgmap v230: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T08:49:03.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:03 smithi019 ceph-mon[30976]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T08:49:03.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:03 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:49:03.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:03 smithi019 ceph-mon[30976]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-19T08:49:03.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:03 smithi155 ceph-mon[34921]: pgmap v230: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T08:49:03.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:03 smithi155 ceph-mon[34921]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T08:49:03.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:03 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:49:03.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:03 smithi155 ceph-mon[34921]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-19T08:49:03.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:03 smithi203 ceph-mon[35450]: pgmap v230: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 343 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T08:49:03.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:03 smithi203 ceph-mon[35450]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T08:49:03.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:03 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:49:03.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:03 smithi203 ceph-mon[35450]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-19T08:49:05.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:05 smithi155 ceph-mon[34921]: pgmap v232: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T08:49:05.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:05 smithi203 ceph-mon[35450]: pgmap v232: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T08:49:05.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:05 smithi019 ceph-mon[30976]: pgmap v232: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T08:49:06.225 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:06 smithi203 ceph-mon[35450]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-19T08:49:06.225 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:06 smithi203 ceph-mon[35450]: Cluster is now healthy 2024-09-19T08:49:06.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:06 smithi155 ceph-mon[34921]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-19T08:49:06.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:06 smithi155 ceph-mon[34921]: Cluster is now healthy 2024-09-19T08:49:06.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:06 smithi019 ceph-mon[30976]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-19T08:49:06.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:06 smithi019 ceph-mon[30976]: Cluster is now healthy 2024-09-19T08:49:07.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:07 smithi155 ceph-mon[34921]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T08:49:07.471 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:07 smithi203 ceph-mon[35450]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T08:49:07.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:07 smithi019 ceph-mon[30976]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T08:49:09.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:09 smithi155 ceph-mon[34921]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-19T08:49:09.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:09 smithi203 ceph-mon[35450]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-19T08:49:09.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:09 smithi019 ceph-mon[30976]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 82 KiB/s, 0 objects/s recovering 2024-09-19T08:49:10.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:10 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T08:49:10.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:10 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:10.450 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:10 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T08:49:10.450 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:10 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:10.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:10 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T08:49:10.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:10 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:11.278 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:11 smithi203 ceph-mon[35450]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-19T08:49:11.278 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:11 smithi203 ceph-mon[35450]: Deploying daemon osd.11 on smithi203 2024-09-19T08:49:11.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:11 smithi155 ceph-mon[34921]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-19T08:49:11.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:11 smithi155 ceph-mon[34921]: Deploying daemon osd.11 on smithi203 2024-09-19T08:49:11.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:11 smithi019 ceph-mon[30976]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-19T08:49:11.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:11 smithi019 ceph-mon[30976]: Deploying daemon osd.11 on smithi203 2024-09-19T08:49:13.397 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:13 smithi203 ceph-mon[35450]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T08:49:13.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:13 smithi155 ceph-mon[34921]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T08:49:13.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:13 smithi019 ceph-mon[30976]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T08:49:15.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:15 smithi155 ceph-mon[34921]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T08:49:15.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:15 smithi203 ceph-mon[35450]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T08:49:15.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:15 smithi019 ceph-mon[30976]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T08:49:16.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:16 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:49:16.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:16 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:16.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:16 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:16.470 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:16 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:49:16.470 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:16 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:16.471 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:16 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:16.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:16 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:49:16.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:16 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:16.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:16 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:17.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:17 smithi155 ceph-mon[34921]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:49:17.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:17 smithi203 ceph-mon[35450]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:49:17.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:17 smithi019 ceph-mon[30976]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T08:49:19.344 INFO:teuthology.orchestra.run.smithi203.stdout:Created osd(s) 11 on host 'smithi203' 2024-09-19T08:49:19.344 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:19.343+0000 7f9a7ffff640 1 -- 172.21.15.203:0/1464796353 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f9a88062630 con 0x7f9a740a3270 2024-09-19T08:49:19.346 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:19.346+0000 7f9a8d3ba640 1 -- 172.21.15.203:0/1464796353 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9a740a3270 msgr2=0x7f9a740a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:19.346 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:19.346+0000 7f9a8d3ba640 1 --2- 172.21.15.203:0/1464796353 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9a740a3270 0x7f9a740a5730 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9a78005fd0 tx=0x7f9a78009500 comp rx=0 tx=0).stop 2024-09-19T08:49:19.347 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:19.346+0000 7f9a8d3ba640 1 -- 172.21.15.203:0/1464796353 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a881078c0 msgr2=0x7f9a8819f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:19.347 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:19.346+0000 7f9a8d3ba640 1 --2- 172.21.15.203:0/1464796353 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a881078c0 0x7f9a8819f500 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9a8000d750 tx=0x7f9a8000dc10 comp rx=0 tx=0).stop 2024-09-19T08:49:19.347 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:19.346+0000 7f9a8d3ba640 1 -- 172.21.15.203:0/1464796353 shutdown_connections 2024-09-19T08:49:19.347 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:19.346+0000 7f9a8d3ba640 1 --2- 172.21.15.203:0/1464796353 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9a740a3270 0x7f9a740a5730 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:19.347 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:19.346+0000 7f9a8d3ba640 1 --2- 172.21.15.203:0/1464796353 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a881078c0 0x7f9a8819f500 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:19.347 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:19.346+0000 7f9a8d3ba640 1 --2- 172.21.15.203:0/1464796353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a88104f90 0x7f9a88198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:19.347 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:19.346+0000 7f9a8d3ba640 1 --2- 172.21.15.203:0/1464796353 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a88102660 0x7f9a88197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:19.347 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:19.346+0000 7f9a8d3ba640 1 -- 172.21.15.203:0/1464796353 >> 172.21.15.203:0/1464796353 conn(0x7f9a880fc280 msgr2=0x7f9a881030e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:19.347 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:19.346+0000 7f9a8d3ba640 1 -- 172.21.15.203:0/1464796353 shutdown_connections 2024-09-19T08:49:19.347 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:19.346+0000 7f9a8d3ba640 1 -- 172.21.15.203:0/1464796353 wait complete. 2024-09-19T08:49:19.975 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:19 smithi203 ceph-mon[35450]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:49:19.975 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:19 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:19.975 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:19 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:19.975 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:19 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:19.975 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:19 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:49:19.976 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:19 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:19.976 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:19 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:49:19.976 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:19 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:19.976 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:19 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:20.003 DEBUG:teuthology.orchestra.run.smithi203:osd.11> sudo journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@osd.11.service 2024-09-19T08:49:20.006 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-19T08:49:20.007 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T08:49:20.036 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:19 smithi019 ceph-mon[30976]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:49:20.036 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:19 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:20.036 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:19 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:20.036 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:19 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:20.036 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:19 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:49:20.036 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:19 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:20.036 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:19 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:49:20.036 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:19 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:20.037 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:19 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:20.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:19 smithi155 ceph-mon[34921]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:49:20.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:19 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:20.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:19 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:20.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:19 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:20.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:19 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:49:20.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:19 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:20.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:19 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:49:20.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:19 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:20.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:19 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:20.275 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:49:20.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.747+0000 7fe5fb897640 1 -- 172.21.15.19:0/212507535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5f4076220 msgr2=0x7fe5f4074680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:20.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.747+0000 7fe5fb897640 1 --2- 172.21.15.19:0/212507535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5f4076220 0x7fe5f4074680 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0009900 tx=0x7fe5f002a410 comp rx=0 tx=0).stop 2024-09-19T08:49:20.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.747+0000 7fe5fb897640 1 -- 172.21.15.19:0/212507535 shutdown_connections 2024-09-19T08:49:20.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.747+0000 7fe5fb897640 1 --2- 172.21.15.19:0/212507535 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe5f410e1e0 0x7fe5f41105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:20.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.747+0000 7fe5fb897640 1 --2- 172.21.15.19:0/212507535 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5f4074c50 0x7fe5f40750b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:20.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.747+0000 7fe5fb897640 1 --2- 172.21.15.19:0/212507535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5f4076220 0x7fe5f4074680 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:20.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.747+0000 7fe5fb897640 1 -- 172.21.15.19:0/212507535 >> 172.21.15.19:0/212507535 conn(0x7fe5f40fd390 msgr2=0x7fe5f40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:20.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.747+0000 7fe5fb897640 1 -- 172.21.15.19:0/212507535 shutdown_connections 2024-09-19T08:49:20.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.747+0000 7fe5fb897640 1 -- 172.21.15.19:0/212507535 wait complete. 2024-09-19T08:49:20.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.748+0000 7fe5fb897640 1 Processor -- start 2024-09-19T08:49:20.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.748+0000 7fe5fb897640 1 -- start start 2024-09-19T08:49:20.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.748+0000 7fe5fb897640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5f4074c50 0x7fe5f419e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:20.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.748+0000 7fe5fb897640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe5f4076220 0x7fe5f419ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:20.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.748+0000 7fe5fb897640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5f410e1e0 0x7fe5f41a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:20.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.748+0000 7fe5fb897640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f4113e70 con 0x7fe5f410e1e0 2024-09-19T08:49:20.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.748+0000 7fe5fb897640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f4113cf0 con 0x7fe5f4074c50 2024-09-19T08:49:20.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.748+0000 7fe5fb897640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f4113ff0 con 0x7fe5f4076220 2024-09-19T08:49:20.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.748+0000 7fe5f9e34640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5f410e1e0 0x7fe5f41a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:20.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.749+0000 7fe5f8e32640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe5f4076220 0x7fe5f419ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:20.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.749+0000 7fe5f9e34640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5f410e1e0 0x7fe5f41a5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53932/0 (socket says 172.21.15.19:53932) 2024-09-19T08:49:20.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.749+0000 7fe5f9e34640 1 -- 172.21.15.19:0/1877057027 learned_addr learned my addr 172.21.15.19:0/1877057027 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:49:20.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.749+0000 7fe5f9633640 1 --2- 172.21.15.19:0/1877057027 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5f4074c50 0x7fe5f419e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:20.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.749+0000 7fe5f9e34640 1 -- 172.21.15.19:0/1877057027 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe5f4076220 msgr2=0x7fe5f419ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:20.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.749+0000 7fe5f9e34640 1 --2- 172.21.15.19:0/1877057027 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe5f4076220 0x7fe5f419ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:20.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.749+0000 7fe5f9e34640 1 -- 172.21.15.19:0/1877057027 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5f4074c50 msgr2=0x7fe5f419e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:20.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.749+0000 7fe5f9e34640 1 --2- 172.21.15.19:0/1877057027 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5f4074c50 0x7fe5f419e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:20.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.749+0000 7fe5f9e34640 1 -- 172.21.15.19:0/1877057027 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f41a6130 con 0x7fe5f410e1e0 2024-09-19T08:49:20.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.749+0000 7fe5f9e34640 1 --2- 172.21.15.19:0/1877057027 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5f410e1e0 0x7fe5f41a5ac0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec00cad0 tx=0x7fe5ec00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:20.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.750+0000 7fe5ea7fc640 1 -- 172.21.15.19:0/1877057027 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec00ae20 con 0x7fe5f410e1e0 2024-09-19T08:49:20.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.750+0000 7fe5ea7fc640 1 -- 172.21.15.19:0/1877057027 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe5ec005020 con 0x7fe5f410e1e0 2024-09-19T08:49:20.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.750+0000 7fe5ea7fc640 1 -- 172.21.15.19:0/1877057027 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec00f6f0 con 0x7fe5f410e1e0 2024-09-19T08:49:20.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.750+0000 7fe5fb897640 1 -- 172.21.15.19:0/1877057027 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5f41a6420 con 0x7fe5f410e1e0 2024-09-19T08:49:20.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.751+0000 7fe5fb897640 1 -- 172.21.15.19:0/1877057027 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5f41a6960 con 0x7fe5f410e1e0 2024-09-19T08:49:20.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.752+0000 7fe5fb897640 1 -- 172.21.15.19:0/1877057027 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5f4103b80 con 0x7fe5f410e1e0 2024-09-19T08:49:20.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.754+0000 7fe5ea7fc640 1 -- 172.21.15.19:0/1877057027 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe5ec0051d0 con 0x7fe5f410e1e0 2024-09-19T08:49:20.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.754+0000 7fe5ea7fc640 1 --2- 172.21.15.19:0/1877057027 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe5e00a32f0 0x7fe5e00a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:20.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.755+0000 7fe5f9633640 1 --2- 172.21.15.19:0/1877057027 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe5e00a32f0 0x7fe5e00a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:20.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.755+0000 7fe5ea7fc640 1 -- 172.21.15.19:0/1877057027 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6809+0+0 (secure 0 0 0) 0x7fe5ec0cf5f0 con 0x7fe5f410e1e0 2024-09-19T08:49:20.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.755+0000 7fe5f9633640 1 --2- 172.21.15.19:0/1877057027 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe5e00a32f0 0x7fe5e00a57b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0005ab0 tx=0x7fe5f0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:20.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.758+0000 7fe5ea7fc640 1 -- 172.21.15.19:0/1877057027 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe5ec014030 con 0x7fe5f410e1e0 2024-09-19T08:49:20.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.937+0000 7fe5fb897640 1 -- 172.21.15.19:0/1877057027 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fe5f402d990 con 0x7fe5f410e1e0 2024-09-19T08:49:20.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.937+0000 7fe5ea7fc640 1 -- 172.21.15.19:0/1877057027 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v71) ==== 74+0+133 (secure 0 0 0) 0x7fe5ec09c320 con 0x7fe5f410e1e0 2024-09-19T08:49:20.937 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:49:20.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.939+0000 7fe5fb897640 1 -- 172.21.15.19:0/1877057027 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe5e00a32f0 msgr2=0x7fe5e00a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:20.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.939+0000 7fe5fb897640 1 --2- 172.21.15.19:0/1877057027 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe5e00a32f0 0x7fe5e00a57b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0005ab0 tx=0x7fe5f0000bc0 comp rx=0 tx=0).stop 2024-09-19T08:49:20.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.939+0000 7fe5fb897640 1 -- 172.21.15.19:0/1877057027 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5f410e1e0 msgr2=0x7fe5f41a5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:20.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.939+0000 7fe5fb897640 1 --2- 172.21.15.19:0/1877057027 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5f410e1e0 0x7fe5f41a5ac0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec00cad0 tx=0x7fe5ec00cf90 comp rx=0 tx=0).stop 2024-09-19T08:49:20.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.939+0000 7fe5fb897640 1 -- 172.21.15.19:0/1877057027 shutdown_connections 2024-09-19T08:49:20.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.939+0000 7fe5fb897640 1 --2- 172.21.15.19:0/1877057027 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe5e00a32f0 0x7fe5e00a57b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:20.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.939+0000 7fe5fb897640 1 --2- 172.21.15.19:0/1877057027 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe5f4076220 0x7fe5f419ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:20.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.939+0000 7fe5fb897640 1 --2- 172.21.15.19:0/1877057027 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe5f410e1e0 0x7fe5f41a5ac0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:20.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.939+0000 7fe5fb897640 1 --2- 172.21.15.19:0/1877057027 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe5f4074c50 0x7fe5f419e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:20.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.939+0000 7fe5fb897640 1 -- 172.21.15.19:0/1877057027 >> 172.21.15.19:0/1877057027 conn(0x7fe5f40fd390 msgr2=0x7fe5f40ff780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:20.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.940+0000 7fe5fb897640 1 -- 172.21.15.19:0/1877057027 shutdown_connections 2024-09-19T08:49:20.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:20.940+0000 7fe5fb897640 1 -- 172.21.15.19:0/1877057027 wait complete. 2024-09-19T08:49:21.681 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":71,"num_osds":12,"num_up_osds":11,"osd_up_since":1726735738,"num_in_osds":12,"osd_in_since":1726735741,"num_remapped_pgs":0} 2024-09-19T08:49:22.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:21 smithi019 ceph-mon[30976]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:49:22.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:21 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1877057027' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:49:22.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:21 smithi155 ceph-mon[34921]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:49:22.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:21 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1877057027' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:49:22.225 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:21 smithi203 ceph-mon[35450]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:49:22.225 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:21 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1877057027' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:49:22.225 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:49:21 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T08:49:21.938+0000 7fa29c90c640 -1 osd.11 0 log_to_monitors true 2024-09-19T08:49:22.682 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T08:49:22.870 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:22 smithi203 ceph-mon[35450]: from='osd.11 [v2:172.21.15.203:6824/522943955,v1:172.21.15.203:6825/522943955]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T08:49:22.870 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:22 smithi203 ceph-mon[35450]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T08:49:22.957 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:49:23.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:22 smithi019 ceph-mon[30976]: from='osd.11 [v2:172.21.15.203:6824/522943955,v1:172.21.15.203:6825/522943955]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T08:49:23.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:22 smithi019 ceph-mon[30976]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T08:49:23.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:22 smithi155 ceph-mon[34921]: from='osd.11 [v2:172.21.15.203:6824/522943955,v1:172.21.15.203:6825/522943955]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T08:49:23.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:22 smithi155 ceph-mon[34921]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T08:49:23.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.425+0000 7fea65fcd640 1 -- 172.21.15.19:0/1372694201 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea60105050 msgr2=0x7fea60107440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:23.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.425+0000 7fea65fcd640 1 --2- 172.21.15.19:0/1372694201 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea60105050 0x7fea60107440 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fea48009900 tx=0x7fea4802a410 comp rx=0 tx=0).stop 2024-09-19T08:49:23.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.425+0000 7fea65fcd640 1 -- 172.21.15.19:0/1372694201 shutdown_connections 2024-09-19T08:49:23.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.425+0000 7fea65fcd640 1 --2- 172.21.15.19:0/1372694201 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea60107980 0x7fea60109d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:23.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.425+0000 7fea65fcd640 1 --2- 172.21.15.19:0/1372694201 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea60105050 0x7fea60107440 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:23.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.425+0000 7fea65fcd640 1 --2- 172.21.15.19:0/1372694201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea60102720 0x7fea60104b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:23.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.425+0000 7fea65fcd640 1 -- 172.21.15.19:0/1372694201 >> 172.21.15.19:0/1372694201 conn(0x7fea600fc2a0 msgr2=0x7fea600fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:23.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.425+0000 7fea65fcd640 1 -- 172.21.15.19:0/1372694201 shutdown_connections 2024-09-19T08:49:23.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.425+0000 7fea65fcd640 1 -- 172.21.15.19:0/1372694201 wait complete. 2024-09-19T08:49:23.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.425+0000 7fea65fcd640 1 Processor -- start 2024-09-19T08:49:23.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.425+0000 7fea65fcd640 1 -- start start 2024-09-19T08:49:23.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.426+0000 7fea65fcd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea60102720 0x7fea60197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:23.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.426+0000 7fea65fcd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea60105050 0x7fea60198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:23.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.426+0000 7fea65fcd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea60107980 0x7fea6019f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:23.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.426+0000 7fea65fcd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fea6010d890 con 0x7fea60107980 2024-09-19T08:49:23.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.426+0000 7fea65fcd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fea6010d710 con 0x7fea60105050 2024-09-19T08:49:23.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.426+0000 7fea65fcd640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fea6010da10 con 0x7fea60102720 2024-09-19T08:49:23.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.426+0000 7fea5ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea60107980 0x7fea6019f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:23.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.426+0000 7fea5ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea60107980 0x7fea6019f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53948/0 (socket says 172.21.15.19:53948) 2024-09-19T08:49:23.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.426+0000 7fea5ffff640 1 -- 172.21.15.19:0/1038458242 learned_addr learned my addr 172.21.15.19:0/1038458242 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:49:23.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.426+0000 7fea5f7fe640 1 --2- 172.21.15.19:0/1038458242 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea60102720 0x7fea60197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:23.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.426+0000 7fea56ffd640 1 --2- 172.21.15.19:0/1038458242 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea60105050 0x7fea60198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:23.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.426+0000 7fea5ffff640 1 -- 172.21.15.19:0/1038458242 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea60102720 msgr2=0x7fea60197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:23.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.426+0000 7fea5ffff640 1 --2- 172.21.15.19:0/1038458242 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea60102720 0x7fea60197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:23.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.426+0000 7fea5ffff640 1 -- 172.21.15.19:0/1038458242 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea60105050 msgr2=0x7fea60198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:23.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.426+0000 7fea5ffff640 1 --2- 172.21.15.19:0/1038458242 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea60105050 0x7fea60198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:23.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.426+0000 7fea5ffff640 1 -- 172.21.15.19:0/1038458242 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea6019fb20 con 0x7fea60107980 2024-09-19T08:49:23.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.426+0000 7fea56ffd640 1 --2- 172.21.15.19:0/1038458242 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea60105050 0x7fea60198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:49:23.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.426+0000 7fea5ffff640 1 --2- 172.21.15.19:0/1038458242 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea60107980 0x7fea6019f4b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fea5800eaa0 tx=0x7fea5800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:23.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.426+0000 7fea5d7fa640 1 -- 172.21.15.19:0/1038458242 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea5800cdb0 con 0x7fea60107980 2024-09-19T08:49:23.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.426+0000 7fea5d7fa640 1 -- 172.21.15.19:0/1038458242 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea58005020 con 0x7fea60107980 2024-09-19T08:49:23.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.427+0000 7fea5d7fa640 1 -- 172.21.15.19:0/1038458242 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea580116b0 con 0x7fea60107980 2024-09-19T08:49:23.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.427+0000 7fea65fcd640 1 -- 172.21.15.19:0/1038458242 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea60100570 con 0x7fea60107980 2024-09-19T08:49:23.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.427+0000 7fea65fcd640 1 -- 172.21.15.19:0/1038458242 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea60100b00 con 0x7fea60107980 2024-09-19T08:49:23.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.428+0000 7fea65fcd640 1 -- 172.21.15.19:0/1038458242 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea600fdd90 con 0x7fea60107980 2024-09-19T08:49:23.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.429+0000 7fea5d7fa640 1 -- 172.21.15.19:0/1038458242 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fea58005560 con 0x7fea60107980 2024-09-19T08:49:23.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.429+0000 7fea5d7fa640 1 --2- 172.21.15.19:0/1038458242 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fea4c0a32f0 0x7fea4c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:23.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.430+0000 7fea5f7fe640 1 --2- 172.21.15.19:0/1038458242 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fea4c0a32f0 0x7fea4c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:23.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.430+0000 7fea5d7fa640 1 -- 172.21.15.19:0/1038458242 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6831+0+0 (secure 0 0 0) 0x7fea580cf4e0 con 0x7fea60107980 2024-09-19T08:49:23.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.430+0000 7fea5f7fe640 1 --2- 172.21.15.19:0/1038458242 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fea4c0a32f0 0x7fea4c0a57b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fea500058c0 tx=0x7fea50010040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:23.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.434+0000 7fea5d7fa640 1 -- 172.21.15.19:0/1038458242 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fea58016030 con 0x7fea60107980 2024-09-19T08:49:23.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.609+0000 7fea65fcd640 1 -- 172.21.15.19:0/1038458242 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fea60101f40 con 0x7fea60107980 2024-09-19T08:49:23.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.610+0000 7fea5d7fa640 1 -- 172.21.15.19:0/1038458242 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7fea5809c7d0 con 0x7fea60107980 2024-09-19T08:49:23.609 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:49:23.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.612+0000 7fea65fcd640 1 -- 172.21.15.19:0/1038458242 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fea4c0a32f0 msgr2=0x7fea4c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:23.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.612+0000 7fea65fcd640 1 --2- 172.21.15.19:0/1038458242 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fea4c0a32f0 0x7fea4c0a57b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fea500058c0 tx=0x7fea50010040 comp rx=0 tx=0).stop 2024-09-19T08:49:23.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.612+0000 7fea65fcd640 1 -- 172.21.15.19:0/1038458242 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea60107980 msgr2=0x7fea6019f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:23.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.612+0000 7fea65fcd640 1 --2- 172.21.15.19:0/1038458242 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea60107980 0x7fea6019f4b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fea5800eaa0 tx=0x7fea5800ef60 comp rx=0 tx=0).stop 2024-09-19T08:49:23.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.612+0000 7fea65fcd640 1 -- 172.21.15.19:0/1038458242 shutdown_connections 2024-09-19T08:49:23.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.612+0000 7fea65fcd640 1 --2- 172.21.15.19:0/1038458242 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fea4c0a32f0 0x7fea4c0a57b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:23.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.612+0000 7fea65fcd640 1 --2- 172.21.15.19:0/1038458242 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea60107980 0x7fea6019f4b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:23.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.612+0000 7fea65fcd640 1 --2- 172.21.15.19:0/1038458242 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea60105050 0x7fea60198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:23.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.612+0000 7fea65fcd640 1 --2- 172.21.15.19:0/1038458242 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea60102720 0x7fea60197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:23.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.612+0000 7fea65fcd640 1 -- 172.21.15.19:0/1038458242 >> 172.21.15.19:0/1038458242 conn(0x7fea600fc2a0 msgr2=0x7fea601030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:23.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.612+0000 7fea65fcd640 1 -- 172.21.15.19:0/1038458242 shutdown_connections 2024-09-19T08:49:23.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:23.612+0000 7fea65fcd640 1 -- 172.21.15.19:0/1038458242 wait complete. 2024-09-19T08:49:24.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:23 smithi019 ceph-mon[30976]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:49:24.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:23 smithi019 ceph-mon[30976]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T08:49:24.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:23 smithi019 ceph-mon[30976]: from='osd.11 [v2:172.21.15.203:6824/522943955,v1:172.21.15.203:6825/522943955]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:49:24.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:23 smithi019 ceph-mon[30976]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T08:49:24.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:23 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:49:24.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:23 smithi019 ceph-mon[30976]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:49:24.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:23 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:24.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:23 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:24.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:23 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:49:24.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:23 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:49:24.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:23 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:49:24.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:23 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:49:24.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:23 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:24.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:23 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:24.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:23 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:49:24.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:23 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:24.070 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:23 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1038458242' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:49:24.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:23 smithi155 ceph-mon[34921]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:49:24.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:23 smithi155 ceph-mon[34921]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T08:49:24.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:23 smithi155 ceph-mon[34921]: from='osd.11 [v2:172.21.15.203:6824/522943955,v1:172.21.15.203:6825/522943955]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:49:24.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:23 smithi155 ceph-mon[34921]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T08:49:24.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:23 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:49:24.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:23 smithi155 ceph-mon[34921]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:49:24.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:23 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:24.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:23 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:24.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:23 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:49:24.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:23 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:49:24.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:23 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:49:24.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:23 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:49:24.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:23 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:24.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:23 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:24.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:23 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:49:24.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:23 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:24.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:23 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1038458242' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:49:24.231 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:49:23 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T08:49:23.762+0000 7fa29888f640 -1 osd.11 0 waiting for initial osdmap 2024-09-19T08:49:24.231 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 08:49:23 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T08:49:23.774+0000 7fa2946b7640 -1 osd.11 73 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T08:49:24.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:23 smithi203 ceph-mon[35450]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:49:24.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:23 smithi203 ceph-mon[35450]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T08:49:24.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:23 smithi203 ceph-mon[35450]: from='osd.11 [v2:172.21.15.203:6824/522943955,v1:172.21.15.203:6825/522943955]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:49:24.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:23 smithi203 ceph-mon[35450]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T08:49:24.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:23 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:49:24.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:23 smithi203 ceph-mon[35450]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-09-19T08:49:24.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:23 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:24.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:23 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:24.233 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:23 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:49:24.233 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:23 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:49:24.233 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:23 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:49:24.233 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:23 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:49:24.233 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:23 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:24.233 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:23 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:24.233 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:23 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:49:24.233 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:23 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:24.233 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:23 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1038458242' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:49:24.259 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":72,"num_osds":12,"num_up_osds":11,"osd_up_since":1726735738,"num_in_osds":12,"osd_in_since":1726735741,"num_remapped_pgs":0} 2024-09-19T08:49:25.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:24 smithi019 ceph-mon[30976]: Detected new or changed devices on smithi203 2024-09-19T08:49:25.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:24 smithi019 ceph-mon[30976]: Adjusting osd_memory_target on smithi203 to 4272M 2024-09-19T08:49:25.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:24 smithi019 ceph-mon[30976]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-19T08:49:25.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:24 smithi019 ceph-mon[30976]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T08:49:25.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:24 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:49:25.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:24 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:49:25.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:24 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:49:25.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:24 smithi155 ceph-mon[34921]: Detected new or changed devices on smithi203 2024-09-19T08:49:25.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:24 smithi155 ceph-mon[34921]: Adjusting osd_memory_target on smithi203 to 4272M 2024-09-19T08:49:25.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:24 smithi155 ceph-mon[34921]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-19T08:49:25.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:24 smithi155 ceph-mon[34921]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T08:49:25.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:24 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:49:25.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:24 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:49:25.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:24 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:49:25.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:24 smithi203 ceph-mon[35450]: Detected new or changed devices on smithi203 2024-09-19T08:49:25.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:24 smithi203 ceph-mon[35450]: Adjusting osd_memory_target on smithi203 to 4272M 2024-09-19T08:49:25.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:24 smithi203 ceph-mon[35450]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-09-19T08:49:25.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:24 smithi203 ceph-mon[35450]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T08:49:25.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:24 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:49:25.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:24 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:49:25.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:24 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:49:25.260 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T08:49:25.528 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:49:25.918 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:25 smithi019 ceph-mon[30976]: purged_snaps scrub starts 2024-09-19T08:49:25.918 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:25 smithi019 ceph-mon[30976]: purged_snaps scrub ok 2024-09-19T08:49:25.918 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:25 smithi019 ceph-mon[30976]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:49:25.918 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:25 smithi019 ceph-mon[30976]: osd.11 [v2:172.21.15.203:6824/522943955,v1:172.21.15.203:6825/522943955] boot 2024-09-19T08:49:25.918 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:25 smithi019 ceph-mon[30976]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T08:49:25.918 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:25 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:49:26.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.001+0000 7f489fa36640 1 -- 172.21.15.19:0/2029998125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4898105030 msgr2=0x7f4898107420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:26.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.001+0000 7f489fa36640 1 --2- 172.21.15.19:0/2029998125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4898105030 0x7f4898107420 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4888009900 tx=0x7f488802a410 comp rx=0 tx=0).stop 2024-09-19T08:49:26.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.001+0000 7f489fa36640 1 -- 172.21.15.19:0/2029998125 shutdown_connections 2024-09-19T08:49:26.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.001+0000 7f489fa36640 1 --2- 172.21.15.19:0/2029998125 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4898107960 0x7f4898109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:26.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.001+0000 7f489fa36640 1 --2- 172.21.15.19:0/2029998125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4898105030 0x7f4898107420 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:26.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.001+0000 7f489fa36640 1 --2- 172.21.15.19:0/2029998125 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4898102700 0x7f4898104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:26.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.001+0000 7f489fa36640 1 -- 172.21.15.19:0/2029998125 >> 172.21.15.19:0/2029998125 conn(0x7f48980fc280 msgr2=0x7f48980fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:26.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.001+0000 7f489fa36640 1 -- 172.21.15.19:0/2029998125 shutdown_connections 2024-09-19T08:49:26.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.001+0000 7f489fa36640 1 -- 172.21.15.19:0/2029998125 wait complete. 2024-09-19T08:49:26.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.001+0000 7f489fa36640 1 Processor -- start 2024-09-19T08:49:26.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.001+0000 7f489fa36640 1 -- start start 2024-09-19T08:49:26.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.002+0000 7f489fa36640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4898102700 0x7f489819a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:26.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.002+0000 7f489fa36640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4898105030 0x7f489819a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:26.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.002+0000 7f489fa36640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4898107960 0x7f48981a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:26.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.002+0000 7f489fa36640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f489810d850 con 0x7f4898105030 2024-09-19T08:49:26.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.002+0000 7f489fa36640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f489810d6d0 con 0x7f4898107960 2024-09-19T08:49:26.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.002+0000 7f489fa36640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f489810d9d0 con 0x7f4898102700 2024-09-19T08:49:26.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.002+0000 7f489cfd1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4898105030 0x7f489819a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:26.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.002+0000 7f489cfd1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4898105030 0x7f489819a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58918/0 (socket says 172.21.15.19:58918) 2024-09-19T08:49:26.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.002+0000 7f489cfd1640 1 -- 172.21.15.19:0/810544347 learned_addr learned my addr 172.21.15.19:0/810544347 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:49:26.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.002+0000 7f489d7d2640 1 --2- 172.21.15.19:0/810544347 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4898102700 0x7f489819a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:26.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.002+0000 7f489dfd3640 1 --2- 172.21.15.19:0/810544347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4898107960 0x7f48981a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:26.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.002+0000 7f489cfd1640 1 -- 172.21.15.19:0/810544347 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4898102700 msgr2=0x7f489819a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:26.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.002+0000 7f489cfd1640 1 --2- 172.21.15.19:0/810544347 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4898102700 0x7f489819a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:26.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.002+0000 7f489cfd1640 1 -- 172.21.15.19:0/810544347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4898107960 msgr2=0x7f48981a1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:26.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.002+0000 7f489cfd1640 1 --2- 172.21.15.19:0/810544347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4898107960 0x7f48981a1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:26.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.002+0000 7f489cfd1640 1 -- 172.21.15.19:0/810544347 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48981a1d90 con 0x7f4898105030 2024-09-19T08:49:26.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.002+0000 7f489dfd3640 1 --2- 172.21.15.19:0/810544347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4898107960 0x7f48981a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:49:26.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.002+0000 7f489cfd1640 1 --2- 172.21.15.19:0/810544347 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4898105030 0x7f489819a6a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4888031610 tx=0x7f48880043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:26.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.002+0000 7f488e7fc640 1 -- 172.21.15.19:0/810544347 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488803f030 con 0x7f4898105030 2024-09-19T08:49:26.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.002+0000 7f489fa36640 1 -- 172.21.15.19:0/810544347 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48981a2020 con 0x7f4898105030 2024-09-19T08:49:26.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.002+0000 7f488e7fc640 1 -- 172.21.15.19:0/810544347 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4888003ce0 con 0x7f4898105030 2024-09-19T08:49:26.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.002+0000 7f488e7fc640 1 -- 172.21.15.19:0/810544347 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4888035070 con 0x7f4898105030 2024-09-19T08:49:26.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.003+0000 7f489fa36640 1 -- 172.21.15.19:0/810544347 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48981a2550 con 0x7f4898105030 2024-09-19T08:49:26.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.004+0000 7f489fa36640 1 -- 172.21.15.19:0/810544347 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4898109450 con 0x7f4898105030 2024-09-19T08:49:26.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.005+0000 7f488e7fc640 1 -- 172.21.15.19:0/810544347 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f4888042030 con 0x7f4898105030 2024-09-19T08:49:26.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.006+0000 7f488e7fc640 1 --2- 172.21.15.19:0/810544347 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f48840a3270 0x7f48840a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:26.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.006+0000 7f488e7fc640 1 -- 172.21.15.19:0/810544347 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f48880efcc0 con 0x7f4898105030 2024-09-19T08:49:26.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.006+0000 7f489d7d2640 1 --2- 172.21.15.19:0/810544347 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f48840a3270 0x7f48840a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:26.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.007+0000 7f489d7d2640 1 --2- 172.21.15.19:0/810544347 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f48840a3270 0x7f48840a5730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f48940058c0 tx=0x7f489400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:26.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.009+0000 7f488e7fc640 1 -- 172.21.15.19:0/810544347 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f48880bce80 con 0x7f4898105030 2024-09-19T08:49:26.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:25 smithi155 ceph-mon[34921]: purged_snaps scrub starts 2024-09-19T08:49:26.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:25 smithi155 ceph-mon[34921]: purged_snaps scrub ok 2024-09-19T08:49:26.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:25 smithi155 ceph-mon[34921]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:49:26.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:25 smithi155 ceph-mon[34921]: osd.11 [v2:172.21.15.203:6824/522943955,v1:172.21.15.203:6825/522943955] boot 2024-09-19T08:49:26.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:25 smithi155 ceph-mon[34921]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T08:49:26.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:25 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:49:26.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.185+0000 7f489fa36640 1 -- 172.21.15.19:0/810544347 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f489802d9c0 con 0x7f4898105030 2024-09-19T08:49:26.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.185+0000 7f488e7fc640 1 -- 172.21.15.19:0/810544347 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v75) ==== 74+0+133 (secure 0 0 0) 0x7f48880bc780 con 0x7f4898105030 2024-09-19T08:49:26.185 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:49:26.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.187+0000 7f489fa36640 1 -- 172.21.15.19:0/810544347 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f48840a3270 msgr2=0x7f48840a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:26.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.187+0000 7f489fa36640 1 --2- 172.21.15.19:0/810544347 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f48840a3270 0x7f48840a5730 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f48940058c0 tx=0x7f489400a2d0 comp rx=0 tx=0).stop 2024-09-19T08:49:26.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.187+0000 7f489fa36640 1 -- 172.21.15.19:0/810544347 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4898105030 msgr2=0x7f489819a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:26.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.187+0000 7f489fa36640 1 --2- 172.21.15.19:0/810544347 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4898105030 0x7f489819a6a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4888031610 tx=0x7f48880043b0 comp rx=0 tx=0).stop 2024-09-19T08:49:26.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.187+0000 7f489fa36640 1 -- 172.21.15.19:0/810544347 shutdown_connections 2024-09-19T08:49:26.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.187+0000 7f489fa36640 1 --2- 172.21.15.19:0/810544347 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f48840a3270 0x7f48840a5730 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:26.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.187+0000 7f489fa36640 1 --2- 172.21.15.19:0/810544347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4898107960 0x7f48981a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:26.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.187+0000 7f489fa36640 1 --2- 172.21.15.19:0/810544347 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4898105030 0x7f489819a6a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:26.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.187+0000 7f489fa36640 1 --2- 172.21.15.19:0/810544347 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4898102700 0x7f489819a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:26.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.187+0000 7f489fa36640 1 -- 172.21.15.19:0/810544347 >> 172.21.15.19:0/810544347 conn(0x7f48980fc280 msgr2=0x7f4898101e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:26.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.187+0000 7f489fa36640 1 -- 172.21.15.19:0/810544347 shutdown_connections 2024-09-19T08:49:26.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:26.187+0000 7f489fa36640 1 -- 172.21.15.19:0/810544347 wait complete. 2024-09-19T08:49:26.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:25 smithi203 ceph-mon[35450]: purged_snaps scrub starts 2024-09-19T08:49:26.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:25 smithi203 ceph-mon[35450]: purged_snaps scrub ok 2024-09-19T08:49:26.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:25 smithi203 ceph-mon[35450]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 319 MiB used, 983 GiB / 983 GiB avail 2024-09-19T08:49:26.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:25 smithi203 ceph-mon[35450]: osd.11 [v2:172.21.15.203:6824/522943955,v1:172.21.15.203:6825/522943955] boot 2024-09-19T08:49:26.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:25 smithi203 ceph-mon[35450]: osdmap e74: 12 total, 12 up, 12 in 2024-09-19T08:49:26.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:25 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T08:49:26.861 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":75,"num_osds":12,"num_up_osds":12,"osd_up_since":1726735764,"num_in_osds":12,"osd_in_since":1726735741,"num_remapped_pgs":0} 2024-09-19T08:49:26.862 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:49:27.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:26 smithi019 ceph-mon[30976]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T08:49:27.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:26 smithi019 ceph-mon[30976]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:27.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:26 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/810544347' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:49:27.117 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:49:27.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:26 smithi155 ceph-mon[34921]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T08:49:27.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:26 smithi155 ceph-mon[34921]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:27.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:26 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/810544347' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:49:27.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:26 smithi203 ceph-mon[35450]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T08:49:27.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:26 smithi203 ceph-mon[35450]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:27.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:26 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/810544347' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T08:49:27.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.542+0000 7f8706bf5640 1 -- 172.21.15.19:0/2498692239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8700102790 msgr2=0x7f87001067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:27.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.542+0000 7f8706bf5640 1 --2- 172.21.15.19:0/2498692239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8700102790 0x7f87001067e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f86f4009900 tx=0x7f86f402a410 comp rx=0 tx=0).stop 2024-09-19T08:49:27.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.542+0000 7f8706bf5640 1 -- 172.21.15.19:0/2498692239 shutdown_connections 2024-09-19T08:49:27.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.542+0000 7f8706bf5640 1 --2- 172.21.15.19:0/2498692239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8700106f10 0x7f870010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:27.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.542+0000 7f8706bf5640 1 --2- 172.21.15.19:0/2498692239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8700102790 0x7f87001067e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:27.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.542+0000 7f8706bf5640 1 --2- 172.21.15.19:0/2498692239 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8700101de0 0x7f87001021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:27.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.542+0000 7f8706bf5640 1 -- 172.21.15.19:0/2498692239 >> 172.21.15.19:0/2498692239 conn(0x7f87000fd8c0 msgr2=0x7f87000ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:27.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.542+0000 7f8706bf5640 1 -- 172.21.15.19:0/2498692239 shutdown_connections 2024-09-19T08:49:27.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.542+0000 7f8706bf5640 1 -- 172.21.15.19:0/2498692239 wait complete. 2024-09-19T08:49:27.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.543+0000 7f8706bf5640 1 Processor -- start 2024-09-19T08:49:27.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.543+0000 7f8706bf5640 1 -- start start 2024-09-19T08:49:27.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.543+0000 7f8706bf5640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8700101de0 0x7f87000744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:27.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.543+0000 7f8706bf5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8700102790 0x7f8700074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:27.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.543+0000 7f8706bf5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8700106f10 0x7f8700074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:27.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.543+0000 7f8706bf5640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8700112010 con 0x7f8700102790 2024-09-19T08:49:27.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.543+0000 7f8706bf5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8700111e90 con 0x7f8700106f10 2024-09-19T08:49:27.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.543+0000 7f8706bf5640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8700112190 con 0x7f8700101de0 2024-09-19T08:49:27.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.543+0000 7f86fffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8700102790 0x7f8700074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:27.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.543+0000 7f86fffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8700102790 0x7f8700074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58936/0 (socket says 172.21.15.19:58936) 2024-09-19T08:49:27.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.543+0000 7f86fffff640 1 -- 172.21.15.19:0/4255763129 learned_addr learned my addr 172.21.15.19:0/4255763129 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:49:27.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.543+0000 7f8704991640 1 --2- 172.21.15.19:0/4255763129 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8700101de0 0x7f87000744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:27.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.543+0000 7f8705192640 1 --2- 172.21.15.19:0/4255763129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8700106f10 0x7f8700074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:27.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.543+0000 7f86fffff640 1 -- 172.21.15.19:0/4255763129 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8700101de0 msgr2=0x7f87000744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:27.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.543+0000 7f86fffff640 1 --2- 172.21.15.19:0/4255763129 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8700101de0 0x7f87000744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:27.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.543+0000 7f86fffff640 1 -- 172.21.15.19:0/4255763129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8700106f10 msgr2=0x7f8700074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:27.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.543+0000 7f86fffff640 1 --2- 172.21.15.19:0/4255763129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8700106f10 0x7f8700074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:27.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.543+0000 7f86fffff640 1 -- 172.21.15.19:0/4255763129 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87001a6a70 con 0x7f8700102790 2024-09-19T08:49:27.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.543+0000 7f8705192640 1 --2- 172.21.15.19:0/4255763129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8700106f10 0x7f8700074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:49:27.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.544+0000 7f86fffff640 1 --2- 172.21.15.19:0/4255763129 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8700102790 0x7f8700074a30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f86f4005ab0 tx=0x7f86f40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:27.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.544+0000 7f86fdffb640 1 -- 172.21.15.19:0/4255763129 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f403f030 con 0x7f8700102790 2024-09-19T08:49:27.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.544+0000 7f8706bf5640 1 -- 172.21.15.19:0/4255763129 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87001a6d00 con 0x7f8700102790 2024-09-19T08:49:27.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.544+0000 7f86fdffb640 1 -- 172.21.15.19:0/4255763129 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f86f4003ce0 con 0x7f8700102790 2024-09-19T08:49:27.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.544+0000 7f86fdffb640 1 -- 172.21.15.19:0/4255763129 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f4035070 con 0x7f8700102790 2024-09-19T08:49:27.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.544+0000 7f8706bf5640 1 -- 172.21.15.19:0/4255763129 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87001a71d0 con 0x7f8700102790 2024-09-19T08:49:27.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.545+0000 7f8706bf5640 1 -- 172.21.15.19:0/4255763129 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8700102240 con 0x7f8700102790 2024-09-19T08:49:27.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.547+0000 7f86fdffb640 1 -- 172.21.15.19:0/4255763129 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f86f4042030 con 0x7f8700102790 2024-09-19T08:49:27.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.547+0000 7f86fdffb640 1 --2- 172.21.15.19:0/4255763129 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f86e80a3240 0x7f86e80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:27.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.547+0000 7f8704991640 1 --2- 172.21.15.19:0/4255763129 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f86e80a3240 0x7f86e80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:27.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.547+0000 7f86fdffb640 1 -- 172.21.15.19:0/4255763129 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f86f40effc0 con 0x7f8700102790 2024-09-19T08:49:27.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.548+0000 7f8704991640 1 --2- 172.21.15.19:0/4255763129 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f86e80a3240 0x7f86e80a5700 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f86f0009990 tx=0x7f86f0009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:27.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.550+0000 7f86fdffb640 1 -- 172.21.15.19:0/4255763129 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f86f40bd180 con 0x7f8700102790 2024-09-19T08:49:27.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.727+0000 7f8706bf5640 1 -- 172.21.15.19:0/4255763129 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f870002d7c0 con 0x7f8700102790 2024-09-19T08:49:27.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.728+0000 7f86fdffb640 1 -- 172.21.15.19:0/4255763129 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+18465 (secure 0 0 0) 0x7f86f40bca80 con 0x7f8700102790 2024-09-19T08:49:27.727 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:49:27.728 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":75,"fsid":"f26c9d84-7662-11ef-bceb-c7b262605968","created":"2024-09-19T08:42:32.324073+0000","modified":"2024-09-19T08:49:25.773684+0000","last_up_change":"2024-09-19T08:49:24.764960+0000","last_in_change":"2024-09-19T08:49:01.062919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:45:36.232910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81c7bb06-5b13-4ee0-9290-d779faac1b91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6803","nonce":3397146732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6805","nonce":3397146732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6809","nonce":3397146732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6807","nonce":3397146732}]},"public_addr":"172.21.15.19:6803/3397146732","cluster_addr":"172.21.15.19:6805/3397146732","heartbeat_back_addr":"172.21.15.19:6809/3397146732","heartbeat_front_addr":"172.21.15.19:6807/3397146732","state":["exists","up"]},{"osd":1,"uuid":"24c145e6-5252-4708-8f25-5ce041e8251e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6801","nonce":2011043685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6803","nonce":2011043685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6807","nonce":2011043685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6805","nonce":2011043685}]},"public_addr":"172.21.15.155:6801/2011043685","cluster_addr":"172.21.15.155:6803/2011043685","heartbeat_back_addr":"172.21.15.155:6807/2011043685","heartbeat_front_addr":"172.21.15.155:6805/2011043685","state":["exists","up"]},{"osd":2,"uuid":"99cefd33-0675-495f-8871-2e6fdead0c3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6801","nonce":3358994623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6803","nonce":3358994623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6807","nonce":3358994623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6805","nonce":3358994623}]},"public_addr":"172.21.15.203:6801/3358994623","cluster_addr":"172.21.15.203:6803/3358994623","heartbeat_back_addr":"172.21.15.203:6807/3358994623","heartbeat_front_addr":"172.21.15.203:6805/3358994623","state":["exists","up"]},{"osd":3,"uuid":"8f46c16c-f17e-484a-8b66-6dbf135f34c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6811","nonce":176445576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6813","nonce":176445576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6817","nonce":176445576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6815","nonce":176445576}]},"public_addr":"172.21.15.19:6811/176445576","cluster_addr":"172.21.15.19:6813/176445576","heartbeat_back_addr":"172.21.15.19:6817/176445576","heartbeat_front_addr":"172.21.15.19:6815/176445576","state":["exists","up"]},{"osd":4,"uuid":"411b0423-1317-4e82-bc01-b5f55b391bc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6809","nonce":2163087792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6811","nonce":2163087792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6815","nonce":2163087792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6813","nonce":2163087792}]},"public_addr":"172.21.15.155:6809/2163087792","cluster_addr":"172.21.15.155:6811/2163087792","heartbeat_back_addr":"172.21.15.155:6815/2163087792","heartbeat_front_addr":"172.21.15.155:6813/2163087792","state":["exists","up"]},{"osd":5,"uuid":"057c073e-569f-4c6e-9602-e1169ad4dd8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6809","nonce":334881465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6811","nonce":334881465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6815","nonce":334881465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6813","nonce":334881465}]},"public_addr":"172.21.15.203:6809/334881465","cluster_addr":"172.21.15.203:6811/334881465","heartbeat_back_addr":"172.21.15.203:6815/334881465","heartbeat_front_addr":"172.21.15.203:6813/334881465","state":["exists","up"]},{"osd":6,"uuid":"40418f13-823e-4f94-a427-84781abbcb5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6819","nonce":2669779791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6821","nonce":2669779791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6825","nonce":2669779791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6823","nonce":2669779791}]},"public_addr":"172.21.15.19:6819/2669779791","cluster_addr":"172.21.15.19:6821/2669779791","heartbeat_back_addr":"172.21.15.19:6825/2669779791","heartbeat_front_addr":"172.21.15.19:6823/2669779791","state":["exists","up"]},{"osd":7,"uuid":"ad15f762-aeab-4167-a63d-6c9f9b89b9c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6817","nonce":3169455907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6819","nonce":3169455907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6823","nonce":3169455907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6821","nonce":3169455907}]},"public_addr":"172.21.15.155:6817/3169455907","cluster_addr":"172.21.15.155:6819/3169455907","heartbeat_back_addr":"172.21.15.155:6823/3169455907","heartbeat_front_addr":"172.21.15.155:6821/3169455907","state":["exists","up"]},{"osd":8,"uuid":"23cf8ea2-29d6-43d8-a05b-7822f4bbf254","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6817","nonce":1062999528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6819","nonce":1062999528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6823","nonce":1062999528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6821","nonce":1062999528}]},"public_addr":"172.21.15.203:6817/1062999528","cluster_addr":"172.21.15.203:6819/1062999528","heartbeat_back_addr":"172.21.15.203:6823/1062999528","heartbeat_front_addr":"172.21.15.203:6821/1062999528","state":["exists","up"]},{"osd":9,"uuid":"e851e605-2d17-4fbf-b783-2138133edd06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6827","nonce":574664786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6829","nonce":574664786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6833","nonce":574664786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6831","nonce":574664786}]},"public_addr":"172.21.15.19:6827/574664786","cluster_addr":"172.21.15.19:6829/574664786","heartbeat_back_addr":"172.21.15.19:6833/574664786","heartbeat_front_addr":"172.21.15.19:6831/574664786","state":["exists","up"]},{"osd":10,"uuid":"cc770717-91bd-4494-9103-6db8214b5872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6825","nonce":2242158832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6827","nonce":2242158832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6831","nonce":2242158832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6829","nonce":2242158832}]},"public_addr":"172.21.15.155:6825/2242158832","cluster_addr":"172.21.15.155:6827/2242158832","heartbeat_back_addr":"172.21.15.155:6831/2242158832","heartbeat_front_addr":"172.21.15.155:6829/2242158832","state":["exists","up"]},{"osd":11,"uuid":"6c237db9-5d79-47bc-8ff6-60d09d721d5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6825","nonce":522943955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6827","nonce":522943955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6831","nonce":522943955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6829","nonce":522943955}]},"public_addr":"172.21.15.203:6825/522943955","cluster_addr":"172.21.15.203:6827/522943955","heartbeat_back_addr":"172.21.15.203:6831/522943955","heartbeat_front_addr":"172.21.15.203:6829/522943955","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:44:44.656414+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:09.339183+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:33.245452+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:59.449025+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:46:24.831213+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:46:49.189780+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:47:13.493628+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:47:39.478247+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:05.089875+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:30.722878+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:56.951834+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:22.894678+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6801/4266644067":"2024-09-20T08:43:21.732222+0000","172.21.15.19:0/1398782170":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6800/4266644067":"2024-09-20T08:43:21.732222+0000","172.21.15.19:0/34162461":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6801/1764769529":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/2910961714":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6800/1764769529":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/820792769":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/560203138":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/809642328":"2024-09-20T08:42:56.618773+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:49:27.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.730+0000 7f8706bf5640 1 -- 172.21.15.19:0/4255763129 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f86e80a3240 msgr2=0x7f86e80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:27.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.730+0000 7f8706bf5640 1 --2- 172.21.15.19:0/4255763129 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f86e80a3240 0x7f86e80a5700 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f86f0009990 tx=0x7f86f0009110 comp rx=0 tx=0).stop 2024-09-19T08:49:27.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.730+0000 7f8706bf5640 1 -- 172.21.15.19:0/4255763129 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8700102790 msgr2=0x7f8700074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:27.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.730+0000 7f8706bf5640 1 --2- 172.21.15.19:0/4255763129 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8700102790 0x7f8700074a30 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f86f4005ab0 tx=0x7f86f40042f0 comp rx=0 tx=0).stop 2024-09-19T08:49:27.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.730+0000 7f8706bf5640 1 -- 172.21.15.19:0/4255763129 shutdown_connections 2024-09-19T08:49:27.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.730+0000 7f8706bf5640 1 --2- 172.21.15.19:0/4255763129 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f86e80a3240 0x7f86e80a5700 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:27.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.730+0000 7f8706bf5640 1 --2- 172.21.15.19:0/4255763129 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8700106f10 0x7f8700074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:27.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.730+0000 7f8706bf5640 1 --2- 172.21.15.19:0/4255763129 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8700102790 0x7f8700074a30 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:27.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.730+0000 7f8706bf5640 1 --2- 172.21.15.19:0/4255763129 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8700101de0 0x7f87000744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:27.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.730+0000 7f8706bf5640 1 -- 172.21.15.19:0/4255763129 >> 172.21.15.19:0/4255763129 conn(0x7f87000fd8c0 msgr2=0x7f87000fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:27.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.730+0000 7f8706bf5640 1 -- 172.21.15.19:0/4255763129 shutdown_connections 2024-09-19T08:49:27.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:27.730+0000 7f8706bf5640 1 -- 172.21.15.19:0/4255763129 wait complete. 2024-09-19T08:49:28.047 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:27 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/4255763129' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:49:28.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:27 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/4255763129' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:49:28.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:27 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/4255763129' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:49:28.468 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T08:45:36.232910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T08:49:28.469 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-19T08:49:28.729 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:49:29.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:28 smithi019 ceph-mon[30976]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:29.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:28 smithi155 ceph-mon[34921]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:29.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.196+0000 7fa6fab0a640 1 -- 172.21.15.19:0/3292531327 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6f4100a80 msgr2=0x7fa6f4100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:29.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.196+0000 7fa6fab0a640 1 --2- 172.21.15.19:0/3292531327 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6f4100a80 0x7fa6f4100ee0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4009cd0 tx=0x7fa6e402a8e0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.197+0000 7fa6fab0a640 1 -- 172.21.15.19:0/3292531327 shutdown_connections 2024-09-19T08:49:29.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.197+0000 7fa6fab0a640 1 --2- 172.21.15.19:0/3292531327 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6f4101420 0x7fa6f410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.197+0000 7fa6fab0a640 1 --2- 172.21.15.19:0/3292531327 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6f4100a80 0x7fa6f4100ee0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.197+0000 7fa6fab0a640 1 --2- 172.21.15.19:0/3292531327 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6f4106a80 0x7fa6f4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.197+0000 7fa6fab0a640 1 -- 172.21.15.19:0/3292531327 >> 172.21.15.19:0/3292531327 conn(0x7fa6f40fc7a0 msgr2=0x7fa6f40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:29.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.197+0000 7fa6fab0a640 1 -- 172.21.15.19:0/3292531327 shutdown_connections 2024-09-19T08:49:29.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.197+0000 7fa6fab0a640 1 -- 172.21.15.19:0/3292531327 wait complete. 2024-09-19T08:49:29.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.197+0000 7fa6fab0a640 1 Processor -- start 2024-09-19T08:49:29.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.197+0000 7fa6fab0a640 1 -- start start 2024-09-19T08:49:29.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.197+0000 7fa6fab0a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6f4100a80 0x7fa6f4197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:29.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.197+0000 7fa6fab0a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6f4101420 0x7fa6f41978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:29.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.197+0000 7fa6fab0a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6f4106a80 0x7fa6f419bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:29.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.197+0000 7fa6fab0a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f4110e40 con 0x7fa6f4100a80 2024-09-19T08:49:29.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.197+0000 7fa6fab0a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f4110cc0 con 0x7fa6f4101420 2024-09-19T08:49:29.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.197+0000 7fa6fab0a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa6f4110fc0 con 0x7fa6f4106a80 2024-09-19T08:49:29.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.197+0000 7fa6f88a6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6f4100a80 0x7fa6f4197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:29.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.198+0000 7fa6f88a6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6f4100a80 0x7fa6f4197380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58944/0 (socket says 172.21.15.19:58944) 2024-09-19T08:49:29.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.198+0000 7fa6f88a6640 1 -- 172.21.15.19:0/279672657 learned_addr learned my addr 172.21.15.19:0/279672657 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:49:29.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.198+0000 7fa6f90a7640 1 --2- 172.21.15.19:0/279672657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6f4106a80 0x7fa6f419bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:29.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.198+0000 7fa6f3fff640 1 --2- 172.21.15.19:0/279672657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6f4101420 0x7fa6f41978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:29.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.198+0000 7fa6f88a6640 1 -- 172.21.15.19:0/279672657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6f4106a80 msgr2=0x7fa6f419bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:29.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.198+0000 7fa6f88a6640 1 --2- 172.21.15.19:0/279672657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6f4106a80 0x7fa6f419bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.198+0000 7fa6f88a6640 1 -- 172.21.15.19:0/279672657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6f4101420 msgr2=0x7fa6f41978c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:29.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.198+0000 7fa6f88a6640 1 --2- 172.21.15.19:0/279672657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6f4101420 0x7fa6f41978c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.198+0000 7fa6f88a6640 1 -- 172.21.15.19:0/279672657 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6f419c330 con 0x7fa6f4100a80 2024-09-19T08:49:29.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.198+0000 7fa6f90a7640 1 --2- 172.21.15.19:0/279672657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6f4106a80 0x7fa6f419bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:49:29.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.198+0000 7fa6f88a6640 1 --2- 172.21.15.19:0/279672657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6f4100a80 0x7fa6f4197380 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc009970 tx=0x7fa6dc009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:29.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.198+0000 7fa6f1ffb640 1 -- 172.21.15.19:0/279672657 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc00d020 con 0x7fa6f4100a80 2024-09-19T08:49:29.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.198+0000 7fa6f1ffb640 1 -- 172.21.15.19:0/279672657 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6dc007d40 con 0x7fa6f4100a80 2024-09-19T08:49:29.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.198+0000 7fa6f1ffb640 1 -- 172.21.15.19:0/279672657 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6dc00ccc0 con 0x7fa6f4100a80 2024-09-19T08:49:29.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.198+0000 7fa6fab0a640 1 -- 172.21.15.19:0/279672657 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6f419c620 con 0x7fa6f4100a80 2024-09-19T08:49:29.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.198+0000 7fa6fab0a640 1 -- 172.21.15.19:0/279672657 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6f406a790 con 0x7fa6f4100a80 2024-09-19T08:49:29.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.199+0000 7fa6fab0a640 1 -- 172.21.15.19:0/279672657 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6f4100ee0 con 0x7fa6f4100a80 2024-09-19T08:49:29.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.201+0000 7fa6f1ffb640 1 -- 172.21.15.19:0/279672657 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fa6dc00c460 con 0x7fa6f4100a80 2024-09-19T08:49:29.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.202+0000 7fa6f1ffb640 1 --2- 172.21.15.19:0/279672657 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa6e00a3240 0x7fa6e00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:29.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.202+0000 7fa6f3fff640 1 --2- 172.21.15.19:0/279672657 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa6e00a3240 0x7fa6e00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:29.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.202+0000 7fa6f1ffb640 1 -- 172.21.15.19:0/279672657 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fa6dc0d0e40 con 0x7fa6f4100a80 2024-09-19T08:49:29.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.202+0000 7fa6f3fff640 1 --2- 172.21.15.19:0/279672657 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa6e00a3240 0x7fa6e00a5700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4006010 tx=0x7fa6e4000f40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:29.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.205+0000 7fa6f1ffb640 1 -- 172.21.15.19:0/279672657 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa6dc09df60 con 0x7fa6f4100a80 2024-09-19T08:49:29.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:28 smithi203 ceph-mon[35450]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:29.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.381+0000 7fa6fab0a640 1 -- 172.21.15.19:0/279672657 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa6f406b1b0 con 0x7fa6f4100a80 2024-09-19T08:49:29.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.381+0000 7fa6f1ffb640 1 -- 172.21.15.19:0/279672657 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) ==== 93+0+10 (secure 0 0 0) 0x7fa6dc09d860 con 0x7fa6f4100a80 2024-09-19T08:49:29.381 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-09-19T08:49:29.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.383+0000 7fa6fab0a640 1 -- 172.21.15.19:0/279672657 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa6e00a3240 msgr2=0x7fa6e00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:29.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.383+0000 7fa6fab0a640 1 --2- 172.21.15.19:0/279672657 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa6e00a3240 0x7fa6e00a5700 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4006010 tx=0x7fa6e4000f40 comp rx=0 tx=0).stop 2024-09-19T08:49:29.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.383+0000 7fa6fab0a640 1 -- 172.21.15.19:0/279672657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6f4100a80 msgr2=0x7fa6f4197380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:29.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.383+0000 7fa6fab0a640 1 --2- 172.21.15.19:0/279672657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6f4100a80 0x7fa6f4197380 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc009970 tx=0x7fa6dc009e30 comp rx=0 tx=0).stop 2024-09-19T08:49:29.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.383+0000 7fa6fab0a640 1 -- 172.21.15.19:0/279672657 shutdown_connections 2024-09-19T08:49:29.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.383+0000 7fa6fab0a640 1 --2- 172.21.15.19:0/279672657 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa6e00a3240 0x7fa6e00a5700 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.383+0000 7fa6fab0a640 1 --2- 172.21.15.19:0/279672657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6f4106a80 0x7fa6f419bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.383+0000 7fa6fab0a640 1 --2- 172.21.15.19:0/279672657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa6f4101420 0x7fa6f41978c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.383+0000 7fa6fab0a640 1 --2- 172.21.15.19:0/279672657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa6f4100a80 0x7fa6f4197380 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:29.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.383+0000 7fa6fab0a640 1 -- 172.21.15.19:0/279672657 >> 172.21.15.19:0/279672657 conn(0x7fa6f40fc7a0 msgr2=0x7fa6f40fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:29.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.383+0000 7fa6fab0a640 1 -- 172.21.15.19:0/279672657 shutdown_connections 2024-09-19T08:49:29.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:29.383+0000 7fa6fab0a640 1 -- 172.21.15.19:0/279672657 wait complete. 2024-09-19T08:49:30.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:29 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/279672657' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:49:30.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:29 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/279672657' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:49:30.216 INFO:tasks.cephadm:Adding mds.a on smithi019 2024-09-19T08:49:30.216 INFO:tasks.cephadm:Adding mds.d on smithi019 2024-09-19T08:49:30.216 INFO:tasks.cephadm:Adding mds.g on smithi019 2024-09-19T08:49:30.217 INFO:tasks.cephadm:Adding mds.j on smithi019 2024-09-19T08:49:30.217 INFO:tasks.cephadm:Adding mds.b on smithi155 2024-09-19T08:49:30.217 INFO:tasks.cephadm:Adding mds.e on smithi155 2024-09-19T08:49:30.217 INFO:tasks.cephadm:Adding mds.h on smithi155 2024-09-19T08:49:30.217 INFO:tasks.cephadm:Adding mds.k on smithi155 2024-09-19T08:49:30.217 INFO:tasks.cephadm:Adding mds.c on smithi203 2024-09-19T08:49:30.217 INFO:tasks.cephadm:Adding mds.f on smithi203 2024-09-19T08:49:30.217 INFO:tasks.cephadm:Adding mds.i on smithi203 2024-09-19T08:49:30.217 INFO:tasks.cephadm:Adding mds.l on smithi203 2024-09-19T08:49:30.217 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi019=a;smithi019=d;smithi019=g;smithi019=j;smithi155=b;smithi155=e;smithi155=h;smithi155=k;smithi203=c;smithi203=f;smithi203=i;smithi203=l' 2024-09-19T08:49:30.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:29 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/279672657' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:49:30.475 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T08:49:30.908 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:30 smithi203 ceph-mon[35450]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:30.999 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:30.995+0000 7fa447f49640 1 -- 172.21.15.203:0/2810319601 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa4401037c0 msgr2=0x7fa44010a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:30.999 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:30.995+0000 7fa447f49640 1 --2- 172.21.15.203:0/2810319601 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa4401037c0 0x7fa44010a050 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa438009ca0 tx=0x7fa43802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:49:31.000 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:30.995+0000 7fa447f49640 1 -- 172.21.15.203:0/2810319601 shutdown_connections 2024-09-19T08:49:31.000 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:30.995+0000 7fa447f49640 1 --2- 172.21.15.203:0/2810319601 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa4401037c0 0x7fa44010a050 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:31.000 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:30.995+0000 7fa447f49640 1 --2- 172.21.15.203:0/2810319601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa440102e00 0x7fa440103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:31.000 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:30.995+0000 7fa447f49640 1 --2- 172.21.15.203:0/2810319601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa440101c00 0x7fa440102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:31.000 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:30.995+0000 7fa447f49640 1 -- 172.21.15.203:0/2810319601 >> 172.21.15.203:0/2810319601 conn(0x7fa4400fd390 msgr2=0x7fa4400ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:31.000 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:30.995+0000 7fa447f49640 1 -- 172.21.15.203:0/2810319601 shutdown_connections 2024-09-19T08:49:31.000 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:30.995+0000 7fa447f49640 1 -- 172.21.15.203:0/2810319601 wait complete. 2024-09-19T08:49:31.000 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:30.995+0000 7fa447f49640 1 Processor -- start 2024-09-19T08:49:31.000 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:30.995+0000 7fa447f49640 1 -- start start 2024-09-19T08:49:31.000 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:30.995+0000 7fa447f49640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa440101c00 0x7fa440197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:31.000 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:30.995+0000 7fa447f49640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa440102e00 0x7fa4401983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:31.001 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:30.996+0000 7fa447f49640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4401037c0 0x7fa44019f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:31.001 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:30.996+0000 7fa447f49640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa44010d860 con 0x7fa4401037c0 2024-09-19T08:49:31.001 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:30.996+0000 7fa447f49640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa44010d6e0 con 0x7fa440101c00 2024-09-19T08:49:31.001 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:30.996+0000 7fa447f49640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa44010d9e0 con 0x7fa440102e00 2024-09-19T08:49:31.001 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:30.996+0000 7fa4454e4640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa440102e00 0x7fa4401983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:31.001 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:30.996+0000 7fa4454e4640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa440102e00 0x7fa4401983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:46816/0 (socket says 172.21.15.203:46816) 2024-09-19T08:49:31.001 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:30.996+0000 7fa4454e4640 1 -- 172.21.15.203:0/2781818051 learned_addr learned my addr 172.21.15.203:0/2781818051 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-09-19T08:49:31.001 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:30.996+0000 7fa4464e6640 1 --2- 172.21.15.203:0/2781818051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4401037c0 0x7fa44019f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:31.001 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:30.996+0000 7fa445ce5640 1 --2- 172.21.15.203:0/2781818051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa440101c00 0x7fa440197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:31.001 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:30.996+0000 7fa4454e4640 1 -- 172.21.15.203:0/2781818051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa440101c00 msgr2=0x7fa440197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:31.001 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:30.996+0000 7fa4454e4640 1 --2- 172.21.15.203:0/2781818051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa440101c00 0x7fa440197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:31.001 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:30.996+0000 7fa4454e4640 1 -- 172.21.15.203:0/2781818051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4401037c0 msgr2=0x7fa44019f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:31.002 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:30.996+0000 7fa4454e4640 1 --2- 172.21.15.203:0/2781818051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4401037c0 0x7fa44019f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:31.002 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:30.996+0000 7fa4454e4640 1 -- 172.21.15.203:0/2781818051 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa44019fae0 con 0x7fa440102e00 2024-09-19T08:49:31.002 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:30.996+0000 7fa4454e4640 1 --2- 172.21.15.203:0/2781818051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa440102e00 0x7fa4401983f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa43c00d950 tx=0x7fa43c00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:31.002 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:30.996+0000 7fa436ffd640 1 -- 172.21.15.203:0/2781818051 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43c017030 con 0x7fa440102e00 2024-09-19T08:49:31.002 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:30.996+0000 7fa447f49640 1 -- 172.21.15.203:0/2781818051 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa44019fdd0 con 0x7fa440102e00 2024-09-19T08:49:31.002 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:30.996+0000 7fa436ffd640 1 -- 172.21.15.203:0/2781818051 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa43c004020 con 0x7fa440102e00 2024-09-19T08:49:31.002 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:30.996+0000 7fa436ffd640 1 -- 172.21.15.203:0/2781818051 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43c0047a0 con 0x7fa440102e00 2024-09-19T08:49:31.002 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:30.996+0000 7fa447f49640 1 -- 172.21.15.203:0/2781818051 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4401a0280 con 0x7fa440102e00 2024-09-19T08:49:31.002 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:30.998+0000 7fa447f49640 1 -- 172.21.15.203:0/2781818051 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa440108fd0 con 0x7fa440102e00 2024-09-19T08:49:31.002 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:31.000+0000 7fa436ffd640 1 -- 172.21.15.203:0/2781818051 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fa43c0041d0 con 0x7fa440102e00 2024-09-19T08:49:31.003 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:31.000+0000 7fa436ffd640 1 --2- 172.21.15.203:0/2781818051 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa42c0a32f0 0x7fa42c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:31.003 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:31.001+0000 7fa436ffd640 1 -- 172.21.15.203:0/2781818051 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fa43c0cf470 con 0x7fa440102e00 2024-09-19T08:49:31.003 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:31.001+0000 7fa445ce5640 1 --2- 172.21.15.203:0/2781818051 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa42c0a32f0 0x7fa42c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:31.003 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:31.001+0000 7fa445ce5640 1 --2- 172.21.15.203:0/2781818051 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa42c0a32f0 0x7fa42c0a57b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa440102c60 tx=0x7fa43000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:31.004 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:31.005+0000 7fa436ffd640 1 -- 172.21.15.203:0/2781818051 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa43c09c590 con 0x7fa440102e00 2024-09-19T08:49:31.073 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:30 smithi155 ceph-mon[34921]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:31.188 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:31.188+0000 7fa447f49640 1 -- 172.21.15.203:0/2781818051 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi019=a;smithi019=d;smithi019=g;smithi019=j;smithi155=b;smithi155=e;smithi155=h;smithi155=k;smithi203=c;smithi203=f;smithi203=i;smithi203=l", "target": ["mon-mgr", ""]}) -- 0x7fa440062730 con 0x7fa42c0a32f0 2024-09-19T08:49:31.197 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:31.198+0000 7fa436ffd640 1 -- 172.21.15.203:0/2781818051 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fa440062730 con 0x7fa42c0a32f0 2024-09-19T08:49:31.198 INFO:teuthology.orchestra.run.smithi203.stdout:Scheduled mds.all update... 2024-09-19T08:49:31.200 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:31.200+0000 7fa447f49640 1 -- 172.21.15.203:0/2781818051 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa42c0a32f0 msgr2=0x7fa42c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:31.200 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:31.200+0000 7fa447f49640 1 --2- 172.21.15.203:0/2781818051 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa42c0a32f0 0x7fa42c0a57b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa440102c60 tx=0x7fa43000b390 comp rx=0 tx=0).stop 2024-09-19T08:49:31.200 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:31.200+0000 7fa447f49640 1 -- 172.21.15.203:0/2781818051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa440102e00 msgr2=0x7fa4401983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:31.200 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:31.200+0000 7fa447f49640 1 --2- 172.21.15.203:0/2781818051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa440102e00 0x7fa4401983f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa43c00d950 tx=0x7fa43c00de10 comp rx=0 tx=0).stop 2024-09-19T08:49:31.200 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:31.200+0000 7fa447f49640 1 -- 172.21.15.203:0/2781818051 shutdown_connections 2024-09-19T08:49:31.200 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:31.200+0000 7fa447f49640 1 --2- 172.21.15.203:0/2781818051 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa42c0a32f0 0x7fa42c0a57b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:31.201 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:31.200+0000 7fa447f49640 1 --2- 172.21.15.203:0/2781818051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa440102e00 0x7fa4401983f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:31.201 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:31.200+0000 7fa447f49640 1 --2- 172.21.15.203:0/2781818051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4401037c0 0x7fa44019f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:31.201 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:31.200+0000 7fa447f49640 1 --2- 172.21.15.203:0/2781818051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa440101c00 0x7fa440197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:31.201 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:31.200+0000 7fa447f49640 1 -- 172.21.15.203:0/2781818051 >> 172.21.15.203:0/2781818051 conn(0x7fa4400fd390 msgr2=0x7fa4401061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:31.201 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:31.201+0000 7fa447f49640 1 -- 172.21.15.203:0/2781818051 shutdown_connections 2024-09-19T08:49:31.201 INFO:teuthology.orchestra.run.smithi203.stderr:2024-09-19T08:49:31.201+0000 7fa447f49640 1 -- 172.21.15.203:0/2781818051 wait complete. 2024-09-19T08:49:31.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:30 smithi019 ceph-mon[30976]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:31.867 DEBUG:teuthology.orchestra.run.smithi019:mds.a> sudo journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.a.service 2024-09-19T08:49:31.871 DEBUG:teuthology.orchestra.run.smithi019:mds.d> sudo journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.d.service 2024-09-19T08:49:31.914 DEBUG:teuthology.orchestra.run.smithi019:mds.g> sudo journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.g.service 2024-09-19T08:49:31.958 DEBUG:teuthology.orchestra.run.smithi019:mds.j> sudo journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.j.service 2024-09-19T08:49:32.001 DEBUG:teuthology.orchestra.run.smithi155:mds.b> sudo journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.b.service 2024-09-19T08:49:32.004 DEBUG:teuthology.orchestra.run.smithi155:mds.e> sudo journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.e.service 2024-09-19T08:49:32.047 DEBUG:teuthology.orchestra.run.smithi155:mds.h> sudo journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.h.service 2024-09-19T08:49:32.090 DEBUG:teuthology.orchestra.run.smithi155:mds.k> sudo journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.k.service 2024-09-19T08:49:32.133 DEBUG:teuthology.orchestra.run.smithi203:mds.c> sudo journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.c.service 2024-09-19T08:49:32.137 DEBUG:teuthology.orchestra.run.smithi203:mds.f> sudo journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.f.service 2024-09-19T08:49:32.180 DEBUG:teuthology.orchestra.run.smithi203:mds.i> sudo journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.i.service 2024-09-19T08:49:32.225 DEBUG:teuthology.orchestra.run.smithi203:mds.l> sudo journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.l.service 2024-09-19T08:49:32.268 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-19T08:49:32.268 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:49:32.308 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:32 smithi203 ceph-mon[35450]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi019=a;smithi019=d;smithi019=g;smithi019=j;smithi155=b;smithi155=e;smithi155=h;smithi155=k;smithi203=c;smithi203=f;smithi203=i;smithi203=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:49:32.308 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:32 smithi203 ceph-mon[35450]: Saving service mds.all spec with placement smithi019=a;smithi019=d;smithi019=g;smithi019=j;smithi155=b;smithi155=e;smithi155=h;smithi155=k;smithi203=c;smithi203=f;smithi203=i;smithi203=l;count:12 2024-09-19T08:49:32.308 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:32 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:32.308 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:32 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:49:32.308 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:32 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:32.309 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:32 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:49:32.309 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:32 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:32.309 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:32 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:49:32.309 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:32 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:49:32.309 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:32 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:32.309 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:32 smithi203 ceph-mon[35450]: Deploying daemon mds.l on smithi203 2024-09-19T08:49:32.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:32 smithi155 ceph-mon[34921]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi019=a;smithi019=d;smithi019=g;smithi019=j;smithi155=b;smithi155=e;smithi155=h;smithi155=k;smithi203=c;smithi203=f;smithi203=i;smithi203=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:49:32.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:32 smithi155 ceph-mon[34921]: Saving service mds.all spec with placement smithi019=a;smithi019=d;smithi019=g;smithi019=j;smithi155=b;smithi155=e;smithi155=h;smithi155=k;smithi203=c;smithi203=f;smithi203=i;smithi203=l;count:12 2024-09-19T08:49:32.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:32 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:32.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:32 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:49:32.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:32 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:32.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:32 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:49:32.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:32 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:32.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:32 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:49:32.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:32 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:49:32.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:32 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:32.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:32 smithi155 ceph-mon[34921]: Deploying daemon mds.l on smithi203 2024-09-19T08:49:32.526 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:49:32.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:32 smithi019 ceph-mon[30976]: from='client.24409 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi019=a;smithi019=d;smithi019=g;smithi019=j;smithi155=b;smithi155=e;smithi155=h;smithi155=k;smithi203=c;smithi203=f;smithi203=i;smithi203=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:49:32.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:32 smithi019 ceph-mon[30976]: Saving service mds.all spec with placement smithi019=a;smithi019=d;smithi019=g;smithi019=j;smithi155=b;smithi155=e;smithi155=h;smithi155=k;smithi203=c;smithi203=f;smithi203=i;smithi203=l;count:12 2024-09-19T08:49:32.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:32 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:32.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:32 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:49:32.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:32 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:32.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:32 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:49:32.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:32 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:32.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:32 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:49:32.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:32 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:49:32.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:32 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:32.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:32 smithi019 ceph-mon[30976]: Deploying daemon mds.l on smithi203 2024-09-19T08:49:33.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.012+0000 7f1d80f8f640 1 -- 172.21.15.19:0/270613377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d7c100a80 msgr2=0x7f1d7c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:33.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.012+0000 7f1d80f8f640 1 --2- 172.21.15.19:0/270613377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d7c100a80 0x7f1d7c100ee0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1d64009930 tx=0x7f1d6402a420 comp rx=0 tx=0).stop 2024-09-19T08:49:33.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.012+0000 7f1d80f8f640 1 -- 172.21.15.19:0/270613377 shutdown_connections 2024-09-19T08:49:33.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.012+0000 7f1d80f8f640 1 --2- 172.21.15.19:0/270613377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d7c101420 0x7f1d7c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:33.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.012+0000 7f1d80f8f640 1 --2- 172.21.15.19:0/270613377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d7c100a80 0x7f1d7c100ee0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:33.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.012+0000 7f1d80f8f640 1 --2- 172.21.15.19:0/270613377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1d7c106a80 0x7f1d7c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:33.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.012+0000 7f1d80f8f640 1 -- 172.21.15.19:0/270613377 >> 172.21.15.19:0/270613377 conn(0x7f1d7c0fc7a0 msgr2=0x7f1d7c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:33.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.012+0000 7f1d80f8f640 1 -- 172.21.15.19:0/270613377 shutdown_connections 2024-09-19T08:49:33.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.012+0000 7f1d80f8f640 1 -- 172.21.15.19:0/270613377 wait complete. 2024-09-19T08:49:33.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.013+0000 7f1d80f8f640 1 Processor -- start 2024-09-19T08:49:33.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.014+0000 7f1d80f8f640 1 -- start start 2024-09-19T08:49:33.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.014+0000 7f1d80f8f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d7c100a80 0x7f1d7c1973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:33.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.014+0000 7f1d80f8f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1d7c101420 0x7f1d7c197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:33.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.014+0000 7f1d80f8f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d7c106a80 0x7f1d7c19bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:33.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.014+0000 7f1d80f8f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7c110f10 con 0x7f1d7c106a80 2024-09-19T08:49:33.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.014+0000 7f1d80f8f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7c110d90 con 0x7f1d7c100a80 2024-09-19T08:49:33.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.014+0000 7f1d80f8f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7c111090 con 0x7f1d7c101420 2024-09-19T08:49:33.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.014+0000 7f1d7ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d7c106a80 0x7f1d7c19bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:33.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.014+0000 7f1d7ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d7c106a80 0x7f1d7c19bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58974/0 (socket says 172.21.15.19:58974) 2024-09-19T08:49:33.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.014+0000 7f1d7ad9d640 1 -- 172.21.15.19:0/301387273 learned_addr learned my addr 172.21.15.19:0/301387273 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:49:33.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.014+0000 7f1d79d9b640 1 --2- 172.21.15.19:0/301387273 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1d7c101420 0x7f1d7c197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:33.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.014+0000 7f1d7a59c640 1 --2- 172.21.15.19:0/301387273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d7c100a80 0x7f1d7c1973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:33.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.015+0000 7f1d7ad9d640 1 -- 172.21.15.19:0/301387273 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1d7c101420 msgr2=0x7f1d7c197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:33.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.015+0000 7f1d7ad9d640 1 --2- 172.21.15.19:0/301387273 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1d7c101420 0x7f1d7c197930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:33.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.015+0000 7f1d7ad9d640 1 -- 172.21.15.19:0/301387273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d7c100a80 msgr2=0x7f1d7c1973f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:33.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.015+0000 7f1d7ad9d640 1 --2- 172.21.15.19:0/301387273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d7c100a80 0x7f1d7c1973f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:33.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.015+0000 7f1d7ad9d640 1 -- 172.21.15.19:0/301387273 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d7c19c3c0 con 0x7f1d7c106a80 2024-09-19T08:49:33.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.015+0000 7f1d7ad9d640 1 --2- 172.21.15.19:0/301387273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d7c106a80 0x7f1d7c19bcc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1d7400b970 tx=0x7f1d7400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:33.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.015+0000 7f1d737fe640 1 -- 172.21.15.19:0/301387273 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d74019070 con 0x7f1d7c106a80 2024-09-19T08:49:33.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.015+0000 7f1d737fe640 1 -- 172.21.15.19:0/301387273 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1d7400cb40 con 0x7f1d7c106a80 2024-09-19T08:49:33.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.015+0000 7f1d80f8f640 1 -- 172.21.15.19:0/301387273 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d7c19c6b0 con 0x7f1d7c106a80 2024-09-19T08:49:33.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.015+0000 7f1d737fe640 1 -- 172.21.15.19:0/301387273 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d74007650 con 0x7f1d7c106a80 2024-09-19T08:49:33.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.015+0000 7f1d80f8f640 1 -- 172.21.15.19:0/301387273 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d7c06a790 con 0x7f1d7c106a80 2024-09-19T08:49:33.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.016+0000 7f1d80f8f640 1 -- 172.21.15.19:0/301387273 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d7c1021c0 con 0x7f1d7c106a80 2024-09-19T08:49:33.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.017+0000 7f1d737fe640 1 -- 172.21.15.19:0/301387273 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f1d7401c070 con 0x7f1d7c106a80 2024-09-19T08:49:33.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.018+0000 7f1d737fe640 1 --2- 172.21.15.19:0/301387273 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1d680a3240 0x7f1d680a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:33.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.018+0000 7f1d737fe640 1 -- 172.21.15.19:0/301387273 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f1d740cea60 con 0x7f1d7c106a80 2024-09-19T08:49:33.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.018+0000 7f1d7a59c640 1 --2- 172.21.15.19:0/301387273 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1d680a3240 0x7f1d680a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:33.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.019+0000 7f1d7a59c640 1 --2- 172.21.15.19:0/301387273 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1d680a3240 0x7f1d680a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c0058c0 tx=0x7f1d6c00a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:33.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.022+0000 7f1d737fe640 1 -- 172.21.15.19:0/301387273 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1d7409b5d0 con 0x7f1d7c106a80 2024-09-19T08:49:33.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.236+0000 7f1d80f8f640 1 -- 172.21.15.19:0/301387273 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1d7c06b210 con 0x7f1d7c106a80 2024-09-19T08:49:33.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.236+0000 7f1d737fe640 1 -- 172.21.15.19:0/301387273 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f1d740cce20 con 0x7f1d7c106a80 2024-09-19T08:49:33.236 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:49:33.236 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":1,"btime":"2024-09-19T08:42:32:323860+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-19T08:49:33.236 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 1 2024-09-19T08:49:33.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.239+0000 7f1d80f8f640 1 -- 172.21.15.19:0/301387273 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1d680a3240 msgr2=0x7f1d680a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:33.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.239+0000 7f1d80f8f640 1 --2- 172.21.15.19:0/301387273 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1d680a3240 0x7f1d680a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c0058c0 tx=0x7f1d6c00a250 comp rx=0 tx=0).stop 2024-09-19T08:49:33.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.239+0000 7f1d80f8f640 1 -- 172.21.15.19:0/301387273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d7c106a80 msgr2=0x7f1d7c19bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:33.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.239+0000 7f1d80f8f640 1 --2- 172.21.15.19:0/301387273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d7c106a80 0x7f1d7c19bcc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1d7400b970 tx=0x7f1d7400be30 comp rx=0 tx=0).stop 2024-09-19T08:49:33.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.239+0000 7f1d80f8f640 1 -- 172.21.15.19:0/301387273 shutdown_connections 2024-09-19T08:49:33.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.239+0000 7f1d80f8f640 1 --2- 172.21.15.19:0/301387273 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1d680a3240 0x7f1d680a5700 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:33.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.239+0000 7f1d80f8f640 1 --2- 172.21.15.19:0/301387273 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1d7c101420 0x7f1d7c197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:33.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.239+0000 7f1d80f8f640 1 --2- 172.21.15.19:0/301387273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1d7c106a80 0x7f1d7c19bcc0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:33.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.239+0000 7f1d80f8f640 1 --2- 172.21.15.19:0/301387273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1d7c100a80 0x7f1d7c1973f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:33.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.239+0000 7f1d80f8f640 1 -- 172.21.15.19:0/301387273 >> 172.21.15.19:0/301387273 conn(0x7f1d7c0fc7a0 msgr2=0x7f1d7c0fce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:33.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.239+0000 7f1d80f8f640 1 -- 172.21.15.19:0/301387273 shutdown_connections 2024-09-19T08:49:33.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:33.239+0000 7f1d80f8f640 1 -- 172.21.15.19:0/301387273 wait complete. 2024-09-19T08:49:33.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:33 smithi203 ceph-mon[35450]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:33.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:33 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/301387273' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:49:33.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:33 smithi019 ceph-mon[30976]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:33.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:33 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/301387273' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:49:33.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:33 smithi155 ceph-mon[34921]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:33.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:33 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/301387273' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:49:34.009 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 08:49:33 smithi203 podman[65135]: 2024-09-19 08:49:33.986672392 +0000 UTC m=+0.359438173 container start d54305bb0683f5b9b1eb0c3503bc9e11587924e7b9db125f38b79af72c045655 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-l, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS) 2024-09-19T08:49:34.009 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 08:49:34 smithi203 ceph-mds[65154]: -- 172.21.15.203:0/3097026118 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f77cb79860 con 0x55f77cb56800 2024-09-19T08:49:34.481 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 08:49:34 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-l[65150]: starting mds.l at 2024-09-19T08:49:34.481 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 08:49:34 smithi203 bash[65135]: d54305bb0683f5b9b1eb0c3503bc9e11587924e7b9db125f38b79af72c045655 2024-09-19T08:49:34.482 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 08:49:34 smithi203 systemd[1]: Started Ceph mds.l for f26c9d84-7662-11ef-bceb-c7b262605968. 2024-09-19T08:49:35.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:35 smithi155 ceph-mon[34921]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:35.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:35 smithi155 ceph-mon[34921]: mds.? [v2:172.21.15.203:6832/471920691,v1:172.21.15.203:6833/471920691] up:boot 2024-09-19T08:49:35.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:35 smithi155 ceph-mon[34921]: fsmap 1 up:standby 2024-09-19T08:49:35.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:35 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T08:49:35.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:35 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:35.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:35 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:35.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:35 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:35.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:35 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:49:35.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:35 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:49:35.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:35 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:35.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:35 smithi155 ceph-mon[34921]: Deploying daemon mds.k on smithi155 2024-09-19T08:49:35.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:35 smithi019 ceph-mon[30976]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:35.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:35 smithi019 ceph-mon[30976]: mds.? [v2:172.21.15.203:6832/471920691,v1:172.21.15.203:6833/471920691] up:boot 2024-09-19T08:49:35.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:35 smithi019 ceph-mon[30976]: fsmap 1 up:standby 2024-09-19T08:49:35.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:35 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T08:49:35.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:35 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:35.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:35 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:35.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:35 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:35.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:35 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:49:35.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:35 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:49:35.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:35 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:35.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:35 smithi019 ceph-mon[30976]: Deploying daemon mds.k on smithi155 2024-09-19T08:49:35.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:35 smithi203 ceph-mon[35450]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:35.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:35 smithi203 ceph-mon[35450]: mds.? [v2:172.21.15.203:6832/471920691,v1:172.21.15.203:6833/471920691] up:boot 2024-09-19T08:49:35.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:35 smithi203 ceph-mon[35450]: fsmap 1 up:standby 2024-09-19T08:49:35.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:35 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T08:49:35.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:35 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:35.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:35 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:35.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:35 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:35.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:35 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:49:35.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:35 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:49:35.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:35 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:35.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:35 smithi203 ceph-mon[35450]: Deploying daemon mds.k on smithi155 2024-09-19T08:49:36.090 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:49:36.362 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:49:36.371 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 19 08:49:36 smithi155 systemd[1]: Starting Ceph mds.k for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T08:49:36.625 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 19 08:49:36 smithi155 podman[64893]: 2024-09-19 08:49:36.274992828 +0000 UTC m=+0.016248768 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:49:36.625 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 19 08:49:36 smithi155 podman[64893]: 2024-09-19 08:49:36.384838362 +0000 UTC m=+0.126094287 container create 4e4dcdc47989dcf1497398007fc143654d2fd4fff6fa8c36fb7792c6f296b8fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-k, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T08:49:36.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.864+0000 7f952bc3f640 1 -- 172.21.15.19:0/1272639562 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9524102790 msgr2=0x7f95241067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:36.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.864+0000 7f952bc3f640 1 --2- 172.21.15.19:0/1272639562 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9524102790 0x7f95241067e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9514009900 tx=0x7f951402a410 comp rx=0 tx=0).stop 2024-09-19T08:49:36.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.865+0000 7f952bc3f640 1 -- 172.21.15.19:0/1272639562 shutdown_connections 2024-09-19T08:49:36.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.865+0000 7f952bc3f640 1 --2- 172.21.15.19:0/1272639562 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9524106f10 0x7f952410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:36.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.865+0000 7f952bc3f640 1 --2- 172.21.15.19:0/1272639562 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9524102790 0x7f95241067e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:36.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.865+0000 7f952bc3f640 1 --2- 172.21.15.19:0/1272639562 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9524101de0 0x7f95241021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:36.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.865+0000 7f952bc3f640 1 -- 172.21.15.19:0/1272639562 >> 172.21.15.19:0/1272639562 conn(0x7f95240fd8c0 msgr2=0x7f95240ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:36.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.865+0000 7f952bc3f640 1 -- 172.21.15.19:0/1272639562 shutdown_connections 2024-09-19T08:49:36.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.865+0000 7f952bc3f640 1 -- 172.21.15.19:0/1272639562 wait complete. 2024-09-19T08:49:36.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.865+0000 7f952bc3f640 1 Processor -- start 2024-09-19T08:49:36.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.865+0000 7f952bc3f640 1 -- start start 2024-09-19T08:49:36.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.866+0000 7f952bc3f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9524101de0 0x7f9524198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:36.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.866+0000 7f952bc3f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9524102790 0x7f9524198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:36.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.866+0000 7f952bc3f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9524106f10 0x7f952419cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:36.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.866+0000 7f952bc3f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9524111f70 con 0x7f9524101de0 2024-09-19T08:49:36.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.866+0000 7f952bc3f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9524111df0 con 0x7f9524106f10 2024-09-19T08:49:36.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.866+0000 7f952bc3f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f95241120f0 con 0x7f9524102790 2024-09-19T08:49:36.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.866+0000 7f95299db640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9524101de0 0x7f9524198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:36.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.866+0000 7f95299db640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9524101de0 0x7f9524198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48680/0 (socket says 172.21.15.19:48680) 2024-09-19T08:49:36.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.866+0000 7f95299db640 1 -- 172.21.15.19:0/3160171722 learned_addr learned my addr 172.21.15.19:0/3160171722 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:49:36.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.866+0000 7f95291da640 1 --2- 172.21.15.19:0/3160171722 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9524102790 0x7f9524198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:36.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.866+0000 7f952a1dc640 1 --2- 172.21.15.19:0/3160171722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9524106f10 0x7f952419cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:36.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.866+0000 7f95299db640 1 -- 172.21.15.19:0/3160171722 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9524102790 msgr2=0x7f9524198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:36.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.866+0000 7f95299db640 1 --2- 172.21.15.19:0/3160171722 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9524102790 0x7f9524198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:36.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.866+0000 7f95299db640 1 -- 172.21.15.19:0/3160171722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9524106f10 msgr2=0x7f952419cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:36.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.866+0000 7f95299db640 1 --2- 172.21.15.19:0/3160171722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9524106f10 0x7f952419cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:36.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.866+0000 7f95299db640 1 -- 172.21.15.19:0/3160171722 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f952419d400 con 0x7f9524101de0 2024-09-19T08:49:36.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.866+0000 7f95299db640 1 --2- 172.21.15.19:0/3160171722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9524101de0 0x7f9524198450 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f952000e9f0 tx=0x7f952000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:36.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.867+0000 7f951affd640 1 -- 172.21.15.19:0/3160171722 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f952000cd80 con 0x7f9524101de0 2024-09-19T08:49:36.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.867+0000 7f952bc3f640 1 -- 172.21.15.19:0/3160171722 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f952419d6f0 con 0x7f9524101de0 2024-09-19T08:49:36.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.867+0000 7f951affd640 1 -- 172.21.15.19:0/3160171722 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9520010910 con 0x7f9524101de0 2024-09-19T08:49:36.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.867+0000 7f951affd640 1 -- 172.21.15.19:0/3160171722 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95200188f0 con 0x7f9524101de0 2024-09-19T08:49:36.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.867+0000 7f952bc3f640 1 -- 172.21.15.19:0/3160171722 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95241a4fd0 con 0x7f9524101de0 2024-09-19T08:49:36.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.868+0000 7f952bc3f640 1 -- 172.21.15.19:0/3160171722 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95241021c0 con 0x7f9524101de0 2024-09-19T08:49:36.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.869+0000 7f951affd640 1 -- 172.21.15.19:0/3160171722 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f9520010ac0 con 0x7f9524101de0 2024-09-19T08:49:36.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.869+0000 7f951affd640 1 --2- 172.21.15.19:0/3160171722 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f95100a3240 0x7f95100a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:36.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.869+0000 7f95291da640 1 --2- 172.21.15.19:0/3160171722 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f95100a3240 0x7f95100a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:36.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.869+0000 7f951affd640 1 -- 172.21.15.19:0/3160171722 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f95200cf820 con 0x7f9524101de0 2024-09-19T08:49:36.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.870+0000 7f95291da640 1 --2- 172.21.15.19:0/3160171722 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f95100a3240 0x7f95100a5700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9514009230 tx=0x7f95140058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:36.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:36.874+0000 7f951affd640 1 -- 172.21.15.19:0/3160171722 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f952009c390 con 0x7f9524101de0 2024-09-19T08:49:36.923 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 19 08:49:36 smithi155 podman[64893]: 2024-09-19 08:49:36.754915784 +0000 UTC m=+0.496171712 container init 4e4dcdc47989dcf1497398007fc143654d2fd4fff6fa8c36fb7792c6f296b8fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-k, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T08:49:36.923 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 19 08:49:36 smithi155 podman[64893]: 2024-09-19 08:49:36.75773343 +0000 UTC m=+0.498989358 container start 4e4dcdc47989dcf1497398007fc143654d2fd4fff6fa8c36fb7792c6f296b8fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-k, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS) 2024-09-19T08:49:36.923 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 19 08:49:36 smithi155 ceph-mds[64912]: -- 172.21.15.155:0/376541377 <== mon.2 v2:172.21.15.155:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ae4c177860 con 0x55ae4c155000 2024-09-19T08:49:36.923 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 19 08:49:36 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-k[64908]: starting mds.k at 2024-09-19T08:49:36.923 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 19 08:49:36 smithi155 bash[64893]: 4e4dcdc47989dcf1497398007fc143654d2fd4fff6fa8c36fb7792c6f296b8fe 2024-09-19T08:49:36.923 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 19 08:49:36 smithi155 systemd[1]: Started Ceph mds.k for f26c9d84-7662-11ef-bceb-c7b262605968. 2024-09-19T08:49:37.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:37 smithi019 ceph-mon[30976]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:37.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:37 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:37.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:37 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:37.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:37 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:37.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:37 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:49:37.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:37 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:49:37.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:37 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:37.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:37.091+0000 7f952bc3f640 1 -- 172.21.15.19:0/3160171722 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f952410a150 con 0x7f9524101de0 2024-09-19T08:49:37.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:37.091+0000 7f951affd640 1 -- 172.21.15.19:0/3160171722 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2263 (secure 0 0 0) 0x7f95200a0690 con 0x7f9524101de0 2024-09-19T08:49:37.091 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:49:37.091 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":3,"btime":"2024-09-19T08:49:37:019615+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-19T08:49:37.091 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 3 2024-09-19T08:49:37.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:37.094+0000 7f952bc3f640 1 -- 172.21.15.19:0/3160171722 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f95100a3240 msgr2=0x7f95100a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:37.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:37.094+0000 7f952bc3f640 1 --2- 172.21.15.19:0/3160171722 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f95100a3240 0x7f95100a5700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9514009230 tx=0x7f95140058d0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:37.094+0000 7f952bc3f640 1 -- 172.21.15.19:0/3160171722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9524101de0 msgr2=0x7f9524198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:37.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:37.094+0000 7f952bc3f640 1 --2- 172.21.15.19:0/3160171722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9524101de0 0x7f9524198450 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f952000e9f0 tx=0x7f952000eeb0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:37.094+0000 7f952bc3f640 1 -- 172.21.15.19:0/3160171722 shutdown_connections 2024-09-19T08:49:37.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:37.094+0000 7f952bc3f640 1 --2- 172.21.15.19:0/3160171722 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f95100a3240 0x7f95100a5700 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:37.094+0000 7f952bc3f640 1 --2- 172.21.15.19:0/3160171722 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9524102790 0x7f9524198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:37.094+0000 7f952bc3f640 1 --2- 172.21.15.19:0/3160171722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9524106f10 0x7f952419cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:37.094+0000 7f952bc3f640 1 --2- 172.21.15.19:0/3160171722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9524101de0 0x7f9524198450 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:37.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:37.094+0000 7f952bc3f640 1 -- 172.21.15.19:0/3160171722 >> 172.21.15.19:0/3160171722 conn(0x7f95240fd8c0 msgr2=0x7f95240febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:37.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:37.094+0000 7f952bc3f640 1 -- 172.21.15.19:0/3160171722 shutdown_connections 2024-09-19T08:49:37.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:37.094+0000 7f952bc3f640 1 -- 172.21.15.19:0/3160171722 wait complete. 2024-09-19T08:49:37.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:37 smithi155 ceph-mon[34921]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:37.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:37 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:37.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:37 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:37.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:37 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:37.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:37 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:49:37.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:37 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:49:37.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:37 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:37.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:37 smithi203 ceph-mon[35450]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:37.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:37 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:37.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:37 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:37.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:37 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:37.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:37 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:49:37.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:37 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:49:37.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:37 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:38.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:38 smithi019 ceph-mon[30976]: Deploying daemon mds.j on smithi019 2024-09-19T08:49:38.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:38 smithi019 ceph-mon[30976]: mds.? [v2:172.21.15.155:6832/3575511501,v1:172.21.15.155:6833/3575511501] up:boot 2024-09-19T08:49:38.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:38 smithi019 ceph-mon[30976]: fsmap 2 up:standby 2024-09-19T08:49:38.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:38 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T08:49:38.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:38 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3160171722' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:49:38.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:38 smithi155 ceph-mon[34921]: Deploying daemon mds.j on smithi019 2024-09-19T08:49:38.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:38 smithi155 ceph-mon[34921]: mds.? [v2:172.21.15.155:6832/3575511501,v1:172.21.15.155:6833/3575511501] up:boot 2024-09-19T08:49:38.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:38 smithi155 ceph-mon[34921]: fsmap 2 up:standby 2024-09-19T08:49:38.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:38 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T08:49:38.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:38 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3160171722' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:49:38.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:38 smithi203 ceph-mon[35450]: Deploying daemon mds.j on smithi019 2024-09-19T08:49:38.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:38 smithi203 ceph-mon[35450]: mds.? [v2:172.21.15.155:6832/3575511501,v1:172.21.15.155:6833/3575511501] up:boot 2024-09-19T08:49:38.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:38 smithi203 ceph-mon[35450]: fsmap 2 up:standby 2024-09-19T08:49:38.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:38 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T08:49:38.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:38 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3160171722' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:49:39.159 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:39 smithi155 ceph-mon[34921]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:39.250 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:39 smithi019 ceph-mon[30976]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:39.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:39 smithi203 ceph-mon[35450]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:39.568 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 19 08:49:39 smithi019 systemd[1]: Starting Ceph mds.j for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T08:49:39.807 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:49:39.908 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 19 08:49:39 smithi019 podman[70712]: 2024-09-19 08:49:39.55699167 +0000 UTC m=+0.016340978 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:49:39.908 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 19 08:49:39 smithi019 podman[70712]: 2024-09-19 08:49:39.656137221 +0000 UTC m=+0.115486520 container create ea2658f680ce482dd74808837bbddc4ee96782f5bdbd906f7b32e401cf9d3236 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-j, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:49:39.908 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 19 08:49:39 smithi019 podman[70712]: 2024-09-19 08:49:39.909023999 +0000 UTC m=+0.368373314 container init ea2658f680ce482dd74808837bbddc4ee96782f5bdbd906f7b32e401cf9d3236 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-j, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-19T08:49:40.080 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:49:40.203 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 19 08:49:39 smithi019 podman[70712]: 2024-09-19 08:49:39.912537821 +0000 UTC m=+0.371887124 container start ea2658f680ce482dd74808837bbddc4ee96782f5bdbd906f7b32e401cf9d3236 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-j, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-19T08:49:40.203 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 19 08:49:39 smithi019 ceph-mds[70749]: -- 172.21.15.19:0/4053520815 <== mon.0 v2:172.21.15.19:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562014e4b860 con 0x562014e29000 2024-09-19T08:49:40.203 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 19 08:49:39 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-j[70727]: starting mds.j at 2024-09-19T08:49:40.203 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 19 08:49:39 smithi019 bash[70712]: ea2658f680ce482dd74808837bbddc4ee96782f5bdbd906f7b32e401cf9d3236 2024-09-19T08:49:40.203 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 19 08:49:39 smithi019 systemd[1]: Started Ceph mds.j for f26c9d84-7662-11ef-bceb-c7b262605968. 2024-09-19T08:49:40.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.613+0000 7f51d97ea640 1 -- 172.21.15.19:0/4169010796 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51d41082a0 msgr2=0x7f51d410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:40.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.613+0000 7f51d97ea640 1 --2- 172.21.15.19:0/4169010796 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51d41082a0 0x7f51d410ec40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f51cc009930 tx=0x7f51cc02a420 comp rx=0 tx=0).stop 2024-09-19T08:49:40.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.613+0000 7f51d97ea640 1 -- 172.21.15.19:0/4169010796 shutdown_connections 2024-09-19T08:49:40.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.613+0000 7f51d97ea640 1 --2- 172.21.15.19:0/4169010796 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51d41082a0 0x7f51d410ec40 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.613+0000 7f51d97ea640 1 --2- 172.21.15.19:0/4169010796 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51d41036e0 0x7f51d4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.613+0000 7f51d97ea640 1 --2- 172.21.15.19:0/4169010796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51d4102d30 0x7f51d4103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.613+0000 7f51d97ea640 1 -- 172.21.15.19:0/4169010796 >> 172.21.15.19:0/4169010796 conn(0x7f51d40fc7d0 msgr2=0x7f51d40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:40.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.613+0000 7f51d97ea640 1 -- 172.21.15.19:0/4169010796 shutdown_connections 2024-09-19T08:49:40.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.613+0000 7f51d97ea640 1 -- 172.21.15.19:0/4169010796 wait complete. 2024-09-19T08:49:40.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.614+0000 7f51d97ea640 1 Processor -- start 2024-09-19T08:49:40.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.614+0000 7f51d97ea640 1 -- start start 2024-09-19T08:49:40.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.614+0000 7f51d97ea640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51d4102d30 0x7f51d4100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:40.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.614+0000 7f51d97ea640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51d41036e0 0x7f51d4100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:40.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.614+0000 7f51d97ea640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51d41082a0 0x7f51d4101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:40.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.614+0000 7f51d97ea640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f51d4112100 con 0x7f51d41036e0 2024-09-19T08:49:40.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.614+0000 7f51d97ea640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f51d4111f80 con 0x7f51d41082a0 2024-09-19T08:49:40.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.614+0000 7f51d97ea640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f51d4112280 con 0x7f51d4102d30 2024-09-19T08:49:40.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.614+0000 7f51d27fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51d41036e0 0x7f51d4100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:40.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.614+0000 7f51d27fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51d41036e0 0x7f51d4100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48700/0 (socket says 172.21.15.19:48700) 2024-09-19T08:49:40.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.614+0000 7f51d27fc640 1 -- 172.21.15.19:0/2996511995 learned_addr learned my addr 172.21.15.19:0/2996511995 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:49:40.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.614+0000 7f51d37fe640 1 --2- 172.21.15.19:0/2996511995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51d41082a0 0x7f51d4101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:40.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.614+0000 7f51d2ffd640 1 --2- 172.21.15.19:0/2996511995 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51d4102d30 0x7f51d4100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:40.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.614+0000 7f51d27fc640 1 -- 172.21.15.19:0/2996511995 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51d4102d30 msgr2=0x7f51d4100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:40.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.614+0000 7f51d27fc640 1 --2- 172.21.15.19:0/2996511995 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51d4102d30 0x7f51d4100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.614+0000 7f51d27fc640 1 -- 172.21.15.19:0/2996511995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51d41082a0 msgr2=0x7f51d4101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:40.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.614+0000 7f51d27fc640 1 --2- 172.21.15.19:0/2996511995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51d41082a0 0x7f51d4101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.615+0000 7f51d27fc640 1 -- 172.21.15.19:0/2996511995 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51d41a6a90 con 0x7f51d41036e0 2024-09-19T08:49:40.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.615+0000 7f51d27fc640 1 --2- 172.21.15.19:0/2996511995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51d41036e0 0x7f51d4100ed0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f51c800d950 tx=0x7f51c800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:40.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.615+0000 7f51bbfff640 1 -- 172.21.15.19:0/2996511995 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c8017070 con 0x7f51d41036e0 2024-09-19T08:49:40.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.615+0000 7f51bbfff640 1 -- 172.21.15.19:0/2996511995 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f51c8009c30 con 0x7f51d41036e0 2024-09-19T08:49:40.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.615+0000 7f51d97ea640 1 -- 172.21.15.19:0/2996511995 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51d41a6d80 con 0x7f51d41036e0 2024-09-19T08:49:40.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.615+0000 7f51bbfff640 1 -- 172.21.15.19:0/2996511995 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51c80047a0 con 0x7f51d41036e0 2024-09-19T08:49:40.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.615+0000 7f51d97ea640 1 -- 172.21.15.19:0/2996511995 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51d41a7260 con 0x7f51d41036e0 2024-09-19T08:49:40.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.616+0000 7f51d97ea640 1 -- 172.21.15.19:0/2996511995 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51d4103110 con 0x7f51d41036e0 2024-09-19T08:49:40.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.617+0000 7f51bbfff640 1 -- 172.21.15.19:0/2996511995 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f51c8004020 con 0x7f51d41036e0 2024-09-19T08:49:40.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.618+0000 7f51bbfff640 1 --2- 172.21.15.19:0/2996511995 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f51bc0a3240 0x7f51bc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:40.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.618+0000 7f51d2ffd640 1 --2- 172.21.15.19:0/2996511995 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f51bc0a3240 0x7f51bc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:40.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.618+0000 7f51bbfff640 1 -- 172.21.15.19:0/2996511995 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f51c80cf110 con 0x7f51d41036e0 2024-09-19T08:49:40.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.618+0000 7f51d2ffd640 1 --2- 172.21.15.19:0/2996511995 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f51bc0a3240 0x7f51bc0a5700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f51c400a400 tx=0x7f51c400d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:40.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.622+0000 7f51bbfff640 1 -- 172.21.15.19:0/2996511995 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f51c8020020 con 0x7f51d41036e0 2024-09-19T08:49:40.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.840+0000 7f51d97ea640 1 -- 172.21.15.19:0/2996511995 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f51d410a2b0 con 0x7f51d41036e0 2024-09-19T08:49:40.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.840+0000 7f51bbfff640 1 -- 172.21.15.19:0/2996511995 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3085 (secure 0 0 0) 0x7f51c809c230 con 0x7f51d41036e0 2024-09-19T08:49:40.840 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:49:40.840 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":4,"btime":"2024-09-19T08:49:40:031454+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24431,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[]} 2024-09-19T08:49:40.840 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 4 2024-09-19T08:49:40.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.842+0000 7f51d97ea640 1 -- 172.21.15.19:0/2996511995 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f51bc0a3240 msgr2=0x7f51bc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:40.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.842+0000 7f51d97ea640 1 --2- 172.21.15.19:0/2996511995 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f51bc0a3240 0x7f51bc0a5700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f51c400a400 tx=0x7f51c400d040 comp rx=0 tx=0).stop 2024-09-19T08:49:40.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.842+0000 7f51d97ea640 1 -- 172.21.15.19:0/2996511995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51d41036e0 msgr2=0x7f51d4100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:40.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.842+0000 7f51d97ea640 1 --2- 172.21.15.19:0/2996511995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51d41036e0 0x7f51d4100ed0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f51c800d950 tx=0x7f51c800de10 comp rx=0 tx=0).stop 2024-09-19T08:49:40.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.842+0000 7f51d97ea640 1 -- 172.21.15.19:0/2996511995 shutdown_connections 2024-09-19T08:49:40.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.842+0000 7f51d97ea640 1 --2- 172.21.15.19:0/2996511995 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f51bc0a3240 0x7f51bc0a5700 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.842+0000 7f51d97ea640 1 --2- 172.21.15.19:0/2996511995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f51d41082a0 0x7f51d4101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.842+0000 7f51d97ea640 1 --2- 172.21.15.19:0/2996511995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f51d41036e0 0x7f51d4100ed0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.842+0000 7f51d97ea640 1 --2- 172.21.15.19:0/2996511995 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51d4102d30 0x7f51d4100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:40.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.843+0000 7f51d97ea640 1 -- 172.21.15.19:0/2996511995 >> 172.21.15.19:0/2996511995 conn(0x7f51d40fc7d0 msgr2=0x7f51d4105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:40.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.843+0000 7f51d97ea640 1 -- 172.21.15.19:0/2996511995 shutdown_connections 2024-09-19T08:49:40.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:40.843+0000 7f51d97ea640 1 -- 172.21.15.19:0/2996511995 wait complete. 2024-09-19T08:49:41.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:41 smithi019 ceph-mon[30976]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:41.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:41 smithi019 ceph-mon[30976]: mds.? [v2:172.21.15.19:6834/805488508,v1:172.21.15.19:6835/805488508] up:boot 2024-09-19T08:49:41.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:41 smithi019 ceph-mon[30976]: fsmap 3 up:standby 2024-09-19T08:49:41.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:41 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T08:49:41.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:41 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:41.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:41 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:41.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:41 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:41.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:41 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:49:41.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:41 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:49:41.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:41 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:41.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:41 smithi019 ceph-mon[30976]: Deploying daemon mds.d on smithi019 2024-09-19T08:49:41.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:41 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/2996511995' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:49:41.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:41 smithi155 ceph-mon[34921]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:41.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:41 smithi155 ceph-mon[34921]: mds.? [v2:172.21.15.19:6834/805488508,v1:172.21.15.19:6835/805488508] up:boot 2024-09-19T08:49:41.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:41 smithi155 ceph-mon[34921]: fsmap 3 up:standby 2024-09-19T08:49:41.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:41 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T08:49:41.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:41 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:41.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:41 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:41.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:41 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:41.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:41 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:49:41.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:41 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:49:41.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:41 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:41.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:41 smithi155 ceph-mon[34921]: Deploying daemon mds.d on smithi019 2024-09-19T08:49:41.424 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:41 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/2996511995' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:49:41.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:41 smithi203 ceph-mon[35450]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:41.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:41 smithi203 ceph-mon[35450]: mds.? [v2:172.21.15.19:6834/805488508,v1:172.21.15.19:6835/805488508] up:boot 2024-09-19T08:49:41.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:41 smithi203 ceph-mon[35450]: fsmap 3 up:standby 2024-09-19T08:49:41.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:41 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T08:49:41.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:41 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:41.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:41 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:41.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:41 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:41.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:41 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:49:41.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:41 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:49:41.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:41 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:41.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:41 smithi203 ceph-mon[35450]: Deploying daemon mds.d on smithi019 2024-09-19T08:49:41.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:41 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/2996511995' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:49:43.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:43 smithi019 ceph-mon[30976]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:43.319 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 19 08:49:43 smithi019 systemd[1]: Starting Ceph mds.d for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T08:49:43.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:43 smithi155 ceph-mon[34921]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:43.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:43 smithi203 ceph-mon[35450]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:43.582 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 19 08:49:43 smithi019 podman[71127]: 2024-09-19 08:49:43.235216898 +0000 UTC m=+0.016610145 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:49:43.582 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 19 08:49:43 smithi019 podman[71127]: 2024-09-19 08:49:43.34673426 +0000 UTC m=+0.128127539 container create d7a2d18f594e3e241be696d83b2b29a9aef7a8ab0817f268f2353d9cfd45b434 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-d, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:49:43.582 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 19 08:49:43 smithi019 podman[71127]: 2024-09-19 08:49:43.582765307 +0000 UTC m=+0.364158557 container init d7a2d18f594e3e241be696d83b2b29a9aef7a8ab0817f268f2353d9cfd45b434 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-d, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-19T08:49:43.683 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:49:43.949 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:49:44.008 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 19 08:49:43 smithi019 podman[71127]: 2024-09-19 08:49:43.585806972 +0000 UTC m=+0.367200211 container start d7a2d18f594e3e241be696d83b2b29a9aef7a8ab0817f268f2353d9cfd45b434 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-d, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:49:44.008 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 19 08:49:43 smithi019 ceph-mds[71146]: -- 172.21.15.19:0/1599752826 <== mon.0 v2:172.21.15.19:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555b20513860 con 0x555b204f0800 2024-09-19T08:49:44.008 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 19 08:49:43 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-d[71142]: starting mds.d at 2024-09-19T08:49:44.009 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 19 08:49:43 smithi019 bash[71127]: d7a2d18f594e3e241be696d83b2b29a9aef7a8ab0817f268f2353d9cfd45b434 2024-09-19T08:49:44.009 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 19 08:49:43 smithi019 systemd[1]: Started Ceph mds.d for f26c9d84-7662-11ef-bceb-c7b262605968. 2024-09-19T08:49:44.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.436+0000 7f4f35f3d640 1 -- 172.21.15.19:0/1201483712 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f30102790 msgr2=0x7f4f301067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:44.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.436+0000 7f4f35f3d640 1 --2- 172.21.15.19:0/1201483712 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f30102790 0x7f4f301067e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4f24009900 tx=0x7f4f2402a410 comp rx=0 tx=0).stop 2024-09-19T08:49:44.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.436+0000 7f4f35f3d640 1 -- 172.21.15.19:0/1201483712 shutdown_connections 2024-09-19T08:49:44.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.436+0000 7f4f35f3d640 1 --2- 172.21.15.19:0/1201483712 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f30106f10 0x7f4f3010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:44.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.436+0000 7f4f35f3d640 1 --2- 172.21.15.19:0/1201483712 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f30102790 0x7f4f301067e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:44.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.436+0000 7f4f35f3d640 1 --2- 172.21.15.19:0/1201483712 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f30101de0 0x7f4f301021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:44.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.436+0000 7f4f35f3d640 1 -- 172.21.15.19:0/1201483712 >> 172.21.15.19:0/1201483712 conn(0x7f4f300fd8c0 msgr2=0x7f4f300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:44.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.436+0000 7f4f35f3d640 1 -- 172.21.15.19:0/1201483712 shutdown_connections 2024-09-19T08:49:44.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.436+0000 7f4f35f3d640 1 -- 172.21.15.19:0/1201483712 wait complete. 2024-09-19T08:49:44.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.436+0000 7f4f35f3d640 1 Processor -- start 2024-09-19T08:49:44.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.437+0000 7f4f35f3d640 1 -- start start 2024-09-19T08:49:44.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.437+0000 7f4f35f3d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f30101de0 0x7f4f3019a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:44.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.437+0000 7f4f35f3d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f30102790 0x7f4f3019abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:44.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.437+0000 7f4f35f3d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f30106f10 0x7f4f3019ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:44.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.437+0000 7f4f35f3d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4f30111f70 con 0x7f4f30106f10 2024-09-19T08:49:44.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.437+0000 7f4f35f3d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4f30111df0 con 0x7f4f30102790 2024-09-19T08:49:44.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.437+0000 7f4f35f3d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4f301120f0 con 0x7f4f30101de0 2024-09-19T08:49:44.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.437+0000 7f4f2ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f30106f10 0x7f4f3019ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:44.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.437+0000 7f4f2ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f30106f10 0x7f4f3019ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48732/0 (socket says 172.21.15.19:48732) 2024-09-19T08:49:44.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.437+0000 7f4f2ffff640 1 -- 172.21.15.19:0/1207399472 learned_addr learned my addr 172.21.15.19:0/1207399472 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:49:44.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.437+0000 7f4f2effd640 1 --2- 172.21.15.19:0/1207399472 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f30102790 0x7f4f3019abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:44.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.437+0000 7f4f2f7fe640 1 --2- 172.21.15.19:0/1207399472 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f30101de0 0x7f4f3019a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:44.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.437+0000 7f4f2ffff640 1 -- 172.21.15.19:0/1207399472 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f30101de0 msgr2=0x7f4f3019a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:44.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.437+0000 7f4f2ffff640 1 --2- 172.21.15.19:0/1207399472 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f30101de0 0x7f4f3019a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:44.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.437+0000 7f4f2ffff640 1 -- 172.21.15.19:0/1207399472 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f30102790 msgr2=0x7f4f3019abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:44.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.437+0000 7f4f2ffff640 1 --2- 172.21.15.19:0/1207399472 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f30102790 0x7f4f3019abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:44.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.437+0000 7f4f2ffff640 1 -- 172.21.15.19:0/1207399472 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f3019f640 con 0x7f4f30106f10 2024-09-19T08:49:44.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.438+0000 7f4f2ffff640 1 --2- 172.21.15.19:0/1207399472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f30106f10 0x7f4f3019ef60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4f28009fd0 tx=0x7f4f2800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:44.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.438+0000 7f4f2cff9640 1 -- 172.21.15.19:0/1207399472 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f28017070 con 0x7f4f30106f10 2024-09-19T08:49:44.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.438+0000 7f4f35f3d640 1 -- 172.21.15.19:0/1207399472 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f3019f930 con 0x7f4f30106f10 2024-09-19T08:49:44.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.438+0000 7f4f2cff9640 1 -- 172.21.15.19:0/1207399472 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f28003e50 con 0x7f4f30106f10 2024-09-19T08:49:44.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.438+0000 7f4f2cff9640 1 -- 172.21.15.19:0/1207399472 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f280106c0 con 0x7f4f30106f10 2024-09-19T08:49:44.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.438+0000 7f4f35f3d640 1 -- 172.21.15.19:0/1207399472 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f301a7210 con 0x7f4f30106f10 2024-09-19T08:49:44.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.439+0000 7f4f35f3d640 1 -- 172.21.15.19:0/1207399472 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f301021c0 con 0x7f4f30106f10 2024-09-19T08:49:44.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.440+0000 7f4f2cff9640 1 -- 172.21.15.19:0/1207399472 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f4f28003970 con 0x7f4f30106f10 2024-09-19T08:49:44.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.441+0000 7f4f2cff9640 1 --2- 172.21.15.19:0/1207399472 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4f180a3240 0x7f4f180a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:44.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.441+0000 7f4f2f7fe640 1 --2- 172.21.15.19:0/1207399472 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4f180a3240 0x7f4f180a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:44.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.441+0000 7f4f2cff9640 1 -- 172.21.15.19:0/1207399472 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f4f280cf1e0 con 0x7f4f30106f10 2024-09-19T08:49:44.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.441+0000 7f4f2f7fe640 1 --2- 172.21.15.19:0/1207399472 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4f180a3240 0x7f4f180a5700 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4f200058c0 tx=0x7f4f2000a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:44.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.445+0000 7f4f2cff9640 1 -- 172.21.15.19:0/1207399472 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4f2809c3a0 con 0x7f4f30106f10 2024-09-19T08:49:44.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.656+0000 7f4f35f3d640 1 -- 172.21.15.19:0/1207399472 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f301a7410 con 0x7f4f30106f10 2024-09-19T08:49:44.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.657+0000 7f4f2cff9640 1 -- 172.21.15.19:0/1207399472 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3910 (secure 0 0 0) 0x7f4f2809bca0 con 0x7f4f30106f10 2024-09-19T08:49:44.657 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:49:44.657 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":5,"btime":"2024-09-19T08:49:44:041903+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24431,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[]} 2024-09-19T08:49:44.657 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 5 2024-09-19T08:49:44.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.659+0000 7f4f35f3d640 1 -- 172.21.15.19:0/1207399472 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4f180a3240 msgr2=0x7f4f180a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:44.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.659+0000 7f4f35f3d640 1 --2- 172.21.15.19:0/1207399472 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4f180a3240 0x7f4f180a5700 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4f200058c0 tx=0x7f4f2000a4c0 comp rx=0 tx=0).stop 2024-09-19T08:49:44.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.659+0000 7f4f35f3d640 1 -- 172.21.15.19:0/1207399472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f30106f10 msgr2=0x7f4f3019ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:44.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.659+0000 7f4f35f3d640 1 --2- 172.21.15.19:0/1207399472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f30106f10 0x7f4f3019ef60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4f28009fd0 tx=0x7f4f2800b260 comp rx=0 tx=0).stop 2024-09-19T08:49:44.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.660+0000 7f4f35f3d640 1 -- 172.21.15.19:0/1207399472 shutdown_connections 2024-09-19T08:49:44.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.660+0000 7f4f35f3d640 1 --2- 172.21.15.19:0/1207399472 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4f180a3240 0x7f4f180a5700 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:44.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.660+0000 7f4f35f3d640 1 --2- 172.21.15.19:0/1207399472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f30106f10 0x7f4f3019ef60 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:44.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.660+0000 7f4f35f3d640 1 --2- 172.21.15.19:0/1207399472 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f30102790 0x7f4f3019abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:44.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.660+0000 7f4f35f3d640 1 --2- 172.21.15.19:0/1207399472 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f30101de0 0x7f4f3019a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:44.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.660+0000 7f4f35f3d640 1 -- 172.21.15.19:0/1207399472 >> 172.21.15.19:0/1207399472 conn(0x7f4f300fd8c0 msgr2=0x7f4f300feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:44.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.660+0000 7f4f35f3d640 1 -- 172.21.15.19:0/1207399472 shutdown_connections 2024-09-19T08:49:44.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:44.660+0000 7f4f35f3d640 1 -- 172.21.15.19:0/1207399472 wait complete. 2024-09-19T08:49:44.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:44 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:44.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:44 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:44.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:44 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:44.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:44 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:49:44.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:44 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:49:44.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:44 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:44.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:44 smithi155 ceph-mon[34921]: Deploying daemon mds.e on smithi155 2024-09-19T08:49:44.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:44 smithi155 ceph-mon[34921]: mds.? [v2:172.21.15.19:6836/1501683219,v1:172.21.15.19:6837/1501683219] up:boot 2024-09-19T08:49:44.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:44 smithi155 ceph-mon[34921]: fsmap 4 up:standby 2024-09-19T08:49:44.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:44 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T08:49:44.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:44 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1207399472' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:49:44.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:44 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:44.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:44 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:44.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:44 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:44.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:44 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:49:44.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:44 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:49:44.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:44 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:44.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:44 smithi203 ceph-mon[35450]: Deploying daemon mds.e on smithi155 2024-09-19T08:49:44.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:44 smithi203 ceph-mon[35450]: mds.? [v2:172.21.15.19:6836/1501683219,v1:172.21.15.19:6837/1501683219] up:boot 2024-09-19T08:49:44.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:44 smithi203 ceph-mon[35450]: fsmap 4 up:standby 2024-09-19T08:49:44.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:44 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T08:49:44.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:44 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1207399472' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:49:45.047 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:44 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:45.047 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:44 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:45.047 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:44 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:45.047 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:44 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:49:45.047 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:44 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:49:45.048 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:44 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:45.048 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:44 smithi019 ceph-mon[30976]: Deploying daemon mds.e on smithi155 2024-09-19T08:49:45.048 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:44 smithi019 ceph-mon[30976]: mds.? [v2:172.21.15.19:6836/1501683219,v1:172.21.15.19:6837/1501683219] up:boot 2024-09-19T08:49:45.048 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:44 smithi019 ceph-mon[30976]: fsmap 4 up:standby 2024-09-19T08:49:45.048 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:44 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T08:49:45.048 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:44 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1207399472' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:49:45.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:45 smithi155 ceph-mon[34921]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:45.923 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:49:45 smithi155 systemd[1]: Starting Ceph mds.e for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T08:49:46.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:45 smithi019 ceph-mon[30976]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:46.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:45 smithi203 ceph-mon[35450]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:46.250 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:49:45 smithi155 podman[65207]: 2024-09-19 08:49:45.86965336 +0000 UTC m=+0.015982350 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:49:46.250 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:49:45 smithi155 podman[65207]: 2024-09-19 08:49:45.990171641 +0000 UTC m=+0.136500630 container create 2b5274a37fe54b288ae13a5388b1509a265ba25574bc43693f95caa7a1b2782e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-e, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-19T08:49:46.251 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:49:46 smithi155 podman[65207]: 2024-09-19 08:49:46.251232999 +0000 UTC m=+0.397561989 container init 2b5274a37fe54b288ae13a5388b1509a265ba25574bc43693f95caa7a1b2782e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-e, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:49:46.672 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:49:46 smithi155 podman[65207]: 2024-09-19 08:49:46.254373711 +0000 UTC m=+0.400702707 container start 2b5274a37fe54b288ae13a5388b1509a265ba25574bc43693f95caa7a1b2782e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-e, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-19T08:49:46.673 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:49:46 smithi155 ceph-mds[65226]: -- 172.21.15.155:0/1192036376 <== mon.2 v2:172.21.15.155:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f1dfd2f860 con 0x55f1dfd0c800 2024-09-19T08:49:46.673 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:49:46 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-e[65222]: starting mds.e at 2024-09-19T08:49:46.673 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:49:46 smithi155 bash[65207]: 2b5274a37fe54b288ae13a5388b1509a265ba25574bc43693f95caa7a1b2782e 2024-09-19T08:49:46.673 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:49:46 smithi155 systemd[1]: Started Ceph mds.e for f26c9d84-7662-11ef-bceb-c7b262605968. 2024-09-19T08:49:47.505 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:49:47.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:47 smithi155 ceph-mon[34921]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:47.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:47 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:47.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:47 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:47.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:47 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:47.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:47 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:49:47.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:47 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:49:47.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:47 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:47.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:47 smithi155 ceph-mon[34921]: Deploying daemon mds.f on smithi203 2024-09-19T08:49:47.674 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:47 smithi155 ceph-mon[34921]: mds.? [v2:172.21.15.155:6834/2480841559,v1:172.21.15.155:6835/2480841559] up:boot 2024-09-19T08:49:47.674 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:47 smithi155 ceph-mon[34921]: fsmap 5 up:standby 2024-09-19T08:49:47.674 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:47 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T08:49:47.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:47 smithi203 ceph-mon[35450]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:47.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:47 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:47.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:47 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:47.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:47 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:47.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:47 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:49:47.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:47 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:49:47.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:47 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:47.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:47 smithi203 ceph-mon[35450]: Deploying daemon mds.f on smithi203 2024-09-19T08:49:47.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:47 smithi203 ceph-mon[35450]: mds.? [v2:172.21.15.155:6834/2480841559,v1:172.21.15.155:6835/2480841559] up:boot 2024-09-19T08:49:47.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:47 smithi203 ceph-mon[35450]: fsmap 5 up:standby 2024-09-19T08:49:47.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:47 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T08:49:47.778 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:49:47.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:47 smithi019 ceph-mon[30976]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:47.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:47 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:47.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:47 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:47.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:47 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:47.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:47 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:49:47.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:47 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:49:47.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:47 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:47.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:47 smithi019 ceph-mon[30976]: Deploying daemon mds.f on smithi203 2024-09-19T08:49:47.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:47 smithi019 ceph-mon[30976]: mds.? [v2:172.21.15.155:6834/2480841559,v1:172.21.15.155:6835/2480841559] up:boot 2024-09-19T08:49:47.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:47 smithi019 ceph-mon[30976]: fsmap 5 up:standby 2024-09-19T08:49:47.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:47 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T08:49:48.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.262+0000 7fbb3c31e640 1 -- 172.21.15.19:0/136824980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb34101420 msgr2=0x7fbb3410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:48.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.262+0000 7fbb3c31e640 1 --2- 172.21.15.19:0/136824980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb34101420 0x7fbb3410d950 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbb24009930 tx=0x7fbb2402a420 comp rx=0 tx=0).stop 2024-09-19T08:49:48.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.262+0000 7fbb3c31e640 1 -- 172.21.15.19:0/136824980 shutdown_connections 2024-09-19T08:49:48.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.262+0000 7fbb3c31e640 1 --2- 172.21.15.19:0/136824980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb34101420 0x7fbb3410d950 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.262+0000 7fbb3c31e640 1 --2- 172.21.15.19:0/136824980 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb34100a80 0x7fbb34100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.262+0000 7fbb3c31e640 1 --2- 172.21.15.19:0/136824980 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb34106a80 0x7fbb34106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.262+0000 7fbb3c31e640 1 -- 172.21.15.19:0/136824980 >> 172.21.15.19:0/136824980 conn(0x7fbb340fc7a0 msgr2=0x7fbb340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.262+0000 7fbb3c31e640 1 -- 172.21.15.19:0/136824980 shutdown_connections 2024-09-19T08:49:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.262+0000 7fbb3c31e640 1 -- 172.21.15.19:0/136824980 wait complete. 2024-09-19T08:49:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.263+0000 7fbb3c31e640 1 Processor -- start 2024-09-19T08:49:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.263+0000 7fbb3c31e640 1 -- start start 2024-09-19T08:49:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.263+0000 7fbb3c31e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb34100a80 0x7fbb340fcde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.263+0000 7fbb3c31e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb34101420 0x7fbb340fd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.263+0000 7fbb3c31e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb34106a80 0x7fbb340fd860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.263+0000 7fbb3c31e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbb34110e80 con 0x7fbb34100a80 2024-09-19T08:49:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.263+0000 7fbb3c31e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbb34110d00 con 0x7fbb34106a80 2024-09-19T08:49:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.263+0000 7fbb3c31e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbb34111000 con 0x7fbb34101420 2024-09-19T08:49:48.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.263+0000 7fbb3a0ba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb34100a80 0x7fbb340fcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.263+0000 7fbb3a0ba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb34100a80 0x7fbb340fcde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60842/0 (socket says 172.21.15.19:60842) 2024-09-19T08:49:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.263+0000 7fbb3a0ba640 1 -- 172.21.15.19:0/3405948437 learned_addr learned my addr 172.21.15.19:0/3405948437 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:49:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.263+0000 7fbb398b9640 1 --2- 172.21.15.19:0/3405948437 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb34101420 0x7fbb340fd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.263+0000 7fbb3a8bb640 1 --2- 172.21.15.19:0/3405948437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb34106a80 0x7fbb340fd860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.263+0000 7fbb3a0ba640 1 -- 172.21.15.19:0/3405948437 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb34101420 msgr2=0x7fbb340fd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.263+0000 7fbb3a0ba640 1 --2- 172.21.15.19:0/3405948437 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb34101420 0x7fbb340fd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.263+0000 7fbb3a0ba640 1 -- 172.21.15.19:0/3405948437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb34106a80 msgr2=0x7fbb340fd860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.263+0000 7fbb3a0ba640 1 --2- 172.21.15.19:0/3405948437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb34106a80 0x7fbb340fd860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.263+0000 7fbb3a0ba640 1 -- 172.21.15.19:0/3405948437 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb341a6950 con 0x7fbb34100a80 2024-09-19T08:49:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.264+0000 7fbb3a0ba640 1 --2- 172.21.15.19:0/3405948437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb34100a80 0x7fbb340fcde0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c00eb90 tx=0x7fbb2c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.264+0000 7fbb337fe640 1 -- 172.21.15.19:0/3405948437 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c004d20 con 0x7fbb34100a80 2024-09-19T08:49:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.264+0000 7fbb337fe640 1 -- 172.21.15.19:0/3405948437 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb2c00ee90 con 0x7fbb34100a80 2024-09-19T08:49:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.264+0000 7fbb3c31e640 1 -- 172.21.15.19:0/3405948437 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb341a6c40 con 0x7fbb34100a80 2024-09-19T08:49:48.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.264+0000 7fbb337fe640 1 -- 172.21.15.19:0/3405948437 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb2c010830 con 0x7fbb34100a80 2024-09-19T08:49:48.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.264+0000 7fbb3c31e640 1 -- 172.21.15.19:0/3405948437 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb341a7130 con 0x7fbb34100a80 2024-09-19T08:49:48.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.265+0000 7fbb3c31e640 1 -- 172.21.15.19:0/3405948437 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb34100ee0 con 0x7fbb34100a80 2024-09-19T08:49:48.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.266+0000 7fbb337fe640 1 -- 172.21.15.19:0/3405948437 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fbb2c005000 con 0x7fbb34100a80 2024-09-19T08:49:48.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.267+0000 7fbb337fe640 1 --2- 172.21.15.19:0/3405948437 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbb1c0a3240 0x7fbb1c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:48.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.267+0000 7fbb337fe640 1 -- 172.21.15.19:0/3405948437 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fbb2c0cfca0 con 0x7fbb34100a80 2024-09-19T08:49:48.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.267+0000 7fbb398b9640 1 --2- 172.21.15.19:0/3405948437 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbb1c0a3240 0x7fbb1c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:48.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.267+0000 7fbb398b9640 1 --2- 172.21.15.19:0/3405948437 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbb1c0a3240 0x7fbb1c0a5700 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbb340fe870 tx=0x7fbb2800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:48.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.270+0000 7fbb337fe640 1 -- 172.21.15.19:0/3405948437 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbb2c054210 con 0x7fbb34100a80 2024-09-19T08:49:48.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.481+0000 7fbb3c31e640 1 -- 172.21.15.19:0/3405948437 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb340fe310 con 0x7fbb34100a80 2024-09-19T08:49:48.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.482+0000 7fbb337fe640 1 -- 172.21.15.19:0/3405948437 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4738 (secure 0 0 0) 0x7fbb340fe310 con 0x7fbb34100a80 2024-09-19T08:49:48.482 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:49:48.482 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":6,"btime":"2024-09-19T08:49:46:744658+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24431,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2480841559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2480841559},{"type":"v1","addr":"172.21.15.155:6835","nonce":2480841559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-19T08:49:48.482 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 6 2024-09-19T08:49:48.482 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 08:49:48 smithi203 systemd[1]: Starting Ceph mds.f for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T08:49:48.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.485+0000 7fbb3c31e640 1 -- 172.21.15.19:0/3405948437 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbb1c0a3240 msgr2=0x7fbb1c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:48.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.485+0000 7fbb3c31e640 1 --2- 172.21.15.19:0/3405948437 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbb1c0a3240 0x7fbb1c0a5700 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbb340fe870 tx=0x7fbb2800a2d0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.485+0000 7fbb3c31e640 1 -- 172.21.15.19:0/3405948437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb34100a80 msgr2=0x7fbb340fcde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:48.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.485+0000 7fbb3c31e640 1 --2- 172.21.15.19:0/3405948437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb34100a80 0x7fbb340fcde0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbb2c00eb90 tx=0x7fbb2c00c6a0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.485+0000 7fbb3c31e640 1 -- 172.21.15.19:0/3405948437 shutdown_connections 2024-09-19T08:49:48.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.485+0000 7fbb3c31e640 1 --2- 172.21.15.19:0/3405948437 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbb1c0a3240 0x7fbb1c0a5700 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.485+0000 7fbb3c31e640 1 --2- 172.21.15.19:0/3405948437 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb34101420 0x7fbb340fd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.485+0000 7fbb3c31e640 1 --2- 172.21.15.19:0/3405948437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb34106a80 0x7fbb340fd860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.485+0000 7fbb3c31e640 1 --2- 172.21.15.19:0/3405948437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb34100a80 0x7fbb340fcde0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:48.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.485+0000 7fbb3c31e640 1 -- 172.21.15.19:0/3405948437 >> 172.21.15.19:0/3405948437 conn(0x7fbb340fc7a0 msgr2=0x7fbb3406aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:48.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.485+0000 7fbb3c31e640 1 -- 172.21.15.19:0/3405948437 shutdown_connections 2024-09-19T08:49:48.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:48.485+0000 7fbb3c31e640 1 -- 172.21.15.19:0/3405948437 wait complete. 2024-09-19T08:49:48.821 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 08:49:48 smithi203 podman[65440]: 2024-09-19 08:49:48.420070277 +0000 UTC m=+0.016006733 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:49:48.821 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 08:49:48 smithi203 podman[65440]: 2024-09-19 08:49:48.536536267 +0000 UTC m=+0.132472722 container create 6cb766f17c95e3cb628268e6552fbed60668c8fa15b82cda13f68ec15d6dcb8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-f, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-19T08:49:49.231 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 08:49:48 smithi203 podman[65440]: 2024-09-19 08:49:48.822419454 +0000 UTC m=+0.418355927 container init 6cb766f17c95e3cb628268e6552fbed60668c8fa15b82cda13f68ec15d6dcb8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-f, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T08:49:49.232 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 08:49:48 smithi203 podman[65440]: 2024-09-19 08:49:48.825273461 +0000 UTC m=+0.421209925 container start 6cb766f17c95e3cb628268e6552fbed60668c8fa15b82cda13f68ec15d6dcb8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-f, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:49:49.232 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 08:49:48 smithi203 ceph-mds[65459]: -- 172.21.15.203:0/4103023292 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a38d709860 con 0x55a38d6e7000 2024-09-19T08:49:49.232 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 08:49:48 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-f[65455]: starting mds.f at 2024-09-19T08:49:49.232 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 08:49:48 smithi203 bash[65440]: 6cb766f17c95e3cb628268e6552fbed60668c8fa15b82cda13f68ec15d6dcb8f 2024-09-19T08:49:49.232 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 08:49:48 smithi203 systemd[1]: Started Ceph mds.f for f26c9d84-7662-11ef-bceb-c7b262605968. 2024-09-19T08:49:49.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:49 smithi155 ceph-mon[34921]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:49.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:49 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3405948437' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:49:49.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:49 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:49.674 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:49 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:49.674 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:49 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:49.674 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:49 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:49:49.674 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:49 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:49:49.674 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:49 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:49.692 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:49 smithi203 ceph-mon[35450]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:49.693 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:49 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3405948437' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:49:49.693 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:49 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:49.693 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:49 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:49.693 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:49 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:49.693 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:49 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:49:49.694 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:49 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:49:49.694 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:49 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:49.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:49 smithi019 ceph-mon[30976]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:49.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:49 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3405948437' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:49:49.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:49 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:49.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:49 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:49.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:49 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:49.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:49 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:49:49.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:49 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:49:49.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:49 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:50.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:50 smithi155 ceph-mon[34921]: Deploying daemon mds.c on smithi203 2024-09-19T08:49:50.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:50 smithi155 ceph-mon[34921]: mds.? [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] up:boot 2024-09-19T08:49:50.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:50 smithi155 ceph-mon[34921]: fsmap 6 up:standby 2024-09-19T08:49:50.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:50 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T08:49:50.675 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:50 smithi203 ceph-mon[35450]: Deploying daemon mds.c on smithi203 2024-09-19T08:49:50.675 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:50 smithi203 ceph-mon[35450]: mds.? [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] up:boot 2024-09-19T08:49:50.675 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:50 smithi203 ceph-mon[35450]: fsmap 6 up:standby 2024-09-19T08:49:50.675 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:50 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T08:49:50.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:50 smithi019 ceph-mon[30976]: Deploying daemon mds.c on smithi203 2024-09-19T08:49:50.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:50 smithi019 ceph-mon[30976]: mds.? [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] up:boot 2024-09-19T08:49:50.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:50 smithi019 ceph-mon[30976]: fsmap 6 up:standby 2024-09-19T08:49:50.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:50 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T08:49:50.981 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 08:49:50 smithi203 systemd[1]: Starting Ceph mds.c for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T08:49:51.157 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:49:51.344 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 08:49:51 smithi203 podman[65742]: 2024-09-19 08:49:50.971427118 +0000 UTC m=+0.015744683 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:49:51.344 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 08:49:51 smithi203 podman[65742]: 2024-09-19 08:49:51.100317678 +0000 UTC m=+0.144635241 container create e7da5fc02f01a531241c31e010689ab99770b6c162202020b22cdfd820b3c6fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-c, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True) 2024-09-19T08:49:51.344 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 08:49:51 smithi203 podman[65742]: 2024-09-19 08:49:51.344773518 +0000 UTC m=+0.389091086 container init e7da5fc02f01a531241c31e010689ab99770b6c162202020b22cdfd820b3c6fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-c, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T08:49:51.428 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:49:51.550 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:51 smithi019 ceph-mon[30976]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:51.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:51 smithi155 ceph-mon[34921]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:51.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:51 smithi203 ceph-mon[35450]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:51.732 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 08:49:51 smithi203 podman[65742]: 2024-09-19 08:49:51.347873236 +0000 UTC m=+0.392190793 container start e7da5fc02f01a531241c31e010689ab99770b6c162202020b22cdfd820b3c6fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-19T08:49:51.732 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 08:49:51 smithi203 ceph-mds[65762]: -- 172.21.15.203:0/3171008763 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cbd11e7860 con 0x55cbd11c5400 2024-09-19T08:49:51.732 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 08:49:51 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-c[65758]: starting mds.c at 2024-09-19T08:49:51.732 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 08:49:51 smithi203 bash[65742]: e7da5fc02f01a531241c31e010689ab99770b6c162202020b22cdfd820b3c6fc 2024-09-19T08:49:51.732 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 08:49:51 smithi203 systemd[1]: Started Ceph mds.c for f26c9d84-7662-11ef-bceb-c7b262605968. 2024-09-19T08:49:51.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.895+0000 7fc9814dd640 1 -- 172.21.15.19:0/3712332271 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc97c106f10 msgr2=0x7fc97c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:51.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.895+0000 7fc9814dd640 1 --2- 172.21.15.19:0/3712332271 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc97c106f10 0x7fc97c10ea90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc974009ca0 tx=0x7fc97402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:49:51.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.895+0000 7fc9814dd640 1 -- 172.21.15.19:0/3712332271 shutdown_connections 2024-09-19T08:49:51.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.895+0000 7fc9814dd640 1 --2- 172.21.15.19:0/3712332271 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc97c106f10 0x7fc97c10ea90 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:51.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.895+0000 7fc9814dd640 1 --2- 172.21.15.19:0/3712332271 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc97c102790 0x7fc97c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:51.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.895+0000 7fc9814dd640 1 --2- 172.21.15.19:0/3712332271 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc97c101de0 0x7fc97c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:51.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.895+0000 7fc9814dd640 1 -- 172.21.15.19:0/3712332271 >> 172.21.15.19:0/3712332271 conn(0x7fc97c0fd8c0 msgr2=0x7fc97c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:51.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.896+0000 7fc9814dd640 1 -- 172.21.15.19:0/3712332271 shutdown_connections 2024-09-19T08:49:51.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.896+0000 7fc9814dd640 1 -- 172.21.15.19:0/3712332271 wait complete. 2024-09-19T08:49:51.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.896+0000 7fc9814dd640 1 Processor -- start 2024-09-19T08:49:51.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.896+0000 7fc9814dd640 1 -- start start 2024-09-19T08:49:51.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.897+0000 7fc9814dd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc97c101de0 0x7fc97c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:51.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.897+0000 7fc9814dd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc97c102790 0x7fc97c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:51.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.897+0000 7fc9814dd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc97c106f10 0x7fc97c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:51.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.897+0000 7fc9814dd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc97c111f70 con 0x7fc97c106f10 2024-09-19T08:49:51.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.897+0000 7fc9814dd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc97c111df0 con 0x7fc97c101de0 2024-09-19T08:49:51.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.897+0000 7fc9814dd640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc97c1120f0 con 0x7fc97c102790 2024-09-19T08:49:51.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.897+0000 7fc97b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc97c106f10 0x7fc97c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:51.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.897+0000 7fc97b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc97c106f10 0x7fc97c074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60868/0 (socket says 172.21.15.19:60868) 2024-09-19T08:49:51.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.897+0000 7fc97b7fe640 1 -- 172.21.15.19:0/837292228 learned_addr learned my addr 172.21.15.19:0/837292228 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:49:51.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.897+0000 7fc97a7fc640 1 --2- 172.21.15.19:0/837292228 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc97c102790 0x7fc97c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:51.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.897+0000 7fc97affd640 1 --2- 172.21.15.19:0/837292228 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc97c101de0 0x7fc97c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:51.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.897+0000 7fc97b7fe640 1 -- 172.21.15.19:0/837292228 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc97c102790 msgr2=0x7fc97c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:51.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.897+0000 7fc97b7fe640 1 --2- 172.21.15.19:0/837292228 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc97c102790 0x7fc97c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:51.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.897+0000 7fc97b7fe640 1 -- 172.21.15.19:0/837292228 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc97c101de0 msgr2=0x7fc97c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:51.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.897+0000 7fc97b7fe640 1 --2- 172.21.15.19:0/837292228 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc97c101de0 0x7fc97c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:51.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.897+0000 7fc97b7fe640 1 -- 172.21.15.19:0/837292228 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc97c1a6870 con 0x7fc97c106f10 2024-09-19T08:49:51.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.897+0000 7fc97b7fe640 1 --2- 172.21.15.19:0/837292228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc97c106f10 0x7fc97c074f70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc974031a20 tx=0x7fc974031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:51.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.897+0000 7fc963fff640 1 -- 172.21.15.19:0/837292228 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc974003c30 con 0x7fc97c106f10 2024-09-19T08:49:51.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.898+0000 7fc9814dd640 1 -- 172.21.15.19:0/837292228 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc97c1a6b00 con 0x7fc97c106f10 2024-09-19T08:49:51.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.898+0000 7fc963fff640 1 -- 172.21.15.19:0/837292228 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc974003dd0 con 0x7fc97c106f10 2024-09-19T08:49:51.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.898+0000 7fc963fff640 1 -- 172.21.15.19:0/837292228 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc97402fba0 con 0x7fc97c106f10 2024-09-19T08:49:51.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.898+0000 7fc9814dd640 1 -- 172.21.15.19:0/837292228 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc97c1a7090 con 0x7fc97c106f10 2024-09-19T08:49:51.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.899+0000 7fc9814dd640 1 -- 172.21.15.19:0/837292228 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc97c1021c0 con 0x7fc97c106f10 2024-09-19T08:49:51.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.900+0000 7fc963fff640 1 -- 172.21.15.19:0/837292228 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fc9740046c0 con 0x7fc97c106f10 2024-09-19T08:49:51.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.900+0000 7fc963fff640 1 --2- 172.21.15.19:0/837292228 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc9640a3240 0x7fc9640a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:51.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.901+0000 7fc97affd640 1 --2- 172.21.15.19:0/837292228 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc9640a3240 0x7fc9640a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:51.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.901+0000 7fc963fff640 1 -- 172.21.15.19:0/837292228 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fc9740f0600 con 0x7fc97c106f10 2024-09-19T08:49:51.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.901+0000 7fc97affd640 1 --2- 172.21.15.19:0/837292228 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc9640a3240 0x7fc9640a5700 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc96c005d00 tx=0x7fc96c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:51.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:51.905+0000 7fc963fff640 1 -- 172.21.15.19:0/837292228 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc9740bd970 con 0x7fc97c106f10 2024-09-19T08:49:52.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:52.118+0000 7fc9814dd640 1 -- 172.21.15.19:0/837292228 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc97c10a0f0 con 0x7fc97c106f10 2024-09-19T08:49:52.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:52.119+0000 7fc963fff640 1 -- 172.21.15.19:0/837292228 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6394 (secure 0 0 0) 0x7fc9740bd270 con 0x7fc97c106f10 2024-09-19T08:49:52.120 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:49:52.120 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":8,"btime":"2024-09-19T08:49:51:414746+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24431,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2480841559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2480841559},{"type":"v1","addr":"172.21.15.155:6835","nonce":2480841559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24469,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-19T08:49:52.120 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 8 2024-09-19T08:49:52.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:52.121+0000 7fc9814dd640 1 -- 172.21.15.19:0/837292228 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc9640a3240 msgr2=0x7fc9640a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:52.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:52.121+0000 7fc9814dd640 1 --2- 172.21.15.19:0/837292228 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc9640a3240 0x7fc9640a5700 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc96c005d00 tx=0x7fc96c00b410 comp rx=0 tx=0).stop 2024-09-19T08:49:52.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:52.121+0000 7fc9814dd640 1 -- 172.21.15.19:0/837292228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc97c106f10 msgr2=0x7fc97c074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:52.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:52.121+0000 7fc9814dd640 1 --2- 172.21.15.19:0/837292228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc97c106f10 0x7fc97c074f70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc974031a20 tx=0x7fc974031a50 comp rx=0 tx=0).stop 2024-09-19T08:49:52.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:52.121+0000 7fc9814dd640 1 -- 172.21.15.19:0/837292228 shutdown_connections 2024-09-19T08:49:52.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:52.121+0000 7fc9814dd640 1 --2- 172.21.15.19:0/837292228 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc9640a3240 0x7fc9640a5700 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:52.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:52.121+0000 7fc9814dd640 1 --2- 172.21.15.19:0/837292228 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc97c102790 0x7fc97c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:52.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:52.121+0000 7fc9814dd640 1 --2- 172.21.15.19:0/837292228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc97c106f10 0x7fc97c074f70 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:52.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:52.121+0000 7fc9814dd640 1 --2- 172.21.15.19:0/837292228 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc97c101de0 0x7fc97c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:52.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:52.121+0000 7fc9814dd640 1 -- 172.21.15.19:0/837292228 >> 172.21.15.19:0/837292228 conn(0x7fc97c0fd8c0 msgr2=0x7fc97c0fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:52.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:52.121+0000 7fc9814dd640 1 -- 172.21.15.19:0/837292228 shutdown_connections 2024-09-19T08:49:52.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:52.122+0000 7fc9814dd640 1 -- 172.21.15.19:0/837292228 wait complete. 2024-09-19T08:49:52.657 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:52 smithi155 ceph-mon[34921]: mds.? [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] up:boot 2024-09-19T08:49:52.658 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:52 smithi155 ceph-mon[34921]: fsmap 7 up:standby 2024-09-19T08:49:52.658 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:52 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T08:49:52.658 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:52 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:52.658 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:52 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:52.658 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:52 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:52.658 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:52 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:49:52.658 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:52 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:49:52.658 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:52 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:52.658 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:52 smithi155 ceph-mon[34921]: Deploying daemon mds.h on smithi155 2024-09-19T08:49:52.658 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:52 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/837292228' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:49:52.692 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:52 smithi019 ceph-mon[30976]: mds.? [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] up:boot 2024-09-19T08:49:52.693 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:52 smithi019 ceph-mon[30976]: fsmap 7 up:standby 2024-09-19T08:49:52.693 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:52 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T08:49:52.693 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:52 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:52.693 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:52 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:52.693 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:52 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:52.694 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:52 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:49:52.694 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:52 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:49:52.694 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:52 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:52.694 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:52 smithi019 ceph-mon[30976]: Deploying daemon mds.h on smithi155 2024-09-19T08:49:52.694 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:52 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/837292228' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:49:52.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:52 smithi203 ceph-mon[35450]: mds.? [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] up:boot 2024-09-19T08:49:52.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:52 smithi203 ceph-mon[35450]: fsmap 7 up:standby 2024-09-19T08:49:52.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:52 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T08:49:52.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:52 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:52.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:52 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:52.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:52 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:52.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:52 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:49:52.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:52 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:49:52.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:52 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:52.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:52 smithi203 ceph-mon[35450]: Deploying daemon mds.h on smithi155 2024-09-19T08:49:52.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:52 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/837292228' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:49:53.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:53 smithi155 ceph-mon[34921]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:53.673 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 19 08:49:53 smithi155 systemd[1]: Starting Ceph mds.h for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T08:49:53.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:53 smithi019 ceph-mon[30976]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:53.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:53 smithi203 ceph-mon[35450]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:54.039 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 19 08:49:53 smithi155 podman[65509]: 2024-09-19 08:49:53.786642153 +0000 UTC m=+0.108031183 container create 609fef8bb1bd4688b42976ab9436d46d706ff7c9f1e89c040644d8054fcd9cfd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-h, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, ceph=True) 2024-09-19T08:49:54.039 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 19 08:49:53 smithi155 podman[65509]: 2024-09-19 08:49:53.694462417 +0000 UTC m=+0.015851459 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:49:54.039 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 19 08:49:54 smithi155 podman[65509]: 2024-09-19 08:49:54.039512453 +0000 UTC m=+0.360901482 container init 609fef8bb1bd4688b42976ab9436d46d706ff7c9f1e89c040644d8054fcd9cfd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-h, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-19T08:49:54.423 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 19 08:49:54 smithi155 podman[65509]: 2024-09-19 08:49:54.042439476 +0000 UTC m=+0.363828506 container start 609fef8bb1bd4688b42976ab9436d46d706ff7c9f1e89c040644d8054fcd9cfd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-h, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-19T08:49:54.423 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 19 08:49:54 smithi155 ceph-mds[65528]: -- 172.21.15.155:0/3753003996 <== mon.2 v2:172.21.15.155:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5564db27b860 con 0x5564db258800 2024-09-19T08:49:54.423 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 19 08:49:54 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-h[65524]: starting mds.h at 2024-09-19T08:49:54.423 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 19 08:49:54 smithi155 bash[65509]: 609fef8bb1bd4688b42976ab9436d46d706ff7c9f1e89c040644d8054fcd9cfd 2024-09-19T08:49:54.423 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 19 08:49:54 smithi155 systemd[1]: Started Ceph mds.h for f26c9d84-7662-11ef-bceb-c7b262605968. 2024-09-19T08:49:54.721 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:49:54.992 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:49:55.233 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:55 smithi203 ceph-mon[35450]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:55.233 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:55 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:55.233 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:55 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:55.234 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:55 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:55.234 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:55 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:49:55.234 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:55 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:49:55.234 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:55 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:55.234 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:55 smithi203 ceph-mon[35450]: Deploying daemon mds.i on smithi203 2024-09-19T08:49:55.234 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:55 smithi203 ceph-mon[35450]: mds.? [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] up:boot 2024-09-19T08:49:55.234 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:55 smithi203 ceph-mon[35450]: fsmap 8 up:standby 2024-09-19T08:49:55.234 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:55 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T08:49:55.370 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:55 smithi019 ceph-mon[30976]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:55.370 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:55 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:55.371 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:55 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:55.371 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:55 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:55.371 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:55 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:49:55.371 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:55 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:49:55.371 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:55 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:55.371 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:55 smithi019 ceph-mon[30976]: Deploying daemon mds.i on smithi203 2024-09-19T08:49:55.371 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:55 smithi019 ceph-mon[30976]: mds.? [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] up:boot 2024-09-19T08:49:55.371 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:55 smithi019 ceph-mon[30976]: fsmap 8 up:standby 2024-09-19T08:49:55.371 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:55 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T08:49:55.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.562+0000 7f4f98685640 1 -- 172.21.15.19:0/2362049452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f90100a80 msgr2=0x7f4f90100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:55.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.562+0000 7f4f98685640 1 --2- 172.21.15.19:0/2362049452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f90100a80 0x7f4f90100ee0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009930 tx=0x7f4f8002a420 comp rx=0 tx=0).stop 2024-09-19T08:49:55.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.562+0000 7f4f98685640 1 -- 172.21.15.19:0/2362049452 shutdown_connections 2024-09-19T08:49:55.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.562+0000 7f4f98685640 1 --2- 172.21.15.19:0/2362049452 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f90101420 0x7f4f9010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.562+0000 7f4f98685640 1 --2- 172.21.15.19:0/2362049452 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f90100a80 0x7f4f90100ee0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.562+0000 7f4f98685640 1 --2- 172.21.15.19:0/2362049452 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f90106a80 0x7f4f90106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.562+0000 7f4f98685640 1 -- 172.21.15.19:0/2362049452 >> 172.21.15.19:0/2362049452 conn(0x7f4f900fc7a0 msgr2=0x7f4f900febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:55.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.562+0000 7f4f98685640 1 -- 172.21.15.19:0/2362049452 shutdown_connections 2024-09-19T08:49:55.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.562+0000 7f4f98685640 1 -- 172.21.15.19:0/2362049452 wait complete. 2024-09-19T08:49:55.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.562+0000 7f4f98685640 1 Processor -- start 2024-09-19T08:49:55.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.563+0000 7f4f98685640 1 -- start start 2024-09-19T08:49:55.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.563+0000 7f4f98685640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f90100a80 0x7f4f90197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:55.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.563+0000 7f4f98685640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f90101420 0x7f4f901978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:55.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.563+0000 7f4f98685640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f90106a80 0x7f4f9019bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:55.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.563+0000 7f4f98685640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4f90110e80 con 0x7f4f90106a80 2024-09-19T08:49:55.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.563+0000 7f4f98685640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4f90110d00 con 0x7f4f90100a80 2024-09-19T08:49:55.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.563+0000 7f4f98685640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4f90111000 con 0x7f4f90101420 2024-09-19T08:49:55.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.563+0000 7f4f96c22640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f90106a80 0x7f4f9019bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:55.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.563+0000 7f4f96c22640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f90106a80 0x7f4f9019bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37438/0 (socket says 172.21.15.19:37438) 2024-09-19T08:49:55.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.563+0000 7f4f96c22640 1 -- 172.21.15.19:0/4047967689 learned_addr learned my addr 172.21.15.19:0/4047967689 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:49:55.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.563+0000 7f4f95c20640 1 --2- 172.21.15.19:0/4047967689 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f90101420 0x7f4f901978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:55.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.563+0000 7f4f96421640 1 --2- 172.21.15.19:0/4047967689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f90100a80 0x7f4f90197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:55.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.563+0000 7f4f96c22640 1 -- 172.21.15.19:0/4047967689 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f90101420 msgr2=0x7f4f901978a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:55.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.563+0000 7f4f96c22640 1 --2- 172.21.15.19:0/4047967689 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f90101420 0x7f4f901978a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.563+0000 7f4f96c22640 1 -- 172.21.15.19:0/4047967689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f90100a80 msgr2=0x7f4f90197360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:55.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.563+0000 7f4f96c22640 1 --2- 172.21.15.19:0/4047967689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f90100a80 0x7f4f90197360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.563+0000 7f4f96c22640 1 -- 172.21.15.19:0/4047967689 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f9019c310 con 0x7f4f90106a80 2024-09-19T08:49:55.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.563+0000 7f4f96c22640 1 --2- 172.21.15.19:0/4047967689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f90106a80 0x7f4f9019bc30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4f8800eaa0 tx=0x7f4f8800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:55.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.564+0000 7f4f877fe640 1 -- 172.21.15.19:0/4047967689 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8800cdb0 con 0x7f4f90106a80 2024-09-19T08:49:55.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.564+0000 7f4f98685640 1 -- 172.21.15.19:0/4047967689 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f9019c600 con 0x7f4f90106a80 2024-09-19T08:49:55.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.564+0000 7f4f877fe640 1 -- 172.21.15.19:0/4047967689 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f88005020 con 0x7f4f90106a80 2024-09-19T08:49:55.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.564+0000 7f4f877fe640 1 -- 172.21.15.19:0/4047967689 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f880116b0 con 0x7f4f90106a80 2024-09-19T08:49:55.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.564+0000 7f4f98685640 1 -- 172.21.15.19:0/4047967689 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f901a3ee0 con 0x7f4f90106a80 2024-09-19T08:49:55.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.565+0000 7f4f98685640 1 -- 172.21.15.19:0/4047967689 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f90100ee0 con 0x7f4f90106a80 2024-09-19T08:49:55.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.566+0000 7f4f877fe640 1 -- 172.21.15.19:0/4047967689 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f4f88005560 con 0x7f4f90106a80 2024-09-19T08:49:55.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.566+0000 7f4f877fe640 1 --2- 172.21.15.19:0/4047967689 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4f7c0a3240 0x7f4f7c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:55.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.567+0000 7f4f96421640 1 --2- 172.21.15.19:0/4047967689 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4f7c0a3240 0x7f4f7c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:55.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.567+0000 7f4f877fe640 1 -- 172.21.15.19:0/4047967689 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f4f880cf6c0 con 0x7f4f90106a80 2024-09-19T08:49:55.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.567+0000 7f4f96421640 1 --2- 172.21.15.19:0/4047967689 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4f7c0a3240 0x7f4f7c0a5700 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c005fd0 tx=0x7f4f8c00b510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:55.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.571+0000 7f4f877fe640 1 -- 172.21.15.19:0/4047967689 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4f88016030 con 0x7f4f90106a80 2024-09-19T08:49:55.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:55 smithi155 ceph-mon[34921]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:55.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:55 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:55.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:55 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:55.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:55 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:55.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:55 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:49:55.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:55 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:49:55.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:55 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:55.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:55 smithi155 ceph-mon[34921]: Deploying daemon mds.i on smithi203 2024-09-19T08:49:55.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:55 smithi155 ceph-mon[34921]: mds.? [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] up:boot 2024-09-19T08:49:55.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:55 smithi155 ceph-mon[34921]: fsmap 8 up:standby 2024-09-19T08:49:55.674 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:55 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T08:49:55.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.785+0000 7f4f98685640 1 -- 172.21.15.19:0/4047967689 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f90109070 con 0x7f4f90106a80 2024-09-19T08:49:55.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.786+0000 7f4f877fe640 1 -- 172.21.15.19:0/4047967689 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7222 (secure 0 0 0) 0x7f4f8809c880 con 0x7f4f90106a80 2024-09-19T08:49:55.786 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:49:55.786 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":9,"btime":"2024-09-19T08:49:54:522505+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24431,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2480841559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2480841559},{"type":"v1","addr":"172.21.15.155:6835","nonce":2480841559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24464,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-19T08:49:55.787 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 9 2024-09-19T08:49:55.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.788+0000 7f4f98685640 1 -- 172.21.15.19:0/4047967689 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4f7c0a3240 msgr2=0x7f4f7c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:55.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.788+0000 7f4f98685640 1 --2- 172.21.15.19:0/4047967689 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4f7c0a3240 0x7f4f7c0a5700 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c005fd0 tx=0x7f4f8c00b510 comp rx=0 tx=0).stop 2024-09-19T08:49:55.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.788+0000 7f4f98685640 1 -- 172.21.15.19:0/4047967689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f90106a80 msgr2=0x7f4f9019bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:55.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.788+0000 7f4f98685640 1 --2- 172.21.15.19:0/4047967689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f90106a80 0x7f4f9019bc30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4f8800eaa0 tx=0x7f4f8800ef60 comp rx=0 tx=0).stop 2024-09-19T08:49:55.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.788+0000 7f4f98685640 1 -- 172.21.15.19:0/4047967689 shutdown_connections 2024-09-19T08:49:55.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.788+0000 7f4f98685640 1 --2- 172.21.15.19:0/4047967689 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4f7c0a3240 0x7f4f7c0a5700 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.788+0000 7f4f98685640 1 --2- 172.21.15.19:0/4047967689 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f90101420 0x7f4f901978a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.788+0000 7f4f98685640 1 --2- 172.21.15.19:0/4047967689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f90106a80 0x7f4f9019bc30 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.788+0000 7f4f98685640 1 --2- 172.21.15.19:0/4047967689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f90100a80 0x7f4f90197360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:55.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.788+0000 7f4f98685640 1 -- 172.21.15.19:0/4047967689 >> 172.21.15.19:0/4047967689 conn(0x7f4f900fc7a0 msgr2=0x7f4f900fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:55.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.788+0000 7f4f98685640 1 -- 172.21.15.19:0/4047967689 shutdown_connections 2024-09-19T08:49:55.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:55.788+0000 7f4f98685640 1 -- 172.21.15.19:0/4047967689 wait complete. 2024-09-19T08:49:56.418 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:56 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/4047967689' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:49:56.418 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 08:49:56 smithi203 systemd[1]: Starting Ceph mds.i for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T08:49:56.542 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:56 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/4047967689' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:49:56.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:56 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/4047967689' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:49:56.732 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 08:49:56 smithi203 podman[66044]: 2024-09-19 08:49:56.32107429 +0000 UTC m=+0.015782865 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:49:56.732 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 08:49:56 smithi203 podman[66044]: 2024-09-19 08:49:56.422458844 +0000 UTC m=+0.117167461 container create 6d3c36377a0ea8151eae48c689d8c02af9536232ce2a58e5da8830f6e749e9d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-i, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-19T08:49:56.732 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 08:49:56 smithi203 podman[66044]: 2024-09-19 08:49:56.64184568 +0000 UTC m=+0.336554254 container init 6d3c36377a0ea8151eae48c689d8c02af9536232ce2a58e5da8830f6e749e9d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-i, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:49:56.732 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 08:49:56 smithi203 podman[66044]: 2024-09-19 08:49:56.644650591 +0000 UTC m=+0.339359177 container start 6d3c36377a0ea8151eae48c689d8c02af9536232ce2a58e5da8830f6e749e9d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-19T08:49:56.732 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 08:49:56 smithi203 ceph-mds[66063]: -- 172.21.15.203:0/2545855389 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557f0d39d860 con 0x557f0d37a800 2024-09-19T08:49:56.732 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 08:49:56 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-i[66059]: starting mds.i at 2024-09-19T08:49:57.204 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 08:49:56 smithi203 bash[66044]: 6d3c36377a0ea8151eae48c689d8c02af9536232ce2a58e5da8830f6e749e9d4 2024-09-19T08:49:57.204 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 08:49:56 smithi203 systemd[1]: Started Ceph mds.i for f26c9d84-7662-11ef-bceb-c7b262605968. 2024-09-19T08:49:57.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:57 smithi203 ceph-mon[35450]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:57.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:57 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:57.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:57 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:57.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:57 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:57.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:57 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:49:57.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:57 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:49:57.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:57 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:57.512 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:57 smithi019 ceph-mon[30976]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:57.512 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:57 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:57.512 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:57 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:57.512 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:57 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:57.512 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:57 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:49:57.513 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:57 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:49:57.513 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:57 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:57.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:57 smithi155 ceph-mon[34921]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:57.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:57 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:57.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:57 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:57.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:57 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:49:57.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:57 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:49:57.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:57 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:49:57.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:57 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:49:58.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:58 smithi203 ceph-mon[35450]: Deploying daemon mds.g on smithi019 2024-09-19T08:49:58.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:58 smithi203 ceph-mon[35450]: mds.? [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] up:boot 2024-09-19T08:49:58.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:58 smithi203 ceph-mon[35450]: fsmap 9 up:standby 2024-09-19T08:49:58.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:58 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T08:49:58.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:58 smithi019 ceph-mon[30976]: Deploying daemon mds.g on smithi019 2024-09-19T08:49:58.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:58 smithi019 ceph-mon[30976]: mds.? [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] up:boot 2024-09-19T08:49:58.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:58 smithi019 ceph-mon[30976]: fsmap 9 up:standby 2024-09-19T08:49:58.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:58 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T08:49:58.578 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:49:58.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:58 smithi155 ceph-mon[34921]: Deploying daemon mds.g on smithi019 2024-09-19T08:49:58.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:58 smithi155 ceph-mon[34921]: mds.? [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] up:boot 2024-09-19T08:49:58.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:58 smithi155 ceph-mon[34921]: fsmap 9 up:standby 2024-09-19T08:49:58.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:58 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T08:49:58.819 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 08:49:58 smithi019 systemd[1]: Starting Ceph mds.g for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T08:49:59.240 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:49:59 smithi019 ceph-mon[30976]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:59.240 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 08:49:58 smithi019 podman[71915]: 2024-09-19 08:49:58.881328094 +0000 UTC m=+0.016673485 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:49:59.240 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 08:49:59 smithi019 podman[71915]: 2024-09-19 08:49:59.004415911 +0000 UTC m=+0.139761330 container create 806be8997683868d9d7ed80fb2bf2404cdf0691b8aa5daef199b632a0f791149 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True) 2024-09-19T08:49:59.240 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 08:49:59 smithi019 podman[71915]: 2024-09-19 08:49:59.240508743 +0000 UTC m=+0.375854129 container init 806be8997683868d9d7ed80fb2bf2404cdf0691b8aa5daef199b632a0f791149 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-g, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-19T08:49:59.371 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:49:59.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:49:59 smithi203 ceph-mon[35450]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:59.495 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 08:49:59 smithi019 podman[71915]: 2024-09-19 08:49:59.243782254 +0000 UTC m=+0.379127631 container start 806be8997683868d9d7ed80fb2bf2404cdf0691b8aa5daef199b632a0f791149 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-19T08:49:59.495 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 08:49:59 smithi019 ceph-mds[71958]: -- 172.21.15.19:0/2622187768 <== mon.0 v2:172.21.15.19:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563fcac0f860 con 0x563fcabed400 2024-09-19T08:49:59.495 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 08:49:59 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-g[71949]: starting mds.g at 2024-09-19T08:49:59.495 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 08:49:59 smithi019 bash[71915]: 806be8997683868d9d7ed80fb2bf2404cdf0691b8aa5daef199b632a0f791149 2024-09-19T08:49:59.495 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 08:49:59 smithi019 systemd[1]: Started Ceph mds.g for f26c9d84-7662-11ef-bceb-c7b262605968. 2024-09-19T08:49:59.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:49:59 smithi155 ceph-mon[34921]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:49:59.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.851+0000 7fec11ff6640 1 -- 172.21.15.19:0/2025303862 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec0c102d40 msgr2=0x7fec0c103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:59.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.851+0000 7fec11ff6640 1 --2- 172.21.15.19:0/2025303862 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec0c102d40 0x7fec0c103120 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7febfc009900 tx=0x7febfc02a480 comp rx=0 tx=0).stop 2024-09-19T08:49:59.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.852+0000 7fec11ff6640 1 -- 172.21.15.19:0/2025303862 shutdown_connections 2024-09-19T08:49:59.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.852+0000 7fec11ff6640 1 --2- 172.21.15.19:0/2025303862 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec0c10c170 0x7fec0c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:59.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.852+0000 7fec11ff6640 1 --2- 172.21.15.19:0/2025303862 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec0c103660 0x7fec0c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:59.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.852+0000 7fec11ff6640 1 --2- 172.21.15.19:0/2025303862 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec0c102d40 0x7fec0c103120 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:59.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.852+0000 7fec11ff6640 1 -- 172.21.15.19:0/2025303862 >> 172.21.15.19:0/2025303862 conn(0x7fec0c0fc7a0 msgr2=0x7fec0c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:49:59.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.852+0000 7fec11ff6640 1 -- 172.21.15.19:0/2025303862 shutdown_connections 2024-09-19T08:49:59.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.852+0000 7fec11ff6640 1 -- 172.21.15.19:0/2025303862 wait complete. 2024-09-19T08:49:59.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.852+0000 7fec11ff6640 1 Processor -- start 2024-09-19T08:49:59.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.853+0000 7fec11ff6640 1 -- start start 2024-09-19T08:49:59.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.853+0000 7fec11ff6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec0c102d40 0x7fec0c1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:59.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.853+0000 7fec11ff6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec0c103660 0x7fec0c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:59.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.853+0000 7fec11ff6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec0c10c170 0x7fec0c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:59.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.853+0000 7fec11ff6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fec0c111f70 con 0x7fec0c103660 2024-09-19T08:49:59.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.853+0000 7fec11ff6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fec0c111df0 con 0x7fec0c10c170 2024-09-19T08:49:59.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.853+0000 7fec11ff6640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fec0c1120f0 con 0x7fec0c102d40 2024-09-19T08:49:59.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.853+0000 7fec0affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec0c103660 0x7fec0c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:59.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.853+0000 7fec0affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec0c103660 0x7fec0c100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37468/0 (socket says 172.21.15.19:37468) 2024-09-19T08:49:59.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.853+0000 7fec0affd640 1 -- 172.21.15.19:0/1456304157 learned_addr learned my addr 172.21.15.19:0/1456304157 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:49:59.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.853+0000 7fec0b7fe640 1 --2- 172.21.15.19:0/1456304157 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec0c102d40 0x7fec0c1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:59.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.853+0000 7fec0bfff640 1 --2- 172.21.15.19:0/1456304157 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec0c10c170 0x7fec0c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:59.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.853+0000 7fec0affd640 1 -- 172.21.15.19:0/1456304157 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec0c102d40 msgr2=0x7fec0c1009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:59.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.853+0000 7fec0affd640 1 --2- 172.21.15.19:0/1456304157 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec0c102d40 0x7fec0c1009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:59.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.853+0000 7fec0affd640 1 -- 172.21.15.19:0/1456304157 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec0c10c170 msgr2=0x7fec0c101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:49:59.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.853+0000 7fec0affd640 1 --2- 172.21.15.19:0/1456304157 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec0c10c170 0x7fec0c101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:49:59.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.853+0000 7fec0affd640 1 -- 172.21.15.19:0/1456304157 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec0c1a6910 con 0x7fec0c103660 2024-09-19T08:49:59.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.853+0000 7fec0bfff640 1 --2- 172.21.15.19:0/1456304157 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec0c10c170 0x7fec0c101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:49:59.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.854+0000 7fec0affd640 1 --2- 172.21.15.19:0/1456304157 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec0c103660 0x7fec0c100ee0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fec0000d740 tx=0x7fec0000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:59.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.854+0000 7fec08ff9640 1 -- 172.21.15.19:0/1456304157 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec00017070 con 0x7fec0c103660 2024-09-19T08:49:59.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.854+0000 7fec08ff9640 1 -- 172.21.15.19:0/1456304157 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec0000de50 con 0x7fec0c103660 2024-09-19T08:49:59.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.854+0000 7fec11ff6640 1 -- 172.21.15.19:0/1456304157 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec0c1a6c00 con 0x7fec0c103660 2024-09-19T08:49:59.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.854+0000 7fec08ff9640 1 -- 172.21.15.19:0/1456304157 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec0000f620 con 0x7fec0c103660 2024-09-19T08:49:59.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.854+0000 7fec11ff6640 1 -- 172.21.15.19:0/1456304157 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec0c1a7140 con 0x7fec0c103660 2024-09-19T08:49:59.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.855+0000 7fec11ff6640 1 -- 172.21.15.19:0/1456304157 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec0c103120 con 0x7fec0c103660 2024-09-19T08:49:59.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.856+0000 7fec08ff9640 1 -- 172.21.15.19:0/1456304157 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fec00009c30 con 0x7fec0c103660 2024-09-19T08:49:59.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.857+0000 7fec08ff9640 1 --2- 172.21.15.19:0/1456304157 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7febf40a3240 0x7febf40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:49:59.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.857+0000 7fec0b7fe640 1 --2- 172.21.15.19:0/1456304157 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7febf40a3240 0x7febf40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:49:59.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.857+0000 7fec08ff9640 1 -- 172.21.15.19:0/1456304157 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fec000cf060 con 0x7fec0c103660 2024-09-19T08:49:59.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.857+0000 7fec0b7fe640 1 --2- 172.21.15.19:0/1456304157 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7febf40a3240 0x7febf40a5700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7febfc009230 tx=0x7febfc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:49:59.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:49:59.860+0000 7fec08ff9640 1 -- 172.21.15.19:0/1456304157 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fec0009c220 con 0x7fec0c103660 2024-09-19T08:50:00.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:00.082+0000 7fec11ff6640 1 -- 172.21.15.19:0/1456304157 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec0c101ed0 con 0x7fec0c103660 2024-09-19T08:50:00.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:00.083+0000 7fec08ff9640 1 -- 172.21.15.19:0/1456304157 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8052 (secure 0 0 0) 0x7fec0c101ed0 con 0x7fec0c103660 2024-09-19T08:50:00.083 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:50:00.083 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":10,"btime":"2024-09-19T08:49:57:203457+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24431,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2480841559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2480841559},{"type":"v1","addr":"172.21.15.155:6835","nonce":2480841559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24464,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24490,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T08:50:00.084 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 10 2024-09-19T08:50:00.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:00.085+0000 7fec11ff6640 1 -- 172.21.15.19:0/1456304157 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7febf40a3240 msgr2=0x7febf40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:00.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:00.085+0000 7fec11ff6640 1 --2- 172.21.15.19:0/1456304157 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7febf40a3240 0x7febf40a5700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7febfc009230 tx=0x7febfc0058d0 comp rx=0 tx=0).stop 2024-09-19T08:50:00.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:00.085+0000 7fec11ff6640 1 -- 172.21.15.19:0/1456304157 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec0c103660 msgr2=0x7fec0c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:00.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:00.085+0000 7fec11ff6640 1 --2- 172.21.15.19:0/1456304157 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec0c103660 0x7fec0c100ee0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fec0000d740 tx=0x7fec0000dc00 comp rx=0 tx=0).stop 2024-09-19T08:50:00.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:00.085+0000 7fec11ff6640 1 -- 172.21.15.19:0/1456304157 shutdown_connections 2024-09-19T08:50:00.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:00.085+0000 7fec11ff6640 1 --2- 172.21.15.19:0/1456304157 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7febf40a3240 0x7febf40a5700 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:00.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:00.085+0000 7fec11ff6640 1 --2- 172.21.15.19:0/1456304157 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec0c10c170 0x7fec0c101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:00.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:00.085+0000 7fec11ff6640 1 --2- 172.21.15.19:0/1456304157 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec0c103660 0x7fec0c100ee0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:00.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:00.085+0000 7fec11ff6640 1 --2- 172.21.15.19:0/1456304157 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec0c102d40 0x7fec0c1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:00.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:00.085+0000 7fec11ff6640 1 -- 172.21.15.19:0/1456304157 >> 172.21.15.19:0/1456304157 conn(0x7fec0c0fc7a0 msgr2=0x7fec0c0fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:00.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:00.085+0000 7fec11ff6640 1 -- 172.21.15.19:0/1456304157 shutdown_connections 2024-09-19T08:50:00.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:00.085+0000 7fec11ff6640 1 -- 172.21.15.19:0/1456304157 wait complete. 2024-09-19T08:50:00.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:00 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:00.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:00 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:00.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:00 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:00.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:00 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:50:00.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:00 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:50:00.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:00 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:00.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:00 smithi155 ceph-mon[34921]: Deploying daemon mds.a on smithi019 2024-09-19T08:50:00.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:00 smithi155 ceph-mon[34921]: overall HEALTH_OK 2024-09-19T08:50:00.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:00 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1456304157' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:50:00.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:00 smithi155 ceph-mon[34921]: mds.? [v2:172.21.15.19:6838/2452068876,v1:172.21.15.19:6839/2452068876] up:boot 2024-09-19T08:50:00.674 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:00 smithi155 ceph-mon[34921]: fsmap 10 up:standby 2024-09-19T08:50:00.674 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:00 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T08:50:00.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:00 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:00.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:00 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:00.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:00 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:00.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:00 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:50:00.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:00 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:50:00.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:00 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:00.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:00 smithi203 ceph-mon[35450]: Deploying daemon mds.a on smithi019 2024-09-19T08:50:00.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:00 smithi203 ceph-mon[35450]: overall HEALTH_OK 2024-09-19T08:50:00.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:00 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1456304157' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:50:00.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:00 smithi203 ceph-mon[35450]: mds.? [v2:172.21.15.19:6838/2452068876,v1:172.21.15.19:6839/2452068876] up:boot 2024-09-19T08:50:00.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:00 smithi203 ceph-mon[35450]: fsmap 10 up:standby 2024-09-19T08:50:00.733 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:00 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T08:50:00.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:00 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:00.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:00 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:00.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:00 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:00.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:00 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:50:00.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:00 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:50:00.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:00 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:00.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:00 smithi019 ceph-mon[30976]: Deploying daemon mds.a on smithi019 2024-09-19T08:50:00.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:00 smithi019 ceph-mon[30976]: overall HEALTH_OK 2024-09-19T08:50:00.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:00 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1456304157' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:50:00.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:00 smithi019 ceph-mon[30976]: mds.? [v2:172.21.15.19:6838/2452068876,v1:172.21.15.19:6839/2452068876] up:boot 2024-09-19T08:50:00.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:00 smithi019 ceph-mon[30976]: fsmap 10 up:standby 2024-09-19T08:50:00.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:00 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T08:50:01.513 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:01 smithi019 ceph-mon[30976]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:50:01.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:01 smithi155 ceph-mon[34921]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:50:01.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:01 smithi203 ceph-mon[35450]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:50:01.763 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 19 08:50:01 smithi019 systemd[1]: Starting Ceph mds.a for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T08:50:02.238 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 19 08:50:01 smithi019 podman[72318]: 2024-09-19 08:50:01.879989318 +0000 UTC m=+0.016330877 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:50:02.238 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 19 08:50:02 smithi019 podman[72318]: 2024-09-19 08:50:02.002172519 +0000 UTC m=+0.138514068 container create 0f6edd0d91194edf52c01426a700948fa8c21b98fb2ad0dad5572f92937e9a88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-a, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T08:50:02.238 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 19 08:50:02 smithi019 podman[72318]: 2024-09-19 08:50:02.238619961 +0000 UTC m=+0.374961511 container init 0f6edd0d91194edf52c01426a700948fa8c21b98fb2ad0dad5572f92937e9a88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-a, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:50:02.569 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 19 08:50:02 smithi019 podman[72318]: 2024-09-19 08:50:02.241682661 +0000 UTC m=+0.378024203 container start 0f6edd0d91194edf52c01426a700948fa8c21b98fb2ad0dad5572f92937e9a88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-a, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T08:50:02.569 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 19 08:50:02 smithi019 ceph-mds[72337]: -- 172.21.15.19:0/469297518 <== mon.0 v2:172.21.15.19:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d8fe8ab860 con 0x55d8fe889000 2024-09-19T08:50:02.569 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 19 08:50:02 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-a[72333]: starting mds.a at 2024-09-19T08:50:02.570 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 19 08:50:02 smithi019 bash[72318]: 0f6edd0d91194edf52c01426a700948fa8c21b98fb2ad0dad5572f92937e9a88 2024-09-19T08:50:02.570 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 19 08:50:02 smithi019 systemd[1]: Started Ceph mds.a for f26c9d84-7662-11ef-bceb-c7b262605968. 2024-09-19T08:50:03.668 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:03 smithi019 ceph-mon[30976]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:50:03.668 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:03 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:03.668 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:03 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:03.668 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:03 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:03.668 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:03 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:50:03.668 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:03 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:50:03.668 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:03 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:03.668 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:03 smithi019 ceph-mon[30976]: Deploying daemon mds.b on smithi155 2024-09-19T08:50:03.668 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:03 smithi019 ceph-mon[30976]: mds.? [v2:172.21.15.19:6840/1973648402,v1:172.21.15.19:6841/1973648402] up:boot 2024-09-19T08:50:03.669 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:03 smithi019 ceph-mon[30976]: fsmap 11 up:standby 2024-09-19T08:50:03.669 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:03 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T08:50:03.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:03 smithi155 ceph-mon[34921]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:50:03.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:03 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:03.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:03 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:03.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:03 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:03.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:03 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:50:03.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:03 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:50:03.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:03 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:03.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:03 smithi155 ceph-mon[34921]: Deploying daemon mds.b on smithi155 2024-09-19T08:50:03.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:03 smithi155 ceph-mon[34921]: mds.? [v2:172.21.15.19:6840/1973648402,v1:172.21.15.19:6841/1973648402] up:boot 2024-09-19T08:50:03.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:03 smithi155 ceph-mon[34921]: fsmap 11 up:standby 2024-09-19T08:50:03.674 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:03 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T08:50:03.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:03 smithi203 ceph-mon[35450]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:50:03.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:03 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:03.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:03 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:03.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:03 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:03.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:03 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T08:50:03.733 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:03 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T08:50:03.733 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:03 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:03.733 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:03 smithi203 ceph-mon[35450]: Deploying daemon mds.b on smithi155 2024-09-19T08:50:03.733 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:03 smithi203 ceph-mon[35450]: mds.? [v2:172.21.15.19:6840/1973648402,v1:172.21.15.19:6841/1973648402] up:boot 2024-09-19T08:50:03.733 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:03 smithi203 ceph-mon[35450]: fsmap 11 up:standby 2024-09-19T08:50:03.733 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:03 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T08:50:03.748 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:50:04.023 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:04.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.501+0000 7fe339129640 1 -- 172.21.15.19:0/3602570543 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3341082a0 msgr2=0x7fe33410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:04.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.501+0000 7fe339129640 1 --2- 172.21.15.19:0/3602570543 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3341082a0 0x7fe33410ec40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe32c009cd0 tx=0x7fe32c02a8e0 comp rx=0 tx=0).stop 2024-09-19T08:50:04.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.501+0000 7fe339129640 1 -- 172.21.15.19:0/3602570543 shutdown_connections 2024-09-19T08:50:04.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.501+0000 7fe339129640 1 --2- 172.21.15.19:0/3602570543 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3341036e0 0x7fe334107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:04.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.501+0000 7fe339129640 1 --2- 172.21.15.19:0/3602570543 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3341082a0 0x7fe33410ec40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:04.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.501+0000 7fe339129640 1 --2- 172.21.15.19:0/3602570543 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe334102d30 0x7fe334103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:04.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.501+0000 7fe339129640 1 -- 172.21.15.19:0/3602570543 >> 172.21.15.19:0/3602570543 conn(0x7fe3340fc7d0 msgr2=0x7fe3340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:04.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.501+0000 7fe339129640 1 -- 172.21.15.19:0/3602570543 shutdown_connections 2024-09-19T08:50:04.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.501+0000 7fe339129640 1 -- 172.21.15.19:0/3602570543 wait complete. 2024-09-19T08:50:04.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.502+0000 7fe339129640 1 Processor -- start 2024-09-19T08:50:04.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.502+0000 7fe339129640 1 -- start start 2024-09-19T08:50:04.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.502+0000 7fe339129640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe334102d30 0x7fe3341984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:04.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.502+0000 7fe339129640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3341036e0 0x7fe334198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:04.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.502+0000 7fe339129640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3341082a0 0x7fe33419cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:04.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.502+0000 7fe339129640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe3341120a0 con 0x7fe3341036e0 2024-09-19T08:50:04.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.502+0000 7fe339129640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe334111f20 con 0x7fe334102d30 2024-09-19T08:50:04.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.502+0000 7fe339129640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe334112220 con 0x7fe3341082a0 2024-09-19T08:50:04.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.502+0000 7fe33259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3341036e0 0x7fe334198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:04.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.502+0000 7fe33259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3341036e0 0x7fe334198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37506/0 (socket says 172.21.15.19:37506) 2024-09-19T08:50:04.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.502+0000 7fe33259c640 1 -- 172.21.15.19:0/1685903134 learned_addr learned my addr 172.21.15.19:0/1685903134 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:50:04.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.502+0000 7fe332d9d640 1 --2- 172.21.15.19:0/1685903134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe334102d30 0x7fe3341984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:04.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.502+0000 7fe33359e640 1 --2- 172.21.15.19:0/1685903134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3341082a0 0x7fe33419cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:04.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.502+0000 7fe33259c640 1 -- 172.21.15.19:0/1685903134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3341082a0 msgr2=0x7fe33419cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:04.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.502+0000 7fe33259c640 1 --2- 172.21.15.19:0/1685903134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3341082a0 0x7fe33419cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:04.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.503+0000 7fe33259c640 1 -- 172.21.15.19:0/1685903134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe334102d30 msgr2=0x7fe3341984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:04.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.503+0000 7fe33259c640 1 --2- 172.21.15.19:0/1685903134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe334102d30 0x7fe3341984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:04.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.503+0000 7fe33259c640 1 -- 172.21.15.19:0/1685903134 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe33419d470 con 0x7fe3341036e0 2024-09-19T08:50:04.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.503+0000 7fe33259c640 1 --2- 172.21.15.19:0/1685903134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3341036e0 0x7fe334198a00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe32800c8c0 tx=0x7fe32800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:04.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.503+0000 7fe31bfff640 1 -- 172.21.15.19:0/1685903134 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe328007bb0 con 0x7fe3341036e0 2024-09-19T08:50:04.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.503+0000 7fe31bfff640 1 -- 172.21.15.19:0/1685903134 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe328007d50 con 0x7fe3341036e0 2024-09-19T08:50:04.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.503+0000 7fe339129640 1 -- 172.21.15.19:0/1685903134 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe33419d760 con 0x7fe3341036e0 2024-09-19T08:50:04.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.503+0000 7fe31bfff640 1 -- 172.21.15.19:0/1685903134 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe328018830 con 0x7fe3341036e0 2024-09-19T08:50:04.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.503+0000 7fe339129640 1 -- 172.21.15.19:0/1685903134 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3341a5040 con 0x7fe3341036e0 2024-09-19T08:50:04.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.504+0000 7fe339129640 1 -- 172.21.15.19:0/1685903134 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe334103110 con 0x7fe3341036e0 2024-09-19T08:50:04.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.505+0000 7fe31bfff640 1 -- 172.21.15.19:0/1685903134 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe328018a10 con 0x7fe3341036e0 2024-09-19T08:50:04.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.506+0000 7fe31bfff640 1 --2- 172.21.15.19:0/1685903134 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe31c0a3240 0x7fe31c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:04.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.506+0000 7fe332d9d640 1 --2- 172.21.15.19:0/1685903134 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe31c0a3240 0x7fe31c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:04.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.506+0000 7fe31bfff640 1 -- 172.21.15.19:0/1685903134 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fe3280cf4e0 con 0x7fe3341036e0 2024-09-19T08:50:04.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.507+0000 7fe332d9d640 1 --2- 172.21.15.19:0/1685903134 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe31c0a3240 0x7fe31c0a5700 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe324005d00 tx=0x7fe32400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:04.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.510+0000 7fe31bfff640 1 -- 172.21.15.19:0/1685903134 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe328014030 con 0x7fe3341036e0 2024-09-19T08:50:04.639 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 08:50:04 smithi155 systemd[1]: Starting Ceph mds.b for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T08:50:04.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.724+0000 7fe339129640 1 -- 172.21.15.19:0/1685903134 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe33410a2b0 con 0x7fe3341036e0 2024-09-19T08:50:04.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.724+0000 7fe31bfff640 1 -- 172.21.15.19:0/1685903134 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9704 (secure 0 0 0) 0x7fe32809c600 con 0x7fe3341036e0 2024-09-19T08:50:04.725 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:50:04.725 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":12,"btime":"2024-09-19T08:50:02:407240+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2452068876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2452068876},{"type":"v1","addr":"172.21.15.19:6839","nonce":2452068876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24431,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2480841559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2480841559},{"type":"v1","addr":"172.21.15.155:6835","nonce":2480841559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24464,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24490,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-19T08:50:04.725 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 12 2024-09-19T08:50:04.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.726+0000 7fe339129640 1 -- 172.21.15.19:0/1685903134 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe31c0a3240 msgr2=0x7fe31c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:04.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.726+0000 7fe339129640 1 --2- 172.21.15.19:0/1685903134 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe31c0a3240 0x7fe31c0a5700 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe324005d00 tx=0x7fe32400b410 comp rx=0 tx=0).stop 2024-09-19T08:50:04.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.726+0000 7fe339129640 1 -- 172.21.15.19:0/1685903134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3341036e0 msgr2=0x7fe334198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:04.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.726+0000 7fe339129640 1 --2- 172.21.15.19:0/1685903134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3341036e0 0x7fe334198a00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe32800c8c0 tx=0x7fe32800cd80 comp rx=0 tx=0).stop 2024-09-19T08:50:04.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.726+0000 7fe339129640 1 -- 172.21.15.19:0/1685903134 shutdown_connections 2024-09-19T08:50:04.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.726+0000 7fe339129640 1 --2- 172.21.15.19:0/1685903134 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe31c0a3240 0x7fe31c0a5700 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:04.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.726+0000 7fe339129640 1 --2- 172.21.15.19:0/1685903134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3341082a0 0x7fe33419cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:04.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.726+0000 7fe339129640 1 --2- 172.21.15.19:0/1685903134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3341036e0 0x7fe334198a00 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:04.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.726+0000 7fe339129640 1 --2- 172.21.15.19:0/1685903134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe334102d30 0x7fe3341984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:04.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.726+0000 7fe339129640 1 -- 172.21.15.19:0/1685903134 >> 172.21.15.19:0/1685903134 conn(0x7fe3340fc7d0 msgr2=0x7fe334106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:04.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.727+0000 7fe339129640 1 -- 172.21.15.19:0/1685903134 shutdown_connections 2024-09-19T08:50:04.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:04.727+0000 7fe339129640 1 -- 172.21.15.19:0/1685903134 wait complete. 2024-09-19T08:50:04.923 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 08:50:04 smithi155 podman[65822]: 2024-09-19 08:50:04.542637922 +0000 UTC m=+0.016063603 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:50:04.923 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 08:50:04 smithi155 podman[65822]: 2024-09-19 08:50:04.675224767 +0000 UTC m=+0.148650480 container create 8ec6d2ddad3c9b3e58a2d030a7d557ebf64926da40fb67166f0d7091b9794c6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-b, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-2f599a4) 2024-09-19T08:50:05.395 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 08:50:04 smithi155 podman[65822]: 2024-09-19 08:50:04.927632394 +0000 UTC m=+0.401058064 container init 8ec6d2ddad3c9b3e58a2d030a7d557ebf64926da40fb67166f0d7091b9794c6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-b, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-19T08:50:05.395 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 08:50:04 smithi155 podman[65822]: 2024-09-19 08:50:04.930522515 +0000 UTC m=+0.403948185 container start 8ec6d2ddad3c9b3e58a2d030a7d557ebf64926da40fb67166f0d7091b9794c6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-19T08:50:05.395 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 08:50:04 smithi155 ceph-mds[65841]: -- 172.21.15.155:0/271882560 <== mon.2 v2:172.21.15.155:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56203fe2d860 con 0x56203fe0a800 2024-09-19T08:50:05.395 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 08:50:04 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-b[65837]: starting mds.b at 2024-09-19T08:50:05.395 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 08:50:05 smithi155 bash[65822]: 8ec6d2ddad3c9b3e58a2d030a7d557ebf64926da40fb67166f0d7091b9794c6d 2024-09-19T08:50:05.395 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 08:50:05 smithi155 systemd[1]: Started Ceph mds.b for f26c9d84-7662-11ef-bceb-c7b262605968. 2024-09-19T08:50:05.396 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:05 smithi155 ceph-mon[34921]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:50:05.396 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:05 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1685903134' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:50:05.396 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:05 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:05.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:05 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:05.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:05 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:05.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:05 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:05.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:05 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:05.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:05 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:50:05.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:05 smithi203 ceph-mon[35450]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:50:05.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:05 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1685903134' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:50:05.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:05 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:05.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:05 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:05.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:05 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:05.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:05 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:05.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:05 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:05.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:05 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:50:05.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:05 smithi019 ceph-mon[30976]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:50:05.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:05 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1685903134' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:50:05.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:05 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:05.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:05 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:05.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:05 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:05.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:05 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:05.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:05 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:05.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:05 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:50:06.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:06 smithi155 ceph-mon[34921]: mds.? [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] up:boot 2024-09-19T08:50:06.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:06 smithi155 ceph-mon[34921]: fsmap 12 up:standby 2024-09-19T08:50:06.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:06 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T08:50:06.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:06 smithi203 ceph-mon[35450]: mds.? [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] up:boot 2024-09-19T08:50:06.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:06 smithi203 ceph-mon[35450]: fsmap 12 up:standby 2024-09-19T08:50:06.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:06 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T08:50:06.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:06 smithi019 ceph-mon[30976]: mds.? [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] up:boot 2024-09-19T08:50:06.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:06 smithi019 ceph-mon[30976]: fsmap 12 up:standby 2024-09-19T08:50:06.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:06 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T08:50:07.386 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:50:07.730 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:07 smithi019 ceph-mon[30976]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:50:07.731 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:07 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:07.731 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:07 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:07.731 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:07 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:07.731 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:07 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:07.731 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:07 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:07.731 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:07 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:07.731 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:07 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:07.731 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:07 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:07.731 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:07 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:50:07.731 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:07 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:07.731 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:07 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:50:07.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:07 smithi155 ceph-mon[34921]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:50:07.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:07 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:07.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:07 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:07.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:07 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:07.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:07 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:07.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:07 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:07.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:07 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:07.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:07 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:07.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:07 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:07.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:07 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:50:07.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:07 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:07.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:07 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:50:07.949 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:07 smithi203 ceph-mon[35450]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:50:07.949 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:07 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:07.949 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:07 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:07.949 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:07 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:07.950 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:07 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:07.950 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:07 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:07.950 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:07 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:07.950 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:07 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:07.950 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:07 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:07.950 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:07 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:50:07.950 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:07 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:07.950 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:07 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:50:08.294 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:08.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.784+0000 7fbb0c75e640 1 -- 172.21.15.19:0/3829659547 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb0410c180 msgr2=0x7fbb0410e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:08.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.784+0000 7fbb0c75e640 1 --2- 172.21.15.19:0/3829659547 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb0410c180 0x7fbb0410e600 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbafc009ca0 tx=0x7fbafc02a950 comp rx=0 tx=0).stop 2024-09-19T08:50:08.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.784+0000 7fbb0c75e640 1 -- 172.21.15.19:0/3829659547 shutdown_connections 2024-09-19T08:50:08.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.784+0000 7fbb0c75e640 1 --2- 172.21.15.19:0/3829659547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb041036c0 0x7fbb0410bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:08.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.784+0000 7fbb0c75e640 1 --2- 172.21.15.19:0/3829659547 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb0410c180 0x7fbb0410e600 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:08.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.784+0000 7fbb0c75e640 1 --2- 172.21.15.19:0/3829659547 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb04102da0 0x7fbb04103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:08.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.784+0000 7fbb0c75e640 1 -- 172.21.15.19:0/3829659547 >> 172.21.15.19:0/3829659547 conn(0x7fbb040fc7a0 msgr2=0x7fbb040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:08.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.784+0000 7fbb0c75e640 1 -- 172.21.15.19:0/3829659547 shutdown_connections 2024-09-19T08:50:08.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.784+0000 7fbb0c75e640 1 -- 172.21.15.19:0/3829659547 wait complete. 2024-09-19T08:50:08.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.785+0000 7fbb0c75e640 1 Processor -- start 2024-09-19T08:50:08.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.785+0000 7fbb0c75e640 1 -- start start 2024-09-19T08:50:08.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.785+0000 7fbb0c75e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb04102da0 0x7fbb04198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:08.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.785+0000 7fbb0c75e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb041036c0 0x7fbb04198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:08.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.785+0000 7fbb0c75e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb0410c180 0x7fbb0419cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:08.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.785+0000 7fbb0c75e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbb04111fa0 con 0x7fbb04102da0 2024-09-19T08:50:08.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.785+0000 7fbb0c75e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbb04111e20 con 0x7fbb041036c0 2024-09-19T08:50:08.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.785+0000 7fbb0c75e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbb04112120 con 0x7fbb0410c180 2024-09-19T08:50:08.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.785+0000 7fbb0a4fa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb04102da0 0x7fbb04198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:08.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.785+0000 7fbb0a4fa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb04102da0 0x7fbb04198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57952/0 (socket says 172.21.15.19:57952) 2024-09-19T08:50:08.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.785+0000 7fbb0a4fa640 1 -- 172.21.15.19:0/1232956617 learned_addr learned my addr 172.21.15.19:0/1232956617 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:50:08.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.785+0000 7fbb09cf9640 1 --2- 172.21.15.19:0/1232956617 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb041036c0 0x7fbb04198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:08.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.785+0000 7fbb0acfb640 1 --2- 172.21.15.19:0/1232956617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb0410c180 0x7fbb0419cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:08.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.785+0000 7fbb0a4fa640 1 -- 172.21.15.19:0/1232956617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb0410c180 msgr2=0x7fbb0419cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:08.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.785+0000 7fbb0a4fa640 1 --2- 172.21.15.19:0/1232956617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb0410c180 0x7fbb0419cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:08.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.785+0000 7fbb0a4fa640 1 -- 172.21.15.19:0/1232956617 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb041036c0 msgr2=0x7fbb04198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:08.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.785+0000 7fbb0a4fa640 1 --2- 172.21.15.19:0/1232956617 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb041036c0 0x7fbb04198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:08.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.785+0000 7fbb0a4fa640 1 -- 172.21.15.19:0/1232956617 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb0419d3f0 con 0x7fbb04102da0 2024-09-19T08:50:08.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.785+0000 7fbb09cf9640 1 --2- 172.21.15.19:0/1232956617 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb041036c0 0x7fbb04198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:50:08.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.785+0000 7fbb0acfb640 1 --2- 172.21.15.19:0/1232956617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb0410c180 0x7fbb0419cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:50:08.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.786+0000 7fbb0a4fa640 1 --2- 172.21.15.19:0/1232956617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb04102da0 0x7fbb04198440 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbb0000d950 tx=0x7fbb0000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:08.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.786+0000 7fbafb7fe640 1 -- 172.21.15.19:0/1232956617 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb00017070 con 0x7fbb04102da0 2024-09-19T08:50:08.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.786+0000 7fbafb7fe640 1 -- 172.21.15.19:0/1232956617 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbb00009c30 con 0x7fbb04102da0 2024-09-19T08:50:08.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.786+0000 7fbb0c75e640 1 -- 172.21.15.19:0/1232956617 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb0419d6e0 con 0x7fbb04102da0 2024-09-19T08:50:08.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.786+0000 7fbafb7fe640 1 -- 172.21.15.19:0/1232956617 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb0000f6b0 con 0x7fbb04102da0 2024-09-19T08:50:08.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.786+0000 7fbb0c75e640 1 -- 172.21.15.19:0/1232956617 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb041a4fc0 con 0x7fbb04102da0 2024-09-19T08:50:08.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.787+0000 7fbb0c75e640 1 -- 172.21.15.19:0/1232956617 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb04103180 con 0x7fbb04102da0 2024-09-19T08:50:08.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.788+0000 7fbafb7fe640 1 -- 172.21.15.19:0/1232956617 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fbb000109d0 con 0x7fbb04102da0 2024-09-19T08:50:08.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.789+0000 7fbafb7fe640 1 --2- 172.21.15.19:0/1232956617 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbaf00a32c0 0x7fbaf00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:08.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.789+0000 7fbb09cf9640 1 --2- 172.21.15.19:0/1232956617 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbaf00a32c0 0x7fbaf00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:08.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.789+0000 7fbafb7fe640 1 -- 172.21.15.19:0/1232956617 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fbb000cf150 con 0x7fbb04102da0 2024-09-19T08:50:08.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.789+0000 7fbb09cf9640 1 --2- 172.21.15.19:0/1232956617 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbaf00a32c0 0x7fbaf00a5780 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbb040fed30 tx=0x7fbaf4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:08.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:08.794+0000 7fbafb7fe640 1 -- 172.21.15.19:0/1232956617 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbb00009de0 con 0x7fbb04102da0 2024-09-19T08:50:09.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:09.016+0000 7fbb0c75e640 1 -- 172.21.15.19:0/1232956617 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb04107260 con 0x7fbb04102da0 2024-09-19T08:50:09.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:09.017+0000 7fbafb7fe640 1 -- 172.21.15.19:0/1232956617 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10533 (secure 0 0 0) 0x7fbb0009c270 con 0x7fbb04102da0 2024-09-19T08:50:09.018 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:50:09.018 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":13,"btime":"2024-09-19T08:50:05:389350+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2452068876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2452068876},{"type":"v1","addr":"172.21.15.19:6839","nonce":2452068876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24418,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24419,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24431,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24449,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/2480841559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2480841559},{"type":"v1","addr":"172.21.15.155:6835","nonce":2480841559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24463,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24464,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24469,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24490,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-19T08:50:09.018 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 13 2024-09-19T08:50:09.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:09.021+0000 7fbb0c75e640 1 -- 172.21.15.19:0/1232956617 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbaf00a32c0 msgr2=0x7fbaf00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:09.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:09.021+0000 7fbb0c75e640 1 --2- 172.21.15.19:0/1232956617 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbaf00a32c0 0x7fbaf00a5780 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fbb040fed30 tx=0x7fbaf4008040 comp rx=0 tx=0).stop 2024-09-19T08:50:09.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:09.021+0000 7fbb0c75e640 1 -- 172.21.15.19:0/1232956617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb04102da0 msgr2=0x7fbb04198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:09.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:09.021+0000 7fbb0c75e640 1 --2- 172.21.15.19:0/1232956617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb04102da0 0x7fbb04198440 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbb0000d950 tx=0x7fbb0000de10 comp rx=0 tx=0).stop 2024-09-19T08:50:09.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:09.021+0000 7fbb0c75e640 1 -- 172.21.15.19:0/1232956617 shutdown_connections 2024-09-19T08:50:09.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:09.021+0000 7fbb0c75e640 1 --2- 172.21.15.19:0/1232956617 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbaf00a32c0 0x7fbaf00a5780 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:09.021+0000 7fbb0c75e640 1 --2- 172.21.15.19:0/1232956617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb0410c180 0x7fbb0419cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:09.021+0000 7fbb0c75e640 1 --2- 172.21.15.19:0/1232956617 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbb041036c0 0x7fbb04198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:09.021+0000 7fbb0c75e640 1 --2- 172.21.15.19:0/1232956617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbb04102da0 0x7fbb04198440 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:09.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:09.021+0000 7fbb0c75e640 1 -- 172.21.15.19:0/1232956617 >> 172.21.15.19:0/1232956617 conn(0x7fbb040fc7a0 msgr2=0x7fbb040fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:09.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:09.021+0000 7fbb0c75e640 1 -- 172.21.15.19:0/1232956617 shutdown_connections 2024-09-19T08:50:09.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:09.021+0000 7fbb0c75e640 1 -- 172.21.15.19:0/1232956617 wait complete. 2024-09-19T08:50:09.632 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:09 smithi019 ceph-mon[30976]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:50:09.632 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:09 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:09.632 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:09 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:09.632 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:09 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:09.632 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:09 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:09.632 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:09 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1232956617' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:50:09.661 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-19T08:50:09.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:09 smithi155 ceph-mon[34921]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:50:09.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:09 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:09.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:09 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:09.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:09 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:09.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:09 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:09.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:09 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1232956617' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:50:09.936 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:09.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:09 smithi203 ceph-mon[35450]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:50:09.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:09 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:09.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:09 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:09.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:09 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:09.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:09 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:09.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:09 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1232956617' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:50:10.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.401+0000 7fb7c4529640 1 -- 172.21.15.19:0/1098612711 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7bc103700 msgr2=0x7fb7bc10bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:10.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.401+0000 7fb7c4529640 1 --2- 172.21.15.19:0/1098612711 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7bc103700 0x7fb7bc10bbf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac009900 tx=0x7fb7ac02a480 comp rx=0 tx=0).stop 2024-09-19T08:50:10.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.402+0000 7fb7c4529640 1 -- 172.21.15.19:0/1098612711 shutdown_connections 2024-09-19T08:50:10.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.402+0000 7fb7c4529640 1 --2- 172.21.15.19:0/1098612711 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb7bc10c180 0x7fb7bc10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:10.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.402+0000 7fb7c4529640 1 --2- 172.21.15.19:0/1098612711 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7bc103700 0x7fb7bc10bbf0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:10.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.402+0000 7fb7c4529640 1 --2- 172.21.15.19:0/1098612711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7bc102de0 0x7fb7bc1031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:10.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.402+0000 7fb7c4529640 1 -- 172.21.15.19:0/1098612711 >> 172.21.15.19:0/1098612711 conn(0x7fb7bc0fc7a0 msgr2=0x7fb7bc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:10.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.402+0000 7fb7c4529640 1 -- 172.21.15.19:0/1098612711 shutdown_connections 2024-09-19T08:50:10.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.402+0000 7fb7c4529640 1 -- 172.21.15.19:0/1098612711 wait complete. 2024-09-19T08:50:10.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.402+0000 7fb7c4529640 1 Processor -- start 2024-09-19T08:50:10.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.402+0000 7fb7c4529640 1 -- start start 2024-09-19T08:50:10.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.402+0000 7fb7c4529640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7bc102de0 0x7fb7bc100a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:10.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.402+0000 7fb7c4529640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb7bc103700 0x7fb7bc100f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:10.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.402+0000 7fb7c4529640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7bc10c180 0x7fb7bc1014c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:10.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.402+0000 7fb7c4529640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb7bc111f70 con 0x7fb7bc10c180 2024-09-19T08:50:10.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.402+0000 7fb7c4529640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb7bc111df0 con 0x7fb7bc102de0 2024-09-19T08:50:10.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.402+0000 7fb7c4529640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb7bc1120f0 con 0x7fb7bc103700 2024-09-19T08:50:10.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.403+0000 7fb7c2ac6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7bc10c180 0x7fb7bc1014c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:10.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.403+0000 7fb7c2ac6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7bc10c180 0x7fb7bc1014c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57966/0 (socket says 172.21.15.19:57966) 2024-09-19T08:50:10.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.403+0000 7fb7c2ac6640 1 -- 172.21.15.19:0/420687671 learned_addr learned my addr 172.21.15.19:0/420687671 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:50:10.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.403+0000 7fb7c22c5640 1 --2- 172.21.15.19:0/420687671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7bc102de0 0x7fb7bc100a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:10.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.403+0000 7fb7c1ac4640 1 --2- 172.21.15.19:0/420687671 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb7bc103700 0x7fb7bc100f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:10.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.403+0000 7fb7c2ac6640 1 -- 172.21.15.19:0/420687671 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb7bc103700 msgr2=0x7fb7bc100f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:10.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.403+0000 7fb7c2ac6640 1 --2- 172.21.15.19:0/420687671 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb7bc103700 0x7fb7bc100f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:10.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.403+0000 7fb7c2ac6640 1 -- 172.21.15.19:0/420687671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7bc102de0 msgr2=0x7fb7bc100a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:10.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.403+0000 7fb7c2ac6640 1 --2- 172.21.15.19:0/420687671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7bc102de0 0x7fb7bc100a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:10.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.403+0000 7fb7c2ac6640 1 -- 172.21.15.19:0/420687671 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7bc1a6970 con 0x7fb7bc10c180 2024-09-19T08:50:10.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.403+0000 7fb7c2ac6640 1 --2- 172.21.15.19:0/420687671 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7bc10c180 0x7fb7bc1014c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb7b400cad0 tx=0x7fb7b400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:10.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.403+0000 7fb7b37fe640 1 -- 172.21.15.19:0/420687671 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b400ae20 con 0x7fb7bc10c180 2024-09-19T08:50:10.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.403+0000 7fb7b37fe640 1 -- 172.21.15.19:0/420687671 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb7b4005020 con 0x7fb7bc10c180 2024-09-19T08:50:10.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.403+0000 7fb7c4529640 1 -- 172.21.15.19:0/420687671 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7bc1a6c60 con 0x7fb7bc10c180 2024-09-19T08:50:10.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.403+0000 7fb7b37fe640 1 -- 172.21.15.19:0/420687671 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b400f6f0 con 0x7fb7bc10c180 2024-09-19T08:50:10.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.403+0000 7fb7c4529640 1 -- 172.21.15.19:0/420687671 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7bc1a7170 con 0x7fb7bc10c180 2024-09-19T08:50:10.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.404+0000 7fb7c4529640 1 -- 172.21.15.19:0/420687671 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7bc1031c0 con 0x7fb7bc10c180 2024-09-19T08:50:10.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.405+0000 7fb7b37fe640 1 -- 172.21.15.19:0/420687671 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fb7b40051d0 con 0x7fb7bc10c180 2024-09-19T08:50:10.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.406+0000 7fb7b37fe640 1 --2- 172.21.15.19:0/420687671 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb7a80a32c0 0x7fb7a80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:10.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.406+0000 7fb7c22c5640 1 --2- 172.21.15.19:0/420687671 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb7a80a32c0 0x7fb7a80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:10.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.406+0000 7fb7b37fe640 1 -- 172.21.15.19:0/420687671 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fb7b40cf360 con 0x7fb7bc10c180 2024-09-19T08:50:10.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.407+0000 7fb7c22c5640 1 --2- 172.21.15.19:0/420687671 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb7a80a32c0 0x7fb7a80a5780 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb7b800bbe0 tx=0x7fb7b800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:10.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.410+0000 7fb7b37fe640 1 -- 172.21.15.19:0/420687671 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb7b4014030 con 0x7fb7bc10c180 2024-09-19T08:50:10.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.587+0000 7fb7c4529640 1 -- 172.21.15.19:0/420687671 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb7bc107200 con 0x7fb7bc10c180 2024-09-19T08:50:10.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.588+0000 7fb7b37fe640 1 -- 172.21.15.19:0/420687671 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v75) ==== 84+0+65 (secure 0 0 0) 0x7fb7b409bed0 con 0x7fb7bc10c180 2024-09-19T08:50:10.588 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:50:10.588 INFO:teuthology.orchestra.run.smithi019.stdout:[ 2024-09-19T08:50:10.589 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T08:50:10.589 INFO:teuthology.orchestra.run.smithi019.stdout: "poolnum": 1, 2024-09-19T08:50:10.589 INFO:teuthology.orchestra.run.smithi019.stdout: "poolname": ".mgr" 2024-09-19T08:50:10.589 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:50:10.589 INFO:teuthology.orchestra.run.smithi019.stdout:] 2024-09-19T08:50:10.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.590+0000 7fb7c4529640 1 -- 172.21.15.19:0/420687671 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb7a80a32c0 msgr2=0x7fb7a80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:10.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.590+0000 7fb7c4529640 1 --2- 172.21.15.19:0/420687671 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb7a80a32c0 0x7fb7a80a5780 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fb7b800bbe0 tx=0x7fb7b800b390 comp rx=0 tx=0).stop 2024-09-19T08:50:10.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.590+0000 7fb7c4529640 1 -- 172.21.15.19:0/420687671 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7bc10c180 msgr2=0x7fb7bc1014c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:10.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.590+0000 7fb7c4529640 1 --2- 172.21.15.19:0/420687671 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7bc10c180 0x7fb7bc1014c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb7b400cad0 tx=0x7fb7b400cf90 comp rx=0 tx=0).stop 2024-09-19T08:50:10.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.590+0000 7fb7c4529640 1 -- 172.21.15.19:0/420687671 shutdown_connections 2024-09-19T08:50:10.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.590+0000 7fb7c4529640 1 --2- 172.21.15.19:0/420687671 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb7a80a32c0 0x7fb7a80a5780 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:10.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.590+0000 7fb7c4529640 1 --2- 172.21.15.19:0/420687671 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb7bc103700 0x7fb7bc100f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:10.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.590+0000 7fb7c4529640 1 --2- 172.21.15.19:0/420687671 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb7bc10c180 0x7fb7bc1014c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:10.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.590+0000 7fb7c4529640 1 --2- 172.21.15.19:0/420687671 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb7bc102de0 0x7fb7bc100a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:10.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.590+0000 7fb7c4529640 1 -- 172.21.15.19:0/420687671 >> 172.21.15.19:0/420687671 conn(0x7fb7bc0fc7a0 msgr2=0x7fb7bc0fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:10.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.590+0000 7fb7c4529640 1 -- 172.21.15.19:0/420687671 shutdown_connections 2024-09-19T08:50:10.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:10.590+0000 7fb7c4529640 1 -- 172.21.15.19:0/420687671 wait complete. 2024-09-19T08:50:11.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:10 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:11.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:10 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:11.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:10 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:11.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:10 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:50:11.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:10 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:11.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:10 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/420687671' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T08:50:11.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:10 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:11.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:10 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:11.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:10 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:11.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:10 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:50:11.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:10 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:11.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:10 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/420687671' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T08:50:11.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:10 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:11.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:10 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:11.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:10 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:50:11.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:10 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:50:11.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:10 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:50:11.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:10 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/420687671' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T08:50:11.265 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T08:50:11.265 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T08:50:11.525 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:11.911 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:11 smithi019 ceph-mon[30976]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:50:12.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:11.997+0000 7f9082b77640 1 -- 172.21.15.19:0/1120187065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f907c102790 msgr2=0x7f907c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:12.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:11.997+0000 7f9082b77640 1 --2- 172.21.15.19:0/1120187065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f907c102790 0x7f907c1067e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f906c009900 tx=0x7f906c02a410 comp rx=0 tx=0).stop 2024-09-19T08:50:12.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:11.997+0000 7f9082b77640 1 -- 172.21.15.19:0/1120187065 shutdown_connections 2024-09-19T08:50:12.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:11.997+0000 7f9082b77640 1 --2- 172.21.15.19:0/1120187065 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f907c106f10 0x7f907c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:12.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:11.997+0000 7f9082b77640 1 --2- 172.21.15.19:0/1120187065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f907c102790 0x7f907c1067e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:12.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:11.997+0000 7f9082b77640 1 --2- 172.21.15.19:0/1120187065 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f907c101de0 0x7f907c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:12.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:11.997+0000 7f9082b77640 1 -- 172.21.15.19:0/1120187065 >> 172.21.15.19:0/1120187065 conn(0x7f907c0fd8c0 msgr2=0x7f907c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:12.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:11.997+0000 7f9082b77640 1 -- 172.21.15.19:0/1120187065 shutdown_connections 2024-09-19T08:50:12.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:11.997+0000 7f9082b77640 1 -- 172.21.15.19:0/1120187065 wait complete. 2024-09-19T08:50:12.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:11.998+0000 7f9082b77640 1 Processor -- start 2024-09-19T08:50:12.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:11.998+0000 7f9082b77640 1 -- start start 2024-09-19T08:50:12.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:11.998+0000 7f9082b77640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f907c101de0 0x7f907c198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:12.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:11.998+0000 7f9082b77640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f907c102790 0x7f907c198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:12.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:11.998+0000 7f9082b77640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f907c106f10 0x7f907c19cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:12.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:11.998+0000 7f9082b77640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f907c111f70 con 0x7f907c101de0 2024-09-19T08:50:12.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:11.998+0000 7f9082b77640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f907c111df0 con 0x7f907c106f10 2024-09-19T08:50:12.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:11.998+0000 7f9082b77640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f907c1120f0 con 0x7f907c102790 2024-09-19T08:50:12.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:11.998+0000 7f9080913640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f907c101de0 0x7f907c198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:12.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:11.998+0000 7f9080913640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f907c101de0 0x7f907c198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57972/0 (socket says 172.21.15.19:57972) 2024-09-19T08:50:12.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:11.998+0000 7f9080913640 1 -- 172.21.15.19:0/1410516620 learned_addr learned my addr 172.21.15.19:0/1410516620 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:50:12.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:11.998+0000 7f9081114640 1 --2- 172.21.15.19:0/1410516620 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f907c106f10 0x7f907c19cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:12.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:11.999+0000 7f9073fff640 1 --2- 172.21.15.19:0/1410516620 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f907c102790 0x7f907c198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:12.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:11.999+0000 7f9080913640 1 -- 172.21.15.19:0/1410516620 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f907c102790 msgr2=0x7f907c198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:12.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:11.999+0000 7f9080913640 1 --2- 172.21.15.19:0/1410516620 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f907c102790 0x7f907c198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:12.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:11.999+0000 7f9080913640 1 -- 172.21.15.19:0/1410516620 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f907c106f10 msgr2=0x7f907c19cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:12.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:11.999+0000 7f9080913640 1 --2- 172.21.15.19:0/1410516620 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f907c106f10 0x7f907c19cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:12.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:11.999+0000 7f9080913640 1 -- 172.21.15.19:0/1410516620 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f907c19d4c0 con 0x7f907c101de0 2024-09-19T08:50:12.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:11.999+0000 7f9073fff640 1 --2- 172.21.15.19:0/1410516620 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f907c102790 0x7f907c198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:50:12.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:11.999+0000 7f9080913640 1 --2- 172.21.15.19:0/1410516620 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f907c101de0 0x7f907c198510 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f907800d770 tx=0x7f907800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:12.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:11.999+0000 7f9071ffb640 1 -- 172.21.15.19:0/1410516620 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9078017070 con 0x7f907c101de0 2024-09-19T08:50:12.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:11.999+0000 7f9082b77640 1 -- 172.21.15.19:0/1410516620 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f907c19d7b0 con 0x7f907c101de0 2024-09-19T08:50:12.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:11.999+0000 7f9071ffb640 1 -- 172.21.15.19:0/1410516620 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9078005500 con 0x7f907c101de0 2024-09-19T08:50:12.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:11.999+0000 7f9071ffb640 1 -- 172.21.15.19:0/1410516620 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9078004e00 con 0x7f907c101de0 2024-09-19T08:50:12.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:11.999+0000 7f9082b77640 1 -- 172.21.15.19:0/1410516620 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f907c1a5090 con 0x7f907c101de0 2024-09-19T08:50:12.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:12.000+0000 7f9082b77640 1 -- 172.21.15.19:0/1410516620 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f907c1021c0 con 0x7f907c101de0 2024-09-19T08:50:12.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:12.001+0000 7f9071ffb640 1 -- 172.21.15.19:0/1410516620 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f9078004fa0 con 0x7f907c101de0 2024-09-19T08:50:12.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:12.002+0000 7f9071ffb640 1 --2- 172.21.15.19:0/1410516620 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f90640a3240 0x7f90640a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:12.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:12.002+0000 7f9073fff640 1 --2- 172.21.15.19:0/1410516620 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f90640a3240 0x7f90640a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:12.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:12.003+0000 7f9071ffb640 1 -- 172.21.15.19:0/1410516620 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f90780cf2f0 con 0x7f907c101de0 2024-09-19T08:50:12.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:12.003+0000 7f9073fff640 1 --2- 172.21.15.19:0/1410516620 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f90640a3240 0x7f90640a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f906c000c00 tx=0x7f906c032c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:12.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:12.006+0000 7f9071ffb640 1 -- 172.21.15.19:0/1410516620 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f907809c490 con 0x7f907c101de0 2024-09-19T08:50:12.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:11 smithi155 ceph-mon[34921]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:50:12.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:12.183+0000 7f9082b77640 1 -- 172.21.15.19:0/1410516620 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f907c10a150 con 0x7f907c101de0 2024-09-19T08:50:12.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:11 smithi203 ceph-mon[35450]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:50:12.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:12.777+0000 7f9071ffb640 1 -- 172.21.15.19:0/1410516620 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v76) ==== 138+0+0 (secure 0 0 0) 0x7f907809bd90 con 0x7f907c101de0 2024-09-19T08:50:12.777 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' created 2024-09-19T08:50:12.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:12.780+0000 7f9082b77640 1 -- 172.21.15.19:0/1410516620 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f90640a3240 msgr2=0x7f90640a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:12.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:12.780+0000 7f9082b77640 1 --2- 172.21.15.19:0/1410516620 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f90640a3240 0x7f90640a5700 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f906c000c00 tx=0x7f906c032c70 comp rx=0 tx=0).stop 2024-09-19T08:50:12.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:12.780+0000 7f9082b77640 1 -- 172.21.15.19:0/1410516620 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f907c101de0 msgr2=0x7f907c198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:12.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:12.780+0000 7f9082b77640 1 --2- 172.21.15.19:0/1410516620 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f907c101de0 0x7f907c198510 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f907800d770 tx=0x7f907800dc30 comp rx=0 tx=0).stop 2024-09-19T08:50:12.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:12.780+0000 7f9082b77640 1 -- 172.21.15.19:0/1410516620 shutdown_connections 2024-09-19T08:50:12.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:12.780+0000 7f9082b77640 1 --2- 172.21.15.19:0/1410516620 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f90640a3240 0x7f90640a5700 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:12.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:12.780+0000 7f9082b77640 1 --2- 172.21.15.19:0/1410516620 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f907c102790 0x7f907c198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:12.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:12.780+0000 7f9082b77640 1 --2- 172.21.15.19:0/1410516620 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f907c106f10 0x7f907c19cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:12.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:12.780+0000 7f9082b77640 1 --2- 172.21.15.19:0/1410516620 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f907c101de0 0x7f907c198510 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:12.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:12.780+0000 7f9082b77640 1 -- 172.21.15.19:0/1410516620 >> 172.21.15.19:0/1410516620 conn(0x7f907c0fd8c0 msgr2=0x7f907c0fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:12.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:12.781+0000 7f9082b77640 1 -- 172.21.15.19:0/1410516620 shutdown_connections 2024-09-19T08:50:12.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:12.781+0000 7f9082b77640 1 -- 172.21.15.19:0/1410516620 wait complete. 2024-09-19T08:50:13.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:12 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1410516620' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T08:50:13.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:12 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1410516620' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T08:50:13.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:12 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1410516620' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T08:50:13.501 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T08:50:13.761 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:14.046 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:13 smithi019 ceph-mon[30976]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:50:14.047 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:13 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1410516620' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T08:50:14.047 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:13 smithi019 ceph-mon[30976]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T08:50:14.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:13 smithi155 ceph-mon[34921]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:50:14.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:13 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1410516620' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T08:50:14.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:13 smithi155 ceph-mon[34921]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T08:50:14.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:13 smithi203 ceph-mon[35450]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:50:14.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:13 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1410516620' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T08:50:14.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:13 smithi203 ceph-mon[35450]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T08:50:14.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.234+0000 7f814472b640 1 -- 172.21.15.19:0/691945817 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f813c102570 msgr2=0x7f813c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:14.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.234+0000 7f814472b640 1 --2- 172.21.15.19:0/691945817 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f813c102570 0x7f813c1029b0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f812c009900 tx=0x7f812c02a480 comp rx=0 tx=0).stop 2024-09-19T08:50:14.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.234+0000 7f814472b640 1 -- 172.21.15.19:0/691945817 shutdown_connections 2024-09-19T08:50:14.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.234+0000 7f814472b640 1 --2- 172.21.15.19:0/691945817 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f813c102ef0 0x7f813c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:14.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.234+0000 7f814472b640 1 --2- 172.21.15.19:0/691945817 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f813c102570 0x7f813c1029b0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:14.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.234+0000 7f814472b640 1 --2- 172.21.15.19:0/691945817 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f813c100e20 0x7f813c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:14.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.234+0000 7f814472b640 1 -- 172.21.15.19:0/691945817 >> 172.21.15.19:0/691945817 conn(0x7f813c0fc7d0 msgr2=0x7f813c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:14.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.234+0000 7f814472b640 1 -- 172.21.15.19:0/691945817 shutdown_connections 2024-09-19T08:50:14.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.234+0000 7f814472b640 1 -- 172.21.15.19:0/691945817 wait complete. 2024-09-19T08:50:14.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.235+0000 7f814472b640 1 Processor -- start 2024-09-19T08:50:14.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.235+0000 7f814472b640 1 -- start start 2024-09-19T08:50:14.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.235+0000 7f814472b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f813c100e20 0x7f813c1993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:14.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.235+0000 7f814472b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f813c102570 0x7f813c199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:14.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.235+0000 7f814472b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f813c102ef0 0x7f813c1a4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:14.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.235+0000 7f814472b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f813c110f80 con 0x7f813c102ef0 2024-09-19T08:50:14.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.235+0000 7f814472b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f813c110e00 con 0x7f813c102570 2024-09-19T08:50:14.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.235+0000 7f814472b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f813c111100 con 0x7f813c100e20 2024-09-19T08:50:14.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.235+0000 7f8142cc8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f813c102ef0 0x7f813c1a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:14.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.235+0000 7f8142cc8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f813c102ef0 0x7f813c1a4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57988/0 (socket says 172.21.15.19:57988) 2024-09-19T08:50:14.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.235+0000 7f8142cc8640 1 -- 172.21.15.19:0/896179272 learned_addr learned my addr 172.21.15.19:0/896179272 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:50:14.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.235+0000 7f8141cc6640 1 --2- 172.21.15.19:0/896179272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f813c102570 0x7f813c199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:14.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.235+0000 7f81424c7640 1 --2- 172.21.15.19:0/896179272 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f813c100e20 0x7f813c1993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:14.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.235+0000 7f8142cc8640 1 -- 172.21.15.19:0/896179272 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f813c100e20 msgr2=0x7f813c1993d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:14.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.235+0000 7f8142cc8640 1 --2- 172.21.15.19:0/896179272 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f813c100e20 0x7f813c1993d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:14.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.235+0000 7f8142cc8640 1 -- 172.21.15.19:0/896179272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f813c102570 msgr2=0x7f813c199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:14.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.235+0000 7f8142cc8640 1 --2- 172.21.15.19:0/896179272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f813c102570 0x7f813c199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:14.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.235+0000 7f8142cc8640 1 -- 172.21.15.19:0/896179272 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f813c1a4990 con 0x7f813c102ef0 2024-09-19T08:50:14.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.236+0000 7f8142cc8640 1 --2- 172.21.15.19:0/896179272 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f813c102ef0 0x7f813c1a4450 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f813400eaa0 tx=0x7f813400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:14.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.236+0000 7f81337fe640 1 -- 172.21.15.19:0/896179272 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f813400cdb0 con 0x7f813c102ef0 2024-09-19T08:50:14.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.236+0000 7f81337fe640 1 -- 172.21.15.19:0/896179272 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8134005020 con 0x7f813c102ef0 2024-09-19T08:50:14.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.236+0000 7f814472b640 1 -- 172.21.15.19:0/896179272 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f813c1a4b60 con 0x7f813c102ef0 2024-09-19T08:50:14.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.236+0000 7f81337fe640 1 -- 172.21.15.19:0/896179272 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81340116b0 con 0x7f813c102ef0 2024-09-19T08:50:14.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.236+0000 7f814472b640 1 -- 172.21.15.19:0/896179272 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f813c1a5020 con 0x7f813c102ef0 2024-09-19T08:50:14.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.237+0000 7f814472b640 1 -- 172.21.15.19:0/896179272 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f813c101200 con 0x7f813c102ef0 2024-09-19T08:50:14.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.238+0000 7f81337fe640 1 -- 172.21.15.19:0/896179272 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f8134005560 con 0x7f813c102ef0 2024-09-19T08:50:14.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.239+0000 7f81337fe640 1 --2- 172.21.15.19:0/896179272 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f81280a3240 0x7f81280a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:14.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.239+0000 7f81424c7640 1 --2- 172.21.15.19:0/896179272 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f81280a3240 0x7f81280a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:14.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.239+0000 7f81337fe640 1 -- 172.21.15.19:0/896179272 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(77..77 src has 1..77) ==== 7497+0+0 (secure 0 0 0) 0x7f81340cfb80 con 0x7f813c102ef0 2024-09-19T08:50:14.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.239+0000 7f81424c7640 1 --2- 172.21.15.19:0/896179272 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f81280a3240 0x7f81280a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8138009b60 tx=0x7f8138005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:14.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.242+0000 7f81337fe640 1 -- 172.21.15.19:0/896179272 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8134016030 con 0x7f813c102ef0 2024-09-19T08:50:14.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.421+0000 7f814472b640 1 -- 172.21.15.19:0/896179272 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f813c109090 con 0x7f813c102ef0 2024-09-19T08:50:14.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.858+0000 7f81337fe640 1 -- 172.21.15.19:0/896179272 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v78) ==== 170+0+0 (secure 0 0 0) 0x7f813409cbd0 con 0x7f813c102ef0 2024-09-19T08:50:14.861 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' created 2024-09-19T08:50:14.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.861+0000 7f814472b640 1 -- 172.21.15.19:0/896179272 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f81280a3240 msgr2=0x7f81280a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:14.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.861+0000 7f814472b640 1 --2- 172.21.15.19:0/896179272 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f81280a3240 0x7f81280a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8138009b60 tx=0x7f8138005f90 comp rx=0 tx=0).stop 2024-09-19T08:50:14.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.861+0000 7f814472b640 1 -- 172.21.15.19:0/896179272 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f813c102ef0 msgr2=0x7f813c1a4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:14.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.861+0000 7f814472b640 1 --2- 172.21.15.19:0/896179272 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f813c102ef0 0x7f813c1a4450 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f813400eaa0 tx=0x7f813400ef60 comp rx=0 tx=0).stop 2024-09-19T08:50:14.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.861+0000 7f814472b640 1 -- 172.21.15.19:0/896179272 shutdown_connections 2024-09-19T08:50:14.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.861+0000 7f814472b640 1 --2- 172.21.15.19:0/896179272 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f81280a3240 0x7f81280a5700 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:14.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.861+0000 7f814472b640 1 --2- 172.21.15.19:0/896179272 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f813c102ef0 0x7f813c1a4450 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:14.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.861+0000 7f814472b640 1 --2- 172.21.15.19:0/896179272 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f813c102570 0x7f813c199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:14.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.861+0000 7f814472b640 1 --2- 172.21.15.19:0/896179272 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f813c100e20 0x7f813c1993d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:14.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.861+0000 7f814472b640 1 -- 172.21.15.19:0/896179272 >> 172.21.15.19:0/896179272 conn(0x7f813c0fc7d0 msgr2=0x7f813c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:14.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.861+0000 7f814472b640 1 -- 172.21.15.19:0/896179272 shutdown_connections 2024-09-19T08:50:14.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:14.861+0000 7f814472b640 1 -- 172.21.15.19:0/896179272 wait complete. 2024-09-19T08:50:15.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:14 smithi155 ceph-mon[34921]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T08:50:15.173 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:14 smithi019 ceph-mon[30976]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T08:50:15.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:14 smithi203 ceph-mon[35450]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T08:50:15.522 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T08:50:15.782 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:16.170 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:15 smithi019 ceph-mon[30976]: pgmap v273: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:50:16.170 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:15 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/896179272' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T08:50:16.170 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:15 smithi019 ceph-mon[30976]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T08:50:16.170 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:15 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/896179272' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T08:50:16.170 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:15 smithi019 ceph-mon[30976]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T08:50:16.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:15 smithi155 ceph-mon[34921]: pgmap v273: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:50:16.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:15 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/896179272' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T08:50:16.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:15 smithi155 ceph-mon[34921]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T08:50:16.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:15 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/896179272' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T08:50:16.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:15 smithi155 ceph-mon[34921]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T08:50:16.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:15 smithi203 ceph-mon[35450]: pgmap v273: 33 pgs: 6 creating+peering, 26 unknown, 1 active+clean; 577 KiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:50:16.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:15 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/896179272' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T08:50:16.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:15 smithi203 ceph-mon[35450]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T08:50:16.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:15 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/896179272' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T08:50:16.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:15 smithi203 ceph-mon[35450]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T08:50:16.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.254+0000 7f358c333640 1 -- 172.21.15.19:0/4160478424 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3584106f10 msgr2=0x7f358410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:16.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.254+0000 7f358c333640 1 --2- 172.21.15.19:0/4160478424 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3584106f10 0x7f358410ea90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f357c009ca0 tx=0x7f357c02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:50:16.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.254+0000 7f358c333640 1 -- 172.21.15.19:0/4160478424 shutdown_connections 2024-09-19T08:50:16.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.254+0000 7f358c333640 1 --2- 172.21.15.19:0/4160478424 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3584106f10 0x7f358410ea90 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:16.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.254+0000 7f358c333640 1 --2- 172.21.15.19:0/4160478424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3584102790 0x7f35841067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:16.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.254+0000 7f358c333640 1 --2- 172.21.15.19:0/4160478424 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3584101de0 0x7f35841021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:16.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.254+0000 7f358c333640 1 -- 172.21.15.19:0/4160478424 >> 172.21.15.19:0/4160478424 conn(0x7f35840fd8c0 msgr2=0x7f35840ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:16.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.254+0000 7f358c333640 1 -- 172.21.15.19:0/4160478424 shutdown_connections 2024-09-19T08:50:16.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.255+0000 7f358c333640 1 -- 172.21.15.19:0/4160478424 wait complete. 2024-09-19T08:50:16.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.255+0000 7f358c333640 1 Processor -- start 2024-09-19T08:50:16.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.255+0000 7f358c333640 1 -- start start 2024-09-19T08:50:16.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.255+0000 7f358c333640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3584101de0 0x7f35840744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:16.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.255+0000 7f358c333640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3584102790 0x7f3584074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:16.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.255+0000 7f358c333640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3584106f10 0x7f3584074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:16.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.255+0000 7f358c333640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3584111f70 con 0x7f3584101de0 2024-09-19T08:50:16.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.255+0000 7f358c333640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3584111df0 con 0x7f3584102790 2024-09-19T08:50:16.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.255+0000 7f358c333640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f35841120f0 con 0x7f3584106f10 2024-09-19T08:50:16.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.255+0000 7f358a0cf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3584101de0 0x7f35840744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:16.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.255+0000 7f358a0cf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3584101de0 0x7f35840744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57426/0 (socket says 172.21.15.19:57426) 2024-09-19T08:50:16.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.255+0000 7f358a0cf640 1 -- 172.21.15.19:0/1589879899 learned_addr learned my addr 172.21.15.19:0/1589879899 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:50:16.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.256+0000 7f358a8d0640 1 --2- 172.21.15.19:0/1589879899 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3584106f10 0x7f3584074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:16.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.256+0000 7f35898ce640 1 --2- 172.21.15.19:0/1589879899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3584102790 0x7f3584074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:16.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.256+0000 7f358a0cf640 1 -- 172.21.15.19:0/1589879899 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3584106f10 msgr2=0x7f3584074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:16.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.256+0000 7f358a0cf640 1 --2- 172.21.15.19:0/1589879899 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3584106f10 0x7f3584074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:16.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.256+0000 7f358a0cf640 1 -- 172.21.15.19:0/1589879899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3584102790 msgr2=0x7f3584074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:16.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.256+0000 7f358a0cf640 1 --2- 172.21.15.19:0/1589879899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3584102790 0x7f3584074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:16.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.256+0000 7f358a0cf640 1 -- 172.21.15.19:0/1589879899 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35841a6890 con 0x7f3584101de0 2024-09-19T08:50:16.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.256+0000 7f35898ce640 1 --2- 172.21.15.19:0/1589879899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3584102790 0x7f3584074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:50:16.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.256+0000 7f358a0cf640 1 --2- 172.21.15.19:0/1589879899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3584101de0 0x7f35840744f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f358000d770 tx=0x7f358000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:16.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.256+0000 7f357b7fe640 1 -- 172.21.15.19:0/1589879899 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3580017070 con 0x7f3584101de0 2024-09-19T08:50:16.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.256+0000 7f357b7fe640 1 -- 172.21.15.19:0/1589879899 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3580005500 con 0x7f3584101de0 2024-09-19T08:50:16.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.256+0000 7f358c333640 1 -- 172.21.15.19:0/1589879899 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35841a6b80 con 0x7f3584101de0 2024-09-19T08:50:16.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.256+0000 7f357b7fe640 1 -- 172.21.15.19:0/1589879899 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3580004e00 con 0x7f3584101de0 2024-09-19T08:50:16.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.256+0000 7f358c333640 1 -- 172.21.15.19:0/1589879899 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35841a70c0 con 0x7f3584101de0 2024-09-19T08:50:16.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.257+0000 7f358c333640 1 -- 172.21.15.19:0/1589879899 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35841021c0 con 0x7f3584101de0 2024-09-19T08:50:16.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.258+0000 7f357b7fe640 1 -- 172.21.15.19:0/1589879899 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f3580004fa0 con 0x7f3584101de0 2024-09-19T08:50:16.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.259+0000 7f357b7fe640 1 --2- 172.21.15.19:0/1589879899 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f35700a32c0 0x7f35700a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:16.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.259+0000 7f35898ce640 1 --2- 172.21.15.19:0/1589879899 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f35700a32c0 0x7f35700a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:16.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.259+0000 7f357b7fe640 1 -- 172.21.15.19:0/1589879899 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7879+0+0 (secure 0 0 0) 0x7f35800cf110 con 0x7f3584101de0 2024-09-19T08:50:16.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.260+0000 7f35898ce640 1 --2- 172.21.15.19:0/1589879899 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f35700a32c0 0x7f35700a5780 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3574005fd0 tx=0x7f3574005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:16.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.263+0000 7f357b7fe640 1 -- 172.21.15.19:0/1589879899 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f358009bfe0 con 0x7f3584101de0 2024-09-19T08:50:16.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.475+0000 7f358c333640 1 -- 172.21.15.19:0/1589879899 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f3584109bc0 con 0x7f3584101de0 2024-09-19T08:50:16.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.865+0000 7f357b7fe640 1 -- 172.21.15.19:0/1589879899 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f358009b8e0 con 0x7f3584101de0 2024-09-19T08:50:16.866 INFO:teuthology.orchestra.run.smithi019.stderr:new fs with metadata pool 2 and data pool 3 2024-09-19T08:50:16.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.868+0000 7f358c333640 1 -- 172.21.15.19:0/1589879899 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f35700a32c0 msgr2=0x7f35700a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:16.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.868+0000 7f358c333640 1 --2- 172.21.15.19:0/1589879899 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f35700a32c0 0x7f35700a5780 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3574005fd0 tx=0x7f3574005850 comp rx=0 tx=0).stop 2024-09-19T08:50:16.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.868+0000 7f358c333640 1 -- 172.21.15.19:0/1589879899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3584101de0 msgr2=0x7f35840744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:16.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.868+0000 7f358c333640 1 --2- 172.21.15.19:0/1589879899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3584101de0 0x7f35840744f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f358000d770 tx=0x7f358000dc30 comp rx=0 tx=0).stop 2024-09-19T08:50:16.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.868+0000 7f358c333640 1 -- 172.21.15.19:0/1589879899 shutdown_connections 2024-09-19T08:50:16.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.868+0000 7f358c333640 1 --2- 172.21.15.19:0/1589879899 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f35700a32c0 0x7f35700a5780 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:16.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.868+0000 7f358c333640 1 --2- 172.21.15.19:0/1589879899 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3584106f10 0x7f3584074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:16.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.868+0000 7f358c333640 1 --2- 172.21.15.19:0/1589879899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3584102790 0x7f3584074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:16.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.868+0000 7f358c333640 1 --2- 172.21.15.19:0/1589879899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3584101de0 0x7f35840744f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:16.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.868+0000 7f358c333640 1 -- 172.21.15.19:0/1589879899 >> 172.21.15.19:0/1589879899 conn(0x7f35840fd8c0 msgr2=0x7f35840feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:16.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.869+0000 7f358c333640 1 -- 172.21.15.19:0/1589879899 shutdown_connections 2024-09-19T08:50:16.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:16.869+0000 7f358c333640 1 -- 172.21.15.19:0/1589879899 wait complete. 2024-09-19T08:50:17.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:16 smithi155 ceph-mon[34921]: pgmap v275: 97 pgs: 15 active+clean, 36 creating+peering, 46 unknown; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:50:17.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:16 smithi155 ceph-mon[34921]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T08:50:17.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:16 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1589879899' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T08:50:17.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:16 smithi155 ceph-mon[34921]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T08:50:17.182 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:16 smithi019 ceph-mon[30976]: pgmap v275: 97 pgs: 15 active+clean, 36 creating+peering, 46 unknown; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:50:17.182 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:16 smithi019 ceph-mon[30976]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T08:50:17.182 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:16 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1589879899' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T08:50:17.182 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:16 smithi019 ceph-mon[30976]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T08:50:17.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:16 smithi203 ceph-mon[35450]: pgmap v275: 97 pgs: 15 active+clean, 36 creating+peering, 46 unknown; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T08:50:17.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:16 smithi203 ceph-mon[35450]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T08:50:17.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:16 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1589879899' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T08:50:17.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:16 smithi203 ceph-mon[35450]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T08:50:17.559 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:50:17.819 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:18.170 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:17 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1589879899' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T08:50:18.171 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:17 smithi019 ceph-mon[30976]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T08:50:18.171 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:17 smithi019 ceph-mon[30976]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T08:50:18.171 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:17 smithi019 ceph-mon[30976]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T08:50:18.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:17 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1589879899' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T08:50:18.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:17 smithi155 ceph-mon[34921]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T08:50:18.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:17 smithi155 ceph-mon[34921]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T08:50:18.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:17 smithi155 ceph-mon[34921]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T08:50:18.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:17 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1589879899' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T08:50:18.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:17 smithi203 ceph-mon[35450]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T08:50:18.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:17 smithi203 ceph-mon[35450]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T08:50:18.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:17 smithi203 ceph-mon[35450]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T08:50:18.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.252+0000 7fe39f1d9640 1 -- 172.21.15.19:0/3551201470 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe398100a80 msgr2=0x7fe398100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:18.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.252+0000 7fe39f1d9640 1 --2- 172.21.15.19:0/3551201470 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe398100a80 0x7fe398100ee0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe384009930 tx=0x7fe38402a420 comp rx=0 tx=0).stop 2024-09-19T08:50:18.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.252+0000 7fe39f1d9640 1 -- 172.21.15.19:0/3551201470 shutdown_connections 2024-09-19T08:50:18.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.252+0000 7fe39f1d9640 1 --2- 172.21.15.19:0/3551201470 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe398101420 0x7fe39810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:18.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.252+0000 7fe39f1d9640 1 --2- 172.21.15.19:0/3551201470 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe398100a80 0x7fe398100ee0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:18.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.252+0000 7fe39f1d9640 1 --2- 172.21.15.19:0/3551201470 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe398106a80 0x7fe398106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:18.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.252+0000 7fe39f1d9640 1 -- 172.21.15.19:0/3551201470 >> 172.21.15.19:0/3551201470 conn(0x7fe3980fc7a0 msgr2=0x7fe3980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:18.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.252+0000 7fe39f1d9640 1 -- 172.21.15.19:0/3551201470 shutdown_connections 2024-09-19T08:50:18.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.252+0000 7fe39f1d9640 1 -- 172.21.15.19:0/3551201470 wait complete. 2024-09-19T08:50:18.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.253+0000 7fe39f1d9640 1 Processor -- start 2024-09-19T08:50:18.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.253+0000 7fe39f1d9640 1 -- start start 2024-09-19T08:50:18.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.253+0000 7fe39f1d9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe398100a80 0x7fe3981970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:18.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.253+0000 7fe39f1d9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe398101420 0x7fe398197620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:18.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.253+0000 7fe39f1d9640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe398106a80 0x7fe398197b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:18.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.253+0000 7fe39f1d9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe398110ea0 con 0x7fe398101420 2024-09-19T08:50:18.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.253+0000 7fe39f1d9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe398110d20 con 0x7fe398100a80 2024-09-19T08:50:18.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.253+0000 7fe39f1d9640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe398111020 con 0x7fe398106a80 2024-09-19T08:50:18.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.253+0000 7fe397fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe398101420 0x7fe398197620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:18.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.253+0000 7fe397fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe398101420 0x7fe398197620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57448/0 (socket says 172.21.15.19:57448) 2024-09-19T08:50:18.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.253+0000 7fe397fff640 1 -- 172.21.15.19:0/1925013651 learned_addr learned my addr 172.21.15.19:0/1925013651 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:50:18.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.253+0000 7fe39cf75640 1 --2- 172.21.15.19:0/1925013651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe398100a80 0x7fe3981970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:18.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.253+0000 7fe39d776640 1 --2- 172.21.15.19:0/1925013651 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe398106a80 0x7fe398197b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:18.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.254+0000 7fe397fff640 1 -- 172.21.15.19:0/1925013651 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe398106a80 msgr2=0x7fe398197b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:18.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.254+0000 7fe397fff640 1 --2- 172.21.15.19:0/1925013651 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe398106a80 0x7fe398197b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:18.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.254+0000 7fe397fff640 1 -- 172.21.15.19:0/1925013651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe398100a80 msgr2=0x7fe3981970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:18.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.254+0000 7fe397fff640 1 --2- 172.21.15.19:0/1925013651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe398100a80 0x7fe3981970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:18.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.254+0000 7fe397fff640 1 -- 172.21.15.19:0/1925013651 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3981a6950 con 0x7fe398101420 2024-09-19T08:50:18.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.254+0000 7fe397fff640 1 --2- 172.21.15.19:0/1925013651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe398101420 0x7fe398197620 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe384009230 tx=0x7fe384004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:18.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.254+0000 7fe395ffb640 1 -- 172.21.15.19:0/1925013651 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38403f030 con 0x7fe398101420 2024-09-19T08:50:18.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.254+0000 7fe39f1d9640 1 -- 172.21.15.19:0/1925013651 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3981a6be0 con 0x7fe398101420 2024-09-19T08:50:18.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.254+0000 7fe395ffb640 1 -- 172.21.15.19:0/1925013651 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe384003ad0 con 0x7fe398101420 2024-09-19T08:50:18.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.254+0000 7fe395ffb640 1 -- 172.21.15.19:0/1925013651 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe384035070 con 0x7fe398101420 2024-09-19T08:50:18.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.254+0000 7fe39f1d9640 1 -- 172.21.15.19:0/1925013651 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3981a7110 con 0x7fe398101420 2024-09-19T08:50:18.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.255+0000 7fe39f1d9640 1 -- 172.21.15.19:0/1925013651 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe398100ee0 con 0x7fe398101420 2024-09-19T08:50:18.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.256+0000 7fe395ffb640 1 -- 172.21.15.19:0/1925013651 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fe384042030 con 0x7fe398101420 2024-09-19T08:50:18.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.257+0000 7fe395ffb640 1 --2- 172.21.15.19:0/1925013651 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe3880a3240 0x7fe3880a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:18.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.258+0000 7fe39cf75640 1 --2- 172.21.15.19:0/1925013651 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe3880a3240 0x7fe3880a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:18.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.258+0000 7fe395ffb640 1 -- 172.21.15.19:0/1925013651 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fe3840f0100 con 0x7fe398101420 2024-09-19T08:50:18.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.258+0000 7fe39cf75640 1 --2- 172.21.15.19:0/1925013651 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe3880a3240 0x7fe3880a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00bbe0 tx=0x7fe38c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:18.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.261+0000 7fe395ffb640 1 -- 172.21.15.19:0/1925013651 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe3840bced0 con 0x7fe398101420 2024-09-19T08:50:18.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.438+0000 7fe39f1d9640 1 -- 172.21.15.19:0/1925013651 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe39802d7c0 con 0x7fe398101420 2024-09-19T08:50:18.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.440+0000 7fe395ffb640 1 -- 172.21.15.19:0/1925013651 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22276 (secure 0 0 0) 0x7fe3840bc7d0 con 0x7fe398101420 2024-09-19T08:50:18.440 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:50:18.441 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":80,"fsid":"f26c9d84-7662-11ef-bceb-c7b262605968","created":"2024-09-19T08:42:32.324073+0000","modified":"2024-09-19T08:50:16.477000+0000","last_up_change":"2024-09-19T08:49:24.764960+0000","last_in_change":"2024-09-19T08:49:01.062919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:45:36.232910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:50:12.615884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:50:14.854513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81c7bb06-5b13-4ee0-9290-d779faac1b91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6803","nonce":3397146732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6805","nonce":3397146732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6809","nonce":3397146732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6807","nonce":3397146732}]},"public_addr":"172.21.15.19:6803/3397146732","cluster_addr":"172.21.15.19:6805/3397146732","heartbeat_back_addr":"172.21.15.19:6809/3397146732","heartbeat_front_addr":"172.21.15.19:6807/3397146732","state":["exists","up"]},{"osd":1,"uuid":"24c145e6-5252-4708-8f25-5ce041e8251e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6801","nonce":2011043685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6803","nonce":2011043685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6807","nonce":2011043685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6805","nonce":2011043685}]},"public_addr":"172.21.15.155:6801/2011043685","cluster_addr":"172.21.15.155:6803/2011043685","heartbeat_back_addr":"172.21.15.155:6807/2011043685","heartbeat_front_addr":"172.21.15.155:6805/2011043685","state":["exists","up"]},{"osd":2,"uuid":"99cefd33-0675-495f-8871-2e6fdead0c3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6801","nonce":3358994623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6803","nonce":3358994623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6807","nonce":3358994623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6805","nonce":3358994623}]},"public_addr":"172.21.15.203:6801/3358994623","cluster_addr":"172.21.15.203:6803/3358994623","heartbeat_back_addr":"172.21.15.203:6807/3358994623","heartbeat_front_addr":"172.21.15.203:6805/3358994623","state":["exists","up"]},{"osd":3,"uuid":"8f46c16c-f17e-484a-8b66-6dbf135f34c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6811","nonce":176445576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6813","nonce":176445576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6817","nonce":176445576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6815","nonce":176445576}]},"public_addr":"172.21.15.19:6811/176445576","cluster_addr":"172.21.15.19:6813/176445576","heartbeat_back_addr":"172.21.15.19:6817/176445576","heartbeat_front_addr":"172.21.15.19:6815/176445576","state":["exists","up"]},{"osd":4,"uuid":"411b0423-1317-4e82-bc01-b5f55b391bc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6809","nonce":2163087792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6811","nonce":2163087792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6815","nonce":2163087792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6813","nonce":2163087792}]},"public_addr":"172.21.15.155:6809/2163087792","cluster_addr":"172.21.15.155:6811/2163087792","heartbeat_back_addr":"172.21.15.155:6815/2163087792","heartbeat_front_addr":"172.21.15.155:6813/2163087792","state":["exists","up"]},{"osd":5,"uuid":"057c073e-569f-4c6e-9602-e1169ad4dd8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6809","nonce":334881465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6811","nonce":334881465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6815","nonce":334881465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6813","nonce":334881465}]},"public_addr":"172.21.15.203:6809/334881465","cluster_addr":"172.21.15.203:6811/334881465","heartbeat_back_addr":"172.21.15.203:6815/334881465","heartbeat_front_addr":"172.21.15.203:6813/334881465","state":["exists","up"]},{"osd":6,"uuid":"40418f13-823e-4f94-a427-84781abbcb5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6819","nonce":2669779791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6821","nonce":2669779791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6825","nonce":2669779791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6823","nonce":2669779791}]},"public_addr":"172.21.15.19:6819/2669779791","cluster_addr":"172.21.15.19:6821/2669779791","heartbeat_back_addr":"172.21.15.19:6825/2669779791","heartbeat_front_addr":"172.21.15.19:6823/2669779791","state":["exists","up"]},{"osd":7,"uuid":"ad15f762-aeab-4167-a63d-6c9f9b89b9c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6817","nonce":3169455907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6819","nonce":3169455907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6823","nonce":3169455907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6821","nonce":3169455907}]},"public_addr":"172.21.15.155:6817/3169455907","cluster_addr":"172.21.15.155:6819/3169455907","heartbeat_back_addr":"172.21.15.155:6823/3169455907","heartbeat_front_addr":"172.21.15.155:6821/3169455907","state":["exists","up"]},{"osd":8,"uuid":"23cf8ea2-29d6-43d8-a05b-7822f4bbf254","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6817","nonce":1062999528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6819","nonce":1062999528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6823","nonce":1062999528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6821","nonce":1062999528}]},"public_addr":"172.21.15.203:6817/1062999528","cluster_addr":"172.21.15.203:6819/1062999528","heartbeat_back_addr":"172.21.15.203:6823/1062999528","heartbeat_front_addr":"172.21.15.203:6821/1062999528","state":["exists","up"]},{"osd":9,"uuid":"e851e605-2d17-4fbf-b783-2138133edd06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6827","nonce":574664786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6829","nonce":574664786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6833","nonce":574664786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6831","nonce":574664786}]},"public_addr":"172.21.15.19:6827/574664786","cluster_addr":"172.21.15.19:6829/574664786","heartbeat_back_addr":"172.21.15.19:6833/574664786","heartbeat_front_addr":"172.21.15.19:6831/574664786","state":["exists","up"]},{"osd":10,"uuid":"cc770717-91bd-4494-9103-6db8214b5872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6825","nonce":2242158832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6827","nonce":2242158832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6831","nonce":2242158832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6829","nonce":2242158832}]},"public_addr":"172.21.15.155:6825/2242158832","cluster_addr":"172.21.15.155:6827/2242158832","heartbeat_back_addr":"172.21.15.155:6831/2242158832","heartbeat_front_addr":"172.21.15.155:6829/2242158832","state":["exists","up"]},{"osd":11,"uuid":"6c237db9-5d79-47bc-8ff6-60d09d721d5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6825","nonce":522943955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6827","nonce":522943955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6831","nonce":522943955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6829","nonce":522943955}]},"public_addr":"172.21.15.203:6825/522943955","cluster_addr":"172.21.15.203:6827/522943955","heartbeat_back_addr":"172.21.15.203:6831/522943955","heartbeat_front_addr":"172.21.15.203:6829/522943955","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:44:44.656414+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:09.339183+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:33.245452+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:59.449025+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:46:24.831213+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:46:49.189780+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:47:13.493628+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:47:39.478247+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:05.089875+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:30.722878+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:56.951834+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:22.894678+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6801/4266644067":"2024-09-20T08:43:21.732222+0000","172.21.15.19:0/1398782170":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6800/4266644067":"2024-09-20T08:43:21.732222+0000","172.21.15.19:0/34162461":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6801/1764769529":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/2910961714":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6800/1764769529":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/820792769":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/560203138":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/809642328":"2024-09-20T08:42:56.618773+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:50:18.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.442+0000 7fe39f1d9640 1 -- 172.21.15.19:0/1925013651 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe3880a3240 msgr2=0x7fe3880a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:18.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.442+0000 7fe39f1d9640 1 --2- 172.21.15.19:0/1925013651 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe3880a3240 0x7fe3880a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00bbe0 tx=0x7fe38c00b390 comp rx=0 tx=0).stop 2024-09-19T08:50:18.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.442+0000 7fe39f1d9640 1 -- 172.21.15.19:0/1925013651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe398101420 msgr2=0x7fe398197620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:18.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.442+0000 7fe39f1d9640 1 --2- 172.21.15.19:0/1925013651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe398101420 0x7fe398197620 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe384009230 tx=0x7fe384004270 comp rx=0 tx=0).stop 2024-09-19T08:50:18.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.442+0000 7fe39f1d9640 1 -- 172.21.15.19:0/1925013651 shutdown_connections 2024-09-19T08:50:18.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.442+0000 7fe39f1d9640 1 --2- 172.21.15.19:0/1925013651 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe3880a3240 0x7fe3880a5700 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:18.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.442+0000 7fe39f1d9640 1 --2- 172.21.15.19:0/1925013651 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe398106a80 0x7fe398197b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:18.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.442+0000 7fe39f1d9640 1 --2- 172.21.15.19:0/1925013651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe398101420 0x7fe398197620 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:18.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.442+0000 7fe39f1d9640 1 --2- 172.21.15.19:0/1925013651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe398100a80 0x7fe3981970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:18.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.442+0000 7fe39f1d9640 1 -- 172.21.15.19:0/1925013651 >> 172.21.15.19:0/1925013651 conn(0x7fe3980fc7a0 msgr2=0x7fe3980fcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:18.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.442+0000 7fe39f1d9640 1 -- 172.21.15.19:0/1925013651 shutdown_connections 2024-09-19T08:50:18.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:18.442+0000 7fe39f1d9640 1 -- 172.21.15.19:0/1925013651 wait complete. 2024-09-19T08:50:19.034 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:18 smithi019 ceph-mon[30976]: pgmap v278: 97 pgs: 55 active+clean, 36 creating+peering, 6 unknown; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 252 B/s wr, 5 op/s 2024-09-19T08:50:19.034 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:18 smithi019 ceph-mon[30976]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T08:50:19.034 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:18 smithi019 ceph-mon[30976]: Cluster is now healthy 2024-09-19T08:50:19.034 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:18 smithi019 ceph-mon[30976]: mds.? [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] up:active 2024-09-19T08:50:19.034 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:18 smithi019 ceph-mon[30976]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:50:19.034 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:18 smithi019 ceph-mon[30976]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:50:19.034 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:18 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1925013651' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:50:19.065 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:50:19.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:18 smithi155 ceph-mon[34921]: pgmap v278: 97 pgs: 55 active+clean, 36 creating+peering, 6 unknown; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 252 B/s wr, 5 op/s 2024-09-19T08:50:19.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:18 smithi155 ceph-mon[34921]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T08:50:19.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:18 smithi155 ceph-mon[34921]: Cluster is now healthy 2024-09-19T08:50:19.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:18 smithi155 ceph-mon[34921]: mds.? [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] up:active 2024-09-19T08:50:19.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:18 smithi155 ceph-mon[34921]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:50:19.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:18 smithi155 ceph-mon[34921]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:50:19.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:18 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1925013651' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:50:19.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:18 smithi203 ceph-mon[35450]: pgmap v278: 97 pgs: 55 active+clean, 36 creating+peering, 6 unknown; 577 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 252 B/s wr, 5 op/s 2024-09-19T08:50:19.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:18 smithi203 ceph-mon[35450]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T08:50:19.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:18 smithi203 ceph-mon[35450]: Cluster is now healthy 2024-09-19T08:50:19.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:18 smithi203 ceph-mon[35450]: mds.? [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] up:active 2024-09-19T08:50:19.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:18 smithi203 ceph-mon[35450]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:50:19.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:18 smithi203 ceph-mon[35450]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:50:19.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:18 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1925013651' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:50:19.333 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:19.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.776+0000 7fbfbac5a640 1 -- 172.21.15.19:0/1627516739 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfb4106f20 msgr2=0x7fbfb410eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:19.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.776+0000 7fbfbac5a640 1 --2- 172.21.15.19:0/1627516739 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfb4106f20 0x7fbfb410eaa0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbfac009ca0 tx=0x7fbfac02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.776+0000 7fbfbac5a640 1 -- 172.21.15.19:0/1627516739 shutdown_connections 2024-09-19T08:50:19.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.776+0000 7fbfbac5a640 1 --2- 172.21.15.19:0/1627516739 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfb4106f20 0x7fbfb410eaa0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.776+0000 7fbfbac5a640 1 --2- 172.21.15.19:0/1627516739 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfb41027a0 0x7fbfb41067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.776+0000 7fbfbac5a640 1 --2- 172.21.15.19:0/1627516739 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbfb4101df0 0x7fbfb41021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.776+0000 7fbfbac5a640 1 -- 172.21.15.19:0/1627516739 >> 172.21.15.19:0/1627516739 conn(0x7fbfb40fd8b0 msgr2=0x7fbfb40ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:19.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.777+0000 7fbfbac5a640 1 -- 172.21.15.19:0/1627516739 shutdown_connections 2024-09-19T08:50:19.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.777+0000 7fbfbac5a640 1 -- 172.21.15.19:0/1627516739 wait complete. 2024-09-19T08:50:19.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.777+0000 7fbfbac5a640 1 Processor -- start 2024-09-19T08:50:19.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.777+0000 7fbfbac5a640 1 -- start start 2024-09-19T08:50:19.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.778+0000 7fbfbac5a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfb4101df0 0x7fbfb41983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:19.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.778+0000 7fbfbac5a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfb41027a0 0x7fbfb4198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:19.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.778+0000 7fbfbac5a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbfb4106f20 0x7fbfb419cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:19.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.778+0000 7fbfbac5a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb4111f80 con 0x7fbfb4101df0 2024-09-19T08:50:19.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.778+0000 7fbfbac5a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb4111e00 con 0x7fbfb41027a0 2024-09-19T08:50:19.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.778+0000 7fbfbac5a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbfb4112100 con 0x7fbfb4106f20 2024-09-19T08:50:19.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.778+0000 7fbfb89f6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfb4101df0 0x7fbfb41983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:19.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.778+0000 7fbfb89f6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfb4101df0 0x7fbfb41983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57468/0 (socket says 172.21.15.19:57468) 2024-09-19T08:50:19.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.778+0000 7fbfb89f6640 1 -- 172.21.15.19:0/3518107055 learned_addr learned my addr 172.21.15.19:0/3518107055 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:50:19.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.778+0000 7fbfb91f7640 1 --2- 172.21.15.19:0/3518107055 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbfb4106f20 0x7fbfb419cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:19.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.778+0000 7fbfb3fff640 1 --2- 172.21.15.19:0/3518107055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfb41027a0 0x7fbfb4198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:19.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.778+0000 7fbfb89f6640 1 -- 172.21.15.19:0/3518107055 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbfb4106f20 msgr2=0x7fbfb419cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:19.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.778+0000 7fbfb89f6640 1 --2- 172.21.15.19:0/3518107055 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbfb4106f20 0x7fbfb419cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.778+0000 7fbfb89f6640 1 -- 172.21.15.19:0/3518107055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfb41027a0 msgr2=0x7fbfb4198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:19.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.778+0000 7fbfb89f6640 1 --2- 172.21.15.19:0/3518107055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfb41027a0 0x7fbfb4198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.778+0000 7fbfb89f6640 1 -- 172.21.15.19:0/3518107055 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfb419d370 con 0x7fbfb4101df0 2024-09-19T08:50:19.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.778+0000 7fbfb91f7640 1 --2- 172.21.15.19:0/3518107055 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbfb4106f20 0x7fbfb419cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:50:19.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.778+0000 7fbfb3fff640 1 --2- 172.21.15.19:0/3518107055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfb41027a0 0x7fbfb4198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:50:19.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.778+0000 7fbfb89f6640 1 --2- 172.21.15.19:0/3518107055 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfb4101df0 0x7fbfb41983c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbfa800e9f0 tx=0x7fbfa800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:19.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.779+0000 7fbfb1ffb640 1 -- 172.21.15.19:0/3518107055 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa800cd80 con 0x7fbfb4101df0 2024-09-19T08:50:19.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.779+0000 7fbfbac5a640 1 -- 172.21.15.19:0/3518107055 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfb419d660 con 0x7fbfb4101df0 2024-09-19T08:50:19.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.779+0000 7fbfb1ffb640 1 -- 172.21.15.19:0/3518107055 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbfa8005500 con 0x7fbfb4101df0 2024-09-19T08:50:19.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.779+0000 7fbfb1ffb640 1 -- 172.21.15.19:0/3518107055 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfa8010690 con 0x7fbfb4101df0 2024-09-19T08:50:19.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.779+0000 7fbfbac5a640 1 -- 172.21.15.19:0/3518107055 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfb41a4f40 con 0x7fbfb4101df0 2024-09-19T08:50:19.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.780+0000 7fbfbac5a640 1 -- 172.21.15.19:0/3518107055 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfb41021d0 con 0x7fbfb4101df0 2024-09-19T08:50:19.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.781+0000 7fbfb1ffb640 1 -- 172.21.15.19:0/3518107055 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fbfa80046c0 con 0x7fbfb4101df0 2024-09-19T08:50:19.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.782+0000 7fbfb1ffb640 1 --2- 172.21.15.19:0/3518107055 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbfa40a3240 0x7fbfa40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:19.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.782+0000 7fbfb3fff640 1 --2- 172.21.15.19:0/3518107055 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbfa40a3240 0x7fbfa40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:19.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.782+0000 7fbfb1ffb640 1 -- 172.21.15.19:0/3518107055 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fbfa80cfdc0 con 0x7fbfb4101df0 2024-09-19T08:50:19.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.782+0000 7fbfb3fff640 1 --2- 172.21.15.19:0/3518107055 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbfa40a3240 0x7fbfa40a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0005e00 tx=0x7fbfa0005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:19.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.786+0000 7fbfb1ffb640 1 -- 172.21.15.19:0/3518107055 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbfa809cb90 con 0x7fbfb4101df0 2024-09-19T08:50:19.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.963+0000 7fbfbac5a640 1 -- 172.21.15.19:0/3518107055 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbfb410a1c0 con 0x7fbfb4101df0 2024-09-19T08:50:19.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.965+0000 7fbfb1ffb640 1 -- 172.21.15.19:0/3518107055 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22276 (secure 0 0 0) 0x7fbfa809c490 con 0x7fbfb4101df0 2024-09-19T08:50:19.969 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:50:19.969 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":80,"fsid":"f26c9d84-7662-11ef-bceb-c7b262605968","created":"2024-09-19T08:42:32.324073+0000","modified":"2024-09-19T08:50:16.477000+0000","last_up_change":"2024-09-19T08:49:24.764960+0000","last_in_change":"2024-09-19T08:49:01.062919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:45:36.232910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:50:12.615884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:50:14.854513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81c7bb06-5b13-4ee0-9290-d779faac1b91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6803","nonce":3397146732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6805","nonce":3397146732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6809","nonce":3397146732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6807","nonce":3397146732}]},"public_addr":"172.21.15.19:6803/3397146732","cluster_addr":"172.21.15.19:6805/3397146732","heartbeat_back_addr":"172.21.15.19:6809/3397146732","heartbeat_front_addr":"172.21.15.19:6807/3397146732","state":["exists","up"]},{"osd":1,"uuid":"24c145e6-5252-4708-8f25-5ce041e8251e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6801","nonce":2011043685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6803","nonce":2011043685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6807","nonce":2011043685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6805","nonce":2011043685}]},"public_addr":"172.21.15.155:6801/2011043685","cluster_addr":"172.21.15.155:6803/2011043685","heartbeat_back_addr":"172.21.15.155:6807/2011043685","heartbeat_front_addr":"172.21.15.155:6805/2011043685","state":["exists","up"]},{"osd":2,"uuid":"99cefd33-0675-495f-8871-2e6fdead0c3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6801","nonce":3358994623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6803","nonce":3358994623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6807","nonce":3358994623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6805","nonce":3358994623}]},"public_addr":"172.21.15.203:6801/3358994623","cluster_addr":"172.21.15.203:6803/3358994623","heartbeat_back_addr":"172.21.15.203:6807/3358994623","heartbeat_front_addr":"172.21.15.203:6805/3358994623","state":["exists","up"]},{"osd":3,"uuid":"8f46c16c-f17e-484a-8b66-6dbf135f34c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6811","nonce":176445576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6813","nonce":176445576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6817","nonce":176445576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6815","nonce":176445576}]},"public_addr":"172.21.15.19:6811/176445576","cluster_addr":"172.21.15.19:6813/176445576","heartbeat_back_addr":"172.21.15.19:6817/176445576","heartbeat_front_addr":"172.21.15.19:6815/176445576","state":["exists","up"]},{"osd":4,"uuid":"411b0423-1317-4e82-bc01-b5f55b391bc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6809","nonce":2163087792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6811","nonce":2163087792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6815","nonce":2163087792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6813","nonce":2163087792}]},"public_addr":"172.21.15.155:6809/2163087792","cluster_addr":"172.21.15.155:6811/2163087792","heartbeat_back_addr":"172.21.15.155:6815/2163087792","heartbeat_front_addr":"172.21.15.155:6813/2163087792","state":["exists","up"]},{"osd":5,"uuid":"057c073e-569f-4c6e-9602-e1169ad4dd8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6809","nonce":334881465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6811","nonce":334881465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6815","nonce":334881465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6813","nonce":334881465}]},"public_addr":"172.21.15.203:6809/334881465","cluster_addr":"172.21.15.203:6811/334881465","heartbeat_back_addr":"172.21.15.203:6815/334881465","heartbeat_front_addr":"172.21.15.203:6813/334881465","state":["exists","up"]},{"osd":6,"uuid":"40418f13-823e-4f94-a427-84781abbcb5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6819","nonce":2669779791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6821","nonce":2669779791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6825","nonce":2669779791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6823","nonce":2669779791}]},"public_addr":"172.21.15.19:6819/2669779791","cluster_addr":"172.21.15.19:6821/2669779791","heartbeat_back_addr":"172.21.15.19:6825/2669779791","heartbeat_front_addr":"172.21.15.19:6823/2669779791","state":["exists","up"]},{"osd":7,"uuid":"ad15f762-aeab-4167-a63d-6c9f9b89b9c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6817","nonce":3169455907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6819","nonce":3169455907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6823","nonce":3169455907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6821","nonce":3169455907}]},"public_addr":"172.21.15.155:6817/3169455907","cluster_addr":"172.21.15.155:6819/3169455907","heartbeat_back_addr":"172.21.15.155:6823/3169455907","heartbeat_front_addr":"172.21.15.155:6821/3169455907","state":["exists","up"]},{"osd":8,"uuid":"23cf8ea2-29d6-43d8-a05b-7822f4bbf254","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6817","nonce":1062999528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6819","nonce":1062999528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6823","nonce":1062999528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6821","nonce":1062999528}]},"public_addr":"172.21.15.203:6817/1062999528","cluster_addr":"172.21.15.203:6819/1062999528","heartbeat_back_addr":"172.21.15.203:6823/1062999528","heartbeat_front_addr":"172.21.15.203:6821/1062999528","state":["exists","up"]},{"osd":9,"uuid":"e851e605-2d17-4fbf-b783-2138133edd06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6827","nonce":574664786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6829","nonce":574664786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6833","nonce":574664786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6831","nonce":574664786}]},"public_addr":"172.21.15.19:6827/574664786","cluster_addr":"172.21.15.19:6829/574664786","heartbeat_back_addr":"172.21.15.19:6833/574664786","heartbeat_front_addr":"172.21.15.19:6831/574664786","state":["exists","up"]},{"osd":10,"uuid":"cc770717-91bd-4494-9103-6db8214b5872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6825","nonce":2242158832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6827","nonce":2242158832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6831","nonce":2242158832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6829","nonce":2242158832}]},"public_addr":"172.21.15.155:6825/2242158832","cluster_addr":"172.21.15.155:6827/2242158832","heartbeat_back_addr":"172.21.15.155:6831/2242158832","heartbeat_front_addr":"172.21.15.155:6829/2242158832","state":["exists","up"]},{"osd":11,"uuid":"6c237db9-5d79-47bc-8ff6-60d09d721d5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6825","nonce":522943955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6827","nonce":522943955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6831","nonce":522943955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6829","nonce":522943955}]},"public_addr":"172.21.15.203:6825/522943955","cluster_addr":"172.21.15.203:6827/522943955","heartbeat_back_addr":"172.21.15.203:6831/522943955","heartbeat_front_addr":"172.21.15.203:6829/522943955","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:44:44.656414+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:09.339183+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:33.245452+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:59.449025+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:46:24.831213+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:46:49.189780+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:47:13.493628+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:47:39.478247+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:05.089875+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:30.722878+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:56.951834+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:22.894678+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6801/4266644067":"2024-09-20T08:43:21.732222+0000","172.21.15.19:0/1398782170":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6800/4266644067":"2024-09-20T08:43:21.732222+0000","172.21.15.19:0/34162461":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6801/1764769529":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/2910961714":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6800/1764769529":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/820792769":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/560203138":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/809642328":"2024-09-20T08:42:56.618773+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:50:19.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.967+0000 7fbfbac5a640 1 -- 172.21.15.19:0/3518107055 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbfa40a3240 msgr2=0x7fbfa40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:19.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.967+0000 7fbfbac5a640 1 --2- 172.21.15.19:0/3518107055 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbfa40a3240 0x7fbfa40a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0005e00 tx=0x7fbfa0005c70 comp rx=0 tx=0).stop 2024-09-19T08:50:19.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.967+0000 7fbfbac5a640 1 -- 172.21.15.19:0/3518107055 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfb4101df0 msgr2=0x7fbfb41983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:19.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.967+0000 7fbfbac5a640 1 --2- 172.21.15.19:0/3518107055 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfb4101df0 0x7fbfb41983c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fbfa800e9f0 tx=0x7fbfa800edf0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.967+0000 7fbfbac5a640 1 -- 172.21.15.19:0/3518107055 shutdown_connections 2024-09-19T08:50:19.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.967+0000 7fbfbac5a640 1 --2- 172.21.15.19:0/3518107055 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbfa40a3240 0x7fbfa40a5700 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.967+0000 7fbfbac5a640 1 --2- 172.21.15.19:0/3518107055 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbfb4106f20 0x7fbfb419cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.967+0000 7fbfbac5a640 1 --2- 172.21.15.19:0/3518107055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbfb41027a0 0x7fbfb4198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.967+0000 7fbfbac5a640 1 --2- 172.21.15.19:0/3518107055 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbfb4101df0 0x7fbfb41983c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:19.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.967+0000 7fbfbac5a640 1 -- 172.21.15.19:0/3518107055 >> 172.21.15.19:0/3518107055 conn(0x7fbfb40fd8b0 msgr2=0x7fbfb40febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:19.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.967+0000 7fbfbac5a640 1 -- 172.21.15.19:0/3518107055 shutdown_connections 2024-09-19T08:50:19.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:19.967+0000 7fbfbac5a640 1 -- 172.21.15.19:0/3518107055 wait complete. 2024-09-19T08:50:20.577 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-19T08:50:20.672 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 08:50:20 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-b[65837]: 2024-09-19T08:50:20.398+0000 7faf3d9d0640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T08:50:20.839 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:21.137 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:20 smithi019 ceph-mon[30976]: pgmap v279: 97 pgs: 67 active+clean, 30 creating+peering; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s wr, 5 op/s 2024-09-19T08:50:21.137 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:20 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3518107055' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:50:21.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:20 smithi155 ceph-mon[34921]: pgmap v279: 97 pgs: 67 active+clean, 30 creating+peering; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s wr, 5 op/s 2024-09-19T08:50:21.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:20 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3518107055' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:50:21.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.224+0000 7fcff1c0e640 1 -- 172.21.15.19:0/3609135591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfec100e20 msgr2=0x7fcfec101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:21.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.224+0000 7fcff1c0e640 1 --2- 172.21.15.19:0/3609135591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfec100e20 0x7fcfec101200 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc009900 tx=0x7fcfdc02a480 comp rx=0 tx=0).stop 2024-09-19T08:50:21.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.224+0000 7fcff1c0e640 1 -- 172.21.15.19:0/3609135591 shutdown_connections 2024-09-19T08:50:21.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.224+0000 7fcff1c0e640 1 --2- 172.21.15.19:0/3609135591 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcfec102570 0x7fcfec1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:21.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.224+0000 7fcff1c0e640 1 --2- 172.21.15.19:0/3609135591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfec102ef0 0x7fcfec10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:21.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.224+0000 7fcff1c0e640 1 --2- 172.21.15.19:0/3609135591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfec100e20 0x7fcfec101200 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:21.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.224+0000 7fcff1c0e640 1 -- 172.21.15.19:0/3609135591 >> 172.21.15.19:0/3609135591 conn(0x7fcfec0fc7d0 msgr2=0x7fcfec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:21.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.224+0000 7fcff1c0e640 1 -- 172.21.15.19:0/3609135591 shutdown_connections 2024-09-19T08:50:21.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.224+0000 7fcff1c0e640 1 -- 172.21.15.19:0/3609135591 wait complete. 2024-09-19T08:50:21.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.225+0000 7fcff1c0e640 1 Processor -- start 2024-09-19T08:50:21.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.225+0000 7fcff1c0e640 1 -- start start 2024-09-19T08:50:21.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.225+0000 7fcff1c0e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfec100e20 0x7fcfec199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:21.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.225+0000 7fcff1c0e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcfec102570 0x7fcfec1998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:21.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.225+0000 7fcff1c0e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfec102ef0 0x7fcfec1a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:21.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.225+0000 7fcff1c0e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcfec110f80 con 0x7fcfec100e20 2024-09-19T08:50:21.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.225+0000 7fcff1c0e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcfec110e00 con 0x7fcfec102ef0 2024-09-19T08:50:21.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.225+0000 7fcff1c0e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcfec111100 con 0x7fcfec102570 2024-09-19T08:50:21.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.225+0000 7fcfeb7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfec100e20 0x7fcfec199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:21.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.226+0000 7fcfeb7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfec100e20 0x7fcfec199360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57486/0 (socket says 172.21.15.19:57486) 2024-09-19T08:50:21.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.226+0000 7fcfeb7fe640 1 -- 172.21.15.19:0/82192979 learned_addr learned my addr 172.21.15.19:0/82192979 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:50:21.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.226+0000 7fcfebfff640 1 --2- 172.21.15.19:0/82192979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfec102ef0 0x7fcfec1a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:21.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.226+0000 7fcfeaffd640 1 --2- 172.21.15.19:0/82192979 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcfec102570 0x7fcfec1998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:21.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.226+0000 7fcfeb7fe640 1 -- 172.21.15.19:0/82192979 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcfec102570 msgr2=0x7fcfec1998a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:21.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.226+0000 7fcfeb7fe640 1 --2- 172.21.15.19:0/82192979 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcfec102570 0x7fcfec1998a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:21.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.226+0000 7fcfeb7fe640 1 -- 172.21.15.19:0/82192979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfec102ef0 msgr2=0x7fcfec1a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:21.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.226+0000 7fcfeb7fe640 1 --2- 172.21.15.19:0/82192979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfec102ef0 0x7fcfec1a43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:21.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.226+0000 7fcfeb7fe640 1 -- 172.21.15.19:0/82192979 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfec1a4920 con 0x7fcfec100e20 2024-09-19T08:50:21.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.226+0000 7fcfeb7fe640 1 --2- 172.21.15.19:0/82192979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfec100e20 0x7fcfec199360 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc006010 tx=0x7fcfdc003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:21.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.226+0000 7fcfe8ff9640 1 -- 172.21.15.19:0/82192979 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc03f070 con 0x7fcfec100e20 2024-09-19T08:50:21.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.226+0000 7fcff1c0e640 1 -- 172.21.15.19:0/82192979 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfec1a4af0 con 0x7fcfec100e20 2024-09-19T08:50:21.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.226+0000 7fcfe8ff9640 1 -- 172.21.15.19:0/82192979 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfdc031c30 con 0x7fcfec100e20 2024-09-19T08:50:21.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.226+0000 7fcfe8ff9640 1 -- 172.21.15.19:0/82192979 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc035030 con 0x7fcfec100e20 2024-09-19T08:50:21.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.226+0000 7fcff1c0e640 1 -- 172.21.15.19:0/82192979 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfec1a4fa0 con 0x7fcfec100e20 2024-09-19T08:50:21.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.228+0000 7fcff1c0e640 1 -- 172.21.15.19:0/82192979 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfec101200 con 0x7fcfec100e20 2024-09-19T08:50:21.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.229+0000 7fcfe8ff9640 1 -- 172.21.15.19:0/82192979 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fcfdc042070 con 0x7fcfec100e20 2024-09-19T08:50:21.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:20 smithi203 ceph-mon[35450]: pgmap v279: 97 pgs: 67 active+clean, 30 creating+peering; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s wr, 5 op/s 2024-09-19T08:50:21.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:20 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3518107055' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:50:21.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.229+0000 7fcfe8ff9640 1 --2- 172.21.15.19:0/82192979 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fcfd40a32c0 0x7fcfd40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:21.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.229+0000 7fcfeaffd640 1 --2- 172.21.15.19:0/82192979 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fcfd40a32c0 0x7fcfd40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:21.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.229+0000 7fcfe8ff9640 1 -- 172.21.15.19:0/82192979 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fcfdc0effc0 con 0x7fcfec100e20 2024-09-19T08:50:21.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.230+0000 7fcfeaffd640 1 --2- 172.21.15.19:0/82192979 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fcfd40a32c0 0x7fcfd40a5780 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0005fd0 tx=0x7fcfe0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:21.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.234+0000 7fcfe8ff9640 1 -- 172.21.15.19:0/82192979 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcfdc031de0 con 0x7fcfec100e20 2024-09-19T08:50:21.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.450+0000 7fcff1c0e640 1 -- 172.21.15.19:0/82192979 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fcfec109090 con 0x7fcfec100e20 2024-09-19T08:50:21.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.891+0000 7fcfe8ff9640 1 -- 172.21.15.19:0/82192979 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fcfdc0bce10 con 0x7fcfec100e20 2024-09-19T08:50:21.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.894+0000 7fcff1c0e640 1 -- 172.21.15.19:0/82192979 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fcfd40a32c0 msgr2=0x7fcfd40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:21.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.894+0000 7fcff1c0e640 1 --2- 172.21.15.19:0/82192979 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fcfd40a32c0 0x7fcfd40a5780 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0005fd0 tx=0x7fcfe0005850 comp rx=0 tx=0).stop 2024-09-19T08:50:21.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.894+0000 7fcff1c0e640 1 -- 172.21.15.19:0/82192979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfec100e20 msgr2=0x7fcfec199360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:21.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.894+0000 7fcff1c0e640 1 --2- 172.21.15.19:0/82192979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfec100e20 0x7fcfec199360 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc006010 tx=0x7fcfdc003c10 comp rx=0 tx=0).stop 2024-09-19T08:50:21.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.894+0000 7fcff1c0e640 1 -- 172.21.15.19:0/82192979 shutdown_connections 2024-09-19T08:50:21.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.894+0000 7fcff1c0e640 1 --2- 172.21.15.19:0/82192979 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fcfd40a32c0 0x7fcfd40a5780 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:21.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.894+0000 7fcff1c0e640 1 --2- 172.21.15.19:0/82192979 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcfec102570 0x7fcfec1998a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:21.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.894+0000 7fcff1c0e640 1 --2- 172.21.15.19:0/82192979 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfec102ef0 0x7fcfec1a43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:21.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.894+0000 7fcff1c0e640 1 --2- 172.21.15.19:0/82192979 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfec100e20 0x7fcfec199360 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:21.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.894+0000 7fcff1c0e640 1 -- 172.21.15.19:0/82192979 >> 172.21.15.19:0/82192979 conn(0x7fcfec0fc7d0 msgr2=0x7fcfec0fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:21.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.894+0000 7fcff1c0e640 1 -- 172.21.15.19:0/82192979 shutdown_connections 2024-09-19T08:50:21.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:21.894+0000 7fcff1c0e640 1 -- 172.21.15.19:0/82192979 wait complete. 2024-09-19T08:50:22.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:21 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/82192979' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T08:50:22.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:21 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/82192979' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T08:50:22.265 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:21 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/82192979' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T08:50:22.594 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-09-19T08:50:22.594 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-09-19T08:50:22.852 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:23.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:22 smithi155 ceph-mon[34921]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-19T08:50:23.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:22 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/82192979' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T08:50:23.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:22 smithi155 ceph-mon[34921]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:50:23.190 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:22 smithi019 ceph-mon[30976]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-19T08:50:23.190 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:22 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/82192979' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T08:50:23.190 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:22 smithi019 ceph-mon[30976]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:50:23.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:22 smithi203 ceph-mon[35450]: pgmap v280: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-19T08:50:23.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:22 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/82192979' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T08:50:23.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:22 smithi203 ceph-mon[35450]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:50:23.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.275+0000 7f0447af8640 1 -- 172.21.15.19:0/1480750011 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0440106f10 msgr2=0x7f044010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:23.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.275+0000 7f0447af8640 1 --2- 172.21.15.19:0/1480750011 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0440106f10 0x7f044010ea90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0438009ca0 tx=0x7f043802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.275+0000 7f0447af8640 1 -- 172.21.15.19:0/1480750011 shutdown_connections 2024-09-19T08:50:23.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.275+0000 7f0447af8640 1 --2- 172.21.15.19:0/1480750011 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0440102790 0x7f04401067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.275+0000 7f0447af8640 1 --2- 172.21.15.19:0/1480750011 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0440106f10 0x7f044010ea90 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.275+0000 7f0447af8640 1 --2- 172.21.15.19:0/1480750011 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0440101de0 0x7f04401021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.275+0000 7f0447af8640 1 -- 172.21.15.19:0/1480750011 >> 172.21.15.19:0/1480750011 conn(0x7f04400fd8c0 msgr2=0x7f04400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:23.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.275+0000 7f0447af8640 1 -- 172.21.15.19:0/1480750011 shutdown_connections 2024-09-19T08:50:23.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.275+0000 7f0447af8640 1 -- 172.21.15.19:0/1480750011 wait complete. 2024-09-19T08:50:23.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.276+0000 7f0447af8640 1 Processor -- start 2024-09-19T08:50:23.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.276+0000 7f0447af8640 1 -- start start 2024-09-19T08:50:23.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.276+0000 7f0447af8640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0440101de0 0x7f04400744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:23.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.276+0000 7f0447af8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0440102790 0x7f0440074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:23.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.276+0000 7f0447af8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0440106f10 0x7f0440074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:23.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.276+0000 7f0447af8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0440111f90 con 0x7f0440102790 2024-09-19T08:50:23.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.276+0000 7f0447af8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0440111e10 con 0x7f0440106f10 2024-09-19T08:50:23.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.276+0000 7f0447af8640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0440112110 con 0x7f0440101de0 2024-09-19T08:50:23.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.276+0000 7f0445093640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0440102790 0x7f0440074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:23.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.276+0000 7f0445093640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0440102790 0x7f0440074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57504/0 (socket says 172.21.15.19:57504) 2024-09-19T08:50:23.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.276+0000 7f0445093640 1 -- 172.21.15.19:0/4048303092 learned_addr learned my addr 172.21.15.19:0/4048303092 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:50:23.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.276+0000 7f0446095640 1 --2- 172.21.15.19:0/4048303092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0440106f10 0x7f0440074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:23.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.276+0000 7f0445894640 1 --2- 172.21.15.19:0/4048303092 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0440101de0 0x7f04400744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:23.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.277+0000 7f0445093640 1 -- 172.21.15.19:0/4048303092 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0440101de0 msgr2=0x7f04400744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:23.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.277+0000 7f0445093640 1 --2- 172.21.15.19:0/4048303092 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0440101de0 0x7f04400744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.277+0000 7f0445093640 1 -- 172.21.15.19:0/4048303092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0440106f10 msgr2=0x7f0440074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:23.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.277+0000 7f0445093640 1 --2- 172.21.15.19:0/4048303092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0440106f10 0x7f0440074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.277+0000 7f0445093640 1 -- 172.21.15.19:0/4048303092 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04401a6930 con 0x7f0440102790 2024-09-19T08:50:23.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.277+0000 7f0445093640 1 --2- 172.21.15.19:0/4048303092 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0440102790 0x7f0440074a30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f043000b4a0 tx=0x7f043000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:23.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.277+0000 7f0436ffd640 1 -- 172.21.15.19:0/4048303092 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0430014070 con 0x7f0440102790 2024-09-19T08:50:23.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.277+0000 7f0447af8640 1 -- 172.21.15.19:0/4048303092 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04401a6c20 con 0x7f0440102790 2024-09-19T08:50:23.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.277+0000 7f0436ffd640 1 -- 172.21.15.19:0/4048303092 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0430010af0 con 0x7f0440102790 2024-09-19T08:50:23.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.277+0000 7f0436ffd640 1 -- 172.21.15.19:0/4048303092 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0430017d10 con 0x7f0440102790 2024-09-19T08:50:23.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.277+0000 7f0447af8640 1 -- 172.21.15.19:0/4048303092 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04401a71b0 con 0x7f0440102790 2024-09-19T08:50:23.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.278+0000 7f0447af8640 1 -- 172.21.15.19:0/4048303092 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04401021c0 con 0x7f0440102790 2024-09-19T08:50:23.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.279+0000 7f0436ffd640 1 -- 172.21.15.19:0/4048303092 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f0430017070 con 0x7f0440102790 2024-09-19T08:50:23.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.280+0000 7f0436ffd640 1 --2- 172.21.15.19:0/4048303092 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f042c0a3240 0x7f042c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:23.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.280+0000 7f0445894640 1 --2- 172.21.15.19:0/4048303092 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f042c0a3240 0x7f042c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:23.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.280+0000 7f0436ffd640 1 -- 172.21.15.19:0/4048303092 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f04300cefd0 con 0x7f0440102790 2024-09-19T08:50:23.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.281+0000 7f0445894640 1 --2- 172.21.15.19:0/4048303092 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f042c0a3240 0x7f042c0a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f043c0058c0 tx=0x7f043c00a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:23.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.283+0000 7f0436ffd640 1 -- 172.21.15.19:0/4048303092 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f043009bda0 con 0x7f0440102790 2024-09-19T08:50:23.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.495+0000 7f0447af8640 1 -- 172.21.15.19:0/4048303092 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f044002d7c0 con 0x7f0440102790 2024-09-19T08:50:23.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.898+0000 7f0436ffd640 1 -- 172.21.15.19:0/4048303092 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f043009b6a0 con 0x7f0440102790 2024-09-19T08:50:23.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.900+0000 7f0447af8640 1 -- 172.21.15.19:0/4048303092 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f042c0a3240 msgr2=0x7f042c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:23.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.900+0000 7f0447af8640 1 --2- 172.21.15.19:0/4048303092 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f042c0a3240 0x7f042c0a5700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f043c0058c0 tx=0x7f043c00a4c0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.900+0000 7f0447af8640 1 -- 172.21.15.19:0/4048303092 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0440102790 msgr2=0x7f0440074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:23.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.900+0000 7f0447af8640 1 --2- 172.21.15.19:0/4048303092 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0440102790 0x7f0440074a30 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f043000b4a0 tx=0x7f043000b960 comp rx=0 tx=0).stop 2024-09-19T08:50:23.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.900+0000 7f0447af8640 1 -- 172.21.15.19:0/4048303092 shutdown_connections 2024-09-19T08:50:23.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.900+0000 7f0447af8640 1 --2- 172.21.15.19:0/4048303092 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f042c0a3240 0x7f042c0a5700 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.900+0000 7f0447af8640 1 --2- 172.21.15.19:0/4048303092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0440106f10 0x7f0440074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.900+0000 7f0447af8640 1 --2- 172.21.15.19:0/4048303092 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0440102790 0x7f0440074a30 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.900+0000 7f0447af8640 1 --2- 172.21.15.19:0/4048303092 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0440101de0 0x7f04400744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:23.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.900+0000 7f0447af8640 1 -- 172.21.15.19:0/4048303092 >> 172.21.15.19:0/4048303092 conn(0x7f04400fd8c0 msgr2=0x7f04400fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:23.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.901+0000 7f0447af8640 1 -- 172.21.15.19:0/4048303092 shutdown_connections 2024-09-19T08:50:23.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:23.901+0000 7f0447af8640 1 -- 172.21.15.19:0/4048303092 wait complete. 2024-09-19T08:50:24.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:23 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/4048303092' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-19T08:50:24.227 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:23 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/4048303092' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-19T08:50:24.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:23 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/4048303092' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-09-19T08:50:24.622 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-19T08:50:24.887 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:25.168 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:24 smithi019 ceph-mon[30976]: pgmap v281: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T08:50:25.168 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:24 smithi019 ceph-mon[30976]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T08:50:25.168 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:24 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/4048303092' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-19T08:50:25.168 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:24 smithi019 ceph-mon[30976]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T08:50:25.168 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:24 smithi019 ceph-mon[30976]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:50:25.169 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:24 smithi019 ceph-mon[30976]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-19T08:50:25.169 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:24 smithi019 ceph-mon[30976]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-19T08:50:25.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:24 smithi155 ceph-mon[34921]: pgmap v281: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T08:50:25.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:24 smithi155 ceph-mon[34921]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T08:50:25.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:24 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/4048303092' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-19T08:50:25.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:24 smithi155 ceph-mon[34921]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T08:50:25.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:24 smithi155 ceph-mon[34921]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:50:25.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:24 smithi155 ceph-mon[34921]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-19T08:50:25.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:24 smithi155 ceph-mon[34921]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-19T08:50:25.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:24 smithi203 ceph-mon[35450]: pgmap v281: 97 pgs: 97 active+clean; 579 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T08:50:25.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:24 smithi203 ceph-mon[35450]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T08:50:25.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:24 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/4048303092' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-19T08:50:25.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:24 smithi203 ceph-mon[35450]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T08:50:25.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:24 smithi203 ceph-mon[35450]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T08:50:25.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:24 smithi203 ceph-mon[35450]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-19T08:50:25.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:24 smithi203 ceph-mon[35450]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-19T08:50:25.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.365+0000 7f98347ac640 1 -- 172.21.15.19:0/690524972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f982c101de0 msgr2=0x7f982c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:25.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.365+0000 7f98347ac640 1 --2- 172.21.15.19:0/690524972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f982c101de0 0x7f982c1021c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9828009900 tx=0x7f982802a410 comp rx=0 tx=0).stop 2024-09-19T08:50:25.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.365+0000 7f98347ac640 1 -- 172.21.15.19:0/690524972 shutdown_connections 2024-09-19T08:50:25.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.365+0000 7f98347ac640 1 --2- 172.21.15.19:0/690524972 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f982c102790 0x7f982c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:25.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.365+0000 7f98347ac640 1 --2- 172.21.15.19:0/690524972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f982c106f10 0x7f982c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:25.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.365+0000 7f98347ac640 1 --2- 172.21.15.19:0/690524972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f982c101de0 0x7f982c1021c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:25.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.365+0000 7f98347ac640 1 -- 172.21.15.19:0/690524972 >> 172.21.15.19:0/690524972 conn(0x7f982c0fd8c0 msgr2=0x7f982c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:25.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.366+0000 7f98347ac640 1 -- 172.21.15.19:0/690524972 shutdown_connections 2024-09-19T08:50:25.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.366+0000 7f98347ac640 1 -- 172.21.15.19:0/690524972 wait complete. 2024-09-19T08:50:25.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.366+0000 7f98347ac640 1 Processor -- start 2024-09-19T08:50:25.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.366+0000 7f98347ac640 1 -- start start 2024-09-19T08:50:25.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.366+0000 7f98347ac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f982c101de0 0x7f982c198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:25.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.366+0000 7f98347ac640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f982c102790 0x7f982c1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:25.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.366+0000 7f98347ac640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f982c106f10 0x7f982c19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:25.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.367+0000 7f98347ac640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f982c111f90 con 0x7f982c101de0 2024-09-19T08:50:25.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.367+0000 7f98347ac640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f982c111e10 con 0x7f982c106f10 2024-09-19T08:50:25.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.367+0000 7f98347ac640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f982c112110 con 0x7f982c102790 2024-09-19T08:50:25.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.367+0000 7f9832548640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f982c101de0 0x7f982c198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:25.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.367+0000 7f9832548640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f982c101de0 0x7f982c198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54304/0 (socket says 172.21.15.19:54304) 2024-09-19T08:50:25.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.367+0000 7f9832548640 1 -- 172.21.15.19:0/1470941119 learned_addr learned my addr 172.21.15.19:0/1470941119 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:50:25.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.367+0000 7f9831d47640 1 --2- 172.21.15.19:0/1470941119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f982c102790 0x7f982c1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:25.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.367+0000 7f9832d49640 1 --2- 172.21.15.19:0/1470941119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f982c106f10 0x7f982c19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:25.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.367+0000 7f9832548640 1 -- 172.21.15.19:0/1470941119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f982c102790 msgr2=0x7f982c1989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:25.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.367+0000 7f9832548640 1 --2- 172.21.15.19:0/1470941119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f982c102790 0x7f982c1989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:25.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.367+0000 7f9832548640 1 -- 172.21.15.19:0/1470941119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f982c106f10 msgr2=0x7f982c19cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:25.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.367+0000 7f9832548640 1 --2- 172.21.15.19:0/1470941119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f982c106f10 0x7f982c19cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:25.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.367+0000 7f9832548640 1 -- 172.21.15.19:0/1470941119 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f982c19d440 con 0x7f982c101de0 2024-09-19T08:50:25.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.367+0000 7f9832548640 1 --2- 172.21.15.19:0/1470941119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f982c101de0 0x7f982c198490 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9828006010 tx=0x7f98280042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:25.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.367+0000 7f98237fe640 1 -- 172.21.15.19:0/1470941119 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982803f030 con 0x7f982c101de0 2024-09-19T08:50:25.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.367+0000 7f98237fe640 1 -- 172.21.15.19:0/1470941119 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9828003ce0 con 0x7f982c101de0 2024-09-19T08:50:25.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.367+0000 7f98347ac640 1 -- 172.21.15.19:0/1470941119 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f982c19d6d0 con 0x7f982c101de0 2024-09-19T08:50:25.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.367+0000 7f98237fe640 1 -- 172.21.15.19:0/1470941119 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9828035070 con 0x7f982c101de0 2024-09-19T08:50:25.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.367+0000 7f98347ac640 1 -- 172.21.15.19:0/1470941119 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f982c1a5010 con 0x7f982c101de0 2024-09-19T08:50:25.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.368+0000 7f98347ac640 1 -- 172.21.15.19:0/1470941119 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f982c1032c0 con 0x7f982c101de0 2024-09-19T08:50:25.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.370+0000 7f98237fe640 1 -- 172.21.15.19:0/1470941119 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f9828042030 con 0x7f982c101de0 2024-09-19T08:50:25.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.370+0000 7f98237fe640 1 --2- 172.21.15.19:0/1470941119 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f98180a3240 0x7f98180a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:25.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.370+0000 7f98237fe640 1 -- 172.21.15.19:0/1470941119 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f98280efe10 con 0x7f982c101de0 2024-09-19T08:50:25.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.370+0000 7f9831d47640 1 --2- 172.21.15.19:0/1470941119 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f98180a3240 0x7f98180a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:25.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.371+0000 7f9831d47640 1 --2- 172.21.15.19:0/1470941119 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f98180a3240 0x7f98180a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f982c0fdd50 tx=0x7f981c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:25.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.374+0000 7f98237fe640 1 -- 172.21.15.19:0/1470941119 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f98280bcc80 con 0x7f982c101de0 2024-09-19T08:50:25.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.587+0000 7f98347ac640 1 -- 172.21.15.19:0/1470941119 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f982c10a0f0 con 0x7f982c101de0 2024-09-19T08:50:25.673 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 08:50:25 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-b[65837]: 2024-09-19T08:50:25.399+0000 7faf3d9d0640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-19T08:50:25.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.917+0000 7f98237fe640 1 -- 172.21.15.19:0/1470941119 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v22) ==== 121+0+0 (secure 0 0 0) 0x7f98280bc580 con 0x7f982c101de0 2024-09-19T08:50:25.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.919+0000 7f98347ac640 1 -- 172.21.15.19:0/1470941119 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f98180a3240 msgr2=0x7f98180a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:25.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.919+0000 7f98347ac640 1 --2- 172.21.15.19:0/1470941119 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f98180a3240 0x7f98180a5700 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f982c0fdd50 tx=0x7f981c009110 comp rx=0 tx=0).stop 2024-09-19T08:50:25.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.919+0000 7f98347ac640 1 -- 172.21.15.19:0/1470941119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f982c101de0 msgr2=0x7f982c198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:25.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.919+0000 7f98347ac640 1 --2- 172.21.15.19:0/1470941119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f982c101de0 0x7f982c198490 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9828006010 tx=0x7f98280042f0 comp rx=0 tx=0).stop 2024-09-19T08:50:25.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.919+0000 7f98347ac640 1 -- 172.21.15.19:0/1470941119 shutdown_connections 2024-09-19T08:50:25.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.919+0000 7f98347ac640 1 --2- 172.21.15.19:0/1470941119 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f98180a3240 0x7f98180a5700 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:25.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.919+0000 7f98347ac640 1 --2- 172.21.15.19:0/1470941119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f982c102790 0x7f982c1989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:25.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.919+0000 7f98347ac640 1 --2- 172.21.15.19:0/1470941119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f982c106f10 0x7f982c19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:25.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.919+0000 7f98347ac640 1 --2- 172.21.15.19:0/1470941119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f982c101de0 0x7f982c198490 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:25.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.919+0000 7f98347ac640 1 -- 172.21.15.19:0/1470941119 >> 172.21.15.19:0/1470941119 conn(0x7f982c0fd8c0 msgr2=0x7f982c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:25.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.919+0000 7f98347ac640 1 -- 172.21.15.19:0/1470941119 shutdown_connections 2024-09-19T08:50:25.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:25.919+0000 7f98347ac640 1 -- 172.21.15.19:0/1470941119 wait complete. 2024-09-19T08:50:26.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:25 smithi155 ceph-mon[34921]: mds.? [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] up:active 2024-09-19T08:50:26.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:25 smithi155 ceph-mon[34921]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T08:50:26.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:25 smithi155 ceph-mon[34921]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-19T08:50:26.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:25 smithi155 ceph-mon[34921]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-19T08:50:26.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:25 smithi155 ceph-mon[34921]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-19T08:50:26.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:25 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1470941119' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T08:50:26.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:25 smithi203 ceph-mon[35450]: mds.? [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] up:active 2024-09-19T08:50:26.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:25 smithi203 ceph-mon[35450]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T08:50:26.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:25 smithi203 ceph-mon[35450]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-19T08:50:26.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:25 smithi203 ceph-mon[35450]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-19T08:50:26.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:25 smithi203 ceph-mon[35450]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-19T08:50:26.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:25 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1470941119' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T08:50:26.293 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:25 smithi019 ceph-mon[30976]: mds.? [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] up:active 2024-09-19T08:50:26.293 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:25 smithi019 ceph-mon[30976]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T08:50:26.293 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:25 smithi019 ceph-mon[30976]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-19T08:50:26.293 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:25 smithi019 ceph-mon[30976]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-09-19T08:50:26.293 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:25 smithi019 ceph-mon[30976]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-09-19T08:50:26.294 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:25 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1470941119' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T08:50:26.645 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-19T08:50:26.907 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:27.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:26 smithi155 ceph-mon[34921]: pgmap v282: 97 pgs: 97 active+clean; 581 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 7 op/s 2024-09-19T08:50:27.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:26 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1470941119' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T08:50:27.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:26 smithi155 ceph-mon[34921]: mds.? [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] up:active 2024-09-19T08:50:27.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:26 smithi155 ceph-mon[34921]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-19T08:50:27.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:26 smithi155 ceph-mon[34921]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-19T08:50:27.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:26 smithi155 ceph-mon[34921]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:creating} 8 up:standby 2024-09-19T08:50:27.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:26 smithi155 ceph-mon[34921]: daemon mds.h is now active in filesystem cephfs as rank 3 2024-09-19T08:50:27.175 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:26 smithi019 ceph-mon[30976]: pgmap v282: 97 pgs: 97 active+clean; 581 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 7 op/s 2024-09-19T08:50:27.175 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:26 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1470941119' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T08:50:27.175 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:26 smithi019 ceph-mon[30976]: mds.? [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] up:active 2024-09-19T08:50:27.175 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:26 smithi019 ceph-mon[30976]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-19T08:50:27.175 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:26 smithi019 ceph-mon[30976]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-19T08:50:27.175 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:26 smithi019 ceph-mon[30976]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:creating} 8 up:standby 2024-09-19T08:50:27.176 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:26 smithi019 ceph-mon[30976]: daemon mds.h is now active in filesystem cephfs as rank 3 2024-09-19T08:50:27.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:26 smithi203 ceph-mon[35450]: pgmap v282: 97 pgs: 97 active+clean; 581 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s wr, 7 op/s 2024-09-19T08:50:27.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:26 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1470941119' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T08:50:27.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:26 smithi203 ceph-mon[35450]: mds.? [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] up:active 2024-09-19T08:50:27.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:26 smithi203 ceph-mon[35450]: daemon mds.h assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-19T08:50:27.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:26 smithi203 ceph-mon[35450]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-09-19T08:50:27.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:26 smithi203 ceph-mon[35450]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:creating} 8 up:standby 2024-09-19T08:50:27.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:26 smithi203 ceph-mon[35450]: daemon mds.h is now active in filesystem cephfs as rank 3 2024-09-19T08:50:27.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.385+0000 7f16d0fe6640 1 -- 172.21.15.19:0/3904494584 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16cc106a80 msgr2=0x7f16cc106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:27.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.385+0000 7f16d0fe6640 1 --2- 172.21.15.19:0/3904494584 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16cc106a80 0x7f16cc106e60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009930 tx=0x7f16bc02a420 comp rx=0 tx=0).stop 2024-09-19T08:50:27.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.385+0000 7f16d0fe6640 1 -- 172.21.15.19:0/3904494584 shutdown_connections 2024-09-19T08:50:27.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.385+0000 7f16d0fe6640 1 --2- 172.21.15.19:0/3904494584 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16cc101420 0x7f16cc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:27.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.385+0000 7f16d0fe6640 1 --2- 172.21.15.19:0/3904494584 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16cc100a80 0x7f16cc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:27.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.385+0000 7f16d0fe6640 1 --2- 172.21.15.19:0/3904494584 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16cc106a80 0x7f16cc106e60 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:27.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.385+0000 7f16d0fe6640 1 -- 172.21.15.19:0/3904494584 >> 172.21.15.19:0/3904494584 conn(0x7f16cc0fc7a0 msgr2=0x7f16cc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:27.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.385+0000 7f16d0fe6640 1 -- 172.21.15.19:0/3904494584 shutdown_connections 2024-09-19T08:50:27.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.385+0000 7f16d0fe6640 1 -- 172.21.15.19:0/3904494584 wait complete. 2024-09-19T08:50:27.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.386+0000 7f16d0fe6640 1 Processor -- start 2024-09-19T08:50:27.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.386+0000 7f16d0fe6640 1 -- start start 2024-09-19T08:50:27.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.386+0000 7f16d0fe6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16cc100a80 0x7f16cc1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:27.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.386+0000 7f16d0fe6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16cc101420 0x7f16cc1997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:27.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.386+0000 7f16d0fe6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16cc106a80 0x7f16cc1a4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:27.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.386+0000 7f16d0fe6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f16cc110e80 con 0x7f16cc100a80 2024-09-19T08:50:27.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.386+0000 7f16d0fe6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f16cc110d00 con 0x7f16cc106a80 2024-09-19T08:50:27.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.386+0000 7f16d0fe6640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f16cc111000 con 0x7f16cc101420 2024-09-19T08:50:27.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.386+0000 7f16ca59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16cc100a80 0x7f16cc1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:27.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.386+0000 7f16ca59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16cc100a80 0x7f16cc1992b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54312/0 (socket says 172.21.15.19:54312) 2024-09-19T08:50:27.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.386+0000 7f16ca59c640 1 -- 172.21.15.19:0/230295399 learned_addr learned my addr 172.21.15.19:0/230295399 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:50:27.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.386+0000 7f16cad9d640 1 --2- 172.21.15.19:0/230295399 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16cc106a80 0x7f16cc1a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:27.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.386+0000 7f16c9d9b640 1 --2- 172.21.15.19:0/230295399 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16cc101420 0x7f16cc1997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:27.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.387+0000 7f16ca59c640 1 -- 172.21.15.19:0/230295399 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16cc101420 msgr2=0x7f16cc1997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:27.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.387+0000 7f16ca59c640 1 --2- 172.21.15.19:0/230295399 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16cc101420 0x7f16cc1997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:27.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.387+0000 7f16ca59c640 1 -- 172.21.15.19:0/230295399 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16cc106a80 msgr2=0x7f16cc1a4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:27.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.387+0000 7f16ca59c640 1 --2- 172.21.15.19:0/230295399 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16cc106a80 0x7f16cc1a4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:27.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.387+0000 7f16ca59c640 1 -- 172.21.15.19:0/230295399 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16cc1a4870 con 0x7f16cc100a80 2024-09-19T08:50:27.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.387+0000 7f16cad9d640 1 --2- 172.21.15.19:0/230295399 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16cc106a80 0x7f16cc1a4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:50:27.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.387+0000 7f16ca59c640 1 --2- 172.21.15.19:0/230295399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16cc100a80 0x7f16cc1992b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009a50 tx=0x7f16bc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:27.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.387+0000 7f16bb7fe640 1 -- 172.21.15.19:0/230295399 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc03f030 con 0x7f16cc100a80 2024-09-19T08:50:27.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.387+0000 7f16bb7fe640 1 -- 172.21.15.19:0/230295399 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f16bc003ce0 con 0x7f16cc100a80 2024-09-19T08:50:27.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.387+0000 7f16d0fe6640 1 -- 172.21.15.19:0/230295399 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16cc1a4a40 con 0x7f16cc100a80 2024-09-19T08:50:27.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.387+0000 7f16bb7fe640 1 -- 172.21.15.19:0/230295399 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc035070 con 0x7f16cc100a80 2024-09-19T08:50:27.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.387+0000 7f16d0fe6640 1 -- 172.21.15.19:0/230295399 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16cc1a4e90 con 0x7f16cc100a80 2024-09-19T08:50:27.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.388+0000 7f16d0fe6640 1 -- 172.21.15.19:0/230295399 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16cc100ee0 con 0x7f16cc100a80 2024-09-19T08:50:27.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.389+0000 7f16bb7fe640 1 -- 172.21.15.19:0/230295399 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f16bc042030 con 0x7f16cc100a80 2024-09-19T08:50:27.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.390+0000 7f16bb7fe640 1 --2- 172.21.15.19:0/230295399 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f16b40a3240 0x7f16b40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:27.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.390+0000 7f16c9d9b640 1 --2- 172.21.15.19:0/230295399 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f16b40a3240 0x7f16b40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:27.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.390+0000 7f16bb7fe640 1 -- 172.21.15.19:0/230295399 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f16bc0efea0 con 0x7f16cc100a80 2024-09-19T08:50:27.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.390+0000 7f16c9d9b640 1 --2- 172.21.15.19:0/230295399 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f16b40a3240 0x7f16b40a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f16cc06b2e0 tx=0x7f16c000a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:27.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.394+0000 7f16bb7fe640 1 -- 172.21.15.19:0/230295399 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f16bc0bcc70 con 0x7f16cc100a80 2024-09-19T08:50:27.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.608+0000 7f16d0fe6640 1 -- 172.21.15.19:0/230295399 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f16cc108ff0 con 0x7f16cc100a80 2024-09-19T08:50:27.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.934+0000 7f16bb7fe640 1 -- 172.21.15.19:0/230295399 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v26) ==== 115+0+0 (secure 0 0 0) 0x7f16bc0dc0b0 con 0x7f16cc100a80 2024-09-19T08:50:27.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.936+0000 7f16d0fe6640 1 -- 172.21.15.19:0/230295399 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f16b40a3240 msgr2=0x7f16b40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:27.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.936+0000 7f16d0fe6640 1 --2- 172.21.15.19:0/230295399 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f16b40a3240 0x7f16b40a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f16cc06b2e0 tx=0x7f16c000a4c0 comp rx=0 tx=0).stop 2024-09-19T08:50:27.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.936+0000 7f16d0fe6640 1 -- 172.21.15.19:0/230295399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16cc100a80 msgr2=0x7f16cc1992b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:27.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.936+0000 7f16d0fe6640 1 --2- 172.21.15.19:0/230295399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16cc100a80 0x7f16cc1992b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009a50 tx=0x7f16bc004270 comp rx=0 tx=0).stop 2024-09-19T08:50:27.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.937+0000 7f16d0fe6640 1 -- 172.21.15.19:0/230295399 shutdown_connections 2024-09-19T08:50:27.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.937+0000 7f16d0fe6640 1 --2- 172.21.15.19:0/230295399 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f16b40a3240 0x7f16b40a5700 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:27.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.937+0000 7f16d0fe6640 1 --2- 172.21.15.19:0/230295399 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16cc101420 0x7f16cc1997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:27.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.937+0000 7f16d0fe6640 1 --2- 172.21.15.19:0/230295399 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f16cc106a80 0x7f16cc1a4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:27.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.937+0000 7f16d0fe6640 1 --2- 172.21.15.19:0/230295399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f16cc100a80 0x7f16cc1992b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:27.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.937+0000 7f16d0fe6640 1 -- 172.21.15.19:0/230295399 >> 172.21.15.19:0/230295399 conn(0x7f16cc0fc7a0 msgr2=0x7f16cc0fe050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:27.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.937+0000 7f16d0fe6640 1 -- 172.21.15.19:0/230295399 shutdown_connections 2024-09-19T08:50:27.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:27.937+0000 7f16d0fe6640 1 -- 172.21.15.19:0/230295399 wait complete. 2024-09-19T08:50:28.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:27 smithi203 ceph-mon[35450]: mds.? [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] up:active 2024-09-19T08:50:28.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:27 smithi203 ceph-mon[35450]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-19T08:50:28.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:27 smithi203 ceph-mon[35450]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T08:50:28.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:27 smithi203 ceph-mon[35450]: Cluster is now healthy 2024-09-19T08:50:28.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:27 smithi203 ceph-mon[35450]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:active} 8 up:standby 2024-09-19T08:50:28.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:27 smithi203 ceph-mon[35450]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-19T08:50:28.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:27 smithi203 ceph-mon[35450]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-19T08:50:28.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:27 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/230295399' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T08:50:28.245 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:27 smithi019 ceph-mon[30976]: mds.? [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] up:active 2024-09-19T08:50:28.245 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:27 smithi019 ceph-mon[30976]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-19T08:50:28.245 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:27 smithi019 ceph-mon[30976]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T08:50:28.245 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:27 smithi019 ceph-mon[30976]: Cluster is now healthy 2024-09-19T08:50:28.245 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:27 smithi019 ceph-mon[30976]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:active} 8 up:standby 2024-09-19T08:50:28.245 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:27 smithi019 ceph-mon[30976]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-19T08:50:28.245 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:27 smithi019 ceph-mon[30976]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-19T08:50:28.245 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:27 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/230295399' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T08:50:28.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:27 smithi155 ceph-mon[34921]: mds.? [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] up:active 2024-09-19T08:50:28.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:27 smithi155 ceph-mon[34921]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-19T08:50:28.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:27 smithi155 ceph-mon[34921]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T08:50:28.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:27 smithi155 ceph-mon[34921]: Cluster is now healthy 2024-09-19T08:50:28.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:27 smithi155 ceph-mon[34921]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=h=up:active} 8 up:standby 2024-09-19T08:50:28.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:27 smithi155 ceph-mon[34921]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-19T08:50:28.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:27 smithi155 ceph-mon[34921]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-19T08:50:28.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:27 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/230295399' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T08:50:28.584 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-09-19T08:50:28.585 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-19T08:50:28.844 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:29.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:28 smithi203 ceph-mon[35450]: pgmap v283: 97 pgs: 97 active+clean; 582 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s wr, 12 op/s 2024-09-19T08:50:29.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:28 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/230295399' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T08:50:29.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:28 smithi203 ceph-mon[35450]: mds.? [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] up:active 2024-09-19T08:50:29.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:28 smithi203 ceph-mon[35450]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-19T08:50:29.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:28 smithi203 ceph-mon[35450]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T08:50:29.249 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:28 smithi019 ceph-mon[30976]: pgmap v283: 97 pgs: 97 active+clean; 582 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s wr, 12 op/s 2024-09-19T08:50:29.250 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:28 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/230295399' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T08:50:29.250 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:28 smithi019 ceph-mon[30976]: mds.? [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] up:active 2024-09-19T08:50:29.250 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:28 smithi019 ceph-mon[30976]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-19T08:50:29.250 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:28 smithi019 ceph-mon[30976]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T08:50:29.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.334+0000 7f2e98234640 1 -- 172.21.15.19:0/2838866845 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e90101410 msgr2=0x7f2e9010d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:29.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.334+0000 7f2e98234640 1 --2- 172.21.15.19:0/2838866845 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e90101410 0x7f2e9010d940 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f2e88009cd0 tx=0x7f2e8802a8e0 comp rx=0 tx=0).stop 2024-09-19T08:50:29.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.334+0000 7f2e98234640 1 -- 172.21.15.19:0/2838866845 shutdown_connections 2024-09-19T08:50:29.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.334+0000 7f2e98234640 1 --2- 172.21.15.19:0/2838866845 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e90100a70 0x7f2e90100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:29.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.334+0000 7f2e98234640 1 --2- 172.21.15.19:0/2838866845 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e90101410 0x7f2e9010d940 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:29.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.334+0000 7f2e98234640 1 --2- 172.21.15.19:0/2838866845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e90106a70 0x7f2e90106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:29.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.334+0000 7f2e98234640 1 -- 172.21.15.19:0/2838866845 >> 172.21.15.19:0/2838866845 conn(0x7f2e900fc790 msgr2=0x7f2e900febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:29.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.334+0000 7f2e98234640 1 -- 172.21.15.19:0/2838866845 shutdown_connections 2024-09-19T08:50:29.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.334+0000 7f2e98234640 1 -- 172.21.15.19:0/2838866845 wait complete. 2024-09-19T08:50:29.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.335+0000 7f2e98234640 1 Processor -- start 2024-09-19T08:50:29.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.335+0000 7f2e98234640 1 -- start start 2024-09-19T08:50:29.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.335+0000 7f2e98234640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e90100a70 0x7f2e90197030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:29.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.335+0000 7f2e98234640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e90101410 0x7f2e90197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:29.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.335+0000 7f2e98234640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e90106a70 0x7f2e90197ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:29.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.335+0000 7f2e98234640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2e90110e70 con 0x7f2e90100a70 2024-09-19T08:50:29.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.335+0000 7f2e98234640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2e90110cf0 con 0x7f2e90106a70 2024-09-19T08:50:29.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.335+0000 7f2e98234640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2e90110ff0 con 0x7f2e90101410 2024-09-19T08:50:29.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.335+0000 7f2e95fd0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e90100a70 0x7f2e90197030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:29.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.335+0000 7f2e95fd0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e90100a70 0x7f2e90197030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54330/0 (socket says 172.21.15.19:54330) 2024-09-19T08:50:29.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.335+0000 7f2e95fd0640 1 -- 172.21.15.19:0/3904568711 learned_addr learned my addr 172.21.15.19:0/3904568711 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:50:29.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.335+0000 7f2e967d1640 1 --2- 172.21.15.19:0/3904568711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e90106a70 0x7f2e90197ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:29.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.335+0000 7f2e957cf640 1 --2- 172.21.15.19:0/3904568711 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e90101410 0x7f2e90197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:29.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.335+0000 7f2e95fd0640 1 -- 172.21.15.19:0/3904568711 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e90101410 msgr2=0x7f2e90197570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:29.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.335+0000 7f2e95fd0640 1 --2- 172.21.15.19:0/3904568711 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e90101410 0x7f2e90197570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:29.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.335+0000 7f2e95fd0640 1 -- 172.21.15.19:0/3904568711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e90106a70 msgr2=0x7f2e90197ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:29.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.335+0000 7f2e95fd0640 1 --2- 172.21.15.19:0/3904568711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e90106a70 0x7f2e90197ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:29.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.335+0000 7f2e95fd0640 1 -- 172.21.15.19:0/3904568711 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e901a68a0 con 0x7f2e90100a70 2024-09-19T08:50:29.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.335+0000 7f2e957cf640 1 --2- 172.21.15.19:0/3904568711 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e90101410 0x7f2e90197570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:50:29.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.336+0000 7f2e95fd0640 1 --2- 172.21.15.19:0/3904568711 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e90100a70 0x7f2e90197030 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00e9f0 tx=0x7f2e8c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:29.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.336+0000 7f2e86ffd640 1 -- 172.21.15.19:0/3904568711 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c00cd80 con 0x7f2e90100a70 2024-09-19T08:50:29.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.336+0000 7f2e98234640 1 -- 172.21.15.19:0/3904568711 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e901a6b90 con 0x7f2e90100a70 2024-09-19T08:50:29.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.336+0000 7f2e86ffd640 1 -- 172.21.15.19:0/3904568711 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e8c010910 con 0x7f2e90100a70 2024-09-19T08:50:29.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.336+0000 7f2e86ffd640 1 -- 172.21.15.19:0/3904568711 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e8c0188f0 con 0x7f2e90100a70 2024-09-19T08:50:29.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.336+0000 7f2e98234640 1 -- 172.21.15.19:0/3904568711 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e901a70d0 con 0x7f2e90100a70 2024-09-19T08:50:29.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.337+0000 7f2e98234640 1 -- 172.21.15.19:0/3904568711 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e90100ed0 con 0x7f2e90100a70 2024-09-19T08:50:29.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.338+0000 7f2e86ffd640 1 -- 172.21.15.19:0/3904568711 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f2e8c010ac0 con 0x7f2e90100a70 2024-09-19T08:50:29.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.339+0000 7f2e86ffd640 1 --2- 172.21.15.19:0/3904568711 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2e7c0a3240 0x7f2e7c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:29.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.339+0000 7f2e86ffd640 1 -- 172.21.15.19:0/3904568711 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f2e8c0cff80 con 0x7f2e90100a70 2024-09-19T08:50:29.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.339+0000 7f2e957cf640 1 --2- 172.21.15.19:0/3904568711 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2e7c0a3240 0x7f2e7c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:29.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.339+0000 7f2e957cf640 1 --2- 172.21.15.19:0/3904568711 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2e7c0a3240 0x7f2e7c0a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2e90199190 tx=0x7f2e80005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:29.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.342+0000 7f2e86ffd640 1 -- 172.21.15.19:0/3904568711 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2e8c09cdf0 con 0x7f2e90100a70 2024-09-19T08:50:29.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:28 smithi155 ceph-mon[34921]: pgmap v283: 97 pgs: 97 active+clean; 582 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s wr, 12 op/s 2024-09-19T08:50:29.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:28 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/230295399' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T08:50:29.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:28 smithi155 ceph-mon[34921]: mds.? [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] up:active 2024-09-19T08:50:29.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:28 smithi155 ceph-mon[34921]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-19T08:50:29.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:28 smithi155 ceph-mon[34921]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T08:50:29.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.541+0000 7f2e98234640 1 -- 172.21.15.19:0/3904568711 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f2e90062630 con 0x7f2e7c0a3240 2024-09-19T08:50:29.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.569+0000 7f2e86ffd640 1 -- 172.21.15.19:0/3904568711 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2e90062630 con 0x7f2e7c0a3240 2024-09-19T08:50:29.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.571+0000 7f2e98234640 1 -- 172.21.15.19:0/3904568711 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2e7c0a3240 msgr2=0x7f2e7c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:29.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.571+0000 7f2e98234640 1 --2- 172.21.15.19:0/3904568711 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2e7c0a3240 0x7f2e7c0a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2e90199190 tx=0x7f2e80005d30 comp rx=0 tx=0).stop 2024-09-19T08:50:29.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.571+0000 7f2e98234640 1 -- 172.21.15.19:0/3904568711 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e90100a70 msgr2=0x7f2e90197030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:29.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.571+0000 7f2e98234640 1 --2- 172.21.15.19:0/3904568711 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e90100a70 0x7f2e90197030 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c00e9f0 tx=0x7f2e8c00eeb0 comp rx=0 tx=0).stop 2024-09-19T08:50:29.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.571+0000 7f2e98234640 1 -- 172.21.15.19:0/3904568711 shutdown_connections 2024-09-19T08:50:29.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.571+0000 7f2e98234640 1 --2- 172.21.15.19:0/3904568711 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2e7c0a3240 0x7f2e7c0a5700 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:29.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.571+0000 7f2e98234640 1 --2- 172.21.15.19:0/3904568711 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e90101410 0x7f2e90197570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:29.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.571+0000 7f2e98234640 1 --2- 172.21.15.19:0/3904568711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e90106a70 0x7f2e90197ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:29.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.571+0000 7f2e98234640 1 --2- 172.21.15.19:0/3904568711 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e90100a70 0x7f2e90197030 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:29.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.571+0000 7f2e98234640 1 -- 172.21.15.19:0/3904568711 >> 172.21.15.19:0/3904568711 conn(0x7f2e900fc790 msgr2=0x7f2e900fdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:29.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.571+0000 7f2e98234640 1 -- 172.21.15.19:0/3904568711 shutdown_connections 2024-09-19T08:50:29.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:29.571+0000 7f2e98234640 1 -- 172.21.15.19:0/3904568711 wait complete. 2024-09-19T08:50:29.818 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:50:29 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:50:29.546+0000 7f9b047f7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:50:29.818 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:50:29 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:50:29.546+0000 7f9b047f7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:50:29.819 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:50:29 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:50:29.547+0000 7f9b047f7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:50:29.819 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:50:29 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:50:29.547+0000 7f9b047f7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:50:29.819 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:50:29 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:50:29.547+0000 7f9b047f7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:50:30.213 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:29 smithi019 ceph-mon[30976]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:50:30.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:29 smithi203 ceph-mon[35450]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:50:30.243 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-19T08:50:30.399 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:29 smithi155 ceph-mon[34921]: from='client.14703 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:50:30.501 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:30.672 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 08:50:30 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-b[65837]: 2024-09-19T08:50:30.399+0000 7faf3d9d0640 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-09-19T08:50:31.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.012+0000 7fd536fd0640 1 -- 172.21.15.19:0/41405874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd530102d90 msgr2=0x7fd530103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:31.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.012+0000 7fd536fd0640 1 --2- 172.21.15.19:0/41405874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd530102d90 0x7fd530103170 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd520009930 tx=0x7fd52002a420 comp rx=0 tx=0).stop 2024-09-19T08:50:31.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.013+0000 7fd536fd0640 1 -- 172.21.15.19:0/41405874 shutdown_connections 2024-09-19T08:50:31.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.013+0000 7fd536fd0640 1 --2- 172.21.15.19:0/41405874 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd530108290 0x7fd53010ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:31.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.013+0000 7fd536fd0640 1 --2- 172.21.15.19:0/41405874 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd530103740 0x7fd530107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:31.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.013+0000 7fd536fd0640 1 --2- 172.21.15.19:0/41405874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd530102d90 0x7fd530103170 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:31.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.013+0000 7fd536fd0640 1 -- 172.21.15.19:0/41405874 >> 172.21.15.19:0/41405874 conn(0x7fd5300fc7d0 msgr2=0x7fd5300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:31.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.013+0000 7fd536fd0640 1 -- 172.21.15.19:0/41405874 shutdown_connections 2024-09-19T08:50:31.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.013+0000 7fd536fd0640 1 -- 172.21.15.19:0/41405874 wait complete. 2024-09-19T08:50:31.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.013+0000 7fd536fd0640 1 Processor -- start 2024-09-19T08:50:31.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.013+0000 7fd536fd0640 1 -- start start 2024-09-19T08:50:31.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.014+0000 7fd536fd0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd530102d90 0x7fd5301985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:31.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.014+0000 7fd536fd0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd530103740 0x7fd530198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:31.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.014+0000 7fd536fd0640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd530108290 0x7fd53019cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:31.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.014+0000 7fd536fd0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd530112090 con 0x7fd530102d90 2024-09-19T08:50:31.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.014+0000 7fd536fd0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd530111f10 con 0x7fd530103740 2024-09-19T08:50:31.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.014+0000 7fd536fd0640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd530112210 con 0x7fd530108290 2024-09-19T08:50:31.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.014+0000 7fd534d6c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd530102d90 0x7fd5301985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:31.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.014+0000 7fd534d6c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd530102d90 0x7fd5301985d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54366/0 (socket says 172.21.15.19:54366) 2024-09-19T08:50:31.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.014+0000 7fd534d6c640 1 -- 172.21.15.19:0/2547049698 learned_addr learned my addr 172.21.15.19:0/2547049698 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:50:31.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.014+0000 7fd53556d640 1 --2- 172.21.15.19:0/2547049698 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd530108290 0x7fd53019cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:31.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.014+0000 7fd52ffff640 1 --2- 172.21.15.19:0/2547049698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd530103740 0x7fd530198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:31.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.014+0000 7fd534d6c640 1 -- 172.21.15.19:0/2547049698 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd530108290 msgr2=0x7fd53019cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:31.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.014+0000 7fd534d6c640 1 --2- 172.21.15.19:0/2547049698 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd530108290 0x7fd53019cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:31.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.014+0000 7fd534d6c640 1 -- 172.21.15.19:0/2547049698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd530103740 msgr2=0x7fd530198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:31.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.014+0000 7fd534d6c640 1 --2- 172.21.15.19:0/2547049698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd530103740 0x7fd530198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:31.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.014+0000 7fd534d6c640 1 -- 172.21.15.19:0/2547049698 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd53019d580 con 0x7fd530102d90 2024-09-19T08:50:31.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.014+0000 7fd534d6c640 1 --2- 172.21.15.19:0/2547049698 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd530102d90 0x7fd5301985d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd520009230 tx=0x7fd520004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:31.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.015+0000 7fd52dffb640 1 -- 172.21.15.19:0/2547049698 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd52003f030 con 0x7fd530102d90 2024-09-19T08:50:31.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.015+0000 7fd52dffb640 1 -- 172.21.15.19:0/2547049698 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd520003ad0 con 0x7fd530102d90 2024-09-19T08:50:31.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.015+0000 7fd536fd0640 1 -- 172.21.15.19:0/2547049698 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd53019d810 con 0x7fd530102d90 2024-09-19T08:50:31.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.015+0000 7fd52dffb640 1 -- 172.21.15.19:0/2547049698 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd520035070 con 0x7fd530102d90 2024-09-19T08:50:31.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.015+0000 7fd536fd0640 1 -- 172.21.15.19:0/2547049698 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5301a5150 con 0x7fd530102d90 2024-09-19T08:50:31.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.016+0000 7fd536fd0640 1 -- 172.21.15.19:0/2547049698 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd53006a7f0 con 0x7fd530102d90 2024-09-19T08:50:31.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.017+0000 7fd52dffb640 1 -- 172.21.15.19:0/2547049698 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd520042030 con 0x7fd530102d90 2024-09-19T08:50:31.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.018+0000 7fd52dffb640 1 --2- 172.21.15.19:0/2547049698 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd5180a32d0 0x7fd5180a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:31.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.018+0000 7fd52ffff640 1 --2- 172.21.15.19:0/2547049698 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd5180a32d0 0x7fd5180a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:31.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.018+0000 7fd52dffb640 1 -- 172.21.15.19:0/2547049698 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fd5200efee0 con 0x7fd530102d90 2024-09-19T08:50:31.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.018+0000 7fd52ffff640 1 --2- 172.21.15.19:0/2547049698 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd5180a32d0 0x7fd5180a5790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd524005fd0 tx=0x7fd524005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:31.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.022+0000 7fd52dffb640 1 -- 172.21.15.19:0/2547049698 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd5200bcb50 con 0x7fd530102d90 2024-09-19T08:50:31.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.224+0000 7fd536fd0640 1 -- 172.21.15.19:0/2547049698 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fd530062630 con 0x7fd5180a32d0 2024-09-19T08:50:31.225 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:30 smithi019 ceph-mon[30976]: pgmap v284: 97 pgs: 97 active+clean; 583 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s rd, 3.6 KiB/s wr, 13 op/s 2024-09-19T08:50:31.225 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:30 smithi019 ceph-mon[30976]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T08:50:31.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:30 smithi203 ceph-mon[35450]: pgmap v284: 97 pgs: 97 active+clean; 583 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s rd, 3.6 KiB/s wr, 13 op/s 2024-09-19T08:50:31.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:30 smithi203 ceph-mon[35450]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T08:50:31.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.249+0000 7fd52dffb640 1 -- 172.21.15.19:0/2547049698 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd530062630 con 0x7fd5180a32d0 2024-09-19T08:50:31.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.251+0000 7fd536fd0640 1 -- 172.21.15.19:0/2547049698 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd5180a32d0 msgr2=0x7fd5180a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:31.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.251+0000 7fd536fd0640 1 --2- 172.21.15.19:0/2547049698 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd5180a32d0 0x7fd5180a5790 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd524005fd0 tx=0x7fd524005850 comp rx=0 tx=0).stop 2024-09-19T08:50:31.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.251+0000 7fd536fd0640 1 -- 172.21.15.19:0/2547049698 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd530102d90 msgr2=0x7fd5301985d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:31.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.251+0000 7fd536fd0640 1 --2- 172.21.15.19:0/2547049698 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd530102d90 0x7fd5301985d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd520009230 tx=0x7fd520004270 comp rx=0 tx=0).stop 2024-09-19T08:50:31.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.251+0000 7fd536fd0640 1 -- 172.21.15.19:0/2547049698 shutdown_connections 2024-09-19T08:50:31.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.251+0000 7fd536fd0640 1 --2- 172.21.15.19:0/2547049698 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd5180a32d0 0x7fd5180a5790 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:31.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.251+0000 7fd536fd0640 1 --2- 172.21.15.19:0/2547049698 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd530108290 0x7fd53019cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:31.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.251+0000 7fd536fd0640 1 --2- 172.21.15.19:0/2547049698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd530103740 0x7fd530198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:31.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.251+0000 7fd536fd0640 1 --2- 172.21.15.19:0/2547049698 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd530102d90 0x7fd5301985d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:31.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.251+0000 7fd536fd0640 1 -- 172.21.15.19:0/2547049698 >> 172.21.15.19:0/2547049698 conn(0x7fd5300fc7d0 msgr2=0x7fd530105e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:31.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.251+0000 7fd536fd0640 1 -- 172.21.15.19:0/2547049698 shutdown_connections 2024-09-19T08:50:31.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:31.251+0000 7fd536fd0640 1 -- 172.21.15.19:0/2547049698 wait complete. 2024-09-19T08:50:31.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:30 smithi155 ceph-mon[34921]: pgmap v284: 97 pgs: 97 active+clean; 583 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s rd, 3.6 KiB/s wr, 13 op/s 2024-09-19T08:50:31.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:30 smithi155 ceph-mon[34921]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T08:50:32.011 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-19T08:50:32.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:31 smithi203 ceph-mon[35450]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:50:32.269 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:32.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:31 smithi019 ceph-mon[30976]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:50:32.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:31 smithi155 ceph-mon[34921]: from='client.14715 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:50:32.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.773+0000 7f75dd531640 1 -- 172.21.15.19:0/4174097183 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75d8106a80 msgr2=0x7f75d8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:32.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.773+0000 7f75dd531640 1 --2- 172.21.15.19:0/4174097183 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75d8106a80 0x7f75d8106e60 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f75c8009930 tx=0x7f75c802a420 comp rx=0 tx=0).stop 2024-09-19T08:50:32.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.773+0000 7f75dd531640 1 -- 172.21.15.19:0/4174097183 shutdown_connections 2024-09-19T08:50:32.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.773+0000 7f75dd531640 1 --2- 172.21.15.19:0/4174097183 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75d8101420 0x7f75d810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:32.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.773+0000 7f75dd531640 1 --2- 172.21.15.19:0/4174097183 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75d8100a80 0x7f75d8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:32.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.773+0000 7f75dd531640 1 --2- 172.21.15.19:0/4174097183 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75d8106a80 0x7f75d8106e60 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:32.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.773+0000 7f75dd531640 1 -- 172.21.15.19:0/4174097183 >> 172.21.15.19:0/4174097183 conn(0x7f75d80fc7a0 msgr2=0x7f75d80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:32.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.773+0000 7f75dd531640 1 -- 172.21.15.19:0/4174097183 shutdown_connections 2024-09-19T08:50:32.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.773+0000 7f75dd531640 1 -- 172.21.15.19:0/4174097183 wait complete. 2024-09-19T08:50:32.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.774+0000 7f75dd531640 1 Processor -- start 2024-09-19T08:50:32.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.774+0000 7f75dd531640 1 -- start start 2024-09-19T08:50:32.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.774+0000 7f75dd531640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75d8100a80 0x7f75d8102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:32.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.774+0000 7f75dd531640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75d8101420 0x7f75d8102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:32.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.774+0000 7f75dd531640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75d8106a80 0x7f75d81030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:32.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.774+0000 7f75dd531640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f75d8110e80 con 0x7f75d8106a80 2024-09-19T08:50:32.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.774+0000 7f75dd531640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f75d8110d00 con 0x7f75d8101420 2024-09-19T08:50:32.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.774+0000 7f75dd531640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f75d8111000 con 0x7f75d8100a80 2024-09-19T08:50:32.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.774+0000 7f75d77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75d8106a80 0x7f75d81030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:32.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.774+0000 7f75d77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75d8106a80 0x7f75d81030d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54378/0 (socket says 172.21.15.19:54378) 2024-09-19T08:50:32.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.774+0000 7f75d77fe640 1 -- 172.21.15.19:0/3890540909 learned_addr learned my addr 172.21.15.19:0/3890540909 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:50:32.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.774+0000 7f75d67fc640 1 --2- 172.21.15.19:0/3890540909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75d8101420 0x7f75d8102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:32.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.774+0000 7f75d6ffd640 1 --2- 172.21.15.19:0/3890540909 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75d8100a80 0x7f75d8102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:32.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.774+0000 7f75d77fe640 1 -- 172.21.15.19:0/3890540909 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75d8100a80 msgr2=0x7f75d8102650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:32.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.774+0000 7f75d77fe640 1 --2- 172.21.15.19:0/3890540909 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75d8100a80 0x7f75d8102650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:32.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.774+0000 7f75d77fe640 1 -- 172.21.15.19:0/3890540909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75d8101420 msgr2=0x7f75d8102b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:32.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.774+0000 7f75d77fe640 1 --2- 172.21.15.19:0/3890540909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75d8101420 0x7f75d8102b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:32.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.774+0000 7f75d77fe640 1 -- 172.21.15.19:0/3890540909 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75d81a68d0 con 0x7f75d8106a80 2024-09-19T08:50:32.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.775+0000 7f75d77fe640 1 --2- 172.21.15.19:0/3890540909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75d8106a80 0x7f75d81030d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f75d000eaa0 tx=0x7f75d000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:32.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.775+0000 7f75bffff640 1 -- 172.21.15.19:0/3890540909 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d0004d20 con 0x7f75d8106a80 2024-09-19T08:50:32.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.775+0000 7f75dd531640 1 -- 172.21.15.19:0/3890540909 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75d81a6bc0 con 0x7f75d8106a80 2024-09-19T08:50:32.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.775+0000 7f75bffff640 1 -- 172.21.15.19:0/3890540909 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75d0005020 con 0x7f75d8106a80 2024-09-19T08:50:32.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.775+0000 7f75bffff640 1 -- 172.21.15.19:0/3890540909 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d00116d0 con 0x7f75d8106a80 2024-09-19T08:50:32.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.775+0000 7f75dd531640 1 -- 172.21.15.19:0/3890540909 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75d81a7100 con 0x7f75d8106a80 2024-09-19T08:50:32.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.776+0000 7f75dd531640 1 -- 172.21.15.19:0/3890540909 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75d8100ee0 con 0x7f75d8106a80 2024-09-19T08:50:32.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.777+0000 7f75bffff640 1 -- 172.21.15.19:0/3890540909 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f75d00051d0 con 0x7f75d8106a80 2024-09-19T08:50:32.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.778+0000 7f75bffff640 1 --2- 172.21.15.19:0/3890540909 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f75c00a32d0 0x7f75c00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:32.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.778+0000 7f75d6ffd640 1 --2- 172.21.15.19:0/3890540909 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f75c00a32d0 0x7f75c00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:32.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.778+0000 7f75bffff640 1 -- 172.21.15.19:0/3890540909 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f75d00cfbd0 con 0x7f75d8106a80 2024-09-19T08:50:32.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.778+0000 7f75d6ffd640 1 --2- 172.21.15.19:0/3890540909 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f75c00a32d0 0x7f75c00a5790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f75c80096c0 tx=0x7f75c8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:32.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.782+0000 7f75bffff640 1 -- 172.21.15.19:0/3890540909 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f75d0016030 con 0x7f75d8106a80 2024-09-19T08:50:32.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.987+0000 7f75dd531640 1 -- 172.21.15.19:0/3890540909 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f75d806afc0 con 0x7f75c00a32d0 2024-09-19T08:50:32.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.991+0000 7f75bffff640 1 -- 172.21.15.19:0/3890540909 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f75d806afc0 con 0x7f75c00a32d0 2024-09-19T08:50:32.992 INFO:teuthology.orchestra.run.smithi019.stdout:/volumes/qa/sv_0/bc13f7dc-2fcb-43f6-b29b-597eb4058443 2024-09-19T08:50:32.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.993+0000 7f75dd531640 1 -- 172.21.15.19:0/3890540909 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f75c00a32d0 msgr2=0x7f75c00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:32.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.993+0000 7f75dd531640 1 --2- 172.21.15.19:0/3890540909 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f75c00a32d0 0x7f75c00a5790 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f75c80096c0 tx=0x7f75c8000bc0 comp rx=0 tx=0).stop 2024-09-19T08:50:32.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.993+0000 7f75dd531640 1 -- 172.21.15.19:0/3890540909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75d8106a80 msgr2=0x7f75d81030d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:32.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.993+0000 7f75dd531640 1 --2- 172.21.15.19:0/3890540909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75d8106a80 0x7f75d81030d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f75d000eaa0 tx=0x7f75d000eea0 comp rx=0 tx=0).stop 2024-09-19T08:50:32.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.993+0000 7f75dd531640 1 -- 172.21.15.19:0/3890540909 shutdown_connections 2024-09-19T08:50:32.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.993+0000 7f75dd531640 1 --2- 172.21.15.19:0/3890540909 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f75c00a32d0 0x7f75c00a5790 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:32.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.993+0000 7f75dd531640 1 --2- 172.21.15.19:0/3890540909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75d8106a80 0x7f75d81030d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:32.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.993+0000 7f75dd531640 1 --2- 172.21.15.19:0/3890540909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75d8101420 0x7f75d8102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:32.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.993+0000 7f75dd531640 1 --2- 172.21.15.19:0/3890540909 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75d8100a80 0x7f75d8102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:32.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.993+0000 7f75dd531640 1 -- 172.21.15.19:0/3890540909 >> 172.21.15.19:0/3890540909 conn(0x7f75d80fc7a0 msgr2=0x7f75d806a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:32.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.993+0000 7f75dd531640 1 -- 172.21.15.19:0/3890540909 shutdown_connections 2024-09-19T08:50:32.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:32.993+0000 7f75dd531640 1 -- 172.21.15.19:0/3890540909 wait complete. 2024-09-19T08:50:33.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:32 smithi203 ceph-mon[35450]: pgmap v285: 97 pgs: 97 active+clean; 585 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4.8 KiB/s wr, 17 op/s 2024-09-19T08:50:33.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:32 smithi019 ceph-mon[30976]: pgmap v285: 97 pgs: 97 active+clean; 585 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4.8 KiB/s wr, 17 op/s 2024-09-19T08:50:33.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:32 smithi155 ceph-mon[34921]: pgmap v285: 97 pgs: 97 active+clean; 585 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 4.8 KiB/s wr, 17 op/s 2024-09-19T08:50:33.842 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-19T08:50:34.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:33 smithi019 ceph-mon[30976]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:50:34.105 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:34.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:33 smithi203 ceph-mon[35450]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:50:34.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:33 smithi155 ceph-mon[34921]: from='client.14721 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:50:34.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.566+0000 7fb60a15f640 1 -- 172.21.15.19:0/241974295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb604106a80 msgr2=0x7fb604106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:34.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.566+0000 7fb60a15f640 1 --2- 172.21.15.19:0/241974295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb604106a80 0x7fb604106e60 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4009930 tx=0x7fb5f402a420 comp rx=0 tx=0).stop 2024-09-19T08:50:34.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.566+0000 7fb60a15f640 1 -- 172.21.15.19:0/241974295 shutdown_connections 2024-09-19T08:50:34.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.566+0000 7fb60a15f640 1 --2- 172.21.15.19:0/241974295 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb604100a80 0x7fb604100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:34.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.566+0000 7fb60a15f640 1 --2- 172.21.15.19:0/241974295 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb604101420 0x7fb60410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:34.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.566+0000 7fb60a15f640 1 --2- 172.21.15.19:0/241974295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb604106a80 0x7fb604106e60 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:34.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.566+0000 7fb60a15f640 1 -- 172.21.15.19:0/241974295 >> 172.21.15.19:0/241974295 conn(0x7fb6040fc7a0 msgr2=0x7fb6040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:34.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.566+0000 7fb60a15f640 1 -- 172.21.15.19:0/241974295 shutdown_connections 2024-09-19T08:50:34.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.566+0000 7fb60a15f640 1 -- 172.21.15.19:0/241974295 wait complete. 2024-09-19T08:50:34.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.566+0000 7fb60a15f640 1 Processor -- start 2024-09-19T08:50:34.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.566+0000 7fb60a15f640 1 -- start start 2024-09-19T08:50:34.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.567+0000 7fb60a15f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb604100a80 0x7fb6041985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:34.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.567+0000 7fb60a15f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb604101420 0x7fb604198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:34.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.567+0000 7fb60a15f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb604106a80 0x7fb60419ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:34.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.567+0000 7fb60a15f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb604110f20 con 0x7fb604101420 2024-09-19T08:50:34.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.567+0000 7fb60a15f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb604110da0 con 0x7fb604106a80 2024-09-19T08:50:34.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.567+0000 7fb60a15f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb6041110a0 con 0x7fb604100a80 2024-09-19T08:50:34.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.567+0000 7fb602ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb604101420 0x7fb604198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:34.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.567+0000 7fb602ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb604101420 0x7fb604198b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54400/0 (socket says 172.21.15.19:54400) 2024-09-19T08:50:34.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.567+0000 7fb602ffd640 1 -- 172.21.15.19:0/3393749576 learned_addr learned my addr 172.21.15.19:0/3393749576 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:50:34.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.567+0000 7fb6037fe640 1 --2- 172.21.15.19:0/3393749576 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb604100a80 0x7fb6041985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:34.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.567+0000 7fb603fff640 1 --2- 172.21.15.19:0/3393749576 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb604106a80 0x7fb60419ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:34.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.567+0000 7fb602ffd640 1 -- 172.21.15.19:0/3393749576 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb604100a80 msgr2=0x7fb6041985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:34.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.567+0000 7fb602ffd640 1 --2- 172.21.15.19:0/3393749576 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb604100a80 0x7fb6041985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:34.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.567+0000 7fb602ffd640 1 -- 172.21.15.19:0/3393749576 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb604106a80 msgr2=0x7fb60419ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:34.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.567+0000 7fb602ffd640 1 --2- 172.21.15.19:0/3393749576 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb604106a80 0x7fb60419ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:34.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.567+0000 7fb602ffd640 1 -- 172.21.15.19:0/3393749576 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb60419d590 con 0x7fb604101420 2024-09-19T08:50:34.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.567+0000 7fb602ffd640 1 --2- 172.21.15.19:0/3393749576 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb604101420 0x7fb604198b20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb5f800b4a0 tx=0x7fb5f800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:34.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.567+0000 7fb600ff9640 1 -- 172.21.15.19:0/3393749576 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8014070 con 0x7fb604101420 2024-09-19T08:50:34.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.568+0000 7fb60a15f640 1 -- 172.21.15.19:0/3393749576 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb60419d880 con 0x7fb604101420 2024-09-19T08:50:34.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.568+0000 7fb600ff9640 1 -- 172.21.15.19:0/3393749576 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb5f8010af0 con 0x7fb604101420 2024-09-19T08:50:34.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.568+0000 7fb600ff9640 1 -- 172.21.15.19:0/3393749576 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8017d10 con 0x7fb604101420 2024-09-19T08:50:34.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.568+0000 7fb60a15f640 1 -- 172.21.15.19:0/3393749576 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6041a5160 con 0x7fb604101420 2024-09-19T08:50:34.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.569+0000 7fb60a15f640 1 -- 172.21.15.19:0/3393749576 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb604100f60 con 0x7fb604101420 2024-09-19T08:50:34.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.570+0000 7fb600ff9640 1 -- 172.21.15.19:0/3393749576 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb5f8017070 con 0x7fb604101420 2024-09-19T08:50:34.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.570+0000 7fb600ff9640 1 --2- 172.21.15.19:0/3393749576 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb5ec0a32d0 0x7fb5ec0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:34.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.570+0000 7fb6037fe640 1 --2- 172.21.15.19:0/3393749576 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb5ec0a32d0 0x7fb5ec0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:34.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.570+0000 7fb600ff9640 1 -- 172.21.15.19:0/3393749576 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fb5f80cec20 con 0x7fb604101420 2024-09-19T08:50:34.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.571+0000 7fb6037fe640 1 --2- 172.21.15.19:0/3393749576 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb5ec0a32d0 0x7fb5ec0a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4009900 tx=0x7fb5f40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:34.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.575+0000 7fb600ff9640 1 -- 172.21.15.19:0/3393749576 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb5f809baa0 con 0x7fb604101420 2024-09-19T08:50:34.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.778+0000 7fb60a15f640 1 -- 172.21.15.19:0/3393749576 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fb604062630 con 0x7fb5ec0a32d0 2024-09-19T08:50:34.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.803+0000 7fb600ff9640 1 -- 172.21.15.19:0/3393749576 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb604062630 con 0x7fb5ec0a32d0 2024-09-19T08:50:34.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.806+0000 7fb60a15f640 1 -- 172.21.15.19:0/3393749576 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb5ec0a32d0 msgr2=0x7fb5ec0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:34.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.806+0000 7fb60a15f640 1 --2- 172.21.15.19:0/3393749576 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb5ec0a32d0 0x7fb5ec0a5790 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4009900 tx=0x7fb5f40058d0 comp rx=0 tx=0).stop 2024-09-19T08:50:34.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.806+0000 7fb60a15f640 1 -- 172.21.15.19:0/3393749576 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb604101420 msgr2=0x7fb604198b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:34.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.806+0000 7fb60a15f640 1 --2- 172.21.15.19:0/3393749576 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb604101420 0x7fb604198b20 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb5f800b4a0 tx=0x7fb5f800b960 comp rx=0 tx=0).stop 2024-09-19T08:50:34.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.806+0000 7fb60a15f640 1 -- 172.21.15.19:0/3393749576 shutdown_connections 2024-09-19T08:50:34.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.806+0000 7fb60a15f640 1 --2- 172.21.15.19:0/3393749576 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb5ec0a32d0 0x7fb5ec0a5790 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:34.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.806+0000 7fb60a15f640 1 --2- 172.21.15.19:0/3393749576 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb604106a80 0x7fb60419ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:34.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.806+0000 7fb60a15f640 1 --2- 172.21.15.19:0/3393749576 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb604101420 0x7fb604198b20 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:34.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.806+0000 7fb60a15f640 1 --2- 172.21.15.19:0/3393749576 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb604100a80 0x7fb6041985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:34.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.806+0000 7fb60a15f640 1 -- 172.21.15.19:0/3393749576 >> 172.21.15.19:0/3393749576 conn(0x7fb6040fc7a0 msgr2=0x7fb60406ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:34.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.806+0000 7fb60a15f640 1 -- 172.21.15.19:0/3393749576 shutdown_connections 2024-09-19T08:50:34.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:34.806+0000 7fb60a15f640 1 -- 172.21.15.19:0/3393749576 wait complete. 2024-09-19T08:50:35.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:34 smithi019 ceph-mon[30976]: pgmap v286: 97 pgs: 97 active+clean; 605 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 6.2 KiB/s wr, 21 op/s 2024-09-19T08:50:35.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:34 smithi203 ceph-mon[35450]: pgmap v286: 97 pgs: 97 active+clean; 605 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 6.2 KiB/s wr, 21 op/s 2024-09-19T08:50:35.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:34 smithi155 ceph-mon[34921]: pgmap v286: 97 pgs: 97 active+clean; 605 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 6.2 KiB/s wr, 21 op/s 2024-09-19T08:50:35.554 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-19T08:50:35.824 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:36.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.346+0000 7f614c4fd640 1 -- 172.21.15.19:0/3160227257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6144102790 msgr2=0x7f61441067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:36.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.346+0000 7f614c4fd640 1 --2- 172.21.15.19:0/3160227257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6144102790 0x7f61441067e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6138009900 tx=0x7f613802a410 comp rx=0 tx=0).stop 2024-09-19T08:50:36.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.346+0000 7f614c4fd640 1 -- 172.21.15.19:0/3160227257 shutdown_connections 2024-09-19T08:50:36.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.346+0000 7f614c4fd640 1 --2- 172.21.15.19:0/3160227257 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6144106f10 0x7f614410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.346+0000 7f614c4fd640 1 --2- 172.21.15.19:0/3160227257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6144102790 0x7f61441067e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.346+0000 7f614c4fd640 1 --2- 172.21.15.19:0/3160227257 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6144101de0 0x7f61441021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.346+0000 7f614c4fd640 1 -- 172.21.15.19:0/3160227257 >> 172.21.15.19:0/3160227257 conn(0x7f61440fd8c0 msgr2=0x7f61440ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:36.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.346+0000 7f614c4fd640 1 -- 172.21.15.19:0/3160227257 shutdown_connections 2024-09-19T08:50:36.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.346+0000 7f614c4fd640 1 -- 172.21.15.19:0/3160227257 wait complete. 2024-09-19T08:50:36.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.347+0000 7f614c4fd640 1 Processor -- start 2024-09-19T08:50:36.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.347+0000 7f614c4fd640 1 -- start start 2024-09-19T08:50:36.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.348+0000 7f614c4fd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6144101de0 0x7f61440744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:36.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.348+0000 7f614c4fd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6144102790 0x7f6144074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:36.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.348+0000 7f614c4fd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6144106f10 0x7f6144074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:36.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.348+0000 7f614c4fd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6144111f70 con 0x7f6144101de0 2024-09-19T08:50:36.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.348+0000 7f614c4fd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6144111df0 con 0x7f6144102790 2024-09-19T08:50:36.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.348+0000 7f614c4fd640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f61441120f0 con 0x7f6144106f10 2024-09-19T08:50:36.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.348+0000 7f614a299640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6144101de0 0x7f61440744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:36.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.348+0000 7f614a299640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6144101de0 0x7f61440744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40774/0 (socket says 172.21.15.19:40774) 2024-09-19T08:50:36.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.348+0000 7f614a299640 1 -- 172.21.15.19:0/957291992 learned_addr learned my addr 172.21.15.19:0/957291992 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:50:36.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.348+0000 7f6149a98640 1 --2- 172.21.15.19:0/957291992 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6144102790 0x7f6144074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:36.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.348+0000 7f614aa9a640 1 --2- 172.21.15.19:0/957291992 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6144106f10 0x7f6144074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:36.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.348+0000 7f614a299640 1 -- 172.21.15.19:0/957291992 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6144106f10 msgr2=0x7f6144074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:36.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.348+0000 7f614a299640 1 --2- 172.21.15.19:0/957291992 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6144106f10 0x7f6144074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.348+0000 7f614a299640 1 -- 172.21.15.19:0/957291992 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6144102790 msgr2=0x7f6144074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:36.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.348+0000 7f614a299640 1 --2- 172.21.15.19:0/957291992 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6144102790 0x7f6144074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.348+0000 7f614a299640 1 -- 172.21.15.19:0/957291992 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61441a6950 con 0x7f6144101de0 2024-09-19T08:50:36.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.348+0000 7f614a299640 1 --2- 172.21.15.19:0/957291992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6144101de0 0x7f61440744f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f613400ebc0 tx=0x7f613400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:36.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.348+0000 7f61437fe640 1 -- 172.21.15.19:0/957291992 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6134010430 con 0x7f6144101de0 2024-09-19T08:50:36.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.348+0000 7f61437fe640 1 -- 172.21.15.19:0/957291992 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6134010ab0 con 0x7f6144101de0 2024-09-19T08:50:36.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.348+0000 7f61437fe640 1 -- 172.21.15.19:0/957291992 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6134018b30 con 0x7f6144101de0 2024-09-19T08:50:36.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.348+0000 7f614c4fd640 1 -- 172.21.15.19:0/957291992 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61441a6c40 con 0x7f6144101de0 2024-09-19T08:50:36.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.349+0000 7f614c4fd640 1 -- 172.21.15.19:0/957291992 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61441a7150 con 0x7f6144101de0 2024-09-19T08:50:36.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.349+0000 7f614c4fd640 1 -- 172.21.15.19:0/957291992 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61441021c0 con 0x7f6144101de0 2024-09-19T08:50:36.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.351+0000 7f61437fe640 1 -- 172.21.15.19:0/957291992 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6134018cd0 con 0x7f6144101de0 2024-09-19T08:50:36.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.351+0000 7f61437fe640 1 --2- 172.21.15.19:0/957291992 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f612c0a32d0 0x7f612c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:36.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.351+0000 7f6149a98640 1 --2- 172.21.15.19:0/957291992 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f612c0a32d0 0x7f612c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:36.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.352+0000 7f61437fe640 1 -- 172.21.15.19:0/957291992 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f61340cff80 con 0x7f6144101de0 2024-09-19T08:50:36.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.352+0000 7f6149a98640 1 --2- 172.21.15.19:0/957291992 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f612c0a32d0 0x7f612c0a5790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6138009230 tx=0x7f61380058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:36.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.358+0000 7f61437fe640 1 -- 172.21.15.19:0/957291992 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f613409ccf0 con 0x7f6144101de0 2024-09-19T08:50:36.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.565+0000 7f614c4fd640 1 -- 172.21.15.19:0/957291992 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f6144062630 con 0x7f612c0a32d0 2024-09-19T08:50:36.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.569+0000 7f61437fe640 1 -- 172.21.15.19:0/957291992 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f6144062630 con 0x7f612c0a32d0 2024-09-19T08:50:36.570 INFO:teuthology.orchestra.run.smithi019.stdout:/volumes/qa/sv_1/7c8d6e9e-29b1-4146-b80e-6ebd0025a96b 2024-09-19T08:50:36.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.571+0000 7f614c4fd640 1 -- 172.21.15.19:0/957291992 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f612c0a32d0 msgr2=0x7f612c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:36.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.572+0000 7f614c4fd640 1 --2- 172.21.15.19:0/957291992 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f612c0a32d0 0x7f612c0a5790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6138009230 tx=0x7f61380058d0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.572+0000 7f614c4fd640 1 -- 172.21.15.19:0/957291992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6144101de0 msgr2=0x7f61440744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:36.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.572+0000 7f614c4fd640 1 --2- 172.21.15.19:0/957291992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6144101de0 0x7f61440744f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f613400ebc0 tx=0x7f613400c2d0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.572+0000 7f614c4fd640 1 -- 172.21.15.19:0/957291992 shutdown_connections 2024-09-19T08:50:36.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.572+0000 7f614c4fd640 1 --2- 172.21.15.19:0/957291992 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f612c0a32d0 0x7f612c0a5790 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.572+0000 7f614c4fd640 1 --2- 172.21.15.19:0/957291992 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6144106f10 0x7f6144074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.572+0000 7f614c4fd640 1 --2- 172.21.15.19:0/957291992 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6144102790 0x7f6144074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.572+0000 7f614c4fd640 1 --2- 172.21.15.19:0/957291992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6144101de0 0x7f61440744f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:36.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.572+0000 7f614c4fd640 1 -- 172.21.15.19:0/957291992 >> 172.21.15.19:0/957291992 conn(0x7f61440fd8c0 msgr2=0x7f61440fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:36.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.572+0000 7f614c4fd640 1 -- 172.21.15.19:0/957291992 shutdown_connections 2024-09-19T08:50:36.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:36.572+0000 7f614c4fd640 1 -- 172.21.15.19:0/957291992 wait complete. 2024-09-19T08:50:36.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:36 smithi155 ceph-mon[34921]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:50:36.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:36 smithi203 ceph-mon[35450]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:50:36.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:36 smithi019 ceph-mon[30976]: from='client.14727 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:50:37.247 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:50:37.505 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:37.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:37 smithi019 ceph-mon[30976]: pgmap v287: 97 pgs: 97 active+clean; 606 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.3 KiB/s wr, 23 op/s 2024-09-19T08:50:37.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:37 smithi019 ceph-mon[30976]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:50:37.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:37 smithi155 ceph-mon[34921]: pgmap v287: 97 pgs: 97 active+clean; 606 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.3 KiB/s wr, 23 op/s 2024-09-19T08:50:37.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:37 smithi155 ceph-mon[34921]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:50:37.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:37 smithi203 ceph-mon[35450]: pgmap v287: 97 pgs: 97 active+clean; 606 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.3 KiB/s wr, 23 op/s 2024-09-19T08:50:37.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:37 smithi203 ceph-mon[35450]: from='client.14733 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:50:38.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.982+0000 7efd5efa4640 1 -- 172.21.15.19:0/4028982615 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd58106f10 msgr2=0x7efd5810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:38.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.982+0000 7efd5efa4640 1 --2- 172.21.15.19:0/4028982615 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd58106f10 0x7efd5810ea90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7efd50009ca0 tx=0x7efd5002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:50:38.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.982+0000 7efd5efa4640 1 -- 172.21.15.19:0/4028982615 shutdown_connections 2024-09-19T08:50:38.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.982+0000 7efd5efa4640 1 --2- 172.21.15.19:0/4028982615 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd58106f10 0x7efd5810ea90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:38.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.982+0000 7efd5efa4640 1 --2- 172.21.15.19:0/4028982615 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd58102790 0x7efd581067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:38.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.982+0000 7efd5efa4640 1 --2- 172.21.15.19:0/4028982615 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd58101de0 0x7efd581021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:38.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.982+0000 7efd5efa4640 1 -- 172.21.15.19:0/4028982615 >> 172.21.15.19:0/4028982615 conn(0x7efd580fd8c0 msgr2=0x7efd580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:38.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.982+0000 7efd5efa4640 1 -- 172.21.15.19:0/4028982615 shutdown_connections 2024-09-19T08:50:38.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.982+0000 7efd5efa4640 1 -- 172.21.15.19:0/4028982615 wait complete. 2024-09-19T08:50:38.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.983+0000 7efd5efa4640 1 Processor -- start 2024-09-19T08:50:38.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.983+0000 7efd5efa4640 1 -- start start 2024-09-19T08:50:38.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.983+0000 7efd5efa4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd58101de0 0x7efd58198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:38.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.983+0000 7efd5efa4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd58102790 0x7efd58198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:38.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.983+0000 7efd5efa4640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd58106f10 0x7efd5819cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:38.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.983+0000 7efd5efa4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7efd58111f70 con 0x7efd58101de0 2024-09-19T08:50:38.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.983+0000 7efd5efa4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efd58111df0 con 0x7efd58102790 2024-09-19T08:50:38.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.983+0000 7efd5efa4640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efd581120f0 con 0x7efd58106f10 2024-09-19T08:50:38.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.983+0000 7efd5cd40640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd58101de0 0x7efd58198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:38.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.983+0000 7efd5cd40640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd58101de0 0x7efd58198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40788/0 (socket says 172.21.15.19:40788) 2024-09-19T08:50:38.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.983+0000 7efd5cd40640 1 -- 172.21.15.19:0/4086320420 learned_addr learned my addr 172.21.15.19:0/4086320420 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:50:38.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.983+0000 7efd5d541640 1 --2- 172.21.15.19:0/4086320420 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd58106f10 0x7efd5819cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:38.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.983+0000 7efd4ffff640 1 --2- 172.21.15.19:0/4086320420 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd58102790 0x7efd58198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:38.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.984+0000 7efd5cd40640 1 -- 172.21.15.19:0/4086320420 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd58106f10 msgr2=0x7efd5819cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:38.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.984+0000 7efd5cd40640 1 --2- 172.21.15.19:0/4086320420 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd58106f10 0x7efd5819cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:38.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.984+0000 7efd5cd40640 1 -- 172.21.15.19:0/4086320420 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd58102790 msgr2=0x7efd58198890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:38.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.984+0000 7efd5cd40640 1 --2- 172.21.15.19:0/4086320420 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd58102790 0x7efd58198890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:38.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.984+0000 7efd5cd40640 1 -- 172.21.15.19:0/4086320420 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd5819d300 con 0x7efd58101de0 2024-09-19T08:50:38.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.984+0000 7efd5cd40640 1 --2- 172.21.15.19:0/4086320420 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd58101de0 0x7efd58198350 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7efd5400d950 tx=0x7efd5400dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:38.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.984+0000 7efd4dffb640 1 -- 172.21.15.19:0/4086320420 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd54017070 con 0x7efd58101de0 2024-09-19T08:50:38.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.984+0000 7efd5efa4640 1 -- 172.21.15.19:0/4086320420 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd5819d5f0 con 0x7efd58101de0 2024-09-19T08:50:38.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.984+0000 7efd4dffb640 1 -- 172.21.15.19:0/4086320420 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efd5400de80 con 0x7efd58101de0 2024-09-19T08:50:38.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.984+0000 7efd4dffb640 1 -- 172.21.15.19:0/4086320420 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd5400f620 con 0x7efd58101de0 2024-09-19T08:50:38.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.984+0000 7efd5efa4640 1 -- 172.21.15.19:0/4086320420 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd581a4ed0 con 0x7efd58101de0 2024-09-19T08:50:38.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.985+0000 7efd5efa4640 1 -- 172.21.15.19:0/4086320420 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd581021c0 con 0x7efd58101de0 2024-09-19T08:50:38.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.986+0000 7efd4dffb640 1 -- 172.21.15.19:0/4086320420 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7efd54009c30 con 0x7efd58101de0 2024-09-19T08:50:38.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.987+0000 7efd4dffb640 1 --2- 172.21.15.19:0/4086320420 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7efd400a32d0 0x7efd400a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:38.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.987+0000 7efd4ffff640 1 --2- 172.21.15.19:0/4086320420 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7efd400a32d0 0x7efd400a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:38.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.987+0000 7efd4dffb640 1 -- 172.21.15.19:0/4086320420 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7efd540cf4f0 con 0x7efd58101de0 2024-09-19T08:50:38.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.988+0000 7efd4ffff640 1 --2- 172.21.15.19:0/4086320420 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7efd400a32d0 0x7efd400a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7efd58108880 tx=0x7efd4800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:38.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:37.991+0000 7efd4dffb640 1 -- 172.21.15.19:0/4086320420 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efd5409c260 con 0x7efd58101de0 2024-09-19T08:50:38.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:38.203+0000 7efd5efa4640 1 -- 172.21.15.19:0/4086320420 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efd581a51b0 con 0x7efd58101de0 2024-09-19T08:50:38.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:38.204+0000 7efd4dffb640 1 -- 172.21.15.19:0/4086320420 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11983 (secure 0 0 0) 0x7efd5409bb60 con 0x7efd58101de0 2024-09-19T08:50:38.204 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:50:38.204 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"btime":"2024-09-19T08:50:27:938748+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2452068876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2452068876},{"type":"v1","addr":"172.21.15.19:6839","nonce":2452068876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T08:50:27.938727+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/2480841559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2480841559},{"type":"v1","addr":"172.21.15.155:6835","nonce":2480841559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24469,24490,24464,24463]},"id":1}]} 2024-09-19T08:50:38.205 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 27 2024-09-19T08:50:38.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:38.207+0000 7efd5efa4640 1 -- 172.21.15.19:0/4086320420 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7efd400a32d0 msgr2=0x7efd400a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:38.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:38.207+0000 7efd5efa4640 1 --2- 172.21.15.19:0/4086320420 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7efd400a32d0 0x7efd400a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7efd58108880 tx=0x7efd4800a2d0 comp rx=0 tx=0).stop 2024-09-19T08:50:38.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:38.207+0000 7efd5efa4640 1 -- 172.21.15.19:0/4086320420 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd58101de0 msgr2=0x7efd58198350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:38.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:38.207+0000 7efd5efa4640 1 --2- 172.21.15.19:0/4086320420 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd58101de0 0x7efd58198350 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7efd5400d950 tx=0x7efd5400dd50 comp rx=0 tx=0).stop 2024-09-19T08:50:38.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:38.207+0000 7efd5efa4640 1 -- 172.21.15.19:0/4086320420 shutdown_connections 2024-09-19T08:50:38.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:38.207+0000 7efd5efa4640 1 --2- 172.21.15.19:0/4086320420 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7efd400a32d0 0x7efd400a5790 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:38.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:38.207+0000 7efd5efa4640 1 --2- 172.21.15.19:0/4086320420 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd58106f10 0x7efd5819cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:38.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:38.207+0000 7efd5efa4640 1 --2- 172.21.15.19:0/4086320420 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd58102790 0x7efd58198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:38.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:38.207+0000 7efd5efa4640 1 --2- 172.21.15.19:0/4086320420 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd58101de0 0x7efd58198350 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:38.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:38.207+0000 7efd5efa4640 1 -- 172.21.15.19:0/4086320420 >> 172.21.15.19:0/4086320420 conn(0x7efd580fd8c0 msgr2=0x7efd580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:38.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:38.207+0000 7efd5efa4640 1 -- 172.21.15.19:0/4086320420 shutdown_connections 2024-09-19T08:50:38.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:38.207+0000 7efd5efa4640 1 -- 172.21.15.19:0/4086320420 wait complete. 2024-09-19T08:50:38.519 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:38 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/4086320420' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:50:38.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:38 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/4086320420' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:50:38.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:38 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/4086320420' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:50:38.853 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:50:39.118 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:39.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:39 smithi019 ceph-mon[30976]: pgmap v288: 97 pgs: 97 active+clean; 606 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.9 KiB/s wr, 21 op/s 2024-09-19T08:50:39.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:39 smithi155 ceph-mon[34921]: pgmap v288: 97 pgs: 97 active+clean; 606 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.9 KiB/s wr, 21 op/s 2024-09-19T08:50:39.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.665+0000 7f064980c640 1 -- 172.21.15.19:0/2160278171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0644102d40 msgr2=0x7f0644103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:39.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.665+0000 7f064980c640 1 --2- 172.21.15.19:0/2160278171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0644102d40 0x7f0644103120 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0634009900 tx=0x7f063402a480 comp rx=0 tx=0).stop 2024-09-19T08:50:39.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.665+0000 7f064980c640 1 -- 172.21.15.19:0/2160278171 shutdown_connections 2024-09-19T08:50:39.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.665+0000 7f064980c640 1 --2- 172.21.15.19:0/2160278171 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f064410c170 0x7f064410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.665+0000 7f064980c640 1 --2- 172.21.15.19:0/2160278171 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0644103660 0x7f064410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.665+0000 7f064980c640 1 --2- 172.21.15.19:0/2160278171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0644102d40 0x7f0644103120 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.665+0000 7f064980c640 1 -- 172.21.15.19:0/2160278171 >> 172.21.15.19:0/2160278171 conn(0x7f06440fc7a0 msgr2=0x7f06440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:39.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.665+0000 7f064980c640 1 -- 172.21.15.19:0/2160278171 shutdown_connections 2024-09-19T08:50:39.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.665+0000 7f064980c640 1 -- 172.21.15.19:0/2160278171 wait complete. 2024-09-19T08:50:39.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.666+0000 7f064980c640 1 Processor -- start 2024-09-19T08:50:39.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.666+0000 7f064980c640 1 -- start start 2024-09-19T08:50:39.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.666+0000 7f064980c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0644102d40 0x7f0644198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:39.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.666+0000 7f064980c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0644103660 0x7f06441989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:39.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.666+0000 7f064980c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f064410c170 0x7f064419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:39.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.666+0000 7f064980c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0644111f70 con 0x7f064410c170 2024-09-19T08:50:39.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.666+0000 7f064980c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0644111df0 con 0x7f0644103660 2024-09-19T08:50:39.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.666+0000 7f064980c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f06441120f0 con 0x7f0644102d40 2024-09-19T08:50:39.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.666+0000 7f06437fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f064410c170 0x7f064419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:39.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.666+0000 7f06437fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f064410c170 0x7f064419cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40808/0 (socket says 172.21.15.19:40808) 2024-09-19T08:50:39.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.666+0000 7f06437fe640 1 -- 172.21.15.19:0/2496527319 learned_addr learned my addr 172.21.15.19:0/2496527319 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:50:39.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.666+0000 7f06427fc640 1 --2- 172.21.15.19:0/2496527319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0644103660 0x7f06441989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:39.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.666+0000 7f0642ffd640 1 --2- 172.21.15.19:0/2496527319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0644102d40 0x7f0644198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:39.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.667+0000 7f06437fe640 1 -- 172.21.15.19:0/2496527319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0644102d40 msgr2=0x7f0644198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:39.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.667+0000 7f06437fe640 1 --2- 172.21.15.19:0/2496527319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0644102d40 0x7f0644198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.667+0000 7f06437fe640 1 -- 172.21.15.19:0/2496527319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0644103660 msgr2=0x7f06441989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:39.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.667+0000 7f06437fe640 1 --2- 172.21.15.19:0/2496527319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0644103660 0x7f06441989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.667+0000 7f06437fe640 1 -- 172.21.15.19:0/2496527319 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f064419d420 con 0x7f064410c170 2024-09-19T08:50:39.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.667+0000 7f06437fe640 1 --2- 172.21.15.19:0/2496527319 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f064410c170 0x7f064419cd40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f063c00cad0 tx=0x7f063c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:39.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.667+0000 7f064880a640 1 -- 172.21.15.19:0/2496527319 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063c00ae20 con 0x7f064410c170 2024-09-19T08:50:39.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.667+0000 7f064980c640 1 -- 172.21.15.19:0/2496527319 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f064419d710 con 0x7f064410c170 2024-09-19T08:50:39.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.667+0000 7f064880a640 1 -- 172.21.15.19:0/2496527319 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f063c005020 con 0x7f064410c170 2024-09-19T08:50:39.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.667+0000 7f064880a640 1 -- 172.21.15.19:0/2496527319 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063c00f6f0 con 0x7f064410c170 2024-09-19T08:50:39.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.667+0000 7f064980c640 1 -- 172.21.15.19:0/2496527319 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06441a4ff0 con 0x7f064410c170 2024-09-19T08:50:39.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.668+0000 7f064980c640 1 -- 172.21.15.19:0/2496527319 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0644103120 con 0x7f064410c170 2024-09-19T08:50:39.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.669+0000 7f064880a640 1 -- 172.21.15.19:0/2496527319 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f063c0051d0 con 0x7f064410c170 2024-09-19T08:50:39.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.670+0000 7f064880a640 1 --2- 172.21.15.19:0/2496527319 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f062c0a32d0 0x7f062c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:39.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.670+0000 7f0642ffd640 1 --2- 172.21.15.19:0/2496527319 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f062c0a32d0 0x7f062c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:39.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.670+0000 7f064880a640 1 -- 172.21.15.19:0/2496527319 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f063c0cfa20 con 0x7f064410c170 2024-09-19T08:50:39.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.671+0000 7f0642ffd640 1 --2- 172.21.15.19:0/2496527319 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f062c0a32d0 0x7f062c0a5790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0634005ab0 tx=0x7f0634005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:39.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.674+0000 7f064880a640 1 -- 172.21.15.19:0/2496527319 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f063c014030 con 0x7f064410c170 2024-09-19T08:50:39.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:39 smithi203 ceph-mon[35450]: pgmap v288: 97 pgs: 97 active+clean; 606 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.9 KiB/s wr, 21 op/s 2024-09-19T08:50:39.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.852+0000 7f064980c640 1 -- 172.21.15.19:0/2496527319 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0644106c80 con 0x7f064410c170 2024-09-19T08:50:39.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.854+0000 7f064880a640 1 -- 172.21.15.19:0/2496527319 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22276 (secure 0 0 0) 0x7f063c09c690 con 0x7f064410c170 2024-09-19T08:50:39.854 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:50:39.854 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":80,"fsid":"f26c9d84-7662-11ef-bceb-c7b262605968","created":"2024-09-19T08:42:32.324073+0000","modified":"2024-09-19T08:50:16.477000+0000","last_up_change":"2024-09-19T08:49:24.764960+0000","last_in_change":"2024-09-19T08:49:01.062919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:45:36.232910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:50:12.615884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:50:14.854513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81c7bb06-5b13-4ee0-9290-d779faac1b91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6803","nonce":3397146732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6805","nonce":3397146732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6809","nonce":3397146732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6807","nonce":3397146732}]},"public_addr":"172.21.15.19:6803/3397146732","cluster_addr":"172.21.15.19:6805/3397146732","heartbeat_back_addr":"172.21.15.19:6809/3397146732","heartbeat_front_addr":"172.21.15.19:6807/3397146732","state":["exists","up"]},{"osd":1,"uuid":"24c145e6-5252-4708-8f25-5ce041e8251e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6801","nonce":2011043685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6803","nonce":2011043685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6807","nonce":2011043685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6805","nonce":2011043685}]},"public_addr":"172.21.15.155:6801/2011043685","cluster_addr":"172.21.15.155:6803/2011043685","heartbeat_back_addr":"172.21.15.155:6807/2011043685","heartbeat_front_addr":"172.21.15.155:6805/2011043685","state":["exists","up"]},{"osd":2,"uuid":"99cefd33-0675-495f-8871-2e6fdead0c3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6801","nonce":3358994623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6803","nonce":3358994623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6807","nonce":3358994623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6805","nonce":3358994623}]},"public_addr":"172.21.15.203:6801/3358994623","cluster_addr":"172.21.15.203:6803/3358994623","heartbeat_back_addr":"172.21.15.203:6807/3358994623","heartbeat_front_addr":"172.21.15.203:6805/3358994623","state":["exists","up"]},{"osd":3,"uuid":"8f46c16c-f17e-484a-8b66-6dbf135f34c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6811","nonce":176445576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6813","nonce":176445576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6817","nonce":176445576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6815","nonce":176445576}]},"public_addr":"172.21.15.19:6811/176445576","cluster_addr":"172.21.15.19:6813/176445576","heartbeat_back_addr":"172.21.15.19:6817/176445576","heartbeat_front_addr":"172.21.15.19:6815/176445576","state":["exists","up"]},{"osd":4,"uuid":"411b0423-1317-4e82-bc01-b5f55b391bc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6809","nonce":2163087792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6811","nonce":2163087792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6815","nonce":2163087792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6813","nonce":2163087792}]},"public_addr":"172.21.15.155:6809/2163087792","cluster_addr":"172.21.15.155:6811/2163087792","heartbeat_back_addr":"172.21.15.155:6815/2163087792","heartbeat_front_addr":"172.21.15.155:6813/2163087792","state":["exists","up"]},{"osd":5,"uuid":"057c073e-569f-4c6e-9602-e1169ad4dd8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6809","nonce":334881465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6811","nonce":334881465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6815","nonce":334881465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6813","nonce":334881465}]},"public_addr":"172.21.15.203:6809/334881465","cluster_addr":"172.21.15.203:6811/334881465","heartbeat_back_addr":"172.21.15.203:6815/334881465","heartbeat_front_addr":"172.21.15.203:6813/334881465","state":["exists","up"]},{"osd":6,"uuid":"40418f13-823e-4f94-a427-84781abbcb5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6819","nonce":2669779791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6821","nonce":2669779791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6825","nonce":2669779791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6823","nonce":2669779791}]},"public_addr":"172.21.15.19:6819/2669779791","cluster_addr":"172.21.15.19:6821/2669779791","heartbeat_back_addr":"172.21.15.19:6825/2669779791","heartbeat_front_addr":"172.21.15.19:6823/2669779791","state":["exists","up"]},{"osd":7,"uuid":"ad15f762-aeab-4167-a63d-6c9f9b89b9c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6817","nonce":3169455907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6819","nonce":3169455907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6823","nonce":3169455907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6821","nonce":3169455907}]},"public_addr":"172.21.15.155:6817/3169455907","cluster_addr":"172.21.15.155:6819/3169455907","heartbeat_back_addr":"172.21.15.155:6823/3169455907","heartbeat_front_addr":"172.21.15.155:6821/3169455907","state":["exists","up"]},{"osd":8,"uuid":"23cf8ea2-29d6-43d8-a05b-7822f4bbf254","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6817","nonce":1062999528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6819","nonce":1062999528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6823","nonce":1062999528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6821","nonce":1062999528}]},"public_addr":"172.21.15.203:6817/1062999528","cluster_addr":"172.21.15.203:6819/1062999528","heartbeat_back_addr":"172.21.15.203:6823/1062999528","heartbeat_front_addr":"172.21.15.203:6821/1062999528","state":["exists","up"]},{"osd":9,"uuid":"e851e605-2d17-4fbf-b783-2138133edd06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6827","nonce":574664786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6829","nonce":574664786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6833","nonce":574664786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6831","nonce":574664786}]},"public_addr":"172.21.15.19:6827/574664786","cluster_addr":"172.21.15.19:6829/574664786","heartbeat_back_addr":"172.21.15.19:6833/574664786","heartbeat_front_addr":"172.21.15.19:6831/574664786","state":["exists","up"]},{"osd":10,"uuid":"cc770717-91bd-4494-9103-6db8214b5872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6825","nonce":2242158832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6827","nonce":2242158832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6831","nonce":2242158832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6829","nonce":2242158832}]},"public_addr":"172.21.15.155:6825/2242158832","cluster_addr":"172.21.15.155:6827/2242158832","heartbeat_back_addr":"172.21.15.155:6831/2242158832","heartbeat_front_addr":"172.21.15.155:6829/2242158832","state":["exists","up"]},{"osd":11,"uuid":"6c237db9-5d79-47bc-8ff6-60d09d721d5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6825","nonce":522943955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6827","nonce":522943955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6831","nonce":522943955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6829","nonce":522943955}]},"public_addr":"172.21.15.203:6825/522943955","cluster_addr":"172.21.15.203:6827/522943955","heartbeat_back_addr":"172.21.15.203:6831/522943955","heartbeat_front_addr":"172.21.15.203:6829/522943955","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:44:44.656414+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:09.339183+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:33.245452+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:59.449025+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:46:24.831213+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:46:49.189780+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:47:13.493628+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:47:39.478247+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:05.089875+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:30.722878+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:56.951834+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:22.894678+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6801/4266644067":"2024-09-20T08:43:21.732222+0000","172.21.15.19:0/1398782170":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6800/4266644067":"2024-09-20T08:43:21.732222+0000","172.21.15.19:0/34162461":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6801/1764769529":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/2910961714":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6800/1764769529":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/820792769":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/560203138":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/809642328":"2024-09-20T08:42:56.618773+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:50:39.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.857+0000 7f064980c640 1 -- 172.21.15.19:0/2496527319 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f062c0a32d0 msgr2=0x7f062c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:39.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.857+0000 7f064980c640 1 --2- 172.21.15.19:0/2496527319 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f062c0a32d0 0x7f062c0a5790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0634005ab0 tx=0x7f0634005a20 comp rx=0 tx=0).stop 2024-09-19T08:50:39.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.857+0000 7f064980c640 1 -- 172.21.15.19:0/2496527319 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f064410c170 msgr2=0x7f064419cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:39.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.857+0000 7f064980c640 1 --2- 172.21.15.19:0/2496527319 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f064410c170 0x7f064419cd40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f063c00cad0 tx=0x7f063c00cf90 comp rx=0 tx=0).stop 2024-09-19T08:50:39.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.857+0000 7f064980c640 1 -- 172.21.15.19:0/2496527319 shutdown_connections 2024-09-19T08:50:39.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.857+0000 7f064980c640 1 --2- 172.21.15.19:0/2496527319 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f062c0a32d0 0x7f062c0a5790 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.857+0000 7f064980c640 1 --2- 172.21.15.19:0/2496527319 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f064410c170 0x7f064419cd40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.857+0000 7f064980c640 1 --2- 172.21.15.19:0/2496527319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0644103660 0x7f06441989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.857+0000 7f064980c640 1 --2- 172.21.15.19:0/2496527319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0644102d40 0x7f0644198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:39.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.857+0000 7f064980c640 1 -- 172.21.15.19:0/2496527319 >> 172.21.15.19:0/2496527319 conn(0x7f06440fc7a0 msgr2=0x7f06440fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:39.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.857+0000 7f064980c640 1 -- 172.21.15.19:0/2496527319 shutdown_connections 2024-09-19T08:50:39.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:39.857+0000 7f064980c640 1 -- 172.21.15.19:0/2496527319 wait complete. 2024-09-19T08:50:40.591 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T08:50:40.591 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:50:40.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:40 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/2496527319' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:50:40.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:40 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/2496527319' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:50:40.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:40 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/2496527319' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:50:40.854 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:41.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.314+0000 7f065e0b8640 1 -- 172.21.15.19:0/3868040459 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0658102ef0 msgr2=0x7f065810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:41.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.314+0000 7f065e0b8640 1 --2- 172.21.15.19:0/3868040459 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0658102ef0 0x7f065810da40 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0650009ca0 tx=0x7f065002a950 comp rx=0 tx=0).stop 2024-09-19T08:50:41.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.314+0000 7f065e0b8640 1 -- 172.21.15.19:0/3868040459 shutdown_connections 2024-09-19T08:50:41.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.314+0000 7f065e0b8640 1 --2- 172.21.15.19:0/3868040459 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0658102570 0x7f06581029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:41.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.314+0000 7f065e0b8640 1 --2- 172.21.15.19:0/3868040459 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0658102ef0 0x7f065810da40 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:41.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.314+0000 7f065e0b8640 1 --2- 172.21.15.19:0/3868040459 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0658100e20 0x7f0658101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:41.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.314+0000 7f065e0b8640 1 -- 172.21.15.19:0/3868040459 >> 172.21.15.19:0/3868040459 conn(0x7f06580fc7d0 msgr2=0x7f06580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:41.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.314+0000 7f065e0b8640 1 -- 172.21.15.19:0/3868040459 shutdown_connections 2024-09-19T08:50:41.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.314+0000 7f065e0b8640 1 -- 172.21.15.19:0/3868040459 wait complete. 2024-09-19T08:50:41.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.314+0000 7f065e0b8640 1 Processor -- start 2024-09-19T08:50:41.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.315+0000 7f065e0b8640 1 -- start start 2024-09-19T08:50:41.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.315+0000 7f065e0b8640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0658100e20 0x7f06580fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:41.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.315+0000 7f065e0b8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0658102570 0x7f06580fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:41.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.315+0000 7f065e0b8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0658102ef0 0x7f06580fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:41.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.315+0000 7f065e0b8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0658110f80 con 0x7f0658102570 2024-09-19T08:50:41.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.315+0000 7f065e0b8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0658110e00 con 0x7f0658102ef0 2024-09-19T08:50:41.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.315+0000 7f065e0b8640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0658111100 con 0x7f0658100e20 2024-09-19T08:50:41.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.315+0000 7f0656ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0658102570 0x7f06580fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:41.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.315+0000 7f0656ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0658102570 0x7f06580fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40830/0 (socket says 172.21.15.19:40830) 2024-09-19T08:50:41.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.315+0000 7f0656ffd640 1 -- 172.21.15.19:0/518137628 learned_addr learned my addr 172.21.15.19:0/518137628 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:50:41.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.315+0000 7f06577fe640 1 --2- 172.21.15.19:0/518137628 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0658100e20 0x7f06580fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:41.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.315+0000 7f0657fff640 1 --2- 172.21.15.19:0/518137628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0658102ef0 0x7f06580fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:41.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.315+0000 7f0656ffd640 1 -- 172.21.15.19:0/518137628 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0658100e20 msgr2=0x7f06580fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:41.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.315+0000 7f0656ffd640 1 --2- 172.21.15.19:0/518137628 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0658100e20 0x7f06580fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:41.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.315+0000 7f0656ffd640 1 -- 172.21.15.19:0/518137628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0658102ef0 msgr2=0x7f06580fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:41.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.315+0000 7f0656ffd640 1 --2- 172.21.15.19:0/518137628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0658102ef0 0x7f06580fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:41.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.315+0000 7f0656ffd640 1 -- 172.21.15.19:0/518137628 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06581a6920 con 0x7f0658102570 2024-09-19T08:50:41.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.315+0000 7f0657fff640 1 --2- 172.21.15.19:0/518137628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0658102ef0 0x7f06580fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:50:41.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.315+0000 7f0656ffd640 1 --2- 172.21.15.19:0/518137628 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0658102570 0x7f06580fd1c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f064c00c920 tx=0x7f064c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:41.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.315+0000 7f0654ff9640 1 -- 172.21.15.19:0/518137628 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f064c007c70 con 0x7f0658102570 2024-09-19T08:50:41.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.315+0000 7f0654ff9640 1 -- 172.21.15.19:0/518137628 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f064c007e10 con 0x7f0658102570 2024-09-19T08:50:41.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.315+0000 7f065e0b8640 1 -- 172.21.15.19:0/518137628 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06581a6c10 con 0x7f0658102570 2024-09-19T08:50:41.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.315+0000 7f0654ff9640 1 -- 172.21.15.19:0/518137628 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f064c018890 con 0x7f0658102570 2024-09-19T08:50:41.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.316+0000 7f065e0b8640 1 -- 172.21.15.19:0/518137628 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06581a71a0 con 0x7f0658102570 2024-09-19T08:50:41.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.317+0000 7f065e0b8640 1 -- 172.21.15.19:0/518137628 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0658101200 con 0x7f0658102570 2024-09-19T08:50:41.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.318+0000 7f0654ff9640 1 -- 172.21.15.19:0/518137628 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f064c018a70 con 0x7f0658102570 2024-09-19T08:50:41.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.318+0000 7f0654ff9640 1 --2- 172.21.15.19:0/518137628 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f06400a3350 0x7f06400a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:41.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.319+0000 7f06577fe640 1 --2- 172.21.15.19:0/518137628 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f06400a3350 0x7f06400a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:41.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.319+0000 7f0654ff9640 1 -- 172.21.15.19:0/518137628 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f064c0cfa20 con 0x7f0658102570 2024-09-19T08:50:41.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.319+0000 7f06577fe640 1 --2- 172.21.15.19:0/518137628 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f06400a3350 0x7f06400a5810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f06480058c0 tx=0x7f064800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:41.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.323+0000 7f0654ff9640 1 -- 172.21.15.19:0/518137628 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f064c014030 con 0x7f0658102570 2024-09-19T08:50:41.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.494+0000 7f065e0b8640 1 -- 172.21.15.19:0/518137628 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0658062630 con 0x7f06400a3350 2024-09-19T08:50:41.495 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:41 smithi019 ceph-mon[30976]: pgmap v289: 97 pgs: 97 active+clean; 630 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 19 op/s 2024-09-19T08:50:41.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.501+0000 7f0654ff9640 1 -- 172.21.15.19:0/518137628 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258888 (secure 0 0 0) 0x7f0658062630 con 0x7f06400a3350 2024-09-19T08:50:41.504 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:50:41.506 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-19T08:50:41.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.505+0000 7f065e0b8640 1 -- 172.21.15.19:0/518137628 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f06400a3350 msgr2=0x7f06400a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:41.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.505+0000 7f065e0b8640 1 --2- 172.21.15.19:0/518137628 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f06400a3350 0x7f06400a5810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f06480058c0 tx=0x7f064800a2d0 comp rx=0 tx=0).stop 2024-09-19T08:50:41.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.505+0000 7f065e0b8640 1 -- 172.21.15.19:0/518137628 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0658102570 msgr2=0x7f06580fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:41.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.505+0000 7f065e0b8640 1 --2- 172.21.15.19:0/518137628 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0658102570 0x7f06580fd1c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f064c00c920 tx=0x7f064c00cde0 comp rx=0 tx=0).stop 2024-09-19T08:50:41.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.505+0000 7f065e0b8640 1 -- 172.21.15.19:0/518137628 shutdown_connections 2024-09-19T08:50:41.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.505+0000 7f065e0b8640 1 --2- 172.21.15.19:0/518137628 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f06400a3350 0x7f06400a5810 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:41.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.505+0000 7f065e0b8640 1 --2- 172.21.15.19:0/518137628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0658102ef0 0x7f06580fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:41.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.505+0000 7f065e0b8640 1 --2- 172.21.15.19:0/518137628 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0658102570 0x7f06580fd1c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:41.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.505+0000 7f065e0b8640 1 --2- 172.21.15.19:0/518137628 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0658100e20 0x7f06580fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:41.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.505+0000 7f065e0b8640 1 -- 172.21.15.19:0/518137628 >> 172.21.15.19:0/518137628 conn(0x7f06580fc7d0 msgr2=0x7f065806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:41.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.505+0000 7f065e0b8640 1 -- 172.21.15.19:0/518137628 shutdown_connections 2024-09-19T08:50:41.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:41.505+0000 7f065e0b8640 1 -- 172.21.15.19:0/518137628 wait complete. 2024-09-19T08:50:41.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:41 smithi155 ceph-mon[34921]: pgmap v289: 97 pgs: 97 active+clean; 630 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 19 op/s 2024-09-19T08:50:41.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:41 smithi203 ceph-mon[35450]: pgmap v289: 97 pgs: 97 active+clean; 630 KiB data, 347 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 19 op/s 2024-09-19T08:50:42.191 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":289,"stamp":"2024-09-19T08:50:39.844668+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":644612,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":260,"num_read_kb":240,"num_write":414,"num_write_kb":3057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":339,"ondisk_log_size":339,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":355828,"kb_used_data":10740,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585996,"statfs":{"total":1151940427776,"available":1151576059904,"internally_reserved":0,"allocated":10997760,"data_stored":6890158,"data_compressed":107538,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19142,"internal_metadata":353154362},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":48384,"num_objects":33,"num_object_clones":0,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":134,"num_read_kb":131,"num_write":95,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003299"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.885166+0000","last_change":"2024-09-19T08:50:15.893270+0000","last_active":"2024-09-19T08:50:16.885166+0000","last_peered":"2024-09-19T08:50:16.885166+0000","last_clean":"2024-09-19T08:50:16.885166+0000","last_became_active":"2024-09-19T08:50:15.892020+0000","last_became_peered":"2024-09-19T08:50:15.892020+0000","last_unstale":"2024-09-19T08:50:16.885166+0000","last_undegraded":"2024-09-19T08:50:16.885166+0000","last_fullsized":"2024-09-19T08:50:16.885166+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:40.846708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877980+0000","last_change":"2024-09-19T08:50:15.889331+0000","last_active":"2024-09-19T08:50:16.877980+0000","last_peered":"2024-09-19T08:50:16.877980+0000","last_clean":"2024-09-19T08:50:16.877980+0000","last_became_active":"2024-09-19T08:50:15.887082+0000","last_became_peered":"2024-09-19T08:50:15.887082+0000","last_unstale":"2024-09-19T08:50:16.877980+0000","last_undegraded":"2024-09-19T08:50:16.877980+0000","last_fullsized":"2024-09-19T08:50:16.877980+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:46.934172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877371+0000","last_change":"2024-09-19T08:50:15.891714+0000","last_active":"2024-09-19T08:50:16.877371+0000","last_peered":"2024-09-19T08:50:16.877371+0000","last_clean":"2024-09-19T08:50:16.877371+0000","last_became_active":"2024-09-19T08:50:15.891380+0000","last_became_peered":"2024-09-19T08:50:15.891380+0000","last_unstale":"2024-09-19T08:50:16.877371+0000","last_undegraded":"2024-09-19T08:50:16.877371+0000","last_fullsized":"2024-09-19T08:50:16.877371+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:02.203252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.880548+0000","last_change":"2024-09-19T08:50:15.896157+0000","last_active":"2024-09-19T08:50:16.880548+0000","last_peered":"2024-09-19T08:50:16.880548+0000","last_clean":"2024-09-19T08:50:16.880548+0000","last_became_active":"2024-09-19T08:50:15.895772+0000","last_became_peered":"2024-09-19T08:50:15.895772+0000","last_unstale":"2024-09-19T08:50:16.880548+0000","last_undegraded":"2024-09-19T08:50:16.880548+0000","last_fullsized":"2024-09-19T08:50:16.880548+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:12.915745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877401+0000","last_change":"2024-09-19T08:50:15.886600+0000","last_active":"2024-09-19T08:50:16.877401+0000","last_peered":"2024-09-19T08:50:16.877401+0000","last_clean":"2024-09-19T08:50:16.877401+0000","last_became_active":"2024-09-19T08:50:15.886270+0000","last_became_peered":"2024-09-19T08:50:15.886270+0000","last_unstale":"2024-09-19T08:50:16.877401+0000","last_undegraded":"2024-09-19T08:50:16.877401+0000","last_fullsized":"2024-09-19T08:50:16.877401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:53.779930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869832+0000","last_change":"2024-09-19T08:50:15.889475+0000","last_active":"2024-09-19T08:50:16.869832+0000","last_peered":"2024-09-19T08:50:16.869832+0000","last_clean":"2024-09-19T08:50:16.869832+0000","last_became_active":"2024-09-19T08:50:15.889134+0000","last_became_peered":"2024-09-19T08:50:15.889134+0000","last_unstale":"2024-09-19T08:50:16.869832+0000","last_undegraded":"2024-09-19T08:50:16.869832+0000","last_fullsized":"2024-09-19T08:50:16.869832+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:53.977662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877346+0000","last_change":"2024-09-19T08:50:15.897163+0000","last_active":"2024-09-19T08:50:16.877346+0000","last_peered":"2024-09-19T08:50:16.877346+0000","last_clean":"2024-09-19T08:50:16.877346+0000","last_became_active":"2024-09-19T08:50:15.895161+0000","last_became_peered":"2024-09-19T08:50:15.895161+0000","last_unstale":"2024-09-19T08:50:16.877346+0000","last_undegraded":"2024-09-19T08:50:16.877346+0000","last_fullsized":"2024-09-19T08:50:16.877346+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:32.432691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869011+0000","last_change":"2024-09-19T08:50:15.891197+0000","last_active":"2024-09-19T08:50:16.869011+0000","last_peered":"2024-09-19T08:50:16.869011+0000","last_clean":"2024-09-19T08:50:16.869011+0000","last_became_active":"2024-09-19T08:50:15.890880+0000","last_became_peered":"2024-09-19T08:50:15.890880+0000","last_unstale":"2024-09-19T08:50:16.869011+0000","last_undegraded":"2024-09-19T08:50:16.869011+0000","last_fullsized":"2024-09-19T08:50:16.869011+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:41.100341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877991+0000","last_change":"2024-09-19T08:50:15.896043+0000","last_active":"2024-09-19T08:50:16.877991+0000","last_peered":"2024-09-19T08:50:16.877991+0000","last_clean":"2024-09-19T08:50:16.877991+0000","last_became_active":"2024-09-19T08:50:15.895498+0000","last_became_peered":"2024-09-19T08:50:15.895498+0000","last_unstale":"2024-09-19T08:50:16.877991+0000","last_undegraded":"2024-09-19T08:50:16.877991+0000","last_fullsized":"2024-09-19T08:50:16.877991+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:57.956427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.870481+0000","last_change":"2024-09-19T08:50:15.887658+0000","last_active":"2024-09-19T08:50:16.870481+0000","last_peered":"2024-09-19T08:50:16.870481+0000","last_clean":"2024-09-19T08:50:16.870481+0000","last_became_active":"2024-09-19T08:50:15.887199+0000","last_became_peered":"2024-09-19T08:50:15.887199+0000","last_unstale":"2024-09-19T08:50:16.870481+0000","last_undegraded":"2024-09-19T08:50:16.870481+0000","last_fullsized":"2024-09-19T08:50:16.870481+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:39.947735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876931+0000","last_change":"2024-09-19T08:50:15.894865+0000","last_active":"2024-09-19T08:50:16.876931+0000","last_peered":"2024-09-19T08:50:16.876931+0000","last_clean":"2024-09-19T08:50:16.876931+0000","last_became_active":"2024-09-19T08:50:15.894475+0000","last_became_peered":"2024-09-19T08:50:15.894475+0000","last_unstale":"2024-09-19T08:50:16.876931+0000","last_undegraded":"2024-09-19T08:50:16.876931+0000","last_fullsized":"2024-09-19T08:50:16.876931+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:43.235991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.880654+0000","last_change":"2024-09-19T08:50:15.897209+0000","last_active":"2024-09-19T08:50:16.880654+0000","last_peered":"2024-09-19T08:50:16.880654+0000","last_clean":"2024-09-19T08:50:16.880654+0000","last_became_active":"2024-09-19T08:50:15.896866+0000","last_became_peered":"2024-09-19T08:50:15.896866+0000","last_unstale":"2024-09-19T08:50:16.880654+0000","last_undegraded":"2024-09-19T08:50:16.880654+0000","last_fullsized":"2024-09-19T08:50:16.880654+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:23.036534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876974+0000","last_change":"2024-09-19T08:50:15.890076+0000","last_active":"2024-09-19T08:50:16.876974+0000","last_peered":"2024-09-19T08:50:16.876974+0000","last_clean":"2024-09-19T08:50:16.876974+0000","last_became_active":"2024-09-19T08:50:15.889735+0000","last_became_peered":"2024-09-19T08:50:15.889735+0000","last_unstale":"2024-09-19T08:50:16.876974+0000","last_undegraded":"2024-09-19T08:50:16.876974+0000","last_fullsized":"2024-09-19T08:50:16.876974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:25.602757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877013+0000","last_change":"2024-09-19T08:50:15.886739+0000","last_active":"2024-09-19T08:50:16.877013+0000","last_peered":"2024-09-19T08:50:16.877013+0000","last_clean":"2024-09-19T08:50:16.877013+0000","last_became_active":"2024-09-19T08:50:15.886313+0000","last_became_peered":"2024-09-19T08:50:15.886313+0000","last_unstale":"2024-09-19T08:50:16.877013+0000","last_undegraded":"2024-09-19T08:50:16.877013+0000","last_fullsized":"2024-09-19T08:50:16.877013+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:03.244674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876731+0000","last_change":"2024-09-19T08:50:15.898519+0000","last_active":"2024-09-19T08:50:16.876731+0000","last_peered":"2024-09-19T08:50:16.876731+0000","last_clean":"2024-09-19T08:50:16.876731+0000","last_became_active":"2024-09-19T08:50:15.898249+0000","last_became_peered":"2024-09-19T08:50:15.898249+0000","last_unstale":"2024-09-19T08:50:16.876731+0000","last_undegraded":"2024-09-19T08:50:16.876731+0000","last_fullsized":"2024-09-19T08:50:16.876731+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:32.318895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876236+0000","last_change":"2024-09-19T08:50:15.890324+0000","last_active":"2024-09-19T08:50:16.876236+0000","last_peered":"2024-09-19T08:50:16.876236+0000","last_clean":"2024-09-19T08:50:16.876236+0000","last_became_active":"2024-09-19T08:50:15.887345+0000","last_became_peered":"2024-09-19T08:50:15.887345+0000","last_unstale":"2024-09-19T08:50:16.876236+0000","last_undegraded":"2024-09-19T08:50:16.876236+0000","last_fullsized":"2024-09-19T08:50:16.876236+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:27.989128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.885345+0000","last_change":"2024-09-19T08:50:15.896305+0000","last_active":"2024-09-19T08:50:16.885345+0000","last_peered":"2024-09-19T08:50:16.885345+0000","last_clean":"2024-09-19T08:50:16.885345+0000","last_became_active":"2024-09-19T08:50:15.895832+0000","last_became_peered":"2024-09-19T08:50:15.895832+0000","last_unstale":"2024-09-19T08:50:16.885345+0000","last_undegraded":"2024-09-19T08:50:16.885345+0000","last_fullsized":"2024-09-19T08:50:16.885345+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:37.098237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.880615+0000","last_change":"2024-09-19T08:50:15.887251+0000","last_active":"2024-09-19T08:50:16.880615+0000","last_peered":"2024-09-19T08:50:16.880615+0000","last_clean":"2024-09-19T08:50:16.880615+0000","last_became_active":"2024-09-19T08:50:15.886936+0000","last_became_peered":"2024-09-19T08:50:15.886936+0000","last_unstale":"2024-09-19T08:50:16.880615+0000","last_undegraded":"2024-09-19T08:50:16.880615+0000","last_fullsized":"2024-09-19T08:50:16.880615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:38:08.828246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877371+0000","last_change":"2024-09-19T08:50:15.884813+0000","last_active":"2024-09-19T08:50:16.877371+0000","last_peered":"2024-09-19T08:50:16.877371+0000","last_clean":"2024-09-19T08:50:16.877371+0000","last_became_active":"2024-09-19T08:50:15.883445+0000","last_became_peered":"2024-09-19T08:50:15.883445+0000","last_unstale":"2024-09-19T08:50:16.877371+0000","last_undegraded":"2024-09-19T08:50:16.877371+0000","last_fullsized":"2024-09-19T08:50:16.877371+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:39.733501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.884301+0000","last_change":"2024-09-19T08:50:15.887644+0000","last_active":"2024-09-19T08:50:16.884301+0000","last_peered":"2024-09-19T08:50:16.884301+0000","last_clean":"2024-09-19T08:50:16.884301+0000","last_became_active":"2024-09-19T08:50:15.887224+0000","last_became_peered":"2024-09-19T08:50:15.887224+0000","last_unstale":"2024-09-19T08:50:16.884301+0000","last_undegraded":"2024-09-19T08:50:16.884301+0000","last_fullsized":"2024-09-19T08:50:16.884301+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:35.883690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.878822+0000","last_change":"2024-09-19T08:50:15.886678+0000","last_active":"2024-09-19T08:50:16.878822+0000","last_peered":"2024-09-19T08:50:16.878822+0000","last_clean":"2024-09-19T08:50:16.878822+0000","last_became_active":"2024-09-19T08:50:15.886360+0000","last_became_peered":"2024-09-19T08:50:15.886360+0000","last_unstale":"2024-09-19T08:50:16.878822+0000","last_undegraded":"2024-09-19T08:50:16.878822+0000","last_fullsized":"2024-09-19T08:50:16.878822+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:51.515211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876586+0000","last_change":"2024-09-19T08:50:15.887607+0000","last_active":"2024-09-19T08:50:16.876586+0000","last_peered":"2024-09-19T08:50:16.876586+0000","last_clean":"2024-09-19T08:50:16.876586+0000","last_became_active":"2024-09-19T08:50:15.887266+0000","last_became_peered":"2024-09-19T08:50:15.887266+0000","last_unstale":"2024-09-19T08:50:16.876586+0000","last_undegraded":"2024-09-19T08:50:16.876586+0000","last_fullsized":"2024-09-19T08:50:16.876586+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:44:57.404160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.868953+0000","last_change":"2024-09-19T08:50:15.882651+0000","last_active":"2024-09-19T08:50:16.868953+0000","last_peered":"2024-09-19T08:50:16.868953+0000","last_clean":"2024-09-19T08:50:16.868953+0000","last_became_active":"2024-09-19T08:50:15.882298+0000","last_became_peered":"2024-09-19T08:50:15.882298+0000","last_unstale":"2024-09-19T08:50:16.868953+0000","last_undegraded":"2024-09-19T08:50:16.868953+0000","last_fullsized":"2024-09-19T08:50:16.868953+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:16.028013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869849+0000","last_change":"2024-09-19T08:50:15.880407+0000","last_active":"2024-09-19T08:50:16.869849+0000","last_peered":"2024-09-19T08:50:16.869849+0000","last_clean":"2024-09-19T08:50:16.869849+0000","last_became_active":"2024-09-19T08:50:15.880026+0000","last_became_peered":"2024-09-19T08:50:15.880026+0000","last_unstale":"2024-09-19T08:50:16.869849+0000","last_undegraded":"2024-09-19T08:50:16.869849+0000","last_fullsized":"2024-09-19T08:50:16.869849+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:16.600913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869489+0000","last_change":"2024-09-19T08:50:15.883573+0000","last_active":"2024-09-19T08:50:16.869489+0000","last_peered":"2024-09-19T08:50:16.869489+0000","last_clean":"2024-09-19T08:50:16.869489+0000","last_became_active":"2024-09-19T08:50:15.883258+0000","last_became_peered":"2024-09-19T08:50:15.883258+0000","last_unstale":"2024-09-19T08:50:16.869489+0000","last_undegraded":"2024-09-19T08:50:16.869489+0000","last_fullsized":"2024-09-19T08:50:16.869489+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:33.026579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877624+0000","last_change":"2024-09-19T08:50:15.889519+0000","last_active":"2024-09-19T08:50:16.877624+0000","last_peered":"2024-09-19T08:50:16.877624+0000","last_clean":"2024-09-19T08:50:16.877624+0000","last_became_active":"2024-09-19T08:50:15.889183+0000","last_became_peered":"2024-09-19T08:50:15.889183+0000","last_unstale":"2024-09-19T08:50:16.877624+0000","last_undegraded":"2024-09-19T08:50:16.877624+0000","last_fullsized":"2024-09-19T08:50:16.877624+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:06.725662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.884752+0000","last_change":"2024-09-19T08:50:15.894483+0000","last_active":"2024-09-19T08:50:16.884752+0000","last_peered":"2024-09-19T08:50:16.884752+0000","last_clean":"2024-09-19T08:50:16.884752+0000","last_became_active":"2024-09-19T08:50:15.893760+0000","last_became_peered":"2024-09-19T08:50:15.893760+0000","last_unstale":"2024-09-19T08:50:16.884752+0000","last_undegraded":"2024-09-19T08:50:16.884752+0000","last_fullsized":"2024-09-19T08:50:16.884752+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:23.686592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876894+0000","last_change":"2024-09-19T08:50:15.882393+0000","last_active":"2024-09-19T08:50:16.876894+0000","last_peered":"2024-09-19T08:50:16.876894+0000","last_clean":"2024-09-19T08:50:16.876894+0000","last_became_active":"2024-09-19T08:50:15.882040+0000","last_became_peered":"2024-09-19T08:50:15.882040+0000","last_unstale":"2024-09-19T08:50:16.876894+0000","last_undegraded":"2024-09-19T08:50:16.876894+0000","last_fullsized":"2024-09-19T08:50:16.876894+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:22.430017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.878384+0000","last_change":"2024-09-19T08:50:15.890919+0000","last_active":"2024-09-19T08:50:16.878384+0000","last_peered":"2024-09-19T08:50:16.878384+0000","last_clean":"2024-09-19T08:50:16.878384+0000","last_became_active":"2024-09-19T08:50:15.890256+0000","last_became_peered":"2024-09-19T08:50:15.890256+0000","last_unstale":"2024-09-19T08:50:16.878384+0000","last_undegraded":"2024-09-19T08:50:16.878384+0000","last_fullsized":"2024-09-19T08:50:16.878384+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:48.404890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877173+0000","last_change":"2024-09-19T08:50:15.888139+0000","last_active":"2024-09-19T08:50:16.877173+0000","last_peered":"2024-09-19T08:50:16.877173+0000","last_clean":"2024-09-19T08:50:16.877173+0000","last_became_active":"2024-09-19T08:50:15.886471+0000","last_became_peered":"2024-09-19T08:50:15.886471+0000","last_unstale":"2024-09-19T08:50:16.877173+0000","last_undegraded":"2024-09-19T08:50:16.877173+0000","last_fullsized":"2024-09-19T08:50:16.877173+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:20.545473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877882+0000","last_change":"2024-09-19T08:50:15.891354+0000","last_active":"2024-09-19T08:50:16.877882+0000","last_peered":"2024-09-19T08:50:16.877882+0000","last_clean":"2024-09-19T08:50:16.877882+0000","last_became_active":"2024-09-19T08:50:15.890900+0000","last_became_peered":"2024-09-19T08:50:15.890900+0000","last_unstale":"2024-09-19T08:50:16.877882+0000","last_undegraded":"2024-09-19T08:50:16.877882+0000","last_fullsized":"2024-09-19T08:50:16.877882+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:33.139637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.884989+0000","last_change":"2024-09-19T08:50:15.891501+0000","last_active":"2024-09-19T08:50:16.884989+0000","last_peered":"2024-09-19T08:50:16.884989+0000","last_clean":"2024-09-19T08:50:16.884989+0000","last_became_active":"2024-09-19T08:50:15.891183+0000","last_became_peered":"2024-09-19T08:50:15.891183+0000","last_unstale":"2024-09-19T08:50:16.884989+0000","last_undegraded":"2024-09-19T08:50:16.884989+0000","last_fullsized":"2024-09-19T08:50:16.884989+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:16.976705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877858+0000","last_change":"2024-09-19T08:50:15.882048+0000","last_active":"2024-09-19T08:50:16.877858+0000","last_peered":"2024-09-19T08:50:16.877858+0000","last_clean":"2024-09-19T08:50:16.877858+0000","last_became_active":"2024-09-19T08:50:15.881156+0000","last_became_peered":"2024-09-19T08:50:15.881156+0000","last_unstale":"2024-09-19T08:50:16.877858+0000","last_undegraded":"2024-09-19T08:50:16.877858+0000","last_fullsized":"2024-09-19T08:50:16.877858+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:33.198852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:33.957395+0000","last_change":"2024-09-19T08:50:13.800156+0000","last_active":"2024-09-19T08:50:33.957395+0000","last_peered":"2024-09-19T08:50:33.957395+0000","last_clean":"2024-09-19T08:50:33.957395+0000","last_became_active":"2024-09-19T08:50:13.799779+0000","last_became_peered":"2024-09-19T08:50:13.799779+0000","last_unstale":"2024-09-19T08:50:33.957395+0000","last_undegraded":"2024-09-19T08:50:33.957395+0000","last_fullsized":"2024-09-19T08:50:33.957395+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:38.033049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869794+0000","last_change":"2024-09-19T08:50:15.887252+0000","last_active":"2024-09-19T08:50:16.869794+0000","last_peered":"2024-09-19T08:50:16.869794+0000","last_clean":"2024-09-19T08:50:16.869794+0000","last_became_active":"2024-09-19T08:50:15.886899+0000","last_became_peered":"2024-09-19T08:50:15.886899+0000","last_unstale":"2024-09-19T08:50:16.869794+0000","last_undegraded":"2024-09-19T08:50:16.869794+0000","last_fullsized":"2024-09-19T08:50:16.869794+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:56.262387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:25.932594+0000","last_change":"2024-09-19T08:50:13.795380+0000","last_active":"2024-09-19T08:50:25.932594+0000","last_peered":"2024-09-19T08:50:25.932594+0000","last_clean":"2024-09-19T08:50:25.932594+0000","last_became_active":"2024-09-19T08:50:13.794944+0000","last_became_peered":"2024-09-19T08:50:13.794944+0000","last_unstale":"2024-09-19T08:50:25.932594+0000","last_undegraded":"2024-09-19T08:50:25.932594+0000","last_fullsized":"2024-09-19T08:50:25.932594+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:14.317408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:24.924364+0000","last_change":"2024-09-19T08:50:13.794010+0000","last_active":"2024-09-19T08:50:24.924364+0000","last_peered":"2024-09-19T08:50:24.924364+0000","last_clean":"2024-09-19T08:50:24.924364+0000","last_became_active":"2024-09-19T08:50:13.793677+0000","last_became_peered":"2024-09-19T08:50:13.793677+0000","last_unstale":"2024-09-19T08:50:24.924364+0000","last_undegraded":"2024-09-19T08:50:24.924364+0000","last_fullsized":"2024-09-19T08:50:24.924364+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:56.125702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869056+0000","last_change":"2024-09-19T08:50:15.881732+0000","last_active":"2024-09-19T08:50:16.869056+0000","last_peered":"2024-09-19T08:50:16.869056+0000","last_clean":"2024-09-19T08:50:16.869056+0000","last_became_active":"2024-09-19T08:50:15.881394+0000","last_became_peered":"2024-09-19T08:50:15.881394+0000","last_unstale":"2024-09-19T08:50:16.869056+0000","last_undegraded":"2024-09-19T08:50:16.869056+0000","last_fullsized":"2024-09-19T08:50:16.869056+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:55.549138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.941084+0000","last_change":"2024-09-19T08:50:13.797118+0000","last_active":"2024-09-19T08:50:26.941084+0000","last_peered":"2024-09-19T08:50:26.941084+0000","last_clean":"2024-09-19T08:50:26.941084+0000","last_became_active":"2024-09-19T08:50:13.796727+0000","last_became_peered":"2024-09-19T08:50:13.796727+0000","last_unstale":"2024-09-19T08:50:26.941084+0000","last_undegraded":"2024-09-19T08:50:26.941084+0000","last_fullsized":"2024-09-19T08:50:26.941084+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:49.310543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.879798+0000","last_change":"2024-09-19T08:50:15.888192+0000","last_active":"2024-09-19T08:50:16.879798+0000","last_peered":"2024-09-19T08:50:16.879798+0000","last_clean":"2024-09-19T08:50:16.879798+0000","last_became_active":"2024-09-19T08:50:15.887890+0000","last_became_peered":"2024-09-19T08:50:15.887890+0000","last_unstale":"2024-09-19T08:50:16.879798+0000","last_undegraded":"2024-09-19T08:50:16.879798+0000","last_fullsized":"2024-09-19T08:50:16.879798+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:24:48.951856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":44,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:37.962561+0000","last_change":"2024-09-19T08:50:13.797427+0000","last_active":"2024-09-19T08:50:37.962561+0000","last_peered":"2024-09-19T08:50:37.962561+0000","last_clean":"2024-09-19T08:50:37.962561+0000","last_became_active":"2024-09-19T08:50:13.797021+0000","last_became_peered":"2024-09-19T08:50:13.797021+0000","last_unstale":"2024-09-19T08:50:37.962561+0000","last_undegraded":"2024-09-19T08:50:37.962561+0000","last_fullsized":"2024-09-19T08:50:37.962561+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:14.530373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.878467+0000","last_change":"2024-09-19T08:50:15.894619+0000","last_active":"2024-09-19T08:50:16.878467+0000","last_peered":"2024-09-19T08:50:16.878467+0000","last_clean":"2024-09-19T08:50:16.878467+0000","last_became_active":"2024-09-19T08:50:15.894258+0000","last_became_peered":"2024-09-19T08:50:15.894258+0000","last_unstale":"2024-09-19T08:50:16.878467+0000","last_undegraded":"2024-09-19T08:50:16.878467+0000","last_fullsized":"2024-09-19T08:50:16.878467+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:13.137314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.939873+0000","last_change":"2024-09-19T08:50:13.800867+0000","last_active":"2024-09-19T08:50:26.939873+0000","last_peered":"2024-09-19T08:50:26.939873+0000","last_clean":"2024-09-19T08:50:26.939873+0000","last_became_active":"2024-09-19T08:50:13.800376+0000","last_became_peered":"2024-09-19T08:50:13.800376+0000","last_unstale":"2024-09-19T08:50:26.939873+0000","last_undegraded":"2024-09-19T08:50:26.939873+0000","last_fullsized":"2024-09-19T08:50:26.939873+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:31.924599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.878704+0000","last_change":"2024-09-19T08:50:15.891121+0000","last_active":"2024-09-19T08:50:16.878704+0000","last_peered":"2024-09-19T08:50:16.878704+0000","last_clean":"2024-09-19T08:50:16.878704+0000","last_became_active":"2024-09-19T08:50:15.890810+0000","last_became_peered":"2024-09-19T08:50:15.890810+0000","last_unstale":"2024-09-19T08:50:16.878704+0000","last_undegraded":"2024-09-19T08:50:16.878704+0000","last_fullsized":"2024-09-19T08:50:16.878704+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:13.010282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:25.931563+0000","last_change":"2024-09-19T08:50:14.293953+0000","last_active":"2024-09-19T08:50:25.931563+0000","last_peered":"2024-09-19T08:50:25.931563+0000","last_clean":"2024-09-19T08:50:25.931563+0000","last_became_active":"2024-09-19T08:50:14.293546+0000","last_became_peered":"2024-09-19T08:50:14.293546+0000","last_unstale":"2024-09-19T08:50:25.931563+0000","last_undegraded":"2024-09-19T08:50:25.931563+0000","last_fullsized":"2024-09-19T08:50:25.931563+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:27.809243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877095+0000","last_change":"2024-09-19T08:50:15.878300+0000","last_active":"2024-09-19T08:50:16.877095+0000","last_peered":"2024-09-19T08:50:16.877095+0000","last_clean":"2024-09-19T08:50:16.877095+0000","last_became_active":"2024-09-19T08:50:15.877938+0000","last_became_peered":"2024-09-19T08:50:15.877938+0000","last_unstale":"2024-09-19T08:50:16.877095+0000","last_undegraded":"2024-09-19T08:50:16.877095+0000","last_fullsized":"2024-09-19T08:50:16.877095+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:05.376708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'24","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:37.966503+0000","last_change":"2024-09-19T08:50:13.800696+0000","last_active":"2024-09-19T08:50:37.966503+0000","last_peered":"2024-09-19T08:50:37.966503+0000","last_clean":"2024-09-19T08:50:37.966503+0000","last_became_active":"2024-09-19T08:50:13.799385+0000","last_became_peered":"2024-09-19T08:50:13.799385+0000","last_unstale":"2024-09-19T08:50:37.966503+0000","last_undegraded":"2024-09-19T08:50:37.966503+0000","last_fullsized":"2024-09-19T08:50:37.966503+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:56.897309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46802,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":27,"num_read_kb":58,"num_write":26,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.878356+0000","last_change":"2024-09-19T08:50:15.891483+0000","last_active":"2024-09-19T08:50:16.878356+0000","last_peered":"2024-09-19T08:50:16.878356+0000","last_clean":"2024-09-19T08:50:16.878356+0000","last_became_active":"2024-09-19T08:50:15.891185+0000","last_became_peered":"2024-09-19T08:50:15.891185+0000","last_unstale":"2024-09-19T08:50:16.878356+0000","last_undegraded":"2024-09-19T08:50:16.878356+0000","last_fullsized":"2024-09-19T08:50:16.878356+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:26.599151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:27.944994+0000","last_change":"2024-09-19T08:50:13.795148+0000","last_active":"2024-09-19T08:50:27.944994+0000","last_peered":"2024-09-19T08:50:27.944994+0000","last_clean":"2024-09-19T08:50:27.944994+0000","last_became_active":"2024-09-19T08:50:13.794688+0000","last_became_peered":"2024-09-19T08:50:13.794688+0000","last_unstale":"2024-09-19T08:50:27.944994+0000","last_undegraded":"2024-09-19T08:50:27.944994+0000","last_fullsized":"2024-09-19T08:50:27.944994+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:01.366439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877362+0000","last_change":"2024-09-19T08:50:15.886449+0000","last_active":"2024-09-19T08:50:16.877362+0000","last_peered":"2024-09-19T08:50:16.877362+0000","last_clean":"2024-09-19T08:50:16.877362+0000","last_became_active":"2024-09-19T08:50:15.886119+0000","last_became_peered":"2024-09-19T08:50:15.886119+0000","last_unstale":"2024-09-19T08:50:16.877362+0000","last_undegraded":"2024-09-19T08:50:16.877362+0000","last_fullsized":"2024-09-19T08:50:16.877362+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:22.916593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.940744+0000","last_change":"2024-09-19T08:50:13.799363+0000","last_active":"2024-09-19T08:50:26.940744+0000","last_peered":"2024-09-19T08:50:26.940744+0000","last_clean":"2024-09-19T08:50:26.940744+0000","last_became_active":"2024-09-19T08:50:13.799033+0000","last_became_peered":"2024-09-19T08:50:13.799033+0000","last_unstale":"2024-09-19T08:50:26.940744+0000","last_undegraded":"2024-09-19T08:50:26.940744+0000","last_fullsized":"2024-09-19T08:50:26.940744+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:57.753451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877104+0000","last_change":"2024-09-19T08:50:15.898902+0000","last_active":"2024-09-19T08:50:16.877104+0000","last_peered":"2024-09-19T08:50:16.877104+0000","last_clean":"2024-09-19T08:50:16.877104+0000","last_became_active":"2024-09-19T08:50:15.898417+0000","last_became_peered":"2024-09-19T08:50:15.898417+0000","last_unstale":"2024-09-19T08:50:16.877104+0000","last_undegraded":"2024-09-19T08:50:16.877104+0000","last_fullsized":"2024-09-19T08:50:16.877104+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:32:19.799301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'6","reported_seq":37,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:35.962267+0000","last_change":"2024-09-19T08:50:13.798477+0000","last_active":"2024-09-19T08:50:35.962267+0000","last_peered":"2024-09-19T08:50:35.962267+0000","last_clean":"2024-09-19T08:50:35.962267+0000","last_became_active":"2024-09-19T08:50:13.798136+0000","last_became_peered":"2024-09-19T08:50:13.798136+0000","last_unstale":"2024-09-19T08:50:35.962267+0000","last_undegraded":"2024-09-19T08:50:35.962267+0000","last_fullsized":"2024-09-19T08:50:35.962267+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:33.874285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876769+0000","last_change":"2024-09-19T08:50:15.896414+0000","last_active":"2024-09-19T08:50:16.876769+0000","last_peered":"2024-09-19T08:50:16.876769+0000","last_clean":"2024-09-19T08:50:16.876769+0000","last_became_active":"2024-09-19T08:50:15.895530+0000","last_became_peered":"2024-09-19T08:50:15.895530+0000","last_unstale":"2024-09-19T08:50:16.876769+0000","last_undegraded":"2024-09-19T08:50:16.876769+0000","last_fullsized":"2024-09-19T08:50:16.876769+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:59.717869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.940708+0000","last_change":"2024-09-19T08:50:14.294087+0000","last_active":"2024-09-19T08:50:26.940708+0000","last_peered":"2024-09-19T08:50:26.940708+0000","last_clean":"2024-09-19T08:50:26.940708+0000","last_became_active":"2024-09-19T08:50:14.293712+0000","last_became_peered":"2024-09-19T08:50:14.293712+0000","last_unstale":"2024-09-19T08:50:26.940708+0000","last_undegraded":"2024-09-19T08:50:26.940708+0000","last_fullsized":"2024-09-19T08:50:26.940708+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:12.187514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869736+0000","last_change":"2024-09-19T08:50:15.888134+0000","last_active":"2024-09-19T08:50:16.869736+0000","last_peered":"2024-09-19T08:50:16.869736+0000","last_clean":"2024-09-19T08:50:16.869736+0000","last_became_active":"2024-09-19T08:50:15.887768+0000","last_became_peered":"2024-09-19T08:50:15.887768+0000","last_unstale":"2024-09-19T08:50:16.869736+0000","last_undegraded":"2024-09-19T08:50:16.869736+0000","last_fullsized":"2024-09-19T08:50:16.869736+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:12.868773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.920893+0000","last_change":"2024-09-19T08:50:13.792585+0000","last_active":"2024-09-19T08:50:26.920893+0000","last_peered":"2024-09-19T08:50:26.920893+0000","last_clean":"2024-09-19T08:50:26.920893+0000","last_became_active":"2024-09-19T08:50:13.792222+0000","last_became_peered":"2024-09-19T08:50:13.792222+0000","last_unstale":"2024-09-19T08:50:26.920893+0000","last_undegraded":"2024-09-19T08:50:26.920893+0000","last_fullsized":"2024-09-19T08:50:26.920893+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:45.234800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.885284+0000","last_change":"2024-09-19T08:50:15.892725+0000","last_active":"2024-09-19T08:50:16.885284+0000","last_peered":"2024-09-19T08:50:16.885284+0000","last_clean":"2024-09-19T08:50:16.885284+0000","last_became_active":"2024-09-19T08:50:15.892357+0000","last_became_peered":"2024-09-19T08:50:15.892357+0000","last_unstale":"2024-09-19T08:50:16.885284+0000","last_undegraded":"2024-09-19T08:50:16.885284+0000","last_fullsized":"2024-09-19T08:50:16.885284+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:18.756349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.939949+0000","last_change":"2024-09-19T08:50:13.795360+0000","last_active":"2024-09-19T08:50:26.939949+0000","last_peered":"2024-09-19T08:50:26.939949+0000","last_clean":"2024-09-19T08:50:26.939949+0000","last_became_active":"2024-09-19T08:50:13.794823+0000","last_became_peered":"2024-09-19T08:50:13.794823+0000","last_unstale":"2024-09-19T08:50:26.939949+0000","last_undegraded":"2024-09-19T08:50:26.939949+0000","last_fullsized":"2024-09-19T08:50:26.939949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:15.037834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877268+0000","last_change":"2024-09-19T08:50:15.893668+0000","last_active":"2024-09-19T08:50:16.877268+0000","last_peered":"2024-09-19T08:50:16.877268+0000","last_clean":"2024-09-19T08:50:16.877268+0000","last_became_active":"2024-09-19T08:50:15.893303+0000","last_became_peered":"2024-09-19T08:50:15.893303+0000","last_unstale":"2024-09-19T08:50:16.877268+0000","last_undegraded":"2024-09-19T08:50:16.877268+0000","last_fullsized":"2024-09-19T08:50:16.877268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:59.281601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.939251+0000","last_change":"2024-09-19T08:50:13.797442+0000","last_active":"2024-09-19T08:50:26.939251+0000","last_peered":"2024-09-19T08:50:26.939251+0000","last_clean":"2024-09-19T08:50:26.939251+0000","last_became_active":"2024-09-19T08:50:13.797072+0000","last_became_peered":"2024-09-19T08:50:13.797072+0000","last_unstale":"2024-09-19T08:50:26.939251+0000","last_undegraded":"2024-09-19T08:50:26.939251+0000","last_fullsized":"2024-09-19T08:50:26.939251+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:32.960928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876874+0000","last_change":"2024-09-19T08:50:15.895819+0000","last_active":"2024-09-19T08:50:16.876874+0000","last_peered":"2024-09-19T08:50:16.876874+0000","last_clean":"2024-09-19T08:50:16.876874+0000","last_became_active":"2024-09-19T08:50:15.895468+0000","last_became_peered":"2024-09-19T08:50:15.895468+0000","last_unstale":"2024-09-19T08:50:16.876874+0000","last_undegraded":"2024-09-19T08:50:16.876874+0000","last_fullsized":"2024-09-19T08:50:16.876874+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:33.568263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'6","reported_seq":35,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:33.958942+0000","last_change":"2024-09-19T08:50:14.294014+0000","last_active":"2024-09-19T08:50:33.958942+0000","last_peered":"2024-09-19T08:50:33.958942+0000","last_clean":"2024-09-19T08:50:33.958942+0000","last_became_active":"2024-09-19T08:50:14.293564+0000","last_became_peered":"2024-09-19T08:50:14.293564+0000","last_unstale":"2024-09-19T08:50:33.958942+0000","last_undegraded":"2024-09-19T08:50:33.958942+0000","last_fullsized":"2024-09-19T08:50:33.958942+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:23.806408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877550+0000","last_change":"2024-09-19T08:50:15.891840+0000","last_active":"2024-09-19T08:50:16.877550+0000","last_peered":"2024-09-19T08:50:16.877550+0000","last_clean":"2024-09-19T08:50:16.877550+0000","last_became_active":"2024-09-19T08:50:15.891511+0000","last_became_peered":"2024-09-19T08:50:15.891511+0000","last_unstale":"2024-09-19T08:50:16.877550+0000","last_undegraded":"2024-09-19T08:50:16.877550+0000","last_fullsized":"2024-09-19T08:50:16.877550+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:26.800508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":327,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877159+0000","last_change":"2024-09-19T08:49:02.071497+0000","last_active":"2024-09-19T08:50:16.877159+0000","last_peered":"2024-09-19T08:50:16.877159+0000","last_clean":"2024-09-19T08:50:16.877159+0000","last_became_active":"2024-09-19T08:49:02.071114+0000","last_became_peered":"2024-09-19T08:49:02.071114+0000","last_unstale":"2024-09-19T08:50:16.877159+0000","last_undegraded":"2024-09-19T08:50:16.877159+0000","last_fullsized":"2024-09-19T08:50:16.877159+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:45:36.600595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:45:36.600595+0000","last_clean_scrub_stamp":"2024-09-19T08:45:36.600595+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:18:15.369279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:27.945549+0000","last_change":"2024-09-19T08:50:13.793981+0000","last_active":"2024-09-19T08:50:27.945549+0000","last_peered":"2024-09-19T08:50:27.945549+0000","last_clean":"2024-09-19T08:50:27.945549+0000","last_became_active":"2024-09-19T08:50:13.793616+0000","last_became_peered":"2024-09-19T08:50:13.793616+0000","last_unstale":"2024-09-19T08:50:27.945549+0000","last_undegraded":"2024-09-19T08:50:27.945549+0000","last_fullsized":"2024-09-19T08:50:27.945549+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:45.195906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869593+0000","last_change":"2024-09-19T08:50:15.891248+0000","last_active":"2024-09-19T08:50:16.869593+0000","last_peered":"2024-09-19T08:50:16.869593+0000","last_clean":"2024-09-19T08:50:16.869593+0000","last_became_active":"2024-09-19T08:50:15.890922+0000","last_became_peered":"2024-09-19T08:50:15.890922+0000","last_unstale":"2024-09-19T08:50:16.869593+0000","last_undegraded":"2024-09-19T08:50:16.869593+0000","last_fullsized":"2024-09-19T08:50:16.869593+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:18:43.914214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:24.924191+0000","last_change":"2024-09-19T08:50:13.797471+0000","last_active":"2024-09-19T08:50:24.924191+0000","last_peered":"2024-09-19T08:50:24.924191+0000","last_clean":"2024-09-19T08:50:24.924191+0000","last_became_active":"2024-09-19T08:50:13.797033+0000","last_became_peered":"2024-09-19T08:50:13.797033+0000","last_unstale":"2024-09-19T08:50:24.924191+0000","last_undegraded":"2024-09-19T08:50:24.924191+0000","last_fullsized":"2024-09-19T08:50:24.924191+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:53.141708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876668+0000","last_change":"2024-09-19T08:50:15.882650+0000","last_active":"2024-09-19T08:50:16.876668+0000","last_peered":"2024-09-19T08:50:16.876668+0000","last_clean":"2024-09-19T08:50:16.876668+0000","last_became_active":"2024-09-19T08:50:15.882308+0000","last_became_peered":"2024-09-19T08:50:15.882308+0000","last_unstale":"2024-09-19T08:50:16.876668+0000","last_undegraded":"2024-09-19T08:50:16.876668+0000","last_fullsized":"2024-09-19T08:50:16.876668+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:26.449562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:33.959356+0000","last_change":"2024-09-19T08:50:14.292466+0000","last_active":"2024-09-19T08:50:33.959356+0000","last_peered":"2024-09-19T08:50:33.959356+0000","last_clean":"2024-09-19T08:50:33.959356+0000","last_became_active":"2024-09-19T08:50:14.292092+0000","last_became_peered":"2024-09-19T08:50:14.292092+0000","last_unstale":"2024-09-19T08:50:33.959356+0000","last_undegraded":"2024-09-19T08:50:33.959356+0000","last_fullsized":"2024-09-19T08:50:33.959356+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:11.373226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869763+0000","last_change":"2024-09-19T08:50:15.886093+0000","last_active":"2024-09-19T08:50:16.869763+0000","last_peered":"2024-09-19T08:50:16.869763+0000","last_clean":"2024-09-19T08:50:16.869763+0000","last_became_active":"2024-09-19T08:50:15.885790+0000","last_became_peered":"2024-09-19T08:50:15.885790+0000","last_unstale":"2024-09-19T08:50:16.869763+0000","last_undegraded":"2024-09-19T08:50:16.869763+0000","last_fullsized":"2024-09-19T08:50:16.869763+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:06.405176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'5","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:33.957801+0000","last_change":"2024-09-19T08:50:13.799909+0000","last_active":"2024-09-19T08:50:33.957801+0000","last_peered":"2024-09-19T08:50:33.957801+0000","last_clean":"2024-09-19T08:50:33.957801+0000","last_became_active":"2024-09-19T08:50:13.799542+0000","last_became_peered":"2024-09-19T08:50:13.799542+0000","last_unstale":"2024-09-19T08:50:33.957801+0000","last_undegraded":"2024-09-19T08:50:33.957801+0000","last_fullsized":"2024-09-19T08:50:33.957801+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:23.545897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.870214+0000","last_change":"2024-09-19T08:50:15.890410+0000","last_active":"2024-09-19T08:50:16.870214+0000","last_peered":"2024-09-19T08:50:16.870214+0000","last_clean":"2024-09-19T08:50:16.870214+0000","last_became_active":"2024-09-19T08:50:15.890093+0000","last_became_peered":"2024-09-19T08:50:15.890093+0000","last_unstale":"2024-09-19T08:50:16.870214+0000","last_undegraded":"2024-09-19T08:50:16.870214+0000","last_fullsized":"2024-09-19T08:50:16.870214+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:06.533722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.880158+0000","last_change":"2024-09-19T08:50:14.292577+0000","last_active":"2024-09-19T08:50:16.880158+0000","last_peered":"2024-09-19T08:50:16.880158+0000","last_clean":"2024-09-19T08:50:16.880158+0000","last_became_active":"2024-09-19T08:50:14.292220+0000","last_became_peered":"2024-09-19T08:50:14.292220+0000","last_unstale":"2024-09-19T08:50:16.880158+0000","last_undegraded":"2024-09-19T08:50:16.880158+0000","last_fullsized":"2024-09-19T08:50:16.880158+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:23.631672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:18.755907+0000","last_change":"2024-09-19T08:50:15.891345+0000","last_active":"2024-09-19T08:50:18.755907+0000","last_peered":"2024-09-19T08:50:18.755907+0000","last_clean":"2024-09-19T08:50:18.755907+0000","last_became_active":"2024-09-19T08:50:15.891006+0000","last_became_peered":"2024-09-19T08:50:15.891006+0000","last_unstale":"2024-09-19T08:50:18.755907+0000","last_undegraded":"2024-09-19T08:50:18.755907+0000","last_fullsized":"2024-09-19T08:50:18.755907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:41.934331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.940739+0000","last_change":"2024-09-19T08:50:14.292619+0000","last_active":"2024-09-19T08:50:26.940739+0000","last_peered":"2024-09-19T08:50:26.940739+0000","last_clean":"2024-09-19T08:50:26.940739+0000","last_became_active":"2024-09-19T08:50:14.292230+0000","last_became_peered":"2024-09-19T08:50:14.292230+0000","last_unstale":"2024-09-19T08:50:26.940739+0000","last_undegraded":"2024-09-19T08:50:26.940739+0000","last_fullsized":"2024-09-19T08:50:26.940739+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:21:33.076142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877022+0000","last_change":"2024-09-19T08:50:15.882760+0000","last_active":"2024-09-19T08:50:16.877022+0000","last_peered":"2024-09-19T08:50:16.877022+0000","last_clean":"2024-09-19T08:50:16.877022+0000","last_became_active":"2024-09-19T08:50:15.882402+0000","last_became_peered":"2024-09-19T08:50:15.882402+0000","last_unstale":"2024-09-19T08:50:16.877022+0000","last_undegraded":"2024-09-19T08:50:16.877022+0000","last_fullsized":"2024-09-19T08:50:16.877022+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:17.343385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'12","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:35.876663+0000","last_change":"2024-09-19T08:50:13.790982+0000","last_active":"2024-09-19T08:50:35.876663+0000","last_peered":"2024-09-19T08:50:35.876663+0000","last_clean":"2024-09-19T08:50:35.876663+0000","last_became_active":"2024-09-19T08:50:13.790644+0000","last_became_peered":"2024-09-19T08:50:13.790644+0000","last_unstale":"2024-09-19T08:50:35.876663+0000","last_undegraded":"2024-09-19T08:50:35.876663+0000","last_fullsized":"2024-09-19T08:50:35.876663+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:20:25.923021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869864+0000","last_change":"2024-09-19T08:50:15.887556+0000","last_active":"2024-09-19T08:50:16.869864+0000","last_peered":"2024-09-19T08:50:16.869864+0000","last_clean":"2024-09-19T08:50:16.869864+0000","last_became_active":"2024-09-19T08:50:15.887280+0000","last_became_peered":"2024-09-19T08:50:15.887280+0000","last_unstale":"2024-09-19T08:50:16.869864+0000","last_undegraded":"2024-09-19T08:50:16.869864+0000","last_fullsized":"2024-09-19T08:50:16.869864+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:51.226527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.939936+0000","last_change":"2024-09-19T08:50:14.012150+0000","last_active":"2024-09-19T08:50:26.939936+0000","last_peered":"2024-09-19T08:50:26.939936+0000","last_clean":"2024-09-19T08:50:26.939936+0000","last_became_active":"2024-09-19T08:50:14.011799+0000","last_became_peered":"2024-09-19T08:50:14.011799+0000","last_unstale":"2024-09-19T08:50:26.939936+0000","last_undegraded":"2024-09-19T08:50:26.939936+0000","last_fullsized":"2024-09-19T08:50:26.939936+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:37.310539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.878237+0000","last_change":"2024-09-19T08:50:15.889577+0000","last_active":"2024-09-19T08:50:16.878237+0000","last_peered":"2024-09-19T08:50:16.878237+0000","last_clean":"2024-09-19T08:50:16.878237+0000","last_became_active":"2024-09-19T08:50:15.889244+0000","last_became_peered":"2024-09-19T08:50:15.889244+0000","last_unstale":"2024-09-19T08:50:16.878237+0000","last_undegraded":"2024-09-19T08:50:16.878237+0000","last_fullsized":"2024-09-19T08:50:16.878237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:54.382221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:23.919295+0000","last_change":"2024-09-19T08:50:14.293845+0000","last_active":"2024-09-19T08:50:23.919295+0000","last_peered":"2024-09-19T08:50:23.919295+0000","last_clean":"2024-09-19T08:50:23.919295+0000","last_became_active":"2024-09-19T08:50:14.293585+0000","last_became_peered":"2024-09-19T08:50:14.293585+0000","last_unstale":"2024-09-19T08:50:23.919295+0000","last_undegraded":"2024-09-19T08:50:23.919295+0000","last_fullsized":"2024-09-19T08:50:23.919295+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:02.886475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877681+0000","last_change":"2024-09-19T08:50:15.888591+0000","last_active":"2024-09-19T08:50:16.877681+0000","last_peered":"2024-09-19T08:50:16.877681+0000","last_clean":"2024-09-19T08:50:16.877681+0000","last_became_active":"2024-09-19T08:50:15.888270+0000","last_became_peered":"2024-09-19T08:50:15.888270+0000","last_unstale":"2024-09-19T08:50:16.877681+0000","last_undegraded":"2024-09-19T08:50:16.877681+0000","last_fullsized":"2024-09-19T08:50:16.877681+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:08.644828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.939797+0000","last_change":"2024-09-19T08:50:13.794081+0000","last_active":"2024-09-19T08:50:26.939797+0000","last_peered":"2024-09-19T08:50:26.939797+0000","last_clean":"2024-09-19T08:50:26.939797+0000","last_became_active":"2024-09-19T08:50:13.793770+0000","last_became_peered":"2024-09-19T08:50:13.793770+0000","last_unstale":"2024-09-19T08:50:26.939797+0000","last_undegraded":"2024-09-19T08:50:26.939797+0000","last_fullsized":"2024-09-19T08:50:26.939797+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:43.053893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.885008+0000","last_change":"2024-09-19T08:50:15.885338+0000","last_active":"2024-09-19T08:50:16.885008+0000","last_peered":"2024-09-19T08:50:16.885008+0000","last_clean":"2024-09-19T08:50:16.885008+0000","last_became_active":"2024-09-19T08:50:15.884983+0000","last_became_peered":"2024-09-19T08:50:15.884983+0000","last_unstale":"2024-09-19T08:50:16.885008+0000","last_undegraded":"2024-09-19T08:50:16.885008+0000","last_fullsized":"2024-09-19T08:50:16.885008+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:05.228871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'3","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:25.931497+0000","last_change":"2024-09-19T08:50:13.795440+0000","last_active":"2024-09-19T08:50:25.931497+0000","last_peered":"2024-09-19T08:50:25.931497+0000","last_clean":"2024-09-19T08:50:25.931497+0000","last_became_active":"2024-09-19T08:50:13.795053+0000","last_became_peered":"2024-09-19T08:50:13.795053+0000","last_unstale":"2024-09-19T08:50:25.931497+0000","last_undegraded":"2024-09-19T08:50:25.931497+0000","last_fullsized":"2024-09-19T08:50:25.931497+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:13.466112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869289+0000","last_change":"2024-09-19T08:50:15.886587+0000","last_active":"2024-09-19T08:50:16.869289+0000","last_peered":"2024-09-19T08:50:16.869289+0000","last_clean":"2024-09-19T08:50:16.869289+0000","last_became_active":"2024-09-19T08:50:15.886231+0000","last_became_peered":"2024-09-19T08:50:15.886231+0000","last_unstale":"2024-09-19T08:50:16.869289+0000","last_undegraded":"2024-09-19T08:50:16.869289+0000","last_fullsized":"2024-09-19T08:50:16.869289+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:11.965382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:23.921108+0000","last_change":"2024-09-19T08:50:13.796681+0000","last_active":"2024-09-19T08:50:23.921108+0000","last_peered":"2024-09-19T08:50:23.921108+0000","last_clean":"2024-09-19T08:50:23.921108+0000","last_became_active":"2024-09-19T08:50:13.796338+0000","last_became_peered":"2024-09-19T08:50:13.796338+0000","last_unstale":"2024-09-19T08:50:23.921108+0000","last_undegraded":"2024-09-19T08:50:23.921108+0000","last_fullsized":"2024-09-19T08:50:23.921108+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:32.588800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877525+0000","last_change":"2024-09-19T08:50:15.889667+0000","last_active":"2024-09-19T08:50:16.877525+0000","last_peered":"2024-09-19T08:50:16.877525+0000","last_clean":"2024-09-19T08:50:16.877525+0000","last_became_active":"2024-09-19T08:50:15.889341+0000","last_became_peered":"2024-09-19T08:50:15.889341+0000","last_unstale":"2024-09-19T08:50:16.877525+0000","last_undegraded":"2024-09-19T08:50:16.877525+0000","last_fullsized":"2024-09-19T08:50:16.877525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:13.255483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.870110+0000","last_change":"2024-09-19T08:50:15.887337+0000","last_active":"2024-09-19T08:50:16.870110+0000","last_peered":"2024-09-19T08:50:16.870110+0000","last_clean":"2024-09-19T08:50:16.870110+0000","last_became_active":"2024-09-19T08:50:15.887001+0000","last_became_peered":"2024-09-19T08:50:15.887001+0000","last_unstale":"2024-09-19T08:50:16.870110+0000","last_undegraded":"2024-09-19T08:50:16.870110+0000","last_fullsized":"2024-09-19T08:50:16.870110+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:43.544863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.940436+0000","last_change":"2024-09-19T08:50:13.799321+0000","last_active":"2024-09-19T08:50:26.940436+0000","last_peered":"2024-09-19T08:50:26.940436+0000","last_clean":"2024-09-19T08:50:26.940436+0000","last_became_active":"2024-09-19T08:50:13.798837+0000","last_became_peered":"2024-09-19T08:50:13.798837+0000","last_unstale":"2024-09-19T08:50:26.940436+0000","last_undegraded":"2024-09-19T08:50:26.940436+0000","last_fullsized":"2024-09-19T08:50:26.940436+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:35.753093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876836+0000","last_change":"2024-09-19T08:50:15.892074+0000","last_active":"2024-09-19T08:50:16.876836+0000","last_peered":"2024-09-19T08:50:16.876836+0000","last_clean":"2024-09-19T08:50:16.876836+0000","last_became_active":"2024-09-19T08:50:15.891722+0000","last_became_peered":"2024-09-19T08:50:15.891722+0000","last_unstale":"2024-09-19T08:50:16.876836+0000","last_undegraded":"2024-09-19T08:50:16.876836+0000","last_fullsized":"2024-09-19T08:50:16.876836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:39.913080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:27.944924+0000","last_change":"2024-09-19T08:50:13.795577+0000","last_active":"2024-09-19T08:50:27.944924+0000","last_peered":"2024-09-19T08:50:27.944924+0000","last_clean":"2024-09-19T08:50:27.944924+0000","last_became_active":"2024-09-19T08:50:13.795254+0000","last_became_peered":"2024-09-19T08:50:13.795254+0000","last_unstale":"2024-09-19T08:50:27.944924+0000","last_undegraded":"2024-09-19T08:50:27.944924+0000","last_fullsized":"2024-09-19T08:50:27.944924+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:13.263447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.878562+0000","last_change":"2024-09-19T08:50:15.884584+0000","last_active":"2024-09-19T08:50:16.878562+0000","last_peered":"2024-09-19T08:50:16.878562+0000","last_clean":"2024-09-19T08:50:16.878562+0000","last_became_active":"2024-09-19T08:50:15.884244+0000","last_became_peered":"2024-09-19T08:50:15.884244+0000","last_unstale":"2024-09-19T08:50:16.878562+0000","last_undegraded":"2024-09-19T08:50:16.878562+0000","last_fullsized":"2024-09-19T08:50:16.878562+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:58.835351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.880212+0000","last_change":"2024-09-19T08:50:14.294210+0000","last_active":"2024-09-19T08:50:16.880212+0000","last_peered":"2024-09-19T08:50:16.880212+0000","last_clean":"2024-09-19T08:50:16.880212+0000","last_became_active":"2024-09-19T08:50:14.293850+0000","last_became_peered":"2024-09-19T08:50:14.293850+0000","last_unstale":"2024-09-19T08:50:16.880212+0000","last_undegraded":"2024-09-19T08:50:16.880212+0000","last_fullsized":"2024-09-19T08:50:16.880212+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:42:44.340766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869569+0000","last_change":"2024-09-19T08:50:15.892934+0000","last_active":"2024-09-19T08:50:16.869569+0000","last_peered":"2024-09-19T08:50:16.869569+0000","last_clean":"2024-09-19T08:50:16.869569+0000","last_became_active":"2024-09-19T08:50:15.892309+0000","last_became_peered":"2024-09-19T08:50:15.892309+0000","last_unstale":"2024-09-19T08:50:16.869569+0000","last_undegraded":"2024-09-19T08:50:16.869569+0000","last_fullsized":"2024-09-19T08:50:16.869569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:40.158724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":43,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:36.960299+0000","last_change":"2024-09-19T08:50:13.796977+0000","last_active":"2024-09-19T08:50:36.960299+0000","last_peered":"2024-09-19T08:50:36.960299+0000","last_clean":"2024-09-19T08:50:36.960299+0000","last_became_active":"2024-09-19T08:50:13.796628+0000","last_became_peered":"2024-09-19T08:50:13.796628+0000","last_unstale":"2024-09-19T08:50:36.960299+0000","last_undegraded":"2024-09-19T08:50:36.960299+0000","last_fullsized":"2024-09-19T08:50:36.960299+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:59.335583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":54010,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":134,"num_read_kb":131,"num_write":231,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":528384,"data_stored":162030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":247642,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579921,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":872448,"data_stored":416651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32176,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712976,"statfs":{"total":95995035648,"available":95962087424,"internally_reserved":0,"allocated":1015808,"data_stored":1054482,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972380,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":897024,"data_stored":416188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201313,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":892928,"data_stored":416566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430245,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":1009086,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593771,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":415905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822703,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":1008371,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953523,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":416159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182457,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":897024,"data_stored":415730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411391,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":439763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":463620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738441,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":417637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34206,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34206,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":48554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":49167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":48931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:50:42.196 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:50:42.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:42 smithi155 ceph-mon[34921]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:50:42.458 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:42.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:42 smithi019 ceph-mon[30976]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:50:42.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:42 smithi203 ceph-mon[35450]: from='client.14751 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:50:42.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.937+0000 7f4a68b96640 1 -- 172.21.15.19:0/2220295214 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a6410c170 msgr2=0x7f4a6410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:42.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.937+0000 7f4a68b96640 1 --2- 172.21.15.19:0/2220295214 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a6410c170 0x7f4a6410e610 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4a5c009ca0 tx=0x7f4a5c02a950 comp rx=0 tx=0).stop 2024-09-19T08:50:42.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.937+0000 7f4a68b96640 1 -- 172.21.15.19:0/2220295214 shutdown_connections 2024-09-19T08:50:42.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.937+0000 7f4a68b96640 1 --2- 172.21.15.19:0/2220295214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a64103660 0x7f4a6410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:42.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.937+0000 7f4a68b96640 1 --2- 172.21.15.19:0/2220295214 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a6410c170 0x7f4a6410e610 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:42.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.937+0000 7f4a68b96640 1 --2- 172.21.15.19:0/2220295214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a64102d40 0x7f4a64103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:42.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.937+0000 7f4a68b96640 1 -- 172.21.15.19:0/2220295214 >> 172.21.15.19:0/2220295214 conn(0x7f4a640fc7a0 msgr2=0x7f4a640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:42.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.937+0000 7f4a68b96640 1 -- 172.21.15.19:0/2220295214 shutdown_connections 2024-09-19T08:50:42.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.937+0000 7f4a68b96640 1 -- 172.21.15.19:0/2220295214 wait complete. 2024-09-19T08:50:42.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.938+0000 7f4a68b96640 1 Processor -- start 2024-09-19T08:50:42.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.938+0000 7f4a68b96640 1 -- start start 2024-09-19T08:50:42.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.938+0000 7f4a68b96640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a64102d40 0x7f4a641009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:42.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.938+0000 7f4a68b96640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a64103660 0x7f4a64100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:42.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.938+0000 7f4a68b96640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a6410c170 0x7f4a64101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:42.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.938+0000 7f4a68b96640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4a64111f70 con 0x7f4a64103660 2024-09-19T08:50:42.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.938+0000 7f4a68b96640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4a64111df0 con 0x7f4a6410c170 2024-09-19T08:50:42.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.938+0000 7f4a68b96640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4a641120f0 con 0x7f4a64102d40 2024-09-19T08:50:42.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.938+0000 7f4a61d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a64103660 0x7f4a64100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:42.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.938+0000 7f4a61d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a64103660 0x7f4a64100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40852/0 (socket says 172.21.15.19:40852) 2024-09-19T08:50:42.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.938+0000 7f4a61d9b640 1 -- 172.21.15.19:0/2643341289 learned_addr learned my addr 172.21.15.19:0/2643341289 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:50:42.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.938+0000 7f4a6259c640 1 --2- 172.21.15.19:0/2643341289 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a64102d40 0x7f4a641009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:42.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.938+0000 7f4a62d9d640 1 --2- 172.21.15.19:0/2643341289 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a6410c170 0x7f4a64101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:42.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.939+0000 7f4a61d9b640 1 -- 172.21.15.19:0/2643341289 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a64102d40 msgr2=0x7f4a641009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:42.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.939+0000 7f4a61d9b640 1 --2- 172.21.15.19:0/2643341289 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a64102d40 0x7f4a641009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:42.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.939+0000 7f4a61d9b640 1 -- 172.21.15.19:0/2643341289 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a6410c170 msgr2=0x7f4a64101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:42.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.939+0000 7f4a61d9b640 1 --2- 172.21.15.19:0/2643341289 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a6410c170 0x7f4a64101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:42.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.939+0000 7f4a61d9b640 1 -- 172.21.15.19:0/2643341289 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a641a67f0 con 0x7f4a64103660 2024-09-19T08:50:42.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.939+0000 7f4a61d9b640 1 --2- 172.21.15.19:0/2643341289 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a64103660 0x7f4a64100ee0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4a5400c970 tx=0x7f4a5400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:42.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.939+0000 7f4a5b7fe640 1 -- 172.21.15.19:0/2643341289 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a54007bb0 con 0x7f4a64103660 2024-09-19T08:50:42.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.939+0000 7f4a68b96640 1 -- 172.21.15.19:0/2643341289 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a641a6ae0 con 0x7f4a64103660 2024-09-19T08:50:42.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.939+0000 7f4a5b7fe640 1 -- 172.21.15.19:0/2643341289 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a54007d50 con 0x7f4a64103660 2024-09-19T08:50:42.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.939+0000 7f4a5b7fe640 1 -- 172.21.15.19:0/2643341289 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a54018820 con 0x7f4a64103660 2024-09-19T08:50:42.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.939+0000 7f4a68b96640 1 -- 172.21.15.19:0/2643341289 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a641a7020 con 0x7f4a64103660 2024-09-19T08:50:42.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.940+0000 7f4a68b96640 1 -- 172.21.15.19:0/2643341289 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a64103120 con 0x7f4a64103660 2024-09-19T08:50:42.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.941+0000 7f4a5b7fe640 1 -- 172.21.15.19:0/2643341289 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4a540189c0 con 0x7f4a64103660 2024-09-19T08:50:42.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.942+0000 7f4a5b7fe640 1 --2- 172.21.15.19:0/2643341289 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4a500a32d0 0x7f4a500a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:42.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.942+0000 7f4a6259c640 1 --2- 172.21.15.19:0/2643341289 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4a500a32d0 0x7f4a500a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:42.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.942+0000 7f4a5b7fe640 1 -- 172.21.15.19:0/2643341289 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f4a540cf870 con 0x7f4a64103660 2024-09-19T08:50:42.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.943+0000 7f4a6259c640 1 --2- 172.21.15.19:0/2643341289 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4a500a32d0 0x7f4a500a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c005d00 tx=0x7f4a4c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:42.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:42.946+0000 7f4a5b7fe640 1 -- 172.21.15.19:0/2643341289 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4a54014030 con 0x7f4a64103660 2024-09-19T08:50:43.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:43.120+0000 7f4a68b96640 1 -- 172.21.15.19:0/2643341289 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4a640fe480 con 0x7f4a500a32d0 2024-09-19T08:50:43.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:43.126+0000 7f4a5b7fe640 1 -- 172.21.15.19:0/2643341289 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258891 (secure 0 0 0) 0x7f4a640fe480 con 0x7f4a500a32d0 2024-09-19T08:50:43.128 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:50:43.129 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-19T08:50:43.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:43.129+0000 7f4a68b96640 1 -- 172.21.15.19:0/2643341289 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4a500a32d0 msgr2=0x7f4a500a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:43.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:43.129+0000 7f4a68b96640 1 --2- 172.21.15.19:0/2643341289 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4a500a32d0 0x7f4a500a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c005d00 tx=0x7f4a4c00b410 comp rx=0 tx=0).stop 2024-09-19T08:50:43.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:43.129+0000 7f4a68b96640 1 -- 172.21.15.19:0/2643341289 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a64103660 msgr2=0x7f4a64100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:43.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:43.129+0000 7f4a68b96640 1 --2- 172.21.15.19:0/2643341289 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a64103660 0x7f4a64100ee0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4a5400c970 tx=0x7f4a5400ce30 comp rx=0 tx=0).stop 2024-09-19T08:50:43.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:43.129+0000 7f4a68b96640 1 -- 172.21.15.19:0/2643341289 shutdown_connections 2024-09-19T08:50:43.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:43.129+0000 7f4a68b96640 1 --2- 172.21.15.19:0/2643341289 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4a500a32d0 0x7f4a500a5790 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:43.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:43.129+0000 7f4a68b96640 1 --2- 172.21.15.19:0/2643341289 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a6410c170 0x7f4a64101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:43.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:43.129+0000 7f4a68b96640 1 --2- 172.21.15.19:0/2643341289 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a64103660 0x7f4a64100ee0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:43.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:43.129+0000 7f4a68b96640 1 --2- 172.21.15.19:0/2643341289 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a64102d40 0x7f4a641009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:43.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:43.129+0000 7f4a68b96640 1 -- 172.21.15.19:0/2643341289 >> 172.21.15.19:0/2643341289 conn(0x7f4a640fc7a0 msgr2=0x7f4a640fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:43.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:43.129+0000 7f4a68b96640 1 -- 172.21.15.19:0/2643341289 shutdown_connections 2024-09-19T08:50:43.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:43.129+0000 7f4a68b96640 1 -- 172.21.15.19:0/2643341289 wait complete. 2024-09-19T08:50:43.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:43 smithi155 ceph-mon[34921]: pgmap v290: 97 pgs: 97 active+clean; 630 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 16 op/s 2024-09-19T08:50:43.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:43 smithi203 ceph-mon[35450]: pgmap v290: 97 pgs: 97 active+clean; 630 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 16 op/s 2024-09-19T08:50:43.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:43 smithi019 ceph-mon[30976]: pgmap v290: 97 pgs: 97 active+clean; 630 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 16 op/s 2024-09-19T08:50:43.875 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":290,"stamp":"2024-09-19T08:50:41.845078+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":644612,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":280,"num_read_kb":245,"num_write":414,"num_write_kb":3057,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":339,"ondisk_log_size":339,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":355860,"kb_used_data":10772,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585964,"statfs":{"total":1151940427776,"available":1151576027136,"internally_reserved":0,"allocated":11030528,"data_stored":6922780,"data_compressed":107538,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19142,"internal_metadata":353154362},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":48114,"num_objects":18,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":146,"num_read_kb":129,"num_write":56,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003227"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.885166+0000","last_change":"2024-09-19T08:50:15.893270+0000","last_active":"2024-09-19T08:50:16.885166+0000","last_peered":"2024-09-19T08:50:16.885166+0000","last_clean":"2024-09-19T08:50:16.885166+0000","last_became_active":"2024-09-19T08:50:15.892020+0000","last_became_peered":"2024-09-19T08:50:15.892020+0000","last_unstale":"2024-09-19T08:50:16.885166+0000","last_undegraded":"2024-09-19T08:50:16.885166+0000","last_fullsized":"2024-09-19T08:50:16.885166+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:40.846708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877980+0000","last_change":"2024-09-19T08:50:15.889331+0000","last_active":"2024-09-19T08:50:16.877980+0000","last_peered":"2024-09-19T08:50:16.877980+0000","last_clean":"2024-09-19T08:50:16.877980+0000","last_became_active":"2024-09-19T08:50:15.887082+0000","last_became_peered":"2024-09-19T08:50:15.887082+0000","last_unstale":"2024-09-19T08:50:16.877980+0000","last_undegraded":"2024-09-19T08:50:16.877980+0000","last_fullsized":"2024-09-19T08:50:16.877980+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:46.934172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877371+0000","last_change":"2024-09-19T08:50:15.891714+0000","last_active":"2024-09-19T08:50:16.877371+0000","last_peered":"2024-09-19T08:50:16.877371+0000","last_clean":"2024-09-19T08:50:16.877371+0000","last_became_active":"2024-09-19T08:50:15.891380+0000","last_became_peered":"2024-09-19T08:50:15.891380+0000","last_unstale":"2024-09-19T08:50:16.877371+0000","last_undegraded":"2024-09-19T08:50:16.877371+0000","last_fullsized":"2024-09-19T08:50:16.877371+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:02.203252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.880548+0000","last_change":"2024-09-19T08:50:15.896157+0000","last_active":"2024-09-19T08:50:16.880548+0000","last_peered":"2024-09-19T08:50:16.880548+0000","last_clean":"2024-09-19T08:50:16.880548+0000","last_became_active":"2024-09-19T08:50:15.895772+0000","last_became_peered":"2024-09-19T08:50:15.895772+0000","last_unstale":"2024-09-19T08:50:16.880548+0000","last_undegraded":"2024-09-19T08:50:16.880548+0000","last_fullsized":"2024-09-19T08:50:16.880548+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:12.915745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877401+0000","last_change":"2024-09-19T08:50:15.886600+0000","last_active":"2024-09-19T08:50:16.877401+0000","last_peered":"2024-09-19T08:50:16.877401+0000","last_clean":"2024-09-19T08:50:16.877401+0000","last_became_active":"2024-09-19T08:50:15.886270+0000","last_became_peered":"2024-09-19T08:50:15.886270+0000","last_unstale":"2024-09-19T08:50:16.877401+0000","last_undegraded":"2024-09-19T08:50:16.877401+0000","last_fullsized":"2024-09-19T08:50:16.877401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:53.779930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869832+0000","last_change":"2024-09-19T08:50:15.889475+0000","last_active":"2024-09-19T08:50:16.869832+0000","last_peered":"2024-09-19T08:50:16.869832+0000","last_clean":"2024-09-19T08:50:16.869832+0000","last_became_active":"2024-09-19T08:50:15.889134+0000","last_became_peered":"2024-09-19T08:50:15.889134+0000","last_unstale":"2024-09-19T08:50:16.869832+0000","last_undegraded":"2024-09-19T08:50:16.869832+0000","last_fullsized":"2024-09-19T08:50:16.869832+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:53.977662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877346+0000","last_change":"2024-09-19T08:50:15.897163+0000","last_active":"2024-09-19T08:50:16.877346+0000","last_peered":"2024-09-19T08:50:16.877346+0000","last_clean":"2024-09-19T08:50:16.877346+0000","last_became_active":"2024-09-19T08:50:15.895161+0000","last_became_peered":"2024-09-19T08:50:15.895161+0000","last_unstale":"2024-09-19T08:50:16.877346+0000","last_undegraded":"2024-09-19T08:50:16.877346+0000","last_fullsized":"2024-09-19T08:50:16.877346+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:32.432691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869011+0000","last_change":"2024-09-19T08:50:15.891197+0000","last_active":"2024-09-19T08:50:16.869011+0000","last_peered":"2024-09-19T08:50:16.869011+0000","last_clean":"2024-09-19T08:50:16.869011+0000","last_became_active":"2024-09-19T08:50:15.890880+0000","last_became_peered":"2024-09-19T08:50:15.890880+0000","last_unstale":"2024-09-19T08:50:16.869011+0000","last_undegraded":"2024-09-19T08:50:16.869011+0000","last_fullsized":"2024-09-19T08:50:16.869011+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:41.100341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877991+0000","last_change":"2024-09-19T08:50:15.896043+0000","last_active":"2024-09-19T08:50:16.877991+0000","last_peered":"2024-09-19T08:50:16.877991+0000","last_clean":"2024-09-19T08:50:16.877991+0000","last_became_active":"2024-09-19T08:50:15.895498+0000","last_became_peered":"2024-09-19T08:50:15.895498+0000","last_unstale":"2024-09-19T08:50:16.877991+0000","last_undegraded":"2024-09-19T08:50:16.877991+0000","last_fullsized":"2024-09-19T08:50:16.877991+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:57.956427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.870481+0000","last_change":"2024-09-19T08:50:15.887658+0000","last_active":"2024-09-19T08:50:16.870481+0000","last_peered":"2024-09-19T08:50:16.870481+0000","last_clean":"2024-09-19T08:50:16.870481+0000","last_became_active":"2024-09-19T08:50:15.887199+0000","last_became_peered":"2024-09-19T08:50:15.887199+0000","last_unstale":"2024-09-19T08:50:16.870481+0000","last_undegraded":"2024-09-19T08:50:16.870481+0000","last_fullsized":"2024-09-19T08:50:16.870481+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:39.947735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876931+0000","last_change":"2024-09-19T08:50:15.894865+0000","last_active":"2024-09-19T08:50:16.876931+0000","last_peered":"2024-09-19T08:50:16.876931+0000","last_clean":"2024-09-19T08:50:16.876931+0000","last_became_active":"2024-09-19T08:50:15.894475+0000","last_became_peered":"2024-09-19T08:50:15.894475+0000","last_unstale":"2024-09-19T08:50:16.876931+0000","last_undegraded":"2024-09-19T08:50:16.876931+0000","last_fullsized":"2024-09-19T08:50:16.876931+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:43.235991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.880654+0000","last_change":"2024-09-19T08:50:15.897209+0000","last_active":"2024-09-19T08:50:16.880654+0000","last_peered":"2024-09-19T08:50:16.880654+0000","last_clean":"2024-09-19T08:50:16.880654+0000","last_became_active":"2024-09-19T08:50:15.896866+0000","last_became_peered":"2024-09-19T08:50:15.896866+0000","last_unstale":"2024-09-19T08:50:16.880654+0000","last_undegraded":"2024-09-19T08:50:16.880654+0000","last_fullsized":"2024-09-19T08:50:16.880654+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:23.036534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876974+0000","last_change":"2024-09-19T08:50:15.890076+0000","last_active":"2024-09-19T08:50:16.876974+0000","last_peered":"2024-09-19T08:50:16.876974+0000","last_clean":"2024-09-19T08:50:16.876974+0000","last_became_active":"2024-09-19T08:50:15.889735+0000","last_became_peered":"2024-09-19T08:50:15.889735+0000","last_unstale":"2024-09-19T08:50:16.876974+0000","last_undegraded":"2024-09-19T08:50:16.876974+0000","last_fullsized":"2024-09-19T08:50:16.876974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:25.602757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877013+0000","last_change":"2024-09-19T08:50:15.886739+0000","last_active":"2024-09-19T08:50:16.877013+0000","last_peered":"2024-09-19T08:50:16.877013+0000","last_clean":"2024-09-19T08:50:16.877013+0000","last_became_active":"2024-09-19T08:50:15.886313+0000","last_became_peered":"2024-09-19T08:50:15.886313+0000","last_unstale":"2024-09-19T08:50:16.877013+0000","last_undegraded":"2024-09-19T08:50:16.877013+0000","last_fullsized":"2024-09-19T08:50:16.877013+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:03.244674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876731+0000","last_change":"2024-09-19T08:50:15.898519+0000","last_active":"2024-09-19T08:50:16.876731+0000","last_peered":"2024-09-19T08:50:16.876731+0000","last_clean":"2024-09-19T08:50:16.876731+0000","last_became_active":"2024-09-19T08:50:15.898249+0000","last_became_peered":"2024-09-19T08:50:15.898249+0000","last_unstale":"2024-09-19T08:50:16.876731+0000","last_undegraded":"2024-09-19T08:50:16.876731+0000","last_fullsized":"2024-09-19T08:50:16.876731+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:32.318895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876236+0000","last_change":"2024-09-19T08:50:15.890324+0000","last_active":"2024-09-19T08:50:16.876236+0000","last_peered":"2024-09-19T08:50:16.876236+0000","last_clean":"2024-09-19T08:50:16.876236+0000","last_became_active":"2024-09-19T08:50:15.887345+0000","last_became_peered":"2024-09-19T08:50:15.887345+0000","last_unstale":"2024-09-19T08:50:16.876236+0000","last_undegraded":"2024-09-19T08:50:16.876236+0000","last_fullsized":"2024-09-19T08:50:16.876236+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:27.989128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.885345+0000","last_change":"2024-09-19T08:50:15.896305+0000","last_active":"2024-09-19T08:50:16.885345+0000","last_peered":"2024-09-19T08:50:16.885345+0000","last_clean":"2024-09-19T08:50:16.885345+0000","last_became_active":"2024-09-19T08:50:15.895832+0000","last_became_peered":"2024-09-19T08:50:15.895832+0000","last_unstale":"2024-09-19T08:50:16.885345+0000","last_undegraded":"2024-09-19T08:50:16.885345+0000","last_fullsized":"2024-09-19T08:50:16.885345+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:37.098237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.880615+0000","last_change":"2024-09-19T08:50:15.887251+0000","last_active":"2024-09-19T08:50:16.880615+0000","last_peered":"2024-09-19T08:50:16.880615+0000","last_clean":"2024-09-19T08:50:16.880615+0000","last_became_active":"2024-09-19T08:50:15.886936+0000","last_became_peered":"2024-09-19T08:50:15.886936+0000","last_unstale":"2024-09-19T08:50:16.880615+0000","last_undegraded":"2024-09-19T08:50:16.880615+0000","last_fullsized":"2024-09-19T08:50:16.880615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:38:08.828246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877371+0000","last_change":"2024-09-19T08:50:15.884813+0000","last_active":"2024-09-19T08:50:16.877371+0000","last_peered":"2024-09-19T08:50:16.877371+0000","last_clean":"2024-09-19T08:50:16.877371+0000","last_became_active":"2024-09-19T08:50:15.883445+0000","last_became_peered":"2024-09-19T08:50:15.883445+0000","last_unstale":"2024-09-19T08:50:16.877371+0000","last_undegraded":"2024-09-19T08:50:16.877371+0000","last_fullsized":"2024-09-19T08:50:16.877371+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:39.733501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.884301+0000","last_change":"2024-09-19T08:50:15.887644+0000","last_active":"2024-09-19T08:50:16.884301+0000","last_peered":"2024-09-19T08:50:16.884301+0000","last_clean":"2024-09-19T08:50:16.884301+0000","last_became_active":"2024-09-19T08:50:15.887224+0000","last_became_peered":"2024-09-19T08:50:15.887224+0000","last_unstale":"2024-09-19T08:50:16.884301+0000","last_undegraded":"2024-09-19T08:50:16.884301+0000","last_fullsized":"2024-09-19T08:50:16.884301+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:35.883690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.878822+0000","last_change":"2024-09-19T08:50:15.886678+0000","last_active":"2024-09-19T08:50:16.878822+0000","last_peered":"2024-09-19T08:50:16.878822+0000","last_clean":"2024-09-19T08:50:16.878822+0000","last_became_active":"2024-09-19T08:50:15.886360+0000","last_became_peered":"2024-09-19T08:50:15.886360+0000","last_unstale":"2024-09-19T08:50:16.878822+0000","last_undegraded":"2024-09-19T08:50:16.878822+0000","last_fullsized":"2024-09-19T08:50:16.878822+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:51.515211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876586+0000","last_change":"2024-09-19T08:50:15.887607+0000","last_active":"2024-09-19T08:50:16.876586+0000","last_peered":"2024-09-19T08:50:16.876586+0000","last_clean":"2024-09-19T08:50:16.876586+0000","last_became_active":"2024-09-19T08:50:15.887266+0000","last_became_peered":"2024-09-19T08:50:15.887266+0000","last_unstale":"2024-09-19T08:50:16.876586+0000","last_undegraded":"2024-09-19T08:50:16.876586+0000","last_fullsized":"2024-09-19T08:50:16.876586+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:44:57.404160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.868953+0000","last_change":"2024-09-19T08:50:15.882651+0000","last_active":"2024-09-19T08:50:16.868953+0000","last_peered":"2024-09-19T08:50:16.868953+0000","last_clean":"2024-09-19T08:50:16.868953+0000","last_became_active":"2024-09-19T08:50:15.882298+0000","last_became_peered":"2024-09-19T08:50:15.882298+0000","last_unstale":"2024-09-19T08:50:16.868953+0000","last_undegraded":"2024-09-19T08:50:16.868953+0000","last_fullsized":"2024-09-19T08:50:16.868953+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:16.028013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869849+0000","last_change":"2024-09-19T08:50:15.880407+0000","last_active":"2024-09-19T08:50:16.869849+0000","last_peered":"2024-09-19T08:50:16.869849+0000","last_clean":"2024-09-19T08:50:16.869849+0000","last_became_active":"2024-09-19T08:50:15.880026+0000","last_became_peered":"2024-09-19T08:50:15.880026+0000","last_unstale":"2024-09-19T08:50:16.869849+0000","last_undegraded":"2024-09-19T08:50:16.869849+0000","last_fullsized":"2024-09-19T08:50:16.869849+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:16.600913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869489+0000","last_change":"2024-09-19T08:50:15.883573+0000","last_active":"2024-09-19T08:50:16.869489+0000","last_peered":"2024-09-19T08:50:16.869489+0000","last_clean":"2024-09-19T08:50:16.869489+0000","last_became_active":"2024-09-19T08:50:15.883258+0000","last_became_peered":"2024-09-19T08:50:15.883258+0000","last_unstale":"2024-09-19T08:50:16.869489+0000","last_undegraded":"2024-09-19T08:50:16.869489+0000","last_fullsized":"2024-09-19T08:50:16.869489+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:33.026579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877624+0000","last_change":"2024-09-19T08:50:15.889519+0000","last_active":"2024-09-19T08:50:16.877624+0000","last_peered":"2024-09-19T08:50:16.877624+0000","last_clean":"2024-09-19T08:50:16.877624+0000","last_became_active":"2024-09-19T08:50:15.889183+0000","last_became_peered":"2024-09-19T08:50:15.889183+0000","last_unstale":"2024-09-19T08:50:16.877624+0000","last_undegraded":"2024-09-19T08:50:16.877624+0000","last_fullsized":"2024-09-19T08:50:16.877624+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:06.725662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.884752+0000","last_change":"2024-09-19T08:50:15.894483+0000","last_active":"2024-09-19T08:50:16.884752+0000","last_peered":"2024-09-19T08:50:16.884752+0000","last_clean":"2024-09-19T08:50:16.884752+0000","last_became_active":"2024-09-19T08:50:15.893760+0000","last_became_peered":"2024-09-19T08:50:15.893760+0000","last_unstale":"2024-09-19T08:50:16.884752+0000","last_undegraded":"2024-09-19T08:50:16.884752+0000","last_fullsized":"2024-09-19T08:50:16.884752+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:23.686592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876894+0000","last_change":"2024-09-19T08:50:15.882393+0000","last_active":"2024-09-19T08:50:16.876894+0000","last_peered":"2024-09-19T08:50:16.876894+0000","last_clean":"2024-09-19T08:50:16.876894+0000","last_became_active":"2024-09-19T08:50:15.882040+0000","last_became_peered":"2024-09-19T08:50:15.882040+0000","last_unstale":"2024-09-19T08:50:16.876894+0000","last_undegraded":"2024-09-19T08:50:16.876894+0000","last_fullsized":"2024-09-19T08:50:16.876894+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:22.430017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.878384+0000","last_change":"2024-09-19T08:50:15.890919+0000","last_active":"2024-09-19T08:50:16.878384+0000","last_peered":"2024-09-19T08:50:16.878384+0000","last_clean":"2024-09-19T08:50:16.878384+0000","last_became_active":"2024-09-19T08:50:15.890256+0000","last_became_peered":"2024-09-19T08:50:15.890256+0000","last_unstale":"2024-09-19T08:50:16.878384+0000","last_undegraded":"2024-09-19T08:50:16.878384+0000","last_fullsized":"2024-09-19T08:50:16.878384+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:48.404890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877173+0000","last_change":"2024-09-19T08:50:15.888139+0000","last_active":"2024-09-19T08:50:16.877173+0000","last_peered":"2024-09-19T08:50:16.877173+0000","last_clean":"2024-09-19T08:50:16.877173+0000","last_became_active":"2024-09-19T08:50:15.886471+0000","last_became_peered":"2024-09-19T08:50:15.886471+0000","last_unstale":"2024-09-19T08:50:16.877173+0000","last_undegraded":"2024-09-19T08:50:16.877173+0000","last_fullsized":"2024-09-19T08:50:16.877173+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:20.545473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877882+0000","last_change":"2024-09-19T08:50:15.891354+0000","last_active":"2024-09-19T08:50:16.877882+0000","last_peered":"2024-09-19T08:50:16.877882+0000","last_clean":"2024-09-19T08:50:16.877882+0000","last_became_active":"2024-09-19T08:50:15.890900+0000","last_became_peered":"2024-09-19T08:50:15.890900+0000","last_unstale":"2024-09-19T08:50:16.877882+0000","last_undegraded":"2024-09-19T08:50:16.877882+0000","last_fullsized":"2024-09-19T08:50:16.877882+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:33.139637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.884989+0000","last_change":"2024-09-19T08:50:15.891501+0000","last_active":"2024-09-19T08:50:16.884989+0000","last_peered":"2024-09-19T08:50:16.884989+0000","last_clean":"2024-09-19T08:50:16.884989+0000","last_became_active":"2024-09-19T08:50:15.891183+0000","last_became_peered":"2024-09-19T08:50:15.891183+0000","last_unstale":"2024-09-19T08:50:16.884989+0000","last_undegraded":"2024-09-19T08:50:16.884989+0000","last_fullsized":"2024-09-19T08:50:16.884989+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:16.976705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877858+0000","last_change":"2024-09-19T08:50:15.882048+0000","last_active":"2024-09-19T08:50:16.877858+0000","last_peered":"2024-09-19T08:50:16.877858+0000","last_clean":"2024-09-19T08:50:16.877858+0000","last_became_active":"2024-09-19T08:50:15.881156+0000","last_became_peered":"2024-09-19T08:50:15.881156+0000","last_unstale":"2024-09-19T08:50:16.877858+0000","last_undegraded":"2024-09-19T08:50:16.877858+0000","last_fullsized":"2024-09-19T08:50:16.877858+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:33.198852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":38,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:38.964388+0000","last_change":"2024-09-19T08:50:13.800156+0000","last_active":"2024-09-19T08:50:38.964388+0000","last_peered":"2024-09-19T08:50:38.964388+0000","last_clean":"2024-09-19T08:50:38.964388+0000","last_became_active":"2024-09-19T08:50:13.799779+0000","last_became_peered":"2024-09-19T08:50:13.799779+0000","last_unstale":"2024-09-19T08:50:38.964388+0000","last_undegraded":"2024-09-19T08:50:38.964388+0000","last_fullsized":"2024-09-19T08:50:38.964388+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:38.033049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869794+0000","last_change":"2024-09-19T08:50:15.887252+0000","last_active":"2024-09-19T08:50:16.869794+0000","last_peered":"2024-09-19T08:50:16.869794+0000","last_clean":"2024-09-19T08:50:16.869794+0000","last_became_active":"2024-09-19T08:50:15.886899+0000","last_became_peered":"2024-09-19T08:50:15.886899+0000","last_unstale":"2024-09-19T08:50:16.869794+0000","last_undegraded":"2024-09-19T08:50:16.869794+0000","last_fullsized":"2024-09-19T08:50:16.869794+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:56.262387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:25.932594+0000","last_change":"2024-09-19T08:50:13.795380+0000","last_active":"2024-09-19T08:50:25.932594+0000","last_peered":"2024-09-19T08:50:25.932594+0000","last_clean":"2024-09-19T08:50:25.932594+0000","last_became_active":"2024-09-19T08:50:13.794944+0000","last_became_peered":"2024-09-19T08:50:13.794944+0000","last_unstale":"2024-09-19T08:50:25.932594+0000","last_undegraded":"2024-09-19T08:50:25.932594+0000","last_fullsized":"2024-09-19T08:50:25.932594+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:14.317408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:24.924364+0000","last_change":"2024-09-19T08:50:13.794010+0000","last_active":"2024-09-19T08:50:24.924364+0000","last_peered":"2024-09-19T08:50:24.924364+0000","last_clean":"2024-09-19T08:50:24.924364+0000","last_became_active":"2024-09-19T08:50:13.793677+0000","last_became_peered":"2024-09-19T08:50:13.793677+0000","last_unstale":"2024-09-19T08:50:24.924364+0000","last_undegraded":"2024-09-19T08:50:24.924364+0000","last_fullsized":"2024-09-19T08:50:24.924364+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:56.125702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869056+0000","last_change":"2024-09-19T08:50:15.881732+0000","last_active":"2024-09-19T08:50:16.869056+0000","last_peered":"2024-09-19T08:50:16.869056+0000","last_clean":"2024-09-19T08:50:16.869056+0000","last_became_active":"2024-09-19T08:50:15.881394+0000","last_became_peered":"2024-09-19T08:50:15.881394+0000","last_unstale":"2024-09-19T08:50:16.869056+0000","last_undegraded":"2024-09-19T08:50:16.869056+0000","last_fullsized":"2024-09-19T08:50:16.869056+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:55.549138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.941084+0000","last_change":"2024-09-19T08:50:13.797118+0000","last_active":"2024-09-19T08:50:26.941084+0000","last_peered":"2024-09-19T08:50:26.941084+0000","last_clean":"2024-09-19T08:50:26.941084+0000","last_became_active":"2024-09-19T08:50:13.796727+0000","last_became_peered":"2024-09-19T08:50:13.796727+0000","last_unstale":"2024-09-19T08:50:26.941084+0000","last_undegraded":"2024-09-19T08:50:26.941084+0000","last_fullsized":"2024-09-19T08:50:26.941084+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:49.310543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.879798+0000","last_change":"2024-09-19T08:50:15.888192+0000","last_active":"2024-09-19T08:50:16.879798+0000","last_peered":"2024-09-19T08:50:16.879798+0000","last_clean":"2024-09-19T08:50:16.879798+0000","last_became_active":"2024-09-19T08:50:15.887890+0000","last_became_peered":"2024-09-19T08:50:15.887890+0000","last_unstale":"2024-09-19T08:50:16.879798+0000","last_undegraded":"2024-09-19T08:50:16.879798+0000","last_fullsized":"2024-09-19T08:50:16.879798+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:24:48.951856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":44,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:37.962561+0000","last_change":"2024-09-19T08:50:13.797427+0000","last_active":"2024-09-19T08:50:37.962561+0000","last_peered":"2024-09-19T08:50:37.962561+0000","last_clean":"2024-09-19T08:50:37.962561+0000","last_became_active":"2024-09-19T08:50:13.797021+0000","last_became_peered":"2024-09-19T08:50:13.797021+0000","last_unstale":"2024-09-19T08:50:37.962561+0000","last_undegraded":"2024-09-19T08:50:37.962561+0000","last_fullsized":"2024-09-19T08:50:37.962561+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:14.530373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.878467+0000","last_change":"2024-09-19T08:50:15.894619+0000","last_active":"2024-09-19T08:50:16.878467+0000","last_peered":"2024-09-19T08:50:16.878467+0000","last_clean":"2024-09-19T08:50:16.878467+0000","last_became_active":"2024-09-19T08:50:15.894258+0000","last_became_peered":"2024-09-19T08:50:15.894258+0000","last_unstale":"2024-09-19T08:50:16.878467+0000","last_undegraded":"2024-09-19T08:50:16.878467+0000","last_fullsized":"2024-09-19T08:50:16.878467+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:13.137314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.939873+0000","last_change":"2024-09-19T08:50:13.800867+0000","last_active":"2024-09-19T08:50:26.939873+0000","last_peered":"2024-09-19T08:50:26.939873+0000","last_clean":"2024-09-19T08:50:26.939873+0000","last_became_active":"2024-09-19T08:50:13.800376+0000","last_became_peered":"2024-09-19T08:50:13.800376+0000","last_unstale":"2024-09-19T08:50:26.939873+0000","last_undegraded":"2024-09-19T08:50:26.939873+0000","last_fullsized":"2024-09-19T08:50:26.939873+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:31.924599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.878704+0000","last_change":"2024-09-19T08:50:15.891121+0000","last_active":"2024-09-19T08:50:16.878704+0000","last_peered":"2024-09-19T08:50:16.878704+0000","last_clean":"2024-09-19T08:50:16.878704+0000","last_became_active":"2024-09-19T08:50:15.890810+0000","last_became_peered":"2024-09-19T08:50:15.890810+0000","last_unstale":"2024-09-19T08:50:16.878704+0000","last_undegraded":"2024-09-19T08:50:16.878704+0000","last_fullsized":"2024-09-19T08:50:16.878704+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:13.010282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:25.931563+0000","last_change":"2024-09-19T08:50:14.293953+0000","last_active":"2024-09-19T08:50:25.931563+0000","last_peered":"2024-09-19T08:50:25.931563+0000","last_clean":"2024-09-19T08:50:25.931563+0000","last_became_active":"2024-09-19T08:50:14.293546+0000","last_became_peered":"2024-09-19T08:50:14.293546+0000","last_unstale":"2024-09-19T08:50:25.931563+0000","last_undegraded":"2024-09-19T08:50:25.931563+0000","last_fullsized":"2024-09-19T08:50:25.931563+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:27.809243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877095+0000","last_change":"2024-09-19T08:50:15.878300+0000","last_active":"2024-09-19T08:50:16.877095+0000","last_peered":"2024-09-19T08:50:16.877095+0000","last_clean":"2024-09-19T08:50:16.877095+0000","last_became_active":"2024-09-19T08:50:15.877938+0000","last_became_peered":"2024-09-19T08:50:15.877938+0000","last_unstale":"2024-09-19T08:50:16.877095+0000","last_undegraded":"2024-09-19T08:50:16.877095+0000","last_fullsized":"2024-09-19T08:50:16.877095+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:05.376708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'24","reported_seq":69,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:37.966503+0000","last_change":"2024-09-19T08:50:13.800696+0000","last_active":"2024-09-19T08:50:37.966503+0000","last_peered":"2024-09-19T08:50:37.966503+0000","last_clean":"2024-09-19T08:50:37.966503+0000","last_became_active":"2024-09-19T08:50:13.799385+0000","last_became_peered":"2024-09-19T08:50:13.799385+0000","last_unstale":"2024-09-19T08:50:37.966503+0000","last_undegraded":"2024-09-19T08:50:37.966503+0000","last_fullsized":"2024-09-19T08:50:37.966503+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:56.897309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46802,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":27,"num_read_kb":58,"num_write":26,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.878356+0000","last_change":"2024-09-19T08:50:15.891483+0000","last_active":"2024-09-19T08:50:16.878356+0000","last_peered":"2024-09-19T08:50:16.878356+0000","last_clean":"2024-09-19T08:50:16.878356+0000","last_became_active":"2024-09-19T08:50:15.891185+0000","last_became_peered":"2024-09-19T08:50:15.891185+0000","last_unstale":"2024-09-19T08:50:16.878356+0000","last_undegraded":"2024-09-19T08:50:16.878356+0000","last_fullsized":"2024-09-19T08:50:16.878356+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:26.599151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:27.944994+0000","last_change":"2024-09-19T08:50:13.795148+0000","last_active":"2024-09-19T08:50:27.944994+0000","last_peered":"2024-09-19T08:50:27.944994+0000","last_clean":"2024-09-19T08:50:27.944994+0000","last_became_active":"2024-09-19T08:50:13.794688+0000","last_became_peered":"2024-09-19T08:50:13.794688+0000","last_unstale":"2024-09-19T08:50:27.944994+0000","last_undegraded":"2024-09-19T08:50:27.944994+0000","last_fullsized":"2024-09-19T08:50:27.944994+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:01.366439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877362+0000","last_change":"2024-09-19T08:50:15.886449+0000","last_active":"2024-09-19T08:50:16.877362+0000","last_peered":"2024-09-19T08:50:16.877362+0000","last_clean":"2024-09-19T08:50:16.877362+0000","last_became_active":"2024-09-19T08:50:15.886119+0000","last_became_peered":"2024-09-19T08:50:15.886119+0000","last_unstale":"2024-09-19T08:50:16.877362+0000","last_undegraded":"2024-09-19T08:50:16.877362+0000","last_fullsized":"2024-09-19T08:50:16.877362+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:22.916593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.940744+0000","last_change":"2024-09-19T08:50:13.799363+0000","last_active":"2024-09-19T08:50:26.940744+0000","last_peered":"2024-09-19T08:50:26.940744+0000","last_clean":"2024-09-19T08:50:26.940744+0000","last_became_active":"2024-09-19T08:50:13.799033+0000","last_became_peered":"2024-09-19T08:50:13.799033+0000","last_unstale":"2024-09-19T08:50:26.940744+0000","last_undegraded":"2024-09-19T08:50:26.940744+0000","last_fullsized":"2024-09-19T08:50:26.940744+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:57.753451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877104+0000","last_change":"2024-09-19T08:50:15.898902+0000","last_active":"2024-09-19T08:50:16.877104+0000","last_peered":"2024-09-19T08:50:16.877104+0000","last_clean":"2024-09-19T08:50:16.877104+0000","last_became_active":"2024-09-19T08:50:15.898417+0000","last_became_peered":"2024-09-19T08:50:15.898417+0000","last_unstale":"2024-09-19T08:50:16.877104+0000","last_undegraded":"2024-09-19T08:50:16.877104+0000","last_fullsized":"2024-09-19T08:50:16.877104+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:32:19.799301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'6","reported_seq":37,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:35.962267+0000","last_change":"2024-09-19T08:50:13.798477+0000","last_active":"2024-09-19T08:50:35.962267+0000","last_peered":"2024-09-19T08:50:35.962267+0000","last_clean":"2024-09-19T08:50:35.962267+0000","last_became_active":"2024-09-19T08:50:13.798136+0000","last_became_peered":"2024-09-19T08:50:13.798136+0000","last_unstale":"2024-09-19T08:50:35.962267+0000","last_undegraded":"2024-09-19T08:50:35.962267+0000","last_fullsized":"2024-09-19T08:50:35.962267+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:33.874285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876769+0000","last_change":"2024-09-19T08:50:15.896414+0000","last_active":"2024-09-19T08:50:16.876769+0000","last_peered":"2024-09-19T08:50:16.876769+0000","last_clean":"2024-09-19T08:50:16.876769+0000","last_became_active":"2024-09-19T08:50:15.895530+0000","last_became_peered":"2024-09-19T08:50:15.895530+0000","last_unstale":"2024-09-19T08:50:16.876769+0000","last_undegraded":"2024-09-19T08:50:16.876769+0000","last_fullsized":"2024-09-19T08:50:16.876769+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:59.717869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.940708+0000","last_change":"2024-09-19T08:50:14.294087+0000","last_active":"2024-09-19T08:50:26.940708+0000","last_peered":"2024-09-19T08:50:26.940708+0000","last_clean":"2024-09-19T08:50:26.940708+0000","last_became_active":"2024-09-19T08:50:14.293712+0000","last_became_peered":"2024-09-19T08:50:14.293712+0000","last_unstale":"2024-09-19T08:50:26.940708+0000","last_undegraded":"2024-09-19T08:50:26.940708+0000","last_fullsized":"2024-09-19T08:50:26.940708+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:12.187514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869736+0000","last_change":"2024-09-19T08:50:15.888134+0000","last_active":"2024-09-19T08:50:16.869736+0000","last_peered":"2024-09-19T08:50:16.869736+0000","last_clean":"2024-09-19T08:50:16.869736+0000","last_became_active":"2024-09-19T08:50:15.887768+0000","last_became_peered":"2024-09-19T08:50:15.887768+0000","last_unstale":"2024-09-19T08:50:16.869736+0000","last_undegraded":"2024-09-19T08:50:16.869736+0000","last_fullsized":"2024-09-19T08:50:16.869736+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:12.868773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.920893+0000","last_change":"2024-09-19T08:50:13.792585+0000","last_active":"2024-09-19T08:50:26.920893+0000","last_peered":"2024-09-19T08:50:26.920893+0000","last_clean":"2024-09-19T08:50:26.920893+0000","last_became_active":"2024-09-19T08:50:13.792222+0000","last_became_peered":"2024-09-19T08:50:13.792222+0000","last_unstale":"2024-09-19T08:50:26.920893+0000","last_undegraded":"2024-09-19T08:50:26.920893+0000","last_fullsized":"2024-09-19T08:50:26.920893+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:45.234800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.885284+0000","last_change":"2024-09-19T08:50:15.892725+0000","last_active":"2024-09-19T08:50:16.885284+0000","last_peered":"2024-09-19T08:50:16.885284+0000","last_clean":"2024-09-19T08:50:16.885284+0000","last_became_active":"2024-09-19T08:50:15.892357+0000","last_became_peered":"2024-09-19T08:50:15.892357+0000","last_unstale":"2024-09-19T08:50:16.885284+0000","last_undegraded":"2024-09-19T08:50:16.885284+0000","last_fullsized":"2024-09-19T08:50:16.885284+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:18.756349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.939949+0000","last_change":"2024-09-19T08:50:13.795360+0000","last_active":"2024-09-19T08:50:26.939949+0000","last_peered":"2024-09-19T08:50:26.939949+0000","last_clean":"2024-09-19T08:50:26.939949+0000","last_became_active":"2024-09-19T08:50:13.794823+0000","last_became_peered":"2024-09-19T08:50:13.794823+0000","last_unstale":"2024-09-19T08:50:26.939949+0000","last_undegraded":"2024-09-19T08:50:26.939949+0000","last_fullsized":"2024-09-19T08:50:26.939949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:15.037834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877268+0000","last_change":"2024-09-19T08:50:15.893668+0000","last_active":"2024-09-19T08:50:16.877268+0000","last_peered":"2024-09-19T08:50:16.877268+0000","last_clean":"2024-09-19T08:50:16.877268+0000","last_became_active":"2024-09-19T08:50:15.893303+0000","last_became_peered":"2024-09-19T08:50:15.893303+0000","last_unstale":"2024-09-19T08:50:16.877268+0000","last_undegraded":"2024-09-19T08:50:16.877268+0000","last_fullsized":"2024-09-19T08:50:16.877268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:59.281601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.939251+0000","last_change":"2024-09-19T08:50:13.797442+0000","last_active":"2024-09-19T08:50:26.939251+0000","last_peered":"2024-09-19T08:50:26.939251+0000","last_clean":"2024-09-19T08:50:26.939251+0000","last_became_active":"2024-09-19T08:50:13.797072+0000","last_became_peered":"2024-09-19T08:50:13.797072+0000","last_unstale":"2024-09-19T08:50:26.939251+0000","last_undegraded":"2024-09-19T08:50:26.939251+0000","last_fullsized":"2024-09-19T08:50:26.939251+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:32.960928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876874+0000","last_change":"2024-09-19T08:50:15.895819+0000","last_active":"2024-09-19T08:50:16.876874+0000","last_peered":"2024-09-19T08:50:16.876874+0000","last_clean":"2024-09-19T08:50:16.876874+0000","last_became_active":"2024-09-19T08:50:15.895468+0000","last_became_peered":"2024-09-19T08:50:15.895468+0000","last_unstale":"2024-09-19T08:50:16.876874+0000","last_undegraded":"2024-09-19T08:50:16.876874+0000","last_fullsized":"2024-09-19T08:50:16.876874+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:33.568263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'6","reported_seq":40,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:38.964995+0000","last_change":"2024-09-19T08:50:14.294014+0000","last_active":"2024-09-19T08:50:38.964995+0000","last_peered":"2024-09-19T08:50:38.964995+0000","last_clean":"2024-09-19T08:50:38.964995+0000","last_became_active":"2024-09-19T08:50:14.293564+0000","last_became_peered":"2024-09-19T08:50:14.293564+0000","last_unstale":"2024-09-19T08:50:38.964995+0000","last_undegraded":"2024-09-19T08:50:38.964995+0000","last_fullsized":"2024-09-19T08:50:38.964995+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:23.806408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877550+0000","last_change":"2024-09-19T08:50:15.891840+0000","last_active":"2024-09-19T08:50:16.877550+0000","last_peered":"2024-09-19T08:50:16.877550+0000","last_clean":"2024-09-19T08:50:16.877550+0000","last_became_active":"2024-09-19T08:50:15.891511+0000","last_became_peered":"2024-09-19T08:50:15.891511+0000","last_unstale":"2024-09-19T08:50:16.877550+0000","last_undegraded":"2024-09-19T08:50:16.877550+0000","last_fullsized":"2024-09-19T08:50:16.877550+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:26.800508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":327,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877159+0000","last_change":"2024-09-19T08:49:02.071497+0000","last_active":"2024-09-19T08:50:16.877159+0000","last_peered":"2024-09-19T08:50:16.877159+0000","last_clean":"2024-09-19T08:50:16.877159+0000","last_became_active":"2024-09-19T08:49:02.071114+0000","last_became_peered":"2024-09-19T08:49:02.071114+0000","last_unstale":"2024-09-19T08:50:16.877159+0000","last_undegraded":"2024-09-19T08:50:16.877159+0000","last_fullsized":"2024-09-19T08:50:16.877159+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:45:36.600595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:45:36.600595+0000","last_clean_scrub_stamp":"2024-09-19T08:45:36.600595+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:18:15.369279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:27.945549+0000","last_change":"2024-09-19T08:50:13.793981+0000","last_active":"2024-09-19T08:50:27.945549+0000","last_peered":"2024-09-19T08:50:27.945549+0000","last_clean":"2024-09-19T08:50:27.945549+0000","last_became_active":"2024-09-19T08:50:13.793616+0000","last_became_peered":"2024-09-19T08:50:13.793616+0000","last_unstale":"2024-09-19T08:50:27.945549+0000","last_undegraded":"2024-09-19T08:50:27.945549+0000","last_fullsized":"2024-09-19T08:50:27.945549+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:45.195906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869593+0000","last_change":"2024-09-19T08:50:15.891248+0000","last_active":"2024-09-19T08:50:16.869593+0000","last_peered":"2024-09-19T08:50:16.869593+0000","last_clean":"2024-09-19T08:50:16.869593+0000","last_became_active":"2024-09-19T08:50:15.890922+0000","last_became_peered":"2024-09-19T08:50:15.890922+0000","last_unstale":"2024-09-19T08:50:16.869593+0000","last_undegraded":"2024-09-19T08:50:16.869593+0000","last_fullsized":"2024-09-19T08:50:16.869593+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:18:43.914214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:24.924191+0000","last_change":"2024-09-19T08:50:13.797471+0000","last_active":"2024-09-19T08:50:24.924191+0000","last_peered":"2024-09-19T08:50:24.924191+0000","last_clean":"2024-09-19T08:50:24.924191+0000","last_became_active":"2024-09-19T08:50:13.797033+0000","last_became_peered":"2024-09-19T08:50:13.797033+0000","last_unstale":"2024-09-19T08:50:24.924191+0000","last_undegraded":"2024-09-19T08:50:24.924191+0000","last_fullsized":"2024-09-19T08:50:24.924191+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:53.141708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876668+0000","last_change":"2024-09-19T08:50:15.882650+0000","last_active":"2024-09-19T08:50:16.876668+0000","last_peered":"2024-09-19T08:50:16.876668+0000","last_clean":"2024-09-19T08:50:16.876668+0000","last_became_active":"2024-09-19T08:50:15.882308+0000","last_became_peered":"2024-09-19T08:50:15.882308+0000","last_unstale":"2024-09-19T08:50:16.876668+0000","last_undegraded":"2024-09-19T08:50:16.876668+0000","last_fullsized":"2024-09-19T08:50:16.876668+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:26.449562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":37,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:38.964970+0000","last_change":"2024-09-19T08:50:14.292466+0000","last_active":"2024-09-19T08:50:38.964970+0000","last_peered":"2024-09-19T08:50:38.964970+0000","last_clean":"2024-09-19T08:50:38.964970+0000","last_became_active":"2024-09-19T08:50:14.292092+0000","last_became_peered":"2024-09-19T08:50:14.292092+0000","last_unstale":"2024-09-19T08:50:38.964970+0000","last_undegraded":"2024-09-19T08:50:38.964970+0000","last_fullsized":"2024-09-19T08:50:38.964970+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:11.373226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869763+0000","last_change":"2024-09-19T08:50:15.886093+0000","last_active":"2024-09-19T08:50:16.869763+0000","last_peered":"2024-09-19T08:50:16.869763+0000","last_clean":"2024-09-19T08:50:16.869763+0000","last_became_active":"2024-09-19T08:50:15.885790+0000","last_became_peered":"2024-09-19T08:50:15.885790+0000","last_unstale":"2024-09-19T08:50:16.869763+0000","last_undegraded":"2024-09-19T08:50:16.869763+0000","last_fullsized":"2024-09-19T08:50:16.869763+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:06.405176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'5","reported_seq":37,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:38.963700+0000","last_change":"2024-09-19T08:50:13.799909+0000","last_active":"2024-09-19T08:50:38.963700+0000","last_peered":"2024-09-19T08:50:38.963700+0000","last_clean":"2024-09-19T08:50:38.963700+0000","last_became_active":"2024-09-19T08:50:13.799542+0000","last_became_peered":"2024-09-19T08:50:13.799542+0000","last_unstale":"2024-09-19T08:50:38.963700+0000","last_undegraded":"2024-09-19T08:50:38.963700+0000","last_fullsized":"2024-09-19T08:50:38.963700+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:23.545897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.870214+0000","last_change":"2024-09-19T08:50:15.890410+0000","last_active":"2024-09-19T08:50:16.870214+0000","last_peered":"2024-09-19T08:50:16.870214+0000","last_clean":"2024-09-19T08:50:16.870214+0000","last_became_active":"2024-09-19T08:50:15.890093+0000","last_became_peered":"2024-09-19T08:50:15.890093+0000","last_unstale":"2024-09-19T08:50:16.870214+0000","last_undegraded":"2024-09-19T08:50:16.870214+0000","last_fullsized":"2024-09-19T08:50:16.870214+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:06.533722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.880158+0000","last_change":"2024-09-19T08:50:14.292577+0000","last_active":"2024-09-19T08:50:16.880158+0000","last_peered":"2024-09-19T08:50:16.880158+0000","last_clean":"2024-09-19T08:50:16.880158+0000","last_became_active":"2024-09-19T08:50:14.292220+0000","last_became_peered":"2024-09-19T08:50:14.292220+0000","last_unstale":"2024-09-19T08:50:16.880158+0000","last_undegraded":"2024-09-19T08:50:16.880158+0000","last_fullsized":"2024-09-19T08:50:16.880158+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:23.631672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:18.755907+0000","last_change":"2024-09-19T08:50:15.891345+0000","last_active":"2024-09-19T08:50:18.755907+0000","last_peered":"2024-09-19T08:50:18.755907+0000","last_clean":"2024-09-19T08:50:18.755907+0000","last_became_active":"2024-09-19T08:50:15.891006+0000","last_became_peered":"2024-09-19T08:50:15.891006+0000","last_unstale":"2024-09-19T08:50:18.755907+0000","last_undegraded":"2024-09-19T08:50:18.755907+0000","last_fullsized":"2024-09-19T08:50:18.755907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:41.934331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.940739+0000","last_change":"2024-09-19T08:50:14.292619+0000","last_active":"2024-09-19T08:50:26.940739+0000","last_peered":"2024-09-19T08:50:26.940739+0000","last_clean":"2024-09-19T08:50:26.940739+0000","last_became_active":"2024-09-19T08:50:14.292230+0000","last_became_peered":"2024-09-19T08:50:14.292230+0000","last_unstale":"2024-09-19T08:50:26.940739+0000","last_undegraded":"2024-09-19T08:50:26.940739+0000","last_fullsized":"2024-09-19T08:50:26.940739+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:21:33.076142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877022+0000","last_change":"2024-09-19T08:50:15.882760+0000","last_active":"2024-09-19T08:50:16.877022+0000","last_peered":"2024-09-19T08:50:16.877022+0000","last_clean":"2024-09-19T08:50:16.877022+0000","last_became_active":"2024-09-19T08:50:15.882402+0000","last_became_peered":"2024-09-19T08:50:15.882402+0000","last_unstale":"2024-09-19T08:50:16.877022+0000","last_undegraded":"2024-09-19T08:50:16.877022+0000","last_fullsized":"2024-09-19T08:50:16.877022+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:17.343385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'12","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:35.876663+0000","last_change":"2024-09-19T08:50:13.790982+0000","last_active":"2024-09-19T08:50:35.876663+0000","last_peered":"2024-09-19T08:50:35.876663+0000","last_clean":"2024-09-19T08:50:35.876663+0000","last_became_active":"2024-09-19T08:50:13.790644+0000","last_became_peered":"2024-09-19T08:50:13.790644+0000","last_unstale":"2024-09-19T08:50:35.876663+0000","last_undegraded":"2024-09-19T08:50:35.876663+0000","last_fullsized":"2024-09-19T08:50:35.876663+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:20:25.923021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869864+0000","last_change":"2024-09-19T08:50:15.887556+0000","last_active":"2024-09-19T08:50:16.869864+0000","last_peered":"2024-09-19T08:50:16.869864+0000","last_clean":"2024-09-19T08:50:16.869864+0000","last_became_active":"2024-09-19T08:50:15.887280+0000","last_became_peered":"2024-09-19T08:50:15.887280+0000","last_unstale":"2024-09-19T08:50:16.869864+0000","last_undegraded":"2024-09-19T08:50:16.869864+0000","last_fullsized":"2024-09-19T08:50:16.869864+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:51.226527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.939936+0000","last_change":"2024-09-19T08:50:14.012150+0000","last_active":"2024-09-19T08:50:26.939936+0000","last_peered":"2024-09-19T08:50:26.939936+0000","last_clean":"2024-09-19T08:50:26.939936+0000","last_became_active":"2024-09-19T08:50:14.011799+0000","last_became_peered":"2024-09-19T08:50:14.011799+0000","last_unstale":"2024-09-19T08:50:26.939936+0000","last_undegraded":"2024-09-19T08:50:26.939936+0000","last_fullsized":"2024-09-19T08:50:26.939936+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:37.310539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.878237+0000","last_change":"2024-09-19T08:50:15.889577+0000","last_active":"2024-09-19T08:50:16.878237+0000","last_peered":"2024-09-19T08:50:16.878237+0000","last_clean":"2024-09-19T08:50:16.878237+0000","last_became_active":"2024-09-19T08:50:15.889244+0000","last_became_peered":"2024-09-19T08:50:15.889244+0000","last_unstale":"2024-09-19T08:50:16.878237+0000","last_undegraded":"2024-09-19T08:50:16.878237+0000","last_fullsized":"2024-09-19T08:50:16.878237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:54.382221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:23.919295+0000","last_change":"2024-09-19T08:50:14.293845+0000","last_active":"2024-09-19T08:50:23.919295+0000","last_peered":"2024-09-19T08:50:23.919295+0000","last_clean":"2024-09-19T08:50:23.919295+0000","last_became_active":"2024-09-19T08:50:14.293585+0000","last_became_peered":"2024-09-19T08:50:14.293585+0000","last_unstale":"2024-09-19T08:50:23.919295+0000","last_undegraded":"2024-09-19T08:50:23.919295+0000","last_fullsized":"2024-09-19T08:50:23.919295+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:02.886475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877681+0000","last_change":"2024-09-19T08:50:15.888591+0000","last_active":"2024-09-19T08:50:16.877681+0000","last_peered":"2024-09-19T08:50:16.877681+0000","last_clean":"2024-09-19T08:50:16.877681+0000","last_became_active":"2024-09-19T08:50:15.888270+0000","last_became_peered":"2024-09-19T08:50:15.888270+0000","last_unstale":"2024-09-19T08:50:16.877681+0000","last_undegraded":"2024-09-19T08:50:16.877681+0000","last_fullsized":"2024-09-19T08:50:16.877681+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:08.644828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.939797+0000","last_change":"2024-09-19T08:50:13.794081+0000","last_active":"2024-09-19T08:50:26.939797+0000","last_peered":"2024-09-19T08:50:26.939797+0000","last_clean":"2024-09-19T08:50:26.939797+0000","last_became_active":"2024-09-19T08:50:13.793770+0000","last_became_peered":"2024-09-19T08:50:13.793770+0000","last_unstale":"2024-09-19T08:50:26.939797+0000","last_undegraded":"2024-09-19T08:50:26.939797+0000","last_fullsized":"2024-09-19T08:50:26.939797+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:43.053893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.885008+0000","last_change":"2024-09-19T08:50:15.885338+0000","last_active":"2024-09-19T08:50:16.885008+0000","last_peered":"2024-09-19T08:50:16.885008+0000","last_clean":"2024-09-19T08:50:16.885008+0000","last_became_active":"2024-09-19T08:50:15.884983+0000","last_became_peered":"2024-09-19T08:50:15.884983+0000","last_unstale":"2024-09-19T08:50:16.885008+0000","last_undegraded":"2024-09-19T08:50:16.885008+0000","last_fullsized":"2024-09-19T08:50:16.885008+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:05.228871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'3","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:25.931497+0000","last_change":"2024-09-19T08:50:13.795440+0000","last_active":"2024-09-19T08:50:25.931497+0000","last_peered":"2024-09-19T08:50:25.931497+0000","last_clean":"2024-09-19T08:50:25.931497+0000","last_became_active":"2024-09-19T08:50:13.795053+0000","last_became_peered":"2024-09-19T08:50:13.795053+0000","last_unstale":"2024-09-19T08:50:25.931497+0000","last_undegraded":"2024-09-19T08:50:25.931497+0000","last_fullsized":"2024-09-19T08:50:25.931497+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:13.466112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869289+0000","last_change":"2024-09-19T08:50:15.886587+0000","last_active":"2024-09-19T08:50:16.869289+0000","last_peered":"2024-09-19T08:50:16.869289+0000","last_clean":"2024-09-19T08:50:16.869289+0000","last_became_active":"2024-09-19T08:50:15.886231+0000","last_became_peered":"2024-09-19T08:50:15.886231+0000","last_unstale":"2024-09-19T08:50:16.869289+0000","last_undegraded":"2024-09-19T08:50:16.869289+0000","last_fullsized":"2024-09-19T08:50:16.869289+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:11.965382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:23.921108+0000","last_change":"2024-09-19T08:50:13.796681+0000","last_active":"2024-09-19T08:50:23.921108+0000","last_peered":"2024-09-19T08:50:23.921108+0000","last_clean":"2024-09-19T08:50:23.921108+0000","last_became_active":"2024-09-19T08:50:13.796338+0000","last_became_peered":"2024-09-19T08:50:13.796338+0000","last_unstale":"2024-09-19T08:50:23.921108+0000","last_undegraded":"2024-09-19T08:50:23.921108+0000","last_fullsized":"2024-09-19T08:50:23.921108+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:32.588800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877525+0000","last_change":"2024-09-19T08:50:15.889667+0000","last_active":"2024-09-19T08:50:16.877525+0000","last_peered":"2024-09-19T08:50:16.877525+0000","last_clean":"2024-09-19T08:50:16.877525+0000","last_became_active":"2024-09-19T08:50:15.889341+0000","last_became_peered":"2024-09-19T08:50:15.889341+0000","last_unstale":"2024-09-19T08:50:16.877525+0000","last_undegraded":"2024-09-19T08:50:16.877525+0000","last_fullsized":"2024-09-19T08:50:16.877525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:13.255483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.870110+0000","last_change":"2024-09-19T08:50:15.887337+0000","last_active":"2024-09-19T08:50:16.870110+0000","last_peered":"2024-09-19T08:50:16.870110+0000","last_clean":"2024-09-19T08:50:16.870110+0000","last_became_active":"2024-09-19T08:50:15.887001+0000","last_became_peered":"2024-09-19T08:50:15.887001+0000","last_unstale":"2024-09-19T08:50:16.870110+0000","last_undegraded":"2024-09-19T08:50:16.870110+0000","last_fullsized":"2024-09-19T08:50:16.870110+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:43.544863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.940436+0000","last_change":"2024-09-19T08:50:13.799321+0000","last_active":"2024-09-19T08:50:26.940436+0000","last_peered":"2024-09-19T08:50:26.940436+0000","last_clean":"2024-09-19T08:50:26.940436+0000","last_became_active":"2024-09-19T08:50:13.798837+0000","last_became_peered":"2024-09-19T08:50:13.798837+0000","last_unstale":"2024-09-19T08:50:26.940436+0000","last_undegraded":"2024-09-19T08:50:26.940436+0000","last_fullsized":"2024-09-19T08:50:26.940436+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:35.753093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876836+0000","last_change":"2024-09-19T08:50:15.892074+0000","last_active":"2024-09-19T08:50:16.876836+0000","last_peered":"2024-09-19T08:50:16.876836+0000","last_clean":"2024-09-19T08:50:16.876836+0000","last_became_active":"2024-09-19T08:50:15.891722+0000","last_became_peered":"2024-09-19T08:50:15.891722+0000","last_unstale":"2024-09-19T08:50:16.876836+0000","last_undegraded":"2024-09-19T08:50:16.876836+0000","last_fullsized":"2024-09-19T08:50:16.876836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:39.913080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:27.944924+0000","last_change":"2024-09-19T08:50:13.795577+0000","last_active":"2024-09-19T08:50:27.944924+0000","last_peered":"2024-09-19T08:50:27.944924+0000","last_clean":"2024-09-19T08:50:27.944924+0000","last_became_active":"2024-09-19T08:50:13.795254+0000","last_became_peered":"2024-09-19T08:50:13.795254+0000","last_unstale":"2024-09-19T08:50:27.944924+0000","last_undegraded":"2024-09-19T08:50:27.944924+0000","last_fullsized":"2024-09-19T08:50:27.944924+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:13.263447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.878562+0000","last_change":"2024-09-19T08:50:15.884584+0000","last_active":"2024-09-19T08:50:16.878562+0000","last_peered":"2024-09-19T08:50:16.878562+0000","last_clean":"2024-09-19T08:50:16.878562+0000","last_became_active":"2024-09-19T08:50:15.884244+0000","last_became_peered":"2024-09-19T08:50:15.884244+0000","last_unstale":"2024-09-19T08:50:16.878562+0000","last_undegraded":"2024-09-19T08:50:16.878562+0000","last_fullsized":"2024-09-19T08:50:16.878562+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:58.835351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.880212+0000","last_change":"2024-09-19T08:50:14.294210+0000","last_active":"2024-09-19T08:50:16.880212+0000","last_peered":"2024-09-19T08:50:16.880212+0000","last_clean":"2024-09-19T08:50:16.880212+0000","last_became_active":"2024-09-19T08:50:14.293850+0000","last_became_peered":"2024-09-19T08:50:14.293850+0000","last_unstale":"2024-09-19T08:50:16.880212+0000","last_undegraded":"2024-09-19T08:50:16.880212+0000","last_fullsized":"2024-09-19T08:50:16.880212+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:42:44.340766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869569+0000","last_change":"2024-09-19T08:50:15.892934+0000","last_active":"2024-09-19T08:50:16.869569+0000","last_peered":"2024-09-19T08:50:16.869569+0000","last_clean":"2024-09-19T08:50:16.869569+0000","last_became_active":"2024-09-19T08:50:15.892309+0000","last_became_peered":"2024-09-19T08:50:15.892309+0000","last_unstale":"2024-09-19T08:50:16.869569+0000","last_undegraded":"2024-09-19T08:50:16.869569+0000","last_fullsized":"2024-09-19T08:50:16.869569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:40.158724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":43,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:36.960299+0000","last_change":"2024-09-19T08:50:13.796977+0000","last_active":"2024-09-19T08:50:36.960299+0000","last_peered":"2024-09-19T08:50:36.960299+0000","last_clean":"2024-09-19T08:50:36.960299+0000","last_became_active":"2024-09-19T08:50:13.796628+0000","last_became_peered":"2024-09-19T08:50:13.796628+0000","last_unstale":"2024-09-19T08:50:36.960299+0000","last_undegraded":"2024-09-19T08:50:36.960299+0000","last_fullsized":"2024-09-19T08:50:36.960299+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:59.335583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":54010,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":154,"num_read_kb":136,"num_write":231,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":178334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":247642,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579922,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":872448,"data_stored":416651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32176,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712976,"statfs":{"total":95995035648,"available":95962087424,"internally_reserved":0,"allocated":1015808,"data_stored":1054482,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972380,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":897024,"data_stored":416188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201313,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":892928,"data_stored":416566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430246,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":1009086,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593772,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":415905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822704,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":1008371,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953523,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":416159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182458,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":897024,"data_stored":415730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411392,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":464233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":937984,"data_stored":471772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738441,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":417637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34206,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34206,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":56706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":57319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":48931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:50:43.879 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T08:50:43.879 INFO:tasks.cephadm:Setting up client nodes... 2024-09-19T08:50:43.880 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-19T08:50:44.143 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:44.504 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:44 smithi019 ceph-mon[30976]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:50:44.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.596+0000 7faa9c608640 1 -- 172.21.15.19:0/67119085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa94107960 msgr2=0x7faa94109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:44.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.596+0000 7faa9c608640 1 --2- 172.21.15.19:0/67119085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa94107960 0x7faa94109d50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7faa8c009ca0 tx=0x7faa8c02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:50:44.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.596+0000 7faa9c608640 1 -- 172.21.15.19:0/67119085 shutdown_connections 2024-09-19T08:50:44.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.596+0000 7faa9c608640 1 --2- 172.21.15.19:0/67119085 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa94105030 0x7faa94107420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:44.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.596+0000 7faa9c608640 1 --2- 172.21.15.19:0/67119085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa94107960 0x7faa94109d50 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:44.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.596+0000 7faa9c608640 1 --2- 172.21.15.19:0/67119085 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa94102700 0x7faa94104af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:44.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.596+0000 7faa9c608640 1 -- 172.21.15.19:0/67119085 >> 172.21.15.19:0/67119085 conn(0x7faa940fc2a0 msgr2=0x7faa940fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:44.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.596+0000 7faa9c608640 1 -- 172.21.15.19:0/67119085 shutdown_connections 2024-09-19T08:50:44.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.596+0000 7faa9c608640 1 -- 172.21.15.19:0/67119085 wait complete. 2024-09-19T08:50:44.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.597+0000 7faa9c608640 1 Processor -- start 2024-09-19T08:50:44.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.597+0000 7faa9c608640 1 -- start start 2024-09-19T08:50:44.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.597+0000 7faa9c608640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa94102700 0x7faa94197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:44.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.597+0000 7faa9c608640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa94105030 0x7faa94198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:44.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.597+0000 7faa9c608640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa94107960 0x7faa9419f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:44.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.597+0000 7faa9c608640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7faa9410d8a0 con 0x7faa94107960 2024-09-19T08:50:44.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.597+0000 7faa9c608640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7faa9410d720 con 0x7faa94105030 2024-09-19T08:50:44.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.597+0000 7faa9c608640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7faa9410da20 con 0x7faa94102700 2024-09-19T08:50:44.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.597+0000 7faa9aba5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa94107960 0x7faa9419f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:44.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.597+0000 7faa9aba5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa94107960 0x7faa9419f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40856/0 (socket says 172.21.15.19:40856) 2024-09-19T08:50:44.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.597+0000 7faa9aba5640 1 -- 172.21.15.19:0/672653918 learned_addr learned my addr 172.21.15.19:0/672653918 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:50:44.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.597+0000 7faa9a3a4640 1 --2- 172.21.15.19:0/672653918 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa94102700 0x7faa94197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:44.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.597+0000 7faa99ba3640 1 --2- 172.21.15.19:0/672653918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa94105030 0x7faa94198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:44.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.597+0000 7faa9aba5640 1 -- 172.21.15.19:0/672653918 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa94102700 msgr2=0x7faa94197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:44.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.597+0000 7faa9aba5640 1 --2- 172.21.15.19:0/672653918 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa94102700 0x7faa94197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:44.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.597+0000 7faa9aba5640 1 -- 172.21.15.19:0/672653918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa94105030 msgr2=0x7faa94198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:44.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.597+0000 7faa9aba5640 1 --2- 172.21.15.19:0/672653918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa94105030 0x7faa94198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:44.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.597+0000 7faa9aba5640 1 -- 172.21.15.19:0/672653918 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa9419fb30 con 0x7faa94107960 2024-09-19T08:50:44.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.598+0000 7faa9aba5640 1 --2- 172.21.15.19:0/672653918 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa94107960 0x7faa9419f4c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7faa8c005e30 tx=0x7faa8c031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:44.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.598+0000 7faa8b7fe640 1 -- 172.21.15.19:0/672653918 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c003c30 con 0x7faa94107960 2024-09-19T08:50:44.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.598+0000 7faa8b7fe640 1 -- 172.21.15.19:0/672653918 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faa8c003dd0 con 0x7faa94107960 2024-09-19T08:50:44.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.598+0000 7faa9c608640 1 -- 172.21.15.19:0/672653918 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa9419fdc0 con 0x7faa94107960 2024-09-19T08:50:44.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.598+0000 7faa8b7fe640 1 -- 172.21.15.19:0/672653918 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8c02fde0 con 0x7faa94107960 2024-09-19T08:50:44.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.598+0000 7faa9c608640 1 -- 172.21.15.19:0/672653918 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa941a02d0 con 0x7faa94107960 2024-09-19T08:50:44.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.599+0000 7faa9c608640 1 -- 172.21.15.19:0/672653918 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa940fdd90 con 0x7faa94107960 2024-09-19T08:50:44.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.600+0000 7faa8b7fe640 1 -- 172.21.15.19:0/672653918 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7faa8c004050 con 0x7faa94107960 2024-09-19T08:50:44.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.601+0000 7faa8b7fe640 1 --2- 172.21.15.19:0/672653918 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7faa800a3380 0x7faa800a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:44.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.601+0000 7faa9a3a4640 1 --2- 172.21.15.19:0/672653918 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7faa800a3380 0x7faa800a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:44.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.601+0000 7faa8b7fe640 1 -- 172.21.15.19:0/672653918 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7faa8c0f0be0 con 0x7faa94107960 2024-09-19T08:50:44.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.601+0000 7faa9a3a4640 1 --2- 172.21.15.19:0/672653918 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7faa800a3380 0x7faa800a5840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7faa9000bbe0 tx=0x7faa9000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:44.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.605+0000 7faa8b7fe640 1 -- 172.21.15.19:0/672653918 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faa8c0bd960 con 0x7faa94107960 2024-09-19T08:50:44.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:44 smithi155 ceph-mon[34921]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:50:44.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:44 smithi203 ceph-mon[35450]: from='client.14757 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:50:44.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.847+0000 7faa9c608640 1 -- 172.21.15.19:0/672653918 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7faa9402da10 con 0x7faa94107960 2024-09-19T08:50:44.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.849+0000 7faa8b7fe640 1 -- 172.21.15.19:0/672653918 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7faa8c0bd260 con 0x7faa94107960 2024-09-19T08:50:44.850 INFO:teuthology.orchestra.run.smithi019.stdout:[client.0] 2024-09-19T08:50:44.850 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQDk5etmmFegMhAABV24SBQErN1xUWzMtZnQMA== 2024-09-19T08:50:44.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.852+0000 7faa9c608640 1 -- 172.21.15.19:0/672653918 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7faa800a3380 msgr2=0x7faa800a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:44.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.852+0000 7faa9c608640 1 --2- 172.21.15.19:0/672653918 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7faa800a3380 0x7faa800a5840 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7faa9000bbe0 tx=0x7faa9000b390 comp rx=0 tx=0).stop 2024-09-19T08:50:44.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.852+0000 7faa9c608640 1 -- 172.21.15.19:0/672653918 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa94107960 msgr2=0x7faa9419f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:44.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.852+0000 7faa9c608640 1 --2- 172.21.15.19:0/672653918 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa94107960 0x7faa9419f4c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7faa8c005e30 tx=0x7faa8c031ee0 comp rx=0 tx=0).stop 2024-09-19T08:50:44.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.852+0000 7faa9c608640 1 -- 172.21.15.19:0/672653918 shutdown_connections 2024-09-19T08:50:44.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.852+0000 7faa9c608640 1 --2- 172.21.15.19:0/672653918 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7faa800a3380 0x7faa800a5840 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:44.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.852+0000 7faa9c608640 1 --2- 172.21.15.19:0/672653918 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faa94107960 0x7faa9419f4c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:44.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.852+0000 7faa9c608640 1 --2- 172.21.15.19:0/672653918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faa94105030 0x7faa94198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:44.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.852+0000 7faa9c608640 1 --2- 172.21.15.19:0/672653918 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa94102700 0x7faa94197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:44.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.852+0000 7faa9c608640 1 -- 172.21.15.19:0/672653918 >> 172.21.15.19:0/672653918 conn(0x7faa940fc2a0 msgr2=0x7faa94102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:44.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.852+0000 7faa9c608640 1 -- 172.21.15.19:0/672653918 shutdown_connections 2024-09-19T08:50:44.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:44.852+0000 7faa9c608640 1 -- 172.21.15.19:0/672653918 wait complete. 2024-09-19T08:50:45.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:45 smithi155 ceph-mon[34921]: pgmap v291: 97 pgs: 97 active+clean; 637 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.5 KiB/s wr, 15 op/s 2024-09-19T08:50:45.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:45 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/672653918' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T08:50:45.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:45 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/672653918' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T08:50:45.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:45 smithi203 ceph-mon[35450]: pgmap v291: 97 pgs: 97 active+clean; 637 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.5 KiB/s wr, 15 op/s 2024-09-19T08:50:45.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:45 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/672653918' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T08:50:45.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:45 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/672653918' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T08:50:45.732 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:45 smithi019 ceph-mon[30976]: pgmap v291: 97 pgs: 97 active+clean; 637 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.5 KiB/s wr, 15 op/s 2024-09-19T08:50:45.732 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:45 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/672653918' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T08:50:45.733 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:45 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/672653918' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T08:50:45.768 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-19T08:50:45.768 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-19T08:50:45.768 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T08:50:45.811 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T08:50:45.811 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-19T08:50:45.811 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-19T08:50:46.111 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:46.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.610+0000 7fc78a457640 1 -- 172.21.15.19:0/17929019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7841055b0 msgr2=0x7fc78410d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:46.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.610+0000 7fc78a457640 1 --2- 172.21.15.19:0/17929019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7841055b0 0x7fc78410d130 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc77c00adb0 tx=0x7fc77c02b7a0 comp rx=0 tx=0).stop 2024-09-19T08:50:46.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.610+0000 7fc78a457640 1 -- 172.21.15.19:0/17929019 shutdown_connections 2024-09-19T08:50:46.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.610+0000 7fc78a457640 1 --2- 172.21.15.19:0/17929019 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7841055b0 0x7fc78410d130 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:46.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.610+0000 7fc78a457640 1 --2- 172.21.15.19:0/17929019 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc784100e30 0x7fc784104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:46.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.610+0000 7fc78a457640 1 --2- 172.21.15.19:0/17929019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc784100480 0x7fc784100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:46.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.610+0000 7fc78a457640 1 -- 172.21.15.19:0/17929019 >> 172.21.15.19:0/17929019 conn(0x7fc784077210 msgr2=0x7fc7840fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:46.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.610+0000 7fc78a457640 1 -- 172.21.15.19:0/17929019 shutdown_connections 2024-09-19T08:50:46.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.610+0000 7fc78a457640 1 -- 172.21.15.19:0/17929019 wait complete. 2024-09-19T08:50:46.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.610+0000 7fc78a457640 1 Processor -- start 2024-09-19T08:50:46.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.610+0000 7fc78a457640 1 -- start start 2024-09-19T08:50:46.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.611+0000 7fc78a457640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc784100480 0x7fc784198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:46.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.611+0000 7fc78a457640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc784100e30 0x7fc784198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:46.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.611+0000 7fc78a457640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7841055b0 0x7fc78419cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:46.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.611+0000 7fc78a457640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc78410fd90 con 0x7fc784100e30 2024-09-19T08:50:46.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.611+0000 7fc78a457640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc78410fc10 con 0x7fc784100480 2024-09-19T08:50:46.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.611+0000 7fc78a457640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc78410ff10 con 0x7fc7841055b0 2024-09-19T08:50:46.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.611+0000 7fc7837fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc784100e30 0x7fc784198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:46.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.611+0000 7fc7837fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc784100e30 0x7fc784198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35602/0 (socket says 172.21.15.19:35602) 2024-09-19T08:50:46.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.611+0000 7fc7837fe640 1 -- 172.21.15.19:0/1384061683 learned_addr learned my addr 172.21.15.19:0/1384061683 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:50:46.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.611+0000 7fc783fff640 1 --2- 172.21.15.19:0/1384061683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc784100480 0x7fc784198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:46.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.611+0000 7fc7889f4640 1 --2- 172.21.15.19:0/1384061683 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7841055b0 0x7fc78419cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:46.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.611+0000 7fc7837fe640 1 -- 172.21.15.19:0/1384061683 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7841055b0 msgr2=0x7fc78419cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:46.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.611+0000 7fc7837fe640 1 --2- 172.21.15.19:0/1384061683 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7841055b0 0x7fc78419cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:46.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.611+0000 7fc7837fe640 1 -- 172.21.15.19:0/1384061683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc784100480 msgr2=0x7fc784198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:46.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.611+0000 7fc7837fe640 1 --2- 172.21.15.19:0/1384061683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc784100480 0x7fc784198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:46.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.611+0000 7fc7837fe640 1 -- 172.21.15.19:0/1384061683 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc78419d400 con 0x7fc784100e30 2024-09-19T08:50:46.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.611+0000 7fc7837fe640 1 --2- 172.21.15.19:0/1384061683 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc784100e30 0x7fc784198990 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc77800d950 tx=0x7fc77800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:46.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.612+0000 7fc7817fa640 1 -- 172.21.15.19:0/1384061683 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc778017030 con 0x7fc784100e30 2024-09-19T08:50:46.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.612+0000 7fc7817fa640 1 -- 172.21.15.19:0/1384061683 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc778004020 con 0x7fc784100e30 2024-09-19T08:50:46.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.612+0000 7fc78a457640 1 -- 172.21.15.19:0/1384061683 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc78419d6f0 con 0x7fc784100e30 2024-09-19T08:50:46.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.612+0000 7fc7817fa640 1 -- 172.21.15.19:0/1384061683 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7780047a0 con 0x7fc784100e30 2024-09-19T08:50:46.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.612+0000 7fc78a457640 1 -- 172.21.15.19:0/1384061683 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7841a4fd0 con 0x7fc784100e30 2024-09-19T08:50:46.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.613+0000 7fc78a457640 1 -- 172.21.15.19:0/1384061683 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc784100860 con 0x7fc784100e30 2024-09-19T08:50:46.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.614+0000 7fc7817fa640 1 -- 172.21.15.19:0/1384061683 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc7780041d0 con 0x7fc784100e30 2024-09-19T08:50:46.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.615+0000 7fc7817fa640 1 --2- 172.21.15.19:0/1384061683 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc76c0a3350 0x7fc76c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:46.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.615+0000 7fc783fff640 1 --2- 172.21.15.19:0/1384061683 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc76c0a3350 0x7fc76c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:46.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.615+0000 7fc7817fa640 1 -- 172.21.15.19:0/1384061683 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fc7780cf1f0 con 0x7fc784100e30 2024-09-19T08:50:46.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.615+0000 7fc783fff640 1 --2- 172.21.15.19:0/1384061683 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc76c0a3350 0x7fc76c0a5810 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc7740058c0 tx=0x7fc77400a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:46.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.619+0000 7fc7817fa640 1 -- 172.21.15.19:0/1384061683 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc77809bf60 con 0x7fc784100e30 2024-09-19T08:50:46.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.842+0000 7fc78a457640 1 -- 172.21.15.19:0/1384061683 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fc78402d7c0 con 0x7fc784100e30 2024-09-19T08:50:46.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.846+0000 7fc7817fa640 1 -- 172.21.15.19:0/1384061683 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264047 (secure 0 0 0) 0x7fc77809b860 con 0x7fc784100e30 2024-09-19T08:50:46.850 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:50:46.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.849+0000 7fc78a457640 1 -- 172.21.15.19:0/1384061683 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc76c0a3350 msgr2=0x7fc76c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:46.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.849+0000 7fc78a457640 1 --2- 172.21.15.19:0/1384061683 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc76c0a3350 0x7fc76c0a5810 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc7740058c0 tx=0x7fc77400a250 comp rx=0 tx=0).stop 2024-09-19T08:50:46.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.849+0000 7fc78a457640 1 -- 172.21.15.19:0/1384061683 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc784100e30 msgr2=0x7fc784198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:46.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.849+0000 7fc78a457640 1 --2- 172.21.15.19:0/1384061683 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc784100e30 0x7fc784198990 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc77800d950 tx=0x7fc77800de10 comp rx=0 tx=0).stop 2024-09-19T08:50:46.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.849+0000 7fc78a457640 1 -- 172.21.15.19:0/1384061683 shutdown_connections 2024-09-19T08:50:46.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.849+0000 7fc78a457640 1 --2- 172.21.15.19:0/1384061683 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc76c0a3350 0x7fc76c0a5810 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:46.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.849+0000 7fc78a457640 1 --2- 172.21.15.19:0/1384061683 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7841055b0 0x7fc78419cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:46.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.849+0000 7fc78a457640 1 --2- 172.21.15.19:0/1384061683 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc784100e30 0x7fc784198990 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:46.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.849+0000 7fc78a457640 1 --2- 172.21.15.19:0/1384061683 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc784100480 0x7fc784198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:46.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.849+0000 7fc78a457640 1 -- 172.21.15.19:0/1384061683 >> 172.21.15.19:0/1384061683 conn(0x7fc784077210 msgr2=0x7fc784103d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:46.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.849+0000 7fc78a457640 1 -- 172.21.15.19:0/1384061683 shutdown_connections 2024-09-19T08:50:46.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:46.849+0000 7fc78a457640 1 -- 172.21.15.19:0/1384061683 wait complete. 2024-09-19T08:50:47.661 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:47 smithi019 ceph-mon[30976]: pgmap v292: 97 pgs: 97 active+clean; 637 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.3 KiB/s wr, 12 op/s 2024-09-19T08:50:47.662 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:47 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1384061683' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T08:50:47.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:47 smithi155 ceph-mon[34921]: pgmap v292: 97 pgs: 97 active+clean; 637 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.3 KiB/s wr, 12 op/s 2024-09-19T08:50:47.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:47 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1384061683' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T08:50:47.698 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":1181234346},{"type":"v1","addr":"172.21.15.19:6801","nonce":1181234346}]},"active_addr":"172.21.15.19:6801/1181234346","active_change":"2024-09-19T08:43:21.732368+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24110,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.19:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":3056300595}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":424182441}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":621811985}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":1818352476}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.19:0","nonce":444342149}]}]} 2024-09-19T08:50:47.704 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-19T08:50:47.704 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-19T08:50:47.704 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:50:47.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:47 smithi203 ceph-mon[35450]: pgmap v292: 97 pgs: 97 active+clean; 637 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.3 KiB/s wr, 12 op/s 2024-09-19T08:50:47.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:47 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1384061683' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T08:50:47.973 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:48.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.455+0000 7f4f8d4b6640 1 -- 172.21.15.19:0/2313091717 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f88101de0 msgr2=0x7f4f881021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:48.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.455+0000 7f4f8d4b6640 1 --2- 172.21.15.19:0/2313091717 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f88101de0 0x7f4f881021c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4f78009900 tx=0x7f4f7802a410 comp rx=0 tx=0).stop 2024-09-19T08:50:48.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.455+0000 7f4f8d4b6640 1 -- 172.21.15.19:0/2313091717 shutdown_connections 2024-09-19T08:50:48.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.455+0000 7f4f8d4b6640 1 --2- 172.21.15.19:0/2313091717 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f88102790 0x7f4f881067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.455+0000 7f4f8d4b6640 1 --2- 172.21.15.19:0/2313091717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f88106f10 0x7f4f8810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.455+0000 7f4f8d4b6640 1 --2- 172.21.15.19:0/2313091717 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f88101de0 0x7f4f881021c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.455+0000 7f4f8d4b6640 1 -- 172.21.15.19:0/2313091717 >> 172.21.15.19:0/2313091717 conn(0x7f4f880fd8c0 msgr2=0x7f4f880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:48.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.455+0000 7f4f8d4b6640 1 -- 172.21.15.19:0/2313091717 shutdown_connections 2024-09-19T08:50:48.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.455+0000 7f4f8d4b6640 1 -- 172.21.15.19:0/2313091717 wait complete. 2024-09-19T08:50:48.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.456+0000 7f4f8d4b6640 1 Processor -- start 2024-09-19T08:50:48.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.456+0000 7f4f8d4b6640 1 -- start start 2024-09-19T08:50:48.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.456+0000 7f4f8d4b6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f88101de0 0x7f4f880744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:48.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.456+0000 7f4f8d4b6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f88102790 0x7f4f88074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:48.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.456+0000 7f4f8d4b6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f88106f10 0x7f4f88074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:48.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.456+0000 7f4f8d4b6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4f88111f70 con 0x7f4f88106f10 2024-09-19T08:50:48.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.456+0000 7f4f8d4b6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4f88111df0 con 0x7f4f88101de0 2024-09-19T08:50:48.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.456+0000 7f4f8d4b6640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4f881120f0 con 0x7f4f88102790 2024-09-19T08:50:48.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.456+0000 7f4f877fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f88106f10 0x7f4f88074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:48.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.456+0000 7f4f877fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f88106f10 0x7f4f88074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35610/0 (socket says 172.21.15.19:35610) 2024-09-19T08:50:48.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.456+0000 7f4f877fe640 1 -- 172.21.15.19:0/1243901936 learned_addr learned my addr 172.21.15.19:0/1243901936 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:50:48.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.457+0000 7f4f867fc640 1 --2- 172.21.15.19:0/1243901936 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f88102790 0x7f4f88074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:48.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.457+0000 7f4f86ffd640 1 --2- 172.21.15.19:0/1243901936 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f88101de0 0x7f4f880744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:48.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.457+0000 7f4f877fe640 1 -- 172.21.15.19:0/1243901936 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f88102790 msgr2=0x7f4f88074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:48.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.457+0000 7f4f877fe640 1 --2- 172.21.15.19:0/1243901936 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f88102790 0x7f4f88074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.457+0000 7f4f877fe640 1 -- 172.21.15.19:0/1243901936 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f88101de0 msgr2=0x7f4f880744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:48.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.457+0000 7f4f877fe640 1 --2- 172.21.15.19:0/1243901936 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f88101de0 0x7f4f880744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.457+0000 7f4f877fe640 1 -- 172.21.15.19:0/1243901936 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f881a68f0 con 0x7f4f88106f10 2024-09-19T08:50:48.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.457+0000 7f4f877fe640 1 --2- 172.21.15.19:0/1243901936 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f88106f10 0x7f4f88074f70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009fd0 tx=0x7f4f8000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:48.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.457+0000 7f4f6ffff640 1 -- 172.21.15.19:0/1243901936 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f80017070 con 0x7f4f88106f10 2024-09-19T08:50:48.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.457+0000 7f4f6ffff640 1 -- 172.21.15.19:0/1243901936 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4f80003e50 con 0x7f4f88106f10 2024-09-19T08:50:48.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.457+0000 7f4f8d4b6640 1 -- 172.21.15.19:0/1243901936 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f881a6be0 con 0x7f4f88106f10 2024-09-19T08:50:48.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.457+0000 7f4f6ffff640 1 -- 172.21.15.19:0/1243901936 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f800106c0 con 0x7f4f88106f10 2024-09-19T08:50:48.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.457+0000 7f4f8d4b6640 1 -- 172.21.15.19:0/1243901936 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f881a70d0 con 0x7f4f88106f10 2024-09-19T08:50:48.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.458+0000 7f4f8d4b6640 1 -- 172.21.15.19:0/1243901936 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f881021c0 con 0x7f4f88106f10 2024-09-19T08:50:48.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.460+0000 7f4f6ffff640 1 -- 172.21.15.19:0/1243901936 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4f80003970 con 0x7f4f88106f10 2024-09-19T08:50:48.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.461+0000 7f4f6ffff640 1 --2- 172.21.15.19:0/1243901936 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4f700a32d0 0x7f4f700a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:48.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.461+0000 7f4f86ffd640 1 --2- 172.21.15.19:0/1243901936 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4f700a32d0 0x7f4f700a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:48.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.461+0000 7f4f6ffff640 1 -- 172.21.15.19:0/1243901936 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f4f800cf600 con 0x7f4f88106f10 2024-09-19T08:50:48.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.461+0000 7f4f86ffd640 1 --2- 172.21.15.19:0/1243901936 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4f700a32d0 0x7f4f700a5790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4f78009230 tx=0x7f4f780058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:48.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.464+0000 7f4f6ffff640 1 -- 172.21.15.19:0/1243901936 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4f8009bc20 con 0x7f4f88106f10 2024-09-19T08:50:48.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.641+0000 7f4f8d4b6640 1 -- 172.21.15.19:0/1243901936 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4f8810a0f0 con 0x7f4f88106f10 2024-09-19T08:50:48.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.642+0000 7f4f6ffff640 1 -- 172.21.15.19:0/1243901936 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22276 (secure 0 0 0) 0x7f4f8009ff20 con 0x7f4f88106f10 2024-09-19T08:50:48.643 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:50:48.643 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":80,"fsid":"f26c9d84-7662-11ef-bceb-c7b262605968","created":"2024-09-19T08:42:32.324073+0000","modified":"2024-09-19T08:50:16.477000+0000","last_up_change":"2024-09-19T08:49:24.764960+0000","last_in_change":"2024-09-19T08:49:01.062919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:45:36.232910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:50:12.615884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:50:14.854513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81c7bb06-5b13-4ee0-9290-d779faac1b91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6803","nonce":3397146732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6805","nonce":3397146732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6809","nonce":3397146732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6807","nonce":3397146732}]},"public_addr":"172.21.15.19:6803/3397146732","cluster_addr":"172.21.15.19:6805/3397146732","heartbeat_back_addr":"172.21.15.19:6809/3397146732","heartbeat_front_addr":"172.21.15.19:6807/3397146732","state":["exists","up"]},{"osd":1,"uuid":"24c145e6-5252-4708-8f25-5ce041e8251e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6801","nonce":2011043685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6803","nonce":2011043685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6807","nonce":2011043685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6805","nonce":2011043685}]},"public_addr":"172.21.15.155:6801/2011043685","cluster_addr":"172.21.15.155:6803/2011043685","heartbeat_back_addr":"172.21.15.155:6807/2011043685","heartbeat_front_addr":"172.21.15.155:6805/2011043685","state":["exists","up"]},{"osd":2,"uuid":"99cefd33-0675-495f-8871-2e6fdead0c3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6801","nonce":3358994623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6803","nonce":3358994623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6807","nonce":3358994623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6805","nonce":3358994623}]},"public_addr":"172.21.15.203:6801/3358994623","cluster_addr":"172.21.15.203:6803/3358994623","heartbeat_back_addr":"172.21.15.203:6807/3358994623","heartbeat_front_addr":"172.21.15.203:6805/3358994623","state":["exists","up"]},{"osd":3,"uuid":"8f46c16c-f17e-484a-8b66-6dbf135f34c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6811","nonce":176445576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6813","nonce":176445576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6817","nonce":176445576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6815","nonce":176445576}]},"public_addr":"172.21.15.19:6811/176445576","cluster_addr":"172.21.15.19:6813/176445576","heartbeat_back_addr":"172.21.15.19:6817/176445576","heartbeat_front_addr":"172.21.15.19:6815/176445576","state":["exists","up"]},{"osd":4,"uuid":"411b0423-1317-4e82-bc01-b5f55b391bc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6809","nonce":2163087792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6811","nonce":2163087792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6815","nonce":2163087792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6813","nonce":2163087792}]},"public_addr":"172.21.15.155:6809/2163087792","cluster_addr":"172.21.15.155:6811/2163087792","heartbeat_back_addr":"172.21.15.155:6815/2163087792","heartbeat_front_addr":"172.21.15.155:6813/2163087792","state":["exists","up"]},{"osd":5,"uuid":"057c073e-569f-4c6e-9602-e1169ad4dd8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6809","nonce":334881465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6811","nonce":334881465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6815","nonce":334881465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6813","nonce":334881465}]},"public_addr":"172.21.15.203:6809/334881465","cluster_addr":"172.21.15.203:6811/334881465","heartbeat_back_addr":"172.21.15.203:6815/334881465","heartbeat_front_addr":"172.21.15.203:6813/334881465","state":["exists","up"]},{"osd":6,"uuid":"40418f13-823e-4f94-a427-84781abbcb5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6819","nonce":2669779791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6821","nonce":2669779791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6825","nonce":2669779791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6823","nonce":2669779791}]},"public_addr":"172.21.15.19:6819/2669779791","cluster_addr":"172.21.15.19:6821/2669779791","heartbeat_back_addr":"172.21.15.19:6825/2669779791","heartbeat_front_addr":"172.21.15.19:6823/2669779791","state":["exists","up"]},{"osd":7,"uuid":"ad15f762-aeab-4167-a63d-6c9f9b89b9c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6817","nonce":3169455907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6819","nonce":3169455907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6823","nonce":3169455907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6821","nonce":3169455907}]},"public_addr":"172.21.15.155:6817/3169455907","cluster_addr":"172.21.15.155:6819/3169455907","heartbeat_back_addr":"172.21.15.155:6823/3169455907","heartbeat_front_addr":"172.21.15.155:6821/3169455907","state":["exists","up"]},{"osd":8,"uuid":"23cf8ea2-29d6-43d8-a05b-7822f4bbf254","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6817","nonce":1062999528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6819","nonce":1062999528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6823","nonce":1062999528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6821","nonce":1062999528}]},"public_addr":"172.21.15.203:6817/1062999528","cluster_addr":"172.21.15.203:6819/1062999528","heartbeat_back_addr":"172.21.15.203:6823/1062999528","heartbeat_front_addr":"172.21.15.203:6821/1062999528","state":["exists","up"]},{"osd":9,"uuid":"e851e605-2d17-4fbf-b783-2138133edd06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6827","nonce":574664786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6829","nonce":574664786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6833","nonce":574664786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6831","nonce":574664786}]},"public_addr":"172.21.15.19:6827/574664786","cluster_addr":"172.21.15.19:6829/574664786","heartbeat_back_addr":"172.21.15.19:6833/574664786","heartbeat_front_addr":"172.21.15.19:6831/574664786","state":["exists","up"]},{"osd":10,"uuid":"cc770717-91bd-4494-9103-6db8214b5872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6825","nonce":2242158832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6827","nonce":2242158832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6831","nonce":2242158832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6829","nonce":2242158832}]},"public_addr":"172.21.15.155:6825/2242158832","cluster_addr":"172.21.15.155:6827/2242158832","heartbeat_back_addr":"172.21.15.155:6831/2242158832","heartbeat_front_addr":"172.21.15.155:6829/2242158832","state":["exists","up"]},{"osd":11,"uuid":"6c237db9-5d79-47bc-8ff6-60d09d721d5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6825","nonce":522943955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6827","nonce":522943955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6831","nonce":522943955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6829","nonce":522943955}]},"public_addr":"172.21.15.203:6825/522943955","cluster_addr":"172.21.15.203:6827/522943955","heartbeat_back_addr":"172.21.15.203:6831/522943955","heartbeat_front_addr":"172.21.15.203:6829/522943955","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:44:44.656414+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:09.339183+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:33.245452+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:59.449025+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:46:24.831213+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:46:49.189780+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:47:13.493628+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:47:39.478247+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:05.089875+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:30.722878+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:56.951834+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:22.894678+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6801/4266644067":"2024-09-20T08:43:21.732222+0000","172.21.15.19:0/1398782170":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6800/4266644067":"2024-09-20T08:43:21.732222+0000","172.21.15.19:0/34162461":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6801/1764769529":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/2910961714":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6800/1764769529":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/820792769":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/560203138":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/809642328":"2024-09-20T08:42:56.618773+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:50:48.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.644+0000 7f4f8d4b6640 1 -- 172.21.15.19:0/1243901936 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4f700a32d0 msgr2=0x7f4f700a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:48.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.644+0000 7f4f8d4b6640 1 --2- 172.21.15.19:0/1243901936 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4f700a32d0 0x7f4f700a5790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4f78009230 tx=0x7f4f780058d0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.644+0000 7f4f8d4b6640 1 -- 172.21.15.19:0/1243901936 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f88106f10 msgr2=0x7f4f88074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:48.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.644+0000 7f4f8d4b6640 1 --2- 172.21.15.19:0/1243901936 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f88106f10 0x7f4f88074f70 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009fd0 tx=0x7f4f8000b260 comp rx=0 tx=0).stop 2024-09-19T08:50:48.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.645+0000 7f4f8d4b6640 1 -- 172.21.15.19:0/1243901936 shutdown_connections 2024-09-19T08:50:48.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.645+0000 7f4f8d4b6640 1 --2- 172.21.15.19:0/1243901936 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4f700a32d0 0x7f4f700a5790 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.645+0000 7f4f8d4b6640 1 --2- 172.21.15.19:0/1243901936 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f88102790 0x7f4f88074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.645+0000 7f4f8d4b6640 1 --2- 172.21.15.19:0/1243901936 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f88106f10 0x7f4f88074f70 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.645+0000 7f4f8d4b6640 1 --2- 172.21.15.19:0/1243901936 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f88101de0 0x7f4f880744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:48.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.645+0000 7f4f8d4b6640 1 -- 172.21.15.19:0/1243901936 >> 172.21.15.19:0/1243901936 conn(0x7f4f880fd8c0 msgr2=0x7f4f880fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:48.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.645+0000 7f4f8d4b6640 1 -- 172.21.15.19:0/1243901936 shutdown_connections 2024-09-19T08:50:48.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:48.645+0000 7f4f8d4b6640 1 -- 172.21.15.19:0/1243901936 wait complete. 2024-09-19T08:50:49.277 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-19T08:50:49.277 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:50:49.537 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:49.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:49 smithi019 ceph-mon[30976]: pgmap v293: 97 pgs: 97 active+clean; 637 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-09-19T08:50:49.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:49 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1243901936' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:50:49.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:49 smithi155 ceph-mon[34921]: pgmap v293: 97 pgs: 97 active+clean; 637 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-09-19T08:50:49.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:49 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1243901936' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:50:49.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:49 smithi203 ceph-mon[35450]: pgmap v293: 97 pgs: 97 active+clean; 637 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 3.2 KiB/s wr, 10 op/s 2024-09-19T08:50:49.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:49 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1243901936' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:50:50.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.015+0000 7f98c991b640 1 -- 172.21.15.19:0/1089535323 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98c4106a90 msgr2=0x7f98c4106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:50.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.015+0000 7f98c991b640 1 --2- 172.21.15.19:0/1089535323 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98c4106a90 0x7f98c4106e70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f98b4009930 tx=0x7f98b402a420 comp rx=0 tx=0).stop 2024-09-19T08:50:50.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.015+0000 7f98c991b640 1 -- 172.21.15.19:0/1089535323 shutdown_connections 2024-09-19T08:50:50.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.015+0000 7f98c991b640 1 --2- 172.21.15.19:0/1089535323 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98c4101430 0x7f98c410d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:50.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.015+0000 7f98c991b640 1 --2- 172.21.15.19:0/1089535323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98c4100a90 0x7f98c4100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:50.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.015+0000 7f98c991b640 1 --2- 172.21.15.19:0/1089535323 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98c4106a90 0x7f98c4106e70 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:50.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.015+0000 7f98c991b640 1 -- 172.21.15.19:0/1089535323 >> 172.21.15.19:0/1089535323 conn(0x7f98c40fc7d0 msgr2=0x7f98c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:50.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.015+0000 7f98c991b640 1 -- 172.21.15.19:0/1089535323 shutdown_connections 2024-09-19T08:50:50.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.015+0000 7f98c991b640 1 -- 172.21.15.19:0/1089535323 wait complete. 2024-09-19T08:50:50.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.016+0000 7f98c991b640 1 Processor -- start 2024-09-19T08:50:50.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.016+0000 7f98c991b640 1 -- start start 2024-09-19T08:50:50.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.016+0000 7f98c991b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98c4100a90 0x7f98c41983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:50.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.016+0000 7f98c991b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98c4101430 0x7f98c4198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:50.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.016+0000 7f98c991b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98c4106a90 0x7f98c419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:50.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.016+0000 7f98c991b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f98c4111fb0 con 0x7f98c4101430 2024-09-19T08:50:50.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.016+0000 7f98c991b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f98c4111e30 con 0x7f98c4106a90 2024-09-19T08:50:50.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.016+0000 7f98c991b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f98c4112130 con 0x7f98c4100a90 2024-09-19T08:50:50.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.017+0000 7f98c2ffd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98c4100a90 0x7f98c41983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:50.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.017+0000 7f98c2ffd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98c4100a90 0x7f98c41983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:53692/0 (socket says 172.21.15.19:53692) 2024-09-19T08:50:50.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.017+0000 7f98c2ffd640 1 -- 172.21.15.19:0/1072418475 learned_addr learned my addr 172.21.15.19:0/1072418475 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:50:50.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.017+0000 7f98ba7fc640 1 --2- 172.21.15.19:0/1072418475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98c4101430 0x7f98c4198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:50.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.017+0000 7f98c37fe640 1 --2- 172.21.15.19:0/1072418475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98c4106a90 0x7f98c419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:50.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.017+0000 7f98ba7fc640 1 -- 172.21.15.19:0/1072418475 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98c4100a90 msgr2=0x7f98c41983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:50.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.017+0000 7f98ba7fc640 1 --2- 172.21.15.19:0/1072418475 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98c4100a90 0x7f98c41983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:50.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.017+0000 7f98ba7fc640 1 -- 172.21.15.19:0/1072418475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98c4106a90 msgr2=0x7f98c419ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:50.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.017+0000 7f98ba7fc640 1 --2- 172.21.15.19:0/1072418475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98c4106a90 0x7f98c419ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:50.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.017+0000 7f98ba7fc640 1 -- 172.21.15.19:0/1072418475 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98c419d3a0 con 0x7f98c4101430 2024-09-19T08:50:50.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.017+0000 7f98c37fe640 1 --2- 172.21.15.19:0/1072418475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98c4106a90 0x7f98c419ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:50:50.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.017+0000 7f98ba7fc640 1 --2- 172.21.15.19:0/1072418475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98c4101430 0x7f98c4198930 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f98ac00c970 tx=0x7f98ac00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:50.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.017+0000 7f98c8919640 1 -- 172.21.15.19:0/1072418475 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98ac007bb0 con 0x7f98c4101430 2024-09-19T08:50:50.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.017+0000 7f98c8919640 1 -- 172.21.15.19:0/1072418475 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f98ac007d50 con 0x7f98c4101430 2024-09-19T08:50:50.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.017+0000 7f98c991b640 1 -- 172.21.15.19:0/1072418475 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98c419d690 con 0x7f98c4101430 2024-09-19T08:50:50.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.017+0000 7f98c8919640 1 -- 172.21.15.19:0/1072418475 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98ac018820 con 0x7f98c4101430 2024-09-19T08:50:50.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.018+0000 7f98c991b640 1 -- 172.21.15.19:0/1072418475 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98c41a4f70 con 0x7f98c4101430 2024-09-19T08:50:50.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.019+0000 7f98c991b640 1 -- 172.21.15.19:0/1072418475 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98c4100ef0 con 0x7f98c4101430 2024-09-19T08:50:50.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.020+0000 7f98c8919640 1 -- 172.21.15.19:0/1072418475 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f98ac0189c0 con 0x7f98c4101430 2024-09-19T08:50:50.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.021+0000 7f98c8919640 1 --2- 172.21.15.19:0/1072418475 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f98b00a32d0 0x7f98b00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:50.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.021+0000 7f98c2ffd640 1 --2- 172.21.15.19:0/1072418475 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f98b00a32d0 0x7f98b00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:50.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.021+0000 7f98c8919640 1 -- 172.21.15.19:0/1072418475 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f98ac0cfa80 con 0x7f98c4101430 2024-09-19T08:50:50.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.021+0000 7f98c2ffd640 1 --2- 172.21.15.19:0/1072418475 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f98b00a32d0 0x7f98b00a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f98b4000c00 tx=0x7f98b4009560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:50.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.024+0000 7f98c8919640 1 -- 172.21.15.19:0/1072418475 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f98ac0d1e20 con 0x7f98c4101430 2024-09-19T08:50:50.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.200+0000 7f98c991b640 1 -- 172.21.15.19:0/1072418475 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f98c41a51a0 con 0x7f98c4101430 2024-09-19T08:50:50.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.201+0000 7f98c8919640 1 -- 172.21.15.19:0/1072418475 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22276 (secure 0 0 0) 0x7f98ac014030 con 0x7f98c4101430 2024-09-19T08:50:50.202 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:50:50.202 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":80,"fsid":"f26c9d84-7662-11ef-bceb-c7b262605968","created":"2024-09-19T08:42:32.324073+0000","modified":"2024-09-19T08:50:16.477000+0000","last_up_change":"2024-09-19T08:49:24.764960+0000","last_in_change":"2024-09-19T08:49:01.062919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:45:36.232910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:50:12.615884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:50:14.854513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81c7bb06-5b13-4ee0-9290-d779faac1b91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6803","nonce":3397146732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6805","nonce":3397146732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6809","nonce":3397146732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6807","nonce":3397146732}]},"public_addr":"172.21.15.19:6803/3397146732","cluster_addr":"172.21.15.19:6805/3397146732","heartbeat_back_addr":"172.21.15.19:6809/3397146732","heartbeat_front_addr":"172.21.15.19:6807/3397146732","state":["exists","up"]},{"osd":1,"uuid":"24c145e6-5252-4708-8f25-5ce041e8251e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6801","nonce":2011043685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6803","nonce":2011043685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6807","nonce":2011043685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6805","nonce":2011043685}]},"public_addr":"172.21.15.155:6801/2011043685","cluster_addr":"172.21.15.155:6803/2011043685","heartbeat_back_addr":"172.21.15.155:6807/2011043685","heartbeat_front_addr":"172.21.15.155:6805/2011043685","state":["exists","up"]},{"osd":2,"uuid":"99cefd33-0675-495f-8871-2e6fdead0c3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6801","nonce":3358994623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6803","nonce":3358994623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6807","nonce":3358994623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6805","nonce":3358994623}]},"public_addr":"172.21.15.203:6801/3358994623","cluster_addr":"172.21.15.203:6803/3358994623","heartbeat_back_addr":"172.21.15.203:6807/3358994623","heartbeat_front_addr":"172.21.15.203:6805/3358994623","state":["exists","up"]},{"osd":3,"uuid":"8f46c16c-f17e-484a-8b66-6dbf135f34c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6811","nonce":176445576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6813","nonce":176445576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6817","nonce":176445576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6815","nonce":176445576}]},"public_addr":"172.21.15.19:6811/176445576","cluster_addr":"172.21.15.19:6813/176445576","heartbeat_back_addr":"172.21.15.19:6817/176445576","heartbeat_front_addr":"172.21.15.19:6815/176445576","state":["exists","up"]},{"osd":4,"uuid":"411b0423-1317-4e82-bc01-b5f55b391bc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6809","nonce":2163087792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6811","nonce":2163087792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6815","nonce":2163087792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6813","nonce":2163087792}]},"public_addr":"172.21.15.155:6809/2163087792","cluster_addr":"172.21.15.155:6811/2163087792","heartbeat_back_addr":"172.21.15.155:6815/2163087792","heartbeat_front_addr":"172.21.15.155:6813/2163087792","state":["exists","up"]},{"osd":5,"uuid":"057c073e-569f-4c6e-9602-e1169ad4dd8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6809","nonce":334881465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6811","nonce":334881465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6815","nonce":334881465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6813","nonce":334881465}]},"public_addr":"172.21.15.203:6809/334881465","cluster_addr":"172.21.15.203:6811/334881465","heartbeat_back_addr":"172.21.15.203:6815/334881465","heartbeat_front_addr":"172.21.15.203:6813/334881465","state":["exists","up"]},{"osd":6,"uuid":"40418f13-823e-4f94-a427-84781abbcb5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6819","nonce":2669779791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6821","nonce":2669779791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6825","nonce":2669779791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6823","nonce":2669779791}]},"public_addr":"172.21.15.19:6819/2669779791","cluster_addr":"172.21.15.19:6821/2669779791","heartbeat_back_addr":"172.21.15.19:6825/2669779791","heartbeat_front_addr":"172.21.15.19:6823/2669779791","state":["exists","up"]},{"osd":7,"uuid":"ad15f762-aeab-4167-a63d-6c9f9b89b9c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6817","nonce":3169455907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6819","nonce":3169455907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6823","nonce":3169455907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6821","nonce":3169455907}]},"public_addr":"172.21.15.155:6817/3169455907","cluster_addr":"172.21.15.155:6819/3169455907","heartbeat_back_addr":"172.21.15.155:6823/3169455907","heartbeat_front_addr":"172.21.15.155:6821/3169455907","state":["exists","up"]},{"osd":8,"uuid":"23cf8ea2-29d6-43d8-a05b-7822f4bbf254","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6817","nonce":1062999528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6819","nonce":1062999528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6823","nonce":1062999528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6821","nonce":1062999528}]},"public_addr":"172.21.15.203:6817/1062999528","cluster_addr":"172.21.15.203:6819/1062999528","heartbeat_back_addr":"172.21.15.203:6823/1062999528","heartbeat_front_addr":"172.21.15.203:6821/1062999528","state":["exists","up"]},{"osd":9,"uuid":"e851e605-2d17-4fbf-b783-2138133edd06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6827","nonce":574664786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6829","nonce":574664786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6833","nonce":574664786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6831","nonce":574664786}]},"public_addr":"172.21.15.19:6827/574664786","cluster_addr":"172.21.15.19:6829/574664786","heartbeat_back_addr":"172.21.15.19:6833/574664786","heartbeat_front_addr":"172.21.15.19:6831/574664786","state":["exists","up"]},{"osd":10,"uuid":"cc770717-91bd-4494-9103-6db8214b5872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6825","nonce":2242158832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6827","nonce":2242158832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6831","nonce":2242158832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6829","nonce":2242158832}]},"public_addr":"172.21.15.155:6825/2242158832","cluster_addr":"172.21.15.155:6827/2242158832","heartbeat_back_addr":"172.21.15.155:6831/2242158832","heartbeat_front_addr":"172.21.15.155:6829/2242158832","state":["exists","up"]},{"osd":11,"uuid":"6c237db9-5d79-47bc-8ff6-60d09d721d5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6825","nonce":522943955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6827","nonce":522943955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6831","nonce":522943955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6829","nonce":522943955}]},"public_addr":"172.21.15.203:6825/522943955","cluster_addr":"172.21.15.203:6827/522943955","heartbeat_back_addr":"172.21.15.203:6831/522943955","heartbeat_front_addr":"172.21.15.203:6829/522943955","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:44:44.656414+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:09.339183+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:33.245452+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:59.449025+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:46:24.831213+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:46:49.189780+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:47:13.493628+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:47:39.478247+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:05.089875+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:30.722878+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:56.951834+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:22.894678+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6801/4266644067":"2024-09-20T08:43:21.732222+0000","172.21.15.19:0/1398782170":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6800/4266644067":"2024-09-20T08:43:21.732222+0000","172.21.15.19:0/34162461":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6801/1764769529":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/2910961714":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6800/1764769529":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/820792769":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/560203138":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/809642328":"2024-09-20T08:42:56.618773+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:50:50.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.204+0000 7f98c991b640 1 -- 172.21.15.19:0/1072418475 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f98b00a32d0 msgr2=0x7f98b00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:50.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.204+0000 7f98c991b640 1 --2- 172.21.15.19:0/1072418475 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f98b00a32d0 0x7f98b00a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f98b4000c00 tx=0x7f98b4009560 comp rx=0 tx=0).stop 2024-09-19T08:50:50.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.204+0000 7f98c991b640 1 -- 172.21.15.19:0/1072418475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98c4101430 msgr2=0x7f98c4198930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:50.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.204+0000 7f98c991b640 1 --2- 172.21.15.19:0/1072418475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98c4101430 0x7f98c4198930 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f98ac00c970 tx=0x7f98ac00ce30 comp rx=0 tx=0).stop 2024-09-19T08:50:50.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.204+0000 7f98c991b640 1 -- 172.21.15.19:0/1072418475 shutdown_connections 2024-09-19T08:50:50.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.204+0000 7f98c991b640 1 --2- 172.21.15.19:0/1072418475 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f98b00a32d0 0x7f98b00a5790 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:50.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.204+0000 7f98c991b640 1 --2- 172.21.15.19:0/1072418475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98c4106a90 0x7f98c419ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:50.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.204+0000 7f98c991b640 1 --2- 172.21.15.19:0/1072418475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f98c4101430 0x7f98c4198930 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:50.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.204+0000 7f98c991b640 1 --2- 172.21.15.19:0/1072418475 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98c4100a90 0x7f98c41983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:50.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.204+0000 7f98c991b640 1 -- 172.21.15.19:0/1072418475 >> 172.21.15.19:0/1072418475 conn(0x7f98c40fc7d0 msgr2=0x7f98c40fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:50.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.204+0000 7f98c991b640 1 -- 172.21.15.19:0/1072418475 shutdown_connections 2024-09-19T08:50:50.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:50.204+0000 7f98c991b640 1 -- 172.21.15.19:0/1072418475 wait complete. 2024-09-19T08:50:50.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:50 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1072418475' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:50:50.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:50 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1072418475' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:50:50.842 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-19T08:50:50.843 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-19T08:50:50.843 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-19T08:50:50.844 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-19T08:50:50.844 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-19T08:50:50.845 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-19T08:50:50.850 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-19T08:50:50.850 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-19T08:50:50.851 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-19T08:50:50.851 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-19T08:50:50.852 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-19T08:50:50.852 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-19T08:50:50.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:50 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1072418475' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:50:51.542 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:51.569 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:51.711 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:51 smithi019 ceph-mon[30976]: pgmap v294: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 3.7 KiB/s wr, 12 op/s 2024-09-19T08:50:51.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:51 smithi203 ceph-mon[35450]: pgmap v294: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 3.7 KiB/s wr, 12 op/s 2024-09-19T08:50:51.880 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:51.887 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:51.887 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:51.889 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:51.890 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:51.894 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:51.895 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:51.903 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:51.903 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:51.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:51 smithi155 ceph-mon[34921]: pgmap v294: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 3.7 KiB/s wr, 12 op/s 2024-09-19T08:50:52.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.126+0000 7f95c7b5f640 1 -- 172.21.15.19:0/277433166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95c0101de0 msgr2=0x7f95c01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:52.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.126+0000 7f95c7b5f640 1 --2- 172.21.15.19:0/277433166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95c0101de0 0x7f95c01021c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f95bc009900 tx=0x7f95bc02a410 comp rx=0 tx=0).stop 2024-09-19T08:50:52.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.127+0000 7f95c7b5f640 1 -- 172.21.15.19:0/277433166 shutdown_connections 2024-09-19T08:50:52.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.127+0000 7f95c7b5f640 1 --2- 172.21.15.19:0/277433166 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95c0106f10 0x7f95c010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:52.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.127+0000 7f95c7b5f640 1 --2- 172.21.15.19:0/277433166 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c0102790 0x7f95c01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:52.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.127+0000 7f95c7b5f640 1 --2- 172.21.15.19:0/277433166 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95c0101de0 0x7f95c01021c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:52.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.127+0000 7f95c7b5f640 1 -- 172.21.15.19:0/277433166 >> 172.21.15.19:0/277433166 conn(0x7f95c00fd8c0 msgr2=0x7f95c00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:52.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.127+0000 7f95c7b5f640 1 -- 172.21.15.19:0/277433166 shutdown_connections 2024-09-19T08:50:52.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.127+0000 7f95c7b5f640 1 -- 172.21.15.19:0/277433166 wait complete. 2024-09-19T08:50:52.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.127+0000 7f95c7b5f640 1 Processor -- start 2024-09-19T08:50:52.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.127+0000 7f95c7b5f640 1 -- start start 2024-09-19T08:50:52.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.128+0000 7f95c7b5f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c0101de0 0x7f95c01984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:52.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.128+0000 7f95c7b5f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95c0102790 0x7f95c01989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:52.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.128+0000 7f95c7b5f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95c0106f10 0x7f95c019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:52.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.128+0000 7f95c7b5f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f95c0111f90 con 0x7f95c0106f10 2024-09-19T08:50:52.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.128+0000 7f95c7b5f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f95c0111e10 con 0x7f95c0101de0 2024-09-19T08:50:52.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.128+0000 7f95c7b5f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f95c0112110 con 0x7f95c0102790 2024-09-19T08:50:52.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.128+0000 7f95c60fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95c0106f10 0x7f95c019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:52.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.128+0000 7f95c60fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95c0106f10 0x7f95c019cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35644/0 (socket says 172.21.15.19:35644) 2024-09-19T08:50:52.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.128+0000 7f95c60fc640 1 -- 172.21.15.19:0/2337878221 learned_addr learned my addr 172.21.15.19:0/2337878221 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:50:52.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.128+0000 7f95c58fb640 1 --2- 172.21.15.19:0/2337878221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c0101de0 0x7f95c01984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:52.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.128+0000 7f95c50fa640 1 --2- 172.21.15.19:0/2337878221 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95c0102790 0x7f95c01989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:52.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.128+0000 7f95c60fc640 1 -- 172.21.15.19:0/2337878221 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95c0102790 msgr2=0x7f95c01989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:52.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.128+0000 7f95c60fc640 1 --2- 172.21.15.19:0/2337878221 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95c0102790 0x7f95c01989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:52.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.128+0000 7f95c60fc640 1 -- 172.21.15.19:0/2337878221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c0101de0 msgr2=0x7f95c01984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:52.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.128+0000 7f95c60fc640 1 --2- 172.21.15.19:0/2337878221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f95c0101de0 0x7f95c01984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:52.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.128+0000 7f95c60fc640 1 -- 172.21.15.19:0/2337878221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95c019d460 con 0x7f95c0106f10 2024-09-19T08:50:52.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.128+0000 7f95c60fc640 1 --2- 172.21.15.19:0/2337878221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95c0106f10 0x7f95c019cd80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f95b800b970 tx=0x7f95b800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:52.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.128+0000 7f95b2ffd640 1 -- 172.21.15.19:0/2337878221 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b8019070 con 0x7f95c0106f10 2024-09-19T08:50:52.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.129+0000 7f95b2ffd640 1 -- 172.21.15.19:0/2337878221 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f95b800cb40 con 0x7f95c0106f10 2024-09-19T08:50:52.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.129+0000 7f95c7b5f640 1 -- 172.21.15.19:0/2337878221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95c019d750 con 0x7f95c0106f10 2024-09-19T08:50:52.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.129+0000 7f95b2ffd640 1 -- 172.21.15.19:0/2337878221 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b8007650 con 0x7f95c0106f10 2024-09-19T08:50:52.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.129+0000 7f95c7b5f640 1 -- 172.21.15.19:0/2337878221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95c01a5030 con 0x7f95c0106f10 2024-09-19T08:50:52.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.129+0000 7f95c7b5f640 1 -- 172.21.15.19:0/2337878221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f95c0062980 con 0x7f95c0106f10 2024-09-19T08:50:52.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.131+0000 7f95b2ffd640 1 -- 172.21.15.19:0/2337878221 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f95b801c070 con 0x7f95c0106f10 2024-09-19T08:50:52.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.131+0000 7f95b2ffd640 1 --2- 172.21.15.19:0/2337878221 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f95ac0a32d0 0x7f95ac0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:52.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.131+0000 7f95c58fb640 1 --2- 172.21.15.19:0/2337878221 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f95ac0a32d0 0x7f95ac0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:52.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.131+0000 7f95b2ffd640 1 -- 172.21.15.19:0/2337878221 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f95b80cf5d0 con 0x7f95c0106f10 2024-09-19T08:50:52.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.132+0000 7f95b2ffd640 1 --2- 172.21.15.19:0/2337878221 >> [v2:172.21.15.203:6824/522943955,v1:172.21.15.203:6825/522943955] conn(0x7f95ac0acb20 0x7f95ac0aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:52.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.132+0000 7f95b2ffd640 1 -- 172.21.15.19:0/2337878221 --> [v2:172.21.15.203:6824/522943955,v1:172.21.15.203:6825/522943955] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f95b80047d0 con 0x7f95ac0acb20 2024-09-19T08:50:52.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.132+0000 7f95b2ffd640 1 -- 172.21.15.19:0/2337878221 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f95b80cfab0 con 0x7f95c0106f10 2024-09-19T08:50:52.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.132+0000 7f95c58fb640 1 --2- 172.21.15.19:0/2337878221 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f95ac0a32d0 0x7f95ac0a5790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f95bc009230 tx=0x7f95bc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:52.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.132+0000 7f95c50fa640 1 --2- 172.21.15.19:0/2337878221 >> [v2:172.21.15.203:6824/522943955,v1:172.21.15.203:6825/522943955] conn(0x7f95ac0acb20 0x7f95ac0aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:52.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.132+0000 7f95c50fa640 1 --2- 172.21.15.19:0/2337878221 >> [v2:172.21.15.203:6824/522943955,v1:172.21.15.203:6825/522943955] conn(0x7f95ac0acb20 0x7f95ac0aef40 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:52.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.133+0000 7f95b2ffd640 1 -- 172.21.15.19:0/2337878221 <== osd.11 v2:172.21.15.203:6824/522943955 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f95b80047d0 con 0x7f95ac0acb20 2024-09-19T08:50:52.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.147+0000 7f95c7b5f640 1 -- 172.21.15.19:0/2337878221 --> [v2:172.21.15.203:6824/522943955,v1:172.21.15.203:6825/522943955] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f95c0062e00 con 0x7f95ac0acb20 2024-09-19T08:50:52.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.147+0000 7f95b2ffd640 1 -- 172.21.15.19:0/2337878221 <== osd.11 v2:172.21.15.203:6824/522943955 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f95c0062e00 con 0x7f95ac0acb20 2024-09-19T08:50:52.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.147+0000 7f95c7b5f640 1 -- 172.21.15.19:0/2337878221 >> [v2:172.21.15.203:6824/522943955,v1:172.21.15.203:6825/522943955] conn(0x7f95ac0acb20 msgr2=0x7f95ac0aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:52.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.147+0000 7f95c7b5f640 1 --2- 172.21.15.19:0/2337878221 >> [v2:172.21.15.203:6824/522943955,v1:172.21.15.203:6825/522943955] conn(0x7f95ac0acb20 0x7f95ac0aef40 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:52.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.147+0000 7f95c7b5f640 1 -- 172.21.15.19:0/2337878221 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f95ac0a32d0 msgr2=0x7f95ac0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:52.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.147+0000 7f95c7b5f640 1 --2- 172.21.15.19:0/2337878221 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f95ac0a32d0 0x7f95ac0a5790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f95bc009230 tx=0x7f95bc0058d0 comp rx=0 tx=0).stop 2024-09-19T08:50:52.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.147+0000 7f95c7b5f640 1 -- 172.21.15.19:0/2337878221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95c0106f10 msgr2=0x7f95c019cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:52.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.147+0000 7f95c7b5f640 1 --2- 172.21.15.19:0/2337878221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95c0106f10 0x7f95c019cd80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f95b800b970 tx=0x7f95b800be30 comp rx=0 tx=0).stop 2024-09-19T08:50:52.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.147+0000 7f95c60fc640 1 -- 172.21.15.19:0/2337878221 reap_dead start 2024-09-19T08:50:52.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.148+0000 7f95c7b5f640 1 -- 172.21.15.19:0/2337878221 shutdown_connections 2024-09-19T08:50:52.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.148+0000 7f95c7b5f640 1 -- 172.21.15.19:0/2337878221 >> 172.21.15.19:0/2337878221 conn(0x7f95c00fd8c0 msgr2=0x7f95c00fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:52.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.148+0000 7f95c7b5f640 1 -- 172.21.15.19:0/2337878221 shutdown_connections 2024-09-19T08:50:52.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:52.148+0000 7f95c7b5f640 1 -- 172.21.15.19:0/2337878221 wait complete. 2024-09-19T08:50:52.159 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:50:53.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.251+0000 7f93a8f9d640 1 -- 172.21.15.19:0/2330658949 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93a4102570 msgr2=0x7f93a41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:53.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.251+0000 7f93a8f9d640 1 --2- 172.21.15.19:0/2330658949 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93a4102570 0x7f93a41029b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f938c009900 tx=0x7f938c02a480 comp rx=0 tx=0).stop 2024-09-19T08:50:53.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.251+0000 7f93a8f9d640 1 -- 172.21.15.19:0/2330658949 shutdown_connections 2024-09-19T08:50:53.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.251+0000 7f93a8f9d640 1 --2- 172.21.15.19:0/2330658949 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93a4102ef0 0x7f93a410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:53.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.251+0000 7f93a8f9d640 1 --2- 172.21.15.19:0/2330658949 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93a4102570 0x7f93a41029b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:53.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.251+0000 7f93a8f9d640 1 --2- 172.21.15.19:0/2330658949 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f93a4100e20 0x7f93a4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:53.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.251+0000 7f93a8f9d640 1 -- 172.21.15.19:0/2330658949 >> 172.21.15.19:0/2330658949 conn(0x7f93a40fc7d0 msgr2=0x7f93a40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:53.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.251+0000 7f93a8f9d640 1 -- 172.21.15.19:0/2330658949 shutdown_connections 2024-09-19T08:50:53.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.251+0000 7f93a8f9d640 1 -- 172.21.15.19:0/2330658949 wait complete. 2024-09-19T08:50:53.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.252+0000 7f93a8f9d640 1 Processor -- start 2024-09-19T08:50:53.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.252+0000 7f93a8f9d640 1 -- start start 2024-09-19T08:50:53.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.252+0000 7f93a8f9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f93a4100e20 0x7f93a41a4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:53.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.252+0000 7f93a8f9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93a4102570 0x7f93a41a4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:53.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.252+0000 7f93a8f9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93a4102ef0 0x7f93a419ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:53.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.253+0000 7f93a8f9d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f93a4110f80 con 0x7f93a4102570 2024-09-19T08:50:53.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.253+0000 7f93a8f9d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f93a4110e00 con 0x7f93a4102ef0 2024-09-19T08:50:53.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.253+0000 7f93a8f9d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f93a4111100 con 0x7f93a4100e20 2024-09-19T08:50:53.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.253+0000 7f9399d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93a4102570 0x7f93a41a4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:53.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.253+0000 7f9399d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93a4102570 0x7f93a41a4d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35662/0 (socket says 172.21.15.19:35662) 2024-09-19T08:50:53.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.253+0000 7f9399d9b640 1 -- 172.21.15.19:0/603458855 learned_addr learned my addr 172.21.15.19:0/603458855 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:50:53.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.253+0000 7f93a259c640 1 --2- 172.21.15.19:0/603458855 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f93a4100e20 0x7f93a41a4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:53.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.253+0000 7f93a2d9d640 1 --2- 172.21.15.19:0/603458855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93a4102ef0 0x7f93a419ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:53.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.253+0000 7f93a259c640 1 -- 172.21.15.19:0/603458855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93a4102ef0 msgr2=0x7f93a419ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:53.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.253+0000 7f93a259c640 1 --2- 172.21.15.19:0/603458855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93a4102ef0 0x7f93a419ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:53.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.253+0000 7f93a259c640 1 -- 172.21.15.19:0/603458855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93a4102570 msgr2=0x7f93a41a4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:53.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.253+0000 7f93a259c640 1 --2- 172.21.15.19:0/603458855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93a4102570 0x7f93a41a4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:53.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.253+0000 7f93a259c640 1 -- 172.21.15.19:0/603458855 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93a419f4c0 con 0x7f93a4100e20 2024-09-19T08:50:53.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.253+0000 7f93a259c640 1 --2- 172.21.15.19:0/603458855 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f93a4100e20 0x7f93a41a4850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f939400d720 tx=0x7f939400dbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:53.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.254+0000 7f939bfff640 1 -- 172.21.15.19:0/603458855 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9394017070 con 0x7f93a4100e20 2024-09-19T08:50:53.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.254+0000 7f93a8f9d640 1 -- 172.21.15.19:0/603458855 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93a419f7b0 con 0x7f93a4100e20 2024-09-19T08:50:53.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.254+0000 7f939bfff640 1 -- 172.21.15.19:0/603458855 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f939400de30 con 0x7f93a4100e20 2024-09-19T08:50:53.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.254+0000 7f939bfff640 1 -- 172.21.15.19:0/603458855 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93940047a0 con 0x7f93a4100e20 2024-09-19T08:50:53.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.254+0000 7f93a8f9d640 1 -- 172.21.15.19:0/603458855 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93a41ab780 con 0x7f93a4100e20 2024-09-19T08:50:53.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.254+0000 7f93a8f9d640 1 -- 172.21.15.19:0/603458855 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f93a406a9b0 con 0x7f93a4100e20 2024-09-19T08:50:53.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.256+0000 7f939bfff640 1 -- 172.21.15.19:0/603458855 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f93940099d0 con 0x7f93a4100e20 2024-09-19T08:50:53.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.257+0000 7f939bfff640 1 --2- 172.21.15.19:0/603458855 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f93900a32d0 0x7f93900a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:53.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.257+0000 7f9399d9b640 1 --2- 172.21.15.19:0/603458855 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f93900a32d0 0x7f93900a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:53.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.257+0000 7f939bfff640 1 -- 172.21.15.19:0/603458855 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f93940cfaf0 con 0x7f93a4100e20 2024-09-19T08:50:53.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.257+0000 7f939bfff640 1 --2- 172.21.15.19:0/603458855 >> [v2:172.21.15.203:6808/334881465,v1:172.21.15.203:6809/334881465] conn(0x7f93900acb20 0x7f93900aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:53.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.257+0000 7f939bfff640 1 -- 172.21.15.19:0/603458855 --> [v2:172.21.15.203:6808/334881465,v1:172.21.15.203:6809/334881465] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9394015e80 con 0x7f93900acb20 2024-09-19T08:50:53.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.257+0000 7f939bfff640 1 -- 172.21.15.19:0/603458855 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f93940cffd0 con 0x7f93a4100e20 2024-09-19T08:50:53.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.257+0000 7f93a2d9d640 1 --2- 172.21.15.19:0/603458855 >> [v2:172.21.15.203:6808/334881465,v1:172.21.15.203:6809/334881465] conn(0x7f93900acb20 0x7f93900aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:53.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.257+0000 7f9399d9b640 1 --2- 172.21.15.19:0/603458855 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f93900a32d0 0x7f93900a5790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f93a41a0060 tx=0x7f938c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:53.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.258+0000 7f93a2d9d640 1 --2- 172.21.15.19:0/603458855 >> [v2:172.21.15.203:6808/334881465,v1:172.21.15.203:6809/334881465] conn(0x7f93900acb20 0x7f93900aef40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:53.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.259+0000 7f939bfff640 1 -- 172.21.15.19:0/603458855 <== osd.5 v2:172.21.15.203:6808/334881465 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9394015e80 con 0x7f93900acb20 2024-09-19T08:50:53.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.273+0000 7f93a8f9d640 1 -- 172.21.15.19:0/603458855 --> [v2:172.21.15.203:6808/334881465,v1:172.21.15.203:6809/334881465] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f93a41021b0 con 0x7f93900acb20 2024-09-19T08:50:53.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.273+0000 7f939bfff640 1 -- 172.21.15.19:0/603458855 <== osd.5 v2:172.21.15.203:6808/334881465 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f93a41021b0 con 0x7f93900acb20 2024-09-19T08:50:53.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.274+0000 7f93a8f9d640 1 -- 172.21.15.19:0/603458855 >> [v2:172.21.15.203:6808/334881465,v1:172.21.15.203:6809/334881465] conn(0x7f93900acb20 msgr2=0x7f93900aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:53.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.274+0000 7f93a8f9d640 1 --2- 172.21.15.19:0/603458855 >> [v2:172.21.15.203:6808/334881465,v1:172.21.15.203:6809/334881465] conn(0x7f93900acb20 0x7f93900aef40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:53.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.274+0000 7f93a8f9d640 1 -- 172.21.15.19:0/603458855 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f93900a32d0 msgr2=0x7f93900a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:53.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.274+0000 7f93a8f9d640 1 --2- 172.21.15.19:0/603458855 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f93900a32d0 0x7f93900a5790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f93a41a0060 tx=0x7f938c005a20 comp rx=0 tx=0).stop 2024-09-19T08:50:53.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.274+0000 7f93a8f9d640 1 -- 172.21.15.19:0/603458855 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f93a4100e20 msgr2=0x7f93a41a4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:53.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.274+0000 7f93a8f9d640 1 --2- 172.21.15.19:0/603458855 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f93a4100e20 0x7f93a41a4850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f939400d720 tx=0x7f939400dbe0 comp rx=0 tx=0).stop 2024-09-19T08:50:53.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.274+0000 7f93a2d9d640 1 -- 172.21.15.19:0/603458855 reap_dead start 2024-09-19T08:50:53.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.274+0000 7f93a8f9d640 1 -- 172.21.15.19:0/603458855 shutdown_connections 2024-09-19T08:50:53.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.274+0000 7f93a8f9d640 1 -- 172.21.15.19:0/603458855 >> 172.21.15.19:0/603458855 conn(0x7f93a40fc7d0 msgr2=0x7f93a4069fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:53.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.274+0000 7f93a8f9d640 1 -- 172.21.15.19:0/603458855 shutdown_connections 2024-09-19T08:50:53.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.274+0000 7f93a8f9d640 1 -- 172.21.15.19:0/603458855 wait complete. 2024-09-19T08:50:53.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.455+0000 7f25414dd640 1 -- 172.21.15.19:0/4239648200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f253c100a80 msgr2=0x7f253c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:53.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.455+0000 7f25414dd640 1 --2- 172.21.15.19:0/4239648200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f253c100a80 0x7f253c100ee0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2524009930 tx=0x7f252402a420 comp rx=0 tx=0).stop 2024-09-19T08:50:53.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.455+0000 7f25414dd640 1 -- 172.21.15.19:0/4239648200 shutdown_connections 2024-09-19T08:50:53.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.455+0000 7f25414dd640 1 --2- 172.21.15.19:0/4239648200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f253c101420 0x7f253c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:53.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.455+0000 7f25414dd640 1 --2- 172.21.15.19:0/4239648200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f253c100a80 0x7f253c100ee0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:53.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.455+0000 7f25414dd640 1 --2- 172.21.15.19:0/4239648200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f253c106a80 0x7f253c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:53.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.455+0000 7f25414dd640 1 -- 172.21.15.19:0/4239648200 >> 172.21.15.19:0/4239648200 conn(0x7f253c0fc7a0 msgr2=0x7f253c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:53.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.455+0000 7f25414dd640 1 -- 172.21.15.19:0/4239648200 shutdown_connections 2024-09-19T08:50:53.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.455+0000 7f25414dd640 1 -- 172.21.15.19:0/4239648200 wait complete. 2024-09-19T08:50:53.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.455+0000 7f25414dd640 1 Processor -- start 2024-09-19T08:50:53.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.456+0000 7f25414dd640 1 -- start start 2024-09-19T08:50:53.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.456+0000 7f25414dd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f253c100a80 0x7f253c199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:53.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.456+0000 7f25414dd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f253c101420 0x7f253c199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:53.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.456+0000 7f25414dd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f253c106a80 0x7f253c1a4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:53.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.456+0000 7f25414dd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f253c110ed0 con 0x7f253c106a80 2024-09-19T08:50:53.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.456+0000 7f25414dd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f253c110d50 con 0x7f253c101420 2024-09-19T08:50:53.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.456+0000 7f25414dd640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f253c111050 con 0x7f253c100a80 2024-09-19T08:50:53.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.456+0000 7f253b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f253c106a80 0x7f253c1a4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:53.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.456+0000 7f253b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f253c106a80 0x7f253c1a4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35680/0 (socket says 172.21.15.19:35680) 2024-09-19T08:50:53.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.456+0000 7f253b7fe640 1 -- 172.21.15.19:0/3909521564 learned_addr learned my addr 172.21.15.19:0/3909521564 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:50:53.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.456+0000 7f253affd640 1 --2- 172.21.15.19:0/3909521564 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f253c100a80 0x7f253c199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:53.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.456+0000 7f253a7fc640 1 --2- 172.21.15.19:0/3909521564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f253c101420 0x7f253c199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:53.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.456+0000 7f253b7fe640 1 -- 172.21.15.19:0/3909521564 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f253c100a80 msgr2=0x7f253c199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:53.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.456+0000 7f253b7fe640 1 --2- 172.21.15.19:0/3909521564 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f253c100a80 0x7f253c199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:53.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.456+0000 7f253b7fe640 1 -- 172.21.15.19:0/3909521564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f253c101420 msgr2=0x7f253c199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:53.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.456+0000 7f253b7fe640 1 --2- 172.21.15.19:0/3909521564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f253c101420 0x7f253c199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:53.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.456+0000 7f253b7fe640 1 -- 172.21.15.19:0/3909521564 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f253c1a48c0 con 0x7f253c106a80 2024-09-19T08:50:53.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.457+0000 7f253b7fe640 1 --2- 172.21.15.19:0/3909521564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f253c106a80 0x7f253c1a4380 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f252c00d750 tx=0x7f252c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:53.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.457+0000 7f2533fff640 1 -- 172.21.15.19:0/3909521564 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252c017070 con 0x7f253c106a80 2024-09-19T08:50:53.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.457+0000 7f25414dd640 1 -- 172.21.15.19:0/3909521564 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f253c1a4a90 con 0x7f253c106a80 2024-09-19T08:50:53.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.457+0000 7f2533fff640 1 -- 172.21.15.19:0/3909521564 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f252c005500 con 0x7f253c106a80 2024-09-19T08:50:53.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.457+0000 7f2533fff640 1 -- 172.21.15.19:0/3909521564 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252c004d90 con 0x7f253c106a80 2024-09-19T08:50:53.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.457+0000 7f25414dd640 1 -- 172.21.15.19:0/3909521564 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f253c1a4f50 con 0x7f253c106a80 2024-09-19T08:50:53.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.458+0000 7f25414dd640 1 -- 172.21.15.19:0/3909521564 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f253c062900 con 0x7f253c106a80 2024-09-19T08:50:53.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.459+0000 7f2533fff640 1 -- 172.21.15.19:0/3909521564 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f252c004f30 con 0x7f253c106a80 2024-09-19T08:50:53.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.460+0000 7f2533fff640 1 --2- 172.21.15.19:0/3909521564 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f25280a32d0 0x7f25280a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:53.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.460+0000 7f253affd640 1 --2- 172.21.15.19:0/3909521564 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f25280a32d0 0x7f25280a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:53.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.460+0000 7f2533fff640 1 -- 172.21.15.19:0/3909521564 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f252c0cf600 con 0x7f253c106a80 2024-09-19T08:50:53.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.460+0000 7f2533fff640 1 --2- 172.21.15.19:0/3909521564 >> [v2:172.21.15.155:6816/3169455907,v1:172.21.15.155:6817/3169455907] conn(0x7f25280acb20 0x7f25280aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:53.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.460+0000 7f2533fff640 1 -- 172.21.15.19:0/3909521564 --> [v2:172.21.15.155:6816/3169455907,v1:172.21.15.155:6817/3169455907] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f25280af5f0 con 0x7f25280acb20 2024-09-19T08:50:53.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.460+0000 7f2533fff640 1 -- 172.21.15.19:0/3909521564 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f252c0cfae0 con 0x7f253c106a80 2024-09-19T08:50:53.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.460+0000 7f253affd640 1 --2- 172.21.15.19:0/3909521564 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f25280a32d0 0x7f25280a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2534005fd0 tx=0x7f2534009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:53.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.460+0000 7f253a7fc640 1 --2- 172.21.15.19:0/3909521564 >> [v2:172.21.15.155:6816/3169455907,v1:172.21.15.155:6817/3169455907] conn(0x7f25280acb20 0x7f25280aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:53.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.461+0000 7f253a7fc640 1 --2- 172.21.15.19:0/3909521564 >> [v2:172.21.15.155:6816/3169455907,v1:172.21.15.155:6817/3169455907] conn(0x7f25280acb20 0x7f25280aef40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:53.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.462+0000 7f2533fff640 1 -- 172.21.15.19:0/3909521564 <== osd.7 v2:172.21.15.155:6816/3169455907 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f25280af5f0 con 0x7f25280acb20 2024-09-19T08:50:53.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.475+0000 7f25414dd640 1 -- 172.21.15.19:0/3909521564 --> [v2:172.21.15.155:6816/3169455907,v1:172.21.15.155:6817/3169455907] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f253c062d80 con 0x7f25280acb20 2024-09-19T08:50:53.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.476+0000 7f2533fff640 1 -- 172.21.15.19:0/3909521564 <== osd.7 v2:172.21.15.155:6816/3169455907 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f253c062d80 con 0x7f25280acb20 2024-09-19T08:50:53.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.476+0000 7f25414dd640 1 -- 172.21.15.19:0/3909521564 >> [v2:172.21.15.155:6816/3169455907,v1:172.21.15.155:6817/3169455907] conn(0x7f25280acb20 msgr2=0x7f25280aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:53.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.476+0000 7f25414dd640 1 --2- 172.21.15.19:0/3909521564 >> [v2:172.21.15.155:6816/3169455907,v1:172.21.15.155:6817/3169455907] conn(0x7f25280acb20 0x7f25280aef40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:53.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.476+0000 7f25414dd640 1 -- 172.21.15.19:0/3909521564 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f25280a32d0 msgr2=0x7f25280a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:53.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.476+0000 7f25414dd640 1 --2- 172.21.15.19:0/3909521564 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f25280a32d0 0x7f25280a5790 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2534005fd0 tx=0x7f2534009680 comp rx=0 tx=0).stop 2024-09-19T08:50:53.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.476+0000 7f25414dd640 1 -- 172.21.15.19:0/3909521564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f253c106a80 msgr2=0x7f253c1a4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:53.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.476+0000 7f25414dd640 1 --2- 172.21.15.19:0/3909521564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f253c106a80 0x7f253c1a4380 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f252c00d750 tx=0x7f252c00dc10 comp rx=0 tx=0).stop 2024-09-19T08:50:53.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.476+0000 7f253b7fe640 1 -- 172.21.15.19:0/3909521564 reap_dead start 2024-09-19T08:50:53.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.476+0000 7f25414dd640 1 -- 172.21.15.19:0/3909521564 shutdown_connections 2024-09-19T08:50:53.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.476+0000 7f25414dd640 1 -- 172.21.15.19:0/3909521564 >> 172.21.15.19:0/3909521564 conn(0x7f253c0fc7a0 msgr2=0x7f253c0fcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:53.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.477+0000 7f25414dd640 1 -- 172.21.15.19:0/3909521564 shutdown_connections 2024-09-19T08:50:53.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:53.477+0000 7f25414dd640 1 -- 172.21.15.19:0/3909521564 wait complete. 2024-09-19T08:50:53.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:53 smithi019 ceph-mon[30976]: pgmap v295: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-19T08:50:53.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:53 smithi203 ceph-mon[35450]: pgmap v295: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-19T08:50:53.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:53 smithi155 ceph-mon[34921]: pgmap v295: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-09-19T08:50:54.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.109+0000 7f10a8304640 1 -- 172.21.15.19:0/4118985136 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10a0102da0 msgr2=0x7f10a0103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:54.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.109+0000 7f10a8304640 1 --2- 172.21.15.19:0/4118985136 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10a0102da0 0x7f10a0103180 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f109c009900 tx=0x7f109c02a480 comp rx=0 tx=0).stop 2024-09-19T08:50:54.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.109+0000 7f10a8304640 1 -- 172.21.15.19:0/4118985136 shutdown_connections 2024-09-19T08:50:54.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.109+0000 7f10a8304640 1 --2- 172.21.15.19:0/4118985136 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f10a01036c0 0x7f10a010bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:54.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.109+0000 7f10a8304640 1 --2- 172.21.15.19:0/4118985136 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10a010c180 0x7f10a010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:54.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.109+0000 7f10a8304640 1 --2- 172.21.15.19:0/4118985136 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10a0102da0 0x7f10a0103180 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:54.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.109+0000 7f10a8304640 1 -- 172.21.15.19:0/4118985136 >> 172.21.15.19:0/4118985136 conn(0x7f10a00fc7a0 msgr2=0x7f10a00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:54.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.109+0000 7f10a8304640 1 -- 172.21.15.19:0/4118985136 shutdown_connections 2024-09-19T08:50:54.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.109+0000 7f10a8304640 1 -- 172.21.15.19:0/4118985136 wait complete. 2024-09-19T08:50:54.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.110+0000 7f10a8304640 1 Processor -- start 2024-09-19T08:50:54.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.110+0000 7f10a8304640 1 -- start start 2024-09-19T08:50:54.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.110+0000 7f10a8304640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10a0102da0 0x7f10a0198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:54.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.110+0000 7f10a8304640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f10a01036c0 0x7f10a01989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:54.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.110+0000 7f10a8304640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10a010c180 0x7f10a019cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:54.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.110+0000 7f10a8304640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f10a0111f60 con 0x7f10a0102da0 2024-09-19T08:50:54.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.110+0000 7f10a8304640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f10a0111de0 con 0x7f10a010c180 2024-09-19T08:50:54.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.110+0000 7f10a8304640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f10a01120e0 con 0x7f10a01036c0 2024-09-19T08:50:54.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.110+0000 7f10a60a0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10a0102da0 0x7f10a0198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:54.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.110+0000 7f10a60a0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10a0102da0 0x7f10a0198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35686/0 (socket says 172.21.15.19:35686) 2024-09-19T08:50:54.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.110+0000 7f10a60a0640 1 -- 172.21.15.19:0/1153234784 learned_addr learned my addr 172.21.15.19:0/1153234784 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:50:54.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.110+0000 7f10a68a1640 1 --2- 172.21.15.19:0/1153234784 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10a010c180 0x7f10a019cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:54.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.110+0000 7f10a60a0640 1 -- 172.21.15.19:0/1153234784 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f10a01036c0 msgr2=0x7f10a01989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:54.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.110+0000 7f10a589f640 1 --2- 172.21.15.19:0/1153234784 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f10a01036c0 0x7f10a01989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:54.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.110+0000 7f10a60a0640 1 --2- 172.21.15.19:0/1153234784 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f10a01036c0 0x7f10a01989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:54.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.110+0000 7f10a60a0640 1 -- 172.21.15.19:0/1153234784 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10a010c180 msgr2=0x7f10a019cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:54.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.110+0000 7f10a60a0640 1 --2- 172.21.15.19:0/1153234784 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10a010c180 0x7f10a019cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:54.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.110+0000 7f10a60a0640 1 -- 172.21.15.19:0/1153234784 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a019d430 con 0x7f10a0102da0 2024-09-19T08:50:54.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.110+0000 7f10a589f640 1 --2- 172.21.15.19:0/1153234784 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f10a01036c0 0x7f10a01989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:50:54.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.110+0000 7f10a68a1640 1 --2- 172.21.15.19:0/1153234784 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10a010c180 0x7f10a019cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:50:54.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.111+0000 7f10a60a0640 1 --2- 172.21.15.19:0/1153234784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10a0102da0 0x7f10a0198480 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f109c006010 tx=0x7f109c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.111+0000 7f10977fe640 1 -- 172.21.15.19:0/1153234784 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109c03f030 con 0x7f10a0102da0 2024-09-19T08:50:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.111+0000 7f10977fe640 1 -- 172.21.15.19:0/1153234784 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f109c003ce0 con 0x7f10a0102da0 2024-09-19T08:50:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.111+0000 7f10a8304640 1 -- 172.21.15.19:0/1153234784 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10a019d6c0 con 0x7f10a0102da0 2024-09-19T08:50:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.111+0000 7f10977fe640 1 -- 172.21.15.19:0/1153234784 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109c035070 con 0x7f10a0102da0 2024-09-19T08:50:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.111+0000 7f10a8304640 1 -- 172.21.15.19:0/1153234784 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10a01a5000 con 0x7f10a0102da0 2024-09-19T08:50:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.112+0000 7f10a8304640 1 -- 172.21.15.19:0/1153234784 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f10a0062980 con 0x7f10a0102da0 2024-09-19T08:50:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.113+0000 7f10977fe640 1 -- 172.21.15.19:0/1153234784 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f109c042030 con 0x7f10a0102da0 2024-09-19T08:50:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.114+0000 7f10977fe640 1 --2- 172.21.15.19:0/1153234784 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f108c0a3350 0x7f108c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.114+0000 7f10a589f640 1 --2- 172.21.15.19:0/1153234784 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f108c0a3350 0x7f108c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.114+0000 7f10977fe640 1 -- 172.21.15.19:0/1153234784 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f109c0f0540 con 0x7f10a0102da0 2024-09-19T08:50:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.114+0000 7f10977fe640 1 --2- 172.21.15.19:0/1153234784 >> [v2:172.21.15.19:6810/176445576,v1:172.21.15.19:6811/176445576] conn(0x7f108c0acba0 0x7f108c0aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.114+0000 7f10977fe640 1 -- 172.21.15.19:0/1153234784 --> [v2:172.21.15.19:6810/176445576,v1:172.21.15.19:6811/176445576] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f109c001d30 con 0x7f108c0acba0 2024-09-19T08:50:54.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.114+0000 7f10977fe640 1 -- 172.21.15.19:0/1153234784 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f109c0f0a20 con 0x7f10a0102da0 2024-09-19T08:50:54.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.114+0000 7f10a68a1640 1 --2- 172.21.15.19:0/1153234784 >> [v2:172.21.15.19:6810/176445576,v1:172.21.15.19:6811/176445576] conn(0x7f108c0acba0 0x7f108c0aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:54.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.114+0000 7f10a589f640 1 --2- 172.21.15.19:0/1153234784 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f108c0a3350 0x7f108c0a5810 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f10a00feda0 tx=0x7f1090005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:54.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.115+0000 7f10a68a1640 1 --2- 172.21.15.19:0/1153234784 >> [v2:172.21.15.19:6810/176445576,v1:172.21.15.19:6811/176445576] conn(0x7f108c0acba0 0x7f108c0aefc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:54.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.115+0000 7f10977fe640 1 -- 172.21.15.19:0/1153234784 <== osd.3 v2:172.21.15.19:6810/176445576 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f109c001d30 con 0x7f108c0acba0 2024-09-19T08:50:54.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.129+0000 7f10a8304640 1 -- 172.21.15.19:0/1153234784 --> [v2:172.21.15.19:6810/176445576,v1:172.21.15.19:6811/176445576] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f10a0062d80 con 0x7f108c0acba0 2024-09-19T08:50:54.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.129+0000 7f10977fe640 1 -- 172.21.15.19:0/1153234784 <== osd.3 v2:172.21.15.19:6810/176445576 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f10a0062d80 con 0x7f108c0acba0 2024-09-19T08:50:54.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.129+0000 7f10a8304640 1 -- 172.21.15.19:0/1153234784 >> [v2:172.21.15.19:6810/176445576,v1:172.21.15.19:6811/176445576] conn(0x7f108c0acba0 msgr2=0x7f108c0aefc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:54.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.129+0000 7f10a8304640 1 --2- 172.21.15.19:0/1153234784 >> [v2:172.21.15.19:6810/176445576,v1:172.21.15.19:6811/176445576] conn(0x7f108c0acba0 0x7f108c0aefc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:54.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.130+0000 7f10a8304640 1 -- 172.21.15.19:0/1153234784 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f108c0a3350 msgr2=0x7f108c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:54.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.130+0000 7f10a8304640 1 --2- 172.21.15.19:0/1153234784 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f108c0a3350 0x7f108c0a5810 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f10a00feda0 tx=0x7f1090005d30 comp rx=0 tx=0).stop 2024-09-19T08:50:54.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.130+0000 7f10a8304640 1 -- 172.21.15.19:0/1153234784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10a0102da0 msgr2=0x7f10a0198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:54.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.130+0000 7f10a8304640 1 --2- 172.21.15.19:0/1153234784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10a0102da0 0x7f10a0198480 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f109c006010 tx=0x7f109c0042f0 comp rx=0 tx=0).stop 2024-09-19T08:50:54.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.130+0000 7f10a68a1640 1 -- 172.21.15.19:0/1153234784 reap_dead start 2024-09-19T08:50:54.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.130+0000 7f10a8304640 1 -- 172.21.15.19:0/1153234784 shutdown_connections 2024-09-19T08:50:54.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.130+0000 7f10a8304640 1 -- 172.21.15.19:0/1153234784 >> 172.21.15.19:0/1153234784 conn(0x7f10a00fc7a0 msgr2=0x7f10a00fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:54.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.130+0000 7f10a8304640 1 -- 172.21.15.19:0/1153234784 shutdown_connections 2024-09-19T08:50:54.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.130+0000 7f10a8304640 1 -- 172.21.15.19:0/1153234784 wait complete. 2024-09-19T08:50:54.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.845+0000 7f74a0322640 1 -- 172.21.15.19:0/3534451041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7498106f10 msgr2=0x7f749810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:54.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.845+0000 7f74a0322640 1 --2- 172.21.15.19:0/3534451041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7498106f10 0x7f749810ea90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7490009ca0 tx=0x7f749002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:50:54.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.845+0000 7f74a0322640 1 -- 172.21.15.19:0/3534451041 shutdown_connections 2024-09-19T08:50:54.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.845+0000 7f74a0322640 1 --2- 172.21.15.19:0/3534451041 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7498102790 0x7f74981067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:54.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.845+0000 7f74a0322640 1 --2- 172.21.15.19:0/3534451041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7498106f10 0x7f749810ea90 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:54.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.845+0000 7f74a0322640 1 --2- 172.21.15.19:0/3534451041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7498101de0 0x7f74981021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:54.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.845+0000 7f74a0322640 1 -- 172.21.15.19:0/3534451041 >> 172.21.15.19:0/3534451041 conn(0x7f74980fd8c0 msgr2=0x7f74980ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:54.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.845+0000 7f74a0322640 1 -- 172.21.15.19:0/3534451041 shutdown_connections 2024-09-19T08:50:54.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.845+0000 7f74a0322640 1 -- 172.21.15.19:0/3534451041 wait complete. 2024-09-19T08:50:54.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.846+0000 7f74a0322640 1 Processor -- start 2024-09-19T08:50:54.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.846+0000 7f74a0322640 1 -- start start 2024-09-19T08:50:54.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.846+0000 7f74a0322640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7498101de0 0x7f74980744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:54.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.846+0000 7f74a0322640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7498102790 0x7f7498074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:54.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.846+0000 7f74a0322640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7498106f10 0x7f7498074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:54.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.846+0000 7f74a0322640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7498111f70 con 0x7f7498102790 2024-09-19T08:50:54.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.846+0000 7f74a0322640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7498111df0 con 0x7f7498101de0 2024-09-19T08:50:54.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.846+0000 7f74a0322640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f74981120f0 con 0x7f7498106f10 2024-09-19T08:50:54.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.846+0000 7f749d8bd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7498102790 0x7f7498074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:54.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.846+0000 7f749d8bd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7498102790 0x7f7498074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35720/0 (socket says 172.21.15.19:35720) 2024-09-19T08:50:54.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.846+0000 7f749d8bd640 1 -- 172.21.15.19:0/1181355951 learned_addr learned my addr 172.21.15.19:0/1181355951 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:50:54.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.846+0000 7f749e0be640 1 --2- 172.21.15.19:0/1181355951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7498101de0 0x7f74980744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:54.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.846+0000 7f749e8bf640 1 --2- 172.21.15.19:0/1181355951 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7498106f10 0x7f7498074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:54.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.846+0000 7f749d8bd640 1 -- 172.21.15.19:0/1181355951 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7498106f10 msgr2=0x7f7498074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:54.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.846+0000 7f749d8bd640 1 --2- 172.21.15.19:0/1181355951 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7498106f10 0x7f7498074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:54.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.846+0000 7f749d8bd640 1 -- 172.21.15.19:0/1181355951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7498101de0 msgr2=0x7f74980744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:54.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.846+0000 7f749d8bd640 1 --2- 172.21.15.19:0/1181355951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7498101de0 0x7f74980744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:54.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.846+0000 7f749d8bd640 1 -- 172.21.15.19:0/1181355951 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74981a6890 con 0x7f7498102790 2024-09-19T08:50:54.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.846+0000 7f749e8bf640 1 --2- 172.21.15.19:0/1181355951 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7498106f10 0x7f7498074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:50:54.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.847+0000 7f749d8bd640 1 --2- 172.21.15.19:0/1181355951 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7498102790 0x7f7498074a30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f749400d950 tx=0x7f749400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:54.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.847+0000 7f748b7fe640 1 -- 172.21.15.19:0/1181355951 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7494017070 con 0x7f7498102790 2024-09-19T08:50:54.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.847+0000 7f74a0322640 1 -- 172.21.15.19:0/1181355951 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74981a6b80 con 0x7f7498102790 2024-09-19T08:50:54.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.847+0000 7f748b7fe640 1 -- 172.21.15.19:0/1181355951 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7494009c30 con 0x7f7498102790 2024-09-19T08:50:54.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.847+0000 7f748b7fe640 1 -- 172.21.15.19:0/1181355951 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f749400f6b0 con 0x7f7498102790 2024-09-19T08:50:54.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.847+0000 7f74a0322640 1 -- 172.21.15.19:0/1181355951 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74981a7110 con 0x7f7498102790 2024-09-19T08:50:54.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.848+0000 7f74a0322640 1 -- 172.21.15.19:0/1181355951 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f74980628c0 con 0x7f7498102790 2024-09-19T08:50:54.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.849+0000 7f748b7fe640 1 -- 172.21.15.19:0/1181355951 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f74940109d0 con 0x7f7498102790 2024-09-19T08:50:54.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.850+0000 7f748b7fe640 1 --2- 172.21.15.19:0/1181355951 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f74840a32d0 0x7f74840a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:54.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.850+0000 7f748b7fe640 1 -- 172.21.15.19:0/1181355951 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f74940cf860 con 0x7f7498102790 2024-09-19T08:50:54.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.850+0000 7f749e0be640 1 --2- 172.21.15.19:0/1181355951 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f74840a32d0 0x7f74840a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:54.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.850+0000 7f748b7fe640 1 --2- 172.21.15.19:0/1181355951 >> [v2:172.21.15.19:6818/2669779791,v1:172.21.15.19:6819/2669779791] conn(0x7f74840acb20 0x7f74840aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:54.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.850+0000 7f748b7fe640 1 -- 172.21.15.19:0/1181355951 --> [v2:172.21.15.19:6818/2669779791,v1:172.21.15.19:6819/2669779791] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f74840af5f0 con 0x7f74840acb20 2024-09-19T08:50:54.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.850+0000 7f748b7fe640 1 -- 172.21.15.19:0/1181355951 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f74940cfd40 con 0x7f7498102790 2024-09-19T08:50:54.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.850+0000 7f749e8bf640 1 --2- 172.21.15.19:0/1181355951 >> [v2:172.21.15.19:6818/2669779791,v1:172.21.15.19:6819/2669779791] conn(0x7f74840acb20 0x7f74840aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:54.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.850+0000 7f749e0be640 1 --2- 172.21.15.19:0/1181355951 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f74840a32d0 0x7f74840a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f748c0058c0 tx=0x7f748c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:54.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.851+0000 7f749e8bf640 1 --2- 172.21.15.19:0/1181355951 >> [v2:172.21.15.19:6818/2669779791,v1:172.21.15.19:6819/2669779791] conn(0x7f74840acb20 0x7f74840aef40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:54.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.851+0000 7f748b7fe640 1 -- 172.21.15.19:0/1181355951 <== osd.6 v2:172.21.15.19:6818/2669779791 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f74840af5f0 con 0x7f74840acb20 2024-09-19T08:50:54.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.866+0000 7f74a0322640 1 -- 172.21.15.19:0/1181355951 --> [v2:172.21.15.19:6818/2669779791,v1:172.21.15.19:6819/2669779791] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7498062cc0 con 0x7f74840acb20 2024-09-19T08:50:54.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.867+0000 7f748b7fe640 1 -- 172.21.15.19:0/1181355951 <== osd.6 v2:172.21.15.19:6818/2669779791 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7498062cc0 con 0x7f74840acb20 2024-09-19T08:50:54.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.867+0000 7f74a0322640 1 -- 172.21.15.19:0/1181355951 >> [v2:172.21.15.19:6818/2669779791,v1:172.21.15.19:6819/2669779791] conn(0x7f74840acb20 msgr2=0x7f74840aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:54.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.867+0000 7f74a0322640 1 --2- 172.21.15.19:0/1181355951 >> [v2:172.21.15.19:6818/2669779791,v1:172.21.15.19:6819/2669779791] conn(0x7f74840acb20 0x7f74840aef40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:54.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.867+0000 7f74a0322640 1 -- 172.21.15.19:0/1181355951 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f74840a32d0 msgr2=0x7f74840a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:54.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.867+0000 7f74a0322640 1 --2- 172.21.15.19:0/1181355951 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f74840a32d0 0x7f74840a5790 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f748c0058c0 tx=0x7f748c00a2d0 comp rx=0 tx=0).stop 2024-09-19T08:50:54.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.867+0000 7f74a0322640 1 -- 172.21.15.19:0/1181355951 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7498102790 msgr2=0x7f7498074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:54.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.867+0000 7f74a0322640 1 --2- 172.21.15.19:0/1181355951 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7498102790 0x7f7498074a30 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f749400d950 tx=0x7f749400de10 comp rx=0 tx=0).stop 2024-09-19T08:50:54.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.867+0000 7f749e8bf640 1 -- 172.21.15.19:0/1181355951 reap_dead start 2024-09-19T08:50:54.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.867+0000 7f74a0322640 1 -- 172.21.15.19:0/1181355951 shutdown_connections 2024-09-19T08:50:54.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.867+0000 7f74a0322640 1 -- 172.21.15.19:0/1181355951 >> 172.21.15.19:0/1181355951 conn(0x7f74980fd8c0 msgr2=0x7f74980fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:54.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.867+0000 7f74a0322640 1 -- 172.21.15.19:0/1181355951 shutdown_connections 2024-09-19T08:50:54.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.867+0000 7f74a0322640 1 -- 172.21.15.19:0/1181355951 wait complete. 2024-09-19T08:50:55.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.738+0000 7fc104bce640 1 -- 172.21.15.19:0/4111912579 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc100102570 msgr2=0x7fc1001029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:55.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.738+0000 7fc104bce640 1 --2- 172.21.15.19:0/4111912579 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc100102570 0x7fc1001029b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc0f4009900 tx=0x7fc0f402a480 comp rx=0 tx=0).stop 2024-09-19T08:50:55.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.738+0000 7fc104bce640 1 -- 172.21.15.19:0/4111912579 shutdown_connections 2024-09-19T08:50:55.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.738+0000 7fc104bce640 1 --2- 172.21.15.19:0/4111912579 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc100102ef0 0x7fc10010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:55.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.738+0000 7fc104bce640 1 --2- 172.21.15.19:0/4111912579 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc100102570 0x7fc1001029b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:55.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.738+0000 7fc104bce640 1 --2- 172.21.15.19:0/4111912579 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc100100e20 0x7fc100101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:55.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.738+0000 7fc104bce640 1 -- 172.21.15.19:0/4111912579 >> 172.21.15.19:0/4111912579 conn(0x7fc1000fc7d0 msgr2=0x7fc1000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:55.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.738+0000 7fc104bce640 1 -- 172.21.15.19:0/4111912579 shutdown_connections 2024-09-19T08:50:55.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.738+0000 7fc104bce640 1 -- 172.21.15.19:0/4111912579 wait complete. 2024-09-19T08:50:55.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.739+0000 7fc104bce640 1 Processor -- start 2024-09-19T08:50:55.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.739+0000 7fc104bce640 1 -- start start 2024-09-19T08:50:55.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.739+0000 7fc104bce640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc100100e20 0x7fc1001973c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:55.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.739+0000 7fc104bce640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc100102570 0x7fc100197900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:55.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.739+0000 7fc104bce640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc100102ef0 0x7fc10019bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:55.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.739+0000 7fc104bce640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc100110f80 con 0x7fc100102ef0 2024-09-19T08:50:55.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.739+0000 7fc104bce640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc100110e00 con 0x7fc100100e20 2024-09-19T08:50:55.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.739+0000 7fc104bce640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc100111100 con 0x7fc100102570 2024-09-19T08:50:55.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.739+0000 7fc0fed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc100102ef0 0x7fc10019bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:55.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.739+0000 7fc0fed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc100102ef0 0x7fc10019bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35704/0 (socket says 172.21.15.19:35704) 2024-09-19T08:50:55.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.739+0000 7fc0fed9d640 1 -- 172.21.15.19:0/151792162 learned_addr learned my addr 172.21.15.19:0/151792162 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:50:55.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.739+0000 7fc0fe59c640 1 --2- 172.21.15.19:0/151792162 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc100100e20 0x7fc1001973c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:55.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.739+0000 7fc0fdd9b640 1 --2- 172.21.15.19:0/151792162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc100102570 0x7fc100197900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:55.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.739+0000 7fc0fed9d640 1 -- 172.21.15.19:0/151792162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc100102570 msgr2=0x7fc100197900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:55.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.739+0000 7fc0fed9d640 1 --2- 172.21.15.19:0/151792162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc100102570 0x7fc100197900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:55.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.739+0000 7fc0fed9d640 1 -- 172.21.15.19:0/151792162 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc100100e20 msgr2=0x7fc1001973c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:55.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.739+0000 7fc0fed9d640 1 --2- 172.21.15.19:0/151792162 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc100100e20 0x7fc1001973c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:55.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.739+0000 7fc0fed9d640 1 -- 172.21.15.19:0/151792162 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc10019c370 con 0x7fc100102ef0 2024-09-19T08:50:55.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.740+0000 7fc0fed9d640 1 --2- 172.21.15.19:0/151792162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc100102ef0 0x7fc10019bc90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc0f800cce0 tx=0x7fc0f800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:55.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.740+0000 7fc0ef7fe640 1 -- 172.21.15.19:0/151792162 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f800f450 con 0x7fc100102ef0 2024-09-19T08:50:55.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.740+0000 7fc0ef7fe640 1 -- 172.21.15.19:0/151792162 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc0f800fad0 con 0x7fc100102ef0 2024-09-19T08:50:55.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.740+0000 7fc104bce640 1 -- 172.21.15.19:0/151792162 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc10019c660 con 0x7fc100102ef0 2024-09-19T08:50:55.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.740+0000 7fc0ef7fe640 1 -- 172.21.15.19:0/151792162 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0f8018c10 con 0x7fc100102ef0 2024-09-19T08:50:55.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.740+0000 7fc104bce640 1 -- 172.21.15.19:0/151792162 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1001a3f40 con 0x7fc100102ef0 2024-09-19T08:50:55.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.741+0000 7fc104bce640 1 -- 172.21.15.19:0/151792162 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc1001072c0 con 0x7fc100102ef0 2024-09-19T08:50:55.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.742+0000 7fc0ef7fe640 1 -- 172.21.15.19:0/151792162 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc0f800f5f0 con 0x7fc100102ef0 2024-09-19T08:50:55.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.743+0000 7fc0ef7fe640 1 --2- 172.21.15.19:0/151792162 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc0e80a32d0 0x7fc0e80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:55.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.743+0000 7fc0fe59c640 1 --2- 172.21.15.19:0/151792162 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc0e80a32d0 0x7fc0e80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:55.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.743+0000 7fc0ef7fe640 1 -- 172.21.15.19:0/151792162 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fc0f80d0190 con 0x7fc100102ef0 2024-09-19T08:50:55.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.743+0000 7fc0ef7fe640 1 --2- 172.21.15.19:0/151792162 >> [v2:172.21.15.19:6826/574664786,v1:172.21.15.19:6827/574664786] conn(0x7fc0e80acb20 0x7fc0e80aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:55.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.743+0000 7fc0ef7fe640 1 -- 172.21.15.19:0/151792162 --> [v2:172.21.15.19:6826/574664786,v1:172.21.15.19:6827/574664786] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc0f801ee50 con 0x7fc0e80acb20 2024-09-19T08:50:55.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.743+0000 7fc0ef7fe640 1 -- 172.21.15.19:0/151792162 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fc0f80d0670 con 0x7fc100102ef0 2024-09-19T08:50:55.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.743+0000 7fc0fdd9b640 1 --2- 172.21.15.19:0/151792162 >> [v2:172.21.15.19:6826/574664786,v1:172.21.15.19:6827/574664786] conn(0x7fc0e80acb20 0x7fc0e80aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:55.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.743+0000 7fc0fe59c640 1 --2- 172.21.15.19:0/151792162 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc0e80a32d0 0x7fc0e80a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0005d00 tx=0x7fc0f000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:55.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.743+0000 7fc0fdd9b640 1 --2- 172.21.15.19:0/151792162 >> [v2:172.21.15.19:6826/574664786,v1:172.21.15.19:6827/574664786] conn(0x7fc0e80acb20 0x7fc0e80aef40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:55.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.744+0000 7fc0ef7fe640 1 -- 172.21.15.19:0/151792162 <== osd.9 v2:172.21.15.19:6826/574664786 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc0f801ee50 con 0x7fc0e80acb20 2024-09-19T08:50:55.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.758+0000 7fc104bce640 1 -- 172.21.15.19:0/151792162 --> [v2:172.21.15.19:6826/574664786,v1:172.21.15.19:6827/574664786] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc1001021b0 con 0x7fc0e80acb20 2024-09-19T08:50:55.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.759+0000 7fc0ef7fe640 1 -- 172.21.15.19:0/151792162 <== osd.9 v2:172.21.15.19:6826/574664786 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc1001021b0 con 0x7fc0e80acb20 2024-09-19T08:50:55.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.759+0000 7fc104bce640 1 -- 172.21.15.19:0/151792162 >> [v2:172.21.15.19:6826/574664786,v1:172.21.15.19:6827/574664786] conn(0x7fc0e80acb20 msgr2=0x7fc0e80aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:55.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.759+0000 7fc104bce640 1 --2- 172.21.15.19:0/151792162 >> [v2:172.21.15.19:6826/574664786,v1:172.21.15.19:6827/574664786] conn(0x7fc0e80acb20 0x7fc0e80aef40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:55.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.759+0000 7fc104bce640 1 -- 172.21.15.19:0/151792162 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc0e80a32d0 msgr2=0x7fc0e80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:55.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.759+0000 7fc104bce640 1 --2- 172.21.15.19:0/151792162 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc0e80a32d0 0x7fc0e80a5790 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0005d00 tx=0x7fc0f000b410 comp rx=0 tx=0).stop 2024-09-19T08:50:55.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.759+0000 7fc104bce640 1 -- 172.21.15.19:0/151792162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc100102ef0 msgr2=0x7fc10019bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:55.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.759+0000 7fc104bce640 1 --2- 172.21.15.19:0/151792162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc100102ef0 0x7fc10019bc90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc0f800cce0 tx=0x7fc0f800a620 comp rx=0 tx=0).stop 2024-09-19T08:50:55.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.759+0000 7fc0fed9d640 1 -- 172.21.15.19:0/151792162 reap_dead start 2024-09-19T08:50:55.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.759+0000 7fc104bce640 1 -- 172.21.15.19:0/151792162 shutdown_connections 2024-09-19T08:50:55.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.759+0000 7fc104bce640 1 -- 172.21.15.19:0/151792162 >> 172.21.15.19:0/151792162 conn(0x7fc1000fc7d0 msgr2=0x7fc1000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:55.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.759+0000 7fc104bce640 1 -- 172.21.15.19:0/151792162 shutdown_connections 2024-09-19T08:50:55.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:54.759+0000 7fc104bce640 1 -- 172.21.15.19:0/151792162 wait complete. 2024-09-19T08:50:55.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:55 smithi203 ceph-mon[35450]: pgmap v296: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-19T08:50:55.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:55 smithi019 ceph-mon[30976]: pgmap v296: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-19T08:50:55.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:55 smithi155 ceph-mon[34921]: pgmap v296: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-19T08:50:56.066 INFO:teuthology.orchestra.run.smithi019.stdout:266287972384 2024-09-19T08:50:56.067 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-19T08:50:57.027 INFO:teuthology.orchestra.run.smithi019.stdout:184683593775 2024-09-19T08:50:57.027 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-19T08:50:57.522 INFO:teuthology.orchestra.run.smithi019.stdout:317827579925 2024-09-19T08:50:57.522 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-19T08:50:57.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:57 smithi203 ceph-mon[35450]: pgmap v297: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-19T08:50:57.773 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:57 smithi019 ceph-mon[30976]: pgmap v297: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-19T08:50:57.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:57 smithi155 ceph-mon[34921]: pgmap v297: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-19T08:50:58.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.042+0000 7f2beeec2640 1 -- 172.21.15.19:0/1857142030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2be8101280 msgr2=0x7f2be810df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:58.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.042+0000 7f2beeec2640 1 --2- 172.21.15.19:0/1857142030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2be8101280 0x7f2be810df40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4009900 tx=0x7f2bd402a410 comp rx=0 tx=0).stop 2024-09-19T08:50:58.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.042+0000 7f2beeec2640 1 -- 172.21.15.19:0/1857142030 shutdown_connections 2024-09-19T08:50:58.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.042+0000 7f2beeec2640 1 --2- 172.21.15.19:0/1857142030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2be810e480 0x7f2be8110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:58.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.042+0000 7f2beeec2640 1 --2- 172.21.15.19:0/1857142030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2be8101280 0x7f2be810df40 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:58.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.042+0000 7f2beeec2640 1 --2- 172.21.15.19:0/1857142030 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2be81008d0 0x7f2be8100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:58.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.042+0000 7f2beeec2640 1 -- 172.21.15.19:0/1857142030 >> 172.21.15.19:0/1857142030 conn(0x7f2be80fc7a0 msgr2=0x7f2be80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:58.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.042+0000 7f2beeec2640 1 -- 172.21.15.19:0/1857142030 shutdown_connections 2024-09-19T08:50:58.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.042+0000 7f2beeec2640 1 -- 172.21.15.19:0/1857142030 wait complete. 2024-09-19T08:50:58.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.043+0000 7f2beeec2640 1 Processor -- start 2024-09-19T08:50:58.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.043+0000 7f2beeec2640 1 -- start start 2024-09-19T08:50:58.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.043+0000 7f2beeec2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2be81008d0 0x7f2be819a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:58.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.043+0000 7f2beeec2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2be8101280 0x7f2be819aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:58.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.043+0000 7f2beeec2640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2be810e480 0x7f2be819df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:58.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.043+0000 7f2beeec2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2be8114200 con 0x7f2be8101280 2024-09-19T08:50:58.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.043+0000 7f2beeec2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2be8114080 con 0x7f2be81008d0 2024-09-19T08:50:58.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.043+0000 7f2beeec2640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2be8114380 con 0x7f2be810e480 2024-09-19T08:50:58.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.043+0000 7f2be7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2be8101280 0x7f2be819aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:58.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.044+0000 7f2be7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2be8101280 0x7f2be819aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42802/0 (socket says 172.21.15.19:42802) 2024-09-19T08:50:58.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.044+0000 7f2be7fff640 1 -- 172.21.15.19:0/1397691481 learned_addr learned my addr 172.21.15.19:0/1397691481 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:50:58.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.044+0000 7f2bed45f640 1 --2- 172.21.15.19:0/1397691481 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2be810e480 0x7f2be819df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:58.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.044+0000 7f2becc5e640 1 --2- 172.21.15.19:0/1397691481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2be81008d0 0x7f2be819a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:58.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.044+0000 7f2be7fff640 1 -- 172.21.15.19:0/1397691481 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2be810e480 msgr2=0x7f2be819df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:58.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.044+0000 7f2be7fff640 1 --2- 172.21.15.19:0/1397691481 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2be810e480 0x7f2be819df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:58.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.044+0000 7f2be7fff640 1 -- 172.21.15.19:0/1397691481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2be81008d0 msgr2=0x7f2be819a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:58.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.044+0000 7f2be7fff640 1 --2- 172.21.15.19:0/1397691481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2be81008d0 0x7f2be819a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:58.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.044+0000 7f2be7fff640 1 -- 172.21.15.19:0/1397691481 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be819e6b0 con 0x7f2be8101280 2024-09-19T08:50:58.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.044+0000 7f2becc5e640 1 --2- 172.21.15.19:0/1397691481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2be81008d0 0x7f2be819a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:50:58.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.044+0000 7f2be7fff640 1 --2- 172.21.15.19:0/1397691481 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2be8101280 0x7f2be819aca0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4006010 tx=0x7f2bd40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:58.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.044+0000 7f2be5ffb640 1 -- 172.21.15.19:0/1397691481 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd403f030 con 0x7f2be8101280 2024-09-19T08:50:58.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.044+0000 7f2be5ffb640 1 -- 172.21.15.19:0/1397691481 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2bd4003ce0 con 0x7f2be8101280 2024-09-19T08:50:58.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.044+0000 7f2beeec2640 1 -- 172.21.15.19:0/1397691481 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2be819e940 con 0x7f2be8101280 2024-09-19T08:50:58.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.044+0000 7f2be5ffb640 1 -- 172.21.15.19:0/1397691481 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd4035070 con 0x7f2be8101280 2024-09-19T08:50:58.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.044+0000 7f2beeec2640 1 -- 172.21.15.19:0/1397691481 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2be81a7310 con 0x7f2be8101280 2024-09-19T08:50:58.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.045+0000 7f2beeec2640 1 -- 172.21.15.19:0/1397691481 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2be80628c0 con 0x7f2be8101280 2024-09-19T08:50:58.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.047+0000 7f2be5ffb640 1 -- 172.21.15.19:0/1397691481 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2bd4042030 con 0x7f2be8101280 2024-09-19T08:50:58.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.047+0000 7f2be5ffb640 1 --2- 172.21.15.19:0/1397691481 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2bd80a3350 0x7f2bd80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:58.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.047+0000 7f2be5ffb640 1 -- 172.21.15.19:0/1397691481 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f2bd40f0540 con 0x7f2be8101280 2024-09-19T08:50:58.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.047+0000 7f2becc5e640 1 --2- 172.21.15.19:0/1397691481 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2bd80a3350 0x7f2bd80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:58.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.048+0000 7f2be5ffb640 1 --2- 172.21.15.19:0/1397691481 >> [v2:172.21.15.203:6800/3358994623,v1:172.21.15.203:6801/3358994623] conn(0x7f2bd80acba0 0x7f2bd80aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:58.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.048+0000 7f2be5ffb640 1 -- 172.21.15.19:0/1397691481 --> [v2:172.21.15.203:6800/3358994623,v1:172.21.15.203:6801/3358994623] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2bd4001d30 con 0x7f2bd80acba0 2024-09-19T08:50:58.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.048+0000 7f2be5ffb640 1 -- 172.21.15.19:0/1397691481 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f2bd40f0a20 con 0x7f2be8101280 2024-09-19T08:50:58.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.048+0000 7f2becc5e640 1 --2- 172.21.15.19:0/1397691481 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2bd80a3350 0x7f2bd80a5810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc006fd0 tx=0x7f2bdc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:58.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.048+0000 7f2bed45f640 1 --2- 172.21.15.19:0/1397691481 >> [v2:172.21.15.203:6800/3358994623,v1:172.21.15.203:6801/3358994623] conn(0x7f2bd80acba0 0x7f2bd80aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:58.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.048+0000 7f2bed45f640 1 --2- 172.21.15.19:0/1397691481 >> [v2:172.21.15.203:6800/3358994623,v1:172.21.15.203:6801/3358994623] conn(0x7f2bd80acba0 0x7f2bd80aefc0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:58.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.049+0000 7f2be5ffb640 1 -- 172.21.15.19:0/1397691481 <== osd.2 v2:172.21.15.203:6800/3358994623 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2bd4001d30 con 0x7f2bd80acba0 2024-09-19T08:50:58.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.063+0000 7f2beeec2640 1 -- 172.21.15.19:0/1397691481 --> [v2:172.21.15.203:6800/3358994623,v1:172.21.15.203:6801/3358994623] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2be8062cc0 con 0x7f2bd80acba0 2024-09-19T08:50:58.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.063+0000 7f2be5ffb640 1 -- 172.21.15.19:0/1397691481 <== osd.2 v2:172.21.15.203:6800/3358994623 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2be8062cc0 con 0x7f2bd80acba0 2024-09-19T08:50:58.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.064+0000 7f2beeec2640 1 -- 172.21.15.19:0/1397691481 >> [v2:172.21.15.203:6800/3358994623,v1:172.21.15.203:6801/3358994623] conn(0x7f2bd80acba0 msgr2=0x7f2bd80aefc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:58.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.064+0000 7f2beeec2640 1 --2- 172.21.15.19:0/1397691481 >> [v2:172.21.15.203:6800/3358994623,v1:172.21.15.203:6801/3358994623] conn(0x7f2bd80acba0 0x7f2bd80aefc0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:58.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.064+0000 7f2beeec2640 1 -- 172.21.15.19:0/1397691481 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2bd80a3350 msgr2=0x7f2bd80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:58.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.064+0000 7f2beeec2640 1 --2- 172.21.15.19:0/1397691481 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2bd80a3350 0x7f2bd80a5810 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc006fd0 tx=0x7f2bdc008040 comp rx=0 tx=0).stop 2024-09-19T08:50:58.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.064+0000 7f2beeec2640 1 -- 172.21.15.19:0/1397691481 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2be8101280 msgr2=0x7f2be819aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:58.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.064+0000 7f2beeec2640 1 --2- 172.21.15.19:0/1397691481 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2be8101280 0x7f2be819aca0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4006010 tx=0x7f2bd40042f0 comp rx=0 tx=0).stop 2024-09-19T08:50:58.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.064+0000 7f2bed45f640 1 -- 172.21.15.19:0/1397691481 reap_dead start 2024-09-19T08:50:58.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.064+0000 7f2beeec2640 1 -- 172.21.15.19:0/1397691481 shutdown_connections 2024-09-19T08:50:58.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.064+0000 7f2beeec2640 1 -- 172.21.15.19:0/1397691481 >> 172.21.15.19:0/1397691481 conn(0x7f2be80fc7a0 msgr2=0x7f2be80feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:58.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.064+0000 7f2beeec2640 1 -- 172.21.15.19:0/1397691481 shutdown_connections 2024-09-19T08:50:58.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:58.064+0000 7f2beeec2640 1 -- 172.21.15.19:0/1397691481 wait complete. 2024-09-19T08:50:59.098 INFO:teuthology.orchestra.run.smithi019.stdout:77309411396 2024-09-19T08:50:59.098 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-19T08:50:59.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.395+0000 7fca9f717640 1 -- 172.21.15.19:0/1824957170 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca98100a80 msgr2=0x7fca98100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:59.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.395+0000 7fca9f717640 1 --2- 172.21.15.19:0/1824957170 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca98100a80 0x7fca98100ee0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fca8c009930 tx=0x7fca8c02a420 comp rx=0 tx=0).stop 2024-09-19T08:50:59.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.395+0000 7fca9f717640 1 -- 172.21.15.19:0/1824957170 shutdown_connections 2024-09-19T08:50:59.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.395+0000 7fca9f717640 1 --2- 172.21.15.19:0/1824957170 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca98101420 0x7fca9810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:59.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.395+0000 7fca9f717640 1 --2- 172.21.15.19:0/1824957170 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca98100a80 0x7fca98100ee0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:59.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.395+0000 7fca9f717640 1 --2- 172.21.15.19:0/1824957170 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca98106a80 0x7fca98106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:59.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.395+0000 7fca9f717640 1 -- 172.21.15.19:0/1824957170 >> 172.21.15.19:0/1824957170 conn(0x7fca980fc7a0 msgr2=0x7fca980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:59.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.395+0000 7fca9f717640 1 -- 172.21.15.19:0/1824957170 shutdown_connections 2024-09-19T08:50:59.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.395+0000 7fca9f717640 1 -- 172.21.15.19:0/1824957170 wait complete. 2024-09-19T08:50:59.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.396+0000 7fca9f717640 1 Processor -- start 2024-09-19T08:50:59.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.396+0000 7fca9f717640 1 -- start start 2024-09-19T08:50:59.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.396+0000 7fca9f717640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca98100a80 0x7fca98199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:59.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.396+0000 7fca9f717640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca98101420 0x7fca98199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:59.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.396+0000 7fca9f717640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca98106a80 0x7fca981a42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:59.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.396+0000 7fca9f717640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fca98110e90 con 0x7fca98101420 2024-09-19T08:50:59.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.396+0000 7fca9f717640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fca98110d10 con 0x7fca98106a80 2024-09-19T08:50:59.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.396+0000 7fca9f717640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fca98111010 con 0x7fca98100a80 2024-09-19T08:50:59.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.397+0000 7fca9ccb2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca98101420 0x7fca98199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:59.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.397+0000 7fca9ccb2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca98101420 0x7fca98199790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42820/0 (socket says 172.21.15.19:42820) 2024-09-19T08:50:59.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.397+0000 7fca9ccb2640 1 -- 172.21.15.19:0/302255697 learned_addr learned my addr 172.21.15.19:0/302255697 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:50:59.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.397+0000 7fca9d4b3640 1 --2- 172.21.15.19:0/302255697 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca98100a80 0x7fca98199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:59.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.397+0000 7fca9dcb4640 1 --2- 172.21.15.19:0/302255697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca98106a80 0x7fca981a42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:59.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.397+0000 7fca9ccb2640 1 -- 172.21.15.19:0/302255697 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca98100a80 msgr2=0x7fca98199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:59.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.397+0000 7fca9ccb2640 1 --2- 172.21.15.19:0/302255697 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca98100a80 0x7fca98199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:59.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.397+0000 7fca9ccb2640 1 -- 172.21.15.19:0/302255697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca98106a80 msgr2=0x7fca981a42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:59.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.397+0000 7fca9ccb2640 1 --2- 172.21.15.19:0/302255697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca98106a80 0x7fca981a42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:59.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.397+0000 7fca9ccb2640 1 -- 172.21.15.19:0/302255697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca981a4810 con 0x7fca98101420 2024-09-19T08:50:59.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.397+0000 7fca9ccb2640 1 --2- 172.21.15.19:0/302255697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca98101420 0x7fca98199790 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fca8c02a940 tx=0x7fca8c003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:59.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.397+0000 7fca8a7fc640 1 -- 172.21.15.19:0/302255697 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c03f070 con 0x7fca98101420 2024-09-19T08:50:59.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.397+0000 7fca8a7fc640 1 -- 172.21.15.19:0/302255697 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca8c031c90 con 0x7fca98101420 2024-09-19T08:50:59.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.397+0000 7fca9f717640 1 -- 172.21.15.19:0/302255697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca981a49e0 con 0x7fca98101420 2024-09-19T08:50:59.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.397+0000 7fca8a7fc640 1 -- 172.21.15.19:0/302255697 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c035030 con 0x7fca98101420 2024-09-19T08:50:59.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.397+0000 7fca9f717640 1 -- 172.21.15.19:0/302255697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca981a4e90 con 0x7fca98101420 2024-09-19T08:50:59.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.398+0000 7fca9f717640 1 -- 172.21.15.19:0/302255697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fca980fd850 con 0x7fca98101420 2024-09-19T08:50:59.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.400+0000 7fca8a7fc640 1 -- 172.21.15.19:0/302255697 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fca8c042070 con 0x7fca98101420 2024-09-19T08:50:59.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.400+0000 7fca8a7fc640 1 --2- 172.21.15.19:0/302255697 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fca840a3350 0x7fca840a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:59.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.400+0000 7fca9d4b3640 1 --2- 172.21.15.19:0/302255697 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fca840a3350 0x7fca840a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:59.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.400+0000 7fca8a7fc640 1 -- 172.21.15.19:0/302255697 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fca8c0f00c0 con 0x7fca98101420 2024-09-19T08:50:59.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.401+0000 7fca8a7fc640 1 --2- 172.21.15.19:0/302255697 >> [v2:172.21.15.203:6816/1062999528,v1:172.21.15.203:6817/1062999528] conn(0x7fca840acba0 0x7fca840aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:50:59.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.401+0000 7fca8a7fc640 1 -- 172.21.15.19:0/302255697 --> [v2:172.21.15.203:6816/1062999528,v1:172.21.15.203:6817/1062999528] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fca8c02fec0 con 0x7fca840acba0 2024-09-19T08:50:59.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.401+0000 7fca8a7fc640 1 -- 172.21.15.19:0/302255697 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fca8c0f7050 con 0x7fca98101420 2024-09-19T08:50:59.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.401+0000 7fca9d4b3640 1 --2- 172.21.15.19:0/302255697 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fca840a3350 0x7fca840a5810 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fca9400ab60 tx=0x7fca9400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:59.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.401+0000 7fca9dcb4640 1 --2- 172.21.15.19:0/302255697 >> [v2:172.21.15.203:6816/1062999528,v1:172.21.15.203:6817/1062999528] conn(0x7fca840acba0 0x7fca840aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:50:59.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.401+0000 7fca9dcb4640 1 --2- 172.21.15.19:0/302255697 >> [v2:172.21.15.203:6816/1062999528,v1:172.21.15.203:6817/1062999528] conn(0x7fca840acba0 0x7fca840aefc0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:50:59.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.402+0000 7fca8a7fc640 1 -- 172.21.15.19:0/302255697 <== osd.8 v2:172.21.15.203:6816/1062999528 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fca8c02fec0 con 0x7fca840acba0 2024-09-19T08:50:59.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.416+0000 7fca9f717640 1 -- 172.21.15.19:0/302255697 --> [v2:172.21.15.203:6816/1062999528,v1:172.21.15.203:6817/1062999528] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fca981021c0 con 0x7fca840acba0 2024-09-19T08:50:59.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.416+0000 7fca8a7fc640 1 -- 172.21.15.19:0/302255697 <== osd.8 v2:172.21.15.203:6816/1062999528 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fca981021c0 con 0x7fca840acba0 2024-09-19T08:50:59.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.417+0000 7fca9f717640 1 -- 172.21.15.19:0/302255697 >> [v2:172.21.15.203:6816/1062999528,v1:172.21.15.203:6817/1062999528] conn(0x7fca840acba0 msgr2=0x7fca840aefc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:59.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.417+0000 7fca9f717640 1 --2- 172.21.15.19:0/302255697 >> [v2:172.21.15.203:6816/1062999528,v1:172.21.15.203:6817/1062999528] conn(0x7fca840acba0 0x7fca840aefc0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:50:59.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.417+0000 7fca9f717640 1 -- 172.21.15.19:0/302255697 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fca840a3350 msgr2=0x7fca840a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:59.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.417+0000 7fca9f717640 1 --2- 172.21.15.19:0/302255697 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fca840a3350 0x7fca840a5810 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fca9400ab60 tx=0x7fca9400a2d0 comp rx=0 tx=0).stop 2024-09-19T08:50:59.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.417+0000 7fca9f717640 1 -- 172.21.15.19:0/302255697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca98101420 msgr2=0x7fca98199790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:50:59.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.417+0000 7fca9f717640 1 --2- 172.21.15.19:0/302255697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca98101420 0x7fca98199790 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fca8c02a940 tx=0x7fca8c003b90 comp rx=0 tx=0).stop 2024-09-19T08:50:59.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.417+0000 7fca9dcb4640 1 -- 172.21.15.19:0/302255697 reap_dead start 2024-09-19T08:50:59.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.417+0000 7fca9f717640 1 -- 172.21.15.19:0/302255697 shutdown_connections 2024-09-19T08:50:59.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.417+0000 7fca9f717640 1 -- 172.21.15.19:0/302255697 >> 172.21.15.19:0/302255697 conn(0x7fca980fc7a0 msgr2=0x7fca980fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:50:59.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.417+0000 7fca9f717640 1 -- 172.21.15.19:0/302255697 shutdown_connections 2024-09-19T08:50:59.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:50:59.417+0000 7fca9f717640 1 -- 172.21.15.19:0/302255697 wait complete. 2024-09-19T08:50:59.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:50:59 smithi203 ceph-mon[35450]: pgmap v298: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-19T08:50:59.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:50:59 smithi019 ceph-mon[30976]: pgmap v298: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-19T08:50:59.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:50:59 smithi155 ceph-mon[34921]: pgmap v298: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 8 op/s 2024-09-19T08:50:59.970 INFO:teuthology.orchestra.run.smithi019.stdout:206158430249 2024-09-19T08:50:59.971 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-19T08:51:00.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.226+0000 7f8c69f9d640 1 -- 172.21.15.19:0/2349616351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c64074590 msgr2=0x7f8c64074970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:00.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.226+0000 7f8c69f9d640 1 --2- 172.21.15.19:0/2349616351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c64074590 0x7f8c64074970 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8c54009900 tx=0x7f8c5402a480 comp rx=0 tx=0).stop 2024-09-19T08:51:00.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.226+0000 7f8c69f9d640 1 -- 172.21.15.19:0/2349616351 shutdown_connections 2024-09-19T08:51:00.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.226+0000 7f8c69f9d640 1 --2- 172.21.15.19:0/2349616351 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8c64112b90 0x7f8c64114f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:00.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.226+0000 7f8c69f9d640 1 --2- 172.21.15.19:0/2349616351 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c64074eb0 0x7f8c64112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:00.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.226+0000 7f8c69f9d640 1 --2- 172.21.15.19:0/2349616351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c64074590 0x7f8c64074970 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:00.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.226+0000 7f8c69f9d640 1 -- 172.21.15.19:0/2349616351 >> 172.21.15.19:0/2349616351 conn(0x7f8c640fd8c0 msgr2=0x7f8c640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:00.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.227+0000 7f8c69f9d640 1 -- 172.21.15.19:0/2349616351 shutdown_connections 2024-09-19T08:51:00.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.227+0000 7f8c69f9d640 1 -- 172.21.15.19:0/2349616351 wait complete. 2024-09-19T08:51:00.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.227+0000 7f8c69f9d640 1 Processor -- start 2024-09-19T08:51:00.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.227+0000 7f8c69f9d640 1 -- start start 2024-09-19T08:51:00.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.227+0000 7f8c69f9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c64074590 0x7f8c641a4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:00.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.227+0000 7f8c69f9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8c64074eb0 0x7f8c641a4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:00.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.227+0000 7f8c69f9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c64112b90 0x7f8c6419e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:00.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.227+0000 7f8c69f9d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8c64118630 con 0x7f8c64074590 2024-09-19T08:51:00.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.227+0000 7f8c69f9d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8c641184b0 con 0x7f8c64112b90 2024-09-19T08:51:00.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.227+0000 7f8c69f9d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8c641187b0 con 0x7f8c64074eb0 2024-09-19T08:51:00.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.228+0000 7f8c637fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c64074590 0x7f8c641a4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:00.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.228+0000 7f8c637fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c64074590 0x7f8c641a4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42836/0 (socket says 172.21.15.19:42836) 2024-09-19T08:51:00.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.228+0000 7f8c637fe640 1 -- 172.21.15.19:0/759347589 learned_addr learned my addr 172.21.15.19:0/759347589 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:00.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.228+0000 7f8c5bfff640 1 --2- 172.21.15.19:0/759347589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8c64074eb0 0x7f8c641a4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:00.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.228+0000 7f8c637fe640 1 -- 172.21.15.19:0/759347589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8c64074eb0 msgr2=0x7f8c641a4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:00.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.228+0000 7f8c63fff640 1 --2- 172.21.15.19:0/759347589 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c64112b90 0x7f8c6419e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:00.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.228+0000 7f8c637fe640 1 --2- 172.21.15.19:0/759347589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8c64074eb0 0x7f8c641a4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:00.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.228+0000 7f8c637fe640 1 -- 172.21.15.19:0/759347589 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c64112b90 msgr2=0x7f8c6419e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:00.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.228+0000 7f8c637fe640 1 --2- 172.21.15.19:0/759347589 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c64112b90 0x7f8c6419e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:00.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.228+0000 7f8c637fe640 1 -- 172.21.15.19:0/759347589 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c6419f050 con 0x7f8c64074590 2024-09-19T08:51:00.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.228+0000 7f8c63fff640 1 --2- 172.21.15.19:0/759347589 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8c64112b90 0x7f8c6419e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:51:00.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.228+0000 7f8c637fe640 1 --2- 172.21.15.19:0/759347589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c64074590 0x7f8c641a4760 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8c54006010 tx=0x7f8c54003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:00.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.228+0000 7f8c617fa640 1 -- 172.21.15.19:0/759347589 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5403f070 con 0x7f8c64074590 2024-09-19T08:51:00.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.228+0000 7f8c69f9d640 1 -- 172.21.15.19:0/759347589 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c6419f2e0 con 0x7f8c64074590 2024-09-19T08:51:00.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.228+0000 7f8c617fa640 1 -- 172.21.15.19:0/759347589 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8c54031c90 con 0x7f8c64074590 2024-09-19T08:51:00.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.228+0000 7f8c617fa640 1 -- 172.21.15.19:0/759347589 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c54035030 con 0x7f8c64074590 2024-09-19T08:51:00.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.228+0000 7f8c69f9d640 1 -- 172.21.15.19:0/759347589 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c641ab630 con 0x7f8c64074590 2024-09-19T08:51:00.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.229+0000 7f8c69f9d640 1 -- 172.21.15.19:0/759347589 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8c640ffa80 con 0x7f8c64074590 2024-09-19T08:51:00.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.231+0000 7f8c617fa640 1 -- 172.21.15.19:0/759347589 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8c54042070 con 0x7f8c64074590 2024-09-19T08:51:00.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.231+0000 7f8c617fa640 1 --2- 172.21.15.19:0/759347589 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8c500a32d0 0x7f8c500a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:00.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.231+0000 7f8c5bfff640 1 --2- 172.21.15.19:0/759347589 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8c500a32d0 0x7f8c500a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:00.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.231+0000 7f8c617fa640 1 -- 172.21.15.19:0/759347589 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f8c540f0770 con 0x7f8c64074590 2024-09-19T08:51:00.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.231+0000 7f8c617fa640 1 --2- 172.21.15.19:0/759347589 >> [v2:172.21.15.19:6802/3397146732,v1:172.21.15.19:6803/3397146732] conn(0x7f8c500acb20 0x7f8c500aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:00.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.232+0000 7f8c617fa640 1 -- 172.21.15.19:0/759347589 --> [v2:172.21.15.19:6802/3397146732,v1:172.21.15.19:6803/3397146732] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8c54038e90 con 0x7f8c500acb20 2024-09-19T08:51:00.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.232+0000 7f8c617fa640 1 -- 172.21.15.19:0/759347589 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f8c540f0c50 con 0x7f8c64074590 2024-09-19T08:51:00.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.232+0000 7f8c63fff640 1 --2- 172.21.15.19:0/759347589 >> [v2:172.21.15.19:6802/3397146732,v1:172.21.15.19:6803/3397146732] conn(0x7f8c500acb20 0x7f8c500aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:00.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.232+0000 7f8c5bfff640 1 --2- 172.21.15.19:0/759347589 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8c500a32d0 0x7f8c500a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8c640fff30 tx=0x7f8c4c005c60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:00.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.232+0000 7f8c63fff640 1 --2- 172.21.15.19:0/759347589 >> [v2:172.21.15.19:6802/3397146732,v1:172.21.15.19:6803/3397146732] conn(0x7f8c500acb20 0x7f8c500aef40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:00.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.233+0000 7f8c617fa640 1 -- 172.21.15.19:0/759347589 <== osd.0 v2:172.21.15.19:6802/3397146732 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8c54038e90 con 0x7f8c500acb20 2024-09-19T08:51:00.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.246+0000 7f8c69f9d640 1 -- 172.21.15.19:0/759347589 --> [v2:172.21.15.19:6802/3397146732,v1:172.21.15.19:6803/3397146732] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8c64075cd0 con 0x7f8c500acb20 2024-09-19T08:51:00.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.247+0000 7f8c617fa640 1 -- 172.21.15.19:0/759347589 <== osd.0 v2:172.21.15.19:6802/3397146732 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8c64075cd0 con 0x7f8c500acb20 2024-09-19T08:51:00.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.247+0000 7f8c69f9d640 1 -- 172.21.15.19:0/759347589 >> [v2:172.21.15.19:6802/3397146732,v1:172.21.15.19:6803/3397146732] conn(0x7f8c500acb20 msgr2=0x7f8c500aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:00.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.247+0000 7f8c69f9d640 1 --2- 172.21.15.19:0/759347589 >> [v2:172.21.15.19:6802/3397146732,v1:172.21.15.19:6803/3397146732] conn(0x7f8c500acb20 0x7f8c500aef40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:00.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.247+0000 7f8c69f9d640 1 -- 172.21.15.19:0/759347589 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8c500a32d0 msgr2=0x7f8c500a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:00.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.247+0000 7f8c69f9d640 1 --2- 172.21.15.19:0/759347589 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8c500a32d0 0x7f8c500a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8c640fff30 tx=0x7f8c4c005c60 comp rx=0 tx=0).stop 2024-09-19T08:51:00.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.247+0000 7f8c69f9d640 1 -- 172.21.15.19:0/759347589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c64074590 msgr2=0x7f8c641a4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:00.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.247+0000 7f8c69f9d640 1 --2- 172.21.15.19:0/759347589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8c64074590 0x7f8c641a4760 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8c54006010 tx=0x7f8c54003ba0 comp rx=0 tx=0).stop 2024-09-19T08:51:00.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.247+0000 7f8c63fff640 1 -- 172.21.15.19:0/759347589 reap_dead start 2024-09-19T08:51:00.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.248+0000 7f8c69f9d640 1 -- 172.21.15.19:0/759347589 shutdown_connections 2024-09-19T08:51:00.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.248+0000 7f8c69f9d640 1 -- 172.21.15.19:0/759347589 >> 172.21.15.19:0/759347589 conn(0x7f8c640fd8c0 msgr2=0x7f8c640ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:00.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.248+0000 7f8c69f9d640 1 -- 172.21.15.19:0/759347589 shutdown_connections 2024-09-19T08:51:00.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.248+0000 7f8c69f9d640 1 -- 172.21.15.19:0/759347589 wait complete. 2024-09-19T08:51:01.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.077+0000 7f0f685ea640 1 -- 172.21.15.19:0/346662205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f60102d40 msgr2=0x7f0f60103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:01.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.077+0000 7f0f685ea640 1 --2- 172.21.15.19:0/346662205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f60102d40 0x7f0f60103120 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0f54009900 tx=0x7f0f5402a480 comp rx=0 tx=0).stop 2024-09-19T08:51:01.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.077+0000 7f0f685ea640 1 -- 172.21.15.19:0/346662205 shutdown_connections 2024-09-19T08:51:01.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.077+0000 7f0f685ea640 1 --2- 172.21.15.19:0/346662205 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f6010c170 0x7f0f6010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.077+0000 7f0f685ea640 1 --2- 172.21.15.19:0/346662205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f60103660 0x7f0f6010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.077+0000 7f0f685ea640 1 --2- 172.21.15.19:0/346662205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f60102d40 0x7f0f60103120 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.077+0000 7f0f685ea640 1 -- 172.21.15.19:0/346662205 >> 172.21.15.19:0/346662205 conn(0x7f0f600fc7a0 msgr2=0x7f0f600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:01.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.077+0000 7f0f685ea640 1 -- 172.21.15.19:0/346662205 shutdown_connections 2024-09-19T08:51:01.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.077+0000 7f0f685ea640 1 -- 172.21.15.19:0/346662205 wait complete. 2024-09-19T08:51:01.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.078+0000 7f0f685ea640 1 Processor -- start 2024-09-19T08:51:01.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.078+0000 7f0f685ea640 1 -- start start 2024-09-19T08:51:01.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.078+0000 7f0f685ea640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f60102d40 0x7f0f601984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:01.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.078+0000 7f0f685ea640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f60103660 0x7f0f60198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:01.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.078+0000 7f0f685ea640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f6010c170 0x7f0f6019cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:01.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.078+0000 7f0f685ea640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0f60111f70 con 0x7f0f60103660 2024-09-19T08:51:01.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.078+0000 7f0f685ea640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0f60111df0 con 0x7f0f6010c170 2024-09-19T08:51:01.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.078+0000 7f0f685ea640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0f601120f0 con 0x7f0f60102d40 2024-09-19T08:51:01.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.078+0000 7f0f65b85640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f60103660 0x7f0f60198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:01.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.078+0000 7f0f65b85640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f60103660 0x7f0f60198a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42872/0 (socket says 172.21.15.19:42872) 2024-09-19T08:51:01.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.078+0000 7f0f65b85640 1 -- 172.21.15.19:0/3271457582 learned_addr learned my addr 172.21.15.19:0/3271457582 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:01.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.078+0000 7f0f66b87640 1 --2- 172.21.15.19:0/3271457582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f6010c170 0x7f0f6019cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:01.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.078+0000 7f0f66386640 1 --2- 172.21.15.19:0/3271457582 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f60102d40 0x7f0f601984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:01.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.078+0000 7f0f65b85640 1 -- 172.21.15.19:0/3271457582 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f60102d40 msgr2=0x7f0f601984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:01.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.078+0000 7f0f65b85640 1 --2- 172.21.15.19:0/3271457582 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f60102d40 0x7f0f601984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.078+0000 7f0f65b85640 1 -- 172.21.15.19:0/3271457582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f6010c170 msgr2=0x7f0f6019cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:01.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.078+0000 7f0f65b85640 1 --2- 172.21.15.19:0/3271457582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0f6010c170 0x7f0f6019cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.078+0000 7f0f65b85640 1 -- 172.21.15.19:0/3271457582 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f6019d490 con 0x7f0f60103660 2024-09-19T08:51:01.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.079+0000 7f0f65b85640 1 --2- 172.21.15.19:0/3271457582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f60103660 0x7f0f60198a20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c00c940 tx=0x7f0f5c00ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:01.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.079+0000 7f0f537fe640 1 -- 172.21.15.19:0/3271457582 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c004220 con 0x7f0f60103660 2024-09-19T08:51:01.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.079+0000 7f0f537fe640 1 -- 172.21.15.19:0/3271457582 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0f5c0043c0 con 0x7f0f60103660 2024-09-19T08:51:01.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.079+0000 7f0f537fe640 1 -- 172.21.15.19:0/3271457582 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c004a00 con 0x7f0f60103660 2024-09-19T08:51:01.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.079+0000 7f0f685ea640 1 -- 172.21.15.19:0/3271457582 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f6019d780 con 0x7f0f60103660 2024-09-19T08:51:01.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.079+0000 7f0f685ea640 1 -- 172.21.15.19:0/3271457582 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f601a5060 con 0x7f0f60103660 2024-09-19T08:51:01.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.080+0000 7f0f685ea640 1 -- 172.21.15.19:0/3271457582 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0f60062900 con 0x7f0f60103660 2024-09-19T08:51:01.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.081+0000 7f0f537fe640 1 -- 172.21.15.19:0/3271457582 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f0f5c0079b0 con 0x7f0f60103660 2024-09-19T08:51:01.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.082+0000 7f0f537fe640 1 --2- 172.21.15.19:0/3271457582 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f0f4c0a32d0 0x7f0f4c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:01.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.082+0000 7f0f537fe640 1 -- 172.21.15.19:0/3271457582 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f0f5c0cfb10 con 0x7f0f60103660 2024-09-19T08:51:01.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.082+0000 7f0f66386640 1 --2- 172.21.15.19:0/3271457582 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f0f4c0a32d0 0x7f0f4c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:01.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.082+0000 7f0f537fe640 1 --2- 172.21.15.19:0/3271457582 >> [v2:172.21.15.155:6824/2242158832,v1:172.21.15.155:6825/2242158832] conn(0x7f0f4c0acb20 0x7f0f4c0aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:01.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.082+0000 7f0f537fe640 1 -- 172.21.15.19:0/3271457582 --> [v2:172.21.15.155:6824/2242158832,v1:172.21.15.155:6825/2242158832] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0f5c012ec0 con 0x7f0f4c0acb20 2024-09-19T08:51:01.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.082+0000 7f0f537fe640 1 -- 172.21.15.19:0/3271457582 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7f0f5c0cfff0 con 0x7f0f60103660 2024-09-19T08:51:01.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.082+0000 7f0f66386640 1 --2- 172.21.15.19:0/3271457582 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f0f4c0a32d0 0x7f0f4c0a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0f540096c0 tx=0x7f0f54031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:01.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.082+0000 7f0f66b87640 1 --2- 172.21.15.19:0/3271457582 >> [v2:172.21.15.155:6824/2242158832,v1:172.21.15.155:6825/2242158832] conn(0x7f0f4c0acb20 0x7f0f4c0aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:01.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.083+0000 7f0f66b87640 1 --2- 172.21.15.19:0/3271457582 >> [v2:172.21.15.155:6824/2242158832,v1:172.21.15.155:6825/2242158832] conn(0x7f0f4c0acb20 0x7f0f4c0aef40 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:01.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.084+0000 7f0f537fe640 1 -- 172.21.15.19:0/3271457582 <== osd.10 v2:172.21.15.155:6824/2242158832 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0f5c012ec0 con 0x7f0f4c0acb20 2024-09-19T08:51:01.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.097+0000 7f0f685ea640 1 -- 172.21.15.19:0/3271457582 --> [v2:172.21.15.155:6824/2242158832,v1:172.21.15.155:6825/2242158832] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0f60062d80 con 0x7f0f4c0acb20 2024-09-19T08:51:01.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.098+0000 7f0f537fe640 1 -- 172.21.15.19:0/3271457582 <== osd.10 v2:172.21.15.155:6824/2242158832 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f0f60062d80 con 0x7f0f4c0acb20 2024-09-19T08:51:01.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.098+0000 7f0f685ea640 1 -- 172.21.15.19:0/3271457582 >> [v2:172.21.15.155:6824/2242158832,v1:172.21.15.155:6825/2242158832] conn(0x7f0f4c0acb20 msgr2=0x7f0f4c0aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:01.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.098+0000 7f0f685ea640 1 --2- 172.21.15.19:0/3271457582 >> [v2:172.21.15.155:6824/2242158832,v1:172.21.15.155:6825/2242158832] conn(0x7f0f4c0acb20 0x7f0f4c0aef40 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.098+0000 7f0f685ea640 1 -- 172.21.15.19:0/3271457582 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f0f4c0a32d0 msgr2=0x7f0f4c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:01.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.098+0000 7f0f685ea640 1 --2- 172.21.15.19:0/3271457582 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f0f4c0a32d0 0x7f0f4c0a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0f540096c0 tx=0x7f0f54031490 comp rx=0 tx=0).stop 2024-09-19T08:51:01.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.098+0000 7f0f685ea640 1 -- 172.21.15.19:0/3271457582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f60103660 msgr2=0x7f0f60198a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:01.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.098+0000 7f0f685ea640 1 --2- 172.21.15.19:0/3271457582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0f60103660 0x7f0f60198a20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c00c940 tx=0x7f0f5c00ce00 comp rx=0 tx=0).stop 2024-09-19T08:51:01.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.098+0000 7f0f66b87640 1 -- 172.21.15.19:0/3271457582 reap_dead start 2024-09-19T08:51:01.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.098+0000 7f0f685ea640 1 -- 172.21.15.19:0/3271457582 shutdown_connections 2024-09-19T08:51:01.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.098+0000 7f0f685ea640 1 -- 172.21.15.19:0/3271457582 >> 172.21.15.19:0/3271457582 conn(0x7f0f600fc7a0 msgr2=0x7f0f600fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:01.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.098+0000 7f0f685ea640 1 -- 172.21.15.19:0/3271457582 shutdown_connections 2024-09-19T08:51:01.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.098+0000 7f0f685ea640 1 -- 172.21.15.19:0/3271457582 wait complete. 2024-09-19T08:51:01.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.982+0000 7fec2b3c3640 1 -- 172.21.15.19:0/825833057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec24101de0 msgr2=0x7fec241021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:01.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.982+0000 7fec2b3c3640 1 --2- 172.21.15.19:0/825833057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec24101de0 0x7fec241021c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fec20009900 tx=0x7fec2002a410 comp rx=0 tx=0).stop 2024-09-19T08:51:01.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.982+0000 7fec2b3c3640 1 -- 172.21.15.19:0/825833057 shutdown_connections 2024-09-19T08:51:01.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.982+0000 7fec2b3c3640 1 --2- 172.21.15.19:0/825833057 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec24102790 0x7fec241067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.982+0000 7fec2b3c3640 1 --2- 172.21.15.19:0/825833057 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec24106f10 0x7fec2410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.982+0000 7fec2b3c3640 1 --2- 172.21.15.19:0/825833057 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec24101de0 0x7fec241021c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.982+0000 7fec2b3c3640 1 -- 172.21.15.19:0/825833057 >> 172.21.15.19:0/825833057 conn(0x7fec240fd8c0 msgr2=0x7fec240ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:01.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.982+0000 7fec2b3c3640 1 -- 172.21.15.19:0/825833057 shutdown_connections 2024-09-19T08:51:01.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.982+0000 7fec2b3c3640 1 -- 172.21.15.19:0/825833057 wait complete. 2024-09-19T08:51:01.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.983+0000 7fec2b3c3640 1 Processor -- start 2024-09-19T08:51:01.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.983+0000 7fec2b3c3640 1 -- start start 2024-09-19T08:51:01.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.983+0000 7fec2b3c3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec24101de0 0x7fec24198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:01.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.983+0000 7fec2b3c3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec24102790 0x7fec241989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:01.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.983+0000 7fec2b3c3640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec24106f10 0x7fec2419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:01.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.983+0000 7fec2b3c3640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fec24111f30 con 0x7fec24101de0 2024-09-19T08:51:01.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.983+0000 7fec2b3c3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fec24111db0 con 0x7fec24102790 2024-09-19T08:51:01.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.983+0000 7fec2b3c3640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fec241120b0 con 0x7fec24106f10 2024-09-19T08:51:01.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.983+0000 7fec2915f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec24101de0 0x7fec24198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:01.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.983+0000 7fec2915f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec24101de0 0x7fec24198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42850/0 (socket says 172.21.15.19:42850) 2024-09-19T08:51:01.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.983+0000 7fec2915f640 1 -- 172.21.15.19:0/1722573295 learned_addr learned my addr 172.21.15.19:0/1722573295 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:01.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.983+0000 7fec2895e640 1 --2- 172.21.15.19:0/1722573295 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec24102790 0x7fec241989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:01.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.984+0000 7fec2915f640 1 -- 172.21.15.19:0/1722573295 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec24106f10 msgr2=0x7fec2419cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:01.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.984+0000 7fec29960640 1 --2- 172.21.15.19:0/1722573295 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec24106f10 0x7fec2419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:01.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.984+0000 7fec2915f640 1 --2- 172.21.15.19:0/1722573295 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec24106f10 0x7fec2419cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.984+0000 7fec2915f640 1 -- 172.21.15.19:0/1722573295 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec24102790 msgr2=0x7fec241989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:01.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.984+0000 7fec2915f640 1 --2- 172.21.15.19:0/1722573295 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec24102790 0x7fec241989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.984+0000 7fec2915f640 1 -- 172.21.15.19:0/1722573295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec2419d410 con 0x7fec24101de0 2024-09-19T08:51:01.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.984+0000 7fec2915f640 1 --2- 172.21.15.19:0/1722573295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec24101de0 0x7fec24198460 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fec20006010 tx=0x7fec200042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:01.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.984+0000 7fec1a7fc640 1 -- 172.21.15.19:0/1722573295 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec2003f030 con 0x7fec24101de0 2024-09-19T08:51:01.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.984+0000 7fec1a7fc640 1 -- 172.21.15.19:0/1722573295 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec20003ce0 con 0x7fec24101de0 2024-09-19T08:51:01.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.984+0000 7fec2b3c3640 1 -- 172.21.15.19:0/1722573295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec2419d6a0 con 0x7fec24101de0 2024-09-19T08:51:01.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.984+0000 7fec1a7fc640 1 -- 172.21.15.19:0/1722573295 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec20035070 con 0x7fec24101de0 2024-09-19T08:51:01.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.984+0000 7fec2b3c3640 1 -- 172.21.15.19:0/1722573295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec241a4fe0 con 0x7fec24101de0 2024-09-19T08:51:01.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.985+0000 7fec2b3c3640 1 -- 172.21.15.19:0/1722573295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fec24062980 con 0x7fec24101de0 2024-09-19T08:51:01.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.986+0000 7fec1a7fc640 1 -- 172.21.15.19:0/1722573295 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fec20042030 con 0x7fec24101de0 2024-09-19T08:51:01.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.987+0000 7fec1a7fc640 1 --2- 172.21.15.19:0/1722573295 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fec100a3350 0x7fec100a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:01.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.987+0000 7fec2895e640 1 --2- 172.21.15.19:0/1722573295 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fec100a3350 0x7fec100a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:01.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.987+0000 7fec1a7fc640 1 -- 172.21.15.19:0/1722573295 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fec200f0530 con 0x7fec24101de0 2024-09-19T08:51:01.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.987+0000 7fec1a7fc640 1 --2- 172.21.15.19:0/1722573295 >> [v2:172.21.15.155:6800/2011043685,v1:172.21.15.155:6801/2011043685] conn(0x7fec100acba0 0x7fec100aefc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:01.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.987+0000 7fec1a7fc640 1 -- 172.21.15.19:0/1722573295 --> [v2:172.21.15.155:6800/2011043685,v1:172.21.15.155:6801/2011043685] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fec20040e70 con 0x7fec100acba0 2024-09-19T08:51:01.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.987+0000 7fec1a7fc640 1 -- 172.21.15.19:0/1722573295 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fec200f0a10 con 0x7fec24101de0 2024-09-19T08:51:01.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.987+0000 7fec29960640 1 --2- 172.21.15.19:0/1722573295 >> [v2:172.21.15.155:6800/2011043685,v1:172.21.15.155:6801/2011043685] conn(0x7fec100acba0 0x7fec100aefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:01.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.987+0000 7fec2895e640 1 --2- 172.21.15.19:0/1722573295 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fec100a3350 0x7fec100a5810 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fec240fdce0 tx=0x7fec1400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:01.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.988+0000 7fec29960640 1 --2- 172.21.15.19:0/1722573295 >> [v2:172.21.15.155:6800/2011043685,v1:172.21.15.155:6801/2011043685] conn(0x7fec100acba0 0x7fec100aefc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:01.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:00.989+0000 7fec1a7fc640 1 -- 172.21.15.19:0/1722573295 <== osd.1 v2:172.21.15.155:6800/2011043685 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fec20040e70 con 0x7fec100acba0 2024-09-19T08:51:01.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.004+0000 7fec2b3c3640 1 -- 172.21.15.19:0/1722573295 --> [v2:172.21.15.155:6800/2011043685,v1:172.21.15.155:6801/2011043685] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fec24062d80 con 0x7fec100acba0 2024-09-19T08:51:01.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.004+0000 7fec1a7fc640 1 -- 172.21.15.19:0/1722573295 <== osd.1 v2:172.21.15.155:6800/2011043685 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fec24062d80 con 0x7fec100acba0 2024-09-19T08:51:01.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.005+0000 7fec2b3c3640 1 -- 172.21.15.19:0/1722573295 >> [v2:172.21.15.155:6800/2011043685,v1:172.21.15.155:6801/2011043685] conn(0x7fec100acba0 msgr2=0x7fec100aefc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:01.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.005+0000 7fec2b3c3640 1 --2- 172.21.15.19:0/1722573295 >> [v2:172.21.15.155:6800/2011043685,v1:172.21.15.155:6801/2011043685] conn(0x7fec100acba0 0x7fec100aefc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.005+0000 7fec2b3c3640 1 -- 172.21.15.19:0/1722573295 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fec100a3350 msgr2=0x7fec100a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:01.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.005+0000 7fec2b3c3640 1 --2- 172.21.15.19:0/1722573295 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fec100a3350 0x7fec100a5810 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fec240fdce0 tx=0x7fec1400b410 comp rx=0 tx=0).stop 2024-09-19T08:51:01.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.005+0000 7fec2b3c3640 1 -- 172.21.15.19:0/1722573295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec24101de0 msgr2=0x7fec24198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:01.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.005+0000 7fec2b3c3640 1 --2- 172.21.15.19:0/1722573295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec24101de0 0x7fec24198460 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fec20006010 tx=0x7fec200042f0 comp rx=0 tx=0).stop 2024-09-19T08:51:01.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.005+0000 7fec29960640 1 -- 172.21.15.19:0/1722573295 reap_dead start 2024-09-19T08:51:01.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.005+0000 7fec2b3c3640 1 -- 172.21.15.19:0/1722573295 shutdown_connections 2024-09-19T08:51:01.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.005+0000 7fec2b3c3640 1 -- 172.21.15.19:0/1722573295 >> 172.21.15.19:0/1722573295 conn(0x7fec240fd8c0 msgr2=0x7fec240fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:01.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.005+0000 7fec2b3c3640 1 -- 172.21.15.19:0/1722573295 shutdown_connections 2024-09-19T08:51:01.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:01.005+0000 7fec2b3c3640 1 -- 172.21.15.19:0/1722573295 wait complete. 2024-09-19T08:51:01.725 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:01 smithi155 ceph-mon[34921]: pgmap v299: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-19T08:51:01.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:01 smithi203 ceph-mon[35450]: pgmap v299: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-19T08:51:01.757 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:01 smithi019 ceph-mon[30976]: pgmap v299: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-19T08:51:02.452 INFO:teuthology.orchestra.run.smithi019.stdout:236223201318 2024-09-19T08:51:02.453 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-19T08:51:02.885 INFO:teuthology.orchestra.run.smithi019.stdout:287762808859 2024-09-19T08:51:02.886 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-19T08:51:03.674 INFO:teuthology.orchestra.run.smithi019.stdout:55834574921 2024-09-19T08:51:03.675 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-19T08:51:03.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:03 smithi203 ceph-mon[35450]: pgmap v300: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-19T08:51:03.808 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:03 smithi019 ceph-mon[30976]: pgmap v300: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-19T08:51:03.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:03 smithi155 ceph-mon[34921]: pgmap v300: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-09-19T08:51:04.156 INFO:teuthology.orchestra.run.smithi019.stdout:107374182461 2024-09-19T08:51:04.157 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-19T08:51:04.618 INFO:teuthology.orchestra.run.smithi019.stdout:34359738446 2024-09-19T08:51:04.618 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-19T08:51:04.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.267+0000 7fc8ce785640 1 -- 172.21.15.19:0/3296306557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8c8101de0 msgr2=0x7fc8c81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:04.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.267+0000 7fc8ce785640 1 --2- 172.21.15.19:0/3296306557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8c8101de0 0x7fc8c81021c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8009900 tx=0x7fc8b802a410 comp rx=0 tx=0).stop 2024-09-19T08:51:04.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.267+0000 7fc8ce785640 1 -- 172.21.15.19:0/3296306557 shutdown_connections 2024-09-19T08:51:04.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.267+0000 7fc8ce785640 1 --2- 172.21.15.19:0/3296306557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8c8106f10 0x7fc8c810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:04.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.267+0000 7fc8ce785640 1 --2- 172.21.15.19:0/3296306557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8c8102790 0x7fc8c81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:04.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.267+0000 7fc8ce785640 1 --2- 172.21.15.19:0/3296306557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8c8101de0 0x7fc8c81021c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:04.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.267+0000 7fc8ce785640 1 -- 172.21.15.19:0/3296306557 >> 172.21.15.19:0/3296306557 conn(0x7fc8c80fd8c0 msgr2=0x7fc8c80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:04.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.267+0000 7fc8ce785640 1 -- 172.21.15.19:0/3296306557 shutdown_connections 2024-09-19T08:51:04.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.267+0000 7fc8ce785640 1 -- 172.21.15.19:0/3296306557 wait complete. 2024-09-19T08:51:04.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.268+0000 7fc8ce785640 1 Processor -- start 2024-09-19T08:51:04.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.268+0000 7fc8ce785640 1 -- start start 2024-09-19T08:51:04.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.268+0000 7fc8ce785640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8c8101de0 0x7fc8c80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:04.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.268+0000 7fc8ce785640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8c8102790 0x7fc8c8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:04.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.268+0000 7fc8ce785640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8c8106f10 0x7fc8c8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:04.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.268+0000 7fc8ce785640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c8111fc0 con 0x7fc8c8102790 2024-09-19T08:51:04.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.268+0000 7fc8ce785640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c8111e40 con 0x7fc8c8106f10 2024-09-19T08:51:04.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.268+0000 7fc8ce785640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c8112140 con 0x7fc8c8101de0 2024-09-19T08:51:04.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.269+0000 7fc8c77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8c8102790 0x7fc8c8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:04.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.269+0000 7fc8c77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8c8102790 0x7fc8c8074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42892/0 (socket says 172.21.15.19:42892) 2024-09-19T08:51:04.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.269+0000 7fc8c77fe640 1 -- 172.21.15.19:0/3268370754 learned_addr learned my addr 172.21.15.19:0/3268370754 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:04.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.269+0000 7fc8c7fff640 1 --2- 172.21.15.19:0/3268370754 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8c8101de0 0x7fc8c80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:04.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.269+0000 7fc8ccd22640 1 --2- 172.21.15.19:0/3268370754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8c8106f10 0x7fc8c8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:04.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.269+0000 7fc8c77fe640 1 -- 172.21.15.19:0/3268370754 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8c8101de0 msgr2=0x7fc8c80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:04.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.269+0000 7fc8c77fe640 1 --2- 172.21.15.19:0/3268370754 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc8c8101de0 0x7fc8c80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:04.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.269+0000 7fc8c77fe640 1 -- 172.21.15.19:0/3268370754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8c8106f10 msgr2=0x7fc8c8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:04.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.269+0000 7fc8c77fe640 1 --2- 172.21.15.19:0/3268370754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8c8106f10 0x7fc8c8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:04.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.269+0000 7fc8c77fe640 1 -- 172.21.15.19:0/3268370754 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8c81a6930 con 0x7fc8c8102790 2024-09-19T08:51:04.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.269+0000 7fc8ccd22640 1 --2- 172.21.15.19:0/3268370754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc8c8106f10 0x7fc8c8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:04.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.269+0000 7fc8c77fe640 1 --2- 172.21.15.19:0/3268370754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8c8102790 0x7fc8c8074a30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc00d950 tx=0x7fc8bc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:04.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.269+0000 7fc8c57fa640 1 -- 172.21.15.19:0/3268370754 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc017070 con 0x7fc8c8102790 2024-09-19T08:51:04.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.269+0000 7fc8ce785640 1 -- 172.21.15.19:0/3268370754 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8c81a6c20 con 0x7fc8c8102790 2024-09-19T08:51:04.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.269+0000 7fc8c57fa640 1 -- 172.21.15.19:0/3268370754 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc8bc009c30 con 0x7fc8c8102790 2024-09-19T08:51:04.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.269+0000 7fc8c57fa640 1 -- 172.21.15.19:0/3268370754 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc00f6b0 con 0x7fc8c8102790 2024-09-19T08:51:04.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.269+0000 7fc8ce785640 1 -- 172.21.15.19:0/3268370754 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8c81a71b0 con 0x7fc8c8102790 2024-09-19T08:51:04.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.270+0000 7fc8ce785640 1 -- 172.21.15.19:0/3268370754 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc8c80628c0 con 0x7fc8c8102790 2024-09-19T08:51:04.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.271+0000 7fc8c57fa640 1 -- 172.21.15.19:0/3268370754 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc8bc0109d0 con 0x7fc8c8102790 2024-09-19T08:51:04.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.272+0000 7fc8c57fa640 1 --2- 172.21.15.19:0/3268370754 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc8b00a32d0 0x7fc8b00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:04.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.272+0000 7fc8c7fff640 1 --2- 172.21.15.19:0/3268370754 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc8b00a32d0 0x7fc8b00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:04.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.272+0000 7fc8c57fa640 1 -- 172.21.15.19:0/3268370754 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fc8bc0cf600 con 0x7fc8c8102790 2024-09-19T08:51:04.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.272+0000 7fc8c57fa640 1 --2- 172.21.15.19:0/3268370754 >> [v2:172.21.15.155:6808/2163087792,v1:172.21.15.155:6809/2163087792] conn(0x7fc8b00acb20 0x7fc8b00aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:04.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.272+0000 7fc8c57fa640 1 -- 172.21.15.19:0/3268370754 --> [v2:172.21.15.155:6808/2163087792,v1:172.21.15.155:6809/2163087792] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc8bc004470 con 0x7fc8b00acb20 2024-09-19T08:51:04.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.272+0000 7fc8c57fa640 1 -- 172.21.15.19:0/3268370754 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_get_version_reply(handle=1 version=80) ==== 24+0+0 (secure 0 0 0) 0x7fc8bc0d6050 con 0x7fc8c8102790 2024-09-19T08:51:04.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.273+0000 7fc8c7fff640 1 --2- 172.21.15.19:0/3268370754 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc8b00a32d0 0x7fc8b00a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8000c00 tx=0x7fc8b8005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:04.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.273+0000 7fc8ccd22640 1 --2- 172.21.15.19:0/3268370754 >> [v2:172.21.15.155:6808/2163087792,v1:172.21.15.155:6809/2163087792] conn(0x7fc8b00acb20 0x7fc8b00aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:04.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.273+0000 7fc8ccd22640 1 --2- 172.21.15.19:0/3268370754 >> [v2:172.21.15.155:6808/2163087792,v1:172.21.15.155:6809/2163087792] conn(0x7fc8b00acb20 0x7fc8b00aef40 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:04.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.274+0000 7fc8c57fa640 1 -- 172.21.15.19:0/3268370754 <== osd.4 v2:172.21.15.155:6808/2163087792 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc8bc004470 con 0x7fc8b00acb20 2024-09-19T08:51:04.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.287+0000 7fc8ce785640 1 -- 172.21.15.19:0/3268370754 --> [v2:172.21.15.155:6808/2163087792,v1:172.21.15.155:6809/2163087792] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc8c8062cf0 con 0x7fc8b00acb20 2024-09-19T08:51:04.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.288+0000 7fc8c57fa640 1 -- 172.21.15.19:0/3268370754 <== osd.4 v2:172.21.15.155:6808/2163087792 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc8c8062cf0 con 0x7fc8b00acb20 2024-09-19T08:51:04.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.288+0000 7fc8ce785640 1 -- 172.21.15.19:0/3268370754 >> [v2:172.21.15.155:6808/2163087792,v1:172.21.15.155:6809/2163087792] conn(0x7fc8b00acb20 msgr2=0x7fc8b00aef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:04.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.288+0000 7fc8ce785640 1 --2- 172.21.15.19:0/3268370754 >> [v2:172.21.15.155:6808/2163087792,v1:172.21.15.155:6809/2163087792] conn(0x7fc8b00acb20 0x7fc8b00aef40 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:04.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.288+0000 7fc8ce785640 1 -- 172.21.15.19:0/3268370754 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc8b00a32d0 msgr2=0x7fc8b00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:04.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.288+0000 7fc8ce785640 1 --2- 172.21.15.19:0/3268370754 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc8b00a32d0 0x7fc8b00a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8000c00 tx=0x7fc8b8005b50 comp rx=0 tx=0).stop 2024-09-19T08:51:04.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.288+0000 7fc8ce785640 1 -- 172.21.15.19:0/3268370754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8c8102790 msgr2=0x7fc8c8074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:04.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.288+0000 7fc8ce785640 1 --2- 172.21.15.19:0/3268370754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc8c8102790 0x7fc8c8074a30 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc00d950 tx=0x7fc8bc00de10 comp rx=0 tx=0).stop 2024-09-19T08:51:04.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.288+0000 7fc8ccd22640 1 -- 172.21.15.19:0/3268370754 reap_dead start 2024-09-19T08:51:04.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.288+0000 7fc8ce785640 1 -- 172.21.15.19:0/3268370754 shutdown_connections 2024-09-19T08:51:04.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.288+0000 7fc8ce785640 1 -- 172.21.15.19:0/3268370754 >> 172.21.15.19:0/3268370754 conn(0x7fc8c80fd8c0 msgr2=0x7fc8c80febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:04.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.289+0000 7fc8ce785640 1 -- 172.21.15.19:0/3268370754 shutdown_connections 2024-09-19T08:51:04.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:03.289+0000 7fc8ce785640 1 -- 172.21.15.19:0/3268370754 wait complete. 2024-09-19T08:51:05.402 INFO:teuthology.orchestra.run.smithi019.stdout:137438953529 2024-09-19T08:51:05.403 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-19T08:51:05.621 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:05 smithi019 ceph-mon[30976]: pgmap v301: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T08:51:05.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:05 smithi203 ceph-mon[35450]: pgmap v301: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T08:51:05.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:05 smithi155 ceph-mon[34921]: pgmap v301: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T08:51:05.966 INFO:teuthology.orchestra.run.smithi019.stdout:154618822707 2024-09-19T08:51:05.966 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-19T08:51:05.968 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:05.973 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:06.020 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:06.061 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:07.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.042+0000 7f5fe022d640 1 -- 172.21.15.19:0/2875917586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fd8103ff0 msgr2=0x7f5fd81043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:07.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.042+0000 7f5fe022d640 1 --2- 172.21.15.19:0/2875917586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fd8103ff0 0x7f5fd81043d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4009900 tx=0x7f5fd402a410 comp rx=0 tx=0).stop 2024-09-19T08:51:07.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.042+0000 7f5fe022d640 1 -- 172.21.15.19:0/2875917586 shutdown_connections 2024-09-19T08:51:07.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.042+0000 7f5fe022d640 1 --2- 172.21.15.19:0/2875917586 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5fd81049a0 0x7f5fd81089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:07.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.042+0000 7f5fe022d640 1 --2- 172.21.15.19:0/2875917586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5fd8109120 0x7f5fd8110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:07.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.042+0000 7f5fe022d640 1 --2- 172.21.15.19:0/2875917586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fd8103ff0 0x7f5fd81043d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:07.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.042+0000 7f5fe022d640 1 -- 172.21.15.19:0/2875917586 >> 172.21.15.19:0/2875917586 conn(0x7f5fd80ffab0 msgr2=0x7f5fd8101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:07.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.043+0000 7f5fe022d640 1 -- 172.21.15.19:0/2875917586 shutdown_connections 2024-09-19T08:51:07.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.043+0000 7f5fe022d640 1 -- 172.21.15.19:0/2875917586 wait complete. 2024-09-19T08:51:07.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.043+0000 7f5fe022d640 1 Processor -- start 2024-09-19T08:51:07.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.043+0000 7f5fe022d640 1 -- start start 2024-09-19T08:51:07.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.043+0000 7f5fe022d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fd8103ff0 0x7f5fd819a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:07.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.043+0000 7f5fe022d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5fd81049a0 0x7f5fd819ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:07.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.043+0000 7f5fe022d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5fd8109120 0x7f5fd819ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:07.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.043+0000 7f5fe022d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd8114140 con 0x7f5fd8103ff0 2024-09-19T08:51:07.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.043+0000 7f5fe022d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd8113fc0 con 0x7f5fd8109120 2024-09-19T08:51:07.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.043+0000 7f5fe022d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd81142c0 con 0x7f5fd81049a0 2024-09-19T08:51:07.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.043+0000 7f5fddfc9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fd8103ff0 0x7f5fd819a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:07.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.044+0000 7f5fddfc9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fd8103ff0 0x7f5fd819a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48698/0 (socket says 172.21.15.19:48698) 2024-09-19T08:51:07.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.044+0000 7f5fddfc9640 1 -- 172.21.15.19:0/4099709953 learned_addr learned my addr 172.21.15.19:0/4099709953 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:07.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.044+0000 7f5fdd7c8640 1 --2- 172.21.15.19:0/4099709953 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5fd81049a0 0x7f5fd819ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:07.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.044+0000 7f5fddfc9640 1 -- 172.21.15.19:0/4099709953 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5fd81049a0 msgr2=0x7f5fd819ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:07.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.044+0000 7f5fddfc9640 1 --2- 172.21.15.19:0/4099709953 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5fd81049a0 0x7f5fd819ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:07.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.044+0000 7f5fddfc9640 1 -- 172.21.15.19:0/4099709953 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5fd8109120 msgr2=0x7f5fd819ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:07.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.044+0000 7f5fddfc9640 1 --2- 172.21.15.19:0/4099709953 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5fd8109120 0x7f5fd819ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:07.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.044+0000 7f5fddfc9640 1 -- 172.21.15.19:0/4099709953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd819f5f0 con 0x7f5fd8103ff0 2024-09-19T08:51:07.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.044+0000 7f5fdd7c8640 1 --2- 172.21.15.19:0/4099709953 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5fd81049a0 0x7f5fd819ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:51:07.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.044+0000 7f5fddfc9640 1 --2- 172.21.15.19:0/4099709953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fd8103ff0 0x7f5fd819a640 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4006010 tx=0x7f5fd40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:07.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.044+0000 7f5fceffd640 1 -- 172.21.15.19:0/4099709953 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd403f030 con 0x7f5fd8103ff0 2024-09-19T08:51:07.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.044+0000 7f5fe022d640 1 -- 172.21.15.19:0/4099709953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fd819f880 con 0x7f5fd8103ff0 2024-09-19T08:51:07.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.044+0000 7f5fceffd640 1 -- 172.21.15.19:0/4099709953 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5fd4003ce0 con 0x7f5fd8103ff0 2024-09-19T08:51:07.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.044+0000 7f5fceffd640 1 -- 172.21.15.19:0/4099709953 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd4035070 con 0x7f5fd8103ff0 2024-09-19T08:51:07.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.044+0000 7f5fe022d640 1 -- 172.21.15.19:0/4099709953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fd81a71c0 con 0x7f5fd8103ff0 2024-09-19T08:51:07.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.045+0000 7f5fe022d640 1 -- 172.21.15.19:0/4099709953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fd81054d0 con 0x7f5fd8103ff0 2024-09-19T08:51:07.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.047+0000 7f5fceffd640 1 -- 172.21.15.19:0/4099709953 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5fd4042030 con 0x7f5fd8103ff0 2024-09-19T08:51:07.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.047+0000 7f5fceffd640 1 --2- 172.21.15.19:0/4099709953 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5fc40a32d0 0x7f5fc40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:07.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.047+0000 7f5fdd7c8640 1 --2- 172.21.15.19:0/4099709953 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5fc40a32d0 0x7f5fc40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:07.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.047+0000 7f5fceffd640 1 -- 172.21.15.19:0/4099709953 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f5fd40f0300 con 0x7f5fd8103ff0 2024-09-19T08:51:07.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.048+0000 7f5fdd7c8640 1 --2- 172.21.15.19:0/4099709953 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5fc40a32d0 0x7f5fc40a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5fd80fff40 tx=0x7f5fc8005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:07.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.050+0000 7f5fceffd640 1 -- 172.21.15.19:0/4099709953 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5fd40bd130 con 0x7f5fd8103ff0 2024-09-19T08:51:07.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.233+0000 7f5fe022d640 1 -- 172.21.15.19:0/4099709953 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f5fd810c300 con 0x7f5fd8103ff0 2024-09-19T08:51:07.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.233+0000 7f5fceffd640 1 -- 172.21.15.19:0/4099709953 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f5fd40bca30 con 0x7f5fd8103ff0 2024-09-19T08:51:07.233 INFO:teuthology.orchestra.run.smithi019.stdout:317827579928 2024-09-19T08:51:07.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.236+0000 7f5fe022d640 1 -- 172.21.15.19:0/4099709953 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5fc40a32d0 msgr2=0x7f5fc40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:07.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.236+0000 7f5fe022d640 1 --2- 172.21.15.19:0/4099709953 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5fc40a32d0 0x7f5fc40a5790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5fd80fff40 tx=0x7f5fc8005e50 comp rx=0 tx=0).stop 2024-09-19T08:51:07.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.236+0000 7f5fe022d640 1 -- 172.21.15.19:0/4099709953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fd8103ff0 msgr2=0x7f5fd819a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:07.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.236+0000 7f5fe022d640 1 --2- 172.21.15.19:0/4099709953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fd8103ff0 0x7f5fd819a640 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4006010 tx=0x7f5fd40042f0 comp rx=0 tx=0).stop 2024-09-19T08:51:07.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.236+0000 7f5fe022d640 1 -- 172.21.15.19:0/4099709953 shutdown_connections 2024-09-19T08:51:07.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.236+0000 7f5fe022d640 1 --2- 172.21.15.19:0/4099709953 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5fc40a32d0 0x7f5fc40a5790 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:07.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.236+0000 7f5fe022d640 1 --2- 172.21.15.19:0/4099709953 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5fd81049a0 0x7f5fd819ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:07.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.236+0000 7f5fe022d640 1 --2- 172.21.15.19:0/4099709953 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5fd8109120 0x7f5fd819ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:07.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.236+0000 7f5fe022d640 1 --2- 172.21.15.19:0/4099709953 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fd8103ff0 0x7f5fd819a640 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:07.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.236+0000 7f5fe022d640 1 -- 172.21.15.19:0/4099709953 >> 172.21.15.19:0/4099709953 conn(0x7f5fd80ffab0 msgr2=0x7f5fd8100e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:07.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.236+0000 7f5fe022d640 1 -- 172.21.15.19:0/4099709953 shutdown_connections 2024-09-19T08:51:07.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.236+0000 7f5fe022d640 1 -- 172.21.15.19:0/4099709953 wait complete. 2024-09-19T08:51:07.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.466+0000 7fdb5d97c640 1 -- 172.21.15.19:0/3296390377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb58102d90 msgr2=0x7fdb58103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:07.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.466+0000 7fdb5d97c640 1 --2- 172.21.15.19:0/3296390377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb58102d90 0x7fdb58103170 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fdb48009930 tx=0x7fdb4802a420 comp rx=0 tx=0).stop 2024-09-19T08:51:07.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.466+0000 7fdb5d97c640 1 -- 172.21.15.19:0/3296390377 shutdown_connections 2024-09-19T08:51:07.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.466+0000 7fdb5d97c640 1 --2- 172.21.15.19:0/3296390377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdb58103740 0x7fdb58107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:07.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.466+0000 7fdb5d97c640 1 --2- 172.21.15.19:0/3296390377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb58108290 0x7fdb5810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:07.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.466+0000 7fdb5d97c640 1 --2- 172.21.15.19:0/3296390377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb58102d90 0x7fdb58103170 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:07.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.466+0000 7fdb5d97c640 1 -- 172.21.15.19:0/3296390377 >> 172.21.15.19:0/3296390377 conn(0x7fdb580fc7d0 msgr2=0x7fdb580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:07.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.467+0000 7fdb5d97c640 1 -- 172.21.15.19:0/3296390377 shutdown_connections 2024-09-19T08:51:07.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.467+0000 7fdb5d97c640 1 -- 172.21.15.19:0/3296390377 wait complete. 2024-09-19T08:51:07.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.467+0000 7fdb5d97c640 1 Processor -- start 2024-09-19T08:51:07.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.467+0000 7fdb5d97c640 1 -- start start 2024-09-19T08:51:07.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.468+0000 7fdb5d97c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdb58102d90 0x7fdb58198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:07.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.468+0000 7fdb5d97c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb58103740 0x7fdb58198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:07.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.468+0000 7fdb5d97c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb58108290 0x7fdb5819ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:07.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.468+0000 7fdb5d97c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdb58112090 con 0x7fdb58108290 2024-09-19T08:51:07.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.468+0000 7fdb5d97c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdb58111f10 con 0x7fdb58103740 2024-09-19T08:51:07.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.468+0000 7fdb5d97c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdb58112210 con 0x7fdb58102d90 2024-09-19T08:51:07.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.468+0000 7fdb577fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb58108290 0x7fdb5819ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:07.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.468+0000 7fdb577fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb58108290 0x7fdb5819ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48722/0 (socket says 172.21.15.19:48722) 2024-09-19T08:51:07.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.468+0000 7fdb577fe640 1 -- 172.21.15.19:0/1298056787 learned_addr learned my addr 172.21.15.19:0/1298056787 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:07.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.468+0000 7fdb56ffd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdb58102d90 0x7fdb58198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:07.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.468+0000 7fdb4e7fc640 1 --2- 172.21.15.19:0/1298056787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb58103740 0x7fdb58198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:07.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.468+0000 7fdb577fe640 1 -- 172.21.15.19:0/1298056787 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdb58102d90 msgr2=0x7fdb58198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:07.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.468+0000 7fdb577fe640 1 --2- 172.21.15.19:0/1298056787 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdb58102d90 0x7fdb58198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:07.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.468+0000 7fdb577fe640 1 -- 172.21.15.19:0/1298056787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb58103740 msgr2=0x7fdb58198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:07.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.468+0000 7fdb577fe640 1 --2- 172.21.15.19:0/1298056787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb58103740 0x7fdb58198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:07.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.468+0000 7fdb577fe640 1 -- 172.21.15.19:0/1298056787 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb5819d520 con 0x7fdb58108290 2024-09-19T08:51:07.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.469+0000 7fdb577fe640 1 --2- 172.21.15.19:0/1298056787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb58108290 0x7fdb5819ce40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdb5000cce0 tx=0x7fdb5000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:07.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.469+0000 7fdb5c97a640 1 -- 172.21.15.19:0/1298056787 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5000f450 con 0x7fdb58108290 2024-09-19T08:51:07.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.469+0000 7fdb5c97a640 1 -- 172.21.15.19:0/1298056787 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdb5000fad0 con 0x7fdb58108290 2024-09-19T08:51:07.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.469+0000 7fdb5d97c640 1 -- 172.21.15.19:0/1298056787 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb5819d810 con 0x7fdb58108290 2024-09-19T08:51:07.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.469+0000 7fdb5c97a640 1 -- 172.21.15.19:0/1298056787 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb50018c10 con 0x7fdb58108290 2024-09-19T08:51:07.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.469+0000 7fdb5d97c640 1 -- 172.21.15.19:0/1298056787 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb58100920 con 0x7fdb58108290 2024-09-19T08:51:07.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.470+0000 7fdb5d97c640 1 -- 172.21.15.19:0/1298056787 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb5806a7f0 con 0x7fdb58108290 2024-09-19T08:51:07.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.471+0000 7fdb5c97a640 1 -- 172.21.15.19:0/1298056787 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fdb5000f5f0 con 0x7fdb58108290 2024-09-19T08:51:07.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.472+0000 7fdb5c97a640 1 --2- 172.21.15.19:0/1298056787 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fdb440a32d0 0x7fdb440a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:07.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.472+0000 7fdb56ffd640 1 --2- 172.21.15.19:0/1298056787 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fdb440a32d0 0x7fdb440a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:07.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.472+0000 7fdb5c97a640 1 -- 172.21.15.19:0/1298056787 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fdb500cfe70 con 0x7fdb58108290 2024-09-19T08:51:07.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.473+0000 7fdb56ffd640 1 --2- 172.21.15.19:0/1298056787 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fdb440a32d0 0x7fdb440a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdb48009900 tx=0x7fdb480058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:07.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.480+0000 7fdb5c97a640 1 -- 172.21.15.19:0/1298056787 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdb50014030 con 0x7fdb58108290 2024-09-19T08:51:07.496 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:07 smithi019 ceph-mon[30976]: pgmap v302: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T08:51:07.496 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:07 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/4099709953' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T08:51:07.509 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:07.509 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:07.511 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:07.511 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:07.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.691+0000 7fdb5d97c640 1 -- 172.21.15.19:0/1298056787 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fdb5810a2a0 con 0x7fdb58108290 2024-09-19T08:51:07.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.691+0000 7fdb5c97a640 1 -- 172.21.15.19:0/1298056787 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fdb5009cbe0 con 0x7fdb58108290 2024-09-19T08:51:07.691 INFO:teuthology.orchestra.run.smithi019.stdout:266287972386 2024-09-19T08:51:07.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.693+0000 7fdb5d97c640 1 -- 172.21.15.19:0/1298056787 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fdb440a32d0 msgr2=0x7fdb440a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:07.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.693+0000 7fdb5d97c640 1 --2- 172.21.15.19:0/1298056787 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fdb440a32d0 0x7fdb440a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdb48009900 tx=0x7fdb480058d0 comp rx=0 tx=0).stop 2024-09-19T08:51:07.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.693+0000 7fdb5d97c640 1 -- 172.21.15.19:0/1298056787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb58108290 msgr2=0x7fdb5819ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:07.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.693+0000 7fdb5d97c640 1 --2- 172.21.15.19:0/1298056787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb58108290 0x7fdb5819ce40 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdb5000cce0 tx=0x7fdb5000a620 comp rx=0 tx=0).stop 2024-09-19T08:51:07.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.693+0000 7fdb5d97c640 1 -- 172.21.15.19:0/1298056787 shutdown_connections 2024-09-19T08:51:07.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.693+0000 7fdb5d97c640 1 --2- 172.21.15.19:0/1298056787 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fdb440a32d0 0x7fdb440a5790 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:07.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.693+0000 7fdb5d97c640 1 --2- 172.21.15.19:0/1298056787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdb58108290 0x7fdb5819ce40 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:07.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.693+0000 7fdb5d97c640 1 --2- 172.21.15.19:0/1298056787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdb58103740 0x7fdb58198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:07.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.693+0000 7fdb5d97c640 1 --2- 172.21.15.19:0/1298056787 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdb58102d90 0x7fdb58198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:07.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.693+0000 7fdb5d97c640 1 -- 172.21.15.19:0/1298056787 >> 172.21.15.19:0/1298056787 conn(0x7fdb580fc7d0 msgr2=0x7fdb58105d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:07.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.693+0000 7fdb5d97c640 1 -- 172.21.15.19:0/1298056787 shutdown_connections 2024-09-19T08:51:07.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.693+0000 7fdb5d97c640 1 -- 172.21.15.19:0/1298056787 wait complete. 2024-09-19T08:51:07.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.357+0000 7f5da9d44640 1 -- 172.21.15.19:0/1320587891 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5da4102790 msgr2=0x7f5da41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:07.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.357+0000 7f5da9d44640 1 --2- 172.21.15.19:0/1320587891 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5da4102790 0x7f5da41067e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c009900 tx=0x7f5d8c02a410 comp rx=0 tx=0).stop 2024-09-19T08:51:07.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.357+0000 7f5da9d44640 1 -- 172.21.15.19:0/1320587891 shutdown_connections 2024-09-19T08:51:07.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.357+0000 7f5da9d44640 1 --2- 172.21.15.19:0/1320587891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5da4106f10 0x7f5da410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:07.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.357+0000 7f5da9d44640 1 --2- 172.21.15.19:0/1320587891 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5da4102790 0x7f5da41067e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:07.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.357+0000 7f5da9d44640 1 --2- 172.21.15.19:0/1320587891 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5da4101de0 0x7f5da41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:07.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.357+0000 7f5da9d44640 1 -- 172.21.15.19:0/1320587891 >> 172.21.15.19:0/1320587891 conn(0x7f5da40fd8c0 msgr2=0x7f5da40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:07.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.357+0000 7f5da9d44640 1 -- 172.21.15.19:0/1320587891 shutdown_connections 2024-09-19T08:51:07.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.357+0000 7f5da9d44640 1 -- 172.21.15.19:0/1320587891 wait complete. 2024-09-19T08:51:07.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.358+0000 7f5da9d44640 1 Processor -- start 2024-09-19T08:51:07.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.358+0000 7f5da9d44640 1 -- start start 2024-09-19T08:51:07.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.358+0000 7f5da9d44640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5da4101de0 0x7f5da4198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:07.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.358+0000 7f5da9d44640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5da4102790 0x7f5da4198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:07.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.358+0000 7f5da9d44640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5da4106f10 0x7f5da419cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:07.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.358+0000 7f5da9d44640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5da4111fe0 con 0x7f5da4101de0 2024-09-19T08:51:07.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.358+0000 7f5da9d44640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5da4111e60 con 0x7f5da4106f10 2024-09-19T08:51:07.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.358+0000 7f5da9d44640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5da4112160 con 0x7f5da4102790 2024-09-19T08:51:07.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.358+0000 7f5da37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5da4101de0 0x7f5da4198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:07.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.359+0000 7f5da37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5da4101de0 0x7f5da4198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48706/0 (socket says 172.21.15.19:48706) 2024-09-19T08:51:07.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.359+0000 7f5da37fe640 1 -- 172.21.15.19:0/1142106088 learned_addr learned my addr 172.21.15.19:0/1142106088 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:07.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.359+0000 7f5da2ffd640 1 --2- 172.21.15.19:0/1142106088 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5da4102790 0x7f5da4198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:07.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.359+0000 7f5da3fff640 1 --2- 172.21.15.19:0/1142106088 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5da4106f10 0x7f5da419cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:07.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.359+0000 7f5da37fe640 1 -- 172.21.15.19:0/1142106088 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5da4102790 msgr2=0x7f5da4198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:07.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.359+0000 7f5da37fe640 1 --2- 172.21.15.19:0/1142106088 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5da4102790 0x7f5da4198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:07.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.359+0000 7f5da37fe640 1 -- 172.21.15.19:0/1142106088 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5da4106f10 msgr2=0x7f5da419cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:07.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.359+0000 7f5da37fe640 1 --2- 172.21.15.19:0/1142106088 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5da4106f10 0x7f5da419cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:07.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.359+0000 7f5da37fe640 1 -- 172.21.15.19:0/1142106088 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5da419d4d0 con 0x7f5da4101de0 2024-09-19T08:51:07.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.359+0000 7f5da3fff640 1 --2- 172.21.15.19:0/1142106088 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5da4106f10 0x7f5da419cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:51:07.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.359+0000 7f5da37fe640 1 --2- 172.21.15.19:0/1142106088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5da4101de0 0x7f5da4198520 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5d9400b4a0 tx=0x7f5d9400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:07.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.359+0000 7f5da0ff9640 1 -- 172.21.15.19:0/1142106088 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d94014070 con 0x7f5da4101de0 2024-09-19T08:51:07.704 INFO:teuthology.orchestra.run.smithi019.stdout:206158430252 2024-09-19T08:51:07.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.359+0000 7f5da9d44640 1 -- 172.21.15.19:0/1142106088 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5da419d7c0 con 0x7f5da4101de0 2024-09-19T08:51:07.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.359+0000 7f5da0ff9640 1 -- 172.21.15.19:0/1142106088 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d94010af0 con 0x7f5da4101de0 2024-09-19T08:51:07.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.359+0000 7f5da0ff9640 1 -- 172.21.15.19:0/1142106088 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d94017d10 con 0x7f5da4101de0 2024-09-19T08:51:07.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.359+0000 7f5da9d44640 1 -- 172.21.15.19:0/1142106088 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5da41a50a0 con 0x7f5da4101de0 2024-09-19T08:51:07.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.360+0000 7f5da9d44640 1 -- 172.21.15.19:0/1142106088 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5da41021c0 con 0x7f5da4101de0 2024-09-19T08:51:07.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.362+0000 7f5da0ff9640 1 -- 172.21.15.19:0/1142106088 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5d94017070 con 0x7f5da4101de0 2024-09-19T08:51:07.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.362+0000 7f5da0ff9640 1 --2- 172.21.15.19:0/1142106088 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5d900a32d0 0x7f5d900a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.363+0000 7f5da2ffd640 1 --2- 172.21.15.19:0/1142106088 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5d900a32d0 0x7f5d900a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.363+0000 7f5da0ff9640 1 -- 172.21.15.19:0/1142106088 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f5d940cf170 con 0x7f5da4101de0 2024-09-19T08:51:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.363+0000 7f5da2ffd640 1 --2- 172.21.15.19:0/1142106088 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5d900a32d0 0x7f5d900a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c000c00 tx=0x7f5d8c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.365+0000 7f5da0ff9640 1 -- 172.21.15.19:0/1142106088 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5d9409bef0 con 0x7f5da4101de0 2024-09-19T08:51:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.564+0000 7f5da9d44640 1 -- 172.21.15.19:0/1142106088 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f5da4199880 con 0x7f5da4101de0 2024-09-19T08:51:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.564+0000 7f5da0ff9640 1 -- 172.21.15.19:0/1142106088 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f5d9409b7f0 con 0x7f5da4101de0 2024-09-19T08:51:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.568+0000 7f5da9d44640 1 -- 172.21.15.19:0/1142106088 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5d900a32d0 msgr2=0x7f5d900a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.568+0000 7f5da9d44640 1 --2- 172.21.15.19:0/1142106088 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5d900a32d0 0x7f5d900a5790 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c000c00 tx=0x7f5d8c005a20 comp rx=0 tx=0).stop 2024-09-19T08:51:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.568+0000 7f5da9d44640 1 -- 172.21.15.19:0/1142106088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5da4101de0 msgr2=0x7f5da4198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.568+0000 7f5da9d44640 1 --2- 172.21.15.19:0/1142106088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5da4101de0 0x7f5da4198520 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5d9400b4a0 tx=0x7f5d9400b960 comp rx=0 tx=0).stop 2024-09-19T08:51:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.568+0000 7f5da9d44640 1 -- 172.21.15.19:0/1142106088 shutdown_connections 2024-09-19T08:51:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.568+0000 7f5da9d44640 1 --2- 172.21.15.19:0/1142106088 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5d900a32d0 0x7f5d900a5790 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.568+0000 7f5da9d44640 1 --2- 172.21.15.19:0/1142106088 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5da4102790 0x7f5da4198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:07.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.568+0000 7f5da9d44640 1 --2- 172.21.15.19:0/1142106088 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5da4106f10 0x7f5da419cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:07.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.568+0000 7f5da9d44640 1 --2- 172.21.15.19:0/1142106088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5da4101de0 0x7f5da4198520 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:07.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.568+0000 7f5da9d44640 1 -- 172.21.15.19:0/1142106088 >> 172.21.15.19:0/1142106088 conn(0x7f5da40fd8c0 msgr2=0x7f5da40fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:07.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.568+0000 7f5da9d44640 1 -- 172.21.15.19:0/1142106088 shutdown_connections 2024-09-19T08:51:07.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:07.568+0000 7f5da9d44640 1 -- 172.21.15.19:0/1142106088 wait complete. 2024-09-19T08:51:07.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:07 smithi203 ceph-mon[35450]: pgmap v302: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T08:51:07.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:07 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/4099709953' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T08:51:07.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:07 smithi155 ceph-mon[34921]: pgmap v302: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T08:51:07.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:07 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/4099709953' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T08:51:08.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:08 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1142106088' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T08:51:08.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:08 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1298056787' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T08:51:08.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:08 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1142106088' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T08:51:08.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:08 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1298056787' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T08:51:08.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:08 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1142106088' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T08:51:08.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:08 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1298056787' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T08:51:09.167 INFO:tasks.cephadm.ceph_manager.ceph:need seq 317827579925 got 317827579928 for osd.11 2024-09-19T08:51:09.167 DEBUG:teuthology.parallel:result is None 2024-09-19T08:51:09.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.336+0000 7f3a9a34e640 1 -- 172.21.15.19:0/4269901852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a94102d90 msgr2=0x7f3a94103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:09.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.336+0000 7f3a9a34e640 1 --2- 172.21.15.19:0/4269901852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a94102d90 0x7f3a94103170 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3a84009930 tx=0x7f3a8402a420 comp rx=0 tx=0).stop 2024-09-19T08:51:09.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.336+0000 7f3a9a34e640 1 -- 172.21.15.19:0/4269901852 shutdown_connections 2024-09-19T08:51:09.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.336+0000 7f3a9a34e640 1 --2- 172.21.15.19:0/4269901852 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a94108290 0x7f3a9410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:09.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.336+0000 7f3a9a34e640 1 --2- 172.21.15.19:0/4269901852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a94103740 0x7f3a94107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:09.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.336+0000 7f3a9a34e640 1 --2- 172.21.15.19:0/4269901852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a94102d90 0x7f3a94103170 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:09.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.336+0000 7f3a9a34e640 1 -- 172.21.15.19:0/4269901852 >> 172.21.15.19:0/4269901852 conn(0x7f3a940fc7d0 msgr2=0x7f3a940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:09.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.336+0000 7f3a9a34e640 1 -- 172.21.15.19:0/4269901852 shutdown_connections 2024-09-19T08:51:09.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.336+0000 7f3a9a34e640 1 -- 172.21.15.19:0/4269901852 wait complete. 2024-09-19T08:51:09.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.337+0000 7f3a9a34e640 1 Processor -- start 2024-09-19T08:51:09.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.337+0000 7f3a9a34e640 1 -- start start 2024-09-19T08:51:09.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.337+0000 7f3a9a34e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a94102d90 0x7f3a94198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:09.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.337+0000 7f3a9a34e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a94103740 0x7f3a94198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:09.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.337+0000 7f3a9a34e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a94108290 0x7f3a9419cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:09.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.337+0000 7f3a9a34e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3a941120d0 con 0x7f3a94102d90 2024-09-19T08:51:09.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.337+0000 7f3a9a34e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3a94111f50 con 0x7f3a94103740 2024-09-19T08:51:09.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.337+0000 7f3a9a34e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3a94112250 con 0x7f3a94108290 2024-09-19T08:51:09.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.337+0000 7f3a93fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a94102d90 0x7f3a94198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:09.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.337+0000 7f3a93fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a94102d90 0x7f3a94198650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48740/0 (socket says 172.21.15.19:48740) 2024-09-19T08:51:09.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.337+0000 7f3a93fff640 1 -- 172.21.15.19:0/3337973894 learned_addr learned my addr 172.21.15.19:0/3337973894 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:09.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.338+0000 7f3a8bfff640 1 --2- 172.21.15.19:0/3337973894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a94103740 0x7f3a94198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:09.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.338+0000 7f3a988eb640 1 --2- 172.21.15.19:0/3337973894 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a94108290 0x7f3a9419cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:09.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.338+0000 7f3a93fff640 1 -- 172.21.15.19:0/3337973894 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a94108290 msgr2=0x7f3a9419cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:09.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.338+0000 7f3a93fff640 1 --2- 172.21.15.19:0/3337973894 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a94108290 0x7f3a9419cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:09.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.338+0000 7f3a93fff640 1 -- 172.21.15.19:0/3337973894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a94103740 msgr2=0x7f3a94198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:09.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.338+0000 7f3a93fff640 1 --2- 172.21.15.19:0/3337973894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a94103740 0x7f3a94198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:09.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.338+0000 7f3a93fff640 1 -- 172.21.15.19:0/3337973894 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a9419d600 con 0x7f3a94102d90 2024-09-19T08:51:09.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.338+0000 7f3a93fff640 1 --2- 172.21.15.19:0/3337973894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a94102d90 0x7f3a94198650 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3a84009a50 tx=0x7f3a84004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:09.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.338+0000 7f3a91ffb640 1 -- 172.21.15.19:0/3337973894 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a8403f030 con 0x7f3a94102d90 2024-09-19T08:51:09.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.338+0000 7f3a91ffb640 1 -- 172.21.15.19:0/3337973894 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a84003ad0 con 0x7f3a94102d90 2024-09-19T08:51:09.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.338+0000 7f3a9a34e640 1 -- 172.21.15.19:0/3337973894 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a9419d890 con 0x7f3a94102d90 2024-09-19T08:51:09.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.338+0000 7f3a91ffb640 1 -- 172.21.15.19:0/3337973894 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a84035070 con 0x7f3a94102d90 2024-09-19T08:51:09.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.338+0000 7f3a9a34e640 1 -- 172.21.15.19:0/3337973894 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a941a51d0 con 0x7f3a94102d90 2024-09-19T08:51:09.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.339+0000 7f3a9a34e640 1 -- 172.21.15.19:0/3337973894 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a9406a7f0 con 0x7f3a94102d90 2024-09-19T08:51:09.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.341+0000 7f3a91ffb640 1 -- 172.21.15.19:0/3337973894 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3a84042030 con 0x7f3a94102d90 2024-09-19T08:51:09.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.342+0000 7f3a91ffb640 1 --2- 172.21.15.19:0/3337973894 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3a800a32d0 0x7f3a800a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:09.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.342+0000 7f3a8bfff640 1 --2- 172.21.15.19:0/3337973894 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3a800a32d0 0x7f3a800a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:09.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.342+0000 7f3a91ffb640 1 -- 172.21.15.19:0/3337973894 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f3a840f00d0 con 0x7f3a94102d90 2024-09-19T08:51:09.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.342+0000 7f3a8bfff640 1 --2- 172.21.15.19:0/3337973894 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3a800a32d0 0x7f3a800a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3a940feeb0 tx=0x7f3a7c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:09.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.346+0000 7f3a91ffb640 1 -- 172.21.15.19:0/3337973894 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3a840bce40 con 0x7f3a94102d90 2024-09-19T08:51:09.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.525+0000 7f3a9a34e640 1 -- 172.21.15.19:0/3337973894 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f3a941999b0 con 0x7f3a94102d90 2024-09-19T08:51:09.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.525+0000 7f3a91ffb640 1 -- 172.21.15.19:0/3337973894 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f3a840bc740 con 0x7f3a94102d90 2024-09-19T08:51:09.525 INFO:teuthology.orchestra.run.smithi019.stdout:236223201320 2024-09-19T08:51:09.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.527+0000 7f3a9a34e640 1 -- 172.21.15.19:0/3337973894 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3a800a32d0 msgr2=0x7f3a800a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:09.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.527+0000 7f3a9a34e640 1 --2- 172.21.15.19:0/3337973894 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3a800a32d0 0x7f3a800a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3a940feeb0 tx=0x7f3a7c009110 comp rx=0 tx=0).stop 2024-09-19T08:51:09.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.527+0000 7f3a9a34e640 1 -- 172.21.15.19:0/3337973894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a94102d90 msgr2=0x7f3a94198650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:09.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.527+0000 7f3a9a34e640 1 --2- 172.21.15.19:0/3337973894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a94102d90 0x7f3a94198650 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3a84009a50 tx=0x7f3a84004270 comp rx=0 tx=0).stop 2024-09-19T08:51:09.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.527+0000 7f3a9a34e640 1 -- 172.21.15.19:0/3337973894 shutdown_connections 2024-09-19T08:51:09.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.527+0000 7f3a9a34e640 1 --2- 172.21.15.19:0/3337973894 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3a800a32d0 0x7f3a800a5790 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:09.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.527+0000 7f3a9a34e640 1 --2- 172.21.15.19:0/3337973894 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a94108290 0x7f3a9419cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:09.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.527+0000 7f3a9a34e640 1 --2- 172.21.15.19:0/3337973894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a94103740 0x7f3a94198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:09.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.527+0000 7f3a9a34e640 1 --2- 172.21.15.19:0/3337973894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a94102d90 0x7f3a94198650 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:09.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.527+0000 7f3a9a34e640 1 -- 172.21.15.19:0/3337973894 >> 172.21.15.19:0/3337973894 conn(0x7f3a940fc7d0 msgr2=0x7f3a94105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:09.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.527+0000 7f3a9a34e640 1 -- 172.21.15.19:0/3337973894 shutdown_connections 2024-09-19T08:51:09.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:09.527+0000 7f3a9a34e640 1 -- 172.21.15.19:0/3337973894 wait complete. 2024-09-19T08:51:09.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:09 smithi019 ceph-mon[30976]: pgmap v303: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-19T08:51:09.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:09 smithi155 ceph-mon[34921]: pgmap v303: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-19T08:51:09.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:09 smithi203 ceph-mon[35450]: pgmap v303: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8 op/s 2024-09-19T08:51:10.272 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:10.300 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201318 got 236223201320 for osd.8 2024-09-19T08:51:10.300 DEBUG:teuthology.parallel:result is None 2024-09-19T08:51:10.517 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:10 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3337973894' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T08:51:10.518 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:10 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:51:10.783 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:10 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3337973894' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T08:51:10.784 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:10 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:51:10.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:10 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3337973894' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T08:51:10.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:10 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:51:11.035 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430249 got 206158430252 for osd.7 2024-09-19T08:51:11.035 DEBUG:teuthology.parallel:result is None 2024-09-19T08:51:11.511 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:11 smithi019 ceph-mon[30976]: pgmap v304: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-19T08:51:11.511 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:11 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:51:11.512 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:11 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:51:11.512 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:11 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:51:11.512 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:11 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:51:11.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.832+0000 7f02f8cdf640 1 -- 172.21.15.19:0/3748569230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02f4101de0 msgr2=0x7f02f41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:11.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.832+0000 7f02f8cdf640 1 --2- 172.21.15.19:0/3748569230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02f4101de0 0x7f02f41021c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f02e4009900 tx=0x7f02e402a410 comp rx=0 tx=0).stop 2024-09-19T08:51:11.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.832+0000 7f02f8cdf640 1 -- 172.21.15.19:0/3748569230 shutdown_connections 2024-09-19T08:51:11.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.832+0000 7f02f8cdf640 1 --2- 172.21.15.19:0/3748569230 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02f4106f10 0x7f02f410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:11.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.832+0000 7f02f8cdf640 1 --2- 172.21.15.19:0/3748569230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02f4102790 0x7f02f41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:11.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.832+0000 7f02f8cdf640 1 --2- 172.21.15.19:0/3748569230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02f4101de0 0x7f02f41021c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:11.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.832+0000 7f02f8cdf640 1 -- 172.21.15.19:0/3748569230 >> 172.21.15.19:0/3748569230 conn(0x7f02f40fd8e0 msgr2=0x7f02f40ffd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:11.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.832+0000 7f02f8cdf640 1 -- 172.21.15.19:0/3748569230 shutdown_connections 2024-09-19T08:51:11.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.832+0000 7f02f8cdf640 1 -- 172.21.15.19:0/3748569230 wait complete. 2024-09-19T08:51:11.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.832+0000 7f02f8cdf640 1 Processor -- start 2024-09-19T08:51:11.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.833+0000 7f02f8cdf640 1 -- start start 2024-09-19T08:51:11.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.833+0000 7f02f8cdf640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02f4101de0 0x7f02f4198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:11.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.833+0000 7f02f8cdf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02f4102790 0x7f02f4198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:11.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.833+0000 7f02f8cdf640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02f4106f10 0x7f02f419cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:11.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.833+0000 7f02f8cdf640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f02f4111f70 con 0x7f02f4102790 2024-09-19T08:51:11.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.833+0000 7f02f8cdf640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f02f4111df0 con 0x7f02f4101de0 2024-09-19T08:51:11.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.833+0000 7f02f8cdf640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f02f41120f0 con 0x7f02f4106f10 2024-09-19T08:51:11.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.833+0000 7f02f1d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02f4102790 0x7f02f4198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:11.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.833+0000 7f02f1d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02f4102790 0x7f02f4198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48780/0 (socket says 172.21.15.19:48780) 2024-09-19T08:51:11.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.833+0000 7f02f1d9b640 1 -- 172.21.15.19:0/3254082757 learned_addr learned my addr 172.21.15.19:0/3254082757 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:11.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.833+0000 7f02f259c640 1 --2- 172.21.15.19:0/3254082757 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02f4101de0 0x7f02f4198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:11.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.833+0000 7f02f2d9d640 1 --2- 172.21.15.19:0/3254082757 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02f4106f10 0x7f02f419cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:11.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.833+0000 7f02f1d9b640 1 -- 172.21.15.19:0/3254082757 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02f4106f10 msgr2=0x7f02f419cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:11.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.833+0000 7f02f1d9b640 1 --2- 172.21.15.19:0/3254082757 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02f4106f10 0x7f02f419cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:11.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.833+0000 7f02f1d9b640 1 -- 172.21.15.19:0/3254082757 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02f4101de0 msgr2=0x7f02f4198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:11.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.833+0000 7f02f1d9b640 1 --2- 172.21.15.19:0/3254082757 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02f4101de0 0x7f02f4198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:11.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.833+0000 7f02f1d9b640 1 -- 172.21.15.19:0/3254082757 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f419d3c0 con 0x7f02f4102790 2024-09-19T08:51:11.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.834+0000 7f02f1d9b640 1 --2- 172.21.15.19:0/3254082757 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02f4102790 0x7f02f4198950 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f02e800e9f0 tx=0x7f02e800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:11.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.834+0000 7f02e37fe640 1 -- 172.21.15.19:0/3254082757 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e800cd80 con 0x7f02f4102790 2024-09-19T08:51:11.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.834+0000 7f02e37fe640 1 -- 172.21.15.19:0/3254082757 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02e8010910 con 0x7f02f4102790 2024-09-19T08:51:11.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.834+0000 7f02f8cdf640 1 -- 172.21.15.19:0/3254082757 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02f419d6b0 con 0x7f02f4102790 2024-09-19T08:51:11.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.834+0000 7f02e37fe640 1 -- 172.21.15.19:0/3254082757 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e8018990 con 0x7f02f4102790 2024-09-19T08:51:11.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.834+0000 7f02f8cdf640 1 -- 172.21.15.19:0/3254082757 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02f41a4f90 con 0x7f02f4102790 2024-09-19T08:51:11.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.835+0000 7f02f8cdf640 1 -- 172.21.15.19:0/3254082757 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02f41021c0 con 0x7f02f4102790 2024-09-19T08:51:11.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.836+0000 7f02e37fe640 1 -- 172.21.15.19:0/3254082757 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f02e8010ac0 con 0x7f02f4102790 2024-09-19T08:51:11.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.837+0000 7f02e37fe640 1 --2- 172.21.15.19:0/3254082757 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f02dc0a32d0 0x7f02dc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:11.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.837+0000 7f02f259c640 1 --2- 172.21.15.19:0/3254082757 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f02dc0a32d0 0x7f02dc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:11.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.837+0000 7f02e37fe640 1 -- 172.21.15.19:0/3254082757 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f02e80cfc20 con 0x7f02f4102790 2024-09-19T08:51:11.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.837+0000 7f02f259c640 1 --2- 172.21.15.19:0/3254082757 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f02dc0a32d0 0x7f02dc0a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f02e4009230 tx=0x7f02e40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:11.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.841+0000 7f02e37fe640 1 -- 172.21.15.19:0/3254082757 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f02e809c340 con 0x7f02f4102790 2024-09-19T08:51:11.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:11 smithi155 ceph-mon[34921]: pgmap v304: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-19T08:51:11.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:11 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:51:11.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:11 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:51:11.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:11 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:51:11.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:11 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:51:11.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:11 smithi203 ceph-mon[35450]: pgmap v304: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-19T08:51:11.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:11 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:51:11.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:11 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:51:11.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:11 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:51:11.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:11 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:51:12.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.029+0000 7f02f8cdf640 1 -- 172.21.15.19:0/3254082757 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f02f410a150 con 0x7f02f4102790 2024-09-19T08:51:12.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.029+0000 7f02e37fe640 1 -- 172.21.15.19:0/3254082757 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f02e80a0640 con 0x7f02f4102790 2024-09-19T08:51:12.029 INFO:teuthology.orchestra.run.smithi019.stdout:55834574923 2024-09-19T08:51:12.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.032+0000 7f02f8cdf640 1 -- 172.21.15.19:0/3254082757 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f02dc0a32d0 msgr2=0x7f02dc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:12.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.032+0000 7f02f8cdf640 1 --2- 172.21.15.19:0/3254082757 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f02dc0a32d0 0x7f02dc0a5790 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f02e4009230 tx=0x7f02e40058d0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.032+0000 7f02f8cdf640 1 -- 172.21.15.19:0/3254082757 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02f4102790 msgr2=0x7f02f4198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:12.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.032+0000 7f02f8cdf640 1 --2- 172.21.15.19:0/3254082757 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02f4102790 0x7f02f4198950 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f02e800e9f0 tx=0x7f02e800eeb0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.032+0000 7f02f8cdf640 1 -- 172.21.15.19:0/3254082757 shutdown_connections 2024-09-19T08:51:12.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.032+0000 7f02f8cdf640 1 --2- 172.21.15.19:0/3254082757 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f02dc0a32d0 0x7f02dc0a5790 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.032+0000 7f02f8cdf640 1 --2- 172.21.15.19:0/3254082757 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02f4106f10 0x7f02f419cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.032+0000 7f02f8cdf640 1 --2- 172.21.15.19:0/3254082757 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02f4102790 0x7f02f4198950 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.032+0000 7f02f8cdf640 1 --2- 172.21.15.19:0/3254082757 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02f4101de0 0x7f02f4198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.032+0000 7f02f8cdf640 1 -- 172.21.15.19:0/3254082757 >> 172.21.15.19:0/3254082757 conn(0x7f02f40fd8e0 msgr2=0x7f02f40fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:12.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.033+0000 7f02f8cdf640 1 -- 172.21.15.19:0/3254082757 shutdown_connections 2024-09-19T08:51:12.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.033+0000 7f02f8cdf640 1 -- 172.21.15.19:0/3254082757 wait complete. 2024-09-19T08:51:12.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.101+0000 7f2538bf9640 1 -- 172.21.15.19:0/673177315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2534102df0 msgr2=0x7f25341031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:12.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.101+0000 7f2538bf9640 1 --2- 172.21.15.19:0/673177315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2534102df0 0x7f25341031d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2524009900 tx=0x7f252402a410 comp rx=0 tx=0).stop 2024-09-19T08:51:12.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.101+0000 7f2538bf9640 1 -- 172.21.15.19:0/673177315 shutdown_connections 2024-09-19T08:51:12.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.101+0000 7f2538bf9640 1 --2- 172.21.15.19:0/673177315 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f25341037a0 0x7f253410bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.101+0000 7f2538bf9640 1 --2- 172.21.15.19:0/673177315 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f253410c2f0 0x7f253410e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.101+0000 7f2538bf9640 1 --2- 172.21.15.19:0/673177315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2534102df0 0x7f25341031d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.101+0000 7f2538bf9640 1 -- 172.21.15.19:0/673177315 >> 172.21.15.19:0/673177315 conn(0x7f25340fc7d0 msgr2=0x7f25340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:12.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.101+0000 7f2538bf9640 1 -- 172.21.15.19:0/673177315 shutdown_connections 2024-09-19T08:51:12.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.101+0000 7f2538bf9640 1 -- 172.21.15.19:0/673177315 wait complete. 2024-09-19T08:51:12.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.102+0000 7f2538bf9640 1 Processor -- start 2024-09-19T08:51:12.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.102+0000 7f2538bf9640 1 -- start start 2024-09-19T08:51:12.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.102+0000 7f2538bf9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2534102df0 0x7f25341986a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:12.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.102+0000 7f2538bf9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25341037a0 0x7f2534198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:12.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.102+0000 7f2538bf9640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f253410c2f0 0x7f253419cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:12.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.102+0000 7f2538bf9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2534112110 con 0x7f25341037a0 2024-09-19T08:51:12.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.102+0000 7f2538bf9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2534111f90 con 0x7f2534102df0 2024-09-19T08:51:12.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.102+0000 7f2538bf9640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2534112290 con 0x7f253410c2f0 2024-09-19T08:51:12.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.102+0000 7f2531d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25341037a0 0x7f2534198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:12.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.102+0000 7f2531d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25341037a0 0x7f2534198be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48802/0 (socket says 172.21.15.19:48802) 2024-09-19T08:51:12.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.102+0000 7f2531d9b640 1 -- 172.21.15.19:0/2023681866 learned_addr learned my addr 172.21.15.19:0/2023681866 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:12.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.102+0000 7f2532d9d640 1 --2- 172.21.15.19:0/2023681866 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f253410c2f0 0x7f253419cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:12.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.102+0000 7f253259c640 1 --2- 172.21.15.19:0/2023681866 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2534102df0 0x7f25341986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:12.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.102+0000 7f2531d9b640 1 -- 172.21.15.19:0/2023681866 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f253410c2f0 msgr2=0x7f253419cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:12.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.102+0000 7f2531d9b640 1 --2- 172.21.15.19:0/2023681866 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f253410c2f0 0x7f253419cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.102+0000 7f2531d9b640 1 -- 172.21.15.19:0/2023681866 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2534102df0 msgr2=0x7f25341986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:12.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.102+0000 7f2531d9b640 1 --2- 172.21.15.19:0/2023681866 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2534102df0 0x7f25341986a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.102+0000 7f2531d9b640 1 -- 172.21.15.19:0/2023681866 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f253419d650 con 0x7f25341037a0 2024-09-19T08:51:12.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.103+0000 7f2531d9b640 1 --2- 172.21.15.19:0/2023681866 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25341037a0 0x7f2534198be0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f252800d750 tx=0x7f252800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:12.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.103+0000 7f25237fe640 1 -- 172.21.15.19:0/2023681866 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2528017070 con 0x7f25341037a0 2024-09-19T08:51:12.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.103+0000 7f25237fe640 1 -- 172.21.15.19:0/2023681866 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2528005500 con 0x7f25341037a0 2024-09-19T08:51:12.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.103+0000 7f2538bf9640 1 -- 172.21.15.19:0/2023681866 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f253419d940 con 0x7f25341037a0 2024-09-19T08:51:12.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.103+0000 7f25237fe640 1 -- 172.21.15.19:0/2023681866 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2528004e00 con 0x7f25341037a0 2024-09-19T08:51:12.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.103+0000 7f2538bf9640 1 -- 172.21.15.19:0/2023681866 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25341a5220 con 0x7f25341037a0 2024-09-19T08:51:12.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.104+0000 7f2538bf9640 1 -- 172.21.15.19:0/2023681866 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f253406a790 con 0x7f25341037a0 2024-09-19T08:51:12.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.105+0000 7f25237fe640 1 -- 172.21.15.19:0/2023681866 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2528004fa0 con 0x7f25341037a0 2024-09-19T08:51:12.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.106+0000 7f25237fe640 1 --2- 172.21.15.19:0/2023681866 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f251c0a32d0 0x7f251c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:12.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.106+0000 7f253259c640 1 --2- 172.21.15.19:0/2023681866 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f251c0a32d0 0x7f251c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:12.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.106+0000 7f25237fe640 1 -- 172.21.15.19:0/2023681866 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f25280cf2b0 con 0x7f25341037a0 2024-09-19T08:51:12.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.106+0000 7f253259c640 1 --2- 172.21.15.19:0/2023681866 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f251c0a32d0 0x7f251c0a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2524005ab0 tx=0x7f2524005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:12.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.110+0000 7f25237fe640 1 -- 172.21.15.19:0/2023681866 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f252809c020 con 0x7f25341037a0 2024-09-19T08:51:12.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.286+0000 7f2538bf9640 1 -- 172.21.15.19:0/2023681866 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f2534199a00 con 0x7f25341037a0 2024-09-19T08:51:12.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.287+0000 7f25237fe640 1 -- 172.21.15.19:0/2023681866 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f252809b920 con 0x7f25341037a0 2024-09-19T08:51:12.286 INFO:teuthology.orchestra.run.smithi019.stdout:107374182464 2024-09-19T08:51:12.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.288+0000 7f2538bf9640 1 -- 172.21.15.19:0/2023681866 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f251c0a32d0 msgr2=0x7f251c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:12.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.288+0000 7f2538bf9640 1 --2- 172.21.15.19:0/2023681866 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f251c0a32d0 0x7f251c0a5790 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2524005ab0 tx=0x7f2524005a20 comp rx=0 tx=0).stop 2024-09-19T08:51:12.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.288+0000 7f2538bf9640 1 -- 172.21.15.19:0/2023681866 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25341037a0 msgr2=0x7f2534198be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:12.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.289+0000 7f2538bf9640 1 --2- 172.21.15.19:0/2023681866 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25341037a0 0x7f2534198be0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f252800d750 tx=0x7f252800dc10 comp rx=0 tx=0).stop 2024-09-19T08:51:12.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.289+0000 7f2538bf9640 1 -- 172.21.15.19:0/2023681866 shutdown_connections 2024-09-19T08:51:12.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.289+0000 7f2538bf9640 1 --2- 172.21.15.19:0/2023681866 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f251c0a32d0 0x7f251c0a5790 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.289+0000 7f2538bf9640 1 --2- 172.21.15.19:0/2023681866 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f253410c2f0 0x7f253419cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.289+0000 7f2538bf9640 1 --2- 172.21.15.19:0/2023681866 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f25341037a0 0x7f2534198be0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.289+0000 7f2538bf9640 1 --2- 172.21.15.19:0/2023681866 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2534102df0 0x7f25341986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:12.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.289+0000 7f2538bf9640 1 -- 172.21.15.19:0/2023681866 >> 172.21.15.19:0/2023681866 conn(0x7f25340fc7d0 msgr2=0x7f25340fe000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:12.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.289+0000 7f2538bf9640 1 -- 172.21.15.19:0/2023681866 shutdown_connections 2024-09-19T08:51:12.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:12.289+0000 7f2538bf9640 1 -- 172.21.15.19:0/2023681866 wait complete. 2024-09-19T08:51:12.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:12 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/2335374959' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T08:51:12.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:12 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3254082757' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T08:51:12.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:12 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/2023681866' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T08:51:12.790 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:12 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/2335374959' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T08:51:12.790 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:12 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3254082757' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T08:51:12.790 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:12 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/2023681866' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T08:51:12.791 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574921 got 55834574923 for osd.1 2024-09-19T08:51:12.791 DEBUG:teuthology.parallel:result is None 2024-09-19T08:51:12.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:12 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/2335374959' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T08:51:12.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:12 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3254082757' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T08:51:12.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:12 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/2023681866' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T08:51:13.199 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:13.236 INFO:tasks.cephadm.ceph_manager.ceph:need seq 266287972384 got 266287972386 for osd.9 2024-09-19T08:51:13.236 DEBUG:teuthology.parallel:result is None 2024-09-19T08:51:13.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:13 smithi019 ceph-mon[30976]: pgmap v305: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T08:51:13.883 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182461 got 107374182464 for osd.3 2024-09-19T08:51:13.883 DEBUG:teuthology.parallel:result is None 2024-09-19T08:51:13.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:13 smithi155 ceph-mon[34921]: pgmap v305: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T08:51:13.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:13 smithi203 ceph-mon[35450]: pgmap v305: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T08:51:14.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.052+0000 7fa439a50640 1 -- 172.21.15.19:0/1102201431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa434106a80 msgr2=0x7fa434106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:14.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.052+0000 7fa439a50640 1 --2- 172.21.15.19:0/1102201431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa434106a80 0x7fa434106e60 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa424009930 tx=0x7fa42402a420 comp rx=0 tx=0).stop 2024-09-19T08:51:14.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.052+0000 7fa439a50640 1 -- 172.21.15.19:0/1102201431 shutdown_connections 2024-09-19T08:51:14.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.052+0000 7fa439a50640 1 --2- 172.21.15.19:0/1102201431 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa434101420 0x7fa43410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:14.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.052+0000 7fa439a50640 1 --2- 172.21.15.19:0/1102201431 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa434100a80 0x7fa434100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:14.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.052+0000 7fa439a50640 1 --2- 172.21.15.19:0/1102201431 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa434106a80 0x7fa434106e60 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:14.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.052+0000 7fa439a50640 1 -- 172.21.15.19:0/1102201431 >> 172.21.15.19:0/1102201431 conn(0x7fa4340fc7a0 msgr2=0x7fa4340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:14.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.052+0000 7fa439a50640 1 -- 172.21.15.19:0/1102201431 shutdown_connections 2024-09-19T08:51:14.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.052+0000 7fa439a50640 1 -- 172.21.15.19:0/1102201431 wait complete. 2024-09-19T08:51:14.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.052+0000 7fa439a50640 1 Processor -- start 2024-09-19T08:51:14.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.053+0000 7fa439a50640 1 -- start start 2024-09-19T08:51:14.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.053+0000 7fa439a50640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa434100a80 0x7fa434198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:14.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.053+0000 7fa439a50640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa434101420 0x7fa434198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:14.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.053+0000 7fa439a50640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa434106a80 0x7fa43419cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:14.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.053+0000 7fa439a50640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa434111fa0 con 0x7fa434101420 2024-09-19T08:51:14.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.053+0000 7fa439a50640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa434111e20 con 0x7fa434100a80 2024-09-19T08:51:14.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.053+0000 7fa439a50640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa434112120 con 0x7fa434106a80 2024-09-19T08:51:14.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.053+0000 7fa4327fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa434101420 0x7fa434198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:14.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.053+0000 7fa4327fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa434101420 0x7fa434198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48818/0 (socket says 172.21.15.19:48818) 2024-09-19T08:51:14.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.053+0000 7fa4327fc640 1 -- 172.21.15.19:0/3948209822 learned_addr learned my addr 172.21.15.19:0/3948209822 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:14.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.053+0000 7fa4337fe640 1 --2- 172.21.15.19:0/3948209822 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa434106a80 0x7fa43419cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:14.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.053+0000 7fa432ffd640 1 --2- 172.21.15.19:0/3948209822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa434100a80 0x7fa434198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:14.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.053+0000 7fa4327fc640 1 -- 172.21.15.19:0/3948209822 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa434106a80 msgr2=0x7fa43419cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:14.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.053+0000 7fa4327fc640 1 --2- 172.21.15.19:0/3948209822 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa434106a80 0x7fa43419cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:14.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.053+0000 7fa4327fc640 1 -- 172.21.15.19:0/3948209822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa434100a80 msgr2=0x7fa434198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:14.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.053+0000 7fa4327fc640 1 --2- 172.21.15.19:0/3948209822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa434100a80 0x7fa434198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:14.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.053+0000 7fa4327fc640 1 -- 172.21.15.19:0/3948209822 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa43419d400 con 0x7fa434101420 2024-09-19T08:51:14.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.054+0000 7fa4327fc640 1 --2- 172.21.15.19:0/3948209822 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa434101420 0x7fa434198990 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa41c00d950 tx=0x7fa41c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:14.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.054+0000 7fa438a4e640 1 -- 172.21.15.19:0/3948209822 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41c017070 con 0x7fa434101420 2024-09-19T08:51:14.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.054+0000 7fa438a4e640 1 -- 172.21.15.19:0/3948209822 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa41c009c30 con 0x7fa434101420 2024-09-19T08:51:14.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.054+0000 7fa439a50640 1 -- 172.21.15.19:0/3948209822 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa43419d6f0 con 0x7fa434101420 2024-09-19T08:51:14.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.054+0000 7fa438a4e640 1 -- 172.21.15.19:0/3948209822 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa41c00f6b0 con 0x7fa434101420 2024-09-19T08:51:14.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.054+0000 7fa439a50640 1 -- 172.21.15.19:0/3948209822 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4341a4fd0 con 0x7fa434101420 2024-09-19T08:51:14.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.055+0000 7fa439a50640 1 -- 172.21.15.19:0/3948209822 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa434100ee0 con 0x7fa434101420 2024-09-19T08:51:14.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.056+0000 7fa438a4e640 1 -- 172.21.15.19:0/3948209822 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fa41c0109d0 con 0x7fa434101420 2024-09-19T08:51:14.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.057+0000 7fa438a4e640 1 --2- 172.21.15.19:0/3948209822 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa4200a32d0 0x7fa4200a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:14.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.057+0000 7fa432ffd640 1 --2- 172.21.15.19:0/3948209822 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa4200a32d0 0x7fa4200a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:14.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.058+0000 7fa438a4e640 1 -- 172.21.15.19:0/3948209822 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fa41c0cf5d0 con 0x7fa434101420 2024-09-19T08:51:14.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.058+0000 7fa432ffd640 1 --2- 172.21.15.19:0/3948209822 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa4200a32d0 0x7fa4200a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa424009900 tx=0x7fa4240058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:14.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.061+0000 7fa438a4e640 1 -- 172.21.15.19:0/3948209822 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa41c009de0 con 0x7fa434101420 2024-09-19T08:51:14.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.239+0000 7fa439a50640 1 -- 172.21.15.19:0/3948209822 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fa434109050 con 0x7fa434101420 2024-09-19T08:51:14.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.239+0000 7fa438a4e640 1 -- 172.21.15.19:0/3948209822 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fa41c09bbf0 con 0x7fa434101420 2024-09-19T08:51:14.239 INFO:teuthology.orchestra.run.smithi019.stdout:287762808861 2024-09-19T08:51:14.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.242+0000 7fa439a50640 1 -- 172.21.15.19:0/3948209822 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa4200a32d0 msgr2=0x7fa4200a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:14.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.242+0000 7fa439a50640 1 --2- 172.21.15.19:0/3948209822 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa4200a32d0 0x7fa4200a5790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa424009900 tx=0x7fa4240058d0 comp rx=0 tx=0).stop 2024-09-19T08:51:14.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.242+0000 7fa439a50640 1 -- 172.21.15.19:0/3948209822 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa434101420 msgr2=0x7fa434198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:14.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.242+0000 7fa439a50640 1 --2- 172.21.15.19:0/3948209822 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa434101420 0x7fa434198990 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa41c00d950 tx=0x7fa41c00de10 comp rx=0 tx=0).stop 2024-09-19T08:51:14.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.242+0000 7fa439a50640 1 -- 172.21.15.19:0/3948209822 shutdown_connections 2024-09-19T08:51:14.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.242+0000 7fa439a50640 1 --2- 172.21.15.19:0/3948209822 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa4200a32d0 0x7fa4200a5790 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:14.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.242+0000 7fa439a50640 1 --2- 172.21.15.19:0/3948209822 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa434106a80 0x7fa43419cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:14.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.242+0000 7fa439a50640 1 --2- 172.21.15.19:0/3948209822 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa434101420 0x7fa434198990 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:14.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.242+0000 7fa439a50640 1 --2- 172.21.15.19:0/3948209822 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa434100a80 0x7fa434198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:14.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.242+0000 7fa439a50640 1 -- 172.21.15.19:0/3948209822 >> 172.21.15.19:0/3948209822 conn(0x7fa4340fc7a0 msgr2=0x7fa4340fdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:14.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.242+0000 7fa439a50640 1 -- 172.21.15.19:0/3948209822 shutdown_connections 2024-09-19T08:51:14.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.242+0000 7fa439a50640 1 -- 172.21.15.19:0/3948209822 wait complete. 2024-09-19T08:51:14.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.706+0000 7fde2a591640 1 -- 172.21.15.19:0/182106995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde24100a80 msgr2=0x7fde24100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:14.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.706+0000 7fde2a591640 1 --2- 172.21.15.19:0/182106995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde24100a80 0x7fde24100ee0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fde18009930 tx=0x7fde1802a420 comp rx=0 tx=0).stop 2024-09-19T08:51:14.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.706+0000 7fde2a591640 1 -- 172.21.15.19:0/182106995 shutdown_connections 2024-09-19T08:51:14.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.706+0000 7fde2a591640 1 --2- 172.21.15.19:0/182106995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde24101420 0x7fde2410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:14.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.706+0000 7fde2a591640 1 --2- 172.21.15.19:0/182106995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde24100a80 0x7fde24100ee0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:14.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.706+0000 7fde2a591640 1 --2- 172.21.15.19:0/182106995 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde24106a80 0x7fde24106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:14.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.706+0000 7fde2a591640 1 -- 172.21.15.19:0/182106995 >> 172.21.15.19:0/182106995 conn(0x7fde240fc7a0 msgr2=0x7fde240febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:14.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.706+0000 7fde2a591640 1 -- 172.21.15.19:0/182106995 shutdown_connections 2024-09-19T08:51:14.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.706+0000 7fde2a591640 1 -- 172.21.15.19:0/182106995 wait complete. 2024-09-19T08:51:14.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.706+0000 7fde2a591640 1 Processor -- start 2024-09-19T08:51:14.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.706+0000 7fde2a591640 1 -- start start 2024-09-19T08:51:14.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.707+0000 7fde2a591640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde24100a80 0x7fde24198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:14.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.707+0000 7fde2a591640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde24101420 0x7fde24198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:14.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.707+0000 7fde2a591640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde24106a80 0x7fde2419cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:14.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.707+0000 7fde2a591640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fde24110e40 con 0x7fde24106a80 2024-09-19T08:51:14.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.707+0000 7fde2a591640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fde24110cc0 con 0x7fde24100a80 2024-09-19T08:51:14.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.707+0000 7fde2a591640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fde24110fc0 con 0x7fde24101420 2024-09-19T08:51:14.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.707+0000 7fde28b2e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde24106a80 0x7fde2419cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:14.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.707+0000 7fde28b2e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde24106a80 0x7fde2419cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48830/0 (socket says 172.21.15.19:48830) 2024-09-19T08:51:14.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.707+0000 7fde28b2e640 1 -- 172.21.15.19:0/3930961111 learned_addr learned my addr 172.21.15.19:0/3930961111 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:14.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.707+0000 7fde237fe640 1 --2- 172.21.15.19:0/3930961111 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde24101420 0x7fde24198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:14.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.707+0000 7fde23fff640 1 --2- 172.21.15.19:0/3930961111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde24100a80 0x7fde24198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:14.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.707+0000 7fde28b2e640 1 -- 172.21.15.19:0/3930961111 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde24101420 msgr2=0x7fde24198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:14.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.707+0000 7fde28b2e640 1 --2- 172.21.15.19:0/3930961111 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde24101420 0x7fde24198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:14.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.707+0000 7fde28b2e640 1 -- 172.21.15.19:0/3930961111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde24100a80 msgr2=0x7fde24198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:14.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.707+0000 7fde28b2e640 1 --2- 172.21.15.19:0/3930961111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde24100a80 0x7fde24198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:14.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.707+0000 7fde28b2e640 1 -- 172.21.15.19:0/3930961111 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde2419d400 con 0x7fde24106a80 2024-09-19T08:51:14.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.707+0000 7fde28b2e640 1 --2- 172.21.15.19:0/3930961111 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde24106a80 0x7fde2419cd20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fde1c009fd0 tx=0x7fde1c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:14.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.708+0000 7fde217fa640 1 -- 172.21.15.19:0/3930961111 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1c017070 con 0x7fde24106a80 2024-09-19T08:51:14.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.708+0000 7fde217fa640 1 -- 172.21.15.19:0/3930961111 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde1c003e50 con 0x7fde24106a80 2024-09-19T08:51:14.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.708+0000 7fde2a591640 1 -- 172.21.15.19:0/3930961111 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde2419d6f0 con 0x7fde24106a80 2024-09-19T08:51:14.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.708+0000 7fde217fa640 1 -- 172.21.15.19:0/3930961111 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1c0106c0 con 0x7fde24106a80 2024-09-19T08:51:14.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.708+0000 7fde2a591640 1 -- 172.21.15.19:0/3930961111 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde241a4fd0 con 0x7fde24106a80 2024-09-19T08:51:14.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.709+0000 7fde2a591640 1 -- 172.21.15.19:0/3930961111 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde241021c0 con 0x7fde24106a80 2024-09-19T08:51:14.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.710+0000 7fde217fa640 1 -- 172.21.15.19:0/3930961111 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fde1c003970 con 0x7fde24106a80 2024-09-19T08:51:14.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.711+0000 7fde217fa640 1 --2- 172.21.15.19:0/3930961111 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fde0c0a32d0 0x7fde0c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:14.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.711+0000 7fde23fff640 1 --2- 172.21.15.19:0/3930961111 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fde0c0a32d0 0x7fde0c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:14.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.711+0000 7fde217fa640 1 -- 172.21.15.19:0/3930961111 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fde1c0cf5e0 con 0x7fde24106a80 2024-09-19T08:51:14.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.711+0000 7fde23fff640 1 --2- 172.21.15.19:0/3930961111 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fde0c0a32d0 0x7fde0c0a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fde14005d00 tx=0x7fde1400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:14.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.715+0000 7fde217fa640 1 -- 172.21.15.19:0/3930961111 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fde1c09bd00 con 0x7fde24106a80 2024-09-19T08:51:14.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:14 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3948209822' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T08:51:14.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.898+0000 7fde2a591640 1 -- 172.21.15.19:0/3930961111 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fde2410a050 con 0x7fde24106a80 2024-09-19T08:51:14.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.899+0000 7fde217fa640 1 -- 172.21.15.19:0/3930961111 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fde1c0a0000 con 0x7fde24106a80 2024-09-19T08:51:14.898 INFO:teuthology.orchestra.run.smithi019.stdout:184683593779 2024-09-19T08:51:14.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.901+0000 7fde2a591640 1 -- 172.21.15.19:0/3930961111 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fde0c0a32d0 msgr2=0x7fde0c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:14.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.901+0000 7fde2a591640 1 --2- 172.21.15.19:0/3930961111 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fde0c0a32d0 0x7fde0c0a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fde14005d00 tx=0x7fde1400b410 comp rx=0 tx=0).stop 2024-09-19T08:51:14.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.901+0000 7fde2a591640 1 -- 172.21.15.19:0/3930961111 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde24106a80 msgr2=0x7fde2419cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:14.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.901+0000 7fde2a591640 1 --2- 172.21.15.19:0/3930961111 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde24106a80 0x7fde2419cd20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fde1c009fd0 tx=0x7fde1c00b260 comp rx=0 tx=0).stop 2024-09-19T08:51:14.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.901+0000 7fde2a591640 1 -- 172.21.15.19:0/3930961111 shutdown_connections 2024-09-19T08:51:14.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.901+0000 7fde2a591640 1 --2- 172.21.15.19:0/3930961111 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fde0c0a32d0 0x7fde0c0a5790 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:14.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.901+0000 7fde2a591640 1 --2- 172.21.15.19:0/3930961111 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde24101420 0x7fde24198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:14.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.901+0000 7fde2a591640 1 --2- 172.21.15.19:0/3930961111 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde24106a80 0x7fde2419cd20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:14.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.901+0000 7fde2a591640 1 --2- 172.21.15.19:0/3930961111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde24100a80 0x7fde24198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:14.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.901+0000 7fde2a591640 1 -- 172.21.15.19:0/3930961111 >> 172.21.15.19:0/3930961111 conn(0x7fde240fc7a0 msgr2=0x7fde2406aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:14.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.901+0000 7fde2a591640 1 -- 172.21.15.19:0/3930961111 shutdown_connections 2024-09-19T08:51:14.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:14.901+0000 7fde2a591640 1 -- 172.21.15.19:0/3930961111 wait complete. 2024-09-19T08:51:14.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:14 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3948209822' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T08:51:14.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:14 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3948209822' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T08:51:15.191 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808859 got 287762808861 for osd.10 2024-09-19T08:51:15.191 DEBUG:teuthology.parallel:result is None 2024-09-19T08:51:15.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.739+0000 7f05da2dd640 1 -- 172.21.15.19:0/2543094916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05d41036e0 msgr2=0x7f05d4107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:15.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.739+0000 7f05da2dd640 1 --2- 172.21.15.19:0/2543094916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05d41036e0 0x7f05d4107b90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f05c8009930 tx=0x7f05c802a420 comp rx=0 tx=0).stop 2024-09-19T08:51:15.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.739+0000 7f05da2dd640 1 -- 172.21.15.19:0/2543094916 shutdown_connections 2024-09-19T08:51:15.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.739+0000 7f05da2dd640 1 --2- 172.21.15.19:0/2543094916 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05d41082a0 0x7f05d410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.739+0000 7f05da2dd640 1 --2- 172.21.15.19:0/2543094916 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05d41036e0 0x7f05d4107b90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.739+0000 7f05da2dd640 1 --2- 172.21.15.19:0/2543094916 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05d4102d30 0x7f05d4103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.739+0000 7f05da2dd640 1 -- 172.21.15.19:0/2543094916 >> 172.21.15.19:0/2543094916 conn(0x7f05d40fc7d0 msgr2=0x7f05d40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:15.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.739+0000 7f05da2dd640 1 -- 172.21.15.19:0/2543094916 shutdown_connections 2024-09-19T08:51:15.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.739+0000 7f05da2dd640 1 -- 172.21.15.19:0/2543094916 wait complete. 2024-09-19T08:51:15.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.740+0000 7f05da2dd640 1 Processor -- start 2024-09-19T08:51:15.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.740+0000 7f05da2dd640 1 -- start start 2024-09-19T08:51:15.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.740+0000 7f05da2dd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05d4102d30 0x7f05d41985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.740+0000 7f05da2dd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05d41036e0 0x7f05d4198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.740+0000 7f05da2dd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05d41082a0 0x7f05d419ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.740+0000 7f05da2dd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f05d41120a0 con 0x7f05d41082a0 2024-09-19T08:51:15.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.740+0000 7f05da2dd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f05d4111f20 con 0x7f05d41036e0 2024-09-19T08:51:15.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.740+0000 7f05da2dd640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f05d4112220 con 0x7f05d4102d30 2024-09-19T08:51:15.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.741+0000 7f05d887a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05d41082a0 0x7f05d419ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.741+0000 7f05d3fff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05d4102d30 0x7f05d41985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.741+0000 7f05d3fff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05d4102d30 0x7f05d41985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:57396/0 (socket says 172.21.15.19:57396) 2024-09-19T08:51:15.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.741+0000 7f05d887a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05d41082a0 0x7f05d419ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48770/0 (socket says 172.21.15.19:48770) 2024-09-19T08:51:15.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.741+0000 7f05d3fff640 1 -- 172.21.15.19:0/2335374959 learned_addr learned my addr 172.21.15.19:0/2335374959 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:15.499 INFO:teuthology.orchestra.run.smithi019.stdout:77309411398 2024-09-19T08:51:15.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.741+0000 7f05d37fe640 1 --2- 172.21.15.19:0/2335374959 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05d41036e0 0x7f05d4198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.741+0000 7f05d3fff640 1 -- 172.21.15.19:0/2335374959 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05d41036e0 msgr2=0x7f05d4198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:15.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.741+0000 7f05d3fff640 1 --2- 172.21.15.19:0/2335374959 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05d41036e0 0x7f05d4198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.741+0000 7f05d3fff640 1 -- 172.21.15.19:0/2335374959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05d41082a0 msgr2=0x7f05d419ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:15.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.741+0000 7f05d3fff640 1 --2- 172.21.15.19:0/2335374959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05d41082a0 0x7f05d419ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.741+0000 7f05d3fff640 1 -- 172.21.15.19:0/2335374959 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05d419d590 con 0x7f05d4102d30 2024-09-19T08:51:15.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.741+0000 7f05d887a640 1 --2- 172.21.15.19:0/2335374959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05d41082a0 0x7f05d419ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:51:15.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.741+0000 7f05d3fff640 1 --2- 172.21.15.19:0/2335374959 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05d4102d30 0x7f05d41985e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f05c400e9f0 tx=0x7f05c400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:15.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.741+0000 7f05d17fa640 1 -- 172.21.15.19:0/2335374959 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c400cd80 con 0x7f05d4102d30 2024-09-19T08:51:15.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.741+0000 7f05da2dd640 1 -- 172.21.15.19:0/2335374959 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05d419d880 con 0x7f05d4102d30 2024-09-19T08:51:15.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.741+0000 7f05d17fa640 1 -- 172.21.15.19:0/2335374959 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05c4005500 con 0x7f05d4102d30 2024-09-19T08:51:15.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.741+0000 7f05d17fa640 1 -- 172.21.15.19:0/2335374959 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05c4010690 con 0x7f05d4102d30 2024-09-19T08:51:15.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.741+0000 7f05da2dd640 1 -- 172.21.15.19:0/2335374959 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05d41a5160 con 0x7f05d4102d30 2024-09-19T08:51:15.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.742+0000 7f05da2dd640 1 -- 172.21.15.19:0/2335374959 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05d4103110 con 0x7f05d4102d30 2024-09-19T08:51:15.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.744+0000 7f05d17fa640 1 -- 172.21.15.19:0/2335374959 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f05c40046c0 con 0x7f05d4102d30 2024-09-19T08:51:15.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.744+0000 7f05d17fa640 1 --2- 172.21.15.19:0/2335374959 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f05bc0a32d0 0x7f05bc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:15.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.744+0000 7f05d37fe640 1 --2- 172.21.15.19:0/2335374959 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f05bc0a32d0 0x7f05bc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:15.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.744+0000 7f05d17fa640 1 -- 172.21.15.19:0/2335374959 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f05c40d0090 con 0x7f05d4102d30 2024-09-19T08:51:15.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.745+0000 7f05d37fe640 1 --2- 172.21.15.19:0/2335374959 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f05bc0a32d0 0x7f05bc0a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f05c8005940 tx=0x7f05c80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:15.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.747+0000 7f05d17fa640 1 -- 172.21.15.19:0/2335374959 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f05c409cd00 con 0x7f05d4102d30 2024-09-19T08:51:15.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.933+0000 7f05da2dd640 1 -- 172.21.15.19:0/2335374959 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f05d4199940 con 0x7f05d4102d30 2024-09-19T08:51:15.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.933+0000 7f05d17fa640 1 -- 172.21.15.19:0/2335374959 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f05d4199940 con 0x7f05d4102d30 2024-09-19T08:51:15.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.936+0000 7f05da2dd640 1 -- 172.21.15.19:0/2335374959 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f05bc0a32d0 msgr2=0x7f05bc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:15.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.936+0000 7f05da2dd640 1 --2- 172.21.15.19:0/2335374959 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f05bc0a32d0 0x7f05bc0a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f05c8005940 tx=0x7f05c80058d0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.936+0000 7f05da2dd640 1 -- 172.21.15.19:0/2335374959 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05d4102d30 msgr2=0x7f05d41985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:15.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.936+0000 7f05da2dd640 1 --2- 172.21.15.19:0/2335374959 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05d4102d30 0x7f05d41985e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f05c400e9f0 tx=0x7f05c400edf0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.937+0000 7f05da2dd640 1 -- 172.21.15.19:0/2335374959 shutdown_connections 2024-09-19T08:51:15.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.937+0000 7f05da2dd640 1 --2- 172.21.15.19:0/2335374959 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f05bc0a32d0 0x7f05bc0a5790 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.937+0000 7f05da2dd640 1 --2- 172.21.15.19:0/2335374959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05d41082a0 0x7f05d419ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.937+0000 7f05da2dd640 1 --2- 172.21.15.19:0/2335374959 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05d41036e0 0x7f05d4198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.937+0000 7f05da2dd640 1 --2- 172.21.15.19:0/2335374959 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05d4102d30 0x7f05d41985e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:15.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.937+0000 7f05da2dd640 1 -- 172.21.15.19:0/2335374959 >> 172.21.15.19:0/2335374959 conn(0x7f05d40fc7d0 msgr2=0x7f05d4105e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:15.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.937+0000 7f05da2dd640 1 -- 172.21.15.19:0/2335374959 shutdown_connections 2024-09-19T08:51:15.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:11.937+0000 7f05da2dd640 1 -- 172.21.15.19:0/2335374959 wait complete. 2024-09-19T08:51:15.706 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:15.706 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:15.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:15 smithi019 ceph-mon[30976]: pgmap v306: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2024-09-19T08:51:15.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:15 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3930961111' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T08:51:15.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:15 smithi155 ceph-mon[34921]: pgmap v306: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2024-09-19T08:51:15.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:15 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3930961111' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T08:51:15.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:15 smithi203 ceph-mon[35450]: pgmap v306: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 9 op/s 2024-09-19T08:51:15.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:15 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3930961111' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T08:51:16.157 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411396 got 77309411398 for osd.2 2024-09-19T08:51:16.157 DEBUG:teuthology.parallel:result is None 2024-09-19T08:51:16.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.540+0000 7fac67315640 1 -- 172.21.15.19:0/3080660347 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac6010e480 msgr2=0x7fac60110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:16.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.540+0000 7fac67315640 1 --2- 172.21.15.19:0/3080660347 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac6010e480 0x7fac60110870 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fac58009ca0 tx=0x7fac5802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.540+0000 7fac67315640 1 -- 172.21.15.19:0/3080660347 shutdown_connections 2024-09-19T08:51:16.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.540+0000 7fac67315640 1 --2- 172.21.15.19:0/3080660347 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac60101280 0x7fac6010df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.540+0000 7fac67315640 1 --2- 172.21.15.19:0/3080660347 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac6010e480 0x7fac60110870 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.540+0000 7fac67315640 1 --2- 172.21.15.19:0/3080660347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac601008d0 0x7fac60100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.540+0000 7fac67315640 1 -- 172.21.15.19:0/3080660347 >> 172.21.15.19:0/3080660347 conn(0x7fac600fc7a0 msgr2=0x7fac600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:16.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.541+0000 7fac67315640 1 -- 172.21.15.19:0/3080660347 shutdown_connections 2024-09-19T08:51:16.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.541+0000 7fac67315640 1 -- 172.21.15.19:0/3080660347 wait complete. 2024-09-19T08:51:16.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.541+0000 7fac67315640 1 Processor -- start 2024-09-19T08:51:16.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.542+0000 7fac67315640 1 -- start start 2024-09-19T08:51:16.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.542+0000 7fac67315640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac601008d0 0x7fac6019a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:16.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.542+0000 7fac67315640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac60101280 0x7fac6019abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:16.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.542+0000 7fac67315640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac6010e480 0x7fac6019ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:16.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.542+0000 7fac67315640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fac60114160 con 0x7fac601008d0 2024-09-19T08:51:16.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.542+0000 7fac67315640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fac60113fe0 con 0x7fac6010e480 2024-09-19T08:51:16.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.542+0000 7fac67315640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fac601142e0 con 0x7fac60101280 2024-09-19T08:51:16.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.542+0000 7fac650b1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac601008d0 0x7fac6019a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:16.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.542+0000 7fac650b1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac601008d0 0x7fac6019a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34730/0 (socket says 172.21.15.19:34730) 2024-09-19T08:51:16.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.542+0000 7fac650b1640 1 -- 172.21.15.19:0/3820718321 learned_addr learned my addr 172.21.15.19:0/3820718321 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:16.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.542+0000 7fac648b0640 1 --2- 172.21.15.19:0/3820718321 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac60101280 0x7fac6019abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:16.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.542+0000 7fac658b2640 1 --2- 172.21.15.19:0/3820718321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac6010e480 0x7fac6019ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:16.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.542+0000 7fac650b1640 1 -- 172.21.15.19:0/3820718321 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac60101280 msgr2=0x7fac6019abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:16.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.542+0000 7fac650b1640 1 --2- 172.21.15.19:0/3820718321 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac60101280 0x7fac6019abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.542+0000 7fac650b1640 1 -- 172.21.15.19:0/3820718321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac6010e480 msgr2=0x7fac6019ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:16.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.542+0000 7fac650b1640 1 --2- 172.21.15.19:0/3820718321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac6010e480 0x7fac6019ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.542+0000 7fac650b1640 1 -- 172.21.15.19:0/3820718321 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac6019f650 con 0x7fac601008d0 2024-09-19T08:51:16.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.543+0000 7fac650b1640 1 --2- 172.21.15.19:0/3820718321 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac601008d0 0x7fac6019a6a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fac5c00c890 tx=0x7fac5c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:16.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.543+0000 7fac567fc640 1 -- 172.21.15.19:0/3820718321 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac5c004220 con 0x7fac601008d0 2024-09-19T08:51:16.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.543+0000 7fac67315640 1 -- 172.21.15.19:0/3820718321 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac6019f940 con 0x7fac601008d0 2024-09-19T08:51:16.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.543+0000 7fac567fc640 1 -- 172.21.15.19:0/3820718321 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac5c007e10 con 0x7fac601008d0 2024-09-19T08:51:16.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.543+0000 7fac567fc640 1 -- 172.21.15.19:0/3820718321 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac5c004a00 con 0x7fac601008d0 2024-09-19T08:51:16.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.543+0000 7fac67315640 1 -- 172.21.15.19:0/3820718321 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac601a7220 con 0x7fac601008d0 2024-09-19T08:51:16.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.544+0000 7fac67315640 1 -- 172.21.15.19:0/3820718321 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac60100cb0 con 0x7fac601008d0 2024-09-19T08:51:16.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.545+0000 7fac567fc640 1 -- 172.21.15.19:0/3820718321 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fac5c007930 con 0x7fac601008d0 2024-09-19T08:51:16.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.546+0000 7fac567fc640 1 --2- 172.21.15.19:0/3820718321 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fac4c0a3320 0x7fac4c0a57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:16.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.546+0000 7fac648b0640 1 --2- 172.21.15.19:0/3820718321 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fac4c0a3320 0x7fac4c0a57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:16.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.546+0000 7fac567fc640 1 -- 172.21.15.19:0/3820718321 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fac5c0cf570 con 0x7fac601008d0 2024-09-19T08:51:16.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.546+0000 7fac648b0640 1 --2- 172.21.15.19:0/3820718321 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fac4c0a3320 0x7fac4c0a57e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fac60110c20 tx=0x7fac5000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:16.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.550+0000 7fac567fc640 1 -- 172.21.15.19:0/3820718321 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fac5c014030 con 0x7fac601008d0 2024-09-19T08:51:16.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.728+0000 7fac67315640 1 -- 172.21.15.19:0/3820718321 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fac601a7450 con 0x7fac601008d0 2024-09-19T08:51:16.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.728+0000 7fac567fc640 1 -- 172.21.15.19:0/3820718321 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fac5c09c1e0 con 0x7fac601008d0 2024-09-19T08:51:16.728 INFO:teuthology.orchestra.run.smithi019.stdout:34359738449 2024-09-19T08:51:16.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.730+0000 7fac67315640 1 -- 172.21.15.19:0/3820718321 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fac4c0a3320 msgr2=0x7fac4c0a57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:16.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.730+0000 7fac67315640 1 --2- 172.21.15.19:0/3820718321 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fac4c0a3320 0x7fac4c0a57e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fac60110c20 tx=0x7fac5000a2d0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.730+0000 7fac67315640 1 -- 172.21.15.19:0/3820718321 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac601008d0 msgr2=0x7fac6019a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:16.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.730+0000 7fac67315640 1 --2- 172.21.15.19:0/3820718321 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac601008d0 0x7fac6019a6a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fac5c00c890 tx=0x7fac5c00cc90 comp rx=0 tx=0).stop 2024-09-19T08:51:16.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.730+0000 7fac67315640 1 -- 172.21.15.19:0/3820718321 shutdown_connections 2024-09-19T08:51:16.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.730+0000 7fac67315640 1 --2- 172.21.15.19:0/3820718321 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fac4c0a3320 0x7fac4c0a57e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.730+0000 7fac67315640 1 --2- 172.21.15.19:0/3820718321 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac60101280 0x7fac6019abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.730+0000 7fac67315640 1 --2- 172.21.15.19:0/3820718321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac6010e480 0x7fac6019ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.730+0000 7fac67315640 1 --2- 172.21.15.19:0/3820718321 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac601008d0 0x7fac6019a6a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:16.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.730+0000 7fac67315640 1 -- 172.21.15.19:0/3820718321 >> 172.21.15.19:0/3820718321 conn(0x7fac600fc7a0 msgr2=0x7fac600feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:16.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.730+0000 7fac67315640 1 -- 172.21.15.19:0/3820718321 shutdown_connections 2024-09-19T08:51:16.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:16.730+0000 7fac67315640 1 -- 172.21.15.19:0/3820718321 wait complete. 2024-09-19T08:51:17.405 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738446 got 34359738449 for osd.0 2024-09-19T08:51:17.406 DEBUG:teuthology.parallel:result is None 2024-09-19T08:51:17.626 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:17 smithi019 ceph-mon[30976]: pgmap v307: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T08:51:17.627 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:17 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3820718321' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T08:51:17.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.827+0000 7f8ce266e640 1 -- 172.21.15.19:0/3350687986 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cdc101420 msgr2=0x7f8cdc10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:17.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.827+0000 7f8ce266e640 1 --2- 172.21.15.19:0/3350687986 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cdc101420 0x7f8cdc10d950 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4009cd0 tx=0x7f8cd402a8e0 comp rx=0 tx=0).stop 2024-09-19T08:51:17.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.827+0000 7f8ce266e640 1 -- 172.21.15.19:0/3350687986 shutdown_connections 2024-09-19T08:51:17.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.827+0000 7f8ce266e640 1 --2- 172.21.15.19:0/3350687986 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cdc101420 0x7f8cdc10d950 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:17.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.827+0000 7f8ce266e640 1 --2- 172.21.15.19:0/3350687986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cdc100a80 0x7f8cdc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:17.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.827+0000 7f8ce266e640 1 --2- 172.21.15.19:0/3350687986 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8cdc106a80 0x7f8cdc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:17.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.827+0000 7f8ce266e640 1 -- 172.21.15.19:0/3350687986 >> 172.21.15.19:0/3350687986 conn(0x7f8cdc0fc7a0 msgr2=0x7f8cdc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:17.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.827+0000 7f8ce266e640 1 -- 172.21.15.19:0/3350687986 shutdown_connections 2024-09-19T08:51:17.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.827+0000 7f8ce266e640 1 -- 172.21.15.19:0/3350687986 wait complete. 2024-09-19T08:51:17.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.828+0000 7f8ce266e640 1 Processor -- start 2024-09-19T08:51:17.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.828+0000 7f8ce266e640 1 -- start start 2024-09-19T08:51:17.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.828+0000 7f8ce266e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cdc100a80 0x7f8cdc198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:17.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.828+0000 7f8ce266e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8cdc101420 0x7f8cdc1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:17.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.828+0000 7f8ce266e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cdc106a80 0x7f8cdc19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:17.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.828+0000 7f8ce266e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8cdc110e80 con 0x7f8cdc100a80 2024-09-19T08:51:17.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.828+0000 7f8ce266e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8cdc110d00 con 0x7f8cdc106a80 2024-09-19T08:51:17.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.828+0000 7f8ce266e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8cdc111000 con 0x7f8cdc101420 2024-09-19T08:51:17.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.828+0000 7f8cdbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cdc100a80 0x7f8cdc198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:17.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.828+0000 7f8cdbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cdc100a80 0x7f8cdc198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34748/0 (socket says 172.21.15.19:34748) 2024-09-19T08:51:17.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.828+0000 7f8cdbfff640 1 -- 172.21.15.19:0/2034353639 learned_addr learned my addr 172.21.15.19:0/2034353639 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:17.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.828+0000 7f8cdb7fe640 1 --2- 172.21.15.19:0/2034353639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8cdc101420 0x7f8cdc1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:17.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.828+0000 7f8ce0c0b640 1 --2- 172.21.15.19:0/2034353639 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cdc106a80 0x7f8cdc19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:17.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.829+0000 7f8cdbfff640 1 -- 172.21.15.19:0/2034353639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8cdc101420 msgr2=0x7f8cdc1989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:17.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.829+0000 7f8cdbfff640 1 --2- 172.21.15.19:0/2034353639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8cdc101420 0x7f8cdc1989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:17.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.829+0000 7f8cdbfff640 1 -- 172.21.15.19:0/2034353639 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cdc106a80 msgr2=0x7f8cdc19cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:17.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.829+0000 7f8cdbfff640 1 --2- 172.21.15.19:0/2034353639 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cdc106a80 0x7f8cdc19cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:17.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.829+0000 7f8cdbfff640 1 -- 172.21.15.19:0/2034353639 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cdc19d420 con 0x7f8cdc100a80 2024-09-19T08:51:17.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.829+0000 7f8cdbfff640 1 --2- 172.21.15.19:0/2034353639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cdc100a80 0x7f8cdc198470 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00c970 tx=0x7f8ccc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:17.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.829+0000 7f8cd97fa640 1 -- 172.21.15.19:0/2034353639 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc007bb0 con 0x7f8cdc100a80 2024-09-19T08:51:17.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.829+0000 7f8cd97fa640 1 -- 172.21.15.19:0/2034353639 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8ccc007d50 con 0x7f8cdc100a80 2024-09-19T08:51:17.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.829+0000 7f8ce266e640 1 -- 172.21.15.19:0/2034353639 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cdc19d710 con 0x7f8cdc100a80 2024-09-19T08:51:17.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.829+0000 7f8cd97fa640 1 -- 172.21.15.19:0/2034353639 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc00f450 con 0x7f8cdc100a80 2024-09-19T08:51:17.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.829+0000 7f8ce266e640 1 -- 172.21.15.19:0/2034353639 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cdc1a4ff0 con 0x7f8cdc100a80 2024-09-19T08:51:17.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.830+0000 7f8ce266e640 1 -- 172.21.15.19:0/2034353639 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cdc100ee0 con 0x7f8cdc100a80 2024-09-19T08:51:17.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.831+0000 7f8cd97fa640 1 -- 172.21.15.19:0/2034353639 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8ccc005020 con 0x7f8cdc100a80 2024-09-19T08:51:17.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.832+0000 7f8cd97fa640 1 --2- 172.21.15.19:0/2034353639 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8cc40a3350 0x7f8cc40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:17.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.832+0000 7f8cdb7fe640 1 --2- 172.21.15.19:0/2034353639 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8cc40a3350 0x7f8cc40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:17.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.832+0000 7f8cd97fa640 1 -- 172.21.15.19:0/2034353639 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f8ccc0cf560 con 0x7f8cdc100a80 2024-09-19T08:51:17.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.832+0000 7f8cdb7fe640 1 --2- 172.21.15.19:0/2034353639 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8cc40a3350 0x7f8cc40a5810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc105150 tx=0x7f8cd000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:17.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:17.836+0000 7f8cd97fa640 1 -- 172.21.15.19:0/2034353639 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8ccc014030 con 0x7f8cdc100a80 2024-09-19T08:51:17.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:17 smithi155 ceph-mon[34921]: pgmap v307: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T08:51:17.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:17 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3820718321' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T08:51:17.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:17 smithi203 ceph-mon[35450]: pgmap v307: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T08:51:17.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:17 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3820718321' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T08:51:18.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.016+0000 7f8ce266e640 1 -- 172.21.15.19:0/2034353639 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f8cdc109a70 con 0x7f8cdc100a80 2024-09-19T08:51:18.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.016+0000 7f8cd97fa640 1 -- 172.21.15.19:0/2034353639 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f8ccc09bc80 con 0x7f8cdc100a80 2024-09-19T08:51:18.016 INFO:teuthology.orchestra.run.smithi019.stdout:154618822712 2024-09-19T08:51:18.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.018+0000 7f8ce266e640 1 -- 172.21.15.19:0/2034353639 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8cc40a3350 msgr2=0x7f8cc40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:18.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.018+0000 7f8ce266e640 1 --2- 172.21.15.19:0/2034353639 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8cc40a3350 0x7f8cc40a5810 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc105150 tx=0x7f8cd000b410 comp rx=0 tx=0).stop 2024-09-19T08:51:18.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.018+0000 7f8ce266e640 1 -- 172.21.15.19:0/2034353639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cdc100a80 msgr2=0x7f8cdc198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:18.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.018+0000 7f8ce266e640 1 --2- 172.21.15.19:0/2034353639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cdc100a80 0x7f8cdc198470 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00c970 tx=0x7f8ccc00ce30 comp rx=0 tx=0).stop 2024-09-19T08:51:18.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.019+0000 7f8ce266e640 1 -- 172.21.15.19:0/2034353639 shutdown_connections 2024-09-19T08:51:18.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.019+0000 7f8ce266e640 1 --2- 172.21.15.19:0/2034353639 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8cc40a3350 0x7f8cc40a5810 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.019+0000 7f8ce266e640 1 --2- 172.21.15.19:0/2034353639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8cdc101420 0x7f8cdc1989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.019+0000 7f8ce266e640 1 --2- 172.21.15.19:0/2034353639 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8cdc106a80 0x7f8cdc19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.019+0000 7f8ce266e640 1 --2- 172.21.15.19:0/2034353639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8cdc100a80 0x7f8cdc198470 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.019+0000 7f8ce266e640 1 -- 172.21.15.19:0/2034353639 >> 172.21.15.19:0/2034353639 conn(0x7f8cdc0fc7a0 msgr2=0x7f8cdc06aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:18.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.019+0000 7f8ce266e640 1 -- 172.21.15.19:0/2034353639 shutdown_connections 2024-09-19T08:51:18.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.019+0000 7f8ce266e640 1 -- 172.21.15.19:0/2034353639 wait complete. 2024-09-19T08:51:18.309 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593775 got 184683593779 for osd.6 2024-09-19T08:51:18.309 DEBUG:teuthology.parallel:result is None 2024-09-19T08:51:18.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:18 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/2034353639' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T08:51:18.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.770+0000 7f83de139640 1 -- 172.21.15.19:0/1098648818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83d8102d40 msgr2=0x7f83d8103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:18.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.770+0000 7f83de139640 1 --2- 172.21.15.19:0/1098648818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83d8102d40 0x7f83d8103120 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f83c8009900 tx=0x7f83c802a480 comp rx=0 tx=0).stop 2024-09-19T08:51:18.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.770+0000 7f83de139640 1 -- 172.21.15.19:0/1098648818 shutdown_connections 2024-09-19T08:51:18.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.770+0000 7f83de139640 1 --2- 172.21.15.19:0/1098648818 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83d810c170 0x7f83d810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.770+0000 7f83de139640 1 --2- 172.21.15.19:0/1098648818 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83d8103660 0x7f83d810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.770+0000 7f83de139640 1 --2- 172.21.15.19:0/1098648818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83d8102d40 0x7f83d8103120 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.770+0000 7f83de139640 1 -- 172.21.15.19:0/1098648818 >> 172.21.15.19:0/1098648818 conn(0x7f83d80fc7a0 msgr2=0x7f83d80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:18.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.770+0000 7f83de139640 1 -- 172.21.15.19:0/1098648818 shutdown_connections 2024-09-19T08:51:18.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.770+0000 7f83de139640 1 -- 172.21.15.19:0/1098648818 wait complete. 2024-09-19T08:51:18.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.771+0000 7f83de139640 1 Processor -- start 2024-09-19T08:51:18.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.771+0000 7f83de139640 1 -- start start 2024-09-19T08:51:18.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.771+0000 7f83de139640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83d8102d40 0x7f83d8198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:18.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.771+0000 7f83de139640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83d8103660 0x7f83d81989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:18.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.771+0000 7f83de139640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83d810c170 0x7f83d819cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:18.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.771+0000 7f83de139640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f83d8111fb0 con 0x7f83d8102d40 2024-09-19T08:51:18.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.771+0000 7f83de139640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f83d8111e30 con 0x7f83d810c170 2024-09-19T08:51:18.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.771+0000 7f83de139640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f83d8112130 con 0x7f83d8103660 2024-09-19T08:51:18.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.771+0000 7f83d77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83d8102d40 0x7f83d8198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:18.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.772+0000 7f83d77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83d8102d40 0x7f83d8198480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34780/0 (socket says 172.21.15.19:34780) 2024-09-19T08:51:18.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.772+0000 7f83d77fe640 1 -- 172.21.15.19:0/2799533818 learned_addr learned my addr 172.21.15.19:0/2799533818 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:18.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.772+0000 7f83d7fff640 1 --2- 172.21.15.19:0/2799533818 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83d810c170 0x7f83d819cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:18.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.772+0000 7f83d6ffd640 1 --2- 172.21.15.19:0/2799533818 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83d8103660 0x7f83d81989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:18.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.772+0000 7f83d77fe640 1 -- 172.21.15.19:0/2799533818 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83d8103660 msgr2=0x7f83d81989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:18.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.772+0000 7f83d77fe640 1 --2- 172.21.15.19:0/2799533818 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83d8103660 0x7f83d81989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.772+0000 7f83d77fe640 1 -- 172.21.15.19:0/2799533818 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83d810c170 msgr2=0x7f83d819cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:18.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.772+0000 7f83d77fe640 1 --2- 172.21.15.19:0/2799533818 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83d810c170 0x7f83d819cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.772+0000 7f83d77fe640 1 -- 172.21.15.19:0/2799533818 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83d819d430 con 0x7f83d8102d40 2024-09-19T08:51:18.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.772+0000 7f83d7fff640 1 --2- 172.21.15.19:0/2799533818 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83d810c170 0x7f83d819cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:18.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.772+0000 7f83d77fe640 1 --2- 172.21.15.19:0/2799533818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83d8102d40 0x7f83d8198480 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f83c8006010 tx=0x7f83c80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:18.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.772+0000 7f83d4ff9640 1 -- 172.21.15.19:0/2799533818 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c803f030 con 0x7f83d8102d40 2024-09-19T08:51:18.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.772+0000 7f83de139640 1 -- 172.21.15.19:0/2799533818 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83d819d6c0 con 0x7f83d8102d40 2024-09-19T08:51:18.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.772+0000 7f83d4ff9640 1 -- 172.21.15.19:0/2799533818 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f83c8003ce0 con 0x7f83d8102d40 2024-09-19T08:51:18.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.772+0000 7f83d4ff9640 1 -- 172.21.15.19:0/2799533818 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c8035070 con 0x7f83d8102d40 2024-09-19T08:51:18.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.772+0000 7f83de139640 1 -- 172.21.15.19:0/2799533818 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83d81a5000 con 0x7f83d8102d40 2024-09-19T08:51:18.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.773+0000 7f83de139640 1 -- 172.21.15.19:0/2799533818 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83d8103120 con 0x7f83d8102d40 2024-09-19T08:51:18.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.775+0000 7f83d4ff9640 1 -- 172.21.15.19:0/2799533818 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f83c8042030 con 0x7f83d8102d40 2024-09-19T08:51:18.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.775+0000 7f83d4ff9640 1 --2- 172.21.15.19:0/2799533818 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f83c00a32d0 0x7f83c00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:18.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.775+0000 7f83d6ffd640 1 --2- 172.21.15.19:0/2799533818 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f83c00a32d0 0x7f83c00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:18.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.775+0000 7f83d4ff9640 1 -- 172.21.15.19:0/2799533818 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f83c80f00d0 con 0x7f83d8102d40 2024-09-19T08:51:18.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.776+0000 7f83d6ffd640 1 --2- 172.21.15.19:0/2799533818 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f83c00a32d0 0x7f83c00a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f83cc004630 tx=0x7f83cc005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:18.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.779+0000 7f83d4ff9640 1 -- 172.21.15.19:0/2799533818 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f83c80bce00 con 0x7f83d8102d40 2024-09-19T08:51:18.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:18 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/2034353639' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T08:51:18.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.958+0000 7f83de139640 1 -- 172.21.15.19:0/2799533818 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f83d8107210 con 0x7f83d8102d40 2024-09-19T08:51:18.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.958+0000 7f83d4ff9640 1 -- 172.21.15.19:0/2799533818 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f83c80bc700 con 0x7f83d8102d40 2024-09-19T08:51:18.958 INFO:teuthology.orchestra.run.smithi019.stdout:137438953532 2024-09-19T08:51:18.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.960+0000 7f83de139640 1 -- 172.21.15.19:0/2799533818 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f83c00a32d0 msgr2=0x7f83c00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:18.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.960+0000 7f83de139640 1 --2- 172.21.15.19:0/2799533818 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f83c00a32d0 0x7f83c00a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f83cc004630 tx=0x7f83cc005c50 comp rx=0 tx=0).stop 2024-09-19T08:51:18.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.960+0000 7f83de139640 1 -- 172.21.15.19:0/2799533818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83d8102d40 msgr2=0x7f83d8198480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:18.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.960+0000 7f83de139640 1 --2- 172.21.15.19:0/2799533818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83d8102d40 0x7f83d8198480 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f83c8006010 tx=0x7f83c80042f0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.960+0000 7f83de139640 1 -- 172.21.15.19:0/2799533818 shutdown_connections 2024-09-19T08:51:18.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.960+0000 7f83de139640 1 --2- 172.21.15.19:0/2799533818 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f83c00a32d0 0x7f83c00a5790 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.960+0000 7f83de139640 1 --2- 172.21.15.19:0/2799533818 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83d8103660 0x7f83d81989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.960+0000 7f83de139640 1 --2- 172.21.15.19:0/2799533818 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83d810c170 0x7f83d819cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.960+0000 7f83de139640 1 --2- 172.21.15.19:0/2799533818 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83d8102d40 0x7f83d8198480 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:18.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.960+0000 7f83de139640 1 -- 172.21.15.19:0/2799533818 >> 172.21.15.19:0/2799533818 conn(0x7f83d80fc7a0 msgr2=0x7f83d80fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:18.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.960+0000 7f83de139640 1 -- 172.21.15.19:0/2799533818 shutdown_connections 2024-09-19T08:51:18.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:18.960+0000 7f83de139640 1 -- 172.21.15.19:0/2799533818 wait complete. 2024-09-19T08:51:18.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:18 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/2034353639' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T08:51:19.210 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822707 got 154618822712 for osd.5 2024-09-19T08:51:19.211 DEBUG:teuthology.parallel:result is None 2024-09-19T08:51:19.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:19 smithi019 ceph-mon[30976]: pgmap v308: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T08:51:19.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:19 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/2799533818' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T08:51:19.879 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953529 got 137438953532 for osd.4 2024-09-19T08:51:19.879 DEBUG:teuthology.parallel:result is None 2024-09-19T08:51:19.879 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T08:51:19.879 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:51:19.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:19 smithi155 ceph-mon[34921]: pgmap v308: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T08:51:19.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:19 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/2799533818' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T08:51:19.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:19 smithi203 ceph-mon[35450]: pgmap v308: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T08:51:19.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:19 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/2799533818' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T08:51:20.682 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:21.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.185+0000 7f4781348640 1 -- 172.21.15.19:0/3783532907 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f477c106f10 msgr2=0x7f477c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:21.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.185+0000 7f4781348640 1 --2- 172.21.15.19:0/3783532907 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f477c106f10 0x7f477c10ea90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f4774009ca0 tx=0x7f477402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.185+0000 7f4781348640 1 -- 172.21.15.19:0/3783532907 shutdown_connections 2024-09-19T08:51:21.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.185+0000 7f4781348640 1 --2- 172.21.15.19:0/3783532907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f477c102790 0x7f477c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.185+0000 7f4781348640 1 --2- 172.21.15.19:0/3783532907 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f477c106f10 0x7f477c10ea90 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.185+0000 7f4781348640 1 --2- 172.21.15.19:0/3783532907 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f477c101de0 0x7f477c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.185+0000 7f4781348640 1 -- 172.21.15.19:0/3783532907 >> 172.21.15.19:0/3783532907 conn(0x7f477c0fd8c0 msgr2=0x7f477c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:21.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.186+0000 7f4781348640 1 -- 172.21.15.19:0/3783532907 shutdown_connections 2024-09-19T08:51:21.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.186+0000 7f4781348640 1 -- 172.21.15.19:0/3783532907 wait complete. 2024-09-19T08:51:21.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.186+0000 7f4781348640 1 Processor -- start 2024-09-19T08:51:21.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.186+0000 7f4781348640 1 -- start start 2024-09-19T08:51:21.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.187+0000 7f4781348640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f477c101de0 0x7f477c198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:21.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.187+0000 7f4781348640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f477c102790 0x7f477c1987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:21.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.187+0000 7f4781348640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f477c106f10 0x7f477c19cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:21.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.187+0000 7f4781348640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f477c111f70 con 0x7f477c102790 2024-09-19T08:51:21.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.187+0000 7f4781348640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f477c111df0 con 0x7f477c101de0 2024-09-19T08:51:21.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.187+0000 7f4781348640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f477c1120f0 con 0x7f477c106f10 2024-09-19T08:51:21.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.187+0000 7f477a7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f477c102790 0x7f477c1987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:21.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.187+0000 7f477a7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f477c102790 0x7f477c1987c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34792/0 (socket says 172.21.15.19:34792) 2024-09-19T08:51:21.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.187+0000 7f477a7fc640 1 -- 172.21.15.19:0/444152022 learned_addr learned my addr 172.21.15.19:0/444152022 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:21.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.187+0000 7f477b7fe640 1 --2- 172.21.15.19:0/444152022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f477c106f10 0x7f477c19cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:21.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.187+0000 7f477affd640 1 --2- 172.21.15.19:0/444152022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f477c101de0 0x7f477c198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:21.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.187+0000 7f477a7fc640 1 -- 172.21.15.19:0/444152022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f477c106f10 msgr2=0x7f477c19cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:21.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.187+0000 7f477a7fc640 1 --2- 172.21.15.19:0/444152022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f477c106f10 0x7f477c19cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.187+0000 7f477a7fc640 1 -- 172.21.15.19:0/444152022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f477c101de0 msgr2=0x7f477c198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:21.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.187+0000 7f477a7fc640 1 --2- 172.21.15.19:0/444152022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f477c101de0 0x7f477c198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.187+0000 7f477a7fc640 1 -- 172.21.15.19:0/444152022 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f477c19d230 con 0x7f477c102790 2024-09-19T08:51:21.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.187+0000 7f477affd640 1 --2- 172.21.15.19:0/444152022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f477c101de0 0x7f477c198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:51:21.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.187+0000 7f477a7fc640 1 --2- 172.21.15.19:0/444152022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f477c102790 0x7f477c1987c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f477000c920 tx=0x7f477000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:21.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.187+0000 7f4763fff640 1 -- 172.21.15.19:0/444152022 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4770007c70 con 0x7f477c102790 2024-09-19T08:51:21.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.187+0000 7f4781348640 1 -- 172.21.15.19:0/444152022 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f477c19d520 con 0x7f477c102790 2024-09-19T08:51:21.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.187+0000 7f4763fff640 1 -- 172.21.15.19:0/444152022 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4770007e10 con 0x7f477c102790 2024-09-19T08:51:21.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.187+0000 7f4763fff640 1 -- 172.21.15.19:0/444152022 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4770018890 con 0x7f477c102790 2024-09-19T08:51:21.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.187+0000 7f4781348640 1 -- 172.21.15.19:0/444152022 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f477c1a4e00 con 0x7f477c102790 2024-09-19T08:51:21.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.189+0000 7f4781348640 1 -- 172.21.15.19:0/444152022 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f477c1021c0 con 0x7f477c102790 2024-09-19T08:51:21.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.190+0000 7f4763fff640 1 -- 172.21.15.19:0/444152022 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4770018a70 con 0x7f477c102790 2024-09-19T08:51:21.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.190+0000 7f4763fff640 1 --2- 172.21.15.19:0/444152022 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f47640a32d0 0x7f47640a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:21.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.191+0000 7f477affd640 1 --2- 172.21.15.19:0/444152022 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f47640a32d0 0x7f47640a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:21.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.191+0000 7f4763fff640 1 -- 172.21.15.19:0/444152022 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f47700cf9f0 con 0x7f477c102790 2024-09-19T08:51:21.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.191+0000 7f477affd640 1 --2- 172.21.15.19:0/444152022 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f47640a32d0 0x7f47640a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f476c00baa0 tx=0x7f476c005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:21.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.195+0000 7f4763fff640 1 -- 172.21.15.19:0/444152022 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4770014030 con 0x7f477c102790 2024-09-19T08:51:21.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.373+0000 7f4781348640 1 -- 172.21.15.19:0/444152022 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f477c0ffc00 con 0x7f47640a32d0 2024-09-19T08:51:21.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.381+0000 7f4763fff640 1 -- 172.21.15.19:0/444152022 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258888 (secure 0 0 0) 0x7f477c0ffc00 con 0x7f47640a32d0 2024-09-19T08:51:21.383 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:51:21.384 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-19T08:51:21.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.385+0000 7f4781348640 1 -- 172.21.15.19:0/444152022 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f47640a32d0 msgr2=0x7f47640a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:21.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.385+0000 7f4781348640 1 --2- 172.21.15.19:0/444152022 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f47640a32d0 0x7f47640a5790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f476c00baa0 tx=0x7f476c005d90 comp rx=0 tx=0).stop 2024-09-19T08:51:21.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.385+0000 7f4781348640 1 -- 172.21.15.19:0/444152022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f477c102790 msgr2=0x7f477c1987c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:21.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.385+0000 7f4781348640 1 --2- 172.21.15.19:0/444152022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f477c102790 0x7f477c1987c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f477000c920 tx=0x7f477000cde0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.385+0000 7f4781348640 1 -- 172.21.15.19:0/444152022 shutdown_connections 2024-09-19T08:51:21.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.385+0000 7f4781348640 1 --2- 172.21.15.19:0/444152022 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f47640a32d0 0x7f47640a5790 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.385+0000 7f4781348640 1 --2- 172.21.15.19:0/444152022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f477c106f10 0x7f477c19cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.385+0000 7f4781348640 1 --2- 172.21.15.19:0/444152022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f477c102790 0x7f477c1987c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.385+0000 7f4781348640 1 --2- 172.21.15.19:0/444152022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f477c101de0 0x7f477c198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:21.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.385+0000 7f4781348640 1 -- 172.21.15.19:0/444152022 >> 172.21.15.19:0/444152022 conn(0x7f477c0fd8c0 msgr2=0x7f477c0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:21.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.385+0000 7f4781348640 1 -- 172.21.15.19:0/444152022 shutdown_connections 2024-09-19T08:51:21.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:21.385+0000 7f4781348640 1 -- 172.21.15.19:0/444152022 wait complete. 2024-09-19T08:51:21.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:21 smithi019 ceph-mon[30976]: pgmap v309: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T08:51:21.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:21 smithi155 ceph-mon[34921]: pgmap v309: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T08:51:21.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:21 smithi203 ceph-mon[35450]: pgmap v309: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T08:51:22.102 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":309,"stamp":"2024-09-19T08:51:19.861945+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657021,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":662,"num_read_kb":453,"num_write":424,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":346,"ondisk_log_size":346,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":355888,"kb_used_data":10800,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585936,"statfs":{"total":1151940427776,"available":1151575998464,"internally_reserved":0,"allocated":11059200,"data_stored":6951855,"data_compressed":107538,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19142,"internal_metadata":353154362},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":70,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003072"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.885166+0000","last_change":"2024-09-19T08:50:15.893270+0000","last_active":"2024-09-19T08:50:16.885166+0000","last_peered":"2024-09-19T08:50:16.885166+0000","last_clean":"2024-09-19T08:50:16.885166+0000","last_became_active":"2024-09-19T08:50:15.892020+0000","last_became_peered":"2024-09-19T08:50:15.892020+0000","last_unstale":"2024-09-19T08:50:16.885166+0000","last_undegraded":"2024-09-19T08:50:16.885166+0000","last_fullsized":"2024-09-19T08:50:16.885166+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:40.846708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877980+0000","last_change":"2024-09-19T08:50:15.889331+0000","last_active":"2024-09-19T08:50:16.877980+0000","last_peered":"2024-09-19T08:50:16.877980+0000","last_clean":"2024-09-19T08:50:16.877980+0000","last_became_active":"2024-09-19T08:50:15.887082+0000","last_became_peered":"2024-09-19T08:50:15.887082+0000","last_unstale":"2024-09-19T08:50:16.877980+0000","last_undegraded":"2024-09-19T08:50:16.877980+0000","last_fullsized":"2024-09-19T08:50:16.877980+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:46.934172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877371+0000","last_change":"2024-09-19T08:50:15.891714+0000","last_active":"2024-09-19T08:50:16.877371+0000","last_peered":"2024-09-19T08:50:16.877371+0000","last_clean":"2024-09-19T08:50:16.877371+0000","last_became_active":"2024-09-19T08:50:15.891380+0000","last_became_peered":"2024-09-19T08:50:15.891380+0000","last_unstale":"2024-09-19T08:50:16.877371+0000","last_undegraded":"2024-09-19T08:50:16.877371+0000","last_fullsized":"2024-09-19T08:50:16.877371+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:02.203252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.880548+0000","last_change":"2024-09-19T08:50:15.896157+0000","last_active":"2024-09-19T08:50:16.880548+0000","last_peered":"2024-09-19T08:50:16.880548+0000","last_clean":"2024-09-19T08:50:16.880548+0000","last_became_active":"2024-09-19T08:50:15.895772+0000","last_became_peered":"2024-09-19T08:50:15.895772+0000","last_unstale":"2024-09-19T08:50:16.880548+0000","last_undegraded":"2024-09-19T08:50:16.880548+0000","last_fullsized":"2024-09-19T08:50:16.880548+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:12.915745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877401+0000","last_change":"2024-09-19T08:50:15.886600+0000","last_active":"2024-09-19T08:50:16.877401+0000","last_peered":"2024-09-19T08:50:16.877401+0000","last_clean":"2024-09-19T08:50:16.877401+0000","last_became_active":"2024-09-19T08:50:15.886270+0000","last_became_peered":"2024-09-19T08:50:15.886270+0000","last_unstale":"2024-09-19T08:50:16.877401+0000","last_undegraded":"2024-09-19T08:50:16.877401+0000","last_fullsized":"2024-09-19T08:50:16.877401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:53.779930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869832+0000","last_change":"2024-09-19T08:50:15.889475+0000","last_active":"2024-09-19T08:50:16.869832+0000","last_peered":"2024-09-19T08:50:16.869832+0000","last_clean":"2024-09-19T08:50:16.869832+0000","last_became_active":"2024-09-19T08:50:15.889134+0000","last_became_peered":"2024-09-19T08:50:15.889134+0000","last_unstale":"2024-09-19T08:50:16.869832+0000","last_undegraded":"2024-09-19T08:50:16.869832+0000","last_fullsized":"2024-09-19T08:50:16.869832+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:53.977662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877346+0000","last_change":"2024-09-19T08:50:15.897163+0000","last_active":"2024-09-19T08:50:16.877346+0000","last_peered":"2024-09-19T08:50:16.877346+0000","last_clean":"2024-09-19T08:50:16.877346+0000","last_became_active":"2024-09-19T08:50:15.895161+0000","last_became_peered":"2024-09-19T08:50:15.895161+0000","last_unstale":"2024-09-19T08:50:16.877346+0000","last_undegraded":"2024-09-19T08:50:16.877346+0000","last_fullsized":"2024-09-19T08:50:16.877346+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:32.432691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869011+0000","last_change":"2024-09-19T08:50:15.891197+0000","last_active":"2024-09-19T08:50:16.869011+0000","last_peered":"2024-09-19T08:50:16.869011+0000","last_clean":"2024-09-19T08:50:16.869011+0000","last_became_active":"2024-09-19T08:50:15.890880+0000","last_became_peered":"2024-09-19T08:50:15.890880+0000","last_unstale":"2024-09-19T08:50:16.869011+0000","last_undegraded":"2024-09-19T08:50:16.869011+0000","last_fullsized":"2024-09-19T08:50:16.869011+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:41.100341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877991+0000","last_change":"2024-09-19T08:50:15.896043+0000","last_active":"2024-09-19T08:50:16.877991+0000","last_peered":"2024-09-19T08:50:16.877991+0000","last_clean":"2024-09-19T08:50:16.877991+0000","last_became_active":"2024-09-19T08:50:15.895498+0000","last_became_peered":"2024-09-19T08:50:15.895498+0000","last_unstale":"2024-09-19T08:50:16.877991+0000","last_undegraded":"2024-09-19T08:50:16.877991+0000","last_fullsized":"2024-09-19T08:50:16.877991+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:57.956427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.870481+0000","last_change":"2024-09-19T08:50:15.887658+0000","last_active":"2024-09-19T08:50:16.870481+0000","last_peered":"2024-09-19T08:50:16.870481+0000","last_clean":"2024-09-19T08:50:16.870481+0000","last_became_active":"2024-09-19T08:50:15.887199+0000","last_became_peered":"2024-09-19T08:50:15.887199+0000","last_unstale":"2024-09-19T08:50:16.870481+0000","last_undegraded":"2024-09-19T08:50:16.870481+0000","last_fullsized":"2024-09-19T08:50:16.870481+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:39.947735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876931+0000","last_change":"2024-09-19T08:50:15.894865+0000","last_active":"2024-09-19T08:50:16.876931+0000","last_peered":"2024-09-19T08:50:16.876931+0000","last_clean":"2024-09-19T08:50:16.876931+0000","last_became_active":"2024-09-19T08:50:15.894475+0000","last_became_peered":"2024-09-19T08:50:15.894475+0000","last_unstale":"2024-09-19T08:50:16.876931+0000","last_undegraded":"2024-09-19T08:50:16.876931+0000","last_fullsized":"2024-09-19T08:50:16.876931+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:43.235991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.880654+0000","last_change":"2024-09-19T08:50:15.897209+0000","last_active":"2024-09-19T08:50:16.880654+0000","last_peered":"2024-09-19T08:50:16.880654+0000","last_clean":"2024-09-19T08:50:16.880654+0000","last_became_active":"2024-09-19T08:50:15.896866+0000","last_became_peered":"2024-09-19T08:50:15.896866+0000","last_unstale":"2024-09-19T08:50:16.880654+0000","last_undegraded":"2024-09-19T08:50:16.880654+0000","last_fullsized":"2024-09-19T08:50:16.880654+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:23.036534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876974+0000","last_change":"2024-09-19T08:50:15.890076+0000","last_active":"2024-09-19T08:50:16.876974+0000","last_peered":"2024-09-19T08:50:16.876974+0000","last_clean":"2024-09-19T08:50:16.876974+0000","last_became_active":"2024-09-19T08:50:15.889735+0000","last_became_peered":"2024-09-19T08:50:15.889735+0000","last_unstale":"2024-09-19T08:50:16.876974+0000","last_undegraded":"2024-09-19T08:50:16.876974+0000","last_fullsized":"2024-09-19T08:50:16.876974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:25.602757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877013+0000","last_change":"2024-09-19T08:50:15.886739+0000","last_active":"2024-09-19T08:50:16.877013+0000","last_peered":"2024-09-19T08:50:16.877013+0000","last_clean":"2024-09-19T08:50:16.877013+0000","last_became_active":"2024-09-19T08:50:15.886313+0000","last_became_peered":"2024-09-19T08:50:15.886313+0000","last_unstale":"2024-09-19T08:50:16.877013+0000","last_undegraded":"2024-09-19T08:50:16.877013+0000","last_fullsized":"2024-09-19T08:50:16.877013+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:03.244674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876731+0000","last_change":"2024-09-19T08:50:15.898519+0000","last_active":"2024-09-19T08:50:16.876731+0000","last_peered":"2024-09-19T08:50:16.876731+0000","last_clean":"2024-09-19T08:50:16.876731+0000","last_became_active":"2024-09-19T08:50:15.898249+0000","last_became_peered":"2024-09-19T08:50:15.898249+0000","last_unstale":"2024-09-19T08:50:16.876731+0000","last_undegraded":"2024-09-19T08:50:16.876731+0000","last_fullsized":"2024-09-19T08:50:16.876731+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:32.318895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876236+0000","last_change":"2024-09-19T08:50:15.890324+0000","last_active":"2024-09-19T08:50:16.876236+0000","last_peered":"2024-09-19T08:50:16.876236+0000","last_clean":"2024-09-19T08:50:16.876236+0000","last_became_active":"2024-09-19T08:50:15.887345+0000","last_became_peered":"2024-09-19T08:50:15.887345+0000","last_unstale":"2024-09-19T08:50:16.876236+0000","last_undegraded":"2024-09-19T08:50:16.876236+0000","last_fullsized":"2024-09-19T08:50:16.876236+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:27.989128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.885345+0000","last_change":"2024-09-19T08:50:15.896305+0000","last_active":"2024-09-19T08:50:16.885345+0000","last_peered":"2024-09-19T08:50:16.885345+0000","last_clean":"2024-09-19T08:50:16.885345+0000","last_became_active":"2024-09-19T08:50:15.895832+0000","last_became_peered":"2024-09-19T08:50:15.895832+0000","last_unstale":"2024-09-19T08:50:16.885345+0000","last_undegraded":"2024-09-19T08:50:16.885345+0000","last_fullsized":"2024-09-19T08:50:16.885345+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:37.098237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.880615+0000","last_change":"2024-09-19T08:50:15.887251+0000","last_active":"2024-09-19T08:50:16.880615+0000","last_peered":"2024-09-19T08:50:16.880615+0000","last_clean":"2024-09-19T08:50:16.880615+0000","last_became_active":"2024-09-19T08:50:15.886936+0000","last_became_peered":"2024-09-19T08:50:15.886936+0000","last_unstale":"2024-09-19T08:50:16.880615+0000","last_undegraded":"2024-09-19T08:50:16.880615+0000","last_fullsized":"2024-09-19T08:50:16.880615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:38:08.828246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877371+0000","last_change":"2024-09-19T08:50:15.884813+0000","last_active":"2024-09-19T08:50:16.877371+0000","last_peered":"2024-09-19T08:50:16.877371+0000","last_clean":"2024-09-19T08:50:16.877371+0000","last_became_active":"2024-09-19T08:50:15.883445+0000","last_became_peered":"2024-09-19T08:50:15.883445+0000","last_unstale":"2024-09-19T08:50:16.877371+0000","last_undegraded":"2024-09-19T08:50:16.877371+0000","last_fullsized":"2024-09-19T08:50:16.877371+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:39.733501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.884301+0000","last_change":"2024-09-19T08:50:15.887644+0000","last_active":"2024-09-19T08:50:16.884301+0000","last_peered":"2024-09-19T08:50:16.884301+0000","last_clean":"2024-09-19T08:50:16.884301+0000","last_became_active":"2024-09-19T08:50:15.887224+0000","last_became_peered":"2024-09-19T08:50:15.887224+0000","last_unstale":"2024-09-19T08:50:16.884301+0000","last_undegraded":"2024-09-19T08:50:16.884301+0000","last_fullsized":"2024-09-19T08:50:16.884301+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:35.883690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.878822+0000","last_change":"2024-09-19T08:50:15.886678+0000","last_active":"2024-09-19T08:50:16.878822+0000","last_peered":"2024-09-19T08:50:16.878822+0000","last_clean":"2024-09-19T08:50:16.878822+0000","last_became_active":"2024-09-19T08:50:15.886360+0000","last_became_peered":"2024-09-19T08:50:15.886360+0000","last_unstale":"2024-09-19T08:50:16.878822+0000","last_undegraded":"2024-09-19T08:50:16.878822+0000","last_fullsized":"2024-09-19T08:50:16.878822+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:51.515211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876586+0000","last_change":"2024-09-19T08:50:15.887607+0000","last_active":"2024-09-19T08:50:16.876586+0000","last_peered":"2024-09-19T08:50:16.876586+0000","last_clean":"2024-09-19T08:50:16.876586+0000","last_became_active":"2024-09-19T08:50:15.887266+0000","last_became_peered":"2024-09-19T08:50:15.887266+0000","last_unstale":"2024-09-19T08:50:16.876586+0000","last_undegraded":"2024-09-19T08:50:16.876586+0000","last_fullsized":"2024-09-19T08:50:16.876586+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:44:57.404160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.868953+0000","last_change":"2024-09-19T08:50:15.882651+0000","last_active":"2024-09-19T08:50:16.868953+0000","last_peered":"2024-09-19T08:50:16.868953+0000","last_clean":"2024-09-19T08:50:16.868953+0000","last_became_active":"2024-09-19T08:50:15.882298+0000","last_became_peered":"2024-09-19T08:50:15.882298+0000","last_unstale":"2024-09-19T08:50:16.868953+0000","last_undegraded":"2024-09-19T08:50:16.868953+0000","last_fullsized":"2024-09-19T08:50:16.868953+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:16.028013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869849+0000","last_change":"2024-09-19T08:50:15.880407+0000","last_active":"2024-09-19T08:50:16.869849+0000","last_peered":"2024-09-19T08:50:16.869849+0000","last_clean":"2024-09-19T08:50:16.869849+0000","last_became_active":"2024-09-19T08:50:15.880026+0000","last_became_peered":"2024-09-19T08:50:15.880026+0000","last_unstale":"2024-09-19T08:50:16.869849+0000","last_undegraded":"2024-09-19T08:50:16.869849+0000","last_fullsized":"2024-09-19T08:50:16.869849+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:16.600913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869489+0000","last_change":"2024-09-19T08:50:15.883573+0000","last_active":"2024-09-19T08:50:16.869489+0000","last_peered":"2024-09-19T08:50:16.869489+0000","last_clean":"2024-09-19T08:50:16.869489+0000","last_became_active":"2024-09-19T08:50:15.883258+0000","last_became_peered":"2024-09-19T08:50:15.883258+0000","last_unstale":"2024-09-19T08:50:16.869489+0000","last_undegraded":"2024-09-19T08:50:16.869489+0000","last_fullsized":"2024-09-19T08:50:16.869489+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:33.026579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877624+0000","last_change":"2024-09-19T08:50:15.889519+0000","last_active":"2024-09-19T08:50:16.877624+0000","last_peered":"2024-09-19T08:50:16.877624+0000","last_clean":"2024-09-19T08:50:16.877624+0000","last_became_active":"2024-09-19T08:50:15.889183+0000","last_became_peered":"2024-09-19T08:50:15.889183+0000","last_unstale":"2024-09-19T08:50:16.877624+0000","last_undegraded":"2024-09-19T08:50:16.877624+0000","last_fullsized":"2024-09-19T08:50:16.877624+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:06.725662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.884752+0000","last_change":"2024-09-19T08:50:15.894483+0000","last_active":"2024-09-19T08:50:16.884752+0000","last_peered":"2024-09-19T08:50:16.884752+0000","last_clean":"2024-09-19T08:50:16.884752+0000","last_became_active":"2024-09-19T08:50:15.893760+0000","last_became_peered":"2024-09-19T08:50:15.893760+0000","last_unstale":"2024-09-19T08:50:16.884752+0000","last_undegraded":"2024-09-19T08:50:16.884752+0000","last_fullsized":"2024-09-19T08:50:16.884752+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:23.686592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876894+0000","last_change":"2024-09-19T08:50:15.882393+0000","last_active":"2024-09-19T08:50:16.876894+0000","last_peered":"2024-09-19T08:50:16.876894+0000","last_clean":"2024-09-19T08:50:16.876894+0000","last_became_active":"2024-09-19T08:50:15.882040+0000","last_became_peered":"2024-09-19T08:50:15.882040+0000","last_unstale":"2024-09-19T08:50:16.876894+0000","last_undegraded":"2024-09-19T08:50:16.876894+0000","last_fullsized":"2024-09-19T08:50:16.876894+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:22.430017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.878384+0000","last_change":"2024-09-19T08:50:15.890919+0000","last_active":"2024-09-19T08:50:16.878384+0000","last_peered":"2024-09-19T08:50:16.878384+0000","last_clean":"2024-09-19T08:50:16.878384+0000","last_became_active":"2024-09-19T08:50:15.890256+0000","last_became_peered":"2024-09-19T08:50:15.890256+0000","last_unstale":"2024-09-19T08:50:16.878384+0000","last_undegraded":"2024-09-19T08:50:16.878384+0000","last_fullsized":"2024-09-19T08:50:16.878384+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:48.404890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877173+0000","last_change":"2024-09-19T08:50:15.888139+0000","last_active":"2024-09-19T08:50:16.877173+0000","last_peered":"2024-09-19T08:50:16.877173+0000","last_clean":"2024-09-19T08:50:16.877173+0000","last_became_active":"2024-09-19T08:50:15.886471+0000","last_became_peered":"2024-09-19T08:50:15.886471+0000","last_unstale":"2024-09-19T08:50:16.877173+0000","last_undegraded":"2024-09-19T08:50:16.877173+0000","last_fullsized":"2024-09-19T08:50:16.877173+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:20.545473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877882+0000","last_change":"2024-09-19T08:50:15.891354+0000","last_active":"2024-09-19T08:50:16.877882+0000","last_peered":"2024-09-19T08:50:16.877882+0000","last_clean":"2024-09-19T08:50:16.877882+0000","last_became_active":"2024-09-19T08:50:15.890900+0000","last_became_peered":"2024-09-19T08:50:15.890900+0000","last_unstale":"2024-09-19T08:50:16.877882+0000","last_undegraded":"2024-09-19T08:50:16.877882+0000","last_fullsized":"2024-09-19T08:50:16.877882+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:33.139637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.884989+0000","last_change":"2024-09-19T08:50:15.891501+0000","last_active":"2024-09-19T08:50:16.884989+0000","last_peered":"2024-09-19T08:50:16.884989+0000","last_clean":"2024-09-19T08:50:16.884989+0000","last_became_active":"2024-09-19T08:50:15.891183+0000","last_became_peered":"2024-09-19T08:50:15.891183+0000","last_unstale":"2024-09-19T08:50:16.884989+0000","last_undegraded":"2024-09-19T08:50:16.884989+0000","last_fullsized":"2024-09-19T08:50:16.884989+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:16.976705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877858+0000","last_change":"2024-09-19T08:50:15.882048+0000","last_active":"2024-09-19T08:50:16.877858+0000","last_peered":"2024-09-19T08:50:16.877858+0000","last_clean":"2024-09-19T08:50:16.877858+0000","last_became_active":"2024-09-19T08:50:15.881156+0000","last_became_peered":"2024-09-19T08:50:15.881156+0000","last_unstale":"2024-09-19T08:50:16.877858+0000","last_undegraded":"2024-09-19T08:50:16.877858+0000","last_fullsized":"2024-09-19T08:50:16.877858+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:33.198852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:51:14.010120+0000","last_change":"2024-09-19T08:50:13.800156+0000","last_active":"2024-09-19T08:51:14.010120+0000","last_peered":"2024-09-19T08:51:14.010120+0000","last_clean":"2024-09-19T08:51:14.010120+0000","last_became_active":"2024-09-19T08:50:13.799779+0000","last_became_peered":"2024-09-19T08:50:13.799779+0000","last_unstale":"2024-09-19T08:51:14.010120+0000","last_undegraded":"2024-09-19T08:51:14.010120+0000","last_fullsized":"2024-09-19T08:51:14.010120+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:38.033049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869794+0000","last_change":"2024-09-19T08:50:15.887252+0000","last_active":"2024-09-19T08:50:16.869794+0000","last_peered":"2024-09-19T08:50:16.869794+0000","last_clean":"2024-09-19T08:50:16.869794+0000","last_became_active":"2024-09-19T08:50:15.886899+0000","last_became_peered":"2024-09-19T08:50:15.886899+0000","last_unstale":"2024-09-19T08:50:16.869794+0000","last_undegraded":"2024-09-19T08:50:16.869794+0000","last_fullsized":"2024-09-19T08:50:16.869794+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:56.262387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:25.932594+0000","last_change":"2024-09-19T08:50:13.795380+0000","last_active":"2024-09-19T08:50:25.932594+0000","last_peered":"2024-09-19T08:50:25.932594+0000","last_clean":"2024-09-19T08:50:25.932594+0000","last_became_active":"2024-09-19T08:50:13.794944+0000","last_became_peered":"2024-09-19T08:50:13.794944+0000","last_unstale":"2024-09-19T08:50:25.932594+0000","last_undegraded":"2024-09-19T08:50:25.932594+0000","last_fullsized":"2024-09-19T08:50:25.932594+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:14.317408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:24.924364+0000","last_change":"2024-09-19T08:50:13.794010+0000","last_active":"2024-09-19T08:50:24.924364+0000","last_peered":"2024-09-19T08:50:24.924364+0000","last_clean":"2024-09-19T08:50:24.924364+0000","last_became_active":"2024-09-19T08:50:13.793677+0000","last_became_peered":"2024-09-19T08:50:13.793677+0000","last_unstale":"2024-09-19T08:50:24.924364+0000","last_undegraded":"2024-09-19T08:50:24.924364+0000","last_fullsized":"2024-09-19T08:50:24.924364+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:56.125702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869056+0000","last_change":"2024-09-19T08:50:15.881732+0000","last_active":"2024-09-19T08:50:16.869056+0000","last_peered":"2024-09-19T08:50:16.869056+0000","last_clean":"2024-09-19T08:50:16.869056+0000","last_became_active":"2024-09-19T08:50:15.881394+0000","last_became_peered":"2024-09-19T08:50:15.881394+0000","last_unstale":"2024-09-19T08:50:16.869056+0000","last_undegraded":"2024-09-19T08:50:16.869056+0000","last_fullsized":"2024-09-19T08:50:16.869056+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:55.549138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.941084+0000","last_change":"2024-09-19T08:50:13.797118+0000","last_active":"2024-09-19T08:50:26.941084+0000","last_peered":"2024-09-19T08:50:26.941084+0000","last_clean":"2024-09-19T08:50:26.941084+0000","last_became_active":"2024-09-19T08:50:13.796727+0000","last_became_peered":"2024-09-19T08:50:13.796727+0000","last_unstale":"2024-09-19T08:50:26.941084+0000","last_undegraded":"2024-09-19T08:50:26.941084+0000","last_fullsized":"2024-09-19T08:50:26.941084+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:49.310543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.879798+0000","last_change":"2024-09-19T08:50:15.888192+0000","last_active":"2024-09-19T08:50:16.879798+0000","last_peered":"2024-09-19T08:50:16.879798+0000","last_clean":"2024-09-19T08:50:16.879798+0000","last_became_active":"2024-09-19T08:50:15.887890+0000","last_became_peered":"2024-09-19T08:50:15.887890+0000","last_unstale":"2024-09-19T08:50:16.879798+0000","last_undegraded":"2024-09-19T08:50:16.879798+0000","last_fullsized":"2024-09-19T08:50:16.879798+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:24:48.951856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":124,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:51:18.015041+0000","last_change":"2024-09-19T08:50:13.797427+0000","last_active":"2024-09-19T08:51:18.015041+0000","last_peered":"2024-09-19T08:51:18.015041+0000","last_clean":"2024-09-19T08:51:18.015041+0000","last_became_active":"2024-09-19T08:50:13.797021+0000","last_became_peered":"2024-09-19T08:50:13.797021+0000","last_unstale":"2024-09-19T08:51:18.015041+0000","last_undegraded":"2024-09-19T08:51:18.015041+0000","last_fullsized":"2024-09-19T08:51:18.015041+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:14.530373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.878467+0000","last_change":"2024-09-19T08:50:15.894619+0000","last_active":"2024-09-19T08:50:16.878467+0000","last_peered":"2024-09-19T08:50:16.878467+0000","last_clean":"2024-09-19T08:50:16.878467+0000","last_became_active":"2024-09-19T08:50:15.894258+0000","last_became_peered":"2024-09-19T08:50:15.894258+0000","last_unstale":"2024-09-19T08:50:16.878467+0000","last_undegraded":"2024-09-19T08:50:16.878467+0000","last_fullsized":"2024-09-19T08:50:16.878467+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:13.137314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.939873+0000","last_change":"2024-09-19T08:50:13.800867+0000","last_active":"2024-09-19T08:50:26.939873+0000","last_peered":"2024-09-19T08:50:26.939873+0000","last_clean":"2024-09-19T08:50:26.939873+0000","last_became_active":"2024-09-19T08:50:13.800376+0000","last_became_peered":"2024-09-19T08:50:13.800376+0000","last_unstale":"2024-09-19T08:50:26.939873+0000","last_undegraded":"2024-09-19T08:50:26.939873+0000","last_fullsized":"2024-09-19T08:50:26.939873+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:31.924599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.878704+0000","last_change":"2024-09-19T08:50:15.891121+0000","last_active":"2024-09-19T08:50:16.878704+0000","last_peered":"2024-09-19T08:50:16.878704+0000","last_clean":"2024-09-19T08:50:16.878704+0000","last_became_active":"2024-09-19T08:50:15.890810+0000","last_became_peered":"2024-09-19T08:50:15.890810+0000","last_unstale":"2024-09-19T08:50:16.878704+0000","last_undegraded":"2024-09-19T08:50:16.878704+0000","last_fullsized":"2024-09-19T08:50:16.878704+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:13.010282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:25.931563+0000","last_change":"2024-09-19T08:50:14.293953+0000","last_active":"2024-09-19T08:50:25.931563+0000","last_peered":"2024-09-19T08:50:25.931563+0000","last_clean":"2024-09-19T08:50:25.931563+0000","last_became_active":"2024-09-19T08:50:14.293546+0000","last_became_peered":"2024-09-19T08:50:14.293546+0000","last_unstale":"2024-09-19T08:50:25.931563+0000","last_undegraded":"2024-09-19T08:50:25.931563+0000","last_fullsized":"2024-09-19T08:50:25.931563+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:27.809243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877095+0000","last_change":"2024-09-19T08:50:15.878300+0000","last_active":"2024-09-19T08:50:16.877095+0000","last_peered":"2024-09-19T08:50:16.877095+0000","last_clean":"2024-09-19T08:50:16.877095+0000","last_became_active":"2024-09-19T08:50:15.877938+0000","last_became_peered":"2024-09-19T08:50:15.877938+0000","last_unstale":"2024-09-19T08:50:16.877095+0000","last_undegraded":"2024-09-19T08:50:16.877095+0000","last_fullsized":"2024-09-19T08:50:16.877095+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:05.376708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'28","reported_seq":155,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:51:18.014661+0000","last_change":"2024-09-19T08:50:13.800696+0000","last_active":"2024-09-19T08:51:18.014661+0000","last_peered":"2024-09-19T08:51:18.014661+0000","last_clean":"2024-09-19T08:51:18.014661+0000","last_became_active":"2024-09-19T08:50:13.799385+0000","last_became_peered":"2024-09-19T08:50:13.799385+0000","last_unstale":"2024-09-19T08:51:18.014661+0000","last_undegraded":"2024-09-19T08:51:18.014661+0000","last_fullsized":"2024-09-19T08:51:18.014661+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:56.897309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59211,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":109,"num_read_kb":111,"num_write":30,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.878356+0000","last_change":"2024-09-19T08:50:15.891483+0000","last_active":"2024-09-19T08:50:16.878356+0000","last_peered":"2024-09-19T08:50:16.878356+0000","last_clean":"2024-09-19T08:50:16.878356+0000","last_became_active":"2024-09-19T08:50:15.891185+0000","last_became_peered":"2024-09-19T08:50:15.891185+0000","last_unstale":"2024-09-19T08:50:16.878356+0000","last_undegraded":"2024-09-19T08:50:16.878356+0000","last_fullsized":"2024-09-19T08:50:16.878356+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:26.599151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:27.944994+0000","last_change":"2024-09-19T08:50:13.795148+0000","last_active":"2024-09-19T08:50:27.944994+0000","last_peered":"2024-09-19T08:50:27.944994+0000","last_clean":"2024-09-19T08:50:27.944994+0000","last_became_active":"2024-09-19T08:50:13.794688+0000","last_became_peered":"2024-09-19T08:50:13.794688+0000","last_unstale":"2024-09-19T08:50:27.944994+0000","last_undegraded":"2024-09-19T08:50:27.944994+0000","last_fullsized":"2024-09-19T08:50:27.944994+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:01.366439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877362+0000","last_change":"2024-09-19T08:50:15.886449+0000","last_active":"2024-09-19T08:50:16.877362+0000","last_peered":"2024-09-19T08:50:16.877362+0000","last_clean":"2024-09-19T08:50:16.877362+0000","last_became_active":"2024-09-19T08:50:15.886119+0000","last_became_peered":"2024-09-19T08:50:15.886119+0000","last_unstale":"2024-09-19T08:50:16.877362+0000","last_undegraded":"2024-09-19T08:50:16.877362+0000","last_fullsized":"2024-09-19T08:50:16.877362+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:22.916593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.940744+0000","last_change":"2024-09-19T08:50:13.799363+0000","last_active":"2024-09-19T08:50:26.940744+0000","last_peered":"2024-09-19T08:50:26.940744+0000","last_clean":"2024-09-19T08:50:26.940744+0000","last_became_active":"2024-09-19T08:50:13.799033+0000","last_became_peered":"2024-09-19T08:50:13.799033+0000","last_unstale":"2024-09-19T08:50:26.940744+0000","last_undegraded":"2024-09-19T08:50:26.940744+0000","last_fullsized":"2024-09-19T08:50:26.940744+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:57.753451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877104+0000","last_change":"2024-09-19T08:50:15.898902+0000","last_active":"2024-09-19T08:50:16.877104+0000","last_peered":"2024-09-19T08:50:16.877104+0000","last_clean":"2024-09-19T08:50:16.877104+0000","last_became_active":"2024-09-19T08:50:15.898417+0000","last_became_peered":"2024-09-19T08:50:15.898417+0000","last_unstale":"2024-09-19T08:50:16.877104+0000","last_undegraded":"2024-09-19T08:50:16.877104+0000","last_fullsized":"2024-09-19T08:50:16.877104+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:32:19.799301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'6","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:51:16.012068+0000","last_change":"2024-09-19T08:50:13.798477+0000","last_active":"2024-09-19T08:51:16.012068+0000","last_peered":"2024-09-19T08:51:16.012068+0000","last_clean":"2024-09-19T08:51:16.012068+0000","last_became_active":"2024-09-19T08:50:13.798136+0000","last_became_peered":"2024-09-19T08:50:13.798136+0000","last_unstale":"2024-09-19T08:51:16.012068+0000","last_undegraded":"2024-09-19T08:51:16.012068+0000","last_fullsized":"2024-09-19T08:51:16.012068+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:33.874285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876769+0000","last_change":"2024-09-19T08:50:15.896414+0000","last_active":"2024-09-19T08:50:16.876769+0000","last_peered":"2024-09-19T08:50:16.876769+0000","last_clean":"2024-09-19T08:50:16.876769+0000","last_became_active":"2024-09-19T08:50:15.895530+0000","last_became_peered":"2024-09-19T08:50:15.895530+0000","last_unstale":"2024-09-19T08:50:16.876769+0000","last_undegraded":"2024-09-19T08:50:16.876769+0000","last_fullsized":"2024-09-19T08:50:16.876769+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:59.717869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.940708+0000","last_change":"2024-09-19T08:50:14.294087+0000","last_active":"2024-09-19T08:50:26.940708+0000","last_peered":"2024-09-19T08:50:26.940708+0000","last_clean":"2024-09-19T08:50:26.940708+0000","last_became_active":"2024-09-19T08:50:14.293712+0000","last_became_peered":"2024-09-19T08:50:14.293712+0000","last_unstale":"2024-09-19T08:50:26.940708+0000","last_undegraded":"2024-09-19T08:50:26.940708+0000","last_fullsized":"2024-09-19T08:50:26.940708+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:12.187514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869736+0000","last_change":"2024-09-19T08:50:15.888134+0000","last_active":"2024-09-19T08:50:16.869736+0000","last_peered":"2024-09-19T08:50:16.869736+0000","last_clean":"2024-09-19T08:50:16.869736+0000","last_became_active":"2024-09-19T08:50:15.887768+0000","last_became_peered":"2024-09-19T08:50:15.887768+0000","last_unstale":"2024-09-19T08:50:16.869736+0000","last_undegraded":"2024-09-19T08:50:16.869736+0000","last_fullsized":"2024-09-19T08:50:16.869736+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:12.868773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.920893+0000","last_change":"2024-09-19T08:50:13.792585+0000","last_active":"2024-09-19T08:50:26.920893+0000","last_peered":"2024-09-19T08:50:26.920893+0000","last_clean":"2024-09-19T08:50:26.920893+0000","last_became_active":"2024-09-19T08:50:13.792222+0000","last_became_peered":"2024-09-19T08:50:13.792222+0000","last_unstale":"2024-09-19T08:50:26.920893+0000","last_undegraded":"2024-09-19T08:50:26.920893+0000","last_fullsized":"2024-09-19T08:50:26.920893+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:45.234800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.885284+0000","last_change":"2024-09-19T08:50:15.892725+0000","last_active":"2024-09-19T08:50:16.885284+0000","last_peered":"2024-09-19T08:50:16.885284+0000","last_clean":"2024-09-19T08:50:16.885284+0000","last_became_active":"2024-09-19T08:50:15.892357+0000","last_became_peered":"2024-09-19T08:50:15.892357+0000","last_unstale":"2024-09-19T08:50:16.885284+0000","last_undegraded":"2024-09-19T08:50:16.885284+0000","last_fullsized":"2024-09-19T08:50:16.885284+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:18.756349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.939949+0000","last_change":"2024-09-19T08:50:13.795360+0000","last_active":"2024-09-19T08:50:26.939949+0000","last_peered":"2024-09-19T08:50:26.939949+0000","last_clean":"2024-09-19T08:50:26.939949+0000","last_became_active":"2024-09-19T08:50:13.794823+0000","last_became_peered":"2024-09-19T08:50:13.794823+0000","last_unstale":"2024-09-19T08:50:26.939949+0000","last_undegraded":"2024-09-19T08:50:26.939949+0000","last_fullsized":"2024-09-19T08:50:26.939949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:15.037834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877268+0000","last_change":"2024-09-19T08:50:15.893668+0000","last_active":"2024-09-19T08:50:16.877268+0000","last_peered":"2024-09-19T08:50:16.877268+0000","last_clean":"2024-09-19T08:50:16.877268+0000","last_became_active":"2024-09-19T08:50:15.893303+0000","last_became_peered":"2024-09-19T08:50:15.893303+0000","last_unstale":"2024-09-19T08:50:16.877268+0000","last_undegraded":"2024-09-19T08:50:16.877268+0000","last_fullsized":"2024-09-19T08:50:16.877268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:59.281601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.939251+0000","last_change":"2024-09-19T08:50:13.797442+0000","last_active":"2024-09-19T08:50:26.939251+0000","last_peered":"2024-09-19T08:50:26.939251+0000","last_clean":"2024-09-19T08:50:26.939251+0000","last_became_active":"2024-09-19T08:50:13.797072+0000","last_became_peered":"2024-09-19T08:50:13.797072+0000","last_unstale":"2024-09-19T08:50:26.939251+0000","last_undegraded":"2024-09-19T08:50:26.939251+0000","last_fullsized":"2024-09-19T08:50:26.939251+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:32.960928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876874+0000","last_change":"2024-09-19T08:50:15.895819+0000","last_active":"2024-09-19T08:50:16.876874+0000","last_peered":"2024-09-19T08:50:16.876874+0000","last_clean":"2024-09-19T08:50:16.876874+0000","last_became_active":"2024-09-19T08:50:15.895468+0000","last_became_peered":"2024-09-19T08:50:15.895468+0000","last_unstale":"2024-09-19T08:50:16.876874+0000","last_undegraded":"2024-09-19T08:50:16.876874+0000","last_fullsized":"2024-09-19T08:50:16.876874+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:33.568263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'6","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:51:14.010029+0000","last_change":"2024-09-19T08:50:14.294014+0000","last_active":"2024-09-19T08:51:14.010029+0000","last_peered":"2024-09-19T08:51:14.010029+0000","last_clean":"2024-09-19T08:51:14.010029+0000","last_became_active":"2024-09-19T08:50:14.293564+0000","last_became_peered":"2024-09-19T08:50:14.293564+0000","last_unstale":"2024-09-19T08:51:14.010029+0000","last_undegraded":"2024-09-19T08:51:14.010029+0000","last_fullsized":"2024-09-19T08:51:14.010029+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:23.806408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877550+0000","last_change":"2024-09-19T08:50:15.891840+0000","last_active":"2024-09-19T08:50:16.877550+0000","last_peered":"2024-09-19T08:50:16.877550+0000","last_clean":"2024-09-19T08:50:16.877550+0000","last_became_active":"2024-09-19T08:50:15.891511+0000","last_became_peered":"2024-09-19T08:50:15.891511+0000","last_unstale":"2024-09-19T08:50:16.877550+0000","last_undegraded":"2024-09-19T08:50:16.877550+0000","last_fullsized":"2024-09-19T08:50:16.877550+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:26.800508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":327,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877159+0000","last_change":"2024-09-19T08:49:02.071497+0000","last_active":"2024-09-19T08:50:16.877159+0000","last_peered":"2024-09-19T08:50:16.877159+0000","last_clean":"2024-09-19T08:50:16.877159+0000","last_became_active":"2024-09-19T08:49:02.071114+0000","last_became_peered":"2024-09-19T08:49:02.071114+0000","last_unstale":"2024-09-19T08:50:16.877159+0000","last_undegraded":"2024-09-19T08:50:16.877159+0000","last_fullsized":"2024-09-19T08:50:16.877159+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:45:36.600595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:45:36.600595+0000","last_clean_scrub_stamp":"2024-09-19T08:45:36.600595+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:18:15.369279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:27.945549+0000","last_change":"2024-09-19T08:50:13.793981+0000","last_active":"2024-09-19T08:50:27.945549+0000","last_peered":"2024-09-19T08:50:27.945549+0000","last_clean":"2024-09-19T08:50:27.945549+0000","last_became_active":"2024-09-19T08:50:13.793616+0000","last_became_peered":"2024-09-19T08:50:13.793616+0000","last_unstale":"2024-09-19T08:50:27.945549+0000","last_undegraded":"2024-09-19T08:50:27.945549+0000","last_fullsized":"2024-09-19T08:50:27.945549+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:45.195906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869593+0000","last_change":"2024-09-19T08:50:15.891248+0000","last_active":"2024-09-19T08:50:16.869593+0000","last_peered":"2024-09-19T08:50:16.869593+0000","last_clean":"2024-09-19T08:50:16.869593+0000","last_became_active":"2024-09-19T08:50:15.890922+0000","last_became_peered":"2024-09-19T08:50:15.890922+0000","last_unstale":"2024-09-19T08:50:16.869593+0000","last_undegraded":"2024-09-19T08:50:16.869593+0000","last_fullsized":"2024-09-19T08:50:16.869593+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:18:43.914214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:24.924191+0000","last_change":"2024-09-19T08:50:13.797471+0000","last_active":"2024-09-19T08:50:24.924191+0000","last_peered":"2024-09-19T08:50:24.924191+0000","last_clean":"2024-09-19T08:50:24.924191+0000","last_became_active":"2024-09-19T08:50:13.797033+0000","last_became_peered":"2024-09-19T08:50:13.797033+0000","last_unstale":"2024-09-19T08:50:24.924191+0000","last_undegraded":"2024-09-19T08:50:24.924191+0000","last_fullsized":"2024-09-19T08:50:24.924191+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:53.141708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876668+0000","last_change":"2024-09-19T08:50:15.882650+0000","last_active":"2024-09-19T08:50:16.876668+0000","last_peered":"2024-09-19T08:50:16.876668+0000","last_clean":"2024-09-19T08:50:16.876668+0000","last_became_active":"2024-09-19T08:50:15.882308+0000","last_became_peered":"2024-09-19T08:50:15.882308+0000","last_unstale":"2024-09-19T08:50:16.876668+0000","last_undegraded":"2024-09-19T08:50:16.876668+0000","last_fullsized":"2024-09-19T08:50:16.876668+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:26.449562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":72,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:51:14.008743+0000","last_change":"2024-09-19T08:50:14.292466+0000","last_active":"2024-09-19T08:51:14.008743+0000","last_peered":"2024-09-19T08:51:14.008743+0000","last_clean":"2024-09-19T08:51:14.008743+0000","last_became_active":"2024-09-19T08:50:14.292092+0000","last_became_peered":"2024-09-19T08:50:14.292092+0000","last_unstale":"2024-09-19T08:51:14.008743+0000","last_undegraded":"2024-09-19T08:51:14.008743+0000","last_fullsized":"2024-09-19T08:51:14.008743+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:11.373226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869763+0000","last_change":"2024-09-19T08:50:15.886093+0000","last_active":"2024-09-19T08:50:16.869763+0000","last_peered":"2024-09-19T08:50:16.869763+0000","last_clean":"2024-09-19T08:50:16.869763+0000","last_became_active":"2024-09-19T08:50:15.885790+0000","last_became_peered":"2024-09-19T08:50:15.885790+0000","last_unstale":"2024-09-19T08:50:16.869763+0000","last_undegraded":"2024-09-19T08:50:16.869763+0000","last_fullsized":"2024-09-19T08:50:16.869763+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:06.405176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'5","reported_seq":72,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:51:14.009031+0000","last_change":"2024-09-19T08:50:13.799909+0000","last_active":"2024-09-19T08:51:14.009031+0000","last_peered":"2024-09-19T08:51:14.009031+0000","last_clean":"2024-09-19T08:51:14.009031+0000","last_became_active":"2024-09-19T08:50:13.799542+0000","last_became_peered":"2024-09-19T08:50:13.799542+0000","last_unstale":"2024-09-19T08:51:14.009031+0000","last_undegraded":"2024-09-19T08:51:14.009031+0000","last_fullsized":"2024-09-19T08:51:14.009031+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:23.545897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":49,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.870214+0000","last_change":"2024-09-19T08:50:15.890410+0000","last_active":"2024-09-19T08:50:16.870214+0000","last_peered":"2024-09-19T08:50:16.870214+0000","last_clean":"2024-09-19T08:50:16.870214+0000","last_became_active":"2024-09-19T08:50:15.890093+0000","last_became_peered":"2024-09-19T08:50:15.890093+0000","last_unstale":"2024-09-19T08:50:16.870214+0000","last_undegraded":"2024-09-19T08:50:16.870214+0000","last_fullsized":"2024-09-19T08:50:16.870214+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:06.533722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.880158+0000","last_change":"2024-09-19T08:50:14.292577+0000","last_active":"2024-09-19T08:50:16.880158+0000","last_peered":"2024-09-19T08:50:16.880158+0000","last_clean":"2024-09-19T08:50:16.880158+0000","last_became_active":"2024-09-19T08:50:14.292220+0000","last_became_peered":"2024-09-19T08:50:14.292220+0000","last_unstale":"2024-09-19T08:50:16.880158+0000","last_undegraded":"2024-09-19T08:50:16.880158+0000","last_fullsized":"2024-09-19T08:50:16.880158+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:23.631672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:18.755907+0000","last_change":"2024-09-19T08:50:15.891345+0000","last_active":"2024-09-19T08:50:18.755907+0000","last_peered":"2024-09-19T08:50:18.755907+0000","last_clean":"2024-09-19T08:50:18.755907+0000","last_became_active":"2024-09-19T08:50:15.891006+0000","last_became_peered":"2024-09-19T08:50:15.891006+0000","last_unstale":"2024-09-19T08:50:18.755907+0000","last_undegraded":"2024-09-19T08:50:18.755907+0000","last_fullsized":"2024-09-19T08:50:18.755907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:41.934331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.940739+0000","last_change":"2024-09-19T08:50:14.292619+0000","last_active":"2024-09-19T08:50:26.940739+0000","last_peered":"2024-09-19T08:50:26.940739+0000","last_clean":"2024-09-19T08:50:26.940739+0000","last_became_active":"2024-09-19T08:50:14.292230+0000","last_became_peered":"2024-09-19T08:50:14.292230+0000","last_unstale":"2024-09-19T08:50:26.940739+0000","last_undegraded":"2024-09-19T08:50:26.940739+0000","last_fullsized":"2024-09-19T08:50:26.940739+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:21:33.076142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877022+0000","last_change":"2024-09-19T08:50:15.882760+0000","last_active":"2024-09-19T08:50:16.877022+0000","last_peered":"2024-09-19T08:50:16.877022+0000","last_clean":"2024-09-19T08:50:16.877022+0000","last_became_active":"2024-09-19T08:50:15.882402+0000","last_became_peered":"2024-09-19T08:50:15.882402+0000","last_unstale":"2024-09-19T08:50:16.877022+0000","last_undegraded":"2024-09-19T08:50:16.877022+0000","last_fullsized":"2024-09-19T08:50:16.877022+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:17.343385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'15","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:40.877709+0000","last_change":"2024-09-19T08:50:13.790982+0000","last_active":"2024-09-19T08:50:40.877709+0000","last_peered":"2024-09-19T08:50:40.877709+0000","last_clean":"2024-09-19T08:50:40.877709+0000","last_became_active":"2024-09-19T08:50:13.790644+0000","last_became_peered":"2024-09-19T08:50:13.790644+0000","last_unstale":"2024-09-19T08:50:40.877709+0000","last_undegraded":"2024-09-19T08:50:40.877709+0000","last_fullsized":"2024-09-19T08:50:40.877709+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:20:25.923021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869864+0000","last_change":"2024-09-19T08:50:15.887556+0000","last_active":"2024-09-19T08:50:16.869864+0000","last_peered":"2024-09-19T08:50:16.869864+0000","last_clean":"2024-09-19T08:50:16.869864+0000","last_became_active":"2024-09-19T08:50:15.887280+0000","last_became_peered":"2024-09-19T08:50:15.887280+0000","last_unstale":"2024-09-19T08:50:16.869864+0000","last_undegraded":"2024-09-19T08:50:16.869864+0000","last_fullsized":"2024-09-19T08:50:16.869864+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:51.226527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.939936+0000","last_change":"2024-09-19T08:50:14.012150+0000","last_active":"2024-09-19T08:50:26.939936+0000","last_peered":"2024-09-19T08:50:26.939936+0000","last_clean":"2024-09-19T08:50:26.939936+0000","last_became_active":"2024-09-19T08:50:14.011799+0000","last_became_peered":"2024-09-19T08:50:14.011799+0000","last_unstale":"2024-09-19T08:50:26.939936+0000","last_undegraded":"2024-09-19T08:50:26.939936+0000","last_fullsized":"2024-09-19T08:50:26.939936+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:37.310539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.878237+0000","last_change":"2024-09-19T08:50:15.889577+0000","last_active":"2024-09-19T08:50:16.878237+0000","last_peered":"2024-09-19T08:50:16.878237+0000","last_clean":"2024-09-19T08:50:16.878237+0000","last_became_active":"2024-09-19T08:50:15.889244+0000","last_became_peered":"2024-09-19T08:50:15.889244+0000","last_unstale":"2024-09-19T08:50:16.878237+0000","last_undegraded":"2024-09-19T08:50:16.878237+0000","last_fullsized":"2024-09-19T08:50:16.878237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:54.382221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:23.919295+0000","last_change":"2024-09-19T08:50:14.293845+0000","last_active":"2024-09-19T08:50:23.919295+0000","last_peered":"2024-09-19T08:50:23.919295+0000","last_clean":"2024-09-19T08:50:23.919295+0000","last_became_active":"2024-09-19T08:50:14.293585+0000","last_became_peered":"2024-09-19T08:50:14.293585+0000","last_unstale":"2024-09-19T08:50:23.919295+0000","last_undegraded":"2024-09-19T08:50:23.919295+0000","last_fullsized":"2024-09-19T08:50:23.919295+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:02.886475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877681+0000","last_change":"2024-09-19T08:50:15.888591+0000","last_active":"2024-09-19T08:50:16.877681+0000","last_peered":"2024-09-19T08:50:16.877681+0000","last_clean":"2024-09-19T08:50:16.877681+0000","last_became_active":"2024-09-19T08:50:15.888270+0000","last_became_peered":"2024-09-19T08:50:15.888270+0000","last_unstale":"2024-09-19T08:50:16.877681+0000","last_undegraded":"2024-09-19T08:50:16.877681+0000","last_fullsized":"2024-09-19T08:50:16.877681+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:08.644828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.939797+0000","last_change":"2024-09-19T08:50:13.794081+0000","last_active":"2024-09-19T08:50:26.939797+0000","last_peered":"2024-09-19T08:50:26.939797+0000","last_clean":"2024-09-19T08:50:26.939797+0000","last_became_active":"2024-09-19T08:50:13.793770+0000","last_became_peered":"2024-09-19T08:50:13.793770+0000","last_unstale":"2024-09-19T08:50:26.939797+0000","last_undegraded":"2024-09-19T08:50:26.939797+0000","last_fullsized":"2024-09-19T08:50:26.939797+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:43.053893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.885008+0000","last_change":"2024-09-19T08:50:15.885338+0000","last_active":"2024-09-19T08:50:16.885008+0000","last_peered":"2024-09-19T08:50:16.885008+0000","last_clean":"2024-09-19T08:50:16.885008+0000","last_became_active":"2024-09-19T08:50:15.884983+0000","last_became_peered":"2024-09-19T08:50:15.884983+0000","last_unstale":"2024-09-19T08:50:16.885008+0000","last_undegraded":"2024-09-19T08:50:16.885008+0000","last_fullsized":"2024-09-19T08:50:16.885008+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:05.228871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'3","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:25.931497+0000","last_change":"2024-09-19T08:50:13.795440+0000","last_active":"2024-09-19T08:50:25.931497+0000","last_peered":"2024-09-19T08:50:25.931497+0000","last_clean":"2024-09-19T08:50:25.931497+0000","last_became_active":"2024-09-19T08:50:13.795053+0000","last_became_peered":"2024-09-19T08:50:13.795053+0000","last_unstale":"2024-09-19T08:50:25.931497+0000","last_undegraded":"2024-09-19T08:50:25.931497+0000","last_fullsized":"2024-09-19T08:50:25.931497+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:13.466112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869289+0000","last_change":"2024-09-19T08:50:15.886587+0000","last_active":"2024-09-19T08:50:16.869289+0000","last_peered":"2024-09-19T08:50:16.869289+0000","last_clean":"2024-09-19T08:50:16.869289+0000","last_became_active":"2024-09-19T08:50:15.886231+0000","last_became_peered":"2024-09-19T08:50:15.886231+0000","last_unstale":"2024-09-19T08:50:16.869289+0000","last_undegraded":"2024-09-19T08:50:16.869289+0000","last_fullsized":"2024-09-19T08:50:16.869289+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:11.965382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:23.921108+0000","last_change":"2024-09-19T08:50:13.796681+0000","last_active":"2024-09-19T08:50:23.921108+0000","last_peered":"2024-09-19T08:50:23.921108+0000","last_clean":"2024-09-19T08:50:23.921108+0000","last_became_active":"2024-09-19T08:50:13.796338+0000","last_became_peered":"2024-09-19T08:50:13.796338+0000","last_unstale":"2024-09-19T08:50:23.921108+0000","last_undegraded":"2024-09-19T08:50:23.921108+0000","last_fullsized":"2024-09-19T08:50:23.921108+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:32.588800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877525+0000","last_change":"2024-09-19T08:50:15.889667+0000","last_active":"2024-09-19T08:50:16.877525+0000","last_peered":"2024-09-19T08:50:16.877525+0000","last_clean":"2024-09-19T08:50:16.877525+0000","last_became_active":"2024-09-19T08:50:15.889341+0000","last_became_peered":"2024-09-19T08:50:15.889341+0000","last_unstale":"2024-09-19T08:50:16.877525+0000","last_undegraded":"2024-09-19T08:50:16.877525+0000","last_fullsized":"2024-09-19T08:50:16.877525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:13.255483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.870110+0000","last_change":"2024-09-19T08:50:15.887337+0000","last_active":"2024-09-19T08:50:16.870110+0000","last_peered":"2024-09-19T08:50:16.870110+0000","last_clean":"2024-09-19T08:50:16.870110+0000","last_became_active":"2024-09-19T08:50:15.887001+0000","last_became_peered":"2024-09-19T08:50:15.887001+0000","last_unstale":"2024-09-19T08:50:16.870110+0000","last_undegraded":"2024-09-19T08:50:16.870110+0000","last_fullsized":"2024-09-19T08:50:16.870110+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:43.544863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.940436+0000","last_change":"2024-09-19T08:50:13.799321+0000","last_active":"2024-09-19T08:50:26.940436+0000","last_peered":"2024-09-19T08:50:26.940436+0000","last_clean":"2024-09-19T08:50:26.940436+0000","last_became_active":"2024-09-19T08:50:13.798837+0000","last_became_peered":"2024-09-19T08:50:13.798837+0000","last_unstale":"2024-09-19T08:50:26.940436+0000","last_undegraded":"2024-09-19T08:50:26.940436+0000","last_fullsized":"2024-09-19T08:50:26.940436+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:35.753093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876836+0000","last_change":"2024-09-19T08:50:15.892074+0000","last_active":"2024-09-19T08:50:16.876836+0000","last_peered":"2024-09-19T08:50:16.876836+0000","last_clean":"2024-09-19T08:50:16.876836+0000","last_became_active":"2024-09-19T08:50:15.891722+0000","last_became_peered":"2024-09-19T08:50:15.891722+0000","last_unstale":"2024-09-19T08:50:16.876836+0000","last_undegraded":"2024-09-19T08:50:16.876836+0000","last_fullsized":"2024-09-19T08:50:16.876836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:39.913080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:27.944924+0000","last_change":"2024-09-19T08:50:13.795577+0000","last_active":"2024-09-19T08:50:27.944924+0000","last_peered":"2024-09-19T08:50:27.944924+0000","last_clean":"2024-09-19T08:50:27.944924+0000","last_became_active":"2024-09-19T08:50:13.795254+0000","last_became_peered":"2024-09-19T08:50:13.795254+0000","last_unstale":"2024-09-19T08:50:27.944924+0000","last_undegraded":"2024-09-19T08:50:27.944924+0000","last_fullsized":"2024-09-19T08:50:27.944924+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:13.263447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.878562+0000","last_change":"2024-09-19T08:50:15.884584+0000","last_active":"2024-09-19T08:50:16.878562+0000","last_peered":"2024-09-19T08:50:16.878562+0000","last_clean":"2024-09-19T08:50:16.878562+0000","last_became_active":"2024-09-19T08:50:15.884244+0000","last_became_peered":"2024-09-19T08:50:15.884244+0000","last_unstale":"2024-09-19T08:50:16.878562+0000","last_undegraded":"2024-09-19T08:50:16.878562+0000","last_fullsized":"2024-09-19T08:50:16.878562+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:58.835351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.880212+0000","last_change":"2024-09-19T08:50:14.294210+0000","last_active":"2024-09-19T08:50:16.880212+0000","last_peered":"2024-09-19T08:50:16.880212+0000","last_clean":"2024-09-19T08:50:16.880212+0000","last_became_active":"2024-09-19T08:50:14.293850+0000","last_became_peered":"2024-09-19T08:50:14.293850+0000","last_unstale":"2024-09-19T08:50:16.880212+0000","last_undegraded":"2024-09-19T08:50:16.880212+0000","last_fullsized":"2024-09-19T08:50:16.880212+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:42:44.340766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869569+0000","last_change":"2024-09-19T08:50:15.892934+0000","last_active":"2024-09-19T08:50:16.869569+0000","last_peered":"2024-09-19T08:50:16.869569+0000","last_clean":"2024-09-19T08:50:16.869569+0000","last_became_active":"2024-09-19T08:50:15.892309+0000","last_became_peered":"2024-09-19T08:50:15.892309+0000","last_unstale":"2024-09-19T08:50:16.869569+0000","last_undegraded":"2024-09-19T08:50:16.869569+0000","last_fullsized":"2024-09-19T08:50:16.869569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:40.158724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:51:17.012740+0000","last_change":"2024-09-19T08:50:13.796977+0000","last_active":"2024-09-19T08:51:17.012740+0000","last_peered":"2024-09-19T08:51:17.012740+0000","last_clean":"2024-09-19T08:51:17.012740+0000","last_became_active":"2024-09-19T08:50:13.796628+0000","last_became_peered":"2024-09-19T08:50:13.796628+0000","last_unstale":"2024-09-19T08:51:17.012740+0000","last_undegraded":"2024-09-19T08:51:17.012740+0000","last_fullsized":"2024-09-19T08:51:17.012740+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:59.335583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66419,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":536,"num_read_kb":344,"num_write":241,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":199257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":247642,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579930,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":872448,"data_stored":416651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808863,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1028096,"data_stored":1066891,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972389,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":897024,"data_stored":416188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201322,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":892928,"data_stored":416566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430254,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":1009086,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593780,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":415905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822712,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":1008371,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953532,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":416159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182466,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":897024,"data_stored":415730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411400,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":476642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":476029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":417637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34206,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34206,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":60963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:51:22.107 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:51:22.373 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:22.797 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:22 smithi019 ceph-mon[30976]: from='client.14931 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:51:22.797 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:22 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T08:51:22.797 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:22 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-09-19T08:51:22.797 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:22 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-09-19T08:51:22.797 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:22 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-09-19T08:51:22.797 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:22 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-09-19T08:51:22.797 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:22 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-09-19T08:51:22.797 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:22 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-09-19T08:51:22.798 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:22 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2024-09-19T08:51:22.798 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:22 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:51:22.798 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:22 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:51:22.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.880+0000 7f68df17f640 1 -- 172.21.15.19:0/1541667465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68d8106a80 msgr2=0x7f68d8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:22.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.880+0000 7f68df17f640 1 --2- 172.21.15.19:0/1541667465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68d8106a80 0x7f68d8106e60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f68c8009930 tx=0x7f68c802a420 comp rx=0 tx=0).stop 2024-09-19T08:51:22.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.881+0000 7f68df17f640 1 -- 172.21.15.19:0/1541667465 shutdown_connections 2024-09-19T08:51:22.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.881+0000 7f68df17f640 1 --2- 172.21.15.19:0/1541667465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68d8101420 0x7f68d810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.881+0000 7f68df17f640 1 --2- 172.21.15.19:0/1541667465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68d8100a80 0x7f68d8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.881+0000 7f68df17f640 1 --2- 172.21.15.19:0/1541667465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68d8106a80 0x7f68d8106e60 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.881+0000 7f68df17f640 1 -- 172.21.15.19:0/1541667465 >> 172.21.15.19:0/1541667465 conn(0x7f68d80fc7a0 msgr2=0x7f68d80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:22.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.881+0000 7f68df17f640 1 -- 172.21.15.19:0/1541667465 shutdown_connections 2024-09-19T08:51:22.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.881+0000 7f68df17f640 1 -- 172.21.15.19:0/1541667465 wait complete. 2024-09-19T08:51:22.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.881+0000 7f68df17f640 1 Processor -- start 2024-09-19T08:51:22.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.881+0000 7f68df17f640 1 -- start start 2024-09-19T08:51:22.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.881+0000 7f68df17f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68d8100a80 0x7f68d81974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:22.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.881+0000 7f68df17f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68d8101420 0x7f68d8197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:22.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.881+0000 7f68df17f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68d8106a80 0x7f68d819bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:22.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.881+0000 7f68df17f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f68d8110f20 con 0x7f68d8101420 2024-09-19T08:51:22.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.881+0000 7f68df17f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f68d8110da0 con 0x7f68d8106a80 2024-09-19T08:51:22.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.881+0000 7f68df17f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f68d81110a0 con 0x7f68d8100a80 2024-09-19T08:51:22.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.882+0000 7f68d7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68d8101420 0x7f68d8197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:22.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.882+0000 7f68d7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68d8101420 0x7f68d8197a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34806/0 (socket says 172.21.15.19:34806) 2024-09-19T08:51:22.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.882+0000 7f68d7fff640 1 -- 172.21.15.19:0/2785858749 learned_addr learned my addr 172.21.15.19:0/2785858749 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:22.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.882+0000 7f68dd71c640 1 --2- 172.21.15.19:0/2785858749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68d8106a80 0x7f68d819bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:22.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.882+0000 7f68dcf1b640 1 --2- 172.21.15.19:0/2785858749 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68d8100a80 0x7f68d81974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:22.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.882+0000 7f68d7fff640 1 -- 172.21.15.19:0/2785858749 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68d8100a80 msgr2=0x7f68d81974f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:22.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.882+0000 7f68d7fff640 1 --2- 172.21.15.19:0/2785858749 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68d8100a80 0x7f68d81974f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.882+0000 7f68d7fff640 1 -- 172.21.15.19:0/2785858749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68d8106a80 msgr2=0x7f68d819bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:22.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.882+0000 7f68d7fff640 1 --2- 172.21.15.19:0/2785858749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68d8106a80 0x7f68d819bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:22.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.882+0000 7f68d7fff640 1 -- 172.21.15.19:0/2785858749 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68d819c4a0 con 0x7f68d8101420 2024-09-19T08:51:22.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.882+0000 7f68d7fff640 1 --2- 172.21.15.19:0/2785858749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68d8101420 0x7f68d8197a30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f68cc00b4a0 tx=0x7f68cc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:22.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.882+0000 7f68d5ffb640 1 -- 172.21.15.19:0/2785858749 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68cc014070 con 0x7f68d8101420 2024-09-19T08:51:22.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.882+0000 7f68df17f640 1 -- 172.21.15.19:0/2785858749 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68d819c790 con 0x7f68d8101420 2024-09-19T08:51:22.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.882+0000 7f68d5ffb640 1 -- 172.21.15.19:0/2785858749 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68cc010af0 con 0x7f68d8101420 2024-09-19T08:51:22.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.882+0000 7f68d5ffb640 1 -- 172.21.15.19:0/2785858749 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68cc017d10 con 0x7f68d8101420 2024-09-19T08:51:22.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.883+0000 7f68df17f640 1 -- 172.21.15.19:0/2785858749 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68d81a4070 con 0x7f68d8101420 2024-09-19T08:51:22.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.883+0000 7f68df17f640 1 -- 172.21.15.19:0/2785858749 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68d8100f60 con 0x7f68d8101420 2024-09-19T08:51:22.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.885+0000 7f68d5ffb640 1 -- 172.21.15.19:0/2785858749 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f68cc017070 con 0x7f68d8101420 2024-09-19T08:51:22.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.885+0000 7f68d5ffb640 1 --2- 172.21.15.19:0/2785858749 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f68c00a32d0 0x7f68c00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:22.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.885+0000 7f68d5ffb640 1 -- 172.21.15.19:0/2785858749 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8211+0+0 (secure 0 0 0) 0x7f68cc0ced50 con 0x7f68d8101420 2024-09-19T08:51:22.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.885+0000 7f68dcf1b640 1 --2- 172.21.15.19:0/2785858749 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f68c00a32d0 0x7f68c00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:22.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.886+0000 7f68dcf1b640 1 --2- 172.21.15.19:0/2785858749 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f68c00a32d0 0x7f68c00a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f68c8000c00 tx=0x7f68c8031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:22.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:22.889+0000 7f68d5ffb640 1 -- 172.21.15.19:0/2785858749 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f68cc09ba30 con 0x7f68d8101420 2024-09-19T08:51:22.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:22 smithi155 ceph-mon[34921]: from='client.14931 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:51:22.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:22 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T08:51:22.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:22 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-09-19T08:51:22.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:22 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-09-19T08:51:22.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:22 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-09-19T08:51:22.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:22 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-09-19T08:51:22.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:22 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-09-19T08:51:22.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:22 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-09-19T08:51:22.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:22 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2024-09-19T08:51:22.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:22 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:51:22.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:22 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:51:22.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:22 smithi203 ceph-mon[35450]: from='client.14931 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:51:22.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:22 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-09-19T08:51:22.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:22 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]: dispatch 2024-09-19T08:51:22.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:22 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-09-19T08:51:22.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:22 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]: dispatch 2024-09-19T08:51:22.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:22 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]: dispatch 2024-09-19T08:51:22.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:22 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-09-19T08:51:22.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:22 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-09-19T08:51:22.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:22 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2024-09-19T08:51:22.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:22 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:51:22.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:22 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:51:23.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:23.062+0000 7f68df17f640 1 -- 172.21.15.19:0/2785858749 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f68d8062630 con 0x7f68c00a32d0 2024-09-19T08:51:23.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:23.069+0000 7f68d5ffb640 1 -- 172.21.15.19:0/2785858749 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258888 (secure 0 0 0) 0x7f68d8062630 con 0x7f68c00a32d0 2024-09-19T08:51:23.070 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:51:23.071 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-19T08:51:23.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:23.072+0000 7f68df17f640 1 -- 172.21.15.19:0/2785858749 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f68c00a32d0 msgr2=0x7f68c00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:23.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:23.072+0000 7f68df17f640 1 --2- 172.21.15.19:0/2785858749 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f68c00a32d0 0x7f68c00a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f68c8000c00 tx=0x7f68c8031490 comp rx=0 tx=0).stop 2024-09-19T08:51:23.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:23.072+0000 7f68df17f640 1 -- 172.21.15.19:0/2785858749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68d8101420 msgr2=0x7f68d8197a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:23.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:23.072+0000 7f68df17f640 1 --2- 172.21.15.19:0/2785858749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68d8101420 0x7f68d8197a30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f68cc00b4a0 tx=0x7f68cc00b960 comp rx=0 tx=0).stop 2024-09-19T08:51:23.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:23.072+0000 7f68df17f640 1 -- 172.21.15.19:0/2785858749 shutdown_connections 2024-09-19T08:51:23.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:23.072+0000 7f68df17f640 1 --2- 172.21.15.19:0/2785858749 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f68c00a32d0 0x7f68c00a5790 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:23.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:23.072+0000 7f68df17f640 1 --2- 172.21.15.19:0/2785858749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f68d8106a80 0x7f68d819bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:23.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:23.072+0000 7f68df17f640 1 --2- 172.21.15.19:0/2785858749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f68d8101420 0x7f68d8197a30 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:23.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:23.072+0000 7f68df17f640 1 --2- 172.21.15.19:0/2785858749 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f68d8100a80 0x7f68d81974f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:23.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:23.072+0000 7f68df17f640 1 -- 172.21.15.19:0/2785858749 >> 172.21.15.19:0/2785858749 conn(0x7f68d80fc7a0 msgr2=0x7f68d80fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:23.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:23.072+0000 7f68df17f640 1 -- 172.21.15.19:0/2785858749 shutdown_connections 2024-09-19T08:51:23.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:23.072+0000 7f68df17f640 1 -- 172.21.15.19:0/2785858749 wait complete. 2024-09-19T08:51:23.598 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:23 smithi019 ceph-mon[30976]: pgmap v310: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T08:51:23.599 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:23 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T08:51:23.599 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:23 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-19T08:51:23.599 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:23 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-09-19T08:51:23.599 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:23 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-09-19T08:51:23.599 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:23 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-09-19T08:51:23.599 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:23 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-19T08:51:23.599 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:23 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-09-19T08:51:23.599 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:23 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-19T08:51:23.599 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:23 smithi019 ceph-mon[30976]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T08:51:23.599 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:23 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:23.599 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:23 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:51:23.600 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:23 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:51:23.750 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":311,"stamp":"2024-09-19T08:51:22.538064+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657021,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":682,"num_read_kb":458,"num_write":424,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":346,"ondisk_log_size":346,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":355888,"kb_used_data":10800,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585936,"statfs":{"total":1151940427776,"available":1151575998464,"internally_reserved":0,"allocated":11059200,"data_stored":6951855,"data_compressed":107538,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19142,"internal_metadata":353154362},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.678290"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.885166+0000","last_change":"2024-09-19T08:50:15.893270+0000","last_active":"2024-09-19T08:50:16.885166+0000","last_peered":"2024-09-19T08:50:16.885166+0000","last_clean":"2024-09-19T08:50:16.885166+0000","last_became_active":"2024-09-19T08:50:15.892020+0000","last_became_peered":"2024-09-19T08:50:15.892020+0000","last_unstale":"2024-09-19T08:50:16.885166+0000","last_undegraded":"2024-09-19T08:50:16.885166+0000","last_fullsized":"2024-09-19T08:50:16.885166+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:40.846708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877980+0000","last_change":"2024-09-19T08:50:15.889331+0000","last_active":"2024-09-19T08:50:16.877980+0000","last_peered":"2024-09-19T08:50:16.877980+0000","last_clean":"2024-09-19T08:50:16.877980+0000","last_became_active":"2024-09-19T08:50:15.887082+0000","last_became_peered":"2024-09-19T08:50:15.887082+0000","last_unstale":"2024-09-19T08:50:16.877980+0000","last_undegraded":"2024-09-19T08:50:16.877980+0000","last_fullsized":"2024-09-19T08:50:16.877980+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:46.934172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877371+0000","last_change":"2024-09-19T08:50:15.891714+0000","last_active":"2024-09-19T08:50:16.877371+0000","last_peered":"2024-09-19T08:50:16.877371+0000","last_clean":"2024-09-19T08:50:16.877371+0000","last_became_active":"2024-09-19T08:50:15.891380+0000","last_became_peered":"2024-09-19T08:50:15.891380+0000","last_unstale":"2024-09-19T08:50:16.877371+0000","last_undegraded":"2024-09-19T08:50:16.877371+0000","last_fullsized":"2024-09-19T08:50:16.877371+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:02.203252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.880548+0000","last_change":"2024-09-19T08:50:15.896157+0000","last_active":"2024-09-19T08:50:16.880548+0000","last_peered":"2024-09-19T08:50:16.880548+0000","last_clean":"2024-09-19T08:50:16.880548+0000","last_became_active":"2024-09-19T08:50:15.895772+0000","last_became_peered":"2024-09-19T08:50:15.895772+0000","last_unstale":"2024-09-19T08:50:16.880548+0000","last_undegraded":"2024-09-19T08:50:16.880548+0000","last_fullsized":"2024-09-19T08:50:16.880548+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:12.915745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877401+0000","last_change":"2024-09-19T08:50:15.886600+0000","last_active":"2024-09-19T08:50:16.877401+0000","last_peered":"2024-09-19T08:50:16.877401+0000","last_clean":"2024-09-19T08:50:16.877401+0000","last_became_active":"2024-09-19T08:50:15.886270+0000","last_became_peered":"2024-09-19T08:50:15.886270+0000","last_unstale":"2024-09-19T08:50:16.877401+0000","last_undegraded":"2024-09-19T08:50:16.877401+0000","last_fullsized":"2024-09-19T08:50:16.877401+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:53.779930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869832+0000","last_change":"2024-09-19T08:50:15.889475+0000","last_active":"2024-09-19T08:50:16.869832+0000","last_peered":"2024-09-19T08:50:16.869832+0000","last_clean":"2024-09-19T08:50:16.869832+0000","last_became_active":"2024-09-19T08:50:15.889134+0000","last_became_peered":"2024-09-19T08:50:15.889134+0000","last_unstale":"2024-09-19T08:50:16.869832+0000","last_undegraded":"2024-09-19T08:50:16.869832+0000","last_fullsized":"2024-09-19T08:50:16.869832+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:53.977662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877346+0000","last_change":"2024-09-19T08:50:15.897163+0000","last_active":"2024-09-19T08:50:16.877346+0000","last_peered":"2024-09-19T08:50:16.877346+0000","last_clean":"2024-09-19T08:50:16.877346+0000","last_became_active":"2024-09-19T08:50:15.895161+0000","last_became_peered":"2024-09-19T08:50:15.895161+0000","last_unstale":"2024-09-19T08:50:16.877346+0000","last_undegraded":"2024-09-19T08:50:16.877346+0000","last_fullsized":"2024-09-19T08:50:16.877346+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:32.432691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869011+0000","last_change":"2024-09-19T08:50:15.891197+0000","last_active":"2024-09-19T08:50:16.869011+0000","last_peered":"2024-09-19T08:50:16.869011+0000","last_clean":"2024-09-19T08:50:16.869011+0000","last_became_active":"2024-09-19T08:50:15.890880+0000","last_became_peered":"2024-09-19T08:50:15.890880+0000","last_unstale":"2024-09-19T08:50:16.869011+0000","last_undegraded":"2024-09-19T08:50:16.869011+0000","last_fullsized":"2024-09-19T08:50:16.869011+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:41.100341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877991+0000","last_change":"2024-09-19T08:50:15.896043+0000","last_active":"2024-09-19T08:50:16.877991+0000","last_peered":"2024-09-19T08:50:16.877991+0000","last_clean":"2024-09-19T08:50:16.877991+0000","last_became_active":"2024-09-19T08:50:15.895498+0000","last_became_peered":"2024-09-19T08:50:15.895498+0000","last_unstale":"2024-09-19T08:50:16.877991+0000","last_undegraded":"2024-09-19T08:50:16.877991+0000","last_fullsized":"2024-09-19T08:50:16.877991+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:57.956427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.870481+0000","last_change":"2024-09-19T08:50:15.887658+0000","last_active":"2024-09-19T08:50:16.870481+0000","last_peered":"2024-09-19T08:50:16.870481+0000","last_clean":"2024-09-19T08:50:16.870481+0000","last_became_active":"2024-09-19T08:50:15.887199+0000","last_became_peered":"2024-09-19T08:50:15.887199+0000","last_unstale":"2024-09-19T08:50:16.870481+0000","last_undegraded":"2024-09-19T08:50:16.870481+0000","last_fullsized":"2024-09-19T08:50:16.870481+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:39.947735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876931+0000","last_change":"2024-09-19T08:50:15.894865+0000","last_active":"2024-09-19T08:50:16.876931+0000","last_peered":"2024-09-19T08:50:16.876931+0000","last_clean":"2024-09-19T08:50:16.876931+0000","last_became_active":"2024-09-19T08:50:15.894475+0000","last_became_peered":"2024-09-19T08:50:15.894475+0000","last_unstale":"2024-09-19T08:50:16.876931+0000","last_undegraded":"2024-09-19T08:50:16.876931+0000","last_fullsized":"2024-09-19T08:50:16.876931+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:43.235991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.880654+0000","last_change":"2024-09-19T08:50:15.897209+0000","last_active":"2024-09-19T08:50:16.880654+0000","last_peered":"2024-09-19T08:50:16.880654+0000","last_clean":"2024-09-19T08:50:16.880654+0000","last_became_active":"2024-09-19T08:50:15.896866+0000","last_became_peered":"2024-09-19T08:50:15.896866+0000","last_unstale":"2024-09-19T08:50:16.880654+0000","last_undegraded":"2024-09-19T08:50:16.880654+0000","last_fullsized":"2024-09-19T08:50:16.880654+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:23.036534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876974+0000","last_change":"2024-09-19T08:50:15.890076+0000","last_active":"2024-09-19T08:50:16.876974+0000","last_peered":"2024-09-19T08:50:16.876974+0000","last_clean":"2024-09-19T08:50:16.876974+0000","last_became_active":"2024-09-19T08:50:15.889735+0000","last_became_peered":"2024-09-19T08:50:15.889735+0000","last_unstale":"2024-09-19T08:50:16.876974+0000","last_undegraded":"2024-09-19T08:50:16.876974+0000","last_fullsized":"2024-09-19T08:50:16.876974+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:25.602757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877013+0000","last_change":"2024-09-19T08:50:15.886739+0000","last_active":"2024-09-19T08:50:16.877013+0000","last_peered":"2024-09-19T08:50:16.877013+0000","last_clean":"2024-09-19T08:50:16.877013+0000","last_became_active":"2024-09-19T08:50:15.886313+0000","last_became_peered":"2024-09-19T08:50:15.886313+0000","last_unstale":"2024-09-19T08:50:16.877013+0000","last_undegraded":"2024-09-19T08:50:16.877013+0000","last_fullsized":"2024-09-19T08:50:16.877013+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:03.244674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876731+0000","last_change":"2024-09-19T08:50:15.898519+0000","last_active":"2024-09-19T08:50:16.876731+0000","last_peered":"2024-09-19T08:50:16.876731+0000","last_clean":"2024-09-19T08:50:16.876731+0000","last_became_active":"2024-09-19T08:50:15.898249+0000","last_became_peered":"2024-09-19T08:50:15.898249+0000","last_unstale":"2024-09-19T08:50:16.876731+0000","last_undegraded":"2024-09-19T08:50:16.876731+0000","last_fullsized":"2024-09-19T08:50:16.876731+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:32.318895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876236+0000","last_change":"2024-09-19T08:50:15.890324+0000","last_active":"2024-09-19T08:50:16.876236+0000","last_peered":"2024-09-19T08:50:16.876236+0000","last_clean":"2024-09-19T08:50:16.876236+0000","last_became_active":"2024-09-19T08:50:15.887345+0000","last_became_peered":"2024-09-19T08:50:15.887345+0000","last_unstale":"2024-09-19T08:50:16.876236+0000","last_undegraded":"2024-09-19T08:50:16.876236+0000","last_fullsized":"2024-09-19T08:50:16.876236+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:27.989128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.885345+0000","last_change":"2024-09-19T08:50:15.896305+0000","last_active":"2024-09-19T08:50:16.885345+0000","last_peered":"2024-09-19T08:50:16.885345+0000","last_clean":"2024-09-19T08:50:16.885345+0000","last_became_active":"2024-09-19T08:50:15.895832+0000","last_became_peered":"2024-09-19T08:50:15.895832+0000","last_unstale":"2024-09-19T08:50:16.885345+0000","last_undegraded":"2024-09-19T08:50:16.885345+0000","last_fullsized":"2024-09-19T08:50:16.885345+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:37.098237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.880615+0000","last_change":"2024-09-19T08:50:15.887251+0000","last_active":"2024-09-19T08:50:16.880615+0000","last_peered":"2024-09-19T08:50:16.880615+0000","last_clean":"2024-09-19T08:50:16.880615+0000","last_became_active":"2024-09-19T08:50:15.886936+0000","last_became_peered":"2024-09-19T08:50:15.886936+0000","last_unstale":"2024-09-19T08:50:16.880615+0000","last_undegraded":"2024-09-19T08:50:16.880615+0000","last_fullsized":"2024-09-19T08:50:16.880615+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:38:08.828246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877371+0000","last_change":"2024-09-19T08:50:15.884813+0000","last_active":"2024-09-19T08:50:16.877371+0000","last_peered":"2024-09-19T08:50:16.877371+0000","last_clean":"2024-09-19T08:50:16.877371+0000","last_became_active":"2024-09-19T08:50:15.883445+0000","last_became_peered":"2024-09-19T08:50:15.883445+0000","last_unstale":"2024-09-19T08:50:16.877371+0000","last_undegraded":"2024-09-19T08:50:16.877371+0000","last_fullsized":"2024-09-19T08:50:16.877371+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:39.733501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.884301+0000","last_change":"2024-09-19T08:50:15.887644+0000","last_active":"2024-09-19T08:50:16.884301+0000","last_peered":"2024-09-19T08:50:16.884301+0000","last_clean":"2024-09-19T08:50:16.884301+0000","last_became_active":"2024-09-19T08:50:15.887224+0000","last_became_peered":"2024-09-19T08:50:15.887224+0000","last_unstale":"2024-09-19T08:50:16.884301+0000","last_undegraded":"2024-09-19T08:50:16.884301+0000","last_fullsized":"2024-09-19T08:50:16.884301+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:35.883690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.878822+0000","last_change":"2024-09-19T08:50:15.886678+0000","last_active":"2024-09-19T08:50:16.878822+0000","last_peered":"2024-09-19T08:50:16.878822+0000","last_clean":"2024-09-19T08:50:16.878822+0000","last_became_active":"2024-09-19T08:50:15.886360+0000","last_became_peered":"2024-09-19T08:50:15.886360+0000","last_unstale":"2024-09-19T08:50:16.878822+0000","last_undegraded":"2024-09-19T08:50:16.878822+0000","last_fullsized":"2024-09-19T08:50:16.878822+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:51.515211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876586+0000","last_change":"2024-09-19T08:50:15.887607+0000","last_active":"2024-09-19T08:50:16.876586+0000","last_peered":"2024-09-19T08:50:16.876586+0000","last_clean":"2024-09-19T08:50:16.876586+0000","last_became_active":"2024-09-19T08:50:15.887266+0000","last_became_peered":"2024-09-19T08:50:15.887266+0000","last_unstale":"2024-09-19T08:50:16.876586+0000","last_undegraded":"2024-09-19T08:50:16.876586+0000","last_fullsized":"2024-09-19T08:50:16.876586+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:44:57.404160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.868953+0000","last_change":"2024-09-19T08:50:15.882651+0000","last_active":"2024-09-19T08:50:16.868953+0000","last_peered":"2024-09-19T08:50:16.868953+0000","last_clean":"2024-09-19T08:50:16.868953+0000","last_became_active":"2024-09-19T08:50:15.882298+0000","last_became_peered":"2024-09-19T08:50:15.882298+0000","last_unstale":"2024-09-19T08:50:16.868953+0000","last_undegraded":"2024-09-19T08:50:16.868953+0000","last_fullsized":"2024-09-19T08:50:16.868953+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:16.028013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869849+0000","last_change":"2024-09-19T08:50:15.880407+0000","last_active":"2024-09-19T08:50:16.869849+0000","last_peered":"2024-09-19T08:50:16.869849+0000","last_clean":"2024-09-19T08:50:16.869849+0000","last_became_active":"2024-09-19T08:50:15.880026+0000","last_became_peered":"2024-09-19T08:50:15.880026+0000","last_unstale":"2024-09-19T08:50:16.869849+0000","last_undegraded":"2024-09-19T08:50:16.869849+0000","last_fullsized":"2024-09-19T08:50:16.869849+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:16.600913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869489+0000","last_change":"2024-09-19T08:50:15.883573+0000","last_active":"2024-09-19T08:50:16.869489+0000","last_peered":"2024-09-19T08:50:16.869489+0000","last_clean":"2024-09-19T08:50:16.869489+0000","last_became_active":"2024-09-19T08:50:15.883258+0000","last_became_peered":"2024-09-19T08:50:15.883258+0000","last_unstale":"2024-09-19T08:50:16.869489+0000","last_undegraded":"2024-09-19T08:50:16.869489+0000","last_fullsized":"2024-09-19T08:50:16.869489+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:33.026579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877624+0000","last_change":"2024-09-19T08:50:15.889519+0000","last_active":"2024-09-19T08:50:16.877624+0000","last_peered":"2024-09-19T08:50:16.877624+0000","last_clean":"2024-09-19T08:50:16.877624+0000","last_became_active":"2024-09-19T08:50:15.889183+0000","last_became_peered":"2024-09-19T08:50:15.889183+0000","last_unstale":"2024-09-19T08:50:16.877624+0000","last_undegraded":"2024-09-19T08:50:16.877624+0000","last_fullsized":"2024-09-19T08:50:16.877624+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:06.725662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.884752+0000","last_change":"2024-09-19T08:50:15.894483+0000","last_active":"2024-09-19T08:50:16.884752+0000","last_peered":"2024-09-19T08:50:16.884752+0000","last_clean":"2024-09-19T08:50:16.884752+0000","last_became_active":"2024-09-19T08:50:15.893760+0000","last_became_peered":"2024-09-19T08:50:15.893760+0000","last_unstale":"2024-09-19T08:50:16.884752+0000","last_undegraded":"2024-09-19T08:50:16.884752+0000","last_fullsized":"2024-09-19T08:50:16.884752+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:23.686592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876894+0000","last_change":"2024-09-19T08:50:15.882393+0000","last_active":"2024-09-19T08:50:16.876894+0000","last_peered":"2024-09-19T08:50:16.876894+0000","last_clean":"2024-09-19T08:50:16.876894+0000","last_became_active":"2024-09-19T08:50:15.882040+0000","last_became_peered":"2024-09-19T08:50:15.882040+0000","last_unstale":"2024-09-19T08:50:16.876894+0000","last_undegraded":"2024-09-19T08:50:16.876894+0000","last_fullsized":"2024-09-19T08:50:16.876894+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:22.430017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.878384+0000","last_change":"2024-09-19T08:50:15.890919+0000","last_active":"2024-09-19T08:50:16.878384+0000","last_peered":"2024-09-19T08:50:16.878384+0000","last_clean":"2024-09-19T08:50:16.878384+0000","last_became_active":"2024-09-19T08:50:15.890256+0000","last_became_peered":"2024-09-19T08:50:15.890256+0000","last_unstale":"2024-09-19T08:50:16.878384+0000","last_undegraded":"2024-09-19T08:50:16.878384+0000","last_fullsized":"2024-09-19T08:50:16.878384+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:48.404890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877173+0000","last_change":"2024-09-19T08:50:15.888139+0000","last_active":"2024-09-19T08:50:16.877173+0000","last_peered":"2024-09-19T08:50:16.877173+0000","last_clean":"2024-09-19T08:50:16.877173+0000","last_became_active":"2024-09-19T08:50:15.886471+0000","last_became_peered":"2024-09-19T08:50:15.886471+0000","last_unstale":"2024-09-19T08:50:16.877173+0000","last_undegraded":"2024-09-19T08:50:16.877173+0000","last_fullsized":"2024-09-19T08:50:16.877173+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:20.545473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877882+0000","last_change":"2024-09-19T08:50:15.891354+0000","last_active":"2024-09-19T08:50:16.877882+0000","last_peered":"2024-09-19T08:50:16.877882+0000","last_clean":"2024-09-19T08:50:16.877882+0000","last_became_active":"2024-09-19T08:50:15.890900+0000","last_became_peered":"2024-09-19T08:50:15.890900+0000","last_unstale":"2024-09-19T08:50:16.877882+0000","last_undegraded":"2024-09-19T08:50:16.877882+0000","last_fullsized":"2024-09-19T08:50:16.877882+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:33.139637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.884989+0000","last_change":"2024-09-19T08:50:15.891501+0000","last_active":"2024-09-19T08:50:16.884989+0000","last_peered":"2024-09-19T08:50:16.884989+0000","last_clean":"2024-09-19T08:50:16.884989+0000","last_became_active":"2024-09-19T08:50:15.891183+0000","last_became_peered":"2024-09-19T08:50:15.891183+0000","last_unstale":"2024-09-19T08:50:16.884989+0000","last_undegraded":"2024-09-19T08:50:16.884989+0000","last_fullsized":"2024-09-19T08:50:16.884989+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:16.976705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877858+0000","last_change":"2024-09-19T08:50:15.882048+0000","last_active":"2024-09-19T08:50:16.877858+0000","last_peered":"2024-09-19T08:50:16.877858+0000","last_clean":"2024-09-19T08:50:16.877858+0000","last_became_active":"2024-09-19T08:50:15.881156+0000","last_became_peered":"2024-09-19T08:50:15.881156+0000","last_unstale":"2024-09-19T08:50:16.877858+0000","last_undegraded":"2024-09-19T08:50:16.877858+0000","last_fullsized":"2024-09-19T08:50:16.877858+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:33.198852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:51:19.016969+0000","last_change":"2024-09-19T08:50:13.800156+0000","last_active":"2024-09-19T08:51:19.016969+0000","last_peered":"2024-09-19T08:51:19.016969+0000","last_clean":"2024-09-19T08:51:19.016969+0000","last_became_active":"2024-09-19T08:50:13.799779+0000","last_became_peered":"2024-09-19T08:50:13.799779+0000","last_unstale":"2024-09-19T08:51:19.016969+0000","last_undegraded":"2024-09-19T08:51:19.016969+0000","last_fullsized":"2024-09-19T08:51:19.016969+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:38.033049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869794+0000","last_change":"2024-09-19T08:50:15.887252+0000","last_active":"2024-09-19T08:50:16.869794+0000","last_peered":"2024-09-19T08:50:16.869794+0000","last_clean":"2024-09-19T08:50:16.869794+0000","last_became_active":"2024-09-19T08:50:15.886899+0000","last_became_peered":"2024-09-19T08:50:15.886899+0000","last_unstale":"2024-09-19T08:50:16.869794+0000","last_undegraded":"2024-09-19T08:50:16.869794+0000","last_fullsized":"2024-09-19T08:50:16.869794+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:56.262387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:25.932594+0000","last_change":"2024-09-19T08:50:13.795380+0000","last_active":"2024-09-19T08:50:25.932594+0000","last_peered":"2024-09-19T08:50:25.932594+0000","last_clean":"2024-09-19T08:50:25.932594+0000","last_became_active":"2024-09-19T08:50:13.794944+0000","last_became_peered":"2024-09-19T08:50:13.794944+0000","last_unstale":"2024-09-19T08:50:25.932594+0000","last_undegraded":"2024-09-19T08:50:25.932594+0000","last_fullsized":"2024-09-19T08:50:25.932594+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:13:14.317408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:24.924364+0000","last_change":"2024-09-19T08:50:13.794010+0000","last_active":"2024-09-19T08:50:24.924364+0000","last_peered":"2024-09-19T08:50:24.924364+0000","last_clean":"2024-09-19T08:50:24.924364+0000","last_became_active":"2024-09-19T08:50:13.793677+0000","last_became_peered":"2024-09-19T08:50:13.793677+0000","last_unstale":"2024-09-19T08:50:24.924364+0000","last_undegraded":"2024-09-19T08:50:24.924364+0000","last_fullsized":"2024-09-19T08:50:24.924364+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:56.125702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869056+0000","last_change":"2024-09-19T08:50:15.881732+0000","last_active":"2024-09-19T08:50:16.869056+0000","last_peered":"2024-09-19T08:50:16.869056+0000","last_clean":"2024-09-19T08:50:16.869056+0000","last_became_active":"2024-09-19T08:50:15.881394+0000","last_became_peered":"2024-09-19T08:50:15.881394+0000","last_unstale":"2024-09-19T08:50:16.869056+0000","last_undegraded":"2024-09-19T08:50:16.869056+0000","last_fullsized":"2024-09-19T08:50:16.869056+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:55.549138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.941084+0000","last_change":"2024-09-19T08:50:13.797118+0000","last_active":"2024-09-19T08:50:26.941084+0000","last_peered":"2024-09-19T08:50:26.941084+0000","last_clean":"2024-09-19T08:50:26.941084+0000","last_became_active":"2024-09-19T08:50:13.796727+0000","last_became_peered":"2024-09-19T08:50:13.796727+0000","last_unstale":"2024-09-19T08:50:26.941084+0000","last_undegraded":"2024-09-19T08:50:26.941084+0000","last_fullsized":"2024-09-19T08:50:26.941084+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:49.310543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.879798+0000","last_change":"2024-09-19T08:50:15.888192+0000","last_active":"2024-09-19T08:50:16.879798+0000","last_peered":"2024-09-19T08:50:16.879798+0000","last_clean":"2024-09-19T08:50:16.879798+0000","last_became_active":"2024-09-19T08:50:15.887890+0000","last_became_peered":"2024-09-19T08:50:15.887890+0000","last_unstale":"2024-09-19T08:50:16.879798+0000","last_undegraded":"2024-09-19T08:50:16.879798+0000","last_fullsized":"2024-09-19T08:50:16.879798+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:24:48.951856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":124,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:51:18.015041+0000","last_change":"2024-09-19T08:50:13.797427+0000","last_active":"2024-09-19T08:51:18.015041+0000","last_peered":"2024-09-19T08:51:18.015041+0000","last_clean":"2024-09-19T08:51:18.015041+0000","last_became_active":"2024-09-19T08:50:13.797021+0000","last_became_peered":"2024-09-19T08:50:13.797021+0000","last_unstale":"2024-09-19T08:51:18.015041+0000","last_undegraded":"2024-09-19T08:51:18.015041+0000","last_fullsized":"2024-09-19T08:51:18.015041+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:14.530373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.878467+0000","last_change":"2024-09-19T08:50:15.894619+0000","last_active":"2024-09-19T08:50:16.878467+0000","last_peered":"2024-09-19T08:50:16.878467+0000","last_clean":"2024-09-19T08:50:16.878467+0000","last_became_active":"2024-09-19T08:50:15.894258+0000","last_became_peered":"2024-09-19T08:50:15.894258+0000","last_unstale":"2024-09-19T08:50:16.878467+0000","last_undegraded":"2024-09-19T08:50:16.878467+0000","last_fullsized":"2024-09-19T08:50:16.878467+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:13.137314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.939873+0000","last_change":"2024-09-19T08:50:13.800867+0000","last_active":"2024-09-19T08:50:26.939873+0000","last_peered":"2024-09-19T08:50:26.939873+0000","last_clean":"2024-09-19T08:50:26.939873+0000","last_became_active":"2024-09-19T08:50:13.800376+0000","last_became_peered":"2024-09-19T08:50:13.800376+0000","last_unstale":"2024-09-19T08:50:26.939873+0000","last_undegraded":"2024-09-19T08:50:26.939873+0000","last_fullsized":"2024-09-19T08:50:26.939873+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:31.924599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.878704+0000","last_change":"2024-09-19T08:50:15.891121+0000","last_active":"2024-09-19T08:50:16.878704+0000","last_peered":"2024-09-19T08:50:16.878704+0000","last_clean":"2024-09-19T08:50:16.878704+0000","last_became_active":"2024-09-19T08:50:15.890810+0000","last_became_peered":"2024-09-19T08:50:15.890810+0000","last_unstale":"2024-09-19T08:50:16.878704+0000","last_undegraded":"2024-09-19T08:50:16.878704+0000","last_fullsized":"2024-09-19T08:50:16.878704+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:13.010282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:25.931563+0000","last_change":"2024-09-19T08:50:14.293953+0000","last_active":"2024-09-19T08:50:25.931563+0000","last_peered":"2024-09-19T08:50:25.931563+0000","last_clean":"2024-09-19T08:50:25.931563+0000","last_became_active":"2024-09-19T08:50:14.293546+0000","last_became_peered":"2024-09-19T08:50:14.293546+0000","last_unstale":"2024-09-19T08:50:25.931563+0000","last_undegraded":"2024-09-19T08:50:25.931563+0000","last_fullsized":"2024-09-19T08:50:25.931563+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:27.809243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877095+0000","last_change":"2024-09-19T08:50:15.878300+0000","last_active":"2024-09-19T08:50:16.877095+0000","last_peered":"2024-09-19T08:50:16.877095+0000","last_clean":"2024-09-19T08:50:16.877095+0000","last_became_active":"2024-09-19T08:50:15.877938+0000","last_became_peered":"2024-09-19T08:50:15.877938+0000","last_unstale":"2024-09-19T08:50:16.877095+0000","last_undegraded":"2024-09-19T08:50:16.877095+0000","last_fullsized":"2024-09-19T08:50:16.877095+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:05.376708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"80'28","reported_seq":155,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:51:18.014661+0000","last_change":"2024-09-19T08:50:13.800696+0000","last_active":"2024-09-19T08:51:18.014661+0000","last_peered":"2024-09-19T08:51:18.014661+0000","last_clean":"2024-09-19T08:51:18.014661+0000","last_became_active":"2024-09-19T08:50:13.799385+0000","last_became_peered":"2024-09-19T08:50:13.799385+0000","last_unstale":"2024-09-19T08:51:18.014661+0000","last_undegraded":"2024-09-19T08:51:18.014661+0000","last_fullsized":"2024-09-19T08:51:18.014661+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:56.897309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59211,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":109,"num_read_kb":111,"num_write":30,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.878356+0000","last_change":"2024-09-19T08:50:15.891483+0000","last_active":"2024-09-19T08:50:16.878356+0000","last_peered":"2024-09-19T08:50:16.878356+0000","last_clean":"2024-09-19T08:50:16.878356+0000","last_became_active":"2024-09-19T08:50:15.891185+0000","last_became_peered":"2024-09-19T08:50:15.891185+0000","last_unstale":"2024-09-19T08:50:16.878356+0000","last_undegraded":"2024-09-19T08:50:16.878356+0000","last_fullsized":"2024-09-19T08:50:16.878356+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:26.599151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:27.944994+0000","last_change":"2024-09-19T08:50:13.795148+0000","last_active":"2024-09-19T08:50:27.944994+0000","last_peered":"2024-09-19T08:50:27.944994+0000","last_clean":"2024-09-19T08:50:27.944994+0000","last_became_active":"2024-09-19T08:50:13.794688+0000","last_became_peered":"2024-09-19T08:50:13.794688+0000","last_unstale":"2024-09-19T08:50:27.944994+0000","last_undegraded":"2024-09-19T08:50:27.944994+0000","last_fullsized":"2024-09-19T08:50:27.944994+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:01.366439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877362+0000","last_change":"2024-09-19T08:50:15.886449+0000","last_active":"2024-09-19T08:50:16.877362+0000","last_peered":"2024-09-19T08:50:16.877362+0000","last_clean":"2024-09-19T08:50:16.877362+0000","last_became_active":"2024-09-19T08:50:15.886119+0000","last_became_peered":"2024-09-19T08:50:15.886119+0000","last_unstale":"2024-09-19T08:50:16.877362+0000","last_undegraded":"2024-09-19T08:50:16.877362+0000","last_fullsized":"2024-09-19T08:50:16.877362+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:22.916593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.940744+0000","last_change":"2024-09-19T08:50:13.799363+0000","last_active":"2024-09-19T08:50:26.940744+0000","last_peered":"2024-09-19T08:50:26.940744+0000","last_clean":"2024-09-19T08:50:26.940744+0000","last_became_active":"2024-09-19T08:50:13.799033+0000","last_became_peered":"2024-09-19T08:50:13.799033+0000","last_unstale":"2024-09-19T08:50:26.940744+0000","last_undegraded":"2024-09-19T08:50:26.940744+0000","last_fullsized":"2024-09-19T08:50:26.940744+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:57.753451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877104+0000","last_change":"2024-09-19T08:50:15.898902+0000","last_active":"2024-09-19T08:50:16.877104+0000","last_peered":"2024-09-19T08:50:16.877104+0000","last_clean":"2024-09-19T08:50:16.877104+0000","last_became_active":"2024-09-19T08:50:15.898417+0000","last_became_peered":"2024-09-19T08:50:15.898417+0000","last_unstale":"2024-09-19T08:50:16.877104+0000","last_undegraded":"2024-09-19T08:50:16.877104+0000","last_fullsized":"2024-09-19T08:50:16.877104+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:32:19.799301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'6","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:51:16.012068+0000","last_change":"2024-09-19T08:50:13.798477+0000","last_active":"2024-09-19T08:51:16.012068+0000","last_peered":"2024-09-19T08:51:16.012068+0000","last_clean":"2024-09-19T08:51:16.012068+0000","last_became_active":"2024-09-19T08:50:13.798136+0000","last_became_peered":"2024-09-19T08:50:13.798136+0000","last_unstale":"2024-09-19T08:51:16.012068+0000","last_undegraded":"2024-09-19T08:51:16.012068+0000","last_fullsized":"2024-09-19T08:51:16.012068+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:33.874285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876769+0000","last_change":"2024-09-19T08:50:15.896414+0000","last_active":"2024-09-19T08:50:16.876769+0000","last_peered":"2024-09-19T08:50:16.876769+0000","last_clean":"2024-09-19T08:50:16.876769+0000","last_became_active":"2024-09-19T08:50:15.895530+0000","last_became_peered":"2024-09-19T08:50:15.895530+0000","last_unstale":"2024-09-19T08:50:16.876769+0000","last_undegraded":"2024-09-19T08:50:16.876769+0000","last_fullsized":"2024-09-19T08:50:16.876769+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:59.717869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":36,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.940708+0000","last_change":"2024-09-19T08:50:14.294087+0000","last_active":"2024-09-19T08:50:26.940708+0000","last_peered":"2024-09-19T08:50:26.940708+0000","last_clean":"2024-09-19T08:50:26.940708+0000","last_became_active":"2024-09-19T08:50:14.293712+0000","last_became_peered":"2024-09-19T08:50:14.293712+0000","last_unstale":"2024-09-19T08:50:26.940708+0000","last_undegraded":"2024-09-19T08:50:26.940708+0000","last_fullsized":"2024-09-19T08:50:26.940708+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:12.187514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869736+0000","last_change":"2024-09-19T08:50:15.888134+0000","last_active":"2024-09-19T08:50:16.869736+0000","last_peered":"2024-09-19T08:50:16.869736+0000","last_clean":"2024-09-19T08:50:16.869736+0000","last_became_active":"2024-09-19T08:50:15.887768+0000","last_became_peered":"2024-09-19T08:50:15.887768+0000","last_unstale":"2024-09-19T08:50:16.869736+0000","last_undegraded":"2024-09-19T08:50:16.869736+0000","last_fullsized":"2024-09-19T08:50:16.869736+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:12.868773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.920893+0000","last_change":"2024-09-19T08:50:13.792585+0000","last_active":"2024-09-19T08:50:26.920893+0000","last_peered":"2024-09-19T08:50:26.920893+0000","last_clean":"2024-09-19T08:50:26.920893+0000","last_became_active":"2024-09-19T08:50:13.792222+0000","last_became_peered":"2024-09-19T08:50:13.792222+0000","last_unstale":"2024-09-19T08:50:26.920893+0000","last_undegraded":"2024-09-19T08:50:26.920893+0000","last_fullsized":"2024-09-19T08:50:26.920893+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:45.234800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.885284+0000","last_change":"2024-09-19T08:50:15.892725+0000","last_active":"2024-09-19T08:50:16.885284+0000","last_peered":"2024-09-19T08:50:16.885284+0000","last_clean":"2024-09-19T08:50:16.885284+0000","last_became_active":"2024-09-19T08:50:15.892357+0000","last_became_peered":"2024-09-19T08:50:15.892357+0000","last_unstale":"2024-09-19T08:50:16.885284+0000","last_undegraded":"2024-09-19T08:50:16.885284+0000","last_fullsized":"2024-09-19T08:50:16.885284+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:18.756349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.939949+0000","last_change":"2024-09-19T08:50:13.795360+0000","last_active":"2024-09-19T08:50:26.939949+0000","last_peered":"2024-09-19T08:50:26.939949+0000","last_clean":"2024-09-19T08:50:26.939949+0000","last_became_active":"2024-09-19T08:50:13.794823+0000","last_became_peered":"2024-09-19T08:50:13.794823+0000","last_unstale":"2024-09-19T08:50:26.939949+0000","last_undegraded":"2024-09-19T08:50:26.939949+0000","last_fullsized":"2024-09-19T08:50:26.939949+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:15.037834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877268+0000","last_change":"2024-09-19T08:50:15.893668+0000","last_active":"2024-09-19T08:50:16.877268+0000","last_peered":"2024-09-19T08:50:16.877268+0000","last_clean":"2024-09-19T08:50:16.877268+0000","last_became_active":"2024-09-19T08:50:15.893303+0000","last_became_peered":"2024-09-19T08:50:15.893303+0000","last_unstale":"2024-09-19T08:50:16.877268+0000","last_undegraded":"2024-09-19T08:50:16.877268+0000","last_fullsized":"2024-09-19T08:50:16.877268+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:59.281601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.939251+0000","last_change":"2024-09-19T08:50:13.797442+0000","last_active":"2024-09-19T08:50:26.939251+0000","last_peered":"2024-09-19T08:50:26.939251+0000","last_clean":"2024-09-19T08:50:26.939251+0000","last_became_active":"2024-09-19T08:50:13.797072+0000","last_became_peered":"2024-09-19T08:50:13.797072+0000","last_unstale":"2024-09-19T08:50:26.939251+0000","last_undegraded":"2024-09-19T08:50:26.939251+0000","last_fullsized":"2024-09-19T08:50:26.939251+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:32.960928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876874+0000","last_change":"2024-09-19T08:50:15.895819+0000","last_active":"2024-09-19T08:50:16.876874+0000","last_peered":"2024-09-19T08:50:16.876874+0000","last_clean":"2024-09-19T08:50:16.876874+0000","last_became_active":"2024-09-19T08:50:15.895468+0000","last_became_peered":"2024-09-19T08:50:15.895468+0000","last_unstale":"2024-09-19T08:50:16.876874+0000","last_undegraded":"2024-09-19T08:50:16.876874+0000","last_fullsized":"2024-09-19T08:50:16.876874+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:45:33.568263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'6","reported_seq":80,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:51:19.016959+0000","last_change":"2024-09-19T08:50:14.294014+0000","last_active":"2024-09-19T08:51:19.016959+0000","last_peered":"2024-09-19T08:51:19.016959+0000","last_clean":"2024-09-19T08:51:19.016959+0000","last_became_active":"2024-09-19T08:50:14.293564+0000","last_became_peered":"2024-09-19T08:50:14.293564+0000","last_unstale":"2024-09-19T08:51:19.016959+0000","last_undegraded":"2024-09-19T08:51:19.016959+0000","last_fullsized":"2024-09-19T08:51:19.016959+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:23.806408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1563,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877550+0000","last_change":"2024-09-19T08:50:15.891840+0000","last_active":"2024-09-19T08:50:16.877550+0000","last_peered":"2024-09-19T08:50:16.877550+0000","last_clean":"2024-09-19T08:50:16.877550+0000","last_became_active":"2024-09-19T08:50:15.891511+0000","last_became_peered":"2024-09-19T08:50:15.891511+0000","last_unstale":"2024-09-19T08:50:16.877550+0000","last_undegraded":"2024-09-19T08:50:16.877550+0000","last_fullsized":"2024-09-19T08:50:16.877550+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:26.800508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":327,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877159+0000","last_change":"2024-09-19T08:49:02.071497+0000","last_active":"2024-09-19T08:50:16.877159+0000","last_peered":"2024-09-19T08:50:16.877159+0000","last_clean":"2024-09-19T08:50:16.877159+0000","last_became_active":"2024-09-19T08:49:02.071114+0000","last_became_peered":"2024-09-19T08:49:02.071114+0000","last_unstale":"2024-09-19T08:50:16.877159+0000","last_undegraded":"2024-09-19T08:50:16.877159+0000","last_fullsized":"2024-09-19T08:50:16.877159+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:45:36.600595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:45:36.600595+0000","last_clean_scrub_stamp":"2024-09-19T08:45:36.600595+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:18:15.369279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":27,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:27.945549+0000","last_change":"2024-09-19T08:50:13.793981+0000","last_active":"2024-09-19T08:50:27.945549+0000","last_peered":"2024-09-19T08:50:27.945549+0000","last_clean":"2024-09-19T08:50:27.945549+0000","last_became_active":"2024-09-19T08:50:13.793616+0000","last_became_peered":"2024-09-19T08:50:13.793616+0000","last_unstale":"2024-09-19T08:50:27.945549+0000","last_undegraded":"2024-09-19T08:50:27.945549+0000","last_fullsized":"2024-09-19T08:50:27.945549+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:45.195906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869593+0000","last_change":"2024-09-19T08:50:15.891248+0000","last_active":"2024-09-19T08:50:16.869593+0000","last_peered":"2024-09-19T08:50:16.869593+0000","last_clean":"2024-09-19T08:50:16.869593+0000","last_became_active":"2024-09-19T08:50:15.890922+0000","last_became_peered":"2024-09-19T08:50:15.890922+0000","last_unstale":"2024-09-19T08:50:16.869593+0000","last_undegraded":"2024-09-19T08:50:16.869593+0000","last_fullsized":"2024-09-19T08:50:16.869593+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:18:43.914214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":22,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:24.924191+0000","last_change":"2024-09-19T08:50:13.797471+0000","last_active":"2024-09-19T08:50:24.924191+0000","last_peered":"2024-09-19T08:50:24.924191+0000","last_clean":"2024-09-19T08:50:24.924191+0000","last_became_active":"2024-09-19T08:50:13.797033+0000","last_became_peered":"2024-09-19T08:50:13.797033+0000","last_unstale":"2024-09-19T08:50:24.924191+0000","last_undegraded":"2024-09-19T08:50:24.924191+0000","last_fullsized":"2024-09-19T08:50:24.924191+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:53.141708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876668+0000","last_change":"2024-09-19T08:50:15.882650+0000","last_active":"2024-09-19T08:50:16.876668+0000","last_peered":"2024-09-19T08:50:16.876668+0000","last_clean":"2024-09-19T08:50:16.876668+0000","last_became_active":"2024-09-19T08:50:15.882308+0000","last_became_peered":"2024-09-19T08:50:15.882308+0000","last_unstale":"2024-09-19T08:50:16.876668+0000","last_undegraded":"2024-09-19T08:50:16.876668+0000","last_fullsized":"2024-09-19T08:50:16.876668+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:26.449562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:51:19.015376+0000","last_change":"2024-09-19T08:50:14.292466+0000","last_active":"2024-09-19T08:51:19.015376+0000","last_peered":"2024-09-19T08:51:19.015376+0000","last_clean":"2024-09-19T08:51:19.015376+0000","last_became_active":"2024-09-19T08:50:14.292092+0000","last_became_peered":"2024-09-19T08:50:14.292092+0000","last_unstale":"2024-09-19T08:51:19.015376+0000","last_undegraded":"2024-09-19T08:51:19.015376+0000","last_fullsized":"2024-09-19T08:51:19.015376+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:11.373226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":54,"num_read_kb":54,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869763+0000","last_change":"2024-09-19T08:50:15.886093+0000","last_active":"2024-09-19T08:50:16.869763+0000","last_peered":"2024-09-19T08:50:16.869763+0000","last_clean":"2024-09-19T08:50:16.869763+0000","last_became_active":"2024-09-19T08:50:15.885790+0000","last_became_peered":"2024-09-19T08:50:15.885790+0000","last_unstale":"2024-09-19T08:50:16.869763+0000","last_undegraded":"2024-09-19T08:50:16.869763+0000","last_fullsized":"2024-09-19T08:50:16.869763+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:06.405176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"80'5","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:51:19.015638+0000","last_change":"2024-09-19T08:50:13.799909+0000","last_active":"2024-09-19T08:51:19.015638+0000","last_peered":"2024-09-19T08:51:19.015638+0000","last_clean":"2024-09-19T08:51:19.015638+0000","last_became_active":"2024-09-19T08:50:13.799542+0000","last_became_peered":"2024-09-19T08:50:13.799542+0000","last_unstale":"2024-09-19T08:51:19.015638+0000","last_undegraded":"2024-09-19T08:51:19.015638+0000","last_fullsized":"2024-09-19T08:51:19.015638+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:23.545897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.870214+0000","last_change":"2024-09-19T08:50:15.890410+0000","last_active":"2024-09-19T08:50:16.870214+0000","last_peered":"2024-09-19T08:50:16.870214+0000","last_clean":"2024-09-19T08:50:16.870214+0000","last_became_active":"2024-09-19T08:50:15.890093+0000","last_became_peered":"2024-09-19T08:50:15.890093+0000","last_unstale":"2024-09-19T08:50:16.870214+0000","last_undegraded":"2024-09-19T08:50:16.870214+0000","last_fullsized":"2024-09-19T08:50:16.870214+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:45:06.533722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":19,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.880158+0000","last_change":"2024-09-19T08:50:14.292577+0000","last_active":"2024-09-19T08:50:16.880158+0000","last_peered":"2024-09-19T08:50:16.880158+0000","last_clean":"2024-09-19T08:50:16.880158+0000","last_became_active":"2024-09-19T08:50:14.292220+0000","last_became_peered":"2024-09-19T08:50:14.292220+0000","last_unstale":"2024-09-19T08:50:16.880158+0000","last_undegraded":"2024-09-19T08:50:16.880158+0000","last_fullsized":"2024-09-19T08:50:16.880158+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:23.631672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":14,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:18.755907+0000","last_change":"2024-09-19T08:50:15.891345+0000","last_active":"2024-09-19T08:50:18.755907+0000","last_peered":"2024-09-19T08:50:18.755907+0000","last_clean":"2024-09-19T08:50:18.755907+0000","last_became_active":"2024-09-19T08:50:15.891006+0000","last_became_peered":"2024-09-19T08:50:15.891006+0000","last_unstale":"2024-09-19T08:50:18.755907+0000","last_undegraded":"2024-09-19T08:50:18.755907+0000","last_fullsized":"2024-09-19T08:50:18.755907+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:41.934331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.940739+0000","last_change":"2024-09-19T08:50:14.292619+0000","last_active":"2024-09-19T08:50:26.940739+0000","last_peered":"2024-09-19T08:50:26.940739+0000","last_clean":"2024-09-19T08:50:26.940739+0000","last_became_active":"2024-09-19T08:50:14.292230+0000","last_became_peered":"2024-09-19T08:50:14.292230+0000","last_unstale":"2024-09-19T08:50:26.940739+0000","last_undegraded":"2024-09-19T08:50:26.940739+0000","last_fullsized":"2024-09-19T08:50:26.940739+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:21:33.076142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877022+0000","last_change":"2024-09-19T08:50:15.882760+0000","last_active":"2024-09-19T08:50:16.877022+0000","last_peered":"2024-09-19T08:50:16.877022+0000","last_clean":"2024-09-19T08:50:16.877022+0000","last_became_active":"2024-09-19T08:50:15.882402+0000","last_became_peered":"2024-09-19T08:50:15.882402+0000","last_unstale":"2024-09-19T08:50:16.877022+0000","last_undegraded":"2024-09-19T08:50:16.877022+0000","last_fullsized":"2024-09-19T08:50:16.877022+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:17.343385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"80'15","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:40.877709+0000","last_change":"2024-09-19T08:50:13.790982+0000","last_active":"2024-09-19T08:50:40.877709+0000","last_peered":"2024-09-19T08:50:40.877709+0000","last_clean":"2024-09-19T08:50:40.877709+0000","last_became_active":"2024-09-19T08:50:13.790644+0000","last_became_peered":"2024-09-19T08:50:13.790644+0000","last_unstale":"2024-09-19T08:50:40.877709+0000","last_undegraded":"2024-09-19T08:50:40.877709+0000","last_fullsized":"2024-09-19T08:50:40.877709+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:20:25.923021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869864+0000","last_change":"2024-09-19T08:50:15.887556+0000","last_active":"2024-09-19T08:50:16.869864+0000","last_peered":"2024-09-19T08:50:16.869864+0000","last_clean":"2024-09-19T08:50:16.869864+0000","last_became_active":"2024-09-19T08:50:15.887280+0000","last_became_peered":"2024-09-19T08:50:15.887280+0000","last_unstale":"2024-09-19T08:50:16.869864+0000","last_undegraded":"2024-09-19T08:50:16.869864+0000","last_fullsized":"2024-09-19T08:50:16.869864+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:51.226527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":26,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.939936+0000","last_change":"2024-09-19T08:50:14.012150+0000","last_active":"2024-09-19T08:50:26.939936+0000","last_peered":"2024-09-19T08:50:26.939936+0000","last_clean":"2024-09-19T08:50:26.939936+0000","last_became_active":"2024-09-19T08:50:14.011799+0000","last_became_peered":"2024-09-19T08:50:14.011799+0000","last_unstale":"2024-09-19T08:50:26.939936+0000","last_undegraded":"2024-09-19T08:50:26.939936+0000","last_fullsized":"2024-09-19T08:50:26.939936+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:37.310539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.878237+0000","last_change":"2024-09-19T08:50:15.889577+0000","last_active":"2024-09-19T08:50:16.878237+0000","last_peered":"2024-09-19T08:50:16.878237+0000","last_clean":"2024-09-19T08:50:16.878237+0000","last_became_active":"2024-09-19T08:50:15.889244+0000","last_became_peered":"2024-09-19T08:50:15.889244+0000","last_unstale":"2024-09-19T08:50:16.878237+0000","last_undegraded":"2024-09-19T08:50:16.878237+0000","last_fullsized":"2024-09-19T08:50:16.878237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:54.382221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:23.919295+0000","last_change":"2024-09-19T08:50:14.293845+0000","last_active":"2024-09-19T08:50:23.919295+0000","last_peered":"2024-09-19T08:50:23.919295+0000","last_clean":"2024-09-19T08:50:23.919295+0000","last_became_active":"2024-09-19T08:50:14.293585+0000","last_became_peered":"2024-09-19T08:50:14.293585+0000","last_unstale":"2024-09-19T08:50:23.919295+0000","last_undegraded":"2024-09-19T08:50:23.919295+0000","last_fullsized":"2024-09-19T08:50:23.919295+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:02.886475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877681+0000","last_change":"2024-09-19T08:50:15.888591+0000","last_active":"2024-09-19T08:50:16.877681+0000","last_peered":"2024-09-19T08:50:16.877681+0000","last_clean":"2024-09-19T08:50:16.877681+0000","last_became_active":"2024-09-19T08:50:15.888270+0000","last_became_peered":"2024-09-19T08:50:15.888270+0000","last_unstale":"2024-09-19T08:50:16.877681+0000","last_undegraded":"2024-09-19T08:50:16.877681+0000","last_fullsized":"2024-09-19T08:50:16.877681+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:08.644828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":25,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.939797+0000","last_change":"2024-09-19T08:50:13.794081+0000","last_active":"2024-09-19T08:50:26.939797+0000","last_peered":"2024-09-19T08:50:26.939797+0000","last_clean":"2024-09-19T08:50:26.939797+0000","last_became_active":"2024-09-19T08:50:13.793770+0000","last_became_peered":"2024-09-19T08:50:13.793770+0000","last_unstale":"2024-09-19T08:50:26.939797+0000","last_undegraded":"2024-09-19T08:50:26.939797+0000","last_fullsized":"2024-09-19T08:50:26.939797+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:43.053893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.885008+0000","last_change":"2024-09-19T08:50:15.885338+0000","last_active":"2024-09-19T08:50:16.885008+0000","last_peered":"2024-09-19T08:50:16.885008+0000","last_clean":"2024-09-19T08:50:16.885008+0000","last_became_active":"2024-09-19T08:50:15.884983+0000","last_became_peered":"2024-09-19T08:50:15.884983+0000","last_unstale":"2024-09-19T08:50:16.885008+0000","last_undegraded":"2024-09-19T08:50:16.885008+0000","last_fullsized":"2024-09-19T08:50:16.885008+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:05.228871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'3","reported_seq":21,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:25.931497+0000","last_change":"2024-09-19T08:50:13.795440+0000","last_active":"2024-09-19T08:50:25.931497+0000","last_peered":"2024-09-19T08:50:25.931497+0000","last_clean":"2024-09-19T08:50:25.931497+0000","last_became_active":"2024-09-19T08:50:13.795053+0000","last_became_peered":"2024-09-19T08:50:13.795053+0000","last_unstale":"2024-09-19T08:50:25.931497+0000","last_undegraded":"2024-09-19T08:50:25.931497+0000","last_fullsized":"2024-09-19T08:50:25.931497+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:13.466112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869289+0000","last_change":"2024-09-19T08:50:15.886587+0000","last_active":"2024-09-19T08:50:16.869289+0000","last_peered":"2024-09-19T08:50:16.869289+0000","last_clean":"2024-09-19T08:50:16.869289+0000","last_became_active":"2024-09-19T08:50:15.886231+0000","last_became_peered":"2024-09-19T08:50:15.886231+0000","last_unstale":"2024-09-19T08:50:16.869289+0000","last_undegraded":"2024-09-19T08:50:16.869289+0000","last_fullsized":"2024-09-19T08:50:16.869289+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:11.965382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":23,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:23.921108+0000","last_change":"2024-09-19T08:50:13.796681+0000","last_active":"2024-09-19T08:50:23.921108+0000","last_peered":"2024-09-19T08:50:23.921108+0000","last_clean":"2024-09-19T08:50:23.921108+0000","last_became_active":"2024-09-19T08:50:13.796338+0000","last_became_peered":"2024-09-19T08:50:13.796338+0000","last_unstale":"2024-09-19T08:50:23.921108+0000","last_undegraded":"2024-09-19T08:50:23.921108+0000","last_fullsized":"2024-09-19T08:50:23.921108+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:32.588800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.877525+0000","last_change":"2024-09-19T08:50:15.889667+0000","last_active":"2024-09-19T08:50:16.877525+0000","last_peered":"2024-09-19T08:50:16.877525+0000","last_clean":"2024-09-19T08:50:16.877525+0000","last_became_active":"2024-09-19T08:50:15.889341+0000","last_became_peered":"2024-09-19T08:50:15.889341+0000","last_unstale":"2024-09-19T08:50:16.877525+0000","last_undegraded":"2024-09-19T08:50:16.877525+0000","last_fullsized":"2024-09-19T08:50:16.877525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:13.255483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.870110+0000","last_change":"2024-09-19T08:50:15.887337+0000","last_active":"2024-09-19T08:50:16.870110+0000","last_peered":"2024-09-19T08:50:16.870110+0000","last_clean":"2024-09-19T08:50:16.870110+0000","last_became_active":"2024-09-19T08:50:15.887001+0000","last_became_peered":"2024-09-19T08:50:15.887001+0000","last_unstale":"2024-09-19T08:50:16.870110+0000","last_undegraded":"2024-09-19T08:50:16.870110+0000","last_fullsized":"2024-09-19T08:50:16.870110+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:43.544863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":24,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:26.940436+0000","last_change":"2024-09-19T08:50:13.799321+0000","last_active":"2024-09-19T08:50:26.940436+0000","last_peered":"2024-09-19T08:50:26.940436+0000","last_clean":"2024-09-19T08:50:26.940436+0000","last_became_active":"2024-09-19T08:50:13.798837+0000","last_became_peered":"2024-09-19T08:50:13.798837+0000","last_unstale":"2024-09-19T08:50:26.940436+0000","last_undegraded":"2024-09-19T08:50:26.940436+0000","last_fullsized":"2024-09-19T08:50:26.940436+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:35.753093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.876836+0000","last_change":"2024-09-19T08:50:15.892074+0000","last_active":"2024-09-19T08:50:16.876836+0000","last_peered":"2024-09-19T08:50:16.876836+0000","last_clean":"2024-09-19T08:50:16.876836+0000","last_became_active":"2024-09-19T08:50:15.891722+0000","last_became_peered":"2024-09-19T08:50:15.891722+0000","last_unstale":"2024-09-19T08:50:16.876836+0000","last_undegraded":"2024-09-19T08:50:16.876836+0000","last_fullsized":"2024-09-19T08:50:16.876836+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:39.913080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":31,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:27.944924+0000","last_change":"2024-09-19T08:50:13.795577+0000","last_active":"2024-09-19T08:50:27.944924+0000","last_peered":"2024-09-19T08:50:27.944924+0000","last_clean":"2024-09-19T08:50:27.944924+0000","last_became_active":"2024-09-19T08:50:13.795254+0000","last_became_peered":"2024-09-19T08:50:13.795254+0000","last_unstale":"2024-09-19T08:50:27.944924+0000","last_undegraded":"2024-09-19T08:50:27.944924+0000","last_fullsized":"2024-09-19T08:50:27.944924+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:13.263447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.878562+0000","last_change":"2024-09-19T08:50:15.884584+0000","last_active":"2024-09-19T08:50:16.878562+0000","last_peered":"2024-09-19T08:50:16.878562+0000","last_clean":"2024-09-19T08:50:16.878562+0000","last_became_active":"2024-09-19T08:50:15.884244+0000","last_became_peered":"2024-09-19T08:50:15.884244+0000","last_unstale":"2024-09-19T08:50:16.878562+0000","last_undegraded":"2024-09-19T08:50:16.878562+0000","last_fullsized":"2024-09-19T08:50:16.878562+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:58.835351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":20,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.880212+0000","last_change":"2024-09-19T08:50:14.294210+0000","last_active":"2024-09-19T08:50:16.880212+0000","last_peered":"2024-09-19T08:50:16.880212+0000","last_clean":"2024-09-19T08:50:16.880212+0000","last_became_active":"2024-09-19T08:50:14.293850+0000","last_became_peered":"2024-09-19T08:50:14.293850+0000","last_unstale":"2024-09-19T08:50:16.880212+0000","last_undegraded":"2024-09-19T08:50:16.880212+0000","last_fullsized":"2024-09-19T08:50:16.880212+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:42:44.340766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:50:16.869569+0000","last_change":"2024-09-19T08:50:15.892934+0000","last_active":"2024-09-19T08:50:16.869569+0000","last_peered":"2024-09-19T08:50:16.869569+0000","last_clean":"2024-09-19T08:50:16.869569+0000","last_became_active":"2024-09-19T08:50:15.892309+0000","last_became_peered":"2024-09-19T08:50:15.892309+0000","last_unstale":"2024-09-19T08:50:16.869569+0000","last_undegraded":"2024-09-19T08:50:16.869569+0000","last_fullsized":"2024-09-19T08:50:16.869569+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:40.158724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-09-19T08:51:17.012740+0000","last_change":"2024-09-19T08:50:13.796977+0000","last_active":"2024-09-19T08:51:17.012740+0000","last_peered":"2024-09-19T08:51:17.012740+0000","last_clean":"2024-09-19T08:51:17.012740+0000","last_became_active":"2024-09-19T08:50:13.796628+0000","last_became_peered":"2024-09-19T08:50:13.796628+0000","last_unstale":"2024-09-19T08:51:17.012740+0000","last_undegraded":"2024-09-19T08:51:17.012740+0000","last_fullsized":"2024-09-19T08:51:17.012740+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:06:59.335583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66419,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":556,"num_read_kb":349,"num_write":241,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":199257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":207,"ondisk_log_size":207,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":247642,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579931,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":872448,"data_stored":416651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808863,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1028096,"data_stored":1066891,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972389,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":897024,"data_stored":416188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201322,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":892928,"data_stored":416566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430255,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":1009086,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593781,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":415905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822713,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32120,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713032,"statfs":{"total":95995035648,"available":95962144768,"internally_reserved":0,"allocated":958464,"data_stored":1008371,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953532,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27884,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717268,"statfs":{"total":95995035648,"available":95966482432,"internally_reserved":0,"allocated":880640,"data_stored":416159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182467,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713092,"statfs":{"total":95995035648,"available":95962206208,"internally_reserved":0,"allocated":897024,"data_stored":415730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411401,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":476642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":476029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":417637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34206,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34206,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":60963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1585,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:51:23.754 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T08:51:23.754 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T08:51:23.755 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-19T08:51:23.755 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-19T08:51:23.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:23 smithi155 ceph-mon[34921]: pgmap v310: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T08:51:23.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:23 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T08:51:23.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:23 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-19T08:51:23.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:23 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-09-19T08:51:23.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:23 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-09-19T08:51:23.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:23 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-09-19T08:51:23.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:23 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-19T08:51:23.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:23 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-09-19T08:51:23.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:23 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-19T08:51:23.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:23 smithi155 ceph-mon[34921]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T08:51:23.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:23 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:23.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:23 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:51:23.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:23 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:51:23.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:23 smithi203 ceph-mon[35450]: pgmap v310: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T08:51:23.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:23 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-09-19T08:51:23.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:23 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.16", "id": [2, 4]}]': finished 2024-09-19T08:51:23.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:23 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-09-19T08:51:23.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:23 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 11]}]': finished 2024-09-19T08:51:23.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:23 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 8]}]': finished 2024-09-19T08:51:23.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:23 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-19T08:51:23.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:23 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-09-19T08:51:23.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:23 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2024-09-19T08:51:23.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:23 smithi203 ceph-mon[35450]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T08:51:23.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:23 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:51:23.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:23 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:51:23.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:23 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:51:24.023 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:24.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.537+0000 7f40813d4640 1 -- 172.21.15.19:0/1204382060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f407c1036e0 msgr2=0x7f407c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:24.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.537+0000 7f40813d4640 1 --2- 172.21.15.19:0/1204382060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f407c1036e0 0x7f407c107b90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4070009cd0 tx=0x7f407002a8e0 comp rx=0 tx=0).stop 2024-09-19T08:51:24.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.537+0000 7f40813d4640 1 -- 172.21.15.19:0/1204382060 shutdown_connections 2024-09-19T08:51:24.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.537+0000 7f40813d4640 1 --2- 172.21.15.19:0/1204382060 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f407c1082a0 0x7f407c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:24.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.537+0000 7f40813d4640 1 --2- 172.21.15.19:0/1204382060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f407c1036e0 0x7f407c107b90 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:24.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.537+0000 7f40813d4640 1 --2- 172.21.15.19:0/1204382060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f407c102d30 0x7f407c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:24.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.537+0000 7f40813d4640 1 -- 172.21.15.19:0/1204382060 >> 172.21.15.19:0/1204382060 conn(0x7f407c0fc7d0 msgr2=0x7f407c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:24.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.537+0000 7f40813d4640 1 -- 172.21.15.19:0/1204382060 shutdown_connections 2024-09-19T08:51:24.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.537+0000 7f40813d4640 1 -- 172.21.15.19:0/1204382060 wait complete. 2024-09-19T08:51:24.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.537+0000 7f40813d4640 1 Processor -- start 2024-09-19T08:51:24.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.538+0000 7f40813d4640 1 -- start start 2024-09-19T08:51:24.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.538+0000 7f40813d4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f407c102d30 0x7f407c198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:24.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.538+0000 7f40813d4640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f407c1036e0 0x7f407c198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:24.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.538+0000 7f40813d4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f407c1082a0 0x7f407c19cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:24.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.538+0000 7f40813d4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f407c1120a0 con 0x7f407c1082a0 2024-09-19T08:51:24.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.538+0000 7f40813d4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f407c111f20 con 0x7f407c102d30 2024-09-19T08:51:24.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.538+0000 7f40813d4640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f407c112220 con 0x7f407c1036e0 2024-09-19T08:51:24.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.538+0000 7f407b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f407c1082a0 0x7f407c19cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:24.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.538+0000 7f407b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f407c1082a0 0x7f407c19cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34816/0 (socket says 172.21.15.19:34816) 2024-09-19T08:51:24.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.538+0000 7f407b7fe640 1 -- 172.21.15.19:0/1437415296 learned_addr learned my addr 172.21.15.19:0/1437415296 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:24.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.538+0000 7f407affd640 1 --2- 172.21.15.19:0/1437415296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f407c102d30 0x7f407c198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:24.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.538+0000 7f407b7fe640 1 -- 172.21.15.19:0/1437415296 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f407c1036e0 msgr2=0x7f407c198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:24.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.538+0000 7f407b7fe640 1 --2- 172.21.15.19:0/1437415296 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f407c1036e0 0x7f407c198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:24.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.538+0000 7f407b7fe640 1 -- 172.21.15.19:0/1437415296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f407c102d30 msgr2=0x7f407c198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:24.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.538+0000 7f407b7fe640 1 --2- 172.21.15.19:0/1437415296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f407c102d30 0x7f407c198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:24.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.538+0000 7f407b7fe640 1 -- 172.21.15.19:0/1437415296 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f407c19d5f0 con 0x7f407c1082a0 2024-09-19T08:51:24.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.539+0000 7f407b7fe640 1 --2- 172.21.15.19:0/1437415296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f407c1082a0 0x7f407c19cf10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f407400d750 tx=0x7f407400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:24.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.539+0000 7f4063fff640 1 -- 172.21.15.19:0/1437415296 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4074017070 con 0x7f407c1082a0 2024-09-19T08:51:24.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.539+0000 7f40813d4640 1 -- 172.21.15.19:0/1437415296 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f407c19d8e0 con 0x7f407c1082a0 2024-09-19T08:51:24.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.539+0000 7f4063fff640 1 -- 172.21.15.19:0/1437415296 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4074005500 con 0x7f407c1082a0 2024-09-19T08:51:24.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.539+0000 7f4063fff640 1 -- 172.21.15.19:0/1437415296 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4074004d90 con 0x7f407c1082a0 2024-09-19T08:51:24.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.539+0000 7f40813d4640 1 -- 172.21.15.19:0/1437415296 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f407c1a51c0 con 0x7f407c1082a0 2024-09-19T08:51:24.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.540+0000 7f40813d4640 1 -- 172.21.15.19:0/1437415296 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f407c103110 con 0x7f407c1082a0 2024-09-19T08:51:24.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.541+0000 7f4063fff640 1 -- 172.21.15.19:0/1437415296 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4074004f30 con 0x7f407c1082a0 2024-09-19T08:51:24.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.542+0000 7f4063fff640 1 --2- 172.21.15.19:0/1437415296 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f40640a32d0 0x7f40640a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:24.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.542+0000 7f407affd640 1 --2- 172.21.15.19:0/1437415296 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f40640a32d0 0x7f40640a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:24.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.542+0000 7f4063fff640 1 -- 172.21.15.19:0/1437415296 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f40740cf430 con 0x7f407c1082a0 2024-09-19T08:51:24.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.542+0000 7f407affd640 1 --2- 172.21.15.19:0/1437415296 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f40640a32d0 0x7f40640a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f406c0058c0 tx=0x7f406c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:24.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.546+0000 7f4063fff640 1 -- 172.21.15.19:0/1437415296 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f407409bfa0 con 0x7f407c1082a0 2024-09-19T08:51:24.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.761+0000 7f40813d4640 1 -- 172.21.15.19:0/1437415296 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f407c10a2b0 con 0x7f407c1082a0 2024-09-19T08:51:24.760 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:24 smithi019 ceph-mon[30976]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:51:24.761 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:24 smithi019 ceph-mon[30976]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T08:51:24.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.761+0000 7f4063fff640 1 -- 172.21.15.19:0/1437415296 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f407409b8a0 con 0x7f407c1082a0 2024-09-19T08:51:24.761 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:51:24.761 INFO:teuthology.orchestra.run.smithi019.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T08:51:24.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.763+0000 7f40813d4640 1 -- 172.21.15.19:0/1437415296 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f40640a32d0 msgr2=0x7f40640a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:24.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.763+0000 7f40813d4640 1 --2- 172.21.15.19:0/1437415296 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f40640a32d0 0x7f40640a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f406c0058c0 tx=0x7f406c00a2d0 comp rx=0 tx=0).stop 2024-09-19T08:51:24.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.763+0000 7f40813d4640 1 -- 172.21.15.19:0/1437415296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f407c1082a0 msgr2=0x7f407c19cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:24.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.763+0000 7f40813d4640 1 --2- 172.21.15.19:0/1437415296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f407c1082a0 0x7f407c19cf10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f407400d750 tx=0x7f407400dc10 comp rx=0 tx=0).stop 2024-09-19T08:51:24.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.763+0000 7f40813d4640 1 -- 172.21.15.19:0/1437415296 shutdown_connections 2024-09-19T08:51:24.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.763+0000 7f40813d4640 1 --2- 172.21.15.19:0/1437415296 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f40640a32d0 0x7f40640a5790 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:24.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.763+0000 7f40813d4640 1 --2- 172.21.15.19:0/1437415296 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f407c1036e0 0x7f407c198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:24.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.763+0000 7f40813d4640 1 --2- 172.21.15.19:0/1437415296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f407c1082a0 0x7f407c19cf10 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:24.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.763+0000 7f40813d4640 1 --2- 172.21.15.19:0/1437415296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f407c102d30 0x7f407c198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:24.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.763+0000 7f40813d4640 1 -- 172.21.15.19:0/1437415296 >> 172.21.15.19:0/1437415296 conn(0x7f407c0fc7d0 msgr2=0x7f407c106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:24.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.764+0000 7f40813d4640 1 -- 172.21.15.19:0/1437415296 shutdown_connections 2024-09-19T08:51:24.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:24.764+0000 7f40813d4640 1 -- 172.21.15.19:0/1437415296 wait complete. 2024-09-19T08:51:24.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:24 smithi155 ceph-mon[34921]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:51:24.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:24 smithi155 ceph-mon[34921]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T08:51:24.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:24 smithi203 ceph-mon[35450]: from='client.14937 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:51:24.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:24 smithi203 ceph-mon[35450]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T08:51:25.417 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-19T08:51:25.417 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:51:25.680 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:25.801 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:25 smithi019 ceph-mon[30976]: pgmap v313: 97 pgs: 1 activating, 96 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s; 83 B/s, 1 objects/s recovering 2024-09-19T08:51:25.802 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:25 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1437415296' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T08:51:25.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:25 smithi155 ceph-mon[34921]: pgmap v313: 97 pgs: 1 activating, 96 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s; 83 B/s, 1 objects/s recovering 2024-09-19T08:51:25.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:25 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1437415296' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T08:51:25.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:25 smithi203 ceph-mon[35450]: pgmap v313: 97 pgs: 1 activating, 96 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s; 83 B/s, 1 objects/s recovering 2024-09-19T08:51:25.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:25 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1437415296' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T08:51:26.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.205+0000 7f18fee75640 1 -- 172.21.15.19:0/1240444673 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18f8101420 msgr2=0x7f18f810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:26.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.205+0000 7f18fee75640 1 --2- 172.21.15.19:0/1240444673 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18f8101420 0x7f18f810d950 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f18f0009cd0 tx=0x7f18f002a8e0 comp rx=0 tx=0).stop 2024-09-19T08:51:26.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.205+0000 7f18fee75640 1 -- 172.21.15.19:0/1240444673 shutdown_connections 2024-09-19T08:51:26.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.205+0000 7f18fee75640 1 --2- 172.21.15.19:0/1240444673 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18f8101420 0x7f18f810d950 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:26.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.205+0000 7f18fee75640 1 --2- 172.21.15.19:0/1240444673 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18f8100a80 0x7f18f8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:26.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.205+0000 7f18fee75640 1 --2- 172.21.15.19:0/1240444673 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18f8106a80 0x7f18f8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:26.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.205+0000 7f18fee75640 1 -- 172.21.15.19:0/1240444673 >> 172.21.15.19:0/1240444673 conn(0x7f18f80fc7a0 msgr2=0x7f18f80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:26.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.205+0000 7f18fee75640 1 -- 172.21.15.19:0/1240444673 shutdown_connections 2024-09-19T08:51:26.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.205+0000 7f18fee75640 1 -- 172.21.15.19:0/1240444673 wait complete. 2024-09-19T08:51:26.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.206+0000 7f18fee75640 1 Processor -- start 2024-09-19T08:51:26.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.206+0000 7f18fee75640 1 -- start start 2024-09-19T08:51:26.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.206+0000 7f18fee75640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18f8100a80 0x7f18f81985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:26.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.206+0000 7f18fee75640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18f8101420 0x7f18f8198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:26.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.206+0000 7f18fee75640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18f8106a80 0x7f18f819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:26.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.206+0000 7f18fee75640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f18f8110f20 con 0x7f18f8101420 2024-09-19T08:51:26.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.206+0000 7f18fee75640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f18f8110da0 con 0x7f18f8106a80 2024-09-19T08:51:26.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.206+0000 7f18fee75640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f18f81110a0 con 0x7f18f8100a80 2024-09-19T08:51:26.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.206+0000 7f18f7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18f8101420 0x7f18f8198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:26.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.206+0000 7f18f7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18f8101420 0x7f18f8198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54666/0 (socket says 172.21.15.19:54666) 2024-09-19T08:51:26.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.206+0000 7f18f7fff640 1 -- 172.21.15.19:0/3728916394 learned_addr learned my addr 172.21.15.19:0/3728916394 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:26.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.206+0000 7f18fcc11640 1 --2- 172.21.15.19:0/3728916394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18f8100a80 0x7f18f81985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:26.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.207+0000 7f18fd412640 1 --2- 172.21.15.19:0/3728916394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18f8106a80 0x7f18f819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:26.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.207+0000 7f18f7fff640 1 -- 172.21.15.19:0/3728916394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18f8100a80 msgr2=0x7f18f81985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:26.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.207+0000 7f18f7fff640 1 --2- 172.21.15.19:0/3728916394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18f8100a80 0x7f18f81985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:26.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.207+0000 7f18f7fff640 1 -- 172.21.15.19:0/3728916394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18f8106a80 msgr2=0x7f18f819ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:26.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.207+0000 7f18f7fff640 1 --2- 172.21.15.19:0/3728916394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18f8106a80 0x7f18f819ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:26.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.207+0000 7f18f7fff640 1 -- 172.21.15.19:0/3728916394 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18f819d550 con 0x7f18f8101420 2024-09-19T08:51:26.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.207+0000 7f18f7fff640 1 --2- 172.21.15.19:0/3728916394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18f8101420 0x7f18f8198ae0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f18e400b4a0 tx=0x7f18e400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:26.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.207+0000 7f18f5ffb640 1 -- 172.21.15.19:0/3728916394 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e4015020 con 0x7f18f8101420 2024-09-19T08:51:26.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.207+0000 7f18f5ffb640 1 -- 172.21.15.19:0/3728916394 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18e4011d10 con 0x7f18f8101420 2024-09-19T08:51:26.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.207+0000 7f18fee75640 1 -- 172.21.15.19:0/3728916394 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18f819d840 con 0x7f18f8101420 2024-09-19T08:51:26.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.207+0000 7f18f5ffb640 1 -- 172.21.15.19:0/3728916394 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18e400f2e0 con 0x7f18f8101420 2024-09-19T08:51:26.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.207+0000 7f18fee75640 1 -- 172.21.15.19:0/3728916394 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18f81a5120 con 0x7f18f8101420 2024-09-19T08:51:26.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.208+0000 7f18fee75640 1 -- 172.21.15.19:0/3728916394 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18f8100f60 con 0x7f18f8101420 2024-09-19T08:51:26.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.209+0000 7f18f5ffb640 1 -- 172.21.15.19:0/3728916394 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f18e4018020 con 0x7f18f8101420 2024-09-19T08:51:26.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.210+0000 7f18f5ffb640 1 --2- 172.21.15.19:0/3728916394 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f18e80a3350 0x7f18e80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:26.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.211+0000 7f18fcc11640 1 --2- 172.21.15.19:0/3728916394 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f18e80a3350 0x7f18e80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:26.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.211+0000 7f18f5ffb640 1 -- 172.21.15.19:0/3728916394 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f18e40cf1f0 con 0x7f18f8101420 2024-09-19T08:51:26.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.211+0000 7f18fcc11640 1 --2- 172.21.15.19:0/3728916394 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f18e80a3350 0x7f18e80a5810 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f18ec009990 tx=0x7f18ec009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:26.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.215+0000 7f18f5ffb640 1 -- 172.21.15.19:0/3728916394 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f18e401f020 con 0x7f18f8101420 2024-09-19T08:51:26.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.428+0000 7f18fee75640 1 -- 172.21.15.19:0/3728916394 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f18f8109a90 con 0x7f18f8101420 2024-09-19T08:51:26.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.429+0000 7f18f5ffb640 1 -- 172.21.15.19:0/3728916394 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11983 (secure 0 0 0) 0x7f18e409bed0 con 0x7f18f8101420 2024-09-19T08:51:26.429 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:51:26.430 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"btime":"2024-09-19T08:50:27:938748+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2452068876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2452068876},{"type":"v1","addr":"172.21.15.19:6839","nonce":2452068876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T08:50:27.938727+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/2480841559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2480841559},{"type":"v1","addr":"172.21.15.155:6835","nonce":2480841559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24469,24490,24464,24463]},"id":1}]} 2024-09-19T08:51:26.430 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 27 2024-09-19T08:51:26.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.432+0000 7f18fee75640 1 -- 172.21.15.19:0/3728916394 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f18e80a3350 msgr2=0x7f18e80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:26.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.432+0000 7f18fee75640 1 --2- 172.21.15.19:0/3728916394 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f18e80a3350 0x7f18e80a5810 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f18ec009990 tx=0x7f18ec009110 comp rx=0 tx=0).stop 2024-09-19T08:51:26.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.432+0000 7f18fee75640 1 -- 172.21.15.19:0/3728916394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18f8101420 msgr2=0x7f18f8198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:26.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.432+0000 7f18fee75640 1 --2- 172.21.15.19:0/3728916394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18f8101420 0x7f18f8198ae0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f18e400b4a0 tx=0x7f18e400b8a0 comp rx=0 tx=0).stop 2024-09-19T08:51:26.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.432+0000 7f18fee75640 1 -- 172.21.15.19:0/3728916394 shutdown_connections 2024-09-19T08:51:26.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.432+0000 7f18fee75640 1 --2- 172.21.15.19:0/3728916394 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f18e80a3350 0x7f18e80a5810 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:26.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.432+0000 7f18fee75640 1 --2- 172.21.15.19:0/3728916394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f18f8106a80 0x7f18f819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:26.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.432+0000 7f18fee75640 1 --2- 172.21.15.19:0/3728916394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f18f8101420 0x7f18f8198ae0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:26.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.432+0000 7f18fee75640 1 --2- 172.21.15.19:0/3728916394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18f8100a80 0x7f18f81985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:26.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.432+0000 7f18fee75640 1 -- 172.21.15.19:0/3728916394 >> 172.21.15.19:0/3728916394 conn(0x7f18f80fc7a0 msgr2=0x7f18f806aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:26.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.432+0000 7f18fee75640 1 -- 172.21.15.19:0/3728916394 shutdown_connections 2024-09-19T08:51:26.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:26.432+0000 7f18fee75640 1 -- 172.21.15.19:0/3728916394 wait complete. 2024-09-19T08:51:26.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:26 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3728916394' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:51:26.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:26 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3728916394' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:51:26.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:26 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3728916394' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:51:27.222 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:51:27.485 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:27.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:27 smithi019 ceph-mon[30976]: pgmap v314: 97 pgs: 1 activating, 96 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s; 98 B/s, 1 objects/s recovering 2024-09-19T08:51:27.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:27 smithi155 ceph-mon[34921]: pgmap v314: 97 pgs: 1 activating, 96 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s; 98 B/s, 1 objects/s recovering 2024-09-19T08:51:27.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.952+0000 7f234867b640 1 -- 172.21.15.19:0/319680005 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2340106f10 msgr2=0x7f234010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:27.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.952+0000 7f234867b640 1 --2- 172.21.15.19:0/319680005 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2340106f10 0x7f234010ea90 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2338009ca0 tx=0x7f233802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:51:27.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.952+0000 7f234867b640 1 -- 172.21.15.19:0/319680005 shutdown_connections 2024-09-19T08:51:27.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.952+0000 7f234867b640 1 --2- 172.21.15.19:0/319680005 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2340106f10 0x7f234010ea90 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:27.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.952+0000 7f234867b640 1 --2- 172.21.15.19:0/319680005 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2340102790 0x7f23401067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:27.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.952+0000 7f234867b640 1 --2- 172.21.15.19:0/319680005 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2340101de0 0x7f23401021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.952+0000 7f234867b640 1 -- 172.21.15.19:0/319680005 >> 172.21.15.19:0/319680005 conn(0x7f23400fd8c0 msgr2=0x7f23400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.952+0000 7f234867b640 1 -- 172.21.15.19:0/319680005 shutdown_connections 2024-09-19T08:51:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.952+0000 7f234867b640 1 -- 172.21.15.19:0/319680005 wait complete. 2024-09-19T08:51:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.953+0000 7f234867b640 1 Processor -- start 2024-09-19T08:51:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.953+0000 7f234867b640 1 -- start start 2024-09-19T08:51:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.953+0000 7f234867b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2340101de0 0x7f23400744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.953+0000 7f234867b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2340102790 0x7f2340074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.953+0000 7f234867b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2340106f10 0x7f2340074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.953+0000 7f234867b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2340111f70 con 0x7f2340106f10 2024-09-19T08:51:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.953+0000 7f234867b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2340111df0 con 0x7f2340101de0 2024-09-19T08:51:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.953+0000 7f234867b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f23401120f0 con 0x7f2340102790 2024-09-19T08:51:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.953+0000 7f2346c18640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2340106f10 0x7f2340074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.953+0000 7f2346c18640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2340106f10 0x7f2340074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54680/0 (socket says 172.21.15.19:54680) 2024-09-19T08:51:27.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.953+0000 7f2346c18640 1 -- 172.21.15.19:0/1430490812 learned_addr learned my addr 172.21.15.19:0/1430490812 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:27.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.953+0000 7f2346417640 1 --2- 172.21.15.19:0/1430490812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2340101de0 0x7f23400744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:27.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.954+0000 7f2345c16640 1 --2- 172.21.15.19:0/1430490812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2340102790 0x7f2340074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:27.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.954+0000 7f2346c18640 1 -- 172.21.15.19:0/1430490812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2340102790 msgr2=0x7f2340074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:27.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.954+0000 7f2346c18640 1 --2- 172.21.15.19:0/1430490812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2340102790 0x7f2340074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:27.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.954+0000 7f2346c18640 1 -- 172.21.15.19:0/1430490812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2340101de0 msgr2=0x7f23400744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:27.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.954+0000 7f2346c18640 1 --2- 172.21.15.19:0/1430490812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2340101de0 0x7f23400744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:27.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.954+0000 7f2346c18640 1 -- 172.21.15.19:0/1430490812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23401a67f0 con 0x7f2340106f10 2024-09-19T08:51:27.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.954+0000 7f2345c16640 1 --2- 172.21.15.19:0/1430490812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2340102790 0x7f2340074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:51:27.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.954+0000 7f2346c18640 1 --2- 172.21.15.19:0/1430490812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2340106f10 0x7f2340074f70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2338031a20 tx=0x7f2338031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:27.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.954+0000 7f23377fe640 1 -- 172.21.15.19:0/1430490812 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2338003b70 con 0x7f2340106f10 2024-09-19T08:51:27.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.954+0000 7f234867b640 1 -- 172.21.15.19:0/1430490812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23401a6a80 con 0x7f2340106f10 2024-09-19T08:51:27.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.954+0000 7f23377fe640 1 -- 172.21.15.19:0/1430490812 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2338003d10 con 0x7f2340106f10 2024-09-19T08:51:27.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.954+0000 7f23377fe640 1 -- 172.21.15.19:0/1430490812 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233802fc80 con 0x7f2340106f10 2024-09-19T08:51:27.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.954+0000 7f234867b640 1 -- 172.21.15.19:0/1430490812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23401a6fc0 con 0x7f2340106f10 2024-09-19T08:51:27.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.955+0000 7f234867b640 1 -- 172.21.15.19:0/1430490812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23401021c0 con 0x7f2340106f10 2024-09-19T08:51:27.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.956+0000 7f23377fe640 1 -- 172.21.15.19:0/1430490812 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f23380046a0 con 0x7f2340106f10 2024-09-19T08:51:27.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.957+0000 7f23377fe640 1 --2- 172.21.15.19:0/1430490812 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f232c0a32d0 0x7f232c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:27.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.957+0000 7f2346417640 1 --2- 172.21.15.19:0/1430490812 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f232c0a32d0 0x7f232c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:27.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.957+0000 7f23377fe640 1 -- 172.21.15.19:0/1430490812 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f23380f0bf0 con 0x7f2340106f10 2024-09-19T08:51:27.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.958+0000 7f2346417640 1 --2- 172.21.15.19:0/1430490812 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f232c0a32d0 0x7f232c0a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f233c00abe0 tx=0x7f233c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:27.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:27.961+0000 7f23377fe640 1 -- 172.21.15.19:0/1430490812 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f23380bd960 con 0x7f2340106f10 2024-09-19T08:51:27.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:27 smithi203 ceph-mon[35450]: pgmap v314: 97 pgs: 1 activating, 96 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 11 op/s; 98 B/s, 1 objects/s recovering 2024-09-19T08:51:28.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:28.171+0000 7f234867b640 1 -- 172.21.15.19:0/1430490812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f234010a120 con 0x7f2340106f10 2024-09-19T08:51:28.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:28.172+0000 7f23377fe640 1 -- 172.21.15.19:0/1430490812 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11983 (secure 0 0 0) 0x7f23380bd260 con 0x7f2340106f10 2024-09-19T08:51:28.172 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:51:28.172 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"btime":"2024-09-19T08:50:27:938748+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2452068876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2452068876},{"type":"v1","addr":"172.21.15.19:6839","nonce":2452068876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T08:50:27.938727+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/2480841559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2480841559},{"type":"v1","addr":"172.21.15.155:6835","nonce":2480841559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24469,24490,24464,24463]},"id":1}]} 2024-09-19T08:51:28.172 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 27 2024-09-19T08:51:28.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:28.175+0000 7f234867b640 1 -- 172.21.15.19:0/1430490812 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f232c0a32d0 msgr2=0x7f232c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:28.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:28.175+0000 7f234867b640 1 --2- 172.21.15.19:0/1430490812 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f232c0a32d0 0x7f232c0a5790 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f233c00abe0 tx=0x7f233c00a2d0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:28.175+0000 7f234867b640 1 -- 172.21.15.19:0/1430490812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2340106f10 msgr2=0x7f2340074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:28.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:28.175+0000 7f234867b640 1 --2- 172.21.15.19:0/1430490812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2340106f10 0x7f2340074f70 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2338031a20 tx=0x7f2338031a50 comp rx=0 tx=0).stop 2024-09-19T08:51:28.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:28.175+0000 7f234867b640 1 -- 172.21.15.19:0/1430490812 shutdown_connections 2024-09-19T08:51:28.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:28.175+0000 7f234867b640 1 --2- 172.21.15.19:0/1430490812 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f232c0a32d0 0x7f232c0a5790 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:28.175+0000 7f234867b640 1 --2- 172.21.15.19:0/1430490812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2340102790 0x7f2340074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:28.175+0000 7f234867b640 1 --2- 172.21.15.19:0/1430490812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2340106f10 0x7f2340074f70 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:28.175+0000 7f234867b640 1 --2- 172.21.15.19:0/1430490812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2340101de0 0x7f23400744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:28.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:28.175+0000 7f234867b640 1 -- 172.21.15.19:0/1430490812 >> 172.21.15.19:0/1430490812 conn(0x7f23400fd8c0 msgr2=0x7f23400febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:28.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:28.175+0000 7f234867b640 1 -- 172.21.15.19:0/1430490812 shutdown_connections 2024-09-19T08:51:28.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:28.175+0000 7f234867b640 1 -- 172.21.15.19:0/1430490812 wait complete. 2024-09-19T08:51:28.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:28 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1430490812' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:51:28.860 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:51:28.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:28 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1430490812' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:51:28.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:28 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1430490812' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:51:29.119 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:29.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.609+0000 7f9c89c2e640 1 -- 172.21.15.19:0/2119089846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c841037a0 msgr2=0x7f9c8410bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:29.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.609+0000 7f9c89c2e640 1 --2- 172.21.15.19:0/2119089846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c841037a0 0x7f9c8410bc00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9c78009900 tx=0x7f9c7802a410 comp rx=0 tx=0).stop 2024-09-19T08:51:29.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.609+0000 7f9c89c2e640 1 -- 172.21.15.19:0/2119089846 shutdown_connections 2024-09-19T08:51:29.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.609+0000 7f9c89c2e640 1 --2- 172.21.15.19:0/2119089846 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c8410c2f0 0x7f9c8410e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:29.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.609+0000 7f9c89c2e640 1 --2- 172.21.15.19:0/2119089846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c841037a0 0x7f9c8410bc00 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:29.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.609+0000 7f9c89c2e640 1 --2- 172.21.15.19:0/2119089846 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c84102df0 0x7f9c841031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:29.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.609+0000 7f9c89c2e640 1 -- 172.21.15.19:0/2119089846 >> 172.21.15.19:0/2119089846 conn(0x7f9c840fc7d0 msgr2=0x7f9c840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:29.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.609+0000 7f9c89c2e640 1 -- 172.21.15.19:0/2119089846 shutdown_connections 2024-09-19T08:51:29.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.609+0000 7f9c89c2e640 1 -- 172.21.15.19:0/2119089846 wait complete. 2024-09-19T08:51:29.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.610+0000 7f9c89c2e640 1 Processor -- start 2024-09-19T08:51:29.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.610+0000 7f9c89c2e640 1 -- start start 2024-09-19T08:51:29.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.610+0000 7f9c89c2e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c84102df0 0x7f9c841986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:29.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.610+0000 7f9c89c2e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c841037a0 0x7f9c84198bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:29.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.610+0000 7f9c89c2e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c8410c2f0 0x7f9c8419cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:29.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.610+0000 7f9c89c2e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9c84112130 con 0x7f9c8410c2f0 2024-09-19T08:51:29.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.610+0000 7f9c89c2e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9c84111fb0 con 0x7f9c84102df0 2024-09-19T08:51:29.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.610+0000 7f9c89c2e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9c841122b0 con 0x7f9c841037a0 2024-09-19T08:51:29.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.611+0000 7f9c83fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c8410c2f0 0x7f9c8419cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.611+0000 7f9c83fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c8410c2f0 0x7f9c8419cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54688/0 (socket says 172.21.15.19:54688) 2024-09-19T08:51:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.611+0000 7f9c83fff640 1 -- 172.21.15.19:0/3297235234 learned_addr learned my addr 172.21.15.19:0/3297235234 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.611+0000 7f9c837fe640 1 --2- 172.21.15.19:0/3297235234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c84102df0 0x7f9c841986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.611+0000 7f9c82ffd640 1 --2- 172.21.15.19:0/3297235234 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c841037a0 0x7f9c84198bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.611+0000 7f9c83fff640 1 -- 172.21.15.19:0/3297235234 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c841037a0 msgr2=0x7f9c84198bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.611+0000 7f9c83fff640 1 --2- 172.21.15.19:0/3297235234 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c841037a0 0x7f9c84198bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.611+0000 7f9c83fff640 1 -- 172.21.15.19:0/3297235234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c84102df0 msgr2=0x7f9c841986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.611+0000 7f9c83fff640 1 --2- 172.21.15.19:0/3297235234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c84102df0 0x7f9c841986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.611+0000 7f9c83fff640 1 -- 172.21.15.19:0/3297235234 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c8419d660 con 0x7f9c8410c2f0 2024-09-19T08:51:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.611+0000 7f9c82ffd640 1 --2- 172.21.15.19:0/3297235234 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c841037a0 0x7f9c84198bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:51:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.611+0000 7f9c83fff640 1 --2- 172.21.15.19:0/3297235234 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c8410c2f0 0x7f9c8419cf80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00eb10 tx=0x7f9c7c00ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:29.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.611+0000 7f9c80ff9640 1 -- 172.21.15.19:0/3297235234 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c00ce20 con 0x7f9c8410c2f0 2024-09-19T08:51:29.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.611+0000 7f9c80ff9640 1 -- 172.21.15.19:0/3297235234 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9c7c005020 con 0x7f9c8410c2f0 2024-09-19T08:51:29.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.611+0000 7f9c89c2e640 1 -- 172.21.15.19:0/3297235234 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c8419d950 con 0x7f9c8410c2f0 2024-09-19T08:51:29.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.611+0000 7f9c80ff9640 1 -- 172.21.15.19:0/3297235234 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c010690 con 0x7f9c8410c2f0 2024-09-19T08:51:29.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.611+0000 7f9c89c2e640 1 -- 172.21.15.19:0/3297235234 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c841a5230 con 0x7f9c8410c2f0 2024-09-19T08:51:29.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.612+0000 7f9c89c2e640 1 -- 172.21.15.19:0/3297235234 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c841031d0 con 0x7f9c8410c2f0 2024-09-19T08:51:29.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.614+0000 7f9c80ff9640 1 -- 172.21.15.19:0/3297235234 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9c7c005540 con 0x7f9c8410c2f0 2024-09-19T08:51:29.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.614+0000 7f9c80ff9640 1 --2- 172.21.15.19:0/3297235234 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9c6c0a3350 0x7f9c6c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:29.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.615+0000 7f9c80ff9640 1 -- 172.21.15.19:0/3297235234 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9c7c0d0230 con 0x7f9c8410c2f0 2024-09-19T08:51:29.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.615+0000 7f9c837fe640 1 --2- 172.21.15.19:0/3297235234 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9c6c0a3350 0x7f9c6c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:29.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.615+0000 7f9c837fe640 1 --2- 172.21.15.19:0/3297235234 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9c6c0a3350 0x7f9c6c0a5810 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9c74009990 tx=0x7f9c74009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:29.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.618+0000 7f9c80ff9640 1 -- 172.21.15.19:0/3297235234 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9c7c054210 con 0x7f9c8410c2f0 2024-09-19T08:51:29.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.795+0000 7f9c89c2e640 1 -- 172.21.15.19:0/3297235234 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9c84199a10 con 0x7f9c8410c2f0 2024-09-19T08:51:29.795 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:29 smithi019 ceph-mon[30976]: pgmap v315: 97 pgs: 1 activating, 96 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 8 op/s; 98 B/s, 1 objects/s recovering 2024-09-19T08:51:29.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.797+0000 7f9c80ff9640 1 -- 172.21.15.19:0/3297235234 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22651 (secure 0 0 0) 0x7f9c84199a10 con 0x7f9c8410c2f0 2024-09-19T08:51:29.797 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:51:29.797 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":82,"fsid":"f26c9d84-7662-11ef-bceb-c7b262605968","created":"2024-09-19T08:42:32.324073+0000","modified":"2024-09-19T08:51:23.536977+0000","last_up_change":"2024-09-19T08:49:24.764960+0000","last_in_change":"2024-09-19T08:49:01.062919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:45:36.232910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:50:12.615884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:50:14.854513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81c7bb06-5b13-4ee0-9290-d779faac1b91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6803","nonce":3397146732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6805","nonce":3397146732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6809","nonce":3397146732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6807","nonce":3397146732}]},"public_addr":"172.21.15.19:6803/3397146732","cluster_addr":"172.21.15.19:6805/3397146732","heartbeat_back_addr":"172.21.15.19:6809/3397146732","heartbeat_front_addr":"172.21.15.19:6807/3397146732","state":["exists","up"]},{"osd":1,"uuid":"24c145e6-5252-4708-8f25-5ce041e8251e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6801","nonce":2011043685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6803","nonce":2011043685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6807","nonce":2011043685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6805","nonce":2011043685}]},"public_addr":"172.21.15.155:6801/2011043685","cluster_addr":"172.21.15.155:6803/2011043685","heartbeat_back_addr":"172.21.15.155:6807/2011043685","heartbeat_front_addr":"172.21.15.155:6805/2011043685","state":["exists","up"]},{"osd":2,"uuid":"99cefd33-0675-495f-8871-2e6fdead0c3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6801","nonce":3358994623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6803","nonce":3358994623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6807","nonce":3358994623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6805","nonce":3358994623}]},"public_addr":"172.21.15.203:6801/3358994623","cluster_addr":"172.21.15.203:6803/3358994623","heartbeat_back_addr":"172.21.15.203:6807/3358994623","heartbeat_front_addr":"172.21.15.203:6805/3358994623","state":["exists","up"]},{"osd":3,"uuid":"8f46c16c-f17e-484a-8b66-6dbf135f34c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6811","nonce":176445576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6813","nonce":176445576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6817","nonce":176445576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6815","nonce":176445576}]},"public_addr":"172.21.15.19:6811/176445576","cluster_addr":"172.21.15.19:6813/176445576","heartbeat_back_addr":"172.21.15.19:6817/176445576","heartbeat_front_addr":"172.21.15.19:6815/176445576","state":["exists","up"]},{"osd":4,"uuid":"411b0423-1317-4e82-bc01-b5f55b391bc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6809","nonce":2163087792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6811","nonce":2163087792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6815","nonce":2163087792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6813","nonce":2163087792}]},"public_addr":"172.21.15.155:6809/2163087792","cluster_addr":"172.21.15.155:6811/2163087792","heartbeat_back_addr":"172.21.15.155:6815/2163087792","heartbeat_front_addr":"172.21.15.155:6813/2163087792","state":["exists","up"]},{"osd":5,"uuid":"057c073e-569f-4c6e-9602-e1169ad4dd8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6809","nonce":334881465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6811","nonce":334881465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6815","nonce":334881465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6813","nonce":334881465}]},"public_addr":"172.21.15.203:6809/334881465","cluster_addr":"172.21.15.203:6811/334881465","heartbeat_back_addr":"172.21.15.203:6815/334881465","heartbeat_front_addr":"172.21.15.203:6813/334881465","state":["exists","up"]},{"osd":6,"uuid":"40418f13-823e-4f94-a427-84781abbcb5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6819","nonce":2669779791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6821","nonce":2669779791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6825","nonce":2669779791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6823","nonce":2669779791}]},"public_addr":"172.21.15.19:6819/2669779791","cluster_addr":"172.21.15.19:6821/2669779791","heartbeat_back_addr":"172.21.15.19:6825/2669779791","heartbeat_front_addr":"172.21.15.19:6823/2669779791","state":["exists","up"]},{"osd":7,"uuid":"ad15f762-aeab-4167-a63d-6c9f9b89b9c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6817","nonce":3169455907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6819","nonce":3169455907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6823","nonce":3169455907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6821","nonce":3169455907}]},"public_addr":"172.21.15.155:6817/3169455907","cluster_addr":"172.21.15.155:6819/3169455907","heartbeat_back_addr":"172.21.15.155:6823/3169455907","heartbeat_front_addr":"172.21.15.155:6821/3169455907","state":["exists","up"]},{"osd":8,"uuid":"23cf8ea2-29d6-43d8-a05b-7822f4bbf254","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6817","nonce":1062999528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6819","nonce":1062999528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6823","nonce":1062999528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6821","nonce":1062999528}]},"public_addr":"172.21.15.203:6817/1062999528","cluster_addr":"172.21.15.203:6819/1062999528","heartbeat_back_addr":"172.21.15.203:6823/1062999528","heartbeat_front_addr":"172.21.15.203:6821/1062999528","state":["exists","up"]},{"osd":9,"uuid":"e851e605-2d17-4fbf-b783-2138133edd06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6827","nonce":574664786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6829","nonce":574664786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6833","nonce":574664786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6831","nonce":574664786}]},"public_addr":"172.21.15.19:6827/574664786","cluster_addr":"172.21.15.19:6829/574664786","heartbeat_back_addr":"172.21.15.19:6833/574664786","heartbeat_front_addr":"172.21.15.19:6831/574664786","state":["exists","up"]},{"osd":10,"uuid":"cc770717-91bd-4494-9103-6db8214b5872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6825","nonce":2242158832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6827","nonce":2242158832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6831","nonce":2242158832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6829","nonce":2242158832}]},"public_addr":"172.21.15.155:6825/2242158832","cluster_addr":"172.21.15.155:6827/2242158832","heartbeat_back_addr":"172.21.15.155:6831/2242158832","heartbeat_front_addr":"172.21.15.155:6829/2242158832","state":["exists","up"]},{"osd":11,"uuid":"6c237db9-5d79-47bc-8ff6-60d09d721d5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6825","nonce":522943955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6827","nonce":522943955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6831","nonce":522943955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6829","nonce":522943955}]},"public_addr":"172.21.15.203:6825/522943955","cluster_addr":"172.21.15.203:6827/522943955","heartbeat_back_addr":"172.21.15.203:6831/522943955","heartbeat_front_addr":"172.21.15.203:6829/522943955","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:44:44.656414+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:09.339183+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:33.245452+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:59.449025+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:46:24.831213+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:46:49.189780+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:47:13.493628+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:47:39.478247+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:05.089875+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:30.722878+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:56.951834+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:22.894678+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6801/4266644067":"2024-09-20T08:43:21.732222+0000","172.21.15.19:0/1398782170":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6800/4266644067":"2024-09-20T08:43:21.732222+0000","172.21.15.19:0/34162461":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6801/1764769529":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/2910961714":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6800/1764769529":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/820792769":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/560203138":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/809642328":"2024-09-20T08:42:56.618773+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:51:29.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.799+0000 7f9c89c2e640 1 -- 172.21.15.19:0/3297235234 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9c6c0a3350 msgr2=0x7f9c6c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:29.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.799+0000 7f9c89c2e640 1 --2- 172.21.15.19:0/3297235234 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9c6c0a3350 0x7f9c6c0a5810 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9c74009990 tx=0x7f9c74009110 comp rx=0 tx=0).stop 2024-09-19T08:51:29.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.799+0000 7f9c89c2e640 1 -- 172.21.15.19:0/3297235234 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c8410c2f0 msgr2=0x7f9c8419cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:29.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.799+0000 7f9c89c2e640 1 --2- 172.21.15.19:0/3297235234 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c8410c2f0 0x7f9c8419cf80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00eb10 tx=0x7f9c7c00ef10 comp rx=0 tx=0).stop 2024-09-19T08:51:29.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.799+0000 7f9c89c2e640 1 -- 172.21.15.19:0/3297235234 shutdown_connections 2024-09-19T08:51:29.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.799+0000 7f9c89c2e640 1 --2- 172.21.15.19:0/3297235234 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9c6c0a3350 0x7f9c6c0a5810 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:29.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.799+0000 7f9c89c2e640 1 --2- 172.21.15.19:0/3297235234 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c841037a0 0x7f9c84198bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:29.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.799+0000 7f9c89c2e640 1 --2- 172.21.15.19:0/3297235234 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9c8410c2f0 0x7f9c8419cf80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:29.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.799+0000 7f9c89c2e640 1 --2- 172.21.15.19:0/3297235234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9c84102df0 0x7f9c841986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:29.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.799+0000 7f9c89c2e640 1 -- 172.21.15.19:0/3297235234 >> 172.21.15.19:0/3297235234 conn(0x7f9c840fc7d0 msgr2=0x7f9c840fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:29.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.800+0000 7f9c89c2e640 1 -- 172.21.15.19:0/3297235234 shutdown_connections 2024-09-19T08:51:29.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:29.800+0000 7f9c89c2e640 1 -- 172.21.15.19:0/3297235234 wait complete. 2024-09-19T08:51:29.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:29 smithi155 ceph-mon[34921]: pgmap v315: 97 pgs: 1 activating, 96 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 8 op/s; 98 B/s, 1 objects/s recovering 2024-09-19T08:51:29.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:29 smithi203 ceph-mon[35450]: pgmap v315: 97 pgs: 1 activating, 96 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 8 op/s; 98 B/s, 1 objects/s recovering 2024-09-19T08:51:30.522 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:51:30.784 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:30.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:30 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3297235234' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:51:30.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:30 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3297235234' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:51:30.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:30 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3297235234' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:51:31.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.285+0000 7f45cf78d640 1 -- 172.21.15.19:0/1185521213 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45c8101450 msgr2=0x7f45c8105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:31.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.285+0000 7f45cf78d640 1 --2- 172.21.15.19:0/1185521213 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45c8101450 0x7f45c8105920 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f45b8009900 tx=0x7f45b802a470 comp rx=0 tx=0).stop 2024-09-19T08:51:31.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.285+0000 7f45cf78d640 1 -- 172.21.15.19:0/1185521213 shutdown_connections 2024-09-19T08:51:31.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.285+0000 7f45cf78d640 1 --2- 172.21.15.19:0/1185521213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f45c8105f40 0x7f45c81063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:31.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.285+0000 7f45cf78d640 1 --2- 172.21.15.19:0/1185521213 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45c8101450 0x7f45c8105920 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:31.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.285+0000 7f45cf78d640 1 --2- 172.21.15.19:0/1185521213 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45c8100b30 0x7f45c8100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:31.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.285+0000 7f45cf78d640 1 -- 172.21.15.19:0/1185521213 >> 172.21.15.19:0/1185521213 conn(0x7f45c80fc7a0 msgr2=0x7f45c80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:31.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.285+0000 7f45cf78d640 1 -- 172.21.15.19:0/1185521213 shutdown_connections 2024-09-19T08:51:31.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.285+0000 7f45cf78d640 1 -- 172.21.15.19:0/1185521213 wait complete. 2024-09-19T08:51:31.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.286+0000 7f45cf78d640 1 Processor -- start 2024-09-19T08:51:31.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.286+0000 7f45cf78d640 1 -- start start 2024-09-19T08:51:31.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.286+0000 7f45cf78d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45c8100b30 0x7f45c81a4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:31.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.286+0000 7f45cf78d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45c8101450 0x7f45c81a4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:31.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.286+0000 7f45cf78d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f45c8105f40 0x7f45c819e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:31.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.286+0000 7f45cf78d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f45c81185c0 con 0x7f45c8101450 2024-09-19T08:51:31.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.286+0000 7f45cf78d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f45c8118440 con 0x7f45c8100b30 2024-09-19T08:51:31.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.286+0000 7f45cf78d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f45c8118740 con 0x7f45c8105f40 2024-09-19T08:51:31.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.286+0000 7f45ccd28640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45c8101450 0x7f45c81a4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:31.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.287+0000 7f45ccd28640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45c8101450 0x7f45c81a4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54714/0 (socket says 172.21.15.19:54714) 2024-09-19T08:51:31.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.287+0000 7f45ccd28640 1 -- 172.21.15.19:0/1683265934 learned_addr learned my addr 172.21.15.19:0/1683265934 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:31.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.287+0000 7f45cd529640 1 --2- 172.21.15.19:0/1683265934 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45c8100b30 0x7f45c81a4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:31.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.287+0000 7f45cdd2a640 1 --2- 172.21.15.19:0/1683265934 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f45c8105f40 0x7f45c819e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:31.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.287+0000 7f45ccd28640 1 -- 172.21.15.19:0/1683265934 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f45c8105f40 msgr2=0x7f45c819e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:31.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.287+0000 7f45ccd28640 1 --2- 172.21.15.19:0/1683265934 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f45c8105f40 0x7f45c819e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:31.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.287+0000 7f45ccd28640 1 -- 172.21.15.19:0/1683265934 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45c8100b30 msgr2=0x7f45c81a4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:31.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.287+0000 7f45ccd28640 1 --2- 172.21.15.19:0/1683265934 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45c8100b30 0x7f45c81a4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:31.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.287+0000 7f45ccd28640 1 -- 172.21.15.19:0/1683265934 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c819f020 con 0x7f45c8101450 2024-09-19T08:51:31.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.287+0000 7f45ccd28640 1 --2- 172.21.15.19:0/1683265934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45c8101450 0x7f45c81a4c70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f45b8006010 tx=0x7f45b80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:31.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.287+0000 7f45be7fc640 1 -- 172.21.15.19:0/1683265934 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b803f030 con 0x7f45c8101450 2024-09-19T08:51:31.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.287+0000 7f45be7fc640 1 -- 172.21.15.19:0/1683265934 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45b8003ce0 con 0x7f45c8101450 2024-09-19T08:51:31.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.287+0000 7f45cf78d640 1 -- 172.21.15.19:0/1683265934 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45c819f2b0 con 0x7f45c8101450 2024-09-19T08:51:31.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.287+0000 7f45be7fc640 1 -- 172.21.15.19:0/1683265934 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b8035070 con 0x7f45c8101450 2024-09-19T08:51:31.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.287+0000 7f45cf78d640 1 -- 172.21.15.19:0/1683265934 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45c81ab600 con 0x7f45c8101450 2024-09-19T08:51:31.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.288+0000 7f45cf78d640 1 -- 172.21.15.19:0/1683265934 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45c8105920 con 0x7f45c8101450 2024-09-19T08:51:31.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.290+0000 7f45be7fc640 1 -- 172.21.15.19:0/1683265934 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f45b8042030 con 0x7f45c8101450 2024-09-19T08:51:31.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.290+0000 7f45be7fc640 1 --2- 172.21.15.19:0/1683265934 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f45b40a32d0 0x7f45b40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:31.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.290+0000 7f45cd529640 1 --2- 172.21.15.19:0/1683265934 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f45b40a32d0 0x7f45b40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:31.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.290+0000 7f45be7fc640 1 -- 172.21.15.19:0/1683265934 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f45b80f0270 con 0x7f45c8101450 2024-09-19T08:51:31.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.291+0000 7f45cd529640 1 --2- 172.21.15.19:0/1683265934 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f45b40a32d0 0x7f45b40a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f45c4005fd0 tx=0x7f45c4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:31.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.293+0000 7f45be7fc640 1 -- 172.21.15.19:0/1683265934 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f45b80bcea0 con 0x7f45c8101450 2024-09-19T08:51:31.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.506+0000 7f45cf78d640 1 -- 172.21.15.19:0/1683265934 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45c81ab830 con 0x7f45c8101450 2024-09-19T08:51:31.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.507+0000 7f45be7fc640 1 -- 172.21.15.19:0/1683265934 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11983 (secure 0 0 0) 0x7f45b80bc7a0 con 0x7f45c8101450 2024-09-19T08:51:31.506 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:51:31.506 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"btime":"2024-09-19T08:50:27:938748+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2452068876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2452068876},{"type":"v1","addr":"172.21.15.19:6839","nonce":2452068876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T08:50:27.938727+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/2480841559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2480841559},{"type":"v1","addr":"172.21.15.155:6835","nonce":2480841559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24469,24490,24464,24463]},"id":1}]} 2024-09-19T08:51:31.506 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 27 2024-09-19T08:51:31.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.509+0000 7f45cf78d640 1 -- 172.21.15.19:0/1683265934 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f45b40a32d0 msgr2=0x7f45b40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:31.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.509+0000 7f45cf78d640 1 --2- 172.21.15.19:0/1683265934 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f45b40a32d0 0x7f45b40a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f45c4005fd0 tx=0x7f45c4005850 comp rx=0 tx=0).stop 2024-09-19T08:51:31.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.509+0000 7f45cf78d640 1 -- 172.21.15.19:0/1683265934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45c8101450 msgr2=0x7f45c81a4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:31.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.509+0000 7f45cf78d640 1 --2- 172.21.15.19:0/1683265934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45c8101450 0x7f45c81a4c70 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f45b8006010 tx=0x7f45b80042f0 comp rx=0 tx=0).stop 2024-09-19T08:51:31.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.509+0000 7f45cf78d640 1 -- 172.21.15.19:0/1683265934 shutdown_connections 2024-09-19T08:51:31.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.509+0000 7f45cf78d640 1 --2- 172.21.15.19:0/1683265934 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f45b40a32d0 0x7f45b40a5790 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:31.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.509+0000 7f45cf78d640 1 --2- 172.21.15.19:0/1683265934 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f45c8105f40 0x7f45c819e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:31.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.509+0000 7f45cf78d640 1 --2- 172.21.15.19:0/1683265934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45c8101450 0x7f45c81a4c70 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:31.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.509+0000 7f45cf78d640 1 --2- 172.21.15.19:0/1683265934 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45c8100b30 0x7f45c81a4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:31.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.509+0000 7f45cf78d640 1 -- 172.21.15.19:0/1683265934 >> 172.21.15.19:0/1683265934 conn(0x7f45c80fc7a0 msgr2=0x7f45c81038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:31.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.509+0000 7f45cf78d640 1 -- 172.21.15.19:0/1683265934 shutdown_connections 2024-09-19T08:51:31.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:31.509+0000 7f45cf78d640 1 -- 172.21.15.19:0/1683265934 wait complete. 2024-09-19T08:51:31.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:31 smithi019 ceph-mon[30976]: pgmap v316: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s; 98 B/s, 1 objects/s recovering 2024-09-19T08:51:31.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:31 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1683265934' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:51:31.843 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:31 smithi155 ceph-mon[34921]: pgmap v316: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s; 98 B/s, 1 objects/s recovering 2024-09-19T08:51:31.843 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:31 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1683265934' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:51:31.883 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:31 smithi203 ceph-mon[35450]: pgmap v316: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s; 98 B/s, 1 objects/s recovering 2024-09-19T08:51:31.883 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:31 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1683265934' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:51:32.210 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T08:50:16.477197+0000', 'modified': '2024-09-19T08:50:27.938727+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24497, 'mds_1': 24490, 'mds_2': 24469, 'mds_3': 24464, 'mds_4': 24463}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14619': {'gid': 14619, 'name': 'a', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.19:6841/1973648402', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6840', 'nonce': 1973648402}, {'type': 'v1', 'addr': '172.21.15.19:6841', 'nonce': 1973648402}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24418': {'gid': 24418, 'name': 'l', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.203:6833/471920691', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6832', 'nonce': 471920691}, {'type': 'v1', 'addr': '172.21.15.203:6833', 'nonce': 471920691}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24419': {'gid': 24419, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.155:6833/3575511501', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6832', 'nonce': 3575511501}, {'type': 'v1', 'addr': '172.21.15.155:6833', 'nonce': 3575511501}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24431': {'gid': 24431, 'name': 'j', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.19:6835/805488508', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6834', 'nonce': 805488508}, {'type': 'v1', 'addr': '172.21.15.19:6835', 'nonce': 805488508}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24449': {'gid': 24449, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.155:6835/2480841559', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 2480841559}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 2480841559}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24463': {'gid': 24463, 'name': 'f', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.203:6835/2702758353', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6834', 'nonce': 2702758353}, {'type': 'v1', 'addr': '172.21.15.203:6835', 'nonce': 2702758353}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24464': {'gid': 24464, 'name': 'h', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.155:6837/3381010945', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6836', 'nonce': 3381010945}, {'type': 'v1', 'addr': '172.21.15.155:6837', 'nonce': 3381010945}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24469': {'gid': 24469, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.203:6837/3684671619', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6836', 'nonce': 3684671619}, {'type': 'v1', 'addr': '172.21.15.203:6837', 'nonce': 3684671619}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24490': {'gid': 24490, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.203:6839/2547507299', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6838', 'nonce': 2547507299}, {'type': 'v1', 'addr': '172.21.15.203:6839', 'nonce': 2547507299}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24497': {'gid': 24497, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.155:6839/1224030981', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6838', 'nonce': 1224030981}, {'type': 'v1', 'addr': '172.21.15.155:6839', 'nonce': 1224030981}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24497, 'qdb_cluster': [24497, 24469, 24490, 24464, 24463]} 2024-09-19T08:51:32.210 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-19T08:51:32.210 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.f status 2024-09-19T08:51:32.470 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:33.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.038+0000 7f75e118c640 1 -- 172.21.15.19:0/2586316528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75dc101de0 msgr2=0x7f75dc1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:33.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.038+0000 7f75e118c640 1 --2- 172.21.15.19:0/2586316528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75dc101de0 0x7f75dc1021c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f75cc009900 tx=0x7f75cc02a410 comp rx=0 tx=0).stop 2024-09-19T08:51:33.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.038+0000 7f75e118c640 1 -- 172.21.15.19:0/2586316528 shutdown_connections 2024-09-19T08:51:33.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.038+0000 7f75e118c640 1 --2- 172.21.15.19:0/2586316528 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75dc106f10 0x7f75dc10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:33.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.038+0000 7f75e118c640 1 --2- 172.21.15.19:0/2586316528 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75dc102790 0x7f75dc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:33.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.038+0000 7f75e118c640 1 --2- 172.21.15.19:0/2586316528 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75dc101de0 0x7f75dc1021c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:33.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.038+0000 7f75e118c640 1 -- 172.21.15.19:0/2586316528 >> 172.21.15.19:0/2586316528 conn(0x7f75dc0fd8c0 msgr2=0x7f75dc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:33.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.038+0000 7f75e118c640 1 -- 172.21.15.19:0/2586316528 shutdown_connections 2024-09-19T08:51:33.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.038+0000 7f75e118c640 1 -- 172.21.15.19:0/2586316528 wait complete. 2024-09-19T08:51:33.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.038+0000 7f75e118c640 1 Processor -- start 2024-09-19T08:51:33.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.039+0000 7f75e118c640 1 -- start start 2024-09-19T08:51:33.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.039+0000 7f75e118c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75dc101de0 0x7f75dc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:33.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.039+0000 7f75e118c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75dc102790 0x7f75dc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:33.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.039+0000 7f75e118c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75dc106f10 0x7f75dc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:33.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.039+0000 7f75e118c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f75dc111f70 con 0x7f75dc101de0 2024-09-19T08:51:33.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.039+0000 7f75e118c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f75dc111df0 con 0x7f75dc102790 2024-09-19T08:51:33.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.039+0000 7f75e118c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f75dc1120f0 con 0x7f75dc106f10 2024-09-19T08:51:33.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.039+0000 7f75dad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75dc101de0 0x7f75dc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:33.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.039+0000 7f75dad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75dc101de0 0x7f75dc0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54724/0 (socket says 172.21.15.19:54724) 2024-09-19T08:51:33.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.039+0000 7f75dad9d640 1 -- 172.21.15.19:0/2466476067 learned_addr learned my addr 172.21.15.19:0/2466476067 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:33.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.039+0000 7f75da59c640 1 --2- 172.21.15.19:0/2466476067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75dc102790 0x7f75dc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:33.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.039+0000 7f75db59e640 1 --2- 172.21.15.19:0/2466476067 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75dc106f10 0x7f75dc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:33.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.039+0000 7f75dad9d640 1 -- 172.21.15.19:0/2466476067 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75dc106f10 msgr2=0x7f75dc074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:33.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.039+0000 7f75dad9d640 1 --2- 172.21.15.19:0/2466476067 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75dc106f10 0x7f75dc074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:33.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.039+0000 7f75dad9d640 1 -- 172.21.15.19:0/2466476067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75dc102790 msgr2=0x7f75dc074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:33.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.039+0000 7f75dad9d640 1 --2- 172.21.15.19:0/2466476067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75dc102790 0x7f75dc074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:33.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.039+0000 7f75dad9d640 1 -- 172.21.15.19:0/2466476067 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75dc1a6930 con 0x7f75dc101de0 2024-09-19T08:51:33.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.039+0000 7f75db59e640 1 --2- 172.21.15.19:0/2466476067 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75dc106f10 0x7f75dc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:33.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.039+0000 7f75da59c640 1 --2- 172.21.15.19:0/2466476067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75dc102790 0x7f75dc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:51:33.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.040+0000 7f75dad9d640 1 --2- 172.21.15.19:0/2466476067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75dc101de0 0x7f75dc0744f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f75cc006010 tx=0x7f75cc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:33.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.040+0000 7f75c3fff640 1 -- 172.21.15.19:0/2466476067 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75cc03f030 con 0x7f75dc101de0 2024-09-19T08:51:33.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.040+0000 7f75c3fff640 1 -- 172.21.15.19:0/2466476067 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75cc003ce0 con 0x7f75dc101de0 2024-09-19T08:51:33.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.040+0000 7f75e118c640 1 -- 172.21.15.19:0/2466476067 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75dc1a6bc0 con 0x7f75dc101de0 2024-09-19T08:51:33.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.040+0000 7f75c3fff640 1 -- 172.21.15.19:0/2466476067 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75cc035070 con 0x7f75dc101de0 2024-09-19T08:51:33.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.040+0000 7f75e118c640 1 -- 172.21.15.19:0/2466476067 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75dc1a70a0 con 0x7f75dc101de0 2024-09-19T08:51:33.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.042+0000 7f75c3fff640 1 -- 172.21.15.19:0/2466476067 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f75cc042030 con 0x7f75dc101de0 2024-09-19T08:51:33.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.042+0000 7f75e3565740 1 Processor -- start 2024-09-19T08:51:33.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.042+0000 7f75e3565740 1 -- start start 2024-09-19T08:51:33.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.043+0000 7f75e3565740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576e63ca9d0 0x5576e63cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:33.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.043+0000 7f75e3565740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576e63cb2f0 0x5576e63d5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:33.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.043+0000 7f75e3565740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576e63d5bb0 0x5576e63d7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:33.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.043+0000 7f75e3565740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5576e6331090 con 0x5576e63ca9d0 2024-09-19T08:51:33.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.043+0000 7f75e3565740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5576e62d8a70 con 0x5576e63d5bb0 2024-09-19T08:51:33.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.043+0000 7f75e3565740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5576e632d050 con 0x5576e63cb2f0 2024-09-19T08:51:33.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.043+0000 7f75db59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576e63ca9d0 0x5576e63cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:33.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.043+0000 7f75db59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576e63ca9d0 0x5576e63cadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54728/0 (socket says 172.21.15.19:54728) 2024-09-19T08:51:33.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.043+0000 7f75db59e640 1 -- 172.21.15.19:0/3744478248 learned_addr learned my addr 172.21.15.19:0/3744478248 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:33.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.043+0000 7f75dad9d640 1 --2- 172.21.15.19:0/3744478248 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576e63cb2f0 0x5576e63d5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:33.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.043+0000 7f75da59c640 1 --2- 172.21.15.19:0/3744478248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576e63d5bb0 0x5576e63d7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:33.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.043+0000 7f75c3fff640 1 --2- 172.21.15.19:0/2466476067 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f75c40a32d0 0x7f75c40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:33.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.043+0000 7f75db59e640 1 -- 172.21.15.19:0/3744478248 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576e63cb2f0 msgr2=0x5576e63d5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:33.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.043+0000 7f75db59e640 1 --2- 172.21.15.19:0/3744478248 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576e63cb2f0 0x5576e63d5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:33.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.043+0000 7f75db59e640 1 -- 172.21.15.19:0/3744478248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576e63d5bb0 msgr2=0x5576e63d7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:33.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.043+0000 7f75db59e640 1 --2- 172.21.15.19:0/3744478248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576e63d5bb0 0x5576e63d7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:33.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.043+0000 7f75db59e640 1 -- 172.21.15.19:0/3744478248 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576e62e5130 con 0x5576e63ca9d0 2024-09-19T08:51:33.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.043+0000 7f75dad9d640 1 --2- 172.21.15.19:0/3744478248 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576e63cb2f0 0x5576e63d5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:33.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.043+0000 7f75db59e640 1 --2- 172.21.15.19:0/2466476067 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f75c40a32d0 0x7f75c40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:33.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.043+0000 7f75c3fff640 1 -- 172.21.15.19:0/2466476067 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f75cc0effd0 con 0x7f75dc101de0 2024-09-19T08:51:33.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.043+0000 7f75db59e640 1 --2- 172.21.15.19:0/3744478248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576e63ca9d0 0x5576e63cadb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f75d400f4b0 tx=0x7f75d400f970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d041196d82d7c842 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:33.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.044+0000 7f75c17fa640 1 -- 172.21.15.19:0/3744478248 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d401c400 con 0x5576e63ca9d0 2024-09-19T08:51:33.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.044+0000 7f75c17fa640 1 -- 172.21.15.19:0/3744478248 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75d401ca80 con 0x5576e63ca9d0 2024-09-19T08:51:33.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.044+0000 7f75c17fa640 1 -- 172.21.15.19:0/3744478248 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75d401b800 con 0x5576e63ca9d0 2024-09-19T08:51:33.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.044+0000 7f75e3565740 1 -- 172.21.15.19:0/3744478248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576e63ca9d0 msgr2=0x5576e63cadb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:33.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.044+0000 7f75db59e640 1 --2- 172.21.15.19:0/2466476067 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f75c40a32d0 0x7f75c40a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f75d4020000 tx=0x7f75d401d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:33.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.044+0000 7f75e3565740 1 --2- 172.21.15.19:0/3744478248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576e63ca9d0 0x5576e63cadb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f75d400f4b0 tx=0x7f75d400f970 comp rx=0 tx=0).stop 2024-09-19T08:51:33.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.044+0000 7f75e3565740 1 -- 172.21.15.19:0/3744478248 shutdown_connections 2024-09-19T08:51:33.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.044+0000 7f75e3565740 1 --2- 172.21.15.19:0/3744478248 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576e63cb2f0 0x5576e63d5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:33.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.044+0000 7f75e3565740 1 --2- 172.21.15.19:0/3744478248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576e63d5bb0 0x5576e63d7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:33.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.044+0000 7f75e3565740 1 --2- 172.21.15.19:0/3744478248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576e63ca9d0 0x5576e63cadb0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:33.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.044+0000 7f75e3565740 1 -- 172.21.15.19:0/3744478248 >> 172.21.15.19:0/3744478248 conn(0x5576e63c6f60 msgr2=0x5576e63c7340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:33.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.044+0000 7f75e3565740 1 -- 172.21.15.19:0/3744478248 shutdown_connections 2024-09-19T08:51:33.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.044+0000 7f75e3565740 1 -- 172.21.15.19:0/3744478248 wait complete. 2024-09-19T08:51:33.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.045+0000 7f75e3565740 1 -- start start 2024-09-19T08:51:33.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.045+0000 7f75e3565740 1 Processor -- start 2024-09-19T08:51:33.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.045+0000 7f75e3565740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576e63ca9d0 0x5576e63d53d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:33.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.045+0000 7f75e3565740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576e63cb2f0 0x5576e63d2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:33.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.045+0000 7f75e3565740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576e63d5bb0 0x5576e63d2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:33.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.045+0000 7f75e3565740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5576e63d8780 con 0x5576e63ca9d0 2024-09-19T08:51:33.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.045+0000 7f75e3565740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5576e62ebf20 con 0x5576e63cb2f0 2024-09-19T08:51:33.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.045+0000 7f75e3565740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5576e63d8900 con 0x5576e63d5bb0 2024-09-19T08:51:33.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.045+0000 7f75e3565740 10 client.0 _ll_register_callbacks cb 0x5576e62b5030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:33.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.045+0000 7f75dad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576e63ca9d0 0x5576e63d53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:33.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.045+0000 7f75dad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576e63ca9d0 0x5576e63d53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54742/0 (socket says 172.21.15.19:54742) 2024-09-19T08:51:33.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.045+0000 7f75dad9d640 1 -- 172.21.15.19:0/1595787109 learned_addr learned my addr 172.21.15.19:0/1595787109 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:33.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.045+0000 7f75da59c640 1 --2- 172.21.15.19:0/1595787109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576e63cb2f0 0x5576e63d2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:33.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.045+0000 7f75dad9d640 1 -- 172.21.15.19:0/1595787109 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576e63d5bb0 msgr2=0x5576e63d2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:33.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.045+0000 7f75dad9d640 1 --2- 172.21.15.19:0/1595787109 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576e63d5bb0 0x5576e63d2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:33.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.045+0000 7f75dad9d640 1 -- 172.21.15.19:0/1595787109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576e63cb2f0 msgr2=0x5576e63d2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:33.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.045+0000 7f75dad9d640 1 --2- 172.21.15.19:0/1595787109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576e63cb2f0 0x5576e63d2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:33.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.046+0000 7f75dad9d640 1 -- 172.21.15.19:0/1595787109 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576e60a22b0 con 0x5576e63ca9d0 2024-09-19T08:51:33.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.046+0000 7f75dad9d640 1 --2- 172.21.15.19:0/1595787109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576e63ca9d0 0x5576e63d53d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f75cc0bc300 tx=0x7f75cc0b89d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91eed36de53cc908 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:33.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.046+0000 7f75beff5640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:51:33.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.046+0000 7f75beff5640 1 -- 172.21.15.19:0/1595787109 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75cc0b8050 con 0x5576e63ca9d0 2024-09-19T08:51:33.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.046+0000 7f75beff5640 1 -- 172.21.15.19:0/1595787109 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f75cc0f2110 con 0x5576e63ca9d0 2024-09-19T08:51:33.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.046+0000 7f75e3565740 1 -- 172.21.15.19:0/1595787109 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75d401ca80 con 0x5576e63ca9d0 2024-09-19T08:51:33.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.046+0000 7f75beff5640 1 -- 172.21.15.19:0/1595787109 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f75cc049070 con 0x5576e63ca9d0 2024-09-19T08:51:33.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.046+0000 7f75e3565740 10 client.14979 fetch_fsmap learned FSMap version 27 2024-09-19T08:51:33.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.046+0000 7f75e3565740 1 -- 172.21.15.19:0/1595787109 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5576e63e4030 con 0x5576e63ca9d0 2024-09-19T08:51:33.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.046+0000 7f75beff5640 1 -- 172.21.15.19:0/1595787109 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75d401ca80 con 0x5576e63ca9d0 2024-09-19T08:51:33.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.046+0000 7f75beff5640 1 -- 172.21.15.19:0/1595787109 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f75cc0bc860 con 0x5576e63ca9d0 2024-09-19T08:51:33.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.046+0000 7f75e3565740 10 client.14979 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T08:51:33.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.047+0000 7f75e3565740 10 client.14979 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-19T08:51:33.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.047+0000 7f75e3565740 20 client.14979 populate_metadata read hostname 'smithi019' 2024-09-19T08:51:33.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.047+0000 7f75e3565740 1 --2- 172.21.15.19:0/1595787109 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5576e63e66d0 0x5576e63e7b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:33.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.047+0000 7f75e3565740 4 client.14979 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:51:33.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.047+0000 7f75e3565740 1 -- 172.21.15.19:0/1595787109 --> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576e633e600 con 0x5576e63e66d0 2024-09-19T08:51:33.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.047+0000 7f75da59c640 1 --2- 172.21.15.19:0/1595787109 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5576e63e66d0 0x5576e63e7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:33.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.047+0000 7f75da59c640 1 --2- 172.21.15.19:0/1595787109 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5576e63e66d0 0x5576e63e7b40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3e2c096e018ec6de server_cookie=1790c49d6475c7da in_seq=0 out_seq=0 2024-09-19T08:51:33.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.047+0000 7f75beff5640 10 client.14979 ms_handle_connect on v2:172.21.15.203:6834/2702758353 2024-09-19T08:51:33.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.048+0000 7f75beff5640 1 -- 172.21.15.19:0/1595787109 <== mds.4 v2:172.21.15.203:6834/2702758353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5576e633e600 con 0x5576e63e66d0 2024-09-19T08:51:33.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.048+0000 7f75beff5640 10 client.14979 handle_command_reply: tid=0 2024-09-19T08:51:33.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.048+0000 7f75e3565740 1 client.14979 shutdown 2024-09-19T08:51:33.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.048+0000 7f75e3565740 1 -- 172.21.15.19:0/1595787109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576e63ca9d0 msgr2=0x5576e63d53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:33.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.048+0000 7f75e3565740 1 --2- 172.21.15.19:0/1595787109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576e63ca9d0 0x5576e63d53d0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f75cc0bc300 tx=0x7f75cc0b89d0 comp rx=0 tx=0).stop 2024-09-19T08:51:33.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.048+0000 7f75e3565740 1 -- 172.21.15.19:0/1595787109 shutdown_connections 2024-09-19T08:51:33.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.048+0000 7f75e3565740 1 --2- 172.21.15.19:0/1595787109 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5576e63e66d0 0x5576e63e7b40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:33.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.048+0000 7f75e3565740 1 --2- 172.21.15.19:0/1595787109 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576e63d5bb0 0x5576e63d2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:33.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.048+0000 7f75e3565740 1 --2- 172.21.15.19:0/1595787109 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576e63cb2f0 0x5576e63d2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:33.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.048+0000 7f75e3565740 1 --2- 172.21.15.19:0/1595787109 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576e63ca9d0 0x5576e63d53d0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:33.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.048+0000 7f75beff5640 0 client.14979 ms_handle_reset on v2:172.21.15.203:6834/2702758353 2024-09-19T08:51:33.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.048+0000 7f75e3565740 1 -- 172.21.15.19:0/1595787109 >> 172.21.15.19:0/1595787109 conn(0x5576e63c6f60 msgr2=0x5576e63ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:33.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.048+0000 7f75e3565740 1 -- 172.21.15.19:0/1595787109 shutdown_connections 2024-09-19T08:51:33.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.048+0000 7f75e3565740 1 -- 172.21.15.19:0/1595787109 wait complete. 2024-09-19T08:51:33.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.048+0000 7f75e3565740 20 client.14979 trim_cache size 0 max 16384 2024-09-19T08:51:33.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.067+0000 7f75e3565740 1 Processor -- start 2024-09-19T08:51:33.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.067+0000 7f75e3565740 1 -- start start 2024-09-19T08:51:33.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.067+0000 7f75e3565740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576e63ca9d0 0x5576e63d1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:33.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.067+0000 7f75e3565740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576e63cb2f0 0x5576e63c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:33.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.067+0000 7f75e3565740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576e63d5bb0 0x5576e63d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:33.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.067+0000 7f75e3565740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5576e63e5e80 con 0x5576e63ca9d0 2024-09-19T08:51:33.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.067+0000 7f75e3565740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5576e63e6550 con 0x5576e63d5bb0 2024-09-19T08:51:33.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.067+0000 7f75e3565740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5576e63e6c20 con 0x5576e63cb2f0 2024-09-19T08:51:33.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.067+0000 7f75dad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576e63ca9d0 0x5576e63d1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:33.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.067+0000 7f75dad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576e63ca9d0 0x5576e63d1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54748/0 (socket says 172.21.15.19:54748) 2024-09-19T08:51:33.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.067+0000 7f75dad9d640 1 -- 172.21.15.19:0/1873892078 learned_addr learned my addr 172.21.15.19:0/1873892078 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:33.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.067+0000 7f75da59c640 1 --2- 172.21.15.19:0/1873892078 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576e63cb2f0 0x5576e63c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:33.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.067+0000 7f75db59e640 1 --2- 172.21.15.19:0/1873892078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576e63d5bb0 0x5576e63d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:33.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.067+0000 7f75dad9d640 1 -- 172.21.15.19:0/1873892078 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576e63cb2f0 msgr2=0x5576e63c67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:33.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.067+0000 7f75dad9d640 1 --2- 172.21.15.19:0/1873892078 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576e63cb2f0 0x5576e63c67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:33.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.067+0000 7f75dad9d640 1 -- 172.21.15.19:0/1873892078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576e63d5bb0 msgr2=0x5576e63d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:33.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.067+0000 7f75dad9d640 1 --2- 172.21.15.19:0/1873892078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576e63d5bb0 0x5576e63d0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:33.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.067+0000 7f75dad9d640 1 -- 172.21.15.19:0/1873892078 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576e63d3260 con 0x5576e63ca9d0 2024-09-19T08:51:33.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.067+0000 7f75db59e640 1 --2- 172.21.15.19:0/1873892078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576e63d5bb0 0x5576e63d0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:33.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.068+0000 7f75dad9d640 1 --2- 172.21.15.19:0/1873892078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576e63ca9d0 0x5576e63d1fe0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f75cc005ab0 tx=0x7f75cc003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2140e68cd2bd2f85 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:33.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.068+0000 7f75c0ff9640 1 -- 172.21.15.19:0/1873892078 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75cc0b8040 con 0x5576e63ca9d0 2024-09-19T08:51:33.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.068+0000 7f75c0ff9640 1 -- 172.21.15.19:0/1873892078 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75cc0dc040 con 0x5576e63ca9d0 2024-09-19T08:51:33.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.068+0000 7f75c0ff9640 1 -- 172.21.15.19:0/1873892078 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75cc0b8c70 con 0x5576e63ca9d0 2024-09-19T08:51:33.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.069+0000 7f75e3565740 1 -- 172.21.15.19:0/1873892078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576e63ca9d0 msgr2=0x5576e63d1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:33.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.069+0000 7f75e3565740 1 --2- 172.21.15.19:0/1873892078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576e63ca9d0 0x5576e63d1fe0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f75cc005ab0 tx=0x7f75cc003f90 comp rx=0 tx=0).stop 2024-09-19T08:51:33.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.069+0000 7f75e3565740 1 -- 172.21.15.19:0/1873892078 shutdown_connections 2024-09-19T08:51:33.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.069+0000 7f75e3565740 1 --2- 172.21.15.19:0/1873892078 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576e63cb2f0 0x5576e63c67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:33.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.069+0000 7f75e3565740 1 --2- 172.21.15.19:0/1873892078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576e63d5bb0 0x5576e63d0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:33.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.069+0000 7f75e3565740 1 --2- 172.21.15.19:0/1873892078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576e63ca9d0 0x5576e63d1fe0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:33.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.069+0000 7f75e3565740 1 -- 172.21.15.19:0/1873892078 >> 172.21.15.19:0/1873892078 conn(0x5576e63c6f60 msgr2=0x5576e63e5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:33.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.069+0000 7f75e3565740 1 -- 172.21.15.19:0/1873892078 shutdown_connections 2024-09-19T08:51:33.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.069+0000 7f75e3565740 1 -- 172.21.15.19:0/1873892078 wait complete. 2024-09-19T08:51:33.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.069+0000 7f75e3565740 1 -- start start 2024-09-19T08:51:33.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.069+0000 7f75e3565740 1 Processor -- start 2024-09-19T08:51:33.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.069+0000 7f75e3565740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576e63ca9d0 0x5576e63ced50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:33.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.069+0000 7f75e3565740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576e63cb2f0 0x5576e63cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:33.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.069+0000 7f75e3565740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576e63d5bb0 0x5576e63eee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:33.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.069+0000 7f75e3565740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5576e63e79c0 con 0x5576e63ca9d0 2024-09-19T08:51:33.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.069+0000 7f75e3565740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5576e63e72f0 con 0x5576e63d5bb0 2024-09-19T08:51:33.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.069+0000 7f75e3565740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5576e63e8090 con 0x5576e63cb2f0 2024-09-19T08:51:33.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.069+0000 7f75e3565740 10 client.0 _ll_register_callbacks cb 0x7f75cc005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:33.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.069+0000 7f75dad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576e63ca9d0 0x5576e63ced50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:33.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.069+0000 7f75dad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576e63ca9d0 0x5576e63ced50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54758/0 (socket says 172.21.15.19:54758) 2024-09-19T08:51:33.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.069+0000 7f75dad9d640 1 -- 172.21.15.19:0/1813978787 learned_addr learned my addr 172.21.15.19:0/1813978787 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:33.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.070+0000 7f75da59c640 1 --2- 172.21.15.19:0/1813978787 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576e63cb2f0 0x5576e63cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:33.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.070+0000 7f75db59e640 1 --2- 172.21.15.19:0/1813978787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576e63d5bb0 0x5576e63eee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:33.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.070+0000 7f75dad9d640 1 -- 172.21.15.19:0/1813978787 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576e63cb2f0 msgr2=0x5576e63cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:33.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.070+0000 7f75dad9d640 1 --2- 172.21.15.19:0/1813978787 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576e63cb2f0 0x5576e63cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:33.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.070+0000 7f75dad9d640 1 -- 172.21.15.19:0/1813978787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576e63d5bb0 msgr2=0x5576e63eee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:33.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.070+0000 7f75dad9d640 1 --2- 172.21.15.19:0/1813978787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576e63d5bb0 0x5576e63eee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:33.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.070+0000 7f75dad9d640 1 -- 172.21.15.19:0/1813978787 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576e63ef340 con 0x5576e63ca9d0 2024-09-19T08:51:33.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.070+0000 7f75dad9d640 1 --2- 172.21.15.19:0/1813978787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576e63ca9d0 0x5576e63ced50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f75cc0b8fd0 tx=0x7f75cc0b89d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67a197d9256ba245 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:33.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.070+0000 7f75beff5640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:51:33.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.070+0000 7f75beff5640 1 -- 172.21.15.19:0/1813978787 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75cc075070 con 0x5576e63ca9d0 2024-09-19T08:51:33.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.070+0000 7f75beff5640 1 -- 172.21.15.19:0/1813978787 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f75cc0c4fe0 con 0x5576e63ca9d0 2024-09-19T08:51:33.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.070+0000 7f75e3565740 1 -- 172.21.15.19:0/1813978787 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75cc0dc040 con 0x5576e63ca9d0 2024-09-19T08:51:33.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.070+0000 7f75beff5640 1 -- 172.21.15.19:0/1813978787 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f75cc0b8050 con 0x5576e63ca9d0 2024-09-19T08:51:33.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.070+0000 7f75e3565740 10 client.14985 fetch_fsmap learned FSMap version 27 2024-09-19T08:51:33.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.070+0000 7f75e3565740 1 -- 172.21.15.19:0/1813978787 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5576e63ef340 con 0x5576e63ca9d0 2024-09-19T08:51:33.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.071+0000 7f75beff5640 1 -- 172.21.15.19:0/1813978787 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75cc0dc040 con 0x5576e63ca9d0 2024-09-19T08:51:33.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.071+0000 7f75beff5640 1 -- 172.21.15.19:0/1813978787 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f75cc078020 con 0x5576e63ca9d0 2024-09-19T08:51:33.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.071+0000 7f75e3565740 10 client.14985 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T08:51:33.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.071+0000 7f75e3565740 10 client.14985 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-19T08:51:33.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.071+0000 7f75e3565740 20 client.14985 populate_metadata read hostname 'smithi019' 2024-09-19T08:51:33.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.071+0000 7f75e3565740 1 --2- 172.21.15.19:0/1813978787 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5576e6454a70 0x5576e6453780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:33.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.071+0000 7f75e3565740 4 client.14985 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T08:51:33.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.071+0000 7f75e3565740 1 -- 172.21.15.19:0/1813978787 --> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] -- command(tid 0: {"prefix": "status"}) -- 0x5576e6338b10 con 0x5576e6454a70 2024-09-19T08:51:33.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.071+0000 7f75da59c640 1 --2- 172.21.15.19:0/1813978787 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5576e6454a70 0x5576e6453780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:33.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.071+0000 7f75da59c640 1 --2- 172.21.15.19:0/1813978787 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5576e6454a70 0x5576e6453780 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=36215732b5430891 server_cookie=1adcd9e34756c378 in_seq=0 out_seq=0 2024-09-19T08:51:33.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.071+0000 7f75beff5640 10 client.14985 ms_handle_connect on v2:172.21.15.203:6834/2702758353 2024-09-19T08:51:33.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.072+0000 7f75beff5640 1 -- 172.21.15.19:0/1813978787 <== mds.4 v2:172.21.15.203:6834/2702758353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5576e6338b10 con 0x5576e6454a70 2024-09-19T08:51:33.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.072+0000 7f75beff5640 10 client.14985 handle_command_reply: tid=0 2024-09-19T08:51:33.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.072+0000 7f75e3565740 1 client.14985 shutdown 2024-09-19T08:51:33.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.072+0000 7f75e3565740 1 -- 172.21.15.19:0/1813978787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576e63ca9d0 msgr2=0x5576e63ced50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:33.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.072+0000 7f75e3565740 1 --2- 172.21.15.19:0/1813978787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576e63ca9d0 0x5576e63ced50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f75cc0b8fd0 tx=0x7f75cc0b89d0 comp rx=0 tx=0).stop 2024-09-19T08:51:33.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.072+0000 7f75e3565740 1 -- 172.21.15.19:0/1813978787 shutdown_connections 2024-09-19T08:51:33.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.072+0000 7f75e3565740 1 --2- 172.21.15.19:0/1813978787 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5576e6454a70 0x5576e6453780 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:33.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.072+0000 7f75e3565740 1 --2- 172.21.15.19:0/1813978787 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576e63cb2f0 0x5576e63cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:33.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.072+0000 7f75e3565740 1 --2- 172.21.15.19:0/1813978787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576e63d5bb0 0x5576e63eee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:33.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.072+0000 7f75e3565740 1 --2- 172.21.15.19:0/1813978787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576e63ca9d0 0x5576e63ced50 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:33.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.072+0000 7f75e3565740 1 -- 172.21.15.19:0/1813978787 >> 172.21.15.19:0/1813978787 conn(0x5576e63c6f60 msgr2=0x5576e63cc420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:33.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.072+0000 7f75beff5640 0 client.14985 ms_handle_reset on v2:172.21.15.203:6834/2702758353 2024-09-19T08:51:33.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.072+0000 7f75e3565740 1 -- 172.21.15.19:0/1813978787 shutdown_connections 2024-09-19T08:51:33.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.072+0000 7f75e3565740 1 -- 172.21.15.19:0/1813978787 wait complete. 2024-09-19T08:51:33.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.072+0000 7f75e3565740 20 client.14985 trim_cache size 0 max 16384 2024-09-19T08:51:33.084 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:51:33.084 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "f26c9d84-7662-11ef-bceb-c7b262605968", 2024-09-19T08:51:33.084 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 4, 2024-09-19T08:51:33.085 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 24463, 2024-09-19T08:51:33.085 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-19T08:51:33.085 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-19T08:51:33.085 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-19T08:51:33.085 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 66.141151755999999, 2024-09-19T08:51:33.085 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 27, 2024-09-19T08:51:33.085 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 82, 2024-09-19T08:51:33.085 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 80, 2024-09-19T08:51:33.085 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 104.221179269 2024-09-19T08:51:33.085 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:51:33.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.073+0000 7f75e118c640 1 -- 172.21.15.19:0/2466476067 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f75c40a32d0 msgr2=0x7f75c40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:33.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.073+0000 7f75e118c640 1 --2- 172.21.15.19:0/2466476067 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f75c40a32d0 0x7f75c40a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f75d4020000 tx=0x7f75d401d000 comp rx=0 tx=0).stop 2024-09-19T08:51:33.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.073+0000 7f75e118c640 1 -- 172.21.15.19:0/2466476067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75dc101de0 msgr2=0x7f75dc0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:33.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.073+0000 7f75e118c640 1 --2- 172.21.15.19:0/2466476067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75dc101de0 0x7f75dc0744f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f75cc006010 tx=0x7f75cc0042f0 comp rx=0 tx=0).stop 2024-09-19T08:51:33.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.073+0000 7f75e118c640 1 -- 172.21.15.19:0/2466476067 shutdown_connections 2024-09-19T08:51:33.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.073+0000 7f75e118c640 1 --2- 172.21.15.19:0/2466476067 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f75c40a32d0 0x7f75c40a5790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:33.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.073+0000 7f75e118c640 1 --2- 172.21.15.19:0/2466476067 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75dc106f10 0x7f75dc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:33.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.073+0000 7f75e118c640 1 --2- 172.21.15.19:0/2466476067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f75dc102790 0x7f75dc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:33.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.073+0000 7f75e118c640 1 --2- 172.21.15.19:0/2466476067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75dc101de0 0x7f75dc0744f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:33.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.073+0000 7f75e118c640 1 -- 172.21.15.19:0/2466476067 >> 172.21.15.19:0/2466476067 conn(0x7f75dc0fd8c0 msgr2=0x7f75dc0fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:33.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.073+0000 7f75e118c640 1 -- 172.21.15.19:0/2466476067 shutdown_connections 2024-09-19T08:51:33.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:33.073+0000 7f75e118c640 1 -- 172.21.15.19:0/2466476067 wait complete. 2024-09-19T08:51:33.823 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-19T08:51:33.849 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:33 smithi019 ceph-mon[30976]: pgmap v317: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s; 84 B/s, 1 objects/s recovering 2024-09-19T08:51:33.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:33 smithi155 ceph-mon[34921]: pgmap v317: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s; 84 B/s, 1 objects/s recovering 2024-09-19T08:51:33.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:33 smithi203 ceph-mon[35450]: pgmap v317: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s; 84 B/s, 1 objects/s recovering 2024-09-19T08:51:34.091 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:34.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.550+0000 7fc570587640 1 -- 172.21.15.19:0/2225306708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc56810c170 msgr2=0x7fc56810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:34.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.550+0000 7fc570587640 1 --2- 172.21.15.19:0/2225306708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc56810c170 0x7fc56810e610 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fc560009ca0 tx=0x7fc56002a950 comp rx=0 tx=0).stop 2024-09-19T08:51:34.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.550+0000 7fc570587640 1 -- 172.21.15.19:0/2225306708 shutdown_connections 2024-09-19T08:51:34.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.550+0000 7fc570587640 1 --2- 172.21.15.19:0/2225306708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc56810c170 0x7fc56810e610 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:34.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.550+0000 7fc570587640 1 --2- 172.21.15.19:0/2225306708 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc568103660 0x7fc56810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:34.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.550+0000 7fc570587640 1 --2- 172.21.15.19:0/2225306708 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc568102d40 0x7fc568103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:34.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.550+0000 7fc570587640 1 -- 172.21.15.19:0/2225306708 >> 172.21.15.19:0/2225306708 conn(0x7fc5680fc7a0 msgr2=0x7fc5680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:34.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.550+0000 7fc570587640 1 -- 172.21.15.19:0/2225306708 shutdown_connections 2024-09-19T08:51:34.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.550+0000 7fc570587640 1 -- 172.21.15.19:0/2225306708 wait complete. 2024-09-19T08:51:34.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.550+0000 7fc570587640 1 Processor -- start 2024-09-19T08:51:34.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.550+0000 7fc570587640 1 -- start start 2024-09-19T08:51:34.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.551+0000 7fc570587640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc568102d40 0x7fc5681a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:34.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.551+0000 7fc570587640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc568103660 0x7fc5681a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:34.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.551+0000 7fc570587640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc56810c170 0x7fc56819a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:34.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.551+0000 7fc570587640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc568112030 con 0x7fc568103660 2024-09-19T08:51:34.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.551+0000 7fc570587640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc568111eb0 con 0x7fc56810c170 2024-09-19T08:51:34.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.551+0000 7fc570587640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc5681121b0 con 0x7fc568102d40 2024-09-19T08:51:34.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.551+0000 7fc56db22640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc568103660 0x7fc5681a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:34.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.551+0000 7fc56db22640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc568103660 0x7fc5681a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54784/0 (socket says 172.21.15.19:54784) 2024-09-19T08:51:34.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.551+0000 7fc56db22640 1 -- 172.21.15.19:0/3848014689 learned_addr learned my addr 172.21.15.19:0/3848014689 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:34.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.551+0000 7fc56e323640 1 --2- 172.21.15.19:0/3848014689 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc568102d40 0x7fc5681a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:34.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.551+0000 7fc56db22640 1 -- 172.21.15.19:0/3848014689 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc568102d40 msgr2=0x7fc5681a0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:34.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.551+0000 7fc56db22640 1 --2- 172.21.15.19:0/3848014689 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc568102d40 0x7fc5681a0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:34.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.551+0000 7fc56db22640 1 -- 172.21.15.19:0/3848014689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc56810c170 msgr2=0x7fc56819a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:34.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.551+0000 7fc56db22640 1 --2- 172.21.15.19:0/3848014689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc56810c170 0x7fc56819a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:34.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.551+0000 7fc56db22640 1 -- 172.21.15.19:0/3848014689 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc56819ad50 con 0x7fc568103660 2024-09-19T08:51:34.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.551+0000 7fc56e323640 1 --2- 172.21.15.19:0/3848014689 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc568102d40 0x7fc5681a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:51:34.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.551+0000 7fc56db22640 1 --2- 172.21.15.19:0/3848014689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc568103660 0x7fc5681a09a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc55800b3f0 tx=0x7fc55800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:34.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.551+0000 7fc55f7fe640 1 -- 172.21.15.19:0/3848014689 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc558015020 con 0x7fc568103660 2024-09-19T08:51:34.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.551+0000 7fc55f7fe640 1 -- 172.21.15.19:0/3848014689 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc558011d10 con 0x7fc568103660 2024-09-19T08:51:34.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.551+0000 7fc570587640 1 -- 172.21.15.19:0/3848014689 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc56819b040 con 0x7fc568103660 2024-09-19T08:51:34.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.551+0000 7fc55f7fe640 1 -- 172.21.15.19:0/3848014689 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55800f2e0 con 0x7fc568103660 2024-09-19T08:51:34.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.551+0000 7fc570587640 1 -- 172.21.15.19:0/3848014689 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5681a7330 con 0x7fc568103660 2024-09-19T08:51:34.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.554+0000 7fc55f7fe640 1 -- 172.21.15.19:0/3848014689 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc558018020 con 0x7fc568103660 2024-09-19T08:51:34.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.554+0000 7fc572960740 1 Processor -- start 2024-09-19T08:51:34.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.554+0000 7fc572960740 1 -- start start 2024-09-19T08:51:34.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.554+0000 7fc572960740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fb726f19d0 0x55fb726f1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:34.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.554+0000 7fc572960740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb726f22f0 0x55fb726fc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:34.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.554+0000 7fc572960740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb726fcbb0 0x55fb726fefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:34.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.554+0000 7fc572960740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55fb72658090 con 0x55fb726f22f0 2024-09-19T08:51:34.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.554+0000 7fc572960740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55fb725ffa70 con 0x55fb726f19d0 2024-09-19T08:51:34.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.554+0000 7fc572960740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55fb72654050 con 0x55fb726fcbb0 2024-09-19T08:51:34.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.554+0000 7fc56e323640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb726f22f0 0x55fb726fc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:34.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.555+0000 7fc56e323640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb726f22f0 0x55fb726fc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54800/0 (socket says 172.21.15.19:54800) 2024-09-19T08:51:34.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.555+0000 7fc56e323640 1 -- 172.21.15.19:0/2614345795 learned_addr learned my addr 172.21.15.19:0/2614345795 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:34.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.555+0000 7fc55f7fe640 1 --2- 172.21.15.19:0/3848014689 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc5540a32d0 0x7fc5540a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:34.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.555+0000 7fc56eb24640 1 --2- 172.21.15.19:0/2614345795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fb726f19d0 0x55fb726f1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:34.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.555+0000 7fc56db22640 1 --2- 172.21.15.19:0/2614345795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb726fcbb0 0x55fb726fefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:34.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.555+0000 7fc56eb24640 1 --2- 172.21.15.19:0/3848014689 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc5540a32d0 0x7fc5540a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:34.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.555+0000 7fc56e323640 1 -- 172.21.15.19:0/2614345795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb726fcbb0 msgr2=0x55fb726fefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:34.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.555+0000 7fc55f7fe640 1 -- 172.21.15.19:0/3848014689 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc5580cf290 con 0x7fc568103660 2024-09-19T08:51:34.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.555+0000 7fc56e323640 1 --2- 172.21.15.19:0/2614345795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb726fcbb0 0x55fb726fefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:34.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.555+0000 7fc56e323640 1 -- 172.21.15.19:0/2614345795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fb726f19d0 msgr2=0x55fb726f1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:34.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.555+0000 7fc56e323640 1 --2- 172.21.15.19:0/2614345795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fb726f19d0 0x55fb726f1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:34.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.555+0000 7fc56e323640 1 -- 172.21.15.19:0/2614345795 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb7260c130 con 0x55fb726f22f0 2024-09-19T08:51:34.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.555+0000 7fc56eb24640 1 --2- 172.21.15.19:0/2614345795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fb726f19d0 0x55fb726f1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:34.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.555+0000 7fc56db22640 1 --2- 172.21.15.19:0/2614345795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb726fcbb0 0x55fb726fefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:51:34.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.555+0000 7fc56e323640 1 --2- 172.21.15.19:0/2614345795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb726f22f0 0x55fb726fc670 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc56400aa10 tx=0x7fc56400aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2feaa332eb59077 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:34.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.555+0000 7fc56eb24640 1 --2- 172.21.15.19:0/3848014689 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc5540a32d0 0x7fc5540a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc560009a60 tx=0x7fc5600095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:34.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.555+0000 7fc55cff9640 1 -- 172.21.15.19:0/2614345795 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc564015070 con 0x55fb726f22f0 2024-09-19T08:51:34.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.555+0000 7fc55cff9640 1 -- 172.21.15.19:0/2614345795 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc56400cc60 con 0x55fb726f22f0 2024-09-19T08:51:34.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.555+0000 7fc55cff9640 1 -- 172.21.15.19:0/2614345795 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc564018700 con 0x55fb726f22f0 2024-09-19T08:51:34.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.556+0000 7fc572960740 1 -- 172.21.15.19:0/2614345795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb726f22f0 msgr2=0x55fb726fc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:34.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.556+0000 7fc572960740 1 --2- 172.21.15.19:0/2614345795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb726f22f0 0x55fb726fc670 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc56400aa10 tx=0x7fc56400aed0 comp rx=0 tx=0).stop 2024-09-19T08:51:34.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.556+0000 7fc572960740 1 -- 172.21.15.19:0/2614345795 shutdown_connections 2024-09-19T08:51:34.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.556+0000 7fc572960740 1 --2- 172.21.15.19:0/2614345795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb726fcbb0 0x55fb726fefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:34.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.556+0000 7fc572960740 1 --2- 172.21.15.19:0/2614345795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb726f22f0 0x55fb726fc670 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:34.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.556+0000 7fc572960740 1 --2- 172.21.15.19:0/2614345795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fb726f19d0 0x55fb726f1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:34.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.556+0000 7fc572960740 1 -- 172.21.15.19:0/2614345795 >> 172.21.15.19:0/2614345795 conn(0x55fb726edf60 msgr2=0x55fb726ee340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:34.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.556+0000 7fc572960740 1 -- 172.21.15.19:0/2614345795 shutdown_connections 2024-09-19T08:51:34.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.556+0000 7fc572960740 1 -- 172.21.15.19:0/2614345795 wait complete. 2024-09-19T08:51:34.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.556+0000 7fc572960740 1 -- start start 2024-09-19T08:51:34.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.557+0000 7fc572960740 1 Processor -- start 2024-09-19T08:51:34.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.557+0000 7fc572960740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fb726f19d0 0x55fb726fc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:34.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.557+0000 7fc572960740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb726f22f0 0x55fb726f9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:34.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.557+0000 7fc572960740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb726fcbb0 0x55fb726f9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:34.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.557+0000 7fc572960740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55fb726ff780 con 0x55fb726fcbb0 2024-09-19T08:51:34.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.557+0000 7fc572960740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55fb72612f20 con 0x55fb726f19d0 2024-09-19T08:51:34.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.557+0000 7fc572960740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55fb726ff900 con 0x55fb726f22f0 2024-09-19T08:51:34.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.557+0000 7fc572960740 10 client.0 _ll_register_callbacks cb 0x55fb725dc030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:34.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.557+0000 7fc56eb24640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb726fcbb0 0x55fb726f9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:34.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.557+0000 7fc56eb24640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb726fcbb0 0x55fb726f9c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54802/0 (socket says 172.21.15.19:54802) 2024-09-19T08:51:34.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.557+0000 7fc56eb24640 1 -- 172.21.15.19:0/534711933 learned_addr learned my addr 172.21.15.19:0/534711933 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:34.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.557+0000 7fc56e323640 1 --2- 172.21.15.19:0/534711933 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fb726f19d0 0x55fb726fc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:34.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.557+0000 7fc56db22640 1 --2- 172.21.15.19:0/534711933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb726f22f0 0x55fb726f9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:34.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.557+0000 7fc56eb24640 1 -- 172.21.15.19:0/534711933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb726f22f0 msgr2=0x55fb726f9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:34.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.557+0000 7fc56eb24640 1 --2- 172.21.15.19:0/534711933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb726f22f0 0x55fb726f9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:34.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.557+0000 7fc56eb24640 1 -- 172.21.15.19:0/534711933 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fb726f19d0 msgr2=0x55fb726fc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:34.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.557+0000 7fc56eb24640 1 --2- 172.21.15.19:0/534711933 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fb726f19d0 0x55fb726fc3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:34.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.557+0000 7fc56eb24640 1 -- 172.21.15.19:0/534711933 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb723c92b0 con 0x55fb726fcbb0 2024-09-19T08:51:34.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.558+0000 7fc56eb24640 1 --2- 172.21.15.19:0/534711933 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb726fcbb0 0x55fb726f9c40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc560009870 tx=0x7fc56002fe10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78f820baf07aeb62 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:34.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.558+0000 7fc551ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:51:34.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.558+0000 7fc551ffb640 1 -- 172.21.15.19:0/534711933 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc560041070 con 0x55fb726fcbb0 2024-09-19T08:51:34.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.558+0000 7fc572960740 1 -- 172.21.15.19:0/534711933 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc56400cc60 con 0x55fb726fcbb0 2024-09-19T08:51:34.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.558+0000 7fc551ffb640 1 -- 172.21.15.19:0/534711933 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc560004500 con 0x55fb726fcbb0 2024-09-19T08:51:34.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.558+0000 7fc551ffb640 1 -- 172.21.15.19:0/534711933 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc560034040 con 0x55fb726fcbb0 2024-09-19T08:51:34.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.558+0000 7fc572960740 10 client.14997 fetch_fsmap learned FSMap version 27 2024-09-19T08:51:34.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.558+0000 7fc572960740 1 -- 172.21.15.19:0/534711933 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fb7270afd0 con 0x55fb726fcbb0 2024-09-19T08:51:34.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.558+0000 7fc551ffb640 1 -- 172.21.15.19:0/534711933 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc56400cc60 con 0x55fb726fcbb0 2024-09-19T08:51:34.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.558+0000 7fc551ffb640 1 -- 172.21.15.19:0/534711933 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fc560030440 con 0x55fb726fcbb0 2024-09-19T08:51:34.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.558+0000 7fc572960740 10 client.14997 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T08:51:34.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.558+0000 7fc572960740 10 client.14997 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T08:51:34.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.558+0000 7fc572960740 20 client.14997 populate_metadata read hostname 'smithi019' 2024-09-19T08:51:34.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.558+0000 7fc572960740 1 --2- 172.21.15.19:0/534711933 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55fb7270d5e0 0x55fb7270ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:34.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.558+0000 7fc572960740 4 client.14997 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:51:34.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.558+0000 7fc572960740 1 -- 172.21.15.19:0/534711933 --> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb72665600 con 0x55fb7270d5e0 2024-09-19T08:51:34.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.559+0000 7fc56e323640 1 --2- 172.21.15.19:0/534711933 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55fb7270d5e0 0x55fb7270ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:34.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.559+0000 7fc56e323640 1 --2- 172.21.15.19:0/534711933 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55fb7270d5e0 0x55fb7270ea50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=214cab6fdbe4422f server_cookie=ab0141cf130caf6f in_seq=0 out_seq=0 2024-09-19T08:51:34.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.559+0000 7fc551ffb640 10 client.14997 ms_handle_connect on v2:172.21.15.155:6836/3381010945 2024-09-19T08:51:34.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.560+0000 7fc551ffb640 1 -- 172.21.15.19:0/534711933 <== mds.3 v2:172.21.15.155:6836/3381010945 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fb72665600 con 0x55fb7270d5e0 2024-09-19T08:51:34.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.560+0000 7fc551ffb640 10 client.14997 handle_command_reply: tid=0 2024-09-19T08:51:34.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.560+0000 7fc572960740 1 client.14997 shutdown 2024-09-19T08:51:34.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.560+0000 7fc572960740 1 -- 172.21.15.19:0/534711933 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb726fcbb0 msgr2=0x55fb726f9c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:34.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.560+0000 7fc572960740 1 --2- 172.21.15.19:0/534711933 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb726fcbb0 0x55fb726f9c40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fc560009870 tx=0x7fc56002fe10 comp rx=0 tx=0).stop 2024-09-19T08:51:34.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.560+0000 7fc572960740 1 -- 172.21.15.19:0/534711933 shutdown_connections 2024-09-19T08:51:34.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.560+0000 7fc572960740 1 --2- 172.21.15.19:0/534711933 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55fb7270d5e0 0x55fb7270ea50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:34.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.560+0000 7fc551ffb640 0 client.14997 ms_handle_reset on v2:172.21.15.155:6836/3381010945 2024-09-19T08:51:34.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.560+0000 7fc572960740 1 --2- 172.21.15.19:0/534711933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb726f22f0 0x55fb726f9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:34.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.560+0000 7fc572960740 1 --2- 172.21.15.19:0/534711933 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb726fcbb0 0x55fb726f9c40 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:34.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.560+0000 7fc572960740 1 --2- 172.21.15.19:0/534711933 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fb726f19d0 0x55fb726fc3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:34.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.560+0000 7fc572960740 1 -- 172.21.15.19:0/534711933 >> 172.21.15.19:0/534711933 conn(0x55fb726edf60 msgr2=0x55fb726f3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:34.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.560+0000 7fc572960740 1 -- 172.21.15.19:0/534711933 shutdown_connections 2024-09-19T08:51:34.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.560+0000 7fc572960740 1 -- 172.21.15.19:0/534711933 wait complete. 2024-09-19T08:51:34.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.560+0000 7fc572960740 20 client.14997 trim_cache size 0 max 16384 2024-09-19T08:51:34.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.578+0000 7fc572960740 1 Processor -- start 2024-09-19T08:51:34.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.578+0000 7fc572960740 1 -- start start 2024-09-19T08:51:34.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.578+0000 7fc572960740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb726f19d0 0x55fb7270dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:34.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.578+0000 7fc572960740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb726f22f0 0x55fb726f96c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:34.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.578+0000 7fc572960740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fb726fcbb0 0x55fb726f9c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:34.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.578+0000 7fc572960740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55fb7270cd90 con 0x55fb726f22f0 2024-09-19T08:51:34.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.578+0000 7fc572960740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55fb7270d460 con 0x55fb726fcbb0 2024-09-19T08:51:34.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.578+0000 7fc572960740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55fb7270db30 con 0x55fb726f19d0 2024-09-19T08:51:34.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.579+0000 7fc56db22640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb726f22f0 0x55fb726f96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:34.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.579+0000 7fc56db22640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb726f22f0 0x55fb726f96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54810/0 (socket says 172.21.15.19:54810) 2024-09-19T08:51:34.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.579+0000 7fc56db22640 1 -- 172.21.15.19:0/3469358889 learned_addr learned my addr 172.21.15.19:0/3469358889 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:34.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.579+0000 7fc56e323640 1 --2- 172.21.15.19:0/3469358889 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb726f19d0 0x55fb7270dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:34.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.579+0000 7fc56db22640 1 -- 172.21.15.19:0/3469358889 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb726f19d0 msgr2=0x55fb7270dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:34.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.579+0000 7fc56eb24640 1 --2- 172.21.15.19:0/3469358889 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fb726fcbb0 0x55fb726f9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:34.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.579+0000 7fc56db22640 1 --2- 172.21.15.19:0/3469358889 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb726f19d0 0x55fb7270dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:34.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.579+0000 7fc56db22640 1 -- 172.21.15.19:0/3469358889 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fb726fcbb0 msgr2=0x55fb726f9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:34.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.579+0000 7fc56db22640 1 --2- 172.21.15.19:0/3469358889 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fb726fcbb0 0x55fb726f9c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:34.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.579+0000 7fc56db22640 1 -- 172.21.15.19:0/3469358889 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb726ff890 con 0x55fb726f22f0 2024-09-19T08:51:34.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.579+0000 7fc56e323640 1 --2- 172.21.15.19:0/3469358889 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb726f19d0 0x55fb7270dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:51:34.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.579+0000 7fc56eb24640 1 --2- 172.21.15.19:0/3469358889 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fb726fcbb0 0x55fb726f9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:51:34.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.579+0000 7fc56db22640 1 --2- 172.21.15.19:0/3469358889 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb726f22f0 0x55fb726f96c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc55809b570 tx=0x7fc55800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a00056da6ca4f20 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:34.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.579+0000 7fc553fff640 1 -- 172.21.15.19:0/3469358889 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc55809bf70 con 0x55fb726f22f0 2024-09-19T08:51:34.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.579+0000 7fc553fff640 1 -- 172.21.15.19:0/3469358889 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5580151c0 con 0x55fb726f22f0 2024-09-19T08:51:34.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.579+0000 7fc553fff640 1 -- 172.21.15.19:0/3469358889 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc558010510 con 0x55fb726f22f0 2024-09-19T08:51:34.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.580+0000 7fc572960740 1 -- 172.21.15.19:0/3469358889 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb726f22f0 msgr2=0x55fb726f96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:34.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.580+0000 7fc572960740 1 --2- 172.21.15.19:0/3469358889 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb726f22f0 0x55fb726f96c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc55809b570 tx=0x7fc55800c810 comp rx=0 tx=0).stop 2024-09-19T08:51:34.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.580+0000 7fc572960740 1 -- 172.21.15.19:0/3469358889 shutdown_connections 2024-09-19T08:51:34.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.580+0000 7fc572960740 1 --2- 172.21.15.19:0/3469358889 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fb726fcbb0 0x55fb726f9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:34.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.580+0000 7fc572960740 1 --2- 172.21.15.19:0/3469358889 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb726f22f0 0x55fb726f96c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:34.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.580+0000 7fc572960740 1 --2- 172.21.15.19:0/3469358889 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb726f19d0 0x55fb7270dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:34.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.580+0000 7fc572960740 1 -- 172.21.15.19:0/3469358889 >> 172.21.15.19:0/3469358889 conn(0x55fb726edf60 msgr2=0x55fb726f8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:34.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.580+0000 7fc572960740 1 -- 172.21.15.19:0/3469358889 shutdown_connections 2024-09-19T08:51:34.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.580+0000 7fc572960740 1 -- 172.21.15.19:0/3469358889 wait complete. 2024-09-19T08:51:34.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.580+0000 7fc572960740 1 -- start start 2024-09-19T08:51:34.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.580+0000 7fc572960740 1 Processor -- start 2024-09-19T08:51:34.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.581+0000 7fc572960740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb726f19d0 0x55fb72711d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:34.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.581+0000 7fc572960740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fb726f22f0 0x55fb727122b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:34.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.581+0000 7fc572960740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb726fcbb0 0x55fb72775ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:34.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.581+0000 7fc572960740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55fb7270e8d0 con 0x55fb726fcbb0 2024-09-19T08:51:34.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.581+0000 7fc572960740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55fb7270e200 con 0x55fb726f22f0 2024-09-19T08:51:34.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.581+0000 7fc572960740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55fb7270efa0 con 0x55fb726f19d0 2024-09-19T08:51:34.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.581+0000 7fc572960740 10 client.0 _ll_register_callbacks cb 0x7fc560009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:34.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.581+0000 7fc56eb24640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb726fcbb0 0x55fb72775ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:34.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.581+0000 7fc56eb24640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb726fcbb0 0x55fb72775ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54816/0 (socket says 172.21.15.19:54816) 2024-09-19T08:51:34.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.581+0000 7fc56e323640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb726f19d0 0x55fb72711d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:34.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.581+0000 7fc56eb24640 1 -- 172.21.15.19:0/1715770053 learned_addr learned my addr 172.21.15.19:0/1715770053 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:34.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.581+0000 7fc56db22640 1 --2- 172.21.15.19:0/1715770053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fb726f22f0 0x55fb727122b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:34.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.581+0000 7fc56eb24640 1 -- 172.21.15.19:0/1715770053 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb726f19d0 msgr2=0x55fb72711d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:34.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.581+0000 7fc56eb24640 1 --2- 172.21.15.19:0/1715770053 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb726f19d0 0x55fb72711d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:34.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.581+0000 7fc56eb24640 1 -- 172.21.15.19:0/1715770053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fb726f22f0 msgr2=0x55fb727122b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:34.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.581+0000 7fc56eb24640 1 --2- 172.21.15.19:0/1715770053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fb726f22f0 0x55fb727122b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:34.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.581+0000 7fc56eb24640 1 -- 172.21.15.19:0/1715770053 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb72712b40 con 0x55fb726fcbb0 2024-09-19T08:51:34.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.581+0000 7fc56eb24640 1 --2- 172.21.15.19:0/1715770053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb726fcbb0 0x55fb72775ce0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc560009ca0 tx=0x7fc56002f940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6a8b493812f6bdf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:34.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.581+0000 7fc551ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:51:34.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.581+0000 7fc551ffb640 1 -- 172.21.15.19:0/1715770053 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc560060020 con 0x55fb726fcbb0 2024-09-19T08:51:34.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.581+0000 7fc551ffb640 1 -- 172.21.15.19:0/1715770053 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc560004500 con 0x55fb726fcbb0 2024-09-19T08:51:34.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.581+0000 7fc572960740 1 -- 172.21.15.19:0/1715770053 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5580151c0 con 0x55fb726fcbb0 2024-09-19T08:51:34.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.582+0000 7fc551ffb640 1 -- 172.21.15.19:0/1715770053 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc560041070 con 0x55fb726fcbb0 2024-09-19T08:51:34.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.582+0000 7fc572960740 10 client.15003 fetch_fsmap learned FSMap version 27 2024-09-19T08:51:34.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.582+0000 7fc572960740 1 -- 172.21.15.19:0/1715770053 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55fb727772c0 con 0x55fb726fcbb0 2024-09-19T08:51:34.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.582+0000 7fc551ffb640 1 -- 172.21.15.19:0/1715770053 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc5580151c0 con 0x55fb726fcbb0 2024-09-19T08:51:34.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.582+0000 7fc551ffb640 1 -- 172.21.15.19:0/1715770053 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fc56005c450 con 0x55fb726fcbb0 2024-09-19T08:51:34.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.582+0000 7fc572960740 10 client.15003 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T08:51:34.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.582+0000 7fc572960740 10 client.15003 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T08:51:34.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.582+0000 7fc572960740 20 client.15003 populate_metadata read hostname 'smithi019' 2024-09-19T08:51:34.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.582+0000 7fc572960740 1 --2- 172.21.15.19:0/1715770053 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55fb7270d5e0 0x55fb7277ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:34.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.582+0000 7fc572960740 4 client.15003 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T08:51:34.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.582+0000 7fc572960740 1 -- 172.21.15.19:0/1715770053 --> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] -- command(tid 0: {"prefix": "status"}) -- 0x55fb7265fb10 con 0x55fb7270d5e0 2024-09-19T08:51:34.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.583+0000 7fc56e323640 1 --2- 172.21.15.19:0/1715770053 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55fb7270d5e0 0x55fb7277ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:34.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.583+0000 7fc56e323640 1 --2- 172.21.15.19:0/1715770053 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55fb7270d5e0 0x55fb7277ac00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b956a70d6a8afdb4 server_cookie=7b55e3ee1a78b533 in_seq=0 out_seq=0 2024-09-19T08:51:34.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.583+0000 7fc551ffb640 10 client.15003 ms_handle_connect on v2:172.21.15.155:6836/3381010945 2024-09-19T08:51:34.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.584+0000 7fc551ffb640 1 -- 172.21.15.19:0/1715770053 <== mds.3 v2:172.21.15.155:6836/3381010945 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55fb7265fb10 con 0x55fb7270d5e0 2024-09-19T08:51:34.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.584+0000 7fc551ffb640 10 client.15003 handle_command_reply: tid=0 2024-09-19T08:51:34.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.584+0000 7fc572960740 1 client.15003 shutdown 2024-09-19T08:51:34.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.584+0000 7fc572960740 1 -- 172.21.15.19:0/1715770053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb726fcbb0 msgr2=0x55fb72775ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:34.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.584+0000 7fc572960740 1 --2- 172.21.15.19:0/1715770053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb726fcbb0 0x55fb72775ce0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc560009ca0 tx=0x7fc56002f940 comp rx=0 tx=0).stop 2024-09-19T08:51:34.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.584+0000 7fc572960740 1 -- 172.21.15.19:0/1715770053 shutdown_connections 2024-09-19T08:51:34.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.584+0000 7fc572960740 1 --2- 172.21.15.19:0/1715770053 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55fb7270d5e0 0x55fb7277ac00 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:34.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.584+0000 7fc572960740 1 --2- 172.21.15.19:0/1715770053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55fb726fcbb0 0x55fb72775ce0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:34.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.584+0000 7fc572960740 1 --2- 172.21.15.19:0/1715770053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55fb726f22f0 0x55fb727122b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:34.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.584+0000 7fc572960740 1 --2- 172.21.15.19:0/1715770053 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fb726f19d0 0x55fb72711d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:34.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.584+0000 7fc551ffb640 0 client.15003 ms_handle_reset on v2:172.21.15.155:6836/3381010945 2024-09-19T08:51:34.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.584+0000 7fc572960740 1 -- 172.21.15.19:0/1715770053 >> 172.21.15.19:0/1715770053 conn(0x55fb726edf60 msgr2=0x55fb726f96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:34.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.584+0000 7fc572960740 1 -- 172.21.15.19:0/1715770053 shutdown_connections 2024-09-19T08:51:34.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.584+0000 7fc572960740 1 -- 172.21.15.19:0/1715770053 wait complete. 2024-09-19T08:51:34.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.584+0000 7fc572960740 20 client.15003 trim_cache size 0 max 16384 2024-09-19T08:51:34.601 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:51:34.601 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "f26c9d84-7662-11ef-bceb-c7b262605968", 2024-09-19T08:51:34.601 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 3, 2024-09-19T08:51:34.601 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 24464, 2024-09-19T08:51:34.601 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-19T08:51:34.601 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-19T08:51:34.601 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-19T08:51:34.601 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 68.660857242000006, 2024-09-19T08:51:34.601 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 27, 2024-09-19T08:51:34.601 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 82, 2024-09-19T08:51:34.601 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 80, 2024-09-19T08:51:34.601 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 100.514941478 2024-09-19T08:51:34.602 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:51:34.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.585+0000 7fc570587640 1 -- 172.21.15.19:0/3848014689 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc5540a32d0 msgr2=0x7fc5540a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:34.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.585+0000 7fc570587640 1 --2- 172.21.15.19:0/3848014689 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc5540a32d0 0x7fc5540a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc560009a60 tx=0x7fc5600095c0 comp rx=0 tx=0).stop 2024-09-19T08:51:34.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.585+0000 7fc570587640 1 -- 172.21.15.19:0/3848014689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc568103660 msgr2=0x7fc5681a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:34.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.585+0000 7fc570587640 1 --2- 172.21.15.19:0/3848014689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc568103660 0x7fc5681a09a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc55800b3f0 tx=0x7fc55800b8b0 comp rx=0 tx=0).stop 2024-09-19T08:51:34.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.585+0000 7fc570587640 1 -- 172.21.15.19:0/3848014689 shutdown_connections 2024-09-19T08:51:34.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.585+0000 7fc570587640 1 --2- 172.21.15.19:0/3848014689 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc5540a32d0 0x7fc5540a5790 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:34.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.585+0000 7fc570587640 1 --2- 172.21.15.19:0/3848014689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc56810c170 0x7fc56819a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:34.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.585+0000 7fc570587640 1 --2- 172.21.15.19:0/3848014689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc568103660 0x7fc5681a09a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:34.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.585+0000 7fc570587640 1 --2- 172.21.15.19:0/3848014689 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc568102d40 0x7fc5681a0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:34.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.585+0000 7fc570587640 1 -- 172.21.15.19:0/3848014689 >> 172.21.15.19:0/3848014689 conn(0x7fc5680fc7a0 msgr2=0x7fc5681008d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:34.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.585+0000 7fc570587640 1 -- 172.21.15.19:0/3848014689 shutdown_connections 2024-09-19T08:51:34.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:34.585+0000 7fc570587640 1 -- 172.21.15.19:0/3848014689 wait complete. 2024-09-19T08:51:35.284 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-19T08:51:35.587 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:35.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:35 smithi019 ceph-mon[30976]: pgmap v318: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 11 op/s; 76 B/s, 1 objects/s recovering 2024-09-19T08:51:35.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:35 smithi155 ceph-mon[34921]: pgmap v318: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 11 op/s; 76 B/s, 1 objects/s recovering 2024-09-19T08:51:35.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:35 smithi203 ceph-mon[35450]: pgmap v318: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 11 op/s; 76 B/s, 1 objects/s recovering 2024-09-19T08:51:36.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.085+0000 7f19d5622640 1 -- 172.21.15.19:0/3740171600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19d0102dc0 msgr2=0x7f19d01031a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:36.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.085+0000 7f19d5622640 1 --2- 172.21.15.19:0/3740171600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19d0102dc0 0x7f19d01031a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f19c0009900 tx=0x7f19c002a480 comp rx=0 tx=0).stop 2024-09-19T08:51:36.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.085+0000 7f19d5622640 1 -- 172.21.15.19:0/3740171600 shutdown_connections 2024-09-19T08:51:36.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.085+0000 7f19d5622640 1 --2- 172.21.15.19:0/3740171600 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19d010c1a0 0x7f19d010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:36.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.085+0000 7f19d5622640 1 --2- 172.21.15.19:0/3740171600 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19d01036e0 0x7f19d010bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:36.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.085+0000 7f19d5622640 1 --2- 172.21.15.19:0/3740171600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19d0102dc0 0x7f19d01031a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:36.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.085+0000 7f19d5622640 1 -- 172.21.15.19:0/3740171600 >> 172.21.15.19:0/3740171600 conn(0x7f19d00fc7a0 msgr2=0x7f19d00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:36.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.085+0000 7f19d5622640 1 -- 172.21.15.19:0/3740171600 shutdown_connections 2024-09-19T08:51:36.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.085+0000 7f19d5622640 1 -- 172.21.15.19:0/3740171600 wait complete. 2024-09-19T08:51:36.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.086+0000 7f19d5622640 1 Processor -- start 2024-09-19T08:51:36.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.086+0000 7f19d5622640 1 -- start start 2024-09-19T08:51:36.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.086+0000 7f19d5622640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19d0102dc0 0x7f19d0198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:36.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.086+0000 7f19d5622640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19d01036e0 0x7f19d0198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:36.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.086+0000 7f19d5622640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19d010c1a0 0x7f19d019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:36.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.086+0000 7f19d5622640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f19d0111f70 con 0x7f19d010c1a0 2024-09-19T08:51:36.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.086+0000 7f19d5622640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f19d0111df0 con 0x7f19d01036e0 2024-09-19T08:51:36.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.086+0000 7f19d5622640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f19d01120f0 con 0x7f19d0102dc0 2024-09-19T08:51:36.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.086+0000 7f19cf7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19d010c1a0 0x7f19d019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:36.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.086+0000 7f19cf7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19d010c1a0 0x7f19d019cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40632/0 (socket says 172.21.15.19:40632) 2024-09-19T08:51:36.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.086+0000 7f19cf7fe640 1 -- 172.21.15.19:0/3470112335 learned_addr learned my addr 172.21.15.19:0/3470112335 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:36.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.086+0000 7f19ceffd640 1 --2- 172.21.15.19:0/3470112335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19d0102dc0 0x7f19d0198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:36.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.087+0000 7f19ce7fc640 1 --2- 172.21.15.19:0/3470112335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19d01036e0 0x7f19d0198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:36.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.087+0000 7f19cf7fe640 1 -- 172.21.15.19:0/3470112335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19d0102dc0 msgr2=0x7f19d0198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:36.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.087+0000 7f19cf7fe640 1 --2- 172.21.15.19:0/3470112335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19d0102dc0 0x7f19d0198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:36.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.087+0000 7f19cf7fe640 1 -- 172.21.15.19:0/3470112335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19d01036e0 msgr2=0x7f19d0198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:36.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.087+0000 7f19cf7fe640 1 --2- 172.21.15.19:0/3470112335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19d01036e0 0x7f19d0198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:36.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.087+0000 7f19cf7fe640 1 -- 172.21.15.19:0/3470112335 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19d019d400 con 0x7f19d010c1a0 2024-09-19T08:51:36.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.087+0000 7f19cf7fe640 1 --2- 172.21.15.19:0/3470112335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19d010c1a0 0x7f19d019cd20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f19c800eaa0 tx=0x7f19c800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:36.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.087+0000 7f19c7fff640 1 -- 172.21.15.19:0/3470112335 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c800cdb0 con 0x7f19d010c1a0 2024-09-19T08:51:36.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.087+0000 7f19d5622640 1 -- 172.21.15.19:0/3470112335 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19d019d6f0 con 0x7f19d010c1a0 2024-09-19T08:51:36.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.087+0000 7f19c7fff640 1 -- 172.21.15.19:0/3470112335 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19c8005020 con 0x7f19d010c1a0 2024-09-19T08:51:36.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.087+0000 7f19c7fff640 1 -- 172.21.15.19:0/3470112335 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c80116b0 con 0x7f19d010c1a0 2024-09-19T08:51:36.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.087+0000 7f19d5622640 1 -- 172.21.15.19:0/3470112335 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19d01a4fd0 con 0x7f19d010c1a0 2024-09-19T08:51:36.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.090+0000 7f19c7fff640 1 -- 172.21.15.19:0/3470112335 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f19c8011850 con 0x7f19d010c1a0 2024-09-19T08:51:36.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.090+0000 7f19d79fb740 1 Processor -- start 2024-09-19T08:51:36.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.090+0000 7f19d79fb740 1 -- start start 2024-09-19T08:51:36.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.090+0000 7f19d79fb740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574725b09d0 0x5574725b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:36.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.090+0000 7f19d79fb740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574725b12f0 0x5574725bb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:36.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.091+0000 7f19d79fb740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574725bbbb0 0x5574725bdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:36.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.091+0000 7f19d79fb740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557472517090 con 0x5574725bbbb0 2024-09-19T08:51:36.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.091+0000 7f19d79fb740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5574724bea70 con 0x5574725b09d0 2024-09-19T08:51:36.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.091+0000 7f19d79fb740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557472513050 con 0x5574725b12f0 2024-09-19T08:51:36.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.091+0000 7f19ce7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574725bbbb0 0x5574725bdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:36.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.091+0000 7f19ce7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574725bbbb0 0x5574725bdfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40642/0 (socket says 172.21.15.19:40642) 2024-09-19T08:51:36.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.091+0000 7f19ce7fc640 1 -- 172.21.15.19:0/4175153301 learned_addr learned my addr 172.21.15.19:0/4175153301 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:36.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.091+0000 7f19c7fff640 1 --2- 172.21.15.19:0/3470112335 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f19bc0a32d0 0x7f19bc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:36.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.091+0000 7f19ce7fc640 1 --2- 172.21.15.19:0/4175153301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574725b09d0 0x5574725b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:36.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.091+0000 7f19ceffd640 1 --2- 172.21.15.19:0/4175153301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574725b12f0 0x5574725bb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:36.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.091+0000 7f19ce7fc640 1 -- 172.21.15.19:0/4175153301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574725b12f0 msgr2=0x5574725bb670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:36.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.091+0000 7f19c7fff640 1 -- 172.21.15.19:0/3470112335 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f19c80cfbe0 con 0x7f19d010c1a0 2024-09-19T08:51:36.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.091+0000 7f19ce7fc640 1 --2- 172.21.15.19:0/4175153301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574725b12f0 0x5574725bb670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:36.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.091+0000 7f19cf7fe640 1 --2- 172.21.15.19:0/3470112335 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f19bc0a32d0 0x7f19bc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:36.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.091+0000 7f19ce7fc640 1 -- 172.21.15.19:0/4175153301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574725b09d0 msgr2=0x5574725b0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:36.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.091+0000 7f19ce7fc640 1 --2- 172.21.15.19:0/4175153301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574725b09d0 0x5574725b0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:36.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.091+0000 7f19ce7fc640 1 -- 172.21.15.19:0/4175153301 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574724cb130 con 0x5574725bbbb0 2024-09-19T08:51:36.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.091+0000 7f19ceffd640 1 --2- 172.21.15.19:0/4175153301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574725b12f0 0x5574725bb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:51:36.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.091+0000 7f19ce7fc640 1 --2- 172.21.15.19:0/4175153301 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574725bbbb0 0x5574725bdfa0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f19b80125c0 tx=0x7f19b800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc536d8ea130a6b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:36.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.092+0000 7f19c57fa640 1 -- 172.21.15.19:0/4175153301 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b80106b0 con 0x5574725bbbb0 2024-09-19T08:51:36.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.092+0000 7f19c57fa640 1 -- 172.21.15.19:0/4175153301 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19b8010d30 con 0x5574725bbbb0 2024-09-19T08:51:36.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.092+0000 7f19c57fa640 1 -- 172.21.15.19:0/4175153301 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b801dd90 con 0x5574725bbbb0 2024-09-19T08:51:36.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.092+0000 7f19d79fb740 1 -- 172.21.15.19:0/4175153301 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574725bbbb0 msgr2=0x5574725bdfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:36.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.092+0000 7f19cf7fe640 1 --2- 172.21.15.19:0/3470112335 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f19bc0a32d0 0x7f19bc0a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f19c8098b30 tx=0x7f19c8098480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:36.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.092+0000 7f19d79fb740 1 --2- 172.21.15.19:0/4175153301 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574725bbbb0 0x5574725bdfa0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f19b80125c0 tx=0x7f19b800b870 comp rx=0 tx=0).stop 2024-09-19T08:51:36.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.092+0000 7f19d79fb740 1 -- 172.21.15.19:0/4175153301 shutdown_connections 2024-09-19T08:51:36.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.093+0000 7f19d79fb740 1 --2- 172.21.15.19:0/4175153301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574725b12f0 0x5574725bb670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:36.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.093+0000 7f19d79fb740 1 --2- 172.21.15.19:0/4175153301 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574725bbbb0 0x5574725bdfa0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:36.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.093+0000 7f19d79fb740 1 --2- 172.21.15.19:0/4175153301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574725b09d0 0x5574725b0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:36.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.093+0000 7f19d79fb740 1 -- 172.21.15.19:0/4175153301 >> 172.21.15.19:0/4175153301 conn(0x5574725acf60 msgr2=0x5574725ad340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:36.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.093+0000 7f19d79fb740 1 -- 172.21.15.19:0/4175153301 shutdown_connections 2024-09-19T08:51:36.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.093+0000 7f19d79fb740 1 -- 172.21.15.19:0/4175153301 wait complete. 2024-09-19T08:51:36.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.093+0000 7f19d79fb740 1 -- start start 2024-09-19T08:51:36.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.093+0000 7f19d79fb740 1 Processor -- start 2024-09-19T08:51:36.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.093+0000 7f19d79fb740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574725b09d0 0x5574725bb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:36.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.093+0000 7f19d79fb740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574725b12f0 0x5574725b8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:36.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.093+0000 7f19d79fb740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574725bbbb0 0x5574725b8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:36.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.093+0000 7f19d79fb740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5574725be780 con 0x5574725bbbb0 2024-09-19T08:51:36.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.093+0000 7f19d79fb740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5574724d1f20 con 0x5574725b12f0 2024-09-19T08:51:36.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.093+0000 7f19d79fb740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5574725be900 con 0x5574725b09d0 2024-09-19T08:51:36.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.093+0000 7f19d79fb740 10 client.0 _ll_register_callbacks cb 0x55747249b030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:36.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.093+0000 7f19ce7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574725bbbb0 0x5574725b8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:36.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.093+0000 7f19ce7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574725bbbb0 0x5574725b8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40646/0 (socket says 172.21.15.19:40646) 2024-09-19T08:51:36.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.093+0000 7f19ce7fc640 1 -- 172.21.15.19:0/318896348 learned_addr learned my addr 172.21.15.19:0/318896348 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:36.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.094+0000 7f19ceffd640 1 --2- 172.21.15.19:0/318896348 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574725b12f0 0x5574725b8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:36.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.094+0000 7f19ce7fc640 1 --2- 172.21.15.19:0/318896348 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574725b09d0 0x5574725bb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:36.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.094+0000 7f19ce7fc640 1 -- 172.21.15.19:0/318896348 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574725b09d0 msgr2=0x5574725bb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:36.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.094+0000 7f19ce7fc640 1 --2- 172.21.15.19:0/318896348 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574725b09d0 0x5574725bb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:36.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.094+0000 7f19ce7fc640 1 -- 172.21.15.19:0/318896348 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574725b12f0 msgr2=0x5574725b8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:36.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.094+0000 7f19ce7fc640 1 --2- 172.21.15.19:0/318896348 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574725b12f0 0x5574725b8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:36.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.094+0000 7f19ce7fc640 1 -- 172.21.15.19:0/318896348 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574722882b0 con 0x5574725bbbb0 2024-09-19T08:51:36.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.094+0000 7f19ce7fc640 1 --2- 172.21.15.19:0/318896348 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574725bbbb0 0x5574725b8d50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f19b8005940 tx=0x7f19b801d8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb2b1e962b21aec7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:36.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.094+0000 7f19b67fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:51:36.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.094+0000 7f19b67fc640 1 -- 172.21.15.19:0/318896348 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b8005250 con 0x5574725bbbb0 2024-09-19T08:51:36.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.094+0000 7f19b67fc640 1 -- 172.21.15.19:0/318896348 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f19b80053f0 con 0x5574725bbbb0 2024-09-19T08:51:36.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.094+0000 7f19d79fb740 1 -- 172.21.15.19:0/318896348 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19b8010d30 con 0x5574725bbbb0 2024-09-19T08:51:36.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.094+0000 7f19b67fc640 1 -- 172.21.15.19:0/318896348 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f19b8005610 con 0x5574725bbbb0 2024-09-19T08:51:36.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.094+0000 7f19d79fb740 10 client.15015 fetch_fsmap learned FSMap version 27 2024-09-19T08:51:36.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.094+0000 7f19d79fb740 1 -- 172.21.15.19:0/318896348 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5574725ca070 con 0x5574725bbbb0 2024-09-19T08:51:36.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.095+0000 7f19b67fc640 1 -- 172.21.15.19:0/318896348 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19b8010d30 con 0x5574725bbbb0 2024-09-19T08:51:36.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.095+0000 7f19b67fc640 1 -- 172.21.15.19:0/318896348 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f19b801c070 con 0x5574725bbbb0 2024-09-19T08:51:36.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.095+0000 7f19d79fb740 10 client.15015 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T08:51:36.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.095+0000 7f19d79fb740 10 client.15015 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T08:51:36.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.095+0000 7f19d79fb740 20 client.15015 populate_metadata read hostname 'smithi019' 2024-09-19T08:51:36.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.095+0000 7f19d79fb740 1 --2- 172.21.15.19:0/318896348 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x5574725cc310 0x5574725cd780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:36.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.095+0000 7f19d79fb740 4 client.15015 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:51:36.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.095+0000 7f19d79fb740 1 -- 172.21.15.19:0/318896348 --> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557472524600 con 0x5574725cc310 2024-09-19T08:51:36.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.095+0000 7f19ceffd640 1 --2- 172.21.15.19:0/318896348 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x5574725cc310 0x5574725cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:36.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.096+0000 7f19b67fc640 10 client.15015 ms_handle_connect on v2:172.21.15.203:6836/3684671619 2024-09-19T08:51:36.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.096+0000 7f19ceffd640 1 --2- 172.21.15.19:0/318896348 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x5574725cc310 0x5574725cd780 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b30e62679e862d46 server_cookie=d313e5e8326b200 in_seq=0 out_seq=0 2024-09-19T08:51:36.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.097+0000 7f19b67fc640 1 -- 172.21.15.19:0/318896348 <== mds.2 v2:172.21.15.203:6836/3684671619 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557472524600 con 0x5574725cc310 2024-09-19T08:51:36.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.097+0000 7f19b67fc640 10 client.15015 handle_command_reply: tid=0 2024-09-19T08:51:36.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.097+0000 7f19d79fb740 1 client.15015 shutdown 2024-09-19T08:51:36.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.097+0000 7f19d79fb740 1 -- 172.21.15.19:0/318896348 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574725bbbb0 msgr2=0x5574725b8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:36.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.097+0000 7f19d79fb740 1 --2- 172.21.15.19:0/318896348 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574725bbbb0 0x5574725b8d50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f19b8005940 tx=0x7f19b801d8f0 comp rx=0 tx=0).stop 2024-09-19T08:51:36.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.097+0000 7f19d79fb740 1 -- 172.21.15.19:0/318896348 shutdown_connections 2024-09-19T08:51:36.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.097+0000 7f19d79fb740 1 --2- 172.21.15.19:0/318896348 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x5574725cc310 0x5574725cd780 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:36.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.097+0000 7f19d79fb740 1 --2- 172.21.15.19:0/318896348 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574725bbbb0 0x5574725b8d50 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:36.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.097+0000 7f19b67fc640 0 client.15015 ms_handle_reset on v2:172.21.15.203:6836/3684671619 2024-09-19T08:51:36.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.097+0000 7f19d79fb740 1 --2- 172.21.15.19:0/318896348 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574725b12f0 0x5574725b8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:36.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.097+0000 7f19d79fb740 1 --2- 172.21.15.19:0/318896348 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574725b09d0 0x5574725bb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:36.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.097+0000 7f19d79fb740 1 -- 172.21.15.19:0/318896348 >> 172.21.15.19:0/318896348 conn(0x5574725acf60 msgr2=0x5574725b2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:36.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.097+0000 7f19d79fb740 1 -- 172.21.15.19:0/318896348 shutdown_connections 2024-09-19T08:51:36.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.097+0000 7f19d79fb740 1 -- 172.21.15.19:0/318896348 wait complete. 2024-09-19T08:51:36.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.097+0000 7f19d79fb740 20 client.15015 trim_cache size 0 max 16384 2024-09-19T08:51:36.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.133+0000 7f19d79fb740 1 Processor -- start 2024-09-19T08:51:36.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.133+0000 7f19d79fb740 1 -- start start 2024-09-19T08:51:36.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.133+0000 7f19d79fb740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574725b09d0 0x5574725d5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:36.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.133+0000 7f19d79fb740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574725b12f0 0x5574725b70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:36.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.133+0000 7f19d79fb740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574725bbbb0 0x5574725b7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:36.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.133+0000 7f19d79fb740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5574725cbac0 con 0x5574725b12f0 2024-09-19T08:51:36.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.133+0000 7f19d79fb740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5574725cc190 con 0x5574725b09d0 2024-09-19T08:51:36.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.133+0000 7f19d79fb740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5574725cc860 con 0x5574725bbbb0 2024-09-19T08:51:36.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.133+0000 7f19ceffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574725b12f0 0x5574725b70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:36.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.133+0000 7f19ceffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574725b12f0 0x5574725b70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40648/0 (socket says 172.21.15.19:40648) 2024-09-19T08:51:36.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.133+0000 7f19ceffd640 1 -- 172.21.15.19:0/2049752212 learned_addr learned my addr 172.21.15.19:0/2049752212 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:36.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.133+0000 7f19ce7fc640 1 --2- 172.21.15.19:0/2049752212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574725b09d0 0x5574725d5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:36.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.134+0000 7f19ce7fc640 1 --2- 172.21.15.19:0/2049752212 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574725bbbb0 0x5574725b7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:36.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.134+0000 7f19ceffd640 1 -- 172.21.15.19:0/2049752212 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574725bbbb0 msgr2=0x5574725b7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:36.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.134+0000 7f19ceffd640 1 --2- 172.21.15.19:0/2049752212 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574725bbbb0 0x5574725b7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:36.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.134+0000 7f19ceffd640 1 -- 172.21.15.19:0/2049752212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574725b09d0 msgr2=0x5574725d5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:36.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.134+0000 7f19ceffd640 1 --2- 172.21.15.19:0/2049752212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574725b09d0 0x5574725d5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:36.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.134+0000 7f19ceffd640 1 -- 172.21.15.19:0/2049752212 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574725bb0e0 con 0x5574725b12f0 2024-09-19T08:51:36.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.134+0000 7f19ce7fc640 1 --2- 172.21.15.19:0/2049752212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574725b09d0 0x5574725d5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:51:36.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.134+0000 7f19ceffd640 1 --2- 172.21.15.19:0/2049752212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574725b12f0 0x5574725b70e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f19c0009230 tx=0x7f19c00058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a72fdffdd37b85f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:36.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.134+0000 7f19c4ff9640 1 -- 172.21.15.19:0/2049752212 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c0049070 con 0x5574725b12f0 2024-09-19T08:51:36.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.134+0000 7f19c4ff9640 1 -- 172.21.15.19:0/2049752212 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19c0005500 con 0x5574725b12f0 2024-09-19T08:51:36.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.134+0000 7f19c4ff9640 1 -- 172.21.15.19:0/2049752212 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c0035040 con 0x5574725b12f0 2024-09-19T08:51:36.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.135+0000 7f19d79fb740 1 -- 172.21.15.19:0/2049752212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574725b12f0 msgr2=0x5574725b70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:36.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.135+0000 7f19d79fb740 1 --2- 172.21.15.19:0/2049752212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574725b12f0 0x5574725b70e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f19c0009230 tx=0x7f19c00058d0 comp rx=0 tx=0).stop 2024-09-19T08:51:36.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.135+0000 7f19d79fb740 1 -- 172.21.15.19:0/2049752212 shutdown_connections 2024-09-19T08:51:36.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.135+0000 7f19d79fb740 1 --2- 172.21.15.19:0/2049752212 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574725bbbb0 0x5574725b7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:36.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.135+0000 7f19d79fb740 1 --2- 172.21.15.19:0/2049752212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574725b12f0 0x5574725b70e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:36.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.135+0000 7f19d79fb740 1 --2- 172.21.15.19:0/2049752212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574725b09d0 0x5574725d5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:36.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.135+0000 7f19d79fb740 1 -- 172.21.15.19:0/2049752212 >> 172.21.15.19:0/2049752212 conn(0x5574725acf60 msgr2=0x5574725b87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:36.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.135+0000 7f19d79fb740 1 -- 172.21.15.19:0/2049752212 shutdown_connections 2024-09-19T08:51:36.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.135+0000 7f19d79fb740 1 -- 172.21.15.19:0/2049752212 wait complete. 2024-09-19T08:51:36.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.136+0000 7f19d79fb740 1 -- start start 2024-09-19T08:51:36.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.136+0000 7f19d79fb740 1 Processor -- start 2024-09-19T08:51:36.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.136+0000 7f19d79fb740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574725b09d0 0x5574725cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:36.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.136+0000 7f19d79fb740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574725b12f0 0x5574725d0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:36.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.136+0000 7f19d79fb740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574725bbbb0 0x557472632140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:36.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.136+0000 7f19d79fb740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5574725cd600 con 0x5574725b09d0 2024-09-19T08:51:36.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.136+0000 7f19d79fb740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5574725ccf30 con 0x5574725b12f0 2024-09-19T08:51:36.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.136+0000 7f19d79fb740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5574725cdcd0 con 0x5574725bbbb0 2024-09-19T08:51:36.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.136+0000 7f19d79fb740 10 client.0 _ll_register_callbacks cb 0x7f19b80123f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:36.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.136+0000 7f19ce7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574725b09d0 0x5574725cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:36.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.136+0000 7f19ce7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574725b09d0 0x5574725cfbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40652/0 (socket says 172.21.15.19:40652) 2024-09-19T08:51:36.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.136+0000 7f19ce7fc640 1 -- 172.21.15.19:0/2221808320 learned_addr learned my addr 172.21.15.19:0/2221808320 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:36.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.136+0000 7f19ce7fc640 1 --2- 172.21.15.19:0/2221808320 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574725bbbb0 0x557472632140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:36.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.137+0000 7f19ceffd640 1 --2- 172.21.15.19:0/2221808320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574725b12f0 0x5574725d0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:36.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.137+0000 7f19ce7fc640 1 -- 172.21.15.19:0/2221808320 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574725bbbb0 msgr2=0x557472632140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:36.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.137+0000 7f19ce7fc640 1 --2- 172.21.15.19:0/2221808320 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574725bbbb0 0x557472632140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:36.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.137+0000 7f19ce7fc640 1 -- 172.21.15.19:0/2221808320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574725b12f0 msgr2=0x5574725d0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:36.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.137+0000 7f19ce7fc640 1 --2- 172.21.15.19:0/2221808320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574725b12f0 0x5574725d0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:36.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.137+0000 7f19ce7fc640 1 -- 172.21.15.19:0/2221808320 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557472632780 con 0x5574725b09d0 2024-09-19T08:51:36.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.137+0000 7f19ceffd640 1 --2- 172.21.15.19:0/2221808320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574725b12f0 0x5574725d0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:36.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.137+0000 7f19ce7fc640 1 --2- 172.21.15.19:0/2221808320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574725b09d0 0x5574725cfbc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f19b801e000 tx=0x7f19b800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e83bdbb9c2d21d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:36.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.137+0000 7f19b67fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:51:36.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.137+0000 7f19b67fc640 1 -- 172.21.15.19:0/2221808320 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b803c040 con 0x5574725b09d0 2024-09-19T08:51:36.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.137+0000 7f19b67fc640 1 -- 172.21.15.19:0/2221808320 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f19b801d5f0 con 0x5574725b09d0 2024-09-19T08:51:36.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.137+0000 7f19d79fb740 1 -- 172.21.15.19:0/2221808320 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19c0005500 con 0x5574725b09d0 2024-09-19T08:51:36.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.137+0000 7f19b67fc640 1 -- 172.21.15.19:0/2221808320 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f19b80120b0 con 0x5574725b09d0 2024-09-19T08:51:36.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.137+0000 7f19d79fb740 10 client.15021 fetch_fsmap learned FSMap version 27 2024-09-19T08:51:36.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.137+0000 7f19d79fb740 1 -- 172.21.15.19:0/2221808320 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55747263ad30 con 0x5574725b09d0 2024-09-19T08:51:36.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.138+0000 7f19b67fc640 1 -- 172.21.15.19:0/2221808320 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19c0005500 con 0x5574725b09d0 2024-09-19T08:51:36.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.138+0000 7f19b67fc640 1 -- 172.21.15.19:0/2221808320 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f19b801c040 con 0x5574725b09d0 2024-09-19T08:51:36.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.138+0000 7f19d79fb740 10 client.15021 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T08:51:36.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.138+0000 7f19d79fb740 10 client.15021 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T08:51:36.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.138+0000 7f19d79fb740 20 client.15021 populate_metadata read hostname 'smithi019' 2024-09-19T08:51:36.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.138+0000 7f19d79fb740 1 --2- 172.21.15.19:0/2221808320 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55747263f920 0x55747263e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:36.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.138+0000 7f19d79fb740 4 client.15021 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T08:51:36.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.138+0000 7f19d79fb740 1 -- 172.21.15.19:0/2221808320 --> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] -- command(tid 0: {"prefix": "status"}) -- 0x55747251eb10 con 0x55747263f920 2024-09-19T08:51:36.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.138+0000 7f19ceffd640 1 --2- 172.21.15.19:0/2221808320 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55747263f920 0x55747263e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:36.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.139+0000 7f19ceffd640 1 --2- 172.21.15.19:0/2221808320 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55747263f920 0x55747263e630 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2862616f044ca3cf server_cookie=c4868f7faa57136e in_seq=0 out_seq=0 2024-09-19T08:51:36.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.139+0000 7f19b67fc640 10 client.15021 ms_handle_connect on v2:172.21.15.203:6836/3684671619 2024-09-19T08:51:36.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.139+0000 7f19b67fc640 1 -- 172.21.15.19:0/2221808320 <== mds.2 v2:172.21.15.203:6836/3684671619 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55747251eb10 con 0x55747263f920 2024-09-19T08:51:36.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.139+0000 7f19b67fc640 10 client.15021 handle_command_reply: tid=0 2024-09-19T08:51:36.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.139+0000 7f19d79fb740 1 client.15021 shutdown 2024-09-19T08:51:36.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.139+0000 7f19d79fb740 1 -- 172.21.15.19:0/2221808320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574725b09d0 msgr2=0x5574725cfbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:36.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.139+0000 7f19d79fb740 1 --2- 172.21.15.19:0/2221808320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574725b09d0 0x5574725cfbc0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f19b801e000 tx=0x7f19b800b960 comp rx=0 tx=0).stop 2024-09-19T08:51:36.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.139+0000 7f19d79fb740 1 -- 172.21.15.19:0/2221808320 shutdown_connections 2024-09-19T08:51:36.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.139+0000 7f19d79fb740 1 --2- 172.21.15.19:0/2221808320 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55747263f920 0x55747263e630 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:36.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.139+0000 7f19d79fb740 1 --2- 172.21.15.19:0/2221808320 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574725bbbb0 0x557472632140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:36.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.139+0000 7f19b67fc640 0 client.15021 ms_handle_reset on v2:172.21.15.203:6836/3684671619 2024-09-19T08:51:36.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.139+0000 7f19d79fb740 1 --2- 172.21.15.19:0/2221808320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5574725b12f0 0x5574725d0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:36.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.139+0000 7f19d79fb740 1 --2- 172.21.15.19:0/2221808320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5574725b09d0 0x5574725cfbc0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:36.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.139+0000 7f19d79fb740 1 -- 172.21.15.19:0/2221808320 >> 172.21.15.19:0/2221808320 conn(0x5574725acf60 msgr2=0x5574725b6ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:36.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.140+0000 7f19d79fb740 1 -- 172.21.15.19:0/2221808320 shutdown_connections 2024-09-19T08:51:36.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.140+0000 7f19d79fb740 1 -- 172.21.15.19:0/2221808320 wait complete. 2024-09-19T08:51:36.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.140+0000 7f19d79fb740 20 client.15021 trim_cache size 0 max 16384 2024-09-19T08:51:36.144 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:51:36.144 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "f26c9d84-7662-11ef-bceb-c7b262605968", 2024-09-19T08:51:36.144 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 2, 2024-09-19T08:51:36.144 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 24469, 2024-09-19T08:51:36.144 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-19T08:51:36.144 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-19T08:51:36.145 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-19T08:51:36.145 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 71.224125563000001, 2024-09-19T08:51:36.145 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 27, 2024-09-19T08:51:36.145 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 82, 2024-09-19T08:51:36.145 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 80, 2024-09-19T08:51:36.145 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 104.766017702 2024-09-19T08:51:36.145 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:51:36.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.140+0000 7f19d5622640 1 -- 172.21.15.19:0/3470112335 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f19bc0a32d0 msgr2=0x7f19bc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:36.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.140+0000 7f19d5622640 1 --2- 172.21.15.19:0/3470112335 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f19bc0a32d0 0x7f19bc0a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f19c8098b30 tx=0x7f19c8098480 comp rx=0 tx=0).stop 2024-09-19T08:51:36.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.140+0000 7f19d5622640 1 -- 172.21.15.19:0/3470112335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19d010c1a0 msgr2=0x7f19d019cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:36.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.140+0000 7f19d5622640 1 --2- 172.21.15.19:0/3470112335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19d010c1a0 0x7f19d019cd20 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f19c800eaa0 tx=0x7f19c800ef60 comp rx=0 tx=0).stop 2024-09-19T08:51:36.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.141+0000 7f19d5622640 1 -- 172.21.15.19:0/3470112335 shutdown_connections 2024-09-19T08:51:36.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.141+0000 7f19d5622640 1 --2- 172.21.15.19:0/3470112335 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f19bc0a32d0 0x7f19bc0a5790 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:36.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.141+0000 7f19d5622640 1 --2- 172.21.15.19:0/3470112335 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19d010c1a0 0x7f19d019cd20 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:36.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.141+0000 7f19d5622640 1 --2- 172.21.15.19:0/3470112335 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19d01036e0 0x7f19d0198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:36.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.141+0000 7f19d5622640 1 --2- 172.21.15.19:0/3470112335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19d0102dc0 0x7f19d0198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:36.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.141+0000 7f19d5622640 1 -- 172.21.15.19:0/3470112335 >> 172.21.15.19:0/3470112335 conn(0x7f19d00fc7a0 msgr2=0x7f19d00fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:36.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.141+0000 7f19d5622640 1 -- 172.21.15.19:0/3470112335 shutdown_connections 2024-09-19T08:51:36.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:36.141+0000 7f19d5622640 1 -- 172.21.15.19:0/3470112335 wait complete. 2024-09-19T08:51:36.858 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T08:51:37.116 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:37.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.602+0000 7fc6f9f9d640 1 -- 172.21.15.19:0/3216256551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6f4102790 msgr2=0x7fc6f41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:37.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.602+0000 7fc6f9f9d640 1 --2- 172.21.15.19:0/3216256551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6f4102790 0x7fc6f41067e0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8009900 tx=0x7fc6e802a410 comp rx=0 tx=0).stop 2024-09-19T08:51:37.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.602+0000 7fc6f9f9d640 1 -- 172.21.15.19:0/3216256551 shutdown_connections 2024-09-19T08:51:37.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.602+0000 7fc6f9f9d640 1 --2- 172.21.15.19:0/3216256551 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6f4106f10 0x7fc6f410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:37.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.602+0000 7fc6f9f9d640 1 --2- 172.21.15.19:0/3216256551 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6f4102790 0x7fc6f41067e0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:37.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.602+0000 7fc6f9f9d640 1 --2- 172.21.15.19:0/3216256551 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6f4101de0 0x7fc6f41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:37.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.602+0000 7fc6f9f9d640 1 -- 172.21.15.19:0/3216256551 >> 172.21.15.19:0/3216256551 conn(0x7fc6f40fd8c0 msgr2=0x7fc6f40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:37.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.602+0000 7fc6f9f9d640 1 -- 172.21.15.19:0/3216256551 shutdown_connections 2024-09-19T08:51:37.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.602+0000 7fc6f9f9d640 1 -- 172.21.15.19:0/3216256551 wait complete. 2024-09-19T08:51:37.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.603+0000 7fc6f9f9d640 1 Processor -- start 2024-09-19T08:51:37.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.603+0000 7fc6f9f9d640 1 -- start start 2024-09-19T08:51:37.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.603+0000 7fc6f9f9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6f4101de0 0x7fc6f4198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:37.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.603+0000 7fc6f9f9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6f4102790 0x7fc6f41988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:37.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.603+0000 7fc6f9f9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6f4106f10 0x7fc6f419cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:37.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.603+0000 7fc6f9f9d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f4111f70 con 0x7fc6f4102790 2024-09-19T08:51:37.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.603+0000 7fc6f9f9d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f4111df0 con 0x7fc6f4106f10 2024-09-19T08:51:37.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.603+0000 7fc6f9f9d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc6f41120f0 con 0x7fc6f4101de0 2024-09-19T08:51:37.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.604+0000 7fc6f2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6f4102790 0x7fc6f41988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:37.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.604+0000 7fc6f2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6f4102790 0x7fc6f41988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40674/0 (socket says 172.21.15.19:40674) 2024-09-19T08:51:37.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.604+0000 7fc6f2ffd640 1 -- 172.21.15.19:0/4084013124 learned_addr learned my addr 172.21.15.19:0/4084013124 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:37.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.604+0000 7fc6f37fe640 1 --2- 172.21.15.19:0/4084013124 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6f4101de0 0x7fc6f4198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:37.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.604+0000 7fc6f3fff640 1 --2- 172.21.15.19:0/4084013124 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6f4106f10 0x7fc6f419cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:37.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.604+0000 7fc6f2ffd640 1 -- 172.21.15.19:0/4084013124 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6f4101de0 msgr2=0x7fc6f4198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:37.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.604+0000 7fc6f2ffd640 1 --2- 172.21.15.19:0/4084013124 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6f4101de0 0x7fc6f4198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:37.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.604+0000 7fc6f2ffd640 1 -- 172.21.15.19:0/4084013124 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6f4106f10 msgr2=0x7fc6f419cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:37.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.604+0000 7fc6f2ffd640 1 --2- 172.21.15.19:0/4084013124 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6f4106f10 0x7fc6f419cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:37.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.604+0000 7fc6f2ffd640 1 -- 172.21.15.19:0/4084013124 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f419d310 con 0x7fc6f4102790 2024-09-19T08:51:37.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.604+0000 7fc6f3fff640 1 --2- 172.21.15.19:0/4084013124 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6f4106f10 0x7fc6f419cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:37.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.604+0000 7fc6f2ffd640 1 --2- 172.21.15.19:0/4084013124 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6f4102790 0x7fc6f41988a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8006010 tx=0x7fc6e80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:37.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.604+0000 7fc6f0ff9640 1 -- 172.21.15.19:0/4084013124 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e803f030 con 0x7fc6f4102790 2024-09-19T08:51:37.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.604+0000 7fc6f9f9d640 1 -- 172.21.15.19:0/4084013124 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6f419d5a0 con 0x7fc6f4102790 2024-09-19T08:51:37.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.604+0000 7fc6f0ff9640 1 -- 172.21.15.19:0/4084013124 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6e8003ce0 con 0x7fc6f4102790 2024-09-19T08:51:37.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.604+0000 7fc6f0ff9640 1 -- 172.21.15.19:0/4084013124 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e8035070 con 0x7fc6f4102790 2024-09-19T08:51:37.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.604+0000 7fc6f9f9d640 1 -- 172.21.15.19:0/4084013124 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6f41a4ee0 con 0x7fc6f4102790 2024-09-19T08:51:37.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.607+0000 7fc6f0ff9640 1 -- 172.21.15.19:0/4084013124 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc6e8042030 con 0x7fc6f4102790 2024-09-19T08:51:37.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.607+0000 7fc6fc376740 1 Processor -- start 2024-09-19T08:51:37.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.607+0000 7fc6fc376740 1 -- start start 2024-09-19T08:51:37.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.607+0000 7fc6fc376740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648c9eaf8d0 0x5648c9eafcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:37.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.607+0000 7fc6fc376740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648c9eb01f0 0x5648c9ebea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:37.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.607+0000 7fc6fc376740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648c9ebefc0 0x5648c9ec13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:37.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.607+0000 7fc6fc376740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5648c9e16090 con 0x5648c9eaf8d0 2024-09-19T08:51:37.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.607+0000 7fc6fc376740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5648c9dbda70 con 0x5648c9ebefc0 2024-09-19T08:51:37.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.607+0000 7fc6fc376740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5648c9e12050 con 0x5648c9eb01f0 2024-09-19T08:51:37.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.607+0000 7fc6f3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648c9eaf8d0 0x5648c9eafcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:37.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.607+0000 7fc6f3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648c9eaf8d0 0x5648c9eafcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40684/0 (socket says 172.21.15.19:40684) 2024-09-19T08:51:37.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.607+0000 7fc6f3fff640 1 -- 172.21.15.19:0/3500903302 learned_addr learned my addr 172.21.15.19:0/3500903302 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:37.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.608+0000 7fc6f0ff9640 1 --2- 172.21.15.19:0/4084013124 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc6dc0a32d0 0x7fc6dc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:37.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.608+0000 7fc6f37fe640 1 --2- 172.21.15.19:0/3500903302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648c9eb01f0 0x5648c9ebea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:37.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.608+0000 7fc6f2ffd640 1 --2- 172.21.15.19:0/3500903302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648c9ebefc0 0x5648c9ec13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:37.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.608+0000 7fc6f3fff640 1 -- 172.21.15.19:0/3500903302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648c9eb01f0 msgr2=0x5648c9ebea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:37.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.608+0000 7fc6f3fff640 1 --2- 172.21.15.19:0/3500903302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648c9eb01f0 0x5648c9ebea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:37.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.608+0000 7fc6f3fff640 1 -- 172.21.15.19:0/3500903302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648c9ebefc0 msgr2=0x5648c9ec13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:37.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.608+0000 7fc6f3fff640 1 --2- 172.21.15.19:0/3500903302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648c9ebefc0 0x5648c9ec13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:37.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.608+0000 7fc6f3fff640 1 -- 172.21.15.19:0/3500903302 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648c9dca130 con 0x5648c9eaf8d0 2024-09-19T08:51:37.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.608+0000 7fc6f0ff9640 1 -- 172.21.15.19:0/4084013124 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc6e80efeb0 con 0x7fc6f4102790 2024-09-19T08:51:37.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.608+0000 7fc6f2ffd640 1 --2- 172.21.15.19:0/3500903302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648c9ebefc0 0x5648c9ec13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:51:37.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.608+0000 7fc6f3fff640 1 --2- 172.21.15.19:0/4084013124 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc6dc0a32d0 0x7fc6dc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:37.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.608+0000 7fc6f3fff640 1 --2- 172.21.15.19:0/3500903302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648c9eaf8d0 0x5648c9eafcb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec010420 tx=0x7fc6ec0108e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef73bbe2f09d405f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:37.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.608+0000 7fc6d9ffb640 1 -- 172.21.15.19:0/3500903302 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec023070 con 0x5648c9eaf8d0 2024-09-19T08:51:37.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.608+0000 7fc6d9ffb640 1 -- 172.21.15.19:0/3500903302 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6ec01c470 con 0x5648c9eaf8d0 2024-09-19T08:51:37.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.608+0000 7fc6d9ffb640 1 -- 172.21.15.19:0/3500903302 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec01d6a0 con 0x5648c9eaf8d0 2024-09-19T08:51:37.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.608+0000 7fc6f3fff640 1 --2- 172.21.15.19:0/4084013124 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc6dc0a32d0 0x7fc6dc0a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec020000 tx=0x7fc6ec01a000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:37.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.609+0000 7fc6fc376740 1 -- 172.21.15.19:0/3500903302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648c9eaf8d0 msgr2=0x5648c9eafcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:37.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.609+0000 7fc6fc376740 1 --2- 172.21.15.19:0/3500903302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648c9eaf8d0 0x5648c9eafcb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec010420 tx=0x7fc6ec0108e0 comp rx=0 tx=0).stop 2024-09-19T08:51:37.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.609+0000 7fc6fc376740 1 -- 172.21.15.19:0/3500903302 shutdown_connections 2024-09-19T08:51:37.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.609+0000 7fc6fc376740 1 --2- 172.21.15.19:0/3500903302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648c9eb01f0 0x5648c9ebea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:37.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.609+0000 7fc6fc376740 1 --2- 172.21.15.19:0/3500903302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648c9ebefc0 0x5648c9ec13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:37.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.609+0000 7fc6fc376740 1 --2- 172.21.15.19:0/3500903302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648c9eaf8d0 0x5648c9eafcb0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:37.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.609+0000 7fc6fc376740 1 -- 172.21.15.19:0/3500903302 >> 172.21.15.19:0/3500903302 conn(0x5648c9eabf60 msgr2=0x5648c9eac340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:37.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.609+0000 7fc6fc376740 1 -- 172.21.15.19:0/3500903302 shutdown_connections 2024-09-19T08:51:37.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.609+0000 7fc6fc376740 1 -- 172.21.15.19:0/3500903302 wait complete. 2024-09-19T08:51:37.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.609+0000 7fc6fc376740 1 -- start start 2024-09-19T08:51:37.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.610+0000 7fc6fc376740 1 Processor -- start 2024-09-19T08:51:37.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.610+0000 7fc6fc376740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648c9eaf8d0 0x5648c9ebe960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:37.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.610+0000 7fc6fc376740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648c9eb01f0 0x5648c9ebbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:37.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.610+0000 7fc6fc376740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648c9ebefc0 0x5648c9ebc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:37.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.610+0000 7fc6fc376740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5648c9ec1bf0 con 0x5648c9eb01f0 2024-09-19T08:51:37.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.610+0000 7fc6fc376740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5648c9dd0f20 con 0x5648c9ebefc0 2024-09-19T08:51:37.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.610+0000 7fc6fc376740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5648c9ec1d70 con 0x5648c9eaf8d0 2024-09-19T08:51:37.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.610+0000 7fc6fc376740 10 client.0 _ll_register_callbacks cb 0x5648c9d9a030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:37.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.610+0000 7fc6f2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648c9eb01f0 0x5648c9ebbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:37.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.610+0000 7fc6f2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648c9eb01f0 0x5648c9ebbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40694/0 (socket says 172.21.15.19:40694) 2024-09-19T08:51:37.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.610+0000 7fc6f2ffd640 1 -- 172.21.15.19:0/3850956910 learned_addr learned my addr 172.21.15.19:0/3850956910 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:37.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.610+0000 7fc6f3fff640 1 --2- 172.21.15.19:0/3850956910 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648c9ebefc0 0x5648c9ebc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:37.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.610+0000 7fc6f37fe640 1 --2- 172.21.15.19:0/3850956910 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648c9eaf8d0 0x5648c9ebe960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:37.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.610+0000 7fc6f2ffd640 1 -- 172.21.15.19:0/3850956910 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648c9eaf8d0 msgr2=0x5648c9ebe960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:37.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.610+0000 7fc6f2ffd640 1 --2- 172.21.15.19:0/3850956910 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648c9eaf8d0 0x5648c9ebe960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:37.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.610+0000 7fc6f2ffd640 1 -- 172.21.15.19:0/3850956910 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648c9ebefc0 msgr2=0x5648c9ebc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:37.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.610+0000 7fc6f2ffd640 1 --2- 172.21.15.19:0/3850956910 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648c9ebefc0 0x5648c9ebc1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:37.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.610+0000 7fc6f2ffd640 1 -- 172.21.15.19:0/3850956910 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648c9b872b0 con 0x5648c9eb01f0 2024-09-19T08:51:37.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.610+0000 7fc6f37fe640 1 --2- 172.21.15.19:0/3850956910 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648c9eaf8d0 0x5648c9ebe960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:37.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.611+0000 7fc6f2ffd640 1 --2- 172.21.15.19:0/3850956910 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648c9eb01f0 0x5648c9ebbc10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc6e80b8d50 tx=0x7fc6e8042fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b7fa03b621bde5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:37.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.611+0000 7fc6d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:51:37.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.611+0000 7fc6d2ffd640 1 -- 172.21.15.19:0/3850956910 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e8049040 con 0x5648c9eb01f0 2024-09-19T08:51:37.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.611+0000 7fc6d2ffd640 1 -- 172.21.15.19:0/3850956910 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc6e803bc40 con 0x5648c9eb01f0 2024-09-19T08:51:37.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.611+0000 7fc6fc376740 1 -- 172.21.15.19:0/3850956910 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6ec01c470 con 0x5648c9eb01f0 2024-09-19T08:51:37.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.611+0000 7fc6d2ffd640 1 -- 172.21.15.19:0/3850956910 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc6e80bbce0 con 0x5648c9eb01f0 2024-09-19T08:51:37.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.611+0000 7fc6fc376740 10 client.15033 fetch_fsmap learned FSMap version 27 2024-09-19T08:51:37.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.611+0000 7fc6fc376740 1 -- 172.21.15.19:0/3850956910 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5648c9ecd5b0 con 0x5648c9eb01f0 2024-09-19T08:51:37.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.611+0000 7fc6d2ffd640 1 -- 172.21.15.19:0/3850956910 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6ec01c470 con 0x5648c9eb01f0 2024-09-19T08:51:37.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.611+0000 7fc6d2ffd640 1 -- 172.21.15.19:0/3850956910 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fc6e80bc5e0 con 0x5648c9eb01f0 2024-09-19T08:51:37.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.611+0000 7fc6fc376740 10 client.15033 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T08:51:37.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.611+0000 7fc6fc376740 10 client.15033 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T08:51:37.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.611+0000 7fc6fc376740 20 client.15033 populate_metadata read hostname 'smithi019' 2024-09-19T08:51:37.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.611+0000 7fc6fc376740 1 --2- 172.21.15.19:0/3850956910 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x5648c9ecfc10 0x5648c9ed1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:37.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.611+0000 7fc6fc376740 4 client.15033 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:51:37.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.611+0000 7fc6fc376740 1 -- 172.21.15.19:0/3850956910 --> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648c9e23600 con 0x5648c9ecfc10 2024-09-19T08:51:37.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.612+0000 7fc6f37fe640 1 --2- 172.21.15.19:0/3850956910 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x5648c9ecfc10 0x5648c9ed1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:37.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.612+0000 7fc6d2ffd640 10 client.15033 ms_handle_connect on v2:172.21.15.203:6838/2547507299 2024-09-19T08:51:37.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.612+0000 7fc6f37fe640 1 --2- 172.21.15.19:0/3850956910 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x5648c9ecfc10 0x5648c9ed1080 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d8828f99653d427 server_cookie=67b495d562e142d6 in_seq=0 out_seq=0 2024-09-19T08:51:37.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.613+0000 7fc6d2ffd640 1 -- 172.21.15.19:0/3850956910 <== mds.1 v2:172.21.15.203:6838/2547507299 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5648c9e23600 con 0x5648c9ecfc10 2024-09-19T08:51:37.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.613+0000 7fc6d2ffd640 10 client.15033 handle_command_reply: tid=0 2024-09-19T08:51:37.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.613+0000 7fc6fc376740 1 client.15033 shutdown 2024-09-19T08:51:37.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.613+0000 7fc6fc376740 1 -- 172.21.15.19:0/3850956910 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648c9eb01f0 msgr2=0x5648c9ebbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:37.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.613+0000 7fc6fc376740 1 --2- 172.21.15.19:0/3850956910 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648c9eb01f0 0x5648c9ebbc10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fc6e80b8d50 tx=0x7fc6e8042fd0 comp rx=0 tx=0).stop 2024-09-19T08:51:37.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.613+0000 7fc6fc376740 1 -- 172.21.15.19:0/3850956910 shutdown_connections 2024-09-19T08:51:37.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.613+0000 7fc6fc376740 1 --2- 172.21.15.19:0/3850956910 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x5648c9ecfc10 0x5648c9ed1080 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:37.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.613+0000 7fc6fc376740 1 --2- 172.21.15.19:0/3850956910 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648c9ebefc0 0x5648c9ebc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:37.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.613+0000 7fc6fc376740 1 --2- 172.21.15.19:0/3850956910 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648c9eb01f0 0x5648c9ebbc10 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:37.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.613+0000 7fc6d2ffd640 0 client.15033 ms_handle_reset on v2:172.21.15.203:6838/2547507299 2024-09-19T08:51:37.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.613+0000 7fc6fc376740 1 --2- 172.21.15.19:0/3850956910 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648c9eaf8d0 0x5648c9ebe960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:37.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.613+0000 7fc6fc376740 1 -- 172.21.15.19:0/3850956910 >> 172.21.15.19:0/3850956910 conn(0x5648c9eabf60 msgr2=0x5648c9eb1cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:37.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.613+0000 7fc6fc376740 1 -- 172.21.15.19:0/3850956910 shutdown_connections 2024-09-19T08:51:37.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.613+0000 7fc6fc376740 1 -- 172.21.15.19:0/3850956910 wait complete. 2024-09-19T08:51:37.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.613+0000 7fc6fc376740 20 client.15033 trim_cache size 0 max 16384 2024-09-19T08:51:37.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.632+0000 7fc6fc376740 1 Processor -- start 2024-09-19T08:51:37.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.632+0000 7fc6fc376740 1 -- start start 2024-09-19T08:51:37.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.632+0000 7fc6fc376740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648c9eaf8d0 0x5648c9ecb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:37.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.632+0000 7fc6fc376740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648c9eb01f0 0x5648c9ed09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:37.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.632+0000 7fc6fc376740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648c9ebefc0 0x5648c9ecf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:37.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.632+0000 7fc6fc376740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5648c9ecf3c0 con 0x5648c9eb01f0 2024-09-19T08:51:37.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.632+0000 7fc6fc376740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5648c9ecfa90 con 0x5648c9ebefc0 2024-09-19T08:51:37.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.632+0000 7fc6fc376740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5648c9ed0160 con 0x5648c9eaf8d0 2024-09-19T08:51:37.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.632+0000 7fc6f2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648c9eb01f0 0x5648c9ed09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:37.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.632+0000 7fc6f2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648c9eb01f0 0x5648c9ed09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40698/0 (socket says 172.21.15.19:40698) 2024-09-19T08:51:37.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.632+0000 7fc6f2ffd640 1 -- 172.21.15.19:0/3164454523 learned_addr learned my addr 172.21.15.19:0/3164454523 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:37.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.632+0000 7fc6f37fe640 1 --2- 172.21.15.19:0/3164454523 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648c9eaf8d0 0x5648c9ecb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:37.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.632+0000 7fc6f3fff640 1 --2- 172.21.15.19:0/3164454523 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648c9ebefc0 0x5648c9ecf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:37.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.632+0000 7fc6f2ffd640 1 -- 172.21.15.19:0/3164454523 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648c9eaf8d0 msgr2=0x5648c9ecb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:37.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.632+0000 7fc6f2ffd640 1 --2- 172.21.15.19:0/3164454523 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648c9eaf8d0 0x5648c9ecb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:37.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.632+0000 7fc6f2ffd640 1 -- 172.21.15.19:0/3164454523 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648c9ebefc0 msgr2=0x5648c9ecf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:37.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.632+0000 7fc6f2ffd640 1 --2- 172.21.15.19:0/3164454523 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648c9ebefc0 0x5648c9ecf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:37.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.632+0000 7fc6f2ffd640 1 -- 172.21.15.19:0/3164454523 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648c9ec16f0 con 0x5648c9eb01f0 2024-09-19T08:51:37.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.632+0000 7fc6f2ffd640 1 --2- 172.21.15.19:0/3164454523 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648c9eb01f0 0x5648c9ed09b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc6e80c4ac0 tx=0x7fc6e802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=842537d13e546881 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:37.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.633+0000 7fc6d97fa640 1 -- 172.21.15.19:0/3164454523 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e8049070 con 0x5648c9eb01f0 2024-09-19T08:51:37.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.633+0000 7fc6d97fa640 1 -- 172.21.15.19:0/3164454523 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6e803b510 con 0x5648c9eb01f0 2024-09-19T08:51:37.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.633+0000 7fc6d97fa640 1 -- 172.21.15.19:0/3164454523 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6e80044e0 con 0x5648c9eb01f0 2024-09-19T08:51:37.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.633+0000 7fc6fc376740 1 -- 172.21.15.19:0/3164454523 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648c9eb01f0 msgr2=0x5648c9ed09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:37.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.633+0000 7fc6fc376740 1 --2- 172.21.15.19:0/3164454523 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648c9eb01f0 0x5648c9ed09b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc6e80c4ac0 tx=0x7fc6e802a410 comp rx=0 tx=0).stop 2024-09-19T08:51:37.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.633+0000 7fc6fc376740 1 -- 172.21.15.19:0/3164454523 shutdown_connections 2024-09-19T08:51:37.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.633+0000 7fc6fc376740 1 --2- 172.21.15.19:0/3164454523 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648c9ebefc0 0x5648c9ecf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:37.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.633+0000 7fc6fc376740 1 --2- 172.21.15.19:0/3164454523 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648c9eb01f0 0x5648c9ed09b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:37.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.633+0000 7fc6fc376740 1 --2- 172.21.15.19:0/3164454523 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648c9eaf8d0 0x5648c9ecb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:37.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.633+0000 7fc6fc376740 1 -- 172.21.15.19:0/3164454523 >> 172.21.15.19:0/3164454523 conn(0x5648c9eabf60 msgr2=0x5648c9eac340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:37.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.633+0000 7fc6fc376740 1 -- 172.21.15.19:0/3164454523 shutdown_connections 2024-09-19T08:51:37.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.633+0000 7fc6fc376740 1 -- 172.21.15.19:0/3164454523 wait complete. 2024-09-19T08:51:37.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.634+0000 7fc6fc376740 1 -- start start 2024-09-19T08:51:37.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.634+0000 7fc6fc376740 1 Processor -- start 2024-09-19T08:51:37.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.634+0000 7fc6fc376740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648c9eaf8d0 0x5648c9ed27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:37.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.634+0000 7fc6fc376740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648c9eb01f0 0x5648c9ed2d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:37.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.634+0000 7fc6fc376740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648c9ebefc0 0x5648c9f38310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:37.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.634+0000 7fc6fc376740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5648c9ed0f00 con 0x5648c9ebefc0 2024-09-19T08:51:37.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.634+0000 7fc6fc376740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5648c9ed0830 con 0x5648c9eb01f0 2024-09-19T08:51:37.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.634+0000 7fc6fc376740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5648c9ed15d0 con 0x5648c9eaf8d0 2024-09-19T08:51:37.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.634+0000 7fc6fc376740 10 client.0 _ll_register_callbacks cb 0x7fc6e80314b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:37.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.634+0000 7fc6f3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648c9ebefc0 0x5648c9f38310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:37.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.634+0000 7fc6f3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648c9ebefc0 0x5648c9f38310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40708/0 (socket says 172.21.15.19:40708) 2024-09-19T08:51:37.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.634+0000 7fc6f3fff640 1 -- 172.21.15.19:0/4105418677 learned_addr learned my addr 172.21.15.19:0/4105418677 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:37.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.634+0000 7fc6f2ffd640 1 --2- 172.21.15.19:0/4105418677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648c9eb01f0 0x5648c9ed2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:37.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.635+0000 7fc6f37fe640 1 --2- 172.21.15.19:0/4105418677 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648c9eaf8d0 0x5648c9ed27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:37.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.635+0000 7fc6f3fff640 1 -- 172.21.15.19:0/4105418677 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648c9eaf8d0 msgr2=0x5648c9ed27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:37.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.635+0000 7fc6f3fff640 1 --2- 172.21.15.19:0/4105418677 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648c9eaf8d0 0x5648c9ed27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:37.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.635+0000 7fc6f3fff640 1 -- 172.21.15.19:0/4105418677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648c9eb01f0 msgr2=0x5648c9ed2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:37.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.635+0000 7fc6f3fff640 1 --2- 172.21.15.19:0/4105418677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648c9eb01f0 0x5648c9ed2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:37.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.635+0000 7fc6f3fff640 1 -- 172.21.15.19:0/4105418677 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648c9f38850 con 0x5648c9ebefc0 2024-09-19T08:51:37.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.635+0000 7fc6f3fff640 1 --2- 172.21.15.19:0/4105418677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648c9ebefc0 0x5648c9f38310 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec0103f0 tx=0x7fc6ec01ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e699314e8c872add server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:37.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.635+0000 7fc6d2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:51:37.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.635+0000 7fc6d2ffd640 1 -- 172.21.15.19:0/4105418677 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec023040 con 0x5648c9ebefc0 2024-09-19T08:51:37.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.635+0000 7fc6d2ffd640 1 -- 172.21.15.19:0/4105418677 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc6ec01db00 con 0x5648c9ebefc0 2024-09-19T08:51:37.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.635+0000 7fc6fc376740 1 -- 172.21.15.19:0/4105418677 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5648c9e1db10 con 0x5648c9ebefc0 2024-09-19T08:51:37.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.635+0000 7fc6d2ffd640 1 -- 172.21.15.19:0/4105418677 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fc6ec01dd00 con 0x5648c9ebefc0 2024-09-19T08:51:37.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.635+0000 7fc6fc376740 10 client.15039 fetch_fsmap learned FSMap version 27 2024-09-19T08:51:37.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.635+0000 7fc6fc376740 1 -- 172.21.15.19:0/4105418677 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5648c9f39a60 con 0x5648c9ebefc0 2024-09-19T08:51:37.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.635+0000 7fc6d2ffd640 1 -- 172.21.15.19:0/4105418677 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5648c9e1db10 con 0x5648c9ebefc0 2024-09-19T08:51:37.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.636+0000 7fc6d2ffd640 1 -- 172.21.15.19:0/4105418677 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fc6ec00f040 con 0x5648c9ebefc0 2024-09-19T08:51:37.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.636+0000 7fc6fc376740 10 client.15039 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T08:51:37.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.636+0000 7fc6fc376740 10 client.15039 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T08:51:37.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.636+0000 7fc6fc376740 20 client.15039 populate_metadata read hostname 'smithi019' 2024-09-19T08:51:37.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.636+0000 7fc6fc376740 1 --2- 172.21.15.19:0/4105418677 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x5648c9f3e4e0 0x5648c9f3d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:37.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.636+0000 7fc6fc376740 4 client.15039 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T08:51:37.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.636+0000 7fc6fc376740 1 -- 172.21.15.19:0/4105418677 --> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] -- command(tid 0: {"prefix": "status"}) -- 0x5648c9d9a0e0 con 0x5648c9f3e4e0 2024-09-19T08:51:37.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.636+0000 7fc6f37fe640 1 --2- 172.21.15.19:0/4105418677 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x5648c9f3e4e0 0x5648c9f3d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:37.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.636+0000 7fc6d2ffd640 10 client.15039 ms_handle_connect on v2:172.21.15.203:6838/2547507299 2024-09-19T08:51:37.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.636+0000 7fc6f37fe640 1 --2- 172.21.15.19:0/4105418677 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x5648c9f3e4e0 0x5648c9f3d1f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3bef8a69e713016b server_cookie=a88464adf5ccde58 in_seq=0 out_seq=0 2024-09-19T08:51:37.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.637+0000 7fc6d2ffd640 1 -- 172.21.15.19:0/4105418677 <== mds.1 v2:172.21.15.203:6838/2547507299 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5648c9d9a0e0 con 0x5648c9f3e4e0 2024-09-19T08:51:37.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.637+0000 7fc6d2ffd640 10 client.15039 handle_command_reply: tid=0 2024-09-19T08:51:37.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.637+0000 7fc6fc376740 1 client.15039 shutdown 2024-09-19T08:51:37.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.637+0000 7fc6fc376740 1 -- 172.21.15.19:0/4105418677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648c9ebefc0 msgr2=0x5648c9f38310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:37.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.637+0000 7fc6fc376740 1 --2- 172.21.15.19:0/4105418677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648c9ebefc0 0x5648c9f38310 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec0103f0 tx=0x7fc6ec01ce50 comp rx=0 tx=0).stop 2024-09-19T08:51:37.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.637+0000 7fc6fc376740 1 -- 172.21.15.19:0/4105418677 shutdown_connections 2024-09-19T08:51:37.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.637+0000 7fc6fc376740 1 --2- 172.21.15.19:0/4105418677 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x5648c9f3e4e0 0x5648c9f3d1f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:37.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.637+0000 7fc6d2ffd640 0 client.15039 ms_handle_reset on v2:172.21.15.203:6838/2547507299 2024-09-19T08:51:37.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.637+0000 7fc6fc376740 1 --2- 172.21.15.19:0/4105418677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648c9ebefc0 0x5648c9f38310 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:37.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.637+0000 7fc6fc376740 1 --2- 172.21.15.19:0/4105418677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648c9eb01f0 0x5648c9ed2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:37.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.637+0000 7fc6fc376740 1 --2- 172.21.15.19:0/4105418677 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648c9eaf8d0 0x5648c9ed27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:37.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.637+0000 7fc6fc376740 1 -- 172.21.15.19:0/4105418677 >> 172.21.15.19:0/4105418677 conn(0x5648c9eabf60 msgr2=0x5648c9eb6a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:37.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.637+0000 7fc6fc376740 1 -- 172.21.15.19:0/4105418677 shutdown_connections 2024-09-19T08:51:37.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.637+0000 7fc6fc376740 1 -- 172.21.15.19:0/4105418677 wait complete. 2024-09-19T08:51:37.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.637+0000 7fc6fc376740 20 client.15039 trim_cache size 0 max 16384 2024-09-19T08:51:37.642 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:51:37.642 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "f26c9d84-7662-11ef-bceb-c7b262605968", 2024-09-19T08:51:37.642 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 1, 2024-09-19T08:51:37.642 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 24490, 2024-09-19T08:51:37.642 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-19T08:51:37.642 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-19T08:51:37.642 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-19T08:51:37.642 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 73.726209033000004, 2024-09-19T08:51:37.642 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 27, 2024-09-19T08:51:37.642 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 82, 2024-09-19T08:51:37.643 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 80, 2024-09-19T08:51:37.643 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 100.966997878 2024-09-19T08:51:37.643 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:51:37.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.638+0000 7fc6f9f9d640 1 -- 172.21.15.19:0/4084013124 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc6dc0a32d0 msgr2=0x7fc6dc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:37.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.638+0000 7fc6f9f9d640 1 --2- 172.21.15.19:0/4084013124 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc6dc0a32d0 0x7fc6dc0a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec020000 tx=0x7fc6ec01a000 comp rx=0 tx=0).stop 2024-09-19T08:51:37.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.638+0000 7fc6f9f9d640 1 -- 172.21.15.19:0/4084013124 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6f4102790 msgr2=0x7fc6f41988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:37.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.638+0000 7fc6f9f9d640 1 --2- 172.21.15.19:0/4084013124 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6f4102790 0x7fc6f41988a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc6e8006010 tx=0x7fc6e80042f0 comp rx=0 tx=0).stop 2024-09-19T08:51:37.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.638+0000 7fc6f9f9d640 1 -- 172.21.15.19:0/4084013124 shutdown_connections 2024-09-19T08:51:37.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.638+0000 7fc6f9f9d640 1 --2- 172.21.15.19:0/4084013124 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc6dc0a32d0 0x7fc6dc0a5790 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:37.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.638+0000 7fc6f9f9d640 1 --2- 172.21.15.19:0/4084013124 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6f4106f10 0x7fc6f419cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:37.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.638+0000 7fc6f9f9d640 1 --2- 172.21.15.19:0/4084013124 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6f4102790 0x7fc6f41988a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:37.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.638+0000 7fc6f9f9d640 1 --2- 172.21.15.19:0/4084013124 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6f4101de0 0x7fc6f4198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:37.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.638+0000 7fc6f9f9d640 1 -- 172.21.15.19:0/4084013124 >> 172.21.15.19:0/4084013124 conn(0x7fc6f40fd8c0 msgr2=0x7fc6f40fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:37.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.638+0000 7fc6f9f9d640 1 -- 172.21.15.19:0/4084013124 shutdown_connections 2024-09-19T08:51:37.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:37.638+0000 7fc6f9f9d640 1 -- 172.21.15.19:0/4084013124 wait complete. 2024-09-19T08:51:37.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:37 smithi019 ceph-mon[30976]: pgmap v319: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 9 B/s, 0 objects/s recovering 2024-09-19T08:51:37.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:37 smithi155 ceph-mon[34921]: pgmap v319: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 9 B/s, 0 objects/s recovering 2024-09-19T08:51:37.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:37 smithi203 ceph-mon[35450]: pgmap v319: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 9 B/s, 0 objects/s recovering 2024-09-19T08:51:38.310 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T08:51:38.567 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:39.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.043+0000 7fd38a42a640 1 -- 172.21.15.19:0/2556399147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd384103ff0 msgr2=0x7fd3841043d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:39.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.043+0000 7fd38a42a640 1 --2- 172.21.15.19:0/2556399147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd384103ff0 0x7fd3841043d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd374009900 tx=0x7fd37402a410 comp rx=0 tx=0).stop 2024-09-19T08:51:39.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.044+0000 7fd38a42a640 1 -- 172.21.15.19:0/2556399147 shutdown_connections 2024-09-19T08:51:39.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.044+0000 7fd38a42a640 1 --2- 172.21.15.19:0/2556399147 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3841049a0 0x7fd3841089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.044+0000 7fd38a42a640 1 --2- 172.21.15.19:0/2556399147 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd384109120 0x7fd384110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.044+0000 7fd38a42a640 1 --2- 172.21.15.19:0/2556399147 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd384103ff0 0x7fd3841043d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.044+0000 7fd38a42a640 1 -- 172.21.15.19:0/2556399147 >> 172.21.15.19:0/2556399147 conn(0x7fd3840ffa90 msgr2=0x7fd384101eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:39.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.044+0000 7fd38a42a640 1 -- 172.21.15.19:0/2556399147 shutdown_connections 2024-09-19T08:51:39.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.044+0000 7fd38a42a640 1 -- 172.21.15.19:0/2556399147 wait complete. 2024-09-19T08:51:39.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.044+0000 7fd38a42a640 1 Processor -- start 2024-09-19T08:51:39.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.044+0000 7fd38a42a640 1 -- start start 2024-09-19T08:51:39.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.045+0000 7fd38a42a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd384103ff0 0x7fd38419a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:39.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.045+0000 7fd38a42a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3841049a0 0x7fd38419ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:39.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.045+0000 7fd38a42a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd384109120 0x7fd38419eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:39.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.045+0000 7fd38a42a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd384114120 con 0x7fd384103ff0 2024-09-19T08:51:39.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.045+0000 7fd38a42a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd384113fa0 con 0x7fd384109120 2024-09-19T08:51:39.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.045+0000 7fd38a42a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd3841142a0 con 0x7fd3841049a0 2024-09-19T08:51:39.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.045+0000 7fd383fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd384103ff0 0x7fd38419a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:39.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.045+0000 7fd383fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd384103ff0 0x7fd38419a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40732/0 (socket says 172.21.15.19:40732) 2024-09-19T08:51:39.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.045+0000 7fd383fff640 1 -- 172.21.15.19:0/1705023160 learned_addr learned my addr 172.21.15.19:0/1705023160 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:39.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.045+0000 7fd3889c7640 1 --2- 172.21.15.19:0/1705023160 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd384109120 0x7fd38419eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:39.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.045+0000 7fd3837fe640 1 --2- 172.21.15.19:0/1705023160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3841049a0 0x7fd38419ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:39.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.045+0000 7fd383fff640 1 -- 172.21.15.19:0/1705023160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3841049a0 msgr2=0x7fd38419ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:39.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.045+0000 7fd383fff640 1 --2- 172.21.15.19:0/1705023160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3841049a0 0x7fd38419ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.045+0000 7fd383fff640 1 -- 172.21.15.19:0/1705023160 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd384109120 msgr2=0x7fd38419eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:39.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.045+0000 7fd383fff640 1 --2- 172.21.15.19:0/1705023160 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd384109120 0x7fd38419eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.045+0000 7fd383fff640 1 -- 172.21.15.19:0/1705023160 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd38419f5d0 con 0x7fd384103ff0 2024-09-19T08:51:39.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.045+0000 7fd3889c7640 1 --2- 172.21.15.19:0/1705023160 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd384109120 0x7fd38419eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:39.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.045+0000 7fd383fff640 1 --2- 172.21.15.19:0/1705023160 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd384103ff0 0x7fd38419a620 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd374006010 tx=0x7fd3740042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:39.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.045+0000 7fd3817fa640 1 -- 172.21.15.19:0/1705023160 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37403f030 con 0x7fd384103ff0 2024-09-19T08:51:39.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.045+0000 7fd3817fa640 1 -- 172.21.15.19:0/1705023160 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd374003ce0 con 0x7fd384103ff0 2024-09-19T08:51:39.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.045+0000 7fd38a42a640 1 -- 172.21.15.19:0/1705023160 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd38419f860 con 0x7fd384103ff0 2024-09-19T08:51:39.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.045+0000 7fd3817fa640 1 -- 172.21.15.19:0/1705023160 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd374035070 con 0x7fd384103ff0 2024-09-19T08:51:39.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.045+0000 7fd38a42a640 1 -- 172.21.15.19:0/1705023160 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3841a71a0 con 0x7fd384103ff0 2024-09-19T08:51:39.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.048+0000 7fd3817fa640 1 -- 172.21.15.19:0/1705023160 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd374042030 con 0x7fd384103ff0 2024-09-19T08:51:39.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.048+0000 7fd38c803740 1 Processor -- start 2024-09-19T08:51:39.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.048+0000 7fd38c803740 1 -- start start 2024-09-19T08:51:39.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.048+0000 7fd38c803740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f65f78f9d0 0x55f65f78fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:39.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.048+0000 7fd38c803740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f65f7902f0 0x55f65f79a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:39.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.048+0000 7fd38c803740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65f79abb0 0x55f65f79cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:39.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.048+0000 7fd38c803740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f65f6f6090 con 0x55f65f78f9d0 2024-09-19T08:51:39.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.048+0000 7fd38c803740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f65f69da70 con 0x55f65f7902f0 2024-09-19T08:51:39.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.048+0000 7fd38c803740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f65f6f2050 con 0x55f65f79abb0 2024-09-19T08:51:39.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.048+0000 7fd3889c7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f65f78f9d0 0x55f65f78fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:39.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.048+0000 7fd3889c7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f65f78f9d0 0x55f65f78fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40740/0 (socket says 172.21.15.19:40740) 2024-09-19T08:51:39.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.048+0000 7fd3889c7640 1 -- 172.21.15.19:0/1316409237 learned_addr learned my addr 172.21.15.19:0/1316409237 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:39.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.049+0000 7fd383fff640 1 --2- 172.21.15.19:0/1316409237 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f65f7902f0 0x55f65f79a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:39.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.049+0000 7fd3837fe640 1 --2- 172.21.15.19:0/1316409237 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65f79abb0 0x55f65f79cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:39.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.049+0000 7fd3817fa640 1 --2- 172.21.15.19:0/1705023160 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd36c0a32d0 0x7fd36c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:39.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.049+0000 7fd3889c7640 1 -- 172.21.15.19:0/1316409237 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65f79abb0 msgr2=0x55f65f79cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:39.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.049+0000 7fd3889c7640 1 --2- 172.21.15.19:0/1316409237 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65f79abb0 0x55f65f79cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.049+0000 7fd3889c7640 1 -- 172.21.15.19:0/1316409237 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f65f7902f0 msgr2=0x55f65f79a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:39.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.049+0000 7fd3889c7640 1 --2- 172.21.15.19:0/1316409237 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f65f7902f0 0x55f65f79a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.049+0000 7fd3889c7640 1 -- 172.21.15.19:0/1316409237 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f65f6aa130 con 0x55f65f78f9d0 2024-09-19T08:51:39.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.049+0000 7fd383fff640 1 --2- 172.21.15.19:0/1316409237 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f65f7902f0 0x55f65f79a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:39.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.049+0000 7fd3817fa640 1 -- 172.21.15.19:0/1705023160 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd3740effd0 con 0x7fd384103ff0 2024-09-19T08:51:39.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.049+0000 7fd3889c7640 1 --2- 172.21.15.19:0/1316409237 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f65f78f9d0 0x55f65f78fdb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd37c009fd0 tx=0x7fd37c010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c710dbebab6c7141 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:39.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.049+0000 7fd3889c7640 1 --2- 172.21.15.19:0/1705023160 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd36c0a32d0 0x7fd36c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:39.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.049+0000 7fd36a7fc640 1 -- 172.21.15.19:0/1316409237 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37c011860 con 0x55f65f78f9d0 2024-09-19T08:51:39.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.049+0000 7fd36a7fc640 1 -- 172.21.15.19:0/1316409237 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd37c011c20 con 0x55f65f78f9d0 2024-09-19T08:51:39.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.049+0000 7fd36a7fc640 1 -- 172.21.15.19:0/1316409237 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37c01a830 con 0x55f65f78f9d0 2024-09-19T08:51:39.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.050+0000 7fd38c803740 1 -- 172.21.15.19:0/1316409237 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f65f78f9d0 msgr2=0x55f65f78fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:39.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.050+0000 7fd3889c7640 1 --2- 172.21.15.19:0/1705023160 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd36c0a32d0 0x7fd36c0a5790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd37c011010 tx=0x7fd37c01af30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:39.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.050+0000 7fd38c803740 1 --2- 172.21.15.19:0/1316409237 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f65f78f9d0 0x55f65f78fdb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd37c009fd0 tx=0x7fd37c010860 comp rx=0 tx=0).stop 2024-09-19T08:51:39.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.050+0000 7fd38c803740 1 -- 172.21.15.19:0/1316409237 shutdown_connections 2024-09-19T08:51:39.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.050+0000 7fd38c803740 1 --2- 172.21.15.19:0/1316409237 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65f79abb0 0x55f65f79cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.050+0000 7fd38c803740 1 --2- 172.21.15.19:0/1316409237 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f65f7902f0 0x55f65f79a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.050+0000 7fd38c803740 1 --2- 172.21.15.19:0/1316409237 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f65f78f9d0 0x55f65f78fdb0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.050+0000 7fd38c803740 1 -- 172.21.15.19:0/1316409237 >> 172.21.15.19:0/1316409237 conn(0x55f65f78bf60 msgr2=0x55f65f78c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:39.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.050+0000 7fd38c803740 1 -- 172.21.15.19:0/1316409237 shutdown_connections 2024-09-19T08:51:39.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.050+0000 7fd38c803740 1 -- 172.21.15.19:0/1316409237 wait complete. 2024-09-19T08:51:39.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.050+0000 7fd38c803740 1 -- start start 2024-09-19T08:51:39.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.051+0000 7fd38c803740 1 Processor -- start 2024-09-19T08:51:39.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.051+0000 7fd38c803740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f65f78f9d0 0x55f65f79a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:39.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.051+0000 7fd38c803740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f65f7902f0 0x55f65f797780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:39.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.051+0000 7fd38c803740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65f79abb0 0x55f65f797cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:39.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.051+0000 7fd38c803740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f65f79d780 con 0x55f65f78f9d0 2024-09-19T08:51:39.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.051+0000 7fd38c803740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f65f6b0f20 con 0x55f65f7902f0 2024-09-19T08:51:39.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.051+0000 7fd38c803740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f65f79d900 con 0x55f65f79abb0 2024-09-19T08:51:39.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.051+0000 7fd38c803740 10 client.0 _ll_register_callbacks cb 0x55f65f67a030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:39.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.051+0000 7fd383fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f65f78f9d0 0x55f65f79a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:39.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.051+0000 7fd383fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f65f78f9d0 0x55f65f79a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40752/0 (socket says 172.21.15.19:40752) 2024-09-19T08:51:39.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.051+0000 7fd383fff640 1 -- 172.21.15.19:0/2475387676 learned_addr learned my addr 172.21.15.19:0/2475387676 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:39.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.051+0000 7fd3837fe640 1 --2- 172.21.15.19:0/2475387676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f65f7902f0 0x55f65f797780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:39.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.051+0000 7fd383fff640 1 -- 172.21.15.19:0/2475387676 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65f79abb0 msgr2=0x55f65f797cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:39.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.051+0000 7fd383fff640 1 --2- 172.21.15.19:0/2475387676 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65f79abb0 0x55f65f797cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.051+0000 7fd383fff640 1 -- 172.21.15.19:0/2475387676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f65f7902f0 msgr2=0x55f65f797780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:39.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.051+0000 7fd383fff640 1 --2- 172.21.15.19:0/2475387676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f65f7902f0 0x55f65f797780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.051+0000 7fd383fff640 1 -- 172.21.15.19:0/2475387676 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f65f4672b0 con 0x55f65f78f9d0 2024-09-19T08:51:39.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.051+0000 7fd3837fe640 1 --2- 172.21.15.19:0/2475387676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f65f7902f0 0x55f65f797780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:39.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.051+0000 7fd383fff640 1 --2- 172.21.15.19:0/2475387676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f65f78f9d0 0x55f65f79a430 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd3740b8fd0 tx=0x7fd37403b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc4f151c66ad84ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:39.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.051+0000 7fd3637fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:51:39.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.052+0000 7fd3637fe640 1 -- 172.21.15.19:0/2475387676 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3740b8050 con 0x55f65f78f9d0 2024-09-19T08:51:39.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.052+0000 7fd3637fe640 1 -- 172.21.15.19:0/2475387676 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd3740f2110 con 0x55f65f78f9d0 2024-09-19T08:51:39.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.052+0000 7fd38c803740 1 -- 172.21.15.19:0/2475387676 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd37c011c20 con 0x55f65f78f9d0 2024-09-19T08:51:39.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.052+0000 7fd3637fe640 1 -- 172.21.15.19:0/2475387676 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd374049070 con 0x55f65f78f9d0 2024-09-19T08:51:39.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.052+0000 7fd38c803740 10 client.15051 fetch_fsmap learned FSMap version 27 2024-09-19T08:51:39.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.052+0000 7fd38c803740 1 -- 172.21.15.19:0/2475387676 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f65f7a9090 con 0x55f65f78f9d0 2024-09-19T08:51:39.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.052+0000 7fd3637fe640 1 -- 172.21.15.19:0/2475387676 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd37c011c20 con 0x55f65f78f9d0 2024-09-19T08:51:39.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.052+0000 7fd3637fe640 1 -- 172.21.15.19:0/2475387676 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fd3740bc860 con 0x55f65f78f9d0 2024-09-19T08:51:39.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.052+0000 7fd38c803740 10 client.15051 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T08:51:39.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.052+0000 7fd38c803740 10 client.15051 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T08:51:39.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.052+0000 7fd38c803740 20 client.15051 populate_metadata read hostname 'smithi019' 2024-09-19T08:51:39.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.052+0000 7fd38c803740 1 --2- 172.21.15.19:0/2475387676 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55f65f7ab740 0x55f65f7acbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:39.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.052+0000 7fd38c803740 4 client.15051 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:51:39.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.052+0000 7fd38c803740 1 -- 172.21.15.19:0/2475387676 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f65f703600 con 0x55f65f7ab740 2024-09-19T08:51:39.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.052+0000 7fd3837fe640 1 --2- 172.21.15.19:0/2475387676 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55f65f7ab740 0x55f65f7acbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:39.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.053+0000 7fd3837fe640 1 --2- 172.21.15.19:0/2475387676 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55f65f7ab740 0x55f65f7acbb0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e0903d20b919be0 server_cookie=46da8ba3d0a25709 in_seq=0 out_seq=0 2024-09-19T08:51:39.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.053+0000 7fd3637fe640 10 client.15051 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:51:39.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.054+0000 7fd3637fe640 1 -- 172.21.15.19:0/2475387676 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f65f703600 con 0x55f65f7ab740 2024-09-19T08:51:39.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.054+0000 7fd3637fe640 10 client.15051 handle_command_reply: tid=0 2024-09-19T08:51:39.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.054+0000 7fd38c803740 1 client.15051 shutdown 2024-09-19T08:51:39.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.054+0000 7fd38c803740 1 -- 172.21.15.19:0/2475387676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f65f78f9d0 msgr2=0x55f65f79a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:39.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.054+0000 7fd38c803740 1 --2- 172.21.15.19:0/2475387676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f65f78f9d0 0x55f65f79a430 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fd3740b8fd0 tx=0x7fd37403b460 comp rx=0 tx=0).stop 2024-09-19T08:51:39.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.054+0000 7fd38c803740 1 -- 172.21.15.19:0/2475387676 shutdown_connections 2024-09-19T08:51:39.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.054+0000 7fd38c803740 1 --2- 172.21.15.19:0/2475387676 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55f65f7ab740 0x55f65f7acbb0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.054+0000 7fd38c803740 1 --2- 172.21.15.19:0/2475387676 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65f79abb0 0x55f65f797cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.054+0000 7fd38c803740 1 --2- 172.21.15.19:0/2475387676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f65f7902f0 0x55f65f797780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.054+0000 7fd38c803740 1 --2- 172.21.15.19:0/2475387676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f65f78f9d0 0x55f65f79a430 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.054+0000 7fd3637fe640 0 client.15051 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:51:39.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.054+0000 7fd38c803740 1 -- 172.21.15.19:0/2475387676 >> 172.21.15.19:0/2475387676 conn(0x55f65f78bf60 msgr2=0x55f65f791c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:39.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.054+0000 7fd38c803740 1 -- 172.21.15.19:0/2475387676 shutdown_connections 2024-09-19T08:51:39.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.054+0000 7fd38c803740 1 -- 172.21.15.19:0/2475387676 wait complete. 2024-09-19T08:51:39.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.054+0000 7fd38c803740 20 client.15051 trim_cache size 0 max 16384 2024-09-19T08:51:39.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.072+0000 7fd38c803740 1 Processor -- start 2024-09-19T08:51:39.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.072+0000 7fd38c803740 1 -- start start 2024-09-19T08:51:39.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.072+0000 7fd38c803740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f65f78f9d0 0x55f65f797040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:39.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.072+0000 7fd38c803740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65f7902f0 0x55f65f796050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:39.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.072+0000 7fd38c803740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f65f79abb0 0x55f65f796590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:39.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.072+0000 7fd38c803740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f65f7aaef0 con 0x55f65f78f9d0 2024-09-19T08:51:39.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.072+0000 7fd38c803740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f65f7ab5c0 con 0x55f65f79abb0 2024-09-19T08:51:39.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.072+0000 7fd38c803740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f65f7abc90 con 0x55f65f7902f0 2024-09-19T08:51:39.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.072+0000 7fd383fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f65f78f9d0 0x55f65f797040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:39.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.072+0000 7fd383fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f65f78f9d0 0x55f65f797040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40760/0 (socket says 172.21.15.19:40760) 2024-09-19T08:51:39.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.072+0000 7fd383fff640 1 -- 172.21.15.19:0/2083883512 learned_addr learned my addr 172.21.15.19:0/2083883512 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:39.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.072+0000 7fd3889c7640 1 --2- 172.21.15.19:0/2083883512 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f65f79abb0 0x55f65f796590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:39.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.073+0000 7fd383fff640 1 -- 172.21.15.19:0/2083883512 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65f7902f0 msgr2=0x55f65f796050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:39.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.073+0000 7fd383fff640 1 --2- 172.21.15.19:0/2083883512 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65f7902f0 0x55f65f796050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.073+0000 7fd383fff640 1 -- 172.21.15.19:0/2083883512 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f65f79abb0 msgr2=0x55f65f796590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:39.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.073+0000 7fd383fff640 1 --2- 172.21.15.19:0/2083883512 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f65f79abb0 0x55f65f796590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.073+0000 7fd383fff640 1 -- 172.21.15.19:0/2083883512 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f65f78f800 con 0x55f65f78f9d0 2024-09-19T08:51:39.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.073+0000 7fd383fff640 1 --2- 172.21.15.19:0/2083883512 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f65f78f9d0 0x55f65f797040 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd3740d7040 tx=0x7fd374005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d2462474ad9c18 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:39.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.073+0000 7fd369ffb640 1 -- 172.21.15.19:0/2083883512 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3740bc3d0 con 0x55f65f78f9d0 2024-09-19T08:51:39.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.073+0000 7fd369ffb640 1 -- 172.21.15.19:0/2083883512 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3740dc040 con 0x55f65f78f9d0 2024-09-19T08:51:39.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.073+0000 7fd369ffb640 1 -- 172.21.15.19:0/2083883512 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3740bc650 con 0x55f65f78f9d0 2024-09-19T08:51:39.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.073+0000 7fd38c803740 1 -- 172.21.15.19:0/2083883512 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f65f78f9d0 msgr2=0x55f65f797040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:39.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.073+0000 7fd38c803740 1 --2- 172.21.15.19:0/2083883512 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f65f78f9d0 0x55f65f797040 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd3740d7040 tx=0x7fd374005e50 comp rx=0 tx=0).stop 2024-09-19T08:51:39.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.074+0000 7fd38c803740 1 -- 172.21.15.19:0/2083883512 shutdown_connections 2024-09-19T08:51:39.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.074+0000 7fd38c803740 1 --2- 172.21.15.19:0/2083883512 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65f7902f0 0x55f65f796050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.074+0000 7fd38c803740 1 --2- 172.21.15.19:0/2083883512 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f65f79abb0 0x55f65f796590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.074+0000 7fd38c803740 1 --2- 172.21.15.19:0/2083883512 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f65f78f9d0 0x55f65f797040 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.074+0000 7fd38c803740 1 -- 172.21.15.19:0/2083883512 >> 172.21.15.19:0/2083883512 conn(0x55f65f78bf60 msgr2=0x55f65f7aa3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:39.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.074+0000 7fd38c803740 1 -- 172.21.15.19:0/2083883512 shutdown_connections 2024-09-19T08:51:39.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.074+0000 7fd38c803740 1 -- 172.21.15.19:0/2083883512 wait complete. 2024-09-19T08:51:39.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.074+0000 7fd38c803740 1 -- start start 2024-09-19T08:51:39.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.074+0000 7fd38c803740 1 Processor -- start 2024-09-19T08:51:39.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.074+0000 7fd38c803740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f65f78f9d0 0x55f65f7ae3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:39.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.074+0000 7fd38c803740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f65f7902f0 0x55f65f7ae900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:39.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.074+0000 7fd38c803740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65f79abb0 0x55f65f813e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:39.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.074+0000 7fd38c803740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f65f7aca30 con 0x55f65f78f9d0 2024-09-19T08:51:39.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.074+0000 7fd38c803740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f65f7ac360 con 0x55f65f7902f0 2024-09-19T08:51:39.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.074+0000 7fd38c803740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f65f7ad100 con 0x55f65f79abb0 2024-09-19T08:51:39.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.074+0000 7fd38c803740 10 client.0 _ll_register_callbacks cb 0x7fd374005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:39.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.075+0000 7fd383fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f65f78f9d0 0x55f65f7ae3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:39.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.075+0000 7fd383fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f65f78f9d0 0x55f65f7ae3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40774/0 (socket says 172.21.15.19:40774) 2024-09-19T08:51:39.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.075+0000 7fd383fff640 1 -- 172.21.15.19:0/2030712449 learned_addr learned my addr 172.21.15.19:0/2030712449 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:39.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.075+0000 7fd3889c7640 1 --2- 172.21.15.19:0/2030712449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65f79abb0 0x55f65f813e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:39.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.075+0000 7fd3837fe640 1 --2- 172.21.15.19:0/2030712449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f65f7902f0 0x55f65f7ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:39.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.075+0000 7fd383fff640 1 -- 172.21.15.19:0/2030712449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65f79abb0 msgr2=0x55f65f813e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:39.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.075+0000 7fd383fff640 1 --2- 172.21.15.19:0/2030712449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65f79abb0 0x55f65f813e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.075+0000 7fd383fff640 1 -- 172.21.15.19:0/2030712449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f65f7902f0 msgr2=0x55f65f7ae900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:39.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.075+0000 7fd383fff640 1 --2- 172.21.15.19:0/2030712449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f65f7902f0 0x55f65f7ae900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.075+0000 7fd383fff640 1 -- 172.21.15.19:0/2030712449 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f65f814380 con 0x55f65f78f9d0 2024-09-19T08:51:39.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.075+0000 7fd3889c7640 1 --2- 172.21.15.19:0/2030712449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65f79abb0 0x55f65f813e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:39.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.075+0000 7fd383fff640 1 --2- 172.21.15.19:0/2030712449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f65f78f9d0 0x55f65f7ae3c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd3740bceb0 tx=0x7fd37403b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ff5cace83d6fc76 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:39.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.075+0000 7fd3637fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:51:39.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.075+0000 7fd3637fe640 1 -- 172.21.15.19:0/2030712449 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3740b8040 con 0x55f65f78f9d0 2024-09-19T08:51:39.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.075+0000 7fd3637fe640 1 -- 172.21.15.19:0/2030712449 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd3740c4fe0 con 0x55f65f78f9d0 2024-09-19T08:51:39.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.075+0000 7fd38c803740 1 -- 172.21.15.19:0/2030712449 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3740dc040 con 0x55f65f78f9d0 2024-09-19T08:51:39.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.075+0000 7fd3637fe640 1 -- 172.21.15.19:0/2030712449 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd3740bc140 con 0x55f65f78f9d0 2024-09-19T08:51:39.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.075+0000 7fd38c803740 10 client.15057 fetch_fsmap learned FSMap version 27 2024-09-19T08:51:39.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.075+0000 7fd38c803740 1 -- 172.21.15.19:0/2030712449 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f65f814380 con 0x55f65f78f9d0 2024-09-19T08:51:39.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.076+0000 7fd3637fe640 1 -- 172.21.15.19:0/2030712449 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd3740dc040 con 0x55f65f78f9d0 2024-09-19T08:51:39.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.076+0000 7fd3637fe640 1 -- 172.21.15.19:0/2030712449 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fd37403bbb0 con 0x55f65f78f9d0 2024-09-19T08:51:39.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.076+0000 7fd38c803740 10 client.15057 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T08:51:39.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.076+0000 7fd38c803740 10 client.15057 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T08:51:39.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.076+0000 7fd38c803740 20 client.15057 populate_metadata read hostname 'smithi019' 2024-09-19T08:51:39.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.076+0000 7fd38c803740 1 --2- 172.21.15.19:0/2030712449 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55f65f819a00 0x55f65f818710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:39.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.076+0000 7fd38c803740 4 client.15057 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T08:51:39.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.076+0000 7fd38c803740 1 -- 172.21.15.19:0/2030712449 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "status"}) -- 0x55f65f6fdb10 con 0x55f65f819a00 2024-09-19T08:51:39.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.076+0000 7fd3837fe640 1 --2- 172.21.15.19:0/2030712449 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55f65f819a00 0x55f65f818710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:39.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.077+0000 7fd3837fe640 1 --2- 172.21.15.19:0/2030712449 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55f65f819a00 0x55f65f818710 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20b5f981934808c9 server_cookie=7deba623fc243bd0 in_seq=0 out_seq=0 2024-09-19T08:51:39.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.077+0000 7fd3637fe640 10 client.15057 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:51:39.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.077+0000 7fd3637fe640 1 -- 172.21.15.19:0/2030712449 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55f65f6fdb10 con 0x55f65f819a00 2024-09-19T08:51:39.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.077+0000 7fd3637fe640 10 client.15057 handle_command_reply: tid=0 2024-09-19T08:51:39.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.077+0000 7fd38c803740 1 client.15057 shutdown 2024-09-19T08:51:39.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.077+0000 7fd38c803740 1 -- 172.21.15.19:0/2030712449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f65f78f9d0 msgr2=0x55f65f7ae3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:39.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.077+0000 7fd38c803740 1 --2- 172.21.15.19:0/2030712449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f65f78f9d0 0x55f65f7ae3c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd3740bceb0 tx=0x7fd37403b4e0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.077+0000 7fd38c803740 1 -- 172.21.15.19:0/2030712449 shutdown_connections 2024-09-19T08:51:39.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.077+0000 7fd38c803740 1 --2- 172.21.15.19:0/2030712449 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55f65f819a00 0x55f65f818710 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.077+0000 7fd38c803740 1 --2- 172.21.15.19:0/2030712449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f65f79abb0 0x55f65f813e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.077+0000 7fd38c803740 1 --2- 172.21.15.19:0/2030712449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f65f7902f0 0x55f65f7ae900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.077+0000 7fd38c803740 1 --2- 172.21.15.19:0/2030712449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f65f78f9d0 0x55f65f7ae3c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.077+0000 7fd38c803740 1 -- 172.21.15.19:0/2030712449 >> 172.21.15.19:0/2030712449 conn(0x55f65f78bf60 msgr2=0x55f65f795fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:39.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.077+0000 7fd3637fe640 0 client.15057 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:51:39.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.077+0000 7fd38c803740 1 -- 172.21.15.19:0/2030712449 shutdown_connections 2024-09-19T08:51:39.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.077+0000 7fd38c803740 1 -- 172.21.15.19:0/2030712449 wait complete. 2024-09-19T08:51:39.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.077+0000 7fd38c803740 20 client.15057 trim_cache size 0 max 16384 2024-09-19T08:51:39.089 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:51:39.089 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "f26c9d84-7662-11ef-bceb-c7b262605968", 2024-09-19T08:51:39.089 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-09-19T08:51:39.089 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 24497, 2024-09-19T08:51:39.089 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-19T08:51:39.089 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-19T08:51:39.089 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-19T08:51:39.089 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 82.209011719000003, 2024-09-19T08:51:39.089 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 27, 2024-09-19T08:51:39.089 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 82, 2024-09-19T08:51:39.089 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 80, 2024-09-19T08:51:39.090 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 94.120528092000001 2024-09-19T08:51:39.090 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:51:39.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.078+0000 7fd38a42a640 1 -- 172.21.15.19:0/1705023160 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd36c0a32d0 msgr2=0x7fd36c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:39.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.078+0000 7fd38a42a640 1 --2- 172.21.15.19:0/1705023160 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd36c0a32d0 0x7fd36c0a5790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd37c011010 tx=0x7fd37c01af30 comp rx=0 tx=0).stop 2024-09-19T08:51:39.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.078+0000 7fd38a42a640 1 -- 172.21.15.19:0/1705023160 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd384103ff0 msgr2=0x7fd38419a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:39.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.078+0000 7fd38a42a640 1 --2- 172.21.15.19:0/1705023160 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd384103ff0 0x7fd38419a620 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd374006010 tx=0x7fd3740042f0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.078+0000 7fd38a42a640 1 -- 172.21.15.19:0/1705023160 shutdown_connections 2024-09-19T08:51:39.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.078+0000 7fd38a42a640 1 --2- 172.21.15.19:0/1705023160 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd36c0a32d0 0x7fd36c0a5790 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.078+0000 7fd38a42a640 1 --2- 172.21.15.19:0/1705023160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd3841049a0 0x7fd38419ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.078+0000 7fd38a42a640 1 --2- 172.21.15.19:0/1705023160 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd384109120 0x7fd38419eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.078+0000 7fd38a42a640 1 --2- 172.21.15.19:0/1705023160 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd384103ff0 0x7fd38419a620 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:39.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.078+0000 7fd38a42a640 1 -- 172.21.15.19:0/1705023160 >> 172.21.15.19:0/1705023160 conn(0x7fd3840ffa90 msgr2=0x7fd384100db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:39.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.078+0000 7fd38a42a640 1 -- 172.21.15.19:0/1705023160 shutdown_connections 2024-09-19T08:51:39.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:39.078+0000 7fd38a42a640 1 -- 172.21.15.19:0/1705023160 wait complete. 2024-09-19T08:51:39.765 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:39 smithi019 ceph-mon[30976]: pgmap v320: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T08:51:39.799 INFO:tasks.cephadm:Setup complete, yielding 2024-09-19T08:51:39.799 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T08:51:39.809 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi019.front.sepia.ceph.com 2024-09-19T08:51:39.810 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-19T08:51:39.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:39 smithi155 ceph-mon[34921]: pgmap v320: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T08:51:39.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:39 smithi203 ceph-mon[35450]: pgmap v320: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T08:51:40.069 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:40.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.568+0000 7faf5a501640 1 -- 172.21.15.19:0/1414091060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf54104f90 msgr2=0x7faf54107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:40.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.568+0000 7faf5a501640 1 --2- 172.21.15.19:0/1414091060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf54104f90 0x7faf54107380 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7faf48009900 tx=0x7faf4802a410 comp rx=0 tx=0).stop 2024-09-19T08:51:40.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.568+0000 7faf5a501640 1 -- 172.21.15.19:0/1414091060 shutdown_connections 2024-09-19T08:51:40.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.568+0000 7faf5a501640 1 --2- 172.21.15.19:0/1414091060 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf541078c0 0x7faf54109d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:40.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.568+0000 7faf5a501640 1 --2- 172.21.15.19:0/1414091060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf54104f90 0x7faf54107380 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:40.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.568+0000 7faf5a501640 1 --2- 172.21.15.19:0/1414091060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf54102660 0x7faf54104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:40.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.568+0000 7faf5a501640 1 -- 172.21.15.19:0/1414091060 >> 172.21.15.19:0/1414091060 conn(0x7faf540fc280 msgr2=0x7faf540fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:40.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.569+0000 7faf5a501640 1 -- 172.21.15.19:0/1414091060 shutdown_connections 2024-09-19T08:51:40.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.569+0000 7faf5a501640 1 -- 172.21.15.19:0/1414091060 wait complete. 2024-09-19T08:51:40.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.569+0000 7faf5a501640 1 Processor -- start 2024-09-19T08:51:40.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.569+0000 7faf5a501640 1 -- start start 2024-09-19T08:51:40.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.570+0000 7faf5a501640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf54102660 0x7faf54197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:40.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.570+0000 7faf5a501640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf54104f90 0x7faf54198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:40.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.570+0000 7faf5a501640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf541078c0 0x7faf5419f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:40.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.570+0000 7faf5a501640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7faf5410d8b0 con 0x7faf54102660 2024-09-19T08:51:40.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.570+0000 7faf5a501640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7faf5410d730 con 0x7faf541078c0 2024-09-19T08:51:40.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.570+0000 7faf5a501640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7faf5410da30 con 0x7faf54104f90 2024-09-19T08:51:40.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.570+0000 7faf53fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf54102660 0x7faf54197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:40.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.570+0000 7faf53fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf54102660 0x7faf54197f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40786/0 (socket says 172.21.15.19:40786) 2024-09-19T08:51:40.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.570+0000 7faf53fff640 1 -- 172.21.15.19:0/534316998 learned_addr learned my addr 172.21.15.19:0/534316998 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:40.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.570+0000 7faf537fe640 1 --2- 172.21.15.19:0/534316998 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf54104f90 0x7faf54198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:40.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.570+0000 7faf58a9e640 1 --2- 172.21.15.19:0/534316998 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf541078c0 0x7faf5419f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:40.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.570+0000 7faf53fff640 1 -- 172.21.15.19:0/534316998 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf54104f90 msgr2=0x7faf54198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:40.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.570+0000 7faf53fff640 1 --2- 172.21.15.19:0/534316998 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf54104f90 0x7faf54198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:40.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.570+0000 7faf53fff640 1 -- 172.21.15.19:0/534316998 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf541078c0 msgr2=0x7faf5419f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:40.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.570+0000 7faf53fff640 1 --2- 172.21.15.19:0/534316998 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf541078c0 0x7faf5419f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:40.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.570+0000 7faf53fff640 1 -- 172.21.15.19:0/534316998 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf5419fb60 con 0x7faf54102660 2024-09-19T08:51:40.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.570+0000 7faf58a9e640 1 --2- 172.21.15.19:0/534316998 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf541078c0 0x7faf5419f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:40.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.570+0000 7faf53fff640 1 --2- 172.21.15.19:0/534316998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf54102660 0x7faf54197f30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7faf4400d950 tx=0x7faf4400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:40.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.570+0000 7faf517fa640 1 -- 172.21.15.19:0/534316998 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf44017070 con 0x7faf54102660 2024-09-19T08:51:40.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.570+0000 7faf517fa640 1 -- 172.21.15.19:0/534316998 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf44009c30 con 0x7faf54102660 2024-09-19T08:51:40.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.570+0000 7faf5a501640 1 -- 172.21.15.19:0/534316998 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf5419fe50 con 0x7faf54102660 2024-09-19T08:51:40.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.570+0000 7faf517fa640 1 -- 172.21.15.19:0/534316998 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4400f6b0 con 0x7faf54102660 2024-09-19T08:51:40.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.571+0000 7faf5a501640 1 -- 172.21.15.19:0/534316998 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf541a02a0 con 0x7faf54102660 2024-09-19T08:51:40.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.571+0000 7faf5a501640 1 -- 172.21.15.19:0/534316998 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf540fdd70 con 0x7faf54102660 2024-09-19T08:51:40.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.573+0000 7faf517fa640 1 -- 172.21.15.19:0/534316998 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7faf440109d0 con 0x7faf54102660 2024-09-19T08:51:40.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.573+0000 7faf517fa640 1 --2- 172.21.15.19:0/534316998 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7faf3c0a3300 0x7faf3c0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:40.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.573+0000 7faf537fe640 1 --2- 172.21.15.19:0/534316998 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7faf3c0a3300 0x7faf3c0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:40.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.573+0000 7faf517fa640 1 -- 172.21.15.19:0/534316998 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7faf440cf660 con 0x7faf54102660 2024-09-19T08:51:40.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.574+0000 7faf537fe640 1 --2- 172.21.15.19:0/534316998 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7faf3c0a3300 0x7faf3c0a57c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7faf4802aa00 tx=0x7faf480315b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:40.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.578+0000 7faf517fa640 1 -- 172.21.15.19:0/534316998 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7faf4409c230 con 0x7faf54102660 2024-09-19T08:51:40.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.770+0000 7faf5a501640 1 -- 172.21.15.19:0/534316998 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7faf54062630 con 0x7faf3c0a3300 2024-09-19T08:51:40.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.771+0000 7faf517fa640 1 -- 172.21.15.19:0/534316998 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7faf54062630 con 0x7faf3c0a3300 2024-09-19T08:51:40.770 INFO:teuthology.orchestra.run.smithi019.stdout:Backend: cephadm 2024-09-19T08:51:40.771 INFO:teuthology.orchestra.run.smithi019.stdout:Available: Yes 2024-09-19T08:51:40.771 INFO:teuthology.orchestra.run.smithi019.stdout:Paused: No 2024-09-19T08:51:40.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.773+0000 7faf5a501640 1 -- 172.21.15.19:0/534316998 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7faf3c0a3300 msgr2=0x7faf3c0a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:40.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.773+0000 7faf5a501640 1 --2- 172.21.15.19:0/534316998 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7faf3c0a3300 0x7faf3c0a57c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7faf4802aa00 tx=0x7faf480315b0 comp rx=0 tx=0).stop 2024-09-19T08:51:40.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.773+0000 7faf5a501640 1 -- 172.21.15.19:0/534316998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf54102660 msgr2=0x7faf54197f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:40.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.773+0000 7faf5a501640 1 --2- 172.21.15.19:0/534316998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf54102660 0x7faf54197f30 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7faf4400d950 tx=0x7faf4400de10 comp rx=0 tx=0).stop 2024-09-19T08:51:40.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.773+0000 7faf5a501640 1 -- 172.21.15.19:0/534316998 shutdown_connections 2024-09-19T08:51:40.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.773+0000 7faf5a501640 1 --2- 172.21.15.19:0/534316998 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7faf3c0a3300 0x7faf3c0a57c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:40.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.773+0000 7faf5a501640 1 --2- 172.21.15.19:0/534316998 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf54104f90 0x7faf54198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:40.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.773+0000 7faf5a501640 1 --2- 172.21.15.19:0/534316998 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf541078c0 0x7faf5419f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:40.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.773+0000 7faf5a501640 1 --2- 172.21.15.19:0/534316998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf54102660 0x7faf54197f30 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:40.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.773+0000 7faf5a501640 1 -- 172.21.15.19:0/534316998 >> 172.21.15.19:0/534316998 conn(0x7faf540fc280 msgr2=0x7faf54102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:40.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.773+0000 7faf5a501640 1 -- 172.21.15.19:0/534316998 shutdown_connections 2024-09-19T08:51:40.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:40.773+0000 7faf5a501640 1 -- 172.21.15.19:0/534316998 wait complete. 2024-09-19T08:51:41.454 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-19T08:51:41.712 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:41.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:41 smithi019 ceph-mon[30976]: pgmap v321: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T08:51:41.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:41 smithi019 ceph-mon[30976]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:51:41.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:41 smithi155 ceph-mon[34921]: pgmap v321: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T08:51:41.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:41 smithi155 ceph-mon[34921]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:51:41.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:41 smithi203 ceph-mon[35450]: pgmap v321: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T08:51:41.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:41 smithi203 ceph-mon[35450]: from='client.15063 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:51:42.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.185+0000 7f3e12f72640 1 -- 172.21.15.19:0/447036381 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e0c1026a0 msgr2=0x7f3e0c104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:42.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.185+0000 7f3e12f72640 1 --2- 172.21.15.19:0/447036381 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e0c1026a0 0x7f3e0c104a90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3e00009900 tx=0x7f3e0002a410 comp rx=0 tx=0).stop 2024-09-19T08:51:42.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.185+0000 7f3e12f72640 1 -- 172.21.15.19:0/447036381 shutdown_connections 2024-09-19T08:51:42.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.185+0000 7f3e12f72640 1 --2- 172.21.15.19:0/447036381 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e0c107900 0x7f3e0c109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:42.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.185+0000 7f3e12f72640 1 --2- 172.21.15.19:0/447036381 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e0c104fd0 0x7f3e0c1073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:42.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.185+0000 7f3e12f72640 1 --2- 172.21.15.19:0/447036381 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e0c1026a0 0x7f3e0c104a90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:42.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.185+0000 7f3e12f72640 1 -- 172.21.15.19:0/447036381 >> 172.21.15.19:0/447036381 conn(0x7f3e0c0fc2a0 msgr2=0x7f3e0c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:42.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.185+0000 7f3e12f72640 1 -- 172.21.15.19:0/447036381 shutdown_connections 2024-09-19T08:51:42.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.185+0000 7f3e12f72640 1 -- 172.21.15.19:0/447036381 wait complete. 2024-09-19T08:51:42.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.186+0000 7f3e12f72640 1 Processor -- start 2024-09-19T08:51:42.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.186+0000 7f3e12f72640 1 -- start start 2024-09-19T08:51:42.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.186+0000 7f3e12f72640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e0c1026a0 0x7f3e0c197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:42.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.186+0000 7f3e12f72640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e0c104fd0 0x7f3e0c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:42.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.186+0000 7f3e12f72640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e0c107900 0x7f3e0c19f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:42.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.186+0000 7f3e12f72640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c10d900 con 0x7f3e0c1026a0 2024-09-19T08:51:42.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.186+0000 7f3e12f72640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c10d780 con 0x7f3e0c107900 2024-09-19T08:51:42.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.186+0000 7f3e12f72640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c10da80 con 0x7f3e0c104fd0 2024-09-19T08:51:42.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.186+0000 7f3e10d0e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e0c1026a0 0x7f3e0c197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:42.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.186+0000 7f3e10d0e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e0c1026a0 0x7f3e0c197f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40806/0 (socket says 172.21.15.19:40806) 2024-09-19T08:51:42.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.186+0000 7f3e10d0e640 1 -- 172.21.15.19:0/4172134049 learned_addr learned my addr 172.21.15.19:0/4172134049 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:42.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.186+0000 7f3e0bfff640 1 --2- 172.21.15.19:0/4172134049 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e0c104fd0 0x7f3e0c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:42.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.186+0000 7f3e1150f640 1 --2- 172.21.15.19:0/4172134049 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e0c107900 0x7f3e0c19f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:42.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.186+0000 7f3e10d0e640 1 -- 172.21.15.19:0/4172134049 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e0c104fd0 msgr2=0x7f3e0c198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:42.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.186+0000 7f3e10d0e640 1 --2- 172.21.15.19:0/4172134049 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e0c104fd0 0x7f3e0c198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:42.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.186+0000 7f3e10d0e640 1 -- 172.21.15.19:0/4172134049 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e0c107900 msgr2=0x7f3e0c19f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:42.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.186+0000 7f3e10d0e640 1 --2- 172.21.15.19:0/4172134049 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e0c107900 0x7f3e0c19f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:42.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.186+0000 7f3e10d0e640 1 -- 172.21.15.19:0/4172134049 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e0c19fb60 con 0x7f3e0c1026a0 2024-09-19T08:51:42.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.186+0000 7f3e0bfff640 1 --2- 172.21.15.19:0/4172134049 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e0c104fd0 0x7f3e0c198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:42.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.186+0000 7f3e1150f640 1 --2- 172.21.15.19:0/4172134049 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e0c107900 0x7f3e0c19f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:51:42.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.187+0000 7f3e10d0e640 1 --2- 172.21.15.19:0/4172134049 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e0c1026a0 0x7f3e0c197f30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3e00031440 tx=0x7f3e00032e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:42.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.187+0000 7f3e09ffb640 1 -- 172.21.15.19:0/4172134049 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e0003f030 con 0x7f3e0c1026a0 2024-09-19T08:51:42.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.187+0000 7f3e09ffb640 1 -- 172.21.15.19:0/4172134049 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e00003ce0 con 0x7f3e0c1026a0 2024-09-19T08:51:42.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.187+0000 7f3e12f72640 1 -- 172.21.15.19:0/4172134049 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e0c19fdf0 con 0x7f3e0c1026a0 2024-09-19T08:51:42.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.187+0000 7f3e09ffb640 1 -- 172.21.15.19:0/4172134049 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e00035070 con 0x7f3e0c1026a0 2024-09-19T08:51:42.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.187+0000 7f3e12f72640 1 -- 172.21.15.19:0/4172134049 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e0c1a0210 con 0x7f3e0c1026a0 2024-09-19T08:51:42.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.188+0000 7f3e12f72640 1 -- 172.21.15.19:0/4172134049 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e0c0fdd90 con 0x7f3e0c1026a0 2024-09-19T08:51:42.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.189+0000 7f3e09ffb640 1 -- 172.21.15.19:0/4172134049 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3e00042030 con 0x7f3e0c1026a0 2024-09-19T08:51:42.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.190+0000 7f3e09ffb640 1 --2- 172.21.15.19:0/4172134049 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3dfc0a3300 0x7f3dfc0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:42.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.190+0000 7f3e0bfff640 1 --2- 172.21.15.19:0/4172134049 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3dfc0a3300 0x7f3dfc0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:42.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.190+0000 7f3e09ffb640 1 -- 172.21.15.19:0/4172134049 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f3e000f0150 con 0x7f3e0c1026a0 2024-09-19T08:51:42.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.190+0000 7f3e0bfff640 1 --2- 172.21.15.19:0/4172134049 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3dfc0a3300 0x7f3dfc0a57c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3df8005d00 tx=0x7f3df8005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:42.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.194+0000 7f3e09ffb640 1 -- 172.21.15.19:0/4172134049 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3e000bcd20 con 0x7f3e0c1026a0 2024-09-19T08:51:42.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.378+0000 7f3e12f72640 1 -- 172.21.15.19:0/4172134049 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f3e0c062630 con 0x7f3dfc0a3300 2024-09-19T08:51:42.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.391+0000 7f3e09ffb640 1 -- 172.21.15.19:0/4172134049 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7f3e0c062630 con 0x7f3dfc0a3300 2024-09-19T08:51:42.390 INFO:teuthology.orchestra.run.smithi019.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T08:51:42.390 INFO:teuthology.orchestra.run.smithi019.stdout:mds.a smithi019 running (100s) 20s ago 100s 18.7M - 19.1.1-361-g2f599a46 d2baa855c067 0f6edd0d9119 2024-09-19T08:51:42.391 INFO:teuthology.orchestra.run.smithi019.stdout:mds.b smithi155 running (97s) 30s ago 97s 26.4M - 19.1.1-361-g2f599a46 d2baa855c067 8ec6d2ddad3c 2024-09-19T08:51:42.391 INFO:teuthology.orchestra.run.smithi019.stdout:mds.c smithi203 running (111s) 31s ago 110s 20.2M - 19.1.1-361-g2f599a46 d2baa855c067 e7da5fc02f01 2024-09-19T08:51:42.391 INFO:teuthology.orchestra.run.smithi019.stdout:mds.d smithi019 running (119s) 20s ago 118s 13.5M - 19.1.1-361-g2f599a46 d2baa855c067 d7a2d18f594e 2024-09-19T08:51:42.391 INFO:teuthology.orchestra.run.smithi019.stdout:mds.e smithi155 running (116s) 30s ago 116s 17.9M - 19.1.1-361-g2f599a46 d2baa855c067 2b5274a37fe5 2024-09-19T08:51:42.391 INFO:teuthology.orchestra.run.smithi019.stdout:mds.f smithi203 running (113s) 31s ago 113s 17.0M - 19.1.1-361-g2f599a46 d2baa855c067 6cb766f17c95 2024-09-19T08:51:42.391 INFO:teuthology.orchestra.run.smithi019.stdout:mds.g smithi019 running (103s) 20s ago 103s 16.7M - 19.1.1-361-g2f599a46 d2baa855c067 806be8997683 2024-09-19T08:51:42.391 INFO:teuthology.orchestra.run.smithi019.stdout:mds.h smithi155 running (108s) 30s ago 108s 19.5M - 19.1.1-361-g2f599a46 d2baa855c067 609fef8bb1bd 2024-09-19T08:51:42.391 INFO:teuthology.orchestra.run.smithi019.stdout:mds.i smithi203 running (106s) 31s ago 105s 18.0M - 19.1.1-361-g2f599a46 d2baa855c067 6d3c36377a0e 2024-09-19T08:51:42.391 INFO:teuthology.orchestra.run.smithi019.stdout:mds.j smithi019 running (2m) 20s ago 2m 17.1M - 19.1.1-361-g2f599a46 d2baa855c067 ea2658f680ce 2024-09-19T08:51:42.391 INFO:teuthology.orchestra.run.smithi019.stdout:mds.k smithi155 running (2m) 30s ago 2m 16.9M - 19.1.1-361-g2f599a46 d2baa855c067 4e4dcdc47989 2024-09-19T08:51:42.391 INFO:teuthology.orchestra.run.smithi019.stdout:mds.l smithi203 running (2m) 31s ago 2m 16.9M - 19.1.1-361-g2f599a46 d2baa855c067 d54305bb0683 2024-09-19T08:51:42.392 INFO:teuthology.orchestra.run.smithi019.stdout:mgr.x smithi019 *:9283,8765 running (9m) 20s ago 9m 508M - 19.1.1-361-g2f599a46 d2baa855c067 b2a9fb49f940 2024-09-19T08:51:42.392 INFO:teuthology.orchestra.run.smithi019.stdout:mgr.y smithi155 *:8443,8765 running (7m) 30s ago 7m 444M - 19.1.1-361-g2f599a46 d2baa855c067 517ec88276f7 2024-09-19T08:51:42.392 INFO:teuthology.orchestra.run.smithi019.stdout:mgr.z smithi203 *:8443,8765 running (7m) 31s ago 7m 443M - 19.1.1-361-g2f599a46 d2baa855c067 48cdd72c29a0 2024-09-19T08:51:42.392 INFO:teuthology.orchestra.run.smithi019.stdout:mon.a smithi019 running (9m) 20s ago 9m 49.8M 2048M 19.1.1-361-g2f599a46 d2baa855c067 2c489516c9ba 2024-09-19T08:51:42.392 INFO:teuthology.orchestra.run.smithi019.stdout:mon.b smithi155 running (7m) 30s ago 7m 40.3M 2048M 19.1.1-361-g2f599a46 d2baa855c067 8405faf5060a 2024-09-19T08:51:42.392 INFO:teuthology.orchestra.run.smithi019.stdout:mon.c smithi203 running (7m) 31s ago 7m 40.5M 2048M 19.1.1-361-g2f599a46 d2baa855c067 2a82357b0af2 2024-09-19T08:51:42.392 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0 smithi019 running (7m) 20s ago 7m 44.8M 4273M 19.1.1-361-g2f599a46 d2baa855c067 e5c7c432051e 2024-09-19T08:51:42.392 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1 smithi155 running (6m) 30s ago 6m 48.1M 4272M 19.1.1-361-g2f599a46 d2baa855c067 1be9374314d6 2024-09-19T08:51:42.392 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2 smithi203 running (6m) 31s ago 6m 48.9M 4272M 19.1.1-361-g2f599a46 d2baa855c067 21aeed39b957 2024-09-19T08:51:42.392 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3 smithi019 running (5m) 20s ago 5m 55.7M 4273M 19.1.1-361-g2f599a46 d2baa855c067 70c8830d2c3f 2024-09-19T08:51:42.392 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4 smithi155 running (5m) 30s ago 5m 42.2M 4272M 19.1.1-361-g2f599a46 d2baa855c067 4a5eb9db31bf 2024-09-19T08:51:42.393 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5 smithi203 running (5m) 31s ago 5m 55.4M 4272M 19.1.1-361-g2f599a46 d2baa855c067 fe22e1985f0e 2024-09-19T08:51:42.393 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6 smithi019 running (4m) 20s ago 4m 42.0M 4273M 19.1.1-361-g2f599a46 d2baa855c067 1944c2d51f1e 2024-09-19T08:51:42.393 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7 smithi155 running (4m) 30s ago 4m 43.1M 4272M 19.1.1-361-g2f599a46 d2baa855c067 9502dd6e2d5d 2024-09-19T08:51:42.393 INFO:teuthology.orchestra.run.smithi019.stdout:osd.8 smithi203 running (3m) 31s ago 3m 55.4M 4272M 19.1.1-361-g2f599a46 d2baa855c067 8137ccabee01 2024-09-19T08:51:42.393 INFO:teuthology.orchestra.run.smithi019.stdout:osd.9 smithi019 running (3m) 20s ago 3m 50.5M 4273M 19.1.1-361-g2f599a46 d2baa855c067 98bec916f416 2024-09-19T08:51:42.393 INFO:teuthology.orchestra.run.smithi019.stdout:osd.10 smithi155 running (2m) 30s ago 2m 54.2M 4272M 19.1.1-361-g2f599a46 d2baa855c067 bd16a8bddee9 2024-09-19T08:51:42.393 INFO:teuthology.orchestra.run.smithi019.stdout:osd.11 smithi203 running (2m) 31s ago 2m 42.6M 4272M 19.1.1-361-g2f599a46 d2baa855c067 73caf4b0f668 2024-09-19T08:51:42.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.393+0000 7f3e12f72640 1 -- 172.21.15.19:0/4172134049 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3dfc0a3300 msgr2=0x7f3dfc0a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:42.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.393+0000 7f3e12f72640 1 --2- 172.21.15.19:0/4172134049 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3dfc0a3300 0x7f3dfc0a57c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3df8005d00 tx=0x7f3df8005c70 comp rx=0 tx=0).stop 2024-09-19T08:51:42.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.394+0000 7f3e12f72640 1 -- 172.21.15.19:0/4172134049 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e0c1026a0 msgr2=0x7f3e0c197f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:42.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.394+0000 7f3e12f72640 1 --2- 172.21.15.19:0/4172134049 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e0c1026a0 0x7f3e0c197f30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f3e00031440 tx=0x7f3e00032e20 comp rx=0 tx=0).stop 2024-09-19T08:51:42.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.394+0000 7f3e12f72640 1 -- 172.21.15.19:0/4172134049 shutdown_connections 2024-09-19T08:51:42.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.394+0000 7f3e12f72640 1 --2- 172.21.15.19:0/4172134049 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3dfc0a3300 0x7f3dfc0a57c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:42.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.394+0000 7f3e12f72640 1 --2- 172.21.15.19:0/4172134049 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e0c104fd0 0x7f3e0c198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:42.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.394+0000 7f3e12f72640 1 --2- 172.21.15.19:0/4172134049 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e0c107900 0x7f3e0c19f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:42.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.394+0000 7f3e12f72640 1 --2- 172.21.15.19:0/4172134049 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e0c1026a0 0x7f3e0c197f30 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:42.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.394+0000 7f3e12f72640 1 -- 172.21.15.19:0/4172134049 >> 172.21.15.19:0/4172134049 conn(0x7f3e0c0fc2a0 msgr2=0x7f3e0c103060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:42.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.394+0000 7f3e12f72640 1 -- 172.21.15.19:0/4172134049 shutdown_connections 2024-09-19T08:51:42.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:42.394+0000 7f3e12f72640 1 -- 172.21.15.19:0/4172134049 wait complete. 2024-09-19T08:51:43.101 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-19T08:51:43.356 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:43.736 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:43 smithi019 ceph-mon[30976]: pgmap v322: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T08:51:43.737 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:43 smithi019 ceph-mon[30976]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:51:43.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.819+0000 7f8bd2983640 1 -- 172.21.15.19:0/1481818020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8bcc1037c0 msgr2=0x7f8bcc10a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:43.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.819+0000 7f8bd2983640 1 --2- 172.21.15.19:0/1481818020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8bcc1037c0 0x7f8bcc10a050 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4009ca0 tx=0x7f8bc402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:51:43.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.819+0000 7f8bd2983640 1 -- 172.21.15.19:0/1481818020 shutdown_connections 2024-09-19T08:51:43.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.819+0000 7f8bd2983640 1 --2- 172.21.15.19:0/1481818020 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8bcc102e00 0x7f8bcc103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:43.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.819+0000 7f8bd2983640 1 --2- 172.21.15.19:0/1481818020 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8bcc1037c0 0x7f8bcc10a050 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:43.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.819+0000 7f8bd2983640 1 --2- 172.21.15.19:0/1481818020 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bcc101c00 0x7f8bcc102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:43.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.819+0000 7f8bd2983640 1 -- 172.21.15.19:0/1481818020 >> 172.21.15.19:0/1481818020 conn(0x7f8bcc0fd390 msgr2=0x7f8bcc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:43.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.819+0000 7f8bd2983640 1 -- 172.21.15.19:0/1481818020 shutdown_connections 2024-09-19T08:51:43.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.819+0000 7f8bd2983640 1 -- 172.21.15.19:0/1481818020 wait complete. 2024-09-19T08:51:43.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.820+0000 7f8bd2983640 1 Processor -- start 2024-09-19T08:51:43.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.820+0000 7f8bd2983640 1 -- start start 2024-09-19T08:51:43.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.820+0000 7f8bd2983640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8bcc101c00 0x7f8bcc197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:43.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.820+0000 7f8bd2983640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bcc102e00 0x7f8bcc1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:43.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.820+0000 7f8bd2983640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8bcc1037c0 0x7f8bcc19f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:43.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.820+0000 7f8bd2983640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8bcc10d880 con 0x7f8bcc1037c0 2024-09-19T08:51:43.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.820+0000 7f8bd2983640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8bcc10d700 con 0x7f8bcc102e00 2024-09-19T08:51:43.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.820+0000 7f8bd2983640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8bcc10da00 con 0x7f8bcc101c00 2024-09-19T08:51:43.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.821+0000 7f8bd0f20640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8bcc1037c0 0x7f8bcc19f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:43.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.821+0000 7f8bd0f20640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8bcc1037c0 0x7f8bcc19f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40816/0 (socket says 172.21.15.19:40816) 2024-09-19T08:51:43.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.821+0000 7f8bd0f20640 1 -- 172.21.15.19:0/5435095 learned_addr learned my addr 172.21.15.19:0/5435095 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:43.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.821+0000 7f8bcbfff640 1 --2- 172.21.15.19:0/5435095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8bcc101c00 0x7f8bcc197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:43.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.821+0000 7f8bcb7fe640 1 --2- 172.21.15.19:0/5435095 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bcc102e00 0x7f8bcc1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:43.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.821+0000 7f8bd0f20640 1 -- 172.21.15.19:0/5435095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8bcc101c00 msgr2=0x7f8bcc197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:43.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.821+0000 7f8bd0f20640 1 --2- 172.21.15.19:0/5435095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8bcc101c00 0x7f8bcc197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:43.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.821+0000 7f8bd0f20640 1 -- 172.21.15.19:0/5435095 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bcc102e00 msgr2=0x7f8bcc1983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:43.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.821+0000 7f8bd0f20640 1 --2- 172.21.15.19:0/5435095 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bcc102e00 0x7f8bcc1983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:43.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.821+0000 7f8bd0f20640 1 -- 172.21.15.19:0/5435095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bcc19fad0 con 0x7f8bcc1037c0 2024-09-19T08:51:43.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.821+0000 7f8bd0f20640 1 --2- 172.21.15.19:0/5435095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8bcc1037c0 0x7f8bcc19f460 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4005e30 tx=0x7f8bc4031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:43.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.821+0000 7f8bc97fa640 1 -- 172.21.15.19:0/5435095 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc4003c30 con 0x7f8bcc1037c0 2024-09-19T08:51:43.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.821+0000 7f8bc97fa640 1 -- 172.21.15.19:0/5435095 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8bc4003dd0 con 0x7f8bcc1037c0 2024-09-19T08:51:43.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.821+0000 7f8bd2983640 1 -- 172.21.15.19:0/5435095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bcc19fd60 con 0x7f8bcc1037c0 2024-09-19T08:51:43.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.821+0000 7f8bc97fa640 1 -- 172.21.15.19:0/5435095 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bc402fde0 con 0x7f8bcc1037c0 2024-09-19T08:51:43.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.821+0000 7f8bd2983640 1 -- 172.21.15.19:0/5435095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bcc1a0240 con 0x7f8bcc1037c0 2024-09-19T08:51:43.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.822+0000 7f8bd2983640 1 -- 172.21.15.19:0/5435095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bcc108f80 con 0x7f8bcc1037c0 2024-09-19T08:51:43.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.823+0000 7f8bc97fa640 1 -- 172.21.15.19:0/5435095 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f8bc4004050 con 0x7f8bcc1037c0 2024-09-19T08:51:43.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.824+0000 7f8bc97fa640 1 --2- 172.21.15.19:0/5435095 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8bb40a3300 0x7f8bb40a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:43.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.824+0000 7f8bcbfff640 1 --2- 172.21.15.19:0/5435095 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8bb40a3300 0x7f8bb40a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:43.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.824+0000 7f8bc97fa640 1 -- 172.21.15.19:0/5435095 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f8bc40f0dc0 con 0x7f8bcc1037c0 2024-09-19T08:51:43.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.825+0000 7f8bcbfff640 1 --2- 172.21.15.19:0/5435095 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8bb40a3300 0x7f8bb40a57c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc102c60 tx=0x7f8bbc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:43.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:43.828+0000 7f8bc97fa640 1 -- 172.21.15.19:0/5435095 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8bc40bda40 con 0x7f8bcc1037c0 2024-09-19T08:51:43.947 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:43 smithi155 ceph-mon[34921]: pgmap v322: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T08:51:43.947 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:43 smithi155 ceph-mon[34921]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:51:43.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:43 smithi203 ceph-mon[35450]: pgmap v322: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T08:51:43.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:43 smithi203 ceph-mon[35450]: from='client.15069 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:51:44.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:44.017+0000 7f8bd2983640 1 -- 172.21.15.19:0/5435095 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f8bcc062630 con 0x7f8bb40a3300 2024-09-19T08:51:44.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:44.023+0000 7f8bc97fa640 1 -- 172.21.15.19:0/5435095 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f8bcc062630 con 0x7f8bb40a3300 2024-09-19T08:51:44.022 INFO:teuthology.orchestra.run.smithi019.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-19T08:51:44.022 INFO:teuthology.orchestra.run.smithi019.stdout:mds.all 12/12 32s ago 2m smithi019=a;smithi019=d;smithi019=g;smithi019=j;smithi155=b;smithi155=e;smithi155=h;smithi155=k;smithi203=c;smithi203=f;smithi203=i;smithi203=l;count:12 2024-09-19T08:51:44.023 INFO:teuthology.orchestra.run.smithi019.stdout:mgr 3/3 32s ago 7m smithi019=x;smithi155=y;smithi203=z;count:3 2024-09-19T08:51:44.023 INFO:teuthology.orchestra.run.smithi019.stdout:mon 3/3 32s ago 7m smithi019:172.21.15.19=a;smithi155:172.21.15.155=b;smithi203:172.21.15.203=c;count:3 2024-09-19T08:51:44.023 INFO:teuthology.orchestra.run.smithi019.stdout:osd 12 32s ago - 2024-09-19T08:51:44.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:44.025+0000 7f8bd2983640 1 -- 172.21.15.19:0/5435095 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8bb40a3300 msgr2=0x7f8bb40a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:44.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:44.025+0000 7f8bd2983640 1 --2- 172.21.15.19:0/5435095 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8bb40a3300 0x7f8bb40a57c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8bcc102c60 tx=0x7f8bbc00b390 comp rx=0 tx=0).stop 2024-09-19T08:51:44.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:44.025+0000 7f8bd2983640 1 -- 172.21.15.19:0/5435095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8bcc1037c0 msgr2=0x7f8bcc19f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:44.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:44.025+0000 7f8bd2983640 1 --2- 172.21.15.19:0/5435095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8bcc1037c0 0x7f8bcc19f460 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f8bc4005e30 tx=0x7f8bc4031ee0 comp rx=0 tx=0).stop 2024-09-19T08:51:44.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:44.025+0000 7f8bd2983640 1 -- 172.21.15.19:0/5435095 shutdown_connections 2024-09-19T08:51:44.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:44.025+0000 7f8bd2983640 1 --2- 172.21.15.19:0/5435095 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8bb40a3300 0x7f8bb40a57c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:44.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:44.025+0000 7f8bd2983640 1 --2- 172.21.15.19:0/5435095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8bcc1037c0 0x7f8bcc19f460 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:44.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:44.025+0000 7f8bd2983640 1 --2- 172.21.15.19:0/5435095 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8bcc102e00 0x7f8bcc1983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:44.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:44.025+0000 7f8bd2983640 1 --2- 172.21.15.19:0/5435095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8bcc101c00 0x7f8bcc197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:44.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:44.025+0000 7f8bd2983640 1 -- 172.21.15.19:0/5435095 >> 172.21.15.19:0/5435095 conn(0x7f8bcc0fd390 msgr2=0x7f8bcc106150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:44.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:44.025+0000 7f8bd2983640 1 -- 172.21.15.19:0/5435095 shutdown_connections 2024-09-19T08:51:44.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:44.025+0000 7f8bd2983640 1 -- 172.21.15.19:0/5435095 wait complete. 2024-09-19T08:51:44.780 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-19T08:51:45.038 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:45.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.513+0000 7ff7b20e6640 1 -- 172.21.15.19:0/3138786758 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7ac101d10 msgr2=0x7ff7ac102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:45.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.513+0000 7ff7b20e6640 1 --2- 172.21.15.19:0/3138786758 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7ac101d10 0x7ff7ac102190 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff794009900 tx=0x7ff79402a410 comp rx=0 tx=0).stop 2024-09-19T08:51:45.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.513+0000 7ff7b20e6640 1 -- 172.21.15.19:0/3138786758 shutdown_connections 2024-09-19T08:51:45.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.513+0000 7ff7b20e6640 1 --2- 172.21.15.19:0/3138786758 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7ac1026d0 0x7ff7ac108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:45.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.513+0000 7ff7b20e6640 1 --2- 172.21.15.19:0/3138786758 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7ac101d10 0x7ff7ac102190 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:45.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.513+0000 7ff7b20e6640 1 --2- 172.21.15.19:0/3138786758 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7ac100b10 0x7ff7ac100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:45.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.513+0000 7ff7b20e6640 1 -- 172.21.15.19:0/3138786758 >> 172.21.15.19:0/3138786758 conn(0x7ff7ac0fc2a0 msgr2=0x7ff7ac0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:45.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.513+0000 7ff7b20e6640 1 -- 172.21.15.19:0/3138786758 shutdown_connections 2024-09-19T08:51:45.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.513+0000 7ff7b20e6640 1 -- 172.21.15.19:0/3138786758 wait complete. 2024-09-19T08:51:45.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.514+0000 7ff7b20e6640 1 Processor -- start 2024-09-19T08:51:45.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.514+0000 7ff7b20e6640 1 -- start start 2024-09-19T08:51:45.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.514+0000 7ff7b20e6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7ac100b10 0x7ff7ac06b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:45.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.514+0000 7ff7b20e6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7ac101d10 0x7ff7ac19f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:45.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.514+0000 7ff7b20e6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7ac1026d0 0x7ff7ac1a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:45.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.514+0000 7ff7b20e6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac10c790 con 0x7ff7ac1026d0 2024-09-19T08:51:45.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.514+0000 7ff7b20e6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac10c610 con 0x7ff7ac100b10 2024-09-19T08:51:45.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.514+0000 7ff7b20e6640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff7ac10c910 con 0x7ff7ac101d10 2024-09-19T08:51:45.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.514+0000 7ff7abfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7ac1026d0 0x7ff7ac1a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:45.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.514+0000 7ff7abfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7ac1026d0 0x7ff7ac1a1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59738/0 (socket says 172.21.15.19:59738) 2024-09-19T08:51:45.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.514+0000 7ff7abfff640 1 -- 172.21.15.19:0/1620254922 learned_addr learned my addr 172.21.15.19:0/1620254922 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:45.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.514+0000 7ff7ab7fe640 1 --2- 172.21.15.19:0/1620254922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7ac100b10 0x7ff7ac06b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:45.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.514+0000 7ff7a2ffd640 1 --2- 172.21.15.19:0/1620254922 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7ac101d10 0x7ff7ac19f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:45.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.515+0000 7ff7abfff640 1 -- 172.21.15.19:0/1620254922 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7ac101d10 msgr2=0x7ff7ac19f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:45.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.515+0000 7ff7abfff640 1 --2- 172.21.15.19:0/1620254922 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7ac101d10 0x7ff7ac19f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:45.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.515+0000 7ff7abfff640 1 -- 172.21.15.19:0/1620254922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7ac100b10 msgr2=0x7ff7ac06b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:45.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.515+0000 7ff7abfff640 1 --2- 172.21.15.19:0/1620254922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7ac100b10 0x7ff7ac06b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:45.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.515+0000 7ff7abfff640 1 -- 172.21.15.19:0/1620254922 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7ac1a1e20 con 0x7ff7ac1026d0 2024-09-19T08:51:45.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.515+0000 7ff7ab7fe640 1 --2- 172.21.15.19:0/1620254922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7ac100b10 0x7ff7ac06b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:45.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.515+0000 7ff7abfff640 1 --2- 172.21.15.19:0/1620254922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7ac1026d0 0x7ff7ac1a1630 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff7a400eaa0 tx=0x7ff7a400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:45.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.515+0000 7ff7a97fa640 1 -- 172.21.15.19:0/1620254922 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a400cdb0 con 0x7ff7ac1026d0 2024-09-19T08:51:45.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.515+0000 7ff7a97fa640 1 -- 172.21.15.19:0/1620254922 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7a4005020 con 0x7ff7ac1026d0 2024-09-19T08:51:45.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.515+0000 7ff7b20e6640 1 -- 172.21.15.19:0/1620254922 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7ac1a20b0 con 0x7ff7ac1026d0 2024-09-19T08:51:45.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.515+0000 7ff7a97fa640 1 -- 172.21.15.19:0/1620254922 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7a40116b0 con 0x7ff7ac1026d0 2024-09-19T08:51:45.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.515+0000 7ff7b20e6640 1 -- 172.21.15.19:0/1620254922 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7ac1a2570 con 0x7ff7ac1026d0 2024-09-19T08:51:45.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.516+0000 7ff7b20e6640 1 -- 172.21.15.19:0/1620254922 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7ac100f10 con 0x7ff7ac1026d0 2024-09-19T08:51:45.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.517+0000 7ff7a97fa640 1 -- 172.21.15.19:0/1620254922 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ff7a4005560 con 0x7ff7ac1026d0 2024-09-19T08:51:45.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.518+0000 7ff7a97fa640 1 --2- 172.21.15.19:0/1620254922 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff7980a3300 0x7ff7980a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:45.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.518+0000 7ff7ab7fe640 1 --2- 172.21.15.19:0/1620254922 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff7980a3300 0x7ff7980a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:45.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.518+0000 7ff7a97fa640 1 -- 172.21.15.19:0/1620254922 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff7a40cfd00 con 0x7ff7ac1026d0 2024-09-19T08:51:45.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.519+0000 7ff7ab7fe640 1 --2- 172.21.15.19:0/1620254922 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff7980a3300 0x7ff7980a57c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff79c0058c0 tx=0x7ff79c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:45.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.522+0000 7ff7a97fa640 1 -- 172.21.15.19:0/1620254922 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff7a4016030 con 0x7ff7ac1026d0 2024-09-19T08:51:45.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.704+0000 7ff7b20e6640 1 -- 172.21.15.19:0/1620254922 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7ff7ac062630 con 0x7ff7980a3300 2024-09-19T08:51:45.703 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:45 smithi019 ceph-mon[30976]: pgmap v323: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T08:51:45.704 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:45 smithi019 ceph-mon[30976]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:51:45.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.705+0000 7ff7a97fa640 1 -- 172.21.15.19:0/1620254922 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7ff7ac062630 con 0x7ff7980a3300 2024-09-19T08:51:45.705 INFO:teuthology.orchestra.run.smithi019.stdout:HOST ADDR LABELS STATUS 2024-09-19T08:51:45.705 INFO:teuthology.orchestra.run.smithi019.stdout:smithi019 172.21.15.19 2024-09-19T08:51:45.705 INFO:teuthology.orchestra.run.smithi019.stdout:smithi155 172.21.15.155 2024-09-19T08:51:45.705 INFO:teuthology.orchestra.run.smithi019.stdout:smithi203 172.21.15.203 2024-09-19T08:51:45.705 INFO:teuthology.orchestra.run.smithi019.stdout:3 hosts in cluster 2024-09-19T08:51:45.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.707+0000 7ff7b20e6640 1 -- 172.21.15.19:0/1620254922 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff7980a3300 msgr2=0x7ff7980a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:45.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.707+0000 7ff7b20e6640 1 --2- 172.21.15.19:0/1620254922 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff7980a3300 0x7ff7980a57c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff79c0058c0 tx=0x7ff79c005850 comp rx=0 tx=0).stop 2024-09-19T08:51:45.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.707+0000 7ff7b20e6640 1 -- 172.21.15.19:0/1620254922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7ac1026d0 msgr2=0x7ff7ac1a1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:45.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.707+0000 7ff7b20e6640 1 --2- 172.21.15.19:0/1620254922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7ac1026d0 0x7ff7ac1a1630 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff7a400eaa0 tx=0x7ff7a400ef60 comp rx=0 tx=0).stop 2024-09-19T08:51:45.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.708+0000 7ff7b20e6640 1 -- 172.21.15.19:0/1620254922 shutdown_connections 2024-09-19T08:51:45.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.708+0000 7ff7b20e6640 1 --2- 172.21.15.19:0/1620254922 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff7980a3300 0x7ff7980a57c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:45.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.708+0000 7ff7b20e6640 1 --2- 172.21.15.19:0/1620254922 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff7ac101d10 0x7ff7ac19f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:45.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.708+0000 7ff7b20e6640 1 --2- 172.21.15.19:0/1620254922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff7ac1026d0 0x7ff7ac1a1630 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:45.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.708+0000 7ff7b20e6640 1 --2- 172.21.15.19:0/1620254922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff7ac100b10 0x7ff7ac06b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:45.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.708+0000 7ff7b20e6640 1 -- 172.21.15.19:0/1620254922 >> 172.21.15.19:0/1620254922 conn(0x7ff7ac0fc2a0 msgr2=0x7ff7ac1050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:45.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.708+0000 7ff7b20e6640 1 -- 172.21.15.19:0/1620254922 shutdown_connections 2024-09-19T08:51:45.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:45.708+0000 7ff7b20e6640 1 -- 172.21.15.19:0/1620254922 wait complete. 2024-09-19T08:51:45.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:45 smithi155 ceph-mon[34921]: pgmap v323: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T08:51:45.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:45 smithi155 ceph-mon[34921]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:51:45.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:45 smithi203 ceph-mon[35450]: pgmap v323: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T08:51:45.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:45 smithi203 ceph-mon[35450]: from='client.15075 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:51:46.419 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-19T08:51:46.680 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:46 smithi019 ceph-mon[30976]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:51:46.681 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:46.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:46 smithi155 ceph-mon[34921]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:51:46.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:46 smithi203 ceph-mon[35450]: from='client.15081 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:51:47.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.189+0000 7f240cc3e640 1 -- 172.21.15.19:0/2897672420 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2408101c00 msgr2=0x7f2408102000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:47.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.189+0000 7f240cc3e640 1 --2- 172.21.15.19:0/2897672420 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2408101c00 0x7f2408102000 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f23f0009900 tx=0x7f23f002a410 comp rx=0 tx=0).stop 2024-09-19T08:51:47.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.189+0000 7f240cc3e640 1 -- 172.21.15.19:0/2897672420 shutdown_connections 2024-09-19T08:51:47.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.189+0000 7f240cc3e640 1 --2- 172.21.15.19:0/2897672420 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2408102e00 0x7f2408103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:47.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.189+0000 7f240cc3e640 1 --2- 172.21.15.19:0/2897672420 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f24081037c0 0x7f240810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:47.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.189+0000 7f240cc3e640 1 --2- 172.21.15.19:0/2897672420 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2408101c00 0x7f2408102000 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:47.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.189+0000 7f240cc3e640 1 -- 172.21.15.19:0/2897672420 >> 172.21.15.19:0/2897672420 conn(0x7f24080fd390 msgr2=0x7f24080ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:47.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.189+0000 7f240cc3e640 1 -- 172.21.15.19:0/2897672420 shutdown_connections 2024-09-19T08:51:47.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.189+0000 7f240cc3e640 1 -- 172.21.15.19:0/2897672420 wait complete. 2024-09-19T08:51:47.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.190+0000 7f240cc3e640 1 Processor -- start 2024-09-19T08:51:47.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.190+0000 7f240cc3e640 1 -- start start 2024-09-19T08:51:47.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.190+0000 7f240cc3e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2408101c00 0x7f2408197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:47.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.190+0000 7f240cc3e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2408102e00 0x7f24081984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:47.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.190+0000 7f240cc3e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24081037c0 0x7f240819f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:47.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.190+0000 7f240cc3e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f240810d880 con 0x7f2408101c00 2024-09-19T08:51:47.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.190+0000 7f240cc3e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f240810d700 con 0x7f2408102e00 2024-09-19T08:51:47.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.190+0000 7f240cc3e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f240810da00 con 0x7f24081037c0 2024-09-19T08:51:47.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.190+0000 7f240659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2408101c00 0x7f2408197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:47.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.190+0000 7f240659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2408101c00 0x7f2408197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59762/0 (socket says 172.21.15.19:59762) 2024-09-19T08:51:47.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.190+0000 7f240659c640 1 -- 172.21.15.19:0/2567707137 learned_addr learned my addr 172.21.15.19:0/2567707137 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:47.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.190+0000 7f2406d9d640 1 --2- 172.21.15.19:0/2567707137 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24081037c0 0x7f240819f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:47.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.190+0000 7f2405d9b640 1 --2- 172.21.15.19:0/2567707137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2408102e00 0x7f24081984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:47.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.190+0000 7f240659c640 1 -- 172.21.15.19:0/2567707137 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24081037c0 msgr2=0x7f240819f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:47.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.190+0000 7f240659c640 1 --2- 172.21.15.19:0/2567707137 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24081037c0 0x7f240819f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:47.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.190+0000 7f240659c640 1 -- 172.21.15.19:0/2567707137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2408102e00 msgr2=0x7f24081984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:47.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.191+0000 7f240659c640 1 --2- 172.21.15.19:0/2567707137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2408102e00 0x7f24081984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:47.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.191+0000 7f240659c640 1 -- 172.21.15.19:0/2567707137 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f240819fb90 con 0x7f2408101c00 2024-09-19T08:51:47.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.191+0000 7f240659c640 1 --2- 172.21.15.19:0/2567707137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2408101c00 0x7f2408197f60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f23f0031610 tx=0x7f23f00043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:47.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.191+0000 7f23ff7fe640 1 -- 172.21.15.19:0/2567707137 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f003f030 con 0x7f2408101c00 2024-09-19T08:51:47.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.191+0000 7f240cc3e640 1 -- 172.21.15.19:0/2567707137 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f240819fe20 con 0x7f2408101c00 2024-09-19T08:51:47.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.191+0000 7f23ff7fe640 1 -- 172.21.15.19:0/2567707137 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23f0003ce0 con 0x7f2408101c00 2024-09-19T08:51:47.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.191+0000 7f23ff7fe640 1 -- 172.21.15.19:0/2567707137 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f0035070 con 0x7f2408101c00 2024-09-19T08:51:47.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.191+0000 7f240cc3e640 1 -- 172.21.15.19:0/2567707137 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24081a0220 con 0x7f2408101c00 2024-09-19T08:51:47.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.192+0000 7f240cc3e640 1 -- 172.21.15.19:0/2567707137 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2408108fd0 con 0x7f2408101c00 2024-09-19T08:51:47.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.193+0000 7f23ff7fe640 1 -- 172.21.15.19:0/2567707137 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f23f0042030 con 0x7f2408101c00 2024-09-19T08:51:47.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.194+0000 7f23ff7fe640 1 --2- 172.21.15.19:0/2567707137 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f23f40a3300 0x7f23f40a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:47.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.194+0000 7f2405d9b640 1 --2- 172.21.15.19:0/2567707137 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f23f40a3300 0x7f23f40a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:47.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.194+0000 7f23ff7fe640 1 -- 172.21.15.19:0/2567707137 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f23f00f01d0 con 0x7f2408101c00 2024-09-19T08:51:47.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.195+0000 7f2405d9b640 1 --2- 172.21.15.19:0/2567707137 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f23f40a3300 0x7f23f40a57c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2408199480 tx=0x7f23f800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:47.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.197+0000 7f23ff7fe640 1 -- 172.21.15.19:0/2567707137 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f23f00bc6f0 con 0x7f2408101c00 2024-09-19T08:51:47.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.382+0000 7f240cc3e640 1 -- 172.21.15.19:0/2567707137 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f2408062630 con 0x7f23f40a3300 2024-09-19T08:51:47.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.383+0000 7f23ff7fe640 1 -- 172.21.15.19:0/2567707137 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f2408062630 con 0x7f23f40a3300 2024-09-19T08:51:47.383 INFO:teuthology.orchestra.run.smithi019.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-19T08:51:47.383 INFO:teuthology.orchestra.run.smithi019.stdout:smithi019 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5330002G400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-09-19T08:51:47.383 INFO:teuthology.orchestra.run.smithi019.stdout:smithi155 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300GW400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T08:51:47.383 INFO:teuthology.orchestra.run.smithi019.stdout:smithi203 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300GK400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T08:51:47.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.386+0000 7f240cc3e640 1 -- 172.21.15.19:0/2567707137 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f23f40a3300 msgr2=0x7f23f40a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:47.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.386+0000 7f240cc3e640 1 --2- 172.21.15.19:0/2567707137 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f23f40a3300 0x7f23f40a57c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2408199480 tx=0x7f23f800b390 comp rx=0 tx=0).stop 2024-09-19T08:51:47.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.386+0000 7f240cc3e640 1 -- 172.21.15.19:0/2567707137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2408101c00 msgr2=0x7f2408197f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:47.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.386+0000 7f240cc3e640 1 --2- 172.21.15.19:0/2567707137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2408101c00 0x7f2408197f60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f23f0031610 tx=0x7f23f00043b0 comp rx=0 tx=0).stop 2024-09-19T08:51:47.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.386+0000 7f240cc3e640 1 -- 172.21.15.19:0/2567707137 shutdown_connections 2024-09-19T08:51:47.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.386+0000 7f240cc3e640 1 --2- 172.21.15.19:0/2567707137 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f23f40a3300 0x7f23f40a57c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:47.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.386+0000 7f240cc3e640 1 --2- 172.21.15.19:0/2567707137 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f24081037c0 0x7f240819f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:47.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.386+0000 7f240cc3e640 1 --2- 172.21.15.19:0/2567707137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2408102e00 0x7f24081984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:47.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.386+0000 7f240cc3e640 1 --2- 172.21.15.19:0/2567707137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2408101c00 0x7f2408197f60 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:47.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.386+0000 7f240cc3e640 1 -- 172.21.15.19:0/2567707137 >> 172.21.15.19:0/2567707137 conn(0x7f24080fd390 msgr2=0x7f24081061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:47.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.386+0000 7f240cc3e640 1 -- 172.21.15.19:0/2567707137 shutdown_connections 2024-09-19T08:51:47.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:47.386+0000 7f240cc3e640 1 -- 172.21.15.19:0/2567707137 wait complete. 2024-09-19T08:51:47.691 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:47 smithi019 ceph-mon[30976]: pgmap v324: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T08:51:47.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:47 smithi155 ceph-mon[34921]: pgmap v324: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T08:51:47.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:47 smithi203 ceph-mon[35450]: pgmap v324: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T08:51:48.138 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T08:51:48.148 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi019.front.sepia.ceph.com 2024-09-19T08:51:48.148 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-19T08:51:48.406 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:48.805 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:48 smithi019 ceph-mon[30976]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:51:48.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.888+0000 7fec106f2640 1 -- 172.21.15.19:0/712616351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec08102e00 msgr2=0x7fec08103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:48.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.888+0000 7fec106f2640 1 --2- 172.21.15.19:0/712616351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec08102e00 0x7fec08103280 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7febf8009900 tx=0x7febf802a410 comp rx=0 tx=0).stop 2024-09-19T08:51:48.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.889+0000 7fec106f2640 1 -- 172.21.15.19:0/712616351 shutdown_connections 2024-09-19T08:51:48.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.889+0000 7fec106f2640 1 --2- 172.21.15.19:0/712616351 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec081037c0 0x7fec0810a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:48.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.889+0000 7fec106f2640 1 --2- 172.21.15.19:0/712616351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec08102e00 0x7fec08103280 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:48.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.889+0000 7fec106f2640 1 --2- 172.21.15.19:0/712616351 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec08101c00 0x7fec08102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:48.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.889+0000 7fec106f2640 1 -- 172.21.15.19:0/712616351 >> 172.21.15.19:0/712616351 conn(0x7fec080fd390 msgr2=0x7fec080ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:48.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.889+0000 7fec106f2640 1 -- 172.21.15.19:0/712616351 shutdown_connections 2024-09-19T08:51:48.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.889+0000 7fec106f2640 1 -- 172.21.15.19:0/712616351 wait complete. 2024-09-19T08:51:48.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.889+0000 7fec106f2640 1 Processor -- start 2024-09-19T08:51:48.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.889+0000 7fec106f2640 1 -- start start 2024-09-19T08:51:48.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.890+0000 7fec106f2640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec08101c00 0x7fec08197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:48.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.890+0000 7fec106f2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec08102e00 0x7fec08198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:48.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.890+0000 7fec106f2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec081037c0 0x7fec0819f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:48.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.890+0000 7fec106f2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fec0810d8b0 con 0x7fec08102e00 2024-09-19T08:51:48.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.890+0000 7fec106f2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fec0810d730 con 0x7fec081037c0 2024-09-19T08:51:48.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.890+0000 7fec106f2640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fec0810da30 con 0x7fec08101c00 2024-09-19T08:51:48.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.890+0000 7fec0dc8d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec08102e00 0x7fec08198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:48.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.890+0000 7fec0dc8d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec08102e00 0x7fec08198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59784/0 (socket says 172.21.15.19:59784) 2024-09-19T08:51:48.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.890+0000 7fec0dc8d640 1 -- 172.21.15.19:0/1547857419 learned_addr learned my addr 172.21.15.19:0/1547857419 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:48.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.890+0000 7fec0e48e640 1 --2- 172.21.15.19:0/1547857419 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec08101c00 0x7fec08197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:48.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.890+0000 7fec0ec8f640 1 --2- 172.21.15.19:0/1547857419 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec081037c0 0x7fec0819f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:48.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.890+0000 7fec0dc8d640 1 -- 172.21.15.19:0/1547857419 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec08101c00 msgr2=0x7fec08197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:48.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.890+0000 7fec0dc8d640 1 --2- 172.21.15.19:0/1547857419 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec08101c00 0x7fec08197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:48.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.890+0000 7fec0dc8d640 1 -- 172.21.15.19:0/1547857419 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec081037c0 msgr2=0x7fec0819f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:48.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.890+0000 7fec0dc8d640 1 --2- 172.21.15.19:0/1547857419 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec081037c0 0x7fec0819f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:48.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.890+0000 7fec0dc8d640 1 -- 172.21.15.19:0/1547857419 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec0819fb30 con 0x7fec08102e00 2024-09-19T08:51:48.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.890+0000 7fec0dc8d640 1 --2- 172.21.15.19:0/1547857419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec08102e00 0x7fec08198440 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7febf8031440 tx=0x7febf8032e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:48.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.890+0000 7febff7fe640 1 -- 172.21.15.19:0/1547857419 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf803f030 con 0x7fec08102e00 2024-09-19T08:51:48.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.890+0000 7fec106f2640 1 -- 172.21.15.19:0/1547857419 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec0819fdc0 con 0x7fec08102e00 2024-09-19T08:51:48.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.890+0000 7febff7fe640 1 -- 172.21.15.19:0/1547857419 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7febf8003ce0 con 0x7fec08102e00 2024-09-19T08:51:48.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.891+0000 7febff7fe640 1 -- 172.21.15.19:0/1547857419 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febf8035070 con 0x7fec08102e00 2024-09-19T08:51:48.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.891+0000 7fec106f2640 1 -- 172.21.15.19:0/1547857419 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec081a0210 con 0x7fec08102e00 2024-09-19T08:51:48.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.892+0000 7fec106f2640 1 -- 172.21.15.19:0/1547857419 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec08108fb0 con 0x7fec08102e00 2024-09-19T08:51:48.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.893+0000 7febff7fe640 1 -- 172.21.15.19:0/1547857419 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7febf8042030 con 0x7fec08102e00 2024-09-19T08:51:48.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.893+0000 7febff7fe640 1 --2- 172.21.15.19:0/1547857419 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7febf40a3300 0x7febf40a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:48.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.893+0000 7fec0e48e640 1 --2- 172.21.15.19:0/1547857419 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7febf40a3300 0x7febf40a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:48.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.893+0000 7febff7fe640 1 -- 172.21.15.19:0/1547857419 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7febf80efff0 con 0x7fec08102e00 2024-09-19T08:51:48.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.894+0000 7fec0e48e640 1 --2- 172.21.15.19:0/1547857419 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7febf40a3300 0x7febf40a57c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fec08102c60 tx=0x7fec0400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:48.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:48.897+0000 7febff7fe640 1 -- 172.21.15.19:0/1547857419 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7febf80bc570 con 0x7fec08102e00 2024-09-19T08:51:48.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:48 smithi155 ceph-mon[34921]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:51:48.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:48 smithi203 ceph-mon[35450]: from='client.15087 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:51:49.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:49.109+0000 7fec106f2640 1 -- 172.21.15.19:0/1547857419 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fec0802d9c0 con 0x7fec08102e00 2024-09-19T08:51:49.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:49.109+0000 7febff7fe640 1 -- 172.21.15.19:0/1547857419 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) ==== 76+0+3134 (secure 0 0 0) 0x7febf80c0870 con 0x7fec08102e00 2024-09-19T08:51:49.108 INFO:teuthology.orchestra.run.smithi019.stdout:e27 2024-09-19T08:51:49.109 INFO:teuthology.orchestra.run.smithi019.stdout:btime 2024-09-19T08:50:27:938748+0000 2024-09-19T08:51:49.109 INFO:teuthology.orchestra.run.smithi019.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T08:51:49.109 INFO:teuthology.orchestra.run.smithi019.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T08:51:49.109 INFO:teuthology.orchestra.run.smithi019.stdout:legacy client fscid: 1 2024-09-19T08:51:49.109 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:51:49.109 INFO:teuthology.orchestra.run.smithi019.stdout:Filesystem 'cephfs' (1) 2024-09-19T08:51:49.109 INFO:teuthology.orchestra.run.smithi019.stdout:fs_name cephfs 2024-09-19T08:51:49.109 INFO:teuthology.orchestra.run.smithi019.stdout:epoch 27 2024-09-19T08:51:49.109 INFO:teuthology.orchestra.run.smithi019.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T08:51:49.109 INFO:teuthology.orchestra.run.smithi019.stdout:created 2024-09-19T08:50:16.477197+0000 2024-09-19T08:51:49.109 INFO:teuthology.orchestra.run.smithi019.stdout:modified 2024-09-19T08:50:27.938727+0000 2024-09-19T08:51:49.109 INFO:teuthology.orchestra.run.smithi019.stdout:tableserver 0 2024-09-19T08:51:49.110 INFO:teuthology.orchestra.run.smithi019.stdout:root 0 2024-09-19T08:51:49.110 INFO:teuthology.orchestra.run.smithi019.stdout:session_timeout 300 2024-09-19T08:51:49.110 INFO:teuthology.orchestra.run.smithi019.stdout:session_autoclose 300 2024-09-19T08:51:49.110 INFO:teuthology.orchestra.run.smithi019.stdout:max_file_size 1099511627776 2024-09-19T08:51:49.110 INFO:teuthology.orchestra.run.smithi019.stdout:max_xattr_size 65536 2024-09-19T08:51:49.110 INFO:teuthology.orchestra.run.smithi019.stdout:required_client_features {} 2024-09-19T08:51:49.110 INFO:teuthology.orchestra.run.smithi019.stdout:last_failure 0 2024-09-19T08:51:49.110 INFO:teuthology.orchestra.run.smithi019.stdout:last_failure_osd_epoch 0 2024-09-19T08:51:49.110 INFO:teuthology.orchestra.run.smithi019.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T08:51:49.110 INFO:teuthology.orchestra.run.smithi019.stdout:max_mds 5 2024-09-19T08:51:49.110 INFO:teuthology.orchestra.run.smithi019.stdout:in 0,1,2,3,4 2024-09-19T08:51:49.110 INFO:teuthology.orchestra.run.smithi019.stdout:up {0=24497,1=24490,2=24469,3=24464,4=24463} 2024-09-19T08:51:49.110 INFO:teuthology.orchestra.run.smithi019.stdout:failed 2024-09-19T08:51:49.110 INFO:teuthology.orchestra.run.smithi019.stdout:damaged 2024-09-19T08:51:49.110 INFO:teuthology.orchestra.run.smithi019.stdout:stopped 2024-09-19T08:51:49.110 INFO:teuthology.orchestra.run.smithi019.stdout:data_pools [3] 2024-09-19T08:51:49.111 INFO:teuthology.orchestra.run.smithi019.stdout:metadata_pool 2 2024-09-19T08:51:49.111 INFO:teuthology.orchestra.run.smithi019.stdout:inline_data disabled 2024-09-19T08:51:49.111 INFO:teuthology.orchestra.run.smithi019.stdout:balancer 2024-09-19T08:51:49.111 INFO:teuthology.orchestra.run.smithi019.stdout:bal_rank_mask -1 2024-09-19T08:51:49.111 INFO:teuthology.orchestra.run.smithi019.stdout:standby_count_wanted 0 2024-09-19T08:51:49.111 INFO:teuthology.orchestra.run.smithi019.stdout:qdb_cluster leader: 24497 members: 24497,24469,24490,24464,24463 2024-09-19T08:51:49.111 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.b{0:24497} state up:active seq 4 addr [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:51:49.111 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.e{0:24449} state up:standby-replay seq 1 addr [v2:172.21.15.155:6834/2480841559,v1:172.21.15.155:6835/2480841559] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:51:49.111 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.i{1:24490} state up:active seq 8 addr [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:51:49.111 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.j{1:24431} state up:standby-replay seq 1 addr [v2:172.21.15.19:6834/805488508,v1:172.21.15.19:6835/805488508] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:51:49.111 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.c{2:24469} state up:active seq 10 addr [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:51:49.111 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.k{2:24419} state up:standby-replay seq 1 addr [v2:172.21.15.155:6832/3575511501,v1:172.21.15.155:6833/3575511501] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:51:49.111 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.h{3:24464} state up:active seq 9 addr [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:51:49.111 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.l{3:24418} state up:standby-replay seq 1 addr [v2:172.21.15.203:6832/471920691,v1:172.21.15.203:6833/471920691] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:51:49.111 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.f{4:24463} state up:active seq 11 addr [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:51:49.112 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.a{4:14619} state up:standby-replay seq 1 addr [v2:172.21.15.19:6840/1973648402,v1:172.21.15.19:6841/1973648402] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:51:49.112 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:51:49.112 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:51:49.112 INFO:teuthology.orchestra.run.smithi019.stdout:Standby daemons: 2024-09-19T08:51:49.112 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:51:49.112 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.d{-1:14556} state up:standby seq 1 addr [v2:172.21.15.19:6836/1501683219,v1:172.21.15.19:6837/1501683219] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:51:49.112 INFO:teuthology.orchestra.run.smithi019.stdout:[mds.g{-1:14607} state up:standby seq 1 addr [v2:172.21.15.19:6838/2452068876,v1:172.21.15.19:6839/2452068876] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T08:51:49.113 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 27 2024-09-19T08:51:49.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:49.112+0000 7fec106f2640 1 -- 172.21.15.19:0/1547857419 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7febf40a3300 msgr2=0x7febf40a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:49.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:49.112+0000 7fec106f2640 1 --2- 172.21.15.19:0/1547857419 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7febf40a3300 0x7febf40a57c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fec08102c60 tx=0x7fec0400a2d0 comp rx=0 tx=0).stop 2024-09-19T08:51:49.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:49.112+0000 7fec106f2640 1 -- 172.21.15.19:0/1547857419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec08102e00 msgr2=0x7fec08198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:49.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:49.112+0000 7fec106f2640 1 --2- 172.21.15.19:0/1547857419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec08102e00 0x7fec08198440 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7febf8031440 tx=0x7febf8032e20 comp rx=0 tx=0).stop 2024-09-19T08:51:49.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:49.112+0000 7fec106f2640 1 -- 172.21.15.19:0/1547857419 shutdown_connections 2024-09-19T08:51:49.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:49.112+0000 7fec106f2640 1 --2- 172.21.15.19:0/1547857419 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7febf40a3300 0x7febf40a57c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:49.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:49.112+0000 7fec106f2640 1 --2- 172.21.15.19:0/1547857419 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec081037c0 0x7fec0819f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:49.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:49.112+0000 7fec106f2640 1 --2- 172.21.15.19:0/1547857419 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec08102e00 0x7fec08198440 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:49.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:49.112+0000 7fec106f2640 1 --2- 172.21.15.19:0/1547857419 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec08101c00 0x7fec08197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:49.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:49.112+0000 7fec106f2640 1 -- 172.21.15.19:0/1547857419 >> 172.21.15.19:0/1547857419 conn(0x7fec080fd390 msgr2=0x7fec08106180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:49.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:49.112+0000 7fec106f2640 1 -- 172.21.15.19:0/1547857419 shutdown_connections 2024-09-19T08:51:49.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:49.112+0000 7fec106f2640 1 -- 172.21.15.19:0/1547857419 wait complete. 2024-09-19T08:51:49.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:49 smithi019 ceph-mon[30976]: pgmap v325: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T08:51:49.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:49 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1547857419' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T08:51:49.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:49 smithi155 ceph-mon[34921]: pgmap v325: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T08:51:49.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:49 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1547857419' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T08:51:49.928 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-19T08:51:49.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:49 smithi203 ceph-mon[35450]: pgmap v325: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T08:51:49.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:49 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1547857419' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T08:51:50.188 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:50.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.657+0000 7f5fb9e97640 1 -- 172.21.15.19:0/1704937814 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fb41037c0 msgr2=0x7f5fb410a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:50.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.657+0000 7f5fb9e97640 1 --2- 172.21.15.19:0/1704937814 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fb41037c0 0x7f5fb410a050 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f5fac009ca0 tx=0x7f5fac02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:51:50.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.657+0000 7f5fb9e97640 1 -- 172.21.15.19:0/1704937814 shutdown_connections 2024-09-19T08:51:50.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.657+0000 7f5fb9e97640 1 --2- 172.21.15.19:0/1704937814 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5fb4102e00 0x7f5fb4103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:50.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.657+0000 7f5fb9e97640 1 --2- 172.21.15.19:0/1704937814 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fb41037c0 0x7f5fb410a050 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:50.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.657+0000 7f5fb9e97640 1 --2- 172.21.15.19:0/1704937814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5fb4101c00 0x7f5fb4102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:50.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.657+0000 7f5fb9e97640 1 -- 172.21.15.19:0/1704937814 >> 172.21.15.19:0/1704937814 conn(0x7f5fb40fd390 msgr2=0x7f5fb40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:50.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.658+0000 7f5fb9e97640 1 -- 172.21.15.19:0/1704937814 shutdown_connections 2024-09-19T08:51:50.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.658+0000 7f5fb9e97640 1 -- 172.21.15.19:0/1704937814 wait complete. 2024-09-19T08:51:50.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.658+0000 7f5fb9e97640 1 Processor -- start 2024-09-19T08:51:50.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.658+0000 7f5fb9e97640 1 -- start start 2024-09-19T08:51:50.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.658+0000 7f5fb9e97640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5fb4101c00 0x7f5fb4197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:50.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.658+0000 7f5fb9e97640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fb4102e00 0x7f5fb4198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:50.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.658+0000 7f5fb9e97640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5fb41037c0 0x7f5fb419f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:50.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.658+0000 7f5fb9e97640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb410d8e0 con 0x7f5fb4102e00 2024-09-19T08:51:50.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.658+0000 7f5fb9e97640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb410d760 con 0x7f5fb4101c00 2024-09-19T08:51:50.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.658+0000 7f5fb9e97640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb410da60 con 0x7f5fb41037c0 2024-09-19T08:51:50.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.659+0000 7f5fb2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fb4102e00 0x7f5fb4198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:50.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.659+0000 7f5fb2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fb4102e00 0x7f5fb4198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59800/0 (socket says 172.21.15.19:59800) 2024-09-19T08:51:50.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.659+0000 7f5fb2ffd640 1 -- 172.21.15.19:0/1056431010 learned_addr learned my addr 172.21.15.19:0/1056431010 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:50.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.659+0000 7f5fb37fe640 1 --2- 172.21.15.19:0/1056431010 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5fb4101c00 0x7f5fb4197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:50.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.659+0000 7f5fb3fff640 1 --2- 172.21.15.19:0/1056431010 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5fb41037c0 0x7f5fb419f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:50.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.659+0000 7f5fb2ffd640 1 -- 172.21.15.19:0/1056431010 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5fb41037c0 msgr2=0x7f5fb419f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:50.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.659+0000 7f5fb2ffd640 1 --2- 172.21.15.19:0/1056431010 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5fb41037c0 0x7f5fb419f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:50.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.659+0000 7f5fb2ffd640 1 -- 172.21.15.19:0/1056431010 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5fb4101c00 msgr2=0x7f5fb4197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:50.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.659+0000 7f5fb2ffd640 1 --2- 172.21.15.19:0/1056431010 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5fb4101c00 0x7f5fb4197e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:50.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.659+0000 7f5fb2ffd640 1 -- 172.21.15.19:0/1056431010 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fb419fa80 con 0x7f5fb4102e00 2024-09-19T08:51:50.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.659+0000 7f5fb37fe640 1 --2- 172.21.15.19:0/1056431010 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5fb4101c00 0x7f5fb4197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:50.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.659+0000 7f5fb2ffd640 1 --2- 172.21.15.19:0/1056431010 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fb4102e00 0x7f5fb4198390 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5fa800b4a0 tx=0x7f5fa800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:50.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.659+0000 7f5fb0ff9640 1 -- 172.21.15.19:0/1056431010 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa8014070 con 0x7f5fb4102e00 2024-09-19T08:51:50.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.659+0000 7f5fb9e97640 1 -- 172.21.15.19:0/1056431010 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fb419fd70 con 0x7f5fb4102e00 2024-09-19T08:51:50.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.659+0000 7f5fb0ff9640 1 -- 172.21.15.19:0/1056431010 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5fa8010af0 con 0x7f5fb4102e00 2024-09-19T08:51:50.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.659+0000 7f5fb0ff9640 1 -- 172.21.15.19:0/1056431010 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fa8017d10 con 0x7f5fb4102e00 2024-09-19T08:51:50.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.659+0000 7f5fb9e97640 1 -- 172.21.15.19:0/1056431010 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fb41a02d0 con 0x7f5fb4102e00 2024-09-19T08:51:50.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.660+0000 7f5fb9e97640 1 -- 172.21.15.19:0/1056431010 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fb4108f30 con 0x7f5fb4102e00 2024-09-19T08:51:50.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.661+0000 7f5fb0ff9640 1 -- 172.21.15.19:0/1056431010 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5fa8017070 con 0x7f5fb4102e00 2024-09-19T08:51:50.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.662+0000 7f5fb0ff9640 1 --2- 172.21.15.19:0/1056431010 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5f9c0a3300 0x7f5f9c0a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:50.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.662+0000 7f5fb37fe640 1 --2- 172.21.15.19:0/1056431010 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5f9c0a3300 0x7f5f9c0a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:50.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.662+0000 7f5fb0ff9640 1 -- 172.21.15.19:0/1056431010 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5fa80cedd0 con 0x7f5fb4102e00 2024-09-19T08:51:50.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.663+0000 7f5fb37fe640 1 --2- 172.21.15.19:0/1056431010 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5f9c0a3300 0x7f5f9c0a57c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4102c60 tx=0x7f5fa400a5e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:50.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.666+0000 7f5fb0ff9640 1 -- 172.21.15.19:0/1056431010 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5fa809bab0 con 0x7f5fb4102e00 2024-09-19T08:51:50.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.845+0000 7f5fb9e97640 1 -- 172.21.15.19:0/1056431010 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f5fb402d9b0 con 0x7f5fb4102e00 2024-09-19T08:51:50.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.845+0000 7f5fb0ff9640 1 -- 172.21.15.19:0/1056431010 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v82) ==== 56+0+5274 (secure 0 0 0) 0x7f5fa809b3b0 con 0x7f5fb4102e00 2024-09-19T08:51:50.845 INFO:teuthology.orchestra.run.smithi019.stdout:epoch 82 2024-09-19T08:51:50.845 INFO:teuthology.orchestra.run.smithi019.stdout:fsid f26c9d84-7662-11ef-bceb-c7b262605968 2024-09-19T08:51:50.845 INFO:teuthology.orchestra.run.smithi019.stdout:created 2024-09-19T08:42:32.324073+0000 2024-09-19T08:51:50.845 INFO:teuthology.orchestra.run.smithi019.stdout:modified 2024-09-19T08:51:23.536977+0000 2024-09-19T08:51:50.845 INFO:teuthology.orchestra.run.smithi019.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-19T08:51:50.845 INFO:teuthology.orchestra.run.smithi019.stdout:crush_version 26 2024-09-19T08:51:50.845 INFO:teuthology.orchestra.run.smithi019.stdout:full_ratio 0.95 2024-09-19T08:51:50.846 INFO:teuthology.orchestra.run.smithi019.stdout:backfillfull_ratio 0.9 2024-09-19T08:51:50.846 INFO:teuthology.orchestra.run.smithi019.stdout:nearfull_ratio 0.85 2024-09-19T08:51:50.846 INFO:teuthology.orchestra.run.smithi019.stdout:require_min_compat_client luminous 2024-09-19T08:51:50.846 INFO:teuthology.orchestra.run.smithi019.stdout:min_compat_client luminous 2024-09-19T08:51:50.846 INFO:teuthology.orchestra.run.smithi019.stdout:require_osd_release squid 2024-09-19T08:51:50.846 INFO:teuthology.orchestra.run.smithi019.stdout:stretch_mode_enabled false 2024-09-19T08:51:50.846 INFO:teuthology.orchestra.run.smithi019.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-19T08:51:50.846 INFO:teuthology.orchestra.run.smithi019.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-09-19T08:51:50.846 INFO:teuthology.orchestra.run.smithi019.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-19T08:51:50.846 INFO:teuthology.orchestra.run.smithi019.stdout:max_osd 12 2024-09-19T08:51:50.846 INFO:teuthology.orchestra.run.smithi019.stdout:osd.0 up in weight 1 up_from 8 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.19:6802/3397146732,v1:172.21.15.19:6803/3397146732] [v2:172.21.15.19:6804/3397146732,v1:172.21.15.19:6805/3397146732] exists,up 81c7bb06-5b13-4ee0-9290-d779faac1b91 2024-09-19T08:51:50.846 INFO:teuthology.orchestra.run.smithi019.stdout:osd.1 up in weight 1 up_from 13 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.155:6800/2011043685,v1:172.21.15.155:6801/2011043685] [v2:172.21.15.155:6802/2011043685,v1:172.21.15.155:6803/2011043685] exists,up 24c145e6-5252-4708-8f25-5ce041e8251e 2024-09-19T08:51:50.846 INFO:teuthology.orchestra.run.smithi019.stdout:osd.2 up in weight 1 up_from 18 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.203:6800/3358994623,v1:172.21.15.203:6801/3358994623] [v2:172.21.15.203:6802/3358994623,v1:172.21.15.203:6803/3358994623] exists,up 99cefd33-0675-495f-8871-2e6fdead0c3a 2024-09-19T08:51:50.847 INFO:teuthology.orchestra.run.smithi019.stdout:osd.3 up in weight 1 up_from 25 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.19:6810/176445576,v1:172.21.15.19:6811/176445576] [v2:172.21.15.19:6812/176445576,v1:172.21.15.19:6813/176445576] exists,up 8f46c16c-f17e-484a-8b66-6dbf135f34c3 2024-09-19T08:51:50.847 INFO:teuthology.orchestra.run.smithi019.stdout:osd.4 up in weight 1 up_from 32 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.155:6808/2163087792,v1:172.21.15.155:6809/2163087792] [v2:172.21.15.155:6810/2163087792,v1:172.21.15.155:6811/2163087792] exists,up 411b0423-1317-4e82-bc01-b5f55b391bc7 2024-09-19T08:51:50.847 INFO:teuthology.orchestra.run.smithi019.stdout:osd.5 up in weight 1 up_from 36 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.203:6808/334881465,v1:172.21.15.203:6809/334881465] [v2:172.21.15.203:6810/334881465,v1:172.21.15.203:6811/334881465] exists,up 057c073e-569f-4c6e-9602-e1169ad4dd8e 2024-09-19T08:51:50.847 INFO:teuthology.orchestra.run.smithi019.stdout:osd.6 up in weight 1 up_from 43 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.19:6818/2669779791,v1:172.21.15.19:6819/2669779791] [v2:172.21.15.19:6820/2669779791,v1:172.21.15.19:6821/2669779791] exists,up 40418f13-823e-4f94-a427-84781abbcb5e 2024-09-19T08:51:50.847 INFO:teuthology.orchestra.run.smithi019.stdout:osd.7 up in weight 1 up_from 48 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.155:6816/3169455907,v1:172.21.15.155:6817/3169455907] [v2:172.21.15.155:6818/3169455907,v1:172.21.15.155:6819/3169455907] exists,up ad15f762-aeab-4167-a63d-6c9f9b89b9c0 2024-09-19T08:51:50.847 INFO:teuthology.orchestra.run.smithi019.stdout:osd.8 up in weight 1 up_from 55 up_thru 78 down_at 0 last_clean_interval [0,0) [v2:172.21.15.203:6816/1062999528,v1:172.21.15.203:6817/1062999528] [v2:172.21.15.203:6818/1062999528,v1:172.21.15.203:6819/1062999528] exists,up 23cf8ea2-29d6-43d8-a05b-7822f4bbf254 2024-09-19T08:51:50.847 INFO:teuthology.orchestra.run.smithi019.stdout:osd.9 up in weight 1 up_from 62 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.19:6826/574664786,v1:172.21.15.19:6827/574664786] [v2:172.21.15.19:6828/574664786,v1:172.21.15.19:6829/574664786] exists,up e851e605-2d17-4fbf-b783-2138133edd06 2024-09-19T08:51:50.847 INFO:teuthology.orchestra.run.smithi019.stdout:osd.10 up in weight 1 up_from 67 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.155:6824/2242158832,v1:172.21.15.155:6825/2242158832] [v2:172.21.15.155:6826/2242158832,v1:172.21.15.155:6827/2242158832] exists,up cc770717-91bd-4494-9103-6db8214b5872 2024-09-19T08:51:50.847 INFO:teuthology.orchestra.run.smithi019.stdout:osd.11 up in weight 1 up_from 74 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.203:6824/522943955,v1:172.21.15.203:6825/522943955] [v2:172.21.15.203:6826/522943955,v1:172.21.15.203:6827/522943955] exists,up 6c237db9-5d79-47bc-8ff6-60d09d721d5d 2024-09-19T08:51:50.847 INFO:teuthology.orchestra.run.smithi019.stdout:pg_upmap_items 2.a [2,11] 2024-09-19T08:51:50.847 INFO:teuthology.orchestra.run.smithi019.stdout:pg_upmap_items 2.16 [2,4] 2024-09-19T08:51:50.847 INFO:teuthology.orchestra.run.smithi019.stdout:pg_upmap_items 2.1a [8,1] 2024-09-19T08:51:50.847 INFO:teuthology.orchestra.run.smithi019.stdout:pg_upmap_items 2.1f [7,11] 2024-09-19T08:51:50.847 INFO:teuthology.orchestra.run.smithi019.stdout:pg_upmap_items 3.0 [4,8] 2024-09-19T08:51:50.847 INFO:teuthology.orchestra.run.smithi019.stdout:pg_upmap_items 3.3 [4,9] 2024-09-19T08:51:50.848 INFO:teuthology.orchestra.run.smithi019.stdout:pg_upmap_items 3.c [3,9] 2024-09-19T08:51:50.848 INFO:teuthology.orchestra.run.smithi019.stdout:pg_upmap_items 3.e [5,9] 2024-09-19T08:51:50.848 INFO:teuthology.orchestra.run.smithi019.stdout:blocklist 172.21.15.19:6801/4266644067 expires 2024-09-20T08:43:21.732222+0000 2024-09-19T08:51:50.848 INFO:teuthology.orchestra.run.smithi019.stdout:blocklist 172.21.15.19:0/1398782170 expires 2024-09-20T08:43:21.732222+0000 2024-09-19T08:51:50.848 INFO:teuthology.orchestra.run.smithi019.stdout:blocklist 172.21.15.19:6800/4266644067 expires 2024-09-20T08:43:21.732222+0000 2024-09-19T08:51:50.848 INFO:teuthology.orchestra.run.smithi019.stdout:blocklist 172.21.15.19:0/34162461 expires 2024-09-20T08:43:21.732222+0000 2024-09-19T08:51:50.848 INFO:teuthology.orchestra.run.smithi019.stdout:blocklist 172.21.15.19:6801/1764769529 expires 2024-09-20T08:42:56.618773+0000 2024-09-19T08:51:50.848 INFO:teuthology.orchestra.run.smithi019.stdout:blocklist 172.21.15.19:0/2910961714 expires 2024-09-20T08:43:21.732222+0000 2024-09-19T08:51:50.848 INFO:teuthology.orchestra.run.smithi019.stdout:blocklist 172.21.15.19:6800/1764769529 expires 2024-09-20T08:42:56.618773+0000 2024-09-19T08:51:50.848 INFO:teuthology.orchestra.run.smithi019.stdout:blocklist 172.21.15.19:0/820792769 expires 2024-09-20T08:42:56.618773+0000 2024-09-19T08:51:50.848 INFO:teuthology.orchestra.run.smithi019.stdout:blocklist 172.21.15.19:0/560203138 expires 2024-09-20T08:42:56.618773+0000 2024-09-19T08:51:50.848 INFO:teuthology.orchestra.run.smithi019.stdout:blocklist 172.21.15.19:0/809642328 expires 2024-09-20T08:42:56.618773+0000 2024-09-19T08:51:50.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.847+0000 7f5fb9e97640 1 -- 172.21.15.19:0/1056431010 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5f9c0a3300 msgr2=0x7f5f9c0a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:50.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.847+0000 7f5fb9e97640 1 --2- 172.21.15.19:0/1056431010 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5f9c0a3300 0x7f5f9c0a57c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4102c60 tx=0x7f5fa400a5e0 comp rx=0 tx=0).stop 2024-09-19T08:51:50.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.848+0000 7f5fb9e97640 1 -- 172.21.15.19:0/1056431010 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fb4102e00 msgr2=0x7f5fb4198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:50.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.848+0000 7f5fb9e97640 1 --2- 172.21.15.19:0/1056431010 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fb4102e00 0x7f5fb4198390 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5fa800b4a0 tx=0x7f5fa800b960 comp rx=0 tx=0).stop 2024-09-19T08:51:50.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.848+0000 7f5fb9e97640 1 -- 172.21.15.19:0/1056431010 shutdown_connections 2024-09-19T08:51:50.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.848+0000 7f5fb9e97640 1 --2- 172.21.15.19:0/1056431010 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5f9c0a3300 0x7f5f9c0a57c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:50.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.848+0000 7f5fb9e97640 1 --2- 172.21.15.19:0/1056431010 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5fb41037c0 0x7f5fb419f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:50.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.848+0000 7f5fb9e97640 1 --2- 172.21.15.19:0/1056431010 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5fb4102e00 0x7f5fb4198390 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:50.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.848+0000 7f5fb9e97640 1 --2- 172.21.15.19:0/1056431010 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5fb4101c00 0x7f5fb4197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:50.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.848+0000 7f5fb9e97640 1 -- 172.21.15.19:0/1056431010 >> 172.21.15.19:0/1056431010 conn(0x7f5fb40fd390 msgr2=0x7f5fb4106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:50.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.848+0000 7f5fb9e97640 1 -- 172.21.15.19:0/1056431010 shutdown_connections 2024-09-19T08:51:50.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:50.848+0000 7f5fb9e97640 1 -- 172.21.15.19:0/1056431010 wait complete. 2024-09-19T08:51:51.703 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-19T08:51:51.715 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:51:51.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:51 smithi155 ceph-mon[34921]: pgmap v326: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T08:51:51.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:51 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1056431010' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T08:51:51.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:51 smithi203 ceph-mon[35450]: pgmap v326: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T08:51:51.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:51 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1056431010' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T08:51:52.003 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:52.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:51 smithi019 ceph-mon[30976]: pgmap v326: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T08:51:52.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:51 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1056431010' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T08:51:52.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.459+0000 7fc18008d640 1 -- 172.21.15.19:0/534955969 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1781009d0 msgr2=0x7fc178100db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:52.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.459+0000 7fc18008d640 1 --2- 172.21.15.19:0/534955969 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1781009d0 0x7fc178100db0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc174009900 tx=0x7fc17402a410 comp rx=0 tx=0).stop 2024-09-19T08:51:52.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.459+0000 7fc18008d640 1 -- 172.21.15.19:0/534955969 shutdown_connections 2024-09-19T08:51:52.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.459+0000 7fc18008d640 1 --2- 172.21.15.19:0/534955969 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc178101380 0x7fc17810dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:52.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.459+0000 7fc18008d640 1 --2- 172.21.15.19:0/534955969 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc17810e4f0 0x7fc178110900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:52.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.459+0000 7fc18008d640 1 --2- 172.21.15.19:0/534955969 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc1781009d0 0x7fc178100db0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:52.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.459+0000 7fc18008d640 1 -- 172.21.15.19:0/534955969 >> 172.21.15.19:0/534955969 conn(0x7fc1780fc7d0 msgr2=0x7fc1780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:52.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.459+0000 7fc18008d640 1 -- 172.21.15.19:0/534955969 shutdown_connections 2024-09-19T08:51:52.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.459+0000 7fc18008d640 1 -- 172.21.15.19:0/534955969 wait complete. 2024-09-19T08:51:52.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.460+0000 7fc18008d640 1 Processor -- start 2024-09-19T08:51:52.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.460+0000 7fc18008d640 1 -- start start 2024-09-19T08:51:52.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.460+0000 7fc18008d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc1781009d0 0x7fc17819a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:52.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.460+0000 7fc18008d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc178101380 0x7fc17819ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:52.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.460+0000 7fc18008d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc17810e4f0 0x7fc17819f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:52.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.460+0000 7fc18008d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc178114270 con 0x7fc178101380 2024-09-19T08:51:52.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.460+0000 7fc18008d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc1781140f0 con 0x7fc17810e4f0 2024-09-19T08:51:52.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.460+0000 7fc18008d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc1781143f0 con 0x7fc1781009d0 2024-09-19T08:51:52.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.460+0000 7fc17d628640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc178101380 0x7fc17819ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:52.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.460+0000 7fc17d628640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc178101380 0x7fc17819ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59818/0 (socket says 172.21.15.19:59818) 2024-09-19T08:51:52.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.460+0000 7fc17d628640 1 -- 172.21.15.19:0/1729133569 learned_addr learned my addr 172.21.15.19:0/1729133569 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:52.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.460+0000 7fc17de29640 1 --2- 172.21.15.19:0/1729133569 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc1781009d0 0x7fc17819a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:52.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.460+0000 7fc17e62a640 1 --2- 172.21.15.19:0/1729133569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc17810e4f0 0x7fc17819f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:52.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.460+0000 7fc17d628640 1 -- 172.21.15.19:0/1729133569 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc1781009d0 msgr2=0x7fc17819a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:52.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.460+0000 7fc17d628640 1 --2- 172.21.15.19:0/1729133569 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc1781009d0 0x7fc17819a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:52.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.460+0000 7fc17d628640 1 -- 172.21.15.19:0/1729133569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc17810e4f0 msgr2=0x7fc17819f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:52.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.460+0000 7fc17d628640 1 --2- 172.21.15.19:0/1729133569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc17810e4f0 0x7fc17819f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:52.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.460+0000 7fc17d628640 1 -- 172.21.15.19:0/1729133569 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc17819f700 con 0x7fc178101380 2024-09-19T08:51:52.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.461+0000 7fc17d628640 1 --2- 172.21.15.19:0/1729133569 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc178101380 0x7fc17819ac90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc16800d770 tx=0x7fc16800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:52.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.461+0000 7fc16effd640 1 -- 172.21.15.19:0/1729133569 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc168017070 con 0x7fc178101380 2024-09-19T08:51:52.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.461+0000 7fc18008d640 1 -- 172.21.15.19:0/1729133569 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc17819f9f0 con 0x7fc178101380 2024-09-19T08:51:52.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.461+0000 7fc16effd640 1 -- 172.21.15.19:0/1729133569 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc168005500 con 0x7fc178101380 2024-09-19T08:51:52.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.461+0000 7fc16effd640 1 -- 172.21.15.19:0/1729133569 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc168004e00 con 0x7fc178101380 2024-09-19T08:51:52.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.461+0000 7fc18008d640 1 -- 172.21.15.19:0/1729133569 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1781a72d0 con 0x7fc178101380 2024-09-19T08:51:52.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.462+0000 7fc18008d640 1 -- 172.21.15.19:0/1729133569 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc17806a7d0 con 0x7fc178101380 2024-09-19T08:51:52.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.463+0000 7fc16effd640 1 -- 172.21.15.19:0/1729133569 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fc168004fa0 con 0x7fc178101380 2024-09-19T08:51:52.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.464+0000 7fc16effd640 1 --2- 172.21.15.19:0/1729133569 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc1640a32d0 0x7fc1640a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:52.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.464+0000 7fc17de29640 1 --2- 172.21.15.19:0/1729133569 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc1640a32d0 0x7fc1640a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:52.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.464+0000 7fc16effd640 1 -- 172.21.15.19:0/1729133569 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc1680cf510 con 0x7fc178101380 2024-09-19T08:51:52.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.464+0000 7fc17de29640 1 --2- 172.21.15.19:0/1729133569 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc1640a32d0 0x7fc1640a5790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc174009230 tx=0x7fc1740058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:52.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.468+0000 7fc16effd640 1 -- 172.21.15.19:0/1729133569 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc16809c0e0 con 0x7fc178101380 2024-09-19T08:51:52.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.630+0000 7fc16effd640 1 -- 172.21.15.19:0/1729133569 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fc168098050 con 0x7fc178101380 2024-09-19T08:51:52.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.689+0000 7fc18008d640 1 -- 172.21.15.19:0/1729133569 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc178109680 con 0x7fc178101380 2024-09-19T08:51:52.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.690+0000 7fc16effd640 1 -- 172.21.15.19:0/1729133569 <== mon.0 v2:172.21.15.19:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11983 (secure 0 0 0) 0x7fc16808cd20 con 0x7fc178101380 2024-09-19T08:51:52.690 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:51:52.690 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"btime":"2024-09-19T08:50:27:938748+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2452068876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2452068876},{"type":"v1","addr":"172.21.15.19:6839","nonce":2452068876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T08:50:27.938727+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/2480841559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2480841559},{"type":"v1","addr":"172.21.15.155:6835","nonce":2480841559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24469,24490,24464,24463]},"id":1}]} 2024-09-19T08:51:52.690 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 27 2024-09-19T08:51:52.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.692+0000 7fc18008d640 1 -- 172.21.15.19:0/1729133569 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc1640a32d0 msgr2=0x7fc1640a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:52.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.692+0000 7fc18008d640 1 --2- 172.21.15.19:0/1729133569 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc1640a32d0 0x7fc1640a5790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc174009230 tx=0x7fc1740058d0 comp rx=0 tx=0).stop 2024-09-19T08:51:52.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.692+0000 7fc18008d640 1 -- 172.21.15.19:0/1729133569 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc178101380 msgr2=0x7fc17819ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:52.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.692+0000 7fc18008d640 1 --2- 172.21.15.19:0/1729133569 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc178101380 0x7fc17819ac90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc16800d770 tx=0x7fc16800dc30 comp rx=0 tx=0).stop 2024-09-19T08:51:52.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.693+0000 7fc18008d640 1 -- 172.21.15.19:0/1729133569 shutdown_connections 2024-09-19T08:51:52.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.693+0000 7fc18008d640 1 --2- 172.21.15.19:0/1729133569 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc1640a32d0 0x7fc1640a5790 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:52.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.693+0000 7fc18008d640 1 --2- 172.21.15.19:0/1729133569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc17810e4f0 0x7fc17819f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:52.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.693+0000 7fc18008d640 1 --2- 172.21.15.19:0/1729133569 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc178101380 0x7fc17819ac90 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:52.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.693+0000 7fc18008d640 1 --2- 172.21.15.19:0/1729133569 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc1781009d0 0x7fc17819a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:52.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.693+0000 7fc18008d640 1 -- 172.21.15.19:0/1729133569 >> 172.21.15.19:0/1729133569 conn(0x7fc1780fc7d0 msgr2=0x7fc1780febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:52.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.693+0000 7fc18008d640 1 -- 172.21.15.19:0/1729133569 shutdown_connections 2024-09-19T08:51:52.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:52.693+0000 7fc18008d640 1 -- 172.21.15.19:0/1729133569 wait complete. 2024-09-19T08:51:53.402 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:51:53.664 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:53.672 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:53 smithi019 ceph-mon[30976]: pgmap v327: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T08:51:53.672 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:53 smithi019 ceph-mon[30976]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T08:51:53.673 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:53 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1729133569' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:51:53.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:53 smithi155 ceph-mon[34921]: pgmap v327: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T08:51:53.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:53 smithi155 ceph-mon[34921]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T08:51:53.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:53 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1729133569' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:51:53.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:53 smithi203 ceph-mon[35450]: pgmap v327: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T08:51:53.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:53 smithi203 ceph-mon[35450]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T08:51:53.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:53 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1729133569' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:51:54.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.176+0000 7f21890c9640 1 -- 172.21.15.19:0/298951648 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2184106f10 msgr2=0x7f218410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:54.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.176+0000 7f21890c9640 1 --2- 172.21.15.19:0/298951648 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2184106f10 0x7f218410ea90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f217c009ca0 tx=0x7f217c02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.176+0000 7f21890c9640 1 -- 172.21.15.19:0/298951648 shutdown_connections 2024-09-19T08:51:54.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.176+0000 7f21890c9640 1 --2- 172.21.15.19:0/298951648 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2184102790 0x7f21841067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.176+0000 7f21890c9640 1 --2- 172.21.15.19:0/298951648 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2184106f10 0x7f218410ea90 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.176+0000 7f21890c9640 1 --2- 172.21.15.19:0/298951648 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2184101de0 0x7f21841021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.176+0000 7f21890c9640 1 -- 172.21.15.19:0/298951648 >> 172.21.15.19:0/298951648 conn(0x7f21840fd8c0 msgr2=0x7f21840ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:54.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.176+0000 7f21890c9640 1 -- 172.21.15.19:0/298951648 shutdown_connections 2024-09-19T08:51:54.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.176+0000 7f21890c9640 1 -- 172.21.15.19:0/298951648 wait complete. 2024-09-19T08:51:54.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.177+0000 7f21890c9640 1 Processor -- start 2024-09-19T08:51:54.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.177+0000 7f21890c9640 1 -- start start 2024-09-19T08:51:54.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.177+0000 7f21890c9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2184101de0 0x7f21840744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.177+0000 7f21890c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2184102790 0x7f2184074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.177+0000 7f21890c9640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2184106f10 0x7f2184074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.177+0000 7f21890c9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2184111f70 con 0x7f2184102790 2024-09-19T08:51:54.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.177+0000 7f21890c9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2184111df0 con 0x7f2184101de0 2024-09-19T08:51:54.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.177+0000 7f21890c9640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f21841120f0 con 0x7f2184106f10 2024-09-19T08:51:54.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.177+0000 7f218259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2184102790 0x7f2184074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.177+0000 7f218259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2184102790 0x7f2184074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59842/0 (socket says 172.21.15.19:59842) 2024-09-19T08:51:54.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.177+0000 7f218259c640 1 -- 172.21.15.19:0/3809945718 learned_addr learned my addr 172.21.15.19:0/3809945718 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:54.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.177+0000 7f2182d9d640 1 --2- 172.21.15.19:0/3809945718 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2184101de0 0x7f21840744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.177+0000 7f218359e640 1 --2- 172.21.15.19:0/3809945718 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2184106f10 0x7f2184074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.177+0000 7f218259c640 1 -- 172.21.15.19:0/3809945718 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2184106f10 msgr2=0x7f2184074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:54.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.177+0000 7f218259c640 1 --2- 172.21.15.19:0/3809945718 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2184106f10 0x7f2184074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.177+0000 7f218259c640 1 -- 172.21.15.19:0/3809945718 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2184101de0 msgr2=0x7f21840744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:54.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.177+0000 7f218259c640 1 --2- 172.21.15.19:0/3809945718 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2184101de0 0x7f21840744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.177+0000 7f218259c640 1 -- 172.21.15.19:0/3809945718 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21841a67f0 con 0x7f2184102790 2024-09-19T08:51:54.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.177+0000 7f218359e640 1 --2- 172.21.15.19:0/3809945718 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2184106f10 0x7f2184074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:51:54.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.178+0000 7f218259c640 1 --2- 172.21.15.19:0/3809945718 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2184102790 0x7f2184074a30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f217800d770 tx=0x7f217800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:54.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.178+0000 7f216bfff640 1 -- 172.21.15.19:0/3809945718 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2178017070 con 0x7f2184102790 2024-09-19T08:51:54.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.178+0000 7f21890c9640 1 -- 172.21.15.19:0/3809945718 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21841a6ae0 con 0x7f2184102790 2024-09-19T08:51:54.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.178+0000 7f216bfff640 1 -- 172.21.15.19:0/3809945718 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2178005500 con 0x7f2184102790 2024-09-19T08:51:54.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.178+0000 7f216bfff640 1 -- 172.21.15.19:0/3809945718 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2178004e00 con 0x7f2184102790 2024-09-19T08:51:54.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.178+0000 7f21890c9640 1 -- 172.21.15.19:0/3809945718 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21841a7020 con 0x7f2184102790 2024-09-19T08:51:54.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.179+0000 7f21890c9640 1 -- 172.21.15.19:0/3809945718 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21841021c0 con 0x7f2184102790 2024-09-19T08:51:54.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.180+0000 7f216bfff640 1 -- 172.21.15.19:0/3809945718 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f2178004fa0 con 0x7f2184102790 2024-09-19T08:51:54.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.181+0000 7f216bfff640 1 --2- 172.21.15.19:0/3809945718 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f216c0a3240 0x7f216c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:54.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.181+0000 7f2182d9d640 1 --2- 172.21.15.19:0/3809945718 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f216c0a3240 0x7f216c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:54.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.181+0000 7f216bfff640 1 -- 172.21.15.19:0/3809945718 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f21780cf400 con 0x7f2184102790 2024-09-19T08:51:54.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.181+0000 7f2182d9d640 1 --2- 172.21.15.19:0/3809945718 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f216c0a3240 0x7f216c0a5700 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2174005e10 tx=0x7f2174005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:54.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.185+0000 7f216bfff640 1 -- 172.21.15.19:0/3809945718 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f217809c0d0 con 0x7f2184102790 2024-09-19T08:51:54.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.400+0000 7f21890c9640 1 -- 172.21.15.19:0/3809945718 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f218410a0f0 con 0x7f2184102790 2024-09-19T08:51:54.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.401+0000 7f216bfff640 1 -- 172.21.15.19:0/3809945718 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11983 (secure 0 0 0) 0x7f217809b9d0 con 0x7f2184102790 2024-09-19T08:51:54.401 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:51:54.401 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":27,"btime":"2024-09-19T08:50:27:938748+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2452068876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2452068876},{"type":"v1","addr":"172.21.15.19:6839","nonce":2452068876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T08:50:27.938727+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/2480841559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2480841559},{"type":"v1","addr":"172.21.15.155:6835","nonce":2480841559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24469,24490,24464,24463]},"id":1}]} 2024-09-19T08:51:54.401 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 27 2024-09-19T08:51:54.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.403+0000 7f21890c9640 1 -- 172.21.15.19:0/3809945718 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f216c0a3240 msgr2=0x7f216c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:54.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.403+0000 7f21890c9640 1 --2- 172.21.15.19:0/3809945718 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f216c0a3240 0x7f216c0a5700 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f2174005e10 tx=0x7f2174005da0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.403+0000 7f21890c9640 1 -- 172.21.15.19:0/3809945718 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2184102790 msgr2=0x7f2184074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:54.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.403+0000 7f21890c9640 1 --2- 172.21.15.19:0/3809945718 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2184102790 0x7f2184074a30 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f217800d770 tx=0x7f217800dc30 comp rx=0 tx=0).stop 2024-09-19T08:51:54.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.403+0000 7f21890c9640 1 -- 172.21.15.19:0/3809945718 shutdown_connections 2024-09-19T08:51:54.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.403+0000 7f21890c9640 1 --2- 172.21.15.19:0/3809945718 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f216c0a3240 0x7f216c0a5700 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.403+0000 7f21890c9640 1 --2- 172.21.15.19:0/3809945718 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2184106f10 0x7f2184074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.403+0000 7f21890c9640 1 --2- 172.21.15.19:0/3809945718 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2184102790 0x7f2184074a30 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.403+0000 7f21890c9640 1 --2- 172.21.15.19:0/3809945718 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2184101de0 0x7f21840744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:54.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.403+0000 7f21890c9640 1 -- 172.21.15.19:0/3809945718 >> 172.21.15.19:0/3809945718 conn(0x7f21840fd8c0 msgr2=0x7f21840febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:54.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.403+0000 7f21890c9640 1 -- 172.21.15.19:0/3809945718 shutdown_connections 2024-09-19T08:51:54.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:54.403+0000 7f21890c9640 1 -- 172.21.15.19:0/3809945718 wait complete. 2024-09-19T08:51:54.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:54 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3809945718' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:51:54.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:54 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3809945718' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:51:55.038 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:54 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3809945718' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:51:55.071 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:51:55.332 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:55.734 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:55 smithi019 ceph-mon[30976]: pgmap v328: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-19T08:51:55.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.815+0000 7f037773c640 1 -- 172.21.15.19:0/2013556040 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0370101420 msgr2=0x7f037010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:55.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.815+0000 7f037773c640 1 --2- 172.21.15.19:0/2013556040 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0370101420 0x7f037010d950 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0368009cd0 tx=0x7f036802a8e0 comp rx=0 tx=0).stop 2024-09-19T08:51:55.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.815+0000 7f037773c640 1 -- 172.21.15.19:0/2013556040 shutdown_connections 2024-09-19T08:51:55.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.815+0000 7f037773c640 1 --2- 172.21.15.19:0/2013556040 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0370101420 0x7f037010d950 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:55.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.815+0000 7f037773c640 1 --2- 172.21.15.19:0/2013556040 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0370100a80 0x7f0370100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:55.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.815+0000 7f037773c640 1 --2- 172.21.15.19:0/2013556040 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0370106a80 0x7f0370106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:55.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.815+0000 7f037773c640 1 -- 172.21.15.19:0/2013556040 >> 172.21.15.19:0/2013556040 conn(0x7f03700fc7a0 msgr2=0x7f03700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:55.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.815+0000 7f037773c640 1 -- 172.21.15.19:0/2013556040 shutdown_connections 2024-09-19T08:51:55.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.815+0000 7f037773c640 1 -- 172.21.15.19:0/2013556040 wait complete. 2024-09-19T08:51:55.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.816+0000 7f037773c640 1 Processor -- start 2024-09-19T08:51:55.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.816+0000 7f037773c640 1 -- start start 2024-09-19T08:51:55.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.817+0000 7f037773c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0370100a80 0x7f03701983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:55.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.817+0000 7f037773c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0370101420 0x7f03701988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:55.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.817+0000 7f037773c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0370106a80 0x7f037019cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:55.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.817+0000 7f037773c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0370110e80 con 0x7f0370101420 2024-09-19T08:51:55.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.817+0000 7f037773c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0370110d00 con 0x7f0370106a80 2024-09-19T08:51:55.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.817+0000 7f037773c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0370111000 con 0x7f0370100a80 2024-09-19T08:51:55.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.817+0000 7f0374cd7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0370101420 0x7f03701988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:55.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.817+0000 7f0374cd7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0370101420 0x7f03701988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53534/0 (socket says 172.21.15.19:53534) 2024-09-19T08:51:55.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.817+0000 7f0374cd7640 1 -- 172.21.15.19:0/2255494923 learned_addr learned my addr 172.21.15.19:0/2255494923 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:55.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.817+0000 7f0375cd9640 1 --2- 172.21.15.19:0/2255494923 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0370106a80 0x7f037019cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:55.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.817+0000 7f03754d8640 1 --2- 172.21.15.19:0/2255494923 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0370100a80 0x7f03701983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:55.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.817+0000 7f0374cd7640 1 -- 172.21.15.19:0/2255494923 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0370100a80 msgr2=0x7f03701983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:55.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.817+0000 7f0374cd7640 1 --2- 172.21.15.19:0/2255494923 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0370100a80 0x7f03701983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:55.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.817+0000 7f0374cd7640 1 -- 172.21.15.19:0/2255494923 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0370106a80 msgr2=0x7f037019cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:55.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.817+0000 7f0374cd7640 1 --2- 172.21.15.19:0/2255494923 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0370106a80 0x7f037019cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:55.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.817+0000 7f0374cd7640 1 -- 172.21.15.19:0/2255494923 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f037019d350 con 0x7f0370101420 2024-09-19T08:51:55.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.817+0000 7f0374cd7640 1 --2- 172.21.15.19:0/2255494923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0370101420 0x7f03701988e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f036000d950 tx=0x7f036000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:55.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.817+0000 7f03667fc640 1 -- 172.21.15.19:0/2255494923 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0360017070 con 0x7f0370101420 2024-09-19T08:51:55.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.817+0000 7f03667fc640 1 -- 172.21.15.19:0/2255494923 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0360009c30 con 0x7f0370101420 2024-09-19T08:51:55.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.817+0000 7f037773c640 1 -- 172.21.15.19:0/2255494923 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f037019d640 con 0x7f0370101420 2024-09-19T08:51:55.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.817+0000 7f03667fc640 1 -- 172.21.15.19:0/2255494923 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f036000f6b0 con 0x7f0370101420 2024-09-19T08:51:55.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.818+0000 7f037773c640 1 -- 172.21.15.19:0/2255494923 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03701a4f20 con 0x7f0370101420 2024-09-19T08:51:55.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.819+0000 7f037773c640 1 -- 172.21.15.19:0/2255494923 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0370100ee0 con 0x7f0370101420 2024-09-19T08:51:55.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.820+0000 7f03667fc640 1 -- 172.21.15.19:0/2255494923 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f03600109d0 con 0x7f0370101420 2024-09-19T08:51:55.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.820+0000 7f03667fc640 1 --2- 172.21.15.19:0/2255494923 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f035c0a32c0 0x7f035c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:55.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.820+0000 7f03754d8640 1 --2- 172.21.15.19:0/2255494923 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f035c0a32c0 0x7f035c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:55.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.820+0000 7f03667fc640 1 -- 172.21.15.19:0/2255494923 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f03600cf4f0 con 0x7f0370101420 2024-09-19T08:51:55.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.821+0000 7f03754d8640 1 --2- 172.21.15.19:0/2255494923 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f035c0a32c0 0x7f035c0a5780 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f036c00cac0 tx=0x7f036c00c4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:55.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:55.825+0000 7f03667fc640 1 -- 172.21.15.19:0/2255494923 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0360009de0 con 0x7f0370101420 2024-09-19T08:51:55.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:55 smithi155 ceph-mon[34921]: pgmap v328: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-19T08:51:55.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:55 smithi203 ceph-mon[35450]: pgmap v328: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-19T08:51:56.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:56.001+0000 7f037773c640 1 -- 172.21.15.19:0/2255494923 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f03701a51b0 con 0x7f0370101420 2024-09-19T08:51:56.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:56.004+0000 7f03667fc640 1 -- 172.21.15.19:0/2255494923 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22651 (secure 0 0 0) 0x7f036009c220 con 0x7f0370101420 2024-09-19T08:51:56.004 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:51:56.004 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":82,"fsid":"f26c9d84-7662-11ef-bceb-c7b262605968","created":"2024-09-19T08:42:32.324073+0000","modified":"2024-09-19T08:51:23.536977+0000","last_up_change":"2024-09-19T08:49:24.764960+0000","last_in_change":"2024-09-19T08:49:01.062919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:45:36.232910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:50:12.615884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:50:14.854513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81c7bb06-5b13-4ee0-9290-d779faac1b91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6803","nonce":3397146732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6805","nonce":3397146732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6809","nonce":3397146732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6807","nonce":3397146732}]},"public_addr":"172.21.15.19:6803/3397146732","cluster_addr":"172.21.15.19:6805/3397146732","heartbeat_back_addr":"172.21.15.19:6809/3397146732","heartbeat_front_addr":"172.21.15.19:6807/3397146732","state":["exists","up"]},{"osd":1,"uuid":"24c145e6-5252-4708-8f25-5ce041e8251e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6801","nonce":2011043685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6803","nonce":2011043685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6807","nonce":2011043685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6805","nonce":2011043685}]},"public_addr":"172.21.15.155:6801/2011043685","cluster_addr":"172.21.15.155:6803/2011043685","heartbeat_back_addr":"172.21.15.155:6807/2011043685","heartbeat_front_addr":"172.21.15.155:6805/2011043685","state":["exists","up"]},{"osd":2,"uuid":"99cefd33-0675-495f-8871-2e6fdead0c3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6801","nonce":3358994623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6803","nonce":3358994623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6807","nonce":3358994623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6805","nonce":3358994623}]},"public_addr":"172.21.15.203:6801/3358994623","cluster_addr":"172.21.15.203:6803/3358994623","heartbeat_back_addr":"172.21.15.203:6807/3358994623","heartbeat_front_addr":"172.21.15.203:6805/3358994623","state":["exists","up"]},{"osd":3,"uuid":"8f46c16c-f17e-484a-8b66-6dbf135f34c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6811","nonce":176445576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6813","nonce":176445576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6817","nonce":176445576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6815","nonce":176445576}]},"public_addr":"172.21.15.19:6811/176445576","cluster_addr":"172.21.15.19:6813/176445576","heartbeat_back_addr":"172.21.15.19:6817/176445576","heartbeat_front_addr":"172.21.15.19:6815/176445576","state":["exists","up"]},{"osd":4,"uuid":"411b0423-1317-4e82-bc01-b5f55b391bc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6809","nonce":2163087792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6811","nonce":2163087792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6815","nonce":2163087792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6813","nonce":2163087792}]},"public_addr":"172.21.15.155:6809/2163087792","cluster_addr":"172.21.15.155:6811/2163087792","heartbeat_back_addr":"172.21.15.155:6815/2163087792","heartbeat_front_addr":"172.21.15.155:6813/2163087792","state":["exists","up"]},{"osd":5,"uuid":"057c073e-569f-4c6e-9602-e1169ad4dd8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6809","nonce":334881465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6811","nonce":334881465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6815","nonce":334881465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6813","nonce":334881465}]},"public_addr":"172.21.15.203:6809/334881465","cluster_addr":"172.21.15.203:6811/334881465","heartbeat_back_addr":"172.21.15.203:6815/334881465","heartbeat_front_addr":"172.21.15.203:6813/334881465","state":["exists","up"]},{"osd":6,"uuid":"40418f13-823e-4f94-a427-84781abbcb5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6819","nonce":2669779791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6821","nonce":2669779791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6825","nonce":2669779791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6823","nonce":2669779791}]},"public_addr":"172.21.15.19:6819/2669779791","cluster_addr":"172.21.15.19:6821/2669779791","heartbeat_back_addr":"172.21.15.19:6825/2669779791","heartbeat_front_addr":"172.21.15.19:6823/2669779791","state":["exists","up"]},{"osd":7,"uuid":"ad15f762-aeab-4167-a63d-6c9f9b89b9c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6817","nonce":3169455907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6819","nonce":3169455907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6823","nonce":3169455907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6821","nonce":3169455907}]},"public_addr":"172.21.15.155:6817/3169455907","cluster_addr":"172.21.15.155:6819/3169455907","heartbeat_back_addr":"172.21.15.155:6823/3169455907","heartbeat_front_addr":"172.21.15.155:6821/3169455907","state":["exists","up"]},{"osd":8,"uuid":"23cf8ea2-29d6-43d8-a05b-7822f4bbf254","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6817","nonce":1062999528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6819","nonce":1062999528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6823","nonce":1062999528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6821","nonce":1062999528}]},"public_addr":"172.21.15.203:6817/1062999528","cluster_addr":"172.21.15.203:6819/1062999528","heartbeat_back_addr":"172.21.15.203:6823/1062999528","heartbeat_front_addr":"172.21.15.203:6821/1062999528","state":["exists","up"]},{"osd":9,"uuid":"e851e605-2d17-4fbf-b783-2138133edd06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6827","nonce":574664786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6829","nonce":574664786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6833","nonce":574664786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6831","nonce":574664786}]},"public_addr":"172.21.15.19:6827/574664786","cluster_addr":"172.21.15.19:6829/574664786","heartbeat_back_addr":"172.21.15.19:6833/574664786","heartbeat_front_addr":"172.21.15.19:6831/574664786","state":["exists","up"]},{"osd":10,"uuid":"cc770717-91bd-4494-9103-6db8214b5872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6825","nonce":2242158832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6827","nonce":2242158832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6831","nonce":2242158832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6829","nonce":2242158832}]},"public_addr":"172.21.15.155:6825/2242158832","cluster_addr":"172.21.15.155:6827/2242158832","heartbeat_back_addr":"172.21.15.155:6831/2242158832","heartbeat_front_addr":"172.21.15.155:6829/2242158832","state":["exists","up"]},{"osd":11,"uuid":"6c237db9-5d79-47bc-8ff6-60d09d721d5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6825","nonce":522943955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6827","nonce":522943955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6831","nonce":522943955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6829","nonce":522943955}]},"public_addr":"172.21.15.203:6825/522943955","cluster_addr":"172.21.15.203:6827/522943955","heartbeat_back_addr":"172.21.15.203:6831/522943955","heartbeat_front_addr":"172.21.15.203:6829/522943955","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:44:44.656414+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:09.339183+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:33.245452+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:59.449025+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:46:24.831213+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:46:49.189780+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:47:13.493628+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:47:39.478247+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:05.089875+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:30.722878+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:56.951834+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:22.894678+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6801/4266644067":"2024-09-20T08:43:21.732222+0000","172.21.15.19:0/1398782170":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6800/4266644067":"2024-09-20T08:43:21.732222+0000","172.21.15.19:0/34162461":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6801/1764769529":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/2910961714":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6800/1764769529":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/820792769":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/560203138":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/809642328":"2024-09-20T08:42:56.618773+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:51:56.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:56.006+0000 7f037773c640 1 -- 172.21.15.19:0/2255494923 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f035c0a32c0 msgr2=0x7f035c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:56.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:56.006+0000 7f037773c640 1 --2- 172.21.15.19:0/2255494923 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f035c0a32c0 0x7f035c0a5780 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f036c00cac0 tx=0x7f036c00c4a0 comp rx=0 tx=0).stop 2024-09-19T08:51:56.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:56.006+0000 7f037773c640 1 -- 172.21.15.19:0/2255494923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0370101420 msgr2=0x7f03701988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:56.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:56.006+0000 7f037773c640 1 --2- 172.21.15.19:0/2255494923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0370101420 0x7f03701988e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f036000d950 tx=0x7f036000de10 comp rx=0 tx=0).stop 2024-09-19T08:51:56.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:56.006+0000 7f037773c640 1 -- 172.21.15.19:0/2255494923 shutdown_connections 2024-09-19T08:51:56.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:56.006+0000 7f037773c640 1 --2- 172.21.15.19:0/2255494923 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f035c0a32c0 0x7f035c0a5780 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:56.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:56.006+0000 7f037773c640 1 --2- 172.21.15.19:0/2255494923 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0370106a80 0x7f037019cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:56.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:56.006+0000 7f037773c640 1 --2- 172.21.15.19:0/2255494923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0370101420 0x7f03701988e0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:56.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:56.006+0000 7f037773c640 1 --2- 172.21.15.19:0/2255494923 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0370100a80 0x7f03701983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:56.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:56.006+0000 7f037773c640 1 -- 172.21.15.19:0/2255494923 >> 172.21.15.19:0/2255494923 conn(0x7f03700fc7a0 msgr2=0x7f037006a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:56.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:56.006+0000 7f037773c640 1 -- 172.21.15.19:0/2255494923 shutdown_connections 2024-09-19T08:51:56.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:56.006+0000 7f037773c640 1 -- 172.21.15.19:0/2255494923 wait complete. 2024-09-19T08:51:56.675 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T08:50:16.477197+0000', 'modified': '2024-09-19T08:50:27.938727+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24497, 'mds_1': 24490, 'mds_2': 24469, 'mds_3': 24464, 'mds_4': 24463}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14619': {'gid': 14619, 'name': 'a', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.19:6841/1973648402', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6840', 'nonce': 1973648402}, {'type': 'v1', 'addr': '172.21.15.19:6841', 'nonce': 1973648402}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24418': {'gid': 24418, 'name': 'l', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.203:6833/471920691', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6832', 'nonce': 471920691}, {'type': 'v1', 'addr': '172.21.15.203:6833', 'nonce': 471920691}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24419': {'gid': 24419, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.155:6833/3575511501', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6832', 'nonce': 3575511501}, {'type': 'v1', 'addr': '172.21.15.155:6833', 'nonce': 3575511501}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24431': {'gid': 24431, 'name': 'j', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.19:6835/805488508', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6834', 'nonce': 805488508}, {'type': 'v1', 'addr': '172.21.15.19:6835', 'nonce': 805488508}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24449': {'gid': 24449, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.155:6835/2480841559', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 2480841559}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 2480841559}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24463': {'gid': 24463, 'name': 'f', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.203:6835/2702758353', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6834', 'nonce': 2702758353}, {'type': 'v1', 'addr': '172.21.15.203:6835', 'nonce': 2702758353}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24464': {'gid': 24464, 'name': 'h', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.155:6837/3381010945', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6836', 'nonce': 3381010945}, {'type': 'v1', 'addr': '172.21.15.155:6837', 'nonce': 3381010945}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24469': {'gid': 24469, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.203:6837/3684671619', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6836', 'nonce': 3684671619}, {'type': 'v1', 'addr': '172.21.15.203:6837', 'nonce': 3684671619}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24490': {'gid': 24490, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.203:6839/2547507299', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6838', 'nonce': 2547507299}, {'type': 'v1', 'addr': '172.21.15.203:6839', 'nonce': 2547507299}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24497': {'gid': 24497, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.155:6839/1224030981', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6838', 'nonce': 1224030981}, {'type': 'v1', 'addr': '172.21.15.155:6839', 'nonce': 1224030981}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24497, 'qdb_cluster': [24497, 24469, 24490, 24464, 24463]} 2024-09-19T08:51:56.675 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-19T08:51:56.675 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.f status 2024-09-19T08:51:56.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:56 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/2255494923' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:51:56.933 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:56.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:56 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/2255494923' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:51:57.054 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:56 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/2255494923' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:51:57.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.559+0000 7ff8f831d640 1 -- 172.21.15.19:0/283302740 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8f0102790 msgr2=0x7ff8f01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:57.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.559+0000 7ff8f831d640 1 --2- 172.21.15.19:0/283302740 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8f0102790 0x7ff8f01067e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff8e0009900 tx=0x7ff8e002a410 comp rx=0 tx=0).stop 2024-09-19T08:51:57.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.559+0000 7ff8f831d640 1 -- 172.21.15.19:0/283302740 shutdown_connections 2024-09-19T08:51:57.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.559+0000 7ff8f831d640 1 --2- 172.21.15.19:0/283302740 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8f0106f10 0x7ff8f010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.559+0000 7ff8f831d640 1 --2- 172.21.15.19:0/283302740 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8f0102790 0x7ff8f01067e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.559+0000 7ff8f831d640 1 --2- 172.21.15.19:0/283302740 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8f0101de0 0x7ff8f01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.559+0000 7ff8f831d640 1 -- 172.21.15.19:0/283302740 >> 172.21.15.19:0/283302740 conn(0x7ff8f00fd8c0 msgr2=0x7ff8f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:57.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.559+0000 7ff8f831d640 1 -- 172.21.15.19:0/283302740 shutdown_connections 2024-09-19T08:51:57.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.559+0000 7ff8f831d640 1 -- 172.21.15.19:0/283302740 wait complete. 2024-09-19T08:51:57.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.560+0000 7ff8f831d640 1 Processor -- start 2024-09-19T08:51:57.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.560+0000 7ff8f831d640 1 -- start start 2024-09-19T08:51:57.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.560+0000 7ff8f831d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8f0101de0 0x7ff8f00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:57.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.560+0000 7ff8f831d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8f0102790 0x7ff8f0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:57.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.560+0000 7ff8f831d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8f0106f10 0x7ff8f0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:57.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.560+0000 7ff8f831d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f0111f70 con 0x7ff8f0101de0 2024-09-19T08:51:57.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.560+0000 7ff8f831d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f0111df0 con 0x7ff8f0106f10 2024-09-19T08:51:57.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.560+0000 7ff8f831d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff8f01120f0 con 0x7ff8f0102790 2024-09-19T08:51:57.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.560+0000 7ff8f60b9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8f0101de0 0x7ff8f00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:57.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.560+0000 7ff8f60b9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8f0101de0 0x7ff8f00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53556/0 (socket says 172.21.15.19:53556) 2024-09-19T08:51:57.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.560+0000 7ff8f60b9640 1 -- 172.21.15.19:0/1024912050 learned_addr learned my addr 172.21.15.19:0/1024912050 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:57.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.560+0000 7ff8f58b8640 1 --2- 172.21.15.19:0/1024912050 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8f0102790 0x7ff8f0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:57.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.560+0000 7ff8f68ba640 1 --2- 172.21.15.19:0/1024912050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8f0106f10 0x7ff8f0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:57.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.560+0000 7ff8f60b9640 1 -- 172.21.15.19:0/1024912050 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8f0102790 msgr2=0x7ff8f0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:57.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.560+0000 7ff8f60b9640 1 --2- 172.21.15.19:0/1024912050 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8f0102790 0x7ff8f0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.560+0000 7ff8f60b9640 1 -- 172.21.15.19:0/1024912050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8f0106f10 msgr2=0x7ff8f0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.560+0000 7ff8f60b9640 1 --2- 172.21.15.19:0/1024912050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8f0106f10 0x7ff8f0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.560+0000 7ff8f60b9640 1 -- 172.21.15.19:0/1024912050 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8f01a6930 con 0x7ff8f0101de0 2024-09-19T08:51:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.561+0000 7ff8f60b9640 1 --2- 172.21.15.19:0/1024912050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8f0101de0 0x7ff8f00744f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec00d950 tx=0x7ff8ec00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.561+0000 7ff8e77fe640 1 -- 172.21.15.19:0/1024912050 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec017070 con 0x7ff8f0101de0 2024-09-19T08:51:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.561+0000 7ff8f831d640 1 -- 172.21.15.19:0/1024912050 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8f01a6c20 con 0x7ff8f0101de0 2024-09-19T08:51:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.561+0000 7ff8e77fe640 1 -- 172.21.15.19:0/1024912050 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8ec009c30 con 0x7ff8f0101de0 2024-09-19T08:51:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.561+0000 7ff8e77fe640 1 -- 172.21.15.19:0/1024912050 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec00f6b0 con 0x7ff8f0101de0 2024-09-19T08:51:57.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.561+0000 7ff8f831d640 1 -- 172.21.15.19:0/1024912050 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8f01a7130 con 0x7ff8f0101de0 2024-09-19T08:51:57.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.563+0000 7ff8e77fe640 1 -- 172.21.15.19:0/1024912050 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ff8ec0109d0 con 0x7ff8f0101de0 2024-09-19T08:51:57.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.563+0000 7ff8fa6f6740 1 Processor -- start 2024-09-19T08:51:57.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.564+0000 7ff8fa6f6740 1 -- start start 2024-09-19T08:51:57.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.564+0000 7ff8fa6f6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5646a2bc29d0 0x5646a2bc2db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:57.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.564+0000 7ff8fa6f6740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646a2bc32f0 0x5646a2bcd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:57.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.564+0000 7ff8fa6f6740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5646a2bcdbb0 0x5646a2bcffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:57.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.564+0000 7ff8fa6f6740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5646a2b29090 con 0x5646a2bcdbb0 2024-09-19T08:51:57.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.564+0000 7ff8fa6f6740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5646a2ad0a70 con 0x5646a2bc32f0 2024-09-19T08:51:57.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.564+0000 7ff8fa6f6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5646a2b25050 con 0x5646a2bc29d0 2024-09-19T08:51:57.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.564+0000 7ff8f58b8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5646a2bcdbb0 0x5646a2bcffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:57.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.564+0000 7ff8f58b8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5646a2bcdbb0 0x5646a2bcffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53572/0 (socket says 172.21.15.19:53572) 2024-09-19T08:51:57.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.564+0000 7ff8f58b8640 1 -- 172.21.15.19:0/153698430 learned_addr learned my addr 172.21.15.19:0/153698430 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:57.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.564+0000 7ff8e77fe640 1 --2- 172.21.15.19:0/1024912050 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff8dc0a3240 0x7ff8dc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:57.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.564+0000 7ff8f60b9640 1 --2- 172.21.15.19:0/153698430 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646a2bc32f0 0x5646a2bcd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:57.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.564+0000 7ff8f68ba640 1 --2- 172.21.15.19:0/153698430 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5646a2bc29d0 0x5646a2bc2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:57.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.564+0000 7ff8f68ba640 1 --2- 172.21.15.19:0/1024912050 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff8dc0a3240 0x7ff8dc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:57.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.564+0000 7ff8f58b8640 1 -- 172.21.15.19:0/153698430 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5646a2bc29d0 msgr2=0x5646a2bc2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:57.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.564+0000 7ff8f58b8640 1 --2- 172.21.15.19:0/153698430 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5646a2bc29d0 0x5646a2bc2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.564+0000 7ff8f58b8640 1 -- 172.21.15.19:0/153698430 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646a2bc32f0 msgr2=0x5646a2bcd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:57.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.564+0000 7ff8f58b8640 1 --2- 172.21.15.19:0/153698430 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646a2bc32f0 0x5646a2bcd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.564+0000 7ff8f58b8640 1 -- 172.21.15.19:0/153698430 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646a2add130 con 0x5646a2bcdbb0 2024-09-19T08:51:57.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.565+0000 7ff8e77fe640 1 -- 172.21.15.19:0/1024912050 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff8ec0cf4c0 con 0x7ff8f0101de0 2024-09-19T08:51:57.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.565+0000 7ff8f58b8640 1 --2- 172.21.15.19:0/153698430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5646a2bcdbb0 0x5646a2bcffa0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff8e0009900 tx=0x7ff8e0005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=837b497e1844605 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:57.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.565+0000 7ff8f68ba640 1 --2- 172.21.15.19:0/1024912050 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff8dc0a3240 0x7ff8dc0a5700 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8009fd0 tx=0x7ff8e8009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:57.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.565+0000 7ff8e4dea640 1 -- 172.21.15.19:0/153698430 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e0040070 con 0x5646a2bcdbb0 2024-09-19T08:51:57.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.565+0000 7ff8e4dea640 1 -- 172.21.15.19:0/153698430 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8e00319f0 con 0x5646a2bcdbb0 2024-09-19T08:51:57.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.565+0000 7ff8e4dea640 1 -- 172.21.15.19:0/153698430 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e0035040 con 0x5646a2bcdbb0 2024-09-19T08:51:57.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.566+0000 7ff8fa6f6740 1 -- 172.21.15.19:0/153698430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5646a2bcdbb0 msgr2=0x5646a2bcffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:57.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.566+0000 7ff8fa6f6740 1 --2- 172.21.15.19:0/153698430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5646a2bcdbb0 0x5646a2bcffa0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff8e0009900 tx=0x7ff8e0005e80 comp rx=0 tx=0).stop 2024-09-19T08:51:57.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.566+0000 7ff8fa6f6740 1 -- 172.21.15.19:0/153698430 shutdown_connections 2024-09-19T08:51:57.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.566+0000 7ff8fa6f6740 1 --2- 172.21.15.19:0/153698430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5646a2bcdbb0 0x5646a2bcffa0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.566+0000 7ff8fa6f6740 1 --2- 172.21.15.19:0/153698430 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646a2bc32f0 0x5646a2bcd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.566+0000 7ff8fa6f6740 1 --2- 172.21.15.19:0/153698430 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5646a2bc29d0 0x5646a2bc2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.566+0000 7ff8fa6f6740 1 -- 172.21.15.19:0/153698430 >> 172.21.15.19:0/153698430 conn(0x5646a2bbef60 msgr2=0x5646a2bbf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:57.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.566+0000 7ff8fa6f6740 1 -- 172.21.15.19:0/153698430 shutdown_connections 2024-09-19T08:51:57.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.566+0000 7ff8fa6f6740 1 -- 172.21.15.19:0/153698430 wait complete. 2024-09-19T08:51:57.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.566+0000 7ff8fa6f6740 1 -- start start 2024-09-19T08:51:57.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.566+0000 7ff8fa6f6740 1 Processor -- start 2024-09-19T08:51:57.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.567+0000 7ff8fa6f6740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5646a2bc29d0 0x5646a2bcd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:57.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.567+0000 7ff8fa6f6740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646a2bc32f0 0x5646a2bca750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:57.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.567+0000 7ff8fa6f6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5646a2bcdbb0 0x5646a2bcac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:57.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.567+0000 7ff8fa6f6740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5646a2bd0780 con 0x5646a2bc29d0 2024-09-19T08:51:57.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.567+0000 7ff8fa6f6740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5646a2ae3f20 con 0x5646a2bc32f0 2024-09-19T08:51:57.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.567+0000 7ff8fa6f6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5646a2bd0900 con 0x5646a2bcdbb0 2024-09-19T08:51:57.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.567+0000 7ff8fa6f6740 10 client.0 _ll_register_callbacks cb 0x5646a2aad030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:57.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.567+0000 7ff8f60b9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5646a2bc29d0 0x5646a2bcd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:57.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.567+0000 7ff8f68ba640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5646a2bcdbb0 0x5646a2bcac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:57.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.567+0000 7ff8f60b9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5646a2bc29d0 0x5646a2bcd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53586/0 (socket says 172.21.15.19:53586) 2024-09-19T08:51:57.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.567+0000 7ff8f60b9640 1 -- 172.21.15.19:0/464537252 learned_addr learned my addr 172.21.15.19:0/464537252 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:57.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.567+0000 7ff8f58b8640 1 --2- 172.21.15.19:0/464537252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646a2bc32f0 0x5646a2bca750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:57.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.567+0000 7ff8f60b9640 1 -- 172.21.15.19:0/464537252 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5646a2bcdbb0 msgr2=0x5646a2bcac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:57.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.567+0000 7ff8f60b9640 1 --2- 172.21.15.19:0/464537252 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5646a2bcdbb0 0x5646a2bcac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.567+0000 7ff8f60b9640 1 -- 172.21.15.19:0/464537252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646a2bc32f0 msgr2=0x5646a2bca750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:57.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.567+0000 7ff8f60b9640 1 --2- 172.21.15.19:0/464537252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646a2bc32f0 0x5646a2bca750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.567+0000 7ff8f60b9640 1 -- 172.21.15.19:0/464537252 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646a289a2b0 con 0x5646a2bc29d0 2024-09-19T08:51:57.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.567+0000 7ff8f68ba640 1 --2- 172.21.15.19:0/464537252 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5646a2bcdbb0 0x5646a2bcac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:51:57.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.567+0000 7ff8f58b8640 1 --2- 172.21.15.19:0/464537252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646a2bc32f0 0x5646a2bca750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:57.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.567+0000 7ff8f60b9640 1 --2- 172.21.15.19:0/464537252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5646a2bc29d0 0x5646a2bcd400 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec098510 tx=0x7ff8ec09b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=113c8833f5324e5d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:57.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.567+0000 7ff8d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:51:57.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.567+0000 7ff8d9ffb640 1 -- 172.21.15.19:0/464537252 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec020040 con 0x5646a2bc29d0 2024-09-19T08:51:57.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.567+0000 7ff8d9ffb640 1 -- 172.21.15.19:0/464537252 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff8ec0cd080 con 0x5646a2bc29d0 2024-09-19T08:51:57.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.567+0000 7ff8fa6f6740 1 -- 172.21.15.19:0/464537252 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8e00319f0 con 0x5646a2bc29d0 2024-09-19T08:51:57.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.568+0000 7ff8d9ffb640 1 -- 172.21.15.19:0/464537252 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff8ec09fe40 con 0x5646a2bc29d0 2024-09-19T08:51:57.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.568+0000 7ff8fa6f6740 10 client.15129 fetch_fsmap learned FSMap version 27 2024-09-19T08:51:57.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.568+0000 7ff8fa6f6740 1 -- 172.21.15.19:0/464537252 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5646a2bdc0a0 con 0x5646a2bc29d0 2024-09-19T08:51:57.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.568+0000 7ff8d9ffb640 1 -- 172.21.15.19:0/464537252 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8e00319f0 con 0x5646a2bc29d0 2024-09-19T08:51:57.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.568+0000 7ff8d9ffb640 1 -- 172.21.15.19:0/464537252 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7ff8ec0a4270 con 0x5646a2bc29d0 2024-09-19T08:51:57.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.568+0000 7ff8fa6f6740 10 client.15129 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T08:51:57.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.568+0000 7ff8fa6f6740 10 client.15129 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-19T08:51:57.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.568+0000 7ff8fa6f6740 20 client.15129 populate_metadata read hostname 'smithi019' 2024-09-19T08:51:57.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.568+0000 7ff8fa6f6740 1 --2- 172.21.15.19:0/464537252 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5646a2bde630 0x5646a2bdfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:57.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.568+0000 7ff8fa6f6740 4 client.15129 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:51:57.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.568+0000 7ff8fa6f6740 1 -- 172.21.15.19:0/464537252 --> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5646a2b36600 con 0x5646a2bde630 2024-09-19T08:51:57.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.569+0000 7ff8f58b8640 1 --2- 172.21.15.19:0/464537252 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5646a2bde630 0x5646a2bdfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:57.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.570+0000 7ff8f58b8640 1 --2- 172.21.15.19:0/464537252 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5646a2bde630 0x5646a2bdfaa0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b3c79d6e9d45d30a server_cookie=16dc6496e32eb1c0 in_seq=0 out_seq=0 2024-09-19T08:51:57.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.570+0000 7ff8d9ffb640 10 client.15129 ms_handle_connect on v2:172.21.15.203:6834/2702758353 2024-09-19T08:51:57.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.570+0000 7ff8d9ffb640 1 -- 172.21.15.19:0/464537252 <== mds.4 v2:172.21.15.203:6834/2702758353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5646a2b36600 con 0x5646a2bde630 2024-09-19T08:51:57.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.570+0000 7ff8d9ffb640 10 client.15129 handle_command_reply: tid=0 2024-09-19T08:51:57.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.571+0000 7ff8fa6f6740 1 client.15129 shutdown 2024-09-19T08:51:57.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.571+0000 7ff8fa6f6740 1 -- 172.21.15.19:0/464537252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5646a2bc29d0 msgr2=0x5646a2bcd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:57.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.571+0000 7ff8fa6f6740 1 --2- 172.21.15.19:0/464537252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5646a2bc29d0 0x5646a2bcd400 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec098510 tx=0x7ff8ec09b4a0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.571+0000 7ff8fa6f6740 1 -- 172.21.15.19:0/464537252 shutdown_connections 2024-09-19T08:51:57.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.571+0000 7ff8fa6f6740 1 --2- 172.21.15.19:0/464537252 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5646a2bde630 0x5646a2bdfaa0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.571+0000 7ff8fa6f6740 1 --2- 172.21.15.19:0/464537252 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5646a2bcdbb0 0x5646a2bcac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.571+0000 7ff8fa6f6740 1 --2- 172.21.15.19:0/464537252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646a2bc32f0 0x5646a2bca750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.571+0000 7ff8fa6f6740 1 --2- 172.21.15.19:0/464537252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5646a2bc29d0 0x5646a2bcd400 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.571+0000 7ff8fa6f6740 1 -- 172.21.15.19:0/464537252 >> 172.21.15.19:0/464537252 conn(0x5646a2bbef60 msgr2=0x5646a2bc4c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:57.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.571+0000 7ff8d9ffb640 0 client.15129 ms_handle_reset on v2:172.21.15.203:6834/2702758353 2024-09-19T08:51:57.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.571+0000 7ff8fa6f6740 1 -- 172.21.15.19:0/464537252 shutdown_connections 2024-09-19T08:51:57.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.571+0000 7ff8fa6f6740 1 -- 172.21.15.19:0/464537252 wait complete. 2024-09-19T08:51:57.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.571+0000 7ff8fa6f6740 20 client.15129 trim_cache size 0 max 16384 2024-09-19T08:51:57.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.589+0000 7ff8fa6f6740 1 Processor -- start 2024-09-19T08:51:57.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.589+0000 7ff8fa6f6740 1 -- start start 2024-09-19T08:51:57.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.589+0000 7ff8fa6f6740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5646a2bc29d0 0x5646a2bde630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:57.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.589+0000 7ff8fa6f6740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646a2bc32f0 0x5646a2bdf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:57.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.589+0000 7ff8fa6f6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5646a2bcdbb0 0x5646a2bddf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:57.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.589+0000 7ff8fa6f6740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5646a2bddde0 con 0x5646a2bc29d0 2024-09-19T08:51:57.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.589+0000 7ff8fa6f6740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5646a2bde4b0 con 0x5646a2bc32f0 2024-09-19T08:51:57.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.589+0000 7ff8fa6f6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5646a2bdeb80 con 0x5646a2bcdbb0 2024-09-19T08:51:57.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.590+0000 7ff8f60b9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5646a2bc29d0 0x5646a2bde630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:57.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.590+0000 7ff8f60b9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5646a2bc29d0 0x5646a2bde630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53592/0 (socket says 172.21.15.19:53592) 2024-09-19T08:51:57.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.590+0000 7ff8f60b9640 1 -- 172.21.15.19:0/886915312 learned_addr learned my addr 172.21.15.19:0/886915312 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:57.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.590+0000 7ff8f58b8640 1 --2- 172.21.15.19:0/886915312 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646a2bc32f0 0x5646a2bdf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:57.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.590+0000 7ff8f68ba640 1 --2- 172.21.15.19:0/886915312 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5646a2bcdbb0 0x5646a2bddf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:57.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.590+0000 7ff8f60b9640 1 -- 172.21.15.19:0/886915312 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5646a2bcdbb0 msgr2=0x5646a2bddf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:57.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.590+0000 7ff8f60b9640 1 --2- 172.21.15.19:0/886915312 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5646a2bcdbb0 0x5646a2bddf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.590+0000 7ff8f60b9640 1 -- 172.21.15.19:0/886915312 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646a2bc32f0 msgr2=0x5646a2bdf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:57.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.590+0000 7ff8f60b9640 1 --2- 172.21.15.19:0/886915312 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646a2bc32f0 0x5646a2bdf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.590+0000 7ff8f60b9640 1 -- 172.21.15.19:0/886915312 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646a2bc00f0 con 0x5646a2bc29d0 2024-09-19T08:51:57.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.590+0000 7ff8f58b8640 1 --2- 172.21.15.19:0/886915312 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646a2bc32f0 0x5646a2bdf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:51:57.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.590+0000 7ff8f60b9640 1 --2- 172.21.15.19:0/886915312 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5646a2bc29d0 0x5646a2bde630 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec009610 tx=0x7ff8ec086050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=764848182dcb2228 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:57.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.590+0000 7ff8dbfff640 1 -- 172.21.15.19:0/886915312 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec020070 con 0x5646a2bc29d0 2024-09-19T08:51:57.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.590+0000 7ff8dbfff640 1 -- 172.21.15.19:0/886915312 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8ec009de0 con 0x5646a2bc29d0 2024-09-19T08:51:57.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.590+0000 7ff8dbfff640 1 -- 172.21.15.19:0/886915312 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ec0981b0 con 0x5646a2bc29d0 2024-09-19T08:51:57.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.591+0000 7ff8fa6f6740 1 -- 172.21.15.19:0/886915312 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5646a2bc29d0 msgr2=0x5646a2bde630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:57.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.591+0000 7ff8fa6f6740 1 --2- 172.21.15.19:0/886915312 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5646a2bc29d0 0x5646a2bde630 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec009610 tx=0x7ff8ec086050 comp rx=0 tx=0).stop 2024-09-19T08:51:57.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.591+0000 7ff8fa6f6740 1 -- 172.21.15.19:0/886915312 shutdown_connections 2024-09-19T08:51:57.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.591+0000 7ff8fa6f6740 1 --2- 172.21.15.19:0/886915312 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5646a2bcdbb0 0x5646a2bddf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.591+0000 7ff8fa6f6740 1 --2- 172.21.15.19:0/886915312 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646a2bc32f0 0x5646a2bdf3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.591+0000 7ff8fa6f6740 1 --2- 172.21.15.19:0/886915312 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5646a2bc29d0 0x5646a2bde630 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.591+0000 7ff8fa6f6740 1 -- 172.21.15.19:0/886915312 >> 172.21.15.19:0/886915312 conn(0x5646a2bbef60 msgr2=0x5646a2bbf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:57.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.591+0000 7ff8fa6f6740 1 -- 172.21.15.19:0/886915312 shutdown_connections 2024-09-19T08:51:57.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.591+0000 7ff8fa6f6740 1 -- 172.21.15.19:0/886915312 wait complete. 2024-09-19T08:51:57.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.591+0000 7ff8fa6f6740 1 -- start start 2024-09-19T08:51:57.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.592+0000 7ff8fa6f6740 1 Processor -- start 2024-09-19T08:51:57.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.592+0000 7ff8fa6f6740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5646a2bc29d0 0x5646a2be8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:57.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.592+0000 7ff8fa6f6740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646a2bc32f0 0x5646a2be0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:57.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.592+0000 7ff8fa6f6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5646a2bcdbb0 0x5646a2be14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:57.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.592+0000 7ff8fa6f6740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5646a2bdf920 con 0x5646a2bc29d0 2024-09-19T08:51:57.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.592+0000 7ff8fa6f6740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5646a2bdf250 con 0x5646a2bc32f0 2024-09-19T08:51:57.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.592+0000 7ff8fa6f6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5646a2bdfff0 con 0x5646a2bcdbb0 2024-09-19T08:51:57.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.592+0000 7ff8fa6f6740 10 client.0 _ll_register_callbacks cb 0x7ff8ec00df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:57.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.592+0000 7ff8f60b9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5646a2bc29d0 0x5646a2be8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:57.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.592+0000 7ff8f68ba640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5646a2bcdbb0 0x5646a2be14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.592+0000 7ff8f68ba640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5646a2bcdbb0 0x5646a2be14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:38464/0 (socket says 172.21.15.19:38464) 2024-09-19T08:51:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.592+0000 7ff8f68ba640 1 -- 172.21.15.19:0/2141782219 learned_addr learned my addr 172.21.15.19:0/2141782219 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.592+0000 7ff8f60b9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5646a2bc29d0 0x5646a2be8640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53594/0 (socket says 172.21.15.19:53594) 2024-09-19T08:51:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.592+0000 7ff8f58b8640 1 --2- 172.21.15.19:0/2141782219 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646a2bc32f0 0x5646a2be0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.592+0000 7ff8f68ba640 1 -- 172.21.15.19:0/2141782219 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646a2bc32f0 msgr2=0x5646a2be0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.592+0000 7ff8f68ba640 1 --2- 172.21.15.19:0/2141782219 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646a2bc32f0 0x5646a2be0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.592+0000 7ff8f68ba640 1 -- 172.21.15.19:0/2141782219 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5646a2bc29d0 msgr2=0x5646a2be8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.592+0000 7ff8f68ba640 1 --2- 172.21.15.19:0/2141782219 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5646a2bc29d0 0x5646a2be8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.592+0000 7ff8f68ba640 1 -- 172.21.15.19:0/2141782219 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646a2c46d30 con 0x5646a2bcdbb0 2024-09-19T08:51:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.593+0000 7ff8f60b9640 1 --2- 172.21.15.19:0/2141782219 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5646a2bc29d0 0x5646a2be8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:51:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.593+0000 7ff8f68ba640 1 --2- 172.21.15.19:0/2141782219 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5646a2bcdbb0 0x5646a2be14a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff8e800afa0 tx=0x7ff8e8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae178a24de819d76 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.593+0000 7ff8d9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T08:51:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.593+0000 7ff8d9ffb640 1 -- 172.21.15.19:0/2141782219 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e802d030 con 0x5646a2bcdbb0 2024-09-19T08:51:57.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.593+0000 7ff8fa6f6740 1 -- 172.21.15.19:0/2141782219 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8ec009de0 con 0x5646a2bcdbb0 2024-09-19T08:51:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.593+0000 7ff8d9ffb640 1 -- 172.21.15.19:0/2141782219 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff8e801b070 con 0x5646a2bcdbb0 2024-09-19T08:51:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.593+0000 7ff8d9ffb640 1 -- 172.21.15.19:0/2141782219 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ff8e801ee00 con 0x5646a2bcdbb0 2024-09-19T08:51:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.593+0000 7ff8fa6f6740 10 client.24844 fetch_fsmap learned FSMap version 27 2024-09-19T08:51:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.593+0000 7ff8fa6f6740 1 -- 172.21.15.19:0/2141782219 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5646a2c47fc0 con 0x5646a2bcdbb0 2024-09-19T08:51:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.594+0000 7ff8d9ffb640 1 -- 172.21.15.19:0/2141782219 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8ec009de0 con 0x5646a2bcdbb0 2024-09-19T08:51:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.594+0000 7ff8d9ffb640 1 -- 172.21.15.19:0/2141782219 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7ff8e800f040 con 0x5646a2bcdbb0 2024-09-19T08:51:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.594+0000 7ff8fa6f6740 10 client.24844 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T08:51:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.594+0000 7ff8fa6f6740 10 client.24844 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-19T08:51:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.594+0000 7ff8fa6f6740 20 client.24844 populate_metadata read hostname 'smithi019' 2024-09-19T08:51:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.594+0000 7ff8fa6f6740 1 --2- 172.21.15.19:0/2141782219 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5646a2c4cbe0 0x5646a2c4b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.594+0000 7ff8fa6f6740 4 client.24844 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T08:51:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.594+0000 7ff8fa6f6740 1 -- 172.21.15.19:0/2141782219 --> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] -- command(tid 0: {"prefix": "status"}) -- 0x5646a2b30b10 con 0x5646a2c4cbe0 2024-09-19T08:51:57.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.594+0000 7ff8f60b9640 1 --2- 172.21.15.19:0/2141782219 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5646a2c4cbe0 0x5646a2c4b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.595+0000 7ff8f60b9640 1 --2- 172.21.15.19:0/2141782219 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5646a2c4cbe0 0x5646a2c4b8f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=61b8dfbbd9ef4b2e server_cookie=3df9a7d22b0bfd38 in_seq=0 out_seq=0 2024-09-19T08:51:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.595+0000 7ff8d9ffb640 10 client.24844 ms_handle_connect on v2:172.21.15.203:6834/2702758353 2024-09-19T08:51:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.595+0000 7ff8d9ffb640 1 -- 172.21.15.19:0/2141782219 <== mds.4 v2:172.21.15.203:6834/2702758353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5646a2b30b10 con 0x5646a2c4cbe0 2024-09-19T08:51:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.595+0000 7ff8d9ffb640 10 client.24844 handle_command_reply: tid=0 2024-09-19T08:51:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.595+0000 7ff8fa6f6740 1 client.24844 shutdown 2024-09-19T08:51:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.595+0000 7ff8fa6f6740 1 -- 172.21.15.19:0/2141782219 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5646a2bcdbb0 msgr2=0x5646a2be14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.595+0000 7ff8fa6f6740 1 --2- 172.21.15.19:0/2141782219 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5646a2bcdbb0 0x5646a2be14a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff8e800afa0 tx=0x7ff8e8004a40 comp rx=0 tx=0).stop 2024-09-19T08:51:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.595+0000 7ff8fa6f6740 1 -- 172.21.15.19:0/2141782219 shutdown_connections 2024-09-19T08:51:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.595+0000 7ff8fa6f6740 1 --2- 172.21.15.19:0/2141782219 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5646a2c4cbe0 0x5646a2c4b8f0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.595+0000 7ff8fa6f6740 1 --2- 172.21.15.19:0/2141782219 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5646a2bcdbb0 0x5646a2be14a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.595+0000 7ff8fa6f6740 1 --2- 172.21.15.19:0/2141782219 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5646a2bc32f0 0x5646a2be0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.595+0000 7ff8d9ffb640 0 client.24844 ms_handle_reset on v2:172.21.15.203:6834/2702758353 2024-09-19T08:51:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.595+0000 7ff8fa6f6740 1 --2- 172.21.15.19:0/2141782219 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5646a2bc29d0 0x5646a2be8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.595+0000 7ff8fa6f6740 1 -- 172.21.15.19:0/2141782219 >> 172.21.15.19:0/2141782219 conn(0x5646a2bbef60 msgr2=0x5646a2bc4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:57.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.595+0000 7ff8fa6f6740 1 -- 172.21.15.19:0/2141782219 shutdown_connections 2024-09-19T08:51:57.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.595+0000 7ff8fa6f6740 1 -- 172.21.15.19:0/2141782219 wait complete. 2024-09-19T08:51:57.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.595+0000 7ff8fa6f6740 20 client.24844 trim_cache size 0 max 16384 2024-09-19T08:51:57.601 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:51:57.601 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "f26c9d84-7662-11ef-bceb-c7b262605968", 2024-09-19T08:51:57.601 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 4, 2024-09-19T08:51:57.601 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 24463, 2024-09-19T08:51:57.601 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-19T08:51:57.601 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-19T08:51:57.601 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-19T08:51:57.601 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 90.665426253000007, 2024-09-19T08:51:57.602 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 27, 2024-09-19T08:51:57.602 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 82, 2024-09-19T08:51:57.602 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 80, 2024-09-19T08:51:57.602 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 128.74545384499999 2024-09-19T08:51:57.602 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:51:57.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.596+0000 7ff8f831d640 1 -- 172.21.15.19:0/1024912050 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff8dc0a3240 msgr2=0x7ff8dc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:57.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.596+0000 7ff8f831d640 1 --2- 172.21.15.19:0/1024912050 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff8dc0a3240 0x7ff8dc0a5700 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8009fd0 tx=0x7ff8e8009600 comp rx=0 tx=0).stop 2024-09-19T08:51:57.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.596+0000 7ff8f831d640 1 -- 172.21.15.19:0/1024912050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8f0101de0 msgr2=0x7ff8f00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:57.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.596+0000 7ff8f831d640 1 --2- 172.21.15.19:0/1024912050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8f0101de0 0x7ff8f00744f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff8ec00d950 tx=0x7ff8ec00de10 comp rx=0 tx=0).stop 2024-09-19T08:51:57.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.596+0000 7ff8f831d640 1 -- 172.21.15.19:0/1024912050 shutdown_connections 2024-09-19T08:51:57.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.596+0000 7ff8f831d640 1 --2- 172.21.15.19:0/1024912050 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff8dc0a3240 0x7ff8dc0a5700 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.596+0000 7ff8f831d640 1 --2- 172.21.15.19:0/1024912050 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff8f0102790 0x7ff8f0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.596+0000 7ff8f831d640 1 --2- 172.21.15.19:0/1024912050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff8f0106f10 0x7ff8f0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.596+0000 7ff8f831d640 1 --2- 172.21.15.19:0/1024912050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff8f0101de0 0x7ff8f00744f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:57.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.596+0000 7ff8f831d640 1 -- 172.21.15.19:0/1024912050 >> 172.21.15.19:0/1024912050 conn(0x7ff8f00fd8c0 msgr2=0x7ff8f00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:57.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.596+0000 7ff8f831d640 1 -- 172.21.15.19:0/1024912050 shutdown_connections 2024-09-19T08:51:57.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:57.596+0000 7ff8f831d640 1 -- 172.21.15.19:0/1024912050 wait complete. 2024-09-19T08:51:57.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:57 smithi155 ceph-mon[34921]: pgmap v329: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-19T08:51:57.956 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:57 smithi019 ceph-mon[30976]: pgmap v329: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-19T08:51:57.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:57 smithi203 ceph-mon[35450]: pgmap v329: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-19T08:51:58.385 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-19T08:51:58.647 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:51:59.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.111+0000 7f4d8187a640 1 -- 172.21.15.19:0/4162366791 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d7c1036e0 msgr2=0x7f4d7c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:59.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.111+0000 7f4d8187a640 1 --2- 172.21.15.19:0/4162366791 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d7c1036e0 0x7f4d7c107b90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4d70009930 tx=0x7f4d7002a420 comp rx=0 tx=0).stop 2024-09-19T08:51:59.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.111+0000 7f4d8187a640 1 -- 172.21.15.19:0/4162366791 shutdown_connections 2024-09-19T08:51:59.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.111+0000 7f4d8187a640 1 --2- 172.21.15.19:0/4162366791 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d7c1082a0 0x7f4d7c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.111+0000 7f4d8187a640 1 --2- 172.21.15.19:0/4162366791 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d7c1036e0 0x7f4d7c107b90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.111+0000 7f4d8187a640 1 --2- 172.21.15.19:0/4162366791 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d7c102d30 0x7f4d7c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.111+0000 7f4d8187a640 1 -- 172.21.15.19:0/4162366791 >> 172.21.15.19:0/4162366791 conn(0x7f4d7c0fc7d0 msgr2=0x7f4d7c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:59.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.111+0000 7f4d8187a640 1 -- 172.21.15.19:0/4162366791 shutdown_connections 2024-09-19T08:51:59.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.111+0000 7f4d8187a640 1 -- 172.21.15.19:0/4162366791 wait complete. 2024-09-19T08:51:59.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.111+0000 7f4d8187a640 1 Processor -- start 2024-09-19T08:51:59.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.112+0000 7f4d8187a640 1 -- start start 2024-09-19T08:51:59.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.112+0000 7f4d8187a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d7c102d30 0x7f4d7c1985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:59.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.112+0000 7f4d8187a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d7c1036e0 0x7f4d7c198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:59.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.112+0000 7f4d8187a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d7c1082a0 0x7f4d7c19ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:59.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.112+0000 7f4d8187a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7c1120a0 con 0x7f4d7c1036e0 2024-09-19T08:51:59.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.112+0000 7f4d8187a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7c111f20 con 0x7f4d7c1082a0 2024-09-19T08:51:59.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.112+0000 7f4d8187a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7c112220 con 0x7f4d7c102d30 2024-09-19T08:51:59.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.112+0000 7f4d7a7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d7c1036e0 0x7f4d7c198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:59.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.112+0000 7f4d7a7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d7c1036e0 0x7f4d7c198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53622/0 (socket says 172.21.15.19:53622) 2024-09-19T08:51:59.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.112+0000 7f4d7a7fc640 1 -- 172.21.15.19:0/4071205925 learned_addr learned my addr 172.21.15.19:0/4071205925 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:59.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.112+0000 7f4d7b7fe640 1 --2- 172.21.15.19:0/4071205925 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d7c1082a0 0x7f4d7c19ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:59.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.112+0000 7f4d7affd640 1 --2- 172.21.15.19:0/4071205925 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d7c102d30 0x7f4d7c1985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:59.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.112+0000 7f4d7a7fc640 1 -- 172.21.15.19:0/4071205925 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d7c102d30 msgr2=0x7f4d7c1985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:59.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.112+0000 7f4d7a7fc640 1 --2- 172.21.15.19:0/4071205925 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d7c102d30 0x7f4d7c1985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.112+0000 7f4d7a7fc640 1 -- 172.21.15.19:0/4071205925 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d7c1082a0 msgr2=0x7f4d7c19ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:59.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.112+0000 7f4d7a7fc640 1 --2- 172.21.15.19:0/4071205925 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d7c1082a0 0x7f4d7c19ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.112+0000 7f4d7a7fc640 1 -- 172.21.15.19:0/4071205925 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d7c19d560 con 0x7f4d7c1036e0 2024-09-19T08:51:59.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.113+0000 7f4d7a7fc640 1 --2- 172.21.15.19:0/4071205925 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d7c1036e0 0x7f4d7c198af0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4d70005940 tx=0x7f4d700042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:59.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.113+0000 7f4d80878640 1 -- 172.21.15.19:0/4071205925 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7003f030 con 0x7f4d7c1036e0 2024-09-19T08:51:59.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.113+0000 7f4d80878640 1 -- 172.21.15.19:0/4071205925 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d70003ce0 con 0x7f4d7c1036e0 2024-09-19T08:51:59.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.113+0000 7f4d8187a640 1 -- 172.21.15.19:0/4071205925 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d7c19d7f0 con 0x7f4d7c1036e0 2024-09-19T08:51:59.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.113+0000 7f4d80878640 1 -- 172.21.15.19:0/4071205925 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d70035070 con 0x7f4d7c1036e0 2024-09-19T08:51:59.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.113+0000 7f4d8187a640 1 -- 172.21.15.19:0/4071205925 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d7c1a5130 con 0x7f4d7c1036e0 2024-09-19T08:51:59.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.115+0000 7f4d80878640 1 -- 172.21.15.19:0/4071205925 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4d70042030 con 0x7f4d7c1036e0 2024-09-19T08:51:59.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.116+0000 7f4d83c53740 1 Processor -- start 2024-09-19T08:51:59.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.116+0000 7f4d83c53740 1 -- start start 2024-09-19T08:51:59.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.116+0000 7f4d83c53740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55966a7d09d0 0x55966a7d0db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:59.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.116+0000 7f4d83c53740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55966a7d12f0 0x55966a7db670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:59.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.116+0000 7f4d83c53740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55966a7dbbb0 0x55966a7ddfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:59.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.116+0000 7f4d83c53740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55966a737090 con 0x55966a7d12f0 2024-09-19T08:51:59.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.116+0000 7f4d83c53740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55966a6dea70 con 0x55966a7dbbb0 2024-09-19T08:51:59.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.116+0000 7f4d83c53740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55966a733050 con 0x55966a7d09d0 2024-09-19T08:51:59.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.116+0000 7f4d7affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55966a7d12f0 0x55966a7db670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:59.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.116+0000 7f4d7affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55966a7d12f0 0x55966a7db670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53636/0 (socket says 172.21.15.19:53636) 2024-09-19T08:51:59.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.116+0000 7f4d7affd640 1 -- 172.21.15.19:0/3631180051 learned_addr learned my addr 172.21.15.19:0/3631180051 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:59.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.116+0000 7f4d80878640 1 --2- 172.21.15.19:0/4071205925 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4d640a32c0 0x7f4d640a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:59.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.116+0000 7f4d7a7fc640 1 --2- 172.21.15.19:0/3631180051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55966a7dbbb0 0x55966a7ddfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:59.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.116+0000 7f4d7b7fe640 1 --2- 172.21.15.19:0/3631180051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55966a7d09d0 0x55966a7d0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:59.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.117+0000 7f4d7affd640 1 -- 172.21.15.19:0/3631180051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55966a7d09d0 msgr2=0x55966a7d0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:59.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.117+0000 7f4d7affd640 1 --2- 172.21.15.19:0/3631180051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55966a7d09d0 0x55966a7d0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.117+0000 7f4d7affd640 1 -- 172.21.15.19:0/3631180051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55966a7dbbb0 msgr2=0x55966a7ddfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:59.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.117+0000 7f4d7affd640 1 --2- 172.21.15.19:0/3631180051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55966a7dbbb0 0x55966a7ddfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.117+0000 7f4d7affd640 1 -- 172.21.15.19:0/3631180051 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55966a6eb130 con 0x55966a7d12f0 2024-09-19T08:51:59.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.117+0000 7f4d7b7fe640 1 --2- 172.21.15.19:0/4071205925 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4d640a32c0 0x7f4d640a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:59.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.117+0000 7f4d80878640 1 -- 172.21.15.19:0/4071205925 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4d700efc50 con 0x7f4d7c1036e0 2024-09-19T08:51:59.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.117+0000 7f4d7affd640 1 --2- 172.21.15.19:0/3631180051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55966a7d12f0 0x55966a7db670 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c00bd10 tx=0x7f4d6c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea13603793d9f8c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:59.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.117+0000 7f4d61ffb640 1 -- 172.21.15.19:0/3631180051 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c004030 con 0x55966a7d12f0 2024-09-19T08:51:59.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.117+0000 7f4d61ffb640 1 -- 172.21.15.19:0/3631180051 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d6c0041d0 con 0x55966a7d12f0 2024-09-19T08:51:59.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.117+0000 7f4d61ffb640 1 -- 172.21.15.19:0/3631180051 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c011820 con 0x55966a7d12f0 2024-09-19T08:51:59.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.117+0000 7f4d7b7fe640 1 --2- 172.21.15.19:0/4071205925 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4d640a32c0 0x7f4d640a5780 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4d74005fd0 tx=0x7f4d74004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:59.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.118+0000 7f4d83c53740 1 -- 172.21.15.19:0/3631180051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55966a7d12f0 msgr2=0x55966a7db670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:59.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.118+0000 7f4d83c53740 1 --2- 172.21.15.19:0/3631180051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55966a7d12f0 0x55966a7db670 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c00bd10 tx=0x7f4d6c0107a0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.118+0000 7f4d83c53740 1 -- 172.21.15.19:0/3631180051 shutdown_connections 2024-09-19T08:51:59.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.118+0000 7f4d83c53740 1 --2- 172.21.15.19:0/3631180051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55966a7dbbb0 0x55966a7ddfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.118+0000 7f4d83c53740 1 --2- 172.21.15.19:0/3631180051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55966a7d12f0 0x55966a7db670 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.118+0000 7f4d83c53740 1 --2- 172.21.15.19:0/3631180051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55966a7d09d0 0x55966a7d0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.118+0000 7f4d83c53740 1 -- 172.21.15.19:0/3631180051 >> 172.21.15.19:0/3631180051 conn(0x55966a7ccf60 msgr2=0x55966a7cd340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:59.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.118+0000 7f4d83c53740 1 -- 172.21.15.19:0/3631180051 shutdown_connections 2024-09-19T08:51:59.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.118+0000 7f4d83c53740 1 -- 172.21.15.19:0/3631180051 wait complete. 2024-09-19T08:51:59.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.118+0000 7f4d83c53740 1 -- start start 2024-09-19T08:51:59.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.119+0000 7f4d83c53740 1 Processor -- start 2024-09-19T08:51:59.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.119+0000 7f4d83c53740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55966a7d09d0 0x55966a7db430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:59.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.119+0000 7f4d83c53740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55966a7d12f0 0x55966a7d8780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:59.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.119+0000 7f4d83c53740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55966a7dbbb0 0x55966a7d8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:59.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.119+0000 7f4d83c53740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55966a7de780 con 0x55966a7d09d0 2024-09-19T08:51:59.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.119+0000 7f4d83c53740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55966a6f1f20 con 0x55966a7d12f0 2024-09-19T08:51:59.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.119+0000 7f4d83c53740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55966a7de900 con 0x55966a7dbbb0 2024-09-19T08:51:59.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.119+0000 7f4d83c53740 10 client.0 _ll_register_callbacks cb 0x55966a6bb030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:59.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.119+0000 7f4d7affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55966a7d09d0 0x55966a7db430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:59.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.119+0000 7f4d7affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55966a7d09d0 0x55966a7db430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53646/0 (socket says 172.21.15.19:53646) 2024-09-19T08:51:59.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.119+0000 7f4d7affd640 1 -- 172.21.15.19:0/699953353 learned_addr learned my addr 172.21.15.19:0/699953353 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:59.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.119+0000 7f4d7b7fe640 1 --2- 172.21.15.19:0/699953353 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55966a7dbbb0 0x55966a7d8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:59.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.119+0000 7f4d7a7fc640 1 --2- 172.21.15.19:0/699953353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55966a7d12f0 0x55966a7d8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:59.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.119+0000 7f4d7affd640 1 -- 172.21.15.19:0/699953353 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55966a7dbbb0 msgr2=0x55966a7d8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:59.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.119+0000 7f4d7affd640 1 --2- 172.21.15.19:0/699953353 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55966a7dbbb0 0x55966a7d8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.119+0000 7f4d7affd640 1 -- 172.21.15.19:0/699953353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55966a7d12f0 msgr2=0x55966a7d8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:59.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.119+0000 7f4d7affd640 1 --2- 172.21.15.19:0/699953353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55966a7d12f0 0x55966a7d8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.119+0000 7f4d7affd640 1 -- 172.21.15.19:0/699953353 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55966a4a82b0 con 0x55966a7d09d0 2024-09-19T08:51:59.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.119+0000 7f4d7affd640 1 --2- 172.21.15.19:0/699953353 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55966a7d09d0 0x55966a7db430 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c010ca0 tx=0x7f4d6c004140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fc5e7b134c6991e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:59.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.119+0000 7f4d5affd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:51:59.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.120+0000 7f4d5affd640 1 -- 172.21.15.19:0/699953353 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c029060 con 0x55966a7d09d0 2024-09-19T08:51:59.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.120+0000 7f4d5affd640 1 -- 172.21.15.19:0/699953353 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4d6c0035f0 con 0x55966a7d09d0 2024-09-19T08:51:59.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.120+0000 7f4d83c53740 1 -- 172.21.15.19:0/699953353 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d6c0041d0 con 0x55966a7d09d0 2024-09-19T08:51:59.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.120+0000 7f4d5affd640 1 -- 172.21.15.19:0/699953353 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4d6c0037f0 con 0x55966a7d09d0 2024-09-19T08:51:59.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.120+0000 7f4d83c53740 10 client.15147 fetch_fsmap learned FSMap version 27 2024-09-19T08:51:59.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.120+0000 7f4d83c53740 1 -- 172.21.15.19:0/699953353 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55966a7ea090 con 0x55966a7d09d0 2024-09-19T08:51:59.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.120+0000 7f4d5affd640 1 -- 172.21.15.19:0/699953353 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d6c0041d0 con 0x55966a7d09d0 2024-09-19T08:51:59.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.120+0000 7f4d5affd640 1 -- 172.21.15.19:0/699953353 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f4d6c0048f0 con 0x55966a7d09d0 2024-09-19T08:51:59.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.120+0000 7f4d83c53740 10 client.15147 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T08:51:59.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.120+0000 7f4d83c53740 10 client.15147 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T08:51:59.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.120+0000 7f4d83c53740 20 client.15147 populate_metadata read hostname 'smithi019' 2024-09-19T08:51:59.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.120+0000 7f4d83c53740 1 --2- 172.21.15.19:0/699953353 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55966a7ec2e0 0x55966a7ed750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:59.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.120+0000 7f4d83c53740 4 client.15147 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:51:59.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.120+0000 7f4d83c53740 1 -- 172.21.15.19:0/699953353 --> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55966a744600 con 0x55966a7ec2e0 2024-09-19T08:51:59.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.121+0000 7f4d7a7fc640 1 --2- 172.21.15.19:0/699953353 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55966a7ec2e0 0x55966a7ed750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:59.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.121+0000 7f4d7a7fc640 1 --2- 172.21.15.19:0/699953353 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55966a7ec2e0 0x55966a7ed750 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d45488c3226ebba7 server_cookie=1ab7300376860891 in_seq=0 out_seq=0 2024-09-19T08:51:59.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.121+0000 7f4d5affd640 10 client.15147 ms_handle_connect on v2:172.21.15.155:6836/3381010945 2024-09-19T08:51:59.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.122+0000 7f4d5affd640 1 -- 172.21.15.19:0/699953353 <== mds.3 v2:172.21.15.155:6836/3381010945 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55966a744600 con 0x55966a7ec2e0 2024-09-19T08:51:59.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.122+0000 7f4d5affd640 10 client.15147 handle_command_reply: tid=0 2024-09-19T08:51:59.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.122+0000 7f4d83c53740 1 client.15147 shutdown 2024-09-19T08:51:59.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.122+0000 7f4d83c53740 1 -- 172.21.15.19:0/699953353 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55966a7d09d0 msgr2=0x55966a7db430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:59.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.122+0000 7f4d83c53740 1 --2- 172.21.15.19:0/699953353 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55966a7d09d0 0x55966a7db430 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c010ca0 tx=0x7f4d6c004140 comp rx=0 tx=0).stop 2024-09-19T08:51:59.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.122+0000 7f4d83c53740 1 -- 172.21.15.19:0/699953353 shutdown_connections 2024-09-19T08:51:59.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.122+0000 7f4d83c53740 1 --2- 172.21.15.19:0/699953353 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55966a7ec2e0 0x55966a7ed750 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.122+0000 7f4d83c53740 1 --2- 172.21.15.19:0/699953353 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55966a7dbbb0 0x55966a7d8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.122+0000 7f4d83c53740 1 --2- 172.21.15.19:0/699953353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55966a7d12f0 0x55966a7d8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.122+0000 7f4d83c53740 1 --2- 172.21.15.19:0/699953353 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55966a7d09d0 0x55966a7db430 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.122+0000 7f4d5affd640 0 client.15147 ms_handle_reset on v2:172.21.15.155:6836/3381010945 2024-09-19T08:51:59.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.122+0000 7f4d83c53740 1 -- 172.21.15.19:0/699953353 >> 172.21.15.19:0/699953353 conn(0x55966a7ccf60 msgr2=0x55966a7d2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:59.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.122+0000 7f4d83c53740 1 -- 172.21.15.19:0/699953353 shutdown_connections 2024-09-19T08:51:59.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.122+0000 7f4d83c53740 1 -- 172.21.15.19:0/699953353 wait complete. 2024-09-19T08:51:59.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.122+0000 7f4d83c53740 20 client.15147 trim_cache size 0 max 16384 2024-09-19T08:51:59.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.141+0000 7f4d83c53740 1 Processor -- start 2024-09-19T08:51:59.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.141+0000 7f4d83c53740 1 -- start start 2024-09-19T08:51:59.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.141+0000 7f4d83c53740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55966a7d09d0 0x55966a7ec9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:59.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.141+0000 7f4d83c53740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55966a7d12f0 0x55966a7d7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:59.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.141+0000 7f4d83c53740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55966a7dbbb0 0x55966a7d7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:59.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.141+0000 7f4d83c53740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55966a7eba90 con 0x55966a7d09d0 2024-09-19T08:51:59.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.141+0000 7f4d83c53740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55966a7ec160 con 0x55966a7dbbb0 2024-09-19T08:51:59.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.141+0000 7f4d83c53740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55966a7ec830 con 0x55966a7d12f0 2024-09-19T08:51:59.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.141+0000 7f4d7affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55966a7d09d0 0x55966a7ec9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:59.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.141+0000 7f4d7affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55966a7d09d0 0x55966a7ec9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53660/0 (socket says 172.21.15.19:53660) 2024-09-19T08:51:59.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.141+0000 7f4d7affd640 1 -- 172.21.15.19:0/79526080 learned_addr learned my addr 172.21.15.19:0/79526080 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:59.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.141+0000 7f4d7a7fc640 1 --2- 172.21.15.19:0/79526080 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55966a7d12f0 0x55966a7d7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:59.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.141+0000 7f4d7affd640 1 -- 172.21.15.19:0/79526080 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55966a7d12f0 msgr2=0x55966a7d7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:59.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.141+0000 7f4d7affd640 1 --2- 172.21.15.19:0/79526080 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55966a7d12f0 0x55966a7d7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.141+0000 7f4d7affd640 1 -- 172.21.15.19:0/79526080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55966a7dbbb0 msgr2=0x55966a7d7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:59.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.141+0000 7f4d7b7fe640 1 --2- 172.21.15.19:0/79526080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55966a7dbbb0 0x55966a7d7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:59.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.141+0000 7f4d7affd640 1 --2- 172.21.15.19:0/79526080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55966a7dbbb0 0x55966a7d7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.141+0000 7f4d7affd640 1 -- 172.21.15.19:0/79526080 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55966a7d0750 con 0x55966a7d09d0 2024-09-19T08:51:59.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.141+0000 7f4d7b7fe640 1 --2- 172.21.15.19:0/79526080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55966a7dbbb0 0x55966a7d7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:51:59.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.142+0000 7f4d7affd640 1 --2- 172.21.15.19:0/79526080 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55966a7d09d0 0x55966a7ec9b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c0107e0 tx=0x7f4d6c004060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=141e6efa63969a33 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:59.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.142+0000 7f4d617fa640 1 -- 172.21.15.19:0/79526080 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c034070 con 0x55966a7d09d0 2024-09-19T08:51:59.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.142+0000 7f4d617fa640 1 -- 172.21.15.19:0/79526080 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d6c00b8e0 con 0x55966a7d09d0 2024-09-19T08:51:59.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.142+0000 7f4d617fa640 1 -- 172.21.15.19:0/79526080 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c029070 con 0x55966a7d09d0 2024-09-19T08:51:59.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.143+0000 7f4d83c53740 1 -- 172.21.15.19:0/79526080 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55966a7d09d0 msgr2=0x55966a7ec9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:59.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.143+0000 7f4d83c53740 1 --2- 172.21.15.19:0/79526080 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55966a7d09d0 0x55966a7ec9b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c0107e0 tx=0x7f4d6c004060 comp rx=0 tx=0).stop 2024-09-19T08:51:59.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.143+0000 7f4d83c53740 1 -- 172.21.15.19:0/79526080 shutdown_connections 2024-09-19T08:51:59.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.143+0000 7f4d83c53740 1 --2- 172.21.15.19:0/79526080 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55966a7d12f0 0x55966a7d7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.143+0000 7f4d83c53740 1 --2- 172.21.15.19:0/79526080 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55966a7dbbb0 0x55966a7d7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.143+0000 7f4d83c53740 1 --2- 172.21.15.19:0/79526080 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55966a7d09d0 0x55966a7ec9b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.143+0000 7f4d83c53740 1 -- 172.21.15.19:0/79526080 >> 172.21.15.19:0/79526080 conn(0x55966a7ccf60 msgr2=0x55966a7cb7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:59.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.143+0000 7f4d83c53740 1 -- 172.21.15.19:0/79526080 shutdown_connections 2024-09-19T08:51:59.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.143+0000 7f4d83c53740 1 -- 172.21.15.19:0/79526080 wait complete. 2024-09-19T08:51:59.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.143+0000 7f4d83c53740 1 -- start start 2024-09-19T08:51:59.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.143+0000 7f4d83c53740 1 Processor -- start 2024-09-19T08:51:59.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.144+0000 7f4d83c53740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55966a7d09d0 0x55966a7f06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:59.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.144+0000 7f4d83c53740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55966a7d12f0 0x55966a7f0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:59.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.144+0000 7f4d83c53740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55966a7dbbb0 0x55966a7f1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:59.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.144+0000 7f4d83c53740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55966a7ed5d0 con 0x55966a7d09d0 2024-09-19T08:51:59.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.144+0000 7f4d83c53740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55966a7ecf00 con 0x55966a7d12f0 2024-09-19T08:51:59.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.144+0000 7f4d83c53740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55966a7edca0 con 0x55966a7dbbb0 2024-09-19T08:51:59.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.144+0000 7f4d83c53740 10 client.0 _ll_register_callbacks cb 0x7f4d6c00bb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:51:59.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.144+0000 7f4d7affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55966a7d09d0 0x55966a7f06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:59.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.144+0000 7f4d7affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55966a7d09d0 0x55966a7f06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53668/0 (socket says 172.21.15.19:53668) 2024-09-19T08:51:59.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.144+0000 7f4d7affd640 1 -- 172.21.15.19:0/3319371214 learned_addr learned my addr 172.21.15.19:0/3319371214 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:51:59.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.144+0000 7f4d7a7fc640 1 --2- 172.21.15.19:0/3319371214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55966a7d12f0 0x55966a7f0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:59.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.144+0000 7f4d7affd640 1 -- 172.21.15.19:0/3319371214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55966a7dbbb0 msgr2=0x55966a7f1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:59.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.144+0000 7f4d7b7fe640 1 --2- 172.21.15.19:0/3319371214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55966a7dbbb0 0x55966a7f1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:59.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.144+0000 7f4d7affd640 1 --2- 172.21.15.19:0/3319371214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55966a7dbbb0 0x55966a7f1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.144+0000 7f4d7affd640 1 -- 172.21.15.19:0/3319371214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55966a7d12f0 msgr2=0x55966a7f0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:51:59.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.144+0000 7f4d7affd640 1 --2- 172.21.15.19:0/3319371214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55966a7d12f0 0x55966a7f0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.144+0000 7f4d7affd640 1 -- 172.21.15.19:0/3319371214 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55966a8549e0 con 0x55966a7d09d0 2024-09-19T08:51:59.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.144+0000 7f4d7b7fe640 1 --2- 172.21.15.19:0/3319371214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55966a7dbbb0 0x55966a7f1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:51:59.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.144+0000 7f4d7affd640 1 --2- 172.21.15.19:0/3319371214 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55966a7d09d0 0x55966a7f06c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c004cc0 tx=0x7f4d6c0114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4922e27ffe39c91 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:51:59.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.144+0000 7f4d5affd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:51:59.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.144+0000 7f4d5affd640 1 -- 172.21.15.19:0/3319371214 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c03c070 con 0x55966a7d09d0 2024-09-19T08:51:59.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.144+0000 7f4d5affd640 1 -- 172.21.15.19:0/3319371214 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4d6c004590 con 0x55966a7d09d0 2024-09-19T08:51:59.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.144+0000 7f4d83c53740 1 -- 172.21.15.19:0/3319371214 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d6c00b8e0 con 0x55966a7d09d0 2024-09-19T08:51:59.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.145+0000 7f4d5affd640 1 -- 172.21.15.19:0/3319371214 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4d6c048050 con 0x55966a7d09d0 2024-09-19T08:51:59.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.145+0000 7f4d83c53740 10 client.15153 fetch_fsmap learned FSMap version 27 2024-09-19T08:51:59.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.145+0000 7f4d83c53740 1 -- 172.21.15.19:0/3319371214 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55966a855bb0 con 0x55966a7d09d0 2024-09-19T08:51:59.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.145+0000 7f4d5affd640 1 -- 172.21.15.19:0/3319371214 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d6c00b8e0 con 0x55966a7d09d0 2024-09-19T08:51:59.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.145+0000 7f4d5affd640 1 -- 172.21.15.19:0/3319371214 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f4d6c011650 con 0x55966a7d09d0 2024-09-19T08:51:59.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.145+0000 7f4d83c53740 10 client.15153 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T08:51:59.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.145+0000 7f4d83c53740 10 client.15153 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T08:51:59.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.145+0000 7f4d83c53740 20 client.15153 populate_metadata read hostname 'smithi019' 2024-09-19T08:51:59.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.145+0000 7f4d83c53740 1 --2- 172.21.15.19:0/3319371214 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55966a85a2e0 0x55966a858ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:51:59.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.145+0000 7f4d83c53740 4 client.15153 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T08:51:59.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.145+0000 7f4d83c53740 1 -- 172.21.15.19:0/3319371214 --> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] -- command(tid 0: {"prefix": "status"}) -- 0x55966a73eb10 con 0x55966a85a2e0 2024-09-19T08:51:59.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.145+0000 7f4d7a7fc640 1 --2- 172.21.15.19:0/3319371214 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55966a85a2e0 0x55966a858ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:51:59.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.146+0000 7f4d7a7fc640 1 --2- 172.21.15.19:0/3319371214 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55966a85a2e0 0x55966a858ff0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ffbb7a1fdbb385b4 server_cookie=60961d5e3c6d427d in_seq=0 out_seq=0 2024-09-19T08:51:59.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.146+0000 7f4d5affd640 10 client.15153 ms_handle_connect on v2:172.21.15.155:6836/3381010945 2024-09-19T08:51:59.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.146+0000 7f4d5affd640 1 -- 172.21.15.19:0/3319371214 <== mds.3 v2:172.21.15.155:6836/3381010945 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x55966a73eb10 con 0x55966a85a2e0 2024-09-19T08:51:59.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.146+0000 7f4d5affd640 10 client.15153 handle_command_reply: tid=0 2024-09-19T08:51:59.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.146+0000 7f4d83c53740 1 client.15153 shutdown 2024-09-19T08:51:59.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.146+0000 7f4d83c53740 1 -- 172.21.15.19:0/3319371214 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55966a7d09d0 msgr2=0x55966a7f06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:59.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.146+0000 7f4d83c53740 1 --2- 172.21.15.19:0/3319371214 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55966a7d09d0 0x55966a7f06c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c004cc0 tx=0x7f4d6c0114b0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.146+0000 7f4d83c53740 1 -- 172.21.15.19:0/3319371214 shutdown_connections 2024-09-19T08:51:59.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.146+0000 7f4d83c53740 1 --2- 172.21.15.19:0/3319371214 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55966a85a2e0 0x55966a858ff0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.146+0000 7f4d83c53740 1 --2- 172.21.15.19:0/3319371214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55966a7dbbb0 0x55966a7f1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.146+0000 7f4d83c53740 1 --2- 172.21.15.19:0/3319371214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55966a7d12f0 0x55966a7f0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.146+0000 7f4d83c53740 1 --2- 172.21.15.19:0/3319371214 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55966a7d09d0 0x55966a7f06c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.146+0000 7f4d83c53740 1 -- 172.21.15.19:0/3319371214 >> 172.21.15.19:0/3319371214 conn(0x55966a7ccf60 msgr2=0x55966a7d6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:59.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.146+0000 7f4d5affd640 0 client.15153 ms_handle_reset on v2:172.21.15.155:6836/3381010945 2024-09-19T08:51:59.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.146+0000 7f4d83c53740 1 -- 172.21.15.19:0/3319371214 shutdown_connections 2024-09-19T08:51:59.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.146+0000 7f4d83c53740 1 -- 172.21.15.19:0/3319371214 wait complete. 2024-09-19T08:51:59.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.146+0000 7f4d83c53740 20 client.15153 trim_cache size 0 max 16384 2024-09-19T08:51:59.153 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:51:59.153 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "f26c9d84-7662-11ef-bceb-c7b262605968", 2024-09-19T08:51:59.153 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 3, 2024-09-19T08:51:59.153 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 24464, 2024-09-19T08:51:59.154 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-19T08:51:59.154 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-19T08:51:59.154 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-19T08:51:59.154 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 93.224310527, 2024-09-19T08:51:59.154 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 27, 2024-09-19T08:51:59.154 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 82, 2024-09-19T08:51:59.154 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 80, 2024-09-19T08:51:59.154 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 125.078393033 2024-09-19T08:51:59.154 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:51:59.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.147+0000 7f4d8187a640 1 -- 172.21.15.19:0/4071205925 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4d640a32c0 msgr2=0x7f4d640a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:59.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.147+0000 7f4d8187a640 1 --2- 172.21.15.19:0/4071205925 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4d640a32c0 0x7f4d640a5780 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4d74005fd0 tx=0x7f4d74004a40 comp rx=0 tx=0).stop 2024-09-19T08:51:59.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.147+0000 7f4d8187a640 1 -- 172.21.15.19:0/4071205925 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d7c1036e0 msgr2=0x7f4d7c198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:51:59.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.147+0000 7f4d8187a640 1 --2- 172.21.15.19:0/4071205925 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d7c1036e0 0x7f4d7c198af0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4d70005940 tx=0x7f4d700042f0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.147+0000 7f4d8187a640 1 -- 172.21.15.19:0/4071205925 shutdown_connections 2024-09-19T08:51:59.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.147+0000 7f4d8187a640 1 --2- 172.21.15.19:0/4071205925 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4d640a32c0 0x7f4d640a5780 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.147+0000 7f4d8187a640 1 --2- 172.21.15.19:0/4071205925 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d7c1082a0 0x7f4d7c19ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.147+0000 7f4d8187a640 1 --2- 172.21.15.19:0/4071205925 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d7c1036e0 0x7f4d7c198af0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.147+0000 7f4d8187a640 1 --2- 172.21.15.19:0/4071205925 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d7c102d30 0x7f4d7c1985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:51:59.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.147+0000 7f4d8187a640 1 -- 172.21.15.19:0/4071205925 >> 172.21.15.19:0/4071205925 conn(0x7f4d7c0fc7d0 msgr2=0x7f4d7c105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:51:59.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.147+0000 7f4d8187a640 1 -- 172.21.15.19:0/4071205925 shutdown_connections 2024-09-19T08:51:59.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:51:59.147+0000 7f4d8187a640 1 -- 172.21.15.19:0/4071205925 wait complete. 2024-09-19T08:51:59.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:51:59 smithi019 ceph-mon[30976]: pgmap v330: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-19T08:51:59.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:51:59 smithi155 ceph-mon[34921]: pgmap v330: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-19T08:51:59.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:51:59 smithi203 ceph-mon[35450]: pgmap v330: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-19T08:51:59.988 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-19T08:52:00.244 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:00.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.696+0000 7f1a04e5d640 1 -- 172.21.15.19:0/1747014454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a00102570 msgr2=0x7f1a001029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:00.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.696+0000 7f1a04e5d640 1 --2- 172.21.15.19:0/1747014454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a00102570 0x7f1a001029b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f19e8009900 tx=0x7f19e802a480 comp rx=0 tx=0).stop 2024-09-19T08:52:00.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.696+0000 7f1a04e5d640 1 -- 172.21.15.19:0/1747014454 shutdown_connections 2024-09-19T08:52:00.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.696+0000 7f1a04e5d640 1 --2- 172.21.15.19:0/1747014454 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a00102ef0 0x7f1a0010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.696+0000 7f1a04e5d640 1 --2- 172.21.15.19:0/1747014454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a00102570 0x7f1a001029b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.696+0000 7f1a04e5d640 1 --2- 172.21.15.19:0/1747014454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a00100e20 0x7f1a00101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.696+0000 7f1a04e5d640 1 -- 172.21.15.19:0/1747014454 >> 172.21.15.19:0/1747014454 conn(0x7f1a000fc7d0 msgr2=0x7f1a000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:00.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.696+0000 7f1a04e5d640 1 -- 172.21.15.19:0/1747014454 shutdown_connections 2024-09-19T08:52:00.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.696+0000 7f1a04e5d640 1 -- 172.21.15.19:0/1747014454 wait complete. 2024-09-19T08:52:00.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.697+0000 7f1a04e5d640 1 Processor -- start 2024-09-19T08:52:00.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.697+0000 7f1a04e5d640 1 -- start start 2024-09-19T08:52:00.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.697+0000 7f1a04e5d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a00100e20 0x7f1a0019a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:00.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.697+0000 7f1a04e5d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a00102570 0x7f1a0019abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:00.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.697+0000 7f1a04e5d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a00102ef0 0x7f1a0019ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:00.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.697+0000 7f1a04e5d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1a00112090 con 0x7f1a00102ef0 2024-09-19T08:52:00.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.697+0000 7f1a04e5d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1a00111f10 con 0x7f1a00102570 2024-09-19T08:52:00.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.697+0000 7f1a04e5d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1a00112210 con 0x7f1a00100e20 2024-09-19T08:52:00.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.697+0000 7f19fed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a00102ef0 0x7f1a0019ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:00.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.697+0000 7f19fed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a00102ef0 0x7f1a0019ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53686/0 (socket says 172.21.15.19:53686) 2024-09-19T08:52:00.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.697+0000 7f19fed9d640 1 -- 172.21.15.19:0/3422234578 learned_addr learned my addr 172.21.15.19:0/3422234578 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:00.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.697+0000 7f19fdd9b640 1 --2- 172.21.15.19:0/3422234578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a00102570 0x7f1a0019abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:00.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.698+0000 7f19fe59c640 1 --2- 172.21.15.19:0/3422234578 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a00100e20 0x7f1a0019a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:00.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.698+0000 7f19fed9d640 1 -- 172.21.15.19:0/3422234578 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a00100e20 msgr2=0x7f1a0019a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:00.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.698+0000 7f19fed9d640 1 --2- 172.21.15.19:0/3422234578 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a00100e20 0x7f1a0019a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.698+0000 7f19fed9d640 1 -- 172.21.15.19:0/3422234578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a00102570 msgr2=0x7f1a0019abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:00.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.698+0000 7f19fed9d640 1 --2- 172.21.15.19:0/3422234578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a00102570 0x7f1a0019abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.698+0000 7f19fed9d640 1 -- 172.21.15.19:0/3422234578 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a0019f630 con 0x7f1a00102ef0 2024-09-19T08:52:00.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.698+0000 7f19fe59c640 1 --2- 172.21.15.19:0/3422234578 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a00100e20 0x7f1a0019a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:00.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.698+0000 7f19fed9d640 1 --2- 172.21.15.19:0/3422234578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a00102ef0 0x7f1a0019ef50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f19f800eaa0 tx=0x7f19f800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:00.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.698+0000 7f19f77fe640 1 -- 172.21.15.19:0/3422234578 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f800cdb0 con 0x7f1a00102ef0 2024-09-19T08:52:00.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.698+0000 7f19f77fe640 1 -- 172.21.15.19:0/3422234578 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19f8005020 con 0x7f1a00102ef0 2024-09-19T08:52:00.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.698+0000 7f1a04e5d640 1 -- 172.21.15.19:0/3422234578 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a0019f920 con 0x7f1a00102ef0 2024-09-19T08:52:00.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.698+0000 7f19f77fe640 1 -- 172.21.15.19:0/3422234578 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f80116b0 con 0x7f1a00102ef0 2024-09-19T08:52:00.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.698+0000 7f1a04e5d640 1 -- 172.21.15.19:0/3422234578 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a001a7200 con 0x7f1a00102ef0 2024-09-19T08:52:00.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.701+0000 7f19f77fe640 1 -- 172.21.15.19:0/3422234578 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f19f8005560 con 0x7f1a00102ef0 2024-09-19T08:52:00.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.701+0000 7f1a07236740 1 Processor -- start 2024-09-19T08:52:00.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.701+0000 7f1a07236740 1 -- start start 2024-09-19T08:52:00.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.702+0000 7f1a07236740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0aade49d0 0x55f0aade4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:00.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.702+0000 7f1a07236740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0aade52f0 0x55f0aadef670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:00.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.702+0000 7f1a07236740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0aadefbb0 0x55f0aadf1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:00.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.702+0000 7f1a07236740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f0aad4b090 con 0x55f0aade49d0 2024-09-19T08:52:00.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.702+0000 7f1a07236740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f0aacf2a70 con 0x55f0aade52f0 2024-09-19T08:52:00.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.702+0000 7f1a07236740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f0aad47050 con 0x55f0aadefbb0 2024-09-19T08:52:00.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.702+0000 7f19fdd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0aade49d0 0x55f0aade4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:00.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.702+0000 7f19fdd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0aade49d0 0x55f0aade4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53690/0 (socket says 172.21.15.19:53690) 2024-09-19T08:52:00.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.702+0000 7f19fdd9b640 1 -- 172.21.15.19:0/1229228965 learned_addr learned my addr 172.21.15.19:0/1229228965 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:00.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.702+0000 7f19fdd9b640 1 --2- 172.21.15.19:0/1229228965 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0aadefbb0 0x55f0aadf1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:00.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.702+0000 7f19fe59c640 1 --2- 172.21.15.19:0/1229228965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0aade52f0 0x55f0aadef670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:00.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.702+0000 7f19fdd9b640 1 -- 172.21.15.19:0/1229228965 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0aadefbb0 msgr2=0x55f0aadf1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:00.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.702+0000 7f19fdd9b640 1 --2- 172.21.15.19:0/1229228965 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0aadefbb0 0x55f0aadf1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.702+0000 7f19fdd9b640 1 -- 172.21.15.19:0/1229228965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0aade52f0 msgr2=0x55f0aadef670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:00.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.702+0000 7f19fdd9b640 1 --2- 172.21.15.19:0/1229228965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0aade52f0 0x55f0aadef670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.702+0000 7f19fdd9b640 1 -- 172.21.15.19:0/1229228965 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0aacff130 con 0x55f0aade49d0 2024-09-19T08:52:00.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.702+0000 7f19f77fe640 1 --2- 172.21.15.19:0/3422234578 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f19ec0a3240 0x7f19ec0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:00.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.702+0000 7f19fdd9b640 1 --2- 172.21.15.19:0/1229228965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0aade49d0 0x55f0aade4db0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f19e80096c0 tx=0x7f19e8009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a462c2220de639a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:00.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.702+0000 7f19fe59c640 1 --2- 172.21.15.19:0/3422234578 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f19ec0a3240 0x7f19ec0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:00.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.702+0000 7f19f77fe640 1 -- 172.21.15.19:0/3422234578 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f19f80cfb80 con 0x7f1a00102ef0 2024-09-19T08:52:00.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.703+0000 7f19f4ff9640 1 -- 172.21.15.19:0/1229228965 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e8044020 con 0x55f0aade49d0 2024-09-19T08:52:00.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.703+0000 7f19f4ff9640 1 -- 172.21.15.19:0/1229228965 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19e8004700 con 0x55f0aade49d0 2024-09-19T08:52:00.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.703+0000 7f19f4ff9640 1 -- 172.21.15.19:0/1229228965 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e8035040 con 0x55f0aade49d0 2024-09-19T08:52:00.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.703+0000 7f19fe59c640 1 --2- 172.21.15.19:0/3422234578 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f19ec0a3240 0x7f19ec0a5700 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f19f0005fd0 tx=0x7f19f0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:00.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.703+0000 7f1a07236740 1 -- 172.21.15.19:0/1229228965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0aade49d0 msgr2=0x55f0aade4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:00.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.703+0000 7f1a07236740 1 --2- 172.21.15.19:0/1229228965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0aade49d0 0x55f0aade4db0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f19e80096c0 tx=0x7f19e8009560 comp rx=0 tx=0).stop 2024-09-19T08:52:00.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.703+0000 7f1a07236740 1 -- 172.21.15.19:0/1229228965 shutdown_connections 2024-09-19T08:52:00.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.703+0000 7f1a07236740 1 --2- 172.21.15.19:0/1229228965 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0aadefbb0 0x55f0aadf1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.703+0000 7f1a07236740 1 --2- 172.21.15.19:0/1229228965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0aade52f0 0x55f0aadef670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.703+0000 7f1a07236740 1 --2- 172.21.15.19:0/1229228965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0aade49d0 0x55f0aade4db0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.703+0000 7f1a07236740 1 -- 172.21.15.19:0/1229228965 >> 172.21.15.19:0/1229228965 conn(0x55f0aade0f60 msgr2=0x55f0aade1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:00.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.703+0000 7f1a07236740 1 -- 172.21.15.19:0/1229228965 shutdown_connections 2024-09-19T08:52:00.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.703+0000 7f1a07236740 1 -- 172.21.15.19:0/1229228965 wait complete. 2024-09-19T08:52:00.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.704+0000 7f1a07236740 1 -- start start 2024-09-19T08:52:00.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.704+0000 7f1a07236740 1 Processor -- start 2024-09-19T08:52:00.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.704+0000 7f1a07236740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0aade49d0 0x55f0aadef4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:00.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.704+0000 7f1a07236740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0aade52f0 0x55f0aadec7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:00.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.704+0000 7f1a07236740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0aadefbb0 0x55f0aadecd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:00.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.704+0000 7f1a07236740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f0aadf2780 con 0x55f0aade49d0 2024-09-19T08:52:00.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.704+0000 7f1a07236740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f0aad05f20 con 0x55f0aadefbb0 2024-09-19T08:52:00.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.704+0000 7f1a07236740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f0aadf2900 con 0x55f0aade52f0 2024-09-19T08:52:00.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.704+0000 7f1a07236740 10 client.0 _ll_register_callbacks cb 0x55f0aaccf030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:00.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.704+0000 7f19fe59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0aade49d0 0x55f0aadef4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:00.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.704+0000 7f19fe59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0aade49d0 0x55f0aadef4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53698/0 (socket says 172.21.15.19:53698) 2024-09-19T08:52:00.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.704+0000 7f19fe59c640 1 -- 172.21.15.19:0/3471751549 learned_addr learned my addr 172.21.15.19:0/3471751549 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:00.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.704+0000 7f19fdd9b640 1 --2- 172.21.15.19:0/3471751549 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0aade52f0 0x55f0aadec7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:00.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.705+0000 7f19fed9d640 1 --2- 172.21.15.19:0/3471751549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0aadefbb0 0x55f0aadecd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:00.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.705+0000 7f19fe59c640 1 -- 172.21.15.19:0/3471751549 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0aade52f0 msgr2=0x55f0aadec7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:00.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.705+0000 7f19fe59c640 1 --2- 172.21.15.19:0/3471751549 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0aade52f0 0x55f0aadec7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.705+0000 7f19fe59c640 1 -- 172.21.15.19:0/3471751549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0aadefbb0 msgr2=0x55f0aadecd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:00.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.705+0000 7f19fe59c640 1 --2- 172.21.15.19:0/3471751549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0aadefbb0 0x55f0aadecd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.705+0000 7f19fe59c640 1 -- 172.21.15.19:0/3471751549 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0aaabc2b0 con 0x55f0aade49d0 2024-09-19T08:52:00.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.705+0000 7f19fe59c640 1 --2- 172.21.15.19:0/3471751549 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0aade49d0 0x55f0aadef4a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f19f0005e80 tx=0x7f19f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f2c0ca5ad36129e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:00.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.705+0000 7f19e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:52:00.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.705+0000 7f19e5ffb640 1 -- 172.21.15.19:0/3471751549 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f001d420 con 0x55f0aade49d0 2024-09-19T08:52:00.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.705+0000 7f19e5ffb640 1 -- 172.21.15.19:0/3471751549 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f19f001d5c0 con 0x55f0aade49d0 2024-09-19T08:52:00.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.705+0000 7f1a07236740 1 -- 172.21.15.19:0/3471751549 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19e8004700 con 0x55f0aade49d0 2024-09-19T08:52:00.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.705+0000 7f19e5ffb640 1 -- 172.21.15.19:0/3471751549 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f19f001d7c0 con 0x55f0aade49d0 2024-09-19T08:52:00.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.705+0000 7f1a07236740 10 client.15165 fetch_fsmap learned FSMap version 27 2024-09-19T08:52:00.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.705+0000 7f1a07236740 1 -- 172.21.15.19:0/3471751549 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f0aadfe150 con 0x55f0aade49d0 2024-09-19T08:52:00.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.705+0000 7f19e5ffb640 1 -- 172.21.15.19:0/3471751549 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19e8004700 con 0x55f0aade49d0 2024-09-19T08:52:00.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.706+0000 7f19e5ffb640 1 -- 172.21.15.19:0/3471751549 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f19f00259d0 con 0x55f0aade49d0 2024-09-19T08:52:00.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.706+0000 7f1a07236740 10 client.15165 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T08:52:00.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.706+0000 7f1a07236740 10 client.15165 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T08:52:00.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.706+0000 7f1a07236740 20 client.15165 populate_metadata read hostname 'smithi019' 2024-09-19T08:52:00.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.706+0000 7f1a07236740 1 --2- 172.21.15.19:0/3471751549 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55f0aae007f0 0x55f0aae01c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:00.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.706+0000 7f1a07236740 4 client.15165 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:00.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.706+0000 7f1a07236740 1 -- 172.21.15.19:0/3471751549 --> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f0aad58600 con 0x55f0aae007f0 2024-09-19T08:52:00.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.706+0000 7f19fdd9b640 1 --2- 172.21.15.19:0/3471751549 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55f0aae007f0 0x55f0aae01c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:00.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.706+0000 7f19fdd9b640 1 --2- 172.21.15.19:0/3471751549 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55f0aae007f0 0x55f0aae01c60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=df5e71bbe58389f4 server_cookie=6fc16eb049929bf in_seq=0 out_seq=0 2024-09-19T08:52:00.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.706+0000 7f19e5ffb640 10 client.15165 ms_handle_connect on v2:172.21.15.203:6836/3684671619 2024-09-19T08:52:00.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.707+0000 7f19e5ffb640 1 -- 172.21.15.19:0/3471751549 <== mds.2 v2:172.21.15.203:6836/3684671619 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f0aad58600 con 0x55f0aae007f0 2024-09-19T08:52:00.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.707+0000 7f19e5ffb640 10 client.15165 handle_command_reply: tid=0 2024-09-19T08:52:00.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.707+0000 7f1a07236740 1 client.15165 shutdown 2024-09-19T08:52:00.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.708+0000 7f1a07236740 1 -- 172.21.15.19:0/3471751549 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0aade49d0 msgr2=0x55f0aadef4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:00.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.708+0000 7f1a07236740 1 --2- 172.21.15.19:0/3471751549 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0aade49d0 0x55f0aadef4a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f19f0005e80 tx=0x7f19f00046c0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.708+0000 7f1a07236740 1 -- 172.21.15.19:0/3471751549 shutdown_connections 2024-09-19T08:52:00.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.708+0000 7f1a07236740 1 --2- 172.21.15.19:0/3471751549 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55f0aae007f0 0x55f0aae01c60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.708+0000 7f1a07236740 1 --2- 172.21.15.19:0/3471751549 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0aade52f0 0x55f0aadec7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.708+0000 7f1a07236740 1 --2- 172.21.15.19:0/3471751549 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0aadefbb0 0x55f0aadecd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.708+0000 7f1a07236740 1 --2- 172.21.15.19:0/3471751549 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0aade49d0 0x55f0aadef4a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.708+0000 7f1a07236740 1 -- 172.21.15.19:0/3471751549 >> 172.21.15.19:0/3471751549 conn(0x55f0aade0f60 msgr2=0x55f0aade6c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:00.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.708+0000 7f19e5ffb640 0 client.15165 ms_handle_reset on v2:172.21.15.203:6836/3684671619 2024-09-19T08:52:00.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.708+0000 7f1a07236740 1 -- 172.21.15.19:0/3471751549 shutdown_connections 2024-09-19T08:52:00.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.708+0000 7f1a07236740 1 -- 172.21.15.19:0/3471751549 wait complete. 2024-09-19T08:52:00.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.708+0000 7f1a07236740 20 client.15165 trim_cache size 0 max 16384 2024-09-19T08:52:00.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.725+0000 7f1a07236740 1 Processor -- start 2024-09-19T08:52:00.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.726+0000 7f1a07236740 1 -- start start 2024-09-19T08:52:00.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.726+0000 7f1a07236740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0aade49d0 0x55f0aae007f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:00.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.726+0000 7f1a07236740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0aade52f0 0x55f0aade1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:00.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.726+0000 7f1a07236740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0aadefbb0 0x55f0aadee650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:00.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.726+0000 7f1a07236740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f0aadfffa0 con 0x55f0aade49d0 2024-09-19T08:52:00.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.726+0000 7f1a07236740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f0aae00670 con 0x55f0aadefbb0 2024-09-19T08:52:00.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.726+0000 7f1a07236740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f0aae00d40 con 0x55f0aade52f0 2024-09-19T08:52:00.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.726+0000 7f19fe59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0aade49d0 0x55f0aae007f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:00.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.726+0000 7f19fe59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0aade49d0 0x55f0aae007f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53708/0 (socket says 172.21.15.19:53708) 2024-09-19T08:52:00.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.726+0000 7f19fe59c640 1 -- 172.21.15.19:0/3593954625 learned_addr learned my addr 172.21.15.19:0/3593954625 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:00.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.726+0000 7f19fed9d640 1 --2- 172.21.15.19:0/3593954625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0aadefbb0 0x55f0aadee650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:00.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.726+0000 7f19fdd9b640 1 --2- 172.21.15.19:0/3593954625 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0aade52f0 0x55f0aade1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:00.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.726+0000 7f19fe59c640 1 -- 172.21.15.19:0/3593954625 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0aade52f0 msgr2=0x55f0aade1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:00.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.726+0000 7f19fe59c640 1 --2- 172.21.15.19:0/3593954625 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0aade52f0 0x55f0aade1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.726+0000 7f19fe59c640 1 -- 172.21.15.19:0/3593954625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0aadefbb0 msgr2=0x55f0aadee650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:00.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.726+0000 7f19fe59c640 1 --2- 172.21.15.19:0/3593954625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0aadefbb0 0x55f0aadee650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.726+0000 7f19fe59c640 1 -- 172.21.15.19:0/3593954625 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0aadf2890 con 0x55f0aade49d0 2024-09-19T08:52:00.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.726+0000 7f19fed9d640 1 --2- 172.21.15.19:0/3593954625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0aadefbb0 0x55f0aadee650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:00.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.726+0000 7f19fe59c640 1 --2- 172.21.15.19:0/3593954625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0aade49d0 0x55f0aae007f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f19f0025dc0 tx=0x7f19f0005c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7e6fca6bc11fba3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:00.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.727+0000 7f19e7fff640 1 -- 172.21.15.19:0/3593954625 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f000be40 con 0x55f0aade49d0 2024-09-19T08:52:00.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.727+0000 7f19e7fff640 1 -- 172.21.15.19:0/3593954625 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19f001de40 con 0x55f0aade49d0 2024-09-19T08:52:00.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.727+0000 7f19e7fff640 1 -- 172.21.15.19:0/3593954625 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f0004730 con 0x55f0aade49d0 2024-09-19T08:52:00.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.727+0000 7f1a07236740 1 -- 172.21.15.19:0/3593954625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0aade49d0 msgr2=0x55f0aae007f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:00.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.727+0000 7f1a07236740 1 --2- 172.21.15.19:0/3593954625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0aade49d0 0x55f0aae007f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f19f0025dc0 tx=0x7f19f0005c40 comp rx=0 tx=0).stop 2024-09-19T08:52:00.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.727+0000 7f1a07236740 1 -- 172.21.15.19:0/3593954625 shutdown_connections 2024-09-19T08:52:00.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.727+0000 7f1a07236740 1 --2- 172.21.15.19:0/3593954625 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0aade52f0 0x55f0aade1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.727+0000 7f1a07236740 1 --2- 172.21.15.19:0/3593954625 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0aadefbb0 0x55f0aadee650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.727+0000 7f1a07236740 1 --2- 172.21.15.19:0/3593954625 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0aade49d0 0x55f0aae007f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.727+0000 7f1a07236740 1 -- 172.21.15.19:0/3593954625 >> 172.21.15.19:0/3593954625 conn(0x55f0aade0f60 msgr2=0x55f0aadedf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:00.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.727+0000 7f1a07236740 1 -- 172.21.15.19:0/3593954625 shutdown_connections 2024-09-19T08:52:00.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.727+0000 7f1a07236740 1 -- 172.21.15.19:0/3593954625 wait complete. 2024-09-19T08:52:00.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.728+0000 7f1a07236740 1 -- start start 2024-09-19T08:52:00.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.728+0000 7f1a07236740 1 Processor -- start 2024-09-19T08:52:00.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.728+0000 7f1a07236740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0aade49d0 0x55f0aae0a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:00.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.728+0000 7f1a07236740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0aade52f0 0x55f0aae05850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:00.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.728+0000 7f1a07236740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0aadefbb0 0x55f0aae05d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:00.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.728+0000 7f1a07236740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f0aae01ae0 con 0x55f0aadefbb0 2024-09-19T08:52:00.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.728+0000 7f1a07236740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f0aae01410 con 0x55f0aade49d0 2024-09-19T08:52:00.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.728+0000 7f1a07236740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f0aae021b0 con 0x55f0aade52f0 2024-09-19T08:52:00.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.728+0000 7f1a07236740 10 client.0 _ll_register_callbacks cb 0x7f19f000b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:00.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.728+0000 7f19fed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0aadefbb0 0x55f0aae05d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:00.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.728+0000 7f19fed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0aadefbb0 0x55f0aae05d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53720/0 (socket says 172.21.15.19:53720) 2024-09-19T08:52:00.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.728+0000 7f19fed9d640 1 -- 172.21.15.19:0/1715797156 learned_addr learned my addr 172.21.15.19:0/1715797156 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:00.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.728+0000 7f19fdd9b640 1 --2- 172.21.15.19:0/1715797156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0aade52f0 0x55f0aae05850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:00.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.728+0000 7f19fe59c640 1 --2- 172.21.15.19:0/1715797156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0aade49d0 0x55f0aae0a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:00.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.729+0000 7f19fed9d640 1 -- 172.21.15.19:0/1715797156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0aade52f0 msgr2=0x55f0aae05850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:00.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.729+0000 7f19fed9d640 1 --2- 172.21.15.19:0/1715797156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0aade52f0 0x55f0aae05850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.729+0000 7f19fed9d640 1 -- 172.21.15.19:0/1715797156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0aade49d0 msgr2=0x55f0aae0a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:00.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.729+0000 7f19fed9d640 1 --2- 172.21.15.19:0/1715797156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0aade49d0 0x55f0aae0a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.729+0000 7f19fed9d640 1 -- 172.21.15.19:0/1715797156 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0aae06480 con 0x55f0aadefbb0 2024-09-19T08:52:00.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.729+0000 7f19fed9d640 1 --2- 172.21.15.19:0/1715797156 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0aadefbb0 0x55f0aae05d90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f19f809c140 tx=0x7f19f80a0560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98a98a5062cb94e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:00.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.729+0000 7f19e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:52:00.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.729+0000 7f19e5ffb640 1 -- 172.21.15.19:0/1715797156 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19f801f040 con 0x55f0aadefbb0 2024-09-19T08:52:00.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.729+0000 7f19e5ffb640 1 -- 172.21.15.19:0/1715797156 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f19f80051d0 con 0x55f0aadefbb0 2024-09-19T08:52:00.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.729+0000 7f1a07236740 1 -- 172.21.15.19:0/1715797156 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f0aad52b10 con 0x55f0aadefbb0 2024-09-19T08:52:00.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.729+0000 7f19e5ffb640 1 -- 172.21.15.19:0/1715797156 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f19f80a01b0 con 0x55f0aadefbb0 2024-09-19T08:52:00.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.729+0000 7f1a07236740 10 client.15171 fetch_fsmap learned FSMap version 27 2024-09-19T08:52:00.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.729+0000 7f1a07236740 1 -- 172.21.15.19:0/1715797156 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55f0aae6ae00 con 0x55f0aadefbb0 2024-09-19T08:52:00.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.729+0000 7f19e5ffb640 1 -- 172.21.15.19:0/1715797156 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55f0aad52b10 con 0x55f0aadefbb0 2024-09-19T08:52:00.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.730+0000 7f19e5ffb640 1 -- 172.21.15.19:0/1715797156 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f19f800f040 con 0x55f0aadefbb0 2024-09-19T08:52:00.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.730+0000 7f1a07236740 10 client.15171 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T08:52:00.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.730+0000 7f1a07236740 10 client.15171 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T08:52:00.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.730+0000 7f1a07236740 20 client.15171 populate_metadata read hostname 'smithi019' 2024-09-19T08:52:00.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.730+0000 7f1a07236740 1 --2- 172.21.15.19:0/1715797156 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55f0aae6f9b0 0x55f0aae6e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:00.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.730+0000 7f1a07236740 4 client.15171 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T08:52:00.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.730+0000 7f1a07236740 1 -- 172.21.15.19:0/1715797156 --> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] -- command(tid 0: {"prefix": "status"}) -- 0x55f0aaccf0e0 con 0x55f0aae6f9b0 2024-09-19T08:52:00.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.730+0000 7f19fe59c640 1 --2- 172.21.15.19:0/1715797156 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55f0aae6f9b0 0x55f0aae6e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:00.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.730+0000 7f19e5ffb640 10 client.15171 ms_handle_connect on v2:172.21.15.203:6836/3684671619 2024-09-19T08:52:00.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.730+0000 7f19fe59c640 1 --2- 172.21.15.19:0/1715797156 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55f0aae6f9b0 0x55f0aae6e6c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=615ae5c427db62c3 server_cookie=42b53ea50773d5b8 in_seq=0 out_seq=0 2024-09-19T08:52:00.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.731+0000 7f19e5ffb640 1 -- 172.21.15.19:0/1715797156 <== mds.2 v2:172.21.15.203:6836/3684671619 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55f0aaccf0e0 con 0x55f0aae6f9b0 2024-09-19T08:52:00.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.731+0000 7f19e5ffb640 10 client.15171 handle_command_reply: tid=0 2024-09-19T08:52:00.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.731+0000 7f1a07236740 1 client.15171 shutdown 2024-09-19T08:52:00.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.731+0000 7f1a07236740 1 -- 172.21.15.19:0/1715797156 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0aadefbb0 msgr2=0x55f0aae05d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:00.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.731+0000 7f1a07236740 1 --2- 172.21.15.19:0/1715797156 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0aadefbb0 0x55f0aae05d90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f19f809c140 tx=0x7f19f80a0560 comp rx=0 tx=0).stop 2024-09-19T08:52:00.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.731+0000 7f1a07236740 1 -- 172.21.15.19:0/1715797156 shutdown_connections 2024-09-19T08:52:00.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.731+0000 7f1a07236740 1 --2- 172.21.15.19:0/1715797156 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55f0aae6f9b0 0x55f0aae6e6c0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.731+0000 7f1a07236740 1 --2- 172.21.15.19:0/1715797156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0aade52f0 0x55f0aae05850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.731+0000 7f1a07236740 1 --2- 172.21.15.19:0/1715797156 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0aadefbb0 0x55f0aae05d90 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.731+0000 7f19e5ffb640 0 client.15171 ms_handle_reset on v2:172.21.15.203:6836/3684671619 2024-09-19T08:52:00.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.731+0000 7f1a07236740 1 --2- 172.21.15.19:0/1715797156 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0aade49d0 0x55f0aae0a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.731+0000 7f1a07236740 1 -- 172.21.15.19:0/1715797156 >> 172.21.15.19:0/1715797156 conn(0x55f0aade0f60 msgr2=0x55f0aade0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:00.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.731+0000 7f1a07236740 1 -- 172.21.15.19:0/1715797156 shutdown_connections 2024-09-19T08:52:00.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.731+0000 7f1a07236740 1 -- 172.21.15.19:0/1715797156 wait complete. 2024-09-19T08:52:00.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.731+0000 7f1a07236740 20 client.15171 trim_cache size 0 max 16384 2024-09-19T08:52:00.738 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:52:00.738 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "f26c9d84-7662-11ef-bceb-c7b262605968", 2024-09-19T08:52:00.738 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 2, 2024-09-19T08:52:00.738 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 24469, 2024-09-19T08:52:00.738 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-19T08:52:00.738 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-19T08:52:00.739 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-19T08:52:00.739 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 95.816644006000004, 2024-09-19T08:52:00.739 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 27, 2024-09-19T08:52:00.739 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 82, 2024-09-19T08:52:00.739 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 80, 2024-09-19T08:52:00.739 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 129.35853734700001 2024-09-19T08:52:00.739 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:52:00.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.731+0000 7f1a04e5d640 1 -- 172.21.15.19:0/3422234578 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f19ec0a3240 msgr2=0x7f19ec0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:00.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.731+0000 7f1a04e5d640 1 --2- 172.21.15.19:0/3422234578 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f19ec0a3240 0x7f19ec0a5700 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f19f0005fd0 tx=0x7f19f0005850 comp rx=0 tx=0).stop 2024-09-19T08:52:00.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.731+0000 7f1a04e5d640 1 -- 172.21.15.19:0/3422234578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a00102ef0 msgr2=0x7f1a0019ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:00.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.731+0000 7f1a04e5d640 1 --2- 172.21.15.19:0/3422234578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a00102ef0 0x7f1a0019ef50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f19f800eaa0 tx=0x7f19f800ef60 comp rx=0 tx=0).stop 2024-09-19T08:52:00.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.731+0000 7f1a04e5d640 1 -- 172.21.15.19:0/3422234578 shutdown_connections 2024-09-19T08:52:00.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.731+0000 7f1a04e5d640 1 --2- 172.21.15.19:0/3422234578 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f19ec0a3240 0x7f19ec0a5700 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.731+0000 7f1a04e5d640 1 --2- 172.21.15.19:0/3422234578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a00102ef0 0x7f1a0019ef50 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.731+0000 7f1a04e5d640 1 --2- 172.21.15.19:0/3422234578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a00102570 0x7f1a0019abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.732+0000 7f1a04e5d640 1 --2- 172.21.15.19:0/3422234578 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a00100e20 0x7f1a0019a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:00.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.732+0000 7f1a04e5d640 1 -- 172.21.15.19:0/3422234578 >> 172.21.15.19:0/3422234578 conn(0x7f1a000fc7d0 msgr2=0x7f1a00106c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:00.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.732+0000 7f1a04e5d640 1 -- 172.21.15.19:0/3422234578 shutdown_connections 2024-09-19T08:52:00.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:00.732+0000 7f1a04e5d640 1 -- 172.21.15.19:0/3422234578 wait complete. 2024-09-19T08:52:01.584 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T08:52:01.842 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:01.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:01 smithi155 ceph-mon[34921]: pgmap v331: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-19T08:52:01.964 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:01 smithi019 ceph-mon[30976]: pgmap v331: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-19T08:52:01.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:01 smithi203 ceph-mon[35450]: pgmap v331: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-19T08:52:02.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.320+0000 7f687c316640 1 -- 172.21.15.19:0/1695663045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6874101de0 msgr2=0x7f68741021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:02.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.320+0000 7f687c316640 1 --2- 172.21.15.19:0/1695663045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6874101de0 0x7f68741021c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6870009900 tx=0x7f687002a410 comp rx=0 tx=0).stop 2024-09-19T08:52:02.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.320+0000 7f687c316640 1 -- 172.21.15.19:0/1695663045 shutdown_connections 2024-09-19T08:52:02.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.320+0000 7f687c316640 1 --2- 172.21.15.19:0/1695663045 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6874106f10 0x7f687410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:02.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.320+0000 7f687c316640 1 --2- 172.21.15.19:0/1695663045 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6874102790 0x7f68741067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:02.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.320+0000 7f687c316640 1 --2- 172.21.15.19:0/1695663045 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6874101de0 0x7f68741021c0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:02.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.320+0000 7f687c316640 1 -- 172.21.15.19:0/1695663045 >> 172.21.15.19:0/1695663045 conn(0x7f68740fd8c0 msgr2=0x7f68740ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:02.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.320+0000 7f687c316640 1 -- 172.21.15.19:0/1695663045 shutdown_connections 2024-09-19T08:52:02.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.320+0000 7f687c316640 1 -- 172.21.15.19:0/1695663045 wait complete. 2024-09-19T08:52:02.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.320+0000 7f687c316640 1 Processor -- start 2024-09-19T08:52:02.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.321+0000 7f687c316640 1 -- start start 2024-09-19T08:52:02.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.321+0000 7f687c316640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6874101de0 0x7f68741985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:02.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.321+0000 7f687c316640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6874102790 0x7f6874198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:02.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.321+0000 7f687c316640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6874106f10 0x7f687419ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:02.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.321+0000 7f687c316640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6874112010 con 0x7f6874102790 2024-09-19T08:52:02.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.321+0000 7f687c316640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6874111e90 con 0x7f6874101de0 2024-09-19T08:52:02.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.321+0000 7f687c316640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6874112190 con 0x7f6874106f10 2024-09-19T08:52:02.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.321+0000 7f68798b1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6874102790 0x7f6874198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:02.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.321+0000 7f68798b1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6874102790 0x7f6874198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53744/0 (socket says 172.21.15.19:53744) 2024-09-19T08:52:02.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.321+0000 7f68798b1640 1 -- 172.21.15.19:0/252020726 learned_addr learned my addr 172.21.15.19:0/252020726 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:02.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.321+0000 7f687a0b2640 1 --2- 172.21.15.19:0/252020726 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6874101de0 0x7f68741985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:02.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.321+0000 7f687a8b3640 1 --2- 172.21.15.19:0/252020726 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6874106f10 0x7f687419ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:02.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.321+0000 7f68798b1640 1 -- 172.21.15.19:0/252020726 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6874106f10 msgr2=0x7f687419ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:02.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.321+0000 7f68798b1640 1 --2- 172.21.15.19:0/252020726 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6874106f10 0x7f687419ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:02.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.321+0000 7f68798b1640 1 -- 172.21.15.19:0/252020726 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6874101de0 msgr2=0x7f68741985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:02.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.321+0000 7f68798b1640 1 --2- 172.21.15.19:0/252020726 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6874101de0 0x7f68741985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:02.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.321+0000 7f68798b1640 1 -- 172.21.15.19:0/252020726 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f687419d560 con 0x7f6874102790 2024-09-19T08:52:02.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.321+0000 7f68798b1640 1 --2- 172.21.15.19:0/252020726 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6874102790 0x7f6874198af0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f686400b4a0 tx=0x7f686400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:02.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.322+0000 7f686b7fe640 1 -- 172.21.15.19:0/252020726 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6864014070 con 0x7f6874102790 2024-09-19T08:52:02.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.322+0000 7f687c316640 1 -- 172.21.15.19:0/252020726 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f687419d850 con 0x7f6874102790 2024-09-19T08:52:02.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.322+0000 7f686b7fe640 1 -- 172.21.15.19:0/252020726 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6864010af0 con 0x7f6874102790 2024-09-19T08:52:02.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.322+0000 7f686b7fe640 1 -- 172.21.15.19:0/252020726 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6864017d10 con 0x7f6874102790 2024-09-19T08:52:02.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.322+0000 7f687c316640 1 -- 172.21.15.19:0/252020726 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68741a5130 con 0x7f6874102790 2024-09-19T08:52:02.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.324+0000 7f686b7fe640 1 -- 172.21.15.19:0/252020726 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6864017070 con 0x7f6874102790 2024-09-19T08:52:02.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.324+0000 7f687e6ef740 1 Processor -- start 2024-09-19T08:52:02.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.324+0000 7f687e6ef740 1 -- start start 2024-09-19T08:52:02.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.324+0000 7f687e6ef740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e6a58e79d0 0x55e6a58e7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:02.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.324+0000 7f687e6ef740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6a58e82f0 0x55e6a58f2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:02.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.324+0000 7f687e6ef740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a58f2bb0 0x55e6a58f4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:02.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.324+0000 7f687e6ef740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e6a584e090 con 0x55e6a58e82f0 2024-09-19T08:52:02.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.324+0000 7f687e6ef740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55e6a57f5a70 con 0x55e6a58e79d0 2024-09-19T08:52:02.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.324+0000 7f687e6ef740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e6a584a050 con 0x55e6a58f2bb0 2024-09-19T08:52:02.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.325+0000 7f687a0b2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6a58e82f0 0x55e6a58f2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:02.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.325+0000 7f687a0b2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6a58e82f0 0x55e6a58f2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53752/0 (socket says 172.21.15.19:53752) 2024-09-19T08:52:02.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.325+0000 7f687a0b2640 1 -- 172.21.15.19:0/2475449812 learned_addr learned my addr 172.21.15.19:0/2475449812 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:02.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.325+0000 7f687a8b3640 1 --2- 172.21.15.19:0/2475449812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e6a58e79d0 0x55e6a58e7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:02.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.325+0000 7f686b7fe640 1 --2- 172.21.15.19:0/252020726 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f68600a3240 0x7f68600a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:02.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.325+0000 7f68798b1640 1 --2- 172.21.15.19:0/2475449812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a58f2bb0 0x55e6a58f4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:02.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.325+0000 7f687a0b2640 1 -- 172.21.15.19:0/2475449812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a58f2bb0 msgr2=0x55e6a58f4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:02.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.325+0000 7f687a0b2640 1 --2- 172.21.15.19:0/2475449812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a58f2bb0 0x55e6a58f4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:02.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.325+0000 7f687a0b2640 1 -- 172.21.15.19:0/2475449812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e6a58e79d0 msgr2=0x55e6a58e7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:02.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.325+0000 7f687a0b2640 1 --2- 172.21.15.19:0/2475449812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e6a58e79d0 0x55e6a58e7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:02.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.325+0000 7f687a0b2640 1 -- 172.21.15.19:0/2475449812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6a5802130 con 0x55e6a58e82f0 2024-09-19T08:52:02.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.325+0000 7f687a8b3640 1 --2- 172.21.15.19:0/2475449812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e6a58e79d0 0x55e6a58e7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:02.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.325+0000 7f687a8b3640 1 --2- 172.21.15.19:0/252020726 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f68600a3240 0x7f68600a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:02.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.325+0000 7f686b7fe640 1 -- 172.21.15.19:0/252020726 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f68640ced80 con 0x7f6874102790 2024-09-19T08:52:02.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.325+0000 7f687a0b2640 1 --2- 172.21.15.19:0/2475449812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6a58e82f0 0x55e6a58f2670 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6870005ab0 tx=0x7f6870031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95616bb9084b333f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:02.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.325+0000 7f6868dea640 1 -- 172.21.15.19:0/2475449812 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687003f070 con 0x55e6a58e82f0 2024-09-19T08:52:02.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.325+0000 7f6868dea640 1 -- 172.21.15.19:0/2475449812 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6870031a20 con 0x55e6a58e82f0 2024-09-19T08:52:02.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.325+0000 7f6868dea640 1 -- 172.21.15.19:0/2475449812 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6870035070 con 0x55e6a58e82f0 2024-09-19T08:52:02.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.326+0000 7f687e6ef740 1 -- 172.21.15.19:0/2475449812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6a58e82f0 msgr2=0x55e6a58f2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:02.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.326+0000 7f687a8b3640 1 --2- 172.21.15.19:0/252020726 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f68600a3240 0x7f68600a5700 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f686c00a4c0 tx=0x7f686c00c040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:02.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.326+0000 7f687e6ef740 1 --2- 172.21.15.19:0/2475449812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6a58e82f0 0x55e6a58f2670 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f6870005ab0 tx=0x7f6870031630 comp rx=0 tx=0).stop 2024-09-19T08:52:02.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.326+0000 7f687e6ef740 1 -- 172.21.15.19:0/2475449812 shutdown_connections 2024-09-19T08:52:02.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.326+0000 7f687e6ef740 1 --2- 172.21.15.19:0/2475449812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a58f2bb0 0x55e6a58f4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:02.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.326+0000 7f687e6ef740 1 --2- 172.21.15.19:0/2475449812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6a58e82f0 0x55e6a58f2670 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:02.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.326+0000 7f687e6ef740 1 --2- 172.21.15.19:0/2475449812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e6a58e79d0 0x55e6a58e7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:02.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.326+0000 7f687e6ef740 1 -- 172.21.15.19:0/2475449812 >> 172.21.15.19:0/2475449812 conn(0x55e6a58e3f60 msgr2=0x55e6a58e4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:02.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.326+0000 7f687e6ef740 1 -- 172.21.15.19:0/2475449812 shutdown_connections 2024-09-19T08:52:02.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.326+0000 7f687e6ef740 1 -- 172.21.15.19:0/2475449812 wait complete. 2024-09-19T08:52:02.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.327+0000 7f687e6ef740 1 -- start start 2024-09-19T08:52:02.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.327+0000 7f687e6ef740 1 Processor -- start 2024-09-19T08:52:02.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.327+0000 7f687e6ef740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a58e79d0 0x55e6a58f2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:02.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.327+0000 7f687e6ef740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6a58e82f0 0x55e6a58ef780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:02.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.327+0000 7f687e6ef740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e6a58f2bb0 0x55e6a58efcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:02.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.327+0000 7f687e6ef740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e6a58f5780 con 0x55e6a58e82f0 2024-09-19T08:52:02.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.327+0000 7f687e6ef740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55e6a5808f20 con 0x55e6a58f2bb0 2024-09-19T08:52:02.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.327+0000 7f687e6ef740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e6a58f5900 con 0x55e6a58e79d0 2024-09-19T08:52:02.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.327+0000 7f687e6ef740 10 client.0 _ll_register_callbacks cb 0x55e6a57d2030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:02.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.327+0000 7f68798b1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6a58e82f0 0x55e6a58ef780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:02.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.327+0000 7f68798b1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6a58e82f0 0x55e6a58ef780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53768/0 (socket says 172.21.15.19:53768) 2024-09-19T08:52:02.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.327+0000 7f68798b1640 1 -- 172.21.15.19:0/2066615865 learned_addr learned my addr 172.21.15.19:0/2066615865 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:02.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.327+0000 7f687a0b2640 1 --2- 172.21.15.19:0/2066615865 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a58e79d0 0x55e6a58f2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:02.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.327+0000 7f687a8b3640 1 --2- 172.21.15.19:0/2066615865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e6a58f2bb0 0x55e6a58efcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:02.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.328+0000 7f68798b1640 1 -- 172.21.15.19:0/2066615865 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a58e79d0 msgr2=0x55e6a58f2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:02.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.328+0000 7f68798b1640 1 --2- 172.21.15.19:0/2066615865 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a58e79d0 0x55e6a58f2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:02.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.328+0000 7f68798b1640 1 -- 172.21.15.19:0/2066615865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e6a58f2bb0 msgr2=0x55e6a58efcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:02.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.328+0000 7f68798b1640 1 --2- 172.21.15.19:0/2066615865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e6a58f2bb0 0x55e6a58efcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:02.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.328+0000 7f68798b1640 1 -- 172.21.15.19:0/2066615865 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6a55bf2b0 con 0x55e6a58e82f0 2024-09-19T08:52:02.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.328+0000 7f68798b1640 1 --2- 172.21.15.19:0/2066615865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6a58e82f0 0x55e6a58ef780 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f686400be60 tx=0x7f686409ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e190d44852b241 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:02.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.328+0000 7f685dffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:52:02.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.328+0000 7f685dffb640 1 -- 172.21.15.19:0/2066615865 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686401e070 con 0x55e6a58e82f0 2024-09-19T08:52:02.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.328+0000 7f685dffb640 1 -- 172.21.15.19:0/2066615865 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6864017360 con 0x55e6a58e82f0 2024-09-19T08:52:02.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.328+0000 7f687e6ef740 1 -- 172.21.15.19:0/2066615865 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6870031a20 con 0x55e6a58e82f0 2024-09-19T08:52:02.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.328+0000 7f685dffb640 1 -- 172.21.15.19:0/2066615865 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f686409b610 con 0x55e6a58e82f0 2024-09-19T08:52:02.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.328+0000 7f687e6ef740 10 client.15183 fetch_fsmap learned FSMap version 27 2024-09-19T08:52:02.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.328+0000 7f687e6ef740 1 -- 172.21.15.19:0/2066615865 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e6a59010f0 con 0x55e6a58e82f0 2024-09-19T08:52:02.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.328+0000 7f685dffb640 1 -- 172.21.15.19:0/2066615865 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6870031a20 con 0x55e6a58e82f0 2024-09-19T08:52:02.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.328+0000 7f685dffb640 1 -- 172.21.15.19:0/2066615865 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f686409c360 con 0x55e6a58e82f0 2024-09-19T08:52:02.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.328+0000 7f687e6ef740 10 client.15183 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T08:52:02.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.329+0000 7f687e6ef740 10 client.15183 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T08:52:02.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.329+0000 7f687e6ef740 20 client.15183 populate_metadata read hostname 'smithi019' 2024-09-19T08:52:02.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.329+0000 7f687e6ef740 1 --2- 172.21.15.19:0/2066615865 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55e6a5903740 0x55e6a5904bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:02.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.329+0000 7f687e6ef740 4 client.15183 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:02.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.329+0000 7f687e6ef740 1 -- 172.21.15.19:0/2066615865 --> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6a585b600 con 0x55e6a5903740 2024-09-19T08:52:02.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.329+0000 7f687a0b2640 1 --2- 172.21.15.19:0/2066615865 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55e6a5903740 0x55e6a5904bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:02.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.329+0000 7f687a0b2640 1 --2- 172.21.15.19:0/2066615865 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55e6a5903740 0x55e6a5904bb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2efaffb8856a0852 server_cookie=6740f3fc15a2f20 in_seq=0 out_seq=0 2024-09-19T08:52:02.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.329+0000 7f685dffb640 10 client.15183 ms_handle_connect on v2:172.21.15.203:6838/2547507299 2024-09-19T08:52:02.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.330+0000 7f685dffb640 1 -- 172.21.15.19:0/2066615865 <== mds.1 v2:172.21.15.203:6838/2547507299 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e6a585b600 con 0x55e6a5903740 2024-09-19T08:52:02.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.330+0000 7f685dffb640 10 client.15183 handle_command_reply: tid=0 2024-09-19T08:52:02.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.330+0000 7f687e6ef740 1 client.15183 shutdown 2024-09-19T08:52:02.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.330+0000 7f687e6ef740 1 -- 172.21.15.19:0/2066615865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6a58e82f0 msgr2=0x55e6a58ef780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:02.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.331+0000 7f687e6ef740 1 --2- 172.21.15.19:0/2066615865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6a58e82f0 0x55e6a58ef780 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f686400be60 tx=0x7f686409ad10 comp rx=0 tx=0).stop 2024-09-19T08:52:02.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.331+0000 7f687e6ef740 1 -- 172.21.15.19:0/2066615865 shutdown_connections 2024-09-19T08:52:02.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.331+0000 7f687e6ef740 1 --2- 172.21.15.19:0/2066615865 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55e6a5903740 0x55e6a5904bb0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:02.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.331+0000 7f687e6ef740 1 --2- 172.21.15.19:0/2066615865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e6a58f2bb0 0x55e6a58efcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:02.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.331+0000 7f687e6ef740 1 --2- 172.21.15.19:0/2066615865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6a58e82f0 0x55e6a58ef780 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:02.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.331+0000 7f685dffb640 0 client.15183 ms_handle_reset on v2:172.21.15.203:6838/2547507299 2024-09-19T08:52:02.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.331+0000 7f687e6ef740 1 --2- 172.21.15.19:0/2066615865 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a58e79d0 0x55e6a58f2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:02.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.331+0000 7f687e6ef740 1 -- 172.21.15.19:0/2066615865 >> 172.21.15.19:0/2066615865 conn(0x55e6a58e3f60 msgr2=0x55e6a58e9c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:02.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.331+0000 7f687e6ef740 1 -- 172.21.15.19:0/2066615865 shutdown_connections 2024-09-19T08:52:02.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.331+0000 7f687e6ef740 1 -- 172.21.15.19:0/2066615865 wait complete. 2024-09-19T08:52:02.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.331+0000 7f687e6ef740 20 client.15183 trim_cache size 0 max 16384 2024-09-19T08:52:02.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.349+0000 7f687e6ef740 1 Processor -- start 2024-09-19T08:52:02.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.349+0000 7f687e6ef740 1 -- start start 2024-09-19T08:52:02.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.349+0000 7f687e6ef740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6a58e79d0 0x55e6a5903070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:02.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.349+0000 7f687e6ef740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e6a58e82f0 0x55e6a5904bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:02.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.349+0000 7f687e6ef740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a58f2bb0 0x55e6a58ef040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:02.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.349+0000 7f687e6ef740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e6a5902ef0 con 0x55e6a58e79d0 2024-09-19T08:52:02.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.349+0000 7f687e6ef740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55e6a59035c0 con 0x55e6a58e82f0 2024-09-19T08:52:02.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.349+0000 7f687e6ef740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e6a5903c90 con 0x55e6a58f2bb0 2024-09-19T08:52:02.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.349+0000 7f687a0b2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6a58e79d0 0x55e6a5903070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:02.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.349+0000 7f687a0b2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6a58e79d0 0x55e6a5903070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53770/0 (socket says 172.21.15.19:53770) 2024-09-19T08:52:02.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.349+0000 7f687a0b2640 1 -- 172.21.15.19:0/2132580882 learned_addr learned my addr 172.21.15.19:0/2132580882 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:02.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.349+0000 7f687a8b3640 1 --2- 172.21.15.19:0/2132580882 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a58f2bb0 0x55e6a58ef040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:02.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.349+0000 7f687a0b2640 1 -- 172.21.15.19:0/2132580882 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a58f2bb0 msgr2=0x55e6a58ef040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:02.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.349+0000 7f687a0b2640 1 --2- 172.21.15.19:0/2132580882 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a58f2bb0 0x55e6a58ef040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:02.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.349+0000 7f687a0b2640 1 -- 172.21.15.19:0/2132580882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e6a58e82f0 msgr2=0x55e6a5904bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:02.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.349+0000 7f68798b1640 1 --2- 172.21.15.19:0/2132580882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e6a58e82f0 0x55e6a5904bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:02.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.350+0000 7f687a0b2640 1 --2- 172.21.15.19:0/2132580882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e6a58e82f0 0x55e6a5904bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:02.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.350+0000 7f687a0b2640 1 -- 172.21.15.19:0/2132580882 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6a58f27a0 con 0x55e6a58e79d0 2024-09-19T08:52:02.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.350+0000 7f68798b1640 1 --2- 172.21.15.19:0/2132580882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e6a58e82f0 0x55e6a5904bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:02.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.350+0000 7f687a0b2640 1 --2- 172.21.15.19:0/2132580882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6a58e79d0 0x55e6a5903070 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6870005660 tx=0x7f68700055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46bd5db3d9b13f8b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:02.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.350+0000 7f685ffff640 1 -- 172.21.15.19:0/2132580882 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6870053070 con 0x55e6a58e79d0 2024-09-19T08:52:02.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.350+0000 7f685ffff640 1 -- 172.21.15.19:0/2132580882 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68700043c0 con 0x55e6a58e79d0 2024-09-19T08:52:02.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.350+0000 7f685ffff640 1 -- 172.21.15.19:0/2132580882 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f687003f040 con 0x55e6a58e79d0 2024-09-19T08:52:02.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.350+0000 7f687e6ef740 1 -- 172.21.15.19:0/2132580882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6a58e79d0 msgr2=0x55e6a5903070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:02.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.351+0000 7f687e6ef740 1 --2- 172.21.15.19:0/2132580882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6a58e79d0 0x55e6a5903070 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f6870005660 tx=0x7f68700055f0 comp rx=0 tx=0).stop 2024-09-19T08:52:02.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.351+0000 7f687e6ef740 1 -- 172.21.15.19:0/2132580882 shutdown_connections 2024-09-19T08:52:02.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.351+0000 7f687e6ef740 1 --2- 172.21.15.19:0/2132580882 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a58f2bb0 0x55e6a58ef040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:02.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.351+0000 7f687e6ef740 1 --2- 172.21.15.19:0/2132580882 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e6a58e82f0 0x55e6a5904bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:02.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.351+0000 7f687e6ef740 1 --2- 172.21.15.19:0/2132580882 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6a58e79d0 0x55e6a5903070 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:02.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.351+0000 7f687e6ef740 1 -- 172.21.15.19:0/2132580882 >> 172.21.15.19:0/2132580882 conn(0x55e6a58e3f60 msgr2=0x55e6a58ef740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:02.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.351+0000 7f687e6ef740 1 -- 172.21.15.19:0/2132580882 shutdown_connections 2024-09-19T08:52:02.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.351+0000 7f687e6ef740 1 -- 172.21.15.19:0/2132580882 wait complete. 2024-09-19T08:52:02.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.351+0000 7f687e6ef740 1 -- start start 2024-09-19T08:52:02.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.351+0000 7f687e6ef740 1 Processor -- start 2024-09-19T08:52:02.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.351+0000 7f687e6ef740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a58e79d0 0x55e6a5907b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:02.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.351+0000 7f687e6ef740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e6a58e82f0 0x55e6a5908060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:02.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.351+0000 7f687e6ef740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6a58f2bb0 0x55e6a59085a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:02.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.351+0000 7f687e6ef740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e6a5904a30 con 0x55e6a58f2bb0 2024-09-19T08:52:02.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.351+0000 7f687e6ef740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55e6a5904360 con 0x55e6a58e82f0 2024-09-19T08:52:02.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.351+0000 7f687e6ef740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e6a5905100 con 0x55e6a58e79d0 2024-09-19T08:52:02.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.351+0000 7f687e6ef740 10 client.0 _ll_register_callbacks cb 0x7f6864017630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:02.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.352+0000 7f687a8b3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6a58f2bb0 0x55e6a59085a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:02.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.352+0000 7f687a8b3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6a58f2bb0 0x55e6a59085a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53786/0 (socket says 172.21.15.19:53786) 2024-09-19T08:52:02.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.352+0000 7f687a8b3640 1 -- 172.21.15.19:0/4164759981 learned_addr learned my addr 172.21.15.19:0/4164759981 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:02.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.352+0000 7f68798b1640 1 --2- 172.21.15.19:0/4164759981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e6a58e82f0 0x55e6a5908060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:02.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.352+0000 7f687a0b2640 1 --2- 172.21.15.19:0/4164759981 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a58e79d0 0x55e6a5907b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:02.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.352+0000 7f687a8b3640 1 -- 172.21.15.19:0/4164759981 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a58e79d0 msgr2=0x55e6a5907b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:02.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.352+0000 7f687a8b3640 1 --2- 172.21.15.19:0/4164759981 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a58e79d0 0x55e6a5907b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:02.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.352+0000 7f687a8b3640 1 -- 172.21.15.19:0/4164759981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e6a58e82f0 msgr2=0x55e6a5908060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:02.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.352+0000 7f687a8b3640 1 --2- 172.21.15.19:0/4164759981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e6a58e82f0 0x55e6a5908060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:02.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.352+0000 7f687a8b3640 1 -- 172.21.15.19:0/4164759981 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6a596be40 con 0x55e6a58f2bb0 2024-09-19T08:52:02.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.352+0000 7f687a8b3640 1 --2- 172.21.15.19:0/4164759981 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6a58f2bb0 0x55e6a59085a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f686c016bd0 tx=0x7f686c009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=476dc160cfaf9742 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:02.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.352+0000 7f685dffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:52:02.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.352+0000 7f685dffb640 1 -- 172.21.15.19:0/4164759981 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686c007ce0 con 0x55e6a58f2bb0 2024-09-19T08:52:02.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.352+0000 7f685dffb640 1 -- 172.21.15.19:0/4164759981 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f686c024480 con 0x55e6a58f2bb0 2024-09-19T08:52:02.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.352+0000 7f687e6ef740 1 -- 172.21.15.19:0/4164759981 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68700043c0 con 0x55e6a58f2bb0 2024-09-19T08:52:02.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.352+0000 7f685dffb640 1 -- 172.21.15.19:0/4164759981 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f686c016e40 con 0x55e6a58f2bb0 2024-09-19T08:52:02.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.353+0000 7f687e6ef740 10 client.15189 fetch_fsmap learned FSMap version 27 2024-09-19T08:52:02.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.353+0000 7f687e6ef740 1 -- 172.21.15.19:0/4164759981 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55e6a596d040 con 0x55e6a58f2bb0 2024-09-19T08:52:02.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.353+0000 7f685dffb640 1 -- 172.21.15.19:0/4164759981 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68700043c0 con 0x55e6a58f2bb0 2024-09-19T08:52:02.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.353+0000 7f685dffb640 1 -- 172.21.15.19:0/4164759981 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f686c02d6f0 con 0x55e6a58f2bb0 2024-09-19T08:52:02.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.353+0000 7f687e6ef740 10 client.15189 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T08:52:02.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.353+0000 7f687e6ef740 10 client.15189 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T08:52:02.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.353+0000 7f687e6ef740 20 client.15189 populate_metadata read hostname 'smithi019' 2024-09-19T08:52:02.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.353+0000 7f687e6ef740 1 --2- 172.21.15.19:0/4164759981 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55e6a5971cf0 0x55e6a5970a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:02.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.353+0000 7f687e6ef740 4 client.15189 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T08:52:02.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.353+0000 7f687e6ef740 1 -- 172.21.15.19:0/4164759981 --> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] -- command(tid 0: {"prefix": "status"}) -- 0x55e6a5855b10 con 0x55e6a5971cf0 2024-09-19T08:52:02.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.353+0000 7f687a0b2640 1 --2- 172.21.15.19:0/4164759981 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55e6a5971cf0 0x55e6a5970a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:02.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.354+0000 7f685dffb640 10 client.15189 ms_handle_connect on v2:172.21.15.203:6838/2547507299 2024-09-19T08:52:02.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.354+0000 7f687a0b2640 1 --2- 172.21.15.19:0/4164759981 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55e6a5971cf0 0x55e6a5970a00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a550b7b21757e637 server_cookie=9e403b4f9ced82ff in_seq=0 out_seq=0 2024-09-19T08:52:02.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.354+0000 7f685dffb640 1 -- 172.21.15.19:0/4164759981 <== mds.1 v2:172.21.15.203:6838/2547507299 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55e6a5855b10 con 0x55e6a5971cf0 2024-09-19T08:52:02.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.354+0000 7f685dffb640 10 client.15189 handle_command_reply: tid=0 2024-09-19T08:52:02.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.354+0000 7f687e6ef740 1 client.15189 shutdown 2024-09-19T08:52:02.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.354+0000 7f687e6ef740 1 -- 172.21.15.19:0/4164759981 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6a58f2bb0 msgr2=0x55e6a59085a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:02.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.354+0000 7f687e6ef740 1 --2- 172.21.15.19:0/4164759981 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6a58f2bb0 0x55e6a59085a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f686c016bd0 tx=0x7f686c009620 comp rx=0 tx=0).stop 2024-09-19T08:52:02.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.354+0000 7f687e6ef740 1 -- 172.21.15.19:0/4164759981 shutdown_connections 2024-09-19T08:52:02.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.354+0000 7f687e6ef740 1 --2- 172.21.15.19:0/4164759981 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55e6a5971cf0 0x55e6a5970a00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:02.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.354+0000 7f687e6ef740 1 --2- 172.21.15.19:0/4164759981 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e6a58f2bb0 0x55e6a59085a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:02.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.354+0000 7f687e6ef740 1 --2- 172.21.15.19:0/4164759981 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e6a58e82f0 0x55e6a5908060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:02.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.354+0000 7f687e6ef740 1 --2- 172.21.15.19:0/4164759981 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e6a58e79d0 0x55e6a5907b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:02.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.354+0000 7f687e6ef740 1 -- 172.21.15.19:0/4164759981 >> 172.21.15.19:0/4164759981 conn(0x55e6a58e3f60 msgr2=0x55e6a58ef740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:02.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.354+0000 7f685dffb640 0 client.15189 ms_handle_reset on v2:172.21.15.203:6838/2547507299 2024-09-19T08:52:02.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.354+0000 7f687e6ef740 1 -- 172.21.15.19:0/4164759981 shutdown_connections 2024-09-19T08:52:02.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.354+0000 7f687e6ef740 1 -- 172.21.15.19:0/4164759981 wait complete. 2024-09-19T08:52:02.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.354+0000 7f687e6ef740 20 client.15189 trim_cache size 0 max 16384 2024-09-19T08:52:02.363 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:52:02.363 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "f26c9d84-7662-11ef-bceb-c7b262605968", 2024-09-19T08:52:02.363 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 1, 2024-09-19T08:52:02.363 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 24490, 2024-09-19T08:52:02.363 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-19T08:52:02.363 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-19T08:52:02.363 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-19T08:52:02.363 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 98.444518599000006, 2024-09-19T08:52:02.363 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 27, 2024-09-19T08:52:02.363 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 82, 2024-09-19T08:52:02.363 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 80, 2024-09-19T08:52:02.363 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 125.685306035 2024-09-19T08:52:02.364 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:52:02.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.355+0000 7f687c316640 1 -- 172.21.15.19:0/252020726 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f68600a3240 msgr2=0x7f68600a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:02.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.355+0000 7f687c316640 1 --2- 172.21.15.19:0/252020726 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f68600a3240 0x7f68600a5700 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f686c00a4c0 tx=0x7f686c00c040 comp rx=0 tx=0).stop 2024-09-19T08:52:02.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.355+0000 7f687c316640 1 -- 172.21.15.19:0/252020726 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6874102790 msgr2=0x7f6874198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:02.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.355+0000 7f687c316640 1 --2- 172.21.15.19:0/252020726 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6874102790 0x7f6874198af0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f686400b4a0 tx=0x7f686400b960 comp rx=0 tx=0).stop 2024-09-19T08:52:02.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.355+0000 7f687c316640 1 -- 172.21.15.19:0/252020726 shutdown_connections 2024-09-19T08:52:02.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.355+0000 7f687c316640 1 --2- 172.21.15.19:0/252020726 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f68600a3240 0x7f68600a5700 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:02.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.355+0000 7f687c316640 1 --2- 172.21.15.19:0/252020726 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6874106f10 0x7f687419ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:02.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.355+0000 7f687c316640 1 --2- 172.21.15.19:0/252020726 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6874102790 0x7f6874198af0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:02.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.355+0000 7f687c316640 1 --2- 172.21.15.19:0/252020726 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6874101de0 0x7f68741985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:02.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.355+0000 7f687c316640 1 -- 172.21.15.19:0/252020726 >> 172.21.15.19:0/252020726 conn(0x7f68740fd8c0 msgr2=0x7f68740fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:02.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.355+0000 7f687c316640 1 -- 172.21.15.19:0/252020726 shutdown_connections 2024-09-19T08:52:02.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:02.355+0000 7f687c316640 1 -- 172.21.15.19:0/252020726 wait complete. 2024-09-19T08:52:03.071 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T08:52:03.348 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:03.725 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:03 smithi019 ceph-mon[30976]: pgmap v332: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-19T08:52:03.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.809+0000 7fac8604d640 1 -- 172.21.15.19:0/1154796188 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac80101de0 msgr2=0x7fac801021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:03.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.809+0000 7fac8604d640 1 --2- 172.21.15.19:0/1154796188 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac80101de0 0x7fac801021c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fac70009900 tx=0x7fac7002a410 comp rx=0 tx=0).stop 2024-09-19T08:52:03.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.809+0000 7fac8604d640 1 -- 172.21.15.19:0/1154796188 shutdown_connections 2024-09-19T08:52:03.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.809+0000 7fac8604d640 1 --2- 172.21.15.19:0/1154796188 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac80106f10 0x7fac8010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.809+0000 7fac8604d640 1 --2- 172.21.15.19:0/1154796188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac80102790 0x7fac801067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.809+0000 7fac8604d640 1 --2- 172.21.15.19:0/1154796188 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac80101de0 0x7fac801021c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.809+0000 7fac8604d640 1 -- 172.21.15.19:0/1154796188 >> 172.21.15.19:0/1154796188 conn(0x7fac800fd8c0 msgr2=0x7fac800ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:03.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.809+0000 7fac8604d640 1 -- 172.21.15.19:0/1154796188 shutdown_connections 2024-09-19T08:52:03.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.809+0000 7fac8604d640 1 -- 172.21.15.19:0/1154796188 wait complete. 2024-09-19T08:52:03.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.810+0000 7fac8604d640 1 Processor -- start 2024-09-19T08:52:03.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.810+0000 7fac8604d640 1 -- start start 2024-09-19T08:52:03.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.810+0000 7fac8604d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac80101de0 0x7fac80198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.810+0000 7fac8604d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac80102790 0x7fac80198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.810+0000 7fac8604d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac80106f10 0x7fac8019ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.810+0000 7fac8604d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fac80111f70 con 0x7fac80106f10 2024-09-19T08:52:03.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.810+0000 7fac8604d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fac80111df0 con 0x7fac80102790 2024-09-19T08:52:03.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.810+0000 7fac8604d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fac801120f0 con 0x7fac80101de0 2024-09-19T08:52:03.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.810+0000 7fac7ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac80106f10 0x7fac8019ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.810+0000 7fac7ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac80106f10 0x7fac8019ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53800/0 (socket says 172.21.15.19:53800) 2024-09-19T08:52:03.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.810+0000 7fac7ffff640 1 -- 172.21.15.19:0/412586412 learned_addr learned my addr 172.21.15.19:0/412586412 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:03.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.810+0000 7fac7effd640 1 --2- 172.21.15.19:0/412586412 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac80102790 0x7fac80198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.810+0000 7fac7f7fe640 1 --2- 172.21.15.19:0/412586412 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac80101de0 0x7fac80198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.811+0000 7fac7ffff640 1 -- 172.21.15.19:0/412586412 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac80101de0 msgr2=0x7fac80198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:03.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.811+0000 7fac7ffff640 1 --2- 172.21.15.19:0/412586412 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac80101de0 0x7fac80198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.811+0000 7fac7ffff640 1 -- 172.21.15.19:0/412586412 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac80102790 msgr2=0x7fac80198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:03.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.811+0000 7fac7ffff640 1 --2- 172.21.15.19:0/412586412 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac80102790 0x7fac80198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.811+0000 7fac7ffff640 1 -- 172.21.15.19:0/412586412 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac8019d3d0 con 0x7fac80106f10 2024-09-19T08:52:03.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.811+0000 7fac7ffff640 1 --2- 172.21.15.19:0/412586412 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac80106f10 0x7fac8019ccf0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fac7800cad0 tx=0x7fac7800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:03.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.811+0000 7fac7cff9640 1 -- 172.21.15.19:0/412586412 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7800ae20 con 0x7fac80106f10 2024-09-19T08:52:03.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.811+0000 7fac8604d640 1 -- 172.21.15.19:0/412586412 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac8019d6c0 con 0x7fac80106f10 2024-09-19T08:52:03.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.811+0000 7fac7cff9640 1 -- 172.21.15.19:0/412586412 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac78005020 con 0x7fac80106f10 2024-09-19T08:52:03.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.811+0000 7fac7cff9640 1 -- 172.21.15.19:0/412586412 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7800f6f0 con 0x7fac80106f10 2024-09-19T08:52:03.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.811+0000 7fac8604d640 1 -- 172.21.15.19:0/412586412 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac801a4fa0 con 0x7fac80106f10 2024-09-19T08:52:03.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.813+0000 7fac7cff9640 1 -- 172.21.15.19:0/412586412 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fac780051d0 con 0x7fac80106f10 2024-09-19T08:52:03.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.813+0000 7fac88426740 1 Processor -- start 2024-09-19T08:52:03.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.814+0000 7fac88426740 1 -- start start 2024-09-19T08:52:03.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.814+0000 7fac88426740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39a98a9d0 0x55d39a98adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.814+0000 7fac88426740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d39a98b2f0 0x55d39a995670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.814+0000 7fac88426740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d39a995bb0 0x55d39a997fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.814+0000 7fac88426740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d39a8f1090 con 0x55d39a98b2f0 2024-09-19T08:52:03.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.814+0000 7fac88426740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55d39a898a70 con 0x55d39a98a9d0 2024-09-19T08:52:03.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.814+0000 7fac88426740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d39a8ed050 con 0x55d39a995bb0 2024-09-19T08:52:03.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.814+0000 7fac7f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d39a98b2f0 0x55d39a995670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.814+0000 7fac7f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d39a98b2f0 0x55d39a995670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53814/0 (socket says 172.21.15.19:53814) 2024-09-19T08:52:03.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.814+0000 7fac7f7fe640 1 -- 172.21.15.19:0/2096086645 learned_addr learned my addr 172.21.15.19:0/2096086645 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:03.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.814+0000 7fac7effd640 1 --2- 172.21.15.19:0/2096086645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39a98a9d0 0x55d39a98adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.814+0000 7fac7cff9640 1 --2- 172.21.15.19:0/412586412 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fac680a3240 0x7fac680a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.814+0000 7fac7effd640 1 --2- 172.21.15.19:0/2096086645 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d39a995bb0 0x55d39a997fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.814+0000 7fac7f7fe640 1 -- 172.21.15.19:0/2096086645 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d39a995bb0 msgr2=0x55d39a997fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:03.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.814+0000 7fac7f7fe640 1 --2- 172.21.15.19:0/2096086645 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d39a995bb0 0x55d39a997fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.814+0000 7fac7f7fe640 1 -- 172.21.15.19:0/2096086645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39a98a9d0 msgr2=0x55d39a98adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:03.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.814+0000 7fac7f7fe640 1 --2- 172.21.15.19:0/2096086645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39a98a9d0 0x55d39a98adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.814+0000 7fac7f7fe640 1 -- 172.21.15.19:0/2096086645 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d39a8a5130 con 0x55d39a98b2f0 2024-09-19T08:52:03.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.814+0000 7fac7ffff640 1 --2- 172.21.15.19:0/412586412 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fac680a3240 0x7fac680a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.814+0000 7fac7effd640 1 --2- 172.21.15.19:0/2096086645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39a98a9d0 0x55d39a98adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:03.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.814+0000 7fac7cff9640 1 -- 172.21.15.19:0/412586412 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fac780cf880 con 0x7fac80106f10 2024-09-19T08:52:03.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.814+0000 7fac7f7fe640 1 --2- 172.21.15.19:0/2096086645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d39a98b2f0 0x55d39a995670 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fac70009900 tx=0x7fac70005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53720cf47b9a385e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:03.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.815+0000 7fac65ffb640 1 -- 172.21.15.19:0/2096086645 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac70035040 con 0x55d39a98b2f0 2024-09-19T08:52:03.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.815+0000 7fac65ffb640 1 -- 172.21.15.19:0/2096086645 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac700319f0 con 0x55d39a98b2f0 2024-09-19T08:52:03.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.815+0000 7fac7ffff640 1 --2- 172.21.15.19:0/412586412 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fac680a3240 0x7fac680a5700 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fac7801a000 tx=0x7fac780c6c80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:03.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.815+0000 7fac65ffb640 1 -- 172.21.15.19:0/2096086645 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7003fad0 con 0x55d39a98b2f0 2024-09-19T08:52:03.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.815+0000 7fac88426740 1 -- 172.21.15.19:0/2096086645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d39a98b2f0 msgr2=0x55d39a995670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:03.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.815+0000 7fac88426740 1 --2- 172.21.15.19:0/2096086645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d39a98b2f0 0x55d39a995670 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fac70009900 tx=0x7fac70005e80 comp rx=0 tx=0).stop 2024-09-19T08:52:03.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.815+0000 7fac88426740 1 -- 172.21.15.19:0/2096086645 shutdown_connections 2024-09-19T08:52:03.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.815+0000 7fac88426740 1 --2- 172.21.15.19:0/2096086645 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d39a995bb0 0x55d39a997fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.815+0000 7fac88426740 1 --2- 172.21.15.19:0/2096086645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d39a98b2f0 0x55d39a995670 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.815+0000 7fac88426740 1 --2- 172.21.15.19:0/2096086645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39a98a9d0 0x55d39a98adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.815+0000 7fac88426740 1 -- 172.21.15.19:0/2096086645 >> 172.21.15.19:0/2096086645 conn(0x55d39a986f60 msgr2=0x55d39a987340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:03.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.816+0000 7fac88426740 1 -- 172.21.15.19:0/2096086645 shutdown_connections 2024-09-19T08:52:03.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.816+0000 7fac88426740 1 -- 172.21.15.19:0/2096086645 wait complete. 2024-09-19T08:52:03.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.816+0000 7fac88426740 1 -- start start 2024-09-19T08:52:03.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.816+0000 7fac88426740 1 Processor -- start 2024-09-19T08:52:03.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.816+0000 7fac88426740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d39a98a9d0 0x55d39a9954a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.816+0000 7fac88426740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39a98b2f0 0x55d39a9927f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.816+0000 7fac88426740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d39a995bb0 0x55d39a992d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.816+0000 7fac88426740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d39a998780 con 0x55d39a995bb0 2024-09-19T08:52:03.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.816+0000 7fac88426740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55d39a8abf20 con 0x55d39a98b2f0 2024-09-19T08:52:03.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.816+0000 7fac88426740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d39a998900 con 0x55d39a98a9d0 2024-09-19T08:52:03.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.817+0000 7fac88426740 10 client.0 _ll_register_callbacks cb 0x55d39a875030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:03.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.817+0000 7fac7effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d39a995bb0 0x55d39a992d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.817+0000 7fac7effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d39a995bb0 0x55d39a992d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53826/0 (socket says 172.21.15.19:53826) 2024-09-19T08:52:03.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.817+0000 7fac7effd640 1 -- 172.21.15.19:0/355315611 learned_addr learned my addr 172.21.15.19:0/355315611 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:03.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.817+0000 7fac7f7fe640 1 --2- 172.21.15.19:0/355315611 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39a98b2f0 0x55d39a9927f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.817+0000 7fac7effd640 1 --2- 172.21.15.19:0/355315611 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d39a98a9d0 0x55d39a9954a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.817+0000 7fac7effd640 1 -- 172.21.15.19:0/355315611 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d39a98a9d0 msgr2=0x55d39a9954a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:03.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.817+0000 7fac7effd640 1 --2- 172.21.15.19:0/355315611 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d39a98a9d0 0x55d39a9954a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.817+0000 7fac7effd640 1 -- 172.21.15.19:0/355315611 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39a98b2f0 msgr2=0x55d39a9927f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:03.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.817+0000 7fac7effd640 1 --2- 172.21.15.19:0/355315611 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39a98b2f0 0x55d39a9927f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.817+0000 7fac7effd640 1 -- 172.21.15.19:0/355315611 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d39a6622b0 con 0x55d39a995bb0 2024-09-19T08:52:03.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.817+0000 7fac7effd640 1 --2- 172.21.15.19:0/355315611 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d39a995bb0 0x55d39a992d30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fac74009e00 tx=0x7fac74012040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74718e57c4aebf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:03.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.817+0000 7fac5effd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:52:03.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.817+0000 7fac5effd640 1 -- 172.21.15.19:0/355315611 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7400fdd0 con 0x55d39a995bb0 2024-09-19T08:52:03.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.817+0000 7fac5effd640 1 -- 172.21.15.19:0/355315611 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fac7401e3d0 con 0x55d39a995bb0 2024-09-19T08:52:03.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.817+0000 7fac88426740 1 -- 172.21.15.19:0/355315611 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac700319f0 con 0x55d39a995bb0 2024-09-19T08:52:03.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.817+0000 7fac5effd640 1 -- 172.21.15.19:0/355315611 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fac7401e5d0 con 0x55d39a995bb0 2024-09-19T08:52:03.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.817+0000 7fac88426740 10 client.15201 fetch_fsmap learned FSMap version 27 2024-09-19T08:52:03.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.817+0000 7fac88426740 1 -- 172.21.15.19:0/355315611 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d39a9a40c0 con 0x55d39a995bb0 2024-09-19T08:52:03.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.818+0000 7fac5effd640 1 -- 172.21.15.19:0/355315611 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac700319f0 con 0x55d39a995bb0 2024-09-19T08:52:03.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.818+0000 7fac5effd640 1 -- 172.21.15.19:0/355315611 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fac7401f850 con 0x55d39a995bb0 2024-09-19T08:52:03.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.818+0000 7fac88426740 10 client.15201 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T08:52:03.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.818+0000 7fac88426740 10 client.15201 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T08:52:03.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.818+0000 7fac88426740 20 client.15201 populate_metadata read hostname 'smithi019' 2024-09-19T08:52:03.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.818+0000 7fac88426740 1 --2- 172.21.15.19:0/355315611 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d39a9a6640 0x55d39a9a7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.818+0000 7fac88426740 4 client.15201 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:03.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.818+0000 7fac88426740 1 -- 172.21.15.19:0/355315611 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d39a8fe600 con 0x55d39a9a6640 2024-09-19T08:52:03.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.818+0000 7fac7f7fe640 1 --2- 172.21.15.19:0/355315611 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d39a9a6640 0x55d39a9a7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.819+0000 7fac7f7fe640 1 --2- 172.21.15.19:0/355315611 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d39a9a6640 0x55d39a9a7ab0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26307462559074cc server_cookie=250ca230aca65cd2 in_seq=0 out_seq=0 2024-09-19T08:52:03.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.819+0000 7fac5effd640 10 client.15201 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:52:03.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.819+0000 7fac5effd640 1 -- 172.21.15.19:0/355315611 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d39a8fe600 con 0x55d39a9a6640 2024-09-19T08:52:03.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.819+0000 7fac5effd640 10 client.15201 handle_command_reply: tid=0 2024-09-19T08:52:03.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.819+0000 7fac88426740 1 client.15201 shutdown 2024-09-19T08:52:03.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.820+0000 7fac88426740 1 -- 172.21.15.19:0/355315611 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d39a995bb0 msgr2=0x55d39a992d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:03.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.820+0000 7fac88426740 1 --2- 172.21.15.19:0/355315611 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d39a995bb0 0x55d39a992d30 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fac74009e00 tx=0x7fac74012040 comp rx=0 tx=0).stop 2024-09-19T08:52:03.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.820+0000 7fac88426740 1 -- 172.21.15.19:0/355315611 shutdown_connections 2024-09-19T08:52:03.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.820+0000 7fac88426740 1 --2- 172.21.15.19:0/355315611 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d39a9a6640 0x55d39a9a7ab0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.820+0000 7fac88426740 1 --2- 172.21.15.19:0/355315611 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d39a995bb0 0x55d39a992d30 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.820+0000 7fac5effd640 0 client.15201 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:52:03.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.820+0000 7fac88426740 1 --2- 172.21.15.19:0/355315611 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39a98b2f0 0x55d39a9927f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.820+0000 7fac88426740 1 --2- 172.21.15.19:0/355315611 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d39a98a9d0 0x55d39a9954a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.820+0000 7fac88426740 1 -- 172.21.15.19:0/355315611 >> 172.21.15.19:0/355315611 conn(0x55d39a986f60 msgr2=0x55d39a98cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:03.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.820+0000 7fac88426740 1 -- 172.21.15.19:0/355315611 shutdown_connections 2024-09-19T08:52:03.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.820+0000 7fac88426740 1 -- 172.21.15.19:0/355315611 wait complete. 2024-09-19T08:52:03.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.820+0000 7fac88426740 20 client.15201 trim_cache size 0 max 16384 2024-09-19T08:52:03.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.838+0000 7fac88426740 1 Processor -- start 2024-09-19T08:52:03.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.838+0000 7fac88426740 1 -- start start 2024-09-19T08:52:03.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.838+0000 7fac88426740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39a98a9d0 0x55d39a9927b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.838+0000 7fac88426740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d39a98b2f0 0x55d39a992cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.838+0000 7fac88426740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d39a995bb0 0x55d39a991100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.838+0000 7fac88426740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d39a9a5df0 con 0x55d39a98b2f0 2024-09-19T08:52:03.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.838+0000 7fac88426740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55d39a9a64c0 con 0x55d39a98a9d0 2024-09-19T08:52:03.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.838+0000 7fac88426740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d39a9a6b90 con 0x55d39a995bb0 2024-09-19T08:52:03.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.838+0000 7fac7f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d39a98b2f0 0x55d39a992cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.838+0000 7fac7f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d39a98b2f0 0x55d39a992cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53842/0 (socket says 172.21.15.19:53842) 2024-09-19T08:52:03.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.838+0000 7fac7f7fe640 1 -- 172.21.15.19:0/422942964 learned_addr learned my addr 172.21.15.19:0/422942964 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:03.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.838+0000 7fac7effd640 1 --2- 172.21.15.19:0/422942964 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39a98a9d0 0x55d39a9927b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.838+0000 7fac7f7fe640 1 -- 172.21.15.19:0/422942964 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d39a995bb0 msgr2=0x55d39a991100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:03.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.838+0000 7fac7f7fe640 1 --2- 172.21.15.19:0/422942964 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d39a995bb0 0x55d39a991100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.838+0000 7fac7f7fe640 1 -- 172.21.15.19:0/422942964 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39a98a9d0 msgr2=0x55d39a9927b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:03.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.838+0000 7fac7f7fe640 1 --2- 172.21.15.19:0/422942964 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39a98a9d0 0x55d39a9927b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.838+0000 7fac7f7fe640 1 -- 172.21.15.19:0/422942964 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d39a98e430 con 0x55d39a98b2f0 2024-09-19T08:52:03.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.838+0000 7fac7effd640 1 --2- 172.21.15.19:0/422942964 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39a98a9d0 0x55d39a9927b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:03.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.839+0000 7fac7f7fe640 1 --2- 172.21.15.19:0/422942964 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d39a98b2f0 0x55d39a992cf0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fac70009900 tx=0x7fac70005660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa5e05227c095a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:03.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.839+0000 7fac657fa640 1 -- 172.21.15.19:0/422942964 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac70035040 con 0x55d39a98b2f0 2024-09-19T08:52:03.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.839+0000 7fac657fa640 1 -- 172.21.15.19:0/422942964 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac70031a20 con 0x55d39a98b2f0 2024-09-19T08:52:03.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.839+0000 7fac657fa640 1 -- 172.21.15.19:0/422942964 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac70003850 con 0x55d39a98b2f0 2024-09-19T08:52:03.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.839+0000 7fac88426740 1 -- 172.21.15.19:0/422942964 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d39a98b2f0 msgr2=0x55d39a992cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:03.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.839+0000 7fac88426740 1 --2- 172.21.15.19:0/422942964 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d39a98b2f0 0x55d39a992cf0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fac70009900 tx=0x7fac70005660 comp rx=0 tx=0).stop 2024-09-19T08:52:03.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.839+0000 7fac88426740 1 -- 172.21.15.19:0/422942964 shutdown_connections 2024-09-19T08:52:03.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.839+0000 7fac88426740 1 --2- 172.21.15.19:0/422942964 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d39a995bb0 0x55d39a991100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.839+0000 7fac88426740 1 --2- 172.21.15.19:0/422942964 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d39a98b2f0 0x55d39a992cf0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.839+0000 7fac88426740 1 --2- 172.21.15.19:0/422942964 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39a98a9d0 0x55d39a9927b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.839+0000 7fac88426740 1 -- 172.21.15.19:0/422942964 >> 172.21.15.19:0/422942964 conn(0x55d39a986f60 msgr2=0x55d39a987340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:03.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.839+0000 7fac88426740 1 -- 172.21.15.19:0/422942964 shutdown_connections 2024-09-19T08:52:03.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.839+0000 7fac88426740 1 -- 172.21.15.19:0/422942964 wait complete. 2024-09-19T08:52:03.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.840+0000 7fac88426740 1 -- start start 2024-09-19T08:52:03.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.840+0000 7fac88426740 1 Processor -- start 2024-09-19T08:52:03.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.840+0000 7fac88426740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39a98a9d0 0x55d39a9ab370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.840+0000 7fac88426740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d39a98b2f0 0x55d39a9ab8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.840+0000 7fac88426740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d39a995bb0 0x55d39aa0ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.840+0000 7fac88426740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d39a9a7930 con 0x55d39a98b2f0 2024-09-19T08:52:03.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.840+0000 7fac88426740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55d39a9a7260 con 0x55d39a98a9d0 2024-09-19T08:52:03.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.840+0000 7fac88426740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d39a9a8000 con 0x55d39a995bb0 2024-09-19T08:52:03.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.840+0000 7fac88426740 10 client.0 _ll_register_callbacks cb 0x7fac740098d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:03.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.840+0000 7fac7f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d39a98b2f0 0x55d39a9ab8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.841+0000 7fac7f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d39a98b2f0 0x55d39a9ab8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:53844/0 (socket says 172.21.15.19:53844) 2024-09-19T08:52:03.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.841+0000 7fac7f7fe640 1 -- 172.21.15.19:0/3780587318 learned_addr learned my addr 172.21.15.19:0/3780587318 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:03.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.841+0000 7fac7effd640 1 --2- 172.21.15.19:0/3780587318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39a98a9d0 0x55d39a9ab370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.841+0000 7fac7effd640 1 --2- 172.21.15.19:0/3780587318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d39a995bb0 0x55d39aa0ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.841+0000 7fac7f7fe640 1 -- 172.21.15.19:0/3780587318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d39a995bb0 msgr2=0x55d39aa0ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:03.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.841+0000 7fac7f7fe640 1 --2- 172.21.15.19:0/3780587318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d39a995bb0 0x55d39aa0ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.841+0000 7fac7f7fe640 1 -- 172.21.15.19:0/3780587318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39a98a9d0 msgr2=0x55d39a9ab370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:03.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.841+0000 7fac7f7fe640 1 --2- 172.21.15.19:0/3780587318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39a98a9d0 0x55d39a9ab370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.841+0000 7fac7f7fe640 1 -- 172.21.15.19:0/3780587318 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d39aa0f280 con 0x55d39a98b2f0 2024-09-19T08:52:03.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.841+0000 7fac7f7fe640 1 --2- 172.21.15.19:0/3780587318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d39a98b2f0 0x55d39a9ab8b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fac700056d0 tx=0x7fac7003fe40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d16d6e7f09305505 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:03.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.841+0000 7fac5effd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:52:03.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.841+0000 7fac5effd640 1 -- 172.21.15.19:0/3780587318 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac70060060 con 0x55d39a98b2f0 2024-09-19T08:52:03.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.841+0000 7fac5effd640 1 -- 172.21.15.19:0/3780587318 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fac7003faa0 con 0x55d39a98b2f0 2024-09-19T08:52:03.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.841+0000 7fac88426740 1 -- 172.21.15.19:0/3780587318 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac70031a20 con 0x55d39a98b2f0 2024-09-19T08:52:03.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.841+0000 7fac5effd640 1 -- 172.21.15.19:0/3780587318 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fac70035030 con 0x55d39a98b2f0 2024-09-19T08:52:03.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.841+0000 7fac88426740 10 client.15207 fetch_fsmap learned FSMap version 27 2024-09-19T08:52:03.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.841+0000 7fac88426740 1 -- 172.21.15.19:0/3780587318 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d39aa10470 con 0x55d39a98b2f0 2024-09-19T08:52:03.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.842+0000 7fac5effd640 1 -- 172.21.15.19:0/3780587318 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fac70031a20 con 0x55d39a98b2f0 2024-09-19T08:52:03.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.842+0000 7fac5effd640 1 -- 172.21.15.19:0/3780587318 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fac70054450 con 0x55d39a98b2f0 2024-09-19T08:52:03.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.842+0000 7fac88426740 10 client.15207 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T08:52:03.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.842+0000 7fac88426740 10 client.15207 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T08:52:03.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.842+0000 7fac88426740 20 client.15207 populate_metadata read hostname 'smithi019' 2024-09-19T08:52:03.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.842+0000 7fac88426740 1 --2- 172.21.15.19:0/3780587318 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d39aa14960 0x55d39aa13670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:03.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.842+0000 7fac88426740 4 client.15207 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T08:52:03.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.842+0000 7fac88426740 1 -- 172.21.15.19:0/3780587318 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "status"}) -- 0x55d39a8f8b10 con 0x55d39aa14960 2024-09-19T08:52:03.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.842+0000 7fac7effd640 1 --2- 172.21.15.19:0/3780587318 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d39aa14960 0x55d39aa13670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:03.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.843+0000 7fac7effd640 1 --2- 172.21.15.19:0/3780587318 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d39aa14960 0x55d39aa13670 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1e8671579f1241b server_cookie=c20fe1ac39159744 in_seq=0 out_seq=0 2024-09-19T08:52:03.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.843+0000 7fac5effd640 10 client.15207 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:52:03.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.843+0000 7fac5effd640 1 -- 172.21.15.19:0/3780587318 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55d39a8f8b10 con 0x55d39aa14960 2024-09-19T08:52:03.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.843+0000 7fac5effd640 10 client.15207 handle_command_reply: tid=0 2024-09-19T08:52:03.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.843+0000 7fac88426740 1 client.15207 shutdown 2024-09-19T08:52:03.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.843+0000 7fac88426740 1 -- 172.21.15.19:0/3780587318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d39a98b2f0 msgr2=0x55d39a9ab8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:03.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.843+0000 7fac88426740 1 --2- 172.21.15.19:0/3780587318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d39a98b2f0 0x55d39a9ab8b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fac700056d0 tx=0x7fac7003fe40 comp rx=0 tx=0).stop 2024-09-19T08:52:03.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.843+0000 7fac88426740 1 -- 172.21.15.19:0/3780587318 shutdown_connections 2024-09-19T08:52:03.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.843+0000 7fac88426740 1 --2- 172.21.15.19:0/3780587318 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d39aa14960 0x55d39aa13670 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.843+0000 7fac88426740 1 --2- 172.21.15.19:0/3780587318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d39a995bb0 0x55d39aa0ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.843+0000 7fac5effd640 0 client.15207 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:52:03.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.843+0000 7fac88426740 1 --2- 172.21.15.19:0/3780587318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d39a98b2f0 0x55d39a9ab8b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.843+0000 7fac88426740 1 --2- 172.21.15.19:0/3780587318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d39a98a9d0 0x55d39a9ab370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.843+0000 7fac88426740 1 -- 172.21.15.19:0/3780587318 >> 172.21.15.19:0/3780587318 conn(0x55d39a986f60 msgr2=0x55d39a9927b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:03.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.843+0000 7fac88426740 1 -- 172.21.15.19:0/3780587318 shutdown_connections 2024-09-19T08:52:03.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.843+0000 7fac88426740 1 -- 172.21.15.19:0/3780587318 wait complete. 2024-09-19T08:52:03.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.843+0000 7fac88426740 20 client.15207 trim_cache size 0 max 16384 2024-09-19T08:52:03.849 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:52:03.849 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "f26c9d84-7662-11ef-bceb-c7b262605968", 2024-09-19T08:52:03.849 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-09-19T08:52:03.849 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 24497, 2024-09-19T08:52:03.849 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-19T08:52:03.850 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-19T08:52:03.850 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-19T08:52:03.850 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 106.976041387, 2024-09-19T08:52:03.850 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 27, 2024-09-19T08:52:03.850 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 82, 2024-09-19T08:52:03.850 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 80, 2024-09-19T08:52:03.850 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 118.887558207 2024-09-19T08:52:03.850 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:52:03.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.844+0000 7fac8604d640 1 -- 172.21.15.19:0/412586412 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fac680a3240 msgr2=0x7fac680a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:03.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.844+0000 7fac8604d640 1 --2- 172.21.15.19:0/412586412 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fac680a3240 0x7fac680a5700 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fac7801a000 tx=0x7fac780c6c80 comp rx=0 tx=0).stop 2024-09-19T08:52:03.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.844+0000 7fac8604d640 1 -- 172.21.15.19:0/412586412 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac80106f10 msgr2=0x7fac8019ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:03.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.844+0000 7fac8604d640 1 --2- 172.21.15.19:0/412586412 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac80106f10 0x7fac8019ccf0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fac7800cad0 tx=0x7fac7800cf90 comp rx=0 tx=0).stop 2024-09-19T08:52:03.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.844+0000 7fac8604d640 1 -- 172.21.15.19:0/412586412 shutdown_connections 2024-09-19T08:52:03.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.844+0000 7fac8604d640 1 --2- 172.21.15.19:0/412586412 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fac680a3240 0x7fac680a5700 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.844+0000 7fac8604d640 1 --2- 172.21.15.19:0/412586412 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fac80106f10 0x7fac8019ccf0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.844+0000 7fac8604d640 1 --2- 172.21.15.19:0/412586412 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fac80102790 0x7fac80198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.844+0000 7fac8604d640 1 --2- 172.21.15.19:0/412586412 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac80101de0 0x7fac80198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:03.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.844+0000 7fac8604d640 1 -- 172.21.15.19:0/412586412 >> 172.21.15.19:0/412586412 conn(0x7fac800fd8c0 msgr2=0x7fac800fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:03.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.844+0000 7fac8604d640 1 -- 172.21.15.19:0/412586412 shutdown_connections 2024-09-19T08:52:03.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:03.844+0000 7fac8604d640 1 -- 172.21.15.19:0/412586412 wait complete. 2024-09-19T08:52:03.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:03 smithi155 ceph-mon[34921]: pgmap v332: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-19T08:52:03.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:03 smithi203 ceph-mon[35450]: pgmap v332: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-19T08:52:04.657 INFO:teuthology.run_tasks:Running task sequential... 2024-09-19T08:52:04.821 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-19T08:52:04.821 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-19T08:52:04.822 INFO:teuthology.task.print:Enabling mgr modules 2024-09-19T08:52:04.822 INFO:teuthology.run_tasks:Running task kclient... 2024-09-19T08:52:04.861 INFO:tasks.kclient:Mounting kernel clients... 2024-09-19T08:52:04.862 INFO:tasks.kclient:config is {'client.0': {}} 2024-09-19T08:52:04.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:52:04.862 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-19T08:52:04.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:52:04.880 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link delete ceph-brx 2024-09-19T08:52:04.949 INFO:teuthology.orchestra.run.smithi019.stderr:Cannot find device "ceph-brx" 2024-09-19T08:52:04.950 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T08:52:04.951 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'syntax': 'v2', 'mount_subvol_num': 1} 2024-09-19T08:52:04.951 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T08:52:04.951 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T08:52:04.951 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T08:52:05.259 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:05.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.734+0000 7fdac36f1640 1 -- 172.21.15.19:0/240456009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdabc102570 msgr2=0x7fdabc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:05.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.734+0000 7fdac36f1640 1 --2- 172.21.15.19:0/240456009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdabc102570 0x7fdabc1029b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fdaac009900 tx=0x7fdaac02a480 comp rx=0 tx=0).stop 2024-09-19T08:52:05.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.734+0000 7fdac36f1640 1 -- 172.21.15.19:0/240456009 shutdown_connections 2024-09-19T08:52:05.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.734+0000 7fdac36f1640 1 --2- 172.21.15.19:0/240456009 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdabc102ef0 0x7fdabc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:05.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.734+0000 7fdac36f1640 1 --2- 172.21.15.19:0/240456009 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdabc102570 0x7fdabc1029b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:05.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.734+0000 7fdac36f1640 1 --2- 172.21.15.19:0/240456009 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdabc100e20 0x7fdabc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:05.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.734+0000 7fdac36f1640 1 -- 172.21.15.19:0/240456009 >> 172.21.15.19:0/240456009 conn(0x7fdabc0fc7d0 msgr2=0x7fdabc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:05.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.734+0000 7fdac36f1640 1 -- 172.21.15.19:0/240456009 shutdown_connections 2024-09-19T08:52:05.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.734+0000 7fdac36f1640 1 -- 172.21.15.19:0/240456009 wait complete. 2024-09-19T08:52:05.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.735+0000 7fdac36f1640 1 Processor -- start 2024-09-19T08:52:05.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.735+0000 7fdac36f1640 1 -- start start 2024-09-19T08:52:05.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.735+0000 7fdac36f1640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdabc100e20 0x7fdabc198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:05.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.735+0000 7fdac36f1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdabc102570 0x7fdabc198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:05.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.735+0000 7fdac36f1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdabc102ef0 0x7fdabc19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:05.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.735+0000 7fdac36f1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdabc110f80 con 0x7fdabc102ef0 2024-09-19T08:52:05.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.735+0000 7fdac36f1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdabc110e00 con 0x7fdabc102570 2024-09-19T08:52:05.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.735+0000 7fdac36f1640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdabc111100 con 0x7fdabc100e20 2024-09-19T08:52:05.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.735+0000 7fdac1c8e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdabc102ef0 0x7fdabc19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:05.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.735+0000 7fdac1c8e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdabc102ef0 0x7fdabc19cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50768/0 (socket says 172.21.15.19:50768) 2024-09-19T08:52:05.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.735+0000 7fdac1c8e640 1 -- 172.21.15.19:0/3431944273 learned_addr learned my addr 172.21.15.19:0/3431944273 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:05.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.735+0000 7fdac0c8c640 1 --2- 172.21.15.19:0/3431944273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdabc102570 0x7fdabc198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:05.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.735+0000 7fdac148d640 1 --2- 172.21.15.19:0/3431944273 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdabc100e20 0x7fdabc198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:05.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.736+0000 7fdac1c8e640 1 -- 172.21.15.19:0/3431944273 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdabc100e20 msgr2=0x7fdabc198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:05.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.736+0000 7fdac1c8e640 1 --2- 172.21.15.19:0/3431944273 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdabc100e20 0x7fdabc198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:05.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.736+0000 7fdac1c8e640 1 -- 172.21.15.19:0/3431944273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdabc102570 msgr2=0x7fdabc198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:05.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.736+0000 7fdac1c8e640 1 --2- 172.21.15.19:0/3431944273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdabc102570 0x7fdabc198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:05.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.736+0000 7fdac1c8e640 1 -- 172.21.15.19:0/3431944273 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdabc19d3e0 con 0x7fdabc102ef0 2024-09-19T08:52:05.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.736+0000 7fdac148d640 1 --2- 172.21.15.19:0/3431944273 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdabc100e20 0x7fdabc198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:05.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.736+0000 7fdac1c8e640 1 --2- 172.21.15.19:0/3431944273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdabc102ef0 0x7fdabc19cd00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fdab400eaa0 tx=0x7fdab400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:05.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.736+0000 7fdab27fc640 1 -- 172.21.15.19:0/3431944273 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab400cdb0 con 0x7fdabc102ef0 2024-09-19T08:52:05.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.736+0000 7fdab27fc640 1 -- 172.21.15.19:0/3431944273 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdab4005020 con 0x7fdabc102ef0 2024-09-19T08:52:05.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.736+0000 7fdab27fc640 1 -- 172.21.15.19:0/3431944273 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab40116d0 con 0x7fdabc102ef0 2024-09-19T08:52:05.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.736+0000 7fdac36f1640 1 -- 172.21.15.19:0/3431944273 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdabc19d6d0 con 0x7fdabc102ef0 2024-09-19T08:52:05.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.736+0000 7fdac36f1640 1 -- 172.21.15.19:0/3431944273 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdabc1a4fb0 con 0x7fdabc102ef0 2024-09-19T08:52:05.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.737+0000 7fdac36f1640 1 -- 172.21.15.19:0/3431944273 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdabc101200 con 0x7fdabc102ef0 2024-09-19T08:52:05.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.738+0000 7fdab27fc640 1 -- 172.21.15.19:0/3431944273 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fdab40054d0 con 0x7fdabc102ef0 2024-09-19T08:52:05.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.739+0000 7fdab27fc640 1 --2- 172.21.15.19:0/3431944273 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fdaa80a3240 0x7fdaa80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:05.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.739+0000 7fdac148d640 1 --2- 172.21.15.19:0/3431944273 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fdaa80a3240 0x7fdaa80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:05.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.739+0000 7fdab27fc640 1 -- 172.21.15.19:0/3431944273 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fdab40cfb80 con 0x7fdabc102ef0 2024-09-19T08:52:05.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.740+0000 7fdac148d640 1 --2- 172.21.15.19:0/3431944273 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fdaa80a3240 0x7fdaa80a5700 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdab800abe0 tx=0x7fdab800a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:05.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.743+0000 7fdab27fc640 1 -- 172.21.15.19:0/3431944273 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdab4016030 con 0x7fdabc102ef0 2024-09-19T08:52:05.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:05 smithi155 ceph-mon[34921]: pgmap v333: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-19T08:52:05.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.959+0000 7fdac36f1640 1 -- 172.21.15.19:0/3431944273 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fdabc10a0d0 con 0x7fdabc102ef0 2024-09-19T08:52:05.960 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:05 smithi019 ceph-mon[30976]: pgmap v333: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-19T08:52:05.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.959+0000 7fdab27fc640 1 -- 172.21.15.19:0/3431944273 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v27) ==== 53+0+73 (secure 0 0 0) 0x7fdab409c850 con 0x7fdabc102ef0 2024-09-19T08:52:05.960 INFO:teuthology.orchestra.run.smithi019.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T08:52:05.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.962+0000 7fdac36f1640 1 -- 172.21.15.19:0/3431944273 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fdaa80a3240 msgr2=0x7fdaa80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:05.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.962+0000 7fdac36f1640 1 --2- 172.21.15.19:0/3431944273 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fdaa80a3240 0x7fdaa80a5700 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdab800abe0 tx=0x7fdab800a5c0 comp rx=0 tx=0).stop 2024-09-19T08:52:05.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.962+0000 7fdac36f1640 1 -- 172.21.15.19:0/3431944273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdabc102ef0 msgr2=0x7fdabc19cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:05.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.962+0000 7fdac36f1640 1 --2- 172.21.15.19:0/3431944273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdabc102ef0 0x7fdabc19cd00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fdab400eaa0 tx=0x7fdab400ef60 comp rx=0 tx=0).stop 2024-09-19T08:52:05.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.962+0000 7fdac36f1640 1 -- 172.21.15.19:0/3431944273 shutdown_connections 2024-09-19T08:52:05.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.962+0000 7fdac36f1640 1 --2- 172.21.15.19:0/3431944273 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fdaa80a3240 0x7fdaa80a5700 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:05.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.962+0000 7fdac36f1640 1 --2- 172.21.15.19:0/3431944273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdabc102ef0 0x7fdabc19cd00 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:05.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.962+0000 7fdac36f1640 1 --2- 172.21.15.19:0/3431944273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdabc102570 0x7fdabc198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:05.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.962+0000 7fdac36f1640 1 --2- 172.21.15.19:0/3431944273 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdabc100e20 0x7fdabc198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:05.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.962+0000 7fdac36f1640 1 -- 172.21.15.19:0/3431944273 >> 172.21.15.19:0/3431944273 conn(0x7fdabc0fc7d0 msgr2=0x7fdabc06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:05.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.962+0000 7fdac36f1640 1 -- 172.21.15.19:0/3431944273 shutdown_connections 2024-09-19T08:52:05.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:05.962+0000 7fdac36f1640 1 -- 172.21.15.19:0/3431944273 wait complete. 2024-09-19T08:52:05.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:05 smithi203 ceph-mon[35450]: pgmap v333: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-19T08:52:06.741 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T08:52:06.741 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T08:52:06.742 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi019.front.sepia.ceph.com 2024-09-19T08:52:06.742 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T08:52:06.742 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T08:52:06.742 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T08:52:06.742 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T08:52:06.742 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T08:52:06.742 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T08:52:06.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:52:06.742 DEBUG:teuthology.orchestra.run.smithi019:> ip addr 2024-09-19T08:52:06.764 INFO:teuthology.orchestra.run.smithi019.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T08:52:06.764 INFO:teuthology.orchestra.run.smithi019.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T08:52:06.764 INFO:teuthology.orchestra.run.smithi019.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T08:52:06.765 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:52:06.765 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 ::1/128 scope host 2024-09-19T08:52:06.765 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:52:06.765 INFO:teuthology.orchestra.run.smithi019.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:52:06.765 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:12 brd ff:ff:ff:ff:ff:ff 2024-09-19T08:52:06.765 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f0 2024-09-19T08:52:06.765 INFO:teuthology.orchestra.run.smithi019.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:52:06.765 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:6b:fd:13 brd ff:ff:ff:ff:ff:ff 2024-09-19T08:52:06.765 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp7s0f1 2024-09-19T08:52:06.765 INFO:teuthology.orchestra.run.smithi019.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T08:52:06.765 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1e brd ff:ff:ff:ff:ff:ff 2024-09-19T08:52:06.765 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f0 2024-09-19T08:52:06.765 INFO:teuthology.orchestra.run.smithi019.stdout: inet 172.21.15.19/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-19T08:52:06.765 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft 42166sec preferred_lft 42166sec 2024-09-19T08:52:06.766 INFO:teuthology.orchestra.run.smithi019.stdout: inet6 fe80::ec4:7aff:febd:161e/64 scope link 2024-09-19T08:52:06.766 INFO:teuthology.orchestra.run.smithi019.stdout: valid_lft forever preferred_lft forever 2024-09-19T08:52:06.766 INFO:teuthology.orchestra.run.smithi019.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T08:52:06.766 INFO:teuthology.orchestra.run.smithi019.stdout: link/ether 0c:c4:7a:bd:16:1f brd ff:ff:ff:ff:ff:ff 2024-09-19T08:52:06.766 INFO:teuthology.orchestra.run.smithi019.stdout: altname enp1s0f1 2024-09-19T08:52:06.766 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T08:52:06.766 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:52:06.767 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-19T08:52:06.767 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link add name ceph-brx type bridge 2024-09-19T08:52:06.767 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip addr flush dev ceph-brx 2024-09-19T08:52:06.767 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set ceph-brx up 2024-09-19T08:52:06.767 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T08:52:06.767 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-19T08:52:06.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:52:06.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:06 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3431944273' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T08:52:06.937 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:06 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3431944273' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T08:52:06.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:06 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3431944273' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T08:52:06.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:52:06.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:52:06.994 DEBUG:teuthology.orchestra.run.smithi019:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T08:52:07.021 INFO:teuthology.orchestra.run.smithi019.stdout:1 2024-09-19T08:52:07.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:52:07.023 DEBUG:teuthology.orchestra.run.smithi019:> route 2024-09-19T08:52:07.092 INFO:teuthology.orchestra.run.smithi019.stdout:Kernel IP routing table 2024-09-19T08:52:07.093 INFO:teuthology.orchestra.run.smithi019.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T08:52:07.093 INFO:teuthology.orchestra.run.smithi019.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-19T08:52:07.093 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-19T08:52:07.093 INFO:teuthology.orchestra.run.smithi019.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T08:52:07.093 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:52:07.093 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-19T08:52:07.094 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-19T08:52:07.094 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-19T08:52:07.094 DEBUG:teuthology.orchestra.run.smithi019:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-19T08:52:07.094 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-19T08:52:07.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:52:07.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:52:07.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:52:07.382 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-19T08:52:07.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:52:07.398 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list-id 2024-09-19T08:52:07.455 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:52:07.455 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-19T08:52:07.455 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T08:52:07.455 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-19T08:52:07.455 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-19T08:52:07.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:52:07.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:52:07.575 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-19T08:52:07.575 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:52:07.576 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-19T08:52:07.576 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-19T08:52:07.576 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T08:52:07.576 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-19T08:52:07.576 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-19T08:52:07.576 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-19T08:52:07.576 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-19T08:52:07.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:52:07.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:52:07.708 DEBUG:teuthology.orchestra.run.smithi019:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T08:52:07.708 DEBUG:teuthology.orchestra.run.smithi019:> set -e 2024-09-19T08:52:07.708 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set brx.0 up 2024-09-19T08:52:07.709 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T08:52:07.709 DEBUG:teuthology.orchestra.run.smithi019:> ') 2024-09-19T08:52:07.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:52:07.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:52:07.789 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T08:52:07.789 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T08:52:07.804 INFO:teuthology.orchestra.run.smithi019.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T08:52:07.805 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T08:52:07.805 DEBUG:teuthology.orchestra.run.smithi019:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T08:52:07.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:07 smithi019 ceph-mon[30976]: pgmap v334: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-19T08:52:07.833 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-09-19T08:52:07.833 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-09-19T08:52:07.833 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/volumes/qa/sv_1/7c8d6e9e-29b1-4146-b80e-6ebd0025a96b 2024-09-19T08:52:07.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:52:07.833 DEBUG:teuthology.orchestra.run.smithi019:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/volumes/qa/sv_1/7c8d6e9e-29b1-4146-b80e-6ebd0025a96b /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-09-19T08:52:07.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:07 smithi155 ceph-mon[34921]: pgmap v334: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-19T08:52:07.942 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-09-19T08:52:07.942 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync". 2024-09-19T08:52:07.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:07 smithi203 ceph-mon[35450]: pgmap v334: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-19T08:52:08.100 INFO:teuthology.orchestra.run.smithi019.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,ms_mode=secure,wsync,nofallback 2024-09-19T08:52:08.100 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync". 2024-09-19T08:52:08.100 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: resolved to: "172.21.15.19:3300,172.21.15.155:3300,172.21.15.203:3300" 2024-09-19T08:52:08.100 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: trying mount with new device syntax: 0@f26c9d84-7662-11ef-bceb-c7b262605968.cephfs=/volumes/qa/sv_1/7c8d6e9e-29b1-4146-b80e-6ebd0025a96b 2024-09-19T08:52:08.101 INFO:teuthology.orchestra.run.smithi019.stdout:mount.ceph: options "norequire_active_mds,norbytes,ms_mode=secure,wsync,name=0,key=0,mon_addr=172.21.15.19:3300/172.21.15.155:3300/172.21.15.203:3300" will pass to kernel 2024-09-19T08:52:08.101 INFO:teuthology.orchestra.run.smithi019.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-19T08:52:08.101 INFO:teuthology.orchestra.run.smithi019.stdout: You just mounted a file system that supports labels which does not 2024-09-19T08:52:08.101 INFO:teuthology.orchestra.run.smithi019.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-19T08:52:08.101 INFO:teuthology.orchestra.run.smithi019.stdout: applications will generate AVC messages and not be allowed access to 2024-09-19T08:52:08.102 INFO:teuthology.orchestra.run.smithi019.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-19T08:52:08.103 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-19T08:52:08.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T08:52:08.104 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T08:52:08.131 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T08:52:08.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T08:52:08.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:52:08.229 INFO:teuthology.orchestra.run.smithi019.stdout:client24953 2024-09-19T08:52:08.230 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-19T08:52:08.230 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T08:52:08.247 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T08:52:08.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T08:52:08.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:52:08.346 INFO:teuthology.orchestra.run.smithi019.stdout:client24953 2024-09-19T08:52:08.347 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-19T08:52:08.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-19T08:52:08.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:52:08.405 INFO:teuthology.orchestra.run.smithi019.stdout:client24953 2024-09-19T08:52:08.405 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/f26c9d84-7662-11ef-bceb-c7b262605968.client24953/status') 2024-09-19T08:52:08.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T08:52:08.465 INFO:teuthology.orchestra.run.smithi019.stdout:instance: client.24953 (3)172.21.15.19:0/2732314555 2024-09-19T08:52:08.465 INFO:teuthology.orchestra.run.smithi019.stdout:blocklisted: false 2024-09-19T08:52:08.465 INFO:teuthology.orchestra.run.smithi019.stderr:0+1 records in 2024-09-19T08:52:08.466 INFO:teuthology.orchestra.run.smithi019.stderr:0+1 records out 2024-09-19T08:52:08.466 INFO:teuthology.orchestra.run.smithi019.stderr:71 bytes copied, 2.4969e-05 s, 2.8 MB/s 2024-09-19T08:52:08.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T08:52:08.473 INFO:teuthology.run_tasks:Running task exec... 2024-09-19T08:52:08.483 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T08:52:08.483 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi019.front.sepia.ceph.com 2024-09-19T08:52:08.483 DEBUG:teuthology.orchestra.run.smithi019:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-09-19T08:52:08.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.587+0000 7fa829d2a640 1 -- 172.21.15.19:0/672881937 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa824104fb0 msgr2=0x7fa8241073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:08.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.587+0000 7fa829d2a640 1 --2- 172.21.15.19:0/672881937 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa824104fb0 0x7fa8241073a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fa818009900 tx=0x7fa81802a410 comp rx=0 tx=0).stop 2024-09-19T08:52:08.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.587+0000 7fa829d2a640 1 -- 172.21.15.19:0/672881937 shutdown_connections 2024-09-19T08:52:08.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.587+0000 7fa829d2a640 1 --2- 172.21.15.19:0/672881937 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa8241078e0 0x7fa824109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.587+0000 7fa829d2a640 1 --2- 172.21.15.19:0/672881937 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa824104fb0 0x7fa8241073a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.587+0000 7fa829d2a640 1 --2- 172.21.15.19:0/672881937 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa824102680 0x7fa824104a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.587+0000 7fa829d2a640 1 -- 172.21.15.19:0/672881937 >> 172.21.15.19:0/672881937 conn(0x7fa8240fc1e0 msgr2=0x7fa8240fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:08.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.587+0000 7fa829d2a640 1 -- 172.21.15.19:0/672881937 shutdown_connections 2024-09-19T08:52:08.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.587+0000 7fa829d2a640 1 -- 172.21.15.19:0/672881937 wait complete. 2024-09-19T08:52:08.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.588+0000 7fa829d2a640 1 Processor -- start 2024-09-19T08:52:08.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.588+0000 7fa829d2a640 1 -- start start 2024-09-19T08:52:08.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.588+0000 7fa829d2a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa824102680 0x7fa824101ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:08.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.588+0000 7fa829d2a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa824104fb0 0x7fa824100630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:08.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.588+0000 7fa829d2a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8241078e0 0x7fa824100b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:08.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.588+0000 7fa829d2a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa82410d7a0 con 0x7fa8241078e0 2024-09-19T08:52:08.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.588+0000 7fa829d2a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa82410d620 con 0x7fa824102680 2024-09-19T08:52:08.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.588+0000 7fa829d2a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa82410d920 con 0x7fa824104fb0 2024-09-19T08:52:08.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.588+0000 7fa823fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8241078e0 0x7fa824100b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:08.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.588+0000 7fa823fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8241078e0 0x7fa824100b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50784/0 (socket says 172.21.15.19:50784) 2024-09-19T08:52:08.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.588+0000 7fa823fff640 1 -- 172.21.15.19:0/756702200 learned_addr learned my addr 172.21.15.19:0/756702200 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:08.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.588+0000 7fa8237fe640 1 --2- 172.21.15.19:0/756702200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa824102680 0x7fa824101ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:08.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.588+0000 7fa822ffd640 1 --2- 172.21.15.19:0/756702200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa824104fb0 0x7fa824100630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:08.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.588+0000 7fa823fff640 1 -- 172.21.15.19:0/756702200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa824104fb0 msgr2=0x7fa824100630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:08.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.588+0000 7fa823fff640 1 --2- 172.21.15.19:0/756702200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa824104fb0 0x7fa824100630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.588+0000 7fa823fff640 1 -- 172.21.15.19:0/756702200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa824102680 msgr2=0x7fa824101ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:08.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.588+0000 7fa823fff640 1 --2- 172.21.15.19:0/756702200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa824102680 0x7fa824101ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:08.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.588+0000 7fa823fff640 1 -- 172.21.15.19:0/756702200 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa824101400 con 0x7fa8241078e0 2024-09-19T08:52:08.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.588+0000 7fa8237fe640 1 --2- 172.21.15.19:0/756702200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa824102680 0x7fa824101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:08.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.589+0000 7fa823fff640 1 --2- 172.21.15.19:0/756702200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8241078e0 0x7fa824100b70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa81c00cce0 tx=0x7fa81c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:08.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.589+0000 7fa820ff9640 1 -- 172.21.15.19:0/756702200 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81c00f450 con 0x7fa8241078e0 2024-09-19T08:52:08.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.589+0000 7fa820ff9640 1 -- 172.21.15.19:0/756702200 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa81c00fad0 con 0x7fa8241078e0 2024-09-19T08:52:08.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.589+0000 7fa820ff9640 1 -- 172.21.15.19:0/756702200 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81c018c10 con 0x7fa8241078e0 2024-09-19T08:52:08.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.589+0000 7fa829d2a640 1 -- 172.21.15.19:0/756702200 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8241a1f20 con 0x7fa8241078e0 2024-09-19T08:52:08.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.589+0000 7fa829d2a640 1 -- 172.21.15.19:0/756702200 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8241a2380 con 0x7fa8241078e0 2024-09-19T08:52:08.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.590+0000 7fa829d2a640 1 -- 172.21.15.19:0/756702200 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8240fdcd0 con 0x7fa8241078e0 2024-09-19T08:52:08.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.591+0000 7fa820ff9640 1 -- 172.21.15.19:0/756702200 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7fa81c00f5f0 con 0x7fa8241078e0 2024-09-19T08:52:08.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.592+0000 7fa820ff9640 1 --2- 172.21.15.19:0/756702200 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa80c0a3370 0x7fa80c0a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:08.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.592+0000 7fa8237fe640 1 --2- 172.21.15.19:0/756702200 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa80c0a3370 0x7fa80c0a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:08.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.592+0000 7fa820ff9640 1 -- 172.21.15.19:0/756702200 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa81c0cffd0 con 0x7fa8241078e0 2024-09-19T08:52:08.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.593+0000 7fa8237fe640 1 --2- 172.21.15.19:0/756702200 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa80c0a3370 0x7fa80c0a5830 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa8140058c0 tx=0x7fa814005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:08.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.596+0000 7fa820ff9640 1 -- 172.21.15.19:0/756702200 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa81c014030 con 0x7fa8241078e0 2024-09-19T08:52:08.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:08.812+0000 7fa829d2a640 1 -- 172.21.15.19:0/756702200 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7fa82402d7c0 con 0x7fa8241078e0 2024-09-19T08:52:09.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.653+0000 7fa820ff9640 1 -- 172.21.15.19:0/756702200 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v28) ==== 118+0+0 (secure 0 0 0) 0x7fa81c09cd00 con 0x7fa8241078e0 2024-09-19T08:52:09.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.656+0000 7fa829d2a640 1 -- 172.21.15.19:0/756702200 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa80c0a3370 msgr2=0x7fa80c0a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:09.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.656+0000 7fa829d2a640 1 --2- 172.21.15.19:0/756702200 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa80c0a3370 0x7fa80c0a5830 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa8140058c0 tx=0x7fa814005ec0 comp rx=0 tx=0).stop 2024-09-19T08:52:09.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.656+0000 7fa829d2a640 1 -- 172.21.15.19:0/756702200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8241078e0 msgr2=0x7fa824100b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:09.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.656+0000 7fa829d2a640 1 --2- 172.21.15.19:0/756702200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8241078e0 0x7fa824100b70 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fa81c00cce0 tx=0x7fa81c00a620 comp rx=0 tx=0).stop 2024-09-19T08:52:09.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.656+0000 7fa829d2a640 1 -- 172.21.15.19:0/756702200 shutdown_connections 2024-09-19T08:52:09.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.656+0000 7fa829d2a640 1 --2- 172.21.15.19:0/756702200 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa80c0a3370 0x7fa80c0a5830 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:09.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.656+0000 7fa829d2a640 1 --2- 172.21.15.19:0/756702200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa824104fb0 0x7fa824100630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:09.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.656+0000 7fa829d2a640 1 --2- 172.21.15.19:0/756702200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa8241078e0 0x7fa824100b70 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:09.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.656+0000 7fa829d2a640 1 --2- 172.21.15.19:0/756702200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa824102680 0x7fa824101ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:09.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.656+0000 7fa829d2a640 1 -- 172.21.15.19:0/756702200 >> 172.21.15.19:0/756702200 conn(0x7fa8240fc1e0 msgr2=0x7fa824102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:09.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.657+0000 7fa829d2a640 1 -- 172.21.15.19:0/756702200 shutdown_connections 2024-09-19T08:52:09.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.657+0000 7fa829d2a640 1 -- 172.21.15.19:0/756702200 wait complete. 2024-09-19T08:52:09.671 DEBUG:teuthology.orchestra.run.smithi019:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-09-19T08:52:09.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.785+0000 7ffa2f14b640 1 -- 172.21.15.19:0/2064520023 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa281025e0 msgr2=0x7ffa281049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:09.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.785+0000 7ffa2f14b640 1 --2- 172.21.15.19:0/2064520023 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa281025e0 0x7ffa281049d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ffa18009900 tx=0x7ffa1802a3f0 comp rx=0 tx=0).stop 2024-09-19T08:52:09.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.785+0000 7ffa2f14b640 1 -- 172.21.15.19:0/2064520023 shutdown_connections 2024-09-19T08:52:09.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.785+0000 7ffa2f14b640 1 --2- 172.21.15.19:0/2064520023 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa28107840 0x7ffa28109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:09.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.785+0000 7ffa2f14b640 1 --2- 172.21.15.19:0/2064520023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa28104f10 0x7ffa28107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:09.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.785+0000 7ffa2f14b640 1 --2- 172.21.15.19:0/2064520023 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa281025e0 0x7ffa281049d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:09.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.785+0000 7ffa2f14b640 1 -- 172.21.15.19:0/2064520023 >> 172.21.15.19:0/2064520023 conn(0x7ffa280fc1e0 msgr2=0x7ffa280fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:09.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.785+0000 7ffa2f14b640 1 -- 172.21.15.19:0/2064520023 shutdown_connections 2024-09-19T08:52:09.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.785+0000 7ffa2f14b640 1 -- 172.21.15.19:0/2064520023 wait complete. 2024-09-19T08:52:09.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.785+0000 7ffa2f14b640 1 Processor -- start 2024-09-19T08:52:09.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.785+0000 7ffa2f14b640 1 -- start start 2024-09-19T08:52:09.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.785+0000 7ffa2f14b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa281025e0 0x7ffa28197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:09.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.785+0000 7ffa2f14b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa28104f10 0x7ffa28198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:09.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.785+0000 7ffa2f14b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa28107840 0x7ffa2819f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:09.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.785+0000 7ffa2f14b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ffa2810d820 con 0x7ffa28104f10 2024-09-19T08:52:09.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.785+0000 7ffa2f14b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ffa2810d6a0 con 0x7ffa281025e0 2024-09-19T08:52:09.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.785+0000 7ffa2f14b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ffa2810d9a0 con 0x7ffa28107840 2024-09-19T08:52:09.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.786+0000 7ffa27fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa28104f10 0x7ffa28198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:09.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.786+0000 7ffa27fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa28104f10 0x7ffa28198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50808/0 (socket says 172.21.15.19:50808) 2024-09-19T08:52:09.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.786+0000 7ffa27fff640 1 -- 172.21.15.19:0/3438033676 learned_addr learned my addr 172.21.15.19:0/3438033676 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:09.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.786+0000 7ffa2d6e8640 1 --2- 172.21.15.19:0/3438033676 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa28107840 0x7ffa2819f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:09.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.786+0000 7ffa2cee7640 1 --2- 172.21.15.19:0/3438033676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa281025e0 0x7ffa28197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:09.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.786+0000 7ffa27fff640 1 -- 172.21.15.19:0/3438033676 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa28107840 msgr2=0x7ffa2819f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:09.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.786+0000 7ffa27fff640 1 --2- 172.21.15.19:0/3438033676 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa28107840 0x7ffa2819f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:09.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.786+0000 7ffa27fff640 1 -- 172.21.15.19:0/3438033676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa281025e0 msgr2=0x7ffa28197de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:09.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.786+0000 7ffa27fff640 1 --2- 172.21.15.19:0/3438033676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa281025e0 0x7ffa28197de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:09.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.786+0000 7ffa27fff640 1 -- 172.21.15.19:0/3438033676 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa2819fa00 con 0x7ffa28104f10 2024-09-19T08:52:09.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.786+0000 7ffa2d6e8640 1 --2- 172.21.15.19:0/3438033676 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa28107840 0x7ffa2819f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:09.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.786+0000 7ffa2cee7640 1 --2- 172.21.15.19:0/3438033676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa281025e0 0x7ffa28197de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:09.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.786+0000 7ffa27fff640 1 --2- 172.21.15.19:0/3438033676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa28104f10 0x7ffa28198320 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c00c970 tx=0x7ffa1c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:09.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.786+0000 7ffa25ffb640 1 -- 172.21.15.19:0/3438033676 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c007bb0 con 0x7ffa28104f10 2024-09-19T08:52:09.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.786+0000 7ffa25ffb640 1 -- 172.21.15.19:0/3438033676 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffa1c007d50 con 0x7ffa28104f10 2024-09-19T08:52:09.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.786+0000 7ffa2f14b640 1 -- 172.21.15.19:0/3438033676 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa2819fcf0 con 0x7ffa28104f10 2024-09-19T08:52:09.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.786+0000 7ffa25ffb640 1 -- 172.21.15.19:0/3438033676 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c00f450 con 0x7ffa28104f10 2024-09-19T08:52:09.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.787+0000 7ffa2f14b640 1 -- 172.21.15.19:0/3438033676 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa281a01e0 con 0x7ffa28104f10 2024-09-19T08:52:09.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.787+0000 7ffa2f14b640 1 -- 172.21.15.19:0/3438033676 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa280fdcd0 con 0x7ffa28104f10 2024-09-19T08:52:09.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.788+0000 7ffa25ffb640 1 -- 172.21.15.19:0/3438033676 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7ffa1c0046c0 con 0x7ffa28104f10 2024-09-19T08:52:09.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.789+0000 7ffa25ffb640 1 --2- 172.21.15.19:0/3438033676 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ffa100a32f0 0x7ffa100a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:09.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.789+0000 7ffa25ffb640 1 -- 172.21.15.19:0/3438033676 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ffa1c0cf9e0 con 0x7ffa28104f10 2024-09-19T08:52:09.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.789+0000 7ffa2cee7640 1 --2- 172.21.15.19:0/3438033676 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ffa100a32f0 0x7ffa100a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:09.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.790+0000 7ffa2cee7640 1 --2- 172.21.15.19:0/3438033676 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ffa100a32f0 0x7ffa100a57b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ffa18000c00 tx=0x7ffa18031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:09.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.794+0000 7ffa25ffb640 1 -- 172.21.15.19:0/3438033676 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffa1c014030 con 0x7ffa28104f10 2024-09-19T08:52:09.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:09 smithi155 ceph-mon[34921]: pgmap v335: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T08:52:09.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:09 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/756702200' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-19T08:52:09.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:09 smithi203 ceph-mon[35450]: pgmap v335: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T08:52:09.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:09 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/756702200' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-19T08:52:09.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:09.997+0000 7ffa2f14b640 1 -- 172.21.15.19:0/3438033676 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7ffa280626d0 con 0x7ffa100a32f0 2024-09-19T08:52:10.003 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:09 smithi019 ceph-mon[30976]: pgmap v335: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-19T08:52:10.003 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:09 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/756702200' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-19T08:52:10.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.021+0000 7ffa25ffb640 1 -- 172.21.15.19:0/3438033676 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7ffa280626d0 con 0x7ffa100a32f0 2024-09-19T08:52:10.021 INFO:teuthology.orchestra.run.smithi019.stdout:{} 2024-09-19T08:52:10.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.023+0000 7ffa2f14b640 1 -- 172.21.15.19:0/3438033676 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ffa100a32f0 msgr2=0x7ffa100a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:10.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.023+0000 7ffa2f14b640 1 --2- 172.21.15.19:0/3438033676 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ffa100a32f0 0x7ffa100a57b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ffa18000c00 tx=0x7ffa18031400 comp rx=0 tx=0).stop 2024-09-19T08:52:10.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.023+0000 7ffa2f14b640 1 -- 172.21.15.19:0/3438033676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa28104f10 msgr2=0x7ffa28198320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:10.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.023+0000 7ffa2f14b640 1 --2- 172.21.15.19:0/3438033676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa28104f10 0x7ffa28198320 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c00c970 tx=0x7ffa1c00ce30 comp rx=0 tx=0).stop 2024-09-19T08:52:10.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.023+0000 7ffa2f14b640 1 -- 172.21.15.19:0/3438033676 shutdown_connections 2024-09-19T08:52:10.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.023+0000 7ffa2f14b640 1 --2- 172.21.15.19:0/3438033676 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ffa100a32f0 0x7ffa100a57b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.023+0000 7ffa2f14b640 1 --2- 172.21.15.19:0/3438033676 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa28107840 0x7ffa2819f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.023+0000 7ffa2f14b640 1 --2- 172.21.15.19:0/3438033676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffa28104f10 0x7ffa28198320 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.023+0000 7ffa2f14b640 1 --2- 172.21.15.19:0/3438033676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffa281025e0 0x7ffa28197de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.023+0000 7ffa2f14b640 1 -- 172.21.15.19:0/3438033676 >> 172.21.15.19:0/3438033676 conn(0x7ffa280fc1e0 msgr2=0x7ffa28102ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:10.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.023+0000 7ffa2f14b640 1 -- 172.21.15.19:0/3438033676 shutdown_connections 2024-09-19T08:52:10.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.023+0000 7ffa2f14b640 1 -- 172.21.15.19:0/3438033676 wait complete. 2024-09-19T08:52:10.034 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-19T08:52:10.046 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-19T08:52:10.083 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T08:52:10.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.185+0000 7f4f0e58d640 1 -- 172.21.15.19:0/3489677058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f08100a30 msgr2=0x7f4f08100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:10.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.186+0000 7f4f0e58d640 1 --2- 172.21.15.19:0/3489677058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f08100a30 0x7f4f08100e30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8009900 tx=0x7f4ef802a410 comp rx=0 tx=0).stop 2024-09-19T08:52:10.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.186+0000 7f4f0e58d640 1 -- 172.21.15.19:0/3489677058 shutdown_connections 2024-09-19T08:52:10.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.186+0000 7f4f0e58d640 1 --2- 172.21.15.19:0/3489677058 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f081025e0 0x7f4f08108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.186+0000 7f4f0e58d640 1 --2- 172.21.15.19:0/3489677058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f08101c20 0x7f4f081020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.186+0000 7f4f0e58d640 1 --2- 172.21.15.19:0/3489677058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f08100a30 0x7f4f08100e30 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.186+0000 7f4f0e58d640 1 -- 172.21.15.19:0/3489677058 >> 172.21.15.19:0/3489677058 conn(0x7f4f080fc1b0 msgr2=0x7f4f080fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:10.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.186+0000 7f4f0e58d640 1 -- 172.21.15.19:0/3489677058 shutdown_connections 2024-09-19T08:52:10.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.186+0000 7f4f0e58d640 1 -- 172.21.15.19:0/3489677058 wait complete. 2024-09-19T08:52:10.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.186+0000 7f4f0e58d640 1 Processor -- start 2024-09-19T08:52:10.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.186+0000 7f4f0e58d640 1 -- start start 2024-09-19T08:52:10.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.187+0000 7f4f0e58d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f08100a30 0x7f4f08197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:10.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.187+0000 7f4f0e58d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f08101c20 0x7f4f08198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:10.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.187+0000 7f4f0e58d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f081025e0 0x7f4f0819f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:10.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.187+0000 7f4f0e58d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4f0810d7c0 con 0x7f4f08100a30 2024-09-19T08:52:10.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.187+0000 7f4f0e58d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4f0810d640 con 0x7f4f08101c20 2024-09-19T08:52:10.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.187+0000 7f4f0e58d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4f0810d940 con 0x7f4f081025e0 2024-09-19T08:52:10.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.187+0000 7f4f07fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f08100a30 0x7f4f08197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:10.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.187+0000 7f4f07fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f08100a30 0x7f4f08197e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50832/0 (socket says 172.21.15.19:50832) 2024-09-19T08:52:10.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.187+0000 7f4f07fff640 1 -- 172.21.15.19:0/1073504932 learned_addr learned my addr 172.21.15.19:0/1073504932 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:10.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.187+0000 7f4f077fe640 1 --2- 172.21.15.19:0/1073504932 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f08101c20 0x7f4f08198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:10.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.187+0000 7f4f0cb2a640 1 --2- 172.21.15.19:0/1073504932 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f081025e0 0x7f4f0819f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:10.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.187+0000 7f4f07fff640 1 -- 172.21.15.19:0/1073504932 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f081025e0 msgr2=0x7f4f0819f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:10.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.187+0000 7f4f07fff640 1 --2- 172.21.15.19:0/1073504932 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f081025e0 0x7f4f0819f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.187+0000 7f4f07fff640 1 -- 172.21.15.19:0/1073504932 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f08101c20 msgr2=0x7f4f08198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:10.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.187+0000 7f4f07fff640 1 --2- 172.21.15.19:0/1073504932 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f08101c20 0x7f4f08198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.187+0000 7f4f07fff640 1 -- 172.21.15.19:0/1073504932 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f0819fa70 con 0x7f4f08100a30 2024-09-19T08:52:10.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.187+0000 7f4f07fff640 1 --2- 172.21.15.19:0/1073504932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f08100a30 0x7f4f08197e50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8031610 tx=0x7f4ef80043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:10.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.187+0000 7f4f057fa640 1 -- 172.21.15.19:0/1073504932 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef803f030 con 0x7f4f08100a30 2024-09-19T08:52:10.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.187+0000 7f4f0e58d640 1 -- 172.21.15.19:0/1073504932 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f0819fd00 con 0x7f4f08100a30 2024-09-19T08:52:10.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.187+0000 7f4f057fa640 1 -- 172.21.15.19:0/1073504932 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ef8003ce0 con 0x7f4f08100a30 2024-09-19T08:52:10.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.187+0000 7f4f057fa640 1 -- 172.21.15.19:0/1073504932 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef8035070 con 0x7f4f08100a30 2024-09-19T08:52:10.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.188+0000 7f4f0e58d640 1 -- 172.21.15.19:0/1073504932 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f081a0190 con 0x7f4f08100a30 2024-09-19T08:52:10.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.189+0000 7f4f0e58d640 1 -- 172.21.15.19:0/1073504932 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f08107e90 con 0x7f4f08100a30 2024-09-19T08:52:10.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.190+0000 7f4f057fa640 1 -- 172.21.15.19:0/1073504932 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f4ef8042030 con 0x7f4f08100a30 2024-09-19T08:52:10.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.190+0000 7f4f057fa640 1 --2- 172.21.15.19:0/1073504932 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4ef00a3250 0x7f4ef00a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:10.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.190+0000 7f4f057fa640 1 -- 172.21.15.19:0/1073504932 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4ef80efdf0 con 0x7f4f08100a30 2024-09-19T08:52:10.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.190+0000 7f4f077fe640 1 --2- 172.21.15.19:0/1073504932 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4ef00a3250 0x7f4ef00a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:10.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.191+0000 7f4f077fe640 1 --2- 172.21.15.19:0/1073504932 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4ef00a3250 0x7f4ef00a5710 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4f08199360 tx=0x7f4efc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:10.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.194+0000 7f4f057fa640 1 -- 172.21.15.19:0/1073504932 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4ef80bc4d0 con 0x7f4f08100a30 2024-09-19T08:52:10.318 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:52:10 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:52:10.002+0000 7f9b047f7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:52:10.319 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:52:10 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:52:10.002+0000 7f9b047f7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:52:10.319 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:52:10 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:52:10.002+0000 7f9b047f7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:52:10.319 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:52:10 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:52:10.002+0000 7f9b047f7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:52:10.319 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 08:52:10 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T08:52:10.002+0000 7f9b047f7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T08:52:10.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.372+0000 7f4f0e58d640 1 -- 172.21.15.19:0/1073504932 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4f08062e90 con 0x7f4f08100a30 2024-09-19T08:52:10.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.374+0000 7f4f057fa640 1 -- 172.21.15.19:0/1073504932 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22651 (secure 0 0 0) 0x7f4ef80c07d0 con 0x7f4f08100a30 2024-09-19T08:52:10.374 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:52:10.375 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":82,"fsid":"f26c9d84-7662-11ef-bceb-c7b262605968","created":"2024-09-19T08:42:32.324073+0000","modified":"2024-09-19T08:51:23.536977+0000","last_up_change":"2024-09-19T08:49:24.764960+0000","last_in_change":"2024-09-19T08:49:01.062919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:45:36.232910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:50:12.615884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:50:14.854513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81c7bb06-5b13-4ee0-9290-d779faac1b91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6803","nonce":3397146732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6805","nonce":3397146732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6809","nonce":3397146732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6807","nonce":3397146732}]},"public_addr":"172.21.15.19:6803/3397146732","cluster_addr":"172.21.15.19:6805/3397146732","heartbeat_back_addr":"172.21.15.19:6809/3397146732","heartbeat_front_addr":"172.21.15.19:6807/3397146732","state":["exists","up"]},{"osd":1,"uuid":"24c145e6-5252-4708-8f25-5ce041e8251e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6801","nonce":2011043685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6803","nonce":2011043685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6807","nonce":2011043685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6805","nonce":2011043685}]},"public_addr":"172.21.15.155:6801/2011043685","cluster_addr":"172.21.15.155:6803/2011043685","heartbeat_back_addr":"172.21.15.155:6807/2011043685","heartbeat_front_addr":"172.21.15.155:6805/2011043685","state":["exists","up"]},{"osd":2,"uuid":"99cefd33-0675-495f-8871-2e6fdead0c3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6801","nonce":3358994623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6803","nonce":3358994623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6807","nonce":3358994623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6805","nonce":3358994623}]},"public_addr":"172.21.15.203:6801/3358994623","cluster_addr":"172.21.15.203:6803/3358994623","heartbeat_back_addr":"172.21.15.203:6807/3358994623","heartbeat_front_addr":"172.21.15.203:6805/3358994623","state":["exists","up"]},{"osd":3,"uuid":"8f46c16c-f17e-484a-8b66-6dbf135f34c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6811","nonce":176445576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6813","nonce":176445576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6817","nonce":176445576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6815","nonce":176445576}]},"public_addr":"172.21.15.19:6811/176445576","cluster_addr":"172.21.15.19:6813/176445576","heartbeat_back_addr":"172.21.15.19:6817/176445576","heartbeat_front_addr":"172.21.15.19:6815/176445576","state":["exists","up"]},{"osd":4,"uuid":"411b0423-1317-4e82-bc01-b5f55b391bc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6809","nonce":2163087792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6811","nonce":2163087792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6815","nonce":2163087792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6813","nonce":2163087792}]},"public_addr":"172.21.15.155:6809/2163087792","cluster_addr":"172.21.15.155:6811/2163087792","heartbeat_back_addr":"172.21.15.155:6815/2163087792","heartbeat_front_addr":"172.21.15.155:6813/2163087792","state":["exists","up"]},{"osd":5,"uuid":"057c073e-569f-4c6e-9602-e1169ad4dd8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6809","nonce":334881465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6811","nonce":334881465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6815","nonce":334881465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6813","nonce":334881465}]},"public_addr":"172.21.15.203:6809/334881465","cluster_addr":"172.21.15.203:6811/334881465","heartbeat_back_addr":"172.21.15.203:6815/334881465","heartbeat_front_addr":"172.21.15.203:6813/334881465","state":["exists","up"]},{"osd":6,"uuid":"40418f13-823e-4f94-a427-84781abbcb5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6819","nonce":2669779791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6821","nonce":2669779791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6825","nonce":2669779791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6823","nonce":2669779791}]},"public_addr":"172.21.15.19:6819/2669779791","cluster_addr":"172.21.15.19:6821/2669779791","heartbeat_back_addr":"172.21.15.19:6825/2669779791","heartbeat_front_addr":"172.21.15.19:6823/2669779791","state":["exists","up"]},{"osd":7,"uuid":"ad15f762-aeab-4167-a63d-6c9f9b89b9c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6817","nonce":3169455907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6819","nonce":3169455907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6823","nonce":3169455907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6821","nonce":3169455907}]},"public_addr":"172.21.15.155:6817/3169455907","cluster_addr":"172.21.15.155:6819/3169455907","heartbeat_back_addr":"172.21.15.155:6823/3169455907","heartbeat_front_addr":"172.21.15.155:6821/3169455907","state":["exists","up"]},{"osd":8,"uuid":"23cf8ea2-29d6-43d8-a05b-7822f4bbf254","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6817","nonce":1062999528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6819","nonce":1062999528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6823","nonce":1062999528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6821","nonce":1062999528}]},"public_addr":"172.21.15.203:6817/1062999528","cluster_addr":"172.21.15.203:6819/1062999528","heartbeat_back_addr":"172.21.15.203:6823/1062999528","heartbeat_front_addr":"172.21.15.203:6821/1062999528","state":["exists","up"]},{"osd":9,"uuid":"e851e605-2d17-4fbf-b783-2138133edd06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6827","nonce":574664786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6829","nonce":574664786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6833","nonce":574664786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6831","nonce":574664786}]},"public_addr":"172.21.15.19:6827/574664786","cluster_addr":"172.21.15.19:6829/574664786","heartbeat_back_addr":"172.21.15.19:6833/574664786","heartbeat_front_addr":"172.21.15.19:6831/574664786","state":["exists","up"]},{"osd":10,"uuid":"cc770717-91bd-4494-9103-6db8214b5872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6825","nonce":2242158832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6827","nonce":2242158832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6831","nonce":2242158832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6829","nonce":2242158832}]},"public_addr":"172.21.15.155:6825/2242158832","cluster_addr":"172.21.15.155:6827/2242158832","heartbeat_back_addr":"172.21.15.155:6831/2242158832","heartbeat_front_addr":"172.21.15.155:6829/2242158832","state":["exists","up"]},{"osd":11,"uuid":"6c237db9-5d79-47bc-8ff6-60d09d721d5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6825","nonce":522943955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6827","nonce":522943955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6831","nonce":522943955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6829","nonce":522943955}]},"public_addr":"172.21.15.203:6825/522943955","cluster_addr":"172.21.15.203:6827/522943955","heartbeat_back_addr":"172.21.15.203:6831/522943955","heartbeat_front_addr":"172.21.15.203:6829/522943955","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:44:44.656414+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:09.339183+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:33.245452+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:59.449025+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:46:24.831213+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:46:49.189780+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:47:13.493628+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:47:39.478247+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:05.089875+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:30.722878+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:56.951834+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:22.894678+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6801/4266644067":"2024-09-20T08:43:21.732222+0000","172.21.15.19:0/1398782170":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6800/4266644067":"2024-09-20T08:43:21.732222+0000","172.21.15.19:0/34162461":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6801/1764769529":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/2910961714":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6800/1764769529":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/820792769":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/560203138":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/809642328":"2024-09-20T08:42:56.618773+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:52:10.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.376+0000 7f4f0e58d640 1 -- 172.21.15.19:0/1073504932 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4ef00a3250 msgr2=0x7f4ef00a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:10.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.376+0000 7f4f0e58d640 1 --2- 172.21.15.19:0/1073504932 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4ef00a3250 0x7f4ef00a5710 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4f08199360 tx=0x7f4efc00b390 comp rx=0 tx=0).stop 2024-09-19T08:52:10.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.376+0000 7f4f0e58d640 1 -- 172.21.15.19:0/1073504932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f08100a30 msgr2=0x7f4f08197e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:10.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.376+0000 7f4f0e58d640 1 --2- 172.21.15.19:0/1073504932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f08100a30 0x7f4f08197e50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8031610 tx=0x7f4ef80043b0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.376+0000 7f4f0e58d640 1 -- 172.21.15.19:0/1073504932 shutdown_connections 2024-09-19T08:52:10.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.376+0000 7f4f0e58d640 1 --2- 172.21.15.19:0/1073504932 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4ef00a3250 0x7f4ef00a5710 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.376+0000 7f4f0e58d640 1 --2- 172.21.15.19:0/1073504932 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f081025e0 0x7f4f0819f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.376+0000 7f4f0e58d640 1 --2- 172.21.15.19:0/1073504932 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4f08101c20 0x7f4f08198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.376+0000 7f4f0e58d640 1 --2- 172.21.15.19:0/1073504932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4f08100a30 0x7f4f08197e50 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.376+0000 7f4f0e58d640 1 -- 172.21.15.19:0/1073504932 >> 172.21.15.19:0/1073504932 conn(0x7f4f080fc1b0 msgr2=0x7f4f08105060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:10.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.376+0000 7f4f0e58d640 1 -- 172.21.15.19:0/1073504932 shutdown_connections 2024-09-19T08:52:10.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.376+0000 7f4f0e58d640 1 -- 172.21.15.19:0/1073504932 wait complete. 2024-09-19T08:52:10.387 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T08:45:36.232910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T08:50:12.615884+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T08:50:14.854513+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T08:52:10.388 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T08:52:10.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.494+0000 7f6bcd5b7640 1 -- 172.21.15.19:0/2878578877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bc81025b0 msgr2=0x7f6bc8108e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:10.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.494+0000 7f6bcd5b7640 1 --2- 172.21.15.19:0/2878578877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bc81025b0 0x7f6bc8108e40 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6bc0009ca0 tx=0x7f6bc002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.494+0000 7f6bcd5b7640 1 -- 172.21.15.19:0/2878578877 shutdown_connections 2024-09-19T08:52:10.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.494+0000 7f6bcd5b7640 1 --2- 172.21.15.19:0/2878578877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bc81025b0 0x7f6bc8108e40 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.494+0000 7f6bcd5b7640 1 --2- 172.21.15.19:0/2878578877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc8101bf0 0x7f6bc8102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.494+0000 7f6bcd5b7640 1 --2- 172.21.15.19:0/2878578877 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6bc8100a00 0x7f6bc8100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.495+0000 7f6bcd5b7640 1 -- 172.21.15.19:0/2878578877 >> 172.21.15.19:0/2878578877 conn(0x7f6bc80fc140 msgr2=0x7f6bc80fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:10.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.495+0000 7f6bcd5b7640 1 -- 172.21.15.19:0/2878578877 shutdown_connections 2024-09-19T08:52:10.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.495+0000 7f6bcd5b7640 1 -- 172.21.15.19:0/2878578877 wait complete. 2024-09-19T08:52:10.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.495+0000 7f6bcd5b7640 1 Processor -- start 2024-09-19T08:52:10.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.495+0000 7f6bcd5b7640 1 -- start start 2024-09-19T08:52:10.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.495+0000 7f6bcd5b7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bc8100a00 0x7f6bc8197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:10.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.495+0000 7f6bcd5b7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc8101bf0 0x7f6bc8198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:10.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.495+0000 7f6bcd5b7640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6bc81025b0 0x7f6bc819f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:10.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.495+0000 7f6bcd5b7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc810d830 con 0x7f6bc8100a00 2024-09-19T08:52:10.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.495+0000 7f6bcd5b7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc810d6b0 con 0x7f6bc8101bf0 2024-09-19T08:52:10.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.495+0000 7f6bcd5b7640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc810d9b0 con 0x7f6bc81025b0 2024-09-19T08:52:10.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.496+0000 7f6bc6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bc8100a00 0x7f6bc8197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:10.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.496+0000 7f6bc6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bc8100a00 0x7f6bc8197e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50846/0 (socket says 172.21.15.19:50846) 2024-09-19T08:52:10.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.496+0000 7f6bc6ffd640 1 -- 172.21.15.19:0/1384358350 learned_addr learned my addr 172.21.15.19:0/1384358350 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:10.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.496+0000 7f6bc77fe640 1 --2- 172.21.15.19:0/1384358350 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6bc81025b0 0x7f6bc819f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:10.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.496+0000 7f6bc6ffd640 1 -- 172.21.15.19:0/1384358350 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6bc81025b0 msgr2=0x7f6bc819f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:10.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.496+0000 7f6bc6ffd640 1 --2- 172.21.15.19:0/1384358350 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6bc81025b0 0x7f6bc819f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.496+0000 7f6bc6ffd640 1 -- 172.21.15.19:0/1384358350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc8101bf0 msgr2=0x7f6bc8198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:10.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.496+0000 7f6bc67fc640 1 --2- 172.21.15.19:0/1384358350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc8101bf0 0x7f6bc8198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:10.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.496+0000 7f6bc6ffd640 1 --2- 172.21.15.19:0/1384358350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc8101bf0 0x7f6bc8198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.496+0000 7f6bc6ffd640 1 -- 172.21.15.19:0/1384358350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc819fa20 con 0x7f6bc8100a00 2024-09-19T08:52:10.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.496+0000 7f6bc77fe640 1 --2- 172.21.15.19:0/1384358350 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6bc81025b0 0x7f6bc819f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:10.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.496+0000 7f6bc6ffd640 1 --2- 172.21.15.19:0/1384358350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bc8100a00 0x7f6bc8197e00 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800e9c0 tx=0x7f6bb800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:10.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.496+0000 7f6bbffff640 1 -- 172.21.15.19:0/1384358350 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb800cd80 con 0x7f6bc8100a00 2024-09-19T08:52:10.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.496+0000 7f6bbffff640 1 -- 172.21.15.19:0/1384358350 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bb80035f0 con 0x7f6bc8100a00 2024-09-19T08:52:10.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.496+0000 7f6bcd5b7640 1 -- 172.21.15.19:0/1384358350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bc819fd10 con 0x7f6bc8100a00 2024-09-19T08:52:10.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.496+0000 7f6bbffff640 1 -- 172.21.15.19:0/1384358350 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8010690 con 0x7f6bc8100a00 2024-09-19T08:52:10.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.496+0000 7f6bcd5b7640 1 -- 172.21.15.19:0/1384358350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bc81a01b0 con 0x7f6bc8100a00 2024-09-19T08:52:10.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.498+0000 7f6bcd5b7640 1 -- 172.21.15.19:0/1384358350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bc8107da0 con 0x7f6bc8100a00 2024-09-19T08:52:10.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.499+0000 7f6bbffff640 1 -- 172.21.15.19:0/1384358350 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f6bb80037a0 con 0x7f6bc8100a00 2024-09-19T08:52:10.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.499+0000 7f6bbffff640 1 --2- 172.21.15.19:0/1384358350 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6bb40a3250 0x7f6bb40a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:10.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.499+0000 7f6bc67fc640 1 --2- 172.21.15.19:0/1384358350 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6bb40a3250 0x7f6bb40a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:10.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.499+0000 7f6bbffff640 1 -- 172.21.15.19:0/1384358350 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6bb80cfdf0 con 0x7f6bc8100a00 2024-09-19T08:52:10.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.500+0000 7f6bc67fc640 1 --2- 172.21.15.19:0/1384358350 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6bb40a3250 0x7f6bb40a5710 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0005fd0 tx=0x7f6bb0009470 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:10.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.503+0000 7f6bbffff640 1 -- 172.21.15.19:0/1384358350 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6bb809cb20 con 0x7f6bc8100a00 2024-09-19T08:52:10.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.679+0000 7f6bcd5b7640 1 -- 172.21.15.19:0/1384358350 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6bc802db80 con 0x7f6bc8100a00 2024-09-19T08:52:10.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.680+0000 7f6bbffff640 1 -- 172.21.15.19:0/1384358350 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7f6bb809c420 con 0x7f6bc8100a00 2024-09-19T08:52:10.680 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-09-19T08:52:10.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.682+0000 7f6bcd5b7640 1 -- 172.21.15.19:0/1384358350 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6bb40a3250 msgr2=0x7f6bb40a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:10.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.682+0000 7f6bcd5b7640 1 --2- 172.21.15.19:0/1384358350 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6bb40a3250 0x7f6bb40a5710 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0005fd0 tx=0x7f6bb0009470 comp rx=0 tx=0).stop 2024-09-19T08:52:10.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.682+0000 7f6bcd5b7640 1 -- 172.21.15.19:0/1384358350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bc8100a00 msgr2=0x7f6bc8197e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:10.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.682+0000 7f6bcd5b7640 1 --2- 172.21.15.19:0/1384358350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bc8100a00 0x7f6bc8197e00 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800e9c0 tx=0x7f6bb800ee80 comp rx=0 tx=0).stop 2024-09-19T08:52:10.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.682+0000 7f6bcd5b7640 1 -- 172.21.15.19:0/1384358350 shutdown_connections 2024-09-19T08:52:10.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.682+0000 7f6bcd5b7640 1 --2- 172.21.15.19:0/1384358350 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6bb40a3250 0x7f6bb40a5710 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.682+0000 7f6bcd5b7640 1 --2- 172.21.15.19:0/1384358350 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6bc81025b0 0x7f6bc819f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.682+0000 7f6bcd5b7640 1 --2- 172.21.15.19:0/1384358350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6bc8101bf0 0x7f6bc8198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.682+0000 7f6bcd5b7640 1 --2- 172.21.15.19:0/1384358350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6bc8100a00 0x7f6bc8197e00 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.682+0000 7f6bcd5b7640 1 -- 172.21.15.19:0/1384358350 >> 172.21.15.19:0/1384358350 conn(0x7f6bc80fc140 msgr2=0x7f6bc8104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:10.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.682+0000 7f6bcd5b7640 1 -- 172.21.15.19:0/1384358350 shutdown_connections 2024-09-19T08:52:10.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.682+0000 7f6bcd5b7640 1 -- 172.21.15.19:0/1384358350 wait complete. 2024-09-19T08:52:10.694 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T08:52:10.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.800+0000 7f3a051bd640 1 -- 172.21.15.19:0/1964787185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a00100a10 msgr2=0x7f3a00100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:10.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.800+0000 7f3a051bd640 1 --2- 172.21.15.19:0/1964787185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a00100a10 0x7f3a00100e10 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f39f0009900 tx=0x7f39f002a410 comp rx=0 tx=0).stop 2024-09-19T08:52:10.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.800+0000 7f3a051bd640 1 -- 172.21.15.19:0/1964787185 shutdown_connections 2024-09-19T08:52:10.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.800+0000 7f3a051bd640 1 --2- 172.21.15.19:0/1964787185 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a001025c0 0x7f3a00108e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.800+0000 7f3a051bd640 1 --2- 172.21.15.19:0/1964787185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a00101c00 0x7f3a00102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.800+0000 7f3a051bd640 1 --2- 172.21.15.19:0/1964787185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a00100a10 0x7f3a00100e10 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.800+0000 7f3a051bd640 1 -- 172.21.15.19:0/1964787185 >> 172.21.15.19:0/1964787185 conn(0x7f3a000fc190 msgr2=0x7f3a000fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:10.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.800+0000 7f3a051bd640 1 -- 172.21.15.19:0/1964787185 shutdown_connections 2024-09-19T08:52:10.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.800+0000 7f3a051bd640 1 -- 172.21.15.19:0/1964787185 wait complete. 2024-09-19T08:52:10.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.801+0000 7f3a051bd640 1 Processor -- start 2024-09-19T08:52:10.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.801+0000 7f3a051bd640 1 -- start start 2024-09-19T08:52:10.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.801+0000 7f3a051bd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a00100a10 0x7f3a00197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:10.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.801+0000 7f3a051bd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a00101c00 0x7f3a00198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:10.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.801+0000 7f3a051bd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a001025c0 0x7f3a0019f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:10.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.801+0000 7f3a051bd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3a0010c710 con 0x7f3a001025c0 2024-09-19T08:52:10.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.801+0000 7f3a051bd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3a0010c590 con 0x7f3a00101c00 2024-09-19T08:52:10.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.801+0000 7f3a051bd640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3a0010c890 con 0x7f3a00100a10 2024-09-19T08:52:10.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.801+0000 7f39ff59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a001025c0 0x7f3a0019f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:10.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.801+0000 7f39ff59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a001025c0 0x7f3a0019f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50852/0 (socket says 172.21.15.19:50852) 2024-09-19T08:52:10.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.801+0000 7f39ff59e640 1 -- 172.21.15.19:0/1406470401 learned_addr learned my addr 172.21.15.19:0/1406470401 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:10.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.801+0000 7f39fe59c640 1 --2- 172.21.15.19:0/1406470401 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a00101c00 0x7f3a00198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:10.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.801+0000 7f39fed9d640 1 --2- 172.21.15.19:0/1406470401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a00100a10 0x7f3a00197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:10.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.801+0000 7f39ff59e640 1 -- 172.21.15.19:0/1406470401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a00100a10 msgr2=0x7f3a00197f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:10.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.802+0000 7f39ff59e640 1 --2- 172.21.15.19:0/1406470401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a00100a10 0x7f3a00197f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.802+0000 7f39ff59e640 1 -- 172.21.15.19:0/1406470401 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a00101c00 msgr2=0x7f3a00198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:10.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.802+0000 7f39ff59e640 1 --2- 172.21.15.19:0/1406470401 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a00101c00 0x7f3a00198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.802+0000 7f39ff59e640 1 -- 172.21.15.19:0/1406470401 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a0019fb30 con 0x7f3a001025c0 2024-09-19T08:52:10.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.802+0000 7f39ff59e640 1 --2- 172.21.15.19:0/1406470401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a001025c0 0x7f3a0019f4c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f39f800b990 tx=0x7f39f800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:10.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.802+0000 7f39e7fff640 1 -- 172.21.15.19:0/1406470401 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f8019070 con 0x7f3a001025c0 2024-09-19T08:52:10.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.802+0000 7f39e7fff640 1 -- 172.21.15.19:0/1406470401 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f39f800cba0 con 0x7f3a001025c0 2024-09-19T08:52:10.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.802+0000 7f3a051bd640 1 -- 172.21.15.19:0/1406470401 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a0019fe20 con 0x7f3a001025c0 2024-09-19T08:52:10.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.802+0000 7f39e7fff640 1 -- 172.21.15.19:0/1406470401 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f8007650 con 0x7f3a001025c0 2024-09-19T08:52:10.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.802+0000 7f3a051bd640 1 -- 172.21.15.19:0/1406470401 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a001a02b0 con 0x7f3a001025c0 2024-09-19T08:52:10.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.803+0000 7f3a051bd640 1 -- 172.21.15.19:0/1406470401 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a001a0540 con 0x7f3a001025c0 2024-09-19T08:52:10.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.804+0000 7f39e7fff640 1 -- 172.21.15.19:0/1406470401 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f39f801c070 con 0x7f3a001025c0 2024-09-19T08:52:10.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.805+0000 7f39e7fff640 1 --2- 172.21.15.19:0/1406470401 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f39e80a3250 0x7f39e80a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:10.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.805+0000 7f39e7fff640 1 -- 172.21.15.19:0/1406470401 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f39f80ceed0 con 0x7f3a001025c0 2024-09-19T08:52:10.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.805+0000 7f39fed9d640 1 --2- 172.21.15.19:0/1406470401 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f39e80a3250 0x7f39e80a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:10.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.805+0000 7f39fed9d640 1 --2- 172.21.15.19:0/1406470401 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f39e80a3250 0x7f39e80a5710 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f39f00314e0 tx=0x7f39f0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:10.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.809+0000 7f39e7fff640 1 -- 172.21.15.19:0/1406470401 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f39f809b5b0 con 0x7f3a001025c0 2024-09-19T08:52:10.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:10 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/756702200' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-19T08:52:10.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:10 smithi155 ceph-mon[34921]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T08:52:10.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:10 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1073504932' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:52:10.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:10 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/756702200' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-19T08:52:10.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:10 smithi203 ceph-mon[35450]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T08:52:10.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:10 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1073504932' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:52:10.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.985+0000 7f3a051bd640 1 -- 172.21.15.19:0/1406470401 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3a001a08a0 con 0x7f3a001025c0 2024-09-19T08:52:10.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.985+0000 7f39e7fff640 1 -- 172.21.15.19:0/1406470401 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) ==== 104+0+11 (secure 0 0 0) 0x7f39f809f8b0 con 0x7f3a001025c0 2024-09-19T08:52:10.986 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-09-19T08:52:10.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.988+0000 7f3a051bd640 1 -- 172.21.15.19:0/1406470401 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f39e80a3250 msgr2=0x7f39e80a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:10.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.988+0000 7f3a051bd640 1 --2- 172.21.15.19:0/1406470401 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f39e80a3250 0x7f39e80a5710 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f39f00314e0 tx=0x7f39f0000bc0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.988+0000 7f3a051bd640 1 -- 172.21.15.19:0/1406470401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a001025c0 msgr2=0x7f3a0019f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:10.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.988+0000 7f3a051bd640 1 --2- 172.21.15.19:0/1406470401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a001025c0 0x7f3a0019f4c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f39f800b990 tx=0x7f39f800be50 comp rx=0 tx=0).stop 2024-09-19T08:52:10.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.988+0000 7f3a051bd640 1 -- 172.21.15.19:0/1406470401 shutdown_connections 2024-09-19T08:52:10.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.988+0000 7f3a051bd640 1 --2- 172.21.15.19:0/1406470401 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f39e80a3250 0x7f39e80a5710 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.988+0000 7f3a051bd640 1 --2- 172.21.15.19:0/1406470401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a001025c0 0x7f3a0019f4c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.988+0000 7f3a051bd640 1 --2- 172.21.15.19:0/1406470401 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a00101c00 0x7f3a00198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.988+0000 7f3a051bd640 1 --2- 172.21.15.19:0/1406470401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a00100a10 0x7f3a00197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:10.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.988+0000 7f3a051bd640 1 -- 172.21.15.19:0/1406470401 >> 172.21.15.19:0/1406470401 conn(0x7f3a000fc190 msgr2=0x7f3a0006a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:10.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.988+0000 7f3a051bd640 1 -- 172.21.15.19:0/1406470401 shutdown_connections 2024-09-19T08:52:10.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:10.988+0000 7f3a051bd640 1 -- 172.21.15.19:0/1406470401 wait complete. 2024-09-19T08:52:10.998 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:10 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/756702200' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-19T08:52:10.998 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:10 smithi019 ceph-mon[30976]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T08:52:10.998 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:10 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1073504932' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:52:10.999 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T08:52:11.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.105+0000 7f872dd26640 1 -- 172.21.15.19:0/1173468645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87281036d0 msgr2=0x7f8728109f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:11.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.105+0000 7f872dd26640 1 --2- 172.21.15.19:0/1173468645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87281036d0 0x7f8728109f60 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8720009ca0 tx=0x7f872002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:52:11.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.105+0000 7f872dd26640 1 -- 172.21.15.19:0/1173468645 shutdown_connections 2024-09-19T08:52:11.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.105+0000 7f872dd26640 1 --2- 172.21.15.19:0/1173468645 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f87281036d0 0x7f8728109f60 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:11.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.105+0000 7f872dd26640 1 --2- 172.21.15.19:0/1173468645 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8728102d10 0x7f8728103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:11.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.105+0000 7f872dd26640 1 --2- 172.21.15.19:0/1173468645 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8728101b20 0x7f8728101f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:11.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.105+0000 7f872dd26640 1 -- 172.21.15.19:0/1173468645 >> 172.21.15.19:0/1173468645 conn(0x7f87280fd2a0 msgr2=0x7f87280ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:11.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.105+0000 7f872dd26640 1 -- 172.21.15.19:0/1173468645 shutdown_connections 2024-09-19T08:52:11.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.105+0000 7f872dd26640 1 -- 172.21.15.19:0/1173468645 wait complete. 2024-09-19T08:52:11.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.106+0000 7f872dd26640 1 Processor -- start 2024-09-19T08:52:11.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.106+0000 7f872dd26640 1 -- start start 2024-09-19T08:52:11.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.106+0000 7f872dd26640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8728101b20 0x7f8728197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:11.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.106+0000 7f872dd26640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8728102d10 0x7f8728198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:11.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.106+0000 7f872dd26640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87281036d0 0x7f872819f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:11.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.106+0000 7f872dd26640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f872810d7a0 con 0x7f8728101b20 2024-09-19T08:52:11.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.106+0000 7f872dd26640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f872810d620 con 0x7f87281036d0 2024-09-19T08:52:11.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.106+0000 7f872dd26640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f872810d920 con 0x7f8728102d10 2024-09-19T08:52:11.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.106+0000 7f87277fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8728101b20 0x7f8728197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:11.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.107+0000 7f87277fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8728101b20 0x7f8728197e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50874/0 (socket says 172.21.15.19:50874) 2024-09-19T08:52:11.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.107+0000 7f87277fe640 1 -- 172.21.15.19:0/2843650832 learned_addr learned my addr 172.21.15.19:0/2843650832 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:11.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.107+0000 7f8726ffd640 1 --2- 172.21.15.19:0/2843650832 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8728102d10 0x7f8728198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:11.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.107+0000 7f8727fff640 1 --2- 172.21.15.19:0/2843650832 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87281036d0 0x7f872819f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:11.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.107+0000 7f87277fe640 1 -- 172.21.15.19:0/2843650832 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8728102d10 msgr2=0x7f8728198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:11.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.107+0000 7f87277fe640 1 --2- 172.21.15.19:0/2843650832 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8728102d10 0x7f8728198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:11.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.107+0000 7f87277fe640 1 -- 172.21.15.19:0/2843650832 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87281036d0 msgr2=0x7f872819f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:11.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.107+0000 7f87277fe640 1 --2- 172.21.15.19:0/2843650832 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87281036d0 0x7f872819f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:11.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.107+0000 7f87277fe640 1 -- 172.21.15.19:0/2843650832 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f872819fa40 con 0x7f8728101b20 2024-09-19T08:52:11.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.107+0000 7f8726ffd640 1 --2- 172.21.15.19:0/2843650832 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8728102d10 0x7f8728198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:11.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.107+0000 7f87277fe640 1 --2- 172.21.15.19:0/2843650832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8728101b20 0x7f8728197e20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f871800c970 tx=0x7f871800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:11.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.107+0000 7f8724ff9640 1 -- 172.21.15.19:0/2843650832 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8718004220 con 0x7f8728101b20 2024-09-19T08:52:11.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.107+0000 7f872dd26640 1 -- 172.21.15.19:0/2843650832 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f872819fd30 con 0x7f8728101b20 2024-09-19T08:52:11.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.107+0000 7f8724ff9640 1 -- 172.21.15.19:0/2843650832 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f87180043c0 con 0x7f8728101b20 2024-09-19T08:52:11.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.107+0000 7f8724ff9640 1 -- 172.21.15.19:0/2843650832 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8718004a00 con 0x7f8728101b20 2024-09-19T08:52:11.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.107+0000 7f872dd26640 1 -- 172.21.15.19:0/2843650832 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87281a01d0 con 0x7f8728101b20 2024-09-19T08:52:11.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.108+0000 7f872dd26640 1 -- 172.21.15.19:0/2843650832 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8728108ec0 con 0x7f8728101b20 2024-09-19T08:52:11.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.110+0000 7f8724ff9640 1 -- 172.21.15.19:0/2843650832 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f87180079b0 con 0x7f8728101b20 2024-09-19T08:52:11.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.111+0000 7f8724ff9640 1 --2- 172.21.15.19:0/2843650832 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f87100a3250 0x7f87100a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:11.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.111+0000 7f8726ffd640 1 --2- 172.21.15.19:0/2843650832 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f87100a3250 0x7f87100a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:11.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.111+0000 7f8724ff9640 1 -- 172.21.15.19:0/2843650832 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f87180cf770 con 0x7f8728101b20 2024-09-19T08:52:11.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.111+0000 7f8726ffd640 1 --2- 172.21.15.19:0/2843650832 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f87100a3250 0x7f87100a5710 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8728199330 tx=0x7f871c00b5f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:11.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.115+0000 7f8724ff9640 1 -- 172.21.15.19:0/2843650832 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8718014030 con 0x7f8728101b20 2024-09-19T08:52:11.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.290+0000 7f872dd26640 1 -- 172.21.15.19:0/2843650832 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8728062f30 con 0x7f8728101b20 2024-09-19T08:52:11.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.290+0000 7f8724ff9640 1 -- 172.21.15.19:0/2843650832 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) ==== 100+0+11 (secure 0 0 0) 0x7f871809c4a0 con 0x7f8728101b20 2024-09-19T08:52:11.291 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-09-19T08:52:11.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.293+0000 7f872dd26640 1 -- 172.21.15.19:0/2843650832 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f87100a3250 msgr2=0x7f87100a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:11.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.293+0000 7f872dd26640 1 --2- 172.21.15.19:0/2843650832 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f87100a3250 0x7f87100a5710 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8728199330 tx=0x7f871c00b5f0 comp rx=0 tx=0).stop 2024-09-19T08:52:11.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.293+0000 7f872dd26640 1 -- 172.21.15.19:0/2843650832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8728101b20 msgr2=0x7f8728197e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:11.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.293+0000 7f872dd26640 1 --2- 172.21.15.19:0/2843650832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8728101b20 0x7f8728197e20 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f871800c970 tx=0x7f871800ce30 comp rx=0 tx=0).stop 2024-09-19T08:52:11.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.293+0000 7f872dd26640 1 -- 172.21.15.19:0/2843650832 shutdown_connections 2024-09-19T08:52:11.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.293+0000 7f872dd26640 1 --2- 172.21.15.19:0/2843650832 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f87100a3250 0x7f87100a5710 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:11.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.293+0000 7f872dd26640 1 --2- 172.21.15.19:0/2843650832 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8728102d10 0x7f8728198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:11.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.293+0000 7f872dd26640 1 --2- 172.21.15.19:0/2843650832 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f87281036d0 0x7f872819f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:11.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.293+0000 7f872dd26640 1 --2- 172.21.15.19:0/2843650832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8728101b20 0x7f8728197e20 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:11.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.293+0000 7f872dd26640 1 -- 172.21.15.19:0/2843650832 >> 172.21.15.19:0/2843650832 conn(0x7f87280fd2a0 msgr2=0x7f8728106090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:11.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.293+0000 7f872dd26640 1 -- 172.21.15.19:0/2843650832 shutdown_connections 2024-09-19T08:52:11.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:11.293+0000 7f872dd26640 1 -- 172.21.15.19:0/2843650832 wait complete. 2024-09-19T08:52:11.304 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-19T08:52:11.304 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:52:11.561 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:11.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:11 smithi155 ceph-mon[34921]: pgmap v336: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-19T08:52:11.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:11 smithi155 ceph-mon[34921]: from='client.15225 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:52:11.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:11 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1384358350' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:52:11.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:11 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1406470401' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T08:52:11.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:11 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/2843650832' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T08:52:11.971 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:11 smithi019 ceph-mon[30976]: pgmap v336: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-19T08:52:11.971 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:11 smithi019 ceph-mon[30976]: from='client.15225 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:52:11.971 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:11 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1384358350' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:52:11.971 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:11 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1406470401' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T08:52:11.972 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:11 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/2843650832' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T08:52:11.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:11 smithi203 ceph-mon[35450]: pgmap v336: 97 pgs: 97 active+clean; 642 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-19T08:52:11.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:11 smithi203 ceph-mon[35450]: from='client.15225 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T08:52:11.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:11 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1384358350' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T08:52:11.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:11 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1406470401' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T08:52:11.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:11 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/2843650832' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T08:52:12.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.054+0000 7f43a8aaa640 1 -- 172.21.15.19:0/4236497252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43a4100e20 msgr2=0x7f43a4101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:12.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.054+0000 7f43a8aaa640 1 --2- 172.21.15.19:0/4236497252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43a4100e20 0x7f43a4101200 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f439c009ca0 tx=0x7f439c02a950 comp rx=0 tx=0).stop 2024-09-19T08:52:12.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.054+0000 7f43a8aaa640 1 -- 172.21.15.19:0/4236497252 shutdown_connections 2024-09-19T08:52:12.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.054+0000 7f43a8aaa640 1 --2- 172.21.15.19:0/4236497252 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43a4102ef0 0x7f43a410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.054+0000 7f43a8aaa640 1 --2- 172.21.15.19:0/4236497252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43a4102570 0x7f43a41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.054+0000 7f43a8aaa640 1 --2- 172.21.15.19:0/4236497252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43a4100e20 0x7f43a4101200 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.054+0000 7f43a8aaa640 1 -- 172.21.15.19:0/4236497252 >> 172.21.15.19:0/4236497252 conn(0x7f43a40fc7d0 msgr2=0x7f43a40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:12.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.054+0000 7f43a8aaa640 1 -- 172.21.15.19:0/4236497252 shutdown_connections 2024-09-19T08:52:12.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.054+0000 7f43a8aaa640 1 -- 172.21.15.19:0/4236497252 wait complete. 2024-09-19T08:52:12.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.055+0000 7f43a8aaa640 1 Processor -- start 2024-09-19T08:52:12.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.055+0000 7f43a8aaa640 1 -- start start 2024-09-19T08:52:12.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.055+0000 7f43a8aaa640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43a4100e20 0x7f43a4199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:12.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.055+0000 7f43a8aaa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43a4102570 0x7f43a4199970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:12.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.055+0000 7f43a8aaa640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43a4102ef0 0x7f43a41a44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:12.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.055+0000 7f43a8aaa640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f43a4110fa0 con 0x7f43a4102570 2024-09-19T08:52:12.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.055+0000 7f43a8aaa640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f43a4110e20 con 0x7f43a4102ef0 2024-09-19T08:52:12.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.055+0000 7f43a8aaa640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f43a4111120 con 0x7f43a4100e20 2024-09-19T08:52:12.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.055+0000 7f43a1d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43a4102570 0x7f43a4199970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:12.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.055+0000 7f43a1d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43a4102570 0x7f43a4199970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50886/0 (socket says 172.21.15.19:50886) 2024-09-19T08:52:12.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.055+0000 7f43a1d9b640 1 -- 172.21.15.19:0/3836684885 learned_addr learned my addr 172.21.15.19:0/3836684885 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:12.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.055+0000 7f43a2d9d640 1 --2- 172.21.15.19:0/3836684885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43a4102ef0 0x7f43a41a44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:12.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.055+0000 7f43a259c640 1 --2- 172.21.15.19:0/3836684885 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43a4100e20 0x7f43a4199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:12.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.055+0000 7f43a1d9b640 1 -- 172.21.15.19:0/3836684885 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43a4100e20 msgr2=0x7f43a4199430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:12.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.055+0000 7f43a1d9b640 1 --2- 172.21.15.19:0/3836684885 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43a4100e20 0x7f43a4199430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.055+0000 7f43a1d9b640 1 -- 172.21.15.19:0/3836684885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43a4102ef0 msgr2=0x7f43a41a44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:12.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.055+0000 7f43a1d9b640 1 --2- 172.21.15.19:0/3836684885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43a4102ef0 0x7f43a41a44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.055+0000 7f43a1d9b640 1 -- 172.21.15.19:0/3836684885 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43a41a49f0 con 0x7f43a4102570 2024-09-19T08:52:12.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.055+0000 7f43a2d9d640 1 --2- 172.21.15.19:0/3836684885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43a4102ef0 0x7f43a41a44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:12.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.056+0000 7f43a1d9b640 1 --2- 172.21.15.19:0/3836684885 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43a4102570 0x7f43a4199970 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f438c00b4a0 tx=0x7f438c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:12.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.056+0000 7f439b7fe640 1 -- 172.21.15.19:0/3836684885 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438c014070 con 0x7f43a4102570 2024-09-19T08:52:12.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.056+0000 7f439b7fe640 1 -- 172.21.15.19:0/3836684885 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f438c010af0 con 0x7f43a4102570 2024-09-19T08:52:12.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.056+0000 7f43a8aaa640 1 -- 172.21.15.19:0/3836684885 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43a41a4bc0 con 0x7f43a4102570 2024-09-19T08:52:12.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.056+0000 7f439b7fe640 1 -- 172.21.15.19:0/3836684885 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438c017d10 con 0x7f43a4102570 2024-09-19T08:52:12.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.056+0000 7f43a8aaa640 1 -- 172.21.15.19:0/3836684885 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43a41a50d0 con 0x7f43a4102570 2024-09-19T08:52:12.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.057+0000 7f43a8aaa640 1 -- 172.21.15.19:0/3836684885 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43a4101200 con 0x7f43a4102570 2024-09-19T08:52:12.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.058+0000 7f439b7fe640 1 -- 172.21.15.19:0/3836684885 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 18) ==== 138355+0+0 (secure 0 0 0) 0x7f438c017070 con 0x7f43a4102570 2024-09-19T08:52:12.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.059+0000 7f439b7fe640 1 --2- 172.21.15.19:0/3836684885 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f43900a3240 0x7f43900a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:12.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.059+0000 7f43a259c640 1 --2- 172.21.15.19:0/3836684885 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f43900a3240 0x7f43900a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:12.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.059+0000 7f439b7fe640 1 -- 172.21.15.19:0/3836684885 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f438c0ced80 con 0x7f43a4102570 2024-09-19T08:52:12.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.060+0000 7f43a259c640 1 --2- 172.21.15.19:0/3836684885 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f43900a3240 0x7f43900a5700 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f439c02ae70 tx=0x7f439c005ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:12.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.063+0000 7f439b7fe640 1 -- 172.21.15.19:0/3836684885 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f438c09ba50 con 0x7f43a4102570 2024-09-19T08:52:12.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.279+0000 7f43a8aaa640 1 -- 172.21.15.19:0/3836684885 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43a4109090 con 0x7f43a4102570 2024-09-19T08:52:12.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.280+0000 7f439b7fe640 1 -- 172.21.15.19:0/3836684885 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11983 (secure 0 0 0) 0x7f438c09b350 con 0x7f43a4102570 2024-09-19T08:52:12.281 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:52:12.281 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":28,"btime":"2024-09-19T08:52:09:653615+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2452068876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2452068876},{"type":"v1","addr":"172.21.15.19:6839","nonce":2452068876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T08:52:08.813945+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/2480841559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2480841559},{"type":"v1","addr":"172.21.15.155:6835","nonce":2480841559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24463,24464,24490,24469,24497]},"id":1}]} 2024-09-19T08:52:12.281 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 28 2024-09-19T08:52:12.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.282+0000 7f43a8aaa640 1 -- 172.21.15.19:0/3836684885 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f43900a3240 msgr2=0x7f43900a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:12.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.282+0000 7f43a8aaa640 1 --2- 172.21.15.19:0/3836684885 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f43900a3240 0x7f43900a5700 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f439c02ae70 tx=0x7f439c005ef0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.282+0000 7f43a8aaa640 1 -- 172.21.15.19:0/3836684885 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43a4102570 msgr2=0x7f43a4199970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:12.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.282+0000 7f43a8aaa640 1 --2- 172.21.15.19:0/3836684885 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43a4102570 0x7f43a4199970 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f438c00b4a0 tx=0x7f438c00b960 comp rx=0 tx=0).stop 2024-09-19T08:52:12.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.282+0000 7f43a8aaa640 1 -- 172.21.15.19:0/3836684885 shutdown_connections 2024-09-19T08:52:12.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.282+0000 7f43a8aaa640 1 --2- 172.21.15.19:0/3836684885 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f43900a3240 0x7f43900a5700 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.282+0000 7f43a8aaa640 1 --2- 172.21.15.19:0/3836684885 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43a4102ef0 0x7f43a41a44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.282+0000 7f43a8aaa640 1 --2- 172.21.15.19:0/3836684885 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f43a4102570 0x7f43a4199970 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.282+0000 7f43a8aaa640 1 --2- 172.21.15.19:0/3836684885 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43a4100e20 0x7f43a4199430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:12.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.282+0000 7f43a8aaa640 1 -- 172.21.15.19:0/3836684885 >> 172.21.15.19:0/3836684885 conn(0x7f43a40fc7d0 msgr2=0x7f43a40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:12.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.283+0000 7f43a8aaa640 1 -- 172.21.15.19:0/3836684885 shutdown_connections 2024-09-19T08:52:12.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:12.283+0000 7f43a8aaa640 1 -- 172.21.15.19:0/3836684885 wait complete. 2024-09-19T08:52:12.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:12 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3836684885' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:52:13.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:12 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3836684885' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:52:13.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:12 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3836684885' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:52:13.197 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-19T08:52:13.197 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-19T08:52:13.197 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T08:52:13.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.312+0000 7fe4d7e77640 1 -- 172.21.15.19:0/1854731498 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4d0107810 msgr2=0x7fe4d0109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:13.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.312+0000 7fe4d7e77640 1 --2- 172.21.15.19:0/1854731498 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4d0107810 0x7fe4d0109c80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8009ca0 tx=0x7fe4c802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:52:13.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.312+0000 7fe4d7e77640 1 -- 172.21.15.19:0/1854731498 shutdown_connections 2024-09-19T08:52:13.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.312+0000 7fe4d7e77640 1 --2- 172.21.15.19:0/1854731498 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4d0107810 0x7fe4d0109c80 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:13.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.312+0000 7fe4d7e77640 1 --2- 172.21.15.19:0/1854731498 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4d0104ee0 0x7fe4d01072d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:13.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.312+0000 7fe4d7e77640 1 --2- 172.21.15.19:0/1854731498 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4d01025b0 0x7fe4d01049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:13.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.312+0000 7fe4d7e77640 1 -- 172.21.15.19:0/1854731498 >> 172.21.15.19:0/1854731498 conn(0x7fe4d00fc1b0 msgr2=0x7fe4d00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:13.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.312+0000 7fe4d7e77640 1 -- 172.21.15.19:0/1854731498 shutdown_connections 2024-09-19T08:52:13.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.312+0000 7fe4d7e77640 1 -- 172.21.15.19:0/1854731498 wait complete. 2024-09-19T08:52:13.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.313+0000 7fe4d7e77640 1 Processor -- start 2024-09-19T08:52:13.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.313+0000 7fe4d7e77640 1 -- start start 2024-09-19T08:52:13.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.313+0000 7fe4d7e77640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4d01025b0 0x7fe4d0197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:13.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.313+0000 7fe4d7e77640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4d0104ee0 0x7fe4d0198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:13.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.313+0000 7fe4d7e77640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4d0107810 0x7fe4d019f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:13.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.313+0000 7fe4d7e77640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d010d7f0 con 0x7fe4d0107810 2024-09-19T08:52:13.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.313+0000 7fe4d7e77640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d010d670 con 0x7fe4d01025b0 2024-09-19T08:52:13.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.313+0000 7fe4d7e77640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d010d970 con 0x7fe4d0104ee0 2024-09-19T08:52:13.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.313+0000 7fe4d6414640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4d0107810 0x7fe4d019f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:13.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.313+0000 7fe4d6414640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4d0107810 0x7fe4d019f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50910/0 (socket says 172.21.15.19:50910) 2024-09-19T08:52:13.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.313+0000 7fe4d6414640 1 -- 172.21.15.19:0/3908222852 learned_addr learned my addr 172.21.15.19:0/3908222852 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:13.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.313+0000 7fe4d5c13640 1 --2- 172.21.15.19:0/3908222852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4d01025b0 0x7fe4d0197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:13.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.313+0000 7fe4d5412640 1 --2- 172.21.15.19:0/3908222852 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4d0104ee0 0x7fe4d0198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:13.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.314+0000 7fe4d6414640 1 -- 172.21.15.19:0/3908222852 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4d0104ee0 msgr2=0x7fe4d0198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:13.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.314+0000 7fe4d6414640 1 --2- 172.21.15.19:0/3908222852 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4d0104ee0 0x7fe4d0198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:13.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.314+0000 7fe4d6414640 1 -- 172.21.15.19:0/3908222852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4d01025b0 msgr2=0x7fe4d0197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:13.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.314+0000 7fe4d6414640 1 --2- 172.21.15.19:0/3908222852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4d01025b0 0x7fe4d0197e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:13.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.314+0000 7fe4d6414640 1 -- 172.21.15.19:0/3908222852 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d019fa70 con 0x7fe4d0107810 2024-09-19T08:52:13.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.314+0000 7fe4d5412640 1 --2- 172.21.15.19:0/3908222852 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4d0104ee0 0x7fe4d0198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:13.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.314+0000 7fe4d6414640 1 --2- 172.21.15.19:0/3908222852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4d0107810 0x7fe4d019f400 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8031a40 tx=0x7fe4c8031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:13.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.314+0000 7fe4c6ffd640 1 -- 172.21.15.19:0/3908222852 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8003c30 con 0x7fe4d0107810 2024-09-19T08:52:13.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.314+0000 7fe4c6ffd640 1 -- 172.21.15.19:0/3908222852 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe4c8003dd0 con 0x7fe4d0107810 2024-09-19T08:52:13.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.314+0000 7fe4d7e77640 1 -- 172.21.15.19:0/3908222852 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4d019fd00 con 0x7fe4d0107810 2024-09-19T08:52:13.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.314+0000 7fe4c6ffd640 1 -- 172.21.15.19:0/3908222852 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c802fdb0 con 0x7fe4d0107810 2024-09-19T08:52:13.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.314+0000 7fe4d7e77640 1 -- 172.21.15.19:0/3908222852 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4d01a01f0 con 0x7fe4d0107810 2024-09-19T08:52:13.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.315+0000 7fe4d7e77640 1 -- 172.21.15.19:0/3908222852 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4d00fdca0 con 0x7fe4d0107810 2024-09-19T08:52:13.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.316+0000 7fe4c6ffd640 1 -- 172.21.15.19:0/3908222852 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7fe4c8004050 con 0x7fe4d0107810 2024-09-19T08:52:13.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.317+0000 7fe4c6ffd640 1 --2- 172.21.15.19:0/3908222852 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe4bc0a32e0 0x7fe4bc0a57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:13.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.317+0000 7fe4d5c13640 1 --2- 172.21.15.19:0/3908222852 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe4bc0a32e0 0x7fe4bc0a57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:13.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.317+0000 7fe4c6ffd640 1 -- 172.21.15.19:0/3908222852 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fe4c80f0de0 con 0x7fe4d0107810 2024-09-19T08:52:13.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.318+0000 7fe4d5c13640 1 --2- 172.21.15.19:0/3908222852 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe4bc0a32e0 0x7fe4bc0a57a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc005fd0 tx=0x7fe4cc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:13.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.321+0000 7fe4c6ffd640 1 -- 172.21.15.19:0/3908222852 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe4c80bda60 con 0x7fe4d0107810 2024-09-19T08:52:13.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.494+0000 7fe4d7e77640 1 -- 172.21.15.19:0/3908222852 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe4d0062630 con 0x7fe4bc0a32e0 2024-09-19T08:52:13.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.501+0000 7fe4c6ffd640 1 -- 172.21.15.19:0/3908222852 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259035 (secure 0 0 0) 0x7fe4d0062630 con 0x7fe4bc0a32e0 2024-09-19T08:52:13.504 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:52:13.505 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-19T08:52:13.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.503+0000 7fe4d7e77640 1 -- 172.21.15.19:0/3908222852 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe4bc0a32e0 msgr2=0x7fe4bc0a57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:13.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.503+0000 7fe4d7e77640 1 --2- 172.21.15.19:0/3908222852 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe4bc0a32e0 0x7fe4bc0a57a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc005fd0 tx=0x7fe4cc00b390 comp rx=0 tx=0).stop 2024-09-19T08:52:13.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.504+0000 7fe4d7e77640 1 -- 172.21.15.19:0/3908222852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4d0107810 msgr2=0x7fe4d019f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:13.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.504+0000 7fe4d7e77640 1 --2- 172.21.15.19:0/3908222852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4d0107810 0x7fe4d019f400 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe4c8031a40 tx=0x7fe4c8031ee0 comp rx=0 tx=0).stop 2024-09-19T08:52:13.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.504+0000 7fe4d7e77640 1 -- 172.21.15.19:0/3908222852 shutdown_connections 2024-09-19T08:52:13.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.504+0000 7fe4d7e77640 1 --2- 172.21.15.19:0/3908222852 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe4bc0a32e0 0x7fe4bc0a57a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:13.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.504+0000 7fe4d7e77640 1 --2- 172.21.15.19:0/3908222852 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe4d0104ee0 0x7fe4d0198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:13.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.504+0000 7fe4d7e77640 1 --2- 172.21.15.19:0/3908222852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe4d0107810 0x7fe4d019f400 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:13.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.504+0000 7fe4d7e77640 1 --2- 172.21.15.19:0/3908222852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe4d01025b0 0x7fe4d0197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:13.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.504+0000 7fe4d7e77640 1 -- 172.21.15.19:0/3908222852 >> 172.21.15.19:0/3908222852 conn(0x7fe4d00fc1b0 msgr2=0x7fe4d0102f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:13.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.504+0000 7fe4d7e77640 1 -- 172.21.15.19:0/3908222852 shutdown_connections 2024-09-19T08:52:13.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.504+0000 7fe4d7e77640 1 -- 172.21.15.19:0/3908222852 wait complete. 2024-09-19T08:52:13.515 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":337,"stamp":"2024-09-19T08:52:11.874832+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658646,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1182,"num_read_kb":708,"num_write":438,"num_write_kb":3084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1181525,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":859,"ondisk_log_size":859,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":356180,"kb_used_data":11092,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585644,"statfs":{"total":1151940427776,"available":1151575699456,"internally_reserved":0,"allocated":11358208,"data_stored":7167231,"data_compressed":107538,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19142,"internal_metadata":353154362},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1094,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":57,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002775"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837586+0000","last_change":"2024-09-19T08:50:15.893270+0000","last_active":"2024-09-19T08:51:51.837586+0000","last_peered":"2024-09-19T08:51:51.837586+0000","last_clean":"2024-09-19T08:51:51.837586+0000","last_became_active":"2024-09-19T08:50:15.892020+0000","last_became_peered":"2024-09-19T08:50:15.892020+0000","last_unstale":"2024-09-19T08:51:51.837586+0000","last_undegraded":"2024-09-19T08:51:51.837586+0000","last_fullsized":"2024-09-19T08:51:51.837586+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:40.846708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.834475+0000","last_change":"2024-09-19T08:50:15.889331+0000","last_active":"2024-09-19T08:51:51.834475+0000","last_peered":"2024-09-19T08:51:51.834475+0000","last_clean":"2024-09-19T08:51:51.834475+0000","last_became_active":"2024-09-19T08:50:15.887082+0000","last_became_peered":"2024-09-19T08:50:15.887082+0000","last_unstale":"2024-09-19T08:51:51.834475+0000","last_undegraded":"2024-09-19T08:51:51.834475+0000","last_fullsized":"2024-09-19T08:51:51.834475+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:46.934172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.836646+0000","last_change":"2024-09-19T08:50:15.891714+0000","last_active":"2024-09-19T08:51:51.836646+0000","last_peered":"2024-09-19T08:51:51.836646+0000","last_clean":"2024-09-19T08:51:51.836646+0000","last_became_active":"2024-09-19T08:50:15.891380+0000","last_became_peered":"2024-09-19T08:50:15.891380+0000","last_unstale":"2024-09-19T08:51:51.836646+0000","last_undegraded":"2024-09-19T08:51:51.836646+0000","last_fullsized":"2024-09-19T08:51:51.836646+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:02.203252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.820657+0000","last_change":"2024-09-19T08:50:15.896157+0000","last_active":"2024-09-19T08:51:51.820657+0000","last_peered":"2024-09-19T08:51:51.820657+0000","last_clean":"2024-09-19T08:51:51.820657+0000","last_became_active":"2024-09-19T08:50:15.895772+0000","last_became_peered":"2024-09-19T08:50:15.895772+0000","last_unstale":"2024-09-19T08:51:51.820657+0000","last_undegraded":"2024-09-19T08:51:51.820657+0000","last_fullsized":"2024-09-19T08:51:51.820657+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:12.915745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.819392+0000","last_change":"2024-09-19T08:50:15.886600+0000","last_active":"2024-09-19T08:51:51.819392+0000","last_peered":"2024-09-19T08:51:51.819392+0000","last_clean":"2024-09-19T08:51:51.819392+0000","last_became_active":"2024-09-19T08:50:15.886270+0000","last_became_peered":"2024-09-19T08:50:15.886270+0000","last_unstale":"2024-09-19T08:51:51.819392+0000","last_undegraded":"2024-09-19T08:51:51.819392+0000","last_fullsized":"2024-09-19T08:51:51.819392+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:53.779930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.826597+0000","last_change":"2024-09-19T08:50:15.889475+0000","last_active":"2024-09-19T08:51:51.826597+0000","last_peered":"2024-09-19T08:51:51.826597+0000","last_clean":"2024-09-19T08:51:51.826597+0000","last_became_active":"2024-09-19T08:50:15.889134+0000","last_became_peered":"2024-09-19T08:50:15.889134+0000","last_unstale":"2024-09-19T08:51:51.826597+0000","last_undegraded":"2024-09-19T08:51:51.826597+0000","last_fullsized":"2024-09-19T08:51:51.826597+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:53.977662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829681+0000","last_change":"2024-09-19T08:50:15.897163+0000","last_active":"2024-09-19T08:51:51.829681+0000","last_peered":"2024-09-19T08:51:51.829681+0000","last_clean":"2024-09-19T08:51:51.829681+0000","last_became_active":"2024-09-19T08:50:15.895161+0000","last_became_peered":"2024-09-19T08:50:15.895161+0000","last_unstale":"2024-09-19T08:51:51.829681+0000","last_undegraded":"2024-09-19T08:51:51.829681+0000","last_fullsized":"2024-09-19T08:51:51.829681+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:32.432691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829477+0000","last_change":"2024-09-19T08:50:15.891197+0000","last_active":"2024-09-19T08:51:51.829477+0000","last_peered":"2024-09-19T08:51:51.829477+0000","last_clean":"2024-09-19T08:51:51.829477+0000","last_became_active":"2024-09-19T08:50:15.890880+0000","last_became_peered":"2024-09-19T08:50:15.890880+0000","last_unstale":"2024-09-19T08:51:51.829477+0000","last_undegraded":"2024-09-19T08:51:51.829477+0000","last_fullsized":"2024-09-19T08:51:51.829477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:41.100341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.836501+0000","last_change":"2024-09-19T08:50:15.896043+0000","last_active":"2024-09-19T08:51:51.836501+0000","last_peered":"2024-09-19T08:51:51.836501+0000","last_clean":"2024-09-19T08:51:51.836501+0000","last_became_active":"2024-09-19T08:50:15.895498+0000","last_became_peered":"2024-09-19T08:50:15.895498+0000","last_unstale":"2024-09-19T08:51:51.836501+0000","last_undegraded":"2024-09-19T08:51:51.836501+0000","last_fullsized":"2024-09-19T08:51:51.836501+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:57.956427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.830052+0000","last_change":"2024-09-19T08:50:15.887658+0000","last_active":"2024-09-19T08:51:51.830052+0000","last_peered":"2024-09-19T08:51:51.830052+0000","last_clean":"2024-09-19T08:51:51.830052+0000","last_became_active":"2024-09-19T08:50:15.887199+0000","last_became_peered":"2024-09-19T08:50:15.887199+0000","last_unstale":"2024-09-19T08:51:51.830052+0000","last_undegraded":"2024-09-19T08:51:51.830052+0000","last_fullsized":"2024-09-19T08:51:51.830052+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:39.947735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.834776+0000","last_change":"2024-09-19T08:50:15.894865+0000","last_active":"2024-09-19T08:51:51.834776+0000","last_peered":"2024-09-19T08:51:51.834776+0000","last_clean":"2024-09-19T08:51:51.834776+0000","last_became_active":"2024-09-19T08:50:15.894475+0000","last_became_peered":"2024-09-19T08:50:15.894475+0000","last_unstale":"2024-09-19T08:51:51.834776+0000","last_undegraded":"2024-09-19T08:51:51.834776+0000","last_fullsized":"2024-09-19T08:51:51.834776+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:43.235991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827890+0000","last_change":"2024-09-19T08:50:15.897209+0000","last_active":"2024-09-19T08:51:51.827890+0000","last_peered":"2024-09-19T08:51:51.827890+0000","last_clean":"2024-09-19T08:51:51.827890+0000","last_became_active":"2024-09-19T08:50:15.896866+0000","last_became_peered":"2024-09-19T08:50:15.896866+0000","last_unstale":"2024-09-19T08:51:51.827890+0000","last_undegraded":"2024-09-19T08:51:51.827890+0000","last_fullsized":"2024-09-19T08:51:51.827890+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:23.036534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.825376+0000","last_change":"2024-09-19T08:50:15.890076+0000","last_active":"2024-09-19T08:51:51.825376+0000","last_peered":"2024-09-19T08:51:51.825376+0000","last_clean":"2024-09-19T08:51:51.825376+0000","last_became_active":"2024-09-19T08:50:15.889735+0000","last_became_peered":"2024-09-19T08:50:15.889735+0000","last_unstale":"2024-09-19T08:51:51.825376+0000","last_undegraded":"2024-09-19T08:51:51.825376+0000","last_fullsized":"2024-09-19T08:51:51.825376+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:25.602757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.834241+0000","last_change":"2024-09-19T08:50:15.886739+0000","last_active":"2024-09-19T08:51:51.834241+0000","last_peered":"2024-09-19T08:51:51.834241+0000","last_clean":"2024-09-19T08:51:51.834241+0000","last_became_active":"2024-09-19T08:50:15.886313+0000","last_became_peered":"2024-09-19T08:50:15.886313+0000","last_unstale":"2024-09-19T08:51:51.834241+0000","last_undegraded":"2024-09-19T08:51:51.834241+0000","last_fullsized":"2024-09-19T08:51:51.834241+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:03.244674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837276+0000","last_change":"2024-09-19T08:50:15.898519+0000","last_active":"2024-09-19T08:51:51.837276+0000","last_peered":"2024-09-19T08:51:51.837276+0000","last_clean":"2024-09-19T08:51:51.837276+0000","last_became_active":"2024-09-19T08:50:15.898249+0000","last_became_peered":"2024-09-19T08:50:15.898249+0000","last_unstale":"2024-09-19T08:51:51.837276+0000","last_undegraded":"2024-09-19T08:51:51.837276+0000","last_fullsized":"2024-09-19T08:51:51.837276+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:32.318895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837455+0000","last_change":"2024-09-19T08:50:15.890324+0000","last_active":"2024-09-19T08:51:51.837455+0000","last_peered":"2024-09-19T08:51:51.837455+0000","last_clean":"2024-09-19T08:51:51.837455+0000","last_became_active":"2024-09-19T08:50:15.887345+0000","last_became_peered":"2024-09-19T08:50:15.887345+0000","last_unstale":"2024-09-19T08:51:51.837455+0000","last_undegraded":"2024-09-19T08:51:51.837455+0000","last_fullsized":"2024-09-19T08:51:51.837455+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:27.989128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837724+0000","last_change":"2024-09-19T08:50:15.896305+0000","last_active":"2024-09-19T08:51:51.837724+0000","last_peered":"2024-09-19T08:51:51.837724+0000","last_clean":"2024-09-19T08:51:51.837724+0000","last_became_active":"2024-09-19T08:50:15.895832+0000","last_became_peered":"2024-09-19T08:50:15.895832+0000","last_unstale":"2024-09-19T08:51:51.837724+0000","last_undegraded":"2024-09-19T08:51:51.837724+0000","last_fullsized":"2024-09-19T08:51:51.837724+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:37.098237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.821237+0000","last_change":"2024-09-19T08:50:15.887251+0000","last_active":"2024-09-19T08:51:51.821237+0000","last_peered":"2024-09-19T08:51:51.821237+0000","last_clean":"2024-09-19T08:51:51.821237+0000","last_became_active":"2024-09-19T08:50:15.886936+0000","last_became_peered":"2024-09-19T08:50:15.886936+0000","last_unstale":"2024-09-19T08:51:51.821237+0000","last_undegraded":"2024-09-19T08:51:51.821237+0000","last_fullsized":"2024-09-19T08:51:51.821237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:38:08.828246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827071+0000","last_change":"2024-09-19T08:50:15.884813+0000","last_active":"2024-09-19T08:51:51.827071+0000","last_peered":"2024-09-19T08:51:51.827071+0000","last_clean":"2024-09-19T08:51:51.827071+0000","last_became_active":"2024-09-19T08:50:15.883445+0000","last_became_peered":"2024-09-19T08:50:15.883445+0000","last_unstale":"2024-09-19T08:51:51.827071+0000","last_undegraded":"2024-09-19T08:51:51.827071+0000","last_fullsized":"2024-09-19T08:51:51.827071+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:39.733501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.821368+0000","last_change":"2024-09-19T08:50:15.887644+0000","last_active":"2024-09-19T08:51:51.821368+0000","last_peered":"2024-09-19T08:51:51.821368+0000","last_clean":"2024-09-19T08:51:51.821368+0000","last_became_active":"2024-09-19T08:50:15.887224+0000","last_became_peered":"2024-09-19T08:50:15.887224+0000","last_unstale":"2024-09-19T08:51:51.821368+0000","last_undegraded":"2024-09-19T08:51:51.821368+0000","last_fullsized":"2024-09-19T08:51:51.821368+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:35.883690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.835961+0000","last_change":"2024-09-19T08:50:15.886678+0000","last_active":"2024-09-19T08:51:51.835961+0000","last_peered":"2024-09-19T08:51:51.835961+0000","last_clean":"2024-09-19T08:51:51.835961+0000","last_became_active":"2024-09-19T08:50:15.886360+0000","last_became_peered":"2024-09-19T08:50:15.886360+0000","last_unstale":"2024-09-19T08:51:51.835961+0000","last_undegraded":"2024-09-19T08:51:51.835961+0000","last_fullsized":"2024-09-19T08:51:51.835961+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:51.515211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.832052+0000","last_change":"2024-09-19T08:50:15.887607+0000","last_active":"2024-09-19T08:51:51.832052+0000","last_peered":"2024-09-19T08:51:51.832052+0000","last_clean":"2024-09-19T08:51:51.832052+0000","last_became_active":"2024-09-19T08:50:15.887266+0000","last_became_peered":"2024-09-19T08:50:15.887266+0000","last_unstale":"2024-09-19T08:51:51.832052+0000","last_undegraded":"2024-09-19T08:51:51.832052+0000","last_fullsized":"2024-09-19T08:51:51.832052+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:44:57.404160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829136+0000","last_change":"2024-09-19T08:50:15.882651+0000","last_active":"2024-09-19T08:51:51.829136+0000","last_peered":"2024-09-19T08:51:51.829136+0000","last_clean":"2024-09-19T08:51:51.829136+0000","last_became_active":"2024-09-19T08:50:15.882298+0000","last_became_peered":"2024-09-19T08:50:15.882298+0000","last_unstale":"2024-09-19T08:51:51.829136+0000","last_undegraded":"2024-09-19T08:51:51.829136+0000","last_fullsized":"2024-09-19T08:51:51.829136+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:16.028013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829040+0000","last_change":"2024-09-19T08:50:15.880407+0000","last_active":"2024-09-19T08:51:51.829040+0000","last_peered":"2024-09-19T08:51:51.829040+0000","last_clean":"2024-09-19T08:51:51.829040+0000","last_became_active":"2024-09-19T08:50:15.880026+0000","last_became_peered":"2024-09-19T08:50:15.880026+0000","last_unstale":"2024-09-19T08:51:51.829040+0000","last_undegraded":"2024-09-19T08:51:51.829040+0000","last_fullsized":"2024-09-19T08:51:51.829040+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:16.600913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.828745+0000","last_change":"2024-09-19T08:50:15.883573+0000","last_active":"2024-09-19T08:51:51.828745+0000","last_peered":"2024-09-19T08:51:51.828745+0000","last_clean":"2024-09-19T08:51:51.828745+0000","last_became_active":"2024-09-19T08:50:15.883258+0000","last_became_peered":"2024-09-19T08:50:15.883258+0000","last_unstale":"2024-09-19T08:51:51.828745+0000","last_undegraded":"2024-09-19T08:51:51.828745+0000","last_fullsized":"2024-09-19T08:51:51.828745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:33.026579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827776+0000","last_change":"2024-09-19T08:50:15.889519+0000","last_active":"2024-09-19T08:51:51.827776+0000","last_peered":"2024-09-19T08:51:51.827776+0000","last_clean":"2024-09-19T08:51:51.827776+0000","last_became_active":"2024-09-19T08:50:15.889183+0000","last_became_peered":"2024-09-19T08:50:15.889183+0000","last_unstale":"2024-09-19T08:51:51.827776+0000","last_undegraded":"2024-09-19T08:51:51.827776+0000","last_fullsized":"2024-09-19T08:51:51.827776+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:06.725662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.821674+0000","last_change":"2024-09-19T08:50:15.894483+0000","last_active":"2024-09-19T08:51:51.821674+0000","last_peered":"2024-09-19T08:51:51.821674+0000","last_clean":"2024-09-19T08:51:51.821674+0000","last_became_active":"2024-09-19T08:50:15.893760+0000","last_became_peered":"2024-09-19T08:50:15.893760+0000","last_unstale":"2024-09-19T08:51:51.821674+0000","last_undegraded":"2024-09-19T08:51:51.821674+0000","last_fullsized":"2024-09-19T08:51:51.821674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:23.686592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.835380+0000","last_change":"2024-09-19T08:50:15.882393+0000","last_active":"2024-09-19T08:51:51.835380+0000","last_peered":"2024-09-19T08:51:51.835380+0000","last_clean":"2024-09-19T08:51:51.835380+0000","last_became_active":"2024-09-19T08:50:15.882040+0000","last_became_peered":"2024-09-19T08:50:15.882040+0000","last_unstale":"2024-09-19T08:51:51.835380+0000","last_undegraded":"2024-09-19T08:51:51.835380+0000","last_fullsized":"2024-09-19T08:51:51.835380+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:22.430017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837471+0000","last_change":"2024-09-19T08:50:15.890919+0000","last_active":"2024-09-19T08:51:51.837471+0000","last_peered":"2024-09-19T08:51:51.837471+0000","last_clean":"2024-09-19T08:51:51.837471+0000","last_became_active":"2024-09-19T08:50:15.890256+0000","last_became_peered":"2024-09-19T08:50:15.890256+0000","last_unstale":"2024-09-19T08:51:51.837471+0000","last_undegraded":"2024-09-19T08:51:51.837471+0000","last_fullsized":"2024-09-19T08:51:51.837471+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:48.404890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827490+0000","last_change":"2024-09-19T08:50:15.888139+0000","last_active":"2024-09-19T08:51:51.827490+0000","last_peered":"2024-09-19T08:51:51.827490+0000","last_clean":"2024-09-19T08:51:51.827490+0000","last_became_active":"2024-09-19T08:50:15.886471+0000","last_became_peered":"2024-09-19T08:50:15.886471+0000","last_unstale":"2024-09-19T08:51:51.827490+0000","last_undegraded":"2024-09-19T08:51:51.827490+0000","last_fullsized":"2024-09-19T08:51:51.827490+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:20.545473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.822777+0000","last_change":"2024-09-19T08:50:15.891354+0000","last_active":"2024-09-19T08:51:51.822777+0000","last_peered":"2024-09-19T08:51:51.822777+0000","last_clean":"2024-09-19T08:51:51.822777+0000","last_became_active":"2024-09-19T08:50:15.890900+0000","last_became_peered":"2024-09-19T08:50:15.890900+0000","last_unstale":"2024-09-19T08:51:51.822777+0000","last_undegraded":"2024-09-19T08:51:51.822777+0000","last_fullsized":"2024-09-19T08:51:51.822777+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:33.139637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.828631+0000","last_change":"2024-09-19T08:50:15.891501+0000","last_active":"2024-09-19T08:51:51.828631+0000","last_peered":"2024-09-19T08:51:51.828631+0000","last_clean":"2024-09-19T08:51:51.828631+0000","last_became_active":"2024-09-19T08:50:15.891183+0000","last_became_peered":"2024-09-19T08:50:15.891183+0000","last_unstale":"2024-09-19T08:51:51.828631+0000","last_undegraded":"2024-09-19T08:51:51.828631+0000","last_fullsized":"2024-09-19T08:51:51.828631+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:16.976705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.819783+0000","last_change":"2024-09-19T08:50:15.882048+0000","last_active":"2024-09-19T08:51:51.819783+0000","last_peered":"2024-09-19T08:51:51.819783+0000","last_clean":"2024-09-19T08:51:51.819783+0000","last_became_active":"2024-09-19T08:50:15.881156+0000","last_became_peered":"2024-09-19T08:50:15.881156+0000","last_unstale":"2024-09-19T08:51:51.819783+0000","last_undegraded":"2024-09-19T08:51:51.819783+0000","last_fullsized":"2024-09-19T08:51:51.819783+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:33.198852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":134,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:10.113581+0000","last_change":"2024-09-19T08:50:13.800156+0000","last_active":"2024-09-19T08:52:10.113581+0000","last_peered":"2024-09-19T08:52:10.113581+0000","last_clean":"2024-09-19T08:52:10.113581+0000","last_became_active":"2024-09-19T08:50:13.799779+0000","last_became_peered":"2024-09-19T08:50:13.799779+0000","last_unstale":"2024-09-19T08:52:10.113581+0000","last_undegraded":"2024-09-19T08:52:10.113581+0000","last_fullsized":"2024-09-19T08:52:10.113581+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:38.033049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.826996+0000","last_change":"2024-09-19T08:50:15.887252+0000","last_active":"2024-09-19T08:51:51.826996+0000","last_peered":"2024-09-19T08:51:51.826996+0000","last_clean":"2024-09-19T08:51:51.826996+0000","last_became_active":"2024-09-19T08:50:15.886899+0000","last_became_peered":"2024-09-19T08:50:15.886899+0000","last_unstale":"2024-09-19T08:51:51.826996+0000","last_undegraded":"2024-09-19T08:51:51.826996+0000","last_fullsized":"2024-09-19T08:51:51.826996+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:56.262387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.556154+0000","last_change":"2024-09-19T08:51:23.556154+0000","last_active":"2024-09-19T08:51:23.556154+0000","last_peered":"2024-09-19T08:51:23.556154+0000","last_clean":"2024-09-19T08:51:23.556154+0000","last_became_active":"2024-09-19T08:51:23.549418+0000","last_became_peered":"2024-09-19T08:51:23.549418+0000","last_unstale":"2024-09-19T08:51:23.556154+0000","last_undegraded":"2024-09-19T08:51:23.556154+0000","last_fullsized":"2024-09-19T08:51:23.556154+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:35.225465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.540195+0000","last_change":"2024-09-19T08:50:13.794010+0000","last_active":"2024-09-19T08:51:23.540195+0000","last_peered":"2024-09-19T08:51:23.540195+0000","last_clean":"2024-09-19T08:51:23.540195+0000","last_became_active":"2024-09-19T08:50:13.793677+0000","last_became_peered":"2024-09-19T08:50:13.793677+0000","last_unstale":"2024-09-19T08:51:23.540195+0000","last_undegraded":"2024-09-19T08:51:23.540195+0000","last_fullsized":"2024-09-19T08:51:23.540195+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:56.125702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827232+0000","last_change":"2024-09-19T08:50:15.881732+0000","last_active":"2024-09-19T08:51:51.827232+0000","last_peered":"2024-09-19T08:51:51.827232+0000","last_clean":"2024-09-19T08:51:51.827232+0000","last_became_active":"2024-09-19T08:50:15.881394+0000","last_became_peered":"2024-09-19T08:50:15.881394+0000","last_unstale":"2024-09-19T08:51:51.827232+0000","last_undegraded":"2024-09-19T08:51:51.827232+0000","last_fullsized":"2024-09-19T08:51:51.827232+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:55.549138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.544525+0000","last_change":"2024-09-19T08:50:13.797118+0000","last_active":"2024-09-19T08:51:23.544525+0000","last_peered":"2024-09-19T08:51:23.544525+0000","last_clean":"2024-09-19T08:51:23.544525+0000","last_became_active":"2024-09-19T08:50:13.796727+0000","last_became_peered":"2024-09-19T08:50:13.796727+0000","last_unstale":"2024-09-19T08:51:23.544525+0000","last_undegraded":"2024-09-19T08:51:23.544525+0000","last_fullsized":"2024-09-19T08:51:23.544525+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:49.310543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.824911+0000","last_change":"2024-09-19T08:50:15.888192+0000","last_active":"2024-09-19T08:51:51.824911+0000","last_peered":"2024-09-19T08:51:51.824911+0000","last_clean":"2024-09-19T08:51:51.824911+0000","last_became_active":"2024-09-19T08:50:15.887890+0000","last_became_peered":"2024-09-19T08:50:15.887890+0000","last_unstale":"2024-09-19T08:51:51.824911+0000","last_undegraded":"2024-09-19T08:51:51.824911+0000","last_fullsized":"2024-09-19T08:51:51.824911+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:24:48.951856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'5","reported_seq":229,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:08.080545+0000","last_change":"2024-09-19T08:50:13.797427+0000","last_active":"2024-09-19T08:52:08.080545+0000","last_peered":"2024-09-19T08:52:08.080545+0000","last_clean":"2024-09-19T08:52:08.080545+0000","last_became_active":"2024-09-19T08:50:13.797021+0000","last_became_peered":"2024-09-19T08:50:13.797021+0000","last_unstale":"2024-09-19T08:52:08.080545+0000","last_undegraded":"2024-09-19T08:52:08.080545+0000","last_fullsized":"2024-09-19T08:52:08.080545+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:14.530373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":202,"num_read_kb":202,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837299+0000","last_change":"2024-09-19T08:50:15.894619+0000","last_active":"2024-09-19T08:51:51.837299+0000","last_peered":"2024-09-19T08:51:51.837299+0000","last_clean":"2024-09-19T08:51:51.837299+0000","last_became_active":"2024-09-19T08:50:15.894258+0000","last_became_peered":"2024-09-19T08:50:15.894258+0000","last_unstale":"2024-09-19T08:51:51.837299+0000","last_undegraded":"2024-09-19T08:51:51.837299+0000","last_fullsized":"2024-09-19T08:51:51.837299+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:13.137314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.559196+0000","last_change":"2024-09-19T08:51:23.559196+0000","last_active":"2024-09-19T08:51:23.559196+0000","last_peered":"2024-09-19T08:51:23.559196+0000","last_clean":"2024-09-19T08:51:23.559196+0000","last_became_active":"2024-09-19T08:51:23.549412+0000","last_became_peered":"2024-09-19T08:51:23.549412+0000","last_unstale":"2024-09-19T08:51:23.559196+0000","last_undegraded":"2024-09-19T08:51:23.559196+0000","last_fullsized":"2024-09-19T08:51:23.559196+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:38.145697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837760+0000","last_change":"2024-09-19T08:50:15.891121+0000","last_active":"2024-09-19T08:51:51.837760+0000","last_peered":"2024-09-19T08:51:51.837760+0000","last_clean":"2024-09-19T08:51:51.837760+0000","last_became_active":"2024-09-19T08:50:15.890810+0000","last_became_peered":"2024-09-19T08:50:15.890810+0000","last_unstale":"2024-09-19T08:51:51.837760+0000","last_undegraded":"2024-09-19T08:51:51.837760+0000","last_fullsized":"2024-09-19T08:51:51.837760+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:13.010282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.545394+0000","last_change":"2024-09-19T08:50:14.293953+0000","last_active":"2024-09-19T08:51:23.545394+0000","last_peered":"2024-09-19T08:51:23.545394+0000","last_clean":"2024-09-19T08:51:23.545394+0000","last_became_active":"2024-09-19T08:50:14.293546+0000","last_became_peered":"2024-09-19T08:50:14.293546+0000","last_unstale":"2024-09-19T08:51:23.545394+0000","last_undegraded":"2024-09-19T08:51:23.545394+0000","last_fullsized":"2024-09-19T08:51:23.545394+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:27.809243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.836318+0000","last_change":"2024-09-19T08:50:15.878300+0000","last_active":"2024-09-19T08:51:51.836318+0000","last_peered":"2024-09-19T08:51:51.836318+0000","last_clean":"2024-09-19T08:51:51.836318+0000","last_became_active":"2024-09-19T08:50:15.877938+0000","last_became_peered":"2024-09-19T08:50:15.877938+0000","last_unstale":"2024-09-19T08:51:51.836318+0000","last_undegraded":"2024-09-19T08:51:51.836318+0000","last_fullsized":"2024-09-19T08:51:51.836318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:05.376708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'33","reported_seq":265,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:08.099933+0000","last_change":"2024-09-19T08:50:13.800696+0000","last_active":"2024-09-19T08:52:08.099933+0000","last_peered":"2024-09-19T08:52:08.099933+0000","last_clean":"2024-09-19T08:52:08.099933+0000","last_became_active":"2024-09-19T08:50:13.799385+0000","last_became_peered":"2024-09-19T08:50:13.799385+0000","last_unstale":"2024-09-19T08:52:08.099933+0000","last_undegraded":"2024-09-19T08:52:08.099933+0000","last_fullsized":"2024-09-19T08:52:08.099933+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:56.897309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59768,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":210,"num_read_kb":162,"num_write":35,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.820658+0000","last_change":"2024-09-19T08:50:15.891483+0000","last_active":"2024-09-19T08:51:51.820658+0000","last_peered":"2024-09-19T08:51:51.820658+0000","last_clean":"2024-09-19T08:51:51.820658+0000","last_became_active":"2024-09-19T08:50:15.891185+0000","last_became_peered":"2024-09-19T08:50:15.891185+0000","last_unstale":"2024-09-19T08:51:51.820658+0000","last_undegraded":"2024-09-19T08:51:51.820658+0000","last_fullsized":"2024-09-19T08:51:51.820658+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:26.599151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.548669+0000","last_change":"2024-09-19T08:50:13.795148+0000","last_active":"2024-09-19T08:51:23.548669+0000","last_peered":"2024-09-19T08:51:23.548669+0000","last_clean":"2024-09-19T08:51:23.548669+0000","last_became_active":"2024-09-19T08:50:13.794688+0000","last_became_peered":"2024-09-19T08:50:13.794688+0000","last_unstale":"2024-09-19T08:51:23.548669+0000","last_undegraded":"2024-09-19T08:51:23.548669+0000","last_fullsized":"2024-09-19T08:51:23.548669+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:01.366439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.832390+0000","last_change":"2024-09-19T08:50:15.886449+0000","last_active":"2024-09-19T08:51:51.832390+0000","last_peered":"2024-09-19T08:51:51.832390+0000","last_clean":"2024-09-19T08:51:51.832390+0000","last_became_active":"2024-09-19T08:50:15.886119+0000","last_became_peered":"2024-09-19T08:50:15.886119+0000","last_unstale":"2024-09-19T08:51:51.832390+0000","last_undegraded":"2024-09-19T08:51:51.832390+0000","last_fullsized":"2024-09-19T08:51:51.832390+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:22.916593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.544525+0000","last_change":"2024-09-19T08:50:13.799363+0000","last_active":"2024-09-19T08:51:23.544525+0000","last_peered":"2024-09-19T08:51:23.544525+0000","last_clean":"2024-09-19T08:51:23.544525+0000","last_became_active":"2024-09-19T08:50:13.799033+0000","last_became_peered":"2024-09-19T08:50:13.799033+0000","last_unstale":"2024-09-19T08:51:23.544525+0000","last_undegraded":"2024-09-19T08:51:23.544525+0000","last_fullsized":"2024-09-19T08:51:23.544525+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:57.753451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837083+0000","last_change":"2024-09-19T08:50:15.898902+0000","last_active":"2024-09-19T08:51:51.837083+0000","last_peered":"2024-09-19T08:51:51.837083+0000","last_clean":"2024-09-19T08:51:51.837083+0000","last_became_active":"2024-09-19T08:50:15.898417+0000","last_became_peered":"2024-09-19T08:50:15.898417+0000","last_unstale":"2024-09-19T08:51:51.837083+0000","last_undegraded":"2024-09-19T08:51:51.837083+0000","last_fullsized":"2024-09-19T08:51:51.837083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:32:19.799301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'7","reported_seq":133,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:06.078343+0000","last_change":"2024-09-19T08:50:13.798477+0000","last_active":"2024-09-19T08:52:06.078343+0000","last_peered":"2024-09-19T08:52:06.078343+0000","last_clean":"2024-09-19T08:52:06.078343+0000","last_became_active":"2024-09-19T08:50:13.798136+0000","last_became_peered":"2024-09-19T08:50:13.798136+0000","last_unstale":"2024-09-19T08:52:06.078343+0000","last_undegraded":"2024-09-19T08:52:06.078343+0000","last_fullsized":"2024-09-19T08:52:06.078343+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:33.874285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":105,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829630+0000","last_change":"2024-09-19T08:50:15.896414+0000","last_active":"2024-09-19T08:51:51.829630+0000","last_peered":"2024-09-19T08:51:51.829630+0000","last_clean":"2024-09-19T08:51:51.829630+0000","last_became_active":"2024-09-19T08:50:15.895530+0000","last_became_peered":"2024-09-19T08:50:15.895530+0000","last_unstale":"2024-09-19T08:51:51.829630+0000","last_undegraded":"2024-09-19T08:51:51.829630+0000","last_fullsized":"2024-09-19T08:51:51.829630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:59.717869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.545962+0000","last_change":"2024-09-19T08:50:14.294087+0000","last_active":"2024-09-19T08:51:23.545962+0000","last_peered":"2024-09-19T08:51:23.545962+0000","last_clean":"2024-09-19T08:51:23.545962+0000","last_became_active":"2024-09-19T08:50:14.293712+0000","last_became_peered":"2024-09-19T08:50:14.293712+0000","last_unstale":"2024-09-19T08:51:23.545962+0000","last_undegraded":"2024-09-19T08:51:23.545962+0000","last_fullsized":"2024-09-19T08:51:23.545962+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:12.187514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.835719+0000","last_change":"2024-09-19T08:50:15.888134+0000","last_active":"2024-09-19T08:51:51.835719+0000","last_peered":"2024-09-19T08:51:51.835719+0000","last_clean":"2024-09-19T08:51:51.835719+0000","last_became_active":"2024-09-19T08:50:15.887768+0000","last_became_peered":"2024-09-19T08:50:15.887768+0000","last_unstale":"2024-09-19T08:51:51.835719+0000","last_undegraded":"2024-09-19T08:51:51.835719+0000","last_fullsized":"2024-09-19T08:51:51.835719+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:12.868773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.547326+0000","last_change":"2024-09-19T08:50:13.792585+0000","last_active":"2024-09-19T08:51:23.547326+0000","last_peered":"2024-09-19T08:51:23.547326+0000","last_clean":"2024-09-19T08:51:23.547326+0000","last_became_active":"2024-09-19T08:50:13.792222+0000","last_became_peered":"2024-09-19T08:50:13.792222+0000","last_unstale":"2024-09-19T08:51:23.547326+0000","last_undegraded":"2024-09-19T08:51:23.547326+0000","last_fullsized":"2024-09-19T08:51:23.547326+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:45.234800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.818076+0000","last_change":"2024-09-19T08:51:23.549003+0000","last_active":"2024-09-19T08:51:51.818076+0000","last_peered":"2024-09-19T08:51:51.818076+0000","last_clean":"2024-09-19T08:51:51.818076+0000","last_became_active":"2024-09-19T08:51:23.548611+0000","last_became_peered":"2024-09-19T08:51:23.548611+0000","last_unstale":"2024-09-19T08:51:51.818076+0000","last_undegraded":"2024-09-19T08:51:51.818076+0000","last_fullsized":"2024-09-19T08:51:51.818076+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:00.043092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.540568+0000","last_change":"2024-09-19T08:50:13.795360+0000","last_active":"2024-09-19T08:51:23.540568+0000","last_peered":"2024-09-19T08:51:23.540568+0000","last_clean":"2024-09-19T08:51:23.540568+0000","last_became_active":"2024-09-19T08:50:13.794823+0000","last_became_peered":"2024-09-19T08:50:13.794823+0000","last_unstale":"2024-09-19T08:51:23.540568+0000","last_undegraded":"2024-09-19T08:51:23.540568+0000","last_fullsized":"2024-09-19T08:51:23.540568+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:15.037834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.822420+0000","last_change":"2024-09-19T08:50:15.893668+0000","last_active":"2024-09-19T08:51:51.822420+0000","last_peered":"2024-09-19T08:51:51.822420+0000","last_clean":"2024-09-19T08:51:51.822420+0000","last_became_active":"2024-09-19T08:50:15.893303+0000","last_became_peered":"2024-09-19T08:50:15.893303+0000","last_unstale":"2024-09-19T08:51:51.822420+0000","last_undegraded":"2024-09-19T08:51:51.822420+0000","last_fullsized":"2024-09-19T08:51:51.822420+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:59.281601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.545777+0000","last_change":"2024-09-19T08:50:13.797442+0000","last_active":"2024-09-19T08:51:23.545777+0000","last_peered":"2024-09-19T08:51:23.545777+0000","last_clean":"2024-09-19T08:51:23.545777+0000","last_became_active":"2024-09-19T08:50:13.797072+0000","last_became_peered":"2024-09-19T08:50:13.797072+0000","last_unstale":"2024-09-19T08:51:23.545777+0000","last_undegraded":"2024-09-19T08:51:23.545777+0000","last_fullsized":"2024-09-19T08:51:23.545777+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:32.960928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829292+0000","last_change":"2024-09-19T08:51:23.554271+0000","last_active":"2024-09-19T08:51:51.829292+0000","last_peered":"2024-09-19T08:51:51.829292+0000","last_clean":"2024-09-19T08:51:51.829292+0000","last_became_active":"2024-09-19T08:51:23.547630+0000","last_became_peered":"2024-09-19T08:51:23.547630+0000","last_unstale":"2024-09-19T08:51:51.829292+0000","last_undegraded":"2024-09-19T08:51:51.829292+0000","last_fullsized":"2024-09-19T08:51:51.829292+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:39.033522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'7","reported_seq":136,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:09.082570+0000","last_change":"2024-09-19T08:50:14.294014+0000","last_active":"2024-09-19T08:52:09.082570+0000","last_peered":"2024-09-19T08:52:09.082570+0000","last_clean":"2024-09-19T08:52:09.082570+0000","last_became_active":"2024-09-19T08:50:14.293564+0000","last_became_peered":"2024-09-19T08:50:14.293564+0000","last_unstale":"2024-09-19T08:52:09.082570+0000","last_undegraded":"2024-09-19T08:52:09.082570+0000","last_fullsized":"2024-09-19T08:52:09.082570+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:23.806408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1704,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.834993+0000","last_change":"2024-09-19T08:50:15.891840+0000","last_active":"2024-09-19T08:51:51.834993+0000","last_peered":"2024-09-19T08:51:51.834993+0000","last_clean":"2024-09-19T08:51:51.834993+0000","last_became_active":"2024-09-19T08:50:15.891511+0000","last_became_peered":"2024-09-19T08:50:15.891511+0000","last_unstale":"2024-09-19T08:51:51.834993+0000","last_undegraded":"2024-09-19T08:51:51.834993+0000","last_fullsized":"2024-09-19T08:51:51.834993+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:26.800508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":332,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.545171+0000","last_change":"2024-09-19T08:49:02.071497+0000","last_active":"2024-09-19T08:51:23.545171+0000","last_peered":"2024-09-19T08:51:23.545171+0000","last_clean":"2024-09-19T08:51:23.545171+0000","last_became_active":"2024-09-19T08:49:02.071114+0000","last_became_peered":"2024-09-19T08:49:02.071114+0000","last_unstale":"2024-09-19T08:51:23.545171+0000","last_undegraded":"2024-09-19T08:51:23.545171+0000","last_fullsized":"2024-09-19T08:51:23.545171+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:45:36.600595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:45:36.600595+0000","last_clean_scrub_stamp":"2024-09-19T08:45:36.600595+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:18:15.369279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.541800+0000","last_change":"2024-09-19T08:50:13.793981+0000","last_active":"2024-09-19T08:51:23.541800+0000","last_peered":"2024-09-19T08:51:23.541800+0000","last_clean":"2024-09-19T08:51:23.541800+0000","last_became_active":"2024-09-19T08:50:13.793616+0000","last_became_peered":"2024-09-19T08:50:13.793616+0000","last_unstale":"2024-09-19T08:51:23.541800+0000","last_undegraded":"2024-09-19T08:51:23.541800+0000","last_fullsized":"2024-09-19T08:51:23.541800+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:45.195906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.828840+0000","last_change":"2024-09-19T08:50:15.891248+0000","last_active":"2024-09-19T08:51:51.828840+0000","last_peered":"2024-09-19T08:51:51.828840+0000","last_clean":"2024-09-19T08:51:51.828840+0000","last_became_active":"2024-09-19T08:50:15.890922+0000","last_became_peered":"2024-09-19T08:50:15.890922+0000","last_unstale":"2024-09-19T08:51:51.828840+0000","last_undegraded":"2024-09-19T08:51:51.828840+0000","last_fullsized":"2024-09-19T08:51:51.828840+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:18:43.914214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.545014+0000","last_change":"2024-09-19T08:50:13.797471+0000","last_active":"2024-09-19T08:51:23.545014+0000","last_peered":"2024-09-19T08:51:23.545014+0000","last_clean":"2024-09-19T08:51:23.545014+0000","last_became_active":"2024-09-19T08:50:13.797033+0000","last_became_peered":"2024-09-19T08:50:13.797033+0000","last_unstale":"2024-09-19T08:51:23.545014+0000","last_undegraded":"2024-09-19T08:51:23.545014+0000","last_fullsized":"2024-09-19T08:51:23.545014+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:53.141708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.821571+0000","last_change":"2024-09-19T08:50:15.882650+0000","last_active":"2024-09-19T08:51:51.821571+0000","last_peered":"2024-09-19T08:51:51.821571+0000","last_clean":"2024-09-19T08:51:51.821571+0000","last_became_active":"2024-09-19T08:50:15.882308+0000","last_became_peered":"2024-09-19T08:50:15.882308+0000","last_unstale":"2024-09-19T08:51:51.821571+0000","last_undegraded":"2024-09-19T08:51:51.821571+0000","last_fullsized":"2024-09-19T08:51:51.821571+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:26.449562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'7","reported_seq":133,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:09.081631+0000","last_change":"2024-09-19T08:50:14.292466+0000","last_active":"2024-09-19T08:52:09.081631+0000","last_peered":"2024-09-19T08:52:09.081631+0000","last_clean":"2024-09-19T08:52:09.081631+0000","last_became_active":"2024-09-19T08:50:14.292092+0000","last_became_peered":"2024-09-19T08:50:14.292092+0000","last_unstale":"2024-09-19T08:52:09.081631+0000","last_undegraded":"2024-09-19T08:52:09.081631+0000","last_fullsized":"2024-09-19T08:52:09.081631+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:11.373226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.825695+0000","last_change":"2024-09-19T08:51:23.551606+0000","last_active":"2024-09-19T08:51:51.825695+0000","last_peered":"2024-09-19T08:51:51.825695+0000","last_clean":"2024-09-19T08:51:51.825695+0000","last_became_active":"2024-09-19T08:51:23.551181+0000","last_became_peered":"2024-09-19T08:51:23.551181+0000","last_unstale":"2024-09-19T08:51:51.825695+0000","last_undegraded":"2024-09-19T08:51:51.825695+0000","last_fullsized":"2024-09-19T08:51:51.825695+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:05.577651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'6","reported_seq":133,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:10.612221+0000","last_change":"2024-09-19T08:50:13.799909+0000","last_active":"2024-09-19T08:52:10.612221+0000","last_peered":"2024-09-19T08:52:10.612221+0000","last_clean":"2024-09-19T08:52:10.612221+0000","last_became_active":"2024-09-19T08:50:13.799542+0000","last_became_peered":"2024-09-19T08:50:13.799542+0000","last_unstale":"2024-09-19T08:52:10.612221+0000","last_undegraded":"2024-09-19T08:52:10.612221+0000","last_fullsized":"2024-09-19T08:52:10.612221+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:23.545897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837020+0000","last_change":"2024-09-19T08:51:24.482934+0000","last_active":"2024-09-19T08:51:51.837020+0000","last_peered":"2024-09-19T08:51:51.837020+0000","last_clean":"2024-09-19T08:51:51.837020+0000","last_became_active":"2024-09-19T08:51:24.482586+0000","last_became_peered":"2024-09-19T08:51:24.482586+0000","last_unstale":"2024-09-19T08:51:51.837020+0000","last_undegraded":"2024-09-19T08:51:51.837020+0000","last_fullsized":"2024-09-19T08:51:51.837020+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:15.121449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.543078+0000","last_change":"2024-09-19T08:50:14.292577+0000","last_active":"2024-09-19T08:51:23.543078+0000","last_peered":"2024-09-19T08:51:23.543078+0000","last_clean":"2024-09-19T08:51:23.543078+0000","last_became_active":"2024-09-19T08:50:14.292220+0000","last_became_peered":"2024-09-19T08:50:14.292220+0000","last_unstale":"2024-09-19T08:51:23.543078+0000","last_undegraded":"2024-09-19T08:51:23.543078+0000","last_fullsized":"2024-09-19T08:51:23.543078+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:23.631672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827650+0000","last_change":"2024-09-19T08:50:15.891345+0000","last_active":"2024-09-19T08:51:51.827650+0000","last_peered":"2024-09-19T08:51:51.827650+0000","last_clean":"2024-09-19T08:51:51.827650+0000","last_became_active":"2024-09-19T08:50:15.891006+0000","last_became_peered":"2024-09-19T08:50:15.891006+0000","last_unstale":"2024-09-19T08:51:51.827650+0000","last_undegraded":"2024-09-19T08:51:51.827650+0000","last_fullsized":"2024-09-19T08:51:51.827650+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:41.934331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.546914+0000","last_change":"2024-09-19T08:50:14.292619+0000","last_active":"2024-09-19T08:51:23.546914+0000","last_peered":"2024-09-19T08:51:23.546914+0000","last_clean":"2024-09-19T08:51:23.546914+0000","last_became_active":"2024-09-19T08:50:14.292230+0000","last_became_peered":"2024-09-19T08:50:14.292230+0000","last_unstale":"2024-09-19T08:51:23.546914+0000","last_undegraded":"2024-09-19T08:51:23.546914+0000","last_fullsized":"2024-09-19T08:51:23.546914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:21:33.076142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.824332+0000","last_change":"2024-09-19T08:50:15.882760+0000","last_active":"2024-09-19T08:51:51.824332+0000","last_peered":"2024-09-19T08:51:51.824332+0000","last_clean":"2024-09-19T08:51:51.824332+0000","last_became_active":"2024-09-19T08:50:15.882402+0000","last_became_peered":"2024-09-19T08:50:15.882402+0000","last_unstale":"2024-09-19T08:51:51.824332+0000","last_undegraded":"2024-09-19T08:51:51.824332+0000","last_fullsized":"2024-09-19T08:51:51.824332+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:17.343385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'16","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.543435+0000","last_change":"2024-09-19T08:50:13.790982+0000","last_active":"2024-09-19T08:51:23.543435+0000","last_peered":"2024-09-19T08:51:23.543435+0000","last_clean":"2024-09-19T08:51:23.543435+0000","last_became_active":"2024-09-19T08:50:13.790644+0000","last_became_peered":"2024-09-19T08:50:13.790644+0000","last_unstale":"2024-09-19T08:51:23.543435+0000","last_undegraded":"2024-09-19T08:51:23.543435+0000","last_fullsized":"2024-09-19T08:51:23.543435+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:20:25.923021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827049+0000","last_change":"2024-09-19T08:50:15.887556+0000","last_active":"2024-09-19T08:51:51.827049+0000","last_peered":"2024-09-19T08:51:51.827049+0000","last_clean":"2024-09-19T08:51:51.827049+0000","last_became_active":"2024-09-19T08:50:15.887280+0000","last_became_peered":"2024-09-19T08:50:15.887280+0000","last_unstale":"2024-09-19T08:51:51.827049+0000","last_undegraded":"2024-09-19T08:51:51.827049+0000","last_fullsized":"2024-09-19T08:51:51.827049+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:51.226527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.541910+0000","last_change":"2024-09-19T08:50:14.012150+0000","last_active":"2024-09-19T08:51:23.541910+0000","last_peered":"2024-09-19T08:51:23.541910+0000","last_clean":"2024-09-19T08:51:23.541910+0000","last_became_active":"2024-09-19T08:50:14.011799+0000","last_became_peered":"2024-09-19T08:50:14.011799+0000","last_unstale":"2024-09-19T08:51:23.541910+0000","last_undegraded":"2024-09-19T08:51:23.541910+0000","last_fullsized":"2024-09-19T08:51:23.541910+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:37.310539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837525+0000","last_change":"2024-09-19T08:50:15.889577+0000","last_active":"2024-09-19T08:51:51.837525+0000","last_peered":"2024-09-19T08:51:51.837525+0000","last_clean":"2024-09-19T08:51:51.837525+0000","last_became_active":"2024-09-19T08:50:15.889244+0000","last_became_peered":"2024-09-19T08:50:15.889244+0000","last_unstale":"2024-09-19T08:51:51.837525+0000","last_undegraded":"2024-09-19T08:51:51.837525+0000","last_fullsized":"2024-09-19T08:51:51.837525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:54.382221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.548456+0000","last_change":"2024-09-19T08:50:14.293845+0000","last_active":"2024-09-19T08:51:23.548456+0000","last_peered":"2024-09-19T08:51:23.548456+0000","last_clean":"2024-09-19T08:51:23.548456+0000","last_became_active":"2024-09-19T08:50:14.293585+0000","last_became_peered":"2024-09-19T08:50:14.293585+0000","last_unstale":"2024-09-19T08:51:23.548456+0000","last_undegraded":"2024-09-19T08:51:23.548456+0000","last_fullsized":"2024-09-19T08:51:23.548456+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:02.886475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.794304+0000","last_change":"2024-09-19T08:50:15.888591+0000","last_active":"2024-09-19T08:51:51.794304+0000","last_peered":"2024-09-19T08:51:51.794304+0000","last_clean":"2024-09-19T08:51:51.794304+0000","last_became_active":"2024-09-19T08:50:15.888270+0000","last_became_peered":"2024-09-19T08:50:15.888270+0000","last_unstale":"2024-09-19T08:51:51.794304+0000","last_undegraded":"2024-09-19T08:51:51.794304+0000","last_fullsized":"2024-09-19T08:51:51.794304+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:08.644828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.547015+0000","last_change":"2024-09-19T08:50:13.794081+0000","last_active":"2024-09-19T08:51:23.547015+0000","last_peered":"2024-09-19T08:51:23.547015+0000","last_clean":"2024-09-19T08:51:23.547015+0000","last_became_active":"2024-09-19T08:50:13.793770+0000","last_became_peered":"2024-09-19T08:50:13.793770+0000","last_unstale":"2024-09-19T08:51:23.547015+0000","last_undegraded":"2024-09-19T08:51:23.547015+0000","last_fullsized":"2024-09-19T08:51:23.547015+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:43.053893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.835489+0000","last_change":"2024-09-19T08:50:15.885338+0000","last_active":"2024-09-19T08:51:51.835489+0000","last_peered":"2024-09-19T08:51:51.835489+0000","last_clean":"2024-09-19T08:51:51.835489+0000","last_became_active":"2024-09-19T08:50:15.884983+0000","last_became_peered":"2024-09-19T08:50:15.884983+0000","last_unstale":"2024-09-19T08:51:51.835489+0000","last_undegraded":"2024-09-19T08:51:51.835489+0000","last_fullsized":"2024-09-19T08:51:51.835489+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:05.228871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.563104+0000","last_change":"2024-09-19T08:51:23.562670+0000","last_active":"2024-09-19T08:51:23.563104+0000","last_peered":"2024-09-19T08:51:23.563104+0000","last_clean":"2024-09-19T08:51:23.563104+0000","last_became_active":"2024-09-19T08:51:23.548756+0000","last_became_peered":"2024-09-19T08:51:23.548756+0000","last_unstale":"2024-09-19T08:51:23.563104+0000","last_undegraded":"2024-09-19T08:51:23.563104+0000","last_fullsized":"2024-09-19T08:51:23.563104+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:36.666216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829262+0000","last_change":"2024-09-19T08:50:15.886587+0000","last_active":"2024-09-19T08:51:51.829262+0000","last_peered":"2024-09-19T08:51:51.829262+0000","last_clean":"2024-09-19T08:51:51.829262+0000","last_became_active":"2024-09-19T08:50:15.886231+0000","last_became_peered":"2024-09-19T08:50:15.886231+0000","last_unstale":"2024-09-19T08:51:51.829262+0000","last_undegraded":"2024-09-19T08:51:51.829262+0000","last_fullsized":"2024-09-19T08:51:51.829262+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:11.965382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.546412+0000","last_change":"2024-09-19T08:50:13.796681+0000","last_active":"2024-09-19T08:51:23.546412+0000","last_peered":"2024-09-19T08:51:23.546412+0000","last_clean":"2024-09-19T08:51:23.546412+0000","last_became_active":"2024-09-19T08:50:13.796338+0000","last_became_peered":"2024-09-19T08:50:13.796338+0000","last_unstale":"2024-09-19T08:51:23.546412+0000","last_undegraded":"2024-09-19T08:51:23.546412+0000","last_fullsized":"2024-09-19T08:51:23.546412+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:32.588800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.836422+0000","last_change":"2024-09-19T08:50:15.889667+0000","last_active":"2024-09-19T08:51:51.836422+0000","last_peered":"2024-09-19T08:51:51.836422+0000","last_clean":"2024-09-19T08:51:51.836422+0000","last_became_active":"2024-09-19T08:50:15.889341+0000","last_became_peered":"2024-09-19T08:50:15.889341+0000","last_unstale":"2024-09-19T08:51:51.836422+0000","last_undegraded":"2024-09-19T08:51:51.836422+0000","last_fullsized":"2024-09-19T08:51:51.836422+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:13.255483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.836199+0000","last_change":"2024-09-19T08:50:15.887337+0000","last_active":"2024-09-19T08:51:51.836199+0000","last_peered":"2024-09-19T08:51:51.836199+0000","last_clean":"2024-09-19T08:51:51.836199+0000","last_became_active":"2024-09-19T08:50:15.887001+0000","last_became_peered":"2024-09-19T08:50:15.887001+0000","last_unstale":"2024-09-19T08:51:51.836199+0000","last_undegraded":"2024-09-19T08:51:51.836199+0000","last_fullsized":"2024-09-19T08:51:51.836199+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:43.544863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.547132+0000","last_change":"2024-09-19T08:50:13.799321+0000","last_active":"2024-09-19T08:51:23.547132+0000","last_peered":"2024-09-19T08:51:23.547132+0000","last_clean":"2024-09-19T08:51:23.547132+0000","last_became_active":"2024-09-19T08:50:13.798837+0000","last_became_peered":"2024-09-19T08:50:13.798837+0000","last_unstale":"2024-09-19T08:51:23.547132+0000","last_undegraded":"2024-09-19T08:51:23.547132+0000","last_fullsized":"2024-09-19T08:51:23.547132+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:35.753093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837309+0000","last_change":"2024-09-19T08:50:15.892074+0000","last_active":"2024-09-19T08:51:51.837309+0000","last_peered":"2024-09-19T08:51:51.837309+0000","last_clean":"2024-09-19T08:51:51.837309+0000","last_became_active":"2024-09-19T08:50:15.891722+0000","last_became_peered":"2024-09-19T08:50:15.891722+0000","last_unstale":"2024-09-19T08:51:51.837309+0000","last_undegraded":"2024-09-19T08:51:51.837309+0000","last_fullsized":"2024-09-19T08:51:51.837309+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:39.913080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.546815+0000","last_change":"2024-09-19T08:50:13.795577+0000","last_active":"2024-09-19T08:51:23.546815+0000","last_peered":"2024-09-19T08:51:23.546815+0000","last_clean":"2024-09-19T08:51:23.546815+0000","last_became_active":"2024-09-19T08:50:13.795254+0000","last_became_peered":"2024-09-19T08:50:13.795254+0000","last_unstale":"2024-09-19T08:51:23.546815+0000","last_undegraded":"2024-09-19T08:51:23.546815+0000","last_fullsized":"2024-09-19T08:51:23.546815+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:13.263447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.836430+0000","last_change":"2024-09-19T08:50:15.884584+0000","last_active":"2024-09-19T08:51:51.836430+0000","last_peered":"2024-09-19T08:51:51.836430+0000","last_clean":"2024-09-19T08:51:51.836430+0000","last_became_active":"2024-09-19T08:50:15.884244+0000","last_became_peered":"2024-09-19T08:50:15.884244+0000","last_unstale":"2024-09-19T08:51:51.836430+0000","last_undegraded":"2024-09-19T08:51:51.836430+0000","last_fullsized":"2024-09-19T08:51:51.836430+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:58.835351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.547216+0000","last_change":"2024-09-19T08:50:14.294210+0000","last_active":"2024-09-19T08:51:23.547216+0000","last_peered":"2024-09-19T08:51:23.547216+0000","last_clean":"2024-09-19T08:51:23.547216+0000","last_became_active":"2024-09-19T08:50:14.293850+0000","last_became_peered":"2024-09-19T08:50:14.293850+0000","last_unstale":"2024-09-19T08:51:23.547216+0000","last_undegraded":"2024-09-19T08:51:23.547216+0000","last_fullsized":"2024-09-19T08:51:23.547216+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:42:44.340766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829139+0000","last_change":"2024-09-19T08:50:15.892934+0000","last_active":"2024-09-19T08:51:51.829139+0000","last_peered":"2024-09-19T08:51:51.829139+0000","last_clean":"2024-09-19T08:51:51.829139+0000","last_became_active":"2024-09-19T08:50:15.892309+0000","last_became_peered":"2024-09-19T08:50:15.892309+0000","last_unstale":"2024-09-19T08:51:51.829139+0000","last_undegraded":"2024-09-19T08:51:51.829139+0000","last_fullsized":"2024-09-19T08:51:51.829139+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:40.158724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":157,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:07.607766+0000","last_change":"2024-09-19T08:51:23.559819+0000","last_active":"2024-09-19T08:52:07.607766+0000","last_peered":"2024-09-19T08:52:07.607766+0000","last_clean":"2024-09-19T08:52:07.607766+0000","last_became_active":"2024-09-19T08:51:23.548481+0000","last_became_peered":"2024-09-19T08:51:23.548481+0000","last_unstale":"2024-09-19T08:52:07.607766+0000","last_undegraded":"2024-09-19T08:52:07.607766+0000","last_fullsized":"2024-09-19T08:52:07.607766+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:53.232542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":97,"num_read_kb":97,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68044,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1056,"num_read_kb":599,"num_write":255,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":216673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":247642,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579941,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":434558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808873,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1052672,"data_stored":1084375,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972399,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":925696,"data_stored":433399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201332,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":433660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430265,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":1027136,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593791,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":433392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822723,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":983040,"data_stored":1025465,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953542,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":433394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182477,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":432707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":494434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":499839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":434872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34206,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34206,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":67679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":68433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:52:13.520 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T08:52:13.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.660+0000 7f70f34e6640 1 -- 172.21.15.19:0/1002952363 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70ec100a30 msgr2=0x7f70ec100e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:13.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.660+0000 7f70f34e6640 1 --2- 172.21.15.19:0/1002952363 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70ec100a30 0x7f70ec100e30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f70e8009900 tx=0x7f70e802a410 comp rx=0 tx=0).stop 2024-09-19T08:52:13.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.660+0000 7f70f34e6640 1 -- 172.21.15.19:0/1002952363 shutdown_connections 2024-09-19T08:52:13.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.660+0000 7f70f34e6640 1 --2- 172.21.15.19:0/1002952363 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70ec1025e0 0x7f70ec108e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:13.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.660+0000 7f70f34e6640 1 --2- 172.21.15.19:0/1002952363 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70ec101c20 0x7f70ec1020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:13.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.660+0000 7f70f34e6640 1 --2- 172.21.15.19:0/1002952363 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70ec100a30 0x7f70ec100e30 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:13.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.660+0000 7f70f34e6640 1 -- 172.21.15.19:0/1002952363 >> 172.21.15.19:0/1002952363 conn(0x7f70ec0fc1b0 msgr2=0x7f70ec0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:13.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.660+0000 7f70f34e6640 1 -- 172.21.15.19:0/1002952363 shutdown_connections 2024-09-19T08:52:13.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.660+0000 7f70f34e6640 1 -- 172.21.15.19:0/1002952363 wait complete. 2024-09-19T08:52:13.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.660+0000 7f70f34e6640 1 Processor -- start 2024-09-19T08:52:13.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.660+0000 7f70f34e6640 1 -- start start 2024-09-19T08:52:13.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.661+0000 7f70f34e6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70ec100a30 0x7f70ec06af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:13.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.661+0000 7f70f34e6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70ec101c20 0x7f70ec19cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:13.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.661+0000 7f70f34e6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70ec1025e0 0x7f70ec19f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:13.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.661+0000 7f70f34e6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f70ec10c780 con 0x7f70ec100a30 2024-09-19T08:52:13.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.661+0000 7f70f34e6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f70ec10c600 con 0x7f70ec101c20 2024-09-19T08:52:13.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.661+0000 7f70f34e6640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f70ec10c900 con 0x7f70ec1025e0 2024-09-19T08:52:13.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.661+0000 7f70f1282640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70ec100a30 0x7f70ec06af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:13.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.661+0000 7f70f1282640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70ec100a30 0x7f70ec06af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50930/0 (socket says 172.21.15.19:50930) 2024-09-19T08:52:13.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.661+0000 7f70f1282640 1 -- 172.21.15.19:0/170137357 learned_addr learned my addr 172.21.15.19:0/170137357 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:13.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.661+0000 7f70f0a81640 1 --2- 172.21.15.19:0/170137357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70ec101c20 0x7f70ec19cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:13.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.661+0000 7f70f1282640 1 -- 172.21.15.19:0/170137357 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70ec1025e0 msgr2=0x7f70ec19f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:13.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.661+0000 7f70f1282640 1 --2- 172.21.15.19:0/170137357 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70ec1025e0 0x7f70ec19f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:13.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.661+0000 7f70f1282640 1 -- 172.21.15.19:0/170137357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70ec101c20 msgr2=0x7f70ec19cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:13.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.661+0000 7f70f1282640 1 --2- 172.21.15.19:0/170137357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70ec101c20 0x7f70ec19cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:13.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.661+0000 7f70f1282640 1 -- 172.21.15.19:0/170137357 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70ec19fb80 con 0x7f70ec100a30 2024-09-19T08:52:13.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.661+0000 7f70f1282640 1 --2- 172.21.15.19:0/170137357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70ec100a30 0x7f70ec06af30 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f70e8031440 tx=0x7f70e8032cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:13.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.661+0000 7f70de7fc640 1 -- 172.21.15.19:0/170137357 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e803f030 con 0x7f70ec100a30 2024-09-19T08:52:13.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.661+0000 7f70de7fc640 1 -- 172.21.15.19:0/170137357 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f70e8003ce0 con 0x7f70ec100a30 2024-09-19T08:52:13.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.661+0000 7f70f34e6640 1 -- 172.21.15.19:0/170137357 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70ec19fdb0 con 0x7f70ec100a30 2024-09-19T08:52:13.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.661+0000 7f70de7fc640 1 -- 172.21.15.19:0/170137357 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e8035070 con 0x7f70ec100a30 2024-09-19T08:52:13.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.662+0000 7f70f34e6640 1 -- 172.21.15.19:0/170137357 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70ec1a02e0 con 0x7f70ec100a30 2024-09-19T08:52:13.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.662+0000 7f70f34e6640 1 -- 172.21.15.19:0/170137357 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70ec107e20 con 0x7f70ec100a30 2024-09-19T08:52:13.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.664+0000 7f70de7fc640 1 -- 172.21.15.19:0/170137357 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f70e8042030 con 0x7f70ec100a30 2024-09-19T08:52:13.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.664+0000 7f70de7fc640 1 --2- 172.21.15.19:0/170137357 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f70d80a3360 0x7f70d80a5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:13.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.664+0000 7f70f0a81640 1 --2- 172.21.15.19:0/170137357 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f70d80a3360 0x7f70d80a5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:13.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.664+0000 7f70de7fc640 1 -- 172.21.15.19:0/170137357 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f70e80f0450 con 0x7f70ec100a30 2024-09-19T08:52:13.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.665+0000 7f70f0a81640 1 --2- 172.21.15.19:0/170137357 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f70d80a3360 0x7f70d80a5820 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f70e0005fd0 tx=0x7f70e0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:13.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.667+0000 7f70de7fc640 1 -- 172.21.15.19:0/170137357 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f70e80bd140 con 0x7f70ec100a30 2024-09-19T08:52:13.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:13 smithi019 ceph-mon[30976]: pgmap v337: 97 pgs: 97 active+clean; 643 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-19T08:52:13.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:13 smithi019 ceph-mon[30976]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-19T08:52:13.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.843+0000 7f70f34e6640 1 -- 172.21.15.19:0/170137357 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f70ec062630 con 0x7f70d80a3360 2024-09-19T08:52:13.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.849+0000 7f70de7fc640 1 -- 172.21.15.19:0/170137357 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259035 (secure 0 0 0) 0x7f70ec062630 con 0x7f70d80a3360 2024-09-19T08:52:13.853 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:52:13.854 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-19T08:52:13.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.852+0000 7f70f34e6640 1 -- 172.21.15.19:0/170137357 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f70d80a3360 msgr2=0x7f70d80a5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:13.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.852+0000 7f70f34e6640 1 --2- 172.21.15.19:0/170137357 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f70d80a3360 0x7f70d80a5820 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f70e0005fd0 tx=0x7f70e0005850 comp rx=0 tx=0).stop 2024-09-19T08:52:13.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.852+0000 7f70f34e6640 1 -- 172.21.15.19:0/170137357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70ec100a30 msgr2=0x7f70ec06af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:13.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.852+0000 7f70f34e6640 1 --2- 172.21.15.19:0/170137357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70ec100a30 0x7f70ec06af30 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f70e8031440 tx=0x7f70e8032cc0 comp rx=0 tx=0).stop 2024-09-19T08:52:13.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.852+0000 7f70f34e6640 1 -- 172.21.15.19:0/170137357 shutdown_connections 2024-09-19T08:52:13.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.852+0000 7f70f34e6640 1 --2- 172.21.15.19:0/170137357 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f70d80a3360 0x7f70d80a5820 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:13.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.852+0000 7f70f34e6640 1 --2- 172.21.15.19:0/170137357 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f70ec1025e0 0x7f70ec19f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:13.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.852+0000 7f70f34e6640 1 --2- 172.21.15.19:0/170137357 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f70ec101c20 0x7f70ec19cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:13.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.852+0000 7f70f34e6640 1 --2- 172.21.15.19:0/170137357 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f70ec100a30 0x7f70ec06af30 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:13.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.852+0000 7f70f34e6640 1 -- 172.21.15.19:0/170137357 >> 172.21.15.19:0/170137357 conn(0x7f70ec0fc1b0 msgr2=0x7f70ec104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:13.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.852+0000 7f70f34e6640 1 -- 172.21.15.19:0/170137357 shutdown_connections 2024-09-19T08:52:13.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:13.852+0000 7f70f34e6640 1 -- 172.21.15.19:0/170137357 wait complete. 2024-09-19T08:52:13.863 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":337,"stamp":"2024-09-19T08:52:11.874832+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658646,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1182,"num_read_kb":708,"num_write":438,"num_write_kb":3084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1181525,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":859,"ondisk_log_size":859,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":356180,"kb_used_data":11092,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585644,"statfs":{"total":1151940427776,"available":1151575699456,"internally_reserved":0,"allocated":11358208,"data_stored":7167231,"data_compressed":107538,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19142,"internal_metadata":353154362},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1094,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":57,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002775"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837586+0000","last_change":"2024-09-19T08:50:15.893270+0000","last_active":"2024-09-19T08:51:51.837586+0000","last_peered":"2024-09-19T08:51:51.837586+0000","last_clean":"2024-09-19T08:51:51.837586+0000","last_became_active":"2024-09-19T08:50:15.892020+0000","last_became_peered":"2024-09-19T08:50:15.892020+0000","last_unstale":"2024-09-19T08:51:51.837586+0000","last_undegraded":"2024-09-19T08:51:51.837586+0000","last_fullsized":"2024-09-19T08:51:51.837586+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:40.846708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.834475+0000","last_change":"2024-09-19T08:50:15.889331+0000","last_active":"2024-09-19T08:51:51.834475+0000","last_peered":"2024-09-19T08:51:51.834475+0000","last_clean":"2024-09-19T08:51:51.834475+0000","last_became_active":"2024-09-19T08:50:15.887082+0000","last_became_peered":"2024-09-19T08:50:15.887082+0000","last_unstale":"2024-09-19T08:51:51.834475+0000","last_undegraded":"2024-09-19T08:51:51.834475+0000","last_fullsized":"2024-09-19T08:51:51.834475+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:46.934172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.836646+0000","last_change":"2024-09-19T08:50:15.891714+0000","last_active":"2024-09-19T08:51:51.836646+0000","last_peered":"2024-09-19T08:51:51.836646+0000","last_clean":"2024-09-19T08:51:51.836646+0000","last_became_active":"2024-09-19T08:50:15.891380+0000","last_became_peered":"2024-09-19T08:50:15.891380+0000","last_unstale":"2024-09-19T08:51:51.836646+0000","last_undegraded":"2024-09-19T08:51:51.836646+0000","last_fullsized":"2024-09-19T08:51:51.836646+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:02.203252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.820657+0000","last_change":"2024-09-19T08:50:15.896157+0000","last_active":"2024-09-19T08:51:51.820657+0000","last_peered":"2024-09-19T08:51:51.820657+0000","last_clean":"2024-09-19T08:51:51.820657+0000","last_became_active":"2024-09-19T08:50:15.895772+0000","last_became_peered":"2024-09-19T08:50:15.895772+0000","last_unstale":"2024-09-19T08:51:51.820657+0000","last_undegraded":"2024-09-19T08:51:51.820657+0000","last_fullsized":"2024-09-19T08:51:51.820657+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:12.915745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.819392+0000","last_change":"2024-09-19T08:50:15.886600+0000","last_active":"2024-09-19T08:51:51.819392+0000","last_peered":"2024-09-19T08:51:51.819392+0000","last_clean":"2024-09-19T08:51:51.819392+0000","last_became_active":"2024-09-19T08:50:15.886270+0000","last_became_peered":"2024-09-19T08:50:15.886270+0000","last_unstale":"2024-09-19T08:51:51.819392+0000","last_undegraded":"2024-09-19T08:51:51.819392+0000","last_fullsized":"2024-09-19T08:51:51.819392+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:53.779930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.826597+0000","last_change":"2024-09-19T08:50:15.889475+0000","last_active":"2024-09-19T08:51:51.826597+0000","last_peered":"2024-09-19T08:51:51.826597+0000","last_clean":"2024-09-19T08:51:51.826597+0000","last_became_active":"2024-09-19T08:50:15.889134+0000","last_became_peered":"2024-09-19T08:50:15.889134+0000","last_unstale":"2024-09-19T08:51:51.826597+0000","last_undegraded":"2024-09-19T08:51:51.826597+0000","last_fullsized":"2024-09-19T08:51:51.826597+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:53.977662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829681+0000","last_change":"2024-09-19T08:50:15.897163+0000","last_active":"2024-09-19T08:51:51.829681+0000","last_peered":"2024-09-19T08:51:51.829681+0000","last_clean":"2024-09-19T08:51:51.829681+0000","last_became_active":"2024-09-19T08:50:15.895161+0000","last_became_peered":"2024-09-19T08:50:15.895161+0000","last_unstale":"2024-09-19T08:51:51.829681+0000","last_undegraded":"2024-09-19T08:51:51.829681+0000","last_fullsized":"2024-09-19T08:51:51.829681+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:32.432691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829477+0000","last_change":"2024-09-19T08:50:15.891197+0000","last_active":"2024-09-19T08:51:51.829477+0000","last_peered":"2024-09-19T08:51:51.829477+0000","last_clean":"2024-09-19T08:51:51.829477+0000","last_became_active":"2024-09-19T08:50:15.890880+0000","last_became_peered":"2024-09-19T08:50:15.890880+0000","last_unstale":"2024-09-19T08:51:51.829477+0000","last_undegraded":"2024-09-19T08:51:51.829477+0000","last_fullsized":"2024-09-19T08:51:51.829477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:41.100341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.836501+0000","last_change":"2024-09-19T08:50:15.896043+0000","last_active":"2024-09-19T08:51:51.836501+0000","last_peered":"2024-09-19T08:51:51.836501+0000","last_clean":"2024-09-19T08:51:51.836501+0000","last_became_active":"2024-09-19T08:50:15.895498+0000","last_became_peered":"2024-09-19T08:50:15.895498+0000","last_unstale":"2024-09-19T08:51:51.836501+0000","last_undegraded":"2024-09-19T08:51:51.836501+0000","last_fullsized":"2024-09-19T08:51:51.836501+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:57.956427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.830052+0000","last_change":"2024-09-19T08:50:15.887658+0000","last_active":"2024-09-19T08:51:51.830052+0000","last_peered":"2024-09-19T08:51:51.830052+0000","last_clean":"2024-09-19T08:51:51.830052+0000","last_became_active":"2024-09-19T08:50:15.887199+0000","last_became_peered":"2024-09-19T08:50:15.887199+0000","last_unstale":"2024-09-19T08:51:51.830052+0000","last_undegraded":"2024-09-19T08:51:51.830052+0000","last_fullsized":"2024-09-19T08:51:51.830052+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:39.947735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.834776+0000","last_change":"2024-09-19T08:50:15.894865+0000","last_active":"2024-09-19T08:51:51.834776+0000","last_peered":"2024-09-19T08:51:51.834776+0000","last_clean":"2024-09-19T08:51:51.834776+0000","last_became_active":"2024-09-19T08:50:15.894475+0000","last_became_peered":"2024-09-19T08:50:15.894475+0000","last_unstale":"2024-09-19T08:51:51.834776+0000","last_undegraded":"2024-09-19T08:51:51.834776+0000","last_fullsized":"2024-09-19T08:51:51.834776+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:43.235991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827890+0000","last_change":"2024-09-19T08:50:15.897209+0000","last_active":"2024-09-19T08:51:51.827890+0000","last_peered":"2024-09-19T08:51:51.827890+0000","last_clean":"2024-09-19T08:51:51.827890+0000","last_became_active":"2024-09-19T08:50:15.896866+0000","last_became_peered":"2024-09-19T08:50:15.896866+0000","last_unstale":"2024-09-19T08:51:51.827890+0000","last_undegraded":"2024-09-19T08:51:51.827890+0000","last_fullsized":"2024-09-19T08:51:51.827890+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:23.036534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.825376+0000","last_change":"2024-09-19T08:50:15.890076+0000","last_active":"2024-09-19T08:51:51.825376+0000","last_peered":"2024-09-19T08:51:51.825376+0000","last_clean":"2024-09-19T08:51:51.825376+0000","last_became_active":"2024-09-19T08:50:15.889735+0000","last_became_peered":"2024-09-19T08:50:15.889735+0000","last_unstale":"2024-09-19T08:51:51.825376+0000","last_undegraded":"2024-09-19T08:51:51.825376+0000","last_fullsized":"2024-09-19T08:51:51.825376+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:25.602757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.834241+0000","last_change":"2024-09-19T08:50:15.886739+0000","last_active":"2024-09-19T08:51:51.834241+0000","last_peered":"2024-09-19T08:51:51.834241+0000","last_clean":"2024-09-19T08:51:51.834241+0000","last_became_active":"2024-09-19T08:50:15.886313+0000","last_became_peered":"2024-09-19T08:50:15.886313+0000","last_unstale":"2024-09-19T08:51:51.834241+0000","last_undegraded":"2024-09-19T08:51:51.834241+0000","last_fullsized":"2024-09-19T08:51:51.834241+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:03.244674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837276+0000","last_change":"2024-09-19T08:50:15.898519+0000","last_active":"2024-09-19T08:51:51.837276+0000","last_peered":"2024-09-19T08:51:51.837276+0000","last_clean":"2024-09-19T08:51:51.837276+0000","last_became_active":"2024-09-19T08:50:15.898249+0000","last_became_peered":"2024-09-19T08:50:15.898249+0000","last_unstale":"2024-09-19T08:51:51.837276+0000","last_undegraded":"2024-09-19T08:51:51.837276+0000","last_fullsized":"2024-09-19T08:51:51.837276+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:32.318895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837455+0000","last_change":"2024-09-19T08:50:15.890324+0000","last_active":"2024-09-19T08:51:51.837455+0000","last_peered":"2024-09-19T08:51:51.837455+0000","last_clean":"2024-09-19T08:51:51.837455+0000","last_became_active":"2024-09-19T08:50:15.887345+0000","last_became_peered":"2024-09-19T08:50:15.887345+0000","last_unstale":"2024-09-19T08:51:51.837455+0000","last_undegraded":"2024-09-19T08:51:51.837455+0000","last_fullsized":"2024-09-19T08:51:51.837455+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:27.989128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837724+0000","last_change":"2024-09-19T08:50:15.896305+0000","last_active":"2024-09-19T08:51:51.837724+0000","last_peered":"2024-09-19T08:51:51.837724+0000","last_clean":"2024-09-19T08:51:51.837724+0000","last_became_active":"2024-09-19T08:50:15.895832+0000","last_became_peered":"2024-09-19T08:50:15.895832+0000","last_unstale":"2024-09-19T08:51:51.837724+0000","last_undegraded":"2024-09-19T08:51:51.837724+0000","last_fullsized":"2024-09-19T08:51:51.837724+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:37.098237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.821237+0000","last_change":"2024-09-19T08:50:15.887251+0000","last_active":"2024-09-19T08:51:51.821237+0000","last_peered":"2024-09-19T08:51:51.821237+0000","last_clean":"2024-09-19T08:51:51.821237+0000","last_became_active":"2024-09-19T08:50:15.886936+0000","last_became_peered":"2024-09-19T08:50:15.886936+0000","last_unstale":"2024-09-19T08:51:51.821237+0000","last_undegraded":"2024-09-19T08:51:51.821237+0000","last_fullsized":"2024-09-19T08:51:51.821237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:38:08.828246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827071+0000","last_change":"2024-09-19T08:50:15.884813+0000","last_active":"2024-09-19T08:51:51.827071+0000","last_peered":"2024-09-19T08:51:51.827071+0000","last_clean":"2024-09-19T08:51:51.827071+0000","last_became_active":"2024-09-19T08:50:15.883445+0000","last_became_peered":"2024-09-19T08:50:15.883445+0000","last_unstale":"2024-09-19T08:51:51.827071+0000","last_undegraded":"2024-09-19T08:51:51.827071+0000","last_fullsized":"2024-09-19T08:51:51.827071+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:39.733501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.821368+0000","last_change":"2024-09-19T08:50:15.887644+0000","last_active":"2024-09-19T08:51:51.821368+0000","last_peered":"2024-09-19T08:51:51.821368+0000","last_clean":"2024-09-19T08:51:51.821368+0000","last_became_active":"2024-09-19T08:50:15.887224+0000","last_became_peered":"2024-09-19T08:50:15.887224+0000","last_unstale":"2024-09-19T08:51:51.821368+0000","last_undegraded":"2024-09-19T08:51:51.821368+0000","last_fullsized":"2024-09-19T08:51:51.821368+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:35.883690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.835961+0000","last_change":"2024-09-19T08:50:15.886678+0000","last_active":"2024-09-19T08:51:51.835961+0000","last_peered":"2024-09-19T08:51:51.835961+0000","last_clean":"2024-09-19T08:51:51.835961+0000","last_became_active":"2024-09-19T08:50:15.886360+0000","last_became_peered":"2024-09-19T08:50:15.886360+0000","last_unstale":"2024-09-19T08:51:51.835961+0000","last_undegraded":"2024-09-19T08:51:51.835961+0000","last_fullsized":"2024-09-19T08:51:51.835961+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:51.515211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.832052+0000","last_change":"2024-09-19T08:50:15.887607+0000","last_active":"2024-09-19T08:51:51.832052+0000","last_peered":"2024-09-19T08:51:51.832052+0000","last_clean":"2024-09-19T08:51:51.832052+0000","last_became_active":"2024-09-19T08:50:15.887266+0000","last_became_peered":"2024-09-19T08:50:15.887266+0000","last_unstale":"2024-09-19T08:51:51.832052+0000","last_undegraded":"2024-09-19T08:51:51.832052+0000","last_fullsized":"2024-09-19T08:51:51.832052+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:44:57.404160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829136+0000","last_change":"2024-09-19T08:50:15.882651+0000","last_active":"2024-09-19T08:51:51.829136+0000","last_peered":"2024-09-19T08:51:51.829136+0000","last_clean":"2024-09-19T08:51:51.829136+0000","last_became_active":"2024-09-19T08:50:15.882298+0000","last_became_peered":"2024-09-19T08:50:15.882298+0000","last_unstale":"2024-09-19T08:51:51.829136+0000","last_undegraded":"2024-09-19T08:51:51.829136+0000","last_fullsized":"2024-09-19T08:51:51.829136+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:16.028013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829040+0000","last_change":"2024-09-19T08:50:15.880407+0000","last_active":"2024-09-19T08:51:51.829040+0000","last_peered":"2024-09-19T08:51:51.829040+0000","last_clean":"2024-09-19T08:51:51.829040+0000","last_became_active":"2024-09-19T08:50:15.880026+0000","last_became_peered":"2024-09-19T08:50:15.880026+0000","last_unstale":"2024-09-19T08:51:51.829040+0000","last_undegraded":"2024-09-19T08:51:51.829040+0000","last_fullsized":"2024-09-19T08:51:51.829040+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:16.600913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.828745+0000","last_change":"2024-09-19T08:50:15.883573+0000","last_active":"2024-09-19T08:51:51.828745+0000","last_peered":"2024-09-19T08:51:51.828745+0000","last_clean":"2024-09-19T08:51:51.828745+0000","last_became_active":"2024-09-19T08:50:15.883258+0000","last_became_peered":"2024-09-19T08:50:15.883258+0000","last_unstale":"2024-09-19T08:51:51.828745+0000","last_undegraded":"2024-09-19T08:51:51.828745+0000","last_fullsized":"2024-09-19T08:51:51.828745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:33.026579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827776+0000","last_change":"2024-09-19T08:50:15.889519+0000","last_active":"2024-09-19T08:51:51.827776+0000","last_peered":"2024-09-19T08:51:51.827776+0000","last_clean":"2024-09-19T08:51:51.827776+0000","last_became_active":"2024-09-19T08:50:15.889183+0000","last_became_peered":"2024-09-19T08:50:15.889183+0000","last_unstale":"2024-09-19T08:51:51.827776+0000","last_undegraded":"2024-09-19T08:51:51.827776+0000","last_fullsized":"2024-09-19T08:51:51.827776+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:06.725662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.821674+0000","last_change":"2024-09-19T08:50:15.894483+0000","last_active":"2024-09-19T08:51:51.821674+0000","last_peered":"2024-09-19T08:51:51.821674+0000","last_clean":"2024-09-19T08:51:51.821674+0000","last_became_active":"2024-09-19T08:50:15.893760+0000","last_became_peered":"2024-09-19T08:50:15.893760+0000","last_unstale":"2024-09-19T08:51:51.821674+0000","last_undegraded":"2024-09-19T08:51:51.821674+0000","last_fullsized":"2024-09-19T08:51:51.821674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:23.686592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.835380+0000","last_change":"2024-09-19T08:50:15.882393+0000","last_active":"2024-09-19T08:51:51.835380+0000","last_peered":"2024-09-19T08:51:51.835380+0000","last_clean":"2024-09-19T08:51:51.835380+0000","last_became_active":"2024-09-19T08:50:15.882040+0000","last_became_peered":"2024-09-19T08:50:15.882040+0000","last_unstale":"2024-09-19T08:51:51.835380+0000","last_undegraded":"2024-09-19T08:51:51.835380+0000","last_fullsized":"2024-09-19T08:51:51.835380+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:22.430017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837471+0000","last_change":"2024-09-19T08:50:15.890919+0000","last_active":"2024-09-19T08:51:51.837471+0000","last_peered":"2024-09-19T08:51:51.837471+0000","last_clean":"2024-09-19T08:51:51.837471+0000","last_became_active":"2024-09-19T08:50:15.890256+0000","last_became_peered":"2024-09-19T08:50:15.890256+0000","last_unstale":"2024-09-19T08:51:51.837471+0000","last_undegraded":"2024-09-19T08:51:51.837471+0000","last_fullsized":"2024-09-19T08:51:51.837471+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:48.404890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827490+0000","last_change":"2024-09-19T08:50:15.888139+0000","last_active":"2024-09-19T08:51:51.827490+0000","last_peered":"2024-09-19T08:51:51.827490+0000","last_clean":"2024-09-19T08:51:51.827490+0000","last_became_active":"2024-09-19T08:50:15.886471+0000","last_became_peered":"2024-09-19T08:50:15.886471+0000","last_unstale":"2024-09-19T08:51:51.827490+0000","last_undegraded":"2024-09-19T08:51:51.827490+0000","last_fullsized":"2024-09-19T08:51:51.827490+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:20.545473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.822777+0000","last_change":"2024-09-19T08:50:15.891354+0000","last_active":"2024-09-19T08:51:51.822777+0000","last_peered":"2024-09-19T08:51:51.822777+0000","last_clean":"2024-09-19T08:51:51.822777+0000","last_became_active":"2024-09-19T08:50:15.890900+0000","last_became_peered":"2024-09-19T08:50:15.890900+0000","last_unstale":"2024-09-19T08:51:51.822777+0000","last_undegraded":"2024-09-19T08:51:51.822777+0000","last_fullsized":"2024-09-19T08:51:51.822777+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:33.139637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.828631+0000","last_change":"2024-09-19T08:50:15.891501+0000","last_active":"2024-09-19T08:51:51.828631+0000","last_peered":"2024-09-19T08:51:51.828631+0000","last_clean":"2024-09-19T08:51:51.828631+0000","last_became_active":"2024-09-19T08:50:15.891183+0000","last_became_peered":"2024-09-19T08:50:15.891183+0000","last_unstale":"2024-09-19T08:51:51.828631+0000","last_undegraded":"2024-09-19T08:51:51.828631+0000","last_fullsized":"2024-09-19T08:51:51.828631+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:16.976705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.819783+0000","last_change":"2024-09-19T08:50:15.882048+0000","last_active":"2024-09-19T08:51:51.819783+0000","last_peered":"2024-09-19T08:51:51.819783+0000","last_clean":"2024-09-19T08:51:51.819783+0000","last_became_active":"2024-09-19T08:50:15.881156+0000","last_became_peered":"2024-09-19T08:50:15.881156+0000","last_unstale":"2024-09-19T08:51:51.819783+0000","last_undegraded":"2024-09-19T08:51:51.819783+0000","last_fullsized":"2024-09-19T08:51:51.819783+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:33.198852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":134,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:10.113581+0000","last_change":"2024-09-19T08:50:13.800156+0000","last_active":"2024-09-19T08:52:10.113581+0000","last_peered":"2024-09-19T08:52:10.113581+0000","last_clean":"2024-09-19T08:52:10.113581+0000","last_became_active":"2024-09-19T08:50:13.799779+0000","last_became_peered":"2024-09-19T08:50:13.799779+0000","last_unstale":"2024-09-19T08:52:10.113581+0000","last_undegraded":"2024-09-19T08:52:10.113581+0000","last_fullsized":"2024-09-19T08:52:10.113581+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:38.033049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.826996+0000","last_change":"2024-09-19T08:50:15.887252+0000","last_active":"2024-09-19T08:51:51.826996+0000","last_peered":"2024-09-19T08:51:51.826996+0000","last_clean":"2024-09-19T08:51:51.826996+0000","last_became_active":"2024-09-19T08:50:15.886899+0000","last_became_peered":"2024-09-19T08:50:15.886899+0000","last_unstale":"2024-09-19T08:51:51.826996+0000","last_undegraded":"2024-09-19T08:51:51.826996+0000","last_fullsized":"2024-09-19T08:51:51.826996+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:56.262387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.556154+0000","last_change":"2024-09-19T08:51:23.556154+0000","last_active":"2024-09-19T08:51:23.556154+0000","last_peered":"2024-09-19T08:51:23.556154+0000","last_clean":"2024-09-19T08:51:23.556154+0000","last_became_active":"2024-09-19T08:51:23.549418+0000","last_became_peered":"2024-09-19T08:51:23.549418+0000","last_unstale":"2024-09-19T08:51:23.556154+0000","last_undegraded":"2024-09-19T08:51:23.556154+0000","last_fullsized":"2024-09-19T08:51:23.556154+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:35.225465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.540195+0000","last_change":"2024-09-19T08:50:13.794010+0000","last_active":"2024-09-19T08:51:23.540195+0000","last_peered":"2024-09-19T08:51:23.540195+0000","last_clean":"2024-09-19T08:51:23.540195+0000","last_became_active":"2024-09-19T08:50:13.793677+0000","last_became_peered":"2024-09-19T08:50:13.793677+0000","last_unstale":"2024-09-19T08:51:23.540195+0000","last_undegraded":"2024-09-19T08:51:23.540195+0000","last_fullsized":"2024-09-19T08:51:23.540195+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:56.125702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827232+0000","last_change":"2024-09-19T08:50:15.881732+0000","last_active":"2024-09-19T08:51:51.827232+0000","last_peered":"2024-09-19T08:51:51.827232+0000","last_clean":"2024-09-19T08:51:51.827232+0000","last_became_active":"2024-09-19T08:50:15.881394+0000","last_became_peered":"2024-09-19T08:50:15.881394+0000","last_unstale":"2024-09-19T08:51:51.827232+0000","last_undegraded":"2024-09-19T08:51:51.827232+0000","last_fullsized":"2024-09-19T08:51:51.827232+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:55.549138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.544525+0000","last_change":"2024-09-19T08:50:13.797118+0000","last_active":"2024-09-19T08:51:23.544525+0000","last_peered":"2024-09-19T08:51:23.544525+0000","last_clean":"2024-09-19T08:51:23.544525+0000","last_became_active":"2024-09-19T08:50:13.796727+0000","last_became_peered":"2024-09-19T08:50:13.796727+0000","last_unstale":"2024-09-19T08:51:23.544525+0000","last_undegraded":"2024-09-19T08:51:23.544525+0000","last_fullsized":"2024-09-19T08:51:23.544525+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:49.310543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.824911+0000","last_change":"2024-09-19T08:50:15.888192+0000","last_active":"2024-09-19T08:51:51.824911+0000","last_peered":"2024-09-19T08:51:51.824911+0000","last_clean":"2024-09-19T08:51:51.824911+0000","last_became_active":"2024-09-19T08:50:15.887890+0000","last_became_peered":"2024-09-19T08:50:15.887890+0000","last_unstale":"2024-09-19T08:51:51.824911+0000","last_undegraded":"2024-09-19T08:51:51.824911+0000","last_fullsized":"2024-09-19T08:51:51.824911+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:24:48.951856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'5","reported_seq":229,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:08.080545+0000","last_change":"2024-09-19T08:50:13.797427+0000","last_active":"2024-09-19T08:52:08.080545+0000","last_peered":"2024-09-19T08:52:08.080545+0000","last_clean":"2024-09-19T08:52:08.080545+0000","last_became_active":"2024-09-19T08:50:13.797021+0000","last_became_peered":"2024-09-19T08:50:13.797021+0000","last_unstale":"2024-09-19T08:52:08.080545+0000","last_undegraded":"2024-09-19T08:52:08.080545+0000","last_fullsized":"2024-09-19T08:52:08.080545+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:14.530373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":202,"num_read_kb":202,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837299+0000","last_change":"2024-09-19T08:50:15.894619+0000","last_active":"2024-09-19T08:51:51.837299+0000","last_peered":"2024-09-19T08:51:51.837299+0000","last_clean":"2024-09-19T08:51:51.837299+0000","last_became_active":"2024-09-19T08:50:15.894258+0000","last_became_peered":"2024-09-19T08:50:15.894258+0000","last_unstale":"2024-09-19T08:51:51.837299+0000","last_undegraded":"2024-09-19T08:51:51.837299+0000","last_fullsized":"2024-09-19T08:51:51.837299+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:13.137314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.559196+0000","last_change":"2024-09-19T08:51:23.559196+0000","last_active":"2024-09-19T08:51:23.559196+0000","last_peered":"2024-09-19T08:51:23.559196+0000","last_clean":"2024-09-19T08:51:23.559196+0000","last_became_active":"2024-09-19T08:51:23.549412+0000","last_became_peered":"2024-09-19T08:51:23.549412+0000","last_unstale":"2024-09-19T08:51:23.559196+0000","last_undegraded":"2024-09-19T08:51:23.559196+0000","last_fullsized":"2024-09-19T08:51:23.559196+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:38.145697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837760+0000","last_change":"2024-09-19T08:50:15.891121+0000","last_active":"2024-09-19T08:51:51.837760+0000","last_peered":"2024-09-19T08:51:51.837760+0000","last_clean":"2024-09-19T08:51:51.837760+0000","last_became_active":"2024-09-19T08:50:15.890810+0000","last_became_peered":"2024-09-19T08:50:15.890810+0000","last_unstale":"2024-09-19T08:51:51.837760+0000","last_undegraded":"2024-09-19T08:51:51.837760+0000","last_fullsized":"2024-09-19T08:51:51.837760+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:13.010282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.545394+0000","last_change":"2024-09-19T08:50:14.293953+0000","last_active":"2024-09-19T08:51:23.545394+0000","last_peered":"2024-09-19T08:51:23.545394+0000","last_clean":"2024-09-19T08:51:23.545394+0000","last_became_active":"2024-09-19T08:50:14.293546+0000","last_became_peered":"2024-09-19T08:50:14.293546+0000","last_unstale":"2024-09-19T08:51:23.545394+0000","last_undegraded":"2024-09-19T08:51:23.545394+0000","last_fullsized":"2024-09-19T08:51:23.545394+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:27.809243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.836318+0000","last_change":"2024-09-19T08:50:15.878300+0000","last_active":"2024-09-19T08:51:51.836318+0000","last_peered":"2024-09-19T08:51:51.836318+0000","last_clean":"2024-09-19T08:51:51.836318+0000","last_became_active":"2024-09-19T08:50:15.877938+0000","last_became_peered":"2024-09-19T08:50:15.877938+0000","last_unstale":"2024-09-19T08:51:51.836318+0000","last_undegraded":"2024-09-19T08:51:51.836318+0000","last_fullsized":"2024-09-19T08:51:51.836318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:05.376708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'33","reported_seq":265,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:08.099933+0000","last_change":"2024-09-19T08:50:13.800696+0000","last_active":"2024-09-19T08:52:08.099933+0000","last_peered":"2024-09-19T08:52:08.099933+0000","last_clean":"2024-09-19T08:52:08.099933+0000","last_became_active":"2024-09-19T08:50:13.799385+0000","last_became_peered":"2024-09-19T08:50:13.799385+0000","last_unstale":"2024-09-19T08:52:08.099933+0000","last_undegraded":"2024-09-19T08:52:08.099933+0000","last_fullsized":"2024-09-19T08:52:08.099933+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:56.897309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59768,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":210,"num_read_kb":162,"num_write":35,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.820658+0000","last_change":"2024-09-19T08:50:15.891483+0000","last_active":"2024-09-19T08:51:51.820658+0000","last_peered":"2024-09-19T08:51:51.820658+0000","last_clean":"2024-09-19T08:51:51.820658+0000","last_became_active":"2024-09-19T08:50:15.891185+0000","last_became_peered":"2024-09-19T08:50:15.891185+0000","last_unstale":"2024-09-19T08:51:51.820658+0000","last_undegraded":"2024-09-19T08:51:51.820658+0000","last_fullsized":"2024-09-19T08:51:51.820658+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:26.599151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.548669+0000","last_change":"2024-09-19T08:50:13.795148+0000","last_active":"2024-09-19T08:51:23.548669+0000","last_peered":"2024-09-19T08:51:23.548669+0000","last_clean":"2024-09-19T08:51:23.548669+0000","last_became_active":"2024-09-19T08:50:13.794688+0000","last_became_peered":"2024-09-19T08:50:13.794688+0000","last_unstale":"2024-09-19T08:51:23.548669+0000","last_undegraded":"2024-09-19T08:51:23.548669+0000","last_fullsized":"2024-09-19T08:51:23.548669+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:01.366439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.832390+0000","last_change":"2024-09-19T08:50:15.886449+0000","last_active":"2024-09-19T08:51:51.832390+0000","last_peered":"2024-09-19T08:51:51.832390+0000","last_clean":"2024-09-19T08:51:51.832390+0000","last_became_active":"2024-09-19T08:50:15.886119+0000","last_became_peered":"2024-09-19T08:50:15.886119+0000","last_unstale":"2024-09-19T08:51:51.832390+0000","last_undegraded":"2024-09-19T08:51:51.832390+0000","last_fullsized":"2024-09-19T08:51:51.832390+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:22.916593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.544525+0000","last_change":"2024-09-19T08:50:13.799363+0000","last_active":"2024-09-19T08:51:23.544525+0000","last_peered":"2024-09-19T08:51:23.544525+0000","last_clean":"2024-09-19T08:51:23.544525+0000","last_became_active":"2024-09-19T08:50:13.799033+0000","last_became_peered":"2024-09-19T08:50:13.799033+0000","last_unstale":"2024-09-19T08:51:23.544525+0000","last_undegraded":"2024-09-19T08:51:23.544525+0000","last_fullsized":"2024-09-19T08:51:23.544525+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:57.753451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837083+0000","last_change":"2024-09-19T08:50:15.898902+0000","last_active":"2024-09-19T08:51:51.837083+0000","last_peered":"2024-09-19T08:51:51.837083+0000","last_clean":"2024-09-19T08:51:51.837083+0000","last_became_active":"2024-09-19T08:50:15.898417+0000","last_became_peered":"2024-09-19T08:50:15.898417+0000","last_unstale":"2024-09-19T08:51:51.837083+0000","last_undegraded":"2024-09-19T08:51:51.837083+0000","last_fullsized":"2024-09-19T08:51:51.837083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:32:19.799301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'7","reported_seq":133,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:06.078343+0000","last_change":"2024-09-19T08:50:13.798477+0000","last_active":"2024-09-19T08:52:06.078343+0000","last_peered":"2024-09-19T08:52:06.078343+0000","last_clean":"2024-09-19T08:52:06.078343+0000","last_became_active":"2024-09-19T08:50:13.798136+0000","last_became_peered":"2024-09-19T08:50:13.798136+0000","last_unstale":"2024-09-19T08:52:06.078343+0000","last_undegraded":"2024-09-19T08:52:06.078343+0000","last_fullsized":"2024-09-19T08:52:06.078343+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:33.874285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1122,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":105,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829630+0000","last_change":"2024-09-19T08:50:15.896414+0000","last_active":"2024-09-19T08:51:51.829630+0000","last_peered":"2024-09-19T08:51:51.829630+0000","last_clean":"2024-09-19T08:51:51.829630+0000","last_became_active":"2024-09-19T08:50:15.895530+0000","last_became_peered":"2024-09-19T08:50:15.895530+0000","last_unstale":"2024-09-19T08:51:51.829630+0000","last_undegraded":"2024-09-19T08:51:51.829630+0000","last_fullsized":"2024-09-19T08:51:51.829630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:59.717869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.545962+0000","last_change":"2024-09-19T08:50:14.294087+0000","last_active":"2024-09-19T08:51:23.545962+0000","last_peered":"2024-09-19T08:51:23.545962+0000","last_clean":"2024-09-19T08:51:23.545962+0000","last_became_active":"2024-09-19T08:50:14.293712+0000","last_became_peered":"2024-09-19T08:50:14.293712+0000","last_unstale":"2024-09-19T08:51:23.545962+0000","last_undegraded":"2024-09-19T08:51:23.545962+0000","last_fullsized":"2024-09-19T08:51:23.545962+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:12.187514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.835719+0000","last_change":"2024-09-19T08:50:15.888134+0000","last_active":"2024-09-19T08:51:51.835719+0000","last_peered":"2024-09-19T08:51:51.835719+0000","last_clean":"2024-09-19T08:51:51.835719+0000","last_became_active":"2024-09-19T08:50:15.887768+0000","last_became_peered":"2024-09-19T08:50:15.887768+0000","last_unstale":"2024-09-19T08:51:51.835719+0000","last_undegraded":"2024-09-19T08:51:51.835719+0000","last_fullsized":"2024-09-19T08:51:51.835719+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:12.868773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.547326+0000","last_change":"2024-09-19T08:50:13.792585+0000","last_active":"2024-09-19T08:51:23.547326+0000","last_peered":"2024-09-19T08:51:23.547326+0000","last_clean":"2024-09-19T08:51:23.547326+0000","last_became_active":"2024-09-19T08:50:13.792222+0000","last_became_peered":"2024-09-19T08:50:13.792222+0000","last_unstale":"2024-09-19T08:51:23.547326+0000","last_undegraded":"2024-09-19T08:51:23.547326+0000","last_fullsized":"2024-09-19T08:51:23.547326+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:45.234800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.818076+0000","last_change":"2024-09-19T08:51:23.549003+0000","last_active":"2024-09-19T08:51:51.818076+0000","last_peered":"2024-09-19T08:51:51.818076+0000","last_clean":"2024-09-19T08:51:51.818076+0000","last_became_active":"2024-09-19T08:51:23.548611+0000","last_became_peered":"2024-09-19T08:51:23.548611+0000","last_unstale":"2024-09-19T08:51:51.818076+0000","last_undegraded":"2024-09-19T08:51:51.818076+0000","last_fullsized":"2024-09-19T08:51:51.818076+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:00.043092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.540568+0000","last_change":"2024-09-19T08:50:13.795360+0000","last_active":"2024-09-19T08:51:23.540568+0000","last_peered":"2024-09-19T08:51:23.540568+0000","last_clean":"2024-09-19T08:51:23.540568+0000","last_became_active":"2024-09-19T08:50:13.794823+0000","last_became_peered":"2024-09-19T08:50:13.794823+0000","last_unstale":"2024-09-19T08:51:23.540568+0000","last_undegraded":"2024-09-19T08:51:23.540568+0000","last_fullsized":"2024-09-19T08:51:23.540568+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:15.037834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.822420+0000","last_change":"2024-09-19T08:50:15.893668+0000","last_active":"2024-09-19T08:51:51.822420+0000","last_peered":"2024-09-19T08:51:51.822420+0000","last_clean":"2024-09-19T08:51:51.822420+0000","last_became_active":"2024-09-19T08:50:15.893303+0000","last_became_peered":"2024-09-19T08:50:15.893303+0000","last_unstale":"2024-09-19T08:51:51.822420+0000","last_undegraded":"2024-09-19T08:51:51.822420+0000","last_fullsized":"2024-09-19T08:51:51.822420+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:59.281601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.545777+0000","last_change":"2024-09-19T08:50:13.797442+0000","last_active":"2024-09-19T08:51:23.545777+0000","last_peered":"2024-09-19T08:51:23.545777+0000","last_clean":"2024-09-19T08:51:23.545777+0000","last_became_active":"2024-09-19T08:50:13.797072+0000","last_became_peered":"2024-09-19T08:50:13.797072+0000","last_unstale":"2024-09-19T08:51:23.545777+0000","last_undegraded":"2024-09-19T08:51:23.545777+0000","last_fullsized":"2024-09-19T08:51:23.545777+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:32.960928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829292+0000","last_change":"2024-09-19T08:51:23.554271+0000","last_active":"2024-09-19T08:51:51.829292+0000","last_peered":"2024-09-19T08:51:51.829292+0000","last_clean":"2024-09-19T08:51:51.829292+0000","last_became_active":"2024-09-19T08:51:23.547630+0000","last_became_peered":"2024-09-19T08:51:23.547630+0000","last_unstale":"2024-09-19T08:51:51.829292+0000","last_undegraded":"2024-09-19T08:51:51.829292+0000","last_fullsized":"2024-09-19T08:51:51.829292+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:39.033522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'7","reported_seq":136,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:09.082570+0000","last_change":"2024-09-19T08:50:14.294014+0000","last_active":"2024-09-19T08:52:09.082570+0000","last_peered":"2024-09-19T08:52:09.082570+0000","last_clean":"2024-09-19T08:52:09.082570+0000","last_became_active":"2024-09-19T08:50:14.293564+0000","last_became_peered":"2024-09-19T08:50:14.293564+0000","last_unstale":"2024-09-19T08:52:09.082570+0000","last_undegraded":"2024-09-19T08:52:09.082570+0000","last_fullsized":"2024-09-19T08:52:09.082570+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:23.806408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1704,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.834993+0000","last_change":"2024-09-19T08:50:15.891840+0000","last_active":"2024-09-19T08:51:51.834993+0000","last_peered":"2024-09-19T08:51:51.834993+0000","last_clean":"2024-09-19T08:51:51.834993+0000","last_became_active":"2024-09-19T08:50:15.891511+0000","last_became_peered":"2024-09-19T08:50:15.891511+0000","last_unstale":"2024-09-19T08:51:51.834993+0000","last_undegraded":"2024-09-19T08:51:51.834993+0000","last_fullsized":"2024-09-19T08:51:51.834993+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:26.800508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":332,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.545171+0000","last_change":"2024-09-19T08:49:02.071497+0000","last_active":"2024-09-19T08:51:23.545171+0000","last_peered":"2024-09-19T08:51:23.545171+0000","last_clean":"2024-09-19T08:51:23.545171+0000","last_became_active":"2024-09-19T08:49:02.071114+0000","last_became_peered":"2024-09-19T08:49:02.071114+0000","last_unstale":"2024-09-19T08:51:23.545171+0000","last_undegraded":"2024-09-19T08:51:23.545171+0000","last_fullsized":"2024-09-19T08:51:23.545171+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:45:36.600595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:45:36.600595+0000","last_clean_scrub_stamp":"2024-09-19T08:45:36.600595+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:18:15.369279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.541800+0000","last_change":"2024-09-19T08:50:13.793981+0000","last_active":"2024-09-19T08:51:23.541800+0000","last_peered":"2024-09-19T08:51:23.541800+0000","last_clean":"2024-09-19T08:51:23.541800+0000","last_became_active":"2024-09-19T08:50:13.793616+0000","last_became_peered":"2024-09-19T08:50:13.793616+0000","last_unstale":"2024-09-19T08:51:23.541800+0000","last_undegraded":"2024-09-19T08:51:23.541800+0000","last_fullsized":"2024-09-19T08:51:23.541800+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:45.195906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.828840+0000","last_change":"2024-09-19T08:50:15.891248+0000","last_active":"2024-09-19T08:51:51.828840+0000","last_peered":"2024-09-19T08:51:51.828840+0000","last_clean":"2024-09-19T08:51:51.828840+0000","last_became_active":"2024-09-19T08:50:15.890922+0000","last_became_peered":"2024-09-19T08:50:15.890922+0000","last_unstale":"2024-09-19T08:51:51.828840+0000","last_undegraded":"2024-09-19T08:51:51.828840+0000","last_fullsized":"2024-09-19T08:51:51.828840+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:18:43.914214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.545014+0000","last_change":"2024-09-19T08:50:13.797471+0000","last_active":"2024-09-19T08:51:23.545014+0000","last_peered":"2024-09-19T08:51:23.545014+0000","last_clean":"2024-09-19T08:51:23.545014+0000","last_became_active":"2024-09-19T08:50:13.797033+0000","last_became_peered":"2024-09-19T08:50:13.797033+0000","last_unstale":"2024-09-19T08:51:23.545014+0000","last_undegraded":"2024-09-19T08:51:23.545014+0000","last_fullsized":"2024-09-19T08:51:23.545014+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:53.141708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.821571+0000","last_change":"2024-09-19T08:50:15.882650+0000","last_active":"2024-09-19T08:51:51.821571+0000","last_peered":"2024-09-19T08:51:51.821571+0000","last_clean":"2024-09-19T08:51:51.821571+0000","last_became_active":"2024-09-19T08:50:15.882308+0000","last_became_peered":"2024-09-19T08:50:15.882308+0000","last_unstale":"2024-09-19T08:51:51.821571+0000","last_undegraded":"2024-09-19T08:51:51.821571+0000","last_fullsized":"2024-09-19T08:51:51.821571+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:26.449562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'7","reported_seq":133,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:09.081631+0000","last_change":"2024-09-19T08:50:14.292466+0000","last_active":"2024-09-19T08:52:09.081631+0000","last_peered":"2024-09-19T08:52:09.081631+0000","last_clean":"2024-09-19T08:52:09.081631+0000","last_became_active":"2024-09-19T08:50:14.292092+0000","last_became_peered":"2024-09-19T08:50:14.292092+0000","last_unstale":"2024-09-19T08:52:09.081631+0000","last_undegraded":"2024-09-19T08:52:09.081631+0000","last_fullsized":"2024-09-19T08:52:09.081631+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:11.373226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.825695+0000","last_change":"2024-09-19T08:51:23.551606+0000","last_active":"2024-09-19T08:51:51.825695+0000","last_peered":"2024-09-19T08:51:51.825695+0000","last_clean":"2024-09-19T08:51:51.825695+0000","last_became_active":"2024-09-19T08:51:23.551181+0000","last_became_peered":"2024-09-19T08:51:23.551181+0000","last_unstale":"2024-09-19T08:51:51.825695+0000","last_undegraded":"2024-09-19T08:51:51.825695+0000","last_fullsized":"2024-09-19T08:51:51.825695+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:05.577651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'6","reported_seq":133,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:10.612221+0000","last_change":"2024-09-19T08:50:13.799909+0000","last_active":"2024-09-19T08:52:10.612221+0000","last_peered":"2024-09-19T08:52:10.612221+0000","last_clean":"2024-09-19T08:52:10.612221+0000","last_became_active":"2024-09-19T08:50:13.799542+0000","last_became_peered":"2024-09-19T08:50:13.799542+0000","last_unstale":"2024-09-19T08:52:10.612221+0000","last_undegraded":"2024-09-19T08:52:10.612221+0000","last_fullsized":"2024-09-19T08:52:10.612221+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:23.545897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837020+0000","last_change":"2024-09-19T08:51:24.482934+0000","last_active":"2024-09-19T08:51:51.837020+0000","last_peered":"2024-09-19T08:51:51.837020+0000","last_clean":"2024-09-19T08:51:51.837020+0000","last_became_active":"2024-09-19T08:51:24.482586+0000","last_became_peered":"2024-09-19T08:51:24.482586+0000","last_unstale":"2024-09-19T08:51:51.837020+0000","last_undegraded":"2024-09-19T08:51:51.837020+0000","last_fullsized":"2024-09-19T08:51:51.837020+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:15.121449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.543078+0000","last_change":"2024-09-19T08:50:14.292577+0000","last_active":"2024-09-19T08:51:23.543078+0000","last_peered":"2024-09-19T08:51:23.543078+0000","last_clean":"2024-09-19T08:51:23.543078+0000","last_became_active":"2024-09-19T08:50:14.292220+0000","last_became_peered":"2024-09-19T08:50:14.292220+0000","last_unstale":"2024-09-19T08:51:23.543078+0000","last_undegraded":"2024-09-19T08:51:23.543078+0000","last_fullsized":"2024-09-19T08:51:23.543078+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:23.631672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827650+0000","last_change":"2024-09-19T08:50:15.891345+0000","last_active":"2024-09-19T08:51:51.827650+0000","last_peered":"2024-09-19T08:51:51.827650+0000","last_clean":"2024-09-19T08:51:51.827650+0000","last_became_active":"2024-09-19T08:50:15.891006+0000","last_became_peered":"2024-09-19T08:50:15.891006+0000","last_unstale":"2024-09-19T08:51:51.827650+0000","last_undegraded":"2024-09-19T08:51:51.827650+0000","last_fullsized":"2024-09-19T08:51:51.827650+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:41.934331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.546914+0000","last_change":"2024-09-19T08:50:14.292619+0000","last_active":"2024-09-19T08:51:23.546914+0000","last_peered":"2024-09-19T08:51:23.546914+0000","last_clean":"2024-09-19T08:51:23.546914+0000","last_became_active":"2024-09-19T08:50:14.292230+0000","last_became_peered":"2024-09-19T08:50:14.292230+0000","last_unstale":"2024-09-19T08:51:23.546914+0000","last_undegraded":"2024-09-19T08:51:23.546914+0000","last_fullsized":"2024-09-19T08:51:23.546914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:21:33.076142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.824332+0000","last_change":"2024-09-19T08:50:15.882760+0000","last_active":"2024-09-19T08:51:51.824332+0000","last_peered":"2024-09-19T08:51:51.824332+0000","last_clean":"2024-09-19T08:51:51.824332+0000","last_became_active":"2024-09-19T08:50:15.882402+0000","last_became_peered":"2024-09-19T08:50:15.882402+0000","last_unstale":"2024-09-19T08:51:51.824332+0000","last_undegraded":"2024-09-19T08:51:51.824332+0000","last_fullsized":"2024-09-19T08:51:51.824332+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:17.343385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'16","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.543435+0000","last_change":"2024-09-19T08:50:13.790982+0000","last_active":"2024-09-19T08:51:23.543435+0000","last_peered":"2024-09-19T08:51:23.543435+0000","last_clean":"2024-09-19T08:51:23.543435+0000","last_became_active":"2024-09-19T08:50:13.790644+0000","last_became_peered":"2024-09-19T08:50:13.790644+0000","last_unstale":"2024-09-19T08:51:23.543435+0000","last_undegraded":"2024-09-19T08:51:23.543435+0000","last_fullsized":"2024-09-19T08:51:23.543435+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:20:25.923021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827049+0000","last_change":"2024-09-19T08:50:15.887556+0000","last_active":"2024-09-19T08:51:51.827049+0000","last_peered":"2024-09-19T08:51:51.827049+0000","last_clean":"2024-09-19T08:51:51.827049+0000","last_became_active":"2024-09-19T08:50:15.887280+0000","last_became_peered":"2024-09-19T08:50:15.887280+0000","last_unstale":"2024-09-19T08:51:51.827049+0000","last_undegraded":"2024-09-19T08:51:51.827049+0000","last_fullsized":"2024-09-19T08:51:51.827049+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:51.226527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.541910+0000","last_change":"2024-09-19T08:50:14.012150+0000","last_active":"2024-09-19T08:51:23.541910+0000","last_peered":"2024-09-19T08:51:23.541910+0000","last_clean":"2024-09-19T08:51:23.541910+0000","last_became_active":"2024-09-19T08:50:14.011799+0000","last_became_peered":"2024-09-19T08:50:14.011799+0000","last_unstale":"2024-09-19T08:51:23.541910+0000","last_undegraded":"2024-09-19T08:51:23.541910+0000","last_fullsized":"2024-09-19T08:51:23.541910+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:37.310539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837525+0000","last_change":"2024-09-19T08:50:15.889577+0000","last_active":"2024-09-19T08:51:51.837525+0000","last_peered":"2024-09-19T08:51:51.837525+0000","last_clean":"2024-09-19T08:51:51.837525+0000","last_became_active":"2024-09-19T08:50:15.889244+0000","last_became_peered":"2024-09-19T08:50:15.889244+0000","last_unstale":"2024-09-19T08:51:51.837525+0000","last_undegraded":"2024-09-19T08:51:51.837525+0000","last_fullsized":"2024-09-19T08:51:51.837525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:54.382221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.548456+0000","last_change":"2024-09-19T08:50:14.293845+0000","last_active":"2024-09-19T08:51:23.548456+0000","last_peered":"2024-09-19T08:51:23.548456+0000","last_clean":"2024-09-19T08:51:23.548456+0000","last_became_active":"2024-09-19T08:50:14.293585+0000","last_became_peered":"2024-09-19T08:50:14.293585+0000","last_unstale":"2024-09-19T08:51:23.548456+0000","last_undegraded":"2024-09-19T08:51:23.548456+0000","last_fullsized":"2024-09-19T08:51:23.548456+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:02.886475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.794304+0000","last_change":"2024-09-19T08:50:15.888591+0000","last_active":"2024-09-19T08:51:51.794304+0000","last_peered":"2024-09-19T08:51:51.794304+0000","last_clean":"2024-09-19T08:51:51.794304+0000","last_became_active":"2024-09-19T08:50:15.888270+0000","last_became_peered":"2024-09-19T08:50:15.888270+0000","last_unstale":"2024-09-19T08:51:51.794304+0000","last_undegraded":"2024-09-19T08:51:51.794304+0000","last_fullsized":"2024-09-19T08:51:51.794304+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:08.644828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.547015+0000","last_change":"2024-09-19T08:50:13.794081+0000","last_active":"2024-09-19T08:51:23.547015+0000","last_peered":"2024-09-19T08:51:23.547015+0000","last_clean":"2024-09-19T08:51:23.547015+0000","last_became_active":"2024-09-19T08:50:13.793770+0000","last_became_peered":"2024-09-19T08:50:13.793770+0000","last_unstale":"2024-09-19T08:51:23.547015+0000","last_undegraded":"2024-09-19T08:51:23.547015+0000","last_fullsized":"2024-09-19T08:51:23.547015+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:43.053893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.835489+0000","last_change":"2024-09-19T08:50:15.885338+0000","last_active":"2024-09-19T08:51:51.835489+0000","last_peered":"2024-09-19T08:51:51.835489+0000","last_clean":"2024-09-19T08:51:51.835489+0000","last_became_active":"2024-09-19T08:50:15.884983+0000","last_became_peered":"2024-09-19T08:50:15.884983+0000","last_unstale":"2024-09-19T08:51:51.835489+0000","last_undegraded":"2024-09-19T08:51:51.835489+0000","last_fullsized":"2024-09-19T08:51:51.835489+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:05.228871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.563104+0000","last_change":"2024-09-19T08:51:23.562670+0000","last_active":"2024-09-19T08:51:23.563104+0000","last_peered":"2024-09-19T08:51:23.563104+0000","last_clean":"2024-09-19T08:51:23.563104+0000","last_became_active":"2024-09-19T08:51:23.548756+0000","last_became_peered":"2024-09-19T08:51:23.548756+0000","last_unstale":"2024-09-19T08:51:23.563104+0000","last_undegraded":"2024-09-19T08:51:23.563104+0000","last_fullsized":"2024-09-19T08:51:23.563104+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:36.666216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829262+0000","last_change":"2024-09-19T08:50:15.886587+0000","last_active":"2024-09-19T08:51:51.829262+0000","last_peered":"2024-09-19T08:51:51.829262+0000","last_clean":"2024-09-19T08:51:51.829262+0000","last_became_active":"2024-09-19T08:50:15.886231+0000","last_became_peered":"2024-09-19T08:50:15.886231+0000","last_unstale":"2024-09-19T08:51:51.829262+0000","last_undegraded":"2024-09-19T08:51:51.829262+0000","last_fullsized":"2024-09-19T08:51:51.829262+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:11.965382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.546412+0000","last_change":"2024-09-19T08:50:13.796681+0000","last_active":"2024-09-19T08:51:23.546412+0000","last_peered":"2024-09-19T08:51:23.546412+0000","last_clean":"2024-09-19T08:51:23.546412+0000","last_became_active":"2024-09-19T08:50:13.796338+0000","last_became_peered":"2024-09-19T08:50:13.796338+0000","last_unstale":"2024-09-19T08:51:23.546412+0000","last_undegraded":"2024-09-19T08:51:23.546412+0000","last_fullsized":"2024-09-19T08:51:23.546412+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:32.588800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.836422+0000","last_change":"2024-09-19T08:50:15.889667+0000","last_active":"2024-09-19T08:51:51.836422+0000","last_peered":"2024-09-19T08:51:51.836422+0000","last_clean":"2024-09-19T08:51:51.836422+0000","last_became_active":"2024-09-19T08:50:15.889341+0000","last_became_peered":"2024-09-19T08:50:15.889341+0000","last_unstale":"2024-09-19T08:51:51.836422+0000","last_undegraded":"2024-09-19T08:51:51.836422+0000","last_fullsized":"2024-09-19T08:51:51.836422+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:13.255483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.836199+0000","last_change":"2024-09-19T08:50:15.887337+0000","last_active":"2024-09-19T08:51:51.836199+0000","last_peered":"2024-09-19T08:51:51.836199+0000","last_clean":"2024-09-19T08:51:51.836199+0000","last_became_active":"2024-09-19T08:50:15.887001+0000","last_became_peered":"2024-09-19T08:50:15.887001+0000","last_unstale":"2024-09-19T08:51:51.836199+0000","last_undegraded":"2024-09-19T08:51:51.836199+0000","last_fullsized":"2024-09-19T08:51:51.836199+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:43.544863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.547132+0000","last_change":"2024-09-19T08:50:13.799321+0000","last_active":"2024-09-19T08:51:23.547132+0000","last_peered":"2024-09-19T08:51:23.547132+0000","last_clean":"2024-09-19T08:51:23.547132+0000","last_became_active":"2024-09-19T08:50:13.798837+0000","last_became_peered":"2024-09-19T08:50:13.798837+0000","last_unstale":"2024-09-19T08:51:23.547132+0000","last_undegraded":"2024-09-19T08:51:23.547132+0000","last_fullsized":"2024-09-19T08:51:23.547132+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:35.753093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837309+0000","last_change":"2024-09-19T08:50:15.892074+0000","last_active":"2024-09-19T08:51:51.837309+0000","last_peered":"2024-09-19T08:51:51.837309+0000","last_clean":"2024-09-19T08:51:51.837309+0000","last_became_active":"2024-09-19T08:50:15.891722+0000","last_became_peered":"2024-09-19T08:50:15.891722+0000","last_unstale":"2024-09-19T08:51:51.837309+0000","last_undegraded":"2024-09-19T08:51:51.837309+0000","last_fullsized":"2024-09-19T08:51:51.837309+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:39.913080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.546815+0000","last_change":"2024-09-19T08:50:13.795577+0000","last_active":"2024-09-19T08:51:23.546815+0000","last_peered":"2024-09-19T08:51:23.546815+0000","last_clean":"2024-09-19T08:51:23.546815+0000","last_became_active":"2024-09-19T08:50:13.795254+0000","last_became_peered":"2024-09-19T08:50:13.795254+0000","last_unstale":"2024-09-19T08:51:23.546815+0000","last_undegraded":"2024-09-19T08:51:23.546815+0000","last_fullsized":"2024-09-19T08:51:23.546815+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:13.263447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.836430+0000","last_change":"2024-09-19T08:50:15.884584+0000","last_active":"2024-09-19T08:51:51.836430+0000","last_peered":"2024-09-19T08:51:51.836430+0000","last_clean":"2024-09-19T08:51:51.836430+0000","last_became_active":"2024-09-19T08:50:15.884244+0000","last_became_peered":"2024-09-19T08:50:15.884244+0000","last_unstale":"2024-09-19T08:51:51.836430+0000","last_undegraded":"2024-09-19T08:51:51.836430+0000","last_fullsized":"2024-09-19T08:51:51.836430+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:58.835351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.547216+0000","last_change":"2024-09-19T08:50:14.294210+0000","last_active":"2024-09-19T08:51:23.547216+0000","last_peered":"2024-09-19T08:51:23.547216+0000","last_clean":"2024-09-19T08:51:23.547216+0000","last_became_active":"2024-09-19T08:50:14.293850+0000","last_became_peered":"2024-09-19T08:50:14.293850+0000","last_unstale":"2024-09-19T08:51:23.547216+0000","last_undegraded":"2024-09-19T08:51:23.547216+0000","last_fullsized":"2024-09-19T08:51:23.547216+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:42:44.340766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829139+0000","last_change":"2024-09-19T08:50:15.892934+0000","last_active":"2024-09-19T08:51:51.829139+0000","last_peered":"2024-09-19T08:51:51.829139+0000","last_clean":"2024-09-19T08:51:51.829139+0000","last_became_active":"2024-09-19T08:50:15.892309+0000","last_became_peered":"2024-09-19T08:50:15.892309+0000","last_unstale":"2024-09-19T08:51:51.829139+0000","last_undegraded":"2024-09-19T08:51:51.829139+0000","last_fullsized":"2024-09-19T08:51:51.829139+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:40.158724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":157,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:07.607766+0000","last_change":"2024-09-19T08:51:23.559819+0000","last_active":"2024-09-19T08:52:07.607766+0000","last_peered":"2024-09-19T08:52:07.607766+0000","last_clean":"2024-09-19T08:52:07.607766+0000","last_became_active":"2024-09-19T08:51:23.548481+0000","last_became_peered":"2024-09-19T08:51:23.548481+0000","last_unstale":"2024-09-19T08:52:07.607766+0000","last_undegraded":"2024-09-19T08:52:07.607766+0000","last_fullsized":"2024-09-19T08:52:07.607766+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:53.232542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":97,"num_read_kb":97,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68044,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1056,"num_read_kb":599,"num_write":255,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":216673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":247642,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579941,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":434558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808873,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1052672,"data_stored":1084375,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972399,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":925696,"data_stored":433399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201332,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":433660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430265,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":1027136,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593791,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":433392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822723,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":983040,"data_stored":1025465,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953542,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":433394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182477,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":432707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":494434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":499839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":434872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34206,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34206,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":67679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":68433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":62346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:52:13.868 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-19T08:52:13.868 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T08:52:13.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:13 smithi203 ceph-mon[35450]: pgmap v337: 97 pgs: 97 active+clean; 643 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-19T08:52:13.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:13 smithi203 ceph-mon[35450]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-19T08:52:14.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.007+0000 7f43392c9640 1 -- 172.21.15.19:0/1633753599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4334104f20 msgr2=0x7f4334107310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.007+0000 7f43392c9640 1 --2- 172.21.15.19:0/1633753599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4334104f20 0x7f4334107310 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4328009900 tx=0x7f432802a410 comp rx=0 tx=0).stop 2024-09-19T08:52:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.007+0000 7f43392c9640 1 -- 172.21.15.19:0/1633753599 shutdown_connections 2024-09-19T08:52:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.007+0000 7f43392c9640 1 --2- 172.21.15.19:0/1633753599 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4334107850 0x7f4334109c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.007+0000 7f43392c9640 1 --2- 172.21.15.19:0/1633753599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4334104f20 0x7f4334107310 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.007+0000 7f43392c9640 1 --2- 172.21.15.19:0/1633753599 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43341025f0 0x7f43341049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.007+0000 7f43392c9640 1 -- 172.21.15.19:0/1633753599 >> 172.21.15.19:0/1633753599 conn(0x7f43340fc170 msgr2=0x7f43340fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.007+0000 7f43392c9640 1 -- 172.21.15.19:0/1633753599 shutdown_connections 2024-09-19T08:52:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.007+0000 7f43392c9640 1 -- 172.21.15.19:0/1633753599 wait complete. 2024-09-19T08:52:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.008+0000 7f43392c9640 1 Processor -- start 2024-09-19T08:52:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.008+0000 7f43392c9640 1 -- start start 2024-09-19T08:52:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.008+0000 7f43392c9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43341025f0 0x7f4334197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:14.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.008+0000 7f43392c9640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4334104f20 0x7f43341983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:14.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.008+0000 7f43392c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4334107850 0x7f433419f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:14.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.008+0000 7f43392c9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f433410d7b0 con 0x7f4334107850 2024-09-19T08:52:14.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.008+0000 7f43392c9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f433410d630 con 0x7f43341025f0 2024-09-19T08:52:14.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.008+0000 7f43392c9640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f433410d930 con 0x7f4334104f20 2024-09-19T08:52:14.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.009+0000 7f43337fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4334107850 0x7f433419f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:14.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.009+0000 7f4332ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43341025f0 0x7f4334197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:14.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.009+0000 7f43337fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4334107850 0x7f433419f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50952/0 (socket says 172.21.15.19:50952) 2024-09-19T08:52:14.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.009+0000 7f43337fe640 1 -- 172.21.15.19:0/2203443173 learned_addr learned my addr 172.21.15.19:0/2203443173 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:14.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.009+0000 7f43327fc640 1 --2- 172.21.15.19:0/2203443173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4334104f20 0x7f43341983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:14.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.009+0000 7f43337fe640 1 -- 172.21.15.19:0/2203443173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4334104f20 msgr2=0x7f43341983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:14.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.009+0000 7f43337fe640 1 --2- 172.21.15.19:0/2203443173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4334104f20 0x7f43341983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.009+0000 7f43337fe640 1 -- 172.21.15.19:0/2203443173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43341025f0 msgr2=0x7f4334197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:14.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.009+0000 7f43337fe640 1 --2- 172.21.15.19:0/2203443173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43341025f0 0x7f4334197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.009+0000 7f43337fe640 1 -- 172.21.15.19:0/2203443173 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f433419fac0 con 0x7f4334107850 2024-09-19T08:52:14.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.009+0000 7f43337fe640 1 --2- 172.21.15.19:0/2203443173 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4334107850 0x7f433419f450 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f432c00e9d0 tx=0x7f432c00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:14.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.009+0000 7f431bfff640 1 -- 172.21.15.19:0/2203443173 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f432c00cd80 con 0x7f4334107850 2024-09-19T08:52:14.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.009+0000 7f431bfff640 1 -- 172.21.15.19:0/2203443173 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f432c005020 con 0x7f4334107850 2024-09-19T08:52:14.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.009+0000 7f43392c9640 1 -- 172.21.15.19:0/2203443173 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f433419fdb0 con 0x7f4334107850 2024-09-19T08:52:14.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.009+0000 7f431bfff640 1 -- 172.21.15.19:0/2203443173 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f432c0116d0 con 0x7f4334107850 2024-09-19T08:52:14.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.009+0000 7f43392c9640 1 -- 172.21.15.19:0/2203443173 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43341a0220 con 0x7f4334107850 2024-09-19T08:52:14.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.010+0000 7f43392c9640 1 -- 172.21.15.19:0/2203443173 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43340fdc60 con 0x7f4334107850 2024-09-19T08:52:14.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.011+0000 7f431bfff640 1 -- 172.21.15.19:0/2203443173 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f432c0051d0 con 0x7f4334107850 2024-09-19T08:52:14.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.012+0000 7f431bfff640 1 --2- 172.21.15.19:0/2203443173 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f431c0a32e0 0x7f431c0a57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:14.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.012+0000 7f431bfff640 1 -- 172.21.15.19:0/2203443173 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f432c0cfff0 con 0x7f4334107850 2024-09-19T08:52:14.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.012+0000 7f4332ffd640 1 --2- 172.21.15.19:0/2203443173 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f431c0a32e0 0x7f431c0a57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:14.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.013+0000 7f4332ffd640 1 --2- 172.21.15.19:0/2203443173 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f431c0a32e0 0x7f431c0a57a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f43240058c0 tx=0x7f432400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:14.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.017+0000 7f431bfff640 1 -- 172.21.15.19:0/2203443173 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f432c016030 con 0x7f4334107850 2024-09-19T08:52:14.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:13 smithi155 ceph-mon[34921]: pgmap v337: 97 pgs: 97 active+clean; 643 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-19T08:52:14.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:13 smithi155 ceph-mon[34921]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-09-19T08:52:14.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.189+0000 7f43392c9640 1 -- 172.21.15.19:0/2203443173 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4334062630 con 0x7f431c0a32e0 2024-09-19T08:52:14.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.196+0000 7f431bfff640 1 -- 172.21.15.19:0/2203443173 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259039 (secure 0 0 0) 0x7f4334062630 con 0x7f431c0a32e0 2024-09-19T08:52:14.199 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:52:14.200 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-19T08:52:14.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.198+0000 7f43392c9640 1 -- 172.21.15.19:0/2203443173 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f431c0a32e0 msgr2=0x7f431c0a57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:14.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.198+0000 7f43392c9640 1 --2- 172.21.15.19:0/2203443173 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f431c0a32e0 0x7f431c0a57a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f43240058c0 tx=0x7f432400a2d0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.198+0000 7f43392c9640 1 -- 172.21.15.19:0/2203443173 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4334107850 msgr2=0x7f433419f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:14.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.198+0000 7f43392c9640 1 --2- 172.21.15.19:0/2203443173 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4334107850 0x7f433419f450 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f432c00e9d0 tx=0x7f432c00ee90 comp rx=0 tx=0).stop 2024-09-19T08:52:14.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.199+0000 7f43392c9640 1 -- 172.21.15.19:0/2203443173 shutdown_connections 2024-09-19T08:52:14.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.199+0000 7f43392c9640 1 --2- 172.21.15.19:0/2203443173 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f431c0a32e0 0x7f431c0a57a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.199+0000 7f43392c9640 1 --2- 172.21.15.19:0/2203443173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4334104f20 0x7f43341983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.199+0000 7f43392c9640 1 --2- 172.21.15.19:0/2203443173 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4334107850 0x7f433419f450 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.199+0000 7f43392c9640 1 --2- 172.21.15.19:0/2203443173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f43341025f0 0x7f4334197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.199+0000 7f43392c9640 1 -- 172.21.15.19:0/2203443173 >> 172.21.15.19:0/2203443173 conn(0x7f43340fc170 msgr2=0x7f4334102fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:14.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.199+0000 7f43392c9640 1 -- 172.21.15.19:0/2203443173 shutdown_connections 2024-09-19T08:52:14.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.199+0000 7f43392c9640 1 -- 172.21.15.19:0/2203443173 wait complete. 2024-09-19T08:52:14.210 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":338,"stamp":"2024-09-19T08:52:13.875399+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665113,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1216,"num_read_kb":737,"num_write":448,"num_write_kb":3097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1181525,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":867,"ondisk_log_size":867,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":356184,"kb_used_data":11096,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585640,"statfs":{"total":1151940427776,"available":1151575695360,"internally_reserved":0,"allocated":11362304,"data_stored":7174707,"data_compressed":107538,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19142,"internal_metadata":353154362},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7561,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":81,"num_write":15,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002842"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837586+0000","last_change":"2024-09-19T08:50:15.893270+0000","last_active":"2024-09-19T08:51:51.837586+0000","last_peered":"2024-09-19T08:51:51.837586+0000","last_clean":"2024-09-19T08:51:51.837586+0000","last_became_active":"2024-09-19T08:50:15.892020+0000","last_became_peered":"2024-09-19T08:50:15.892020+0000","last_unstale":"2024-09-19T08:51:51.837586+0000","last_undegraded":"2024-09-19T08:51:51.837586+0000","last_fullsized":"2024-09-19T08:51:51.837586+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:40.846708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.834475+0000","last_change":"2024-09-19T08:50:15.889331+0000","last_active":"2024-09-19T08:51:51.834475+0000","last_peered":"2024-09-19T08:51:51.834475+0000","last_clean":"2024-09-19T08:51:51.834475+0000","last_became_active":"2024-09-19T08:50:15.887082+0000","last_became_peered":"2024-09-19T08:50:15.887082+0000","last_unstale":"2024-09-19T08:51:51.834475+0000","last_undegraded":"2024-09-19T08:51:51.834475+0000","last_fullsized":"2024-09-19T08:51:51.834475+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:46.934172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.836646+0000","last_change":"2024-09-19T08:50:15.891714+0000","last_active":"2024-09-19T08:51:51.836646+0000","last_peered":"2024-09-19T08:51:51.836646+0000","last_clean":"2024-09-19T08:51:51.836646+0000","last_became_active":"2024-09-19T08:50:15.891380+0000","last_became_peered":"2024-09-19T08:50:15.891380+0000","last_unstale":"2024-09-19T08:51:51.836646+0000","last_undegraded":"2024-09-19T08:51:51.836646+0000","last_fullsized":"2024-09-19T08:51:51.836646+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:02.203252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.820657+0000","last_change":"2024-09-19T08:50:15.896157+0000","last_active":"2024-09-19T08:51:51.820657+0000","last_peered":"2024-09-19T08:51:51.820657+0000","last_clean":"2024-09-19T08:51:51.820657+0000","last_became_active":"2024-09-19T08:50:15.895772+0000","last_became_peered":"2024-09-19T08:50:15.895772+0000","last_unstale":"2024-09-19T08:51:51.820657+0000","last_undegraded":"2024-09-19T08:51:51.820657+0000","last_fullsized":"2024-09-19T08:51:51.820657+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:12.915745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.819392+0000","last_change":"2024-09-19T08:50:15.886600+0000","last_active":"2024-09-19T08:51:51.819392+0000","last_peered":"2024-09-19T08:51:51.819392+0000","last_clean":"2024-09-19T08:51:51.819392+0000","last_became_active":"2024-09-19T08:50:15.886270+0000","last_became_peered":"2024-09-19T08:50:15.886270+0000","last_unstale":"2024-09-19T08:51:51.819392+0000","last_undegraded":"2024-09-19T08:51:51.819392+0000","last_fullsized":"2024-09-19T08:51:51.819392+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:53.779930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.826597+0000","last_change":"2024-09-19T08:50:15.889475+0000","last_active":"2024-09-19T08:51:51.826597+0000","last_peered":"2024-09-19T08:51:51.826597+0000","last_clean":"2024-09-19T08:51:51.826597+0000","last_became_active":"2024-09-19T08:50:15.889134+0000","last_became_peered":"2024-09-19T08:50:15.889134+0000","last_unstale":"2024-09-19T08:51:51.826597+0000","last_undegraded":"2024-09-19T08:51:51.826597+0000","last_fullsized":"2024-09-19T08:51:51.826597+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:53.977662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829681+0000","last_change":"2024-09-19T08:50:15.897163+0000","last_active":"2024-09-19T08:51:51.829681+0000","last_peered":"2024-09-19T08:51:51.829681+0000","last_clean":"2024-09-19T08:51:51.829681+0000","last_became_active":"2024-09-19T08:50:15.895161+0000","last_became_peered":"2024-09-19T08:50:15.895161+0000","last_unstale":"2024-09-19T08:51:51.829681+0000","last_undegraded":"2024-09-19T08:51:51.829681+0000","last_fullsized":"2024-09-19T08:51:51.829681+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:32.432691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829477+0000","last_change":"2024-09-19T08:50:15.891197+0000","last_active":"2024-09-19T08:51:51.829477+0000","last_peered":"2024-09-19T08:51:51.829477+0000","last_clean":"2024-09-19T08:51:51.829477+0000","last_became_active":"2024-09-19T08:50:15.890880+0000","last_became_peered":"2024-09-19T08:50:15.890880+0000","last_unstale":"2024-09-19T08:51:51.829477+0000","last_undegraded":"2024-09-19T08:51:51.829477+0000","last_fullsized":"2024-09-19T08:51:51.829477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:41.100341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.836501+0000","last_change":"2024-09-19T08:50:15.896043+0000","last_active":"2024-09-19T08:51:51.836501+0000","last_peered":"2024-09-19T08:51:51.836501+0000","last_clean":"2024-09-19T08:51:51.836501+0000","last_became_active":"2024-09-19T08:50:15.895498+0000","last_became_peered":"2024-09-19T08:50:15.895498+0000","last_unstale":"2024-09-19T08:51:51.836501+0000","last_undegraded":"2024-09-19T08:51:51.836501+0000","last_fullsized":"2024-09-19T08:51:51.836501+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:57.956427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.830052+0000","last_change":"2024-09-19T08:50:15.887658+0000","last_active":"2024-09-19T08:51:51.830052+0000","last_peered":"2024-09-19T08:51:51.830052+0000","last_clean":"2024-09-19T08:51:51.830052+0000","last_became_active":"2024-09-19T08:50:15.887199+0000","last_became_peered":"2024-09-19T08:50:15.887199+0000","last_unstale":"2024-09-19T08:51:51.830052+0000","last_undegraded":"2024-09-19T08:51:51.830052+0000","last_fullsized":"2024-09-19T08:51:51.830052+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:39.947735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.834776+0000","last_change":"2024-09-19T08:50:15.894865+0000","last_active":"2024-09-19T08:51:51.834776+0000","last_peered":"2024-09-19T08:51:51.834776+0000","last_clean":"2024-09-19T08:51:51.834776+0000","last_became_active":"2024-09-19T08:50:15.894475+0000","last_became_peered":"2024-09-19T08:50:15.894475+0000","last_unstale":"2024-09-19T08:51:51.834776+0000","last_undegraded":"2024-09-19T08:51:51.834776+0000","last_fullsized":"2024-09-19T08:51:51.834776+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:43.235991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827890+0000","last_change":"2024-09-19T08:50:15.897209+0000","last_active":"2024-09-19T08:51:51.827890+0000","last_peered":"2024-09-19T08:51:51.827890+0000","last_clean":"2024-09-19T08:51:51.827890+0000","last_became_active":"2024-09-19T08:50:15.896866+0000","last_became_peered":"2024-09-19T08:50:15.896866+0000","last_unstale":"2024-09-19T08:51:51.827890+0000","last_undegraded":"2024-09-19T08:51:51.827890+0000","last_fullsized":"2024-09-19T08:51:51.827890+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:23.036534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.825376+0000","last_change":"2024-09-19T08:50:15.890076+0000","last_active":"2024-09-19T08:51:51.825376+0000","last_peered":"2024-09-19T08:51:51.825376+0000","last_clean":"2024-09-19T08:51:51.825376+0000","last_became_active":"2024-09-19T08:50:15.889735+0000","last_became_peered":"2024-09-19T08:50:15.889735+0000","last_unstale":"2024-09-19T08:51:51.825376+0000","last_undegraded":"2024-09-19T08:51:51.825376+0000","last_fullsized":"2024-09-19T08:51:51.825376+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:25.602757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.834241+0000","last_change":"2024-09-19T08:50:15.886739+0000","last_active":"2024-09-19T08:51:51.834241+0000","last_peered":"2024-09-19T08:51:51.834241+0000","last_clean":"2024-09-19T08:51:51.834241+0000","last_became_active":"2024-09-19T08:50:15.886313+0000","last_became_peered":"2024-09-19T08:50:15.886313+0000","last_unstale":"2024-09-19T08:51:51.834241+0000","last_undegraded":"2024-09-19T08:51:51.834241+0000","last_fullsized":"2024-09-19T08:51:51.834241+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:03.244674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837276+0000","last_change":"2024-09-19T08:50:15.898519+0000","last_active":"2024-09-19T08:51:51.837276+0000","last_peered":"2024-09-19T08:51:51.837276+0000","last_clean":"2024-09-19T08:51:51.837276+0000","last_became_active":"2024-09-19T08:50:15.898249+0000","last_became_peered":"2024-09-19T08:50:15.898249+0000","last_unstale":"2024-09-19T08:51:51.837276+0000","last_undegraded":"2024-09-19T08:51:51.837276+0000","last_fullsized":"2024-09-19T08:51:51.837276+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:32.318895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837455+0000","last_change":"2024-09-19T08:50:15.890324+0000","last_active":"2024-09-19T08:51:51.837455+0000","last_peered":"2024-09-19T08:51:51.837455+0000","last_clean":"2024-09-19T08:51:51.837455+0000","last_became_active":"2024-09-19T08:50:15.887345+0000","last_became_peered":"2024-09-19T08:50:15.887345+0000","last_unstale":"2024-09-19T08:51:51.837455+0000","last_undegraded":"2024-09-19T08:51:51.837455+0000","last_fullsized":"2024-09-19T08:51:51.837455+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:27.989128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837724+0000","last_change":"2024-09-19T08:50:15.896305+0000","last_active":"2024-09-19T08:51:51.837724+0000","last_peered":"2024-09-19T08:51:51.837724+0000","last_clean":"2024-09-19T08:51:51.837724+0000","last_became_active":"2024-09-19T08:50:15.895832+0000","last_became_peered":"2024-09-19T08:50:15.895832+0000","last_unstale":"2024-09-19T08:51:51.837724+0000","last_undegraded":"2024-09-19T08:51:51.837724+0000","last_fullsized":"2024-09-19T08:51:51.837724+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:37.098237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.821237+0000","last_change":"2024-09-19T08:50:15.887251+0000","last_active":"2024-09-19T08:51:51.821237+0000","last_peered":"2024-09-19T08:51:51.821237+0000","last_clean":"2024-09-19T08:51:51.821237+0000","last_became_active":"2024-09-19T08:50:15.886936+0000","last_became_peered":"2024-09-19T08:50:15.886936+0000","last_unstale":"2024-09-19T08:51:51.821237+0000","last_undegraded":"2024-09-19T08:51:51.821237+0000","last_fullsized":"2024-09-19T08:51:51.821237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:38:08.828246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827071+0000","last_change":"2024-09-19T08:50:15.884813+0000","last_active":"2024-09-19T08:51:51.827071+0000","last_peered":"2024-09-19T08:51:51.827071+0000","last_clean":"2024-09-19T08:51:51.827071+0000","last_became_active":"2024-09-19T08:50:15.883445+0000","last_became_peered":"2024-09-19T08:50:15.883445+0000","last_unstale":"2024-09-19T08:51:51.827071+0000","last_undegraded":"2024-09-19T08:51:51.827071+0000","last_fullsized":"2024-09-19T08:51:51.827071+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:39.733501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.821368+0000","last_change":"2024-09-19T08:50:15.887644+0000","last_active":"2024-09-19T08:51:51.821368+0000","last_peered":"2024-09-19T08:51:51.821368+0000","last_clean":"2024-09-19T08:51:51.821368+0000","last_became_active":"2024-09-19T08:50:15.887224+0000","last_became_peered":"2024-09-19T08:50:15.887224+0000","last_unstale":"2024-09-19T08:51:51.821368+0000","last_undegraded":"2024-09-19T08:51:51.821368+0000","last_fullsized":"2024-09-19T08:51:51.821368+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:35.883690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.835961+0000","last_change":"2024-09-19T08:50:15.886678+0000","last_active":"2024-09-19T08:51:51.835961+0000","last_peered":"2024-09-19T08:51:51.835961+0000","last_clean":"2024-09-19T08:51:51.835961+0000","last_became_active":"2024-09-19T08:50:15.886360+0000","last_became_peered":"2024-09-19T08:50:15.886360+0000","last_unstale":"2024-09-19T08:51:51.835961+0000","last_undegraded":"2024-09-19T08:51:51.835961+0000","last_fullsized":"2024-09-19T08:51:51.835961+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:51.515211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.832052+0000","last_change":"2024-09-19T08:50:15.887607+0000","last_active":"2024-09-19T08:51:51.832052+0000","last_peered":"2024-09-19T08:51:51.832052+0000","last_clean":"2024-09-19T08:51:51.832052+0000","last_became_active":"2024-09-19T08:50:15.887266+0000","last_became_peered":"2024-09-19T08:50:15.887266+0000","last_unstale":"2024-09-19T08:51:51.832052+0000","last_undegraded":"2024-09-19T08:51:51.832052+0000","last_fullsized":"2024-09-19T08:51:51.832052+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:44:57.404160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829136+0000","last_change":"2024-09-19T08:50:15.882651+0000","last_active":"2024-09-19T08:51:51.829136+0000","last_peered":"2024-09-19T08:51:51.829136+0000","last_clean":"2024-09-19T08:51:51.829136+0000","last_became_active":"2024-09-19T08:50:15.882298+0000","last_became_peered":"2024-09-19T08:50:15.882298+0000","last_unstale":"2024-09-19T08:51:51.829136+0000","last_undegraded":"2024-09-19T08:51:51.829136+0000","last_fullsized":"2024-09-19T08:51:51.829136+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:16.028013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829040+0000","last_change":"2024-09-19T08:50:15.880407+0000","last_active":"2024-09-19T08:51:51.829040+0000","last_peered":"2024-09-19T08:51:51.829040+0000","last_clean":"2024-09-19T08:51:51.829040+0000","last_became_active":"2024-09-19T08:50:15.880026+0000","last_became_peered":"2024-09-19T08:50:15.880026+0000","last_unstale":"2024-09-19T08:51:51.829040+0000","last_undegraded":"2024-09-19T08:51:51.829040+0000","last_fullsized":"2024-09-19T08:51:51.829040+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:16.600913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.828745+0000","last_change":"2024-09-19T08:50:15.883573+0000","last_active":"2024-09-19T08:51:51.828745+0000","last_peered":"2024-09-19T08:51:51.828745+0000","last_clean":"2024-09-19T08:51:51.828745+0000","last_became_active":"2024-09-19T08:50:15.883258+0000","last_became_peered":"2024-09-19T08:50:15.883258+0000","last_unstale":"2024-09-19T08:51:51.828745+0000","last_undegraded":"2024-09-19T08:51:51.828745+0000","last_fullsized":"2024-09-19T08:51:51.828745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:33.026579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827776+0000","last_change":"2024-09-19T08:50:15.889519+0000","last_active":"2024-09-19T08:51:51.827776+0000","last_peered":"2024-09-19T08:51:51.827776+0000","last_clean":"2024-09-19T08:51:51.827776+0000","last_became_active":"2024-09-19T08:50:15.889183+0000","last_became_peered":"2024-09-19T08:50:15.889183+0000","last_unstale":"2024-09-19T08:51:51.827776+0000","last_undegraded":"2024-09-19T08:51:51.827776+0000","last_fullsized":"2024-09-19T08:51:51.827776+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:06.725662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.821674+0000","last_change":"2024-09-19T08:50:15.894483+0000","last_active":"2024-09-19T08:51:51.821674+0000","last_peered":"2024-09-19T08:51:51.821674+0000","last_clean":"2024-09-19T08:51:51.821674+0000","last_became_active":"2024-09-19T08:50:15.893760+0000","last_became_peered":"2024-09-19T08:50:15.893760+0000","last_unstale":"2024-09-19T08:51:51.821674+0000","last_undegraded":"2024-09-19T08:51:51.821674+0000","last_fullsized":"2024-09-19T08:51:51.821674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:23.686592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.835380+0000","last_change":"2024-09-19T08:50:15.882393+0000","last_active":"2024-09-19T08:51:51.835380+0000","last_peered":"2024-09-19T08:51:51.835380+0000","last_clean":"2024-09-19T08:51:51.835380+0000","last_became_active":"2024-09-19T08:50:15.882040+0000","last_became_peered":"2024-09-19T08:50:15.882040+0000","last_unstale":"2024-09-19T08:51:51.835380+0000","last_undegraded":"2024-09-19T08:51:51.835380+0000","last_fullsized":"2024-09-19T08:51:51.835380+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:22.430017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837471+0000","last_change":"2024-09-19T08:50:15.890919+0000","last_active":"2024-09-19T08:51:51.837471+0000","last_peered":"2024-09-19T08:51:51.837471+0000","last_clean":"2024-09-19T08:51:51.837471+0000","last_became_active":"2024-09-19T08:50:15.890256+0000","last_became_peered":"2024-09-19T08:50:15.890256+0000","last_unstale":"2024-09-19T08:51:51.837471+0000","last_undegraded":"2024-09-19T08:51:51.837471+0000","last_fullsized":"2024-09-19T08:51:51.837471+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:48.404890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827490+0000","last_change":"2024-09-19T08:50:15.888139+0000","last_active":"2024-09-19T08:51:51.827490+0000","last_peered":"2024-09-19T08:51:51.827490+0000","last_clean":"2024-09-19T08:51:51.827490+0000","last_became_active":"2024-09-19T08:50:15.886471+0000","last_became_peered":"2024-09-19T08:50:15.886471+0000","last_unstale":"2024-09-19T08:51:51.827490+0000","last_undegraded":"2024-09-19T08:51:51.827490+0000","last_fullsized":"2024-09-19T08:51:51.827490+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:20.545473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.822777+0000","last_change":"2024-09-19T08:50:15.891354+0000","last_active":"2024-09-19T08:51:51.822777+0000","last_peered":"2024-09-19T08:51:51.822777+0000","last_clean":"2024-09-19T08:51:51.822777+0000","last_became_active":"2024-09-19T08:50:15.890900+0000","last_became_peered":"2024-09-19T08:50:15.890900+0000","last_unstale":"2024-09-19T08:51:51.822777+0000","last_undegraded":"2024-09-19T08:51:51.822777+0000","last_fullsized":"2024-09-19T08:51:51.822777+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:33.139637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.828631+0000","last_change":"2024-09-19T08:50:15.891501+0000","last_active":"2024-09-19T08:51:51.828631+0000","last_peered":"2024-09-19T08:51:51.828631+0000","last_clean":"2024-09-19T08:51:51.828631+0000","last_became_active":"2024-09-19T08:50:15.891183+0000","last_became_peered":"2024-09-19T08:50:15.891183+0000","last_unstale":"2024-09-19T08:51:51.828631+0000","last_undegraded":"2024-09-19T08:51:51.828631+0000","last_fullsized":"2024-09-19T08:51:51.828631+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:16.976705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.819783+0000","last_change":"2024-09-19T08:50:15.882048+0000","last_active":"2024-09-19T08:51:51.819783+0000","last_peered":"2024-09-19T08:51:51.819783+0000","last_clean":"2024-09-19T08:51:51.819783+0000","last_became_active":"2024-09-19T08:50:15.881156+0000","last_became_peered":"2024-09-19T08:50:15.881156+0000","last_unstale":"2024-09-19T08:51:51.819783+0000","last_undegraded":"2024-09-19T08:51:51.819783+0000","last_fullsized":"2024-09-19T08:51:51.819783+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:33.198852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":134,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:10.113581+0000","last_change":"2024-09-19T08:50:13.800156+0000","last_active":"2024-09-19T08:52:10.113581+0000","last_peered":"2024-09-19T08:52:10.113581+0000","last_clean":"2024-09-19T08:52:10.113581+0000","last_became_active":"2024-09-19T08:50:13.799779+0000","last_became_peered":"2024-09-19T08:50:13.799779+0000","last_unstale":"2024-09-19T08:52:10.113581+0000","last_undegraded":"2024-09-19T08:52:10.113581+0000","last_fullsized":"2024-09-19T08:52:10.113581+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:38.033049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.826996+0000","last_change":"2024-09-19T08:50:15.887252+0000","last_active":"2024-09-19T08:51:51.826996+0000","last_peered":"2024-09-19T08:51:51.826996+0000","last_clean":"2024-09-19T08:51:51.826996+0000","last_became_active":"2024-09-19T08:50:15.886899+0000","last_became_peered":"2024-09-19T08:50:15.886899+0000","last_unstale":"2024-09-19T08:51:51.826996+0000","last_undegraded":"2024-09-19T08:51:51.826996+0000","last_fullsized":"2024-09-19T08:51:51.826996+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:56.262387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.556154+0000","last_change":"2024-09-19T08:51:23.556154+0000","last_active":"2024-09-19T08:51:23.556154+0000","last_peered":"2024-09-19T08:51:23.556154+0000","last_clean":"2024-09-19T08:51:23.556154+0000","last_became_active":"2024-09-19T08:51:23.549418+0000","last_became_peered":"2024-09-19T08:51:23.549418+0000","last_unstale":"2024-09-19T08:51:23.556154+0000","last_undegraded":"2024-09-19T08:51:23.556154+0000","last_fullsized":"2024-09-19T08:51:23.556154+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:35.225465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.540195+0000","last_change":"2024-09-19T08:50:13.794010+0000","last_active":"2024-09-19T08:51:23.540195+0000","last_peered":"2024-09-19T08:51:23.540195+0000","last_clean":"2024-09-19T08:51:23.540195+0000","last_became_active":"2024-09-19T08:50:13.793677+0000","last_became_peered":"2024-09-19T08:50:13.793677+0000","last_unstale":"2024-09-19T08:51:23.540195+0000","last_undegraded":"2024-09-19T08:51:23.540195+0000","last_fullsized":"2024-09-19T08:51:23.540195+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:56.125702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827232+0000","last_change":"2024-09-19T08:50:15.881732+0000","last_active":"2024-09-19T08:51:51.827232+0000","last_peered":"2024-09-19T08:51:51.827232+0000","last_clean":"2024-09-19T08:51:51.827232+0000","last_became_active":"2024-09-19T08:50:15.881394+0000","last_became_peered":"2024-09-19T08:50:15.881394+0000","last_unstale":"2024-09-19T08:51:51.827232+0000","last_undegraded":"2024-09-19T08:51:51.827232+0000","last_fullsized":"2024-09-19T08:51:51.827232+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:55.549138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.544525+0000","last_change":"2024-09-19T08:50:13.797118+0000","last_active":"2024-09-19T08:51:23.544525+0000","last_peered":"2024-09-19T08:51:23.544525+0000","last_clean":"2024-09-19T08:51:23.544525+0000","last_became_active":"2024-09-19T08:50:13.796727+0000","last_became_peered":"2024-09-19T08:50:13.796727+0000","last_unstale":"2024-09-19T08:51:23.544525+0000","last_undegraded":"2024-09-19T08:51:23.544525+0000","last_fullsized":"2024-09-19T08:51:23.544525+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:49.310543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.824911+0000","last_change":"2024-09-19T08:50:15.888192+0000","last_active":"2024-09-19T08:51:51.824911+0000","last_peered":"2024-09-19T08:51:51.824911+0000","last_clean":"2024-09-19T08:51:51.824911+0000","last_became_active":"2024-09-19T08:50:15.887890+0000","last_became_peered":"2024-09-19T08:50:15.887890+0000","last_unstale":"2024-09-19T08:51:51.824911+0000","last_undegraded":"2024-09-19T08:51:51.824911+0000","last_fullsized":"2024-09-19T08:51:51.824911+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:24:48.951856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'6","reported_seq":240,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:13.088220+0000","last_change":"2024-09-19T08:50:13.797427+0000","last_active":"2024-09-19T08:52:13.088220+0000","last_peered":"2024-09-19T08:52:13.088220+0000","last_clean":"2024-09-19T08:52:13.088220+0000","last_became_active":"2024-09-19T08:50:13.797021+0000","last_became_peered":"2024-09-19T08:50:13.797021+0000","last_unstale":"2024-09-19T08:52:13.088220+0000","last_undegraded":"2024-09-19T08:52:13.088220+0000","last_fullsized":"2024-09-19T08:52:13.088220+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:14.530373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":212,"num_read_kb":212,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837299+0000","last_change":"2024-09-19T08:50:15.894619+0000","last_active":"2024-09-19T08:51:51.837299+0000","last_peered":"2024-09-19T08:51:51.837299+0000","last_clean":"2024-09-19T08:51:51.837299+0000","last_became_active":"2024-09-19T08:50:15.894258+0000","last_became_peered":"2024-09-19T08:50:15.894258+0000","last_unstale":"2024-09-19T08:51:51.837299+0000","last_undegraded":"2024-09-19T08:51:51.837299+0000","last_fullsized":"2024-09-19T08:51:51.837299+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:13.137314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.559196+0000","last_change":"2024-09-19T08:51:23.559196+0000","last_active":"2024-09-19T08:51:23.559196+0000","last_peered":"2024-09-19T08:51:23.559196+0000","last_clean":"2024-09-19T08:51:23.559196+0000","last_became_active":"2024-09-19T08:51:23.549412+0000","last_became_peered":"2024-09-19T08:51:23.549412+0000","last_unstale":"2024-09-19T08:51:23.559196+0000","last_undegraded":"2024-09-19T08:51:23.559196+0000","last_fullsized":"2024-09-19T08:51:23.559196+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:38.145697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837760+0000","last_change":"2024-09-19T08:50:15.891121+0000","last_active":"2024-09-19T08:51:51.837760+0000","last_peered":"2024-09-19T08:51:51.837760+0000","last_clean":"2024-09-19T08:51:51.837760+0000","last_became_active":"2024-09-19T08:50:15.890810+0000","last_became_peered":"2024-09-19T08:50:15.890810+0000","last_unstale":"2024-09-19T08:51:51.837760+0000","last_undegraded":"2024-09-19T08:51:51.837760+0000","last_fullsized":"2024-09-19T08:51:51.837760+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:13.010282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.545394+0000","last_change":"2024-09-19T08:50:14.293953+0000","last_active":"2024-09-19T08:51:23.545394+0000","last_peered":"2024-09-19T08:51:23.545394+0000","last_clean":"2024-09-19T08:51:23.545394+0000","last_became_active":"2024-09-19T08:50:14.293546+0000","last_became_peered":"2024-09-19T08:50:14.293546+0000","last_unstale":"2024-09-19T08:51:23.545394+0000","last_undegraded":"2024-09-19T08:51:23.545394+0000","last_fullsized":"2024-09-19T08:51:23.545394+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:27.809243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.836318+0000","last_change":"2024-09-19T08:50:15.878300+0000","last_active":"2024-09-19T08:51:51.836318+0000","last_peered":"2024-09-19T08:51:51.836318+0000","last_clean":"2024-09-19T08:51:51.836318+0000","last_became_active":"2024-09-19T08:50:15.877938+0000","last_became_peered":"2024-09-19T08:50:15.877938+0000","last_unstale":"2024-09-19T08:51:51.836318+0000","last_undegraded":"2024-09-19T08:51:51.836318+0000","last_fullsized":"2024-09-19T08:51:51.836318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:05.376708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'35","reported_seq":279,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:13.088187+0000","last_change":"2024-09-19T08:50:13.800696+0000","last_active":"2024-09-19T08:52:13.088187+0000","last_peered":"2024-09-19T08:52:13.088187+0000","last_clean":"2024-09-19T08:52:13.088187+0000","last_became_active":"2024-09-19T08:50:13.799385+0000","last_became_peered":"2024-09-19T08:50:13.799385+0000","last_unstale":"2024-09-19T08:52:13.088187+0000","last_undegraded":"2024-09-19T08:52:13.088187+0000","last_fullsized":"2024-09-19T08:52:13.088187+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:56.897309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65534,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":222,"num_read_kb":174,"num_write":37,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.820658+0000","last_change":"2024-09-19T08:50:15.891483+0000","last_active":"2024-09-19T08:51:51.820658+0000","last_peered":"2024-09-19T08:51:51.820658+0000","last_clean":"2024-09-19T08:51:51.820658+0000","last_became_active":"2024-09-19T08:50:15.891185+0000","last_became_peered":"2024-09-19T08:50:15.891185+0000","last_unstale":"2024-09-19T08:51:51.820658+0000","last_undegraded":"2024-09-19T08:51:51.820658+0000","last_fullsized":"2024-09-19T08:51:51.820658+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:26.599151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.548669+0000","last_change":"2024-09-19T08:50:13.795148+0000","last_active":"2024-09-19T08:51:23.548669+0000","last_peered":"2024-09-19T08:51:23.548669+0000","last_clean":"2024-09-19T08:51:23.548669+0000","last_became_active":"2024-09-19T08:50:13.794688+0000","last_became_peered":"2024-09-19T08:50:13.794688+0000","last_unstale":"2024-09-19T08:51:23.548669+0000","last_undegraded":"2024-09-19T08:51:23.548669+0000","last_fullsized":"2024-09-19T08:51:23.548669+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:01.366439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.832390+0000","last_change":"2024-09-19T08:50:15.886449+0000","last_active":"2024-09-19T08:51:51.832390+0000","last_peered":"2024-09-19T08:51:51.832390+0000","last_clean":"2024-09-19T08:51:51.832390+0000","last_became_active":"2024-09-19T08:50:15.886119+0000","last_became_peered":"2024-09-19T08:50:15.886119+0000","last_unstale":"2024-09-19T08:51:51.832390+0000","last_undegraded":"2024-09-19T08:51:51.832390+0000","last_fullsized":"2024-09-19T08:51:51.832390+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:22.916593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.544525+0000","last_change":"2024-09-19T08:50:13.799363+0000","last_active":"2024-09-19T08:51:23.544525+0000","last_peered":"2024-09-19T08:51:23.544525+0000","last_clean":"2024-09-19T08:51:23.544525+0000","last_became_active":"2024-09-19T08:50:13.799033+0000","last_became_peered":"2024-09-19T08:50:13.799033+0000","last_unstale":"2024-09-19T08:51:23.544525+0000","last_undegraded":"2024-09-19T08:51:23.544525+0000","last_fullsized":"2024-09-19T08:51:23.544525+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:57.753451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837083+0000","last_change":"2024-09-19T08:50:15.898902+0000","last_active":"2024-09-19T08:51:51.837083+0000","last_peered":"2024-09-19T08:51:51.837083+0000","last_clean":"2024-09-19T08:51:51.837083+0000","last_became_active":"2024-09-19T08:50:15.898417+0000","last_became_peered":"2024-09-19T08:50:15.898417+0000","last_unstale":"2024-09-19T08:51:51.837083+0000","last_undegraded":"2024-09-19T08:51:51.837083+0000","last_fullsized":"2024-09-19T08:51:51.837083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:32:19.799301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'9","reported_seq":142,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:11.086095+0000","last_change":"2024-09-19T08:50:13.798477+0000","last_active":"2024-09-19T08:52:11.086095+0000","last_peered":"2024-09-19T08:52:11.086095+0000","last_clean":"2024-09-19T08:52:11.086095+0000","last_became_active":"2024-09-19T08:50:13.798136+0000","last_became_peered":"2024-09-19T08:50:13.798136+0000","last_unstale":"2024-09-19T08:52:11.086095+0000","last_undegraded":"2024-09-19T08:52:11.086095+0000","last_fullsized":"2024-09-19T08:52:11.086095+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:33.874285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1823,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":7,"num_write":9,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829630+0000","last_change":"2024-09-19T08:50:15.896414+0000","last_active":"2024-09-19T08:51:51.829630+0000","last_peered":"2024-09-19T08:51:51.829630+0000","last_clean":"2024-09-19T08:51:51.829630+0000","last_became_active":"2024-09-19T08:50:15.895530+0000","last_became_peered":"2024-09-19T08:50:15.895530+0000","last_unstale":"2024-09-19T08:51:51.829630+0000","last_undegraded":"2024-09-19T08:51:51.829630+0000","last_fullsized":"2024-09-19T08:51:51.829630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:59.717869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.545962+0000","last_change":"2024-09-19T08:50:14.294087+0000","last_active":"2024-09-19T08:51:23.545962+0000","last_peered":"2024-09-19T08:51:23.545962+0000","last_clean":"2024-09-19T08:51:23.545962+0000","last_became_active":"2024-09-19T08:50:14.293712+0000","last_became_peered":"2024-09-19T08:50:14.293712+0000","last_unstale":"2024-09-19T08:51:23.545962+0000","last_undegraded":"2024-09-19T08:51:23.545962+0000","last_fullsized":"2024-09-19T08:51:23.545962+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:12.187514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.835719+0000","last_change":"2024-09-19T08:50:15.888134+0000","last_active":"2024-09-19T08:51:51.835719+0000","last_peered":"2024-09-19T08:51:51.835719+0000","last_clean":"2024-09-19T08:51:51.835719+0000","last_became_active":"2024-09-19T08:50:15.887768+0000","last_became_peered":"2024-09-19T08:50:15.887768+0000","last_unstale":"2024-09-19T08:51:51.835719+0000","last_undegraded":"2024-09-19T08:51:51.835719+0000","last_fullsized":"2024-09-19T08:51:51.835719+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:12.868773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.547326+0000","last_change":"2024-09-19T08:50:13.792585+0000","last_active":"2024-09-19T08:51:23.547326+0000","last_peered":"2024-09-19T08:51:23.547326+0000","last_clean":"2024-09-19T08:51:23.547326+0000","last_became_active":"2024-09-19T08:50:13.792222+0000","last_became_peered":"2024-09-19T08:50:13.792222+0000","last_unstale":"2024-09-19T08:51:23.547326+0000","last_undegraded":"2024-09-19T08:51:23.547326+0000","last_fullsized":"2024-09-19T08:51:23.547326+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:45.234800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.818076+0000","last_change":"2024-09-19T08:51:23.549003+0000","last_active":"2024-09-19T08:51:51.818076+0000","last_peered":"2024-09-19T08:51:51.818076+0000","last_clean":"2024-09-19T08:51:51.818076+0000","last_became_active":"2024-09-19T08:51:23.548611+0000","last_became_peered":"2024-09-19T08:51:23.548611+0000","last_unstale":"2024-09-19T08:51:51.818076+0000","last_undegraded":"2024-09-19T08:51:51.818076+0000","last_fullsized":"2024-09-19T08:51:51.818076+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:00.043092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.540568+0000","last_change":"2024-09-19T08:50:13.795360+0000","last_active":"2024-09-19T08:51:23.540568+0000","last_peered":"2024-09-19T08:51:23.540568+0000","last_clean":"2024-09-19T08:51:23.540568+0000","last_became_active":"2024-09-19T08:50:13.794823+0000","last_became_peered":"2024-09-19T08:50:13.794823+0000","last_unstale":"2024-09-19T08:51:23.540568+0000","last_undegraded":"2024-09-19T08:51:23.540568+0000","last_fullsized":"2024-09-19T08:51:23.540568+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:15.037834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.822420+0000","last_change":"2024-09-19T08:50:15.893668+0000","last_active":"2024-09-19T08:51:51.822420+0000","last_peered":"2024-09-19T08:51:51.822420+0000","last_clean":"2024-09-19T08:51:51.822420+0000","last_became_active":"2024-09-19T08:50:15.893303+0000","last_became_peered":"2024-09-19T08:50:15.893303+0000","last_unstale":"2024-09-19T08:51:51.822420+0000","last_undegraded":"2024-09-19T08:51:51.822420+0000","last_fullsized":"2024-09-19T08:51:51.822420+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:59.281601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.545777+0000","last_change":"2024-09-19T08:50:13.797442+0000","last_active":"2024-09-19T08:51:23.545777+0000","last_peered":"2024-09-19T08:51:23.545777+0000","last_clean":"2024-09-19T08:51:23.545777+0000","last_became_active":"2024-09-19T08:50:13.797072+0000","last_became_peered":"2024-09-19T08:50:13.797072+0000","last_unstale":"2024-09-19T08:51:23.545777+0000","last_undegraded":"2024-09-19T08:51:23.545777+0000","last_fullsized":"2024-09-19T08:51:23.545777+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:32.960928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829292+0000","last_change":"2024-09-19T08:51:23.554271+0000","last_active":"2024-09-19T08:51:51.829292+0000","last_peered":"2024-09-19T08:51:51.829292+0000","last_clean":"2024-09-19T08:51:51.829292+0000","last_became_active":"2024-09-19T08:51:23.547630+0000","last_became_peered":"2024-09-19T08:51:23.547630+0000","last_unstale":"2024-09-19T08:51:51.829292+0000","last_undegraded":"2024-09-19T08:51:51.829292+0000","last_fullsized":"2024-09-19T08:51:51.829292+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:39.033522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'7","reported_seq":136,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:09.082570+0000","last_change":"2024-09-19T08:50:14.294014+0000","last_active":"2024-09-19T08:52:09.082570+0000","last_peered":"2024-09-19T08:52:09.082570+0000","last_clean":"2024-09-19T08:52:09.082570+0000","last_became_active":"2024-09-19T08:50:14.293564+0000","last_became_peered":"2024-09-19T08:50:14.293564+0000","last_unstale":"2024-09-19T08:52:09.082570+0000","last_undegraded":"2024-09-19T08:52:09.082570+0000","last_fullsized":"2024-09-19T08:52:09.082570+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:23.806408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1704,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":107,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.834993+0000","last_change":"2024-09-19T08:50:15.891840+0000","last_active":"2024-09-19T08:51:51.834993+0000","last_peered":"2024-09-19T08:51:51.834993+0000","last_clean":"2024-09-19T08:51:51.834993+0000","last_became_active":"2024-09-19T08:50:15.891511+0000","last_became_peered":"2024-09-19T08:50:15.891511+0000","last_unstale":"2024-09-19T08:51:51.834993+0000","last_undegraded":"2024-09-19T08:51:51.834993+0000","last_fullsized":"2024-09-19T08:51:51.834993+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:26.800508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":332,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.545171+0000","last_change":"2024-09-19T08:49:02.071497+0000","last_active":"2024-09-19T08:51:23.545171+0000","last_peered":"2024-09-19T08:51:23.545171+0000","last_clean":"2024-09-19T08:51:23.545171+0000","last_became_active":"2024-09-19T08:49:02.071114+0000","last_became_peered":"2024-09-19T08:49:02.071114+0000","last_unstale":"2024-09-19T08:51:23.545171+0000","last_undegraded":"2024-09-19T08:51:23.545171+0000","last_fullsized":"2024-09-19T08:51:23.545171+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:45:36.600595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:45:36.600595+0000","last_clean_scrub_stamp":"2024-09-19T08:45:36.600595+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:18:15.369279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.541800+0000","last_change":"2024-09-19T08:50:13.793981+0000","last_active":"2024-09-19T08:51:23.541800+0000","last_peered":"2024-09-19T08:51:23.541800+0000","last_clean":"2024-09-19T08:51:23.541800+0000","last_became_active":"2024-09-19T08:50:13.793616+0000","last_became_peered":"2024-09-19T08:50:13.793616+0000","last_unstale":"2024-09-19T08:51:23.541800+0000","last_undegraded":"2024-09-19T08:51:23.541800+0000","last_fullsized":"2024-09-19T08:51:23.541800+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:45.195906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.828840+0000","last_change":"2024-09-19T08:50:15.891248+0000","last_active":"2024-09-19T08:51:51.828840+0000","last_peered":"2024-09-19T08:51:51.828840+0000","last_clean":"2024-09-19T08:51:51.828840+0000","last_became_active":"2024-09-19T08:50:15.890922+0000","last_became_peered":"2024-09-19T08:50:15.890922+0000","last_unstale":"2024-09-19T08:51:51.828840+0000","last_undegraded":"2024-09-19T08:51:51.828840+0000","last_fullsized":"2024-09-19T08:51:51.828840+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:18:43.914214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.545014+0000","last_change":"2024-09-19T08:50:13.797471+0000","last_active":"2024-09-19T08:51:23.545014+0000","last_peered":"2024-09-19T08:51:23.545014+0000","last_clean":"2024-09-19T08:51:23.545014+0000","last_became_active":"2024-09-19T08:50:13.797033+0000","last_became_peered":"2024-09-19T08:50:13.797033+0000","last_unstale":"2024-09-19T08:51:23.545014+0000","last_undegraded":"2024-09-19T08:51:23.545014+0000","last_fullsized":"2024-09-19T08:51:23.545014+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:53.141708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.821571+0000","last_change":"2024-09-19T08:50:15.882650+0000","last_active":"2024-09-19T08:51:51.821571+0000","last_peered":"2024-09-19T08:51:51.821571+0000","last_clean":"2024-09-19T08:51:51.821571+0000","last_became_active":"2024-09-19T08:50:15.882308+0000","last_became_peered":"2024-09-19T08:50:15.882308+0000","last_unstale":"2024-09-19T08:51:51.821571+0000","last_undegraded":"2024-09-19T08:51:51.821571+0000","last_fullsized":"2024-09-19T08:51:51.821571+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:26.449562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'7","reported_seq":133,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:09.081631+0000","last_change":"2024-09-19T08:50:14.292466+0000","last_active":"2024-09-19T08:52:09.081631+0000","last_peered":"2024-09-19T08:52:09.081631+0000","last_clean":"2024-09-19T08:52:09.081631+0000","last_became_active":"2024-09-19T08:50:14.292092+0000","last_became_peered":"2024-09-19T08:50:14.292092+0000","last_unstale":"2024-09-19T08:52:09.081631+0000","last_undegraded":"2024-09-19T08:52:09.081631+0000","last_fullsized":"2024-09-19T08:52:09.081631+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:11.373226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":104,"num_read_kb":104,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.825695+0000","last_change":"2024-09-19T08:51:23.551606+0000","last_active":"2024-09-19T08:51:51.825695+0000","last_peered":"2024-09-19T08:51:51.825695+0000","last_clean":"2024-09-19T08:51:51.825695+0000","last_became_active":"2024-09-19T08:51:23.551181+0000","last_became_peered":"2024-09-19T08:51:23.551181+0000","last_unstale":"2024-09-19T08:51:51.825695+0000","last_undegraded":"2024-09-19T08:51:51.825695+0000","last_fullsized":"2024-09-19T08:51:51.825695+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:05.577651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'6","reported_seq":133,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:10.612221+0000","last_change":"2024-09-19T08:50:13.799909+0000","last_active":"2024-09-19T08:52:10.612221+0000","last_peered":"2024-09-19T08:52:10.612221+0000","last_clean":"2024-09-19T08:52:10.612221+0000","last_became_active":"2024-09-19T08:50:13.799542+0000","last_became_peered":"2024-09-19T08:50:13.799542+0000","last_unstale":"2024-09-19T08:52:10.612221+0000","last_undegraded":"2024-09-19T08:52:10.612221+0000","last_fullsized":"2024-09-19T08:52:10.612221+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:23.545897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837020+0000","last_change":"2024-09-19T08:51:24.482934+0000","last_active":"2024-09-19T08:51:51.837020+0000","last_peered":"2024-09-19T08:51:51.837020+0000","last_clean":"2024-09-19T08:51:51.837020+0000","last_became_active":"2024-09-19T08:51:24.482586+0000","last_became_peered":"2024-09-19T08:51:24.482586+0000","last_unstale":"2024-09-19T08:51:51.837020+0000","last_undegraded":"2024-09-19T08:51:51.837020+0000","last_fullsized":"2024-09-19T08:51:51.837020+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:15.121449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.543078+0000","last_change":"2024-09-19T08:50:14.292577+0000","last_active":"2024-09-19T08:51:23.543078+0000","last_peered":"2024-09-19T08:51:23.543078+0000","last_clean":"2024-09-19T08:51:23.543078+0000","last_became_active":"2024-09-19T08:50:14.292220+0000","last_became_peered":"2024-09-19T08:50:14.292220+0000","last_unstale":"2024-09-19T08:51:23.543078+0000","last_undegraded":"2024-09-19T08:51:23.543078+0000","last_fullsized":"2024-09-19T08:51:23.543078+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:23.631672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827650+0000","last_change":"2024-09-19T08:50:15.891345+0000","last_active":"2024-09-19T08:51:51.827650+0000","last_peered":"2024-09-19T08:51:51.827650+0000","last_clean":"2024-09-19T08:51:51.827650+0000","last_became_active":"2024-09-19T08:50:15.891006+0000","last_became_peered":"2024-09-19T08:50:15.891006+0000","last_unstale":"2024-09-19T08:51:51.827650+0000","last_undegraded":"2024-09-19T08:51:51.827650+0000","last_fullsized":"2024-09-19T08:51:51.827650+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:41.934331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.546914+0000","last_change":"2024-09-19T08:50:14.292619+0000","last_active":"2024-09-19T08:51:23.546914+0000","last_peered":"2024-09-19T08:51:23.546914+0000","last_clean":"2024-09-19T08:51:23.546914+0000","last_became_active":"2024-09-19T08:50:14.292230+0000","last_became_peered":"2024-09-19T08:50:14.292230+0000","last_unstale":"2024-09-19T08:51:23.546914+0000","last_undegraded":"2024-09-19T08:51:23.546914+0000","last_fullsized":"2024-09-19T08:51:23.546914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:21:33.076142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.824332+0000","last_change":"2024-09-19T08:50:15.882760+0000","last_active":"2024-09-19T08:51:51.824332+0000","last_peered":"2024-09-19T08:51:51.824332+0000","last_clean":"2024-09-19T08:51:51.824332+0000","last_became_active":"2024-09-19T08:50:15.882402+0000","last_became_peered":"2024-09-19T08:50:15.882402+0000","last_unstale":"2024-09-19T08:51:51.824332+0000","last_undegraded":"2024-09-19T08:51:51.824332+0000","last_fullsized":"2024-09-19T08:51:51.824332+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:17.343385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'18","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:08.890564+0000","last_change":"2024-09-19T08:50:13.790982+0000","last_active":"2024-09-19T08:52:08.890564+0000","last_peered":"2024-09-19T08:52:08.890564+0000","last_clean":"2024-09-19T08:52:08.890564+0000","last_became_active":"2024-09-19T08:50:13.790644+0000","last_became_peered":"2024-09-19T08:50:13.790644+0000","last_unstale":"2024-09-19T08:52:08.890564+0000","last_undegraded":"2024-09-19T08:52:08.890564+0000","last_fullsized":"2024-09-19T08:52:08.890564+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:20:25.923021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827049+0000","last_change":"2024-09-19T08:50:15.887556+0000","last_active":"2024-09-19T08:51:51.827049+0000","last_peered":"2024-09-19T08:51:51.827049+0000","last_clean":"2024-09-19T08:51:51.827049+0000","last_became_active":"2024-09-19T08:50:15.887280+0000","last_became_peered":"2024-09-19T08:50:15.887280+0000","last_unstale":"2024-09-19T08:51:51.827049+0000","last_undegraded":"2024-09-19T08:51:51.827049+0000","last_fullsized":"2024-09-19T08:51:51.827049+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:51.226527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.541910+0000","last_change":"2024-09-19T08:50:14.012150+0000","last_active":"2024-09-19T08:51:23.541910+0000","last_peered":"2024-09-19T08:51:23.541910+0000","last_clean":"2024-09-19T08:51:23.541910+0000","last_became_active":"2024-09-19T08:50:14.011799+0000","last_became_peered":"2024-09-19T08:50:14.011799+0000","last_unstale":"2024-09-19T08:51:23.541910+0000","last_undegraded":"2024-09-19T08:51:23.541910+0000","last_fullsized":"2024-09-19T08:51:23.541910+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:37.310539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837525+0000","last_change":"2024-09-19T08:50:15.889577+0000","last_active":"2024-09-19T08:51:51.837525+0000","last_peered":"2024-09-19T08:51:51.837525+0000","last_clean":"2024-09-19T08:51:51.837525+0000","last_became_active":"2024-09-19T08:50:15.889244+0000","last_became_peered":"2024-09-19T08:50:15.889244+0000","last_unstale":"2024-09-19T08:51:51.837525+0000","last_undegraded":"2024-09-19T08:51:51.837525+0000","last_fullsized":"2024-09-19T08:51:51.837525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:54.382221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.548456+0000","last_change":"2024-09-19T08:50:14.293845+0000","last_active":"2024-09-19T08:51:23.548456+0000","last_peered":"2024-09-19T08:51:23.548456+0000","last_clean":"2024-09-19T08:51:23.548456+0000","last_became_active":"2024-09-19T08:50:14.293585+0000","last_became_peered":"2024-09-19T08:50:14.293585+0000","last_unstale":"2024-09-19T08:51:23.548456+0000","last_undegraded":"2024-09-19T08:51:23.548456+0000","last_fullsized":"2024-09-19T08:51:23.548456+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:02.886475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.794304+0000","last_change":"2024-09-19T08:50:15.888591+0000","last_active":"2024-09-19T08:51:51.794304+0000","last_peered":"2024-09-19T08:51:51.794304+0000","last_clean":"2024-09-19T08:51:51.794304+0000","last_became_active":"2024-09-19T08:50:15.888270+0000","last_became_peered":"2024-09-19T08:50:15.888270+0000","last_unstale":"2024-09-19T08:51:51.794304+0000","last_undegraded":"2024-09-19T08:51:51.794304+0000","last_fullsized":"2024-09-19T08:51:51.794304+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:08.644828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.547015+0000","last_change":"2024-09-19T08:50:13.794081+0000","last_active":"2024-09-19T08:51:23.547015+0000","last_peered":"2024-09-19T08:51:23.547015+0000","last_clean":"2024-09-19T08:51:23.547015+0000","last_became_active":"2024-09-19T08:50:13.793770+0000","last_became_peered":"2024-09-19T08:50:13.793770+0000","last_unstale":"2024-09-19T08:51:23.547015+0000","last_undegraded":"2024-09-19T08:51:23.547015+0000","last_fullsized":"2024-09-19T08:51:23.547015+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:43.053893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.835489+0000","last_change":"2024-09-19T08:50:15.885338+0000","last_active":"2024-09-19T08:51:51.835489+0000","last_peered":"2024-09-19T08:51:51.835489+0000","last_clean":"2024-09-19T08:51:51.835489+0000","last_became_active":"2024-09-19T08:50:15.884983+0000","last_became_peered":"2024-09-19T08:50:15.884983+0000","last_unstale":"2024-09-19T08:51:51.835489+0000","last_undegraded":"2024-09-19T08:51:51.835489+0000","last_fullsized":"2024-09-19T08:51:51.835489+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:05.228871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'3","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.563104+0000","last_change":"2024-09-19T08:51:23.562670+0000","last_active":"2024-09-19T08:51:23.563104+0000","last_peered":"2024-09-19T08:51:23.563104+0000","last_clean":"2024-09-19T08:51:23.563104+0000","last_became_active":"2024-09-19T08:51:23.548756+0000","last_became_peered":"2024-09-19T08:51:23.548756+0000","last_unstale":"2024-09-19T08:51:23.563104+0000","last_undegraded":"2024-09-19T08:51:23.563104+0000","last_fullsized":"2024-09-19T08:51:23.563104+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:36.666216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829262+0000","last_change":"2024-09-19T08:50:15.886587+0000","last_active":"2024-09-19T08:51:51.829262+0000","last_peered":"2024-09-19T08:51:51.829262+0000","last_clean":"2024-09-19T08:51:51.829262+0000","last_became_active":"2024-09-19T08:50:15.886231+0000","last_became_peered":"2024-09-19T08:50:15.886231+0000","last_unstale":"2024-09-19T08:51:51.829262+0000","last_undegraded":"2024-09-19T08:51:51.829262+0000","last_fullsized":"2024-09-19T08:51:51.829262+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:11.965382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.546412+0000","last_change":"2024-09-19T08:50:13.796681+0000","last_active":"2024-09-19T08:51:23.546412+0000","last_peered":"2024-09-19T08:51:23.546412+0000","last_clean":"2024-09-19T08:51:23.546412+0000","last_became_active":"2024-09-19T08:50:13.796338+0000","last_became_peered":"2024-09-19T08:50:13.796338+0000","last_unstale":"2024-09-19T08:51:23.546412+0000","last_undegraded":"2024-09-19T08:51:23.546412+0000","last_fullsized":"2024-09-19T08:51:23.546412+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:32.588800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.836422+0000","last_change":"2024-09-19T08:50:15.889667+0000","last_active":"2024-09-19T08:51:51.836422+0000","last_peered":"2024-09-19T08:51:51.836422+0000","last_clean":"2024-09-19T08:51:51.836422+0000","last_became_active":"2024-09-19T08:50:15.889341+0000","last_became_peered":"2024-09-19T08:50:15.889341+0000","last_unstale":"2024-09-19T08:51:51.836422+0000","last_undegraded":"2024-09-19T08:51:51.836422+0000","last_fullsized":"2024-09-19T08:51:51.836422+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:13.255483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.836199+0000","last_change":"2024-09-19T08:50:15.887337+0000","last_active":"2024-09-19T08:51:51.836199+0000","last_peered":"2024-09-19T08:51:51.836199+0000","last_clean":"2024-09-19T08:51:51.836199+0000","last_became_active":"2024-09-19T08:50:15.887001+0000","last_became_peered":"2024-09-19T08:50:15.887001+0000","last_unstale":"2024-09-19T08:51:51.836199+0000","last_undegraded":"2024-09-19T08:51:51.836199+0000","last_fullsized":"2024-09-19T08:51:51.836199+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:43.544863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.547132+0000","last_change":"2024-09-19T08:50:13.799321+0000","last_active":"2024-09-19T08:51:23.547132+0000","last_peered":"2024-09-19T08:51:23.547132+0000","last_clean":"2024-09-19T08:51:23.547132+0000","last_became_active":"2024-09-19T08:50:13.798837+0000","last_became_peered":"2024-09-19T08:50:13.798837+0000","last_unstale":"2024-09-19T08:51:23.547132+0000","last_undegraded":"2024-09-19T08:51:23.547132+0000","last_fullsized":"2024-09-19T08:51:23.547132+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:35.753093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837309+0000","last_change":"2024-09-19T08:50:15.892074+0000","last_active":"2024-09-19T08:51:51.837309+0000","last_peered":"2024-09-19T08:51:51.837309+0000","last_clean":"2024-09-19T08:51:51.837309+0000","last_became_active":"2024-09-19T08:50:15.891722+0000","last_became_peered":"2024-09-19T08:50:15.891722+0000","last_unstale":"2024-09-19T08:51:51.837309+0000","last_undegraded":"2024-09-19T08:51:51.837309+0000","last_fullsized":"2024-09-19T08:51:51.837309+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:39.913080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.546815+0000","last_change":"2024-09-19T08:50:13.795577+0000","last_active":"2024-09-19T08:51:23.546815+0000","last_peered":"2024-09-19T08:51:23.546815+0000","last_clean":"2024-09-19T08:51:23.546815+0000","last_became_active":"2024-09-19T08:50:13.795254+0000","last_became_peered":"2024-09-19T08:50:13.795254+0000","last_unstale":"2024-09-19T08:51:23.546815+0000","last_undegraded":"2024-09-19T08:51:23.546815+0000","last_fullsized":"2024-09-19T08:51:23.546815+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:13.263447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.836430+0000","last_change":"2024-09-19T08:50:15.884584+0000","last_active":"2024-09-19T08:51:51.836430+0000","last_peered":"2024-09-19T08:51:51.836430+0000","last_clean":"2024-09-19T08:51:51.836430+0000","last_became_active":"2024-09-19T08:50:15.884244+0000","last_became_peered":"2024-09-19T08:50:15.884244+0000","last_unstale":"2024-09-19T08:51:51.836430+0000","last_undegraded":"2024-09-19T08:51:51.836430+0000","last_fullsized":"2024-09-19T08:51:51.836430+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:58.835351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.547216+0000","last_change":"2024-09-19T08:50:14.294210+0000","last_active":"2024-09-19T08:51:23.547216+0000","last_peered":"2024-09-19T08:51:23.547216+0000","last_clean":"2024-09-19T08:51:23.547216+0000","last_became_active":"2024-09-19T08:50:14.293850+0000","last_became_peered":"2024-09-19T08:50:14.293850+0000","last_unstale":"2024-09-19T08:51:23.547216+0000","last_undegraded":"2024-09-19T08:51:23.547216+0000","last_fullsized":"2024-09-19T08:51:23.547216+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:42:44.340766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829139+0000","last_change":"2024-09-19T08:50:15.892934+0000","last_active":"2024-09-19T08:51:51.829139+0000","last_peered":"2024-09-19T08:51:51.829139+0000","last_clean":"2024-09-19T08:51:51.829139+0000","last_became_active":"2024-09-19T08:50:15.892309+0000","last_became_peered":"2024-09-19T08:50:15.892309+0000","last_unstale":"2024-09-19T08:51:51.829139+0000","last_undegraded":"2024-09-19T08:51:51.829139+0000","last_fullsized":"2024-09-19T08:51:51.829139+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:40.158724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'14","reported_seq":163,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:12.615197+0000","last_change":"2024-09-19T08:51:23.559819+0000","last_active":"2024-09-19T08:52:12.615197+0000","last_peered":"2024-09-19T08:52:12.615197+0000","last_clean":"2024-09-19T08:52:12.615197+0000","last_became_active":"2024-09-19T08:51:23.548481+0000","last_became_peered":"2024-09-19T08:51:23.548481+0000","last_unstale":"2024-09-19T08:52:12.615197+0000","last_undegraded":"2024-09-19T08:52:12.615197+0000","last_fullsized":"2024-09-19T08:52:12.615197+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:53.232542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74511,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1090,"num_read_kb":628,"num_write":265,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":577536,"data_stored":223533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":228,"ondisk_log_size":228,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":247642,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579941,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":434558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808874,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1056768,"data_stored":1091150,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972400,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":925696,"data_stored":433399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201333,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":433660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430265,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":1027136,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593791,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":433392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822723,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":983040,"data_stored":1025465,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953543,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":434095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182477,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":432707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27988,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717164,"statfs":{"total":95995035648,"available":95966375936,"internally_reserved":0,"allocated":987136,"data_stored":494434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":499839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738461,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":434872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34206,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34206,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":67679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":68433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":68505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:52:14.214 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:52:14.507 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:14.906 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:14 smithi019 ceph-mon[30976]: from='client.15267 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:52:14.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:14 smithi203 ceph-mon[35450]: from='client.15267 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:52:14.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.988+0000 7fc298e87640 1 -- 172.21.15.19:0/1026679657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc294100a80 msgr2=0x7fc294100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:14.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.988+0000 7fc298e87640 1 --2- 172.21.15.19:0/1026679657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc294100a80 0x7fc294100ee0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fc27c009930 tx=0x7fc27c02a420 comp rx=0 tx=0).stop 2024-09-19T08:52:14.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.988+0000 7fc298e87640 1 -- 172.21.15.19:0/1026679657 shutdown_connections 2024-09-19T08:52:14.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.988+0000 7fc298e87640 1 --2- 172.21.15.19:0/1026679657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc294101420 0x7fc29410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.988+0000 7fc298e87640 1 --2- 172.21.15.19:0/1026679657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc294100a80 0x7fc294100ee0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.988+0000 7fc298e87640 1 --2- 172.21.15.19:0/1026679657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc294106a80 0x7fc294106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.988+0000 7fc298e87640 1 -- 172.21.15.19:0/1026679657 >> 172.21.15.19:0/1026679657 conn(0x7fc2940fc7a0 msgr2=0x7fc2940febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:14.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.988+0000 7fc298e87640 1 -- 172.21.15.19:0/1026679657 shutdown_connections 2024-09-19T08:52:14.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.988+0000 7fc298e87640 1 -- 172.21.15.19:0/1026679657 wait complete. 2024-09-19T08:52:14.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.989+0000 7fc298e87640 1 Processor -- start 2024-09-19T08:52:14.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.989+0000 7fc298e87640 1 -- start start 2024-09-19T08:52:14.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.989+0000 7fc298e87640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc294100a80 0x7fc294197320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:14.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.989+0000 7fc298e87640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc294101420 0x7fc294197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:14.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.989+0000 7fc298e87640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc294106a80 0x7fc29419bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:14.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.990+0000 7fc298e87640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc294110e40 con 0x7fc294106a80 2024-09-19T08:52:14.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.990+0000 7fc298e87640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc294110cc0 con 0x7fc294101420 2024-09-19T08:52:14.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.990+0000 7fc298e87640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc294110fc0 con 0x7fc294100a80 2024-09-19T08:52:14.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.990+0000 7fc292d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc294106a80 0x7fc29419bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:14.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.990+0000 7fc292d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc294106a80 0x7fc29419bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50966/0 (socket says 172.21.15.19:50966) 2024-09-19T08:52:14.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.990+0000 7fc292d9d640 1 -- 172.21.15.19:0/2664049231 learned_addr learned my addr 172.21.15.19:0/2664049231 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:14.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.990+0000 7fc28bfff640 1 --2- 172.21.15.19:0/2664049231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc294101420 0x7fc294197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:14.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.990+0000 7fc29259c640 1 --2- 172.21.15.19:0/2664049231 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc294100a80 0x7fc294197320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:14.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.990+0000 7fc292d9d640 1 -- 172.21.15.19:0/2664049231 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc294100a80 msgr2=0x7fc294197320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:14.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.990+0000 7fc292d9d640 1 --2- 172.21.15.19:0/2664049231 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc294100a80 0x7fc294197320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:14.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.990+0000 7fc292d9d640 1 -- 172.21.15.19:0/2664049231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc294101420 msgr2=0x7fc294197860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:14.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.990+0000 7fc292d9d640 1 --2- 172.21.15.19:0/2664049231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc294101420 0x7fc294197860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:15.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.990+0000 7fc292d9d640 1 -- 172.21.15.19:0/2664049231 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc29419c2d0 con 0x7fc294106a80 2024-09-19T08:52:15.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.990+0000 7fc292d9d640 1 --2- 172.21.15.19:0/2664049231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc294106a80 0x7fc29419bbf0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc28c00cad0 tx=0x7fc28c00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:15.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.990+0000 7fc28b7fe640 1 -- 172.21.15.19:0/2664049231 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc28c00ad60 con 0x7fc294106a80 2024-09-19T08:52:15.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.990+0000 7fc298e87640 1 -- 172.21.15.19:0/2664049231 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc29419c5c0 con 0x7fc294106a80 2024-09-19T08:52:15.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.990+0000 7fc28b7fe640 1 -- 172.21.15.19:0/2664049231 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc28c005020 con 0x7fc294106a80 2024-09-19T08:52:15.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.990+0000 7fc28b7fe640 1 -- 172.21.15.19:0/2664049231 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc28c00f6b0 con 0x7fc294106a80 2024-09-19T08:52:15.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.991+0000 7fc298e87640 1 -- 172.21.15.19:0/2664049231 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2941a3ea0 con 0x7fc294106a80 2024-09-19T08:52:15.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.991+0000 7fc298e87640 1 -- 172.21.15.19:0/2664049231 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc294100ee0 con 0x7fc294106a80 2024-09-19T08:52:15.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.993+0000 7fc28b7fe640 1 -- 172.21.15.19:0/2664049231 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7fc28c005560 con 0x7fc294106a80 2024-09-19T08:52:15.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.993+0000 7fc28b7fe640 1 --2- 172.21.15.19:0/2664049231 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc2800a32d0 0x7fc2800a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:15.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.993+0000 7fc29259c640 1 --2- 172.21.15.19:0/2664049231 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc2800a32d0 0x7fc2800a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:15.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.993+0000 7fc28b7fe640 1 -- 172.21.15.19:0/2664049231 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc28c0cfa80 con 0x7fc294106a80 2024-09-19T08:52:15.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.994+0000 7fc29259c640 1 --2- 172.21.15.19:0/2664049231 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc2800a32d0 0x7fc2800a5790 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc28400ab60 tx=0x7fc28400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:15.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:14.997+0000 7fc28b7fe640 1 -- 172.21.15.19:0/2664049231 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc28c014030 con 0x7fc294106a80 2024-09-19T08:52:15.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:14 smithi155 ceph-mon[34921]: from='client.15267 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:52:15.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:15.207+0000 7fc298e87640 1 -- 172.21.15.19:0/2664049231 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc29402d7c0 con 0x7fc294106a80 2024-09-19T08:52:15.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:15.208+0000 7fc28b7fe640 1 -- 172.21.15.19:0/2664049231 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11983 (secure 0 0 0) 0x7fc28c09c650 con 0x7fc294106a80 2024-09-19T08:52:15.209 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:52:15.209 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":28,"btime":"2024-09-19T08:52:09:653615+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2452068876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2452068876},{"type":"v1","addr":"172.21.15.19:6839","nonce":2452068876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T08:52:08.813945+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/2480841559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2480841559},{"type":"v1","addr":"172.21.15.155:6835","nonce":2480841559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24463,24464,24490,24469,24497]},"id":1}]} 2024-09-19T08:52:15.209 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 28 2024-09-19T08:52:15.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:15.210+0000 7fc298e87640 1 -- 172.21.15.19:0/2664049231 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc2800a32d0 msgr2=0x7fc2800a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:15.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:15.210+0000 7fc298e87640 1 --2- 172.21.15.19:0/2664049231 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc2800a32d0 0x7fc2800a5790 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc28400ab60 tx=0x7fc28400a2d0 comp rx=0 tx=0).stop 2024-09-19T08:52:15.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:15.210+0000 7fc298e87640 1 -- 172.21.15.19:0/2664049231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc294106a80 msgr2=0x7fc29419bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:15.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:15.210+0000 7fc298e87640 1 --2- 172.21.15.19:0/2664049231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc294106a80 0x7fc29419bbf0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fc28c00cad0 tx=0x7fc28c00ced0 comp rx=0 tx=0).stop 2024-09-19T08:52:15.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:15.210+0000 7fc298e87640 1 -- 172.21.15.19:0/2664049231 shutdown_connections 2024-09-19T08:52:15.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:15.210+0000 7fc298e87640 1 --2- 172.21.15.19:0/2664049231 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc2800a32d0 0x7fc2800a5790 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:15.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:15.210+0000 7fc298e87640 1 --2- 172.21.15.19:0/2664049231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc294106a80 0x7fc29419bbf0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:15.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:15.210+0000 7fc298e87640 1 --2- 172.21.15.19:0/2664049231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc294101420 0x7fc294197860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:15.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:15.210+0000 7fc298e87640 1 --2- 172.21.15.19:0/2664049231 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc294100a80 0x7fc294197320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:15.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:15.210+0000 7fc298e87640 1 -- 172.21.15.19:0/2664049231 >> 172.21.15.19:0/2664049231 conn(0x7fc2940fc7a0 msgr2=0x7fc2940fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:15.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:15.210+0000 7fc298e87640 1 -- 172.21.15.19:0/2664049231 shutdown_connections 2024-09-19T08:52:15.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:15.210+0000 7fc298e87640 1 -- 172.21.15.19:0/2664049231 wait complete. 2024-09-19T08:52:15.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:15 smithi203 ceph-mon[35450]: from='client.15273 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:52:15.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:15 smithi203 ceph-mon[35450]: pgmap v338: 97 pgs: 97 active+clean; 650 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-19T08:52:15.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:15 smithi203 ceph-mon[35450]: from='client.15279 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:52:15.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:15 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/2664049231' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:52:15.995 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:15 smithi019 ceph-mon[30976]: from='client.15273 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:52:15.996 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:15 smithi019 ceph-mon[30976]: pgmap v338: 97 pgs: 97 active+clean; 650 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-19T08:52:15.996 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:15 smithi019 ceph-mon[30976]: from='client.15279 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:52:15.996 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:15 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/2664049231' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:52:16.033 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:52:16.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:15 smithi155 ceph-mon[34921]: from='client.15273 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:52:16.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:15 smithi155 ceph-mon[34921]: pgmap v338: 97 pgs: 97 active+clean; 650 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-19T08:52:16.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:15 smithi155 ceph-mon[34921]: from='client.15279 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:52:16.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:15 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/2664049231' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:52:16.299 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:16.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.756+0000 7f197c6f1640 1 -- 172.21.15.19:0/3546624407 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1974101de0 msgr2=0x7f19741021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:16.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.757+0000 7f197c6f1640 1 --2- 172.21.15.19:0/3546624407 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1974101de0 0x7f19741021c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1970009900 tx=0x7f197002a410 comp rx=0 tx=0).stop 2024-09-19T08:52:16.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.757+0000 7f197c6f1640 1 -- 172.21.15.19:0/3546624407 shutdown_connections 2024-09-19T08:52:16.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.757+0000 7f197c6f1640 1 --2- 172.21.15.19:0/3546624407 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1974106f10 0x7f197410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:16.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.757+0000 7f197c6f1640 1 --2- 172.21.15.19:0/3546624407 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1974102790 0x7f19741067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:16.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.757+0000 7f197c6f1640 1 --2- 172.21.15.19:0/3546624407 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1974101de0 0x7f19741021c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:16.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.757+0000 7f197c6f1640 1 -- 172.21.15.19:0/3546624407 >> 172.21.15.19:0/3546624407 conn(0x7f19740fd8c0 msgr2=0x7f19740ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:16.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.757+0000 7f197c6f1640 1 -- 172.21.15.19:0/3546624407 shutdown_connections 2024-09-19T08:52:16.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.757+0000 7f197c6f1640 1 -- 172.21.15.19:0/3546624407 wait complete. 2024-09-19T08:52:16.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.757+0000 7f197c6f1640 1 Processor -- start 2024-09-19T08:52:16.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.757+0000 7f197c6f1640 1 -- start start 2024-09-19T08:52:16.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.758+0000 7f197c6f1640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1974101de0 0x7f1974198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:16.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.758+0000 7f197c6f1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1974102790 0x7f1974198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:16.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.758+0000 7f197c6f1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1974106f10 0x7f197419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:16.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.758+0000 7f197c6f1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1974111f70 con 0x7f1974102790 2024-09-19T08:52:16.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.758+0000 7f197c6f1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1974111df0 con 0x7f1974106f10 2024-09-19T08:52:16.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.758+0000 7f197c6f1640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f19741120f0 con 0x7f1974101de0 2024-09-19T08:52:16.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.758+0000 7f1979c8c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1974102790 0x7f1974198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:16.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.758+0000 7f1979c8c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1974102790 0x7f1974198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51240/0 (socket says 172.21.15.19:51240) 2024-09-19T08:52:16.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.758+0000 7f1979c8c640 1 -- 172.21.15.19:0/954223870 learned_addr learned my addr 172.21.15.19:0/954223870 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:16.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.758+0000 7f197a48d640 1 --2- 172.21.15.19:0/954223870 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1974101de0 0x7f1974198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:16.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.758+0000 7f197ac8e640 1 --2- 172.21.15.19:0/954223870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1974106f10 0x7f197419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:16.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.758+0000 7f1979c8c640 1 -- 172.21.15.19:0/954223870 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1974101de0 msgr2=0x7f1974198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:16.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.758+0000 7f1979c8c640 1 --2- 172.21.15.19:0/954223870 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1974101de0 0x7f1974198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:16.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.758+0000 7f1979c8c640 1 -- 172.21.15.19:0/954223870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1974106f10 msgr2=0x7f197419cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:16.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.758+0000 7f1979c8c640 1 --2- 172.21.15.19:0/954223870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1974106f10 0x7f197419cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:16.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.758+0000 7f1979c8c640 1 -- 172.21.15.19:0/954223870 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f197419d3e0 con 0x7f1974102790 2024-09-19T08:52:16.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.758+0000 7f1979c8c640 1 --2- 172.21.15.19:0/954223870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1974102790 0x7f1974198970 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f196400d950 tx=0x7f196400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:16.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.758+0000 7f196b7fe640 1 -- 172.21.15.19:0/954223870 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1964017070 con 0x7f1974102790 2024-09-19T08:52:16.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.758+0000 7f196b7fe640 1 -- 172.21.15.19:0/954223870 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1964009c30 con 0x7f1974102790 2024-09-19T08:52:16.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.758+0000 7f196b7fe640 1 -- 172.21.15.19:0/954223870 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196400f6b0 con 0x7f1974102790 2024-09-19T08:52:16.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.758+0000 7f197c6f1640 1 -- 172.21.15.19:0/954223870 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f197419d6d0 con 0x7f1974102790 2024-09-19T08:52:16.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.758+0000 7f197c6f1640 1 -- 172.21.15.19:0/954223870 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19741a4fb0 con 0x7f1974102790 2024-09-19T08:52:16.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.759+0000 7f197c6f1640 1 -- 172.21.15.19:0/954223870 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19741021c0 con 0x7f1974102790 2024-09-19T08:52:16.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.761+0000 7f196b7fe640 1 -- 172.21.15.19:0/954223870 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f19640109d0 con 0x7f1974102790 2024-09-19T08:52:16.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.762+0000 7f196b7fe640 1 --2- 172.21.15.19:0/954223870 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f19600a3350 0x7f19600a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:16.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.762+0000 7f197a48d640 1 --2- 172.21.15.19:0/954223870 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f19600a3350 0x7f19600a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:16.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.762+0000 7f196b7fe640 1 -- 172.21.15.19:0/954223870 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f19640cf760 con 0x7f1974102790 2024-09-19T08:52:16.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.763+0000 7f197a48d640 1 --2- 172.21.15.19:0/954223870 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f19600a3350 0x7f19600a5810 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1970005ab0 tx=0x7f1970005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:16.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.765+0000 7f196b7fe640 1 -- 172.21.15.19:0/954223870 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1964009de0 con 0x7f1974102790 2024-09-19T08:52:16.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.944+0000 7f197c6f1640 1 -- 172.21.15.19:0/954223870 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f197402d7c0 con 0x7f1974102790 2024-09-19T08:52:16.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.945+0000 7f196b7fe640 1 -- 172.21.15.19:0/954223870 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22651 (secure 0 0 0) 0x7f196409c350 con 0x7f1974102790 2024-09-19T08:52:16.946 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:52:16.946 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":82,"fsid":"f26c9d84-7662-11ef-bceb-c7b262605968","created":"2024-09-19T08:42:32.324073+0000","modified":"2024-09-19T08:51:23.536977+0000","last_up_change":"2024-09-19T08:49:24.764960+0000","last_in_change":"2024-09-19T08:49:01.062919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:45:36.232910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:50:12.615884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:50:14.854513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81c7bb06-5b13-4ee0-9290-d779faac1b91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6803","nonce":3397146732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6805","nonce":3397146732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6809","nonce":3397146732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6807","nonce":3397146732}]},"public_addr":"172.21.15.19:6803/3397146732","cluster_addr":"172.21.15.19:6805/3397146732","heartbeat_back_addr":"172.21.15.19:6809/3397146732","heartbeat_front_addr":"172.21.15.19:6807/3397146732","state":["exists","up"]},{"osd":1,"uuid":"24c145e6-5252-4708-8f25-5ce041e8251e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6801","nonce":2011043685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6803","nonce":2011043685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6807","nonce":2011043685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6805","nonce":2011043685}]},"public_addr":"172.21.15.155:6801/2011043685","cluster_addr":"172.21.15.155:6803/2011043685","heartbeat_back_addr":"172.21.15.155:6807/2011043685","heartbeat_front_addr":"172.21.15.155:6805/2011043685","state":["exists","up"]},{"osd":2,"uuid":"99cefd33-0675-495f-8871-2e6fdead0c3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6801","nonce":3358994623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6803","nonce":3358994623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6807","nonce":3358994623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6805","nonce":3358994623}]},"public_addr":"172.21.15.203:6801/3358994623","cluster_addr":"172.21.15.203:6803/3358994623","heartbeat_back_addr":"172.21.15.203:6807/3358994623","heartbeat_front_addr":"172.21.15.203:6805/3358994623","state":["exists","up"]},{"osd":3,"uuid":"8f46c16c-f17e-484a-8b66-6dbf135f34c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6811","nonce":176445576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6813","nonce":176445576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6817","nonce":176445576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6815","nonce":176445576}]},"public_addr":"172.21.15.19:6811/176445576","cluster_addr":"172.21.15.19:6813/176445576","heartbeat_back_addr":"172.21.15.19:6817/176445576","heartbeat_front_addr":"172.21.15.19:6815/176445576","state":["exists","up"]},{"osd":4,"uuid":"411b0423-1317-4e82-bc01-b5f55b391bc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6809","nonce":2163087792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6811","nonce":2163087792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6815","nonce":2163087792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6813","nonce":2163087792}]},"public_addr":"172.21.15.155:6809/2163087792","cluster_addr":"172.21.15.155:6811/2163087792","heartbeat_back_addr":"172.21.15.155:6815/2163087792","heartbeat_front_addr":"172.21.15.155:6813/2163087792","state":["exists","up"]},{"osd":5,"uuid":"057c073e-569f-4c6e-9602-e1169ad4dd8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6809","nonce":334881465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6811","nonce":334881465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6815","nonce":334881465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6813","nonce":334881465}]},"public_addr":"172.21.15.203:6809/334881465","cluster_addr":"172.21.15.203:6811/334881465","heartbeat_back_addr":"172.21.15.203:6815/334881465","heartbeat_front_addr":"172.21.15.203:6813/334881465","state":["exists","up"]},{"osd":6,"uuid":"40418f13-823e-4f94-a427-84781abbcb5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6819","nonce":2669779791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6821","nonce":2669779791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6825","nonce":2669779791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6823","nonce":2669779791}]},"public_addr":"172.21.15.19:6819/2669779791","cluster_addr":"172.21.15.19:6821/2669779791","heartbeat_back_addr":"172.21.15.19:6825/2669779791","heartbeat_front_addr":"172.21.15.19:6823/2669779791","state":["exists","up"]},{"osd":7,"uuid":"ad15f762-aeab-4167-a63d-6c9f9b89b9c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6817","nonce":3169455907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6819","nonce":3169455907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6823","nonce":3169455907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6821","nonce":3169455907}]},"public_addr":"172.21.15.155:6817/3169455907","cluster_addr":"172.21.15.155:6819/3169455907","heartbeat_back_addr":"172.21.15.155:6823/3169455907","heartbeat_front_addr":"172.21.15.155:6821/3169455907","state":["exists","up"]},{"osd":8,"uuid":"23cf8ea2-29d6-43d8-a05b-7822f4bbf254","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6817","nonce":1062999528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6819","nonce":1062999528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6823","nonce":1062999528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6821","nonce":1062999528}]},"public_addr":"172.21.15.203:6817/1062999528","cluster_addr":"172.21.15.203:6819/1062999528","heartbeat_back_addr":"172.21.15.203:6823/1062999528","heartbeat_front_addr":"172.21.15.203:6821/1062999528","state":["exists","up"]},{"osd":9,"uuid":"e851e605-2d17-4fbf-b783-2138133edd06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6827","nonce":574664786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6829","nonce":574664786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6833","nonce":574664786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6831","nonce":574664786}]},"public_addr":"172.21.15.19:6827/574664786","cluster_addr":"172.21.15.19:6829/574664786","heartbeat_back_addr":"172.21.15.19:6833/574664786","heartbeat_front_addr":"172.21.15.19:6831/574664786","state":["exists","up"]},{"osd":10,"uuid":"cc770717-91bd-4494-9103-6db8214b5872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6825","nonce":2242158832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6827","nonce":2242158832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6831","nonce":2242158832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6829","nonce":2242158832}]},"public_addr":"172.21.15.155:6825/2242158832","cluster_addr":"172.21.15.155:6827/2242158832","heartbeat_back_addr":"172.21.15.155:6831/2242158832","heartbeat_front_addr":"172.21.15.155:6829/2242158832","state":["exists","up"]},{"osd":11,"uuid":"6c237db9-5d79-47bc-8ff6-60d09d721d5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6825","nonce":522943955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6827","nonce":522943955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6831","nonce":522943955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6829","nonce":522943955}]},"public_addr":"172.21.15.203:6825/522943955","cluster_addr":"172.21.15.203:6827/522943955","heartbeat_back_addr":"172.21.15.203:6831/522943955","heartbeat_front_addr":"172.21.15.203:6829/522943955","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:44:44.656414+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:09.339183+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:33.245452+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:59.449025+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:46:24.831213+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:46:49.189780+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:47:13.493628+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:47:39.478247+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:05.089875+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:30.722878+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:56.951834+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:22.894678+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6801/4266644067":"2024-09-20T08:43:21.732222+0000","172.21.15.19:0/1398782170":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6800/4266644067":"2024-09-20T08:43:21.732222+0000","172.21.15.19:0/34162461":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6801/1764769529":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/2910961714":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6800/1764769529":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/820792769":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/560203138":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/809642328":"2024-09-20T08:42:56.618773+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:52:16.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.947+0000 7f197c6f1640 1 -- 172.21.15.19:0/954223870 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f19600a3350 msgr2=0x7f19600a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:16.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.947+0000 7f197c6f1640 1 --2- 172.21.15.19:0/954223870 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f19600a3350 0x7f19600a5810 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1970005ab0 tx=0x7f1970005a20 comp rx=0 tx=0).stop 2024-09-19T08:52:16.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.947+0000 7f197c6f1640 1 -- 172.21.15.19:0/954223870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1974102790 msgr2=0x7f1974198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:16.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.947+0000 7f197c6f1640 1 --2- 172.21.15.19:0/954223870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1974102790 0x7f1974198970 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f196400d950 tx=0x7f196400de10 comp rx=0 tx=0).stop 2024-09-19T08:52:16.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.947+0000 7f197c6f1640 1 -- 172.21.15.19:0/954223870 shutdown_connections 2024-09-19T08:52:16.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.948+0000 7f197c6f1640 1 --2- 172.21.15.19:0/954223870 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f19600a3350 0x7f19600a5810 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:16.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.948+0000 7f197c6f1640 1 --2- 172.21.15.19:0/954223870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1974106f10 0x7f197419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:16.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.948+0000 7f197c6f1640 1 --2- 172.21.15.19:0/954223870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1974102790 0x7f1974198970 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:16.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.948+0000 7f197c6f1640 1 --2- 172.21.15.19:0/954223870 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1974101de0 0x7f1974198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:16.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.948+0000 7f197c6f1640 1 -- 172.21.15.19:0/954223870 >> 172.21.15.19:0/954223870 conn(0x7f19740fd8c0 msgr2=0x7f19740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:16.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.948+0000 7f197c6f1640 1 -- 172.21.15.19:0/954223870 shutdown_connections 2024-09-19T08:52:16.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:16.948+0000 7f197c6f1640 1 -- 172.21.15.19:0/954223870 wait complete. 2024-09-19T08:52:17.660 DEBUG:tasks.fwd_scrub:Yielding 2024-09-19T08:52:17.660 INFO:teuthology.run_tasks:Running task background_exec... 2024-09-19T08:52:17.670 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi019.front.sepia.ceph.com 2024-09-19T08:52:17.670 DEBUG:teuthology.orchestra.run.smithi019:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-09-19T08:52:17.671 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-19T08:52:17.671 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:52:17.671 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:52:17.674 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-19T08:52:17.710 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T08:52:17.710 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:52:17.948 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:17.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:17 smithi203 ceph-mon[35450]: pgmap v339: 97 pgs: 97 active+clean; 650 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-19T08:52:17.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:17 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/954223870' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:52:17.988 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:18.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:17 smithi019 ceph-mon[30976]: pgmap v339: 97 pgs: 97 active+clean; 650 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-19T08:52:18.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:17 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/954223870' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:52:18.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:17 smithi155 ceph-mon[34921]: pgmap v339: 97 pgs: 97 active+clean; 650 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-09-19T08:52:18.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:17 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/954223870' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:52:18.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.838+0000 7f45452ae640 1 -- 172.21.15.19:0/1908955630 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4540102ef0 msgr2=0x7f454010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:18.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.838+0000 7f45452ae640 1 --2- 172.21.15.19:0/1908955630 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4540102ef0 0x7f454010da40 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f4538009900 tx=0x7f453802a480 comp rx=0 tx=0).stop 2024-09-19T08:52:18.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.838+0000 7f45452ae640 1 -- 172.21.15.19:0/1908955630 shutdown_connections 2024-09-19T08:52:18.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.838+0000 7f45452ae640 1 --2- 172.21.15.19:0/1908955630 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4540102ef0 0x7f454010da40 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:18.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.838+0000 7f45452ae640 1 --2- 172.21.15.19:0/1908955630 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4540102570 0x7f45401029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:18.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.838+0000 7f45452ae640 1 --2- 172.21.15.19:0/1908955630 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4540100e20 0x7f4540101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:18.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.838+0000 7f45452ae640 1 -- 172.21.15.19:0/1908955630 >> 172.21.15.19:0/1908955630 conn(0x7f45400fc7d0 msgr2=0x7f45400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:18.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.838+0000 7f45452ae640 1 -- 172.21.15.19:0/1908955630 shutdown_connections 2024-09-19T08:52:18.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.838+0000 7f45452ae640 1 -- 172.21.15.19:0/1908955630 wait complete. 2024-09-19T08:52:18.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.838+0000 7f45452ae640 1 Processor -- start 2024-09-19T08:52:18.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.839+0000 7f45452ae640 1 -- start start 2024-09-19T08:52:18.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.839+0000 7f45452ae640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4540100e20 0x7f45401992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:18.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.839+0000 7f45452ae640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4540102570 0x7f4540199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:18.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.839+0000 7f45452ae640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4540102ef0 0x7f45401a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:18.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.839+0000 7f45452ae640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4540110fd0 con 0x7f4540102ef0 2024-09-19T08:52:18.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.839+0000 7f45452ae640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4540110e50 con 0x7f4540100e20 2024-09-19T08:52:18.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.839+0000 7f45452ae640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4540111150 con 0x7f4540102570 2024-09-19T08:52:18.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.839+0000 7f453f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4540102ef0 0x7f45401a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:18.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.839+0000 7f453f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4540102ef0 0x7f45401a4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51306/0 (socket says 172.21.15.19:51306) 2024-09-19T08:52:18.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.839+0000 7f453f7fe640 1 -- 172.21.15.19:0/3329703666 learned_addr learned my addr 172.21.15.19:0/3329703666 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:18.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.839+0000 7f453effd640 1 --2- 172.21.15.19:0/3329703666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4540100e20 0x7f45401992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:18.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.839+0000 7f453e7fc640 1 --2- 172.21.15.19:0/3329703666 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4540102570 0x7f4540199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:18.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.839+0000 7f453f7fe640 1 -- 172.21.15.19:0/3329703666 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4540102570 msgr2=0x7f4540199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:18.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.839+0000 7f453f7fe640 1 --2- 172.21.15.19:0/3329703666 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4540102570 0x7f4540199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:18.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.839+0000 7f453f7fe640 1 -- 172.21.15.19:0/3329703666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4540100e20 msgr2=0x7f45401992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:18.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.839+0000 7f453f7fe640 1 --2- 172.21.15.19:0/3329703666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4540100e20 0x7f45401992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:18.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.839+0000 7f453f7fe640 1 -- 172.21.15.19:0/3329703666 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45401a48a0 con 0x7f4540102ef0 2024-09-19T08:52:18.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.839+0000 7f453f7fe640 1 --2- 172.21.15.19:0/3329703666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4540102ef0 0x7f45401a4360 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f453802a9a0 tx=0x7f4538003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:18.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.840+0000 7f4527fff640 1 -- 172.21.15.19:0/3329703666 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453803f070 con 0x7f4540102ef0 2024-09-19T08:52:18.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.840+0000 7f45452ae640 1 -- 172.21.15.19:0/3329703666 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45401a4a70 con 0x7f4540102ef0 2024-09-19T08:52:18.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.840+0000 7f4527fff640 1 -- 172.21.15.19:0/3329703666 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4538031c20 con 0x7f4540102ef0 2024-09-19T08:52:18.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.840+0000 7f4527fff640 1 -- 172.21.15.19:0/3329703666 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4538035030 con 0x7f4540102ef0 2024-09-19T08:52:18.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.840+0000 7f45452ae640 1 -- 172.21.15.19:0/3329703666 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45401a4ec0 con 0x7f4540102ef0 2024-09-19T08:52:18.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.841+0000 7f45452ae640 1 -- 172.21.15.19:0/3329703666 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4540101200 con 0x7f4540102ef0 2024-09-19T08:52:18.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.842+0000 7f4527fff640 1 -- 172.21.15.19:0/3329703666 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f4538042070 con 0x7f4540102ef0 2024-09-19T08:52:18.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.842+0000 7f4527fff640 1 --2- 172.21.15.19:0/3329703666 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f45280a32d0 0x7f45280a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:18.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.843+0000 7f453effd640 1 --2- 172.21.15.19:0/3329703666 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f45280a32d0 0x7f45280a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:18.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.843+0000 7f4527fff640 1 -- 172.21.15.19:0/3329703666 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f45380f0410 con 0x7f4540102ef0 2024-09-19T08:52:18.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.843+0000 7f453effd640 1 --2- 172.21.15.19:0/3329703666 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f45280a32d0 0x7f45280a5790 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4530005fd0 tx=0x7f4530009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:18.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.847+0000 7f4527fff640 1 -- 172.21.15.19:0/3329703666 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f45380bc930 con 0x7f4540102ef0 2024-09-19T08:52:19.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:19.020+0000 7f45452ae640 1 -- 172.21.15.19:0/3329703666 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4540106ee0 con 0x7f45280a32d0 2024-09-19T08:52:19.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.683+0000 7f6e3ec95640 1 -- 172.21.15.19:0/1476638590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e38102d30 msgr2=0x7f6e38103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:19.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.683+0000 7f6e3ec95640 1 --2- 172.21.15.19:0/1476638590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e38102d30 0x7f6e38103110 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009930 tx=0x7f6e3402a420 comp rx=0 tx=0).stop 2024-09-19T08:52:19.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.683+0000 7f6e3ec95640 1 -- 172.21.15.19:0/1476638590 shutdown_connections 2024-09-19T08:52:19.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.683+0000 7f6e3ec95640 1 --2- 172.21.15.19:0/1476638590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6e381082a0 0x7f6e3810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:19.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.683+0000 7f6e3ec95640 1 --2- 172.21.15.19:0/1476638590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e381036e0 0x7f6e38107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:19.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.683+0000 7f6e3ec95640 1 --2- 172.21.15.19:0/1476638590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e38102d30 0x7f6e38103110 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:19.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.683+0000 7f6e3ec95640 1 -- 172.21.15.19:0/1476638590 >> 172.21.15.19:0/1476638590 conn(0x7f6e380fc7d0 msgr2=0x7f6e380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:19.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.683+0000 7f6e3ec95640 1 -- 172.21.15.19:0/1476638590 shutdown_connections 2024-09-19T08:52:19.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.683+0000 7f6e3ec95640 1 -- 172.21.15.19:0/1476638590 wait complete. 2024-09-19T08:52:19.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.683+0000 7f6e3ec95640 1 Processor -- start 2024-09-19T08:52:19.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.683+0000 7f6e3ec95640 1 -- start start 2024-09-19T08:52:19.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.684+0000 7f6e3ec95640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6e38102d30 0x7f6e38198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:19.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.684+0000 7f6e3ec95640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e381036e0 0x7f6e38198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:19.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.684+0000 7f6e3ec95640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e381082a0 0x7f6e3819cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:19.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.684+0000 7f6e3ec95640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6e381120a0 con 0x7f6e381036e0 2024-09-19T08:52:19.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.684+0000 7f6e3ec95640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6e38111f20 con 0x7f6e381082a0 2024-09-19T08:52:19.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.684+0000 7f6e3ec95640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6e38112220 con 0x7f6e38102d30 2024-09-19T08:52:19.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.684+0000 7f6e2ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e381036e0 0x7f6e38198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:19.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.684+0000 7f6e2ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e381036e0 0x7f6e38198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51264/0 (socket says 172.21.15.19:51264) 2024-09-19T08:52:19.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.684+0000 7f6e2ffff640 1 -- 172.21.15.19:0/4260811708 learned_addr learned my addr 172.21.15.19:0/4260811708 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:19.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.684+0000 7f6e3ca31640 1 --2- 172.21.15.19:0/4260811708 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6e38102d30 0x7f6e38198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:19.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.684+0000 7f6e3d232640 1 --2- 172.21.15.19:0/4260811708 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e381082a0 0x7f6e3819cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:19.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.684+0000 7f6e2ffff640 1 -- 172.21.15.19:0/4260811708 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6e38102d30 msgr2=0x7f6e38198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:19.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.684+0000 7f6e2ffff640 1 --2- 172.21.15.19:0/4260811708 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6e38102d30 0x7f6e38198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:19.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.684+0000 7f6e2ffff640 1 -- 172.21.15.19:0/4260811708 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e381082a0 msgr2=0x7f6e3819cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:19.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.684+0000 7f6e2ffff640 1 --2- 172.21.15.19:0/4260811708 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e381082a0 0x7f6e3819cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:19.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.684+0000 7f6e2ffff640 1 -- 172.21.15.19:0/4260811708 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3819d4d0 con 0x7f6e381036e0 2024-09-19T08:52:19.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.684+0000 7f6e3d232640 1 --2- 172.21.15.19:0/4260811708 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e381082a0 0x7f6e3819cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:19.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.684+0000 7f6e2ffff640 1 --2- 172.21.15.19:0/4260811708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e381036e0 0x7f6e38198a60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6e2800c970 tx=0x7f6e2800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:19.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.685+0000 7f6e2dffb640 1 -- 172.21.15.19:0/4260811708 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e28007bb0 con 0x7f6e381036e0 2024-09-19T08:52:19.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.685+0000 7f6e3ec95640 1 -- 172.21.15.19:0/4260811708 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e3819d7c0 con 0x7f6e381036e0 2024-09-19T08:52:19.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.685+0000 7f6e2dffb640 1 -- 172.21.15.19:0/4260811708 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e28007d50 con 0x7f6e381036e0 2024-09-19T08:52:19.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.685+0000 7f6e2dffb640 1 -- 172.21.15.19:0/4260811708 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2800f450 con 0x7f6e381036e0 2024-09-19T08:52:19.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.685+0000 7f6e3ec95640 1 -- 172.21.15.19:0/4260811708 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e381a50a0 con 0x7f6e381036e0 2024-09-19T08:52:19.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.687+0000 7f6e2dffb640 1 -- 172.21.15.19:0/4260811708 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f6e28004f60 con 0x7f6e381036e0 2024-09-19T08:52:19.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.688+0000 7f6e4106e740 1 Processor -- start 2024-09-19T08:52:19.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.688+0000 7f6e4106e740 1 -- start start 2024-09-19T08:52:19.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.688+0000 7f6e4106e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b5df2b60 0x55b5b5df2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:19.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.688+0000 7f6e4106e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b5b5df3480 0x55b5b5dfd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:19.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.688+0000 7f6e4106e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b5b5dfdd40 0x55b5b5e00130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:19.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.688+0000 7f6e4106e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b5b5d58280 con 0x55b5b5df3480 2024-09-19T08:52:19.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.688+0000 7f6e4106e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b5b5cffb10 con 0x55b5b5df2b60 2024-09-19T08:52:19.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.688+0000 7f6e4106e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b5b5d54240 con 0x55b5b5dfdd40 2024-09-19T08:52:19.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.688+0000 7f6e2dffb640 1 --2- 172.21.15.19:0/4260811708 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6e200a32d0 0x7f6e200a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:19.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.688+0000 7f6e3ca31640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b5b5df3480 0x55b5b5dfd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:19.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.688+0000 7f6e3d232640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b5df2b60 0x55b5b5df2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:19.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.688+0000 7f6e3d232640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b5df2b60 0x55b5b5df2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:39672/0 (socket says 172.21.15.19:39672) 2024-09-19T08:52:19.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.688+0000 7f6e3ca31640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b5b5df3480 0x55b5b5dfd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51270/0 (socket says 172.21.15.19:51270) 2024-09-19T08:52:19.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.688+0000 7f6e3d232640 1 -- 172.21.15.19:0/1887782453 learned_addr learned my addr 172.21.15.19:0/1887782453 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:19.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.688+0000 7f6e3d232640 1 --2- 172.21.15.19:0/4260811708 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6e200a32d0 0x7f6e200a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:19.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.688+0000 7f6e2dffb640 1 -- 172.21.15.19:0/4260811708 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6e280cf7a0 con 0x7f6e381036e0 2024-09-19T08:52:19.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.688+0000 7f6e2ffff640 1 --2- 172.21.15.19:0/1887782453 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b5b5dfdd40 0x55b5b5e00130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:19.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.689+0000 7f6e3d232640 1 -- 172.21.15.19:0/1887782453 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b5b5dfdd40 msgr2=0x55b5b5e00130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:19.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.689+0000 7f6e3d232640 1 --2- 172.21.15.19:0/1887782453 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b5b5dfdd40 0x55b5b5e00130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:19.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.689+0000 7f6e3d232640 1 -- 172.21.15.19:0/1887782453 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b5b5df3480 msgr2=0x55b5b5dfd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:19.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.689+0000 7f6e3d232640 1 --2- 172.21.15.19:0/1887782453 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b5b5df3480 0x55b5b5dfd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:19.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.689+0000 7f6e3d232640 1 -- 172.21.15.19:0/1887782453 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5b5d0c1f0 con 0x55b5b5df2b60 2024-09-19T08:52:19.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.689+0000 7f6e3ca31640 1 --2- 172.21.15.19:0/1887782453 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b5b5df3480 0x55b5b5dfd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:52:19.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.689+0000 7f6e2ffff640 1 --2- 172.21.15.19:0/1887782453 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b5b5dfdd40 0x55b5b5e00130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:19.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.689+0000 7f6e3d232640 1 --2- 172.21.15.19:0/1887782453 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b5df2b60 0x55b5b5df2f40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6e30012d80 tx=0x7f6e3000f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=216e0e7afb39c625 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:19.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.689+0000 7f6e3d232640 1 --2- 172.21.15.19:0/4260811708 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6e200a32d0 0x7f6e200a5790 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6e3000fc30 tx=0x7f6e3001a000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:19.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.689+0000 7f6e1effd640 1 -- 172.21.15.19:0/1887782453 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e30020070 con 0x55b5b5df2b60 2024-09-19T08:52:19.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.689+0000 7f6e1effd640 1 -- 172.21.15.19:0/1887782453 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e3000ab70 con 0x55b5b5df2b60 2024-09-19T08:52:19.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.689+0000 7f6e1effd640 1 -- 172.21.15.19:0/1887782453 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e3000d3d0 con 0x55b5b5df2b60 2024-09-19T08:52:19.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.690+0000 7f6e4106e740 1 -- 172.21.15.19:0/1887782453 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b5df2b60 msgr2=0x55b5b5df2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:19.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.690+0000 7f6e4106e740 1 --2- 172.21.15.19:0/1887782453 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b5df2b60 0x55b5b5df2f40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6e30012d80 tx=0x7f6e3000f730 comp rx=0 tx=0).stop 2024-09-19T08:52:19.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.690+0000 7f6e4106e740 1 -- 172.21.15.19:0/1887782453 shutdown_connections 2024-09-19T08:52:19.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.690+0000 7f6e4106e740 1 --2- 172.21.15.19:0/1887782453 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b5b5dfdd40 0x55b5b5e00130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:19.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.690+0000 7f6e4106e740 1 --2- 172.21.15.19:0/1887782453 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b5b5df3480 0x55b5b5dfd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:19.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.690+0000 7f6e4106e740 1 --2- 172.21.15.19:0/1887782453 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b5df2b60 0x55b5b5df2f40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:19.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.690+0000 7f6e4106e740 1 -- 172.21.15.19:0/1887782453 >> 172.21.15.19:0/1887782453 conn(0x55b5b5def0f0 msgr2=0x55b5b5def4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:19.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.690+0000 7f6e4106e740 1 -- 172.21.15.19:0/1887782453 shutdown_connections 2024-09-19T08:52:19.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.690+0000 7f6e4106e740 1 -- 172.21.15.19:0/1887782453 wait complete. 2024-09-19T08:52:19.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.691+0000 7f6e4106e740 1 -- start start 2024-09-19T08:52:19.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.691+0000 7f6e4106e740 1 Processor -- start 2024-09-19T08:52:19.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.691+0000 7f6e4106e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b5df2b60 0x55b5b5dfac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:19.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.691+0000 7f6e4106e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b5b5df3480 0x55b5b5dfb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:19.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.691+0000 7f6e4106e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b5b5dfdd40 0x55b5b5dfb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:19.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.691+0000 7f6e4106e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b5b5e00910 con 0x55b5b5df3480 2024-09-19T08:52:19.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.691+0000 7f6e4106e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b5b5d12f10 con 0x55b5b5df2b60 2024-09-19T08:52:19.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.691+0000 7f6e4106e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b5b5e00a90 con 0x55b5b5dfdd40 2024-09-19T08:52:19.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.691+0000 7f6e4106e740 10 client.0 _ll_register_callbacks cb 0x55b5b5cdba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:19.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.691+0000 7f6e3ca31640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b5df2b60 0x55b5b5dfac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:19.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.691+0000 7f6e2ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b5b5df3480 0x55b5b5dfb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:19.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.691+0000 7f6e3ca31640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b5df2b60 0x55b5b5dfac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:39686/0 (socket says 172.21.15.19:39686) 2024-09-19T08:52:19.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.691+0000 7f6e3ca31640 1 -- 172.21.15.19:0/165661085 learned_addr learned my addr 172.21.15.19:0/165661085 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:19.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.691+0000 7f6e2ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b5b5df3480 0x55b5b5dfb1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51276/0 (socket says 172.21.15.19:51276) 2024-09-19T08:52:19.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.691+0000 7f6e3d232640 1 --2- 172.21.15.19:0/165661085 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b5b5dfdd40 0x55b5b5dfb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:19.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.692+0000 7f6e2ffff640 1 -- 172.21.15.19:0/165661085 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b5b5dfdd40 msgr2=0x55b5b5dfb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:19.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.692+0000 7f6e2ffff640 1 --2- 172.21.15.19:0/165661085 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b5b5dfdd40 0x55b5b5dfb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:19.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.692+0000 7f6e2ffff640 1 -- 172.21.15.19:0/165661085 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b5df2b60 msgr2=0x55b5b5dfac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:19.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.692+0000 7f6e2ffff640 1 --2- 172.21.15.19:0/165661085 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b5df2b60 0x55b5b5dfac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:19.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.692+0000 7f6e2ffff640 1 -- 172.21.15.19:0/165661085 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5b5ac96a0 con 0x55b5b5df3480 2024-09-19T08:52:19.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.692+0000 7f6e3ca31640 1 --2- 172.21.15.19:0/165661085 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b5df2b60 0x55b5b5dfac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:52:19.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.692+0000 7f6e2ffff640 1 --2- 172.21.15.19:0/165661085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b5b5df3480 0x55b5b5dfb1d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6e280cd160 tx=0x7f6e2809b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0ef7ebe13188f31 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:19.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.692+0000 7f6e17fff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:52:19.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.692+0000 7f6e17fff640 1 -- 172.21.15.19:0/165661085 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e2801d030 con 0x55b5b5df3480 2024-09-19T08:52:19.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.692+0000 7f6e17fff640 1 -- 172.21.15.19:0/165661085 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6e2809b2c0 con 0x55b5b5df3480 2024-09-19T08:52:19.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.692+0000 7f6e4106e740 1 -- 172.21.15.19:0/165661085 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e3000ab70 con 0x55b5b5df3480 2024-09-19T08:52:19.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.692+0000 7f6e17fff640 1 -- 172.21.15.19:0/165661085 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6e280a48e0 con 0x55b5b5df3480 2024-09-19T08:52:19.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.692+0000 7f6e4106e740 10 client.15303 fetch_fsmap learned FSMap version 28 2024-09-19T08:52:19.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.692+0000 7f6e4106e740 1 -- 172.21.15.19:0/165661085 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b5b5e0c590 con 0x55b5b5df3480 2024-09-19T08:52:19.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.692+0000 7f6e17fff640 1 -- 172.21.15.19:0/165661085 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e3000ab70 con 0x55b5b5df3480 2024-09-19T08:52:19.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.693+0000 7f6e17fff640 1 -- 172.21.15.19:0/165661085 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6e280860c0 con 0x55b5b5df3480 2024-09-19T08:52:19.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.693+0000 7f6e4106e740 10 client.15303 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:52:19.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.693+0000 7f6e4106e740 10 client.15303 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:19.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.693+0000 7f6e4106e740 20 client.15303 populate_metadata read hostname 'smithi019' 2024-09-19T08:52:19.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.693+0000 7f6e4106e740 1 --2- 172.21.15.19:0/165661085 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b5b5e0da50 0x55b5b5e0fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:19.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.693+0000 7f6e4106e740 4 client.15303 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:19.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.693+0000 7f6e4106e740 1 -- 172.21.15.19:0/165661085 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5b5d657f0 con 0x55b5b5e0da50 2024-09-19T08:52:19.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.693+0000 7f6e3ca31640 1 --2- 172.21.15.19:0/165661085 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b5b5e0da50 0x55b5b5e0fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:19.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.693+0000 7f6e3ca31640 1 --2- 172.21.15.19:0/165661085 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b5b5e0da50 0x55b5b5e0fea0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6640312667e2320 server_cookie=668a77b1ff4860e1 in_seq=0 out_seq=0 2024-09-19T08:52:19.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.693+0000 7f6e17fff640 10 client.15303 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:52:19.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.694+0000 7f6e17fff640 1 -- 172.21.15.19:0/165661085 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b5b5d657f0 con 0x55b5b5e0da50 2024-09-19T08:52:19.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.694+0000 7f6e17fff640 10 client.15303 handle_command_reply: tid=0 2024-09-19T08:52:19.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.694+0000 7f6e4106e740 1 client.15303 shutdown 2024-09-19T08:52:19.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.694+0000 7f6e4106e740 1 -- 172.21.15.19:0/165661085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b5b5df3480 msgr2=0x55b5b5dfb1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:19.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.694+0000 7f6e4106e740 1 --2- 172.21.15.19:0/165661085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b5b5df3480 0x55b5b5dfb1d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f6e280cd160 tx=0x7f6e2809b690 comp rx=0 tx=0).stop 2024-09-19T08:52:19.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.694+0000 7f6e4106e740 1 -- 172.21.15.19:0/165661085 shutdown_connections 2024-09-19T08:52:19.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.694+0000 7f6e4106e740 1 --2- 172.21.15.19:0/165661085 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b5b5e0da50 0x55b5b5e0fea0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:19.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.694+0000 7f6e4106e740 1 --2- 172.21.15.19:0/165661085 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b5b5dfdd40 0x55b5b5dfb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:19.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.694+0000 7f6e4106e740 1 --2- 172.21.15.19:0/165661085 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b5b5df3480 0x55b5b5dfb1d0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:19.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.694+0000 7f6e17fff640 0 client.15303 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:52:19.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.694+0000 7f6e4106e740 1 --2- 172.21.15.19:0/165661085 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b5df2b60 0x55b5b5dfac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:19.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.694+0000 7f6e4106e740 1 -- 172.21.15.19:0/165661085 >> 172.21.15.19:0/165661085 conn(0x55b5b5def0f0 msgr2=0x55b5b5df4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:19.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.694+0000 7f6e4106e740 1 -- 172.21.15.19:0/165661085 shutdown_connections 2024-09-19T08:52:19.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.695+0000 7f6e4106e740 1 -- 172.21.15.19:0/165661085 wait complete. 2024-09-19T08:52:19.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.695+0000 7f6e4106e740 20 client.15303 trim_cache size 0 max 16384 2024-09-19T08:52:19.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.712+0000 7f6e4106e740 1 Processor -- start 2024-09-19T08:52:19.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.712+0000 7f6e4106e740 1 -- start start 2024-09-19T08:52:19.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.712+0000 7f6e4106e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b5b5df2b60 0x55b5b5e15770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:19.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.712+0000 7f6e4106e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b5df3480 0x55b5b5e15cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:19.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.712+0000 7f6e4106e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b5b5dfdd40 0x55b5b5df7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:19.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.712+0000 7f6e4106e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6e381ad460 con 0x55b5b5df2b60 2024-09-19T08:52:19.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.712+0000 7f6e4106e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6e381aefa0 con 0x55b5b5df3480 2024-09-19T08:52:19.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.712+0000 7f6e4106e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6e381adb30 con 0x55b5b5dfdd40 2024-09-19T08:52:19.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.712+0000 7f6e3ca31640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b5b5df2b60 0x55b5b5e15770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:19.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.712+0000 7f6e3ca31640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b5b5df2b60 0x55b5b5e15770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51290/0 (socket says 172.21.15.19:51290) 2024-09-19T08:52:19.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.712+0000 7f6e3ca31640 1 -- 172.21.15.19:0/3615792521 learned_addr learned my addr 172.21.15.19:0/3615792521 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:19.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.713+0000 7f6e2ffff640 1 --2- 172.21.15.19:0/3615792521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b5df3480 0x55b5b5e15cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:19.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.713+0000 7f6e3ca31640 1 -- 172.21.15.19:0/3615792521 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b5b5dfdd40 msgr2=0x55b5b5df7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:19.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.713+0000 7f6e3ca31640 1 --2- 172.21.15.19:0/3615792521 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b5b5dfdd40 0x55b5b5df7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:19.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.713+0000 7f6e3ca31640 1 -- 172.21.15.19:0/3615792521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b5df3480 msgr2=0x55b5b5e15cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:19.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.713+0000 7f6e3ca31640 1 --2- 172.21.15.19:0/3615792521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b5df3480 0x55b5b5e15cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:19.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.713+0000 7f6e3ca31640 1 -- 172.21.15.19:0/3615792521 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5b5df91e0 con 0x55b5b5df2b60 2024-09-19T08:52:19.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.713+0000 7f6e3ca31640 1 --2- 172.21.15.19:0/3615792521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b5b5df2b60 0x55b5b5e15770 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009930 tx=0x7f6e34031b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=593a37ae1553846b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:19.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.713+0000 7f6e1e7fc640 1 -- 172.21.15.19:0/3615792521 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e3404d030 con 0x55b5b5df2b60 2024-09-19T08:52:19.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.713+0000 7f6e1e7fc640 1 -- 172.21.15.19:0/3615792521 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e34005020 con 0x55b5b5df2b60 2024-09-19T08:52:19.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.713+0000 7f6e1e7fc640 1 -- 172.21.15.19:0/3615792521 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e34035040 con 0x55b5b5df2b60 2024-09-19T08:52:19.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.714+0000 7f6e4106e740 1 -- 172.21.15.19:0/3615792521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b5b5df2b60 msgr2=0x55b5b5e15770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:19.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.714+0000 7f6e4106e740 1 --2- 172.21.15.19:0/3615792521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b5b5df2b60 0x55b5b5e15770 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009930 tx=0x7f6e34031b10 comp rx=0 tx=0).stop 2024-09-19T08:52:19.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.714+0000 7f6e4106e740 1 -- 172.21.15.19:0/3615792521 shutdown_connections 2024-09-19T08:52:19.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.714+0000 7f6e4106e740 1 --2- 172.21.15.19:0/3615792521 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b5b5dfdd40 0x55b5b5df7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:19.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.714+0000 7f6e4106e740 1 --2- 172.21.15.19:0/3615792521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b5df3480 0x55b5b5e15cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:19.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.714+0000 7f6e4106e740 1 --2- 172.21.15.19:0/3615792521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b5b5df2b60 0x55b5b5e15770 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:19.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.714+0000 7f6e4106e740 1 -- 172.21.15.19:0/3615792521 >> 172.21.15.19:0/3615792521 conn(0x55b5b5def0f0 msgr2=0x55b5b5dfcc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:19.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.714+0000 7f6e4106e740 1 -- 172.21.15.19:0/3615792521 shutdown_connections 2024-09-19T08:52:19.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.714+0000 7f6e4106e740 1 -- 172.21.15.19:0/3615792521 wait complete. 2024-09-19T08:52:19.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.714+0000 7f6e4106e740 1 -- start start 2024-09-19T08:52:19.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.714+0000 7f6e4106e740 1 Processor -- start 2024-09-19T08:52:19.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.714+0000 7f6e4106e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b5df2b60 0x55b5b5df7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:19.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.714+0000 7f6e4106e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b5b5df3480 0x55b5b5df83a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:19.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.715+0000 7f6e4106e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b5b5dfdd40 0x55b5b5df88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:19.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.715+0000 7f6e4106e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6e381ae8d0 con 0x55b5b5dfdd40 2024-09-19T08:52:19.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.715+0000 7f6e4106e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6e381ae200 con 0x55b5b5df2b60 2024-09-19T08:52:19.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.715+0000 7f6e4106e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6e381ab440 con 0x55b5b5df3480 2024-09-19T08:52:19.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.715+0000 7f6e4106e740 10 client.0 _ll_register_callbacks cb 0x7f6e2800c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:19.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.715+0000 7f6e3d232640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b5b5dfdd40 0x55b5b5df88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:19.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.715+0000 7f6e3d232640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b5b5dfdd40 0x55b5b5df88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51292/0 (socket says 172.21.15.19:51292) 2024-09-19T08:52:19.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.715+0000 7f6e3d232640 1 -- 172.21.15.19:0/3735294846 learned_addr learned my addr 172.21.15.19:0/3735294846 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:19.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.715+0000 7f6e3ca31640 1 --2- 172.21.15.19:0/3735294846 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b5df2b60 0x55b5b5df7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:19.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.715+0000 7f6e2ffff640 1 --2- 172.21.15.19:0/3735294846 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b5b5df3480 0x55b5b5df83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:19.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.715+0000 7f6e3d232640 1 -- 172.21.15.19:0/3735294846 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b5b5df3480 msgr2=0x55b5b5df83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:19.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.715+0000 7f6e3d232640 1 --2- 172.21.15.19:0/3735294846 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b5b5df3480 0x55b5b5df83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:19.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.715+0000 7f6e3d232640 1 -- 172.21.15.19:0/3735294846 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b5df2b60 msgr2=0x55b5b5df7e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:19.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.715+0000 7f6e3d232640 1 --2- 172.21.15.19:0/3735294846 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b5df2b60 0x55b5b5df7e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:19.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.715+0000 7f6e3d232640 1 -- 172.21.15.19:0/3735294846 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5b5e778a0 con 0x55b5b5dfdd40 2024-09-19T08:52:19.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.715+0000 7f6e3d232640 1 --2- 172.21.15.19:0/3735294846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b5b5dfdd40 0x55b5b5df88e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6e3001ca90 tx=0x7f6e3001ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=796c41ecff091a4d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:19.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.715+0000 7f6e17fff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:52:19.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.715+0000 7f6e17fff640 1 -- 172.21.15.19:0/3735294846 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e30020040 con 0x55b5b5dfdd40 2024-09-19T08:52:19.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.715+0000 7f6e17fff640 1 -- 172.21.15.19:0/3735294846 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6e30004a00 con 0x55b5b5dfdd40 2024-09-19T08:52:19.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.715+0000 7f6e4106e740 1 -- 172.21.15.19:0/3735294846 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6e34005020 con 0x55b5b5dfdd40 2024-09-19T08:52:19.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.716+0000 7f6e17fff640 1 -- 172.21.15.19:0/3735294846 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6e3000ab70 con 0x55b5b5dfdd40 2024-09-19T08:52:19.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.716+0000 7f6e4106e740 10 client.15309 fetch_fsmap learned FSMap version 28 2024-09-19T08:52:19.056 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:52:19.056 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-19T08:52:19.056 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "8cdad152-4ed0-409d-9b08-a0d4ab6b1dab", 2024-09-19T08:52:19.057 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-19T08:52:19.057 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:52:19.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.716+0000 7f6e4106e740 1 -- 172.21.15.19:0/3735294846 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b5b5e78b80 con 0x55b5b5dfdd40 2024-09-19T08:52:19.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.716+0000 7f6e17fff640 1 -- 172.21.15.19:0/3735294846 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6e34005020 con 0x55b5b5dfdd40 2024-09-19T08:52:19.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.716+0000 7f6e17fff640 1 -- 172.21.15.19:0/3735294846 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f6e3002c070 con 0x55b5b5dfdd40 2024-09-19T08:52:19.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.716+0000 7f6e4106e740 10 client.15309 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:52:19.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.716+0000 7f6e4106e740 10 client.15309 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:19.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.716+0000 7f6e4106e740 20 client.15309 populate_metadata read hostname 'smithi019' 2024-09-19T08:52:19.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.716+0000 7f6e4106e740 1 --2- 172.21.15.19:0/3735294846 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b5b5e79130 0x55b5b5e7b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:19.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.716+0000 7f6e4106e740 4 client.15309 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:52:19.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.716+0000 7f6e4106e740 1 -- 172.21.15.19:0/3735294846 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b5b5d5fd00 con 0x55b5b5e79130 2024-09-19T08:52:19.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.716+0000 7f6e3ca31640 1 --2- 172.21.15.19:0/3735294846 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b5b5e79130 0x55b5b5e7b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:19.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.717+0000 7f6e3ca31640 1 --2- 172.21.15.19:0/3735294846 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b5b5e79130 0x55b5b5e7b550 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a90e4ea7306da3f server_cookie=434f3c3500b7d1f6 in_seq=0 out_seq=0 2024-09-19T08:52:19.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.717+0000 7f6e17fff640 10 client.15309 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:52:19.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.718+0000 7f6e17fff640 1 -- 172.21.15.19:0/3735294846 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b5b5d5fd00 con 0x55b5b5e79130 2024-09-19T08:52:19.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.718+0000 7f6e17fff640 10 client.15309 handle_command_reply: tid=0 2024-09-19T08:52:19.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.718+0000 7f6e4106e740 1 client.15309 shutdown 2024-09-19T08:52:19.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.718+0000 7f6e4106e740 1 -- 172.21.15.19:0/3735294846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b5b5dfdd40 msgr2=0x55b5b5df88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:19.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.718+0000 7f6e4106e740 1 --2- 172.21.15.19:0/3735294846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b5b5dfdd40 0x55b5b5df88e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f6e3001ca90 tx=0x7f6e3001ce20 comp rx=0 tx=0).stop 2024-09-19T08:52:19.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.718+0000 7f6e4106e740 1 -- 172.21.15.19:0/3735294846 shutdown_connections 2024-09-19T08:52:19.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.718+0000 7f6e4106e740 1 --2- 172.21.15.19:0/3735294846 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b5b5e79130 0x55b5b5e7b550 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:19.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.718+0000 7f6e4106e740 1 --2- 172.21.15.19:0/3735294846 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b5b5df3480 0x55b5b5df83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:19.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.718+0000 7f6e4106e740 1 --2- 172.21.15.19:0/3735294846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b5b5dfdd40 0x55b5b5df88e0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:19.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.718+0000 7f6e17fff640 0 client.15309 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:52:19.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.718+0000 7f6e4106e740 1 --2- 172.21.15.19:0/3735294846 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b5b5df2b60 0x55b5b5df7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:19.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.718+0000 7f6e4106e740 1 -- 172.21.15.19:0/3735294846 >> 172.21.15.19:0/3735294846 conn(0x55b5b5def0f0 msgr2=0x55b5b5df45b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:19.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.718+0000 7f6e4106e740 1 -- 172.21.15.19:0/3735294846 shutdown_connections 2024-09-19T08:52:19.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.718+0000 7f6e4106e740 1 -- 172.21.15.19:0/3735294846 wait complete. 2024-09-19T08:52:19.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.718+0000 7f6e4106e740 20 client.15309 trim_cache size 0 max 16384 2024-09-19T08:52:19.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.719+0000 7f6e3ec95640 1 -- 172.21.15.19:0/4260811708 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6e200a32d0 msgr2=0x7f6e200a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:19.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.719+0000 7f6e3ec95640 1 --2- 172.21.15.19:0/4260811708 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6e200a32d0 0x7f6e200a5790 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6e3000fc30 tx=0x7f6e3001a000 comp rx=0 tx=0).stop 2024-09-19T08:52:19.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.719+0000 7f6e3ec95640 1 -- 172.21.15.19:0/4260811708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e381036e0 msgr2=0x7f6e38198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:19.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.719+0000 7f6e3ec95640 1 --2- 172.21.15.19:0/4260811708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e381036e0 0x7f6e38198a60 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f6e2800c970 tx=0x7f6e2800ce30 comp rx=0 tx=0).stop 2024-09-19T08:52:19.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.719+0000 7f6e3ec95640 1 -- 172.21.15.19:0/4260811708 shutdown_connections 2024-09-19T08:52:19.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.719+0000 7f6e3ec95640 1 --2- 172.21.15.19:0/4260811708 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6e200a32d0 0x7f6e200a5790 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:19.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.719+0000 7f6e3ec95640 1 --2- 172.21.15.19:0/4260811708 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6e381082a0 0x7f6e3819cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:19.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.719+0000 7f6e3ec95640 1 --2- 172.21.15.19:0/4260811708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6e381036e0 0x7f6e38198a60 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:19.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.719+0000 7f6e3ec95640 1 --2- 172.21.15.19:0/4260811708 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6e38102d30 0x7f6e38198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:19.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.719+0000 7f6e3ec95640 1 -- 172.21.15.19:0/4260811708 >> 172.21.15.19:0/4260811708 conn(0x7f6e380fc7d0 msgr2=0x7f6e38105d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:19.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.719+0000 7f6e3ec95640 1 -- 172.21.15.19:0/4260811708 shutdown_connections 2024-09-19T08:52:19.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:18.719+0000 7f6e3ec95640 1 -- 172.21.15.19:0/4260811708 wait complete. 2024-09-19T08:52:19.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:19.026+0000 7f4527fff640 1 -- 172.21.15.19:0/3329703666 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259039 (secure 0 0 0) 0x7f4540106ee0 con 0x7f45280a32d0 2024-09-19T08:52:19.072 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:52:19.073 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-19T08:52:19.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:19.029+0000 7f45452ae640 1 -- 172.21.15.19:0/3329703666 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f45280a32d0 msgr2=0x7f45280a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:19.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:19.029+0000 7f45452ae640 1 --2- 172.21.15.19:0/3329703666 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f45280a32d0 0x7f45280a5790 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4530005fd0 tx=0x7f4530009500 comp rx=0 tx=0).stop 2024-09-19T08:52:19.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:19.029+0000 7f45452ae640 1 -- 172.21.15.19:0/3329703666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4540102ef0 msgr2=0x7f45401a4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:19.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:19.029+0000 7f45452ae640 1 --2- 172.21.15.19:0/3329703666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4540102ef0 0x7f45401a4360 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f453802a9a0 tx=0x7f4538003b90 comp rx=0 tx=0).stop 2024-09-19T08:52:19.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:19.029+0000 7f45452ae640 1 -- 172.21.15.19:0/3329703666 shutdown_connections 2024-09-19T08:52:19.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:19.029+0000 7f45452ae640 1 --2- 172.21.15.19:0/3329703666 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f45280a32d0 0x7f45280a5790 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:19.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:19.029+0000 7f45452ae640 1 --2- 172.21.15.19:0/3329703666 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4540102570 0x7f4540199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:19.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:19.029+0000 7f45452ae640 1 --2- 172.21.15.19:0/3329703666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4540102ef0 0x7f45401a4360 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:19.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:19.029+0000 7f45452ae640 1 --2- 172.21.15.19:0/3329703666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4540100e20 0x7f45401992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:19.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:19.029+0000 7f45452ae640 1 -- 172.21.15.19:0/3329703666 >> 172.21.15.19:0/3329703666 conn(0x7f45400fc7d0 msgr2=0x7f45401067d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:19.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:19.029+0000 7f45452ae640 1 -- 172.21.15.19:0/3329703666 shutdown_connections 2024-09-19T08:52:19.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:19.029+0000 7f45452ae640 1 -- 172.21.15.19:0/3329703666 wait complete. 2024-09-19T08:52:19.690 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:52:19.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:19 smithi203 ceph-mon[35450]: pgmap v340: 97 pgs: 97 active+clean; 650 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-09-19T08:52:19.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:19 smithi203 ceph-mon[35450]: scrub queued for path: / 2024-09-19T08:52:19.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:19 smithi203 ceph-mon[35450]: scrub summary: idle+waiting paths [/] 2024-09-19T08:52:19.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:19 smithi203 ceph-mon[35450]: scrub summary: active paths [/] 2024-09-19T08:52:19.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:19 smithi203 ceph-mon[35450]: scrub summary: idle+waiting paths [/] 2024-09-19T08:52:20.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:19 smithi019 ceph-mon[30976]: pgmap v340: 97 pgs: 97 active+clean; 650 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-09-19T08:52:20.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:19 smithi019 ceph-mon[30976]: scrub queued for path: / 2024-09-19T08:52:20.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:19 smithi019 ceph-mon[30976]: scrub summary: idle+waiting paths [/] 2024-09-19T08:52:20.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:19 smithi019 ceph-mon[30976]: scrub summary: active paths [/] 2024-09-19T08:52:20.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:19 smithi019 ceph-mon[30976]: scrub summary: idle+waiting paths [/] 2024-09-19T08:52:20.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:19 smithi155 ceph-mon[34921]: pgmap v340: 97 pgs: 97 active+clean; 650 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.6 KiB/s wr, 10 op/s 2024-09-19T08:52:20.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:19 smithi155 ceph-mon[34921]: scrub queued for path: / 2024-09-19T08:52:20.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:19 smithi155 ceph-mon[34921]: scrub summary: idle+waiting paths [/] 2024-09-19T08:52:20.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:19 smithi155 ceph-mon[34921]: scrub summary: active paths [/] 2024-09-19T08:52:20.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:19 smithi155 ceph-mon[34921]: scrub summary: idle+waiting paths [/] 2024-09-19T08:52:20.290 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":340,"stamp":"2024-09-19T08:52:17.876478+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665113,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1241,"num_read_kb":742,"num_write":450,"num_write_kb":3098,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1181525,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":868,"ondisk_log_size":868,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":356192,"kb_used_data":11104,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585632,"statfs":{"total":1151940427776,"available":1151575687168,"internally_reserved":0,"allocated":11370496,"data_stored":7183779,"data_compressed":107538,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19142,"internal_metadata":353154362},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":7561,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":61,"num_write":17,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002972"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837586+0000","last_change":"2024-09-19T08:50:15.893270+0000","last_active":"2024-09-19T08:51:51.837586+0000","last_peered":"2024-09-19T08:51:51.837586+0000","last_clean":"2024-09-19T08:51:51.837586+0000","last_became_active":"2024-09-19T08:50:15.892020+0000","last_became_peered":"2024-09-19T08:50:15.892020+0000","last_unstale":"2024-09-19T08:51:51.837586+0000","last_undegraded":"2024-09-19T08:51:51.837586+0000","last_fullsized":"2024-09-19T08:51:51.837586+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:40.846708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.834475+0000","last_change":"2024-09-19T08:50:15.889331+0000","last_active":"2024-09-19T08:51:51.834475+0000","last_peered":"2024-09-19T08:51:51.834475+0000","last_clean":"2024-09-19T08:51:51.834475+0000","last_became_active":"2024-09-19T08:50:15.887082+0000","last_became_peered":"2024-09-19T08:50:15.887082+0000","last_unstale":"2024-09-19T08:51:51.834475+0000","last_undegraded":"2024-09-19T08:51:51.834475+0000","last_fullsized":"2024-09-19T08:51:51.834475+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:46.934172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.836646+0000","last_change":"2024-09-19T08:50:15.891714+0000","last_active":"2024-09-19T08:51:51.836646+0000","last_peered":"2024-09-19T08:51:51.836646+0000","last_clean":"2024-09-19T08:51:51.836646+0000","last_became_active":"2024-09-19T08:50:15.891380+0000","last_became_peered":"2024-09-19T08:50:15.891380+0000","last_unstale":"2024-09-19T08:51:51.836646+0000","last_undegraded":"2024-09-19T08:51:51.836646+0000","last_fullsized":"2024-09-19T08:51:51.836646+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:02.203252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.820814+0000","last_change":"2024-09-19T08:50:15.896157+0000","last_active":"2024-09-19T08:51:51.820814+0000","last_peered":"2024-09-19T08:51:51.820814+0000","last_clean":"2024-09-19T08:51:51.820814+0000","last_became_active":"2024-09-19T08:50:15.895772+0000","last_became_peered":"2024-09-19T08:50:15.895772+0000","last_unstale":"2024-09-19T08:51:51.820814+0000","last_undegraded":"2024-09-19T08:51:51.820814+0000","last_fullsized":"2024-09-19T08:51:51.820814+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:12.915745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.819392+0000","last_change":"2024-09-19T08:50:15.886600+0000","last_active":"2024-09-19T08:51:51.819392+0000","last_peered":"2024-09-19T08:51:51.819392+0000","last_clean":"2024-09-19T08:51:51.819392+0000","last_became_active":"2024-09-19T08:50:15.886270+0000","last_became_peered":"2024-09-19T08:50:15.886270+0000","last_unstale":"2024-09-19T08:51:51.819392+0000","last_undegraded":"2024-09-19T08:51:51.819392+0000","last_fullsized":"2024-09-19T08:51:51.819392+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:53.779930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.826597+0000","last_change":"2024-09-19T08:50:15.889475+0000","last_active":"2024-09-19T08:51:51.826597+0000","last_peered":"2024-09-19T08:51:51.826597+0000","last_clean":"2024-09-19T08:51:51.826597+0000","last_became_active":"2024-09-19T08:50:15.889134+0000","last_became_peered":"2024-09-19T08:50:15.889134+0000","last_unstale":"2024-09-19T08:51:51.826597+0000","last_undegraded":"2024-09-19T08:51:51.826597+0000","last_fullsized":"2024-09-19T08:51:51.826597+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:53.977662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829681+0000","last_change":"2024-09-19T08:50:15.897163+0000","last_active":"2024-09-19T08:51:51.829681+0000","last_peered":"2024-09-19T08:51:51.829681+0000","last_clean":"2024-09-19T08:51:51.829681+0000","last_became_active":"2024-09-19T08:50:15.895161+0000","last_became_peered":"2024-09-19T08:50:15.895161+0000","last_unstale":"2024-09-19T08:51:51.829681+0000","last_undegraded":"2024-09-19T08:51:51.829681+0000","last_fullsized":"2024-09-19T08:51:51.829681+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:32.432691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829477+0000","last_change":"2024-09-19T08:50:15.891197+0000","last_active":"2024-09-19T08:51:51.829477+0000","last_peered":"2024-09-19T08:51:51.829477+0000","last_clean":"2024-09-19T08:51:51.829477+0000","last_became_active":"2024-09-19T08:50:15.890880+0000","last_became_peered":"2024-09-19T08:50:15.890880+0000","last_unstale":"2024-09-19T08:51:51.829477+0000","last_undegraded":"2024-09-19T08:51:51.829477+0000","last_fullsized":"2024-09-19T08:51:51.829477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:41.100341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.836501+0000","last_change":"2024-09-19T08:50:15.896043+0000","last_active":"2024-09-19T08:51:51.836501+0000","last_peered":"2024-09-19T08:51:51.836501+0000","last_clean":"2024-09-19T08:51:51.836501+0000","last_became_active":"2024-09-19T08:50:15.895498+0000","last_became_peered":"2024-09-19T08:50:15.895498+0000","last_unstale":"2024-09-19T08:51:51.836501+0000","last_undegraded":"2024-09-19T08:51:51.836501+0000","last_fullsized":"2024-09-19T08:51:51.836501+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:57.956427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.830052+0000","last_change":"2024-09-19T08:50:15.887658+0000","last_active":"2024-09-19T08:51:51.830052+0000","last_peered":"2024-09-19T08:51:51.830052+0000","last_clean":"2024-09-19T08:51:51.830052+0000","last_became_active":"2024-09-19T08:50:15.887199+0000","last_became_peered":"2024-09-19T08:50:15.887199+0000","last_unstale":"2024-09-19T08:51:51.830052+0000","last_undegraded":"2024-09-19T08:51:51.830052+0000","last_fullsized":"2024-09-19T08:51:51.830052+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:39.947735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.834776+0000","last_change":"2024-09-19T08:50:15.894865+0000","last_active":"2024-09-19T08:51:51.834776+0000","last_peered":"2024-09-19T08:51:51.834776+0000","last_clean":"2024-09-19T08:51:51.834776+0000","last_became_active":"2024-09-19T08:50:15.894475+0000","last_became_peered":"2024-09-19T08:50:15.894475+0000","last_unstale":"2024-09-19T08:51:51.834776+0000","last_undegraded":"2024-09-19T08:51:51.834776+0000","last_fullsized":"2024-09-19T08:51:51.834776+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:43.235991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827890+0000","last_change":"2024-09-19T08:50:15.897209+0000","last_active":"2024-09-19T08:51:51.827890+0000","last_peered":"2024-09-19T08:51:51.827890+0000","last_clean":"2024-09-19T08:51:51.827890+0000","last_became_active":"2024-09-19T08:50:15.896866+0000","last_became_peered":"2024-09-19T08:50:15.896866+0000","last_unstale":"2024-09-19T08:51:51.827890+0000","last_undegraded":"2024-09-19T08:51:51.827890+0000","last_fullsized":"2024-09-19T08:51:51.827890+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:23.036534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.825376+0000","last_change":"2024-09-19T08:50:15.890076+0000","last_active":"2024-09-19T08:51:51.825376+0000","last_peered":"2024-09-19T08:51:51.825376+0000","last_clean":"2024-09-19T08:51:51.825376+0000","last_became_active":"2024-09-19T08:50:15.889735+0000","last_became_peered":"2024-09-19T08:50:15.889735+0000","last_unstale":"2024-09-19T08:51:51.825376+0000","last_undegraded":"2024-09-19T08:51:51.825376+0000","last_fullsized":"2024-09-19T08:51:51.825376+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:25.602757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.834241+0000","last_change":"2024-09-19T08:50:15.886739+0000","last_active":"2024-09-19T08:51:51.834241+0000","last_peered":"2024-09-19T08:51:51.834241+0000","last_clean":"2024-09-19T08:51:51.834241+0000","last_became_active":"2024-09-19T08:50:15.886313+0000","last_became_peered":"2024-09-19T08:50:15.886313+0000","last_unstale":"2024-09-19T08:51:51.834241+0000","last_undegraded":"2024-09-19T08:51:51.834241+0000","last_fullsized":"2024-09-19T08:51:51.834241+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:03.244674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837276+0000","last_change":"2024-09-19T08:50:15.898519+0000","last_active":"2024-09-19T08:51:51.837276+0000","last_peered":"2024-09-19T08:51:51.837276+0000","last_clean":"2024-09-19T08:51:51.837276+0000","last_became_active":"2024-09-19T08:50:15.898249+0000","last_became_peered":"2024-09-19T08:50:15.898249+0000","last_unstale":"2024-09-19T08:51:51.837276+0000","last_undegraded":"2024-09-19T08:51:51.837276+0000","last_fullsized":"2024-09-19T08:51:51.837276+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:32.318895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837455+0000","last_change":"2024-09-19T08:50:15.890324+0000","last_active":"2024-09-19T08:51:51.837455+0000","last_peered":"2024-09-19T08:51:51.837455+0000","last_clean":"2024-09-19T08:51:51.837455+0000","last_became_active":"2024-09-19T08:50:15.887345+0000","last_became_peered":"2024-09-19T08:50:15.887345+0000","last_unstale":"2024-09-19T08:51:51.837455+0000","last_undegraded":"2024-09-19T08:51:51.837455+0000","last_fullsized":"2024-09-19T08:51:51.837455+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:27.989128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837724+0000","last_change":"2024-09-19T08:50:15.896305+0000","last_active":"2024-09-19T08:51:51.837724+0000","last_peered":"2024-09-19T08:51:51.837724+0000","last_clean":"2024-09-19T08:51:51.837724+0000","last_became_active":"2024-09-19T08:50:15.895832+0000","last_became_peered":"2024-09-19T08:50:15.895832+0000","last_unstale":"2024-09-19T08:51:51.837724+0000","last_undegraded":"2024-09-19T08:51:51.837724+0000","last_fullsized":"2024-09-19T08:51:51.837724+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:37.098237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.821237+0000","last_change":"2024-09-19T08:50:15.887251+0000","last_active":"2024-09-19T08:51:51.821237+0000","last_peered":"2024-09-19T08:51:51.821237+0000","last_clean":"2024-09-19T08:51:51.821237+0000","last_became_active":"2024-09-19T08:50:15.886936+0000","last_became_peered":"2024-09-19T08:50:15.886936+0000","last_unstale":"2024-09-19T08:51:51.821237+0000","last_undegraded":"2024-09-19T08:51:51.821237+0000","last_fullsized":"2024-09-19T08:51:51.821237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:38:08.828246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827071+0000","last_change":"2024-09-19T08:50:15.884813+0000","last_active":"2024-09-19T08:51:51.827071+0000","last_peered":"2024-09-19T08:51:51.827071+0000","last_clean":"2024-09-19T08:51:51.827071+0000","last_became_active":"2024-09-19T08:50:15.883445+0000","last_became_peered":"2024-09-19T08:50:15.883445+0000","last_unstale":"2024-09-19T08:51:51.827071+0000","last_undegraded":"2024-09-19T08:51:51.827071+0000","last_fullsized":"2024-09-19T08:51:51.827071+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:39.733501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.821368+0000","last_change":"2024-09-19T08:50:15.887644+0000","last_active":"2024-09-19T08:51:51.821368+0000","last_peered":"2024-09-19T08:51:51.821368+0000","last_clean":"2024-09-19T08:51:51.821368+0000","last_became_active":"2024-09-19T08:50:15.887224+0000","last_became_peered":"2024-09-19T08:50:15.887224+0000","last_unstale":"2024-09-19T08:51:51.821368+0000","last_undegraded":"2024-09-19T08:51:51.821368+0000","last_fullsized":"2024-09-19T08:51:51.821368+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:35.883690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.835961+0000","last_change":"2024-09-19T08:50:15.886678+0000","last_active":"2024-09-19T08:51:51.835961+0000","last_peered":"2024-09-19T08:51:51.835961+0000","last_clean":"2024-09-19T08:51:51.835961+0000","last_became_active":"2024-09-19T08:50:15.886360+0000","last_became_peered":"2024-09-19T08:50:15.886360+0000","last_unstale":"2024-09-19T08:51:51.835961+0000","last_undegraded":"2024-09-19T08:51:51.835961+0000","last_fullsized":"2024-09-19T08:51:51.835961+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:51.515211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.832052+0000","last_change":"2024-09-19T08:50:15.887607+0000","last_active":"2024-09-19T08:51:51.832052+0000","last_peered":"2024-09-19T08:51:51.832052+0000","last_clean":"2024-09-19T08:51:51.832052+0000","last_became_active":"2024-09-19T08:50:15.887266+0000","last_became_peered":"2024-09-19T08:50:15.887266+0000","last_unstale":"2024-09-19T08:51:51.832052+0000","last_undegraded":"2024-09-19T08:51:51.832052+0000","last_fullsized":"2024-09-19T08:51:51.832052+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:44:57.404160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829136+0000","last_change":"2024-09-19T08:50:15.882651+0000","last_active":"2024-09-19T08:51:51.829136+0000","last_peered":"2024-09-19T08:51:51.829136+0000","last_clean":"2024-09-19T08:51:51.829136+0000","last_became_active":"2024-09-19T08:50:15.882298+0000","last_became_peered":"2024-09-19T08:50:15.882298+0000","last_unstale":"2024-09-19T08:51:51.829136+0000","last_undegraded":"2024-09-19T08:51:51.829136+0000","last_fullsized":"2024-09-19T08:51:51.829136+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:16.028013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829040+0000","last_change":"2024-09-19T08:50:15.880407+0000","last_active":"2024-09-19T08:51:51.829040+0000","last_peered":"2024-09-19T08:51:51.829040+0000","last_clean":"2024-09-19T08:51:51.829040+0000","last_became_active":"2024-09-19T08:50:15.880026+0000","last_became_peered":"2024-09-19T08:50:15.880026+0000","last_unstale":"2024-09-19T08:51:51.829040+0000","last_undegraded":"2024-09-19T08:51:51.829040+0000","last_fullsized":"2024-09-19T08:51:51.829040+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:16.600913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.828745+0000","last_change":"2024-09-19T08:50:15.883573+0000","last_active":"2024-09-19T08:51:51.828745+0000","last_peered":"2024-09-19T08:51:51.828745+0000","last_clean":"2024-09-19T08:51:51.828745+0000","last_became_active":"2024-09-19T08:50:15.883258+0000","last_became_peered":"2024-09-19T08:50:15.883258+0000","last_unstale":"2024-09-19T08:51:51.828745+0000","last_undegraded":"2024-09-19T08:51:51.828745+0000","last_fullsized":"2024-09-19T08:51:51.828745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:33.026579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827776+0000","last_change":"2024-09-19T08:50:15.889519+0000","last_active":"2024-09-19T08:51:51.827776+0000","last_peered":"2024-09-19T08:51:51.827776+0000","last_clean":"2024-09-19T08:51:51.827776+0000","last_became_active":"2024-09-19T08:50:15.889183+0000","last_became_peered":"2024-09-19T08:50:15.889183+0000","last_unstale":"2024-09-19T08:51:51.827776+0000","last_undegraded":"2024-09-19T08:51:51.827776+0000","last_fullsized":"2024-09-19T08:51:51.827776+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:06.725662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.821674+0000","last_change":"2024-09-19T08:50:15.894483+0000","last_active":"2024-09-19T08:51:51.821674+0000","last_peered":"2024-09-19T08:51:51.821674+0000","last_clean":"2024-09-19T08:51:51.821674+0000","last_became_active":"2024-09-19T08:50:15.893760+0000","last_became_peered":"2024-09-19T08:50:15.893760+0000","last_unstale":"2024-09-19T08:51:51.821674+0000","last_undegraded":"2024-09-19T08:51:51.821674+0000","last_fullsized":"2024-09-19T08:51:51.821674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:23.686592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.835380+0000","last_change":"2024-09-19T08:50:15.882393+0000","last_active":"2024-09-19T08:51:51.835380+0000","last_peered":"2024-09-19T08:51:51.835380+0000","last_clean":"2024-09-19T08:51:51.835380+0000","last_became_active":"2024-09-19T08:50:15.882040+0000","last_became_peered":"2024-09-19T08:50:15.882040+0000","last_unstale":"2024-09-19T08:51:51.835380+0000","last_undegraded":"2024-09-19T08:51:51.835380+0000","last_fullsized":"2024-09-19T08:51:51.835380+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:22.430017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837471+0000","last_change":"2024-09-19T08:50:15.890919+0000","last_active":"2024-09-19T08:51:51.837471+0000","last_peered":"2024-09-19T08:51:51.837471+0000","last_clean":"2024-09-19T08:51:51.837471+0000","last_became_active":"2024-09-19T08:50:15.890256+0000","last_became_peered":"2024-09-19T08:50:15.890256+0000","last_unstale":"2024-09-19T08:51:51.837471+0000","last_undegraded":"2024-09-19T08:51:51.837471+0000","last_fullsized":"2024-09-19T08:51:51.837471+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:48.404890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827490+0000","last_change":"2024-09-19T08:50:15.888139+0000","last_active":"2024-09-19T08:51:51.827490+0000","last_peered":"2024-09-19T08:51:51.827490+0000","last_clean":"2024-09-19T08:51:51.827490+0000","last_became_active":"2024-09-19T08:50:15.886471+0000","last_became_peered":"2024-09-19T08:50:15.886471+0000","last_unstale":"2024-09-19T08:51:51.827490+0000","last_undegraded":"2024-09-19T08:51:51.827490+0000","last_fullsized":"2024-09-19T08:51:51.827490+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:20.545473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.822777+0000","last_change":"2024-09-19T08:50:15.891354+0000","last_active":"2024-09-19T08:51:51.822777+0000","last_peered":"2024-09-19T08:51:51.822777+0000","last_clean":"2024-09-19T08:51:51.822777+0000","last_became_active":"2024-09-19T08:50:15.890900+0000","last_became_peered":"2024-09-19T08:50:15.890900+0000","last_unstale":"2024-09-19T08:51:51.822777+0000","last_undegraded":"2024-09-19T08:51:51.822777+0000","last_fullsized":"2024-09-19T08:51:51.822777+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:33.139637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.828631+0000","last_change":"2024-09-19T08:50:15.891501+0000","last_active":"2024-09-19T08:51:51.828631+0000","last_peered":"2024-09-19T08:51:51.828631+0000","last_clean":"2024-09-19T08:51:51.828631+0000","last_became_active":"2024-09-19T08:50:15.891183+0000","last_became_peered":"2024-09-19T08:50:15.891183+0000","last_unstale":"2024-09-19T08:51:51.828631+0000","last_undegraded":"2024-09-19T08:51:51.828631+0000","last_fullsized":"2024-09-19T08:51:51.828631+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:16.976705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.819783+0000","last_change":"2024-09-19T08:50:15.882048+0000","last_active":"2024-09-19T08:51:51.819783+0000","last_peered":"2024-09-19T08:51:51.819783+0000","last_clean":"2024-09-19T08:51:51.819783+0000","last_became_active":"2024-09-19T08:50:15.881156+0000","last_became_peered":"2024-09-19T08:50:15.881156+0000","last_unstale":"2024-09-19T08:51:51.819783+0000","last_undegraded":"2024-09-19T08:51:51.819783+0000","last_fullsized":"2024-09-19T08:51:51.819783+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:33.198852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":139,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:14.120298+0000","last_change":"2024-09-19T08:50:13.800156+0000","last_active":"2024-09-19T08:52:14.120298+0000","last_peered":"2024-09-19T08:52:14.120298+0000","last_clean":"2024-09-19T08:52:14.120298+0000","last_became_active":"2024-09-19T08:50:13.799779+0000","last_became_peered":"2024-09-19T08:50:13.799779+0000","last_unstale":"2024-09-19T08:52:14.120298+0000","last_undegraded":"2024-09-19T08:52:14.120298+0000","last_fullsized":"2024-09-19T08:52:14.120298+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:38.033049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.826996+0000","last_change":"2024-09-19T08:50:15.887252+0000","last_active":"2024-09-19T08:51:51.826996+0000","last_peered":"2024-09-19T08:51:51.826996+0000","last_clean":"2024-09-19T08:51:51.826996+0000","last_became_active":"2024-09-19T08:50:15.886899+0000","last_became_peered":"2024-09-19T08:50:15.886899+0000","last_unstale":"2024-09-19T08:51:51.826996+0000","last_undegraded":"2024-09-19T08:51:51.826996+0000","last_fullsized":"2024-09-19T08:51:51.826996+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:56.262387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.556154+0000","last_change":"2024-09-19T08:51:23.556154+0000","last_active":"2024-09-19T08:51:23.556154+0000","last_peered":"2024-09-19T08:51:23.556154+0000","last_clean":"2024-09-19T08:51:23.556154+0000","last_became_active":"2024-09-19T08:51:23.549418+0000","last_became_peered":"2024-09-19T08:51:23.549418+0000","last_unstale":"2024-09-19T08:51:23.556154+0000","last_undegraded":"2024-09-19T08:51:23.556154+0000","last_fullsized":"2024-09-19T08:51:23.556154+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:35.225465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.540195+0000","last_change":"2024-09-19T08:50:13.794010+0000","last_active":"2024-09-19T08:51:23.540195+0000","last_peered":"2024-09-19T08:51:23.540195+0000","last_clean":"2024-09-19T08:51:23.540195+0000","last_became_active":"2024-09-19T08:50:13.793677+0000","last_became_peered":"2024-09-19T08:50:13.793677+0000","last_unstale":"2024-09-19T08:51:23.540195+0000","last_undegraded":"2024-09-19T08:51:23.540195+0000","last_fullsized":"2024-09-19T08:51:23.540195+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:56.125702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827232+0000","last_change":"2024-09-19T08:50:15.881732+0000","last_active":"2024-09-19T08:51:51.827232+0000","last_peered":"2024-09-19T08:51:51.827232+0000","last_clean":"2024-09-19T08:51:51.827232+0000","last_became_active":"2024-09-19T08:50:15.881394+0000","last_became_peered":"2024-09-19T08:50:15.881394+0000","last_unstale":"2024-09-19T08:51:51.827232+0000","last_undegraded":"2024-09-19T08:51:51.827232+0000","last_fullsized":"2024-09-19T08:51:51.827232+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:55.549138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.544525+0000","last_change":"2024-09-19T08:50:13.797118+0000","last_active":"2024-09-19T08:51:23.544525+0000","last_peered":"2024-09-19T08:51:23.544525+0000","last_clean":"2024-09-19T08:51:23.544525+0000","last_became_active":"2024-09-19T08:50:13.796727+0000","last_became_peered":"2024-09-19T08:50:13.796727+0000","last_unstale":"2024-09-19T08:51:23.544525+0000","last_undegraded":"2024-09-19T08:51:23.544525+0000","last_fullsized":"2024-09-19T08:51:23.544525+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:49.310543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.824911+0000","last_change":"2024-09-19T08:50:15.888192+0000","last_active":"2024-09-19T08:51:51.824911+0000","last_peered":"2024-09-19T08:51:51.824911+0000","last_clean":"2024-09-19T08:51:51.824911+0000","last_became_active":"2024-09-19T08:50:15.887890+0000","last_became_peered":"2024-09-19T08:50:15.887890+0000","last_unstale":"2024-09-19T08:51:51.824911+0000","last_undegraded":"2024-09-19T08:51:51.824911+0000","last_fullsized":"2024-09-19T08:51:51.824911+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:24:48.951856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'6","reported_seq":240,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:13.088220+0000","last_change":"2024-09-19T08:50:13.797427+0000","last_active":"2024-09-19T08:52:13.088220+0000","last_peered":"2024-09-19T08:52:13.088220+0000","last_clean":"2024-09-19T08:52:13.088220+0000","last_became_active":"2024-09-19T08:50:13.797021+0000","last_became_peered":"2024-09-19T08:50:13.797021+0000","last_unstale":"2024-09-19T08:52:13.088220+0000","last_undegraded":"2024-09-19T08:52:13.088220+0000","last_fullsized":"2024-09-19T08:52:13.088220+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:14.530373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":212,"num_read_kb":212,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837299+0000","last_change":"2024-09-19T08:50:15.894619+0000","last_active":"2024-09-19T08:51:51.837299+0000","last_peered":"2024-09-19T08:51:51.837299+0000","last_clean":"2024-09-19T08:51:51.837299+0000","last_became_active":"2024-09-19T08:50:15.894258+0000","last_became_peered":"2024-09-19T08:50:15.894258+0000","last_unstale":"2024-09-19T08:51:51.837299+0000","last_undegraded":"2024-09-19T08:51:51.837299+0000","last_fullsized":"2024-09-19T08:51:51.837299+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:13.137314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.559196+0000","last_change":"2024-09-19T08:51:23.559196+0000","last_active":"2024-09-19T08:51:23.559196+0000","last_peered":"2024-09-19T08:51:23.559196+0000","last_clean":"2024-09-19T08:51:23.559196+0000","last_became_active":"2024-09-19T08:51:23.549412+0000","last_became_peered":"2024-09-19T08:51:23.549412+0000","last_unstale":"2024-09-19T08:51:23.559196+0000","last_undegraded":"2024-09-19T08:51:23.559196+0000","last_fullsized":"2024-09-19T08:51:23.559196+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:38.145697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837760+0000","last_change":"2024-09-19T08:50:15.891121+0000","last_active":"2024-09-19T08:51:51.837760+0000","last_peered":"2024-09-19T08:51:51.837760+0000","last_clean":"2024-09-19T08:51:51.837760+0000","last_became_active":"2024-09-19T08:50:15.890810+0000","last_became_peered":"2024-09-19T08:50:15.890810+0000","last_unstale":"2024-09-19T08:51:51.837760+0000","last_undegraded":"2024-09-19T08:51:51.837760+0000","last_fullsized":"2024-09-19T08:51:51.837760+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:13.010282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.545394+0000","last_change":"2024-09-19T08:50:14.293953+0000","last_active":"2024-09-19T08:51:23.545394+0000","last_peered":"2024-09-19T08:51:23.545394+0000","last_clean":"2024-09-19T08:51:23.545394+0000","last_became_active":"2024-09-19T08:50:14.293546+0000","last_became_peered":"2024-09-19T08:50:14.293546+0000","last_unstale":"2024-09-19T08:51:23.545394+0000","last_undegraded":"2024-09-19T08:51:23.545394+0000","last_fullsized":"2024-09-19T08:51:23.545394+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:27.809243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.836318+0000","last_change":"2024-09-19T08:50:15.878300+0000","last_active":"2024-09-19T08:51:51.836318+0000","last_peered":"2024-09-19T08:51:51.836318+0000","last_clean":"2024-09-19T08:51:51.836318+0000","last_became_active":"2024-09-19T08:50:15.877938+0000","last_became_peered":"2024-09-19T08:50:15.877938+0000","last_unstale":"2024-09-19T08:51:51.836318+0000","last_undegraded":"2024-09-19T08:51:51.836318+0000","last_fullsized":"2024-09-19T08:51:51.836318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:05.376708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'35","reported_seq":279,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:13.088187+0000","last_change":"2024-09-19T08:50:13.800696+0000","last_active":"2024-09-19T08:52:13.088187+0000","last_peered":"2024-09-19T08:52:13.088187+0000","last_clean":"2024-09-19T08:52:13.088187+0000","last_became_active":"2024-09-19T08:50:13.799385+0000","last_became_peered":"2024-09-19T08:50:13.799385+0000","last_unstale":"2024-09-19T08:52:13.088187+0000","last_undegraded":"2024-09-19T08:52:13.088187+0000","last_fullsized":"2024-09-19T08:52:13.088187+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:56.897309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65534,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":222,"num_read_kb":174,"num_write":37,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.820658+0000","last_change":"2024-09-19T08:50:15.891483+0000","last_active":"2024-09-19T08:51:51.820658+0000","last_peered":"2024-09-19T08:51:51.820658+0000","last_clean":"2024-09-19T08:51:51.820658+0000","last_became_active":"2024-09-19T08:50:15.891185+0000","last_became_peered":"2024-09-19T08:50:15.891185+0000","last_unstale":"2024-09-19T08:51:51.820658+0000","last_undegraded":"2024-09-19T08:51:51.820658+0000","last_fullsized":"2024-09-19T08:51:51.820658+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:26.599151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.548669+0000","last_change":"2024-09-19T08:50:13.795148+0000","last_active":"2024-09-19T08:51:23.548669+0000","last_peered":"2024-09-19T08:51:23.548669+0000","last_clean":"2024-09-19T08:51:23.548669+0000","last_became_active":"2024-09-19T08:50:13.794688+0000","last_became_peered":"2024-09-19T08:50:13.794688+0000","last_unstale":"2024-09-19T08:51:23.548669+0000","last_undegraded":"2024-09-19T08:51:23.548669+0000","last_fullsized":"2024-09-19T08:51:23.548669+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:01.366439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.832390+0000","last_change":"2024-09-19T08:50:15.886449+0000","last_active":"2024-09-19T08:51:51.832390+0000","last_peered":"2024-09-19T08:51:51.832390+0000","last_clean":"2024-09-19T08:51:51.832390+0000","last_became_active":"2024-09-19T08:50:15.886119+0000","last_became_peered":"2024-09-19T08:50:15.886119+0000","last_unstale":"2024-09-19T08:51:51.832390+0000","last_undegraded":"2024-09-19T08:51:51.832390+0000","last_fullsized":"2024-09-19T08:51:51.832390+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:22.916593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.544525+0000","last_change":"2024-09-19T08:50:13.799363+0000","last_active":"2024-09-19T08:51:23.544525+0000","last_peered":"2024-09-19T08:51:23.544525+0000","last_clean":"2024-09-19T08:51:23.544525+0000","last_became_active":"2024-09-19T08:50:13.799033+0000","last_became_peered":"2024-09-19T08:50:13.799033+0000","last_unstale":"2024-09-19T08:51:23.544525+0000","last_undegraded":"2024-09-19T08:51:23.544525+0000","last_fullsized":"2024-09-19T08:51:23.544525+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:57.753451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837083+0000","last_change":"2024-09-19T08:50:15.898902+0000","last_active":"2024-09-19T08:51:51.837083+0000","last_peered":"2024-09-19T08:51:51.837083+0000","last_clean":"2024-09-19T08:51:51.837083+0000","last_became_active":"2024-09-19T08:50:15.898417+0000","last_became_peered":"2024-09-19T08:50:15.898417+0000","last_unstale":"2024-09-19T08:51:51.837083+0000","last_undegraded":"2024-09-19T08:51:51.837083+0000","last_fullsized":"2024-09-19T08:51:51.837083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:32:19.799301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'9","reported_seq":147,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:16.092852+0000","last_change":"2024-09-19T08:50:13.798477+0000","last_active":"2024-09-19T08:52:16.092852+0000","last_peered":"2024-09-19T08:52:16.092852+0000","last_clean":"2024-09-19T08:52:16.092852+0000","last_became_active":"2024-09-19T08:50:13.798136+0000","last_became_peered":"2024-09-19T08:50:13.798136+0000","last_unstale":"2024-09-19T08:52:16.092852+0000","last_undegraded":"2024-09-19T08:52:16.092852+0000","last_fullsized":"2024-09-19T08:52:16.092852+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:33.874285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1823,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":7,"num_write":9,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829630+0000","last_change":"2024-09-19T08:50:15.896414+0000","last_active":"2024-09-19T08:51:51.829630+0000","last_peered":"2024-09-19T08:51:51.829630+0000","last_clean":"2024-09-19T08:51:51.829630+0000","last_became_active":"2024-09-19T08:50:15.895530+0000","last_became_peered":"2024-09-19T08:50:15.895530+0000","last_unstale":"2024-09-19T08:51:51.829630+0000","last_undegraded":"2024-09-19T08:51:51.829630+0000","last_fullsized":"2024-09-19T08:51:51.829630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:59.717869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.545962+0000","last_change":"2024-09-19T08:50:14.294087+0000","last_active":"2024-09-19T08:51:23.545962+0000","last_peered":"2024-09-19T08:51:23.545962+0000","last_clean":"2024-09-19T08:51:23.545962+0000","last_became_active":"2024-09-19T08:50:14.293712+0000","last_became_peered":"2024-09-19T08:50:14.293712+0000","last_unstale":"2024-09-19T08:51:23.545962+0000","last_undegraded":"2024-09-19T08:51:23.545962+0000","last_fullsized":"2024-09-19T08:51:23.545962+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:12.187514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.835719+0000","last_change":"2024-09-19T08:50:15.888134+0000","last_active":"2024-09-19T08:51:51.835719+0000","last_peered":"2024-09-19T08:51:51.835719+0000","last_clean":"2024-09-19T08:51:51.835719+0000","last_became_active":"2024-09-19T08:50:15.887768+0000","last_became_peered":"2024-09-19T08:50:15.887768+0000","last_unstale":"2024-09-19T08:51:51.835719+0000","last_undegraded":"2024-09-19T08:51:51.835719+0000","last_fullsized":"2024-09-19T08:51:51.835719+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:12.868773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.547326+0000","last_change":"2024-09-19T08:50:13.792585+0000","last_active":"2024-09-19T08:51:23.547326+0000","last_peered":"2024-09-19T08:51:23.547326+0000","last_clean":"2024-09-19T08:51:23.547326+0000","last_became_active":"2024-09-19T08:50:13.792222+0000","last_became_peered":"2024-09-19T08:50:13.792222+0000","last_unstale":"2024-09-19T08:51:23.547326+0000","last_undegraded":"2024-09-19T08:51:23.547326+0000","last_fullsized":"2024-09-19T08:51:23.547326+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:45.234800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.818076+0000","last_change":"2024-09-19T08:51:23.549003+0000","last_active":"2024-09-19T08:51:51.818076+0000","last_peered":"2024-09-19T08:51:51.818076+0000","last_clean":"2024-09-19T08:51:51.818076+0000","last_became_active":"2024-09-19T08:51:23.548611+0000","last_became_peered":"2024-09-19T08:51:23.548611+0000","last_unstale":"2024-09-19T08:51:51.818076+0000","last_undegraded":"2024-09-19T08:51:51.818076+0000","last_fullsized":"2024-09-19T08:51:51.818076+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:00.043092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.540568+0000","last_change":"2024-09-19T08:50:13.795360+0000","last_active":"2024-09-19T08:51:23.540568+0000","last_peered":"2024-09-19T08:51:23.540568+0000","last_clean":"2024-09-19T08:51:23.540568+0000","last_became_active":"2024-09-19T08:50:13.794823+0000","last_became_peered":"2024-09-19T08:50:13.794823+0000","last_unstale":"2024-09-19T08:51:23.540568+0000","last_undegraded":"2024-09-19T08:51:23.540568+0000","last_fullsized":"2024-09-19T08:51:23.540568+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:15.037834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.822420+0000","last_change":"2024-09-19T08:50:15.893668+0000","last_active":"2024-09-19T08:51:51.822420+0000","last_peered":"2024-09-19T08:51:51.822420+0000","last_clean":"2024-09-19T08:51:51.822420+0000","last_became_active":"2024-09-19T08:50:15.893303+0000","last_became_peered":"2024-09-19T08:50:15.893303+0000","last_unstale":"2024-09-19T08:51:51.822420+0000","last_undegraded":"2024-09-19T08:51:51.822420+0000","last_fullsized":"2024-09-19T08:51:51.822420+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:59.281601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.545777+0000","last_change":"2024-09-19T08:50:13.797442+0000","last_active":"2024-09-19T08:51:23.545777+0000","last_peered":"2024-09-19T08:51:23.545777+0000","last_clean":"2024-09-19T08:51:23.545777+0000","last_became_active":"2024-09-19T08:50:13.797072+0000","last_became_peered":"2024-09-19T08:50:13.797072+0000","last_unstale":"2024-09-19T08:51:23.545777+0000","last_undegraded":"2024-09-19T08:51:23.545777+0000","last_fullsized":"2024-09-19T08:51:23.545777+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:32.960928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829292+0000","last_change":"2024-09-19T08:51:23.554271+0000","last_active":"2024-09-19T08:51:51.829292+0000","last_peered":"2024-09-19T08:51:51.829292+0000","last_clean":"2024-09-19T08:51:51.829292+0000","last_became_active":"2024-09-19T08:51:23.547630+0000","last_became_peered":"2024-09-19T08:51:23.547630+0000","last_unstale":"2024-09-19T08:51:51.829292+0000","last_undegraded":"2024-09-19T08:51:51.829292+0000","last_fullsized":"2024-09-19T08:51:51.829292+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:39.033522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'7","reported_seq":141,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:14.090444+0000","last_change":"2024-09-19T08:50:14.294014+0000","last_active":"2024-09-19T08:52:14.090444+0000","last_peered":"2024-09-19T08:52:14.090444+0000","last_clean":"2024-09-19T08:52:14.090444+0000","last_became_active":"2024-09-19T08:50:14.293564+0000","last_became_peered":"2024-09-19T08:50:14.293564+0000","last_unstale":"2024-09-19T08:52:14.090444+0000","last_undegraded":"2024-09-19T08:52:14.090444+0000","last_fullsized":"2024-09-19T08:52:14.090444+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:23.806408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1704,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.834993+0000","last_change":"2024-09-19T08:50:15.891840+0000","last_active":"2024-09-19T08:51:51.834993+0000","last_peered":"2024-09-19T08:51:51.834993+0000","last_clean":"2024-09-19T08:51:51.834993+0000","last_became_active":"2024-09-19T08:50:15.891511+0000","last_became_peered":"2024-09-19T08:50:15.891511+0000","last_unstale":"2024-09-19T08:51:51.834993+0000","last_undegraded":"2024-09-19T08:51:51.834993+0000","last_fullsized":"2024-09-19T08:51:51.834993+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:26.800508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":332,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.545171+0000","last_change":"2024-09-19T08:49:02.071497+0000","last_active":"2024-09-19T08:51:23.545171+0000","last_peered":"2024-09-19T08:51:23.545171+0000","last_clean":"2024-09-19T08:51:23.545171+0000","last_became_active":"2024-09-19T08:49:02.071114+0000","last_became_peered":"2024-09-19T08:49:02.071114+0000","last_unstale":"2024-09-19T08:51:23.545171+0000","last_undegraded":"2024-09-19T08:51:23.545171+0000","last_fullsized":"2024-09-19T08:51:23.545171+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:45:36.600595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:45:36.600595+0000","last_clean_scrub_stamp":"2024-09-19T08:45:36.600595+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:18:15.369279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.541800+0000","last_change":"2024-09-19T08:50:13.793981+0000","last_active":"2024-09-19T08:51:23.541800+0000","last_peered":"2024-09-19T08:51:23.541800+0000","last_clean":"2024-09-19T08:51:23.541800+0000","last_became_active":"2024-09-19T08:50:13.793616+0000","last_became_peered":"2024-09-19T08:50:13.793616+0000","last_unstale":"2024-09-19T08:51:23.541800+0000","last_undegraded":"2024-09-19T08:51:23.541800+0000","last_fullsized":"2024-09-19T08:51:23.541800+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:45.195906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.828840+0000","last_change":"2024-09-19T08:50:15.891248+0000","last_active":"2024-09-19T08:51:51.828840+0000","last_peered":"2024-09-19T08:51:51.828840+0000","last_clean":"2024-09-19T08:51:51.828840+0000","last_became_active":"2024-09-19T08:50:15.890922+0000","last_became_peered":"2024-09-19T08:50:15.890922+0000","last_unstale":"2024-09-19T08:51:51.828840+0000","last_undegraded":"2024-09-19T08:51:51.828840+0000","last_fullsized":"2024-09-19T08:51:51.828840+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:18:43.914214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.545087+0000","last_change":"2024-09-19T08:50:13.797471+0000","last_active":"2024-09-19T08:51:23.545087+0000","last_peered":"2024-09-19T08:51:23.545087+0000","last_clean":"2024-09-19T08:51:23.545087+0000","last_became_active":"2024-09-19T08:50:13.797033+0000","last_became_peered":"2024-09-19T08:50:13.797033+0000","last_unstale":"2024-09-19T08:51:23.545087+0000","last_undegraded":"2024-09-19T08:51:23.545087+0000","last_fullsized":"2024-09-19T08:51:23.545087+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:53.141708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.821571+0000","last_change":"2024-09-19T08:50:15.882650+0000","last_active":"2024-09-19T08:51:51.821571+0000","last_peered":"2024-09-19T08:51:51.821571+0000","last_clean":"2024-09-19T08:51:51.821571+0000","last_became_active":"2024-09-19T08:50:15.882308+0000","last_became_peered":"2024-09-19T08:50:15.882308+0000","last_unstale":"2024-09-19T08:51:51.821571+0000","last_undegraded":"2024-09-19T08:51:51.821571+0000","last_fullsized":"2024-09-19T08:51:51.821571+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:26.449562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'7","reported_seq":138,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:14.089890+0000","last_change":"2024-09-19T08:50:14.292466+0000","last_active":"2024-09-19T08:52:14.089890+0000","last_peered":"2024-09-19T08:52:14.089890+0000","last_clean":"2024-09-19T08:52:14.089890+0000","last_became_active":"2024-09-19T08:50:14.292092+0000","last_became_peered":"2024-09-19T08:50:14.292092+0000","last_unstale":"2024-09-19T08:52:14.089890+0000","last_undegraded":"2024-09-19T08:52:14.089890+0000","last_fullsized":"2024-09-19T08:52:14.089890+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:11.373226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":109,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.825807+0000","last_change":"2024-09-19T08:51:23.551606+0000","last_active":"2024-09-19T08:51:51.825807+0000","last_peered":"2024-09-19T08:51:51.825807+0000","last_clean":"2024-09-19T08:51:51.825807+0000","last_became_active":"2024-09-19T08:51:23.551181+0000","last_became_peered":"2024-09-19T08:51:23.551181+0000","last_unstale":"2024-09-19T08:51:51.825807+0000","last_undegraded":"2024-09-19T08:51:51.825807+0000","last_fullsized":"2024-09-19T08:51:51.825807+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:05.577651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'6","reported_seq":138,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:14.618319+0000","last_change":"2024-09-19T08:50:13.799909+0000","last_active":"2024-09-19T08:52:14.618319+0000","last_peered":"2024-09-19T08:52:14.618319+0000","last_clean":"2024-09-19T08:52:14.618319+0000","last_became_active":"2024-09-19T08:50:13.799542+0000","last_became_peered":"2024-09-19T08:50:13.799542+0000","last_unstale":"2024-09-19T08:52:14.618319+0000","last_undegraded":"2024-09-19T08:52:14.618319+0000","last_fullsized":"2024-09-19T08:52:14.618319+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:23.545897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837020+0000","last_change":"2024-09-19T08:51:24.482934+0000","last_active":"2024-09-19T08:51:51.837020+0000","last_peered":"2024-09-19T08:51:51.837020+0000","last_clean":"2024-09-19T08:51:51.837020+0000","last_became_active":"2024-09-19T08:51:24.482586+0000","last_became_peered":"2024-09-19T08:51:24.482586+0000","last_unstale":"2024-09-19T08:51:51.837020+0000","last_undegraded":"2024-09-19T08:51:51.837020+0000","last_fullsized":"2024-09-19T08:51:51.837020+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:15.121449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.543078+0000","last_change":"2024-09-19T08:50:14.292577+0000","last_active":"2024-09-19T08:51:23.543078+0000","last_peered":"2024-09-19T08:51:23.543078+0000","last_clean":"2024-09-19T08:51:23.543078+0000","last_became_active":"2024-09-19T08:50:14.292220+0000","last_became_peered":"2024-09-19T08:50:14.292220+0000","last_unstale":"2024-09-19T08:51:23.543078+0000","last_undegraded":"2024-09-19T08:51:23.543078+0000","last_fullsized":"2024-09-19T08:51:23.543078+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:23.631672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827650+0000","last_change":"2024-09-19T08:50:15.891345+0000","last_active":"2024-09-19T08:51:51.827650+0000","last_peered":"2024-09-19T08:51:51.827650+0000","last_clean":"2024-09-19T08:51:51.827650+0000","last_became_active":"2024-09-19T08:50:15.891006+0000","last_became_peered":"2024-09-19T08:50:15.891006+0000","last_unstale":"2024-09-19T08:51:51.827650+0000","last_undegraded":"2024-09-19T08:51:51.827650+0000","last_fullsized":"2024-09-19T08:51:51.827650+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:41.934331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.546914+0000","last_change":"2024-09-19T08:50:14.292619+0000","last_active":"2024-09-19T08:51:23.546914+0000","last_peered":"2024-09-19T08:51:23.546914+0000","last_clean":"2024-09-19T08:51:23.546914+0000","last_became_active":"2024-09-19T08:50:14.292230+0000","last_became_peered":"2024-09-19T08:50:14.292230+0000","last_unstale":"2024-09-19T08:51:23.546914+0000","last_undegraded":"2024-09-19T08:51:23.546914+0000","last_fullsized":"2024-09-19T08:51:23.546914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:21:33.076142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.824332+0000","last_change":"2024-09-19T08:50:15.882760+0000","last_active":"2024-09-19T08:51:51.824332+0000","last_peered":"2024-09-19T08:51:51.824332+0000","last_clean":"2024-09-19T08:51:51.824332+0000","last_became_active":"2024-09-19T08:50:15.882402+0000","last_became_peered":"2024-09-19T08:50:15.882402+0000","last_unstale":"2024-09-19T08:51:51.824332+0000","last_undegraded":"2024-09-19T08:51:51.824332+0000","last_fullsized":"2024-09-19T08:51:51.824332+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:17.343385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'18","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:08.890564+0000","last_change":"2024-09-19T08:50:13.790982+0000","last_active":"2024-09-19T08:52:08.890564+0000","last_peered":"2024-09-19T08:52:08.890564+0000","last_clean":"2024-09-19T08:52:08.890564+0000","last_became_active":"2024-09-19T08:50:13.790644+0000","last_became_peered":"2024-09-19T08:50:13.790644+0000","last_unstale":"2024-09-19T08:52:08.890564+0000","last_undegraded":"2024-09-19T08:52:08.890564+0000","last_fullsized":"2024-09-19T08:52:08.890564+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:20:25.923021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827049+0000","last_change":"2024-09-19T08:50:15.887556+0000","last_active":"2024-09-19T08:51:51.827049+0000","last_peered":"2024-09-19T08:51:51.827049+0000","last_clean":"2024-09-19T08:51:51.827049+0000","last_became_active":"2024-09-19T08:50:15.887280+0000","last_became_peered":"2024-09-19T08:50:15.887280+0000","last_unstale":"2024-09-19T08:51:51.827049+0000","last_undegraded":"2024-09-19T08:51:51.827049+0000","last_fullsized":"2024-09-19T08:51:51.827049+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:51.226527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.541910+0000","last_change":"2024-09-19T08:50:14.012150+0000","last_active":"2024-09-19T08:51:23.541910+0000","last_peered":"2024-09-19T08:51:23.541910+0000","last_clean":"2024-09-19T08:51:23.541910+0000","last_became_active":"2024-09-19T08:50:14.011799+0000","last_became_peered":"2024-09-19T08:50:14.011799+0000","last_unstale":"2024-09-19T08:51:23.541910+0000","last_undegraded":"2024-09-19T08:51:23.541910+0000","last_fullsized":"2024-09-19T08:51:23.541910+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:37.310539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837525+0000","last_change":"2024-09-19T08:50:15.889577+0000","last_active":"2024-09-19T08:51:51.837525+0000","last_peered":"2024-09-19T08:51:51.837525+0000","last_clean":"2024-09-19T08:51:51.837525+0000","last_became_active":"2024-09-19T08:50:15.889244+0000","last_became_peered":"2024-09-19T08:50:15.889244+0000","last_unstale":"2024-09-19T08:51:51.837525+0000","last_undegraded":"2024-09-19T08:51:51.837525+0000","last_fullsized":"2024-09-19T08:51:51.837525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:54.382221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.548456+0000","last_change":"2024-09-19T08:50:14.293845+0000","last_active":"2024-09-19T08:51:23.548456+0000","last_peered":"2024-09-19T08:51:23.548456+0000","last_clean":"2024-09-19T08:51:23.548456+0000","last_became_active":"2024-09-19T08:50:14.293585+0000","last_became_peered":"2024-09-19T08:50:14.293585+0000","last_unstale":"2024-09-19T08:51:23.548456+0000","last_undegraded":"2024-09-19T08:51:23.548456+0000","last_fullsized":"2024-09-19T08:51:23.548456+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:02.886475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.794304+0000","last_change":"2024-09-19T08:50:15.888591+0000","last_active":"2024-09-19T08:51:51.794304+0000","last_peered":"2024-09-19T08:51:51.794304+0000","last_clean":"2024-09-19T08:51:51.794304+0000","last_became_active":"2024-09-19T08:50:15.888270+0000","last_became_peered":"2024-09-19T08:50:15.888270+0000","last_unstale":"2024-09-19T08:51:51.794304+0000","last_undegraded":"2024-09-19T08:51:51.794304+0000","last_fullsized":"2024-09-19T08:51:51.794304+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:08.644828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.547015+0000","last_change":"2024-09-19T08:50:13.794081+0000","last_active":"2024-09-19T08:51:23.547015+0000","last_peered":"2024-09-19T08:51:23.547015+0000","last_clean":"2024-09-19T08:51:23.547015+0000","last_became_active":"2024-09-19T08:50:13.793770+0000","last_became_peered":"2024-09-19T08:50:13.793770+0000","last_unstale":"2024-09-19T08:51:23.547015+0000","last_undegraded":"2024-09-19T08:51:23.547015+0000","last_fullsized":"2024-09-19T08:51:23.547015+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:43.053893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.835489+0000","last_change":"2024-09-19T08:50:15.885338+0000","last_active":"2024-09-19T08:51:51.835489+0000","last_peered":"2024-09-19T08:51:51.835489+0000","last_clean":"2024-09-19T08:51:51.835489+0000","last_became_active":"2024-09-19T08:50:15.884983+0000","last_became_peered":"2024-09-19T08:50:15.884983+0000","last_unstale":"2024-09-19T08:51:51.835489+0000","last_undegraded":"2024-09-19T08:51:51.835489+0000","last_fullsized":"2024-09-19T08:51:51.835489+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:05.228871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:25.776440+0000","last_change":"2024-09-19T08:51:23.562670+0000","last_active":"2024-09-19T08:51:25.776440+0000","last_peered":"2024-09-19T08:51:25.776440+0000","last_clean":"2024-09-19T08:51:25.776440+0000","last_became_active":"2024-09-19T08:51:23.548756+0000","last_became_peered":"2024-09-19T08:51:23.548756+0000","last_unstale":"2024-09-19T08:51:25.776440+0000","last_undegraded":"2024-09-19T08:51:25.776440+0000","last_fullsized":"2024-09-19T08:51:25.776440+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:36.666216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829262+0000","last_change":"2024-09-19T08:50:15.886587+0000","last_active":"2024-09-19T08:51:51.829262+0000","last_peered":"2024-09-19T08:51:51.829262+0000","last_clean":"2024-09-19T08:51:51.829262+0000","last_became_active":"2024-09-19T08:50:15.886231+0000","last_became_peered":"2024-09-19T08:50:15.886231+0000","last_unstale":"2024-09-19T08:51:51.829262+0000","last_undegraded":"2024-09-19T08:51:51.829262+0000","last_fullsized":"2024-09-19T08:51:51.829262+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:11.965382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.546412+0000","last_change":"2024-09-19T08:50:13.796681+0000","last_active":"2024-09-19T08:51:23.546412+0000","last_peered":"2024-09-19T08:51:23.546412+0000","last_clean":"2024-09-19T08:51:23.546412+0000","last_became_active":"2024-09-19T08:50:13.796338+0000","last_became_peered":"2024-09-19T08:50:13.796338+0000","last_unstale":"2024-09-19T08:51:23.546412+0000","last_undegraded":"2024-09-19T08:51:23.546412+0000","last_fullsized":"2024-09-19T08:51:23.546412+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:32.588800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.836422+0000","last_change":"2024-09-19T08:50:15.889667+0000","last_active":"2024-09-19T08:51:51.836422+0000","last_peered":"2024-09-19T08:51:51.836422+0000","last_clean":"2024-09-19T08:51:51.836422+0000","last_became_active":"2024-09-19T08:50:15.889341+0000","last_became_peered":"2024-09-19T08:50:15.889341+0000","last_unstale":"2024-09-19T08:51:51.836422+0000","last_undegraded":"2024-09-19T08:51:51.836422+0000","last_fullsized":"2024-09-19T08:51:51.836422+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:13.255483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.836199+0000","last_change":"2024-09-19T08:50:15.887337+0000","last_active":"2024-09-19T08:51:51.836199+0000","last_peered":"2024-09-19T08:51:51.836199+0000","last_clean":"2024-09-19T08:51:51.836199+0000","last_became_active":"2024-09-19T08:50:15.887001+0000","last_became_peered":"2024-09-19T08:50:15.887001+0000","last_unstale":"2024-09-19T08:51:51.836199+0000","last_undegraded":"2024-09-19T08:51:51.836199+0000","last_fullsized":"2024-09-19T08:51:51.836199+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:43.544863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.547132+0000","last_change":"2024-09-19T08:50:13.799321+0000","last_active":"2024-09-19T08:51:23.547132+0000","last_peered":"2024-09-19T08:51:23.547132+0000","last_clean":"2024-09-19T08:51:23.547132+0000","last_became_active":"2024-09-19T08:50:13.798837+0000","last_became_peered":"2024-09-19T08:50:13.798837+0000","last_unstale":"2024-09-19T08:51:23.547132+0000","last_undegraded":"2024-09-19T08:51:23.547132+0000","last_fullsized":"2024-09-19T08:51:23.547132+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:35.753093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837309+0000","last_change":"2024-09-19T08:50:15.892074+0000","last_active":"2024-09-19T08:51:51.837309+0000","last_peered":"2024-09-19T08:51:51.837309+0000","last_clean":"2024-09-19T08:51:51.837309+0000","last_became_active":"2024-09-19T08:50:15.891722+0000","last_became_peered":"2024-09-19T08:50:15.891722+0000","last_unstale":"2024-09-19T08:51:51.837309+0000","last_undegraded":"2024-09-19T08:51:51.837309+0000","last_fullsized":"2024-09-19T08:51:51.837309+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:39.913080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.546815+0000","last_change":"2024-09-19T08:50:13.795577+0000","last_active":"2024-09-19T08:51:23.546815+0000","last_peered":"2024-09-19T08:51:23.546815+0000","last_clean":"2024-09-19T08:51:23.546815+0000","last_became_active":"2024-09-19T08:50:13.795254+0000","last_became_peered":"2024-09-19T08:50:13.795254+0000","last_unstale":"2024-09-19T08:51:23.546815+0000","last_undegraded":"2024-09-19T08:51:23.546815+0000","last_fullsized":"2024-09-19T08:51:23.546815+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:13.263447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.836430+0000","last_change":"2024-09-19T08:50:15.884584+0000","last_active":"2024-09-19T08:51:51.836430+0000","last_peered":"2024-09-19T08:51:51.836430+0000","last_clean":"2024-09-19T08:51:51.836430+0000","last_became_active":"2024-09-19T08:50:15.884244+0000","last_became_peered":"2024-09-19T08:50:15.884244+0000","last_unstale":"2024-09-19T08:51:51.836430+0000","last_undegraded":"2024-09-19T08:51:51.836430+0000","last_fullsized":"2024-09-19T08:51:51.836430+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:58.835351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.547268+0000","last_change":"2024-09-19T08:50:14.294210+0000","last_active":"2024-09-19T08:51:23.547268+0000","last_peered":"2024-09-19T08:51:23.547268+0000","last_clean":"2024-09-19T08:51:23.547268+0000","last_became_active":"2024-09-19T08:50:14.293850+0000","last_became_peered":"2024-09-19T08:50:14.293850+0000","last_unstale":"2024-09-19T08:51:23.547268+0000","last_undegraded":"2024-09-19T08:51:23.547268+0000","last_fullsized":"2024-09-19T08:51:23.547268+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:42:44.340766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829360+0000","last_change":"2024-09-19T08:50:15.892934+0000","last_active":"2024-09-19T08:51:51.829360+0000","last_peered":"2024-09-19T08:51:51.829360+0000","last_clean":"2024-09-19T08:51:51.829360+0000","last_became_active":"2024-09-19T08:50:15.892309+0000","last_became_peered":"2024-09-19T08:50:15.892309+0000","last_unstale":"2024-09-19T08:51:51.829360+0000","last_undegraded":"2024-09-19T08:51:51.829360+0000","last_fullsized":"2024-09-19T08:51:51.829360+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:40.158724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'14","reported_seq":163,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:12.615197+0000","last_change":"2024-09-19T08:51:23.559819+0000","last_active":"2024-09-19T08:52:12.615197+0000","last_peered":"2024-09-19T08:52:12.615197+0000","last_clean":"2024-09-19T08:52:12.615197+0000","last_became_active":"2024-09-19T08:51:23.548481+0000","last_became_peered":"2024-09-19T08:51:23.548481+0000","last_unstale":"2024-09-19T08:52:12.615197+0000","last_undegraded":"2024-09-19T08:52:12.615197+0000","last_fullsized":"2024-09-19T08:52:12.615197+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:53.232542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74511,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1115,"num_read_kb":633,"num_write":267,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":585728,"data_stored":228573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":247642,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579942,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":434558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808874,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1056768,"data_stored":1091150,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972400,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":925696,"data_stored":433399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201334,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":433660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430266,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":1027136,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593792,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":433392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822724,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":983040,"data_stored":1025858,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953544,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":434095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182478,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":432707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411412,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":991232,"data_stored":500593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":502359,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":434872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34206,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34206,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":70199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":70953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":68505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:52:20.295 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:52:20.383 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:20.800 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:20 smithi019 ceph-mon[30976]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:52:20.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.885+0000 7f2120e5e640 1 -- 172.21.15.19:0/2904414902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f211c100a80 msgr2=0x7f211c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:20.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.885+0000 7f2120e5e640 1 --2- 172.21.15.19:0/2904414902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f211c100a80 0x7f211c100ee0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f2110009930 tx=0x7f211002a420 comp rx=0 tx=0).stop 2024-09-19T08:52:20.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.885+0000 7f2120e5e640 1 -- 172.21.15.19:0/2904414902 shutdown_connections 2024-09-19T08:52:20.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.885+0000 7f2120e5e640 1 --2- 172.21.15.19:0/2904414902 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f211c101420 0x7f211c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.885+0000 7f2120e5e640 1 --2- 172.21.15.19:0/2904414902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f211c100a80 0x7f211c100ee0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.885+0000 7f2120e5e640 1 --2- 172.21.15.19:0/2904414902 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f211c106a80 0x7f211c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.885+0000 7f2120e5e640 1 -- 172.21.15.19:0/2904414902 >> 172.21.15.19:0/2904414902 conn(0x7f211c0fc7a0 msgr2=0x7f211c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:20.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.885+0000 7f2120e5e640 1 -- 172.21.15.19:0/2904414902 shutdown_connections 2024-09-19T08:52:20.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.885+0000 7f2120e5e640 1 -- 172.21.15.19:0/2904414902 wait complete. 2024-09-19T08:52:20.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.886+0000 7f2120e5e640 1 Processor -- start 2024-09-19T08:52:20.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.886+0000 7f2120e5e640 1 -- start start 2024-09-19T08:52:20.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.886+0000 7f2120e5e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f211c100a80 0x7f211c198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:20.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.886+0000 7f2120e5e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f211c101420 0x7f211c1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:20.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.886+0000 7f2120e5e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f211c106a80 0x7f211c19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:20.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.886+0000 7f2120e5e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f211c110ed0 con 0x7f211c106a80 2024-09-19T08:52:20.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.886+0000 7f2120e5e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f211c110d50 con 0x7f211c100a80 2024-09-19T08:52:20.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.886+0000 7f2120e5e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f211c111050 con 0x7f211c101420 2024-09-19T08:52:20.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.886+0000 7f211ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f211c106a80 0x7f211c19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:20.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.886+0000 7f211ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f211c106a80 0x7f211c19cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51322/0 (socket says 172.21.15.19:51322) 2024-09-19T08:52:20.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.886+0000 7f211ad9d640 1 -- 172.21.15.19:0/1078267250 learned_addr learned my addr 172.21.15.19:0/1078267250 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:20.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.886+0000 7f2119d9b640 1 --2- 172.21.15.19:0/1078267250 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f211c101420 0x7f211c1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:20.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.886+0000 7f211a59c640 1 --2- 172.21.15.19:0/1078267250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f211c100a80 0x7f211c198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:20.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.886+0000 7f211ad9d640 1 -- 172.21.15.19:0/1078267250 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f211c101420 msgr2=0x7f211c1989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:20.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.886+0000 7f211ad9d640 1 --2- 172.21.15.19:0/1078267250 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f211c101420 0x7f211c1989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.886+0000 7f211ad9d640 1 -- 172.21.15.19:0/1078267250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f211c100a80 msgr2=0x7f211c198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:20.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.886+0000 7f211ad9d640 1 --2- 172.21.15.19:0/1078267250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f211c100a80 0x7f211c198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.886+0000 7f211ad9d640 1 -- 172.21.15.19:0/1078267250 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f211c19d440 con 0x7f211c106a80 2024-09-19T08:52:20.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.886+0000 7f2119d9b640 1 --2- 172.21.15.19:0/1078267250 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f211c101420 0x7f211c1989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:20.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.887+0000 7f211ad9d640 1 --2- 172.21.15.19:0/1078267250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f211c106a80 0x7f211c19cd60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f211400eaa0 tx=0x7f211400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:20.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.887+0000 7f210b7fe640 1 -- 172.21.15.19:0/1078267250 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f211400cdb0 con 0x7f211c106a80 2024-09-19T08:52:20.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.887+0000 7f2120e5e640 1 -- 172.21.15.19:0/1078267250 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f211c19d730 con 0x7f211c106a80 2024-09-19T08:52:20.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.887+0000 7f210b7fe640 1 -- 172.21.15.19:0/1078267250 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2114005020 con 0x7f211c106a80 2024-09-19T08:52:20.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.887+0000 7f210b7fe640 1 -- 172.21.15.19:0/1078267250 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21140116b0 con 0x7f211c106a80 2024-09-19T08:52:20.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.887+0000 7f2120e5e640 1 -- 172.21.15.19:0/1078267250 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f211c1a5010 con 0x7f211c106a80 2024-09-19T08:52:20.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.889+0000 7f210b7fe640 1 -- 172.21.15.19:0/1078267250 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f2114005560 con 0x7f211c106a80 2024-09-19T08:52:20.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.889+0000 7f2123237740 1 Processor -- start 2024-09-19T08:52:20.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.890+0000 7f2123237740 1 -- start start 2024-09-19T08:52:20.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.890+0000 7f2123237740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556fddaf64a0 0x556fddaf6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:20.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.890+0000 7f2123237740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556fddaf6dc0 0x556fddb01140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:20.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.890+0000 7f2123237740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fddb01680 0x556fddb03a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:20.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.890+0000 7f210b7fe640 1 --2- 172.21.15.19:0/1078267250 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f21040a32d0 0x7f21040a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:20.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.890+0000 7f2123237740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556fdda5c2e0 con 0x556fddaf6dc0 2024-09-19T08:52:20.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.890+0000 7f2123237740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x556fdda03ce0 con 0x556fddb01680 2024-09-19T08:52:20.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.890+0000 7f2123237740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x556fdda582a0 con 0x556fddaf64a0 2024-09-19T08:52:20.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.890+0000 7f211a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556fddaf6dc0 0x556fddb01140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:20.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.890+0000 7f211a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556fddaf6dc0 0x556fddb01140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51328/0 (socket says 172.21.15.19:51328) 2024-09-19T08:52:20.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.890+0000 7f211a59c640 1 -- 172.21.15.19:0/1092159699 learned_addr learned my addr 172.21.15.19:0/1092159699 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:20.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.890+0000 7f211ad9d640 1 --2- 172.21.15.19:0/1078267250 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f21040a32d0 0x7f21040a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:20.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.890+0000 7f2119d9b640 1 --2- 172.21.15.19:0/1092159699 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556fddaf64a0 0x556fddaf6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:20.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.890+0000 7f210b7fe640 1 -- 172.21.15.19:0/1078267250 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f21140cfe20 con 0x7f211c106a80 2024-09-19T08:52:20.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.890+0000 7f2119d9b640 1 --2- 172.21.15.19:0/1092159699 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fddb01680 0x556fddb03a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:20.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.890+0000 7f211a59c640 1 -- 172.21.15.19:0/1092159699 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556fddaf64a0 msgr2=0x556fddaf6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:20.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.890+0000 7f211a59c640 1 --2- 172.21.15.19:0/1092159699 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556fddaf64a0 0x556fddaf6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.890+0000 7f211a59c640 1 -- 172.21.15.19:0/1092159699 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fddb01680 msgr2=0x556fddb03a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:20.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.890+0000 7f211a59c640 1 --2- 172.21.15.19:0/1092159699 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fddb01680 0x556fddb03a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.890+0000 7f211a59c640 1 -- 172.21.15.19:0/1092159699 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fdd9e8440 con 0x556fddaf6dc0 2024-09-19T08:52:20.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.890+0000 7f2119d9b640 1 --2- 172.21.15.19:0/1092159699 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556fddaf64a0 0x556fddaf6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:20.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.891+0000 7f211a59c640 1 --2- 172.21.15.19:0/1092159699 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556fddaf6dc0 0x556fddb01140 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f210c00bc60 tx=0x7f210c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e8a8cf63a304a54 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:20.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.891+0000 7f211ad9d640 1 --2- 172.21.15.19:0/1078267250 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f21040a32d0 0x7f21040a5790 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f211409bf90 tx=0x7f211406f110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:20.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.891+0000 7f2108ff9640 1 -- 172.21.15.19:0/1092159699 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210c015070 con 0x556fddaf6dc0 2024-09-19T08:52:20.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.891+0000 7f2108ff9640 1 -- 172.21.15.19:0/1092159699 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f210c011920 con 0x556fddaf6dc0 2024-09-19T08:52:20.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.891+0000 7f2108ff9640 1 -- 172.21.15.19:0/1092159699 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210c0108e0 con 0x556fddaf6dc0 2024-09-19T08:52:20.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.891+0000 7f2123237740 1 -- 172.21.15.19:0/1092159699 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556fddaf6dc0 msgr2=0x556fddb01140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:20.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.891+0000 7f2123237740 1 --2- 172.21.15.19:0/1092159699 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556fddaf6dc0 0x556fddb01140 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f210c00bc60 tx=0x7f210c00f730 comp rx=0 tx=0).stop 2024-09-19T08:52:20.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.892+0000 7f2123237740 1 -- 172.21.15.19:0/1092159699 shutdown_connections 2024-09-19T08:52:20.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.892+0000 7f2123237740 1 --2- 172.21.15.19:0/1092159699 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fddb01680 0x556fddb03a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.892+0000 7f2123237740 1 --2- 172.21.15.19:0/1092159699 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556fddaf6dc0 0x556fddb01140 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.892+0000 7f2123237740 1 --2- 172.21.15.19:0/1092159699 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556fddaf64a0 0x556fddaf6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.892+0000 7f2123237740 1 -- 172.21.15.19:0/1092159699 >> 172.21.15.19:0/1092159699 conn(0x556fddaf2a30 msgr2=0x556fddaf2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:20.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.892+0000 7f2123237740 1 -- 172.21.15.19:0/1092159699 shutdown_connections 2024-09-19T08:52:20.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.892+0000 7f2123237740 1 -- 172.21.15.19:0/1092159699 wait complete. 2024-09-19T08:52:20.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.892+0000 7f2123237740 1 -- start start 2024-09-19T08:52:20.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.892+0000 7f2123237740 1 Processor -- start 2024-09-19T08:52:20.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.892+0000 7f2123237740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556fddaf64a0 0x556fddb00f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:20.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.892+0000 7f2123237740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fddaf6dc0 0x556fddafe200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:20.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.892+0000 7f2123237740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556fddb01680 0x556fddafe740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:20.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.892+0000 7f2123237740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556fddb04250 con 0x556fddb01680 2024-09-19T08:52:20.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.892+0000 7f2123237740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x556fdda17050 con 0x556fddaf6dc0 2024-09-19T08:52:20.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.892+0000 7f2123237740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x556fddb043d0 con 0x556fddaf64a0 2024-09-19T08:52:20.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.892+0000 7f2123237740 10 client.0 _ll_register_callbacks cb 0x556fdda57160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:20.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.892+0000 7f2119d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556fddb01680 0x556fddafe740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:20.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.892+0000 7f2119d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556fddb01680 0x556fddafe740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51344/0 (socket says 172.21.15.19:51344) 2024-09-19T08:52:20.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.893+0000 7f2119d9b640 1 -- 172.21.15.19:0/1493085877 learned_addr learned my addr 172.21.15.19:0/1493085877 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:20.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.893+0000 7f2119d9b640 1 --2- 172.21.15.19:0/1493085877 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556fddaf64a0 0x556fddb00f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:20.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.893+0000 7f211a59c640 1 --2- 172.21.15.19:0/1493085877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fddaf6dc0 0x556fddafe200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:20.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.893+0000 7f2119d9b640 1 -- 172.21.15.19:0/1493085877 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556fddaf64a0 msgr2=0x556fddb00f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:20.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.893+0000 7f2119d9b640 1 --2- 172.21.15.19:0/1493085877 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556fddaf64a0 0x556fddb00f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.893+0000 7f2119d9b640 1 -- 172.21.15.19:0/1493085877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fddaf6dc0 msgr2=0x556fddafe200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:20.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.893+0000 7f2119d9b640 1 --2- 172.21.15.19:0/1493085877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fddaf6dc0 0x556fddafe200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.893+0000 7f2119d9b640 1 -- 172.21.15.19:0/1493085877 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fdd7cd3c0 con 0x556fddb01680 2024-09-19T08:52:20.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.893+0000 7f211a59c640 1 --2- 172.21.15.19:0/1493085877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fddaf6dc0 0x556fddafe200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:20.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.893+0000 7f2119d9b640 1 --2- 172.21.15.19:0/1493085877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556fddb01680 0x556fddafe740 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2110009930 tx=0x7f2110009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e43ea47188455991 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:20.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.893+0000 7f2101ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:52:20.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.893+0000 7f2101ffb640 1 -- 172.21.15.19:0/1493085877 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2110035040 con 0x556fddb01680 2024-09-19T08:52:20.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.893+0000 7f2101ffb640 1 -- 172.21.15.19:0/1493085877 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f21100315b0 con 0x556fddb01680 2024-09-19T08:52:20.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.893+0000 7f2123237740 1 -- 172.21.15.19:0/1493085877 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f210c011920 con 0x556fddb01680 2024-09-19T08:52:20.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.893+0000 7f2101ffb640 1 -- 172.21.15.19:0/1493085877 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f21100317b0 con 0x556fddb01680 2024-09-19T08:52:20.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.893+0000 7f2123237740 10 client.15327 fetch_fsmap learned FSMap version 28 2024-09-19T08:52:20.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.893+0000 7f2123237740 1 -- 172.21.15.19:0/1493085877 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556fddb0fba0 con 0x556fddb01680 2024-09-19T08:52:20.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.894+0000 7f2101ffb640 1 -- 172.21.15.19:0/1493085877 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f210c011920 con 0x556fddb01680 2024-09-19T08:52:20.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.894+0000 7f2101ffb640 1 -- 172.21.15.19:0/1493085877 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f211003a040 con 0x556fddb01680 2024-09-19T08:52:20.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.894+0000 7f2123237740 10 client.15327 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:52:20.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.894+0000 7f2123237740 10 client.15327 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:20.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.894+0000 7f2123237740 20 client.15327 populate_metadata read hostname 'smithi019' 2024-09-19T08:52:20.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.894+0000 7f2123237740 1 --2- 172.21.15.19:0/1493085877 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x556fddb11000 0x556fddb13460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:20.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.894+0000 7f2123237740 4 client.15327 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:20.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.894+0000 7f2123237740 1 -- 172.21.15.19:0/1493085877 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556fdda69850 con 0x556fddb11000 2024-09-19T08:52:20.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.894+0000 7f211a59c640 1 --2- 172.21.15.19:0/1493085877 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x556fddb11000 0x556fddb13460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:20.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.895+0000 7f211a59c640 1 --2- 172.21.15.19:0/1493085877 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x556fddb11000 0x556fddb13460 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=773b881beddd6ea4 server_cookie=a8cc01f02ff919b5 in_seq=0 out_seq=0 2024-09-19T08:52:20.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.895+0000 7f2101ffb640 10 client.15327 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:52:20.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.896+0000 7f2101ffb640 1 -- 172.21.15.19:0/1493085877 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556fdda69850 con 0x556fddb11000 2024-09-19T08:52:20.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.896+0000 7f2101ffb640 10 client.15327 handle_command_reply: tid=0 2024-09-19T08:52:20.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.896+0000 7f2123237740 1 client.15327 shutdown 2024-09-19T08:52:20.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.896+0000 7f2123237740 1 -- 172.21.15.19:0/1493085877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556fddb01680 msgr2=0x556fddafe740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:20.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.896+0000 7f2123237740 1 --2- 172.21.15.19:0/1493085877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556fddb01680 0x556fddafe740 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f2110009930 tx=0x7f2110009260 comp rx=0 tx=0).stop 2024-09-19T08:52:20.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.896+0000 7f2123237740 1 -- 172.21.15.19:0/1493085877 shutdown_connections 2024-09-19T08:52:20.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.896+0000 7f2123237740 1 --2- 172.21.15.19:0/1493085877 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x556fddb11000 0x556fddb13460 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.896+0000 7f2123237740 1 --2- 172.21.15.19:0/1493085877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556fddb01680 0x556fddafe740 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.896+0000 7f2123237740 1 --2- 172.21.15.19:0/1493085877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fddaf6dc0 0x556fddafe200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.896+0000 7f2101ffb640 0 client.15327 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:52:20.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.896+0000 7f2123237740 1 --2- 172.21.15.19:0/1493085877 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556fddaf64a0 0x556fddb00f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.896+0000 7f2123237740 1 -- 172.21.15.19:0/1493085877 >> 172.21.15.19:0/1493085877 conn(0x556fddaf2a30 msgr2=0x556fddaf8710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:20.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.896+0000 7f2123237740 1 -- 172.21.15.19:0/1493085877 shutdown_connections 2024-09-19T08:52:20.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.896+0000 7f2123237740 1 -- 172.21.15.19:0/1493085877 wait complete. 2024-09-19T08:52:20.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.896+0000 7f2123237740 20 client.15327 trim_cache size 0 max 16384 2024-09-19T08:52:20.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.914+0000 7f2123237740 1 Processor -- start 2024-09-19T08:52:20.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.914+0000 7f2123237740 1 -- start start 2024-09-19T08:52:20.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.914+0000 7f2123237740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fddaf2a30 0x556fddb00170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:20.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.914+0000 7f2123237740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556fddaf64a0 0x556fddb18d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:20.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.914+0000 7f2123237740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556fddaf6dc0 0x556fddb19270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:20.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.914+0000 7f2123237740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f211c1ad570 con 0x556fddaf6dc0 2024-09-19T08:52:20.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.914+0000 7f2123237740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f211c1af0b0 con 0x556fddaf2a30 2024-09-19T08:52:20.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.914+0000 7f2123237740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f211c1adc40 con 0x556fddaf64a0 2024-09-19T08:52:20.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.914+0000 7f2119d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556fddaf6dc0 0x556fddb19270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:20.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.914+0000 7f2119d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556fddaf6dc0 0x556fddb19270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51356/0 (socket says 172.21.15.19:51356) 2024-09-19T08:52:20.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.914+0000 7f2119d9b640 1 -- 172.21.15.19:0/1812004211 learned_addr learned my addr 172.21.15.19:0/1812004211 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:20.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.914+0000 7f2119d9b640 1 --2- 172.21.15.19:0/1812004211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fddaf2a30 0x556fddb00170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:20.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.914+0000 7f211a59c640 1 --2- 172.21.15.19:0/1812004211 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556fddaf64a0 0x556fddb18d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:20.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.915+0000 7f2119d9b640 1 -- 172.21.15.19:0/1812004211 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556fddaf64a0 msgr2=0x556fddb18d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:20.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.915+0000 7f2119d9b640 1 --2- 172.21.15.19:0/1812004211 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556fddaf64a0 0x556fddb18d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.915+0000 7f2119d9b640 1 -- 172.21.15.19:0/1812004211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fddaf2a30 msgr2=0x556fddb00170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:20.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.915+0000 7f2119d9b640 1 --2- 172.21.15.19:0/1812004211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fddaf2a30 0x556fddb00170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.915+0000 7f2119d9b640 1 -- 172.21.15.19:0/1812004211 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556fddaf7330 con 0x556fddaf6dc0 2024-09-19T08:52:20.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.915+0000 7f2119d9b640 1 --2- 172.21.15.19:0/1812004211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556fddaf6dc0 0x556fddb19270 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f21100045d0 tx=0x7f211002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b79a94762caa5747 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:20.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.915+0000 7f2103fff640 1 -- 172.21.15.19:0/1812004211 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2110035040 con 0x556fddaf6dc0 2024-09-19T08:52:20.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.915+0000 7f2103fff640 1 -- 172.21.15.19:0/1812004211 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2110003f10 con 0x556fddaf6dc0 2024-09-19T08:52:20.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.915+0000 7f2103fff640 1 -- 172.21.15.19:0/1812004211 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2110005330 con 0x556fddaf6dc0 2024-09-19T08:52:20.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.916+0000 7f2123237740 1 -- 172.21.15.19:0/1812004211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556fddaf6dc0 msgr2=0x556fddb19270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:20.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.916+0000 7f2123237740 1 --2- 172.21.15.19:0/1812004211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556fddaf6dc0 0x556fddb19270 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f21100045d0 tx=0x7f211002a420 comp rx=0 tx=0).stop 2024-09-19T08:52:20.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.916+0000 7f2123237740 1 -- 172.21.15.19:0/1812004211 shutdown_connections 2024-09-19T08:52:20.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.916+0000 7f2123237740 1 --2- 172.21.15.19:0/1812004211 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556fddaf64a0 0x556fddb18d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.916+0000 7f2123237740 1 --2- 172.21.15.19:0/1812004211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556fddaf6dc0 0x556fddb19270 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.916+0000 7f2123237740 1 --2- 172.21.15.19:0/1812004211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fddaf2a30 0x556fddb00170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.916+0000 7f2123237740 1 -- 172.21.15.19:0/1812004211 >> 172.21.15.19:0/1812004211 conn(0x556fddafe8a0 msgr2=0x556fddaffa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:20.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.916+0000 7f2123237740 1 -- 172.21.15.19:0/1812004211 shutdown_connections 2024-09-19T08:52:20.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.916+0000 7f2123237740 1 -- 172.21.15.19:0/1812004211 wait complete. 2024-09-19T08:52:20.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.917+0000 7f2123237740 1 -- start start 2024-09-19T08:52:20.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.917+0000 7f2123237740 1 Processor -- start 2024-09-19T08:52:20.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.917+0000 7f2123237740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fddaf2a30 0x556fddb09d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:20.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.917+0000 7f2123237740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556fddaf64a0 0x556fddb070f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:20.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.917+0000 7f2123237740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556fddaf6dc0 0x556fddb07630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:20.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.917+0000 7f2123237740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f211c1ae9e0 con 0x556fddaf64a0 2024-09-19T08:52:20.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.917+0000 7f2123237740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f211c1ae310 con 0x556fddaf2a30 2024-09-19T08:52:20.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.917+0000 7f2123237740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f211c1ab550 con 0x556fddaf6dc0 2024-09-19T08:52:20.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.917+0000 7f2123237740 10 client.0 _ll_register_callbacks cb 0x7f2110009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:20.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.917+0000 7f211a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556fddaf64a0 0x556fddb070f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:20.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.917+0000 7f211a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556fddaf64a0 0x556fddb070f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51362/0 (socket says 172.21.15.19:51362) 2024-09-19T08:52:20.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.917+0000 7f211a59c640 1 -- 172.21.15.19:0/2871898912 learned_addr learned my addr 172.21.15.19:0/2871898912 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:20.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.918+0000 7f2119d9b640 1 --2- 172.21.15.19:0/2871898912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fddaf2a30 0x556fddb09d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:20.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.918+0000 7f2119d9b640 1 --2- 172.21.15.19:0/2871898912 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556fddaf6dc0 0x556fddb07630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:20.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.918+0000 7f211a59c640 1 -- 172.21.15.19:0/2871898912 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556fddaf6dc0 msgr2=0x556fddb07630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:20.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.918+0000 7f211a59c640 1 --2- 172.21.15.19:0/2871898912 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556fddaf6dc0 0x556fddb07630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.918+0000 7f211a59c640 1 -- 172.21.15.19:0/2871898912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fddaf2a30 msgr2=0x556fddb09d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:20.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.918+0000 7f211a59c640 1 --2- 172.21.15.19:0/2871898912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fddaf2a30 0x556fddb09d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.918+0000 7f211a59c640 1 -- 172.21.15.19:0/2871898912 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fddaf36c0 con 0x556fddaf64a0 2024-09-19T08:52:20.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.918+0000 7f2119d9b640 1 --2- 172.21.15.19:0/2871898912 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556fddaf6dc0 0x556fddb07630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:20.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.918+0000 7f211a59c640 1 --2- 172.21.15.19:0/2871898912 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556fddaf64a0 0x556fddb070f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f210c00fc30 tx=0x7f210c005d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43d1deb47fa209d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:20.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.918+0000 7f2101ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:52:20.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.918+0000 7f2101ffb640 1 -- 172.21.15.19:0/2871898912 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210c015040 con 0x556fddaf64a0 2024-09-19T08:52:20.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.918+0000 7f2101ffb640 1 -- 172.21.15.19:0/2871898912 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f210c004440 con 0x556fddaf64a0 2024-09-19T08:52:20.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.918+0000 7f2123237740 1 -- 172.21.15.19:0/2871898912 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2110003f10 con 0x556fddaf64a0 2024-09-19T08:52:20.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.918+0000 7f2101ffb640 1 -- 172.21.15.19:0/2871898912 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f210c00b3a0 con 0x556fddaf64a0 2024-09-19T08:52:20.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.918+0000 7f2123237740 10 client.15333 fetch_fsmap learned FSMap version 28 2024-09-19T08:52:20.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.918+0000 7f2123237740 1 -- 172.21.15.19:0/2871898912 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556fddb7bbb0 con 0x556fddaf64a0 2024-09-19T08:52:20.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.919+0000 7f2101ffb640 1 -- 172.21.15.19:0/2871898912 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2110003f10 con 0x556fddaf64a0 2024-09-19T08:52:20.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.919+0000 7f2101ffb640 1 -- 172.21.15.19:0/2871898912 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f210c004b00 con 0x556fddaf64a0 2024-09-19T08:52:20.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.919+0000 7f2123237740 10 client.15333 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:52:20.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.919+0000 7f2123237740 10 client.15333 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:20.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.919+0000 7f2123237740 20 client.15333 populate_metadata read hostname 'smithi019' 2024-09-19T08:52:20.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.919+0000 7f2123237740 1 --2- 172.21.15.19:0/2871898912 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x556fddb01680 0x556fddb7e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:20.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.919+0000 7f2123237740 4 client.15333 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:52:20.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.919+0000 7f2123237740 1 -- 172.21.15.19:0/2871898912 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556fdda63d60 con 0x556fddb01680 2024-09-19T08:52:20.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.919+0000 7f2119d9b640 1 --2- 172.21.15.19:0/2871898912 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x556fddb01680 0x556fddb7e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:20.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.920+0000 7f2119d9b640 1 --2- 172.21.15.19:0/2871898912 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x556fddb01680 0x556fddb7e060 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3e6e6f668f2509a server_cookie=4b34d0e4c42aa34a in_seq=0 out_seq=0 2024-09-19T08:52:20.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.920+0000 7f2101ffb640 10 client.15333 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:52:20.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.920+0000 7f2101ffb640 1 -- 172.21.15.19:0/2871898912 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x556fdda63d60 con 0x556fddb01680 2024-09-19T08:52:20.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.920+0000 7f2101ffb640 10 client.15333 handle_command_reply: tid=0 2024-09-19T08:52:20.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.920+0000 7f2123237740 1 client.15333 shutdown 2024-09-19T08:52:20.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.920+0000 7f2123237740 1 -- 172.21.15.19:0/2871898912 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556fddaf64a0 msgr2=0x556fddb070f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:20.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.920+0000 7f2123237740 1 --2- 172.21.15.19:0/2871898912 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556fddaf64a0 0x556fddb070f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f210c00fc30 tx=0x7f210c005d40 comp rx=0 tx=0).stop 2024-09-19T08:52:20.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.920+0000 7f2123237740 1 -- 172.21.15.19:0/2871898912 shutdown_connections 2024-09-19T08:52:20.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.920+0000 7f2123237740 1 --2- 172.21.15.19:0/2871898912 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x556fddb01680 0x556fddb7e060 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.920+0000 7f2123237740 1 --2- 172.21.15.19:0/2871898912 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556fddaf6dc0 0x556fddb07630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.920+0000 7f2101ffb640 0 client.15333 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:52:20.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.920+0000 7f2123237740 1 --2- 172.21.15.19:0/2871898912 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556fddaf64a0 0x556fddb070f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.920+0000 7f2123237740 1 --2- 172.21.15.19:0/2871898912 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556fddaf2a30 0x556fddb09d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.920+0000 7f2123237740 1 -- 172.21.15.19:0/2871898912 >> 172.21.15.19:0/2871898912 conn(0x556fddafe8a0 msgr2=0x556fddb00280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:20.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.920+0000 7f2123237740 1 -- 172.21.15.19:0/2871898912 shutdown_connections 2024-09-19T08:52:20.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.920+0000 7f2123237740 1 -- 172.21.15.19:0/2871898912 wait complete. 2024-09-19T08:52:20.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.920+0000 7f2123237740 20 client.15333 trim_cache size 0 max 16384 2024-09-19T08:52:20.943 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:52:20.944 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T08:52:20.944 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-19T08:52:20.944 INFO:teuthology.orchestra.run.smithi019.stdout: "8cdad152-4ed0-409d-9b08-a0d4ab6b1dab": { 2024-09-19T08:52:20.944 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-19T08:52:20.944 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "8cdad152-4ed0-409d-9b08-a0d4ab6b1dab", 2024-09-19T08:52:20.944 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-19T08:52:20.945 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:52:20.945 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:52:20.945 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:52:20.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.921+0000 7f2120e5e640 1 -- 172.21.15.19:0/1078267250 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f21040a32d0 msgr2=0x7f21040a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:20.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.921+0000 7f2120e5e640 1 --2- 172.21.15.19:0/1078267250 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f21040a32d0 0x7f21040a5790 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f211409bf90 tx=0x7f211406f110 comp rx=0 tx=0).stop 2024-09-19T08:52:20.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.921+0000 7f2120e5e640 1 -- 172.21.15.19:0/1078267250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f211c106a80 msgr2=0x7f211c19cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:20.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.921+0000 7f2120e5e640 1 --2- 172.21.15.19:0/1078267250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f211c106a80 0x7f211c19cd60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f211400eaa0 tx=0x7f211400ef60 comp rx=0 tx=0).stop 2024-09-19T08:52:20.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.921+0000 7f2120e5e640 1 -- 172.21.15.19:0/1078267250 shutdown_connections 2024-09-19T08:52:20.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.921+0000 7f2120e5e640 1 --2- 172.21.15.19:0/1078267250 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f21040a32d0 0x7f21040a5790 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.921+0000 7f2120e5e640 1 --2- 172.21.15.19:0/1078267250 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f211c101420 0x7f211c1989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.921+0000 7f2120e5e640 1 --2- 172.21.15.19:0/1078267250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f211c106a80 0x7f211c19cd60 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.921+0000 7f2120e5e640 1 --2- 172.21.15.19:0/1078267250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f211c100a80 0x7f211c198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:20.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.921+0000 7f2120e5e640 1 -- 172.21.15.19:0/1078267250 >> 172.21.15.19:0/1078267250 conn(0x7f211c0fc7a0 msgr2=0x7f211c06aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:20.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.921+0000 7f2120e5e640 1 -- 172.21.15.19:0/1078267250 shutdown_connections 2024-09-19T08:52:20.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:20.921+0000 7f2120e5e640 1 -- 172.21.15.19:0/1078267250 wait complete. 2024-09-19T08:52:20.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:20 smithi203 ceph-mon[35450]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:52:21.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:20 smithi155 ceph-mon[34921]: from='client.15315 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:52:21.180 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:21.636 INFO:tasks.cephfs.filesystem:scrub status for tag:8cdad152-4ed0-409d-9b08-a0d4ab6b1dab - {'path': '/', 'tag': '8cdad152-4ed0-409d-9b08-a0d4ab6b1dab', 'options': 'recursive,force'} 2024-09-19T08:52:21.929 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:21 smithi019 ceph-mon[30976]: pgmap v341: 97 pgs: 97 active+clean; 653 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-19T08:52:21.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:21 smithi203 ceph-mon[35450]: pgmap v341: 97 pgs: 97 active+clean; 653 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-19T08:52:22.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.150+0000 7feaa1a48640 1 -- 172.21.15.19:0/879050155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea9c103660 msgr2=0x7fea9c10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:22.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.150+0000 7feaa1a48640 1 --2- 172.21.15.19:0/879050155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea9c103660 0x7fea9c10bb50 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fea84009900 tx=0x7fea8402a480 comp rx=0 tx=0).stop 2024-09-19T08:52:22.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.151+0000 7feaa1a48640 1 -- 172.21.15.19:0/879050155 shutdown_connections 2024-09-19T08:52:22.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.151+0000 7feaa1a48640 1 --2- 172.21.15.19:0/879050155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea9c10c170 0x7fea9c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:22.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.151+0000 7feaa1a48640 1 --2- 172.21.15.19:0/879050155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea9c103660 0x7fea9c10bb50 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:22.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.151+0000 7feaa1a48640 1 --2- 172.21.15.19:0/879050155 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea9c102d40 0x7fea9c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:22.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.151+0000 7feaa1a48640 1 -- 172.21.15.19:0/879050155 >> 172.21.15.19:0/879050155 conn(0x7fea9c0fc7a0 msgr2=0x7fea9c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:22.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.151+0000 7feaa1a48640 1 -- 172.21.15.19:0/879050155 shutdown_connections 2024-09-19T08:52:22.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.151+0000 7feaa1a48640 1 -- 172.21.15.19:0/879050155 wait complete. 2024-09-19T08:52:22.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.151+0000 7feaa1a48640 1 Processor -- start 2024-09-19T08:52:22.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.151+0000 7feaa1a48640 1 -- start start 2024-09-19T08:52:22.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.151+0000 7feaa1a48640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea9c102d40 0x7fea9c198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:22.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.151+0000 7feaa1a48640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea9c103660 0x7fea9c198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:22.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.151+0000 7feaa1a48640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea9c10c170 0x7fea9c19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:22.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.151+0000 7feaa1a48640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fea9c111f70 con 0x7fea9c103660 2024-09-19T08:52:22.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.151+0000 7feaa1a48640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fea9c111df0 con 0x7fea9c10c170 2024-09-19T08:52:22.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.151+0000 7feaa1a48640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fea9c1120f0 con 0x7fea9c102d40 2024-09-19T08:52:22.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.152+0000 7fea93fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea9c103660 0x7fea9c198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:22.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.152+0000 7fea93fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea9c103660 0x7fea9c198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51372/0 (socket says 172.21.15.19:51372) 2024-09-19T08:52:22.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.152+0000 7fea93fff640 1 -- 172.21.15.19:0/2754599516 learned_addr learned my addr 172.21.15.19:0/2754599516 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:22.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.152+0000 7fea93fff640 1 -- 172.21.15.19:0/2754599516 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea9c102d40 msgr2=0x7fea9c198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:22.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.152+0000 7fea93fff640 1 --2- 172.21.15.19:0/2754599516 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea9c102d40 0x7fea9c198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:22.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.152+0000 7fea93fff640 1 -- 172.21.15.19:0/2754599516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea9c10c170 msgr2=0x7fea9c19cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:22.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.152+0000 7fea93fff640 1 --2- 172.21.15.19:0/2754599516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea9c10c170 0x7fea9c19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:22.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.152+0000 7fea93fff640 1 -- 172.21.15.19:0/2754599516 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea9c19d400 con 0x7fea9c103660 2024-09-19T08:52:22.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.152+0000 7fea93fff640 1 --2- 172.21.15.19:0/2754599516 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea9c103660 0x7fea9c198990 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fea84006010 tx=0x7fea840042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:22.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.152+0000 7feaa0a46640 1 -- 172.21.15.19:0/2754599516 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea8403f030 con 0x7fea9c103660 2024-09-19T08:52:22.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.152+0000 7feaa1a48640 1 -- 172.21.15.19:0/2754599516 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea9c19d690 con 0x7fea9c103660 2024-09-19T08:52:22.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.152+0000 7feaa0a46640 1 -- 172.21.15.19:0/2754599516 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fea84003ce0 con 0x7fea9c103660 2024-09-19T08:52:22.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.152+0000 7feaa0a46640 1 -- 172.21.15.19:0/2754599516 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea84035070 con 0x7fea9c103660 2024-09-19T08:52:22.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.152+0000 7feaa1a48640 1 -- 172.21.15.19:0/2754599516 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea9c1a4fd0 con 0x7fea9c103660 2024-09-19T08:52:22.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.153+0000 7feaa1a48640 1 -- 172.21.15.19:0/2754599516 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea9c103120 con 0x7fea9c103660 2024-09-19T08:52:22.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.155+0000 7feaa0a46640 1 -- 172.21.15.19:0/2754599516 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7fea84042030 con 0x7fea9c103660 2024-09-19T08:52:22.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.155+0000 7feaa0a46640 1 --2- 172.21.15.19:0/2754599516 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fea880a32d0 0x7fea880a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:22.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.155+0000 7feaa0a46640 1 -- 172.21.15.19:0/2754599516 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fea840f0120 con 0x7fea9c103660 2024-09-19T08:52:22.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.155+0000 7fea9affd640 1 --2- 172.21.15.19:0/2754599516 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fea880a32d0 0x7fea880a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:22.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.156+0000 7fea9affd640 1 --2- 172.21.15.19:0/2754599516 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fea880a32d0 0x7fea880a5790 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fea8c00a8f0 tx=0x7fea8c005bf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:22.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.160+0000 7feaa0a46640 1 -- 172.21.15.19:0/2754599516 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fea840bcdb0 con 0x7fea9c103660 2024-09-19T08:52:22.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:21 smithi155 ceph-mon[34921]: pgmap v341: 97 pgs: 97 active+clean; 653 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.0 KiB/s wr, 12 op/s 2024-09-19T08:52:22.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.336+0000 7feaa1a48640 1 -- 172.21.15.19:0/2754599516 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fea9c062630 con 0x7fea880a32d0 2024-09-19T08:52:22.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.343+0000 7feaa0a46640 1 -- 172.21.15.19:0/2754599516 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259040 (secure 0 0 0) 0x7fea9c062630 con 0x7fea880a32d0 2024-09-19T08:52:22.346 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:52:22.347 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-19T08:52:22.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.346+0000 7feaa1a48640 1 -- 172.21.15.19:0/2754599516 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fea880a32d0 msgr2=0x7fea880a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:22.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.346+0000 7feaa1a48640 1 --2- 172.21.15.19:0/2754599516 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fea880a32d0 0x7fea880a5790 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fea8c00a8f0 tx=0x7fea8c005bf0 comp rx=0 tx=0).stop 2024-09-19T08:52:22.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.346+0000 7feaa1a48640 1 -- 172.21.15.19:0/2754599516 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea9c103660 msgr2=0x7fea9c198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:22.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.346+0000 7feaa1a48640 1 --2- 172.21.15.19:0/2754599516 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea9c103660 0x7fea9c198990 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fea84006010 tx=0x7fea840042f0 comp rx=0 tx=0).stop 2024-09-19T08:52:22.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.346+0000 7feaa1a48640 1 -- 172.21.15.19:0/2754599516 shutdown_connections 2024-09-19T08:52:22.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.346+0000 7feaa1a48640 1 --2- 172.21.15.19:0/2754599516 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fea880a32d0 0x7fea880a5790 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:22.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.346+0000 7feaa1a48640 1 --2- 172.21.15.19:0/2754599516 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fea9c10c170 0x7fea9c19cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:22.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.346+0000 7feaa1a48640 1 --2- 172.21.15.19:0/2754599516 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fea9c103660 0x7fea9c198990 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:22.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.346+0000 7feaa1a48640 1 --2- 172.21.15.19:0/2754599516 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fea9c102d40 0x7fea9c198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:22.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.346+0000 7feaa1a48640 1 -- 172.21.15.19:0/2754599516 >> 172.21.15.19:0/2754599516 conn(0x7fea9c0fc7a0 msgr2=0x7fea9c0fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:22.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.346+0000 7feaa1a48640 1 -- 172.21.15.19:0/2754599516 shutdown_connections 2024-09-19T08:52:22.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:22.346+0000 7feaa1a48640 1 -- 172.21.15.19:0/2754599516 wait complete. 2024-09-19T08:52:22.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:22 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:52:22.982 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:22 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:52:23.012 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":342,"stamp":"2024-09-19T08:52:21.877404+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":668771,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1288,"num_read_kb":771,"num_write":452,"num_write_kb":3103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1181525,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":870,"ondisk_log_size":870,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":356200,"kb_used_data":11112,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585624,"statfs":{"total":1151940427776,"available":1151575678976,"internally_reserved":0,"allocated":11378688,"data_stored":7192233,"data_compressed":107538,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19142,"internal_metadata":353154362},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10911,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":128,"num_read_kb":70,"num_write":17,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002929"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837651+0000","last_change":"2024-09-19T08:50:15.893270+0000","last_active":"2024-09-19T08:51:51.837651+0000","last_peered":"2024-09-19T08:51:51.837651+0000","last_clean":"2024-09-19T08:51:51.837651+0000","last_became_active":"2024-09-19T08:50:15.892020+0000","last_became_peered":"2024-09-19T08:50:15.892020+0000","last_unstale":"2024-09-19T08:51:51.837651+0000","last_undegraded":"2024-09-19T08:51:51.837651+0000","last_fullsized":"2024-09-19T08:51:51.837651+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:40.846708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.834475+0000","last_change":"2024-09-19T08:50:15.889331+0000","last_active":"2024-09-19T08:51:51.834475+0000","last_peered":"2024-09-19T08:51:51.834475+0000","last_clean":"2024-09-19T08:51:51.834475+0000","last_became_active":"2024-09-19T08:50:15.887082+0000","last_became_peered":"2024-09-19T08:50:15.887082+0000","last_unstale":"2024-09-19T08:51:51.834475+0000","last_undegraded":"2024-09-19T08:51:51.834475+0000","last_fullsized":"2024-09-19T08:51:51.834475+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:46.934172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.836646+0000","last_change":"2024-09-19T08:50:15.891714+0000","last_active":"2024-09-19T08:51:51.836646+0000","last_peered":"2024-09-19T08:51:51.836646+0000","last_clean":"2024-09-19T08:51:51.836646+0000","last_became_active":"2024-09-19T08:50:15.891380+0000","last_became_peered":"2024-09-19T08:50:15.891380+0000","last_unstale":"2024-09-19T08:51:51.836646+0000","last_undegraded":"2024-09-19T08:51:51.836646+0000","last_fullsized":"2024-09-19T08:51:51.836646+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:02.203252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.820814+0000","last_change":"2024-09-19T08:50:15.896157+0000","last_active":"2024-09-19T08:51:51.820814+0000","last_peered":"2024-09-19T08:51:51.820814+0000","last_clean":"2024-09-19T08:51:51.820814+0000","last_became_active":"2024-09-19T08:50:15.895772+0000","last_became_peered":"2024-09-19T08:50:15.895772+0000","last_unstale":"2024-09-19T08:51:51.820814+0000","last_undegraded":"2024-09-19T08:51:51.820814+0000","last_fullsized":"2024-09-19T08:51:51.820814+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:12.915745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.819392+0000","last_change":"2024-09-19T08:50:15.886600+0000","last_active":"2024-09-19T08:51:51.819392+0000","last_peered":"2024-09-19T08:51:51.819392+0000","last_clean":"2024-09-19T08:51:51.819392+0000","last_became_active":"2024-09-19T08:50:15.886270+0000","last_became_peered":"2024-09-19T08:50:15.886270+0000","last_unstale":"2024-09-19T08:51:51.819392+0000","last_undegraded":"2024-09-19T08:51:51.819392+0000","last_fullsized":"2024-09-19T08:51:51.819392+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:53.779930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.826597+0000","last_change":"2024-09-19T08:50:15.889475+0000","last_active":"2024-09-19T08:51:51.826597+0000","last_peered":"2024-09-19T08:51:51.826597+0000","last_clean":"2024-09-19T08:51:51.826597+0000","last_became_active":"2024-09-19T08:50:15.889134+0000","last_became_peered":"2024-09-19T08:50:15.889134+0000","last_unstale":"2024-09-19T08:51:51.826597+0000","last_undegraded":"2024-09-19T08:51:51.826597+0000","last_fullsized":"2024-09-19T08:51:51.826597+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:53.977662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829681+0000","last_change":"2024-09-19T08:50:15.897163+0000","last_active":"2024-09-19T08:51:51.829681+0000","last_peered":"2024-09-19T08:51:51.829681+0000","last_clean":"2024-09-19T08:51:51.829681+0000","last_became_active":"2024-09-19T08:50:15.895161+0000","last_became_peered":"2024-09-19T08:50:15.895161+0000","last_unstale":"2024-09-19T08:51:51.829681+0000","last_undegraded":"2024-09-19T08:51:51.829681+0000","last_fullsized":"2024-09-19T08:51:51.829681+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:32.432691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829477+0000","last_change":"2024-09-19T08:50:15.891197+0000","last_active":"2024-09-19T08:51:51.829477+0000","last_peered":"2024-09-19T08:51:51.829477+0000","last_clean":"2024-09-19T08:51:51.829477+0000","last_became_active":"2024-09-19T08:50:15.890880+0000","last_became_peered":"2024-09-19T08:50:15.890880+0000","last_unstale":"2024-09-19T08:51:51.829477+0000","last_undegraded":"2024-09-19T08:51:51.829477+0000","last_fullsized":"2024-09-19T08:51:51.829477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:41.100341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.836501+0000","last_change":"2024-09-19T08:50:15.896043+0000","last_active":"2024-09-19T08:51:51.836501+0000","last_peered":"2024-09-19T08:51:51.836501+0000","last_clean":"2024-09-19T08:51:51.836501+0000","last_became_active":"2024-09-19T08:50:15.895498+0000","last_became_peered":"2024-09-19T08:50:15.895498+0000","last_unstale":"2024-09-19T08:51:51.836501+0000","last_undegraded":"2024-09-19T08:51:51.836501+0000","last_fullsized":"2024-09-19T08:51:51.836501+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:57.956427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.830052+0000","last_change":"2024-09-19T08:50:15.887658+0000","last_active":"2024-09-19T08:51:51.830052+0000","last_peered":"2024-09-19T08:51:51.830052+0000","last_clean":"2024-09-19T08:51:51.830052+0000","last_became_active":"2024-09-19T08:50:15.887199+0000","last_became_peered":"2024-09-19T08:50:15.887199+0000","last_unstale":"2024-09-19T08:51:51.830052+0000","last_undegraded":"2024-09-19T08:51:51.830052+0000","last_fullsized":"2024-09-19T08:51:51.830052+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:39.947735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.834776+0000","last_change":"2024-09-19T08:50:15.894865+0000","last_active":"2024-09-19T08:51:51.834776+0000","last_peered":"2024-09-19T08:51:51.834776+0000","last_clean":"2024-09-19T08:51:51.834776+0000","last_became_active":"2024-09-19T08:50:15.894475+0000","last_became_peered":"2024-09-19T08:50:15.894475+0000","last_unstale":"2024-09-19T08:51:51.834776+0000","last_undegraded":"2024-09-19T08:51:51.834776+0000","last_fullsized":"2024-09-19T08:51:51.834776+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:43.235991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827890+0000","last_change":"2024-09-19T08:50:15.897209+0000","last_active":"2024-09-19T08:51:51.827890+0000","last_peered":"2024-09-19T08:51:51.827890+0000","last_clean":"2024-09-19T08:51:51.827890+0000","last_became_active":"2024-09-19T08:50:15.896866+0000","last_became_peered":"2024-09-19T08:50:15.896866+0000","last_unstale":"2024-09-19T08:51:51.827890+0000","last_undegraded":"2024-09-19T08:51:51.827890+0000","last_fullsized":"2024-09-19T08:51:51.827890+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:23.036534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.825376+0000","last_change":"2024-09-19T08:50:15.890076+0000","last_active":"2024-09-19T08:51:51.825376+0000","last_peered":"2024-09-19T08:51:51.825376+0000","last_clean":"2024-09-19T08:51:51.825376+0000","last_became_active":"2024-09-19T08:50:15.889735+0000","last_became_peered":"2024-09-19T08:50:15.889735+0000","last_unstale":"2024-09-19T08:51:51.825376+0000","last_undegraded":"2024-09-19T08:51:51.825376+0000","last_fullsized":"2024-09-19T08:51:51.825376+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:25.602757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.834241+0000","last_change":"2024-09-19T08:50:15.886739+0000","last_active":"2024-09-19T08:51:51.834241+0000","last_peered":"2024-09-19T08:51:51.834241+0000","last_clean":"2024-09-19T08:51:51.834241+0000","last_became_active":"2024-09-19T08:50:15.886313+0000","last_became_peered":"2024-09-19T08:50:15.886313+0000","last_unstale":"2024-09-19T08:51:51.834241+0000","last_undegraded":"2024-09-19T08:51:51.834241+0000","last_fullsized":"2024-09-19T08:51:51.834241+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:03.244674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837276+0000","last_change":"2024-09-19T08:50:15.898519+0000","last_active":"2024-09-19T08:51:51.837276+0000","last_peered":"2024-09-19T08:51:51.837276+0000","last_clean":"2024-09-19T08:51:51.837276+0000","last_became_active":"2024-09-19T08:50:15.898249+0000","last_became_peered":"2024-09-19T08:50:15.898249+0000","last_unstale":"2024-09-19T08:51:51.837276+0000","last_undegraded":"2024-09-19T08:51:51.837276+0000","last_fullsized":"2024-09-19T08:51:51.837276+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:32.318895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837455+0000","last_change":"2024-09-19T08:50:15.890324+0000","last_active":"2024-09-19T08:51:51.837455+0000","last_peered":"2024-09-19T08:51:51.837455+0000","last_clean":"2024-09-19T08:51:51.837455+0000","last_became_active":"2024-09-19T08:50:15.887345+0000","last_became_peered":"2024-09-19T08:50:15.887345+0000","last_unstale":"2024-09-19T08:51:51.837455+0000","last_undegraded":"2024-09-19T08:51:51.837455+0000","last_fullsized":"2024-09-19T08:51:51.837455+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:27.989128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837724+0000","last_change":"2024-09-19T08:50:15.896305+0000","last_active":"2024-09-19T08:51:51.837724+0000","last_peered":"2024-09-19T08:51:51.837724+0000","last_clean":"2024-09-19T08:51:51.837724+0000","last_became_active":"2024-09-19T08:50:15.895832+0000","last_became_peered":"2024-09-19T08:50:15.895832+0000","last_unstale":"2024-09-19T08:51:51.837724+0000","last_undegraded":"2024-09-19T08:51:51.837724+0000","last_fullsized":"2024-09-19T08:51:51.837724+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:37.098237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.821237+0000","last_change":"2024-09-19T08:50:15.887251+0000","last_active":"2024-09-19T08:51:51.821237+0000","last_peered":"2024-09-19T08:51:51.821237+0000","last_clean":"2024-09-19T08:51:51.821237+0000","last_became_active":"2024-09-19T08:50:15.886936+0000","last_became_peered":"2024-09-19T08:50:15.886936+0000","last_unstale":"2024-09-19T08:51:51.821237+0000","last_undegraded":"2024-09-19T08:51:51.821237+0000","last_fullsized":"2024-09-19T08:51:51.821237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:38:08.828246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827071+0000","last_change":"2024-09-19T08:50:15.884813+0000","last_active":"2024-09-19T08:51:51.827071+0000","last_peered":"2024-09-19T08:51:51.827071+0000","last_clean":"2024-09-19T08:51:51.827071+0000","last_became_active":"2024-09-19T08:50:15.883445+0000","last_became_peered":"2024-09-19T08:50:15.883445+0000","last_unstale":"2024-09-19T08:51:51.827071+0000","last_undegraded":"2024-09-19T08:51:51.827071+0000","last_fullsized":"2024-09-19T08:51:51.827071+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:39.733501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.821368+0000","last_change":"2024-09-19T08:50:15.887644+0000","last_active":"2024-09-19T08:51:51.821368+0000","last_peered":"2024-09-19T08:51:51.821368+0000","last_clean":"2024-09-19T08:51:51.821368+0000","last_became_active":"2024-09-19T08:50:15.887224+0000","last_became_peered":"2024-09-19T08:50:15.887224+0000","last_unstale":"2024-09-19T08:51:51.821368+0000","last_undegraded":"2024-09-19T08:51:51.821368+0000","last_fullsized":"2024-09-19T08:51:51.821368+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:35.883690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.835961+0000","last_change":"2024-09-19T08:50:15.886678+0000","last_active":"2024-09-19T08:51:51.835961+0000","last_peered":"2024-09-19T08:51:51.835961+0000","last_clean":"2024-09-19T08:51:51.835961+0000","last_became_active":"2024-09-19T08:50:15.886360+0000","last_became_peered":"2024-09-19T08:50:15.886360+0000","last_unstale":"2024-09-19T08:51:51.835961+0000","last_undegraded":"2024-09-19T08:51:51.835961+0000","last_fullsized":"2024-09-19T08:51:51.835961+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:51.515211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.832052+0000","last_change":"2024-09-19T08:50:15.887607+0000","last_active":"2024-09-19T08:51:51.832052+0000","last_peered":"2024-09-19T08:51:51.832052+0000","last_clean":"2024-09-19T08:51:51.832052+0000","last_became_active":"2024-09-19T08:50:15.887266+0000","last_became_peered":"2024-09-19T08:50:15.887266+0000","last_unstale":"2024-09-19T08:51:51.832052+0000","last_undegraded":"2024-09-19T08:51:51.832052+0000","last_fullsized":"2024-09-19T08:51:51.832052+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:44:57.404160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829136+0000","last_change":"2024-09-19T08:50:15.882651+0000","last_active":"2024-09-19T08:51:51.829136+0000","last_peered":"2024-09-19T08:51:51.829136+0000","last_clean":"2024-09-19T08:51:51.829136+0000","last_became_active":"2024-09-19T08:50:15.882298+0000","last_became_peered":"2024-09-19T08:50:15.882298+0000","last_unstale":"2024-09-19T08:51:51.829136+0000","last_undegraded":"2024-09-19T08:51:51.829136+0000","last_fullsized":"2024-09-19T08:51:51.829136+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:16.028013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829040+0000","last_change":"2024-09-19T08:50:15.880407+0000","last_active":"2024-09-19T08:51:51.829040+0000","last_peered":"2024-09-19T08:51:51.829040+0000","last_clean":"2024-09-19T08:51:51.829040+0000","last_became_active":"2024-09-19T08:50:15.880026+0000","last_became_peered":"2024-09-19T08:50:15.880026+0000","last_unstale":"2024-09-19T08:51:51.829040+0000","last_undegraded":"2024-09-19T08:51:51.829040+0000","last_fullsized":"2024-09-19T08:51:51.829040+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:16.600913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.828745+0000","last_change":"2024-09-19T08:50:15.883573+0000","last_active":"2024-09-19T08:51:51.828745+0000","last_peered":"2024-09-19T08:51:51.828745+0000","last_clean":"2024-09-19T08:51:51.828745+0000","last_became_active":"2024-09-19T08:50:15.883258+0000","last_became_peered":"2024-09-19T08:50:15.883258+0000","last_unstale":"2024-09-19T08:51:51.828745+0000","last_undegraded":"2024-09-19T08:51:51.828745+0000","last_fullsized":"2024-09-19T08:51:51.828745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:33.026579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827776+0000","last_change":"2024-09-19T08:50:15.889519+0000","last_active":"2024-09-19T08:51:51.827776+0000","last_peered":"2024-09-19T08:51:51.827776+0000","last_clean":"2024-09-19T08:51:51.827776+0000","last_became_active":"2024-09-19T08:50:15.889183+0000","last_became_peered":"2024-09-19T08:50:15.889183+0000","last_unstale":"2024-09-19T08:51:51.827776+0000","last_undegraded":"2024-09-19T08:51:51.827776+0000","last_fullsized":"2024-09-19T08:51:51.827776+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:06.725662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.821674+0000","last_change":"2024-09-19T08:50:15.894483+0000","last_active":"2024-09-19T08:51:51.821674+0000","last_peered":"2024-09-19T08:51:51.821674+0000","last_clean":"2024-09-19T08:51:51.821674+0000","last_became_active":"2024-09-19T08:50:15.893760+0000","last_became_peered":"2024-09-19T08:50:15.893760+0000","last_unstale":"2024-09-19T08:51:51.821674+0000","last_undegraded":"2024-09-19T08:51:51.821674+0000","last_fullsized":"2024-09-19T08:51:51.821674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:23.686592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.835380+0000","last_change":"2024-09-19T08:50:15.882393+0000","last_active":"2024-09-19T08:51:51.835380+0000","last_peered":"2024-09-19T08:51:51.835380+0000","last_clean":"2024-09-19T08:51:51.835380+0000","last_became_active":"2024-09-19T08:50:15.882040+0000","last_became_peered":"2024-09-19T08:50:15.882040+0000","last_unstale":"2024-09-19T08:51:51.835380+0000","last_undegraded":"2024-09-19T08:51:51.835380+0000","last_fullsized":"2024-09-19T08:51:51.835380+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:22.430017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837471+0000","last_change":"2024-09-19T08:50:15.890919+0000","last_active":"2024-09-19T08:51:51.837471+0000","last_peered":"2024-09-19T08:51:51.837471+0000","last_clean":"2024-09-19T08:51:51.837471+0000","last_became_active":"2024-09-19T08:50:15.890256+0000","last_became_peered":"2024-09-19T08:50:15.890256+0000","last_unstale":"2024-09-19T08:51:51.837471+0000","last_undegraded":"2024-09-19T08:51:51.837471+0000","last_fullsized":"2024-09-19T08:51:51.837471+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:48.404890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.834164+0000","last_change":"2024-09-19T08:50:15.888139+0000","last_active":"2024-09-19T08:51:51.834164+0000","last_peered":"2024-09-19T08:51:51.834164+0000","last_clean":"2024-09-19T08:51:51.834164+0000","last_became_active":"2024-09-19T08:50:15.886471+0000","last_became_peered":"2024-09-19T08:50:15.886471+0000","last_unstale":"2024-09-19T08:51:51.834164+0000","last_undegraded":"2024-09-19T08:51:51.834164+0000","last_fullsized":"2024-09-19T08:51:51.834164+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:20.545473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.822886+0000","last_change":"2024-09-19T08:50:15.891354+0000","last_active":"2024-09-19T08:51:51.822886+0000","last_peered":"2024-09-19T08:51:51.822886+0000","last_clean":"2024-09-19T08:51:51.822886+0000","last_became_active":"2024-09-19T08:50:15.890900+0000","last_became_peered":"2024-09-19T08:50:15.890900+0000","last_unstale":"2024-09-19T08:51:51.822886+0000","last_undegraded":"2024-09-19T08:51:51.822886+0000","last_fullsized":"2024-09-19T08:51:51.822886+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:33.139637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.828772+0000","last_change":"2024-09-19T08:50:15.891501+0000","last_active":"2024-09-19T08:51:51.828772+0000","last_peered":"2024-09-19T08:51:51.828772+0000","last_clean":"2024-09-19T08:51:51.828772+0000","last_became_active":"2024-09-19T08:50:15.891183+0000","last_became_peered":"2024-09-19T08:50:15.891183+0000","last_unstale":"2024-09-19T08:51:51.828772+0000","last_undegraded":"2024-09-19T08:51:51.828772+0000","last_fullsized":"2024-09-19T08:51:51.828772+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:16.976705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.819783+0000","last_change":"2024-09-19T08:50:15.882048+0000","last_active":"2024-09-19T08:51:51.819783+0000","last_peered":"2024-09-19T08:51:51.819783+0000","last_clean":"2024-09-19T08:51:51.819783+0000","last_became_active":"2024-09-19T08:50:15.881156+0000","last_became_peered":"2024-09-19T08:50:15.881156+0000","last_unstale":"2024-09-19T08:51:51.819783+0000","last_undegraded":"2024-09-19T08:51:51.819783+0000","last_fullsized":"2024-09-19T08:51:51.819783+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:33.198852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":144,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:19.128854+0000","last_change":"2024-09-19T08:50:13.800156+0000","last_active":"2024-09-19T08:52:19.128854+0000","last_peered":"2024-09-19T08:52:19.128854+0000","last_clean":"2024-09-19T08:52:19.128854+0000","last_became_active":"2024-09-19T08:50:13.799779+0000","last_became_peered":"2024-09-19T08:50:13.799779+0000","last_unstale":"2024-09-19T08:52:19.128854+0000","last_undegraded":"2024-09-19T08:52:19.128854+0000","last_fullsized":"2024-09-19T08:52:19.128854+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:38.033049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.826996+0000","last_change":"2024-09-19T08:50:15.887252+0000","last_active":"2024-09-19T08:51:51.826996+0000","last_peered":"2024-09-19T08:51:51.826996+0000","last_clean":"2024-09-19T08:51:51.826996+0000","last_became_active":"2024-09-19T08:50:15.886899+0000","last_became_peered":"2024-09-19T08:50:15.886899+0000","last_unstale":"2024-09-19T08:51:51.826996+0000","last_undegraded":"2024-09-19T08:51:51.826996+0000","last_fullsized":"2024-09-19T08:51:51.826996+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:56.262387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.556154+0000","last_change":"2024-09-19T08:51:23.556154+0000","last_active":"2024-09-19T08:51:23.556154+0000","last_peered":"2024-09-19T08:51:23.556154+0000","last_clean":"2024-09-19T08:51:23.556154+0000","last_became_active":"2024-09-19T08:51:23.549418+0000","last_became_peered":"2024-09-19T08:51:23.549418+0000","last_unstale":"2024-09-19T08:51:23.556154+0000","last_undegraded":"2024-09-19T08:51:23.556154+0000","last_fullsized":"2024-09-19T08:51:23.556154+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:35.225465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.540195+0000","last_change":"2024-09-19T08:50:13.794010+0000","last_active":"2024-09-19T08:51:23.540195+0000","last_peered":"2024-09-19T08:51:23.540195+0000","last_clean":"2024-09-19T08:51:23.540195+0000","last_became_active":"2024-09-19T08:50:13.793677+0000","last_became_peered":"2024-09-19T08:50:13.793677+0000","last_unstale":"2024-09-19T08:51:23.540195+0000","last_undegraded":"2024-09-19T08:51:23.540195+0000","last_fullsized":"2024-09-19T08:51:23.540195+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:56.125702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827232+0000","last_change":"2024-09-19T08:50:15.881732+0000","last_active":"2024-09-19T08:51:51.827232+0000","last_peered":"2024-09-19T08:51:51.827232+0000","last_clean":"2024-09-19T08:51:51.827232+0000","last_became_active":"2024-09-19T08:50:15.881394+0000","last_became_peered":"2024-09-19T08:50:15.881394+0000","last_unstale":"2024-09-19T08:51:51.827232+0000","last_undegraded":"2024-09-19T08:51:51.827232+0000","last_fullsized":"2024-09-19T08:51:51.827232+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:55.549138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.544525+0000","last_change":"2024-09-19T08:50:13.797118+0000","last_active":"2024-09-19T08:51:23.544525+0000","last_peered":"2024-09-19T08:51:23.544525+0000","last_clean":"2024-09-19T08:51:23.544525+0000","last_became_active":"2024-09-19T08:50:13.796727+0000","last_became_peered":"2024-09-19T08:50:13.796727+0000","last_unstale":"2024-09-19T08:51:23.544525+0000","last_undegraded":"2024-09-19T08:51:23.544525+0000","last_fullsized":"2024-09-19T08:51:23.544525+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:49.310543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.824911+0000","last_change":"2024-09-19T08:50:15.888192+0000","last_active":"2024-09-19T08:51:51.824911+0000","last_peered":"2024-09-19T08:51:51.824911+0000","last_clean":"2024-09-19T08:51:51.824911+0000","last_became_active":"2024-09-19T08:50:15.887890+0000","last_became_peered":"2024-09-19T08:50:15.887890+0000","last_unstale":"2024-09-19T08:51:51.824911+0000","last_undegraded":"2024-09-19T08:51:51.824911+0000","last_fullsized":"2024-09-19T08:51:51.824911+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:24:48.951856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'6","reported_seq":250,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:18.095678+0000","last_change":"2024-09-19T08:50:13.797427+0000","last_active":"2024-09-19T08:52:18.095678+0000","last_peered":"2024-09-19T08:52:18.095678+0000","last_clean":"2024-09-19T08:52:18.095678+0000","last_became_active":"2024-09-19T08:50:13.797021+0000","last_became_peered":"2024-09-19T08:50:13.797021+0000","last_unstale":"2024-09-19T08:52:18.095678+0000","last_undegraded":"2024-09-19T08:52:18.095678+0000","last_fullsized":"2024-09-19T08:52:18.095678+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:14.530373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":222,"num_read_kb":222,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837299+0000","last_change":"2024-09-19T08:50:15.894619+0000","last_active":"2024-09-19T08:51:51.837299+0000","last_peered":"2024-09-19T08:51:51.837299+0000","last_clean":"2024-09-19T08:51:51.837299+0000","last_became_active":"2024-09-19T08:50:15.894258+0000","last_became_peered":"2024-09-19T08:50:15.894258+0000","last_unstale":"2024-09-19T08:51:51.837299+0000","last_undegraded":"2024-09-19T08:51:51.837299+0000","last_fullsized":"2024-09-19T08:51:51.837299+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:13.137314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.559196+0000","last_change":"2024-09-19T08:51:23.559196+0000","last_active":"2024-09-19T08:51:23.559196+0000","last_peered":"2024-09-19T08:51:23.559196+0000","last_clean":"2024-09-19T08:51:23.559196+0000","last_became_active":"2024-09-19T08:51:23.549412+0000","last_became_peered":"2024-09-19T08:51:23.549412+0000","last_unstale":"2024-09-19T08:51:23.559196+0000","last_undegraded":"2024-09-19T08:51:23.559196+0000","last_fullsized":"2024-09-19T08:51:23.559196+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:38.145697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837760+0000","last_change":"2024-09-19T08:50:15.891121+0000","last_active":"2024-09-19T08:51:51.837760+0000","last_peered":"2024-09-19T08:51:51.837760+0000","last_clean":"2024-09-19T08:51:51.837760+0000","last_became_active":"2024-09-19T08:50:15.890810+0000","last_became_peered":"2024-09-19T08:50:15.890810+0000","last_unstale":"2024-09-19T08:51:51.837760+0000","last_undegraded":"2024-09-19T08:51:51.837760+0000","last_fullsized":"2024-09-19T08:51:51.837760+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:13.010282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.545394+0000","last_change":"2024-09-19T08:50:14.293953+0000","last_active":"2024-09-19T08:51:23.545394+0000","last_peered":"2024-09-19T08:51:23.545394+0000","last_clean":"2024-09-19T08:51:23.545394+0000","last_became_active":"2024-09-19T08:50:14.293546+0000","last_became_peered":"2024-09-19T08:50:14.293546+0000","last_unstale":"2024-09-19T08:51:23.545394+0000","last_undegraded":"2024-09-19T08:51:23.545394+0000","last_fullsized":"2024-09-19T08:51:23.545394+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:27.809243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.836318+0000","last_change":"2024-09-19T08:50:15.878300+0000","last_active":"2024-09-19T08:51:51.836318+0000","last_peered":"2024-09-19T08:51:51.836318+0000","last_clean":"2024-09-19T08:51:51.836318+0000","last_became_active":"2024-09-19T08:50:15.877938+0000","last_became_peered":"2024-09-19T08:50:15.877938+0000","last_unstale":"2024-09-19T08:51:51.836318+0000","last_undegraded":"2024-09-19T08:51:51.836318+0000","last_fullsized":"2024-09-19T08:51:51.836318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:05.376708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'37","reported_seq":293,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:18.720492+0000","last_change":"2024-09-19T08:50:13.800696+0000","last_active":"2024-09-19T08:52:18.720492+0000","last_peered":"2024-09-19T08:52:18.720492+0000","last_clean":"2024-09-19T08:52:18.720492+0000","last_became_active":"2024-09-19T08:50:13.799385+0000","last_became_peered":"2024-09-19T08:50:13.799385+0000","last_unstale":"2024-09-19T08:52:18.720492+0000","last_undegraded":"2024-09-19T08:52:18.720492+0000","last_fullsized":"2024-09-19T08:52:18.720492+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:56.897309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69192,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":234,"num_read_kb":183,"num_write":39,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.820658+0000","last_change":"2024-09-19T08:50:15.891483+0000","last_active":"2024-09-19T08:51:51.820658+0000","last_peered":"2024-09-19T08:51:51.820658+0000","last_clean":"2024-09-19T08:51:51.820658+0000","last_became_active":"2024-09-19T08:50:15.891185+0000","last_became_peered":"2024-09-19T08:50:15.891185+0000","last_unstale":"2024-09-19T08:51:51.820658+0000","last_undegraded":"2024-09-19T08:51:51.820658+0000","last_fullsized":"2024-09-19T08:51:51.820658+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:26.599151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.548669+0000","last_change":"2024-09-19T08:50:13.795148+0000","last_active":"2024-09-19T08:51:23.548669+0000","last_peered":"2024-09-19T08:51:23.548669+0000","last_clean":"2024-09-19T08:51:23.548669+0000","last_became_active":"2024-09-19T08:50:13.794688+0000","last_became_peered":"2024-09-19T08:50:13.794688+0000","last_unstale":"2024-09-19T08:51:23.548669+0000","last_undegraded":"2024-09-19T08:51:23.548669+0000","last_fullsized":"2024-09-19T08:51:23.548669+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:01.366439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.832390+0000","last_change":"2024-09-19T08:50:15.886449+0000","last_active":"2024-09-19T08:51:51.832390+0000","last_peered":"2024-09-19T08:51:51.832390+0000","last_clean":"2024-09-19T08:51:51.832390+0000","last_became_active":"2024-09-19T08:50:15.886119+0000","last_became_peered":"2024-09-19T08:50:15.886119+0000","last_unstale":"2024-09-19T08:51:51.832390+0000","last_undegraded":"2024-09-19T08:51:51.832390+0000","last_fullsized":"2024-09-19T08:51:51.832390+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:22.916593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.544525+0000","last_change":"2024-09-19T08:50:13.799363+0000","last_active":"2024-09-19T08:51:23.544525+0000","last_peered":"2024-09-19T08:51:23.544525+0000","last_clean":"2024-09-19T08:51:23.544525+0000","last_became_active":"2024-09-19T08:50:13.799033+0000","last_became_peered":"2024-09-19T08:50:13.799033+0000","last_unstale":"2024-09-19T08:51:23.544525+0000","last_undegraded":"2024-09-19T08:51:23.544525+0000","last_fullsized":"2024-09-19T08:51:23.544525+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:57.753451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837083+0000","last_change":"2024-09-19T08:50:15.898902+0000","last_active":"2024-09-19T08:51:51.837083+0000","last_peered":"2024-09-19T08:51:51.837083+0000","last_clean":"2024-09-19T08:51:51.837083+0000","last_became_active":"2024-09-19T08:50:15.898417+0000","last_became_peered":"2024-09-19T08:50:15.898417+0000","last_unstale":"2024-09-19T08:51:51.837083+0000","last_undegraded":"2024-09-19T08:51:51.837083+0000","last_fullsized":"2024-09-19T08:51:51.837083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:32:19.799301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'9","reported_seq":147,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:16.092852+0000","last_change":"2024-09-19T08:50:13.798477+0000","last_active":"2024-09-19T08:52:16.092852+0000","last_peered":"2024-09-19T08:52:16.092852+0000","last_clean":"2024-09-19T08:52:16.092852+0000","last_became_active":"2024-09-19T08:50:13.798136+0000","last_became_peered":"2024-09-19T08:50:13.798136+0000","last_unstale":"2024-09-19T08:52:16.092852+0000","last_undegraded":"2024-09-19T08:52:16.092852+0000","last_fullsized":"2024-09-19T08:52:16.092852+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:33.874285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1823,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":7,"num_write":9,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829630+0000","last_change":"2024-09-19T08:50:15.896414+0000","last_active":"2024-09-19T08:51:51.829630+0000","last_peered":"2024-09-19T08:51:51.829630+0000","last_clean":"2024-09-19T08:51:51.829630+0000","last_became_active":"2024-09-19T08:50:15.895530+0000","last_became_peered":"2024-09-19T08:50:15.895530+0000","last_unstale":"2024-09-19T08:51:51.829630+0000","last_undegraded":"2024-09-19T08:51:51.829630+0000","last_fullsized":"2024-09-19T08:51:51.829630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:59.717869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.545962+0000","last_change":"2024-09-19T08:50:14.294087+0000","last_active":"2024-09-19T08:51:23.545962+0000","last_peered":"2024-09-19T08:51:23.545962+0000","last_clean":"2024-09-19T08:51:23.545962+0000","last_became_active":"2024-09-19T08:50:14.293712+0000","last_became_peered":"2024-09-19T08:50:14.293712+0000","last_unstale":"2024-09-19T08:51:23.545962+0000","last_undegraded":"2024-09-19T08:51:23.545962+0000","last_fullsized":"2024-09-19T08:51:23.545962+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:12.187514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.835719+0000","last_change":"2024-09-19T08:50:15.888134+0000","last_active":"2024-09-19T08:51:51.835719+0000","last_peered":"2024-09-19T08:51:51.835719+0000","last_clean":"2024-09-19T08:51:51.835719+0000","last_became_active":"2024-09-19T08:50:15.887768+0000","last_became_peered":"2024-09-19T08:50:15.887768+0000","last_unstale":"2024-09-19T08:51:51.835719+0000","last_undegraded":"2024-09-19T08:51:51.835719+0000","last_fullsized":"2024-09-19T08:51:51.835719+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:12.868773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.547326+0000","last_change":"2024-09-19T08:50:13.792585+0000","last_active":"2024-09-19T08:51:23.547326+0000","last_peered":"2024-09-19T08:51:23.547326+0000","last_clean":"2024-09-19T08:51:23.547326+0000","last_became_active":"2024-09-19T08:50:13.792222+0000","last_became_peered":"2024-09-19T08:50:13.792222+0000","last_unstale":"2024-09-19T08:51:23.547326+0000","last_undegraded":"2024-09-19T08:51:23.547326+0000","last_fullsized":"2024-09-19T08:51:23.547326+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:45.234800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.818076+0000","last_change":"2024-09-19T08:51:23.549003+0000","last_active":"2024-09-19T08:51:51.818076+0000","last_peered":"2024-09-19T08:51:51.818076+0000","last_clean":"2024-09-19T08:51:51.818076+0000","last_became_active":"2024-09-19T08:51:23.548611+0000","last_became_peered":"2024-09-19T08:51:23.548611+0000","last_unstale":"2024-09-19T08:51:51.818076+0000","last_undegraded":"2024-09-19T08:51:51.818076+0000","last_fullsized":"2024-09-19T08:51:51.818076+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:00.043092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.540568+0000","last_change":"2024-09-19T08:50:13.795360+0000","last_active":"2024-09-19T08:51:23.540568+0000","last_peered":"2024-09-19T08:51:23.540568+0000","last_clean":"2024-09-19T08:51:23.540568+0000","last_became_active":"2024-09-19T08:50:13.794823+0000","last_became_peered":"2024-09-19T08:50:13.794823+0000","last_unstale":"2024-09-19T08:51:23.540568+0000","last_undegraded":"2024-09-19T08:51:23.540568+0000","last_fullsized":"2024-09-19T08:51:23.540568+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:15.037834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.822420+0000","last_change":"2024-09-19T08:50:15.893668+0000","last_active":"2024-09-19T08:51:51.822420+0000","last_peered":"2024-09-19T08:51:51.822420+0000","last_clean":"2024-09-19T08:51:51.822420+0000","last_became_active":"2024-09-19T08:50:15.893303+0000","last_became_peered":"2024-09-19T08:50:15.893303+0000","last_unstale":"2024-09-19T08:51:51.822420+0000","last_undegraded":"2024-09-19T08:51:51.822420+0000","last_fullsized":"2024-09-19T08:51:51.822420+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:59.281601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.545777+0000","last_change":"2024-09-19T08:50:13.797442+0000","last_active":"2024-09-19T08:51:23.545777+0000","last_peered":"2024-09-19T08:51:23.545777+0000","last_clean":"2024-09-19T08:51:23.545777+0000","last_became_active":"2024-09-19T08:50:13.797072+0000","last_became_peered":"2024-09-19T08:50:13.797072+0000","last_unstale":"2024-09-19T08:51:23.545777+0000","last_undegraded":"2024-09-19T08:51:23.545777+0000","last_fullsized":"2024-09-19T08:51:23.545777+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:32.960928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829292+0000","last_change":"2024-09-19T08:51:23.554271+0000","last_active":"2024-09-19T08:51:51.829292+0000","last_peered":"2024-09-19T08:51:51.829292+0000","last_clean":"2024-09-19T08:51:51.829292+0000","last_became_active":"2024-09-19T08:51:23.547630+0000","last_became_peered":"2024-09-19T08:51:23.547630+0000","last_unstale":"2024-09-19T08:51:51.829292+0000","last_undegraded":"2024-09-19T08:51:51.829292+0000","last_fullsized":"2024-09-19T08:51:51.829292+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:39.033522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'7","reported_seq":146,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:19.097782+0000","last_change":"2024-09-19T08:50:14.294014+0000","last_active":"2024-09-19T08:52:19.097782+0000","last_peered":"2024-09-19T08:52:19.097782+0000","last_clean":"2024-09-19T08:52:19.097782+0000","last_became_active":"2024-09-19T08:50:14.293564+0000","last_became_peered":"2024-09-19T08:50:14.293564+0000","last_unstale":"2024-09-19T08:52:19.097782+0000","last_undegraded":"2024-09-19T08:52:19.097782+0000","last_fullsized":"2024-09-19T08:52:19.097782+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:23.806408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1704,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.834993+0000","last_change":"2024-09-19T08:50:15.891840+0000","last_active":"2024-09-19T08:51:51.834993+0000","last_peered":"2024-09-19T08:51:51.834993+0000","last_clean":"2024-09-19T08:51:51.834993+0000","last_became_active":"2024-09-19T08:50:15.891511+0000","last_became_peered":"2024-09-19T08:50:15.891511+0000","last_unstale":"2024-09-19T08:51:51.834993+0000","last_undegraded":"2024-09-19T08:51:51.834993+0000","last_fullsized":"2024-09-19T08:51:51.834993+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:26.800508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":332,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.545171+0000","last_change":"2024-09-19T08:49:02.071497+0000","last_active":"2024-09-19T08:51:23.545171+0000","last_peered":"2024-09-19T08:51:23.545171+0000","last_clean":"2024-09-19T08:51:23.545171+0000","last_became_active":"2024-09-19T08:49:02.071114+0000","last_became_peered":"2024-09-19T08:49:02.071114+0000","last_unstale":"2024-09-19T08:51:23.545171+0000","last_undegraded":"2024-09-19T08:51:23.545171+0000","last_fullsized":"2024-09-19T08:51:23.545171+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:45:36.600595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:45:36.600595+0000","last_clean_scrub_stamp":"2024-09-19T08:45:36.600595+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:18:15.369279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.541800+0000","last_change":"2024-09-19T08:50:13.793981+0000","last_active":"2024-09-19T08:51:23.541800+0000","last_peered":"2024-09-19T08:51:23.541800+0000","last_clean":"2024-09-19T08:51:23.541800+0000","last_became_active":"2024-09-19T08:50:13.793616+0000","last_became_peered":"2024-09-19T08:50:13.793616+0000","last_unstale":"2024-09-19T08:51:23.541800+0000","last_undegraded":"2024-09-19T08:51:23.541800+0000","last_fullsized":"2024-09-19T08:51:23.541800+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:45.195906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.828998+0000","last_change":"2024-09-19T08:50:15.891248+0000","last_active":"2024-09-19T08:51:51.828998+0000","last_peered":"2024-09-19T08:51:51.828998+0000","last_clean":"2024-09-19T08:51:51.828998+0000","last_became_active":"2024-09-19T08:50:15.890922+0000","last_became_peered":"2024-09-19T08:50:15.890922+0000","last_unstale":"2024-09-19T08:51:51.828998+0000","last_undegraded":"2024-09-19T08:51:51.828998+0000","last_fullsized":"2024-09-19T08:51:51.828998+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:18:43.914214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.545087+0000","last_change":"2024-09-19T08:50:13.797471+0000","last_active":"2024-09-19T08:51:23.545087+0000","last_peered":"2024-09-19T08:51:23.545087+0000","last_clean":"2024-09-19T08:51:23.545087+0000","last_became_active":"2024-09-19T08:50:13.797033+0000","last_became_peered":"2024-09-19T08:50:13.797033+0000","last_unstale":"2024-09-19T08:51:23.545087+0000","last_undegraded":"2024-09-19T08:51:23.545087+0000","last_fullsized":"2024-09-19T08:51:23.545087+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:53.141708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.823643+0000","last_change":"2024-09-19T08:50:15.882650+0000","last_active":"2024-09-19T08:51:51.823643+0000","last_peered":"2024-09-19T08:51:51.823643+0000","last_clean":"2024-09-19T08:51:51.823643+0000","last_became_active":"2024-09-19T08:50:15.882308+0000","last_became_peered":"2024-09-19T08:50:15.882308+0000","last_unstale":"2024-09-19T08:51:51.823643+0000","last_undegraded":"2024-09-19T08:51:51.823643+0000","last_fullsized":"2024-09-19T08:51:51.823643+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:26.449562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'7","reported_seq":144,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:20.097841+0000","last_change":"2024-09-19T08:50:14.292466+0000","last_active":"2024-09-19T08:52:20.097841+0000","last_peered":"2024-09-19T08:52:20.097841+0000","last_clean":"2024-09-19T08:52:20.097841+0000","last_became_active":"2024-09-19T08:50:14.292092+0000","last_became_peered":"2024-09-19T08:50:14.292092+0000","last_unstale":"2024-09-19T08:52:20.097841+0000","last_undegraded":"2024-09-19T08:52:20.097841+0000","last_fullsized":"2024-09-19T08:52:20.097841+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:11.373226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.825807+0000","last_change":"2024-09-19T08:51:23.551606+0000","last_active":"2024-09-19T08:51:51.825807+0000","last_peered":"2024-09-19T08:51:51.825807+0000","last_clean":"2024-09-19T08:51:51.825807+0000","last_became_active":"2024-09-19T08:51:23.551181+0000","last_became_peered":"2024-09-19T08:51:23.551181+0000","last_unstale":"2024-09-19T08:51:51.825807+0000","last_undegraded":"2024-09-19T08:51:51.825807+0000","last_fullsized":"2024-09-19T08:51:51.825807+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:05.577651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'6","reported_seq":144,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:20.626662+0000","last_change":"2024-09-19T08:50:13.799909+0000","last_active":"2024-09-19T08:52:20.626662+0000","last_peered":"2024-09-19T08:52:20.626662+0000","last_clean":"2024-09-19T08:52:20.626662+0000","last_became_active":"2024-09-19T08:50:13.799542+0000","last_became_peered":"2024-09-19T08:50:13.799542+0000","last_unstale":"2024-09-19T08:52:20.626662+0000","last_undegraded":"2024-09-19T08:52:20.626662+0000","last_fullsized":"2024-09-19T08:52:20.626662+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:23.545897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837020+0000","last_change":"2024-09-19T08:51:24.482934+0000","last_active":"2024-09-19T08:51:51.837020+0000","last_peered":"2024-09-19T08:51:51.837020+0000","last_clean":"2024-09-19T08:51:51.837020+0000","last_became_active":"2024-09-19T08:51:24.482586+0000","last_became_peered":"2024-09-19T08:51:24.482586+0000","last_unstale":"2024-09-19T08:51:51.837020+0000","last_undegraded":"2024-09-19T08:51:51.837020+0000","last_fullsized":"2024-09-19T08:51:51.837020+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:15.121449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.543140+0000","last_change":"2024-09-19T08:50:14.292577+0000","last_active":"2024-09-19T08:51:23.543140+0000","last_peered":"2024-09-19T08:51:23.543140+0000","last_clean":"2024-09-19T08:51:23.543140+0000","last_became_active":"2024-09-19T08:50:14.292220+0000","last_became_peered":"2024-09-19T08:50:14.292220+0000","last_unstale":"2024-09-19T08:51:23.543140+0000","last_undegraded":"2024-09-19T08:51:23.543140+0000","last_fullsized":"2024-09-19T08:51:23.543140+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:23.631672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827650+0000","last_change":"2024-09-19T08:50:15.891345+0000","last_active":"2024-09-19T08:51:51.827650+0000","last_peered":"2024-09-19T08:51:51.827650+0000","last_clean":"2024-09-19T08:51:51.827650+0000","last_became_active":"2024-09-19T08:50:15.891006+0000","last_became_peered":"2024-09-19T08:50:15.891006+0000","last_unstale":"2024-09-19T08:51:51.827650+0000","last_undegraded":"2024-09-19T08:51:51.827650+0000","last_fullsized":"2024-09-19T08:51:51.827650+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:41.934331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.546914+0000","last_change":"2024-09-19T08:50:14.292619+0000","last_active":"2024-09-19T08:51:23.546914+0000","last_peered":"2024-09-19T08:51:23.546914+0000","last_clean":"2024-09-19T08:51:23.546914+0000","last_became_active":"2024-09-19T08:50:14.292230+0000","last_became_peered":"2024-09-19T08:50:14.292230+0000","last_unstale":"2024-09-19T08:51:23.546914+0000","last_undegraded":"2024-09-19T08:51:23.546914+0000","last_fullsized":"2024-09-19T08:51:23.546914+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:21:33.076142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.824453+0000","last_change":"2024-09-19T08:50:15.882760+0000","last_active":"2024-09-19T08:51:51.824453+0000","last_peered":"2024-09-19T08:51:51.824453+0000","last_clean":"2024-09-19T08:51:51.824453+0000","last_became_active":"2024-09-19T08:50:15.882402+0000","last_became_peered":"2024-09-19T08:50:15.882402+0000","last_unstale":"2024-09-19T08:51:51.824453+0000","last_undegraded":"2024-09-19T08:51:51.824453+0000","last_fullsized":"2024-09-19T08:51:51.824453+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:17.343385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'18","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:08.890564+0000","last_change":"2024-09-19T08:50:13.790982+0000","last_active":"2024-09-19T08:52:08.890564+0000","last_peered":"2024-09-19T08:52:08.890564+0000","last_clean":"2024-09-19T08:52:08.890564+0000","last_became_active":"2024-09-19T08:50:13.790644+0000","last_became_peered":"2024-09-19T08:50:13.790644+0000","last_unstale":"2024-09-19T08:52:08.890564+0000","last_undegraded":"2024-09-19T08:52:08.890564+0000","last_fullsized":"2024-09-19T08:52:08.890564+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:20:25.923021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827049+0000","last_change":"2024-09-19T08:50:15.887556+0000","last_active":"2024-09-19T08:51:51.827049+0000","last_peered":"2024-09-19T08:51:51.827049+0000","last_clean":"2024-09-19T08:51:51.827049+0000","last_became_active":"2024-09-19T08:50:15.887280+0000","last_became_peered":"2024-09-19T08:50:15.887280+0000","last_unstale":"2024-09-19T08:51:51.827049+0000","last_undegraded":"2024-09-19T08:51:51.827049+0000","last_fullsized":"2024-09-19T08:51:51.827049+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:51.226527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.541910+0000","last_change":"2024-09-19T08:50:14.012150+0000","last_active":"2024-09-19T08:51:23.541910+0000","last_peered":"2024-09-19T08:51:23.541910+0000","last_clean":"2024-09-19T08:51:23.541910+0000","last_became_active":"2024-09-19T08:50:14.011799+0000","last_became_peered":"2024-09-19T08:50:14.011799+0000","last_unstale":"2024-09-19T08:51:23.541910+0000","last_undegraded":"2024-09-19T08:51:23.541910+0000","last_fullsized":"2024-09-19T08:51:23.541910+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:37.310539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837525+0000","last_change":"2024-09-19T08:50:15.889577+0000","last_active":"2024-09-19T08:51:51.837525+0000","last_peered":"2024-09-19T08:51:51.837525+0000","last_clean":"2024-09-19T08:51:51.837525+0000","last_became_active":"2024-09-19T08:50:15.889244+0000","last_became_peered":"2024-09-19T08:50:15.889244+0000","last_unstale":"2024-09-19T08:51:51.837525+0000","last_undegraded":"2024-09-19T08:51:51.837525+0000","last_fullsized":"2024-09-19T08:51:51.837525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:54.382221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.548456+0000","last_change":"2024-09-19T08:50:14.293845+0000","last_active":"2024-09-19T08:51:23.548456+0000","last_peered":"2024-09-19T08:51:23.548456+0000","last_clean":"2024-09-19T08:51:23.548456+0000","last_became_active":"2024-09-19T08:50:14.293585+0000","last_became_peered":"2024-09-19T08:50:14.293585+0000","last_unstale":"2024-09-19T08:51:23.548456+0000","last_undegraded":"2024-09-19T08:51:23.548456+0000","last_fullsized":"2024-09-19T08:51:23.548456+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:02.886475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.794304+0000","last_change":"2024-09-19T08:50:15.888591+0000","last_active":"2024-09-19T08:51:51.794304+0000","last_peered":"2024-09-19T08:51:51.794304+0000","last_clean":"2024-09-19T08:51:51.794304+0000","last_became_active":"2024-09-19T08:50:15.888270+0000","last_became_peered":"2024-09-19T08:50:15.888270+0000","last_unstale":"2024-09-19T08:51:51.794304+0000","last_undegraded":"2024-09-19T08:51:51.794304+0000","last_fullsized":"2024-09-19T08:51:51.794304+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:08.644828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.547015+0000","last_change":"2024-09-19T08:50:13.794081+0000","last_active":"2024-09-19T08:51:23.547015+0000","last_peered":"2024-09-19T08:51:23.547015+0000","last_clean":"2024-09-19T08:51:23.547015+0000","last_became_active":"2024-09-19T08:50:13.793770+0000","last_became_peered":"2024-09-19T08:50:13.793770+0000","last_unstale":"2024-09-19T08:51:23.547015+0000","last_undegraded":"2024-09-19T08:51:23.547015+0000","last_fullsized":"2024-09-19T08:51:23.547015+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:43.053893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.835489+0000","last_change":"2024-09-19T08:50:15.885338+0000","last_active":"2024-09-19T08:51:51.835489+0000","last_peered":"2024-09-19T08:51:51.835489+0000","last_clean":"2024-09-19T08:51:51.835489+0000","last_became_active":"2024-09-19T08:50:15.884983+0000","last_became_peered":"2024-09-19T08:50:15.884983+0000","last_unstale":"2024-09-19T08:51:51.835489+0000","last_undegraded":"2024-09-19T08:51:51.835489+0000","last_fullsized":"2024-09-19T08:51:51.835489+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:05.228871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:25.776440+0000","last_change":"2024-09-19T08:51:23.562670+0000","last_active":"2024-09-19T08:51:25.776440+0000","last_peered":"2024-09-19T08:51:25.776440+0000","last_clean":"2024-09-19T08:51:25.776440+0000","last_became_active":"2024-09-19T08:51:23.548756+0000","last_became_peered":"2024-09-19T08:51:23.548756+0000","last_unstale":"2024-09-19T08:51:25.776440+0000","last_undegraded":"2024-09-19T08:51:25.776440+0000","last_fullsized":"2024-09-19T08:51:25.776440+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:36.666216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829262+0000","last_change":"2024-09-19T08:50:15.886587+0000","last_active":"2024-09-19T08:51:51.829262+0000","last_peered":"2024-09-19T08:51:51.829262+0000","last_clean":"2024-09-19T08:51:51.829262+0000","last_became_active":"2024-09-19T08:50:15.886231+0000","last_became_peered":"2024-09-19T08:50:15.886231+0000","last_unstale":"2024-09-19T08:51:51.829262+0000","last_undegraded":"2024-09-19T08:51:51.829262+0000","last_fullsized":"2024-09-19T08:51:51.829262+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:11.965382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.546412+0000","last_change":"2024-09-19T08:50:13.796681+0000","last_active":"2024-09-19T08:51:23.546412+0000","last_peered":"2024-09-19T08:51:23.546412+0000","last_clean":"2024-09-19T08:51:23.546412+0000","last_became_active":"2024-09-19T08:50:13.796338+0000","last_became_peered":"2024-09-19T08:50:13.796338+0000","last_unstale":"2024-09-19T08:51:23.546412+0000","last_undegraded":"2024-09-19T08:51:23.546412+0000","last_fullsized":"2024-09-19T08:51:23.546412+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:32.588800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.836422+0000","last_change":"2024-09-19T08:50:15.889667+0000","last_active":"2024-09-19T08:51:51.836422+0000","last_peered":"2024-09-19T08:51:51.836422+0000","last_clean":"2024-09-19T08:51:51.836422+0000","last_became_active":"2024-09-19T08:50:15.889341+0000","last_became_peered":"2024-09-19T08:50:15.889341+0000","last_unstale":"2024-09-19T08:51:51.836422+0000","last_undegraded":"2024-09-19T08:51:51.836422+0000","last_fullsized":"2024-09-19T08:51:51.836422+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:13.255483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.836199+0000","last_change":"2024-09-19T08:50:15.887337+0000","last_active":"2024-09-19T08:51:51.836199+0000","last_peered":"2024-09-19T08:51:51.836199+0000","last_clean":"2024-09-19T08:51:51.836199+0000","last_became_active":"2024-09-19T08:50:15.887001+0000","last_became_peered":"2024-09-19T08:50:15.887001+0000","last_unstale":"2024-09-19T08:51:51.836199+0000","last_undegraded":"2024-09-19T08:51:51.836199+0000","last_fullsized":"2024-09-19T08:51:51.836199+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:43.544863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.547132+0000","last_change":"2024-09-19T08:50:13.799321+0000","last_active":"2024-09-19T08:51:23.547132+0000","last_peered":"2024-09-19T08:51:23.547132+0000","last_clean":"2024-09-19T08:51:23.547132+0000","last_became_active":"2024-09-19T08:50:13.798837+0000","last_became_peered":"2024-09-19T08:50:13.798837+0000","last_unstale":"2024-09-19T08:51:23.547132+0000","last_undegraded":"2024-09-19T08:51:23.547132+0000","last_fullsized":"2024-09-19T08:51:23.547132+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:35.753093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837309+0000","last_change":"2024-09-19T08:50:15.892074+0000","last_active":"2024-09-19T08:51:51.837309+0000","last_peered":"2024-09-19T08:51:51.837309+0000","last_clean":"2024-09-19T08:51:51.837309+0000","last_became_active":"2024-09-19T08:50:15.891722+0000","last_became_peered":"2024-09-19T08:50:15.891722+0000","last_unstale":"2024-09-19T08:51:51.837309+0000","last_undegraded":"2024-09-19T08:51:51.837309+0000","last_fullsized":"2024-09-19T08:51:51.837309+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:39.913080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.546815+0000","last_change":"2024-09-19T08:50:13.795577+0000","last_active":"2024-09-19T08:51:23.546815+0000","last_peered":"2024-09-19T08:51:23.546815+0000","last_clean":"2024-09-19T08:51:23.546815+0000","last_became_active":"2024-09-19T08:50:13.795254+0000","last_became_peered":"2024-09-19T08:50:13.795254+0000","last_unstale":"2024-09-19T08:51:23.546815+0000","last_undegraded":"2024-09-19T08:51:23.546815+0000","last_fullsized":"2024-09-19T08:51:23.546815+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:13.263447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.836430+0000","last_change":"2024-09-19T08:50:15.884584+0000","last_active":"2024-09-19T08:51:51.836430+0000","last_peered":"2024-09-19T08:51:51.836430+0000","last_clean":"2024-09-19T08:51:51.836430+0000","last_became_active":"2024-09-19T08:50:15.884244+0000","last_became_peered":"2024-09-19T08:50:15.884244+0000","last_unstale":"2024-09-19T08:51:51.836430+0000","last_undegraded":"2024-09-19T08:51:51.836430+0000","last_fullsized":"2024-09-19T08:51:51.836430+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:58.835351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.547268+0000","last_change":"2024-09-19T08:50:14.294210+0000","last_active":"2024-09-19T08:51:23.547268+0000","last_peered":"2024-09-19T08:51:23.547268+0000","last_clean":"2024-09-19T08:51:23.547268+0000","last_became_active":"2024-09-19T08:50:14.293850+0000","last_became_peered":"2024-09-19T08:50:14.293850+0000","last_unstale":"2024-09-19T08:51:23.547268+0000","last_undegraded":"2024-09-19T08:51:23.547268+0000","last_fullsized":"2024-09-19T08:51:23.547268+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:42:44.340766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829360+0000","last_change":"2024-09-19T08:50:15.892934+0000","last_active":"2024-09-19T08:51:51.829360+0000","last_peered":"2024-09-19T08:51:51.829360+0000","last_clean":"2024-09-19T08:51:51.829360+0000","last_became_active":"2024-09-19T08:50:15.892309+0000","last_became_peered":"2024-09-19T08:50:15.892309+0000","last_unstale":"2024-09-19T08:51:51.829360+0000","last_undegraded":"2024-09-19T08:51:51.829360+0000","last_fullsized":"2024-09-19T08:51:51.829360+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:40.158724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'14","reported_seq":169,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:18.623331+0000","last_change":"2024-09-19T08:51:23.559819+0000","last_active":"2024-09-19T08:52:18.623331+0000","last_peered":"2024-09-19T08:52:18.623331+0000","last_clean":"2024-09-19T08:52:18.623331+0000","last_became_active":"2024-09-19T08:51:23.548481+0000","last_became_peered":"2024-09-19T08:51:23.548481+0000","last_unstale":"2024-09-19T08:52:18.623331+0000","last_undegraded":"2024-09-19T08:52:18.623331+0000","last_fullsized":"2024-09-19T08:52:18.623331+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:53.232542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":107,"num_read_kb":107,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":78169,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1162,"num_read_kb":662,"num_write":269,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":234507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":231,"ondisk_log_size":231,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":247642,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579943,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":434558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808875,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1060864,"data_stored":1094808,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972401,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":925696,"data_stored":433399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201334,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":433660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430267,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":1027136,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593793,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":433392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822725,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":983040,"data_stored":1025858,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953544,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":434095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182479,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":432707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411413,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":504251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":503497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":434872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34206,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34206,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":71337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":72091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":72163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:52:23.016 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T08:52:23.017 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T08:52:23.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:22 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:52:23.927 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:24.051 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:23 smithi019 ceph-mon[30976]: pgmap v342: 97 pgs: 97 active+clean; 653 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2024-09-19T08:52:24.051 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:23 smithi019 ceph-mon[30976]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:52:24.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:23 smithi155 ceph-mon[34921]: pgmap v342: 97 pgs: 97 active+clean; 653 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2024-09-19T08:52:24.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:23 smithi155 ceph-mon[34921]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:52:24.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:23 smithi203 ceph-mon[35450]: pgmap v342: 97 pgs: 97 active+clean; 653 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.8 KiB/s wr, 12 op/s 2024-09-19T08:52:24.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:23 smithi203 ceph-mon[35450]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:52:24.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.399+0000 7f8924557640 1 -- 172.21.15.19:0/3015330340 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f891c100e20 msgr2=0x7f891c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:24.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.399+0000 7f8924557640 1 --2- 172.21.15.19:0/3015330340 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f891c100e20 0x7f891c101200 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8918009900 tx=0x7f891802a480 comp rx=0 tx=0).stop 2024-09-19T08:52:24.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.399+0000 7f8924557640 1 -- 172.21.15.19:0/3015330340 shutdown_connections 2024-09-19T08:52:24.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.399+0000 7f8924557640 1 --2- 172.21.15.19:0/3015330340 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f891c102ef0 0x7f891c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.399+0000 7f8924557640 1 --2- 172.21.15.19:0/3015330340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f891c102570 0x7f891c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.399+0000 7f8924557640 1 --2- 172.21.15.19:0/3015330340 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f891c100e20 0x7f891c101200 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.399+0000 7f8924557640 1 -- 172.21.15.19:0/3015330340 >> 172.21.15.19:0/3015330340 conn(0x7f891c0fc7d0 msgr2=0x7f891c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:24.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.399+0000 7f8924557640 1 -- 172.21.15.19:0/3015330340 shutdown_connections 2024-09-19T08:52:24.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.399+0000 7f8924557640 1 -- 172.21.15.19:0/3015330340 wait complete. 2024-09-19T08:52:24.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.400+0000 7f8924557640 1 Processor -- start 2024-09-19T08:52:24.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.400+0000 7f8924557640 1 -- start start 2024-09-19T08:52:24.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.400+0000 7f8924557640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f891c100e20 0x7f891c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:24.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.400+0000 7f8924557640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f891c102570 0x7f891c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:24.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.400+0000 7f8924557640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f891c102ef0 0x7f891c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:24.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.400+0000 7f8924557640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f891c110f80 con 0x7f891c102ef0 2024-09-19T08:52:24.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.400+0000 7f8924557640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f891c110e00 con 0x7f891c102570 2024-09-19T08:52:24.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.400+0000 7f8924557640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f891c111100 con 0x7f891c100e20 2024-09-19T08:52:24.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.400+0000 7f8922af4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f891c102ef0 0x7f891c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:24.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.400+0000 7f89222f3640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f891c100e20 0x7f891c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:24.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.400+0000 7f8922af4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f891c102ef0 0x7f891c0fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51394/0 (socket says 172.21.15.19:51394) 2024-09-19T08:52:24.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.400+0000 7f8922af4640 1 -- 172.21.15.19:0/3369291134 learned_addr learned my addr 172.21.15.19:0/3369291134 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:24.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.400+0000 7f8921af2640 1 --2- 172.21.15.19:0/3369291134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f891c102570 0x7f891c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:24.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.401+0000 7f89222f3640 1 -- 172.21.15.19:0/3369291134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f891c102570 msgr2=0x7f891c0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:24.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.401+0000 7f89222f3640 1 --2- 172.21.15.19:0/3369291134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f891c102570 0x7f891c0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.401+0000 7f89222f3640 1 -- 172.21.15.19:0/3369291134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f891c102ef0 msgr2=0x7f891c0fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:24.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.401+0000 7f89222f3640 1 --2- 172.21.15.19:0/3369291134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f891c102ef0 0x7f891c0fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.401+0000 7f89222f3640 1 -- 172.21.15.19:0/3369291134 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f891c1a69c0 con 0x7f891c100e20 2024-09-19T08:52:24.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.401+0000 7f8922af4640 1 --2- 172.21.15.19:0/3369291134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f891c102ef0 0x7f891c0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:52:24.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.401+0000 7f89222f3640 1 --2- 172.21.15.19:0/3369291134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f891c100e20 0x7f891c0fcc80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8918005940 tx=0x7f8918003c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:24.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.401+0000 7f89137fe640 1 -- 172.21.15.19:0/3369291134 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891803f070 con 0x7f891c100e20 2024-09-19T08:52:24.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.401+0000 7f8924557640 1 -- 172.21.15.19:0/3369291134 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f891c1a6c50 con 0x7f891c100e20 2024-09-19T08:52:24.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.401+0000 7f89137fe640 1 -- 172.21.15.19:0/3369291134 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8918031c30 con 0x7f891c100e20 2024-09-19T08:52:24.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.401+0000 7f89137fe640 1 -- 172.21.15.19:0/3369291134 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8918035030 con 0x7f891c100e20 2024-09-19T08:52:24.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.401+0000 7f8924557640 1 -- 172.21.15.19:0/3369291134 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f891c1a7180 con 0x7f891c100e20 2024-09-19T08:52:24.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.402+0000 7f8924557640 1 -- 172.21.15.19:0/3369291134 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f891c101200 con 0x7f891c100e20 2024-09-19T08:52:24.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.404+0000 7f89137fe640 1 -- 172.21.15.19:0/3369291134 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f8918042070 con 0x7f891c100e20 2024-09-19T08:52:24.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.404+0000 7f89137fe640 1 --2- 172.21.15.19:0/3369291134 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f89080a32d0 0x7f89080a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:24.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.404+0000 7f8921af2640 1 --2- 172.21.15.19:0/3369291134 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f89080a32d0 0x7f89080a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:24.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.404+0000 7f89137fe640 1 -- 172.21.15.19:0/3369291134 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f89180f0a00 con 0x7f891c100e20 2024-09-19T08:52:24.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.405+0000 7f8921af2640 1 --2- 172.21.15.19:0/3369291134 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f89080a32d0 0x7f89080a5790 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f891c0fe710 tx=0x7f890c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:24.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.407+0000 7f89137fe640 1 -- 172.21.15.19:0/3369291134 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f89180bcf80 con 0x7f891c100e20 2024-09-19T08:52:24.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.591+0000 7f8924557640 1 -- 172.21.15.19:0/3369291134 --> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f891c10a110 con 0x7f89080a32d0 2024-09-19T08:52:24.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.599+0000 7f89137fe640 1 -- 172.21.15.19:0/3369291134 <== mgr.14150 v2:172.21.15.19:6800/1181234346 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259040 (secure 0 0 0) 0x7f890c00bc40 con 0x7f89080a32d0 2024-09-19T08:52:24.602 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:52:24.603 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-19T08:52:24.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.603+0000 7f8924557640 1 -- 172.21.15.19:0/3369291134 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f89080a32d0 msgr2=0x7f89080a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:24.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.603+0000 7f8924557640 1 --2- 172.21.15.19:0/3369291134 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f89080a32d0 0x7f89080a5790 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f891c0fe710 tx=0x7f890c00b410 comp rx=0 tx=0).stop 2024-09-19T08:52:24.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.603+0000 7f8924557640 1 -- 172.21.15.19:0/3369291134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f891c100e20 msgr2=0x7f891c0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:24.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.603+0000 7f8924557640 1 --2- 172.21.15.19:0/3369291134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f891c100e20 0x7f891c0fcc80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8918005940 tx=0x7f8918003c10 comp rx=0 tx=0).stop 2024-09-19T08:52:24.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.603+0000 7f8924557640 1 -- 172.21.15.19:0/3369291134 shutdown_connections 2024-09-19T08:52:24.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.603+0000 7f8924557640 1 --2- 172.21.15.19:0/3369291134 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f89080a32d0 0x7f89080a5790 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.603+0000 7f8924557640 1 --2- 172.21.15.19:0/3369291134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f891c102ef0 0x7f891c0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.603+0000 7f8924557640 1 --2- 172.21.15.19:0/3369291134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f891c102570 0x7f891c0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.603+0000 7f8924557640 1 --2- 172.21.15.19:0/3369291134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f891c100e20 0x7f891c0fcc80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:24.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.603+0000 7f8924557640 1 -- 172.21.15.19:0/3369291134 >> 172.21.15.19:0/3369291134 conn(0x7f891c0fc7d0 msgr2=0x7f891c06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:24.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.603+0000 7f8924557640 1 -- 172.21.15.19:0/3369291134 shutdown_connections 2024-09-19T08:52:24.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:24.603+0000 7f8924557640 1 -- 172.21.15.19:0/3369291134 wait complete. 2024-09-19T08:52:25.229 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:25 smithi019 ceph-mon[30976]: pgmap v343: 97 pgs: 97 active+clean; 653 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-09-19T08:52:25.229 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:25 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:52:25.229 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:25 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:52:25.229 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:25 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:52:25.229 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:25 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:52:25.230 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:25 smithi019 ceph-mon[30976]: from='client.24991 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:52:25.262 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":343,"stamp":"2024-09-19T08:52:23.878073+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":668771,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1320,"num_read_kb":794,"num_write":452,"num_write_kb":3103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":1181525,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":870,"ondisk_log_size":870,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":356200,"kb_used_data":11112,"kb_used_omap":18,"kb_used_meta":344877,"kb_avail":1124585624,"statfs":{"total":1151940427776,"available":1151575678976,"internally_reserved":0,"allocated":11378688,"data_stored":7192233,"data_compressed":107538,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19142,"internal_metadata":353154362},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":10125,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":86,"num_write":14,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003241"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837651+0000","last_change":"2024-09-19T08:50:15.893270+0000","last_active":"2024-09-19T08:51:51.837651+0000","last_peered":"2024-09-19T08:51:51.837651+0000","last_clean":"2024-09-19T08:51:51.837651+0000","last_became_active":"2024-09-19T08:50:15.892020+0000","last_became_peered":"2024-09-19T08:50:15.892020+0000","last_unstale":"2024-09-19T08:51:51.837651+0000","last_undegraded":"2024-09-19T08:51:51.837651+0000","last_fullsized":"2024-09-19T08:51:51.837651+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:40.846708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.835403+0000","last_change":"2024-09-19T08:50:15.889331+0000","last_active":"2024-09-19T08:51:51.835403+0000","last_peered":"2024-09-19T08:51:51.835403+0000","last_clean":"2024-09-19T08:51:51.835403+0000","last_became_active":"2024-09-19T08:50:15.887082+0000","last_became_peered":"2024-09-19T08:50:15.887082+0000","last_unstale":"2024-09-19T08:51:51.835403+0000","last_undegraded":"2024-09-19T08:51:51.835403+0000","last_fullsized":"2024-09-19T08:51:51.835403+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:46.934172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.836760+0000","last_change":"2024-09-19T08:50:15.891714+0000","last_active":"2024-09-19T08:51:51.836760+0000","last_peered":"2024-09-19T08:51:51.836760+0000","last_clean":"2024-09-19T08:51:51.836760+0000","last_became_active":"2024-09-19T08:50:15.891380+0000","last_became_peered":"2024-09-19T08:50:15.891380+0000","last_unstale":"2024-09-19T08:51:51.836760+0000","last_undegraded":"2024-09-19T08:51:51.836760+0000","last_fullsized":"2024-09-19T08:51:51.836760+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:02.203252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.820814+0000","last_change":"2024-09-19T08:50:15.896157+0000","last_active":"2024-09-19T08:51:51.820814+0000","last_peered":"2024-09-19T08:51:51.820814+0000","last_clean":"2024-09-19T08:51:51.820814+0000","last_became_active":"2024-09-19T08:50:15.895772+0000","last_became_peered":"2024-09-19T08:50:15.895772+0000","last_unstale":"2024-09-19T08:51:51.820814+0000","last_undegraded":"2024-09-19T08:51:51.820814+0000","last_fullsized":"2024-09-19T08:51:51.820814+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:12.915745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.819392+0000","last_change":"2024-09-19T08:50:15.886600+0000","last_active":"2024-09-19T08:51:51.819392+0000","last_peered":"2024-09-19T08:51:51.819392+0000","last_clean":"2024-09-19T08:51:51.819392+0000","last_became_active":"2024-09-19T08:50:15.886270+0000","last_became_peered":"2024-09-19T08:50:15.886270+0000","last_unstale":"2024-09-19T08:51:51.819392+0000","last_undegraded":"2024-09-19T08:51:51.819392+0000","last_fullsized":"2024-09-19T08:51:51.819392+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:18:53.779930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.826597+0000","last_change":"2024-09-19T08:50:15.889475+0000","last_active":"2024-09-19T08:51:51.826597+0000","last_peered":"2024-09-19T08:51:51.826597+0000","last_clean":"2024-09-19T08:51:51.826597+0000","last_became_active":"2024-09-19T08:50:15.889134+0000","last_became_peered":"2024-09-19T08:50:15.889134+0000","last_unstale":"2024-09-19T08:51:51.826597+0000","last_undegraded":"2024-09-19T08:51:51.826597+0000","last_fullsized":"2024-09-19T08:51:51.826597+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:53.977662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829681+0000","last_change":"2024-09-19T08:50:15.897163+0000","last_active":"2024-09-19T08:51:51.829681+0000","last_peered":"2024-09-19T08:51:51.829681+0000","last_clean":"2024-09-19T08:51:51.829681+0000","last_became_active":"2024-09-19T08:50:15.895161+0000","last_became_peered":"2024-09-19T08:50:15.895161+0000","last_unstale":"2024-09-19T08:51:51.829681+0000","last_undegraded":"2024-09-19T08:51:51.829681+0000","last_fullsized":"2024-09-19T08:51:51.829681+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:29:32.432691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829477+0000","last_change":"2024-09-19T08:50:15.891197+0000","last_active":"2024-09-19T08:51:51.829477+0000","last_peered":"2024-09-19T08:51:51.829477+0000","last_clean":"2024-09-19T08:51:51.829477+0000","last_became_active":"2024-09-19T08:50:15.890880+0000","last_became_peered":"2024-09-19T08:50:15.890880+0000","last_unstale":"2024-09-19T08:51:51.829477+0000","last_undegraded":"2024-09-19T08:51:51.829477+0000","last_fullsized":"2024-09-19T08:51:51.829477+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:06:41.100341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.836501+0000","last_change":"2024-09-19T08:50:15.896043+0000","last_active":"2024-09-19T08:51:51.836501+0000","last_peered":"2024-09-19T08:51:51.836501+0000","last_clean":"2024-09-19T08:51:51.836501+0000","last_became_active":"2024-09-19T08:50:15.895498+0000","last_became_peered":"2024-09-19T08:50:15.895498+0000","last_unstale":"2024-09-19T08:51:51.836501+0000","last_undegraded":"2024-09-19T08:51:51.836501+0000","last_fullsized":"2024-09-19T08:51:51.836501+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:57.956427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.830052+0000","last_change":"2024-09-19T08:50:15.887658+0000","last_active":"2024-09-19T08:51:51.830052+0000","last_peered":"2024-09-19T08:51:51.830052+0000","last_clean":"2024-09-19T08:51:51.830052+0000","last_became_active":"2024-09-19T08:50:15.887199+0000","last_became_peered":"2024-09-19T08:50:15.887199+0000","last_unstale":"2024-09-19T08:51:51.830052+0000","last_undegraded":"2024-09-19T08:51:51.830052+0000","last_fullsized":"2024-09-19T08:51:51.830052+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:39.947735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.834776+0000","last_change":"2024-09-19T08:50:15.894865+0000","last_active":"2024-09-19T08:51:51.834776+0000","last_peered":"2024-09-19T08:51:51.834776+0000","last_clean":"2024-09-19T08:51:51.834776+0000","last_became_active":"2024-09-19T08:50:15.894475+0000","last_became_peered":"2024-09-19T08:50:15.894475+0000","last_unstale":"2024-09-19T08:51:51.834776+0000","last_undegraded":"2024-09-19T08:51:51.834776+0000","last_fullsized":"2024-09-19T08:51:51.834776+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:43.235991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827890+0000","last_change":"2024-09-19T08:50:15.897209+0000","last_active":"2024-09-19T08:51:51.827890+0000","last_peered":"2024-09-19T08:51:51.827890+0000","last_clean":"2024-09-19T08:51:51.827890+0000","last_became_active":"2024-09-19T08:50:15.896866+0000","last_became_peered":"2024-09-19T08:50:15.896866+0000","last_unstale":"2024-09-19T08:51:51.827890+0000","last_undegraded":"2024-09-19T08:51:51.827890+0000","last_fullsized":"2024-09-19T08:51:51.827890+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:09:23.036534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.825376+0000","last_change":"2024-09-19T08:50:15.890076+0000","last_active":"2024-09-19T08:51:51.825376+0000","last_peered":"2024-09-19T08:51:51.825376+0000","last_clean":"2024-09-19T08:51:51.825376+0000","last_became_active":"2024-09-19T08:50:15.889735+0000","last_became_peered":"2024-09-19T08:50:15.889735+0000","last_unstale":"2024-09-19T08:51:51.825376+0000","last_undegraded":"2024-09-19T08:51:51.825376+0000","last_fullsized":"2024-09-19T08:51:51.825376+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:25.602757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.834241+0000","last_change":"2024-09-19T08:50:15.886739+0000","last_active":"2024-09-19T08:51:51.834241+0000","last_peered":"2024-09-19T08:51:51.834241+0000","last_clean":"2024-09-19T08:51:51.834241+0000","last_became_active":"2024-09-19T08:50:15.886313+0000","last_became_peered":"2024-09-19T08:50:15.886313+0000","last_unstale":"2024-09-19T08:51:51.834241+0000","last_undegraded":"2024-09-19T08:51:51.834241+0000","last_fullsized":"2024-09-19T08:51:51.834241+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:33:03.244674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837276+0000","last_change":"2024-09-19T08:50:15.898519+0000","last_active":"2024-09-19T08:51:51.837276+0000","last_peered":"2024-09-19T08:51:51.837276+0000","last_clean":"2024-09-19T08:51:51.837276+0000","last_became_active":"2024-09-19T08:50:15.898249+0000","last_became_peered":"2024-09-19T08:50:15.898249+0000","last_unstale":"2024-09-19T08:51:51.837276+0000","last_undegraded":"2024-09-19T08:51:51.837276+0000","last_fullsized":"2024-09-19T08:51:51.837276+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:43:32.318895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837455+0000","last_change":"2024-09-19T08:50:15.890324+0000","last_active":"2024-09-19T08:51:51.837455+0000","last_peered":"2024-09-19T08:51:51.837455+0000","last_clean":"2024-09-19T08:51:51.837455+0000","last_became_active":"2024-09-19T08:50:15.887345+0000","last_became_peered":"2024-09-19T08:50:15.887345+0000","last_unstale":"2024-09-19T08:51:51.837455+0000","last_undegraded":"2024-09-19T08:51:51.837455+0000","last_fullsized":"2024-09-19T08:51:51.837455+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:14:27.989128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837724+0000","last_change":"2024-09-19T08:50:15.896305+0000","last_active":"2024-09-19T08:51:51.837724+0000","last_peered":"2024-09-19T08:51:51.837724+0000","last_clean":"2024-09-19T08:51:51.837724+0000","last_became_active":"2024-09-19T08:50:15.895832+0000","last_became_peered":"2024-09-19T08:50:15.895832+0000","last_unstale":"2024-09-19T08:51:51.837724+0000","last_undegraded":"2024-09-19T08:51:51.837724+0000","last_fullsized":"2024-09-19T08:51:51.837724+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:23:37.098237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.821237+0000","last_change":"2024-09-19T08:50:15.887251+0000","last_active":"2024-09-19T08:51:51.821237+0000","last_peered":"2024-09-19T08:51:51.821237+0000","last_clean":"2024-09-19T08:51:51.821237+0000","last_became_active":"2024-09-19T08:50:15.886936+0000","last_became_peered":"2024-09-19T08:50:15.886936+0000","last_unstale":"2024-09-19T08:51:51.821237+0000","last_undegraded":"2024-09-19T08:51:51.821237+0000","last_fullsized":"2024-09-19T08:51:51.821237+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:38:08.828246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827071+0000","last_change":"2024-09-19T08:50:15.884813+0000","last_active":"2024-09-19T08:51:51.827071+0000","last_peered":"2024-09-19T08:51:51.827071+0000","last_clean":"2024-09-19T08:51:51.827071+0000","last_became_active":"2024-09-19T08:50:15.883445+0000","last_became_peered":"2024-09-19T08:50:15.883445+0000","last_unstale":"2024-09-19T08:51:51.827071+0000","last_undegraded":"2024-09-19T08:51:51.827071+0000","last_fullsized":"2024-09-19T08:51:51.827071+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:39.733501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.821368+0000","last_change":"2024-09-19T08:50:15.887644+0000","last_active":"2024-09-19T08:51:51.821368+0000","last_peered":"2024-09-19T08:51:51.821368+0000","last_clean":"2024-09-19T08:51:51.821368+0000","last_became_active":"2024-09-19T08:50:15.887224+0000","last_became_peered":"2024-09-19T08:50:15.887224+0000","last_unstale":"2024-09-19T08:51:51.821368+0000","last_undegraded":"2024-09-19T08:51:51.821368+0000","last_fullsized":"2024-09-19T08:51:51.821368+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:35.883690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.835961+0000","last_change":"2024-09-19T08:50:15.886678+0000","last_active":"2024-09-19T08:51:51.835961+0000","last_peered":"2024-09-19T08:51:51.835961+0000","last_clean":"2024-09-19T08:51:51.835961+0000","last_became_active":"2024-09-19T08:50:15.886360+0000","last_became_peered":"2024-09-19T08:50:15.886360+0000","last_unstale":"2024-09-19T08:51:51.835961+0000","last_undegraded":"2024-09-19T08:51:51.835961+0000","last_fullsized":"2024-09-19T08:51:51.835961+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:00:51.515211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.832052+0000","last_change":"2024-09-19T08:50:15.887607+0000","last_active":"2024-09-19T08:51:51.832052+0000","last_peered":"2024-09-19T08:51:51.832052+0000","last_clean":"2024-09-19T08:51:51.832052+0000","last_became_active":"2024-09-19T08:50:15.887266+0000","last_became_peered":"2024-09-19T08:50:15.887266+0000","last_unstale":"2024-09-19T08:51:51.832052+0000","last_undegraded":"2024-09-19T08:51:51.832052+0000","last_fullsized":"2024-09-19T08:51:51.832052+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:44:57.404160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829136+0000","last_change":"2024-09-19T08:50:15.882651+0000","last_active":"2024-09-19T08:51:51.829136+0000","last_peered":"2024-09-19T08:51:51.829136+0000","last_clean":"2024-09-19T08:51:51.829136+0000","last_became_active":"2024-09-19T08:50:15.882298+0000","last_became_peered":"2024-09-19T08:50:15.882298+0000","last_unstale":"2024-09-19T08:51:51.829136+0000","last_undegraded":"2024-09-19T08:51:51.829136+0000","last_fullsized":"2024-09-19T08:51:51.829136+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:06:16.028013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829040+0000","last_change":"2024-09-19T08:50:15.880407+0000","last_active":"2024-09-19T08:51:51.829040+0000","last_peered":"2024-09-19T08:51:51.829040+0000","last_clean":"2024-09-19T08:51:51.829040+0000","last_became_active":"2024-09-19T08:50:15.880026+0000","last_became_peered":"2024-09-19T08:50:15.880026+0000","last_unstale":"2024-09-19T08:51:51.829040+0000","last_undegraded":"2024-09-19T08:51:51.829040+0000","last_fullsized":"2024-09-19T08:51:51.829040+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:52:16.600913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.828745+0000","last_change":"2024-09-19T08:50:15.883573+0000","last_active":"2024-09-19T08:51:51.828745+0000","last_peered":"2024-09-19T08:51:51.828745+0000","last_clean":"2024-09-19T08:51:51.828745+0000","last_became_active":"2024-09-19T08:50:15.883258+0000","last_became_peered":"2024-09-19T08:50:15.883258+0000","last_unstale":"2024-09-19T08:51:51.828745+0000","last_undegraded":"2024-09-19T08:51:51.828745+0000","last_fullsized":"2024-09-19T08:51:51.828745+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:05:33.026579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827776+0000","last_change":"2024-09-19T08:50:15.889519+0000","last_active":"2024-09-19T08:51:51.827776+0000","last_peered":"2024-09-19T08:51:51.827776+0000","last_clean":"2024-09-19T08:51:51.827776+0000","last_became_active":"2024-09-19T08:50:15.889183+0000","last_became_peered":"2024-09-19T08:50:15.889183+0000","last_unstale":"2024-09-19T08:51:51.827776+0000","last_undegraded":"2024-09-19T08:51:51.827776+0000","last_fullsized":"2024-09-19T08:51:51.827776+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:06:06.725662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.821674+0000","last_change":"2024-09-19T08:50:15.894483+0000","last_active":"2024-09-19T08:51:51.821674+0000","last_peered":"2024-09-19T08:51:51.821674+0000","last_clean":"2024-09-19T08:51:51.821674+0000","last_became_active":"2024-09-19T08:50:15.893760+0000","last_became_peered":"2024-09-19T08:50:15.893760+0000","last_unstale":"2024-09-19T08:51:51.821674+0000","last_undegraded":"2024-09-19T08:51:51.821674+0000","last_fullsized":"2024-09-19T08:51:51.821674+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:23.686592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.835380+0000","last_change":"2024-09-19T08:50:15.882393+0000","last_active":"2024-09-19T08:51:51.835380+0000","last_peered":"2024-09-19T08:51:51.835380+0000","last_clean":"2024-09-19T08:51:51.835380+0000","last_became_active":"2024-09-19T08:50:15.882040+0000","last_became_peered":"2024-09-19T08:50:15.882040+0000","last_unstale":"2024-09-19T08:51:51.835380+0000","last_undegraded":"2024-09-19T08:51:51.835380+0000","last_fullsized":"2024-09-19T08:51:51.835380+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:16:22.430017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837549+0000","last_change":"2024-09-19T08:50:15.890919+0000","last_active":"2024-09-19T08:51:51.837549+0000","last_peered":"2024-09-19T08:51:51.837549+0000","last_clean":"2024-09-19T08:51:51.837549+0000","last_became_active":"2024-09-19T08:50:15.890256+0000","last_became_peered":"2024-09-19T08:50:15.890256+0000","last_unstale":"2024-09-19T08:51:51.837549+0000","last_undegraded":"2024-09-19T08:51:51.837549+0000","last_fullsized":"2024-09-19T08:51:51.837549+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:48.404890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.834164+0000","last_change":"2024-09-19T08:50:15.888139+0000","last_active":"2024-09-19T08:51:51.834164+0000","last_peered":"2024-09-19T08:51:51.834164+0000","last_clean":"2024-09-19T08:51:51.834164+0000","last_became_active":"2024-09-19T08:50:15.886471+0000","last_became_peered":"2024-09-19T08:50:15.886471+0000","last_unstale":"2024-09-19T08:51:51.834164+0000","last_undegraded":"2024-09-19T08:51:51.834164+0000","last_fullsized":"2024-09-19T08:51:51.834164+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:20.545473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.822886+0000","last_change":"2024-09-19T08:50:15.891354+0000","last_active":"2024-09-19T08:51:51.822886+0000","last_peered":"2024-09-19T08:51:51.822886+0000","last_clean":"2024-09-19T08:51:51.822886+0000","last_became_active":"2024-09-19T08:50:15.890900+0000","last_became_peered":"2024-09-19T08:50:15.890900+0000","last_unstale":"2024-09-19T08:51:51.822886+0000","last_undegraded":"2024-09-19T08:51:51.822886+0000","last_fullsized":"2024-09-19T08:51:51.822886+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:33.139637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.828772+0000","last_change":"2024-09-19T08:50:15.891501+0000","last_active":"2024-09-19T08:51:51.828772+0000","last_peered":"2024-09-19T08:51:51.828772+0000","last_clean":"2024-09-19T08:51:51.828772+0000","last_became_active":"2024-09-19T08:50:15.891183+0000","last_became_peered":"2024-09-19T08:50:15.891183+0000","last_unstale":"2024-09-19T08:51:51.828772+0000","last_undegraded":"2024-09-19T08:51:51.828772+0000","last_fullsized":"2024-09-19T08:51:51.828772+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:16.976705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.819783+0000","last_change":"2024-09-19T08:50:15.882048+0000","last_active":"2024-09-19T08:51:51.819783+0000","last_peered":"2024-09-19T08:51:51.819783+0000","last_clean":"2024-09-19T08:51:51.819783+0000","last_became_active":"2024-09-19T08:50:15.881156+0000","last_became_peered":"2024-09-19T08:50:15.881156+0000","last_unstale":"2024-09-19T08:51:51.819783+0000","last_undegraded":"2024-09-19T08:51:51.819783+0000","last_fullsized":"2024-09-19T08:51:51.819783+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:13:33.198852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"82'6","reported_seq":144,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:19.128854+0000","last_change":"2024-09-19T08:50:13.800156+0000","last_active":"2024-09-19T08:52:19.128854+0000","last_peered":"2024-09-19T08:52:19.128854+0000","last_clean":"2024-09-19T08:52:19.128854+0000","last_became_active":"2024-09-19T08:50:13.799779+0000","last_became_peered":"2024-09-19T08:50:13.799779+0000","last_unstale":"2024-09-19T08:52:19.128854+0000","last_undegraded":"2024-09-19T08:52:19.128854+0000","last_fullsized":"2024-09-19T08:52:19.128854+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:38.033049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1015,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.826996+0000","last_change":"2024-09-19T08:50:15.887252+0000","last_active":"2024-09-19T08:51:51.826996+0000","last_peered":"2024-09-19T08:51:51.826996+0000","last_clean":"2024-09-19T08:51:51.826996+0000","last_became_active":"2024-09-19T08:50:15.886899+0000","last_became_peered":"2024-09-19T08:50:15.886899+0000","last_unstale":"2024-09-19T08:51:51.826996+0000","last_undegraded":"2024-09-19T08:51:51.826996+0000","last_fullsized":"2024-09-19T08:51:51.826996+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:17:56.262387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":43,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.556154+0000","last_change":"2024-09-19T08:51:23.556154+0000","last_active":"2024-09-19T08:51:23.556154+0000","last_peered":"2024-09-19T08:51:23.556154+0000","last_clean":"2024-09-19T08:51:23.556154+0000","last_became_active":"2024-09-19T08:51:23.549418+0000","last_became_peered":"2024-09-19T08:51:23.549418+0000","last_unstale":"2024-09-19T08:51:23.556154+0000","last_undegraded":"2024-09-19T08:51:23.556154+0000","last_fullsized":"2024-09-19T08:51:23.556154+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:35.225465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.540195+0000","last_change":"2024-09-19T08:50:13.794010+0000","last_active":"2024-09-19T08:51:23.540195+0000","last_peered":"2024-09-19T08:51:23.540195+0000","last_clean":"2024-09-19T08:51:23.540195+0000","last_became_active":"2024-09-19T08:50:13.793677+0000","last_became_peered":"2024-09-19T08:50:13.793677+0000","last_unstale":"2024-09-19T08:51:23.540195+0000","last_undegraded":"2024-09-19T08:51:23.540195+0000","last_fullsized":"2024-09-19T08:51:23.540195+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:56.125702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827232+0000","last_change":"2024-09-19T08:50:15.881732+0000","last_active":"2024-09-19T08:51:51.827232+0000","last_peered":"2024-09-19T08:51:51.827232+0000","last_clean":"2024-09-19T08:51:51.827232+0000","last_became_active":"2024-09-19T08:50:15.881394+0000","last_became_peered":"2024-09-19T08:50:15.881394+0000","last_unstale":"2024-09-19T08:51:51.827232+0000","last_undegraded":"2024-09-19T08:51:51.827232+0000","last_fullsized":"2024-09-19T08:51:51.827232+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:03:55.549138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.544525+0000","last_change":"2024-09-19T08:50:13.797118+0000","last_active":"2024-09-19T08:51:23.544525+0000","last_peered":"2024-09-19T08:51:23.544525+0000","last_clean":"2024-09-19T08:51:23.544525+0000","last_became_active":"2024-09-19T08:50:13.796727+0000","last_became_peered":"2024-09-19T08:50:13.796727+0000","last_unstale":"2024-09-19T08:51:23.544525+0000","last_undegraded":"2024-09-19T08:51:23.544525+0000","last_fullsized":"2024-09-19T08:51:23.544525+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:49.310543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.824911+0000","last_change":"2024-09-19T08:50:15.888192+0000","last_active":"2024-09-19T08:51:51.824911+0000","last_peered":"2024-09-19T08:51:51.824911+0000","last_clean":"2024-09-19T08:51:51.824911+0000","last_became_active":"2024-09-19T08:50:15.887890+0000","last_became_peered":"2024-09-19T08:50:15.887890+0000","last_unstale":"2024-09-19T08:51:51.824911+0000","last_undegraded":"2024-09-19T08:51:51.824911+0000","last_fullsized":"2024-09-19T08:51:51.824911+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:24:48.951856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'6","reported_seq":260,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:23.103062+0000","last_change":"2024-09-19T08:50:13.797427+0000","last_active":"2024-09-19T08:52:23.103062+0000","last_peered":"2024-09-19T08:52:23.103062+0000","last_clean":"2024-09-19T08:52:23.103062+0000","last_became_active":"2024-09-19T08:50:13.797021+0000","last_became_peered":"2024-09-19T08:50:13.797021+0000","last_unstale":"2024-09-19T08:52:23.103062+0000","last_undegraded":"2024-09-19T08:52:23.103062+0000","last_fullsized":"2024-09-19T08:52:23.103062+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:34:14.530373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":232,"num_read_kb":232,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837299+0000","last_change":"2024-09-19T08:50:15.894619+0000","last_active":"2024-09-19T08:51:51.837299+0000","last_peered":"2024-09-19T08:51:51.837299+0000","last_clean":"2024-09-19T08:51:51.837299+0000","last_became_active":"2024-09-19T08:50:15.894258+0000","last_became_peered":"2024-09-19T08:50:15.894258+0000","last_unstale":"2024-09-19T08:51:51.837299+0000","last_undegraded":"2024-09-19T08:51:51.837299+0000","last_fullsized":"2024-09-19T08:51:51.837299+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:20:13.137314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":38,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.559196+0000","last_change":"2024-09-19T08:51:23.559196+0000","last_active":"2024-09-19T08:51:23.559196+0000","last_peered":"2024-09-19T08:51:23.559196+0000","last_clean":"2024-09-19T08:51:23.559196+0000","last_became_active":"2024-09-19T08:51:23.549412+0000","last_became_peered":"2024-09-19T08:51:23.549412+0000","last_unstale":"2024-09-19T08:51:23.559196+0000","last_undegraded":"2024-09-19T08:51:23.559196+0000","last_fullsized":"2024-09-19T08:51:23.559196+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:38.145697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,4],"acting":[7,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837760+0000","last_change":"2024-09-19T08:50:15.891121+0000","last_active":"2024-09-19T08:51:51.837760+0000","last_peered":"2024-09-19T08:51:51.837760+0000","last_clean":"2024-09-19T08:51:51.837760+0000","last_became_active":"2024-09-19T08:50:15.890810+0000","last_became_peered":"2024-09-19T08:50:15.890810+0000","last_unstale":"2024-09-19T08:51:51.837760+0000","last_undegraded":"2024-09-19T08:51:51.837760+0000","last_fullsized":"2024-09-19T08:51:51.837760+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:13.010282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.545394+0000","last_change":"2024-09-19T08:50:14.293953+0000","last_active":"2024-09-19T08:51:23.545394+0000","last_peered":"2024-09-19T08:51:23.545394+0000","last_clean":"2024-09-19T08:51:23.545394+0000","last_became_active":"2024-09-19T08:50:14.293546+0000","last_became_peered":"2024-09-19T08:50:14.293546+0000","last_unstale":"2024-09-19T08:51:23.545394+0000","last_undegraded":"2024-09-19T08:51:23.545394+0000","last_fullsized":"2024-09-19T08:51:23.545394+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:44:27.809243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.836318+0000","last_change":"2024-09-19T08:50:15.878300+0000","last_active":"2024-09-19T08:51:51.836318+0000","last_peered":"2024-09-19T08:51:51.836318+0000","last_clean":"2024-09-19T08:51:51.836318+0000","last_became_active":"2024-09-19T08:50:15.877938+0000","last_became_peered":"2024-09-19T08:50:15.877938+0000","last_unstale":"2024-09-19T08:51:51.836318+0000","last_undegraded":"2024-09-19T08:51:51.836318+0000","last_fullsized":"2024-09-19T08:51:51.836318+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:05.376708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'37","reported_seq":304,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:23.102903+0000","last_change":"2024-09-19T08:50:13.800696+0000","last_active":"2024-09-19T08:52:23.102903+0000","last_peered":"2024-09-19T08:52:23.102903+0000","last_clean":"2024-09-19T08:52:23.102903+0000","last_became_active":"2024-09-19T08:50:13.799385+0000","last_became_peered":"2024-09-19T08:50:13.799385+0000","last_unstale":"2024-09-19T08:52:23.102903+0000","last_undegraded":"2024-09-19T08:52:23.102903+0000","last_fullsized":"2024-09-19T08:52:23.102903+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:11:56.897309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69192,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":245,"num_read_kb":190,"num_write":39,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.820658+0000","last_change":"2024-09-19T08:50:15.891483+0000","last_active":"2024-09-19T08:51:51.820658+0000","last_peered":"2024-09-19T08:51:51.820658+0000","last_clean":"2024-09-19T08:51:51.820658+0000","last_became_active":"2024-09-19T08:50:15.891185+0000","last_became_peered":"2024-09-19T08:50:15.891185+0000","last_unstale":"2024-09-19T08:51:51.820658+0000","last_undegraded":"2024-09-19T08:51:51.820658+0000","last_fullsized":"2024-09-19T08:51:51.820658+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:14:26.599151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.548669+0000","last_change":"2024-09-19T08:50:13.795148+0000","last_active":"2024-09-19T08:51:23.548669+0000","last_peered":"2024-09-19T08:51:23.548669+0000","last_clean":"2024-09-19T08:51:23.548669+0000","last_became_active":"2024-09-19T08:50:13.794688+0000","last_became_peered":"2024-09-19T08:50:13.794688+0000","last_unstale":"2024-09-19T08:51:23.548669+0000","last_undegraded":"2024-09-19T08:51:23.548669+0000","last_fullsized":"2024-09-19T08:51:23.548669+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:01.366439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.832390+0000","last_change":"2024-09-19T08:50:15.886449+0000","last_active":"2024-09-19T08:51:51.832390+0000","last_peered":"2024-09-19T08:51:51.832390+0000","last_clean":"2024-09-19T08:51:51.832390+0000","last_became_active":"2024-09-19T08:50:15.886119+0000","last_became_peered":"2024-09-19T08:50:15.886119+0000","last_unstale":"2024-09-19T08:51:51.832390+0000","last_undegraded":"2024-09-19T08:51:51.832390+0000","last_fullsized":"2024-09-19T08:51:51.832390+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:35:22.916593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.544525+0000","last_change":"2024-09-19T08:50:13.799363+0000","last_active":"2024-09-19T08:51:23.544525+0000","last_peered":"2024-09-19T08:51:23.544525+0000","last_clean":"2024-09-19T08:51:23.544525+0000","last_became_active":"2024-09-19T08:50:13.799033+0000","last_became_peered":"2024-09-19T08:50:13.799033+0000","last_unstale":"2024-09-19T08:51:23.544525+0000","last_undegraded":"2024-09-19T08:51:23.544525+0000","last_fullsized":"2024-09-19T08:51:23.544525+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:56:57.753451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837083+0000","last_change":"2024-09-19T08:50:15.898902+0000","last_active":"2024-09-19T08:51:51.837083+0000","last_peered":"2024-09-19T08:51:51.837083+0000","last_clean":"2024-09-19T08:51:51.837083+0000","last_became_active":"2024-09-19T08:50:15.898417+0000","last_became_peered":"2024-09-19T08:50:15.898417+0000","last_unstale":"2024-09-19T08:51:51.837083+0000","last_undegraded":"2024-09-19T08:51:51.837083+0000","last_fullsized":"2024-09-19T08:51:51.837083+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:32:19.799301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'9","reported_seq":152,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:21.100008+0000","last_change":"2024-09-19T08:50:13.798477+0000","last_active":"2024-09-19T08:52:21.100008+0000","last_peered":"2024-09-19T08:52:21.100008+0000","last_clean":"2024-09-19T08:52:21.100008+0000","last_became_active":"2024-09-19T08:50:13.798136+0000","last_became_peered":"2024-09-19T08:50:13.798136+0000","last_unstale":"2024-09-19T08:52:21.100008+0000","last_undegraded":"2024-09-19T08:52:21.100008+0000","last_fullsized":"2024-09-19T08:52:21.100008+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:49:33.874285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1823,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":122,"num_read_kb":7,"num_write":9,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829630+0000","last_change":"2024-09-19T08:50:15.896414+0000","last_active":"2024-09-19T08:51:51.829630+0000","last_peered":"2024-09-19T08:51:51.829630+0000","last_clean":"2024-09-19T08:51:51.829630+0000","last_became_active":"2024-09-19T08:50:15.895530+0000","last_became_peered":"2024-09-19T08:50:15.895530+0000","last_unstale":"2024-09-19T08:51:51.829630+0000","last_undegraded":"2024-09-19T08:51:51.829630+0000","last_fullsized":"2024-09-19T08:51:51.829630+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:59:59.717869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":40,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.545962+0000","last_change":"2024-09-19T08:50:14.294087+0000","last_active":"2024-09-19T08:51:23.545962+0000","last_peered":"2024-09-19T08:51:23.545962+0000","last_clean":"2024-09-19T08:51:23.545962+0000","last_became_active":"2024-09-19T08:50:14.293712+0000","last_became_peered":"2024-09-19T08:50:14.293712+0000","last_unstale":"2024-09-19T08:51:23.545962+0000","last_undegraded":"2024-09-19T08:51:23.545962+0000","last_fullsized":"2024-09-19T08:51:23.545962+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:12.187514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.835719+0000","last_change":"2024-09-19T08:50:15.888134+0000","last_active":"2024-09-19T08:51:51.835719+0000","last_peered":"2024-09-19T08:51:51.835719+0000","last_clean":"2024-09-19T08:51:51.835719+0000","last_became_active":"2024-09-19T08:50:15.887768+0000","last_became_peered":"2024-09-19T08:50:15.887768+0000","last_unstale":"2024-09-19T08:51:51.835719+0000","last_undegraded":"2024-09-19T08:51:51.835719+0000","last_fullsized":"2024-09-19T08:51:51.835719+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:18:12.868773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.547326+0000","last_change":"2024-09-19T08:50:13.792585+0000","last_active":"2024-09-19T08:51:23.547326+0000","last_peered":"2024-09-19T08:51:23.547326+0000","last_clean":"2024-09-19T08:51:23.547326+0000","last_became_active":"2024-09-19T08:50:13.792222+0000","last_became_peered":"2024-09-19T08:50:13.792222+0000","last_unstale":"2024-09-19T08:51:23.547326+0000","last_undegraded":"2024-09-19T08:51:23.547326+0000","last_fullsized":"2024-09-19T08:51:23.547326+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:42:45.234800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.818076+0000","last_change":"2024-09-19T08:51:23.549003+0000","last_active":"2024-09-19T08:51:51.818076+0000","last_peered":"2024-09-19T08:51:51.818076+0000","last_clean":"2024-09-19T08:51:51.818076+0000","last_became_active":"2024-09-19T08:51:23.548611+0000","last_became_peered":"2024-09-19T08:51:23.548611+0000","last_unstale":"2024-09-19T08:51:51.818076+0000","last_undegraded":"2024-09-19T08:51:51.818076+0000","last_fullsized":"2024-09-19T08:51:51.818076+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:00.043092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.540568+0000","last_change":"2024-09-19T08:50:13.795360+0000","last_active":"2024-09-19T08:51:23.540568+0000","last_peered":"2024-09-19T08:51:23.540568+0000","last_clean":"2024-09-19T08:51:23.540568+0000","last_became_active":"2024-09-19T08:50:13.794823+0000","last_became_peered":"2024-09-19T08:50:13.794823+0000","last_unstale":"2024-09-19T08:51:23.540568+0000","last_undegraded":"2024-09-19T08:51:23.540568+0000","last_fullsized":"2024-09-19T08:51:23.540568+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:23:15.037834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.822420+0000","last_change":"2024-09-19T08:50:15.893668+0000","last_active":"2024-09-19T08:51:51.822420+0000","last_peered":"2024-09-19T08:51:51.822420+0000","last_clean":"2024-09-19T08:51:51.822420+0000","last_became_active":"2024-09-19T08:50:15.893303+0000","last_became_peered":"2024-09-19T08:50:15.893303+0000","last_unstale":"2024-09-19T08:51:51.822420+0000","last_undegraded":"2024-09-19T08:51:51.822420+0000","last_fullsized":"2024-09-19T08:51:51.822420+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:50:59.281601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.545777+0000","last_change":"2024-09-19T08:50:13.797442+0000","last_active":"2024-09-19T08:51:23.545777+0000","last_peered":"2024-09-19T08:51:23.545777+0000","last_clean":"2024-09-19T08:51:23.545777+0000","last_became_active":"2024-09-19T08:50:13.797072+0000","last_became_peered":"2024-09-19T08:50:13.797072+0000","last_unstale":"2024-09-19T08:51:23.545777+0000","last_undegraded":"2024-09-19T08:51:23.545777+0000","last_fullsized":"2024-09-19T08:51:23.545777+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:32.960928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829292+0000","last_change":"2024-09-19T08:51:23.554271+0000","last_active":"2024-09-19T08:51:51.829292+0000","last_peered":"2024-09-19T08:51:51.829292+0000","last_clean":"2024-09-19T08:51:51.829292+0000","last_became_active":"2024-09-19T08:51:23.547630+0000","last_became_peered":"2024-09-19T08:51:23.547630+0000","last_unstale":"2024-09-19T08:51:51.829292+0000","last_undegraded":"2024-09-19T08:51:51.829292+0000","last_fullsized":"2024-09-19T08:51:51.829292+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:01:39.033522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'7","reported_seq":146,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:19.097782+0000","last_change":"2024-09-19T08:50:14.294014+0000","last_active":"2024-09-19T08:52:19.097782+0000","last_peered":"2024-09-19T08:52:19.097782+0000","last_clean":"2024-09-19T08:52:19.097782+0000","last_became_active":"2024-09-19T08:50:14.293564+0000","last_became_peered":"2024-09-19T08:50:14.293564+0000","last_unstale":"2024-09-19T08:52:19.097782+0000","last_undegraded":"2024-09-19T08:52:19.097782+0000","last_fullsized":"2024-09-19T08:52:19.097782+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:01:23.806408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1704,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.834993+0000","last_change":"2024-09-19T08:50:15.891840+0000","last_active":"2024-09-19T08:51:51.834993+0000","last_peered":"2024-09-19T08:51:51.834993+0000","last_clean":"2024-09-19T08:51:51.834993+0000","last_became_active":"2024-09-19T08:50:15.891511+0000","last_became_peered":"2024-09-19T08:50:15.891511+0000","last_unstale":"2024-09-19T08:51:51.834993+0000","last_undegraded":"2024-09-19T08:51:51.834993+0000","last_fullsized":"2024-09-19T08:51:51.834993+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:28:26.800508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":332,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.545171+0000","last_change":"2024-09-19T08:49:02.071497+0000","last_active":"2024-09-19T08:51:23.545171+0000","last_peered":"2024-09-19T08:51:23.545171+0000","last_clean":"2024-09-19T08:51:23.545171+0000","last_became_active":"2024-09-19T08:49:02.071114+0000","last_became_peered":"2024-09-19T08:49:02.071114+0000","last_unstale":"2024-09-19T08:51:23.545171+0000","last_undegraded":"2024-09-19T08:51:23.545171+0000","last_fullsized":"2024-09-19T08:51:23.545171+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:45:36.600595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:45:36.600595+0000","last_clean_scrub_stamp":"2024-09-19T08:45:36.600595+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:18:15.369279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.541874+0000","last_change":"2024-09-19T08:50:13.793981+0000","last_active":"2024-09-19T08:51:23.541874+0000","last_peered":"2024-09-19T08:51:23.541874+0000","last_clean":"2024-09-19T08:51:23.541874+0000","last_became_active":"2024-09-19T08:50:13.793616+0000","last_became_peered":"2024-09-19T08:50:13.793616+0000","last_unstale":"2024-09-19T08:51:23.541874+0000","last_undegraded":"2024-09-19T08:51:23.541874+0000","last_fullsized":"2024-09-19T08:51:23.541874+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:45.195906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.828998+0000","last_change":"2024-09-19T08:50:15.891248+0000","last_active":"2024-09-19T08:51:51.828998+0000","last_peered":"2024-09-19T08:51:51.828998+0000","last_clean":"2024-09-19T08:51:51.828998+0000","last_became_active":"2024-09-19T08:50:15.890922+0000","last_became_peered":"2024-09-19T08:50:15.890922+0000","last_unstale":"2024-09-19T08:51:51.828998+0000","last_undegraded":"2024-09-19T08:51:51.828998+0000","last_fullsized":"2024-09-19T08:51:51.828998+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:18:43.914214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.545087+0000","last_change":"2024-09-19T08:50:13.797471+0000","last_active":"2024-09-19T08:51:23.545087+0000","last_peered":"2024-09-19T08:51:23.545087+0000","last_clean":"2024-09-19T08:51:23.545087+0000","last_became_active":"2024-09-19T08:50:13.797033+0000","last_became_peered":"2024-09-19T08:50:13.797033+0000","last_unstale":"2024-09-19T08:51:23.545087+0000","last_undegraded":"2024-09-19T08:51:23.545087+0000","last_fullsized":"2024-09-19T08:51:23.545087+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:36:53.141708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.823643+0000","last_change":"2024-09-19T08:50:15.882650+0000","last_active":"2024-09-19T08:51:51.823643+0000","last_peered":"2024-09-19T08:51:51.823643+0000","last_clean":"2024-09-19T08:51:51.823643+0000","last_became_active":"2024-09-19T08:50:15.882308+0000","last_became_peered":"2024-09-19T08:50:15.882308+0000","last_unstale":"2024-09-19T08:51:51.823643+0000","last_undegraded":"2024-09-19T08:51:51.823643+0000","last_fullsized":"2024-09-19T08:51:51.823643+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:26.449562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"82'7","reported_seq":144,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:20.097841+0000","last_change":"2024-09-19T08:50:14.292466+0000","last_active":"2024-09-19T08:52:20.097841+0000","last_peered":"2024-09-19T08:52:20.097841+0000","last_clean":"2024-09-19T08:52:20.097841+0000","last_became_active":"2024-09-19T08:50:14.292092+0000","last_became_peered":"2024-09-19T08:50:14.292092+0000","last_unstale":"2024-09-19T08:52:20.097841+0000","last_undegraded":"2024-09-19T08:52:20.097841+0000","last_fullsized":"2024-09-19T08:52:20.097841+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:11.373226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":114,"num_read_kb":114,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.825807+0000","last_change":"2024-09-19T08:51:23.551606+0000","last_active":"2024-09-19T08:51:51.825807+0000","last_peered":"2024-09-19T08:51:51.825807+0000","last_clean":"2024-09-19T08:51:51.825807+0000","last_became_active":"2024-09-19T08:51:23.551181+0000","last_became_peered":"2024-09-19T08:51:23.551181+0000","last_unstale":"2024-09-19T08:51:51.825807+0000","last_undegraded":"2024-09-19T08:51:51.825807+0000","last_fullsized":"2024-09-19T08:51:51.825807+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:57:05.577651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,8],"acting":[5,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"82'6","reported_seq":144,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:20.626662+0000","last_change":"2024-09-19T08:50:13.799909+0000","last_active":"2024-09-19T08:52:20.626662+0000","last_peered":"2024-09-19T08:52:20.626662+0000","last_clean":"2024-09-19T08:52:20.626662+0000","last_became_active":"2024-09-19T08:50:13.799542+0000","last_became_peered":"2024-09-19T08:50:13.799542+0000","last_unstale":"2024-09-19T08:52:20.626662+0000","last_undegraded":"2024-09-19T08:52:20.626662+0000","last_fullsized":"2024-09-19T08:52:20.626662+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:23.545897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":115,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837280+0000","last_change":"2024-09-19T08:51:24.482934+0000","last_active":"2024-09-19T08:51:51.837280+0000","last_peered":"2024-09-19T08:51:51.837280+0000","last_clean":"2024-09-19T08:51:51.837280+0000","last_became_active":"2024-09-19T08:51:24.482586+0000","last_became_peered":"2024-09-19T08:51:24.482586+0000","last_unstale":"2024-09-19T08:51:51.837280+0000","last_undegraded":"2024-09-19T08:51:51.837280+0000","last_fullsized":"2024-09-19T08:51:51.837280+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:45:15.121449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.543140+0000","last_change":"2024-09-19T08:50:14.292577+0000","last_active":"2024-09-19T08:51:23.543140+0000","last_peered":"2024-09-19T08:51:23.543140+0000","last_clean":"2024-09-19T08:51:23.543140+0000","last_became_active":"2024-09-19T08:50:14.292220+0000","last_became_peered":"2024-09-19T08:50:14.292220+0000","last_unstale":"2024-09-19T08:51:23.543140+0000","last_undegraded":"2024-09-19T08:51:23.543140+0000","last_fullsized":"2024-09-19T08:51:23.543140+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:23.631672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827755+0000","last_change":"2024-09-19T08:50:15.891345+0000","last_active":"2024-09-19T08:51:51.827755+0000","last_peered":"2024-09-19T08:51:51.827755+0000","last_clean":"2024-09-19T08:51:51.827755+0000","last_became_active":"2024-09-19T08:50:15.891006+0000","last_became_peered":"2024-09-19T08:50:15.891006+0000","last_unstale":"2024-09-19T08:51:51.827755+0000","last_undegraded":"2024-09-19T08:51:51.827755+0000","last_fullsized":"2024-09-19T08:51:51.827755+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:56:41.934331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.546956+0000","last_change":"2024-09-19T08:50:14.292619+0000","last_active":"2024-09-19T08:51:23.546956+0000","last_peered":"2024-09-19T08:51:23.546956+0000","last_clean":"2024-09-19T08:51:23.546956+0000","last_became_active":"2024-09-19T08:50:14.292230+0000","last_became_peered":"2024-09-19T08:50:14.292230+0000","last_unstale":"2024-09-19T08:51:23.546956+0000","last_undegraded":"2024-09-19T08:51:23.546956+0000","last_fullsized":"2024-09-19T08:51:23.546956+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:21:33.076142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.824453+0000","last_change":"2024-09-19T08:50:15.882760+0000","last_active":"2024-09-19T08:51:51.824453+0000","last_peered":"2024-09-19T08:51:51.824453+0000","last_clean":"2024-09-19T08:51:51.824453+0000","last_became_active":"2024-09-19T08:50:15.882402+0000","last_became_peered":"2024-09-19T08:50:15.882402+0000","last_unstale":"2024-09-19T08:51:51.824453+0000","last_undegraded":"2024-09-19T08:51:51.824453+0000","last_fullsized":"2024-09-19T08:51:51.824453+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:19:17.343385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'18","reported_seq":41,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:10.890599+0000","last_change":"2024-09-19T08:50:13.790982+0000","last_active":"2024-09-19T08:52:10.890599+0000","last_peered":"2024-09-19T08:52:10.890599+0000","last_clean":"2024-09-19T08:52:10.890599+0000","last_became_active":"2024-09-19T08:50:13.790644+0000","last_became_peered":"2024-09-19T08:50:13.790644+0000","last_unstale":"2024-09-19T08:52:10.890599+0000","last_undegraded":"2024-09-19T08:52:10.890599+0000","last_fullsized":"2024-09-19T08:52:10.890599+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:20:25.923021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.827049+0000","last_change":"2024-09-19T08:50:15.887556+0000","last_active":"2024-09-19T08:51:51.827049+0000","last_peered":"2024-09-19T08:51:51.827049+0000","last_clean":"2024-09-19T08:51:51.827049+0000","last_became_active":"2024-09-19T08:50:15.887280+0000","last_became_peered":"2024-09-19T08:50:15.887280+0000","last_unstale":"2024-09-19T08:51:51.827049+0000","last_undegraded":"2024-09-19T08:51:51.827049+0000","last_fullsized":"2024-09-19T08:51:51.827049+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:51.226527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.541910+0000","last_change":"2024-09-19T08:50:14.012150+0000","last_active":"2024-09-19T08:51:23.541910+0000","last_peered":"2024-09-19T08:51:23.541910+0000","last_clean":"2024-09-19T08:51:23.541910+0000","last_became_active":"2024-09-19T08:50:14.011799+0000","last_became_peered":"2024-09-19T08:50:14.011799+0000","last_unstale":"2024-09-19T08:51:23.541910+0000","last_undegraded":"2024-09-19T08:51:23.541910+0000","last_fullsized":"2024-09-19T08:51:23.541910+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:05:37.310539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837525+0000","last_change":"2024-09-19T08:50:15.889577+0000","last_active":"2024-09-19T08:51:51.837525+0000","last_peered":"2024-09-19T08:51:51.837525+0000","last_clean":"2024-09-19T08:51:51.837525+0000","last_became_active":"2024-09-19T08:50:15.889244+0000","last_became_peered":"2024-09-19T08:50:15.889244+0000","last_unstale":"2024-09-19T08:51:51.837525+0000","last_undegraded":"2024-09-19T08:51:51.837525+0000","last_fullsized":"2024-09-19T08:51:51.837525+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:23:54.382221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.548456+0000","last_change":"2024-09-19T08:50:14.293845+0000","last_active":"2024-09-19T08:51:23.548456+0000","last_peered":"2024-09-19T08:51:23.548456+0000","last_clean":"2024-09-19T08:51:23.548456+0000","last_became_active":"2024-09-19T08:50:14.293585+0000","last_became_peered":"2024-09-19T08:50:14.293585+0000","last_unstale":"2024-09-19T08:51:23.548456+0000","last_undegraded":"2024-09-19T08:51:23.548456+0000","last_fullsized":"2024-09-19T08:51:23.548456+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:02.886475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":19,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.794304+0000","last_change":"2024-09-19T08:50:15.888591+0000","last_active":"2024-09-19T08:51:51.794304+0000","last_peered":"2024-09-19T08:51:51.794304+0000","last_clean":"2024-09-19T08:51:51.794304+0000","last_became_active":"2024-09-19T08:50:15.888270+0000","last_became_peered":"2024-09-19T08:50:15.888270+0000","last_unstale":"2024-09-19T08:51:51.794304+0000","last_undegraded":"2024-09-19T08:51:51.794304+0000","last_fullsized":"2024-09-19T08:51:51.794304+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:30:08.644828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.547015+0000","last_change":"2024-09-19T08:50:13.794081+0000","last_active":"2024-09-19T08:51:23.547015+0000","last_peered":"2024-09-19T08:51:23.547015+0000","last_clean":"2024-09-19T08:51:23.547015+0000","last_became_active":"2024-09-19T08:50:13.793770+0000","last_became_peered":"2024-09-19T08:50:13.793770+0000","last_unstale":"2024-09-19T08:51:23.547015+0000","last_undegraded":"2024-09-19T08:51:23.547015+0000","last_fullsized":"2024-09-19T08:51:23.547015+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:29:43.053893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.835489+0000","last_change":"2024-09-19T08:50:15.885338+0000","last_active":"2024-09-19T08:51:51.835489+0000","last_peered":"2024-09-19T08:51:51.835489+0000","last_clean":"2024-09-19T08:51:51.835489+0000","last_became_active":"2024-09-19T08:50:15.884983+0000","last_became_peered":"2024-09-19T08:50:15.884983+0000","last_unstale":"2024-09-19T08:51:51.835489+0000","last_undegraded":"2024-09-19T08:51:51.835489+0000","last_fullsized":"2024-09-19T08:51:51.835489+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:05.228871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'4","reported_seq":18,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:25.776440+0000","last_change":"2024-09-19T08:51:23.562670+0000","last_active":"2024-09-19T08:51:25.776440+0000","last_peered":"2024-09-19T08:51:25.776440+0000","last_clean":"2024-09-19T08:51:25.776440+0000","last_became_active":"2024-09-19T08:51:23.548756+0000","last_became_peered":"2024-09-19T08:51:23.548756+0000","last_unstale":"2024-09-19T08:51:25.776440+0000","last_undegraded":"2024-09-19T08:51:25.776440+0000","last_fullsized":"2024-09-19T08:51:25.776440+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:36.666216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829262+0000","last_change":"2024-09-19T08:50:15.886587+0000","last_active":"2024-09-19T08:51:51.829262+0000","last_peered":"2024-09-19T08:51:51.829262+0000","last_clean":"2024-09-19T08:51:51.829262+0000","last_became_active":"2024-09-19T08:50:15.886231+0000","last_became_peered":"2024-09-19T08:50:15.886231+0000","last_unstale":"2024-09-19T08:51:51.829262+0000","last_undegraded":"2024-09-19T08:51:51.829262+0000","last_fullsized":"2024-09-19T08:51:51.829262+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:00:11.965382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.546412+0000","last_change":"2024-09-19T08:50:13.796681+0000","last_active":"2024-09-19T08:51:23.546412+0000","last_peered":"2024-09-19T08:51:23.546412+0000","last_clean":"2024-09-19T08:51:23.546412+0000","last_became_active":"2024-09-19T08:50:13.796338+0000","last_became_peered":"2024-09-19T08:50:13.796338+0000","last_unstale":"2024-09-19T08:51:23.546412+0000","last_undegraded":"2024-09-19T08:51:23.546412+0000","last_fullsized":"2024-09-19T08:51:23.546412+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:24:32.588800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":22,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.836422+0000","last_change":"2024-09-19T08:50:15.889667+0000","last_active":"2024-09-19T08:51:51.836422+0000","last_peered":"2024-09-19T08:51:51.836422+0000","last_clean":"2024-09-19T08:51:51.836422+0000","last_became_active":"2024-09-19T08:50:15.889341+0000","last_became_peered":"2024-09-19T08:50:15.889341+0000","last_unstale":"2024-09-19T08:51:51.836422+0000","last_undegraded":"2024-09-19T08:51:51.836422+0000","last_fullsized":"2024-09-19T08:51:51.836422+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:13.255483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.836199+0000","last_change":"2024-09-19T08:50:15.887337+0000","last_active":"2024-09-19T08:51:51.836199+0000","last_peered":"2024-09-19T08:51:51.836199+0000","last_clean":"2024-09-19T08:51:51.836199+0000","last_became_active":"2024-09-19T08:50:15.887001+0000","last_became_peered":"2024-09-19T08:50:15.887001+0000","last_unstale":"2024-09-19T08:51:51.836199+0000","last_undegraded":"2024-09-19T08:51:51.836199+0000","last_fullsized":"2024-09-19T08:51:51.836199+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:54:43.544863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.547132+0000","last_change":"2024-09-19T08:50:13.799321+0000","last_active":"2024-09-19T08:51:23.547132+0000","last_peered":"2024-09-19T08:51:23.547132+0000","last_clean":"2024-09-19T08:51:23.547132+0000","last_became_active":"2024-09-19T08:50:13.798837+0000","last_became_peered":"2024-09-19T08:50:13.798837+0000","last_unstale":"2024-09-19T08:51:23.547132+0000","last_undegraded":"2024-09-19T08:51:23.547132+0000","last_fullsized":"2024-09-19T08:51:23.547132+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:35.753093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.837309+0000","last_change":"2024-09-19T08:50:15.892074+0000","last_active":"2024-09-19T08:51:51.837309+0000","last_peered":"2024-09-19T08:51:51.837309+0000","last_clean":"2024-09-19T08:51:51.837309+0000","last_became_active":"2024-09-19T08:50:15.891722+0000","last_became_peered":"2024-09-19T08:50:15.891722+0000","last_unstale":"2024-09-19T08:51:51.837309+0000","last_undegraded":"2024-09-19T08:51:51.837309+0000","last_fullsized":"2024-09-19T08:51:51.837309+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:41:39.913080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.546815+0000","last_change":"2024-09-19T08:50:13.795577+0000","last_active":"2024-09-19T08:51:23.546815+0000","last_peered":"2024-09-19T08:51:23.546815+0000","last_clean":"2024-09-19T08:51:23.546815+0000","last_became_active":"2024-09-19T08:50:13.795254+0000","last_became_peered":"2024-09-19T08:50:13.795254+0000","last_unstale":"2024-09-19T08:51:23.546815+0000","last_undegraded":"2024-09-19T08:51:23.546815+0000","last_fullsized":"2024-09-19T08:51:23.546815+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:13.263447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.836554+0000","last_change":"2024-09-19T08:50:15.884584+0000","last_active":"2024-09-19T08:51:51.836554+0000","last_peered":"2024-09-19T08:51:51.836554+0000","last_clean":"2024-09-19T08:51:51.836554+0000","last_became_active":"2024-09-19T08:50:15.884244+0000","last_became_peered":"2024-09-19T08:50:15.884244+0000","last_unstale":"2024-09-19T08:51:51.836554+0000","last_undegraded":"2024-09-19T08:51:51.836554+0000","last_fullsized":"2024-09-19T08:51:51.836554+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:58.835351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:23.547268+0000","last_change":"2024-09-19T08:50:14.294210+0000","last_active":"2024-09-19T08:51:23.547268+0000","last_peered":"2024-09-19T08:51:23.547268+0000","last_clean":"2024-09-19T08:51:23.547268+0000","last_became_active":"2024-09-19T08:50:14.293850+0000","last_became_peered":"2024-09-19T08:50:14.293850+0000","last_unstale":"2024-09-19T08:51:23.547268+0000","last_undegraded":"2024-09-19T08:51:23.547268+0000","last_fullsized":"2024-09-19T08:51:23.547268+0000","mapping_epoch":76,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":77,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:42:44.340766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:51:51.829360+0000","last_change":"2024-09-19T08:50:15.892934+0000","last_active":"2024-09-19T08:51:51.829360+0000","last_peered":"2024-09-19T08:51:51.829360+0000","last_clean":"2024-09-19T08:51:51.829360+0000","last_became_active":"2024-09-19T08:50:15.892309+0000","last_became_peered":"2024-09-19T08:50:15.892309+0000","last_unstale":"2024-09-19T08:51:51.829360+0000","last_undegraded":"2024-09-19T08:51:51.829360+0000","last_fullsized":"2024-09-19T08:51:51.829360+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":78,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:14.855055+0000","last_clean_scrub_stamp":"2024-09-19T08:50:14.855055+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:54:40.158724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"82'14","reported_seq":175,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-09-19T08:52:22.628631+0000","last_change":"2024-09-19T08:51:23.559819+0000","last_active":"2024-09-19T08:52:22.628631+0000","last_peered":"2024-09-19T08:52:22.628631+0000","last_clean":"2024-09-19T08:52:22.628631+0000","last_became_active":"2024-09-19T08:51:23.548481+0000","last_became_peered":"2024-09-19T08:51:23.548481+0000","last_unstale":"2024-09-19T08:52:22.628631+0000","last_undegraded":"2024-09-19T08:52:22.628631+0000","last_fullsized":"2024-09-19T08:52:22.628631+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":76,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T08:50:12.773201+0000","last_clean_scrub_stamp":"2024-09-19T08:50:12.773201+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:14:53.232542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":113,"num_read_kb":113,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,8],"acting":[9,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":117,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":78169,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1194,"num_read_kb":685,"num_write":269,"num_write_kb":163,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":672,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":234507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":231,"ondisk_log_size":231,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":247642,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":74,"seq":317827579943,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":434558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808876,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1060864,"data_stored":1094808,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972402,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":925696,"data_stored":433399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":31914433},"hb_peers":[0,1,2,3,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201335,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":433660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430267,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":1027136,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593793,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":433392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822725,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":983040,"data_stored":1025858,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953545,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":434095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182479,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":917504,"data_stored":432707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411413,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":504251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574938,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":503497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738463,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":434872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34206,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34206,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35846,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":71337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":72091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":72163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T08:52:25.266 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:52:25.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:25 smithi155 ceph-mon[34921]: pgmap v343: 97 pgs: 97 active+clean; 653 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-09-19T08:52:25.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:25 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:52:25.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:25 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:52:25.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:25 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:52:25.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:25 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:52:25.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:25 smithi155 ceph-mon[34921]: from='client.24991 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:52:25.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:25 smithi203 ceph-mon[35450]: pgmap v343: 97 pgs: 97 active+clean; 653 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2024-09-19T08:52:25.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:25 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:52:25.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:25 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:52:25.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:25 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:52:25.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:25 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:52:25.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:25 smithi203 ceph-mon[35450]: from='client.24991 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T08:52:25.532 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:25.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.991+0000 7fbe364a9640 1 -- 172.21.15.19:0/2848297301 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe30106a80 msgr2=0x7fbe30106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:25.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.991+0000 7fbe364a9640 1 --2- 172.21.15.19:0/2848297301 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe30106a80 0x7fbe30106e60 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fbe20009930 tx=0x7fbe2002a440 comp rx=0 tx=0).stop 2024-09-19T08:52:25.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.991+0000 7fbe364a9640 1 -- 172.21.15.19:0/2848297301 shutdown_connections 2024-09-19T08:52:25.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.991+0000 7fbe364a9640 1 --2- 172.21.15.19:0/2848297301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe30100a80 0x7fbe30100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:25.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.991+0000 7fbe364a9640 1 --2- 172.21.15.19:0/2848297301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbe30101420 0x7fbe3010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:25.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.991+0000 7fbe364a9640 1 --2- 172.21.15.19:0/2848297301 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe30106a80 0x7fbe30106e60 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:25.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.991+0000 7fbe364a9640 1 -- 172.21.15.19:0/2848297301 >> 172.21.15.19:0/2848297301 conn(0x7fbe300fc7a0 msgr2=0x7fbe300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:25.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.991+0000 7fbe364a9640 1 -- 172.21.15.19:0/2848297301 shutdown_connections 2024-09-19T08:52:25.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.991+0000 7fbe364a9640 1 -- 172.21.15.19:0/2848297301 wait complete. 2024-09-19T08:52:25.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.992+0000 7fbe364a9640 1 Processor -- start 2024-09-19T08:52:25.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.992+0000 7fbe364a9640 1 -- start start 2024-09-19T08:52:25.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.992+0000 7fbe364a9640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe30100a80 0x7fbe3019a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:25.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.992+0000 7fbe364a9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbe30101420 0x7fbe3019aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:25.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.992+0000 7fbe364a9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe30106a80 0x7fbe3019ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:25.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.992+0000 7fbe364a9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbe30110e80 con 0x7fbe30106a80 2024-09-19T08:52:25.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.992+0000 7fbe364a9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbe30110d00 con 0x7fbe30101420 2024-09-19T08:52:25.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.992+0000 7fbe364a9640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbe30111000 con 0x7fbe30100a80 2024-09-19T08:52:25.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.992+0000 7fbe34a46640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe30106a80 0x7fbe3019ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:25.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.992+0000 7fbe34a46640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe30106a80 0x7fbe3019ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48946/0 (socket says 172.21.15.19:48946) 2024-09-19T08:52:25.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.992+0000 7fbe34a46640 1 -- 172.21.15.19:0/1120703437 learned_addr learned my addr 172.21.15.19:0/1120703437 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:25.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.992+0000 7fbe2f7fe640 1 --2- 172.21.15.19:0/1120703437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbe30101420 0x7fbe3019aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:25.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.992+0000 7fbe2ffff640 1 --2- 172.21.15.19:0/1120703437 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe30100a80 0x7fbe3019a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:25.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.993+0000 7fbe34a46640 1 -- 172.21.15.19:0/1120703437 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe30100a80 msgr2=0x7fbe3019a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:25.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.993+0000 7fbe34a46640 1 --2- 172.21.15.19:0/1120703437 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe30100a80 0x7fbe3019a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:25.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.993+0000 7fbe34a46640 1 -- 172.21.15.19:0/1120703437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbe30101420 msgr2=0x7fbe3019aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:25.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.993+0000 7fbe34a46640 1 --2- 172.21.15.19:0/1120703437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbe30101420 0x7fbe3019aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:25.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.993+0000 7fbe34a46640 1 -- 172.21.15.19:0/1120703437 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe3019f510 con 0x7fbe30106a80 2024-09-19T08:52:25.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.993+0000 7fbe34a46640 1 --2- 172.21.15.19:0/1120703437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe30106a80 0x7fbe3019ee30 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fbe2800cce0 tx=0x7fbe2800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:25.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.993+0000 7fbe2d7fa640 1 -- 172.21.15.19:0/1120703437 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe2800f450 con 0x7fbe30106a80 2024-09-19T08:52:25.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.993+0000 7fbe2d7fa640 1 -- 172.21.15.19:0/1120703437 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbe2800fad0 con 0x7fbe30106a80 2024-09-19T08:52:25.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.993+0000 7fbe364a9640 1 -- 172.21.15.19:0/1120703437 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe3019f800 con 0x7fbe30106a80 2024-09-19T08:52:25.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.993+0000 7fbe2d7fa640 1 -- 172.21.15.19:0/1120703437 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe28018b60 con 0x7fbe30106a80 2024-09-19T08:52:25.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.993+0000 7fbe364a9640 1 -- 172.21.15.19:0/1120703437 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe301a70e0 con 0x7fbe30106a80 2024-09-19T08:52:25.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.994+0000 7fbe364a9640 1 -- 172.21.15.19:0/1120703437 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe1c005290 con 0x7fbe30106a80 2024-09-19T08:52:25.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.996+0000 7fbe2d7fa640 1 -- 172.21.15.19:0/1120703437 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7fbe2800fc80 con 0x7fbe30106a80 2024-09-19T08:52:25.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.996+0000 7fbe2d7fa640 1 --2- 172.21.15.19:0/1120703437 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbe180a32d0 0x7fbe180a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:25.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.997+0000 7fbe2ffff640 1 --2- 172.21.15.19:0/1120703437 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbe180a32d0 0x7fbe180a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:25.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.997+0000 7fbe2d7fa640 1 -- 172.21.15.19:0/1120703437 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fbe280d0220 con 0x7fbe30106a80 2024-09-19T08:52:25.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:25.997+0000 7fbe2ffff640 1 --2- 172.21.15.19:0/1120703437 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbe180a32d0 0x7fbe180a5790 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbe20000c00 tx=0x7fbe20031490 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:26.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:26.000+0000 7fbe2d7fa640 1 -- 172.21.15.19:0/1120703437 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbe28014030 con 0x7fbe30106a80 2024-09-19T08:52:26.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:26.210+0000 7fbe364a9640 1 -- 172.21.15.19:0/1120703437 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe1c005580 con 0x7fbe30106a80 2024-09-19T08:52:26.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:26.211+0000 7fbe2d7fa640 1 -- 172.21.15.19:0/1120703437 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11983 (secure 0 0 0) 0x7fbe2809cdf0 con 0x7fbe30106a80 2024-09-19T08:52:26.212 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:52:26.212 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":28,"btime":"2024-09-19T08:52:09:653615+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2452068876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2452068876},{"type":"v1","addr":"172.21.15.19:6839","nonce":2452068876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T08:52:08.813945+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/2480841559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2480841559},{"type":"v1","addr":"172.21.15.155:6835","nonce":2480841559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24463,24464,24490,24469,24497]},"id":1}]} 2024-09-19T08:52:26.212 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 28 2024-09-19T08:52:26.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:26.214+0000 7fbe364a9640 1 -- 172.21.15.19:0/1120703437 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbe180a32d0 msgr2=0x7fbe180a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:26.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:26.214+0000 7fbe364a9640 1 --2- 172.21.15.19:0/1120703437 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbe180a32d0 0x7fbe180a5790 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fbe20000c00 tx=0x7fbe20031490 comp rx=0 tx=0).stop 2024-09-19T08:52:26.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:26.214+0000 7fbe364a9640 1 -- 172.21.15.19:0/1120703437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe30106a80 msgr2=0x7fbe3019ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:26.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:26.214+0000 7fbe364a9640 1 --2- 172.21.15.19:0/1120703437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe30106a80 0x7fbe3019ee30 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fbe2800cce0 tx=0x7fbe2800a620 comp rx=0 tx=0).stop 2024-09-19T08:52:26.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:26.214+0000 7fbe364a9640 1 -- 172.21.15.19:0/1120703437 shutdown_connections 2024-09-19T08:52:26.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:26.214+0000 7fbe364a9640 1 --2- 172.21.15.19:0/1120703437 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbe180a32d0 0x7fbe180a5790 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:26.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:26.214+0000 7fbe364a9640 1 --2- 172.21.15.19:0/1120703437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbe30106a80 0x7fbe3019ee30 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:26.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:26.214+0000 7fbe364a9640 1 --2- 172.21.15.19:0/1120703437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbe30101420 0x7fbe3019aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:26.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:26.214+0000 7fbe364a9640 1 --2- 172.21.15.19:0/1120703437 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe30100a80 0x7fbe3019a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:26.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:26.214+0000 7fbe364a9640 1 -- 172.21.15.19:0/1120703437 >> 172.21.15.19:0/1120703437 conn(0x7fbe300fc7a0 msgr2=0x7fbe3006a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:26.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:26.215+0000 7fbe364a9640 1 -- 172.21.15.19:0/1120703437 shutdown_connections 2024-09-19T08:52:26.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:26.215+0000 7fbe364a9640 1 -- 172.21.15.19:0/1120703437 wait complete. 2024-09-19T08:52:26.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:26 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:52:26.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:26 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:52:26.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:26 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:26.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:26 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:52:26.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:26 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:52:26.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:26 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1120703437' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:52:26.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:26 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:52:26.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:26 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:52:26.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:26 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:26.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:26 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:52:26.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:26 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:52:26.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:26 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1120703437' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:52:26.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:26 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:52:26.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:26 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:52:26.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:26 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:52:26.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:26 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:52:26.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:26 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:52:26.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:26 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1120703437' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:52:26.910 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:52:27.170 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:27.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.666+0000 7f47b67f2640 1 -- 172.21.15.19:0/994475993 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47b0102570 msgr2=0x7f47b01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:27.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.666+0000 7f47b67f2640 1 --2- 172.21.15.19:0/994475993 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47b0102570 0x7f47b01029b0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f47a4009900 tx=0x7f47a402a480 comp rx=0 tx=0).stop 2024-09-19T08:52:27.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.666+0000 7f47b67f2640 1 -- 172.21.15.19:0/994475993 shutdown_connections 2024-09-19T08:52:27.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.666+0000 7f47b67f2640 1 --2- 172.21.15.19:0/994475993 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f47b0102ef0 0x7f47b010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:27.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.666+0000 7f47b67f2640 1 --2- 172.21.15.19:0/994475993 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47b0102570 0x7f47b01029b0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:27.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.666+0000 7f47b67f2640 1 --2- 172.21.15.19:0/994475993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47b0100e20 0x7f47b0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:27.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.666+0000 7f47b67f2640 1 -- 172.21.15.19:0/994475993 >> 172.21.15.19:0/994475993 conn(0x7f47b00fc7d0 msgr2=0x7f47b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:27.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.666+0000 7f47b67f2640 1 -- 172.21.15.19:0/994475993 shutdown_connections 2024-09-19T08:52:27.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.666+0000 7f47b67f2640 1 -- 172.21.15.19:0/994475993 wait complete. 2024-09-19T08:52:27.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.666+0000 7f47b67f2640 1 Processor -- start 2024-09-19T08:52:27.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.666+0000 7f47b67f2640 1 -- start start 2024-09-19T08:52:27.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.667+0000 7f47b67f2640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f47b0100e20 0x7f47b019a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:27.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.667+0000 7f47b67f2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47b0102570 0x7f47b019ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:27.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.667+0000 7f47b67f2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47b0102ef0 0x7f47b019f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:27.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.667+0000 7f47b67f2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f47b01120a0 con 0x7f47b0102ef0 2024-09-19T08:52:27.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.667+0000 7f47b67f2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f47b0111f20 con 0x7f47b0102570 2024-09-19T08:52:27.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.667+0000 7f47b67f2640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f47b0112220 con 0x7f47b0100e20 2024-09-19T08:52:27.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.667+0000 7f47b4d8f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47b0102ef0 0x7f47b019f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:27.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.667+0000 7f47affff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f47b0100e20 0x7f47b019a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:27.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.667+0000 7f47b4d8f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47b0102ef0 0x7f47b019f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48970/0 (socket says 172.21.15.19:48970) 2024-09-19T08:52:27.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.667+0000 7f47b4d8f640 1 -- 172.21.15.19:0/1753964475 learned_addr learned my addr 172.21.15.19:0/1753964475 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:27.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.667+0000 7f47af7fe640 1 --2- 172.21.15.19:0/1753964475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47b0102570 0x7f47b019ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:27.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.667+0000 7f47b4d8f640 1 -- 172.21.15.19:0/1753964475 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f47b0100e20 msgr2=0x7f47b019a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:27.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.667+0000 7f47b4d8f640 1 --2- 172.21.15.19:0/1753964475 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f47b0100e20 0x7f47b019a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:27.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.667+0000 7f47b4d8f640 1 -- 172.21.15.19:0/1753964475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47b0102570 msgr2=0x7f47b019ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:27.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.667+0000 7f47b4d8f640 1 --2- 172.21.15.19:0/1753964475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47b0102570 0x7f47b019ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:27.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.667+0000 7f47b4d8f640 1 -- 172.21.15.19:0/1753964475 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b019f6f0 con 0x7f47b0102ef0 2024-09-19T08:52:27.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.667+0000 7f47af7fe640 1 --2- 172.21.15.19:0/1753964475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47b0102570 0x7f47b019ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:27.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.667+0000 7f47b4d8f640 1 --2- 172.21.15.19:0/1753964475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47b0102ef0 0x7f47b019f010 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f47a800b970 tx=0x7f47a800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:27.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.668+0000 7f47ad7fa640 1 -- 172.21.15.19:0/1753964475 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a8019070 con 0x7f47b0102ef0 2024-09-19T08:52:27.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.668+0000 7f47b67f2640 1 -- 172.21.15.19:0/1753964475 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47b019f9e0 con 0x7f47b0102ef0 2024-09-19T08:52:27.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.668+0000 7f47ad7fa640 1 -- 172.21.15.19:0/1753964475 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f47a800cb40 con 0x7f47b0102ef0 2024-09-19T08:52:27.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.668+0000 7f47ad7fa640 1 -- 172.21.15.19:0/1753964475 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a8007610 con 0x7f47b0102ef0 2024-09-19T08:52:27.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.668+0000 7f47b67f2640 1 -- 172.21.15.19:0/1753964475 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47b01a72c0 con 0x7f47b0102ef0 2024-09-19T08:52:27.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.669+0000 7f47b67f2640 1 -- 172.21.15.19:0/1753964475 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47b0101200 con 0x7f47b0102ef0 2024-09-19T08:52:27.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.670+0000 7f47ad7fa640 1 -- 172.21.15.19:0/1753964475 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f47a801c070 con 0x7f47b0102ef0 2024-09-19T08:52:27.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.670+0000 7f47ad7fa640 1 --2- 172.21.15.19:0/1753964475 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f47980a32d0 0x7f47980a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:27.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.671+0000 7f47ad7fa640 1 -- 172.21.15.19:0/1753964475 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f47a80cef10 con 0x7f47b0102ef0 2024-09-19T08:52:27.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.671+0000 7f47affff640 1 --2- 172.21.15.19:0/1753964475 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f47980a32d0 0x7f47980a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:27.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.671+0000 7f47affff640 1 --2- 172.21.15.19:0/1753964475 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f47980a32d0 0x7f47980a5790 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f47a000bbe0 tx=0x7f47a000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:27.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.675+0000 7f47ad7fa640 1 -- 172.21.15.19:0/1753964475 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f47a809b5a0 con 0x7f47b0102ef0 2024-09-19T08:52:27.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.887+0000 7f47b67f2640 1 -- 172.21.15.19:0/1753964475 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f47b010fb10 con 0x7f47b0102ef0 2024-09-19T08:52:27.887 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:27 smithi019 ceph-mon[30976]: pgmap v344: 97 pgs: 97 active+clean; 653 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-19T08:52:27.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.888+0000 7f47ad7fa640 1 -- 172.21.15.19:0/1753964475 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11983 (secure 0 0 0) 0x7f47a809f8a0 con 0x7f47b0102ef0 2024-09-19T08:52:27.888 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:52:27.888 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":28,"btime":"2024-09-19T08:52:09:653615+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2452068876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2452068876},{"type":"v1","addr":"172.21.15.19:6839","nonce":2452068876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T08:52:08.813945+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/2480841559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2480841559},{"type":"v1","addr":"172.21.15.155:6835","nonce":2480841559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24463,24464,24490,24469,24497]},"id":1}]} 2024-09-19T08:52:27.889 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 28 2024-09-19T08:52:27.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.890+0000 7f47b67f2640 1 -- 172.21.15.19:0/1753964475 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f47980a32d0 msgr2=0x7f47980a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:27.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.890+0000 7f47b67f2640 1 --2- 172.21.15.19:0/1753964475 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f47980a32d0 0x7f47980a5790 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f47a000bbe0 tx=0x7f47a000b390 comp rx=0 tx=0).stop 2024-09-19T08:52:27.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.890+0000 7f47b67f2640 1 -- 172.21.15.19:0/1753964475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47b0102ef0 msgr2=0x7f47b019f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:27.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.890+0000 7f47b67f2640 1 --2- 172.21.15.19:0/1753964475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47b0102ef0 0x7f47b019f010 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f47a800b970 tx=0x7f47a800be30 comp rx=0 tx=0).stop 2024-09-19T08:52:27.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.890+0000 7f47b67f2640 1 -- 172.21.15.19:0/1753964475 shutdown_connections 2024-09-19T08:52:27.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.890+0000 7f47b67f2640 1 --2- 172.21.15.19:0/1753964475 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f47980a32d0 0x7f47980a5790 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:27.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.890+0000 7f47b67f2640 1 --2- 172.21.15.19:0/1753964475 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f47b0102ef0 0x7f47b019f010 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:27.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.890+0000 7f47b67f2640 1 --2- 172.21.15.19:0/1753964475 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f47b0102570 0x7f47b019ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:27.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.890+0000 7f47b67f2640 1 --2- 172.21.15.19:0/1753964475 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f47b0100e20 0x7f47b019a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:27.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.890+0000 7f47b67f2640 1 -- 172.21.15.19:0/1753964475 >> 172.21.15.19:0/1753964475 conn(0x7f47b00fc7d0 msgr2=0x7f47b0105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:27.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.890+0000 7f47b67f2640 1 -- 172.21.15.19:0/1753964475 shutdown_connections 2024-09-19T08:52:27.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:27.890+0000 7f47b67f2640 1 -- 172.21.15.19:0/1753964475 wait complete. 2024-09-19T08:52:27.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:27 smithi203 ceph-mon[35450]: pgmap v344: 97 pgs: 97 active+clean; 653 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-19T08:52:28.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:27 smithi155 ceph-mon[34921]: pgmap v344: 97 pgs: 97 active+clean; 653 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 511 B/s wr, 10 op/s 2024-09-19T08:52:28.596 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T08:52:28.820 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:28 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1753964475' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:52:28.859 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:28.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:28 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1753964475' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:52:29.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:28 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1753964475' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:52:29.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.292+0000 7f0aaa41c640 1 -- 172.21.15.19:0/3048267121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0aa4106f30 msgr2=0x7f0aa410ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:29.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.292+0000 7f0aaa41c640 1 --2- 172.21.15.19:0/3048267121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0aa4106f30 0x7f0aa410ead0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c009cd0 tx=0x7f0a9c02a8e0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.292+0000 7f0aaa41c640 1 -- 172.21.15.19:0/3048267121 shutdown_connections 2024-09-19T08:52:29.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.292+0000 7f0aaa41c640 1 --2- 172.21.15.19:0/3048267121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0aa4106f30 0x7f0aa410ead0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.292+0000 7f0aaa41c640 1 --2- 172.21.15.19:0/3048267121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0aa4100c80 0x7f0aa4106820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.292+0000 7f0aaa41c640 1 --2- 172.21.15.19:0/3048267121 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0aa41002d0 0x7f0aa41006b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.292+0000 7f0aaa41c640 1 -- 172.21.15.19:0/3048267121 >> 172.21.15.19:0/3048267121 conn(0x7f0aa40fbee0 msgr2=0x7f0aa40fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:29.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.292+0000 7f0aaa41c640 1 -- 172.21.15.19:0/3048267121 shutdown_connections 2024-09-19T08:52:29.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.293+0000 7f0aaa41c640 1 -- 172.21.15.19:0/3048267121 wait complete. 2024-09-19T08:52:29.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.293+0000 7f0aaa41c640 1 Processor -- start 2024-09-19T08:52:29.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.293+0000 7f0aaa41c640 1 -- start start 2024-09-19T08:52:29.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.294+0000 7f0aaa41c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0aa41002d0 0x7f0aa41983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:29.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.294+0000 7f0aaa41c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0aa4100c80 0x7f0aa41988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:29.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.294+0000 7f0aaa41c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0aa4106f30 0x7f0aa419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:29.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.294+0000 7f0aaa41c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa4111fd0 con 0x7f0aa41002d0 2024-09-19T08:52:29.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.294+0000 7f0aaa41c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa4111e50 con 0x7f0aa4106f30 2024-09-19T08:52:29.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.294+0000 7f0aaa41c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa4112150 con 0x7f0aa4100c80 2024-09-19T08:52:29.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.294+0000 7f0aa3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0aa41002d0 0x7f0aa41983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:29.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.294+0000 7f0aa3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0aa41002d0 0x7f0aa41983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48988/0 (socket says 172.21.15.19:48988) 2024-09-19T08:52:29.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.294+0000 7f0aa3fff640 1 -- 172.21.15.19:0/1692373443 learned_addr learned my addr 172.21.15.19:0/1692373443 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:29.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.294+0000 7f0aa37fe640 1 --2- 172.21.15.19:0/1692373443 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0aa4100c80 0x7f0aa41988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:29.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.294+0000 7f0aa89b9640 1 --2- 172.21.15.19:0/1692373443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0aa4106f30 0x7f0aa419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:29.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.294+0000 7f0aa3fff640 1 -- 172.21.15.19:0/1692373443 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0aa4100c80 msgr2=0x7f0aa41988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:29.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.294+0000 7f0aa3fff640 1 --2- 172.21.15.19:0/1692373443 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0aa4100c80 0x7f0aa41988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.294+0000 7f0aa3fff640 1 -- 172.21.15.19:0/1692373443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0aa4106f30 msgr2=0x7f0aa419cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:29.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.294+0000 7f0aa3fff640 1 --2- 172.21.15.19:0/1692373443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0aa4106f30 0x7f0aa419cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.294+0000 7f0aa3fff640 1 -- 172.21.15.19:0/1692373443 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aa419d360 con 0x7f0aa41002d0 2024-09-19T08:52:29.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.294+0000 7f0aa89b9640 1 --2- 172.21.15.19:0/1692373443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0aa4106f30 0x7f0aa419cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:29.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.295+0000 7f0aa3fff640 1 --2- 172.21.15.19:0/1692373443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0aa41002d0 0x7f0aa41983b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f0a9400d950 tx=0x7f0a9400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:29.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.295+0000 7f0aa17fa640 1 -- 172.21.15.19:0/1692373443 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a94017070 con 0x7f0aa41002d0 2024-09-19T08:52:29.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.295+0000 7f0aa17fa640 1 -- 172.21.15.19:0/1692373443 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0a94009c30 con 0x7f0aa41002d0 2024-09-19T08:52:29.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.295+0000 7f0aaa41c640 1 -- 172.21.15.19:0/1692373443 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aa419d650 con 0x7f0aa41002d0 2024-09-19T08:52:29.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.295+0000 7f0aa17fa640 1 -- 172.21.15.19:0/1692373443 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9400f6b0 con 0x7f0aa41002d0 2024-09-19T08:52:29.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.295+0000 7f0aaa41c640 1 -- 172.21.15.19:0/1692373443 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aa41a4f30 con 0x7f0aa41002d0 2024-09-19T08:52:29.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.296+0000 7f0aaa41c640 1 -- 172.21.15.19:0/1692373443 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0aa41006b0 con 0x7f0aa41002d0 2024-09-19T08:52:29.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.297+0000 7f0aa17fa640 1 -- 172.21.15.19:0/1692373443 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f0a940109d0 con 0x7f0aa41002d0 2024-09-19T08:52:29.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.298+0000 7f0aa17fa640 1 --2- 172.21.15.19:0/1692373443 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f0a8c0a32d0 0x7f0a8c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:29.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.298+0000 7f0aa17fa640 1 -- 172.21.15.19:0/1692373443 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0a940cf790 con 0x7f0aa41002d0 2024-09-19T08:52:29.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.298+0000 7f0aa37fe640 1 --2- 172.21.15.19:0/1692373443 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f0a8c0a32d0 0x7f0a8c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:29.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.298+0000 7f0aa37fe640 1 --2- 172.21.15.19:0/1692373443 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f0a8c0a32d0 0x7f0a8c0a5790 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0aa41088e0 tx=0x7f0a9800c4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:29.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.303+0000 7f0aa17fa640 1 -- 172.21.15.19:0/1692373443 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0a94009de0 con 0x7f0aa41002d0 2024-09-19T08:52:29.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.480+0000 7f0aaa41c640 1 -- 172.21.15.19:0/1692373443 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0aa402d7c0 con 0x7f0aa41002d0 2024-09-19T08:52:29.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.482+0000 7f0aa17fa640 1 -- 172.21.15.19:0/1692373443 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22651 (secure 0 0 0) 0x7f0a9409c360 con 0x7f0aa41002d0 2024-09-19T08:52:29.482 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:52:29.483 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":82,"fsid":"f26c9d84-7662-11ef-bceb-c7b262605968","created":"2024-09-19T08:42:32.324073+0000","modified":"2024-09-19T08:51:23.536977+0000","last_up_change":"2024-09-19T08:49:24.764960+0000","last_in_change":"2024-09-19T08:49:01.062919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:45:36.232910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:50:12.615884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:50:14.854513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81c7bb06-5b13-4ee0-9290-d779faac1b91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6803","nonce":3397146732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6805","nonce":3397146732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6809","nonce":3397146732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6807","nonce":3397146732}]},"public_addr":"172.21.15.19:6803/3397146732","cluster_addr":"172.21.15.19:6805/3397146732","heartbeat_back_addr":"172.21.15.19:6809/3397146732","heartbeat_front_addr":"172.21.15.19:6807/3397146732","state":["exists","up"]},{"osd":1,"uuid":"24c145e6-5252-4708-8f25-5ce041e8251e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6801","nonce":2011043685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6803","nonce":2011043685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6807","nonce":2011043685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6805","nonce":2011043685}]},"public_addr":"172.21.15.155:6801/2011043685","cluster_addr":"172.21.15.155:6803/2011043685","heartbeat_back_addr":"172.21.15.155:6807/2011043685","heartbeat_front_addr":"172.21.15.155:6805/2011043685","state":["exists","up"]},{"osd":2,"uuid":"99cefd33-0675-495f-8871-2e6fdead0c3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6801","nonce":3358994623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6803","nonce":3358994623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6807","nonce":3358994623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6805","nonce":3358994623}]},"public_addr":"172.21.15.203:6801/3358994623","cluster_addr":"172.21.15.203:6803/3358994623","heartbeat_back_addr":"172.21.15.203:6807/3358994623","heartbeat_front_addr":"172.21.15.203:6805/3358994623","state":["exists","up"]},{"osd":3,"uuid":"8f46c16c-f17e-484a-8b66-6dbf135f34c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6811","nonce":176445576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6813","nonce":176445576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6817","nonce":176445576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6815","nonce":176445576}]},"public_addr":"172.21.15.19:6811/176445576","cluster_addr":"172.21.15.19:6813/176445576","heartbeat_back_addr":"172.21.15.19:6817/176445576","heartbeat_front_addr":"172.21.15.19:6815/176445576","state":["exists","up"]},{"osd":4,"uuid":"411b0423-1317-4e82-bc01-b5f55b391bc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6809","nonce":2163087792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6811","nonce":2163087792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6815","nonce":2163087792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6813","nonce":2163087792}]},"public_addr":"172.21.15.155:6809/2163087792","cluster_addr":"172.21.15.155:6811/2163087792","heartbeat_back_addr":"172.21.15.155:6815/2163087792","heartbeat_front_addr":"172.21.15.155:6813/2163087792","state":["exists","up"]},{"osd":5,"uuid":"057c073e-569f-4c6e-9602-e1169ad4dd8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6809","nonce":334881465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6811","nonce":334881465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6815","nonce":334881465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6813","nonce":334881465}]},"public_addr":"172.21.15.203:6809/334881465","cluster_addr":"172.21.15.203:6811/334881465","heartbeat_back_addr":"172.21.15.203:6815/334881465","heartbeat_front_addr":"172.21.15.203:6813/334881465","state":["exists","up"]},{"osd":6,"uuid":"40418f13-823e-4f94-a427-84781abbcb5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6819","nonce":2669779791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6821","nonce":2669779791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6825","nonce":2669779791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6823","nonce":2669779791}]},"public_addr":"172.21.15.19:6819/2669779791","cluster_addr":"172.21.15.19:6821/2669779791","heartbeat_back_addr":"172.21.15.19:6825/2669779791","heartbeat_front_addr":"172.21.15.19:6823/2669779791","state":["exists","up"]},{"osd":7,"uuid":"ad15f762-aeab-4167-a63d-6c9f9b89b9c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6817","nonce":3169455907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6819","nonce":3169455907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6823","nonce":3169455907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6821","nonce":3169455907}]},"public_addr":"172.21.15.155:6817/3169455907","cluster_addr":"172.21.15.155:6819/3169455907","heartbeat_back_addr":"172.21.15.155:6823/3169455907","heartbeat_front_addr":"172.21.15.155:6821/3169455907","state":["exists","up"]},{"osd":8,"uuid":"23cf8ea2-29d6-43d8-a05b-7822f4bbf254","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6817","nonce":1062999528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6819","nonce":1062999528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6823","nonce":1062999528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6821","nonce":1062999528}]},"public_addr":"172.21.15.203:6817/1062999528","cluster_addr":"172.21.15.203:6819/1062999528","heartbeat_back_addr":"172.21.15.203:6823/1062999528","heartbeat_front_addr":"172.21.15.203:6821/1062999528","state":["exists","up"]},{"osd":9,"uuid":"e851e605-2d17-4fbf-b783-2138133edd06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6827","nonce":574664786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6829","nonce":574664786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6833","nonce":574664786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6831","nonce":574664786}]},"public_addr":"172.21.15.19:6827/574664786","cluster_addr":"172.21.15.19:6829/574664786","heartbeat_back_addr":"172.21.15.19:6833/574664786","heartbeat_front_addr":"172.21.15.19:6831/574664786","state":["exists","up"]},{"osd":10,"uuid":"cc770717-91bd-4494-9103-6db8214b5872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6825","nonce":2242158832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6827","nonce":2242158832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6831","nonce":2242158832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6829","nonce":2242158832}]},"public_addr":"172.21.15.155:6825/2242158832","cluster_addr":"172.21.15.155:6827/2242158832","heartbeat_back_addr":"172.21.15.155:6831/2242158832","heartbeat_front_addr":"172.21.15.155:6829/2242158832","state":["exists","up"]},{"osd":11,"uuid":"6c237db9-5d79-47bc-8ff6-60d09d721d5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6825","nonce":522943955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6827","nonce":522943955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6831","nonce":522943955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6829","nonce":522943955}]},"public_addr":"172.21.15.203:6825/522943955","cluster_addr":"172.21.15.203:6827/522943955","heartbeat_back_addr":"172.21.15.203:6831/522943955","heartbeat_front_addr":"172.21.15.203:6829/522943955","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:44:44.656414+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:09.339183+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:33.245452+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:59.449025+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:46:24.831213+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:46:49.189780+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:47:13.493628+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:47:39.478247+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:05.089875+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:30.722878+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:56.951834+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:22.894678+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6801/4266644067":"2024-09-20T08:43:21.732222+0000","172.21.15.19:0/1398782170":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6800/4266644067":"2024-09-20T08:43:21.732222+0000","172.21.15.19:0/34162461":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6801/1764769529":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/2910961714":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6800/1764769529":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/820792769":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/560203138":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/809642328":"2024-09-20T08:42:56.618773+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T08:52:29.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.484+0000 7f0aaa41c640 1 -- 172.21.15.19:0/1692373443 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f0a8c0a32d0 msgr2=0x7f0a8c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:29.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.484+0000 7f0aaa41c640 1 --2- 172.21.15.19:0/1692373443 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f0a8c0a32d0 0x7f0a8c0a5790 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0aa41088e0 tx=0x7f0a9800c4a0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.484+0000 7f0aaa41c640 1 -- 172.21.15.19:0/1692373443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0aa41002d0 msgr2=0x7f0aa41983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:29.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.484+0000 7f0aaa41c640 1 --2- 172.21.15.19:0/1692373443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0aa41002d0 0x7f0aa41983b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f0a9400d950 tx=0x7f0a9400de10 comp rx=0 tx=0).stop 2024-09-19T08:52:29.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.484+0000 7f0aaa41c640 1 -- 172.21.15.19:0/1692373443 shutdown_connections 2024-09-19T08:52:29.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.484+0000 7f0aaa41c640 1 --2- 172.21.15.19:0/1692373443 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f0a8c0a32d0 0x7f0a8c0a5790 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.484+0000 7f0aaa41c640 1 --2- 172.21.15.19:0/1692373443 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0aa4100c80 0x7f0aa41988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.484+0000 7f0aaa41c640 1 --2- 172.21.15.19:0/1692373443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0aa4106f30 0x7f0aa419cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.484+0000 7f0aaa41c640 1 --2- 172.21.15.19:0/1692373443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0aa41002d0 0x7f0aa41983b0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:29.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.484+0000 7f0aaa41c640 1 -- 172.21.15.19:0/1692373443 >> 172.21.15.19:0/1692373443 conn(0x7f0aa40fbee0 msgr2=0x7f0aa40fd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:29.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.484+0000 7f0aaa41c640 1 -- 172.21.15.19:0/1692373443 shutdown_connections 2024-09-19T08:52:29.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:29.484+0000 7f0aaa41c640 1 -- 172.21.15.19:0/1692373443 wait complete. 2024-09-19T08:52:29.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:29 smithi203 ceph-mon[35450]: pgmap v345: 97 pgs: 97 active+clean; 653 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-19T08:52:29.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:29 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1692373443' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:52:29.994 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:29 smithi019 ceph-mon[30976]: pgmap v345: 97 pgs: 97 active+clean; 653 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-19T08:52:29.994 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:29 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1692373443' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:52:30.147 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-09-19T08:52:30.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:29 smithi155 ceph-mon[34921]: pgmap v345: 97 pgs: 97 active+clean; 653 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-19T08:52:30.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:29 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1692373443' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T08:52:30.409 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:30.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.812+0000 7f422a41e640 1 -- 172.21.15.19:0/13964800 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4224100a40 msgr2=0x7f4224100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:30.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.812+0000 7f422a41e640 1 --2- 172.21.15.19:0/13964800 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4224100a40 0x7f4224100e40 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f4214009900 tx=0x7f421402a410 comp rx=0 tx=0).stop 2024-09-19T08:52:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.812+0000 7f422a41e640 1 -- 172.21.15.19:0/13964800 shutdown_connections 2024-09-19T08:52:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.812+0000 7f422a41e640 1 --2- 172.21.15.19:0/13964800 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4224101c30 0x7f42241020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.812+0000 7f422a41e640 1 --2- 172.21.15.19:0/13964800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42241025f0 0x7f4224108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.812+0000 7f422a41e640 1 --2- 172.21.15.19:0/13964800 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4224100a40 0x7f4224100e40 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.813+0000 7f422a41e640 1 -- 172.21.15.19:0/13964800 >> 172.21.15.19:0/13964800 conn(0x7f42240fc1e0 msgr2=0x7f42240fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.813+0000 7f422a41e640 1 -- 172.21.15.19:0/13964800 shutdown_connections 2024-09-19T08:52:30.814 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.813+0000 7f422a41e640 1 -- 172.21.15.19:0/13964800 wait complete. 2024-09-19T08:52:30.816 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.813+0000 7f422a41e640 1 Processor -- start 2024-09-19T08:52:30.816 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.813+0000 7f422a41e640 1 -- start start 2024-09-19T08:52:30.816 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.814+0000 7f422a41e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4224100a40 0x7f422406a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:30.816 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.814+0000 7f422a41e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4224101c30 0x7f422419cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:30.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.814+0000 7f422a41e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42241025f0 0x7f422419f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:30.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.814+0000 7f422a41e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f422410c6c0 con 0x7f4224100a40 2024-09-19T08:52:30.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.814+0000 7f422a41e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f422410c540 con 0x7f42241025f0 2024-09-19T08:52:30.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.814+0000 7f422a41e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f422410c840 con 0x7f4224101c30 2024-09-19T08:52:30.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.814+0000 7f4223fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4224100a40 0x7f422406a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:30.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.814+0000 7f4223fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4224100a40 0x7f422406a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49000/0 (socket says 172.21.15.19:49000) 2024-09-19T08:52:30.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.814+0000 7f4223fff640 1 -- 172.21.15.19:0/961608561 learned_addr learned my addr 172.21.15.19:0/961608561 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:30.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.814+0000 7f42237fe640 1 --2- 172.21.15.19:0/961608561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4224101c30 0x7f422419cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:30.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.814+0000 7f4223fff640 1 -- 172.21.15.19:0/961608561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4224101c30 msgr2=0x7f422419cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:30.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.814+0000 7f4223fff640 1 --2- 172.21.15.19:0/961608561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4224101c30 0x7f422419cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.814+0000 7f4223fff640 1 -- 172.21.15.19:0/961608561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42241025f0 msgr2=0x7f422419f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:30.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.814+0000 7f4223fff640 1 --2- 172.21.15.19:0/961608561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42241025f0 0x7f422419f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.814+0000 7f4223fff640 1 -- 172.21.15.19:0/961608561 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f422419fa00 con 0x7f4224100a40 2024-09-19T08:52:30.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.814+0000 7f4223fff640 1 --2- 172.21.15.19:0/961608561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4224100a40 0x7f422406a410 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4214031610 tx=0x7f42140043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:30.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.815+0000 7f42217fa640 1 -- 172.21.15.19:0/961608561 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421403f030 con 0x7f4224100a40 2024-09-19T08:52:30.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.815+0000 7f422a41e640 1 -- 172.21.15.19:0/961608561 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f422419fc30 con 0x7f4224100a40 2024-09-19T08:52:30.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.815+0000 7f42217fa640 1 -- 172.21.15.19:0/961608561 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4214003ce0 con 0x7f4224100a40 2024-09-19T08:52:30.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.815+0000 7f42217fa640 1 -- 172.21.15.19:0/961608561 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4214035070 con 0x7f4224100a40 2024-09-19T08:52:30.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.815+0000 7f422a41e640 1 -- 172.21.15.19:0/961608561 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42241a0120 con 0x7f4224100a40 2024-09-19T08:52:30.819 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.817+0000 7f42217fa640 1 -- 172.21.15.19:0/961608561 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f4214042030 con 0x7f4224100a40 2024-09-19T08:52:30.819 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.817+0000 7f422d28f740 1 Processor -- start 2024-09-19T08:52:30.819 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.817+0000 7f422d28f740 1 -- start start 2024-09-19T08:52:30.820 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.818+0000 7f422d28f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0919b09a0 0x55e0919b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:30.820 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.818+0000 7f422d28f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0919b12e0 0x55e0919b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:30.820 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.818+0000 7f422d28f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0919b6370 0x55e0919b8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:30.820 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.818+0000 7f422d28f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e0919142f0 con 0x55e0919b09a0 2024-09-19T08:52:30.820 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.818+0000 7f422d28f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55e0918bc270 con 0x55e0919b6370 2024-09-19T08:52:30.820 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:30 smithi019 ceph-mon[30976]: scrub summary: idle 2024-09-19T08:52:30.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.818+0000 7f422d28f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e0919102b0 con 0x55e0919b12e0 2024-09-19T08:52:30.826 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.818+0000 7f42289bb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0919b09a0 0x55e0919b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:30.826 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.818+0000 7f42289bb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0919b09a0 0x55e0919b0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49008/0 (socket says 172.21.15.19:49008) 2024-09-19T08:52:30.826 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.818+0000 7f42289bb640 1 -- 172.21.15.19:0/1719906735 learned_addr learned my addr 172.21.15.19:0/1719906735 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:30.826 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.818+0000 7f4223fff640 1 --2- 172.21.15.19:0/1719906735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0919b12e0 0x55e0919b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:30.826 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.818+0000 7f42237fe640 1 --2- 172.21.15.19:0/1719906735 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0919b6370 0x55e0919b8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:30.826 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.818+0000 7f42289bb640 1 -- 172.21.15.19:0/1719906735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0919b12e0 msgr2=0x55e0919b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:30.826 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.818+0000 7f42289bb640 1 --2- 172.21.15.19:0/1719906735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0919b12e0 0x55e0919b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.826 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.818+0000 7f42289bb640 1 -- 172.21.15.19:0/1719906735 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0919b6370 msgr2=0x55e0919b8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:30.826 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.818+0000 7f42289bb640 1 --2- 172.21.15.19:0/1719906735 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0919b6370 0x55e0919b8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.826 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.818+0000 7f42289bb640 1 -- 172.21.15.19:0/1719906735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0918bb340 con 0x55e0919b09a0 2024-09-19T08:52:30.826 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.818+0000 7f42217fa640 1 --2- 172.21.15.19:0/961608561 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f420c0a3390 0x7f420c0a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:30.826 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.818+0000 7f42289bb640 1 --2- 172.21.15.19:0/1719906735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0919b09a0 0x55e0919b0da0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f421c007cf0 tx=0x7f421c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=235dab10a79d8bd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:30.827 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.819+0000 7f4223fff640 1 --2- 172.21.15.19:0/961608561 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f420c0a3390 0x7f420c0a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:30.827 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.819+0000 7f42217fa640 1 -- 172.21.15.19:0/961608561 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f42140f0100 con 0x7f4224100a40 2024-09-19T08:52:30.827 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.819+0000 7f420a7fc640 1 -- 172.21.15.19:0/1719906735 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421c014070 con 0x55e0919b09a0 2024-09-19T08:52:30.827 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.819+0000 7f420a7fc640 1 -- 172.21.15.19:0/1719906735 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f421c00fb30 con 0x55e0919b09a0 2024-09-19T08:52:30.827 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.819+0000 7f420a7fc640 1 -- 172.21.15.19:0/1719906735 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421c00ebc0 con 0x55e0919b09a0 2024-09-19T08:52:30.827 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.820+0000 7f422d28f740 1 -- 172.21.15.19:0/1719906735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0919b09a0 msgr2=0x55e0919b0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:30.827 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.820+0000 7f4223fff640 1 --2- 172.21.15.19:0/961608561 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f420c0a3390 0x7f420c0a5850 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f42140b8f80 tx=0x7f42140f3bf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:30.827 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.820+0000 7f422d28f740 1 --2- 172.21.15.19:0/1719906735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0919b09a0 0x55e0919b0da0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f421c007cf0 tx=0x7f421c00c6a0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.827 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.820+0000 7f422d28f740 1 -- 172.21.15.19:0/1719906735 shutdown_connections 2024-09-19T08:52:30.827 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.820+0000 7f422d28f740 1 --2- 172.21.15.19:0/1719906735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0919b12e0 0x55e0919b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.827 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.820+0000 7f422d28f740 1 --2- 172.21.15.19:0/1719906735 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0919b6370 0x55e0919b8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.827 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.820+0000 7f422d28f740 1 --2- 172.21.15.19:0/1719906735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0919b09a0 0x55e0919b0da0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.827 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.820+0000 7f422d28f740 1 -- 172.21.15.19:0/1719906735 >> 172.21.15.19:0/1719906735 conn(0x55e0919ac010 msgr2=0x55e0919ac410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:30.828 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.820+0000 7f422d28f740 1 -- 172.21.15.19:0/1719906735 shutdown_connections 2024-09-19T08:52:30.828 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.820+0000 7f422d28f740 1 -- 172.21.15.19:0/1719906735 wait complete. 2024-09-19T08:52:30.828 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.820+0000 7f422d28f740 1 -- start start 2024-09-19T08:52:30.828 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.820+0000 7f422d28f740 1 Processor -- start 2024-09-19T08:52:30.828 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.821+0000 7f422d28f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0919b09a0 0x55e0919bf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:30.828 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.821+0000 7f422d28f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0919b12e0 0x55e0919bf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:30.828 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.821+0000 7f422d28f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0919b6370 0x55e0919c6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:30.828 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.821+0000 7f422d28f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e0919bd750 con 0x55e0919b12e0 2024-09-19T08:52:30.828 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.821+0000 7f422d28f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55e09189d290 con 0x55e0919b09a0 2024-09-19T08:52:30.828 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.821+0000 7f422d28f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e0919bd8d0 con 0x55e0919b6370 2024-09-19T08:52:30.828 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.821+0000 7f422d28f740 10 client.0 _ll_register_callbacks cb 0x55e0918ce140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:30.828 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.821+0000 7f42237fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0919b12e0 0x55e0919bf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:30.828 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.821+0000 7f42237fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0919b12e0 0x55e0919bf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49024/0 (socket says 172.21.15.19:49024) 2024-09-19T08:52:30.829 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.821+0000 7f42237fe640 1 -- 172.21.15.19:0/2959805126 learned_addr learned my addr 172.21.15.19:0/2959805126 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:30.829 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.821+0000 7f42289bb640 1 --2- 172.21.15.19:0/2959805126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0919b6370 0x55e0919c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:30.829 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.821+0000 7f42289bb640 1 --2- 172.21.15.19:0/2959805126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0919b09a0 0x55e0919bf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:30.829 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.821+0000 7f42237fe640 1 -- 172.21.15.19:0/2959805126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0919b6370 msgr2=0x55e0919c6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:30.829 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.821+0000 7f42237fe640 1 --2- 172.21.15.19:0/2959805126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0919b6370 0x55e0919c6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.829 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.821+0000 7f42237fe640 1 -- 172.21.15.19:0/2959805126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0919b09a0 msgr2=0x55e0919bf0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:30.829 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.821+0000 7f42237fe640 1 --2- 172.21.15.19:0/2959805126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0919b09a0 0x55e0919bf0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.829 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.821+0000 7f42237fe640 1 -- 172.21.15.19:0/2959805126 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e091627210 con 0x55e0919b12e0 2024-09-19T08:52:30.829 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.821+0000 7f42289bb640 1 --2- 172.21.15.19:0/2959805126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0919b09a0 0x55e0919bf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:30.829 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.821+0000 7f42237fe640 1 --2- 172.21.15.19:0/2959805126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0919b12e0 0x55e0919bf600 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f421800be10 tx=0x7f42180117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb7f2a3725601c98 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:30.829 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.821+0000 7f42037fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:52:30.829 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.821+0000 7f42037fe640 1 -- 172.21.15.19:0/2959805126 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4218012650 con 0x55e0919b12e0 2024-09-19T08:52:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.821+0000 7f42037fe640 1 -- 172.21.15.19:0/2959805126 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f42180127f0 con 0x55e0919b12e0 2024-09-19T08:52:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.821+0000 7f422d28f740 1 -- 172.21.15.19:0/2959805126 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f421c00fb30 con 0x55e0919b12e0 2024-09-19T08:52:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.822+0000 7f42037fe640 1 -- 172.21.15.19:0/2959805126 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f42180129f0 con 0x55e0919b12e0 2024-09-19T08:52:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.822+0000 7f422d28f740 10 client.15375 fetch_fsmap learned FSMap version 28 2024-09-19T08:52:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.822+0000 7f422d28f740 1 -- 172.21.15.19:0/2959805126 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e0916f3620 con 0x55e0919b12e0 2024-09-19T08:52:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.822+0000 7f42037fe640 1 -- 172.21.15.19:0/2959805126 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f421c00fb30 con 0x55e0919b12e0 2024-09-19T08:52:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.822+0000 7f42037fe640 1 -- 172.21.15.19:0/2959805126 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f42180253f0 con 0x55e0919b12e0 2024-09-19T08:52:30.830 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.822+0000 7f422d28f740 10 client.15375 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:52:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.822+0000 7f422d28f740 10 client.15375 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.822+0000 7f422d28f740 20 client.15375 populate_metadata read hostname 'smithi019' 2024-09-19T08:52:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.822+0000 7f422d28f740 1 --2- 172.21.15.19:0/2959805126 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e0919cac80 0x55e0919cd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.822+0000 7f422d28f740 4 client.15375 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.822+0000 7f422d28f740 1 -- 172.21.15.19:0/2959805126 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e091921a20 con 0x55e0919cac80 2024-09-19T08:52:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.822+0000 7f42289bb640 1 --2- 172.21.15.19:0/2959805126 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e0919cac80 0x55e0919cd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.823+0000 7f42037fe640 10 client.15375 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:52:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.823+0000 7f42289bb640 1 --2- 172.21.15.19:0/2959805126 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e0919cac80 0x55e0919cd0d0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9901eee9b7d33622 server_cookie=79b8f91d56f3e021 in_seq=0 out_seq=0 2024-09-19T08:52:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.823+0000 7f42037fe640 1 -- 172.21.15.19:0/2959805126 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e091921a20 con 0x55e0919cac80 2024-09-19T08:52:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.823+0000 7f42037fe640 10 client.15375 handle_command_reply: tid=0 2024-09-19T08:52:30.831 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.823+0000 7f422d28f740 1 client.15375 shutdown 2024-09-19T08:52:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.824+0000 7f422d28f740 1 -- 172.21.15.19:0/2959805126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0919b12e0 msgr2=0x55e0919bf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.824+0000 7f422d28f740 1 --2- 172.21.15.19:0/2959805126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0919b12e0 0x55e0919bf600 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f421800be10 tx=0x7f42180117b0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.824+0000 7f422d28f740 1 -- 172.21.15.19:0/2959805126 shutdown_connections 2024-09-19T08:52:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.824+0000 7f422d28f740 1 --2- 172.21.15.19:0/2959805126 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e0919cac80 0x55e0919cd0d0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.824+0000 7f422d28f740 1 --2- 172.21.15.19:0/2959805126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0919b6370 0x55e0919c6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.824+0000 7f422d28f740 1 --2- 172.21.15.19:0/2959805126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0919b12e0 0x55e0919bf600 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.824+0000 7f422d28f740 1 --2- 172.21.15.19:0/2959805126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0919b09a0 0x55e0919bf0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.824+0000 7f42037fe640 0 client.15375 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:52:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.824+0000 7f422d28f740 1 -- 172.21.15.19:0/2959805126 >> 172.21.15.19:0/2959805126 conn(0x55e0919ac010 msgr2=0x55e0919ad820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.824+0000 7f422d28f740 1 -- 172.21.15.19:0/2959805126 shutdown_connections 2024-09-19T08:52:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.824+0000 7f422d28f740 1 -- 172.21.15.19:0/2959805126 wait complete. 2024-09-19T08:52:30.832 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.824+0000 7f422d28f740 20 client.15375 trim_cache size 0 max 16384 2024-09-19T08:52:30.840 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.838+0000 7f422d28f740 1 Processor -- start 2024-09-19T08:52:30.840 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.838+0000 7f422d28f740 1 -- start start 2024-09-19T08:52:30.840 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.839+0000 7f422d28f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0919b09a0 0x55e0919ace90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:30.840 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.839+0000 7f422d28f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0919b12e0 0x55e0919c6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:30.841 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.839+0000 7f422d28f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0919b6370 0x55e0919ad3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:30.841 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.839+0000 7f422d28f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f42241a6d50 con 0x55e0919b6370 2024-09-19T08:52:30.841 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.839+0000 7f422d28f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f42241a8890 con 0x55e0919b09a0 2024-09-19T08:52:30.841 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.839+0000 7f422d28f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f42241a7420 con 0x55e0919b12e0 2024-09-19T08:52:30.841 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.839+0000 7f42289bb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0919b6370 0x55e0919ad3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:30.841 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.839+0000 7f42289bb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0919b6370 0x55e0919ad3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49028/0 (socket says 172.21.15.19:49028) 2024-09-19T08:52:30.841 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.839+0000 7f42289bb640 1 -- 172.21.15.19:0/3433665193 learned_addr learned my addr 172.21.15.19:0/3433665193 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:30.841 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.839+0000 7f42289bb640 1 --2- 172.21.15.19:0/3433665193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0919b09a0 0x55e0919ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:30.841 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.839+0000 7f42237fe640 1 --2- 172.21.15.19:0/3433665193 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0919b12e0 0x55e0919c6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:30.841 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.839+0000 7f42289bb640 1 -- 172.21.15.19:0/3433665193 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0919b12e0 msgr2=0x55e0919c6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:30.841 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.839+0000 7f42289bb640 1 --2- 172.21.15.19:0/3433665193 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0919b12e0 0x55e0919c6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.841 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.839+0000 7f42289bb640 1 -- 172.21.15.19:0/3433665193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0919b09a0 msgr2=0x55e0919ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:30.842 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.839+0000 7f42289bb640 1 --2- 172.21.15.19:0/3433665193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0919b09a0 0x55e0919ace90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.842 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.839+0000 7f42289bb640 1 -- 172.21.15.19:0/3433665193 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0919abe30 con 0x55e0919b6370 2024-09-19T08:52:30.842 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.839+0000 7f42289bb640 1 --2- 172.21.15.19:0/3433665193 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0919b6370 0x55e0919ad3d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f421c007cf0 tx=0x7f421c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cca3ff0e12ef4672 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:30.842 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.839+0000 7f4209ffb640 1 -- 172.21.15.19:0/3433665193 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421c014070 con 0x55e0919b6370 2024-09-19T08:52:30.842 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.839+0000 7f4209ffb640 1 -- 172.21.15.19:0/3433665193 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f421c0039f0 con 0x55e0919b6370 2024-09-19T08:52:30.842 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.839+0000 7f4209ffb640 1 -- 172.21.15.19:0/3433665193 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421c004040 con 0x55e0919b6370 2024-09-19T08:52:30.846 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.840+0000 7f422d28f740 1 -- 172.21.15.19:0/3433665193 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0919b6370 msgr2=0x55e0919ad3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:30.846 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.840+0000 7f422d28f740 1 --2- 172.21.15.19:0/3433665193 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0919b6370 0x55e0919ad3d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f421c007cf0 tx=0x7f421c00c6a0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.846 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.840+0000 7f422d28f740 1 -- 172.21.15.19:0/3433665193 shutdown_connections 2024-09-19T08:52:30.846 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.840+0000 7f422d28f740 1 --2- 172.21.15.19:0/3433665193 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0919b12e0 0x55e0919c6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.846 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.840+0000 7f422d28f740 1 --2- 172.21.15.19:0/3433665193 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0919b6370 0x55e0919ad3d0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.846 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.840+0000 7f422d28f740 1 --2- 172.21.15.19:0/3433665193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0919b09a0 0x55e0919ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.846 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.840+0000 7f422d28f740 1 -- 172.21.15.19:0/3433665193 >> 172.21.15.19:0/3433665193 conn(0x55e0919ac010 msgr2=0x55e0919bf0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:30.846 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.840+0000 7f422d28f740 1 -- 172.21.15.19:0/3433665193 shutdown_connections 2024-09-19T08:52:30.846 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.840+0000 7f422d28f740 1 -- 172.21.15.19:0/3433665193 wait complete. 2024-09-19T08:52:30.847 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.841+0000 7f422d28f740 1 -- start start 2024-09-19T08:52:30.847 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.841+0000 7f422d28f740 1 Processor -- start 2024-09-19T08:52:30.847 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.841+0000 7f422d28f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0919b09a0 0x55e0919c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:30.847 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.841+0000 7f422d28f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0919b12e0 0x55e0919c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:30.847 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.841+0000 7f422d28f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0919b6370 0x55e0919c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:30.847 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.841+0000 7f422d28f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f42241a81c0 con 0x55e0919b09a0 2024-09-19T08:52:30.847 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.841+0000 7f422d28f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f42241a7af0 con 0x55e0919b12e0 2024-09-19T08:52:30.847 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.841+0000 7f422d28f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f42241a4d30 con 0x55e0919b6370 2024-09-19T08:52:30.847 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.841+0000 7f422d28f740 10 client.0 _ll_register_callbacks cb 0x7f421800b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:30.847 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.841+0000 7f42289bb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0919b09a0 0x55e0919c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:30.847 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.841+0000 7f42289bb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0919b09a0 0x55e0919c3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49036/0 (socket says 172.21.15.19:49036) 2024-09-19T08:52:30.848 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.841+0000 7f42289bb640 1 -- 172.21.15.19:0/3053278023 learned_addr learned my addr 172.21.15.19:0/3053278023 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:30.848 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.841+0000 7f42237fe640 1 --2- 172.21.15.19:0/3053278023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0919b12e0 0x55e0919c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:30.848 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.842+0000 7f42289bb640 1 -- 172.21.15.19:0/3053278023 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0919b6370 msgr2=0x55e0919c50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:30.848 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.842+0000 7f42289bb640 1 --2- 172.21.15.19:0/3053278023 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0919b6370 0x55e0919c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.848 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.842+0000 7f42289bb640 1 -- 172.21.15.19:0/3053278023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0919b12e0 msgr2=0x55e0919c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:30.848 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.842+0000 7f42289bb640 1 --2- 172.21.15.19:0/3053278023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0919b12e0 0x55e0919c40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.848 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.842+0000 7f42289bb640 1 -- 172.21.15.19:0/3053278023 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0919c5700 con 0x55e0919b09a0 2024-09-19T08:52:30.848 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.842+0000 7f42237fe640 1 --2- 172.21.15.19:0/3053278023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0919b12e0 0x55e0919c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:30.848 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.842+0000 7f42289bb640 1 --2- 172.21.15.19:0/3053278023 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0919b09a0 0x55e0919c3ba0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f421c002230 tx=0x7f421c00edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2964a15275d8128 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:30.848 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.842+0000 7f42037fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:52:30.848 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.842+0000 7f42037fe640 1 -- 172.21.15.19:0/3053278023 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421c014040 con 0x55e0919b09a0 2024-09-19T08:52:30.848 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.842+0000 7f42037fe640 1 -- 172.21.15.19:0/3053278023 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f421c02d050 con 0x55e0919b09a0 2024-09-19T08:52:30.849 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.842+0000 7f422d28f740 1 -- 172.21.15.19:0/3053278023 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f421c0039f0 con 0x55e0919b09a0 2024-09-19T08:52:30.849 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.842+0000 7f42037fe640 1 -- 172.21.15.19:0/3053278023 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f421c003ba0 con 0x55e0919b09a0 2024-09-19T08:52:30.849 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.842+0000 7f422d28f740 10 client.15381 fetch_fsmap learned FSMap version 28 2024-09-19T08:52:30.849 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.842+0000 7f422d28f740 1 -- 172.21.15.19:0/3053278023 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e091a359b0 con 0x55e0919b09a0 2024-09-19T08:52:30.849 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.842+0000 7f42037fe640 1 -- 172.21.15.19:0/3053278023 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f421c0039f0 con 0x55e0919b09a0 2024-09-19T08:52:30.849 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.843+0000 7f42037fe640 1 -- 172.21.15.19:0/3053278023 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f421c0044d0 con 0x55e0919b09a0 2024-09-19T08:52:30.849 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.843+0000 7f422d28f740 10 client.15381 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:52:30.849 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.843+0000 7f422d28f740 10 client.15381 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:30.849 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.843+0000 7f422d28f740 20 client.15381 populate_metadata read hostname 'smithi019' 2024-09-19T08:52:30.849 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.843+0000 7f422d28f740 1 --2- 172.21.15.19:0/3053278023 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e091a36100 0x55e091a38520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:30.849 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.843+0000 7f422d28f740 4 client.15381 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:52:30.849 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.843+0000 7f422d28f740 1 -- 172.21.15.19:0/3053278023 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e09191bd70 con 0x55e091a36100 2024-09-19T08:52:30.849 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.843+0000 7f42237fe640 1 --2- 172.21.15.19:0/3053278023 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e091a36100 0x55e091a38520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:30.850 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.843+0000 7f42237fe640 1 --2- 172.21.15.19:0/3053278023 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e091a36100 0x55e091a38520 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62d038f41d570022 server_cookie=670611c8e2dc6f60 in_seq=0 out_seq=0 2024-09-19T08:52:30.850 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.843+0000 7f42037fe640 10 client.15381 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:52:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.854+0000 7f42037fe640 1 -- 172.21.15.19:0/3053278023 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e09191bd70 con 0x55e091a36100 2024-09-19T08:52:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.854+0000 7f42037fe640 10 client.15381 handle_command_reply: tid=0 2024-09-19T08:52:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.854+0000 7f422d28f740 1 client.15381 shutdown 2024-09-19T08:52:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.855+0000 7f422d28f740 1 -- 172.21.15.19:0/3053278023 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0919b09a0 msgr2=0x55e0919c3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.855+0000 7f422d28f740 1 --2- 172.21.15.19:0/3053278023 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0919b09a0 0x55e0919c3ba0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f421c002230 tx=0x7f421c00edd0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.855+0000 7f422d28f740 1 -- 172.21.15.19:0/3053278023 shutdown_connections 2024-09-19T08:52:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.855+0000 7f422d28f740 1 --2- 172.21.15.19:0/3053278023 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e091a36100 0x55e091a38520 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.855+0000 7f422d28f740 1 --2- 172.21.15.19:0/3053278023 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0919b6370 0x55e0919c50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.856 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.855+0000 7f422d28f740 1 --2- 172.21.15.19:0/3053278023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0919b12e0 0x55e0919c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.857 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.855+0000 7f42037fe640 0 client.15381 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:52:30.857 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.855+0000 7f422d28f740 1 --2- 172.21.15.19:0/3053278023 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0919b09a0 0x55e0919c3ba0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.857 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.855+0000 7f422d28f740 1 -- 172.21.15.19:0/3053278023 >> 172.21.15.19:0/3053278023 conn(0x55e0919ac010 msgr2=0x55e0919aa9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:30.857 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.855+0000 7f422d28f740 1 -- 172.21.15.19:0/3053278023 shutdown_connections 2024-09-19T08:52:30.857 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.855+0000 7f422d28f740 1 -- 172.21.15.19:0/3053278023 wait complete. 2024-09-19T08:52:30.857 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.855+0000 7f422d28f740 20 client.15381 trim_cache size 0 max 16384 2024-09-19T08:52:30.858 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T08:52:30.858 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T08:52:30.858 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T08:52:30.858 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T08:52:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.855+0000 7f422a41e640 1 -- 172.21.15.19:0/961608561 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f420c0a3390 msgr2=0x7f420c0a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.855+0000 7f422a41e640 1 --2- 172.21.15.19:0/961608561 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f420c0a3390 0x7f420c0a5850 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f42140b8f80 tx=0x7f42140f3bf0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.855+0000 7f422a41e640 1 -- 172.21.15.19:0/961608561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4224100a40 msgr2=0x7f422406a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.855+0000 7f422a41e640 1 --2- 172.21.15.19:0/961608561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4224100a40 0x7f422406a410 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4214031610 tx=0x7f42140043b0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.856+0000 7f422a41e640 1 -- 172.21.15.19:0/961608561 shutdown_connections 2024-09-19T08:52:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.856+0000 7f422a41e640 1 --2- 172.21.15.19:0/961608561 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f420c0a3390 0x7f420c0a5850 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.856+0000 7f422a41e640 1 --2- 172.21.15.19:0/961608561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4224101c30 0x7f422419cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.856+0000 7f422a41e640 1 --2- 172.21.15.19:0/961608561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f42241025f0 0x7f422419f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.856+0000 7f422a41e640 1 --2- 172.21.15.19:0/961608561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4224100a40 0x7f422406a410 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.856+0000 7f422a41e640 1 -- 172.21.15.19:0/961608561 >> 172.21.15.19:0/961608561 conn(0x7f42240fc1e0 msgr2=0x7f4224104f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.856+0000 7f422a41e640 1 -- 172.21.15.19:0/961608561 shutdown_connections 2024-09-19T08:52:30.859 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:30.856+0000 7f422a41e640 1 -- 172.21.15.19:0/961608561 wait complete. 2024-09-19T08:52:30.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:30 smithi203 ceph-mon[35450]: scrub summary: idle 2024-09-19T08:52:31.074 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:30 smithi155 ceph-mon[34921]: scrub summary: idle 2024-09-19T08:52:31.563 INFO:teuthology.orchestra.run.smithi019.stdout:{"run_dir":"/var/run/ceph"} 2024-09-19T08:52:31.563 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-19T08:52:31.563 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 1747 2024-09-19T08:52:31.564 DEBUG:tasks.quiescer:Yielding 2024-09-19T08:52:31.564 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T08:52:32.306 INFO:tasks.workunit:Pulling workunits from ref 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T08:52:32.307 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T08:52:32.307 INFO:tasks.workunit:timeout=3h 2024-09-19T08:52:32.307 INFO:tasks.workunit:cleanup=True 2024-09-19T08:52:32.308 DEBUG:teuthology.orchestra.run.smithi019:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T08:52:32.308 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:52:32.310 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:31 smithi203 ceph-mon[35450]: pgmap v346: 97 pgs: 97 active+clean; 653 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-19T08:52:32.310 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:31 smithi155 ceph-mon[34921]: pgmap v346: 97 pgs: 97 active+clean; 653 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-19T08:52:32.310 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:31 smithi019 ceph-mon[30976]: pgmap v346: 97 pgs: 97 active+clean; 653 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-19T08:52:32.331 INFO:teuthology.orchestra.run.smithi019.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-19T08:52:32.331 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-19T08:52:32.331 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 78h/120d Inode: 1099511628283 Links: 2 2024-09-19T08:52:32.331 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T08:52:32.331 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-19T08:52:32.331 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-09-19 08:50:34.783657278 +0000 2024-09-19T08:52:32.331 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-09-19 08:50:34.783657278 +0000 2024-09-19T08:52:32.331 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-09-19 08:52:08.128897816 +0000 2024-09-19T08:52:32.331 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-09-19 08:50:34.783657278 +0000 2024-09-19T08:52:32.332 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-19T08:52:32.332 DEBUG:teuthology.orchestra.run.smithi019:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-19T08:52:32.410 DEBUG:teuthology.orchestra.run.smithi019:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T08:52:32.468 INFO:tasks.workunit.client.0.smithi019.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T08:52:32.586 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:33.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.095+0000 7f0d95ec2640 1 -- 172.21.15.19:0/1382567914 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d90100e20 msgr2=0x7f0d90101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:33.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.095+0000 7f0d95ec2640 1 --2- 172.21.15.19:0/1382567914 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d90100e20 0x7f0d90101200 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0d80009900 tx=0x7f0d8002a480 comp rx=0 tx=0).stop 2024-09-19T08:52:33.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.095+0000 7f0d95ec2640 1 -- 172.21.15.19:0/1382567914 shutdown_connections 2024-09-19T08:52:33.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.095+0000 7f0d95ec2640 1 --2- 172.21.15.19:0/1382567914 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0d90102570 0x7f0d901029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.095+0000 7f0d95ec2640 1 --2- 172.21.15.19:0/1382567914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d90102ef0 0x7f0d9010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.095+0000 7f0d95ec2640 1 --2- 172.21.15.19:0/1382567914 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d90100e20 0x7f0d90101200 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.095+0000 7f0d95ec2640 1 -- 172.21.15.19:0/1382567914 >> 172.21.15.19:0/1382567914 conn(0x7f0d900fc7d0 msgr2=0x7f0d900febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:33.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.095+0000 7f0d95ec2640 1 -- 172.21.15.19:0/1382567914 shutdown_connections 2024-09-19T08:52:33.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.095+0000 7f0d95ec2640 1 -- 172.21.15.19:0/1382567914 wait complete. 2024-09-19T08:52:33.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.096+0000 7f0d95ec2640 1 Processor -- start 2024-09-19T08:52:33.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.096+0000 7f0d95ec2640 1 -- start start 2024-09-19T08:52:33.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.096+0000 7f0d95ec2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d90100e20 0x7f0d901993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:33.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.096+0000 7f0d95ec2640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0d90102570 0x7f0d90199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:33.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.096+0000 7f0d95ec2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d90102ef0 0x7f0d901a4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:33.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.096+0000 7f0d95ec2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0d90110f80 con 0x7f0d90100e20 2024-09-19T08:52:33.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.096+0000 7f0d95ec2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0d90110e00 con 0x7f0d90102ef0 2024-09-19T08:52:33.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.096+0000 7f0d95ec2640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0d90111100 con 0x7f0d90102570 2024-09-19T08:52:33.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.097+0000 7f0d8f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d90100e20 0x7f0d901993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:33.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.097+0000 7f0d8f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d90100e20 0x7f0d901993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49058/0 (socket says 172.21.15.19:49058) 2024-09-19T08:52:33.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.097+0000 7f0d8f7fe640 1 -- 172.21.15.19:0/2171000928 learned_addr learned my addr 172.21.15.19:0/2171000928 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:33.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.097+0000 7f0d8ffff640 1 --2- 172.21.15.19:0/2171000928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d90102ef0 0x7f0d901a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:33.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.097+0000 7f0d8effd640 1 --2- 172.21.15.19:0/2171000928 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0d90102570 0x7f0d90199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:33.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.097+0000 7f0d8f7fe640 1 -- 172.21.15.19:0/2171000928 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0d90102570 msgr2=0x7f0d90199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:33.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.097+0000 7f0d8f7fe640 1 --2- 172.21.15.19:0/2171000928 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0d90102570 0x7f0d90199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.097+0000 7f0d8f7fe640 1 -- 172.21.15.19:0/2171000928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d90102ef0 msgr2=0x7f0d901a4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:33.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.097+0000 7f0d8f7fe640 1 --2- 172.21.15.19:0/2171000928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d90102ef0 0x7f0d901a4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.097+0000 7f0d8f7fe640 1 -- 172.21.15.19:0/2171000928 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d901a4990 con 0x7f0d90100e20 2024-09-19T08:52:33.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.097+0000 7f0d8f7fe640 1 --2- 172.21.15.19:0/2171000928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d90100e20 0x7f0d901993d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0d80006010 tx=0x7f0d80003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:33.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.097+0000 7f0d8cff9640 1 -- 172.21.15.19:0/2171000928 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d8003f070 con 0x7f0d90100e20 2024-09-19T08:52:33.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.097+0000 7f0d95ec2640 1 -- 172.21.15.19:0/2171000928 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d901a4b60 con 0x7f0d90100e20 2024-09-19T08:52:33.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.097+0000 7f0d8cff9640 1 -- 172.21.15.19:0/2171000928 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0d80031c30 con 0x7f0d90100e20 2024-09-19T08:52:33.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.097+0000 7f0d8cff9640 1 -- 172.21.15.19:0/2171000928 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d80035030 con 0x7f0d90100e20 2024-09-19T08:52:33.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.097+0000 7f0d95ec2640 1 -- 172.21.15.19:0/2171000928 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d901a5010 con 0x7f0d90100e20 2024-09-19T08:52:33.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.099+0000 7f0d95ec2640 1 -- 172.21.15.19:0/2171000928 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d90101200 con 0x7f0d90100e20 2024-09-19T08:52:33.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.100+0000 7f0d8cff9640 1 -- 172.21.15.19:0/2171000928 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f0d80042070 con 0x7f0d90100e20 2024-09-19T08:52:33.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.100+0000 7f0d8cff9640 1 --2- 172.21.15.19:0/2171000928 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f0d780a32d0 0x7f0d780a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:33.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.101+0000 7f0d8cff9640 1 -- 172.21.15.19:0/2171000928 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0d800f0700 con 0x7f0d90100e20 2024-09-19T08:52:33.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.101+0000 7f0d8effd640 1 --2- 172.21.15.19:0/2171000928 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f0d780a32d0 0x7f0d780a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:33.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.101+0000 7f0d8effd640 1 --2- 172.21.15.19:0/2171000928 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f0d780a32d0 0x7f0d780a5790 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0d9006aac0 tx=0x7f0d8400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:33.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.104+0000 7f0d8cff9640 1 -- 172.21.15.19:0/2171000928 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0d80031de0 con 0x7f0d90100e20 2024-09-19T08:52:33.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.318+0000 7f0d95ec2640 1 -- 172.21.15.19:0/2171000928 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d90109090 con 0x7f0d90100e20 2024-09-19T08:52:33.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.319+0000 7f0d8cff9640 1 -- 172.21.15.19:0/2171000928 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11983 (secure 0 0 0) 0x7f0d800bcce0 con 0x7f0d90100e20 2024-09-19T08:52:33.319 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:52:33.319 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":28,"btime":"2024-09-19T08:52:09:653615+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2452068876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2452068876},{"type":"v1","addr":"172.21.15.19:6839","nonce":2452068876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T08:52:08.813945+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/2480841559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2480841559},{"type":"v1","addr":"172.21.15.155:6835","nonce":2480841559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24463,24464,24490,24469,24497]},"id":1}]} 2024-09-19T08:52:33.320 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 28 2024-09-19T08:52:33.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.322+0000 7f0d95ec2640 1 -- 172.21.15.19:0/2171000928 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f0d780a32d0 msgr2=0x7f0d780a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:33.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.322+0000 7f0d95ec2640 1 --2- 172.21.15.19:0/2171000928 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f0d780a32d0 0x7f0d780a5790 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0d9006aac0 tx=0x7f0d8400b390 comp rx=0 tx=0).stop 2024-09-19T08:52:33.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.322+0000 7f0d95ec2640 1 -- 172.21.15.19:0/2171000928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d90100e20 msgr2=0x7f0d901993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:33.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.322+0000 7f0d95ec2640 1 --2- 172.21.15.19:0/2171000928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d90100e20 0x7f0d901993d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0d80006010 tx=0x7f0d80003c10 comp rx=0 tx=0).stop 2024-09-19T08:52:33.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.322+0000 7f0d95ec2640 1 -- 172.21.15.19:0/2171000928 shutdown_connections 2024-09-19T08:52:33.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.322+0000 7f0d95ec2640 1 --2- 172.21.15.19:0/2171000928 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f0d780a32d0 0x7f0d780a5790 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.322+0000 7f0d95ec2640 1 --2- 172.21.15.19:0/2171000928 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0d90102570 0x7f0d90199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.322+0000 7f0d95ec2640 1 --2- 172.21.15.19:0/2171000928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0d90102ef0 0x7f0d901a4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.322+0000 7f0d95ec2640 1 --2- 172.21.15.19:0/2171000928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0d90100e20 0x7f0d901993d0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:33.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.322+0000 7f0d95ec2640 1 -- 172.21.15.19:0/2171000928 >> 172.21.15.19:0/2171000928 conn(0x7f0d900fc7d0 msgr2=0x7f0d900fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:33.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.322+0000 7f0d95ec2640 1 -- 172.21.15.19:0/2171000928 shutdown_connections 2024-09-19T08:52:33.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:33.322+0000 7f0d95ec2640 1 -- 172.21.15.19:0/2171000928 wait complete. 2024-09-19T08:52:33.968 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T08:50:16.477197+0000', 'modified': '2024-09-19T08:52:08.813945+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24497, 'mds_1': 24490, 'mds_2': 24469, 'mds_3': 24464, 'mds_4': 24463}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14619': {'gid': 14619, 'name': 'a', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.19:6841/1973648402', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6840', 'nonce': 1973648402}, {'type': 'v1', 'addr': '172.21.15.19:6841', 'nonce': 1973648402}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24418': {'gid': 24418, 'name': 'l', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.203:6833/471920691', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6832', 'nonce': 471920691}, {'type': 'v1', 'addr': '172.21.15.203:6833', 'nonce': 471920691}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24419': {'gid': 24419, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.155:6833/3575511501', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6832', 'nonce': 3575511501}, {'type': 'v1', 'addr': '172.21.15.155:6833', 'nonce': 3575511501}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24431': {'gid': 24431, 'name': 'j', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.19:6835/805488508', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.19:6834', 'nonce': 805488508}, {'type': 'v1', 'addr': '172.21.15.19:6835', 'nonce': 805488508}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24449': {'gid': 24449, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.155:6835/2480841559', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6834', 'nonce': 2480841559}, {'type': 'v1', 'addr': '172.21.15.155:6835', 'nonce': 2480841559}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24463': {'gid': 24463, 'name': 'f', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.203:6835/2702758353', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6834', 'nonce': 2702758353}, {'type': 'v1', 'addr': '172.21.15.203:6835', 'nonce': 2702758353}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24464': {'gid': 24464, 'name': 'h', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.155:6837/3381010945', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6836', 'nonce': 3381010945}, {'type': 'v1', 'addr': '172.21.15.155:6837', 'nonce': 3381010945}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24469': {'gid': 24469, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.203:6837/3684671619', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6836', 'nonce': 3684671619}, {'type': 'v1', 'addr': '172.21.15.203:6837', 'nonce': 3684671619}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24490': {'gid': 24490, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.203:6839/2547507299', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6838', 'nonce': 2547507299}, {'type': 'v1', 'addr': '172.21.15.203:6839', 'nonce': 2547507299}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24497': {'gid': 24497, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.155:6839/1224030981', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.155:6838', 'nonce': 1224030981}, {'type': 'v1', 'addr': '172.21.15.155:6839', 'nonce': 1224030981}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24497, 'qdb_cluster': [24463, 24464, 24490, 24469, 24497]} 2024-09-19T08:52:33.969 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-19T08:52:33.969 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.f status 2024-09-19T08:52:34.032 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:33 smithi019 ceph-mon[30976]: pgmap v347: 97 pgs: 97 active+clean; 653 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2024-09-19T08:52:34.032 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:33 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/2171000928' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:52:34.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:33 smithi155 ceph-mon[34921]: pgmap v347: 97 pgs: 97 active+clean; 653 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2024-09-19T08:52:34.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:33 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/2171000928' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:52:34.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:33 smithi203 ceph-mon[35450]: pgmap v347: 97 pgs: 97 active+clean; 653 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 10 op/s 2024-09-19T08:52:34.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:33 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/2171000928' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:52:34.266 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:34.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.760+0000 7f7c7a032640 1 -- 172.21.15.19:0/1986512318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c74102d30 msgr2=0x7f7c74103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:34.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.760+0000 7f7c7a032640 1 --2- 172.21.15.19:0/1986512318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c74102d30 0x7f7c74103110 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f7c64009cd0 tx=0x7f7c6402a910 comp rx=0 tx=0).stop 2024-09-19T08:52:34.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.760+0000 7f7c7a032640 1 -- 172.21.15.19:0/1986512318 shutdown_connections 2024-09-19T08:52:34.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.760+0000 7f7c7a032640 1 --2- 172.21.15.19:0/1986512318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c741036e0 0x7f7c74107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.760+0000 7f7c7a032640 1 --2- 172.21.15.19:0/1986512318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c741082a0 0x7f7c7410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.760+0000 7f7c7a032640 1 --2- 172.21.15.19:0/1986512318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c74102d30 0x7f7c74103110 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.760+0000 7f7c7a032640 1 -- 172.21.15.19:0/1986512318 >> 172.21.15.19:0/1986512318 conn(0x7f7c740fc7d0 msgr2=0x7f7c740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:34.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.760+0000 7f7c7a032640 1 -- 172.21.15.19:0/1986512318 shutdown_connections 2024-09-19T08:52:34.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.760+0000 7f7c7a032640 1 -- 172.21.15.19:0/1986512318 wait complete. 2024-09-19T08:52:34.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.760+0000 7f7c7a032640 1 Processor -- start 2024-09-19T08:52:34.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.760+0000 7f7c7a032640 1 -- start start 2024-09-19T08:52:34.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.761+0000 7f7c7a032640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c74102d30 0x7f7c74198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:34.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.761+0000 7f7c7a032640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c741036e0 0x7f7c74198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:34.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.761+0000 7f7c7a032640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c741082a0 0x7f7c7419cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:34.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.761+0000 7f7c7a032640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7c741120e0 con 0x7f7c74102d30 2024-09-19T08:52:34.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.761+0000 7f7c7a032640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7c74111f60 con 0x7f7c741082a0 2024-09-19T08:52:34.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.761+0000 7f7c7a032640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7c74112260 con 0x7f7c741036e0 2024-09-19T08:52:34.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.761+0000 7f7c737fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c74102d30 0x7f7c74198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:34.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.761+0000 7f7c737fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c74102d30 0x7f7c74198620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49062/0 (socket says 172.21.15.19:49062) 2024-09-19T08:52:34.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.761+0000 7f7c737fe640 1 -- 172.21.15.19:0/1712736440 learned_addr learned my addr 172.21.15.19:0/1712736440 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:34.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.761+0000 7f7c72ffd640 1 --2- 172.21.15.19:0/1712736440 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c741036e0 0x7f7c74198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:34.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.761+0000 7f7c73fff640 1 --2- 172.21.15.19:0/1712736440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c741082a0 0x7f7c7419cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:34.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.761+0000 7f7c737fe640 1 -- 172.21.15.19:0/1712736440 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c741036e0 msgr2=0x7f7c74198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:34.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.761+0000 7f7c737fe640 1 --2- 172.21.15.19:0/1712736440 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c741036e0 0x7f7c74198b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.761+0000 7f7c737fe640 1 -- 172.21.15.19:0/1712736440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c741082a0 msgr2=0x7f7c7419cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:34.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.761+0000 7f7c737fe640 1 --2- 172.21.15.19:0/1712736440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c741082a0 0x7f7c7419cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.761+0000 7f7c737fe640 1 -- 172.21.15.19:0/1712736440 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c7419d5d0 con 0x7f7c74102d30 2024-09-19T08:52:34.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.761+0000 7f7c72ffd640 1 --2- 172.21.15.19:0/1712736440 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c741036e0 0x7f7c74198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:34.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.761+0000 7f7c737fe640 1 --2- 172.21.15.19:0/1712736440 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c74102d30 0x7f7c74198620 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f7c640098d0 tx=0x7f7c64031460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:34.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.762+0000 7f7c70ff9640 1 -- 172.21.15.19:0/1712736440 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c64031850 con 0x7f7c74102d30 2024-09-19T08:52:34.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.762+0000 7f7c70ff9640 1 -- 172.21.15.19:0/1712736440 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c64004520 con 0x7f7c74102d30 2024-09-19T08:52:34.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.762+0000 7f7c7a032640 1 -- 172.21.15.19:0/1712736440 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c7419d860 con 0x7f7c74102d30 2024-09-19T08:52:34.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.762+0000 7f7c70ff9640 1 -- 172.21.15.19:0/1712736440 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6402fe20 con 0x7f7c74102d30 2024-09-19T08:52:34.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.762+0000 7f7c7a032640 1 -- 172.21.15.19:0/1712736440 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c741a51a0 con 0x7f7c74102d30 2024-09-19T08:52:34.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.764+0000 7f7c70ff9640 1 -- 172.21.15.19:0/1712736440 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f7c64004040 con 0x7f7c74102d30 2024-09-19T08:52:34.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.764+0000 7f7c7c40b740 1 Processor -- start 2024-09-19T08:52:34.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.764+0000 7f7c7c40b740 1 -- start start 2024-09-19T08:52:34.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.765+0000 7f7c7c40b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562aeaed1890 0x562aeaed1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:34.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.765+0000 7f7c7c40b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562aeaed21b0 0x562aeaee0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:34.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.765+0000 7f7c7c40b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562aeaee0fc0 0x562aeaee33b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:34.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.765+0000 7f7c7c40b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562aeae38090 con 0x562aeaee0fc0 2024-09-19T08:52:34.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.765+0000 7f7c7c40b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x562aeaddfa70 con 0x562aeaed1890 2024-09-19T08:52:34.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.765+0000 7f7c7c40b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562aeae34050 con 0x562aeaed21b0 2024-09-19T08:52:34.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.765+0000 7f7c70ff9640 1 --2- 172.21.15.19:0/1712736440 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7c600a3350 0x7f7c600a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:34.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.765+0000 7f7c72ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562aeaee0fc0 0x562aeaee33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:34.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.765+0000 7f7c72ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562aeaee0fc0 0x562aeaee33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49066/0 (socket says 172.21.15.19:49066) 2024-09-19T08:52:34.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.765+0000 7f7c72ffd640 1 -- 172.21.15.19:0/4282384118 learned_addr learned my addr 172.21.15.19:0/4282384118 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:34.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.765+0000 7f7c73fff640 1 --2- 172.21.15.19:0/1712736440 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7c600a3350 0x7f7c600a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:34.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.765+0000 7f7c70ff9640 1 -- 172.21.15.19:0/1712736440 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7c640f1180 con 0x7f7c74102d30 2024-09-19T08:52:34.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.765+0000 7f7c737fe640 1 --2- 172.21.15.19:0/4282384118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562aeaed21b0 0x562aeaee0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:34.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.765+0000 7f7c73fff640 1 --2- 172.21.15.19:0/4282384118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562aeaed1890 0x562aeaed1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:34.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.765+0000 7f7c72ffd640 1 -- 172.21.15.19:0/4282384118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562aeaed21b0 msgr2=0x562aeaee0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:34.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.765+0000 7f7c72ffd640 1 --2- 172.21.15.19:0/4282384118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562aeaed21b0 0x562aeaee0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.765+0000 7f7c72ffd640 1 -- 172.21.15.19:0/4282384118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562aeaed1890 msgr2=0x562aeaed1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:34.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.765+0000 7f7c72ffd640 1 --2- 172.21.15.19:0/4282384118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562aeaed1890 0x562aeaed1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.765+0000 7f7c72ffd640 1 -- 172.21.15.19:0/4282384118 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aeadec130 con 0x562aeaee0fc0 2024-09-19T08:52:34.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.765+0000 7f7c73fff640 1 --2- 172.21.15.19:0/4282384118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562aeaed1890 0x562aeaed1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:34.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.765+0000 7f7c72ffd640 1 --2- 172.21.15.19:0/4282384118 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562aeaee0fc0 0x562aeaee33b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c0077a0 tx=0x7f7c5c007c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e50d25bbf01fd96e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:34.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.765+0000 7f7c73fff640 1 --2- 172.21.15.19:0/1712736440 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7c600a3350 0x7f7c600a5810 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c00dbe0 tx=0x7f7c6c005cc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:34.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.766+0000 7f7c69ffb640 1 -- 172.21.15.19:0/4282384118 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c00d950 con 0x562aeaee0fc0 2024-09-19T08:52:34.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.766+0000 7f7c69ffb640 1 -- 172.21.15.19:0/4282384118 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c5c018070 con 0x562aeaee0fc0 2024-09-19T08:52:34.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.766+0000 7f7c69ffb640 1 -- 172.21.15.19:0/4282384118 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c0123e0 con 0x562aeaee0fc0 2024-09-19T08:52:34.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.766+0000 7f7c7c40b740 1 -- 172.21.15.19:0/4282384118 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562aeaee0fc0 msgr2=0x562aeaee33b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:34.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.766+0000 7f7c7c40b740 1 --2- 172.21.15.19:0/4282384118 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562aeaee0fc0 0x562aeaee33b0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c0077a0 tx=0x7f7c5c007c60 comp rx=0 tx=0).stop 2024-09-19T08:52:34.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.767+0000 7f7c7c40b740 1 -- 172.21.15.19:0/4282384118 shutdown_connections 2024-09-19T08:52:34.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.767+0000 7f7c7c40b740 1 --2- 172.21.15.19:0/4282384118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562aeaed21b0 0x562aeaee0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.767+0000 7f7c7c40b740 1 --2- 172.21.15.19:0/4282384118 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562aeaee0fc0 0x562aeaee33b0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.767+0000 7f7c7c40b740 1 --2- 172.21.15.19:0/4282384118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562aeaed1890 0x562aeaed1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.767+0000 7f7c7c40b740 1 -- 172.21.15.19:0/4282384118 >> 172.21.15.19:0/4282384118 conn(0x562aeaecdf60 msgr2=0x562aeaece340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:34.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.767+0000 7f7c7c40b740 1 -- 172.21.15.19:0/4282384118 shutdown_connections 2024-09-19T08:52:34.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.767+0000 7f7c7c40b740 1 -- 172.21.15.19:0/4282384118 wait complete. 2024-09-19T08:52:34.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.767+0000 7f7c7c40b740 1 -- start start 2024-09-19T08:52:34.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.767+0000 7f7c7c40b740 1 Processor -- start 2024-09-19T08:52:34.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.767+0000 7f7c7c40b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562aeaed1890 0x562aeaee07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:34.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.767+0000 7f7c7c40b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562aeaed21b0 0x562aeaeddb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:34.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.767+0000 7f7c7c40b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562aeaee0fc0 0x562aeaede080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:34.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.767+0000 7f7c7c40b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562aeaee3b90 con 0x562aeaed1890 2024-09-19T08:52:34.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.767+0000 7f7c7c40b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x562aeadf2f20 con 0x562aeaed21b0 2024-09-19T08:52:34.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.767+0000 7f7c7c40b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562aeaee3d10 con 0x562aeaee0fc0 2024-09-19T08:52:34.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.767+0000 7f7c7c40b740 10 client.0 _ll_register_callbacks cb 0x562aeadbc030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:34.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.768+0000 7f7c737fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562aeaed1890 0x562aeaee07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:34.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.768+0000 7f7c737fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562aeaed1890 0x562aeaee07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49074/0 (socket says 172.21.15.19:49074) 2024-09-19T08:52:34.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.768+0000 7f7c737fe640 1 -- 172.21.15.19:0/428295468 learned_addr learned my addr 172.21.15.19:0/428295468 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:34.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.768+0000 7f7c737fe640 1 -- 172.21.15.19:0/428295468 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562aeaee0fc0 msgr2=0x562aeaede080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:34.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.768+0000 7f7c737fe640 1 --2- 172.21.15.19:0/428295468 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562aeaee0fc0 0x562aeaede080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.768+0000 7f7c72ffd640 1 --2- 172.21.15.19:0/428295468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562aeaed21b0 0x562aeaeddb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:34.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.768+0000 7f7c737fe640 1 -- 172.21.15.19:0/428295468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562aeaed21b0 msgr2=0x562aeaeddb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:34.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.768+0000 7f7c737fe640 1 --2- 172.21.15.19:0/428295468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562aeaed21b0 0x562aeaeddb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.768+0000 7f7c737fe640 1 -- 172.21.15.19:0/428295468 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aeaba92b0 con 0x562aeaed1890 2024-09-19T08:52:34.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.768+0000 7f7c737fe640 1 --2- 172.21.15.19:0/428295468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562aeaed1890 0x562aeaee07f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7c64009ca0 tx=0x7f7c640b9a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20fb1b7907a5811b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:34.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.768+0000 7f7c52ffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:52:34.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.768+0000 7f7c52ffd640 1 -- 172.21.15.19:0/428295468 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c640d5070 con 0x562aeaed1890 2024-09-19T08:52:34.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.768+0000 7f7c52ffd640 1 -- 172.21.15.19:0/428295468 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7c640046d0 con 0x562aeaed1890 2024-09-19T08:52:34.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.768+0000 7f7c7c40b740 1 -- 172.21.15.19:0/428295468 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c5c018070 con 0x562aeaed1890 2024-09-19T08:52:34.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.768+0000 7f7c52ffd640 1 -- 172.21.15.19:0/428295468 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7c640443d0 con 0x562aeaed1890 2024-09-19T08:52:34.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.768+0000 7f7c7c40b740 10 client.15399 fetch_fsmap learned FSMap version 28 2024-09-19T08:52:34.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.768+0000 7f7c7c40b740 1 -- 172.21.15.19:0/428295468 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562aeaeef3f0 con 0x562aeaed1890 2024-09-19T08:52:34.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.768+0000 7f7c52ffd640 1 -- 172.21.15.19:0/428295468 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c5c018070 con 0x562aeaed1890 2024-09-19T08:52:34.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.769+0000 7f7c52ffd640 1 -- 172.21.15.19:0/428295468 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7c640b9dd0 con 0x562aeaed1890 2024-09-19T08:52:34.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.769+0000 7f7c7c40b740 10 client.15399 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:52:34.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.769+0000 7f7c7c40b740 10 client.15399 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-19T08:52:34.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.769+0000 7f7c7c40b740 20 client.15399 populate_metadata read hostname 'smithi019' 2024-09-19T08:52:34.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.769+0000 7f7c7c40b740 1 --2- 172.21.15.19:0/428295468 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x562aeaef1ac0 0x562aeaef2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:34.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.769+0000 7f7c7c40b740 4 client.15399 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:34.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.769+0000 7f7c7c40b740 1 -- 172.21.15.19:0/428295468 --> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562aeae45600 con 0x562aeaef1ac0 2024-09-19T08:52:34.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.769+0000 7f7c72ffd640 1 --2- 172.21.15.19:0/428295468 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x562aeaef1ac0 0x562aeaef2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:34.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.770+0000 7f7c52ffd640 10 client.15399 ms_handle_connect on v2:172.21.15.203:6834/2702758353 2024-09-19T08:52:34.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.770+0000 7f7c72ffd640 1 --2- 172.21.15.19:0/428295468 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x562aeaef1ac0 0x562aeaef2f30 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b7e80d6c67f530b2 server_cookie=f9c7156c13864790 in_seq=0 out_seq=0 2024-09-19T08:52:34.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.770+0000 7f7c52ffd640 1 -- 172.21.15.19:0/428295468 <== mds.4 v2:172.21.15.203:6834/2702758353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562aeae45600 con 0x562aeaef1ac0 2024-09-19T08:52:34.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.770+0000 7f7c52ffd640 10 client.15399 handle_command_reply: tid=0 2024-09-19T08:52:34.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.770+0000 7f7c7c40b740 1 client.15399 shutdown 2024-09-19T08:52:34.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.770+0000 7f7c7c40b740 1 -- 172.21.15.19:0/428295468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562aeaed1890 msgr2=0x562aeaee07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:34.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.771+0000 7f7c7c40b740 1 --2- 172.21.15.19:0/428295468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562aeaed1890 0x562aeaee07f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f7c64009ca0 tx=0x7f7c640b9a00 comp rx=0 tx=0).stop 2024-09-19T08:52:34.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.771+0000 7f7c7c40b740 1 -- 172.21.15.19:0/428295468 shutdown_connections 2024-09-19T08:52:34.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.771+0000 7f7c7c40b740 1 --2- 172.21.15.19:0/428295468 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x562aeaef1ac0 0x562aeaef2f30 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.771+0000 7f7c7c40b740 1 --2- 172.21.15.19:0/428295468 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562aeaee0fc0 0x562aeaede080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.771+0000 7f7c7c40b740 1 --2- 172.21.15.19:0/428295468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562aeaed21b0 0x562aeaeddb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.771+0000 7f7c52ffd640 0 client.15399 ms_handle_reset on v2:172.21.15.203:6834/2702758353 2024-09-19T08:52:34.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.771+0000 7f7c7c40b740 1 --2- 172.21.15.19:0/428295468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562aeaed1890 0x562aeaee07f0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.771+0000 7f7c7c40b740 1 -- 172.21.15.19:0/428295468 >> 172.21.15.19:0/428295468 conn(0x562aeaecdf60 msgr2=0x562aeaed3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:34.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.771+0000 7f7c7c40b740 1 -- 172.21.15.19:0/428295468 shutdown_connections 2024-09-19T08:52:34.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.771+0000 7f7c7c40b740 1 -- 172.21.15.19:0/428295468 wait complete. 2024-09-19T08:52:34.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.771+0000 7f7c7c40b740 20 client.15399 trim_cache size 0 max 16384 2024-09-19T08:52:34.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.789+0000 7f7c7c40b740 1 Processor -- start 2024-09-19T08:52:34.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.789+0000 7f7c7c40b740 1 -- start start 2024-09-19T08:52:34.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.789+0000 7f7c7c40b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562aeaed1890 0x562aeaef13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:34.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.789+0000 7f7c7c40b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562aeaed21b0 0x562aeaef2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:34.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.789+0000 7f7c7c40b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562aeaee0fc0 0x562aeaef0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:34.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.789+0000 7f7c7c40b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562aeaef1270 con 0x562aeaed21b0 2024-09-19T08:52:34.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.789+0000 7f7c7c40b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x562aeaef1940 con 0x562aeaee0fc0 2024-09-19T08:52:34.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.789+0000 7f7c7c40b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562aeaef2010 con 0x562aeaed1890 2024-09-19T08:52:34.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.789+0000 7f7c72ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562aeaed21b0 0x562aeaef2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:34.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.789+0000 7f7c72ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562aeaed21b0 0x562aeaef2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49088/0 (socket says 172.21.15.19:49088) 2024-09-19T08:52:34.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.789+0000 7f7c72ffd640 1 -- 172.21.15.19:0/2913143262 learned_addr learned my addr 172.21.15.19:0/2913143262 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:34.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.789+0000 7f7c737fe640 1 --2- 172.21.15.19:0/2913143262 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562aeaed1890 0x562aeaef13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:34.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.789+0000 7f7c73fff640 1 --2- 172.21.15.19:0/2913143262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562aeaee0fc0 0x562aeaef0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:34.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.789+0000 7f7c72ffd640 1 -- 172.21.15.19:0/2913143262 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562aeaed1890 msgr2=0x562aeaef13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:34.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.789+0000 7f7c72ffd640 1 --2- 172.21.15.19:0/2913143262 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562aeaed1890 0x562aeaef13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.789+0000 7f7c72ffd640 1 -- 172.21.15.19:0/2913143262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562aeaee0fc0 msgr2=0x562aeaef0740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:34.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.789+0000 7f7c72ffd640 1 --2- 172.21.15.19:0/2913143262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562aeaee0fc0 0x562aeaef0740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.789+0000 7f7c72ffd640 1 -- 172.21.15.19:0/2913143262 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aeaedc090 con 0x562aeaed21b0 2024-09-19T08:52:34.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.789+0000 7f7c73fff640 1 --2- 172.21.15.19:0/2913143262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562aeaee0fc0 0x562aeaef0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:34.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.790+0000 7f7c72ffd640 1 --2- 172.21.15.19:0/2913143262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562aeaed21b0 0x562aeaef2190 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c007fd0 tx=0x7f7c5c00f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fa3e90765a2918d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:34.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.790+0000 7f7c697fa640 1 -- 172.21.15.19:0/2913143262 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c00db50 con 0x562aeaed21b0 2024-09-19T08:52:34.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.790+0000 7f7c697fa640 1 -- 172.21.15.19:0/2913143262 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c5c018070 con 0x562aeaed21b0 2024-09-19T08:52:34.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.790+0000 7f7c697fa640 1 -- 172.21.15.19:0/2913143262 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c01dce0 con 0x562aeaed21b0 2024-09-19T08:52:34.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.790+0000 7f7c7c40b740 1 -- 172.21.15.19:0/2913143262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562aeaed21b0 msgr2=0x562aeaef2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:34.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.790+0000 7f7c7c40b740 1 --2- 172.21.15.19:0/2913143262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562aeaed21b0 0x562aeaef2190 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c007fd0 tx=0x7f7c5c00f040 comp rx=0 tx=0).stop 2024-09-19T08:52:34.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.790+0000 7f7c7c40b740 1 -- 172.21.15.19:0/2913143262 shutdown_connections 2024-09-19T08:52:34.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.790+0000 7f7c7c40b740 1 --2- 172.21.15.19:0/2913143262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562aeaee0fc0 0x562aeaef0740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.790+0000 7f7c7c40b740 1 --2- 172.21.15.19:0/2913143262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562aeaed21b0 0x562aeaef2190 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.790+0000 7f7c7c40b740 1 --2- 172.21.15.19:0/2913143262 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562aeaed1890 0x562aeaef13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.790+0000 7f7c7c40b740 1 -- 172.21.15.19:0/2913143262 >> 172.21.15.19:0/2913143262 conn(0x562aeaecdf60 msgr2=0x562aeaec8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:34.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.791+0000 7f7c7c40b740 1 -- 172.21.15.19:0/2913143262 shutdown_connections 2024-09-19T08:52:34.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.791+0000 7f7c7c40b740 1 -- 172.21.15.19:0/2913143262 wait complete. 2024-09-19T08:52:34.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.791+0000 7f7c7c40b740 1 -- start start 2024-09-19T08:52:34.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.791+0000 7f7c7c40b740 1 Processor -- start 2024-09-19T08:52:34.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.791+0000 7f7c7c40b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562aeaed1890 0x562aeaef4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:34.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.791+0000 7f7c7c40b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562aeaed21b0 0x562aeaef4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.791+0000 7f7c7c40b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562aeaee0fc0 0x562aeaf5a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.791+0000 7f7c7c40b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562aeaef2db0 con 0x562aeaee0fc0 2024-09-19T08:52:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.791+0000 7f7c7c40b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x562aeaef26e0 con 0x562aeaed21b0 2024-09-19T08:52:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.791+0000 7f7c7c40b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562aeaef3480 con 0x562aeaed1890 2024-09-19T08:52:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.792+0000 7f7c7c40b740 10 client.0 _ll_register_callbacks cb 0x7f7c6402ffc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.792+0000 7f7c73fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562aeaee0fc0 0x562aeaf5a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.792+0000 7f7c73fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562aeaee0fc0 0x562aeaf5a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49102/0 (socket says 172.21.15.19:49102) 2024-09-19T08:52:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.792+0000 7f7c73fff640 1 -- 172.21.15.19:0/3853794369 learned_addr learned my addr 172.21.15.19:0/3853794369 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.792+0000 7f7c737fe640 1 --2- 172.21.15.19:0/3853794369 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562aeaed1890 0x562aeaef4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.792+0000 7f7c72ffd640 1 --2- 172.21.15.19:0/3853794369 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562aeaed21b0 0x562aeaef4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.792+0000 7f7c73fff640 1 -- 172.21.15.19:0/3853794369 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562aeaed1890 msgr2=0x562aeaef4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.792+0000 7f7c73fff640 1 --2- 172.21.15.19:0/3853794369 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562aeaed1890 0x562aeaef4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.792+0000 7f7c73fff640 1 -- 172.21.15.19:0/3853794369 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562aeaed21b0 msgr2=0x562aeaef4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:34.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.792+0000 7f7c73fff640 1 --2- 172.21.15.19:0/3853794369 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562aeaed21b0 0x562aeaef4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.792+0000 7f7c73fff640 1 -- 172.21.15.19:0/3853794369 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aeaf5a730 con 0x562aeaee0fc0 2024-09-19T08:52:34.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.792+0000 7f7c72ffd640 1 --2- 172.21.15.19:0/3853794369 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562aeaed21b0 0x562aeaef4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:34.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.792+0000 7f7c73fff640 1 --2- 172.21.15.19:0/3853794369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562aeaee0fc0 0x562aeaf5a1c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c012700 tx=0x7f7c6c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98e16c1a0b7cf5e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:34.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.792+0000 7f7c52ffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:52:34.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.792+0000 7f7c52ffd640 1 -- 172.21.15.19:0/3853794369 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c011ad0 con 0x562aeaee0fc0 2024-09-19T08:52:34.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.792+0000 7f7c52ffd640 1 -- 172.21.15.19:0/3853794369 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7c6c011c70 con 0x562aeaee0fc0 2024-09-19T08:52:34.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.792+0000 7f7c7c40b740 1 -- 172.21.15.19:0/3853794369 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7c5c018070 con 0x562aeaee0fc0 2024-09-19T08:52:34.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.793+0000 7f7c52ffd640 1 -- 172.21.15.19:0/3853794369 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7c6c005020 con 0x562aeaee0fc0 2024-09-19T08:52:34.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.793+0000 7f7c7c40b740 10 client.15405 fetch_fsmap learned FSMap version 28 2024-09-19T08:52:34.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.793+0000 7f7c7c40b740 1 -- 172.21.15.19:0/3853794369 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562aeaf5ba70 con 0x562aeaee0fc0 2024-09-19T08:52:34.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.793+0000 7f7c52ffd640 1 -- 172.21.15.19:0/3853794369 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c5c018070 con 0x562aeaee0fc0 2024-09-19T08:52:34.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.793+0000 7f7c52ffd640 1 -- 172.21.15.19:0/3853794369 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7c6c01e420 con 0x562aeaee0fc0 2024-09-19T08:52:34.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.793+0000 7f7c7c40b740 10 client.15405 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:52:34.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.793+0000 7f7c7c40b740 10 client.15405 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-19T08:52:34.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.793+0000 7f7c7c40b740 20 client.15405 populate_metadata read hostname 'smithi019' 2024-09-19T08:52:34.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.793+0000 7f7c7c40b740 1 --2- 172.21.15.19:0/3853794369 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x562aeaf60730 0x562aeaf5f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:34.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.793+0000 7f7c7c40b740 4 client.15405 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T08:52:34.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.793+0000 7f7c7c40b740 1 -- 172.21.15.19:0/3853794369 --> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] -- command(tid 0: {"prefix": "status"}) -- 0x562aeaed2e80 con 0x562aeaf60730 2024-09-19T08:52:34.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.793+0000 7f7c737fe640 1 --2- 172.21.15.19:0/3853794369 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x562aeaf60730 0x562aeaf5f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:34.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.794+0000 7f7c52ffd640 10 client.15405 ms_handle_connect on v2:172.21.15.203:6834/2702758353 2024-09-19T08:52:34.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.794+0000 7f7c737fe640 1 --2- 172.21.15.19:0/3853794369 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x562aeaf60730 0x562aeaf5f440 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=308ab36d81e99b3e server_cookie=9d07ab32d0d5025c in_seq=0 out_seq=0 2024-09-19T08:52:34.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.794+0000 7f7c52ffd640 1 -- 172.21.15.19:0/3853794369 <== mds.4 v2:172.21.15.203:6834/2702758353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x562aeaed2e80 con 0x562aeaf60730 2024-09-19T08:52:34.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.794+0000 7f7c52ffd640 10 client.15405 handle_command_reply: tid=0 2024-09-19T08:52:34.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.794+0000 7f7c7c40b740 1 client.15405 shutdown 2024-09-19T08:52:34.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.794+0000 7f7c7c40b740 1 -- 172.21.15.19:0/3853794369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562aeaee0fc0 msgr2=0x562aeaf5a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:34.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.794+0000 7f7c7c40b740 1 --2- 172.21.15.19:0/3853794369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562aeaee0fc0 0x562aeaf5a1c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c012700 tx=0x7f7c6c004730 comp rx=0 tx=0).stop 2024-09-19T08:52:34.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.794+0000 7f7c7c40b740 1 -- 172.21.15.19:0/3853794369 shutdown_connections 2024-09-19T08:52:34.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.794+0000 7f7c7c40b740 1 --2- 172.21.15.19:0/3853794369 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x562aeaf60730 0x562aeaf5f440 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.794+0000 7f7c7c40b740 1 --2- 172.21.15.19:0/3853794369 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562aeaee0fc0 0x562aeaf5a1c0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.794+0000 7f7c7c40b740 1 --2- 172.21.15.19:0/3853794369 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562aeaed21b0 0x562aeaef4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.794+0000 7f7c7c40b740 1 --2- 172.21.15.19:0/3853794369 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562aeaed1890 0x562aeaef4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.794+0000 7f7c7c40b740 1 -- 172.21.15.19:0/3853794369 >> 172.21.15.19:0/3853794369 conn(0x562aeaecdf60 msgr2=0x562aeaef0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:34.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.794+0000 7f7c52ffd640 0 client.15405 ms_handle_reset on v2:172.21.15.203:6834/2702758353 2024-09-19T08:52:34.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.794+0000 7f7c7c40b740 1 -- 172.21.15.19:0/3853794369 shutdown_connections 2024-09-19T08:52:34.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.794+0000 7f7c7c40b740 1 -- 172.21.15.19:0/3853794369 wait complete. 2024-09-19T08:52:34.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.794+0000 7f7c7c40b740 20 client.15405 trim_cache size 0 max 16384 2024-09-19T08:52:34.801 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:52:34.801 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "f26c9d84-7662-11ef-bceb-c7b262605968", 2024-09-19T08:52:34.801 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 4, 2024-09-19T08:52:34.801 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 24463, 2024-09-19T08:52:34.801 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-19T08:52:34.801 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-19T08:52:34.801 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-19T08:52:34.801 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 127.864307634, 2024-09-19T08:52:34.801 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 28, 2024-09-19T08:52:34.802 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 82, 2024-09-19T08:52:34.802 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 82, 2024-09-19T08:52:34.802 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 165.94433615700001 2024-09-19T08:52:34.802 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:52:34.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.795+0000 7f7c7a032640 1 -- 172.21.15.19:0/1712736440 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7c600a3350 msgr2=0x7f7c600a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:34.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.795+0000 7f7c7a032640 1 --2- 172.21.15.19:0/1712736440 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7c600a3350 0x7f7c600a5810 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c00dbe0 tx=0x7f7c6c005cc0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.795+0000 7f7c7a032640 1 -- 172.21.15.19:0/1712736440 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c74102d30 msgr2=0x7f7c74198620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:34.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.795+0000 7f7c7a032640 1 --2- 172.21.15.19:0/1712736440 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c74102d30 0x7f7c74198620 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f7c640098d0 tx=0x7f7c64031460 comp rx=0 tx=0).stop 2024-09-19T08:52:34.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.795+0000 7f7c7a032640 1 -- 172.21.15.19:0/1712736440 shutdown_connections 2024-09-19T08:52:34.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.795+0000 7f7c7a032640 1 --2- 172.21.15.19:0/1712736440 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7c600a3350 0x7f7c600a5810 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.795+0000 7f7c7a032640 1 --2- 172.21.15.19:0/1712736440 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c741036e0 0x7f7c74198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.795+0000 7f7c7a032640 1 --2- 172.21.15.19:0/1712736440 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c741082a0 0x7f7c7419cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.795+0000 7f7c7a032640 1 --2- 172.21.15.19:0/1712736440 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c74102d30 0x7f7c74198620 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:34.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.795+0000 7f7c7a032640 1 -- 172.21.15.19:0/1712736440 >> 172.21.15.19:0/1712736440 conn(0x7f7c740fc7d0 msgr2=0x7f7c74105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:34.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.795+0000 7f7c7a032640 1 -- 172.21.15.19:0/1712736440 shutdown_connections 2024-09-19T08:52:34.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:34.795+0000 7f7c7a032640 1 -- 172.21.15.19:0/1712736440 wait complete. 2024-09-19T08:52:35.515 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-19T08:52:35.817 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:36.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:35 smithi019 ceph-mon[30976]: pgmap v348: 97 pgs: 97 active+clean; 661 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.1 KiB/s wr, 14 op/s 2024-09-19T08:52:36.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:35 smithi155 ceph-mon[34921]: pgmap v348: 97 pgs: 97 active+clean; 661 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.1 KiB/s wr, 14 op/s 2024-09-19T08:52:36.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:35 smithi203 ceph-mon[35450]: pgmap v348: 97 pgs: 97 active+clean; 661 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.1 KiB/s wr, 14 op/s 2024-09-19T08:52:36.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.285+0000 7fc5022e3640 1 -- 172.21.15.19:0/2919485520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4fc106f10 msgr2=0x7fc4fc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:36.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.285+0000 7fc5022e3640 1 --2- 172.21.15.19:0/2919485520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4fc106f10 0x7fc4fc10ea90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4009ca0 tx=0x7fc4f402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.285+0000 7fc5022e3640 1 -- 172.21.15.19:0/2919485520 shutdown_connections 2024-09-19T08:52:36.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.285+0000 7fc5022e3640 1 --2- 172.21.15.19:0/2919485520 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4fc102790 0x7fc4fc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.285+0000 7fc5022e3640 1 --2- 172.21.15.19:0/2919485520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4fc106f10 0x7fc4fc10ea90 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.285+0000 7fc5022e3640 1 --2- 172.21.15.19:0/2919485520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4fc101de0 0x7fc4fc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.285+0000 7fc5022e3640 1 -- 172.21.15.19:0/2919485520 >> 172.21.15.19:0/2919485520 conn(0x7fc4fc0fd8c0 msgr2=0x7fc4fc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:36.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.285+0000 7fc5022e3640 1 -- 172.21.15.19:0/2919485520 shutdown_connections 2024-09-19T08:52:36.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.285+0000 7fc5022e3640 1 -- 172.21.15.19:0/2919485520 wait complete. 2024-09-19T08:52:36.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.286+0000 7fc5022e3640 1 Processor -- start 2024-09-19T08:52:36.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.286+0000 7fc5022e3640 1 -- start start 2024-09-19T08:52:36.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.286+0000 7fc5022e3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4fc101de0 0x7fc4fc0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:36.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.286+0000 7fc5022e3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4fc102790 0x7fc4fc074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:36.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.286+0000 7fc5022e3640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4fc106f10 0x7fc4fc074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:36.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.286+0000 7fc5022e3640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc4fc111f70 con 0x7fc4fc101de0 2024-09-19T08:52:36.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.286+0000 7fc5022e3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc4fc111df0 con 0x7fc4fc102790 2024-09-19T08:52:36.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.286+0000 7fc5022e3640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc4fc1120f0 con 0x7fc4fc106f10 2024-09-19T08:52:36.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.286+0000 7fc4fbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4fc101de0 0x7fc4fc0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:36.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.286+0000 7fc4fbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4fc101de0 0x7fc4fc0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35974/0 (socket says 172.21.15.19:35974) 2024-09-19T08:52:36.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.286+0000 7fc4fbfff640 1 -- 172.21.15.19:0/3589895971 learned_addr learned my addr 172.21.15.19:0/3589895971 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:36.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.287+0000 7fc500880640 1 --2- 172.21.15.19:0/3589895971 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4fc106f10 0x7fc4fc074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:36.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.287+0000 7fc4f3fff640 1 --2- 172.21.15.19:0/3589895971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4fc102790 0x7fc4fc074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:36.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.287+0000 7fc4fbfff640 1 -- 172.21.15.19:0/3589895971 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4fc106f10 msgr2=0x7fc4fc074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:36.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.287+0000 7fc4fbfff640 1 --2- 172.21.15.19:0/3589895971 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4fc106f10 0x7fc4fc074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.287+0000 7fc4fbfff640 1 -- 172.21.15.19:0/3589895971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4fc102790 msgr2=0x7fc4fc074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:36.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.287+0000 7fc4fbfff640 1 --2- 172.21.15.19:0/3589895971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4fc102790 0x7fc4fc074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.287+0000 7fc4fbfff640 1 -- 172.21.15.19:0/3589895971 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4fc1a6850 con 0x7fc4fc101de0 2024-09-19T08:52:36.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.287+0000 7fc4fbfff640 1 --2- 172.21.15.19:0/3589895971 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4fc101de0 0x7fc4fc0744f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec00c920 tx=0x7fc4ec00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:36.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.287+0000 7fc4f9ffb640 1 -- 172.21.15.19:0/3589895971 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec007c70 con 0x7fc4fc101de0 2024-09-19T08:52:36.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.287+0000 7fc4f9ffb640 1 -- 172.21.15.19:0/3589895971 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4ec007e10 con 0x7fc4fc101de0 2024-09-19T08:52:36.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.287+0000 7fc5022e3640 1 -- 172.21.15.19:0/3589895971 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4fc1a6b40 con 0x7fc4fc101de0 2024-09-19T08:52:36.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.287+0000 7fc4f9ffb640 1 -- 172.21.15.19:0/3589895971 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec018890 con 0x7fc4fc101de0 2024-09-19T08:52:36.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.287+0000 7fc5022e3640 1 -- 172.21.15.19:0/3589895971 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4fc1a70d0 con 0x7fc4fc101de0 2024-09-19T08:52:36.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.289+0000 7fc4f9ffb640 1 -- 172.21.15.19:0/3589895971 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7fc4ec018a70 con 0x7fc4fc101de0 2024-09-19T08:52:36.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.289+0000 7fc5046bc740 1 Processor -- start 2024-09-19T08:52:36.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.290+0000 7fc5046bc740 1 -- start start 2024-09-19T08:52:36.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.290+0000 7fc5046bc740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d91b5dc9d0 0x55d91b5dcdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:36.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.290+0000 7fc5046bc740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d91b5dd2f0 0x55d91b5e7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:36.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.290+0000 7fc5046bc740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d91b5e7bb0 0x55d91b5e9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:36.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.290+0000 7fc5046bc740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d91b543090 con 0x55d91b5dc9d0 2024-09-19T08:52:36.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.290+0000 7fc5046bc740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55d91b4eaa70 con 0x55d91b5e7bb0 2024-09-19T08:52:36.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.290+0000 7fc5046bc740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d91b53f050 con 0x55d91b5dd2f0 2024-09-19T08:52:36.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.290+0000 7fc500880640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d91b5dc9d0 0x55d91b5dcdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:36.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.290+0000 7fc500880640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d91b5dc9d0 0x55d91b5dcdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35976/0 (socket says 172.21.15.19:35976) 2024-09-19T08:52:36.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.290+0000 7fc500880640 1 -- 172.21.15.19:0/3299943603 learned_addr learned my addr 172.21.15.19:0/3299943603 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:36.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.290+0000 7fc4fbfff640 1 --2- 172.21.15.19:0/3299943603 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d91b5dd2f0 0x55d91b5e7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:36.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.290+0000 7fc4f9ffb640 1 --2- 172.21.15.19:0/3589895971 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc4e80a3350 0x7fc4e80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:36.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.290+0000 7fc4f3fff640 1 --2- 172.21.15.19:0/3299943603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d91b5e7bb0 0x55d91b5e9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:36.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.290+0000 7fc500880640 1 -- 172.21.15.19:0/3299943603 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d91b5dd2f0 msgr2=0x55d91b5e7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:36.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.290+0000 7fc500880640 1 --2- 172.21.15.19:0/3299943603 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d91b5dd2f0 0x55d91b5e7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.290+0000 7fc500880640 1 -- 172.21.15.19:0/3299943603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d91b5e7bb0 msgr2=0x55d91b5e9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:36.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.290+0000 7fc500880640 1 --2- 172.21.15.19:0/3299943603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d91b5e7bb0 0x55d91b5e9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.290+0000 7fc500880640 1 -- 172.21.15.19:0/3299943603 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d91b4f7130 con 0x55d91b5dc9d0 2024-09-19T08:52:36.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.290+0000 7fc4fbfff640 1 --2- 172.21.15.19:0/3299943603 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d91b5dd2f0 0x55d91b5e7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:36.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.290+0000 7fc4f3fff640 1 --2- 172.21.15.19:0/3299943603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d91b5e7bb0 0x55d91b5e9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:36.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.291+0000 7fc4f9ffb640 1 -- 172.21.15.19:0/3589895971 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc4ec0cfc50 con 0x7fc4fc101de0 2024-09-19T08:52:36.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.291+0000 7fc500880640 1 --2- 172.21.15.19:0/3589895971 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc4e80a3350 0x7fc4e80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:36.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.291+0000 7fc500880640 1 --2- 172.21.15.19:0/3299943603 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d91b5dc9d0 0x55d91b5dcdb0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4005e30 tx=0x7fc4f4009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b00d726dc58dc47 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:36.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.291+0000 7fc4f27fc640 1 -- 172.21.15.19:0/3299943603 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f4031920 con 0x55d91b5dc9d0 2024-09-19T08:52:36.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.291+0000 7fc4f27fc640 1 -- 172.21.15.19:0/3299943603 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4f4036070 con 0x55d91b5dc9d0 2024-09-19T08:52:36.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.291+0000 7fc4f27fc640 1 -- 172.21.15.19:0/3299943603 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f402fa30 con 0x55d91b5dc9d0 2024-09-19T08:52:36.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.292+0000 7fc5046bc740 1 -- 172.21.15.19:0/3299943603 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d91b5dc9d0 msgr2=0x55d91b5dcdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:36.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.292+0000 7fc500880640 1 --2- 172.21.15.19:0/3589895971 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc4e80a3350 0x7fc4e80a5810 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc4f404b000 tx=0x7fc4f4048000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:36.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.292+0000 7fc5046bc740 1 --2- 172.21.15.19:0/3299943603 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d91b5dc9d0 0x55d91b5dcdb0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4005e30 tx=0x7fc4f4009880 comp rx=0 tx=0).stop 2024-09-19T08:52:36.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.292+0000 7fc5046bc740 1 -- 172.21.15.19:0/3299943603 shutdown_connections 2024-09-19T08:52:36.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.292+0000 7fc5046bc740 1 --2- 172.21.15.19:0/3299943603 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d91b5dd2f0 0x55d91b5e7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.292+0000 7fc5046bc740 1 --2- 172.21.15.19:0/3299943603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d91b5e7bb0 0x55d91b5e9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.292+0000 7fc5046bc740 1 --2- 172.21.15.19:0/3299943603 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d91b5dc9d0 0x55d91b5dcdb0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.292+0000 7fc5046bc740 1 -- 172.21.15.19:0/3299943603 >> 172.21.15.19:0/3299943603 conn(0x55d91b5d8f60 msgr2=0x55d91b5d9340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:36.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.292+0000 7fc5046bc740 1 -- 172.21.15.19:0/3299943603 shutdown_connections 2024-09-19T08:52:36.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.292+0000 7fc5046bc740 1 -- 172.21.15.19:0/3299943603 wait complete. 2024-09-19T08:52:36.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.292+0000 7fc5046bc740 1 -- start start 2024-09-19T08:52:36.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.292+0000 7fc5046bc740 1 Processor -- start 2024-09-19T08:52:36.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.293+0000 7fc5046bc740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d91b5dc9d0 0x55d91b5e7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:36.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.293+0000 7fc5046bc740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d91b5dd2f0 0x55d91b5e47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:36.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.293+0000 7fc5046bc740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d91b5e7bb0 0x55d91b5e4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:36.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.293+0000 7fc5046bc740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d91b5ea600 con 0x55d91b5e7bb0 2024-09-19T08:52:36.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.293+0000 7fc5046bc740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55d91b4fdf20 con 0x55d91b5dc9d0 2024-09-19T08:52:36.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.293+0000 7fc5046bc740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d91b5ea780 con 0x55d91b5dd2f0 2024-09-19T08:52:36.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.293+0000 7fc5046bc740 10 client.0 _ll_register_callbacks cb 0x55d91b4c7030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:36.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.293+0000 7fc500880640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d91b5e7bb0 0x55d91b5e4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:36.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.293+0000 7fc500880640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d91b5e7bb0 0x55d91b5e4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35988/0 (socket says 172.21.15.19:35988) 2024-09-19T08:52:36.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.293+0000 7fc500880640 1 -- 172.21.15.19:0/2846298969 learned_addr learned my addr 172.21.15.19:0/2846298969 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:36.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.293+0000 7fc4f3fff640 1 --2- 172.21.15.19:0/2846298969 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d91b5dd2f0 0x55d91b5e47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:36.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.293+0000 7fc4fbfff640 1 --2- 172.21.15.19:0/2846298969 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d91b5dc9d0 0x55d91b5e7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:36.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.293+0000 7fc500880640 1 -- 172.21.15.19:0/2846298969 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d91b5dd2f0 msgr2=0x55d91b5e47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:36.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.293+0000 7fc500880640 1 --2- 172.21.15.19:0/2846298969 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d91b5dd2f0 0x55d91b5e47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.293+0000 7fc500880640 1 -- 172.21.15.19:0/2846298969 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d91b5dc9d0 msgr2=0x55d91b5e7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:36.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.293+0000 7fc500880640 1 --2- 172.21.15.19:0/2846298969 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d91b5dc9d0 0x55d91b5e7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.293+0000 7fc500880640 1 -- 172.21.15.19:0/2846298969 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d91b2b42b0 con 0x55d91b5e7bb0 2024-09-19T08:52:36.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.293+0000 7fc500880640 1 --2- 172.21.15.19:0/2846298969 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d91b5e7bb0 0x55d91b5e4d00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4009780 tx=0x7fc4f402afc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc48596672ac1973 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:36.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.293+0000 7fc4db7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:52:36.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.293+0000 7fc4db7fe640 1 -- 172.21.15.19:0/2846298969 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f4004860 con 0x55d91b5e7bb0 2024-09-19T08:52:36.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.293+0000 7fc4db7fe640 1 -- 172.21.15.19:0/2846298969 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc4f404d070 con 0x55d91b5e7bb0 2024-09-19T08:52:36.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.294+0000 7fc5046bc740 1 -- 172.21.15.19:0/2846298969 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4f4036070 con 0x55d91b5e7bb0 2024-09-19T08:52:36.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.294+0000 7fc4db7fe640 1 -- 172.21.15.19:0/2846298969 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc4f402f310 con 0x55d91b5e7bb0 2024-09-19T08:52:36.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.294+0000 7fc5046bc740 10 client.15417 fetch_fsmap learned FSMap version 28 2024-09-19T08:52:36.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.294+0000 7fc5046bc740 1 -- 172.21.15.19:0/2846298969 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d91b5ea600 con 0x55d91b5e7bb0 2024-09-19T08:52:36.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.294+0000 7fc4db7fe640 1 -- 172.21.15.19:0/2846298969 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4f4036070 con 0x55d91b5e7bb0 2024-09-19T08:52:36.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.294+0000 7fc4db7fe640 1 -- 172.21.15.19:0/2846298969 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc4f4030a30 con 0x55d91b5e7bb0 2024-09-19T08:52:36.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.294+0000 7fc5046bc740 10 client.15417 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:52:36.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.294+0000 7fc5046bc740 10 client.15417 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T08:52:36.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.294+0000 7fc5046bc740 20 client.15417 populate_metadata read hostname 'smithi019' 2024-09-19T08:52:36.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.294+0000 7fc5046bc740 1 --2- 172.21.15.19:0/2846298969 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55d91b5f8310 0x55d91b5f9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:36.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.294+0000 7fc5046bc740 4 client.15417 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:36.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.294+0000 7fc5046bc740 1 -- 172.21.15.19:0/2846298969 --> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d91b550600 con 0x55d91b5f8310 2024-09-19T08:52:36.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.295+0000 7fc4fbfff640 1 --2- 172.21.15.19:0/2846298969 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55d91b5f8310 0x55d91b5f9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:36.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.295+0000 7fc4fbfff640 1 --2- 172.21.15.19:0/2846298969 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55d91b5f8310 0x55d91b5f9780 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4b4bce9a8ea41bfe server_cookie=546a6302d76c850e in_seq=0 out_seq=0 2024-09-19T08:52:36.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.295+0000 7fc4db7fe640 10 client.15417 ms_handle_connect on v2:172.21.15.155:6836/3381010945 2024-09-19T08:52:36.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.296+0000 7fc4db7fe640 1 -- 172.21.15.19:0/2846298969 <== mds.3 v2:172.21.15.155:6836/3381010945 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d91b550600 con 0x55d91b5f8310 2024-09-19T08:52:36.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.296+0000 7fc4db7fe640 10 client.15417 handle_command_reply: tid=0 2024-09-19T08:52:36.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.296+0000 7fc5046bc740 1 client.15417 shutdown 2024-09-19T08:52:36.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.296+0000 7fc5046bc740 1 -- 172.21.15.19:0/2846298969 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d91b5e7bb0 msgr2=0x55d91b5e4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:36.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.296+0000 7fc5046bc740 1 --2- 172.21.15.19:0/2846298969 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d91b5e7bb0 0x55d91b5e4d00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4009780 tx=0x7fc4f402afc0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.296+0000 7fc5046bc740 1 -- 172.21.15.19:0/2846298969 shutdown_connections 2024-09-19T08:52:36.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.296+0000 7fc5046bc740 1 --2- 172.21.15.19:0/2846298969 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55d91b5f8310 0x55d91b5f9780 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.296+0000 7fc4db7fe640 0 client.15417 ms_handle_reset on v2:172.21.15.155:6836/3381010945 2024-09-19T08:52:36.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.296+0000 7fc5046bc740 1 --2- 172.21.15.19:0/2846298969 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d91b5dd2f0 0x55d91b5e47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.296+0000 7fc5046bc740 1 --2- 172.21.15.19:0/2846298969 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d91b5e7bb0 0x55d91b5e4d00 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.296+0000 7fc5046bc740 1 --2- 172.21.15.19:0/2846298969 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d91b5dc9d0 0x55d91b5e7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.296+0000 7fc5046bc740 1 -- 172.21.15.19:0/2846298969 >> 172.21.15.19:0/2846298969 conn(0x55d91b5d8f60 msgr2=0x55d91b5dec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:36.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.296+0000 7fc5046bc740 1 -- 172.21.15.19:0/2846298969 shutdown_connections 2024-09-19T08:52:36.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.296+0000 7fc5046bc740 1 -- 172.21.15.19:0/2846298969 wait complete. 2024-09-19T08:52:36.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.296+0000 7fc5046bc740 20 client.15417 trim_cache size 0 max 16384 2024-09-19T08:52:36.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.314+0000 7fc5046bc740 1 Processor -- start 2024-09-19T08:52:36.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.314+0000 7fc5046bc740 1 -- start start 2024-09-19T08:52:36.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.315+0000 7fc5046bc740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d91b5dc9d0 0x55d91b5e3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:36.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.315+0000 7fc5046bc740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d91b5dd2f0 0x55d91b5deb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:36.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.315+0000 7fc5046bc740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d91b5e7bb0 0x55d91b601a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:36.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.315+0000 7fc5046bc740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d91b5f7ac0 con 0x55d91b5e7bb0 2024-09-19T08:52:36.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.315+0000 7fc5046bc740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55d91b5f8190 con 0x55d91b5dd2f0 2024-09-19T08:52:36.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.315+0000 7fc5046bc740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d91b5f8860 con 0x55d91b5dc9d0 2024-09-19T08:52:36.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.315+0000 7fc500880640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d91b5e7bb0 0x55d91b601a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:36.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.315+0000 7fc500880640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d91b5e7bb0 0x55d91b601a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35998/0 (socket says 172.21.15.19:35998) 2024-09-19T08:52:36.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.315+0000 7fc500880640 1 -- 172.21.15.19:0/3199306793 learned_addr learned my addr 172.21.15.19:0/3199306793 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:36.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.315+0000 7fc4f3fff640 1 --2- 172.21.15.19:0/3199306793 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d91b5dd2f0 0x55d91b5deb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:36.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.315+0000 7fc500880640 1 -- 172.21.15.19:0/3199306793 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d91b5dc9d0 msgr2=0x55d91b5e3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:36.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.315+0000 7fc4fbfff640 1 --2- 172.21.15.19:0/3199306793 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d91b5dc9d0 0x55d91b5e3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:36.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.315+0000 7fc500880640 1 --2- 172.21.15.19:0/3199306793 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d91b5dc9d0 0x55d91b5e3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.315+0000 7fc500880640 1 -- 172.21.15.19:0/3199306793 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d91b5dd2f0 msgr2=0x55d91b5deb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:36.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.315+0000 7fc500880640 1 --2- 172.21.15.19:0/3199306793 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d91b5dd2f0 0x55d91b5deb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.315+0000 7fc500880640 1 -- 172.21.15.19:0/3199306793 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d91b5e3770 con 0x55d91b5e7bb0 2024-09-19T08:52:36.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.315+0000 7fc4f3fff640 1 --2- 172.21.15.19:0/3199306793 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d91b5dd2f0 0x55d91b5deb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:36.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.315+0000 7fc4fbfff640 1 --2- 172.21.15.19:0/3199306793 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d91b5dc9d0 0x55d91b5e3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:36.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.315+0000 7fc500880640 1 --2- 172.21.15.19:0/3199306793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d91b5e7bb0 0x55d91b601a60 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4030ff0 tx=0x7fc4f4009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c6374f4199b5823 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:36.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.315+0000 7fc4f1ffb640 1 -- 172.21.15.19:0/3199306793 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f402f610 con 0x55d91b5e7bb0 2024-09-19T08:52:36.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.315+0000 7fc4f1ffb640 1 -- 172.21.15.19:0/3199306793 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4f4036040 con 0x55d91b5e7bb0 2024-09-19T08:52:36.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.315+0000 7fc4f1ffb640 1 -- 172.21.15.19:0/3199306793 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4f4004380 con 0x55d91b5e7bb0 2024-09-19T08:52:36.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.316+0000 7fc5046bc740 1 -- 172.21.15.19:0/3199306793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d91b5e7bb0 msgr2=0x55d91b601a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:36.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.316+0000 7fc5046bc740 1 --2- 172.21.15.19:0/3199306793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d91b5e7bb0 0x55d91b601a60 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fc4f4030ff0 tx=0x7fc4f4009580 comp rx=0 tx=0).stop 2024-09-19T08:52:36.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.316+0000 7fc5046bc740 1 -- 172.21.15.19:0/3199306793 shutdown_connections 2024-09-19T08:52:36.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.316+0000 7fc5046bc740 1 --2- 172.21.15.19:0/3199306793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d91b5e7bb0 0x55d91b601a60 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.316+0000 7fc5046bc740 1 --2- 172.21.15.19:0/3199306793 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d91b5dd2f0 0x55d91b5deb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.316+0000 7fc5046bc740 1 --2- 172.21.15.19:0/3199306793 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d91b5dc9d0 0x55d91b5e3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.316+0000 7fc5046bc740 1 -- 172.21.15.19:0/3199306793 >> 172.21.15.19:0/3199306793 conn(0x55d91b5d8f60 msgr2=0x55d91b5de420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:36.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.316+0000 7fc5046bc740 1 -- 172.21.15.19:0/3199306793 shutdown_connections 2024-09-19T08:52:36.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.316+0000 7fc5046bc740 1 -- 172.21.15.19:0/3199306793 wait complete. 2024-09-19T08:52:36.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.317+0000 7fc5046bc740 1 -- start start 2024-09-19T08:52:36.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.317+0000 7fc5046bc740 1 Processor -- start 2024-09-19T08:52:36.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.317+0000 7fc5046bc740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d91b5dc9d0 0x55d91b601f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:36.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.317+0000 7fc5046bc740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d91b5dd2f0 0x55d91b5fb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:36.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.317+0000 7fc5046bc740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d91b5e7bb0 0x55d91b5fb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:36.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.317+0000 7fc5046bc740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d91b5f9600 con 0x55d91b5dd2f0 2024-09-19T08:52:36.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.317+0000 7fc5046bc740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55d91b5f8f30 con 0x55d91b5e7bb0 2024-09-19T08:52:36.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.317+0000 7fc5046bc740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d91b5f9cd0 con 0x55d91b5dc9d0 2024-09-19T08:52:36.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.317+0000 7fc5046bc740 10 client.0 _ll_register_callbacks cb 0x7fc4f404a020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:36.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.317+0000 7fc4f3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d91b5dd2f0 0x55d91b5fb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:36.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.317+0000 7fc4f3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d91b5dd2f0 0x55d91b5fb2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36004/0 (socket says 172.21.15.19:36004) 2024-09-19T08:52:36.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.317+0000 7fc4f3fff640 1 -- 172.21.15.19:0/3322262366 learned_addr learned my addr 172.21.15.19:0/3322262366 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:36.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.317+0000 7fc4fbfff640 1 --2- 172.21.15.19:0/3322262366 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d91b5dc9d0 0x55d91b601f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:36.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.317+0000 7fc500880640 1 --2- 172.21.15.19:0/3322262366 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d91b5e7bb0 0x55d91b5fb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:36.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.318+0000 7fc4f3fff640 1 -- 172.21.15.19:0/3322262366 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d91b5dc9d0 msgr2=0x55d91b601f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:36.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.318+0000 7fc4f3fff640 1 --2- 172.21.15.19:0/3322262366 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d91b5dc9d0 0x55d91b601f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.318+0000 7fc4f3fff640 1 -- 172.21.15.19:0/3322262366 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d91b5e7bb0 msgr2=0x55d91b5fb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:36.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.318+0000 7fc4f3fff640 1 --2- 172.21.15.19:0/3322262366 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d91b5e7bb0 0x55d91b5fb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.318+0000 7fc4f3fff640 1 -- 172.21.15.19:0/3322262366 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d91b5fbe30 con 0x55d91b5dd2f0 2024-09-19T08:52:36.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.318+0000 7fc500880640 1 --2- 172.21.15.19:0/3322262366 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d91b5e7bb0 0x55d91b5fb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:36.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.318+0000 7fc4f3fff640 1 --2- 172.21.15.19:0/3322262366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d91b5dd2f0 0x55d91b5fb2b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x55d91b5da2e0 tx=0x7fc4e4013940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af4e162fa1f1c82 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:36.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.318+0000 7fc4db7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:52:36.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.318+0000 7fc4db7fe640 1 -- 172.21.15.19:0/3322262366 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4e4011770 con 0x55d91b5dd2f0 2024-09-19T08:52:36.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.318+0000 7fc4db7fe640 1 -- 172.21.15.19:0/3322262366 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc4e4011910 con 0x55d91b5dd2f0 2024-09-19T08:52:36.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.318+0000 7fc5046bc740 1 -- 172.21.15.19:0/3322262366 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc4f4036040 con 0x55d91b5dd2f0 2024-09-19T08:52:36.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.318+0000 7fc4db7fe640 1 -- 172.21.15.19:0/3322262366 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc4e4011b10 con 0x55d91b5dd2f0 2024-09-19T08:52:36.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.318+0000 7fc5046bc740 10 client.15423 fetch_fsmap learned FSMap version 28 2024-09-19T08:52:36.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.318+0000 7fc5046bc740 1 -- 172.21.15.19:0/3322262366 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55d91b662a20 con 0x55d91b5dd2f0 2024-09-19T08:52:36.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.319+0000 7fc4db7fe640 1 -- 172.21.15.19:0/3322262366 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc4f4036040 con 0x55d91b5dd2f0 2024-09-19T08:52:36.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.319+0000 7fc4db7fe640 1 -- 172.21.15.19:0/3322262366 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc4e401b070 con 0x55d91b5dd2f0 2024-09-19T08:52:36.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.319+0000 7fc5046bc740 10 client.15423 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:52:36.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.319+0000 7fc5046bc740 10 client.15423 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T08:52:36.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.319+0000 7fc5046bc740 20 client.15423 populate_metadata read hostname 'smithi019' 2024-09-19T08:52:36.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.319+0000 7fc5046bc740 1 --2- 172.21.15.19:0/3322262366 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55d91b667530 0x55d91b666240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:36.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.319+0000 7fc5046bc740 4 client.15423 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T08:52:36.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.319+0000 7fc5046bc740 1 -- 172.21.15.19:0/3322262366 --> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] -- command(tid 0: {"prefix": "status"}) -- 0x55d91b54ab10 con 0x55d91b667530 2024-09-19T08:52:36.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.319+0000 7fc4fbfff640 1 --2- 172.21.15.19:0/3322262366 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55d91b667530 0x55d91b666240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:36.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.320+0000 7fc4db7fe640 10 client.15423 ms_handle_connect on v2:172.21.15.155:6836/3381010945 2024-09-19T08:52:36.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.320+0000 7fc4fbfff640 1 --2- 172.21.15.19:0/3322262366 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55d91b667530 0x55d91b666240 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3796aa172a97ed9d server_cookie=9fbd29dff91e2a25 in_seq=0 out_seq=0 2024-09-19T08:52:36.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.320+0000 7fc4db7fe640 1 -- 172.21.15.19:0/3322262366 <== mds.3 v2:172.21.15.155:6836/3381010945 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55d91b54ab10 con 0x55d91b667530 2024-09-19T08:52:36.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.320+0000 7fc4db7fe640 10 client.15423 handle_command_reply: tid=0 2024-09-19T08:52:36.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.320+0000 7fc5046bc740 1 client.15423 shutdown 2024-09-19T08:52:36.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.320+0000 7fc5046bc740 1 -- 172.21.15.19:0/3322262366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d91b5dd2f0 msgr2=0x55d91b5fb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:36.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.320+0000 7fc5046bc740 1 --2- 172.21.15.19:0/3322262366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d91b5dd2f0 0x55d91b5fb2b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x55d91b5da2e0 tx=0x7fc4e4013940 comp rx=0 tx=0).stop 2024-09-19T08:52:36.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.320+0000 7fc5046bc740 1 -- 172.21.15.19:0/3322262366 shutdown_connections 2024-09-19T08:52:36.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.320+0000 7fc5046bc740 1 --2- 172.21.15.19:0/3322262366 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55d91b667530 0x55d91b666240 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.320+0000 7fc5046bc740 1 --2- 172.21.15.19:0/3322262366 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d91b5e7bb0 0x55d91b5fb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.320+0000 7fc5046bc740 1 --2- 172.21.15.19:0/3322262366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d91b5dd2f0 0x55d91b5fb2b0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.320+0000 7fc5046bc740 1 --2- 172.21.15.19:0/3322262366 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d91b5dc9d0 0x55d91b601f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.320+0000 7fc5046bc740 1 -- 172.21.15.19:0/3322262366 >> 172.21.15.19:0/3322262366 conn(0x55d91b5d8f60 msgr2=0x55d91b5de420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:36.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.320+0000 7fc4db7fe640 0 client.15423 ms_handle_reset on v2:172.21.15.155:6836/3381010945 2024-09-19T08:52:36.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.320+0000 7fc5046bc740 1 -- 172.21.15.19:0/3322262366 shutdown_connections 2024-09-19T08:52:36.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.320+0000 7fc5046bc740 1 -- 172.21.15.19:0/3322262366 wait complete. 2024-09-19T08:52:36.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.321+0000 7fc5046bc740 20 client.15423 trim_cache size 0 max 16384 2024-09-19T08:52:36.326 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:52:36.326 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "f26c9d84-7662-11ef-bceb-c7b262605968", 2024-09-19T08:52:36.327 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 3, 2024-09-19T08:52:36.327 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 24464, 2024-09-19T08:52:36.327 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-19T08:52:36.327 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-19T08:52:36.327 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-19T08:52:36.327 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 130.398252356, 2024-09-19T08:52:36.327 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 28, 2024-09-19T08:52:36.327 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 82, 2024-09-19T08:52:36.327 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 82, 2024-09-19T08:52:36.327 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 162.25233520399999 2024-09-19T08:52:36.327 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:52:36.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.321+0000 7fc5022e3640 1 -- 172.21.15.19:0/3589895971 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc4e80a3350 msgr2=0x7fc4e80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:36.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.321+0000 7fc5022e3640 1 --2- 172.21.15.19:0/3589895971 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc4e80a3350 0x7fc4e80a5810 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc4f404b000 tx=0x7fc4f4048000 comp rx=0 tx=0).stop 2024-09-19T08:52:36.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.321+0000 7fc5022e3640 1 -- 172.21.15.19:0/3589895971 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4fc101de0 msgr2=0x7fc4fc0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:36.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.321+0000 7fc5022e3640 1 --2- 172.21.15.19:0/3589895971 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4fc101de0 0x7fc4fc0744f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec00c920 tx=0x7fc4ec00cde0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.321+0000 7fc5022e3640 1 -- 172.21.15.19:0/3589895971 shutdown_connections 2024-09-19T08:52:36.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.321+0000 7fc5022e3640 1 --2- 172.21.15.19:0/3589895971 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc4e80a3350 0x7fc4e80a5810 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.321+0000 7fc5022e3640 1 --2- 172.21.15.19:0/3589895971 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4fc106f10 0x7fc4fc074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.321+0000 7fc5022e3640 1 --2- 172.21.15.19:0/3589895971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4fc102790 0x7fc4fc074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.321+0000 7fc5022e3640 1 --2- 172.21.15.19:0/3589895971 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4fc101de0 0x7fc4fc0744f0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:36.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.321+0000 7fc5022e3640 1 -- 172.21.15.19:0/3589895971 >> 172.21.15.19:0/3589895971 conn(0x7fc4fc0fd8c0 msgr2=0x7fc4fc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:36.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.321+0000 7fc5022e3640 1 -- 172.21.15.19:0/3589895971 shutdown_connections 2024-09-19T08:52:36.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:36.321+0000 7fc5022e3640 1 -- 172.21.15.19:0/3589895971 wait complete. 2024-09-19T08:52:37.006 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.c status 2024-09-19T08:52:37.264 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:37.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.694+0000 7f1e810fb640 1 -- 172.21.15.19:0/1249498787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e7c103660 msgr2=0x7f1e7c10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:37.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.694+0000 7f1e810fb640 1 --2- 172.21.15.19:0/1249498787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e7c103660 0x7f1e7c10bb50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f1e64009900 tx=0x7f1e6402a480 comp rx=0 tx=0).stop 2024-09-19T08:52:37.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.694+0000 7f1e810fb640 1 -- 172.21.15.19:0/1249498787 shutdown_connections 2024-09-19T08:52:37.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.694+0000 7f1e810fb640 1 --2- 172.21.15.19:0/1249498787 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e7c10c170 0x7f1e7c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.694+0000 7f1e810fb640 1 --2- 172.21.15.19:0/1249498787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e7c103660 0x7f1e7c10bb50 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.694+0000 7f1e810fb640 1 --2- 172.21.15.19:0/1249498787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e7c102d40 0x7f1e7c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.694+0000 7f1e810fb640 1 -- 172.21.15.19:0/1249498787 >> 172.21.15.19:0/1249498787 conn(0x7f1e7c0fc7a0 msgr2=0x7f1e7c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:37.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.694+0000 7f1e810fb640 1 -- 172.21.15.19:0/1249498787 shutdown_connections 2024-09-19T08:52:37.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.694+0000 7f1e810fb640 1 -- 172.21.15.19:0/1249498787 wait complete. 2024-09-19T08:52:37.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.695+0000 7f1e810fb640 1 Processor -- start 2024-09-19T08:52:37.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.695+0000 7f1e810fb640 1 -- start start 2024-09-19T08:52:37.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.696+0000 7f1e810fb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e7c102d40 0x7f1e7c1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:37.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.696+0000 7f1e810fb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e7c103660 0x7f1e7c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:37.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.696+0000 7f1e810fb640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e7c10c170 0x7f1e7c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:37.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.696+0000 7f1e810fb640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1e7c111f70 con 0x7f1e7c103660 2024-09-19T08:52:37.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.696+0000 7f1e810fb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1e7c111df0 con 0x7f1e7c102d40 2024-09-19T08:52:37.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.696+0000 7f1e810fb640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1e7c1120f0 con 0x7f1e7c10c170 2024-09-19T08:52:37.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.696+0000 7f1e73fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e7c103660 0x7f1e7c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:37.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.696+0000 7f1e73fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e7c103660 0x7f1e7c100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36020/0 (socket says 172.21.15.19:36020) 2024-09-19T08:52:37.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.696+0000 7f1e73fff640 1 -- 172.21.15.19:0/2098918248 learned_addr learned my addr 172.21.15.19:0/2098918248 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:37.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.696+0000 7f1e7ad9d640 1 --2- 172.21.15.19:0/2098918248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e7c102d40 0x7f1e7c1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:37.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.696+0000 7f1e7b59e640 1 --2- 172.21.15.19:0/2098918248 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e7c10c170 0x7f1e7c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:37.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.696+0000 7f1e73fff640 1 -- 172.21.15.19:0/2098918248 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e7c10c170 msgr2=0x7f1e7c101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:37.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.696+0000 7f1e73fff640 1 --2- 172.21.15.19:0/2098918248 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e7c10c170 0x7f1e7c101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.696+0000 7f1e73fff640 1 -- 172.21.15.19:0/2098918248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e7c102d40 msgr2=0x7f1e7c1009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:37.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.696+0000 7f1e73fff640 1 --2- 172.21.15.19:0/2098918248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e7c102d40 0x7f1e7c1009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.696+0000 7f1e73fff640 1 -- 172.21.15.19:0/2098918248 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e7c1a68b0 con 0x7f1e7c103660 2024-09-19T08:52:37.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.696+0000 7f1e7ad9d640 1 --2- 172.21.15.19:0/2098918248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e7c102d40 0x7f1e7c1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:37.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.696+0000 7f1e7b59e640 1 --2- 172.21.15.19:0/2098918248 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e7c10c170 0x7f1e7c101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:37.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.696+0000 7f1e73fff640 1 --2- 172.21.15.19:0/2098918248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e7c103660 0x7f1e7c100ee0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f1e64006010 tx=0x7f1e640042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:37.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.697+0000 7f1e78d99640 1 -- 172.21.15.19:0/2098918248 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6403f030 con 0x7f1e7c103660 2024-09-19T08:52:37.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.697+0000 7f1e810fb640 1 -- 172.21.15.19:0/2098918248 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e7c1a6b40 con 0x7f1e7c103660 2024-09-19T08:52:37.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.697+0000 7f1e78d99640 1 -- 172.21.15.19:0/2098918248 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e64003ce0 con 0x7f1e7c103660 2024-09-19T08:52:37.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.697+0000 7f1e78d99640 1 -- 172.21.15.19:0/2098918248 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e64035070 con 0x7f1e7c103660 2024-09-19T08:52:37.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.697+0000 7f1e810fb640 1 -- 172.21.15.19:0/2098918248 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e7c1a7070 con 0x7f1e7c103660 2024-09-19T08:52:37.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.699+0000 7f1e78d99640 1 -- 172.21.15.19:0/2098918248 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f1e64042030 con 0x7f1e7c103660 2024-09-19T08:52:37.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.699+0000 7f1e834d4740 1 Processor -- start 2024-09-19T08:52:37.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.699+0000 7f1e834d4740 1 -- start start 2024-09-19T08:52:37.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.700+0000 7f1e834d4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a36b9a69d0 0x55a36b9a6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:37.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.700+0000 7f1e834d4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a36b9a72f0 0x55a36b9b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:37.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.700+0000 7f1e834d4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a36b9b1bb0 0x55a36b9b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:37.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.700+0000 7f1e834d4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a36b90d090 con 0x55a36b9a72f0 2024-09-19T08:52:37.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.700+0000 7f1e834d4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55a36b8b4a70 con 0x55a36b9b1bb0 2024-09-19T08:52:37.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.700+0000 7f1e834d4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a36b909050 con 0x55a36b9a69d0 2024-09-19T08:52:37.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.700+0000 7f1e7ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a36b9a72f0 0x55a36b9b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:37.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.700+0000 7f1e7ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a36b9a72f0 0x55a36b9b1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36024/0 (socket says 172.21.15.19:36024) 2024-09-19T08:52:37.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.700+0000 7f1e7ad9d640 1 -- 172.21.15.19:0/2777638022 learned_addr learned my addr 172.21.15.19:0/2777638022 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:37.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.700+0000 7f1e78d99640 1 --2- 172.21.15.19:0/2098918248 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1e680a32d0 0x7f1e680a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:37.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.700+0000 7f1e7b59e640 1 --2- 172.21.15.19:0/2777638022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a36b9a69d0 0x55a36b9a6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:37.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.700+0000 7f1e73fff640 1 --2- 172.21.15.19:0/2777638022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a36b9b1bb0 0x55a36b9b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:37.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.700+0000 7f1e7ad9d640 1 -- 172.21.15.19:0/2777638022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a36b9a69d0 msgr2=0x55a36b9a6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:37.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.700+0000 7f1e7ad9d640 1 --2- 172.21.15.19:0/2777638022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a36b9a69d0 0x55a36b9a6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.700+0000 7f1e7ad9d640 1 -- 172.21.15.19:0/2777638022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a36b9b1bb0 msgr2=0x55a36b9b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:37.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.700+0000 7f1e7ad9d640 1 --2- 172.21.15.19:0/2777638022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a36b9b1bb0 0x55a36b9b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.700+0000 7f1e7ad9d640 1 -- 172.21.15.19:0/2777638022 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a36b8c1130 con 0x55a36b9a72f0 2024-09-19T08:52:37.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.700+0000 7f1e78d99640 1 -- 172.21.15.19:0/2098918248 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1e640f0180 con 0x7f1e7c103660 2024-09-19T08:52:37.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.700+0000 7f1e7b59e640 1 --2- 172.21.15.19:0/2777638022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a36b9a69d0 0x55a36b9a6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:37.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.700+0000 7f1e73fff640 1 --2- 172.21.15.19:0/2777638022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a36b9b1bb0 0x55a36b9b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:37.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.700+0000 7f1e7b59e640 1 --2- 172.21.15.19:0/2098918248 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1e680a32d0 0x7f1e680a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:37.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.701+0000 7f1e7ad9d640 1 --2- 172.21.15.19:0/2777638022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a36b9a72f0 0x55a36b9b1670 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c00bd40 tx=0x7f1e6c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6a64746628c766c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:37.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.701+0000 7f1e717fa640 1 -- 172.21.15.19:0/2777638022 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c015070 con 0x55a36b9a72f0 2024-09-19T08:52:37.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.701+0000 7f1e717fa640 1 -- 172.21.15.19:0/2777638022 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e6c00be30 con 0x55a36b9a72f0 2024-09-19T08:52:37.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.701+0000 7f1e717fa640 1 -- 172.21.15.19:0/2777638022 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c011aa0 con 0x55a36b9a72f0 2024-09-19T08:52:37.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.701+0000 7f1e834d4740 1 -- 172.21.15.19:0/2777638022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a36b9a72f0 msgr2=0x55a36b9b1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:37.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.701+0000 7f1e7b59e640 1 --2- 172.21.15.19:0/2098918248 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1e680a32d0 0x7f1e680a5790 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1e74007f50 tx=0x7f1e74004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:37.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.701+0000 7f1e834d4740 1 --2- 172.21.15.19:0/2777638022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a36b9a72f0 0x55a36b9b1670 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c00bd40 tx=0x7f1e6c00f730 comp rx=0 tx=0).stop 2024-09-19T08:52:37.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.702+0000 7f1e834d4740 1 -- 172.21.15.19:0/2777638022 shutdown_connections 2024-09-19T08:52:37.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.702+0000 7f1e834d4740 1 --2- 172.21.15.19:0/2777638022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a36b9b1bb0 0x55a36b9b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.702+0000 7f1e834d4740 1 --2- 172.21.15.19:0/2777638022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a36b9a72f0 0x55a36b9b1670 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.702+0000 7f1e834d4740 1 --2- 172.21.15.19:0/2777638022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a36b9a69d0 0x55a36b9a6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.702+0000 7f1e834d4740 1 -- 172.21.15.19:0/2777638022 >> 172.21.15.19:0/2777638022 conn(0x55a36b9a2f60 msgr2=0x55a36b9a3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:37.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.702+0000 7f1e834d4740 1 -- 172.21.15.19:0/2777638022 shutdown_connections 2024-09-19T08:52:37.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.702+0000 7f1e834d4740 1 -- 172.21.15.19:0/2777638022 wait complete. 2024-09-19T08:52:37.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.702+0000 7f1e834d4740 1 -- start start 2024-09-19T08:52:37.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.702+0000 7f1e834d4740 1 Processor -- start 2024-09-19T08:52:37.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.703+0000 7f1e834d4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a36b9a69d0 0x55a36b9b1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:37.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.703+0000 7f1e834d4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a36b9a72f0 0x55a36b9ae7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:37.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.703+0000 7f1e834d4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a36b9b1bb0 0x55a36b9aed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:37.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.703+0000 7f1e834d4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a36b9b4780 con 0x55a36b9a72f0 2024-09-19T08:52:37.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.703+0000 7f1e834d4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55a36b8c7f20 con 0x55a36b9b1bb0 2024-09-19T08:52:37.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.703+0000 7f1e834d4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a36b9b4900 con 0x55a36b9a69d0 2024-09-19T08:52:37.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.703+0000 7f1e834d4740 10 client.0 _ll_register_callbacks cb 0x55a36b891030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:37.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.703+0000 7f1e73fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a36b9a72f0 0x55a36b9ae7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:37.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.703+0000 7f1e73fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a36b9a72f0 0x55a36b9ae7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36030/0 (socket says 172.21.15.19:36030) 2024-09-19T08:52:37.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.703+0000 7f1e73fff640 1 -- 172.21.15.19:0/473316046 learned_addr learned my addr 172.21.15.19:0/473316046 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:37.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.703+0000 7f1e7ad9d640 1 --2- 172.21.15.19:0/473316046 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a36b9a69d0 0x55a36b9b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:37.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.703+0000 7f1e7b59e640 1 --2- 172.21.15.19:0/473316046 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a36b9b1bb0 0x55a36b9aed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:37.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.703+0000 7f1e73fff640 1 -- 172.21.15.19:0/473316046 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a36b9a69d0 msgr2=0x55a36b9b1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:37.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.703+0000 7f1e73fff640 1 --2- 172.21.15.19:0/473316046 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a36b9a69d0 0x55a36b9b1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.703+0000 7f1e73fff640 1 -- 172.21.15.19:0/473316046 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a36b9b1bb0 msgr2=0x55a36b9aed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:37.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.703+0000 7f1e73fff640 1 --2- 172.21.15.19:0/473316046 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a36b9b1bb0 0x55a36b9aed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.703+0000 7f1e73fff640 1 -- 172.21.15.19:0/473316046 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a36b67e2b0 con 0x55a36b9a72f0 2024-09-19T08:52:37.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.703+0000 7f1e7b59e640 1 --2- 172.21.15.19:0/473316046 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a36b9b1bb0 0x55a36b9aed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:37.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.703+0000 7f1e7ad9d640 1 --2- 172.21.15.19:0/473316046 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a36b9a69d0 0x55a36b9b1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:37.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.703+0000 7f1e73fff640 1 --2- 172.21.15.19:0/473316046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a36b9a72f0 0x55a36b9ae7c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1e640bc640 tx=0x7f1e64005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfda4402c5e89790 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:37.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.703+0000 7f1e627fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:52:37.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.703+0000 7f1e627fc640 1 -- 172.21.15.19:0/473316046 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e64049070 con 0x55a36b9a72f0 2024-09-19T08:52:37.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.703+0000 7f1e627fc640 1 -- 172.21.15.19:0/473316046 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1e640edd30 con 0x55a36b9a72f0 2024-09-19T08:52:37.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.703+0000 7f1e834d4740 1 -- 172.21.15.19:0/473316046 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e6c00be30 con 0x55a36b9a72f0 2024-09-19T08:52:37.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.704+0000 7f1e627fc640 1 -- 172.21.15.19:0/473316046 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1e640bc480 con 0x55a36b9a72f0 2024-09-19T08:52:37.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.704+0000 7f1e834d4740 10 client.15435 fetch_fsmap learned FSMap version 28 2024-09-19T08:52:37.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.704+0000 7f1e834d4740 1 -- 172.21.15.19:0/473316046 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a36b9c0100 con 0x55a36b9a72f0 2024-09-19T08:52:37.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.704+0000 7f1e627fc640 1 -- 172.21.15.19:0/473316046 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e6c00be30 con 0x55a36b9a72f0 2024-09-19T08:52:37.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.704+0000 7f1e627fc640 1 -- 172.21.15.19:0/473316046 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1e640c4e90 con 0x55a36b9a72f0 2024-09-19T08:52:37.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.704+0000 7f1e834d4740 10 client.15435 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:52:37.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.704+0000 7f1e834d4740 10 client.15435 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T08:52:37.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.704+0000 7f1e834d4740 20 client.15435 populate_metadata read hostname 'smithi019' 2024-09-19T08:52:37.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.704+0000 7f1e834d4740 1 --2- 172.21.15.19:0/473316046 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55a36b9c27a0 0x55a36b9c3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:37.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.704+0000 7f1e834d4740 4 client.15435 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:37.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.704+0000 7f1e834d4740 1 -- 172.21.15.19:0/473316046 --> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a36b91a600 con 0x55a36b9c27a0 2024-09-19T08:52:37.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.704+0000 7f1e7ad9d640 1 --2- 172.21.15.19:0/473316046 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55a36b9c27a0 0x55a36b9c3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:37.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.705+0000 7f1e7ad9d640 1 --2- 172.21.15.19:0/473316046 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55a36b9c27a0 0x55a36b9c3c10 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=adf83cb250d3a2bd server_cookie=ea6724c009a2a213 in_seq=0 out_seq=0 2024-09-19T08:52:37.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.705+0000 7f1e627fc640 10 client.15435 ms_handle_connect on v2:172.21.15.203:6836/3684671619 2024-09-19T08:52:37.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.705+0000 7f1e627fc640 1 -- 172.21.15.19:0/473316046 <== mds.2 v2:172.21.15.203:6836/3684671619 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a36b91a600 con 0x55a36b9c27a0 2024-09-19T08:52:37.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.705+0000 7f1e627fc640 10 client.15435 handle_command_reply: tid=0 2024-09-19T08:52:37.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.705+0000 7f1e834d4740 1 client.15435 shutdown 2024-09-19T08:52:37.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.706+0000 7f1e834d4740 1 -- 172.21.15.19:0/473316046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a36b9a72f0 msgr2=0x55a36b9ae7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:37.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.706+0000 7f1e834d4740 1 --2- 172.21.15.19:0/473316046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a36b9a72f0 0x55a36b9ae7c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1e640bc640 tx=0x7f1e64005be0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.706+0000 7f1e834d4740 1 -- 172.21.15.19:0/473316046 shutdown_connections 2024-09-19T08:52:37.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.706+0000 7f1e834d4740 1 --2- 172.21.15.19:0/473316046 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55a36b9c27a0 0x55a36b9c3c10 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.706+0000 7f1e834d4740 1 --2- 172.21.15.19:0/473316046 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a36b9b1bb0 0x55a36b9aed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.706+0000 7f1e627fc640 0 client.15435 ms_handle_reset on v2:172.21.15.203:6836/3684671619 2024-09-19T08:52:37.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.706+0000 7f1e834d4740 1 --2- 172.21.15.19:0/473316046 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a36b9a72f0 0x55a36b9ae7c0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.706+0000 7f1e834d4740 1 --2- 172.21.15.19:0/473316046 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a36b9a69d0 0x55a36b9b1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.706+0000 7f1e834d4740 1 -- 172.21.15.19:0/473316046 >> 172.21.15.19:0/473316046 conn(0x55a36b9a2f60 msgr2=0x55a36b9a8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:37.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.706+0000 7f1e834d4740 1 -- 172.21.15.19:0/473316046 shutdown_connections 2024-09-19T08:52:37.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.706+0000 7f1e834d4740 1 -- 172.21.15.19:0/473316046 wait complete. 2024-09-19T08:52:37.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.706+0000 7f1e834d4740 20 client.15435 trim_cache size 0 max 16384 2024-09-19T08:52:37.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.724+0000 7f1e834d4740 1 Processor -- start 2024-09-19T08:52:37.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.724+0000 7f1e834d4740 1 -- start start 2024-09-19T08:52:37.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.725+0000 7f1e834d4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a36b9a69d0 0x55a36b9c20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:37.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.725+0000 7f1e834d4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a36b9a72f0 0x55a36b9ae080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:37.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.725+0000 7f1e834d4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a36b9b1bb0 0x55a36b9ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:37.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.725+0000 7f1e834d4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a36b9c1f50 con 0x55a36b9b1bb0 2024-09-19T08:52:37.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.725+0000 7f1e834d4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55a36b9c2620 con 0x55a36b9a69d0 2024-09-19T08:52:37.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.725+0000 7f1e834d4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a36b9c2cf0 con 0x55a36b9a72f0 2024-09-19T08:52:37.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.725+0000 7f1e7b59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a36b9b1bb0 0x55a36b9ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:37.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.725+0000 7f1e7ad9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a36b9a69d0 0x55a36b9c20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:37.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.725+0000 7f1e7b59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a36b9b1bb0 0x55a36b9ad090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36034/0 (socket says 172.21.15.19:36034) 2024-09-19T08:52:37.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.725+0000 7f1e7ad9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a36b9a69d0 0x55a36b9c20d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:47564/0 (socket says 172.21.15.19:47564) 2024-09-19T08:52:37.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.725+0000 7f1e7b59e640 1 -- 172.21.15.19:0/4137553587 learned_addr learned my addr 172.21.15.19:0/4137553587 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:37.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.725+0000 7f1e73fff640 1 --2- 172.21.15.19:0/4137553587 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a36b9a72f0 0x55a36b9ae080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:37.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.725+0000 7f1e7b59e640 1 -- 172.21.15.19:0/4137553587 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a36b9a72f0 msgr2=0x55a36b9ae080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:37.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.725+0000 7f1e7b59e640 1 --2- 172.21.15.19:0/4137553587 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a36b9a72f0 0x55a36b9ae080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.725+0000 7f1e7b59e640 1 -- 172.21.15.19:0/4137553587 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a36b9a69d0 msgr2=0x55a36b9c20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:37.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.725+0000 7f1e7b59e640 1 --2- 172.21.15.19:0/4137553587 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a36b9a69d0 0x55a36b9c20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.725+0000 7f1e7b59e640 1 -- 172.21.15.19:0/4137553587 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a36b9a7120 con 0x55a36b9b1bb0 2024-09-19T08:52:37.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.725+0000 7f1e7ad9d640 1 --2- 172.21.15.19:0/4137553587 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a36b9a69d0 0x55a36b9c20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:52:37.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.725+0000 7f1e7b59e640 1 --2- 172.21.15.19:0/4137553587 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a36b9b1bb0 0x55a36b9ad090 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1e7401e5f0 tx=0x7f1e74013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2af6d17eb8eeae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:37.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.726+0000 7f1e70ff9640 1 -- 172.21.15.19:0/4137553587 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e74003d80 con 0x55a36b9b1bb0 2024-09-19T08:52:37.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.726+0000 7f1e70ff9640 1 -- 172.21.15.19:0/4137553587 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e74004530 con 0x55a36b9b1bb0 2024-09-19T08:52:37.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.726+0000 7f1e70ff9640 1 -- 172.21.15.19:0/4137553587 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e74012e10 con 0x55a36b9b1bb0 2024-09-19T08:52:37.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.727+0000 7f1e834d4740 1 -- 172.21.15.19:0/4137553587 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a36b9b1bb0 msgr2=0x55a36b9ad090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:37.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.727+0000 7f1e834d4740 1 --2- 172.21.15.19:0/4137553587 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a36b9b1bb0 0x55a36b9ad090 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1e7401e5f0 tx=0x7f1e74013000 comp rx=0 tx=0).stop 2024-09-19T08:52:37.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.727+0000 7f1e834d4740 1 -- 172.21.15.19:0/4137553587 shutdown_connections 2024-09-19T08:52:37.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.727+0000 7f1e834d4740 1 --2- 172.21.15.19:0/4137553587 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a36b9a72f0 0x55a36b9ae080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.727+0000 7f1e834d4740 1 --2- 172.21.15.19:0/4137553587 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a36b9b1bb0 0x55a36b9ad090 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.727+0000 7f1e834d4740 1 --2- 172.21.15.19:0/4137553587 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a36b9a69d0 0x55a36b9c20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.727+0000 7f1e834d4740 1 -- 172.21.15.19:0/4137553587 >> 172.21.15.19:0/4137553587 conn(0x55a36b9a2f60 msgr2=0x55a36b9a3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:37.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.727+0000 7f1e834d4740 1 -- 172.21.15.19:0/4137553587 shutdown_connections 2024-09-19T08:52:37.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.727+0000 7f1e834d4740 1 -- 172.21.15.19:0/4137553587 wait complete. 2024-09-19T08:52:37.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.727+0000 7f1e834d4740 1 -- start start 2024-09-19T08:52:37.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.727+0000 7f1e834d4740 1 Processor -- start 2024-09-19T08:52:37.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.728+0000 7f1e834d4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a36b9a69d0 0x55a36b9cc1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:37.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.728+0000 7f1e834d4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a36b9a72f0 0x55a36b9cc730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:37.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.728+0000 7f1e834d4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a36b9b1bb0 0x55a36b9c7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:37.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.728+0000 7f1e834d4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a36b9c3a90 con 0x55a36b9a72f0 2024-09-19T08:52:37.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.728+0000 7f1e834d4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55a36b9c33c0 con 0x55a36b9a69d0 2024-09-19T08:52:37.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.728+0000 7f1e834d4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a36b9c4160 con 0x55a36b9b1bb0 2024-09-19T08:52:37.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.728+0000 7f1e834d4740 10 client.0 _ll_register_callbacks cb 0x7f1e640b8310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:37.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.728+0000 7f1e73fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a36b9a72f0 0x55a36b9cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:37.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.728+0000 7f1e73fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a36b9a72f0 0x55a36b9cc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36040/0 (socket says 172.21.15.19:36040) 2024-09-19T08:52:37.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.728+0000 7f1e73fff640 1 -- 172.21.15.19:0/4016375553 learned_addr learned my addr 172.21.15.19:0/4016375553 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:37.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.728+0000 7f1e7b59e640 1 --2- 172.21.15.19:0/4016375553 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a36b9b1bb0 0x55a36b9c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:37.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.728+0000 7f1e7ad9d640 1 --2- 172.21.15.19:0/4016375553 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a36b9a69d0 0x55a36b9cc1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:37.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.728+0000 7f1e73fff640 1 -- 172.21.15.19:0/4016375553 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a36b9b1bb0 msgr2=0x55a36b9c7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:37.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.728+0000 7f1e73fff640 1 --2- 172.21.15.19:0/4016375553 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a36b9b1bb0 0x55a36b9c7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.728+0000 7f1e73fff640 1 -- 172.21.15.19:0/4016375553 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a36b9a69d0 msgr2=0x55a36b9cc1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:37.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.728+0000 7f1e73fff640 1 --2- 172.21.15.19:0/4016375553 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a36b9a69d0 0x55a36b9cc1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.728+0000 7f1e73fff640 1 -- 172.21.15.19:0/4016375553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a36b9c7e50 con 0x55a36b9a72f0 2024-09-19T08:52:37.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.728+0000 7f1e73fff640 1 --2- 172.21.15.19:0/4016375553 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a36b9a72f0 0x55a36b9cc730 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1e64005820 tx=0x7f1e64005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7c5a765c3ce5f2e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:37.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.728+0000 7f1e627fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:52:37.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.728+0000 7f1e627fc640 1 -- 172.21.15.19:0/4016375553 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e64085070 con 0x55a36b9a72f0 2024-09-19T08:52:37.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.728+0000 7f1e627fc640 1 -- 172.21.15.19:0/4016375553 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1e640edd30 con 0x55a36b9a72f0 2024-09-19T08:52:37.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.728+0000 7f1e834d4740 1 -- 172.21.15.19:0/4016375553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e74004530 con 0x55a36b9a72f0 2024-09-19T08:52:37.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.729+0000 7f1e627fc640 1 -- 172.21.15.19:0/4016375553 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1e640e3050 con 0x55a36b9a72f0 2024-09-19T08:52:37.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.729+0000 7f1e834d4740 10 client.15441 fetch_fsmap learned FSMap version 28 2024-09-19T08:52:37.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.729+0000 7f1e834d4740 1 -- 172.21.15.19:0/4016375553 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a36b9c7e50 con 0x55a36b9a72f0 2024-09-19T08:52:37.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.729+0000 7f1e627fc640 1 -- 172.21.15.19:0/4016375553 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e74004530 con 0x55a36b9a72f0 2024-09-19T08:52:37.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.729+0000 7f1e627fc640 1 -- 172.21.15.19:0/4016375553 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1e640bbb00 con 0x55a36b9a72f0 2024-09-19T08:52:37.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.729+0000 7f1e834d4740 10 client.15441 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:52:37.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.729+0000 7f1e834d4740 10 client.15441 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-19T08:52:37.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.729+0000 7f1e834d4740 20 client.15441 populate_metadata read hostname 'smithi019' 2024-09-19T08:52:37.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.729+0000 7f1e834d4740 1 --2- 172.21.15.19:0/4016375553 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55a36ba312b0 0x55a36ba2ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:37.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.729+0000 7f1e834d4740 4 client.15441 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T08:52:37.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.729+0000 7f1e834d4740 1 -- 172.21.15.19:0/4016375553 --> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] -- command(tid 0: {"prefix": "status"}) -- 0x55a36b914b10 con 0x55a36ba312b0 2024-09-19T08:52:37.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.729+0000 7f1e7ad9d640 1 --2- 172.21.15.19:0/4016375553 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55a36ba312b0 0x55a36ba2ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:37.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.730+0000 7f1e627fc640 10 client.15441 ms_handle_connect on v2:172.21.15.203:6836/3684671619 2024-09-19T08:52:37.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.730+0000 7f1e7ad9d640 1 --2- 172.21.15.19:0/4016375553 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55a36ba312b0 0x55a36ba2ffc0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c18633881d2cd44f server_cookie=a14f16f5999ef61e in_seq=0 out_seq=0 2024-09-19T08:52:37.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.730+0000 7f1e627fc640 1 -- 172.21.15.19:0/4016375553 <== mds.2 v2:172.21.15.203:6836/3684671619 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55a36b914b10 con 0x55a36ba312b0 2024-09-19T08:52:37.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.730+0000 7f1e627fc640 10 client.15441 handle_command_reply: tid=0 2024-09-19T08:52:37.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.730+0000 7f1e834d4740 1 client.15441 shutdown 2024-09-19T08:52:37.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.730+0000 7f1e834d4740 1 -- 172.21.15.19:0/4016375553 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a36b9a72f0 msgr2=0x55a36b9cc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:37.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.730+0000 7f1e834d4740 1 --2- 172.21.15.19:0/4016375553 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a36b9a72f0 0x55a36b9cc730 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1e64005820 tx=0x7f1e64005c90 comp rx=0 tx=0).stop 2024-09-19T08:52:37.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.730+0000 7f1e834d4740 1 -- 172.21.15.19:0/4016375553 shutdown_connections 2024-09-19T08:52:37.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.730+0000 7f1e834d4740 1 --2- 172.21.15.19:0/4016375553 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55a36ba312b0 0x55a36ba2ffc0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.730+0000 7f1e834d4740 1 --2- 172.21.15.19:0/4016375553 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a36b9b1bb0 0x55a36b9c7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.730+0000 7f1e627fc640 0 client.15441 ms_handle_reset on v2:172.21.15.203:6836/3684671619 2024-09-19T08:52:37.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.730+0000 7f1e834d4740 1 --2- 172.21.15.19:0/4016375553 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a36b9a72f0 0x55a36b9cc730 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.730+0000 7f1e834d4740 1 --2- 172.21.15.19:0/4016375553 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a36b9a69d0 0x55a36b9cc1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.730+0000 7f1e834d4740 1 -- 172.21.15.19:0/4016375553 >> 172.21.15.19:0/4016375553 conn(0x55a36b9a2f60 msgr2=0x55a36b9acfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:37.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.731+0000 7f1e834d4740 1 -- 172.21.15.19:0/4016375553 shutdown_connections 2024-09-19T08:52:37.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.731+0000 7f1e834d4740 1 -- 172.21.15.19:0/4016375553 wait complete. 2024-09-19T08:52:37.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.731+0000 7f1e834d4740 20 client.15441 trim_cache size 0 max 16384 2024-09-19T08:52:37.745 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:52:37.745 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "f26c9d84-7662-11ef-bceb-c7b262605968", 2024-09-19T08:52:37.745 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 2, 2024-09-19T08:52:37.745 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 24469, 2024-09-19T08:52:37.745 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-19T08:52:37.745 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-19T08:52:37.745 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-19T08:52:37.745 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 132.81629022800001, 2024-09-19T08:52:37.745 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 28, 2024-09-19T08:52:37.745 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 82, 2024-09-19T08:52:37.745 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 82, 2024-09-19T08:52:37.745 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 166.35818293 2024-09-19T08:52:37.745 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:52:37.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.731+0000 7f1e810fb640 1 -- 172.21.15.19:0/2098918248 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1e680a32d0 msgr2=0x7f1e680a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:37.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.731+0000 7f1e810fb640 1 --2- 172.21.15.19:0/2098918248 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1e680a32d0 0x7f1e680a5790 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1e74007f50 tx=0x7f1e74004a40 comp rx=0 tx=0).stop 2024-09-19T08:52:37.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.731+0000 7f1e810fb640 1 -- 172.21.15.19:0/2098918248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e7c103660 msgr2=0x7f1e7c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:37.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.731+0000 7f1e810fb640 1 --2- 172.21.15.19:0/2098918248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e7c103660 0x7f1e7c100ee0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f1e64006010 tx=0x7f1e640042f0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.731+0000 7f1e810fb640 1 -- 172.21.15.19:0/2098918248 shutdown_connections 2024-09-19T08:52:37.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.731+0000 7f1e810fb640 1 --2- 172.21.15.19:0/2098918248 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1e680a32d0 0x7f1e680a5790 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.731+0000 7f1e810fb640 1 --2- 172.21.15.19:0/2098918248 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e7c10c170 0x7f1e7c101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.731+0000 7f1e810fb640 1 --2- 172.21.15.19:0/2098918248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e7c103660 0x7f1e7c100ee0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.731+0000 7f1e810fb640 1 --2- 172.21.15.19:0/2098918248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e7c102d40 0x7f1e7c1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:37.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.732+0000 7f1e810fb640 1 -- 172.21.15.19:0/2098918248 >> 172.21.15.19:0/2098918248 conn(0x7f1e7c0fc7a0 msgr2=0x7f1e7c0fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:37.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.732+0000 7f1e810fb640 1 -- 172.21.15.19:0/2098918248 shutdown_connections 2024-09-19T08:52:37.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:37.732+0000 7f1e810fb640 1 -- 172.21.15.19:0/2098918248 wait complete. 2024-09-19T08:52:38.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:37 smithi019 ceph-mon[30976]: pgmap v349: 97 pgs: 97 active+clean; 662 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.6 KiB/s wr, 15 op/s 2024-09-19T08:52:38.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:37 smithi155 ceph-mon[34921]: pgmap v349: 97 pgs: 97 active+clean; 662 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.6 KiB/s wr, 15 op/s 2024-09-19T08:52:38.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:37 smithi203 ceph-mon[35450]: pgmap v349: 97 pgs: 97 active+clean; 662 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.6 KiB/s wr, 15 op/s 2024-09-19T08:52:38.439 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T08:52:38.705 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:39.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.188+0000 7fd4e4a75640 1 -- 172.21.15.19:0/2029202769 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4e0106f10 msgr2=0x7fd4e010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:39.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.188+0000 7fd4e4a75640 1 --2- 172.21.15.19:0/2029202769 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4e0106f10 0x7fd4e010ea90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8009900 tx=0x7fd4d802a410 comp rx=0 tx=0).stop 2024-09-19T08:52:39.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.189+0000 7fd4e4a75640 1 -- 172.21.15.19:0/2029202769 shutdown_connections 2024-09-19T08:52:39.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.189+0000 7fd4e4a75640 1 --2- 172.21.15.19:0/2029202769 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4e0106f10 0x7fd4e010ea90 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:39.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.189+0000 7fd4e4a75640 1 --2- 172.21.15.19:0/2029202769 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4e0102790 0x7fd4e01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:39.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.189+0000 7fd4e4a75640 1 --2- 172.21.15.19:0/2029202769 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4e0101de0 0x7fd4e01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:39.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.189+0000 7fd4e4a75640 1 -- 172.21.15.19:0/2029202769 >> 172.21.15.19:0/2029202769 conn(0x7fd4e00fd8c0 msgr2=0x7fd4e00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:39.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.189+0000 7fd4e4a75640 1 -- 172.21.15.19:0/2029202769 shutdown_connections 2024-09-19T08:52:39.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.189+0000 7fd4e4a75640 1 -- 172.21.15.19:0/2029202769 wait complete. 2024-09-19T08:52:39.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.189+0000 7fd4e4a75640 1 Processor -- start 2024-09-19T08:52:39.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.189+0000 7fd4e4a75640 1 -- start start 2024-09-19T08:52:39.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.190+0000 7fd4e4a75640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4e0101de0 0x7fd4e01983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:39.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.190+0000 7fd4e4a75640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4e0102790 0x7fd4e01988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:39.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.190+0000 7fd4e4a75640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4e0106f10 0x7fd4e019cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:39.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.190+0000 7fd4e4a75640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e0111f70 con 0x7fd4e0101de0 2024-09-19T08:52:39.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.190+0000 7fd4e4a75640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e0111df0 con 0x7fd4e0102790 2024-09-19T08:52:39.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.190+0000 7fd4e4a75640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd4e01120f0 con 0x7fd4e0106f10 2024-09-19T08:52:39.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.190+0000 7fd4de59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4e0101de0 0x7fd4e01983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:39.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.190+0000 7fd4de59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4e0101de0 0x7fd4e01983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36058/0 (socket says 172.21.15.19:36058) 2024-09-19T08:52:39.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.190+0000 7fd4de59c640 1 -- 172.21.15.19:0/1102186029 learned_addr learned my addr 172.21.15.19:0/1102186029 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:39.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.190+0000 7fd4ded9d640 1 --2- 172.21.15.19:0/1102186029 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4e0106f10 0x7fd4e019cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:39.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.190+0000 7fd4ddd9b640 1 --2- 172.21.15.19:0/1102186029 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4e0102790 0x7fd4e01988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:39.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.190+0000 7fd4de59c640 1 -- 172.21.15.19:0/1102186029 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4e0106f10 msgr2=0x7fd4e019cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:39.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.190+0000 7fd4de59c640 1 --2- 172.21.15.19:0/1102186029 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4e0106f10 0x7fd4e019cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:39.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.190+0000 7fd4de59c640 1 -- 172.21.15.19:0/1102186029 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4e0102790 msgr2=0x7fd4e01988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:39.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.190+0000 7fd4de59c640 1 --2- 172.21.15.19:0/1102186029 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4e0102790 0x7fd4e01988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:39.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.190+0000 7fd4de59c640 1 -- 172.21.15.19:0/1102186029 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e019d350 con 0x7fd4e0101de0 2024-09-19T08:52:39.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.190+0000 7fd4ddd9b640 1 --2- 172.21.15.19:0/1102186029 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4e0102790 0x7fd4e01988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:39.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.190+0000 7fd4ded9d640 1 --2- 172.21.15.19:0/1102186029 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4e0106f10 0x7fd4e019cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:39.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.190+0000 7fd4de59c640 1 --2- 172.21.15.19:0/1102186029 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4e0101de0 0x7fd4e01983a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd4d000ea80 tx=0x7fd4d000ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:39.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.190+0000 7fd4d77fe640 1 -- 172.21.15.19:0/1102186029 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d000ce40 con 0x7fd4e0101de0 2024-09-19T08:52:39.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.191+0000 7fd4e4a75640 1 -- 172.21.15.19:0/1102186029 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4e019d640 con 0x7fd4e0101de0 2024-09-19T08:52:39.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.191+0000 7fd4e4a75640 1 -- 172.21.15.19:0/1102186029 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4e01a4f20 con 0x7fd4e0101de0 2024-09-19T08:52:39.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.191+0000 7fd4d77fe640 1 -- 172.21.15.19:0/1102186029 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4d0005020 con 0x7fd4e0101de0 2024-09-19T08:52:39.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.191+0000 7fd4d77fe640 1 -- 172.21.15.19:0/1102186029 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d001f060 con 0x7fd4e0101de0 2024-09-19T08:52:39.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.193+0000 7fd4d77fe640 1 -- 172.21.15.19:0/1102186029 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7fd4d0004a40 con 0x7fd4e0101de0 2024-09-19T08:52:39.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.193+0000 7fd4e6e4e740 1 Processor -- start 2024-09-19T08:52:39.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.193+0000 7fd4e6e4e740 1 -- start start 2024-09-19T08:52:39.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.194+0000 7fd4e6e4e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c261b339d0 0x55c261b33db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:39.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.194+0000 7fd4e6e4e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c261b342f0 0x55c261b3e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:39.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.194+0000 7fd4e6e4e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c261b3ebb0 0x55c261b40fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:39.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.194+0000 7fd4e6e4e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c261a9a090 con 0x55c261b342f0 2024-09-19T08:52:39.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.194+0000 7fd4e6e4e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55c261a41a70 con 0x55c261b3ebb0 2024-09-19T08:52:39.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.194+0000 7fd4e6e4e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c261a96050 con 0x55c261b339d0 2024-09-19T08:52:39.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.194+0000 7fd4de59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c261b342f0 0x55c261b3e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:39.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.194+0000 7fd4ded9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c261b339d0 0x55c261b33db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:39.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.194+0000 7fd4ded9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c261b339d0 0x55c261b33db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:56424/0 (socket says 172.21.15.19:56424) 2024-09-19T08:52:39.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.194+0000 7fd4ded9d640 1 -- 172.21.15.19:0/308282333 learned_addr learned my addr 172.21.15.19:0/308282333 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:39.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.194+0000 7fd4d77fe640 1 --2- 172.21.15.19:0/1102186029 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd4cc0a32d0 0x7fd4cc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:39.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.194+0000 7fd4ddd9b640 1 --2- 172.21.15.19:0/308282333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c261b3ebb0 0x55c261b40fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:39.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.194+0000 7fd4ded9d640 1 --2- 172.21.15.19:0/1102186029 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd4cc0a32d0 0x7fd4cc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:39.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.194+0000 7fd4de59c640 1 -- 172.21.15.19:0/308282333 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c261b339d0 msgr2=0x55c261b33db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:39.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.194+0000 7fd4de59c640 1 --2- 172.21.15.19:0/308282333 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c261b339d0 0x55c261b33db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:39.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.194+0000 7fd4de59c640 1 -- 172.21.15.19:0/308282333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c261b3ebb0 msgr2=0x55c261b40fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:39.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.194+0000 7fd4de59c640 1 --2- 172.21.15.19:0/308282333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c261b3ebb0 0x55c261b40fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:39.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.194+0000 7fd4de59c640 1 -- 172.21.15.19:0/308282333 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c261a4e130 con 0x55c261b342f0 2024-09-19T08:52:39.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.194+0000 7fd4d77fe640 1 -- 172.21.15.19:0/1102186029 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd4d00cfd60 con 0x7fd4e0101de0 2024-09-19T08:52:39.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.195+0000 7fd4de59c640 1 --2- 172.21.15.19:0/308282333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c261b342f0 0x55c261b3e670 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd4d00cd6c0 tx=0x7fd4d0021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e1831b1746e8f1b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:39.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.195+0000 7fd4ded9d640 1 --2- 172.21.15.19:0/1102186029 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd4cc0a32d0 0x7fd4cc0a5790 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8031550 tx=0x7fd4d802a410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:39.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.195+0000 7fd4d4ff9640 1 -- 172.21.15.19:0/308282333 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d00a3900 con 0x55c261b342f0 2024-09-19T08:52:39.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.195+0000 7fd4d4ff9640 1 -- 172.21.15.19:0/308282333 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4d009c8d0 con 0x55c261b342f0 2024-09-19T08:52:39.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.195+0000 7fd4d4ff9640 1 -- 172.21.15.19:0/308282333 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d00d3360 con 0x55c261b342f0 2024-09-19T08:52:39.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.195+0000 7fd4e6e4e740 1 -- 172.21.15.19:0/308282333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c261b342f0 msgr2=0x55c261b3e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:39.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.196+0000 7fd4e6e4e740 1 --2- 172.21.15.19:0/308282333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c261b342f0 0x55c261b3e670 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd4d00cd6c0 tx=0x7fd4d0021000 comp rx=0 tx=0).stop 2024-09-19T08:52:39.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.196+0000 7fd4e6e4e740 1 -- 172.21.15.19:0/308282333 shutdown_connections 2024-09-19T08:52:39.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.196+0000 7fd4e6e4e740 1 --2- 172.21.15.19:0/308282333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c261b3ebb0 0x55c261b40fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:39.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.196+0000 7fd4e6e4e740 1 --2- 172.21.15.19:0/308282333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c261b342f0 0x55c261b3e670 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:39.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.196+0000 7fd4e6e4e740 1 --2- 172.21.15.19:0/308282333 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c261b339d0 0x55c261b33db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:39.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.196+0000 7fd4e6e4e740 1 -- 172.21.15.19:0/308282333 >> 172.21.15.19:0/308282333 conn(0x55c261b2ff60 msgr2=0x55c261b30340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:39.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.196+0000 7fd4e6e4e740 1 -- 172.21.15.19:0/308282333 shutdown_connections 2024-09-19T08:52:39.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.196+0000 7fd4e6e4e740 1 -- 172.21.15.19:0/308282333 wait complete. 2024-09-19T08:52:39.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.196+0000 7fd4e6e4e740 1 -- start start 2024-09-19T08:52:39.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.196+0000 7fd4e6e4e740 1 Processor -- start 2024-09-19T08:52:39.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.196+0000 7fd4e6e4e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c261b339d0 0x55c261b3e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:39.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.196+0000 7fd4e6e4e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c261b342f0 0x55c261b3b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:39.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.196+0000 7fd4e6e4e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c261b3ebb0 0x55c261b3bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:39.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.196+0000 7fd4e6e4e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c261b41780 con 0x55c261b339d0 2024-09-19T08:52:39.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.196+0000 7fd4e6e4e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55c261a54f20 con 0x55c261b3ebb0 2024-09-19T08:52:39.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.196+0000 7fd4e6e4e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c261b41900 con 0x55c261b342f0 2024-09-19T08:52:39.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.196+0000 7fd4e6e4e740 10 client.0 _ll_register_callbacks cb 0x55c261a1e030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:39.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.196+0000 7fd4de59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c261b339d0 0x55c261b3e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:39.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.197+0000 7fd4de59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c261b339d0 0x55c261b3e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36076/0 (socket says 172.21.15.19:36076) 2024-09-19T08:52:39.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.197+0000 7fd4de59c640 1 -- 172.21.15.19:0/2363269848 learned_addr learned my addr 172.21.15.19:0/2363269848 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:39.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.197+0000 7fd4ddd9b640 1 --2- 172.21.15.19:0/2363269848 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c261b342f0 0x55c261b3b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:39.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.197+0000 7fd4ded9d640 1 --2- 172.21.15.19:0/2363269848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c261b3ebb0 0x55c261b3bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:39.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.197+0000 7fd4de59c640 1 -- 172.21.15.19:0/2363269848 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c261b342f0 msgr2=0x55c261b3b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:39.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.197+0000 7fd4de59c640 1 --2- 172.21.15.19:0/2363269848 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c261b342f0 0x55c261b3b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:39.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.197+0000 7fd4de59c640 1 -- 172.21.15.19:0/2363269848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c261b3ebb0 msgr2=0x55c261b3bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:39.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.197+0000 7fd4de59c640 1 --2- 172.21.15.19:0/2363269848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c261b3ebb0 0x55c261b3bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:39.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.197+0000 7fd4de59c640 1 -- 172.21.15.19:0/2363269848 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c26180b2b0 con 0x55c261b339d0 2024-09-19T08:52:39.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.197+0000 7fd4ded9d640 1 --2- 172.21.15.19:0/2363269848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c261b3ebb0 0x55c261b3bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:39.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.197+0000 7fd4ddd9b640 1 --2- 172.21.15.19:0/2363269848 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c261b342f0 0x55c261b3b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:39.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.197+0000 7fd4de59c640 1 --2- 172.21.15.19:0/2363269848 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c261b339d0 0x55c261b3e410 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd4d009ca80 tx=0x7fd4d0048cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7295de45d011d004 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:39.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.197+0000 7fd4c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:52:39.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.197+0000 7fd4c5ffb640 1 -- 172.21.15.19:0/2363269848 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d00a3900 con 0x55c261b339d0 2024-09-19T08:52:39.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.197+0000 7fd4c5ffb640 1 -- 172.21.15.19:0/2363269848 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd4d00cd910 con 0x55c261b339d0 2024-09-19T08:52:39.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.197+0000 7fd4e6e4e740 1 -- 172.21.15.19:0/2363269848 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4d009c8d0 con 0x55c261b339d0 2024-09-19T08:52:39.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.197+0000 7fd4c5ffb640 1 -- 172.21.15.19:0/2363269848 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd4d00d3360 con 0x55c261b339d0 2024-09-19T08:52:39.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.197+0000 7fd4e6e4e740 10 client.15453 fetch_fsmap learned FSMap version 28 2024-09-19T08:52:39.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.197+0000 7fd4e6e4e740 1 -- 172.21.15.19:0/2363269848 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c261b41780 con 0x55c261b339d0 2024-09-19T08:52:39.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.198+0000 7fd4c5ffb640 1 -- 172.21.15.19:0/2363269848 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4d009c8d0 con 0x55c261b339d0 2024-09-19T08:52:39.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.198+0000 7fd4c5ffb640 1 -- 172.21.15.19:0/2363269848 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd4d000f040 con 0x55c261b339d0 2024-09-19T08:52:39.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.198+0000 7fd4e6e4e740 10 client.15453 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:52:39.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.198+0000 7fd4e6e4e740 10 client.15453 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T08:52:39.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.198+0000 7fd4e6e4e740 20 client.15453 populate_metadata read hostname 'smithi019' 2024-09-19T08:52:39.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.198+0000 7fd4e6e4e740 1 --2- 172.21.15.19:0/2363269848 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55c261b4f2c0 0x55c261b50730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:39.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.198+0000 7fd4e6e4e740 4 client.15453 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:39.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.198+0000 7fd4e6e4e740 1 -- 172.21.15.19:0/2363269848 --> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c261aa7600 con 0x55c261b4f2c0 2024-09-19T08:52:39.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.199+0000 7fd4ddd9b640 1 --2- 172.21.15.19:0/2363269848 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55c261b4f2c0 0x55c261b50730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:39.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.199+0000 7fd4ddd9b640 1 --2- 172.21.15.19:0/2363269848 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55c261b4f2c0 0x55c261b50730 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e6c61f57975294a5 server_cookie=bd4efab0231f97e5 in_seq=0 out_seq=0 2024-09-19T08:52:39.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.199+0000 7fd4c5ffb640 10 client.15453 ms_handle_connect on v2:172.21.15.203:6838/2547507299 2024-09-19T08:52:39.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.200+0000 7fd4c5ffb640 1 -- 172.21.15.19:0/2363269848 <== mds.1 v2:172.21.15.203:6838/2547507299 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c261aa7600 con 0x55c261b4f2c0 2024-09-19T08:52:39.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.200+0000 7fd4c5ffb640 10 client.15453 handle_command_reply: tid=0 2024-09-19T08:52:39.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.200+0000 7fd4e6e4e740 1 client.15453 shutdown 2024-09-19T08:52:39.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.200+0000 7fd4e6e4e740 1 -- 172.21.15.19:0/2363269848 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c261b339d0 msgr2=0x55c261b3e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:39.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.200+0000 7fd4e6e4e740 1 --2- 172.21.15.19:0/2363269848 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c261b339d0 0x55c261b3e410 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd4d009ca80 tx=0x7fd4d0048cb0 comp rx=0 tx=0).stop 2024-09-19T08:52:39.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.200+0000 7fd4e6e4e740 1 -- 172.21.15.19:0/2363269848 shutdown_connections 2024-09-19T08:52:39.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.200+0000 7fd4e6e4e740 1 --2- 172.21.15.19:0/2363269848 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55c261b4f2c0 0x55c261b50730 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:39.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.200+0000 7fd4e6e4e740 1 --2- 172.21.15.19:0/2363269848 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c261b342f0 0x55c261b3b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:39.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.200+0000 7fd4e6e4e740 1 --2- 172.21.15.19:0/2363269848 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c261b3ebb0 0x55c261b3bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:39.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.200+0000 7fd4c5ffb640 0 client.15453 ms_handle_reset on v2:172.21.15.203:6838/2547507299 2024-09-19T08:52:39.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.200+0000 7fd4e6e4e740 1 --2- 172.21.15.19:0/2363269848 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c261b339d0 0x55c261b3e410 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:39.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.200+0000 7fd4e6e4e740 1 -- 172.21.15.19:0/2363269848 >> 172.21.15.19:0/2363269848 conn(0x55c261b2ff60 msgr2=0x55c261b35c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:39.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.200+0000 7fd4e6e4e740 1 -- 172.21.15.19:0/2363269848 shutdown_connections 2024-09-19T08:52:39.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.200+0000 7fd4e6e4e740 1 -- 172.21.15.19:0/2363269848 wait complete. 2024-09-19T08:52:39.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.200+0000 7fd4e6e4e740 20 client.15453 trim_cache size 0 max 16384 2024-09-19T08:52:39.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.218+0000 7fd4e6e4e740 1 Processor -- start 2024-09-19T08:52:39.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.218+0000 7fd4e6e4e740 1 -- start start 2024-09-19T08:52:39.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.218+0000 7fd4e6e4e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c261b339d0 0x55c261b4e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:39.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.218+0000 7fd4e6e4e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c261b342f0 0x55c261b389c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:39.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.218+0000 7fd4e6e4e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c261b3ebb0 0x55c261b38f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:39.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.218+0000 7fd4e6e4e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c261b4ea70 con 0x55c261b3ebb0 2024-09-19T08:52:39.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.218+0000 7fd4e6e4e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55c261b4f140 con 0x55c261b342f0 2024-09-19T08:52:39.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.218+0000 7fd4e6e4e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c261b4f810 con 0x55c261b339d0 2024-09-19T08:52:39.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.219+0000 7fd4ded9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c261b3ebb0 0x55c261b38f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:39.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.219+0000 7fd4ded9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c261b3ebb0 0x55c261b38f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36078/0 (socket says 172.21.15.19:36078) 2024-09-19T08:52:39.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.219+0000 7fd4ded9d640 1 -- 172.21.15.19:0/1283695651 learned_addr learned my addr 172.21.15.19:0/1283695651 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:39.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.219+0000 7fd4de59c640 1 --2- 172.21.15.19:0/1283695651 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c261b339d0 0x55c261b4e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:39.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.219+0000 7fd4ddd9b640 1 --2- 172.21.15.19:0/1283695651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c261b342f0 0x55c261b389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:39.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.219+0000 7fd4ded9d640 1 -- 172.21.15.19:0/1283695651 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c261b339d0 msgr2=0x55c261b4e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:39.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.219+0000 7fd4ded9d640 1 --2- 172.21.15.19:0/1283695651 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c261b339d0 0x55c261b4e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:39.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.219+0000 7fd4ded9d640 1 -- 172.21.15.19:0/1283695651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c261b342f0 msgr2=0x55c261b389c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:39.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.219+0000 7fd4ded9d640 1 --2- 172.21.15.19:0/1283695651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c261b342f0 0x55c261b389c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:39.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.219+0000 7fd4ded9d640 1 -- 172.21.15.19:0/1283695651 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c261b3e780 con 0x55c261b3ebb0 2024-09-19T08:52:39.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.219+0000 7fd4ddd9b640 1 --2- 172.21.15.19:0/1283695651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c261b342f0 0x55c261b389c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:39.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.219+0000 7fd4ded9d640 1 --2- 172.21.15.19:0/1283695651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c261b3ebb0 0x55c261b38f00 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8009900 tx=0x7fd4d8005b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=775f5971cc56f3a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:39.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.219+0000 7fd4c7fff640 1 -- 172.21.15.19:0/1283695651 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d8035070 con 0x55c261b3ebb0 2024-09-19T08:52:39.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.219+0000 7fd4c7fff640 1 -- 172.21.15.19:0/1283695651 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4d8005520 con 0x55c261b3ebb0 2024-09-19T08:52:39.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.219+0000 7fd4c7fff640 1 -- 172.21.15.19:0/1283695651 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d8004ce0 con 0x55c261b3ebb0 2024-09-19T08:52:39.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.220+0000 7fd4e6e4e740 1 -- 172.21.15.19:0/1283695651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c261b3ebb0 msgr2=0x55c261b38f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:39.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.220+0000 7fd4e6e4e740 1 --2- 172.21.15.19:0/1283695651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c261b3ebb0 0x55c261b38f00 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8009900 tx=0x7fd4d8005b70 comp rx=0 tx=0).stop 2024-09-19T08:52:39.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.220+0000 7fd4e6e4e740 1 -- 172.21.15.19:0/1283695651 shutdown_connections 2024-09-19T08:52:39.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.220+0000 7fd4e6e4e740 1 --2- 172.21.15.19:0/1283695651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c261b3ebb0 0x55c261b38f00 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:39.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.220+0000 7fd4e6e4e740 1 --2- 172.21.15.19:0/1283695651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c261b342f0 0x55c261b389c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:39.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.220+0000 7fd4e6e4e740 1 --2- 172.21.15.19:0/1283695651 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c261b339d0 0x55c261b4e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:39.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.220+0000 7fd4e6e4e740 1 -- 172.21.15.19:0/1283695651 >> 172.21.15.19:0/1283695651 conn(0x55c261b2ff60 msgr2=0x55c261b3a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:39.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.220+0000 7fd4e6e4e740 1 -- 172.21.15.19:0/1283695651 shutdown_connections 2024-09-19T08:52:39.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.220+0000 7fd4e6e4e740 1 -- 172.21.15.19:0/1283695651 wait complete. 2024-09-19T08:52:39.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.220+0000 7fd4e6e4e740 1 -- start start 2024-09-19T08:52:39.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.221+0000 7fd4e6e4e740 1 Processor -- start 2024-09-19T08:52:39.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.221+0000 7fd4e6e4e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c261b339d0 0x55c261b51aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:39.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.221+0000 7fd4e6e4e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c261b342f0 0x55c261b51fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:39.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.221+0000 7fd4e6e4e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c261b3ebb0 0x55c261bb79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:39.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.221+0000 7fd4e6e4e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c261b505b0 con 0x55c261b339d0 2024-09-19T08:52:39.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.221+0000 7fd4e6e4e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55c261b4fee0 con 0x55c261b3ebb0 2024-09-19T08:52:39.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.221+0000 7fd4e6e4e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c261b50c80 con 0x55c261b342f0 2024-09-19T08:52:39.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.221+0000 7fd4e6e4e740 10 client.0 _ll_register_callbacks cb 0x7fd4d8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:39.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.221+0000 7fd4de59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c261b339d0 0x55c261b51aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:39.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.221+0000 7fd4de59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c261b339d0 0x55c261b51aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36094/0 (socket says 172.21.15.19:36094) 2024-09-19T08:52:39.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.221+0000 7fd4de59c640 1 -- 172.21.15.19:0/3666617805 learned_addr learned my addr 172.21.15.19:0/3666617805 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:39.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.221+0000 7fd4ddd9b640 1 --2- 172.21.15.19:0/3666617805 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c261b342f0 0x55c261b51fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:39.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.221+0000 7fd4ded9d640 1 --2- 172.21.15.19:0/3666617805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c261b3ebb0 0x55c261bb79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:39.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.221+0000 7fd4de59c640 1 -- 172.21.15.19:0/3666617805 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c261b342f0 msgr2=0x55c261b51fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:39.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.221+0000 7fd4de59c640 1 --2- 172.21.15.19:0/3666617805 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c261b342f0 0x55c261b51fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:39.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.221+0000 7fd4de59c640 1 -- 172.21.15.19:0/3666617805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c261b3ebb0 msgr2=0x55c261bb79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:39.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.221+0000 7fd4de59c640 1 --2- 172.21.15.19:0/3666617805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c261b3ebb0 0x55c261bb79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:39.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.221+0000 7fd4de59c640 1 -- 172.21.15.19:0/3666617805 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c261bb7f00 con 0x55c261b339d0 2024-09-19T08:52:39.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.221+0000 7fd4ded9d640 1 --2- 172.21.15.19:0/3666617805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c261b3ebb0 0x55c261bb79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:39.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.221+0000 7fd4ddd9b640 1 --2- 172.21.15.19:0/3666617805 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c261b342f0 0x55c261b51fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:39.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.221+0000 7fd4de59c640 1 --2- 172.21.15.19:0/3666617805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c261b339d0 0x55c261b51aa0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd4d000efd0 tx=0x7fd4d0098a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b52752d47cc375ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:39.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.222+0000 7fd4c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:52:39.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.222+0000 7fd4c5ffb640 1 -- 172.21.15.19:0/3666617805 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d00a0380 con 0x55c261b339d0 2024-09-19T08:52:39.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.222+0000 7fd4c5ffb640 1 -- 172.21.15.19:0/3666617805 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd4d009b820 con 0x55c261b339d0 2024-09-19T08:52:39.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.222+0000 7fd4e6e4e740 1 -- 172.21.15.19:0/3666617805 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4d8005520 con 0x55c261b339d0 2024-09-19T08:52:39.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.222+0000 7fd4c5ffb640 1 -- 172.21.15.19:0/3666617805 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd4d009bb30 con 0x55c261b339d0 2024-09-19T08:52:39.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.222+0000 7fd4e6e4e740 10 client.15459 fetch_fsmap learned FSMap version 28 2024-09-19T08:52:39.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.222+0000 7fd4e6e4e740 1 -- 172.21.15.19:0/3666617805 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c261bb8ff0 con 0x55c261b339d0 2024-09-19T08:52:39.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.222+0000 7fd4c5ffb640 1 -- 172.21.15.19:0/3666617805 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd4d8005520 con 0x55c261b339d0 2024-09-19T08:52:39.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.222+0000 7fd4c5ffb640 1 -- 172.21.15.19:0/3666617805 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fd4d009b090 con 0x55c261b339d0 2024-09-19T08:52:39.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.222+0000 7fd4e6e4e740 10 client.15459 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:52:39.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.222+0000 7fd4e6e4e740 10 client.15459 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T08:52:39.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.222+0000 7fd4e6e4e740 20 client.15459 populate_metadata read hostname 'smithi019' 2024-09-19T08:52:39.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.222+0000 7fd4e6e4e740 1 --2- 172.21.15.19:0/3666617805 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55c261bbd930 0x55c261bbc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:39.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.222+0000 7fd4e6e4e740 4 client.15459 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T08:52:39.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.222+0000 7fd4e6e4e740 1 -- 172.21.15.19:0/3666617805 --> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] -- command(tid 0: {"prefix": "status"}) -- 0x55c261aa1b10 con 0x55c261bbd930 2024-09-19T08:52:39.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.223+0000 7fd4ddd9b640 1 --2- 172.21.15.19:0/3666617805 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55c261bbd930 0x55c261bbc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:39.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.223+0000 7fd4ddd9b640 1 --2- 172.21.15.19:0/3666617805 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55c261bbd930 0x55c261bbc640 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=34ddd03cc9ae2229 server_cookie=7e762b9286769b75 in_seq=0 out_seq=0 2024-09-19T08:52:39.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.223+0000 7fd4c5ffb640 10 client.15459 ms_handle_connect on v2:172.21.15.203:6838/2547507299 2024-09-19T08:52:39.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.223+0000 7fd4c5ffb640 1 -- 172.21.15.19:0/3666617805 <== mds.1 v2:172.21.15.203:6838/2547507299 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55c261aa1b10 con 0x55c261bbd930 2024-09-19T08:52:39.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.223+0000 7fd4c5ffb640 10 client.15459 handle_command_reply: tid=0 2024-09-19T08:52:39.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.223+0000 7fd4e6e4e740 1 client.15459 shutdown 2024-09-19T08:52:39.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.223+0000 7fd4e6e4e740 1 -- 172.21.15.19:0/3666617805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c261b339d0 msgr2=0x55c261b51aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:39.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.223+0000 7fd4e6e4e740 1 --2- 172.21.15.19:0/3666617805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c261b339d0 0x55c261b51aa0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd4d000efd0 tx=0x7fd4d0098a30 comp rx=0 tx=0).stop 2024-09-19T08:52:39.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.224+0000 7fd4e6e4e740 1 -- 172.21.15.19:0/3666617805 shutdown_connections 2024-09-19T08:52:39.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.224+0000 7fd4e6e4e740 1 --2- 172.21.15.19:0/3666617805 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55c261bbd930 0x55c261bbc640 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:39.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.224+0000 7fd4e6e4e740 1 --2- 172.21.15.19:0/3666617805 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c261b342f0 0x55c261b51fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:39.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.224+0000 7fd4e6e4e740 1 --2- 172.21.15.19:0/3666617805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c261b3ebb0 0x55c261bb79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:39.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.224+0000 7fd4c5ffb640 0 client.15459 ms_handle_reset on v2:172.21.15.203:6838/2547507299 2024-09-19T08:52:39.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.224+0000 7fd4e6e4e740 1 --2- 172.21.15.19:0/3666617805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c261b339d0 0x55c261b51aa0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:39.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.224+0000 7fd4e6e4e740 1 -- 172.21.15.19:0/3666617805 >> 172.21.15.19:0/3666617805 conn(0x55c261b2ff60 msgr2=0x55c261b3b020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:39.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.224+0000 7fd4e6e4e740 1 -- 172.21.15.19:0/3666617805 shutdown_connections 2024-09-19T08:52:39.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.224+0000 7fd4e6e4e740 1 -- 172.21.15.19:0/3666617805 wait complete. 2024-09-19T08:52:39.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.224+0000 7fd4e6e4e740 20 client.15459 trim_cache size 0 max 16384 2024-09-19T08:52:39.230 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:52:39.231 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "f26c9d84-7662-11ef-bceb-c7b262605968", 2024-09-19T08:52:39.231 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 1, 2024-09-19T08:52:39.231 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 24490, 2024-09-19T08:52:39.231 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-19T08:52:39.231 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-19T08:52:39.231 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-19T08:52:39.231 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 135.31405035, 2024-09-19T08:52:39.231 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 28, 2024-09-19T08:52:39.231 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 82, 2024-09-19T08:52:39.231 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 82, 2024-09-19T08:52:39.232 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 162.55483735000001 2024-09-19T08:52:39.232 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:52:39.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.224+0000 7fd4e4a75640 1 -- 172.21.15.19:0/1102186029 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd4cc0a32d0 msgr2=0x7fd4cc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:39.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.224+0000 7fd4e4a75640 1 --2- 172.21.15.19:0/1102186029 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd4cc0a32d0 0x7fd4cc0a5790 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd4d8031550 tx=0x7fd4d802a410 comp rx=0 tx=0).stop 2024-09-19T08:52:39.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.224+0000 7fd4e4a75640 1 -- 172.21.15.19:0/1102186029 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4e0101de0 msgr2=0x7fd4e01983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:39.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.224+0000 7fd4e4a75640 1 --2- 172.21.15.19:0/1102186029 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4e0101de0 0x7fd4e01983a0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fd4d000ea80 tx=0x7fd4d000ef40 comp rx=0 tx=0).stop 2024-09-19T08:52:39.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.224+0000 7fd4e4a75640 1 -- 172.21.15.19:0/1102186029 shutdown_connections 2024-09-19T08:52:39.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.224+0000 7fd4e4a75640 1 --2- 172.21.15.19:0/1102186029 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd4cc0a32d0 0x7fd4cc0a5790 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:39.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.224+0000 7fd4e4a75640 1 --2- 172.21.15.19:0/1102186029 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd4e0106f10 0x7fd4e019cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:39.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.224+0000 7fd4e4a75640 1 --2- 172.21.15.19:0/1102186029 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd4e0102790 0x7fd4e01988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:39.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.224+0000 7fd4e4a75640 1 --2- 172.21.15.19:0/1102186029 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd4e0101de0 0x7fd4e01983a0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:39.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.224+0000 7fd4e4a75640 1 -- 172.21.15.19:0/1102186029 >> 172.21.15.19:0/1102186029 conn(0x7fd4e00fd8c0 msgr2=0x7fd4e00fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:39.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.224+0000 7fd4e4a75640 1 -- 172.21.15.19:0/1102186029 shutdown_connections 2024-09-19T08:52:39.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:39.224+0000 7fd4e4a75640 1 -- 172.21.15.19:0/1102186029 wait complete. 2024-09-19T08:52:39.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:39 smithi019 ceph-mon[30976]: pgmap v350: 97 pgs: 97 active+clean; 662 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.6 KiB/s wr, 13 op/s 2024-09-19T08:52:39.975 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T08:52:40.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:39 smithi155 ceph-mon[34921]: pgmap v350: 97 pgs: 97 active+clean; 662 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.6 KiB/s wr, 13 op/s 2024-09-19T08:52:40.231 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:40.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:39 smithi203 ceph-mon[35450]: pgmap v350: 97 pgs: 97 active+clean; 662 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.6 KiB/s wr, 13 op/s 2024-09-19T08:52:40.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.691+0000 7f7158a57640 1 -- 172.21.15.19:0/3224625601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7154106f10 msgr2=0x7f715410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:40.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.691+0000 7f7158a57640 1 --2- 172.21.15.19:0/3224625601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7154106f10 0x7f715410ea90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f714c009ca0 tx=0x7f714c02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.692+0000 7f7158a57640 1 -- 172.21.15.19:0/3224625601 shutdown_connections 2024-09-19T08:52:40.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.692+0000 7f7158a57640 1 --2- 172.21.15.19:0/3224625601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7154106f10 0x7f715410ea90 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.692+0000 7f7158a57640 1 --2- 172.21.15.19:0/3224625601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7154102790 0x7f71541067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.692+0000 7f7158a57640 1 --2- 172.21.15.19:0/3224625601 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7154101de0 0x7f71541021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.692+0000 7f7158a57640 1 -- 172.21.15.19:0/3224625601 >> 172.21.15.19:0/3224625601 conn(0x7f71540fd8c0 msgr2=0x7f71540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:40.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.692+0000 7f7158a57640 1 -- 172.21.15.19:0/3224625601 shutdown_connections 2024-09-19T08:52:40.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.692+0000 7f7158a57640 1 -- 172.21.15.19:0/3224625601 wait complete. 2024-09-19T08:52:40.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.692+0000 7f7158a57640 1 Processor -- start 2024-09-19T08:52:40.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.692+0000 7f7158a57640 1 -- start start 2024-09-19T08:52:40.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.693+0000 7f7158a57640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7154101de0 0x7f71540744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.693+0000 7f7158a57640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7154102790 0x7f7154074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.693+0000 7f7158a57640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7154106f10 0x7f7154074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.693+0000 7f7158a57640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7154111fe0 con 0x7f7154101de0 2024-09-19T08:52:40.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.693+0000 7f7158a57640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7154111e60 con 0x7f7154102790 2024-09-19T08:52:40.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.693+0000 7f7158a57640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7154112160 con 0x7f7154106f10 2024-09-19T08:52:40.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.693+0000 7f715259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7154101de0 0x7f71540744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.693+0000 7f715259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7154101de0 0x7f71540744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36110/0 (socket says 172.21.15.19:36110) 2024-09-19T08:52:40.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.693+0000 7f715259c640 1 -- 172.21.15.19:0/1863753454 learned_addr learned my addr 172.21.15.19:0/1863753454 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:40.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.693+0000 7f7152d9d640 1 --2- 172.21.15.19:0/1863753454 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7154106f10 0x7f7154074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.693+0000 7f714bfff640 1 --2- 172.21.15.19:0/1863753454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7154102790 0x7f7154074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.693+0000 7f715259c640 1 -- 172.21.15.19:0/1863753454 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7154106f10 msgr2=0x7f7154074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:40.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.693+0000 7f715259c640 1 --2- 172.21.15.19:0/1863753454 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7154106f10 0x7f7154074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.693+0000 7f715259c640 1 -- 172.21.15.19:0/1863753454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7154102790 msgr2=0x7f7154074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.693+0000 7f715259c640 1 --2- 172.21.15.19:0/1863753454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7154102790 0x7f7154074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.693+0000 7f715259c640 1 -- 172.21.15.19:0/1863753454 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71541a6990 con 0x7f7154101de0 2024-09-19T08:52:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.693+0000 7f7152d9d640 1 --2- 172.21.15.19:0/1863753454 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7154106f10 0x7f7154074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.693+0000 7f715259c640 1 --2- 172.21.15.19:0/1863753454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7154101de0 0x7f71540744f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f714400b4a0 tx=0x7f714400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.693+0000 7f714b7fe640 1 -- 172.21.15.19:0/1863753454 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7144014070 con 0x7f7154101de0 2024-09-19T08:52:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.694+0000 7f7158a57640 1 -- 172.21.15.19:0/1863753454 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71541a6c80 con 0x7f7154101de0 2024-09-19T08:52:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.694+0000 7f714b7fe640 1 -- 172.21.15.19:0/1863753454 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7144010af0 con 0x7f7154101de0 2024-09-19T08:52:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.694+0000 7f714b7fe640 1 -- 172.21.15.19:0/1863753454 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7144017d10 con 0x7f7154101de0 2024-09-19T08:52:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.694+0000 7f7158a57640 1 -- 172.21.15.19:0/1863753454 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71541a71c0 con 0x7f7154101de0 2024-09-19T08:52:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.696+0000 7f714b7fe640 1 -- 172.21.15.19:0/1863753454 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f7144017070 con 0x7f7154101de0 2024-09-19T08:52:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.696+0000 7f715ae30740 1 Processor -- start 2024-09-19T08:52:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.696+0000 7f715ae30740 1 -- start start 2024-09-19T08:52:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.697+0000 7f715ae30740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5586119ce9d0 0x5586119cedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.697+0000 7f715ae30740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5586119cf2f0 0x5586119d9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.697+0000 7f715ae30740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5586119d9bb0 0x5586119dbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.697+0000 7f715ae30740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x558611935090 con 0x5586119d9bb0 2024-09-19T08:52:40.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.697+0000 7f715ae30740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5586118dca70 con 0x5586119ce9d0 2024-09-19T08:52:40.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.697+0000 7f715ae30740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558611931050 con 0x5586119cf2f0 2024-09-19T08:52:40.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.697+0000 7f714b7fe640 1 --2- 172.21.15.19:0/1863753454 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f71400a32d0 0x7f71400a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.697+0000 7f714bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5586119d9bb0 0x5586119dbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.697+0000 7f714bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5586119d9bb0 0x5586119dbfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36122/0 (socket says 172.21.15.19:36122) 2024-09-19T08:52:40.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.697+0000 7f714bfff640 1 -- 172.21.15.19:0/1133997428 learned_addr learned my addr 172.21.15.19:0/1133997428 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:40.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.697+0000 7f7152d9d640 1 --2- 172.21.15.19:0/1863753454 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f71400a32d0 0x7f71400a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.697+0000 7f714b7fe640 1 -- 172.21.15.19:0/1863753454 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f71440ceda0 con 0x7f7154101de0 2024-09-19T08:52:40.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.697+0000 7f715259c640 1 --2- 172.21.15.19:0/1133997428 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5586119cf2f0 0x5586119d9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.697+0000 7f7152d9d640 1 --2- 172.21.15.19:0/1133997428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5586119ce9d0 0x5586119cedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.697+0000 7f714bfff640 1 -- 172.21.15.19:0/1133997428 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5586119cf2f0 msgr2=0x5586119d9670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:40.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.697+0000 7f714bfff640 1 --2- 172.21.15.19:0/1133997428 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5586119cf2f0 0x5586119d9670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.697+0000 7f714bfff640 1 -- 172.21.15.19:0/1133997428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5586119ce9d0 msgr2=0x5586119cedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:40.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.697+0000 7f714bfff640 1 --2- 172.21.15.19:0/1133997428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5586119ce9d0 0x5586119cedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.697+0000 7f714bfff640 1 -- 172.21.15.19:0/1133997428 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586118e9130 con 0x5586119d9bb0 2024-09-19T08:52:40.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.697+0000 7f714bfff640 1 --2- 172.21.15.19:0/1133997428 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5586119d9bb0 0x5586119dbfa0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f713c00ba70 tx=0x7f713c00bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c10aa4c23f6be0e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:40.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.698+0000 7f7152d9d640 1 --2- 172.21.15.19:0/1863753454 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f71400a32d0 0x7f71400a5790 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f714c009a60 tx=0x7f714c005ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:40.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.698+0000 7f7148ff9640 1 -- 172.21.15.19:0/1133997428 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713c017420 con 0x5586119d9bb0 2024-09-19T08:52:40.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.698+0000 7f7148ff9640 1 -- 172.21.15.19:0/1133997428 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f713c017aa0 con 0x5586119d9bb0 2024-09-19T08:52:40.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.698+0000 7f7148ff9640 1 -- 172.21.15.19:0/1133997428 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713c00fb20 con 0x5586119d9bb0 2024-09-19T08:52:40.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.698+0000 7f715ae30740 1 -- 172.21.15.19:0/1133997428 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5586119d9bb0 msgr2=0x5586119dbfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:40.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.698+0000 7f715ae30740 1 --2- 172.21.15.19:0/1133997428 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5586119d9bb0 0x5586119dbfa0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f713c00ba70 tx=0x7f713c00bf30 comp rx=0 tx=0).stop 2024-09-19T08:52:40.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.699+0000 7f715ae30740 1 -- 172.21.15.19:0/1133997428 shutdown_connections 2024-09-19T08:52:40.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.699+0000 7f715ae30740 1 --2- 172.21.15.19:0/1133997428 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5586119cf2f0 0x5586119d9670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.699+0000 7f715ae30740 1 --2- 172.21.15.19:0/1133997428 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5586119d9bb0 0x5586119dbfa0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.699+0000 7f715ae30740 1 --2- 172.21.15.19:0/1133997428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5586119ce9d0 0x5586119cedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.699+0000 7f715ae30740 1 -- 172.21.15.19:0/1133997428 >> 172.21.15.19:0/1133997428 conn(0x5586119caf60 msgr2=0x5586119cb340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:40.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.699+0000 7f715ae30740 1 -- 172.21.15.19:0/1133997428 shutdown_connections 2024-09-19T08:52:40.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.699+0000 7f715ae30740 1 -- 172.21.15.19:0/1133997428 wait complete. 2024-09-19T08:52:40.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.699+0000 7f715ae30740 1 -- start start 2024-09-19T08:52:40.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.699+0000 7f715ae30740 1 Processor -- start 2024-09-19T08:52:40.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.699+0000 7f715ae30740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5586119ce9d0 0x5586119d9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.699+0000 7f715ae30740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5586119cf2f0 0x5586119d6780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.699+0000 7f715ae30740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5586119d9bb0 0x5586119d6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.699+0000 7f715ae30740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5586119dc780 con 0x5586119cf2f0 2024-09-19T08:52:40.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.699+0000 7f715ae30740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5586118eff20 con 0x5586119d9bb0 2024-09-19T08:52:40.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.699+0000 7f715ae30740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5586119dc900 con 0x5586119ce9d0 2024-09-19T08:52:40.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.700+0000 7f715ae30740 10 client.0 _ll_register_callbacks cb 0x5586118b9030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:40.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.700+0000 7f714bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5586119cf2f0 0x5586119d6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.700+0000 7f714bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5586119cf2f0 0x5586119d6780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36132/0 (socket says 172.21.15.19:36132) 2024-09-19T08:52:40.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.700+0000 7f714bfff640 1 -- 172.21.15.19:0/850888368 learned_addr learned my addr 172.21.15.19:0/850888368 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:40.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.700+0000 7f715259c640 1 --2- 172.21.15.19:0/850888368 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5586119ce9d0 0x5586119d9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.700+0000 7f7152d9d640 1 --2- 172.21.15.19:0/850888368 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5586119d9bb0 0x5586119d6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.700+0000 7f714bfff640 1 -- 172.21.15.19:0/850888368 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5586119ce9d0 msgr2=0x5586119d9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:40.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.700+0000 7f714bfff640 1 --2- 172.21.15.19:0/850888368 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5586119ce9d0 0x5586119d9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.700+0000 7f714bfff640 1 -- 172.21.15.19:0/850888368 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5586119d9bb0 msgr2=0x5586119d6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:40.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.700+0000 7f714bfff640 1 --2- 172.21.15.19:0/850888368 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5586119d9bb0 0x5586119d6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.700+0000 7f714bfff640 1 -- 172.21.15.19:0/850888368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586116a62b0 con 0x5586119cf2f0 2024-09-19T08:52:40.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.700+0000 7f7152d9d640 1 --2- 172.21.15.19:0/850888368 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5586119d9bb0 0x5586119d6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:40.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.700+0000 7f714bfff640 1 --2- 172.21.15.19:0/850888368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5586119cf2f0 0x5586119d6780 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f713c00f740 tx=0x7f713c00f530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfdc42866bbbd36 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:40.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.700+0000 7f7139ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:52:40.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.700+0000 7f7139ffb640 1 -- 172.21.15.19:0/850888368 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713c025070 con 0x5586119cf2f0 2024-09-19T08:52:40.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.700+0000 7f7139ffb640 1 -- 172.21.15.19:0/850888368 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f713c017620 con 0x5586119cf2f0 2024-09-19T08:52:40.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.700+0000 7f715ae30740 1 -- 172.21.15.19:0/850888368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f713c017aa0 con 0x5586119cf2f0 2024-09-19T08:52:40.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.701+0000 7f7139ffb640 1 -- 172.21.15.19:0/850888368 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f713c031050 con 0x5586119cf2f0 2024-09-19T08:52:40.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.701+0000 7f715ae30740 10 client.15471 fetch_fsmap learned FSMap version 28 2024-09-19T08:52:40.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.701+0000 7f715ae30740 1 -- 172.21.15.19:0/850888368 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5586119e8090 con 0x5586119cf2f0 2024-09-19T08:52:40.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.701+0000 7f7139ffb640 1 -- 172.21.15.19:0/850888368 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f713c017aa0 con 0x5586119cf2f0 2024-09-19T08:52:40.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.701+0000 7f7139ffb640 1 -- 172.21.15.19:0/850888368 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f713c0046c0 con 0x5586119cf2f0 2024-09-19T08:52:40.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.701+0000 7f715ae30740 10 client.15471 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:52:40.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.701+0000 7f715ae30740 10 client.15471 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T08:52:40.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.701+0000 7f715ae30740 20 client.15471 populate_metadata read hostname 'smithi019' 2024-09-19T08:52:40.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.701+0000 7f715ae30740 1 --2- 172.21.15.19:0/850888368 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5586119ea2e0 0x5586119eb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.701+0000 7f715ae30740 4 client.15471 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:40.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.701+0000 7f715ae30740 1 -- 172.21.15.19:0/850888368 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558611942600 con 0x5586119ea2e0 2024-09-19T08:52:40.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.701+0000 7f715259c640 1 --2- 172.21.15.19:0/850888368 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5586119ea2e0 0x5586119eb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.702+0000 7f715259c640 1 --2- 172.21.15.19:0/850888368 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5586119ea2e0 0x5586119eb750 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f8087bea09ebea6 server_cookie=f28b6388f03dab87 in_seq=0 out_seq=0 2024-09-19T08:52:40.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.702+0000 7f7139ffb640 10 client.15471 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:52:40.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.702+0000 7f7139ffb640 1 -- 172.21.15.19:0/850888368 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558611942600 con 0x5586119ea2e0 2024-09-19T08:52:40.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.702+0000 7f7139ffb640 10 client.15471 handle_command_reply: tid=0 2024-09-19T08:52:40.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.702+0000 7f715ae30740 1 client.15471 shutdown 2024-09-19T08:52:40.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.703+0000 7f715ae30740 1 -- 172.21.15.19:0/850888368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5586119cf2f0 msgr2=0x5586119d6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:40.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.703+0000 7f715ae30740 1 --2- 172.21.15.19:0/850888368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5586119cf2f0 0x5586119d6780 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f713c00f740 tx=0x7f713c00f530 comp rx=0 tx=0).stop 2024-09-19T08:52:40.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.703+0000 7f715ae30740 1 -- 172.21.15.19:0/850888368 shutdown_connections 2024-09-19T08:52:40.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.703+0000 7f715ae30740 1 --2- 172.21.15.19:0/850888368 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5586119ea2e0 0x5586119eb750 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.703+0000 7f715ae30740 1 --2- 172.21.15.19:0/850888368 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5586119d9bb0 0x5586119d6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.703+0000 7f715ae30740 1 --2- 172.21.15.19:0/850888368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5586119cf2f0 0x5586119d6780 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.703+0000 7f715ae30740 1 --2- 172.21.15.19:0/850888368 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5586119ce9d0 0x5586119d9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.703+0000 7f715ae30740 1 -- 172.21.15.19:0/850888368 >> 172.21.15.19:0/850888368 conn(0x5586119caf60 msgr2=0x5586119d0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:40.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.703+0000 7f7139ffb640 0 client.15471 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:52:40.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.703+0000 7f715ae30740 1 -- 172.21.15.19:0/850888368 shutdown_connections 2024-09-19T08:52:40.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.703+0000 7f715ae30740 1 -- 172.21.15.19:0/850888368 wait complete. 2024-09-19T08:52:40.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.703+0000 7f715ae30740 20 client.15471 trim_cache size 0 max 16384 2024-09-19T08:52:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.721+0000 7f715ae30740 1 Processor -- start 2024-09-19T08:52:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.721+0000 7f715ae30740 1 -- start start 2024-09-19T08:52:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.721+0000 7f715ae30740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5586119ce9d0 0x5586119ea9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.721+0000 7f715ae30740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5586119cf2f0 0x5586119d85e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.721+0000 7f715ae30740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5586119d9bb0 0x5586119d39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.721+0000 7f715ae30740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5586119e9a90 con 0x5586119cf2f0 2024-09-19T08:52:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.721+0000 7f715ae30740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5586119ea160 con 0x5586119ce9d0 2024-09-19T08:52:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.721+0000 7f715ae30740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5586119ea830 con 0x5586119d9bb0 2024-09-19T08:52:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.721+0000 7f714bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5586119cf2f0 0x5586119d85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.721+0000 7f714bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5586119cf2f0 0x5586119d85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36134/0 (socket says 172.21.15.19:36134) 2024-09-19T08:52:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.721+0000 7f714bfff640 1 -- 172.21.15.19:0/4173495658 learned_addr learned my addr 172.21.15.19:0/4173495658 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.721+0000 7f715259c640 1 --2- 172.21.15.19:0/4173495658 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5586119ce9d0 0x5586119ea9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.721+0000 7f7152d9d640 1 --2- 172.21.15.19:0/4173495658 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5586119d9bb0 0x5586119d39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.721+0000 7f714bfff640 1 -- 172.21.15.19:0/4173495658 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5586119d9bb0 msgr2=0x5586119d39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.721+0000 7f714bfff640 1 --2- 172.21.15.19:0/4173495658 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5586119d9bb0 0x5586119d39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.721+0000 7f714bfff640 1 -- 172.21.15.19:0/4173495658 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5586119ce9d0 msgr2=0x5586119ea9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.721+0000 7f714bfff640 1 --2- 172.21.15.19:0/4173495658 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5586119ce9d0 0x5586119ea9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.721+0000 7f714bfff640 1 -- 172.21.15.19:0/4173495658 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586119d7790 con 0x5586119cf2f0 2024-09-19T08:52:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.721+0000 7f715259c640 1 --2- 172.21.15.19:0/4173495658 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5586119ce9d0 0x5586119ea9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:40.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.722+0000 7f714bfff640 1 --2- 172.21.15.19:0/4173495658 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5586119cf2f0 0x5586119d85e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f713c000c00 tx=0x7f713c005e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95da9a8d2e497aa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:40.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.722+0000 7f713bfff640 1 -- 172.21.15.19:0/4173495658 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713c03a070 con 0x5586119cf2f0 2024-09-19T08:52:40.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.722+0000 7f713bfff640 1 -- 172.21.15.19:0/4173495658 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f713c005550 con 0x5586119cf2f0 2024-09-19T08:52:40.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.722+0000 7f713bfff640 1 -- 172.21.15.19:0/4173495658 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f713c025040 con 0x5586119cf2f0 2024-09-19T08:52:40.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.722+0000 7f715ae30740 1 -- 172.21.15.19:0/4173495658 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5586119cf2f0 msgr2=0x5586119d85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:40.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.722+0000 7f715ae30740 1 --2- 172.21.15.19:0/4173495658 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5586119cf2f0 0x5586119d85e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f713c000c00 tx=0x7f713c005e60 comp rx=0 tx=0).stop 2024-09-19T08:52:40.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.722+0000 7f715ae30740 1 -- 172.21.15.19:0/4173495658 shutdown_connections 2024-09-19T08:52:40.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.722+0000 7f715ae30740 1 --2- 172.21.15.19:0/4173495658 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5586119d9bb0 0x5586119d39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.722+0000 7f715ae30740 1 --2- 172.21.15.19:0/4173495658 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5586119cf2f0 0x5586119d85e0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.722+0000 7f715ae30740 1 --2- 172.21.15.19:0/4173495658 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5586119ce9d0 0x5586119ea9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.722+0000 7f715ae30740 1 -- 172.21.15.19:0/4173495658 >> 172.21.15.19:0/4173495658 conn(0x5586119caf60 msgr2=0x5586119d7ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:40.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.723+0000 7f715ae30740 1 -- 172.21.15.19:0/4173495658 shutdown_connections 2024-09-19T08:52:40.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.723+0000 7f715ae30740 1 -- 172.21.15.19:0/4173495658 wait complete. 2024-09-19T08:52:40.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.723+0000 7f715ae30740 1 -- start start 2024-09-19T08:52:40.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.723+0000 7f715ae30740 1 Processor -- start 2024-09-19T08:52:40.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.723+0000 7f715ae30740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5586119ce9d0 0x5586119eeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.723+0000 7f715ae30740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5586119cf2f0 0x5586119ef0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.723+0000 7f715ae30740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5586119d9bb0 0x558611a529e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.723+0000 7f715ae30740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5586119eb5d0 con 0x5586119d9bb0 2024-09-19T08:52:40.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.723+0000 7f715ae30740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5586119eaf00 con 0x5586119cf2f0 2024-09-19T08:52:40.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.723+0000 7f715ae30740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5586119ebca0 con 0x5586119ce9d0 2024-09-19T08:52:40.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.723+0000 7f715ae30740 10 client.0 _ll_register_callbacks cb 0x7f7144017eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:40.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.723+0000 7f7152d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5586119d9bb0 0x558611a529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.723+0000 7f7152d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5586119d9bb0 0x558611a529e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36148/0 (socket says 172.21.15.19:36148) 2024-09-19T08:52:40.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.723+0000 7f7152d9d640 1 -- 172.21.15.19:0/591413433 learned_addr learned my addr 172.21.15.19:0/591413433 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:40.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.723+0000 7f715259c640 1 --2- 172.21.15.19:0/591413433 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5586119ce9d0 0x5586119eeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.724+0000 7f714bfff640 1 --2- 172.21.15.19:0/591413433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5586119cf2f0 0x5586119ef0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.724+0000 7f7152d9d640 1 -- 172.21.15.19:0/591413433 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5586119ce9d0 msgr2=0x5586119eeb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:40.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.724+0000 7f7152d9d640 1 --2- 172.21.15.19:0/591413433 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5586119ce9d0 0x5586119eeb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.724+0000 7f7152d9d640 1 -- 172.21.15.19:0/591413433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5586119cf2f0 msgr2=0x5586119ef0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:40.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.724+0000 7f7152d9d640 1 --2- 172.21.15.19:0/591413433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5586119cf2f0 0x5586119ef0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.724+0000 7f7152d9d640 1 -- 172.21.15.19:0/591413433 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558611a52f20 con 0x5586119d9bb0 2024-09-19T08:52:40.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.724+0000 7f7152d9d640 1 --2- 172.21.15.19:0/591413433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5586119d9bb0 0x558611a529e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f714c009ca0 tx=0x7f714c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=872e255c307736cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:40.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.724+0000 7f7139ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:52:40.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.724+0000 7f7139ffb640 1 -- 172.21.15.19:0/591413433 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c02f990 con 0x5586119d9bb0 2024-09-19T08:52:40.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.724+0000 7f7139ffb640 1 -- 172.21.15.19:0/591413433 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f714c02fb30 con 0x5586119d9bb0 2024-09-19T08:52:40.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.724+0000 7f715ae30740 1 -- 172.21.15.19:0/591413433 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f713c005550 con 0x5586119d9bb0 2024-09-19T08:52:40.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.724+0000 7f7139ffb640 1 -- 172.21.15.19:0/591413433 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f714c02fd30 con 0x5586119d9bb0 2024-09-19T08:52:40.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.724+0000 7f715ae30740 10 client.15477 fetch_fsmap learned FSMap version 28 2024-09-19T08:52:40.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.724+0000 7f715ae30740 1 -- 172.21.15.19:0/591413433 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558611a54160 con 0x5586119d9bb0 2024-09-19T08:52:40.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.725+0000 7f7139ffb640 1 -- 172.21.15.19:0/591413433 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f713c005550 con 0x5586119d9bb0 2024-09-19T08:52:40.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.725+0000 7f7139ffb640 1 -- 172.21.15.19:0/591413433 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f714c05f070 con 0x5586119d9bb0 2024-09-19T08:52:40.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.725+0000 7f715ae30740 10 client.15477 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:52:40.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.725+0000 7f715ae30740 10 client.15477 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T08:52:40.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.725+0000 7f715ae30740 20 client.15477 populate_metadata read hostname 'smithi019' 2024-09-19T08:52:40.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.725+0000 7f715ae30740 1 --2- 172.21.15.19:0/591413433 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x558611a58da0 0x558611a57ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:40.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.725+0000 7f715ae30740 4 client.15477 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T08:52:40.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.725+0000 7f715ae30740 1 -- 172.21.15.19:0/591413433 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "status"}) -- 0x55861193cb10 con 0x558611a58da0 2024-09-19T08:52:40.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.725+0000 7f715259c640 1 --2- 172.21.15.19:0/591413433 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x558611a58da0 0x558611a57ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:40.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.725+0000 7f7139ffb640 10 client.15477 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:52:40.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.725+0000 7f715259c640 1 --2- 172.21.15.19:0/591413433 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x558611a58da0 0x558611a57ab0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20286c9c7b43dd60 server_cookie=d12d373f1a5a9c43 in_seq=0 out_seq=0 2024-09-19T08:52:40.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.726+0000 7f7139ffb640 1 -- 172.21.15.19:0/591413433 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55861193cb10 con 0x558611a58da0 2024-09-19T08:52:40.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.726+0000 7f7139ffb640 10 client.15477 handle_command_reply: tid=0 2024-09-19T08:52:40.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.726+0000 7f715ae30740 1 client.15477 shutdown 2024-09-19T08:52:40.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.726+0000 7f715ae30740 1 -- 172.21.15.19:0/591413433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5586119d9bb0 msgr2=0x558611a529e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:40.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.726+0000 7f715ae30740 1 --2- 172.21.15.19:0/591413433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5586119d9bb0 0x558611a529e0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f714c009ca0 tx=0x7f714c02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.726+0000 7f715ae30740 1 -- 172.21.15.19:0/591413433 shutdown_connections 2024-09-19T08:52:40.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.726+0000 7f715ae30740 1 --2- 172.21.15.19:0/591413433 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x558611a58da0 0x558611a57ab0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.726+0000 7f715ae30740 1 --2- 172.21.15.19:0/591413433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5586119d9bb0 0x558611a529e0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.726+0000 7f715ae30740 1 --2- 172.21.15.19:0/591413433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5586119cf2f0 0x5586119ef0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.726+0000 7f715ae30740 1 --2- 172.21.15.19:0/591413433 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5586119ce9d0 0x5586119eeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.726+0000 7f715ae30740 1 -- 172.21.15.19:0/591413433 >> 172.21.15.19:0/591413433 conn(0x5586119caf60 msgr2=0x5586119d6830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:40.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.726+0000 7f7139ffb640 0 client.15477 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:52:40.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.726+0000 7f715ae30740 1 -- 172.21.15.19:0/591413433 shutdown_connections 2024-09-19T08:52:40.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.726+0000 7f715ae30740 1 -- 172.21.15.19:0/591413433 wait complete. 2024-09-19T08:52:40.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.726+0000 7f715ae30740 20 client.15477 trim_cache size 0 max 16384 2024-09-19T08:52:40.736 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:52:40.736 INFO:teuthology.orchestra.run.smithi019.stdout: "cluster_fsid": "f26c9d84-7662-11ef-bceb-c7b262605968", 2024-09-19T08:52:40.736 INFO:teuthology.orchestra.run.smithi019.stdout: "whoami": 0, 2024-09-19T08:52:40.736 INFO:teuthology.orchestra.run.smithi019.stdout: "id": 24497, 2024-09-19T08:52:40.736 INFO:teuthology.orchestra.run.smithi019.stdout: "want_state": "up:active", 2024-09-19T08:52:40.736 INFO:teuthology.orchestra.run.smithi019.stdout: "state": "up:active", 2024-09-19T08:52:40.736 INFO:teuthology.orchestra.run.smithi019.stdout: "fs_name": "cephfs", 2024-09-19T08:52:40.736 INFO:teuthology.orchestra.run.smithi019.stdout: "rank_uptime": 143.85896740800001, 2024-09-19T08:52:40.736 INFO:teuthology.orchestra.run.smithi019.stdout: "mdsmap_epoch": 28, 2024-09-19T08:52:40.737 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch": 82, 2024-09-19T08:52:40.737 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_epoch_barrier": 82, 2024-09-19T08:52:40.737 INFO:teuthology.orchestra.run.smithi019.stdout: "uptime": 155.77048159899999 2024-09-19T08:52:40.737 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:52:40.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.727+0000 7f7158a57640 1 -- 172.21.15.19:0/1863753454 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f71400a32d0 msgr2=0x7f71400a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:40.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.727+0000 7f7158a57640 1 --2- 172.21.15.19:0/1863753454 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f71400a32d0 0x7f71400a5790 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f714c009a60 tx=0x7f714c005ef0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.727+0000 7f7158a57640 1 -- 172.21.15.19:0/1863753454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7154101de0 msgr2=0x7f71540744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:40.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.727+0000 7f7158a57640 1 --2- 172.21.15.19:0/1863753454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7154101de0 0x7f71540744f0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f714400b4a0 tx=0x7f714400b960 comp rx=0 tx=0).stop 2024-09-19T08:52:40.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.727+0000 7f7158a57640 1 -- 172.21.15.19:0/1863753454 shutdown_connections 2024-09-19T08:52:40.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.727+0000 7f7158a57640 1 --2- 172.21.15.19:0/1863753454 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f71400a32d0 0x7f71400a5790 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.727+0000 7f7158a57640 1 --2- 172.21.15.19:0/1863753454 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7154106f10 0x7f7154074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.727+0000 7f7158a57640 1 --2- 172.21.15.19:0/1863753454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7154102790 0x7f7154074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.727+0000 7f7158a57640 1 --2- 172.21.15.19:0/1863753454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7154101de0 0x7f71540744f0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:40.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.727+0000 7f7158a57640 1 -- 172.21.15.19:0/1863753454 >> 172.21.15.19:0/1863753454 conn(0x7f71540fd8c0 msgr2=0x7f71540fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:40.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.727+0000 7f7158a57640 1 -- 172.21.15.19:0/1863753454 shutdown_connections 2024-09-19T08:52:40.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:40.727+0000 7f7158a57640 1 -- 172.21.15.19:0/1863753454 wait complete. 2024-09-19T08:52:41.454 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-19T08:52:42.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:41 smithi019 ceph-mon[30976]: pgmap v351: 97 pgs: 97 active+clean; 662 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.6 KiB/s wr, 15 op/s 2024-09-19T08:52:42.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:41 smithi155 ceph-mon[34921]: pgmap v351: 97 pgs: 97 active+clean; 662 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.6 KiB/s wr, 15 op/s 2024-09-19T08:52:42.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:41 smithi203 ceph-mon[35450]: pgmap v351: 97 pgs: 97 active+clean; 662 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.6 KiB/s wr, 15 op/s 2024-09-19T08:52:43.959 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.957+0000 7f1ecb5f6640 1 -- 172.21.15.19:0/299854134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ec41025e0 msgr2=0x7f1ec41049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:43.960 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.957+0000 7f1ecb5f6640 1 --2- 172.21.15.19:0/299854134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ec41025e0 0x7f1ec41049d0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0009900 tx=0x7f1ec002a410 comp rx=0 tx=0).stop 2024-09-19T08:52:43.960 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.957+0000 7f1ecb5f6640 1 -- 172.21.15.19:0/299854134 shutdown_connections 2024-09-19T08:52:43.960 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.957+0000 7f1ecb5f6640 1 --2- 172.21.15.19:0/299854134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ec4104f10 0x7f1ec4107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:43.960 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.957+0000 7f1ecb5f6640 1 --2- 172.21.15.19:0/299854134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ec4107840 0x7f1ec4109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:43.960 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.957+0000 7f1ecb5f6640 1 --2- 172.21.15.19:0/299854134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ec41025e0 0x7f1ec41049d0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:43.960 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.957+0000 7f1ecb5f6640 1 -- 172.21.15.19:0/299854134 >> 172.21.15.19:0/299854134 conn(0x7f1ec40fc1e0 msgr2=0x7f1ec40fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:43.960 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.957+0000 7f1ecb5f6640 1 -- 172.21.15.19:0/299854134 shutdown_connections 2024-09-19T08:52:43.960 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.957+0000 7f1ecb5f6640 1 -- 172.21.15.19:0/299854134 wait complete. 2024-09-19T08:52:43.960 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.957+0000 7f1ecb5f6640 1 Processor -- start 2024-09-19T08:52:43.960 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.957+0000 7f1ecb5f6640 1 -- start start 2024-09-19T08:52:43.960 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.958+0000 7f1ecb5f6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ec41025e0 0x7f1ec4197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:43.961 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.958+0000 7f1ecb5f6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ec4104f10 0x7f1ec41983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:43.961 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.958+0000 7f1ecb5f6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ec4107840 0x7f1ec419f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:43.961 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.958+0000 7f1ecb5f6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec410d8a0 con 0x7f1ec4107840 2024-09-19T08:52:43.961 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.958+0000 7f1ecb5f6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec410d720 con 0x7f1ec41025e0 2024-09-19T08:52:43.961 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.958+0000 7f1ecb5f6640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec410da20 con 0x7f1ec4104f10 2024-09-19T08:52:43.961 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.958+0000 7f1ec9b93640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ec4107840 0x7f1ec419f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:43.961 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.958+0000 7f1ec9b93640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ec4107840 0x7f1ec419f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36170/0 (socket says 172.21.15.19:36170) 2024-09-19T08:52:43.961 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.958+0000 7f1ec9b93640 1 -- 172.21.15.19:0/2542429376 learned_addr learned my addr 172.21.15.19:0/2542429376 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:43.961 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.958+0000 7f1ec8b91640 1 --2- 172.21.15.19:0/2542429376 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ec4104f10 0x7f1ec41983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:43.961 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.958+0000 7f1ec9392640 1 --2- 172.21.15.19:0/2542429376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ec41025e0 0x7f1ec4197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:43.961 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.958+0000 7f1ec9b93640 1 -- 172.21.15.19:0/2542429376 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ec4104f10 msgr2=0x7f1ec41983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:43.961 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.958+0000 7f1ec9b93640 1 --2- 172.21.15.19:0/2542429376 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ec4104f10 0x7f1ec41983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:43.961 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.958+0000 7f1ec9b93640 1 -- 172.21.15.19:0/2542429376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ec41025e0 msgr2=0x7f1ec4197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:43.962 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.958+0000 7f1ec9b93640 1 --2- 172.21.15.19:0/2542429376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ec41025e0 0x7f1ec4197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:43.962 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.958+0000 7f1ec9b93640 1 -- 172.21.15.19:0/2542429376 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec419fa80 con 0x7f1ec4107840 2024-09-19T08:52:43.962 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.958+0000 7f1ec9b93640 1 --2- 172.21.15.19:0/2542429376 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ec4107840 0x7f1ec419f410 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00b9e0 tx=0x7f1ebc00bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:43.962 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.959+0000 7f1eba7fc640 1 -- 172.21.15.19:0/2542429376 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc019070 con 0x7f1ec4107840 2024-09-19T08:52:43.962 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.959+0000 7f1eba7fc640 1 -- 172.21.15.19:0/2542429376 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1ebc014440 con 0x7f1ec4107840 2024-09-19T08:52:43.962 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.959+0000 7f1ecb5f6640 1 -- 172.21.15.19:0/2542429376 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ec419fd70 con 0x7f1ec4107840 2024-09-19T08:52:43.962 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.959+0000 7f1eba7fc640 1 -- 172.21.15.19:0/2542429376 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc0125e0 con 0x7f1ec4107840 2024-09-19T08:52:43.962 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.959+0000 7f1ecb5f6640 1 -- 172.21.15.19:0/2542429376 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ec41a0290 con 0x7f1ec4107840 2024-09-19T08:52:43.969 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.961+0000 7f1eba7fc640 1 -- 172.21.15.19:0/2542429376 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f1ebc01c070 con 0x7f1ec4107840 2024-09-19T08:52:43.969 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.961+0000 7f1ece46c740 1 Processor -- start 2024-09-19T08:52:43.970 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.961+0000 7f1ece46c740 1 -- start start 2024-09-19T08:52:43.970 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.962+0000 7f1ece46c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55695fc1f9a0 0x55695fc1fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:43.970 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.962+0000 7f1ece46c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55695fc202e0 0x55695fc24da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:43.970 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.962+0000 7f1ece46c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55695fc25370 0x55695fc27830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:43.970 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.962+0000 7f1ece46c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55695fb832f0 con 0x55695fc25370 2024-09-19T08:52:43.970 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.962+0000 7f1ece46c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55695fb2b270 con 0x55695fc1f9a0 2024-09-19T08:52:43.970 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.962+0000 7f1ece46c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55695fb7f2b0 con 0x55695fc202e0 2024-09-19T08:52:43.970 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.962+0000 7f1ec8b91640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55695fc25370 0x55695fc27830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:43.971 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.962+0000 7f1ec8b91640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55695fc25370 0x55695fc27830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36174/0 (socket says 172.21.15.19:36174) 2024-09-19T08:52:43.971 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.962+0000 7f1ec8b91640 1 -- 172.21.15.19:0/506014184 learned_addr learned my addr 172.21.15.19:0/506014184 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:43.971 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.962+0000 7f1ec9392640 1 --2- 172.21.15.19:0/506014184 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55695fc202e0 0x55695fc24da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:43.971 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.962+0000 7f1eba7fc640 1 --2- 172.21.15.19:0/2542429376 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1eb00a3390 0x7f1eb00a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:43.971 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.962+0000 7f1ec8b91640 1 --2- 172.21.15.19:0/506014184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55695fc1f9a0 0x55695fc1fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:43.971 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.962+0000 7f1ec8b91640 1 -- 172.21.15.19:0/506014184 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55695fc202e0 msgr2=0x55695fc24da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:43.971 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.962+0000 7f1ec8b91640 1 --2- 172.21.15.19:0/506014184 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55695fc202e0 0x55695fc24da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:43.971 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.962+0000 7f1ec8b91640 1 -- 172.21.15.19:0/506014184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55695fc1f9a0 msgr2=0x55695fc1fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:43.971 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.962+0000 7f1ec8b91640 1 --2- 172.21.15.19:0/506014184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55695fc1f9a0 0x55695fc1fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:43.971 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.962+0000 7f1ec8b91640 1 -- 172.21.15.19:0/506014184 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55695fb2a340 con 0x55695fc25370 2024-09-19T08:52:43.971 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.962+0000 7f1ec9b93640 1 --2- 172.21.15.19:0/2542429376 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1eb00a3390 0x7f1eb00a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:43.972 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.962+0000 7f1ec8b91640 1 --2- 172.21.15.19:0/506014184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55695fc25370 0x55695fc27830 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1eb400afd0 tx=0x7f1eb400a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4ce729228513efa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:43.972 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.962+0000 7f1eba7fc640 1 -- 172.21.15.19:0/2542429376 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1ebc0ceea0 con 0x7f1ec4107840 2024-09-19T08:52:43.972 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.963+0000 7f1eaf7fe640 1 -- 172.21.15.19:0/506014184 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb4005220 con 0x55695fc25370 2024-09-19T08:52:43.972 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.963+0000 7f1eaf7fe640 1 -- 172.21.15.19:0/506014184 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1eb4004c80 con 0x55695fc25370 2024-09-19T08:52:43.972 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.963+0000 7f1eaf7fe640 1 -- 172.21.15.19:0/506014184 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb400fd00 con 0x55695fc25370 2024-09-19T08:52:43.972 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.963+0000 7f1ece46c740 1 -- 172.21.15.19:0/506014184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55695fc25370 msgr2=0x55695fc27830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:43.972 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.963+0000 7f1ece46c740 1 --2- 172.21.15.19:0/506014184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55695fc25370 0x55695fc27830 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f1eb400afd0 tx=0x7f1eb400a7d0 comp rx=0 tx=0).stop 2024-09-19T08:52:43.972 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.963+0000 7f1ec9b93640 1 --2- 172.21.15.19:0/2542429376 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1eb00a3390 0x7f1eb00a5850 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00cfd0 tx=0x7f1ebc06e3b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:43.972 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.963+0000 7f1ece46c740 1 -- 172.21.15.19:0/506014184 shutdown_connections 2024-09-19T08:52:43.972 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.963+0000 7f1ece46c740 1 --2- 172.21.15.19:0/506014184 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55695fc202e0 0x55695fc24da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:43.972 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.963+0000 7f1ece46c740 1 --2- 172.21.15.19:0/506014184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55695fc25370 0x55695fc27830 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:43.972 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.963+0000 7f1ece46c740 1 --2- 172.21.15.19:0/506014184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55695fc1f9a0 0x55695fc1fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:43.972 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.963+0000 7f1ece46c740 1 -- 172.21.15.19:0/506014184 >> 172.21.15.19:0/506014184 conn(0x55695fc1b010 msgr2=0x55695fc1b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:43.973 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.963+0000 7f1ece46c740 1 -- 172.21.15.19:0/506014184 shutdown_connections 2024-09-19T08:52:43.973 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.963+0000 7f1ece46c740 1 -- 172.21.15.19:0/506014184 wait complete. 2024-09-19T08:52:43.973 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.964+0000 7f1ece46c740 1 -- start start 2024-09-19T08:52:43.973 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.964+0000 7f1ece46c740 1 Processor -- start 2024-09-19T08:52:43.973 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.964+0000 7f1ece46c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55695fc1f9a0 0x55695fc29c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:43.973 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.964+0000 7f1ece46c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55695fc202e0 0x55695fc2a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:43.973 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.964+0000 7f1ece46c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55695fc25370 0x55695fc311d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:43.973 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.964+0000 7f1ece46c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55695fc28340 con 0x55695fc1f9a0 2024-09-19T08:52:43.973 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.964+0000 7f1ece46c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55695fb0c290 con 0x55695fc25370 2024-09-19T08:52:43.973 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.964+0000 7f1ece46c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55695fc284c0 con 0x55695fc202e0 2024-09-19T08:52:43.973 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.964+0000 7f1ece46c740 10 client.0 _ll_register_callbacks cb 0x55695fb3d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:43.973 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.964+0000 7f1ec8b91640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55695fc1f9a0 0x55695fc29c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:43.974 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.965+0000 7f1ec8b91640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55695fc1f9a0 0x55695fc29c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36178/0 (socket says 172.21.15.19:36178) 2024-09-19T08:52:43.974 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.965+0000 7f1ec8b91640 1 -- 172.21.15.19:0/227950978 learned_addr learned my addr 172.21.15.19:0/227950978 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:43.974 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.965+0000 7f1ec9392640 1 --2- 172.21.15.19:0/227950978 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55695fc202e0 0x55695fc2a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:43.974 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.965+0000 7f1ec8b91640 1 --2- 172.21.15.19:0/227950978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55695fc25370 0x55695fc311d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:43.974 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.965+0000 7f1ec8b91640 1 -- 172.21.15.19:0/227950978 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55695fc202e0 msgr2=0x55695fc2a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:43.974 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.965+0000 7f1ec8b91640 1 --2- 172.21.15.19:0/227950978 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55695fc202e0 0x55695fc2a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:43.974 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.965+0000 7f1ec8b91640 1 -- 172.21.15.19:0/227950978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55695fc25370 msgr2=0x55695fc311d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:43.974 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.965+0000 7f1ec8b91640 1 --2- 172.21.15.19:0/227950978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55695fc25370 0x55695fc311d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:43.974 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.965+0000 7f1ec8b91640 1 -- 172.21.15.19:0/227950978 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55695f896210 con 0x55695fc1f9a0 2024-09-19T08:52:43.974 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.965+0000 7f1ec8b91640 1 --2- 172.21.15.19:0/227950978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55695fc1f9a0 0x55695fc29c50 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40057c0 tx=0x7f1eb400a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b100aa6d816a0ee7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:43.974 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.965+0000 7f1eacff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:52:43.974 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.965+0000 7f1eacff9640 1 -- 172.21.15.19:0/227950978 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb4005030 con 0x55695fc1f9a0 2024-09-19T08:52:43.974 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.965+0000 7f1eacff9640 1 -- 172.21.15.19:0/227950978 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1eb40051d0 con 0x55695fc1f9a0 2024-09-19T08:52:43.975 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.965+0000 7f1ece46c740 1 -- 172.21.15.19:0/227950978 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1eb4004c80 con 0x55695fc1f9a0 2024-09-19T08:52:43.975 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.966+0000 7f1eacff9640 1 -- 172.21.15.19:0/227950978 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1eb40053d0 con 0x55695fc1f9a0 2024-09-19T08:52:43.975 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.966+0000 7f1ece46c740 10 client.15489 fetch_fsmap learned FSMap version 28 2024-09-19T08:52:43.975 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.966+0000 7f1ece46c740 1 -- 172.21.15.19:0/227950978 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55695f962620 con 0x55695fc1f9a0 2024-09-19T08:52:43.975 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.966+0000 7f1eacff9640 1 -- 172.21.15.19:0/227950978 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1eb4004c80 con 0x55695fc1f9a0 2024-09-19T08:52:43.975 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.966+0000 7f1eacff9640 1 -- 172.21.15.19:0/227950978 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1eb401b070 con 0x55695fc1f9a0 2024-09-19T08:52:43.975 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.966+0000 7f1ece46c740 10 client.15489 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:52:43.975 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.966+0000 7f1ece46c740 10 client.15489 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:43.975 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.966+0000 7f1ece46c740 20 client.15489 populate_metadata read hostname 'smithi019' 2024-09-19T08:52:43.975 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.966+0000 7f1ece46c740 1 --2- 172.21.15.19:0/227950978 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55695fc35590 0x55695fc37980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:43.975 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.966+0000 7f1ece46c740 4 client.15489 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:43.975 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.966+0000 7f1ece46c740 1 -- 172.21.15.19:0/227950978 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55695fb90a20 con 0x55695fc35590 2024-09-19T08:52:43.976 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.966+0000 7f1ec9392640 1 --2- 172.21.15.19:0/227950978 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55695fc35590 0x55695fc37980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:43.976 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.967+0000 7f1ec9392640 1 --2- 172.21.15.19:0/227950978 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55695fc35590 0x55695fc37980 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1372d42ee1c5b830 server_cookie=1eecf1162fdc9561 in_seq=0 out_seq=0 2024-09-19T08:52:43.976 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.967+0000 7f1eacff9640 10 client.15489 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:52:43.976 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.968+0000 7f1eacff9640 1 -- 172.21.15.19:0/227950978 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55695fb90a20 con 0x55695fc35590 2024-09-19T08:52:43.976 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.968+0000 7f1eacff9640 10 client.15489 handle_command_reply: tid=0 2024-09-19T08:52:43.976 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.968+0000 7f1ece46c740 1 client.15489 shutdown 2024-09-19T08:52:43.976 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.968+0000 7f1ece46c740 1 -- 172.21.15.19:0/227950978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55695fc1f9a0 msgr2=0x55695fc29c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:43.976 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.968+0000 7f1ece46c740 1 --2- 172.21.15.19:0/227950978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55695fc1f9a0 0x55695fc29c50 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40057c0 tx=0x7f1eb400a680 comp rx=0 tx=0).stop 2024-09-19T08:52:43.976 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.968+0000 7f1ece46c740 1 -- 172.21.15.19:0/227950978 shutdown_connections 2024-09-19T08:52:43.976 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.968+0000 7f1ece46c740 1 --2- 172.21.15.19:0/227950978 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55695fc35590 0x55695fc37980 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:43.976 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.968+0000 7f1ece46c740 1 --2- 172.21.15.19:0/227950978 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55695fc202e0 0x55695fc2a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:43.976 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.968+0000 7f1ece46c740 1 --2- 172.21.15.19:0/227950978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55695fc25370 0x55695fc311d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:43.977 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.968+0000 7f1eacff9640 0 client.15489 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:52:43.977 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.968+0000 7f1ece46c740 1 --2- 172.21.15.19:0/227950978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55695fc1f9a0 0x55695fc29c50 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:43.977 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.968+0000 7f1ece46c740 1 -- 172.21.15.19:0/227950978 >> 172.21.15.19:0/227950978 conn(0x55695fc1b010 msgr2=0x55695fc1c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:43.977 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.968+0000 7f1ece46c740 1 -- 172.21.15.19:0/227950978 shutdown_connections 2024-09-19T08:52:43.977 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.968+0000 7f1ece46c740 1 -- 172.21.15.19:0/227950978 wait complete. 2024-09-19T08:52:43.977 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.968+0000 7f1ece46c740 20 client.15489 trim_cache size 0 max 16384 2024-09-19T08:52:43.988 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.983+0000 7f1ece46c740 1 Processor -- start 2024-09-19T08:52:43.989 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.983+0000 7f1ece46c740 1 -- start start 2024-09-19T08:52:43.989 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.983+0000 7f1ece46c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55695fc1f9a0 0x55695fc199a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:43.989 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.983+0000 7f1ece46c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55695fc202e0 0x55695fc19ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:43.989 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.983+0000 7f1ece46c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55695fc25370 0x55695fc1a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:43.989 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.983+0000 7f1ece46c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec41a9060 con 0x55695fc1f9a0 2024-09-19T08:52:43.989 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.983+0000 7f1ece46c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec41aaba0 con 0x55695fc202e0 2024-09-19T08:52:43.989 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.983+0000 7f1ece46c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec41a9730 con 0x55695fc25370 2024-09-19T08:52:43.989 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.983+0000 7f1ec8b91640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55695fc1f9a0 0x55695fc199a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:43.989 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.983+0000 7f1ec8b91640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55695fc1f9a0 0x55695fc199a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36194/0 (socket says 172.21.15.19:36194) 2024-09-19T08:52:43.994 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.983+0000 7f1ec8b91640 1 -- 172.21.15.19:0/3527737961 learned_addr learned my addr 172.21.15.19:0/3527737961 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:43.994 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.984+0000 7f1ec9392640 1 --2- 172.21.15.19:0/3527737961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55695fc202e0 0x55695fc19ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:43.994 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.984+0000 7f1ec8b91640 1 --2- 172.21.15.19:0/3527737961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55695fc25370 0x55695fc1a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:43.995 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.984+0000 7f1ec8b91640 1 -- 172.21.15.19:0/3527737961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55695fc25370 msgr2=0x55695fc1a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:43.995 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.984+0000 7f1ec8b91640 1 --2- 172.21.15.19:0/3527737961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55695fc25370 0x55695fc1a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:43.995 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.984+0000 7f1ec8b91640 1 -- 172.21.15.19:0/3527737961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55695fc202e0 msgr2=0x55695fc19ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:43.995 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.984+0000 7f1ec8b91640 1 --2- 172.21.15.19:0/3527737961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55695fc202e0 0x55695fc19ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:43.995 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.984+0000 7f1ec8b91640 1 -- 172.21.15.19:0/3527737961 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55695fc31580 con 0x55695fc1f9a0 2024-09-19T08:52:43.995 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.984+0000 7f1ec8b91640 1 --2- 172.21.15.19:0/3527737961 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55695fc1f9a0 0x55695fc199a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1eb402cff0 tx=0x7f1eb400a400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29146f85d4fa3a86 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:43.995 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.984+0000 7f1eaeffd640 1 -- 172.21.15.19:0/3527737961 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb403b070 con 0x55695fc1f9a0 2024-09-19T08:52:43.995 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.984+0000 7f1eaeffd640 1 -- 172.21.15.19:0/3527737961 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1eb4020030 con 0x55695fc1f9a0 2024-09-19T08:52:43.995 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.984+0000 7f1eaeffd640 1 -- 172.21.15.19:0/3527737961 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb4004eb0 con 0x55695fc1f9a0 2024-09-19T08:52:43.995 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.985+0000 7f1ece46c740 1 -- 172.21.15.19:0/3527737961 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55695fc1f9a0 msgr2=0x55695fc199a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:43.995 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.985+0000 7f1ece46c740 1 --2- 172.21.15.19:0/3527737961 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55695fc1f9a0 0x55695fc199a0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f1eb402cff0 tx=0x7f1eb400a400 comp rx=0 tx=0).stop 2024-09-19T08:52:43.996 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.985+0000 7f1ece46c740 1 -- 172.21.15.19:0/3527737961 shutdown_connections 2024-09-19T08:52:43.996 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.985+0000 7f1ece46c740 1 --2- 172.21.15.19:0/3527737961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55695fc25370 0x55695fc1a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:43.996 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.985+0000 7f1ece46c740 1 --2- 172.21.15.19:0/3527737961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55695fc202e0 0x55695fc19ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:43.996 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.985+0000 7f1ece46c740 1 --2- 172.21.15.19:0/3527737961 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55695fc1f9a0 0x55695fc199a0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:43.996 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.985+0000 7f1ece46c740 1 -- 172.21.15.19:0/3527737961 >> 172.21.15.19:0/3527737961 conn(0x55695fc1b010 msgr2=0x55695fc29a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:43.996 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.985+0000 7f1ece46c740 1 -- 172.21.15.19:0/3527737961 shutdown_connections 2024-09-19T08:52:43.996 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.985+0000 7f1ece46c740 1 -- 172.21.15.19:0/3527737961 wait complete. 2024-09-19T08:52:43.996 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.985+0000 7f1ece46c740 1 -- start start 2024-09-19T08:52:43.996 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.985+0000 7f1ece46c740 1 Processor -- start 2024-09-19T08:52:43.996 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.986+0000 7f1ece46c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55695fc1f9a0 0x55695fc9b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:43.996 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.986+0000 7f1ece46c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55695fc202e0 0x55695fc9b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:43.996 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.986+0000 7f1ece46c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55695fc25370 0x55695fca2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:43.997 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.986+0000 7f1ece46c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec41aa4d0 con 0x55695fc1f9a0 2024-09-19T08:52:43.997 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.986+0000 7f1ece46c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec41a9e00 con 0x55695fc25370 2024-09-19T08:52:43.997 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.986+0000 7f1ece46c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec41a7040 con 0x55695fc202e0 2024-09-19T08:52:43.997 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.986+0000 7f1ece46c740 10 client.0 _ll_register_callbacks cb 0x7f1eb4011440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:43.997 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.986+0000 7f1ec8b91640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55695fc1f9a0 0x55695fc9b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:43.997 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.986+0000 7f1ec8b91640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55695fc1f9a0 0x55695fc9b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36198/0 (socket says 172.21.15.19:36198) 2024-09-19T08:52:43.997 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.986+0000 7f1ec8b91640 1 -- 172.21.15.19:0/755521917 learned_addr learned my addr 172.21.15.19:0/755521917 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:43.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.986+0000 7f1ec9392640 1 --2- 172.21.15.19:0/755521917 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55695fc202e0 0x55695fc9b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:43.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.986+0000 7f1ec8b91640 1 -- 172.21.15.19:0/755521917 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55695fc202e0 msgr2=0x55695fc9b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:43.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.986+0000 7f1ec8b91640 1 --2- 172.21.15.19:0/755521917 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55695fc202e0 0x55695fc9b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:43.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.986+0000 7f1ec8b91640 1 -- 172.21.15.19:0/755521917 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55695fc25370 msgr2=0x55695fca2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:43.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.986+0000 7f1ec8b91640 1 --2- 172.21.15.19:0/755521917 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55695fc25370 0x55695fca2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:43.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.986+0000 7f1ec8b91640 1 -- 172.21.15.19:0/755521917 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55695fca2f90 con 0x55695fc1f9a0 2024-09-19T08:52:43.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.986+0000 7f1ec8b91640 1 --2- 172.21.15.19:0/755521917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55695fc1f9a0 0x55695fc9b400 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4005bd0 tx=0x7f1eb40355f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48661ea3af33d69f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:43.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.986+0000 7f1eacff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:52:43.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.986+0000 7f1eacff9640 1 -- 172.21.15.19:0/755521917 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb403b070 con 0x55695fc1f9a0 2024-09-19T08:52:43.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.986+0000 7f1eacff9640 1 -- 172.21.15.19:0/755521917 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1eb4035d70 con 0x55695fc1f9a0 2024-09-19T08:52:43.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.986+0000 7f1ece46c740 1 -- 172.21.15.19:0/755521917 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1eb4020030 con 0x55695fc1f9a0 2024-09-19T08:52:43.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.987+0000 7f1eacff9640 1 -- 172.21.15.19:0/755521917 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1eb4004bc0 con 0x55695fc1f9a0 2024-09-19T08:52:43.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.987+0000 7f1ece46c740 10 client.15495 fetch_fsmap learned FSMap version 28 2024-09-19T08:52:43.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.987+0000 7f1ece46c740 1 -- 172.21.15.19:0/755521917 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55695fca4210 con 0x55695fc1f9a0 2024-09-19T08:52:43.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.987+0000 7f1eacff9640 1 -- 172.21.15.19:0/755521917 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1eb4020030 con 0x55695fc1f9a0 2024-09-19T08:52:43.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.987+0000 7f1eacff9640 1 -- 172.21.15.19:0/755521917 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1eb4052080 con 0x55695fc1f9a0 2024-09-19T08:52:43.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.987+0000 7f1ece46c740 10 client.15495 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:52:43.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.987+0000 7f1ece46c740 10 client.15495 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:43.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.987+0000 7f1ece46c740 20 client.15495 populate_metadata read hostname 'smithi019' 2024-09-19T08:52:43.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.987+0000 7f1ece46c740 1 --2- 172.21.15.19:0/755521917 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55695fca4b90 0x55695fca6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:43.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.987+0000 7f1ece46c740 4 client.15495 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:52:43.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.987+0000 7f1ece46c740 1 -- 172.21.15.19:0/755521917 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55695fb8ad70 con 0x55695fca4b90 2024-09-19T08:52:43.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.987+0000 7f1ec9392640 1 --2- 172.21.15.19:0/755521917 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55695fca4b90 0x55695fca6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:44.000 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.988+0000 7f1eacff9640 10 client.15495 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:52:44.000 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.988+0000 7f1ec9392640 1 --2- 172.21.15.19:0/755521917 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55695fca4b90 0x55695fca6fb0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a615a62016471ccd server_cookie=37a2e5d270b1e2b7 in_seq=0 out_seq=0 2024-09-19T08:52:44.001 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.995+0000 7f1eacff9640 1 -- 172.21.15.19:0/755521917 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55695fb8ad70 con 0x55695fca4b90 2024-09-19T08:52:44.001 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.995+0000 7f1eacff9640 10 client.15495 handle_command_reply: tid=0 2024-09-19T08:52:44.001 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.995+0000 7f1ece46c740 1 client.15495 shutdown 2024-09-19T08:52:44.001 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.996+0000 7f1ece46c740 1 -- 172.21.15.19:0/755521917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55695fc1f9a0 msgr2=0x55695fc9b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:44.002 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.996+0000 7f1ece46c740 1 --2- 172.21.15.19:0/755521917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55695fc1f9a0 0x55695fc9b400 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4005bd0 tx=0x7f1eb40355f0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.002 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.996+0000 7f1ece46c740 1 -- 172.21.15.19:0/755521917 shutdown_connections 2024-09-19T08:52:44.002 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.996+0000 7f1ece46c740 1 --2- 172.21.15.19:0/755521917 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55695fca4b90 0x55695fca6fb0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.002 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.996+0000 7f1ece46c740 1 --2- 172.21.15.19:0/755521917 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55695fc202e0 0x55695fc9b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.002 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.996+0000 7f1eacff9640 0 client.15495 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:52:44.002 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.996+0000 7f1ece46c740 1 --2- 172.21.15.19:0/755521917 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55695fc25370 0x55695fca2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.002 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.996+0000 7f1ece46c740 1 --2- 172.21.15.19:0/755521917 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55695fc1f9a0 0x55695fc9b400 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.002 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.996+0000 7f1ece46c740 1 -- 172.21.15.19:0/755521917 >> 172.21.15.19:0/755521917 conn(0x55695fc1b010 msgr2=0x55695fc1bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:44.002 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.996+0000 7f1ece46c740 1 -- 172.21.15.19:0/755521917 shutdown_connections 2024-09-19T08:52:44.002 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.996+0000 7f1ece46c740 1 -- 172.21.15.19:0/755521917 wait complete. 2024-09-19T08:52:44.002 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.996+0000 7f1ece46c740 20 client.15495 trim_cache size 0 max 16384 2024-09-19T08:52:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T08:52:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T08:52:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T08:52:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T08:52:44.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.996+0000 7f1ecb5f6640 1 -- 172.21.15.19:0/2542429376 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1eb00a3390 msgr2=0x7f1eb00a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:44.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.996+0000 7f1ecb5f6640 1 --2- 172.21.15.19:0/2542429376 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1eb00a3390 0x7f1eb00a5850 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00cfd0 tx=0x7f1ebc06e3b0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.996+0000 7f1ecb5f6640 1 -- 172.21.15.19:0/2542429376 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ec4107840 msgr2=0x7f1ec419f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:44.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.996+0000 7f1ecb5f6640 1 --2- 172.21.15.19:0/2542429376 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ec4107840 0x7f1ec419f410 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00b9e0 tx=0x7f1ebc00bde0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.996+0000 7f1ecb5f6640 1 -- 172.21.15.19:0/2542429376 shutdown_connections 2024-09-19T08:52:44.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.996+0000 7f1ecb5f6640 1 --2- 172.21.15.19:0/2542429376 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1eb00a3390 0x7f1eb00a5850 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.996+0000 7f1ecb5f6640 1 --2- 172.21.15.19:0/2542429376 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ec4104f10 0x7f1ec41983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.996+0000 7f1ecb5f6640 1 --2- 172.21.15.19:0/2542429376 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ec4107840 0x7f1ec419f410 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.996+0000 7f1ecb5f6640 1 --2- 172.21.15.19:0/2542429376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ec41025e0 0x7f1ec4197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.996+0000 7f1ecb5f6640 1 -- 172.21.15.19:0/2542429376 >> 172.21.15.19:0/2542429376 conn(0x7f1ec40fc1e0 msgr2=0x7f1ec4102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.997+0000 7f1ecb5f6640 1 -- 172.21.15.19:0/2542429376 shutdown_connections 2024-09-19T08:52:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:43.997+0000 7f1ecb5f6640 1 -- 172.21.15.19:0/2542429376 wait complete. 2024-09-19T08:52:44.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:43 smithi019 ceph-mon[30976]: pgmap v352: 97 pgs: 97 active+clean; 662 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.6 KiB/s wr, 15 op/s 2024-09-19T08:52:44.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:43 smithi155 ceph-mon[34921]: pgmap v352: 97 pgs: 97 active+clean; 662 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.6 KiB/s wr, 15 op/s 2024-09-19T08:52:44.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:43 smithi203 ceph-mon[35450]: pgmap v352: 97 pgs: 97 active+clean; 662 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.6 KiB/s wr, 15 op/s 2024-09-19T08:52:46.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:45 smithi019 ceph-mon[30976]: pgmap v353: 97 pgs: 97 active+clean; 662 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.6 KiB/s wr, 15 op/s 2024-09-19T08:52:46.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:45 smithi155 ceph-mon[34921]: pgmap v353: 97 pgs: 97 active+clean; 662 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.6 KiB/s wr, 15 op/s 2024-09-19T08:52:46.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:45 smithi203 ceph-mon[35450]: pgmap v353: 97 pgs: 97 active+clean; 662 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.6 KiB/s wr, 15 op/s 2024-09-19T08:52:48.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:47 smithi019 ceph-mon[30976]: pgmap v354: 97 pgs: 97 active+clean; 662 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-19T08:52:48.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:47 smithi155 ceph-mon[34921]: pgmap v354: 97 pgs: 97 active+clean; 662 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-19T08:52:48.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:47 smithi203 ceph-mon[35450]: pgmap v354: 97 pgs: 97 active+clean; 662 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 682 B/s wr, 12 op/s 2024-09-19T08:52:50.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:49 smithi019 ceph-mon[30976]: pgmap v355: 97 pgs: 97 active+clean; 662 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-19T08:52:50.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:49 smithi155 ceph-mon[34921]: pgmap v355: 97 pgs: 97 active+clean; 662 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-19T08:52:50.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:49 smithi203 ceph-mon[35450]: pgmap v355: 97 pgs: 97 active+clean; 662 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 426 B/s wr, 9 op/s 2024-09-19T08:52:51.637 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:52:51.904 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:52.028 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:51 smithi019 ceph-mon[30976]: pgmap v356: 97 pgs: 97 active+clean; 663 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-19T08:52:52.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:51 smithi155 ceph-mon[34921]: pgmap v356: 97 pgs: 97 active+clean; 663 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-19T08:52:52.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:51 smithi203 ceph-mon[35450]: pgmap v356: 97 pgs: 97 active+clean; 663 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-19T08:52:52.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.382+0000 7f370c60f640 1 -- 172.21.15.19:0/1890726938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3704100e20 msgr2=0x7f3704101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:52.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.382+0000 7f370c60f640 1 --2- 172.21.15.19:0/1890726938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3704100e20 0x7f3704101200 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3700009900 tx=0x7f370002a480 comp rx=0 tx=0).stop 2024-09-19T08:52:52.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.382+0000 7f370c60f640 1 -- 172.21.15.19:0/1890726938 shutdown_connections 2024-09-19T08:52:52.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.382+0000 7f370c60f640 1 --2- 172.21.15.19:0/1890726938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3704102ef0 0x7f370410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.382+0000 7f370c60f640 1 --2- 172.21.15.19:0/1890726938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3704102570 0x7f37041029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.382+0000 7f370c60f640 1 --2- 172.21.15.19:0/1890726938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3704100e20 0x7f3704101200 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.382+0000 7f370c60f640 1 -- 172.21.15.19:0/1890726938 >> 172.21.15.19:0/1890726938 conn(0x7f37040fc7d0 msgr2=0x7f37040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:52.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.382+0000 7f370c60f640 1 -- 172.21.15.19:0/1890726938 shutdown_connections 2024-09-19T08:52:52.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.382+0000 7f370c60f640 1 -- 172.21.15.19:0/1890726938 wait complete. 2024-09-19T08:52:52.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.383+0000 7f370c60f640 1 Processor -- start 2024-09-19T08:52:52.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.383+0000 7f370c60f640 1 -- start start 2024-09-19T08:52:52.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.383+0000 7f370c60f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3704100e20 0x7f37040fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:52.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.383+0000 7f370c60f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3704102570 0x7f37040fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:52.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.383+0000 7f370c60f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3704102ef0 0x7f37040fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:52.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.383+0000 7f370c60f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3704110f80 con 0x7f3704102570 2024-09-19T08:52:52.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.383+0000 7f370c60f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3704110e00 con 0x7f3704100e20 2024-09-19T08:52:52.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.383+0000 7f370c60f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3704111100 con 0x7f3704102ef0 2024-09-19T08:52:52.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.383+0000 7f3709baa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3704102570 0x7f37040fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:52.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.383+0000 7f3709baa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3704102570 0x7f37040fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44138/0 (socket says 172.21.15.19:44138) 2024-09-19T08:52:52.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.383+0000 7f3709baa640 1 -- 172.21.15.19:0/1367274234 learned_addr learned my addr 172.21.15.19:0/1367274234 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:52.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.383+0000 7f370abac640 1 --2- 172.21.15.19:0/1367274234 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3704102ef0 0x7f37040fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:52.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.383+0000 7f370a3ab640 1 --2- 172.21.15.19:0/1367274234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3704100e20 0x7f37040fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:52.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.383+0000 7f3709baa640 1 -- 172.21.15.19:0/1367274234 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3704102ef0 msgr2=0x7f37040fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:52.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.383+0000 7f3709baa640 1 --2- 172.21.15.19:0/1367274234 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3704102ef0 0x7f37040fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.383+0000 7f3709baa640 1 -- 172.21.15.19:0/1367274234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3704100e20 msgr2=0x7f37040fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:52.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.383+0000 7f3709baa640 1 --2- 172.21.15.19:0/1367274234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3704100e20 0x7f37040fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.383+0000 7f3709baa640 1 -- 172.21.15.19:0/1367274234 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37041a6a50 con 0x7f3704102570 2024-09-19T08:52:52.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.383+0000 7f370a3ab640 1 --2- 172.21.15.19:0/1367274234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3704100e20 0x7f37040fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:52.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.384+0000 7f3709baa640 1 --2- 172.21.15.19:0/1367274234 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3704102570 0x7f37040fd1c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f36f400c890 tx=0x7f36f400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:52.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.384+0000 7f36fb7fe640 1 -- 172.21.15.19:0/1367274234 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f4004220 con 0x7f3704102570 2024-09-19T08:52:52.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.384+0000 7f36fb7fe640 1 -- 172.21.15.19:0/1367274234 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36f40043c0 con 0x7f3704102570 2024-09-19T08:52:52.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.384+0000 7f36fb7fe640 1 -- 172.21.15.19:0/1367274234 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f40049e0 con 0x7f3704102570 2024-09-19T08:52:52.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.384+0000 7f370c60f640 1 -- 172.21.15.19:0/1367274234 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37041a6d40 con 0x7f3704102570 2024-09-19T08:52:52.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.384+0000 7f370c60f640 1 -- 172.21.15.19:0/1367274234 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37041a7270 con 0x7f3704102570 2024-09-19T08:52:52.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.387+0000 7f370e9e8740 1 Processor -- start 2024-09-19T08:52:52.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.387+0000 7f370e9e8740 1 -- start start 2024-09-19T08:52:52.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.387+0000 7f370e9e8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e390b44a0 0x563e390b4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:52.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.387+0000 7f370e9e8740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e390b4dc0 0x563e390bf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:52.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.387+0000 7f370e9e8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e390bf680 0x563e390c1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:52.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.387+0000 7f370e9e8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563e3901a2e0 con 0x563e390b44a0 2024-09-19T08:52:52.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.387+0000 7f370e9e8740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x563e38fc1ce0 con 0x563e390b4dc0 2024-09-19T08:52:52.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.387+0000 7f370e9e8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563e390162a0 con 0x563e390bf680 2024-09-19T08:52:52.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.387+0000 7f370abac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e390b44a0 0x563e390b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:52.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.387+0000 7f370abac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e390b44a0 0x563e390b4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44150/0 (socket says 172.21.15.19:44150) 2024-09-19T08:52:52.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.387+0000 7f370abac640 1 -- 172.21.15.19:0/300264660 learned_addr learned my addr 172.21.15.19:0/300264660 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:52.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.388+0000 7f370a3ab640 1 --2- 172.21.15.19:0/300264660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e390b4dc0 0x563e390bf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:52.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.388+0000 7f36fb7fe640 1 -- 172.21.15.19:0/1367274234 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f36f40079b0 con 0x7f3704102570 2024-09-19T08:52:52.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.388+0000 7f370abac640 1 -- 172.21.15.19:0/300264660 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e390bf680 msgr2=0x563e390c1a70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T08:52:52.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.388+0000 7f370abac640 1 --2- 172.21.15.19:0/300264660 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e390bf680 0x563e390c1a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.388+0000 7f370abac640 1 -- 172.21.15.19:0/300264660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e390b4dc0 msgr2=0x563e390bf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:52.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.388+0000 7f370abac640 1 --2- 172.21.15.19:0/300264660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e390b4dc0 0x563e390bf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.388+0000 7f370abac640 1 -- 172.21.15.19:0/300264660 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e38fa6440 con 0x563e390b44a0 2024-09-19T08:52:52.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.388+0000 7f370abac640 1 --2- 172.21.15.19:0/300264660 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e390b44a0 0x563e390b4880 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f36fc00ae10 tx=0x7f36fc00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d0b206b76cfb733 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:52.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.388+0000 7f36f8ff9640 1 -- 172.21.15.19:0/300264660 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36fc003b70 con 0x563e390b44a0 2024-09-19T08:52:52.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.388+0000 7f36f8ff9640 1 -- 172.21.15.19:0/300264660 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36fc003d10 con 0x563e390b44a0 2024-09-19T08:52:52.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.388+0000 7f36f8ff9640 1 -- 172.21.15.19:0/300264660 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36fc010a30 con 0x563e390b44a0 2024-09-19T08:52:52.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.389+0000 7f36fb7fe640 1 --2- 172.21.15.19:0/1367274234 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f36f00a3350 0x7f36f00a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:52.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.389+0000 7f370a3ab640 1 --2- 172.21.15.19:0/1367274234 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f36f00a3350 0x7f36f00a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:52.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.389+0000 7f36fb7fe640 1 -- 172.21.15.19:0/1367274234 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f36f40cfa70 con 0x7f3704102570 2024-09-19T08:52:52.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.389+0000 7f370e9e8740 1 -- 172.21.15.19:0/300264660 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e390b44a0 msgr2=0x563e390b4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:52.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.389+0000 7f370e9e8740 1 --2- 172.21.15.19:0/300264660 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e390b44a0 0x563e390b4880 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f36fc00ae10 tx=0x7f36fc00f790 comp rx=0 tx=0).stop 2024-09-19T08:52:52.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.389+0000 7f370e9e8740 1 -- 172.21.15.19:0/300264660 shutdown_connections 2024-09-19T08:52:52.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.389+0000 7f370e9e8740 1 --2- 172.21.15.19:0/300264660 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e390bf680 0x563e390c1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.389+0000 7f370e9e8740 1 --2- 172.21.15.19:0/300264660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e390b4dc0 0x563e390bf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.389+0000 7f370e9e8740 1 --2- 172.21.15.19:0/300264660 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e390b44a0 0x563e390b4880 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.389+0000 7f370e9e8740 1 -- 172.21.15.19:0/300264660 >> 172.21.15.19:0/300264660 conn(0x563e390b0a30 msgr2=0x563e390b0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:52.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.389+0000 7f370a3ab640 1 --2- 172.21.15.19:0/1367274234 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f36f00a3350 0x7f36f00a5810 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f37000314e0 tx=0x7f3700005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:52.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.389+0000 7f370e9e8740 1 -- 172.21.15.19:0/300264660 shutdown_connections 2024-09-19T08:52:52.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.389+0000 7f370e9e8740 1 -- 172.21.15.19:0/300264660 wait complete. 2024-09-19T08:52:52.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.390+0000 7f370e9e8740 1 -- start start 2024-09-19T08:52:52.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.390+0000 7f370e9e8740 1 Processor -- start 2024-09-19T08:52:52.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.390+0000 7f370e9e8740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e390b44a0 0x563e390befa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:52.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.390+0000 7f370e9e8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e390b4dc0 0x563e390bc250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:52.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.390+0000 7f370e9e8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e390bf680 0x563e390bc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:52.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.390+0000 7f370e9e8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563e390c2250 con 0x563e390b4dc0 2024-09-19T08:52:52.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.390+0000 7f370e9e8740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x563e38fd5050 con 0x563e390b44a0 2024-09-19T08:52:52.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.390+0000 7f370e9e8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563e390c23d0 con 0x563e390bf680 2024-09-19T08:52:52.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.390+0000 7f370e9e8740 10 client.0 _ll_register_callbacks cb 0x563e39015160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:52.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.390+0000 7f3709baa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e390b4dc0 0x563e390bc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:52.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.390+0000 7f370a3ab640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e390b44a0 0x563e390befa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:52.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.390+0000 7f3709baa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e390b4dc0 0x563e390bc250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44160/0 (socket says 172.21.15.19:44160) 2024-09-19T08:52:52.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.390+0000 7f370a3ab640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e390b44a0 0x563e390befa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:37254/0 (socket says 172.21.15.19:37254) 2024-09-19T08:52:52.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.390+0000 7f3709baa640 1 -- 172.21.15.19:0/2926234684 learned_addr learned my addr 172.21.15.19:0/2926234684 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:52.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.391+0000 7f370abac640 1 --2- 172.21.15.19:0/2926234684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e390bf680 0x563e390bc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:52.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.391+0000 7f3709baa640 1 -- 172.21.15.19:0/2926234684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e390bf680 msgr2=0x563e390bc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:52.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.391+0000 7f3709baa640 1 --2- 172.21.15.19:0/2926234684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e390bf680 0x563e390bc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.391+0000 7f3709baa640 1 -- 172.21.15.19:0/2926234684 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e390b44a0 msgr2=0x563e390befa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:52.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.391+0000 7f3709baa640 1 --2- 172.21.15.19:0/2926234684 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e390b44a0 0x563e390befa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.391+0000 7f3709baa640 1 -- 172.21.15.19:0/2926234684 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e38d8b3c0 con 0x563e390b4dc0 2024-09-19T08:52:52.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.391+0000 7f370a3ab640 1 --2- 172.21.15.19:0/2926234684 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e390b44a0 0x563e390befa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:52:52.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.391+0000 7f3709baa640 1 --2- 172.21.15.19:0/2926234684 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e390b4dc0 0x563e390bc250 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f36f4005fd0 tx=0x7f36f409ba80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=594a522e578aef21 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:52.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.391+0000 7f36edffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:52:52.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.391+0000 7f36edffb640 1 -- 172.21.15.19:0/2926234684 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f401d040 con 0x563e390b4dc0 2024-09-19T08:52:52.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.391+0000 7f36edffb640 1 -- 172.21.15.19:0/2926234684 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f36f40a4720 con 0x563e390b4dc0 2024-09-19T08:52:52.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.391+0000 7f370e9e8740 1 -- 172.21.15.19:0/2926234684 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36fc003d10 con 0x563e390b4dc0 2024-09-19T08:52:52.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.391+0000 7f36edffb640 1 -- 172.21.15.19:0/2926234684 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f36f409bf40 con 0x563e390b4dc0 2024-09-19T08:52:52.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.391+0000 7f370e9e8740 10 client.15507 fetch_fsmap learned FSMap version 28 2024-09-19T08:52:52.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.391+0000 7f370e9e8740 1 -- 172.21.15.19:0/2926234684 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563e390cdc60 con 0x563e390b4dc0 2024-09-19T08:52:52.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.391+0000 7f36edffb640 1 -- 172.21.15.19:0/2926234684 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36f40a02f0 con 0x563e390b4dc0 2024-09-19T08:52:52.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.392+0000 7f36edffb640 1 -- 172.21.15.19:0/2926234684 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f36f407ab70 con 0x563e390b4dc0 2024-09-19T08:52:52.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.392+0000 7f370e9e8740 10 client.15507 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:52:52.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.392+0000 7f370e9e8740 10 client.15507 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:52.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.392+0000 7f370e9e8740 20 client.15507 populate_metadata read hostname 'smithi019' 2024-09-19T08:52:52.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.392+0000 7f370e9e8740 1 --2- 172.21.15.19:0/2926234684 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563e390cf120 0x563e390d1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:52.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.392+0000 7f370e9e8740 4 client.15507 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:52.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.392+0000 7f370e9e8740 1 -- 172.21.15.19:0/2926234684 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f36fc003d10 con 0x563e390cf120 2024-09-19T08:52:52.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.392+0000 7f370a3ab640 1 --2- 172.21.15.19:0/2926234684 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563e390cf120 0x563e390d1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:52.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.392+0000 7f36edffb640 10 client.15507 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:52:52.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.392+0000 7f370a3ab640 1 --2- 172.21.15.19:0/2926234684 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563e390cf120 0x563e390d1510 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ea4c4b12c4810e5 server_cookie=dfb96ca50e358e51 in_seq=0 out_seq=0 2024-09-19T08:52:52.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.393+0000 7f36edffb640 1 -- 172.21.15.19:0/2926234684 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f36fc003d10 con 0x563e390cf120 2024-09-19T08:52:52.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.393+0000 7f36edffb640 10 client.15507 handle_command_reply: tid=0 2024-09-19T08:52:52.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.393+0000 7f370e9e8740 1 client.15507 shutdown 2024-09-19T08:52:52.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.393+0000 7f370e9e8740 1 -- 172.21.15.19:0/2926234684 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e390b4dc0 msgr2=0x563e390bc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:52.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.393+0000 7f370e9e8740 1 --2- 172.21.15.19:0/2926234684 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e390b4dc0 0x563e390bc250 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f36f4005fd0 tx=0x7f36f409ba80 comp rx=0 tx=0).stop 2024-09-19T08:52:52.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.393+0000 7f370e9e8740 1 -- 172.21.15.19:0/2926234684 shutdown_connections 2024-09-19T08:52:52.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.393+0000 7f370e9e8740 1 --2- 172.21.15.19:0/2926234684 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563e390cf120 0x563e390d1510 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.393+0000 7f370e9e8740 1 --2- 172.21.15.19:0/2926234684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e390bf680 0x563e390bc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.393+0000 7f370e9e8740 1 --2- 172.21.15.19:0/2926234684 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e390b4dc0 0x563e390bc250 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.393+0000 7f36edffb640 0 client.15507 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:52:52.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.393+0000 7f370e9e8740 1 --2- 172.21.15.19:0/2926234684 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e390b44a0 0x563e390befa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.393+0000 7f370e9e8740 1 -- 172.21.15.19:0/2926234684 >> 172.21.15.19:0/2926234684 conn(0x563e390b0a30 msgr2=0x563e390b6760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:52.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.393+0000 7f370e9e8740 1 -- 172.21.15.19:0/2926234684 shutdown_connections 2024-09-19T08:52:52.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.393+0000 7f370e9e8740 1 -- 172.21.15.19:0/2926234684 wait complete. 2024-09-19T08:52:52.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.393+0000 7f370e9e8740 20 client.15507 trim_cache size 0 max 16384 2024-09-19T08:52:52.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.411+0000 7f370e9e8740 1 Processor -- start 2024-09-19T08:52:52.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.411+0000 7f370e9e8740 1 -- start start 2024-09-19T08:52:52.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.411+0000 7f370e9e8740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e390b44a0 0x563e390cb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:52.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.411+0000 7f370e9e8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e390b4dc0 0x563e390d6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:52.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.411+0000 7f370e9e8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e390bf680 0x563e390d72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:52.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.411+0000 7f370e9e8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f37041af6b0 con 0x563e390bf680 2024-09-19T08:52:52.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.411+0000 7f370e9e8740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f37041b11f0 con 0x563e390b44a0 2024-09-19T08:52:52.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.411+0000 7f370e9e8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f37041afd80 con 0x563e390b4dc0 2024-09-19T08:52:52.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.412+0000 7f370abac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e390bf680 0x563e390d72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:52.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.412+0000 7f370abac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e390bf680 0x563e390d72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44168/0 (socket says 172.21.15.19:44168) 2024-09-19T08:52:52.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.412+0000 7f370abac640 1 -- 172.21.15.19:0/1430327236 learned_addr learned my addr 172.21.15.19:0/1430327236 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:52.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.412+0000 7f3709baa640 1 --2- 172.21.15.19:0/1430327236 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e390b4dc0 0x563e390d6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:52.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.412+0000 7f370a3ab640 1 --2- 172.21.15.19:0/1430327236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e390b44a0 0x563e390cb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:52.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.412+0000 7f370abac640 1 -- 172.21.15.19:0/1430327236 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e390b4dc0 msgr2=0x563e390d6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:52.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.412+0000 7f370abac640 1 --2- 172.21.15.19:0/1430327236 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e390b4dc0 0x563e390d6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.412+0000 7f370abac640 1 -- 172.21.15.19:0/1430327236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e390b44a0 msgr2=0x563e390cb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:52.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.412+0000 7f370abac640 1 --2- 172.21.15.19:0/1430327236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e390b44a0 0x563e390cb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.412+0000 7f370abac640 1 -- 172.21.15.19:0/1430327236 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e390d1b40 con 0x563e390bf680 2024-09-19T08:52:52.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.412+0000 7f370abac640 1 --2- 172.21.15.19:0/1430327236 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e390bf680 0x563e390d72b0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f36fc00ad30 tx=0x7f36fc00a870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37be23d7694e5f45 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:52.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.413+0000 7f36effff640 1 -- 172.21.15.19:0/1430327236 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36fc004b00 con 0x563e390bf680 2024-09-19T08:52:52.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.413+0000 7f36effff640 1 -- 172.21.15.19:0/1430327236 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36fc004ca0 con 0x563e390bf680 2024-09-19T08:52:52.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.413+0000 7f36effff640 1 -- 172.21.15.19:0/1430327236 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36fc005570 con 0x563e390bf680 2024-09-19T08:52:52.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.413+0000 7f370e9e8740 1 -- 172.21.15.19:0/1430327236 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e390bf680 msgr2=0x563e390d72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:52.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.413+0000 7f370e9e8740 1 --2- 172.21.15.19:0/1430327236 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e390bf680 0x563e390d72b0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f36fc00ad30 tx=0x7f36fc00a870 comp rx=0 tx=0).stop 2024-09-19T08:52:52.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.414+0000 7f370e9e8740 1 -- 172.21.15.19:0/1430327236 shutdown_connections 2024-09-19T08:52:52.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.414+0000 7f370e9e8740 1 --2- 172.21.15.19:0/1430327236 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e390b4dc0 0x563e390d6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.414+0000 7f370e9e8740 1 --2- 172.21.15.19:0/1430327236 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e390bf680 0x563e390d72b0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.414+0000 7f370e9e8740 1 --2- 172.21.15.19:0/1430327236 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e390b44a0 0x563e390cb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.414+0000 7f370e9e8740 1 -- 172.21.15.19:0/1430327236 >> 172.21.15.19:0/1430327236 conn(0x563e390b0a30 msgr2=0x563e390b78b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:52.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.414+0000 7f370e9e8740 1 -- 172.21.15.19:0/1430327236 shutdown_connections 2024-09-19T08:52:52.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.414+0000 7f370e9e8740 1 -- 172.21.15.19:0/1430327236 wait complete. 2024-09-19T08:52:52.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.414+0000 7f370e9e8740 1 -- start start 2024-09-19T08:52:52.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.414+0000 7f370e9e8740 1 Processor -- start 2024-09-19T08:52:52.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.414+0000 7f370e9e8740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e390b44a0 0x563e390c7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:52.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.414+0000 7f370e9e8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e390b4dc0 0x563e390c3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:52.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.414+0000 7f370e9e8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e390bf680 0x563e390c3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:52.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.414+0000 7f370e9e8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f37041b0b20 con 0x563e390b4dc0 2024-09-19T08:52:52.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.414+0000 7f370e9e8740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f37041b0450 con 0x563e390b44a0 2024-09-19T08:52:52.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.414+0000 7f370e9e8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f37041ad690 con 0x563e390bf680 2024-09-19T08:52:52.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.414+0000 7f370e9e8740 10 client.0 _ll_register_callbacks cb 0x7f36f40058c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:52.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.414+0000 7f3709baa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e390b4dc0 0x563e390c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:52.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.415+0000 7f3709baa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e390b4dc0 0x563e390c3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44176/0 (socket says 172.21.15.19:44176) 2024-09-19T08:52:52.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.415+0000 7f3709baa640 1 -- 172.21.15.19:0/481218268 learned_addr learned my addr 172.21.15.19:0/481218268 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:52.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.415+0000 7f370a3ab640 1 --2- 172.21.15.19:0/481218268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e390b44a0 0x563e390c7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:52.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.415+0000 7f370abac640 1 --2- 172.21.15.19:0/481218268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e390bf680 0x563e390c3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:52.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.415+0000 7f3709baa640 1 -- 172.21.15.19:0/481218268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e390bf680 msgr2=0x563e390c3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:52.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.415+0000 7f3709baa640 1 --2- 172.21.15.19:0/481218268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e390bf680 0x563e390c3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.415+0000 7f3709baa640 1 -- 172.21.15.19:0/481218268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e390b44a0 msgr2=0x563e390c7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:52.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.415+0000 7f3709baa640 1 --2- 172.21.15.19:0/481218268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e390b44a0 0x563e390c7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.415+0000 7f3709baa640 1 -- 172.21.15.19:0/481218268 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e390c3d70 con 0x563e390b4dc0 2024-09-19T08:52:52.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.415+0000 7f370a3ab640 1 --2- 172.21.15.19:0/481218268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e390b44a0 0x563e390c7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:52:52.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.415+0000 7f370abac640 1 --2- 172.21.15.19:0/481218268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e390bf680 0x563e390c3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:52:52.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.415+0000 7f3709baa640 1 --2- 172.21.15.19:0/481218268 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e390b4dc0 0x563e390c3000 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f36f409bc40 tx=0x7f36f40054a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b7d79d868048b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:52.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.415+0000 7f36edffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:52:52.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.415+0000 7f36edffb640 1 -- 172.21.15.19:0/481218268 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f401d040 con 0x563e390b4dc0 2024-09-19T08:52:52.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.415+0000 7f36edffb640 1 -- 172.21.15.19:0/481218268 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f36f40b7030 con 0x563e390b4dc0 2024-09-19T08:52:52.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.415+0000 7f370e9e8740 1 -- 172.21.15.19:0/481218268 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f36fc004ca0 con 0x563e390b4dc0 2024-09-19T08:52:52.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.416+0000 7f36edffb640 1 -- 172.21.15.19:0/481218268 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f36f409b8a0 con 0x563e390b4dc0 2024-09-19T08:52:52.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.416+0000 7f370e9e8740 10 client.15513 fetch_fsmap learned FSMap version 28 2024-09-19T08:52:52.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.416+0000 7f370e9e8740 1 -- 172.21.15.19:0/481218268 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563e39139c90 con 0x563e390b4dc0 2024-09-19T08:52:52.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.416+0000 7f36edffb640 1 -- 172.21.15.19:0/481218268 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f36fc004ca0 con 0x563e390b4dc0 2024-09-19T08:52:52.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.416+0000 7f36edffb640 1 -- 172.21.15.19:0/481218268 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f36f40a4720 con 0x563e390b4dc0 2024-09-19T08:52:52.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.416+0000 7f370e9e8740 10 client.15513 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:52:52.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.416+0000 7f370e9e8740 10 client.15513 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:52.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.416+0000 7f370e9e8740 20 client.15513 populate_metadata read hostname 'smithi019' 2024-09-19T08:52:52.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.416+0000 7f370e9e8740 1 --2- 172.21.15.19:0/481218268 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563e3913a300 0x563e3913c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:52.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.416+0000 7f370e9e8740 4 client.15513 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:52:52.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.416+0000 7f370e9e8740 1 -- 172.21.15.19:0/481218268 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563e39027850 con 0x563e3913a300 2024-09-19T08:52:52.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.416+0000 7f370a3ab640 1 --2- 172.21.15.19:0/481218268 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563e3913a300 0x563e3913c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:52.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.417+0000 7f370a3ab640 1 --2- 172.21.15.19:0/481218268 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563e3913a300 0x563e3913c6f0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a10d062237f005d server_cookie=36aaf788ca1763fa in_seq=0 out_seq=0 2024-09-19T08:52:52.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.417+0000 7f36edffb640 10 client.15513 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:52:52.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.417+0000 7f36edffb640 1 -- 172.21.15.19:0/481218268 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x563e39027850 con 0x563e3913a300 2024-09-19T08:52:52.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.417+0000 7f36edffb640 10 client.15513 handle_command_reply: tid=0 2024-09-19T08:52:52.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.417+0000 7f370e9e8740 1 client.15513 shutdown 2024-09-19T08:52:52.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.417+0000 7f370e9e8740 1 -- 172.21.15.19:0/481218268 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e390b4dc0 msgr2=0x563e390c3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:52.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.417+0000 7f370e9e8740 1 --2- 172.21.15.19:0/481218268 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e390b4dc0 0x563e390c3000 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f36f409bc40 tx=0x7f36f40054a0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.417+0000 7f370e9e8740 1 -- 172.21.15.19:0/481218268 shutdown_connections 2024-09-19T08:52:52.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.417+0000 7f370e9e8740 1 --2- 172.21.15.19:0/481218268 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563e3913a300 0x563e3913c6f0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.417+0000 7f370e9e8740 1 --2- 172.21.15.19:0/481218268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e390bf680 0x563e390c3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.417+0000 7f370e9e8740 1 --2- 172.21.15.19:0/481218268 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e390b4dc0 0x563e390c3000 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.417+0000 7f370e9e8740 1 --2- 172.21.15.19:0/481218268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e390b44a0 0x563e390c7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.417+0000 7f370e9e8740 1 -- 172.21.15.19:0/481218268 >> 172.21.15.19:0/481218268 conn(0x563e390b0a30 msgr2=0x563e390b5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:52.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.417+0000 7f36edffb640 0 client.15513 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:52:52.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.417+0000 7f370e9e8740 1 -- 172.21.15.19:0/481218268 shutdown_connections 2024-09-19T08:52:52.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.418+0000 7f370e9e8740 1 -- 172.21.15.19:0/481218268 wait complete. 2024-09-19T08:52:52.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.418+0000 7f370e9e8740 20 client.15513 trim_cache size 0 max 16384 2024-09-19T08:52:52.424 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:52:52.424 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-19T08:52:52.424 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {} 2024-09-19T08:52:52.424 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:52:52.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.418+0000 7f370c60f640 1 -- 172.21.15.19:0/1367274234 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f36f00a3350 msgr2=0x7f36f00a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:52.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.418+0000 7f370c60f640 1 --2- 172.21.15.19:0/1367274234 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f36f00a3350 0x7f36f00a5810 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f37000314e0 tx=0x7f3700005b50 comp rx=0 tx=0).stop 2024-09-19T08:52:52.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.418+0000 7f370c60f640 1 -- 172.21.15.19:0/1367274234 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3704102570 msgr2=0x7f37040fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:52.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.418+0000 7f370c60f640 1 --2- 172.21.15.19:0/1367274234 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3704102570 0x7f37040fd1c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f36f400c890 tx=0x7f36f400cd50 comp rx=0 tx=0).stop 2024-09-19T08:52:52.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.418+0000 7f370c60f640 1 -- 172.21.15.19:0/1367274234 shutdown_connections 2024-09-19T08:52:52.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.418+0000 7f370c60f640 1 --2- 172.21.15.19:0/1367274234 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f36f00a3350 0x7f36f00a5810 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.418+0000 7f370c60f640 1 --2- 172.21.15.19:0/1367274234 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3704102ef0 0x7f37040fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.418+0000 7f370c60f640 1 --2- 172.21.15.19:0/1367274234 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3704102570 0x7f37040fd1c0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.418+0000 7f370c60f640 1 --2- 172.21.15.19:0/1367274234 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3704100e20 0x7f37040fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:52.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.418+0000 7f370c60f640 1 -- 172.21.15.19:0/1367274234 >> 172.21.15.19:0/1367274234 conn(0x7f37040fc7d0 msgr2=0x7f370406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:52.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.418+0000 7f370c60f640 1 -- 172.21.15.19:0/1367274234 shutdown_connections 2024-09-19T08:52:52.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:52.418+0000 7f370c60f640 1 -- 172.21.15.19:0/1367274234 wait complete. 2024-09-19T08:52:53.150 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:52:53.150 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:52:53.434 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:53.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:53 smithi019 ceph-mon[30976]: pgmap v357: 97 pgs: 97 active+clean; 663 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-19T08:52:53.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.924+0000 7f5a38ca6640 1 -- 172.21.15.19:0/304413802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a34102570 msgr2=0x7f5a341029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:53.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.924+0000 7f5a38ca6640 1 --2- 172.21.15.19:0/304413802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a34102570 0x7f5a341029b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5a28009900 tx=0x7f5a2802a4a0 comp rx=0 tx=0).stop 2024-09-19T08:52:53.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.924+0000 7f5a38ca6640 1 -- 172.21.15.19:0/304413802 shutdown_connections 2024-09-19T08:52:53.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.924+0000 7f5a38ca6640 1 --2- 172.21.15.19:0/304413802 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a34102ef0 0x7f5a3410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:53.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.924+0000 7f5a38ca6640 1 --2- 172.21.15.19:0/304413802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a34102570 0x7f5a341029b0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:53.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.924+0000 7f5a38ca6640 1 --2- 172.21.15.19:0/304413802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a34100e20 0x7f5a34101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:53.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.924+0000 7f5a38ca6640 1 -- 172.21.15.19:0/304413802 >> 172.21.15.19:0/304413802 conn(0x7f5a340fc7d0 msgr2=0x7f5a340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:53.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.924+0000 7f5a38ca6640 1 -- 172.21.15.19:0/304413802 shutdown_connections 2024-09-19T08:52:53.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.924+0000 7f5a38ca6640 1 -- 172.21.15.19:0/304413802 wait complete. 2024-09-19T08:52:53.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.925+0000 7f5a38ca6640 1 Processor -- start 2024-09-19T08:52:53.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.925+0000 7f5a38ca6640 1 -- start start 2024-09-19T08:52:53.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.925+0000 7f5a38ca6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a34100e20 0x7f5a34197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:53.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.926+0000 7f5a38ca6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a34102570 0x7f5a34197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:53.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.926+0000 7f5a38ca6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a34102ef0 0x7f5a3419bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:53.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.926+0000 7f5a38ca6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5a34110fc0 con 0x7f5a34102ef0 2024-09-19T08:52:53.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.926+0000 7f5a38ca6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5a34110e40 con 0x7f5a34100e20 2024-09-19T08:52:53.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.926+0000 7f5a38ca6640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5a34111140 con 0x7f5a34102570 2024-09-19T08:52:53.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.926+0000 7f5a32d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a34102ef0 0x7f5a3419bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:53.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.926+0000 7f5a32d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a34102ef0 0x7f5a3419bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44200/0 (socket says 172.21.15.19:44200) 2024-09-19T08:52:53.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.926+0000 7f5a32d9d640 1 -- 172.21.15.19:0/3686333030 learned_addr learned my addr 172.21.15.19:0/3686333030 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:53.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.926+0000 7f5a3259c640 1 --2- 172.21.15.19:0/3686333030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a34100e20 0x7f5a34197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:53.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.926+0000 7f5a31d9b640 1 --2- 172.21.15.19:0/3686333030 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a34102570 0x7f5a34197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:53.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.926+0000 7f5a32d9d640 1 -- 172.21.15.19:0/3686333030 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a34102570 msgr2=0x7f5a34197960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:53.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.926+0000 7f5a32d9d640 1 --2- 172.21.15.19:0/3686333030 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a34102570 0x7f5a34197960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:53.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.926+0000 7f5a32d9d640 1 -- 172.21.15.19:0/3686333030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a34100e20 msgr2=0x7f5a34197420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:53.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.926+0000 7f5a32d9d640 1 --2- 172.21.15.19:0/3686333030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a34100e20 0x7f5a34197420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:53.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.926+0000 7f5a32d9d640 1 -- 172.21.15.19:0/3686333030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a3419c3d0 con 0x7f5a34102ef0 2024-09-19T08:52:53.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.926+0000 7f5a31d9b640 1 --2- 172.21.15.19:0/3686333030 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a34102570 0x7f5a34197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:53.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.926+0000 7f5a32d9d640 1 --2- 172.21.15.19:0/3686333030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a34102ef0 0x7f5a3419bcf0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00b990 tx=0x7f5a2c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:53.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.926+0000 7f5a237fe640 1 -- 172.21.15.19:0/3686333030 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c019070 con 0x7f5a34102ef0 2024-09-19T08:52:53.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.927+0000 7f5a38ca6640 1 -- 172.21.15.19:0/3686333030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a3419c6c0 con 0x7f5a34102ef0 2024-09-19T08:52:53.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.927+0000 7f5a237fe640 1 -- 172.21.15.19:0/3686333030 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5a2c00cba0 con 0x7f5a34102ef0 2024-09-19T08:52:53.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.927+0000 7f5a237fe640 1 -- 172.21.15.19:0/3686333030 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a2c007610 con 0x7f5a34102ef0 2024-09-19T08:52:53.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.927+0000 7f5a38ca6640 1 -- 172.21.15.19:0/3686333030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a341a3fa0 con 0x7f5a34102ef0 2024-09-19T08:52:53.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.928+0000 7f5a38ca6640 1 -- 172.21.15.19:0/3686333030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a34101200 con 0x7f5a34102ef0 2024-09-19T08:52:53.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.929+0000 7f5a237fe640 1 -- 172.21.15.19:0/3686333030 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f5a2c01c070 con 0x7f5a34102ef0 2024-09-19T08:52:53.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.929+0000 7f5a237fe640 1 --2- 172.21.15.19:0/3686333030 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5a1c0a32d0 0x7f5a1c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:53.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.930+0000 7f5a237fe640 1 -- 172.21.15.19:0/3686333030 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5a2c0cef70 con 0x7f5a34102ef0 2024-09-19T08:52:53.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.930+0000 7f5a3259c640 1 --2- 172.21.15.19:0/3686333030 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5a1c0a32d0 0x7f5a1c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:53.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.930+0000 7f5a3259c640 1 --2- 172.21.15.19:0/3686333030 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5a1c0a32d0 0x7f5a1c0a5790 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5a24009bd0 tx=0x7f5a24005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:53.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:53.934+0000 7f5a237fe640 1 -- 172.21.15.19:0/3686333030 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5a2c09b5a0 con 0x7f5a34102ef0 2024-09-19T08:52:54.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:54.156+0000 7f5a38ca6640 1 -- 172.21.15.19:0/3686333030 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a341a41d0 con 0x7f5a34102ef0 2024-09-19T08:52:54.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:54.157+0000 7f5a237fe640 1 -- 172.21.15.19:0/3686333030 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11983 (secure 0 0 0) 0x7f5a2c09f8a0 con 0x7f5a34102ef0 2024-09-19T08:52:54.157 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:52:54.158 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":28,"btime":"2024-09-19T08:52:09:653615+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2452068876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2452068876},{"type":"v1","addr":"172.21.15.19:6839","nonce":2452068876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T08:52:08.813945+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/2480841559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2480841559},{"type":"v1","addr":"172.21.15.155:6835","nonce":2480841559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24463,24464,24490,24469,24497]},"id":1}]} 2024-09-19T08:52:54.158 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 28 2024-09-19T08:52:54.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:54.160+0000 7f5a38ca6640 1 -- 172.21.15.19:0/3686333030 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5a1c0a32d0 msgr2=0x7f5a1c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:54.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:54.160+0000 7f5a38ca6640 1 --2- 172.21.15.19:0/3686333030 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5a1c0a32d0 0x7f5a1c0a5790 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5a24009bd0 tx=0x7f5a24005f90 comp rx=0 tx=0).stop 2024-09-19T08:52:54.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:54.160+0000 7f5a38ca6640 1 -- 172.21.15.19:0/3686333030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a34102ef0 msgr2=0x7f5a3419bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:54.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:54.160+0000 7f5a38ca6640 1 --2- 172.21.15.19:0/3686333030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a34102ef0 0x7f5a3419bcf0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5a2c00b990 tx=0x7f5a2c00be50 comp rx=0 tx=0).stop 2024-09-19T08:52:54.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:54.160+0000 7f5a38ca6640 1 -- 172.21.15.19:0/3686333030 shutdown_connections 2024-09-19T08:52:54.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:54.160+0000 7f5a38ca6640 1 --2- 172.21.15.19:0/3686333030 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5a1c0a32d0 0x7f5a1c0a5790 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:54.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:54.160+0000 7f5a38ca6640 1 --2- 172.21.15.19:0/3686333030 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5a34102570 0x7f5a34197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:54.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:54.160+0000 7f5a38ca6640 1 --2- 172.21.15.19:0/3686333030 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5a34102ef0 0x7f5a3419bcf0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:54.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:54.160+0000 7f5a38ca6640 1 --2- 172.21.15.19:0/3686333030 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5a34100e20 0x7f5a34197420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:54.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:54.160+0000 7f5a38ca6640 1 -- 172.21.15.19:0/3686333030 >> 172.21.15.19:0/3686333030 conn(0x7f5a340fc7d0 msgr2=0x7f5a340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:54.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:54.160+0000 7f5a38ca6640 1 -- 172.21.15.19:0/3686333030 shutdown_connections 2024-09-19T08:52:54.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:54.160+0000 7f5a38ca6640 1 -- 172.21.15.19:0/3686333030 wait complete. 2024-09-19T08:52:54.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:53 smithi155 ceph-mon[34921]: pgmap v357: 97 pgs: 97 active+clean; 663 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-19T08:52:54.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:53 smithi203 ceph-mon[35450]: pgmap v357: 97 pgs: 97 active+clean; 663 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-19T08:52:54.833 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T08:52:55.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:54 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3686333030' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:52:55.109 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:55.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:54 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3686333030' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:52:55.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:54 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3686333030' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:52:55.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.622+0000 7fc467edd640 1 -- 172.21.15.19:0/3066117250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4601082a0 msgr2=0x7fc46010ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:55.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.622+0000 7fc467edd640 1 --2- 172.21.15.19:0/3066117250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4601082a0 0x7fc46010ec40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc458009cd0 tx=0x7fc45802a8e0 comp rx=0 tx=0).stop 2024-09-19T08:52:55.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.622+0000 7fc467edd640 1 -- 172.21.15.19:0/3066117250 shutdown_connections 2024-09-19T08:52:55.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.622+0000 7fc467edd640 1 --2- 172.21.15.19:0/3066117250 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4601036e0 0x7fc460107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:55.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.622+0000 7fc467edd640 1 --2- 172.21.15.19:0/3066117250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc4601082a0 0x7fc46010ec40 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:55.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.622+0000 7fc467edd640 1 --2- 172.21.15.19:0/3066117250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc460102d30 0x7fc460103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:55.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.622+0000 7fc467edd640 1 -- 172.21.15.19:0/3066117250 >> 172.21.15.19:0/3066117250 conn(0x7fc4600fc7d0 msgr2=0x7fc4600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:55.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.622+0000 7fc467edd640 1 -- 172.21.15.19:0/3066117250 shutdown_connections 2024-09-19T08:52:55.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.622+0000 7fc467edd640 1 -- 172.21.15.19:0/3066117250 wait complete. 2024-09-19T08:52:55.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.623+0000 7fc467edd640 1 Processor -- start 2024-09-19T08:52:55.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.623+0000 7fc467edd640 1 -- start start 2024-09-19T08:52:55.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.623+0000 7fc467edd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc460102d30 0x7fc4601a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:55.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.623+0000 7fc467edd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4601036e0 0x7fc4601a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:55.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.623+0000 7fc467edd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4601082a0 0x7fc46019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:55.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.623+0000 7fc467edd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc4601120a0 con 0x7fc460102d30 2024-09-19T08:52:55.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.623+0000 7fc467edd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc460111f20 con 0x7fc4601082a0 2024-09-19T08:52:55.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.623+0000 7fc467edd640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc460112220 con 0x7fc4601036e0 2024-09-19T08:52:55.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.624+0000 7fc465c79640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc460102d30 0x7fc4601a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:55.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.624+0000 7fc465c79640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc460102d30 0x7fc4601a0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51946/0 (socket says 172.21.15.19:51946) 2024-09-19T08:52:55.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.624+0000 7fc465c79640 1 -- 172.21.15.19:0/2282321145 learned_addr learned my addr 172.21.15.19:0/2282321145 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:55.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.624+0000 7fc465478640 1 --2- 172.21.15.19:0/2282321145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4601036e0 0x7fc4601a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:55.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.624+0000 7fc46647a640 1 --2- 172.21.15.19:0/2282321145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4601082a0 0x7fc46019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:55.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.624+0000 7fc465c79640 1 -- 172.21.15.19:0/2282321145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4601036e0 msgr2=0x7fc4601a0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:55.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.624+0000 7fc465c79640 1 --2- 172.21.15.19:0/2282321145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4601036e0 0x7fc4601a0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:55.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.624+0000 7fc465c79640 1 -- 172.21.15.19:0/2282321145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4601082a0 msgr2=0x7fc46019a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:55.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.624+0000 7fc465c79640 1 --2- 172.21.15.19:0/2282321145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4601082a0 0x7fc46019a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:55.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.624+0000 7fc465c79640 1 -- 172.21.15.19:0/2282321145 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc46019acf0 con 0x7fc460102d30 2024-09-19T08:52:55.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.624+0000 7fc46647a640 1 --2- 172.21.15.19:0/2282321145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4601082a0 0x7fc46019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:55.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.624+0000 7fc465478640 1 --2- 172.21.15.19:0/2282321145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4601036e0 0x7fc4601a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:55.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.624+0000 7fc465c79640 1 --2- 172.21.15.19:0/2282321145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc460102d30 0x7fc4601a0400 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fc45c00d950 tx=0x7fc45c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:55.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.624+0000 7fc456ffd640 1 -- 172.21.15.19:0/2282321145 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc45c017070 con 0x7fc460102d30 2024-09-19T08:52:55.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.624+0000 7fc467edd640 1 -- 172.21.15.19:0/2282321145 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc46019afe0 con 0x7fc460102d30 2024-09-19T08:52:55.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.624+0000 7fc456ffd640 1 -- 172.21.15.19:0/2282321145 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc45c009c30 con 0x7fc460102d30 2024-09-19T08:52:55.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.624+0000 7fc456ffd640 1 -- 172.21.15.19:0/2282321145 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc45c00f6b0 con 0x7fc460102d30 2024-09-19T08:52:55.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.624+0000 7fc467edd640 1 -- 172.21.15.19:0/2282321145 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4601a72d0 con 0x7fc460102d30 2024-09-19T08:52:55.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.627+0000 7fc456ffd640 1 -- 172.21.15.19:0/2282321145 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7fc45c0109d0 con 0x7fc460102d30 2024-09-19T08:52:55.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.627+0000 7fc46a2b6740 1 Processor -- start 2024-09-19T08:52:55.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.628+0000 7fc46a2b6740 1 -- start start 2024-09-19T08:52:55.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.628+0000 7fc456ffd640 1 --2- 172.21.15.19:0/2282321145 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc44c0a32d0 0x7fc44c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:55.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.628+0000 7fc46a2b6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604074e9b40 0x5604074e8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:55.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.628+0000 7fc46a2b6740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604074e85d0 0x5604074e8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:55.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.628+0000 7fc46a2b6740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604074f3370 0x5604074f5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:55.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.628+0000 7fc46a2b6740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56040744e2f0 con 0x5604074f3370 2024-09-19T08:52:55.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.628+0000 7fc46a2b6740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5604073f5cf0 con 0x5604074e85d0 2024-09-19T08:52:55.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.628+0000 7fc46a2b6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56040744a2b0 con 0x5604074e9b40 2024-09-19T08:52:55.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.628+0000 7fc456ffd640 1 -- 172.21.15.19:0/2282321145 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc45c0cf7b0 con 0x7fc460102d30 2024-09-19T08:52:55.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.628+0000 7fc465c79640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604074e9b40 0x5604074e8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:55.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.628+0000 7fc46647a640 1 --2- 172.21.15.19:0/2282321145 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc44c0a32d0 0x7fc44c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:55.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.628+0000 7fc465c79640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604074e9b40 0x5604074e8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:51840/0 (socket says 172.21.15.19:51840) 2024-09-19T08:52:55.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.628+0000 7fc465c79640 1 -- 172.21.15.19:0/1144169454 learned_addr learned my addr 172.21.15.19:0/1144169454 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:55.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.628+0000 7fc465478640 1 --2- 172.21.15.19:0/1144169454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604074e85d0 0x5604074e8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:55.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.628+0000 7fc46647a640 1 --2- 172.21.15.19:0/1144169454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604074f3370 0x5604074f5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:55.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.628+0000 7fc465c79640 1 -- 172.21.15.19:0/1144169454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604074e85d0 msgr2=0x5604074e8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:55.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.628+0000 7fc465c79640 1 --2- 172.21.15.19:0/1144169454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604074e85d0 0x5604074e8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:55.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.628+0000 7fc465c79640 1 -- 172.21.15.19:0/1144169454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604074f3370 msgr2=0x5604074f5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:55.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.628+0000 7fc465c79640 1 --2- 172.21.15.19:0/1144169454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604074f3370 0x5604074f5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:55.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.628+0000 7fc465c79640 1 -- 172.21.15.19:0/1144169454 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604073da3a0 con 0x5604074e9b40 2024-09-19T08:52:55.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.629+0000 7fc46647a640 1 --2- 172.21.15.19:0/2282321145 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc44c0a32d0 0x7fc44c0a5790 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x5604074e9070 tx=0x7fc458005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:55.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.629+0000 7fc465c79640 1 --2- 172.21.15.19:0/1144169454 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604074e9b40 0x5604074e8090 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc45c0a43c0 tx=0x7fc45c09b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90b889cbc3dd98f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:55.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.629+0000 7fc44bfff640 1 -- 172.21.15.19:0/1144169454 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc45c020040 con 0x5604074e9b40 2024-09-19T08:52:55.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.629+0000 7fc44bfff640 1 -- 172.21.15.19:0/1144169454 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc45c09c380 con 0x5604074e9b40 2024-09-19T08:52:55.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.629+0000 7fc44bfff640 1 -- 172.21.15.19:0/1144169454 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc45c04a320 con 0x5604074e9b40 2024-09-19T08:52:55.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.630+0000 7fc46a2b6740 1 -- 172.21.15.19:0/1144169454 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604074e9b40 msgr2=0x5604074e8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:55.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.630+0000 7fc46a2b6740 1 --2- 172.21.15.19:0/1144169454 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604074e9b40 0x5604074e8090 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc45c0a43c0 tx=0x7fc45c09b710 comp rx=0 tx=0).stop 2024-09-19T08:52:55.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.630+0000 7fc46a2b6740 1 -- 172.21.15.19:0/1144169454 shutdown_connections 2024-09-19T08:52:55.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.630+0000 7fc46a2b6740 1 --2- 172.21.15.19:0/1144169454 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604074f3370 0x5604074f5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:55.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.630+0000 7fc46a2b6740 1 --2- 172.21.15.19:0/1144169454 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604074e85d0 0x5604074e8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:55.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.630+0000 7fc46a2b6740 1 --2- 172.21.15.19:0/1144169454 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604074e9b40 0x5604074e8090 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:55.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.630+0000 7fc46a2b6740 1 -- 172.21.15.19:0/1144169454 >> 172.21.15.19:0/1144169454 conn(0x5604074b1310 msgr2=0x5604074e4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:55.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.630+0000 7fc46a2b6740 1 -- 172.21.15.19:0/1144169454 shutdown_connections 2024-09-19T08:52:55.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.630+0000 7fc46a2b6740 1 -- 172.21.15.19:0/1144169454 wait complete. 2024-09-19T08:52:55.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.631+0000 7fc46a2b6740 1 -- start start 2024-09-19T08:52:55.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.631+0000 7fc46a2b6740 1 Processor -- start 2024-09-19T08:52:55.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.631+0000 7fc46a2b6740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604074e85d0 0x5604074f2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:55.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.631+0000 7fc46a2b6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604074e9b40 0x5604074effb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:55.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.631+0000 7fc46a2b6740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604074f3370 0x5604074f0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:55.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.631+0000 7fc46a2b6740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5604074f5fb0 con 0x5604074f3370 2024-09-19T08:52:55.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.631+0000 7fc46a2b6740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x560407409060 con 0x5604074e85d0 2024-09-19T08:52:55.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.631+0000 7fc46a2b6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5604074f6130 con 0x5604074e9b40 2024-09-19T08:52:55.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.631+0000 7fc46a2b6740 10 client.0 _ll_register_callbacks cb 0x56040715c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:55.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.632+0000 7fc46647a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604074f3370 0x5604074f0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:55.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.632+0000 7fc465478640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604074e9b40 0x5604074effb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:55.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.632+0000 7fc465478640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604074e9b40 0x5604074effb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:51852/0 (socket says 172.21.15.19:51852) 2024-09-19T08:52:55.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.632+0000 7fc46647a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604074f3370 0x5604074f0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51976/0 (socket says 172.21.15.19:51976) 2024-09-19T08:52:55.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.632+0000 7fc465478640 1 -- 172.21.15.19:0/814609331 learned_addr learned my addr 172.21.15.19:0/814609331 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:55.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.632+0000 7fc465c79640 1 --2- 172.21.15.19:0/814609331 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604074e85d0 0x5604074f2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:55.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.632+0000 7fc465478640 1 -- 172.21.15.19:0/814609331 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604074e85d0 msgr2=0x5604074f2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:55.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.632+0000 7fc465478640 1 --2- 172.21.15.19:0/814609331 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604074e85d0 0x5604074f2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:55.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.632+0000 7fc465478640 1 -- 172.21.15.19:0/814609331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604074f3370 msgr2=0x5604074f0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:55.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.632+0000 7fc465478640 1 --2- 172.21.15.19:0/814609331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604074f3370 0x5604074f0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:55.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.632+0000 7fc465478640 1 -- 172.21.15.19:0/814609331 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604071bf3c0 con 0x5604074e9b40 2024-09-19T08:52:55.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.632+0000 7fc46647a640 1 --2- 172.21.15.19:0/814609331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604074f3370 0x5604074f0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:52:55.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.632+0000 7fc465478640 1 --2- 172.21.15.19:0/814609331 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604074e9b40 0x5604074effb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc4500134b0 tx=0x7fc450013970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a00150daecdb360 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:55.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.632+0000 7fc4497fa640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T08:52:55.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.632+0000 7fc4497fa640 1 -- 172.21.15.19:0/814609331 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc450004020 con 0x5604074e9b40 2024-09-19T08:52:55.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.633+0000 7fc46a2b6740 1 -- 172.21.15.19:0/814609331 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc45c09c380 con 0x5604074e9b40 2024-09-19T08:52:55.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.633+0000 7fc4497fa640 1 -- 172.21.15.19:0/814609331 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc4500041c0 con 0x5604074e9b40 2024-09-19T08:52:55.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.633+0000 7fc4497fa640 1 -- 172.21.15.19:0/814609331 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc4500043c0 con 0x5604074e9b40 2024-09-19T08:52:55.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.633+0000 7fc46a2b6740 10 client.25135 fetch_fsmap learned FSMap version 28 2024-09-19T08:52:55.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.633+0000 7fc46a2b6740 1 -- 172.21.15.19:0/814609331 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560407501a90 con 0x5604074e9b40 2024-09-19T08:52:55.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.633+0000 7fc4497fa640 1 -- 172.21.15.19:0/814609331 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc45c09c380 con 0x5604074e9b40 2024-09-19T08:52:55.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.633+0000 7fc4497fa640 1 -- 172.21.15.19:0/814609331 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc45000f040 con 0x5604074e9b40 2024-09-19T08:52:55.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.633+0000 7fc46a2b6740 10 client.25135 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:52:55.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.633+0000 7fc46a2b6740 10 client.25135 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T08:52:55.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.633+0000 7fc46a2b6740 20 client.25135 populate_metadata read hostname 'smithi019' 2024-09-19T08:52:55.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.633+0000 7fc46a2b6740 1 --2- 172.21.15.19:0/814609331 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x560407502ef0 0x560407505350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:55.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.633+0000 7fc46a2b6740 4 client.25135 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:55.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.633+0000 7fc46a2b6740 1 -- 172.21.15.19:0/814609331 --> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56040745b860 con 0x560407502ef0 2024-09-19T08:52:55.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.634+0000 7fc465c79640 1 --2- 172.21.15.19:0/814609331 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x560407502ef0 0x560407505350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:55.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.634+0000 7fc465c79640 1 --2- 172.21.15.19:0/814609331 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x560407502ef0 0x560407505350 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=71cd79688a874eaf server_cookie=cd255498e7182225 in_seq=0 out_seq=0 2024-09-19T08:52:55.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.634+0000 7fc4497fa640 10 client.25135 ms_handle_connect on v2:172.21.15.203:6834/2702758353 2024-09-19T08:52:55.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.635+0000 7fc4497fa640 1 -- 172.21.15.19:0/814609331 <== mds.4 v2:172.21.15.203:6834/2702758353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56040745b860 con 0x560407502ef0 2024-09-19T08:52:55.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.635+0000 7fc4497fa640 10 client.25135 handle_command_reply: tid=0 2024-09-19T08:52:55.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.635+0000 7fc46a2b6740 1 client.25135 shutdown 2024-09-19T08:52:55.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.635+0000 7fc46a2b6740 1 -- 172.21.15.19:0/814609331 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604074e9b40 msgr2=0x5604074effb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:55.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.635+0000 7fc46a2b6740 1 --2- 172.21.15.19:0/814609331 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604074e9b40 0x5604074effb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc4500134b0 tx=0x7fc450013970 comp rx=0 tx=0).stop 2024-09-19T08:52:55.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.635+0000 7fc46a2b6740 1 -- 172.21.15.19:0/814609331 shutdown_connections 2024-09-19T08:52:55.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.635+0000 7fc46a2b6740 1 --2- 172.21.15.19:0/814609331 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x560407502ef0 0x560407505350 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:55.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.635+0000 7fc46a2b6740 1 --2- 172.21.15.19:0/814609331 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604074e9b40 0x5604074effb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:55.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.635+0000 7fc46a2b6740 1 --2- 172.21.15.19:0/814609331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604074f3370 0x5604074f0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:55.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.635+0000 7fc46a2b6740 1 --2- 172.21.15.19:0/814609331 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604074e85d0 0x5604074f2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:55.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.635+0000 7fc46a2b6740 1 -- 172.21.15.19:0/814609331 >> 172.21.15.19:0/814609331 conn(0x5604074b1310 msgr2=0x5604074ea960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:55.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.635+0000 7fc4497fa640 0 client.25135 ms_handle_reset on v2:172.21.15.203:6834/2702758353 2024-09-19T08:52:55.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.635+0000 7fc46a2b6740 1 -- 172.21.15.19:0/814609331 shutdown_connections 2024-09-19T08:52:55.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.635+0000 7fc46a2b6740 1 -- 172.21.15.19:0/814609331 wait complete. 2024-09-19T08:52:55.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.635+0000 7fc46a2b6740 20 client.25135 trim_cache size 0 max 16384 2024-09-19T08:52:55.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.649+0000 7fc46a2b6740 1 Processor -- start 2024-09-19T08:52:55.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.649+0000 7fc46a2b6740 1 -- start start 2024-09-19T08:52:55.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.649+0000 7fc46a2b6740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604074e85d0 0x5604074ff250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:55.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.649+0000 7fc46a2b6740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604074e9b40 0x5604074ef870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:55.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.649+0000 7fc46a2b6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604074f3370 0x5604074eb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:55.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.649+0000 7fc46a2b6740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc4601ab4e0 con 0x5604074e85d0 2024-09-19T08:52:55.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.649+0000 7fc46a2b6740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc4601ad020 con 0x5604074e9b40 2024-09-19T08:52:55.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.649+0000 7fc46a2b6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc4601abbb0 con 0x5604074f3370 2024-09-19T08:52:55.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.649+0000 7fc465c79640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604074e85d0 0x5604074ff250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:55.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.649+0000 7fc465c79640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604074e85d0 0x5604074ff250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51980/0 (socket says 172.21.15.19:51980) 2024-09-19T08:52:55.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.649+0000 7fc465c79640 1 -- 172.21.15.19:0/3544297035 learned_addr learned my addr 172.21.15.19:0/3544297035 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:55.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.649+0000 7fc465478640 1 --2- 172.21.15.19:0/3544297035 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604074e9b40 0x5604074ef870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:55.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.649+0000 7fc46647a640 1 --2- 172.21.15.19:0/3544297035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604074f3370 0x5604074eb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:55.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.650+0000 7fc465c79640 1 -- 172.21.15.19:0/3544297035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604074f3370 msgr2=0x5604074eb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:55.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.650+0000 7fc465c79640 1 --2- 172.21.15.19:0/3544297035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604074f3370 0x5604074eb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:55.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.650+0000 7fc465c79640 1 -- 172.21.15.19:0/3544297035 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604074e9b40 msgr2=0x5604074ef870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:55.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.650+0000 7fc465c79640 1 --2- 172.21.15.19:0/3544297035 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604074e9b40 0x5604074ef870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:55.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.650+0000 7fc465c79640 1 -- 172.21.15.19:0/3544297035 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604074ee500 con 0x5604074e85d0 2024-09-19T08:52:55.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.650+0000 7fc465c79640 1 --2- 172.21.15.19:0/3544297035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604074e85d0 0x5604074ff250 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc45c000c00 tx=0x7fc45c097800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4759044aaceeacd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:55.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.650+0000 7fc44b7fe640 1 -- 172.21.15.19:0/3544297035 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc45c020040 con 0x5604074e85d0 2024-09-19T08:52:55.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.650+0000 7fc44b7fe640 1 -- 172.21.15.19:0/3544297035 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc45c09c380 con 0x5604074e85d0 2024-09-19T08:52:55.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.650+0000 7fc44b7fe640 1 -- 172.21.15.19:0/3544297035 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc45c04d2c0 con 0x5604074e85d0 2024-09-19T08:52:55.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.651+0000 7fc46a2b6740 1 -- 172.21.15.19:0/3544297035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604074e85d0 msgr2=0x5604074ff250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:55.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.651+0000 7fc46a2b6740 1 --2- 172.21.15.19:0/3544297035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604074e85d0 0x5604074ff250 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fc45c000c00 tx=0x7fc45c097800 comp rx=0 tx=0).stop 2024-09-19T08:52:55.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.651+0000 7fc46a2b6740 1 -- 172.21.15.19:0/3544297035 shutdown_connections 2024-09-19T08:52:55.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.651+0000 7fc46a2b6740 1 --2- 172.21.15.19:0/3544297035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604074f3370 0x5604074eb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:55.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.651+0000 7fc46a2b6740 1 --2- 172.21.15.19:0/3544297035 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604074e9b40 0x5604074ef870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:55.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.651+0000 7fc46a2b6740 1 --2- 172.21.15.19:0/3544297035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604074e85d0 0x5604074ff250 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:55.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.651+0000 7fc46a2b6740 1 -- 172.21.15.19:0/3544297035 >> 172.21.15.19:0/3544297035 conn(0x5604074b1310 msgr2=0x5604074ef0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:55.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.651+0000 7fc46a2b6740 1 -- 172.21.15.19:0/3544297035 shutdown_connections 2024-09-19T08:52:55.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.651+0000 7fc46a2b6740 1 -- 172.21.15.19:0/3544297035 wait complete. 2024-09-19T08:52:55.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.651+0000 7fc46a2b6740 1 -- start start 2024-09-19T08:52:55.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.651+0000 7fc46a2b6740 1 Processor -- start 2024-09-19T08:52:55.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.652+0000 7fc46a2b6740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604074e85d0 0x5604074fb740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:55.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.652+0000 7fc46a2b6740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604074e9b40 0x5604074fbc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:55.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.652+0000 7fc46a2b6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604074f3370 0x5604074f6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:55.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.652+0000 7fc46a2b6740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc4601ac950 con 0x5604074e9b40 2024-09-19T08:52:55.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.652+0000 7fc46a2b6740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc4601ac280 con 0x5604074e85d0 2024-09-19T08:52:55.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.652+0000 7fc46a2b6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc4601a9520 con 0x5604074f3370 2024-09-19T08:52:55.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.652+0000 7fc46a2b6740 10 client.0 _ll_register_callbacks cb 0x7fc450009c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:55.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.652+0000 7fc465478640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604074e9b40 0x5604074fbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:55.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.652+0000 7fc465478640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604074e9b40 0x5604074fbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51990/0 (socket says 172.21.15.19:51990) 2024-09-19T08:52:55.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.652+0000 7fc465478640 1 -- 172.21.15.19:0/3810532391 learned_addr learned my addr 172.21.15.19:0/3810532391 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:55.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.652+0000 7fc465c79640 1 --2- 172.21.15.19:0/3810532391 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604074e85d0 0x5604074fb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:55.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.652+0000 7fc46647a640 1 --2- 172.21.15.19:0/3810532391 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604074f3370 0x5604074f6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:55.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.652+0000 7fc465478640 1 -- 172.21.15.19:0/3810532391 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604074f3370 msgr2=0x5604074f6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:55.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.652+0000 7fc465478640 1 --2- 172.21.15.19:0/3810532391 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604074f3370 0x5604074f6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:55.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.652+0000 7fc465478640 1 -- 172.21.15.19:0/3810532391 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604074e85d0 msgr2=0x5604074fb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:55.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.652+0000 7fc465478640 1 --2- 172.21.15.19:0/3810532391 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604074e85d0 0x5604074fb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:55.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.652+0000 7fc465478640 1 -- 172.21.15.19:0/3810532391 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604074f7540 con 0x5604074e9b40 2024-09-19T08:52:55.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.652+0000 7fc46647a640 1 --2- 172.21.15.19:0/3810532391 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604074f3370 0x5604074f6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:55.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.653+0000 7fc465478640 1 --2- 172.21.15.19:0/3810532391 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604074e9b40 0x5604074fbc80 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc450016040 tx=0x7fc450013f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=186bc99c3753b771 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:55.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.653+0000 7fc4497fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:52:55.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.653+0000 7fc4497fa640 1 -- 172.21.15.19:0/3810532391 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc45002c040 con 0x5604074e9b40 2024-09-19T08:52:55.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.653+0000 7fc4497fa640 1 -- 172.21.15.19:0/3810532391 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc450004870 con 0x5604074e9b40 2024-09-19T08:52:55.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.653+0000 7fc46a2b6740 1 -- 172.21.15.19:0/3810532391 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc45c09c380 con 0x5604074e9b40 2024-09-19T08:52:55.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.653+0000 7fc4497fa640 1 -- 172.21.15.19:0/3810532391 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc450005c50 con 0x5604074e9b40 2024-09-19T08:52:55.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.653+0000 7fc46a2b6740 10 client.15537 fetch_fsmap learned FSMap version 28 2024-09-19T08:52:55.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.653+0000 7fc46a2b6740 1 -- 172.21.15.19:0/3810532391 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56040756d850 con 0x5604074e9b40 2024-09-19T08:52:55.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.653+0000 7fc4497fa640 1 -- 172.21.15.19:0/3810532391 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc45c09c380 con 0x5604074e9b40 2024-09-19T08:52:55.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.653+0000 7fc4497fa640 1 -- 172.21.15.19:0/3810532391 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fc450005270 con 0x5604074e9b40 2024-09-19T08:52:55.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.654+0000 7fc46a2b6740 10 client.15537 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:52:55.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.654+0000 7fc46a2b6740 10 client.15537 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T08:52:55.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.654+0000 7fc46a2b6740 20 client.15537 populate_metadata read hostname 'smithi019' 2024-09-19T08:52:55.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.654+0000 7fc46a2b6740 1 --2- 172.21.15.19:0/3810532391 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x56040756dfa0 0x5604075703c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:55.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.654+0000 7fc46a2b6740 4 client.15537 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:52:55.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.654+0000 7fc46a2b6740 1 -- 172.21.15.19:0/3810532391 --> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560407455d70 con 0x56040756dfa0 2024-09-19T08:52:55.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.654+0000 7fc465c79640 1 --2- 172.21.15.19:0/3810532391 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x56040756dfa0 0x5604075703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:55.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.654+0000 7fc465c79640 1 --2- 172.21.15.19:0/3810532391 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x56040756dfa0 0x5604075703c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=40ad81797b69a0ea server_cookie=117341ca05fbb5f1 in_seq=0 out_seq=0 2024-09-19T08:52:55.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.654+0000 7fc4497fa640 10 client.15537 ms_handle_connect on v2:172.21.15.203:6834/2702758353 2024-09-19T08:52:55.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.654+0000 7fc4497fa640 1 -- 172.21.15.19:0/3810532391 <== mds.4 v2:172.21.15.203:6834/2702758353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560407455d70 con 0x56040756dfa0 2024-09-19T08:52:55.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.654+0000 7fc4497fa640 10 client.15537 handle_command_reply: tid=0 2024-09-19T08:52:55.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.654+0000 7fc46a2b6740 1 client.15537 shutdown 2024-09-19T08:52:55.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.655+0000 7fc46a2b6740 1 -- 172.21.15.19:0/3810532391 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604074e9b40 msgr2=0x5604074fbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:55.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.655+0000 7fc46a2b6740 1 --2- 172.21.15.19:0/3810532391 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604074e9b40 0x5604074fbc80 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fc450016040 tx=0x7fc450013f00 comp rx=0 tx=0).stop 2024-09-19T08:52:55.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.655+0000 7fc46a2b6740 1 -- 172.21.15.19:0/3810532391 shutdown_connections 2024-09-19T08:52:55.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.655+0000 7fc46a2b6740 1 --2- 172.21.15.19:0/3810532391 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x56040756dfa0 0x5604075703c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:55.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.655+0000 7fc46a2b6740 1 --2- 172.21.15.19:0/3810532391 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5604074f3370 0x5604074f6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:55.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.655+0000 7fc46a2b6740 1 --2- 172.21.15.19:0/3810532391 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5604074e9b40 0x5604074fbc80 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:55.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.655+0000 7fc46a2b6740 1 --2- 172.21.15.19:0/3810532391 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5604074e85d0 0x5604074fb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:55.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.655+0000 7fc4497fa640 0 client.15537 ms_handle_reset on v2:172.21.15.203:6834/2702758353 2024-09-19T08:52:55.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.655+0000 7fc46a2b6740 1 -- 172.21.15.19:0/3810532391 >> 172.21.15.19:0/3810532391 conn(0x5604074b1310 msgr2=0x5604074f1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:55.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.655+0000 7fc46a2b6740 1 -- 172.21.15.19:0/3810532391 shutdown_connections 2024-09-19T08:52:55.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.655+0000 7fc46a2b6740 1 -- 172.21.15.19:0/3810532391 wait complete. 2024-09-19T08:52:55.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.655+0000 7fc46a2b6740 20 client.15537 trim_cache size 0 max 16384 2024-09-19T08:52:55.660 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T08:52:55.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.655+0000 7fc467edd640 1 -- 172.21.15.19:0/2282321145 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc44c0a32d0 msgr2=0x7fc44c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:55.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.655+0000 7fc467edd640 1 --2- 172.21.15.19:0/2282321145 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc44c0a32d0 0x7fc44c0a5790 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x5604074e9070 tx=0x7fc458005da0 comp rx=0 tx=0).stop 2024-09-19T08:52:55.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.655+0000 7fc467edd640 1 -- 172.21.15.19:0/2282321145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc460102d30 msgr2=0x7fc4601a0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:55.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.655+0000 7fc467edd640 1 --2- 172.21.15.19:0/2282321145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc460102d30 0x7fc4601a0400 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fc45c00d950 tx=0x7fc45c00de10 comp rx=0 tx=0).stop 2024-09-19T08:52:55.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.656+0000 7fc467edd640 1 -- 172.21.15.19:0/2282321145 shutdown_connections 2024-09-19T08:52:55.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.656+0000 7fc467edd640 1 --2- 172.21.15.19:0/2282321145 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc44c0a32d0 0x7fc44c0a5790 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:55.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.656+0000 7fc467edd640 1 --2- 172.21.15.19:0/2282321145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4601036e0 0x7fc4601a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:55.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.656+0000 7fc467edd640 1 --2- 172.21.15.19:0/2282321145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc4601082a0 0x7fc46019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:55.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.656+0000 7fc467edd640 1 --2- 172.21.15.19:0/2282321145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc460102d30 0x7fc4601a0400 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:55.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.656+0000 7fc467edd640 1 -- 172.21.15.19:0/2282321145 >> 172.21.15.19:0/2282321145 conn(0x7fc4600fc7d0 msgr2=0x7fc4600fda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:55.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.656+0000 7fc467edd640 1 -- 172.21.15.19:0/2282321145 shutdown_connections 2024-09-19T08:52:55.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:55.656+0000 7fc467edd640 1 -- 172.21.15.19:0/2282321145 wait complete. 2024-09-19T08:52:55.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:55 smithi019 ceph-mon[30976]: pgmap v358: 97 pgs: 97 active+clean; 663 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-19T08:52:56.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:55 smithi155 ceph-mon[34921]: pgmap v358: 97 pgs: 97 active+clean; 663 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-19T08:52:56.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:55 smithi203 ceph-mon[35450]: pgmap v358: 97 pgs: 97 active+clean; 663 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-19T08:52:56.327 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T08:52:56.456 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 11.2 2024-09-19T08:52:56.456 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:52:56.596 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:57.094 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.093+0000 7fa48d4d0640 1 -- 172.21.15.19:0/3029301532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4881078b0 msgr2=0x7fa488109ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:57.094 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.093+0000 7fa48d4d0640 1 --2- 172.21.15.19:0/3029301532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4881078b0 0x7fa488109ca0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa480009ca0 tx=0x7fa48002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.094 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.093+0000 7fa48d4d0640 1 -- 172.21.15.19:0/3029301532 shutdown_connections 2024-09-19T08:52:57.094 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.093+0000 7fa48d4d0640 1 --2- 172.21.15.19:0/3029301532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa4881078b0 0x7fa488109ca0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.094 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.093+0000 7fa48d4d0640 1 --2- 172.21.15.19:0/3029301532 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa488104f80 0x7fa488107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.094 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.093+0000 7fa48d4d0640 1 --2- 172.21.15.19:0/3029301532 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa488102650 0x7fa488104a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.095 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.094+0000 7fa48d4d0640 1 -- 172.21.15.19:0/3029301532 >> 172.21.15.19:0/3029301532 conn(0x7fa4880fc1b0 msgr2=0x7fa4880fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:57.095 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.094+0000 7fa48d4d0640 1 -- 172.21.15.19:0/3029301532 shutdown_connections 2024-09-19T08:52:57.095 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.094+0000 7fa48d4d0640 1 -- 172.21.15.19:0/3029301532 wait complete. 2024-09-19T08:52:57.097 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.094+0000 7fa48d4d0640 1 Processor -- start 2024-09-19T08:52:57.097 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.094+0000 7fa48d4d0640 1 -- start start 2024-09-19T08:52:57.097 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.094+0000 7fa48d4d0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa488102650 0x7fa488101fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:57.097 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.094+0000 7fa48d4d0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa488104f80 0x7fa488100600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:57.097 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.094+0000 7fa48d4d0640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa4881078b0 0x7fa488100b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:57.097 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.095+0000 7fa48d4d0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa48810d860 con 0x7fa488104f80 2024-09-19T08:52:57.097 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.095+0000 7fa48d4d0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa48810d6e0 con 0x7fa488102650 2024-09-19T08:52:57.097 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.095+0000 7fa48d4d0640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa48810d9e0 con 0x7fa4881078b0 2024-09-19T08:52:57.097 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.095+0000 7fa47ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa488104f80 0x7fa488100600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:57.097 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.095+0000 7fa47ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa488104f80 0x7fa488100600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51994/0 (socket says 172.21.15.19:51994) 2024-09-19T08:52:57.097 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.095+0000 7fa47ffff640 1 -- 172.21.15.19:0/3964151297 learned_addr learned my addr 172.21.15.19:0/3964151297 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.095+0000 7fa4877fe640 1 --2- 172.21.15.19:0/3964151297 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa4881078b0 0x7fa488100b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.095+0000 7fa486ffd640 1 --2- 172.21.15.19:0/3964151297 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa488102650 0x7fa488101fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.095+0000 7fa47ffff640 1 -- 172.21.15.19:0/3964151297 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa4881078b0 msgr2=0x7fa488100b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.095+0000 7fa47ffff640 1 --2- 172.21.15.19:0/3964151297 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa4881078b0 0x7fa488100b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.095+0000 7fa47ffff640 1 -- 172.21.15.19:0/3964151297 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa488102650 msgr2=0x7fa488101fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.095+0000 7fa47ffff640 1 --2- 172.21.15.19:0/3964151297 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa488102650 0x7fa488101fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.095+0000 7fa47ffff640 1 -- 172.21.15.19:0/3964151297 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4881013d0 con 0x7fa488104f80 2024-09-19T08:52:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.095+0000 7fa47ffff640 1 --2- 172.21.15.19:0/3964151297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa488104f80 0x7fa488100600 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa47000d770 tx=0x7fa47000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.095+0000 7fa484ff9640 1 -- 172.21.15.19:0/3964151297 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa470017070 con 0x7fa488104f80 2024-09-19T08:52:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.095+0000 7fa48d4d0640 1 -- 172.21.15.19:0/3964151297 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4881a1f10 con 0x7fa488104f80 2024-09-19T08:52:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.095+0000 7fa484ff9640 1 -- 172.21.15.19:0/3964151297 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa470009c30 con 0x7fa488104f80 2024-09-19T08:52:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.095+0000 7fa484ff9640 1 -- 172.21.15.19:0/3964151297 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47000f620 con 0x7fa488104f80 2024-09-19T08:52:57.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.096+0000 7fa48d4d0640 1 -- 172.21.15.19:0/3964151297 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4881a2370 con 0x7fa488104f80 2024-09-19T08:52:57.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.098+0000 7fa484ff9640 1 -- 172.21.15.19:0/3964151297 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7fa47001a070 con 0x7fa488104f80 2024-09-19T08:52:57.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.099+0000 7fa484ff9640 1 --2- 172.21.15.19:0/3964151297 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa4740a3390 0x7fa4740a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:57.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.099+0000 7fa484ff9640 1 -- 172.21.15.19:0/3964151297 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa4700cf5f0 con 0x7fa488104f80 2024-09-19T08:52:57.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.099+0000 7fa486ffd640 1 --2- 172.21.15.19:0/3964151297 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa4740a3390 0x7fa4740a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:57.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.099+0000 7fa490269740 1 Processor -- start 2024-09-19T08:52:57.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.099+0000 7fa490269740 1 -- start start 2024-09-19T08:52:57.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.100+0000 7fa486ffd640 1 --2- 172.21.15.19:0/3964151297 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa4740a3390 0x7fa4740a5850 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa478009b60 tx=0x7fa478005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:57.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.100+0000 7fa490269740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfafc459a0 0x55dfafc45da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:57.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.100+0000 7fa490269740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dfafc462e0 0x55dfafc4ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:57.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.100+0000 7fa490269740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dfafc4b370 0x55dfafc4d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:57.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.100+0000 7fa490269740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55dfafba92f0 con 0x55dfafc462e0 2024-09-19T08:52:57.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.100+0000 7fa490269740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55dfafb51270 con 0x55dfafc459a0 2024-09-19T08:52:57.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.100+0000 7fa490269740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55dfafba52b0 con 0x55dfafc4b370 2024-09-19T08:52:57.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.100+0000 7fa47ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dfafc462e0 0x55dfafc4ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:57.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.100+0000 7fa47ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dfafc462e0 0x55dfafc4ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51998/0 (socket says 172.21.15.19:51998) 2024-09-19T08:52:57.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.100+0000 7fa47ffff640 1 -- 172.21.15.19:0/3509741074 learned_addr learned my addr 172.21.15.19:0/3509741074 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:57.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.100+0000 7fa4877fe640 1 --2- 172.21.15.19:0/3509741074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dfafc4b370 0x55dfafc4d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:57.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.100+0000 7fa486ffd640 1 --2- 172.21.15.19:0/3509741074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfafc459a0 0x55dfafc45da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:57.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.100+0000 7fa47ffff640 1 -- 172.21.15.19:0/3509741074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dfafc4b370 msgr2=0x55dfafc4d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:57.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.100+0000 7fa47ffff640 1 --2- 172.21.15.19:0/3509741074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dfafc4b370 0x55dfafc4d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.100+0000 7fa47ffff640 1 -- 172.21.15.19:0/3509741074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfafc459a0 msgr2=0x55dfafc45da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:57.103 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.100+0000 7fa47ffff640 1 --2- 172.21.15.19:0/3509741074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfafc459a0 0x55dfafc45da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.103 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.100+0000 7fa47ffff640 1 -- 172.21.15.19:0/3509741074 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfafb50340 con 0x55dfafc462e0 2024-09-19T08:52:57.103 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.100+0000 7fa47ffff640 1 --2- 172.21.15.19:0/3509741074 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dfafc462e0 0x55dfafc4ada0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa470000c00 tx=0x7fa47009c280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33850c12f9a3eea3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:57.103 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.101+0000 7fa47d7fa640 1 -- 172.21.15.19:0/3509741074 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa470021050 con 0x55dfafc462e0 2024-09-19T08:52:57.103 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.101+0000 7fa47d7fa640 1 -- 172.21.15.19:0/3509741074 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4700a4730 con 0x55dfafc462e0 2024-09-19T08:52:57.103 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.101+0000 7fa47d7fa640 1 -- 172.21.15.19:0/3509741074 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47009b170 con 0x55dfafc462e0 2024-09-19T08:52:57.107 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.102+0000 7fa490269740 1 -- 172.21.15.19:0/3509741074 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dfafc462e0 msgr2=0x55dfafc4ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:57.107 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.102+0000 7fa490269740 1 --2- 172.21.15.19:0/3509741074 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dfafc462e0 0x55dfafc4ada0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa470000c00 tx=0x7fa47009c280 comp rx=0 tx=0).stop 2024-09-19T08:52:57.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.102+0000 7fa490269740 1 -- 172.21.15.19:0/3509741074 shutdown_connections 2024-09-19T08:52:57.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.102+0000 7fa490269740 1 --2- 172.21.15.19:0/3509741074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dfafc4b370 0x55dfafc4d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.102+0000 7fa490269740 1 --2- 172.21.15.19:0/3509741074 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dfafc462e0 0x55dfafc4ada0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.102+0000 7fa490269740 1 --2- 172.21.15.19:0/3509741074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfafc459a0 0x55dfafc45da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.102+0000 7fa490269740 1 -- 172.21.15.19:0/3509741074 >> 172.21.15.19:0/3509741074 conn(0x55dfafc41010 msgr2=0x55dfafc41410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:57.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.102+0000 7fa490269740 1 -- 172.21.15.19:0/3509741074 shutdown_connections 2024-09-19T08:52:57.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.102+0000 7fa490269740 1 -- 172.21.15.19:0/3509741074 wait complete. 2024-09-19T08:52:57.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.102+0000 7fa490269740 1 -- start start 2024-09-19T08:52:57.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.102+0000 7fa490269740 1 Processor -- start 2024-09-19T08:52:57.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.103+0000 7fa490269740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dfafc459a0 0x55dfafc4fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:57.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.103+0000 7fa490269740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfafc462e0 0x55dfafc500b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:57.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.103+0000 7fa490269740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dfafc4b370 0x55dfafc570f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:57.109 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.103+0000 7fa490269740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55dfafc4e2e0 con 0x55dfafc459a0 2024-09-19T08:52:57.109 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.103+0000 7fa490269740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55dfafb32290 con 0x55dfafc462e0 2024-09-19T08:52:57.109 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.103+0000 7fa490269740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55dfafc4e460 con 0x55dfafc4b370 2024-09-19T08:52:57.109 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.103+0000 7fa490269740 10 client.0 _ll_register_callbacks cb 0x55dfafb63140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:57.109 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.103+0000 7fa486ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dfafc459a0 0x55dfafc4fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:57.109 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.103+0000 7fa486ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dfafc459a0 0x55dfafc4fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52014/0 (socket says 172.21.15.19:52014) 2024-09-19T08:52:57.109 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.103+0000 7fa486ffd640 1 -- 172.21.15.19:0/3649277829 learned_addr learned my addr 172.21.15.19:0/3649277829 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:57.109 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.103+0000 7fa4877fe640 1 --2- 172.21.15.19:0/3649277829 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dfafc4b370 0x55dfafc570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:57.109 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.103+0000 7fa47ffff640 1 --2- 172.21.15.19:0/3649277829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfafc462e0 0x55dfafc500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:57.109 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.103+0000 7fa486ffd640 1 -- 172.21.15.19:0/3649277829 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dfafc4b370 msgr2=0x55dfafc570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:57.109 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.103+0000 7fa486ffd640 1 --2- 172.21.15.19:0/3649277829 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dfafc4b370 0x55dfafc570f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.109 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.103+0000 7fa486ffd640 1 -- 172.21.15.19:0/3649277829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfafc462e0 msgr2=0x55dfafc500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:57.109 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.103+0000 7fa486ffd640 1 --2- 172.21.15.19:0/3649277829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfafc462e0 0x55dfafc500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.110 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.103+0000 7fa486ffd640 1 -- 172.21.15.19:0/3649277829 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfaf8bc210 con 0x55dfafc459a0 2024-09-19T08:52:57.110 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.103+0000 7fa47ffff640 1 --2- 172.21.15.19:0/3649277829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfafc462e0 0x55dfafc500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:57.110 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.104+0000 7fa486ffd640 1 --2- 172.21.15.19:0/3649277829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dfafc459a0 0x55dfafc4fb70 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fa478012c40 tx=0x7fa478004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21b4e8b4516005e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:57.110 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.104+0000 7fa46e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:52:57.110 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.104+0000 7fa46e7fc640 1 -- 172.21.15.19:0/3649277829 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa47801fe90 con 0x55dfafc459a0 2024-09-19T08:52:57.110 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.104+0000 7fa46e7fc640 1 -- 172.21.15.19:0/3649277829 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa478011c90 con 0x55dfafc459a0 2024-09-19T08:52:57.110 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.104+0000 7fa490269740 1 -- 172.21.15.19:0/3649277829 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4700a4730 con 0x55dfafc459a0 2024-09-19T08:52:57.110 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.104+0000 7fa46e7fc640 1 -- 172.21.15.19:0/3649277829 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa478011e90 con 0x55dfafc459a0 2024-09-19T08:52:57.110 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.104+0000 7fa490269740 10 client.15549 fetch_fsmap learned FSMap version 28 2024-09-19T08:52:57.110 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.104+0000 7fa490269740 1 -- 172.21.15.19:0/3649277829 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dfaf988620 con 0x55dfafc459a0 2024-09-19T08:52:57.110 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.104+0000 7fa46e7fc640 1 -- 172.21.15.19:0/3649277829 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa4700a4730 con 0x55dfafc459a0 2024-09-19T08:52:57.110 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.104+0000 7fa46e7fc640 1 -- 172.21.15.19:0/3649277829 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa478029470 con 0x55dfafc459a0 2024-09-19T08:52:57.110 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.105+0000 7fa490269740 10 client.15549 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:52:57.110 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.105+0000 7fa490269740 10 client.15549 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:57.111 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.105+0000 7fa490269740 20 client.15549 populate_metadata read hostname 'smithi019' 2024-09-19T08:52:57.111 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.105+0000 7fa490269740 1 --2- 172.21.15.19:0/3649277829 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55dfafc5b890 0x55dfafc5dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:57.111 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.105+0000 7fa490269740 4 client.15549 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:57.111 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.105+0000 7fa490269740 1 -- 172.21.15.19:0/3649277829 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dfafbb6a20 con 0x55dfafc5b890 2024-09-19T08:52:57.111 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.105+0000 7fa47ffff640 1 --2- 172.21.15.19:0/3649277829 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55dfafc5b890 0x55dfafc5dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:57.111 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.105+0000 7fa46e7fc640 10 client.15549 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:52:57.111 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.105+0000 7fa47ffff640 1 --2- 172.21.15.19:0/3649277829 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55dfafc5b890 0x55dfafc5dce0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=191e63cbcfda9863 server_cookie=123137e171d2dfff in_seq=0 out_seq=0 2024-09-19T08:52:57.111 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.106+0000 7fa46e7fc640 1 -- 172.21.15.19:0/3649277829 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dfafbb6a20 con 0x55dfafc5b890 2024-09-19T08:52:57.111 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.106+0000 7fa46e7fc640 10 client.15549 handle_command_reply: tid=0 2024-09-19T08:52:57.111 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.106+0000 7fa490269740 1 client.15549 shutdown 2024-09-19T08:52:57.111 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.106+0000 7fa490269740 1 -- 172.21.15.19:0/3649277829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dfafc459a0 msgr2=0x55dfafc4fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:57.111 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.106+0000 7fa490269740 1 --2- 172.21.15.19:0/3649277829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dfafc459a0 0x55dfafc4fb70 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fa478012c40 tx=0x7fa478004730 comp rx=0 tx=0).stop 2024-09-19T08:52:57.111 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.106+0000 7fa490269740 1 -- 172.21.15.19:0/3649277829 shutdown_connections 2024-09-19T08:52:57.111 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.106+0000 7fa490269740 1 --2- 172.21.15.19:0/3649277829 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55dfafc5b890 0x55dfafc5dce0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.112 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.106+0000 7fa490269740 1 --2- 172.21.15.19:0/3649277829 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dfafc4b370 0x55dfafc570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.112 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.106+0000 7fa490269740 1 --2- 172.21.15.19:0/3649277829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfafc462e0 0x55dfafc500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.112 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.106+0000 7fa490269740 1 --2- 172.21.15.19:0/3649277829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dfafc459a0 0x55dfafc4fb70 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.112 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.106+0000 7fa490269740 1 -- 172.21.15.19:0/3649277829 >> 172.21.15.19:0/3649277829 conn(0x55dfafc41010 msgr2=0x55dfafc42820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:57.112 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.106+0000 7fa46e7fc640 0 client.15549 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:52:57.112 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.107+0000 7fa490269740 1 -- 172.21.15.19:0/3649277829 shutdown_connections 2024-09-19T08:52:57.112 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.107+0000 7fa490269740 1 -- 172.21.15.19:0/3649277829 wait complete. 2024-09-19T08:52:57.112 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.107+0000 7fa490269740 20 client.15549 trim_cache size 0 max 16384 2024-09-19T08:52:57.122 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.122+0000 7fa490269740 1 Processor -- start 2024-09-19T08:52:57.122 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.122+0000 7fa490269740 1 -- start start 2024-09-19T08:52:57.124 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.123+0000 7fa490269740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dfafc459a0 0x55dfafc400b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:57.124 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.123+0000 7fa490269740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dfafc462e0 0x55dfafc570b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:57.124 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.123+0000 7fa490269740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfafc4b370 0x55dfafc42400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:57.124 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.123+0000 7fa490269740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa4881ab3f0 con 0x55dfafc459a0 2024-09-19T08:52:57.124 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.123+0000 7fa490269740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa4881acf30 con 0x55dfafc4b370 2024-09-19T08:52:57.124 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.123+0000 7fa490269740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa4881abac0 con 0x55dfafc462e0 2024-09-19T08:52:57.125 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.123+0000 7fa486ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dfafc459a0 0x55dfafc400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:57.125 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.123+0000 7fa486ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dfafc459a0 0x55dfafc400b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52030/0 (socket says 172.21.15.19:52030) 2024-09-19T08:52:57.125 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.123+0000 7fa486ffd640 1 -- 172.21.15.19:0/241810149 learned_addr learned my addr 172.21.15.19:0/241810149 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:57.125 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.123+0000 7fa4877fe640 1 --2- 172.21.15.19:0/241810149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfafc4b370 0x55dfafc42400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:57.125 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.123+0000 7fa47ffff640 1 --2- 172.21.15.19:0/241810149 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dfafc462e0 0x55dfafc570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:57.125 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.123+0000 7fa486ffd640 1 -- 172.21.15.19:0/241810149 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dfafc462e0 msgr2=0x55dfafc570b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:57.125 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.123+0000 7fa486ffd640 1 --2- 172.21.15.19:0/241810149 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dfafc462e0 0x55dfafc570b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.125 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.123+0000 7fa486ffd640 1 -- 172.21.15.19:0/241810149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfafc4b370 msgr2=0x55dfafc42400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:57.125 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.123+0000 7fa486ffd640 1 --2- 172.21.15.19:0/241810149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfafc4b370 0x55dfafc42400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.125 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.123+0000 7fa486ffd640 1 -- 172.21.15.19:0/241810149 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dfafc4f6b0 con 0x55dfafc459a0 2024-09-19T08:52:57.125 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.123+0000 7fa47ffff640 1 --2- 172.21.15.19:0/241810149 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dfafc462e0 0x55dfafc570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:57.125 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.123+0000 7fa486ffd640 1 --2- 172.21.15.19:0/241810149 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dfafc459a0 0x55dfafc400b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa478029890 tx=0x7fa478009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab1f5061fd321f0c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:57.125 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.124+0000 7fa47cff9640 1 -- 172.21.15.19:0/241810149 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa478011c90 con 0x55dfafc459a0 2024-09-19T08:52:57.126 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.124+0000 7fa47cff9640 1 -- 172.21.15.19:0/241810149 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa478011e30 con 0x55dfafc459a0 2024-09-19T08:52:57.126 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.124+0000 7fa47cff9640 1 -- 172.21.15.19:0/241810149 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa478034b90 con 0x55dfafc459a0 2024-09-19T08:52:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.124+0000 7fa490269740 1 -- 172.21.15.19:0/241810149 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dfafc459a0 msgr2=0x55dfafc400b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.124+0000 7fa490269740 1 --2- 172.21.15.19:0/241810149 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dfafc459a0 0x55dfafc400b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fa478029890 tx=0x7fa478009300 comp rx=0 tx=0).stop 2024-09-19T08:52:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.125+0000 7fa490269740 1 -- 172.21.15.19:0/241810149 shutdown_connections 2024-09-19T08:52:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.125+0000 7fa490269740 1 --2- 172.21.15.19:0/241810149 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dfafc462e0 0x55dfafc570b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.125+0000 7fa490269740 1 --2- 172.21.15.19:0/241810149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfafc4b370 0x55dfafc42400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.125+0000 7fa490269740 1 --2- 172.21.15.19:0/241810149 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dfafc459a0 0x55dfafc400b0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.125+0000 7fa490269740 1 -- 172.21.15.19:0/241810149 >> 172.21.15.19:0/241810149 conn(0x55dfafc41010 msgr2=0x55dfafc3f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:57.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.125+0000 7fa490269740 1 -- 172.21.15.19:0/241810149 shutdown_connections 2024-09-19T08:52:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.125+0000 7fa490269740 1 -- 172.21.15.19:0/241810149 wait complete. 2024-09-19T08:52:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.125+0000 7fa490269740 1 -- start start 2024-09-19T08:52:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.125+0000 7fa490269740 1 Processor -- start 2024-09-19T08:52:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.125+0000 7fa490269740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dfafc459a0 0x55dfafc54570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.125+0000 7fa490269740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dfafc462e0 0x55dfafc54ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.125+0000 7fa490269740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfafc4b370 0x55dfafc55a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.126+0000 7fa490269740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa4881ac860 con 0x55dfafc462e0 2024-09-19T08:52:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.126+0000 7fa490269740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa4881ac190 con 0x55dfafc4b370 2024-09-19T08:52:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.126+0000 7fa47ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dfafc462e0 0x55dfafc54ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.126+0000 7fa490269740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa4881a93d0 con 0x55dfafc459a0 2024-09-19T08:52:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.126+0000 7fa47ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dfafc462e0 0x55dfafc54ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52036/0 (socket says 172.21.15.19:52036) 2024-09-19T08:52:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.126+0000 7fa47ffff640 1 -- 172.21.15.19:0/2951082795 learned_addr learned my addr 172.21.15.19:0/2951082795 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:57.130 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.126+0000 7fa490269740 10 client.0 _ll_register_callbacks cb 0x7fa478011be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.126+0000 7fa486ffd640 1 --2- 172.21.15.19:0/2951082795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dfafc459a0 0x55dfafc54570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.126+0000 7fa4877fe640 1 --2- 172.21.15.19:0/2951082795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfafc4b370 0x55dfafc55a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.126+0000 7fa47ffff640 1 -- 172.21.15.19:0/2951082795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dfafc459a0 msgr2=0x55dfafc54570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.126+0000 7fa47ffff640 1 --2- 172.21.15.19:0/2951082795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dfafc459a0 0x55dfafc54570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.126+0000 7fa47ffff640 1 -- 172.21.15.19:0/2951082795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfafc4b370 msgr2=0x55dfafc55a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.126+0000 7fa47ffff640 1 --2- 172.21.15.19:0/2951082795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfafc4b370 0x55dfafc55a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.126+0000 7fa47ffff640 1 -- 172.21.15.19:0/2951082795 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dfafc56080 con 0x55dfafc462e0 2024-09-19T08:52:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.126+0000 7fa4877fe640 1 --2- 172.21.15.19:0/2951082795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfafc4b370 0x55dfafc55a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.126+0000 7fa47ffff640 1 --2- 172.21.15.19:0/2951082795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dfafc462e0 0x55dfafc54ab0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fa47000d740 tx=0x7fa47009fff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a512c8ae5450f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.126+0000 7fa46e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:52:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.126+0000 7fa46e7fc640 1 -- 172.21.15.19:0/2951082795 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa470014040 con 0x55dfafc462e0 2024-09-19T08:52:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.126+0000 7fa46e7fc640 1 -- 172.21.15.19:0/2951082795 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa4700cd200 con 0x55dfafc462e0 2024-09-19T08:52:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.126+0000 7fa490269740 1 -- 172.21.15.19:0/2951082795 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa478011e30 con 0x55dfafc462e0 2024-09-19T08:52:57.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.127+0000 7fa46e7fc640 1 -- 172.21.15.19:0/2951082795 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa470021040 con 0x55dfafc462e0 2024-09-19T08:52:57.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.127+0000 7fa490269740 10 client.15555 fetch_fsmap learned FSMap version 28 2024-09-19T08:52:57.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.127+0000 7fa490269740 1 -- 172.21.15.19:0/2951082795 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55dfafc57400 con 0x55dfafc462e0 2024-09-19T08:52:57.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.127+0000 7fa46e7fc640 1 -- 172.21.15.19:0/2951082795 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa478011e30 con 0x55dfafc462e0 2024-09-19T08:52:57.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.127+0000 7fa46e7fc640 1 -- 172.21.15.19:0/2951082795 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fa4700ba270 con 0x55dfafc462e0 2024-09-19T08:52:57.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.127+0000 7fa490269740 10 client.15555 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:52:57.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.127+0000 7fa490269740 10 client.15555 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:52:57.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.127+0000 7fa490269740 20 client.15555 populate_metadata read hostname 'smithi019' 2024-09-19T08:52:57.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.127+0000 7fa490269740 1 --2- 172.21.15.19:0/2951082795 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55dfafcc67f0 0x55dfafcc8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:57.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.127+0000 7fa490269740 4 client.15555 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:52:57.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.127+0000 7fa490269740 1 -- 172.21.15.19:0/2951082795 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dfafbb0d70 con 0x55dfafcc67f0 2024-09-19T08:52:57.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.127+0000 7fa486ffd640 1 --2- 172.21.15.19:0/2951082795 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55dfafcc67f0 0x55dfafcc8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:57.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.128+0000 7fa46e7fc640 10 client.15555 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:52:57.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.128+0000 7fa486ffd640 1 --2- 172.21.15.19:0/2951082795 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55dfafcc67f0 0x55dfafcc8be0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ac9af36d2f7e328 server_cookie=bd913b649d62a9d6 in_seq=0 out_seq=0 2024-09-19T08:52:57.134 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.131+0000 7fa46e7fc640 1 -- 172.21.15.19:0/2951082795 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dfafbb0d70 con 0x55dfafcc67f0 2024-09-19T08:52:57.134 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.131+0000 7fa46e7fc640 10 client.15555 handle_command_reply: tid=0 2024-09-19T08:52:57.134 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.131+0000 7fa490269740 1 client.15555 shutdown 2024-09-19T08:52:57.134 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.131+0000 7fa490269740 1 -- 172.21.15.19:0/2951082795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dfafc462e0 msgr2=0x55dfafc54ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:57.134 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.131+0000 7fa490269740 1 --2- 172.21.15.19:0/2951082795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dfafc462e0 0x55dfafc54ab0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fa47000d740 tx=0x7fa47009fff0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.134 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.132+0000 7fa490269740 1 -- 172.21.15.19:0/2951082795 shutdown_connections 2024-09-19T08:52:57.134 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.132+0000 7fa490269740 1 --2- 172.21.15.19:0/2951082795 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55dfafcc67f0 0x55dfafcc8be0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.134 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.132+0000 7fa46e7fc640 0 client.15555 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:52:57.134 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.132+0000 7fa490269740 1 --2- 172.21.15.19:0/2951082795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dfafc4b370 0x55dfafc55a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.134 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.132+0000 7fa490269740 1 --2- 172.21.15.19:0/2951082795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dfafc462e0 0x55dfafc54ab0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.134 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.132+0000 7fa490269740 1 --2- 172.21.15.19:0/2951082795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dfafc459a0 0x55dfafc54570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.135 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.132+0000 7fa490269740 1 -- 172.21.15.19:0/2951082795 >> 172.21.15.19:0/2951082795 conn(0x55dfafc41010 msgr2=0x55dfafc401c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:57.135 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.132+0000 7fa490269740 1 -- 172.21.15.19:0/2951082795 shutdown_connections 2024-09-19T08:52:57.135 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.132+0000 7fa490269740 1 -- 172.21.15.19:0/2951082795 wait complete. 2024-09-19T08:52:57.135 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.132+0000 7fa490269740 20 client.15555 trim_cache size 0 max 16384 2024-09-19T08:52:57.135 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T08:52:57.135 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T08:52:57.135 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T08:52:57.135 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T08:52:57.136 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.132+0000 7fa48d4d0640 1 -- 172.21.15.19:0/3964151297 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa4740a3390 msgr2=0x7fa4740a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:57.136 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.132+0000 7fa48d4d0640 1 --2- 172.21.15.19:0/3964151297 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa4740a3390 0x7fa4740a5850 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa478009b60 tx=0x7fa478005f90 comp rx=0 tx=0).stop 2024-09-19T08:52:57.136 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.132+0000 7fa48d4d0640 1 -- 172.21.15.19:0/3964151297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa488104f80 msgr2=0x7fa488100600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:57.136 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.132+0000 7fa48d4d0640 1 --2- 172.21.15.19:0/3964151297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa488104f80 0x7fa488100600 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa47000d770 tx=0x7fa47000dc30 comp rx=0 tx=0).stop 2024-09-19T08:52:57.137 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.132+0000 7fa48d4d0640 1 -- 172.21.15.19:0/3964151297 shutdown_connections 2024-09-19T08:52:57.137 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.133+0000 7fa48d4d0640 1 --2- 172.21.15.19:0/3964151297 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa4740a3390 0x7fa4740a5850 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.137 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.133+0000 7fa48d4d0640 1 --2- 172.21.15.19:0/3964151297 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa4881078b0 0x7fa488100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.137 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.133+0000 7fa48d4d0640 1 --2- 172.21.15.19:0/3964151297 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa488104f80 0x7fa488100600 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.137 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.133+0000 7fa48d4d0640 1 --2- 172.21.15.19:0/3964151297 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa488102650 0x7fa488101fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.137 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.133+0000 7fa48d4d0640 1 -- 172.21.15.19:0/3964151297 >> 172.21.15.19:0/3964151297 conn(0x7fa4880fc1b0 msgr2=0x7fa488102ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:57.137 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.133+0000 7fa48d4d0640 1 -- 172.21.15.19:0/3964151297 shutdown_connections 2024-09-19T08:52:57.137 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:52:57.133+0000 7fa48d4d0640 1 -- 172.21.15.19:0/3964151297 wait complete. 2024-09-19T08:52:57.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.136+0000 7f7b0b0be640 1 -- 172.21.15.19:0/3171766928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b041027a0 msgr2=0x7f7b041067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:57.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.136+0000 7f7b0b0be640 1 --2- 172.21.15.19:0/3171766928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b041027a0 0x7f7b041067f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7af0009900 tx=0x7f7af002a410 comp rx=0 tx=0).stop 2024-09-19T08:52:57.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.137+0000 7f7b0b0be640 1 -- 172.21.15.19:0/3171766928 shutdown_connections 2024-09-19T08:52:57.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.137+0000 7f7b0b0be640 1 --2- 172.21.15.19:0/3171766928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b04106f20 0x7f7b0410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.137+0000 7f7b0b0be640 1 --2- 172.21.15.19:0/3171766928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b041027a0 0x7f7b041067f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.137+0000 7f7b0b0be640 1 --2- 172.21.15.19:0/3171766928 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b04101df0 0x7f7b041021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.137+0000 7f7b0b0be640 1 -- 172.21.15.19:0/3171766928 >> 172.21.15.19:0/3171766928 conn(0x7f7b040fd8f0 msgr2=0x7f7b040ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:57.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.137+0000 7f7b0b0be640 1 -- 172.21.15.19:0/3171766928 shutdown_connections 2024-09-19T08:52:57.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.137+0000 7f7b0b0be640 1 -- 172.21.15.19:0/3171766928 wait complete. 2024-09-19T08:52:57.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.138+0000 7f7b0b0be640 1 Processor -- start 2024-09-19T08:52:57.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.138+0000 7f7b0b0be640 1 -- start start 2024-09-19T08:52:57.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.138+0000 7f7b0b0be640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b04101df0 0x7f7b04198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:57.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.138+0000 7f7b0b0be640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b041027a0 0x7f7b041989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:57.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.138+0000 7f7b0b0be640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b04106f20 0x7f7b0419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:57.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.138+0000 7f7b0b0be640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7b04111f80 con 0x7f7b04106f20 2024-09-19T08:52:57.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.139+0000 7f7b0965b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b04106f20 0x7f7b0419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:57.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.139+0000 7f7b0965b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b04106f20 0x7f7b0419cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52052/0 (socket says 172.21.15.19:52052) 2024-09-19T08:52:57.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.139+0000 7f7b0965b640 1 -- 172.21.15.19:0/1152274162 learned_addr learned my addr 172.21.15.19:0/1152274162 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:57.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.139+0000 7f7b03fff640 1 --2- 172.21.15.19:0/1152274162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b041027a0 0x7f7b041989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:57.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.139+0000 7f7b08e5a640 1 --2- 172.21.15.19:0/1152274162 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b04101df0 0x7f7b04198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:57.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.139+0000 7f7b0b0be640 1 -- 172.21.15.19:0/1152274162 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7b04111e00 con 0x7f7b04101df0 2024-09-19T08:52:57.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.139+0000 7f7b0b0be640 1 -- 172.21.15.19:0/1152274162 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7b04112100 con 0x7f7b041027a0 2024-09-19T08:52:57.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.139+0000 7f7b0965b640 1 -- 172.21.15.19:0/1152274162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b041027a0 msgr2=0x7f7b041989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:57.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.139+0000 7f7b0965b640 1 --2- 172.21.15.19:0/1152274162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b041027a0 0x7f7b041989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.139+0000 7f7b0965b640 1 -- 172.21.15.19:0/1152274162 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b04101df0 msgr2=0x7f7b04198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:57.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.139+0000 7f7b0965b640 1 --2- 172.21.15.19:0/1152274162 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b04101df0 0x7f7b04198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.139+0000 7f7b0965b640 1 -- 172.21.15.19:0/1152274162 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b0419d430 con 0x7f7b04106f20 2024-09-19T08:52:57.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.140+0000 7f7b0965b640 1 --2- 172.21.15.19:0/1152274162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b04106f20 0x7f7b0419cd30 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7afc00eaa0 tx=0x7f7afc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:57.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.140+0000 7f7b01ffb640 1 -- 172.21.15.19:0/1152274162 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7afc00cdb0 con 0x7f7b04106f20 2024-09-19T08:52:57.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.140+0000 7f7b01ffb640 1 -- 172.21.15.19:0/1152274162 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7afc005020 con 0x7f7b04106f20 2024-09-19T08:52:57.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.140+0000 7f7b0b0be640 1 -- 172.21.15.19:0/1152274162 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b0419d720 con 0x7f7b04106f20 2024-09-19T08:52:57.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.140+0000 7f7b01ffb640 1 -- 172.21.15.19:0/1152274162 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7afc0116b0 con 0x7f7b04106f20 2024-09-19T08:52:57.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.140+0000 7f7b0b0be640 1 -- 172.21.15.19:0/1152274162 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b04074420 con 0x7f7b04106f20 2024-09-19T08:52:57.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.144+0000 7f7b0d497740 1 Processor -- start 2024-09-19T08:52:57.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.144+0000 7f7b01ffb640 1 -- 172.21.15.19:0/1152274162 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f7afc005560 con 0x7f7b04106f20 2024-09-19T08:52:57.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.144+0000 7f7b0d497740 1 -- start start 2024-09-19T08:52:57.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.144+0000 7f7b0d497740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55913739cb40 0x55913739b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:57.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.144+0000 7f7b0d497740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55913739b5d0 0x55913739ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:57.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.144+0000 7f7b0d497740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591373a6370 0x5591373a8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:57.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.144+0000 7f7b0d497740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5591373012f0 con 0x55913739cb40 2024-09-19T08:52:57.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.144+0000 7f7b0d497740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5591372a8cf0 con 0x55913739b5d0 2024-09-19T08:52:57.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.144+0000 7f7b0d497740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5591372fd2b0 con 0x5591373a6370 2024-09-19T08:52:57.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.145+0000 7f7b08e5a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55913739b5d0 0x55913739ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:57.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.145+0000 7f7b08e5a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55913739b5d0 0x55913739ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:53788/0 (socket says 172.21.15.19:53788) 2024-09-19T08:52:57.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.145+0000 7f7b08e5a640 1 -- 172.21.15.19:0/2775471205 learned_addr learned my addr 172.21.15.19:0/2775471205 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:57.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.145+0000 7f7b08e5a640 1 -- 172.21.15.19:0/2775471205 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591373a6370 msgr2=0x5591373a8760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T08:52:57.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.145+0000 7f7b08e5a640 1 --2- 172.21.15.19:0/2775471205 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591373a6370 0x5591373a8760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.145+0000 7f7b08e5a640 1 -- 172.21.15.19:0/2775471205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55913739cb40 msgr2=0x55913739b090 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T08:52:57.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.145+0000 7f7b01ffb640 1 --2- 172.21.15.19:0/1152274162 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7af40a32d0 0x7f7af40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:57.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.145+0000 7f7b03fff640 1 --2- 172.21.15.19:0/2775471205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55913739cb40 0x55913739b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:57.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.145+0000 7f7b08e5a640 1 --2- 172.21.15.19:0/2775471205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55913739cb40 0x55913739b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.145+0000 7f7b08e5a640 1 -- 172.21.15.19:0/2775471205 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55913728d3a0 con 0x55913739b5d0 2024-09-19T08:52:57.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.145+0000 7f7b03fff640 1 --2- 172.21.15.19:0/2775471205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55913739cb40 0x55913739b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:57.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.146+0000 7f7b01ffb640 1 -- 172.21.15.19:0/1152274162 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7afc0cfbd0 con 0x7f7b04106f20 2024-09-19T08:52:57.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.146+0000 7f7b03fff640 1 --2- 172.21.15.19:0/1152274162 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7af40a32d0 0x7f7af40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:57.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.146+0000 7f7b08e5a640 1 --2- 172.21.15.19:0/2775471205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55913739b5d0 0x55913739ba10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7af800b760 tx=0x7f7af800bc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4f626c184ffa35e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:57.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.146+0000 7f7aeeffd640 1 -- 172.21.15.19:0/2775471205 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af8003dd0 con 0x55913739b5d0 2024-09-19T08:52:57.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.147+0000 7f7aeeffd640 1 -- 172.21.15.19:0/2775471205 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7af8015070 con 0x55913739b5d0 2024-09-19T08:52:57.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.147+0000 7f7aeeffd640 1 -- 172.21.15.19:0/2775471205 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af8011440 con 0x55913739b5d0 2024-09-19T08:52:57.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.148+0000 7f7b0d497740 1 -- 172.21.15.19:0/2775471205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55913739b5d0 msgr2=0x55913739ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:57.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.148+0000 7f7b03fff640 1 --2- 172.21.15.19:0/1152274162 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7af40a32d0 0x7f7af40a5790 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7af0009230 tx=0x7f7af0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:57.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.148+0000 7f7b0d497740 1 --2- 172.21.15.19:0/2775471205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55913739b5d0 0x55913739ba10 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7af800b760 tx=0x7f7af800bc20 comp rx=0 tx=0).stop 2024-09-19T08:52:57.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.148+0000 7f7b0d497740 1 -- 172.21.15.19:0/2775471205 shutdown_connections 2024-09-19T08:52:57.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.148+0000 7f7b0d497740 1 --2- 172.21.15.19:0/2775471205 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591373a6370 0x5591373a8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.148+0000 7f7b0d497740 1 --2- 172.21.15.19:0/2775471205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55913739b5d0 0x55913739ba10 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.148+0000 7f7b0d497740 1 --2- 172.21.15.19:0/2775471205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55913739cb40 0x55913739b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.148+0000 7f7b0d497740 1 -- 172.21.15.19:0/2775471205 >> 172.21.15.19:0/2775471205 conn(0x559137364310 msgr2=0x559137397c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:57.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.148+0000 7f7b0d497740 1 -- 172.21.15.19:0/2775471205 shutdown_connections 2024-09-19T08:52:57.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.148+0000 7f7b0d497740 1 -- 172.21.15.19:0/2775471205 wait complete. 2024-09-19T08:52:57.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.148+0000 7f7b0d497740 1 -- start start 2024-09-19T08:52:57.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.149+0000 7f7b0d497740 1 Processor -- start 2024-09-19T08:52:57.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.149+0000 7f7b0d497740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55913739b5d0 0x5591373a5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:57.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.149+0000 7f7b0d497740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55913739cb40 0x5591373a2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:57.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.149+0000 7f7b0d497740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5591373a6370 0x5591373a35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:57.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.149+0000 7f7b0d497740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5591373a9070 con 0x5591373a6370 2024-09-19T08:52:57.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.149+0000 7f7b0d497740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5591372bc060 con 0x55913739cb40 2024-09-19T08:52:57.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.149+0000 7f7b0d497740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5591373a91f0 con 0x55913739b5d0 2024-09-19T08:52:57.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.149+0000 7f7b0d497740 10 client.0 _ll_register_callbacks cb 0x55913700f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:57.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.149+0000 7f7b08e5a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55913739b5d0 0x5591373a5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:57.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.149+0000 7f7b08e5a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55913739b5d0 0x5591373a5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:51946/0 (socket says 172.21.15.19:51946) 2024-09-19T08:52:57.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.149+0000 7f7b03fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55913739cb40 0x5591373a2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:57.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.149+0000 7f7b08e5a640 1 -- 172.21.15.19:0/1734790693 learned_addr learned my addr 172.21.15.19:0/1734790693 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:57.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.149+0000 7f7b0965b640 1 --2- 172.21.15.19:0/1734790693 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5591373a6370 0x5591373a35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:57.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.150+0000 7f7b08e5a640 1 -- 172.21.15.19:0/1734790693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55913739cb40 msgr2=0x5591373a2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:57.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.150+0000 7f7b08e5a640 1 --2- 172.21.15.19:0/1734790693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55913739cb40 0x5591373a2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.150+0000 7f7b08e5a640 1 -- 172.21.15.19:0/1734790693 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5591373a6370 msgr2=0x5591373a35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:57.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.150+0000 7f7b08e5a640 1 --2- 172.21.15.19:0/1734790693 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5591373a6370 0x5591373a35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.150+0000 7f7b08e5a640 1 -- 172.21.15.19:0/1734790693 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591370723c0 con 0x55913739b5d0 2024-09-19T08:52:57.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.150+0000 7f7b08e5a640 1 --2- 172.21.15.19:0/1734790693 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55913739b5d0 0x5591373a5d40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7af8004a70 tx=0x7f7af8003e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca9b94132dc1e6ce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:57.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.150+0000 7f7ae3fff640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T08:52:57.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.150+0000 7f7ae3fff640 1 -- 172.21.15.19:0/1734790693 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af8028060 con 0x55913739b5d0 2024-09-19T08:52:57.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.150+0000 7f7ae3fff640 1 -- 172.21.15.19:0/1734790693 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7af8004e80 con 0x55913739b5d0 2024-09-19T08:52:57.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.150+0000 7f7b0d497740 1 -- 172.21.15.19:0/1734790693 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7af8015070 con 0x55913739b5d0 2024-09-19T08:52:57.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.150+0000 7f7ae3fff640 1 -- 172.21.15.19:0/1734790693 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7af8005080 con 0x55913739b5d0 2024-09-19T08:52:57.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.150+0000 7f7b0d497740 10 client.25168 fetch_fsmap learned FSMap version 28 2024-09-19T08:52:57.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.150+0000 7f7b0d497740 1 -- 172.21.15.19:0/1734790693 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5591373b4a50 con 0x55913739b5d0 2024-09-19T08:52:57.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.151+0000 7f7ae3fff640 1 -- 172.21.15.19:0/1734790693 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7af8015070 con 0x55913739b5d0 2024-09-19T08:52:57.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.151+0000 7f7ae3fff640 1 -- 172.21.15.19:0/1734790693 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7af8022070 con 0x55913739b5d0 2024-09-19T08:52:57.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.151+0000 7f7b0d497740 10 client.25168 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:52:57.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.151+0000 7f7b0d497740 10 client.25168 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-19T08:52:57.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.151+0000 7f7b0d497740 20 client.25168 populate_metadata read hostname 'smithi019' 2024-09-19T08:52:57.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.151+0000 7f7b0d497740 1 --2- 172.21.15.19:0/1734790693 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x5591373b5da0 0x5591373b8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:57.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.151+0000 7f7b0d497740 4 client.25168 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:57.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.151+0000 7f7b0d497740 1 -- 172.21.15.19:0/1734790693 --> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55913730e860 con 0x5591373b5da0 2024-09-19T08:52:57.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.151+0000 7f7b03fff640 1 --2- 172.21.15.19:0/1734790693 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x5591373b5da0 0x5591373b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:57.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.152+0000 7f7ae3fff640 10 client.25168 ms_handle_connect on v2:172.21.15.155:6836/3381010945 2024-09-19T08:52:57.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.152+0000 7f7b03fff640 1 --2- 172.21.15.19:0/1734790693 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x5591373b5da0 0x5591373b8190 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e1d4cc1aabf848f1 server_cookie=79d0f36622f59454 in_seq=0 out_seq=0 2024-09-19T08:52:57.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.152+0000 7f7ae3fff640 1 -- 172.21.15.19:0/1734790693 <== mds.3 v2:172.21.15.155:6836/3381010945 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55913730e860 con 0x5591373b5da0 2024-09-19T08:52:57.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.152+0000 7f7ae3fff640 10 client.25168 handle_command_reply: tid=0 2024-09-19T08:52:57.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.153+0000 7f7b0d497740 1 client.25168 shutdown 2024-09-19T08:52:57.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.153+0000 7f7b0d497740 1 -- 172.21.15.19:0/1734790693 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55913739b5d0 msgr2=0x5591373a5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:57.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.153+0000 7f7b0d497740 1 --2- 172.21.15.19:0/1734790693 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55913739b5d0 0x5591373a5d40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7af8004a70 tx=0x7f7af8003e00 comp rx=0 tx=0).stop 2024-09-19T08:52:57.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.153+0000 7f7b0d497740 1 -- 172.21.15.19:0/1734790693 shutdown_connections 2024-09-19T08:52:57.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.153+0000 7f7b0d497740 1 --2- 172.21.15.19:0/1734790693 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x5591373b5da0 0x5591373b8190 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.153+0000 7f7b0d497740 1 --2- 172.21.15.19:0/1734790693 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5591373a6370 0x5591373a35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.153+0000 7f7b0d497740 1 --2- 172.21.15.19:0/1734790693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55913739cb40 0x5591373a2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.153+0000 7f7b0d497740 1 --2- 172.21.15.19:0/1734790693 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55913739b5d0 0x5591373a5d40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.153+0000 7f7ae3fff640 0 client.25168 ms_handle_reset on v2:172.21.15.155:6836/3381010945 2024-09-19T08:52:57.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.153+0000 7f7b0d497740 1 -- 172.21.15.19:0/1734790693 >> 172.21.15.19:0/1734790693 conn(0x559137364310 msgr2=0x55913739d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:57.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.153+0000 7f7b0d497740 1 -- 172.21.15.19:0/1734790693 shutdown_connections 2024-09-19T08:52:57.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.153+0000 7f7b0d497740 1 -- 172.21.15.19:0/1734790693 wait complete. 2024-09-19T08:52:57.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.153+0000 7f7b0d497740 20 client.25168 trim_cache size 0 max 16384 2024-09-19T08:52:57.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.167+0000 7f7b0d497740 1 Processor -- start 2024-09-19T08:52:57.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.167+0000 7f7b0d497740 1 -- start start 2024-09-19T08:52:57.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.167+0000 7f7b0d497740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55913739b5d0 0x5591373b2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:57.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.167+0000 7f7b0d497740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55913739cb40 0x559137392a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:57.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.167+0000 7f7b0d497740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591373a6370 0x55913739e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:57.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.167+0000 7f7b0d497740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7b041af790 con 0x55913739b5d0 2024-09-19T08:52:57.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.167+0000 7f7b0d497740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7b041b12d0 con 0x55913739cb40 2024-09-19T08:52:57.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.167+0000 7f7b0d497740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7b041afe60 con 0x5591373a6370 2024-09-19T08:52:57.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.168+0000 7f7b08e5a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55913739b5d0 0x5591373b2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:57.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.168+0000 7f7b08e5a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55913739b5d0 0x5591373b2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52074/0 (socket says 172.21.15.19:52074) 2024-09-19T08:52:57.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.168+0000 7f7b08e5a640 1 -- 172.21.15.19:0/410448853 learned_addr learned my addr 172.21.15.19:0/410448853 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:57.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.168+0000 7f7b0965b640 1 --2- 172.21.15.19:0/410448853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591373a6370 0x55913739e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:57.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.168+0000 7f7b03fff640 1 --2- 172.21.15.19:0/410448853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55913739cb40 0x559137392a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:57.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.168+0000 7f7b0965b640 1 -- 172.21.15.19:0/410448853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55913739cb40 msgr2=0x559137392a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:57.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.168+0000 7f7b0965b640 1 --2- 172.21.15.19:0/410448853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55913739cb40 0x559137392a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.168+0000 7f7b0965b640 1 -- 172.21.15.19:0/410448853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55913739b5d0 msgr2=0x5591373b2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:57.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.168+0000 7f7b0965b640 1 --2- 172.21.15.19:0/410448853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55913739b5d0 0x5591373b2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.168+0000 7f7b0965b640 1 -- 172.21.15.19:0/410448853 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559137398960 con 0x5591373a6370 2024-09-19T08:52:57.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.168+0000 7f7b0965b640 1 --2- 172.21.15.19:0/410448853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591373a6370 0x55913739e120 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7afc0cd590 tx=0x7f7afc0a0510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1a7b6942ceb464 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:57.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.169+0000 7f7aee7fc640 1 -- 172.21.15.19:0/410448853 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7afc01f040 con 0x5591373a6370 2024-09-19T08:52:57.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.169+0000 7f7aee7fc640 1 -- 172.21.15.19:0/410448853 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7afc0bc0c0 con 0x5591373a6370 2024-09-19T08:52:57.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.169+0000 7f7aee7fc640 1 -- 172.21.15.19:0/410448853 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7afc0cdba0 con 0x5591373a6370 2024-09-19T08:52:57.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.169+0000 7f7b0d497740 1 -- 172.21.15.19:0/410448853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591373a6370 msgr2=0x55913739e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:57.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.169+0000 7f7b0d497740 1 --2- 172.21.15.19:0/410448853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591373a6370 0x55913739e120 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7afc0cd590 tx=0x7f7afc0a0510 comp rx=0 tx=0).stop 2024-09-19T08:52:57.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.170+0000 7f7b0d497740 1 -- 172.21.15.19:0/410448853 shutdown_connections 2024-09-19T08:52:57.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.170+0000 7f7b0d497740 1 --2- 172.21.15.19:0/410448853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591373a6370 0x55913739e120 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.170+0000 7f7b0d497740 1 --2- 172.21.15.19:0/410448853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55913739cb40 0x559137392a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.170+0000 7f7b0d497740 1 --2- 172.21.15.19:0/410448853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55913739b5d0 0x5591373b2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.170+0000 7f7b0d497740 1 -- 172.21.15.19:0/410448853 >> 172.21.15.19:0/410448853 conn(0x559137364310 msgr2=0x5591373a2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:57.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.170+0000 7f7b0d497740 1 -- 172.21.15.19:0/410448853 shutdown_connections 2024-09-19T08:52:57.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.170+0000 7f7b0d497740 1 -- 172.21.15.19:0/410448853 wait complete. 2024-09-19T08:52:57.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.171+0000 7f7b0d497740 1 -- start start 2024-09-19T08:52:57.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.171+0000 7f7b0d497740 1 Processor -- start 2024-09-19T08:52:57.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.171+0000 7f7b0d497740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55913739b5d0 0x5591373ae660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:57.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.171+0000 7f7b0d497740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55913739cb40 0x5591373aeba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:57.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.171+0000 7f7b0d497740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5591373a6370 0x55913739f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:57.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.171+0000 7f7b0d497740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7b041b0c00 con 0x55913739cb40 2024-09-19T08:52:57.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.171+0000 7f7b0d497740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7b041b0530 con 0x5591373a6370 2024-09-19T08:52:57.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.171+0000 7f7b0d497740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7b041ad770 con 0x55913739b5d0 2024-09-19T08:52:57.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.171+0000 7f7b0d497740 10 client.0 _ll_register_callbacks cb 0x7f7af8004590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:57.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.171+0000 7f7b03fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55913739cb40 0x5591373aeba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:57.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.172+0000 7f7b03fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55913739cb40 0x5591373aeba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52084/0 (socket says 172.21.15.19:52084) 2024-09-19T08:52:57.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.172+0000 7f7b03fff640 1 -- 172.21.15.19:0/653771745 learned_addr learned my addr 172.21.15.19:0/653771745 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:57.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.172+0000 7f7b08e5a640 1 --2- 172.21.15.19:0/653771745 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55913739b5d0 0x5591373ae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:57.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.172+0000 7f7b0965b640 1 --2- 172.21.15.19:0/653771745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5591373a6370 0x55913739f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:57.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.172+0000 7f7b03fff640 1 -- 172.21.15.19:0/653771745 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55913739b5d0 msgr2=0x5591373ae660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:57.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.172+0000 7f7b03fff640 1 --2- 172.21.15.19:0/653771745 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55913739b5d0 0x5591373ae660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.172+0000 7f7b03fff640 1 -- 172.21.15.19:0/653771745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5591373a6370 msgr2=0x55913739f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:57.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.172+0000 7f7b03fff640 1 --2- 172.21.15.19:0/653771745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5591373a6370 0x55913739f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.172+0000 7f7b03fff640 1 -- 172.21.15.19:0/653771745 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591373a0050 con 0x55913739cb40 2024-09-19T08:52:57.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.172+0000 7f7b0965b640 1 --2- 172.21.15.19:0/653771745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5591373a6370 0x55913739f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:57.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.172+0000 7f7b08e5a640 1 --2- 172.21.15.19:0/653771745 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55913739b5d0 0x5591373ae660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:52:57.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.172+0000 7f7b03fff640 1 --2- 172.21.15.19:0/653771745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55913739cb40 0x5591373aeba0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7af002a930 tx=0x7f7af002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da024fda338b54c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:57.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.172+0000 7f7ae3fff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:52:57.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.173+0000 7f7ae3fff640 1 -- 172.21.15.19:0/653771745 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7af0035040 con 0x55913739cb40 2024-09-19T08:52:57.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.173+0000 7f7b0d497740 1 -- 172.21.15.19:0/653771745 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7afc0bc0c0 con 0x55913739cb40 2024-09-19T08:52:57.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.173+0000 7f7ae3fff640 1 -- 172.21.15.19:0/653771745 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7af0003a00 con 0x55913739cb40 2024-09-19T08:52:57.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.173+0000 7f7ae3fff640 1 -- 172.21.15.19:0/653771745 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7af00044e0 con 0x55913739cb40 2024-09-19T08:52:57.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.173+0000 7f7b0d497740 10 client.15570 fetch_fsmap learned FSMap version 28 2024-09-19T08:52:57.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.173+0000 7f7b0d497740 1 -- 172.21.15.19:0/653771745 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559137420230 con 0x55913739cb40 2024-09-19T08:52:57.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.173+0000 7f7ae3fff640 1 -- 172.21.15.19:0/653771745 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7afc0bc0c0 con 0x55913739cb40 2024-09-19T08:52:57.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.173+0000 7f7ae3fff640 1 -- 172.21.15.19:0/653771745 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7af005c470 con 0x55913739cb40 2024-09-19T08:52:57.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.173+0000 7f7b0d497740 10 client.15570 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:52:57.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.173+0000 7f7b0d497740 10 client.15570 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-19T08:52:57.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.173+0000 7f7b0d497740 20 client.15570 populate_metadata read hostname 'smithi019' 2024-09-19T08:52:57.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.173+0000 7f7b0d497740 1 --2- 172.21.15.19:0/653771745 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x559137420990 0x559137422db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:57.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.173+0000 7f7b0d497740 4 client.15570 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:52:57.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.173+0000 7f7b0d497740 1 -- 172.21.15.19:0/653771745 --> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559137308d70 con 0x559137420990 2024-09-19T08:52:57.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.174+0000 7f7b08e5a640 1 --2- 172.21.15.19:0/653771745 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x559137420990 0x559137422db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:57.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.174+0000 7f7ae3fff640 10 client.15570 ms_handle_connect on v2:172.21.15.155:6836/3381010945 2024-09-19T08:52:57.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.174+0000 7f7b08e5a640 1 --2- 172.21.15.19:0/653771745 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x559137420990 0x559137422db0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6292d627220989a1 server_cookie=a1c363c6be8c1dff in_seq=0 out_seq=0 2024-09-19T08:52:57.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.174+0000 7f7ae3fff640 1 -- 172.21.15.19:0/653771745 <== mds.3 v2:172.21.15.155:6836/3381010945 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559137308d70 con 0x559137420990 2024-09-19T08:52:57.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.174+0000 7f7ae3fff640 10 client.15570 handle_command_reply: tid=0 2024-09-19T08:52:57.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.174+0000 7f7b0d497740 1 client.15570 shutdown 2024-09-19T08:52:57.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.175+0000 7f7b0d497740 1 -- 172.21.15.19:0/653771745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55913739cb40 msgr2=0x5591373aeba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:57.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.175+0000 7f7b0d497740 1 --2- 172.21.15.19:0/653771745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55913739cb40 0x5591373aeba0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7af002a930 tx=0x7f7af002a410 comp rx=0 tx=0).stop 2024-09-19T08:52:57.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.175+0000 7f7b0d497740 1 -- 172.21.15.19:0/653771745 shutdown_connections 2024-09-19T08:52:57.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.175+0000 7f7b0d497740 1 --2- 172.21.15.19:0/653771745 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x559137420990 0x559137422db0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.175+0000 7f7b0d497740 1 --2- 172.21.15.19:0/653771745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5591373a6370 0x55913739f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.175+0000 7f7ae3fff640 0 client.15570 ms_handle_reset on v2:172.21.15.155:6836/3381010945 2024-09-19T08:52:57.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.175+0000 7f7b0d497740 1 --2- 172.21.15.19:0/653771745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55913739cb40 0x5591373aeba0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.175+0000 7f7b0d497740 1 --2- 172.21.15.19:0/653771745 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55913739b5d0 0x5591373ae660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.175+0000 7f7b0d497740 1 -- 172.21.15.19:0/653771745 >> 172.21.15.19:0/653771745 conn(0x559137364310 msgr2=0x5591373a2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:57.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.175+0000 7f7b0d497740 1 -- 172.21.15.19:0/653771745 shutdown_connections 2024-09-19T08:52:57.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.175+0000 7f7b0d497740 1 -- 172.21.15.19:0/653771745 wait complete. 2024-09-19T08:52:57.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.175+0000 7f7b0d497740 20 client.15570 trim_cache size 0 max 16384 2024-09-19T08:52:57.179 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T08:52:57.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.176+0000 7f7b0b0be640 1 -- 172.21.15.19:0/1152274162 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7af40a32d0 msgr2=0x7f7af40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:57.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.176+0000 7f7b0b0be640 1 --2- 172.21.15.19:0/1152274162 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7af40a32d0 0x7f7af40a5790 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7af0009230 tx=0x7f7af0009260 comp rx=0 tx=0).stop 2024-09-19T08:52:57.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.176+0000 7f7b0b0be640 1 -- 172.21.15.19:0/1152274162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b04106f20 msgr2=0x7f7b0419cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:57.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.176+0000 7f7b0b0be640 1 --2- 172.21.15.19:0/1152274162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b04106f20 0x7f7b0419cd30 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7afc00eaa0 tx=0x7f7afc00ef60 comp rx=0 tx=0).stop 2024-09-19T08:52:57.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.176+0000 7f7b0b0be640 1 -- 172.21.15.19:0/1152274162 shutdown_connections 2024-09-19T08:52:57.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.176+0000 7f7b0b0be640 1 --2- 172.21.15.19:0/1152274162 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7af40a32d0 0x7f7af40a5790 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.176+0000 7f7b0b0be640 1 --2- 172.21.15.19:0/1152274162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b041027a0 0x7f7b041989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.176+0000 7f7b0b0be640 1 --2- 172.21.15.19:0/1152274162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7b04106f20 0x7f7b0419cd30 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.176+0000 7f7b0b0be640 1 --2- 172.21.15.19:0/1152274162 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7b04101df0 0x7f7b04198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:57.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.176+0000 7f7b0b0be640 1 -- 172.21.15.19:0/1152274162 >> 172.21.15.19:0/1152274162 conn(0x7f7b040fd8f0 msgr2=0x7f7b040fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:57.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.176+0000 7f7b0b0be640 1 -- 172.21.15.19:0/1152274162 shutdown_connections 2024-09-19T08:52:57.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:57.176+0000 7f7b0b0be640 1 -- 172.21.15.19:0/1152274162 wait complete. 2024-09-19T08:52:57.186 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:57.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:57 smithi019 ceph-mon[30976]: pgmap v359: 97 pgs: 97 active+clean; 663 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-19T08:52:57.896 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T08:52:58.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:57 smithi155 ceph-mon[34921]: pgmap v359: 97 pgs: 97 active+clean; 663 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-19T08:52:58.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:57 smithi203 ceph-mon[35450]: pgmap v359: 97 pgs: 97 active+clean; 663 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 938 B/s wr, 12 op/s 2024-09-19T08:52:58.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.340+0000 7fb30536b640 1 -- 172.21.15.19:0/2230762980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb300074620 msgr2=0x7fb300074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:58.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.340+0000 7fb30536b640 1 --2- 172.21.15.19:0/2230762980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb300074620 0x7fb300074a00 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0009900 tx=0x7fb2f002a480 comp rx=0 tx=0).stop 2024-09-19T08:52:58.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.340+0000 7fb30536b640 1 -- 172.21.15.19:0/2230762980 shutdown_connections 2024-09-19T08:52:58.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.340+0000 7fb30536b640 1 --2- 172.21.15.19:0/2230762980 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb300074f40 0x7fb30010de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:58.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.340+0000 7fb30536b640 1 --2- 172.21.15.19:0/2230762980 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb30010e3d0 0x7fb300110820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:58.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.340+0000 7fb30536b640 1 --2- 172.21.15.19:0/2230762980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb300074620 0x7fb300074a00 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:58.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.340+0000 7fb30536b640 1 -- 172.21.15.19:0/2230762980 >> 172.21.15.19:0/2230762980 conn(0x7fb3000fd8f0 msgr2=0x7fb3000ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:58.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.340+0000 7fb30536b640 1 -- 172.21.15.19:0/2230762980 shutdown_connections 2024-09-19T08:52:58.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.340+0000 7fb30536b640 1 -- 172.21.15.19:0/2230762980 wait complete. 2024-09-19T08:52:58.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.341+0000 7fb30536b640 1 Processor -- start 2024-09-19T08:52:58.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.341+0000 7fb30536b640 1 -- start start 2024-09-19T08:52:58.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.341+0000 7fb30536b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb300074620 0x7fb30019a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:58.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.341+0000 7fb30536b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb300074f40 0x7fb30019ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:58.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.341+0000 7fb30536b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb30010e3d0 0x7fb30019ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:58.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.341+0000 7fb30536b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb300114160 con 0x7fb30010e3d0 2024-09-19T08:52:58.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.341+0000 7fb30536b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb300113fe0 con 0x7fb300074f40 2024-09-19T08:52:58.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.341+0000 7fb30536b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb3001142e0 con 0x7fb300074620 2024-09-19T08:52:58.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.342+0000 7fb2ff7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb30010e3d0 0x7fb30019ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:58.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.342+0000 7fb2ff7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb30010e3d0 0x7fb30019ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52094/0 (socket says 172.21.15.19:52094) 2024-09-19T08:52:58.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.342+0000 7fb2ff7fe640 1 -- 172.21.15.19:0/3672241127 learned_addr learned my addr 172.21.15.19:0/3672241127 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:58.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.342+0000 7fb2f7fff640 1 --2- 172.21.15.19:0/3672241127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb300074f40 0x7fb30019ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:58.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.342+0000 7fb2feffd640 1 --2- 172.21.15.19:0/3672241127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb300074620 0x7fb30019a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:58.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.342+0000 7fb2ff7fe640 1 -- 172.21.15.19:0/3672241127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb300074620 msgr2=0x7fb30019a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:58.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.342+0000 7fb2ff7fe640 1 --2- 172.21.15.19:0/3672241127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb300074620 0x7fb30019a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:58.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.342+0000 7fb2ff7fe640 1 -- 172.21.15.19:0/3672241127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb300074f40 msgr2=0x7fb30019ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:58.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.342+0000 7fb2ff7fe640 1 --2- 172.21.15.19:0/3672241127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb300074f40 0x7fb30019ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:58.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.342+0000 7fb2ff7fe640 1 -- 172.21.15.19:0/3672241127 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb30019f670 con 0x7fb30010e3d0 2024-09-19T08:52:58.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.342+0000 7fb2f7fff640 1 --2- 172.21.15.19:0/3672241127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb300074f40 0x7fb30019ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:58.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.342+0000 7fb2ff7fe640 1 --2- 172.21.15.19:0/3672241127 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb30010e3d0 0x7fb30019ef90 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8009fd0 tx=0x7fb2f800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:58.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.342+0000 7fb2fcff9640 1 -- 172.21.15.19:0/3672241127 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8017070 con 0x7fb30010e3d0 2024-09-19T08:52:58.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.342+0000 7fb2fcff9640 1 -- 172.21.15.19:0/3672241127 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2f8003e50 con 0x7fb30010e3d0 2024-09-19T08:52:58.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.342+0000 7fb30536b640 1 -- 172.21.15.19:0/3672241127 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb30019f960 con 0x7fb30010e3d0 2024-09-19T08:52:58.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.342+0000 7fb2fcff9640 1 -- 172.21.15.19:0/3672241127 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f80106c0 con 0x7fb30010e3d0 2024-09-19T08:52:58.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.342+0000 7fb30536b640 1 -- 172.21.15.19:0/3672241127 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3001a7240 con 0x7fb30010e3d0 2024-09-19T08:52:58.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.344+0000 7fb30536b640 1 -- 172.21.15.19:0/3672241127 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb300074a00 con 0x7fb30010e3d0 2024-09-19T08:52:58.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.345+0000 7fb2fcff9640 1 -- 172.21.15.19:0/3672241127 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7fb2f8003970 con 0x7fb30010e3d0 2024-09-19T08:52:58.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.346+0000 7fb2fcff9640 1 --2- 172.21.15.19:0/3672241127 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb2ec0a32d0 0x7fb2ec0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:58.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.346+0000 7fb2feffd640 1 --2- 172.21.15.19:0/3672241127 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb2ec0a32d0 0x7fb2ec0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:58.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.346+0000 7fb2fcff9640 1 -- 172.21.15.19:0/3672241127 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb2f80cf8b0 con 0x7fb30010e3d0 2024-09-19T08:52:58.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.347+0000 7fb2feffd640 1 --2- 172.21.15.19:0/3672241127 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb2ec0a32d0 0x7fb2ec0a5790 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0005ab0 tx=0x7fb2f0005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:58.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.349+0000 7fb2fcff9640 1 -- 172.21.15.19:0/3672241127 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb2f809c420 con 0x7fb30010e3d0 2024-09-19T08:52:58.388 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:52:58.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.590+0000 7fb30536b640 1 -- 172.21.15.19:0/3672241127 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb3001095b0 con 0x7fb30010e3d0 2024-09-19T08:52:58.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.591+0000 7fb2fcff9640 1 -- 172.21.15.19:0/3672241127 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11983 (secure 0 0 0) 0x7fb2f809bd20 con 0x7fb30010e3d0 2024-09-19T08:52:58.592 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:52:58.592 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":28,"btime":"2024-09-19T08:52:09:653615+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2452068876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2452068876},{"type":"v1","addr":"172.21.15.19:6839","nonce":2452068876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T08:52:08.813945+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/2480841559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2480841559},{"type":"v1","addr":"172.21.15.155:6835","nonce":2480841559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24463,24464,24490,24469,24497]},"id":1}]} 2024-09-19T08:52:58.593 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 28 2024-09-19T08:52:58.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.593+0000 7fb30536b640 1 -- 172.21.15.19:0/3672241127 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb2ec0a32d0 msgr2=0x7fb2ec0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:58.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.593+0000 7fb30536b640 1 --2- 172.21.15.19:0/3672241127 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb2ec0a32d0 0x7fb2ec0a5790 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb2f0005ab0 tx=0x7fb2f0005a20 comp rx=0 tx=0).stop 2024-09-19T08:52:58.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.593+0000 7fb30536b640 1 -- 172.21.15.19:0/3672241127 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb30010e3d0 msgr2=0x7fb30019ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:58.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.593+0000 7fb30536b640 1 --2- 172.21.15.19:0/3672241127 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb30010e3d0 0x7fb30019ef90 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8009fd0 tx=0x7fb2f800b260 comp rx=0 tx=0).stop 2024-09-19T08:52:58.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.593+0000 7fb30536b640 1 -- 172.21.15.19:0/3672241127 shutdown_connections 2024-09-19T08:52:58.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.593+0000 7fb30536b640 1 --2- 172.21.15.19:0/3672241127 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb2ec0a32d0 0x7fb2ec0a5790 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:58.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.593+0000 7fb30536b640 1 --2- 172.21.15.19:0/3672241127 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb30010e3d0 0x7fb30019ef90 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:58.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.593+0000 7fb30536b640 1 --2- 172.21.15.19:0/3672241127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb300074f40 0x7fb30019ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:58.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.593+0000 7fb30536b640 1 --2- 172.21.15.19:0/3672241127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb300074620 0x7fb30019a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:58.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.593+0000 7fb30536b640 1 -- 172.21.15.19:0/3672241127 >> 172.21.15.19:0/3672241127 conn(0x7fb3000fd8f0 msgr2=0x7fb3000fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:58.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.593+0000 7fb30536b640 1 -- 172.21.15.19:0/3672241127 shutdown_connections 2024-09-19T08:52:58.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:58.593+0000 7fb30536b640 1 -- 172.21.15.19:0/3672241127 wait complete. 2024-09-19T08:52:59.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:58 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3672241127' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:52:59.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.074+0000 7f61f23c6640 1 -- 172.21.15.19:0/191125824 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61ec102d30 msgr2=0x7f61ec103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:59.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.074+0000 7f61f23c6640 1 --2- 172.21.15.19:0/191125824 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61ec102d30 0x7f61ec103110 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f61dc009930 tx=0x7f61dc02a420 comp rx=0 tx=0).stop 2024-09-19T08:52:59.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.074+0000 7f61f23c6640 1 -- 172.21.15.19:0/191125824 shutdown_connections 2024-09-19T08:52:59.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.074+0000 7f61f23c6640 1 --2- 172.21.15.19:0/191125824 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61ec1036e0 0x7f61ec107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:59.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.074+0000 7f61f23c6640 1 --2- 172.21.15.19:0/191125824 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61ec1082a0 0x7f61ec10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:59.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.074+0000 7f61f23c6640 1 --2- 172.21.15.19:0/191125824 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61ec102d30 0x7f61ec103110 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:59.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.074+0000 7f61f23c6640 1 -- 172.21.15.19:0/191125824 >> 172.21.15.19:0/191125824 conn(0x7f61ec0fc7d0 msgr2=0x7f61ec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:59.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.074+0000 7f61f23c6640 1 -- 172.21.15.19:0/191125824 shutdown_connections 2024-09-19T08:52:59.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.074+0000 7f61f23c6640 1 -- 172.21.15.19:0/191125824 wait complete. 2024-09-19T08:52:59.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.075+0000 7f61f23c6640 1 Processor -- start 2024-09-19T08:52:59.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.075+0000 7f61f23c6640 1 -- start start 2024-09-19T08:52:59.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.075+0000 7f61f23c6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61ec102d30 0x7f61ec198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:59.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.075+0000 7f61f23c6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61ec1036e0 0x7f61ec198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:59.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.075+0000 7f61f23c6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61ec1082a0 0x7f61ec19cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:59.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.075+0000 7f61f23c6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f61ec1120a0 con 0x7f61ec1036e0 2024-09-19T08:52:59.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.075+0000 7f61f23c6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f61ec111f20 con 0x7f61ec102d30 2024-09-19T08:52:59.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.075+0000 7f61f23c6640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f61ec112220 con 0x7f61ec1082a0 2024-09-19T08:52:59.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.075+0000 7f61eb7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61ec1036e0 0x7f61ec198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:59.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.075+0000 7f61eb7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61ec1036e0 0x7f61ec198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52108/0 (socket says 172.21.15.19:52108) 2024-09-19T08:52:59.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.075+0000 7f61eb7fe640 1 -- 172.21.15.19:0/697138445 learned_addr learned my addr 172.21.15.19:0/697138445 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:59.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.075+0000 7f61ebfff640 1 --2- 172.21.15.19:0/697138445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61ec102d30 0x7f61ec198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:59.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.075+0000 7f61f0963640 1 --2- 172.21.15.19:0/697138445 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61ec1082a0 0x7f61ec19cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:59.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.076+0000 7f61eb7fe640 1 -- 172.21.15.19:0/697138445 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61ec1082a0 msgr2=0x7f61ec19cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:59.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.076+0000 7f61eb7fe640 1 --2- 172.21.15.19:0/697138445 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61ec1082a0 0x7f61ec19cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:59.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.076+0000 7f61eb7fe640 1 -- 172.21.15.19:0/697138445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61ec102d30 msgr2=0x7f61ec198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:59.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.076+0000 7f61eb7fe640 1 --2- 172.21.15.19:0/697138445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61ec102d30 0x7f61ec198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:59.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.076+0000 7f61eb7fe640 1 -- 172.21.15.19:0/697138445 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61ec19d4d0 con 0x7f61ec1036e0 2024-09-19T08:52:59.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.076+0000 7f61eb7fe640 1 --2- 172.21.15.19:0/697138445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61ec1036e0 0x7f61ec198a60 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f61e000e9f0 tx=0x7f61e000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:59.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.076+0000 7f61e97fa640 1 -- 172.21.15.19:0/697138445 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e000ccc0 con 0x7f61ec1036e0 2024-09-19T08:52:59.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.076+0000 7f61e97fa640 1 -- 172.21.15.19:0/697138445 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61e0010910 con 0x7f61ec1036e0 2024-09-19T08:52:59.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.076+0000 7f61f23c6640 1 -- 172.21.15.19:0/697138445 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61ec19d7c0 con 0x7f61ec1036e0 2024-09-19T08:52:59.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.076+0000 7f61e97fa640 1 -- 172.21.15.19:0/697138445 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e0018920 con 0x7f61ec1036e0 2024-09-19T08:52:59.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.076+0000 7f61f23c6640 1 -- 172.21.15.19:0/697138445 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61ec1a50a0 con 0x7f61ec1036e0 2024-09-19T08:52:59.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.079+0000 7f61f479f740 1 Processor -- start 2024-09-19T08:52:59.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.079+0000 7f61e97fa640 1 -- 172.21.15.19:0/697138445 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f61e0010ac0 con 0x7f61ec1036e0 2024-09-19T08:52:59.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.079+0000 7f61f479f740 1 -- start start 2024-09-19T08:52:59.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.079+0000 7f61f479f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563710eecb40 0x563710eeb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:59.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.079+0000 7f61f479f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563710eeb5d0 0x563710eeba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:59.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.079+0000 7f61f479f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563710ef6370 0x563710ef8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:59.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.079+0000 7f61f479f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563710e512f0 con 0x563710eeb5d0 2024-09-19T08:52:59.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.079+0000 7f61f479f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x563710df8cf0 con 0x563710eecb40 2024-09-19T08:52:59.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.079+0000 7f61f479f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563710e4d2b0 con 0x563710ef6370 2024-09-19T08:52:59.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.079+0000 7f61ebfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563710eeb5d0 0x563710eeba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:59.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.079+0000 7f61ebfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563710eeb5d0 0x563710eeba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52122/0 (socket says 172.21.15.19:52122) 2024-09-19T08:52:59.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.079+0000 7f61ebfff640 1 -- 172.21.15.19:0/252138797 learned_addr learned my addr 172.21.15.19:0/252138797 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:59.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.079+0000 7f61f0963640 1 --2- 172.21.15.19:0/252138797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563710eecb40 0x563710eeb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:59.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.080+0000 7f61eb7fe640 1 --2- 172.21.15.19:0/252138797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563710ef6370 0x563710ef8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:59.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.080+0000 7f61e97fa640 1 --2- 172.21.15.19:0/697138445 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f61d40a3420 0x7f61d40a58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:59.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.080+0000 7f61f0963640 1 -- 172.21.15.19:0/252138797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563710ef6370 msgr2=0x563710ef8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:59.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.080+0000 7f61f0963640 1 --2- 172.21.15.19:0/252138797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563710ef6370 0x563710ef8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:59.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.080+0000 7f61f0963640 1 -- 172.21.15.19:0/252138797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563710eeb5d0 msgr2=0x563710eeba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:59.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.080+0000 7f61f0963640 1 --2- 172.21.15.19:0/252138797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563710eeb5d0 0x563710eeba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:59.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.080+0000 7f61f0963640 1 -- 172.21.15.19:0/252138797 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563710ddd3a0 con 0x563710eecb40 2024-09-19T08:52:59.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.080+0000 7f61ebfff640 1 --2- 172.21.15.19:0/252138797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563710eeb5d0 0x563710eeba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:52:59.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.080+0000 7f61eb7fe640 1 --2- 172.21.15.19:0/252138797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563710ef6370 0x563710ef8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:52:59.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.080+0000 7f61e97fa640 1 -- 172.21.15.19:0/697138445 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f61e00cfce0 con 0x7f61ec1036e0 2024-09-19T08:52:59.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.080+0000 7f61f0963640 1 --2- 172.21.15.19:0/697138445 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f61d40a3420 0x7f61d40a58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:59.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.080+0000 7f61f0963640 1 --2- 172.21.15.19:0/252138797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563710eecb40 0x563710eeb090 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f61e4007dc0 tx=0x7f61e400f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47571c8db2cbf92d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:59.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.080+0000 7f61d27fc640 1 -- 172.21.15.19:0/252138797 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e40107c0 con 0x563710eecb40 2024-09-19T08:52:59.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.081+0000 7f61d27fc640 1 -- 172.21.15.19:0/252138797 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61e401a9a0 con 0x563710eecb40 2024-09-19T08:52:59.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.081+0000 7f61d27fc640 1 -- 172.21.15.19:0/252138797 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e4023930 con 0x563710eecb40 2024-09-19T08:52:59.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.081+0000 7f61f0963640 1 --2- 172.21.15.19:0/697138445 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f61d40a3420 0x7f61d40a58e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f61e401e000 tx=0x7f61e401f000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:59.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.081+0000 7f61f479f740 1 -- 172.21.15.19:0/252138797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563710eecb40 msgr2=0x563710eeb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:59.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.081+0000 7f61f479f740 1 --2- 172.21.15.19:0/252138797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563710eecb40 0x563710eeb090 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f61e4007dc0 tx=0x7f61e400f790 comp rx=0 tx=0).stop 2024-09-19T08:52:59.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.081+0000 7f61f479f740 1 -- 172.21.15.19:0/252138797 shutdown_connections 2024-09-19T08:52:59.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.081+0000 7f61f479f740 1 --2- 172.21.15.19:0/252138797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563710ef6370 0x563710ef8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:59.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.081+0000 7f61f479f740 1 --2- 172.21.15.19:0/252138797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563710eeb5d0 0x563710eeba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:59.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.081+0000 7f61f479f740 1 --2- 172.21.15.19:0/252138797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563710eecb40 0x563710eeb090 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:59.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.081+0000 7f61f479f740 1 -- 172.21.15.19:0/252138797 >> 172.21.15.19:0/252138797 conn(0x563710eb4310 msgr2=0x563710ee7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:59.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.081+0000 7f61f479f740 1 -- 172.21.15.19:0/252138797 shutdown_connections 2024-09-19T08:52:59.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.081+0000 7f61f479f740 1 -- 172.21.15.19:0/252138797 wait complete. 2024-09-19T08:52:59.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.082+0000 7f61f479f740 1 -- start start 2024-09-19T08:52:59.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.082+0000 7f61f479f740 1 Processor -- start 2024-09-19T08:52:59.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.082+0000 7f61f479f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563710eeb5d0 0x563710ef5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:59.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.082+0000 7f61f479f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563710eecb40 0x563710ef3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:59.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.082+0000 7f61f479f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563710ef6370 0x563710ef35d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:59.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.082+0000 7f61f479f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563710ef9070 con 0x563710eeb5d0 2024-09-19T08:52:59.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.082+0000 7f61f479f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x563710e0c060 con 0x563710eecb40 2024-09-19T08:52:59.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.082+0000 7f61f479f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563710ef91f0 con 0x563710ef6370 2024-09-19T08:52:59.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.082+0000 7f61f479f740 10 client.0 _ll_register_callbacks cb 0x563710b5f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:59.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.083+0000 7f61ebfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563710eeb5d0 0x563710ef5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:59.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.083+0000 7f61ebfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563710eeb5d0 0x563710ef5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52128/0 (socket says 172.21.15.19:52128) 2024-09-19T08:52:59.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.083+0000 7f61ebfff640 1 -- 172.21.15.19:0/931669535 learned_addr learned my addr 172.21.15.19:0/931669535 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:59.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.083+0000 7f61eb7fe640 1 --2- 172.21.15.19:0/931669535 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563710eecb40 0x563710ef3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:59.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.083+0000 7f61f0963640 1 --2- 172.21.15.19:0/931669535 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563710ef6370 0x563710ef35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:59.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.083+0000 7f61ebfff640 1 -- 172.21.15.19:0/931669535 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563710ef6370 msgr2=0x563710ef35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:59.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.083+0000 7f61ebfff640 1 --2- 172.21.15.19:0/931669535 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563710ef6370 0x563710ef35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:59.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.083+0000 7f61ebfff640 1 -- 172.21.15.19:0/931669535 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563710eecb40 msgr2=0x563710ef3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:59.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.083+0000 7f61ebfff640 1 --2- 172.21.15.19:0/931669535 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563710eecb40 0x563710ef3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:59.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.083+0000 7f61ebfff640 1 -- 172.21.15.19:0/931669535 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563710bc23c0 con 0x563710eeb5d0 2024-09-19T08:52:59.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.083+0000 7f61eb7fe640 1 --2- 172.21.15.19:0/931669535 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563710eecb40 0x563710ef3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:59.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.083+0000 7f61ebfff640 1 --2- 172.21.15.19:0/931669535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563710eeb5d0 0x563710ef5d50 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f61dc000c00 tx=0x7f61dc004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd96b7aa2d90ca92 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:59.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.083+0000 7f61cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:52:59.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.083+0000 7f61cb7fe640 1 -- 172.21.15.19:0/931669535 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61dc035040 con 0x563710eeb5d0 2024-09-19T08:52:59.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.083+0000 7f61f479f740 1 -- 172.21.15.19:0/931669535 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61e401a9a0 con 0x563710eeb5d0 2024-09-19T08:52:59.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.083+0000 7f61cb7fe640 1 -- 172.21.15.19:0/931669535 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f61dc0043f0 con 0x563710eeb5d0 2024-09-19T08:52:59.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.084+0000 7f61cb7fe640 1 -- 172.21.15.19:0/931669535 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f61dc005030 con 0x563710eeb5d0 2024-09-19T08:52:59.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.084+0000 7f61f479f740 10 client.15588 fetch_fsmap learned FSMap version 28 2024-09-19T08:52:59.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.084+0000 7f61f479f740 1 -- 172.21.15.19:0/931669535 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563710f04ab0 con 0x563710eeb5d0 2024-09-19T08:52:59.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.084+0000 7f61cb7fe640 1 -- 172.21.15.19:0/931669535 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61e401a9a0 con 0x563710eeb5d0 2024-09-19T08:52:59.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.084+0000 7f61cb7fe640 1 -- 172.21.15.19:0/931669535 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f61dc0035f0 con 0x563710eeb5d0 2024-09-19T08:52:59.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.084+0000 7f61f479f740 10 client.15588 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:52:59.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.084+0000 7f61f479f740 10 client.15588 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T08:52:59.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.084+0000 7f61f479f740 20 client.15588 populate_metadata read hostname 'smithi019' 2024-09-19T08:52:59.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.084+0000 7f61f479f740 1 --2- 172.21.15.19:0/931669535 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x563710f05f70 0x563710f08360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:59.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.084+0000 7f61f479f740 4 client.15588 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:52:59.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.084+0000 7f61f479f740 1 -- 172.21.15.19:0/931669535 --> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563710e5e860 con 0x563710f05f70 2024-09-19T08:52:59.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.084+0000 7f61eb7fe640 1 --2- 172.21.15.19:0/931669535 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x563710f05f70 0x563710f08360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:59.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.085+0000 7f61cb7fe640 10 client.15588 ms_handle_connect on v2:172.21.15.203:6836/3684671619 2024-09-19T08:52:59.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.085+0000 7f61eb7fe640 1 --2- 172.21.15.19:0/931669535 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x563710f05f70 0x563710f08360 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6719f4fe15e07d6c server_cookie=d5b76599a0045694 in_seq=0 out_seq=0 2024-09-19T08:52:59.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.086+0000 7f61cb7fe640 1 -- 172.21.15.19:0/931669535 <== mds.2 v2:172.21.15.203:6836/3684671619 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563710e5e860 con 0x563710f05f70 2024-09-19T08:52:59.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.086+0000 7f61cb7fe640 10 client.15588 handle_command_reply: tid=0 2024-09-19T08:52:59.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.086+0000 7f61f479f740 1 client.15588 shutdown 2024-09-19T08:52:59.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.086+0000 7f61f479f740 1 -- 172.21.15.19:0/931669535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563710eeb5d0 msgr2=0x563710ef5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:59.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.086+0000 7f61f479f740 1 --2- 172.21.15.19:0/931669535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563710eeb5d0 0x563710ef5d50 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f61dc000c00 tx=0x7f61dc004040 comp rx=0 tx=0).stop 2024-09-19T08:52:59.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.086+0000 7f61f479f740 1 -- 172.21.15.19:0/931669535 shutdown_connections 2024-09-19T08:52:59.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.086+0000 7f61f479f740 1 --2- 172.21.15.19:0/931669535 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x563710f05f70 0x563710f08360 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:59.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.086+0000 7f61cb7fe640 0 client.15588 ms_handle_reset on v2:172.21.15.203:6836/3684671619 2024-09-19T08:52:59.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.086+0000 7f61f479f740 1 --2- 172.21.15.19:0/931669535 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563710ef6370 0x563710ef35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:59.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.086+0000 7f61f479f740 1 --2- 172.21.15.19:0/931669535 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563710eecb40 0x563710ef3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:59.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.086+0000 7f61f479f740 1 --2- 172.21.15.19:0/931669535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563710eeb5d0 0x563710ef5d50 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:59.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.086+0000 7f61f479f740 1 -- 172.21.15.19:0/931669535 >> 172.21.15.19:0/931669535 conn(0x563710eb4310 msgr2=0x563710eed930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:59.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.086+0000 7f61f479f740 1 -- 172.21.15.19:0/931669535 shutdown_connections 2024-09-19T08:52:59.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.086+0000 7f61f479f740 1 -- 172.21.15.19:0/931669535 wait complete. 2024-09-19T08:52:59.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.086+0000 7f61f479f740 20 client.15588 trim_cache size 0 max 16384 2024-09-19T08:52:59.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.099+0000 7f61f479f740 1 Processor -- start 2024-09-19T08:52:59.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.099+0000 7f61f479f740 1 -- start start 2024-09-19T08:52:59.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.100+0000 7f61f479f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563710eeb5d0 0x563710ef4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:59.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.100+0000 7f61f479f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563710eecb40 0x563710eee120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:59.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.100+0000 7f61f479f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563710ef6370 0x563710eee660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:59.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.100+0000 7f61f479f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f61ec1ad490 con 0x563710ef6370 2024-09-19T08:52:59.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.100+0000 7f61f479f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f61ec1aefd0 con 0x563710eecb40 2024-09-19T08:52:59.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.100+0000 7f61f479f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f61ec1adb60 con 0x563710eeb5d0 2024-09-19T08:52:59.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.100+0000 7f61f0963640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563710ef6370 0x563710eee660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:59.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.100+0000 7f61f0963640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563710ef6370 0x563710eee660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52144/0 (socket says 172.21.15.19:52144) 2024-09-19T08:52:59.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.100+0000 7f61f0963640 1 -- 172.21.15.19:0/3606041914 learned_addr learned my addr 172.21.15.19:0/3606041914 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:59.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.100+0000 7f61eb7fe640 1 --2- 172.21.15.19:0/3606041914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563710eecb40 0x563710eee120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:59.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.100+0000 7f61ebfff640 1 --2- 172.21.15.19:0/3606041914 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563710eeb5d0 0x563710ef4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:59.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.100+0000 7f61f0963640 1 -- 172.21.15.19:0/3606041914 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563710eeb5d0 msgr2=0x563710ef4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:59.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.100+0000 7f61f0963640 1 --2- 172.21.15.19:0/3606041914 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563710eeb5d0 0x563710ef4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:59.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.100+0000 7f61f0963640 1 -- 172.21.15.19:0/3606041914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563710eecb40 msgr2=0x563710eee120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:59.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.100+0000 7f61f0963640 1 --2- 172.21.15.19:0/3606041914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563710eecb40 0x563710eee120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:59.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.100+0000 7f61f0963640 1 -- 172.21.15.19:0/3606041914 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563710eeb2d0 con 0x563710ef6370 2024-09-19T08:52:59.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.100+0000 7f61eb7fe640 1 --2- 172.21.15.19:0/3606041914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563710eecb40 0x563710eee120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:52:59.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.100+0000 7f61f0963640 1 --2- 172.21.15.19:0/3606041914 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563710ef6370 0x563710eee660 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f61e4007d00 tx=0x7f61e4010ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca3b10762e828409 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:59.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.101+0000 7f61d1ffb640 1 -- 172.21.15.19:0/3606041914 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e4007860 con 0x563710ef6370 2024-09-19T08:52:59.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.101+0000 7f61d1ffb640 1 -- 172.21.15.19:0/3606041914 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61e4003e50 con 0x563710ef6370 2024-09-19T08:52:59.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.101+0000 7f61d1ffb640 1 -- 172.21.15.19:0/3606041914 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e4023790 con 0x563710ef6370 2024-09-19T08:52:59.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.101+0000 7f61f479f740 1 -- 172.21.15.19:0/3606041914 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563710ef6370 msgr2=0x563710eee660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:59.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.101+0000 7f61f479f740 1 --2- 172.21.15.19:0/3606041914 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563710ef6370 0x563710eee660 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f61e4007d00 tx=0x7f61e4010ed0 comp rx=0 tx=0).stop 2024-09-19T08:52:59.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.102+0000 7f61f479f740 1 -- 172.21.15.19:0/3606041914 shutdown_connections 2024-09-19T08:52:59.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.102+0000 7f61f479f740 1 --2- 172.21.15.19:0/3606041914 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563710ef6370 0x563710eee660 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:59.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.102+0000 7f61f479f740 1 --2- 172.21.15.19:0/3606041914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563710eecb40 0x563710eee120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:59.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.102+0000 7f61f479f740 1 --2- 172.21.15.19:0/3606041914 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563710eeb5d0 0x563710ef4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:59.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.102+0000 7f61f479f740 1 -- 172.21.15.19:0/3606041914 >> 172.21.15.19:0/3606041914 conn(0x563710eb4310 msgr2=0x563710ef4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:59.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.102+0000 7f61f479f740 1 -- 172.21.15.19:0/3606041914 shutdown_connections 2024-09-19T08:52:59.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.102+0000 7f61f479f740 1 -- 172.21.15.19:0/3606041914 wait complete. 2024-09-19T08:52:59.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.102+0000 7f61f479f740 1 -- start start 2024-09-19T08:52:59.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.102+0000 7f61f479f740 1 Processor -- start 2024-09-19T08:52:59.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.102+0000 7f61f479f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563710eeb5d0 0x563710efed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:59.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.102+0000 7f61f479f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563710eecb40 0x563710eefe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:59.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.102+0000 7f61f479f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563710ef6370 0x563710ef0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:59.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.103+0000 7f61f479f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f61ec1ae900 con 0x563710ef6370 2024-09-19T08:52:59.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.103+0000 7f61f479f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f61ec1ae230 con 0x563710eecb40 2024-09-19T08:52:59.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.103+0000 7f61f479f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f61ec1ab470 con 0x563710eeb5d0 2024-09-19T08:52:59.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.103+0000 7f61f479f740 10 client.0 _ll_register_callbacks cb 0x7f61dc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:52:59.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.103+0000 7f61f0963640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563710ef6370 0x563710ef0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:59.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.103+0000 7f61f0963640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563710ef6370 0x563710ef0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52160/0 (socket says 172.21.15.19:52160) 2024-09-19T08:52:59.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.103+0000 7f61f0963640 1 -- 172.21.15.19:0/2266732950 learned_addr learned my addr 172.21.15.19:0/2266732950 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:52:59.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.103+0000 7f61ebfff640 1 --2- 172.21.15.19:0/2266732950 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563710eeb5d0 0x563710efed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:59.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.103+0000 7f61eb7fe640 1 --2- 172.21.15.19:0/2266732950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563710eecb40 0x563710eefe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:59.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.103+0000 7f61f0963640 1 -- 172.21.15.19:0/2266732950 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563710eeb5d0 msgr2=0x563710efed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:59.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.103+0000 7f61f0963640 1 --2- 172.21.15.19:0/2266732950 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563710eeb5d0 0x563710efed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:59.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.103+0000 7f61f0963640 1 -- 172.21.15.19:0/2266732950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563710eecb40 msgr2=0x563710eefe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:52:59.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.103+0000 7f61f0963640 1 --2- 172.21.15.19:0/2266732950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563710eecb40 0x563710eefe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:59.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.103+0000 7f61f0963640 1 -- 172.21.15.19:0/2266732950 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563710f6fbe0 con 0x563710ef6370 2024-09-19T08:52:59.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.103+0000 7f61f0963640 1 --2- 172.21.15.19:0/2266732950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563710ef6370 0x563710ef0600 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f61e4007ff0 tx=0x7f61e4023ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd575e1a106be4a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:52:59.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.103+0000 7f61cb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:52:59.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.103+0000 7f61cb7fe640 1 -- 172.21.15.19:0/2266732950 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e4003b80 con 0x563710ef6370 2024-09-19T08:52:59.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.103+0000 7f61cb7fe640 1 -- 172.21.15.19:0/2266732950 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f61e4020040 con 0x563710ef6370 2024-09-19T08:52:59.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.104+0000 7f61f479f740 1 -- 172.21.15.19:0/2266732950 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61e4003e50 con 0x563710ef6370 2024-09-19T08:52:59.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.104+0000 7f61cb7fe640 1 -- 172.21.15.19:0/2266732950 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f61e4023610 con 0x563710ef6370 2024-09-19T08:52:59.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.104+0000 7f61f479f740 10 client.15594 fetch_fsmap learned FSMap version 28 2024-09-19T08:52:59.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.104+0000 7f61f479f740 1 -- 172.21.15.19:0/2266732950 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563710f70d30 con 0x563710ef6370 2024-09-19T08:52:59.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.104+0000 7f61cb7fe640 1 -- 172.21.15.19:0/2266732950 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61e4003e50 con 0x563710ef6370 2024-09-19T08:52:59.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.104+0000 7f61cb7fe640 1 -- 172.21.15.19:0/2266732950 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f61e4041070 con 0x563710ef6370 2024-09-19T08:52:59.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.104+0000 7f61f479f740 10 client.15594 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:52:59.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.104+0000 7f61f479f740 10 client.15594 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T08:52:59.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.104+0000 7f61f479f740 20 client.15594 populate_metadata read hostname 'smithi019' 2024-09-19T08:52:59.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.104+0000 7f61f479f740 1 --2- 172.21.15.19:0/2266732950 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x563710f05f70 0x563710f73210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:52:59.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.104+0000 7f61f479f740 4 client.15594 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:52:59.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.104+0000 7f61f479f740 1 -- 172.21.15.19:0/2266732950 --> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563710e58d70 con 0x563710f05f70 2024-09-19T08:52:59.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.105+0000 7f61ebfff640 1 --2- 172.21.15.19:0/2266732950 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x563710f05f70 0x563710f73210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:52:59.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.105+0000 7f61ebfff640 1 --2- 172.21.15.19:0/2266732950 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x563710f05f70 0x563710f73210 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=11480ccadd5fe70f server_cookie=5ff8d89114c2779a in_seq=0 out_seq=0 2024-09-19T08:52:59.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.105+0000 7f61cb7fe640 10 client.15594 ms_handle_connect on v2:172.21.15.203:6836/3684671619 2024-09-19T08:52:59.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.105+0000 7f61cb7fe640 1 -- 172.21.15.19:0/2266732950 <== mds.2 v2:172.21.15.203:6836/3684671619 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563710e58d70 con 0x563710f05f70 2024-09-19T08:52:59.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.105+0000 7f61cb7fe640 10 client.15594 handle_command_reply: tid=0 2024-09-19T08:52:59.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.105+0000 7f61f479f740 1 client.15594 shutdown 2024-09-19T08:52:59.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.105+0000 7f61f479f740 1 -- 172.21.15.19:0/2266732950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563710ef6370 msgr2=0x563710ef0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:59.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.105+0000 7f61f479f740 1 --2- 172.21.15.19:0/2266732950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563710ef6370 0x563710ef0600 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f61e4007ff0 tx=0x7f61e4023ec0 comp rx=0 tx=0).stop 2024-09-19T08:52:59.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.105+0000 7f61f479f740 1 -- 172.21.15.19:0/2266732950 shutdown_connections 2024-09-19T08:52:59.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.105+0000 7f61f479f740 1 --2- 172.21.15.19:0/2266732950 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x563710f05f70 0x563710f73210 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:59.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.105+0000 7f61f479f740 1 --2- 172.21.15.19:0/2266732950 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563710ef6370 0x563710ef0600 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:59.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.105+0000 7f61f479f740 1 --2- 172.21.15.19:0/2266732950 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563710eecb40 0x563710eefe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:59.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.105+0000 7f61f479f740 1 --2- 172.21.15.19:0/2266732950 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563710eeb5d0 0x563710efed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:59.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.106+0000 7f61f479f740 1 -- 172.21.15.19:0/2266732950 >> 172.21.15.19:0/2266732950 conn(0x563710eb4310 msgr2=0x563710ef5080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:59.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.106+0000 7f61cb7fe640 0 client.15594 ms_handle_reset on v2:172.21.15.203:6836/3684671619 2024-09-19T08:52:59.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.106+0000 7f61f479f740 1 -- 172.21.15.19:0/2266732950 shutdown_connections 2024-09-19T08:52:59.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.106+0000 7f61f479f740 1 -- 172.21.15.19:0/2266732950 wait complete. 2024-09-19T08:52:59.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.106+0000 7f61f479f740 20 client.15594 trim_cache size 0 max 16384 2024-09-19T08:52:59.113 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T08:52:59.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.106+0000 7f61f23c6640 1 -- 172.21.15.19:0/697138445 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f61d40a3420 msgr2=0x7f61d40a58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:59.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.106+0000 7f61f23c6640 1 --2- 172.21.15.19:0/697138445 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f61d40a3420 0x7f61d40a58e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f61e401e000 tx=0x7f61e401f000 comp rx=0 tx=0).stop 2024-09-19T08:52:59.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.106+0000 7f61f23c6640 1 -- 172.21.15.19:0/697138445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61ec1036e0 msgr2=0x7f61ec198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:52:59.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.106+0000 7f61f23c6640 1 --2- 172.21.15.19:0/697138445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61ec1036e0 0x7f61ec198a60 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f61e000e9f0 tx=0x7f61e000eeb0 comp rx=0 tx=0).stop 2024-09-19T08:52:59.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.107+0000 7f61f23c6640 1 -- 172.21.15.19:0/697138445 shutdown_connections 2024-09-19T08:52:59.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.107+0000 7f61f23c6640 1 --2- 172.21.15.19:0/697138445 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f61d40a3420 0x7f61d40a58e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:59.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.107+0000 7f61f23c6640 1 --2- 172.21.15.19:0/697138445 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61ec1082a0 0x7f61ec19cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:59.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.107+0000 7f61f23c6640 1 --2- 172.21.15.19:0/697138445 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61ec1036e0 0x7f61ec198a60 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:59.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.107+0000 7f61f23c6640 1 --2- 172.21.15.19:0/697138445 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61ec102d30 0x7f61ec198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:52:59.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.107+0000 7f61f23c6640 1 -- 172.21.15.19:0/697138445 >> 172.21.15.19:0/697138445 conn(0x7f61ec0fc7d0 msgr2=0x7f61ec105d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:52:59.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.107+0000 7f61f23c6640 1 -- 172.21.15.19:0/697138445 shutdown_connections 2024-09-19T08:52:59.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:52:59.107+0000 7f61f23c6640 1 -- 172.21.15.19:0/697138445 wait complete. 2024-09-19T08:52:59.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:58 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3672241127' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:52:59.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:58 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3672241127' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:52:59.868 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T08:53:00.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:52:59 smithi019 ceph-mon[30976]: pgmap v360: 97 pgs: 97 active+clean; 663 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-19T08:53:00.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:52:59 smithi155 ceph-mon[34921]: pgmap v360: 97 pgs: 97 active+clean; 663 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-19T08:53:00.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:52:59 smithi203 ceph-mon[35450]: pgmap v360: 97 pgs: 97 active+clean; 663 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-19T08:53:00.336 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db / --timeout 90 --expiration 131.2 --await-for 45.0' 2024-09-19T08:53:00.336 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db / --timeout 90 --expiration 131.2 --await-for 45.0 2024-09-19T08:53:00.480 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:00.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.959+0000 7ff3a1dd1640 1 -- 172.21.15.19:0/1624868137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff39c100e20 msgr2=0x7ff39c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:00.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.959+0000 7ff3a1dd1640 1 --2- 172.21.15.19:0/1624868137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff39c100e20 0x7ff39c101200 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009900 tx=0x7ff38c02a480 comp rx=0 tx=0).stop 2024-09-19T08:53:00.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.959+0000 7ff3a1dd1640 1 -- 172.21.15.19:0/1624868137 shutdown_connections 2024-09-19T08:53:00.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.959+0000 7ff3a1dd1640 1 --2- 172.21.15.19:0/1624868137 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff39c102570 0x7ff39c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:00.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.959+0000 7ff3a1dd1640 1 --2- 172.21.15.19:0/1624868137 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff39c102ef0 0x7ff39c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:00.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.959+0000 7ff3a1dd1640 1 --2- 172.21.15.19:0/1624868137 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff39c100e20 0x7ff39c101200 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:00.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.959+0000 7ff3a1dd1640 1 -- 172.21.15.19:0/1624868137 >> 172.21.15.19:0/1624868137 conn(0x7ff39c0fc7d0 msgr2=0x7ff39c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:00.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.959+0000 7ff3a1dd1640 1 -- 172.21.15.19:0/1624868137 shutdown_connections 2024-09-19T08:53:00.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.959+0000 7ff3a1dd1640 1 -- 172.21.15.19:0/1624868137 wait complete. 2024-09-19T08:53:00.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.959+0000 7ff3a1dd1640 1 Processor -- start 2024-09-19T08:53:00.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.960+0000 7ff3a1dd1640 1 -- start start 2024-09-19T08:53:00.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.960+0000 7ff3a1dd1640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff39c100e20 0x7ff39c1984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:00.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.960+0000 7ff3a1dd1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff39c102570 0x7ff39c198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:00.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.960+0000 7ff3a1dd1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff39c102ef0 0x7ff39c19cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:00.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.960+0000 7ff3a1dd1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff39c110f50 con 0x7ff39c102ef0 2024-09-19T08:53:00.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.960+0000 7ff3a1dd1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff39c110dd0 con 0x7ff39c102570 2024-09-19T08:53:00.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.960+0000 7ff3a1dd1640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff39c1110d0 con 0x7ff39c100e20 2024-09-19T08:53:00.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.960+0000 7ff39bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff39c102ef0 0x7ff39c19cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:00.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.960+0000 7ff39bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff39c102ef0 0x7ff39c19cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52182/0 (socket says 172.21.15.19:52182) 2024-09-19T08:53:00.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.960+0000 7ff39bfff640 1 -- 172.21.15.19:0/4113531614 learned_addr learned my addr 172.21.15.19:0/4113531614 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:00.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.960+0000 7ff39b7fe640 1 --2- 172.21.15.19:0/4113531614 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff39c100e20 0x7ff39c1984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:00.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.960+0000 7ff39affd640 1 --2- 172.21.15.19:0/4113531614 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff39c102570 0x7ff39c198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:00.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.960+0000 7ff39bfff640 1 -- 172.21.15.19:0/4113531614 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff39c100e20 msgr2=0x7ff39c1984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:00.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.960+0000 7ff39bfff640 1 --2- 172.21.15.19:0/4113531614 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff39c100e20 0x7ff39c1984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:00.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.960+0000 7ff39bfff640 1 -- 172.21.15.19:0/4113531614 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff39c102570 msgr2=0x7ff39c198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:00.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.960+0000 7ff39bfff640 1 --2- 172.21.15.19:0/4113531614 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff39c102570 0x7ff39c198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:00.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.960+0000 7ff39bfff640 1 -- 172.21.15.19:0/4113531614 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff39c19d470 con 0x7ff39c102ef0 2024-09-19T08:53:00.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.961+0000 7ff39bfff640 1 --2- 172.21.15.19:0/4113531614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff39c102ef0 0x7ff39c19cd90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff39400eaa0 tx=0x7ff39400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:00.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.961+0000 7ff398ff9640 1 -- 172.21.15.19:0/4113531614 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39400cdb0 con 0x7ff39c102ef0 2024-09-19T08:53:00.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.961+0000 7ff3a1dd1640 1 -- 172.21.15.19:0/4113531614 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff39c19d760 con 0x7ff39c102ef0 2024-09-19T08:53:00.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.961+0000 7ff3a1dd1640 1 -- 172.21.15.19:0/4113531614 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff39c1a5040 con 0x7ff39c102ef0 2024-09-19T08:53:00.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.961+0000 7ff398ff9640 1 -- 172.21.15.19:0/4113531614 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff394005020 con 0x7ff39c102ef0 2024-09-19T08:53:00.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.961+0000 7ff398ff9640 1 -- 172.21.15.19:0/4113531614 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3940116b0 con 0x7ff39c102ef0 2024-09-19T08:53:00.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.964+0000 7ff3a41aa740 1 Processor -- start 2024-09-19T08:53:00.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.964+0000 7ff398ff9640 1 -- 172.21.15.19:0/4113531614 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7ff3940118f0 con 0x7ff39c102ef0 2024-09-19T08:53:00.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.964+0000 7ff3a41aa740 1 -- start start 2024-09-19T08:53:00.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.964+0000 7ff3a41aa740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55db61d28b40 0x55db61d27090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:00.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.964+0000 7ff3a41aa740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db61d275d0 0x55db61d27a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:00.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.964+0000 7ff3a41aa740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db61d32370 0x55db61d34760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:00.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.964+0000 7ff3a41aa740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55db61c8d2f0 con 0x55db61d32370 2024-09-19T08:53:00.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.964+0000 7ff3a41aa740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55db61c34cf0 con 0x55db61d275d0 2024-09-19T08:53:00.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.964+0000 7ff3a41aa740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55db61c892b0 con 0x55db61d28b40 2024-09-19T08:53:00.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.965+0000 7ff39b7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db61d275d0 0x55db61d27a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:00.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.965+0000 7ff39b7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db61d275d0 0x55db61d27a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:53906/0 (socket says 172.21.15.19:53906) 2024-09-19T08:53:00.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.965+0000 7ff39b7fe640 1 -- 172.21.15.19:0/3777737569 learned_addr learned my addr 172.21.15.19:0/3777737569 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:00.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.965+0000 7ff39affd640 1 --2- 172.21.15.19:0/3777737569 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db61d32370 0x55db61d34760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:00.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.965+0000 7ff39affd640 1 --2- 172.21.15.19:0/3777737569 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55db61d28b40 0x55db61d27090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:00.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.965+0000 7ff398ff9640 1 --2- 172.21.15.19:0/4113531614 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff3840a3350 0x7ff3840a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:00.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.965+0000 7ff398ff9640 1 -- 172.21.15.19:0/4113531614 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff3940cfb30 con 0x7ff39c102ef0 2024-09-19T08:53:00.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.965+0000 7ff39bfff640 1 --2- 172.21.15.19:0/4113531614 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff3840a3350 0x7ff3840a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:00.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.965+0000 7ff39b7fe640 1 -- 172.21.15.19:0/3777737569 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55db61d28b40 msgr2=0x55db61d27090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:00.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.965+0000 7ff39b7fe640 1 --2- 172.21.15.19:0/3777737569 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55db61d28b40 0x55db61d27090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:00.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.965+0000 7ff39b7fe640 1 -- 172.21.15.19:0/3777737569 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db61d32370 msgr2=0x55db61d34760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:00.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.965+0000 7ff39b7fe640 1 --2- 172.21.15.19:0/3777737569 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db61d32370 0x55db61d34760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:00.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.965+0000 7ff39b7fe640 1 -- 172.21.15.19:0/3777737569 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db61c193a0 con 0x55db61d275d0 2024-09-19T08:53:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.965+0000 7ff39affd640 1 --2- 172.21.15.19:0/3777737569 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db61d32370 0x55db61d34760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:53:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.966+0000 7ff39b7fe640 1 --2- 172.21.15.19:0/3777737569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db61d275d0 0x55db61d27a10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009900 tx=0x7ff38c004170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5eea2daec513298b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.966+0000 7ff39bfff640 1 --2- 172.21.15.19:0/4113531614 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff3840a3350 0x7ff3840a5810 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff3940092f0 tx=0x7ff394098400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.966+0000 7ff381ffb640 1 -- 172.21.15.19:0/3777737569 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38c035030 con 0x55db61d275d0 2024-09-19T08:53:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.967+0000 7ff381ffb640 1 -- 172.21.15.19:0/3777737569 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff38c040070 con 0x55db61d275d0 2024-09-19T08:53:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.967+0000 7ff381ffb640 1 -- 172.21.15.19:0/3777737569 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38c031b00 con 0x55db61d275d0 2024-09-19T08:53:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.967+0000 7ff3a41aa740 1 -- 172.21.15.19:0/3777737569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db61d275d0 msgr2=0x55db61d27a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.967+0000 7ff3a41aa740 1 --2- 172.21.15.19:0/3777737569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db61d275d0 0x55db61d27a10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009900 tx=0x7ff38c004170 comp rx=0 tx=0).stop 2024-09-19T08:53:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.967+0000 7ff3a41aa740 1 -- 172.21.15.19:0/3777737569 shutdown_connections 2024-09-19T08:53:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.967+0000 7ff3a41aa740 1 --2- 172.21.15.19:0/3777737569 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db61d32370 0x55db61d34760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.967+0000 7ff3a41aa740 1 --2- 172.21.15.19:0/3777737569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db61d275d0 0x55db61d27a10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.967+0000 7ff3a41aa740 1 --2- 172.21.15.19:0/3777737569 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55db61d28b40 0x55db61d27090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.967+0000 7ff3a41aa740 1 -- 172.21.15.19:0/3777737569 >> 172.21.15.19:0/3777737569 conn(0x55db61cf0310 msgr2=0x55db61d23c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.968+0000 7ff3a41aa740 1 -- 172.21.15.19:0/3777737569 shutdown_connections 2024-09-19T08:53:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.968+0000 7ff3a41aa740 1 -- 172.21.15.19:0/3777737569 wait complete. 2024-09-19T08:53:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.968+0000 7ff3a41aa740 1 -- start start 2024-09-19T08:53:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.968+0000 7ff3a41aa740 1 Processor -- start 2024-09-19T08:53:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.969+0000 7ff3a41aa740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db61d275d0 0x55db61d31d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.969+0000 7ff3a41aa740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55db61d28b40 0x55db61d2efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.969+0000 7ff3a41aa740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db61d32370 0x55db61d2f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:00.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.969+0000 7ff3a41aa740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55db61d35010 con 0x55db61d275d0 2024-09-19T08:53:00.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.969+0000 7ff3a41aa740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55db61c48060 con 0x55db61d32370 2024-09-19T08:53:00.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.969+0000 7ff3a41aa740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55db61d35190 con 0x55db61d28b40 2024-09-19T08:53:00.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.969+0000 7ff3a41aa740 10 client.0 _ll_register_callbacks cb 0x55db6199b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:00.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.969+0000 7ff39affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db61d275d0 0x55db61d31d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:00.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.969+0000 7ff39affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db61d275d0 0x55db61d31d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52202/0 (socket says 172.21.15.19:52202) 2024-09-19T08:53:00.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.969+0000 7ff39affd640 1 -- 172.21.15.19:0/1510302308 learned_addr learned my addr 172.21.15.19:0/1510302308 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:00.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.969+0000 7ff39b7fe640 1 --2- 172.21.15.19:0/1510302308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55db61d28b40 0x55db61d2efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:00.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.969+0000 7ff39affd640 1 --2- 172.21.15.19:0/1510302308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db61d32370 0x55db61d2f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:00.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.969+0000 7ff39affd640 1 -- 172.21.15.19:0/1510302308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55db61d28b40 msgr2=0x55db61d2efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:00.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.969+0000 7ff39affd640 1 --2- 172.21.15.19:0/1510302308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55db61d28b40 0x55db61d2efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.969+0000 7ff39affd640 1 -- 172.21.15.19:0/1510302308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db61d32370 msgr2=0x55db61d2f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.969+0000 7ff39affd640 1 --2- 172.21.15.19:0/1510302308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db61d32370 0x55db61d2f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.969+0000 7ff39affd640 1 -- 172.21.15.19:0/1510302308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db619fe3c0 con 0x55db61d275d0 2024-09-19T08:53:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.970+0000 7ff39affd640 1 --2- 172.21.15.19:0/1510302308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db61d275d0 0x55db61d31d10 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ff39000ca40 tx=0x7ff390019040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff31d1d442ca3cd4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.970+0000 7ff37affd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:53:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.970+0000 7ff37affd640 1 -- 172.21.15.19:0/1510302308 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff390005220 con 0x55db61d275d0 2024-09-19T08:53:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.970+0000 7ff37affd640 1 -- 172.21.15.19:0/1510302308 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff3900053c0 con 0x55db61d275d0 2024-09-19T08:53:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.970+0000 7ff3a41aa740 1 -- 172.21.15.19:0/1510302308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff38c040070 con 0x55db61d275d0 2024-09-19T08:53:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.970+0000 7ff37affd640 1 -- 172.21.15.19:0/1510302308 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff3900055c0 con 0x55db61d275d0 2024-09-19T08:53:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.970+0000 7ff3a41aa740 10 client.15606 fetch_fsmap learned FSMap version 28 2024-09-19T08:53:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.970+0000 7ff3a41aa740 1 -- 172.21.15.19:0/1510302308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55db61d40b50 con 0x55db61d275d0 2024-09-19T08:53:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.970+0000 7ff37affd640 1 -- 172.21.15.19:0/1510302308 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff38c040070 con 0x55db61d275d0 2024-09-19T08:53:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.971+0000 7ff37affd640 1 -- 172.21.15.19:0/1510302308 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff39001f030 con 0x55db61d275d0 2024-09-19T08:53:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.971+0000 7ff3a41aa740 10 client.15606 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:53:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.971+0000 7ff3a41aa740 10 client.15606 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:53:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.971+0000 7ff3a41aa740 20 client.15606 populate_metadata read hostname 'smithi019' 2024-09-19T08:53:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.971+0000 7ff3a41aa740 1 --2- 172.21.15.19:0/1510302308 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55db61d41fb0 0x55db61d443f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.971+0000 7ff3a41aa740 4 client.15606 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:53:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.971+0000 7ff3a41aa740 1 -- 172.21.15.19:0/1510302308 --> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55db61c9a860 con 0x55db61d41fb0 2024-09-19T08:53:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.971+0000 7ff39b7fe640 1 --2- 172.21.15.19:0/1510302308 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55db61d41fb0 0x55db61d443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.972+0000 7ff39b7fe640 1 --2- 172.21.15.19:0/1510302308 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55db61d41fb0 0x55db61d443f0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3db8bbae5f714e8d server_cookie=eedffc1aaac43652 in_seq=0 out_seq=0 2024-09-19T08:53:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.972+0000 7ff37affd640 10 client.15606 ms_handle_connect on v2:172.21.15.203:6838/2547507299 2024-09-19T08:53:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.972+0000 7ff37affd640 1 -- 172.21.15.19:0/1510302308 <== mds.1 v2:172.21.15.203:6838/2547507299 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55db61c9a860 con 0x55db61d41fb0 2024-09-19T08:53:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.972+0000 7ff37affd640 10 client.15606 handle_command_reply: tid=0 2024-09-19T08:53:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.972+0000 7ff3a41aa740 1 client.15606 shutdown 2024-09-19T08:53:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.973+0000 7ff3a41aa740 1 -- 172.21.15.19:0/1510302308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db61d275d0 msgr2=0x55db61d31d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.973+0000 7ff3a41aa740 1 --2- 172.21.15.19:0/1510302308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db61d275d0 0x55db61d31d10 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7ff39000ca40 tx=0x7ff390019040 comp rx=0 tx=0).stop 2024-09-19T08:53:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.973+0000 7ff3a41aa740 1 -- 172.21.15.19:0/1510302308 shutdown_connections 2024-09-19T08:53:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.973+0000 7ff3a41aa740 1 --2- 172.21.15.19:0/1510302308 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55db61d41fb0 0x55db61d443f0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.973+0000 7ff37affd640 0 client.15606 ms_handle_reset on v2:172.21.15.203:6838/2547507299 2024-09-19T08:53:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.973+0000 7ff3a41aa740 1 --2- 172.21.15.19:0/1510302308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55db61d28b40 0x55db61d2efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.973+0000 7ff3a41aa740 1 --2- 172.21.15.19:0/1510302308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db61d32370 0x55db61d2f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.973+0000 7ff3a41aa740 1 --2- 172.21.15.19:0/1510302308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db61d275d0 0x55db61d31d10 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.973+0000 7ff3a41aa740 1 -- 172.21.15.19:0/1510302308 >> 172.21.15.19:0/1510302308 conn(0x55db61cf0310 msgr2=0x55db61d29930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.973+0000 7ff3a41aa740 1 -- 172.21.15.19:0/1510302308 shutdown_connections 2024-09-19T08:53:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.973+0000 7ff3a41aa740 1 -- 172.21.15.19:0/1510302308 wait complete. 2024-09-19T08:53:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.973+0000 7ff3a41aa740 20 client.15606 trim_cache size 0 max 16384 2024-09-19T08:53:00.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.995+0000 7ff3a41aa740 1 Processor -- start 2024-09-19T08:53:00.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.995+0000 7ff3a41aa740 1 -- start start 2024-09-19T08:53:00.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.996+0000 7ff3a41aa740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db61d28b40 0x55db61d22bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:00.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.996+0000 7ff3a41aa740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55db61d32370 0x55db61d33760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:00.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.996+0000 7ff3a41aa740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db61d23130 0x55db61d33ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:00.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.996+0000 7ff3a41aa740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff38800e400 con 0x55db61d23130 2024-09-19T08:53:00.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.996+0000 7ff3a41aa740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff38800ff40 con 0x55db61d28b40 2024-09-19T08:53:00.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.996+0000 7ff3a41aa740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff38800ead0 con 0x55db61d32370 2024-09-19T08:53:00.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.996+0000 7ff39affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db61d23130 0x55db61d33ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:00.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.996+0000 7ff39affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db61d23130 0x55db61d33ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52208/0 (socket says 172.21.15.19:52208) 2024-09-19T08:53:00.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.996+0000 7ff39affd640 1 -- 172.21.15.19:0/3729285244 learned_addr learned my addr 172.21.15.19:0/3729285244 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:00.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.996+0000 7ff39b7fe640 1 --2- 172.21.15.19:0/3729285244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55db61d32370 0x55db61d33760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:00.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.996+0000 7ff39affd640 1 --2- 172.21.15.19:0/3729285244 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db61d28b40 0x55db61d22bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:00.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.996+0000 7ff39b7fe640 1 -- 172.21.15.19:0/3729285244 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db61d28b40 msgr2=0x55db61d22bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:00.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.996+0000 7ff39b7fe640 1 --2- 172.21.15.19:0/3729285244 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db61d28b40 0x55db61d22bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:00.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.996+0000 7ff39b7fe640 1 -- 172.21.15.19:0/3729285244 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db61d23130 msgr2=0x55db61d33ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:00.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.996+0000 7ff39b7fe640 1 --2- 172.21.15.19:0/3729285244 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db61d23130 0x55db61d33ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:00.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.996+0000 7ff39b7fe640 1 -- 172.21.15.19:0/3729285244 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55db61d31930 con 0x55db61d32370 2024-09-19T08:53:00.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.996+0000 7ff39affd640 1 --2- 172.21.15.19:0/3729285244 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db61d23130 0x55db61d33ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:53:00.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.997+0000 7ff39b7fe640 1 --2- 172.21.15.19:0/3729285244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55db61d32370 0x55db61d33760 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff38c02a9a0 tx=0x7ff38c03e040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6dc6cb4ef581eaaf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:00.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.997+0000 7ff3817fa640 1 -- 172.21.15.19:0/3729285244 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38c035040 con 0x55db61d32370 2024-09-19T08:53:00.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.997+0000 7ff3817fa640 1 -- 172.21.15.19:0/3729285244 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff38c040070 con 0x55db61d32370 2024-09-19T08:53:00.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.997+0000 7ff3817fa640 1 -- 172.21.15.19:0/3729285244 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38c004750 con 0x55db61d32370 2024-09-19T08:53:01.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.998+0000 7ff3a41aa740 1 -- 172.21.15.19:0/3729285244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55db61d32370 msgr2=0x55db61d33760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:01.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.998+0000 7ff3a41aa740 1 --2- 172.21.15.19:0/3729285244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55db61d32370 0x55db61d33760 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff38c02a9a0 tx=0x7ff38c03e040 comp rx=0 tx=0).stop 2024-09-19T08:53:01.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.998+0000 7ff3a41aa740 1 -- 172.21.15.19:0/3729285244 shutdown_connections 2024-09-19T08:53:01.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.998+0000 7ff3a41aa740 1 --2- 172.21.15.19:0/3729285244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55db61d32370 0x55db61d33760 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:01.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.998+0000 7ff3a41aa740 1 --2- 172.21.15.19:0/3729285244 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db61d23130 0x55db61d33ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:01.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.998+0000 7ff3a41aa740 1 --2- 172.21.15.19:0/3729285244 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db61d28b40 0x55db61d22bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:01.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.998+0000 7ff3a41aa740 1 -- 172.21.15.19:0/3729285244 >> 172.21.15.19:0/3729285244 conn(0x55db61cf0310 msgr2=0x55db61d224e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:01.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.998+0000 7ff3a41aa740 1 -- 172.21.15.19:0/3729285244 shutdown_connections 2024-09-19T08:53:01.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.998+0000 7ff3a41aa740 1 -- 172.21.15.19:0/3729285244 wait complete. 2024-09-19T08:53:01.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.998+0000 7ff3a41aa740 1 -- start start 2024-09-19T08:53:01.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.999+0000 7ff3a41aa740 1 Processor -- start 2024-09-19T08:53:01.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.999+0000 7ff3a41aa740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db61d23130 0x55db61d3a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:01.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.999+0000 7ff3a41aa740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55db61d28b40 0x55db61d3ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:01.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.999+0000 7ff3a41aa740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db61d32370 0x55db61d2b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:01.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.999+0000 7ff3a41aa740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff38800f870 con 0x55db61d32370 2024-09-19T08:53:01.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.999+0000 7ff3a41aa740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff38800f1a0 con 0x55db61d23130 2024-09-19T08:53:01.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.999+0000 7ff3a41aa740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff38800c3e0 con 0x55db61d28b40 2024-09-19T08:53:01.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.999+0000 7ff3a41aa740 10 client.0 _ll_register_callbacks cb 0x7ff390017e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:01.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.999+0000 7ff39affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db61d32370 0x55db61d2b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:01.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.999+0000 7ff39affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db61d32370 0x55db61d2b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52224/0 (socket says 172.21.15.19:52224) 2024-09-19T08:53:01.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.999+0000 7ff39affd640 1 -- 172.21.15.19:0/130064176 learned_addr learned my addr 172.21.15.19:0/130064176 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:01.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.999+0000 7ff39b7fe640 1 --2- 172.21.15.19:0/130064176 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55db61d28b40 0x55db61d3ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:01.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:00.999+0000 7ff39affd640 1 --2- 172.21.15.19:0/130064176 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db61d23130 0x55db61d3a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:01.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.000+0000 7ff39b7fe640 1 -- 172.21.15.19:0/130064176 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db61d23130 msgr2=0x55db61d3a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:01.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.000+0000 7ff39b7fe640 1 --2- 172.21.15.19:0/130064176 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db61d23130 0x55db61d3a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:01.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.000+0000 7ff39b7fe640 1 -- 172.21.15.19:0/130064176 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db61d32370 msgr2=0x55db61d2b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:01.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.000+0000 7ff39b7fe640 1 --2- 172.21.15.19:0/130064176 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db61d32370 0x55db61d2b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:01.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.000+0000 7ff39b7fe640 1 -- 172.21.15.19:0/130064176 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55db61d2bc60 con 0x55db61d28b40 2024-09-19T08:53:01.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.000+0000 7ff39b7fe640 1 --2- 172.21.15.19:0/130064176 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55db61d28b40 0x55db61d3ada0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff38c0096c0 tx=0x7ff38c005850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a949e8e9c18f8ad5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:01.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.000+0000 7ff37affd640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T08:53:01.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.000+0000 7ff37affd640 1 -- 172.21.15.19:0/130064176 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38c06f060 con 0x55db61d28b40 2024-09-19T08:53:01.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.000+0000 7ff37affd640 1 -- 172.21.15.19:0/130064176 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff38c005440 con 0x55db61d28b40 2024-09-19T08:53:01.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.000+0000 7ff3a41aa740 1 -- 172.21.15.19:0/130064176 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff38c040070 con 0x55db61d28b40 2024-09-19T08:53:01.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.000+0000 7ff37affd640 1 -- 172.21.15.19:0/130064176 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff38c035040 con 0x55db61d28b40 2024-09-19T08:53:01.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.001+0000 7ff3a41aa740 10 client.25210 fetch_fsmap learned FSMap version 28 2024-09-19T08:53:01.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.001+0000 7ff3a41aa740 1 -- 172.21.15.19:0/130064176 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55db61d2cf20 con 0x55db61d28b40 2024-09-19T08:53:01.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.001+0000 7ff37affd640 1 -- 172.21.15.19:0/130064176 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff38c040070 con 0x55db61d28b40 2024-09-19T08:53:01.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.001+0000 7ff37affd640 1 -- 172.21.15.19:0/130064176 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7ff38c004cb0 con 0x55db61d28b40 2024-09-19T08:53:01.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.001+0000 7ff3a41aa740 10 client.25210 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:53:01.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.001+0000 7ff3a41aa740 10 client.25210 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:53:01.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.001+0000 7ff3a41aa740 20 client.25210 populate_metadata read hostname 'smithi019' 2024-09-19T08:53:01.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.001+0000 7ff3a41aa740 1 --2- 172.21.15.19:0/130064176 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55db61db64b0 0x55db61db88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:01.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.001+0000 7ff3a41aa740 4 client.25210 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:53:01.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.001+0000 7ff3a41aa740 1 -- 172.21.15.19:0/130064176 --> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55db61c94d70 con 0x55db61db64b0 2024-09-19T08:53:01.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.001+0000 7ff39affd640 1 --2- 172.21.15.19:0/130064176 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55db61db64b0 0x55db61db88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:01.006 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T08:53:01.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.002+0000 7ff39affd640 1 --2- 172.21.15.19:0/130064176 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55db61db64b0 0x55db61db88a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5ba6414b1179e6ef server_cookie=28a0fb049efc89c6 in_seq=0 out_seq=0 2024-09-19T08:53:01.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.002+0000 7ff37affd640 10 client.25210 ms_handle_connect on v2:172.21.15.203:6838/2547507299 2024-09-19T08:53:01.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.002+0000 7ff37affd640 1 -- 172.21.15.19:0/130064176 <== mds.1 v2:172.21.15.203:6838/2547507299 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55db61c94d70 con 0x55db61db64b0 2024-09-19T08:53:01.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.002+0000 7ff37affd640 10 client.25210 handle_command_reply: tid=0 2024-09-19T08:53:01.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.002+0000 7ff3a41aa740 1 client.25210 shutdown 2024-09-19T08:53:01.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.002+0000 7ff3a41aa740 1 -- 172.21.15.19:0/130064176 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55db61d28b40 msgr2=0x55db61d3ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:01.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.002+0000 7ff3a41aa740 1 --2- 172.21.15.19:0/130064176 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55db61d28b40 0x55db61d3ada0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff38c0096c0 tx=0x7ff38c005850 comp rx=0 tx=0).stop 2024-09-19T08:53:01.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.002+0000 7ff3a41aa740 1 -- 172.21.15.19:0/130064176 shutdown_connections 2024-09-19T08:53:01.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.002+0000 7ff3a41aa740 1 --2- 172.21.15.19:0/130064176 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55db61db64b0 0x55db61db88a0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:01.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.002+0000 7ff3a41aa740 1 --2- 172.21.15.19:0/130064176 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55db61d28b40 0x55db61d3ada0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:01.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.002+0000 7ff3a41aa740 1 --2- 172.21.15.19:0/130064176 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55db61d32370 0x55db61d2b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:01.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.002+0000 7ff3a41aa740 1 --2- 172.21.15.19:0/130064176 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55db61d23130 0x55db61d3a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:01.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.002+0000 7ff3a41aa740 1 -- 172.21.15.19:0/130064176 >> 172.21.15.19:0/130064176 conn(0x55db61cf0310 msgr2=0x55db61d30820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:01.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.002+0000 7ff37affd640 0 client.25210 ms_handle_reset on v2:172.21.15.203:6838/2547507299 2024-09-19T08:53:01.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.002+0000 7ff3a41aa740 1 -- 172.21.15.19:0/130064176 shutdown_connections 2024-09-19T08:53:01.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.003+0000 7ff3a41aa740 1 -- 172.21.15.19:0/130064176 wait complete. 2024-09-19T08:53:01.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.003+0000 7ff3a41aa740 20 client.25210 trim_cache size 0 max 16384 2024-09-19T08:53:01.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.003+0000 7ff3a1dd1640 1 -- 172.21.15.19:0/4113531614 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff3840a3350 msgr2=0x7ff3840a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:01.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.003+0000 7ff3a1dd1640 1 --2- 172.21.15.19:0/4113531614 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff3840a3350 0x7ff3840a5810 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff3940092f0 tx=0x7ff394098400 comp rx=0 tx=0).stop 2024-09-19T08:53:01.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.003+0000 7ff3a1dd1640 1 -- 172.21.15.19:0/4113531614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff39c102ef0 msgr2=0x7ff39c19cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:01.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.003+0000 7ff3a1dd1640 1 --2- 172.21.15.19:0/4113531614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff39c102ef0 0x7ff39c19cd90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff39400eaa0 tx=0x7ff39400ef60 comp rx=0 tx=0).stop 2024-09-19T08:53:01.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.003+0000 7ff3a1dd1640 1 -- 172.21.15.19:0/4113531614 shutdown_connections 2024-09-19T08:53:01.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.003+0000 7ff3a1dd1640 1 --2- 172.21.15.19:0/4113531614 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff3840a3350 0x7ff3840a5810 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:01.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.003+0000 7ff3a1dd1640 1 --2- 172.21.15.19:0/4113531614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff39c102ef0 0x7ff39c19cd90 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:01.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.003+0000 7ff3a1dd1640 1 --2- 172.21.15.19:0/4113531614 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff39c102570 0x7ff39c198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:01.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.003+0000 7ff3a1dd1640 1 --2- 172.21.15.19:0/4113531614 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff39c100e20 0x7ff39c1984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:01.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.003+0000 7ff3a1dd1640 1 -- 172.21.15.19:0/4113531614 >> 172.21.15.19:0/4113531614 conn(0x7ff39c0fc7d0 msgr2=0x7ff39c06a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:01.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.003+0000 7ff3a1dd1640 1 -- 172.21.15.19:0/4113531614 shutdown_connections 2024-09-19T08:53:01.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:01.003+0000 7ff3a1dd1640 1 -- 172.21.15.19:0/4113531614 wait complete. 2024-09-19T08:53:01.011 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:01.683 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:53:01.898 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:01 smithi019 ceph-mon[30976]: pgmap v361: 97 pgs: 97 active+clean; 664 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-19T08:53:02.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.119+0000 7f19f01dc640 1 -- 172.21.15.19:0/508799198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19e810c2f0 msgr2=0x7f19e810e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:02.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.119+0000 7f19f01dc640 1 --2- 172.21.15.19:0/508799198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19e810c2f0 0x7f19e810e790 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f19e0009ca0 tx=0x7f19e002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:53:02.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.119+0000 7f19f01dc640 1 -- 172.21.15.19:0/508799198 shutdown_connections 2024-09-19T08:53:02.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.119+0000 7f19f01dc640 1 --2- 172.21.15.19:0/508799198 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19e81037a0 0x7f19e810bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:02.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.119+0000 7f19f01dc640 1 --2- 172.21.15.19:0/508799198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19e810c2f0 0x7f19e810e790 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:02.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.119+0000 7f19f01dc640 1 --2- 172.21.15.19:0/508799198 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19e8102df0 0x7f19e81031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:02.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.119+0000 7f19f01dc640 1 -- 172.21.15.19:0/508799198 >> 172.21.15.19:0/508799198 conn(0x7f19e80fc7d0 msgr2=0x7f19e80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:02.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.119+0000 7f19f01dc640 1 -- 172.21.15.19:0/508799198 shutdown_connections 2024-09-19T08:53:02.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.119+0000 7f19f01dc640 1 -- 172.21.15.19:0/508799198 wait complete. 2024-09-19T08:53:02.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.120+0000 7f19f01dc640 1 Processor -- start 2024-09-19T08:53:02.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.120+0000 7f19f01dc640 1 -- start start 2024-09-19T08:53:02.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.120+0000 7f19f01dc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19e8102df0 0x7f19e8100a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:02.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.120+0000 7f19f01dc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19e81037a0 0x7f19e8100f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:02.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.120+0000 7f19f01dc640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19e810c2f0 0x7f19e81014d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:02.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.120+0000 7f19f01dc640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f19e81120f0 con 0x7f19e81037a0 2024-09-19T08:53:02.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.120+0000 7f19f01dc640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f19e8111f70 con 0x7f19e8102df0 2024-09-19T08:53:02.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.120+0000 7f19f01dc640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f19e8112270 con 0x7f19e810c2f0 2024-09-19T08:53:02.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.120+0000 7f19ed777640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19e81037a0 0x7f19e8100f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:02.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.121+0000 7f19ed777640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19e81037a0 0x7f19e8100f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52248/0 (socket says 172.21.15.19:52248) 2024-09-19T08:53:02.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.121+0000 7f19ed777640 1 -- 172.21.15.19:0/1411424986 learned_addr learned my addr 172.21.15.19:0/1411424986 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:02.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.121+0000 7f19ee779640 1 --2- 172.21.15.19:0/1411424986 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19e810c2f0 0x7f19e81014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:02.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.121+0000 7f19edf78640 1 --2- 172.21.15.19:0/1411424986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19e8102df0 0x7f19e8100a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:02.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.121+0000 7f19ed777640 1 -- 172.21.15.19:0/1411424986 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19e810c2f0 msgr2=0x7f19e81014d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:02.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.121+0000 7f19ed777640 1 --2- 172.21.15.19:0/1411424986 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19e810c2f0 0x7f19e81014d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:02.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.121+0000 7f19ed777640 1 -- 172.21.15.19:0/1411424986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19e8102df0 msgr2=0x7f19e8100a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:02.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.121+0000 7f19ed777640 1 --2- 172.21.15.19:0/1411424986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19e8102df0 0x7f19e8100a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:02.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.121+0000 7f19ed777640 1 -- 172.21.15.19:0/1411424986 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19e81a6a50 con 0x7f19e81037a0 2024-09-19T08:53:02.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.121+0000 7f19ed777640 1 --2- 172.21.15.19:0/1411424986 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19e81037a0 0x7f19e8100f90 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f19d800d740 tx=0x7f19d800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:02.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.121+0000 7f19deffd640 1 -- 172.21.15.19:0/1411424986 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d8017070 con 0x7f19e81037a0 2024-09-19T08:53:02.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.121+0000 7f19deffd640 1 -- 172.21.15.19:0/1411424986 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19d800de50 con 0x7f19e81037a0 2024-09-19T08:53:02.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.121+0000 7f19f01dc640 1 -- 172.21.15.19:0/1411424986 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19e81a6d40 con 0x7f19e81037a0 2024-09-19T08:53:02.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.121+0000 7f19deffd640 1 -- 172.21.15.19:0/1411424986 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d800f6b0 con 0x7f19e81037a0 2024-09-19T08:53:02.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.121+0000 7f19f01dc640 1 -- 172.21.15.19:0/1411424986 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19e81a7220 con 0x7f19e81037a0 2024-09-19T08:53:02.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.124+0000 7f19f25b5740 1 Processor -- start 2024-09-19T08:53:02.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.124+0000 7f19f25b5740 1 -- start start 2024-09-19T08:53:02.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.125+0000 7f19deffd640 1 -- 172.21.15.19:0/1411424986 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f19d801a070 con 0x7f19e81037a0 2024-09-19T08:53:02.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.125+0000 7f19f25b5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560966f23760 0x560966f23b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:02.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.125+0000 7f19f25b5740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560966f24080 0x560966f2e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:02.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.125+0000 7f19f25b5740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560966f2e940 0x560966f30d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:02.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.125+0000 7f19f25b5740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560966e892a0 con 0x560966f24080 2024-09-19T08:53:02.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.125+0000 7f19f25b5740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x560966e30b10 con 0x560966f2e940 2024-09-19T08:53:02.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.125+0000 7f19f25b5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560966e85260 con 0x560966f23760 2024-09-19T08:53:02.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.125+0000 7f19edf78640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560966f24080 0x560966f2e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:02.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.125+0000 7f19edf78640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560966f24080 0x560966f2e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52260/0 (socket says 172.21.15.19:52260) 2024-09-19T08:53:02.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.125+0000 7f19edf78640 1 -- 172.21.15.19:0/473031031 learned_addr learned my addr 172.21.15.19:0/473031031 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:02.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.125+0000 7f19ee779640 1 --2- 172.21.15.19:0/473031031 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560966f23760 0x560966f23b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:02.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.125+0000 7f19ed777640 1 --2- 172.21.15.19:0/473031031 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560966f2e940 0x560966f30d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:02.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.125+0000 7f19edf78640 1 -- 172.21.15.19:0/473031031 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560966f23760 msgr2=0x560966f23b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:02.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.125+0000 7f19edf78640 1 --2- 172.21.15.19:0/473031031 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560966f23760 0x560966f23b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:02.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.125+0000 7f19edf78640 1 -- 172.21.15.19:0/473031031 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560966f2e940 msgr2=0x560966f30d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:02.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.125+0000 7f19edf78640 1 --2- 172.21.15.19:0/473031031 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560966f2e940 0x560966f30d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:02.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.125+0000 7f19edf78640 1 -- 172.21.15.19:0/473031031 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560966bfab90 con 0x560966f24080 2024-09-19T08:53:02.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.126+0000 7f19edf78640 1 --2- 172.21.15.19:0/473031031 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560966f24080 0x560966f2e400 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f19e4009cf0 tx=0x7f19e4011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14bf6c06f39d25f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:02.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.126+0000 7f19deffd640 1 --2- 172.21.15.19:0/1411424986 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f19d40a32d0 0x7f19d40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:02.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.126+0000 7f19d3fff640 1 -- 172.21.15.19:0/473031031 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e4004230 con 0x560966f24080 2024-09-19T08:53:02.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.126+0000 7f19d3fff640 1 -- 172.21.15.19:0/473031031 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19e40043d0 con 0x560966f24080 2024-09-19T08:53:02.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.126+0000 7f19d3fff640 1 -- 172.21.15.19:0/473031031 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e4019960 con 0x560966f24080 2024-09-19T08:53:02.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.126+0000 7f19ee779640 1 --2- 172.21.15.19:0/1411424986 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f19d40a32d0 0x7f19d40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:02.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.126+0000 7f19deffd640 1 -- 172.21.15.19:0/1411424986 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f19d80cf720 con 0x7f19e81037a0 2024-09-19T08:53:02.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.127+0000 7f19f25b5740 1 -- 172.21.15.19:0/473031031 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560966f24080 msgr2=0x560966f2e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:02.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.127+0000 7f19ee779640 1 --2- 172.21.15.19:0/1411424986 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f19d40a32d0 0x7f19d40a5790 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f19e0004af0 tx=0x7f19e0004a80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:02.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.127+0000 7f19f25b5740 1 --2- 172.21.15.19:0/473031031 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560966f24080 0x560966f2e400 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f19e4009cf0 tx=0x7f19e4011810 comp rx=0 tx=0).stop 2024-09-19T08:53:02.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.127+0000 7f19f25b5740 1 -- 172.21.15.19:0/473031031 shutdown_connections 2024-09-19T08:53:02.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.127+0000 7f19f25b5740 1 --2- 172.21.15.19:0/473031031 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560966f2e940 0x560966f30d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:02.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.127+0000 7f19f25b5740 1 --2- 172.21.15.19:0/473031031 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560966f24080 0x560966f2e400 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:02.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.127+0000 7f19f25b5740 1 --2- 172.21.15.19:0/473031031 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560966f23760 0x560966f23b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:02.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.127+0000 7f19f25b5740 1 -- 172.21.15.19:0/473031031 >> 172.21.15.19:0/473031031 conn(0x560966f1fcf0 msgr2=0x560966f200d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:02.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.127+0000 7f19f25b5740 1 -- 172.21.15.19:0/473031031 shutdown_connections 2024-09-19T08:53:02.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.127+0000 7f19f25b5740 1 -- 172.21.15.19:0/473031031 wait complete. 2024-09-19T08:53:02.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.127+0000 7f19f25b5740 1 -- start start 2024-09-19T08:53:02.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.128+0000 7f19f25b5740 1 Processor -- start 2024-09-19T08:53:02.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.128+0000 7f19f25b5740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560966f23760 0x560966f2b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:02.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.128+0000 7f19f25b5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560966f24080 0x560966f2bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:02.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.128+0000 7f19f25b5740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560966f2e940 0x560966f2c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:02.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.128+0000 7f19f25b5740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560966f31510 con 0x560966f23760 2024-09-19T08:53:02.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.128+0000 7f19f25b5740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x560966e116e0 con 0x560966f2e940 2024-09-19T08:53:02.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.128+0000 7f19f25b5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560966f31690 con 0x560966f24080 2024-09-19T08:53:02.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.128+0000 7f19f25b5740 10 client.0 _ll_register_callbacks cb 0x560966e35a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:02.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.128+0000 7f19edf78640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560966f23760 0x560966f2b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:02.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.128+0000 7f19edf78640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560966f23760 0x560966f2b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52262/0 (socket says 172.21.15.19:52262) 2024-09-19T08:53:02.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.128+0000 7f19edf78640 1 -- 172.21.15.19:0/294975899 learned_addr learned my addr 172.21.15.19:0/294975899 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:02.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.128+0000 7f19ee779640 1 --2- 172.21.15.19:0/294975899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560966f2e940 0x560966f2c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:02.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.128+0000 7f19ed777640 1 --2- 172.21.15.19:0/294975899 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560966f24080 0x560966f2bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:02.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.129+0000 7f19edf78640 1 -- 172.21.15.19:0/294975899 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560966f24080 msgr2=0x560966f2bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:02.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.129+0000 7f19edf78640 1 --2- 172.21.15.19:0/294975899 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560966f24080 0x560966f2bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:02.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.129+0000 7f19edf78640 1 -- 172.21.15.19:0/294975899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560966f2e940 msgr2=0x560966f2c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:02.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.129+0000 7f19edf78640 1 --2- 172.21.15.19:0/294975899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560966f2e940 0x560966f2c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:02.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.129+0000 7f19edf78640 1 -- 172.21.15.19:0/294975899 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560966f3a9b0 con 0x560966f23760 2024-09-19T08:53:02.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.129+0000 7f19edf78640 1 --2- 172.21.15.19:0/294975899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560966f23760 0x560966f2b7b0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f19e4003820 tx=0x7f19e4003850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5642c4ea9a124a5d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:02.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.129+0000 7f19d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:53:02.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.129+0000 7f19d17fa640 1 -- 172.21.15.19:0/294975899 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e4027070 con 0x560966f23760 2024-09-19T08:53:02.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.129+0000 7f19d17fa640 1 -- 172.21.15.19:0/294975899 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f19e4005240 con 0x560966f23760 2024-09-19T08:53:02.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.129+0000 7f19f25b5740 1 -- 172.21.15.19:0/294975899 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19e40043d0 con 0x560966f23760 2024-09-19T08:53:02.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.129+0000 7f19d17fa640 1 -- 172.21.15.19:0/294975899 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f19e4033050 con 0x560966f23760 2024-09-19T08:53:02.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.129+0000 7f19f25b5740 10 client.15624 fetch_fsmap learned FSMap version 28 2024-09-19T08:53:02.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.129+0000 7f19f25b5740 1 -- 172.21.15.19:0/294975899 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560966f3d340 con 0x560966f23760 2024-09-19T08:53:02.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.130+0000 7f19d17fa640 1 -- 172.21.15.19:0/294975899 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19e40043d0 con 0x560966f23760 2024-09-19T08:53:02.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.130+0000 7f19d17fa640 1 -- 172.21.15.19:0/294975899 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f19e4004ba0 con 0x560966f23760 2024-09-19T08:53:02.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.130+0000 7f19f25b5740 10 client.15624 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:53:02.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.130+0000 7f19f25b5740 10 client.15624 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T08:53:02.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.130+0000 7f19f25b5740 20 client.15624 populate_metadata read hostname 'smithi019' 2024-09-19T08:53:02.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.130+0000 7f19f25b5740 1 --2- 172.21.15.19:0/294975899 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560966f3e6f0 0x560966f40ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:02.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.130+0000 7f19f25b5740 4 client.15624 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:53:02.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.130+0000 7f19f25b5740 1 -- 172.21.15.19:0/294975899 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560966e969d0 con 0x560966f3e6f0 2024-09-19T08:53:02.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.130+0000 7f19ed777640 1 --2- 172.21.15.19:0/294975899 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560966f3e6f0 0x560966f40ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:02.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.131+0000 7f19d17fa640 10 client.15624 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:02.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.131+0000 7f19ed777640 1 --2- 172.21.15.19:0/294975899 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560966f3e6f0 0x560966f40ae0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8258decda7b5e126 server_cookie=eb51da28e84fce5e in_seq=0 out_seq=0 2024-09-19T08:53:02.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.131+0000 7f19d17fa640 1 -- 172.21.15.19:0/294975899 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560966e969d0 con 0x560966f3e6f0 2024-09-19T08:53:02.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.131+0000 7f19d17fa640 10 client.15624 handle_command_reply: tid=0 2024-09-19T08:53:02.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.131+0000 7f19f25b5740 1 client.15624 shutdown 2024-09-19T08:53:02.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.132+0000 7f19f25b5740 1 -- 172.21.15.19:0/294975899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560966f23760 msgr2=0x560966f2b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:02.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.132+0000 7f19f25b5740 1 --2- 172.21.15.19:0/294975899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560966f23760 0x560966f2b7b0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f19e4003820 tx=0x7f19e4003850 comp rx=0 tx=0).stop 2024-09-19T08:53:02.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.132+0000 7f19f25b5740 1 -- 172.21.15.19:0/294975899 shutdown_connections 2024-09-19T08:53:02.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.132+0000 7f19f25b5740 1 --2- 172.21.15.19:0/294975899 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560966f3e6f0 0x560966f40ae0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:02.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.132+0000 7f19f25b5740 1 --2- 172.21.15.19:0/294975899 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560966f24080 0x560966f2bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:02.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.132+0000 7f19f25b5740 1 --2- 172.21.15.19:0/294975899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560966f2e940 0x560966f2c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:02.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.132+0000 7f19d17fa640 0 client.15624 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:02.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.132+0000 7f19f25b5740 1 --2- 172.21.15.19:0/294975899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560966f23760 0x560966f2b7b0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:02.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.132+0000 7f19f25b5740 1 -- 172.21.15.19:0/294975899 >> 172.21.15.19:0/294975899 conn(0x560966f1fcf0 msgr2=0x560966f259d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:02.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.132+0000 7f19f25b5740 1 -- 172.21.15.19:0/294975899 shutdown_connections 2024-09-19T08:53:02.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.132+0000 7f19f25b5740 1 -- 172.21.15.19:0/294975899 wait complete. 2024-09-19T08:53:02.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.132+0000 7f19f25b5740 20 client.15624 trim_cache size 0 max 16384 2024-09-19T08:53:02.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.151+0000 7f19f25b5740 1 Processor -- start 2024-09-19T08:53:02.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.151+0000 7f19f25b5740 1 -- start start 2024-09-19T08:53:02.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.151+0000 7f19f25b5740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560966f23760 0x560966f261c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:02.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.151+0000 7f19f25b5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560966f24080 0x560966f39ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:02.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.151+0000 7f19f25b5740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560966f2e940 0x560966f3a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:02.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.151+0000 7f19f25b5740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f19e81af840 con 0x560966f2e940 2024-09-19T08:53:02.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.151+0000 7f19f25b5740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f19e81b1380 con 0x560966f23760 2024-09-19T08:53:02.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.151+0000 7f19f25b5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f19e81aff10 con 0x560966f24080 2024-09-19T08:53:02.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.151+0000 7f19edf78640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560966f23760 0x560966f261c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:02.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.151+0000 7f19ed777640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560966f24080 0x560966f39ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:02.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.151+0000 7f19ee779640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560966f2e940 0x560966f3a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:02.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.151+0000 7f19ed777640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560966f24080 0x560966f39ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:52148/0 (socket says 172.21.15.19:52148) 2024-09-19T08:53:02.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.151+0000 7f19edf78640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560966f23760 0x560966f261c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:53968/0 (socket says 172.21.15.19:53968) 2024-09-19T08:53:02.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.151+0000 7f19ed777640 1 -- 172.21.15.19:0/3061534228 learned_addr learned my addr 172.21.15.19:0/3061534228 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:02.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.152+0000 7f19ed777640 1 -- 172.21.15.19:0/3061534228 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560966f23760 msgr2=0x560966f261c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:02.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.152+0000 7f19ed777640 1 --2- 172.21.15.19:0/3061534228 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560966f23760 0x560966f261c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:02.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.152+0000 7f19ed777640 1 -- 172.21.15.19:0/3061534228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560966f2e940 msgr2=0x560966f3a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:02.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.152+0000 7f19ed777640 1 --2- 172.21.15.19:0/3061534228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560966f2e940 0x560966f3a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:02.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.152+0000 7f19ed777640 1 -- 172.21.15.19:0/3061534228 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560966f23eb0 con 0x560966f24080 2024-09-19T08:53:02.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.152+0000 7f19ee779640 1 --2- 172.21.15.19:0/3061534228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560966f2e940 0x560966f3a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:53:02.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.152+0000 7f19ed777640 1 --2- 172.21.15.19:0/3061534228 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560966f24080 0x560966f39ea0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f19d80cd110 tx=0x7f19d80d5530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13745f3e2c609787 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:02.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.152+0000 7f19d37fe640 1 -- 172.21.15.19:0/3061534228 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d8021040 con 0x560966f24080 2024-09-19T08:53:02.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.152+0000 7f19d37fe640 1 -- 172.21.15.19:0/3061534228 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19d809bca0 con 0x560966f24080 2024-09-19T08:53:02.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.152+0000 7f19d37fe640 1 -- 172.21.15.19:0/3061534228 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d80a43d0 con 0x560966f24080 2024-09-19T08:53:02.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.153+0000 7f19f25b5740 1 -- 172.21.15.19:0/3061534228 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560966f24080 msgr2=0x560966f39ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:02.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.153+0000 7f19f25b5740 1 --2- 172.21.15.19:0/3061534228 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560966f24080 0x560966f39ea0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f19d80cd110 tx=0x7f19d80d5530 comp rx=0 tx=0).stop 2024-09-19T08:53:02.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.153+0000 7f19f25b5740 1 -- 172.21.15.19:0/3061534228 shutdown_connections 2024-09-19T08:53:02.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.153+0000 7f19f25b5740 1 --2- 172.21.15.19:0/3061534228 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560966f24080 0x560966f39ea0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:02.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.153+0000 7f19f25b5740 1 --2- 172.21.15.19:0/3061534228 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560966f2e940 0x560966f3a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:02.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.153+0000 7f19f25b5740 1 --2- 172.21.15.19:0/3061534228 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560966f23760 0x560966f261c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:02.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.153+0000 7f19f25b5740 1 -- 172.21.15.19:0/3061534228 >> 172.21.15.19:0/3061534228 conn(0x560966f1fcf0 msgr2=0x560966f39790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:02.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.153+0000 7f19f25b5740 1 -- 172.21.15.19:0/3061534228 shutdown_connections 2024-09-19T08:53:02.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.153+0000 7f19f25b5740 1 -- 172.21.15.19:0/3061534228 wait complete. 2024-09-19T08:53:02.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.153+0000 7f19f25b5740 1 -- start start 2024-09-19T08:53:02.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.153+0000 7f19f25b5740 1 Processor -- start 2024-09-19T08:53:02.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.154+0000 7f19f25b5740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560966f23760 0x560966f329c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:02.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.154+0000 7f19f25b5740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560966f24080 0x560966f32f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:02.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.154+0000 7f19f25b5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560966f2e940 0x560966fa8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:02.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.154+0000 7f19f25b5740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f19e81b0cb0 con 0x560966f23760 2024-09-19T08:53:02.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.154+0000 7f19f25b5740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f19e81b05e0 con 0x560966f24080 2024-09-19T08:53:02.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.154+0000 7f19f25b5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f19e81ad820 con 0x560966f2e940 2024-09-19T08:53:02.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.154+0000 7f19f25b5740 10 client.0 _ll_register_callbacks cb 0x7f19e4009b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:02.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.154+0000 7f19edf78640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560966f23760 0x560966f329c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:02.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.154+0000 7f19edf78640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560966f23760 0x560966f329c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52278/0 (socket says 172.21.15.19:52278) 2024-09-19T08:53:02.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.154+0000 7f19edf78640 1 -- 172.21.15.19:0/3729408223 learned_addr learned my addr 172.21.15.19:0/3729408223 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:02.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.154+0000 7f19ee779640 1 --2- 172.21.15.19:0/3729408223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560966f2e940 0x560966fa8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:02.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.154+0000 7f19ed777640 1 --2- 172.21.15.19:0/3729408223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560966f24080 0x560966f32f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:02.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.155+0000 7f19edf78640 1 -- 172.21.15.19:0/3729408223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560966f2e940 msgr2=0x560966fa8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:02.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.155+0000 7f19edf78640 1 --2- 172.21.15.19:0/3729408223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560966f2e940 0x560966fa8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:02.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.155+0000 7f19edf78640 1 -- 172.21.15.19:0/3729408223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560966f24080 msgr2=0x560966f32f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:02.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.155+0000 7f19edf78640 1 --2- 172.21.15.19:0/3729408223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560966f24080 0x560966f32f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:02.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.155+0000 7f19edf78640 1 -- 172.21.15.19:0/3729408223 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560966f337b0 con 0x560966f23760 2024-09-19T08:53:02.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.155+0000 7f19ed777640 1 --2- 172.21.15.19:0/3729408223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560966f24080 0x560966f32f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:53:02.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.155+0000 7f19edf78640 1 --2- 172.21.15.19:0/3729408223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560966f23760 0x560966f329c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f19e40059f0 tx=0x7f19e40198c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cf4d66a287fe03c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:02.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.155+0000 7f19d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:53:02.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.155+0000 7f19d17fa640 1 -- 172.21.15.19:0/3729408223 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e4027070 con 0x560966f23760 2024-09-19T08:53:02.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.155+0000 7f19d17fa640 1 -- 172.21.15.19:0/3729408223 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f19e4019c90 con 0x560966f23760 2024-09-19T08:53:02.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.155+0000 7f19f25b5740 1 -- 172.21.15.19:0/3729408223 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19d809bca0 con 0x560966f23760 2024-09-19T08:53:02.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.156+0000 7f19d17fa640 1 -- 172.21.15.19:0/3729408223 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f19e4009910 con 0x560966f23760 2024-09-19T08:53:02.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.156+0000 7f19f25b5740 10 client.15630 fetch_fsmap learned FSMap version 28 2024-09-19T08:53:02.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.156+0000 7f19f25b5740 1 -- 172.21.15.19:0/3729408223 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x560966fa9820 con 0x560966f23760 2024-09-19T08:53:02.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.156+0000 7f19d17fa640 1 -- 172.21.15.19:0/3729408223 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19d809bca0 con 0x560966f23760 2024-09-19T08:53:02.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.156+0000 7f19d17fa640 1 -- 172.21.15.19:0/3729408223 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f19e4004580 con 0x560966f23760 2024-09-19T08:53:02.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.156+0000 7f19f25b5740 10 client.15630 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:53:02.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.156+0000 7f19f25b5740 10 client.15630 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T08:53:02.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.156+0000 7f19f25b5740 20 client.15630 populate_metadata read hostname 'smithi019' 2024-09-19T08:53:02.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.156+0000 7f19f25b5740 1 --2- 172.21.15.19:0/3729408223 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560966fa9f70 0x560966fac390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:02.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.156+0000 7f19f25b5740 4 client.15630 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.2, "await_for": 45.0}] 2024-09-19T08:53:02.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.156+0000 7f19f25b5740 1 -- 172.21.15.19:0/3729408223 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 131.2, "await_for": 45.0}) -- 0x560966e90d20 con 0x560966fa9f70 2024-09-19T08:53:02.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.156+0000 7f19ed777640 1 --2- 172.21.15.19:0/3729408223 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560966fa9f70 0x560966fac390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:02.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.157+0000 7f19ed777640 1 --2- 172.21.15.19:0/3729408223 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560966fa9f70 0x560966fac390 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f081ec3f817691b1 server_cookie=dccd6bb371816f5d in_seq=0 out_seq=0 2024-09-19T08:53:02.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.157+0000 7f19d17fa640 10 client.15630 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:02.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.168+0000 7f19d17fa640 1 -- 172.21.15.19:0/3729408223 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x560966e90d20 con 0x560966fa9f70 2024-09-19T08:53:02.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.168+0000 7f19d17fa640 10 client.15630 handle_command_reply: tid=0 2024-09-19T08:53:02.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.168+0000 7f19f25b5740 1 client.15630 shutdown 2024-09-19T08:53:02.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.168+0000 7f19f25b5740 1 -- 172.21.15.19:0/3729408223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560966f23760 msgr2=0x560966f329c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:02.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.168+0000 7f19f25b5740 1 --2- 172.21.15.19:0/3729408223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560966f23760 0x560966f329c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f19e40059f0 tx=0x7f19e40198c0 comp rx=0 tx=0).stop 2024-09-19T08:53:02.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.168+0000 7f19f25b5740 1 -- 172.21.15.19:0/3729408223 shutdown_connections 2024-09-19T08:53:02.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.168+0000 7f19f25b5740 1 --2- 172.21.15.19:0/3729408223 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560966fa9f70 0x560966fac390 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:02.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.168+0000 7f19f25b5740 1 --2- 172.21.15.19:0/3729408223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560966f2e940 0x560966fa8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:02.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.168+0000 7f19d17fa640 0 client.15630 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:02.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.168+0000 7f19f25b5740 1 --2- 172.21.15.19:0/3729408223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560966f24080 0x560966f32f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:02.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.168+0000 7f19f25b5740 1 --2- 172.21.15.19:0/3729408223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560966f23760 0x560966f329c0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:02.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.168+0000 7f19f25b5740 1 -- 172.21.15.19:0/3729408223 >> 172.21.15.19:0/3729408223 conn(0x560966f1fcf0 msgr2=0x560966f39fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:02.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.169+0000 7f19f25b5740 1 -- 172.21.15.19:0/3729408223 shutdown_connections 2024-09-19T08:53:02.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.169+0000 7f19f25b5740 1 -- 172.21.15.19:0/3729408223 wait complete. 2024-09-19T08:53:02.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.169+0000 7f19f25b5740 20 client.15630 trim_cache size 0 max 16384 2024-09-19T08:53:02.171 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:53:02.171 INFO:teuthology.orchestra.run.smithi019.stdout: "epoch": 28, 2024-09-19T08:53:02.171 INFO:teuthology.orchestra.run.smithi019.stdout: "leader": 24497, 2024-09-19T08:53:02.171 INFO:teuthology.orchestra.run.smithi019.stdout: "set_version": 2, 2024-09-19T08:53:02.171 INFO:teuthology.orchestra.run.smithi019.stdout: "sets": { 2024-09-19T08:53:02.171 INFO:teuthology.orchestra.run.smithi019.stdout: "9b6cce55": { 2024-09-19T08:53:02.171 INFO:teuthology.orchestra.run.smithi019.stdout: "version": 2, 2024-09-19T08:53:02.171 INFO:teuthology.orchestra.run.smithi019.stdout: "age_ref": 0.0, 2024-09-19T08:53:02.171 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T08:53:02.171 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "QUIESCED", 2024-09-19T08:53:02.172 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T08:53:02.172 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T08:53:02.172 INFO:teuthology.orchestra.run.smithi019.stdout: "timeout": 90.0, 2024-09-19T08:53:02.172 INFO:teuthology.orchestra.run.smithi019.stdout: "expiration": 131.2, 2024-09-19T08:53:02.172 INFO:teuthology.orchestra.run.smithi019.stdout: "members": { 2024-09-19T08:53:02.172 INFO:teuthology.orchestra.run.smithi019.stdout: "file:/": { 2024-09-19T08:53:02.172 INFO:teuthology.orchestra.run.smithi019.stdout: "excluded": false, 2024-09-19T08:53:02.172 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T08:53:02.172 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "QUIESCED", 2024-09-19T08:53:02.172 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T08:53:02.172 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:53:02.173 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:53:02.173 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:53:02.173 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:53:02.173 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:53:02.173 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:53:02.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.169+0000 7f19f01dc640 1 -- 172.21.15.19:0/1411424986 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f19d40a32d0 msgr2=0x7f19d40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:02.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.169+0000 7f19f01dc640 1 --2- 172.21.15.19:0/1411424986 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f19d40a32d0 0x7f19d40a5790 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f19e0004af0 tx=0x7f19e0004a80 comp rx=0 tx=0).stop 2024-09-19T08:53:02.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.169+0000 7f19f01dc640 1 -- 172.21.15.19:0/1411424986 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19e81037a0 msgr2=0x7f19e8100f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:02.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.169+0000 7f19f01dc640 1 --2- 172.21.15.19:0/1411424986 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19e81037a0 0x7f19e8100f90 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f19d800d740 tx=0x7f19d800dc00 comp rx=0 tx=0).stop 2024-09-19T08:53:02.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.170+0000 7f19f01dc640 1 -- 172.21.15.19:0/1411424986 shutdown_connections 2024-09-19T08:53:02.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.170+0000 7f19f01dc640 1 --2- 172.21.15.19:0/1411424986 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f19d40a32d0 0x7f19d40a5790 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:02.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.170+0000 7f19f01dc640 1 --2- 172.21.15.19:0/1411424986 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19e810c2f0 0x7f19e81014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:02.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.170+0000 7f19f01dc640 1 --2- 172.21.15.19:0/1411424986 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19e81037a0 0x7f19e8100f90 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:02.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.170+0000 7f19f01dc640 1 --2- 172.21.15.19:0/1411424986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19e8102df0 0x7f19e8100a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:02.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.170+0000 7f19f01dc640 1 -- 172.21.15.19:0/1411424986 >> 172.21.15.19:0/1411424986 conn(0x7f19e80fc7d0 msgr2=0x7f19e80fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:02.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.170+0000 7f19f01dc640 1 -- 172.21.15.19:0/1411424986 shutdown_connections 2024-09-19T08:53:02.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:02.170+0000 7f19f01dc640 1 -- 172.21.15.19:0/1411424986 wait complete. 2024-09-19T08:53:02.175 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:01 smithi155 ceph-mon[34921]: pgmap v361: 97 pgs: 97 active+clean; 664 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-19T08:53:02.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:01 smithi203 ceph-mon[35450]: pgmap v361: 97 pgs: 97 active+clean; 664 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-19T08:53:02.859 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '9b6cce55', quiesce took 6.4 seconds. Will release after: 4.799999999999999 2024-09-19T08:53:02.883 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:03.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.360+0000 7fbc2332c640 1 -- 172.21.15.19:0/475705190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc1c102ef0 msgr2=0x7fbc1c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:03.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.360+0000 7fbc2332c640 1 --2- 172.21.15.19:0/475705190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc1c102ef0 0x7fbc1c10da40 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fbc14009ca0 tx=0x7fbc1402a950 comp rx=0 tx=0).stop 2024-09-19T08:53:03.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.360+0000 7fbc2332c640 1 -- 172.21.15.19:0/475705190 shutdown_connections 2024-09-19T08:53:03.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.360+0000 7fbc2332c640 1 --2- 172.21.15.19:0/475705190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc1c102ef0 0x7fbc1c10da40 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:03.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.360+0000 7fbc2332c640 1 --2- 172.21.15.19:0/475705190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc1c102570 0x7fbc1c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:03.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.360+0000 7fbc2332c640 1 --2- 172.21.15.19:0/475705190 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc1c100e20 0x7fbc1c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:03.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.360+0000 7fbc2332c640 1 -- 172.21.15.19:0/475705190 >> 172.21.15.19:0/475705190 conn(0x7fbc1c0fc7d0 msgr2=0x7fbc1c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:03.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.360+0000 7fbc2332c640 1 -- 172.21.15.19:0/475705190 shutdown_connections 2024-09-19T08:53:03.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.360+0000 7fbc2332c640 1 -- 172.21.15.19:0/475705190 wait complete. 2024-09-19T08:53:03.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.361+0000 7fbc2332c640 1 Processor -- start 2024-09-19T08:53:03.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.361+0000 7fbc2332c640 1 -- start start 2024-09-19T08:53:03.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.361+0000 7fbc2332c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc1c100e20 0x7fbc1c197460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:03.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.361+0000 7fbc2332c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc1c102570 0x7fbc1c1979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:03.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.361+0000 7fbc2332c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc1c102ef0 0x7fbc1c19bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:03.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.361+0000 7fbc2332c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1c110f80 con 0x7fbc1c102ef0 2024-09-19T08:53:03.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.362+0000 7fbc2332c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1c110e00 con 0x7fbc1c100e20 2024-09-19T08:53:03.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.362+0000 7fbc2332c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1c111100 con 0x7fbc1c102570 2024-09-19T08:53:03.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.362+0000 7fbc218c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc1c102ef0 0x7fbc1c19bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:03.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.362+0000 7fbc218c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc1c102ef0 0x7fbc1c19bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52300/0 (socket says 172.21.15.19:52300) 2024-09-19T08:53:03.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.362+0000 7fbc218c9640 1 -- 172.21.15.19:0/3969814345 learned_addr learned my addr 172.21.15.19:0/3969814345 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:03.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.362+0000 7fbc208c7640 1 --2- 172.21.15.19:0/3969814345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc1c102570 0x7fbc1c1979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:03.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.362+0000 7fbc210c8640 1 --2- 172.21.15.19:0/3969814345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc1c100e20 0x7fbc1c197460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:03.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.362+0000 7fbc218c9640 1 -- 172.21.15.19:0/3969814345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc1c102570 msgr2=0x7fbc1c1979a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:03.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.362+0000 7fbc218c9640 1 --2- 172.21.15.19:0/3969814345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc1c102570 0x7fbc1c1979a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:03.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.362+0000 7fbc218c9640 1 -- 172.21.15.19:0/3969814345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc1c100e20 msgr2=0x7fbc1c197460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:03.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.362+0000 7fbc218c9640 1 --2- 172.21.15.19:0/3969814345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc1c100e20 0x7fbc1c197460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:03.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.362+0000 7fbc218c9640 1 -- 172.21.15.19:0/3969814345 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc1c19c410 con 0x7fbc1c102ef0 2024-09-19T08:53:03.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.363+0000 7fbc218c9640 1 --2- 172.21.15.19:0/3969814345 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc1c102ef0 0x7fbc1c19bd30 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fbc1402ae70 tx=0x7fbc14003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:03.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.363+0000 7fbc127fc640 1 -- 172.21.15.19:0/3969814345 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc14034040 con 0x7fbc1c102ef0 2024-09-19T08:53:03.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.363+0000 7fbc127fc640 1 -- 172.21.15.19:0/3969814345 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc1402f710 con 0x7fbc1c102ef0 2024-09-19T08:53:03.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.363+0000 7fbc2332c640 1 -- 172.21.15.19:0/3969814345 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc1c19c6a0 con 0x7fbc1c102ef0 2024-09-19T08:53:03.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.363+0000 7fbc127fc640 1 -- 172.21.15.19:0/3969814345 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc14045480 con 0x7fbc1c102ef0 2024-09-19T08:53:03.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.363+0000 7fbc2332c640 1 -- 172.21.15.19:0/3969814345 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc1c1a3fe0 con 0x7fbc1c102ef0 2024-09-19T08:53:03.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.366+0000 7fbc127fc640 1 -- 172.21.15.19:0/3969814345 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7fbc14037020 con 0x7fbc1c102ef0 2024-09-19T08:53:03.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.366+0000 7fbc127fc640 1 --2- 172.21.15.19:0/3969814345 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbc080a3350 0x7fbc080a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:03.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.367+0000 7fbc25705740 1 Processor -- start 2024-09-19T08:53:03.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.367+0000 7fbc210c8640 1 --2- 172.21.15.19:0/3969814345 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbc080a3350 0x7fbc080a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:03.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.367+0000 7fbc127fc640 1 -- 172.21.15.19:0/3969814345 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fbc140f07d0 con 0x7fbc1c102ef0 2024-09-19T08:53:03.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.367+0000 7fbc25705740 1 -- start start 2024-09-19T08:53:03.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.367+0000 7fbc25705740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028fbd9a20 0x56028fbd8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:03.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.367+0000 7fbc25705740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56028fbd85d0 0x56028fbd8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:03.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.367+0000 7fbc25705740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56028fbe7970 0x56028fbe9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:03.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.367+0000 7fbc25705740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56028fb3e2f0 con 0x56028fbd9a20 2024-09-19T08:53:03.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.367+0000 7fbc25705740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56028fae5cf0 con 0x56028fbe7970 2024-09-19T08:53:03.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.367+0000 7fbc25705740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56028fb3a2b0 con 0x56028fbd85d0 2024-09-19T08:53:03.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.367+0000 7fbc210c8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028fbd9a20 0x56028fbd8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:03.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.367+0000 7fbc210c8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028fbd9a20 0x56028fbd8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52304/0 (socket says 172.21.15.19:52304) 2024-09-19T08:53:03.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.367+0000 7fbc210c8640 1 -- 172.21.15.19:0/3845904989 learned_addr learned my addr 172.21.15.19:0/3845904989 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:03.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.367+0000 7fbc218c9640 1 --2- 172.21.15.19:0/3845904989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56028fbe7970 0x56028fbe9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:03.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.367+0000 7fbc208c7640 1 --2- 172.21.15.19:0/3845904989 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56028fbd85d0 0x56028fbd8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:03.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.368+0000 7fbc218c9640 1 -- 172.21.15.19:0/3845904989 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56028fbd85d0 msgr2=0x56028fbd8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:03.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.368+0000 7fbc218c9640 1 --2- 172.21.15.19:0/3845904989 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56028fbd85d0 0x56028fbd8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:03.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.368+0000 7fbc218c9640 1 -- 172.21.15.19:0/3845904989 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028fbd9a20 msgr2=0x56028fbd8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:03.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.368+0000 7fbc218c9640 1 --2- 172.21.15.19:0/3845904989 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028fbd9a20 0x56028fbd8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:03.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.368+0000 7fbc218c9640 1 -- 172.21.15.19:0/3845904989 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56028faca3a0 con 0x56028fbe7970 2024-09-19T08:53:03.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.368+0000 7fbc210c8640 1 --2- 172.21.15.19:0/3845904989 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028fbd9a20 0x56028fbd8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:53:03.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.368+0000 7fbc218c9640 1 --2- 172.21.15.19:0/3845904989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56028fbe7970 0x56028fbe9d60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbc140ee2a0 tx=0x7fbc1402a950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=779236ff626a6740 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:03.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.368+0000 7fbc077fe640 1 -- 172.21.15.19:0/3845904989 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc1402c040 con 0x56028fbe7970 2024-09-19T08:53:03.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.368+0000 7fbc210c8640 1 --2- 172.21.15.19:0/3969814345 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbc080a3350 0x7fbc080a5810 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbc180036b0 tx=0x7fbc180041d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:03.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.368+0000 7fbc077fe640 1 -- 172.21.15.19:0/3845904989 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc14004040 con 0x56028fbe7970 2024-09-19T08:53:03.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.368+0000 7fbc077fe640 1 -- 172.21.15.19:0/3845904989 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc140b9420 con 0x56028fbe7970 2024-09-19T08:53:03.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.369+0000 7fbc25705740 1 -- 172.21.15.19:0/3845904989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56028fbe7970 msgr2=0x56028fbe9d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:03.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.369+0000 7fbc25705740 1 --2- 172.21.15.19:0/3845904989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56028fbe7970 0x56028fbe9d60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbc140ee2a0 tx=0x7fbc1402a950 comp rx=0 tx=0).stop 2024-09-19T08:53:03.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.369+0000 7fbc25705740 1 -- 172.21.15.19:0/3845904989 shutdown_connections 2024-09-19T08:53:03.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.369+0000 7fbc25705740 1 --2- 172.21.15.19:0/3845904989 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56028fbd85d0 0x56028fbd8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:03.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.369+0000 7fbc25705740 1 --2- 172.21.15.19:0/3845904989 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56028fbe7970 0x56028fbe9d60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:03.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.369+0000 7fbc25705740 1 --2- 172.21.15.19:0/3845904989 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028fbd9a20 0x56028fbd8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:03.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.369+0000 7fbc25705740 1 -- 172.21.15.19:0/3845904989 >> 172.21.15.19:0/3845904989 conn(0x56028fba1310 msgr2=0x56028fbd4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:03.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.370+0000 7fbc25705740 1 -- 172.21.15.19:0/3845904989 shutdown_connections 2024-09-19T08:53:03.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.370+0000 7fbc25705740 1 -- 172.21.15.19:0/3845904989 wait complete. 2024-09-19T08:53:03.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.370+0000 7fbc25705740 1 -- start start 2024-09-19T08:53:03.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.370+0000 7fbc25705740 1 Processor -- start 2024-09-19T08:53:03.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.371+0000 7fbc25705740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028fbd85d0 0x56028fbe7330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:03.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.371+0000 7fbc25705740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56028fbd9a20 0x56028fbe45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:03.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.371+0000 7fbc25705740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56028fbe7970 0x56028fbe4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:03.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.371+0000 7fbc210c8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028fbd85d0 0x56028fbe7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:03.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.371+0000 7fbc210c8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028fbd85d0 0x56028fbe7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52306/0 (socket says 172.21.15.19:52306) 2024-09-19T08:53:03.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.371+0000 7fbc210c8640 1 -- 172.21.15.19:0/3897539504 learned_addr learned my addr 172.21.15.19:0/3897539504 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:03.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.371+0000 7fbc25705740 1 -- 172.21.15.19:0/3897539504 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56028fae5cf0 con 0x56028fbd85d0 2024-09-19T08:53:03.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.371+0000 7fbc25705740 1 -- 172.21.15.19:0/3897539504 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56028faf9060 con 0x56028fbd9a20 2024-09-19T08:53:03.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.371+0000 7fbc25705740 1 -- 172.21.15.19:0/3897539504 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56028fbea300 con 0x56028fbe7970 2024-09-19T08:53:03.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.372+0000 7fbc208c7640 1 --2- 172.21.15.19:0/3897539504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56028fbd9a20 0x56028fbe45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:03.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.372+0000 7fbc25705740 10 client.0 _ll_register_callbacks cb 0x56028f84c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:03.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.372+0000 7fbc218c9640 1 --2- 172.21.15.19:0/3897539504 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56028fbe7970 0x56028fbe4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:03.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.372+0000 7fbc210c8640 1 -- 172.21.15.19:0/3897539504 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56028fbe7970 msgr2=0x56028fbe4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:03.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.372+0000 7fbc210c8640 1 --2- 172.21.15.19:0/3897539504 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56028fbe7970 0x56028fbe4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:03.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.372+0000 7fbc210c8640 1 -- 172.21.15.19:0/3897539504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56028fbd9a20 msgr2=0x56028fbe45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:03.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.372+0000 7fbc210c8640 1 --2- 172.21.15.19:0/3897539504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56028fbd9a20 0x56028fbe45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:03.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.372+0000 7fbc210c8640 1 -- 172.21.15.19:0/3897539504 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56028f8af3c0 con 0x56028fbd85d0 2024-09-19T08:53:03.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.372+0000 7fbc210c8640 1 --2- 172.21.15.19:0/3897539504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028fbd85d0 0x56028fbe7330 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fbc18012740 tx=0x7fbc180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28daecf356898472 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:03.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.372+0000 7fbc04ff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:53:03.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.372+0000 7fbc04ff9640 1 -- 172.21.15.19:0/3897539504 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc1800f7d0 con 0x56028fbd85d0 2024-09-19T08:53:03.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.372+0000 7fbc04ff9640 1 -- 172.21.15.19:0/3897539504 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fbc1800f970 con 0x56028fbd85d0 2024-09-19T08:53:03.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.372+0000 7fbc25705740 1 -- 172.21.15.19:0/3897539504 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56028fb4b860 con 0x56028fbd85d0 2024-09-19T08:53:03.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.373+0000 7fbc04ff9640 1 -- 172.21.15.19:0/3897539504 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbc1800fb70 con 0x56028fbd85d0 2024-09-19T08:53:03.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.373+0000 7fbc25705740 10 client.15642 fetch_fsmap learned FSMap version 28 2024-09-19T08:53:03.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.373+0000 7fbc25705740 1 -- 172.21.15.19:0/3897539504 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56028fbf5c10 con 0x56028fbd85d0 2024-09-19T08:53:03.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.373+0000 7fbc04ff9640 1 -- 172.21.15.19:0/3897539504 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x56028fb4b860 con 0x56028fbd85d0 2024-09-19T08:53:03.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.373+0000 7fbc04ff9640 1 -- 172.21.15.19:0/3897539504 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbc1802d400 con 0x56028fbd85d0 2024-09-19T08:53:03.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.373+0000 7fbc25705740 10 client.15642 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:53:03.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.373+0000 7fbc25705740 10 client.15642 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:53:03.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.373+0000 7fbc25705740 20 client.15642 populate_metadata read hostname 'smithi019' 2024-09-19T08:53:03.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.373+0000 7fbc25705740 1 --2- 172.21.15.19:0/3897539504 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56028fbf7170 0x56028fbf95d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:03.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.373+0000 7fbc25705740 4 client.15642 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:53:03.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.373+0000 7fbc25705740 1 -- 172.21.15.19:0/3897539504 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56028fb45d70 con 0x56028fbf7170 2024-09-19T08:53:03.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.374+0000 7fbc208c7640 1 --2- 172.21.15.19:0/3897539504 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56028fbf7170 0x56028fbf95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:03.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.374+0000 7fbc04ff9640 10 client.15642 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:03.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.374+0000 7fbc208c7640 1 --2- 172.21.15.19:0/3897539504 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56028fbf7170 0x56028fbf95d0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6088eba6f82bfce4 server_cookie=463aae085405b4f2 in_seq=0 out_seq=0 2024-09-19T08:53:03.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.375+0000 7fbc04ff9640 1 -- 172.21.15.19:0/3897539504 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56028fb45d70 con 0x56028fbf7170 2024-09-19T08:53:03.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.375+0000 7fbc04ff9640 10 client.15642 handle_command_reply: tid=0 2024-09-19T08:53:03.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.375+0000 7fbc25705740 1 client.15642 shutdown 2024-09-19T08:53:03.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.375+0000 7fbc25705740 1 -- 172.21.15.19:0/3897539504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028fbd85d0 msgr2=0x56028fbe7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:03.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.375+0000 7fbc25705740 1 --2- 172.21.15.19:0/3897539504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028fbd85d0 0x56028fbe7330 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fbc18012740 tx=0x7fbc180046c0 comp rx=0 tx=0).stop 2024-09-19T08:53:03.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.375+0000 7fbc25705740 1 -- 172.21.15.19:0/3897539504 shutdown_connections 2024-09-19T08:53:03.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.375+0000 7fbc25705740 1 --2- 172.21.15.19:0/3897539504 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56028fbf7170 0x56028fbf95d0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:03.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.375+0000 7fbc25705740 1 --2- 172.21.15.19:0/3897539504 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56028fbe7970 0x56028fbe4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:03.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.375+0000 7fbc25705740 1 --2- 172.21.15.19:0/3897539504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56028fbd9a20 0x56028fbe45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:03.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.375+0000 7fbc04ff9640 0 client.15642 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:03.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.375+0000 7fbc25705740 1 --2- 172.21.15.19:0/3897539504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028fbd85d0 0x56028fbe7330 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:03.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.375+0000 7fbc25705740 1 -- 172.21.15.19:0/3897539504 >> 172.21.15.19:0/3897539504 conn(0x56028fba1310 msgr2=0x56028fbda9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:03.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.375+0000 7fbc25705740 1 -- 172.21.15.19:0/3897539504 shutdown_connections 2024-09-19T08:53:03.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.375+0000 7fbc25705740 1 -- 172.21.15.19:0/3897539504 wait complete. 2024-09-19T08:53:03.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.376+0000 7fbc25705740 20 client.15642 trim_cache size 0 max 16384 2024-09-19T08:53:03.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.389+0000 7fbc25705740 1 Processor -- start 2024-09-19T08:53:03.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.389+0000 7fbc25705740 1 -- start start 2024-09-19T08:53:03.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.389+0000 7fbc25705740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56028fba1310 0x56028fbf33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:03.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.389+0000 7fbc25705740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56028fbd85d0 0x56028fbe35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:03.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.389+0000 7fbc25705740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028fbd9a20 0x56028fbd7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:03.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.389+0000 7fbc25705740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1c1ab210 con 0x56028fbd9a20 2024-09-19T08:53:03.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.389+0000 7fbc25705740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1c1acd50 con 0x56028fba1310 2024-09-19T08:53:03.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.389+0000 7fbc25705740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1c1ab8e0 con 0x56028fbd85d0 2024-09-19T08:53:03.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.389+0000 7fbc218c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028fbd9a20 0x56028fbd7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:03.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.389+0000 7fbc218c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028fbd9a20 0x56028fbd7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52310/0 (socket says 172.21.15.19:52310) 2024-09-19T08:53:03.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.389+0000 7fbc218c9640 1 -- 172.21.15.19:0/3431904014 learned_addr learned my addr 172.21.15.19:0/3431904014 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:03.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.390+0000 7fbc208c7640 1 --2- 172.21.15.19:0/3431904014 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56028fbd85d0 0x56028fbe35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:03.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.390+0000 7fbc210c8640 1 --2- 172.21.15.19:0/3431904014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56028fba1310 0x56028fbf33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:03.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.390+0000 7fbc218c9640 1 -- 172.21.15.19:0/3431904014 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56028fbd85d0 msgr2=0x56028fbe35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:03.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.390+0000 7fbc218c9640 1 --2- 172.21.15.19:0/3431904014 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56028fbd85d0 0x56028fbe35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:03.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.390+0000 7fbc218c9640 1 -- 172.21.15.19:0/3431904014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56028fba1310 msgr2=0x56028fbf33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:03.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.390+0000 7fbc218c9640 1 --2- 172.21.15.19:0/3431904014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56028fba1310 0x56028fbf33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:03.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.390+0000 7fbc218c9640 1 -- 172.21.15.19:0/3431904014 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56028fbe2b30 con 0x56028fbd9a20 2024-09-19T08:53:03.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.390+0000 7fbc208c7640 1 --2- 172.21.15.19:0/3431904014 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56028fbd85d0 0x56028fbe35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:53:03.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.390+0000 7fbc210c8640 1 --2- 172.21.15.19:0/3431904014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56028fba1310 0x56028fbf33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:53:03.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.390+0000 7fbc218c9640 1 --2- 172.21.15.19:0/3431904014 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028fbd9a20 0x56028fbd7020 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fbc140ee2d0 tx=0x7fbc140bc810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d10d29fe2df8a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:03.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.390+0000 7fbc06ffd640 1 -- 172.21.15.19:0/3431904014 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc1402c040 con 0x56028fbd9a20 2024-09-19T08:53:03.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.391+0000 7fbc06ffd640 1 -- 172.21.15.19:0/3431904014 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc140c1160 con 0x56028fbd9a20 2024-09-19T08:53:03.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.391+0000 7fbc06ffd640 1 -- 172.21.15.19:0/3431904014 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc140bc200 con 0x56028fbd9a20 2024-09-19T08:53:03.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.391+0000 7fbc25705740 1 -- 172.21.15.19:0/3431904014 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028fbd9a20 msgr2=0x56028fbd7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:03.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.391+0000 7fbc25705740 1 --2- 172.21.15.19:0/3431904014 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028fbd9a20 0x56028fbd7020 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fbc140ee2d0 tx=0x7fbc140bc810 comp rx=0 tx=0).stop 2024-09-19T08:53:03.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.392+0000 7fbc25705740 1 -- 172.21.15.19:0/3431904014 shutdown_connections 2024-09-19T08:53:03.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.392+0000 7fbc25705740 1 --2- 172.21.15.19:0/3431904014 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56028fbd85d0 0x56028fbe35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:03.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.392+0000 7fbc25705740 1 --2- 172.21.15.19:0/3431904014 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028fbd9a20 0x56028fbd7020 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:03.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.392+0000 7fbc25705740 1 --2- 172.21.15.19:0/3431904014 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56028fba1310 0x56028fbf33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:03.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.392+0000 7fbc25705740 1 -- 172.21.15.19:0/3431904014 >> 172.21.15.19:0/3431904014 conn(0x56028fbd9460 msgr2=0x56028fbe2eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:03.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.392+0000 7fbc25705740 1 -- 172.21.15.19:0/3431904014 shutdown_connections 2024-09-19T08:53:03.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.392+0000 7fbc25705740 1 -- 172.21.15.19:0/3431904014 wait complete. 2024-09-19T08:53:03.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.392+0000 7fbc25705740 1 -- start start 2024-09-19T08:53:03.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.392+0000 7fbc25705740 1 Processor -- start 2024-09-19T08:53:03.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.393+0000 7fbc25705740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56028fba1310 0x56028fbff550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:03.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.393+0000 7fbc25705740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56028fbd85d0 0x56028fbef550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:03.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.393+0000 7fbc25705740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028fbd9a20 0x56028fbefa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:03.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.393+0000 7fbc25705740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1c1ac680 con 0x56028fbd9a20 2024-09-19T08:53:03.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.393+0000 7fbc25705740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1c1abfb0 con 0x56028fba1310 2024-09-19T08:53:03.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.393+0000 7fbc25705740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbc1c1a9210 con 0x56028fbd85d0 2024-09-19T08:53:03.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.393+0000 7fbc25705740 10 client.0 _ll_register_callbacks cb 0x7fbc18005f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:03.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.393+0000 7fbc218c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028fbd9a20 0x56028fbefa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:03.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.393+0000 7fbc218c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028fbd9a20 0x56028fbefa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52316/0 (socket says 172.21.15.19:52316) 2024-09-19T08:53:03.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.393+0000 7fbc218c9640 1 -- 172.21.15.19:0/4239308520 learned_addr learned my addr 172.21.15.19:0/4239308520 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:03.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.393+0000 7fbc210c8640 1 --2- 172.21.15.19:0/4239308520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56028fba1310 0x56028fbff550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:03.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.393+0000 7fbc208c7640 1 --2- 172.21.15.19:0/4239308520 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56028fbd85d0 0x56028fbef550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:03.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.393+0000 7fbc218c9640 1 -- 172.21.15.19:0/4239308520 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56028fbd85d0 msgr2=0x56028fbef550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:03.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.393+0000 7fbc218c9640 1 --2- 172.21.15.19:0/4239308520 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56028fbd85d0 0x56028fbef550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:03.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.393+0000 7fbc218c9640 1 -- 172.21.15.19:0/4239308520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56028fba1310 msgr2=0x56028fbff550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:03.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.393+0000 7fbc218c9640 1 --2- 172.21.15.19:0/4239308520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56028fba1310 0x56028fbff550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:03.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.393+0000 7fbc218c9640 1 -- 172.21.15.19:0/4239308520 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56028fbfe0c0 con 0x56028fbd9a20 2024-09-19T08:53:03.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.394+0000 7fbc218c9640 1 --2- 172.21.15.19:0/4239308520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028fbd9a20 0x56028fbefa90 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fbc14004af0 tx=0x7fbc1402a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51d883cd7430d8b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:03.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.394+0000 7fbc04ff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:53:03.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.394+0000 7fbc04ff9640 1 -- 172.21.15.19:0/4239308520 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc1402c040 con 0x56028fbd9a20 2024-09-19T08:53:03.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.394+0000 7fbc04ff9640 1 -- 172.21.15.19:0/4239308520 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fbc140bc200 con 0x56028fbd9a20 2024-09-19T08:53:03.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.394+0000 7fbc25705740 1 -- 172.21.15.19:0/4239308520 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc140c1160 con 0x56028fbd9a20 2024-09-19T08:53:03.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.394+0000 7fbc04ff9640 1 -- 172.21.15.19:0/4239308520 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbc140bd4b0 con 0x56028fbd9a20 2024-09-19T08:53:03.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.394+0000 7fbc25705740 10 client.15648 fetch_fsmap learned FSMap version 28 2024-09-19T08:53:03.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.394+0000 7fbc25705740 1 -- 172.21.15.19:0/4239308520 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56028fc61fc0 con 0x56028fbd9a20 2024-09-19T08:53:03.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.395+0000 7fbc04ff9640 1 -- 172.21.15.19:0/4239308520 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbc140c1160 con 0x56028fbd9a20 2024-09-19T08:53:03.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.395+0000 7fbc04ff9640 1 -- 172.21.15.19:0/4239308520 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7fbc1404d030 con 0x56028fbd9a20 2024-09-19T08:53:03.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.395+0000 7fbc25705740 10 client.15648 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:53:03.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.395+0000 7fbc25705740 10 client.15648 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:53:03.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.395+0000 7fbc25705740 20 client.15648 populate_metadata read hostname 'smithi019' 2024-09-19T08:53:03.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.395+0000 7fbc25705740 1 --2- 172.21.15.19:0/4239308520 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56028fbe7970 0x56028fc642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:03.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.395+0000 7fbc25705740 4 client.15648 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:53:03.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.395+0000 7fbc25705740 1 -- 172.21.15.19:0/4239308520 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56028fac2170 con 0x56028fbe7970 2024-09-19T08:53:03.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.395+0000 7fbc210c8640 1 --2- 172.21.15.19:0/4239308520 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56028fbe7970 0x56028fc642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:03.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.396+0000 7fbc210c8640 1 --2- 172.21.15.19:0/4239308520 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56028fbe7970 0x56028fc642a0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f5095e7ca02756e server_cookie=52e307ba2295c562 in_seq=0 out_seq=0 2024-09-19T08:53:03.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.396+0000 7fbc04ff9640 10 client.15648 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:03.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.396+0000 7fbc04ff9640 1 -- 172.21.15.19:0/4239308520 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56028fac2170 con 0x56028fbe7970 2024-09-19T08:53:03.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.396+0000 7fbc04ff9640 10 client.15648 handle_command_reply: tid=0 2024-09-19T08:53:03.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.396+0000 7fbc25705740 1 client.15648 shutdown 2024-09-19T08:53:03.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.396+0000 7fbc25705740 1 -- 172.21.15.19:0/4239308520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028fbd9a20 msgr2=0x56028fbefa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:03.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.396+0000 7fbc25705740 1 --2- 172.21.15.19:0/4239308520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028fbd9a20 0x56028fbefa90 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fbc14004af0 tx=0x7fbc1402a950 comp rx=0 tx=0).stop 2024-09-19T08:53:03.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.396+0000 7fbc25705740 1 -- 172.21.15.19:0/4239308520 shutdown_connections 2024-09-19T08:53:03.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.396+0000 7fbc25705740 1 --2- 172.21.15.19:0/4239308520 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56028fbe7970 0x56028fc642a0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:03.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.396+0000 7fbc25705740 1 --2- 172.21.15.19:0/4239308520 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56028fbd85d0 0x56028fbef550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:03.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.396+0000 7fbc04ff9640 0 client.15648 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:03.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.396+0000 7fbc25705740 1 --2- 172.21.15.19:0/4239308520 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56028fbd9a20 0x56028fbefa90 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:03.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.396+0000 7fbc25705740 1 --2- 172.21.15.19:0/4239308520 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56028fba1310 0x56028fbff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:03.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.396+0000 7fbc25705740 1 -- 172.21.15.19:0/4239308520 >> 172.21.15.19:0/4239308520 conn(0x56028fbd9460 msgr2=0x56028fbe36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:03.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.397+0000 7fbc25705740 1 -- 172.21.15.19:0/4239308520 shutdown_connections 2024-09-19T08:53:03.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.397+0000 7fbc25705740 1 -- 172.21.15.19:0/4239308520 wait complete. 2024-09-19T08:53:03.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.397+0000 7fbc25705740 20 client.15648 trim_cache size 0 max 16384 2024-09-19T08:53:03.401 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T08:53:03.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.398+0000 7fbc2332c640 1 -- 172.21.15.19:0/3969814345 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbc080a3350 msgr2=0x7fbc080a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:03.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.398+0000 7fbc2332c640 1 --2- 172.21.15.19:0/3969814345 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbc080a3350 0x7fbc080a5810 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fbc180036b0 tx=0x7fbc180041d0 comp rx=0 tx=0).stop 2024-09-19T08:53:03.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.398+0000 7fbc2332c640 1 -- 172.21.15.19:0/3969814345 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc1c102ef0 msgr2=0x7fbc1c19bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:03.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.398+0000 7fbc2332c640 1 --2- 172.21.15.19:0/3969814345 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc1c102ef0 0x7fbc1c19bd30 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fbc1402ae70 tx=0x7fbc14003ba0 comp rx=0 tx=0).stop 2024-09-19T08:53:03.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.398+0000 7fbc2332c640 1 -- 172.21.15.19:0/3969814345 shutdown_connections 2024-09-19T08:53:03.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.398+0000 7fbc2332c640 1 --2- 172.21.15.19:0/3969814345 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbc080a3350 0x7fbc080a5810 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:03.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.398+0000 7fbc2332c640 1 --2- 172.21.15.19:0/3969814345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbc1c102570 0x7fbc1c1979a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:03.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.398+0000 7fbc2332c640 1 --2- 172.21.15.19:0/3969814345 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbc1c102ef0 0x7fbc1c19bd30 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:03.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.398+0000 7fbc2332c640 1 --2- 172.21.15.19:0/3969814345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbc1c100e20 0x7fbc1c197460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:03.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.398+0000 7fbc2332c640 1 -- 172.21.15.19:0/3969814345 >> 172.21.15.19:0/3969814345 conn(0x7fbc1c0fc7d0 msgr2=0x7fbc1c1068d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:03.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.398+0000 7fbc2332c640 1 -- 172.21.15.19:0/3969814345 shutdown_connections 2024-09-19T08:53:03.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:03.398+0000 7fbc2332c640 1 -- 172.21.15.19:0/3969814345 wait complete. 2024-09-19T08:53:04.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:03 smithi019 ceph-mon[30976]: pgmap v362: 97 pgs: 97 active+clean; 664 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-19T08:53:04.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:03 smithi155 ceph-mon[34921]: pgmap v362: 97 pgs: 97 active+clean; 664 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-19T08:53:04.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:03 smithi203 ceph-mon[35450]: pgmap v362: 97 pgs: 97 active+clean; 664 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 255 B/s wr, 10 op/s 2024-09-19T08:53:05.163 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:53:05.163 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:53:05.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:04 smithi155 ceph-mon[34921]: pgmap v363: 97 pgs: 97 active+clean; 669 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-19T08:53:05.191 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:04 smithi019 ceph-mon[30976]: pgmap v363: 97 pgs: 97 active+clean; 669 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-19T08:53:05.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:04 smithi203 ceph-mon[35450]: pgmap v363: 97 pgs: 97 active+clean; 669 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-19T08:53:05.479 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:06.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.011+0000 7f7e7e3b7640 1 -- 172.21.15.19:0/1032339237 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e78100e20 msgr2=0x7f7e78101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:06.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.011+0000 7f7e7e3b7640 1 --2- 172.21.15.19:0/1032339237 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e78100e20 0x7f7e78101200 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f7e68009900 tx=0x7f7e6802a480 comp rx=0 tx=0).stop 2024-09-19T08:53:06.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.011+0000 7f7e7e3b7640 1 -- 172.21.15.19:0/1032339237 shutdown_connections 2024-09-19T08:53:06.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.011+0000 7f7e7e3b7640 1 --2- 172.21.15.19:0/1032339237 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e78102570 0x7f7e781029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:06.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.011+0000 7f7e7e3b7640 1 --2- 172.21.15.19:0/1032339237 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e78102ef0 0x7f7e7810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:06.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.011+0000 7f7e7e3b7640 1 --2- 172.21.15.19:0/1032339237 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e78100e20 0x7f7e78101200 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:06.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.011+0000 7f7e7e3b7640 1 -- 172.21.15.19:0/1032339237 >> 172.21.15.19:0/1032339237 conn(0x7f7e780fc7d0 msgr2=0x7f7e780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:06.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.011+0000 7f7e7e3b7640 1 -- 172.21.15.19:0/1032339237 shutdown_connections 2024-09-19T08:53:06.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.011+0000 7f7e7e3b7640 1 -- 172.21.15.19:0/1032339237 wait complete. 2024-09-19T08:53:06.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.012+0000 7f7e7e3b7640 1 Processor -- start 2024-09-19T08:53:06.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.012+0000 7f7e7e3b7640 1 -- start start 2024-09-19T08:53:06.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.012+0000 7f7e7e3b7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e78100e20 0x7f7e78198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:06.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.012+0000 7f7e7e3b7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e78102570 0x7f7e78198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:06.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.012+0000 7f7e7e3b7640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e78102ef0 0x7f7e7819ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:06.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.012+0000 7f7e7e3b7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7e78110f80 con 0x7f7e78102570 2024-09-19T08:53:06.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.012+0000 7f7e7e3b7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7e78110e00 con 0x7f7e78100e20 2024-09-19T08:53:06.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.012+0000 7f7e7e3b7640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7e78111100 con 0x7f7e78102ef0 2024-09-19T08:53:06.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.013+0000 7f7e777fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e78102570 0x7f7e78198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:06.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.013+0000 7f7e777fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e78102570 0x7f7e78198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37442/0 (socket says 172.21.15.19:37442) 2024-09-19T08:53:06.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.013+0000 7f7e777fe640 1 -- 172.21.15.19:0/4219999890 learned_addr learned my addr 172.21.15.19:0/4219999890 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:06.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.013+0000 7f7e77fff640 1 --2- 172.21.15.19:0/4219999890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e78100e20 0x7f7e78198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:06.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.013+0000 7f7e7c954640 1 --2- 172.21.15.19:0/4219999890 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e78102ef0 0x7f7e7819ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:06.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.013+0000 7f7e777fe640 1 -- 172.21.15.19:0/4219999890 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e78102ef0 msgr2=0x7f7e7819ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:06.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.013+0000 7f7e777fe640 1 --2- 172.21.15.19:0/4219999890 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e78102ef0 0x7f7e7819ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:06.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.013+0000 7f7e777fe640 1 -- 172.21.15.19:0/4219999890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e78100e20 msgr2=0x7f7e78198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:06.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.013+0000 7f7e777fe640 1 --2- 172.21.15.19:0/4219999890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e78100e20 0x7f7e78198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:06.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.013+0000 7f7e777fe640 1 -- 172.21.15.19:0/4219999890 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e7819d530 con 0x7f7e78102570 2024-09-19T08:53:06.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.013+0000 7f7e777fe640 1 --2- 172.21.15.19:0/4219999890 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e78102570 0x7f7e78198ac0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00d950 tx=0x7f7e6c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:06.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.013+0000 7f7e757fa640 1 -- 172.21.15.19:0/4219999890 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c017070 con 0x7f7e78102570 2024-09-19T08:53:06.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.013+0000 7f7e7e3b7640 1 -- 172.21.15.19:0/4219999890 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e7819d820 con 0x7f7e78102570 2024-09-19T08:53:06.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.013+0000 7f7e757fa640 1 -- 172.21.15.19:0/4219999890 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e6c009c30 con 0x7f7e78102570 2024-09-19T08:53:06.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.013+0000 7f7e757fa640 1 -- 172.21.15.19:0/4219999890 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c00f6b0 con 0x7f7e78102570 2024-09-19T08:53:06.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.013+0000 7f7e7e3b7640 1 -- 172.21.15.19:0/4219999890 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e781a5100 con 0x7f7e78102570 2024-09-19T08:53:06.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.016+0000 7f7e80790740 1 Processor -- start 2024-09-19T08:53:06.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.017+0000 7f7e80790740 1 -- start start 2024-09-19T08:53:06.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.017+0000 7f7e757fa640 1 -- 172.21.15.19:0/4219999890 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f7e6c0109d0 con 0x7f7e78102570 2024-09-19T08:53:06.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.017+0000 7f7e80790740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a149895b60 0x55a149895f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:06.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.017+0000 7f7e80790740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a149896480 0x55a1498a0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:06.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.017+0000 7f7e80790740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1498a0d40 0x55a1498a3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:06.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.017+0000 7f7e80790740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a1497fb280 con 0x55a1498a0d40 2024-09-19T08:53:06.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.017+0000 7f7e80790740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55a1497a2b10 con 0x55a149896480 2024-09-19T08:53:06.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.017+0000 7f7e80790740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a1497f7240 con 0x55a149895b60 2024-09-19T08:53:06.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.017+0000 7f7e777fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1498a0d40 0x55a1498a3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:06.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.017+0000 7f7e777fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1498a0d40 0x55a1498a3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37456/0 (socket says 172.21.15.19:37456) 2024-09-19T08:53:06.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.017+0000 7f7e777fe640 1 -- 172.21.15.19:0/3482831546 learned_addr learned my addr 172.21.15.19:0/3482831546 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:06.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.017+0000 7f7e7c954640 1 --2- 172.21.15.19:0/3482831546 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a149895b60 0x55a149895f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:06.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.017+0000 7f7e77fff640 1 --2- 172.21.15.19:0/3482831546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a149896480 0x55a1498a0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:06.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.018+0000 7f7e7c954640 1 -- 172.21.15.19:0/3482831546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a149896480 msgr2=0x55a1498a0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:06.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.018+0000 7f7e7c954640 1 --2- 172.21.15.19:0/3482831546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a149896480 0x55a1498a0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:06.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.018+0000 7f7e7c954640 1 -- 172.21.15.19:0/3482831546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1498a0d40 msgr2=0x55a1498a3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:06.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.018+0000 7f7e7c954640 1 --2- 172.21.15.19:0/3482831546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1498a0d40 0x55a1498a3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:06.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.018+0000 7f7e7c954640 1 -- 172.21.15.19:0/3482831546 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1497af1f0 con 0x55a149895b60 2024-09-19T08:53:06.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.018+0000 7f7e757fa640 1 --2- 172.21.15.19:0/4219999890 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7e600a3350 0x7f7e600a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:06.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.018+0000 7f7e757fa640 1 -- 172.21.15.19:0/4219999890 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7e6c0cf920 con 0x7f7e78102570 2024-09-19T08:53:06.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.018+0000 7f7e77fff640 1 --2- 172.21.15.19:0/4219999890 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7e600a3350 0x7f7e600a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:06.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.018+0000 7f7e7c954640 1 --2- 172.21.15.19:0/3482831546 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a149895b60 0x55a149895f40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7e7000ad50 tx=0x7f7e7000f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74346e2a6b89573a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:06.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.018+0000 7f7e5e7fc640 1 -- 172.21.15.19:0/3482831546 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e70003b70 con 0x55a149895b60 2024-09-19T08:53:06.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.018+0000 7f7e5e7fc640 1 -- 172.21.15.19:0/3482831546 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e7000ae40 con 0x55a149895b60 2024-09-19T08:53:06.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.018+0000 7f7e5e7fc640 1 -- 172.21.15.19:0/3482831546 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e70010b00 con 0x55a149895b60 2024-09-19T08:53:06.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.019+0000 7f7e80790740 1 -- 172.21.15.19:0/3482831546 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a149895b60 msgr2=0x55a149895f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:06.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.019+0000 7f7e80790740 1 --2- 172.21.15.19:0/3482831546 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a149895b60 0x55a149895f40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7e7000ad50 tx=0x7f7e7000f790 comp rx=0 tx=0).stop 2024-09-19T08:53:06.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.019+0000 7f7e77fff640 1 --2- 172.21.15.19:0/4219999890 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7e600a3350 0x7f7e600a5810 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7e68009230 tx=0x7f7e680058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:06.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.019+0000 7f7e80790740 1 -- 172.21.15.19:0/3482831546 shutdown_connections 2024-09-19T08:53:06.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.019+0000 7f7e80790740 1 --2- 172.21.15.19:0/3482831546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1498a0d40 0x55a1498a3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:06.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.019+0000 7f7e80790740 1 --2- 172.21.15.19:0/3482831546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a149896480 0x55a1498a0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:06.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.019+0000 7f7e80790740 1 --2- 172.21.15.19:0/3482831546 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a149895b60 0x55a149895f40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:06.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.019+0000 7f7e80790740 1 -- 172.21.15.19:0/3482831546 >> 172.21.15.19:0/3482831546 conn(0x55a1498920f0 msgr2=0x55a1498924d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:06.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.019+0000 7f7e80790740 1 -- 172.21.15.19:0/3482831546 shutdown_connections 2024-09-19T08:53:06.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.019+0000 7f7e80790740 1 -- 172.21.15.19:0/3482831546 wait complete. 2024-09-19T08:53:06.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.019+0000 7f7e80790740 1 -- start start 2024-09-19T08:53:06.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.020+0000 7f7e80790740 1 Processor -- start 2024-09-19T08:53:06.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.020+0000 7f7e80790740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a149895b60 0x55a14989dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:06.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.020+0000 7f7e80790740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a149896480 0x55a14989e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:06.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.020+0000 7f7e80790740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1498a0d40 0x55a14989e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:06.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.020+0000 7f7e80790740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a1498a3910 con 0x55a1498a0d40 2024-09-19T08:53:06.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.020+0000 7f7e80790740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55a1497b5f10 con 0x55a149895b60 2024-09-19T08:53:06.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.020+0000 7f7e80790740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a1498a3a90 con 0x55a149896480 2024-09-19T08:53:06.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.020+0000 7f7e80790740 10 client.0 _ll_register_callbacks cb 0x55a14977ea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:06.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.020+0000 7f7e7c954640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1498a0d40 0x55a14989e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:06.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.020+0000 7f7e7c954640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1498a0d40 0x55a14989e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37462/0 (socket says 172.21.15.19:37462) 2024-09-19T08:53:06.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.020+0000 7f7e7c954640 1 -- 172.21.15.19:0/428508294 learned_addr learned my addr 172.21.15.19:0/428508294 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:06.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.020+0000 7f7e777fe640 1 --2- 172.21.15.19:0/428508294 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a149896480 0x55a14989e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:06.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.020+0000 7f7e77fff640 1 --2- 172.21.15.19:0/428508294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a149895b60 0x55a14989dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:06.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.020+0000 7f7e7c954640 1 -- 172.21.15.19:0/428508294 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a149896480 msgr2=0x55a14989e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:06.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.020+0000 7f7e7c954640 1 --2- 172.21.15.19:0/428508294 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a149896480 0x55a14989e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:06.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.020+0000 7f7e7c954640 1 -- 172.21.15.19:0/428508294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a149895b60 msgr2=0x55a14989dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:06.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.020+0000 7f7e7c954640 1 --2- 172.21.15.19:0/428508294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a149895b60 0x55a14989dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:06.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.020+0000 7f7e7c954640 1 -- 172.21.15.19:0/428508294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a14956c6a0 con 0x55a1498a0d40 2024-09-19T08:53:06.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.020+0000 7f7e777fe640 1 --2- 172.21.15.19:0/428508294 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a149896480 0x55a14989e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:53:06.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.021+0000 7f7e7c954640 1 --2- 172.21.15.19:0/428508294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1498a0d40 0x55a14989e680 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f7e70000f80 tx=0x7f7e70010f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f090e871b0ff858 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:06.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.021+0000 7f7e577fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:53:06.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.021+0000 7f7e77fff640 1 --2- 172.21.15.19:0/428508294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a149895b60 0x55a14989dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:53:06.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.021+0000 7f7e577fe640 1 -- 172.21.15.19:0/428508294 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e70026020 con 0x55a1498a0d40 2024-09-19T08:53:06.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.021+0000 7f7e80790740 1 -- 172.21.15.19:0/428508294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a1498087f0 con 0x55a1498a0d40 2024-09-19T08:53:06.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.021+0000 7f7e577fe640 1 -- 172.21.15.19:0/428508294 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7e70018640 con 0x55a1498a0d40 2024-09-19T08:53:06.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.021+0000 7f7e577fe640 1 -- 172.21.15.19:0/428508294 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7e7001d040 con 0x55a1498a0d40 2024-09-19T08:53:06.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.021+0000 7f7e80790740 10 client.15660 fetch_fsmap learned FSMap version 28 2024-09-19T08:53:06.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.021+0000 7f7e80790740 1 -- 172.21.15.19:0/428508294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a1498b7d60 con 0x55a1498a0d40 2024-09-19T08:53:06.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.021+0000 7f7e577fe640 1 -- 172.21.15.19:0/428508294 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55a1498087f0 con 0x55a1498a0d40 2024-09-19T08:53:06.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.021+0000 7f7e577fe640 1 -- 172.21.15.19:0/428508294 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7e700229b0 con 0x55a1498a0d40 2024-09-19T08:53:06.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.021+0000 7f7e80790740 10 client.15660 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:53:06.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.021+0000 7f7e80790740 10 client.15660 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:53:06.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.021+0000 7f7e80790740 20 client.15660 populate_metadata read hostname 'smithi019' 2024-09-19T08:53:06.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.021+0000 7f7e80790740 1 --2- 172.21.15.19:0/428508294 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a1498b9170 0x55a1498bb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:06.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.021+0000 7f7e80790740 4 client.15660 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:53:06.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.021+0000 7f7e80790740 1 -- 172.21.15.19:0/428508294 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a149802d00 con 0x55a1498b9170 2024-09-19T08:53:06.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.022+0000 7f7e77fff640 1 --2- 172.21.15.19:0/428508294 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a1498b9170 0x55a1498bb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:06.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.022+0000 7f7e577fe640 10 client.15660 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:06.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.022+0000 7f7e77fff640 1 --2- 172.21.15.19:0/428508294 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a1498b9170 0x55a1498bb560 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fb911903f7e2297 server_cookie=f06b0c5346441362 in_seq=0 out_seq=0 2024-09-19T08:53:06.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.023+0000 7f7e577fe640 1 -- 172.21.15.19:0/428508294 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a149802d00 con 0x55a1498b9170 2024-09-19T08:53:06.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.023+0000 7f7e577fe640 10 client.15660 handle_command_reply: tid=0 2024-09-19T08:53:06.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.023+0000 7f7e80790740 1 client.15660 shutdown 2024-09-19T08:53:06.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.023+0000 7f7e80790740 1 -- 172.21.15.19:0/428508294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1498a0d40 msgr2=0x55a14989e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:06.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.023+0000 7f7e80790740 1 --2- 172.21.15.19:0/428508294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1498a0d40 0x55a14989e680 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f7e70000f80 tx=0x7f7e70010f60 comp rx=0 tx=0).stop 2024-09-19T08:53:06.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.023+0000 7f7e80790740 1 -- 172.21.15.19:0/428508294 shutdown_connections 2024-09-19T08:53:06.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.023+0000 7f7e80790740 1 --2- 172.21.15.19:0/428508294 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a1498b9170 0x55a1498bb560 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:06.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.023+0000 7f7e577fe640 0 client.15660 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:06.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.023+0000 7f7e80790740 1 --2- 172.21.15.19:0/428508294 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a149896480 0x55a14989e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:06.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.023+0000 7f7e80790740 1 --2- 172.21.15.19:0/428508294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1498a0d40 0x55a14989e680 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:06.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.023+0000 7f7e80790740 1 --2- 172.21.15.19:0/428508294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a149895b60 0x55a14989dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:06.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.023+0000 7f7e80790740 1 -- 172.21.15.19:0/428508294 >> 172.21.15.19:0/428508294 conn(0x55a1498920f0 msgr2=0x55a149891270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:06.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.023+0000 7f7e80790740 1 -- 172.21.15.19:0/428508294 shutdown_connections 2024-09-19T08:53:06.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.024+0000 7f7e80790740 1 -- 172.21.15.19:0/428508294 wait complete. 2024-09-19T08:53:06.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.024+0000 7f7e80790740 20 client.15660 trim_cache size 0 max 16384 2024-09-19T08:53:06.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.041+0000 7f7e80790740 1 Processor -- start 2024-09-19T08:53:06.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.041+0000 7f7e80790740 1 -- start start 2024-09-19T08:53:06.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.041+0000 7f7e80790740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a149895b60 0x55a1498985c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:06.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.041+0000 7f7e80790740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a149896480 0x55a149891160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:06.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.041+0000 7f7e80790740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1498a0d40 0x55a1498c0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:06.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.041+0000 7f7e80790740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7e781ab430 con 0x55a149895b60 2024-09-19T08:53:06.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.041+0000 7f7e80790740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7e781acf70 con 0x55a149896480 2024-09-19T08:53:06.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.041+0000 7f7e80790740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7e781abb00 con 0x55a1498a0d40 2024-09-19T08:53:06.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.041+0000 7f7e77fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a149895b60 0x55a1498985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:06.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.042+0000 7f7e7c954640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1498a0d40 0x55a1498c0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:06.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.042+0000 7f7e77fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a149895b60 0x55a1498985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37476/0 (socket says 172.21.15.19:37476) 2024-09-19T08:53:06.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.042+0000 7f7e77fff640 1 -- 172.21.15.19:0/1660192582 learned_addr learned my addr 172.21.15.19:0/1660192582 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:06.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.042+0000 7f7e777fe640 1 --2- 172.21.15.19:0/1660192582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a149896480 0x55a149891160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:06.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.042+0000 7f7e77fff640 1 -- 172.21.15.19:0/1660192582 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1498a0d40 msgr2=0x55a1498c0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:06.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.042+0000 7f7e77fff640 1 --2- 172.21.15.19:0/1660192582 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1498a0d40 0x55a1498c0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:06.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.042+0000 7f7e77fff640 1 -- 172.21.15.19:0/1660192582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a149896480 msgr2=0x55a149891160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:06.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.042+0000 7f7e77fff640 1 --2- 172.21.15.19:0/1660192582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a149896480 0x55a149891160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:06.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.042+0000 7f7e77fff640 1 -- 172.21.15.19:0/1660192582 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1498a01e0 con 0x55a149895b60 2024-09-19T08:53:06.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.042+0000 7f7e777fe640 1 --2- 172.21.15.19:0/1660192582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a149896480 0x55a149891160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:53:06.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.042+0000 7f7e77fff640 1 --2- 172.21.15.19:0/1660192582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a149895b60 0x55a1498985c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7e6802a9a0 tx=0x7f7e68040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edaa5409dc412ed0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:06.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.042+0000 7f7e5dffb640 1 -- 172.21.15.19:0/1660192582 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e68035040 con 0x55a149895b60 2024-09-19T08:53:06.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.042+0000 7f7e5dffb640 1 -- 172.21.15.19:0/1660192582 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e68003ad0 con 0x55a149895b60 2024-09-19T08:53:06.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.042+0000 7f7e5dffb640 1 -- 172.21.15.19:0/1660192582 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6803da10 con 0x55a149895b60 2024-09-19T08:53:06.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.043+0000 7f7e80790740 1 -- 172.21.15.19:0/1660192582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a149895b60 msgr2=0x55a1498985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:06.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.043+0000 7f7e80790740 1 --2- 172.21.15.19:0/1660192582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a149895b60 0x55a1498985c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7e6802a9a0 tx=0x7f7e68040000 comp rx=0 tx=0).stop 2024-09-19T08:53:06.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.043+0000 7f7e80790740 1 -- 172.21.15.19:0/1660192582 shutdown_connections 2024-09-19T08:53:06.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.043+0000 7f7e80790740 1 --2- 172.21.15.19:0/1660192582 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1498a0d40 0x55a1498c0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:06.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.043+0000 7f7e80790740 1 --2- 172.21.15.19:0/1660192582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a149896480 0x55a149891160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:06.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.043+0000 7f7e80790740 1 --2- 172.21.15.19:0/1660192582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a149895b60 0x55a1498985c0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:06.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.043+0000 7f7e80790740 1 -- 172.21.15.19:0/1660192582 >> 172.21.15.19:0/1660192582 conn(0x55a1498920f0 msgr2=0x55a149890a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:06.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.043+0000 7f7e80790740 1 -- 172.21.15.19:0/1660192582 shutdown_connections 2024-09-19T08:53:06.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.043+0000 7f7e80790740 1 -- 172.21.15.19:0/1660192582 wait complete. 2024-09-19T08:53:06.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.044+0000 7f7e80790740 1 -- start start 2024-09-19T08:53:06.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.044+0000 7f7e80790740 1 Processor -- start 2024-09-19T08:53:06.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.044+0000 7f7e80790740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a149895b60 0x55a1498b1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:06.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.044+0000 7f7e80790740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a149896480 0x55a1498b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:06.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.044+0000 7f7e80790740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1498a0d40 0x55a14989a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:06.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.044+0000 7f7e80790740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7e781ac8a0 con 0x55a149895b60 2024-09-19T08:53:06.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.044+0000 7f7e80790740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7e781ac1d0 con 0x55a149896480 2024-09-19T08:53:06.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.044+0000 7f7e80790740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7e781a9410 con 0x55a1498a0d40 2024-09-19T08:53:06.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.044+0000 7f7e80790740 10 client.0 _ll_register_callbacks cb 0x7f7e6c0d53a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:06.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.044+0000 7f7e77fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a149895b60 0x55a1498b1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:06.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.044+0000 7f7e77fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a149895b60 0x55a1498b1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37482/0 (socket says 172.21.15.19:37482) 2024-09-19T08:53:06.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.044+0000 7f7e77fff640 1 -- 172.21.15.19:0/631966200 learned_addr learned my addr 172.21.15.19:0/631966200 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:06.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.044+0000 7f7e777fe640 1 --2- 172.21.15.19:0/631966200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a149896480 0x55a1498b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:06.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.044+0000 7f7e7c954640 1 --2- 172.21.15.19:0/631966200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1498a0d40 0x55a14989a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:06.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.045+0000 7f7e77fff640 1 -- 172.21.15.19:0/631966200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1498a0d40 msgr2=0x55a14989a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:06.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.045+0000 7f7e77fff640 1 --2- 172.21.15.19:0/631966200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1498a0d40 0x55a14989a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:06.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.045+0000 7f7e77fff640 1 -- 172.21.15.19:0/631966200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a149896480 msgr2=0x55a1498b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:06.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.045+0000 7f7e77fff640 1 --2- 172.21.15.19:0/631966200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a149896480 0x55a1498b1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:06.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.045+0000 7f7e77fff640 1 -- 172.21.15.19:0/631966200 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a14989afe0 con 0x55a149895b60 2024-09-19T08:53:06.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.045+0000 7f7e7c954640 1 --2- 172.21.15.19:0/631966200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1498a0d40 0x55a14989a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:53:06.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.045+0000 7f7e77fff640 1 --2- 172.21.15.19:0/631966200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a149895b60 0x55a1498b1930 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f7e680314e0 tx=0x7f7e6802a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=970ddbb0416f3902 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:06.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.045+0000 7f7e577fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:53:06.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.045+0000 7f7e577fe640 1 -- 172.21.15.19:0/631966200 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e68060060 con 0x55a149895b60 2024-09-19T08:53:06.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.045+0000 7f7e577fe640 1 -- 172.21.15.19:0/631966200 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7e680035f0 con 0x55a149895b60 2024-09-19T08:53:06.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.045+0000 7f7e80790740 1 -- 172.21.15.19:0/631966200 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e68003ad0 con 0x55a149895b60 2024-09-19T08:53:06.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.045+0000 7f7e577fe640 1 -- 172.21.15.19:0/631966200 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7e68035040 con 0x55a149895b60 2024-09-19T08:53:06.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.045+0000 7f7e80790740 10 client.15666 fetch_fsmap learned FSMap version 28 2024-09-19T08:53:06.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.045+0000 7f7e80790740 1 -- 172.21.15.19:0/631966200 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a1499237e0 con 0x55a149895b60 2024-09-19T08:53:06.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.046+0000 7f7e577fe640 1 -- 172.21.15.19:0/631966200 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7e68003ad0 con 0x55a149895b60 2024-09-19T08:53:06.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.046+0000 7f7e577fe640 1 -- 172.21.15.19:0/631966200 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f7e68044040 con 0x55a149895b60 2024-09-19T08:53:06.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.046+0000 7f7e80790740 10 client.15666 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:53:06.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.046+0000 7f7e80790740 10 client.15666 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:53:06.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.046+0000 7f7e80790740 20 client.15666 populate_metadata read hostname 'smithi019' 2024-09-19T08:53:06.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.046+0000 7f7e80790740 1 --2- 172.21.15.19:0/631966200 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a1498b9170 0x55a149925f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:06.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.046+0000 7f7e80790740 4 client.15666 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:53:06.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.046+0000 7f7e80790740 1 -- 172.21.15.19:0/631966200 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a14977f110 con 0x55a1498b9170 2024-09-19T08:53:06.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.046+0000 7f7e777fe640 1 --2- 172.21.15.19:0/631966200 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a1498b9170 0x55a149925f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:06.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.047+0000 7f7e577fe640 10 client.15666 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:06.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.047+0000 7f7e777fe640 1 --2- 172.21.15.19:0/631966200 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a1498b9170 0x55a149925f10 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b98b0ddfca507b8 server_cookie=60518a6511655b3d in_seq=0 out_seq=0 2024-09-19T08:53:06.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.048+0000 7f7e577fe640 1 -- 172.21.15.19:0/631966200 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a14977f110 con 0x55a1498b9170 2024-09-19T08:53:06.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.048+0000 7f7e577fe640 10 client.15666 handle_command_reply: tid=0 2024-09-19T08:53:06.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.048+0000 7f7e80790740 1 client.15666 shutdown 2024-09-19T08:53:06.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.048+0000 7f7e80790740 1 -- 172.21.15.19:0/631966200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a149895b60 msgr2=0x55a1498b1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:06.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.048+0000 7f7e80790740 1 --2- 172.21.15.19:0/631966200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a149895b60 0x55a1498b1930 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f7e680314e0 tx=0x7f7e6802a480 comp rx=0 tx=0).stop 2024-09-19T08:53:06.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.048+0000 7f7e80790740 1 -- 172.21.15.19:0/631966200 shutdown_connections 2024-09-19T08:53:06.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.048+0000 7f7e80790740 1 --2- 172.21.15.19:0/631966200 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a1498b9170 0x55a149925f10 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:06.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.048+0000 7f7e80790740 1 --2- 172.21.15.19:0/631966200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1498a0d40 0x55a14989a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:06.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.048+0000 7f7e577fe640 0 client.15666 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:06.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.048+0000 7f7e80790740 1 --2- 172.21.15.19:0/631966200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a149896480 0x55a1498b1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:06.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.048+0000 7f7e80790740 1 --2- 172.21.15.19:0/631966200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a149895b60 0x55a1498b1930 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:06.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.048+0000 7f7e80790740 1 -- 172.21.15.19:0/631966200 >> 172.21.15.19:0/631966200 conn(0x55a1498920f0 msgr2=0x55a149891270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:06.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.048+0000 7f7e80790740 1 -- 172.21.15.19:0/631966200 shutdown_connections 2024-09-19T08:53:06.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.048+0000 7f7e80790740 1 -- 172.21.15.19:0/631966200 wait complete. 2024-09-19T08:53:06.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.048+0000 7f7e80790740 20 client.15666 trim_cache size 0 max 16384 2024-09-19T08:53:06.053 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:53:06.053 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-19T08:53:06.053 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "fd406fd3-9ddd-44a4-b863-e02ab55775a3", 2024-09-19T08:53:06.053 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-19T08:53:06.053 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:53:06.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.049+0000 7f7e7e3b7640 1 -- 172.21.15.19:0/4219999890 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7e600a3350 msgr2=0x7f7e600a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:06.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.049+0000 7f7e7e3b7640 1 --2- 172.21.15.19:0/4219999890 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7e600a3350 0x7f7e600a5810 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7e68009230 tx=0x7f7e680058d0 comp rx=0 tx=0).stop 2024-09-19T08:53:06.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.049+0000 7f7e7e3b7640 1 -- 172.21.15.19:0/4219999890 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e78102570 msgr2=0x7f7e78198ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:06.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.049+0000 7f7e7e3b7640 1 --2- 172.21.15.19:0/4219999890 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e78102570 0x7f7e78198ac0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c00d950 tx=0x7f7e6c00de10 comp rx=0 tx=0).stop 2024-09-19T08:53:06.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.049+0000 7f7e7e3b7640 1 -- 172.21.15.19:0/4219999890 shutdown_connections 2024-09-19T08:53:06.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.049+0000 7f7e7e3b7640 1 --2- 172.21.15.19:0/4219999890 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7e600a3350 0x7f7e600a5810 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:06.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.049+0000 7f7e7e3b7640 1 --2- 172.21.15.19:0/4219999890 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7e78102ef0 0x7f7e7819ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:06.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.049+0000 7f7e7e3b7640 1 --2- 172.21.15.19:0/4219999890 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7e78102570 0x7f7e78198ac0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:06.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.049+0000 7f7e7e3b7640 1 --2- 172.21.15.19:0/4219999890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7e78100e20 0x7f7e78198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:06.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.049+0000 7f7e7e3b7640 1 -- 172.21.15.19:0/4219999890 >> 172.21.15.19:0/4219999890 conn(0x7f7e780fc7d0 msgr2=0x7f7e7806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:06.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.049+0000 7f7e7e3b7640 1 -- 172.21.15.19:0/4219999890 shutdown_connections 2024-09-19T08:53:06.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:06.049+0000 7f7e7e3b7640 1 -- 172.21.15.19:0/4219999890 wait complete. 2024-09-19T08:53:06.860 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:53:07.206 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:07.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:06 smithi203 ceph-mon[35450]: pgmap v364: 97 pgs: 97 active+clean; 669 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-19T08:53:07.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:06 smithi019 ceph-mon[30976]: pgmap v364: 97 pgs: 97 active+clean; 669 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-19T08:53:07.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:06 smithi155 ceph-mon[34921]: pgmap v364: 97 pgs: 97 active+clean; 669 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 10 op/s 2024-09-19T08:53:07.661 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:53:07.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.718+0000 7f74b953b640 1 -- 172.21.15.19:0/706125347 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74b410e4d0 msgr2=0x7f74b41108e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:07.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.718+0000 7f74b953b640 1 --2- 172.21.15.19:0/706125347 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74b410e4d0 0x7f74b41108e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f74ac009ca0 tx=0x7f74ac02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.718+0000 7f74b953b640 1 -- 172.21.15.19:0/706125347 shutdown_connections 2024-09-19T08:53:07.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.718+0000 7f74b953b640 1 --2- 172.21.15.19:0/706125347 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74b4101360 0x7f74b410df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.718+0000 7f74b953b640 1 --2- 172.21.15.19:0/706125347 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74b410e4d0 0x7f74b41108e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.718+0000 7f74b953b640 1 --2- 172.21.15.19:0/706125347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74b41009b0 0x7f74b4100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.718+0000 7f74b953b640 1 -- 172.21.15.19:0/706125347 >> 172.21.15.19:0/706125347 conn(0x7f74b40fc7d0 msgr2=0x7f74b40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:07.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.719+0000 7f74b953b640 1 -- 172.21.15.19:0/706125347 shutdown_connections 2024-09-19T08:53:07.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.719+0000 7f74b953b640 1 -- 172.21.15.19:0/706125347 wait complete. 2024-09-19T08:53:07.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.720+0000 7f74b953b640 1 Processor -- start 2024-09-19T08:53:07.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.720+0000 7f74b953b640 1 -- start start 2024-09-19T08:53:07.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.720+0000 7f74b953b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74b41009b0 0x7f74b419a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:07.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.720+0000 7f74b953b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74b4101360 0x7f74b419abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:07.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.720+0000 7f74b953b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74b410e4d0 0x7f74b419ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:07.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.720+0000 7f74b953b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f74b4114200 con 0x7f74b41009b0 2024-09-19T08:53:07.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.720+0000 7f74b953b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f74b4114080 con 0x7f74b410e4d0 2024-09-19T08:53:07.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.720+0000 7f74b953b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f74b4114380 con 0x7f74b4101360 2024-09-19T08:53:07.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.721+0000 7f74b27fc640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74b4101360 0x7f74b419abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:07.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.721+0000 7f74b27fc640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74b4101360 0x7f74b419abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:37318/0 (socket says 172.21.15.19:37318) 2024-09-19T08:53:07.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.721+0000 7f74b27fc640 1 -- 172.21.15.19:0/3284719563 learned_addr learned my addr 172.21.15.19:0/3284719563 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:07.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.721+0000 7f74b2ffd640 1 --2- 172.21.15.19:0/3284719563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74b41009b0 0x7f74b419a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:07.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.721+0000 7f74b37fe640 1 --2- 172.21.15.19:0/3284719563 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74b410e4d0 0x7f74b419ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:07.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.721+0000 7f74b27fc640 1 -- 172.21.15.19:0/3284719563 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74b410e4d0 msgr2=0x7f74b419ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:07.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.721+0000 7f74b27fc640 1 --2- 172.21.15.19:0/3284719563 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74b410e4d0 0x7f74b419ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.721+0000 7f74b27fc640 1 -- 172.21.15.19:0/3284719563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74b41009b0 msgr2=0x7f74b419a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:07.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.721+0000 7f74b27fc640 1 --2- 172.21.15.19:0/3284719563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74b41009b0 0x7f74b419a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.721+0000 7f74b27fc640 1 -- 172.21.15.19:0/3284719563 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b419f650 con 0x7f74b4101360 2024-09-19T08:53:07.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.721+0000 7f74b2ffd640 1 --2- 172.21.15.19:0/3284719563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74b41009b0 0x7f74b419a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:53:07.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.722+0000 7f74b27fc640 1 --2- 172.21.15.19:0/3284719563 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74b4101360 0x7f74b419abe0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f74a800e9f0 tx=0x7f74a800eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:07.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.722+0000 7f749bfff640 1 -- 172.21.15.19:0/3284719563 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a800cd80 con 0x7f74b4101360 2024-09-19T08:53:07.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.722+0000 7f749bfff640 1 -- 172.21.15.19:0/3284719563 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74a8010910 con 0x7f74b4101360 2024-09-19T08:53:07.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.722+0000 7f749bfff640 1 -- 172.21.15.19:0/3284719563 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a8018990 con 0x7f74b4101360 2024-09-19T08:53:07.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.722+0000 7f74b953b640 1 -- 172.21.15.19:0/3284719563 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74b419f940 con 0x7f74b4101360 2024-09-19T08:53:07.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.722+0000 7f74b953b640 1 -- 172.21.15.19:0/3284719563 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74b419fd70 con 0x7f74b4101360 2024-09-19T08:53:07.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.725+0000 7f749bfff640 1 -- 172.21.15.19:0/3284719563 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f74a8010ac0 con 0x7f74b4101360 2024-09-19T08:53:07.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.726+0000 7f74bb914740 1 Processor -- start 2024-09-19T08:53:07.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.726+0000 7f749bfff640 1 --2- 172.21.15.19:0/3284719563 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f749c0a3350 0x7f749c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:07.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.726+0000 7f749bfff640 1 -- 172.21.15.19:0/3284719563 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f74a80cfcc0 con 0x7f74b4101360 2024-09-19T08:53:07.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.726+0000 7f74b37fe640 1 --2- 172.21.15.19:0/3284719563 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f749c0a3350 0x7f749c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:07.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.727+0000 7f74bb914740 1 -- start start 2024-09-19T08:53:07.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.727+0000 7f74b37fe640 1 --2- 172.21.15.19:0/3284719563 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f749c0a3350 0x7f749c0a5810 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f74ac004af0 tx=0x7f74ac004a80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:07.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.727+0000 7f74bb914740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a62ba894a0 0x55a62ba89880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:07.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.727+0000 7f74bb914740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a62ba89dc0 0x55a62ba94140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:07.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.727+0000 7f74bb914740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a62ba94680 0x55a62ba96a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:07.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.727+0000 7f74bb914740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a62b9ef2e0 con 0x55a62ba89dc0 2024-09-19T08:53:07.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.727+0000 7f74bb914740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55a62b996ce0 con 0x55a62ba94680 2024-09-19T08:53:07.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.727+0000 7f74bb914740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a62b9eb2a0 con 0x55a62ba894a0 2024-09-19T08:53:07.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.727+0000 7f74b27fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a62ba89dc0 0x55a62ba94140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:07.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.727+0000 7f74b27fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a62ba89dc0 0x55a62ba94140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37504/0 (socket says 172.21.15.19:37504) 2024-09-19T08:53:07.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.727+0000 7f74b27fc640 1 -- 172.21.15.19:0/321947314 learned_addr learned my addr 172.21.15.19:0/321947314 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:07.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.727+0000 7f74b37fe640 1 --2- 172.21.15.19:0/321947314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a62ba94680 0x55a62ba96a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:07.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.728+0000 7f74b27fc640 1 -- 172.21.15.19:0/321947314 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a62ba894a0 msgr2=0x55a62ba89880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:07.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.728+0000 7f74b2ffd640 1 --2- 172.21.15.19:0/321947314 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a62ba894a0 0x55a62ba89880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:07.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.728+0000 7f74b27fc640 1 --2- 172.21.15.19:0/321947314 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a62ba894a0 0x55a62ba89880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.728+0000 7f74b27fc640 1 -- 172.21.15.19:0/321947314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a62ba94680 msgr2=0x55a62ba96a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:07.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.728+0000 7f74b27fc640 1 --2- 172.21.15.19:0/321947314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a62ba94680 0x55a62ba96a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.728+0000 7f74b27fc640 1 -- 172.21.15.19:0/321947314 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a62b97b440 con 0x55a62ba89dc0 2024-09-19T08:53:07.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.728+0000 7f74b27fc640 1 --2- 172.21.15.19:0/321947314 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a62ba89dc0 0x55a62ba94140 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f74a8098bb0 tx=0x7f74a809bc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21d193ba852dc966 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:07.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.728+0000 7f74997fa640 1 -- 172.21.15.19:0/321947314 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a80cd870 con 0x55a62ba89dc0 2024-09-19T08:53:07.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.728+0000 7f74997fa640 1 -- 172.21.15.19:0/321947314 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74a8098850 con 0x55a62ba89dc0 2024-09-19T08:53:07.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.728+0000 7f74997fa640 1 -- 172.21.15.19:0/321947314 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a8018b30 con 0x55a62ba89dc0 2024-09-19T08:53:07.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.729+0000 7f74bb914740 1 -- 172.21.15.19:0/321947314 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a62ba89dc0 msgr2=0x55a62ba94140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:07.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.729+0000 7f74bb914740 1 --2- 172.21.15.19:0/321947314 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a62ba89dc0 0x55a62ba94140 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f74a8098bb0 tx=0x7f74a809bc60 comp rx=0 tx=0).stop 2024-09-19T08:53:07.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.730+0000 7f74bb914740 1 -- 172.21.15.19:0/321947314 shutdown_connections 2024-09-19T08:53:07.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.730+0000 7f74bb914740 1 --2- 172.21.15.19:0/321947314 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a62ba94680 0x55a62ba96a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.730+0000 7f74bb914740 1 --2- 172.21.15.19:0/321947314 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a62ba89dc0 0x55a62ba94140 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.730+0000 7f74bb914740 1 --2- 172.21.15.19:0/321947314 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a62ba894a0 0x55a62ba89880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.730+0000 7f74bb914740 1 -- 172.21.15.19:0/321947314 >> 172.21.15.19:0/321947314 conn(0x55a62ba85a30 msgr2=0x55a62ba85e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:07.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.730+0000 7f74bb914740 1 -- 172.21.15.19:0/321947314 shutdown_connections 2024-09-19T08:53:07.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.730+0000 7f74bb914740 1 -- 172.21.15.19:0/321947314 wait complete. 2024-09-19T08:53:07.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.730+0000 7f74bb914740 1 -- start start 2024-09-19T08:53:07.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.731+0000 7f74bb914740 1 Processor -- start 2024-09-19T08:53:07.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.731+0000 7f74bb914740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a62ba894a0 0x55a62ba94040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:07.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.731+0000 7f74bb914740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a62ba89dc0 0x55a62ba912f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:07.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.731+0000 7f74bb914740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a62ba94680 0x55a62ba918e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:07.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.731+0000 7f74bb914740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a62ba97250 con 0x55a62ba894a0 2024-09-19T08:53:07.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.731+0000 7f74bb914740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55a62b9aa050 con 0x55a62ba89dc0 2024-09-19T08:53:07.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.731+0000 7f74bb914740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a62ba973d0 con 0x55a62ba94680 2024-09-19T08:53:07.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.731+0000 7f74bb914740 10 client.0 _ll_register_callbacks cb 0x55a62b9ea160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:07.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.731+0000 7f74b37fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a62ba94680 0x55a62ba918e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:07.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.731+0000 7f74b2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a62ba894a0 0x55a62ba94040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:07.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.731+0000 7f74b2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a62ba894a0 0x55a62ba94040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37510/0 (socket says 172.21.15.19:37510) 2024-09-19T08:53:07.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.731+0000 7f74b2ffd640 1 -- 172.21.15.19:0/2891202382 learned_addr learned my addr 172.21.15.19:0/2891202382 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:07.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.731+0000 7f74b27fc640 1 --2- 172.21.15.19:0/2891202382 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a62ba89dc0 0x55a62ba912f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:07.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.732+0000 7f74b2ffd640 1 -- 172.21.15.19:0/2891202382 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a62ba94680 msgr2=0x55a62ba918e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:07.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.732+0000 7f74b2ffd640 1 --2- 172.21.15.19:0/2891202382 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a62ba94680 0x55a62ba918e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.732+0000 7f74b2ffd640 1 -- 172.21.15.19:0/2891202382 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a62ba89dc0 msgr2=0x55a62ba912f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:07.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.732+0000 7f74b2ffd640 1 --2- 172.21.15.19:0/2891202382 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a62ba89dc0 0x55a62ba912f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.732+0000 7f74b2ffd640 1 -- 172.21.15.19:0/2891202382 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a62b7603c0 con 0x55a62ba894a0 2024-09-19T08:53:07.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.732+0000 7f74b2ffd640 1 --2- 172.21.15.19:0/2891202382 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a62ba894a0 0x55a62ba94040 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f74a4011690 tx=0x7f74a4011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74ba5c809b363e9f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:07.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.732+0000 7f7496ff5640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:53:07.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.733+0000 7f7496ff5640 1 -- 172.21.15.19:0/2891202382 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a4018070 con 0x55a62ba894a0 2024-09-19T08:53:07.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.733+0000 7f74bb914740 1 -- 172.21.15.19:0/2891202382 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74a8098850 con 0x55a62ba894a0 2024-09-19T08:53:07.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.733+0000 7f7496ff5640 1 -- 172.21.15.19:0/2891202382 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f74a400fb40 con 0x55a62ba894a0 2024-09-19T08:53:07.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.733+0000 7f7496ff5640 1 -- 172.21.15.19:0/2891202382 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f74a400fd40 con 0x55a62ba894a0 2024-09-19T08:53:07.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.733+0000 7f74bb914740 10 client.15678 fetch_fsmap learned FSMap version 28 2024-09-19T08:53:07.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.733+0000 7f74bb914740 1 -- 172.21.15.19:0/2891202382 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55a62baa2cd0 con 0x55a62ba894a0 2024-09-19T08:53:07.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.734+0000 7f7496ff5640 1 -- 172.21.15.19:0/2891202382 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74a8098850 con 0x55a62ba894a0 2024-09-19T08:53:07.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.734+0000 7f7496ff5640 1 -- 172.21.15.19:0/2891202382 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f74a40275a0 con 0x55a62ba894a0 2024-09-19T08:53:07.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.734+0000 7f74bb914740 10 client.15678 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:53:07.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.734+0000 7f74bb914740 10 client.15678 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:53:07.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.734+0000 7f74bb914740 20 client.15678 populate_metadata read hostname 'smithi019' 2024-09-19T08:53:07.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.734+0000 7f74bb914740 1 --2- 172.21.15.19:0/2891202382 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a62baa40e0 0x55a62baa6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:07.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.734+0000 7f74bb914740 4 client.15678 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:53:07.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.734+0000 7f74bb914740 1 -- 172.21.15.19:0/2891202382 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a62b9fc850 con 0x55a62baa40e0 2024-09-19T08:53:07.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.735+0000 7f74b27fc640 1 --2- 172.21.15.19:0/2891202382 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a62baa40e0 0x55a62baa6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:07.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.736+0000 7f7496ff5640 10 client.15678 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:07.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.736+0000 7f74b27fc640 1 --2- 172.21.15.19:0/2891202382 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a62baa40e0 0x55a62baa6520 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a355bd6896b7ee70 server_cookie=b6dfba28d8f193a0 in_seq=0 out_seq=0 2024-09-19T08:53:07.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.736+0000 7f7496ff5640 1 -- 172.21.15.19:0/2891202382 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a62b9fc850 con 0x55a62baa40e0 2024-09-19T08:53:07.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.736+0000 7f7496ff5640 10 client.15678 handle_command_reply: tid=0 2024-09-19T08:53:07.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.737+0000 7f74bb914740 1 client.15678 shutdown 2024-09-19T08:53:07.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.737+0000 7f74bb914740 1 -- 172.21.15.19:0/2891202382 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a62ba894a0 msgr2=0x55a62ba94040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:07.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.737+0000 7f74bb914740 1 --2- 172.21.15.19:0/2891202382 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a62ba894a0 0x55a62ba94040 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f74a4011690 tx=0x7f74a4011b50 comp rx=0 tx=0).stop 2024-09-19T08:53:07.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.737+0000 7f74bb914740 1 -- 172.21.15.19:0/2891202382 shutdown_connections 2024-09-19T08:53:07.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.737+0000 7f74bb914740 1 --2- 172.21.15.19:0/2891202382 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a62baa40e0 0x55a62baa6520 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.737+0000 7f74bb914740 1 --2- 172.21.15.19:0/2891202382 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a62ba94680 0x55a62ba918e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.737+0000 7f74bb914740 1 --2- 172.21.15.19:0/2891202382 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a62ba89dc0 0x55a62ba912f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.737+0000 7f74bb914740 1 --2- 172.21.15.19:0/2891202382 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a62ba894a0 0x55a62ba94040 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.737+0000 7f74bb914740 1 -- 172.21.15.19:0/2891202382 >> 172.21.15.19:0/2891202382 conn(0x55a62ba85a30 msgr2=0x55a62ba84b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:07.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.737+0000 7f7496ff5640 0 client.15678 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:07.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.738+0000 7f74bb914740 1 -- 172.21.15.19:0/2891202382 shutdown_connections 2024-09-19T08:53:07.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.738+0000 7f74bb914740 1 -- 172.21.15.19:0/2891202382 wait complete. 2024-09-19T08:53:07.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.738+0000 7f74bb914740 20 client.15678 trim_cache size 0 max 16384 2024-09-19T08:53:07.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.755+0000 7f74bb914740 1 Processor -- start 2024-09-19T08:53:07.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.755+0000 7f74bb914740 1 -- start start 2024-09-19T08:53:07.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.755+0000 7f74bb914740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a62ba894a0 0x55a62baa04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:07.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.755+0000 7f74bb914740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a62ba89dc0 0x55a62ba8c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:07.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.755+0000 7f74bb914740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a62ba94680 0x55a62baabe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:07.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.756+0000 7f74bb914740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f74b41af7c0 con 0x55a62ba89dc0 2024-09-19T08:53:07.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.756+0000 7f74bb914740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f74b41b1300 con 0x55a62ba94680 2024-09-19T08:53:07.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.756+0000 7f74bb914740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f74b41afe90 con 0x55a62ba894a0 2024-09-19T08:53:07.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.756+0000 7f74b27fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a62ba89dc0 0x55a62ba8c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:07.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.756+0000 7f74b27fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a62ba89dc0 0x55a62ba8c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37512/0 (socket says 172.21.15.19:37512) 2024-09-19T08:53:07.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.756+0000 7f74b27fc640 1 -- 172.21.15.19:0/1822194857 learned_addr learned my addr 172.21.15.19:0/1822194857 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:07.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.756+0000 7f74b2ffd640 1 --2- 172.21.15.19:0/1822194857 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a62ba894a0 0x55a62baa04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:07.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.756+0000 7f74b27fc640 1 -- 172.21.15.19:0/1822194857 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a62ba894a0 msgr2=0x55a62baa04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:07.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.756+0000 7f74b27fc640 1 --2- 172.21.15.19:0/1822194857 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a62ba894a0 0x55a62baa04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.756+0000 7f74b27fc640 1 -- 172.21.15.19:0/1822194857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a62ba94680 msgr2=0x55a62baabe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:07.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.756+0000 7f74b27fc640 1 --2- 172.21.15.19:0/1822194857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a62ba94680 0x55a62baabe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.756+0000 7f74b27fc640 1 -- 172.21.15.19:0/1822194857 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a62ba89bf0 con 0x55a62ba89dc0 2024-09-19T08:53:07.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.756+0000 7f74b27fc640 1 --2- 172.21.15.19:0/1822194857 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a62ba89dc0 0x55a62ba8c7f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f74a809a490 tx=0x7f74a8009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d098e25f880bb490 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:07.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.757+0000 7f7498ff9640 1 -- 172.21.15.19:0/1822194857 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a80a0190 con 0x55a62ba89dc0 2024-09-19T08:53:07.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.757+0000 7f7498ff9640 1 -- 172.21.15.19:0/1822194857 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74a80bc0c0 con 0x55a62ba89dc0 2024-09-19T08:53:07.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.757+0000 7f7498ff9640 1 -- 172.21.15.19:0/1822194857 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a809b630 con 0x55a62ba89dc0 2024-09-19T08:53:07.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.758+0000 7f74bb914740 1 -- 172.21.15.19:0/1822194857 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a62ba89dc0 msgr2=0x55a62ba8c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:07.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.758+0000 7f74bb914740 1 --2- 172.21.15.19:0/1822194857 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a62ba89dc0 0x55a62ba8c7f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f74a809a490 tx=0x7f74a8009310 comp rx=0 tx=0).stop 2024-09-19T08:53:07.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.758+0000 7f74bb914740 1 -- 172.21.15.19:0/1822194857 shutdown_connections 2024-09-19T08:53:07.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.758+0000 7f74bb914740 1 --2- 172.21.15.19:0/1822194857 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a62ba94680 0x55a62baabe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.758+0000 7f74bb914740 1 --2- 172.21.15.19:0/1822194857 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a62ba89dc0 0x55a62ba8c7f0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.758+0000 7f74bb914740 1 --2- 172.21.15.19:0/1822194857 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a62ba894a0 0x55a62baa04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.758+0000 7f74bb914740 1 -- 172.21.15.19:0/1822194857 >> 172.21.15.19:0/1822194857 conn(0x55a62ba85a30 msgr2=0x55a62ba8c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:07.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.758+0000 7f74bb914740 1 -- 172.21.15.19:0/1822194857 shutdown_connections 2024-09-19T08:53:07.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.758+0000 7f74bb914740 1 -- 172.21.15.19:0/1822194857 wait complete. 2024-09-19T08:53:07.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.759+0000 7f74bb914740 1 -- start start 2024-09-19T08:53:07.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.759+0000 7f74bb914740 1 Processor -- start 2024-09-19T08:53:07.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.760+0000 7f74bb914740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a62ba894a0 0x55a62ba9ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:07.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.760+0000 7f74b2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a62ba894a0 0x55a62ba9ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:07.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.760+0000 7f74b2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a62ba894a0 0x55a62ba9ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37526/0 (socket says 172.21.15.19:37526) 2024-09-19T08:53:07.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.760+0000 7f74b2ffd640 1 -- 172.21.15.19:0/1629513890 learned_addr learned my addr 172.21.15.19:0/1629513890 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:07.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.760+0000 7f74bb914740 1 --2- 172.21.15.19:0/1629513890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a62ba89dc0 0x55a62ba981a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:07.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.760+0000 7f74bb914740 1 --2- 172.21.15.19:0/1629513890 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a62ba94680 0x55a62ba98770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:07.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.760+0000 7f74bb914740 1 -- 172.21.15.19:0/1629513890 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f74b41b0c30 con 0x55a62ba894a0 2024-09-19T08:53:07.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.760+0000 7f74bb914740 1 -- 172.21.15.19:0/1629513890 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f74b41b0560 con 0x55a62ba89dc0 2024-09-19T08:53:07.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.760+0000 7f74bb914740 1 -- 172.21.15.19:0/1629513890 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f74b41ad7a0 con 0x55a62ba94680 2024-09-19T08:53:07.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.760+0000 7f74b27fc640 1 --2- 172.21.15.19:0/1629513890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a62ba89dc0 0x55a62ba981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:07.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.760+0000 7f74b37fe640 1 --2- 172.21.15.19:0/1629513890 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a62ba94680 0x55a62ba98770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:07.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.761+0000 7f74b2ffd640 1 -- 172.21.15.19:0/1629513890 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a62ba94680 msgr2=0x55a62ba98770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:07.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.761+0000 7f74b2ffd640 1 --2- 172.21.15.19:0/1629513890 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a62ba94680 0x55a62ba98770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.761+0000 7f74b2ffd640 1 -- 172.21.15.19:0/1629513890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a62ba89dc0 msgr2=0x55a62ba981a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:07.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.761+0000 7f74b2ffd640 1 --2- 172.21.15.19:0/1629513890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a62ba89dc0 0x55a62ba981a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.761+0000 7f74b2ffd640 1 -- 172.21.15.19:0/1629513890 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a62ba943b0 con 0x55a62ba894a0 2024-09-19T08:53:07.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.761+0000 7f74b2ffd640 1 --2- 172.21.15.19:0/1629513890 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a62ba894a0 0x55a62ba9ce70 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f74a4027fd0 tx=0x7f74a400fee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=309579a78876960d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:07.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.761+0000 7f74bb914740 10 client.0 _ll_register_callbacks cb 0x7f74a400bae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:07.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.761+0000 7f74bb914740 1 -- 172.21.15.19:0/1629513890 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74a80bc0c0 con 0x55a62ba894a0 2024-09-19T08:53:07.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.761+0000 7f7496ff5640 10 client.15684 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:53:07.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.761+0000 7f7496ff5640 1 -- 172.21.15.19:0/1629513890 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a4018040 con 0x55a62ba894a0 2024-09-19T08:53:07.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.762+0000 7f7496ff5640 1 -- 172.21.15.19:0/1629513890 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f74a4027600 con 0x55a62ba894a0 2024-09-19T08:53:07.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.762+0000 7f7496ff5640 1 -- 172.21.15.19:0/1629513890 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f74a4027840 con 0x55a62ba894a0 2024-09-19T08:53:07.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.762+0000 7f74bb914740 10 client.15684 fetch_fsmap learned FSMap version 28 2024-09-19T08:53:07.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.762+0000 7f74bb914740 1 -- 172.21.15.19:0/1629513890 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({fsmap=28}) -- 0x55a62bb0ebc0 con 0x55a62ba894a0 2024-09-19T08:53:07.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.762+0000 7f7496ff5640 1 -- 172.21.15.19:0/1629513890 <== mon.0 v2:172.21.15.19:3300/0 4 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f74a4005040 con 0x55a62ba894a0 2024-09-19T08:53:07.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.762+0000 7f74bb914740 10 client.15684 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:53:07.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.762+0000 7f74bb914740 10 client.15684 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:53:07.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.762+0000 7f74bb914740 20 client.15684 populate_metadata read hostname 'smithi019' 2024-09-19T08:53:07.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.762+0000 7f74bb914740 1 --2- 172.21.15.19:0/1629513890 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a62bb0f280 0x55a62bb116c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:07.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.762+0000 7f74bb914740 4 client.15684 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:53:07.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.762+0000 7f74bb914740 1 -- 172.21.15.19:0/1629513890 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a62b9f6d60 con 0x55a62bb0f280 2024-09-19T08:53:07.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.763+0000 7f74b27fc640 1 --2- 172.21.15.19:0/1629513890 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a62bb0f280 0x55a62bb116c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:07.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.763+0000 7f74b27fc640 1 --2- 172.21.15.19:0/1629513890 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a62bb0f280 0x55a62bb116c0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e24210b835aab768 server_cookie=95144291f5ee58aa in_seq=0 out_seq=0 2024-09-19T08:53:07.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.763+0000 7f7496ff5640 10 client.15684 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:07.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.764+0000 7f7496ff5640 1 -- 172.21.15.19:0/1629513890 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55a62b9f6d60 con 0x55a62bb0f280 2024-09-19T08:53:07.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.764+0000 7f7496ff5640 10 client.15684 handle_command_reply: tid=0 2024-09-19T08:53:07.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.764+0000 7f74bb914740 1 client.15684 shutdown 2024-09-19T08:53:07.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.764+0000 7f74bb914740 1 -- 172.21.15.19:0/1629513890 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a62ba894a0 msgr2=0x55a62ba9ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:07.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.764+0000 7f74bb914740 1 --2- 172.21.15.19:0/1629513890 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a62ba894a0 0x55a62ba9ce70 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f74a4027fd0 tx=0x7f74a400fee0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.765+0000 7f74bb914740 1 -- 172.21.15.19:0/1629513890 shutdown_connections 2024-09-19T08:53:07.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.765+0000 7f74bb914740 1 --2- 172.21.15.19:0/1629513890 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a62bb0f280 0x55a62bb116c0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.765+0000 7f7496ff5640 0 client.15684 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:07.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.765+0000 7f74bb914740 1 --2- 172.21.15.19:0/1629513890 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a62ba94680 0x55a62ba98770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.765+0000 7f74bb914740 1 --2- 172.21.15.19:0/1629513890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a62ba89dc0 0x55a62ba981a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.765+0000 7f74bb914740 1 --2- 172.21.15.19:0/1629513890 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a62ba894a0 0x55a62ba9ce70 secure :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f74a4027fd0 tx=0x7f74a400fee0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.765+0000 7f74bb914740 1 -- 172.21.15.19:0/1629513890 >> 172.21.15.19:0/1629513890 conn(0x55a62ba85a30 msgr2=0x55a62ba84b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:07.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.765+0000 7f74bb914740 1 -- 172.21.15.19:0/1629513890 shutdown_connections 2024-09-19T08:53:07.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.765+0000 7f74bb914740 1 -- 172.21.15.19:0/1629513890 wait complete. 2024-09-19T08:53:07.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.765+0000 7f74bb914740 20 client.15684 trim_cache size 0 max 16384 2024-09-19T08:53:07.768 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:53:07.768 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T08:53:07.769 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-19T08:53:07.769 INFO:teuthology.orchestra.run.smithi019.stdout: "fd406fd3-9ddd-44a4-b863-e02ab55775a3": { 2024-09-19T08:53:07.769 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-19T08:53:07.769 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "fd406fd3-9ddd-44a4-b863-e02ab55775a3", 2024-09-19T08:53:07.769 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-19T08:53:07.769 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:53:07.769 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:53:07.769 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:53:07.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.766+0000 7f74b953b640 1 -- 172.21.15.19:0/3284719563 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f749c0a3350 msgr2=0x7f749c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:07.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.766+0000 7f74b953b640 1 --2- 172.21.15.19:0/3284719563 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f749c0a3350 0x7f749c0a5810 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f74ac004af0 tx=0x7f74ac004a80 comp rx=0 tx=0).stop 2024-09-19T08:53:07.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.766+0000 7f74b953b640 1 -- 172.21.15.19:0/3284719563 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74b4101360 msgr2=0x7f74b419abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:07.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.766+0000 7f74b953b640 1 --2- 172.21.15.19:0/3284719563 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74b4101360 0x7f74b419abe0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f74a800e9f0 tx=0x7f74a800eeb0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.766+0000 7f74b953b640 1 -- 172.21.15.19:0/3284719563 shutdown_connections 2024-09-19T08:53:07.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.766+0000 7f74b953b640 1 --2- 172.21.15.19:0/3284719563 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f749c0a3350 0x7f749c0a5810 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.766+0000 7f74b953b640 1 --2- 172.21.15.19:0/3284719563 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74b4101360 0x7f74b419abe0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.766+0000 7f74b953b640 1 --2- 172.21.15.19:0/3284719563 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74b410e4d0 0x7f74b419ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.766+0000 7f74b953b640 1 --2- 172.21.15.19:0/3284719563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74b41009b0 0x7f74b419a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:07.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.766+0000 7f74b953b640 1 -- 172.21.15.19:0/3284719563 >> 172.21.15.19:0/3284719563 conn(0x7f74b40fc7d0 msgr2=0x7f74b40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:07.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.767+0000 7f74b953b640 1 -- 172.21.15.19:0/3284719563 shutdown_connections 2024-09-19T08:53:07.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:07.767+0000 7f74b953b640 1 -- 172.21.15.19:0/3284719563 wait complete. 2024-09-19T08:53:08.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:07 smithi203 ceph-mon[35450]: scrub queued for path: / 2024-09-19T08:53:08.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:07 smithi203 ceph-mon[35450]: scrub summary: idle+waiting paths [/] 2024-09-19T08:53:08.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:07 smithi203 ceph-mon[35450]: scrub summary: active paths [/] 2024-09-19T08:53:08.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:07 smithi203 ceph-mon[35450]: scrub summary: idle+waiting paths [/] 2024-09-19T08:53:08.320 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:07 smithi019 ceph-mon[30976]: scrub queued for path: / 2024-09-19T08:53:08.321 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:07 smithi019 ceph-mon[30976]: scrub summary: idle+waiting paths [/] 2024-09-19T08:53:08.321 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:07 smithi019 ceph-mon[30976]: scrub summary: active paths [/] 2024-09-19T08:53:08.321 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:07 smithi019 ceph-mon[30976]: scrub summary: idle+waiting paths [/] 2024-09-19T08:53:08.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:07 smithi155 ceph-mon[34921]: scrub queued for path: / 2024-09-19T08:53:08.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:07 smithi155 ceph-mon[34921]: scrub summary: idle+waiting paths [/] 2024-09-19T08:53:08.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:07 smithi155 ceph-mon[34921]: scrub summary: active paths [/] 2024-09-19T08:53:08.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:07 smithi155 ceph-mon[34921]: scrub summary: idle+waiting paths [/] 2024-09-19T08:53:08.567 INFO:tasks.cephfs.filesystem:scrub status for tag:fd406fd3-9ddd-44a4-b863-e02ab55775a3 - {'path': '/', 'tag': 'fd406fd3-9ddd-44a4-b863-e02ab55775a3', 'options': 'recursive,force'} 2024-09-19T08:53:08.654 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:09.102 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:08 smithi019 ceph-mon[30976]: pgmap v365: 97 pgs: 97 active+clean; 669 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-19T08:53:09.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.223+0000 7fc365b5d640 1 -- 172.21.15.19:0/2763119852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc360101df0 msgr2=0x7fc3601021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:09.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.223+0000 7fc365b5d640 1 --2- 172.21.15.19:0/2763119852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc360101df0 0x7fc3601021d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fc350009900 tx=0x7fc35002a410 comp rx=0 tx=0).stop 2024-09-19T08:53:09.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.224+0000 7fc365b5d640 1 -- 172.21.15.19:0/2763119852 shutdown_connections 2024-09-19T08:53:09.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.224+0000 7fc365b5d640 1 --2- 172.21.15.19:0/2763119852 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3601027a0 0x7fc3601067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:09.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.224+0000 7fc365b5d640 1 --2- 172.21.15.19:0/2763119852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc360106f20 0x7fc36010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:09.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.224+0000 7fc365b5d640 1 --2- 172.21.15.19:0/2763119852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc360101df0 0x7fc3601021d0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:09.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.224+0000 7fc365b5d640 1 -- 172.21.15.19:0/2763119852 >> 172.21.15.19:0/2763119852 conn(0x7fc3600fd8b0 msgr2=0x7fc3600ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:09.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.224+0000 7fc365b5d640 1 -- 172.21.15.19:0/2763119852 shutdown_connections 2024-09-19T08:53:09.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.224+0000 7fc365b5d640 1 -- 172.21.15.19:0/2763119852 wait complete. 2024-09-19T08:53:09.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.225+0000 7fc365b5d640 1 Processor -- start 2024-09-19T08:53:09.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.225+0000 7fc365b5d640 1 -- start start 2024-09-19T08:53:09.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.225+0000 7fc365b5d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc360101df0 0x7fc360198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:09.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.225+0000 7fc365b5d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3601027a0 0x7fc360198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:09.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.225+0000 7fc365b5d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc360106f20 0x7fc36019ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:09.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.226+0000 7fc365b5d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc360111f80 con 0x7fc360101df0 2024-09-19T08:53:09.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.226+0000 7fc365b5d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc360111e00 con 0x7fc3601027a0 2024-09-19T08:53:09.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.226+0000 7fc365b5d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc360112100 con 0x7fc360106f20 2024-09-19T08:53:09.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.226+0000 7fc35f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc360101df0 0x7fc360198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:09.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.226+0000 7fc35f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc360101df0 0x7fc360198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37538/0 (socket says 172.21.15.19:37538) 2024-09-19T08:53:09.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.226+0000 7fc35f7fe640 1 -- 172.21.15.19:0/3794896874 learned_addr learned my addr 172.21.15.19:0/3794896874 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:09.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.226+0000 7fc35effd640 1 --2- 172.21.15.19:0/3794896874 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3601027a0 0x7fc360198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:09.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.226+0000 7fc35ffff640 1 --2- 172.21.15.19:0/3794896874 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc360106f20 0x7fc36019ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:09.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.226+0000 7fc35f7fe640 1 -- 172.21.15.19:0/3794896874 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc360106f20 msgr2=0x7fc36019ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:09.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.226+0000 7fc35f7fe640 1 --2- 172.21.15.19:0/3794896874 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc360106f20 0x7fc36019ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:09.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.226+0000 7fc35f7fe640 1 -- 172.21.15.19:0/3794896874 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3601027a0 msgr2=0x7fc360198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:09.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.226+0000 7fc35f7fe640 1 --2- 172.21.15.19:0/3794896874 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3601027a0 0x7fc360198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:09.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.226+0000 7fc35f7fe640 1 -- 172.21.15.19:0/3794896874 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc36019d3d0 con 0x7fc360101df0 2024-09-19T08:53:09.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.227+0000 7fc35f7fe640 1 --2- 172.21.15.19:0/3794896874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc360101df0 0x7fc360198420 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc350006010 tx=0x7fc3500042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:09.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.227+0000 7fc35cff9640 1 -- 172.21.15.19:0/3794896874 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc35003f030 con 0x7fc360101df0 2024-09-19T08:53:09.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.227+0000 7fc35cff9640 1 -- 172.21.15.19:0/3794896874 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc350003ce0 con 0x7fc360101df0 2024-09-19T08:53:09.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.227+0000 7fc365b5d640 1 -- 172.21.15.19:0/3794896874 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc36019d660 con 0x7fc360101df0 2024-09-19T08:53:09.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.227+0000 7fc35cff9640 1 -- 172.21.15.19:0/3794896874 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc350035070 con 0x7fc360101df0 2024-09-19T08:53:09.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.227+0000 7fc365b5d640 1 -- 172.21.15.19:0/3794896874 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3601a4fa0 con 0x7fc360101df0 2024-09-19T08:53:09.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.229+0000 7fc365b5d640 1 -- 172.21.15.19:0/3794896874 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3601032d0 con 0x7fc360101df0 2024-09-19T08:53:09.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.230+0000 7fc35cff9640 1 -- 172.21.15.19:0/3794896874 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7fc350042030 con 0x7fc360101df0 2024-09-19T08:53:09.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.231+0000 7fc35cff9640 1 --2- 172.21.15.19:0/3794896874 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc3480a3350 0x7fc3480a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:09.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.231+0000 7fc35cff9640 1 -- 172.21.15.19:0/3794896874 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc3500f02b0 con 0x7fc360101df0 2024-09-19T08:53:09.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.231+0000 7fc35effd640 1 --2- 172.21.15.19:0/3794896874 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc3480a3350 0x7fc3480a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:09.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.232+0000 7fc35effd640 1 --2- 172.21.15.19:0/3794896874 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc3480a3350 0x7fc3480a5810 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc3600fddb0 tx=0x7fc35400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:09.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:08 smithi203 ceph-mon[35450]: pgmap v365: 97 pgs: 97 active+clean; 669 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-19T08:53:09.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.238+0000 7fc35cff9640 1 -- 172.21.15.19:0/3794896874 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc3500bc8f0 con 0x7fc360101df0 2024-09-19T08:53:09.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:08 smithi155 ceph-mon[34921]: pgmap v365: 97 pgs: 97 active+clean; 669 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 767 B/s wr, 9 op/s 2024-09-19T08:53:09.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.453+0000 7fc365b5d640 1 -- 172.21.15.19:0/3794896874 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc3601021d0 con 0x7fc360101df0 2024-09-19T08:53:09.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.454+0000 7fc35cff9640 1 -- 172.21.15.19:0/3794896874 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11983 (secure 0 0 0) 0x7fc3601021d0 con 0x7fc360101df0 2024-09-19T08:53:09.453 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:53:09.454 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":28,"btime":"2024-09-19T08:52:09:653615+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2452068876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2452068876},{"type":"v1","addr":"172.21.15.19:6839","nonce":2452068876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T08:52:08.813945+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/2480841559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2480841559},{"type":"v1","addr":"172.21.15.155:6835","nonce":2480841559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24463,24464,24490,24469,24497]},"id":1}]} 2024-09-19T08:53:09.454 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 28 2024-09-19T08:53:09.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.457+0000 7fc365b5d640 1 -- 172.21.15.19:0/3794896874 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc3480a3350 msgr2=0x7fc3480a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:09.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.457+0000 7fc365b5d640 1 --2- 172.21.15.19:0/3794896874 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc3480a3350 0x7fc3480a5810 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc3600fddb0 tx=0x7fc35400b390 comp rx=0 tx=0).stop 2024-09-19T08:53:09.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.457+0000 7fc365b5d640 1 -- 172.21.15.19:0/3794896874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc360101df0 msgr2=0x7fc360198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:09.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.457+0000 7fc365b5d640 1 --2- 172.21.15.19:0/3794896874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc360101df0 0x7fc360198420 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc350006010 tx=0x7fc3500042f0 comp rx=0 tx=0).stop 2024-09-19T08:53:09.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.457+0000 7fc365b5d640 1 -- 172.21.15.19:0/3794896874 shutdown_connections 2024-09-19T08:53:09.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.457+0000 7fc365b5d640 1 --2- 172.21.15.19:0/3794896874 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc3480a3350 0x7fc3480a5810 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:09.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.457+0000 7fc365b5d640 1 --2- 172.21.15.19:0/3794896874 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc360106f20 0x7fc36019ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:09.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.457+0000 7fc365b5d640 1 --2- 172.21.15.19:0/3794896874 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc3601027a0 0x7fc360198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:09.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.457+0000 7fc365b5d640 1 --2- 172.21.15.19:0/3794896874 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc360101df0 0x7fc360198420 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:09.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.457+0000 7fc365b5d640 1 -- 172.21.15.19:0/3794896874 >> 172.21.15.19:0/3794896874 conn(0x7fc3600fd8b0 msgr2=0x7fc3600febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:09.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.457+0000 7fc365b5d640 1 -- 172.21.15.19:0/3794896874 shutdown_connections 2024-09-19T08:53:09.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:09.457+0000 7fc365b5d640 1 -- 172.21.15.19:0/3794896874 wait complete. 2024-09-19T08:53:10.082 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:09 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3794896874' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:53:10.124 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db --set-id 9b6cce55 --release --await' 2024-09-19T08:53:10.124 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db --set-id 9b6cce55 --release --await 2024-09-19T08:53:10.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:09 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3794896874' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:53:10.275 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.275+0000 7f464cfb9640 1 -- 172.21.15.19:0/3628406458 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4648100f70 msgr2=0x7f4648101370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:10.275 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.275+0000 7f464cfb9640 1 --2- 172.21.15.19:0/3628406458 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4648100f70 0x7f4648101370 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4638009900 tx=0x7f463802a480 comp rx=0 tx=0).stop 2024-09-19T08:53:10.275 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.275+0000 7f464cfb9640 1 -- 172.21.15.19:0/3628406458 shutdown_connections 2024-09-19T08:53:10.275 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.275+0000 7f464cfb9640 1 --2- 172.21.15.19:0/3628406458 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4648101c80 0x7f4648102100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:10.275 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.275+0000 7f464cfb9640 1 --2- 172.21.15.19:0/3628406458 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4648102640 0x7f4648108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:10.275 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.275+0000 7f464cfb9640 1 --2- 172.21.15.19:0/3628406458 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4648100f70 0x7f4648101370 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:10.275 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.275+0000 7f464cfb9640 1 -- 172.21.15.19:0/3628406458 >> 172.21.15.19:0/3628406458 conn(0x7f46480fb930 msgr2=0x7f46480fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:10.275 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.275+0000 7f464cfb9640 1 -- 172.21.15.19:0/3628406458 shutdown_connections 2024-09-19T08:53:10.275 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.275+0000 7f464cfb9640 1 -- 172.21.15.19:0/3628406458 wait complete. 2024-09-19T08:53:10.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.276+0000 7f464cfb9640 1 Processor -- start 2024-09-19T08:53:10.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.276+0000 7f464cfb9640 1 -- start start 2024-09-19T08:53:10.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.276+0000 7f464cfb9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4648100f70 0x7f4648197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:10.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.277+0000 7f464cfb9640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4648101c80 0x7f4648198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.277+0000 7f464cfb9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4648102640 0x7f464819f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.277+0000 7f464cfb9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f464810c740 con 0x7f4648102640 2024-09-19T08:53:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.277+0000 7f464cfb9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f464810c5c0 con 0x7f4648100f70 2024-09-19T08:53:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.277+0000 7f4645d9b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4648101c80 0x7f4648198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.277+0000 7f4646d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4648102640 0x7f464819f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.277+0000 7f4645d9b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4648101c80 0x7f4648198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:37372/0 (socket says 172.21.15.19:37372) 2024-09-19T08:53:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.277+0000 7f4645d9b640 1 -- 172.21.15.19:0/371847074 learned_addr learned my addr 172.21.15.19:0/371847074 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.277+0000 7f464659c640 1 --2- 172.21.15.19:0/371847074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4648100f70 0x7f4648197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.277+0000 7f464cfb9640 1 -- 172.21.15.19:0/371847074 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f464810c8c0 con 0x7f4648101c80 2024-09-19T08:53:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.277+0000 7f4646d9d640 1 -- 172.21.15.19:0/371847074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4648101c80 msgr2=0x7f4648198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.278+0000 7f4646d9d640 1 --2- 172.21.15.19:0/371847074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4648101c80 0x7f4648198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.278+0000 7f4646d9d640 1 -- 172.21.15.19:0/371847074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4648100f70 msgr2=0x7f4648197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.278+0000 7f4646d9d640 1 --2- 172.21.15.19:0/371847074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4648100f70 0x7f4648197e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:10.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.278+0000 7f4646d9d640 1 -- 172.21.15.19:0/371847074 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f464819fa50 con 0x7f4648102640 2024-09-19T08:53:10.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.278+0000 7f4646d9d640 1 --2- 172.21.15.19:0/371847074 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4648102640 0x7f464819f3e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f464000e940 tx=0x7f464000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:10.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.278+0000 7f46377fe640 1 -- 172.21.15.19:0/371847074 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4640004d20 con 0x7f4648102640 2024-09-19T08:53:10.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.278+0000 7f46377fe640 1 -- 172.21.15.19:0/371847074 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4640005020 con 0x7f4648102640 2024-09-19T08:53:10.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.278+0000 7f46377fe640 1 -- 172.21.15.19:0/371847074 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46400116b0 con 0x7f4648102640 2024-09-19T08:53:10.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.278+0000 7f464cfb9640 1 -- 172.21.15.19:0/371847074 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4648102f00 con 0x7f4648102640 2024-09-19T08:53:10.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.279+0000 7f464cfb9640 1 -- 172.21.15.19:0/371847074 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4648103400 con 0x7f4648102640 2024-09-19T08:53:10.281 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.282+0000 7f464fe28740 1 Processor -- start 2024-09-19T08:53:10.281 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.282+0000 7f46377fe640 1 -- 172.21.15.19:0/371847074 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f46400054d0 con 0x7f4648102640 2024-09-19T08:53:10.282 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.283+0000 7f46377fe640 1 --2- 172.21.15.19:0/371847074 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f46300a3410 0x7f46300a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:10.282 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.283+0000 7f46377fe640 1 -- 172.21.15.19:0/371847074 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f46400cf740 con 0x7f4648102640 2024-09-19T08:53:10.283 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.283+0000 7f464fe28740 1 -- start start 2024-09-19T08:53:10.283 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.283+0000 7f4645d9b640 1 --2- 172.21.15.19:0/371847074 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f46300a3410 0x7f46300a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:10.284 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.284+0000 7f464fe28740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591748111b0 0x5591748115b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:10.284 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.284+0000 7f464fe28740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559174811af0 0x5591748165b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:10.284 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.284+0000 7f464fe28740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559174816b80 0x559174819040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:10.284 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.284+0000 7f464fe28740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55917476c2f0 con 0x559174816b80 2024-09-19T08:53:10.284 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.284+0000 7f464fe28740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559174714270 con 0x559174811af0 2024-09-19T08:53:10.284 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.284+0000 7f464fe28740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5591747682b0 con 0x5591748111b0 2024-09-19T08:53:10.284 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.284+0000 7f4646d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559174816b80 0x559174819040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:10.285 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.284+0000 7f4646d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559174816b80 0x559174819040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37562/0 (socket says 172.21.15.19:37562) 2024-09-19T08:53:10.285 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.284+0000 7f464659c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591748111b0 0x5591748115b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:10.285 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.284+0000 7f4646d9d640 1 -- 172.21.15.19:0/521366343 learned_addr learned my addr 172.21.15.19:0/521366343 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:10.285 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.284+0000 7f4645d9b640 1 --2- 172.21.15.19:0/371847074 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f46300a3410 0x7f46300a58d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4648199340 tx=0x7f463c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:10.285 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.284+0000 7f4645d9b640 1 --2- 172.21.15.19:0/521366343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559174811af0 0x5591748165b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:10.285 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.284+0000 7f4646d9d640 1 -- 172.21.15.19:0/521366343 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591748111b0 msgr2=0x5591748115b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:10.285 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.284+0000 7f4646d9d640 1 --2- 172.21.15.19:0/521366343 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591748111b0 0x5591748115b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:10.285 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.284+0000 7f4646d9d640 1 -- 172.21.15.19:0/521366343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559174811af0 msgr2=0x5591748165b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:10.285 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.284+0000 7f4646d9d640 1 --2- 172.21.15.19:0/521366343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559174811af0 0x5591748165b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:10.285 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.284+0000 7f4646d9d640 1 -- 172.21.15.19:0/521366343 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559174713340 con 0x559174816b80 2024-09-19T08:53:10.285 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.285+0000 7f4646d9d640 1 --2- 172.21.15.19:0/521366343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559174816b80 0x559174819040 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f46400a42f0 tx=0x7f464009bd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe9a92a7b1be33dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:10.285 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.285+0000 7f4634ff9640 1 -- 172.21.15.19:0/521366343 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464001f040 con 0x559174816b80 2024-09-19T08:53:10.285 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.285+0000 7f4634ff9640 1 -- 172.21.15.19:0/521366343 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46400051d0 con 0x559174816b80 2024-09-19T08:53:10.286 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.285+0000 7f4634ff9640 1 -- 172.21.15.19:0/521366343 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464009b310 con 0x559174816b80 2024-09-19T08:53:10.288 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.286+0000 7f464fe28740 1 -- 172.21.15.19:0/521366343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559174816b80 msgr2=0x559174819040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:10.288 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.286+0000 7f464fe28740 1 --2- 172.21.15.19:0/521366343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559174816b80 0x559174819040 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f46400a42f0 tx=0x7f464009bd20 comp rx=0 tx=0).stop 2024-09-19T08:53:10.289 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.286+0000 7f464fe28740 1 -- 172.21.15.19:0/521366343 shutdown_connections 2024-09-19T08:53:10.289 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.286+0000 7f464fe28740 1 --2- 172.21.15.19:0/521366343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559174816b80 0x559174819040 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:10.289 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.286+0000 7f464fe28740 1 --2- 172.21.15.19:0/521366343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559174811af0 0x5591748165b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:10.289 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.286+0000 7f464fe28740 1 --2- 172.21.15.19:0/521366343 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591748111b0 0x5591748115b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:10.289 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.286+0000 7f464fe28740 1 -- 172.21.15.19:0/521366343 >> 172.21.15.19:0/521366343 conn(0x559174804010 msgr2=0x559174804410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:10.289 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.286+0000 7f464fe28740 1 -- 172.21.15.19:0/521366343 shutdown_connections 2024-09-19T08:53:10.289 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.286+0000 7f464fe28740 1 -- 172.21.15.19:0/521366343 wait complete. 2024-09-19T08:53:10.289 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.286+0000 7f464fe28740 1 -- start start 2024-09-19T08:53:10.289 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.286+0000 7f464fe28740 1 Processor -- start 2024-09-19T08:53:10.289 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.286+0000 7f464fe28740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5591748111b0 0x55917481b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:10.289 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.286+0000 7f464fe28740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559174811af0 0x55917481b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:10.289 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.286+0000 7f464fe28740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559174816b80 0x559174822960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:10.290 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.286+0000 7f464fe28740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559174819b50 con 0x5591748111b0 2024-09-19T08:53:10.290 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.286+0000 7f464fe28740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5591746f5290 con 0x559174816b80 2024-09-19T08:53:10.290 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.286+0000 7f464fe28740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559174819cd0 con 0x559174811af0 2024-09-19T08:53:10.290 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.287+0000 7f464fe28740 10 client.0 _ll_register_callbacks cb 0x559174726140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:10.290 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.287+0000 7f464659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5591748111b0 0x55917481b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:10.290 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.287+0000 7f4645d9b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559174811af0 0x55917481b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:10.290 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.287+0000 7f4645d9b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559174811af0 0x55917481b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:37386/0 (socket says 172.21.15.19:37386) 2024-09-19T08:53:10.290 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.287+0000 7f4645d9b640 1 -- 172.21.15.19:0/1677300967 learned_addr learned my addr 172.21.15.19:0/1677300967 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:10.290 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.287+0000 7f4646d9d640 1 --2- 172.21.15.19:0/1677300967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559174816b80 0x559174822960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:10.290 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.287+0000 7f464659c640 1 -- 172.21.15.19:0/1677300967 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559174811af0 msgr2=0x55917481b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:10.290 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.287+0000 7f464659c640 1 --2- 172.21.15.19:0/1677300967 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559174811af0 0x55917481b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:10.290 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.287+0000 7f464659c640 1 -- 172.21.15.19:0/1677300967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559174816b80 msgr2=0x559174822960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:10.290 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.287+0000 7f464659c640 1 --2- 172.21.15.19:0/1677300967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559174816b80 0x559174822960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:10.290 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.287+0000 7f464659c640 1 -- 172.21.15.19:0/1677300967 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55917447f210 con 0x5591748111b0 2024-09-19T08:53:10.291 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.287+0000 7f4646d9d640 1 --2- 172.21.15.19:0/1677300967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559174816b80 0x559174822960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:53:10.291 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.287+0000 7f464659c640 1 --2- 172.21.15.19:0/1677300967 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5591748111b0 0x55917481b3e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4638009230 tx=0x7f4638005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e6a46c68d273a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:10.291 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.287+0000 7f462dffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:53:10.291 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.288+0000 7f462dffb640 1 -- 172.21.15.19:0/1677300967 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4638035040 con 0x5591748111b0 2024-09-19T08:53:10.291 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.288+0000 7f464fe28740 1 -- 172.21.15.19:0/1677300967 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46400051d0 con 0x5591748111b0 2024-09-19T08:53:10.291 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.288+0000 7f462dffb640 1 -- 172.21.15.19:0/1677300967 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4638004770 con 0x5591748111b0 2024-09-19T08:53:10.291 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.288+0000 7f462dffb640 1 -- 172.21.15.19:0/1677300967 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4638004970 con 0x5591748111b0 2024-09-19T08:53:10.291 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.288+0000 7f464fe28740 10 client.15702 fetch_fsmap learned FSMap version 28 2024-09-19T08:53:10.291 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.288+0000 7f464fe28740 1 -- 172.21.15.19:0/1677300967 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55917454b620 con 0x5591748111b0 2024-09-19T08:53:10.291 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.288+0000 7f462dffb640 1 -- 172.21.15.19:0/1677300967 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46400051d0 con 0x5591748111b0 2024-09-19T08:53:10.291 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.288+0000 7f462dffb640 1 -- 172.21.15.19:0/1677300967 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f463803a040 con 0x5591748111b0 2024-09-19T08:53:10.291 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.288+0000 7f464fe28740 10 client.15702 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:53:10.291 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.288+0000 7f464fe28740 10 client.15702 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:53:10.292 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.288+0000 7f464fe28740 20 client.15702 populate_metadata read hostname 'smithi019' 2024-09-19T08:53:10.292 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.288+0000 7f464fe28740 1 --2- 172.21.15.19:0/1677300967 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x559174827050 0x5591748294c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:10.292 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.288+0000 7f464fe28740 4 client.15702 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:53:10.292 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.288+0000 7f464fe28740 1 -- 172.21.15.19:0/1677300967 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559174779a20 con 0x559174827050 2024-09-19T08:53:10.292 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.289+0000 7f4645d9b640 1 --2- 172.21.15.19:0/1677300967 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x559174827050 0x5591748294c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:10.292 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.289+0000 7f462dffb640 10 client.15702 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:10.292 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.289+0000 7f4645d9b640 1 --2- 172.21.15.19:0/1677300967 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x559174827050 0x5591748294c0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a835e26e329964f server_cookie=146c80f0ed58ef44 in_seq=0 out_seq=0 2024-09-19T08:53:10.293 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.290+0000 7f462dffb640 1 -- 172.21.15.19:0/1677300967 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559174779a20 con 0x559174827050 2024-09-19T08:53:10.293 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.290+0000 7f462dffb640 10 client.15702 handle_command_reply: tid=0 2024-09-19T08:53:10.293 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.290+0000 7f464fe28740 1 client.15702 shutdown 2024-09-19T08:53:10.293 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.290+0000 7f464fe28740 1 -- 172.21.15.19:0/1677300967 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5591748111b0 msgr2=0x55917481b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:10.293 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.290+0000 7f464fe28740 1 --2- 172.21.15.19:0/1677300967 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5591748111b0 0x55917481b3e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4638009230 tx=0x7f4638005270 comp rx=0 tx=0).stop 2024-09-19T08:53:10.294 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.290+0000 7f464fe28740 1 -- 172.21.15.19:0/1677300967 shutdown_connections 2024-09-19T08:53:10.294 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.290+0000 7f464fe28740 1 --2- 172.21.15.19:0/1677300967 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x559174827050 0x5591748294c0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:10.294 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.290+0000 7f464fe28740 1 --2- 172.21.15.19:0/1677300967 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559174811af0 0x55917481b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:10.294 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.290+0000 7f464fe28740 1 --2- 172.21.15.19:0/1677300967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559174816b80 0x559174822960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:10.294 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.290+0000 7f464fe28740 1 --2- 172.21.15.19:0/1677300967 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5591748111b0 0x55917481b3e0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:10.294 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.290+0000 7f464fe28740 1 -- 172.21.15.19:0/1677300967 >> 172.21.15.19:0/1677300967 conn(0x559174804010 msgr2=0x559174805820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:10.294 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.290+0000 7f462dffb640 0 client.15702 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:10.294 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.290+0000 7f464fe28740 1 -- 172.21.15.19:0/1677300967 shutdown_connections 2024-09-19T08:53:10.294 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.290+0000 7f464fe28740 1 -- 172.21.15.19:0/1677300967 wait complete. 2024-09-19T08:53:10.294 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.291+0000 7f464fe28740 20 client.15702 trim_cache size 0 max 16384 2024-09-19T08:53:10.314 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.314+0000 7f464fe28740 1 Processor -- start 2024-09-19T08:53:10.314 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.314+0000 7f464fe28740 1 -- start start 2024-09-19T08:53:10.314 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.315+0000 7f464fe28740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5591748111b0 0x559174805400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:10.314 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.315+0000 7f464fe28740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559174811af0 0x559174822920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:10.314 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.315+0000 7f464fe28740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559174816b80 0x559174805940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:10.315 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.315+0000 7f464fe28740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f46481a6ce0 con 0x559174816b80 2024-09-19T08:53:10.315 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.315+0000 7f464fe28740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f46481a8820 con 0x5591748111b0 2024-09-19T08:53:10.315 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.315+0000 7f4646d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559174816b80 0x559174805940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:10.315 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.315+0000 7f4646d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559174816b80 0x559174805940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37588/0 (socket says 172.21.15.19:37588) 2024-09-19T08:53:10.315 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.315+0000 7f4646d9d640 1 -- 172.21.15.19:0/2837383888 learned_addr learned my addr 172.21.15.19:0/2837383888 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:10.315 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.315+0000 7f4645d9b640 1 --2- 172.21.15.19:0/2837383888 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559174811af0 0x559174822920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:10.315 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.315+0000 7f464659c640 1 --2- 172.21.15.19:0/2837383888 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5591748111b0 0x559174805400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:10.315 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.315+0000 7f464fe28740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f46481a73b0 con 0x559174811af0 2024-09-19T08:53:10.315 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.316+0000 7f464659c640 1 -- 172.21.15.19:0/2837383888 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559174811af0 msgr2=0x559174822920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:10.315 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.316+0000 7f464659c640 1 --2- 172.21.15.19:0/2837383888 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559174811af0 0x559174822920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:10.315 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.316+0000 7f464659c640 1 -- 172.21.15.19:0/2837383888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559174816b80 msgr2=0x559174805940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:10.316 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.316+0000 7f464659c640 1 --2- 172.21.15.19:0/2837383888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559174816b80 0x559174805940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:10.316 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.316+0000 7f464659c640 1 -- 172.21.15.19:0/2837383888 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559174829b40 con 0x5591748111b0 2024-09-19T08:53:10.316 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.316+0000 7f4646d9d640 1 --2- 172.21.15.19:0/2837383888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559174816b80 0x559174805940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:53:10.317 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.316+0000 7f464659c640 1 --2- 172.21.15.19:0/2837383888 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5591748111b0 0x559174805400 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4638006010 tx=0x7f4638031400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9fc3837b3b1f2a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:10.317 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.316+0000 7f462ffff640 1 -- 172.21.15.19:0/2837383888 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4638053070 con 0x5591748111b0 2024-09-19T08:53:10.317 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.316+0000 7f462ffff640 1 -- 172.21.15.19:0/2837383888 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f46380043e0 con 0x5591748111b0 2024-09-19T08:53:10.317 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.316+0000 7f462ffff640 1 -- 172.21.15.19:0/2837383888 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4638035040 con 0x5591748111b0 2024-09-19T08:53:10.317 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.317+0000 7f464fe28740 1 -- 172.21.15.19:0/2837383888 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5591748111b0 msgr2=0x559174805400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:10.317 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.317+0000 7f464fe28740 1 --2- 172.21.15.19:0/2837383888 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5591748111b0 0x559174805400 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4638006010 tx=0x7f4638031400 comp rx=0 tx=0).stop 2024-09-19T08:53:10.317 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.317+0000 7f464fe28740 1 -- 172.21.15.19:0/2837383888 shutdown_connections 2024-09-19T08:53:10.317 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.317+0000 7f464fe28740 1 --2- 172.21.15.19:0/2837383888 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559174811af0 0x559174822920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:10.318 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.317+0000 7f464fe28740 1 --2- 172.21.15.19:0/2837383888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559174816b80 0x559174805940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:10.318 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.317+0000 7f464fe28740 1 --2- 172.21.15.19:0/2837383888 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5591748111b0 0x559174805400 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:10.318 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.317+0000 7f464fe28740 1 -- 172.21.15.19:0/2837383888 >> 172.21.15.19:0/2837383888 conn(0x559174804010 msgr2=0x5591748031c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:10.318 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.318+0000 7f464fe28740 1 -- 172.21.15.19:0/2837383888 shutdown_connections 2024-09-19T08:53:10.318 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.318+0000 7f464fe28740 1 -- 172.21.15.19:0/2837383888 wait complete. 2024-09-19T08:53:10.318 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.318+0000 7f464fe28740 1 -- start start 2024-09-19T08:53:10.318 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.318+0000 7f464fe28740 1 Processor -- start 2024-09-19T08:53:10.320 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.319+0000 7f464fe28740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591748111b0 0x559174820690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:10.320 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.319+0000 7f464fe28740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559174811af0 0x559174820bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:10.320 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.319+0000 7f464fe28740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559174816b80 0x559174821b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:10.320 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.319+0000 7f464659c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591748111b0 0x559174820690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:10.320 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.319+0000 7f4645d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559174811af0 0x559174820bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:10.320 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.319+0000 7f4645d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559174811af0 0x559174820bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37604/0 (socket says 172.21.15.19:37604) 2024-09-19T08:53:10.320 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.319+0000 7f464659c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591748111b0 0x559174820690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:37412/0 (socket says 172.21.15.19:37412) 2024-09-19T08:53:10.320 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.319+0000 7f4645d9b640 1 -- 172.21.15.19:0/654470481 learned_addr learned my addr 172.21.15.19:0/654470481 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:10.320 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.319+0000 7f464fe28740 1 -- 172.21.15.19:0/654470481 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f46481a8150 con 0x559174811af0 2024-09-19T08:53:10.320 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.319+0000 7f464fe28740 1 -- 172.21.15.19:0/654470481 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f46481a7a80 con 0x559174816b80 2024-09-19T08:53:10.320 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.319+0000 7f4646d9d640 1 --2- 172.21.15.19:0/654470481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559174816b80 0x559174821b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:10.321 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.319+0000 7f464fe28740 1 -- 172.21.15.19:0/654470481 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f46481a4d10 con 0x5591748111b0 2024-09-19T08:53:10.321 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.320+0000 7f464fe28740 10 client.0 _ll_register_callbacks cb 0x7f4638005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:10.321 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.320+0000 7f4646d9d640 1 -- 172.21.15.19:0/654470481 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591748111b0 msgr2=0x559174820690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:10.321 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.320+0000 7f4646d9d640 1 --2- 172.21.15.19:0/654470481 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591748111b0 0x559174820690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:10.321 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.320+0000 7f4646d9d640 1 -- 172.21.15.19:0/654470481 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559174811af0 msgr2=0x559174820bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:10.321 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.320+0000 7f4646d9d640 1 --2- 172.21.15.19:0/654470481 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559174811af0 0x559174820bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:10.321 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.320+0000 7f4646d9d640 1 -- 172.21.15.19:0/654470481 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5591747ff2d0 con 0x559174816b80 2024-09-19T08:53:10.321 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.320+0000 7f4645d9b640 1 --2- 172.21.15.19:0/654470481 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559174811af0 0x559174820bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:53:10.321 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.320+0000 7f4646d9d640 1 --2- 172.21.15.19:0/654470481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559174816b80 0x559174821b70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4640005910 tx=0x7f46400a49a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24eb39410a4b78f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:10.321 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.320+0000 7f462dffb640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T08:53:10.321 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.321+0000 7f462dffb640 1 -- 172.21.15.19:0/654470481 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46400a8070 con 0x559174816b80 2024-09-19T08:53:10.321 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.321+0000 7f462dffb640 1 -- 172.21.15.19:0/654470481 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f46400cd2f0 con 0x559174816b80 2024-09-19T08:53:10.321 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.321+0000 7f464fe28740 1 -- 172.21.15.19:0/654470481 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46380043e0 con 0x559174816b80 2024-09-19T08:53:10.323 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.321+0000 7f462dffb640 1 -- 172.21.15.19:0/654470481 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f46400ba050 con 0x559174816b80 2024-09-19T08:53:10.323 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.321+0000 7f464fe28740 10 client.25310 fetch_fsmap learned FSMap version 28 2024-09-19T08:53:10.323 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.321+0000 7f464fe28740 1 -- 172.21.15.19:0/654470481 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559174892210 con 0x559174816b80 2024-09-19T08:53:10.323 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.322+0000 7f462dffb640 1 -- 172.21.15.19:0/654470481 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f464009b0b0 con 0x559174816b80 2024-09-19T08:53:10.323 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.322+0000 7f462dffb640 1 -- 172.21.15.19:0/654470481 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f4640022060 con 0x559174816b80 2024-09-19T08:53:10.324 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.323+0000 7f464fe28740 10 client.25310 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:53:10.324 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.323+0000 7f464fe28740 10 client.25310 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:53:10.324 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.323+0000 7f464fe28740 20 client.25310 populate_metadata read hostname 'smithi019' 2024-09-19T08:53:10.324 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.323+0000 7f464fe28740 1 --2- 172.21.15.19:0/654470481 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5591748926b0 0x559174894aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:10.324 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.323+0000 7f464fe28740 4 client.25310 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:53:10.324 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.323+0000 7f464fe28740 1 -- 172.21.15.19:0/654470481 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f46380043e0 con 0x5591748926b0 2024-09-19T08:53:10.324 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.323+0000 7f464659c640 1 --2- 172.21.15.19:0/654470481 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5591748926b0 0x559174894aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:10.324 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.324+0000 7f464659c640 1 --2- 172.21.15.19:0/654470481 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5591748926b0 0x559174894aa0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=819ae25cb89d14b9 server_cookie=8e61306fe3e3adf7 in_seq=0 out_seq=0 2024-09-19T08:53:10.324 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.324+0000 7f462dffb640 10 client.25310 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:10.331 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.331+0000 7f462dffb640 1 -- 172.21.15.19:0/654470481 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f46380043e0 con 0x5591748926b0 2024-09-19T08:53:10.331 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.331+0000 7f462dffb640 10 client.25310 handle_command_reply: tid=0 2024-09-19T08:53:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.331+0000 7f464fe28740 1 client.25310 shutdown 2024-09-19T08:53:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.331+0000 7f464fe28740 1 -- 172.21.15.19:0/654470481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559174816b80 msgr2=0x559174821b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.331+0000 7f464fe28740 1 --2- 172.21.15.19:0/654470481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559174816b80 0x559174821b70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4640005910 tx=0x7f46400a49a0 comp rx=0 tx=0).stop 2024-09-19T08:53:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.332+0000 7f464fe28740 1 -- 172.21.15.19:0/654470481 shutdown_connections 2024-09-19T08:53:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.332+0000 7f464fe28740 1 --2- 172.21.15.19:0/654470481 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5591748926b0 0x559174894aa0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.332+0000 7f462dffb640 0 client.25310 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.332+0000 7f464fe28740 1 --2- 172.21.15.19:0/654470481 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559174816b80 0x559174821b70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.332+0000 7f464fe28740 1 --2- 172.21.15.19:0/654470481 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559174811af0 0x559174820bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.332+0000 7f464fe28740 1 --2- 172.21.15.19:0/654470481 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5591748111b0 0x559174820690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.332+0000 7f464fe28740 1 -- 172.21.15.19:0/654470481 >> 172.21.15.19:0/654470481 conn(0x559174804010 msgr2=0x5591748043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.332+0000 7f464fe28740 1 -- 172.21.15.19:0/654470481 shutdown_connections 2024-09-19T08:53:10.332 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.332+0000 7f464fe28740 1 -- 172.21.15.19:0/654470481 wait complete. 2024-09-19T08:53:10.333 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.332+0000 7f464fe28740 20 client.25310 trim_cache size 0 max 16384 2024-09-19T08:53:10.333 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T08:53:10.333 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T08:53:10.333 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T08:53:10.333 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T08:53:10.335 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.333+0000 7f464cfb9640 1 -- 172.21.15.19:0/371847074 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f46300a3410 msgr2=0x7f46300a58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:10.335 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.333+0000 7f464cfb9640 1 --2- 172.21.15.19:0/371847074 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f46300a3410 0x7f46300a58d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4648199340 tx=0x7f463c005f90 comp rx=0 tx=0).stop 2024-09-19T08:53:10.335 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.333+0000 7f464cfb9640 1 -- 172.21.15.19:0/371847074 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4648102640 msgr2=0x7f464819f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:10.335 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.333+0000 7f464cfb9640 1 --2- 172.21.15.19:0/371847074 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4648102640 0x7f464819f3e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f464000e940 tx=0x7f464000ee00 comp rx=0 tx=0).stop 2024-09-19T08:53:10.335 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.333+0000 7f464cfb9640 1 -- 172.21.15.19:0/371847074 shutdown_connections 2024-09-19T08:53:10.335 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.333+0000 7f464cfb9640 1 --2- 172.21.15.19:0/371847074 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f46300a3410 0x7f46300a58d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:10.335 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.333+0000 7f464cfb9640 1 --2- 172.21.15.19:0/371847074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4648101c80 0x7f4648198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:10.335 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.333+0000 7f464cfb9640 1 --2- 172.21.15.19:0/371847074 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4648102640 0x7f464819f3e0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:10.335 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.333+0000 7f464cfb9640 1 --2- 172.21.15.19:0/371847074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4648100f70 0x7f4648197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:10.336 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.333+0000 7f464cfb9640 1 -- 172.21.15.19:0/371847074 >> 172.21.15.19:0/371847074 conn(0x7f46480fb930 msgr2=0x7f46480fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:10.336 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.333+0000 7f464cfb9640 1 -- 172.21.15.19:0/371847074 shutdown_connections 2024-09-19T08:53:10.336 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:10.333+0000 7f464cfb9640 1 -- 172.21.15.19:0/371847074 wait complete. 2024-09-19T08:53:10.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:09 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3794896874' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:53:10.491 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:11.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.058+0000 7f1dd8b27640 1 -- 172.21.15.19:0/2336995455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1dd41012e0 msgr2=0x7f1dd410dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:11.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.058+0000 7f1dd8b27640 1 --2- 172.21.15.19:0/2336995455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1dd41012e0 0x7f1dd410dfa0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8009900 tx=0x7f1dc802a410 comp rx=0 tx=0).stop 2024-09-19T08:53:11.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.058+0000 7f1dd8b27640 1 -- 172.21.15.19:0/2336995455 shutdown_connections 2024-09-19T08:53:11.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.058+0000 7f1dd8b27640 1 --2- 172.21.15.19:0/2336995455 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1dd410e4e0 0x7f1dd41108d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.058+0000 7f1dd8b27640 1 --2- 172.21.15.19:0/2336995455 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1dd41012e0 0x7f1dd410dfa0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.058+0000 7f1dd8b27640 1 --2- 172.21.15.19:0/2336995455 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1dd4100930 0x7f1dd4100d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.058+0000 7f1dd8b27640 1 -- 172.21.15.19:0/2336995455 >> 172.21.15.19:0/2336995455 conn(0x7f1dd40fc7a0 msgr2=0x7f1dd40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:11.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.059+0000 7f1dd8b27640 1 -- 172.21.15.19:0/2336995455 shutdown_connections 2024-09-19T08:53:11.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.059+0000 7f1dd8b27640 1 -- 172.21.15.19:0/2336995455 wait complete. 2024-09-19T08:53:11.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.059+0000 7f1dd8b27640 1 Processor -- start 2024-09-19T08:53:11.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.059+0000 7f1dd8b27640 1 -- start start 2024-09-19T08:53:11.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.060+0000 7f1dd8b27640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1dd4100930 0x7f1dd419a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:11.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.060+0000 7f1dd8b27640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1dd41012e0 0x7f1dd419abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:11.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.060+0000 7f1dd8b27640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1dd410e4e0 0x7f1dd419ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.060+0000 7f1dd8b27640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd4114180 con 0x7f1dd4100930 2024-09-19T08:53:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.060+0000 7f1dd8b27640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd4114000 con 0x7f1dd410e4e0 2024-09-19T08:53:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.060+0000 7f1dd8b27640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1dd4114300 con 0x7f1dd41012e0 2024-09-19T08:53:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.060+0000 7f1dd259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1dd4100930 0x7f1dd419a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.060+0000 7f1dd259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1dd4100930 0x7f1dd419a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37632/0 (socket says 172.21.15.19:37632) 2024-09-19T08:53:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.060+0000 7f1dd259c640 1 -- 172.21.15.19:0/3075077900 learned_addr learned my addr 172.21.15.19:0/3075077900 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.060+0000 7f1dd1d9b640 1 --2- 172.21.15.19:0/3075077900 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1dd41012e0 0x7f1dd419abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.060+0000 7f1dd2d9d640 1 --2- 172.21.15.19:0/3075077900 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1dd410e4e0 0x7f1dd419ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.060+0000 7f1dd1d9b640 1 -- 172.21.15.19:0/3075077900 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1dd410e4e0 msgr2=0x7f1dd419ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.060+0000 7f1dd1d9b640 1 --2- 172.21.15.19:0/3075077900 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1dd410e4e0 0x7f1dd419ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.060+0000 7f1dd1d9b640 1 -- 172.21.15.19:0/3075077900 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1dd4100930 msgr2=0x7f1dd419a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.061+0000 7f1dd1d9b640 1 --2- 172.21.15.19:0/3075077900 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1dd4100930 0x7f1dd419a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.061+0000 7f1dd1d9b640 1 -- 172.21.15.19:0/3075077900 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dd419f630 con 0x7f1dd41012e0 2024-09-19T08:53:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.061+0000 7f1dd259c640 1 --2- 172.21.15.19:0/3075077900 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1dd4100930 0x7f1dd419a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:53:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.061+0000 7f1dd1d9b640 1 --2- 172.21.15.19:0/3075077900 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1dd41012e0 0x7f1dd419abc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8005940 tx=0x7f1dc80040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.061+0000 7f1dc37fe640 1 -- 172.21.15.19:0/3075077900 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc803f030 con 0x7f1dd41012e0 2024-09-19T08:53:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.061+0000 7f1dd8b27640 1 -- 172.21.15.19:0/3075077900 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dd419f8c0 con 0x7f1dd41012e0 2024-09-19T08:53:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.061+0000 7f1dd8b27640 1 -- 172.21.15.19:0/3075077900 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dd41a7200 con 0x7f1dd41012e0 2024-09-19T08:53:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.061+0000 7f1dc37fe640 1 -- 172.21.15.19:0/3075077900 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1dc80044c0 con 0x7f1dd41012e0 2024-09-19T08:53:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.061+0000 7f1dc37fe640 1 -- 172.21.15.19:0/3075077900 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc8035070 con 0x7f1dd41012e0 2024-09-19T08:53:11.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.064+0000 7f1ddaf00740 1 Processor -- start 2024-09-19T08:53:11.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.064+0000 7f1ddaf00740 1 -- start start 2024-09-19T08:53:11.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.065+0000 7f1ddaf00740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557908ed2060 0x557908ed2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:11.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.065+0000 7f1ddaf00740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557908ed2980 0x557908edcd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:11.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.065+0000 7f1ddaf00740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557908edd240 0x557908edf630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:11.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.065+0000 7f1ddaf00740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557908e37620 con 0x557908edd240 2024-09-19T08:53:11.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.065+0000 7f1ddaf00740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x557908ddee50 con 0x557908ed2060 2024-09-19T08:53:11.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.065+0000 7f1ddaf00740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557908e335e0 con 0x557908ed2980 2024-09-19T08:53:11.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.065+0000 7f1dd259c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557908ed2980 0x557908edcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:11.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.065+0000 7f1dd259c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557908ed2980 0x557908edcd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:37452/0 (socket says 172.21.15.19:37452) 2024-09-19T08:53:11.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.065+0000 7f1dd259c640 1 -- 172.21.15.19:0/1536337172 learned_addr learned my addr 172.21.15.19:0/1536337172 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:11.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.065+0000 7f1dd2d9d640 1 --2- 172.21.15.19:0/1536337172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557908ed2060 0x557908ed2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:11.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.065+0000 7f1dd259c640 1 -- 172.21.15.19:0/1536337172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557908ed2060 msgr2=0x557908ed2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:11.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.065+0000 7f1dd259c640 1 --2- 172.21.15.19:0/1536337172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557908ed2060 0x557908ed2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.065+0000 7f1dd259c640 1 -- 172.21.15.19:0/1536337172 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557908edd240 msgr2=0x557908edf630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T08:53:11.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.065+0000 7f1dd259c640 1 --2- 172.21.15.19:0/1536337172 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557908edd240 0x557908edf630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.065+0000 7f1dd259c640 1 -- 172.21.15.19:0/1536337172 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557908dcfd40 con 0x557908ed2980 2024-09-19T08:53:11.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.065+0000 7f1dd259c640 1 --2- 172.21.15.19:0/1536337172 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557908ed2980 0x557908edcd00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4011630 tx=0x7f1dc4011af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33198c99d8562a3b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:11.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.066+0000 7f1dc37fe640 1 -- 172.21.15.19:0/3075077900 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 19) ==== 138406+0+0 (secure 0 0 0) 0x7f1dc8042030 con 0x7f1dd41012e0 2024-09-19T08:53:11.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.066+0000 7f1dc0ff9640 1 -- 172.21.15.19:0/1536337172 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc401e070 con 0x557908ed2980 2024-09-19T08:53:11.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.066+0000 7f1dc0ff9640 1 -- 172.21.15.19:0/1536337172 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1dc400fbd0 con 0x557908ed2980 2024-09-19T08:53:11.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.066+0000 7f1dc0ff9640 1 -- 172.21.15.19:0/1536337172 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4019d00 con 0x557908ed2980 2024-09-19T08:53:11.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.066+0000 7f1ddaf00740 1 -- 172.21.15.19:0/1536337172 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557908ed2980 msgr2=0x557908edcd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:11.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.066+0000 7f1ddaf00740 1 --2- 172.21.15.19:0/1536337172 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557908ed2980 0x557908edcd00 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4011630 tx=0x7f1dc4011af0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.066+0000 7f1dc37fe640 1 --2- 172.21.15.19:0/3075077900 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1dbc0a3350 0x7f1dbc0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:11.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.067+0000 7f1ddaf00740 1 -- 172.21.15.19:0/1536337172 shutdown_connections 2024-09-19T08:53:11.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.067+0000 7f1ddaf00740 1 --2- 172.21.15.19:0/1536337172 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557908ed2980 0x557908edcd00 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.067+0000 7f1ddaf00740 1 --2- 172.21.15.19:0/1536337172 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557908edd240 0x557908edf630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.067+0000 7f1ddaf00740 1 --2- 172.21.15.19:0/1536337172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557908ed2060 0x557908ed2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.067+0000 7f1ddaf00740 1 -- 172.21.15.19:0/1536337172 >> 172.21.15.19:0/1536337172 conn(0x557908ece5f0 msgr2=0x557908ece9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:11.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.067+0000 7f1dc37fe640 1 -- 172.21.15.19:0/3075077900 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1dc80efb70 con 0x7f1dd41012e0 2024-09-19T08:53:11.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.067+0000 7f1dd2d9d640 1 --2- 172.21.15.19:0/3075077900 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1dbc0a3350 0x7f1dbc0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:11.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.067+0000 7f1ddaf00740 1 -- 172.21.15.19:0/1536337172 shutdown_connections 2024-09-19T08:53:11.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.067+0000 7f1ddaf00740 1 -- 172.21.15.19:0/1536337172 wait complete. 2024-09-19T08:53:11.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.068+0000 7f1ddaf00740 1 -- start start 2024-09-19T08:53:11.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.068+0000 7f1ddaf00740 1 Processor -- start 2024-09-19T08:53:11.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.068+0000 7f1dd2d9d640 1 --2- 172.21.15.19:0/3075077900 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1dbc0a3350 0x7f1dbc0a5810 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4102b10 tx=0x7f1dcc009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:11.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.068+0000 7f1ddaf00740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557908ed2060 0x557908eda1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:11.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.068+0000 7f1ddaf00740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557908ed2980 0x557908eda6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:11.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.068+0000 7f1dd259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557908ed2060 0x557908eda1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:11.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.068+0000 7f1dd259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557908ed2060 0x557908eda1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37640/0 (socket says 172.21.15.19:37640) 2024-09-19T08:53:11.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.068+0000 7f1ddaf00740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557908edd240 0x557908edac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:11.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.069+0000 7f1ddaf00740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557908edfe10 con 0x557908ed2060 2024-09-19T08:53:11.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.069+0000 7f1dd259c640 1 -- 172.21.15.19:0/1706240590 learned_addr learned my addr 172.21.15.19:0/1706240590 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:11.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.069+0000 7f1ddaf00740 1 -- 172.21.15.19:0/1706240590 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x557908dbff10 con 0x557908ed2980 2024-09-19T08:53:11.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.069+0000 7f1ddaf00740 1 -- 172.21.15.19:0/1706240590 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557908edff90 con 0x557908edd240 2024-09-19T08:53:11.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.069+0000 7f1dd2d9d640 1 --2- 172.21.15.19:0/1706240590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557908edd240 0x557908edac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:11.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.069+0000 7f1dd1d9b640 1 --2- 172.21.15.19:0/1706240590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557908ed2980 0x557908eda6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:11.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.069+0000 7f1ddaf00740 10 client.0 _ll_register_callbacks cb 0x557908de3db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:11.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.069+0000 7f1dd2d9d640 1 -- 172.21.15.19:0/1706240590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557908ed2980 msgr2=0x557908eda6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:11.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.069+0000 7f1dd2d9d640 1 --2- 172.21.15.19:0/1706240590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557908ed2980 0x557908eda6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.069+0000 7f1dd2d9d640 1 -- 172.21.15.19:0/1706240590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557908ed2060 msgr2=0x557908eda1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:11.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.069+0000 7f1dd2d9d640 1 --2- 172.21.15.19:0/1706240590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557908ed2060 0x557908eda1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.069+0000 7f1dd2d9d640 1 -- 172.21.15.19:0/1706240590 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557908b46580 con 0x557908edd240 2024-09-19T08:53:11.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.069+0000 7f1dd259c640 1 --2- 172.21.15.19:0/1706240590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557908ed2060 0x557908eda1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:53:11.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.070+0000 7f1dd2d9d640 1 --2- 172.21.15.19:0/1706240590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557908edd240 0x557908edac20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc003f50 tx=0x7f1dcc004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdabadf9adaa0803 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:11.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.070+0000 7f1db9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T08:53:11.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.070+0000 7f1db9ffb640 1 -- 172.21.15.19:0/1706240590 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc00f750 con 0x557908edd240 2024-09-19T08:53:11.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.070+0000 7f1db9ffb640 1 -- 172.21.15.19:0/1706240590 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1dcc00f8f0 con 0x557908edd240 2024-09-19T08:53:11.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.070+0000 7f1ddaf00740 1 -- 172.21.15.19:0/1706240590 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1dc400fbd0 con 0x557908edd240 2024-09-19T08:53:11.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.070+0000 7f1db9ffb640 1 -- 172.21.15.19:0/1706240590 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1dcc00faf0 con 0x557908edd240 2024-09-19T08:53:11.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.070+0000 7f1ddaf00740 10 client.25315 fetch_fsmap learned FSMap version 28 2024-09-19T08:53:11.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.070+0000 7f1ddaf00740 1 -- 172.21.15.19:0/1706240590 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557908c10960 con 0x557908edd240 2024-09-19T08:53:11.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.070+0000 7f1db9ffb640 1 -- 172.21.15.19:0/1706240590 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1dcc00fc90 con 0x557908edd240 2024-09-19T08:53:11.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.070+0000 7f1db9ffb640 1 -- 172.21.15.19:0/1706240590 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1dcc026020 con 0x557908edd240 2024-09-19T08:53:11.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.071+0000 7f1ddaf00740 10 client.25315 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:53:11.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.071+0000 7f1ddaf00740 10 client.25315 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T08:53:11.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.071+0000 7f1ddaf00740 20 client.25315 populate_metadata read hostname 'smithi019' 2024-09-19T08:53:11.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.071+0000 7f1ddaf00740 1 --2- 172.21.15.19:0/1706240590 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557908ef5780 0x557908ef7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:11.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.071+0000 7f1ddaf00740 4 client.25315 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:53:11.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.071+0000 7f1ddaf00740 1 -- 172.21.15.19:0/1706240590 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1dc400fbd0 con 0x557908ef5780 2024-09-19T08:53:11.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.071+0000 7f1dd259c640 1 --2- 172.21.15.19:0/1706240590 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557908ef5780 0x557908ef7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:11.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.072+0000 7f1db9ffb640 10 client.25315 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:11.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.072+0000 7f1dd259c640 1 --2- 172.21.15.19:0/1706240590 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557908ef5780 0x557908ef7bc0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8842a5c77e5654a server_cookie=9b155f71440715ee in_seq=0 out_seq=0 2024-09-19T08:53:11.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.072+0000 7f1db9ffb640 1 -- 172.21.15.19:0/1706240590 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f1dc400fbd0 con 0x557908ef5780 2024-09-19T08:53:11.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.072+0000 7f1db9ffb640 10 client.25315 handle_command_reply: tid=0 2024-09-19T08:53:11.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.072+0000 7f1ddaf00740 1 client.25315 shutdown 2024-09-19T08:53:11.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.073+0000 7f1ddaf00740 1 -- 172.21.15.19:0/1706240590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557908edd240 msgr2=0x557908edac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:11.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.073+0000 7f1ddaf00740 1 --2- 172.21.15.19:0/1706240590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557908edd240 0x557908edac20 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc003f50 tx=0x7f1dcc004ab0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.073+0000 7f1ddaf00740 1 -- 172.21.15.19:0/1706240590 shutdown_connections 2024-09-19T08:53:11.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.073+0000 7f1ddaf00740 1 --2- 172.21.15.19:0/1706240590 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557908ef5780 0x557908ef7bc0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.073+0000 7f1ddaf00740 1 --2- 172.21.15.19:0/1706240590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557908edd240 0x557908edac20 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.073+0000 7f1ddaf00740 1 --2- 172.21.15.19:0/1706240590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557908ed2980 0x557908eda6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.073+0000 7f1ddaf00740 1 --2- 172.21.15.19:0/1706240590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557908ed2060 0x557908eda1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.073+0000 7f1db9ffb640 0 client.25315 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:11.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.073+0000 7f1ddaf00740 1 -- 172.21.15.19:0/1706240590 >> 172.21.15.19:0/1706240590 conn(0x557908ece5f0 msgr2=0x557908ed42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:11.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.073+0000 7f1ddaf00740 1 -- 172.21.15.19:0/1706240590 shutdown_connections 2024-09-19T08:53:11.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.073+0000 7f1ddaf00740 1 -- 172.21.15.19:0/1706240590 wait complete. 2024-09-19T08:53:11.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.073+0000 7f1ddaf00740 20 client.25315 trim_cache size 0 max 16384 2024-09-19T08:53:11.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.090+0000 7f1ddaf00740 1 Processor -- start 2024-09-19T08:53:11.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.091+0000 7f1ddaf00740 1 -- start start 2024-09-19T08:53:11.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.091+0000 7f1ddaf00740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557908ed2060 0x557908ed41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:11.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.091+0000 7f1ddaf00740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557908ed2980 0x557908efd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:11.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.091+0000 7f1ddaf00740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557908edd240 0x557908efd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:11.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.091+0000 7f1ddaf00740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1db400e400 con 0x557908ed2980 2024-09-19T08:53:11.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.091+0000 7f1ddaf00740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1db400ff40 con 0x557908ed2060 2024-09-19T08:53:11.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.091+0000 7f1ddaf00740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1db400ead0 con 0x557908edd240 2024-09-19T08:53:11.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.091+0000 7f1dd1d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557908ed2980 0x557908efd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:11.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.091+0000 7f1dd1d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557908ed2980 0x557908efd490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37648/0 (socket says 172.21.15.19:37648) 2024-09-19T08:53:11.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.091+0000 7f1dd1d9b640 1 -- 172.21.15.19:0/4136750155 learned_addr learned my addr 172.21.15.19:0/4136750155 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:11.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.091+0000 7f1dd259c640 1 --2- 172.21.15.19:0/4136750155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557908ed2060 0x557908ed41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:11.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.091+0000 7f1dd2d9d640 1 --2- 172.21.15.19:0/4136750155 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557908edd240 0x557908efd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:11.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.092+0000 7f1dd1d9b640 1 -- 172.21.15.19:0/4136750155 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557908edd240 msgr2=0x557908efd9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:11.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.092+0000 7f1dd1d9b640 1 --2- 172.21.15.19:0/4136750155 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557908edd240 0x557908efd9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.092+0000 7f1dd1d9b640 1 -- 172.21.15.19:0/4136750155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557908ed2060 msgr2=0x557908ed41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:11.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.092+0000 7f1dd1d9b640 1 --2- 172.21.15.19:0/4136750155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557908ed2060 0x557908ed41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.092+0000 7f1dd1d9b640 1 -- 172.21.15.19:0/4136750155 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557908ecf780 con 0x557908ed2980 2024-09-19T08:53:11.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.092+0000 7f1dd1d9b640 1 --2- 172.21.15.19:0/4136750155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557908ed2980 0x557908efd490 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8006010 tx=0x7f1dc8005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3b1e10537ce7bf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:11.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.092+0000 7f1dbbfff640 1 -- 172.21.15.19:0/4136750155 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc80c4cb0 con 0x557908ed2980 2024-09-19T08:53:11.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.092+0000 7f1dbbfff640 1 -- 172.21.15.19:0/4136750155 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1dc80ba340 con 0x557908ed2980 2024-09-19T08:53:11.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.092+0000 7f1dbbfff640 1 -- 172.21.15.19:0/4136750155 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc80bc2a0 con 0x557908ed2980 2024-09-19T08:53:11.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.093+0000 7f1ddaf00740 1 -- 172.21.15.19:0/4136750155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557908ed2980 msgr2=0x557908efd490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:11.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.093+0000 7f1ddaf00740 1 --2- 172.21.15.19:0/4136750155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557908ed2980 0x557908efd490 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8006010 tx=0x7f1dc8005bb0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.093+0000 7f1ddaf00740 1 -- 172.21.15.19:0/4136750155 shutdown_connections 2024-09-19T08:53:11.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.093+0000 7f1ddaf00740 1 --2- 172.21.15.19:0/4136750155 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557908edd240 0x557908efd9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.093+0000 7f1ddaf00740 1 --2- 172.21.15.19:0/4136750155 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557908ed2980 0x557908efd490 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.093+0000 7f1ddaf00740 1 --2- 172.21.15.19:0/4136750155 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557908ed2060 0x557908ed41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.093+0000 7f1ddaf00740 1 -- 172.21.15.19:0/4136750155 >> 172.21.15.19:0/4136750155 conn(0x557908ece5f0 msgr2=0x557908ed3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:11.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.093+0000 7f1ddaf00740 1 -- 172.21.15.19:0/4136750155 shutdown_connections 2024-09-19T08:53:11.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.093+0000 7f1ddaf00740 1 -- 172.21.15.19:0/4136750155 wait complete. 2024-09-19T08:53:11.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.094+0000 7f1ddaf00740 1 -- start start 2024-09-19T08:53:11.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.094+0000 7f1ddaf00740 1 Processor -- start 2024-09-19T08:53:11.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.094+0000 7f1ddaf00740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557908ed2060 0x557908ee98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:11.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.094+0000 7f1ddaf00740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557908ed2980 0x557908ee9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:11.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.094+0000 7f1ddaf00740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557908edd240 0x557908eea360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:11.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.094+0000 7f1ddaf00740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1db400f870 con 0x557908edd240 2024-09-19T08:53:11.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.094+0000 7f1ddaf00740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1db400f1a0 con 0x557908ed2980 2024-09-19T08:53:11.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.094+0000 7f1ddaf00740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1db400c3e0 con 0x557908ed2060 2024-09-19T08:53:11.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.094+0000 7f1ddaf00740 10 client.0 _ll_register_callbacks cb 0x7f1dcc003de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:11.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.094+0000 7f1dd1d9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557908ed2980 0x557908ee9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:11.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.094+0000 7f1dd1d9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557908ed2980 0x557908ee9e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:46312/0 (socket says 172.21.15.19:46312) 2024-09-19T08:53:11.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.094+0000 7f1dd1d9b640 1 -- 172.21.15.19:0/2607779941 learned_addr learned my addr 172.21.15.19:0/2607779941 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:11.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.094+0000 7f1dd259c640 1 --2- 172.21.15.19:0/2607779941 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557908ed2060 0x557908ee98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:11.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.094+0000 7f1dd2d9d640 1 --2- 172.21.15.19:0/2607779941 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557908edd240 0x557908eea360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:11.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.095+0000 7f1dd1d9b640 1 -- 172.21.15.19:0/2607779941 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557908ed2060 msgr2=0x557908ee98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:11.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.095+0000 7f1dd1d9b640 1 --2- 172.21.15.19:0/2607779941 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557908ed2060 0x557908ee98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.095+0000 7f1dd1d9b640 1 -- 172.21.15.19:0/2607779941 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557908edd240 msgr2=0x557908eea360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:11.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.095+0000 7f1dd1d9b640 1 --2- 172.21.15.19:0/2607779941 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557908edd240 0x557908eea360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.095+0000 7f1dd1d9b640 1 -- 172.21.15.19:0/2607779941 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557908f5f4e0 con 0x557908ed2980 2024-09-19T08:53:11.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.095+0000 7f1dd2d9d640 1 --2- 172.21.15.19:0/2607779941 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557908edd240 0x557908eea360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:53:11.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.095+0000 7f1dd1d9b640 1 --2- 172.21.15.19:0/2607779941 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557908ed2980 0x557908ee9e20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8005c20 tx=0x7f1dc80ba4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e43e0023b41d1fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:11.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.095+0000 7f1db9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T08:53:11.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.095+0000 7f1db9ffb640 1 -- 172.21.15.19:0/2607779941 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dc809f060 con 0x557908ed2980 2024-09-19T08:53:11.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.095+0000 7f1db9ffb640 1 -- 172.21.15.19:0/2607779941 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1dc80b86b0 con 0x557908ed2980 2024-09-19T08:53:11.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.095+0000 7f1ddaf00740 1 -- 172.21.15.19:0/2607779941 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1dc80ba340 con 0x557908ed2980 2024-09-19T08:53:11.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.096+0000 7f1db9ffb640 1 -- 172.21.15.19:0/2607779941 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1dc80c4cb0 con 0x557908ed2980 2024-09-19T08:53:11.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.096+0000 7f1ddaf00740 10 client.25328 fetch_fsmap learned FSMap version 28 2024-09-19T08:53:11.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.096+0000 7f1ddaf00740 1 -- 172.21.15.19:0/2607779941 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557908f60800 con 0x557908ed2980 2024-09-19T08:53:11.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.096+0000 7f1db9ffb640 1 -- 172.21.15.19:0/2607779941 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1dc80ba340 con 0x557908ed2980 2024-09-19T08:53:11.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.096+0000 7f1db9ffb640 1 -- 172.21.15.19:0/2607779941 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f1dc80d9030 con 0x557908ed2980 2024-09-19T08:53:11.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.096+0000 7f1ddaf00740 10 client.25328 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:53:11.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.096+0000 7f1ddaf00740 10 client.25328 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T08:53:11.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.096+0000 7f1ddaf00740 20 client.25328 populate_metadata read hostname 'smithi019' 2024-09-19T08:53:11.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.096+0000 7f1ddaf00740 1 --2- 172.21.15.19:0/2607779941 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557908f60ed0 0x557908f632f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:11.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.096+0000 7f1ddaf00740 4 client.25328 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "9b6cce55", "release": true, "await": true}] 2024-09-19T08:53:11.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.096+0000 7f1ddaf00740 1 -- 172.21.15.19:0/2607779941 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "quiesce db", "set_id": "9b6cce55", "release": true, "await": true}) -- 0x557908e44b90 con 0x557908f60ed0 2024-09-19T08:53:11.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.097+0000 7f1dd259c640 1 --2- 172.21.15.19:0/2607779941 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557908f60ed0 0x557908f632f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:11.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.097+0000 7f1db9ffb640 10 client.25328 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:11.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.097+0000 7f1dd259c640 1 --2- 172.21.15.19:0/2607779941 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557908f60ed0 0x557908f632f0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c578164b883ddfc server_cookie=231217bee561ffd6 in_seq=0 out_seq=0 2024-09-19T08:53:11.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.099+0000 7f1db9ffb640 1 -- 172.21.15.19:0/2607779941 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x557908e44b90 con 0x557908f60ed0 2024-09-19T08:53:11.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.099+0000 7f1db9ffb640 10 client.25328 handle_command_reply: tid=0 2024-09-19T08:53:11.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.099+0000 7f1ddaf00740 1 client.25328 shutdown 2024-09-19T08:53:11.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.099+0000 7f1ddaf00740 1 -- 172.21.15.19:0/2607779941 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557908ed2980 msgr2=0x557908ee9e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:11.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.099+0000 7f1ddaf00740 1 --2- 172.21.15.19:0/2607779941 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557908ed2980 0x557908ee9e20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8005c20 tx=0x7f1dc80ba4f0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.099+0000 7f1ddaf00740 1 -- 172.21.15.19:0/2607779941 shutdown_connections 2024-09-19T08:53:11.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.099+0000 7f1ddaf00740 1 --2- 172.21.15.19:0/2607779941 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557908f60ed0 0x557908f632f0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.099+0000 7f1ddaf00740 1 --2- 172.21.15.19:0/2607779941 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557908edd240 0x557908eea360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.099+0000 7f1ddaf00740 1 --2- 172.21.15.19:0/2607779941 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557908ed2980 0x557908ee9e20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.099+0000 7f1ddaf00740 1 --2- 172.21.15.19:0/2607779941 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557908ed2060 0x557908ee98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.099+0000 7f1ddaf00740 1 -- 172.21.15.19:0/2607779941 >> 172.21.15.19:0/2607779941 conn(0x557908ece5f0 msgr2=0x557908ef11a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:11.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.099+0000 7f1db9ffb640 0 client.25328 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:11.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.099+0000 7f1ddaf00740 1 -- 172.21.15.19:0/2607779941 shutdown_connections 2024-09-19T08:53:11.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.100+0000 7f1ddaf00740 1 -- 172.21.15.19:0/2607779941 wait complete. 2024-09-19T08:53:11.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.100+0000 7f1ddaf00740 20 client.25328 trim_cache size 0 max 16384 2024-09-19T08:53:11.102 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:53:11.102 INFO:teuthology.orchestra.run.smithi019.stdout: "epoch": 28, 2024-09-19T08:53:11.102 INFO:teuthology.orchestra.run.smithi019.stdout: "leader": 24497, 2024-09-19T08:53:11.102 INFO:teuthology.orchestra.run.smithi019.stdout: "set_version": 4, 2024-09-19T08:53:11.102 INFO:teuthology.orchestra.run.smithi019.stdout: "sets": { 2024-09-19T08:53:11.102 INFO:teuthology.orchestra.run.smithi019.stdout: "9b6cce55": { 2024-09-19T08:53:11.102 INFO:teuthology.orchestra.run.smithi019.stdout: "version": 4, 2024-09-19T08:53:11.102 INFO:teuthology.orchestra.run.smithi019.stdout: "age_ref": 0.0, 2024-09-19T08:53:11.102 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T08:53:11.103 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RELEASED", 2024-09-19T08:53:11.103 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T08:53:11.103 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T08:53:11.103 INFO:teuthology.orchestra.run.smithi019.stdout: "timeout": 90.0, 2024-09-19T08:53:11.103 INFO:teuthology.orchestra.run.smithi019.stdout: "expiration": 131.2, 2024-09-19T08:53:11.103 INFO:teuthology.orchestra.run.smithi019.stdout: "members": { 2024-09-19T08:53:11.103 INFO:teuthology.orchestra.run.smithi019.stdout: "file:/": { 2024-09-19T08:53:11.103 INFO:teuthology.orchestra.run.smithi019.stdout: "excluded": false, 2024-09-19T08:53:11.103 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T08:53:11.103 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RELEASED", 2024-09-19T08:53:11.103 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T08:53:11.104 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:53:11.104 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:53:11.104 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:53:11.104 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:53:11.104 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:53:11.104 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:53:11.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.100+0000 7f1dd8b27640 1 -- 172.21.15.19:0/3075077900 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1dbc0a3350 msgr2=0x7f1dbc0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:11.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.100+0000 7f1dd8b27640 1 --2- 172.21.15.19:0/3075077900 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1dbc0a3350 0x7f1dbc0a5810 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4102b10 tx=0x7f1dcc009500 comp rx=0 tx=0).stop 2024-09-19T08:53:11.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.100+0000 7f1dd8b27640 1 -- 172.21.15.19:0/3075077900 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1dd41012e0 msgr2=0x7f1dd419abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:11.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.100+0000 7f1dd8b27640 1 --2- 172.21.15.19:0/3075077900 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1dd41012e0 0x7f1dd419abc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8005940 tx=0x7f1dc80040c0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.101+0000 7f1dd8b27640 1 -- 172.21.15.19:0/3075077900 shutdown_connections 2024-09-19T08:53:11.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.101+0000 7f1dd8b27640 1 --2- 172.21.15.19:0/3075077900 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1dbc0a3350 0x7f1dbc0a5810 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.101+0000 7f1dd8b27640 1 --2- 172.21.15.19:0/3075077900 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1dd41012e0 0x7f1dd419abc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.101+0000 7f1dd8b27640 1 --2- 172.21.15.19:0/3075077900 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1dd410e4e0 0x7f1dd419ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.101+0000 7f1dd8b27640 1 --2- 172.21.15.19:0/3075077900 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1dd4100930 0x7f1dd419a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:11.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.101+0000 7f1dd8b27640 1 -- 172.21.15.19:0/3075077900 >> 172.21.15.19:0/3075077900 conn(0x7f1dd40fc7a0 msgr2=0x7f1dd40feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:11.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.101+0000 7f1dd8b27640 1 -- 172.21.15.19:0/3075077900 shutdown_connections 2024-09-19T08:53:11.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:11.101+0000 7f1dd8b27640 1 -- 172.21.15.19:0/3075077900 wait complete. 2024-09-19T08:53:11.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:10 smithi203 ceph-mon[35450]: pgmap v366: 97 pgs: 97 active+clean; 669 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-19T08:53:11.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:10 smithi203 ceph-mon[35450]: scrub summary: idle 2024-09-19T08:53:11.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:10 smithi019 ceph-mon[30976]: pgmap v366: 97 pgs: 97 active+clean; 669 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-19T08:53:11.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:10 smithi019 ceph-mon[30976]: scrub summary: idle 2024-09-19T08:53:11.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:10 smithi155 ceph-mon[34921]: pgmap v366: 97 pgs: 97 active+clean; 669 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-19T08:53:11.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:10 smithi155 ceph-mon[34921]: scrub summary: idle 2024-09-19T08:53:11.825 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '9b6cce55', total seconds elapsed: 15.4 2024-09-19T08:53:13.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:12 smithi203 ceph-mon[35450]: pgmap v367: 97 pgs: 97 active+clean; 669 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-19T08:53:13.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:12 smithi019 ceph-mon[30976]: pgmap v367: 97 pgs: 97 active+clean; 669 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-19T08:53:13.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:12 smithi155 ceph-mon[34921]: pgmap v367: 97 pgs: 97 active+clean; 669 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-19T08:53:15.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:14 smithi203 ceph-mon[35450]: pgmap v368: 97 pgs: 97 active+clean; 670 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-09-19T08:53:15.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:14 smithi019 ceph-mon[30976]: pgmap v368: 97 pgs: 97 active+clean; 670 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-09-19T08:53:15.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:14 smithi155 ceph-mon[34921]: pgmap v368: 97 pgs: 97 active+clean; 670 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.3 KiB/s wr, 13 op/s 2024-09-19T08:53:17.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:16 smithi203 ceph-mon[35450]: pgmap v369: 97 pgs: 97 active+clean; 670 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-19T08:53:17.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:16 smithi019 ceph-mon[30976]: pgmap v369: 97 pgs: 97 active+clean; 670 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-19T08:53:17.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:16 smithi155 ceph-mon[34921]: pgmap v369: 97 pgs: 97 active+clean; 670 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-19T08:53:19.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:18 smithi203 ceph-mon[35450]: pgmap v370: 97 pgs: 97 active+clean; 670 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-19T08:53:19.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:18 smithi019 ceph-mon[30976]: pgmap v370: 97 pgs: 97 active+clean; 670 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-19T08:53:19.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:18 smithi155 ceph-mon[34921]: pgmap v370: 97 pgs: 97 active+clean; 670 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 11 op/s 2024-09-19T08:53:21.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:20 smithi203 ceph-mon[35450]: pgmap v371: 97 pgs: 97 active+clean; 670 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 853 B/s wr, 13 op/s 2024-09-19T08:53:21.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:20 smithi019 ceph-mon[30976]: pgmap v371: 97 pgs: 97 active+clean; 670 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 853 B/s wr, 13 op/s 2024-09-19T08:53:21.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:20 smithi155 ceph-mon[34921]: pgmap v371: 97 pgs: 97 active+clean; 670 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 853 B/s wr, 13 op/s 2024-09-19T08:53:23.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:22 smithi203 ceph-mon[35450]: pgmap v372: 97 pgs: 97 active+clean; 670 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-19T08:53:23.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:22 smithi203 ceph-mon[35450]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-19T08:53:23.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:22 smithi019 ceph-mon[30976]: pgmap v372: 97 pgs: 97 active+clean; 670 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-19T08:53:23.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:22 smithi019 ceph-mon[30976]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-19T08:53:23.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:22 smithi155 ceph-mon[34921]: pgmap v372: 97 pgs: 97 active+clean; 670 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 853 B/s wr, 12 op/s 2024-09-19T08:53:23.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:22 smithi155 ceph-mon[34921]: mgrmap e20: x(active, since 10m), standbys: z, y 2024-09-19T08:53:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.430+0000 7f5d37482640 1 -- 172.21.15.19:0/2930879888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d30107880 msgr2=0x7f5d30109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.430+0000 7f5d37482640 1 --2- 172.21.15.19:0/2930879888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d30107880 0x7f5d30109c90 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5d28009ca0 tx=0x7f5d2802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.430+0000 7f5d37482640 1 -- 172.21.15.19:0/2930879888 shutdown_connections 2024-09-19T08:53:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.430+0000 7f5d37482640 1 --2- 172.21.15.19:0/2930879888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d30107880 0x7f5d30109c90 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.429 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.430+0000 7f5d37482640 1 --2- 172.21.15.19:0/2930879888 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d30104f50 0x7f5d30107340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.430 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.430+0000 7f5d37482640 1 --2- 172.21.15.19:0/2930879888 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d30102620 0x7f5d30104a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.430 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.430+0000 7f5d37482640 1 -- 172.21.15.19:0/2930879888 >> 172.21.15.19:0/2930879888 conn(0x7f5d300fc1e0 msgr2=0x7f5d300fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:23.430 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.430+0000 7f5d37482640 1 -- 172.21.15.19:0/2930879888 shutdown_connections 2024-09-19T08:53:23.430 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.430+0000 7f5d37482640 1 -- 172.21.15.19:0/2930879888 wait complete. 2024-09-19T08:53:23.432 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.431+0000 7f5d37482640 1 Processor -- start 2024-09-19T08:53:23.432 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.431+0000 7f5d37482640 1 -- start start 2024-09-19T08:53:23.432 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.431+0000 7f5d37482640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d30102620 0x7f5d30197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:23.432 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.431+0000 7f5d37482640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d30104f50 0x7f5d30198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:23.432 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.431+0000 7f5d37482640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d30107880 0x7f5d3019f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:23.432 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.431+0000 7f5d37482640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3010d800 con 0x7f5d30102620 2024-09-19T08:53:23.432 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.431+0000 7f5d37482640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3010d680 con 0x7f5d30107880 2024-09-19T08:53:23.432 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.431+0000 7f5d37482640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5d3010d980 con 0x7f5d30104f50 2024-09-19T08:53:23.432 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.431+0000 7f5d3521e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d30102620 0x7f5d30197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:23.432 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.431+0000 7f5d3521e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d30102620 0x7f5d30197e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39828/0 (socket says 172.21.15.19:39828) 2024-09-19T08:53:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.431+0000 7f5d3521e640 1 -- 172.21.15.19:0/3239926604 learned_addr learned my addr 172.21.15.19:0/3239926604 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.431+0000 7f5d34a1d640 1 --2- 172.21.15.19:0/3239926604 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d30104f50 0x7f5d30198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.431+0000 7f5d35a1f640 1 --2- 172.21.15.19:0/3239926604 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d30107880 0x7f5d3019f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.431+0000 7f5d3521e640 1 -- 172.21.15.19:0/3239926604 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d30104f50 msgr2=0x7f5d30198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.431+0000 7f5d3521e640 1 --2- 172.21.15.19:0/3239926604 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d30104f50 0x7f5d30198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.432+0000 7f5d3521e640 1 -- 172.21.15.19:0/3239926604 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d30107880 msgr2=0x7f5d3019f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.432+0000 7f5d3521e640 1 --2- 172.21.15.19:0/3239926604 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d30107880 0x7f5d3019f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.432+0000 7f5d3521e640 1 -- 172.21.15.19:0/3239926604 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d3019fa20 con 0x7f5d30102620 2024-09-19T08:53:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.432+0000 7f5d3521e640 1 --2- 172.21.15.19:0/3239926604 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d30102620 0x7f5d30197e00 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c00e9f0 tx=0x7f5d2c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.432+0000 7f5d267fc640 1 -- 172.21.15.19:0/3239926604 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c00cd80 con 0x7f5d30102620 2024-09-19T08:53:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.432+0000 7f5d267fc640 1 -- 172.21.15.19:0/3239926604 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d2c005500 con 0x7f5d30102620 2024-09-19T08:53:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.432+0000 7f5d267fc640 1 -- 172.21.15.19:0/3239926604 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c010690 con 0x7f5d30102620 2024-09-19T08:53:23.433 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.432+0000 7f5d37482640 1 -- 172.21.15.19:0/3239926604 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d3019fd10 con 0x7f5d30102620 2024-09-19T08:53:23.434 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.432+0000 7f5d37482640 1 -- 172.21.15.19:0/3239926604 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d301a01b0 con 0x7f5d30102620 2024-09-19T08:53:23.435 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.436+0000 7f5d267fc640 1 -- 172.21.15.19:0/3239926604 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f5d2c0046c0 con 0x7f5d30102620 2024-09-19T08:53:23.435 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.436+0000 7f5d3a222740 1 Processor -- start 2024-09-19T08:53:23.437 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.436+0000 7f5d3a222740 1 -- start start 2024-09-19T08:53:23.437 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.436+0000 7f5d3a222740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f44999b920 0x55f44999bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:23.437 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.436+0000 7f5d3a222740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f44999c260 0x55f44999ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:23.437 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.436+0000 7f5d3a222740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f44999f330 0x55f4499ac2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:23.437 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.436+0000 7f5d3a222740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f4498ff2f0 con 0x55f44999b920 2024-09-19T08:53:23.437 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.436+0000 7f5d3a222740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f4498a7270 con 0x55f44999f330 2024-09-19T08:53:23.437 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.437+0000 7f5d3a222740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f4498fb2b0 con 0x55f44999c260 2024-09-19T08:53:23.437 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.436+0000 7f5d35a1f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f44999b920 0x55f44999bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:23.437 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.437+0000 7f5d35a1f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f44999b920 0x55f44999bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39842/0 (socket says 172.21.15.19:39842) 2024-09-19T08:53:23.437 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.437+0000 7f5d35a1f640 1 -- 172.21.15.19:0/2913953294 learned_addr learned my addr 172.21.15.19:0/2913953294 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:23.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.437+0000 7f5d34a1d640 1 --2- 172.21.15.19:0/2913953294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f44999f330 0x55f4499ac2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:23.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.437+0000 7f5d34a1d640 1 -- 172.21.15.19:0/2913953294 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f44999c260 msgr2=0x55f44999ed10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T08:53:23.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.437+0000 7f5d34a1d640 1 --2- 172.21.15.19:0/2913953294 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f44999c260 0x55f44999ed10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.437+0000 7f5d34a1d640 1 -- 172.21.15.19:0/2913953294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f44999b920 msgr2=0x55f44999bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:23.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.437+0000 7f5d34a1d640 1 --2- 172.21.15.19:0/2913953294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f44999b920 0x55f44999bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.437+0000 7f5d34a1d640 1 -- 172.21.15.19:0/2913953294 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4498a6340 con 0x55f44999f330 2024-09-19T08:53:23.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.437+0000 7f5d35a1f640 1 --2- 172.21.15.19:0/2913953294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f44999b920 0x55f44999bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:53:23.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.437+0000 7f5d267fc640 1 --2- 172.21.15.19:0/3239926604 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5d1c0a3460 0x7f5d1c0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:23.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.437+0000 7f5d34a1d640 1 --2- 172.21.15.19:0/2913953294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f44999f330 0x55f4499ac2e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5d20005d00 tx=0x7f5d200107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68a9cde5a573a871 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:23.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.437+0000 7f5d35a1f640 1 --2- 172.21.15.19:0/3239926604 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5d1c0a3460 0x7f5d1c0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:23.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.437+0000 7f5d1b7fe640 1 -- 172.21.15.19:0/2913953294 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d20004020 con 0x55f44999f330 2024-09-19T08:53:23.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.437+0000 7f5d267fc640 1 -- 172.21.15.19:0/3239926604 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5d2c0cfc00 con 0x7f5d30102620 2024-09-19T08:53:23.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.438+0000 7f5d1b7fe640 1 -- 172.21.15.19:0/2913953294 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d200041c0 con 0x55f44999f330 2024-09-19T08:53:23.439 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.438+0000 7f5d1b7fe640 1 -- 172.21.15.19:0/2913953294 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d20011730 con 0x55f44999f330 2024-09-19T08:53:23.442 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.438+0000 7f5d3a222740 1 -- 172.21.15.19:0/2913953294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f44999f330 msgr2=0x55f4499ac2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:23.442 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.438+0000 7f5d35a1f640 1 --2- 172.21.15.19:0/3239926604 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5d1c0a3460 0x7f5d1c0a5920 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5d28005e30 tx=0x7f5d2803d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:23.442 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.438+0000 7f5d3a222740 1 --2- 172.21.15.19:0/2913953294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f44999f330 0x55f4499ac2e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5d20005d00 tx=0x7f5d200107a0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.442 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.439+0000 7f5d3a222740 1 -- 172.21.15.19:0/2913953294 shutdown_connections 2024-09-19T08:53:23.442 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.439+0000 7f5d3a222740 1 --2- 172.21.15.19:0/2913953294 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f44999c260 0x55f44999ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.442 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.439+0000 7f5d3a222740 1 --2- 172.21.15.19:0/2913953294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f44999f330 0x55f4499ac2e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.442 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.439+0000 7f5d3a222740 1 --2- 172.21.15.19:0/2913953294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f44999b920 0x55f44999bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.442 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.439+0000 7f5d3a222740 1 -- 172.21.15.19:0/2913953294 >> 172.21.15.19:0/2913953294 conn(0x55f449997010 msgr2=0x55f449997410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:23.442 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.439+0000 7f5d3a222740 1 -- 172.21.15.19:0/2913953294 shutdown_connections 2024-09-19T08:53:23.442 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.439+0000 7f5d3a222740 1 -- 172.21.15.19:0/2913953294 wait complete. 2024-09-19T08:53:23.442 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.439+0000 7f5d3a222740 1 -- start start 2024-09-19T08:53:23.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.439+0000 7f5d3a222740 1 Processor -- start 2024-09-19T08:53:23.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.440+0000 7f5d3a222740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f44999b920 0x55f4499a5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:23.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.440+0000 7f5d3a222740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f44999c260 0x55f4499a6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:23.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.440+0000 7f5d3a222740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f44999f330 0x55f4499ab250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:23.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.440+0000 7f5d3a222740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f44999fe30 con 0x55f44999b920 2024-09-19T08:53:23.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.440+0000 7f5d3a222740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f449888290 con 0x55f44999c260 2024-09-19T08:53:23.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.440+0000 7f5d3a222740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f44999ffb0 con 0x55f44999f330 2024-09-19T08:53:23.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.440+0000 7f5d3a222740 10 client.0 _ll_register_callbacks cb 0x55f4498b9140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:23.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.440+0000 7f5d3521e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f44999b920 0x55f4499a5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:23.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.440+0000 7f5d3521e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f44999b920 0x55f4499a5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39854/0 (socket says 172.21.15.19:39854) 2024-09-19T08:53:23.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.440+0000 7f5d3521e640 1 -- 172.21.15.19:0/515543291 learned_addr learned my addr 172.21.15.19:0/515543291 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:23.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.440+0000 7f5d35a1f640 1 --2- 172.21.15.19:0/515543291 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f44999f330 0x55f4499ab250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:23.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.440+0000 7f5d34a1d640 1 --2- 172.21.15.19:0/515543291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f44999c260 0x55f4499a6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:23.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.440+0000 7f5d3521e640 1 -- 172.21.15.19:0/515543291 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f44999f330 msgr2=0x55f4499ab250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:23.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.440+0000 7f5d3521e640 1 --2- 172.21.15.19:0/515543291 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f44999f330 0x55f4499ab250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.440+0000 7f5d3521e640 1 -- 172.21.15.19:0/515543291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f44999c260 msgr2=0x55f4499a6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:23.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.440+0000 7f5d3521e640 1 --2- 172.21.15.19:0/515543291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f44999c260 0x55f4499a6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.441+0000 7f5d3521e640 1 -- 172.21.15.19:0/515543291 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f449612210 con 0x55f44999b920 2024-09-19T08:53:23.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.441+0000 7f5d35a1f640 1 --2- 172.21.15.19:0/515543291 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f44999f330 0x55f4499ab250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:53:23.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.441+0000 7f5d34a1d640 1 --2- 172.21.15.19:0/515543291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f44999c260 0x55f4499a6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:53:23.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.441+0000 7f5d3521e640 1 --2- 172.21.15.19:0/515543291 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f44999b920 0x55f4499a5ce0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c00e9c0 tx=0x7f5d2c09bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acbec4a58dc846b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:23.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.441+0000 7f5d18ff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:53:23.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.441+0000 7f5d18ff9640 1 -- 172.21.15.19:0/515543291 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c0a03b0 con 0x55f44999b920 2024-09-19T08:53:23.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.441+0000 7f5d3a222740 1 -- 172.21.15.19:0/515543291 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d200041c0 con 0x55f44999b920 2024-09-19T08:53:23.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.441+0000 7f5d18ff9640 1 -- 172.21.15.19:0/515543291 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5d2c0bc0f0 con 0x55f44999b920 2024-09-19T08:53:23.445 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.441+0000 7f5d18ff9640 1 -- 172.21.15.19:0/515543291 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5d2c0b5200 con 0x55f44999b920 2024-09-19T08:53:23.445 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.441+0000 7f5d3a222740 10 client.15735 fetch_fsmap learned FSMap version 28 2024-09-19T08:53:23.445 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.441+0000 7f5d3a222740 1 -- 172.21.15.19:0/515543291 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f4496de620 con 0x55f44999b920 2024-09-19T08:53:23.445 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.442+0000 7f5d18ff9640 1 -- 172.21.15.19:0/515543291 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d200041c0 con 0x55f44999b920 2024-09-19T08:53:23.445 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.442+0000 7f5d18ff9640 1 -- 172.21.15.19:0/515543291 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5d2c0a4a10 con 0x55f44999b920 2024-09-19T08:53:23.445 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.442+0000 7f5d3a222740 10 client.15735 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:53:23.445 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.442+0000 7f5d3a222740 10 client.15735 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:53:23.445 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.442+0000 7f5d3a222740 20 client.15735 populate_metadata read hostname 'smithi019' 2024-09-19T08:53:23.445 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.442+0000 7f5d3a222740 1 --2- 172.21.15.19:0/515543291 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55f4499c2e50 0x55f4499c5280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:23.446 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.442+0000 7f5d3a222740 4 client.15735 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:53:23.446 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.442+0000 7f5d3a222740 1 -- 172.21.15.19:0/515543291 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f44990ca20 con 0x55f4499c2e50 2024-09-19T08:53:23.446 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.443+0000 7f5d34a1d640 1 --2- 172.21.15.19:0/515543291 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55f4499c2e50 0x55f4499c5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:23.447 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.443+0000 7f5d18ff9640 10 client.15735 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:23.447 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.443+0000 7f5d34a1d640 1 --2- 172.21.15.19:0/515543291 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55f4499c2e50 0x55f4499c5280 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=285b2d2452752519 server_cookie=3ff90d036fa7526e in_seq=0 out_seq=0 2024-09-19T08:53:23.447 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.444+0000 7f5d18ff9640 1 -- 172.21.15.19:0/515543291 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f44990ca20 con 0x55f4499c2e50 2024-09-19T08:53:23.447 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.444+0000 7f5d18ff9640 10 client.15735 handle_command_reply: tid=0 2024-09-19T08:53:23.447 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.444+0000 7f5d3a222740 1 client.15735 shutdown 2024-09-19T08:53:23.447 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.444+0000 7f5d3a222740 1 -- 172.21.15.19:0/515543291 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f44999b920 msgr2=0x55f4499a5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:23.447 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.444+0000 7f5d3a222740 1 --2- 172.21.15.19:0/515543291 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f44999b920 0x55f4499a5ce0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c00e9c0 tx=0x7f5d2c09bc50 comp rx=0 tx=0).stop 2024-09-19T08:53:23.447 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.444+0000 7f5d3a222740 1 -- 172.21.15.19:0/515543291 shutdown_connections 2024-09-19T08:53:23.448 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.444+0000 7f5d3a222740 1 --2- 172.21.15.19:0/515543291 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55f4499c2e50 0x55f4499c5280 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.448 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.444+0000 7f5d3a222740 1 --2- 172.21.15.19:0/515543291 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f44999f330 0x55f4499ab250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.448 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.444+0000 7f5d3a222740 1 --2- 172.21.15.19:0/515543291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f44999c260 0x55f4499a6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.448 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.444+0000 7f5d3a222740 1 --2- 172.21.15.19:0/515543291 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f44999b920 0x55f4499a5ce0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.448 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.444+0000 7f5d3a222740 1 -- 172.21.15.19:0/515543291 >> 172.21.15.19:0/515543291 conn(0x55f449997010 msgr2=0x55f449998820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:23.448 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.444+0000 7f5d18ff9640 0 client.15735 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:23.448 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.444+0000 7f5d3a222740 1 -- 172.21.15.19:0/515543291 shutdown_connections 2024-09-19T08:53:23.448 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.444+0000 7f5d3a222740 1 -- 172.21.15.19:0/515543291 wait complete. 2024-09-19T08:53:23.448 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.444+0000 7f5d3a222740 20 client.15735 trim_cache size 0 max 16384 2024-09-19T08:53:23.459 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.459+0000 7f5d3a222740 1 Processor -- start 2024-09-19T08:53:23.459 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.459+0000 7f5d3a222740 1 -- start start 2024-09-19T08:53:23.459 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.459+0000 7f5d3a222740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f44999c260 0x55f44999bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:23.459 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.459+0000 7f5d3a222740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f44999f330 0x55f4499a5a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:23.459 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.459+0000 7f5d3a222740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f449997a60 0x55f4499a5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:23.459 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.459+0000 7f5d3a222740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5d301a6de0 con 0x55f449997a60 2024-09-19T08:53:23.459 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.459+0000 7f5d3a222740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5d301a8920 con 0x55f44999f330 2024-09-19T08:53:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.459+0000 7f5d3a222740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5d301a74b0 con 0x55f44999c260 2024-09-19T08:53:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.459+0000 7f5d35a1f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f449997a60 0x55f4499a5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.459+0000 7f5d35a1f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f449997a60 0x55f4499a5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39856/0 (socket says 172.21.15.19:39856) 2024-09-19T08:53:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.459+0000 7f5d35a1f640 1 -- 172.21.15.19:0/4226056353 learned_addr learned my addr 172.21.15.19:0/4226056353 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.459+0000 7f5d3521e640 1 --2- 172.21.15.19:0/4226056353 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f44999c260 0x55f44999bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.459+0000 7f5d34a1d640 1 --2- 172.21.15.19:0/4226056353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f44999f330 0x55f4499a5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.460+0000 7f5d3521e640 1 -- 172.21.15.19:0/4226056353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f44999f330 msgr2=0x55f4499a5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.460+0000 7f5d3521e640 1 --2- 172.21.15.19:0/4226056353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f44999f330 0x55f4499a5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.460+0000 7f5d3521e640 1 -- 172.21.15.19:0/4226056353 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f449997a60 msgr2=0x55f4499a5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:23.461 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.460+0000 7f5d3521e640 1 --2- 172.21.15.19:0/4226056353 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f449997a60 0x55f4499a5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.461 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.460+0000 7f5d3521e640 1 -- 172.21.15.19:0/4226056353 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f4499a5820 con 0x55f44999c260 2024-09-19T08:53:23.461 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.460+0000 7f5d35a1f640 1 --2- 172.21.15.19:0/4226056353 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f449997a60 0x55f4499a5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:53:23.461 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.460+0000 7f5d3521e640 1 --2- 172.21.15.19:0/4226056353 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f44999c260 0x55f44999bd00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c098c00 tx=0x7f5d2c09c3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b44df6a003bff063 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:23.464 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.460+0000 7f5d1affd640 1 -- 172.21.15.19:0/4226056353 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c09b970 con 0x55f44999c260 2024-09-19T08:53:23.464 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.460+0000 7f5d1affd640 1 -- 172.21.15.19:0/4226056353 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d2c0a4ea0 con 0x55f44999c260 2024-09-19T08:53:23.464 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.460+0000 7f5d1affd640 1 -- 172.21.15.19:0/4226056353 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c09b230 con 0x55f44999c260 2024-09-19T08:53:23.464 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.461+0000 7f5d3a222740 1 -- 172.21.15.19:0/4226056353 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f44999c260 msgr2=0x55f44999bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:23.464 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.461+0000 7f5d3a222740 1 --2- 172.21.15.19:0/4226056353 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f44999c260 0x55f44999bd00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c098c00 tx=0x7f5d2c09c3b0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.464 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.461+0000 7f5d3a222740 1 -- 172.21.15.19:0/4226056353 shutdown_connections 2024-09-19T08:53:23.464 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.461+0000 7f5d3a222740 1 --2- 172.21.15.19:0/4226056353 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f449997a60 0x55f4499a5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.464 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.461+0000 7f5d3a222740 1 --2- 172.21.15.19:0/4226056353 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f44999f330 0x55f4499a5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.465 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.461+0000 7f5d3a222740 1 --2- 172.21.15.19:0/4226056353 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f44999c260 0x55f44999bd00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.465 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.461+0000 7f5d3a222740 1 -- 172.21.15.19:0/4226056353 >> 172.21.15.19:0/4226056353 conn(0x55f449997010 msgr2=0x55f4499a4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:23.465 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.461+0000 7f5d3a222740 1 -- 172.21.15.19:0/4226056353 shutdown_connections 2024-09-19T08:53:23.465 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.461+0000 7f5d3a222740 1 -- 172.21.15.19:0/4226056353 wait complete. 2024-09-19T08:53:23.465 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.462+0000 7f5d3a222740 1 -- start start 2024-09-19T08:53:23.465 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.462+0000 7f5d3a222740 1 Processor -- start 2024-09-19T08:53:23.465 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.462+0000 7f5d3a222740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f449997a60 0x55f4499d7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:23.465 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.462+0000 7f5d3a222740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f44999c260 0x55f4499d3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:23.465 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.462+0000 7f5d3a222740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f44999f330 0x55f4499d4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:23.465 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.462+0000 7f5d3a222740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5d301a8250 con 0x55f449997a60 2024-09-19T08:53:23.465 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.462+0000 7f5d3a222740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5d301a7b80 con 0x55f44999f330 2024-09-19T08:53:23.465 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.462+0000 7f5d3a222740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5d301a4dc0 con 0x55f44999c260 2024-09-19T08:53:23.465 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.462+0000 7f5d3521e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f449997a60 0x55f4499d7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:23.466 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.462+0000 7f5d3a222740 10 client.0 _ll_register_callbacks cb 0x7f5d2c009720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:23.466 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.462+0000 7f5d3521e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f449997a60 0x55f4499d7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:39866/0 (socket says 172.21.15.19:39866) 2024-09-19T08:53:23.466 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.462+0000 7f5d3521e640 1 -- 172.21.15.19:0/430593644 learned_addr learned my addr 172.21.15.19:0/430593644 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:23.466 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.462+0000 7f5d35a1f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f44999f330 0x55f4499d4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:23.466 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.462+0000 7f5d34a1d640 1 --2- 172.21.15.19:0/430593644 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f44999c260 0x55f4499d3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:23.466 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.463+0000 7f5d3521e640 1 -- 172.21.15.19:0/430593644 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f44999c260 msgr2=0x55f4499d3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:23.466 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.463+0000 7f5d3521e640 1 --2- 172.21.15.19:0/430593644 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f44999c260 0x55f4499d3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.466 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.463+0000 7f5d3521e640 1 -- 172.21.15.19:0/430593644 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f44999f330 msgr2=0x55f4499d4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:23.466 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.463+0000 7f5d3521e640 1 --2- 172.21.15.19:0/430593644 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f44999f330 0x55f4499d4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.466 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.463+0000 7f5d3521e640 1 -- 172.21.15.19:0/430593644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f449a2b9d0 con 0x55f449997a60 2024-09-19T08:53:23.466 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.463+0000 7f5d3521e640 1 --2- 172.21.15.19:0/430593644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f449997a60 0x55f4499d7030 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c09c1c0 tx=0x7f5d2c09bcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0430de32380e4ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:23.466 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.463+0000 7f5d18ff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:53:23.466 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.463+0000 7f5d18ff9640 1 -- 172.21.15.19:0/430593644 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2c09bd70 con 0x55f449997a60 2024-09-19T08:53:23.467 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.463+0000 7f5d18ff9640 1 -- 172.21.15.19:0/430593644 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5d2c0cdbd0 con 0x55f449997a60 2024-09-19T08:53:23.467 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.463+0000 7f5d3a222740 1 -- 172.21.15.19:0/430593644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d2c0a4ea0 con 0x55f449997a60 2024-09-19T08:53:23.467 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.463+0000 7f5d18ff9640 1 -- 172.21.15.19:0/430593644 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5d2c0a05e0 con 0x55f449997a60 2024-09-19T08:53:23.467 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.463+0000 7f5d3a222740 10 client.15741 fetch_fsmap learned FSMap version 28 2024-09-19T08:53:23.467 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.463+0000 7f5d3a222740 1 -- 172.21.15.19:0/430593644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f449a2cbf0 con 0x55f449997a60 2024-09-19T08:53:23.467 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.464+0000 7f5d18ff9640 1 -- 172.21.15.19:0/430593644 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5d2c09b920 con 0x55f449997a60 2024-09-19T08:53:23.467 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.464+0000 7f5d18ff9640 1 -- 172.21.15.19:0/430593644 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 28) ==== 8362+0+0 (secure 0 0 0) 0x7f5d2c0b00e0 con 0x55f449997a60 2024-09-19T08:53:23.467 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.464+0000 7f5d3a222740 10 client.15741 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T08:53:23.467 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.464+0000 7f5d3a222740 10 client.15741 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:53:23.467 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.464+0000 7f5d3a222740 20 client.15741 populate_metadata read hostname 'smithi019' 2024-09-19T08:53:23.467 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.464+0000 7f5d3a222740 1 --2- 172.21.15.19:0/430593644 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55f449a2d350 0x55f449a2f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:23.467 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.464+0000 7f5d3a222740 4 client.15741 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:53:23.467 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.464+0000 7f5d3a222740 1 -- 172.21.15.19:0/430593644 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f5d2c0a4ea0 con 0x55f449a2d350 2024-09-19T08:53:23.467 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.464+0000 7f5d34a1d640 1 --2- 172.21.15.19:0/430593644 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55f449a2d350 0x55f449a2f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:23.467 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.464+0000 7f5d18ff9640 10 client.15741 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:23.468 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.465+0000 7f5d34a1d640 1 --2- 172.21.15.19:0/430593644 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55f449a2d350 0x55f449a2f740 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e98cd0509167bb9 server_cookie=7d6925040e57c9b0 in_seq=0 out_seq=0 2024-09-19T08:53:23.470 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.470+0000 7f5d18ff9640 1 -- 172.21.15.19:0/430593644 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f5d2c0a4ea0 con 0x55f449a2d350 2024-09-19T08:53:23.470 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.470+0000 7f5d18ff9640 10 client.15741 handle_command_reply: tid=0 2024-09-19T08:53:23.470 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.470+0000 7f5d3a222740 1 client.15741 shutdown 2024-09-19T08:53:23.470 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.470+0000 7f5d3a222740 1 -- 172.21.15.19:0/430593644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f449997a60 msgr2=0x55f4499d7030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:23.470 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.470+0000 7f5d3a222740 1 --2- 172.21.15.19:0/430593644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f449997a60 0x55f4499d7030 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c09c1c0 tx=0x7f5d2c09bcc0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.470 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.470+0000 7f5d3a222740 1 -- 172.21.15.19:0/430593644 shutdown_connections 2024-09-19T08:53:23.471 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.470+0000 7f5d3a222740 1 --2- 172.21.15.19:0/430593644 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55f449a2d350 0x55f449a2f740 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.471 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.470+0000 7f5d18ff9640 0 client.15741 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:23.471 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.470+0000 7f5d3a222740 1 --2- 172.21.15.19:0/430593644 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f44999c260 0x55f4499d3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.471 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.470+0000 7f5d3a222740 1 --2- 172.21.15.19:0/430593644 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f44999f330 0x55f4499d4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.471 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.470+0000 7f5d3a222740 1 --2- 172.21.15.19:0/430593644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f449997a60 0x55f4499d7030 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.471 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.470+0000 7f5d3a222740 1 -- 172.21.15.19:0/430593644 >> 172.21.15.19:0/430593644 conn(0x55f449997010 msgr2=0x55f4499a5a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:23.471 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.470+0000 7f5d3a222740 1 -- 172.21.15.19:0/430593644 shutdown_connections 2024-09-19T08:53:23.471 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.470+0000 7f5d3a222740 1 -- 172.21.15.19:0/430593644 wait complete. 2024-09-19T08:53:23.471 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.470+0000 7f5d3a222740 20 client.15741 trim_cache size 0 max 16384 2024-09-19T08:53:23.472 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T08:53:23.472 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T08:53:23.472 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T08:53:23.472 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T08:53:23.473 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.471+0000 7f5d37482640 1 -- 172.21.15.19:0/3239926604 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5d1c0a3460 msgr2=0x7f5d1c0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:23.473 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.471+0000 7f5d37482640 1 --2- 172.21.15.19:0/3239926604 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5d1c0a3460 0x7f5d1c0a5920 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f5d28005e30 tx=0x7f5d2803d040 comp rx=0 tx=0).stop 2024-09-19T08:53:23.473 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.471+0000 7f5d37482640 1 -- 172.21.15.19:0/3239926604 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d30102620 msgr2=0x7f5d30197e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:23.473 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.471+0000 7f5d37482640 1 --2- 172.21.15.19:0/3239926604 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d30102620 0x7f5d30197e00 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f5d2c00e9f0 tx=0x7f5d2c00edf0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.473 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.471+0000 7f5d37482640 1 -- 172.21.15.19:0/3239926604 shutdown_connections 2024-09-19T08:53:23.473 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.471+0000 7f5d37482640 1 --2- 172.21.15.19:0/3239926604 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5d1c0a3460 0x7f5d1c0a5920 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.473 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.471+0000 7f5d37482640 1 --2- 172.21.15.19:0/3239926604 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d30104f50 0x7f5d30198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.473 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.471+0000 7f5d37482640 1 --2- 172.21.15.19:0/3239926604 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5d30107880 0x7f5d3019f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.473 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.471+0000 7f5d37482640 1 --2- 172.21.15.19:0/3239926604 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5d30102620 0x7f5d30197e00 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:23.473 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.471+0000 7f5d37482640 1 -- 172.21.15.19:0/3239926604 >> 172.21.15.19:0/3239926604 conn(0x7f5d300fc1e0 msgr2=0x7f5d30102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:23.473 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.471+0000 7f5d37482640 1 -- 172.21.15.19:0/3239926604 shutdown_connections 2024-09-19T08:53:23.474 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:23.472+0000 7f5d37482640 1 -- 172.21.15.19:0/3239926604 wait complete. 2024-09-19T08:53:25.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:24 smithi019 ceph-mon[30976]: pgmap v373: 97 pgs: 97 active+clean; 671 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-09-19T08:53:25.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:24 smithi155 ceph-mon[34921]: pgmap v373: 97 pgs: 97 active+clean; 671 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-09-19T08:53:25.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:24 smithi203 ceph-mon[35450]: pgmap v373: 97 pgs: 97 active+clean; 671 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.4 KiB/s wr, 13 op/s 2024-09-19T08:53:26.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:25 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:53:26.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:25 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:53:26.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:25 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:53:27.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:27 smithi019 ceph-mon[30976]: pgmap v374: 97 pgs: 97 active+clean; 671 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-19T08:53:27.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:27 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:53:27.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:27 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:53:27.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:27 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:27.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:27 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:53:27.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:27 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:53:27.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:27 smithi155 ceph-mon[34921]: pgmap v374: 97 pgs: 97 active+clean; 671 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-19T08:53:27.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:27 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:53:27.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:27 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:53:27.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:27 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:27.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:27 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:53:27.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:27 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:53:27.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:27 smithi203 ceph-mon[35450]: pgmap v374: 97 pgs: 97 active+clean; 671 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-19T08:53:27.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:27 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:53:27.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:27 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:53:27.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:27 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:53:27.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:27 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:53:27.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:27 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:53:29.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:29 smithi155 ceph-mon[34921]: pgmap v375: 97 pgs: 97 active+clean; 671 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1023 B/s wr, 10 op/s 2024-09-19T08:53:29.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:29 smithi203 ceph-mon[35450]: pgmap v375: 97 pgs: 97 active+clean; 671 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1023 B/s wr, 10 op/s 2024-09-19T08:53:29.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:29 smithi019 ceph-mon[30976]: pgmap v375: 97 pgs: 97 active+clean; 671 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1023 B/s wr, 10 op/s 2024-09-19T08:53:31.666 INFO:tasks.workunit.client.0.smithi019.stderr:Updating files: 94% (12239/12896) Updating files: 95% (12252/12896) Updating files: 96% (12381/12896) Updating files: 97% (12510/12896) Updating files: 98% (12639/12896) Updating files: 99% (12768/12896) Updating files: 100% (12896/12896) Updating files: 100% (12896/12896), done. 2024-09-19T08:53:31.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:31 smithi155 ceph-mon[34921]: pgmap v376: 97 pgs: 97 active+clean; 671 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-19T08:53:31.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:31 smithi203 ceph-mon[35450]: pgmap v376: 97 pgs: 97 active+clean; 671 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-19T08:53:31.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:31 smithi019 ceph-mon[30976]: pgmap v376: 97 pgs: 97 active+clean; 671 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-19T08:53:32.520 INFO:tasks.workunit.client.0.smithi019.stderr:Note: switching to '6fad5dd73c93545e52f57f681e140a9c3529c11e'. 2024-09-19T08:53:32.527 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-19T08:53:32.527 INFO:tasks.workunit.client.0.smithi019.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T08:53:32.528 INFO:tasks.workunit.client.0.smithi019.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T08:53:32.528 INFO:tasks.workunit.client.0.smithi019.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T08:53:32.528 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-19T08:53:32.528 INFO:tasks.workunit.client.0.smithi019.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T08:53:32.528 INFO:tasks.workunit.client.0.smithi019.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T08:53:32.528 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-19T08:53:32.528 INFO:tasks.workunit.client.0.smithi019.stderr: git switch -c 2024-09-19T08:53:32.528 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-19T08:53:32.528 INFO:tasks.workunit.client.0.smithi019.stderr:Or undo this operation with: 2024-09-19T08:53:32.528 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-19T08:53:32.528 INFO:tasks.workunit.client.0.smithi019.stderr: git switch - 2024-09-19T08:53:32.528 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-19T08:53:32.529 INFO:tasks.workunit.client.0.smithi019.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T08:53:32.529 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-19T08:53:32.529 INFO:tasks.workunit.client.0.smithi019.stderr:HEAD is now at 6fad5dd73c9 Merge pull request #59812 from neha-ojha/wip-rtd-squid 2024-09-19T08:53:32.537 DEBUG:teuthology.orchestra.run.smithi019:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T08:53:32.626 INFO:tasks.quiescer.fs.[cephfs]:Total duration (40.7) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T08:53:32.626 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-09-19T08:53:32.627 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:53:32.636 INFO:tasks.workunit.client.0.smithi019.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T08:53:32.645 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T08:53:32.645 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T08:53:32.904 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:33.574 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:33 smithi019 ceph-mon[30976]: pgmap v377: 97 pgs: 97 active+clean; 671 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-19T08:53:33.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.574+0000 7fdfbfcf2640 1 -- 172.21.15.19:0/1849897181 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfb810e4d0 msgr2=0x7fdfb81108e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:33.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.574+0000 7fdfbfcf2640 1 --2- 172.21.15.19:0/1849897181 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfb810e4d0 0x7fdfb81108e0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0009ca0 tx=0x7fdfb002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:53:33.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.574+0000 7fdfbfcf2640 1 -- 172.21.15.19:0/1849897181 shutdown_connections 2024-09-19T08:53:33.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.574+0000 7fdfbfcf2640 1 --2- 172.21.15.19:0/1849897181 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdfb8101360 0x7fdfb810df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:33.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.574+0000 7fdfbfcf2640 1 --2- 172.21.15.19:0/1849897181 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfb810e4d0 0x7fdfb81108e0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:33.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.574+0000 7fdfbfcf2640 1 --2- 172.21.15.19:0/1849897181 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfb81009b0 0x7fdfb8100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:33.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.574+0000 7fdfbfcf2640 1 -- 172.21.15.19:0/1849897181 >> 172.21.15.19:0/1849897181 conn(0x7fdfb80fc7d0 msgr2=0x7fdfb80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:33.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.574+0000 7fdfbfcf2640 1 -- 172.21.15.19:0/1849897181 shutdown_connections 2024-09-19T08:53:33.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.574+0000 7fdfbfcf2640 1 -- 172.21.15.19:0/1849897181 wait complete. 2024-09-19T08:53:33.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.575+0000 7fdfbfcf2640 1 Processor -- start 2024-09-19T08:53:33.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.575+0000 7fdfbfcf2640 1 -- start start 2024-09-19T08:53:33.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.575+0000 7fdfbfcf2640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdfb81009b0 0x7fdfb810ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:33.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.575+0000 7fdfbfcf2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfb8101360 0x7fdfb810aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:33.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.575+0000 7fdfbfcf2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfb810e4d0 0x7fdfb810b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:33.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.576+0000 7fdfbfcf2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb81142d0 con 0x7fdfb810e4d0 2024-09-19T08:53:33.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.576+0000 7fdfbfcf2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb8114150 con 0x7fdfb8101360 2024-09-19T08:53:33.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.576+0000 7fdfbfcf2640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb8114450 con 0x7fdfb81009b0 2024-09-19T08:53:33.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.576+0000 7fdfbe28f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfb810e4d0 0x7fdfb810b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:33.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.576+0000 7fdfbe28f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfb810e4d0 0x7fdfb810b430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49056/0 (socket says 172.21.15.19:49056) 2024-09-19T08:53:33.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.576+0000 7fdfbe28f640 1 -- 172.21.15.19:0/4077457681 learned_addr learned my addr 172.21.15.19:0/4077457681 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:33.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.576+0000 7fdfbd28d640 1 --2- 172.21.15.19:0/4077457681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfb8101360 0x7fdfb810aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:33.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.576+0000 7fdfbda8e640 1 --2- 172.21.15.19:0/4077457681 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdfb81009b0 0x7fdfb810ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:33.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.576+0000 7fdfbe28f640 1 -- 172.21.15.19:0/4077457681 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdfb81009b0 msgr2=0x7fdfb810ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:33.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.576+0000 7fdfbe28f640 1 --2- 172.21.15.19:0/4077457681 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdfb81009b0 0x7fdfb810ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:33.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.576+0000 7fdfbe28f640 1 -- 172.21.15.19:0/4077457681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfb8101360 msgr2=0x7fdfb810aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:33.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.576+0000 7fdfbe28f640 1 --2- 172.21.15.19:0/4077457681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfb8101360 0x7fdfb810aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:33.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.576+0000 7fdfbe28f640 1 -- 172.21.15.19:0/4077457681 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb810bcc0 con 0x7fdfb810e4d0 2024-09-19T08:53:33.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.576+0000 7fdfbda8e640 1 --2- 172.21.15.19:0/4077457681 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdfb81009b0 0x7fdfb810ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:53:33.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.576+0000 7fdfbd28d640 1 --2- 172.21.15.19:0/4077457681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfb8101360 0x7fdfb810aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:53:33.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.576+0000 7fdfbe28f640 1 --2- 172.21.15.19:0/4077457681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfb810e4d0 0x7fdfb810b430 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0003f40 tx=0x7fdfb0003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:33.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.576+0000 7fdfaeffd640 1 -- 172.21.15.19:0/4077457681 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb00318c0 con 0x7fdfb810e4d0 2024-09-19T08:53:33.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.576+0000 7fdfaeffd640 1 -- 172.21.15.19:0/4077457681 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfb0004520 con 0x7fdfb810e4d0 2024-09-19T08:53:33.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.576+0000 7fdfbfcf2640 1 -- 172.21.15.19:0/4077457681 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfb81ab0d0 con 0x7fdfb810e4d0 2024-09-19T08:53:33.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.576+0000 7fdfaeffd640 1 -- 172.21.15.19:0/4077457681 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb002fe10 con 0x7fdfb810e4d0 2024-09-19T08:53:33.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.576+0000 7fdfbfcf2640 1 -- 172.21.15.19:0/4077457681 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfb81ab610 con 0x7fdfb810e4d0 2024-09-19T08:53:33.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.577+0000 7fdfbfcf2640 1 -- 172.21.15.19:0/4077457681 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfb806a7f0 con 0x7fdfb810e4d0 2024-09-19T08:53:33.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.579+0000 7fdfaeffd640 1 -- 172.21.15.19:0/4077457681 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fdfb00046d0 con 0x7fdfb810e4d0 2024-09-19T08:53:33.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.580+0000 7fdfaeffd640 1 --2- 172.21.15.19:0/4077457681 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fdfa40a3240 0x7fdfa40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:33.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.580+0000 7fdfaeffd640 1 -- 172.21.15.19:0/4077457681 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fdfb00f11e0 con 0x7fdfb810e4d0 2024-09-19T08:53:33.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.580+0000 7fdfbda8e640 1 --2- 172.21.15.19:0/4077457681 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fdfa40a3240 0x7fdfa40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:33.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.581+0000 7fdfbda8e640 1 --2- 172.21.15.19:0/4077457681 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fdfa40a3240 0x7fdfa40a5700 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fdfb40058c0 tx=0x7fdfb4005d30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:33.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.584+0000 7fdfaeffd640 1 -- 172.21.15.19:0/4077457681 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdfb00bdfa0 con 0x7fdfb810e4d0 2024-09-19T08:53:33.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:33 smithi155 ceph-mon[34921]: pgmap v377: 97 pgs: 97 active+clean; 671 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-19T08:53:33.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:33 smithi203 ceph-mon[35450]: pgmap v377: 97 pgs: 97 active+clean; 671 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1023 B/s wr, 11 op/s 2024-09-19T08:53:33.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.803+0000 7fdfbfcf2640 1 -- 172.21.15.19:0/4077457681 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdfb8105250 con 0x7fdfb810e4d0 2024-09-19T08:53:33.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.804+0000 7fdfaeffd640 1 -- 172.21.15.19:0/4077457681 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11983 (secure 0 0 0) 0x7fdfb00bd8a0 con 0x7fdfb810e4d0 2024-09-19T08:53:33.803 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:53:33.804 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":28,"btime":"2024-09-19T08:52:09:653615+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2452068876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2452068876},{"type":"v1","addr":"172.21.15.19:6839","nonce":2452068876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T08:52:08.813945+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/2480841559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2480841559},{"type":"v1","addr":"172.21.15.155:6835","nonce":2480841559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24463,24464,24490,24469,24497]},"id":1}]} 2024-09-19T08:53:33.804 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 28 2024-09-19T08:53:33.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.806+0000 7fdfbfcf2640 1 -- 172.21.15.19:0/4077457681 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fdfa40a3240 msgr2=0x7fdfa40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:33.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.806+0000 7fdfbfcf2640 1 --2- 172.21.15.19:0/4077457681 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fdfa40a3240 0x7fdfa40a5700 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fdfb40058c0 tx=0x7fdfb4005d30 comp rx=0 tx=0).stop 2024-09-19T08:53:33.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.806+0000 7fdfbfcf2640 1 -- 172.21.15.19:0/4077457681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfb810e4d0 msgr2=0x7fdfb810b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:33.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.806+0000 7fdfbfcf2640 1 --2- 172.21.15.19:0/4077457681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfb810e4d0 0x7fdfb810b430 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fdfb0003f40 tx=0x7fdfb0003f70 comp rx=0 tx=0).stop 2024-09-19T08:53:33.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.806+0000 7fdfbfcf2640 1 -- 172.21.15.19:0/4077457681 shutdown_connections 2024-09-19T08:53:33.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.806+0000 7fdfbfcf2640 1 --2- 172.21.15.19:0/4077457681 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fdfa40a3240 0x7fdfa40a5700 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:33.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.806+0000 7fdfbfcf2640 1 --2- 172.21.15.19:0/4077457681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfb810e4d0 0x7fdfb810b430 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:33.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.806+0000 7fdfbfcf2640 1 --2- 172.21.15.19:0/4077457681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfb8101360 0x7fdfb810aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:33.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.806+0000 7fdfbfcf2640 1 --2- 172.21.15.19:0/4077457681 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdfb81009b0 0x7fdfb810ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:33.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.806+0000 7fdfbfcf2640 1 -- 172.21.15.19:0/4077457681 >> 172.21.15.19:0/4077457681 conn(0x7fdfb80fc7d0 msgr2=0x7fdfb80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:33.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.806+0000 7fdfbfcf2640 1 -- 172.21.15.19:0/4077457681 shutdown_connections 2024-09-19T08:53:33.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:33.806+0000 7fdfbfcf2640 1 -- 172.21.15.19:0/4077457681 wait complete. 2024-09-19T08:53:34.093 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T08:53:34.158 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T08:53:34.202 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T08:53:34.204 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T08:53:34.204 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T08:53:34.252 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T08:53:34.256 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-19T08:53:34.256 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T08:53:34.273 INFO:tasks.workunit:Running workunits matching fs/misc on client.0... 2024-09-19T08:53:34.274 INFO:tasks.workunit:Running workunit fs/misc/acl.sh... 2024-09-19T08:53:34.274 DEBUG:teuthology.orchestra.run.smithi019:workunit test fs/misc/acl.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/acl.sh 2024-09-19T08:53:34.337 INFO:tasks.workunit.client.0.smithi019.stderr:+ set -e 2024-09-19T08:53:34.337 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir -p testdir 2024-09-19T08:53:34.339 INFO:tasks.workunit.client.0.smithi019.stderr:+ cd testdir 2024-09-19T08:53:34.339 INFO:tasks.workunit.client.0.smithi019.stderr:+ set +e 2024-09-19T08:53:34.339 INFO:tasks.workunit.client.0.smithi019.stderr:+ setfacl -d -m u:nobody:rw . 2024-09-19T08:53:34.371 INFO:tasks.workunit.client.0.smithi019.stderr:+ test 0 '!=' 0 2024-09-19T08:53:34.372 INFO:tasks.workunit.client.0.smithi019.stderr:+ set -e 2024-09-19T08:53:34.372 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=0 2024-09-19T08:53:34.372 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 0 -lt 100 ']' 2024-09-19T08:53:34.372 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 0 + 1 2024-09-19T08:53:34.373 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=1 2024-09-19T08:53:34.373 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:53:34.374 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:53:34.375 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:53:34.405 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:53:34.405 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:53:34.405 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:53:34.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:34 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/4077457681' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:53:34.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:34 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/4077457681' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:53:34.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:34 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/4077457681' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:53:34.844 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-09-19T08:53:34.844 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-09-19T08:53:35.293 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:53:35.293 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:53:35.400 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:53:35.400 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:53:35.403 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:53:35.403 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:53:35.403 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 1 -lt 100 ']' 2024-09-19T08:53:35.404 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 1 + 1 2024-09-19T08:53:35.459 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=2 2024-09-19T08:53:35.459 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:53:35.473 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:53:35.473 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:53:35.474 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:53:35.474 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:53:35.474 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:53:35.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:35 smithi019 ceph-mon[30976]: pgmap v378: 97 pgs: 97 active+clean; 671 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-19T08:53:35.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:35 smithi155 ceph-mon[34921]: pgmap v378: 97 pgs: 97 active+clean; 671 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-19T08:53:35.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:35 smithi203 ceph-mon[35450]: pgmap v378: 97 pgs: 97 active+clean; 671 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-19T08:53:36.100 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:53:36.100 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:53:36.350 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:53:36.350 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:53:36.393 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:53:36.393 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:53:36.393 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -lt 100 ']' 2024-09-19T08:53:36.393 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 2 + 1 2024-09-19T08:53:36.502 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=3 2024-09-19T08:53:36.502 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:53:36.605 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:53:36.605 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:53:36.606 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:53:36.606 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:53:36.606 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:53:36.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:36 smithi155 ceph-mon[34921]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T08:53:36.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:36 smithi203 ceph-mon[35450]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T08:53:36.795 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:36 smithi019 ceph-mon[30976]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T08:53:37.391 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:37 smithi019 ceph-mon[30976]: pgmap v379: 97 pgs: 97 active+clean; 671 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-19T08:53:37.450 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:53:37.450 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:53:37.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:37 smithi155 ceph-mon[34921]: pgmap v379: 97 pgs: 97 active+clean; 671 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-19T08:53:37.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:37 smithi203 ceph-mon[35450]: pgmap v379: 97 pgs: 97 active+clean; 671 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-19T08:53:37.744 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:53:37.744 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:53:37.784 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:53:37.784 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:53:37.784 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 3 -lt 100 ']' 2024-09-19T08:53:37.784 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 3 + 1 2024-09-19T08:53:37.873 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=4 2024-09-19T08:53:37.873 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:53:37.878 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:53:37.878 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:53:37.879 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:53:37.879 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:53:37.879 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:53:38.568 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:53:38.983 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:53:38.983 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:53:39.218 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:53:39.218 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:53:39.225 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:53:39.225 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:53:39.225 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 4 -lt 100 ']' 2024-09-19T08:53:39.225 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 4 + 1 2024-09-19T08:53:39.293 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=5 2024-09-19T08:53:39.293 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:53:39.303 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:53:39.303 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:53:39.304 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:53:39.304 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:53:39.304 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:53:39.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:39 smithi155 ceph-mon[34921]: pgmap v380: 97 pgs: 97 active+clean; 685 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-19T08:53:39.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:39 smithi203 ceph-mon[35450]: pgmap v380: 97 pgs: 97 active+clean; 685 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-19T08:53:39.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:39 smithi019 ceph-mon[30976]: pgmap v380: 97 pgs: 97 active+clean; 685 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-09-19T08:53:40.145 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.146+0000 7fe991a82640 1 -- 172.21.15.19:0/2515296713 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe98c103700 msgr2=0x7fe98c109f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.146+0000 7fe991a82640 1 --2- 172.21.15.19:0/2515296713 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe98c103700 0x7fe98c109f90 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fe984009ca0 tx=0x7fe98402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:53:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.146+0000 7fe991a82640 1 -- 172.21.15.19:0/2515296713 shutdown_connections 2024-09-19T08:53:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.146+0000 7fe991a82640 1 --2- 172.21.15.19:0/2515296713 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe98c103700 0x7fe98c109f90 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.146+0000 7fe991a82640 1 --2- 172.21.15.19:0/2515296713 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe98c102d40 0x7fe98c1031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.146+0000 7fe991a82640 1 --2- 172.21.15.19:0/2515296713 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe98c101b50 0x7fe98c101f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.146+0000 7fe991a82640 1 -- 172.21.15.19:0/2515296713 >> 172.21.15.19:0/2515296713 conn(0x7fe98c0fd2b0 msgr2=0x7fe98c0ff6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.146+0000 7fe991a82640 1 -- 172.21.15.19:0/2515296713 shutdown_connections 2024-09-19T08:53:40.146 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.146+0000 7fe991a82640 1 -- 172.21.15.19:0/2515296713 wait complete. 2024-09-19T08:53:40.171 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.172+0000 7fe991a82640 1 Processor -- start 2024-09-19T08:53:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.172+0000 7fe991a82640 1 -- start start 2024-09-19T08:53:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.173+0000 7fe991a82640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe98c101b50 0x7fe98c075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.173+0000 7fe991a82640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe98c102d40 0x7fe98c0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.173+0000 7fe991a82640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe98c103700 0x7fe98c074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.173+0000 7fe991a82640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c10d820 con 0x7fe98c102d40 2024-09-19T08:53:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.173+0000 7fe991a82640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c10d6a0 con 0x7fe98c101b50 2024-09-19T08:53:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.173+0000 7fe991a82640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c10d9a0 con 0x7fe98c103700 2024-09-19T08:53:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.173+0000 7fe98affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe98c102d40 0x7fe98c0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.173+0000 7fe98affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe98c102d40 0x7fe98c0745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51438/0 (socket says 172.21.15.19:51438) 2024-09-19T08:53:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.173+0000 7fe98affd640 1 -- 172.21.15.19:0/4098243175 learned_addr learned my addr 172.21.15.19:0/4098243175 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.173+0000 7fe98bfff640 1 --2- 172.21.15.19:0/4098243175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe98c103700 0x7fe98c074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:40.173 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.173+0000 7fe98b7fe640 1 --2- 172.21.15.19:0/4098243175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe98c101b50 0x7fe98c075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.173+0000 7fe98affd640 1 -- 172.21.15.19:0/4098243175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe98c103700 msgr2=0x7fe98c074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.173+0000 7fe98affd640 1 --2- 172.21.15.19:0/4098243175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe98c103700 0x7fe98c074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.173+0000 7fe98affd640 1 -- 172.21.15.19:0/4098243175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe98c101b50 msgr2=0x7fe98c075fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.173+0000 7fe98affd640 1 --2- 172.21.15.19:0/4098243175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe98c101b50 0x7fe98c075fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.173+0000 7fe98affd640 1 -- 172.21.15.19:0/4098243175 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe98c0753b0 con 0x7fe98c102d40 2024-09-19T08:53:40.174 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.174+0000 7fe98affd640 1 --2- 172.21.15.19:0/4098243175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe98c102d40 0x7fe98c0745e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe98000ea60 tx=0x7fe98000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.174+0000 7fe988ff9640 1 -- 172.21.15.19:0/4098243175 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98000cde0 con 0x7fe98c102d40 2024-09-19T08:53:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.174+0000 7fe988ff9640 1 -- 172.21.15.19:0/4098243175 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9800035f0 con 0x7fe98c102d40 2024-09-19T08:53:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.174+0000 7fe988ff9640 1 -- 172.21.15.19:0/4098243175 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe980010670 con 0x7fe98c102d40 2024-09-19T08:53:40.175 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.174+0000 7fe991a82640 1 -- 172.21.15.19:0/4098243175 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe98c1a1f00 con 0x7fe98c102d40 2024-09-19T08:53:40.176 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.177+0000 7fe988ff9640 1 -- 172.21.15.19:0/4098243175 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fe9800037a0 con 0x7fe98c102d40 2024-09-19T08:53:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.178+0000 7fe988ff9640 1 --2- 172.21.15.19:0/4098243175 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe9740a3370 0x7fe9740a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.178+0000 7fe98b7fe640 1 --2- 172.21.15.19:0/4098243175 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe9740a3370 0x7fe9740a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:40.177 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.179+0000 7fe98b7fe640 1 --2- 172.21.15.19:0/4098243175 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe9740a3370 0x7fe9740a5830 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe97c005fd0 tx=0x7fe97c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:40.193 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.193+0000 7fe991a82640 1 -- 172.21.15.19:0/4098243175 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe98c1a2310 con 0x7fe98c102d40 2024-09-19T08:53:40.193 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.194+0000 7fe988ff9640 1 -- 172.21.15.19:0/4098243175 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fe980099950 con 0x7fe98c102d40 2024-09-19T08:53:40.597 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:53:40.598 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:53:40.775 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:53:40.775 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:53:40.804 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.802+0000 7fe994821740 1 Processor -- start 2024-09-19T08:53:40.804 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.802+0000 7fe994821740 1 -- start start 2024-09-19T08:53:40.805 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.802+0000 7fe994821740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c08cb149a0 0x55c08cb14da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:40.805 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.802+0000 7fe994821740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c08cb152e0 0x55c08cb19da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:40.805 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.802+0000 7fe994821740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c08cb1a370 0x55c08cb1c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:40.805 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.802+0000 7fe994821740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c08ca782f0 con 0x55c08cb1a370 2024-09-19T08:53:40.805 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.802+0000 7fe994821740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55c08ca20270 con 0x55c08cb149a0 2024-09-19T08:53:40.805 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.802+0000 7fe994821740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c08ca742b0 con 0x55c08cb152e0 2024-09-19T08:53:40.805 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.802+0000 7fe98bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c08cb1a370 0x55c08cb1c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:40.806 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.802+0000 7fe98bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c08cb1a370 0x55c08cb1c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51452/0 (socket says 172.21.15.19:51452) 2024-09-19T08:53:40.806 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.802+0000 7fe98bfff640 1 -- 172.21.15.19:0/691971539 learned_addr learned my addr 172.21.15.19:0/691971539 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:40.806 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.802+0000 7fe98affd640 1 --2- 172.21.15.19:0/691971539 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c08cb152e0 0x55c08cb19da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:40.807 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.803+0000 7fe98b7fe640 1 --2- 172.21.15.19:0/691971539 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c08cb149a0 0x55c08cb14da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:40.807 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.803+0000 7fe98bfff640 1 -- 172.21.15.19:0/691971539 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c08cb152e0 msgr2=0x55c08cb19da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:40.808 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.803+0000 7fe98bfff640 1 --2- 172.21.15.19:0/691971539 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c08cb152e0 0x55c08cb19da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:40.808 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.803+0000 7fe98bfff640 1 -- 172.21.15.19:0/691971539 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c08cb149a0 msgr2=0x55c08cb14da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:40.808 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.803+0000 7fe98bfff640 1 --2- 172.21.15.19:0/691971539 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c08cb149a0 0x55c08cb14da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:40.808 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.803+0000 7fe98bfff640 1 -- 172.21.15.19:0/691971539 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c08ca1f340 con 0x55c08cb1a370 2024-09-19T08:53:40.809 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.803+0000 7fe98bfff640 1 --2- 172.21.15.19:0/691971539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c08cb1a370 0x55c08cb1c830 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe984035000 tx=0x7fe984005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68de86e5af5c22a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:40.809 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.803+0000 7fe971ffb640 1 -- 172.21.15.19:0/691971539 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe984031650 con 0x55c08cb1a370 2024-09-19T08:53:40.809 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.803+0000 7fe971ffb640 1 -- 172.21.15.19:0/691971539 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe984036030 con 0x55c08cb1a370 2024-09-19T08:53:40.809 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.803+0000 7fe971ffb640 1 -- 172.21.15.19:0/691971539 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe984004860 con 0x55c08cb1a370 2024-09-19T08:53:40.809 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.804+0000 7fe994821740 1 -- 172.21.15.19:0/691971539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c08cb1a370 msgr2=0x55c08cb1c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:40.809 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.804+0000 7fe994821740 1 --2- 172.21.15.19:0/691971539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c08cb1a370 0x55c08cb1c830 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fe984035000 tx=0x7fe984005fa0 comp rx=0 tx=0).stop 2024-09-19T08:53:40.809 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.804+0000 7fe994821740 1 -- 172.21.15.19:0/691971539 shutdown_connections 2024-09-19T08:53:40.809 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.804+0000 7fe994821740 1 --2- 172.21.15.19:0/691971539 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c08cb152e0 0x55c08cb19da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:40.809 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.804+0000 7fe994821740 1 --2- 172.21.15.19:0/691971539 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c08cb1a370 0x55c08cb1c830 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:40.809 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.804+0000 7fe994821740 1 --2- 172.21.15.19:0/691971539 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c08cb149a0 0x55c08cb14da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:40.809 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.804+0000 7fe994821740 1 -- 172.21.15.19:0/691971539 >> 172.21.15.19:0/691971539 conn(0x55c08cb10010 msgr2=0x55c08cb10410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:40.809 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.804+0000 7fe994821740 1 -- 172.21.15.19:0/691971539 shutdown_connections 2024-09-19T08:53:40.809 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.804+0000 7fe994821740 1 -- 172.21.15.19:0/691971539 wait complete. 2024-09-19T08:53:40.818 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:53:40.818 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:53:40.818 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 5 -lt 100 ']' 2024-09-19T08:53:40.818 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 5 + 1 2024-09-19T08:53:40.850 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.851+0000 7fe994821740 1 -- start start 2024-09-19T08:53:40.857 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.857+0000 7fe994821740 1 Processor -- start 2024-09-19T08:53:40.858 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.857+0000 7fe994821740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c08cb149a0 0x55c08cb1ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:40.858 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.857+0000 7fe994821740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c08cb152e0 0x55c08cb1ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:40.858 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.857+0000 7fe994821740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c08cb1a370 0x55c08cb25f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:40.858 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.857+0000 7fe994821740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c08cb1d160 con 0x55c08cb1a370 2024-09-19T08:53:40.858 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.857+0000 7fe994821740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55c08ca01290 con 0x55c08cb152e0 2024-09-19T08:53:40.858 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.857+0000 7fe994821740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c08cb1d2e0 con 0x55c08cb149a0 2024-09-19T08:53:40.858 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.857+0000 7fe98bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c08cb1a370 0x55c08cb25f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:40.858 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.857+0000 7fe98bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c08cb1a370 0x55c08cb25f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51468/0 (socket says 172.21.15.19:51468) 2024-09-19T08:53:40.858 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.857+0000 7fe98bfff640 1 -- 172.21.15.19:0/1976292008 learned_addr learned my addr 172.21.15.19:0/1976292008 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:40.858 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.858+0000 7fe98b7fe640 1 --2- 172.21.15.19:0/1976292008 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c08cb149a0 0x55c08cb1ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:40.858 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.858+0000 7fe98affd640 1 --2- 172.21.15.19:0/1976292008 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c08cb152e0 0x55c08cb1ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:40.859 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.858+0000 7fe98bfff640 1 -- 172.21.15.19:0/1976292008 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c08cb149a0 msgr2=0x55c08cb1ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:40.859 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.858+0000 7fe98bfff640 1 --2- 172.21.15.19:0/1976292008 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c08cb149a0 0x55c08cb1ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:40.859 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.858+0000 7fe98bfff640 1 -- 172.21.15.19:0/1976292008 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c08cb152e0 msgr2=0x55c08cb1ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:40.859 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.858+0000 7fe98bfff640 1 --2- 172.21.15.19:0/1976292008 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c08cb152e0 0x55c08cb1ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:40.859 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.858+0000 7fe98bfff640 1 -- 172.21.15.19:0/1976292008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c08c78b210 con 0x55c08cb1a370 2024-09-19T08:53:40.859 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.858+0000 7fe994821740 10 client.0 _ll_register_callbacks cb 0x55c08ca32140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:40.859 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.858+0000 7fe98bfff640 1 --2- 172.21.15.19:0/1976292008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c08cb1a370 0x55c08cb25f90 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe984005e30 tx=0x7fe984031680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4412b2113e8a08e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:40.859 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.858+0000 7fe96affd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:53:40.859 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.858+0000 7fe96affd640 1 -- 172.21.15.19:0/1976292008 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe984003b80 con 0x55c08cb1a370 2024-09-19T08:53:40.859 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.858+0000 7fe96affd640 1 -- 172.21.15.19:0/1976292008 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fe984003d20 con 0x55c08cb1a370 2024-09-19T08:53:40.860 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.859+0000 7fe994821740 1 -- 172.21.15.19:0/1976292008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe984036030 con 0x55c08cb1a370 2024-09-19T08:53:40.860 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.860+0000 7fe96affd640 1 -- 172.21.15.19:0/1976292008 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe984003f60 con 0x55c08cb1a370 2024-09-19T08:53:40.860 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.860+0000 7fe994821740 10 client.15759 fetch_fsmap learned FSMap version 30 2024-09-19T08:53:40.860 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:40.860+0000 7fe994821740 1 -- 172.21.15.19:0/1976292008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55c08c857620 con 0x55c08cb1a370 2024-09-19T08:53:40.939 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=6 2024-09-19T08:53:40.940 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:53:40.995 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:53:40.995 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:53:40.996 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:53:40.996 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:53:40.996 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:53:41.023 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.022+0000 7fe96affd640 1 -- 172.21.15.19:0/1976292008 <== mon.0 v2:172.21.15.19:3300/0 4 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fe98402f610 con 0x55c08cb1a370 2024-09-19T08:53:41.023 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.022+0000 7fe994821740 10 client.15759 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T08:53:41.023 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.022+0000 7fe994821740 10 client.15759 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:53:41.024 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.023+0000 7fe994821740 20 client.15759 populate_metadata read hostname 'smithi019' 2024-09-19T08:53:41.024 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.023+0000 7fe994821740 1 --2- 172.21.15.19:0/1976292008 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55c08cb2a100 0x55c08cb2c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:41.024 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.023+0000 7fe994821740 4 client.15759 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:53:41.024 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.023+0000 7fe994821740 1 -- 172.21.15.19:0/1976292008 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c08ca85a20 con 0x55c08cb2a100 2024-09-19T08:53:41.024 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.024+0000 7fe98b7fe640 1 --2- 172.21.15.19:0/1976292008 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55c08cb2a100 0x55c08cb2c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:41.027 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.024+0000 7fe98b7fe640 1 --2- 172.21.15.19:0/1976292008 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55c08cb2a100 0x55c08cb2c5c0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f08fcf5120ac294e server_cookie=69c4e85ed5d53b8d in_seq=0 out_seq=0 2024-09-19T08:53:41.027 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.024+0000 7fe96affd640 10 client.15759 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:41.027 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.025+0000 7fe96affd640 1 -- 172.21.15.19:0/1976292008 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c08ca85a20 con 0x55c08cb2a100 2024-09-19T08:53:41.028 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.025+0000 7fe96affd640 10 client.15759 handle_command_reply: tid=0 2024-09-19T08:53:41.028 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.025+0000 7fe994821740 1 client.15759 shutdown 2024-09-19T08:53:41.028 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.025+0000 7fe994821740 1 -- 172.21.15.19:0/1976292008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c08cb1a370 msgr2=0x55c08cb25f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:41.028 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.025+0000 7fe994821740 1 --2- 172.21.15.19:0/1976292008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c08cb1a370 0x55c08cb25f90 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe984005e30 tx=0x7fe984031680 comp rx=0 tx=0).stop 2024-09-19T08:53:41.028 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.025+0000 7fe994821740 1 -- 172.21.15.19:0/1976292008 shutdown_connections 2024-09-19T08:53:41.029 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.025+0000 7fe994821740 1 --2- 172.21.15.19:0/1976292008 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55c08cb2a100 0x55c08cb2c5c0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:41.029 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.025+0000 7fe994821740 1 --2- 172.21.15.19:0/1976292008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c08cb1a370 0x55c08cb25f90 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:41.029 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.025+0000 7fe994821740 1 --2- 172.21.15.19:0/1976292008 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c08cb152e0 0x55c08cb1ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:41.029 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.025+0000 7fe96affd640 0 client.15759 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:41.029 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.025+0000 7fe994821740 1 --2- 172.21.15.19:0/1976292008 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c08cb149a0 0x55c08cb1ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:41.029 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.025+0000 7fe994821740 1 -- 172.21.15.19:0/1976292008 >> 172.21.15.19:0/1976292008 conn(0x55c08cb10010 msgr2=0x55c08cb11820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:41.030 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.025+0000 7fe994821740 1 -- 172.21.15.19:0/1976292008 shutdown_connections 2024-09-19T08:53:41.030 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.025+0000 7fe994821740 1 -- 172.21.15.19:0/1976292008 wait complete. 2024-09-19T08:53:41.030 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.026+0000 7fe994821740 20 client.15759 trim_cache size 0 max 16384 2024-09-19T08:53:41.049 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.041+0000 7fe994821740 1 Processor -- start 2024-09-19T08:53:41.049 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.041+0000 7fe994821740 1 -- start start 2024-09-19T08:53:41.049 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.041+0000 7fe994821740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c08cb149a0 0x55c08cb0f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:41.049 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.041+0000 7fe994821740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c08cb152e0 0x55c08cb25f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:41.050 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.041+0000 7fe994821740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c08cb1a370 0x55c08cb11400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:41.050 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.041+0000 7fe994821740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c1ab180 con 0x55c08cb152e0 2024-09-19T08:53:41.050 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.041+0000 7fe994821740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c1acd80 con 0x55c08cb149a0 2024-09-19T08:53:41.050 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.041+0000 7fe994821740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c1ab850 con 0x55c08cb1a370 2024-09-19T08:53:41.050 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.042+0000 7fe98affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c08cb152e0 0x55c08cb25f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:41.050 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.042+0000 7fe98affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c08cb152e0 0x55c08cb25f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51480/0 (socket says 172.21.15.19:51480) 2024-09-19T08:53:41.050 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.042+0000 7fe98affd640 1 -- 172.21.15.19:0/4128917959 learned_addr learned my addr 172.21.15.19:0/4128917959 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:41.051 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.042+0000 7fe98b7fe640 1 --2- 172.21.15.19:0/4128917959 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c08cb149a0 0x55c08cb0f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:41.051 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.042+0000 7fe98bfff640 1 --2- 172.21.15.19:0/4128917959 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c08cb1a370 0x55c08cb11400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:41.051 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.042+0000 7fe98affd640 1 -- 172.21.15.19:0/4128917959 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c08cb1a370 msgr2=0x55c08cb11400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:41.051 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.042+0000 7fe98affd640 1 --2- 172.21.15.19:0/4128917959 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c08cb1a370 0x55c08cb11400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:41.051 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.042+0000 7fe98affd640 1 -- 172.21.15.19:0/4128917959 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c08cb149a0 msgr2=0x55c08cb0f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:41.051 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.042+0000 7fe98affd640 1 --2- 172.21.15.19:0/4128917959 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c08cb149a0 0x55c08cb0f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:41.051 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.042+0000 7fe98affd640 1 -- 172.21.15.19:0/4128917959 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c08cb2cc40 con 0x55c08cb152e0 2024-09-19T08:53:41.052 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.042+0000 7fe98affd640 1 --2- 172.21.15.19:0/4128917959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c08cb152e0 0x55c08cb25f30 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe98009b840 tx=0x7fe98009e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52c63d27de9a8111 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:41.052 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.042+0000 7fe9717fa640 1 -- 172.21.15.19:0/4128917959 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98007e020 con 0x55c08cb152e0 2024-09-19T08:53:41.052 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.042+0000 7fe9717fa640 1 -- 172.21.15.19:0/4128917959 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9800a4520 con 0x55c08cb152e0 2024-09-19T08:53:41.052 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.042+0000 7fe9717fa640 1 -- 172.21.15.19:0/4128917959 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9800a4090 con 0x55c08cb152e0 2024-09-19T08:53:41.052 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.043+0000 7fe994821740 1 -- 172.21.15.19:0/4128917959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c08cb152e0 msgr2=0x55c08cb25f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:41.052 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.043+0000 7fe994821740 1 --2- 172.21.15.19:0/4128917959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c08cb152e0 0x55c08cb25f30 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe98009b840 tx=0x7fe98009e040 comp rx=0 tx=0).stop 2024-09-19T08:53:41.052 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.043+0000 7fe994821740 1 -- 172.21.15.19:0/4128917959 shutdown_connections 2024-09-19T08:53:41.052 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.043+0000 7fe994821740 1 --2- 172.21.15.19:0/4128917959 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c08cb1a370 0x55c08cb11400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:41.053 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.043+0000 7fe994821740 1 --2- 172.21.15.19:0/4128917959 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c08cb152e0 0x55c08cb25f30 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:41.053 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.043+0000 7fe994821740 1 --2- 172.21.15.19:0/4128917959 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c08cb149a0 0x55c08cb0f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:41.053 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.043+0000 7fe994821740 1 -- 172.21.15.19:0/4128917959 >> 172.21.15.19:0/4128917959 conn(0x55c08cb10010 msgr2=0x55c08cb0e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:41.053 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.043+0000 7fe994821740 1 -- 172.21.15.19:0/4128917959 shutdown_connections 2024-09-19T08:53:41.053 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.043+0000 7fe994821740 1 -- 172.21.15.19:0/4128917959 wait complete. 2024-09-19T08:53:41.053 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.044+0000 7fe994821740 1 -- start start 2024-09-19T08:53:41.053 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.044+0000 7fe994821740 1 Processor -- start 2024-09-19T08:53:41.054 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.044+0000 7fe994821740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c08cb149a0 0x55c08cb23cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:41.054 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.044+0000 7fe994821740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c08cb152e0 0x55c08cb24200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:41.054 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.044+0000 7fe994821740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c08cb1a370 0x55c08cb25210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:41.054 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.044+0000 7fe994821740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c1ac5f0 con 0x55c08cb1a370 2024-09-19T08:53:41.054 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.044+0000 7fe994821740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c1abf20 con 0x55c08cb149a0 2024-09-19T08:53:41.054 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.044+0000 7fe994821740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c1a9160 con 0x55c08cb152e0 2024-09-19T08:53:41.054 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.044+0000 7fe994821740 10 client.0 _ll_register_callbacks cb 0x7fe97c00b870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:41.055 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.045+0000 7fe98bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c08cb1a370 0x55c08cb25210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:41.055 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.045+0000 7fe98affd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c08cb152e0 0x55c08cb24200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:41.055 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.045+0000 7fe98affd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c08cb152e0 0x55c08cb24200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:44416/0 (socket says 172.21.15.19:44416) 2024-09-19T08:53:41.055 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.045+0000 7fe98bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c08cb1a370 0x55c08cb25210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:51488/0 (socket says 172.21.15.19:51488) 2024-09-19T08:53:41.055 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.045+0000 7fe98affd640 1 -- 172.21.15.19:0/1513187217 learned_addr learned my addr 172.21.15.19:0/1513187217 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:41.055 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.045+0000 7fe98b7fe640 1 --2- 172.21.15.19:0/1513187217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c08cb149a0 0x55c08cb23cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:41.055 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.045+0000 7fe98bfff640 1 -- 172.21.15.19:0/1513187217 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c08cb152e0 msgr2=0x55c08cb24200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:41.056 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.045+0000 7fe98bfff640 1 --2- 172.21.15.19:0/1513187217 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c08cb152e0 0x55c08cb24200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:41.056 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.045+0000 7fe98bfff640 1 -- 172.21.15.19:0/1513187217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c08cb149a0 msgr2=0x55c08cb23cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:41.056 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.045+0000 7fe98bfff640 1 --2- 172.21.15.19:0/1513187217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c08cb149a0 0x55c08cb23cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:41.056 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.045+0000 7fe98bfff640 1 -- 172.21.15.19:0/1513187217 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c08cb25820 con 0x55c08cb1a370 2024-09-19T08:53:41.056 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.045+0000 7fe98affd640 1 --2- 172.21.15.19:0/1513187217 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c08cb152e0 0x55c08cb24200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:53:41.056 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.045+0000 7fe98bfff640 1 --2- 172.21.15.19:0/1513187217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c08cb1a370 0x55c08cb25210 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fe98402ade0 tx=0x7fe984031bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a9ce8465c5d787 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:41.056 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.045+0000 7fe96affd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:53:41.057 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.045+0000 7fe96affd640 1 -- 172.21.15.19:0/1513187217 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe984031860 con 0x55c08cb1a370 2024-09-19T08:53:41.057 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.045+0000 7fe96affd640 1 -- 172.21.15.19:0/1513187217 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fe984004100 con 0x55c08cb1a370 2024-09-19T08:53:41.057 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.045+0000 7fe994821740 1 -- 172.21.15.19:0/1513187217 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9800a4520 con 0x55c08cb1a370 2024-09-19T08:53:41.057 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.046+0000 7fe96affd640 1 -- 172.21.15.19:0/1513187217 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fe984003d90 con 0x55c08cb1a370 2024-09-19T08:53:41.057 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.046+0000 7fe994821740 10 client.15765 fetch_fsmap learned FSMap version 30 2024-09-19T08:53:41.057 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.046+0000 7fe994821740 1 -- 172.21.15.19:0/1513187217 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c08cb95500 con 0x55c08cb1a370 2024-09-19T08:53:41.057 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.046+0000 7fe96affd640 1 -- 172.21.15.19:0/1513187217 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe9800a4520 con 0x55c08cb1a370 2024-09-19T08:53:41.058 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.046+0000 7fe96affd640 1 -- 172.21.15.19:0/1513187217 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fe984030890 con 0x55c08cb1a370 2024-09-19T08:53:41.058 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.046+0000 7fe994821740 10 client.15765 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T08:53:41.058 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.046+0000 7fe994821740 10 client.15765 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:53:41.058 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.046+0000 7fe994821740 20 client.15765 populate_metadata read hostname 'smithi019' 2024-09-19T08:53:41.058 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.046+0000 7fe994821740 1 --2- 172.21.15.19:0/1513187217 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55c08cb95e40 0x55c08cb98260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:41.058 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.046+0000 7fe994821740 4 client.15765 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:53:41.058 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.046+0000 7fe994821740 1 -- 172.21.15.19:0/1513187217 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c08ca7fd70 con 0x55c08cb95e40 2024-09-19T08:53:41.058 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.046+0000 7fe98b7fe640 1 --2- 172.21.15.19:0/1513187217 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55c08cb95e40 0x55c08cb98260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:41.059 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.047+0000 7fe98b7fe640 1 --2- 172.21.15.19:0/1513187217 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55c08cb95e40 0x55c08cb98260 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de394e420fa01b29 server_cookie=414c9ad813629404 in_seq=0 out_seq=0 2024-09-19T08:53:41.059 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.047+0000 7fe96affd640 10 client.15765 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:41.061 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.056+0000 7fe96affd640 1 -- 172.21.15.19:0/1513187217 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c08ca7fd70 con 0x55c08cb95e40 2024-09-19T08:53:41.061 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.056+0000 7fe96affd640 10 client.15765 handle_command_reply: tid=0 2024-09-19T08:53:41.061 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.056+0000 7fe994821740 1 client.15765 shutdown 2024-09-19T08:53:41.061 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.056+0000 7fe994821740 1 -- 172.21.15.19:0/1513187217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c08cb1a370 msgr2=0x55c08cb25210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:41.061 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.056+0000 7fe994821740 1 --2- 172.21.15.19:0/1513187217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c08cb1a370 0x55c08cb25210 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fe98402ade0 tx=0x7fe984031bb0 comp rx=0 tx=0).stop 2024-09-19T08:53:41.061 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.056+0000 7fe994821740 1 -- 172.21.15.19:0/1513187217 shutdown_connections 2024-09-19T08:53:41.062 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.056+0000 7fe994821740 1 --2- 172.21.15.19:0/1513187217 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55c08cb95e40 0x55c08cb98260 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:41.062 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.056+0000 7fe994821740 1 --2- 172.21.15.19:0/1513187217 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c08cb152e0 0x55c08cb24200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:41.062 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.056+0000 7fe994821740 1 --2- 172.21.15.19:0/1513187217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c08cb1a370 0x55c08cb25210 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:41.062 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.056+0000 7fe96affd640 0 client.15765 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:41.062 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.056+0000 7fe994821740 1 --2- 172.21.15.19:0/1513187217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c08cb149a0 0x55c08cb23cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:41.062 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.056+0000 7fe994821740 1 -- 172.21.15.19:0/1513187217 >> 172.21.15.19:0/1513187217 conn(0x55c08cb10010 msgr2=0x55c08cb0f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:41.062 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.056+0000 7fe994821740 1 -- 172.21.15.19:0/1513187217 shutdown_connections 2024-09-19T08:53:41.062 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.056+0000 7fe994821740 1 -- 172.21.15.19:0/1513187217 wait complete. 2024-09-19T08:53:41.062 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.057+0000 7fe994821740 20 client.15765 trim_cache size 0 max 16384 2024-09-19T08:53:41.063 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T08:53:41.063 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T08:53:41.063 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T08:53:41.063 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T08:53:41.064 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.057+0000 7fe991a82640 1 -- 172.21.15.19:0/4098243175 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe9740a3370 msgr2=0x7fe9740a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:41.064 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.057+0000 7fe991a82640 1 --2- 172.21.15.19:0/4098243175 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe9740a3370 0x7fe9740a5830 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe97c005fd0 tx=0x7fe97c00b390 comp rx=0 tx=0).stop 2024-09-19T08:53:41.064 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.057+0000 7fe991a82640 1 -- 172.21.15.19:0/4098243175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe98c102d40 msgr2=0x7fe98c0745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:41.064 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.057+0000 7fe991a82640 1 --2- 172.21.15.19:0/4098243175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe98c102d40 0x7fe98c0745e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fe98000ea60 tx=0x7fe98000ef20 comp rx=0 tx=0).stop 2024-09-19T08:53:41.064 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.057+0000 7fe991a82640 1 -- 172.21.15.19:0/4098243175 shutdown_connections 2024-09-19T08:53:41.064 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.057+0000 7fe991a82640 1 --2- 172.21.15.19:0/4098243175 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe9740a3370 0x7fe9740a5830 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:41.064 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.057+0000 7fe991a82640 1 --2- 172.21.15.19:0/4098243175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe98c103700 0x7fe98c074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:41.065 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.057+0000 7fe991a82640 1 --2- 172.21.15.19:0/4098243175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe98c102d40 0x7fe98c0745e0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:41.065 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.057+0000 7fe991a82640 1 --2- 172.21.15.19:0/4098243175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe98c101b50 0x7fe98c075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:41.065 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.057+0000 7fe991a82640 1 -- 172.21.15.19:0/4098243175 >> 172.21.15.19:0/4098243175 conn(0x7fe98c0fd2b0 msgr2=0x7fe98c105fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:41.065 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.057+0000 7fe991a82640 1 -- 172.21.15.19:0/4098243175 shutdown_connections 2024-09-19T08:53:41.065 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:41.057+0000 7fe991a82640 1 -- 172.21.15.19:0/4098243175 wait complete. 2024-09-19T08:53:41.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:41 smithi155 ceph-mon[34921]: pgmap v381: 97 pgs: 97 active+clean; 709 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 3.7 KiB/s wr, 12 op/s 2024-09-19T08:53:41.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:41 smithi155 ceph-mon[34921]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T08:53:41.724 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:41 smithi019 ceph-mon[30976]: pgmap v381: 97 pgs: 97 active+clean; 709 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 3.7 KiB/s wr, 12 op/s 2024-09-19T08:53:41.724 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:41 smithi019 ceph-mon[30976]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T08:53:41.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:41 smithi203 ceph-mon[35450]: pgmap v381: 97 pgs: 97 active+clean; 709 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 3.7 KiB/s wr, 12 op/s 2024-09-19T08:53:41.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:41 smithi203 ceph-mon[35450]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T08:53:42.066 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:53:42.066 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:53:42.395 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:53:42.395 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:53:42.441 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:53:42.441 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:53:42.442 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 6 -lt 100 ']' 2024-09-19T08:53:42.442 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 6 + 1 2024-09-19T08:53:42.569 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=7 2024-09-19T08:53:42.569 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:53:42.644 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:53:42.645 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:53:42.645 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:53:42.645 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:53:42.646 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:53:43.515 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:53:43.516 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:53:43.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:43 smithi019 ceph-mon[30976]: pgmap v382: 97 pgs: 97 active+clean; 709 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.0 KiB/s wr, 12 op/s 2024-09-19T08:53:43.660 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:53:43.660 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:53:43.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:43 smithi155 ceph-mon[34921]: pgmap v382: 97 pgs: 97 active+clean; 709 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.0 KiB/s wr, 12 op/s 2024-09-19T08:53:43.683 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:53:43.683 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:53:43.683 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 7 -lt 100 ']' 2024-09-19T08:53:43.683 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 7 + 1 2024-09-19T08:53:43.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:43 smithi203 ceph-mon[35450]: pgmap v382: 97 pgs: 97 active+clean; 709 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 4.0 KiB/s wr, 12 op/s 2024-09-19T08:53:43.732 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=8 2024-09-19T08:53:43.732 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:53:43.744 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:53:43.744 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:53:43.745 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:53:43.746 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:53:43.746 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:53:43.754 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:43.754 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:44.974 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:53:44.974 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:53:45.169 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:53:45.170 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:53:45.183 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:53:45.183 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:53:45.183 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 8 -lt 100 ']' 2024-09-19T08:53:45.183 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 8 + 1 2024-09-19T08:53:45.221 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=9 2024-09-19T08:53:45.221 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:53:45.259 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:53:45.260 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:53:45.260 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:53:45.261 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:53:45.261 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:53:45.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:45 smithi155 ceph-mon[34921]: pgmap v383: 97 pgs: 97 active+clean; 754 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.2 KiB/s wr, 16 op/s 2024-09-19T08:53:45.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:45 smithi203 ceph-mon[35450]: pgmap v383: 97 pgs: 97 active+clean; 754 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.2 KiB/s wr, 16 op/s 2024-09-19T08:53:45.748 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:45 smithi019 ceph-mon[30976]: pgmap v383: 97 pgs: 97 active+clean; 754 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.2 KiB/s wr, 16 op/s 2024-09-19T08:53:46.499 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:53:46.499 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:53:46.861 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:53:46.861 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:53:46.899 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:53:46.900 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:53:46.900 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 9 -lt 100 ']' 2024-09-19T08:53:46.900 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 9 + 1 2024-09-19T08:53:46.987 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=10 2024-09-19T08:53:46.987 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:53:47.014 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:53:47.014 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:53:47.016 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:53:47.016 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:53:47.016 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:53:47.531 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:47 smithi019 ceph-mon[30976]: pgmap v384: 97 pgs: 97 active+clean; 754 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.3 KiB/s wr, 16 op/s 2024-09-19T08:53:47.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:47 smithi155 ceph-mon[34921]: pgmap v384: 97 pgs: 97 active+clean; 754 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.3 KiB/s wr, 16 op/s 2024-09-19T08:53:47.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:47 smithi203 ceph-mon[35450]: pgmap v384: 97 pgs: 97 active+clean; 754 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.3 KiB/s wr, 16 op/s 2024-09-19T08:53:47.774 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:53:47.774 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:53:48.050 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:53:48.050 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:53:48.057 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:53:48.057 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:53:48.057 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 10 -lt 100 ']' 2024-09-19T08:53:48.058 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 10 + 1 2024-09-19T08:53:48.105 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=11 2024-09-19T08:53:48.105 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:53:48.131 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:53:48.131 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:53:48.132 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:53:48.132 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:53:48.133 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:53:48.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.408+0000 7f9bf3a1a640 1 -- 172.21.15.19:0/1603625737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bec102d30 msgr2=0x7f9bec103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:48.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.408+0000 7f9bf3a1a640 1 --2- 172.21.15.19:0/1603625737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bec102d30 0x7f9bec103110 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc009cd0 tx=0x7f9bdc02a8e0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.408+0000 7f9bf3a1a640 1 -- 172.21.15.19:0/1603625737 shutdown_connections 2024-09-19T08:53:48.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.408+0000 7f9bf3a1a640 1 --2- 172.21.15.19:0/1603625737 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9bec1082a0 0x7f9bec10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.408+0000 7f9bf3a1a640 1 --2- 172.21.15.19:0/1603625737 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9bec1036e0 0x7f9bec107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.408+0000 7f9bf3a1a640 1 --2- 172.21.15.19:0/1603625737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bec102d30 0x7f9bec103110 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.408+0000 7f9bf3a1a640 1 -- 172.21.15.19:0/1603625737 >> 172.21.15.19:0/1603625737 conn(0x7f9bec0fc7d0 msgr2=0x7f9bec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:48.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.409+0000 7f9bf3a1a640 1 -- 172.21.15.19:0/1603625737 shutdown_connections 2024-09-19T08:53:48.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.409+0000 7f9bf3a1a640 1 -- 172.21.15.19:0/1603625737 wait complete. 2024-09-19T08:53:48.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.409+0000 7f9bf3a1a640 1 Processor -- start 2024-09-19T08:53:48.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.409+0000 7f9bf3a1a640 1 -- start start 2024-09-19T08:53:48.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.410+0000 7f9bf3a1a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bec102d30 0x7f9bec1a0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.410+0000 7f9bf3a1a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9bec1036e0 0x7f9bec1a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.410+0000 7f9bf3a1a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9bec1082a0 0x7f9bec19a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.410+0000 7f9bf3a1a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9bec1120a0 con 0x7f9bec102d30 2024-09-19T08:53:48.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.410+0000 7f9bf3a1a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9bec111f20 con 0x7f9bec1082a0 2024-09-19T08:53:48.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.410+0000 7f9bf3a1a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9bec112220 con 0x7f9bec1036e0 2024-09-19T08:53:48.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.410+0000 7f9bf17b6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bec102d30 0x7f9bec1a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.410+0000 7f9bf17b6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bec102d30 0x7f9bec1a0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60214/0 (socket says 172.21.15.19:60214) 2024-09-19T08:53:48.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.410+0000 7f9bf17b6640 1 -- 172.21.15.19:0/2426827035 learned_addr learned my addr 172.21.15.19:0/2426827035 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:48.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.410+0000 7f9bf0fb5640 1 --2- 172.21.15.19:0/2426827035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9bec1036e0 0x7f9bec1a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.410+0000 7f9bf1fb7640 1 --2- 172.21.15.19:0/2426827035 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9bec1082a0 0x7f9bec19a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.410+0000 7f9bf17b6640 1 -- 172.21.15.19:0/2426827035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9bec1036e0 msgr2=0x7f9bec1a0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:48.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.410+0000 7f9bf17b6640 1 --2- 172.21.15.19:0/2426827035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9bec1036e0 0x7f9bec1a0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.410+0000 7f9bf17b6640 1 -- 172.21.15.19:0/2426827035 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9bec1082a0 msgr2=0x7f9bec19a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:48.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.410+0000 7f9bf17b6640 1 --2- 172.21.15.19:0/2426827035 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9bec1082a0 0x7f9bec19a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.410+0000 7f9bf17b6640 1 -- 172.21.15.19:0/2426827035 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bec19ad20 con 0x7f9bec102d30 2024-09-19T08:53:48.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.410+0000 7f9bf17b6640 1 --2- 172.21.15.19:0/2426827035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bec102d30 0x7f9bec1a0430 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc02ae00 tx=0x7f9bdc003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:48.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.411+0000 7f9bea7fc640 1 -- 172.21.15.19:0/2426827035 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc004240 con 0x7f9bec102d30 2024-09-19T08:53:48.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.411+0000 7f9bf3a1a640 1 -- 172.21.15.19:0/2426827035 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bec19afb0 con 0x7f9bec102d30 2024-09-19T08:53:48.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.411+0000 7f9bea7fc640 1 -- 172.21.15.19:0/2426827035 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bdc0305a0 con 0x7f9bec102d30 2024-09-19T08:53:48.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.411+0000 7f9bea7fc640 1 -- 172.21.15.19:0/2426827035 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc03a660 con 0x7f9bec102d30 2024-09-19T08:53:48.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.411+0000 7f9bf3a1a640 1 -- 172.21.15.19:0/2426827035 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bec1a7300 con 0x7f9bec102d30 2024-09-19T08:53:48.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.413+0000 7f9bea7fc640 1 -- 172.21.15.19:0/2426827035 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f9bdc030ac0 con 0x7f9bec102d30 2024-09-19T08:53:48.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.414+0000 7f9bea7fc640 1 --2- 172.21.15.19:0/2426827035 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9bd40a3240 0x7f9bd40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.414+0000 7f9bf0fb5640 1 --2- 172.21.15.19:0/2426827035 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9bd40a3240 0x7f9bd40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.414+0000 7f9bea7fc640 1 -- 172.21.15.19:0/2426827035 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9bdc02e030 con 0x7f9bec102d30 2024-09-19T08:53:48.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.414+0000 7f9bf0fb5640 1 --2- 172.21.15.19:0/2426827035 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9bd40a3240 0x7f9bd40a5700 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9bec102780 tx=0x7f9be000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:48.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.416+0000 7f5de0a97640 1 -- 172.21.15.19:0/2668693122 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ddc101400 msgr2=0x7f5ddc10d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:48.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.416+0000 7f5de0a97640 1 --2- 172.21.15.19:0/2668693122 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ddc101400 0x7f5ddc10d930 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4009cd0 tx=0x7f5dd402a8e0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.416+0000 7f5de0a97640 1 -- 172.21.15.19:0/2668693122 shutdown_connections 2024-09-19T08:53:48.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.416+0000 7f5de0a97640 1 --2- 172.21.15.19:0/2668693122 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ddc100a60 0x7f5ddc100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.416+0000 7f5de0a97640 1 --2- 172.21.15.19:0/2668693122 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ddc101400 0x7f5ddc10d930 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.416+0000 7f5de0a97640 1 --2- 172.21.15.19:0/2668693122 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ddc106a60 0x7f5ddc106e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.416+0000 7f5de0a97640 1 -- 172.21.15.19:0/2668693122 >> 172.21.15.19:0/2668693122 conn(0x7f5ddc0fc780 msgr2=0x7f5ddc0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:48.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.416+0000 7f5de0a97640 1 -- 172.21.15.19:0/2668693122 shutdown_connections 2024-09-19T08:53:48.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.416+0000 7f5de0a97640 1 -- 172.21.15.19:0/2668693122 wait complete. 2024-09-19T08:53:48.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.417+0000 7f5de0a97640 1 Processor -- start 2024-09-19T08:53:48.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.417+0000 7f5de0a97640 1 -- start start 2024-09-19T08:53:48.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.417+0000 7f5de0a97640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ddc100a60 0x7f5ddc197300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.417+0000 7f5de0a97640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ddc101400 0x7f5ddc197840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.417+0000 7f5de0a97640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ddc106a60 0x7f5ddc19bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.417+0000 7f5de0a97640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5ddc110e60 con 0x7f5ddc101400 2024-09-19T08:53:48.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.417+0000 7f5de0a97640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5ddc110ce0 con 0x7f5ddc106a60 2024-09-19T08:53:48.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.417+0000 7f5de0a97640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5ddc110fe0 con 0x7f5ddc100a60 2024-09-19T08:53:48.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.418+0000 7f5dd9d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ddc101400 0x7f5ddc197840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.418+0000 7f5dd9d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ddc101400 0x7f5ddc197840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60238/0 (socket says 172.21.15.19:60238) 2024-09-19T08:53:48.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.418+0000 7f5dd9d9b640 1 -- 172.21.15.19:0/46521260 learned_addr learned my addr 172.21.15.19:0/46521260 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:48.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.418+0000 7f5dda59c640 1 --2- 172.21.15.19:0/46521260 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ddc100a60 0x7f5ddc197300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.418+0000 7f5ddad9d640 1 --2- 172.21.15.19:0/46521260 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ddc106a60 0x7f5ddc19bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.418+0000 7f5dd9d9b640 1 -- 172.21.15.19:0/46521260 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ddc100a60 msgr2=0x7f5ddc197300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:48.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.418+0000 7f5dd9d9b640 1 --2- 172.21.15.19:0/46521260 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ddc100a60 0x7f5ddc197300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.418+0000 7f5dd9d9b640 1 -- 172.21.15.19:0/46521260 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ddc106a60 msgr2=0x7f5ddc19bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:48.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.418+0000 7f5dd9d9b640 1 --2- 172.21.15.19:0/46521260 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ddc106a60 0x7f5ddc19bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.418+0000 7f5dd9d9b640 1 -- 172.21.15.19:0/46521260 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ddc19c2b0 con 0x7f5ddc101400 2024-09-19T08:53:48.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.418+0000 7f5ddad9d640 1 --2- 172.21.15.19:0/46521260 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ddc106a60 0x7f5ddc19bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:53:48.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.418+0000 7f5dd9d9b640 1 --2- 172.21.15.19:0/46521260 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ddc101400 0x7f5ddc197840 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f5dd000d770 tx=0x7f5dd000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:48.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.418+0000 7f5dcb7fe640 1 -- 172.21.15.19:0/46521260 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd0017070 con 0x7f5ddc101400 2024-09-19T08:53:48.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.418+0000 7f5dcb7fe640 1 -- 172.21.15.19:0/46521260 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dd0005500 con 0x7f5ddc101400 2024-09-19T08:53:48.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.418+0000 7f5de0a97640 1 -- 172.21.15.19:0/46521260 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ddc19c5a0 con 0x7f5ddc101400 2024-09-19T08:53:48.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.418+0000 7f5dcb7fe640 1 -- 172.21.15.19:0/46521260 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd0004e00 con 0x7f5ddc101400 2024-09-19T08:53:48.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.419+0000 7f5de0a97640 1 -- 172.21.15.19:0/46521260 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ddc1a3e80 con 0x7f5ddc101400 2024-09-19T08:53:48.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.421+0000 7f5dcb7fe640 1 -- 172.21.15.19:0/46521260 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f5dd0004fa0 con 0x7f5ddc101400 2024-09-19T08:53:48.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.421+0000 7f5dcb7fe640 1 --2- 172.21.15.19:0/46521260 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5dc40a3240 0x7f5dc40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.422+0000 7f5dcb7fe640 1 -- 172.21.15.19:0/46521260 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5dd00cf3f0 con 0x7f5ddc101400 2024-09-19T08:53:48.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.422+0000 7f5dda59c640 1 --2- 172.21.15.19:0/46521260 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5dc40a3240 0x7f5dc40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.422+0000 7f5dda59c640 1 --2- 172.21.15.19:0/46521260 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5dc40a3240 0x7f5dc40a5700 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00bb60 tx=0x7f5dcc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:48.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.428+0000 7f5de2e70740 1 Processor -- start 2024-09-19T08:53:48.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.428+0000 7f9bf5df3740 1 Processor -- start 2024-09-19T08:53:48.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.428+0000 7f5de2e70740 1 -- start start 2024-09-19T08:53:48.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.428+0000 7f9bf5df3740 1 -- start start 2024-09-19T08:53:48.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.428+0000 7f5de2e70740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648e6877ee0 0x5648e68766d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.428+0000 7f5de2e70740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e6876ca0 0x5648e6877100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.428+0000 7f5de2e70740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648e6885af0 0x5648e6887f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.428+0000 7f5de2e70740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5648e67db160 con 0x5648e6876ca0 2024-09-19T08:53:48.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.428+0000 7f5de2e70740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5648e6782720 con 0x5648e6877ee0 2024-09-19T08:53:48.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.428+0000 7f5de2e70740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5648e67d7120 con 0x5648e6885af0 2024-09-19T08:53:48.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.428+0000 7f9bf5df3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55daec5114a0 0x55daec511880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.428+0000 7f9bf5df3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55daec511dc0 0x55daec51c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.428+0000 7f9bf5df3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55daec51c680 0x55daec51ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.428+0000 7f9bf5df3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55daec4772e0 con 0x55daec5114a0 2024-09-19T08:53:48.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.428+0000 7f9bf5df3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55daec41ece0 con 0x55daec51c680 2024-09-19T08:53:48.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.428+0000 7f9bf5df3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55daec4732a0 con 0x55daec511dc0 2024-09-19T08:53:48.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.428+0000 7f5dd9d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e6876ca0 0x5648e6877100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.428+0000 7f9bf17b6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55daec5114a0 0x55daec511880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.428+0000 7f5dda59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648e6877ee0 0x5648e68766d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.428+0000 7f5dd9d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e6876ca0 0x5648e6877100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60244/0 (socket says 172.21.15.19:60244) 2024-09-19T08:53:48.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.428+0000 7f5dd9d9b640 1 -- 172.21.15.19:0/1685091233 learned_addr learned my addr 172.21.15.19:0/1685091233 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:48.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.428+0000 7f9bf17b6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55daec5114a0 0x55daec511880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60258/0 (socket says 172.21.15.19:60258) 2024-09-19T08:53:48.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.428+0000 7f9bf17b6640 1 -- 172.21.15.19:0/2602484664 learned_addr learned my addr 172.21.15.19:0/2602484664 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:48.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.428+0000 7f9bf0fb5640 1 --2- 172.21.15.19:0/2602484664 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55daec511dc0 0x55daec51c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.428+0000 7f5ddad9d640 1 --2- 172.21.15.19:0/1685091233 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648e6885af0 0x5648e6887f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.429+0000 7f9bf1fb7640 1 --2- 172.21.15.19:0/2602484664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55daec51c680 0x55daec51ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.429+0000 7f5dda59c640 1 -- 172.21.15.19:0/1685091233 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648e6885af0 msgr2=0x5648e6887f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:48.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.429+0000 7f9bf0fb5640 1 -- 172.21.15.19:0/2602484664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55daec51c680 msgr2=0x55daec51ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:48.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.429+0000 7f9bf0fb5640 1 --2- 172.21.15.19:0/2602484664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55daec51c680 0x55daec51ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.429+0000 7f9bf0fb5640 1 -- 172.21.15.19:0/2602484664 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55daec5114a0 msgr2=0x55daec511880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:48.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.429+0000 7f5dda59c640 1 --2- 172.21.15.19:0/1685091233 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648e6885af0 0x5648e6887f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.429+0000 7f5dda59c640 1 -- 172.21.15.19:0/1685091233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e6876ca0 msgr2=0x5648e6877100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:48.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.429+0000 7f5dda59c640 1 --2- 172.21.15.19:0/1685091233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e6876ca0 0x5648e6877100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.429+0000 7f5dda59c640 1 -- 172.21.15.19:0/1685091233 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648e654cba0 con 0x5648e6877ee0 2024-09-19T08:53:48.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.429+0000 7f5dd9d9b640 1 --2- 172.21.15.19:0/1685091233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e6876ca0 0x5648e6877100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:53:48.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.429+0000 7f9bf0fb5640 1 --2- 172.21.15.19:0/2602484664 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55daec5114a0 0x55daec511880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.429+0000 7f9bf0fb5640 1 -- 172.21.15.19:0/2602484664 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55daec403440 con 0x55daec511dc0 2024-09-19T08:53:48.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.429+0000 7f5ddad9d640 1 --2- 172.21.15.19:0/1685091233 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648e6885af0 0x5648e6887f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:53:48.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.429+0000 7f5dda59c640 1 --2- 172.21.15.19:0/1685091233 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648e6877ee0 0x5648e68766d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00b940 tx=0x7f5dcc013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=128bd885ec397d69 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:48.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.429+0000 7f9bf0fb5640 1 --2- 172.21.15.19:0/2602484664 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55daec511dc0 0x55daec51c140 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9be00058c0 tx=0x7f9be0012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=684d75ef49bf1751 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:48.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.429+0000 7f5dc8ff9640 1 -- 172.21.15.19:0/1685091233 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc005220 con 0x5648e6877ee0 2024-09-19T08:53:48.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.429+0000 7f9bd37fe640 1 -- 172.21.15.19:0/2602484664 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be0016070 con 0x55daec511dc0 2024-09-19T08:53:48.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.429+0000 7f5dc8ff9640 1 -- 172.21.15.19:0/1685091233 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dcc011e50 con 0x5648e6877ee0 2024-09-19T08:53:48.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.430+0000 7f5dc8ff9640 1 -- 172.21.15.19:0/1685091233 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc01e7c0 con 0x5648e6877ee0 2024-09-19T08:53:48.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.430+0000 7f9bd37fe640 1 -- 172.21.15.19:0/2602484664 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9be0010e10 con 0x55daec511dc0 2024-09-19T08:53:48.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.430+0000 7f9bd37fe640 1 -- 172.21.15.19:0/2602484664 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be001c760 con 0x55daec511dc0 2024-09-19T08:53:48.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.430+0000 7f5de2e70740 1 -- 172.21.15.19:0/1685091233 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648e6877ee0 msgr2=0x5648e68766d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:48.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.430+0000 7f5de2e70740 1 --2- 172.21.15.19:0/1685091233 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648e6877ee0 0x5648e68766d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00b940 tx=0x7f5dcc013000 comp rx=0 tx=0).stop 2024-09-19T08:53:48.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.430+0000 7f5de2e70740 1 -- 172.21.15.19:0/1685091233 shutdown_connections 2024-09-19T08:53:48.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.430+0000 7f5de2e70740 1 --2- 172.21.15.19:0/1685091233 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648e6885af0 0x5648e6887f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.430+0000 7f5de2e70740 1 --2- 172.21.15.19:0/1685091233 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e6876ca0 0x5648e6877100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.430+0000 7f5de2e70740 1 --2- 172.21.15.19:0/1685091233 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648e6877ee0 0x5648e68766d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.430+0000 7f5de2e70740 1 -- 172.21.15.19:0/1685091233 >> 172.21.15.19:0/1685091233 conn(0x5648e6872de0 msgr2=0x5648e68731c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:48.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.430+0000 7f9bf5df3740 1 -- 172.21.15.19:0/2602484664 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55daec511dc0 msgr2=0x55daec51c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:48.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.430+0000 7f9bf5df3740 1 --2- 172.21.15.19:0/2602484664 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55daec511dc0 0x55daec51c140 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9be00058c0 tx=0x7f9be0012000 comp rx=0 tx=0).stop 2024-09-19T08:53:48.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.430+0000 7f9bf5df3740 1 -- 172.21.15.19:0/2602484664 shutdown_connections 2024-09-19T08:53:48.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.430+0000 7f5de2e70740 1 -- 172.21.15.19:0/1685091233 shutdown_connections 2024-09-19T08:53:48.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.430+0000 7f9bf5df3740 1 --2- 172.21.15.19:0/2602484664 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55daec511dc0 0x55daec51c140 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.430+0000 7f9bf5df3740 1 --2- 172.21.15.19:0/2602484664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55daec51c680 0x55daec51ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.430+0000 7f9bf5df3740 1 --2- 172.21.15.19:0/2602484664 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55daec5114a0 0x55daec511880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.430+0000 7f9bf5df3740 1 -- 172.21.15.19:0/2602484664 >> 172.21.15.19:0/2602484664 conn(0x55daec50da30 msgr2=0x55daec50de10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:48.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.430+0000 7f5de2e70740 1 -- 172.21.15.19:0/1685091233 wait complete. 2024-09-19T08:53:48.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.431+0000 7f9bf5df3740 1 -- 172.21.15.19:0/2602484664 shutdown_connections 2024-09-19T08:53:48.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.431+0000 7f9bf5df3740 1 -- 172.21.15.19:0/2602484664 wait complete. 2024-09-19T08:53:48.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.431+0000 7f5de2e70740 1 -- start start 2024-09-19T08:53:48.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.431+0000 7f9bf5df3740 1 -- start start 2024-09-19T08:53:48.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.431+0000 7f5de2e70740 1 Processor -- start 2024-09-19T08:53:48.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.431+0000 7f9bf5df3740 1 Processor -- start 2024-09-19T08:53:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.431+0000 7f5de2e70740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e6876ca0 0x5648e68853a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.431+0000 7f5de2e70740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648e6877ee0 0x5648e687e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.431+0000 7f5de2e70740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648e6885af0 0x5648e687eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.431+0000 7f5de2e70740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5648e6888a20 con 0x5648e6876ca0 2024-09-19T08:53:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.431+0000 7f5de2e70740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5648e6763900 con 0x5648e6877ee0 2024-09-19T08:53:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.431+0000 7f5de2e70740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5648e6888ba0 con 0x5648e6885af0 2024-09-19T08:53:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.431+0000 7f5de2e70740 10 client.0 _ll_register_callbacks cb 0x5648e6761780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.431+0000 7f5dda59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e6876ca0 0x5648e68853a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.431+0000 7f5dda59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e6876ca0 0x5648e68853a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60268/0 (socket says 172.21.15.19:60268) 2024-09-19T08:53:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.431+0000 7f5dda59c640 1 -- 172.21.15.19:0/1469427699 learned_addr learned my addr 172.21.15.19:0/1469427699 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:48.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.432+0000 7f5ddad9d640 1 --2- 172.21.15.19:0/1469427699 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648e6885af0 0x5648e687eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.432+0000 7f5dd9d9b640 1 --2- 172.21.15.19:0/1469427699 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648e6877ee0 0x5648e687e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.432+0000 7f9bf5df3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55daec5114a0 0x55daec51c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.432+0000 7f9bf5df3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55daec511dc0 0x55daec5192d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.432+0000 7f9bf5df3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55daec51c680 0x55daec519870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.432+0000 7f9bf5df3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55daec51f250 con 0x55daec5114a0 2024-09-19T08:53:48.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.432+0000 7f9bf5df3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55daec432050 con 0x55daec511dc0 2024-09-19T08:53:48.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.432+0000 7f9bf5df3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55daec51f3d0 con 0x55daec51c680 2024-09-19T08:53:48.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.432+0000 7f9bf5df3740 10 client.0 _ll_register_callbacks cb 0x55daec472160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:48.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.432+0000 7f5dda59c640 1 -- 172.21.15.19:0/1469427699 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648e6885af0 msgr2=0x5648e687eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:48.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.432+0000 7f5dda59c640 1 --2- 172.21.15.19:0/1469427699 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648e6885af0 0x5648e687eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.432+0000 7f5dda59c640 1 -- 172.21.15.19:0/1469427699 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648e6877ee0 msgr2=0x5648e687e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:48.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.432+0000 7f5dda59c640 1 --2- 172.21.15.19:0/1469427699 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648e6877ee0 0x5648e687e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.432+0000 7f9bf0fb5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55daec511dc0 0x55daec5192d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.432+0000 7f5dda59c640 1 -- 172.21.15.19:0/1469427699 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648e67a3c50 con 0x5648e6876ca0 2024-09-19T08:53:48.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.432+0000 7f9bf0fb5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55daec511dc0 0x55daec5192d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:54688/0 (socket says 172.21.15.19:54688) 2024-09-19T08:53:48.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.432+0000 7f9bf0fb5640 1 -- 172.21.15.19:0/1209766130 learned_addr learned my addr 172.21.15.19:0/1209766130 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:48.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.432+0000 7f9bf17b6640 1 --2- 172.21.15.19:0/1209766130 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55daec5114a0 0x55daec51c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.432+0000 7f5dda59c640 1 --2- 172.21.15.19:0/1469427699 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e6876ca0 0x5648e68853a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc01f7c0 tx=0x7f5dcc00b5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60da47afb1c932d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:48.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.432+0000 7f9bf1fb7640 1 --2- 172.21.15.19:0/1209766130 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55daec51c680 0x55daec519870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.432+0000 7f5dc1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:53:48.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.432+0000 7f5dc1ffb640 1 -- 172.21.15.19:0/1469427699 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc036060 con 0x5648e6876ca0 2024-09-19T08:53:48.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.432+0000 7f5de2e70740 1 -- 172.21.15.19:0/1469427699 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5dcc011e50 con 0x5648e6876ca0 2024-09-19T08:53:48.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.432+0000 7f5dc1ffb640 1 -- 172.21.15.19:0/1469427699 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5dcc01fdb0 con 0x5648e6876ca0 2024-09-19T08:53:48.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.432+0000 7f9bf0fb5640 1 -- 172.21.15.19:0/1209766130 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55daec51c680 msgr2=0x55daec519870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:48.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.432+0000 7f9bf0fb5640 1 --2- 172.21.15.19:0/1209766130 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55daec51c680 0x55daec519870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.432+0000 7f9bf0fb5640 1 -- 172.21.15.19:0/1209766130 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55daec5114a0 msgr2=0x55daec51c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:48.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.433+0000 7f5dc1ffb640 1 -- 172.21.15.19:0/1469427699 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5dcc031400 con 0x5648e6876ca0 2024-09-19T08:53:48.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.432+0000 7f9bf0fb5640 1 --2- 172.21.15.19:0/1209766130 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55daec5114a0 0x55daec51c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.433+0000 7f5de2e70740 10 client.15786 fetch_fsmap learned FSMap version 30 2024-09-19T08:53:48.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.433+0000 7f5de2e70740 1 -- 172.21.15.19:0/1469427699 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5648e6898d00 con 0x5648e6876ca0 2024-09-19T08:53:48.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.432+0000 7f9bf0fb5640 1 -- 172.21.15.19:0/1209766130 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55daec1e83c0 con 0x55daec511dc0 2024-09-19T08:53:48.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.433+0000 7f9bf0fb5640 1 --2- 172.21.15.19:0/1209766130 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55daec511dc0 0x55daec5192d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9be001c460 tx=0x7f9be0005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87d7ea06c12d5043 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:48.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.433+0000 7f9bd0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T08:53:48.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.433+0000 7f9bf17b6640 1 --2- 172.21.15.19:0/1209766130 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55daec5114a0 0x55daec51c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:53:48.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.433+0000 7f5dc1ffb640 1 -- 172.21.15.19:0/1469427699 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dcc011e50 con 0x5648e6876ca0 2024-09-19T08:53:48.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.433+0000 7f9bd0ff9640 1 -- 172.21.15.19:0/1209766130 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9be002a040 con 0x55daec511dc0 2024-09-19T08:53:48.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.433+0000 7f9bf5df3740 1 -- 172.21.15.19:0/1209766130 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9be0010e10 con 0x55daec511dc0 2024-09-19T08:53:48.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.433+0000 7f5dc1ffb640 1 -- 172.21.15.19:0/1469427699 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f5dcc0265c0 con 0x5648e6876ca0 2024-09-19T08:53:48.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.433+0000 7f9bd0ff9640 1 -- 172.21.15.19:0/1209766130 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9be00046c0 con 0x55daec511dc0 2024-09-19T08:53:48.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.433+0000 7f5de2e70740 10 client.15786 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T08:53:48.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.433+0000 7f5de2e70740 10 client.15786 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T08:53:48.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.433+0000 7f5de2e70740 20 client.15786 populate_metadata read hostname 'smithi019' 2024-09-19T08:53:48.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.433+0000 7f5de2e70740 1 --2- 172.21.15.19:0/1469427699 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5648e689a050 0x5648e689c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.433+0000 7f5de2e70740 4 client.15786 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:53:48.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.433+0000 7f5de2e70740 1 -- 172.21.15.19:0/1469427699 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648e67e8890 con 0x5648e689a050 2024-09-19T08:53:48.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.433+0000 7f9bd0ff9640 1 -- 172.21.15.19:0/1209766130 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9be00048c0 con 0x55daec511dc0 2024-09-19T08:53:48.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.433+0000 7f9bf5df3740 10 client.25385 fetch_fsmap learned FSMap version 30 2024-09-19T08:53:48.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.433+0000 7f9bf5df3740 1 -- 172.21.15.19:0/1209766130 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55daec52ac60 con 0x55daec511dc0 2024-09-19T08:53:48.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.434+0000 7f5dd9d9b640 1 --2- 172.21.15.19:0/1469427699 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5648e689a050 0x5648e689c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.434+0000 7f9bd0ff9640 1 -- 172.21.15.19:0/1209766130 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9be0010e10 con 0x55daec511dc0 2024-09-19T08:53:48.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.434+0000 7f5dc1ffb640 10 client.15786 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:48.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.434+0000 7f9bd0ff9640 1 -- 172.21.15.19:0/1209766130 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f9be002d070 con 0x55daec511dc0 2024-09-19T08:53:48.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.434+0000 7f9bf5df3740 10 client.25385 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T08:53:48.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.434+0000 7f9bf5df3740 10 client.25385 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:53:48.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.434+0000 7f9bf5df3740 20 client.25385 populate_metadata read hostname 'smithi019' 2024-09-19T08:53:48.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.434+0000 7f9bf5df3740 1 --2- 172.21.15.19:0/1209766130 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55daec52c0c0 0x55daec52e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.434+0000 7f9bf5df3740 4 client.25385 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:53:48.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.434+0000 7f9bf5df3740 1 -- 172.21.15.19:0/1209766130 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55daec484850 con 0x55daec52c0c0 2024-09-19T08:53:48.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.434+0000 7f9bf17b6640 1 --2- 172.21.15.19:0/1209766130 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55daec52c0c0 0x55daec52e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.434+0000 7f5dd9d9b640 1 --2- 172.21.15.19:0/1469427699 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5648e689a050 0x5648e689c440 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c3a072a9a72db1a server_cookie=f526e2994335da79 in_seq=0 out_seq=0 2024-09-19T08:53:48.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.435+0000 7f9bf17b6640 1 --2- 172.21.15.19:0/1209766130 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55daec52c0c0 0x55daec52e4b0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=282ba951f4449435 server_cookie=7a80af8dc30a2ef3 in_seq=0 out_seq=0 2024-09-19T08:53:48.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.435+0000 7f9bd0ff9640 10 client.25385 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:48.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.435+0000 7f5dc1ffb640 1 -- 172.21.15.19:0/1469427699 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5648e67e8890 con 0x5648e689a050 2024-09-19T08:53:48.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.435+0000 7f5dc1ffb640 10 client.15786 handle_command_reply: tid=0 2024-09-19T08:53:48.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.435+0000 7f5de2e70740 1 client.15786 shutdown 2024-09-19T08:53:48.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.435+0000 7f5de2e70740 1 -- 172.21.15.19:0/1469427699 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e6876ca0 msgr2=0x5648e68853a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:48.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.435+0000 7f5de2e70740 1 --2- 172.21.15.19:0/1469427699 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e6876ca0 0x5648e68853a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc01f7c0 tx=0x7f5dcc00b5e0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.435+0000 7f5de2e70740 1 -- 172.21.15.19:0/1469427699 shutdown_connections 2024-09-19T08:53:48.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.435+0000 7f5de2e70740 1 --2- 172.21.15.19:0/1469427699 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5648e689a050 0x5648e689c440 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.435+0000 7f5dc1ffb640 0 client.15786 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:48.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.435+0000 7f5de2e70740 1 --2- 172.21.15.19:0/1469427699 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648e6885af0 0x5648e687eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.435+0000 7f5de2e70740 1 --2- 172.21.15.19:0/1469427699 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648e6877ee0 0x5648e687e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.435+0000 7f5de2e70740 1 --2- 172.21.15.19:0/1469427699 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e6876ca0 0x5648e68853a0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.435+0000 7f5de2e70740 1 -- 172.21.15.19:0/1469427699 >> 172.21.15.19:0/1469427699 conn(0x5648e6872de0 msgr2=0x5648e6878b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:48.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.435+0000 7f9bd0ff9640 1 -- 172.21.15.19:0/1209766130 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55daec484850 con 0x55daec52c0c0 2024-09-19T08:53:48.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.435+0000 7f9bd0ff9640 10 client.25385 handle_command_reply: tid=0 2024-09-19T08:53:48.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.436+0000 7f5de2e70740 1 -- 172.21.15.19:0/1469427699 shutdown_connections 2024-09-19T08:53:48.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.436+0000 7f9bf5df3740 1 client.25385 shutdown 2024-09-19T08:53:48.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.436+0000 7f5de2e70740 1 -- 172.21.15.19:0/1469427699 wait complete. 2024-09-19T08:53:48.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.436+0000 7f5de2e70740 20 client.15786 trim_cache size 0 max 16384 2024-09-19T08:53:48.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.436+0000 7f9bf5df3740 1 -- 172.21.15.19:0/1209766130 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55daec511dc0 msgr2=0x55daec5192d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:48.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.436+0000 7f9bf5df3740 1 --2- 172.21.15.19:0/1209766130 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55daec511dc0 0x55daec5192d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9be001c460 tx=0x7f9be0005270 comp rx=0 tx=0).stop 2024-09-19T08:53:48.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.436+0000 7f9bf5df3740 1 -- 172.21.15.19:0/1209766130 shutdown_connections 2024-09-19T08:53:48.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.436+0000 7f9bf5df3740 1 --2- 172.21.15.19:0/1209766130 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55daec52c0c0 0x55daec52e4b0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.436+0000 7f9bf5df3740 1 --2- 172.21.15.19:0/1209766130 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55daec51c680 0x55daec519870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.436+0000 7f9bf5df3740 1 --2- 172.21.15.19:0/1209766130 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55daec511dc0 0x55daec5192d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.436+0000 7f9bf5df3740 1 --2- 172.21.15.19:0/1209766130 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55daec5114a0 0x55daec51c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.436+0000 7f9bd0ff9640 0 client.25385 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:48.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.436+0000 7f9bf5df3740 1 -- 172.21.15.19:0/1209766130 >> 172.21.15.19:0/1209766130 conn(0x55daec50da30 msgr2=0x55daec513760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:48.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.436+0000 7f9bf5df3740 1 -- 172.21.15.19:0/1209766130 shutdown_connections 2024-09-19T08:53:48.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.436+0000 7f9bf5df3740 1 -- 172.21.15.19:0/1209766130 wait complete. 2024-09-19T08:53:48.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.436+0000 7f9bf5df3740 20 client.25385 trim_cache size 0 max 16384 2024-09-19T08:53:48.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.453+0000 7f5de2e70740 1 Processor -- start 2024-09-19T08:53:48.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.453+0000 7f5de2e70740 1 -- start start 2024-09-19T08:53:48.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.453+0000 7f5de2e70740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e6876ca0 0x5648e686dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.453+0000 7f5de2e70740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648e6877ee0 0x5648e6871db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.453+0000 7f5de2e70740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648e6885af0 0x5648e68722f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.453+0000 7f5de2e70740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5ddc1ab3d0 con 0x5648e6876ca0 2024-09-19T08:53:48.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.453+0000 7f5de2e70740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5ddc1acfd0 con 0x5648e6877ee0 2024-09-19T08:53:48.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.453+0000 7f5de2e70740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5ddc1abaa0 con 0x5648e6885af0 2024-09-19T08:53:48.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.453+0000 7f5dda59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e6876ca0 0x5648e686dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.453+0000 7f5dda59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e6876ca0 0x5648e686dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60274/0 (socket says 172.21.15.19:60274) 2024-09-19T08:53:48.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.453+0000 7f5dda59c640 1 -- 172.21.15.19:0/883838497 learned_addr learned my addr 172.21.15.19:0/883838497 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:48.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.453+0000 7f9bf5df3740 1 Processor -- start 2024-09-19T08:53:48.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.453+0000 7f9bf5df3740 1 -- start start 2024-09-19T08:53:48.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.453+0000 7f5dd9d9b640 1 --2- 172.21.15.19:0/883838497 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648e6877ee0 0x5648e6871db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.454+0000 7f5ddad9d640 1 --2- 172.21.15.19:0/883838497 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648e6885af0 0x5648e68722f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.454+0000 7f5dda59c640 1 -- 172.21.15.19:0/883838497 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648e6885af0 msgr2=0x5648e68722f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:48.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.454+0000 7f5dda59c640 1 --2- 172.21.15.19:0/883838497 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648e6885af0 0x5648e68722f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.454+0000 7f5dda59c640 1 -- 172.21.15.19:0/883838497 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648e6877ee0 msgr2=0x5648e6871db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:48.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.454+0000 7f5dda59c640 1 --2- 172.21.15.19:0/883838497 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648e6877ee0 0x5648e6871db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.454+0000 7f5dda59c640 1 -- 172.21.15.19:0/883838497 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648e687d600 con 0x5648e6876ca0 2024-09-19T08:53:48.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.454+0000 7f9bf5df3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55daec5114a0 0x55daec5284b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.454+0000 7f5ddad9d640 1 --2- 172.21.15.19:0/883838497 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648e6885af0 0x5648e68722f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:53:48.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.454+0000 7f9bf5df3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55daec511dc0 0x55daec533bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.454+0000 7f9bf5df3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55daec51c680 0x55daec534110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.454+0000 7f9bf5df3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9bec1af760 con 0x55daec5114a0 2024-09-19T08:53:48.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.454+0000 7f9bf5df3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9bec1b1360 con 0x55daec511dc0 2024-09-19T08:53:48.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.454+0000 7f9bf5df3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9bec1afe30 con 0x55daec51c680 2024-09-19T08:53:48.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.454+0000 7f5dda59c640 1 --2- 172.21.15.19:0/883838497 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e6876ca0 0x5648e686dd30 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc026ba0 tx=0x7f5dcc005950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5125ad63bcccc6e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:48.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.454+0000 7f9bf17b6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55daec5114a0 0x55daec5284b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.454+0000 7f9bf0fb5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55daec511dc0 0x55daec533bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.454+0000 7f9bf17b6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55daec5114a0 0x55daec5284b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60280/0 (socket says 172.21.15.19:60280) 2024-09-19T08:53:48.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.454+0000 7f9bf17b6640 1 -- 172.21.15.19:0/322232493 learned_addr learned my addr 172.21.15.19:0/322232493 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:48.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.454+0000 7f9bf1fb7640 1 --2- 172.21.15.19:0/322232493 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55daec51c680 0x55daec534110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.454+0000 7f5dc3fff640 1 -- 172.21.15.19:0/883838497 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc041020 con 0x5648e6876ca0 2024-09-19T08:53:48.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.454+0000 7f5dc3fff640 1 -- 172.21.15.19:0/883838497 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dcc011ca0 con 0x5648e6876ca0 2024-09-19T08:53:48.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.454+0000 7f5dc3fff640 1 -- 172.21.15.19:0/883838497 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc036070 con 0x5648e6876ca0 2024-09-19T08:53:48.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.454+0000 7f9bf17b6640 1 -- 172.21.15.19:0/322232493 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55daec51c680 msgr2=0x55daec534110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:48.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.454+0000 7f9bf17b6640 1 --2- 172.21.15.19:0/322232493 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55daec51c680 0x55daec534110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.454+0000 7f9bf17b6640 1 -- 172.21.15.19:0/322232493 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55daec511dc0 msgr2=0x55daec533bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:48.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.454+0000 7f9bf17b6640 1 --2- 172.21.15.19:0/322232493 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55daec511dc0 0x55daec533bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.454+0000 7f9bf17b6640 1 -- 172.21.15.19:0/322232493 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55daec519be0 con 0x55daec5114a0 2024-09-19T08:53:48.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.454+0000 7f9bf1fb7640 1 --2- 172.21.15.19:0/322232493 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55daec51c680 0x55daec534110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:53:48.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.455+0000 7f9bf17b6640 1 --2- 172.21.15.19:0/322232493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55daec5114a0 0x55daec5284b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc0ee270 tx=0x7f9bdc03d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11402d1853a0e5ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:48.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.455+0000 7f9bd2ffd640 1 -- 172.21.15.19:0/322232493 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc0c10f0 con 0x55daec5114a0 2024-09-19T08:53:48.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.455+0000 7f9bd2ffd640 1 -- 172.21.15.19:0/322232493 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bdc0d9070 con 0x55daec5114a0 2024-09-19T08:53:48.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.455+0000 7f9bd2ffd640 1 -- 172.21.15.19:0/322232493 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc0bc190 con 0x55daec5114a0 2024-09-19T08:53:48.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.455+0000 7f5de2e70740 1 -- 172.21.15.19:0/883838497 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e6876ca0 msgr2=0x5648e686dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:48.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.455+0000 7f5de2e70740 1 --2- 172.21.15.19:0/883838497 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e6876ca0 0x5648e686dd30 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc026ba0 tx=0x7f5dcc005950 comp rx=0 tx=0).stop 2024-09-19T08:53:48.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.455+0000 7f5de2e70740 1 -- 172.21.15.19:0/883838497 shutdown_connections 2024-09-19T08:53:48.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.455+0000 7f5de2e70740 1 --2- 172.21.15.19:0/883838497 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648e6885af0 0x5648e68722f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.455+0000 7f5de2e70740 1 --2- 172.21.15.19:0/883838497 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648e6877ee0 0x5648e6871db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.455+0000 7f5de2e70740 1 --2- 172.21.15.19:0/883838497 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e6876ca0 0x5648e686dd30 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.455+0000 7f5de2e70740 1 -- 172.21.15.19:0/883838497 >> 172.21.15.19:0/883838497 conn(0x5648e6872de0 msgr2=0x5648e68716a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:48.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.456+0000 7f5de2e70740 1 -- 172.21.15.19:0/883838497 shutdown_connections 2024-09-19T08:53:48.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.456+0000 7f5de2e70740 1 -- 172.21.15.19:0/883838497 wait complete. 2024-09-19T08:53:48.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.456+0000 7f9bf5df3740 1 -- 172.21.15.19:0/322232493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55daec5114a0 msgr2=0x55daec5284b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:48.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.456+0000 7f9bf5df3740 1 --2- 172.21.15.19:0/322232493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55daec5114a0 0x55daec5284b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc0ee270 tx=0x7f9bdc03d040 comp rx=0 tx=0).stop 2024-09-19T08:53:48.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.456+0000 7f9bf5df3740 1 -- 172.21.15.19:0/322232493 shutdown_connections 2024-09-19T08:53:48.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.456+0000 7f9bf5df3740 1 --2- 172.21.15.19:0/322232493 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55daec51c680 0x55daec534110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.456+0000 7f9bf5df3740 1 --2- 172.21.15.19:0/322232493 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55daec511dc0 0x55daec533bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.456+0000 7f9bf5df3740 1 --2- 172.21.15.19:0/322232493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55daec5114a0 0x55daec5284b0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.456+0000 7f9bf5df3740 1 -- 172.21.15.19:0/322232493 >> 172.21.15.19:0/322232493 conn(0x55daec50da30 msgr2=0x55daec514850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:48.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.456+0000 7f9bf5df3740 1 -- 172.21.15.19:0/322232493 shutdown_connections 2024-09-19T08:53:48.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.456+0000 7f9bf5df3740 1 -- 172.21.15.19:0/322232493 wait complete. 2024-09-19T08:53:48.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.456+0000 7f5de2e70740 1 -- start start 2024-09-19T08:53:48.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.456+0000 7f9bf5df3740 1 -- start start 2024-09-19T08:53:48.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.456+0000 7f5de2e70740 1 Processor -- start 2024-09-19T08:53:48.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.456+0000 7f9bf5df3740 1 Processor -- start 2024-09-19T08:53:48.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.457+0000 7f5de2e70740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648e6876ca0 0x5648e6897100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.457+0000 7f5de2e70740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648e6877ee0 0x5648e6892430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.457+0000 7f5de2e70740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e6885af0 0x5648e6892bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.457+0000 7f5de2e70740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5ddc1ac840 con 0x5648e6885af0 2024-09-19T08:53:48.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.457+0000 7f5de2e70740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5ddc1ac170 con 0x5648e6877ee0 2024-09-19T08:53:48.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.457+0000 7f5de2e70740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5ddc1a93b0 con 0x5648e6876ca0 2024-09-19T08:53:48.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.457+0000 7f5ddad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e6885af0 0x5648e6892bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.457+0000 7f5ddad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e6885af0 0x5648e6892bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60286/0 (socket says 172.21.15.19:60286) 2024-09-19T08:53:48.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.457+0000 7f5ddad9d640 1 -- 172.21.15.19:0/2205987434 learned_addr learned my addr 172.21.15.19:0/2205987434 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:48.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.457+0000 7f5dda59c640 1 --2- 172.21.15.19:0/2205987434 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648e6876ca0 0x5648e6897100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.457+0000 7f5de2e70740 10 client.0 _ll_register_callbacks cb 0x7f5dd0097c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:48.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.457+0000 7f5dd9d9b640 1 --2- 172.21.15.19:0/2205987434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648e6877ee0 0x5648e6892430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.457+0000 7f9bf5df3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55daec5114a0 0x55daec520a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.457+0000 7f9bf5df3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55daec511dc0 0x55daec520f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.457+0000 7f5ddad9d640 1 -- 172.21.15.19:0/2205987434 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648e6876ca0 msgr2=0x5648e6897100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:48.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.457+0000 7f5ddad9d640 1 --2- 172.21.15.19:0/2205987434 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648e6876ca0 0x5648e6897100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.458+0000 7f5ddad9d640 1 -- 172.21.15.19:0/2205987434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648e6877ee0 msgr2=0x5648e6892430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:48.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.458+0000 7f5ddad9d640 1 --2- 172.21.15.19:0/2205987434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648e6877ee0 0x5648e6892430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.458+0000 7f5ddad9d640 1 -- 172.21.15.19:0/2205987434 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648e6903b00 con 0x5648e6885af0 2024-09-19T08:53:48.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.458+0000 7f5dda59c640 1 --2- 172.21.15.19:0/2205987434 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648e6876ca0 0x5648e6897100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:53:48.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.458+0000 7f9bf5df3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55daec51c680 0x55daec595ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.458+0000 7f9bf5df3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9bec1b0bd0 con 0x55daec5114a0 2024-09-19T08:53:48.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.458+0000 7f9bf0fb5640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55daec511dc0 0x55daec520f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.458+0000 7f9bf0fb5640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55daec511dc0 0x55daec520f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:43850/0 (socket says 172.21.15.19:43850) 2024-09-19T08:53:48.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.458+0000 7f9bf0fb5640 1 -- 172.21.15.19:0/2017278428 learned_addr learned my addr 172.21.15.19:0/2017278428 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:48.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.458+0000 7f5ddad9d640 1 --2- 172.21.15.19:0/2205987434 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e6885af0 0x5648e6892bc0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4009cd0 tx=0x7f5dd4031b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b85af115d3bf409 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:48.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.458+0000 7f9bf1fb7640 1 --2- 172.21.15.19:0/2017278428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55daec51c680 0x55daec595ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.458+0000 7f5dc1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:53:48.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.458+0000 7f9bf5df3740 1 -- 172.21.15.19:0/2017278428 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9bec1b0500 con 0x55daec51c680 2024-09-19T08:53:48.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.458+0000 7f5dc1ffb640 1 -- 172.21.15.19:0/2205987434 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd4003b70 con 0x5648e6885af0 2024-09-19T08:53:48.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.458+0000 7f9bf17b6640 1 --2- 172.21.15.19:0/2017278428 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55daec5114a0 0x55daec520a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.458+0000 7f9bf5df3740 1 -- 172.21.15.19:0/2017278428 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9bec1ad740 con 0x55daec511dc0 2024-09-19T08:53:48.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.458+0000 7f5de2e70740 1 -- 172.21.15.19:0/2205987434 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5dcc011ca0 con 0x5648e6885af0 2024-09-19T08:53:48.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.458+0000 7f5dc1ffb640 1 -- 172.21.15.19:0/2205987434 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5dd4003d10 con 0x5648e6885af0 2024-09-19T08:53:48.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.458+0000 7f9bf5df3740 10 client.0 _ll_register_callbacks cb 0x7f9bdc0b8940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:48.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.458+0000 7f5dc1ffb640 1 -- 172.21.15.19:0/2205987434 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5dd4004040 con 0x5648e6885af0 2024-09-19T08:53:48.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.459+0000 7f5de2e70740 10 client.15798 fetch_fsmap learned FSMap version 30 2024-09-19T08:53:48.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.459+0000 7f5de2e70740 1 -- 172.21.15.19:0/2205987434 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5648e6904c00 con 0x5648e6885af0 2024-09-19T08:53:48.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.459+0000 7f9bf17b6640 1 -- 172.21.15.19:0/2017278428 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55daec511dc0 msgr2=0x55daec520f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:48.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.459+0000 7f9bf17b6640 1 --2- 172.21.15.19:0/2017278428 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55daec511dc0 0x55daec520f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.459+0000 7f9bf17b6640 1 -- 172.21.15.19:0/2017278428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55daec51c680 msgr2=0x55daec595ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:48.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.459+0000 7f9bf17b6640 1 --2- 172.21.15.19:0/2017278428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55daec51c680 0x55daec595ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.459+0000 7f9bf17b6640 1 -- 172.21.15.19:0/2017278428 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55daec5960e0 con 0x55daec5114a0 2024-09-19T08:53:48.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.459+0000 7f5dc1ffb640 1 -- 172.21.15.19:0/2205987434 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dcc011ca0 con 0x5648e6885af0 2024-09-19T08:53:48.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.459+0000 7f9bf17b6640 1 --2- 172.21.15.19:0/2017278428 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55daec5114a0 0x55daec520a50 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc006010 tx=0x7f9bdc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee77bdc834f6a6e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:48.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.459+0000 7f9bd0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:53:48.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.459+0000 7f5dc1ffb640 1 -- 172.21.15.19:0/2205987434 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f5dd4030070 con 0x5648e6885af0 2024-09-19T08:53:48.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.459+0000 7f5de2e70740 10 client.15798 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T08:53:48.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.459+0000 7f5de2e70740 10 client.15798 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T08:53:48.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.459+0000 7f5de2e70740 20 client.15798 populate_metadata read hostname 'smithi019' 2024-09-19T08:53:48.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.459+0000 7f9bd0ff9640 1 -- 172.21.15.19:0/2017278428 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc09f030 con 0x55daec5114a0 2024-09-19T08:53:48.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.459+0000 7f5de2e70740 1 --2- 172.21.15.19:0/2205987434 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5648e689a050 0x5648e69074f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.459+0000 7f9bd0ff9640 1 -- 172.21.15.19:0/2017278428 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9bdc0bb040 con 0x55daec5114a0 2024-09-19T08:53:48.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.459+0000 7f5de2e70740 4 client.15798 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-09-19T08:53:48.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.459+0000 7f5de2e70740 1 -- 172.21.15.19:0/2205987434 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x5648e67e2be0 con 0x5648e689a050 2024-09-19T08:53:48.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.459+0000 7f9bf5df3740 1 -- 172.21.15.19:0/2017278428 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9bdc0d9070 con 0x55daec5114a0 2024-09-19T08:53:48.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.460+0000 7f5dda59c640 1 --2- 172.21.15.19:0/2205987434 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5648e689a050 0x5648e69074f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.460+0000 7f9bd0ff9640 1 -- 172.21.15.19:0/2017278428 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9bdc0cc050 con 0x55daec5114a0 2024-09-19T08:53:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.460+0000 7f9bf5df3740 10 client.15801 fetch_fsmap learned FSMap version 30 2024-09-19T08:53:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.460+0000 7f9bf5df3740 1 -- 172.21.15.19:0/2017278428 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55daec5972d0 con 0x55daec5114a0 2024-09-19T08:53:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.460+0000 7f9bd0ff9640 1 -- 172.21.15.19:0/2017278428 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9bdc036030 con 0x55daec5114a0 2024-09-19T08:53:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.460+0000 7f9bd0ff9640 1 -- 172.21.15.19:0/2017278428 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f9bdc030070 con 0x55daec5114a0 2024-09-19T08:53:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.460+0000 7f9bf5df3740 10 client.15801 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T08:53:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.460+0000 7f9bf5df3740 10 client.15801 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:53:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.460+0000 7f9bf5df3740 20 client.15801 populate_metadata read hostname 'smithi019' 2024-09-19T08:53:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.460+0000 7f9bf5df3740 1 --2- 172.21.15.19:0/2017278428 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55daec597a00 0x55daec599e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:48.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.460+0000 7f9bf5df3740 4 client.15801 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:53:48.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.460+0000 7f9bf5df3740 1 -- 172.21.15.19:0/2017278428 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f9bdc0d9070 con 0x55daec597a00 2024-09-19T08:53:48.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.461+0000 7f9bf0fb5640 1 --2- 172.21.15.19:0/2017278428 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55daec597a00 0x55daec599e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:48.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.461+0000 7f5dda59c640 1 --2- 172.21.15.19:0/2205987434 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5648e689a050 0x5648e69074f0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8679c1ea2d6f211f server_cookie=871edf5f5b3c849a in_seq=0 out_seq=0 2024-09-19T08:53:48.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.461+0000 7f5dc1ffb640 10 client.15798 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:48.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.461+0000 7f9bd0ff9640 10 client.15801 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:48.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.461+0000 7f9bf0fb5640 1 --2- 172.21.15.19:0/2017278428 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55daec597a00 0x55daec599e20 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d13f3de558f7bbf7 server_cookie=59e5b48e87cc7f80 in_seq=0 out_seq=0 2024-09-19T08:53:48.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.462+0000 7f9bd0ff9640 1 -- 172.21.15.19:0/2017278428 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f9bdc0d9070 con 0x55daec597a00 2024-09-19T08:53:48.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.462+0000 7f9bd0ff9640 10 client.15801 handle_command_reply: tid=0 2024-09-19T08:53:48.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.462+0000 7f9bf5df3740 1 client.15801 shutdown 2024-09-19T08:53:48.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.462+0000 7f9bf5df3740 1 -- 172.21.15.19:0/2017278428 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55daec5114a0 msgr2=0x55daec520a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:48.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.462+0000 7f9bf5df3740 1 --2- 172.21.15.19:0/2017278428 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55daec5114a0 0x55daec520a50 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc006010 tx=0x7f9bdc004a40 comp rx=0 tx=0).stop 2024-09-19T08:53:48.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.462+0000 7f9bf5df3740 1 -- 172.21.15.19:0/2017278428 shutdown_connections 2024-09-19T08:53:48.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.462+0000 7f9bf5df3740 1 --2- 172.21.15.19:0/2017278428 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55daec597a00 0x55daec599e20 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.462+0000 7f9bf5df3740 1 --2- 172.21.15.19:0/2017278428 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55daec511dc0 0x55daec520f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.462+0000 7f9bd0ff9640 0 client.15801 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:48.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.462+0000 7f9bf5df3740 1 --2- 172.21.15.19:0/2017278428 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55daec51c680 0x55daec595ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.462+0000 7f9bf5df3740 1 --2- 172.21.15.19:0/2017278428 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55daec5114a0 0x55daec520a50 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.462+0000 7f9bf5df3740 1 -- 172.21.15.19:0/2017278428 >> 172.21.15.19:0/2017278428 conn(0x55daec50da30 msgr2=0x55daec51ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:48.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.462+0000 7f9bf5df3740 1 -- 172.21.15.19:0/2017278428 shutdown_connections 2024-09-19T08:53:48.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.462+0000 7f9bf5df3740 1 -- 172.21.15.19:0/2017278428 wait complete. 2024-09-19T08:53:48.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.462+0000 7f9bf5df3740 20 client.15801 trim_cache size 0 max 16384 2024-09-19T08:53:48.487 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:53:48.487 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-19T08:53:48.487 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {} 2024-09-19T08:53:48.487 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:53:48.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.463+0000 7f9bf3a1a640 1 -- 172.21.15.19:0/2426827035 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9bd40a3240 msgr2=0x7f9bd40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:48.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.463+0000 7f9bf3a1a640 1 --2- 172.21.15.19:0/2426827035 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9bd40a3240 0x7f9bd40a5700 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9bec102780 tx=0x7f9be000a2d0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.463+0000 7f9bf3a1a640 1 -- 172.21.15.19:0/2426827035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bec102d30 msgr2=0x7f9bec1a0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:48.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.463+0000 7f9bf3a1a640 1 --2- 172.21.15.19:0/2426827035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bec102d30 0x7f9bec1a0430 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc02ae00 tx=0x7f9bdc003ba0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.463+0000 7f9bf3a1a640 1 -- 172.21.15.19:0/2426827035 shutdown_connections 2024-09-19T08:53:48.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.463+0000 7f9bf3a1a640 1 --2- 172.21.15.19:0/2426827035 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9bd40a3240 0x7f9bd40a5700 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.463+0000 7f9bf3a1a640 1 --2- 172.21.15.19:0/2426827035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9bec1036e0 0x7f9bec1a0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.463+0000 7f9bf3a1a640 1 --2- 172.21.15.19:0/2426827035 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9bec1082a0 0x7f9bec19a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.463+0000 7f9bf3a1a640 1 --2- 172.21.15.19:0/2426827035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9bec102d30 0x7f9bec1a0430 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:48.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.463+0000 7f9bf3a1a640 1 -- 172.21.15.19:0/2426827035 >> 172.21.15.19:0/2426827035 conn(0x7f9bec0fc7d0 msgr2=0x7f9bec0fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:48.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.463+0000 7f9bf3a1a640 1 -- 172.21.15.19:0/2426827035 shutdown_connections 2024-09-19T08:53:48.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:48.463+0000 7f9bf3a1a640 1 -- 172.21.15.19:0/2426827035 wait complete. 2024-09-19T08:53:48.631 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:53:48.632 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:53:49.045 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:53:49.045 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:53:49.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:49 smithi155 ceph-mon[34921]: pgmap v385: 97 pgs: 97 active+clean; 777 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-19T08:53:49.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:49 smithi203 ceph-mon[35450]: pgmap v385: 97 pgs: 97 active+clean; 777 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-19T08:53:49.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:49 smithi019 ceph-mon[30976]: pgmap v385: 97 pgs: 97 active+clean; 777 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 15 op/s 2024-09-19T08:53:50.333 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:53:50.333 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:53:51.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:51.386+0000 7f5dc1ffb640 1 -- 172.21.15.19:0/2205987434 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5648e67e2be0 con 0x5648e689a050 2024-09-19T08:53:51.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:51.386+0000 7f5dc1ffb640 10 client.15798 handle_command_reply: tid=0 2024-09-19T08:53:51.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:51.386+0000 7f5de2e70740 1 client.15798 shutdown 2024-09-19T08:53:51.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:51.386+0000 7f5de2e70740 1 -- 172.21.15.19:0/2205987434 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e6885af0 msgr2=0x5648e6892bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:51.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:51.386+0000 7f5de2e70740 1 --2- 172.21.15.19:0/2205987434 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e6885af0 0x5648e6892bc0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4009cd0 tx=0x7f5dd4031b40 comp rx=0 tx=0).stop 2024-09-19T08:53:51.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:51.386+0000 7f5de2e70740 1 -- 172.21.15.19:0/2205987434 shutdown_connections 2024-09-19T08:53:51.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:51.386+0000 7f5de2e70740 1 --2- 172.21.15.19:0/2205987434 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5648e689a050 0x5648e69074f0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:51.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:51.386+0000 7f5de2e70740 1 --2- 172.21.15.19:0/2205987434 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648e6885af0 0x5648e6892bc0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:51.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:51.386+0000 7f5de2e70740 1 --2- 172.21.15.19:0/2205987434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648e6877ee0 0x5648e6892430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:51.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:51.386+0000 7f5de2e70740 1 --2- 172.21.15.19:0/2205987434 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648e6876ca0 0x5648e6897100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:51.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:51.386+0000 7f5de2e70740 1 -- 172.21.15.19:0/2205987434 >> 172.21.15.19:0/2205987434 conn(0x5648e6872de0 msgr2=0x5648e6871ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:51.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:51.387+0000 7f5dc1ffb640 0 client.15798 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:51.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:51.387+0000 7f5de2e70740 1 -- 172.21.15.19:0/2205987434 shutdown_connections 2024-09-19T08:53:51.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:51.387+0000 7f5de2e70740 1 -- 172.21.15.19:0/2205987434 wait complete. 2024-09-19T08:53:51.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:51.387+0000 7f5de2e70740 20 client.15798 trim_cache size 0 max 16384 2024-09-19T08:53:51.388 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:53:51.388 INFO:teuthology.orchestra.run.smithi019.stdout: "epoch": 30, 2024-09-19T08:53:51.388 INFO:teuthology.orchestra.run.smithi019.stdout: "leader": 24497, 2024-09-19T08:53:51.388 INFO:teuthology.orchestra.run.smithi019.stdout: "set_version": 6, 2024-09-19T08:53:51.388 INFO:teuthology.orchestra.run.smithi019.stdout: "sets": { 2024-09-19T08:53:51.388 INFO:teuthology.orchestra.run.smithi019.stdout: "21740d72": { 2024-09-19T08:53:51.388 INFO:teuthology.orchestra.run.smithi019.stdout: "version": 6, 2024-09-19T08:53:51.389 INFO:teuthology.orchestra.run.smithi019.stdout: "age_ref": 0.0, 2024-09-19T08:53:51.389 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T08:53:51.389 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "QUIESCED", 2024-09-19T08:53:51.389 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T08:53:51.389 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T08:53:51.389 INFO:teuthology.orchestra.run.smithi019.stdout: "timeout": 90.0, 2024-09-19T08:53:51.389 INFO:teuthology.orchestra.run.smithi019.stdout: "expiration": 140.3, 2024-09-19T08:53:51.389 INFO:teuthology.orchestra.run.smithi019.stdout: "members": { 2024-09-19T08:53:51.389 INFO:teuthology.orchestra.run.smithi019.stdout: "file:/": { 2024-09-19T08:53:51.389 INFO:teuthology.orchestra.run.smithi019.stdout: "excluded": false, 2024-09-19T08:53:51.390 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T08:53:51.390 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "QUIESCED", 2024-09-19T08:53:51.390 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T08:53:51.390 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:53:51.390 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:53:51.390 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:53:51.390 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:53:51.390 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:53:51.390 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:53:51.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:51.387+0000 7f5de0a97640 1 -- 172.21.15.19:0/46521260 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5dc40a3240 msgr2=0x7f5dc40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:51.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:51.387+0000 7f5de0a97640 1 --2- 172.21.15.19:0/46521260 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5dc40a3240 0x7f5dc40a5700 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00bb60 tx=0x7f5dcc00b390 comp rx=0 tx=0).stop 2024-09-19T08:53:51.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:51.387+0000 7f5de0a97640 1 -- 172.21.15.19:0/46521260 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ddc101400 msgr2=0x7f5ddc197840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:51.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:51.387+0000 7f5de0a97640 1 --2- 172.21.15.19:0/46521260 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ddc101400 0x7f5ddc197840 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f5dd000d770 tx=0x7f5dd000dc30 comp rx=0 tx=0).stop 2024-09-19T08:53:51.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:51.388+0000 7f5de0a97640 1 -- 172.21.15.19:0/46521260 shutdown_connections 2024-09-19T08:53:51.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:51.388+0000 7f5de0a97640 1 --2- 172.21.15.19:0/46521260 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5dc40a3240 0x7f5dc40a5700 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:51.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:51.388+0000 7f5de0a97640 1 --2- 172.21.15.19:0/46521260 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5ddc106a60 0x7f5ddc19bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:51.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:51.388+0000 7f5de0a97640 1 --2- 172.21.15.19:0/46521260 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5ddc101400 0x7f5ddc197840 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:51.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:51.388+0000 7f5de0a97640 1 --2- 172.21.15.19:0/46521260 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5ddc100a60 0x7f5ddc197300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:51.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:51.388+0000 7f5de0a97640 1 -- 172.21.15.19:0/46521260 >> 172.21.15.19:0/46521260 conn(0x7f5ddc0fc780 msgr2=0x7f5ddc0fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:51.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:51.388+0000 7f5de0a97640 1 -- 172.21.15.19:0/46521260 shutdown_connections 2024-09-19T08:53:51.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:51.388+0000 7f5de0a97640 1 -- 172.21.15.19:0/46521260 wait complete. 2024-09-19T08:53:51.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:51 smithi155 ceph-mon[34921]: pgmap v386: 97 pgs: 97 active+clean; 783 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 16 op/s 2024-09-19T08:53:51.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:51 smithi203 ceph-mon[35450]: pgmap v386: 97 pgs: 97 active+clean; 783 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 16 op/s 2024-09-19T08:53:51.748 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:51 smithi019 ceph-mon[30976]: pgmap v386: 97 pgs: 97 active+clean; 783 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 16 op/s 2024-09-19T08:53:52.169 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '21740d72', quiesce took 19.5 seconds. Will release after: 0.8500000000000014 2024-09-19T08:53:52.273 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:53.020 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:53:53.296 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:53.635 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:53 smithi019 ceph-mon[30976]: pgmap v387: 97 pgs: 97 active+clean; 783 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 KiB/s wr, 15 op/s 2024-09-19T08:53:53.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:53 smithi155 ceph-mon[34921]: pgmap v387: 97 pgs: 97 active+clean; 783 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 KiB/s wr, 15 op/s 2024-09-19T08:53:53.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:53 smithi203 ceph-mon[35450]: pgmap v387: 97 pgs: 97 active+clean; 783 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.4 KiB/s wr, 15 op/s 2024-09-19T08:53:54.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.205+0000 7f6c72bcc640 1 -- 172.21.15.19:0/966629765 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c6c102d30 msgr2=0x7f6c6c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:54.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.205+0000 7f6c72bcc640 1 --2- 172.21.15.19:0/966629765 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c6c102d30 0x7f6c6c103110 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c009cd0 tx=0x7f6c5c02a8e0 comp rx=0 tx=0).stop 2024-09-19T08:53:54.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.205+0000 7f6c72bcc640 1 -- 172.21.15.19:0/966629765 shutdown_connections 2024-09-19T08:53:54.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.205+0000 7f6c72bcc640 1 --2- 172.21.15.19:0/966629765 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c6c1082a0 0x7f6c6c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:54.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.205+0000 7f6c72bcc640 1 --2- 172.21.15.19:0/966629765 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c6c1036e0 0x7f6c6c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:54.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.205+0000 7f6c72bcc640 1 --2- 172.21.15.19:0/966629765 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c6c102d30 0x7f6c6c103110 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:54.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.205+0000 7f6c72bcc640 1 -- 172.21.15.19:0/966629765 >> 172.21.15.19:0/966629765 conn(0x7f6c6c0fc7d0 msgr2=0x7f6c6c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:54.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.205+0000 7f6c72bcc640 1 -- 172.21.15.19:0/966629765 shutdown_connections 2024-09-19T08:53:54.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.205+0000 7f6c72bcc640 1 -- 172.21.15.19:0/966629765 wait complete. 2024-09-19T08:53:54.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.206+0000 7f6c72bcc640 1 Processor -- start 2024-09-19T08:53:54.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.205+0000 7f967eadb640 1 -- 172.21.15.19:0/823301301 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9678102d80 msgr2=0x7f9678103160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:54.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.205+0000 7f967eadb640 1 --2- 172.21.15.19:0/823301301 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9678102d80 0x7f9678103160 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f9668009900 tx=0x7f966802a480 comp rx=0 tx=0).stop 2024-09-19T08:53:54.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.205+0000 7f967eadb640 1 -- 172.21.15.19:0/823301301 shutdown_connections 2024-09-19T08:53:54.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.205+0000 7f967eadb640 1 --2- 172.21.15.19:0/823301301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f967810c160 0x7f967810e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:54.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.205+0000 7f967eadb640 1 --2- 172.21.15.19:0/823301301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f96781036a0 0x7f967810bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:54.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.205+0000 7f967eadb640 1 --2- 172.21.15.19:0/823301301 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9678102d80 0x7f9678103160 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:54.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.205+0000 7f967eadb640 1 -- 172.21.15.19:0/823301301 >> 172.21.15.19:0/823301301 conn(0x7f96780fc780 msgr2=0x7f96780feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:54.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.205+0000 7f967eadb640 1 -- 172.21.15.19:0/823301301 shutdown_connections 2024-09-19T08:53:54.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.205+0000 7f967eadb640 1 -- 172.21.15.19:0/823301301 wait complete. 2024-09-19T08:53:54.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.206+0000 7f967eadb640 1 Processor -- start 2024-09-19T08:53:54.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.206+0000 7f967eadb640 1 -- start start 2024-09-19T08:53:54.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.206+0000 7f6c72bcc640 1 -- start start 2024-09-19T08:53:54.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.206+0000 7f967eadb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9678102d80 0x7f96781009e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:54.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.206+0000 7f967eadb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96781036a0 0x7f9678100f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:54.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.206+0000 7f967eadb640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f967810c160 0x7f9678101460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:54.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.206+0000 7f967eadb640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9678111f90 con 0x7f96781036a0 2024-09-19T08:53:54.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.206+0000 7f967eadb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9678111e10 con 0x7f9678102d80 2024-09-19T08:53:54.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.206+0000 7f967eadb640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9678112110 con 0x7f967810c160 2024-09-19T08:53:54.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.207+0000 7f6c72bcc640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c6c102d30 0x7f6c6c1985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:54.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.207+0000 7f6c72bcc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c6c1036e0 0x7f6c6c198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:54.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.207+0000 7f6c72bcc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c6c1082a0 0x7f6c6c19ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:54.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.207+0000 7f6c72bcc640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6c1120a0 con 0x7f6c6c1082a0 2024-09-19T08:53:54.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.207+0000 7f6c72bcc640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6c111f20 con 0x7f6c6c1036e0 2024-09-19T08:53:54.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.207+0000 7f6c72bcc640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6c112220 con 0x7f6c6c102d30 2024-09-19T08:53:54.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.207+0000 7f9677fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96781036a0 0x7f9678100f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:54.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.207+0000 7f967d078640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f967810c160 0x7f9678101460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:54.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.207+0000 7f9677fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96781036a0 0x7f9678100f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60322/0 (socket says 172.21.15.19:60322) 2024-09-19T08:53:54.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.207+0000 7f9677fff640 1 -- 172.21.15.19:0/3208418939 learned_addr learned my addr 172.21.15.19:0/3208418939 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:54.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.207+0000 7f967c877640 1 --2- 172.21.15.19:0/3208418939 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9678102d80 0x7f96781009e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:54.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.207+0000 7f6c6bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c6c1036e0 0x7f6c6c198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:54.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.207+0000 7f6c71169640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c6c1082a0 0x7f6c6c19ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:54.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.207+0000 7f6c6bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c6c1036e0 0x7f6c6c198b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:54754/0 (socket says 172.21.15.19:54754) 2024-09-19T08:53:54.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.207+0000 7f6c6bfff640 1 -- 172.21.15.19:0/3156974977 learned_addr learned my addr 172.21.15.19:0/3156974977 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:54.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.207+0000 7f6c70968640 1 --2- 172.21.15.19:0/3156974977 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c6c102d30 0x7f6c6c1985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:54.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.207+0000 7f6c71169640 1 -- 172.21.15.19:0/3156974977 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c6c102d30 msgr2=0x7f6c6c1985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:54.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.207+0000 7f6c71169640 1 --2- 172.21.15.19:0/3156974977 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c6c102d30 0x7f6c6c1985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:54.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.207+0000 7f6c71169640 1 -- 172.21.15.19:0/3156974977 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c6c1036e0 msgr2=0x7f6c6c198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:54.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.207+0000 7f6c71169640 1 --2- 172.21.15.19:0/3156974977 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c6c1036e0 0x7f6c6c198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:54.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.207+0000 7f6c71169640 1 -- 172.21.15.19:0/3156974977 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c6c19d570 con 0x7f6c6c1082a0 2024-09-19T08:53:54.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.207+0000 7f967c877640 1 -- 172.21.15.19:0/3208418939 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f967810c160 msgr2=0x7f9678101460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:54.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.207+0000 7f967c877640 1 --2- 172.21.15.19:0/3208418939 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f967810c160 0x7f9678101460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:54.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.207+0000 7f967c877640 1 -- 172.21.15.19:0/3208418939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96781036a0 msgr2=0x7f9678100f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:54.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.207+0000 7f967c877640 1 --2- 172.21.15.19:0/3208418939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96781036a0 0x7f9678100f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:54.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.207+0000 7f967c877640 1 -- 172.21.15.19:0/3208418939 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96781a68f0 con 0x7f9678102d80 2024-09-19T08:53:54.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.207+0000 7f6c71169640 1 --2- 172.21.15.19:0/3156974977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c6c1082a0 0x7f6c6c19ce90 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6c6400e970 tx=0x7f6c6400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:54.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.208+0000 7f967c877640 1 --2- 172.21.15.19:0/3208418939 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9678102d80 0x7f96781009e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f966802a9a0 tx=0x7f9668003b20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:54.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.208+0000 7f6c69ffb640 1 -- 172.21.15.19:0/3156974977 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6400ccc0 con 0x7f6c6c1082a0 2024-09-19T08:53:54.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.208+0000 7f6c69ffb640 1 -- 172.21.15.19:0/3156974977 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c64005020 con 0x7f6c6c1082a0 2024-09-19T08:53:54.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.208+0000 7f6c72bcc640 1 -- 172.21.15.19:0/3156974977 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c6c19d860 con 0x7f6c6c1082a0 2024-09-19T08:53:54.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.208+0000 7f6c69ffb640 1 -- 172.21.15.19:0/3156974977 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c64004a00 con 0x7f6c6c1082a0 2024-09-19T08:53:54.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.208+0000 7f9675ffb640 1 -- 172.21.15.19:0/3208418939 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f966803f070 con 0x7f9678102d80 2024-09-19T08:53:54.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.208+0000 7f6c72bcc640 1 -- 172.21.15.19:0/3156974977 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c6c1a5140 con 0x7f6c6c1082a0 2024-09-19T08:53:54.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.208+0000 7f967eadb640 1 -- 172.21.15.19:0/3208418939 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96781a6b80 con 0x7f9678102d80 2024-09-19T08:53:54.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.208+0000 7f9675ffb640 1 -- 172.21.15.19:0/3208418939 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9668031c90 con 0x7f9678102d80 2024-09-19T08:53:54.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.208+0000 7f9675ffb640 1 -- 172.21.15.19:0/3208418939 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9668035030 con 0x7f9678102d80 2024-09-19T08:53:54.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.208+0000 7f967eadb640 1 -- 172.21.15.19:0/3208418939 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96781a7060 con 0x7f9678102d80 2024-09-19T08:53:54.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.209+0000 7f6c72bcc640 1 -- 172.21.15.19:0/3156974977 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c6c06a850 con 0x7f6c6c1082a0 2024-09-19T08:53:54.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.209+0000 7f967eadb640 1 -- 172.21.15.19:0/3208418939 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9678103160 con 0x7f9678102d80 2024-09-19T08:53:54.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.211+0000 7f6c69ffb640 1 -- 172.21.15.19:0/3156974977 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f6c640051d0 con 0x7f6c6c1082a0 2024-09-19T08:53:54.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.211+0000 7f9675ffb640 1 -- 172.21.15.19:0/3208418939 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f9668042070 con 0x7f9678102d80 2024-09-19T08:53:54.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.212+0000 7f6c69ffb640 1 --2- 172.21.15.19:0/3156974977 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6c580a32c0 0x7f6c580a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:54.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.212+0000 7f9675ffb640 1 --2- 172.21.15.19:0/3208418939 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f96640a3240 0x7f96640a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:54.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.212+0000 7f6c69ffb640 1 -- 172.21.15.19:0/3156974977 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6c640cf8b0 con 0x7f6c6c1082a0 2024-09-19T08:53:54.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.212+0000 7f6c70968640 1 --2- 172.21.15.19:0/3156974977 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6c580a32c0 0x7f6c580a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:54.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.212+0000 7f9675ffb640 1 -- 172.21.15.19:0/3208418939 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f96680f0810 con 0x7f9678102d80 2024-09-19T08:53:54.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.213+0000 7f9677fff640 1 --2- 172.21.15.19:0/3208418939 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f96640a3240 0x7f96640a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:54.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.213+0000 7f6c70968640 1 --2- 172.21.15.19:0/3156974977 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6c580a32c0 0x7f6c580a5780 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c006010 tx=0x7f6c5c0093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:54.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.213+0000 7f9677fff640 1 --2- 172.21.15.19:0/3208418939 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f96640a3240 0x7f96640a5700 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9678102470 tx=0x7f9660009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:54.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.215+0000 7f6c69ffb640 1 -- 172.21.15.19:0/3156974977 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6c6409c670 con 0x7f6c6c1082a0 2024-09-19T08:53:54.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.215+0000 7f9675ffb640 1 -- 172.21.15.19:0/3208418939 <== mon.2 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f96680bce90 con 0x7f9678102d80 2024-09-19T08:53:54.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.429+0000 7f967eadb640 1 -- 172.21.15.19:0/3208418939 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9678101f10 con 0x7f9678102d80 2024-09-19T08:53:54.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.430+0000 7f6c72bcc640 1 -- 172.21.15.19:0/3156974977 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c6c10a2b0 con 0x7f6c6c1082a0 2024-09-19T08:53:54.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.430+0000 7f9675ffb640 1 -- 172.21.15.19:0/3208418939 <== mon.2 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11990 (secure 0 0 0) 0x7f96680c1190 con 0x7f9678102d80 2024-09-19T08:53:54.430 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:53:54.430 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":30,"btime":"2024-09-19T08:53:40:359510+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2452068876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2452068876},{"type":"v1","addr":"172.21.15.19:6839","nonce":2452068876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T08:53:39.964693+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/2480841559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2480841559},{"type":"v1","addr":"172.21.15.155:6835","nonce":2480841559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24463,24464,24490,24469,24497]},"id":1}]} 2024-09-19T08:53:54.431 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 30 2024-09-19T08:53:54.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.431+0000 7f6c69ffb640 1 -- 172.21.15.19:0/3156974977 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11990 (secure 0 0 0) 0x7f6c6409bf70 con 0x7f6c6c1082a0 2024-09-19T08:53:54.431 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:53:54.431 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":30,"btime":"2024-09-19T08:53:40:359510+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2452068876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2452068876},{"type":"v1","addr":"172.21.15.19:6839","nonce":2452068876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T08:53:39.964693+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/2480841559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2480841559},{"type":"v1","addr":"172.21.15.155:6835","nonce":2480841559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24463,24464,24490,24469,24497]},"id":1}]} 2024-09-19T08:53:54.432 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 30 2024-09-19T08:53:54.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.433+0000 7f967eadb640 1 -- 172.21.15.19:0/3208418939 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f96640a3240 msgr2=0x7f96640a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:54.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.433+0000 7f967eadb640 1 --2- 172.21.15.19:0/3208418939 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f96640a3240 0x7f96640a5700 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9678102470 tx=0x7f9660009500 comp rx=0 tx=0).stop 2024-09-19T08:53:54.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.433+0000 7f967eadb640 1 -- 172.21.15.19:0/3208418939 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9678102d80 msgr2=0x7f96781009e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:54.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.433+0000 7f967eadb640 1 --2- 172.21.15.19:0/3208418939 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9678102d80 0x7f96781009e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f966802a9a0 tx=0x7f9668003b20 comp rx=0 tx=0).stop 2024-09-19T08:53:54.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.433+0000 7f967eadb640 1 -- 172.21.15.19:0/3208418939 shutdown_connections 2024-09-19T08:53:54.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.433+0000 7f967eadb640 1 --2- 172.21.15.19:0/3208418939 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f96640a3240 0x7f96640a5700 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:54.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.433+0000 7f967eadb640 1 --2- 172.21.15.19:0/3208418939 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f967810c160 0x7f9678101460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:54.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.433+0000 7f967eadb640 1 --2- 172.21.15.19:0/3208418939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f96781036a0 0x7f9678100f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:54.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.433+0000 7f967eadb640 1 --2- 172.21.15.19:0/3208418939 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9678102d80 0x7f96781009e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:54.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.433+0000 7f967eadb640 1 -- 172.21.15.19:0/3208418939 >> 172.21.15.19:0/3208418939 conn(0x7f96780fc780 msgr2=0x7f96780fd420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:54.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.433+0000 7f967eadb640 1 -- 172.21.15.19:0/3208418939 shutdown_connections 2024-09-19T08:53:54.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.433+0000 7f967eadb640 1 -- 172.21.15.19:0/3208418939 wait complete. 2024-09-19T08:53:54.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.433+0000 7f6c72bcc640 1 -- 172.21.15.19:0/3156974977 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6c580a32c0 msgr2=0x7f6c580a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:54.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.433+0000 7f6c72bcc640 1 --2- 172.21.15.19:0/3156974977 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6c580a32c0 0x7f6c580a5780 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c006010 tx=0x7f6c5c0093f0 comp rx=0 tx=0).stop 2024-09-19T08:53:54.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.433+0000 7f6c72bcc640 1 -- 172.21.15.19:0/3156974977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c6c1082a0 msgr2=0x7f6c6c19ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:54.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.433+0000 7f6c72bcc640 1 --2- 172.21.15.19:0/3156974977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c6c1082a0 0x7f6c6c19ce90 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f6c6400e970 tx=0x7f6c6400ee30 comp rx=0 tx=0).stop 2024-09-19T08:53:54.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.433+0000 7f6c72bcc640 1 -- 172.21.15.19:0/3156974977 shutdown_connections 2024-09-19T08:53:54.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.433+0000 7f6c72bcc640 1 --2- 172.21.15.19:0/3156974977 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6c580a32c0 0x7f6c580a5780 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:54.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.433+0000 7f6c72bcc640 1 --2- 172.21.15.19:0/3156974977 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c6c1082a0 0x7f6c6c19ce90 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:54.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.433+0000 7f6c72bcc640 1 --2- 172.21.15.19:0/3156974977 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c6c1036e0 0x7f6c6c198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:54.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.433+0000 7f6c72bcc640 1 --2- 172.21.15.19:0/3156974977 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c6c102d30 0x7f6c6c1985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:54.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.433+0000 7f6c72bcc640 1 -- 172.21.15.19:0/3156974977 >> 172.21.15.19:0/3156974977 conn(0x7f6c6c0fc7d0 msgr2=0x7f6c6c105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:54.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.434+0000 7f6c72bcc640 1 -- 172.21.15.19:0/3156974977 shutdown_connections 2024-09-19T08:53:54.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:54.434+0000 7f6c72bcc640 1 -- 172.21.15.19:0/3156974977 wait complete. 2024-09-19T08:53:55.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:55 smithi019 ceph-mon[30976]: pgmap v388: 97 pgs: 97 active+clean; 799 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.7 KiB/s wr, 16 op/s 2024-09-19T08:53:55.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:55 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3208418939' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:53:55.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:55 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3156974977' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:53:55.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:55 smithi155 ceph-mon[34921]: pgmap v388: 97 pgs: 97 active+clean; 799 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.7 KiB/s wr, 16 op/s 2024-09-19T08:53:55.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:55 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3208418939' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:53:55.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:55 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3156974977' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:53:55.715 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T08:53:55.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:55 smithi203 ceph-mon[35450]: pgmap v388: 97 pgs: 97 active+clean; 799 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.7 KiB/s wr, 16 op/s 2024-09-19T08:53:55.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:55 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3208418939' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:53:55.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:55 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3156974977' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:53:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.335+0000 7efd0a8a6640 1 -- 172.21.15.19:0/3030398883 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd04103710 msgr2=0x7efd04109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.335+0000 7efd0a8a6640 1 --2- 172.21.15.19:0/3030398883 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd04103710 0x7efd04109fa0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7efcfc009ca0 tx=0x7efcfc02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.335+0000 7efd0a8a6640 1 -- 172.21.15.19:0/3030398883 shutdown_connections 2024-09-19T08:53:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.335+0000 7efd0a8a6640 1 --2- 172.21.15.19:0/3030398883 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd04102d50 0x7efd041031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.335+0000 7efd0a8a6640 1 --2- 172.21.15.19:0/3030398883 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd04103710 0x7efd04109fa0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.335+0000 7efd0a8a6640 1 --2- 172.21.15.19:0/3030398883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd04101b60 0x7efd04101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.335+0000 7efd0a8a6640 1 -- 172.21.15.19:0/3030398883 >> 172.21.15.19:0/3030398883 conn(0x7efd040fd2e0 msgr2=0x7efd040ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.335+0000 7efd0a8a6640 1 -- 172.21.15.19:0/3030398883 shutdown_connections 2024-09-19T08:53:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.335+0000 7efd0a8a6640 1 -- 172.21.15.19:0/3030398883 wait complete. 2024-09-19T08:53:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.347+0000 7efd0a8a6640 1 Processor -- start 2024-09-19T08:53:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.347+0000 7efd0a8a6640 1 -- start start 2024-09-19T08:53:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.347+0000 7efd0a8a6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd04101b60 0x7efd04199f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.347+0000 7efd0a8a6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd04102d50 0x7efd0419a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.347+0000 7efd0a8a6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd04103710 0x7efd041a14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.348+0000 7efd0a8a6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7efd0410d7c0 con 0x7efd04101b60 2024-09-19T08:53:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.348+0000 7efd0a8a6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efd0410d640 con 0x7efd04102d50 2024-09-19T08:53:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.348+0000 7efd0a8a6640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efd0410d940 con 0x7efd04103710 2024-09-19T08:53:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.348+0000 7efd03fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd04101b60 0x7efd04199f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.348+0000 7efd03fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd04101b60 0x7efd04199f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50078/0 (socket says 172.21.15.19:50078) 2024-09-19T08:53:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.348+0000 7efd03fff640 1 -- 172.21.15.19:0/4200971932 learned_addr learned my addr 172.21.15.19:0/4200971932 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.348+0000 7efd037fe640 1 --2- 172.21.15.19:0/4200971932 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd04102d50 0x7efd0419a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.348+0000 7efd08e43640 1 --2- 172.21.15.19:0/4200971932 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd04103710 0x7efd041a14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.348+0000 7efd03fff640 1 -- 172.21.15.19:0/4200971932 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd04103710 msgr2=0x7efd041a14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.348+0000 7efd03fff640 1 --2- 172.21.15.19:0/4200971932 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd04103710 0x7efd041a14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.348+0000 7efd03fff640 1 -- 172.21.15.19:0/4200971932 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd04102d50 msgr2=0x7efd0419a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.348+0000 7efd03fff640 1 --2- 172.21.15.19:0/4200971932 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd04102d50 0x7efd0419a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.348+0000 7efd03fff640 1 -- 172.21.15.19:0/4200971932 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd041a1b30 con 0x7efd04101b60 2024-09-19T08:53:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.348+0000 7efd08e43640 1 --2- 172.21.15.19:0/4200971932 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd04103710 0x7efd041a14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:53:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.348+0000 7efd03fff640 1 --2- 172.21.15.19:0/4200971932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd04101b60 0x7efd04199f10 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7efcf400d950 tx=0x7efcf400dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.349+0000 7efd017fa640 1 -- 172.21.15.19:0/4200971932 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf4017020 con 0x7efd04101b60 2024-09-19T08:53:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.349+0000 7efd0a8a6640 1 -- 172.21.15.19:0/4200971932 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd041a1e20 con 0x7efd04101b60 2024-09-19T08:53:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.349+0000 7efd017fa640 1 -- 172.21.15.19:0/4200971932 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efcf4009c30 con 0x7efd04101b60 2024-09-19T08:53:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.349+0000 7efd017fa640 1 -- 172.21.15.19:0/4200971932 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf400f6b0 con 0x7efd04101b60 2024-09-19T08:53:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.349+0000 7efd0a8a6640 1 -- 172.21.15.19:0/4200971932 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd041a2290 con 0x7efd04101b60 2024-09-19T08:53:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.351+0000 7efd017fa640 1 -- 172.21.15.19:0/4200971932 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7efcf401a020 con 0x7efd04101b60 2024-09-19T08:53:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.352+0000 7efd017fa640 1 --2- 172.21.15.19:0/4200971932 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7efcec0a3460 0x7efcec0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.352+0000 7efd017fa640 1 -- 172.21.15.19:0/4200971932 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7efcf40d0240 con 0x7efd04101b60 2024-09-19T08:53:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.352+0000 7efd037fe640 1 --2- 172.21.15.19:0/4200971932 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7efcec0a3460 0x7efcec0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:56.358 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db --set-id 21740d72 --release --await' 2024-09-19T08:53:56.358 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db --set-id 21740d72 --release --await 2024-09-19T08:53:56.399 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.400+0000 7efd037fe640 1 --2- 172.21.15.19:0/4200971932 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7efcec0a3460 0x7efcec0a5920 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7efd0419b420 tx=0x7efcf800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.401+0000 7efd0d638740 1 Processor -- start 2024-09-19T08:53:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.402+0000 7efd0d638740 1 -- start start 2024-09-19T08:53:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.402+0000 7efd0d638740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e465e69a0 0x564e465e6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.402+0000 7efd0d638740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564e465e72e0 0x564e465ebda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.402+0000 7efd0d638740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e465ec370 0x564e465ee830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:56.402 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.402+0000 7efd0d638740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x564e4654a2f0 con 0x564e465e69a0 2024-09-19T08:53:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.402+0000 7efd0d638740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x564e464f2270 con 0x564e465e72e0 2024-09-19T08:53:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.402+0000 7efd0d638740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564e465462b0 con 0x564e465ec370 2024-09-19T08:53:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.402+0000 7efd03fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e465e69a0 0x564e465e6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.402+0000 7efd03fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e465e69a0 0x564e465e6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50090/0 (socket says 172.21.15.19:50090) 2024-09-19T08:53:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.402+0000 7efd03fff640 1 -- 172.21.15.19:0/2308899207 learned_addr learned my addr 172.21.15.19:0/2308899207 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.402+0000 7efd08e43640 1 --2- 172.21.15.19:0/2308899207 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e465ec370 0x564e465ee830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.402+0000 7efd037fe640 1 --2- 172.21.15.19:0/2308899207 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564e465e72e0 0x564e465ebda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.402+0000 7efd03fff640 1 -- 172.21.15.19:0/2308899207 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e465ec370 msgr2=0x564e465ee830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.402+0000 7efd03fff640 1 --2- 172.21.15.19:0/2308899207 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e465ec370 0x564e465ee830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.403 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.402+0000 7efd03fff640 1 -- 172.21.15.19:0/2308899207 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564e465e72e0 msgr2=0x564e465ebda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.402+0000 7efd03fff640 1 --2- 172.21.15.19:0/2308899207 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564e465e72e0 0x564e465ebda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.402+0000 7efd03fff640 1 -- 172.21.15.19:0/2308899207 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e464f1340 con 0x564e465e69a0 2024-09-19T08:53:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.403+0000 7efd03fff640 1 --2- 172.21.15.19:0/2308899207 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e465e69a0 0x564e465e6da0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7efcf4099240 tx=0x7efcf409cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b5d7543bc0715f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.403+0000 7efcea7fc640 1 -- 172.21.15.19:0/2308899207 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf40a0c20 con 0x564e465e69a0 2024-09-19T08:53:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.403+0000 7efcea7fc640 1 -- 172.21.15.19:0/2308899207 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efcf40b5070 con 0x564e465e69a0 2024-09-19T08:53:56.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.403+0000 7efcea7fc640 1 -- 172.21.15.19:0/2308899207 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf409dba0 con 0x564e465e69a0 2024-09-19T08:53:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.404+0000 7efd0d638740 1 -- 172.21.15.19:0/2308899207 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e465e69a0 msgr2=0x564e465e6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.404+0000 7efd0d638740 1 --2- 172.21.15.19:0/2308899207 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e465e69a0 0x564e465e6da0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7efcf4099240 tx=0x7efcf409cf70 comp rx=0 tx=0).stop 2024-09-19T08:53:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.404+0000 7efd0d638740 1 -- 172.21.15.19:0/2308899207 shutdown_connections 2024-09-19T08:53:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.404+0000 7efd0d638740 1 --2- 172.21.15.19:0/2308899207 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e465ec370 0x564e465ee830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.404+0000 7efd0d638740 1 --2- 172.21.15.19:0/2308899207 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564e465e72e0 0x564e465ebda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.404+0000 7efd0d638740 1 --2- 172.21.15.19:0/2308899207 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e465e69a0 0x564e465e6da0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.404+0000 7efd0d638740 1 -- 172.21.15.19:0/2308899207 >> 172.21.15.19:0/2308899207 conn(0x564e465e2010 msgr2=0x564e465e2410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.404+0000 7efd0d638740 1 -- 172.21.15.19:0/2308899207 shutdown_connections 2024-09-19T08:53:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.404+0000 7efd0d638740 1 -- 172.21.15.19:0/2308899207 wait complete. 2024-09-19T08:53:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.406+0000 7efd0d638740 1 -- start start 2024-09-19T08:53:56.408 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.407+0000 7efd0d638740 1 Processor -- start 2024-09-19T08:53:56.408 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.407+0000 7efd0d638740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564e465e69a0 0x564e465f0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:56.408 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.407+0000 7efd0d638740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e465e72e0 0x564e465f1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.407+0000 7efd0d638740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e465ec370 0x564e465f8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.407+0000 7efd0d638740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x564e465ef2e0 con 0x564e465ec370 2024-09-19T08:53:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.407+0000 7efd0d638740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x564e464d3290 con 0x564e465e69a0 2024-09-19T08:53:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.407+0000 7efd0d638740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564e465ef460 con 0x564e465e72e0 2024-09-19T08:53:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.408+0000 7efd08e43640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e465ec370 0x564e465f8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.408+0000 7efd08e43640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e465ec370 0x564e465f8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50098/0 (socket says 172.21.15.19:50098) 2024-09-19T08:53:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.408+0000 7efd08e43640 1 -- 172.21.15.19:0/1428159296 learned_addr learned my addr 172.21.15.19:0/1428159296 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.408+0000 7efd03fff640 1 --2- 172.21.15.19:0/1428159296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564e465e69a0 0x564e465f0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.408+0000 7efd037fe640 1 --2- 172.21.15.19:0/1428159296 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e465e72e0 0x564e465f1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.408+0000 7efd08e43640 1 -- 172.21.15.19:0/1428159296 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e465e72e0 msgr2=0x564e465f1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.408+0000 7efd08e43640 1 --2- 172.21.15.19:0/1428159296 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e465e72e0 0x564e465f1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.410 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.408+0000 7efd08e43640 1 -- 172.21.15.19:0/1428159296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564e465e69a0 msgr2=0x564e465f0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:56.410 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.408+0000 7efd08e43640 1 --2- 172.21.15.19:0/1428159296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564e465e69a0 0x564e465f0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.410 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.408+0000 7efd08e43640 1 -- 172.21.15.19:0/1428159296 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e4625d210 con 0x564e465ec370 2024-09-19T08:53:56.410 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.408+0000 7efd08e43640 1 --2- 172.21.15.19:0/1428159296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e465ec370 0x564e465f8140 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7efcfc009ca0 tx=0x7efcfc009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ebf2eb23829384a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:56.410 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.408+0000 7efce37fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:53:56.410 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.408+0000 7efce37fe640 1 -- 172.21.15.19:0/1428159296 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcfc003970 con 0x564e465ec370 2024-09-19T08:53:56.410 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.408+0000 7efce37fe640 1 -- 172.21.15.19:0/1428159296 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7efcfc003b10 con 0x564e465ec370 2024-09-19T08:53:56.410 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.411+0000 7efd0d638740 10 client.0 _ll_register_callbacks cb 0x564e46504140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:56.417 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.418+0000 7efd0d638740 1 -- 172.21.15.19:0/1428159296 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efcf40b5070 con 0x564e465ec370 2024-09-19T08:53:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.419+0000 7efce37fe640 1 -- 172.21.15.19:0/1428159296 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7efcfc003d10 con 0x564e465ec370 2024-09-19T08:53:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.419+0000 7efd0d638740 10 client.15825 fetch_fsmap learned FSMap version 30 2024-09-19T08:53:56.418 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.419+0000 7efd0d638740 1 -- 172.21.15.19:0/1428159296 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({fsmap=30}) -- 0x564e46329620 con 0x564e465ec370 2024-09-19T08:53:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.421+0000 7efce37fe640 1 -- 172.21.15.19:0/1428159296 <== mon.0 v2:172.21.15.19:3300/0 4 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7efcfc004b40 con 0x564e465ec370 2024-09-19T08:53:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.421+0000 7efd0d638740 10 client.15825 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T08:53:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.421+0000 7efd0d638740 10 client.15825 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:53:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.421+0000 7efd0d638740 20 client.15825 populate_metadata read hostname 'smithi019' 2024-09-19T08:53:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.421+0000 7efd0d638740 1 --2- 172.21.15.19:0/1428159296 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x564e465fc740 0x564e465febe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.421+0000 7efd0d638740 4 client.15825 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:53:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.421+0000 7efd0d638740 1 -- 172.21.15.19:0/1428159296 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e46557a20 con 0x564e465fc740 2024-09-19T08:53:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.421+0000 7efd03fff640 1 --2- 172.21.15.19:0/1428159296 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x564e465fc740 0x564e465febe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.422+0000 7efce37fe640 10 client.15825 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.422+0000 7efd03fff640 1 --2- 172.21.15.19:0/1428159296 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x564e465fc740 0x564e465febe0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f28690db7709fcdb server_cookie=ccc4149c873d6d44 in_seq=0 out_seq=0 2024-09-19T08:53:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.423+0000 7efce37fe640 1 -- 172.21.15.19:0/1428159296 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564e46557a20 con 0x564e465fc740 2024-09-19T08:53:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.423+0000 7efce37fe640 10 client.15825 handle_command_reply: tid=0 2024-09-19T08:53:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.423+0000 7efd0d638740 1 client.15825 shutdown 2024-09-19T08:53:56.423 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.423+0000 7efd0d638740 1 -- 172.21.15.19:0/1428159296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e465ec370 msgr2=0x564e465f8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:56.423 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.423+0000 7efd0d638740 1 --2- 172.21.15.19:0/1428159296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e465ec370 0x564e465f8140 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7efcfc009ca0 tx=0x7efcfc009800 comp rx=0 tx=0).stop 2024-09-19T08:53:56.423 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.423+0000 7efd0d638740 1 -- 172.21.15.19:0/1428159296 shutdown_connections 2024-09-19T08:53:56.423 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.423+0000 7efd0d638740 1 --2- 172.21.15.19:0/1428159296 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x564e465fc740 0x564e465febe0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.423 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.423+0000 7efd0d638740 1 --2- 172.21.15.19:0/1428159296 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e465e72e0 0x564e465f1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.423+0000 7efd0d638740 1 --2- 172.21.15.19:0/1428159296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e465ec370 0x564e465f8140 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.423+0000 7efd0d638740 1 --2- 172.21.15.19:0/1428159296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564e465e69a0 0x564e465f0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.423+0000 7efd0d638740 1 -- 172.21.15.19:0/1428159296 >> 172.21.15.19:0/1428159296 conn(0x564e465e2010 msgr2=0x564e465e3820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.423+0000 7efce37fe640 0 client.15825 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.423+0000 7efd0d638740 1 -- 172.21.15.19:0/1428159296 shutdown_connections 2024-09-19T08:53:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.423+0000 7efd0d638740 1 -- 172.21.15.19:0/1428159296 wait complete. 2024-09-19T08:53:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.423+0000 7efd0d638740 20 client.15825 trim_cache size 0 max 16384 2024-09-19T08:53:56.439 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.439+0000 7efd0d638740 1 Processor -- start 2024-09-19T08:53:56.439 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.439+0000 7efd0d638740 1 -- start start 2024-09-19T08:53:56.439 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.439+0000 7efd0d638740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e465e69a0 0x564e465e23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:56.440 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.439+0000 7efd0d638740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564e465e72e0 0x564e465f8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:56.440 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.439+0000 7efd0d638740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e465ec370 0x564e465e2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:56.440 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.439+0000 7efd0d638740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7efd041ab080 con 0x564e465e69a0 2024-09-19T08:53:56.440 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.439+0000 7efd0d638740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efd041acc80 con 0x564e465e72e0 2024-09-19T08:53:56.440 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.439+0000 7efd0d638740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efd041ab750 con 0x564e465ec370 2024-09-19T08:53:56.440 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.439+0000 7efd03fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e465e69a0 0x564e465e23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:56.440 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.439+0000 7efd03fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e465e69a0 0x564e465e23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50104/0 (socket says 172.21.15.19:50104) 2024-09-19T08:53:56.440 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.439+0000 7efd03fff640 1 -- 172.21.15.19:0/1049477816 learned_addr learned my addr 172.21.15.19:0/1049477816 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:56.440 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.439+0000 7efd08e43640 1 --2- 172.21.15.19:0/1049477816 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e465ec370 0x564e465e2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:56.440 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.439+0000 7efd037fe640 1 --2- 172.21.15.19:0/1049477816 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564e465e72e0 0x564e465f8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:56.440 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.440+0000 7efd03fff640 1 -- 172.21.15.19:0/1049477816 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e465ec370 msgr2=0x564e465e2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:56.441 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.440+0000 7efd03fff640 1 --2- 172.21.15.19:0/1049477816 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e465ec370 0x564e465e2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.441 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.440+0000 7efd03fff640 1 -- 172.21.15.19:0/1049477816 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564e465e72e0 msgr2=0x564e465f8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:56.441 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.440+0000 7efd03fff640 1 --2- 172.21.15.19:0/1049477816 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564e465e72e0 0x564e465f8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.441 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.440+0000 7efd03fff640 1 -- 172.21.15.19:0/1049477816 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e465f0700 con 0x564e465e69a0 2024-09-19T08:53:56.441 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.440+0000 7efd03fff640 1 --2- 172.21.15.19:0/1049477816 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e465e69a0 0x564e465e23f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7efcf4098cd0 tx=0x7efcf40984e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e1364c3be4ebdd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:56.441 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.440+0000 7efce9ffb640 1 -- 172.21.15.19:0/1049477816 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf4014070 con 0x564e465e69a0 2024-09-19T08:53:56.441 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.440+0000 7efce9ffb640 1 -- 172.21.15.19:0/1049477816 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efcf40ba070 con 0x564e465e69a0 2024-09-19T08:53:56.441 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.440+0000 7efce9ffb640 1 -- 172.21.15.19:0/1049477816 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf409bcc0 con 0x564e465e69a0 2024-09-19T08:53:56.445 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.441+0000 7efd0d638740 1 -- 172.21.15.19:0/1049477816 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e465e69a0 msgr2=0x564e465e23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:56.445 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.441+0000 7efd0d638740 1 --2- 172.21.15.19:0/1049477816 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e465e69a0 0x564e465e23f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7efcf4098cd0 tx=0x7efcf40984e0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.445 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.441+0000 7efd0d638740 1 -- 172.21.15.19:0/1049477816 shutdown_connections 2024-09-19T08:53:56.445 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.441+0000 7efd0d638740 1 --2- 172.21.15.19:0/1049477816 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e465ec370 0x564e465e2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.445 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.441+0000 7efd0d638740 1 --2- 172.21.15.19:0/1049477816 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564e465e72e0 0x564e465f8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.445 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.441+0000 7efd0d638740 1 --2- 172.21.15.19:0/1049477816 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e465e69a0 0x564e465e23f0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.446 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.441+0000 7efd0d638740 1 -- 172.21.15.19:0/1049477816 >> 172.21.15.19:0/1049477816 conn(0x564e465e2010 msgr2=0x564e465f0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:56.446 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.441+0000 7efd0d638740 1 -- 172.21.15.19:0/1049477816 shutdown_connections 2024-09-19T08:53:56.446 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.441+0000 7efd0d638740 1 -- 172.21.15.19:0/1049477816 wait complete. 2024-09-19T08:53:56.446 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.441+0000 7efd0d638740 1 -- start start 2024-09-19T08:53:56.446 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.441+0000 7efd0d638740 1 Processor -- start 2024-09-19T08:53:56.446 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.442+0000 7efd0d638740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e465e69a0 0x564e465f5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:56.446 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.442+0000 7efd0d638740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564e465e72e0 0x564e465f5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:56.446 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.442+0000 7efd0d638740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e465ec370 0x564e466654b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:56.446 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.442+0000 7efd0d638740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7efd041ac4f0 con 0x564e465ec370 2024-09-19T08:53:56.446 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.442+0000 7efd0d638740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efd041abe20 con 0x564e465e72e0 2024-09-19T08:53:56.446 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.442+0000 7efd0d638740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efd041a9060 con 0x564e465e69a0 2024-09-19T08:53:56.447 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.442+0000 7efd0d638740 10 client.0 _ll_register_callbacks cb 0x7efcfc005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:56.447 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.442+0000 7efd08e43640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e465ec370 0x564e466654b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:56.447 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.442+0000 7efd08e43640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e465ec370 0x564e466654b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50120/0 (socket says 172.21.15.19:50120) 2024-09-19T08:53:56.447 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.442+0000 7efd08e43640 1 -- 172.21.15.19:0/2064032362 learned_addr learned my addr 172.21.15.19:0/2064032362 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:56.447 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.442+0000 7efd03fff640 1 --2- 172.21.15.19:0/2064032362 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e465e69a0 0x564e465f5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:56.447 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.442+0000 7efd037fe640 1 --2- 172.21.15.19:0/2064032362 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564e465e72e0 0x564e465f5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:56.447 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.442+0000 7efd08e43640 1 -- 172.21.15.19:0/2064032362 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e465e69a0 msgr2=0x564e465f5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:56.447 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.442+0000 7efd08e43640 1 --2- 172.21.15.19:0/2064032362 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e465e69a0 0x564e465f5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.447 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.442+0000 7efd08e43640 1 -- 172.21.15.19:0/2064032362 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564e465e72e0 msgr2=0x564e465f5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:56.447 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.442+0000 7efd08e43640 1 --2- 172.21.15.19:0/2064032362 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564e465e72e0 0x564e465f5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.447 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.442+0000 7efd08e43640 1 -- 172.21.15.19:0/2064032362 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e46665ac0 con 0x564e465ec370 2024-09-19T08:53:56.448 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.443+0000 7efd08e43640 1 --2- 172.21.15.19:0/2064032362 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e465ec370 0x564e466654b0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7efcfc02ade0 tx=0x7efcfc0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7069cde9a2f5bd8c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:56.448 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.443+0000 7efce37fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:53:56.448 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.443+0000 7efce37fe640 1 -- 172.21.15.19:0/2064032362 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcfc004080 con 0x564e465ec370 2024-09-19T08:53:56.448 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.443+0000 7efce37fe640 1 -- 172.21.15.19:0/2064032362 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7efcfc054040 con 0x564e465ec370 2024-09-19T08:53:56.448 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.443+0000 7efd0d638740 1 -- 172.21.15.19:0/2064032362 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efcf40ba070 con 0x564e465ec370 2024-09-19T08:53:56.448 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.443+0000 7efce37fe640 1 -- 172.21.15.19:0/2064032362 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7efcfc004220 con 0x564e465ec370 2024-09-19T08:53:56.448 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.443+0000 7efd0d638740 10 client.15831 fetch_fsmap learned FSMap version 30 2024-09-19T08:53:56.448 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.443+0000 7efd0d638740 1 -- 172.21.15.19:0/2064032362 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564e46666e70 con 0x564e465ec370 2024-09-19T08:53:56.448 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.443+0000 7efce37fe640 1 -- 172.21.15.19:0/2064032362 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efcf40ba070 con 0x564e465ec370 2024-09-19T08:53:56.448 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.443+0000 7efce37fe640 1 -- 172.21.15.19:0/2064032362 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7efcfc0305c0 con 0x564e465ec370 2024-09-19T08:53:56.448 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.443+0000 7efd0d638740 10 client.15831 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T08:53:56.449 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.443+0000 7efd0d638740 10 client.15831 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:53:56.449 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.443+0000 7efd0d638740 20 client.15831 populate_metadata read hostname 'smithi019' 2024-09-19T08:53:56.449 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.443+0000 7efd0d638740 1 --2- 172.21.15.19:0/2064032362 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x564e46667910 0x564e46669d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:56.449 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.443+0000 7efd0d638740 4 client.15831 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:53:56.449 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.443+0000 7efd0d638740 1 -- 172.21.15.19:0/2064032362 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564e46551d70 con 0x564e46667910 2024-09-19T08:53:56.449 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.444+0000 7efd03fff640 1 --2- 172.21.15.19:0/2064032362 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x564e46667910 0x564e46669d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:56.449 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.444+0000 7efd03fff640 1 --2- 172.21.15.19:0/2064032362 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x564e46667910 0x564e46669d30 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d979e14e3b9338c server_cookie=ba3d63323f845053 in_seq=0 out_seq=0 2024-09-19T08:53:56.449 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.444+0000 7efce37fe640 10 client.15831 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:56.450 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:56.451 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.451+0000 7efce37fe640 1 -- 172.21.15.19:0/2064032362 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564e46551d70 con 0x564e46667910 2024-09-19T08:53:56.451 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.451+0000 7efce37fe640 10 client.15831 handle_command_reply: tid=0 2024-09-19T08:53:56.451 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.451+0000 7efd0d638740 1 client.15831 shutdown 2024-09-19T08:53:56.451 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.451+0000 7efd0d638740 1 -- 172.21.15.19:0/2064032362 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e465ec370 msgr2=0x564e466654b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:56.451 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.451+0000 7efd0d638740 1 --2- 172.21.15.19:0/2064032362 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e465ec370 0x564e466654b0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7efcfc02ade0 tx=0x7efcfc0095c0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.451 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.451+0000 7efd0d638740 1 -- 172.21.15.19:0/2064032362 shutdown_connections 2024-09-19T08:53:56.451 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.451+0000 7efd0d638740 1 --2- 172.21.15.19:0/2064032362 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x564e46667910 0x564e46669d30 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.451 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.451+0000 7efd0d638740 1 --2- 172.21.15.19:0/2064032362 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564e465ec370 0x564e466654b0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.451 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.451+0000 7efce37fe640 0 client.15831 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:56.452 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.451+0000 7efd0d638740 1 --2- 172.21.15.19:0/2064032362 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564e465e72e0 0x564e465f5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.452 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.451+0000 7efd0d638740 1 --2- 172.21.15.19:0/2064032362 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e465e69a0 0x564e465f5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.452 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.451+0000 7efd0d638740 1 -- 172.21.15.19:0/2064032362 >> 172.21.15.19:0/2064032362 conn(0x564e465e2010 msgr2=0x564e465e09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:56.452 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.451+0000 7efd0d638740 1 -- 172.21.15.19:0/2064032362 shutdown_connections 2024-09-19T08:53:56.452 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.451+0000 7efd0d638740 1 -- 172.21.15.19:0/2064032362 wait complete. 2024-09-19T08:53:56.452 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.451+0000 7efd0d638740 20 client.15831 trim_cache size 0 max 16384 2024-09-19T08:53:56.452 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T08:53:56.452 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T08:53:56.453 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T08:53:56.453 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T08:53:56.453 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.452+0000 7efd0a8a6640 1 -- 172.21.15.19:0/4200971932 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7efcec0a3460 msgr2=0x7efcec0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:56.454 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.452+0000 7efd0a8a6640 1 --2- 172.21.15.19:0/4200971932 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7efcec0a3460 0x7efcec0a5920 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7efd0419b420 tx=0x7efcf800a2d0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.454 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.452+0000 7efd0a8a6640 1 -- 172.21.15.19:0/4200971932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd04101b60 msgr2=0x7efd04199f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:56.454 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.452+0000 7efd0a8a6640 1 --2- 172.21.15.19:0/4200971932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd04101b60 0x7efd04199f10 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7efcf400d950 tx=0x7efcf400dd50 comp rx=0 tx=0).stop 2024-09-19T08:53:56.454 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.452+0000 7efd0a8a6640 1 -- 172.21.15.19:0/4200971932 shutdown_connections 2024-09-19T08:53:56.454 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.452+0000 7efd0a8a6640 1 --2- 172.21.15.19:0/4200971932 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7efcec0a3460 0x7efcec0a5920 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.454 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.452+0000 7efd0a8a6640 1 --2- 172.21.15.19:0/4200971932 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd04103710 0x7efd041a14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.454 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.452+0000 7efd0a8a6640 1 --2- 172.21.15.19:0/4200971932 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efd04102d50 0x7efd0419a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.454 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.452+0000 7efd0a8a6640 1 --2- 172.21.15.19:0/4200971932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efd04101b60 0x7efd04199f10 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.454 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.452+0000 7efd0a8a6640 1 -- 172.21.15.19:0/4200971932 >> 172.21.15.19:0/4200971932 conn(0x7efd040fd2e0 msgr2=0x7efd04074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:56.454 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.452+0000 7efd0a8a6640 1 -- 172.21.15.19:0/4200971932 shutdown_connections 2024-09-19T08:53:56.454 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:53:56.452+0000 7efd0a8a6640 1 -- 172.21.15.19:0/4200971932 wait complete. 2024-09-19T08:53:56.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.947+0000 7f02c5bb2640 1 -- 172.21.15.19:0/3503030582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02c0105f40 msgr2=0x7f02c01063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:56.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.947+0000 7f02c5bb2640 1 --2- 172.21.15.19:0/3503030582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02c0105f40 0x7f02c01063d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f02b8009ca0 tx=0x7f02b802a940 comp rx=0 tx=0).stop 2024-09-19T08:53:56.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.948+0000 7f02c5bb2640 1 -- 172.21.15.19:0/3503030582 shutdown_connections 2024-09-19T08:53:56.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.948+0000 7f02c5bb2640 1 --2- 172.21.15.19:0/3503030582 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02c0101450 0x7f02c0105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.948+0000 7f02c5bb2640 1 --2- 172.21.15.19:0/3503030582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02c0105f40 0x7f02c01063d0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.948+0000 7f02c5bb2640 1 --2- 172.21.15.19:0/3503030582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02c0100b30 0x7f02c0100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.948+0000 7f02c5bb2640 1 -- 172.21.15.19:0/3503030582 >> 172.21.15.19:0/3503030582 conn(0x7f02c00fc7a0 msgr2=0x7f02c00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:56.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.948+0000 7f02c5bb2640 1 -- 172.21.15.19:0/3503030582 shutdown_connections 2024-09-19T08:53:56.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.948+0000 7f02c5bb2640 1 -- 172.21.15.19:0/3503030582 wait complete. 2024-09-19T08:53:56.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.948+0000 7f02c5bb2640 1 Processor -- start 2024-09-19T08:53:56.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.948+0000 7f02c5bb2640 1 -- start start 2024-09-19T08:53:56.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.949+0000 7f02c5bb2640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02c0100b30 0x7f02c01a4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:56.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.949+0000 7f02c5bb2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02c0101450 0x7f02c01a4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:56.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.949+0000 7f02c5bb2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02c0105f40 0x7f02c019e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:56.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.949+0000 7f02c5bb2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f02c0118560 con 0x7f02c0101450 2024-09-19T08:53:56.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.949+0000 7f02c5bb2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f02c01183e0 con 0x7f02c0105f40 2024-09-19T08:53:56.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.949+0000 7f02c5bb2640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f02c01186e0 con 0x7f02c0100b30 2024-09-19T08:53:56.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.949+0000 7f02beffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02c0101450 0x7f02c01a4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:56.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.949+0000 7f02beffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02c0101450 0x7f02c01a4b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50136/0 (socket says 172.21.15.19:50136) 2024-09-19T08:53:56.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.949+0000 7f02beffd640 1 -- 172.21.15.19:0/1178417644 learned_addr learned my addr 172.21.15.19:0/1178417644 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:56.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.949+0000 7f02bf7fe640 1 --2- 172.21.15.19:0/1178417644 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02c0100b30 0x7f02c01a4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:56.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.949+0000 7f02bffff640 1 --2- 172.21.15.19:0/1178417644 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02c0105f40 0x7f02c019e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:56.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.949+0000 7f02beffd640 1 -- 172.21.15.19:0/1178417644 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02c0100b30 msgr2=0x7f02c01a4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:56.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.949+0000 7f02beffd640 1 --2- 172.21.15.19:0/1178417644 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02c0100b30 0x7f02c01a4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.949+0000 7f02beffd640 1 -- 172.21.15.19:0/1178417644 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02c0105f40 msgr2=0x7f02c019e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:56.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.949+0000 7f02beffd640 1 --2- 172.21.15.19:0/1178417644 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02c0105f40 0x7f02c019e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.949+0000 7f02beffd640 1 -- 172.21.15.19:0/1178417644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c019ef50 con 0x7f02c0101450 2024-09-19T08:53:56.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.949+0000 7f02bffff640 1 --2- 172.21.15.19:0/1178417644 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02c0105f40 0x7f02c019e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:53:56.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.949+0000 7f02beffd640 1 --2- 172.21.15.19:0/1178417644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02c0101450 0x7f02c01a4b70 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f02b400d950 tx=0x7f02b400dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:56.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.949+0000 7f02bcff9640 1 -- 172.21.15.19:0/1178417644 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b4017030 con 0x7f02c0101450 2024-09-19T08:53:56.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.949+0000 7f02c5bb2640 1 -- 172.21.15.19:0/1178417644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02c019f240 con 0x7f02c0101450 2024-09-19T08:53:56.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.949+0000 7f02bcff9640 1 -- 172.21.15.19:0/1178417644 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02b400be10 con 0x7f02c0101450 2024-09-19T08:53:56.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.949+0000 7f02bcff9640 1 -- 172.21.15.19:0/1178417644 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b40055f0 con 0x7f02c0101450 2024-09-19T08:53:56.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.950+0000 7f02c5bb2640 1 -- 172.21.15.19:0/1178417644 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02c01ab490 con 0x7f02c0101450 2024-09-19T08:53:56.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.952+0000 7f02bcff9640 1 -- 172.21.15.19:0/1178417644 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f02b4009a30 con 0x7f02c0101450 2024-09-19T08:53:56.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.952+0000 7f02bcff9640 1 --2- 172.21.15.19:0/1178417644 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f02a80a3240 0x7f02a80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:56.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.953+0000 7f02bf7fe640 1 --2- 172.21.15.19:0/1178417644 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f02a80a3240 0x7f02a80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:56.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.953+0000 7f02bcff9640 1 -- 172.21.15.19:0/1178417644 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f02b40cf200 con 0x7f02c0101450 2024-09-19T08:53:56.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.953+0000 7f02bf7fe640 1 --2- 172.21.15.19:0/1178417644 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f02a80a3240 0x7f02a80a5700 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f02b000abe0 tx=0x7f02b000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:56.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.976+0000 7f02c7f8b740 1 Processor -- start 2024-09-19T08:53:56.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.976+0000 7f02c7f8b740 1 -- start start 2024-09-19T08:53:56.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.977+0000 7f02c7f8b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56113d20bb40 0x56113d20a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:56.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.977+0000 7f02c7f8b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56113d20a5d0 0x56113d20aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:56.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.977+0000 7f02c7f8b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56113d215370 0x56113d217760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:56.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.977+0000 7f02c7f8b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56113d1702f0 con 0x56113d20a5d0 2024-09-19T08:53:56.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.977+0000 7f02c7f8b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56113d117cf0 con 0x56113d215370 2024-09-19T08:53:56.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.977+0000 7f02c7f8b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56113d16c2b0 con 0x56113d20bb40 2024-09-19T08:53:56.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.977+0000 7f02beffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56113d20a5d0 0x56113d20aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:56.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.977+0000 7f02beffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56113d20a5d0 0x56113d20aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50138/0 (socket says 172.21.15.19:50138) 2024-09-19T08:53:56.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.977+0000 7f02beffd640 1 -- 172.21.15.19:0/329886367 learned_addr learned my addr 172.21.15.19:0/329886367 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:56.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.977+0000 7f02bf7fe640 1 --2- 172.21.15.19:0/329886367 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56113d20bb40 0x56113d20a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:56.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.977+0000 7f02bffff640 1 --2- 172.21.15.19:0/329886367 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56113d215370 0x56113d217760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:56.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.977+0000 7f02beffd640 1 -- 172.21.15.19:0/329886367 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56113d20bb40 msgr2=0x56113d20a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:56.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.977+0000 7f02beffd640 1 --2- 172.21.15.19:0/329886367 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56113d20bb40 0x56113d20a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.977+0000 7f02beffd640 1 -- 172.21.15.19:0/329886367 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56113d215370 msgr2=0x56113d217760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:56.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.977+0000 7f02beffd640 1 --2- 172.21.15.19:0/329886367 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56113d215370 0x56113d217760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.977+0000 7f02beffd640 1 -- 172.21.15.19:0/329886367 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56113d0fc3a0 con 0x56113d20a5d0 2024-09-19T08:53:56.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.977+0000 7f02beffd640 1 --2- 172.21.15.19:0/329886367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56113d20a5d0 0x56113d20aa10 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f02b40a3f70 tx=0x7f02b409b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0f9e3b407c3b0c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:56.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.977+0000 7f02a5ffb640 1 -- 172.21.15.19:0/329886367 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b40b3020 con 0x56113d20a5d0 2024-09-19T08:53:56.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.978+0000 7f02a5ffb640 1 -- 172.21.15.19:0/329886367 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02b409bf30 con 0x56113d20a5d0 2024-09-19T08:53:56.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.978+0000 7f02a5ffb640 1 -- 172.21.15.19:0/329886367 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b4004020 con 0x56113d20a5d0 2024-09-19T08:53:56.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.978+0000 7f02c7f8b740 1 -- 172.21.15.19:0/329886367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56113d20a5d0 msgr2=0x56113d20aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:56.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.978+0000 7f02c7f8b740 1 --2- 172.21.15.19:0/329886367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56113d20a5d0 0x56113d20aa10 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f02b40a3f70 tx=0x7f02b409b430 comp rx=0 tx=0).stop 2024-09-19T08:53:56.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.978+0000 7f02c7f8b740 1 -- 172.21.15.19:0/329886367 shutdown_connections 2024-09-19T08:53:56.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.978+0000 7f02c7f8b740 1 --2- 172.21.15.19:0/329886367 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56113d215370 0x56113d217760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.978+0000 7f02c7f8b740 1 --2- 172.21.15.19:0/329886367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56113d20a5d0 0x56113d20aa10 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.978+0000 7f02c7f8b740 1 --2- 172.21.15.19:0/329886367 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56113d20bb40 0x56113d20a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.978+0000 7f02c7f8b740 1 -- 172.21.15.19:0/329886367 >> 172.21.15.19:0/329886367 conn(0x56113d1d3310 msgr2=0x56113d206c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:56.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.978+0000 7f02c7f8b740 1 -- 172.21.15.19:0/329886367 shutdown_connections 2024-09-19T08:53:56.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.978+0000 7f02c7f8b740 1 -- 172.21.15.19:0/329886367 wait complete. 2024-09-19T08:53:56.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.979+0000 7f02c7f8b740 1 -- start start 2024-09-19T08:53:56.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.979+0000 7f02c7f8b740 1 Processor -- start 2024-09-19T08:53:56.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.979+0000 7f02c7f8b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56113d20a5d0 0x56113d212100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:56.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.979+0000 7f02c7f8b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56113d20bb40 0x56113d212640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:56.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.979+0000 7f02c7f8b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56113d215370 0x56113d212b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:56.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.979+0000 7f02c7f8b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56113d218070 con 0x56113d215370 2024-09-19T08:53:56.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.979+0000 7f02c7f8b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56113d12b060 con 0x56113d20bb40 2024-09-19T08:53:56.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.979+0000 7f02c7f8b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56113d2181f0 con 0x56113d20a5d0 2024-09-19T08:53:56.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.979+0000 7f02c7f8b740 10 client.0 _ll_register_callbacks cb 0x56113ce7e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:56.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.979+0000 7f02bffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56113d215370 0x56113d212b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:56.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.979+0000 7f02bffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56113d215370 0x56113d212b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50150/0 (socket says 172.21.15.19:50150) 2024-09-19T08:53:56.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.979+0000 7f02bffff640 1 -- 172.21.15.19:0/4014030601 learned_addr learned my addr 172.21.15.19:0/4014030601 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:56.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.980+0000 7f02beffd640 1 --2- 172.21.15.19:0/4014030601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56113d20bb40 0x56113d212640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:56.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.980+0000 7f02bf7fe640 1 --2- 172.21.15.19:0/4014030601 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56113d20a5d0 0x56113d212100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:56.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.980+0000 7f02bffff640 1 -- 172.21.15.19:0/4014030601 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56113d20a5d0 msgr2=0x56113d212100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:56.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.980+0000 7f02bffff640 1 --2- 172.21.15.19:0/4014030601 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56113d20a5d0 0x56113d212100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.980+0000 7f02bffff640 1 -- 172.21.15.19:0/4014030601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56113d20bb40 msgr2=0x56113d212640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:56.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.980+0000 7f02bffff640 1 --2- 172.21.15.19:0/4014030601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56113d20bb40 0x56113d212640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.980+0000 7f02bffff640 1 -- 172.21.15.19:0/4014030601 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56113cee13c0 con 0x56113d215370 2024-09-19T08:53:56.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.980+0000 7f02bf7fe640 1 --2- 172.21.15.19:0/4014030601 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56113d20a5d0 0x56113d212100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:53:56.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.980+0000 7f02bffff640 1 --2- 172.21.15.19:0/4014030601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56113d215370 0x56113d212b80 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f02b802fb60 tx=0x7f02b802fb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a8f555a4640e38 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:56.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.980+0000 7f029effd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:53:56.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.980+0000 7f029effd640 1 -- 172.21.15.19:0/4014030601 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b8034040 con 0x56113d215370 2024-09-19T08:53:56.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.980+0000 7f029effd640 1 -- 172.21.15.19:0/4014030601 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f02b8003970 con 0x56113d215370 2024-09-19T08:53:56.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.980+0000 7f02c7f8b740 1 -- 172.21.15.19:0/4014030601 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02b409bf30 con 0x56113d215370 2024-09-19T08:53:56.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.980+0000 7f029effd640 1 -- 172.21.15.19:0/4014030601 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f02b8003b70 con 0x56113d215370 2024-09-19T08:53:56.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.980+0000 7f02c7f8b740 10 client.15843 fetch_fsmap learned FSMap version 30 2024-09-19T08:53:56.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.980+0000 7f02c7f8b740 1 -- 172.21.15.19:0/4014030601 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56113d223c00 con 0x56113d215370 2024-09-19T08:53:56.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.981+0000 7f029effd640 1 -- 172.21.15.19:0/4014030601 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02b409bf30 con 0x56113d215370 2024-09-19T08:53:56.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.981+0000 7f029effd640 1 -- 172.21.15.19:0/4014030601 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f02b802f070 con 0x56113d215370 2024-09-19T08:53:56.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.981+0000 7f02c7f8b740 10 client.15843 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T08:53:56.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.981+0000 7f02c7f8b740 10 client.15843 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T08:53:56.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.981+0000 7f02c7f8b740 20 client.15843 populate_metadata read hostname 'smithi019' 2024-09-19T08:53:56.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.981+0000 7f02c7f8b740 1 --2- 172.21.15.19:0/4014030601 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x56113d2250c0 0x56113d2274b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:56.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.981+0000 7f02c7f8b740 4 client.15843 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:53:56.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.981+0000 7f02c7f8b740 1 -- 172.21.15.19:0/4014030601 --> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56113d17d860 con 0x56113d2250c0 2024-09-19T08:53:56.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.981+0000 7f02bf7fe640 1 --2- 172.21.15.19:0/4014030601 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x56113d2250c0 0x56113d2274b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:56.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.982+0000 7f02bf7fe640 1 --2- 172.21.15.19:0/4014030601 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x56113d2250c0 0x56113d2274b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=78c9b0849fa2d997 server_cookie=9302bc6ee539a76d in_seq=0 out_seq=0 2024-09-19T08:53:56.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.982+0000 7f029effd640 10 client.15843 ms_handle_connect on v2:172.21.15.203:6834/2702758353 2024-09-19T08:53:56.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.982+0000 7f029effd640 1 -- 172.21.15.19:0/4014030601 <== mds.4 v2:172.21.15.203:6834/2702758353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56113d17d860 con 0x56113d2250c0 2024-09-19T08:53:56.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.982+0000 7f029effd640 10 client.15843 handle_command_reply: tid=0 2024-09-19T08:53:56.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.982+0000 7f02c7f8b740 1 client.15843 shutdown 2024-09-19T08:53:56.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.983+0000 7f02c7f8b740 1 -- 172.21.15.19:0/4014030601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56113d215370 msgr2=0x56113d212b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:56.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.983+0000 7f02c7f8b740 1 --2- 172.21.15.19:0/4014030601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56113d215370 0x56113d212b80 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f02b802fb60 tx=0x7f02b802fb90 comp rx=0 tx=0).stop 2024-09-19T08:53:56.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.983+0000 7f02c7f8b740 1 -- 172.21.15.19:0/4014030601 shutdown_connections 2024-09-19T08:53:56.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.983+0000 7f02c7f8b740 1 --2- 172.21.15.19:0/4014030601 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x56113d2250c0 0x56113d2274b0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.983+0000 7f02c7f8b740 1 --2- 172.21.15.19:0/4014030601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56113d215370 0x56113d212b80 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.983+0000 7f02c7f8b740 1 --2- 172.21.15.19:0/4014030601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56113d20bb40 0x56113d212640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.983+0000 7f02c7f8b740 1 --2- 172.21.15.19:0/4014030601 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56113d20a5d0 0x56113d212100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.983+0000 7f029effd640 0 client.15843 ms_handle_reset on v2:172.21.15.203:6834/2702758353 2024-09-19T08:53:56.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.983+0000 7f02c7f8b740 1 -- 172.21.15.19:0/4014030601 >> 172.21.15.19:0/4014030601 conn(0x56113d1d3310 msgr2=0x56113d20c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:56.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.983+0000 7f02c7f8b740 1 -- 172.21.15.19:0/4014030601 shutdown_connections 2024-09-19T08:53:56.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.983+0000 7f02c7f8b740 1 -- 172.21.15.19:0/4014030601 wait complete. 2024-09-19T08:53:56.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.983+0000 7f02c7f8b740 20 client.15843 trim_cache size 0 max 16384 2024-09-19T08:53:56.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.996+0000 7f02c7f8b740 1 Processor -- start 2024-09-19T08:53:56.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.996+0000 7f02c7f8b740 1 -- start start 2024-09-19T08:53:56.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.996+0000 7f02c7f8b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56113d20a5d0 0x56113d2129d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:56.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.996+0000 7f02c7f8b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56113d20bb40 0x56113d214070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:56.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.996+0000 7f02c7f8b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56113d215370 0x56113d22cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:56.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.996+0000 7f02c7f8b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f02c01b3ba0 con 0x56113d215370 2024-09-19T08:53:56.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.996+0000 7f02c7f8b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f02c01b57a0 con 0x56113d20a5d0 2024-09-19T08:53:56.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.996+0000 7f02c7f8b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f02c01b4270 con 0x56113d20bb40 2024-09-19T08:53:56.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.996+0000 7f02bffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56113d215370 0x56113d22cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:56.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.996+0000 7f02bffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56113d215370 0x56113d22cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50154/0 (socket says 172.21.15.19:50154) 2024-09-19T08:53:56.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.996+0000 7f02bffff640 1 -- 172.21.15.19:0/601490012 learned_addr learned my addr 172.21.15.19:0/601490012 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:56.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.997+0000 7f02bf7fe640 1 --2- 172.21.15.19:0/601490012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56113d20a5d0 0x56113d2129d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:56.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.997+0000 7f02bffff640 1 -- 172.21.15.19:0/601490012 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56113d20bb40 msgr2=0x56113d214070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:56.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.997+0000 7f02bffff640 1 --2- 172.21.15.19:0/601490012 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56113d20bb40 0x56113d214070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.997+0000 7f02bffff640 1 -- 172.21.15.19:0/601490012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56113d20a5d0 msgr2=0x56113d2129d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:56.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.997+0000 7f02bffff640 1 --2- 172.21.15.19:0/601490012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56113d20a5d0 0x56113d2129d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:56.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.997+0000 7f02bffff640 1 -- 172.21.15.19:0/601490012 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56113d227820 con 0x56113d215370 2024-09-19T08:53:56.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.997+0000 7f02bf7fe640 1 --2- 172.21.15.19:0/601490012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56113d20a5d0 0x56113d2129d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:53:56.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.997+0000 7f02bffff640 1 --2- 172.21.15.19:0/601490012 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56113d215370 0x56113d22cd80 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f02b8004210 tx=0x7f02b8009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d958557b074a15fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:56.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.997+0000 7f02a57fa640 1 -- 172.21.15.19:0/601490012 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b8055070 con 0x56113d215370 2024-09-19T08:53:56.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.997+0000 7f02a57fa640 1 -- 172.21.15.19:0/601490012 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02b803e030 con 0x56113d215370 2024-09-19T08:53:56.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.997+0000 7f02a57fa640 1 -- 172.21.15.19:0/601490012 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b8034040 con 0x56113d215370 2024-09-19T08:53:57.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.997+0000 7f02c7f8b740 1 -- 172.21.15.19:0/601490012 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56113d215370 msgr2=0x56113d22cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:57.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.997+0000 7f02c7f8b740 1 --2- 172.21.15.19:0/601490012 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56113d215370 0x56113d22cd80 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f02b8004210 tx=0x7f02b8009360 comp rx=0 tx=0).stop 2024-09-19T08:53:57.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.998+0000 7f02c7f8b740 1 -- 172.21.15.19:0/601490012 shutdown_connections 2024-09-19T08:53:57.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.998+0000 7f02c7f8b740 1 --2- 172.21.15.19:0/601490012 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56113d20bb40 0x56113d214070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:57.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.998+0000 7f02c7f8b740 1 --2- 172.21.15.19:0/601490012 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56113d215370 0x56113d22cd80 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:57.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.998+0000 7f02c7f8b740 1 --2- 172.21.15.19:0/601490012 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56113d20a5d0 0x56113d2129d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:57.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.998+0000 7f02c7f8b740 1 -- 172.21.15.19:0/601490012 >> 172.21.15.19:0/601490012 conn(0x56113d1d3310 msgr2=0x56113d213960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:57.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.998+0000 7f02c7f8b740 1 -- 172.21.15.19:0/601490012 shutdown_connections 2024-09-19T08:53:57.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.998+0000 7f02c7f8b740 1 -- 172.21.15.19:0/601490012 wait complete. 2024-09-19T08:53:57.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.998+0000 7f02c7f8b740 1 -- start start 2024-09-19T08:53:57.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.998+0000 7f02c7f8b740 1 Processor -- start 2024-09-19T08:53:57.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.998+0000 7f02c7f8b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56113d20a5d0 0x56113d21dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:57.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.998+0000 7f02c7f8b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56113d20bb40 0x56113d218f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:57.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.998+0000 7f02c7f8b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56113d215370 0x56113d219460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:57.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.998+0000 7f02c7f8b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f02c01b5010 con 0x56113d20a5d0 2024-09-19T08:53:57.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.998+0000 7f02c7f8b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f02c01b4940 con 0x56113d215370 2024-09-19T08:53:57.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.998+0000 7f02c7f8b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f02c01b1b80 con 0x56113d20bb40 2024-09-19T08:53:57.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.999+0000 7f02c7f8b740 10 client.0 _ll_register_callbacks cb 0x7f02b8009890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:57.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.999+0000 7f02bf7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56113d20a5d0 0x56113d21dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:57.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.999+0000 7f02bf7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56113d20a5d0 0x56113d21dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50160/0 (socket says 172.21.15.19:50160) 2024-09-19T08:53:57.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.999+0000 7f02bf7fe640 1 -- 172.21.15.19:0/3775923035 learned_addr learned my addr 172.21.15.19:0/3775923035 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:57.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.999+0000 7f02bffff640 1 --2- 172.21.15.19:0/3775923035 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56113d215370 0x56113d219460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:57.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.999+0000 7f02beffd640 1 --2- 172.21.15.19:0/3775923035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56113d20bb40 0x56113d218f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:57.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.999+0000 7f02bf7fe640 1 -- 172.21.15.19:0/3775923035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56113d20bb40 msgr2=0x56113d218f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:57.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.999+0000 7f02bf7fe640 1 --2- 172.21.15.19:0/3775923035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56113d20bb40 0x56113d218f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:57.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.999+0000 7f02bf7fe640 1 -- 172.21.15.19:0/3775923035 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56113d215370 msgr2=0x56113d219460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:57.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.999+0000 7f02bf7fe640 1 --2- 172.21.15.19:0/3775923035 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56113d215370 0x56113d219460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:57.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.999+0000 7f02bf7fe640 1 -- 172.21.15.19:0/3775923035 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56113d219cb0 con 0x56113d20a5d0 2024-09-19T08:53:57.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.999+0000 7f02beffd640 1 --2- 172.21.15.19:0/3775923035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56113d20bb40 0x56113d218f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:53:57.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.999+0000 7f02bffff640 1 --2- 172.21.15.19:0/3775923035 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56113d215370 0x56113d219460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:53:57.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.999+0000 7f02bf7fe640 1 --2- 172.21.15.19:0/3775923035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56113d20a5d0 0x56113d21dbf0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f02b0005e10 tx=0x7f02b0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d84e36128c50f07 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:57.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.999+0000 7f029effd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:53:57.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.999+0000 7f029effd640 1 -- 172.21.15.19:0/3775923035 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02b0016070 con 0x56113d20a5d0 2024-09-19T08:53:57.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.999+0000 7f02c7f8b740 1 -- 172.21.15.19:0/3775923035 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f02b803e030 con 0x56113d20a5d0 2024-09-19T08:53:57.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.999+0000 7f029effd640 1 -- 172.21.15.19:0/3775923035 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f02b001c830 con 0x56113d20a5d0 2024-09-19T08:53:57.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.999+0000 7f029effd640 1 -- 172.21.15.19:0/3775923035 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f02b001ca30 con 0x56113d20a5d0 2024-09-19T08:53:57.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.999+0000 7f02c7f8b740 10 client.15849 fetch_fsmap learned FSMap version 30 2024-09-19T08:53:57.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:56.999+0000 7f02c7f8b740 1 -- 172.21.15.19:0/3775923035 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56113d28fd50 con 0x56113d20a5d0 2024-09-19T08:53:57.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.000+0000 7f029effd640 1 -- 172.21.15.19:0/3775923035 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f02b803e030 con 0x56113d20a5d0 2024-09-19T08:53:57.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.000+0000 7f029effd640 1 -- 172.21.15.19:0/3775923035 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f02b0029400 con 0x56113d20a5d0 2024-09-19T08:53:57.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.000+0000 7f02c7f8b740 10 client.15849 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T08:53:57.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.000+0000 7f02c7f8b740 10 client.15849 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T08:53:57.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.000+0000 7f02c7f8b740 20 client.15849 populate_metadata read hostname 'smithi019' 2024-09-19T08:53:57.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.000+0000 7f02c7f8b740 1 --2- 172.21.15.19:0/3775923035 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x56113d290470 0x56113d2928a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:57.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.000+0000 7f02c7f8b740 4 client.15849 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:53:57.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.000+0000 7f02c7f8b740 1 -- 172.21.15.19:0/3775923035 --> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56113d177d70 con 0x56113d290470 2024-09-19T08:53:57.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.000+0000 7f02beffd640 1 --2- 172.21.15.19:0/3775923035 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x56113d290470 0x56113d2928a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:57.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.001+0000 7f02beffd640 1 --2- 172.21.15.19:0/3775923035 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x56113d290470 0x56113d2928a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6c34bbc243544350 server_cookie=8dd2cd33ddf38bc in_seq=0 out_seq=0 2024-09-19T08:53:57.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.001+0000 7f029effd640 10 client.15849 ms_handle_connect on v2:172.21.15.203:6834/2702758353 2024-09-19T08:53:57.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.001+0000 7f029effd640 1 -- 172.21.15.19:0/3775923035 <== mds.4 v2:172.21.15.203:6834/2702758353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56113d177d70 con 0x56113d290470 2024-09-19T08:53:57.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.001+0000 7f029effd640 10 client.15849 handle_command_reply: tid=0 2024-09-19T08:53:57.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.001+0000 7f02c7f8b740 1 client.15849 shutdown 2024-09-19T08:53:57.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.001+0000 7f02c7f8b740 1 -- 172.21.15.19:0/3775923035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56113d20a5d0 msgr2=0x56113d21dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:57.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.001+0000 7f02c7f8b740 1 --2- 172.21.15.19:0/3775923035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56113d20a5d0 0x56113d21dbf0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f02b0005e10 tx=0x7f02b0004730 comp rx=0 tx=0).stop 2024-09-19T08:53:57.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.001+0000 7f02c7f8b740 1 -- 172.21.15.19:0/3775923035 shutdown_connections 2024-09-19T08:53:57.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.001+0000 7f02c7f8b740 1 --2- 172.21.15.19:0/3775923035 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x56113d290470 0x56113d2928a0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:57.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.001+0000 7f029effd640 0 client.15849 ms_handle_reset on v2:172.21.15.203:6834/2702758353 2024-09-19T08:53:57.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.001+0000 7f02c7f8b740 1 --2- 172.21.15.19:0/3775923035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56113d20bb40 0x56113d218f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:57.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.001+0000 7f02c7f8b740 1 --2- 172.21.15.19:0/3775923035 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56113d215370 0x56113d219460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:57.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.001+0000 7f02c7f8b740 1 --2- 172.21.15.19:0/3775923035 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56113d20a5d0 0x56113d21dbf0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:57.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.001+0000 7f02c7f8b740 1 -- 172.21.15.19:0/3775923035 >> 172.21.15.19:0/3775923035 conn(0x56113d1d3310 msgr2=0x56113d20c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:57.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.001+0000 7f02c7f8b740 1 -- 172.21.15.19:0/3775923035 shutdown_connections 2024-09-19T08:53:57.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.001+0000 7f02c7f8b740 1 -- 172.21.15.19:0/3775923035 wait complete. 2024-09-19T08:53:57.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.002+0000 7f02c7f8b740 20 client.15849 trim_cache size 0 max 16384 2024-09-19T08:53:57.006 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T08:53:57.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.002+0000 7f02c5bb2640 1 -- 172.21.15.19:0/1178417644 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f02a80a3240 msgr2=0x7f02a80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:57.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.002+0000 7f02c5bb2640 1 --2- 172.21.15.19:0/1178417644 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f02a80a3240 0x7f02a80a5700 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f02b000abe0 tx=0x7f02b000a2d0 comp rx=0 tx=0).stop 2024-09-19T08:53:57.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.002+0000 7f02c5bb2640 1 -- 172.21.15.19:0/1178417644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02c0101450 msgr2=0x7f02c01a4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:57.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.002+0000 7f02c5bb2640 1 --2- 172.21.15.19:0/1178417644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02c0101450 0x7f02c01a4b70 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f02b400d950 tx=0x7f02b400dd50 comp rx=0 tx=0).stop 2024-09-19T08:53:57.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.002+0000 7f02c5bb2640 1 -- 172.21.15.19:0/1178417644 shutdown_connections 2024-09-19T08:53:57.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.002+0000 7f02c5bb2640 1 --2- 172.21.15.19:0/1178417644 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f02a80a3240 0x7f02a80a5700 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:57.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.002+0000 7f02c5bb2640 1 --2- 172.21.15.19:0/1178417644 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f02c0105f40 0x7f02c019e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:57.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.002+0000 7f02c5bb2640 1 --2- 172.21.15.19:0/1178417644 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f02c0101450 0x7f02c01a4b70 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:57.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.002+0000 7f02c5bb2640 1 --2- 172.21.15.19:0/1178417644 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f02c0100b30 0x7f02c01a4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:57.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.002+0000 7f02c5bb2640 1 -- 172.21.15.19:0/1178417644 >> 172.21.15.19:0/1178417644 conn(0x7f02c00fc7a0 msgr2=0x7f02c01038c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:57.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.002+0000 7f02c5bb2640 1 -- 172.21.15.19:0/1178417644 shutdown_connections 2024-09-19T08:53:57.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:57.002+0000 7f02c5bb2640 1 -- 172.21.15.19:0/1178417644 wait complete. 2024-09-19T08:53:57.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:57 smithi155 ceph-mon[34921]: pgmap v389: 97 pgs: 97 active+clean; 799 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.5 KiB/s wr, 11 op/s 2024-09-19T08:53:57.727 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:57 smithi019 ceph-mon[30976]: pgmap v389: 97 pgs: 97 active+clean; 799 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.5 KiB/s wr, 11 op/s 2024-09-19T08:53:57.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:57 smithi203 ceph-mon[35450]: pgmap v389: 97 pgs: 97 active+clean; 799 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 4.5 KiB/s wr, 11 op/s 2024-09-19T08:53:57.755 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T08:53:57.815 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:58.413 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:53:58.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.414+0000 7fdcd3eeb640 1 -- 172.21.15.19:0/2977183033 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdccc106b80 msgr2=0x7fdccc106f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:58.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.414+0000 7fdcd3eeb640 1 --2- 172.21.15.19:0/2977183033 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdccc106b80 0x7fdccc106f60 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8009900 tx=0x7fdcc802a410 comp rx=0 tx=0).stop 2024-09-19T08:53:58.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.414+0000 7fdcd3eeb640 1 -- 172.21.15.19:0/2977183033 shutdown_connections 2024-09-19T08:53:58.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.414+0000 7fdcd3eeb640 1 --2- 172.21.15.19:0/2977183033 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdccc100100 0x7fdccc100560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:58.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.414+0000 7fdcd3eeb640 1 --2- 172.21.15.19:0/2977183033 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdccc100aa0 0x7fdccc10ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:58.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.414+0000 7fdcd3eeb640 1 --2- 172.21.15.19:0/2977183033 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdccc106b80 0x7fdccc106f60 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:58.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.414+0000 7fdcd3eeb640 1 -- 172.21.15.19:0/2977183033 >> 172.21.15.19:0/2977183033 conn(0x7fdccc077230 msgr2=0x7fdccc0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:58.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.414+0000 7fdcd3eeb640 1 -- 172.21.15.19:0/2977183033 shutdown_connections 2024-09-19T08:53:58.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.414+0000 7fdcd3eeb640 1 -- 172.21.15.19:0/2977183033 wait complete. 2024-09-19T08:53:58.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.415+0000 7fdcd3eeb640 1 Processor -- start 2024-09-19T08:53:58.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.415+0000 7fdcd3eeb640 1 -- start start 2024-09-19T08:53:58.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.415+0000 7fdcd3eeb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdccc100100 0x7fdccc1012e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:58.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.415+0000 7fdcd3eeb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdccc100aa0 0x7fdccc101820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:58.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.415+0000 7fdcd3eeb640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdccc106b80 0x7fdccc101d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:58.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.416+0000 7fdcd3eeb640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdccc112010 con 0x7fdccc100100 2024-09-19T08:53:58.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.416+0000 7fdcd3eeb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdccc111e90 con 0x7fdccc100aa0 2024-09-19T08:53:58.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.416+0000 7fdcd3eeb640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdccc112190 con 0x7fdccc106b80 2024-09-19T08:53:58.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.416+0000 7fdcd1c87640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdccc100100 0x7fdccc1012e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:58.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.416+0000 7fdcd1c87640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdccc100100 0x7fdccc1012e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50168/0 (socket says 172.21.15.19:50168) 2024-09-19T08:53:58.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.416+0000 7fdcd1c87640 1 -- 172.21.15.19:0/799595348 learned_addr learned my addr 172.21.15.19:0/799595348 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:58.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.416+0000 7fdcd1486640 1 --2- 172.21.15.19:0/799595348 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdccc100aa0 0x7fdccc101820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:58.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.416+0000 7fdcd2488640 1 --2- 172.21.15.19:0/799595348 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdccc106b80 0x7fdccc101d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:58.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.416+0000 7fdcd1c87640 1 -- 172.21.15.19:0/799595348 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdccc106b80 msgr2=0x7fdccc101d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:58.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.416+0000 7fdcd1c87640 1 --2- 172.21.15.19:0/799595348 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdccc106b80 0x7fdccc101d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:58.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.416+0000 7fdcd1c87640 1 -- 172.21.15.19:0/799595348 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdccc100aa0 msgr2=0x7fdccc101820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:58.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.416+0000 7fdcd1c87640 1 --2- 172.21.15.19:0/799595348 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdccc100aa0 0x7fdccc101820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:58.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.416+0000 7fdcd1c87640 1 -- 172.21.15.19:0/799595348 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdccc1a6970 con 0x7fdccc100100 2024-09-19T08:53:58.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.416+0000 7fdcd1c87640 1 --2- 172.21.15.19:0/799595348 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdccc100100 0x7fdccc1012e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8006010 tx=0x7fdcc80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:58.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.416+0000 7fdcc2ffd640 1 -- 172.21.15.19:0/799595348 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc803f030 con 0x7fdccc100100 2024-09-19T08:53:58.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.417+0000 7fdcd3eeb640 1 -- 172.21.15.19:0/799595348 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdccc1a6c00 con 0x7fdccc100100 2024-09-19T08:53:58.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.417+0000 7fdcc2ffd640 1 -- 172.21.15.19:0/799595348 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdcc8003ce0 con 0x7fdccc100100 2024-09-19T08:53:58.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.417+0000 7fdcc2ffd640 1 -- 172.21.15.19:0/799595348 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc8035070 con 0x7fdccc100100 2024-09-19T08:53:58.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.417+0000 7fdcd3eeb640 1 -- 172.21.15.19:0/799595348 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdccc1a7130 con 0x7fdccc100100 2024-09-19T08:53:58.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.419+0000 7fdcc2ffd640 1 -- 172.21.15.19:0/799595348 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fdcc8042030 con 0x7fdccc100100 2024-09-19T08:53:58.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.419+0000 7fdcd62c4740 1 Processor -- start 2024-09-19T08:53:58.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.420+0000 7fdcd62c4740 1 -- start start 2024-09-19T08:53:58.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.420+0000 7fdcd62c4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55de6d221060 0x55de6d221440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:58.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.420+0000 7fdcd62c4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55de6d221980 0x55de6d22bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:58.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.420+0000 7fdcd62c4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de6d22c240 0x55de6d22e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:58.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.420+0000 7fdcd62c4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55de6d186620 con 0x55de6d22c240 2024-09-19T08:53:58.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.420+0000 7fdcd62c4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55de6d12de50 con 0x55de6d221980 2024-09-19T08:53:58.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.420+0000 7fdcd62c4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55de6d1825e0 con 0x55de6d221060 2024-09-19T08:53:58.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.420+0000 7fdcd1486640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de6d22c240 0x55de6d22e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:58.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.420+0000 7fdcd1486640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de6d22c240 0x55de6d22e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50180/0 (socket says 172.21.15.19:50180) 2024-09-19T08:53:58.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.420+0000 7fdcd1486640 1 -- 172.21.15.19:0/497878571 learned_addr learned my addr 172.21.15.19:0/497878571 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:58.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.420+0000 7fdcd2488640 1 --2- 172.21.15.19:0/497878571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55de6d221060 0x55de6d221440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:58.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.420+0000 7fdcc2ffd640 1 --2- 172.21.15.19:0/799595348 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fdcb80a3240 0x7fdcb80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:58.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.420+0000 7fdcd1c87640 1 --2- 172.21.15.19:0/497878571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55de6d221980 0x55de6d22bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:58.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.421+0000 7fdcd2488640 1 --2- 172.21.15.19:0/799595348 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fdcb80a3240 0x7fdcb80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:58.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.421+0000 7fdcd1486640 1 -- 172.21.15.19:0/497878571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55de6d221060 msgr2=0x55de6d221440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:58.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.421+0000 7fdcd1486640 1 --2- 172.21.15.19:0/497878571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55de6d221060 0x55de6d221440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:58.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.421+0000 7fdcd1486640 1 -- 172.21.15.19:0/497878571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55de6d221980 msgr2=0x55de6d22bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:58.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.421+0000 7fdcd1486640 1 --2- 172.21.15.19:0/497878571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55de6d221980 0x55de6d22bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:58.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.421+0000 7fdcd1486640 1 -- 172.21.15.19:0/497878571 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de6d11ed40 con 0x55de6d22c240 2024-09-19T08:53:58.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.421+0000 7fdcc2ffd640 1 -- 172.21.15.19:0/799595348 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fdcc80efd60 con 0x7fdccc100100 2024-09-19T08:53:58.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.421+0000 7fdcd1486640 1 --2- 172.21.15.19:0/497878571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de6d22c240 0x55de6d22e630 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc00bcb0 tx=0x7fdcbc0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3631a73892ecfab8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:58.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.421+0000 7fdcb7fff640 1 -- 172.21.15.19:0/497878571 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc004030 con 0x55de6d22c240 2024-09-19T08:53:58.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.421+0000 7fdcd2488640 1 --2- 172.21.15.19:0/799595348 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fdcb80a3240 0x7fdcb80a5700 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdccc1077c0 tx=0x7fdcc4004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:58.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.421+0000 7fdcb7fff640 1 -- 172.21.15.19:0/497878571 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdcbc0041d0 con 0x55de6d22c240 2024-09-19T08:53:58.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.421+0000 7fdcb7fff640 1 -- 172.21.15.19:0/497878571 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc011800 con 0x55de6d22c240 2024-09-19T08:53:58.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.422+0000 7fdcd62c4740 1 -- 172.21.15.19:0/497878571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de6d22c240 msgr2=0x55de6d22e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:58.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.422+0000 7fdcd62c4740 1 --2- 172.21.15.19:0/497878571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de6d22c240 0x55de6d22e630 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc00bcb0 tx=0x7fdcbc0107a0 comp rx=0 tx=0).stop 2024-09-19T08:53:58.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.422+0000 7fdcd62c4740 1 -- 172.21.15.19:0/497878571 shutdown_connections 2024-09-19T08:53:58.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.422+0000 7fdcd62c4740 1 --2- 172.21.15.19:0/497878571 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de6d22c240 0x55de6d22e630 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:58.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.422+0000 7fdcd62c4740 1 --2- 172.21.15.19:0/497878571 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55de6d221980 0x55de6d22bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:58.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.422+0000 7fdcd62c4740 1 --2- 172.21.15.19:0/497878571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55de6d221060 0x55de6d221440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:58.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.422+0000 7fdcd62c4740 1 -- 172.21.15.19:0/497878571 >> 172.21.15.19:0/497878571 conn(0x55de6d21d5f0 msgr2=0x55de6d21d9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:58.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.422+0000 7fdcd62c4740 1 -- 172.21.15.19:0/497878571 shutdown_connections 2024-09-19T08:53:58.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.422+0000 7fdcd62c4740 1 -- 172.21.15.19:0/497878571 wait complete. 2024-09-19T08:53:58.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.423+0000 7fdcd62c4740 1 -- start start 2024-09-19T08:53:58.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.423+0000 7fdcd62c4740 1 Processor -- start 2024-09-19T08:53:58.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.423+0000 7fdcd62c4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55de6d221060 0x55de6d229130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:58.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.423+0000 7fdcd62c4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de6d221980 0x55de6d229670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:58.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.423+0000 7fdcd62c4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55de6d22c240 0x55de6d229bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:58.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.423+0000 7fdcd62c4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55de6d22ee10 con 0x55de6d221980 2024-09-19T08:53:58.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.423+0000 7fdcd62c4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55de6d10ef10 con 0x55de6d22c240 2024-09-19T08:53:58.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.423+0000 7fdcd62c4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55de6d22ef90 con 0x55de6d221060 2024-09-19T08:53:58.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.423+0000 7fdcd62c4740 10 client.0 _ll_register_callbacks cb 0x55de6d132db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:58.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.423+0000 7fdcd1486640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de6d221980 0x55de6d229670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:58.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.423+0000 7fdcd1486640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de6d221980 0x55de6d229670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50190/0 (socket says 172.21.15.19:50190) 2024-09-19T08:53:58.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.423+0000 7fdcd1486640 1 -- 172.21.15.19:0/1118464876 learned_addr learned my addr 172.21.15.19:0/1118464876 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:58.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.423+0000 7fdcd1c87640 1 --2- 172.21.15.19:0/1118464876 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55de6d221060 0x55de6d229130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:58.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.424+0000 7fdcd2488640 1 --2- 172.21.15.19:0/1118464876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55de6d22c240 0x55de6d229bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:58.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.424+0000 7fdcd1486640 1 -- 172.21.15.19:0/1118464876 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55de6d221060 msgr2=0x55de6d229130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:58.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.424+0000 7fdcd1486640 1 --2- 172.21.15.19:0/1118464876 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55de6d221060 0x55de6d229130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:58.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.424+0000 7fdcd1486640 1 -- 172.21.15.19:0/1118464876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55de6d22c240 msgr2=0x55de6d229bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:58.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.424+0000 7fdcd1486640 1 --2- 172.21.15.19:0/1118464876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55de6d22c240 0x55de6d229bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:58.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.424+0000 7fdcd1486640 1 -- 172.21.15.19:0/1118464876 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de6ce95580 con 0x55de6d221980 2024-09-19T08:53:58.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.424+0000 7fdcd1c87640 1 --2- 172.21.15.19:0/1118464876 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55de6d221060 0x55de6d229130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:53:58.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.424+0000 7fdcd1486640 1 --2- 172.21.15.19:0/1118464876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de6d221980 0x55de6d229670 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc003f40 tx=0x7fdcbc003d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0685f6ec704d9c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:58.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.424+0000 7fdcb57fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:53:58.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.424+0000 7fdcb57fa640 1 -- 172.21.15.19:0/1118464876 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc004380 con 0x55de6d221980 2024-09-19T08:53:58.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.424+0000 7fdcb57fa640 1 -- 172.21.15.19:0/1118464876 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fdcbc0035f0 con 0x55de6d221980 2024-09-19T08:53:58.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.424+0000 7fdcd62c4740 1 -- 172.21.15.19:0/1118464876 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcbc0041d0 con 0x55de6d221980 2024-09-19T08:53:58.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.424+0000 7fdcb57fa640 1 -- 172.21.15.19:0/1118464876 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fdcbc0037f0 con 0x55de6d221980 2024-09-19T08:53:58.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.425+0000 7fdcd62c4740 10 client.15861 fetch_fsmap learned FSMap version 30 2024-09-19T08:53:58.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.425+0000 7fdcd62c4740 1 -- 172.21.15.19:0/1118464876 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55de6cf5f960 con 0x55de6d221980 2024-09-19T08:53:58.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.425+0000 7fdcb57fa640 1 -- 172.21.15.19:0/1118464876 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdcbc0041d0 con 0x55de6d221980 2024-09-19T08:53:58.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.425+0000 7fdcb57fa640 1 -- 172.21.15.19:0/1118464876 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fdcbc004750 con 0x55de6d221980 2024-09-19T08:53:58.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.425+0000 7fdcd62c4740 10 client.15861 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T08:53:58.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.425+0000 7fdcd62c4740 10 client.15861 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T08:53:58.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.425+0000 7fdcd62c4740 20 client.15861 populate_metadata read hostname 'smithi019' 2024-09-19T08:53:58.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.425+0000 7fdcd62c4740 1 --2- 172.21.15.19:0/1118464876 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55de6d23bd00 0x55de6d23e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:58.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.425+0000 7fdcd62c4740 4 client.15861 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:53:58.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.425+0000 7fdcd62c4740 1 -- 172.21.15.19:0/1118464876 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de6d193b90 con 0x55de6d23bd00 2024-09-19T08:53:58.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.425+0000 7fdcd1c87640 1 --2- 172.21.15.19:0/1118464876 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55de6d23bd00 0x55de6d23e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:58.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.426+0000 7fdcb57fa640 10 client.15861 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:58.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.426+0000 7fdcd1c87640 1 --2- 172.21.15.19:0/1118464876 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55de6d23bd00 0x55de6d23e0f0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c8a9f1ccf7f8cf7 server_cookie=c56080d7efd72163 in_seq=0 out_seq=0 2024-09-19T08:53:58.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.426+0000 7fdcb57fa640 1 -- 172.21.15.19:0/1118464876 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55de6d193b90 con 0x55de6d23bd00 2024-09-19T08:53:58.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.426+0000 7fdcb57fa640 10 client.15861 handle_command_reply: tid=0 2024-09-19T08:53:58.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.426+0000 7fdcd62c4740 1 client.15861 shutdown 2024-09-19T08:53:58.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.427+0000 7fdcd62c4740 1 -- 172.21.15.19:0/1118464876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de6d221980 msgr2=0x55de6d229670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:58.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.427+0000 7fdcd62c4740 1 --2- 172.21.15.19:0/1118464876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de6d221980 0x55de6d229670 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc003f40 tx=0x7fdcbc003d30 comp rx=0 tx=0).stop 2024-09-19T08:53:58.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.427+0000 7fdcd62c4740 1 -- 172.21.15.19:0/1118464876 shutdown_connections 2024-09-19T08:53:58.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.427+0000 7fdcd62c4740 1 --2- 172.21.15.19:0/1118464876 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55de6d23bd00 0x55de6d23e0f0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:58.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.427+0000 7fdcd62c4740 1 --2- 172.21.15.19:0/1118464876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55de6d22c240 0x55de6d229bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:58.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.427+0000 7fdcd62c4740 1 --2- 172.21.15.19:0/1118464876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de6d221980 0x55de6d229670 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:58.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.427+0000 7fdcb57fa640 0 client.15861 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:58.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.427+0000 7fdcd62c4740 1 --2- 172.21.15.19:0/1118464876 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55de6d221060 0x55de6d229130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:58.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.427+0000 7fdcd62c4740 1 -- 172.21.15.19:0/1118464876 >> 172.21.15.19:0/1118464876 conn(0x55de6d21d5f0 msgr2=0x55de6d2232d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:58.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.427+0000 7fdcd62c4740 1 -- 172.21.15.19:0/1118464876 shutdown_connections 2024-09-19T08:53:58.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.427+0000 7fdcd62c4740 1 -- 172.21.15.19:0/1118464876 wait complete. 2024-09-19T08:53:58.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.427+0000 7fdcd62c4740 20 client.15861 trim_cache size 0 max 16384 2024-09-19T08:53:58.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.449+0000 7fdcd62c4740 1 Processor -- start 2024-09-19T08:53:58.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.449+0000 7fdcd62c4740 1 -- start start 2024-09-19T08:53:58.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.449+0000 7fdcd62c4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55de6d221060 0x55de6d2246f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:58.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.449+0000 7fdcd62c4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55de6d221980 0x55de6d2231c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:58.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.449+0000 7fdcd62c4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de6d22c240 0x55de6d243940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:58.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.449+0000 7fdcd62c4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdccc1af6c0 con 0x55de6d22c240 2024-09-19T08:53:58.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.449+0000 7fdcd62c4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdccc1b12c0 con 0x55de6d221980 2024-09-19T08:53:58.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.449+0000 7fdcd62c4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdccc1afd90 con 0x55de6d221060 2024-09-19T08:53:58.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.450+0000 7fdcd2488640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de6d22c240 0x55de6d243940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:58.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.450+0000 7fdcd2488640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de6d22c240 0x55de6d243940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50192/0 (socket says 172.21.15.19:50192) 2024-09-19T08:53:58.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.450+0000 7fdcd2488640 1 -- 172.21.15.19:0/1036369695 learned_addr learned my addr 172.21.15.19:0/1036369695 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:58.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.450+0000 7fdcd1c87640 1 --2- 172.21.15.19:0/1036369695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55de6d221060 0x55de6d2246f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:58.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.450+0000 7fdcd1486640 1 --2- 172.21.15.19:0/1036369695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55de6d221980 0x55de6d2231c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:58.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.450+0000 7fdcd2488640 1 -- 172.21.15.19:0/1036369695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55de6d221060 msgr2=0x55de6d2246f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:58.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.450+0000 7fdcd2488640 1 --2- 172.21.15.19:0/1036369695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55de6d221060 0x55de6d2246f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:58.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.450+0000 7fdcd2488640 1 -- 172.21.15.19:0/1036369695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55de6d221980 msgr2=0x55de6d2231c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:58.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.450+0000 7fdcd2488640 1 --2- 172.21.15.19:0/1036369695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55de6d221980 0x55de6d2231c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:58.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.450+0000 7fdcd2488640 1 -- 172.21.15.19:0/1036369695 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de6d21bbb0 con 0x55de6d22c240 2024-09-19T08:53:58.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.450+0000 7fdcd2488640 1 --2- 172.21.15.19:0/1036369695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de6d22c240 0x55de6d243940 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4012b20 tx=0x7fdcc4009ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fda4fdfa3fac7039 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:58.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.450+0000 7fdcb77fe640 1 -- 172.21.15.19:0/1036369695 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc401a070 con 0x55de6d22c240 2024-09-19T08:53:58.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.450+0000 7fdcb77fe640 1 -- 172.21.15.19:0/1036369695 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdcc4026030 con 0x55de6d22c240 2024-09-19T08:53:58.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.450+0000 7fdcb77fe640 1 -- 172.21.15.19:0/1036369695 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4022740 con 0x55de6d22c240 2024-09-19T08:53:58.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.451+0000 7fdcd62c4740 1 -- 172.21.15.19:0/1036369695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de6d22c240 msgr2=0x55de6d243940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:58.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.451+0000 7fdcd62c4740 1 --2- 172.21.15.19:0/1036369695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de6d22c240 0x55de6d243940 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4012b20 tx=0x7fdcc4009ab0 comp rx=0 tx=0).stop 2024-09-19T08:53:58.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.452+0000 7fdcd62c4740 1 -- 172.21.15.19:0/1036369695 shutdown_connections 2024-09-19T08:53:58.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.452+0000 7fdcd62c4740 1 --2- 172.21.15.19:0/1036369695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de6d22c240 0x55de6d243940 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:58.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.452+0000 7fdcd62c4740 1 --2- 172.21.15.19:0/1036369695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55de6d221980 0x55de6d2231c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:58.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.452+0000 7fdcd62c4740 1 --2- 172.21.15.19:0/1036369695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55de6d221060 0x55de6d2246f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:58.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.452+0000 7fdcd62c4740 1 -- 172.21.15.19:0/1036369695 >> 172.21.15.19:0/1036369695 conn(0x55de6d21d5f0 msgr2=0x55de6d222ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:58.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.452+0000 7fdcd62c4740 1 -- 172.21.15.19:0/1036369695 shutdown_connections 2024-09-19T08:53:58.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.452+0000 7fdcd62c4740 1 -- 172.21.15.19:0/1036369695 wait complete. 2024-09-19T08:53:58.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.452+0000 7fdcd62c4740 1 -- start start 2024-09-19T08:53:58.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.452+0000 7fdcd62c4740 1 Processor -- start 2024-09-19T08:53:58.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.452+0000 7fdcd62c4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55de6d221060 0x55de6d2341e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:58.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.452+0000 7fdcd62c4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55de6d221980 0x55de6d234720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:58.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.452+0000 7fdcd62c4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de6d22c240 0x55de6d2311b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:58.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.452+0000 7fdcd62c4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdccc1b0b30 con 0x55de6d22c240 2024-09-19T08:53:58.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.452+0000 7fdcd62c4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdccc1b0460 con 0x55de6d221980 2024-09-19T08:53:58.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.452+0000 7fdcd62c4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdccc1ad6a0 con 0x55de6d221060 2024-09-19T08:53:58.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.453+0000 7fdcd62c4740 10 client.0 _ll_register_callbacks cb 0x7fdcbc00bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:53:58.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.453+0000 7fdcd2488640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de6d22c240 0x55de6d2311b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:58.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.453+0000 7fdcd2488640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de6d22c240 0x55de6d2311b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50206/0 (socket says 172.21.15.19:50206) 2024-09-19T08:53:58.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.453+0000 7fdcd2488640 1 -- 172.21.15.19:0/2180061053 learned_addr learned my addr 172.21.15.19:0/2180061053 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:53:58.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.453+0000 7fdcd1486640 1 --2- 172.21.15.19:0/2180061053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55de6d221980 0x55de6d234720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:58.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.453+0000 7fdcd1c87640 1 --2- 172.21.15.19:0/2180061053 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55de6d221060 0x55de6d2341e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:58.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.453+0000 7fdcd1486640 1 -- 172.21.15.19:0/2180061053 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55de6d221060 msgr2=0x55de6d2341e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:58.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.453+0000 7fdcd1486640 1 --2- 172.21.15.19:0/2180061053 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55de6d221060 0x55de6d2341e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:58.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.453+0000 7fdcd1486640 1 -- 172.21.15.19:0/2180061053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de6d22c240 msgr2=0x55de6d2311b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:53:58.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.453+0000 7fdcd1486640 1 --2- 172.21.15.19:0/2180061053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de6d22c240 0x55de6d2311b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:58.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.453+0000 7fdcd1486640 1 -- 172.21.15.19:0/2180061053 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de6d2316f0 con 0x55de6d221980 2024-09-19T08:53:58.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.453+0000 7fdcd2488640 1 --2- 172.21.15.19:0/2180061053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de6d22c240 0x55de6d2311b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:53:58.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.453+0000 7fdcd1486640 1 --2- 172.21.15.19:0/2180061053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55de6d221980 0x55de6d234720 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc004b20 tx=0x7fdcbc005d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1063c07f485735d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:53:58.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.453+0000 7fdcb57fa640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T08:53:58.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.453+0000 7fdcb57fa640 1 -- 172.21.15.19:0/2180061053 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc0035f0 con 0x55de6d221980 2024-09-19T08:53:58.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.454+0000 7fdcd62c4740 1 -- 172.21.15.19:0/2180061053 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdcc4026030 con 0x55de6d221980 2024-09-19T08:53:58.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.454+0000 7fdcb57fa640 1 -- 172.21.15.19:0/2180061053 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fdcbc011770 con 0x55de6d221980 2024-09-19T08:53:58.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.454+0000 7fdcb57fa640 1 -- 172.21.15.19:0/2180061053 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fdcbc011970 con 0x55de6d221980 2024-09-19T08:53:58.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.454+0000 7fdcd62c4740 10 client.25457 fetch_fsmap learned FSMap version 30 2024-09-19T08:53:58.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.454+0000 7fdcd62c4740 1 -- 172.21.15.19:0/2180061053 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55de6d2a7110 con 0x55de6d221980 2024-09-19T08:53:58.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.454+0000 7fdcb57fa640 1 -- 172.21.15.19:0/2180061053 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdcc4026030 con 0x55de6d221980 2024-09-19T08:53:58.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.454+0000 7fdcb57fa640 1 -- 172.21.15.19:0/2180061053 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fdcbc004d90 con 0x55de6d221980 2024-09-19T08:53:58.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.454+0000 7fdcd62c4740 10 client.25457 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T08:53:58.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.454+0000 7fdcd62c4740 10 client.25457 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T08:53:58.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.454+0000 7fdcd62c4740 20 client.25457 populate_metadata read hostname 'smithi019' 2024-09-19T08:53:58.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.454+0000 7fdcd62c4740 1 --2- 172.21.15.19:0/2180061053 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55de6d2a7830 0x55de6d2a9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:53:58.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.454+0000 7fdcd62c4740 4 client.25457 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "21740d72", "release": true, "await": true}] 2024-09-19T08:53:58.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.454+0000 7fdcd62c4740 1 -- 172.21.15.19:0/2180061053 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "quiesce db", "set_id": "21740d72", "release": true, "await": true}) -- 0x55de6d18e0a0 con 0x55de6d2a7830 2024-09-19T08:53:58.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.454+0000 7fdcd1c87640 1 --2- 172.21.15.19:0/2180061053 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55de6d2a7830 0x55de6d2a9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:53:58.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.455+0000 7fdcb57fa640 10 client.25457 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:58.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.455+0000 7fdcd1c87640 1 --2- 172.21.15.19:0/2180061053 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55de6d2a7830 0x55de6d2a9c50 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c4e466f3cabc96b server_cookie=78805278ff4d85d3 in_seq=0 out_seq=0 2024-09-19T08:53:58.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.457+0000 7fdcb57fa640 1 -- 172.21.15.19:0/2180061053 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55de6d18e0a0 con 0x55de6d2a7830 2024-09-19T08:53:58.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.457+0000 7fdcb57fa640 10 client.25457 handle_command_reply: tid=0 2024-09-19T08:53:58.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.457+0000 7fdcd62c4740 1 client.25457 shutdown 2024-09-19T08:53:58.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.458+0000 7fdcd62c4740 1 -- 172.21.15.19:0/2180061053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55de6d221980 msgr2=0x55de6d234720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:58.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.458+0000 7fdcd62c4740 1 --2- 172.21.15.19:0/2180061053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55de6d221980 0x55de6d234720 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc004b20 tx=0x7fdcbc005d40 comp rx=0 tx=0).stop 2024-09-19T08:53:58.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.458+0000 7fdcd62c4740 1 -- 172.21.15.19:0/2180061053 shutdown_connections 2024-09-19T08:53:58.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.458+0000 7fdcd62c4740 1 --2- 172.21.15.19:0/2180061053 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55de6d2a7830 0x55de6d2a9c50 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:58.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.458+0000 7fdcd62c4740 1 --2- 172.21.15.19:0/2180061053 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55de6d22c240 0x55de6d2311b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:58.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.458+0000 7fdcd62c4740 1 --2- 172.21.15.19:0/2180061053 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55de6d221980 0x55de6d234720 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:58.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.458+0000 7fdcb57fa640 0 client.25457 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:53:58.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.458+0000 7fdcd62c4740 1 --2- 172.21.15.19:0/2180061053 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55de6d221060 0x55de6d2341e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:58.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.458+0000 7fdcd62c4740 1 -- 172.21.15.19:0/2180061053 >> 172.21.15.19:0/2180061053 conn(0x55de6d21d5f0 msgr2=0x55de6d2290d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:58.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.458+0000 7fdcd62c4740 1 -- 172.21.15.19:0/2180061053 shutdown_connections 2024-09-19T08:53:58.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.458+0000 7fdcd62c4740 1 -- 172.21.15.19:0/2180061053 wait complete. 2024-09-19T08:53:58.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.458+0000 7fdcd62c4740 20 client.25457 trim_cache size 0 max 16384 2024-09-19T08:53:58.460 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:53:58.460 INFO:teuthology.orchestra.run.smithi019.stdout: "epoch": 30, 2024-09-19T08:53:58.460 INFO:teuthology.orchestra.run.smithi019.stdout: "leader": 24497, 2024-09-19T08:53:58.460 INFO:teuthology.orchestra.run.smithi019.stdout: "set_version": 8, 2024-09-19T08:53:58.460 INFO:teuthology.orchestra.run.smithi019.stdout: "sets": { 2024-09-19T08:53:58.460 INFO:teuthology.orchestra.run.smithi019.stdout: "21740d72": { 2024-09-19T08:53:58.460 INFO:teuthology.orchestra.run.smithi019.stdout: "version": 8, 2024-09-19T08:53:58.460 INFO:teuthology.orchestra.run.smithi019.stdout: "age_ref": 0.0, 2024-09-19T08:53:58.460 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T08:53:58.460 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RELEASED", 2024-09-19T08:53:58.460 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T08:53:58.460 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T08:53:58.461 INFO:teuthology.orchestra.run.smithi019.stdout: "timeout": 90.0, 2024-09-19T08:53:58.461 INFO:teuthology.orchestra.run.smithi019.stdout: "expiration": 140.3, 2024-09-19T08:53:58.461 INFO:teuthology.orchestra.run.smithi019.stdout: "members": { 2024-09-19T08:53:58.461 INFO:teuthology.orchestra.run.smithi019.stdout: "file:/": { 2024-09-19T08:53:58.461 INFO:teuthology.orchestra.run.smithi019.stdout: "excluded": false, 2024-09-19T08:53:58.461 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T08:53:58.461 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RELEASED", 2024-09-19T08:53:58.461 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T08:53:58.461 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:53:58.461 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:53:58.461 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:53:58.461 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:53:58.461 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:53:58.461 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:53:58.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.459+0000 7fdcd3eeb640 1 -- 172.21.15.19:0/799595348 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fdcb80a3240 msgr2=0x7fdcb80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:58.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.459+0000 7fdcd3eeb640 1 --2- 172.21.15.19:0/799595348 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fdcb80a3240 0x7fdcb80a5700 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdccc1077c0 tx=0x7fdcc4004ab0 comp rx=0 tx=0).stop 2024-09-19T08:53:58.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.459+0000 7fdcd3eeb640 1 -- 172.21.15.19:0/799595348 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdccc100100 msgr2=0x7fdccc1012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:53:58.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.459+0000 7fdcd3eeb640 1 --2- 172.21.15.19:0/799595348 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdccc100100 0x7fdccc1012e0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8006010 tx=0x7fdcc80042f0 comp rx=0 tx=0).stop 2024-09-19T08:53:58.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.459+0000 7fdcd3eeb640 1 -- 172.21.15.19:0/799595348 shutdown_connections 2024-09-19T08:53:58.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.459+0000 7fdcd3eeb640 1 --2- 172.21.15.19:0/799595348 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fdcb80a3240 0x7fdcb80a5700 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:58.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.459+0000 7fdcd3eeb640 1 --2- 172.21.15.19:0/799595348 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdccc106b80 0x7fdccc101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:58.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.459+0000 7fdcd3eeb640 1 --2- 172.21.15.19:0/799595348 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdccc100aa0 0x7fdccc101820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:58.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.459+0000 7fdcd3eeb640 1 --2- 172.21.15.19:0/799595348 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdccc100100 0x7fdccc1012e0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:53:58.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.459+0000 7fdcd3eeb640 1 -- 172.21.15.19:0/799595348 >> 172.21.15.19:0/799595348 conn(0x7fdccc077230 msgr2=0x7fdccc104bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:53:58.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.459+0000 7fdcd3eeb640 1 -- 172.21.15.19:0/799595348 shutdown_connections 2024-09-19T08:53:58.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:53:58.459+0000 7fdcd3eeb640 1 -- 172.21.15.19:0/799595348 wait complete. 2024-09-19T08:53:58.463 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:53:58.463 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:53:58.463 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 11 -lt 100 ']' 2024-09-19T08:53:58.463 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 11 + 1 2024-09-19T08:53:58.550 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=12 2024-09-19T08:53:58.550 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:53:58.610 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:53:58.611 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:53:58.612 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:53:58.612 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:53:58.612 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:53:59.005 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:53:59.005 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:53:59.526 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:53:59.526 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:53:59.529 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:53:59.529 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:53:59.529 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 12 -lt 100 ']' 2024-09-19T08:53:59.529 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 12 + 1 2024-09-19T08:53:59.534 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=13 2024-09-19T08:53:59.535 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:53:59.545 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:53:59.545 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:53:59.546 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:53:59.546 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:53:59.546 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:53:59.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:53:59 smithi019 ceph-mon[30976]: pgmap v390: 97 pgs: 97 active+clean; 800 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.8 KiB/s wr, 11 op/s 2024-09-19T08:53:59.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:53:59 smithi155 ceph-mon[34921]: pgmap v390: 97 pgs: 97 active+clean; 800 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.8 KiB/s wr, 11 op/s 2024-09-19T08:53:59.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:53:59 smithi203 ceph-mon[35450]: pgmap v390: 97 pgs: 97 active+clean; 800 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.8 KiB/s wr, 11 op/s 2024-09-19T08:54:00.529 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:00.529 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:00.529 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '21740d72', total seconds elapsed: 27.9 2024-09-19T08:54:00.529 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.35 2024-09-19T08:54:00.530 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:54:00.784 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:00.784 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:00.788 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:00.788 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:00.788 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 13 -lt 100 ']' 2024-09-19T08:54:00.788 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 13 + 1 2024-09-19T08:54:00.928 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=14 2024-09-19T08:54:00.928 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:01.113 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:01.114 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:01.115 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:01.115 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:01.115 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:01.671 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:01 smithi019 ceph-mon[30976]: pgmap v391: 97 pgs: 97 active+clean; 812 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-19T08:54:01.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:01 smithi155 ceph-mon[34921]: pgmap v391: 97 pgs: 97 active+clean; 812 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-19T08:54:01.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:01 smithi203 ceph-mon[35450]: pgmap v391: 97 pgs: 97 active+clean; 812 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-19T08:54:01.813 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:01.814 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:02.101 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:02.101 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:02.113 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:02.114 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:02.114 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 14 -lt 100 ']' 2024-09-19T08:54:02.114 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 14 + 1 2024-09-19T08:54:02.152 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=15 2024-09-19T08:54:02.152 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:02.214 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:02.214 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:02.215 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:02.215 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:02.215 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:03.163 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:03.163 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:03.359 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:03.359 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:03.372 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:03.372 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:03.372 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 15 -lt 100 ']' 2024-09-19T08:54:03.373 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 15 + 1 2024-09-19T08:54:03.438 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=16 2024-09-19T08:54:03.438 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:03.479 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:03.479 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:03.480 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:03.480 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:03.480 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:03.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:03 smithi155 ceph-mon[34921]: pgmap v392: 97 pgs: 97 active+clean; 812 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.8 KiB/s wr, 13 op/s 2024-09-19T08:54:03.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:03 smithi203 ceph-mon[35450]: pgmap v392: 97 pgs: 97 active+clean; 812 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.8 KiB/s wr, 13 op/s 2024-09-19T08:54:03.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:03 smithi019 ceph-mon[30976]: pgmap v392: 97 pgs: 97 active+clean; 812 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 3.8 KiB/s wr, 13 op/s 2024-09-19T08:54:04.563 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:04.563 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:04.713 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:04.713 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:04.722 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:04.722 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:04.722 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 16 -lt 100 ']' 2024-09-19T08:54:04.723 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 16 + 1 2024-09-19T08:54:04.820 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=17 2024-09-19T08:54:04.820 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:04.876 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:04.876 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:04.877 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:04.877 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:04.877 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:05.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:05 smithi155 ceph-mon[34921]: pgmap v393: 97 pgs: 97 active+clean; 832 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.7 KiB/s wr, 14 op/s 2024-09-19T08:54:05.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:05 smithi203 ceph-mon[35450]: pgmap v393: 97 pgs: 97 active+clean; 832 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.7 KiB/s wr, 14 op/s 2024-09-19T08:54:05.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:05 smithi019 ceph-mon[30976]: pgmap v393: 97 pgs: 97 active+clean; 832 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.7 KiB/s wr, 14 op/s 2024-09-19T08:54:06.572 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:06.572 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:06.900 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:06.900 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:06.914 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:06.914 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:06.914 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 17 -lt 100 ']' 2024-09-19T08:54:06.914 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 17 + 1 2024-09-19T08:54:07.153 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=18 2024-09-19T08:54:07.153 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:07.184 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:07.184 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:07.185 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:07.185 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:07.185 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:07.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.380+0000 7fdd02eb6640 1 -- 172.21.15.19:0/1893832485 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcfc100e20 msgr2=0x7fdcfc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:07.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.380+0000 7fdd02eb6640 1 --2- 172.21.15.19:0/1893832485 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcfc100e20 0x7fdcfc101200 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fdce4009900 tx=0x7fdce402a480 comp rx=0 tx=0).stop 2024-09-19T08:54:07.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.380+0000 7fdd02eb6640 1 -- 172.21.15.19:0/1893832485 shutdown_connections 2024-09-19T08:54:07.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.380+0000 7fdd02eb6640 1 --2- 172.21.15.19:0/1893832485 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdcfc102ef0 0x7fdcfc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.380+0000 7fdd02eb6640 1 --2- 172.21.15.19:0/1893832485 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcfc102570 0x7fdcfc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.380+0000 7fdd02eb6640 1 --2- 172.21.15.19:0/1893832485 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcfc100e20 0x7fdcfc101200 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.380+0000 7fdd02eb6640 1 -- 172.21.15.19:0/1893832485 >> 172.21.15.19:0/1893832485 conn(0x7fdcfc0fc7d0 msgr2=0x7fdcfc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:07.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.380+0000 7fdd02eb6640 1 -- 172.21.15.19:0/1893832485 shutdown_connections 2024-09-19T08:54:07.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.380+0000 7fdd02eb6640 1 -- 172.21.15.19:0/1893832485 wait complete. 2024-09-19T08:54:07.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.381+0000 7fdd02eb6640 1 Processor -- start 2024-09-19T08:54:07.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.381+0000 7fdd02eb6640 1 -- start start 2024-09-19T08:54:07.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.381+0000 7fdd02eb6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdcfc100e20 0x7fdcfc198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:07.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.381+0000 7fdd02eb6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcfc102570 0x7fdcfc198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:07.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.381+0000 7fdd02eb6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcfc102ef0 0x7fdcfc19cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:07.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.381+0000 7fdd02eb6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc110f80 con 0x7fdcfc102570 2024-09-19T08:54:07.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.381+0000 7fdd02eb6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc110e00 con 0x7fdcfc102ef0 2024-09-19T08:54:07.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.381+0000 7fdd02eb6640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc111100 con 0x7fdcfc100e20 2024-09-19T08:54:07.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.382+0000 7fdcfbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcfc102570 0x7fdcfc198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:07.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.382+0000 7fdcfbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcfc102570 0x7fdcfc198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33512/0 (socket says 172.21.15.19:33512) 2024-09-19T08:54:07.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.382+0000 7fdcfbfff640 1 -- 172.21.15.19:0/1054494405 learned_addr learned my addr 172.21.15.19:0/1054494405 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:07.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.382+0000 7fdd00c52640 1 --2- 172.21.15.19:0/1054494405 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdcfc100e20 0x7fdcfc198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:07.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.382+0000 7fdd01453640 1 --2- 172.21.15.19:0/1054494405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcfc102ef0 0x7fdcfc19cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:07.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.382+0000 7fdcfbfff640 1 -- 172.21.15.19:0/1054494405 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdcfc100e20 msgr2=0x7fdcfc198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:07.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.382+0000 7fdcfbfff640 1 --2- 172.21.15.19:0/1054494405 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdcfc100e20 0x7fdcfc198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.382+0000 7fdcfbfff640 1 -- 172.21.15.19:0/1054494405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcfc102ef0 msgr2=0x7fdcfc19cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:07.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.382+0000 7fdcfbfff640 1 --2- 172.21.15.19:0/1054494405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcfc102ef0 0x7fdcfc19cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.382+0000 7fdcfbfff640 1 -- 172.21.15.19:0/1054494405 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcfc19d4b0 con 0x7fdcfc102570 2024-09-19T08:54:07.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.382+0000 7fdd01453640 1 --2- 172.21.15.19:0/1054494405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcfc102ef0 0x7fdcfc19cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:07.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.382+0000 7fdcfbfff640 1 --2- 172.21.15.19:0/1054494405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcfc102570 0x7fdcfc198a40 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fdcec00d950 tx=0x7fdcec00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:07.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.382+0000 7fdcf9ffb640 1 -- 172.21.15.19:0/1054494405 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcec017030 con 0x7fdcfc102570 2024-09-19T08:54:07.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.382+0000 7fdcf9ffb640 1 -- 172.21.15.19:0/1054494405 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdcec004020 con 0x7fdcfc102570 2024-09-19T08:54:07.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.382+0000 7fdd02eb6640 1 -- 172.21.15.19:0/1054494405 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcfc19d7a0 con 0x7fdcfc102570 2024-09-19T08:54:07.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.383+0000 7fdcf9ffb640 1 -- 172.21.15.19:0/1054494405 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcec0047a0 con 0x7fdcfc102570 2024-09-19T08:54:07.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.383+0000 7fdd02eb6640 1 -- 172.21.15.19:0/1054494405 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcfc1a5080 con 0x7fdcfc102570 2024-09-19T08:54:07.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.385+0000 7fdcf9ffb640 1 -- 172.21.15.19:0/1054494405 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fdcec0041d0 con 0x7fdcfc102570 2024-09-19T08:54:07.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.386+0000 7fdcf9ffb640 1 --2- 172.21.15.19:0/1054494405 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fdce80a32c0 0x7fdce80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:07.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.386+0000 7fdcf9ffb640 1 -- 172.21.15.19:0/1054494405 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fdcec0cf2f0 con 0x7fdcfc102570 2024-09-19T08:54:07.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.386+0000 7fdd00c52640 1 --2- 172.21.15.19:0/1054494405 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fdce80a32c0 0x7fdce80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:07.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.387+0000 7fdd00c52640 1 --2- 172.21.15.19:0/1054494405 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fdce80a32c0 0x7fdce80a5780 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdce4009230 tx=0x7fdce40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:07.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.591+0000 7fdd0528f740 1 Processor -- start 2024-09-19T08:54:07.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.591+0000 7fdd0528f740 1 -- start start 2024-09-19T08:54:07.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.591+0000 7fdd0528f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2e6f6b40 0x55bf2e6f5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:07.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.591+0000 7fdd0528f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bf2e6f55d0 0x55bf2e6f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:07.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.591+0000 7fdd0528f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bf2e704780 0x55bf2e706b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:07.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.591+0000 7fdd0528f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55bf2e65b2f0 con 0x55bf2e6f6b40 2024-09-19T08:54:07.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.591+0000 7fdd0528f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55bf2e602cf0 con 0x55bf2e704780 2024-09-19T08:54:07.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.591+0000 7fdd0528f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55bf2e6572b0 con 0x55bf2e6f55d0 2024-09-19T08:54:07.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.591+0000 7fdd00c52640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2e6f6b40 0x55bf2e6f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:07.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.591+0000 7fdd00c52640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2e6f6b40 0x55bf2e6f5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33520/0 (socket says 172.21.15.19:33520) 2024-09-19T08:54:07.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.591+0000 7fdd00c52640 1 -- 172.21.15.19:0/989479538 learned_addr learned my addr 172.21.15.19:0/989479538 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:07.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.592+0000 7fdd01453640 1 --2- 172.21.15.19:0/989479538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bf2e704780 0x55bf2e706b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:07.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.592+0000 7fdcfbfff640 1 --2- 172.21.15.19:0/989479538 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bf2e6f55d0 0x55bf2e6f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:07.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.592+0000 7fdd00c52640 1 -- 172.21.15.19:0/989479538 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bf2e6f55d0 msgr2=0x55bf2e6f5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:07.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.592+0000 7fdd00c52640 1 --2- 172.21.15.19:0/989479538 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bf2e6f55d0 0x55bf2e6f5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.592+0000 7fdd00c52640 1 -- 172.21.15.19:0/989479538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bf2e704780 msgr2=0x55bf2e706b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:07.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.592+0000 7fdd00c52640 1 --2- 172.21.15.19:0/989479538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bf2e704780 0x55bf2e706b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.592+0000 7fdd00c52640 1 -- 172.21.15.19:0/989479538 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf2e5e73a0 con 0x55bf2e6f6b40 2024-09-19T08:54:07.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.592+0000 7fdd01453640 1 --2- 172.21.15.19:0/989479538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bf2e704780 0x55bf2e706b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:07.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.592+0000 7fdd00c52640 1 --2- 172.21.15.19:0/989479538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2e6f6b40 0x55bf2e6f5090 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fdce4000c00 tx=0x7fdce403e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83d07000c392f465 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:07.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.592+0000 7fdcf2ffd640 1 -- 172.21.15.19:0/989479538 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce404d070 con 0x55bf2e6f6b40 2024-09-19T08:54:07.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.592+0000 7fdcf2ffd640 1 -- 172.21.15.19:0/989479538 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdce4031a20 con 0x55bf2e6f6b40 2024-09-19T08:54:07.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.592+0000 7fdcf2ffd640 1 -- 172.21.15.19:0/989479538 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce4035050 con 0x55bf2e6f6b40 2024-09-19T08:54:07.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.593+0000 7fdd0528f740 1 -- 172.21.15.19:0/989479538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2e6f6b40 msgr2=0x55bf2e6f5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:07.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.593+0000 7fdd0528f740 1 --2- 172.21.15.19:0/989479538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2e6f6b40 0x55bf2e6f5090 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fdce4000c00 tx=0x7fdce403e000 comp rx=0 tx=0).stop 2024-09-19T08:54:07.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.593+0000 7fdd0528f740 1 -- 172.21.15.19:0/989479538 shutdown_connections 2024-09-19T08:54:07.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.593+0000 7fdd0528f740 1 --2- 172.21.15.19:0/989479538 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bf2e6f55d0 0x55bf2e6f5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.593+0000 7fdd0528f740 1 --2- 172.21.15.19:0/989479538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bf2e704780 0x55bf2e706b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.593+0000 7fdd0528f740 1 --2- 172.21.15.19:0/989479538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2e6f6b40 0x55bf2e6f5090 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.593+0000 7fdd0528f740 1 -- 172.21.15.19:0/989479538 >> 172.21.15.19:0/989479538 conn(0x55bf2e6be310 msgr2=0x55bf2e6f1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:07.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.593+0000 7fdd0528f740 1 -- 172.21.15.19:0/989479538 shutdown_connections 2024-09-19T08:54:07.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.593+0000 7fdd0528f740 1 -- 172.21.15.19:0/989479538 wait complete. 2024-09-19T08:54:07.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.594+0000 7fdd0528f740 1 -- start start 2024-09-19T08:54:07.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.594+0000 7fdd0528f740 1 Processor -- start 2024-09-19T08:54:07.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.595+0000 7fdd0528f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bf2e6f55d0 0x55bf2e7040f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:07.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.595+0000 7fdd0528f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2e6f6b40 0x55bf2e7013a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:07.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.595+0000 7fdd0528f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bf2e704780 0x55bf2e701900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:07.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.595+0000 7fdd0528f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55bf2e707420 con 0x55bf2e6f6b40 2024-09-19T08:54:07.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.595+0000 7fdd0528f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55bf2e616060 con 0x55bf2e704780 2024-09-19T08:54:07.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.595+0000 7fdd0528f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55bf2e7075a0 con 0x55bf2e6f55d0 2024-09-19T08:54:07.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.595+0000 7fdd0528f740 10 client.0 _ll_register_callbacks cb 0x55bf2e3698c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:07.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.595+0000 7fdcfbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2e6f6b40 0x55bf2e7013a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:07.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.595+0000 7fdcfbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2e6f6b40 0x55bf2e7013a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33532/0 (socket says 172.21.15.19:33532) 2024-09-19T08:54:07.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.595+0000 7fdcfbfff640 1 -- 172.21.15.19:0/1202224487 learned_addr learned my addr 172.21.15.19:0/1202224487 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:07.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.595+0000 7fdd00c52640 1 --2- 172.21.15.19:0/1202224487 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bf2e6f55d0 0x55bf2e7040f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:07.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.595+0000 7fdd01453640 1 --2- 172.21.15.19:0/1202224487 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bf2e704780 0x55bf2e701900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:07.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.595+0000 7fdcfbfff640 1 -- 172.21.15.19:0/1202224487 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bf2e6f55d0 msgr2=0x55bf2e7040f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:07.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.595+0000 7fdcfbfff640 1 --2- 172.21.15.19:0/1202224487 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bf2e6f55d0 0x55bf2e7040f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.595+0000 7fdcfbfff640 1 -- 172.21.15.19:0/1202224487 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bf2e704780 msgr2=0x55bf2e701900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:07.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.595+0000 7fdcfbfff640 1 --2- 172.21.15.19:0/1202224487 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bf2e704780 0x55bf2e701900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.595+0000 7fdcfbfff640 1 -- 172.21.15.19:0/1202224487 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf2e3cc3c0 con 0x55bf2e6f6b40 2024-09-19T08:54:07.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.596+0000 7fdcfbfff640 1 --2- 172.21.15.19:0/1202224487 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2e6f6b40 0x55bf2e7013a0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fdcec0cd170 tx=0x7fdcec09c020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ae0c09927aaefd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:07.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.596+0000 7fdcdbfff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:54:07.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.596+0000 7fdcdbfff640 1 -- 172.21.15.19:0/1202224487 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcec09fcd0 con 0x55bf2e6f6b40 2024-09-19T08:54:07.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.596+0000 7fdcdbfff640 1 -- 172.21.15.19:0/1202224487 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fdcec097f90 con 0x55bf2e6f6b40 2024-09-19T08:54:07.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.596+0000 7fdd0528f740 1 -- 172.21.15.19:0/1202224487 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdce4031a20 con 0x55bf2e6f6b40 2024-09-19T08:54:07.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.596+0000 7fdcdbfff640 1 -- 172.21.15.19:0/1202224487 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fdcec0a4590 con 0x55bf2e6f6b40 2024-09-19T08:54:07.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.596+0000 7fdd0528f740 10 client.15879 fetch_fsmap learned FSMap version 30 2024-09-19T08:54:07.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.596+0000 7fdd0528f740 1 -- 172.21.15.19:0/1202224487 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55bf2e712e30 con 0x55bf2e6f6b40 2024-09-19T08:54:07.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.596+0000 7fdcdbfff640 1 -- 172.21.15.19:0/1202224487 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdce4031a20 con 0x55bf2e6f6b40 2024-09-19T08:54:07.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.597+0000 7fdcdbfff640 1 -- 172.21.15.19:0/1202224487 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fdcec097670 con 0x55bf2e6f6b40 2024-09-19T08:54:07.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.597+0000 7fdd0528f740 10 client.15879 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T08:54:07.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.597+0000 7fdd0528f740 10 client.15879 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-19T08:54:07.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.597+0000 7fdd0528f740 20 client.15879 populate_metadata read hostname 'smithi019' 2024-09-19T08:54:07.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.597+0000 7fdd0528f740 1 --2- 172.21.15.19:0/1202224487 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55bf2e7142f0 0x55bf2e716700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:07.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.597+0000 7fdd0528f740 4 client.15879 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:54:07.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.597+0000 7fdd0528f740 1 -- 172.21.15.19:0/1202224487 --> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bf2e668860 con 0x55bf2e7142f0 2024-09-19T08:54:07.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.597+0000 7fdd00c52640 1 --2- 172.21.15.19:0/1202224487 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55bf2e7142f0 0x55bf2e716700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:07.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.598+0000 7fdd00c52640 1 --2- 172.21.15.19:0/1202224487 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55bf2e7142f0 0x55bf2e716700 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=81cf30698bac4bb1 server_cookie=554c87c9519cbad7 in_seq=0 out_seq=0 2024-09-19T08:54:07.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.598+0000 7fdcdbfff640 10 client.15879 ms_handle_connect on v2:172.21.15.155:6836/3381010945 2024-09-19T08:54:07.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.598+0000 7fdcdbfff640 1 -- 172.21.15.19:0/1202224487 <== mds.3 v2:172.21.15.155:6836/3381010945 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bf2e668860 con 0x55bf2e7142f0 2024-09-19T08:54:07.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.598+0000 7fdcdbfff640 10 client.15879 handle_command_reply: tid=0 2024-09-19T08:54:07.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.598+0000 7fdd0528f740 1 client.15879 shutdown 2024-09-19T08:54:07.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.598+0000 7fdd0528f740 1 -- 172.21.15.19:0/1202224487 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2e6f6b40 msgr2=0x55bf2e7013a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:07.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.598+0000 7fdd0528f740 1 --2- 172.21.15.19:0/1202224487 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2e6f6b40 0x55bf2e7013a0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fdcec0cd170 tx=0x7fdcec09c020 comp rx=0 tx=0).stop 2024-09-19T08:54:07.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.599+0000 7fdd0528f740 1 -- 172.21.15.19:0/1202224487 shutdown_connections 2024-09-19T08:54:07.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.599+0000 7fdd0528f740 1 --2- 172.21.15.19:0/1202224487 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55bf2e7142f0 0x55bf2e716700 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.599+0000 7fdd0528f740 1 --2- 172.21.15.19:0/1202224487 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bf2e704780 0x55bf2e701900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.599+0000 7fdd0528f740 1 --2- 172.21.15.19:0/1202224487 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2e6f6b40 0x55bf2e7013a0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.599+0000 7fdd0528f740 1 --2- 172.21.15.19:0/1202224487 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bf2e6f55d0 0x55bf2e7040f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.599+0000 7fdd0528f740 1 -- 172.21.15.19:0/1202224487 >> 172.21.15.19:0/1202224487 conn(0x55bf2e6be310 msgr2=0x55bf2e6f7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:07.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.599+0000 7fdcdbfff640 0 client.15879 ms_handle_reset on v2:172.21.15.155:6836/3381010945 2024-09-19T08:54:07.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.599+0000 7fdd0528f740 1 -- 172.21.15.19:0/1202224487 shutdown_connections 2024-09-19T08:54:07.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.599+0000 7fdd0528f740 1 -- 172.21.15.19:0/1202224487 wait complete. 2024-09-19T08:54:07.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.599+0000 7fdd0528f740 20 client.15879 trim_cache size 0 max 16384 2024-09-19T08:54:07.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.613+0000 7fdd0528f740 1 Processor -- start 2024-09-19T08:54:07.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.613+0000 7fdd0528f740 1 -- start start 2024-09-19T08:54:07.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.613+0000 7fdd0528f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2e6f55d0 0x55bf2e7106c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:07.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.613+0000 7fdd0528f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bf2e6f6b40 0x55bf2e700c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:07.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.613+0000 7fdd0528f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bf2e704780 0x55bf2e71bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:07.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.613+0000 7fdd0528f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc1ab2c0 con 0x55bf2e6f55d0 2024-09-19T08:54:07.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.613+0000 7fdd0528f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc1acec0 con 0x55bf2e6f6b40 2024-09-19T08:54:07.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.613+0000 7fdd0528f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc1ab990 con 0x55bf2e704780 2024-09-19T08:54:07.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.613+0000 7fdd00c52640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2e6f55d0 0x55bf2e7106c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:07.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.613+0000 7fdd00c52640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2e6f55d0 0x55bf2e7106c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33546/0 (socket says 172.21.15.19:33546) 2024-09-19T08:54:07.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.613+0000 7fdd00c52640 1 -- 172.21.15.19:0/2875873370 learned_addr learned my addr 172.21.15.19:0/2875873370 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:07.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.613+0000 7fdd01453640 1 --2- 172.21.15.19:0/2875873370 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bf2e704780 0x55bf2e71bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:07.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.613+0000 7fdd00c52640 1 -- 172.21.15.19:0/2875873370 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bf2e704780 msgr2=0x55bf2e71bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:07.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.613+0000 7fdd00c52640 1 --2- 172.21.15.19:0/2875873370 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bf2e704780 0x55bf2e71bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.613+0000 7fdcfbfff640 1 --2- 172.21.15.19:0/2875873370 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bf2e6f6b40 0x55bf2e700c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:07.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.613+0000 7fdd00c52640 1 -- 172.21.15.19:0/2875873370 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bf2e6f6b40 msgr2=0x55bf2e700c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:07.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.613+0000 7fdd00c52640 1 --2- 172.21.15.19:0/2875873370 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bf2e6f6b40 0x55bf2e700c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.613+0000 7fdd00c52640 1 -- 172.21.15.19:0/2875873370 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bf2e6f8120 con 0x55bf2e6f55d0 2024-09-19T08:54:07.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.614+0000 7fdd00c52640 1 --2- 172.21.15.19:0/2875873370 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2e6f55d0 0x55bf2e7106c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fdce4005940 tx=0x7fdce402a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=414ed55e37fa10d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:07.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.614+0000 7fdcf27fc640 1 -- 172.21.15.19:0/2875873370 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce4035040 con 0x55bf2e6f55d0 2024-09-19T08:54:07.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.614+0000 7fdcf27fc640 1 -- 172.21.15.19:0/2875873370 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdce4005500 con 0x55bf2e6f55d0 2024-09-19T08:54:07.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.614+0000 7fdcf27fc640 1 -- 172.21.15.19:0/2875873370 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdce404d040 con 0x55bf2e6f55d0 2024-09-19T08:54:07.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.614+0000 7fdd0528f740 1 -- 172.21.15.19:0/2875873370 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2e6f55d0 msgr2=0x55bf2e7106c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:07.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.614+0000 7fdd0528f740 1 --2- 172.21.15.19:0/2875873370 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2e6f55d0 0x55bf2e7106c0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fdce4005940 tx=0x7fdce402a480 comp rx=0 tx=0).stop 2024-09-19T08:54:07.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.615+0000 7fdd0528f740 1 -- 172.21.15.19:0/2875873370 shutdown_connections 2024-09-19T08:54:07.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.615+0000 7fdd0528f740 1 --2- 172.21.15.19:0/2875873370 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bf2e704780 0x55bf2e71bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.615+0000 7fdd0528f740 1 --2- 172.21.15.19:0/2875873370 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bf2e6f6b40 0x55bf2e700c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.615+0000 7fdd0528f740 1 --2- 172.21.15.19:0/2875873370 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2e6f55d0 0x55bf2e7106c0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.615+0000 7fdd0528f740 1 -- 172.21.15.19:0/2875873370 >> 172.21.15.19:0/2875873370 conn(0x55bf2e6be310 msgr2=0x55bf2e6f1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:07.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.615+0000 7fdd0528f740 1 -- 172.21.15.19:0/2875873370 shutdown_connections 2024-09-19T08:54:07.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.615+0000 7fdd0528f740 1 -- 172.21.15.19:0/2875873370 wait complete. 2024-09-19T08:54:07.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.615+0000 7fdd0528f740 1 -- start start 2024-09-19T08:54:07.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.615+0000 7fdd0528f740 1 Processor -- start 2024-09-19T08:54:07.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.616+0000 7fdd0528f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bf2e6f55d0 0x55bf2e70c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:07.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.616+0000 7fdd0528f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bf2e6f6b40 0x55bf2e70cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:07.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.616+0000 7fdd0528f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2e704780 0x55bf2e6fd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:07.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.616+0000 7fdd0528f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc1ac730 con 0x55bf2e704780 2024-09-19T08:54:07.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.616+0000 7fdd0528f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc1ac060 con 0x55bf2e6f6b40 2024-09-19T08:54:07.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.616+0000 7fdd0528f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc1a92a0 con 0x55bf2e6f55d0 2024-09-19T08:54:07.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.616+0000 7fdd0528f740 10 client.0 _ll_register_callbacks cb 0x7fdcec0046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:07.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.616+0000 7fdd01453640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2e704780 0x55bf2e6fd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:07.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.616+0000 7fdd01453640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2e704780 0x55bf2e6fd9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33558/0 (socket says 172.21.15.19:33558) 2024-09-19T08:54:07.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.616+0000 7fdd01453640 1 -- 172.21.15.19:0/41462465 learned_addr learned my addr 172.21.15.19:0/41462465 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:07.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.616+0000 7fdd00c52640 1 --2- 172.21.15.19:0/41462465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bf2e6f55d0 0x55bf2e70c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:07.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.616+0000 7fdcfbfff640 1 --2- 172.21.15.19:0/41462465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bf2e6f6b40 0x55bf2e70cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:07.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.616+0000 7fdd01453640 1 -- 172.21.15.19:0/41462465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bf2e6f55d0 msgr2=0x55bf2e70c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:07.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.616+0000 7fdd01453640 1 --2- 172.21.15.19:0/41462465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bf2e6f55d0 0x55bf2e70c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.616+0000 7fdd01453640 1 -- 172.21.15.19:0/41462465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bf2e6f6b40 msgr2=0x55bf2e70cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:07.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.616+0000 7fdd01453640 1 --2- 172.21.15.19:0/41462465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bf2e6f6b40 0x55bf2e70cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.616+0000 7fdd01453640 1 -- 172.21.15.19:0/41462465 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bf2e6fdf40 con 0x55bf2e704780 2024-09-19T08:54:07.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.617+0000 7fdd01453640 1 --2- 172.21.15.19:0/41462465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2e704780 0x55bf2e6fd9d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4012730 tx=0x7fdcf4012bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74ab01293b08526a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:07.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.617+0000 7fdcdbfff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:54:07.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.617+0000 7fdcdbfff640 1 -- 172.21.15.19:0/41462465 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4021060 con 0x55bf2e704780 2024-09-19T08:54:07.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.617+0000 7fdcdbfff640 1 -- 172.21.15.19:0/41462465 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fdcf4011ac0 con 0x55bf2e704780 2024-09-19T08:54:07.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.617+0000 7fdd0528f740 1 -- 172.21.15.19:0/41462465 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdce4005500 con 0x55bf2e704780 2024-09-19T08:54:07.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.617+0000 7fdcdbfff640 1 -- 172.21.15.19:0/41462465 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fdcf4011cc0 con 0x55bf2e704780 2024-09-19T08:54:07.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.617+0000 7fdd0528f740 10 client.15885 fetch_fsmap learned FSMap version 30 2024-09-19T08:54:07.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.617+0000 7fdd0528f740 1 -- 172.21.15.19:0/41462465 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55bf2e77e860 con 0x55bf2e704780 2024-09-19T08:54:07.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.617+0000 7fdcdbfff640 1 -- 172.21.15.19:0/41462465 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdce4005500 con 0x55bf2e704780 2024-09-19T08:54:07.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.617+0000 7fdcdbfff640 1 -- 172.21.15.19:0/41462465 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fdcf401b070 con 0x55bf2e704780 2024-09-19T08:54:07.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.618+0000 7fdd0528f740 10 client.15885 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T08:54:07.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.618+0000 7fdd0528f740 10 client.15885 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-19T08:54:07.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.618+0000 7fdd0528f740 20 client.15885 populate_metadata read hostname 'smithi019' 2024-09-19T08:54:07.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.618+0000 7fdd0528f740 1 --2- 172.21.15.19:0/41462465 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55bf2e77f010 0x55bf2e781430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:07.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.618+0000 7fdd0528f740 4 client.15885 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:54:07.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.618+0000 7fdd0528f740 1 -- 172.21.15.19:0/41462465 --> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bf2e662d70 con 0x55bf2e77f010 2024-09-19T08:54:07.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.618+0000 7fdd00c52640 1 --2- 172.21.15.19:0/41462465 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55bf2e77f010 0x55bf2e781430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:07.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.618+0000 7fdd00c52640 1 --2- 172.21.15.19:0/41462465 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55bf2e77f010 0x55bf2e781430 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7b5d730c7ae46de6 server_cookie=dc0821eb43b8c2c3 in_seq=0 out_seq=0 2024-09-19T08:54:07.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.618+0000 7fdcdbfff640 10 client.15885 ms_handle_connect on v2:172.21.15.155:6836/3381010945 2024-09-19T08:54:07.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.618+0000 7fdcdbfff640 1 -- 172.21.15.19:0/41462465 <== mds.3 v2:172.21.15.155:6836/3381010945 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bf2e662d70 con 0x55bf2e77f010 2024-09-19T08:54:07.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.618+0000 7fdcdbfff640 10 client.15885 handle_command_reply: tid=0 2024-09-19T08:54:07.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.618+0000 7fdd0528f740 1 client.15885 shutdown 2024-09-19T08:54:07.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.619+0000 7fdd0528f740 1 -- 172.21.15.19:0/41462465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2e704780 msgr2=0x55bf2e6fd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:07.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.619+0000 7fdd0528f740 1 --2- 172.21.15.19:0/41462465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2e704780 0x55bf2e6fd9d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4012730 tx=0x7fdcf4012bf0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.619+0000 7fdd0528f740 1 -- 172.21.15.19:0/41462465 shutdown_connections 2024-09-19T08:54:07.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.619+0000 7fdd0528f740 1 --2- 172.21.15.19:0/41462465 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55bf2e77f010 0x55bf2e781430 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.619+0000 7fdd0528f740 1 --2- 172.21.15.19:0/41462465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bf2e704780 0x55bf2e6fd9d0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.619+0000 7fdd0528f740 1 --2- 172.21.15.19:0/41462465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bf2e6f6b40 0x55bf2e70cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.619+0000 7fdd0528f740 1 --2- 172.21.15.19:0/41462465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bf2e6f55d0 0x55bf2e70c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.619+0000 7fdcdbfff640 0 client.15885 ms_handle_reset on v2:172.21.15.155:6836/3381010945 2024-09-19T08:54:07.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.619+0000 7fdd0528f740 1 -- 172.21.15.19:0/41462465 >> 172.21.15.19:0/41462465 conn(0x55bf2e6be310 msgr2=0x55bf2e6ffc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:07.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.619+0000 7fdd0528f740 1 -- 172.21.15.19:0/41462465 shutdown_connections 2024-09-19T08:54:07.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.619+0000 7fdd0528f740 1 -- 172.21.15.19:0/41462465 wait complete. 2024-09-19T08:54:07.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.619+0000 7fdd0528f740 20 client.15885 trim_cache size 0 max 16384 2024-09-19T08:54:07.624 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T08:54:07.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.620+0000 7fdd02eb6640 1 -- 172.21.15.19:0/1054494405 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fdce80a32c0 msgr2=0x7fdce80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:07.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.620+0000 7fdd02eb6640 1 --2- 172.21.15.19:0/1054494405 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fdce80a32c0 0x7fdce80a5780 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdce4009230 tx=0x7fdce40058d0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.620+0000 7fdd02eb6640 1 -- 172.21.15.19:0/1054494405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcfc102570 msgr2=0x7fdcfc198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:07.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.620+0000 7fdd02eb6640 1 --2- 172.21.15.19:0/1054494405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcfc102570 0x7fdcfc198a40 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fdcec00d950 tx=0x7fdcec00de10 comp rx=0 tx=0).stop 2024-09-19T08:54:07.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.620+0000 7fdd02eb6640 1 -- 172.21.15.19:0/1054494405 shutdown_connections 2024-09-19T08:54:07.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.620+0000 7fdd02eb6640 1 --2- 172.21.15.19:0/1054494405 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fdce80a32c0 0x7fdce80a5780 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.620+0000 7fdd02eb6640 1 --2- 172.21.15.19:0/1054494405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdcfc102ef0 0x7fdcfc19cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.620+0000 7fdd02eb6640 1 --2- 172.21.15.19:0/1054494405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdcfc102570 0x7fdcfc198a40 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.620+0000 7fdd02eb6640 1 --2- 172.21.15.19:0/1054494405 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdcfc100e20 0x7fdcfc198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:07.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.620+0000 7fdd02eb6640 1 -- 172.21.15.19:0/1054494405 >> 172.21.15.19:0/1054494405 conn(0x7fdcfc0fc7d0 msgr2=0x7fdcfc06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:07.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.620+0000 7fdd02eb6640 1 -- 172.21.15.19:0/1054494405 shutdown_connections 2024-09-19T08:54:07.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:07.620+0000 7fdd02eb6640 1 -- 172.21.15.19:0/1054494405 wait complete. 2024-09-19T08:54:07.650 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:07.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:07 smithi155 ceph-mon[34921]: pgmap v394: 97 pgs: 97 active+clean; 832 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-19T08:54:07.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:07 smithi203 ceph-mon[35450]: pgmap v394: 97 pgs: 97 active+clean; 832 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-19T08:54:07.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:07 smithi019 ceph-mon[30976]: pgmap v394: 97 pgs: 97 active+clean; 832 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.2 KiB/s wr, 13 op/s 2024-09-19T08:54:08.971 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:08.971 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:09.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:09 smithi155 ceph-mon[34921]: pgmap v395: 97 pgs: 97 active+clean; 854 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.2 KiB/s wr, 12 op/s 2024-09-19T08:54:09.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:09 smithi203 ceph-mon[35450]: pgmap v395: 97 pgs: 97 active+clean; 854 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.2 KiB/s wr, 12 op/s 2024-09-19T08:54:09.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:09 smithi019 ceph-mon[30976]: pgmap v395: 97 pgs: 97 active+clean; 854 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.2 KiB/s wr, 12 op/s 2024-09-19T08:54:09.833 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:09.833 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:09.896 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:09.897 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:09.897 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 18 -lt 100 ']' 2024-09-19T08:54:09.897 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 18 + 1 2024-09-19T08:54:09.951 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=19 2024-09-19T08:54:09.951 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:10.008 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:10.008 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:10.009 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:10.009 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:10.009 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:11.462 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:11.462 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:11.666 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:11.666 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:11.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:11 smithi155 ceph-mon[34921]: pgmap v396: 97 pgs: 97 active+clean; 860 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 13 op/s 2024-09-19T08:54:11.689 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:11.689 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:11.689 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 19 -lt 100 ']' 2024-09-19T08:54:11.689 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 19 + 1 2024-09-19T08:54:11.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:11 smithi203 ceph-mon[35450]: pgmap v396: 97 pgs: 97 active+clean; 860 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 13 op/s 2024-09-19T08:54:11.817 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=20 2024-09-19T08:54:11.817 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:11.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:11 smithi019 ceph-mon[30976]: pgmap v396: 97 pgs: 97 active+clean; 860 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 KiB/s wr, 13 op/s 2024-09-19T08:54:11.824 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:11.824 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:11.825 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:11.825 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:11.825 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:13.704 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:13.704 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:13.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:13 smithi203 ceph-mon[35450]: pgmap v397: 97 pgs: 97 active+clean; 860 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 12 op/s 2024-09-19T08:54:13.800 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:13 smithi019 ceph-mon[30976]: pgmap v397: 97 pgs: 97 active+clean; 860 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 12 op/s 2024-09-19T08:54:13.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:13 smithi155 ceph-mon[34921]: pgmap v397: 97 pgs: 97 active+clean; 860 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 4.8 KiB/s wr, 12 op/s 2024-09-19T08:54:14.203 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:14.203 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:14.316 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:14.316 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:14.316 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 20 -lt 100 ']' 2024-09-19T08:54:14.316 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 20 + 1 2024-09-19T08:54:14.452 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=21 2024-09-19T08:54:14.452 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:14.494 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:14.495 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:14.496 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:14.496 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:14.496 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:14.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:14 smithi203 ceph-mon[35450]: pgmap v398: 97 pgs: 97 active+clean; 876 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.2 KiB/s wr, 13 op/s 2024-09-19T08:54:14.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:14 smithi019 ceph-mon[30976]: pgmap v398: 97 pgs: 97 active+clean; 876 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.2 KiB/s wr, 13 op/s 2024-09-19T08:54:14.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:14 smithi155 ceph-mon[34921]: pgmap v398: 97 pgs: 97 active+clean; 876 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.2 KiB/s wr, 13 op/s 2024-09-19T08:54:15.469 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T08:54:15.990 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:15.989+0000 7fb0996ac640 1 -- 172.21.15.19:0/2836431135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb094101b60 msgr2=0x7fb094101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:15.990 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:15.989+0000 7fb0996ac640 1 --2- 172.21.15.19:0/2836431135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb094101b60 0x7fb094101f60 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fb084009900 tx=0x7fb08402a400 comp rx=0 tx=0).stop 2024-09-19T08:54:15.990 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:15.989+0000 7fb0996ac640 1 -- 172.21.15.19:0/2836431135 shutdown_connections 2024-09-19T08:54:15.990 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:15.989+0000 7fb0996ac640 1 --2- 172.21.15.19:0/2836431135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb094103710 0x7fb094109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:15.990 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:15.989+0000 7fb0996ac640 1 --2- 172.21.15.19:0/2836431135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb094102d50 0x7fb0941031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:15.989+0000 7fb0996ac640 1 --2- 172.21.15.19:0/2836431135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb094101b60 0x7fb094101f60 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:15.989+0000 7fb0996ac640 1 -- 172.21.15.19:0/2836431135 >> 172.21.15.19:0/2836431135 conn(0x7fb0940fd2e0 msgr2=0x7fb0940ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:15.989+0000 7fb0996ac640 1 -- 172.21.15.19:0/2836431135 shutdown_connections 2024-09-19T08:54:15.991 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:15.989+0000 7fb0996ac640 1 -- 172.21.15.19:0/2836431135 wait complete. 2024-09-19T08:54:16.142 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.141+0000 7fb0996ac640 1 Processor -- start 2024-09-19T08:54:16.142 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.142+0000 7fb0996ac640 1 -- start start 2024-09-19T08:54:16.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.151+0000 7fb0996ac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb094101b60 0x7fb094075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:16.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.151+0000 7fb0996ac640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb094102d50 0x7fb0940745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:16.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.151+0000 7fb0996ac640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb094103710 0x7fb094074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:16.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.151+0000 7fb0996ac640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb09410d810 con 0x7fb094101b60 2024-09-19T08:54:16.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.151+0000 7fb0996ac640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb09410d690 con 0x7fb094102d50 2024-09-19T08:54:16.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.151+0000 7fb0996ac640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb09410d990 con 0x7fb094103710 2024-09-19T08:54:16.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.152+0000 7fb092ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb094101b60 0x7fb094075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:16.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.152+0000 7fb092ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb094101b60 0x7fb094075fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55548/0 (socket says 172.21.15.19:55548) 2024-09-19T08:54:16.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.152+0000 7fb092ffd640 1 -- 172.21.15.19:0/717345967 learned_addr learned my addr 172.21.15.19:0/717345967 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:16.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.152+0000 7fb0937fe640 1 --2- 172.21.15.19:0/717345967 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb094103710 0x7fb094074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:16.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.152+0000 7fb0927fc640 1 --2- 172.21.15.19:0/717345967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb094102d50 0x7fb0940745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:16.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.152+0000 7fb092ffd640 1 -- 172.21.15.19:0/717345967 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb094103710 msgr2=0x7fb094074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:16.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.152+0000 7fb092ffd640 1 --2- 172.21.15.19:0/717345967 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb094103710 0x7fb094074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.152+0000 7fb092ffd640 1 -- 172.21.15.19:0/717345967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb094102d50 msgr2=0x7fb0940745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:16.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.152+0000 7fb092ffd640 1 --2- 172.21.15.19:0/717345967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb094102d50 0x7fb0940745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.152+0000 7fb092ffd640 1 -- 172.21.15.19:0/717345967 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0940753b0 con 0x7fb094101b60 2024-09-19T08:54:16.155 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.152+0000 7fb092ffd640 1 --2- 172.21.15.19:0/717345967 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb094101b60 0x7fb094075fa0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fb084031440 tx=0x7fb084032e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:16.155 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.153+0000 7fb08bfff640 1 -- 172.21.15.19:0/717345967 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb08403f030 con 0x7fb094101b60 2024-09-19T08:54:16.155 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.153+0000 7fb08bfff640 1 -- 172.21.15.19:0/717345967 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb084003ce0 con 0x7fb094101b60 2024-09-19T08:54:16.155 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.153+0000 7fb0996ac640 1 -- 172.21.15.19:0/717345967 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0941a1ed0 con 0x7fb094101b60 2024-09-19T08:54:16.155 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.153+0000 7fb08bfff640 1 -- 172.21.15.19:0/717345967 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb084035070 con 0x7fb094101b60 2024-09-19T08:54:16.155 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.153+0000 7fb0996ac640 1 -- 172.21.15.19:0/717345967 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0941a22d0 con 0x7fb094101b60 2024-09-19T08:54:16.163 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.163+0000 7fb08bfff640 1 -- 172.21.15.19:0/717345967 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fb084042030 con 0x7fb094101b60 2024-09-19T08:54:16.165 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.165+0000 7fb08bfff640 1 --2- 172.21.15.19:0/717345967 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb0800a3460 0x7fb0800a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:16.165 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.165+0000 7fb0927fc640 1 --2- 172.21.15.19:0/717345967 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb0800a3460 0x7fb0800a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:16.166 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.165+0000 7fb08bfff640 1 -- 172.21.15.19:0/717345967 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb0840efd80 con 0x7fb094101b60 2024-09-19T08:54:16.166 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.166+0000 7fb0927fc640 1 --2- 172.21.15.19:0/717345967 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb0800a3460 0x7fb0800a5920 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb094075d10 tx=0x7fb07c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:16.620 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:16.620 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:16.765 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.765+0000 7fb09c44d740 1 Processor -- start 2024-09-19T08:54:16.765 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.765+0000 7fb09c44d740 1 -- start start 2024-09-19T08:54:16.767 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.765+0000 7fb09c44d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560498a509a0 0x560498a50da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:16.767 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.765+0000 7fb09c44d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560498a512e0 0x560498a55da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:16.767 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.765+0000 7fb09c44d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560498a56370 0x560498a58830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:16.767 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.765+0000 7fb09c44d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5604989b42f0 con 0x560498a56370 2024-09-19T08:54:16.768 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.765+0000 7fb09c44d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56049895c270 con 0x560498a512e0 2024-09-19T08:54:16.768 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.765+0000 7fb09c44d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5604989b02b0 con 0x560498a509a0 2024-09-19T08:54:16.768 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.766+0000 7fb0937fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560498a56370 0x560498a58830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:16.768 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.766+0000 7fb0937fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560498a56370 0x560498a58830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55558/0 (socket says 172.21.15.19:55558) 2024-09-19T08:54:16.768 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.766+0000 7fb0937fe640 1 -- 172.21.15.19:0/4195450351 learned_addr learned my addr 172.21.15.19:0/4195450351 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:16.768 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.766+0000 7fb0927fc640 1 --2- 172.21.15.19:0/4195450351 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560498a512e0 0x560498a55da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:16.768 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.766+0000 7fb092ffd640 1 --2- 172.21.15.19:0/4195450351 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560498a509a0 0x560498a50da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:16.768 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.766+0000 7fb0937fe640 1 -- 172.21.15.19:0/4195450351 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560498a509a0 msgr2=0x560498a50da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:16.768 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.766+0000 7fb0937fe640 1 --2- 172.21.15.19:0/4195450351 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560498a509a0 0x560498a50da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.768 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.766+0000 7fb0937fe640 1 -- 172.21.15.19:0/4195450351 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560498a512e0 msgr2=0x560498a55da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:16.768 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.766+0000 7fb0937fe640 1 --2- 172.21.15.19:0/4195450351 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560498a512e0 0x560498a55da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.768 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.766+0000 7fb0937fe640 1 -- 172.21.15.19:0/4195450351 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56049895b340 con 0x560498a56370 2024-09-19T08:54:16.769 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.766+0000 7fb0937fe640 1 --2- 172.21.15.19:0/4195450351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560498a56370 0x560498a58830 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fb08c009f90 tx=0x7fb08c010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c978291b39c811f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:16.769 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.767+0000 7fb0897fa640 1 -- 172.21.15.19:0/4195450351 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb08c011700 con 0x560498a56370 2024-09-19T08:54:16.769 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.767+0000 7fb0897fa640 1 -- 172.21.15.19:0/4195450351 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb08c011d80 con 0x560498a56370 2024-09-19T08:54:16.769 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.767+0000 7fb0897fa640 1 -- 172.21.15.19:0/4195450351 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb08c018380 con 0x560498a56370 2024-09-19T08:54:16.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.767+0000 7fb09c44d740 1 -- 172.21.15.19:0/4195450351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560498a56370 msgr2=0x560498a58830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:16.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.767+0000 7fb09c44d740 1 --2- 172.21.15.19:0/4195450351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560498a56370 0x560498a58830 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fb08c009f90 tx=0x7fb08c010860 comp rx=0 tx=0).stop 2024-09-19T08:54:16.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.768+0000 7fb09c44d740 1 -- 172.21.15.19:0/4195450351 shutdown_connections 2024-09-19T08:54:16.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.768+0000 7fb09c44d740 1 --2- 172.21.15.19:0/4195450351 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560498a56370 0x560498a58830 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.768+0000 7fb09c44d740 1 --2- 172.21.15.19:0/4195450351 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560498a512e0 0x560498a55da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.768+0000 7fb09c44d740 1 --2- 172.21.15.19:0/4195450351 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560498a509a0 0x560498a50da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.768+0000 7fb09c44d740 1 -- 172.21.15.19:0/4195450351 >> 172.21.15.19:0/4195450351 conn(0x560498a4c010 msgr2=0x560498a4c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:16.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.768+0000 7fb09c44d740 1 -- 172.21.15.19:0/4195450351 shutdown_connections 2024-09-19T08:54:16.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.768+0000 7fb09c44d740 1 -- 172.21.15.19:0/4195450351 wait complete. 2024-09-19T08:54:16.804 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.804+0000 7fb09c44d740 1 -- start start 2024-09-19T08:54:16.807 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.808+0000 7fb09c44d740 1 Processor -- start 2024-09-19T08:54:16.809 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.808+0000 7fb09c44d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560498a509a0 0x560498a5aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:16.810 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.808+0000 7fb09c44d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560498a512e0 0x560498a5b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:16.810 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.808+0000 7fb09c44d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560498a56370 0x560498a62120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:16.810 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.808+0000 7fb09c44d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560498a59340 con 0x560498a512e0 2024-09-19T08:54:16.810 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.808+0000 7fb09c44d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56049893d290 con 0x560498a509a0 2024-09-19T08:54:16.810 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.808+0000 7fb09c44d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560498a594c0 con 0x560498a56370 2024-09-19T08:54:16.810 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.808+0000 7fb0927fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560498a512e0 0x560498a5b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:16.810 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.808+0000 7fb0927fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560498a512e0 0x560498a5b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55564/0 (socket says 172.21.15.19:55564) 2024-09-19T08:54:16.810 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.808+0000 7fb0927fc640 1 -- 172.21.15.19:0/1903831041 learned_addr learned my addr 172.21.15.19:0/1903831041 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:16.810 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.808+0000 7fb092ffd640 1 --2- 172.21.15.19:0/1903831041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560498a509a0 0x560498a5aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:16.810 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.808+0000 7fb0937fe640 1 --2- 172.21.15.19:0/1903831041 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560498a56370 0x560498a62120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:16.810 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.808+0000 7fb0927fc640 1 -- 172.21.15.19:0/1903831041 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560498a56370 msgr2=0x560498a62120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:16.810 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.809+0000 7fb0927fc640 1 --2- 172.21.15.19:0/1903831041 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560498a56370 0x560498a62120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.810 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.809+0000 7fb0927fc640 1 -- 172.21.15.19:0/1903831041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560498a509a0 msgr2=0x560498a5aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.809+0000 7fb0927fc640 1 --2- 172.21.15.19:0/1903831041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560498a509a0 0x560498a5aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.809+0000 7fb0927fc640 1 -- 172.21.15.19:0/1903831041 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604986c7210 con 0x560498a512e0 2024-09-19T08:54:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.809+0000 7fb0937fe640 1 --2- 172.21.15.19:0/1903831041 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560498a56370 0x560498a62120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.809+0000 7fb092ffd640 1 --2- 172.21.15.19:0/1903831041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560498a509a0 0x560498a5aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.809+0000 7fb0927fc640 1 --2- 172.21.15.19:0/1903831041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560498a512e0 0x560498a5b0e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fb07c00bfd0 tx=0x7fb07c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a4247c9c1e6e40b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.809+0000 7fb07a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:54:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.809+0000 7fb07a7fc640 1 -- 172.21.15.19:0/1903831041 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb07c01fb70 con 0x560498a512e0 2024-09-19T08:54:16.811 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.809+0000 7fb07a7fc640 1 -- 172.21.15.19:0/1903831041 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb07c01fd10 con 0x560498a512e0 2024-09-19T08:54:16.816 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.816+0000 7fb09c44d740 10 client.0 _ll_register_callbacks cb 0x56049896e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:16.823 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.823+0000 7fb09c44d740 1 -- 172.21.15.19:0/1903831041 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb08c011d80 con 0x560498a512e0 2024-09-19T08:54:16.824 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.823+0000 7fb07a7fc640 1 -- 172.21.15.19:0/1903831041 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb07c028440 con 0x560498a512e0 2024-09-19T08:54:16.824 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.823+0000 7fb09c44d740 10 client.15897 fetch_fsmap learned FSMap version 30 2024-09-19T08:54:16.824 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.823+0000 7fb09c44d740 1 -- 172.21.15.19:0/1903831041 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({fsmap=30}) -- 0x560498793620 con 0x560498a512e0 2024-09-19T08:54:16.828 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:16.828 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:16.864 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:16.865 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:16.865 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 21 -lt 100 ']' 2024-09-19T08:54:16.865 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 21 + 1 2024-09-19T08:54:16.917 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.916+0000 7fb07a7fc640 1 -- 172.21.15.19:0/1903831041 <== mon.0 v2:172.21.15.19:3300/0 4 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fb07c026070 con 0x560498a512e0 2024-09-19T08:54:16.917 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.917+0000 7fb09c44d740 10 client.15897 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T08:54:16.933 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=22 2024-09-19T08:54:16.934 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:16.974 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.974+0000 7fb09c44d740 10 client.15897 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:54:16.975 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.974+0000 7fb09c44d740 20 client.15897 populate_metadata read hostname 'smithi019' 2024-09-19T08:54:16.975 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.974+0000 7fb09c44d740 1 --2- 172.21.15.19:0/1903831041 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560498a66780 0x560498a68c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:16.975 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.974+0000 7fb09c44d740 4 client.15897 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:54:16.975 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.974+0000 7fb09c44d740 1 -- 172.21.15.19:0/1903831041 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604989c1a20 con 0x560498a66780 2024-09-19T08:54:16.975 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.975+0000 7fb092ffd640 1 --2- 172.21.15.19:0/1903831041 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560498a66780 0x560498a68c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.975+0000 7fb092ffd640 1 --2- 172.21.15.19:0/1903831041 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560498a66780 0x560498a68c40 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8bb220b28878b19 server_cookie=3f6a4ea5bafaf5b in_seq=0 out_seq=0 2024-09-19T08:54:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.975+0000 7fb07a7fc640 10 client.15897 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:54:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.976+0000 7fb07a7fc640 1 -- 172.21.15.19:0/1903831041 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5604989c1a20 con 0x560498a66780 2024-09-19T08:54:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.976+0000 7fb07a7fc640 10 client.15897 handle_command_reply: tid=0 2024-09-19T08:54:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.976+0000 7fb09c44d740 1 client.15897 shutdown 2024-09-19T08:54:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.976+0000 7fb09c44d740 1 -- 172.21.15.19:0/1903831041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560498a512e0 msgr2=0x560498a5b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:16.977 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.976+0000 7fb09c44d740 1 --2- 172.21.15.19:0/1903831041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560498a512e0 0x560498a5b0e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fb07c00bfd0 tx=0x7fb07c004730 comp rx=0 tx=0).stop 2024-09-19T08:54:16.978 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.976+0000 7fb09c44d740 1 -- 172.21.15.19:0/1903831041 shutdown_connections 2024-09-19T08:54:16.978 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.976+0000 7fb09c44d740 1 --2- 172.21.15.19:0/1903831041 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560498a66780 0x560498a68c40 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.978 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.976+0000 7fb09c44d740 1 --2- 172.21.15.19:0/1903831041 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560498a56370 0x560498a62120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.978 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.976+0000 7fb09c44d740 1 --2- 172.21.15.19:0/1903831041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560498a512e0 0x560498a5b0e0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.978 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.976+0000 7fb09c44d740 1 --2- 172.21.15.19:0/1903831041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560498a509a0 0x560498a5aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.978 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.976+0000 7fb07a7fc640 0 client.15897 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:54:16.978 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.976+0000 7fb09c44d740 1 -- 172.21.15.19:0/1903831041 >> 172.21.15.19:0/1903831041 conn(0x560498a4c010 msgr2=0x560498a4d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:16.978 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.977+0000 7fb09c44d740 1 -- 172.21.15.19:0/1903831041 shutdown_connections 2024-09-19T08:54:16.978 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.977+0000 7fb09c44d740 1 -- 172.21.15.19:0/1903831041 wait complete. 2024-09-19T08:54:16.978 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.977+0000 7fb09c44d740 20 client.15897 trim_cache size 0 max 16384 2024-09-19T08:54:16.993 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.992+0000 7fb09c44d740 1 Processor -- start 2024-09-19T08:54:16.993 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.993+0000 7fb09c44d740 1 -- start start 2024-09-19T08:54:16.994 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.993+0000 7fb09c44d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560498a509a0 0x560498a5b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:16.995 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.993+0000 7fb09c44d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560498a512e0 0x560498a620e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:16.995 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.993+0000 7fb09c44d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560498a56370 0x560498a4cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:16.995 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.993+0000 7fb09c44d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb0941ab150 con 0x560498a56370 2024-09-19T08:54:16.995 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.993+0000 7fb09c44d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb0941acd50 con 0x560498a512e0 2024-09-19T08:54:16.995 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.993+0000 7fb09c44d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb0941ab820 con 0x560498a509a0 2024-09-19T08:54:16.995 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.993+0000 7fb0937fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560498a56370 0x560498a4cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:16.995 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.993+0000 7fb0937fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560498a56370 0x560498a4cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55576/0 (socket says 172.21.15.19:55576) 2024-09-19T08:54:16.995 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.993+0000 7fb0937fe640 1 -- 172.21.15.19:0/3973861072 learned_addr learned my addr 172.21.15.19:0/3973861072 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:16.995 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.993+0000 7fb092ffd640 1 --2- 172.21.15.19:0/3973861072 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560498a509a0 0x560498a5b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:16.995 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.993+0000 7fb0927fc640 1 --2- 172.21.15.19:0/3973861072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560498a512e0 0x560498a620e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.994+0000 7fb0937fe640 1 -- 172.21.15.19:0/3973861072 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560498a509a0 msgr2=0x560498a5b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.994+0000 7fb0937fe640 1 --2- 172.21.15.19:0/3973861072 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560498a509a0 0x560498a5b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.994+0000 7fb0937fe640 1 -- 172.21.15.19:0/3973861072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560498a512e0 msgr2=0x560498a620e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.994+0000 7fb0937fe640 1 --2- 172.21.15.19:0/3973861072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560498a512e0 0x560498a620e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.994+0000 7fb0937fe640 1 -- 172.21.15.19:0/3973861072 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560498a517c0 con 0x560498a56370 2024-09-19T08:54:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.994+0000 7fb0937fe640 1 --2- 172.21.15.19:0/3973861072 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560498a56370 0x560498a4cec0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x560498a4ce90 tx=0x7fb08c019ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae98bd91a12b00d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.994+0000 7fb088ff9640 1 -- 172.21.15.19:0/3973861072 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb08c028070 con 0x560498a56370 2024-09-19T08:54:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.994+0000 7fb088ff9640 1 -- 172.21.15.19:0/3973861072 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb08c019bd0 con 0x560498a56370 2024-09-19T08:54:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.994+0000 7fb088ff9640 1 -- 172.21.15.19:0/3973861072 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb08c003e30 con 0x560498a56370 2024-09-19T08:54:17.002 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.995+0000 7fb09c44d740 1 -- 172.21.15.19:0/3973861072 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560498a56370 msgr2=0x560498a4cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.995+0000 7fb09c44d740 1 --2- 172.21.15.19:0/3973861072 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560498a56370 0x560498a4cec0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x560498a4ce90 tx=0x7fb08c019ae0 comp rx=0 tx=0).stop 2024-09-19T08:54:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.995+0000 7fb09c44d740 1 -- 172.21.15.19:0/3973861072 shutdown_connections 2024-09-19T08:54:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.995+0000 7fb09c44d740 1 --2- 172.21.15.19:0/3973861072 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560498a56370 0x560498a4cec0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.995+0000 7fb09c44d740 1 --2- 172.21.15.19:0/3973861072 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560498a512e0 0x560498a620e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.995+0000 7fb09c44d740 1 --2- 172.21.15.19:0/3973861072 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560498a509a0 0x560498a5b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.995+0000 7fb09c44d740 1 -- 172.21.15.19:0/3973861072 >> 172.21.15.19:0/3973861072 conn(0x560498a4c010 msgr2=0x560498a5a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.995+0000 7fb09c44d740 1 -- 172.21.15.19:0/3973861072 shutdown_connections 2024-09-19T08:54:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.995+0000 7fb09c44d740 1 -- 172.21.15.19:0/3973861072 wait complete. 2024-09-19T08:54:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.996+0000 7fb09c44d740 1 -- start start 2024-09-19T08:54:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.996+0000 7fb09c44d740 1 Processor -- start 2024-09-19T08:54:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.996+0000 7fb09c44d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560498a509a0 0x560498a5f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.996+0000 7fb09c44d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560498a512e0 0x560498a5ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.996+0000 7fb09c44d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560498a56370 0x560498a60ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.996+0000 7fb09c44d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb0941ac5c0 con 0x560498a56370 2024-09-19T08:54:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.996+0000 7fb09c44d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb0941abef0 con 0x560498a512e0 2024-09-19T08:54:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.996+0000 7fb09c44d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb0941a90c0 con 0x560498a509a0 2024-09-19T08:54:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.996+0000 7fb09c44d740 10 client.0 _ll_register_callbacks cb 0x7fb07c00bd60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.996+0000 7fb0937fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560498a56370 0x560498a60ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.996+0000 7fb0937fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560498a56370 0x560498a60ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55582/0 (socket says 172.21.15.19:55582) 2024-09-19T08:54:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.996+0000 7fb0937fe640 1 -- 172.21.15.19:0/3997602901 learned_addr learned my addr 172.21.15.19:0/3997602901 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.996+0000 7fb092ffd640 1 --2- 172.21.15.19:0/3997602901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560498a509a0 0x560498a5f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.997+0000 7fb0927fc640 1 --2- 172.21.15.19:0/3997602901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560498a512e0 0x560498a5ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.997+0000 7fb0937fe640 1 -- 172.21.15.19:0/3997602901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560498a509a0 msgr2=0x560498a5f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.997+0000 7fb0937fe640 1 --2- 172.21.15.19:0/3997602901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560498a509a0 0x560498a5f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.997+0000 7fb0937fe640 1 -- 172.21.15.19:0/3997602901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560498a512e0 msgr2=0x560498a5ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.997+0000 7fb0937fe640 1 --2- 172.21.15.19:0/3997602901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560498a512e0 0x560498a5ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.997+0000 7fb0937fe640 1 -- 172.21.15.19:0/3997602901 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560498a61500 con 0x560498a56370 2024-09-19T08:54:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.997+0000 7fb0937fe640 1 --2- 172.21.15.19:0/3997602901 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560498a56370 0x560498a60ef0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb08c010d60 tx=0x7fb08c019b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2078e619c0b2347a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.997+0000 7fb07a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:54:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.997+0000 7fb07a7fc640 1 -- 172.21.15.19:0/3997602901 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb08c031060 con 0x560498a56370 2024-09-19T08:54:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.997+0000 7fb07a7fc640 1 -- 172.21.15.19:0/3997602901 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb08c003d40 con 0x560498a56370 2024-09-19T08:54:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.997+0000 7fb09c44d740 1 -- 172.21.15.19:0/3997602901 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb08c019bd0 con 0x560498a56370 2024-09-19T08:54:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.997+0000 7fb07a7fc640 1 -- 172.21.15.19:0/3997602901 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fb08c028040 con 0x560498a56370 2024-09-19T08:54:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.997+0000 7fb09c44d740 10 client.15903 fetch_fsmap learned FSMap version 30 2024-09-19T08:54:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.998+0000 7fb09c44d740 1 -- 172.21.15.19:0/3997602901 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560498ad16f0 con 0x560498a56370 2024-09-19T08:54:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.998+0000 7fb07a7fc640 1 -- 172.21.15.19:0/3997602901 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb08c019bd0 con 0x560498a56370 2024-09-19T08:54:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.998+0000 7fb07a7fc640 1 -- 172.21.15.19:0/3997602901 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fb08c005110 con 0x560498a56370 2024-09-19T08:54:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.998+0000 7fb09c44d740 10 client.15903 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T08:54:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.998+0000 7fb09c44d740 10 client.15903 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:54:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.998+0000 7fb09c44d740 20 client.15903 populate_metadata read hostname 'smithi019' 2024-09-19T08:54:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.998+0000 7fb09c44d740 1 --2- 172.21.15.19:0/3997602901 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560498ad1ea0 0x560498ad42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.998+0000 7fb09c44d740 4 client.15903 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:54:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.998+0000 7fb09c44d740 1 -- 172.21.15.19:0/3997602901 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5604989bbd70 con 0x560498ad1ea0 2024-09-19T08:54:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.998+0000 7fb092ffd640 1 --2- 172.21.15.19:0/3997602901 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560498ad1ea0 0x560498ad42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.999+0000 7fb092ffd640 1 --2- 172.21.15.19:0/3997602901 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560498ad1ea0 0x560498ad42c0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6798a7818fd96271 server_cookie=a97f846b3fa1c2fb in_seq=0 out_seq=0 2024-09-19T08:54:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:16.999+0000 7fb07a7fc640 10 client.15903 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:54:17.007 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:17.006+0000 7fb07a7fc640 1 -- 172.21.15.19:0/3997602901 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5604989bbd70 con 0x560498ad1ea0 2024-09-19T08:54:17.007 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:17.006+0000 7fb07a7fc640 10 client.15903 handle_command_reply: tid=0 2024-09-19T08:54:17.007 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:17.006+0000 7fb09c44d740 1 client.15903 shutdown 2024-09-19T08:54:17.007 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:17.007+0000 7fb09c44d740 1 -- 172.21.15.19:0/3997602901 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560498a56370 msgr2=0x560498a60ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:17.007 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:17.007+0000 7fb09c44d740 1 --2- 172.21.15.19:0/3997602901 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560498a56370 0x560498a60ef0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb08c010d60 tx=0x7fb08c019b60 comp rx=0 tx=0).stop 2024-09-19T08:54:17.007 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:17.007+0000 7fb09c44d740 1 -- 172.21.15.19:0/3997602901 shutdown_connections 2024-09-19T08:54:17.008 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:17.007+0000 7fb09c44d740 1 --2- 172.21.15.19:0/3997602901 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560498ad1ea0 0x560498ad42c0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:17.008 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:17.007+0000 7fb09c44d740 1 --2- 172.21.15.19:0/3997602901 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560498a56370 0x560498a60ef0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:17.008 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:17.007+0000 7fb09c44d740 1 --2- 172.21.15.19:0/3997602901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560498a512e0 0x560498a5ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:17.008 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:17.007+0000 7fb09c44d740 1 --2- 172.21.15.19:0/3997602901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560498a509a0 0x560498a5f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:17.008 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:17.007+0000 7fb07a7fc640 0 client.15903 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:54:17.008 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:17.007+0000 7fb09c44d740 1 -- 172.21.15.19:0/3997602901 >> 172.21.15.19:0/3997602901 conn(0x560498a4c010 msgr2=0x560498a4a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:17.008 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:17.007+0000 7fb09c44d740 1 -- 172.21.15.19:0/3997602901 shutdown_connections 2024-09-19T08:54:17.008 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:17.007+0000 7fb09c44d740 1 -- 172.21.15.19:0/3997602901 wait complete. 2024-09-19T08:54:17.008 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:17.007+0000 7fb09c44d740 20 client.15903 trim_cache size 0 max 16384 2024-09-19T08:54:17.008 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T08:54:17.008 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T08:54:17.008 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T08:54:17.009 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T08:54:17.021 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:17.021+0000 7fb0996ac640 1 -- 172.21.15.19:0/717345967 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb0800a3460 msgr2=0x7fb0800a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:17.021 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:17.021+0000 7fb0996ac640 1 --2- 172.21.15.19:0/717345967 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb0800a3460 0x7fb0800a5920 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb094075d10 tx=0x7fb07c00b410 comp rx=0 tx=0).stop 2024-09-19T08:54:17.021 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:17.021+0000 7fb0996ac640 1 -- 172.21.15.19:0/717345967 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb094101b60 msgr2=0x7fb094075fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:17.021+0000 7fb0996ac640 1 --2- 172.21.15.19:0/717345967 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb094101b60 0x7fb094075fa0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fb084031440 tx=0x7fb084032e20 comp rx=0 tx=0).stop 2024-09-19T08:54:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:17.021+0000 7fb0996ac640 1 -- 172.21.15.19:0/717345967 shutdown_connections 2024-09-19T08:54:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:17.021+0000 7fb0996ac640 1 --2- 172.21.15.19:0/717345967 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb0800a3460 0x7fb0800a5920 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:17.021+0000 7fb0996ac640 1 --2- 172.21.15.19:0/717345967 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb094103710 0x7fb094074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:17.021+0000 7fb0996ac640 1 --2- 172.21.15.19:0/717345967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb094102d50 0x7fb0940745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:17.021+0000 7fb0996ac640 1 --2- 172.21.15.19:0/717345967 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb094101b60 0x7fb094075fa0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:17.021+0000 7fb0996ac640 1 -- 172.21.15.19:0/717345967 >> 172.21.15.19:0/717345967 conn(0x7fb0940fd2e0 msgr2=0x7fb094106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:17.021+0000 7fb0996ac640 1 -- 172.21.15.19:0/717345967 shutdown_connections 2024-09-19T08:54:17.022 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:17.021+0000 7fb0996ac640 1 -- 172.21.15.19:0/717345967 wait complete. 2024-09-19T08:54:17.056 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:17.057 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:17.058 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:17.058 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:17.058 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:17.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:16 smithi203 ceph-mon[35450]: pgmap v399: 97 pgs: 97 active+clean; 876 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.4 KiB/s wr, 11 op/s 2024-09-19T08:54:17.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:16 smithi019 ceph-mon[30976]: pgmap v399: 97 pgs: 97 active+clean; 876 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.4 KiB/s wr, 11 op/s 2024-09-19T08:54:17.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:16 smithi155 ceph-mon[34921]: pgmap v399: 97 pgs: 97 active+clean; 876 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.4 KiB/s wr, 11 op/s 2024-09-19T08:54:18.086 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:18.086 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:18.298 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:18.299 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:18.345 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:18.346 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:18.346 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 22 -lt 100 ']' 2024-09-19T08:54:18.346 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 22 + 1 2024-09-19T08:54:18.375 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=23 2024-09-19T08:54:18.375 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:18.435 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:18.435 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:18.437 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:18.437 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:18.437 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:19.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:18 smithi203 ceph-mon[35450]: pgmap v400: 97 pgs: 97 active+clean; 890 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 6.0 KiB/s wr, 11 op/s 2024-09-19T08:54:19.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:18 smithi019 ceph-mon[30976]: pgmap v400: 97 pgs: 97 active+clean; 890 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 6.0 KiB/s wr, 11 op/s 2024-09-19T08:54:19.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:18 smithi155 ceph-mon[34921]: pgmap v400: 97 pgs: 97 active+clean; 890 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 6.0 KiB/s wr, 11 op/s 2024-09-19T08:54:19.827 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:19.828 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:20.179 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:20.179 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:20.203 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:20.203 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:20.204 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 23 -lt 100 ']' 2024-09-19T08:54:20.204 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 23 + 1 2024-09-19T08:54:20.260 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=24 2024-09-19T08:54:20.260 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:20.322 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:20.322 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:20.323 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:20.323 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:20.323 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:21.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:20 smithi203 ceph-mon[35450]: pgmap v401: 97 pgs: 97 active+clean; 903 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.7 KiB/s wr, 14 op/s 2024-09-19T08:54:21.262 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:21.262 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:21.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:20 smithi019 ceph-mon[30976]: pgmap v401: 97 pgs: 97 active+clean; 903 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.7 KiB/s wr, 14 op/s 2024-09-19T08:54:21.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:20 smithi155 ceph-mon[34921]: pgmap v401: 97 pgs: 97 active+clean; 903 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.7 KiB/s wr, 14 op/s 2024-09-19T08:54:21.564 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:21.564 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:21.578 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:21.578 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:21.578 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 24 -lt 100 ']' 2024-09-19T08:54:21.578 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 24 + 1 2024-09-19T08:54:21.718 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=25 2024-09-19T08:54:21.718 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:21.755 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:21.755 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:21.756 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:21.757 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:21.757 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:22.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.228+0000 7f97d6ab4640 1 -- 172.21.15.19:0/3771035703 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97d0100e20 msgr2=0x7f97d0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:22.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.228+0000 7f97d6ab4640 1 --2- 172.21.15.19:0/3771035703 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97d0100e20 0x7f97d0101200 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f97c4009900 tx=0x7f97c402a480 comp rx=0 tx=0).stop 2024-09-19T08:54:22.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.228+0000 7f97d6ab4640 1 -- 172.21.15.19:0/3771035703 shutdown_connections 2024-09-19T08:54:22.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.228+0000 7f97d6ab4640 1 --2- 172.21.15.19:0/3771035703 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f97d0102ef0 0x7f97d010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:22.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.228+0000 7f97d6ab4640 1 --2- 172.21.15.19:0/3771035703 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97d0102570 0x7f97d01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:22.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.228+0000 7f97d6ab4640 1 --2- 172.21.15.19:0/3771035703 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97d0100e20 0x7f97d0101200 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:22.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.228+0000 7f97d6ab4640 1 -- 172.21.15.19:0/3771035703 >> 172.21.15.19:0/3771035703 conn(0x7f97d00fc7d0 msgr2=0x7f97d00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:22.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.228+0000 7f97d6ab4640 1 -- 172.21.15.19:0/3771035703 shutdown_connections 2024-09-19T08:54:22.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.228+0000 7f97d6ab4640 1 -- 172.21.15.19:0/3771035703 wait complete. 2024-09-19T08:54:22.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.229+0000 7f97d6ab4640 1 Processor -- start 2024-09-19T08:54:22.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.229+0000 7f97d6ab4640 1 -- start start 2024-09-19T08:54:22.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.229+0000 7f97d6ab4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97d0100e20 0x7f97d0198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:22.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.229+0000 7f97d6ab4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97d0102570 0x7f97d0198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:22.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.229+0000 7f97d6ab4640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f97d0102ef0 0x7f97d019cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:22.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.229+0000 7f97d6ab4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f97d0110f80 con 0x7f97d0102570 2024-09-19T08:54:22.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.229+0000 7f97d6ab4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f97d0110e00 con 0x7f97d0100e20 2024-09-19T08:54:22.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.229+0000 7f97d6ab4640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f97d0111100 con 0x7f97d0102ef0 2024-09-19T08:54:22.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.229+0000 7f97cffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97d0102570 0x7f97d0198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:22.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.229+0000 7f97cffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97d0102570 0x7f97d0198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55594/0 (socket says 172.21.15.19:55594) 2024-09-19T08:54:22.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.229+0000 7f97cffff640 1 -- 172.21.15.19:0/1456979388 learned_addr learned my addr 172.21.15.19:0/1456979388 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:22.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.229+0000 7f97d4850640 1 --2- 172.21.15.19:0/1456979388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97d0100e20 0x7f97d0198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:22.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.230+0000 7f97d5051640 1 --2- 172.21.15.19:0/1456979388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f97d0102ef0 0x7f97d019cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:22.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.230+0000 7f97cffff640 1 -- 172.21.15.19:0/1456979388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f97d0102ef0 msgr2=0x7f97d019cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:22.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.230+0000 7f97cffff640 1 --2- 172.21.15.19:0/1456979388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f97d0102ef0 0x7f97d019cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:22.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.230+0000 7f97cffff640 1 -- 172.21.15.19:0/1456979388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97d0100e20 msgr2=0x7f97d0198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:22.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.230+0000 7f97cffff640 1 --2- 172.21.15.19:0/1456979388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97d0100e20 0x7f97d0198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:22.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.230+0000 7f97cffff640 1 -- 172.21.15.19:0/1456979388 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97d019d4b0 con 0x7f97d0102570 2024-09-19T08:54:22.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.230+0000 7f97cffff640 1 --2- 172.21.15.19:0/1456979388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97d0102570 0x7f97d0198a40 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f97bc00e9f0 tx=0x7f97bc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:22.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.230+0000 7f97cdffb640 1 -- 172.21.15.19:0/1456979388 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97bc00cd80 con 0x7f97d0102570 2024-09-19T08:54:22.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.230+0000 7f97cdffb640 1 -- 172.21.15.19:0/1456979388 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f97bc010910 con 0x7f97d0102570 2024-09-19T08:54:22.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.230+0000 7f97d6ab4640 1 -- 172.21.15.19:0/1456979388 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97d019d7a0 con 0x7f97d0102570 2024-09-19T08:54:22.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.230+0000 7f97cdffb640 1 -- 172.21.15.19:0/1456979388 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97bc018990 con 0x7f97d0102570 2024-09-19T08:54:22.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.230+0000 7f97d6ab4640 1 -- 172.21.15.19:0/1456979388 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97d01a5080 con 0x7f97d0102570 2024-09-19T08:54:22.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.232+0000 7f97d6ab4640 1 -- 172.21.15.19:0/1456979388 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97d0101200 con 0x7f97d0102570 2024-09-19T08:54:22.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.233+0000 7f97cdffb640 1 -- 172.21.15.19:0/1456979388 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f97bc010ac0 con 0x7f97d0102570 2024-09-19T08:54:22.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.234+0000 7f97cdffb640 1 --2- 172.21.15.19:0/1456979388 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f97c00a3240 0x7f97c00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:22.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.234+0000 7f97d4850640 1 --2- 172.21.15.19:0/1456979388 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f97c00a3240 0x7f97c00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:22.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.234+0000 7f97cdffb640 1 -- 172.21.15.19:0/1456979388 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f97bc0cfd20 con 0x7f97d0102570 2024-09-19T08:54:22.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.234+0000 7f97d4850640 1 --2- 172.21.15.19:0/1456979388 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f97c00a3240 0x7f97c00a5700 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f97c4009230 tx=0x7f97c40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:22.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.238+0000 7f97cdffb640 1 -- 172.21.15.19:0/1456979388 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f97bc09c9f0 con 0x7f97d0102570 2024-09-19T08:54:22.447 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:22.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.471+0000 7f97d6ab4640 1 -- 172.21.15.19:0/1456979388 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f97d010a0a0 con 0x7f97d0102570 2024-09-19T08:54:22.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.472+0000 7f97cdffb640 1 -- 172.21.15.19:0/1456979388 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11990 (secure 0 0 0) 0x7f97bc09c2f0 con 0x7f97d0102570 2024-09-19T08:54:22.473 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:54:22.473 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":30,"btime":"2024-09-19T08:53:40:359510+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2452068876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2452068876},{"type":"v1","addr":"172.21.15.19:6839","nonce":2452068876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T08:53:39.964693+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/2480841559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2480841559},{"type":"v1","addr":"172.21.15.155:6835","nonce":2480841559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24463,24464,24490,24469,24497]},"id":1}]} 2024-09-19T08:54:22.473 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 30 2024-09-19T08:54:22.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.474+0000 7f97d6ab4640 1 -- 172.21.15.19:0/1456979388 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f97c00a3240 msgr2=0x7f97c00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:22.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.474+0000 7f97d6ab4640 1 --2- 172.21.15.19:0/1456979388 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f97c00a3240 0x7f97c00a5700 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f97c4009230 tx=0x7f97c40058d0 comp rx=0 tx=0).stop 2024-09-19T08:54:22.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.474+0000 7f97d6ab4640 1 -- 172.21.15.19:0/1456979388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97d0102570 msgr2=0x7f97d0198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:22.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.474+0000 7f97d6ab4640 1 --2- 172.21.15.19:0/1456979388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97d0102570 0x7f97d0198a40 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f97bc00e9f0 tx=0x7f97bc00eeb0 comp rx=0 tx=0).stop 2024-09-19T08:54:22.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.474+0000 7f97d6ab4640 1 -- 172.21.15.19:0/1456979388 shutdown_connections 2024-09-19T08:54:22.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.474+0000 7f97d6ab4640 1 --2- 172.21.15.19:0/1456979388 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f97c00a3240 0x7f97c00a5700 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:22.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.474+0000 7f97d6ab4640 1 --2- 172.21.15.19:0/1456979388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f97d0102ef0 0x7f97d019cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:22.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.474+0000 7f97d6ab4640 1 --2- 172.21.15.19:0/1456979388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f97d0102570 0x7f97d0198a40 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:22.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.474+0000 7f97d6ab4640 1 --2- 172.21.15.19:0/1456979388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f97d0100e20 0x7f97d0198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:22.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.474+0000 7f97d6ab4640 1 -- 172.21.15.19:0/1456979388 >> 172.21.15.19:0/1456979388 conn(0x7f97d00fc7d0 msgr2=0x7f97d006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:22.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.474+0000 7f97d6ab4640 1 -- 172.21.15.19:0/1456979388 shutdown_connections 2024-09-19T08:54:22.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:22.474+0000 7f97d6ab4640 1 -- 172.21.15.19:0/1456979388 wait complete. 2024-09-19T08:54:23.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:22 smithi019 ceph-mon[30976]: pgmap v402: 97 pgs: 97 active+clean; 903 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 5.2 KiB/s wr, 14 op/s 2024-09-19T08:54:23.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:22 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1456979388' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:23.144 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:23.144 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:23.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:22 smithi203 ceph-mon[35450]: pgmap v402: 97 pgs: 97 active+clean; 903 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 5.2 KiB/s wr, 14 op/s 2024-09-19T08:54:23.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:22 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1456979388' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:23.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:22 smithi155 ceph-mon[34921]: pgmap v402: 97 pgs: 97 active+clean; 903 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 5.2 KiB/s wr, 14 op/s 2024-09-19T08:54:23.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:22 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1456979388' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:23.565 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:23.565 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:23.803 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:23.803 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:23.803 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 25 -lt 100 ']' 2024-09-19T08:54:23.803 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 25 + 1 2024-09-19T08:54:23.952 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=26 2024-09-19T08:54:23.952 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:24.030 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:24.030 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:24.031 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:24.031 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:24.031 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:25.029 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:24 smithi019 ceph-mon[30976]: pgmap v403: 97 pgs: 97 active+clean; 924 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.4 KiB/s wr, 15 op/s 2024-09-19T08:54:25.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:24 smithi203 ceph-mon[35450]: pgmap v403: 97 pgs: 97 active+clean; 924 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.4 KiB/s wr, 15 op/s 2024-09-19T08:54:25.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:24 smithi155 ceph-mon[34921]: pgmap v403: 97 pgs: 97 active+clean; 924 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.4 KiB/s wr, 15 op/s 2024-09-19T08:54:25.518 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:25.519 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:25.942 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:25.942 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:25.985 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:25.986 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:25.986 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 26 -lt 100 ']' 2024-09-19T08:54:25.986 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 26 + 1 2024-09-19T08:54:26.181 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=27 2024-09-19T08:54:26.182 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:26.313 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:26.313 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:26.315 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:26.315 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:26.315 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:26.511 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0' 2024-09-19T08:54:26.512 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db / --timeout 90 --expiration 140.35 --await-for 45.0 2024-09-19T08:54:27.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:26 smithi203 ceph-mon[35450]: pgmap v404: 97 pgs: 97 active+clean; 924 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.7 KiB/s wr, 14 op/s 2024-09-19T08:54:27.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:26 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:54:27.275 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:26 smithi019 ceph-mon[30976]: pgmap v404: 97 pgs: 97 active+clean; 924 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.7 KiB/s wr, 14 op/s 2024-09-19T08:54:27.275 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:26 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:54:27.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:26 smithi155 ceph-mon[34921]: pgmap v404: 97 pgs: 97 active+clean; 924 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.7 KiB/s wr, 14 op/s 2024-09-19T08:54:27.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:26 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:54:27.560 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:27.560 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:27.781 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:27.782 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:27.785 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:27.785 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:27.785 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 27 -lt 100 ']' 2024-09-19T08:54:27.785 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 27 + 1 2024-09-19T08:54:27.809 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=28 2024-09-19T08:54:27.809 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:27.822 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:27.822 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:27.823 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:27.823 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:27.823 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:28.435 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:28 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:54:28.435 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:28 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:54:28.435 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:28 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:54:28.435 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:28 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:54:28.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:28 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:54:28.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:28 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:54:28.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:28 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:54:28.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:28 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:54:28.659 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:28.660 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:28.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:28 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:54:28.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:28 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:54:28.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:28 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:54:28.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:28 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:54:28.930 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:28.931 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:28.943 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:28.943 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:28.943 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 28 -lt 100 ']' 2024-09-19T08:54:28.943 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 28 + 1 2024-09-19T08:54:29.131 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=29 2024-09-19T08:54:29.131 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:29.224 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:29.224 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:29.225 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:29.225 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:29.226 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:29.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:29 smithi203 ceph-mon[35450]: pgmap v405: 97 pgs: 97 active+clean; 946 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.6 KiB/s wr, 13 op/s 2024-09-19T08:54:29.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:29 smithi019 ceph-mon[30976]: pgmap v405: 97 pgs: 97 active+clean; 946 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.6 KiB/s wr, 13 op/s 2024-09-19T08:54:29.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:29 smithi155 ceph-mon[34921]: pgmap v405: 97 pgs: 97 active+clean; 946 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.6 KiB/s wr, 13 op/s 2024-09-19T08:54:30.479 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:30.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:30 smithi203 ceph-mon[35450]: pgmap v406: 97 pgs: 97 active+clean; 952 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.7 KiB/s wr, 14 op/s 2024-09-19T08:54:30.507 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:30 smithi019 ceph-mon[30976]: pgmap v406: 97 pgs: 97 active+clean; 952 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.7 KiB/s wr, 14 op/s 2024-09-19T08:54:30.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:30 smithi155 ceph-mon[34921]: pgmap v406: 97 pgs: 97 active+clean; 952 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.7 KiB/s wr, 14 op/s 2024-09-19T08:54:31.067 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:31.067 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:31.392 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:31.393 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:31.447 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:31.448 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:31.448 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 29 -lt 100 ']' 2024-09-19T08:54:31.448 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 29 + 1 2024-09-19T08:54:31.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:31 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:31.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:31 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:54:31.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:31 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:54:31.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:31 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:31.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:31 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:54:31.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:31 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:54:31.573 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:31 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:54:31.574 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:31 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:54:31.574 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:31 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:54:31.792 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=30 2024-09-19T08:54:31.792 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:31.863 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:31.863 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:31.864 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:31.864 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:31.864 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:32.437 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:32 smithi019 ceph-mon[30976]: pgmap v407: 97 pgs: 97 active+clean; 952 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.1 KiB/s wr, 12 op/s 2024-09-19T08:54:32.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:32 smithi203 ceph-mon[35450]: pgmap v407: 97 pgs: 97 active+clean; 952 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.1 KiB/s wr, 12 op/s 2024-09-19T08:54:32.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:32 smithi155 ceph-mon[34921]: pgmap v407: 97 pgs: 97 active+clean; 952 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.1 KiB/s wr, 12 op/s 2024-09-19T08:54:32.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.694+0000 7f983c98f640 1 -- 172.21.15.19:0/4254578761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9838102d30 msgr2=0x7f9838103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:32.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.694+0000 7f983c98f640 1 --2- 172.21.15.19:0/4254578761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9838102d30 0x7f9838103110 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f9828009930 tx=0x7f982802a420 comp rx=0 tx=0).stop 2024-09-19T08:54:32.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.694+0000 7f983c98f640 1 -- 172.21.15.19:0/4254578761 shutdown_connections 2024-09-19T08:54:32.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.694+0000 7f983c98f640 1 --2- 172.21.15.19:0/4254578761 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98381036e0 0x7f9838107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:32.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.694+0000 7f983c98f640 1 --2- 172.21.15.19:0/4254578761 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98381082a0 0x7f983810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:32.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.694+0000 7f983c98f640 1 --2- 172.21.15.19:0/4254578761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9838102d30 0x7f9838103110 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:32.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.694+0000 7f983c98f640 1 -- 172.21.15.19:0/4254578761 >> 172.21.15.19:0/4254578761 conn(0x7f98380fc7d0 msgr2=0x7f98380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:32.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.694+0000 7f983c98f640 1 -- 172.21.15.19:0/4254578761 shutdown_connections 2024-09-19T08:54:32.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.694+0000 7f983c98f640 1 -- 172.21.15.19:0/4254578761 wait complete. 2024-09-19T08:54:32.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.695+0000 7f983c98f640 1 Processor -- start 2024-09-19T08:54:32.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.695+0000 7f983c98f640 1 -- start start 2024-09-19T08:54:32.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.696+0000 7f983c98f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9838102d30 0x7f98381985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:32.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.696+0000 7f983c98f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98381036e0 0x7f9838198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:32.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.696+0000 7f983c98f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98381082a0 0x7f983819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:32.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.696+0000 7f983c98f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f98381120e0 con 0x7f9838102d30 2024-09-19T08:54:32.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.696+0000 7f983c98f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9838111f60 con 0x7f98381082a0 2024-09-19T08:54:32.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.696+0000 7f983c98f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9838112260 con 0x7f98381036e0 2024-09-19T08:54:32.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.696+0000 7f983659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9838102d30 0x7f98381985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:32.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.696+0000 7f983659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9838102d30 0x7f98381985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54676/0 (socket says 172.21.15.19:54676) 2024-09-19T08:54:32.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.696+0000 7f983659c640 1 -- 172.21.15.19:0/3145435816 learned_addr learned my addr 172.21.15.19:0/3145435816 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:32.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.696+0000 7f9835d9b640 1 --2- 172.21.15.19:0/3145435816 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98381036e0 0x7f9838198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:32.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.696+0000 7f9836d9d640 1 --2- 172.21.15.19:0/3145435816 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98381082a0 0x7f983819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:32.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.696+0000 7f983659c640 1 -- 172.21.15.19:0/3145435816 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98381036e0 msgr2=0x7f9838198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:32.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.696+0000 7f983659c640 1 --2- 172.21.15.19:0/3145435816 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98381036e0 0x7f9838198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:32.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.696+0000 7f983659c640 1 -- 172.21.15.19:0/3145435816 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98381082a0 msgr2=0x7f983819ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:32.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.696+0000 7f983659c640 1 --2- 172.21.15.19:0/3145435816 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98381082a0 0x7f983819ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:32.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.696+0000 7f983659c640 1 -- 172.21.15.19:0/3145435816 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f983819d550 con 0x7f9838102d30 2024-09-19T08:54:32.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.696+0000 7f9835d9b640 1 --2- 172.21.15.19:0/3145435816 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98381036e0 0x7f9838198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:32.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.697+0000 7f983659c640 1 --2- 172.21.15.19:0/3145435816 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9838102d30 0x7f98381985a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f982802a940 tx=0x7f9828003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:32.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.697+0000 7f98277fe640 1 -- 172.21.15.19:0/3145435816 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982803f070 con 0x7f9838102d30 2024-09-19T08:54:32.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.697+0000 7f983c98f640 1 -- 172.21.15.19:0/3145435816 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f983819d7e0 con 0x7f9838102d30 2024-09-19T08:54:32.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.697+0000 7f98277fe640 1 -- 172.21.15.19:0/3145435816 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9828031c90 con 0x7f9838102d30 2024-09-19T08:54:32.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.697+0000 7f98277fe640 1 -- 172.21.15.19:0/3145435816 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9828035030 con 0x7f9838102d30 2024-09-19T08:54:32.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.697+0000 7f983c98f640 1 -- 172.21.15.19:0/3145435816 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98381a5120 con 0x7f9838102d30 2024-09-19T08:54:32.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.699+0000 7f98277fe640 1 -- 172.21.15.19:0/3145435816 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f9828042070 con 0x7f9838102d30 2024-09-19T08:54:32.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.700+0000 7f98277fe640 1 --2- 172.21.15.19:0/3145435816 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f98200a3240 0x7f98200a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:32.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.700+0000 7f9835d9b640 1 --2- 172.21.15.19:0/3145435816 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f98200a3240 0x7f98200a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:32.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.700+0000 7f98277fe640 1 -- 172.21.15.19:0/3145435816 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f98280f00d0 con 0x7f9838102d30 2024-09-19T08:54:32.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.701+0000 7f9835d9b640 1 --2- 172.21.15.19:0/3145435816 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f98200a3240 0x7f98200a5700 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f98380fed90 tx=0x7f982c005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:32.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.896+0000 7f983ed68740 1 Processor -- start 2024-09-19T08:54:32.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.896+0000 7f983ed68740 1 -- start start 2024-09-19T08:54:32.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.896+0000 7f983ed68740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7152b8b40 0x55b7152b7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:32.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.896+0000 7f983ed68740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b7152b75d0 0x55b7152b7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:32.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.896+0000 7f983ed68740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b7152c6780 0x55b7152c8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:32.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.896+0000 7f983ed68740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b71521d2f0 con 0x55b7152c6780 2024-09-19T08:54:32.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.896+0000 7f983ed68740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b7151c4cf0 con 0x55b7152b8b40 2024-09-19T08:54:32.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.896+0000 7f983ed68740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b7152192b0 con 0x55b7152b75d0 2024-09-19T08:54:32.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.897+0000 7f9836d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b7152c6780 0x55b7152c8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:32.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.897+0000 7f9836d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b7152c6780 0x55b7152c8b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54692/0 (socket says 172.21.15.19:54692) 2024-09-19T08:54:32.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.897+0000 7f9836d9d640 1 -- 172.21.15.19:0/994047798 learned_addr learned my addr 172.21.15.19:0/994047798 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:32.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.897+0000 7f9835d9b640 1 --2- 172.21.15.19:0/994047798 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b7152b75d0 0x55b7152b7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:32.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.897+0000 7f983659c640 1 --2- 172.21.15.19:0/994047798 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7152b8b40 0x55b7152b7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:32.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.897+0000 7f9836d9d640 1 -- 172.21.15.19:0/994047798 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b7152b75d0 msgr2=0x55b7152b7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:32.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.897+0000 7f9836d9d640 1 --2- 172.21.15.19:0/994047798 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b7152b75d0 0x55b7152b7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:32.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.897+0000 7f9836d9d640 1 -- 172.21.15.19:0/994047798 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7152b8b40 msgr2=0x55b7152b7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:32.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.897+0000 7f9836d9d640 1 --2- 172.21.15.19:0/994047798 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7152b8b40 0x55b7152b7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:32.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.897+0000 7f9836d9d640 1 -- 172.21.15.19:0/994047798 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7151a93a0 con 0x55b7152c6780 2024-09-19T08:54:32.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.897+0000 7f9836d9d640 1 --2- 172.21.15.19:0/994047798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b7152c6780 0x55b7152c8b70 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f9830009f90 tx=0x7f9830010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=788455478de60108 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:32.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.897+0000 7f9824ff9640 1 -- 172.21.15.19:0/994047798 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9830011700 con 0x55b7152c6780 2024-09-19T08:54:32.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.898+0000 7f9824ff9640 1 -- 172.21.15.19:0/994047798 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9830011d80 con 0x55b7152c6780 2024-09-19T08:54:32.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.898+0000 7f9824ff9640 1 -- 172.21.15.19:0/994047798 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9830018380 con 0x55b7152c6780 2024-09-19T08:54:32.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.898+0000 7f983ed68740 1 -- 172.21.15.19:0/994047798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b7152c6780 msgr2=0x55b7152c8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:32.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.898+0000 7f983ed68740 1 --2- 172.21.15.19:0/994047798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b7152c6780 0x55b7152c8b70 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f9830009f90 tx=0x7f9830010860 comp rx=0 tx=0).stop 2024-09-19T08:54:32.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.898+0000 7f983ed68740 1 -- 172.21.15.19:0/994047798 shutdown_connections 2024-09-19T08:54:32.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.898+0000 7f983ed68740 1 --2- 172.21.15.19:0/994047798 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b7152b75d0 0x55b7152b7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:32.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.898+0000 7f983ed68740 1 --2- 172.21.15.19:0/994047798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b7152c6780 0x55b7152c8b70 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:32.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.898+0000 7f983ed68740 1 --2- 172.21.15.19:0/994047798 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7152b8b40 0x55b7152b7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:32.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.898+0000 7f983ed68740 1 -- 172.21.15.19:0/994047798 >> 172.21.15.19:0/994047798 conn(0x55b715280310 msgr2=0x55b7152b3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:32.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.899+0000 7f983ed68740 1 -- 172.21.15.19:0/994047798 shutdown_connections 2024-09-19T08:54:32.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.899+0000 7f983ed68740 1 -- 172.21.15.19:0/994047798 wait complete. 2024-09-19T08:54:32.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.899+0000 7f983ed68740 1 -- start start 2024-09-19T08:54:32.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.899+0000 7f983ed68740 1 Processor -- start 2024-09-19T08:54:32.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.899+0000 7f983ed68740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7152b75d0 0x55b7152c6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:32.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.900+0000 7f983ed68740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b7152b8b40 0x55b7152c3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:32.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.900+0000 7f983ed68740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b7152c6780 0x55b7152c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:32.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.900+0000 7f983ed68740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b7152c9480 con 0x55b7152c6780 2024-09-19T08:54:32.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.900+0000 7f983ed68740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b7151d8060 con 0x55b7152b75d0 2024-09-19T08:54:32.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.900+0000 7f983ed68740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b7152c9600 con 0x55b7152b8b40 2024-09-19T08:54:32.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.900+0000 7f983ed68740 10 client.0 _ll_register_callbacks cb 0x55b714f2b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:32.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.900+0000 7f983659c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7152b75d0 0x55b7152c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:32.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.900+0000 7f9835d9b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b7152b8b40 0x55b7152c3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:32.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.900+0000 7f9836d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b7152c6780 0x55b7152c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:32.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.900+0000 7f9835d9b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b7152b8b40 0x55b7152c3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:52780/0 (socket says 172.21.15.19:52780) 2024-09-19T08:54:32.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.900+0000 7f9835d9b640 1 -- 172.21.15.19:0/325174928 learned_addr learned my addr 172.21.15.19:0/325174928 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:32.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.900+0000 7f983659c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7152b75d0 0x55b7152c6160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:48384/0 (socket says 172.21.15.19:48384) 2024-09-19T08:54:32.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.900+0000 7f983659c640 1 -- 172.21.15.19:0/325174928 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b7152b8b40 msgr2=0x55b7152c3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:32.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.900+0000 7f983659c640 1 --2- 172.21.15.19:0/325174928 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b7152b8b40 0x55b7152c3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:32.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.900+0000 7f983659c640 1 -- 172.21.15.19:0/325174928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b7152c6780 msgr2=0x55b7152c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:32.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.900+0000 7f983659c640 1 --2- 172.21.15.19:0/325174928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b7152c6780 0x55b7152c39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:32.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.900+0000 7f983659c640 1 -- 172.21.15.19:0/325174928 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b714f8e3c0 con 0x55b7152b75d0 2024-09-19T08:54:32.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.900+0000 7f9836d9d640 1 --2- 172.21.15.19:0/325174928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b7152c6780 0x55b7152c39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:54:32.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.900+0000 7f9835d9b640 1 --2- 172.21.15.19:0/325174928 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b7152b8b40 0x55b7152c3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:54:32.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.900+0000 7f983659c640 1 --2- 172.21.15.19:0/325174928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7152b75d0 0x55b7152c6160 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9828004650 tx=0x7f9828009620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=760577e569f0da25 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:32.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.900+0000 7f981dffb640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T08:54:32.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.901+0000 7f981dffb640 1 -- 172.21.15.19:0/325174928 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98280d4070 con 0x55b7152b75d0 2024-09-19T08:54:32.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.901+0000 7f983ed68740 1 -- 172.21.15.19:0/325174928 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9830011d80 con 0x55b7152b75d0 2024-09-19T08:54:32.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.901+0000 7f981dffb640 1 -- 172.21.15.19:0/325174928 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f982803b5f0 con 0x55b7152b75d0 2024-09-19T08:54:32.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.901+0000 7f981dffb640 1 -- 172.21.15.19:0/325174928 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9828049050 con 0x55b7152b75d0 2024-09-19T08:54:32.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.901+0000 7f983ed68740 10 client.25508 fetch_fsmap learned FSMap version 30 2024-09-19T08:54:32.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.901+0000 7f983ed68740 1 -- 172.21.15.19:0/325174928 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b7152d4f00 con 0x55b7152b75d0 2024-09-19T08:54:32.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.901+0000 7f981dffb640 1 -- 172.21.15.19:0/325174928 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9830011d80 con 0x55b7152b75d0 2024-09-19T08:54:32.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.901+0000 7f981dffb640 1 -- 172.21.15.19:0/325174928 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f98280c4ee0 con 0x55b7152b75d0 2024-09-19T08:54:32.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.901+0000 7f983ed68740 10 client.25508 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T08:54:32.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.901+0000 7f983ed68740 10 client.25508 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T08:54:32.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.901+0000 7f983ed68740 20 client.25508 populate_metadata read hostname 'smithi019' 2024-09-19T08:54:32.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.901+0000 7f983ed68740 1 --2- 172.21.15.19:0/325174928 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55b7152d63e0 0x55b7152d8860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:32.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.901+0000 7f983ed68740 4 client.25508 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:54:32.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.901+0000 7f983ed68740 1 -- 172.21.15.19:0/325174928 --> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b71522a860 con 0x55b7152d63e0 2024-09-19T08:54:32.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.902+0000 7f9835d9b640 1 --2- 172.21.15.19:0/325174928 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55b7152d63e0 0x55b7152d8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:32.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.902+0000 7f9835d9b640 1 --2- 172.21.15.19:0/325174928 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55b7152d63e0 0x55b7152d8860 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2aa1ee002f997b07 server_cookie=8d39196c0a85f99f in_seq=0 out_seq=0 2024-09-19T08:54:32.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.902+0000 7f981dffb640 10 client.25508 ms_handle_connect on v2:172.21.15.203:6836/3684671619 2024-09-19T08:54:32.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.903+0000 7f981dffb640 1 -- 172.21.15.19:0/325174928 <== mds.2 v2:172.21.15.203:6836/3684671619 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b71522a860 con 0x55b7152d63e0 2024-09-19T08:54:32.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.903+0000 7f981dffb640 10 client.25508 handle_command_reply: tid=0 2024-09-19T08:54:32.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.903+0000 7f983ed68740 1 client.25508 shutdown 2024-09-19T08:54:32.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.903+0000 7f983ed68740 1 -- 172.21.15.19:0/325174928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7152b75d0 msgr2=0x55b7152c6160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:32.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.903+0000 7f983ed68740 1 --2- 172.21.15.19:0/325174928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7152b75d0 0x55b7152c6160 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9828004650 tx=0x7f9828009620 comp rx=0 tx=0).stop 2024-09-19T08:54:32.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.903+0000 7f983ed68740 1 -- 172.21.15.19:0/325174928 shutdown_connections 2024-09-19T08:54:32.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.903+0000 7f983ed68740 1 --2- 172.21.15.19:0/325174928 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55b7152d63e0 0x55b7152d8860 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:32.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.903+0000 7f983ed68740 1 --2- 172.21.15.19:0/325174928 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b7152b8b40 0x55b7152c3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:32.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.903+0000 7f983ed68740 1 --2- 172.21.15.19:0/325174928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b7152c6780 0x55b7152c39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:32.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.903+0000 7f981dffb640 0 client.25508 ms_handle_reset on v2:172.21.15.203:6836/3684671619 2024-09-19T08:54:32.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.903+0000 7f983ed68740 1 --2- 172.21.15.19:0/325174928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7152b75d0 0x55b7152c6160 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:32.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.903+0000 7f983ed68740 1 -- 172.21.15.19:0/325174928 >> 172.21.15.19:0/325174928 conn(0x55b715280310 msgr2=0x55b7152b9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:32.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.903+0000 7f983ed68740 1 -- 172.21.15.19:0/325174928 shutdown_connections 2024-09-19T08:54:32.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.903+0000 7f983ed68740 1 -- 172.21.15.19:0/325174928 wait complete. 2024-09-19T08:54:32.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.903+0000 7f983ed68740 20 client.25508 trim_cache size 0 max 16384 2024-09-19T08:54:32.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.917+0000 7f983ed68740 1 Processor -- start 2024-09-19T08:54:32.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.917+0000 7f983ed68740 1 -- start start 2024-09-19T08:54:32.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.917+0000 7f983ed68740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7152b75d0 0x55b7152b8300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:32.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.917+0000 7f983ed68740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b7152b8b40 0x55b7152d2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:32.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.917+0000 7f983ed68740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b7152c6780 0x55b7152c1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:32.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.917+0000 7f983ed68740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f98381ab370 con 0x55b7152b8b40 2024-09-19T08:54:32.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.917+0000 7f983ed68740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f98381acf70 con 0x55b7152b75d0 2024-09-19T08:54:32.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.917+0000 7f983ed68740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f98381aba40 con 0x55b7152c6780 2024-09-19T08:54:32.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.917+0000 7f9835d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b7152b8b40 0x55b7152d2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:32.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.917+0000 7f9835d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b7152b8b40 0x55b7152d2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54700/0 (socket says 172.21.15.19:54700) 2024-09-19T08:54:32.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.917+0000 7f9835d9b640 1 -- 172.21.15.19:0/3666946018 learned_addr learned my addr 172.21.15.19:0/3666946018 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:32.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.918+0000 7f983659c640 1 --2- 172.21.15.19:0/3666946018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7152b75d0 0x55b7152b8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:32.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.918+0000 7f9836d9d640 1 --2- 172.21.15.19:0/3666946018 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b7152c6780 0x55b7152c1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:32.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.918+0000 7f9835d9b640 1 -- 172.21.15.19:0/3666946018 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b7152c6780 msgr2=0x55b7152c1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:32.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.918+0000 7f9835d9b640 1 --2- 172.21.15.19:0/3666946018 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b7152c6780 0x55b7152c1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:32.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.918+0000 7f9835d9b640 1 -- 172.21.15.19:0/3666946018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7152b75d0 msgr2=0x55b7152b8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:32.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.918+0000 7f9835d9b640 1 --2- 172.21.15.19:0/3666946018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7152b75d0 0x55b7152b8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:32.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.918+0000 7f9835d9b640 1 -- 172.21.15.19:0/3666946018 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7152d8ee0 con 0x55b7152b8b40 2024-09-19T08:54:32.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.918+0000 7f9836d9d640 1 --2- 172.21.15.19:0/3666946018 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b7152c6780 0x55b7152c1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:54:32.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.918+0000 7f983659c640 1 --2- 172.21.15.19:0/3666946018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7152b75d0 0x55b7152b8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:32.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.918+0000 7f9835d9b640 1 --2- 172.21.15.19:0/3666946018 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b7152b8b40 0x55b7152d2720 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x55b7152c4a50 tx=0x7f982c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c8a7f4abf2da29d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:32.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.918+0000 7f981ffff640 1 -- 172.21.15.19:0/3666946018 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982c020190 con 0x55b7152b8b40 2024-09-19T08:54:32.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.918+0000 7f981ffff640 1 -- 172.21.15.19:0/3666946018 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f982c020330 con 0x55b7152b8b40 2024-09-19T08:54:32.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.918+0000 7f981ffff640 1 -- 172.21.15.19:0/3666946018 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f982c010a50 con 0x55b7152b8b40 2024-09-19T08:54:32.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.919+0000 7f983ed68740 1 -- 172.21.15.19:0/3666946018 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b7152b8b40 msgr2=0x55b7152d2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:32.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.919+0000 7f983ed68740 1 --2- 172.21.15.19:0/3666946018 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b7152b8b40 0x55b7152d2720 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x55b7152c4a50 tx=0x7f982c011000 comp rx=0 tx=0).stop 2024-09-19T08:54:32.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.919+0000 7f983ed68740 1 -- 172.21.15.19:0/3666946018 shutdown_connections 2024-09-19T08:54:32.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.919+0000 7f983ed68740 1 --2- 172.21.15.19:0/3666946018 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b7152c6780 0x55b7152c1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:32.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.919+0000 7f983ed68740 1 --2- 172.21.15.19:0/3666946018 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b7152b8b40 0x55b7152d2720 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:32.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.919+0000 7f983ed68740 1 --2- 172.21.15.19:0/3666946018 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7152b75d0 0x55b7152b8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:32.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.919+0000 7f983ed68740 1 -- 172.21.15.19:0/3666946018 >> 172.21.15.19:0/3666946018 conn(0x55b715280310 msgr2=0x55b7152aea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:32.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.919+0000 7f983ed68740 1 -- 172.21.15.19:0/3666946018 shutdown_connections 2024-09-19T08:54:32.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.919+0000 7f983ed68740 1 -- 172.21.15.19:0/3666946018 wait complete. 2024-09-19T08:54:32.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.919+0000 7f983ed68740 1 -- start start 2024-09-19T08:54:32.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.920+0000 7f983ed68740 1 Processor -- start 2024-09-19T08:54:32.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.920+0000 7f983ed68740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b7152b75d0 0x55b7152c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:32.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.920+0000 7f983ed68740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b7152b8b40 0x55b7152ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:32.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.920+0000 7f983ed68740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7152c6780 0x55b71533f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:32.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.920+0000 7f983ed68740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f98381ac7e0 con 0x55b7152b75d0 2024-09-19T08:54:32.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.920+0000 7f983ed68740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f98381ac110 con 0x55b7152c6780 2024-09-19T08:54:32.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.920+0000 7f983ed68740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f98381a9370 con 0x55b7152b8b40 2024-09-19T08:54:32.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.920+0000 7f983ed68740 10 client.0 _ll_register_callbacks cb 0x7f9828009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:32.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.920+0000 7f983659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b7152b75d0 0x55b7152c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:32.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.920+0000 7f983659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b7152b75d0 0x55b7152c9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54708/0 (socket says 172.21.15.19:54708) 2024-09-19T08:54:32.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.920+0000 7f983659c640 1 -- 172.21.15.19:0/720309493 learned_addr learned my addr 172.21.15.19:0/720309493 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:32.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.920+0000 7f9835d9b640 1 --2- 172.21.15.19:0/720309493 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b7152b8b40 0x55b7152ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:32.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.920+0000 7f9836d9d640 1 --2- 172.21.15.19:0/720309493 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7152c6780 0x55b71533f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:32.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.920+0000 7f983659c640 1 -- 172.21.15.19:0/720309493 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b7152b8b40 msgr2=0x55b7152ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:32.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.920+0000 7f983659c640 1 --2- 172.21.15.19:0/720309493 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b7152b8b40 0x55b7152ca330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:32.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.920+0000 7f983659c640 1 -- 172.21.15.19:0/720309493 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7152c6780 msgr2=0x55b71533f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:32.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.920+0000 7f983659c640 1 --2- 172.21.15.19:0/720309493 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7152c6780 0x55b71533f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:32.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.920+0000 7f983659c640 1 -- 172.21.15.19:0/720309493 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b71533f720 con 0x55b7152b75d0 2024-09-19T08:54:32.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.921+0000 7f9835d9b640 1 --2- 172.21.15.19:0/720309493 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b7152b8b40 0x55b7152ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:32.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.921+0000 7f9836d9d640 1 --2- 172.21.15.19:0/720309493 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7152c6780 0x55b71533f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:32.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.921+0000 7f983659c640 1 --2- 172.21.15.19:0/720309493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b7152b75d0 0x55b7152c9df0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f98280b8b60 tx=0x7f98280b8fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5a8c16f3dc774cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:32.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.921+0000 7f981dffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:54:32.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.921+0000 7f981dffb640 1 -- 172.21.15.19:0/720309493 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98280a1030 con 0x55b7152b75d0 2024-09-19T08:54:32.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.921+0000 7f981dffb640 1 -- 172.21.15.19:0/720309493 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f98280bbb50 con 0x55b7152b75d0 2024-09-19T08:54:32.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.921+0000 7f983ed68740 1 -- 172.21.15.19:0/720309493 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f982c020330 con 0x55b7152b75d0 2024-09-19T08:54:32.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.921+0000 7f981dffb640 1 -- 172.21.15.19:0/720309493 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f98280d4070 con 0x55b7152b75d0 2024-09-19T08:54:32.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.921+0000 7f983ed68740 10 client.15927 fetch_fsmap learned FSMap version 30 2024-09-19T08:54:32.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.921+0000 7f983ed68740 1 -- 172.21.15.19:0/720309493 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b715340970 con 0x55b7152b75d0 2024-09-19T08:54:32.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.921+0000 7f981dffb640 1 -- 172.21.15.19:0/720309493 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f982c020330 con 0x55b7152b75d0 2024-09-19T08:54:32.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.922+0000 7f981dffb640 1 -- 172.21.15.19:0/720309493 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f98280b8450 con 0x55b7152b75d0 2024-09-19T08:54:32.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.922+0000 7f983ed68740 10 client.15927 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T08:54:32.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.922+0000 7f983ed68740 10 client.15927 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T08:54:32.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.922+0000 7f983ed68740 20 client.15927 populate_metadata read hostname 'smithi019' 2024-09-19T08:54:32.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.922+0000 7f983ed68740 1 --2- 172.21.15.19:0/720309493 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55b715340ee0 0x55b715343300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:32.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.922+0000 7f983ed68740 4 client.15927 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:54:32.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.922+0000 7f983ed68740 1 -- 172.21.15.19:0/720309493 --> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b715224d70 con 0x55b715340ee0 2024-09-19T08:54:32.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.922+0000 7f9835d9b640 1 --2- 172.21.15.19:0/720309493 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55b715340ee0 0x55b715343300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:32.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.923+0000 7f981dffb640 10 client.15927 ms_handle_connect on v2:172.21.15.203:6836/3684671619 2024-09-19T08:54:32.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.923+0000 7f9835d9b640 1 --2- 172.21.15.19:0/720309493 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55b715340ee0 0x55b715343300 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=40fc44515fe27bab server_cookie=fbe772e6c0b7404d in_seq=0 out_seq=0 2024-09-19T08:54:32.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.923+0000 7f981dffb640 1 -- 172.21.15.19:0/720309493 <== mds.2 v2:172.21.15.203:6836/3684671619 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b715224d70 con 0x55b715340ee0 2024-09-19T08:54:32.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.923+0000 7f981dffb640 10 client.15927 handle_command_reply: tid=0 2024-09-19T08:54:32.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.923+0000 7f983ed68740 1 client.15927 shutdown 2024-09-19T08:54:32.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.923+0000 7f983ed68740 1 -- 172.21.15.19:0/720309493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b7152b75d0 msgr2=0x55b7152c9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:32.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.923+0000 7f983ed68740 1 --2- 172.21.15.19:0/720309493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b7152b75d0 0x55b7152c9df0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f98280b8b60 tx=0x7f98280b8fa0 comp rx=0 tx=0).stop 2024-09-19T08:54:32.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.923+0000 7f983ed68740 1 -- 172.21.15.19:0/720309493 shutdown_connections 2024-09-19T08:54:32.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.923+0000 7f983ed68740 1 --2- 172.21.15.19:0/720309493 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55b715340ee0 0x55b715343300 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:32.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.923+0000 7f983ed68740 1 --2- 172.21.15.19:0/720309493 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b7152b8b40 0x55b7152ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:32.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.923+0000 7f983ed68740 1 --2- 172.21.15.19:0/720309493 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b7152c6780 0x55b71533f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:32.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.923+0000 7f983ed68740 1 --2- 172.21.15.19:0/720309493 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b7152b75d0 0x55b7152c9df0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:32.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.923+0000 7f981dffb640 0 client.15927 ms_handle_reset on v2:172.21.15.203:6836/3684671619 2024-09-19T08:54:32.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.923+0000 7f983ed68740 1 -- 172.21.15.19:0/720309493 >> 172.21.15.19:0/720309493 conn(0x55b715280310 msgr2=0x55b7152c18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:32.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.923+0000 7f983ed68740 1 -- 172.21.15.19:0/720309493 shutdown_connections 2024-09-19T08:54:32.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.923+0000 7f983ed68740 1 -- 172.21.15.19:0/720309493 wait complete. 2024-09-19T08:54:32.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.923+0000 7f983ed68740 20 client.15927 trim_cache size 0 max 16384 2024-09-19T08:54:32.934 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T08:54:32.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.924+0000 7f983c98f640 1 -- 172.21.15.19:0/3145435816 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f98200a3240 msgr2=0x7f98200a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:32.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.924+0000 7f983c98f640 1 --2- 172.21.15.19:0/3145435816 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f98200a3240 0x7f98200a5700 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f98380fed90 tx=0x7f982c005ec0 comp rx=0 tx=0).stop 2024-09-19T08:54:32.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.924+0000 7f983c98f640 1 -- 172.21.15.19:0/3145435816 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9838102d30 msgr2=0x7f98381985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:32.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.924+0000 7f983c98f640 1 --2- 172.21.15.19:0/3145435816 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9838102d30 0x7f98381985a0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f982802a940 tx=0x7f9828003b90 comp rx=0 tx=0).stop 2024-09-19T08:54:32.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.924+0000 7f983c98f640 1 -- 172.21.15.19:0/3145435816 shutdown_connections 2024-09-19T08:54:32.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.924+0000 7f983c98f640 1 --2- 172.21.15.19:0/3145435816 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f98200a3240 0x7f98200a5700 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:32.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.924+0000 7f983c98f640 1 --2- 172.21.15.19:0/3145435816 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f98381036e0 0x7f9838198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:32.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.924+0000 7f983c98f640 1 --2- 172.21.15.19:0/3145435816 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f98381082a0 0x7f983819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:32.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.924+0000 7f983c98f640 1 --2- 172.21.15.19:0/3145435816 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9838102d30 0x7f98381985a0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:32.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.924+0000 7f983c98f640 1 -- 172.21.15.19:0/3145435816 >> 172.21.15.19:0/3145435816 conn(0x7f98380fc7d0 msgr2=0x7f9838106380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:32.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.924+0000 7f983c98f640 1 -- 172.21.15.19:0/3145435816 shutdown_connections 2024-09-19T08:54:32.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:32.924+0000 7f983c98f640 1 -- 172.21.15.19:0/3145435816 wait complete. 2024-09-19T08:54:33.476 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:33.476 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:34.220 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:34.220 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:34.301 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:34.301 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:34.301 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 30 -lt 100 ']' 2024-09-19T08:54:34.301 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 30 + 1 2024-09-19T08:54:34.447 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=31 2024-09-19T08:54:34.447 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:34.513 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:34.513 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:34.515 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:34.515 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:34.515 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:35.317 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:35 smithi019 ceph-mon[30976]: pgmap v408: 97 pgs: 97 active+clean; 968 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 KiB/s wr, 13 op/s 2024-09-19T08:54:35.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:35 smithi155 ceph-mon[34921]: pgmap v408: 97 pgs: 97 active+clean; 968 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 KiB/s wr, 13 op/s 2024-09-19T08:54:35.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:35 smithi203 ceph-mon[35450]: pgmap v408: 97 pgs: 97 active+clean; 968 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 KiB/s wr, 13 op/s 2024-09-19T08:54:35.500 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:35.500 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:35.854 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:35.855 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:35.867 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:35.868 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:35.868 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 31 -lt 100 ']' 2024-09-19T08:54:35.868 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 31 + 1 2024-09-19T08:54:36.118 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=32 2024-09-19T08:54:36.118 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:36.208 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:36.208 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:36.209 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:36.209 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:36.210 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:36.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:36 smithi203 ceph-mon[35450]: pgmap v409: 97 pgs: 97 active+clean; 968 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.4 KiB/s wr, 12 op/s 2024-09-19T08:54:36.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:36 smithi019 ceph-mon[30976]: pgmap v409: 97 pgs: 97 active+clean; 968 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.4 KiB/s wr, 12 op/s 2024-09-19T08:54:36.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:36 smithi155 ceph-mon[34921]: pgmap v409: 97 pgs: 97 active+clean; 968 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.4 KiB/s wr, 12 op/s 2024-09-19T08:54:37.973 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T08:54:37.974 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:37.974 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:38.375 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:38.375 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:38.442 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:38.442 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:38.442 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 32 -lt 100 ']' 2024-09-19T08:54:38.442 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 32 + 1 2024-09-19T08:54:38.509 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=33 2024-09-19T08:54:38.509 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:38.615 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:38.616 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:38.617 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:38.617 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:38.617 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:38.832 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.831+0000 7efdbfe74640 1 -- 172.21.15.19:0/3672701984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdb8101b60 msgr2=0x7efdb8101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:38.832 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.831+0000 7efdbfe74640 1 --2- 172.21.15.19:0/3672701984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdb8101b60 0x7efdb8101f60 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7efdb4009900 tx=0x7efdb402a3f0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.832 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.831+0000 7efdbfe74640 1 -- 172.21.15.19:0/3672701984 shutdown_connections 2024-09-19T08:54:38.832 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.831+0000 7efdbfe74640 1 --2- 172.21.15.19:0/3672701984 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efdb8102d50 0x7efdb81031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.832 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.831+0000 7efdbfe74640 1 --2- 172.21.15.19:0/3672701984 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdb8103710 0x7efdb8109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.833 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.831+0000 7efdbfe74640 1 --2- 172.21.15.19:0/3672701984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdb8101b60 0x7efdb8101f60 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.833 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.831+0000 7efdbfe74640 1 -- 172.21.15.19:0/3672701984 >> 172.21.15.19:0/3672701984 conn(0x7efdb80fd2c0 msgr2=0x7efdb80ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:38.833 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.832+0000 7efdbfe74640 1 -- 172.21.15.19:0/3672701984 shutdown_connections 2024-09-19T08:54:38.833 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.832+0000 7efdbfe74640 1 -- 172.21.15.19:0/3672701984 wait complete. 2024-09-19T08:54:38.863 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.862+0000 7efdbfe74640 1 Processor -- start 2024-09-19T08:54:38.863 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.862+0000 7efdbfe74640 1 -- start start 2024-09-19T08:54:38.863 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.862+0000 7efdbfe74640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdb8101b60 0x7efdb8075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:38.863 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.862+0000 7efdbfe74640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efdb8102d50 0x7efdb80745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:38.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.862+0000 7efdbfe74640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdb8103710 0x7efdb8074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:38.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.862+0000 7efdbfe74640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7efdb810d830 con 0x7efdb8101b60 2024-09-19T08:54:38.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.862+0000 7efdbfe74640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efdb810d6b0 con 0x7efdb8103710 2024-09-19T08:54:38.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.862+0000 7efdbfe74640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efdb810d9b0 con 0x7efdb8102d50 2024-09-19T08:54:38.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.862+0000 7efdbdc10640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdb8101b60 0x7efdb8075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:38.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.862+0000 7efdbdc10640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdb8101b60 0x7efdb8075fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56096/0 (socket says 172.21.15.19:56096) 2024-09-19T08:54:38.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.862+0000 7efdbdc10640 1 -- 172.21.15.19:0/1270741295 learned_addr learned my addr 172.21.15.19:0/1270741295 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:38.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.862+0000 7efdbd40f640 1 --2- 172.21.15.19:0/1270741295 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efdb8102d50 0x7efdb80745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:38.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.863+0000 7efdbe411640 1 --2- 172.21.15.19:0/1270741295 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdb8103710 0x7efdb8074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:38.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.863+0000 7efdbdc10640 1 -- 172.21.15.19:0/1270741295 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efdb8102d50 msgr2=0x7efdb80745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:38.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.863+0000 7efdbdc10640 1 --2- 172.21.15.19:0/1270741295 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efdb8102d50 0x7efdb80745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.863+0000 7efdbdc10640 1 -- 172.21.15.19:0/1270741295 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdb8103710 msgr2=0x7efdb8074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:38.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.863+0000 7efdbdc10640 1 --2- 172.21.15.19:0/1270741295 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdb8103710 0x7efdb8074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:38.865 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.863+0000 7efdbdc10640 1 -- 172.21.15.19:0/1270741295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb80753b0 con 0x7efdb8101b60 2024-09-19T08:54:38.865 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.863+0000 7efdbe411640 1 --2- 172.21.15.19:0/1270741295 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdb8103710 0x7efdb8074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:54:38.865 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.863+0000 7efdbdc10640 1 --2- 172.21.15.19:0/1270741295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdb8101b60 0x7efdb8075fa0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7efdb4031610 tx=0x7efdb4032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:38.867 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.867+0000 7efdaeffd640 1 -- 172.21.15.19:0/1270741295 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb403f030 con 0x7efdb8101b60 2024-09-19T08:54:38.867 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.867+0000 7efdaeffd640 1 -- 172.21.15.19:0/1270741295 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdb4003ce0 con 0x7efdb8101b60 2024-09-19T08:54:38.867 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.867+0000 7efdaeffd640 1 -- 172.21.15.19:0/1270741295 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb4035070 con 0x7efdb8101b60 2024-09-19T08:54:38.867 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.867+0000 7efdbfe74640 1 -- 172.21.15.19:0/1270741295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdb81a1f50 con 0x7efdb8101b60 2024-09-19T08:54:38.869 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.869+0000 7efdaeffd640 1 -- 172.21.15.19:0/1270741295 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7efdb4042030 con 0x7efdb8101b60 2024-09-19T08:54:38.870 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.870+0000 7efdaeffd640 1 --2- 172.21.15.19:0/1270741295 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7efda40a3460 0x7efda40a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:38.870 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.870+0000 7efdbd40f640 1 --2- 172.21.15.19:0/1270741295 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7efda40a3460 0x7efda40a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:38.871 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.871+0000 7efdbd40f640 1 --2- 172.21.15.19:0/1270741295 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7efda40a3460 0x7efda40a5920 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7efdb8075d10 tx=0x7efda8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:38.935 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.935+0000 7efdbfe74640 1 -- 172.21.15.19:0/1270741295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdb81a2360 con 0x7efdb8101b60 2024-09-19T08:54:38.935 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:38.935+0000 7efdaeffd640 1 -- 172.21.15.19:0/1270741295 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7efdb40b9be0 con 0x7efdb8101b60 2024-09-19T08:54:39.076 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.074+0000 7efdc2c16740 1 Processor -- start 2024-09-19T08:54:39.076 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.074+0000 7efdc2c16740 1 -- start start 2024-09-19T08:54:39.076 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.074+0000 7efdc2c16740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d736f429a0 0x55d736f42da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:39.076 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.074+0000 7efdc2c16740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d736f432e0 0x55d736f47da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:39.076 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.074+0000 7efdc2c16740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d736f48370 0x55d736f4a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:39.076 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.075+0000 7efdc2c16740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d736ea62f0 con 0x55d736f429a0 2024-09-19T08:54:39.077 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.075+0000 7efdc2c16740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55d736e4e270 con 0x55d736f48370 2024-09-19T08:54:39.077 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.075+0000 7efdc2c16740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d736ea22b0 con 0x55d736f432e0 2024-09-19T08:54:39.077 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.075+0000 7efdbdc10640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d736f429a0 0x55d736f42da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:39.077 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.075+0000 7efdbdc10640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d736f429a0 0x55d736f42da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56112/0 (socket says 172.21.15.19:56112) 2024-09-19T08:54:39.077 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.075+0000 7efdbdc10640 1 -- 172.21.15.19:0/3447456306 learned_addr learned my addr 172.21.15.19:0/3447456306 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:39.077 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.075+0000 7efdbd40f640 1 --2- 172.21.15.19:0/3447456306 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d736f432e0 0x55d736f47da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:39.077 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.075+0000 7efdbe411640 1 --2- 172.21.15.19:0/3447456306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d736f48370 0x55d736f4a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:39.077 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.075+0000 7efdbdc10640 1 -- 172.21.15.19:0/3447456306 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d736f432e0 msgr2=0x55d736f47da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:39.077 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.075+0000 7efdbdc10640 1 --2- 172.21.15.19:0/3447456306 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d736f432e0 0x55d736f47da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.077 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.075+0000 7efdbdc10640 1 -- 172.21.15.19:0/3447456306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d736f48370 msgr2=0x55d736f4a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:39.077 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.075+0000 7efdbdc10640 1 --2- 172.21.15.19:0/3447456306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d736f48370 0x55d736f4a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.077 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.075+0000 7efdbdc10640 1 -- 172.21.15.19:0/3447456306 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d736e4d340 con 0x55d736f429a0 2024-09-19T08:54:39.077 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.075+0000 7efdbdc10640 1 --2- 172.21.15.19:0/3447456306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d736f429a0 0x55d736f42da0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7efdb403b760 tx=0x7efdb40bb680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b82b5465e8b96196 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:39.077 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.075+0000 7efda3fff640 1 -- 172.21.15.19:0/3447456306 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb40d8070 con 0x55d736f429a0 2024-09-19T08:54:39.078 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.075+0000 7efda3fff640 1 -- 172.21.15.19:0/3447456306 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdb40bbb40 con 0x55d736f429a0 2024-09-19T08:54:39.078 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.075+0000 7efda3fff640 1 -- 172.21.15.19:0/3447456306 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb40bbda0 con 0x55d736f429a0 2024-09-19T08:54:39.078 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.076+0000 7efdc2c16740 1 -- 172.21.15.19:0/3447456306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d736f429a0 msgr2=0x55d736f42da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:39.079 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.076+0000 7efdc2c16740 1 --2- 172.21.15.19:0/3447456306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d736f429a0 0x55d736f42da0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7efdb403b760 tx=0x7efdb40bb680 comp rx=0 tx=0).stop 2024-09-19T08:54:39.079 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.076+0000 7efdc2c16740 1 -- 172.21.15.19:0/3447456306 shutdown_connections 2024-09-19T08:54:39.079 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.076+0000 7efdc2c16740 1 --2- 172.21.15.19:0/3447456306 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d736f432e0 0x55d736f47da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.079 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.076+0000 7efdc2c16740 1 --2- 172.21.15.19:0/3447456306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d736f48370 0x55d736f4a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.079 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.076+0000 7efdc2c16740 1 --2- 172.21.15.19:0/3447456306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d736f429a0 0x55d736f42da0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.079 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.076+0000 7efdc2c16740 1 -- 172.21.15.19:0/3447456306 >> 172.21.15.19:0/3447456306 conn(0x55d736f3e010 msgr2=0x55d736f3e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:39.079 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.076+0000 7efdc2c16740 1 -- 172.21.15.19:0/3447456306 shutdown_connections 2024-09-19T08:54:39.079 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.076+0000 7efdc2c16740 1 -- 172.21.15.19:0/3447456306 wait complete. 2024-09-19T08:54:39.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.098+0000 7efdc2c16740 1 -- start start 2024-09-19T08:54:39.099 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.099+0000 7efdc2c16740 1 Processor -- start 2024-09-19T08:54:39.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.099+0000 7efdc2c16740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d736f429a0 0x55d736f4c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:39.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.099+0000 7efdc2c16740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d736f432e0 0x55d736f4cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:39.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.099+0000 7efdc2c16740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d736f48370 0x55d736f53cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:39.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.099+0000 7efdc2c16740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d736ea62f0 con 0x55d736f48370 2024-09-19T08:54:39.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.099+0000 7efdc2c16740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55d736e2f290 con 0x55d736f429a0 2024-09-19T08:54:39.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.099+0000 7efdc2c16740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d736f4b100 con 0x55d736f432e0 2024-09-19T08:54:39.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.100+0000 7efdbe411640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d736f48370 0x55d736f53cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:39.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.100+0000 7efdbe411640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d736f48370 0x55d736f53cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56128/0 (socket says 172.21.15.19:56128) 2024-09-19T08:54:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.100+0000 7efdbe411640 1 -- 172.21.15.19:0/248491680 learned_addr learned my addr 172.21.15.19:0/248491680 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.100+0000 7efdbd40f640 1 --2- 172.21.15.19:0/248491680 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d736f432e0 0x55d736f4cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.100+0000 7efdbdc10640 1 --2- 172.21.15.19:0/248491680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d736f429a0 0x55d736f4c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.100+0000 7efdbe411640 1 -- 172.21.15.19:0/248491680 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d736f432e0 msgr2=0x55d736f4cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.100+0000 7efdbe411640 1 --2- 172.21.15.19:0/248491680 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d736f432e0 0x55d736f4cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.100+0000 7efdbe411640 1 -- 172.21.15.19:0/248491680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d736f429a0 msgr2=0x55d736f4c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.100+0000 7efdbe411640 1 --2- 172.21.15.19:0/248491680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d736f429a0 0x55d736f4c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.100+0000 7efdbe411640 1 -- 172.21.15.19:0/248491680 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d736bb9210 con 0x55d736f48370 2024-09-19T08:54:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.100+0000 7efdbe411640 1 --2- 172.21.15.19:0/248491680 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d736f48370 0x55d736f53cd0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7efdb0003c10 tx=0x7efdb0004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51d28584612ec054 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.100+0000 7efda17fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:54:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.100+0000 7efda17fa640 1 -- 172.21.15.19:0/248491680 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb0012860 con 0x55d736f48370 2024-09-19T08:54:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.100+0000 7efda17fa640 1 -- 172.21.15.19:0/248491680 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7efdb0012a00 con 0x55d736f48370 2024-09-19T08:54:39.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.100+0000 7efdc2c16740 10 client.0 _ll_register_callbacks cb 0x55d736e60140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:39.103 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.101+0000 7efdc2c16740 1 -- 172.21.15.19:0/248491680 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdb40bbb40 con 0x55d736f48370 2024-09-19T08:54:39.103 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.101+0000 7efda17fa640 1 -- 172.21.15.19:0/248491680 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7efdb0012c00 con 0x55d736f48370 2024-09-19T08:54:39.103 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.101+0000 7efdc2c16740 10 client.15939 fetch_fsmap learned FSMap version 30 2024-09-19T08:54:39.103 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.101+0000 7efdc2c16740 1 -- 172.21.15.19:0/248491680 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55d736c85620 con 0x55d736f48370 2024-09-19T08:54:39.121 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.121+0000 7efda17fa640 1 -- 172.21.15.19:0/248491680 <== mon.0 v2:172.21.15.19:3300/0 4 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7efdb001b470 con 0x55d736f48370 2024-09-19T08:54:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.121+0000 7efdc2c16740 10 client.15939 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T08:54:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.121+0000 7efdc2c16740 10 client.15939 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:54:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.121+0000 7efdc2c16740 20 client.15939 populate_metadata read hostname 'smithi019' 2024-09-19T08:54:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.121+0000 7efdc2c16740 1 --2- 172.21.15.19:0/248491680 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d736f58360 0x55d736f5a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.121+0000 7efdc2c16740 4 client.15939 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:54:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.121+0000 7efdc2c16740 1 -- 172.21.15.19:0/248491680 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d736eb3a20 con 0x55d736f58360 2024-09-19T08:54:39.122 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.122+0000 7efdbdc10640 1 --2- 172.21.15.19:0/248491680 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d736f58360 0x55d736f5a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:39.123 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.122+0000 7efdbdc10640 1 --2- 172.21.15.19:0/248491680 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d736f58360 0x55d736f5a800 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31c1314abe125704 server_cookie=e57db29628bc1ee5 in_seq=0 out_seq=0 2024-09-19T08:54:39.123 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.122+0000 7efda17fa640 10 client.15939 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:54:39.123 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.123+0000 7efda17fa640 1 -- 172.21.15.19:0/248491680 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d736eb3a20 con 0x55d736f58360 2024-09-19T08:54:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.123+0000 7efda17fa640 10 client.15939 handle_command_reply: tid=0 2024-09-19T08:54:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.123+0000 7efdc2c16740 1 client.15939 shutdown 2024-09-19T08:54:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.123+0000 7efdc2c16740 1 -- 172.21.15.19:0/248491680 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d736f48370 msgr2=0x55d736f53cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.123+0000 7efdc2c16740 1 --2- 172.21.15.19:0/248491680 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d736f48370 0x55d736f53cd0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7efdb0003c10 tx=0x7efdb0004410 comp rx=0 tx=0).stop 2024-09-19T08:54:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.123+0000 7efdc2c16740 1 -- 172.21.15.19:0/248491680 shutdown_connections 2024-09-19T08:54:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.123+0000 7efdc2c16740 1 --2- 172.21.15.19:0/248491680 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d736f58360 0x55d736f5a800 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.123+0000 7efdc2c16740 1 --2- 172.21.15.19:0/248491680 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d736f432e0 0x55d736f4cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.123+0000 7efdc2c16740 1 --2- 172.21.15.19:0/248491680 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d736f48370 0x55d736f53cd0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.123+0000 7efdc2c16740 1 --2- 172.21.15.19:0/248491680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d736f429a0 0x55d736f4c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.123+0000 7efda17fa640 0 client.15939 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:54:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.123+0000 7efdc2c16740 1 -- 172.21.15.19:0/248491680 >> 172.21.15.19:0/248491680 conn(0x55d736f3e010 msgr2=0x55d736f3f820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.123+0000 7efdc2c16740 1 -- 172.21.15.19:0/248491680 shutdown_connections 2024-09-19T08:54:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.123+0000 7efdc2c16740 1 -- 172.21.15.19:0/248491680 wait complete. 2024-09-19T08:54:39.125 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.123+0000 7efdc2c16740 20 client.15939 trim_cache size 0 max 16384 2024-09-19T08:54:39.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.137+0000 7efdc2c16740 1 Processor -- start 2024-09-19T08:54:39.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.138+0000 7efdc2c16740 1 -- start start 2024-09-19T08:54:39.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.138+0000 7efdc2c16740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d736f429a0 0x55d736f3ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:39.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.138+0000 7efdc2c16740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d736f432e0 0x55d736f53c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:39.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.138+0000 7efdc2c16740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d736f48370 0x55d736f3f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:39.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.138+0000 7efdc2c16740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7efdb81ab180 con 0x55d736f48370 2024-09-19T08:54:39.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.138+0000 7efdc2c16740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efdb81acd80 con 0x55d736f432e0 2024-09-19T08:54:39.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.138+0000 7efdc2c16740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efdb81ab850 con 0x55d736f429a0 2024-09-19T08:54:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.138+0000 7efdbe411640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d736f48370 0x55d736f3f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.138+0000 7efdbe411640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d736f48370 0x55d736f3f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56138/0 (socket says 172.21.15.19:56138) 2024-09-19T08:54:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.138+0000 7efdbe411640 1 -- 172.21.15.19:0/2948778252 learned_addr learned my addr 172.21.15.19:0/2948778252 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.138+0000 7efdbd40f640 1 --2- 172.21.15.19:0/2948778252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d736f432e0 0x55d736f53c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.138+0000 7efdbdc10640 1 --2- 172.21.15.19:0/2948778252 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d736f429a0 0x55d736f3ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.138+0000 7efdbe411640 1 -- 172.21.15.19:0/2948778252 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d736f429a0 msgr2=0x55d736f3ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.138+0000 7efdbe411640 1 --2- 172.21.15.19:0/2948778252 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d736f429a0 0x55d736f3ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.138+0000 7efdbe411640 1 -- 172.21.15.19:0/2948778252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d736f432e0 msgr2=0x55d736f53c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.138+0000 7efdbe411640 1 --2- 172.21.15.19:0/2948778252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d736f432e0 0x55d736f53c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.141 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.138+0000 7efdbe411640 1 -- 172.21.15.19:0/2948778252 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d736f4c300 con 0x55d736f48370 2024-09-19T08:54:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.138+0000 7efdbe411640 1 --2- 172.21.15.19:0/2948778252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d736f48370 0x55d736f3f290 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009f20 tx=0x7efdb0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d6e90acb5ffcfdb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.139+0000 7efda37fe640 1 -- 172.21.15.19:0/2948778252 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb0012da0 con 0x55d736f48370 2024-09-19T08:54:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.139+0000 7efda37fe640 1 -- 172.21.15.19:0/2948778252 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdb40bbb40 con 0x55d736f48370 2024-09-19T08:54:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.139+0000 7efda37fe640 1 -- 172.21.15.19:0/2948778252 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdb0025420 con 0x55d736f48370 2024-09-19T08:54:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.139+0000 7efdc2c16740 1 -- 172.21.15.19:0/2948778252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d736f48370 msgr2=0x55d736f3f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.139+0000 7efdc2c16740 1 --2- 172.21.15.19:0/2948778252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d736f48370 0x55d736f3f290 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7efdb0009f20 tx=0x7efdb0014000 comp rx=0 tx=0).stop 2024-09-19T08:54:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.139+0000 7efdc2c16740 1 -- 172.21.15.19:0/2948778252 shutdown_connections 2024-09-19T08:54:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.139+0000 7efdc2c16740 1 --2- 172.21.15.19:0/2948778252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d736f48370 0x55d736f3f290 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.142 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.139+0000 7efdc2c16740 1 --2- 172.21.15.19:0/2948778252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d736f432e0 0x55d736f53c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.139+0000 7efdc2c16740 1 --2- 172.21.15.19:0/2948778252 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d736f429a0 0x55d736f3ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.139+0000 7efdc2c16740 1 -- 172.21.15.19:0/2948778252 >> 172.21.15.19:0/2948778252 conn(0x55d736f3e010 msgr2=0x55d736f4c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.139+0000 7efdc2c16740 1 -- 172.21.15.19:0/2948778252 shutdown_connections 2024-09-19T08:54:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.139+0000 7efdc2c16740 1 -- 172.21.15.19:0/2948778252 wait complete. 2024-09-19T08:54:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.140+0000 7efdc2c16740 1 -- start start 2024-09-19T08:54:39.143 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.140+0000 7efdc2c16740 1 Processor -- start 2024-09-19T08:54:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.140+0000 7efdc2c16740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d736f429a0 0x55d736f51380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.140+0000 7efdc2c16740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d736f432e0 0x55d736f518c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.140+0000 7efdc2c16740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d736f48370 0x55d736f52860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.140+0000 7efdc2c16740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7efdb81ac5f0 con 0x55d736f432e0 2024-09-19T08:54:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.140+0000 7efdc2c16740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efdb81abf20 con 0x55d736f48370 2024-09-19T08:54:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.140+0000 7efdc2c16740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efdb81a9160 con 0x55d736f429a0 2024-09-19T08:54:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.140+0000 7efdc2c16740 10 client.0 _ll_register_callbacks cb 0x7efdb0009a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.140+0000 7efdbd40f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d736f432e0 0x55d736f518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.140+0000 7efdbd40f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d736f432e0 0x55d736f518c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56142/0 (socket says 172.21.15.19:56142) 2024-09-19T08:54:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.140+0000 7efdbd40f640 1 -- 172.21.15.19:0/1873697404 learned_addr learned my addr 172.21.15.19:0/1873697404 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.141+0000 7efdbe411640 1 --2- 172.21.15.19:0/1873697404 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d736f48370 0x55d736f52860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.141+0000 7efdbdc10640 1 --2- 172.21.15.19:0/1873697404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d736f429a0 0x55d736f51380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.141+0000 7efdbd40f640 1 -- 172.21.15.19:0/1873697404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d736f429a0 msgr2=0x55d736f51380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.141+0000 7efdbd40f640 1 --2- 172.21.15.19:0/1873697404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d736f429a0 0x55d736f51380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.141+0000 7efdbd40f640 1 -- 172.21.15.19:0/1873697404 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d736f48370 msgr2=0x55d736f52860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.141+0000 7efdbd40f640 1 --2- 172.21.15.19:0/1873697404 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d736f48370 0x55d736f52860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.141+0000 7efdbd40f640 1 -- 172.21.15.19:0/1873697404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d736f52e70 con 0x55d736f432e0 2024-09-19T08:54:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.141+0000 7efdbe411640 1 --2- 172.21.15.19:0/1873697404 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d736f48370 0x55d736f52860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:54:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.141+0000 7efdbd40f640 1 --2- 172.21.15.19:0/1873697404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d736f432e0 0x55d736f518c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x55d736f43d10 tx=0x7efda8014070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efd64d207d6db50b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.141+0000 7efda17fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:54:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.141+0000 7efda17fa640 1 -- 172.21.15.19:0/1873697404 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efda802f060 con 0x55d736f432e0 2024-09-19T08:54:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.141+0000 7efda17fa640 1 -- 172.21.15.19:0/1873697404 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7efda8020d90 con 0x55d736f432e0 2024-09-19T08:54:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.141+0000 7efdc2c16740 1 -- 172.21.15.19:0/1873697404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdb40bbb40 con 0x55d736f432e0 2024-09-19T08:54:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.141+0000 7efda17fa640 1 -- 172.21.15.19:0/1873697404 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7efda8004030 con 0x55d736f432e0 2024-09-19T08:54:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.141+0000 7efdc2c16740 10 client.15945 fetch_fsmap learned FSMap version 30 2024-09-19T08:54:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.141+0000 7efdc2c16740 1 -- 172.21.15.19:0/1873697404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d736fc3170 con 0x55d736f432e0 2024-09-19T08:54:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.141+0000 7efda17fa640 1 -- 172.21.15.19:0/1873697404 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdb40bbb40 con 0x55d736f432e0 2024-09-19T08:54:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.142+0000 7efda17fa640 1 -- 172.21.15.19:0/1873697404 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7efda802a480 con 0x55d736f432e0 2024-09-19T08:54:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.142+0000 7efdc2c16740 10 client.15945 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T08:54:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.142+0000 7efdc2c16740 10 client.15945 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:54:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.142+0000 7efdc2c16740 20 client.15945 populate_metadata read hostname 'smithi019' 2024-09-19T08:54:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.142+0000 7efdc2c16740 1 --2- 172.21.15.19:0/1873697404 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d736fc3bf0 0x55d736fc6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.142+0000 7efdc2c16740 4 client.15945 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:54:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.142+0000 7efdc2c16740 1 -- 172.21.15.19:0/1873697404 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d736eadd70 con 0x55d736fc3bf0 2024-09-19T08:54:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.142+0000 7efdbdc10640 1 --2- 172.21.15.19:0/1873697404 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d736fc3bf0 0x55d736fc6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.143+0000 7efdbdc10640 1 --2- 172.21.15.19:0/1873697404 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d736fc3bf0 0x55d736fc6010 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cce23c6cfe69251 server_cookie=e61cf559d5ef768b in_seq=0 out_seq=0 2024-09-19T08:54:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.143+0000 7efda17fa640 10 client.15945 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:54:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.150+0000 7efda17fa640 1 -- 172.21.15.19:0/1873697404 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d736eadd70 con 0x55d736fc3bf0 2024-09-19T08:54:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.150+0000 7efda17fa640 10 client.15945 handle_command_reply: tid=0 2024-09-19T08:54:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.150+0000 7efdc2c16740 1 client.15945 shutdown 2024-09-19T08:54:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.150+0000 7efdc2c16740 1 -- 172.21.15.19:0/1873697404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d736f432e0 msgr2=0x55d736f518c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.150+0000 7efdc2c16740 1 --2- 172.21.15.19:0/1873697404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d736f432e0 0x55d736f518c0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x55d736f43d10 tx=0x7efda8014070 comp rx=0 tx=0).stop 2024-09-19T08:54:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.150+0000 7efdc2c16740 1 -- 172.21.15.19:0/1873697404 shutdown_connections 2024-09-19T08:54:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.150+0000 7efdc2c16740 1 --2- 172.21.15.19:0/1873697404 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d736fc3bf0 0x55d736fc6010 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.150+0000 7efdc2c16740 1 --2- 172.21.15.19:0/1873697404 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d736f48370 0x55d736f52860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.150+0000 7efdc2c16740 1 --2- 172.21.15.19:0/1873697404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d736f432e0 0x55d736f518c0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.151 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.150+0000 7efdc2c16740 1 --2- 172.21.15.19:0/1873697404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d736f429a0 0x55d736f51380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.150+0000 7efda17fa640 0 client.15945 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:54:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.150+0000 7efdc2c16740 1 -- 172.21.15.19:0/1873697404 >> 172.21.15.19:0/1873697404 conn(0x55d736f3e010 msgr2=0x55d736f3c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.151+0000 7efdc2c16740 1 -- 172.21.15.19:0/1873697404 shutdown_connections 2024-09-19T08:54:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.151+0000 7efdc2c16740 1 -- 172.21.15.19:0/1873697404 wait complete. 2024-09-19T08:54:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.151+0000 7efdc2c16740 20 client.15945 trim_cache size 0 max 16384 2024-09-19T08:54:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T08:54:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T08:54:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T08:54:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T08:54:39.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.151+0000 7efdbfe74640 1 -- 172.21.15.19:0/1270741295 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7efda40a3460 msgr2=0x7efda40a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:39.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.151+0000 7efdbfe74640 1 --2- 172.21.15.19:0/1270741295 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7efda40a3460 0x7efda40a5920 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7efdb8075d10 tx=0x7efda8005f90 comp rx=0 tx=0).stop 2024-09-19T08:54:39.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.151+0000 7efdbfe74640 1 -- 172.21.15.19:0/1270741295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdb8101b60 msgr2=0x7efdb8075fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:39.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.151+0000 7efdbfe74640 1 --2- 172.21.15.19:0/1270741295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdb8101b60 0x7efdb8075fa0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7efdb4031610 tx=0x7efdb4032ce0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.151+0000 7efdbfe74640 1 -- 172.21.15.19:0/1270741295 shutdown_connections 2024-09-19T08:54:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.151+0000 7efdbfe74640 1 --2- 172.21.15.19:0/1270741295 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7efda40a3460 0x7efda40a5920 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.151+0000 7efdbfe74640 1 --2- 172.21.15.19:0/1270741295 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efdb8102d50 0x7efdb80745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.151+0000 7efdbfe74640 1 --2- 172.21.15.19:0/1270741295 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efdb8103710 0x7efdb8074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.151+0000 7efdbfe74640 1 --2- 172.21.15.19:0/1270741295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efdb8101b60 0x7efdb8075fa0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.151+0000 7efdbfe74640 1 -- 172.21.15.19:0/1270741295 >> 172.21.15.19:0/1270741295 conn(0x7efdb80fd2c0 msgr2=0x7efdb8106120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.151+0000 7efdbfe74640 1 -- 172.21.15.19:0/1270741295 shutdown_connections 2024-09-19T08:54:39.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:39.151+0000 7efdbfe74640 1 -- 172.21.15.19:0/1270741295 wait complete. 2024-09-19T08:54:39.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:39 smithi019 ceph-mon[30976]: pgmap v410: 97 pgs: 97 active+clean; 988 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 6.2 KiB/s wr, 11 op/s 2024-09-19T08:54:39.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:39 smithi155 ceph-mon[34921]: pgmap v410: 97 pgs: 97 active+clean; 988 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 6.2 KiB/s wr, 11 op/s 2024-09-19T08:54:39.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:39 smithi203 ceph-mon[35450]: pgmap v410: 97 pgs: 97 active+clean; 988 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 6.2 KiB/s wr, 11 op/s 2024-09-19T08:54:39.975 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:39.975 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:40.237 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:40.237 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:40.267 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:40.267 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:40.267 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 33 -lt 100 ']' 2024-09-19T08:54:40.267 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 33 + 1 2024-09-19T08:54:40.340 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=34 2024-09-19T08:54:40.340 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:40.401 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:40.401 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:40.402 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:40.402 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:40.402 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:40.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.542+0000 7fba1b50a640 1 -- 172.21.15.19:0/3144731704 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba14102ef0 msgr2=0x7fba1410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:40.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.542+0000 7fba1b50a640 1 --2- 172.21.15.19:0/3144731704 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba14102ef0 0x7fba1410da40 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fba0c009ca0 tx=0x7fba0c02a950 comp rx=0 tx=0).stop 2024-09-19T08:54:40.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.542+0000 7fba1b50a640 1 -- 172.21.15.19:0/3144731704 shutdown_connections 2024-09-19T08:54:40.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.542+0000 7fba1b50a640 1 --2- 172.21.15.19:0/3144731704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba14102570 0x7fba141029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.542+0000 7fba1b50a640 1 --2- 172.21.15.19:0/3144731704 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba14102ef0 0x7fba1410da40 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.542+0000 7fba1b50a640 1 --2- 172.21.15.19:0/3144731704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba14100e20 0x7fba14101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.542+0000 7fba1b50a640 1 -- 172.21.15.19:0/3144731704 >> 172.21.15.19:0/3144731704 conn(0x7fba140fc7d0 msgr2=0x7fba140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:40.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.542+0000 7fba1b50a640 1 -- 172.21.15.19:0/3144731704 shutdown_connections 2024-09-19T08:54:40.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.542+0000 7fba1b50a640 1 -- 172.21.15.19:0/3144731704 wait complete. 2024-09-19T08:54:40.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.543+0000 7fba1b50a640 1 Processor -- start 2024-09-19T08:54:40.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.543+0000 7fba1b50a640 1 -- start start 2024-09-19T08:54:40.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.543+0000 7fba1b50a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba14100e20 0x7fba1419a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:40.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.543+0000 7fba1b50a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba14102570 0x7fba1419ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:40.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.543+0000 7fba1b50a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba14102ef0 0x7fba1419ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:40.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.543+0000 7fba1b50a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fba14110f80 con 0x7fba14102ef0 2024-09-19T08:54:40.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.543+0000 7fba1b50a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fba14110e00 con 0x7fba14100e20 2024-09-19T08:54:40.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.543+0000 7fba1b50a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fba14111100 con 0x7fba14102570 2024-09-19T08:54:40.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.543+0000 7fba19aa7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba14102ef0 0x7fba1419ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:40.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.543+0000 7fba19aa7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba14102ef0 0x7fba1419ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56170/0 (socket says 172.21.15.19:56170) 2024-09-19T08:54:40.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.543+0000 7fba192a6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba14100e20 0x7fba1419a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:40.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.543+0000 7fba19aa7640 1 -- 172.21.15.19:0/228057010 learned_addr learned my addr 172.21.15.19:0/228057010 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:40.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.543+0000 7fba18aa5640 1 --2- 172.21.15.19:0/228057010 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba14102570 0x7fba1419ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:40.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.544+0000 7fba19aa7640 1 -- 172.21.15.19:0/228057010 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba14102570 msgr2=0x7fba1419ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:40.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.544+0000 7fba19aa7640 1 --2- 172.21.15.19:0/228057010 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba14102570 0x7fba1419ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.544+0000 7fba19aa7640 1 -- 172.21.15.19:0/228057010 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba14100e20 msgr2=0x7fba1419a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:40.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.544+0000 7fba19aa7640 1 --2- 172.21.15.19:0/228057010 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba14100e20 0x7fba1419a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.544+0000 7fba19aa7640 1 -- 172.21.15.19:0/228057010 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba1419f600 con 0x7fba14102ef0 2024-09-19T08:54:40.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.544+0000 7fba18aa5640 1 --2- 172.21.15.19:0/228057010 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba14102570 0x7fba1419ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:40.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.544+0000 7fba19aa7640 1 --2- 172.21.15.19:0/228057010 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba14102ef0 0x7fba1419ef20 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fba0c02ae70 tx=0x7fba0c02f5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:40.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.544+0000 7fba0a7fc640 1 -- 172.21.15.19:0/228057010 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0c034040 con 0x7fba14102ef0 2024-09-19T08:54:40.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.544+0000 7fba1b50a640 1 -- 172.21.15.19:0/228057010 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba1419f890 con 0x7fba14102ef0 2024-09-19T08:54:40.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.544+0000 7fba0a7fc640 1 -- 172.21.15.19:0/228057010 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba0c030920 con 0x7fba14102ef0 2024-09-19T08:54:40.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.544+0000 7fba1b50a640 1 -- 172.21.15.19:0/228057010 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba141a71d0 con 0x7fba14102ef0 2024-09-19T08:54:40.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.544+0000 7fba0a7fc640 1 -- 172.21.15.19:0/228057010 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0c045480 con 0x7fba14102ef0 2024-09-19T08:54:40.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.547+0000 7fba0a7fc640 1 -- 172.21.15.19:0/228057010 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fba0c037020 con 0x7fba14102ef0 2024-09-19T08:54:40.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.547+0000 7fba0a7fc640 1 --2- 172.21.15.19:0/228057010 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fba000a3240 0x7fba000a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:40.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.548+0000 7fba192a6640 1 --2- 172.21.15.19:0/228057010 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fba000a3240 0x7fba000a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:40.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.548+0000 7fba0a7fc640 1 -- 172.21.15.19:0/228057010 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fba0c0f0810 con 0x7fba14102ef0 2024-09-19T08:54:40.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.548+0000 7fba192a6640 1 --2- 172.21.15.19:0/228057010 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fba000a3240 0x7fba000a5700 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fba1000bbe0 tx=0x7fba1000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:40.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.737+0000 7fba1d8e3740 1 Processor -- start 2024-09-19T08:54:40.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.737+0000 7fba1d8e3740 1 -- start start 2024-09-19T08:54:40.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.737+0000 7fba1d8e3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d27548850 0x557d27548c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:40.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.737+0000 7fba1d8e3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557d27549170 0x557d275534f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:40.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.737+0000 7fba1d8e3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d27553a30 0x557d27555e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:40.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.737+0000 7fba1d8e3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557d274ad160 con 0x557d27548850 2024-09-19T08:54:40.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.737+0000 7fba1d8e3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x557d27454720 con 0x557d27549170 2024-09-19T08:54:40.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.737+0000 7fba1d8e3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557d274a9120 con 0x557d27553a30 2024-09-19T08:54:40.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.737+0000 7fba192a6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d27548850 0x557d27548c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:40.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.737+0000 7fba192a6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d27548850 0x557d27548c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56186/0 (socket says 172.21.15.19:56186) 2024-09-19T08:54:40.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.737+0000 7fba192a6640 1 -- 172.21.15.19:0/2139979175 learned_addr learned my addr 172.21.15.19:0/2139979175 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:40.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.737+0000 7fba19aa7640 1 --2- 172.21.15.19:0/2139979175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d27553a30 0x557d27555e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:40.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.737+0000 7fba18aa5640 1 --2- 172.21.15.19:0/2139979175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557d27549170 0x557d275534f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:40.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.738+0000 7fba192a6640 1 -- 172.21.15.19:0/2139979175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d27553a30 msgr2=0x557d27555e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:40.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.738+0000 7fba192a6640 1 --2- 172.21.15.19:0/2139979175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d27553a30 0x557d27555e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.738+0000 7fba192a6640 1 -- 172.21.15.19:0/2139979175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557d27549170 msgr2=0x557d275534f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:40.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.738+0000 7fba192a6640 1 --2- 172.21.15.19:0/2139979175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557d27549170 0x557d275534f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.738+0000 7fba192a6640 1 -- 172.21.15.19:0/2139979175 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d2721eba0 con 0x557d27548850 2024-09-19T08:54:40.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.738+0000 7fba18aa5640 1 --2- 172.21.15.19:0/2139979175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557d27549170 0x557d275534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:54:40.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.738+0000 7fba192a6640 1 --2- 172.21.15.19:0/2139979175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d27548850 0x557d27548c30 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fba10005d00 tx=0x7fba10013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=590d0057e4f08361 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:40.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.738+0000 7fb9ff7fe640 1 -- 172.21.15.19:0/2139979175 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba10005220 con 0x557d27548850 2024-09-19T08:54:40.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.738+0000 7fb9ff7fe640 1 -- 172.21.15.19:0/2139979175 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba10004c80 con 0x557d27548850 2024-09-19T08:54:40.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.738+0000 7fb9ff7fe640 1 -- 172.21.15.19:0/2139979175 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1001ea00 con 0x557d27548850 2024-09-19T08:54:40.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.739+0000 7fba1d8e3740 1 -- 172.21.15.19:0/2139979175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d27548850 msgr2=0x557d27548c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:40.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.739+0000 7fba1d8e3740 1 --2- 172.21.15.19:0/2139979175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d27548850 0x557d27548c30 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fba10005d00 tx=0x7fba10013000 comp rx=0 tx=0).stop 2024-09-19T08:54:40.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.739+0000 7fba1d8e3740 1 -- 172.21.15.19:0/2139979175 shutdown_connections 2024-09-19T08:54:40.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.739+0000 7fba1d8e3740 1 --2- 172.21.15.19:0/2139979175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d27553a30 0x557d27555e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.739+0000 7fba1d8e3740 1 --2- 172.21.15.19:0/2139979175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557d27549170 0x557d275534f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.739+0000 7fba1d8e3740 1 --2- 172.21.15.19:0/2139979175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d27548850 0x557d27548c30 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.739+0000 7fba1d8e3740 1 -- 172.21.15.19:0/2139979175 >> 172.21.15.19:0/2139979175 conn(0x557d27544de0 msgr2=0x557d275451c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:40.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.739+0000 7fba1d8e3740 1 -- 172.21.15.19:0/2139979175 shutdown_connections 2024-09-19T08:54:40.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.739+0000 7fba1d8e3740 1 -- 172.21.15.19:0/2139979175 wait complete. 2024-09-19T08:54:40.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.739+0000 7fba1d8e3740 1 -- start start 2024-09-19T08:54:40.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.739+0000 7fba1d8e3740 1 Processor -- start 2024-09-19T08:54:40.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.740+0000 7fba1d8e3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557d27548850 0x557d27550940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:40.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.740+0000 7fba1d8e3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d27549170 0x557d27550e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:40.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.740+0000 7fba1d8e3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d27553a30 0x557d275513c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:40.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.740+0000 7fba1d8e3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557d27556600 con 0x557d27549170 2024-09-19T08:54:40.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.740+0000 7fba1d8e3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x557d27435900 con 0x557d27548850 2024-09-19T08:54:40.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.740+0000 7fba1d8e3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557d27556780 con 0x557d27553a30 2024-09-19T08:54:40.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.740+0000 7fba1d8e3740 10 client.0 _ll_register_callbacks cb 0x557d27433780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:40.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.740+0000 7fba18aa5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d27549170 0x557d27550e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:40.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.740+0000 7fba18aa5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d27549170 0x557d27550e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56200/0 (socket says 172.21.15.19:56200) 2024-09-19T08:54:40.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.740+0000 7fba18aa5640 1 -- 172.21.15.19:0/1085178791 learned_addr learned my addr 172.21.15.19:0/1085178791 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:40.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.740+0000 7fba192a6640 1 --2- 172.21.15.19:0/1085178791 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557d27548850 0x557d27550940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:40.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.740+0000 7fba19aa7640 1 --2- 172.21.15.19:0/1085178791 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d27553a30 0x557d275513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:40.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.740+0000 7fba18aa5640 1 -- 172.21.15.19:0/1085178791 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d27553a30 msgr2=0x557d275513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:40.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.740+0000 7fba18aa5640 1 --2- 172.21.15.19:0/1085178791 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d27553a30 0x557d275513c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.740+0000 7fba18aa5640 1 -- 172.21.15.19:0/1085178791 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557d27548850 msgr2=0x557d27550940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:40.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.741+0000 7fba18aa5640 1 --2- 172.21.15.19:0/1085178791 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557d27548850 0x557d27550940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.741+0000 7fba18aa5640 1 -- 172.21.15.19:0/1085178791 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d27475c50 con 0x557d27549170 2024-09-19T08:54:40.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.741+0000 7fba19aa7640 1 --2- 172.21.15.19:0/1085178791 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d27553a30 0x557d275513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:40.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.741+0000 7fba192a6640 1 --2- 172.21.15.19:0/1085178791 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557d27548850 0x557d27550940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:54:40.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.741+0000 7fba18aa5640 1 --2- 172.21.15.19:0/1085178791 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d27549170 0x557d27550e80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fba04010670 tx=0x7fba04010b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d80cbb03f7648942 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:40.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.741+0000 7fb9fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:54:40.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.741+0000 7fb9fcff9640 1 -- 172.21.15.19:0/1085178791 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0400ead0 con 0x557d27549170 2024-09-19T08:54:40.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.741+0000 7fb9fcff9640 1 -- 172.21.15.19:0/1085178791 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fba0400ec70 con 0x557d27549170 2024-09-19T08:54:40.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.741+0000 7fba1d8e3740 1 -- 172.21.15.19:0/1085178791 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba10004c80 con 0x557d27549170 2024-09-19T08:54:40.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.741+0000 7fb9fcff9640 1 -- 172.21.15.19:0/1085178791 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fba0400ee70 con 0x557d27549170 2024-09-19T08:54:40.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.741+0000 7fba1d8e3740 10 client.15957 fetch_fsmap learned FSMap version 30 2024-09-19T08:54:40.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.741+0000 7fba1d8e3740 1 -- 172.21.15.19:0/1085178791 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557d275622b0 con 0x557d27549170 2024-09-19T08:54:40.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.741+0000 7fb9fcff9640 1 -- 172.21.15.19:0/1085178791 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba10004c80 con 0x557d27549170 2024-09-19T08:54:40.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.742+0000 7fb9fcff9640 1 -- 172.21.15.19:0/1085178791 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fba0400f040 con 0x557d27549170 2024-09-19T08:54:40.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.742+0000 7fba1d8e3740 10 client.15957 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T08:54:40.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.742+0000 7fba1d8e3740 10 client.15957 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T08:54:40.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.742+0000 7fba1d8e3740 20 client.15957 populate_metadata read hostname 'smithi019' 2024-09-19T08:54:40.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.742+0000 7fba1d8e3740 1 --2- 172.21.15.19:0/1085178791 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557d275637c0 0x557d27565c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:40.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.742+0000 7fba1d8e3740 4 client.15957 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:54:40.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.742+0000 7fba1d8e3740 1 -- 172.21.15.19:0/1085178791 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d274ba890 con 0x557d275637c0 2024-09-19T08:54:40.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.742+0000 7fba192a6640 1 --2- 172.21.15.19:0/1085178791 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557d275637c0 0x557d27565c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:40.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.743+0000 7fba192a6640 1 --2- 172.21.15.19:0/1085178791 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557d275637c0 0x557d27565c60 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd3716832274fe5 server_cookie=b830bdadaf29a86c in_seq=0 out_seq=0 2024-09-19T08:54:40.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.743+0000 7fb9fcff9640 10 client.15957 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:54:40.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.743+0000 7fb9fcff9640 1 -- 172.21.15.19:0/1085178791 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557d274ba890 con 0x557d275637c0 2024-09-19T08:54:40.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.743+0000 7fb9fcff9640 10 client.15957 handle_command_reply: tid=0 2024-09-19T08:54:40.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.743+0000 7fba1d8e3740 1 client.15957 shutdown 2024-09-19T08:54:40.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.743+0000 7fba1d8e3740 1 -- 172.21.15.19:0/1085178791 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d27549170 msgr2=0x557d27550e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:40.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.743+0000 7fba1d8e3740 1 --2- 172.21.15.19:0/1085178791 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d27549170 0x557d27550e80 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fba04010670 tx=0x7fba04010b30 comp rx=0 tx=0).stop 2024-09-19T08:54:40.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.744+0000 7fba1d8e3740 1 -- 172.21.15.19:0/1085178791 shutdown_connections 2024-09-19T08:54:40.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.744+0000 7fba1d8e3740 1 --2- 172.21.15.19:0/1085178791 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557d275637c0 0x557d27565c60 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.744+0000 7fba1d8e3740 1 --2- 172.21.15.19:0/1085178791 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d27553a30 0x557d275513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.744+0000 7fba1d8e3740 1 --2- 172.21.15.19:0/1085178791 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d27549170 0x557d27550e80 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.744+0000 7fb9fcff9640 0 client.15957 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:54:40.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.744+0000 7fba1d8e3740 1 --2- 172.21.15.19:0/1085178791 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557d27548850 0x557d27550940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.744+0000 7fba1d8e3740 1 -- 172.21.15.19:0/1085178791 >> 172.21.15.19:0/1085178791 conn(0x557d27544de0 msgr2=0x557d2754ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:40.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.744+0000 7fba1d8e3740 1 -- 172.21.15.19:0/1085178791 shutdown_connections 2024-09-19T08:54:40.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.744+0000 7fba1d8e3740 1 -- 172.21.15.19:0/1085178791 wait complete. 2024-09-19T08:54:40.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.744+0000 7fba1d8e3740 20 client.15957 trim_cache size 0 max 16384 2024-09-19T08:54:40.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.762+0000 7fba1d8e3740 1 Processor -- start 2024-09-19T08:54:40.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.762+0000 7fba1d8e3740 1 -- start start 2024-09-19T08:54:40.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.763+0000 7fba1d8e3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d27548850 0x557d2754f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:40.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.763+0000 7fba1d8e3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d27549170 0x557d2754b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:40.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.763+0000 7fba1d8e3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557d27553a30 0x557d2756b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:40.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.763+0000 7fba1d8e3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fba141af640 con 0x557d27549170 2024-09-19T08:54:40.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.763+0000 7fba1d8e3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fba141b1240 con 0x557d27553a30 2024-09-19T08:54:40.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.763+0000 7fba1d8e3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fba141afd10 con 0x557d27548850 2024-09-19T08:54:40.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.763+0000 7fba18aa5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d27549170 0x557d2754b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:40.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.763+0000 7fba18aa5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d27549170 0x557d2754b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56202/0 (socket says 172.21.15.19:56202) 2024-09-19T08:54:40.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.763+0000 7fba18aa5640 1 -- 172.21.15.19:0/3176428312 learned_addr learned my addr 172.21.15.19:0/3176428312 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:40.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.763+0000 7fba192a6640 1 --2- 172.21.15.19:0/3176428312 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d27548850 0x557d2754f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:40.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.763+0000 7fba19aa7640 1 --2- 172.21.15.19:0/3176428312 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557d27553a30 0x557d2756b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:40.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.763+0000 7fba18aa5640 1 -- 172.21.15.19:0/3176428312 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d27548850 msgr2=0x557d2754f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:40.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.763+0000 7fba18aa5640 1 --2- 172.21.15.19:0/3176428312 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d27548850 0x557d2754f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.763+0000 7fba18aa5640 1 -- 172.21.15.19:0/3176428312 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557d27553a30 msgr2=0x557d2756b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:40.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.763+0000 7fba18aa5640 1 --2- 172.21.15.19:0/3176428312 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557d27553a30 0x557d2756b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.763+0000 7fba18aa5640 1 -- 172.21.15.19:0/3176428312 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d275403f0 con 0x557d27549170 2024-09-19T08:54:40.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.763+0000 7fba19aa7640 1 --2- 172.21.15.19:0/3176428312 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557d27553a30 0x557d2756b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:40.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.763+0000 7fba18aa5640 1 --2- 172.21.15.19:0/3176428312 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d27549170 0x557d2754b2b0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fba04000c00 tx=0x7fba0401a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36ed093bac3f1afc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:40.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.764+0000 7fb9feffd640 1 -- 172.21.15.19:0/3176428312 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba04029040 con 0x557d27549170 2024-09-19T08:54:40.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.764+0000 7fb9feffd640 1 -- 172.21.15.19:0/3176428312 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba04010030 con 0x557d27549170 2024-09-19T08:54:40.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.764+0000 7fb9feffd640 1 -- 172.21.15.19:0/3176428312 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba0401ab30 con 0x557d27549170 2024-09-19T08:54:40.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.764+0000 7fba1d8e3740 1 -- 172.21.15.19:0/3176428312 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d27549170 msgr2=0x557d2754b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:40.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.764+0000 7fba1d8e3740 1 --2- 172.21.15.19:0/3176428312 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d27549170 0x557d2754b2b0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fba04000c00 tx=0x7fba0401a420 comp rx=0 tx=0).stop 2024-09-19T08:54:40.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.764+0000 7fba1d8e3740 1 -- 172.21.15.19:0/3176428312 shutdown_connections 2024-09-19T08:54:40.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.764+0000 7fba1d8e3740 1 --2- 172.21.15.19:0/3176428312 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557d27553a30 0x557d2756b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.764+0000 7fba1d8e3740 1 --2- 172.21.15.19:0/3176428312 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d27549170 0x557d2754b2b0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.764+0000 7fba1d8e3740 1 --2- 172.21.15.19:0/3176428312 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d27548850 0x557d2754f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.764+0000 7fba1d8e3740 1 -- 172.21.15.19:0/3176428312 >> 172.21.15.19:0/3176428312 conn(0x557d27544de0 msgr2=0x557d275529c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:40.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.765+0000 7fba1d8e3740 1 -- 172.21.15.19:0/3176428312 shutdown_connections 2024-09-19T08:54:40.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.765+0000 7fba1d8e3740 1 -- 172.21.15.19:0/3176428312 wait complete. 2024-09-19T08:54:40.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.765+0000 7fba1d8e3740 1 -- start start 2024-09-19T08:54:40.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.765+0000 7fba1d8e3740 1 Processor -- start 2024-09-19T08:54:40.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.765+0000 7fba1d8e3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d27548850 0x557d2755bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:40.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.765+0000 7fba1d8e3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d27549170 0x557d275572d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:40.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.765+0000 7fba1d8e3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557d27553a30 0x557d27557810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:40.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.766+0000 7fba1d8e3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fba141b0ab0 con 0x557d27548850 2024-09-19T08:54:40.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.766+0000 7fba1d8e3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fba141b03e0 con 0x557d27553a30 2024-09-19T08:54:40.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.766+0000 7fba1d8e3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fba141ad620 con 0x557d27549170 2024-09-19T08:54:40.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.766+0000 7fba192a6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d27548850 0x557d2755bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:40.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.766+0000 7fba1d8e3740 10 client.0 _ll_register_callbacks cb 0x7fba0400b480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:40.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.766+0000 7fba192a6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d27548850 0x557d2755bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56208/0 (socket says 172.21.15.19:56208) 2024-09-19T08:54:40.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.766+0000 7fba192a6640 1 -- 172.21.15.19:0/1683854169 learned_addr learned my addr 172.21.15.19:0/1683854169 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:40.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.766+0000 7fba18aa5640 1 --2- 172.21.15.19:0/1683854169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d27549170 0x557d275572d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:40.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.766+0000 7fba19aa7640 1 --2- 172.21.15.19:0/1683854169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557d27553a30 0x557d27557810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:40.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.766+0000 7fba192a6640 1 -- 172.21.15.19:0/1683854169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d27549170 msgr2=0x557d275572d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:40.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.766+0000 7fba192a6640 1 --2- 172.21.15.19:0/1683854169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d27549170 0x557d275572d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.766+0000 7fba192a6640 1 -- 172.21.15.19:0/1683854169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557d27553a30 msgr2=0x557d27557810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:40.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.766+0000 7fba192a6640 1 --2- 172.21.15.19:0/1683854169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557d27553a30 0x557d27557810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:40.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.766+0000 7fba192a6640 1 -- 172.21.15.19:0/1683854169 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d27545e90 con 0x557d27548850 2024-09-19T08:54:40.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.766+0000 7fba192a6640 1 --2- 172.21.15.19:0/1683854169 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d27548850 0x557d2755bfa0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fba10010e70 tx=0x7fba1000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=310f05b05e41ac24 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:40.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.766+0000 7fb9fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:54:40.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.766+0000 7fb9fcff9640 1 -- 172.21.15.19:0/1683854169 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba10005410 con 0x557d27548850 2024-09-19T08:54:40.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.766+0000 7fb9fcff9640 1 -- 172.21.15.19:0/1683854169 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fba1002f040 con 0x557d27548850 2024-09-19T08:54:40.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.766+0000 7fba1d8e3740 1 -- 172.21.15.19:0/1683854169 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba04010030 con 0x557d27548850 2024-09-19T08:54:40.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.767+0000 7fb9fcff9640 1 -- 172.21.15.19:0/1683854169 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fba100055b0 con 0x557d27548850 2024-09-19T08:54:40.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.767+0000 7fba1d8e3740 10 client.15963 fetch_fsmap learned FSMap version 30 2024-09-19T08:54:40.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.767+0000 7fba1d8e3740 1 -- 172.21.15.19:0/1683854169 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557d275ce0f0 con 0x557d27548850 2024-09-19T08:54:40.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.767+0000 7fb9fcff9640 1 -- 172.21.15.19:0/1683854169 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fba04010030 con 0x557d27548850 2024-09-19T08:54:40.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.767+0000 7fb9fcff9640 1 -- 172.21.15.19:0/1683854169 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fba100049c0 con 0x557d27548850 2024-09-19T08:54:40.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.767+0000 7fba1d8e3740 10 client.15963 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T08:54:40.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.767+0000 7fba1d8e3740 10 client.15963 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T08:54:40.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.767+0000 7fba1d8e3740 20 client.15963 populate_metadata read hostname 'smithi019' 2024-09-19T08:54:40.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.767+0000 7fba1d8e3740 1 --2- 172.21.15.19:0/1683854169 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557d275ce7a0 0x557d275d0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:40.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.767+0000 7fba1d8e3740 4 client.15963 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}] 2024-09-19T08:54:40.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.767+0000 7fba1d8e3740 1 -- 172.21.15.19:0/1683854169 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.35, "await_for": 45.0}) -- 0x557d274b4be0 con 0x557d275ce7a0 2024-09-19T08:54:40.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.767+0000 7fba18aa5640 1 --2- 172.21.15.19:0/1683854169 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557d275ce7a0 0x557d275d0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:40.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.768+0000 7fba18aa5640 1 --2- 172.21.15.19:0/1683854169 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557d275ce7a0 0x557d275d0be0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6be98e5bb55dafe2 server_cookie=198e01e40e0493c5 in_seq=0 out_seq=0 2024-09-19T08:54:40.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:40.768+0000 7fb9fcff9640 10 client.15963 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:54:41.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:41 smithi019 ceph-mon[30976]: pgmap v411: 97 pgs: 97 active+clean; 994 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.0 KiB/s wr, 12 op/s 2024-09-19T08:54:41.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:41.387+0000 7fb9fcff9640 1 -- 172.21.15.19:0/1683854169 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x557d274b4be0 con 0x557d275ce7a0 2024-09-19T08:54:41.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:41.387+0000 7fb9fcff9640 10 client.15963 handle_command_reply: tid=0 2024-09-19T08:54:41.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:41.387+0000 7fba1d8e3740 1 client.15963 shutdown 2024-09-19T08:54:41.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:41.387+0000 7fba1d8e3740 1 -- 172.21.15.19:0/1683854169 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d27548850 msgr2=0x557d2755bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:41.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:41.387+0000 7fba1d8e3740 1 --2- 172.21.15.19:0/1683854169 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d27548850 0x557d2755bfa0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fba10010e70 tx=0x7fba1000ba50 comp rx=0 tx=0).stop 2024-09-19T08:54:41.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:41.387+0000 7fba1d8e3740 1 -- 172.21.15.19:0/1683854169 shutdown_connections 2024-09-19T08:54:41.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:41.387+0000 7fba1d8e3740 1 --2- 172.21.15.19:0/1683854169 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557d275ce7a0 0x557d275d0be0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:41.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:41.387+0000 7fba1d8e3740 1 --2- 172.21.15.19:0/1683854169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557d27549170 0x557d275572d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:41.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:41.387+0000 7fba1d8e3740 1 --2- 172.21.15.19:0/1683854169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557d27553a30 0x557d27557810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:41.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:41.387+0000 7fba1d8e3740 1 --2- 172.21.15.19:0/1683854169 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557d27548850 0x557d2755bfa0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:41.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:41.387+0000 7fba1d8e3740 1 -- 172.21.15.19:0/1683854169 >> 172.21.15.19:0/1683854169 conn(0x557d27544de0 msgr2=0x557d27543610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:41.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:41.387+0000 7fb9fcff9640 0 client.15963 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:54:41.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:41.387+0000 7fba1d8e3740 1 -- 172.21.15.19:0/1683854169 shutdown_connections 2024-09-19T08:54:41.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:41.387+0000 7fba1d8e3740 1 -- 172.21.15.19:0/1683854169 wait complete. 2024-09-19T08:54:41.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:41.387+0000 7fba1d8e3740 20 client.15963 trim_cache size 0 max 16384 2024-09-19T08:54:41.389 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:54:41.390 INFO:teuthology.orchestra.run.smithi019.stdout: "epoch": 30, 2024-09-19T08:54:41.390 INFO:teuthology.orchestra.run.smithi019.stdout: "leader": 24497, 2024-09-19T08:54:41.390 INFO:teuthology.orchestra.run.smithi019.stdout: "set_version": 10, 2024-09-19T08:54:41.390 INFO:teuthology.orchestra.run.smithi019.stdout: "sets": { 2024-09-19T08:54:41.390 INFO:teuthology.orchestra.run.smithi019.stdout: "be17fc49": { 2024-09-19T08:54:41.390 INFO:teuthology.orchestra.run.smithi019.stdout: "version": 10, 2024-09-19T08:54:41.390 INFO:teuthology.orchestra.run.smithi019.stdout: "age_ref": 0.0, 2024-09-19T08:54:41.390 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T08:54:41.390 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "QUIESCED", 2024-09-19T08:54:41.390 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T08:54:41.390 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T08:54:41.390 INFO:teuthology.orchestra.run.smithi019.stdout: "timeout": 90.0, 2024-09-19T08:54:41.390 INFO:teuthology.orchestra.run.smithi019.stdout: "expiration": 140.3, 2024-09-19T08:54:41.391 INFO:teuthology.orchestra.run.smithi019.stdout: "members": { 2024-09-19T08:54:41.391 INFO:teuthology.orchestra.run.smithi019.stdout: "file:/": { 2024-09-19T08:54:41.391 INFO:teuthology.orchestra.run.smithi019.stdout: "excluded": false, 2024-09-19T08:54:41.391 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T08:54:41.391 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "QUIESCED", 2024-09-19T08:54:41.391 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T08:54:41.391 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:54:41.391 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:54:41.391 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:54:41.391 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:54:41.391 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:54:41.391 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:54:41.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:41.388+0000 7fba1b50a640 1 -- 172.21.15.19:0/228057010 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fba000a3240 msgr2=0x7fba000a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:41.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:41.388+0000 7fba1b50a640 1 --2- 172.21.15.19:0/228057010 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fba000a3240 0x7fba000a5700 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fba1000bbe0 tx=0x7fba1000b390 comp rx=0 tx=0).stop 2024-09-19T08:54:41.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:41.388+0000 7fba1b50a640 1 -- 172.21.15.19:0/228057010 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba14102ef0 msgr2=0x7fba1419ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:41.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:41.388+0000 7fba1b50a640 1 --2- 172.21.15.19:0/228057010 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba14102ef0 0x7fba1419ef20 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fba0c02ae70 tx=0x7fba0c02f5d0 comp rx=0 tx=0).stop 2024-09-19T08:54:41.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:41.388+0000 7fba1b50a640 1 -- 172.21.15.19:0/228057010 shutdown_connections 2024-09-19T08:54:41.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:41.388+0000 7fba1b50a640 1 --2- 172.21.15.19:0/228057010 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fba000a3240 0x7fba000a5700 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:41.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:41.388+0000 7fba1b50a640 1 --2- 172.21.15.19:0/228057010 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba14102570 0x7fba1419ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:41.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:41.388+0000 7fba1b50a640 1 --2- 172.21.15.19:0/228057010 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fba14102ef0 0x7fba1419ef20 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:41.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:41.388+0000 7fba1b50a640 1 --2- 172.21.15.19:0/228057010 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fba14100e20 0x7fba1419a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:41.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:41.388+0000 7fba1b50a640 1 -- 172.21.15.19:0/228057010 >> 172.21.15.19:0/228057010 conn(0x7fba140fc7d0 msgr2=0x7fba1406a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:41.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:41.388+0000 7fba1b50a640 1 -- 172.21.15.19:0/228057010 shutdown_connections 2024-09-19T08:54:41.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:41.388+0000 7fba1b50a640 1 -- 172.21.15.19:0/228057010 wait complete. 2024-09-19T08:54:41.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:41 smithi155 ceph-mon[34921]: pgmap v411: 97 pgs: 97 active+clean; 994 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.0 KiB/s wr, 12 op/s 2024-09-19T08:54:41.424 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:41.424 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:41.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:41 smithi203 ceph-mon[35450]: pgmap v411: 97 pgs: 97 active+clean; 994 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.0 KiB/s wr, 12 op/s 2024-09-19T08:54:41.548 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:41.549 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:43.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:43 smithi019 ceph-mon[30976]: pgmap v412: 97 pgs: 97 active+clean; 994 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.5 KiB/s wr, 12 op/s 2024-09-19T08:54:43.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:43 smithi155 ceph-mon[34921]: pgmap v412: 97 pgs: 97 active+clean; 994 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.5 KiB/s wr, 12 op/s 2024-09-19T08:54:43.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:43 smithi203 ceph-mon[35450]: pgmap v412: 97 pgs: 97 active+clean; 994 KiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 4.5 KiB/s wr, 12 op/s 2024-09-19T08:54:43.567 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'be17fc49', quiesce took 43.0 seconds. Will release after: -22.65 2024-09-19T08:54:43.568 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:54:43.616 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:45.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:45 smithi019 ceph-mon[30976]: pgmap v413: 97 pgs: 97 active+clean; 1017 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.3 KiB/s wr, 15 op/s 2024-09-19T08:54:45.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:45 smithi155 ceph-mon[34921]: pgmap v413: 97 pgs: 97 active+clean; 1017 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.3 KiB/s wr, 15 op/s 2024-09-19T08:54:45.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:45 smithi203 ceph-mon[35450]: pgmap v413: 97 pgs: 97 active+clean; 1017 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.3 KiB/s wr, 15 op/s 2024-09-19T08:54:45.511 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:46.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.328+0000 7f80c5117640 1 -- 172.21.15.19:0/3873544142 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80c0100100 msgr2=0x7f80c0100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:46.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.328+0000 7f80c5117640 1 --2- 172.21.15.19:0/3873544142 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80c0100100 0x7f80c0100560 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f80a8009900 tx=0x7f80a802a410 comp rx=0 tx=0).stop 2024-09-19T08:54:46.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.328+0000 7f80c5117640 1 -- 172.21.15.19:0/3873544142 shutdown_connections 2024-09-19T08:54:46.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.328+0000 7f80c5117640 1 --2- 172.21.15.19:0/3873544142 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f80c0100aa0 0x7f80c010ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.328+0000 7f80c5117640 1 --2- 172.21.15.19:0/3873544142 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80c0100100 0x7f80c0100560 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.328+0000 7f80c5117640 1 --2- 172.21.15.19:0/3873544142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80c0106b80 0x7f80c0106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.328+0000 7f80c5117640 1 -- 172.21.15.19:0/3873544142 >> 172.21.15.19:0/3873544142 conn(0x7f80c0077230 msgr2=0x7f80c00fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:46.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.328+0000 7f80c5117640 1 -- 172.21.15.19:0/3873544142 shutdown_connections 2024-09-19T08:54:46.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.328+0000 7f80c5117640 1 -- 172.21.15.19:0/3873544142 wait complete. 2024-09-19T08:54:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.329+0000 7f80c5117640 1 Processor -- start 2024-09-19T08:54:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.329+0000 7f80c5117640 1 -- start start 2024-09-19T08:54:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.329+0000 7f80c5117640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f80c0100100 0x7f80c01a0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.329+0000 7f80c5117640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80c0100aa0 0x7f80c01a0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.329+0000 7f80c5117640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80c0106b80 0x7f80c019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:46.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.329+0000 7f80c5117640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f80c0112110 con 0x7f80c0100aa0 2024-09-19T08:54:46.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.329+0000 7f80c5117640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f80c0111f90 con 0x7f80c0106b80 2024-09-19T08:54:46.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.329+0000 7f80c5117640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f80c0112290 con 0x7f80c0100100 2024-09-19T08:54:46.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.329+0000 7f80be59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80c0100aa0 0x7f80c01a0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:46.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.330+0000 7f80be59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80c0100aa0 0x7f80c01a0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52690/0 (socket says 172.21.15.19:52690) 2024-09-19T08:54:46.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.330+0000 7f80be59c640 1 -- 172.21.15.19:0/3023122174 learned_addr learned my addr 172.21.15.19:0/3023122174 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:46.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.330+0000 7f80bed9d640 1 --2- 172.21.15.19:0/3023122174 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f80c0100100 0x7f80c01a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:46.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.330+0000 7f80bf59e640 1 --2- 172.21.15.19:0/3023122174 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80c0106b80 0x7f80c019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:46.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.330+0000 7f80bed9d640 1 -- 172.21.15.19:0/3023122174 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80c0106b80 msgr2=0x7f80c019a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:46.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.330+0000 7f80bed9d640 1 --2- 172.21.15.19:0/3023122174 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80c0106b80 0x7f80c019a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.330+0000 7f80bed9d640 1 -- 172.21.15.19:0/3023122174 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80c0100aa0 msgr2=0x7f80c01a0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:46.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.330+0000 7f80bed9d640 1 --2- 172.21.15.19:0/3023122174 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80c0100aa0 0x7f80c01a0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.330+0000 7f80bed9d640 1 -- 172.21.15.19:0/3023122174 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80c019ad30 con 0x7f80c0100100 2024-09-19T08:54:46.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.330+0000 7f80be59c640 1 --2- 172.21.15.19:0/3023122174 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80c0100aa0 0x7f80c01a0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:54:46.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.330+0000 7f80bf59e640 1 --2- 172.21.15.19:0/3023122174 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80c0106b80 0x7f80c019a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:54:46.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.330+0000 7f80bed9d640 1 --2- 172.21.15.19:0/3023122174 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f80c0100100 0x7f80c01a0440 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f80b800b3f0 tx=0x7f80b800b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:46.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.330+0000 7f80b7fff640 1 -- 172.21.15.19:0/3023122174 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b8015020 con 0x7f80c0100100 2024-09-19T08:54:46.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.330+0000 7fc6c00ba640 1 -- 172.21.15.19:0/3179304909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6b8103660 msgr2=0x7fc6b810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:46.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.330+0000 7fc6c00ba640 1 --2- 172.21.15.19:0/3179304909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6b8103660 0x7fc6b810bb50 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8009900 tx=0x7fc6a802a480 comp rx=0 tx=0).stop 2024-09-19T08:54:46.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.331+0000 7fc6c00ba640 1 -- 172.21.15.19:0/3179304909 shutdown_connections 2024-09-19T08:54:46.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.331+0000 7fc6c00ba640 1 --2- 172.21.15.19:0/3179304909 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6b810c170 0x7fc6b810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.331+0000 7fc6c00ba640 1 --2- 172.21.15.19:0/3179304909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6b8103660 0x7fc6b810bb50 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.331+0000 7fc6c00ba640 1 --2- 172.21.15.19:0/3179304909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6b8102d40 0x7fc6b8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.331+0000 7fc6c00ba640 1 -- 172.21.15.19:0/3179304909 >> 172.21.15.19:0/3179304909 conn(0x7fc6b80fc7a0 msgr2=0x7fc6b80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:46.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.331+0000 7f80b7fff640 1 -- 172.21.15.19:0/3023122174 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f80b8011d10 con 0x7f80c0100100 2024-09-19T08:54:46.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.331+0000 7f80b7fff640 1 -- 172.21.15.19:0/3023122174 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80b800f2e0 con 0x7f80c0100100 2024-09-19T08:54:46.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.331+0000 7f80c5117640 1 -- 172.21.15.19:0/3023122174 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80c019b020 con 0x7f80c0100100 2024-09-19T08:54:46.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.331+0000 7f80c5117640 1 -- 172.21.15.19:0/3023122174 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80c01a7310 con 0x7f80c0100100 2024-09-19T08:54:46.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.331+0000 7fc6c00ba640 1 -- 172.21.15.19:0/3179304909 shutdown_connections 2024-09-19T08:54:46.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.331+0000 7fc6c00ba640 1 -- 172.21.15.19:0/3179304909 wait complete. 2024-09-19T08:54:46.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.332+0000 7fc6c00ba640 1 Processor -- start 2024-09-19T08:54:46.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.332+0000 7fc6c00ba640 1 -- start start 2024-09-19T08:54:46.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.332+0000 7fc6c00ba640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6b8102d40 0x7fc6b810b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:46.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.332+0000 7f80c5117640 1 -- 172.21.15.19:0/3023122174 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80c0100560 con 0x7f80c0100100 2024-09-19T08:54:46.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.332+0000 7fc6c00ba640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6b8103660 0x7fc6b810b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:46.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.332+0000 7fc6c00ba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6b810c170 0x7fc6b81084c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:46.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.332+0000 7fc6c00ba640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b8101d20 con 0x7fc6b810c170 2024-09-19T08:54:46.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.332+0000 7fc6c00ba640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b8101ba0 con 0x7fc6b8103660 2024-09-19T08:54:46.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.332+0000 7fc6c00ba640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b8101ea0 con 0x7fc6b8102d40 2024-09-19T08:54:46.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.332+0000 7fc6be657640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6b810c170 0x7fc6b81084c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:46.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.332+0000 7fc6be657640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6b810c170 0x7fc6b81084c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52698/0 (socket says 172.21.15.19:52698) 2024-09-19T08:54:46.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.332+0000 7fc6be657640 1 -- 172.21.15.19:0/2359600285 learned_addr learned my addr 172.21.15.19:0/2359600285 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:46.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.332+0000 7fc6bd655640 1 --2- 172.21.15.19:0/2359600285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6b8103660 0x7fc6b810b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:46.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.333+0000 7fc6be657640 1 -- 172.21.15.19:0/2359600285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6b8102d40 msgr2=0x7fc6b810b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:46.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.332+0000 7fc6bde56640 1 --2- 172.21.15.19:0/2359600285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6b8102d40 0x7fc6b810b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:46.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.333+0000 7fc6be657640 1 --2- 172.21.15.19:0/2359600285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6b8102d40 0x7fc6b810b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.333+0000 7fc6be657640 1 -- 172.21.15.19:0/2359600285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6b8103660 msgr2=0x7fc6b810b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:46.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.333+0000 7fc6be657640 1 --2- 172.21.15.19:0/2359600285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6b8103660 0x7fc6b810b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.333+0000 7fc6be657640 1 -- 172.21.15.19:0/2359600285 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6b8108d30 con 0x7fc6b810c170 2024-09-19T08:54:46.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.333+0000 7fc6bd655640 1 --2- 172.21.15.19:0/2359600285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6b8103660 0x7fc6b810b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:46.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.333+0000 7fc6bde56640 1 --2- 172.21.15.19:0/2359600285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6b8102d40 0x7fc6b810b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:54:46.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.333+0000 7fc6be657640 1 --2- 172.21.15.19:0/2359600285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6b810c170 0x7fc6b81084c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fc6b000cad0 tx=0x7fc6b000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:46.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.333+0000 7fc6aeffd640 1 -- 172.21.15.19:0/2359600285 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b000ae20 con 0x7fc6b810c170 2024-09-19T08:54:46.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.333+0000 7fc6c00ba640 1 -- 172.21.15.19:0/2359600285 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6b8109020 con 0x7fc6b810c170 2024-09-19T08:54:46.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.333+0000 7fc6aeffd640 1 -- 172.21.15.19:0/2359600285 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6b0005020 con 0x7fc6b810c170 2024-09-19T08:54:46.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.333+0000 7fc6aeffd640 1 -- 172.21.15.19:0/2359600285 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b000f6f0 con 0x7fc6b810c170 2024-09-19T08:54:46.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.333+0000 7f80b7fff640 1 -- 172.21.15.19:0/3023122174 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f80b8018020 con 0x7f80c0100100 2024-09-19T08:54:46.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.333+0000 7fc6c00ba640 1 -- 172.21.15.19:0/2359600285 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6b81ab680 con 0x7fc6b810c170 2024-09-19T08:54:46.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.334+0000 7f80b7fff640 1 --2- 172.21.15.19:0/3023122174 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f80ac0a3340 0x7f80ac0a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:46.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.334+0000 7f80b7fff640 1 -- 172.21.15.19:0/3023122174 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f80b80cf110 con 0x7f80c0100100 2024-09-19T08:54:46.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.334+0000 7f80be59c640 1 --2- 172.21.15.19:0/3023122174 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f80ac0a3340 0x7f80ac0a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:46.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.335+0000 7f80be59c640 1 --2- 172.21.15.19:0/3023122174 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f80ac0a3340 0x7f80ac0a5800 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f80c019b740 tx=0x7f80a8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:46.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.336+0000 7fc6aeffd640 1 -- 172.21.15.19:0/2359600285 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fc6b00051d0 con 0x7fc6b810c170 2024-09-19T08:54:46.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.336+0000 7fc6aeffd640 1 --2- 172.21.15.19:0/2359600285 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc6a40a32c0 0x7fc6a40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:46.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.337+0000 7fc6bde56640 1 --2- 172.21.15.19:0/2359600285 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc6a40a32c0 0x7fc6a40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:46.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.337+0000 7fc6aeffd640 1 -- 172.21.15.19:0/2359600285 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc6b00cf930 con 0x7fc6b810c170 2024-09-19T08:54:46.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.337+0000 7fc6bde56640 1 --2- 172.21.15.19:0/2359600285 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc6a40a32c0 0x7fc6a40a5780 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4009b40 tx=0x7fc6b4005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:46.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.339+0000 7f80b7fff640 1 -- 172.21.15.19:0/3023122174 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f80b801f020 con 0x7f80c0100100 2024-09-19T08:54:46.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.352+0000 7fc6c2493740 1 Processor -- start 2024-09-19T08:54:46.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.352+0000 7fc6c2493740 1 -- start start 2024-09-19T08:54:46.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.352+0000 7fc6c2493740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1f9aeeb40 0x55c1f9aed090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:46.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.352+0000 7fc6c2493740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c1f9aed5d0 0x55c1f9aeda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:46.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.352+0000 7fc6c2493740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1f9af8370 0x55c1f9afa760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:46.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.353+0000 7fc6c2493740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c1f9a532f0 con 0x55c1f9aed5d0 2024-09-19T08:54:46.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.353+0000 7fc6c2493740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55c1f99facf0 con 0x55c1f9af8370 2024-09-19T08:54:46.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.353+0000 7fc6c2493740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c1f9a4f2b0 con 0x55c1f9aeeb40 2024-09-19T08:54:46.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.353+0000 7fc6bd655640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c1f9aed5d0 0x55c1f9aeda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:46.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.353+0000 7fc6bd655640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c1f9aed5d0 0x55c1f9aeda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52702/0 (socket says 172.21.15.19:52702) 2024-09-19T08:54:46.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.353+0000 7fc6bd655640 1 -- 172.21.15.19:0/187907896 learned_addr learned my addr 172.21.15.19:0/187907896 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:46.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.353+0000 7fc6bde56640 1 --2- 172.21.15.19:0/187907896 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1f9aeeb40 0x55c1f9aed090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:46.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.353+0000 7fc6be657640 1 --2- 172.21.15.19:0/187907896 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1f9af8370 0x55c1f9afa760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:46.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.353+0000 7fc6bd655640 1 -- 172.21.15.19:0/187907896 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1f9aeeb40 msgr2=0x55c1f9aed090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:46.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.353+0000 7fc6bd655640 1 --2- 172.21.15.19:0/187907896 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1f9aeeb40 0x55c1f9aed090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.353+0000 7fc6bd655640 1 -- 172.21.15.19:0/187907896 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1f9af8370 msgr2=0x55c1f9afa760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:46.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.353+0000 7fc6bd655640 1 --2- 172.21.15.19:0/187907896 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1f9af8370 0x55c1f9afa760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.353+0000 7fc6bd655640 1 -- 172.21.15.19:0/187907896 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1f99df3a0 con 0x55c1f9aed5d0 2024-09-19T08:54:46.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.353+0000 7fc6be657640 1 --2- 172.21.15.19:0/187907896 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1f9af8370 0x55c1f9afa760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:54:46.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.353+0000 7fc6bd655640 1 --2- 172.21.15.19:0/187907896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c1f9aed5d0 0x55c1f9aeda10 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8009900 tx=0x7fc6a8032cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f82166e4d152bdda server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:46.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.353+0000 7fc6a3fff640 1 -- 172.21.15.19:0/187907896 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a803f070 con 0x55c1f9aed5d0 2024-09-19T08:54:46.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.354+0000 7fc6a3fff640 1 -- 172.21.15.19:0/187907896 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6a80317b0 con 0x55c1f9aed5d0 2024-09-19T08:54:46.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.354+0000 7fc6a3fff640 1 -- 172.21.15.19:0/187907896 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a8035070 con 0x55c1f9aed5d0 2024-09-19T08:54:46.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.354+0000 7fc6c2493740 1 -- 172.21.15.19:0/187907896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c1f9aed5d0 msgr2=0x55c1f9aeda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:46.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.354+0000 7fc6c2493740 1 --2- 172.21.15.19:0/187907896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c1f9aed5d0 0x55c1f9aeda10 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8009900 tx=0x7fc6a8032cb0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.354+0000 7fc6c2493740 1 -- 172.21.15.19:0/187907896 shutdown_connections 2024-09-19T08:54:46.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.354+0000 7fc6c2493740 1 --2- 172.21.15.19:0/187907896 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1f9af8370 0x55c1f9afa760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.354+0000 7fc6c2493740 1 --2- 172.21.15.19:0/187907896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c1f9aed5d0 0x55c1f9aeda10 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.354+0000 7fc6c2493740 1 --2- 172.21.15.19:0/187907896 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1f9aeeb40 0x55c1f9aed090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.354+0000 7fc6c2493740 1 -- 172.21.15.19:0/187907896 >> 172.21.15.19:0/187907896 conn(0x55c1f9ab6310 msgr2=0x55c1f9ae9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:46.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.355+0000 7fc6c2493740 1 -- 172.21.15.19:0/187907896 shutdown_connections 2024-09-19T08:54:46.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.355+0000 7fc6c2493740 1 -- 172.21.15.19:0/187907896 wait complete. 2024-09-19T08:54:46.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.355+0000 7fc6c2493740 1 -- start start 2024-09-19T08:54:46.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.355+0000 7fc6c2493740 1 Processor -- start 2024-09-19T08:54:46.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.355+0000 7fc6c2493740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c1f9aed5d0 0x55c1f9af7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:46.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.355+0000 7fc6c2493740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1f9aeeb40 0x55c1f9af5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:46.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.355+0000 7fc6c2493740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1f9af8370 0x55c1f9af57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:46.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.355+0000 7fc6c2493740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c1f9afb010 con 0x55c1f9aed5d0 2024-09-19T08:54:46.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.356+0000 7fc6c2493740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55c1f9a0e060 con 0x55c1f9aeeb40 2024-09-19T08:54:46.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.356+0000 7fc6c2493740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c1f9afb190 con 0x55c1f9af8370 2024-09-19T08:54:46.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.356+0000 7fc6bde56640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c1f9aed5d0 0x55c1f9af7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:46.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.356+0000 7fc6bde56640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c1f9aed5d0 0x55c1f9af7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52714/0 (socket says 172.21.15.19:52714) 2024-09-19T08:54:46.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.356+0000 7fc6c2493740 10 client.0 _ll_register_callbacks cb 0x55c1f97618c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:46.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.356+0000 7fc6bde56640 1 -- 172.21.15.19:0/3172266309 learned_addr learned my addr 172.21.15.19:0/3172266309 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:46.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.356+0000 7fc6be657640 1 --2- 172.21.15.19:0/3172266309 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1f9af8370 0x55c1f9af57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:46.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.356+0000 7fc6bd655640 1 --2- 172.21.15.19:0/3172266309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1f9aeeb40 0x55c1f9af5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:46.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.356+0000 7fc6be657640 1 -- 172.21.15.19:0/3172266309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1f9aeeb40 msgr2=0x55c1f9af5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:46.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.356+0000 7fc6be657640 1 --2- 172.21.15.19:0/3172266309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1f9aeeb40 0x55c1f9af5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.356+0000 7fc6be657640 1 -- 172.21.15.19:0/3172266309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c1f9aed5d0 msgr2=0x55c1f9af7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:46.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.356+0000 7fc6be657640 1 --2- 172.21.15.19:0/3172266309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c1f9aed5d0 0x55c1f9af7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.356+0000 7fc6be657640 1 -- 172.21.15.19:0/3172266309 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1f97c43c0 con 0x55c1f9af8370 2024-09-19T08:54:46.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.356+0000 7fc6bde56640 1 --2- 172.21.15.19:0/3172266309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c1f9aed5d0 0x55c1f9af7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:54:46.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.356+0000 7fc6be657640 1 --2- 172.21.15.19:0/3172266309 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1f9af8370 0x55c1f9af57e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc6b00cd490 tx=0x7fc6b00bc190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f65a167b4f8f8108 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:46.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.356+0000 7fc6a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T08:54:46.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.357+0000 7fc6a17fa640 1 -- 172.21.15.19:0/3172266309 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b001d040 con 0x55c1f9af8370 2024-09-19T08:54:46.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.357+0000 7fc6a17fa640 1 -- 172.21.15.19:0/3172266309 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc6b00a4740 con 0x55c1f9af8370 2024-09-19T08:54:46.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.357+0000 7fc6c2493740 1 -- 172.21.15.19:0/3172266309 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6a80317b0 con 0x55c1f9af8370 2024-09-19T08:54:46.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.357+0000 7fc6a17fa640 1 -- 172.21.15.19:0/3172266309 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc6b00a4bd0 con 0x55c1f9af8370 2024-09-19T08:54:46.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.357+0000 7fc6c2493740 10 client.25534 fetch_fsmap learned FSMap version 30 2024-09-19T08:54:46.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.357+0000 7fc6c2493740 1 -- 172.21.15.19:0/3172266309 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c1f9b06b40 con 0x55c1f9af8370 2024-09-19T08:54:46.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.357+0000 7fc6a17fa640 1 -- 172.21.15.19:0/3172266309 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6a80317b0 con 0x55c1f9af8370 2024-09-19T08:54:46.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.357+0000 7fc6a17fa640 1 -- 172.21.15.19:0/3172266309 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fc6b009b3b0 con 0x55c1f9af8370 2024-09-19T08:54:46.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.357+0000 7fc6c2493740 10 client.25534 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T08:54:46.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.357+0000 7fc6c2493740 10 client.25534 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:54:46.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.358+0000 7fc6c2493740 20 client.25534 populate_metadata read hostname 'smithi019' 2024-09-19T08:54:46.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.358+0000 7fc6c2493740 1 --2- 172.21.15.19:0/3172266309 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55c1f9b08000 0x55c1f9b0a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:46.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.358+0000 7fc6c2493740 4 client.25534 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:54:46.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.358+0000 7fc6c2493740 1 -- 172.21.15.19:0/3172266309 --> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c1f9a60860 con 0x55c1f9b08000 2024-09-19T08:54:46.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.358+0000 7fc6bde56640 1 --2- 172.21.15.19:0/3172266309 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55c1f9b08000 0x55c1f9b0a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:46.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.358+0000 7fc6bde56640 1 --2- 172.21.15.19:0/3172266309 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55c1f9b08000 0x55c1f9b0a3f0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bc97f11d445099ab server_cookie=588d2f2fd7f6954e in_seq=0 out_seq=0 2024-09-19T08:54:46.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.358+0000 7fc6a17fa640 10 client.25534 ms_handle_connect on v2:172.21.15.203:6838/2547507299 2024-09-19T08:54:46.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.359+0000 7fc6a17fa640 1 -- 172.21.15.19:0/3172266309 <== mds.1 v2:172.21.15.203:6838/2547507299 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c1f9a60860 con 0x55c1f9b08000 2024-09-19T08:54:46.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.359+0000 7fc6a17fa640 10 client.25534 handle_command_reply: tid=0 2024-09-19T08:54:46.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.359+0000 7fc6c2493740 1 client.25534 shutdown 2024-09-19T08:54:46.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.359+0000 7fc6c2493740 1 -- 172.21.15.19:0/3172266309 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1f9af8370 msgr2=0x55c1f9af57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:46.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.359+0000 7fc6c2493740 1 --2- 172.21.15.19:0/3172266309 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1f9af8370 0x55c1f9af57e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc6b00cd490 tx=0x7fc6b00bc190 comp rx=0 tx=0).stop 2024-09-19T08:54:46.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.359+0000 7fc6c2493740 1 -- 172.21.15.19:0/3172266309 shutdown_connections 2024-09-19T08:54:46.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.359+0000 7fc6c2493740 1 --2- 172.21.15.19:0/3172266309 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55c1f9b08000 0x55c1f9b0a3f0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.359+0000 7fc6c2493740 1 --2- 172.21.15.19:0/3172266309 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1f9af8370 0x55c1f9af57e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.359+0000 7fc6a17fa640 0 client.25534 ms_handle_reset on v2:172.21.15.203:6838/2547507299 2024-09-19T08:54:46.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.359+0000 7fc6c2493740 1 --2- 172.21.15.19:0/3172266309 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1f9aeeb40 0x55c1f9af5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.359+0000 7fc6c2493740 1 --2- 172.21.15.19:0/3172266309 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c1f9aed5d0 0x55c1f9af7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.359+0000 7fc6c2493740 1 -- 172.21.15.19:0/3172266309 >> 172.21.15.19:0/3172266309 conn(0x55c1f9ab6310 msgr2=0x55c1f9aef930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:46.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.360+0000 7fc6c2493740 1 -- 172.21.15.19:0/3172266309 shutdown_connections 2024-09-19T08:54:46.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.360+0000 7fc6c2493740 1 -- 172.21.15.19:0/3172266309 wait complete. 2024-09-19T08:54:46.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.360+0000 7fc6c2493740 20 client.25534 trim_cache size 0 max 16384 2024-09-19T08:54:46.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.373+0000 7fc6c2493740 1 Processor -- start 2024-09-19T08:54:46.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.373+0000 7fc6c2493740 1 -- start start 2024-09-19T08:54:46.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.373+0000 7fc6c2493740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1f9aed5d0 0x55c1f9ae9700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:46.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.373+0000 7fc6c2493740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1f9aeeb40 0x55c1f9ae9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:46.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.373+0000 7fc6c2493740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c1f9af8370 0x55c1f9b0fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:46.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.373+0000 7fc6c2493740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b81b39e0 con 0x55c1f9af8370 2024-09-19T08:54:46.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.373+0000 7fc6c2493740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b81b55e0 con 0x55c1f9aeeb40 2024-09-19T08:54:46.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.373+0000 7fc6c2493740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b81b40b0 con 0x55c1f9aed5d0 2024-09-19T08:54:46.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.373+0000 7fc6be657640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c1f9af8370 0x55c1f9b0fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:46.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.373+0000 7fc6bd655640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1f9aeeb40 0x55c1f9ae9c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:46.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.373+0000 7fc6be657640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c1f9af8370 0x55c1f9b0fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52724/0 (socket says 172.21.15.19:52724) 2024-09-19T08:54:46.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.373+0000 7fc6be657640 1 -- 172.21.15.19:0/357156607 learned_addr learned my addr 172.21.15.19:0/357156607 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:46.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.373+0000 7fc6bde56640 1 --2- 172.21.15.19:0/357156607 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1f9aed5d0 0x55c1f9ae9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:46.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.373+0000 7fc6be657640 1 -- 172.21.15.19:0/357156607 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1f9aed5d0 msgr2=0x55c1f9ae9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:46.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.373+0000 7fc6be657640 1 --2- 172.21.15.19:0/357156607 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1f9aed5d0 0x55c1f9ae9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.374+0000 7fc6be657640 1 -- 172.21.15.19:0/357156607 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1f9aeeb40 msgr2=0x55c1f9ae9c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:46.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.374+0000 7fc6be657640 1 --2- 172.21.15.19:0/357156607 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1f9aeeb40 0x55c1f9ae9c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.374+0000 7fc6be657640 1 -- 172.21.15.19:0/357156607 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1f9ae94f0 con 0x55c1f9af8370 2024-09-19T08:54:46.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.374+0000 7fc6bd655640 1 --2- 172.21.15.19:0/357156607 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1f9aeeb40 0x55c1f9ae9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:54:46.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.374+0000 7fc6be657640 1 --2- 172.21.15.19:0/357156607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c1f9af8370 0x55c1f9b0fbd0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fc6b00983c0 tx=0x7fc6b009a470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=468254fd932b98b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:46.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.374+0000 7fc6a37fe640 1 -- 172.21.15.19:0/357156607 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b001d040 con 0x55c1f9af8370 2024-09-19T08:54:46.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.374+0000 7fc6a37fe640 1 -- 172.21.15.19:0/357156607 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6b009b3b0 con 0x55c1f9af8370 2024-09-19T08:54:46.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.374+0000 7fc6a37fe640 1 -- 172.21.15.19:0/357156607 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6b00baba0 con 0x55c1f9af8370 2024-09-19T08:54:46.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.375+0000 7fc6c2493740 1 -- 172.21.15.19:0/357156607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c1f9af8370 msgr2=0x55c1f9b0fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:46.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.375+0000 7fc6c2493740 1 --2- 172.21.15.19:0/357156607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c1f9af8370 0x55c1f9b0fbd0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fc6b00983c0 tx=0x7fc6b009a470 comp rx=0 tx=0).stop 2024-09-19T08:54:46.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.375+0000 7fc6c2493740 1 -- 172.21.15.19:0/357156607 shutdown_connections 2024-09-19T08:54:46.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.375+0000 7fc6c2493740 1 --2- 172.21.15.19:0/357156607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c1f9af8370 0x55c1f9b0fbd0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.375+0000 7fc6c2493740 1 --2- 172.21.15.19:0/357156607 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1f9aeeb40 0x55c1f9ae9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.375+0000 7fc6c2493740 1 --2- 172.21.15.19:0/357156607 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1f9aed5d0 0x55c1f9ae9700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.375+0000 7fc6c2493740 1 -- 172.21.15.19:0/357156607 >> 172.21.15.19:0/357156607 conn(0x55c1f9ab6310 msgr2=0x55c1f9ae4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:46.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.375+0000 7fc6c2493740 1 -- 172.21.15.19:0/357156607 shutdown_connections 2024-09-19T08:54:46.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.375+0000 7fc6c2493740 1 -- 172.21.15.19:0/357156607 wait complete. 2024-09-19T08:54:46.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.375+0000 7fc6c2493740 1 -- start start 2024-09-19T08:54:46.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.375+0000 7fc6c2493740 1 Processor -- start 2024-09-19T08:54:46.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.376+0000 7fc6c2493740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1f9aed5d0 0x55c1f9af20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:46.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.376+0000 7fc6c2493740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c1f9aeeb40 0x55c1f9af2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:46.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.376+0000 7fc6c2493740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1f9af8370 0x55c1f9af2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:46.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.376+0000 7fc6c2493740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b81b4e50 con 0x55c1f9aeeb40 2024-09-19T08:54:46.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.376+0000 7fc6c2493740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b81b4780 con 0x55c1f9aed5d0 2024-09-19T08:54:46.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.376+0000 7fc6c2493740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b81b19c0 con 0x55c1f9af8370 2024-09-19T08:54:46.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.376+0000 7fc6c2493740 10 client.0 _ll_register_callbacks cb 0x7fc6b0005860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:46.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.376+0000 7fc6bd655640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c1f9aeeb40 0x55c1f9af2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:46.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.376+0000 7fc6bd655640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c1f9aeeb40 0x55c1f9af2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52728/0 (socket says 172.21.15.19:52728) 2024-09-19T08:54:46.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.376+0000 7fc6bd655640 1 -- 172.21.15.19:0/1089249761 learned_addr learned my addr 172.21.15.19:0/1089249761 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:46.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.376+0000 7fc6be657640 1 --2- 172.21.15.19:0/1089249761 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1f9af8370 0x55c1f9af2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:46.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.376+0000 7fc6bd655640 1 -- 172.21.15.19:0/1089249761 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1f9af8370 msgr2=0x55c1f9af2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:46.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.376+0000 7fc6bd655640 1 --2- 172.21.15.19:0/1089249761 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1f9af8370 0x55c1f9af2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.376+0000 7fc6bd655640 1 -- 172.21.15.19:0/1089249761 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1f9aed5d0 msgr2=0x55c1f9af20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:46.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.376+0000 7fc6bde56640 1 --2- 172.21.15.19:0/1089249761 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1f9aed5d0 0x55c1f9af20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:46.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.376+0000 7fc6bd655640 1 --2- 172.21.15.19:0/1089249761 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1f9aed5d0 0x55c1f9af20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.376+0000 7fc6bd655640 1 -- 172.21.15.19:0/1089249761 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1f9b71c50 con 0x55c1f9aeeb40 2024-09-19T08:54:46.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.376+0000 7fc6bde56640 1 --2- 172.21.15.19:0/1089249761 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1f9aed5d0 0x55c1f9af20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:54:46.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.376+0000 7fc6bd655640 1 --2- 172.21.15.19:0/1089249761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c1f9aeeb40 0x55c1f9af2620 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8009900 tx=0x7fc6a8031980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b17b90b588eba0b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:46.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.376+0000 7fc6a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:54:46.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.376+0000 7fc6a17fa640 1 -- 172.21.15.19:0/1089249761 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a803f030 con 0x55c1f9aeeb40 2024-09-19T08:54:46.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.377+0000 7fc6a17fa640 1 -- 172.21.15.19:0/1089249761 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc6a8004450 con 0x55c1f9aeeb40 2024-09-19T08:54:46.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.377+0000 7fc6c2493740 1 -- 172.21.15.19:0/1089249761 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6b009b3b0 con 0x55c1f9aeeb40 2024-09-19T08:54:46.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.377+0000 7fc6a17fa640 1 -- 172.21.15.19:0/1089249761 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fc6a8035040 con 0x55c1f9aeeb40 2024-09-19T08:54:46.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.377+0000 7fc6c2493740 10 client.15987 fetch_fsmap learned FSMap version 30 2024-09-19T08:54:46.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.377+0000 7fc6c2493740 1 -- 172.21.15.19:0/1089249761 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c1f9b72f40 con 0x55c1f9aeeb40 2024-09-19T08:54:46.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.377+0000 7fc6a17fa640 1 -- 172.21.15.19:0/1089249761 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc6b009b3b0 con 0x55c1f9aeeb40 2024-09-19T08:54:46.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.377+0000 7fc6a17fa640 1 -- 172.21.15.19:0/1089249761 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fc6a803b7c0 con 0x55c1f9aeeb40 2024-09-19T08:54:46.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.377+0000 7fc6c2493740 10 client.15987 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T08:54:46.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.377+0000 7fc6c2493740 10 client.15987 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:54:46.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.377+0000 7fc6c2493740 20 client.15987 populate_metadata read hostname 'smithi019' 2024-09-19T08:54:46.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.377+0000 7fc6c2493740 1 --2- 172.21.15.19:0/1089249761 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55c1f9b08000 0x55c1f9b75310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:46.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.377+0000 7fc6c2493740 4 client.15987 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:54:46.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.377+0000 7fc6c2493740 1 -- 172.21.15.19:0/1089249761 --> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c1f9a5ad70 con 0x55c1f9b08000 2024-09-19T08:54:46.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.378+0000 7fc6bde56640 1 --2- 172.21.15.19:0/1089249761 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55c1f9b08000 0x55c1f9b75310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:46.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.378+0000 7fc6bde56640 1 --2- 172.21.15.19:0/1089249761 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55c1f9b08000 0x55c1f9b75310 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e4f2265717a15720 server_cookie=242e1b758d61b8e0 in_seq=0 out_seq=0 2024-09-19T08:54:46.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.378+0000 7fc6a17fa640 10 client.15987 ms_handle_connect on v2:172.21.15.203:6838/2547507299 2024-09-19T08:54:46.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.378+0000 7fc6a17fa640 1 -- 172.21.15.19:0/1089249761 <== mds.1 v2:172.21.15.203:6838/2547507299 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c1f9a5ad70 con 0x55c1f9b08000 2024-09-19T08:54:46.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.378+0000 7fc6a17fa640 10 client.15987 handle_command_reply: tid=0 2024-09-19T08:54:46.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.378+0000 7fc6c2493740 1 client.15987 shutdown 2024-09-19T08:54:46.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.378+0000 7fc6c2493740 1 -- 172.21.15.19:0/1089249761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c1f9aeeb40 msgr2=0x55c1f9af2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:46.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.378+0000 7fc6c2493740 1 --2- 172.21.15.19:0/1089249761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c1f9aeeb40 0x55c1f9af2620 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8009900 tx=0x7fc6a8031980 comp rx=0 tx=0).stop 2024-09-19T08:54:46.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.379+0000 7fc6c2493740 1 -- 172.21.15.19:0/1089249761 shutdown_connections 2024-09-19T08:54:46.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.379+0000 7fc6c2493740 1 --2- 172.21.15.19:0/1089249761 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55c1f9b08000 0x55c1f9b75310 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.379+0000 7fc6c2493740 1 --2- 172.21.15.19:0/1089249761 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1f9af8370 0x55c1f9af2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.379+0000 7fc6c2493740 1 --2- 172.21.15.19:0/1089249761 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c1f9aeeb40 0x55c1f9af2620 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.379+0000 7fc6c2493740 1 --2- 172.21.15.19:0/1089249761 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c1f9aed5d0 0x55c1f9af20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.379+0000 7fc6a17fa640 0 client.15987 ms_handle_reset on v2:172.21.15.203:6838/2547507299 2024-09-19T08:54:46.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.379+0000 7fc6c2493740 1 -- 172.21.15.19:0/1089249761 >> 172.21.15.19:0/1089249761 conn(0x55c1f9ab6310 msgr2=0x55c1f9ae96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:46.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.379+0000 7fc6c2493740 1 -- 172.21.15.19:0/1089249761 shutdown_connections 2024-09-19T08:54:46.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.379+0000 7fc6c2493740 1 -- 172.21.15.19:0/1089249761 wait complete. 2024-09-19T08:54:46.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.379+0000 7fc6c2493740 20 client.15987 trim_cache size 0 max 16384 2024-09-19T08:54:46.386 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T08:54:46.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.379+0000 7fc6c00ba640 1 -- 172.21.15.19:0/2359600285 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc6a40a32c0 msgr2=0x7fc6a40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:46.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.379+0000 7fc6c00ba640 1 --2- 172.21.15.19:0/2359600285 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc6a40a32c0 0x7fc6a40a5780 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fc6b4009b40 tx=0x7fc6b4005e50 comp rx=0 tx=0).stop 2024-09-19T08:54:46.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.379+0000 7fc6c00ba640 1 -- 172.21.15.19:0/2359600285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6b810c170 msgr2=0x7fc6b81084c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:46.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.379+0000 7fc6c00ba640 1 --2- 172.21.15.19:0/2359600285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6b810c170 0x7fc6b81084c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fc6b000cad0 tx=0x7fc6b000cf90 comp rx=0 tx=0).stop 2024-09-19T08:54:46.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.379+0000 7fc6c00ba640 1 -- 172.21.15.19:0/2359600285 shutdown_connections 2024-09-19T08:54:46.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.379+0000 7fc6c00ba640 1 --2- 172.21.15.19:0/2359600285 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc6a40a32c0 0x7fc6a40a5780 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.379+0000 7fc6c00ba640 1 --2- 172.21.15.19:0/2359600285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc6b810c170 0x7fc6b81084c0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.379+0000 7fc6c00ba640 1 --2- 172.21.15.19:0/2359600285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc6b8103660 0x7fc6b810b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.379+0000 7fc6c00ba640 1 --2- 172.21.15.19:0/2359600285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6b8102d40 0x7fc6b810b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.379+0000 7fc6c00ba640 1 -- 172.21.15.19:0/2359600285 >> 172.21.15.19:0/2359600285 conn(0x7fc6b80fc7a0 msgr2=0x7fc6b80fe910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:46.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.379+0000 7fc6c00ba640 1 -- 172.21.15.19:0/2359600285 shutdown_connections 2024-09-19T08:54:46.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.379+0000 7fc6c00ba640 1 -- 172.21.15.19:0/2359600285 wait complete. 2024-09-19T08:54:46.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.568+0000 7f80c5117640 1 -- 172.21.15.19:0/3023122174 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f80c019bb30 con 0x7f80c0100100 2024-09-19T08:54:46.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.569+0000 7f80b7fff640 1 -- 172.21.15.19:0/3023122174 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11990 (secure 0 0 0) 0x7f80b809bde0 con 0x7f80c0100100 2024-09-19T08:54:46.570 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:54:46.570 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":30,"btime":"2024-09-19T08:53:40:359510+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2452068876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2452068876},{"type":"v1","addr":"172.21.15.19:6839","nonce":2452068876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T08:53:39.964693+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/2480841559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2480841559},{"type":"v1","addr":"172.21.15.155:6835","nonce":2480841559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24463,24464,24490,24469,24497]},"id":1}]} 2024-09-19T08:54:46.570 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 30 2024-09-19T08:54:46.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.571+0000 7f80c5117640 1 -- 172.21.15.19:0/3023122174 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f80ac0a3340 msgr2=0x7f80ac0a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:46.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.571+0000 7f80c5117640 1 --2- 172.21.15.19:0/3023122174 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f80ac0a3340 0x7f80ac0a5800 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f80c019b740 tx=0x7f80a8005a20 comp rx=0 tx=0).stop 2024-09-19T08:54:46.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.571+0000 7f80c5117640 1 -- 172.21.15.19:0/3023122174 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f80c0100100 msgr2=0x7f80c01a0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:46.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.571+0000 7f80c5117640 1 --2- 172.21.15.19:0/3023122174 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f80c0100100 0x7f80c01a0440 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f80b800b3f0 tx=0x7f80b800b8b0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.571+0000 7f80c5117640 1 -- 172.21.15.19:0/3023122174 shutdown_connections 2024-09-19T08:54:46.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.571+0000 7f80c5117640 1 --2- 172.21.15.19:0/3023122174 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f80ac0a3340 0x7f80ac0a5800 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.571+0000 7f80c5117640 1 --2- 172.21.15.19:0/3023122174 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f80c0106b80 0x7f80c019a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.571+0000 7f80c5117640 1 --2- 172.21.15.19:0/3023122174 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f80c0100aa0 0x7f80c01a0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.571+0000 7f80c5117640 1 --2- 172.21.15.19:0/3023122174 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f80c0100100 0x7f80c01a0440 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:46.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.571+0000 7f80c5117640 1 -- 172.21.15.19:0/3023122174 >> 172.21.15.19:0/3023122174 conn(0x7f80c0077230 msgr2=0x7f80c0104f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:46.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.571+0000 7f80c5117640 1 -- 172.21.15.19:0/3023122174 shutdown_connections 2024-09-19T08:54:46.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:46.572+0000 7f80c5117640 1 -- 172.21.15.19:0/3023122174 wait complete. 2024-09-19T08:54:47.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:47 smithi019 ceph-mon[30976]: pgmap v414: 97 pgs: 97 active+clean; 1017 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 5.7 KiB/s wr, 13 op/s 2024-09-19T08:54:47.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:47 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3023122174' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:47.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:47 smithi155 ceph-mon[34921]: pgmap v414: 97 pgs: 97 active+clean; 1017 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 5.7 KiB/s wr, 13 op/s 2024-09-19T08:54:47.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:47 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3023122174' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:47.450 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db --set-id be17fc49 --release --await' 2024-09-19T08:54:47.450 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db --set-id be17fc49 --release --await 2024-09-19T08:54:47.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:47 smithi203 ceph-mon[35450]: pgmap v414: 97 pgs: 97 active+clean; 1017 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 5.7 KiB/s wr, 13 op/s 2024-09-19T08:54:47.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:47 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3023122174' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:54:47.927 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:54:48.058 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:48.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.658+0000 7fd82c45f640 1 -- 172.21.15.19:0/2767805650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd824106f10 msgr2=0x7fd82410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:48.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.658+0000 7fd82c45f640 1 --2- 172.21.15.19:0/2767805650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd824106f10 0x7fd82410ea90 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fd81c009ca0 tx=0x7fd81c02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.658+0000 7fd82c45f640 1 -- 172.21.15.19:0/2767805650 shutdown_connections 2024-09-19T08:54:48.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.658+0000 7fd82c45f640 1 --2- 172.21.15.19:0/2767805650 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd824102790 0x7fd8241067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.658+0000 7fd82c45f640 1 --2- 172.21.15.19:0/2767805650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd824106f10 0x7fd82410ea90 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.658+0000 7fd82c45f640 1 --2- 172.21.15.19:0/2767805650 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd824101de0 0x7fd8241021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.658+0000 7fd82c45f640 1 -- 172.21.15.19:0/2767805650 >> 172.21.15.19:0/2767805650 conn(0x7fd8240fd880 msgr2=0x7fd8240ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:48.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.658+0000 7fd82c45f640 1 -- 172.21.15.19:0/2767805650 shutdown_connections 2024-09-19T08:54:48.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.658+0000 7fd82c45f640 1 -- 172.21.15.19:0/2767805650 wait complete. 2024-09-19T08:54:48.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.658+0000 7fd82c45f640 1 Processor -- start 2024-09-19T08:54:48.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.659+0000 7fd82c45f640 1 -- start start 2024-09-19T08:54:48.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.659+0000 7fd82c45f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd824101de0 0x7fd8240744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:48.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.659+0000 7fd82c45f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd824102790 0x7fd824074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:48.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.659+0000 7fd82c45f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd824106f10 0x7fd824074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:48.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.659+0000 7fd82c45f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd824111f70 con 0x7fd824106f10 2024-09-19T08:54:48.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.659+0000 7fd82c45f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd824111df0 con 0x7fd824101de0 2024-09-19T08:54:48.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.659+0000 7fd82c45f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd8241120f0 con 0x7fd824102790 2024-09-19T08:54:48.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.659+0000 7fd82a9fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd824106f10 0x7fd824074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:48.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.659+0000 7fd82a9fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd824106f10 0x7fd824074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52744/0 (socket says 172.21.15.19:52744) 2024-09-19T08:54:48.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.659+0000 7fd82a9fc640 1 -- 172.21.15.19:0/3596320861 learned_addr learned my addr 172.21.15.19:0/3596320861 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:48.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.659+0000 7fd8299fa640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd824102790 0x7fd824074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:48.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.659+0000 7fd82a1fb640 1 --2- 172.21.15.19:0/3596320861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd824101de0 0x7fd8240744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:48.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.659+0000 7fd82a9fc640 1 -- 172.21.15.19:0/3596320861 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd824102790 msgr2=0x7fd824074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:48.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.659+0000 7fd82a9fc640 1 --2- 172.21.15.19:0/3596320861 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd824102790 0x7fd824074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.659+0000 7fd82a9fc640 1 -- 172.21.15.19:0/3596320861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd824101de0 msgr2=0x7fd8240744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:48.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.659+0000 7fd82a9fc640 1 --2- 172.21.15.19:0/3596320861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd824101de0 0x7fd8240744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.660+0000 7fd82a9fc640 1 -- 172.21.15.19:0/3596320861 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8241a68d0 con 0x7fd824106f10 2024-09-19T08:54:48.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.660+0000 7fd82a9fc640 1 --2- 172.21.15.19:0/3596320861 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd824106f10 0x7fd824074f70 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd81c031a20 tx=0x7fd81c031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:48.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.660+0000 7fd81b7fe640 1 -- 172.21.15.19:0/3596320861 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81c003c30 con 0x7fd824106f10 2024-09-19T08:54:48.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.660+0000 7fd82c45f640 1 -- 172.21.15.19:0/3596320861 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8241a6b60 con 0x7fd824106f10 2024-09-19T08:54:48.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.660+0000 7fd81b7fe640 1 -- 172.21.15.19:0/3596320861 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd81c003dd0 con 0x7fd824106f10 2024-09-19T08:54:48.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.660+0000 7fd81b7fe640 1 -- 172.21.15.19:0/3596320861 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81c02fcf0 con 0x7fd824106f10 2024-09-19T08:54:48.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.660+0000 7fd82c45f640 1 -- 172.21.15.19:0/3596320861 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8241a70a0 con 0x7fd824106f10 2024-09-19T08:54:48.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.663+0000 7fd82e838740 1 Processor -- start 2024-09-19T08:54:48.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.663+0000 7fd81b7fe640 1 -- 172.21.15.19:0/3596320861 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fd81c004050 con 0x7fd824106f10 2024-09-19T08:54:48.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.663+0000 7fd82e838740 1 -- start start 2024-09-19T08:54:48.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.664+0000 7fd82e838740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0bfbaf060 0x55f0bfbaf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:48.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.664+0000 7fd82e838740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0bfbaf980 0x55f0bfbb9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:48.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.664+0000 7fd82e838740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0bfbba240 0x55f0bfbbc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:48.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.664+0000 7fd82e838740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f0bfb14620 con 0x55f0bfbba240 2024-09-19T08:54:48.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.664+0000 7fd82e838740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f0bfabbe50 con 0x55f0bfbaf060 2024-09-19T08:54:48.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.664+0000 7fd82e838740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f0bfb105e0 con 0x55f0bfbaf980 2024-09-19T08:54:48.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.664+0000 7fd82a1fb640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0bfbaf980 0x55f0bfbb9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:48.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.664+0000 7fd8299fa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0bfbba240 0x55f0bfbbc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:48.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.664+0000 7fd82a1fb640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0bfbaf980 0x55f0bfbb9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:54528/0 (socket says 172.21.15.19:54528) 2024-09-19T08:54:48.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.664+0000 7fd82a1fb640 1 -- 172.21.15.19:0/1283292677 learned_addr learned my addr 172.21.15.19:0/1283292677 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:48.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.664+0000 7fd81b7fe640 1 --2- 172.21.15.19:0/3596320861 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd8100a3240 0x7fd8100a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:48.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.664+0000 7fd82a1fb640 1 -- 172.21.15.19:0/1283292677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0bfbaf060 msgr2=0x55f0bfbaf440 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T08:54:48.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.664+0000 7fd82a1fb640 1 --2- 172.21.15.19:0/1283292677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0bfbaf060 0x55f0bfbaf440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.664+0000 7fd82a1fb640 1 -- 172.21.15.19:0/1283292677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0bfbba240 msgr2=0x55f0bfbbc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:48.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.664+0000 7fd82a1fb640 1 --2- 172.21.15.19:0/1283292677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0bfbba240 0x55f0bfbbc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.664+0000 7fd82a1fb640 1 -- 172.21.15.19:0/1283292677 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0bfaacd40 con 0x55f0bfbaf980 2024-09-19T08:54:48.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.664+0000 7fd8299fa640 1 --2- 172.21.15.19:0/1283292677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0bfbba240 0x55f0bfbbc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:54:48.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.664+0000 7fd81b7fe640 1 -- 172.21.15.19:0/3596320861 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd81c0f0db0 con 0x7fd824106f10 2024-09-19T08:54:48.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.664+0000 7fd82a9fc640 1 --2- 172.21.15.19:0/3596320861 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd8100a3240 0x7fd8100a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:48.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.665+0000 7fd82a1fb640 1 --2- 172.21.15.19:0/1283292677 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0bfbaf980 0x55f0bfbb9d00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd82000bd10 tx=0x7fd8200107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=128e227098b5dab4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:48.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.665+0000 7fd818dea640 1 -- 172.21.15.19:0/1283292677 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd820004030 con 0x55f0bfbaf980 2024-09-19T08:54:48.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.665+0000 7fd82a9fc640 1 --2- 172.21.15.19:0/3596320861 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd8100a3240 0x7fd8100a5700 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd81c0319f0 tx=0x7fd81c03d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:48.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.665+0000 7fd818dea640 1 -- 172.21.15.19:0/1283292677 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8200041d0 con 0x55f0bfbaf980 2024-09-19T08:54:48.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.665+0000 7fd818dea640 1 -- 172.21.15.19:0/1283292677 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd820011840 con 0x55f0bfbaf980 2024-09-19T08:54:48.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.666+0000 7fd82e838740 1 -- 172.21.15.19:0/1283292677 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0bfbaf980 msgr2=0x55f0bfbb9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:48.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.666+0000 7fd82e838740 1 --2- 172.21.15.19:0/1283292677 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0bfbaf980 0x55f0bfbb9d00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd82000bd10 tx=0x7fd8200107a0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.666+0000 7fd82e838740 1 -- 172.21.15.19:0/1283292677 shutdown_connections 2024-09-19T08:54:48.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.666+0000 7fd82e838740 1 --2- 172.21.15.19:0/1283292677 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0bfbaf980 0x55f0bfbb9d00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.666+0000 7fd82e838740 1 --2- 172.21.15.19:0/1283292677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0bfbba240 0x55f0bfbbc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.666+0000 7fd82e838740 1 --2- 172.21.15.19:0/1283292677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0bfbaf060 0x55f0bfbaf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.666+0000 7fd82e838740 1 -- 172.21.15.19:0/1283292677 >> 172.21.15.19:0/1283292677 conn(0x55f0bfbab5f0 msgr2=0x55f0bfbab9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:48.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.666+0000 7fd82e838740 1 -- 172.21.15.19:0/1283292677 shutdown_connections 2024-09-19T08:54:48.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.666+0000 7fd82e838740 1 -- 172.21.15.19:0/1283292677 wait complete. 2024-09-19T08:54:48.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.667+0000 7fd82e838740 1 -- start start 2024-09-19T08:54:48.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.667+0000 7fd82e838740 1 Processor -- start 2024-09-19T08:54:48.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.667+0000 7fd82e838740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0bfbaf060 0x55f0bfbb7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:48.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.668+0000 7fd82e838740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0bfbaf980 0x55f0bfbb7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:48.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.668+0000 7fd82e838740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0bfbba240 0x55f0bfbb7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:48.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.668+0000 7fd82e838740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f0bfbbce10 con 0x55f0bfbaf060 2024-09-19T08:54:48.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.668+0000 7fd82e838740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f0bfa9cf10 con 0x55f0bfbba240 2024-09-19T08:54:48.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.668+0000 7fd82e838740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f0bfbbcf90 con 0x55f0bfbaf980 2024-09-19T08:54:48.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.668+0000 7fd82e838740 10 client.0 _ll_register_callbacks cb 0x55f0bfac0db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:48.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.668+0000 7fd8299fa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0bfbaf060 0x55f0bfbb7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:48.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.668+0000 7fd8299fa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0bfbaf060 0x55f0bfbb7150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52768/0 (socket says 172.21.15.19:52768) 2024-09-19T08:54:48.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.668+0000 7fd8299fa640 1 -- 172.21.15.19:0/2936618654 learned_addr learned my addr 172.21.15.19:0/2936618654 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:48.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.668+0000 7fd82a1fb640 1 --2- 172.21.15.19:0/2936618654 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0bfbaf980 0x55f0bfbb7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:48.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.668+0000 7fd8299fa640 1 --2- 172.21.15.19:0/2936618654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0bfbba240 0x55f0bfbb7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:48.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.668+0000 7fd8299fa640 1 -- 172.21.15.19:0/2936618654 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0bfbaf980 msgr2=0x55f0bfbb7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:48.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.668+0000 7fd8299fa640 1 --2- 172.21.15.19:0/2936618654 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0bfbaf980 0x55f0bfbb7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.668+0000 7fd8299fa640 1 -- 172.21.15.19:0/2936618654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0bfbba240 msgr2=0x55f0bfbb7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:48.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.668+0000 7fd8299fa640 1 --2- 172.21.15.19:0/2936618654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0bfbba240 0x55f0bfbb7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.668+0000 7fd8299fa640 1 -- 172.21.15.19:0/2936618654 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0bf823580 con 0x55f0bfbaf060 2024-09-19T08:54:48.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.668+0000 7fd8299fa640 1 --2- 172.21.15.19:0/2936618654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0bfbaf060 0x55f0bfbb7150 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd81400bf10 tx=0x7fd8140042a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af37385e67d167bc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:48.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.668+0000 7fd80dffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:54:48.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.669+0000 7fd80dffb640 1 -- 172.21.15.19:0/2936618654 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd814005220 con 0x55f0bfbaf060 2024-09-19T08:54:48.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.669+0000 7fd80dffb640 1 -- 172.21.15.19:0/2936618654 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd8140053c0 con 0x55f0bfbaf060 2024-09-19T08:54:48.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.669+0000 7fd82e838740 1 -- 172.21.15.19:0/2936618654 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8200041d0 con 0x55f0bfbaf060 2024-09-19T08:54:48.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.669+0000 7fd80dffb640 1 -- 172.21.15.19:0/2936618654 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd8140055c0 con 0x55f0bfbaf060 2024-09-19T08:54:48.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.669+0000 7fd82e838740 10 client.15999 fetch_fsmap learned FSMap version 30 2024-09-19T08:54:48.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.669+0000 7fd82e838740 1 -- 172.21.15.19:0/2936618654 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f0bf8ed960 con 0x55f0bfbaf060 2024-09-19T08:54:48.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.669+0000 7fd80dffb640 1 -- 172.21.15.19:0/2936618654 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd8200041d0 con 0x55f0bfbaf060 2024-09-19T08:54:48.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.669+0000 7fd80dffb640 1 -- 172.21.15.19:0/2936618654 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fd81401e020 con 0x55f0bfbaf060 2024-09-19T08:54:48.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.670+0000 7fd82e838740 10 client.15999 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T08:54:48.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.670+0000 7fd82e838740 10 client.15999 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T08:54:48.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.670+0000 7fd82e838740 20 client.15999 populate_metadata read hostname 'smithi019' 2024-09-19T08:54:48.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.670+0000 7fd82e838740 1 --2- 172.21.15.19:0/2936618654 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55f0bfbc9ef0 0x55f0bfbcc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:48.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.670+0000 7fd82e838740 4 client.15999 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:54:48.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.670+0000 7fd82e838740 1 -- 172.21.15.19:0/2936618654 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f0bfb21b90 con 0x55f0bfbc9ef0 2024-09-19T08:54:48.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.670+0000 7fd82a1fb640 1 --2- 172.21.15.19:0/2936618654 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55f0bfbc9ef0 0x55f0bfbcc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:48.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.670+0000 7fd80dffb640 10 client.15999 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:54:48.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.670+0000 7fd82a1fb640 1 --2- 172.21.15.19:0/2936618654 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55f0bfbc9ef0 0x55f0bfbcc2e0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7153829c7e389b9 server_cookie=b04bcd9f4024d0a2 in_seq=0 out_seq=0 2024-09-19T08:54:48.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.671+0000 7fd80dffb640 1 -- 172.21.15.19:0/2936618654 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f0bfb21b90 con 0x55f0bfbc9ef0 2024-09-19T08:54:48.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.671+0000 7fd80dffb640 10 client.15999 handle_command_reply: tid=0 2024-09-19T08:54:48.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.671+0000 7fd82e838740 1 client.15999 shutdown 2024-09-19T08:54:48.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.671+0000 7fd82e838740 1 -- 172.21.15.19:0/2936618654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0bfbaf060 msgr2=0x55f0bfbb7150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:48.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.671+0000 7fd82e838740 1 --2- 172.21.15.19:0/2936618654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0bfbaf060 0x55f0bfbb7150 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd81400bf10 tx=0x7fd8140042a0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.671+0000 7fd82e838740 1 -- 172.21.15.19:0/2936618654 shutdown_connections 2024-09-19T08:54:48.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.672+0000 7fd82e838740 1 --2- 172.21.15.19:0/2936618654 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55f0bfbc9ef0 0x55f0bfbcc2e0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.672+0000 7fd82e838740 1 --2- 172.21.15.19:0/2936618654 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0bfbaf980 0x55f0bfbb7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.672+0000 7fd82e838740 1 --2- 172.21.15.19:0/2936618654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0bfbba240 0x55f0bfbb7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.672+0000 7fd80dffb640 0 client.15999 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:54:48.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.672+0000 7fd82e838740 1 --2- 172.21.15.19:0/2936618654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0bfbaf060 0x55f0bfbb7150 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.672+0000 7fd82e838740 1 -- 172.21.15.19:0/2936618654 >> 172.21.15.19:0/2936618654 conn(0x55f0bfbab5f0 msgr2=0x55f0bfbb12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:48.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.672+0000 7fd82e838740 1 -- 172.21.15.19:0/2936618654 shutdown_connections 2024-09-19T08:54:48.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.672+0000 7fd82e838740 1 -- 172.21.15.19:0/2936618654 wait complete. 2024-09-19T08:54:48.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.672+0000 7fd82e838740 20 client.15999 trim_cache size 0 max 16384 2024-09-19T08:54:48.678 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:54:48.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.690+0000 7fd82e838740 1 Processor -- start 2024-09-19T08:54:48.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.690+0000 7fd82e838740 1 -- start start 2024-09-19T08:54:48.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.690+0000 7fd82e838740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0bfbaf060 0x55f0bfbb7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:48.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.690+0000 7fd82e838740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0bfbaf980 0x55f0bfbb7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:48.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.690+0000 7fd82e838740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0bfbba240 0x55f0bfbd1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:48.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.690+0000 7fd82e838740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd8241af780 con 0x55f0bfbaf060 2024-09-19T08:54:48.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.690+0000 7fd82e838740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd8241b1380 con 0x55f0bfbba240 2024-09-19T08:54:48.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.690+0000 7fd82e838740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd8241afe50 con 0x55f0bfbaf980 2024-09-19T08:54:48.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.690+0000 7fd8299fa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0bfbaf060 0x55f0bfbb7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:48.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.690+0000 7fd8299fa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0bfbaf060 0x55f0bfbb7820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52774/0 (socket says 172.21.15.19:52774) 2024-09-19T08:54:48.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.690+0000 7fd8299fa640 1 -- 172.21.15.19:0/2046119926 learned_addr learned my addr 172.21.15.19:0/2046119926 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:48.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.691+0000 7fd82a1fb640 1 --2- 172.21.15.19:0/2046119926 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0bfbaf980 0x55f0bfbb7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:48.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.691+0000 7fd8299fa640 1 --2- 172.21.15.19:0/2046119926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0bfbba240 0x55f0bfbd1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:48.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.691+0000 7fd8299fa640 1 -- 172.21.15.19:0/2046119926 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0bfbaf980 msgr2=0x55f0bfbb7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:48.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.691+0000 7fd8299fa640 1 --2- 172.21.15.19:0/2046119926 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0bfbaf980 0x55f0bfbb7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.691+0000 7fd8299fa640 1 -- 172.21.15.19:0/2046119926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0bfbba240 msgr2=0x55f0bfbd1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:48.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.691+0000 7fd8299fa640 1 --2- 172.21.15.19:0/2046119926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0bfbba240 0x55f0bfbd1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.691+0000 7fd8299fa640 1 -- 172.21.15.19:0/2046119926 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0bfbac280 con 0x55f0bfbaf060 2024-09-19T08:54:48.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.691+0000 7fd8299fa640 1 --2- 172.21.15.19:0/2046119926 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0bfbaf060 0x55f0bfbb7820 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd814011cd0 tx=0x7fd814001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27d4645b32c03f75 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:48.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.691+0000 7fd80ffff640 1 -- 172.21.15.19:0/2046119926 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81402d450 con 0x55f0bfbaf060 2024-09-19T08:54:48.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.691+0000 7fd80ffff640 1 -- 172.21.15.19:0/2046119926 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd81401b040 con 0x55f0bfbaf060 2024-09-19T08:54:48.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.691+0000 7fd80ffff640 1 -- 172.21.15.19:0/2046119926 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81402c6a0 con 0x55f0bfbaf060 2024-09-19T08:54:48.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.692+0000 7fd82e838740 1 -- 172.21.15.19:0/2046119926 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0bfbaf060 msgr2=0x55f0bfbb7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:48.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.692+0000 7fd82e838740 1 --2- 172.21.15.19:0/2046119926 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0bfbaf060 0x55f0bfbb7820 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fd814011cd0 tx=0x7fd814001e50 comp rx=0 tx=0).stop 2024-09-19T08:54:48.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.693+0000 7fd82e838740 1 -- 172.21.15.19:0/2046119926 shutdown_connections 2024-09-19T08:54:48.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.693+0000 7fd82e838740 1 --2- 172.21.15.19:0/2046119926 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0bfbaf980 0x55f0bfbb7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.693+0000 7fd82e838740 1 --2- 172.21.15.19:0/2046119926 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0bfbba240 0x55f0bfbd1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.693+0000 7fd82e838740 1 --2- 172.21.15.19:0/2046119926 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0bfbaf060 0x55f0bfbb7820 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.693+0000 7fd82e838740 1 -- 172.21.15.19:0/2046119926 >> 172.21.15.19:0/2046119926 conn(0x55f0bfbab5f0 msgr2=0x55f0bfbb7110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:48.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.693+0000 7fd82e838740 1 -- 172.21.15.19:0/2046119926 shutdown_connections 2024-09-19T08:54:48.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.693+0000 7fd82e838740 1 -- 172.21.15.19:0/2046119926 wait complete. 2024-09-19T08:54:48.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.693+0000 7fd82e838740 1 -- start start 2024-09-19T08:54:48.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.693+0000 7fd82e838740 1 Processor -- start 2024-09-19T08:54:48.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.694+0000 7fd82e838740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0bfbaf060 0x55f0bfbc2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:48.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.694+0000 7fd82e838740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0bfbaf980 0x55f0bfbc2780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:48.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.694+0000 7fd82e838740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0bfbba240 0x55f0bfbbf210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:48.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.694+0000 7fd8299fa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0bfbaf060 0x55f0bfbc2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:48.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.694+0000 7fd82e838740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd8241b0bf0 con 0x55f0bfbaf060 2024-09-19T08:54:48.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.694+0000 7fd82e838740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd8241b0520 con 0x55f0bfbaf980 2024-09-19T08:54:48.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.694+0000 7fd82e838740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd8241ad760 con 0x55f0bfbba240 2024-09-19T08:54:48.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.694+0000 7fd8299fa640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0bfbaf060 0x55f0bfbc2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52780/0 (socket says 172.21.15.19:52780) 2024-09-19T08:54:48.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.694+0000 7fd8299fa640 1 -- 172.21.15.19:0/2961067111 learned_addr learned my addr 172.21.15.19:0/2961067111 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:48.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.694+0000 7fd82e838740 10 client.0 _ll_register_callbacks cb 0x7fd81400baa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:48.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.694+0000 7fd82a1fb640 1 --2- 172.21.15.19:0/2961067111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0bfbaf980 0x55f0bfbc2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:48.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.694+0000 7fd8299fa640 1 -- 172.21.15.19:0/2961067111 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0bfbba240 msgr2=0x55f0bfbbf210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T08:54:48.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.694+0000 7fd8299fa640 1 --2- 172.21.15.19:0/2961067111 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0bfbba240 0x55f0bfbbf210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.694+0000 7fd8299fa640 1 -- 172.21.15.19:0/2961067111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0bfbaf980 msgr2=0x55f0bfbc2780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:48.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.694+0000 7fd8299fa640 1 --2- 172.21.15.19:0/2961067111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0bfbaf980 0x55f0bfbc2780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.694+0000 7fd8299fa640 1 -- 172.21.15.19:0/2961067111 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0bfbbf750 con 0x55f0bfbaf060 2024-09-19T08:54:48.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.695+0000 7fd8299fa640 1 --2- 172.21.15.19:0/2961067111 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0bfbaf060 0x55f0bfbc2240 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fd814004420 tx=0x7fd814011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e4557db5c016ab6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:48.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.695+0000 7fd80dffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:54:48.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.695+0000 7fd80dffb640 1 -- 172.21.15.19:0/2961067111 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd814005020 con 0x55f0bfbaf060 2024-09-19T08:54:48.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.695+0000 7fd80dffb640 1 -- 172.21.15.19:0/2961067111 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd8140051c0 con 0x55f0bfbaf060 2024-09-19T08:54:48.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.695+0000 7fd82e838740 1 -- 172.21.15.19:0/2961067111 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd81401b040 con 0x55f0bfbaf060 2024-09-19T08:54:48.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.695+0000 7fd80dffb640 1 -- 172.21.15.19:0/2961067111 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd8140053c0 con 0x55f0bfbaf060 2024-09-19T08:54:48.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.695+0000 7fd82e838740 10 client.16005 fetch_fsmap learned FSMap version 30 2024-09-19T08:54:48.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.695+0000 7fd82e838740 1 -- 172.21.15.19:0/2961067111 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f0bfc35210 con 0x55f0bfbaf060 2024-09-19T08:54:48.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.696+0000 7fd80dffb640 1 -- 172.21.15.19:0/2961067111 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd81401b040 con 0x55f0bfbaf060 2024-09-19T08:54:48.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.696+0000 7fd80dffb640 1 -- 172.21.15.19:0/2961067111 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fd81401e050 con 0x55f0bfbaf060 2024-09-19T08:54:48.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.696+0000 7fd82e838740 10 client.16005 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T08:54:48.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.696+0000 7fd82e838740 10 client.16005 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T08:54:48.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.696+0000 7fd82e838740 20 client.16005 populate_metadata read hostname 'smithi019' 2024-09-19T08:54:48.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.696+0000 7fd82e838740 1 --2- 172.21.15.19:0/2961067111 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55f0bfc35890 0x55f0bfc37cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:48.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.696+0000 7fd82e838740 4 client.16005 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "be17fc49", "release": true, "await": true}] 2024-09-19T08:54:48.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.696+0000 7fd82e838740 1 -- 172.21.15.19:0/2961067111 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "quiesce db", "set_id": "be17fc49", "release": true, "await": true}) -- 0x55f0bfb1c0a0 con 0x55f0bfc35890 2024-09-19T08:54:48.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.696+0000 7fd82a1fb640 1 --2- 172.21.15.19:0/2961067111 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55f0bfc35890 0x55f0bfc37cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:48.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.697+0000 7fd82a1fb640 1 --2- 172.21.15.19:0/2961067111 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55f0bfc35890 0x55f0bfc37cb0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3077be1048e01749 server_cookie=b3817e3ea70b3ee2 in_seq=0 out_seq=0 2024-09-19T08:54:48.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.697+0000 7fd80dffb640 10 client.16005 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:54:48.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.699+0000 7fd80dffb640 1 -- 172.21.15.19:0/2961067111 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55f0bfb1c0a0 con 0x55f0bfc35890 2024-09-19T08:54:48.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.699+0000 7fd80dffb640 10 client.16005 handle_command_reply: tid=0 2024-09-19T08:54:48.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.699+0000 7fd82e838740 1 client.16005 shutdown 2024-09-19T08:54:48.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.700+0000 7fd82e838740 1 -- 172.21.15.19:0/2961067111 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0bfbaf060 msgr2=0x55f0bfbc2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:48.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.700+0000 7fd82e838740 1 --2- 172.21.15.19:0/2961067111 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0bfbaf060 0x55f0bfbc2240 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fd814004420 tx=0x7fd814011b60 comp rx=0 tx=0).stop 2024-09-19T08:54:48.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.700+0000 7fd82e838740 1 -- 172.21.15.19:0/2961067111 shutdown_connections 2024-09-19T08:54:48.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.700+0000 7fd82e838740 1 --2- 172.21.15.19:0/2961067111 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55f0bfc35890 0x55f0bfc37cb0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.700+0000 7fd82e838740 1 --2- 172.21.15.19:0/2961067111 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0bfbba240 0x55f0bfbbf210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.700+0000 7fd82e838740 1 --2- 172.21.15.19:0/2961067111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0bfbaf980 0x55f0bfbc2780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.700+0000 7fd82e838740 1 --2- 172.21.15.19:0/2961067111 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0bfbaf060 0x55f0bfbc2240 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.700+0000 7fd82e838740 1 -- 172.21.15.19:0/2961067111 >> 172.21.15.19:0/2961067111 conn(0x55f0bfbab5f0 msgr2=0x55f0bfbb70f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:48.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.700+0000 7fd80dffb640 0 client.16005 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:54:48.701 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:48.702 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:48.702 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 34 -lt 100 ']' 2024-09-19T08:54:48.702 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:54:48.702 INFO:teuthology.orchestra.run.smithi019.stdout: "epoch": 30, 2024-09-19T08:54:48.702 INFO:teuthology.orchestra.run.smithi019.stdout: "leader": 24497, 2024-09-19T08:54:48.702 INFO:teuthology.orchestra.run.smithi019.stdout: "set_version": 12, 2024-09-19T08:54:48.702 INFO:teuthology.orchestra.run.smithi019.stdout: "sets": { 2024-09-19T08:54:48.702 INFO:teuthology.orchestra.run.smithi019.stdout: "be17fc49": { 2024-09-19T08:54:48.702 INFO:teuthology.orchestra.run.smithi019.stdout: "version": 12, 2024-09-19T08:54:48.702 INFO:teuthology.orchestra.run.smithi019.stdout: "age_ref": 0.0, 2024-09-19T08:54:48.703 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T08:54:48.703 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RELEASED", 2024-09-19T08:54:48.703 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T08:54:48.703 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T08:54:48.703 INFO:teuthology.orchestra.run.smithi019.stdout: "timeout": 90.0, 2024-09-19T08:54:48.703 INFO:teuthology.orchestra.run.smithi019.stdout: "expiration": 140.3, 2024-09-19T08:54:48.703 INFO:teuthology.orchestra.run.smithi019.stdout: "members": { 2024-09-19T08:54:48.703 INFO:teuthology.orchestra.run.smithi019.stdout: "file:/": { 2024-09-19T08:54:48.703 INFO:teuthology.orchestra.run.smithi019.stdout: "excluded": false, 2024-09-19T08:54:48.703 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T08:54:48.703 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RELEASED", 2024-09-19T08:54:48.703 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T08:54:48.703 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:54:48.703 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:54:48.704 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:54:48.704 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:54:48.704 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:54:48.704 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:54:48.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.700+0000 7fd82e838740 1 -- 172.21.15.19:0/2961067111 shutdown_connections 2024-09-19T08:54:48.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.700+0000 7fd82e838740 1 -- 172.21.15.19:0/2961067111 wait complete. 2024-09-19T08:54:48.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.700+0000 7fd82e838740 20 client.16005 trim_cache size 0 max 16384 2024-09-19T08:54:48.705 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 34 + 1 2024-09-19T08:54:48.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.701+0000 7fd82c45f640 1 -- 172.21.15.19:0/3596320861 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd8100a3240 msgr2=0x7fd8100a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:48.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.701+0000 7fd82c45f640 1 --2- 172.21.15.19:0/3596320861 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd8100a3240 0x7fd8100a5700 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd81c0319f0 tx=0x7fd81c03d040 comp rx=0 tx=0).stop 2024-09-19T08:54:48.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.701+0000 7fd82c45f640 1 -- 172.21.15.19:0/3596320861 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd824106f10 msgr2=0x7fd824074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:48.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.701+0000 7fd82c45f640 1 --2- 172.21.15.19:0/3596320861 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd824106f10 0x7fd824074f70 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd81c031a20 tx=0x7fd81c031a50 comp rx=0 tx=0).stop 2024-09-19T08:54:48.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.701+0000 7fd82c45f640 1 -- 172.21.15.19:0/3596320861 shutdown_connections 2024-09-19T08:54:48.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.701+0000 7fd82c45f640 1 --2- 172.21.15.19:0/3596320861 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd8100a3240 0x7fd8100a5700 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.701+0000 7fd82c45f640 1 --2- 172.21.15.19:0/3596320861 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd824102790 0x7fd824074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.701+0000 7fd82c45f640 1 --2- 172.21.15.19:0/3596320861 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd824106f10 0x7fd824074f70 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.701+0000 7fd82c45f640 1 --2- 172.21.15.19:0/3596320861 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd824101de0 0x7fd8240744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:48.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.701+0000 7fd82c45f640 1 -- 172.21.15.19:0/3596320861 >> 172.21.15.19:0/3596320861 conn(0x7fd8240fd880 msgr2=0x7fd8240feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:48.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.701+0000 7fd82c45f640 1 -- 172.21.15.19:0/3596320861 shutdown_connections 2024-09-19T08:54:48.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:48.701+0000 7fd82c45f640 1 -- 172.21.15.19:0/3596320861 wait complete. 2024-09-19T08:54:48.790 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=35 2024-09-19T08:54:48.791 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:48.827 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:48.827 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:48.828 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:48.828 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:48.828 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:49.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:49 smithi019 ceph-mon[30976]: pgmap v415: 97 pgs: 97 active+clean; 1019 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.9 KiB/s wr, 12 op/s 2024-09-19T08:54:49.148 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:49.148 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:49.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:49 smithi155 ceph-mon[34921]: pgmap v415: 97 pgs: 97 active+clean; 1019 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.9 KiB/s wr, 12 op/s 2024-09-19T08:54:49.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:49 smithi203 ceph-mon[35450]: pgmap v415: 97 pgs: 97 active+clean; 1019 KiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.9 KiB/s wr, 12 op/s 2024-09-19T08:54:49.628 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:49.628 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:49.654 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:49.654 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:49.654 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 35 -lt 100 ']' 2024-09-19T08:54:49.654 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 35 + 1 2024-09-19T08:54:49.705 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=36 2024-09-19T08:54:49.706 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:49.717 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:49.717 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:49.719 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:49.719 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:49.719 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:50.649 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:50.649 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:50.896 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'be17fc49', total seconds elapsed: 50.4 2024-09-19T08:54:50.993 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:50.993 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:51.020 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:51.020 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:51.020 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 36 -lt 100 ']' 2024-09-19T08:54:51.020 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 36 + 1 2024-09-19T08:54:51.063 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=37 2024-09-19T08:54:51.063 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:51.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:51 smithi019 ceph-mon[30976]: pgmap v416: 97 pgs: 97 active+clean; 1.0 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 4.6 KiB/s wr, 14 op/s 2024-09-19T08:54:51.105 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:51.106 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:51.106 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:51.106 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:51.106 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:51.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:51 smithi155 ceph-mon[34921]: pgmap v416: 97 pgs: 97 active+clean; 1.0 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 4.6 KiB/s wr, 14 op/s 2024-09-19T08:54:51.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:51 smithi203 ceph-mon[35450]: pgmap v416: 97 pgs: 97 active+clean; 1.0 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 4.6 KiB/s wr, 14 op/s 2024-09-19T08:54:51.756 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:51.756 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:51.952 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:51.952 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:51.965 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:51.965 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:51.965 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 37 -lt 100 ']' 2024-09-19T08:54:51.966 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 37 + 1 2024-09-19T08:54:52.030 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=38 2024-09-19T08:54:52.030 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:52.076 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:52.077 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:52.078 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:52.078 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:52.078 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:52.244 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:52.244 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:52.277 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:52.277 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:52.279 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:52.279 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:52.279 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 38 -lt 100 ']' 2024-09-19T08:54:52.279 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 38 + 1 2024-09-19T08:54:52.283 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=39 2024-09-19T08:54:52.283 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:52.288 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:52.288 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:52.289 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:52.289 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:52.290 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:52.354 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:52.355 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:52.371 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:52.371 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:52.374 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:52.374 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:52.374 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 39 -lt 100 ']' 2024-09-19T08:54:52.374 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 39 + 1 2024-09-19T08:54:52.377 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=40 2024-09-19T08:54:52.377 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:52.385 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:52.385 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:52.386 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:52.386 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:52.386 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:52.488 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:52.488 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:52.504 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:52.504 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:52.507 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:52.507 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:52.507 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 40 -lt 100 ']' 2024-09-19T08:54:52.508 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 40 + 1 2024-09-19T08:54:52.510 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=41 2024-09-19T08:54:52.511 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:52.515 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:52.515 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:52.516 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:52.517 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:52.517 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:52.625 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:52.625 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:52.636 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:52.636 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:52.639 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:52.639 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:52.639 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 41 -lt 100 ']' 2024-09-19T08:54:52.639 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 41 + 1 2024-09-19T08:54:52.649 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=42 2024-09-19T08:54:52.650 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:52.656 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:52.656 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:52.658 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:52.658 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:52.658 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:52.757 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:52.757 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:52.780 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:52.780 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:52.784 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:52.784 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:52.784 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 42 -lt 100 ']' 2024-09-19T08:54:52.784 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 42 + 1 2024-09-19T08:54:52.789 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=43 2024-09-19T08:54:52.789 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:52.805 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:52.806 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:52.806 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:52.806 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:52.806 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:52.884 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:52.884 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:52.922 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:52.922 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:52.926 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:52.926 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:52.926 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 43 -lt 100 ']' 2024-09-19T08:54:52.926 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 43 + 1 2024-09-19T08:54:52.933 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=44 2024-09-19T08:54:52.933 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:52.941 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:52.941 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:52.941 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:52.941 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:52.941 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:53.045 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:53.045 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:53.105 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:53.105 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:53.108 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:53.108 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:53.108 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 44 -lt 100 ']' 2024-09-19T08:54:53.108 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 44 + 1 2024-09-19T08:54:53.111 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=45 2024-09-19T08:54:53.111 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:53.114 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:53.114 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:53.115 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:53.115 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:53.115 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:53.234 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:53.234 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:53.261 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:53.261 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:53.264 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:53.264 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:53.265 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 45 -lt 100 ']' 2024-09-19T08:54:53.265 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 45 + 1 2024-09-19T08:54:53.272 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=46 2024-09-19T08:54:53.273 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:53.288 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:53.288 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:53.289 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:53.289 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:53.290 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:53.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:53 smithi019 ceph-mon[30976]: pgmap v417: 97 pgs: 97 active+clean; 1.0 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.8 KiB/s wr, 13 op/s 2024-09-19T08:54:53.350 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:53.350 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:53.361 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:53.361 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:53.365 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:53.365 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:53.365 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 46 -lt 100 ']' 2024-09-19T08:54:53.365 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 46 + 1 2024-09-19T08:54:53.371 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=47 2024-09-19T08:54:53.371 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:53.376 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:53.376 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:53.377 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:53.377 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:53.377 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:53.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:53 smithi155 ceph-mon[34921]: pgmap v417: 97 pgs: 97 active+clean; 1.0 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.8 KiB/s wr, 13 op/s 2024-09-19T08:54:53.465 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:53.465 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:53.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:53 smithi203 ceph-mon[35450]: pgmap v417: 97 pgs: 97 active+clean; 1.0 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.8 KiB/s wr, 13 op/s 2024-09-19T08:54:53.488 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:53.488 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:53.490 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:53.491 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:53.491 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 47 -lt 100 ']' 2024-09-19T08:54:53.491 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 47 + 1 2024-09-19T08:54:53.493 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=48 2024-09-19T08:54:53.493 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:53.500 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:53.500 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:53.502 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:53.502 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:53.502 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:53.585 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:53.586 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:53.598 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:53.598 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:53.601 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:53.602 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:53.602 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 48 -lt 100 ']' 2024-09-19T08:54:53.602 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 48 + 1 2024-09-19T08:54:53.609 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=49 2024-09-19T08:54:53.609 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:53.617 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:53.617 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:53.618 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:53.618 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:53.619 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:53.864 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:53.864 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:53.901 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:53.901 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:53.905 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:53.905 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:53.905 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 49 -lt 100 ']' 2024-09-19T08:54:53.905 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 49 + 1 2024-09-19T08:54:53.911 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=50 2024-09-19T08:54:53.911 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:53.915 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:53.915 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:53.916 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:53.916 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:53.916 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:54.045 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:54.045 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:54.059 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:54.059 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:54.064 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:54.064 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:54.065 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 50 -lt 100 ']' 2024-09-19T08:54:54.065 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 50 + 1 2024-09-19T08:54:54.076 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=51 2024-09-19T08:54:54.076 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:54.082 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:54.082 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:54.083 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:54.083 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:54.084 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:54.171 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:54.171 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:54.259 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:54.259 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:54.262 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:54.262 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:54.262 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 51 -lt 100 ']' 2024-09-19T08:54:54.262 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 51 + 1 2024-09-19T08:54:54.267 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=52 2024-09-19T08:54:54.267 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:54.273 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:54.274 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:54.275 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:54.275 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:54.275 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:54.385 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:54.385 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:54.431 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:54.431 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:54.434 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:54.434 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:54.434 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 52 -lt 100 ']' 2024-09-19T08:54:54.434 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 52 + 1 2024-09-19T08:54:54.441 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=53 2024-09-19T08:54:54.441 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:54.444 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:54.444 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:54.446 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:54.446 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:54.446 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:54.533 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:54.534 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:54.548 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:54.548 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:54.553 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:54.553 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:54.553 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 53 -lt 100 ']' 2024-09-19T08:54:54.553 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 53 + 1 2024-09-19T08:54:54.572 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=54 2024-09-19T08:54:54.572 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:54.577 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:54.578 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:54.579 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:54.579 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:54.579 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:54.637 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:54.637 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:54.677 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:54.677 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:54.680 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:54.680 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:54.681 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 54 -lt 100 ']' 2024-09-19T08:54:54.681 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 54 + 1 2024-09-19T08:54:54.690 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=55 2024-09-19T08:54:54.690 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:54.696 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:54.696 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:54.697 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:54.697 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:54.697 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:54.809 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:54.809 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:54.924 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:54.924 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:54.957 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:54.957 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:54.957 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 55 -lt 100 ']' 2024-09-19T08:54:54.957 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 55 + 1 2024-09-19T08:54:55.063 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=56 2024-09-19T08:54:55.063 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:55.115 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:55.116 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:55.116 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:55.117 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:55.117 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:55.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:55 smithi019 ceph-mon[30976]: pgmap v418: 97 pgs: 97 active+clean; 1.0 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.6 KiB/s wr, 14 op/s 2024-09-19T08:54:55.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.366+0000 7ff579de7640 1 -- 172.21.15.19:0/4187139378 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff574102790 msgr2=0x7ff5741067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:55.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.366+0000 7ff579de7640 1 --2- 172.21.15.19:0/4187139378 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff574102790 0x7ff5741067e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ff55c009900 tx=0x7ff55c02a410 comp rx=0 tx=0).stop 2024-09-19T08:54:55.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.366+0000 7ff579de7640 1 -- 172.21.15.19:0/4187139378 shutdown_connections 2024-09-19T08:54:55.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.366+0000 7ff579de7640 1 --2- 172.21.15.19:0/4187139378 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff574106f10 0x7ff57410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.366+0000 7ff579de7640 1 --2- 172.21.15.19:0/4187139378 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff574102790 0x7ff5741067e0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.366+0000 7ff579de7640 1 --2- 172.21.15.19:0/4187139378 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff574101de0 0x7ff5741021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.366+0000 7ff579de7640 1 -- 172.21.15.19:0/4187139378 >> 172.21.15.19:0/4187139378 conn(0x7ff5740fd8c0 msgr2=0x7ff5740ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:55.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.366+0000 7ff579de7640 1 -- 172.21.15.19:0/4187139378 shutdown_connections 2024-09-19T08:54:55.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.366+0000 7ff579de7640 1 -- 172.21.15.19:0/4187139378 wait complete. 2024-09-19T08:54:55.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.367+0000 7ff579de7640 1 Processor -- start 2024-09-19T08:54:55.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.367+0000 7ff579de7640 1 -- start start 2024-09-19T08:54:55.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.367+0000 7ff579de7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff574101de0 0x7ff5740744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:55.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.367+0000 7ff579de7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff574102790 0x7ff574074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:55.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.367+0000 7ff579de7640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff574106f10 0x7ff574074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:55.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.367+0000 7ff579de7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff574111f90 con 0x7ff574102790 2024-09-19T08:54:55.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.367+0000 7ff579de7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff574111e10 con 0x7ff574101de0 2024-09-19T08:54:55.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.367+0000 7ff579de7640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff574112110 con 0x7ff574106f10 2024-09-19T08:54:55.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.367+0000 7ff56affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff574102790 0x7ff574074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:55.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.367+0000 7ff56affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff574102790 0x7ff574074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52278/0 (socket says 172.21.15.19:52278) 2024-09-19T08:54:55.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.367+0000 7ff56affd640 1 -- 172.21.15.19:0/1598497593 learned_addr learned my addr 172.21.15.19:0/1598497593 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:55.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.367+0000 7ff5737fe640 1 --2- 172.21.15.19:0/1598497593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff574101de0 0x7ff5740744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:55.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.368+0000 7ff573fff640 1 --2- 172.21.15.19:0/1598497593 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff574106f10 0x7ff574074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:55.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.368+0000 7ff56affd640 1 -- 172.21.15.19:0/1598497593 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff574106f10 msgr2=0x7ff574074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:55.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.368+0000 7ff56affd640 1 --2- 172.21.15.19:0/1598497593 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff574106f10 0x7ff574074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.368+0000 7ff56affd640 1 -- 172.21.15.19:0/1598497593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff574101de0 msgr2=0x7ff5740744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:55.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.368+0000 7ff56affd640 1 --2- 172.21.15.19:0/1598497593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff574101de0 0x7ff5740744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.368+0000 7ff56affd640 1 -- 172.21.15.19:0/1598497593 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5741a68b0 con 0x7ff574102790 2024-09-19T08:54:55.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.368+0000 7ff573fff640 1 --2- 172.21.15.19:0/1598497593 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff574106f10 0x7ff574074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:55.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.368+0000 7ff56affd640 1 --2- 172.21.15.19:0/1598497593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff574102790 0x7ff574074a30 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7ff55c005ab0 tx=0x7ff55c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:55.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.368+0000 7ff5717fa640 1 -- 172.21.15.19:0/1598497593 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55c03f030 con 0x7ff574102790 2024-09-19T08:54:55.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.368+0000 7ff579de7640 1 -- 172.21.15.19:0/1598497593 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5741a6b40 con 0x7ff574102790 2024-09-19T08:54:55.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.368+0000 7ff5717fa640 1 -- 172.21.15.19:0/1598497593 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff55c003ce0 con 0x7ff574102790 2024-09-19T08:54:55.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.368+0000 7ff5717fa640 1 -- 172.21.15.19:0/1598497593 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff55c035070 con 0x7ff574102790 2024-09-19T08:54:55.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.368+0000 7ff579de7640 1 -- 172.21.15.19:0/1598497593 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5741a7020 con 0x7ff574102790 2024-09-19T08:54:55.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.370+0000 7ff5717fa640 1 -- 172.21.15.19:0/1598497593 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7ff55c042030 con 0x7ff574102790 2024-09-19T08:54:55.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.371+0000 7ff5717fa640 1 --2- 172.21.15.19:0/1598497593 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff5600a3240 0x7ff5600a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:55.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.371+0000 7ff5737fe640 1 --2- 172.21.15.19:0/1598497593 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff5600a3240 0x7ff5600a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:55.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.371+0000 7ff5717fa640 1 -- 172.21.15.19:0/1598497593 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff55c0f0230 con 0x7ff574102790 2024-09-19T08:54:55.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.372+0000 7ff5737fe640 1 --2- 172.21.15.19:0/1598497593 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff5600a3240 0x7ff5600a5700 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff56400abe0 tx=0x7ff56400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:55.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:55 smithi155 ceph-mon[34921]: pgmap v418: 97 pgs: 97 active+clean; 1.0 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.6 KiB/s wr, 14 op/s 2024-09-19T08:54:55.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:55 smithi203 ceph-mon[35450]: pgmap v418: 97 pgs: 97 active+clean; 1.0 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.6 KiB/s wr, 14 op/s 2024-09-19T08:54:55.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.526+0000 7ff57c1c0740 1 Processor -- start 2024-09-19T08:54:55.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.526+0000 7ff57c1c0740 1 -- start start 2024-09-19T08:54:55.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.527+0000 7ff57c1c0740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dcada8cb40 0x55dcada8b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:55.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.527+0000 7ff57c1c0740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcada8b5d0 0x55dcada8ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:55.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.527+0000 7ff57c1c0740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dcada96370 0x55dcada98760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:55.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.527+0000 7ff57c1c0740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55dcad9f12f0 con 0x55dcada96370 2024-09-19T08:54:55.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.527+0000 7ff57c1c0740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55dcad998cf0 con 0x55dcada8cb40 2024-09-19T08:54:55.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.527+0000 7ff57c1c0740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55dcad9ed2b0 con 0x55dcada8b5d0 2024-09-19T08:54:55.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.527+0000 7ff573fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dcada96370 0x55dcada98760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:55.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.527+0000 7ff573fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dcada96370 0x55dcada98760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52294/0 (socket says 172.21.15.19:52294) 2024-09-19T08:54:55.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.527+0000 7ff573fff640 1 -- 172.21.15.19:0/2423554083 learned_addr learned my addr 172.21.15.19:0/2423554083 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:55.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.527+0000 7ff5737fe640 1 --2- 172.21.15.19:0/2423554083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dcada8cb40 0x55dcada8b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:55.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.527+0000 7ff56affd640 1 --2- 172.21.15.19:0/2423554083 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcada8b5d0 0x55dcada8ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:55.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.527+0000 7ff573fff640 1 -- 172.21.15.19:0/2423554083 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcada8b5d0 msgr2=0x55dcada8ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:55.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.527+0000 7ff573fff640 1 --2- 172.21.15.19:0/2423554083 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcada8b5d0 0x55dcada8ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.527+0000 7ff573fff640 1 -- 172.21.15.19:0/2423554083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dcada8cb40 msgr2=0x55dcada8b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:55.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.527+0000 7ff573fff640 1 --2- 172.21.15.19:0/2423554083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dcada8cb40 0x55dcada8b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.527+0000 7ff573fff640 1 -- 172.21.15.19:0/2423554083 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcad97d3a0 con 0x55dcada96370 2024-09-19T08:54:55.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.527+0000 7ff5737fe640 1 --2- 172.21.15.19:0/2423554083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dcada8cb40 0x55dcada8b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:54:55.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.527+0000 7ff573fff640 1 --2- 172.21.15.19:0/2423554083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dcada96370 0x55dcada98760 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7ff56c00c450 tx=0x7ff56c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=737ee1c850389c2c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:55.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.528+0000 7ff569ffb640 1 -- 172.21.15.19:0/2423554083 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56c007430 con 0x55dcada96370 2024-09-19T08:54:55.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.528+0000 7ff569ffb640 1 -- 172.21.15.19:0/2423554083 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff56c007ab0 con 0x55dcada96370 2024-09-19T08:54:55.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.528+0000 7ff569ffb640 1 -- 172.21.15.19:0/2423554083 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56c00aaa0 con 0x55dcada96370 2024-09-19T08:54:55.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.528+0000 7ff57c1c0740 1 -- 172.21.15.19:0/2423554083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dcada96370 msgr2=0x55dcada98760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:55.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.528+0000 7ff57c1c0740 1 --2- 172.21.15.19:0/2423554083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dcada96370 0x55dcada98760 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7ff56c00c450 tx=0x7ff56c00c910 comp rx=0 tx=0).stop 2024-09-19T08:54:55.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.529+0000 7ff57c1c0740 1 -- 172.21.15.19:0/2423554083 shutdown_connections 2024-09-19T08:54:55.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.529+0000 7ff57c1c0740 1 --2- 172.21.15.19:0/2423554083 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcada8b5d0 0x55dcada8ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.529+0000 7ff57c1c0740 1 --2- 172.21.15.19:0/2423554083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dcada96370 0x55dcada98760 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.529+0000 7ff57c1c0740 1 --2- 172.21.15.19:0/2423554083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dcada8cb40 0x55dcada8b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.529+0000 7ff57c1c0740 1 -- 172.21.15.19:0/2423554083 >> 172.21.15.19:0/2423554083 conn(0x55dcada54310 msgr2=0x55dcada87c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:55.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.529+0000 7ff57c1c0740 1 -- 172.21.15.19:0/2423554083 shutdown_connections 2024-09-19T08:54:55.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.529+0000 7ff57c1c0740 1 -- 172.21.15.19:0/2423554083 wait complete. 2024-09-19T08:54:55.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.529+0000 7ff57c1c0740 1 -- start start 2024-09-19T08:54:55.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.529+0000 7ff57c1c0740 1 Processor -- start 2024-09-19T08:54:55.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.530+0000 7ff57c1c0740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcada8b5d0 0x55dcada95cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:55.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.530+0000 7ff57c1c0740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dcada8cb40 0x55dcada92f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:55.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.530+0000 7ff57c1c0740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dcada96370 0x55dcada934d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:55.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.530+0000 7ff57c1c0740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55dcada99070 con 0x55dcada96370 2024-09-19T08:54:55.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.530+0000 7ff57c1c0740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55dcad9ac060 con 0x55dcada8cb40 2024-09-19T08:54:55.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.530+0000 7ff57c1c0740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55dcada991f0 con 0x55dcada8b5d0 2024-09-19T08:54:55.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.530+0000 7ff57c1c0740 10 client.0 _ll_register_callbacks cb 0x55dcad6ff8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:55.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.530+0000 7ff5737fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcada8b5d0 0x55dcada95cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:55.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.530+0000 7ff573fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dcada96370 0x55dcada934d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:55.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.530+0000 7ff5737fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcada8b5d0 0x55dcada95cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:32852/0 (socket says 172.21.15.19:32852) 2024-09-19T08:54:55.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.530+0000 7ff5737fe640 1 -- 172.21.15.19:0/3120435573 learned_addr learned my addr 172.21.15.19:0/3120435573 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:55.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.530+0000 7ff56affd640 1 --2- 172.21.15.19:0/3120435573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dcada8cb40 0x55dcada92f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:55.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.530+0000 7ff573fff640 1 -- 172.21.15.19:0/3120435573 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcada8b5d0 msgr2=0x55dcada95cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:55.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.530+0000 7ff573fff640 1 --2- 172.21.15.19:0/3120435573 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcada8b5d0 0x55dcada95cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.530+0000 7ff573fff640 1 -- 172.21.15.19:0/3120435573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dcada8cb40 msgr2=0x55dcada92f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:55.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.530+0000 7ff573fff640 1 --2- 172.21.15.19:0/3120435573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dcada8cb40 0x55dcada92f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.530+0000 7ff573fff640 1 -- 172.21.15.19:0/3120435573 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dcad7623c0 con 0x55dcada96370 2024-09-19T08:54:55.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.530+0000 7ff5737fe640 1 --2- 172.21.15.19:0/3120435573 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcada8b5d0 0x55dcada95cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:54:55.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.530+0000 7ff573fff640 1 --2- 172.21.15.19:0/3120435573 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dcada96370 0x55dcada934d0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7ff56c009530 tx=0x7ff56c007fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7b10a681182f343 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:55.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.530+0000 7ff552ffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:54:55.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.531+0000 7ff552ffd640 1 -- 172.21.15.19:0/3120435573 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56c009c30 con 0x55dcada96370 2024-09-19T08:54:55.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.531+0000 7ff552ffd640 1 -- 172.21.15.19:0/3120435573 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff56c01b070 con 0x55dcada96370 2024-09-19T08:54:55.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.531+0000 7ff57c1c0740 1 -- 172.21.15.19:0/3120435573 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff56c007ab0 con 0x55dcada96370 2024-09-19T08:54:55.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.531+0000 7ff552ffd640 1 -- 172.21.15.19:0/3120435573 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff56c00a880 con 0x55dcada96370 2024-09-19T08:54:55.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.531+0000 7ff57c1c0740 10 client.16017 fetch_fsmap learned FSMap version 30 2024-09-19T08:54:55.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.531+0000 7ff57c1c0740 1 -- 172.21.15.19:0/3120435573 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55dcadaa4a80 con 0x55dcada96370 2024-09-19T08:54:55.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.531+0000 7ff552ffd640 1 -- 172.21.15.19:0/3120435573 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff56c007ab0 con 0x55dcada96370 2024-09-19T08:54:55.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.531+0000 7ff552ffd640 1 -- 172.21.15.19:0/3120435573 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7ff56c0166b0 con 0x55dcada96370 2024-09-19T08:54:55.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.531+0000 7ff57c1c0740 10 client.16017 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T08:54:55.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.531+0000 7ff57c1c0740 10 client.16017 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:54:55.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.531+0000 7ff57c1c0740 20 client.16017 populate_metadata read hostname 'smithi019' 2024-09-19T08:54:55.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.531+0000 7ff57c1c0740 1 --2- 172.21.15.19:0/3120435573 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55dcadaa5e80 0x55dcadaa8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:55.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.531+0000 7ff57c1c0740 4 client.16017 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:54:55.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.531+0000 7ff57c1c0740 1 -- 172.21.15.19:0/3120435573 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dcad9fe860 con 0x55dcadaa5e80 2024-09-19T08:54:55.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.532+0000 7ff5737fe640 1 --2- 172.21.15.19:0/3120435573 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55dcadaa5e80 0x55dcadaa8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:55.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.532+0000 7ff5737fe640 1 --2- 172.21.15.19:0/3120435573 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55dcadaa5e80 0x55dcadaa8270 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43ed01366a2247e1 server_cookie=a2c4e8954ff22e38 in_seq=0 out_seq=0 2024-09-19T08:54:55.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.532+0000 7ff552ffd640 10 client.16017 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:54:55.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.533+0000 7ff552ffd640 1 -- 172.21.15.19:0/3120435573 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dcad9fe860 con 0x55dcadaa5e80 2024-09-19T08:54:55.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.533+0000 7ff552ffd640 10 client.16017 handle_command_reply: tid=0 2024-09-19T08:54:55.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.533+0000 7ff57c1c0740 1 client.16017 shutdown 2024-09-19T08:54:55.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.533+0000 7ff57c1c0740 1 -- 172.21.15.19:0/3120435573 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dcada96370 msgr2=0x55dcada934d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:55.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.533+0000 7ff57c1c0740 1 --2- 172.21.15.19:0/3120435573 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dcada96370 0x55dcada934d0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7ff56c009530 tx=0x7ff56c007fd0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.533+0000 7ff57c1c0740 1 -- 172.21.15.19:0/3120435573 shutdown_connections 2024-09-19T08:54:55.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.533+0000 7ff57c1c0740 1 --2- 172.21.15.19:0/3120435573 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55dcadaa5e80 0x55dcadaa8270 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.533+0000 7ff57c1c0740 1 --2- 172.21.15.19:0/3120435573 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dcada96370 0x55dcada934d0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.533+0000 7ff57c1c0740 1 --2- 172.21.15.19:0/3120435573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dcada8cb40 0x55dcada92f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.533+0000 7ff552ffd640 0 client.16017 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:54:55.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.533+0000 7ff57c1c0740 1 --2- 172.21.15.19:0/3120435573 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcada8b5d0 0x55dcada95cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.533+0000 7ff57c1c0740 1 -- 172.21.15.19:0/3120435573 >> 172.21.15.19:0/3120435573 conn(0x55dcada54310 msgr2=0x55dcada8d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:55.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.533+0000 7ff57c1c0740 1 -- 172.21.15.19:0/3120435573 shutdown_connections 2024-09-19T08:54:55.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.533+0000 7ff57c1c0740 1 -- 172.21.15.19:0/3120435573 wait complete. 2024-09-19T08:54:55.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.534+0000 7ff57c1c0740 20 client.16017 trim_cache size 0 max 16384 2024-09-19T08:54:55.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.547+0000 7ff57c1c0740 1 Processor -- start 2024-09-19T08:54:55.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.547+0000 7ff57c1c0740 1 -- start start 2024-09-19T08:54:55.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.547+0000 7ff57c1c0740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dcada8b5d0 0x55dcadaa2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:55.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.547+0000 7ff57c1c0740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcada8cb40 0x55dcadaad900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:55.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.547+0000 7ff57c1c0740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dcada96370 0x55dcadaade40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:55.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.547+0000 7ff57c1c0740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff5741af750 con 0x55dcada96370 2024-09-19T08:54:55.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.547+0000 7ff57c1c0740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff5741b1350 con 0x55dcada8b5d0 2024-09-19T08:54:55.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.547+0000 7ff57c1c0740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff5741afe20 con 0x55dcada8cb40 2024-09-19T08:54:55.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.547+0000 7ff573fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dcada96370 0x55dcadaade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:55.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.547+0000 7ff573fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dcada96370 0x55dcadaade40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52310/0 (socket says 172.21.15.19:52310) 2024-09-19T08:54:55.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.547+0000 7ff573fff640 1 -- 172.21.15.19:0/1328863641 learned_addr learned my addr 172.21.15.19:0/1328863641 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:55.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.548+0000 7ff5737fe640 1 --2- 172.21.15.19:0/1328863641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dcada8b5d0 0x55dcadaa2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:55.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.548+0000 7ff56affd640 1 --2- 172.21.15.19:0/1328863641 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcada8cb40 0x55dcadaad900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:55.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.548+0000 7ff573fff640 1 -- 172.21.15.19:0/1328863641 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcada8cb40 msgr2=0x55dcadaad900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:55.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.548+0000 7ff573fff640 1 --2- 172.21.15.19:0/1328863641 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcada8cb40 0x55dcadaad900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.548+0000 7ff573fff640 1 -- 172.21.15.19:0/1328863641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dcada8b5d0 msgr2=0x55dcadaa2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:55.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.548+0000 7ff573fff640 1 --2- 172.21.15.19:0/1328863641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dcada8b5d0 0x55dcadaa2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.548+0000 7ff573fff640 1 -- 172.21.15.19:0/1328863641 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcada8c760 con 0x55dcada96370 2024-09-19T08:54:55.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.548+0000 7ff573fff640 1 --2- 172.21.15.19:0/1328863641 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dcada96370 0x55dcadaade40 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7ff56c00a790 tx=0x7ff56c004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32574aa3b86e3658 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:55.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.548+0000 7ff5697fa640 1 -- 172.21.15.19:0/1328863641 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56c00c2e0 con 0x55dcada96370 2024-09-19T08:54:55.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.548+0000 7ff5697fa640 1 -- 172.21.15.19:0/1328863641 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff56c007a70 con 0x55dcada96370 2024-09-19T08:54:55.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.548+0000 7ff5697fa640 1 -- 172.21.15.19:0/1328863641 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56c016420 con 0x55dcada96370 2024-09-19T08:54:55.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.549+0000 7ff57c1c0740 1 -- 172.21.15.19:0/1328863641 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dcada96370 msgr2=0x55dcadaade40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:55.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.549+0000 7ff57c1c0740 1 --2- 172.21.15.19:0/1328863641 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dcada96370 0x55dcadaade40 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7ff56c00a790 tx=0x7ff56c004b50 comp rx=0 tx=0).stop 2024-09-19T08:54:55.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.549+0000 7ff57c1c0740 1 -- 172.21.15.19:0/1328863641 shutdown_connections 2024-09-19T08:54:55.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.549+0000 7ff57c1c0740 1 --2- 172.21.15.19:0/1328863641 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcada8cb40 0x55dcadaad900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.549+0000 7ff57c1c0740 1 --2- 172.21.15.19:0/1328863641 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dcada96370 0x55dcadaade40 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.549+0000 7ff57c1c0740 1 --2- 172.21.15.19:0/1328863641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dcada8b5d0 0x55dcadaa2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.549+0000 7ff57c1c0740 1 -- 172.21.15.19:0/1328863641 >> 172.21.15.19:0/1328863641 conn(0x55dcada54310 msgr2=0x55dcada92060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:55.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.549+0000 7ff57c1c0740 1 -- 172.21.15.19:0/1328863641 shutdown_connections 2024-09-19T08:54:55.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.549+0000 7ff57c1c0740 1 -- 172.21.15.19:0/1328863641 wait complete. 2024-09-19T08:54:55.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.549+0000 7ff57c1c0740 1 -- start start 2024-09-19T08:54:55.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.549+0000 7ff57c1c0740 1 Processor -- start 2024-09-19T08:54:55.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.550+0000 7ff57c1c0740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dcada8b5d0 0x55dcada9ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:55.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.550+0000 7ff57c1c0740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcada8cb40 0x55dcada99e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:55.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.550+0000 7ff57c1c0740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dcada96370 0x55dcada9a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.550+0000 7ff57c1c0740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff5741b0bc0 con 0x55dcada96370 2024-09-19T08:54:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.550+0000 7ff57c1c0740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff5741b04f0 con 0x55dcada8b5d0 2024-09-19T08:54:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.550+0000 7ff57c1c0740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff5741ad730 con 0x55dcada8cb40 2024-09-19T08:54:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.550+0000 7ff57c1c0740 10 client.0 _ll_register_callbacks cb 0x7ff56400a830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.550+0000 7ff573fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dcada96370 0x55dcada9a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.550+0000 7ff573fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dcada96370 0x55dcada9a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52320/0 (socket says 172.21.15.19:52320) 2024-09-19T08:54:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.550+0000 7ff573fff640 1 -- 172.21.15.19:0/118147572 learned_addr learned my addr 172.21.15.19:0/118147572 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.550+0000 7ff5737fe640 1 --2- 172.21.15.19:0/118147572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dcada8b5d0 0x55dcada9ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.550+0000 7ff56affd640 1 --2- 172.21.15.19:0/118147572 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcada8cb40 0x55dcada99e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.550+0000 7ff573fff640 1 -- 172.21.15.19:0/118147572 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcada8cb40 msgr2=0x55dcada99e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.550+0000 7ff573fff640 1 --2- 172.21.15.19:0/118147572 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcada8cb40 0x55dcada99e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.550+0000 7ff573fff640 1 -- 172.21.15.19:0/118147572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dcada8b5d0 msgr2=0x55dcada9ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.550+0000 7ff573fff640 1 --2- 172.21.15.19:0/118147572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dcada8b5d0 0x55dcada9ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.550+0000 7ff573fff640 1 -- 172.21.15.19:0/118147572 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dcada9aa20 con 0x55dcada96370 2024-09-19T08:54:55.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.550+0000 7ff56affd640 1 --2- 172.21.15.19:0/118147572 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcada8cb40 0x55dcada99e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:54:55.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.550+0000 7ff573fff640 1 --2- 172.21.15.19:0/118147572 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dcada96370 0x55dcada9a380 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7ff56c00c950 tx=0x7ff56c00acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0a69d58f2b11b2e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:55.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.550+0000 7ff552ffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:54:55.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.551+0000 7ff552ffd640 1 -- 172.21.15.19:0/118147572 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff56c037020 con 0x55dcada96370 2024-09-19T08:54:55.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.551+0000 7ff552ffd640 1 -- 172.21.15.19:0/118147572 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff56c012040 con 0x55dcada96370 2024-09-19T08:54:55.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.551+0000 7ff57c1c0740 1 -- 172.21.15.19:0/118147572 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff56c007a70 con 0x55dcada96370 2024-09-19T08:54:55.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.551+0000 7ff552ffd640 1 -- 172.21.15.19:0/118147572 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff56c00c2e0 con 0x55dcada96370 2024-09-19T08:54:55.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.551+0000 7ff57c1c0740 10 client.16023 fetch_fsmap learned FSMap version 30 2024-09-19T08:54:55.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.551+0000 7ff57c1c0740 1 -- 172.21.15.19:0/118147572 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55dcadb10760 con 0x55dcada96370 2024-09-19T08:54:55.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.551+0000 7ff552ffd640 1 -- 172.21.15.19:0/118147572 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff56c007a70 con 0x55dcada96370 2024-09-19T08:54:55.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.551+0000 7ff552ffd640 1 -- 172.21.15.19:0/118147572 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7ff56c031020 con 0x55dcada96370 2024-09-19T08:54:55.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.551+0000 7ff57c1c0740 10 client.16023 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T08:54:55.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.551+0000 7ff57c1c0740 10 client.16023 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:54:55.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.551+0000 7ff57c1c0740 20 client.16023 populate_metadata read hostname 'smithi019' 2024-09-19T08:54:55.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.551+0000 7ff57c1c0740 1 --2- 172.21.15.19:0/118147572 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55dcadb10d20 0x55dcadb13140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:55.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.551+0000 7ff57c1c0740 4 client.16023 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:54:55.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.551+0000 7ff57c1c0740 1 -- 172.21.15.19:0/118147572 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dcad9f8d70 con 0x55dcadb10d20 2024-09-19T08:54:55.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.552+0000 7ff5737fe640 1 --2- 172.21.15.19:0/118147572 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55dcadb10d20 0x55dcadb13140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:55.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.552+0000 7ff552ffd640 10 client.16023 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:54:55.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.552+0000 7ff5737fe640 1 --2- 172.21.15.19:0/118147572 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55dcadb10d20 0x55dcadb13140 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=708ce37ba123afe4 server_cookie=e58c356e99e2bb09 in_seq=0 out_seq=0 2024-09-19T08:54:55.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.552+0000 7ff552ffd640 1 -- 172.21.15.19:0/118147572 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dcad9f8d70 con 0x55dcadb10d20 2024-09-19T08:54:55.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.552+0000 7ff552ffd640 10 client.16023 handle_command_reply: tid=0 2024-09-19T08:54:55.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.552+0000 7ff57c1c0740 1 client.16023 shutdown 2024-09-19T08:54:55.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.553+0000 7ff57c1c0740 1 -- 172.21.15.19:0/118147572 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dcada96370 msgr2=0x55dcada9a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:55.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.553+0000 7ff57c1c0740 1 --2- 172.21.15.19:0/118147572 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dcada96370 0x55dcada9a380 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7ff56c00c950 tx=0x7ff56c00acd0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.553+0000 7ff57c1c0740 1 -- 172.21.15.19:0/118147572 shutdown_connections 2024-09-19T08:54:55.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.553+0000 7ff57c1c0740 1 --2- 172.21.15.19:0/118147572 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55dcadb10d20 0x55dcadb13140 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.553+0000 7ff57c1c0740 1 --2- 172.21.15.19:0/118147572 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dcada8cb40 0x55dcada99e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.553+0000 7ff57c1c0740 1 --2- 172.21.15.19:0/118147572 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55dcada96370 0x55dcada9a380 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.553+0000 7ff57c1c0740 1 --2- 172.21.15.19:0/118147572 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55dcada8b5d0 0x55dcada9ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.553+0000 7ff57c1c0740 1 -- 172.21.15.19:0/118147572 >> 172.21.15.19:0/118147572 conn(0x55dcada54310 msgr2=0x55dcada947d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:55.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.553+0000 7ff552ffd640 0 client.16023 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:54:55.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.553+0000 7ff57c1c0740 1 -- 172.21.15.19:0/118147572 shutdown_connections 2024-09-19T08:54:55.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.553+0000 7ff57c1c0740 1 -- 172.21.15.19:0/118147572 wait complete. 2024-09-19T08:54:55.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.553+0000 7ff57c1c0740 20 client.16023 trim_cache size 0 max 16384 2024-09-19T08:54:55.558 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T08:54:55.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.553+0000 7ff579de7640 1 -- 172.21.15.19:0/1598497593 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff5600a3240 msgr2=0x7ff5600a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:55.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.553+0000 7ff579de7640 1 --2- 172.21.15.19:0/1598497593 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff5600a3240 0x7ff5600a5700 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff56400abe0 tx=0x7ff56400a2d0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.553+0000 7ff579de7640 1 -- 172.21.15.19:0/1598497593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff574102790 msgr2=0x7ff574074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:55.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.553+0000 7ff579de7640 1 --2- 172.21.15.19:0/1598497593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff574102790 0x7ff574074a30 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7ff55c005ab0 tx=0x7ff55c0042f0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.554+0000 7ff579de7640 1 -- 172.21.15.19:0/1598497593 shutdown_connections 2024-09-19T08:54:55.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.554+0000 7ff579de7640 1 --2- 172.21.15.19:0/1598497593 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff5600a3240 0x7ff5600a5700 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.554+0000 7ff579de7640 1 --2- 172.21.15.19:0/1598497593 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff574106f10 0x7ff574074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.554+0000 7ff579de7640 1 --2- 172.21.15.19:0/1598497593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff574102790 0x7ff574074a30 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.554+0000 7ff579de7640 1 --2- 172.21.15.19:0/1598497593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff574101de0 0x7ff5740744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.554+0000 7ff579de7640 1 -- 172.21.15.19:0/1598497593 >> 172.21.15.19:0/1598497593 conn(0x7ff5740fd8c0 msgr2=0x7ff5740febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.554+0000 7ff579de7640 1 -- 172.21.15.19:0/1598497593 shutdown_connections 2024-09-19T08:54:55.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:54:55.554+0000 7ff579de7640 1 -- 172.21.15.19:0/1598497593 wait complete. 2024-09-19T08:54:56.002 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.002+0000 7f52387df640 1 -- 172.21.15.19:0/346044710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52301013c0 msgr2=0x7f5230101840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:56.002 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.002+0000 7f52387df640 1 --2- 172.21.15.19:0/346044710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52301013c0 0x7f5230101840 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f5224009900 tx=0x7f522402a410 comp rx=0 tx=0).stop 2024-09-19T08:54:56.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.002+0000 7f52387df640 1 -- 172.21.15.19:0/346044710 shutdown_connections 2024-09-19T08:54:56.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.002+0000 7f52387df640 1 --2- 172.21.15.19:0/346044710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5230101d80 0x7f5230108610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.002+0000 7f52387df640 1 --2- 172.21.15.19:0/346044710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52301013c0 0x7f5230101840 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.002+0000 7f52387df640 1 --2- 172.21.15.19:0/346044710 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f52301001d0 0x7f52301005d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.002+0000 7f52387df640 1 -- 172.21.15.19:0/346044710 >> 172.21.15.19:0/346044710 conn(0x7f52300fb930 msgr2=0x7f52300fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:56.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.002+0000 7f52387df640 1 -- 172.21.15.19:0/346044710 shutdown_connections 2024-09-19T08:54:56.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.002+0000 7f52387df640 1 -- 172.21.15.19:0/346044710 wait complete. 2024-09-19T08:54:56.028 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.026+0000 7f52387df640 1 Processor -- start 2024-09-19T08:54:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.026+0000 7f52387df640 1 -- start start 2024-09-19T08:54:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.026+0000 7f52387df640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f52301001d0 0x7f5230197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.026+0000 7f52387df640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52301013c0 0x7f5230198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.026+0000 7f52387df640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5230101d80 0x7f523019f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.026+0000 7f52387df640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f523010c760 con 0x7f52301013c0 2024-09-19T08:54:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.026+0000 7f52387df640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f523010c5e0 con 0x7f5230101d80 2024-09-19T08:54:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.026+0000 7f52387df640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f523010c8e0 con 0x7f52301001d0 2024-09-19T08:54:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.027+0000 7f5235d7a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52301013c0 0x7f5230198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.027+0000 7f5235d7a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52301013c0 0x7f5230198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52338/0 (socket says 172.21.15.19:52338) 2024-09-19T08:54:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.027+0000 7f5235d7a640 1 -- 172.21.15.19:0/3850414433 learned_addr learned my addr 172.21.15.19:0/3850414433 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.027+0000 7f523657b640 1 --2- 172.21.15.19:0/3850414433 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f52301001d0 0x7f5230197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.027+0000 7f5236d7c640 1 --2- 172.21.15.19:0/3850414433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5230101d80 0x7f523019f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.027+0000 7f5235d7a640 1 -- 172.21.15.19:0/3850414433 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f52301001d0 msgr2=0x7f5230197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.027+0000 7f5235d7a640 1 --2- 172.21.15.19:0/3850414433 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f52301001d0 0x7f5230197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.027+0000 7f5235d7a640 1 -- 172.21.15.19:0/3850414433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5230101d80 msgr2=0x7f523019f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.027+0000 7f5235d7a640 1 --2- 172.21.15.19:0/3850414433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5230101d80 0x7f523019f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.027+0000 7f5235d7a640 1 -- 172.21.15.19:0/3850414433 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f523019fa40 con 0x7f52301013c0 2024-09-19T08:54:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.027+0000 7f5235d7a640 1 --2- 172.21.15.19:0/3850414433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52301013c0 0x7f5230198360 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f5224031440 tx=0x7f5224032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.027+0000 7f522f7fe640 1 -- 172.21.15.19:0/3850414433 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f522403f030 con 0x7f52301013c0 2024-09-19T08:54:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.027+0000 7f522f7fe640 1 -- 172.21.15.19:0/3850414433 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5224003ce0 con 0x7f52301013c0 2024-09-19T08:54:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.027+0000 7f52387df640 1 -- 172.21.15.19:0/3850414433 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f523019fcd0 con 0x7f52301013c0 2024-09-19T08:54:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.027+0000 7f522f7fe640 1 -- 172.21.15.19:0/3850414433 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5224035070 con 0x7f52301013c0 2024-09-19T08:54:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.028+0000 7f52387df640 1 -- 172.21.15.19:0/3850414433 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52301a01c0 con 0x7f52301013c0 2024-09-19T08:54:56.031 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.030+0000 7f522f7fe640 1 -- 172.21.15.19:0/3850414433 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f5224042030 con 0x7f52301013c0 2024-09-19T08:54:56.031 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.031+0000 7f522f7fe640 1 --2- 172.21.15.19:0/3850414433 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f52180a32f0 0x7f52180a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:56.031 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.031+0000 7f522f7fe640 1 -- 172.21.15.19:0/3850414433 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f52240efed0 con 0x7f52301013c0 2024-09-19T08:54:56.031 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.031+0000 7f523657b640 1 --2- 172.21.15.19:0/3850414433 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f52180a32f0 0x7f52180a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:56.031 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.031+0000 7f523657b640 1 --2- 172.21.15.19:0/3850414433 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f52180a32f0 0x7f52180a57b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5230101220 tx=0x7f5220009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:56.431 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:56.431 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:56.488 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.488+0000 7f523b654740 1 Processor -- start 2024-09-19T08:54:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.489+0000 7f523b654740 1 -- start start 2024-09-19T08:54:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.489+0000 7f523b654740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56386ed8f9a0 0x56386ed8fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.489+0000 7f523b654740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56386ed902e0 0x56386ed94da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.489+0000 7f523b654740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56386ed95370 0x56386ed97830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.489+0000 7f523b654740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56386ecf32f0 con 0x56386ed902e0 2024-09-19T08:54:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.489+0000 7f523b654740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56386ec9b270 con 0x56386ed95370 2024-09-19T08:54:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.489+0000 7f523b654740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56386ecef2b0 con 0x56386ed8f9a0 2024-09-19T08:54:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.489+0000 7f5235d7a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56386ed902e0 0x56386ed94da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.489+0000 7f5235d7a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56386ed902e0 0x56386ed94da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52344/0 (socket says 172.21.15.19:52344) 2024-09-19T08:54:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.489+0000 7f5235d7a640 1 -- 172.21.15.19:0/730119799 learned_addr learned my addr 172.21.15.19:0/730119799 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.489+0000 7f523657b640 1 --2- 172.21.15.19:0/730119799 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56386ed8f9a0 0x56386ed8fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.489+0000 7f5236d7c640 1 --2- 172.21.15.19:0/730119799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56386ed95370 0x56386ed97830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.489+0000 7f5235d7a640 1 -- 172.21.15.19:0/730119799 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56386ed8f9a0 msgr2=0x56386ed8fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.489+0000 7f5235d7a640 1 --2- 172.21.15.19:0/730119799 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56386ed8f9a0 0x56386ed8fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.489+0000 7f5235d7a640 1 -- 172.21.15.19:0/730119799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56386ed95370 msgr2=0x56386ed97830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.489+0000 7f5235d7a640 1 --2- 172.21.15.19:0/730119799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56386ed95370 0x56386ed97830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.489+0000 7f5235d7a640 1 -- 172.21.15.19:0/730119799 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56386ec9a340 con 0x56386ed902e0 2024-09-19T08:54:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.489+0000 7f5236d7c640 1 --2- 172.21.15.19:0/730119799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56386ed95370 0x56386ed97830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:54:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.490+0000 7f5235d7a640 1 --2- 172.21.15.19:0/730119799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56386ed902e0 0x56386ed94da0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f52240b8960 tx=0x7f52240bc390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=497d3513505b6278 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.490+0000 7f522cff9640 1 -- 172.21.15.19:0/730119799 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5224049040 con 0x56386ed902e0 2024-09-19T08:54:56.492 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.490+0000 7f522cff9640 1 -- 172.21.15.19:0/730119799 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52240bc500 con 0x56386ed902e0 2024-09-19T08:54:56.492 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.490+0000 7f522cff9640 1 -- 172.21.15.19:0/730119799 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f522403be10 con 0x56386ed902e0 2024-09-19T08:54:56.492 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.491+0000 7f523b654740 1 -- 172.21.15.19:0/730119799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56386ed902e0 msgr2=0x56386ed94da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:56.492 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.491+0000 7f523b654740 1 --2- 172.21.15.19:0/730119799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56386ed902e0 0x56386ed94da0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f52240b8960 tx=0x7f52240bc390 comp rx=0 tx=0).stop 2024-09-19T08:54:56.492 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.491+0000 7f523b654740 1 -- 172.21.15.19:0/730119799 shutdown_connections 2024-09-19T08:54:56.493 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.491+0000 7f523b654740 1 --2- 172.21.15.19:0/730119799 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56386ed95370 0x56386ed97830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.493 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.491+0000 7f523b654740 1 --2- 172.21.15.19:0/730119799 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56386ed902e0 0x56386ed94da0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.493 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.491+0000 7f523b654740 1 --2- 172.21.15.19:0/730119799 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56386ed8f9a0 0x56386ed8fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.493 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.491+0000 7f523b654740 1 -- 172.21.15.19:0/730119799 >> 172.21.15.19:0/730119799 conn(0x56386ed8b010 msgr2=0x56386ed8b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:56.493 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.491+0000 7f523b654740 1 -- 172.21.15.19:0/730119799 shutdown_connections 2024-09-19T08:54:56.493 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.491+0000 7f523b654740 1 -- 172.21.15.19:0/730119799 wait complete. 2024-09-19T08:54:56.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.555+0000 7f523b654740 1 -- start start 2024-09-19T08:54:56.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.570+0000 7f523b654740 1 Processor -- start 2024-09-19T08:54:56.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.570+0000 7f523b654740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56386ed8f9a0 0x56386ed997d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:56.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.571+0000 7f523b654740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56386ed902e0 0x56386ed99d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:56.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.571+0000 7f523b654740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56386ed95370 0x56386eda0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:56.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.571+0000 7f523b654740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56386ecf32f0 con 0x56386ed8f9a0 2024-09-19T08:54:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.571+0000 7f523b654740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56386ec7c290 con 0x56386ed95370 2024-09-19T08:54:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.571+0000 7f523b654740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56386ed98100 con 0x56386ed902e0 2024-09-19T08:54:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.571+0000 7f523657b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56386ed8f9a0 0x56386ed997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.571+0000 7f523657b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56386ed8f9a0 0x56386ed997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52352/0 (socket says 172.21.15.19:52352) 2024-09-19T08:54:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.571+0000 7f523657b640 1 -- 172.21.15.19:0/876849105 learned_addr learned my addr 172.21.15.19:0/876849105 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.571+0000 7f5235d7a640 1 --2- 172.21.15.19:0/876849105 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56386ed902e0 0x56386ed99d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.571+0000 7f5236d7c640 1 --2- 172.21.15.19:0/876849105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56386ed95370 0x56386eda0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.571+0000 7f523657b640 1 -- 172.21.15.19:0/876849105 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56386ed902e0 msgr2=0x56386ed99d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.571+0000 7f523657b640 1 --2- 172.21.15.19:0/876849105 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56386ed902e0 0x56386ed99d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.571+0000 7f523657b640 1 -- 172.21.15.19:0/876849105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56386ed95370 msgr2=0x56386eda0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.571+0000 7f523657b640 1 --2- 172.21.15.19:0/876849105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56386ed95370 0x56386eda0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.571+0000 7f523657b640 1 -- 172.21.15.19:0/876849105 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56386ea06210 con 0x56386ed8f9a0 2024-09-19T08:54:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.571+0000 7f523657b640 1 --2- 172.21.15.19:0/876849105 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56386ed8f9a0 0x56386ed997d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f5220011db0 tx=0x7f5220004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe54ab22584c39e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.571+0000 7f5215ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:54:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.572+0000 7f5215ffb640 1 -- 172.21.15.19:0/876849105 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5220003d80 con 0x56386ed8f9a0 2024-09-19T08:54:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.572+0000 7f5215ffb640 1 -- 172.21.15.19:0/876849105 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5220004050 con 0x56386ed8f9a0 2024-09-19T08:54:56.583 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.583+0000 7f523b654740 10 client.0 _ll_register_callbacks cb 0x56386ecad140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:56.584 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.584+0000 7f523b654740 1 -- 172.21.15.19:0/876849105 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52240bc500 con 0x56386ed8f9a0 2024-09-19T08:54:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.585+0000 7f5215ffb640 1 -- 172.21.15.19:0/876849105 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f5220004250 con 0x56386ed8f9a0 2024-09-19T08:54:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.585+0000 7f523b654740 10 client.16035 fetch_fsmap learned FSMap version 30 2024-09-19T08:54:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.585+0000 7f523b654740 1 -- 172.21.15.19:0/876849105 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({fsmap=30}) -- 0x56386ead2620 con 0x56386ed8f9a0 2024-09-19T08:54:56.644 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.644+0000 7f5215ffb640 1 -- 172.21.15.19:0/876849105 <== mon.0 v2:172.21.15.19:3300/0 4 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f5220026020 con 0x56386ed8f9a0 2024-09-19T08:54:56.644 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.644+0000 7f523b654740 10 client.16035 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T08:54:56.644 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.644+0000 7f523b654740 10 client.16035 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:54:56.645 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.645+0000 7f523b654740 20 client.16035 populate_metadata read hostname 'smithi019' 2024-09-19T08:54:56.645 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.645+0000 7f523b654740 1 --2- 172.21.15.19:0/876849105 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56386eda52a0 0x56386eda7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:56.645 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.645+0000 7f523b654740 4 client.16035 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:54:56.646 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.645+0000 7f523b654740 1 -- 172.21.15.19:0/876849105 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56386ed00a20 con 0x56386eda52a0 2024-09-19T08:54:56.646 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.645+0000 7f5235d7a640 1 --2- 172.21.15.19:0/876849105 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56386eda52a0 0x56386eda7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:56.646 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.646+0000 7f5235d7a640 1 --2- 172.21.15.19:0/876849105 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56386eda52a0 0x56386eda7740 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98a1dd8a732a51a4 server_cookie=eb21cbd34315a750 in_seq=0 out_seq=0 2024-09-19T08:54:56.646 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.646+0000 7f5215ffb640 10 client.16035 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:54:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.647+0000 7f5215ffb640 1 -- 172.21.15.19:0/876849105 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56386ed00a20 con 0x56386eda52a0 2024-09-19T08:54:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.647+0000 7f5215ffb640 10 client.16035 handle_command_reply: tid=0 2024-09-19T08:54:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.647+0000 7f523b654740 1 client.16035 shutdown 2024-09-19T08:54:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.647+0000 7f523b654740 1 -- 172.21.15.19:0/876849105 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56386ed8f9a0 msgr2=0x56386ed997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.647+0000 7f523b654740 1 --2- 172.21.15.19:0/876849105 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56386ed8f9a0 0x56386ed997d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f5220011db0 tx=0x7f5220004ab0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.647+0000 7f523b654740 1 -- 172.21.15.19:0/876849105 shutdown_connections 2024-09-19T08:54:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.647+0000 7f523b654740 1 --2- 172.21.15.19:0/876849105 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56386eda52a0 0x56386eda7740 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.647+0000 7f523b654740 1 --2- 172.21.15.19:0/876849105 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56386ed902e0 0x56386ed99d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.647+0000 7f523b654740 1 --2- 172.21.15.19:0/876849105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56386ed95370 0x56386eda0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.647+0000 7f523b654740 1 --2- 172.21.15.19:0/876849105 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56386ed8f9a0 0x56386ed997d0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.647+0000 7f5215ffb640 0 client.16035 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:54:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.647+0000 7f523b654740 1 -- 172.21.15.19:0/876849105 >> 172.21.15.19:0/876849105 conn(0x56386ed8b010 msgr2=0x56386ed8c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:56.649 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.647+0000 7f523b654740 1 -- 172.21.15.19:0/876849105 shutdown_connections 2024-09-19T08:54:56.649 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.647+0000 7f523b654740 1 -- 172.21.15.19:0/876849105 wait complete. 2024-09-19T08:54:56.649 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.647+0000 7f523b654740 20 client.16035 trim_cache size 0 max 16384 2024-09-19T08:54:56.664 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.663+0000 7f523b654740 1 Processor -- start 2024-09-19T08:54:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.663+0000 7f523b654740 1 -- start start 2024-09-19T08:54:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.663+0000 7f523b654740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56386ed8f9a0 0x56386ed99da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.663+0000 7f523b654740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56386ed902e0 0x56386eda0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.664+0000 7f523b654740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56386ed95370 0x56386ed8a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.664+0000 7f523b654740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f52301a8fb0 con 0x56386ed902e0 2024-09-19T08:54:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.664+0000 7f523b654740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f52301aabb0 con 0x56386ed95370 2024-09-19T08:54:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.664+0000 7f523b654740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f52301a9680 con 0x56386ed8f9a0 2024-09-19T08:54:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.664+0000 7f5235d7a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56386ed902e0 0x56386eda0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.664+0000 7f5235d7a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56386ed902e0 0x56386eda0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52358/0 (socket says 172.21.15.19:52358) 2024-09-19T08:54:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.664+0000 7f5235d7a640 1 -- 172.21.15.19:0/4126340460 learned_addr learned my addr 172.21.15.19:0/4126340460 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.664+0000 7f523657b640 1 --2- 172.21.15.19:0/4126340460 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56386ed8f9a0 0x56386ed99da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.664+0000 7f5236d7c640 1 --2- 172.21.15.19:0/4126340460 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56386ed95370 0x56386ed8a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.664+0000 7f5235d7a640 1 -- 172.21.15.19:0/4126340460 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56386ed8f9a0 msgr2=0x56386ed99da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.664+0000 7f5235d7a640 1 --2- 172.21.15.19:0/4126340460 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56386ed8f9a0 0x56386ed99da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.664+0000 7f5235d7a640 1 -- 172.21.15.19:0/4126340460 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56386ed95370 msgr2=0x56386ed8a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.664+0000 7f5235d7a640 1 --2- 172.21.15.19:0/4126340460 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56386ed95370 0x56386ed8a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.664+0000 7f5235d7a640 1 -- 172.21.15.19:0/4126340460 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56386ed8bca0 con 0x56386ed902e0 2024-09-19T08:54:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.665+0000 7f5235d7a640 1 --2- 172.21.15.19:0/4126340460 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56386ed902e0 0x56386eda0cc0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f5224000c00 tx=0x7f5224009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efdf97d841597645 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:56.669 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.665+0000 7f5217fff640 1 -- 172.21.15.19:0/4126340460 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5224049040 con 0x56386ed902e0 2024-09-19T08:54:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.665+0000 7f5217fff640 1 -- 172.21.15.19:0/4126340460 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52240c5170 con 0x56386ed902e0 2024-09-19T08:54:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.665+0000 7f5217fff640 1 -- 172.21.15.19:0/4126340460 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52240bc760 con 0x56386ed902e0 2024-09-19T08:54:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.666+0000 7f523b654740 1 -- 172.21.15.19:0/4126340460 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56386ed902e0 msgr2=0x56386eda0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.666+0000 7f523b654740 1 --2- 172.21.15.19:0/4126340460 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56386ed902e0 0x56386eda0cc0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f5224000c00 tx=0x7f5224009260 comp rx=0 tx=0).stop 2024-09-19T08:54:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.666+0000 7f523b654740 1 -- 172.21.15.19:0/4126340460 shutdown_connections 2024-09-19T08:54:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.666+0000 7f523b654740 1 --2- 172.21.15.19:0/4126340460 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56386ed95370 0x56386ed8a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.666+0000 7f523b654740 1 --2- 172.21.15.19:0/4126340460 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56386ed902e0 0x56386eda0cc0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.666+0000 7f523b654740 1 --2- 172.21.15.19:0/4126340460 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56386ed8f9a0 0x56386ed99da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.666+0000 7f523b654740 1 -- 172.21.15.19:0/4126340460 >> 172.21.15.19:0/4126340460 conn(0x56386ed8b010 msgr2=0x56386ed899a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.666+0000 7f523b654740 1 -- 172.21.15.19:0/4126340460 shutdown_connections 2024-09-19T08:54:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.666+0000 7f523b654740 1 -- 172.21.15.19:0/4126340460 wait complete. 2024-09-19T08:54:56.670 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.666+0000 7f523b654740 1 -- start start 2024-09-19T08:54:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.666+0000 7f523b654740 1 Processor -- start 2024-09-19T08:54:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.666+0000 7f523b654740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56386ed8f9a0 0x56386ed9e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.666+0000 7f523b654740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56386ed902e0 0x56386ed9e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.666+0000 7f523b654740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56386ed95370 0x56386ed9f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.667+0000 7f523b654740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f52301aa420 con 0x56386ed8f9a0 2024-09-19T08:54:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.667+0000 7f523b654740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f52301a9d50 con 0x56386ed902e0 2024-09-19T08:54:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.667+0000 7f523b654740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f52301a6f20 con 0x56386ed95370 2024-09-19T08:54:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.667+0000 7f523b654740 10 client.0 _ll_register_callbacks cb 0x7f5220011a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:54:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.667+0000 7f523657b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56386ed8f9a0 0x56386ed9e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.667+0000 7f523657b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56386ed8f9a0 0x56386ed9e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52370/0 (socket says 172.21.15.19:52370) 2024-09-19T08:54:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.667+0000 7f523657b640 1 -- 172.21.15.19:0/2512281628 learned_addr learned my addr 172.21.15.19:0/2512281628 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:54:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.667+0000 7f5236d7c640 1 --2- 172.21.15.19:0/2512281628 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56386ed95370 0x56386ed9f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:56.671 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.667+0000 7f5235d7a640 1 --2- 172.21.15.19:0/2512281628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56386ed902e0 0x56386ed9e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.667+0000 7f523657b640 1 -- 172.21.15.19:0/2512281628 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56386ed95370 msgr2=0x56386ed9f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.667+0000 7f523657b640 1 --2- 172.21.15.19:0/2512281628 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56386ed95370 0x56386ed9f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.667+0000 7f523657b640 1 -- 172.21.15.19:0/2512281628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56386ed902e0 msgr2=0x56386ed9e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:54:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.667+0000 7f523657b640 1 --2- 172.21.15.19:0/2512281628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56386ed902e0 0x56386ed9e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.667+0000 7f523657b640 1 -- 172.21.15.19:0/2512281628 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56386ed9feb0 con 0x56386ed8f9a0 2024-09-19T08:54:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.667+0000 7f523657b640 1 --2- 172.21.15.19:0/2512281628 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56386ed8f9a0 0x56386ed9e350 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f5220011db0 tx=0x7f5220015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d7ef6a79eecbb7a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:54:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.667+0000 7f5215ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:54:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.668+0000 7f5215ffb640 1 -- 172.21.15.19:0/2512281628 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5220042060 con 0x56386ed8f9a0 2024-09-19T08:54:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.668+0000 7f5215ffb640 1 -- 172.21.15.19:0/2512281628 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f52200043f0 con 0x56386ed8f9a0 2024-09-19T08:54:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.668+0000 7f523b654740 1 -- 172.21.15.19:0/2512281628 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52240c5170 con 0x56386ed8f9a0 2024-09-19T08:54:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.668+0000 7f5215ffb640 1 -- 172.21.15.19:0/2512281628 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f52200045f0 con 0x56386ed8f9a0 2024-09-19T08:54:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.668+0000 7f523b654740 10 client.16041 fetch_fsmap learned FSMap version 30 2024-09-19T08:54:56.672 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.668+0000 7f523b654740 1 -- 172.21.15.19:0/2512281628 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56386ee0ffe0 con 0x56386ed8f9a0 2024-09-19T08:54:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.668+0000 7f5215ffb640 1 -- 172.21.15.19:0/2512281628 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f52240c5170 con 0x56386ed8f9a0 2024-09-19T08:54:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.668+0000 7f5215ffb640 1 -- 172.21.15.19:0/2512281628 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7f5220026040 con 0x56386ed8f9a0 2024-09-19T08:54:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.668+0000 7f523b654740 10 client.16041 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T08:54:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.668+0000 7f523b654740 10 client.16041 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:54:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.668+0000 7f523b654740 20 client.16041 populate_metadata read hostname 'smithi019' 2024-09-19T08:54:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.668+0000 7f523b654740 1 --2- 172.21.15.19:0/2512281628 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56386ee10920 0x56386ee12d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:54:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.668+0000 7f523b654740 4 client.16041 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:54:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.668+0000 7f523b654740 1 -- 172.21.15.19:0/2512281628 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56386ecfad70 con 0x56386ee10920 2024-09-19T08:54:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.669+0000 7f5235d7a640 1 --2- 172.21.15.19:0/2512281628 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56386ee10920 0x56386ee12d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:54:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.669+0000 7f5215ffb640 10 client.16041 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:54:56.673 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.669+0000 7f5235d7a640 1 --2- 172.21.15.19:0/2512281628 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56386ee10920 0x56386ee12d40 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9bb731cdc1a8d36 server_cookie=5e09813a8be1f31d in_seq=0 out_seq=0 2024-09-19T08:54:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.676+0000 7f5215ffb640 1 -- 172.21.15.19:0/2512281628 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56386ecfad70 con 0x56386ee10920 2024-09-19T08:54:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.676+0000 7f5215ffb640 10 client.16041 handle_command_reply: tid=0 2024-09-19T08:54:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.676+0000 7f523b654740 1 client.16041 shutdown 2024-09-19T08:54:56.677 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.677+0000 7f523b654740 1 -- 172.21.15.19:0/2512281628 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56386ed8f9a0 msgr2=0x56386ed9e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.677+0000 7f523b654740 1 --2- 172.21.15.19:0/2512281628 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56386ed8f9a0 0x56386ed9e350 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f5220011db0 tx=0x7f5220015000 comp rx=0 tx=0).stop 2024-09-19T08:54:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.677+0000 7f523b654740 1 -- 172.21.15.19:0/2512281628 shutdown_connections 2024-09-19T08:54:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.677+0000 7f523b654740 1 --2- 172.21.15.19:0/2512281628 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56386ee10920 0x56386ee12d40 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.677+0000 7f523b654740 1 --2- 172.21.15.19:0/2512281628 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56386ed95370 0x56386ed9f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.677+0000 7f523b654740 1 --2- 172.21.15.19:0/2512281628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56386ed902e0 0x56386ed9e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.677+0000 7f523b654740 1 --2- 172.21.15.19:0/2512281628 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56386ed8f9a0 0x56386ed9e350 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.677+0000 7f5215ffb640 0 client.16041 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:54:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.677+0000 7f523b654740 1 -- 172.21.15.19:0/2512281628 >> 172.21.15.19:0/2512281628 conn(0x56386ed8b010 msgr2=0x56386ed8a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.677+0000 7f523b654740 1 -- 172.21.15.19:0/2512281628 shutdown_connections 2024-09-19T08:54:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.677+0000 7f523b654740 1 -- 172.21.15.19:0/2512281628 wait complete. 2024-09-19T08:54:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.677+0000 7f523b654740 20 client.16041 trim_cache size 0 max 16384 2024-09-19T08:54:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T08:54:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T08:54:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T08:54:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T08:54:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.678+0000 7f52387df640 1 -- 172.21.15.19:0/3850414433 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f52180a32f0 msgr2=0x7f52180a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.678+0000 7f52387df640 1 --2- 172.21.15.19:0/3850414433 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f52180a32f0 0x7f52180a57b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5230101220 tx=0x7f5220009500 comp rx=0 tx=0).stop 2024-09-19T08:54:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.678+0000 7f52387df640 1 -- 172.21.15.19:0/3850414433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52301013c0 msgr2=0x7f5230198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:54:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.678+0000 7f52387df640 1 --2- 172.21.15.19:0/3850414433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52301013c0 0x7f5230198360 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f5224031440 tx=0x7f5224032ce0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.678+0000 7f52387df640 1 -- 172.21.15.19:0/3850414433 shutdown_connections 2024-09-19T08:54:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.678+0000 7f52387df640 1 --2- 172.21.15.19:0/3850414433 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f52180a32f0 0x7f52180a57b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.678+0000 7f52387df640 1 --2- 172.21.15.19:0/3850414433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5230101d80 0x7f523019f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.678+0000 7f52387df640 1 --2- 172.21.15.19:0/3850414433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52301013c0 0x7f5230198360 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.678+0000 7f52387df640 1 --2- 172.21.15.19:0/3850414433 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f52301001d0 0x7f5230197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:54:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.678+0000 7f52387df640 1 -- 172.21.15.19:0/3850414433 >> 172.21.15.19:0/3850414433 conn(0x7f52300fb930 msgr2=0x7f5230108fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:54:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.678+0000 7f52387df640 1 -- 172.21.15.19:0/3850414433 shutdown_connections 2024-09-19T08:54:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:54:56.678+0000 7f52387df640 1 -- 172.21.15.19:0/3850414433 wait complete. 2024-09-19T08:54:56.743 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:56.744 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:56.782 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:56.782 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:56.782 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 56 -lt 100 ']' 2024-09-19T08:54:56.782 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 56 + 1 2024-09-19T08:54:56.921 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=57 2024-09-19T08:54:56.921 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:56.960 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:56.960 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:56.961 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:56.961 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:56.962 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:57.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:57 smithi019 ceph-mon[30976]: pgmap v419: 97 pgs: 97 active+clean; 1.0 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-09-19T08:54:57.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:57 smithi155 ceph-mon[34921]: pgmap v419: 97 pgs: 97 active+clean; 1.0 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-09-19T08:54:57.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:57 smithi203 ceph-mon[35450]: pgmap v419: 97 pgs: 97 active+clean; 1.0 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-09-19T08:54:57.634 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:57.634 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:57.877 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:57.877 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:57.890 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:57.890 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:57.890 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 57 -lt 100 ']' 2024-09-19T08:54:57.890 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 57 + 1 2024-09-19T08:54:57.928 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=58 2024-09-19T08:54:57.928 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:57.993 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:57.993 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:57.994 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:57.995 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:57.995 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:58.740 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:58.740 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:58.859 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:58.859 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:58.865 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:58.865 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:58.865 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 58 -lt 100 ']' 2024-09-19T08:54:58.865 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 58 + 1 2024-09-19T08:54:58.886 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=59 2024-09-19T08:54:58.886 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:58.895 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:58.896 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:58.897 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:58.897 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:58.897 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:59.280 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:59.280 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:59.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:54:59 smithi019 ceph-mon[30976]: pgmap v420: 97 pgs: 97 active+clean; 1.1 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 10 op/s 2024-09-19T08:54:59.410 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:59.410 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:54:59.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:54:59 smithi155 ceph-mon[34921]: pgmap v420: 97 pgs: 97 active+clean; 1.1 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 10 op/s 2024-09-19T08:54:59.433 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:59.433 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:54:59.433 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 59 -lt 100 ']' 2024-09-19T08:54:59.433 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 59 + 1 2024-09-19T08:54:59.461 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=60 2024-09-19T08:54:59.461 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:54:59.472 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:59.472 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:59.473 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:54:59.474 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:54:59.474 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:54:59.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:54:59 smithi203 ceph-mon[35450]: pgmap v420: 97 pgs: 97 active+clean; 1.1 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 KiB/s wr, 10 op/s 2024-09-19T08:54:59.740 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:54:59.741 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:54:59.864 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:54:59.865 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:54:59.992 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:54:59.992 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:00.015 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:00.015 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:00.015 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 60 -lt 100 ']' 2024-09-19T08:55:00.016 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 60 + 1 2024-09-19T08:55:00.069 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=61 2024-09-19T08:55:00.069 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:00.076 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:00.076 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:00.077 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:00.077 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:00.078 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:00.393 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:00.394 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:00.518 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:00.518 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:00.531 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:00.531 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:00.531 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 61 -lt 100 ']' 2024-09-19T08:55:00.531 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 61 + 1 2024-09-19T08:55:00.569 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=62 2024-09-19T08:55:00.569 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:00.608 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:00.608 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:00.609 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:00.610 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:00.610 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:01.030 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:01.030 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:01.251 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:01.252 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:01.264 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:01.264 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:01.265 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 62 -lt 100 ']' 2024-09-19T08:55:01.265 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 62 + 1 2024-09-19T08:55:01.294 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=63 2024-09-19T08:55:01.294 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:01.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:01 smithi019 ceph-mon[30976]: pgmap v421: 97 pgs: 97 active+clean; 1.1 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T08:55:01.337 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:01.337 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:01.338 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:01.338 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:01.338 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:01.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:01 smithi155 ceph-mon[34921]: pgmap v421: 97 pgs: 97 active+clean; 1.1 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T08:55:01.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:01 smithi203 ceph-mon[35450]: pgmap v421: 97 pgs: 97 active+clean; 1.1 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T08:55:01.740 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:01.740 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:01.976 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:01.976 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:01.997 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:01.997 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:01.998 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 63 -lt 100 ']' 2024-09-19T08:55:01.998 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 63 + 1 2024-09-19T08:55:02.049 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=64 2024-09-19T08:55:02.050 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:02.062 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:02.062 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:02.064 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:02.064 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:02.064 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:02.897 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:02.897 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:03.151 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:03.151 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:03.180 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:03.180 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:03.181 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 64 -lt 100 ']' 2024-09-19T08:55:03.181 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 64 + 1 2024-09-19T08:55:03.224 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=65 2024-09-19T08:55:03.225 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:03.245 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:03.245 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:03.247 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:03.247 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:03.247 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:03.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:03 smithi155 ceph-mon[34921]: pgmap v422: 97 pgs: 97 active+clean; 1.1 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T08:55:03.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:03 smithi203 ceph-mon[35450]: pgmap v422: 97 pgs: 97 active+clean; 1.1 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T08:55:03.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:03 smithi019 ceph-mon[30976]: pgmap v422: 97 pgs: 97 active+clean; 1.1 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-19T08:55:04.038 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:04.038 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:04.349 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:04.349 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:04.364 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:04.364 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:04.364 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 65 -lt 100 ']' 2024-09-19T08:55:04.364 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 65 + 1 2024-09-19T08:55:04.417 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=66 2024-09-19T08:55:04.417 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:04.468 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:04.468 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:04.469 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:04.469 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:04.469 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:05.256 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:05.257 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:05.456 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:05.456 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:05.473 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:05.473 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:05.473 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 66 -lt 100 ']' 2024-09-19T08:55:05.473 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 66 + 1 2024-09-19T08:55:05.513 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=67 2024-09-19T08:55:05.513 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:05.543 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:05.543 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:05.544 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:05.544 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:05.544 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:05.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:05 smithi155 ceph-mon[34921]: pgmap v423: 97 pgs: 97 active+clean; 1.2 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T08:55:05.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:05 smithi203 ceph-mon[35450]: pgmap v423: 97 pgs: 97 active+clean; 1.2 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T08:55:05.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:05 smithi019 ceph-mon[30976]: pgmap v423: 97 pgs: 97 active+clean; 1.2 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 19 KiB/s wr, 15 op/s 2024-09-19T08:55:06.128 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:06.128 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:06.384 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:06.384 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:06.405 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:06.405 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:06.405 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 67 -lt 100 ']' 2024-09-19T08:55:06.405 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 67 + 1 2024-09-19T08:55:06.454 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=68 2024-09-19T08:55:06.454 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:06.467 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:06.467 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:06.468 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:06.468 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:06.468 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:06.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:06 smithi155 ceph-mon[34921]: pgmap v424: 97 pgs: 97 active+clean; 1.2 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 14 op/s 2024-09-19T08:55:06.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:06 smithi203 ceph-mon[35450]: pgmap v424: 97 pgs: 97 active+clean; 1.2 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 14 op/s 2024-09-19T08:55:06.795 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:06 smithi019 ceph-mon[30976]: pgmap v424: 97 pgs: 97 active+clean; 1.2 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 17 KiB/s wr, 14 op/s 2024-09-19T08:55:07.011 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:07.012 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:07.205 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:07.206 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:07.223 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:07.223 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:07.223 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 68 -lt 100 ']' 2024-09-19T08:55:07.223 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 68 + 1 2024-09-19T08:55:07.309 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=69 2024-09-19T08:55:07.309 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:07.329 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:07.329 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:07.330 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:07.331 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:07.331 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:07.409 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:08.154 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:08.154 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:08.413 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:08.414 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:08.447 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:08.447 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:08.447 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 69 -lt 100 ']' 2024-09-19T08:55:08.447 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 69 + 1 2024-09-19T08:55:08.525 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=70 2024-09-19T08:55:08.526 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:08.561 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:08.561 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:08.563 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:08.563 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:08.563 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:09.270 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:09 smithi019 ceph-mon[30976]: pgmap v425: 97 pgs: 97 active+clean; 1.2 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-19T08:55:09.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:09 smithi155 ceph-mon[34921]: pgmap v425: 97 pgs: 97 active+clean; 1.2 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-19T08:55:09.479 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:09.479 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:09.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:09 smithi203 ceph-mon[35450]: pgmap v425: 97 pgs: 97 active+clean; 1.2 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 20 KiB/s wr, 13 op/s 2024-09-19T08:55:09.617 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:09.617 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:09.664 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:09.664 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:09.664 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 70 -lt 100 ']' 2024-09-19T08:55:09.664 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 70 + 1 2024-09-19T08:55:09.726 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=71 2024-09-19T08:55:09.727 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:09.748 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:09.748 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:09.749 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:09.749 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:09.749 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:10.737 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:10.738 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:11.158 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:11.159 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:11.171 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:11.172 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:11.172 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 71 -lt 100 ']' 2024-09-19T08:55:11.172 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 71 + 1 2024-09-19T08:55:11.327 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=72 2024-09-19T08:55:11.327 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:11.387 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:11.387 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:11.388 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:11.388 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:11.389 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:11.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:11 smithi155 ceph-mon[34921]: pgmap v426: 97 pgs: 97 active+clean; 1.2 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-19T08:55:11.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:11 smithi203 ceph-mon[35450]: pgmap v426: 97 pgs: 97 active+clean; 1.2 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-19T08:55:11.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:11 smithi019 ceph-mon[30976]: pgmap v426: 97 pgs: 97 active+clean; 1.2 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-19T08:55:12.410 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:12.411 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:12.875 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:12.875 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:12.930 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:12.930 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:12.931 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 72 -lt 100 ']' 2024-09-19T08:55:12.931 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 72 + 1 2024-09-19T08:55:13.036 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=73 2024-09-19T08:55:13.036 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:13.074 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:13.074 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:13.075 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:13.075 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:13.076 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:13.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:13 smithi155 ceph-mon[34921]: pgmap v427: 97 pgs: 97 active+clean; 1.2 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.0 KiB/s wr, 12 op/s 2024-09-19T08:55:13.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:13 smithi203 ceph-mon[35450]: pgmap v427: 97 pgs: 97 active+clean; 1.2 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.0 KiB/s wr, 12 op/s 2024-09-19T08:55:13.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:13 smithi019 ceph-mon[30976]: pgmap v427: 97 pgs: 97 active+clean; 1.2 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.0 KiB/s wr, 12 op/s 2024-09-19T08:55:13.692 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.692+0000 7ff1547fd640 1 -- 172.21.15.19:0/666434579 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff14c109a10 msgr2=0x7ff14c10bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:13.692 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.692+0000 7ff1547fd640 1 --2- 172.21.15.19:0/666434579 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff14c109a10 0x7ff14c10bea0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7ff144009ca0 tx=0x7ff14402a950 comp rx=0 tx=0).stop 2024-09-19T08:55:13.692 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.692+0000 7ff1547fd640 1 -- 172.21.15.19:0/666434579 shutdown_connections 2024-09-19T08:55:13.692 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.692+0000 7ff1547fd640 1 --2- 172.21.15.19:0/666434579 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff14c074bd0 0x7ff14c075030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:13.692 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.692+0000 7ff1547fd640 1 --2- 172.21.15.19:0/666434579 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff14c109a10 0x7ff14c10bea0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:13.692 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.692+0000 7ff1547fd640 1 --2- 172.21.15.19:0/666434579 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff14c0761b0 0x7ff14c074600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:13.693 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.692+0000 7ff1547fd640 1 -- 172.21.15.19:0/666434579 >> 172.21.15.19:0/666434579 conn(0x7ff14c0fd2e0 msgr2=0x7ff14c0ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:13.693 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.692+0000 7ff1547fd640 1 -- 172.21.15.19:0/666434579 shutdown_connections 2024-09-19T08:55:13.693 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.692+0000 7ff1547fd640 1 -- 172.21.15.19:0/666434579 wait complete. 2024-09-19T08:55:13.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.721+0000 7ff1547fd640 1 Processor -- start 2024-09-19T08:55:13.722 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.721+0000 7ff1547fd640 1 -- start start 2024-09-19T08:55:13.722 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.721+0000 7ff1547fd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff14c074bd0 0x7ff14c199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:13.722 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.721+0000 7ff1547fd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff14c0761b0 0x7ff14c19a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:13.722 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.721+0000 7ff1547fd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff14c109a10 0x7ff14c1a1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:13.722 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.721+0000 7ff1547fd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff14c10fa30 con 0x7ff14c074bd0 2024-09-19T08:55:13.722 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.721+0000 7ff1547fd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff14c10f8b0 con 0x7ff14c0761b0 2024-09-19T08:55:13.722 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.721+0000 7ff1547fd640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff14c10fbb0 con 0x7ff14c109a10 2024-09-19T08:55:13.722 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.722+0000 7ff152599640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff14c074bd0 0x7ff14c199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:13.722 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.722+0000 7ff152599640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff14c074bd0 0x7ff14c199f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36870/0 (socket says 172.21.15.19:36870) 2024-09-19T08:55:13.722 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.722+0000 7ff152599640 1 -- 172.21.15.19:0/3120565386 learned_addr learned my addr 172.21.15.19:0/3120565386 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:55:13.722 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.722+0000 7ff151d98640 1 --2- 172.21.15.19:0/3120565386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff14c0761b0 0x7ff14c19a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:13.722 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.722+0000 7ff152d9a640 1 --2- 172.21.15.19:0/3120565386 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff14c109a10 0x7ff14c1a1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:13.722 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.722+0000 7ff152599640 1 -- 172.21.15.19:0/3120565386 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff14c109a10 msgr2=0x7ff14c1a1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:13.723 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.722+0000 7ff152599640 1 --2- 172.21.15.19:0/3120565386 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff14c109a10 0x7ff14c1a1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:13.723 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.722+0000 7ff152599640 1 -- 172.21.15.19:0/3120565386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff14c0761b0 msgr2=0x7ff14c19a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:13.723 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.722+0000 7ff152599640 1 --2- 172.21.15.19:0/3120565386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff14c0761b0 0x7ff14c19a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:13.723 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.722+0000 7ff152599640 1 -- 172.21.15.19:0/3120565386 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff14c1a1bb0 con 0x7ff14c074bd0 2024-09-19T08:55:13.723 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.722+0000 7ff152599640 1 --2- 172.21.15.19:0/3120565386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff14c074bd0 0x7ff14c199f90 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7ff13c00ea60 tx=0x7ff13c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:13.723 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.723+0000 7ff14b7fe640 1 -- 172.21.15.19:0/3120565386 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff13c00cde0 con 0x7ff14c074bd0 2024-09-19T08:55:13.724 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.723+0000 7ff14b7fe640 1 -- 172.21.15.19:0/3120565386 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff13c0035f0 con 0x7ff14c074bd0 2024-09-19T08:55:13.724 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.723+0000 7ff1547fd640 1 -- 172.21.15.19:0/3120565386 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff14c1a1ea0 con 0x7ff14c074bd0 2024-09-19T08:55:13.724 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.723+0000 7ff14b7fe640 1 -- 172.21.15.19:0/3120565386 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff13c010670 con 0x7ff14c074bd0 2024-09-19T08:55:13.725 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.726+0000 7ff14b7fe640 1 -- 172.21.15.19:0/3120565386 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7ff13c0037a0 con 0x7ff14c074bd0 2024-09-19T08:55:13.726 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.727+0000 7ff14b7fe640 1 --2- 172.21.15.19:0/3120565386 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff1340a3460 0x7ff1340a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:13.727 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.727+0000 7ff151d98640 1 --2- 172.21.15.19:0/3120565386 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff1340a3460 0x7ff1340a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:13.727 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.728+0000 7ff151d98640 1 --2- 172.21.15.19:0/3120565386 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff1340a3460 0x7ff1340a5920 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff14c19b4a0 tx=0x7ff140005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:13.735 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.736+0000 7ff1547fd640 1 -- 172.21.15.19:0/3120565386 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff14c1a2310 con 0x7ff14c074bd0 2024-09-19T08:55:13.735 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.736+0000 7ff14b7fe640 1 -- 172.21.15.19:0/3120565386 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff13c0998d0 con 0x7ff14c074bd0 2024-09-19T08:55:13.852 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.852+0000 7ff157680740 1 Processor -- start 2024-09-19T08:55:13.853 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.852+0000 7ff157680740 1 -- start start 2024-09-19T08:55:13.853 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.852+0000 7ff157680740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cdd12869a0 0x55cdd1286da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:13.853 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.852+0000 7ff157680740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cdd12872e0 0x55cdd128bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:13.853 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.852+0000 7ff157680740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdd128c370 0x55cdd128e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:13.853 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.852+0000 7ff157680740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55cdd11ea2f0 con 0x55cdd12872e0 2024-09-19T08:55:13.853 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.852+0000 7ff157680740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55cdd1192270 con 0x55cdd128c370 2024-09-19T08:55:13.853 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.852+0000 7ff157680740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55cdd11e62b0 con 0x55cdd12869a0 2024-09-19T08:55:13.853 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.853+0000 7ff151d98640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cdd12872e0 0x55cdd128bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:13.853 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.853+0000 7ff151d98640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cdd12872e0 0x55cdd128bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36874/0 (socket says 172.21.15.19:36874) 2024-09-19T08:55:13.853 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.853+0000 7ff151d98640 1 -- 172.21.15.19:0/797104825 learned_addr learned my addr 172.21.15.19:0/797104825 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:55:13.853 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.853+0000 7ff152d9a640 1 --2- 172.21.15.19:0/797104825 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdd128c370 0x55cdd128e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:13.854 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.853+0000 7ff152599640 1 --2- 172.21.15.19:0/797104825 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cdd12869a0 0x55cdd1286da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:13.854 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.853+0000 7ff151d98640 1 -- 172.21.15.19:0/797104825 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cdd12869a0 msgr2=0x55cdd1286da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:13.854 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.853+0000 7ff151d98640 1 --2- 172.21.15.19:0/797104825 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cdd12869a0 0x55cdd1286da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:13.854 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.853+0000 7ff151d98640 1 -- 172.21.15.19:0/797104825 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdd128c370 msgr2=0x55cdd128e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:13.854 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.853+0000 7ff151d98640 1 --2- 172.21.15.19:0/797104825 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdd128c370 0x55cdd128e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:13.854 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.853+0000 7ff151d98640 1 -- 172.21.15.19:0/797104825 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdd1191340 con 0x55cdd12872e0 2024-09-19T08:55:13.854 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.853+0000 7ff152d9a640 1 --2- 172.21.15.19:0/797104825 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdd128c370 0x55cdd128e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:55:13.855 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.854+0000 7ff151d98640 1 --2- 172.21.15.19:0/797104825 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cdd12872e0 0x55cdd128bda0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff1400042c0 tx=0x7ff140014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c785ec19373382 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:13.855 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.854+0000 7ff148ff9640 1 -- 172.21.15.19:0/797104825 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff140005020 con 0x55cdd12872e0 2024-09-19T08:55:13.855 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.854+0000 7ff148ff9640 1 -- 172.21.15.19:0/797104825 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1400047a0 con 0x55cdd12872e0 2024-09-19T08:55:13.855 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.854+0000 7ff148ff9640 1 -- 172.21.15.19:0/797104825 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14001e7a0 con 0x55cdd12872e0 2024-09-19T08:55:13.856 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.855+0000 7ff157680740 1 -- 172.21.15.19:0/797104825 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cdd12872e0 msgr2=0x55cdd128bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:13.856 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.855+0000 7ff157680740 1 --2- 172.21.15.19:0/797104825 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cdd12872e0 0x55cdd128bda0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff1400042c0 tx=0x7ff140014000 comp rx=0 tx=0).stop 2024-09-19T08:55:13.856 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.855+0000 7ff157680740 1 -- 172.21.15.19:0/797104825 shutdown_connections 2024-09-19T08:55:13.856 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.855+0000 7ff157680740 1 --2- 172.21.15.19:0/797104825 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdd128c370 0x55cdd128e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:13.856 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.855+0000 7ff157680740 1 --2- 172.21.15.19:0/797104825 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cdd12872e0 0x55cdd128bda0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:13.856 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.855+0000 7ff157680740 1 --2- 172.21.15.19:0/797104825 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cdd12869a0 0x55cdd1286da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:13.856 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.855+0000 7ff157680740 1 -- 172.21.15.19:0/797104825 >> 172.21.15.19:0/797104825 conn(0x55cdd1282010 msgr2=0x55cdd1282410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:13.856 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.855+0000 7ff157680740 1 -- 172.21.15.19:0/797104825 shutdown_connections 2024-09-19T08:55:13.856 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.855+0000 7ff157680740 1 -- 172.21.15.19:0/797104825 wait complete. 2024-09-19T08:55:13.893 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.894+0000 7ff157680740 1 -- start start 2024-09-19T08:55:13.944 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.945+0000 7ff157680740 1 Processor -- start 2024-09-19T08:55:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.952+0000 7ff157680740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cdd12869a0 0x55cdd1290b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.952+0000 7ff157680740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdd12872e0 0x55cdd12910d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.952+0000 7ff157680740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cdd128c370 0x55cdd1298110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.952+0000 7ff157680740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55cdd128f340 con 0x55cdd12869a0 2024-09-19T08:55:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.952+0000 7ff157680740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55cdd1173290 con 0x55cdd12872e0 2024-09-19T08:55:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.952+0000 7ff157680740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55cdd128f4c0 con 0x55cdd128c370 2024-09-19T08:55:13.953 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.953+0000 7ff152599640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cdd12869a0 0x55cdd1290b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.953+0000 7ff152599640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cdd12869a0 0x55cdd1290b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36880/0 (socket says 172.21.15.19:36880) 2024-09-19T08:55:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.953+0000 7ff152599640 1 -- 172.21.15.19:0/3352839065 learned_addr learned my addr 172.21.15.19:0/3352839065 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:55:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.953+0000 7ff151d98640 1 --2- 172.21.15.19:0/3352839065 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdd12872e0 0x55cdd12910d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.953+0000 7ff152d9a640 1 --2- 172.21.15.19:0/3352839065 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cdd128c370 0x55cdd1298110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.953+0000 7ff152599640 1 -- 172.21.15.19:0/3352839065 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cdd128c370 msgr2=0x55cdd1298110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.953+0000 7ff152599640 1 --2- 172.21.15.19:0/3352839065 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cdd128c370 0x55cdd1298110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.953+0000 7ff152599640 1 -- 172.21.15.19:0/3352839065 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdd12872e0 msgr2=0x55cdd12910d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.953+0000 7ff152599640 1 --2- 172.21.15.19:0/3352839065 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdd12872e0 0x55cdd12910d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.953+0000 7ff152599640 1 -- 172.21.15.19:0/3352839065 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cdd0efd210 con 0x55cdd12869a0 2024-09-19T08:55:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.953+0000 7ff152d9a640 1 --2- 172.21.15.19:0/3352839065 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cdd128c370 0x55cdd1298110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:55:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.953+0000 7ff151d98640 1 --2- 172.21.15.19:0/3352839065 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdd12872e0 0x55cdd12910d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:55:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.953+0000 7ff152599640 1 --2- 172.21.15.19:0/3352839065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cdd12869a0 0x55cdd1290b90 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff13c09b7c0 tx=0x7ff13c09bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10e9de5510601692 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:13.954 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.953+0000 7ff131ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:55:13.955 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.953+0000 7ff131ffb640 1 -- 172.21.15.19:0/3352839065 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff13c0a9060 con 0x55cdd12869a0 2024-09-19T08:55:13.955 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.954+0000 7ff131ffb640 1 -- 172.21.15.19:0/3352839065 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff13c0a4010 con 0x55cdd12869a0 2024-09-19T08:55:13.958 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.959+0000 7ff157680740 10 client.0 _ll_register_callbacks cb 0x55cdd11a4140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:55:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.961+0000 7ff157680740 1 -- 172.21.15.19:0/3352839065 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1400047a0 con 0x55cdd12869a0 2024-09-19T08:55:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.962+0000 7ff131ffb640 1 -- 172.21.15.19:0/3352839065 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff13c0a44a0 con 0x55cdd12869a0 2024-09-19T08:55:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.962+0000 7ff157680740 10 client.16053 fetch_fsmap learned FSMap version 30 2024-09-19T08:55:13.961 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.962+0000 7ff157680740 1 -- 172.21.15.19:0/3352839065 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55cdd0fc9620 con 0x55cdd12869a0 2024-09-19T08:55:13.973 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.974+0000 7ff131ffb640 1 -- 172.21.15.19:0/3352839065 <== mon.0 v2:172.21.15.19:3300/0 4 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7ff13c09cb60 con 0x55cdd12869a0 2024-09-19T08:55:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.974+0000 7ff157680740 10 client.16053 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T08:55:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.974+0000 7ff157680740 10 client.16053 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:55:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.975+0000 7ff157680740 20 client.16053 populate_metadata read hostname 'smithi019' 2024-09-19T08:55:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.975+0000 7ff157680740 1 --2- 172.21.15.19:0/3352839065 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55cdd129c600 0x55cdd129eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.975+0000 7ff157680740 4 client.16053 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:55:13.974 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.975+0000 7ff157680740 1 -- 172.21.15.19:0/3352839065 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cdd11f7a20 con 0x55cdd129c600 2024-09-19T08:55:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.975+0000 7ff151d98640 1 --2- 172.21.15.19:0/3352839065 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55cdd129c600 0x55cdd129eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.976+0000 7ff151d98640 1 --2- 172.21.15.19:0/3352839065 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55cdd129c600 0x55cdd129eac0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1063bdf247085210 server_cookie=628c9a336f8e5912 in_seq=0 out_seq=0 2024-09-19T08:55:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.976+0000 7ff131ffb640 10 client.16053 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:55:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.976+0000 7ff131ffb640 1 -- 172.21.15.19:0/3352839065 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cdd11f7a20 con 0x55cdd129c600 2024-09-19T08:55:13.975 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.976+0000 7ff131ffb640 10 client.16053 handle_command_reply: tid=0 2024-09-19T08:55:13.977 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.977+0000 7ff157680740 1 client.16053 shutdown 2024-09-19T08:55:13.977 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.977+0000 7ff157680740 1 -- 172.21.15.19:0/3352839065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cdd12869a0 msgr2=0x55cdd1290b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:13.977 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.977+0000 7ff157680740 1 --2- 172.21.15.19:0/3352839065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cdd12869a0 0x55cdd1290b90 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff13c09b7c0 tx=0x7ff13c09bff0 comp rx=0 tx=0).stop 2024-09-19T08:55:13.977 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.977+0000 7ff157680740 1 -- 172.21.15.19:0/3352839065 shutdown_connections 2024-09-19T08:55:13.977 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.977+0000 7ff157680740 1 --2- 172.21.15.19:0/3352839065 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55cdd129c600 0x55cdd129eac0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:13.977 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.977+0000 7ff157680740 1 --2- 172.21.15.19:0/3352839065 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cdd128c370 0x55cdd1298110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:13.977 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.977+0000 7ff157680740 1 --2- 172.21.15.19:0/3352839065 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdd12872e0 0x55cdd12910d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:13.977 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.977+0000 7ff131ffb640 0 client.16053 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:55:13.978 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.977+0000 7ff157680740 1 --2- 172.21.15.19:0/3352839065 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cdd12869a0 0x55cdd1290b90 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:13.978 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.977+0000 7ff157680740 1 -- 172.21.15.19:0/3352839065 >> 172.21.15.19:0/3352839065 conn(0x55cdd1282010 msgr2=0x55cdd1283820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:13.978 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.977+0000 7ff157680740 1 -- 172.21.15.19:0/3352839065 shutdown_connections 2024-09-19T08:55:13.978 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.977+0000 7ff157680740 1 -- 172.21.15.19:0/3352839065 wait complete. 2024-09-19T08:55:13.978 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:13.978+0000 7ff157680740 20 client.16053 trim_cache size 0 max 16384 2024-09-19T08:55:14.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.003+0000 7ff157680740 1 Processor -- start 2024-09-19T08:55:14.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.003+0000 7ff157680740 1 -- start start 2024-09-19T08:55:14.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.003+0000 7ff157680740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cdd12869a0 0x55cdd1291050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:14.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.003+0000 7ff157680740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdd12872e0 0x55cdd12980d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:14.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.003+0000 7ff157680740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cdd128c370 0x55cdd1282f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:14.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.003+0000 7ff157680740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff14c1ab1b0 con 0x55cdd12869a0 2024-09-19T08:55:14.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.003+0000 7ff157680740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff14c1acdb0 con 0x55cdd12872e0 2024-09-19T08:55:14.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.003+0000 7ff157680740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff14c1ab880 con 0x55cdd128c370 2024-09-19T08:55:14.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.004+0000 7ff152599640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cdd12869a0 0x55cdd1291050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:14.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.004+0000 7ff152599640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cdd12869a0 0x55cdd1291050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36886/0 (socket says 172.21.15.19:36886) 2024-09-19T08:55:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.004+0000 7ff152599640 1 -- 172.21.15.19:0/1526008295 learned_addr learned my addr 172.21.15.19:0/1526008295 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:55:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.004+0000 7ff151d98640 1 --2- 172.21.15.19:0/1526008295 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdd12872e0 0x55cdd12980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.004+0000 7ff152d9a640 1 --2- 172.21.15.19:0/1526008295 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cdd128c370 0x55cdd1282f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.004+0000 7ff152599640 1 -- 172.21.15.19:0/1526008295 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cdd128c370 msgr2=0x55cdd1282f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.004+0000 7ff152599640 1 --2- 172.21.15.19:0/1526008295 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cdd128c370 0x55cdd1282f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.004+0000 7ff152599640 1 -- 172.21.15.19:0/1526008295 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdd12872e0 msgr2=0x55cdd12980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.004+0000 7ff152599640 1 --2- 172.21.15.19:0/1526008295 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdd12872e0 0x55cdd12980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.004+0000 7ff152599640 1 -- 172.21.15.19:0/1526008295 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdd12877c0 con 0x55cdd12869a0 2024-09-19T08:55:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.004+0000 7ff152d9a640 1 --2- 172.21.15.19:0/1526008295 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cdd128c370 0x55cdd1282f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:55:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.004+0000 7ff152599640 1 --2- 172.21.15.19:0/1526008295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cdd12869a0 0x55cdd1291050 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0a3f70 tx=0x7ff13c0b7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71bf924a693e25f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.004+0000 7ff133fff640 1 -- 172.21.15.19:0/1526008295 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff13c09cb60 con 0x55cdd12869a0 2024-09-19T08:55:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.005+0000 7ff133fff640 1 -- 172.21.15.19:0/1526008295 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1400047a0 con 0x55cdd12869a0 2024-09-19T08:55:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.005+0000 7ff133fff640 1 -- 172.21.15.19:0/1526008295 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff13c09aee0 con 0x55cdd12869a0 2024-09-19T08:55:14.009 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.005+0000 7ff157680740 1 -- 172.21.15.19:0/1526008295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cdd12869a0 msgr2=0x55cdd1291050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:14.009 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.005+0000 7ff157680740 1 --2- 172.21.15.19:0/1526008295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cdd12869a0 0x55cdd1291050 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff13c0a3f70 tx=0x7ff13c0b7000 comp rx=0 tx=0).stop 2024-09-19T08:55:14.009 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.005+0000 7ff157680740 1 -- 172.21.15.19:0/1526008295 shutdown_connections 2024-09-19T08:55:14.009 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.005+0000 7ff157680740 1 --2- 172.21.15.19:0/1526008295 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cdd128c370 0x55cdd1282f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.009 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.005+0000 7ff157680740 1 --2- 172.21.15.19:0/1526008295 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdd12872e0 0x55cdd12980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.009 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.005+0000 7ff157680740 1 --2- 172.21.15.19:0/1526008295 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cdd12869a0 0x55cdd1291050 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.009 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.005+0000 7ff157680740 1 -- 172.21.15.19:0/1526008295 >> 172.21.15.19:0/1526008295 conn(0x55cdd1282010 msgr2=0x55cdd1290940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.005+0000 7ff157680740 1 -- 172.21.15.19:0/1526008295 shutdown_connections 2024-09-19T08:55:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.006+0000 7ff157680740 1 -- 172.21.15.19:0/1526008295 wait complete. 2024-09-19T08:55:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.006+0000 7ff157680740 1 -- start start 2024-09-19T08:55:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.006+0000 7ff157680740 1 Processor -- start 2024-09-19T08:55:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.006+0000 7ff157680740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cdd12869a0 0x55cdd1295af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.006+0000 7ff157680740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdd12872e0 0x55cdd1296030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.006+0000 7ff157680740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cdd128c370 0x55cdd1296ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.006+0000 7ff157680740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff14c1ac620 con 0x55cdd128c370 2024-09-19T08:55:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.006+0000 7ff157680740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff14c1abf50 con 0x55cdd12872e0 2024-09-19T08:55:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.006+0000 7ff157680740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff14c1a9120 con 0x55cdd12869a0 2024-09-19T08:55:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.006+0000 7ff157680740 10 client.0 _ll_register_callbacks cb 0x7ff13c0973f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:55:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.006+0000 7ff152d9a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cdd128c370 0x55cdd1296ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.006+0000 7ff152d9a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cdd128c370 0x55cdd1296ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36892/0 (socket says 172.21.15.19:36892) 2024-09-19T08:55:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.006+0000 7ff152d9a640 1 -- 172.21.15.19:0/1942522811 learned_addr learned my addr 172.21.15.19:0/1942522811 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:55:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.006+0000 7ff151d98640 1 --2- 172.21.15.19:0/1942522811 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdd12872e0 0x55cdd1296030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.007+0000 7ff152599640 1 --2- 172.21.15.19:0/1942522811 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cdd12869a0 0x55cdd1295af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.007+0000 7ff152d9a640 1 -- 172.21.15.19:0/1942522811 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cdd12869a0 msgr2=0x55cdd1295af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.007+0000 7ff152d9a640 1 --2- 172.21.15.19:0/1942522811 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cdd12869a0 0x55cdd1295af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.007+0000 7ff152d9a640 1 -- 172.21.15.19:0/1942522811 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdd12872e0 msgr2=0x55cdd1296030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.007+0000 7ff152d9a640 1 --2- 172.21.15.19:0/1942522811 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdd12872e0 0x55cdd1296030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.007+0000 7ff152d9a640 1 -- 172.21.15.19:0/1942522811 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cdd1297600 con 0x55cdd128c370 2024-09-19T08:55:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.007+0000 7ff151d98640 1 --2- 172.21.15.19:0/1942522811 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdd12872e0 0x55cdd1296030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:55:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.007+0000 7ff152d9a640 1 --2- 172.21.15.19:0/1942522811 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cdd128c370 0x55cdd1296ff0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ff14402f870 tx=0x7ff14402fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36773a56c1521d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.007+0000 7ff131ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:55:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.007+0000 7ff131ffb640 1 -- 172.21.15.19:0/1942522811 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff144034040 con 0x55cdd128c370 2024-09-19T08:55:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.007+0000 7ff131ffb640 1 -- 172.21.15.19:0/1942522811 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff144003d80 con 0x55cdd128c370 2024-09-19T08:55:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.007+0000 7ff157680740 1 -- 172.21.15.19:0/1942522811 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1400047a0 con 0x55cdd128c370 2024-09-19T08:55:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.007+0000 7ff131ffb640 1 -- 172.21.15.19:0/1942522811 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff144004040 con 0x55cdd128c370 2024-09-19T08:55:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.007+0000 7ff157680740 10 client.16059 fetch_fsmap learned FSMap version 30 2024-09-19T08:55:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.007+0000 7ff157680740 1 -- 172.21.15.19:0/1942522811 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55cdd13076d0 con 0x55cdd128c370 2024-09-19T08:55:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.008+0000 7ff131ffb640 1 -- 172.21.15.19:0/1942522811 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff1400047a0 con 0x55cdd128c370 2024-09-19T08:55:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.008+0000 7ff131ffb640 1 -- 172.21.15.19:0/1942522811 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7ff14404e030 con 0x55cdd128c370 2024-09-19T08:55:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.008+0000 7ff157680740 10 client.16059 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T08:55:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.008+0000 7ff157680740 10 client.16059 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:55:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.008+0000 7ff157680740 20 client.16059 populate_metadata read hostname 'smithi019' 2024-09-19T08:55:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.008+0000 7ff157680740 1 --2- 172.21.15.19:0/1942522811 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55cdd1308190 0x55cdd130a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.008+0000 7ff157680740 4 client.16059 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:55:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.008+0000 7ff157680740 1 -- 172.21.15.19:0/1942522811 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cdd11f1d70 con 0x55cdd1308190 2024-09-19T08:55:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.008+0000 7ff152599640 1 --2- 172.21.15.19:0/1942522811 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55cdd1308190 0x55cdd130a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:14.013 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.009+0000 7ff131ffb640 10 client.16059 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:55:14.013 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.009+0000 7ff152599640 1 --2- 172.21.15.19:0/1942522811 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55cdd1308190 0x55cdd130a5b0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2f5dd8a8b72ae4b server_cookie=d7800713cea4b552 in_seq=0 out_seq=0 2024-09-19T08:55:14.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.016+0000 7ff131ffb640 1 -- 172.21.15.19:0/1942522811 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cdd11f1d70 con 0x55cdd1308190 2024-09-19T08:55:14.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.016+0000 7ff131ffb640 10 client.16059 handle_command_reply: tid=0 2024-09-19T08:55:14.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.016+0000 7ff157680740 1 client.16059 shutdown 2024-09-19T08:55:14.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.016+0000 7ff157680740 1 -- 172.21.15.19:0/1942522811 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cdd128c370 msgr2=0x55cdd1296ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:14.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.016+0000 7ff157680740 1 --2- 172.21.15.19:0/1942522811 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cdd128c370 0x55cdd1296ff0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ff14402f870 tx=0x7ff14402fce0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.016+0000 7ff157680740 1 -- 172.21.15.19:0/1942522811 shutdown_connections 2024-09-19T08:55:14.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.016+0000 7ff157680740 1 --2- 172.21.15.19:0/1942522811 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55cdd1308190 0x55cdd130a5b0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.017+0000 7ff157680740 1 --2- 172.21.15.19:0/1942522811 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cdd128c370 0x55cdd1296ff0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.017+0000 7ff157680740 1 --2- 172.21.15.19:0/1942522811 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cdd12872e0 0x55cdd1296030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.017+0000 7ff157680740 1 --2- 172.21.15.19:0/1942522811 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cdd12869a0 0x55cdd1295af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.017+0000 7ff131ffb640 0 client.16059 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:55:14.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.017+0000 7ff157680740 1 -- 172.21.15.19:0/1942522811 >> 172.21.15.19:0/1942522811 conn(0x55cdd1282010 msgr2=0x55cdd12809a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:14.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.017+0000 7ff157680740 1 -- 172.21.15.19:0/1942522811 shutdown_connections 2024-09-19T08:55:14.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.017+0000 7ff157680740 1 -- 172.21.15.19:0/1942522811 wait complete. 2024-09-19T08:55:14.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.017+0000 7ff157680740 20 client.16059 trim_cache size 0 max 16384 2024-09-19T08:55:14.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T08:55:14.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T08:55:14.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T08:55:14.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T08:55:14.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.017+0000 7ff1547fd640 1 -- 172.21.15.19:0/3120565386 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff1340a3460 msgr2=0x7ff1340a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:14.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.017+0000 7ff1547fd640 1 --2- 172.21.15.19:0/3120565386 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff1340a3460 0x7ff1340a5920 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff14c19b4a0 tx=0x7ff140005f90 comp rx=0 tx=0).stop 2024-09-19T08:55:14.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.017+0000 7ff1547fd640 1 -- 172.21.15.19:0/3120565386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff14c074bd0 msgr2=0x7ff14c199f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.017+0000 7ff1547fd640 1 --2- 172.21.15.19:0/3120565386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff14c074bd0 0x7ff14c199f90 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7ff13c00ea60 tx=0x7ff13c00ef20 comp rx=0 tx=0).stop 2024-09-19T08:55:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.017+0000 7ff1547fd640 1 -- 172.21.15.19:0/3120565386 shutdown_connections 2024-09-19T08:55:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.017+0000 7ff1547fd640 1 --2- 172.21.15.19:0/3120565386 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff1340a3460 0x7ff1340a5920 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.017+0000 7ff1547fd640 1 --2- 172.21.15.19:0/3120565386 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff14c109a10 0x7ff14c1a1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.017+0000 7ff1547fd640 1 --2- 172.21.15.19:0/3120565386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff14c0761b0 0x7ff14c19a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.017+0000 7ff1547fd640 1 --2- 172.21.15.19:0/3120565386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff14c074bd0 0x7ff14c199f90 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.017+0000 7ff1547fd640 1 -- 172.21.15.19:0/3120565386 >> 172.21.15.19:0/3120565386 conn(0x7ff14c0fd2e0 msgr2=0x7ff14c1059a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.018+0000 7ff1547fd640 1 -- 172.21.15.19:0/3120565386 shutdown_connections 2024-09-19T08:55:14.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:14.018+0000 7ff1547fd640 1 -- 172.21.15.19:0/3120565386 wait complete. 2024-09-19T08:55:14.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.021+0000 7ff598644640 1 -- 172.21.15.19:0/2439320535 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff590100100 msgr2=0x7ff590100560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:14.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.021+0000 7ff598644640 1 --2- 172.21.15.19:0/2439320535 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff590100100 0x7ff590100560 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff580009900 tx=0x7ff58002a410 comp rx=0 tx=0).stop 2024-09-19T08:55:14.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.021+0000 7ff598644640 1 -- 172.21.15.19:0/2439320535 shutdown_connections 2024-09-19T08:55:14.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.021+0000 7ff598644640 1 --2- 172.21.15.19:0/2439320535 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff590100aa0 0x7ff59010ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.021+0000 7ff598644640 1 --2- 172.21.15.19:0/2439320535 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff590100100 0x7ff590100560 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.021+0000 7ff598644640 1 --2- 172.21.15.19:0/2439320535 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff590106b80 0x7ff590106f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.021+0000 7ff598644640 1 -- 172.21.15.19:0/2439320535 >> 172.21.15.19:0/2439320535 conn(0x7ff590077230 msgr2=0x7ff5900fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:14.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.021+0000 7ff598644640 1 -- 172.21.15.19:0/2439320535 shutdown_connections 2024-09-19T08:55:14.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.022+0000 7ff598644640 1 -- 172.21.15.19:0/2439320535 wait complete. 2024-09-19T08:55:14.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.022+0000 7ff598644640 1 Processor -- start 2024-09-19T08:55:14.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.022+0000 7ff598644640 1 -- start start 2024-09-19T08:55:14.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.023+0000 7ff598644640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff590100100 0x7ff5901984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:14.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.023+0000 7ff598644640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff590100aa0 0x7ff590198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:14.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.023+0000 7ff598644640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff590106b80 0x7ff59019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:14.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.023+0000 7ff598644640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff590112050 con 0x7ff590100100 2024-09-19T08:55:14.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.023+0000 7ff5963e0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff590100100 0x7ff5901984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:14.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.023+0000 7ff598644640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff590111ed0 con 0x7ff590106b80 2024-09-19T08:55:14.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.023+0000 7ff598644640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff5901121d0 con 0x7ff590100aa0 2024-09-19T08:55:14.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.023+0000 7ff5963e0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff590100100 0x7ff5901984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36906/0 (socket says 172.21.15.19:36906) 2024-09-19T08:55:14.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.023+0000 7ff5963e0640 1 -- 172.21.15.19:0/493024902 learned_addr learned my addr 172.21.15.19:0/493024902 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:55:14.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.023+0000 7ff595bdf640 1 --2- 172.21.15.19:0/493024902 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff590100aa0 0x7ff590198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:14.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.023+0000 7ff596be1640 1 --2- 172.21.15.19:0/493024902 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff590106b80 0x7ff59019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:14.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.023+0000 7ff5963e0640 1 -- 172.21.15.19:0/493024902 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff590100aa0 msgr2=0x7ff590198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:14.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.023+0000 7ff5963e0640 1 --2- 172.21.15.19:0/493024902 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff590100aa0 0x7ff590198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.023+0000 7ff5963e0640 1 -- 172.21.15.19:0/493024902 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff590106b80 msgr2=0x7ff59019cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:14.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.023+0000 7ff5963e0640 1 --2- 172.21.15.19:0/493024902 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff590106b80 0x7ff59019cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.023+0000 7ff5963e0640 1 -- 172.21.15.19:0/493024902 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff59019d470 con 0x7ff590100100 2024-09-19T08:55:14.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.023+0000 7ff596be1640 1 --2- 172.21.15.19:0/493024902 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff590106b80 0x7ff59019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:55:14.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.024+0000 7ff5963e0640 1 --2- 172.21.15.19:0/493024902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff590100100 0x7ff5901984c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff58c00d950 tx=0x7ff58c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:14.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.024+0000 7ff5877fe640 1 -- 172.21.15.19:0/493024902 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58c017070 con 0x7ff590100100 2024-09-19T08:55:14.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.024+0000 7ff598644640 1 -- 172.21.15.19:0/493024902 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff59019d760 con 0x7ff590100100 2024-09-19T08:55:14.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.024+0000 7ff5877fe640 1 -- 172.21.15.19:0/493024902 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff58c009c30 con 0x7ff590100100 2024-09-19T08:55:14.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.024+0000 7ff5877fe640 1 -- 172.21.15.19:0/493024902 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58c00f6b0 con 0x7ff590100100 2024-09-19T08:55:14.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.024+0000 7ff598644640 1 -- 172.21.15.19:0/493024902 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5901a5040 con 0x7ff590100100 2024-09-19T08:55:14.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.027+0000 7ff5877fe640 1 -- 172.21.15.19:0/493024902 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7ff58c0109d0 con 0x7ff590100100 2024-09-19T08:55:14.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.028+0000 7ff5877fe640 1 --2- 172.21.15.19:0/493024902 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff57c0a3240 0x7ff57c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:14.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.028+0000 7ff595bdf640 1 --2- 172.21.15.19:0/493024902 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff57c0a3240 0x7ff57c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:14.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.028+0000 7ff5877fe640 1 -- 172.21.15.19:0/493024902 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff58c0cf910 con 0x7ff590100100 2024-09-19T08:55:14.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.028+0000 7ff595bdf640 1 --2- 172.21.15.19:0/493024902 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff57c0a3240 0x7ff57c0a5700 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff580009230 tx=0x7ff5800058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:14.128 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:14.129 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:14.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.250+0000 7ff59aa1d740 1 Processor -- start 2024-09-19T08:55:14.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.250+0000 7ff59aa1d740 1 -- start start 2024-09-19T08:55:14.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.251+0000 7ff59aa1d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56061fa37b60 0x56061fa37f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:14.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.251+0000 7ff59aa1d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56061fa38480 0x56061fa42800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:14.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.251+0000 7ff59aa1d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56061fa42d40 0x56061fa45130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:14.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.251+0000 7ff59aa1d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56061f99d280 con 0x56061fa42d40 2024-09-19T08:55:14.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.251+0000 7ff59aa1d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56061f944b10 con 0x56061fa38480 2024-09-19T08:55:14.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.251+0000 7ff59aa1d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56061f999240 con 0x56061fa37b60 2024-09-19T08:55:14.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.251+0000 7ff596be1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56061fa42d40 0x56061fa45130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:14.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.251+0000 7ff596be1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56061fa42d40 0x56061fa45130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36918/0 (socket says 172.21.15.19:36918) 2024-09-19T08:55:14.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.251+0000 7ff596be1640 1 -- 172.21.15.19:0/694288208 learned_addr learned my addr 172.21.15.19:0/694288208 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:55:14.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.251+0000 7ff5963e0640 1 --2- 172.21.15.19:0/694288208 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56061fa37b60 0x56061fa37f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:14.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.251+0000 7ff595bdf640 1 --2- 172.21.15.19:0/694288208 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56061fa38480 0x56061fa42800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:14.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.251+0000 7ff596be1640 1 -- 172.21.15.19:0/694288208 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56061fa37b60 msgr2=0x56061fa37f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:14.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.251+0000 7ff596be1640 1 --2- 172.21.15.19:0/694288208 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56061fa37b60 0x56061fa37f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.251+0000 7ff596be1640 1 -- 172.21.15.19:0/694288208 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56061fa38480 msgr2=0x56061fa42800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:14.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.251+0000 7ff596be1640 1 --2- 172.21.15.19:0/694288208 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56061fa38480 0x56061fa42800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.251+0000 7ff596be1640 1 -- 172.21.15.19:0/694288208 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56061f9511f0 con 0x56061fa42d40 2024-09-19T08:55:14.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.252+0000 7ff596be1640 1 --2- 172.21.15.19:0/694288208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56061fa42d40 0x56061fa45130 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ff588010480 tx=0x7ff588009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=419d003dce82d42d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:14.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.252+0000 7ff584ff9640 1 -- 172.21.15.19:0/694288208 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff588011760 con 0x56061fa42d40 2024-09-19T08:55:14.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.252+0000 7ff584ff9640 1 -- 172.21.15.19:0/694288208 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff588011de0 con 0x56061fa42d40 2024-09-19T08:55:14.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.252+0000 7ff584ff9640 1 -- 172.21.15.19:0/694288208 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58801a380 con 0x56061fa42d40 2024-09-19T08:55:14.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.253+0000 7ff59aa1d740 1 -- 172.21.15.19:0/694288208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56061fa42d40 msgr2=0x56061fa45130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:14.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.253+0000 7ff59aa1d740 1 --2- 172.21.15.19:0/694288208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56061fa42d40 0x56061fa45130 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ff588010480 tx=0x7ff588009f90 comp rx=0 tx=0).stop 2024-09-19T08:55:14.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.253+0000 7ff59aa1d740 1 -- 172.21.15.19:0/694288208 shutdown_connections 2024-09-19T08:55:14.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.253+0000 7ff59aa1d740 1 --2- 172.21.15.19:0/694288208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56061fa42d40 0x56061fa45130 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.253+0000 7ff59aa1d740 1 --2- 172.21.15.19:0/694288208 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56061fa38480 0x56061fa42800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.253+0000 7ff59aa1d740 1 --2- 172.21.15.19:0/694288208 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56061fa37b60 0x56061fa37f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.253+0000 7ff59aa1d740 1 -- 172.21.15.19:0/694288208 >> 172.21.15.19:0/694288208 conn(0x56061fa340f0 msgr2=0x56061fa344d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:14.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.253+0000 7ff59aa1d740 1 -- 172.21.15.19:0/694288208 shutdown_connections 2024-09-19T08:55:14.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.253+0000 7ff59aa1d740 1 -- 172.21.15.19:0/694288208 wait complete. 2024-09-19T08:55:14.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.253+0000 7ff59aa1d740 1 -- start start 2024-09-19T08:55:14.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.253+0000 7ff59aa1d740 1 Processor -- start 2024-09-19T08:55:14.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.254+0000 7ff59aa1d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56061fa37b60 0x56061fa3fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:14.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.254+0000 7ff59aa1d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56061fa38480 0x56061fa40120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:14.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.254+0000 7ff59aa1d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56061fa42d40 0x56061fa40660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:14.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.254+0000 7ff59aa1d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56061fa49d20 con 0x56061fa38480 2024-09-19T08:55:14.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.254+0000 7ff59aa1d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56061f957f10 con 0x56061fa37b60 2024-09-19T08:55:14.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.254+0000 7ff59aa1d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56061fa49ea0 con 0x56061fa42d40 2024-09-19T08:55:14.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.254+0000 7ff59aa1d740 10 client.0 _ll_register_callbacks cb 0x56061f920a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:55:14.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.254+0000 7ff595bdf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56061fa38480 0x56061fa40120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:14.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.254+0000 7ff595bdf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56061fa38480 0x56061fa40120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36932/0 (socket says 172.21.15.19:36932) 2024-09-19T08:55:14.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.254+0000 7ff595bdf640 1 -- 172.21.15.19:0/2563051991 learned_addr learned my addr 172.21.15.19:0/2563051991 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:55:14.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.254+0000 7ff596be1640 1 --2- 172.21.15.19:0/2563051991 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56061fa42d40 0x56061fa40660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:14.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.254+0000 7ff5963e0640 1 --2- 172.21.15.19:0/2563051991 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56061fa37b60 0x56061fa3fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:14.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.254+0000 7ff595bdf640 1 -- 172.21.15.19:0/2563051991 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56061fa42d40 msgr2=0x56061fa40660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:14.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.254+0000 7ff595bdf640 1 --2- 172.21.15.19:0/2563051991 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56061fa42d40 0x56061fa40660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.254+0000 7ff595bdf640 1 -- 172.21.15.19:0/2563051991 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56061fa37b60 msgr2=0x56061fa3fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:14.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.255+0000 7ff595bdf640 1 --2- 172.21.15.19:0/2563051991 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56061fa37b60 0x56061fa3fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.255+0000 7ff595bdf640 1 -- 172.21.15.19:0/2563051991 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56061f70e6a0 con 0x56061fa38480 2024-09-19T08:55:14.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.255+0000 7ff596be1640 1 --2- 172.21.15.19:0/2563051991 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56061fa42d40 0x56061fa40660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:55:14.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.255+0000 7ff595bdf640 1 --2- 172.21.15.19:0/2563051991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56061fa38480 0x56061fa40120 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ff580033000 tx=0x7ff580009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e115b53f2c0b25d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:14.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.255+0000 7ff579ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:55:14.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.255+0000 7ff579ffb640 1 -- 172.21.15.19:0/2563051991 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58004e070 con 0x56061fa38480 2024-09-19T08:55:14.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.255+0000 7ff579ffb640 1 -- 172.21.15.19:0/2563051991 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff5800035f0 con 0x56061fa38480 2024-09-19T08:55:14.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.255+0000 7ff59aa1d740 1 -- 172.21.15.19:0/2563051991 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff588011de0 con 0x56061fa38480 2024-09-19T08:55:14.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.255+0000 7ff579ffb640 1 -- 172.21.15.19:0/2563051991 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff58005a050 con 0x56061fa38480 2024-09-19T08:55:14.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.255+0000 7ff59aa1d740 10 client.16071 fetch_fsmap learned FSMap version 30 2024-09-19T08:55:14.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.255+0000 7ff59aa1d740 1 -- 172.21.15.19:0/2563051991 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56061fa558f0 con 0x56061fa38480 2024-09-19T08:55:14.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.256+0000 7ff579ffb640 1 -- 172.21.15.19:0/2563051991 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff588011de0 con 0x56061fa38480 2024-09-19T08:55:14.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.256+0000 7ff579ffb640 1 -- 172.21.15.19:0/2563051991 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7ff58004a8e0 con 0x56061fa38480 2024-09-19T08:55:14.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.256+0000 7ff59aa1d740 10 client.16071 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T08:55:14.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.256+0000 7ff59aa1d740 10 client.16071 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:55:14.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.256+0000 7ff59aa1d740 20 client.16071 populate_metadata read hostname 'smithi019' 2024-09-19T08:55:14.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.256+0000 7ff59aa1d740 1 --2- 172.21.15.19:0/2563051991 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56061fa56e20 0x56061fa59240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:14.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.256+0000 7ff59aa1d740 4 client.16071 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:55:14.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.256+0000 7ff59aa1d740 1 -- 172.21.15.19:0/2563051991 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56061f9aa7f0 con 0x56061fa56e20 2024-09-19T08:55:14.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.256+0000 7ff5963e0640 1 --2- 172.21.15.19:0/2563051991 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56061fa56e20 0x56061fa59240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:14.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.257+0000 7ff5963e0640 1 --2- 172.21.15.19:0/2563051991 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56061fa56e20 0x56061fa59240 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=582c88e8c6f02f65 server_cookie=e6af3167d4effd2d in_seq=0 out_seq=0 2024-09-19T08:55:14.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.257+0000 7ff579ffb640 10 client.16071 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:55:14.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.258+0000 7ff579ffb640 1 -- 172.21.15.19:0/2563051991 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56061f9aa7f0 con 0x56061fa56e20 2024-09-19T08:55:14.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.258+0000 7ff579ffb640 10 client.16071 handle_command_reply: tid=0 2024-09-19T08:55:14.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.258+0000 7ff59aa1d740 1 client.16071 shutdown 2024-09-19T08:55:14.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.258+0000 7ff59aa1d740 1 -- 172.21.15.19:0/2563051991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56061fa38480 msgr2=0x56061fa40120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:14.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.258+0000 7ff59aa1d740 1 --2- 172.21.15.19:0/2563051991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56061fa38480 0x56061fa40120 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7ff580033000 tx=0x7ff580009260 comp rx=0 tx=0).stop 2024-09-19T08:55:14.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.258+0000 7ff59aa1d740 1 -- 172.21.15.19:0/2563051991 shutdown_connections 2024-09-19T08:55:14.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.258+0000 7ff59aa1d740 1 --2- 172.21.15.19:0/2563051991 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56061fa56e20 0x56061fa59240 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.258+0000 7ff59aa1d740 1 --2- 172.21.15.19:0/2563051991 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56061fa42d40 0x56061fa40660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.258+0000 7ff59aa1d740 1 --2- 172.21.15.19:0/2563051991 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56061fa38480 0x56061fa40120 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.258+0000 7ff59aa1d740 1 --2- 172.21.15.19:0/2563051991 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56061fa37b60 0x56061fa3fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.258+0000 7ff579ffb640 0 client.16071 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:55:14.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.258+0000 7ff59aa1d740 1 -- 172.21.15.19:0/2563051991 >> 172.21.15.19:0/2563051991 conn(0x56061fa340f0 msgr2=0x56061fa33270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:14.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.258+0000 7ff59aa1d740 1 -- 172.21.15.19:0/2563051991 shutdown_connections 2024-09-19T08:55:14.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.258+0000 7ff59aa1d740 1 -- 172.21.15.19:0/2563051991 wait complete. 2024-09-19T08:55:14.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.258+0000 7ff59aa1d740 20 client.16071 trim_cache size 0 max 16384 2024-09-19T08:55:14.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.276+0000 7ff59aa1d740 1 Processor -- start 2024-09-19T08:55:14.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.276+0000 7ff59aa1d740 1 -- start start 2024-09-19T08:55:14.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.277+0000 7ff59aa1d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56061fa37b60 0x56061fa41a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:14.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.277+0000 7ff59aa1d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56061fa38480 0x56061fa5eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:14.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.277+0000 7ff59aa1d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56061fa42d40 0x56061fa5f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:14.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.277+0000 7ff59aa1d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff5901ab350 con 0x56061fa38480 2024-09-19T08:55:14.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.277+0000 7ff59aa1d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff5901acf50 con 0x56061fa42d40 2024-09-19T08:55:14.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.277+0000 7ff59aa1d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff5901aba20 con 0x56061fa37b60 2024-09-19T08:55:14.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.277+0000 7ff595bdf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56061fa38480 0x56061fa5eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:14.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.277+0000 7ff595bdf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56061fa38480 0x56061fa5eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36940/0 (socket says 172.21.15.19:36940) 2024-09-19T08:55:14.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.277+0000 7ff595bdf640 1 -- 172.21.15.19:0/1897735374 learned_addr learned my addr 172.21.15.19:0/1897735374 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:55:14.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.277+0000 7ff596be1640 1 --2- 172.21.15.19:0/1897735374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56061fa42d40 0x56061fa5f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:14.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.277+0000 7ff5963e0640 1 --2- 172.21.15.19:0/1897735374 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56061fa37b60 0x56061fa41a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:14.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.277+0000 7ff595bdf640 1 -- 172.21.15.19:0/1897735374 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56061fa37b60 msgr2=0x56061fa41a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:14.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.277+0000 7ff595bdf640 1 --2- 172.21.15.19:0/1897735374 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56061fa37b60 0x56061fa41a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.277+0000 7ff595bdf640 1 -- 172.21.15.19:0/1897735374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56061fa42d40 msgr2=0x56061fa5f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:14.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.277+0000 7ff595bdf640 1 --2- 172.21.15.19:0/1897735374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56061fa42d40 0x56061fa5f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.277+0000 7ff595bdf640 1 -- 172.21.15.19:0/1897735374 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56061fa33f20 con 0x56061fa38480 2024-09-19T08:55:14.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.277+0000 7ff596be1640 1 --2- 172.21.15.19:0/1897735374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56061fa42d40 0x56061fa5f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:55:14.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.277+0000 7ff5963e0640 1 --2- 172.21.15.19:0/1897735374 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56061fa37b60 0x56061fa41a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:55:14.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.278+0000 7ff595bdf640 1 --2- 172.21.15.19:0/1897735374 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56061fa38480 0x56061fa5eb50 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff58002a930 tx=0x7ff5800097c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a64dbd8dda84683 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:14.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.278+0000 7ff57bfff640 1 -- 172.21.15.19:0/1897735374 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58004e050 con 0x56061fa38480 2024-09-19T08:55:14.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.278+0000 7ff57bfff640 1 -- 172.21.15.19:0/1897735374 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff580031970 con 0x56061fa38480 2024-09-19T08:55:14.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.278+0000 7ff57bfff640 1 -- 172.21.15.19:0/1897735374 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff580035040 con 0x56061fa38480 2024-09-19T08:55:14.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.278+0000 7ff59aa1d740 1 -- 172.21.15.19:0/1897735374 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56061fa38480 msgr2=0x56061fa5eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:14.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.278+0000 7ff59aa1d740 1 --2- 172.21.15.19:0/1897735374 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56061fa38480 0x56061fa5eb50 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7ff58002a930 tx=0x7ff5800097c0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.279+0000 7ff59aa1d740 1 -- 172.21.15.19:0/1897735374 shutdown_connections 2024-09-19T08:55:14.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.279+0000 7ff59aa1d740 1 --2- 172.21.15.19:0/1897735374 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56061fa42d40 0x56061fa5f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.279+0000 7ff59aa1d740 1 --2- 172.21.15.19:0/1897735374 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56061fa38480 0x56061fa5eb50 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.279+0000 7ff59aa1d740 1 --2- 172.21.15.19:0/1897735374 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56061fa37b60 0x56061fa41a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.279+0000 7ff59aa1d740 1 -- 172.21.15.19:0/1897735374 >> 172.21.15.19:0/1897735374 conn(0x56061fa340f0 msgr2=0x56061fa41330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:14.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.279+0000 7ff59aa1d740 1 -- 172.21.15.19:0/1897735374 shutdown_connections 2024-09-19T08:55:14.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.279+0000 7ff59aa1d740 1 -- 172.21.15.19:0/1897735374 wait complete. 2024-09-19T08:55:14.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.279+0000 7ff59aa1d740 1 -- start start 2024-09-19T08:55:14.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.279+0000 7ff59aa1d740 1 Processor -- start 2024-09-19T08:55:14.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.279+0000 7ff59aa1d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56061fa37b60 0x56061fa4b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:14.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.279+0000 7ff59aa1d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56061fa38480 0x56061fa4bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:14.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.279+0000 7ff59aa1d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56061fa42d40 0x56061fabab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:14.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.279+0000 7ff59aa1d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff5901ac7c0 con 0x56061fa42d40 2024-09-19T08:55:14.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.279+0000 7ff59aa1d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff5901ac0f0 con 0x56061fa38480 2024-09-19T08:55:14.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.279+0000 7ff59aa1d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff5901a9350 con 0x56061fa37b60 2024-09-19T08:55:14.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.279+0000 7ff59aa1d740 10 client.0 _ll_register_callbacks cb 0x7ff580040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:55:14.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.280+0000 7ff596be1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56061fa42d40 0x56061fabab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:14.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.280+0000 7ff595bdf640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56061fa38480 0x56061fa4bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:14.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.280+0000 7ff595bdf640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56061fa38480 0x56061fa4bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:52318/0 (socket says 172.21.15.19:52318) 2024-09-19T08:55:14.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.280+0000 7ff595bdf640 1 -- 172.21.15.19:0/860117333 learned_addr learned my addr 172.21.15.19:0/860117333 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:55:14.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.280+0000 7ff596be1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56061fa42d40 0x56061fabab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:36946/0 (socket says 172.21.15.19:36946) 2024-09-19T08:55:14.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.280+0000 7ff5963e0640 1 --2- 172.21.15.19:0/860117333 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56061fa37b60 0x56061fa4b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:14.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.280+0000 7ff595bdf640 1 -- 172.21.15.19:0/860117333 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56061fa37b60 msgr2=0x56061fa4b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:14.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.280+0000 7ff595bdf640 1 --2- 172.21.15.19:0/860117333 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56061fa37b60 0x56061fa4b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.280+0000 7ff595bdf640 1 -- 172.21.15.19:0/860117333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56061fa42d40 msgr2=0x56061fabab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:14.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.280+0000 7ff595bdf640 1 --2- 172.21.15.19:0/860117333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56061fa42d40 0x56061fabab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.280+0000 7ff595bdf640 1 -- 172.21.15.19:0/860117333 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56061fa3a9d0 con 0x56061fa38480 2024-09-19T08:55:14.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.280+0000 7ff596be1640 1 --2- 172.21.15.19:0/860117333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56061fa42d40 0x56061fabab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:55:14.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.280+0000 7ff595bdf640 1 --2- 172.21.15.19:0/860117333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56061fa38480 0x56061fa4bc60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff580006010 tx=0x7ff580031400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e966bbe50a00ec8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:14.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.280+0000 7ff579ffb640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T08:55:14.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.280+0000 7ff579ffb640 1 -- 172.21.15.19:0/860117333 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff58006d060 con 0x56061fa38480 2024-09-19T08:55:14.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.281+0000 7ff59aa1d740 1 -- 172.21.15.19:0/860117333 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff580031970 con 0x56061fa38480 2024-09-19T08:55:14.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.281+0000 7ff579ffb640 1 -- 172.21.15.19:0/860117333 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff5800043d0 con 0x56061fa38480 2024-09-19T08:55:14.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.281+0000 7ff579ffb640 1 -- 172.21.15.19:0/860117333 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff580035040 con 0x56061fa38480 2024-09-19T08:55:14.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.281+0000 7ff59aa1d740 10 client.25634 fetch_fsmap learned FSMap version 30 2024-09-19T08:55:14.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.281+0000 7ff59aa1d740 1 -- 172.21.15.19:0/860117333 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56061fac2340 con 0x56061fa38480 2024-09-19T08:55:14.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.281+0000 7ff579ffb640 1 -- 172.21.15.19:0/860117333 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff580031970 con 0x56061fa38480 2024-09-19T08:55:14.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.281+0000 7ff579ffb640 1 -- 172.21.15.19:0/860117333 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7ff5800035f0 con 0x56061fa38480 2024-09-19T08:55:14.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.281+0000 7ff59aa1d740 10 client.25634 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T08:55:14.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.281+0000 7ff59aa1d740 10 client.25634 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:55:14.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.281+0000 7ff59aa1d740 20 client.25634 populate_metadata read hostname 'smithi019' 2024-09-19T08:55:14.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.281+0000 7ff59aa1d740 1 --2- 172.21.15.19:0/860117333 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56061fac2af0 0x56061fac4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:14.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.281+0000 7ff59aa1d740 4 client.25634 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:55:14.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.281+0000 7ff59aa1d740 1 -- 172.21.15.19:0/860117333 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56061f9a4d00 con 0x56061fac2af0 2024-09-19T08:55:14.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.282+0000 7ff5963e0640 1 --2- 172.21.15.19:0/860117333 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56061fac2af0 0x56061fac4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:14.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.282+0000 7ff5963e0640 1 --2- 172.21.15.19:0/860117333 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56061fac2af0 0x56061fac4f10 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc338c50e7b7645d server_cookie=a2ef8c6e2e1d961e in_seq=0 out_seq=0 2024-09-19T08:55:14.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.282+0000 7ff579ffb640 10 client.25634 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:55:14.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.283+0000 7ff579ffb640 1 -- 172.21.15.19:0/860117333 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56061f9a4d00 con 0x56061fac2af0 2024-09-19T08:55:14.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.283+0000 7ff579ffb640 10 client.25634 handle_command_reply: tid=0 2024-09-19T08:55:14.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.283+0000 7ff59aa1d740 1 client.25634 shutdown 2024-09-19T08:55:14.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.283+0000 7ff59aa1d740 1 -- 172.21.15.19:0/860117333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56061fa38480 msgr2=0x56061fa4bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:14.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.283+0000 7ff59aa1d740 1 --2- 172.21.15.19:0/860117333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56061fa38480 0x56061fa4bc60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff580006010 tx=0x7ff580031400 comp rx=0 tx=0).stop 2024-09-19T08:55:14.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.283+0000 7ff59aa1d740 1 -- 172.21.15.19:0/860117333 shutdown_connections 2024-09-19T08:55:14.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.283+0000 7ff59aa1d740 1 --2- 172.21.15.19:0/860117333 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56061fac2af0 0x56061fac4f10 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.283+0000 7ff59aa1d740 1 --2- 172.21.15.19:0/860117333 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56061fa42d40 0x56061fabab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.283+0000 7ff59aa1d740 1 --2- 172.21.15.19:0/860117333 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56061fa38480 0x56061fa4bc60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.283+0000 7ff59aa1d740 1 --2- 172.21.15.19:0/860117333 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56061fa37b60 0x56061fa4b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.283+0000 7ff59aa1d740 1 -- 172.21.15.19:0/860117333 >> 172.21.15.19:0/860117333 conn(0x56061fa340f0 msgr2=0x56061fa39dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:14.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.283+0000 7ff579ffb640 0 client.25634 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:55:14.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.284+0000 7ff59aa1d740 1 -- 172.21.15.19:0/860117333 shutdown_connections 2024-09-19T08:55:14.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.284+0000 7ff59aa1d740 1 -- 172.21.15.19:0/860117333 wait complete. 2024-09-19T08:55:14.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.284+0000 7ff59aa1d740 20 client.25634 trim_cache size 0 max 16384 2024-09-19T08:55:14.287 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:55:14.287 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-19T08:55:14.287 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "ee6ee0ba-945f-481d-bbe4-f3d1813866aa", 2024-09-19T08:55:14.288 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-19T08:55:14.288 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:55:14.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.284+0000 7ff598644640 1 -- 172.21.15.19:0/493024902 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff57c0a3240 msgr2=0x7ff57c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:14.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.284+0000 7ff598644640 1 --2- 172.21.15.19:0/493024902 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff57c0a3240 0x7ff57c0a5700 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff580009230 tx=0x7ff5800058d0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.284+0000 7ff598644640 1 -- 172.21.15.19:0/493024902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff590100100 msgr2=0x7ff5901984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:14.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.284+0000 7ff598644640 1 --2- 172.21.15.19:0/493024902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff590100100 0x7ff5901984c0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff58c00d950 tx=0x7ff58c00de10 comp rx=0 tx=0).stop 2024-09-19T08:55:14.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.284+0000 7ff598644640 1 -- 172.21.15.19:0/493024902 shutdown_connections 2024-09-19T08:55:14.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.284+0000 7ff598644640 1 --2- 172.21.15.19:0/493024902 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff57c0a3240 0x7ff57c0a5700 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.284+0000 7ff598644640 1 --2- 172.21.15.19:0/493024902 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff590100aa0 0x7ff590198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.284+0000 7ff598644640 1 --2- 172.21.15.19:0/493024902 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff590106b80 0x7ff59019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.284+0000 7ff598644640 1 --2- 172.21.15.19:0/493024902 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff590100100 0x7ff5901984c0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:14.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.284+0000 7ff598644640 1 -- 172.21.15.19:0/493024902 >> 172.21.15.19:0/493024902 conn(0x7ff590077230 msgr2=0x7ff5900fc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:14.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.285+0000 7ff598644640 1 -- 172.21.15.19:0/493024902 shutdown_connections 2024-09-19T08:55:14.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:14.285+0000 7ff598644640 1 -- 172.21.15.19:0/493024902 wait complete. 2024-09-19T08:55:14.400 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:14.400 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:14.404 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:14.404 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:14.404 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 73 -lt 100 ']' 2024-09-19T08:55:14.404 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 73 + 1 2024-09-19T08:55:14.451 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=74 2024-09-19T08:55:14.451 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:14.507 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:14.507 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:14.508 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:14.509 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:14.509 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:15.377 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:15 smithi019 ceph-mon[30976]: pgmap v428: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-19T08:55:15.377 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:15 smithi019 ceph-mon[30976]: scrub queued for path: / 2024-09-19T08:55:15.377 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:15 smithi019 ceph-mon[30976]: scrub summary: idle+waiting paths [/] 2024-09-19T08:55:15.377 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:15 smithi019 ceph-mon[30976]: scrub summary: active paths [/] 2024-09-19T08:55:15.377 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:15 smithi019 ceph-mon[30976]: scrub summary: active paths [/] 2024-09-19T08:55:15.378 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:15 smithi019 ceph-mon[30976]: scrub summary: idle+waiting paths [/] 2024-09-19T08:55:15.378 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:15 smithi019 ceph-mon[30976]: scrub summary: idle+waiting paths [/] 2024-09-19T08:55:15.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:15 smithi155 ceph-mon[34921]: pgmap v428: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-19T08:55:15.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:15 smithi155 ceph-mon[34921]: scrub queued for path: / 2024-09-19T08:55:15.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:15 smithi155 ceph-mon[34921]: scrub summary: idle+waiting paths [/] 2024-09-19T08:55:15.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:15 smithi155 ceph-mon[34921]: scrub summary: active paths [/] 2024-09-19T08:55:15.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:15 smithi155 ceph-mon[34921]: scrub summary: active paths [/] 2024-09-19T08:55:15.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:15 smithi155 ceph-mon[34921]: scrub summary: idle+waiting paths [/] 2024-09-19T08:55:15.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:15 smithi155 ceph-mon[34921]: scrub summary: idle+waiting paths [/] 2024-09-19T08:55:15.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:15 smithi203 ceph-mon[35450]: pgmap v428: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-09-19T08:55:15.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:15 smithi203 ceph-mon[35450]: scrub queued for path: / 2024-09-19T08:55:15.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:15 smithi203 ceph-mon[35450]: scrub summary: idle+waiting paths [/] 2024-09-19T08:55:15.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:15 smithi203 ceph-mon[35450]: scrub summary: active paths [/] 2024-09-19T08:55:15.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:15 smithi203 ceph-mon[35450]: scrub summary: active paths [/] 2024-09-19T08:55:15.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:15 smithi203 ceph-mon[35450]: scrub summary: idle+waiting paths [/] 2024-09-19T08:55:15.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:15 smithi203 ceph-mon[35450]: scrub summary: idle+waiting paths [/] 2024-09-19T08:55:15.596 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:15.597 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:15.891 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:15.891 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:15.928 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:15.928 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:15.928 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 74 -lt 100 ']' 2024-09-19T08:55:15.928 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 74 + 1 2024-09-19T08:55:16.037 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=75 2024-09-19T08:55:16.037 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:16.069 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:16.069 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:16.070 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:16.070 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:16.071 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:16.813 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:16.813 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:17.142 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:55:17.214 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:17.214 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:17.229 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:17.229 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:17.229 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 75 -lt 100 ']' 2024-09-19T08:55:17.229 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 75 + 1 2024-09-19T08:55:17.265 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=76 2024-09-19T08:55:17.265 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:17.298 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:17.298 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:17.300 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:17.300 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:17.300 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:17.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:17 smithi019 ceph-mon[30976]: pgmap v429: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 KiB/s wr, 12 op/s 2024-09-19T08:55:17.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:17 smithi155 ceph-mon[34921]: pgmap v429: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 KiB/s wr, 12 op/s 2024-09-19T08:55:17.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:17 smithi203 ceph-mon[35450]: pgmap v429: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 KiB/s wr, 12 op/s 2024-09-19T08:55:17.695 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:17.695 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:17.777 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:17.777 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:17.787 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:17.787 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:17.787 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 76 -lt 100 ']' 2024-09-19T08:55:17.787 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 76 + 1 2024-09-19T08:55:17.833 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=77 2024-09-19T08:55:17.833 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:17.869 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:17.869 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:17.871 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:17.871 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:17.871 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:18.403 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:18.403 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:18.707 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:18.708 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:18.720 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:18.720 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:18.720 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 77 -lt 100 ']' 2024-09-19T08:55:18.721 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 77 + 1 2024-09-19T08:55:18.766 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=78 2024-09-19T08:55:18.767 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:18.793 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:18.793 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:18.795 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:18.795 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:18.795 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:19.260 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:19.260 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:19.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:19 smithi155 ceph-mon[34921]: pgmap v430: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.8 KiB/s wr, 13 op/s 2024-09-19T08:55:19.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:19 smithi203 ceph-mon[35450]: pgmap v430: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.8 KiB/s wr, 13 op/s 2024-09-19T08:55:19.532 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:19.532 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:19.545 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:19.545 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:19.545 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 78 -lt 100 ']' 2024-09-19T08:55:19.545 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 78 + 1 2024-09-19T08:55:19.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:19 smithi019 ceph-mon[30976]: pgmap v430: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.8 KiB/s wr, 13 op/s 2024-09-19T08:55:19.588 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=79 2024-09-19T08:55:19.588 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:19.607 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:19.607 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:19.609 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:19.609 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:19.609 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:20.409 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:20.409 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:20.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:20 smithi155 ceph-mon[34921]: scrub summary: idle 2024-09-19T08:55:20.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:20 smithi203 ceph-mon[35450]: scrub summary: idle 2024-09-19T08:55:20.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:20 smithi019 ceph-mon[30976]: scrub summary: idle 2024-09-19T08:55:20.799 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:20.799 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:20.822 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:20.822 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:20.823 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 79 -lt 100 ']' 2024-09-19T08:55:20.823 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 79 + 1 2024-09-19T08:55:20.879 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=80 2024-09-19T08:55:20.879 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:20.966 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:20.966 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:20.968 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:20.968 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:20.968 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:21.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:21 smithi155 ceph-mon[34921]: scrub summary: idle 2024-09-19T08:55:21.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:21 smithi155 ceph-mon[34921]: pgmap v431: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.7 KiB/s wr, 16 op/s 2024-09-19T08:55:21.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:21 smithi203 ceph-mon[35450]: scrub summary: idle 2024-09-19T08:55:21.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:21 smithi203 ceph-mon[35450]: pgmap v431: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.7 KiB/s wr, 16 op/s 2024-09-19T08:55:21.501 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:21 smithi019 ceph-mon[30976]: scrub summary: idle 2024-09-19T08:55:21.501 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:21 smithi019 ceph-mon[30976]: pgmap v431: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.7 KiB/s wr, 16 op/s 2024-09-19T08:55:21.778 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:21.778 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:22.064 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:22.064 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:22.070 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:22.070 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:22.070 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 80 -lt 100 ']' 2024-09-19T08:55:22.070 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 80 + 1 2024-09-19T08:55:22.108 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=81 2024-09-19T08:55:22.108 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:22.161 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:22.161 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:22.163 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:22.163 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:22.163 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:22.803 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:22.965 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:22.965 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:23.312 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:23.312 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:23.337 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:23.337 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:23.337 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 81 -lt 100 ']' 2024-09-19T08:55:23.337 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 81 + 1 2024-09-19T08:55:23.384 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=82 2024-09-19T08:55:23.384 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:23.410 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:23.410 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:23.412 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:23.412 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:23.412 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:23.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:23 smithi155 ceph-mon[34921]: pgmap v432: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.0 KiB/s wr, 15 op/s 2024-09-19T08:55:23.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:23 smithi203 ceph-mon[35450]: pgmap v432: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.0 KiB/s wr, 15 op/s 2024-09-19T08:55:23.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:23 smithi019 ceph-mon[30976]: pgmap v432: 97 pgs: 97 active+clean; 1.3 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.0 KiB/s wr, 15 op/s 2024-09-19T08:55:24.494 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:24.494 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:24.766 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:24.766 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:24.780 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:24.780 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:24.780 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 82 -lt 100 ']' 2024-09-19T08:55:24.780 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 82 + 1 2024-09-19T08:55:24.839 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=83 2024-09-19T08:55:24.839 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:24.860 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:24.860 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:24.862 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:24.862 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:24.862 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:25.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:25 smithi019 ceph-mon[30976]: pgmap v433: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 KiB/s wr, 17 op/s 2024-09-19T08:55:25.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:25 smithi155 ceph-mon[34921]: pgmap v433: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 KiB/s wr, 17 op/s 2024-09-19T08:55:25.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:25 smithi203 ceph-mon[35450]: pgmap v433: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 11 KiB/s wr, 17 op/s 2024-09-19T08:55:25.619 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:25.619 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:25.936 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:25.936 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:25.961 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:25.961 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:25.961 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 83 -lt 100 ']' 2024-09-19T08:55:25.961 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 83 + 1 2024-09-19T08:55:26.022 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=84 2024-09-19T08:55:26.022 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:26.052 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:26.052 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:26.054 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:26.054 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:26.054 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:26.685 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:26.685 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:27.064 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:27.065 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:27.077 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:27.078 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:27.078 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 84 -lt 100 ']' 2024-09-19T08:55:27.078 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 84 + 1 2024-09-19T08:55:27.215 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=85 2024-09-19T08:55:27.215 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:27.261 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:27.261 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:27.262 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:27.262 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:27.262 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:27.425 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:27 smithi155 ceph-mon[34921]: pgmap v434: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.4 KiB/s wr, 15 op/s 2024-09-19T08:55:27.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:27 smithi203 ceph-mon[35450]: pgmap v434: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.4 KiB/s wr, 15 op/s 2024-09-19T08:55:27.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:27 smithi019 ceph-mon[30976]: pgmap v434: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.4 KiB/s wr, 15 op/s 2024-09-19T08:55:27.951 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:27.951 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:27.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.980+0000 7fd73c2fd640 1 -- 172.21.15.19:0/350603235 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd734100a70 msgr2=0x7fd734100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:27.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.980+0000 7fd73c2fd640 1 --2- 172.21.15.19:0/350603235 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd734100a70 0x7fd734100ed0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fd724009930 tx=0x7fd72402a420 comp rx=0 tx=0).stop 2024-09-19T08:55:27.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.980+0000 7fd73c2fd640 1 -- 172.21.15.19:0/350603235 shutdown_connections 2024-09-19T08:55:27.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.980+0000 7fd73c2fd640 1 --2- 172.21.15.19:0/350603235 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd734101410 0x7fd73410d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:27.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.980+0000 7fd73c2fd640 1 --2- 172.21.15.19:0/350603235 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd734100a70 0x7fd734100ed0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:27.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.980+0000 7fd73c2fd640 1 --2- 172.21.15.19:0/350603235 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd734106a70 0x7fd734106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:27.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.980+0000 7fd73c2fd640 1 -- 172.21.15.19:0/350603235 >> 172.21.15.19:0/350603235 conn(0x7fd7340fc790 msgr2=0x7fd7340febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:27.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.980+0000 7fd73c2fd640 1 -- 172.21.15.19:0/350603235 shutdown_connections 2024-09-19T08:55:27.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.980+0000 7fd73c2fd640 1 -- 172.21.15.19:0/350603235 wait complete. 2024-09-19T08:55:27.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.981+0000 7fd73c2fd640 1 Processor -- start 2024-09-19T08:55:27.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.981+0000 7fd73c2fd640 1 -- start start 2024-09-19T08:55:27.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.981+0000 7fd73c2fd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd734100a70 0x7fd734198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:27.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.981+0000 7fd73c2fd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd734101410 0x7fd734198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:27.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.981+0000 7fd73c2fd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd734106a70 0x7fd73419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:27.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.981+0000 7fd73c2fd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd734110ec0 con 0x7fd734106a70 2024-09-19T08:55:27.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.981+0000 7fd73c2fd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd734110d40 con 0x7fd734101410 2024-09-19T08:55:27.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.981+0000 7fd73c2fd640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd734111040 con 0x7fd734100a70 2024-09-19T08:55:27.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.981+0000 7fd73a89a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd734106a70 0x7fd73419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:27.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.981+0000 7fd73a099640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd734100a70 0x7fd734198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:27.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.981+0000 7fd73a89a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd734106a70 0x7fd73419cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33872/0 (socket says 172.21.15.19:33872) 2024-09-19T08:55:27.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.981+0000 7fd73a89a640 1 -- 172.21.15.19:0/1645662774 learned_addr learned my addr 172.21.15.19:0/1645662774 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:55:27.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.982+0000 7fd739898640 1 --2- 172.21.15.19:0/1645662774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd734101410 0x7fd734198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:27.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.982+0000 7fd73a099640 1 -- 172.21.15.19:0/1645662774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd734101410 msgr2=0x7fd734198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:27.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.982+0000 7fd73a099640 1 --2- 172.21.15.19:0/1645662774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd734101410 0x7fd734198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:27.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.982+0000 7fd73a099640 1 -- 172.21.15.19:0/1645662774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd734106a70 msgr2=0x7fd73419cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:27.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.982+0000 7fd73a099640 1 --2- 172.21.15.19:0/1645662774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd734106a70 0x7fd73419cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:27.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.982+0000 7fd73a099640 1 -- 172.21.15.19:0/1645662774 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd73419d3e0 con 0x7fd734100a70 2024-09-19T08:55:27.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.982+0000 7fd73a89a640 1 --2- 172.21.15.19:0/1645662774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd734106a70 0x7fd73419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:55:27.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.982+0000 7fd73a099640 1 --2- 172.21.15.19:0/1645662774 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd734100a70 0x7fd734198430 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd73000e9f0 tx=0x7fd73000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:27.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.982+0000 7fd72b7fe640 1 -- 172.21.15.19:0/1645662774 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73000ccc0 con 0x7fd734100a70 2024-09-19T08:55:27.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.982+0000 7fd73c2fd640 1 -- 172.21.15.19:0/1645662774 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd73419d6d0 con 0x7fd734100a70 2024-09-19T08:55:27.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.982+0000 7fd72b7fe640 1 -- 172.21.15.19:0/1645662774 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd730005020 con 0x7fd734100a70 2024-09-19T08:55:27.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.982+0000 7fd72b7fe640 1 -- 172.21.15.19:0/1645662774 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7300049e0 con 0x7fd734100a70 2024-09-19T08:55:27.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.983+0000 7fd73c2fd640 1 -- 172.21.15.19:0/1645662774 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7341a4fb0 con 0x7fd734100a70 2024-09-19T08:55:27.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.985+0000 7fd72b7fe640 1 -- 172.21.15.19:0/1645662774 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fd730005560 con 0x7fd734100a70 2024-09-19T08:55:27.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.986+0000 7fd72b7fe640 1 --2- 172.21.15.19:0/1645662774 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd7200a3240 0x7fd7200a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:27.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.986+0000 7fd739898640 1 --2- 172.21.15.19:0/1645662774 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd7200a3240 0x7fd7200a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:27.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.986+0000 7fd72b7fe640 1 -- 172.21.15.19:0/1645662774 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd7300cf830 con 0x7fd734100a70 2024-09-19T08:55:27.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:27.987+0000 7fd739898640 1 --2- 172.21.15.19:0/1645662774 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd7200a3240 0x7fd7200a5700 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd724006010 tx=0x7fd724000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:28.123 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:28.123 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:28.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.131+0000 7fd73e6d6740 1 Processor -- start 2024-09-19T08:55:28.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.131+0000 7fd73e6d6740 1 -- start start 2024-09-19T08:55:28.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.132+0000 7fd73e6d6740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2f89744a0 0x55b2f8974880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:28.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.132+0000 7fd73e6d6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b2f8974dc0 0x55b2f897f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:28.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.132+0000 7fd73e6d6740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f897f680 0x55b2f8981a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:28.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.132+0000 7fd73e6d6740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b2f88da2e0 con 0x55b2f897f680 2024-09-19T08:55:28.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.132+0000 7fd73e6d6740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b2f8881ce0 con 0x55b2f89744a0 2024-09-19T08:55:28.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.132+0000 7fd73e6d6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b2f88d62a0 con 0x55b2f8974dc0 2024-09-19T08:55:28.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.132+0000 7fd73a89a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f897f680 0x55b2f8981a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:28.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.132+0000 7fd73a099640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2f89744a0 0x55b2f8974880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:28.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.132+0000 7fd73a099640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2f89744a0 0x55b2f8974880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:43498/0 (socket says 172.21.15.19:43498) 2024-09-19T08:55:28.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.132+0000 7fd73a099640 1 -- 172.21.15.19:0/2622635487 learned_addr learned my addr 172.21.15.19:0/2622635487 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:55:28.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.132+0000 7fd739898640 1 --2- 172.21.15.19:0/2622635487 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b2f8974dc0 0x55b2f897f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:28.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.132+0000 7fd73a099640 1 -- 172.21.15.19:0/2622635487 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b2f8974dc0 msgr2=0x55b2f897f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:28.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.133+0000 7fd73a099640 1 --2- 172.21.15.19:0/2622635487 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b2f8974dc0 0x55b2f897f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.133+0000 7fd73a099640 1 -- 172.21.15.19:0/2622635487 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f897f680 msgr2=0x55b2f8981a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:28.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.133+0000 7fd73a099640 1 --2- 172.21.15.19:0/2622635487 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f897f680 0x55b2f8981a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.133+0000 7fd73a099640 1 -- 172.21.15.19:0/2622635487 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2f8866440 con 0x55b2f89744a0 2024-09-19T08:55:28.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.133+0000 7fd73a89a640 1 --2- 172.21.15.19:0/2622635487 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f897f680 0x55b2f8981a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:55:28.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.133+0000 7fd739898640 1 --2- 172.21.15.19:0/2622635487 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b2f8974dc0 0x55b2f897f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:55:28.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.133+0000 7fd73a099640 1 --2- 172.21.15.19:0/2622635487 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2f89744a0 0x55b2f8974880 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd7300987d0 tx=0x7fd73009bd00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e3a59ecb8e2b694 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:28.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.133+0000 7fd728dea640 1 -- 172.21.15.19:0/2622635487 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73001c040 con 0x55b2f89744a0 2024-09-19T08:55:28.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.133+0000 7fd728dea640 1 -- 172.21.15.19:0/2622635487 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd7300a4a70 con 0x55b2f89744a0 2024-09-19T08:55:28.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.133+0000 7fd728dea640 1 -- 172.21.15.19:0/2622635487 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73009c260 con 0x55b2f89744a0 2024-09-19T08:55:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.134+0000 7fd73e6d6740 1 -- 172.21.15.19:0/2622635487 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2f89744a0 msgr2=0x55b2f8974880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.134+0000 7fd73e6d6740 1 --2- 172.21.15.19:0/2622635487 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2f89744a0 0x55b2f8974880 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd7300987d0 tx=0x7fd73009bd00 comp rx=0 tx=0).stop 2024-09-19T08:55:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.134+0000 7fd73e6d6740 1 -- 172.21.15.19:0/2622635487 shutdown_connections 2024-09-19T08:55:28.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.134+0000 7fd73e6d6740 1 --2- 172.21.15.19:0/2622635487 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b2f8974dc0 0x55b2f897f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.134+0000 7fd73e6d6740 1 --2- 172.21.15.19:0/2622635487 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f897f680 0x55b2f8981a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.134+0000 7fd73e6d6740 1 --2- 172.21.15.19:0/2622635487 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2f89744a0 0x55b2f8974880 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.134+0000 7fd73e6d6740 1 -- 172.21.15.19:0/2622635487 >> 172.21.15.19:0/2622635487 conn(0x55b2f8970a30 msgr2=0x55b2f8970e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:28.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.135+0000 7fd73e6d6740 1 -- 172.21.15.19:0/2622635487 shutdown_connections 2024-09-19T08:55:28.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.135+0000 7fd73e6d6740 1 -- 172.21.15.19:0/2622635487 wait complete. 2024-09-19T08:55:28.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.135+0000 7fd73e6d6740 1 -- start start 2024-09-19T08:55:28.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.135+0000 7fd73e6d6740 1 Processor -- start 2024-09-19T08:55:28.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.136+0000 7fd73e6d6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b2f89744a0 0x55b2f897f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:28.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.136+0000 7fd73e6d6740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2f8974dc0 0x55b2f897c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:28.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.136+0000 7fd73e6d6740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f897f680 0x55b2f897c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:28.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.136+0000 7fd73e6d6740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b2f8982250 con 0x55b2f897f680 2024-09-19T08:55:28.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.136+0000 7fd73a099640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b2f89744a0 0x55b2f897f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.136+0000 7fd73a89a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f897f680 0x55b2f897c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.136+0000 7fd73e6d6740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b2f8895050 con 0x55b2f8974dc0 2024-09-19T08:55:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.136+0000 7fd73a89a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f897f680 0x55b2f897c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33902/0 (socket says 172.21.15.19:33902) 2024-09-19T08:55:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.136+0000 7fd73a89a640 1 -- 172.21.15.19:0/1762403423 learned_addr learned my addr 172.21.15.19:0/1762403423 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:55:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.136+0000 7fd73e6d6740 1 -- 172.21.15.19:0/1762403423 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b2f89823d0 con 0x55b2f89744a0 2024-09-19T08:55:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.136+0000 7fd739898640 1 --2- 172.21.15.19:0/1762403423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2f8974dc0 0x55b2f897c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.136+0000 7fd73e6d6740 10 client.0 _ll_register_callbacks cb 0x55b2f88d5160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:55:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.136+0000 7fd739898640 1 -- 172.21.15.19:0/1762403423 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b2f89744a0 msgr2=0x55b2f897f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.136+0000 7fd739898640 1 --2- 172.21.15.19:0/1762403423 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b2f89744a0 0x55b2f897f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.136+0000 7fd739898640 1 -- 172.21.15.19:0/1762403423 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f897f680 msgr2=0x55b2f897c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.136+0000 7fd739898640 1 --2- 172.21.15.19:0/1762403423 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f897f680 0x55b2f897c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.136+0000 7fd739898640 1 -- 172.21.15.19:0/1762403423 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2f864b3c0 con 0x55b2f8974dc0 2024-09-19T08:55:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.137+0000 7fd73a89a640 1 --2- 172.21.15.19:0/1762403423 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f897f680 0x55b2f897c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:55:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.137+0000 7fd73e6d6740 1 -- 172.21.15.19:0/1762403423 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7300a4a70 con 0x55b2f8974dc0 2024-09-19T08:55:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.137+0000 7fd739898640 1 --2- 172.21.15.19:0/1762403423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2f8974dc0 0x55b2f897c2e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd72402a940 tx=0x7fd724009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=405c74e56a8c41cf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.137+0000 7fd71dffb640 10 client.25646 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T08:55:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.137+0000 7fd71dffb640 1 -- 172.21.15.19:0/1762403423 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd724058050 con 0x55b2f8974dc0 2024-09-19T08:55:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.137+0000 7fd71dffb640 1 -- 172.21.15.19:0/1762403423 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd7240048c0 con 0x55b2f8974dc0 2024-09-19T08:55:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.137+0000 7fd71dffb640 1 -- 172.21.15.19:0/1762403423 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd72404e070 con 0x55b2f8974dc0 2024-09-19T08:55:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.138+0000 7fd73e6d6740 10 client.25646 fetch_fsmap learned FSMap version 30 2024-09-19T08:55:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.138+0000 7fd73e6d6740 1 -- 172.21.15.19:0/1762403423 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55b2f898db80 con 0x55b2f8974dc0 2024-09-19T08:55:28.140 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:28.140 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:28.140 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 85 -lt 100 ']' 2024-09-19T08:55:28.140 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 85 + 1 2024-09-19T08:55:28.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.138+0000 7fd71dffb640 1 -- 172.21.15.19:0/1762403423 <== mon.2 v2:172.21.15.155:3300/0 4 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fd72405b020 con 0x55b2f8974dc0 2024-09-19T08:55:28.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.138+0000 7fd73e6d6740 10 client.25646 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T08:55:28.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.138+0000 7fd73e6d6740 10 client.25646 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:55:28.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.138+0000 7fd73e6d6740 20 client.25646 populate_metadata read hostname 'smithi019' 2024-09-19T08:55:28.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.138+0000 7fd73e6d6740 1 --2- 172.21.15.19:0/1762403423 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b2f898f020 0x55b2f8991480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:28.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.138+0000 7fd73e6d6740 4 client.25646 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:55:28.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.138+0000 7fd73e6d6740 1 -- 172.21.15.19:0/1762403423 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2f88e7850 con 0x55b2f898f020 2024-09-19T08:55:28.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.139+0000 7fd73a099640 1 --2- 172.21.15.19:0/1762403423 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b2f898f020 0x55b2f8991480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:28.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.139+0000 7fd71dffb640 10 client.25646 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:55:28.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.139+0000 7fd73a099640 1 --2- 172.21.15.19:0/1762403423 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b2f898f020 0x55b2f8991480 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ddabdf4b070bf1a server_cookie=30061c780256573f in_seq=0 out_seq=0 2024-09-19T08:55:28.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.140+0000 7fd71dffb640 1 -- 172.21.15.19:0/1762403423 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b2f88e7850 con 0x55b2f898f020 2024-09-19T08:55:28.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.140+0000 7fd71dffb640 10 client.25646 handle_command_reply: tid=0 2024-09-19T08:55:28.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.140+0000 7fd73e6d6740 1 client.25646 shutdown 2024-09-19T08:55:28.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.140+0000 7fd73e6d6740 1 -- 172.21.15.19:0/1762403423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2f8974dc0 msgr2=0x55b2f897c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:28.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.140+0000 7fd73e6d6740 1 --2- 172.21.15.19:0/1762403423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2f8974dc0 0x55b2f897c2e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd72402a940 tx=0x7fd724009260 comp rx=0 tx=0).stop 2024-09-19T08:55:28.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.140+0000 7fd73e6d6740 1 -- 172.21.15.19:0/1762403423 shutdown_connections 2024-09-19T08:55:28.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.140+0000 7fd73e6d6740 1 --2- 172.21.15.19:0/1762403423 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b2f898f020 0x55b2f8991480 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.140+0000 7fd73e6d6740 1 --2- 172.21.15.19:0/1762403423 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f897f680 0x55b2f897c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.140+0000 7fd71dffb640 0 client.25646 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:55:28.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.140+0000 7fd73e6d6740 1 --2- 172.21.15.19:0/1762403423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2f8974dc0 0x55b2f897c2e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.140+0000 7fd73e6d6740 1 --2- 172.21.15.19:0/1762403423 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b2f89744a0 0x55b2f897f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.140+0000 7fd73e6d6740 1 -- 172.21.15.19:0/1762403423 >> 172.21.15.19:0/1762403423 conn(0x55b2f8970a30 msgr2=0x55b2f8976710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:28.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.141+0000 7fd73e6d6740 1 -- 172.21.15.19:0/1762403423 shutdown_connections 2024-09-19T08:55:28.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.141+0000 7fd73e6d6740 1 -- 172.21.15.19:0/1762403423 wait complete. 2024-09-19T08:55:28.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.141+0000 7fd73e6d6740 20 client.25646 trim_cache size 0 max 16384 2024-09-19T08:55:28.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.163+0000 7fd73e6d6740 1 Processor -- start 2024-09-19T08:55:28.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.163+0000 7fd73e6d6740 1 -- start start 2024-09-19T08:55:28.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.163+0000 7fd73e6d6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b2f89744a0 0x55b2f898b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:28.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.163+0000 7fd73e6d6740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f8974dc0 0x55b2f8996d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:28.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.163+0000 7fd73e6d6740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2f897f680 0x55b2f8997290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:28.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.163+0000 7fd73e6d6740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd7341ad4b0 con 0x55b2f8974dc0 2024-09-19T08:55:28.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.163+0000 7fd73e6d6740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd7341af0b0 con 0x55b2f897f680 2024-09-19T08:55:28.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.163+0000 7fd73e6d6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd7341adb80 con 0x55b2f89744a0 2024-09-19T08:55:28.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.163+0000 7fd739898640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f8974dc0 0x55b2f8996d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:28.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.163+0000 7fd739898640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f8974dc0 0x55b2f8996d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33910/0 (socket says 172.21.15.19:33910) 2024-09-19T08:55:28.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.163+0000 7fd739898640 1 -- 172.21.15.19:0/2411554635 learned_addr learned my addr 172.21.15.19:0/2411554635 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:55:28.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.163+0000 7fd73a099640 1 --2- 172.21.15.19:0/2411554635 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b2f89744a0 0x55b2f898b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:28.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.163+0000 7fd73a89a640 1 --2- 172.21.15.19:0/2411554635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2f897f680 0x55b2f8997290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:28.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.163+0000 7fd739898640 1 -- 172.21.15.19:0/2411554635 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b2f89744a0 msgr2=0x55b2f898b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:28.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.163+0000 7fd739898640 1 --2- 172.21.15.19:0/2411554635 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b2f89744a0 0x55b2f898b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.163+0000 7fd739898640 1 -- 172.21.15.19:0/2411554635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2f897f680 msgr2=0x55b2f8997290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:28.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.163+0000 7fd739898640 1 --2- 172.21.15.19:0/2411554635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2f897f680 0x55b2f8997290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.163+0000 7fd739898640 1 -- 172.21.15.19:0/2411554635 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2f8974bf0 con 0x55b2f8974dc0 2024-09-19T08:55:28.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.163+0000 7fd73a89a640 1 --2- 172.21.15.19:0/2411554635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2f897f680 0x55b2f8997290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:55:28.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.164+0000 7fd739898640 1 --2- 172.21.15.19:0/2411554635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f8974dc0 0x55b2f8996d50 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fd72402aa10 tx=0x7fd724043000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec732c73491d9ed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:28.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.164+0000 7fd71ffff640 1 -- 172.21.15.19:0/2411554635 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd724058070 con 0x55b2f8974dc0 2024-09-19T08:55:28.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.164+0000 7fd71ffff640 1 -- 172.21.15.19:0/2411554635 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd724061020 con 0x55b2f8974dc0 2024-09-19T08:55:28.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.164+0000 7fd71ffff640 1 -- 172.21.15.19:0/2411554635 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd724035040 con 0x55b2f8974dc0 2024-09-19T08:55:28.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.165+0000 7fd73e6d6740 1 -- 172.21.15.19:0/2411554635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f8974dc0 msgr2=0x55b2f8996d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:28.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.165+0000 7fd73e6d6740 1 --2- 172.21.15.19:0/2411554635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f8974dc0 0x55b2f8996d50 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fd72402aa10 tx=0x7fd724043000 comp rx=0 tx=0).stop 2024-09-19T08:55:28.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.165+0000 7fd73e6d6740 1 -- 172.21.15.19:0/2411554635 shutdown_connections 2024-09-19T08:55:28.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.165+0000 7fd73e6d6740 1 --2- 172.21.15.19:0/2411554635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2f897f680 0x55b2f8997290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.165+0000 7fd73e6d6740 1 --2- 172.21.15.19:0/2411554635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f8974dc0 0x55b2f8996d50 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.165+0000 7fd73e6d6740 1 --2- 172.21.15.19:0/2411554635 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b2f89744a0 0x55b2f898b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.165+0000 7fd73e6d6740 1 -- 172.21.15.19:0/2411554635 >> 172.21.15.19:0/2411554635 conn(0x55b2f8970a30 msgr2=0x55b2f8977900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:28.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.165+0000 7fd73e6d6740 1 -- 172.21.15.19:0/2411554635 shutdown_connections 2024-09-19T08:55:28.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.165+0000 7fd73e6d6740 1 -- 172.21.15.19:0/2411554635 wait complete. 2024-09-19T08:55:28.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.165+0000 7fd73e6d6740 1 -- start start 2024-09-19T08:55:28.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.165+0000 7fd73e6d6740 1 Processor -- start 2024-09-19T08:55:28.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.166+0000 7fd73e6d6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b2f89744a0 0x55b2f8987b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:28.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.166+0000 7fd73e6d6740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f8974dc0 0x55b2f8982ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:28.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.166+0000 7fd73e6d6740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2f897f680 0x55b2f8983400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:28.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.166+0000 7fd73e6d6740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd7341ae920 con 0x55b2f8974dc0 2024-09-19T08:55:28.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.166+0000 7fd73e6d6740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd7341ae250 con 0x55b2f897f680 2024-09-19T08:55:28.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.166+0000 7fd73e6d6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd7341ab490 con 0x55b2f89744a0 2024-09-19T08:55:28.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.166+0000 7fd73e6d6740 10 client.0 _ll_register_callbacks cb 0x7fd724040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:55:28.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.166+0000 7fd739898640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f8974dc0 0x55b2f8982ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:28.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.166+0000 7fd73a099640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b2f89744a0 0x55b2f8987b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:28.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.166+0000 7fd739898640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f8974dc0 0x55b2f8982ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33924/0 (socket says 172.21.15.19:33924) 2024-09-19T08:55:28.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.166+0000 7fd739898640 1 -- 172.21.15.19:0/3132942654 learned_addr learned my addr 172.21.15.19:0/3132942654 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:55:28.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.166+0000 7fd73a89a640 1 --2- 172.21.15.19:0/3132942654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2f897f680 0x55b2f8983400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:28.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.166+0000 7fd739898640 1 -- 172.21.15.19:0/3132942654 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b2f89744a0 msgr2=0x55b2f8987b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:28.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.166+0000 7fd739898640 1 --2- 172.21.15.19:0/3132942654 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b2f89744a0 0x55b2f8987b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.166+0000 7fd739898640 1 -- 172.21.15.19:0/3132942654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2f897f680 msgr2=0x55b2f8983400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:28.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.166+0000 7fd739898640 1 --2- 172.21.15.19:0/3132942654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2f897f680 0x55b2f8983400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.166+0000 7fd739898640 1 -- 172.21.15.19:0/3132942654 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2f89839c0 con 0x55b2f8974dc0 2024-09-19T08:55:28.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.166+0000 7fd73a89a640 1 --2- 172.21.15.19:0/3132942654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2f897f680 0x55b2f8983400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:55:28.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.166+0000 7fd73a099640 1 --2- 172.21.15.19:0/3132942654 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b2f89744a0 0x55b2f8987b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:55:28.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.166+0000 7fd739898640 1 --2- 172.21.15.19:0/3132942654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f8974dc0 0x55b2f8982ec0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fd724005780 tx=0x7fd724004fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ead4a219b06daae2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:28.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.166+0000 7fd71dffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:55:28.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.167+0000 7fd71dffb640 1 -- 172.21.15.19:0/3132942654 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd72406a030 con 0x55b2f8974dc0 2024-09-19T08:55:28.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.167+0000 7fd71dffb640 1 -- 172.21.15.19:0/3132942654 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd724062040 con 0x55b2f8974dc0 2024-09-19T08:55:28.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.167+0000 7fd73e6d6740 1 -- 172.21.15.19:0/3132942654 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd724061020 con 0x55b2f8974dc0 2024-09-19T08:55:28.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.167+0000 7fd71dffb640 1 -- 172.21.15.19:0/3132942654 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd724035070 con 0x55b2f8974dc0 2024-09-19T08:55:28.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.167+0000 7fd73e6d6740 10 client.16095 fetch_fsmap learned FSMap version 30 2024-09-19T08:55:28.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.167+0000 7fd73e6d6740 1 -- 172.21.15.19:0/3132942654 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55b2f89f9b00 con 0x55b2f8974dc0 2024-09-19T08:55:28.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.167+0000 7fd71dffb640 1 -- 172.21.15.19:0/3132942654 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd724061020 con 0x55b2f8974dc0 2024-09-19T08:55:28.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.167+0000 7fd71dffb640 1 -- 172.21.15.19:0/3132942654 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 30) ==== 8378+0+0 (secure 0 0 0) 0x7fd72405b040 con 0x55b2f8974dc0 2024-09-19T08:55:28.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.167+0000 7fd73e6d6740 10 client.16095 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T08:55:28.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.167+0000 7fd73e6d6740 10 client.16095 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:55:28.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.167+0000 7fd73e6d6740 20 client.16095 populate_metadata read hostname 'smithi019' 2024-09-19T08:55:28.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.167+0000 7fd73e6d6740 1 --2- 172.21.15.19:0/3132942654 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b2f898f020 0x55b2f89fc210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:28.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.167+0000 7fd73e6d6740 4 client.16095 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:55:28.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.167+0000 7fd73e6d6740 1 -- 172.21.15.19:0/3132942654 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b2f88e1d60 con 0x55b2f898f020 2024-09-19T08:55:28.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.168+0000 7fd73a099640 1 --2- 172.21.15.19:0/3132942654 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b2f898f020 0x55b2f89fc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:28.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.168+0000 7fd73a099640 1 --2- 172.21.15.19:0/3132942654 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b2f898f020 0x55b2f89fc210 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf34be1642874753 server_cookie=3233dac18beef73a in_seq=0 out_seq=0 2024-09-19T08:55:28.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.168+0000 7fd71dffb640 10 client.16095 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:55:28.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.169+0000 7fd71dffb640 1 -- 172.21.15.19:0/3132942654 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55b2f88e1d60 con 0x55b2f898f020 2024-09-19T08:55:28.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.169+0000 7fd71dffb640 10 client.16095 handle_command_reply: tid=0 2024-09-19T08:55:28.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.169+0000 7fd73e6d6740 1 client.16095 shutdown 2024-09-19T08:55:28.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.169+0000 7fd73e6d6740 1 -- 172.21.15.19:0/3132942654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f8974dc0 msgr2=0x55b2f8982ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:28.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.169+0000 7fd73e6d6740 1 --2- 172.21.15.19:0/3132942654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f8974dc0 0x55b2f8982ec0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fd724005780 tx=0x7fd724004fd0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.169+0000 7fd73e6d6740 1 -- 172.21.15.19:0/3132942654 shutdown_connections 2024-09-19T08:55:28.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.169+0000 7fd73e6d6740 1 --2- 172.21.15.19:0/3132942654 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b2f898f020 0x55b2f89fc210 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.169+0000 7fd73e6d6740 1 --2- 172.21.15.19:0/3132942654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b2f897f680 0x55b2f8983400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.169+0000 7fd73e6d6740 1 --2- 172.21.15.19:0/3132942654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b2f8974dc0 0x55b2f8982ec0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.169+0000 7fd73e6d6740 1 --2- 172.21.15.19:0/3132942654 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b2f89744a0 0x55b2f8987b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.169+0000 7fd71dffb640 0 client.16095 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:55:28.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.169+0000 7fd73e6d6740 1 -- 172.21.15.19:0/3132942654 >> 172.21.15.19:0/3132942654 conn(0x55b2f8970a30 msgr2=0x55b2f896f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:28.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.169+0000 7fd73e6d6740 1 -- 172.21.15.19:0/3132942654 shutdown_connections 2024-09-19T08:55:28.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.169+0000 7fd73e6d6740 1 -- 172.21.15.19:0/3132942654 wait complete. 2024-09-19T08:55:28.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.169+0000 7fd73e6d6740 20 client.16095 trim_cache size 0 max 16384 2024-09-19T08:55:28.173 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:55:28.173 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-19T08:55:28.173 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {} 2024-09-19T08:55:28.173 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:55:28.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.170+0000 7fd73c2fd640 1 -- 172.21.15.19:0/1645662774 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd7200a3240 msgr2=0x7fd7200a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:28.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.170+0000 7fd73c2fd640 1 --2- 172.21.15.19:0/1645662774 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd7200a3240 0x7fd7200a5700 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd724006010 tx=0x7fd724000bc0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.170+0000 7fd73c2fd640 1 -- 172.21.15.19:0/1645662774 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd734100a70 msgr2=0x7fd734198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:28.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.170+0000 7fd73c2fd640 1 --2- 172.21.15.19:0/1645662774 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd734100a70 0x7fd734198430 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd73000e9f0 tx=0x7fd73000eeb0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.170+0000 7fd73c2fd640 1 -- 172.21.15.19:0/1645662774 shutdown_connections 2024-09-19T08:55:28.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.170+0000 7fd73c2fd640 1 --2- 172.21.15.19:0/1645662774 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd7200a3240 0x7fd7200a5700 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.170+0000 7fd73c2fd640 1 --2- 172.21.15.19:0/1645662774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd734106a70 0x7fd73419cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.170+0000 7fd73c2fd640 1 --2- 172.21.15.19:0/1645662774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd734101410 0x7fd734198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.170+0000 7fd73c2fd640 1 --2- 172.21.15.19:0/1645662774 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd734100a70 0x7fd734198430 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:28.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.170+0000 7fd73c2fd640 1 -- 172.21.15.19:0/1645662774 >> 172.21.15.19:0/1645662774 conn(0x7fd7340fc790 msgr2=0x7fd73406aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:28.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.170+0000 7fd73c2fd640 1 -- 172.21.15.19:0/1645662774 shutdown_connections 2024-09-19T08:55:28.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:28.170+0000 7fd73c2fd640 1 -- 172.21.15.19:0/1645662774 wait complete. 2024-09-19T08:55:28.195 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=86 2024-09-19T08:55:28.195 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:28.278 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:28.278 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:28.280 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:28.280 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:28.281 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:29.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:29 smithi155 ceph-mon[34921]: pgmap v435: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-19T08:55:29.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:29 smithi203 ceph-mon[35450]: pgmap v435: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-19T08:55:29.492 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:29 smithi019 ceph-mon[30976]: pgmap v435: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-19T08:55:29.935 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:29.935 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:30.297 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:30.297 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:30.386 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:30.386 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:30.386 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 86 -lt 100 ']' 2024-09-19T08:55:30.386 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 86 + 1 2024-09-19T08:55:30.506 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=87 2024-09-19T08:55:30.506 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:30.545 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:30.545 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:30.545 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:30.546 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:30.546 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:31.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:31 smithi155 ceph-mon[34921]: pgmap v436: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.2 KiB/s wr, 14 op/s 2024-09-19T08:55:31.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:31 smithi155 ceph-mon[34921]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T08:55:31.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:31 smithi203 ceph-mon[35450]: pgmap v436: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.2 KiB/s wr, 14 op/s 2024-09-19T08:55:31.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:31 smithi203 ceph-mon[35450]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T08:55:31.550 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:31 smithi019 ceph-mon[30976]: pgmap v436: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.2 KiB/s wr, 14 op/s 2024-09-19T08:55:31.550 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:31 smithi019 ceph-mon[30976]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T08:55:32.160 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:32.160 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:32.422 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:32 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:55:32.458 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.458+0000 7f71c4528640 1 -- 172.21.15.19:0/3698336856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71bc102d50 msgr2=0x7f71bc1031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:32.458 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.458+0000 7f71c4528640 1 --2- 172.21.15.19:0/3698336856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71bc102d50 0x7f71bc1031d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f71ac009900 tx=0x7f71ac02a410 comp rx=0 tx=0).stop 2024-09-19T08:55:32.458 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.459+0000 7f71c4528640 1 -- 172.21.15.19:0/3698336856 shutdown_connections 2024-09-19T08:55:32.458 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.459+0000 7f71c4528640 1 --2- 172.21.15.19:0/3698336856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71bc103710 0x7f71bc109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:32.458 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.459+0000 7f71c4528640 1 --2- 172.21.15.19:0/3698336856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71bc102d50 0x7f71bc1031d0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:32.458 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.459+0000 7f71c4528640 1 --2- 172.21.15.19:0/3698336856 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71bc101b60 0x7f71bc101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:32.458 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.459+0000 7f71c4528640 1 -- 172.21.15.19:0/3698336856 >> 172.21.15.19:0/3698336856 conn(0x7f71bc0fd2e0 msgr2=0x7f71bc0ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:32.458 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.459+0000 7f71c4528640 1 -- 172.21.15.19:0/3698336856 shutdown_connections 2024-09-19T08:55:32.458 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.459+0000 7f71c4528640 1 -- 172.21.15.19:0/3698336856 wait complete. 2024-09-19T08:55:32.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:32 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:55:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.556+0000 7f71c4528640 1 Processor -- start 2024-09-19T08:55:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.556+0000 7f71c4528640 1 -- start start 2024-09-19T08:55:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.557+0000 7f71c4528640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71bc101b60 0x7f71bc197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.557+0000 7f71c4528640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71bc102d50 0x7f71bc198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.557+0000 7f71c4528640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71bc103710 0x7f71bc19f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.557+0000 7f71c4528640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f71bc10d830 con 0x7f71bc102d50 2024-09-19T08:55:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.557+0000 7f71c4528640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f71bc10d6b0 con 0x7f71bc101b60 2024-09-19T08:55:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.557+0000 7f71c4528640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f71bc10d9b0 con 0x7f71bc103710 2024-09-19T08:55:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.557+0000 7f71c1ac3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71bc102d50 0x7f71bc198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.557+0000 7f71c1ac3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71bc102d50 0x7f71bc198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33944/0 (socket says 172.21.15.19:33944) 2024-09-19T08:55:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.557+0000 7f71c1ac3640 1 -- 172.21.15.19:0/2903371394 learned_addr learned my addr 172.21.15.19:0/2903371394 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:55:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.557+0000 7f71c22c4640 1 --2- 172.21.15.19:0/2903371394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71bc101b60 0x7f71bc197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.557+0000 7f71c2ac5640 1 --2- 172.21.15.19:0/2903371394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71bc103710 0x7f71bc19f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.557+0000 7f71c1ac3640 1 -- 172.21.15.19:0/2903371394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71bc103710 msgr2=0x7f71bc19f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.557+0000 7f71c1ac3640 1 --2- 172.21.15.19:0/2903371394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71bc103710 0x7f71bc19f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.557+0000 7f71c1ac3640 1 -- 172.21.15.19:0/2903371394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71bc101b60 msgr2=0x7f71bc197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.557+0000 7f71c1ac3640 1 --2- 172.21.15.19:0/2903371394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71bc101b60 0x7f71bc197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.557+0000 7f71c1ac3640 1 -- 172.21.15.19:0/2903371394 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71bc19fa40 con 0x7f71bc102d50 2024-09-19T08:55:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.557+0000 7f71c2ac5640 1 --2- 172.21.15.19:0/2903371394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71bc103710 0x7f71bc19f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:55:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.558+0000 7f71c1ac3640 1 --2- 172.21.15.19:0/2903371394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71bc102d50 0x7f71bc198360 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f71ac031440 tx=0x7f71ac032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.558+0000 7f71b37fe640 1 -- 172.21.15.19:0/2903371394 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ac03f030 con 0x7f71bc102d50 2024-09-19T08:55:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.558+0000 7f71b37fe640 1 -- 172.21.15.19:0/2903371394 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71ac003ce0 con 0x7f71bc102d50 2024-09-19T08:55:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.558+0000 7f71c4528640 1 -- 172.21.15.19:0/2903371394 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71bc19fcd0 con 0x7f71bc102d50 2024-09-19T08:55:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.558+0000 7f71b37fe640 1 -- 172.21.15.19:0/2903371394 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ac035070 con 0x7f71bc102d50 2024-09-19T08:55:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.559+0000 7f71c4528640 1 -- 172.21.15.19:0/2903371394 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71bc1a01c0 con 0x7f71bc102d50 2024-09-19T08:55:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.561+0000 7f71b37fe640 1 -- 172.21.15.19:0/2903371394 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f71ac042030 con 0x7f71bc102d50 2024-09-19T08:55:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.562+0000 7f71b37fe640 1 --2- 172.21.15.19:0/2903371394 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f71a80a3460 0x7f71a80a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.562+0000 7f71c22c4640 1 --2- 172.21.15.19:0/2903371394 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f71a80a3460 0x7f71a80a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.562+0000 7f71b37fe640 1 -- 172.21.15.19:0/2903371394 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f71ac0ef980 con 0x7f71bc102d50 2024-09-19T08:55:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.562+0000 7f71c22c4640 1 --2- 172.21.15.19:0/2903371394 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f71a80a3460 0x7f71a80a5920 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f71bc102bb0 tx=0x7f71b8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:32.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:32 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:55:32.789 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:32.789 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:32.849 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:32.849 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:32.849 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 87 -lt 100 ']' 2024-09-19T08:55:32.849 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 87 + 1 2024-09-19T08:55:32.882 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.883+0000 7f71c72b7740 1 Processor -- start 2024-09-19T08:55:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.884+0000 7f71c72b7740 1 -- start start 2024-09-19T08:55:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.884+0000 7f71c72b7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7a3d7fdb0 0x55a7a3d801b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.884+0000 7f71c72b7740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7a3d806f0 0x55a7a3d851b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.884+0000 7f71c72b7740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a7a3d85780 0x55a7a3d87c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.884+0000 7f71c72b7740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a7a3cdf2f0 con 0x55a7a3d806f0 2024-09-19T08:55:32.884 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.884+0000 7f71c72b7740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55a7a3c87270 con 0x55a7a3d85780 2024-09-19T08:55:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.884+0000 7f71c72b7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a7a3cdb2b0 con 0x55a7a3d7fdb0 2024-09-19T08:55:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.884+0000 7f71c1ac3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7a3d806f0 0x55a7a3d851b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.884+0000 7f71c1ac3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7a3d806f0 0x55a7a3d851b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33948/0 (socket says 172.21.15.19:33948) 2024-09-19T08:55:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.884+0000 7f71c1ac3640 1 -- 172.21.15.19:0/1277055814 learned_addr learned my addr 172.21.15.19:0/1277055814 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:55:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.884+0000 7f71c22c4640 1 --2- 172.21.15.19:0/1277055814 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7a3d7fdb0 0x55a7a3d801b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.884+0000 7f71c2ac5640 1 --2- 172.21.15.19:0/1277055814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a7a3d85780 0x55a7a3d87c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.885+0000 7f71c1ac3640 1 -- 172.21.15.19:0/1277055814 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7a3d7fdb0 msgr2=0x55a7a3d801b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.885+0000 7f71c1ac3640 1 --2- 172.21.15.19:0/1277055814 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7a3d7fdb0 0x55a7a3d801b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.885+0000 7f71c1ac3640 1 -- 172.21.15.19:0/1277055814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a7a3d85780 msgr2=0x55a7a3d87c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.885+0000 7f71c1ac3640 1 --2- 172.21.15.19:0/1277055814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a7a3d85780 0x55a7a3d87c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.885+0000 7f71c1ac3640 1 -- 172.21.15.19:0/1277055814 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7a3c86340 con 0x55a7a3d806f0 2024-09-19T08:55:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.885+0000 7f71c2ac5640 1 --2- 172.21.15.19:0/1277055814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a7a3d85780 0x55a7a3d87c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:55:32.885 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.885+0000 7f71c1ac3640 1 --2- 172.21.15.19:0/1277055814 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7a3d806f0 0x55a7a3d851b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f71ac0c46f0 tx=0x7f71ac0bbe50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18994a1f8d3de67d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:32.886 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.885+0000 7f71b0bfe640 1 -- 172.21.15.19:0/1277055814 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ac049040 con 0x55a7a3d806f0 2024-09-19T08:55:32.886 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.885+0000 7f71b0bfe640 1 -- 172.21.15.19:0/1277055814 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71ac0bbfb0 con 0x55a7a3d806f0 2024-09-19T08:55:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.885+0000 7f71b0bfe640 1 -- 172.21.15.19:0/1277055814 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ac0b8620 con 0x55a7a3d806f0 2024-09-19T08:55:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.886+0000 7f71c72b7740 1 -- 172.21.15.19:0/1277055814 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7a3d806f0 msgr2=0x55a7a3d851b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.886+0000 7f71c72b7740 1 --2- 172.21.15.19:0/1277055814 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7a3d806f0 0x55a7a3d851b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f71ac0c46f0 tx=0x7f71ac0bbe50 comp rx=0 tx=0).stop 2024-09-19T08:55:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.886+0000 7f71c72b7740 1 -- 172.21.15.19:0/1277055814 shutdown_connections 2024-09-19T08:55:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.886+0000 7f71c72b7740 1 --2- 172.21.15.19:0/1277055814 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a7a3d85780 0x55a7a3d87c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.886+0000 7f71c72b7740 1 --2- 172.21.15.19:0/1277055814 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7a3d806f0 0x55a7a3d851b0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.886+0000 7f71c72b7740 1 --2- 172.21.15.19:0/1277055814 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7a3d7fdb0 0x55a7a3d801b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.886+0000 7f71c72b7740 1 -- 172.21.15.19:0/1277055814 >> 172.21.15.19:0/1277055814 conn(0x55a7a3d77010 msgr2=0x55a7a3d77410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.886+0000 7f71c72b7740 1 -- 172.21.15.19:0/1277055814 shutdown_connections 2024-09-19T08:55:32.887 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:32.886+0000 7f71c72b7740 1 -- 172.21.15.19:0/1277055814 wait complete. 2024-09-19T08:55:32.933 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=88 2024-09-19T08:55:32.933 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:32.945 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:32.945 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:32.947 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:32.947 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:32.947 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:32.975 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:55:32.976 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:55:32.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.000+0000 7f71c72b7740 1 -- start start 2024-09-19T08:55:33.008 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.009+0000 7f71c72b7740 1 Processor -- start 2024-09-19T08:55:33.009 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.009+0000 7f71c72b7740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a7a3d7fdb0 0x55a7a3d89d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:33.009 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.009+0000 7f71c72b7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7a3d806f0 0x55a7a3d8a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:33.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.009+0000 7f71c72b7740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7a3d85780 0x55a7a3d91280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:33.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.009+0000 7f71c72b7740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a7a3d88510 con 0x55a7a3d85780 2024-09-19T08:55:33.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.009+0000 7f71c72b7740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55a7a3c68290 con 0x55a7a3d7fdb0 2024-09-19T08:55:33.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.009+0000 7f71c72b7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a7a3d88690 con 0x55a7a3d806f0 2024-09-19T08:55:33.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.009+0000 7f71c2ac5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7a3d85780 0x55a7a3d91280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:33.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.009+0000 7f71c2ac5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7a3d85780 0x55a7a3d91280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33960/0 (socket says 172.21.15.19:33960) 2024-09-19T08:55:33.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.009+0000 7f71c2ac5640 1 -- 172.21.15.19:0/1260975984 learned_addr learned my addr 172.21.15.19:0/1260975984 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:55:33.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.009+0000 7f71c22c4640 1 --2- 172.21.15.19:0/1260975984 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a7a3d7fdb0 0x55a7a3d89d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:33.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.009+0000 7f71c1ac3640 1 --2- 172.21.15.19:0/1260975984 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7a3d806f0 0x55a7a3d8a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:33.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.010+0000 7f71c2ac5640 1 -- 172.21.15.19:0/1260975984 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7a3d806f0 msgr2=0x55a7a3d8a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:33.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.010+0000 7f71c2ac5640 1 --2- 172.21.15.19:0/1260975984 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7a3d806f0 0x55a7a3d8a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:33.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.010+0000 7f71c2ac5640 1 -- 172.21.15.19:0/1260975984 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a7a3d7fdb0 msgr2=0x55a7a3d89d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:33.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.010+0000 7f71c2ac5640 1 --2- 172.21.15.19:0/1260975984 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a7a3d7fdb0 0x55a7a3d89d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:33.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.010+0000 7f71c2ac5640 1 -- 172.21.15.19:0/1260975984 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7a39f2210 con 0x55a7a3d85780 2024-09-19T08:55:33.011 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.010+0000 7f71c22c4640 1 --2- 172.21.15.19:0/1260975984 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a7a3d7fdb0 0x55a7a3d89d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:55:33.011 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.010+0000 7f71c2ac5640 1 --2- 172.21.15.19:0/1260975984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7a3d85780 0x55a7a3d91280 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f71b4012790 tx=0x7f71b4012c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce90a7f6bbc71520 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:33.011 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.010+0000 7f71a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:55:33.011 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.010+0000 7f71a5ffb640 1 -- 172.21.15.19:0/1260975984 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b4004d20 con 0x55a7a3d85780 2024-09-19T08:55:33.011 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.010+0000 7f71a5ffb640 1 -- 172.21.15.19:0/1260975984 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f71b4010b40 con 0x55a7a3d85780 2024-09-19T08:55:33.022 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.023+0000 7f71c72b7740 10 client.0 _ll_register_callbacks cb 0x55a7a3c99140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:55:33.055 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.056+0000 7f71c72b7740 1 -- 172.21.15.19:0/1260975984 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71ac0bbfb0 con 0x55a7a3d85780 2024-09-19T08:55:33.055 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.056+0000 7f71a5ffb640 1 -- 172.21.15.19:0/1260975984 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f71b4010d80 con 0x55a7a3d85780 2024-09-19T08:55:33.055 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.056+0000 7f71c72b7740 10 client.16107 fetch_fsmap learned FSMap version 31 2024-09-19T08:55:33.055 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.056+0000 7f71c72b7740 1 -- 172.21.15.19:0/1260975984 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({fsmap=31}) -- 0x55a7a3abe620 con 0x55a7a3d85780 2024-09-19T08:55:33.127 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.127+0000 7f71a5ffb640 1 -- 172.21.15.19:0/1260975984 <== mon.0 v2:172.21.15.19:3300/0 4 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7f71b4019070 con 0x55a7a3d85780 2024-09-19T08:55:33.127 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.128+0000 7f71c72b7740 10 client.16107 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T08:55:33.127 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.128+0000 7f71c72b7740 10 client.16107 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:55:33.128 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.128+0000 7f71c72b7740 20 client.16107 populate_metadata read hostname 'smithi019' 2024-09-19T08:55:33.128 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.128+0000 7f71c72b7740 1 --2- 172.21.15.19:0/1260975984 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a7a3d95790 0x55a7a3d97c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:33.128 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.128+0000 7f71c72b7740 4 client.16107 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:55:33.128 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.128+0000 7f71c72b7740 1 -- 172.21.15.19:0/1260975984 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a7a3ceca20 con 0x55a7a3d95790 2024-09-19T08:55:33.128 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.129+0000 7f71c22c4640 1 --2- 172.21.15.19:0/1260975984 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a7a3d95790 0x55a7a3d97c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:33.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.129+0000 7f71c22c4640 1 --2- 172.21.15.19:0/1260975984 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a7a3d95790 0x55a7a3d97c50 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbea2ff3283e44d5 server_cookie=5be78adb8cfddad1 in_seq=0 out_seq=0 2024-09-19T08:55:33.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.129+0000 7f71a5ffb640 10 client.16107 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:55:33.130 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.130+0000 7f71a5ffb640 1 -- 172.21.15.19:0/1260975984 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a7a3ceca20 con 0x55a7a3d95790 2024-09-19T08:55:33.130 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.130+0000 7f71a5ffb640 10 client.16107 handle_command_reply: tid=0 2024-09-19T08:55:33.130 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.130+0000 7f71c72b7740 1 client.16107 shutdown 2024-09-19T08:55:33.130 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.130+0000 7f71c72b7740 1 -- 172.21.15.19:0/1260975984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7a3d85780 msgr2=0x55a7a3d91280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:33.130 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.130+0000 7f71c72b7740 1 --2- 172.21.15.19:0/1260975984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7a3d85780 0x55a7a3d91280 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f71b4012790 tx=0x7f71b4012c50 comp rx=0 tx=0).stop 2024-09-19T08:55:33.130 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.130+0000 7f71c72b7740 1 -- 172.21.15.19:0/1260975984 shutdown_connections 2024-09-19T08:55:33.130 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.130+0000 7f71c72b7740 1 --2- 172.21.15.19:0/1260975984 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a7a3d95790 0x55a7a3d97c50 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:33.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.130+0000 7f71c72b7740 1 --2- 172.21.15.19:0/1260975984 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7a3d806f0 0x55a7a3d8a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:33.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.130+0000 7f71c72b7740 1 --2- 172.21.15.19:0/1260975984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7a3d85780 0x55a7a3d91280 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:33.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.130+0000 7f71c72b7740 1 --2- 172.21.15.19:0/1260975984 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a7a3d7fdb0 0x55a7a3d89d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:33.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.130+0000 7f71a5ffb640 0 client.16107 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:55:33.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.130+0000 7f71c72b7740 1 -- 172.21.15.19:0/1260975984 >> 172.21.15.19:0/1260975984 conn(0x55a7a3d77010 msgr2=0x55a7a3d78820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:33.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.130+0000 7f71c72b7740 1 -- 172.21.15.19:0/1260975984 shutdown_connections 2024-09-19T08:55:33.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.131+0000 7f71c72b7740 1 -- 172.21.15.19:0/1260975984 wait complete. 2024-09-19T08:55:33.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.131+0000 7f71c72b7740 20 client.16107 trim_cache size 0 max 16384 2024-09-19T08:55:33.146 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.146+0000 7f71c72b7740 1 Processor -- start 2024-09-19T08:55:33.146 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.146+0000 7f71c72b7740 1 -- start start 2024-09-19T08:55:33.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.146+0000 7f71c72b7740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a7a3d7fdb0 0x55a7a3d891a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:33.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.146+0000 7f71c72b7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7a3d806f0 0x55a7a3d91240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:33.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.146+0000 7f71c72b7740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7a3d85780 0x55a7a3d760b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:33.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.146+0000 7f71c72b7740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f71bc1a6cb0 con 0x55a7a3d85780 2024-09-19T08:55:33.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.146+0000 7f71c72b7740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f71bc1a8820 con 0x55a7a3d7fdb0 2024-09-19T08:55:33.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.146+0000 7f71c72b7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f71bc1a7380 con 0x55a7a3d806f0 2024-09-19T08:55:33.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.146+0000 7f71c2ac5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7a3d85780 0x55a7a3d760b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:33.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.146+0000 7f71c2ac5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7a3d85780 0x55a7a3d760b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33966/0 (socket says 172.21.15.19:33966) 2024-09-19T08:55:33.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.146+0000 7f71c2ac5640 1 -- 172.21.15.19:0/2345147821 learned_addr learned my addr 172.21.15.19:0/2345147821 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:55:33.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.146+0000 7f71c1ac3640 1 --2- 172.21.15.19:0/2345147821 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7a3d806f0 0x55a7a3d91240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:33.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.146+0000 7f71c22c4640 1 --2- 172.21.15.19:0/2345147821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a7a3d7fdb0 0x55a7a3d891a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:33.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.147+0000 7f71c2ac5640 1 -- 172.21.15.19:0/2345147821 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7a3d806f0 msgr2=0x55a7a3d91240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:33.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.147+0000 7f71c2ac5640 1 --2- 172.21.15.19:0/2345147821 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7a3d806f0 0x55a7a3d91240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:33.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.147+0000 7f71c2ac5640 1 -- 172.21.15.19:0/2345147821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a7a3d7fdb0 msgr2=0x55a7a3d891a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:33.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.147+0000 7f71c2ac5640 1 --2- 172.21.15.19:0/2345147821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a7a3d7fdb0 0x55a7a3d891a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:33.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.147+0000 7f71c2ac5640 1 -- 172.21.15.19:0/2345147821 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7a3d982d0 con 0x55a7a3d85780 2024-09-19T08:55:33.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.147+0000 7f71c22c4640 1 --2- 172.21.15.19:0/2345147821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a7a3d7fdb0 0x55a7a3d891a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:55:33.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.147+0000 7f71c1ac3640 1 --2- 172.21.15.19:0/2345147821 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7a3d806f0 0x55a7a3d91240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:55:33.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.147+0000 7f71c2ac5640 1 --2- 172.21.15.19:0/2345147821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7a3d85780 0x55a7a3d760b0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f71b4012c90 tx=0x7f71b4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aad3a115ac9d4d21 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:33.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.147+0000 7f71a7fff640 1 -- 172.21.15.19:0/2345147821 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b40039c0 con 0x55a7a3d85780 2024-09-19T08:55:33.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.147+0000 7f71a7fff640 1 -- 172.21.15.19:0/2345147821 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71ac0bbfb0 con 0x55a7a3d85780 2024-09-19T08:55:33.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.147+0000 7f71a7fff640 1 -- 172.21.15.19:0/2345147821 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71b401a3f0 con 0x55a7a3d85780 2024-09-19T08:55:33.151 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.148+0000 7f71c72b7740 1 -- 172.21.15.19:0/2345147821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7a3d85780 msgr2=0x55a7a3d760b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:33.151 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.148+0000 7f71c72b7740 1 --2- 172.21.15.19:0/2345147821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7a3d85780 0x55a7a3d760b0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f71b4012c90 tx=0x7f71b4015000 comp rx=0 tx=0).stop 2024-09-19T08:55:33.151 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.148+0000 7f71c72b7740 1 -- 172.21.15.19:0/2345147821 shutdown_connections 2024-09-19T08:55:33.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.148+0000 7f71c72b7740 1 --2- 172.21.15.19:0/2345147821 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7a3d806f0 0x55a7a3d91240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:33.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.148+0000 7f71c72b7740 1 --2- 172.21.15.19:0/2345147821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7a3d85780 0x55a7a3d760b0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:33.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.148+0000 7f71c72b7740 1 --2- 172.21.15.19:0/2345147821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a7a3d7fdb0 0x55a7a3d891a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:33.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.148+0000 7f71c72b7740 1 -- 172.21.15.19:0/2345147821 >> 172.21.15.19:0/2345147821 conn(0x55a7a3d77010 msgr2=0x55a7a3d759a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:33.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.148+0000 7f71c72b7740 1 -- 172.21.15.19:0/2345147821 shutdown_connections 2024-09-19T08:55:33.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.148+0000 7f71c72b7740 1 -- 172.21.15.19:0/2345147821 wait complete. 2024-09-19T08:55:33.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.148+0000 7f71c72b7740 1 -- start start 2024-09-19T08:55:33.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.148+0000 7f71c72b7740 1 Processor -- start 2024-09-19T08:55:33.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.148+0000 7f71c72b7740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a7a3d7fdb0 0x55a7a3d8e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:33.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.148+0000 7f71c72b7740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7a3d806f0 0x55a7a3d8ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:33.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.148+0000 7f71c72b7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7a3d85780 0x55a7a3d8fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:33.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.148+0000 7f71c72b7740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f71bc1a8120 con 0x55a7a3d806f0 2024-09-19T08:55:33.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.148+0000 7f71c72b7740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f71bc1a7a50 con 0x55a7a3d7fdb0 2024-09-19T08:55:33.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.149+0000 7f71c72b7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f71bc1a4c90 con 0x55a7a3d85780 2024-09-19T08:55:33.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.149+0000 7f71c72b7740 10 client.0 _ll_register_callbacks cb 0x7f71b4009c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:55:33.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.149+0000 7f71c1ac3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7a3d806f0 0x55a7a3d8ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:33.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.149+0000 7f71c1ac3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7a3d806f0 0x55a7a3d8ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33968/0 (socket says 172.21.15.19:33968) 2024-09-19T08:55:33.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.149+0000 7f71c1ac3640 1 -- 172.21.15.19:0/795587865 learned_addr learned my addr 172.21.15.19:0/795587865 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:55:33.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.149+0000 7f71c2ac5640 1 --2- 172.21.15.19:0/795587865 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7a3d85780 0x55a7a3d8fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:33.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.149+0000 7f71c22c4640 1 --2- 172.21.15.19:0/795587865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a7a3d7fdb0 0x55a7a3d8e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:33.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.149+0000 7f71c1ac3640 1 -- 172.21.15.19:0/795587865 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7a3d85780 msgr2=0x55a7a3d8fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:33.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.149+0000 7f71c1ac3640 1 --2- 172.21.15.19:0/795587865 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7a3d85780 0x55a7a3d8fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:33.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.149+0000 7f71c1ac3640 1 -- 172.21.15.19:0/795587865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a7a3d7fdb0 msgr2=0x55a7a3d8e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:33.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.149+0000 7f71c1ac3640 1 --2- 172.21.15.19:0/795587865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a7a3d7fdb0 0x55a7a3d8e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:33.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.149+0000 7f71c1ac3640 1 -- 172.21.15.19:0/795587865 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7a3d90240 con 0x55a7a3d806f0 2024-09-19T08:55:33.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.149+0000 7f71c1ac3640 1 --2- 172.21.15.19:0/795587865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7a3d806f0 0x55a7a3d8ec20 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f71ac000c00 tx=0x7f71ac003f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4304026fec690e11 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:33.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.149+0000 7f71a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:55:33.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.149+0000 7f71a5ffb640 1 -- 172.21.15.19:0/795587865 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ac0c9060 con 0x55a7a3d806f0 2024-09-19T08:55:33.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.149+0000 7f71a5ffb640 1 -- 172.21.15.19:0/795587865 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f71ac03bcd0 con 0x55a7a3d806f0 2024-09-19T08:55:33.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.149+0000 7f71c72b7740 1 -- 172.21.15.19:0/795587865 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f71ac0bbfb0 con 0x55a7a3d806f0 2024-09-19T08:55:33.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.149+0000 7f71a5ffb640 1 -- 172.21.15.19:0/795587865 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f71ac049040 con 0x55a7a3d806f0 2024-09-19T08:55:33.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.149+0000 7f71c72b7740 10 client.16113 fetch_fsmap learned FSMap version 31 2024-09-19T08:55:33.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.150+0000 7f71c72b7740 1 -- 172.21.15.19:0/795587865 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a7a3d914c0 con 0x55a7a3d806f0 2024-09-19T08:55:33.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.150+0000 7f71a5ffb640 1 -- 172.21.15.19:0/795587865 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71ac0bbfb0 con 0x55a7a3d806f0 2024-09-19T08:55:33.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.150+0000 7f71a5ffb640 1 -- 172.21.15.19:0/795587865 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 31) ==== 8366+0+0 (secure 0 0 0) 0x7f71ac0d8070 con 0x55a7a3d806f0 2024-09-19T08:55:33.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.150+0000 7f71c72b7740 10 client.16113 fetch_fsmap finished waiting for FSMap version 31 2024-09-19T08:55:33.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.150+0000 7f71c72b7740 10 client.16113 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:55:33.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.150+0000 7f71c72b7740 20 client.16113 populate_metadata read hostname 'smithi019' 2024-09-19T08:55:33.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.150+0000 7f71c72b7740 1 --2- 172.21.15.19:0/795587865 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a7a3e00a60 0x55a7a3e02e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:33.155 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.150+0000 7f71c72b7740 4 client.16113 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:55:33.155 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.150+0000 7f71c72b7740 1 -- 172.21.15.19:0/795587865 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a7a3ce6d70 con 0x55a7a3e00a60 2024-09-19T08:55:33.155 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.150+0000 7f71c22c4640 1 --2- 172.21.15.19:0/795587865 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a7a3e00a60 0x55a7a3e02e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:33.155 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.151+0000 7f71c22c4640 1 --2- 172.21.15.19:0/795587865 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a7a3e00a60 0x55a7a3e02e50 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96c0870098beadd2 server_cookie=260a6000ce20abf6 in_seq=0 out_seq=0 2024-09-19T08:55:33.155 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.151+0000 7f71a5ffb640 10 client.16113 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:55:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.157+0000 7f71a5ffb640 1 -- 172.21.15.19:0/795587865 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a7a3ce6d70 con 0x55a7a3e00a60 2024-09-19T08:55:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.157+0000 7f71a5ffb640 10 client.16113 handle_command_reply: tid=0 2024-09-19T08:55:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.157+0000 7f71c72b7740 1 client.16113 shutdown 2024-09-19T08:55:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.158+0000 7f71c72b7740 1 -- 172.21.15.19:0/795587865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7a3d806f0 msgr2=0x55a7a3d8ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.158+0000 7f71c72b7740 1 --2- 172.21.15.19:0/795587865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7a3d806f0 0x55a7a3d8ec20 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f71ac000c00 tx=0x7f71ac003f00 comp rx=0 tx=0).stop 2024-09-19T08:55:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.158+0000 7f71c72b7740 1 -- 172.21.15.19:0/795587865 shutdown_connections 2024-09-19T08:55:33.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.158+0000 7f71c72b7740 1 --2- 172.21.15.19:0/795587865 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a7a3e00a60 0x55a7a3e02e50 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.158+0000 7f71c72b7740 1 --2- 172.21.15.19:0/795587865 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7a3d85780 0x55a7a3d8fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.158+0000 7f71a5ffb640 0 client.16113 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:55:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.158+0000 7f71c72b7740 1 --2- 172.21.15.19:0/795587865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a7a3d806f0 0x55a7a3d8ec20 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.158+0000 7f71c72b7740 1 --2- 172.21.15.19:0/795587865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a7a3d7fdb0 0x55a7a3d8e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.158+0000 7f71c72b7740 1 -- 172.21.15.19:0/795587865 >> 172.21.15.19:0/795587865 conn(0x55a7a3d77010 msgr2=0x55a7a3d761c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.158+0000 7f71c72b7740 1 -- 172.21.15.19:0/795587865 shutdown_connections 2024-09-19T08:55:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.158+0000 7f71c72b7740 1 -- 172.21.15.19:0/795587865 wait complete. 2024-09-19T08:55:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.158+0000 7f71c72b7740 20 client.16113 trim_cache size 0 max 16384 2024-09-19T08:55:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T08:55:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T08:55:33.158 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T08:55:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T08:55:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.158+0000 7f71c4528640 1 -- 172.21.15.19:0/2903371394 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f71a80a3460 msgr2=0x7f71a80a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.158+0000 7f71c4528640 1 --2- 172.21.15.19:0/2903371394 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f71a80a3460 0x7f71a80a5920 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f71bc102bb0 tx=0x7f71b8005f90 comp rx=0 tx=0).stop 2024-09-19T08:55:33.159 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.158+0000 7f71c4528640 1 -- 172.21.15.19:0/2903371394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71bc102d50 msgr2=0x7f71bc198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.158+0000 7f71c4528640 1 --2- 172.21.15.19:0/2903371394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71bc102d50 0x7f71bc198360 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f71ac031440 tx=0x7f71ac032ce0 comp rx=0 tx=0).stop 2024-09-19T08:55:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.158+0000 7f71c4528640 1 -- 172.21.15.19:0/2903371394 shutdown_connections 2024-09-19T08:55:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.158+0000 7f71c4528640 1 --2- 172.21.15.19:0/2903371394 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f71a80a3460 0x7f71a80a5920 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.158+0000 7f71c4528640 1 --2- 172.21.15.19:0/2903371394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71bc103710 0x7f71bc19f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.158+0000 7f71c4528640 1 --2- 172.21.15.19:0/2903371394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71bc102d50 0x7f71bc198360 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.158+0000 7f71c4528640 1 --2- 172.21.15.19:0/2903371394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71bc101b60 0x7f71bc197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.158+0000 7f71c4528640 1 -- 172.21.15.19:0/2903371394 >> 172.21.15.19:0/2903371394 conn(0x7f71bc0fd2e0 msgr2=0x7f71bc1060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.159+0000 7f71c4528640 1 -- 172.21.15.19:0/2903371394 shutdown_connections 2024-09-19T08:55:33.160 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:33.159+0000 7f71c4528640 1 -- 172.21.15.19:0/2903371394 wait complete. 2024-09-19T08:55:33.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:33 smithi203 ceph-mon[35450]: pgmap v437: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 11 op/s 2024-09-19T08:55:33.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:33 smithi019 ceph-mon[30976]: pgmap v437: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 11 op/s 2024-09-19T08:55:33.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:33 smithi155 ceph-mon[34921]: pgmap v437: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 KiB/s wr, 11 op/s 2024-09-19T08:55:34.151 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:34.151 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:34.379 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:34.379 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:34.393 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:34.394 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:34.394 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 88 -lt 100 ']' 2024-09-19T08:55:34.394 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 88 + 1 2024-09-19T08:55:34.558 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=89 2024-09-19T08:55:34.558 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:34.647 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:34.647 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:34.649 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:34.649 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:34.649 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:35.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:35 smithi203 ceph-mon[35450]: pgmap v438: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-19T08:55:35.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:35 smithi019 ceph-mon[30976]: pgmap v438: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-19T08:55:35.642 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:35.642 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:35.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:35 smithi155 ceph-mon[34921]: pgmap v438: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 KiB/s wr, 14 op/s 2024-09-19T08:55:35.888 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:35.888 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:35.918 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:35.918 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:35.919 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 89 -lt 100 ']' 2024-09-19T08:55:35.919 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 89 + 1 2024-09-19T08:55:36.005 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=90 2024-09-19T08:55:36.081 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:36.082 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:36.082 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:36.082 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:36.083 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:36.083 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:37.467 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:37.468 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:37.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:37 smithi019 ceph-mon[30976]: pgmap v439: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.2 KiB/s wr, 13 op/s 2024-09-19T08:55:37.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:37 smithi155 ceph-mon[34921]: pgmap v439: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.2 KiB/s wr, 13 op/s 2024-09-19T08:55:37.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:37 smithi203 ceph-mon[35450]: pgmap v439: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.2 KiB/s wr, 13 op/s 2024-09-19T08:55:37.996 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:37.997 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:38.044 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:38.044 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:38.044 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 90 -lt 100 ']' 2024-09-19T08:55:38.045 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 90 + 1 2024-09-19T08:55:38.115 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=91 2024-09-19T08:55:38.116 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:38.149 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:38.150 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:38.151 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:38.151 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:38.151 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:39.067 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:39.067 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:39.360 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:39.360 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:39.368 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:39.369 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:39.369 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 91 -lt 100 ']' 2024-09-19T08:55:39.369 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 91 + 1 2024-09-19T08:55:39.464 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=92 2024-09-19T08:55:39.464 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:39.514 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:39.514 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:39.515 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:39.515 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:39.515 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:39.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:39 smithi019 ceph-mon[30976]: pgmap v440: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.4 KiB/s wr, 13 op/s 2024-09-19T08:55:39.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:39 smithi155 ceph-mon[34921]: pgmap v440: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.4 KiB/s wr, 13 op/s 2024-09-19T08:55:39.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:39 smithi203 ceph-mon[35450]: pgmap v440: 97 pgs: 97 active+clean; 1.4 MiB data, 349 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.4 KiB/s wr, 13 op/s 2024-09-19T08:55:40.667 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:40.667 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:40.971 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:40.971 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:40.992 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:40.992 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:40.992 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 92 -lt 100 ']' 2024-09-19T08:55:40.992 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 92 + 1 2024-09-19T08:55:41.079 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=93 2024-09-19T08:55:41.079 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:41.097 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:41.097 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:41.098 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:41.098 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:41.098 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:41.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:41 smithi019 ceph-mon[30976]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T08:55:41.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:41 smithi155 ceph-mon[34921]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T08:55:41.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:41 smithi203 ceph-mon[35450]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T08:55:42.049 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:42.050 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:42.362 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:42.363 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:42.367 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:42.367 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:42.367 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 93 -lt 100 ']' 2024-09-19T08:55:42.367 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 93 + 1 2024-09-19T08:55:42.404 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=94 2024-09-19T08:55:42.404 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:42.412 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:42.412 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:42.413 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:42.413 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:42.413 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:42.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:42 smithi019 ceph-mon[30976]: pgmap v441: 97 pgs: 97 active+clean; 1.4 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 KiB/s wr, 14 op/s 2024-09-19T08:55:42.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:42 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:42.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:42 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:55:42.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:42 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:55:42.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:42 smithi155 ceph-mon[34921]: pgmap v441: 97 pgs: 97 active+clean; 1.4 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 KiB/s wr, 14 op/s 2024-09-19T08:55:42.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:42 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:42.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:42 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:55:42.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:42 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:55:42.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:42 smithi203 ceph-mon[35450]: pgmap v441: 97 pgs: 97 active+clean; 1.4 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 KiB/s wr, 14 op/s 2024-09-19T08:55:42.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:42 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:55:42.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:42 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:55:42.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:42 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:55:43.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:43 smithi019 ceph-mon[30976]: pgmap v442: 97 pgs: 97 active+clean; 1.4 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.7 KiB/s wr, 13 op/s 2024-09-19T08:55:43.324 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:43.325 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:43.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:43 smithi155 ceph-mon[34921]: pgmap v442: 97 pgs: 97 active+clean; 1.4 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.7 KiB/s wr, 13 op/s 2024-09-19T08:55:43.712 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:43.713 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:43.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:43 smithi203 ceph-mon[35450]: pgmap v442: 97 pgs: 97 active+clean; 1.4 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.7 KiB/s wr, 13 op/s 2024-09-19T08:55:43.734 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:43.734 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:43.734 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 94 -lt 100 ']' 2024-09-19T08:55:43.734 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 94 + 1 2024-09-19T08:55:43.805 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=95 2024-09-19T08:55:43.805 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:43.862 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:43.862 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:43.863 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:43.864 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:43.864 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:44.999 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:45.000 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:45.262 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:45.262 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:45.284 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:45.284 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:45.284 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 95 -lt 100 ']' 2024-09-19T08:55:45.284 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 95 + 1 2024-09-19T08:55:45.363 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=96 2024-09-19T08:55:45.363 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:45.398 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:45.398 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:45.399 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:45.400 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:45.400 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:45.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:45 smithi019 ceph-mon[30976]: pgmap v443: 97 pgs: 97 active+clean; 1.5 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.2 KiB/s wr, 15 op/s 2024-09-19T08:55:45.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:45 smithi155 ceph-mon[34921]: pgmap v443: 97 pgs: 97 active+clean; 1.5 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.2 KiB/s wr, 15 op/s 2024-09-19T08:55:45.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:45 smithi203 ceph-mon[35450]: pgmap v443: 97 pgs: 97 active+clean; 1.5 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.2 KiB/s wr, 15 op/s 2024-09-19T08:55:46.274 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:46.275 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:46.569 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:46.570 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:46.600 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:46.600 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:46.600 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 96 -lt 100 ']' 2024-09-19T08:55:46.600 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 96 + 1 2024-09-19T08:55:46.746 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=97 2024-09-19T08:55:46.746 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:46.753 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:46.753 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:46.754 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:46.755 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:46.755 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:47.540 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:47 smithi019 ceph-mon[30976]: pgmap v444: 97 pgs: 97 active+clean; 1.5 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.2 KiB/s wr, 12 op/s 2024-09-19T08:55:47.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:47 smithi155 ceph-mon[34921]: pgmap v444: 97 pgs: 97 active+clean; 1.5 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.2 KiB/s wr, 12 op/s 2024-09-19T08:55:47.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:47 smithi203 ceph-mon[35450]: pgmap v444: 97 pgs: 97 active+clean; 1.5 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 5.2 KiB/s wr, 12 op/s 2024-09-19T08:55:48.016 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:48.016 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:48.300 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:48.300 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:48.308 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:48.308 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:48.308 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 97 -lt 100 ']' 2024-09-19T08:55:48.308 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 97 + 1 2024-09-19T08:55:48.320 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:55:48.398 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=98 2024-09-19T08:55:48.398 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:48.454 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:48.454 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:48.455 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:48.456 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:48.456 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:49.391 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:49.391 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:49.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:49 smithi019 ceph-mon[30976]: pgmap v445: 97 pgs: 97 active+clean; 1.5 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 KiB/s wr, 11 op/s 2024-09-19T08:55:49.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:49 smithi155 ceph-mon[34921]: pgmap v445: 97 pgs: 97 active+clean; 1.5 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 KiB/s wr, 11 op/s 2024-09-19T08:55:49.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:49 smithi203 ceph-mon[35450]: pgmap v445: 97 pgs: 97 active+clean; 1.5 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.2 KiB/s wr, 11 op/s 2024-09-19T08:55:49.836 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:49.837 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:49.859 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:49.859 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:49.859 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 98 -lt 100 ']' 2024-09-19T08:55:49.859 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 98 + 1 2024-09-19T08:55:50.145 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=99 2024-09-19T08:55:50.146 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:50.313 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:50.313 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:50.314 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:50.315 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:50.315 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:51.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:51 smithi019 ceph-mon[30976]: pgmap v446: 97 pgs: 97 active+clean; 1.5 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.1 KiB/s wr, 12 op/s 2024-09-19T08:55:51.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:51 smithi155 ceph-mon[34921]: pgmap v446: 97 pgs: 97 active+clean; 1.5 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.1 KiB/s wr, 12 op/s 2024-09-19T08:55:51.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:51 smithi203 ceph-mon[35450]: pgmap v446: 97 pgs: 97 active+clean; 1.5 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.1 KiB/s wr, 12 op/s 2024-09-19T08:55:52.030 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.031+0000 7f1a5ff54640 1 -- 172.21.15.19:0/1320567921 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a580ffba0 msgr2=0x7f1a58100020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:52.031 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.031+0000 7f1a5ff54640 1 --2- 172.21.15.19:0/1320567921 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a580ffba0 0x7f1a58100020 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f1a48009930 tx=0x7f1a4802a440 comp rx=0 tx=0).stop 2024-09-19T08:55:52.045 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.046+0000 7f1a5ff54640 1 -- 172.21.15.19:0/1320567921 shutdown_connections 2024-09-19T08:55:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.046+0000 7f1a5ff54640 1 --2- 172.21.15.19:0/1320567921 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a58100560 0x7f1a5810a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.046+0000 7f1a5ff54640 1 --2- 172.21.15.19:0/1320567921 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a580ffba0 0x7f1a58100020 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.046+0000 7f1a5ff54640 1 --2- 172.21.15.19:0/1320567921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a58103130 0x7f1a58103530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.046+0000 7f1a5ff54640 1 -- 172.21.15.19:0/1320567921 >> 172.21.15.19:0/1320567921 conn(0x7f1a580fb930 msgr2=0x7f1a580fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.046+0000 7f1a5ff54640 1 -- 172.21.15.19:0/1320567921 shutdown_connections 2024-09-19T08:55:52.046 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.046+0000 7f1a5ff54640 1 -- 172.21.15.19:0/1320567921 wait complete. 2024-09-19T08:55:52.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.080+0000 7f1a5ff54640 1 Processor -- start 2024-09-19T08:55:52.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.080+0000 7f1a5ff54640 1 -- start start 2024-09-19T08:55:52.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.080+0000 7f1a5ff54640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a580ffba0 0x7f1a5819a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:52.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.080+0000 7f1a5ff54640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a58100560 0x7f1a5819a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:52.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.080+0000 7f1a5ff54640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a58103130 0x7f1a581a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:52.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.080+0000 7f1a5ff54640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5810d820 con 0x7f1a58100560 2024-09-19T08:55:52.081 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.080+0000 7f1a5ff54640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5810d6a0 con 0x7f1a580ffba0 2024-09-19T08:55:52.081 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.080+0000 7f1a5ff54640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1a5810d9a0 con 0x7f1a58103130 2024-09-19T08:55:52.081 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.081+0000 7f1a5d4ef640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a58100560 0x7f1a5819a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:52.081 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.081+0000 7f1a5d4ef640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a58100560 0x7f1a5819a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48282/0 (socket says 172.21.15.19:48282) 2024-09-19T08:55:52.081 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.081+0000 7f1a5d4ef640 1 -- 172.21.15.19:0/4067330290 learned_addr learned my addr 172.21.15.19:0/4067330290 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:55:52.081 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.081+0000 7f1a5e4f1640 1 --2- 172.21.15.19:0/4067330290 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a58103130 0x7f1a581a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:52.081 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.081+0000 7f1a5dcf0640 1 --2- 172.21.15.19:0/4067330290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a580ffba0 0x7f1a5819a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:52.081 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.081+0000 7f1a5d4ef640 1 -- 172.21.15.19:0/4067330290 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a58103130 msgr2=0x7f1a581a15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:52.081 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.081+0000 7f1a5d4ef640 1 --2- 172.21.15.19:0/4067330290 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a58103130 0x7f1a581a15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.081 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.081+0000 7f1a5d4ef640 1 -- 172.21.15.19:0/4067330290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a580ffba0 msgr2=0x7f1a5819a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:52.081 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.081+0000 7f1a5d4ef640 1 --2- 172.21.15.19:0/4067330290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a580ffba0 0x7f1a5819a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.081 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.081+0000 7f1a5d4ef640 1 -- 172.21.15.19:0/4067330290 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a581a1c50 con 0x7f1a58100560 2024-09-19T08:55:52.082 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.081+0000 7f1a5d4ef640 1 --2- 172.21.15.19:0/4067330290 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a58100560 0x7f1a5819a570 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f1a48031440 tx=0x7f1a48032c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:52.082 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.082+0000 7f1a4effd640 1 -- 172.21.15.19:0/4067330290 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4803f030 con 0x7f1a58100560 2024-09-19T08:55:52.082 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.082+0000 7f1a4effd640 1 -- 172.21.15.19:0/4067330290 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a48003ad0 con 0x7f1a58100560 2024-09-19T08:55:52.082 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.082+0000 7f1a4effd640 1 -- 172.21.15.19:0/4067330290 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a48035070 con 0x7f1a58100560 2024-09-19T08:55:52.082 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.082+0000 7f1a5ff54640 1 -- 172.21.15.19:0/4067330290 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a581a1ee0 con 0x7f1a58100560 2024-09-19T08:55:52.083 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.084+0000 7f1a4effd640 1 -- 172.21.15.19:0/4067330290 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f1a48042030 con 0x7f1a58100560 2024-09-19T08:55:52.089 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.090+0000 7f1a4effd640 1 --2- 172.21.15.19:0/4067330290 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1a440a3340 0x7f1a440a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:52.089 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.090+0000 7f1a5dcf0640 1 --2- 172.21.15.19:0/4067330290 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1a440a3340 0x7f1a440a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:52.090 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.091+0000 7f1a5dcf0640 1 --2- 172.21.15.19:0/4067330290 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1a440a3340 0x7f1a440a5800 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1a580695c0 tx=0x7f1a54005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:52.100 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.101+0000 7f1a5ff54640 1 -- 172.21.15.19:0/4067330290 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a581a2340 con 0x7f1a58100560 2024-09-19T08:55:52.100 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.101+0000 7f1a4effd640 1 -- 172.21.15.19:0/4067330290 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1a4803b460 con 0x7f1a58100560 2024-09-19T08:55:52.265 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:52.265 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.546+0000 7f1a62dc8740 1 Processor -- start 2024-09-19T08:55:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.546+0000 7f1a62dc8740 1 -- start start 2024-09-19T08:55:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.546+0000 7f1a62dc8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c9d97259a0 0x55c9d9725da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.546+0000 7f1a62dc8740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c9d97262e0 0x55c9d972ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.546+0000 7f1a62dc8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c9d972b370 0x55c9d972d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.546+0000 7f1a62dc8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c9d96892f0 con 0x55c9d97259a0 2024-09-19T08:55:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.546+0000 7f1a62dc8740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55c9d9631270 con 0x55c9d97262e0 2024-09-19T08:55:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.546+0000 7f1a62dc8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c9d96852b0 con 0x55c9d972b370 2024-09-19T08:55:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.547+0000 7f1a5dcf0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c9d97259a0 0x55c9d9725da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.547+0000 7f1a5dcf0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c9d97259a0 0x55c9d9725da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48292/0 (socket says 172.21.15.19:48292) 2024-09-19T08:55:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.547+0000 7f1a5dcf0640 1 -- 172.21.15.19:0/1366793719 learned_addr learned my addr 172.21.15.19:0/1366793719 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:55:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.547+0000 7f1a5e4f1640 1 --2- 172.21.15.19:0/1366793719 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c9d972b370 0x55c9d972d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.547+0000 7f1a5d4ef640 1 --2- 172.21.15.19:0/1366793719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c9d97262e0 0x55c9d972ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.547+0000 7f1a5dcf0640 1 -- 172.21.15.19:0/1366793719 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c9d972b370 msgr2=0x55c9d972d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.547+0000 7f1a5dcf0640 1 --2- 172.21.15.19:0/1366793719 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c9d972b370 0x55c9d972d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.547+0000 7f1a5dcf0640 1 -- 172.21.15.19:0/1366793719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c9d97262e0 msgr2=0x55c9d972ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.547+0000 7f1a5dcf0640 1 --2- 172.21.15.19:0/1366793719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c9d97262e0 0x55c9d972ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.547+0000 7f1a5dcf0640 1 -- 172.21.15.19:0/1366793719 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9d9630340 con 0x55c9d97259a0 2024-09-19T08:55:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.547+0000 7f1a5d4ef640 1 --2- 172.21.15.19:0/1366793719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c9d97262e0 0x55c9d972ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:55:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.547+0000 7f1a5dcf0640 1 --2- 172.21.15.19:0/1366793719 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c9d97259a0 0x55c9d9725da0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f1a540097e0 tx=0x7f1a54014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22a70e5980a29937 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.547+0000 7f1a43fff640 1 -- 172.21.15.19:0/1366793719 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a54003d70 con 0x55c9d97259a0 2024-09-19T08:55:52.548 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.548+0000 7f1a43fff640 1 -- 172.21.15.19:0/1366793719 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a540044d0 con 0x55c9d97259a0 2024-09-19T08:55:52.549 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.548+0000 7f1a43fff640 1 -- 172.21.15.19:0/1366793719 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5401d780 con 0x55c9d97259a0 2024-09-19T08:55:52.549 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.548+0000 7f1a62dc8740 1 -- 172.21.15.19:0/1366793719 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c9d97259a0 msgr2=0x55c9d9725da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:52.549 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.548+0000 7f1a62dc8740 1 --2- 172.21.15.19:0/1366793719 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c9d97259a0 0x55c9d9725da0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f1a540097e0 tx=0x7f1a54014000 comp rx=0 tx=0).stop 2024-09-19T08:55:52.549 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.548+0000 7f1a62dc8740 1 -- 172.21.15.19:0/1366793719 shutdown_connections 2024-09-19T08:55:52.549 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.548+0000 7f1a62dc8740 1 --2- 172.21.15.19:0/1366793719 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c9d972b370 0x55c9d972d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.550 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.548+0000 7f1a62dc8740 1 --2- 172.21.15.19:0/1366793719 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c9d97262e0 0x55c9d972ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.550 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.548+0000 7f1a62dc8740 1 --2- 172.21.15.19:0/1366793719 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c9d97259a0 0x55c9d9725da0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.550 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.548+0000 7f1a62dc8740 1 -- 172.21.15.19:0/1366793719 >> 172.21.15.19:0/1366793719 conn(0x55c9d9721010 msgr2=0x55c9d9721410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:52.550 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.548+0000 7f1a62dc8740 1 -- 172.21.15.19:0/1366793719 shutdown_connections 2024-09-19T08:55:52.550 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.549+0000 7f1a62dc8740 1 -- 172.21.15.19:0/1366793719 wait complete. 2024-09-19T08:55:52.658 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.658+0000 7f1a62dc8740 1 -- start start 2024-09-19T08:55:52.672 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.673+0000 7f1a62dc8740 1 Processor -- start 2024-09-19T08:55:52.674 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.673+0000 7f1a62dc8740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c9d97259a0 0x55c9d972fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:52.674 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.673+0000 7f1a62dc8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c9d97262e0 0x55c9d97300a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:52.674 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.673+0000 7f1a62dc8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c9d972b370 0x55c9d97370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:52.674 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.673+0000 7f1a62dc8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c9d972e340 con 0x55c9d972b370 2024-09-19T08:55:52.674 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.673+0000 7f1a62dc8740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55c9d9612290 con 0x55c9d97259a0 2024-09-19T08:55:52.674 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.673+0000 7f1a62dc8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c9d972e4c0 con 0x55c9d97262e0 2024-09-19T08:55:52.674 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.674+0000 7f1a5e4f1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c9d972b370 0x55c9d97370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:52.674 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.674+0000 7f1a5e4f1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c9d972b370 0x55c9d97370e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48306/0 (socket says 172.21.15.19:48306) 2024-09-19T08:55:52.674 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.674+0000 7f1a5e4f1640 1 -- 172.21.15.19:0/182671138 learned_addr learned my addr 172.21.15.19:0/182671138 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:55:52.674 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.674+0000 7f1a5d4ef640 1 --2- 172.21.15.19:0/182671138 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c9d97262e0 0x55c9d97300a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:52.675 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.674+0000 7f1a5dcf0640 1 --2- 172.21.15.19:0/182671138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c9d97259a0 0x55c9d972fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:52.675 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.674+0000 7f1a5e4f1640 1 -- 172.21.15.19:0/182671138 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c9d97262e0 msgr2=0x55c9d97300a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:52.675 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.674+0000 7f1a5e4f1640 1 --2- 172.21.15.19:0/182671138 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c9d97262e0 0x55c9d97300a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.675 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.674+0000 7f1a5e4f1640 1 -- 172.21.15.19:0/182671138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c9d97259a0 msgr2=0x55c9d972fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:52.675 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.674+0000 7f1a5e4f1640 1 --2- 172.21.15.19:0/182671138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c9d97259a0 0x55c9d972fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.675 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.674+0000 7f1a5e4f1640 1 -- 172.21.15.19:0/182671138 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9d939c210 con 0x55c9d972b370 2024-09-19T08:55:52.675 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.674+0000 7f1a5e4f1640 1 --2- 172.21.15.19:0/182671138 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c9d972b370 0x55c9d97370e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f1a50012cf0 tx=0x7f1a5000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8157957834cfece7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:52.675 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.674+0000 7f1a417fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:55:52.675 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.674+0000 7f1a417fa640 1 -- 172.21.15.19:0/182671138 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5000fe60 con 0x55c9d972b370 2024-09-19T08:55:52.675 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.674+0000 7f1a417fa640 1 -- 172.21.15.19:0/182671138 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1a50009bf0 con 0x55c9d972b370 2024-09-19T08:55:52.678 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:52.678 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:52.694 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.695+0000 7f1a62dc8740 10 client.0 _ll_register_callbacks cb 0x55c9d9643140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:55:52.702 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.703+0000 7f1a62dc8740 1 -- 172.21.15.19:0/182671138 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a540044d0 con 0x55c9d972b370 2024-09-19T08:55:52.702 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.703+0000 7f1a417fa640 1 -- 172.21.15.19:0/182671138 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f1a50009df0 con 0x55c9d972b370 2024-09-19T08:55:52.703 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.703+0000 7f1a62dc8740 10 client.16125 fetch_fsmap learned FSMap version 32 2024-09-19T08:55:52.703 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.703+0000 7f1a62dc8740 1 -- 172.21.15.19:0/182671138 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({fsmap=32}) -- 0x55c9d9468620 con 0x55c9d972b370 2024-09-19T08:55:52.716 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:52.716 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:52.716 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 99 -lt 100 ']' 2024-09-19T08:55:52.716 INFO:tasks.workunit.client.0.smithi019.stderr:++ expr 99 + 1 2024-09-19T08:55:52.788 INFO:tasks.workunit.client.0.smithi019.stderr:+ c=100 2024-09-19T08:55:52.789 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.795+0000 7f1a417fa640 1 -- 172.21.15.19:0/182671138 <== mon.0 v2:172.21.15.19:3300/0 4 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f1a50026470 con 0x55c9d972b370 2024-09-19T08:55:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.795+0000 7f1a62dc8740 10 client.16125 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T08:55:52.795 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.795+0000 7f1a62dc8740 10 client.16125 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:55:52.796 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.796+0000 7f1a62dc8740 20 client.16125 populate_metadata read hostname 'smithi019' 2024-09-19T08:55:52.796 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.796+0000 7f1a62dc8740 1 --2- 172.21.15.19:0/182671138 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55c9d973b660 0x55c9d973daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:52.796 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.796+0000 7f1a62dc8740 4 client.16125 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:55:52.796 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.796+0000 7f1a62dc8740 1 -- 172.21.15.19:0/182671138 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c9d9696a20 con 0x55c9d973b660 2024-09-19T08:55:52.796 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.797+0000 7f1a5dcf0640 1 --2- 172.21.15.19:0/182671138 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55c9d973b660 0x55c9d973daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:52.797 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.798+0000 7f1a417fa640 10 client.16125 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:55:52.797 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.798+0000 7f1a5dcf0640 1 --2- 172.21.15.19:0/182671138 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55c9d973b660 0x55c9d973daf0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9871ade23cd992e3 server_cookie=51d4179f2f6a22a in_seq=0 out_seq=0 2024-09-19T08:55:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.798+0000 7f1a417fa640 1 -- 172.21.15.19:0/182671138 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c9d9696a20 con 0x55c9d973b660 2024-09-19T08:55:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.798+0000 7f1a417fa640 10 client.16125 handle_command_reply: tid=0 2024-09-19T08:55:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.798+0000 7f1a62dc8740 1 client.16125 shutdown 2024-09-19T08:55:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.798+0000 7f1a62dc8740 1 -- 172.21.15.19:0/182671138 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c9d972b370 msgr2=0x55c9d97370e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.799+0000 7f1a62dc8740 1 --2- 172.21.15.19:0/182671138 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c9d972b370 0x55c9d97370e0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f1a50012cf0 tx=0x7f1a5000f790 comp rx=0 tx=0).stop 2024-09-19T08:55:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.799+0000 7f1a62dc8740 1 -- 172.21.15.19:0/182671138 shutdown_connections 2024-09-19T08:55:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.799+0000 7f1a62dc8740 1 --2- 172.21.15.19:0/182671138 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55c9d973b660 0x55c9d973daf0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.798 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.799+0000 7f1a62dc8740 1 --2- 172.21.15.19:0/182671138 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c9d97262e0 0x55c9d97300a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.799+0000 7f1a62dc8740 1 --2- 172.21.15.19:0/182671138 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c9d972b370 0x55c9d97370e0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.799+0000 7f1a62dc8740 1 --2- 172.21.15.19:0/182671138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c9d97259a0 0x55c9d972fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.799+0000 7f1a417fa640 0 client.16125 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:55:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.799+0000 7f1a62dc8740 1 -- 172.21.15.19:0/182671138 >> 172.21.15.19:0/182671138 conn(0x55c9d9721010 msgr2=0x55c9d9722820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.799+0000 7f1a62dc8740 1 -- 172.21.15.19:0/182671138 shutdown_connections 2024-09-19T08:55:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.799+0000 7f1a62dc8740 1 -- 172.21.15.19:0/182671138 wait complete. 2024-09-19T08:55:52.799 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.799+0000 7f1a62dc8740 20 client.16125 trim_cache size 0 max 16384 2024-09-19T08:55:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.823+0000 7f1a62dc8740 1 Processor -- start 2024-09-19T08:55:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.823+0000 7f1a62dc8740 1 -- start start 2024-09-19T08:55:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.823+0000 7f1a62dc8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c9d97259a0 0x55c9d97213f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.823+0000 7f1a62dc8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c9d97262e0 0x55c9d97370a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.823+0000 7f1a62dc8740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c9d972b370 0x55c9d9721930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.823+0000 7f1a62dc8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1a581ab230 con 0x55c9d97259a0 2024-09-19T08:55:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.823+0000 7f1a62dc8740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1a581acd70 con 0x55c9d972b370 2024-09-19T08:55:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.823+0000 7f1a62dc8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1a581ab900 con 0x55c9d97262e0 2024-09-19T08:55:52.824 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.823+0000 7f1a5dcf0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c9d97259a0 0x55c9d97213f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:52.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.824+0000 7f1a5dcf0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c9d97259a0 0x55c9d97213f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48322/0 (socket says 172.21.15.19:48322) 2024-09-19T08:55:52.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.824+0000 7f1a5dcf0640 1 -- 172.21.15.19:0/657552562 learned_addr learned my addr 172.21.15.19:0/657552562 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:55:52.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.824+0000 7f1a5d4ef640 1 --2- 172.21.15.19:0/657552562 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c9d97262e0 0x55c9d97370a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:52.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.824+0000 7f1a5e4f1640 1 --2- 172.21.15.19:0/657552562 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c9d972b370 0x55c9d9721930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:52.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.824+0000 7f1a5dcf0640 1 -- 172.21.15.19:0/657552562 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c9d97262e0 msgr2=0x55c9d97370a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:52.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.824+0000 7f1a5dcf0640 1 --2- 172.21.15.19:0/657552562 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c9d97262e0 0x55c9d97370a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.824+0000 7f1a5dcf0640 1 -- 172.21.15.19:0/657552562 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c9d972b370 msgr2=0x55c9d9721930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:52.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.824+0000 7f1a5dcf0640 1 --2- 172.21.15.19:0/657552562 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c9d972b370 0x55c9d9721930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.824+0000 7f1a5dcf0640 1 -- 172.21.15.19:0/657552562 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9d97267c0 con 0x55c9d97259a0 2024-09-19T08:55:52.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.824+0000 7f1a5d4ef640 1 --2- 172.21.15.19:0/657552562 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c9d97262e0 0x55c9d97370a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:55:52.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.824+0000 7f1a5e4f1640 1 --2- 172.21.15.19:0/657552562 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c9d972b370 0x55c9d9721930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:55:52.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.824+0000 7f1a5dcf0640 1 --2- 172.21.15.19:0/657552562 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c9d97259a0 0x55c9d97213f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f1a540095f0 tx=0x7f1a54009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83aabf9a6f69831d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:52.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.824+0000 7f1a437fe640 1 -- 172.21.15.19:0/657552562 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a54005040 con 0x55c9d97259a0 2024-09-19T08:55:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.824+0000 7f1a437fe640 1 -- 172.21.15.19:0/657552562 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a54004680 con 0x55c9d97259a0 2024-09-19T08:55:52.826 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.824+0000 7f1a437fe640 1 -- 172.21.15.19:0/657552562 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5401c420 con 0x55c9d97259a0 2024-09-19T08:55:52.828 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.825+0000 7f1a62dc8740 1 -- 172.21.15.19:0/657552562 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c9d97259a0 msgr2=0x55c9d97213f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:52.829 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.825+0000 7f1a62dc8740 1 --2- 172.21.15.19:0/657552562 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c9d97259a0 0x55c9d97213f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f1a540095f0 tx=0x7f1a54009ea0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.829 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.825+0000 7f1a62dc8740 1 -- 172.21.15.19:0/657552562 shutdown_connections 2024-09-19T08:55:52.829 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.825+0000 7f1a62dc8740 1 --2- 172.21.15.19:0/657552562 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c9d97262e0 0x55c9d97370a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.829 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.825+0000 7f1a62dc8740 1 --2- 172.21.15.19:0/657552562 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c9d972b370 0x55c9d9721930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.829 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.825+0000 7f1a62dc8740 1 --2- 172.21.15.19:0/657552562 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c9d97259a0 0x55c9d97213f0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.829 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.825+0000 7f1a62dc8740 1 -- 172.21.15.19:0/657552562 >> 172.21.15.19:0/657552562 conn(0x55c9d9721010 msgr2=0x55c9d972fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:52.829 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.825+0000 7f1a62dc8740 1 -- 172.21.15.19:0/657552562 shutdown_connections 2024-09-19T08:55:52.829 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.825+0000 7f1a62dc8740 1 -- 172.21.15.19:0/657552562 wait complete. 2024-09-19T08:55:52.829 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.826+0000 7f1a62dc8740 1 -- start start 2024-09-19T08:55:52.829 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.826+0000 7f1a62dc8740 1 Processor -- start 2024-09-19T08:55:52.829 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.826+0000 7f1a62dc8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c9d97259a0 0x55c9d97349a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:52.829 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.826+0000 7f1a62dc8740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c9d97262e0 0x55c9d9734ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:52.830 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.826+0000 7f1a62dc8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c9d972b370 0x55c9d9735ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:52.830 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.826+0000 7f1a62dc8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1a581ac6a0 con 0x55c9d97259a0 2024-09-19T08:55:52.830 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.826+0000 7f1a62dc8740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1a581abfd0 con 0x55c9d97262e0 2024-09-19T08:55:52.830 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.826+0000 7f1a62dc8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1a581a9210 con 0x55c9d972b370 2024-09-19T08:55:52.830 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.826+0000 7f1a62dc8740 10 client.0 _ll_register_callbacks cb 0x7f1a50009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:55:52.830 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.826+0000 7f1a5dcf0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c9d97259a0 0x55c9d97349a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:52.830 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.826+0000 7f1a5dcf0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c9d97259a0 0x55c9d97349a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48338/0 (socket says 172.21.15.19:48338) 2024-09-19T08:55:52.830 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.826+0000 7f1a5dcf0640 1 -- 172.21.15.19:0/1390088443 learned_addr learned my addr 172.21.15.19:0/1390088443 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:55:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.827+0000 7f1a5e4f1640 1 --2- 172.21.15.19:0/1390088443 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c9d972b370 0x55c9d9735ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.827+0000 7f1a5d4ef640 1 --2- 172.21.15.19:0/1390088443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c9d97262e0 0x55c9d9734ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.827+0000 7f1a5dcf0640 1 -- 172.21.15.19:0/1390088443 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c9d972b370 msgr2=0x55c9d9735ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.827+0000 7f1a5dcf0640 1 --2- 172.21.15.19:0/1390088443 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c9d972b370 0x55c9d9735ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.827+0000 7f1a5dcf0640 1 -- 172.21.15.19:0/1390088443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c9d97262e0 msgr2=0x55c9d9734ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:55:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.827+0000 7f1a5dcf0640 1 --2- 172.21.15.19:0/1390088443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c9d97262e0 0x55c9d9734ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.827+0000 7f1a5dcf0640 1 -- 172.21.15.19:0/1390088443 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9d9736500 con 0x55c9d97259a0 2024-09-19T08:55:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.827+0000 7f1a5d4ef640 1 --2- 172.21.15.19:0/1390088443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c9d97262e0 0x55c9d9734ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:55:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.827+0000 7f1a5dcf0640 1 --2- 172.21.15.19:0/1390088443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c9d97259a0 0x55c9d97349a0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f1a54009500 tx=0x7f1a54004990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c7a452decf764 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.827+0000 7f1a417fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:55:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.827+0000 7f1a417fa640 1 -- 172.21.15.19:0/1390088443 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a54004b00 con 0x55c9d97259a0 2024-09-19T08:55:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.827+0000 7f1a417fa640 1 -- 172.21.15.19:0/1390088443 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1a54035070 con 0x55c9d97259a0 2024-09-19T08:55:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.827+0000 7f1a62dc8740 1 -- 172.21.15.19:0/1390088443 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a54004680 con 0x55c9d97259a0 2024-09-19T08:55:52.831 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.827+0000 7f1a417fa640 1 -- 172.21.15.19:0/1390088443 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f1a54004ca0 con 0x55c9d97259a0 2024-09-19T08:55:52.832 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.827+0000 7f1a62dc8740 10 client.16131 fetch_fsmap learned FSMap version 32 2024-09-19T08:55:52.832 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.827+0000 7f1a62dc8740 1 -- 172.21.15.19:0/1390088443 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55c9d97a6610 con 0x55c9d97259a0 2024-09-19T08:55:52.832 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.828+0000 7f1a417fa640 1 -- 172.21.15.19:0/1390088443 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a54004680 con 0x55c9d97259a0 2024-09-19T08:55:52.832 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.828+0000 7f1a417fa640 1 -- 172.21.15.19:0/1390088443 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 32) ==== 8362+0+0 (secure 0 0 0) 0x7f1a54039be0 con 0x55c9d97259a0 2024-09-19T08:55:52.832 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.828+0000 7f1a62dc8740 10 client.16131 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T08:55:52.832 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.828+0000 7f1a62dc8740 10 client.16131 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:55:52.832 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.828+0000 7f1a62dc8740 20 client.16131 populate_metadata read hostname 'smithi019' 2024-09-19T08:55:52.832 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:52.833 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.828+0000 7f1a62dc8740 1 --2- 172.21.15.19:0/1390088443 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55c9d97a6c80 0x55c9d97a9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:52.833 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.828+0000 7f1a62dc8740 4 client.16131 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:55:52.833 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.828+0000 7f1a62dc8740 1 -- 172.21.15.19:0/1390088443 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c9d9690d70 con 0x55c9d97a6c80 2024-09-19T08:55:52.833 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:52.833 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.828+0000 7f1a5d4ef640 1 --2- 172.21.15.19:0/1390088443 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55c9d97a6c80 0x55c9d97a9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:52.834 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.829+0000 7f1a5d4ef640 1 --2- 172.21.15.19:0/1390088443 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55c9d97a6c80 0x55c9d97a9070 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d1803d6b2e880a5 server_cookie=403996ab88c0988d in_seq=0 out_seq=0 2024-09-19T08:55:52.834 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.829+0000 7f1a417fa640 10 client.16131 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:55:52.834 INFO:tasks.workunit.client.0.smithi019.stderr:+ c1=2 2024-09-19T08:55:52.834 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo 3 2024-09-19T08:55:52.834 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo tee /proc/sys/vm/drop_caches 2024-09-19T08:55:52.836 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.836+0000 7f1a417fa640 1 -- 172.21.15.19:0/1390088443 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c9d9690d70 con 0x55c9d97a6c80 2024-09-19T08:55:52.836 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.836+0000 7f1a417fa640 10 client.16131 handle_command_reply: tid=0 2024-09-19T08:55:52.836 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.836+0000 7f1a62dc8740 1 client.16131 shutdown 2024-09-19T08:55:52.836 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.836+0000 7f1a62dc8740 1 -- 172.21.15.19:0/1390088443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c9d97259a0 msgr2=0x55c9d97349a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:52.836 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.836+0000 7f1a62dc8740 1 --2- 172.21.15.19:0/1390088443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c9d97259a0 0x55c9d97349a0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f1a54009500 tx=0x7f1a54004990 comp rx=0 tx=0).stop 2024-09-19T08:55:52.836 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.836+0000 7f1a62dc8740 1 -- 172.21.15.19:0/1390088443 shutdown_connections 2024-09-19T08:55:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.836+0000 7f1a62dc8740 1 --2- 172.21.15.19:0/1390088443 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55c9d97a6c80 0x55c9d97a9070 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.836+0000 7f1a62dc8740 1 --2- 172.21.15.19:0/1390088443 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c9d972b370 0x55c9d9735ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.836+0000 7f1a62dc8740 1 --2- 172.21.15.19:0/1390088443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c9d97262e0 0x55c9d9734ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.836+0000 7f1a417fa640 0 client.16131 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:55:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.836+0000 7f1a62dc8740 1 --2- 172.21.15.19:0/1390088443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c9d97259a0 0x55c9d97349a0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.836+0000 7f1a62dc8740 1 -- 172.21.15.19:0/1390088443 >> 172.21.15.19:0/1390088443 conn(0x55c9d9721010 msgr2=0x55c9d971f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.837+0000 7f1a62dc8740 1 -- 172.21.15.19:0/1390088443 shutdown_connections 2024-09-19T08:55:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.837+0000 7f1a62dc8740 1 -- 172.21.15.19:0/1390088443 wait complete. 2024-09-19T08:55:52.837 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.837+0000 7f1a62dc8740 20 client.16131 trim_cache size 0 max 16384 2024-09-19T08:55:52.838 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T08:55:52.838 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T08:55:52.838 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T08:55:52.838 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T08:55:52.838 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.838+0000 7f1a5ff54640 1 -- 172.21.15.19:0/4067330290 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1a440a3340 msgr2=0x7f1a440a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.838+0000 7f1a5ff54640 1 --2- 172.21.15.19:0/4067330290 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1a440a3340 0x7f1a440a5800 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1a580695c0 tx=0x7f1a54005f90 comp rx=0 tx=0).stop 2024-09-19T08:55:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.838+0000 7f1a5ff54640 1 -- 172.21.15.19:0/4067330290 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a58100560 msgr2=0x7f1a5819a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.838+0000 7f1a5ff54640 1 --2- 172.21.15.19:0/4067330290 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a58100560 0x7f1a5819a570 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f1a48031440 tx=0x7f1a48032c60 comp rx=0 tx=0).stop 2024-09-19T08:55:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.838+0000 7f1a5ff54640 1 -- 172.21.15.19:0/4067330290 shutdown_connections 2024-09-19T08:55:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.838+0000 7f1a5ff54640 1 --2- 172.21.15.19:0/4067330290 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1a440a3340 0x7f1a440a5800 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.838+0000 7f1a5ff54640 1 --2- 172.21.15.19:0/4067330290 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a58103130 0x7f1a581a15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.838+0000 7f1a5ff54640 1 --2- 172.21.15.19:0/4067330290 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a58100560 0x7f1a5819a570 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.838+0000 7f1a5ff54640 1 --2- 172.21.15.19:0/4067330290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a580ffba0 0x7f1a5819a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.838+0000 7f1a5ff54640 1 -- 172.21.15.19:0/4067330290 >> 172.21.15.19:0/4067330290 conn(0x7f1a580fb930 msgr2=0x7f1a58100cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.838+0000 7f1a5ff54640 1 -- 172.21.15.19:0/4067330290 shutdown_connections 2024-09-19T08:55:52.839 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:55:52.838+0000 7f1a5ff54640 1 -- 172.21.15.19:0/4067330290 wait complete. 2024-09-19T08:55:53.535 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:53 smithi019 ceph-mon[30976]: pgmap v447: 97 pgs: 97 active+clean; 1.5 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.9 KiB/s wr, 11 op/s 2024-09-19T08:55:53.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:53 smithi155 ceph-mon[34921]: pgmap v447: 97 pgs: 97 active+clean; 1.5 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.9 KiB/s wr, 11 op/s 2024-09-19T08:55:53.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:53 smithi203 ceph-mon[35450]: pgmap v447: 97 pgs: 97 active+clean; 1.5 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.9 KiB/s wr, 11 op/s 2024-09-19T08:55:54.223 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfacl d1 2024-09-19T08:55:54.223 INFO:tasks.workunit.client.0.smithi019.stderr:++ grep -c nobody:rw 2024-09-19T08:55:54.611 INFO:tasks.workunit.client.0.smithi019.stderr:+ c2=2 2024-09-19T08:55:54.611 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:54.632 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:54.632 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 2 -ne 2 ']' 2024-09-19T08:55:54.632 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' 100 -lt 100 ']' 2024-09-19T08:55:54.641 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir d1 2024-09-19T08:55:54.677 INFO:tasks.workunit.client.0.smithi019.stderr:+ setfattr -n system.posix_acl_access -v 0x02000000 d1 2024-09-19T08:55:54.700 INFO:tasks.workunit.client.0.smithi019.stderr:+ setfattr -n system.posix_acl_default -v 0x02000000 . 2024-09-19T08:55:54.703 INFO:tasks.workunit.client.0.smithi019.stderr:+ expect_failure getfattr -n system.posix_acl_access d1 2024-09-19T08:55:54.703 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n system.posix_acl_access d1 2024-09-19T08:55:54.709 INFO:tasks.workunit.client.0.smithi019.stderr:d1: system.posix_acl_access: No such attribute 2024-09-19T08:55:54.709 INFO:tasks.workunit.client.0.smithi019.stderr:+ return 0 2024-09-19T08:55:54.709 INFO:tasks.workunit.client.0.smithi019.stderr:+ expect_failure getfattr -n system.posix_acl_default . 2024-09-19T08:55:54.710 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n system.posix_acl_default . 2024-09-19T08:55:54.710 INFO:tasks.workunit.client.0.smithi019.stderr:.: system.posix_acl_default: No such attribute 2024-09-19T08:55:54.710 INFO:tasks.workunit.client.0.smithi019.stderr:+ return 0 2024-09-19T08:55:54.710 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir d1 2024-09-19T08:55:54.713 INFO:tasks.workunit.client.0.smithi019.stderr:+ cd .. 2024-09-19T08:55:54.717 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir testdir 2024-09-19T08:55:54.725 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo OK 2024-09-19T08:55:54.726 INFO:tasks.workunit.client.0.smithi019.stdout:OK 2024-09-19T08:55:54.726 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T08:55:54.726 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T08:55:55.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:55 smithi019 ceph-mon[30976]: pgmap v448: 97 pgs: 97 active+clean; 1.5 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.7 KiB/s wr, 14 op/s 2024-09-19T08:55:55.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:55 smithi155 ceph-mon[34921]: pgmap v448: 97 pgs: 97 active+clean; 1.5 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.7 KiB/s wr, 14 op/s 2024-09-19T08:55:55.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:55 smithi203 ceph-mon[35450]: pgmap v448: 97 pgs: 97 active+clean; 1.5 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.7 KiB/s wr, 14 op/s 2024-09-19T08:55:55.867 INFO:tasks.workunit:Running workunit fs/misc/chmod.sh... 2024-09-19T08:55:55.867 DEBUG:teuthology.orchestra.run.smithi019:workunit test fs/misc/chmod.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/chmod.sh 2024-09-19T08:55:55.951 INFO:tasks.workunit.client.0.smithi019.stderr:+ set -e 2024-09-19T08:55:55.951 INFO:tasks.workunit.client.0.smithi019.stderr:+ file=test_chmod.92878 2024-09-19T08:55:55.951 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo foo 2024-09-19T08:55:55.956 INFO:tasks.workunit.client.0.smithi019.stderr:+ test 0 '!=' 0 2024-09-19T08:55:55.956 INFO:tasks.workunit.client.0.smithi019.stderr:+ chmod 400 test_chmod.92878 2024-09-19T08:55:55.962 INFO:tasks.workunit.client.0.smithi019.stderr:+ test 0 '!=' 0 2024-09-19T08:55:55.962 INFO:tasks.workunit.client.0.smithi019.stderr:+ check_perms test_chmod.92878 -r-------- 2024-09-19T08:55:55.962 INFO:tasks.workunit.client.0.smithi019.stderr:+ file=test_chmod.92878 2024-09-19T08:55:55.962 INFO:tasks.workunit.client.0.smithi019.stderr:++ ls -la test_chmod.92878 2024-09-19T08:55:55.974 INFO:tasks.workunit.client.0.smithi019.stderr:+ r='-r--------. 1 ubuntu ubuntu 4 Sep 19 08:55 test_chmod.92878' 2024-09-19T08:55:55.974 INFO:tasks.workunit.client.0.smithi019.stderr:+ test 0 '!=' 0 2024-09-19T08:55:55.974 INFO:tasks.workunit.client.0.smithi019.stderr:+ perms=-r-------- 2024-09-19T08:55:55.975 INFO:tasks.workunit.client.0.smithi019.stderr:++ echo -r--------. 1 ubuntu ubuntu 4 Sep 19 08:55 test_chmod.92878 2024-09-19T08:55:55.975 INFO:tasks.workunit.client.0.smithi019.stderr:++ awk '{print $1}' 2024-09-19T08:55:56.130 INFO:tasks.workunit.client.0.smithi019.stderr:+ test -r-------- '!=' -r--------. 2024-09-19T08:55:56.130 INFO:tasks.workunit.client.0.smithi019.stderr:++ echo -r--------. 1 ubuntu ubuntu 4 Sep 19 08:55 test_chmod.92878 2024-09-19T08:55:56.130 INFO:tasks.workunit.client.0.smithi019.stderr:++ awk '{print $1}' 2024-09-19T08:55:56.133 INFO:tasks.workunit.client.0.smithi019.stderr:+ test -r--------. '!=' -r--------. 2024-09-19T08:55:56.133 INFO:tasks.workunit.client.0.smithi019.stderr:+ set +e 2024-09-19T08:55:56.133 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo bar 2024-09-19T08:55:56.133 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/chmod.sh: line 40: test_chmod.92878: Permission denied 2024-09-19T08:55:56.133 INFO:tasks.workunit.client.0.smithi019.stderr:+ test 1 = 0 2024-09-19T08:55:56.133 INFO:tasks.workunit.client.0.smithi019.stderr:+ set -e 2024-09-19T08:55:56.133 INFO:tasks.workunit.client.0.smithi019.stderr:+ chmod 600 test_chmod.92878 2024-09-19T08:55:56.133 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo bar 2024-09-19T08:55:56.133 INFO:tasks.workunit.client.0.smithi019.stderr:+ test 0 '!=' 0 2024-09-19T08:55:56.133 INFO:tasks.workunit.client.0.smithi019.stderr:+ check_perms test_chmod.92878 -rw------- 2024-09-19T08:55:56.133 INFO:tasks.workunit.client.0.smithi019.stderr:+ file=test_chmod.92878 2024-09-19T08:55:56.134 INFO:tasks.workunit.client.0.smithi019.stderr:++ ls -la test_chmod.92878 2024-09-19T08:55:56.134 INFO:tasks.workunit.client.0.smithi019.stderr:+ r='-rw-------. 1 ubuntu ubuntu 8 Sep 19 08:55 test_chmod.92878' 2024-09-19T08:55:56.134 INFO:tasks.workunit.client.0.smithi019.stderr:+ test 0 '!=' 0 2024-09-19T08:55:56.134 INFO:tasks.workunit.client.0.smithi019.stderr:+ perms=-rw------- 2024-09-19T08:55:56.135 INFO:tasks.workunit.client.0.smithi019.stderr:++ echo -rw-------. 1 ubuntu ubuntu 8 Sep 19 08:55 test_chmod.92878 2024-09-19T08:55:56.135 INFO:tasks.workunit.client.0.smithi019.stderr:++ awk '{print $1}' 2024-09-19T08:55:56.136 INFO:tasks.workunit.client.0.smithi019.stderr:+ test -rw------- '!=' -rw-------. 2024-09-19T08:55:56.137 INFO:tasks.workunit.client.0.smithi019.stderr:++ echo -rw-------. 1 ubuntu ubuntu 8 Sep 19 08:55 test_chmod.92878 2024-09-19T08:55:56.137 INFO:tasks.workunit.client.0.smithi019.stderr:++ awk '{print $1}' 2024-09-19T08:55:56.139 INFO:tasks.workunit.client.0.smithi019.stderr:+ test -rw-------. '!=' -rw-------. 2024-09-19T08:55:56.139 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo foo 2024-09-19T08:55:56.139 INFO:tasks.workunit.client.0.smithi019.stderr:+ test 0 '!=' 0 2024-09-19T08:55:56.139 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T08:55:56.140 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T08:55:56.183 INFO:tasks.workunit:Running workunit fs/misc/dac_override.sh... 2024-09-19T08:55:56.183 DEBUG:teuthology.orchestra.run.smithi019:workunit test fs/misc/dac_override.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/dac_override.sh 2024-09-19T08:55:56.217 INFO:tasks.workunit.client.0.smithi019.stderr:+ set -e 2024-09-19T08:55:56.217 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir -p testdir 2024-09-19T08:55:56.219 INFO:tasks.workunit.client.0.smithi019.stderr:+ file=test_chmod.92931 2024-09-19T08:55:56.219 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo foo 2024-09-19T08:55:56.220 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo chmod 600 testdir 2024-09-19T08:55:56.233 INFO:tasks.workunit.client.0.smithi019.stderr:+ expect_failure cat testdir/test_chmod.92931 2024-09-19T08:55:56.233 INFO:tasks.workunit.client.0.smithi019.stderr:+ cat testdir/test_chmod.92931 2024-09-19T08:55:56.234 INFO:tasks.workunit.client.0.smithi019.stderr:cat: testdir/test_chmod.92931: Permission denied 2024-09-19T08:55:56.234 INFO:tasks.workunit.client.0.smithi019.stderr:+ return 0 2024-09-19T08:55:56.234 INFO:tasks.workunit.client.0.smithi019.stderr:+ sudo cat testdir/test_chmod.92931 2024-09-19T08:55:56.244 INFO:tasks.workunit.client.0.smithi019.stdout:foo 2024-09-19T08:55:56.246 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T08:55:56.246 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T08:55:56.341 INFO:tasks.workunit:Running workunit fs/misc/direct_io.py... 2024-09-19T08:55:56.342 DEBUG:teuthology.orchestra.run.smithi019:workunit test fs/misc/direct_io.py> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/direct_io.py 2024-09-19T08:55:56.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.957+0000 7f3e73a81640 1 -- 172.21.15.19:0/3193796763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e6c102d30 msgr2=0x7f3e6c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:56.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.957+0000 7f3e73a81640 1 --2- 172.21.15.19:0/3193796763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e6c102d30 0x7f3e6c103110 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c009cd0 tx=0x7f3e5c02a910 comp rx=0 tx=0).stop 2024-09-19T08:55:56.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.957+0000 7f3e73a81640 1 -- 172.21.15.19:0/3193796763 shutdown_connections 2024-09-19T08:55:56.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.957+0000 7f3e73a81640 1 --2- 172.21.15.19:0/3193796763 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e6c1082a0 0x7f3e6c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:56.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.957+0000 7f3e73a81640 1 --2- 172.21.15.19:0/3193796763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e6c1036e0 0x7f3e6c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:56.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.957+0000 7f3e73a81640 1 --2- 172.21.15.19:0/3193796763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e6c102d30 0x7f3e6c103110 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:56.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.957+0000 7f3e73a81640 1 -- 172.21.15.19:0/3193796763 >> 172.21.15.19:0/3193796763 conn(0x7f3e6c0fc7d0 msgr2=0x7f3e6c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:56.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.957+0000 7f3e73a81640 1 -- 172.21.15.19:0/3193796763 shutdown_connections 2024-09-19T08:55:56.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.957+0000 7f3e73a81640 1 -- 172.21.15.19:0/3193796763 wait complete. 2024-09-19T08:55:56.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.958+0000 7f3e73a81640 1 Processor -- start 2024-09-19T08:55:56.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.958+0000 7f3e73a81640 1 -- start start 2024-09-19T08:55:56.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.958+0000 7f3e73a81640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e6c102d30 0x7f3e6c100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:56.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.958+0000 7f3e73a81640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e6c1036e0 0x7f3e6c100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:56.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.958+0000 7f3e73a81640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e6c1082a0 0x7f3e6c101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:56.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.958+0000 7f3e73a81640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6c112130 con 0x7f3e6c1036e0 2024-09-19T08:55:56.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.958+0000 7f3e73a81640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6c111fb0 con 0x7f3e6c1082a0 2024-09-19T08:55:56.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.958+0000 7f3e73a81640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6c1122b0 con 0x7f3e6c102d30 2024-09-19T08:55:56.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.958+0000 7f3e7101c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e6c1036e0 0x7f3e6c100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:56.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.958+0000 7f3e7101c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e6c1036e0 0x7f3e6c100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45646/0 (socket says 172.21.15.19:45646) 2024-09-19T08:55:56.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.958+0000 7f3e7101c640 1 -- 172.21.15.19:0/1809967773 learned_addr learned my addr 172.21.15.19:0/1809967773 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:55:56.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.959+0000 7f3e7181d640 1 --2- 172.21.15.19:0/1809967773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e6c102d30 0x7f3e6c100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:56.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.959+0000 7f3e7201e640 1 --2- 172.21.15.19:0/1809967773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e6c1082a0 0x7f3e6c101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:56.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.959+0000 7f3e7101c640 1 -- 172.21.15.19:0/1809967773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e6c102d30 msgr2=0x7f3e6c100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:56.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.959+0000 7f3e7101c640 1 --2- 172.21.15.19:0/1809967773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e6c102d30 0x7f3e6c100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:56.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.959+0000 7f3e7101c640 1 -- 172.21.15.19:0/1809967773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e6c1082a0 msgr2=0x7f3e6c101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:56.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.959+0000 7f3e7101c640 1 --2- 172.21.15.19:0/1809967773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e6c1082a0 0x7f3e6c101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:56.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.959+0000 7f3e7101c640 1 -- 172.21.15.19:0/1809967773 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e6c1a6ad0 con 0x7f3e6c1036e0 2024-09-19T08:55:56.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.959+0000 7f3e7201e640 1 --2- 172.21.15.19:0/1809967773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e6c1082a0 0x7f3e6c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:55:56.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.959+0000 7f3e7101c640 1 --2- 172.21.15.19:0/1809967773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e6c1036e0 0x7f3e6c100ed0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f3e60006fd0 tx=0x7f3e6000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:56.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.959+0000 7f3e6affd640 1 -- 172.21.15.19:0/1809967773 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e60011830 con 0x7f3e6c1036e0 2024-09-19T08:55:56.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.959+0000 7f3e73a81640 1 -- 172.21.15.19:0/1809967773 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e6c1a6dc0 con 0x7f3e6c1036e0 2024-09-19T08:55:56.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.959+0000 7f3e6affd640 1 -- 172.21.15.19:0/1809967773 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e60016070 con 0x7f3e6c1036e0 2024-09-19T08:55:56.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.959+0000 7f3e6affd640 1 -- 172.21.15.19:0/1809967773 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6000f2e0 con 0x7f3e6c1036e0 2024-09-19T08:55:56.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.959+0000 7f3e73a81640 1 -- 172.21.15.19:0/1809967773 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e6c1a7270 con 0x7f3e6c1036e0 2024-09-19T08:55:56.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.962+0000 7f3e6affd640 1 -- 172.21.15.19:0/1809967773 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f3e6001b460 con 0x7f3e6c1036e0 2024-09-19T08:55:56.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.962+0000 7f3e73a81640 1 -- 172.21.15.19:0/1809967773 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e6c06a850 con 0x7f3e6c1036e0 2024-09-19T08:55:56.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.962+0000 7f3e6affd640 1 --2- 172.21.15.19:0/1809967773 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3e540a3240 0x7f3e540a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:55:56.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.962+0000 7f3e7181d640 1 --2- 172.21.15.19:0/1809967773 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3e540a3240 0x7f3e540a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:55:56.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.962+0000 7f3e6affd640 1 -- 172.21.15.19:0/1809967773 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f3e600cefa0 con 0x7f3e6c1036e0 2024-09-19T08:55:56.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.963+0000 7f3e7181d640 1 --2- 172.21.15.19:0/1809967773 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3e540a3240 0x7f3e540a5700 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c000f80 tx=0x7f3e5c009800 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:55:56.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:56.967+0000 7f3e6affd640 1 -- 172.21.15.19:0/1809967773 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3e6009bd70 con 0x7f3e6c1036e0 2024-09-19T08:55:57.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:57.179+0000 7f3e73a81640 1 -- 172.21.15.19:0/1809967773 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3e6c10a2b0 con 0x7f3e6c1036e0 2024-09-19T08:55:57.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:57.180+0000 7f3e6affd640 1 -- 172.21.15.19:0/1809967773 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11983 (secure 0 0 0) 0x7f3e6009b670 con 0x7f3e6c1036e0 2024-09-19T08:55:57.180 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:55:57.180 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":32,"btime":"2024-09-19T08:55:40:240748+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2452068876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2452068876},{"type":"v1","addr":"172.21.15.19:6839","nonce":2452068876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":32,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T08:55:39.966677+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/2480841559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2480841559},{"type":"v1","addr":"172.21.15.155:6835","nonce":2480841559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24463,24464,24490,24469,24497]},"id":1}]} 2024-09-19T08:55:57.180 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 32 2024-09-19T08:55:57.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:57.182+0000 7f3e73a81640 1 -- 172.21.15.19:0/1809967773 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3e540a3240 msgr2=0x7f3e540a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:57.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:57.182+0000 7f3e73a81640 1 --2- 172.21.15.19:0/1809967773 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3e540a3240 0x7f3e540a5700 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c000f80 tx=0x7f3e5c009800 comp rx=0 tx=0).stop 2024-09-19T08:55:57.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:57.182+0000 7f3e73a81640 1 -- 172.21.15.19:0/1809967773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e6c1036e0 msgr2=0x7f3e6c100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:55:57.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:57.182+0000 7f3e73a81640 1 --2- 172.21.15.19:0/1809967773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e6c1036e0 0x7f3e6c100ed0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f3e60006fd0 tx=0x7f3e6000b8e0 comp rx=0 tx=0).stop 2024-09-19T08:55:57.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:57.182+0000 7f3e73a81640 1 -- 172.21.15.19:0/1809967773 shutdown_connections 2024-09-19T08:55:57.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:57.182+0000 7f3e73a81640 1 --2- 172.21.15.19:0/1809967773 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3e540a3240 0x7f3e540a5700 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:57.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:57.182+0000 7f3e73a81640 1 --2- 172.21.15.19:0/1809967773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e6c1082a0 0x7f3e6c101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:57.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:57.182+0000 7f3e73a81640 1 --2- 172.21.15.19:0/1809967773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e6c1036e0 0x7f3e6c100ed0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:57.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:57.182+0000 7f3e73a81640 1 --2- 172.21.15.19:0/1809967773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e6c102d30 0x7f3e6c100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:55:57.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:57.182+0000 7f3e73a81640 1 -- 172.21.15.19:0/1809967773 >> 172.21.15.19:0/1809967773 conn(0x7f3e6c0fc7d0 msgr2=0x7f3e6c105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:55:57.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:57.182+0000 7f3e73a81640 1 -- 172.21.15.19:0/1809967773 shutdown_connections 2024-09-19T08:55:57.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:55:57.182+0000 7f3e73a81640 1 -- 172.21.15.19:0/1809967773 wait complete. 2024-09-19T08:55:57.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:57 smithi019 ceph-mon[30976]: pgmap v449: 97 pgs: 97 active+clean; 1.5 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.2 KiB/s wr, 13 op/s 2024-09-19T08:55:57.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:57 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1809967773' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:55:57.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:57 smithi155 ceph-mon[34921]: pgmap v449: 97 pgs: 97 active+clean; 1.5 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.2 KiB/s wr, 13 op/s 2024-09-19T08:55:57.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:57 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1809967773' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:55:57.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:57 smithi203 ceph-mon[35450]: pgmap v449: 97 pgs: 97 active+clean; 1.5 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.2 KiB/s wr, 13 op/s 2024-09-19T08:55:57.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:57 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1809967773' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:55:58.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:58 smithi019 ceph-mon[30976]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T08:55:58.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:58 smithi155 ceph-mon[34921]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T08:55:58.703 INFO:tasks.workunit.client.0.smithi019.stdout:ok 2024-09-19T08:55:58.707 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T08:55:58.708 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T08:55:58.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:58 smithi203 ceph-mon[35450]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T08:55:58.751 INFO:tasks.workunit:Running workunit fs/misc/dirfrag.sh... 2024-09-19T08:55:58.751 DEBUG:teuthology.orchestra.run.smithi019:workunit test fs/misc/dirfrag.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/dirfrag.sh 2024-09-19T08:55:59.493 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T08:55:59.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:55:59 smithi019 ceph-mon[30976]: pgmap v450: 97 pgs: 97 active+clean; 1.6 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.4 KiB/s wr, 14 op/s 2024-09-19T08:55:59.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:55:59 smithi155 ceph-mon[34921]: pgmap v450: 97 pgs: 97 active+clean; 1.6 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.4 KiB/s wr, 14 op/s 2024-09-19T08:55:59.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:55:59 smithi203 ceph-mon[35450]: pgmap v450: 97 pgs: 97 active+clean; 1.6 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.4 KiB/s wr, 14 op/s 2024-09-19T08:55:59.996 INFO:tasks.workunit.client.0.smithi019.stdout:creating folder hierarchy 2024-09-19T08:56:00.129 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:00.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.932+0000 7ff52b4ac640 1 -- 172.21.15.19:0/36214680 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff524102570 msgr2=0x7ff5241029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:00.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.932+0000 7ff52b4ac640 1 --2- 172.21.15.19:0/36214680 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff524102570 0x7ff5241029b0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ff514009900 tx=0x7ff51402a480 comp rx=0 tx=0).stop 2024-09-19T08:56:00.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.932+0000 7ff52b4ac640 1 -- 172.21.15.19:0/36214680 shutdown_connections 2024-09-19T08:56:00.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.932+0000 7ff52b4ac640 1 --2- 172.21.15.19:0/36214680 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff524102ef0 0x7ff52410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.932+0000 7ff52b4ac640 1 --2- 172.21.15.19:0/36214680 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff524102570 0x7ff5241029b0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.932+0000 7ff52b4ac640 1 --2- 172.21.15.19:0/36214680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff524100e20 0x7ff524101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.932+0000 7ff52b4ac640 1 -- 172.21.15.19:0/36214680 >> 172.21.15.19:0/36214680 conn(0x7ff5240fc7d0 msgr2=0x7ff5240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:00.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.932+0000 7ff52b4ac640 1 -- 172.21.15.19:0/36214680 shutdown_connections 2024-09-19T08:56:00.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.932+0000 7ff52b4ac640 1 -- 172.21.15.19:0/36214680 wait complete. 2024-09-19T08:56:00.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.933+0000 7ff52b4ac640 1 Processor -- start 2024-09-19T08:56:00.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.933+0000 7ff52b4ac640 1 -- start start 2024-09-19T08:56:00.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.933+0000 7ff52b4ac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff524100e20 0x7ff524199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:00.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.933+0000 7ff52b4ac640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff524102570 0x7ff524199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:00.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.933+0000 7ff52b4ac640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff524102ef0 0x7ff5241a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:00.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.933+0000 7ff52b4ac640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff524110f80 con 0x7ff524100e20 2024-09-19T08:56:00.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.933+0000 7ff52b4ac640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff524110e00 con 0x7ff524102ef0 2024-09-19T08:56:00.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.933+0000 7ff52b4ac640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff524111100 con 0x7ff524102570 2024-09-19T08:56:00.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.933+0000 7ff529248640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff524100e20 0x7ff524199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:00.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.933+0000 7ff529248640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff524100e20 0x7ff524199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45720/0 (socket says 172.21.15.19:45720) 2024-09-19T08:56:00.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.933+0000 7ff529248640 1 -- 172.21.15.19:0/2564062629 learned_addr learned my addr 172.21.15.19:0/2564062629 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:00.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.933+0000 7ff528a47640 1 --2- 172.21.15.19:0/2564062629 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff524102570 0x7ff524199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:00.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.933+0000 7ff529a49640 1 --2- 172.21.15.19:0/2564062629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff524102ef0 0x7ff5241a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:00.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.933+0000 7ff529248640 1 -- 172.21.15.19:0/2564062629 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff524102570 msgr2=0x7ff524199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:00.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.933+0000 7ff529248640 1 --2- 172.21.15.19:0/2564062629 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff524102570 0x7ff524199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.933+0000 7ff529248640 1 -- 172.21.15.19:0/2564062629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff524102ef0 msgr2=0x7ff5241a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:00.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.933+0000 7ff529248640 1 --2- 172.21.15.19:0/2564062629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff524102ef0 0x7ff5241a43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.933+0000 7ff529248640 1 -- 172.21.15.19:0/2564062629 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5241a4910 con 0x7ff524100e20 2024-09-19T08:56:00.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.933+0000 7ff529a49640 1 --2- 172.21.15.19:0/2564062629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff524102ef0 0x7ff5241a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:00.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.934+0000 7ff529248640 1 --2- 172.21.15.19:0/2564062629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff524100e20 0x7ff524199350 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff52000e9f0 tx=0x7ff52000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:00.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.934+0000 7ff51a7fc640 1 -- 172.21.15.19:0/2564062629 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52000cd80 con 0x7ff524100e20 2024-09-19T08:56:00.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.934+0000 7ff52b4ac640 1 -- 172.21.15.19:0/2564062629 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5241a4ae0 con 0x7ff524100e20 2024-09-19T08:56:00.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.934+0000 7ff51a7fc640 1 -- 172.21.15.19:0/2564062629 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff520010910 con 0x7ff524100e20 2024-09-19T08:56:00.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.934+0000 7ff51a7fc640 1 -- 172.21.15.19:0/2564062629 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5200188f0 con 0x7ff524100e20 2024-09-19T08:56:00.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.934+0000 7ff52b4ac640 1 -- 172.21.15.19:0/2564062629 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff524197140 con 0x7ff524100e20 2024-09-19T08:56:00.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.936+0000 7ff51a7fc640 1 -- 172.21.15.19:0/2564062629 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7ff520010ac0 con 0x7ff524100e20 2024-09-19T08:56:00.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.937+0000 7ff51a7fc640 1 --2- 172.21.15.19:0/2564062629 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff5100a7650 0x7ff5100a9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:00.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.937+0000 7ff528a47640 1 --2- 172.21.15.19:0/2564062629 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff5100a7650 0x7ff5100a9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:00.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.937+0000 7ff51a7fc640 1 -- 172.21.15.19:0/2564062629 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff5200cfda0 con 0x7ff524100e20 2024-09-19T08:56:00.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.937+0000 7ff528a47640 1 --2- 172.21.15.19:0/2564062629 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff5100a7650 0x7ff5100a9b10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff514009230 tx=0x7ff5140058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:00.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.952+0000 7ff52d885740 1 Processor -- start 2024-09-19T08:56:00.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.952+0000 7ff52d885740 1 -- start start 2024-09-19T08:56:00.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.952+0000 7ff52d885740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564447558b40 0x564447557090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:00.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.952+0000 7ff52d885740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5644475575d0 0x564447557a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:00.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.952+0000 7ff52d885740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564447562370 0x564447564760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:00.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.952+0000 7ff52d885740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5644474bd2f0 con 0x564447562370 2024-09-19T08:56:00.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.952+0000 7ff52d885740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x564447464cf0 con 0x5644475575d0 2024-09-19T08:56:00.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.952+0000 7ff52d885740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5644474b92b0 con 0x564447558b40 2024-09-19T08:56:00.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.952+0000 7ff529a49640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564447562370 0x564447564760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:00.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.952+0000 7ff529a49640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564447562370 0x564447564760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45726/0 (socket says 172.21.15.19:45726) 2024-09-19T08:56:00.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.952+0000 7ff529a49640 1 -- 172.21.15.19:0/2442085133 learned_addr learned my addr 172.21.15.19:0/2442085133 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:00.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.952+0000 7ff529248640 1 --2- 172.21.15.19:0/2442085133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564447558b40 0x564447557090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:00.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.952+0000 7ff528a47640 1 --2- 172.21.15.19:0/2442085133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5644475575d0 0x564447557a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:00.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.952+0000 7ff529a49640 1 -- 172.21.15.19:0/2442085133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564447558b40 msgr2=0x564447557090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:00.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.952+0000 7ff529a49640 1 --2- 172.21.15.19:0/2442085133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564447558b40 0x564447557090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.952+0000 7ff529a49640 1 -- 172.21.15.19:0/2442085133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5644475575d0 msgr2=0x564447557a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:00.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.952+0000 7ff529a49640 1 --2- 172.21.15.19:0/2442085133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5644475575d0 0x564447557a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.952+0000 7ff529a49640 1 -- 172.21.15.19:0/2442085133 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644474493a0 con 0x564447562370 2024-09-19T08:56:00.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.952+0000 7ff529248640 1 --2- 172.21.15.19:0/2442085133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564447558b40 0x564447557090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:56:00.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.953+0000 7ff529a49640 1 --2- 172.21.15.19:0/2442085133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564447562370 0x564447564760 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7ff51c009fd0 tx=0x7ff51c010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8272dd78fc8b4154 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:00.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.953+0000 7ff50f7fe640 1 -- 172.21.15.19:0/2442085133 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51c011700 con 0x564447562370 2024-09-19T08:56:00.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.953+0000 7ff50f7fe640 1 -- 172.21.15.19:0/2442085133 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff51c011d80 con 0x564447562370 2024-09-19T08:56:00.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.953+0000 7ff50f7fe640 1 -- 172.21.15.19:0/2442085133 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51c00e3c0 con 0x564447562370 2024-09-19T08:56:00.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.954+0000 7ff52d885740 1 -- 172.21.15.19:0/2442085133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564447562370 msgr2=0x564447564760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:00.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.954+0000 7ff52d885740 1 --2- 172.21.15.19:0/2442085133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564447562370 0x564447564760 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7ff51c009fd0 tx=0x7ff51c010860 comp rx=0 tx=0).stop 2024-09-19T08:56:00.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.954+0000 7ff52d885740 1 -- 172.21.15.19:0/2442085133 shutdown_connections 2024-09-19T08:56:00.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.954+0000 7ff52d885740 1 --2- 172.21.15.19:0/2442085133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564447562370 0x564447564760 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.954+0000 7ff52d885740 1 --2- 172.21.15.19:0/2442085133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5644475575d0 0x564447557a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.954+0000 7ff52d885740 1 --2- 172.21.15.19:0/2442085133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564447558b40 0x564447557090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.954+0000 7ff52d885740 1 -- 172.21.15.19:0/2442085133 >> 172.21.15.19:0/2442085133 conn(0x564447520310 msgr2=0x564447553c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:00.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.954+0000 7ff52d885740 1 -- 172.21.15.19:0/2442085133 shutdown_connections 2024-09-19T08:56:00.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.954+0000 7ff52d885740 1 -- 172.21.15.19:0/2442085133 wait complete. 2024-09-19T08:56:00.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.954+0000 7ff52d885740 1 -- start start 2024-09-19T08:56:00.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.954+0000 7ff52d885740 1 Processor -- start 2024-09-19T08:56:00.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.955+0000 7ff52d885740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5644475575d0 0x564447561d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:00.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.955+0000 7ff52d885740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564447558b40 0x56444755f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:00.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.955+0000 7ff52d885740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564447562370 0x56444755f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:00.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.955+0000 7ff52d885740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x564447565070 con 0x5644475575d0 2024-09-19T08:56:00.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.955+0000 7ff52d885740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x564447478060 con 0x564447562370 2024-09-19T08:56:00.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.955+0000 7ff52d885740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5644475651f0 con 0x564447558b40 2024-09-19T08:56:00.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.955+0000 7ff52d885740 10 client.0 _ll_register_callbacks cb 0x5644471cb8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:00.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.955+0000 7ff529248640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5644475575d0 0x564447561d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:00.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.955+0000 7ff529248640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5644475575d0 0x564447561d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45734/0 (socket says 172.21.15.19:45734) 2024-09-19T08:56:00.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.955+0000 7ff529248640 1 -- 172.21.15.19:0/3133024714 learned_addr learned my addr 172.21.15.19:0/3133024714 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:00.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.955+0000 7ff528a47640 1 --2- 172.21.15.19:0/3133024714 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564447558b40 0x56444755f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:00.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.955+0000 7ff529a49640 1 --2- 172.21.15.19:0/3133024714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564447562370 0x56444755f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:00.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.955+0000 7ff529248640 1 -- 172.21.15.19:0/3133024714 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564447558b40 msgr2=0x56444755f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:00.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.955+0000 7ff529248640 1 --2- 172.21.15.19:0/3133024714 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564447558b40 0x56444755f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.955+0000 7ff529248640 1 -- 172.21.15.19:0/3133024714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564447562370 msgr2=0x56444755f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:00.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.955+0000 7ff529248640 1 --2- 172.21.15.19:0/3133024714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564447562370 0x56444755f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.955+0000 7ff529248640 1 -- 172.21.15.19:0/3133024714 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56444722e3c0 con 0x5644475575d0 2024-09-19T08:56:00.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.955+0000 7ff529248640 1 --2- 172.21.15.19:0/3133024714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5644475575d0 0x564447561d70 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7ff5200cd850 tx=0x7ff52009c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2a29f281a76e21c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:00.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.955+0000 7ff50cff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:56:00.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.955+0000 7ff50cff9640 1 -- 172.21.15.19:0/3133024714 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52009b9c0 con 0x5644475575d0 2024-09-19T08:56:00.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.955+0000 7ff50cff9640 1 -- 172.21.15.19:0/3133024714 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff520010430 con 0x5644475575d0 2024-09-19T08:56:00.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.955+0000 7ff52d885740 1 -- 172.21.15.19:0/3133024714 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff51c011d80 con 0x5644475575d0 2024-09-19T08:56:00.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.956+0000 7ff50cff9640 1 -- 172.21.15.19:0/3133024714 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7ff520010630 con 0x5644475575d0 2024-09-19T08:56:00.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.956+0000 7ff52d885740 10 client.16167 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:00.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.956+0000 7ff52d885740 1 -- 172.21.15.19:0/3133024714 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564447570a80 con 0x5644475575d0 2024-09-19T08:56:00.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.956+0000 7ff50cff9640 1 -- 172.21.15.19:0/3133024714 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff51c011d80 con 0x5644475575d0 2024-09-19T08:56:00.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.956+0000 7ff50cff9640 1 -- 172.21.15.19:0/3133024714 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7ff52009b430 con 0x5644475575d0 2024-09-19T08:56:00.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.956+0000 7ff52d885740 10 client.16167 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:00.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.956+0000 7ff52d885740 10 client.16167 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T08:56:00.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.956+0000 7ff52d885740 20 client.16167 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:00.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.956+0000 7ff52d885740 1 --2- 172.21.15.19:0/3133024714 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x564447571f40 0x564447574330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:00.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.956+0000 7ff52d885740 4 client.16167 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:56:00.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.956+0000 7ff52d885740 1 -- 172.21.15.19:0/3133024714 --> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644474ca860 con 0x564447571f40 2024-09-19T08:56:00.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.956+0000 7ff528a47640 1 --2- 172.21.15.19:0/3133024714 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x564447571f40 0x564447574330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:00.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.957+0000 7ff528a47640 1 --2- 172.21.15.19:0/3133024714 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x564447571f40 0x564447574330 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=af8cd47b4f735f76 server_cookie=bf7c330ee80a40f1 in_seq=0 out_seq=0 2024-09-19T08:56:00.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.957+0000 7ff50cff9640 10 client.16167 ms_handle_connect on v2:172.21.15.203:6834/2702758353 2024-09-19T08:56:00.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.958+0000 7ff50cff9640 1 -- 172.21.15.19:0/3133024714 <== mds.4 v2:172.21.15.203:6834/2702758353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5644474ca860 con 0x564447571f40 2024-09-19T08:56:00.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.958+0000 7ff50cff9640 10 client.16167 handle_command_reply: tid=0 2024-09-19T08:56:00.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.958+0000 7ff52d885740 1 client.16167 shutdown 2024-09-19T08:56:00.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.958+0000 7ff52d885740 1 -- 172.21.15.19:0/3133024714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5644475575d0 msgr2=0x564447561d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:00.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.958+0000 7ff52d885740 1 --2- 172.21.15.19:0/3133024714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5644475575d0 0x564447561d70 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7ff5200cd850 tx=0x7ff52009c430 comp rx=0 tx=0).stop 2024-09-19T08:56:00.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.958+0000 7ff52d885740 1 -- 172.21.15.19:0/3133024714 shutdown_connections 2024-09-19T08:56:00.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.958+0000 7ff52d885740 1 --2- 172.21.15.19:0/3133024714 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x564447571f40 0x564447574330 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.958+0000 7ff52d885740 1 --2- 172.21.15.19:0/3133024714 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564447558b40 0x56444755f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.958+0000 7ff52d885740 1 --2- 172.21.15.19:0/3133024714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564447562370 0x56444755f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.958+0000 7ff52d885740 1 --2- 172.21.15.19:0/3133024714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5644475575d0 0x564447561d70 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.958+0000 7ff50cff9640 0 client.16167 ms_handle_reset on v2:172.21.15.203:6834/2702758353 2024-09-19T08:56:00.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.958+0000 7ff52d885740 1 -- 172.21.15.19:0/3133024714 >> 172.21.15.19:0/3133024714 conn(0x564447520310 msgr2=0x564447559960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:00.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.958+0000 7ff52d885740 1 -- 172.21.15.19:0/3133024714 shutdown_connections 2024-09-19T08:56:00.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.958+0000 7ff52d885740 1 -- 172.21.15.19:0/3133024714 wait complete. 2024-09-19T08:56:00.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.958+0000 7ff52d885740 20 client.16167 trim_cache size 0 max 16384 2024-09-19T08:56:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.971+0000 7ff52d885740 1 Processor -- start 2024-09-19T08:56:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.971+0000 7ff52d885740 1 -- start start 2024-09-19T08:56:00.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.971+0000 7ff52d885740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5644475575d0 0x56444755e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:00.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.971+0000 7ff52d885740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564447558b40 0x564447552c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:00.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.971+0000 7ff52d885740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564447562370 0x56444755a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:00.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.971+0000 7ff52d885740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff5241ab380 con 0x564447562370 2024-09-19T08:56:00.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.971+0000 7ff52d885740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff5241acef0 con 0x564447558b40 2024-09-19T08:56:00.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.971+0000 7ff52d885740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff5241aba50 con 0x5644475575d0 2024-09-19T08:56:00.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.971+0000 7ff529a49640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564447562370 0x56444755a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:00.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.972+0000 7ff529a49640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564447562370 0x56444755a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45740/0 (socket says 172.21.15.19:45740) 2024-09-19T08:56:00.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.972+0000 7ff529a49640 1 -- 172.21.15.19:0/285383394 learned_addr learned my addr 172.21.15.19:0/285383394 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:00.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.972+0000 7ff529248640 1 --2- 172.21.15.19:0/285383394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5644475575d0 0x56444755e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:00.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.972+0000 7ff528a47640 1 --2- 172.21.15.19:0/285383394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564447558b40 0x564447552c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:00.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.972+0000 7ff529a49640 1 -- 172.21.15.19:0/285383394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5644475575d0 msgr2=0x56444755e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:00.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.972+0000 7ff529a49640 1 --2- 172.21.15.19:0/285383394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5644475575d0 0x56444755e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.972+0000 7ff529a49640 1 -- 172.21.15.19:0/285383394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564447558b40 msgr2=0x564447552c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:00.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.972+0000 7ff529a49640 1 --2- 172.21.15.19:0/285383394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564447558b40 0x564447552c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.972+0000 7ff529a49640 1 -- 172.21.15.19:0/285383394 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564447574960 con 0x564447562370 2024-09-19T08:56:00.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.972+0000 7ff529a49640 1 --2- 172.21.15.19:0/285383394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564447562370 0x56444755a120 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ff51c01bbb0 tx=0x7ff51c01bb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2384561f7c53ab56 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:00.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.972+0000 7ff50effd640 1 -- 172.21.15.19:0/285383394 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51c0049c0 con 0x564447562370 2024-09-19T08:56:00.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.972+0000 7ff50effd640 1 -- 172.21.15.19:0/285383394 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff51c02b070 con 0x564447562370 2024-09-19T08:56:00.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.972+0000 7ff50effd640 1 -- 172.21.15.19:0/285383394 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51c011de0 con 0x564447562370 2024-09-19T08:56:00.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.973+0000 7ff52d885740 1 -- 172.21.15.19:0/285383394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564447562370 msgr2=0x56444755a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:00.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.973+0000 7ff52d885740 1 --2- 172.21.15.19:0/285383394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564447562370 0x56444755a120 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ff51c01bbb0 tx=0x7ff51c01bb20 comp rx=0 tx=0).stop 2024-09-19T08:56:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.973+0000 7ff52d885740 1 -- 172.21.15.19:0/285383394 shutdown_connections 2024-09-19T08:56:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.973+0000 7ff52d885740 1 --2- 172.21.15.19:0/285383394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564447562370 0x56444755a120 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.973+0000 7ff52d885740 1 --2- 172.21.15.19:0/285383394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564447558b40 0x564447552c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.973+0000 7ff52d885740 1 --2- 172.21.15.19:0/285383394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5644475575d0 0x56444755e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.973+0000 7ff52d885740 1 -- 172.21.15.19:0/285383394 >> 172.21.15.19:0/285383394 conn(0x564447520310 msgr2=0x564447552500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.973+0000 7ff52d885740 1 -- 172.21.15.19:0/285383394 shutdown_connections 2024-09-19T08:56:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.973+0000 7ff52d885740 1 -- 172.21.15.19:0/285383394 wait complete. 2024-09-19T08:56:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.973+0000 7ff52d885740 1 -- start start 2024-09-19T08:56:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.973+0000 7ff52d885740 1 Processor -- start 2024-09-19T08:56:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.974+0000 7ff52d885740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5644475575d0 0x56444756ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.974+0000 7ff52d885740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564447558b40 0x5644475660d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.974+0000 7ff52d885740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564447562370 0x564447566860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:00.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.974+0000 7ff52d885740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff5241ac820 con 0x564447562370 2024-09-19T08:56:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.974+0000 7ff52d885740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff5241ac150 con 0x5644475575d0 2024-09-19T08:56:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.974+0000 7ff52d885740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff5241a9360 con 0x564447558b40 2024-09-19T08:56:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.974+0000 7ff52d885740 10 client.0 _ll_register_callbacks cb 0x7ff520098610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.974+0000 7ff529a49640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564447562370 0x564447566860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.974+0000 7ff529a49640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564447562370 0x564447566860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45756/0 (socket says 172.21.15.19:45756) 2024-09-19T08:56:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.974+0000 7ff529a49640 1 -- 172.21.15.19:0/2637292909 learned_addr learned my addr 172.21.15.19:0/2637292909 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.974+0000 7ff528a47640 1 --2- 172.21.15.19:0/2637292909 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564447558b40 0x5644475660d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.974+0000 7ff529248640 1 --2- 172.21.15.19:0/2637292909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5644475575d0 0x56444756ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.974+0000 7ff529a49640 1 -- 172.21.15.19:0/2637292909 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564447558b40 msgr2=0x5644475660d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.974+0000 7ff529a49640 1 --2- 172.21.15.19:0/2637292909 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564447558b40 0x5644475660d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.974+0000 7ff529a49640 1 -- 172.21.15.19:0/2637292909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5644475575d0 msgr2=0x56444756ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.974+0000 7ff529a49640 1 --2- 172.21.15.19:0/2637292909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5644475575d0 0x56444756ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.974+0000 7ff529a49640 1 -- 172.21.15.19:0/2637292909 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644475dbb60 con 0x564447562370 2024-09-19T08:56:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.975+0000 7ff529a49640 1 --2- 172.21.15.19:0/2637292909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564447562370 0x564447566860 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff51c000f80 tx=0x7ff51c01ba80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=728390216cca8be4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.975+0000 7ff50cff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:56:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.975+0000 7ff50cff9640 1 -- 172.21.15.19:0/2637292909 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51c033070 con 0x564447562370 2024-09-19T08:56:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.975+0000 7ff50cff9640 1 -- 172.21.15.19:0/2637292909 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff51c0049c0 con 0x564447562370 2024-09-19T08:56:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.975+0000 7ff52d885740 1 -- 172.21.15.19:0/2637292909 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff51c02b070 con 0x564447562370 2024-09-19T08:56:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.975+0000 7ff50cff9640 1 -- 172.21.15.19:0/2637292909 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7ff51c009c00 con 0x564447562370 2024-09-19T08:56:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.975+0000 7ff52d885740 10 client.16173 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.975+0000 7ff52d885740 1 -- 172.21.15.19:0/2637292909 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5644475dcd40 con 0x564447562370 2024-09-19T08:56:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.975+0000 7ff50cff9640 1 -- 172.21.15.19:0/2637292909 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff51c02b070 con 0x564447562370 2024-09-19T08:56:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.975+0000 7ff50cff9640 1 -- 172.21.15.19:0/2637292909 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7ff51c005820 con 0x564447562370 2024-09-19T08:56:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.975+0000 7ff52d885740 10 client.16173 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.975+0000 7ff52d885740 10 client.16173 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T08:56:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.975+0000 7ff52d885740 20 client.16173 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.975+0000 7ff52d885740 1 --2- 172.21.15.19:0/2637292909 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5644475dd1b0 0x5644475df5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.975+0000 7ff52d885740 4 client.16173 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:56:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.975+0000 7ff52d885740 1 -- 172.21.15.19:0/2637292909 --> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5644474c4d70 con 0x5644475dd1b0 2024-09-19T08:56:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.976+0000 7ff529248640 1 --2- 172.21.15.19:0/2637292909 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5644475dd1b0 0x5644475df5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.976+0000 7ff529248640 1 --2- 172.21.15.19:0/2637292909 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5644475dd1b0 0x5644475df5a0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5fc5879cc37ff338 server_cookie=b5dcfb89a69ad9fb in_seq=0 out_seq=0 2024-09-19T08:56:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.976+0000 7ff50cff9640 10 client.16173 ms_handle_connect on v2:172.21.15.203:6834/2702758353 2024-09-19T08:56:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.976+0000 7ff50cff9640 1 -- 172.21.15.19:0/2637292909 <== mds.4 v2:172.21.15.203:6834/2702758353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5644474c4d70 con 0x5644475dd1b0 2024-09-19T08:56:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.976+0000 7ff50cff9640 10 client.16173 handle_command_reply: tid=0 2024-09-19T08:56:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.976+0000 7ff52d885740 1 client.16173 shutdown 2024-09-19T08:56:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.976+0000 7ff52d885740 1 -- 172.21.15.19:0/2637292909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564447562370 msgr2=0x564447566860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.976+0000 7ff52d885740 1 --2- 172.21.15.19:0/2637292909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564447562370 0x564447566860 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff51c000f80 tx=0x7ff51c01ba80 comp rx=0 tx=0).stop 2024-09-19T08:56:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.976+0000 7ff52d885740 1 -- 172.21.15.19:0/2637292909 shutdown_connections 2024-09-19T08:56:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.976+0000 7ff52d885740 1 --2- 172.21.15.19:0/2637292909 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5644475dd1b0 0x5644475df5a0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.976+0000 7ff52d885740 1 --2- 172.21.15.19:0/2637292909 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564447558b40 0x5644475660d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.976+0000 7ff52d885740 1 --2- 172.21.15.19:0/2637292909 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564447562370 0x564447566860 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.976+0000 7ff52d885740 1 --2- 172.21.15.19:0/2637292909 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5644475575d0 0x56444756ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.976+0000 7ff50cff9640 0 client.16173 ms_handle_reset on v2:172.21.15.203:6834/2702758353 2024-09-19T08:56:00.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.976+0000 7ff52d885740 1 -- 172.21.15.19:0/2637292909 >> 172.21.15.19:0/2637292909 conn(0x564447520310 msgr2=0x564447552d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:00.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.977+0000 7ff52d885740 1 -- 172.21.15.19:0/2637292909 shutdown_connections 2024-09-19T08:56:00.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.977+0000 7ff52d885740 1 -- 172.21.15.19:0/2637292909 wait complete. 2024-09-19T08:56:00.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.977+0000 7ff52d885740 20 client.16173 trim_cache size 0 max 16384 2024-09-19T08:56:00.981 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T08:56:00.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.977+0000 7ff52b4ac640 1 -- 172.21.15.19:0/2564062629 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff5100a7650 msgr2=0x7ff5100a9b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:00.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.977+0000 7ff52b4ac640 1 --2- 172.21.15.19:0/2564062629 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff5100a7650 0x7ff5100a9b10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff514009230 tx=0x7ff5140058d0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.977+0000 7ff52b4ac640 1 -- 172.21.15.19:0/2564062629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff524100e20 msgr2=0x7ff524199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:00.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.977+0000 7ff52b4ac640 1 --2- 172.21.15.19:0/2564062629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff524100e20 0x7ff524199350 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff52000e9f0 tx=0x7ff52000eeb0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.977+0000 7ff52b4ac640 1 -- 172.21.15.19:0/2564062629 shutdown_connections 2024-09-19T08:56:00.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.977+0000 7ff52b4ac640 1 --2- 172.21.15.19:0/2564062629 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff5100a7650 0x7ff5100a9b10 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.977+0000 7ff52b4ac640 1 --2- 172.21.15.19:0/2564062629 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff524102570 0x7ff524199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.977+0000 7ff52b4ac640 1 --2- 172.21.15.19:0/2564062629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff524102ef0 0x7ff5241a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.977+0000 7ff52b4ac640 1 --2- 172.21.15.19:0/2564062629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff524100e20 0x7ff524199350 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:00.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.977+0000 7ff52b4ac640 1 -- 172.21.15.19:0/2564062629 >> 172.21.15.19:0/2564062629 conn(0x7ff5240fc7d0 msgr2=0x7ff5241068b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:00.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.977+0000 7ff52b4ac640 1 -- 172.21.15.19:0/2564062629 shutdown_connections 2024-09-19T08:56:00.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:00.977+0000 7ff52b4ac640 1 -- 172.21.15.19:0/2564062629 wait complete. 2024-09-19T08:56:01.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:01 smithi019 ceph-mon[30976]: pgmap v451: 97 pgs: 97 active+clean; 1.6 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-19T08:56:01.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:01 smithi155 ceph-mon[34921]: pgmap v451: 97 pgs: 97 active+clean; 1.6 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-19T08:56:01.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:01 smithi203 ceph-mon[35450]: pgmap v451: 97 pgs: 97 active+clean; 1.6 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 15 KiB/s wr, 17 op/s 2024-09-19T08:56:01.814 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T08:56:02.085 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:02.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.556+0000 7f61e9044640 1 -- 172.21.15.19:0/637315402 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61e4106f10 msgr2=0x7f61e410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:02.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.556+0000 7f61e9044640 1 --2- 172.21.15.19:0/637315402 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61e4106f10 0x7f61e410ea90 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f61d4009ca0 tx=0x7f61d402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.556+0000 7f61e9044640 1 -- 172.21.15.19:0/637315402 shutdown_connections 2024-09-19T08:56:02.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.556+0000 7f61e9044640 1 --2- 172.21.15.19:0/637315402 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61e4102790 0x7f61e41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.556+0000 7f61e9044640 1 --2- 172.21.15.19:0/637315402 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61e4106f10 0x7f61e410ea90 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.556+0000 7f61e9044640 1 --2- 172.21.15.19:0/637315402 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61e4101de0 0x7f61e41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.556+0000 7f61e9044640 1 -- 172.21.15.19:0/637315402 >> 172.21.15.19:0/637315402 conn(0x7f61e40fd8c0 msgr2=0x7f61e40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:02.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.556+0000 7f61e9044640 1 -- 172.21.15.19:0/637315402 shutdown_connections 2024-09-19T08:56:02.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.556+0000 7f61e9044640 1 -- 172.21.15.19:0/637315402 wait complete. 2024-09-19T08:56:02.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.557+0000 7f61e9044640 1 Processor -- start 2024-09-19T08:56:02.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.557+0000 7f61e9044640 1 -- start start 2024-09-19T08:56:02.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.557+0000 7f61e9044640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61e4101de0 0x7f61e4198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:02.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.557+0000 7f61e9044640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61e4102790 0x7f61e41989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:02.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.558+0000 7f61e9044640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61e4106f10 0x7f61e419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:02.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.558+0000 7f61e9044640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f61e4111f90 con 0x7f61e4106f10 2024-09-19T08:56:02.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.558+0000 7f61e9044640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f61e4111e10 con 0x7f61e4102790 2024-09-19T08:56:02.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.558+0000 7f61e9044640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f61e4112110 con 0x7f61e4101de0 2024-09-19T08:56:02.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.558+0000 7f61e359e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61e4106f10 0x7f61e419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:02.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.558+0000 7f61e359e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61e4106f10 0x7f61e419cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45772/0 (socket says 172.21.15.19:45772) 2024-09-19T08:56:02.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.558+0000 7f61e359e640 1 -- 172.21.15.19:0/338855711 learned_addr learned my addr 172.21.15.19:0/338855711 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:02.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.558+0000 7f61e2d9d640 1 --2- 172.21.15.19:0/338855711 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61e4101de0 0x7f61e4198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:02.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.558+0000 7f61e259c640 1 --2- 172.21.15.19:0/338855711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61e4102790 0x7f61e41989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:02.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.558+0000 7f61e359e640 1 -- 172.21.15.19:0/338855711 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61e4101de0 msgr2=0x7f61e4198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:02.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.558+0000 7f61e359e640 1 --2- 172.21.15.19:0/338855711 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61e4101de0 0x7f61e4198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.558+0000 7f61e359e640 1 -- 172.21.15.19:0/338855711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61e4102790 msgr2=0x7f61e41989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:02.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.558+0000 7f61e359e640 1 --2- 172.21.15.19:0/338855711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61e4102790 0x7f61e41989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.558+0000 7f61e359e640 1 -- 172.21.15.19:0/338855711 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61e419d420 con 0x7f61e4106f10 2024-09-19T08:56:02.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.558+0000 7f61e359e640 1 --2- 172.21.15.19:0/338855711 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61e4106f10 0x7f61e419cd40 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f61d4031a60 tx=0x7f61d4031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:02.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.558+0000 7f61dbfff640 1 -- 172.21.15.19:0/338855711 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d4003c30 con 0x7f61e4106f10 2024-09-19T08:56:02.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.558+0000 7f61e9044640 1 -- 172.21.15.19:0/338855711 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61e419d6b0 con 0x7f61e4106f10 2024-09-19T08:56:02.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.558+0000 7f61dbfff640 1 -- 172.21.15.19:0/338855711 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61d4003dd0 con 0x7f61e4106f10 2024-09-19T08:56:02.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.558+0000 7f61dbfff640 1 -- 172.21.15.19:0/338855711 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d40047e0 con 0x7f61e4106f10 2024-09-19T08:56:02.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.559+0000 7f61e9044640 1 -- 172.21.15.19:0/338855711 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61e41a4ff0 con 0x7f61e4106f10 2024-09-19T08:56:02.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.561+0000 7f61dbfff640 1 -- 172.21.15.19:0/338855711 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f61d402f790 con 0x7f61e4106f10 2024-09-19T08:56:02.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.561+0000 7f61eb41d740 1 Processor -- start 2024-09-19T08:56:02.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.561+0000 7f61eb41d740 1 -- start start 2024-09-19T08:56:02.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.562+0000 7f61eb41d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556759fe0b40 0x556759fdf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:02.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.562+0000 7f61eb41d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556759fdf5d0 0x556759fdfa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:02.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.562+0000 7f61eb41d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556759fee780 0x556759ff0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:02.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.562+0000 7f61eb41d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556759f452f0 con 0x556759fee780 2024-09-19T08:56:02.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.562+0000 7f61eb41d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x556759eeccf0 con 0x556759fe0b40 2024-09-19T08:56:02.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.562+0000 7f61eb41d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x556759f412b0 con 0x556759fdf5d0 2024-09-19T08:56:02.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.562+0000 7f61e259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556759fee780 0x556759ff0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:02.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.562+0000 7f61e259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556759fee780 0x556759ff0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45784/0 (socket says 172.21.15.19:45784) 2024-09-19T08:56:02.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.562+0000 7f61e259c640 1 -- 172.21.15.19:0/3308169022 learned_addr learned my addr 172.21.15.19:0/3308169022 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:02.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.562+0000 7f61e2d9d640 1 --2- 172.21.15.19:0/3308169022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556759fdf5d0 0x556759fdfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:02.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.562+0000 7f61e259c640 1 --2- 172.21.15.19:0/3308169022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556759fe0b40 0x556759fdf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:02.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.562+0000 7f61dbfff640 1 --2- 172.21.15.19:0/338855711 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f61d00a3240 0x7f61d00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:02.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.562+0000 7f61e259c640 1 -- 172.21.15.19:0/3308169022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556759fdf5d0 msgr2=0x556759fdfa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:02.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.562+0000 7f61e259c640 1 --2- 172.21.15.19:0/3308169022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556759fdf5d0 0x556759fdfa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.562+0000 7f61e259c640 1 -- 172.21.15.19:0/3308169022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556759fe0b40 msgr2=0x556759fdf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:02.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.562+0000 7f61e259c640 1 --2- 172.21.15.19:0/3308169022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556759fe0b40 0x556759fdf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.562+0000 7f61e259c640 1 -- 172.21.15.19:0/3308169022 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556759ed13a0 con 0x556759fee780 2024-09-19T08:56:02.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.562+0000 7f61e359e640 1 --2- 172.21.15.19:0/338855711 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f61d00a3240 0x7f61d00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:02.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.562+0000 7f61dbfff640 1 -- 172.21.15.19:0/338855711 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f61d40f0d70 con 0x7f61e4106f10 2024-09-19T08:56:02.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.562+0000 7f61e259c640 1 --2- 172.21.15.19:0/3308169022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556759fee780 0x556759ff0b70 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f61cc016530 tx=0x7f61cc00a2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=504ce1e78dd41c62 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:02.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.563+0000 7f61d97fa640 1 -- 172.21.15.19:0/3308169022 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61cc018430 con 0x556759fee780 2024-09-19T08:56:02.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.563+0000 7f61d97fa640 1 -- 172.21.15.19:0/3308169022 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61cc018ab0 con 0x556759fee780 2024-09-19T08:56:02.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.563+0000 7f61d97fa640 1 -- 172.21.15.19:0/3308169022 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61cc0179d0 con 0x556759fee780 2024-09-19T08:56:02.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.563+0000 7f61eb41d740 1 -- 172.21.15.19:0/3308169022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556759fee780 msgr2=0x556759ff0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:02.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.563+0000 7f61e359e640 1 --2- 172.21.15.19:0/338855711 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f61d00a3240 0x7f61d00a5700 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f61d40b97a0 tx=0x7f61d40b2820 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:02.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.563+0000 7f61eb41d740 1 --2- 172.21.15.19:0/3308169022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556759fee780 0x556759ff0b70 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f61cc016530 tx=0x7f61cc00a2b0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.563+0000 7f61eb41d740 1 -- 172.21.15.19:0/3308169022 shutdown_connections 2024-09-19T08:56:02.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.563+0000 7f61eb41d740 1 --2- 172.21.15.19:0/3308169022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556759fdf5d0 0x556759fdfa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.563+0000 7f61eb41d740 1 --2- 172.21.15.19:0/3308169022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556759fee780 0x556759ff0b70 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.563+0000 7f61eb41d740 1 --2- 172.21.15.19:0/3308169022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556759fe0b40 0x556759fdf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.564+0000 7f61eb41d740 1 -- 172.21.15.19:0/3308169022 >> 172.21.15.19:0/3308169022 conn(0x556759fa8310 msgr2=0x556759fdbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:02.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.564+0000 7f61eb41d740 1 -- 172.21.15.19:0/3308169022 shutdown_connections 2024-09-19T08:56:02.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.564+0000 7f61eb41d740 1 -- 172.21.15.19:0/3308169022 wait complete. 2024-09-19T08:56:02.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.564+0000 7f61eb41d740 1 -- start start 2024-09-19T08:56:02.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.564+0000 7f61eb41d740 1 Processor -- start 2024-09-19T08:56:02.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.564+0000 7f61eb41d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556759fdf5d0 0x556759fee180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:02.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.564+0000 7f61eb41d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556759fe0b40 0x556759feb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:02.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.564+0000 7f61eb41d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556759fee780 0x556759feba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:02.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.564+0000 7f61eb41d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556759ff13c0 con 0x556759fe0b40 2024-09-19T08:56:02.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.564+0000 7f61eb41d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x556759f00060 con 0x556759fdf5d0 2024-09-19T08:56:02.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.564+0000 7f61eb41d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x556759ff1540 con 0x556759fee780 2024-09-19T08:56:02.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.564+0000 7f61eb41d740 10 client.0 _ll_register_callbacks cb 0x556759c538c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:02.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.564+0000 7f61e2d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556759fe0b40 0x556759feb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:02.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.564+0000 7f61e2d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556759fe0b40 0x556759feb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45800/0 (socket says 172.21.15.19:45800) 2024-09-19T08:56:02.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.564+0000 7f61e2d9d640 1 -- 172.21.15.19:0/3172095346 learned_addr learned my addr 172.21.15.19:0/3172095346 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:02.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.565+0000 7f61e259c640 1 --2- 172.21.15.19:0/3172095346 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556759fdf5d0 0x556759fee180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:02.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.565+0000 7f61e259c640 1 --2- 172.21.15.19:0/3172095346 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556759fee780 0x556759feba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:02.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.565+0000 7f61e2d9d640 1 -- 172.21.15.19:0/3172095346 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556759fee780 msgr2=0x556759feba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:02.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.565+0000 7f61e2d9d640 1 --2- 172.21.15.19:0/3172095346 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556759fee780 0x556759feba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.565+0000 7f61e2d9d640 1 -- 172.21.15.19:0/3172095346 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556759fdf5d0 msgr2=0x556759fee180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:02.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.565+0000 7f61e2d9d640 1 --2- 172.21.15.19:0/3172095346 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556759fdf5d0 0x556759fee180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.565+0000 7f61e2d9d640 1 -- 172.21.15.19:0/3172095346 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556759cb63c0 con 0x556759fe0b40 2024-09-19T08:56:02.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.565+0000 7f61e259c640 1 --2- 172.21.15.19:0/3172095346 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556759fee780 0x556759feba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:02.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.565+0000 7f61e2d9d640 1 --2- 172.21.15.19:0/3172095346 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556759fe0b40 0x556759feb430 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f61dc010820 tx=0x7f61dc010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11cfa77be8bb31c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:02.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.565+0000 7f61ca7fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:56:02.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.565+0000 7f61ca7fc640 1 -- 172.21.15.19:0/3172095346 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61dc00fb90 con 0x556759fe0b40 2024-09-19T08:56:02.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.565+0000 7f61ca7fc640 1 -- 172.21.15.19:0/3172095346 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f61dc00fd30 con 0x556759fe0b40 2024-09-19T08:56:02.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.565+0000 7f61eb41d740 1 -- 172.21.15.19:0/3172095346 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61cc018ab0 con 0x556759fe0b40 2024-09-19T08:56:02.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.565+0000 7f61ca7fc640 1 -- 172.21.15.19:0/3172095346 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f61dc005020 con 0x556759fe0b40 2024-09-19T08:56:02.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.565+0000 7f61eb41d740 10 client.16185 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:02.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.565+0000 7f61eb41d740 1 -- 172.21.15.19:0/3172095346 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x556759ffcec0 con 0x556759fe0b40 2024-09-19T08:56:02.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.566+0000 7f61ca7fc640 1 -- 172.21.15.19:0/3172095346 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61cc018ab0 con 0x556759fe0b40 2024-09-19T08:56:02.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.566+0000 7f61ca7fc640 1 -- 172.21.15.19:0/3172095346 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f61dc019410 con 0x556759fe0b40 2024-09-19T08:56:02.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.566+0000 7f61eb41d740 10 client.16185 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:02.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.566+0000 7f61eb41d740 10 client.16185 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-19T08:56:02.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.566+0000 7f61eb41d740 20 client.16185 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:02.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.566+0000 7f61eb41d740 1 --2- 172.21.15.19:0/3172095346 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x556759ffe420 0x55675a000840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:02.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.566+0000 7f61eb41d740 4 client.16185 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:56:02.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.566+0000 7f61eb41d740 1 -- 172.21.15.19:0/3172095346 --> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556759f52860 con 0x556759ffe420 2024-09-19T08:56:02.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.566+0000 7f61e259c640 1 --2- 172.21.15.19:0/3172095346 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x556759ffe420 0x55675a000840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:02.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.567+0000 7f61e259c640 1 --2- 172.21.15.19:0/3172095346 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x556759ffe420 0x55675a000840 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1d9c32c67d22a0e7 server_cookie=5db422ee43f38b28 in_seq=0 out_seq=0 2024-09-19T08:56:02.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.567+0000 7f61ca7fc640 10 client.16185 ms_handle_connect on v2:172.21.15.155:6836/3381010945 2024-09-19T08:56:02.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.567+0000 7f61ca7fc640 1 -- 172.21.15.19:0/3172095346 <== mds.3 v2:172.21.15.155:6836/3381010945 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556759f52860 con 0x556759ffe420 2024-09-19T08:56:02.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.567+0000 7f61ca7fc640 10 client.16185 handle_command_reply: tid=0 2024-09-19T08:56:02.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.567+0000 7f61eb41d740 1 client.16185 shutdown 2024-09-19T08:56:02.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.567+0000 7f61eb41d740 1 -- 172.21.15.19:0/3172095346 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556759fe0b40 msgr2=0x556759feb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:02.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.567+0000 7f61eb41d740 1 --2- 172.21.15.19:0/3172095346 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556759fe0b40 0x556759feb430 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f61dc010820 tx=0x7f61dc010ce0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.568+0000 7f61eb41d740 1 -- 172.21.15.19:0/3172095346 shutdown_connections 2024-09-19T08:56:02.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.568+0000 7f61eb41d740 1 --2- 172.21.15.19:0/3172095346 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x556759ffe420 0x55675a000840 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.568+0000 7f61eb41d740 1 --2- 172.21.15.19:0/3172095346 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556759fee780 0x556759feba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.568+0000 7f61eb41d740 1 --2- 172.21.15.19:0/3172095346 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556759fe0b40 0x556759feb430 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.568+0000 7f61eb41d740 1 --2- 172.21.15.19:0/3172095346 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556759fdf5d0 0x556759fee180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.568+0000 7f61eb41d740 1 -- 172.21.15.19:0/3172095346 >> 172.21.15.19:0/3172095346 conn(0x556759fa8310 msgr2=0x556759fe1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:02.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.568+0000 7f61ca7fc640 0 client.16185 ms_handle_reset on v2:172.21.15.155:6836/3381010945 2024-09-19T08:56:02.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.568+0000 7f61eb41d740 1 -- 172.21.15.19:0/3172095346 shutdown_connections 2024-09-19T08:56:02.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.568+0000 7f61eb41d740 1 -- 172.21.15.19:0/3172095346 wait complete. 2024-09-19T08:56:02.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.568+0000 7f61eb41d740 20 client.16185 trim_cache size 0 max 16384 2024-09-19T08:56:02.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.581+0000 7f61eb41d740 1 Processor -- start 2024-09-19T08:56:02.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.581+0000 7f61eb41d740 1 -- start start 2024-09-19T08:56:02.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.581+0000 7f61eb41d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556759fdf5d0 0x556759fdbe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:02.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.581+0000 7f61eb41d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556759fe0b40 0x556759ffa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:02.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.581+0000 7f61eb41d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556759fee780 0x556759feacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:02.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.581+0000 7f61eb41d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f61e41ab2a0 con 0x556759fe0b40 2024-09-19T08:56:02.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.581+0000 7f61eb41d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f61e41ace10 con 0x556759fee780 2024-09-19T08:56:02.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.581+0000 7f61eb41d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f61e41ab970 con 0x556759fdf5d0 2024-09-19T08:56:02.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.581+0000 7f61e2d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556759fe0b40 0x556759ffa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:02.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.581+0000 7f61e2d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556759fe0b40 0x556759ffa660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45808/0 (socket says 172.21.15.19:45808) 2024-09-19T08:56:02.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.581+0000 7f61e2d9d640 1 -- 172.21.15.19:0/936258760 learned_addr learned my addr 172.21.15.19:0/936258760 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:02.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.581+0000 7f61e259c640 1 --2- 172.21.15.19:0/936258760 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556759fdf5d0 0x556759fdbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:02.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.581+0000 7f61e259c640 1 --2- 172.21.15.19:0/936258760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556759fee780 0x556759feacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:02.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.581+0000 7f61e2d9d640 1 -- 172.21.15.19:0/936258760 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556759fdf5d0 msgr2=0x556759fdbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:02.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.581+0000 7f61e2d9d640 1 --2- 172.21.15.19:0/936258760 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556759fdf5d0 0x556759fdbe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.581+0000 7f61e2d9d640 1 -- 172.21.15.19:0/936258760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556759fee780 msgr2=0x556759feacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:02.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.581+0000 7f61e2d9d640 1 --2- 172.21.15.19:0/936258760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556759fee780 0x556759feacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.581+0000 7f61e2d9d640 1 -- 172.21.15.19:0/936258760 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556759fdc960 con 0x556759fe0b40 2024-09-19T08:56:02.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.581+0000 7f61e259c640 1 --2- 172.21.15.19:0/936258760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556759fee780 0x556759feacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:56:02.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.582+0000 7f61e2d9d640 1 --2- 172.21.15.19:0/936258760 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556759fe0b40 0x556759ffa660 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f61dc00a8e0 tx=0x7f61dc005e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdac3f0e1811c781 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:02.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.582+0000 7f61d8ff9640 1 -- 172.21.15.19:0/936258760 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61dc031070 con 0x556759fe0b40 2024-09-19T08:56:02.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.582+0000 7f61d8ff9640 1 -- 172.21.15.19:0/936258760 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61dc019af0 con 0x556759fe0b40 2024-09-19T08:56:02.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.582+0000 7f61d8ff9640 1 -- 172.21.15.19:0/936258760 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61dc028040 con 0x556759fe0b40 2024-09-19T08:56:02.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.582+0000 7f61eb41d740 1 -- 172.21.15.19:0/936258760 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556759fe0b40 msgr2=0x556759ffa660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:02.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.582+0000 7f61eb41d740 1 --2- 172.21.15.19:0/936258760 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556759fe0b40 0x556759ffa660 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f61dc00a8e0 tx=0x7f61dc005e20 comp rx=0 tx=0).stop 2024-09-19T08:56:02.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.583+0000 7f61eb41d740 1 -- 172.21.15.19:0/936258760 shutdown_connections 2024-09-19T08:56:02.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.583+0000 7f61eb41d740 1 --2- 172.21.15.19:0/936258760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556759fee780 0x556759feacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.583+0000 7f61eb41d740 1 --2- 172.21.15.19:0/936258760 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556759fe0b40 0x556759ffa660 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.583+0000 7f61eb41d740 1 --2- 172.21.15.19:0/936258760 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556759fdf5d0 0x556759fdbe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.583+0000 7f61eb41d740 1 -- 172.21.15.19:0/936258760 >> 172.21.15.19:0/936258760 conn(0x556759fa8310 msgr2=0x556759fdb700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:02.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.583+0000 7f61eb41d740 1 -- 172.21.15.19:0/936258760 shutdown_connections 2024-09-19T08:56:02.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.583+0000 7f61eb41d740 1 -- 172.21.15.19:0/936258760 wait complete. 2024-09-19T08:56:02.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.583+0000 7f61eb41d740 1 -- start start 2024-09-19T08:56:02.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.583+0000 7f61eb41d740 1 Processor -- start 2024-09-19T08:56:02.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.583+0000 7f61eb41d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556759fdf5d0 0x556759ff67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:02.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.583+0000 7f61eb41d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556759fe0b40 0x556759ff6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:02.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.583+0000 7f61eb41d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556759fee780 0x556759fe77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:02.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.583+0000 7f61eb41d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f61e41ac740 con 0x556759fee780 2024-09-19T08:56:02.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.583+0000 7f61eb41d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f61e41ac070 con 0x556759fe0b40 2024-09-19T08:56:02.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.583+0000 7f61eb41d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f61e41a92a0 con 0x556759fdf5d0 2024-09-19T08:56:02.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.583+0000 7f61eb41d740 10 client.0 _ll_register_callbacks cb 0x7f61dc00a700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:02.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.584+0000 7f61e259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556759fee780 0x556759fe77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:02.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.584+0000 7f61e259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556759fee780 0x556759fe77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45816/0 (socket says 172.21.15.19:45816) 2024-09-19T08:56:02.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.584+0000 7f61e259c640 1 -- 172.21.15.19:0/3165584946 learned_addr learned my addr 172.21.15.19:0/3165584946 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:02.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.584+0000 7f61e259c640 1 --2- 172.21.15.19:0/3165584946 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556759fdf5d0 0x556759ff67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:02.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.584+0000 7f61e2d9d640 1 --2- 172.21.15.19:0/3165584946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556759fe0b40 0x556759ff6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:02.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.584+0000 7f61e259c640 1 -- 172.21.15.19:0/3165584946 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556759fdf5d0 msgr2=0x556759ff67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:02.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.584+0000 7f61e259c640 1 --2- 172.21.15.19:0/3165584946 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556759fdf5d0 0x556759ff67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.584+0000 7f61e259c640 1 -- 172.21.15.19:0/3165584946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556759fe0b40 msgr2=0x556759ff6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:02.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.584+0000 7f61e259c640 1 --2- 172.21.15.19:0/3165584946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556759fe0b40 0x556759ff6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.584+0000 7f61e259c640 1 -- 172.21.15.19:0/3165584946 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556759fe7ce0 con 0x556759fee780 2024-09-19T08:56:02.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.584+0000 7f61e2d9d640 1 --2- 172.21.15.19:0/3165584946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556759fe0b40 0x556759ff6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:56:02.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.584+0000 7f61e259c640 1 --2- 172.21.15.19:0/3165584946 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556759fee780 0x556759fe77a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f61cc004810 tx=0x7f61cc027040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde3a4a1210faf47 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:02.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.584+0000 7f61ca7fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:56:02.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.584+0000 7f61ca7fc640 1 -- 172.21.15.19:0/3165584946 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61cc005dd0 con 0x556759fee780 2024-09-19T08:56:02.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.584+0000 7f61ca7fc640 1 -- 172.21.15.19:0/3165584946 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f61cc018430 con 0x556759fee780 2024-09-19T08:56:02.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.584+0000 7f61eb41d740 1 -- 172.21.15.19:0/3165584946 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61dc019af0 con 0x556759fee780 2024-09-19T08:56:02.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.585+0000 7f61ca7fc640 1 -- 172.21.15.19:0/3165584946 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f61cc018630 con 0x556759fee780 2024-09-19T08:56:02.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.585+0000 7f61eb41d740 10 client.16191 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:02.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.585+0000 7f61eb41d740 1 -- 172.21.15.19:0/3165584946 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55675a0686e0 con 0x556759fee780 2024-09-19T08:56:02.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.585+0000 7f61ca7fc640 1 -- 172.21.15.19:0/3165584946 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61dc019af0 con 0x556759fee780 2024-09-19T08:56:02.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.585+0000 7f61ca7fc640 1 -- 172.21.15.19:0/3165584946 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f61cc012050 con 0x556759fee780 2024-09-19T08:56:02.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.585+0000 7f61eb41d740 10 client.16191 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:02.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.585+0000 7f61eb41d740 10 client.16191 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-19T08:56:02.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.585+0000 7f61eb41d740 20 client.16191 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:02.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.585+0000 7f61eb41d740 1 --2- 172.21.15.19:0/3165584946 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55675a068cc0 0x55675a06b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:02.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.585+0000 7f61eb41d740 4 client.16191 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:56:02.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.585+0000 7f61eb41d740 1 -- 172.21.15.19:0/3165584946 --> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556759f4cd70 con 0x55675a068cc0 2024-09-19T08:56:02.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.585+0000 7f61e2d9d640 1 --2- 172.21.15.19:0/3165584946 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55675a068cc0 0x55675a06b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:02.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.586+0000 7f61e2d9d640 1 --2- 172.21.15.19:0/3165584946 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55675a068cc0 0x55675a06b0b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e35f8c619e78340c server_cookie=65e4442142da454c in_seq=0 out_seq=0 2024-09-19T08:56:02.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.586+0000 7f61ca7fc640 10 client.16191 ms_handle_connect on v2:172.21.15.155:6836/3381010945 2024-09-19T08:56:02.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.586+0000 7f61ca7fc640 1 -- 172.21.15.19:0/3165584946 <== mds.3 v2:172.21.15.155:6836/3381010945 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556759f4cd70 con 0x55675a068cc0 2024-09-19T08:56:02.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.586+0000 7f61ca7fc640 10 client.16191 handle_command_reply: tid=0 2024-09-19T08:56:02.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.586+0000 7f61eb41d740 1 client.16191 shutdown 2024-09-19T08:56:02.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.586+0000 7f61eb41d740 1 -- 172.21.15.19:0/3165584946 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556759fee780 msgr2=0x556759fe77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:02.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.586+0000 7f61eb41d740 1 --2- 172.21.15.19:0/3165584946 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556759fee780 0x556759fe77a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f61cc004810 tx=0x7f61cc027040 comp rx=0 tx=0).stop 2024-09-19T08:56:02.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.586+0000 7f61eb41d740 1 -- 172.21.15.19:0/3165584946 shutdown_connections 2024-09-19T08:56:02.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.586+0000 7f61eb41d740 1 --2- 172.21.15.19:0/3165584946 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55675a068cc0 0x55675a06b0b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.586+0000 7f61eb41d740 1 --2- 172.21.15.19:0/3165584946 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556759fee780 0x556759fe77a0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.586+0000 7f61ca7fc640 0 client.16191 ms_handle_reset on v2:172.21.15.155:6836/3381010945 2024-09-19T08:56:02.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.586+0000 7f61eb41d740 1 --2- 172.21.15.19:0/3165584946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556759fe0b40 0x556759ff6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.586+0000 7f61eb41d740 1 --2- 172.21.15.19:0/3165584946 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556759fdf5d0 0x556759ff67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.586+0000 7f61eb41d740 1 -- 172.21.15.19:0/3165584946 >> 172.21.15.19:0/3165584946 conn(0x556759fa8310 msgr2=0x556759feaca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:02.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.587+0000 7f61eb41d740 1 -- 172.21.15.19:0/3165584946 shutdown_connections 2024-09-19T08:56:02.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.587+0000 7f61eb41d740 1 -- 172.21.15.19:0/3165584946 wait complete. 2024-09-19T08:56:02.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.587+0000 7f61eb41d740 20 client.16191 trim_cache size 0 max 16384 2024-09-19T08:56:02.591 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T08:56:02.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.587+0000 7f61e9044640 1 -- 172.21.15.19:0/338855711 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f61d00a3240 msgr2=0x7f61d00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:02.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.587+0000 7f61e9044640 1 --2- 172.21.15.19:0/338855711 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f61d00a3240 0x7f61d00a5700 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f61d40b97a0 tx=0x7f61d40b2820 comp rx=0 tx=0).stop 2024-09-19T08:56:02.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.587+0000 7f61e9044640 1 -- 172.21.15.19:0/338855711 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61e4106f10 msgr2=0x7f61e419cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:02.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.587+0000 7f61e9044640 1 --2- 172.21.15.19:0/338855711 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61e4106f10 0x7f61e419cd40 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f61d4031a60 tx=0x7f61d4031a90 comp rx=0 tx=0).stop 2024-09-19T08:56:02.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.587+0000 7f61e9044640 1 -- 172.21.15.19:0/338855711 shutdown_connections 2024-09-19T08:56:02.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.587+0000 7f61e9044640 1 --2- 172.21.15.19:0/338855711 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f61d00a3240 0x7f61d00a5700 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.587+0000 7f61e9044640 1 --2- 172.21.15.19:0/338855711 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61e4106f10 0x7f61e419cd40 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.587+0000 7f61e9044640 1 --2- 172.21.15.19:0/338855711 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61e4102790 0x7f61e41989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.587+0000 7f61e9044640 1 --2- 172.21.15.19:0/338855711 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61e4101de0 0x7f61e4198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:02.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.587+0000 7f61e9044640 1 -- 172.21.15.19:0/338855711 >> 172.21.15.19:0/338855711 conn(0x7f61e40fd8c0 msgr2=0x7f61e40fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:02.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.587+0000 7f61e9044640 1 -- 172.21.15.19:0/338855711 shutdown_connections 2024-09-19T08:56:02.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:02.588+0000 7f61e9044640 1 -- 172.21.15.19:0/338855711 wait complete. 2024-09-19T08:56:03.416 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T08:56:03.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:03 smithi019 ceph-mon[30976]: pgmap v452: 97 pgs: 97 active+clean; 1.6 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 KiB/s wr, 19 op/s 2024-09-19T08:56:03.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:03 smithi155 ceph-mon[34921]: pgmap v452: 97 pgs: 97 active+clean; 1.6 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 KiB/s wr, 19 op/s 2024-09-19T08:56:03.676 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:03.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:03 smithi203 ceph-mon[35450]: pgmap v452: 97 pgs: 97 active+clean; 1.6 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 16 KiB/s wr, 19 op/s 2024-09-19T08:56:04.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.124+0000 7fc37abb8640 1 -- 172.21.15.19:0/810060851 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc374102790 msgr2=0x7fc3741067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:04.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.124+0000 7fc37abb8640 1 --2- 172.21.15.19:0/810060851 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc374102790 0x7fc3741067e0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fc360009900 tx=0x7fc36002a410 comp rx=0 tx=0).stop 2024-09-19T08:56:04.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.124+0000 7fc37abb8640 1 -- 172.21.15.19:0/810060851 shutdown_connections 2024-09-19T08:56:04.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.124+0000 7fc37abb8640 1 --2- 172.21.15.19:0/810060851 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc374106f10 0x7fc37410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:04.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.124+0000 7fc37abb8640 1 --2- 172.21.15.19:0/810060851 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc374102790 0x7fc3741067e0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:04.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.124+0000 7fc37abb8640 1 --2- 172.21.15.19:0/810060851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc374101de0 0x7fc3741021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:04.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.124+0000 7fc37abb8640 1 -- 172.21.15.19:0/810060851 >> 172.21.15.19:0/810060851 conn(0x7fc3740fd8c0 msgr2=0x7fc3740ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:04.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.124+0000 7fc37abb8640 1 -- 172.21.15.19:0/810060851 shutdown_connections 2024-09-19T08:56:04.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.124+0000 7fc37abb8640 1 -- 172.21.15.19:0/810060851 wait complete. 2024-09-19T08:56:04.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.125+0000 7fc37abb8640 1 Processor -- start 2024-09-19T08:56:04.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.125+0000 7fc37abb8640 1 -- start start 2024-09-19T08:56:04.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.125+0000 7fc37abb8640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc374101de0 0x7fc3740744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:04.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.125+0000 7fc37abb8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc374102790 0x7fc374074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:04.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.125+0000 7fc37abb8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc374106f10 0x7fc374074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:04.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.125+0000 7fc37abb8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc374111f30 con 0x7fc374102790 2024-09-19T08:56:04.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.125+0000 7fc37abb8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc374111db0 con 0x7fc374106f10 2024-09-19T08:56:04.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.125+0000 7fc37abb8640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc3741120b0 con 0x7fc374101de0 2024-09-19T08:56:04.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.125+0000 7fc373fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc374102790 0x7fc374074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:04.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.125+0000 7fc373fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc374102790 0x7fc374074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45834/0 (socket says 172.21.15.19:45834) 2024-09-19T08:56:04.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.125+0000 7fc373fff640 1 -- 172.21.15.19:0/3782544590 learned_addr learned my addr 172.21.15.19:0/3782544590 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:04.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.126+0000 7fc378954640 1 --2- 172.21.15.19:0/3782544590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc374101de0 0x7fc3740744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:04.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.126+0000 7fc379155640 1 --2- 172.21.15.19:0/3782544590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc374106f10 0x7fc374074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:04.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.126+0000 7fc373fff640 1 -- 172.21.15.19:0/3782544590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc374101de0 msgr2=0x7fc3740744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:04.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.126+0000 7fc373fff640 1 --2- 172.21.15.19:0/3782544590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc374101de0 0x7fc3740744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:04.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.126+0000 7fc373fff640 1 -- 172.21.15.19:0/3782544590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc374106f10 msgr2=0x7fc374074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:04.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.126+0000 7fc373fff640 1 --2- 172.21.15.19:0/3782544590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc374106f10 0x7fc374074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:04.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.126+0000 7fc373fff640 1 -- 172.21.15.19:0/3782544590 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3741a6880 con 0x7fc374102790 2024-09-19T08:56:04.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.126+0000 7fc373fff640 1 --2- 172.21.15.19:0/3782544590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc374102790 0x7fc374074a30 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fc360005ab0 tx=0x7fc3600042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:04.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.126+0000 7fc371ffb640 1 -- 172.21.15.19:0/3782544590 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36003f030 con 0x7fc374102790 2024-09-19T08:56:04.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.126+0000 7fc371ffb640 1 -- 172.21.15.19:0/3782544590 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc360003ce0 con 0x7fc374102790 2024-09-19T08:56:04.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.126+0000 7fc37abb8640 1 -- 172.21.15.19:0/3782544590 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3741a6b10 con 0x7fc374102790 2024-09-19T08:56:04.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.126+0000 7fc371ffb640 1 -- 172.21.15.19:0/3782544590 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc360035070 con 0x7fc374102790 2024-09-19T08:56:04.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.126+0000 7fc37abb8640 1 -- 172.21.15.19:0/3782544590 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3741a6ff0 con 0x7fc374102790 2024-09-19T08:56:04.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.129+0000 7fc371ffb640 1 -- 172.21.15.19:0/3782544590 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fc360042030 con 0x7fc374102790 2024-09-19T08:56:04.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.129+0000 7fc37cf91740 1 Processor -- start 2024-09-19T08:56:04.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.129+0000 7fc37cf91740 1 -- start start 2024-09-19T08:56:04.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.129+0000 7fc37cf91740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccc0a39b40 0x55ccc0a38090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:04.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.129+0000 7fc37cf91740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccc0a385d0 0x55ccc0a38a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:04.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.129+0000 7fc37cf91740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccc0a43370 0x55ccc0a45760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:04.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.129+0000 7fc37cf91740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ccc099e2f0 con 0x55ccc0a39b40 2024-09-19T08:56:04.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.129+0000 7fc37cf91740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55ccc0945cf0 con 0x55ccc0a43370 2024-09-19T08:56:04.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.129+0000 7fc37cf91740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ccc099a2b0 con 0x55ccc0a385d0 2024-09-19T08:56:04.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.129+0000 7fc379155640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccc0a39b40 0x55ccc0a38090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:04.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.129+0000 7fc379155640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccc0a39b40 0x55ccc0a38090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45836/0 (socket says 172.21.15.19:45836) 2024-09-19T08:56:04.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.129+0000 7fc379155640 1 -- 172.21.15.19:0/2420151276 learned_addr learned my addr 172.21.15.19:0/2420151276 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:04.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.129+0000 7fc371ffb640 1 --2- 172.21.15.19:0/3782544590 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc3640a3240 0x7fc3640a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:04.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.130+0000 7fc378954640 1 --2- 172.21.15.19:0/2420151276 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccc0a385d0 0x55ccc0a38a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:04.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.130+0000 7fc373fff640 1 --2- 172.21.15.19:0/2420151276 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccc0a43370 0x55ccc0a45760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:04.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.130+0000 7fc379155640 1 -- 172.21.15.19:0/2420151276 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccc0a385d0 msgr2=0x55ccc0a38a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:04.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.130+0000 7fc379155640 1 --2- 172.21.15.19:0/2420151276 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccc0a385d0 0x55ccc0a38a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:04.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.130+0000 7fc379155640 1 -- 172.21.15.19:0/2420151276 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccc0a43370 msgr2=0x55ccc0a45760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:04.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.130+0000 7fc379155640 1 --2- 172.21.15.19:0/2420151276 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccc0a43370 0x55ccc0a45760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:04.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.130+0000 7fc379155640 1 -- 172.21.15.19:0/2420151276 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccc092a3a0 con 0x55ccc0a39b40 2024-09-19T08:56:04.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.130+0000 7fc373fff640 1 --2- 172.21.15.19:0/2420151276 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccc0a43370 0x55ccc0a45760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:04.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.130+0000 7fc379155640 1 --2- 172.21.15.19:0/3782544590 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc3640a3240 0x7fc3640a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:04.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.130+0000 7fc371ffb640 1 -- 172.21.15.19:0/3782544590 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc3600f0280 con 0x7fc374102790 2024-09-19T08:56:04.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.130+0000 7fc379155640 1 --2- 172.21.15.19:0/2420151276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccc0a39b40 0x55ccc0a38090 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fc36c008ec0 tx=0x7fc36c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=add5bc5d9f2f0b07 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:04.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.130+0000 7fc35effd640 1 -- 172.21.15.19:0/2420151276 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36c022070 con 0x55ccc0a39b40 2024-09-19T08:56:04.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.130+0000 7fc379155640 1 --2- 172.21.15.19:0/3782544590 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc3640a3240 0x7fc3640a5700 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc36c01f000 tx=0x7fc36c020000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:04.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.130+0000 7fc35effd640 1 -- 172.21.15.19:0/2420151276 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc36c011d90 con 0x55ccc0a39b40 2024-09-19T08:56:04.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.130+0000 7fc35effd640 1 -- 172.21.15.19:0/2420151276 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36c01cac0 con 0x55ccc0a39b40 2024-09-19T08:56:04.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.131+0000 7fc37cf91740 1 -- 172.21.15.19:0/2420151276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccc0a39b40 msgr2=0x55ccc0a38090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:04.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.131+0000 7fc37cf91740 1 --2- 172.21.15.19:0/2420151276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccc0a39b40 0x55ccc0a38090 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fc36c008ec0 tx=0x7fc36c00e720 comp rx=0 tx=0).stop 2024-09-19T08:56:04.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.131+0000 7fc37cf91740 1 -- 172.21.15.19:0/2420151276 shutdown_connections 2024-09-19T08:56:04.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.131+0000 7fc37cf91740 1 --2- 172.21.15.19:0/2420151276 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccc0a385d0 0x55ccc0a38a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:04.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.131+0000 7fc37cf91740 1 --2- 172.21.15.19:0/2420151276 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccc0a43370 0x55ccc0a45760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:04.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.131+0000 7fc37cf91740 1 --2- 172.21.15.19:0/2420151276 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccc0a39b40 0x55ccc0a38090 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:04.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.131+0000 7fc37cf91740 1 -- 172.21.15.19:0/2420151276 >> 172.21.15.19:0/2420151276 conn(0x55ccc0a01310 msgr2=0x55ccc0a34c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:04.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.131+0000 7fc37cf91740 1 -- 172.21.15.19:0/2420151276 shutdown_connections 2024-09-19T08:56:04.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.131+0000 7fc37cf91740 1 -- 172.21.15.19:0/2420151276 wait complete. 2024-09-19T08:56:04.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.131+0000 7fc37cf91740 1 -- start start 2024-09-19T08:56:04.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.132+0000 7fc37cf91740 1 Processor -- start 2024-09-19T08:56:04.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.132+0000 7fc37cf91740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccc0a385d0 0x55ccc0a42d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:04.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.132+0000 7fc37cf91740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccc0a39b40 0x55ccc0a40020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:04.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.132+0000 7fc37cf91740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccc0a43370 0x55ccc0a40610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:04.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.132+0000 7fc37cf91740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ccc0a46070 con 0x55ccc0a385d0 2024-09-19T08:56:04.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.132+0000 7fc37cf91740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55ccc0959060 con 0x55ccc0a39b40 2024-09-19T08:56:04.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.132+0000 7fc37cf91740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ccc0a461f0 con 0x55ccc0a43370 2024-09-19T08:56:04.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.132+0000 7fc37cf91740 10 client.0 _ll_register_callbacks cb 0x55ccc06ac8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:04.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.132+0000 7fc378954640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccc0a385d0 0x55ccc0a42d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:04.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.132+0000 7fc378954640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccc0a385d0 0x55ccc0a42d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45844/0 (socket says 172.21.15.19:45844) 2024-09-19T08:56:04.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.132+0000 7fc379155640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccc0a43370 0x55ccc0a40610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:04.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.132+0000 7fc373fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccc0a39b40 0x55ccc0a40020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:04.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.132+0000 7fc378954640 1 -- 172.21.15.19:0/802006833 learned_addr learned my addr 172.21.15.19:0/802006833 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:04.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.133+0000 7fc378954640 1 -- 172.21.15.19:0/802006833 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccc0a43370 msgr2=0x55ccc0a40610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:04.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.133+0000 7fc378954640 1 --2- 172.21.15.19:0/802006833 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccc0a43370 0x55ccc0a40610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:04.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.133+0000 7fc378954640 1 -- 172.21.15.19:0/802006833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccc0a39b40 msgr2=0x55ccc0a40020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:04.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.133+0000 7fc378954640 1 --2- 172.21.15.19:0/802006833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccc0a39b40 0x55ccc0a40020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:04.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.133+0000 7fc378954640 1 -- 172.21.15.19:0/802006833 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ccc070f3c0 con 0x55ccc0a385d0 2024-09-19T08:56:04.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.133+0000 7fc378954640 1 --2- 172.21.15.19:0/802006833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccc0a385d0 0x55ccc0a42d70 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fc368010a50 tx=0x7fc368010f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37631c77ba385ecd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:04.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.133+0000 7fc353fff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:56:04.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.133+0000 7fc353fff640 1 -- 172.21.15.19:0/802006833 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36801e060 con 0x55ccc0a385d0 2024-09-19T08:56:04.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.133+0000 7fc353fff640 1 -- 172.21.15.19:0/802006833 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc36800fbd0 con 0x55ccc0a385d0 2024-09-19T08:56:04.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.133+0000 7fc37cf91740 1 -- 172.21.15.19:0/802006833 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc36c011d90 con 0x55ccc0a385d0 2024-09-19T08:56:04.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.133+0000 7fc353fff640 1 -- 172.21.15.19:0/802006833 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc36800fdd0 con 0x55ccc0a385d0 2024-09-19T08:56:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.133+0000 7fc37cf91740 10 client.16203 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.133+0000 7fc37cf91740 1 -- 172.21.15.19:0/802006833 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ccc0a51b70 con 0x55ccc0a385d0 2024-09-19T08:56:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.134+0000 7fc353fff640 1 -- 172.21.15.19:0/802006833 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc36c011d90 con 0x55ccc0a385d0 2024-09-19T08:56:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.134+0000 7fc353fff640 1 -- 172.21.15.19:0/802006833 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7fc368024590 con 0x55ccc0a385d0 2024-09-19T08:56:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.134+0000 7fc37cf91740 10 client.16203 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.134+0000 7fc37cf91740 10 client.16203 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T08:56:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.134+0000 7fc37cf91740 20 client.16203 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.134+0000 7fc37cf91740 1 --2- 172.21.15.19:0/802006833 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55ccc0a53030 0x55ccc0a55460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.134+0000 7fc37cf91740 4 client.16203 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:56:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.134+0000 7fc37cf91740 1 -- 172.21.15.19:0/802006833 --> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ccc09ab860 con 0x55ccc0a53030 2024-09-19T08:56:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.134+0000 7fc373fff640 1 --2- 172.21.15.19:0/802006833 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55ccc0a53030 0x55ccc0a55460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.135+0000 7fc373fff640 1 --2- 172.21.15.19:0/802006833 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55ccc0a53030 0x55ccc0a55460 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bcd449d03725d6a7 server_cookie=a6d62b9b523ba420 in_seq=0 out_seq=0 2024-09-19T08:56:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.135+0000 7fc353fff640 10 client.16203 ms_handle_connect on v2:172.21.15.203:6836/3684671619 2024-09-19T08:56:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.135+0000 7fc353fff640 1 -- 172.21.15.19:0/802006833 <== mds.2 v2:172.21.15.203:6836/3684671619 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ccc09ab860 con 0x55ccc0a53030 2024-09-19T08:56:04.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.135+0000 7fc353fff640 10 client.16203 handle_command_reply: tid=0 2024-09-19T08:56:04.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.135+0000 7fc37cf91740 1 client.16203 shutdown 2024-09-19T08:56:04.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.136+0000 7fc37cf91740 1 -- 172.21.15.19:0/802006833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccc0a385d0 msgr2=0x55ccc0a42d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:04.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.136+0000 7fc37cf91740 1 --2- 172.21.15.19:0/802006833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccc0a385d0 0x55ccc0a42d70 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fc368010a50 tx=0x7fc368010f10 comp rx=0 tx=0).stop 2024-09-19T08:56:04.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.136+0000 7fc37cf91740 1 -- 172.21.15.19:0/802006833 shutdown_connections 2024-09-19T08:56:04.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.136+0000 7fc37cf91740 1 --2- 172.21.15.19:0/802006833 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55ccc0a53030 0x55ccc0a55460 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:04.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.136+0000 7fc37cf91740 1 --2- 172.21.15.19:0/802006833 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccc0a43370 0x55ccc0a40610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:04.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.136+0000 7fc37cf91740 1 --2- 172.21.15.19:0/802006833 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccc0a39b40 0x55ccc0a40020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:04.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.136+0000 7fc37cf91740 1 --2- 172.21.15.19:0/802006833 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccc0a385d0 0x55ccc0a42d70 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:04.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.136+0000 7fc37cf91740 1 -- 172.21.15.19:0/802006833 >> 172.21.15.19:0/802006833 conn(0x55ccc0a01310 msgr2=0x55ccc0a3a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:04.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.136+0000 7fc353fff640 0 client.16203 ms_handle_reset on v2:172.21.15.203:6836/3684671619 2024-09-19T08:56:04.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.136+0000 7fc37cf91740 1 -- 172.21.15.19:0/802006833 shutdown_connections 2024-09-19T08:56:04.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.136+0000 7fc37cf91740 1 -- 172.21.15.19:0/802006833 wait complete. 2024-09-19T08:56:04.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.136+0000 7fc37cf91740 20 client.16203 trim_cache size 0 max 16384 2024-09-19T08:56:04.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.149+0000 7fc37cf91740 1 Processor -- start 2024-09-19T08:56:04.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.149+0000 7fc37cf91740 1 -- start start 2024-09-19T08:56:04.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.149+0000 7fc37cf91740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccc0a385d0 0x55ccc0a33c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:04.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.149+0000 7fc37cf91740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccc0a39b40 0x55ccc0a34150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:04.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.149+0000 7fc37cf91740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccc0a43370 0x55ccc0a3b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:04.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.149+0000 7fc37cf91740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc3741af5f0 con 0x55ccc0a39b40 2024-09-19T08:56:04.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.149+0000 7fc37cf91740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc3741b1160 con 0x55ccc0a43370 2024-09-19T08:56:04.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.149+0000 7fc37cf91740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc3741afcc0 con 0x55ccc0a385d0 2024-09-19T08:56:04.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.149+0000 7fc373fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccc0a39b40 0x55ccc0a34150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:04.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.149+0000 7fc373fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccc0a39b40 0x55ccc0a34150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45854/0 (socket says 172.21.15.19:45854) 2024-09-19T08:56:04.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.149+0000 7fc373fff640 1 -- 172.21.15.19:0/2165066853 learned_addr learned my addr 172.21.15.19:0/2165066853 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:04.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.149+0000 7fc378954640 1 --2- 172.21.15.19:0/2165066853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccc0a385d0 0x55ccc0a33c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:04.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.149+0000 7fc373fff640 1 -- 172.21.15.19:0/2165066853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccc0a385d0 msgr2=0x55ccc0a33c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:04.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.149+0000 7fc373fff640 1 --2- 172.21.15.19:0/2165066853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccc0a385d0 0x55ccc0a33c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:04.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.149+0000 7fc379155640 1 --2- 172.21.15.19:0/2165066853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccc0a43370 0x55ccc0a3b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:04.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.150+0000 7fc373fff640 1 -- 172.21.15.19:0/2165066853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccc0a43370 msgr2=0x55ccc0a3b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:04.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.150+0000 7fc373fff640 1 --2- 172.21.15.19:0/2165066853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccc0a43370 0x55ccc0a3b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:04.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.150+0000 7fc373fff640 1 -- 172.21.15.19:0/2165066853 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccc0a45ad0 con 0x55ccc0a39b40 2024-09-19T08:56:04.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.150+0000 7fc379155640 1 --2- 172.21.15.19:0/2165066853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccc0a43370 0x55ccc0a3b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:56:04.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.150+0000 7fc373fff640 1 --2- 172.21.15.19:0/2165066853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccc0a39b40 0x55ccc0a34150 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fc360005de0 tx=0x7fc36002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f80bd7abc2d7afe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:04.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.150+0000 7fc35e7fc640 1 -- 172.21.15.19:0/2165066853 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc360049070 con 0x55ccc0a39b40 2024-09-19T08:56:04.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.150+0000 7fc35e7fc640 1 -- 172.21.15.19:0/2165066853 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3600bcfb0 con 0x55ccc0a39b40 2024-09-19T08:56:04.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.150+0000 7fc35e7fc640 1 -- 172.21.15.19:0/2165066853 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36003b460 con 0x55ccc0a39b40 2024-09-19T08:56:04.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.150+0000 7fc37cf91740 1 -- 172.21.15.19:0/2165066853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccc0a39b40 msgr2=0x55ccc0a34150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:04.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.150+0000 7fc37cf91740 1 --2- 172.21.15.19:0/2165066853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccc0a39b40 0x55ccc0a34150 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fc360005de0 tx=0x7fc36002a410 comp rx=0 tx=0).stop 2024-09-19T08:56:04.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.150+0000 7fc37cf91740 1 -- 172.21.15.19:0/2165066853 shutdown_connections 2024-09-19T08:56:04.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.150+0000 7fc37cf91740 1 --2- 172.21.15.19:0/2165066853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccc0a43370 0x55ccc0a3b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:04.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.151+0000 7fc37cf91740 1 --2- 172.21.15.19:0/2165066853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccc0a39b40 0x55ccc0a34150 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:04.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.151+0000 7fc37cf91740 1 --2- 172.21.15.19:0/2165066853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccc0a385d0 0x55ccc0a33c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:04.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.151+0000 7fc37cf91740 1 -- 172.21.15.19:0/2165066853 >> 172.21.15.19:0/2165066853 conn(0x55ccc0a01310 msgr2=0x55ccc0a33500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:04.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.151+0000 7fc37cf91740 1 -- 172.21.15.19:0/2165066853 shutdown_connections 2024-09-19T08:56:04.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.151+0000 7fc37cf91740 1 -- 172.21.15.19:0/2165066853 wait complete. 2024-09-19T08:56:04.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.151+0000 7fc37cf91740 1 -- start start 2024-09-19T08:56:04.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.151+0000 7fc37cf91740 1 Processor -- start 2024-09-19T08:56:04.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.151+0000 7fc37cf91740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccc0a385d0 0x55ccc0a4bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:04.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.151+0000 7fc37cf91740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccc0a39b40 0x55ccc0a46ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:04.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.151+0000 7fc37cf91740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccc0a43370 0x55ccc0a47420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:04.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.151+0000 7fc37cf91740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc3741b0a90 con 0x55ccc0a43370 2024-09-19T08:56:04.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.151+0000 7fc37cf91740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc3741b03c0 con 0x55ccc0a39b40 2024-09-19T08:56:04.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.151+0000 7fc37cf91740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc3741ad5f0 con 0x55ccc0a385d0 2024-09-19T08:56:04.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.151+0000 7fc37cf91740 10 client.0 _ll_register_callbacks cb 0x7fc36800a820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:04.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.152+0000 7fc379155640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccc0a43370 0x55ccc0a47420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:04.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.152+0000 7fc379155640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccc0a43370 0x55ccc0a47420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45862/0 (socket says 172.21.15.19:45862) 2024-09-19T08:56:04.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.152+0000 7fc379155640 1 -- 172.21.15.19:0/1076361134 learned_addr learned my addr 172.21.15.19:0/1076361134 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:04.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.152+0000 7fc378954640 1 --2- 172.21.15.19:0/1076361134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccc0a385d0 0x55ccc0a4bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:04.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.152+0000 7fc373fff640 1 --2- 172.21.15.19:0/1076361134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccc0a39b40 0x55ccc0a46ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:04.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.152+0000 7fc379155640 1 -- 172.21.15.19:0/1076361134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccc0a385d0 msgr2=0x55ccc0a4bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:04.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.152+0000 7fc379155640 1 --2- 172.21.15.19:0/1076361134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccc0a385d0 0x55ccc0a4bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:04.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.152+0000 7fc379155640 1 -- 172.21.15.19:0/1076361134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccc0a39b40 msgr2=0x55ccc0a46ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:04.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.152+0000 7fc379155640 1 --2- 172.21.15.19:0/1076361134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccc0a39b40 0x55ccc0a46ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:04.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.152+0000 7fc379155640 1 -- 172.21.15.19:0/1076361134 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ccc0a47c50 con 0x55ccc0a43370 2024-09-19T08:56:04.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.152+0000 7fc379155640 1 --2- 172.21.15.19:0/1076361134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccc0a43370 0x55ccc0a47420 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fc36c00ec20 tx=0x7fc36c0087f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3700c6cd4bf55b9f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:04.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.152+0000 7fc353fff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:56:04.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.152+0000 7fc353fff640 1 -- 172.21.15.19:0/1076361134 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36c022050 con 0x55ccc0a43370 2024-09-19T08:56:04.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.152+0000 7fc353fff640 1 -- 172.21.15.19:0/1076361134 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc36c0118b0 con 0x55ccc0a43370 2024-09-19T08:56:04.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.152+0000 7fc37cf91740 1 -- 172.21.15.19:0/1076361134 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3600bcfb0 con 0x55ccc0a43370 2024-09-19T08:56:04.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.152+0000 7fc353fff640 1 -- 172.21.15.19:0/1076361134 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fc36c0089c0 con 0x55ccc0a43370 2024-09-19T08:56:04.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.152+0000 7fc37cf91740 10 client.16209 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:04.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.152+0000 7fc37cf91740 1 -- 172.21.15.19:0/1076361134 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ccc0abdc60 con 0x55ccc0a43370 2024-09-19T08:56:04.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.153+0000 7fc353fff640 1 -- 172.21.15.19:0/1076361134 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc3600bcfb0 con 0x55ccc0a43370 2024-09-19T08:56:04.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.153+0000 7fc353fff640 1 -- 172.21.15.19:0/1076361134 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7fc36c019040 con 0x55ccc0a43370 2024-09-19T08:56:04.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.153+0000 7fc37cf91740 10 client.16209 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:04.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.153+0000 7fc37cf91740 10 client.16209 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T08:56:04.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.153+0000 7fc37cf91740 20 client.16209 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:04.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.153+0000 7fc37cf91740 1 --2- 172.21.15.19:0/1076361134 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55ccc0abe1b0 0x55ccc0ac05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:04.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.153+0000 7fc37cf91740 4 client.16209 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:56:04.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.153+0000 7fc37cf91740 1 -- 172.21.15.19:0/1076361134 --> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ccc09a5d70 con 0x55ccc0abe1b0 2024-09-19T08:56:04.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.153+0000 7fc378954640 1 --2- 172.21.15.19:0/1076361134 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55ccc0abe1b0 0x55ccc0ac05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:04.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.154+0000 7fc353fff640 10 client.16209 ms_handle_connect on v2:172.21.15.203:6836/3684671619 2024-09-19T08:56:04.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.154+0000 7fc378954640 1 --2- 172.21.15.19:0/1076361134 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55ccc0abe1b0 0x55ccc0ac05d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b42d33cdb696298e server_cookie=5d92d5f92ff1ed34 in_seq=0 out_seq=0 2024-09-19T08:56:04.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.154+0000 7fc353fff640 1 -- 172.21.15.19:0/1076361134 <== mds.2 v2:172.21.15.203:6836/3684671619 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ccc09a5d70 con 0x55ccc0abe1b0 2024-09-19T08:56:04.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.154+0000 7fc353fff640 10 client.16209 handle_command_reply: tid=0 2024-09-19T08:56:04.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.154+0000 7fc37cf91740 1 client.16209 shutdown 2024-09-19T08:56:04.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.154+0000 7fc37cf91740 1 -- 172.21.15.19:0/1076361134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccc0a43370 msgr2=0x55ccc0a47420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:04.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.154+0000 7fc37cf91740 1 --2- 172.21.15.19:0/1076361134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccc0a43370 0x55ccc0a47420 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fc36c00ec20 tx=0x7fc36c0087f0 comp rx=0 tx=0).stop 2024-09-19T08:56:04.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.154+0000 7fc37cf91740 1 -- 172.21.15.19:0/1076361134 shutdown_connections 2024-09-19T08:56:04.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.154+0000 7fc37cf91740 1 --2- 172.21.15.19:0/1076361134 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55ccc0abe1b0 0x55ccc0ac05d0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:04.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.154+0000 7fc37cf91740 1 --2- 172.21.15.19:0/1076361134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccc0a43370 0x55ccc0a47420 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:04.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.154+0000 7fc37cf91740 1 --2- 172.21.15.19:0/1076361134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccc0a39b40 0x55ccc0a46ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:04.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.154+0000 7fc37cf91740 1 --2- 172.21.15.19:0/1076361134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccc0a385d0 0x55ccc0a4bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:04.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.154+0000 7fc353fff640 0 client.16209 ms_handle_reset on v2:172.21.15.203:6836/3684671619 2024-09-19T08:56:04.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.154+0000 7fc37cf91740 1 -- 172.21.15.19:0/1076361134 >> 172.21.15.19:0/1076361134 conn(0x55ccc0a01310 msgr2=0x55ccc0a33d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:04.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.154+0000 7fc37cf91740 1 -- 172.21.15.19:0/1076361134 shutdown_connections 2024-09-19T08:56:04.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.154+0000 7fc37cf91740 1 -- 172.21.15.19:0/1076361134 wait complete. 2024-09-19T08:56:04.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.154+0000 7fc37cf91740 20 client.16209 trim_cache size 0 max 16384 2024-09-19T08:56:04.161 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T08:56:04.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.155+0000 7fc37abb8640 1 -- 172.21.15.19:0/3782544590 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc3640a3240 msgr2=0x7fc3640a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:04.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.155+0000 7fc37abb8640 1 --2- 172.21.15.19:0/3782544590 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc3640a3240 0x7fc3640a5700 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fc36c01f000 tx=0x7fc36c020000 comp rx=0 tx=0).stop 2024-09-19T08:56:04.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.155+0000 7fc37abb8640 1 -- 172.21.15.19:0/3782544590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc374102790 msgr2=0x7fc374074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:04.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.155+0000 7fc37abb8640 1 --2- 172.21.15.19:0/3782544590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc374102790 0x7fc374074a30 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fc360005ab0 tx=0x7fc3600042f0 comp rx=0 tx=0).stop 2024-09-19T08:56:04.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.155+0000 7fc37abb8640 1 -- 172.21.15.19:0/3782544590 shutdown_connections 2024-09-19T08:56:04.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.155+0000 7fc37abb8640 1 --2- 172.21.15.19:0/3782544590 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc3640a3240 0x7fc3640a5700 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:04.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.155+0000 7fc37abb8640 1 --2- 172.21.15.19:0/3782544590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc374106f10 0x7fc374074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:04.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.155+0000 7fc37abb8640 1 --2- 172.21.15.19:0/3782544590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc374102790 0x7fc374074a30 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:04.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.155+0000 7fc37abb8640 1 --2- 172.21.15.19:0/3782544590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc374101de0 0x7fc3740744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:04.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.155+0000 7fc37abb8640 1 -- 172.21.15.19:0/3782544590 >> 172.21.15.19:0/3782544590 conn(0x7fc3740fd8c0 msgr2=0x7fc3740fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:04.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.155+0000 7fc37abb8640 1 -- 172.21.15.19:0/3782544590 shutdown_connections 2024-09-19T08:56:04.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:04.155+0000 7fc37abb8640 1 -- 172.21.15.19:0/3782544590 wait complete. 2024-09-19T08:56:05.082 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T08:56:05.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:05 smithi019 ceph-mon[30976]: pgmap v453: 97 pgs: 97 active+clean; 1.6 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 21 op/s 2024-09-19T08:56:05.363 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:05.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:05 smithi155 ceph-mon[34921]: pgmap v453: 97 pgs: 97 active+clean; 1.6 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 21 op/s 2024-09-19T08:56:05.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:05 smithi203 ceph-mon[35450]: pgmap v453: 97 pgs: 97 active+clean; 1.6 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 20 KiB/s wr, 21 op/s 2024-09-19T08:56:05.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.861+0000 7f8aa7e97640 1 -- 172.21.15.19:0/4005551183 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8aa0108300 msgr2=0x7f8aa010ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:05.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.861+0000 7f8aa7e97640 1 --2- 172.21.15.19:0/4005551183 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8aa0108300 0x7f8aa010ec70 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f8a98009930 tx=0x7f8a9802a420 comp rx=0 tx=0).stop 2024-09-19T08:56:05.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.861+0000 7f8aa7e97640 1 -- 172.21.15.19:0/4005551183 shutdown_connections 2024-09-19T08:56:05.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.861+0000 7f8aa7e97640 1 --2- 172.21.15.19:0/4005551183 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8aa0103780 0x7f8aa0107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.861+0000 7f8aa7e97640 1 --2- 172.21.15.19:0/4005551183 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8aa0108300 0x7f8aa010ec70 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.861+0000 7f8aa7e97640 1 --2- 172.21.15.19:0/4005551183 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8aa0102dd0 0x7f8aa01031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.861+0000 7f8aa7e97640 1 -- 172.21.15.19:0/4005551183 >> 172.21.15.19:0/4005551183 conn(0x7f8aa00fc7d0 msgr2=0x7f8aa00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:05.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.861+0000 7f8aa7e97640 1 -- 172.21.15.19:0/4005551183 shutdown_connections 2024-09-19T08:56:05.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.861+0000 7f8aa7e97640 1 -- 172.21.15.19:0/4005551183 wait complete. 2024-09-19T08:56:05.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.862+0000 7f8aa7e97640 1 Processor -- start 2024-09-19T08:56:05.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.862+0000 7f8aa7e97640 1 -- start start 2024-09-19T08:56:05.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.862+0000 7f8aa7e97640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8aa0102dd0 0x7f8aa0198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:05.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.862+0000 7f8aa7e97640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8aa0103780 0x7f8aa0198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:05.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.862+0000 7f8aa7e97640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8aa0108300 0x7f8aa019ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:05.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.862+0000 7f8aa7e97640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa01120d0 con 0x7f8aa0108300 2024-09-19T08:56:05.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.862+0000 7f8aa7e97640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa0111f50 con 0x7f8aa0103780 2024-09-19T08:56:05.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.862+0000 7f8aa7e97640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa0112250 con 0x7f8aa0102dd0 2024-09-19T08:56:05.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.862+0000 7f8aa6434640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8aa0108300 0x7f8aa019ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:05.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.862+0000 7f8aa6434640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8aa0108300 0x7f8aa019ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54048/0 (socket says 172.21.15.19:54048) 2024-09-19T08:56:05.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.862+0000 7f8aa6434640 1 -- 172.21.15.19:0/1954584308 learned_addr learned my addr 172.21.15.19:0/1954584308 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:05.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.862+0000 7f8aa5c33640 1 --2- 172.21.15.19:0/1954584308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8aa0102dd0 0x7f8aa0198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:05.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.862+0000 7f8aa5432640 1 --2- 172.21.15.19:0/1954584308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8aa0103780 0x7f8aa0198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:05.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.862+0000 7f8aa6434640 1 -- 172.21.15.19:0/1954584308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8aa0102dd0 msgr2=0x7f8aa0198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:05.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.862+0000 7f8aa6434640 1 --2- 172.21.15.19:0/1954584308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8aa0102dd0 0x7f8aa0198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.862+0000 7f8aa6434640 1 -- 172.21.15.19:0/1954584308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8aa0103780 msgr2=0x7f8aa0198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:05.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.862+0000 7f8aa6434640 1 --2- 172.21.15.19:0/1954584308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8aa0103780 0x7f8aa0198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.862+0000 7f8aa6434640 1 -- 172.21.15.19:0/1954584308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aa019d540 con 0x7f8aa0108300 2024-09-19T08:56:05.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.863+0000 7f8aa5432640 1 --2- 172.21.15.19:0/1954584308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8aa0103780 0x7f8aa0198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:05.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.863+0000 7f8aa6434640 1 --2- 172.21.15.19:0/1954584308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8aa0108300 0x7f8aa019ce60 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f8a98005ab0 tx=0x7f8a980040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:05.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.863+0000 7f8a92ffd640 1 -- 172.21.15.19:0/1954584308 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9803f030 con 0x7f8aa0108300 2024-09-19T08:56:05.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.863+0000 7f8a92ffd640 1 -- 172.21.15.19:0/1954584308 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a980044c0 con 0x7f8aa0108300 2024-09-19T08:56:05.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.863+0000 7f8aa7e97640 1 -- 172.21.15.19:0/1954584308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8aa019d7d0 con 0x7f8aa0108300 2024-09-19T08:56:05.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.863+0000 7f8a92ffd640 1 -- 172.21.15.19:0/1954584308 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a98035070 con 0x7f8aa0108300 2024-09-19T08:56:05.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.863+0000 7f8aa7e97640 1 -- 172.21.15.19:0/1954584308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8aa01a5110 con 0x7f8aa0108300 2024-09-19T08:56:05.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.865+0000 7f8a92ffd640 1 -- 172.21.15.19:0/1954584308 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f8a98042030 con 0x7f8aa0108300 2024-09-19T08:56:05.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.866+0000 7f8aaa270740 1 Processor -- start 2024-09-19T08:56:05.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.866+0000 7f8aaa270740 1 -- start start 2024-09-19T08:56:05.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.866+0000 7f8a92ffd640 1 --2- 172.21.15.19:0/1954584308 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8a8c0a3240 0x7f8a8c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:05.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.866+0000 7f8aaa270740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a9a3dedb40 0x55a9a3dec090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:05.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.866+0000 7f8aaa270740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a9a3dec5d0 0x55a9a3deca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:05.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.866+0000 7f8aa5432640 1 --2- 172.21.15.19:0/1954584308 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8a8c0a3240 0x7f8a8c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:05.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.866+0000 7f8a92ffd640 1 -- 172.21.15.19:0/1954584308 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f8a980efc70 con 0x7f8aa0108300 2024-09-19T08:56:05.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.866+0000 7f8aaa270740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a9a3dfb780 0x55a9a3dfdb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:05.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.866+0000 7f8aaa270740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a9a3d522f0 con 0x55a9a3dfb780 2024-09-19T08:56:05.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.866+0000 7f8aaa270740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55a9a3cf9cf0 con 0x55a9a3dedb40 2024-09-19T08:56:05.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.866+0000 7f8aaa270740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a9a3d4e2b0 con 0x55a9a3dec5d0 2024-09-19T08:56:05.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.867+0000 7f8aa6434640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a9a3dfb780 0x55a9a3dfdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:05.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.867+0000 7f8aa5c33640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a9a3dedb40 0x55a9a3dec090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:05.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.867+0000 7f8aa6434640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a9a3dfb780 0x55a9a3dfdb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54060/0 (socket says 172.21.15.19:54060) 2024-09-19T08:56:05.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.867+0000 7f8aa5c33640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a9a3dedb40 0x55a9a3dec090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:34024/0 (socket says 172.21.15.19:34024) 2024-09-19T08:56:05.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.867+0000 7f8aa6434640 1 -- 172.21.15.19:0/1836291437 learned_addr learned my addr 172.21.15.19:0/1836291437 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:05.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.867+0000 7f8aa5432640 1 --2- 172.21.15.19:0/1836291437 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a9a3dec5d0 0x55a9a3deca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:05.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.867+0000 7f8aa5c33640 1 -- 172.21.15.19:0/1836291437 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a9a3dec5d0 msgr2=0x55a9a3deca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:05.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.867+0000 7f8aa5c33640 1 --2- 172.21.15.19:0/1836291437 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a9a3dec5d0 0x55a9a3deca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.867+0000 7f8aa5c33640 1 -- 172.21.15.19:0/1836291437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a9a3dfb780 msgr2=0x55a9a3dfdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:05.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.867+0000 7f8aa5c33640 1 --2- 172.21.15.19:0/1836291437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a9a3dfb780 0x55a9a3dfdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.867+0000 7f8aa5c33640 1 -- 172.21.15.19:0/1836291437 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9a3cde3a0 con 0x55a9a3dedb40 2024-09-19T08:56:05.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.867+0000 7f8aa5432640 1 --2- 172.21.15.19:0/1836291437 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a9a3dec5d0 0x55a9a3deca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:05.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.867+0000 7f8aa5c33640 1 --2- 172.21.15.19:0/1836291437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a9a3dedb40 0x55a9a3dec090 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c009fa0 tx=0x7f8a9c0118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98b56c0efabf5185 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:05.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.867+0000 7f8aa5432640 1 --2- 172.21.15.19:0/1954584308 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8a8c0a3240 0x7f8a8c0a5700 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x55a9a3de9ac0 tx=0x7f8a9400aa60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:05.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.867+0000 7f8a8bfff640 1 -- 172.21.15.19:0/1836291437 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c003a30 con 0x55a9a3dedb40 2024-09-19T08:56:05.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.868+0000 7f8a8bfff640 1 -- 172.21.15.19:0/1836291437 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a9c003bd0 con 0x55a9a3dedb40 2024-09-19T08:56:05.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.868+0000 7f8a8bfff640 1 -- 172.21.15.19:0/1836291437 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c00f950 con 0x55a9a3dedb40 2024-09-19T08:56:05.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.868+0000 7f8aaa270740 1 -- 172.21.15.19:0/1836291437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a9a3dedb40 msgr2=0x55a9a3dec090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:05.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.868+0000 7f8aaa270740 1 --2- 172.21.15.19:0/1836291437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a9a3dedb40 0x55a9a3dec090 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c009fa0 tx=0x7f8a9c0118d0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.868+0000 7f8aaa270740 1 -- 172.21.15.19:0/1836291437 shutdown_connections 2024-09-19T08:56:05.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.868+0000 7f8aaa270740 1 --2- 172.21.15.19:0/1836291437 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a9a3dec5d0 0x55a9a3deca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.868+0000 7f8aaa270740 1 --2- 172.21.15.19:0/1836291437 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a9a3dfb780 0x55a9a3dfdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.868+0000 7f8aaa270740 1 --2- 172.21.15.19:0/1836291437 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a9a3dedb40 0x55a9a3dec090 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.868+0000 7f8aaa270740 1 -- 172.21.15.19:0/1836291437 >> 172.21.15.19:0/1836291437 conn(0x55a9a3db5310 msgr2=0x55a9a3de8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:05.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.868+0000 7f8aaa270740 1 -- 172.21.15.19:0/1836291437 shutdown_connections 2024-09-19T08:56:05.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.868+0000 7f8aaa270740 1 -- 172.21.15.19:0/1836291437 wait complete. 2024-09-19T08:56:05.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.869+0000 7f8aaa270740 1 -- start start 2024-09-19T08:56:05.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.869+0000 7f8aaa270740 1 Processor -- start 2024-09-19T08:56:05.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.869+0000 7f8aaa270740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a9a3dec5d0 0x55a9a3dfb130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:05.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.869+0000 7f8aaa270740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a9a3dedb40 0x55a9a3df83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:05.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.869+0000 7f8aaa270740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a9a3dfb780 0x55a9a3df8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:05.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.869+0000 7f8aaa270740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a9a3dfe480 con 0x55a9a3dedb40 2024-09-19T08:56:05.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.869+0000 7f8aaa270740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55a9a3d0d060 con 0x55a9a3dec5d0 2024-09-19T08:56:05.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.869+0000 7f8aaa270740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a9a3dfe600 con 0x55a9a3dfb780 2024-09-19T08:56:05.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.869+0000 7f8aaa270740 10 client.0 _ll_register_callbacks cb 0x55a9a3a608c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:05.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.870+0000 7f8aa5c33640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a9a3dec5d0 0x55a9a3dfb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:05.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.870+0000 7f8aa5432640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a9a3dedb40 0x55a9a3df83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:05.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.870+0000 7f8aa5c33640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a9a3dec5d0 0x55a9a3dfb130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:34030/0 (socket says 172.21.15.19:34030) 2024-09-19T08:56:05.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.870+0000 7f8aa5c33640 1 -- 172.21.15.19:0/2978892509 learned_addr learned my addr 172.21.15.19:0/2978892509 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:05.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.870+0000 7f8aa6434640 1 --2- 172.21.15.19:0/2978892509 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a9a3dfb780 0x55a9a3df8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:05.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.870+0000 7f8aa5c33640 1 -- 172.21.15.19:0/2978892509 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a9a3dfb780 msgr2=0x55a9a3df8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:05.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.870+0000 7f8aa5c33640 1 --2- 172.21.15.19:0/2978892509 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a9a3dfb780 0x55a9a3df8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.870+0000 7f8aa5c33640 1 -- 172.21.15.19:0/2978892509 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a9a3dedb40 msgr2=0x55a9a3df83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:05.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.870+0000 7f8aa5c33640 1 --2- 172.21.15.19:0/2978892509 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a9a3dedb40 0x55a9a3df83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.870+0000 7f8aa5c33640 1 -- 172.21.15.19:0/2978892509 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9a3ac33c0 con 0x55a9a3dec5d0 2024-09-19T08:56:05.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.870+0000 7f8aa5432640 1 --2- 172.21.15.19:0/2978892509 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a9a3dedb40 0x55a9a3df83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:05.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.870+0000 7f8aa5c33640 1 --2- 172.21.15.19:0/2978892509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a9a3dec5d0 0x55a9a3dfb130 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c01b040 tx=0x7f8a9c00f940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fba30c952c95f7f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:05.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.870+0000 7f8a897fa640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T08:56:05.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.870+0000 7f8a897fa640 1 -- 172.21.15.19:0/2978892509 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c027020 con 0x55a9a3dec5d0 2024-09-19T08:56:05.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.870+0000 7f8aaa270740 1 -- 172.21.15.19:0/2978892509 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a9c003bd0 con 0x55a9a3dec5d0 2024-09-19T08:56:05.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.870+0000 7f8a897fa640 1 -- 172.21.15.19:0/2978892509 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f8a9c00fd40 con 0x55a9a3dec5d0 2024-09-19T08:56:05.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.871+0000 7f8a897fa640 1 -- 172.21.15.19:0/2978892509 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f8a9c003a30 con 0x55a9a3dec5d0 2024-09-19T08:56:05.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.871+0000 7f8aaa270740 10 client.25745 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:05.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.871+0000 7f8aaa270740 1 -- 172.21.15.19:0/2978892509 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55a9a3e09ed0 con 0x55a9a3dec5d0 2024-09-19T08:56:05.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.871+0000 7f8a897fa640 1 -- 172.21.15.19:0/2978892509 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a9c003bd0 con 0x55a9a3dec5d0 2024-09-19T08:56:05.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.871+0000 7f8a897fa640 1 -- 172.21.15.19:0/2978892509 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f8a9c005040 con 0x55a9a3dec5d0 2024-09-19T08:56:05.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.871+0000 7f8aaa270740 10 client.25745 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:05.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.871+0000 7f8aaa270740 10 client.25745 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:56:05.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.871+0000 7f8aaa270740 20 client.25745 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:05.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.871+0000 7f8aaa270740 1 --2- 172.21.15.19:0/2978892509 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55a9a3e0b280 0x55a9a3e0d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:05.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.872+0000 7f8aaa270740 4 client.25745 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:56:05.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.872+0000 7f8aaa270740 1 -- 172.21.15.19:0/2978892509 --> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a9a3d5f860 con 0x55a9a3e0b280 2024-09-19T08:56:05.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.872+0000 7f8aa5432640 1 --2- 172.21.15.19:0/2978892509 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55a9a3e0b280 0x55a9a3e0d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:05.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.872+0000 7f8aa5432640 1 --2- 172.21.15.19:0/2978892509 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55a9a3e0b280 0x55a9a3e0d670 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9ad4e127b0c546d server_cookie=9294e4cd9021adcd in_seq=0 out_seq=0 2024-09-19T08:56:05.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.872+0000 7f8a897fa640 10 client.25745 ms_handle_connect on v2:172.21.15.203:6838/2547507299 2024-09-19T08:56:05.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.873+0000 7f8a897fa640 1 -- 172.21.15.19:0/2978892509 <== mds.1 v2:172.21.15.203:6838/2547507299 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a9a3d5f860 con 0x55a9a3e0b280 2024-09-19T08:56:05.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.873+0000 7f8a897fa640 10 client.25745 handle_command_reply: tid=0 2024-09-19T08:56:05.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.873+0000 7f8aaa270740 1 client.25745 shutdown 2024-09-19T08:56:05.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.873+0000 7f8aaa270740 1 -- 172.21.15.19:0/2978892509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a9a3dec5d0 msgr2=0x55a9a3dfb130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:05.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.873+0000 7f8aaa270740 1 --2- 172.21.15.19:0/2978892509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a9a3dec5d0 0x55a9a3dfb130 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c01b040 tx=0x7f8a9c00f940 comp rx=0 tx=0).stop 2024-09-19T08:56:05.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.873+0000 7f8aaa270740 1 -- 172.21.15.19:0/2978892509 shutdown_connections 2024-09-19T08:56:05.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.873+0000 7f8aaa270740 1 --2- 172.21.15.19:0/2978892509 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55a9a3e0b280 0x55a9a3e0d670 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.873+0000 7f8a897fa640 0 client.25745 ms_handle_reset on v2:172.21.15.203:6838/2547507299 2024-09-19T08:56:05.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.873+0000 7f8aaa270740 1 --2- 172.21.15.19:0/2978892509 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a9a3dfb780 0x55a9a3df8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.873+0000 7f8aaa270740 1 --2- 172.21.15.19:0/2978892509 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a9a3dedb40 0x55a9a3df83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.873+0000 7f8aaa270740 1 --2- 172.21.15.19:0/2978892509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a9a3dec5d0 0x55a9a3dfb130 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.873+0000 7f8aaa270740 1 -- 172.21.15.19:0/2978892509 >> 172.21.15.19:0/2978892509 conn(0x55a9a3db5310 msgr2=0x55a9a3dee960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:05.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.873+0000 7f8aaa270740 1 -- 172.21.15.19:0/2978892509 shutdown_connections 2024-09-19T08:56:05.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.873+0000 7f8aaa270740 1 -- 172.21.15.19:0/2978892509 wait complete. 2024-09-19T08:56:05.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.873+0000 7f8aaa270740 20 client.25745 trim_cache size 0 max 16384 2024-09-19T08:56:05.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.887+0000 7f8aaa270740 1 Processor -- start 2024-09-19T08:56:05.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.887+0000 7f8aaa270740 1 -- start start 2024-09-19T08:56:05.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.887+0000 7f8aaa270740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a9a3dec5d0 0x55a9a3e07720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:05.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.888+0000 7f8aaa270740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a9a3dedb40 0x55a9a3df7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:05.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.888+0000 7f8aaa270740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a9a3dfb780 0x55a9a3e12d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:05.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.888+0000 7f8aaa270740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa01ab340 con 0x55a9a3dedb40 2024-09-19T08:56:05.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.888+0000 7f8aaa270740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa01aceb0 con 0x55a9a3dec5d0 2024-09-19T08:56:05.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.888+0000 7f8aaa270740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa01aba10 con 0x55a9a3dfb780 2024-09-19T08:56:05.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.888+0000 7f8aa5c33640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a9a3dec5d0 0x55a9a3e07720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:05.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.888+0000 7f8aa5432640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a9a3dedb40 0x55a9a3df7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:05.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.888+0000 7f8aa5c33640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a9a3dec5d0 0x55a9a3e07720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:34032/0 (socket says 172.21.15.19:34032) 2024-09-19T08:56:05.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.888+0000 7f8aa5432640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a9a3dedb40 0x55a9a3df7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54074/0 (socket says 172.21.15.19:54074) 2024-09-19T08:56:05.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.888+0000 7f8aa5c33640 1 -- 172.21.15.19:0/1006829268 learned_addr learned my addr 172.21.15.19:0/1006829268 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:05.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.888+0000 7f8aa5c33640 1 -- 172.21.15.19:0/1006829268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a9a3dfb780 msgr2=0x55a9a3e12d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:05.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.888+0000 7f8aa5c33640 1 --2- 172.21.15.19:0/1006829268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a9a3dfb780 0x55a9a3e12d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.888+0000 7f8aa5c33640 1 -- 172.21.15.19:0/1006829268 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a9a3dedb40 msgr2=0x55a9a3df7290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:05.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.888+0000 7f8aa5c33640 1 --2- 172.21.15.19:0/1006829268 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a9a3dedb40 0x55a9a3df7290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.888+0000 7f8aa5c33640 1 -- 172.21.15.19:0/1006829268 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9a3df3fd0 con 0x55a9a3dec5d0 2024-09-19T08:56:05.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.888+0000 7f8aa5c33640 1 --2- 172.21.15.19:0/1006829268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a9a3dec5d0 0x55a9a3e07720 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c00f660 tx=0x7f8a9c00f8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6d8fb92c3786ec6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:05.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.888+0000 7f8a8b7fe640 1 -- 172.21.15.19:0/1006829268 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c027040 con 0x55a9a3dec5d0 2024-09-19T08:56:05.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.889+0000 7f8a8b7fe640 1 -- 172.21.15.19:0/1006829268 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a9c009b50 con 0x55a9a3dec5d0 2024-09-19T08:56:05.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.889+0000 7f8a8b7fe640 1 -- 172.21.15.19:0/1006829268 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c005650 con 0x55a9a3dec5d0 2024-09-19T08:56:05.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.889+0000 7f8aaa270740 1 -- 172.21.15.19:0/1006829268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a9a3dec5d0 msgr2=0x55a9a3e07720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:05.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.889+0000 7f8aaa270740 1 --2- 172.21.15.19:0/1006829268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a9a3dec5d0 0x55a9a3e07720 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c00f660 tx=0x7f8a9c00f8a0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.889+0000 7f8aaa270740 1 -- 172.21.15.19:0/1006829268 shutdown_connections 2024-09-19T08:56:05.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.889+0000 7f8aaa270740 1 --2- 172.21.15.19:0/1006829268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a9a3dfb780 0x55a9a3e12d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.889+0000 7f8aaa270740 1 --2- 172.21.15.19:0/1006829268 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a9a3dedb40 0x55a9a3df7290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.889+0000 7f8aaa270740 1 --2- 172.21.15.19:0/1006829268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a9a3dec5d0 0x55a9a3e07720 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.889+0000 7f8aaa270740 1 -- 172.21.15.19:0/1006829268 >> 172.21.15.19:0/1006829268 conn(0x55a9a3db5310 msgr2=0x55a9a3df6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:05.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.889+0000 7f8aaa270740 1 -- 172.21.15.19:0/1006829268 shutdown_connections 2024-09-19T08:56:05.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.889+0000 7f8aaa270740 1 -- 172.21.15.19:0/1006829268 wait complete. 2024-09-19T08:56:05.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.890+0000 7f8aaa270740 1 -- start start 2024-09-19T08:56:05.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.890+0000 7f8aaa270740 1 Processor -- start 2024-09-19T08:56:05.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.890+0000 7f8aaa270740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a9a3dec5d0 0x55a9a3e03b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:05.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.890+0000 7f8aaa270740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a9a3dedb40 0x55a9a3e040d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:05.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.890+0000 7f8aaa270740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a9a3dfb780 0x55a9a3dfefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:05.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.890+0000 7f8aaa270740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa01ac7e0 con 0x55a9a3dec5d0 2024-09-19T08:56:05.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.890+0000 7f8aaa270740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa01ac110 con 0x55a9a3dfb780 2024-09-19T08:56:05.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.890+0000 7f8aaa270740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8aa01a9320 con 0x55a9a3dedb40 2024-09-19T08:56:05.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.890+0000 7f8aaa270740 10 client.0 _ll_register_callbacks cb 0x7f8a98009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:05.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.890+0000 7f8aa5c33640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a9a3dec5d0 0x55a9a3e03b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:05.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.890+0000 7f8aa5c33640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a9a3dec5d0 0x55a9a3e03b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54088/0 (socket says 172.21.15.19:54088) 2024-09-19T08:56:05.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.890+0000 7f8aa5c33640 1 -- 172.21.15.19:0/1855543878 learned_addr learned my addr 172.21.15.19:0/1855543878 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:05.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.891+0000 7f8aa6434640 1 --2- 172.21.15.19:0/1855543878 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a9a3dfb780 0x55a9a3dfefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:05.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.891+0000 7f8aa5432640 1 --2- 172.21.15.19:0/1855543878 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a9a3dedb40 0x55a9a3e040d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:05.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.891+0000 7f8aa5c33640 1 -- 172.21.15.19:0/1855543878 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a9a3dedb40 msgr2=0x55a9a3e040d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:05.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.891+0000 7f8aa5c33640 1 --2- 172.21.15.19:0/1855543878 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a9a3dedb40 0x55a9a3e040d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.891+0000 7f8aa5c33640 1 -- 172.21.15.19:0/1855543878 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a9a3dfb780 msgr2=0x55a9a3dfefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:05.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.891+0000 7f8aa5c33640 1 --2- 172.21.15.19:0/1855543878 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a9a3dfb780 0x55a9a3dfefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.891+0000 7f8aa5c33640 1 -- 172.21.15.19:0/1855543878 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9a3dff7e0 con 0x55a9a3dec5d0 2024-09-19T08:56:05.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.891+0000 7f8aa5432640 1 --2- 172.21.15.19:0/1855543878 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a9a3dedb40 0x55a9a3e040d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:05.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.891+0000 7f8aa5c33640 1 --2- 172.21.15.19:0/1855543878 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a9a3dec5d0 0x55a9a3e03b90 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c0053e0 tx=0x7f8a9c00ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57dfd284ef6e4a2e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:05.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.891+0000 7f8a897fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:56:05.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.891+0000 7f8a897fa640 1 -- 172.21.15.19:0/1855543878 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c027040 con 0x55a9a3dec5d0 2024-09-19T08:56:05.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.891+0000 7f8a897fa640 1 -- 172.21.15.19:0/1855543878 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f8a9c037640 con 0x55a9a3dec5d0 2024-09-19T08:56:05.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.891+0000 7f8aaa270740 1 -- 172.21.15.19:0/1855543878 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a9c009b50 con 0x55a9a3dec5d0 2024-09-19T08:56:05.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.891+0000 7f8a897fa640 1 -- 172.21.15.19:0/1855543878 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f8a9c005860 con 0x55a9a3dec5d0 2024-09-19T08:56:05.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.892+0000 7f8aaa270740 10 client.16227 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:05.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.892+0000 7f8aaa270740 1 -- 172.21.15.19:0/1855543878 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55a9a3e75910 con 0x55a9a3dec5d0 2024-09-19T08:56:05.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.892+0000 7f8a897fa640 1 -- 172.21.15.19:0/1855543878 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a9c009b50 con 0x55a9a3dec5d0 2024-09-19T08:56:05.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.892+0000 7f8a897fa640 1 -- 172.21.15.19:0/1855543878 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f8a9c035020 con 0x55a9a3dec5d0 2024-09-19T08:56:05.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.892+0000 7f8aaa270740 10 client.16227 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:05.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.892+0000 7f8aaa270740 10 client.16227 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:56:05.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.892+0000 7f8aaa270740 20 client.16227 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:05.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.892+0000 7f8aaa270740 1 --2- 172.21.15.19:0/1855543878 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55a9a3e75ec0 0x55a9a3e782b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:05.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.892+0000 7f8aaa270740 4 client.16227 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:56:05.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.892+0000 7f8aaa270740 1 -- 172.21.15.19:0/1855543878 --> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a9a3d59d70 con 0x55a9a3e75ec0 2024-09-19T08:56:05.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.892+0000 7f8aa5432640 1 --2- 172.21.15.19:0/1855543878 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55a9a3e75ec0 0x55a9a3e782b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:05.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.893+0000 7f8aa5432640 1 --2- 172.21.15.19:0/1855543878 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55a9a3e75ec0 0x55a9a3e782b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4e719a934ef18033 server_cookie=aa1b63912fe0b697 in_seq=0 out_seq=0 2024-09-19T08:56:05.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.893+0000 7f8a897fa640 10 client.16227 ms_handle_connect on v2:172.21.15.203:6838/2547507299 2024-09-19T08:56:05.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.893+0000 7f8a897fa640 1 -- 172.21.15.19:0/1855543878 <== mds.1 v2:172.21.15.203:6838/2547507299 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a9a3d59d70 con 0x55a9a3e75ec0 2024-09-19T08:56:05.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.893+0000 7f8a897fa640 10 client.16227 handle_command_reply: tid=0 2024-09-19T08:56:05.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.893+0000 7f8aaa270740 1 client.16227 shutdown 2024-09-19T08:56:05.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.893+0000 7f8aaa270740 1 -- 172.21.15.19:0/1855543878 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a9a3dec5d0 msgr2=0x55a9a3e03b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:05.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.893+0000 7f8aaa270740 1 --2- 172.21.15.19:0/1855543878 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a9a3dec5d0 0x55a9a3e03b90 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c0053e0 tx=0x7f8a9c00ff70 comp rx=0 tx=0).stop 2024-09-19T08:56:05.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.893+0000 7f8aaa270740 1 -- 172.21.15.19:0/1855543878 shutdown_connections 2024-09-19T08:56:05.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.893+0000 7f8aaa270740 1 --2- 172.21.15.19:0/1855543878 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55a9a3e75ec0 0x55a9a3e782b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.893+0000 7f8aaa270740 1 --2- 172.21.15.19:0/1855543878 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a9a3dedb40 0x55a9a3e040d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.893+0000 7f8aaa270740 1 --2- 172.21.15.19:0/1855543878 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a9a3dfb780 0x55a9a3dfefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.893+0000 7f8aaa270740 1 --2- 172.21.15.19:0/1855543878 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a9a3dec5d0 0x55a9a3e03b90 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.893+0000 7f8aaa270740 1 -- 172.21.15.19:0/1855543878 >> 172.21.15.19:0/1855543878 conn(0x55a9a3db5310 msgr2=0x55a9a3df73a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:05.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.893+0000 7f8a897fa640 0 client.16227 ms_handle_reset on v2:172.21.15.203:6838/2547507299 2024-09-19T08:56:05.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.893+0000 7f8aaa270740 1 -- 172.21.15.19:0/1855543878 shutdown_connections 2024-09-19T08:56:05.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.893+0000 7f8aaa270740 1 -- 172.21.15.19:0/1855543878 wait complete. 2024-09-19T08:56:05.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.893+0000 7f8aaa270740 20 client.16227 trim_cache size 0 max 16384 2024-09-19T08:56:05.900 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T08:56:05.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.894+0000 7f8aa7e97640 1 -- 172.21.15.19:0/1954584308 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8a8c0a3240 msgr2=0x7f8a8c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:05.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.894+0000 7f8aa7e97640 1 --2- 172.21.15.19:0/1954584308 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8a8c0a3240 0x7f8a8c0a5700 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x55a9a3de9ac0 tx=0x7f8a9400aa60 comp rx=0 tx=0).stop 2024-09-19T08:56:05.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.894+0000 7f8aa7e97640 1 -- 172.21.15.19:0/1954584308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8aa0108300 msgr2=0x7f8aa019ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:05.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.894+0000 7f8aa7e97640 1 --2- 172.21.15.19:0/1954584308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8aa0108300 0x7f8aa019ce60 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f8a98005ab0 tx=0x7f8a980040c0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.894+0000 7f8aa7e97640 1 -- 172.21.15.19:0/1954584308 shutdown_connections 2024-09-19T08:56:05.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.894+0000 7f8aa7e97640 1 --2- 172.21.15.19:0/1954584308 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8a8c0a3240 0x7f8a8c0a5700 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.894+0000 7f8aa7e97640 1 --2- 172.21.15.19:0/1954584308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8aa0108300 0x7f8aa019ce60 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.894+0000 7f8aa7e97640 1 --2- 172.21.15.19:0/1954584308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8aa0103780 0x7f8aa0198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.894+0000 7f8aa7e97640 1 --2- 172.21.15.19:0/1954584308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8aa0102dd0 0x7f8aa0198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:05.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.894+0000 7f8aa7e97640 1 -- 172.21.15.19:0/1954584308 >> 172.21.15.19:0/1954584308 conn(0x7f8aa00fc7d0 msgr2=0x7f8aa0105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:05.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.894+0000 7f8aa7e97640 1 -- 172.21.15.19:0/1954584308 shutdown_connections 2024-09-19T08:56:05.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:05.894+0000 7f8aa7e97640 1 -- 172.21.15.19:0/1954584308 wait complete. 2024-09-19T08:56:06.483 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 16.6 2024-09-19T08:56:06.483 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:56:06.676 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:56:06.781 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:06.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.817+0000 7f2e5bcba640 1 -- 172.21.15.19:0/2400070883 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e541037a0 msgr2=0x7f2e5410a030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:06.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.817+0000 7f2e5bcba640 1 --2- 172.21.15.19:0/2400070883 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e541037a0 0x7f2e5410a030 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c009ca0 tx=0x7f2e4c02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.817+0000 7f2e5bcba640 1 -- 172.21.15.19:0/2400070883 shutdown_connections 2024-09-19T08:56:06.819 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.817+0000 7f2e5bcba640 1 --2- 172.21.15.19:0/2400070883 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e54102de0 0x7f2e54103260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.819 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.817+0000 7f2e5bcba640 1 --2- 172.21.15.19:0/2400070883 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e541037a0 0x7f2e5410a030 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.819 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.817+0000 7f2e5bcba640 1 --2- 172.21.15.19:0/2400070883 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e540ffe10 0x7f2e54100210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.819 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.817+0000 7f2e5bcba640 1 -- 172.21.15.19:0/2400070883 >> 172.21.15.19:0/2400070883 conn(0x7f2e540fb930 msgr2=0x7f2e540fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:06.819 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.818+0000 7f2e5bcba640 1 -- 172.21.15.19:0/2400070883 shutdown_connections 2024-09-19T08:56:06.819 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.818+0000 7f2e5bcba640 1 -- 172.21.15.19:0/2400070883 wait complete. 2024-09-19T08:56:06.821 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.819+0000 7f2e5bcba640 1 Processor -- start 2024-09-19T08:56:06.821 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.819+0000 7f2e5bcba640 1 -- start start 2024-09-19T08:56:06.821 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.819+0000 7f2e5bcba640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e540ffe10 0x7f2e54197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:06.821 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.819+0000 7f2e5bcba640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e54102de0 0x7f2e54198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:06.821 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.819+0000 7f2e5bcba640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e541037a0 0x7f2e5419f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:06.821 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.819+0000 7f2e5bcba640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5410d7e0 con 0x7f2e540ffe10 2024-09-19T08:56:06.822 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.819+0000 7f2e5bcba640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5410d660 con 0x7f2e54102de0 2024-09-19T08:56:06.822 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.819+0000 7f2e5bcba640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5410d960 con 0x7f2e541037a0 2024-09-19T08:56:06.822 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.820+0000 7f2e59a56640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e540ffe10 0x7f2e54197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:06.822 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.820+0000 7f2e59255640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e54102de0 0x7f2e54198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:06.822 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.820+0000 7f2e59a56640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e540ffe10 0x7f2e54197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54100/0 (socket says 172.21.15.19:54100) 2024-09-19T08:56:06.822 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.820+0000 7f2e59255640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e54102de0 0x7f2e54198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:34060/0 (socket says 172.21.15.19:34060) 2024-09-19T08:56:06.822 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.820+0000 7f2e59a56640 1 -- 172.21.15.19:0/610056465 learned_addr learned my addr 172.21.15.19:0/610056465 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:06.822 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.820+0000 7f2e5a257640 1 --2- 172.21.15.19:0/610056465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e541037a0 0x7f2e5419f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:06.822 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.820+0000 7f2e59255640 1 -- 172.21.15.19:0/610056465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e541037a0 msgr2=0x7f2e5419f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:06.822 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.820+0000 7f2e59255640 1 --2- 172.21.15.19:0/610056465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e541037a0 0x7f2e5419f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.822 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.820+0000 7f2e59255640 1 -- 172.21.15.19:0/610056465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e540ffe10 msgr2=0x7f2e54197dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:06.822 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.820+0000 7f2e59255640 1 --2- 172.21.15.19:0/610056465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e540ffe10 0x7f2e54197dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.823 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.820+0000 7f2e59255640 1 -- 172.21.15.19:0/610056465 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e5419f9d0 con 0x7f2e54102de0 2024-09-19T08:56:06.823 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.820+0000 7f2e5a257640 1 --2- 172.21.15.19:0/610056465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e541037a0 0x7f2e5419f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:06.823 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.820+0000 7f2e59255640 1 --2- 172.21.15.19:0/610056465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e54102de0 0x7f2e54198300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2e4400e9f0 tx=0x7f2e4400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:06.823 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.820+0000 7f2e4affd640 1 -- 172.21.15.19:0/610056465 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4400ccc0 con 0x7f2e54102de0 2024-09-19T08:56:06.823 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.821+0000 7f2e5bcba640 1 -- 172.21.15.19:0/610056465 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e5419fcc0 con 0x7f2e54102de0 2024-09-19T08:56:06.823 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.821+0000 7f2e4affd640 1 -- 172.21.15.19:0/610056465 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e44005020 con 0x7f2e54102de0 2024-09-19T08:56:06.823 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.821+0000 7f2e4affd640 1 -- 172.21.15.19:0/610056465 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e440049e0 con 0x7f2e54102de0 2024-09-19T08:56:06.823 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.821+0000 7f2e5bcba640 1 -- 172.21.15.19:0/610056465 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e541a01c0 con 0x7f2e54102de0 2024-09-19T08:56:06.823 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.823+0000 7f2e4affd640 1 -- 172.21.15.19:0/610056465 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f2e44005560 con 0x7f2e54102de0 2024-09-19T08:56:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.824+0000 7f2e4affd640 1 --2- 172.21.15.19:0/610056465 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2e400a32f0 0x7f2e400a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:06.824 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.824+0000 7f2e4affd640 1 -- 172.21.15.19:0/610056465 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2e440cfa10 con 0x7f2e54102de0 2024-09-19T08:56:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.825+0000 7f2e59a56640 1 --2- 172.21.15.19:0/610056465 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2e400a32f0 0x7f2e400a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.825+0000 7f2e59a56640 1 --2- 172.21.15.19:0/610056465 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2e400a32f0 0x7f2e400a57b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2e54199290 tx=0x7f2e50005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.993+0000 7f2e5ea57740 1 Processor -- start 2024-09-19T08:56:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.993+0000 7f2e5ea57740 1 -- start start 2024-09-19T08:56:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.994+0000 7f2e5ea57740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b90a1ed9a0 0x55b90a1edda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.994+0000 7f2e5ea57740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b90a1ee2e0 0x55b90a1f2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.994+0000 7f2e5ea57740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b90a1f3370 0x55b90a1f5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.994+0000 7f2e5ea57740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b90a1512f0 con 0x55b90a1ee2e0 2024-09-19T08:56:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.994+0000 7f2e5ea57740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b90a0f9270 con 0x55b90a1f3370 2024-09-19T08:56:06.996 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.994+0000 7f2e5ea57740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b90a14d2b0 con 0x55b90a1ed9a0 2024-09-19T08:56:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.994+0000 7f2e59255640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b90a1ee2e0 0x55b90a1f2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.994+0000 7f2e59255640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b90a1ee2e0 0x55b90a1f2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54108/0 (socket says 172.21.15.19:54108) 2024-09-19T08:56:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.994+0000 7f2e59255640 1 -- 172.21.15.19:0/3897825193 learned_addr learned my addr 172.21.15.19:0/3897825193 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.994+0000 7f2e5a257640 1 --2- 172.21.15.19:0/3897825193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b90a1f3370 0x55b90a1f5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.994+0000 7f2e59a56640 1 --2- 172.21.15.19:0/3897825193 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b90a1ed9a0 0x55b90a1edda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.994+0000 7f2e59255640 1 -- 172.21.15.19:0/3897825193 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b90a1ed9a0 msgr2=0x55b90a1edda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.994+0000 7f2e59255640 1 --2- 172.21.15.19:0/3897825193 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b90a1ed9a0 0x55b90a1edda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.994+0000 7f2e59255640 1 -- 172.21.15.19:0/3897825193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b90a1f3370 msgr2=0x55b90a1f5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.994+0000 7f2e59255640 1 --2- 172.21.15.19:0/3897825193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b90a1f3370 0x55b90a1f5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.994+0000 7f2e59255640 1 -- 172.21.15.19:0/3897825193 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b90a0f8340 con 0x55b90a1ee2e0 2024-09-19T08:56:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.994+0000 7f2e59a56640 1 --2- 172.21.15.19:0/3897825193 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b90a1ed9a0 0x55b90a1edda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:06.997 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.994+0000 7f2e59255640 1 --2- 172.21.15.19:0/3897825193 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b90a1ee2e0 0x55b90a1f2da0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2e44098920 tx=0x7f2e4409bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb42da9dd76a718 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.995+0000 7f2e3ffff640 1 -- 172.21.15.19:0/3897825193 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4401c040 con 0x55b90a1ee2e0 2024-09-19T08:56:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.995+0000 7f2e3ffff640 1 -- 172.21.15.19:0/3897825193 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e4409bfe0 con 0x55b90a1ee2e0 2024-09-19T08:56:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.995+0000 7f2e3ffff640 1 -- 172.21.15.19:0/3897825193 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4409c4a0 con 0x55b90a1ee2e0 2024-09-19T08:56:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.995+0000 7f2e5ea57740 1 -- 172.21.15.19:0/3897825193 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b90a1ee2e0 msgr2=0x55b90a1f2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.995+0000 7f2e5ea57740 1 --2- 172.21.15.19:0/3897825193 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b90a1ee2e0 0x55b90a1f2da0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2e44098920 tx=0x7f2e4409bee0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.995+0000 7f2e5ea57740 1 -- 172.21.15.19:0/3897825193 shutdown_connections 2024-09-19T08:56:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.995+0000 7f2e5ea57740 1 --2- 172.21.15.19:0/3897825193 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b90a1f3370 0x55b90a1f5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.995+0000 7f2e5ea57740 1 --2- 172.21.15.19:0/3897825193 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b90a1ee2e0 0x55b90a1f2da0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.995+0000 7f2e5ea57740 1 --2- 172.21.15.19:0/3897825193 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b90a1ed9a0 0x55b90a1edda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.995+0000 7f2e5ea57740 1 -- 172.21.15.19:0/3897825193 >> 172.21.15.19:0/3897825193 conn(0x55b90a1e9010 msgr2=0x55b90a1e9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.996+0000 7f2e5ea57740 1 -- 172.21.15.19:0/3897825193 shutdown_connections 2024-09-19T08:56:06.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:06.996+0000 7f2e5ea57740 1 -- 172.21.15.19:0/3897825193 wait complete. 2024-09-19T08:56:07.010 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.010+0000 7f2e5ea57740 1 -- start start 2024-09-19T08:56:07.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.019+0000 7f2e5ea57740 1 Processor -- start 2024-09-19T08:56:07.021 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.020+0000 7f2e5ea57740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b90a1ed9a0 0x55b90a1f7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:07.021 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.020+0000 7f2e5ea57740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b90a1ee2e0 0x55b90a1f8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:07.021 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.020+0000 7f2e5ea57740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b90a1f3370 0x55b90a1ff1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:07.021 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.020+0000 7f2e5ea57740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b90a1f6340 con 0x55b90a1ee2e0 2024-09-19T08:56:07.021 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.020+0000 7f2e5ea57740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b90a0da290 con 0x55b90a1f3370 2024-09-19T08:56:07.021 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.020+0000 7f2e5ea57740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b90a1f64c0 con 0x55b90a1ed9a0 2024-09-19T08:56:07.021 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.020+0000 7f2e59255640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b90a1ee2e0 0x55b90a1f8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:07.022 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.020+0000 7f2e59255640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b90a1ee2e0 0x55b90a1f8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54112/0 (socket says 172.21.15.19:54112) 2024-09-19T08:56:07.022 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.020+0000 7f2e59255640 1 -- 172.21.15.19:0/3853146768 learned_addr learned my addr 172.21.15.19:0/3853146768 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:07.022 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.020+0000 7f2e5a257640 1 --2- 172.21.15.19:0/3853146768 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b90a1f3370 0x55b90a1ff1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:07.022 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.020+0000 7f2e59a56640 1 --2- 172.21.15.19:0/3853146768 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b90a1ed9a0 0x55b90a1f7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:07.022 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.020+0000 7f2e59255640 1 -- 172.21.15.19:0/3853146768 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b90a1ed9a0 msgr2=0x55b90a1f7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:07.022 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.020+0000 7f2e59255640 1 --2- 172.21.15.19:0/3853146768 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b90a1ed9a0 0x55b90a1f7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:07.022 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.020+0000 7f2e59255640 1 -- 172.21.15.19:0/3853146768 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b90a1f3370 msgr2=0x55b90a1ff1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:07.022 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.020+0000 7f2e59255640 1 --2- 172.21.15.19:0/3853146768 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b90a1f3370 0x55b90a1ff1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:07.022 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.020+0000 7f2e59255640 1 -- 172.21.15.19:0/3853146768 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b909e64210 con 0x55b90a1ee2e0 2024-09-19T08:56:07.022 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.020+0000 7f2e5a257640 1 --2- 172.21.15.19:0/3853146768 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b90a1f3370 0x55b90a1ff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:07.022 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.020+0000 7f2e59255640 1 --2- 172.21.15.19:0/3853146768 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b90a1ee2e0 0x55b90a1f8160 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f2e4409bf70 tx=0x7f2e440985c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac01b82899d1ee8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:07.022 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.020+0000 7f2e3d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:56:07.022 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.020+0000 7f2e3d7fa640 1 -- 172.21.15.19:0/3853146768 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e4401c040 con 0x55b90a1ee2e0 2024-09-19T08:56:07.023 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.021+0000 7f2e3d7fa640 1 -- 172.21.15.19:0/3853146768 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2e440a49d0 con 0x55b90a1ee2e0 2024-09-19T08:56:07.026 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.026+0000 7f2e5ea57740 10 client.0 _ll_register_callbacks cb 0x55b90a10b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:07.035 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.035+0000 7f2e5ea57740 1 -- 172.21.15.19:0/3853146768 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e4409bfe0 con 0x55b90a1ee2e0 2024-09-19T08:56:07.035 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.035+0000 7f2e3d7fa640 1 -- 172.21.15.19:0/3853146768 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f2e440a4c50 con 0x55b90a1ee2e0 2024-09-19T08:56:07.035 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.035+0000 7f2e5ea57740 10 client.16239 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:07.035 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.035+0000 7f2e5ea57740 1 -- 172.21.15.19:0/3853146768 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({fsmap=33}) -- 0x55b909f30620 con 0x55b90a1ee2e0 2024-09-19T08:56:07.064 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.064+0000 7f2e3d7fa640 1 -- 172.21.15.19:0/3853146768 <== mon.0 v2:172.21.15.19:3300/0 4 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f2e4409b430 con 0x55b90a1ee2e0 2024-09-19T08:56:07.064 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.064+0000 7f2e5ea57740 10 client.16239 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:07.064 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.064+0000 7f2e5ea57740 10 client.16239 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:56:07.076 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.076+0000 7f2e5ea57740 20 client.16239 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:07.077 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.076+0000 7f2e5ea57740 1 --2- 172.21.15.19:0/3853146768 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b90a203310 0x55b90a205700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:07.077 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.076+0000 7f2e5ea57740 4 client.16239 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:56:07.077 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.076+0000 7f2e5ea57740 1 -- 172.21.15.19:0/3853146768 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b90a15ea20 con 0x55b90a203310 2024-09-19T08:56:07.077 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.076+0000 7f2e59a56640 1 --2- 172.21.15.19:0/3853146768 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b90a203310 0x55b90a205700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:07.077 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.077+0000 7f2e3d7fa640 10 client.16239 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:07.077 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.077+0000 7f2e59a56640 1 --2- 172.21.15.19:0/3853146768 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b90a203310 0x55b90a205700 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e96370b75999c9 server_cookie=589b252100da0006 in_seq=0 out_seq=0 2024-09-19T08:56:07.079 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.078+0000 7f2e3d7fa640 1 -- 172.21.15.19:0/3853146768 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b90a15ea20 con 0x55b90a203310 2024-09-19T08:56:07.079 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.078+0000 7f2e3d7fa640 10 client.16239 handle_command_reply: tid=0 2024-09-19T08:56:07.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.079+0000 7f2e5ea57740 1 client.16239 shutdown 2024-09-19T08:56:07.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.079+0000 7f2e5ea57740 1 -- 172.21.15.19:0/3853146768 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b90a1ee2e0 msgr2=0x55b90a1f8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:07.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.079+0000 7f2e5ea57740 1 --2- 172.21.15.19:0/3853146768 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b90a1ee2e0 0x55b90a1f8160 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f2e4409bf70 tx=0x7f2e440985c0 comp rx=0 tx=0).stop 2024-09-19T08:56:07.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.079+0000 7f2e5ea57740 1 -- 172.21.15.19:0/3853146768 shutdown_connections 2024-09-19T08:56:07.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.079+0000 7f2e5ea57740 1 --2- 172.21.15.19:0/3853146768 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b90a203310 0x55b90a205700 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:07.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.079+0000 7f2e5ea57740 1 --2- 172.21.15.19:0/3853146768 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b90a1f3370 0x55b90a1ff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:07.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.079+0000 7f2e5ea57740 1 --2- 172.21.15.19:0/3853146768 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b90a1ee2e0 0x55b90a1f8160 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:07.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.079+0000 7f2e5ea57740 1 --2- 172.21.15.19:0/3853146768 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b90a1ed9a0 0x55b90a1f7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:07.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.079+0000 7f2e5ea57740 1 -- 172.21.15.19:0/3853146768 >> 172.21.15.19:0/3853146768 conn(0x55b90a1e9010 msgr2=0x55b90a1ea820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:07.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.079+0000 7f2e3d7fa640 0 client.16239 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:07.080 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.079+0000 7f2e5ea57740 1 -- 172.21.15.19:0/3853146768 shutdown_connections 2024-09-19T08:56:07.081 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.079+0000 7f2e5ea57740 1 -- 172.21.15.19:0/3853146768 wait complete. 2024-09-19T08:56:07.081 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.079+0000 7f2e5ea57740 20 client.16239 trim_cache size 0 max 16384 2024-09-19T08:56:07.100 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.098+0000 7f2e5ea57740 1 Processor -- start 2024-09-19T08:56:07.100 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.098+0000 7f2e5ea57740 1 -- start start 2024-09-19T08:56:07.100 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.099+0000 7f2e5ea57740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b90a1ed9a0 0x55b90a1f81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:07.100 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.099+0000 7f2e5ea57740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b90a1ee2e0 0x55b90a1ff160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:07.100 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.099+0000 7f2e5ea57740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b90a1f3370 0x55b90a1e80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:07.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.099+0000 7f2e5ea57740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2e541a8fc0 con 0x55b90a1f3370 2024-09-19T08:56:07.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.099+0000 7f2e5ea57740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2e541aab30 con 0x55b90a1ed9a0 2024-09-19T08:56:07.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.099+0000 7f2e5ea57740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2e541a9690 con 0x55b90a1ee2e0 2024-09-19T08:56:07.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.099+0000 7f2e5a257640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b90a1f3370 0x55b90a1e80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:07.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.099+0000 7f2e59a56640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b90a1ed9a0 0x55b90a1f81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:07.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.099+0000 7f2e59a56640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b90a1ed9a0 0x55b90a1f81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:34100/0 (socket says 172.21.15.19:34100) 2024-09-19T08:56:07.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.099+0000 7f2e5a257640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b90a1f3370 0x55b90a1e80b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54122/0 (socket says 172.21.15.19:54122) 2024-09-19T08:56:07.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.099+0000 7f2e59a56640 1 -- 172.21.15.19:0/714439477 learned_addr learned my addr 172.21.15.19:0/714439477 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:07.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.099+0000 7f2e59255640 1 --2- 172.21.15.19:0/714439477 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b90a1ee2e0 0x55b90a1ff160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:07.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.099+0000 7f2e59a56640 1 -- 172.21.15.19:0/714439477 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b90a1ee2e0 msgr2=0x55b90a1ff160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:07.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.099+0000 7f2e59a56640 1 --2- 172.21.15.19:0/714439477 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b90a1ee2e0 0x55b90a1ff160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:07.101 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.099+0000 7f2e59a56640 1 -- 172.21.15.19:0/714439477 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b90a1f3370 msgr2=0x55b90a1e80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:07.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.099+0000 7f2e59a56640 1 --2- 172.21.15.19:0/714439477 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b90a1f3370 0x55b90a1e80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:07.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.099+0000 7f2e59a56640 1 -- 172.21.15.19:0/714439477 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b90a1f6540 con 0x55b90a1ed9a0 2024-09-19T08:56:07.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.099+0000 7f2e59a56640 1 --2- 172.21.15.19:0/714439477 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b90a1ed9a0 0x55b90a1f81f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2e50009b30 tx=0x7f2e50014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df65647875bc29f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:07.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.100+0000 7f2e3f7fe640 1 -- 172.21.15.19:0/714439477 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e50003b30 con 0x55b90a1ed9a0 2024-09-19T08:56:07.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.100+0000 7f2e3f7fe640 1 -- 172.21.15.19:0/714439477 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e50003cd0 con 0x55b90a1ed9a0 2024-09-19T08:56:07.102 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.100+0000 7f2e3f7fe640 1 -- 172.21.15.19:0/714439477 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e50029890 con 0x55b90a1ed9a0 2024-09-19T08:56:07.104 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.101+0000 7f2e5ea57740 1 -- 172.21.15.19:0/714439477 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b90a1ed9a0 msgr2=0x55b90a1f81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:07.104 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.101+0000 7f2e5ea57740 1 --2- 172.21.15.19:0/714439477 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b90a1ed9a0 0x55b90a1f81f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2e50009b30 tx=0x7f2e50014000 comp rx=0 tx=0).stop 2024-09-19T08:56:07.104 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.101+0000 7f2e5ea57740 1 -- 172.21.15.19:0/714439477 shutdown_connections 2024-09-19T08:56:07.104 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.101+0000 7f2e5ea57740 1 --2- 172.21.15.19:0/714439477 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b90a1ee2e0 0x55b90a1ff160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:07.104 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.101+0000 7f2e5ea57740 1 --2- 172.21.15.19:0/714439477 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b90a1f3370 0x55b90a1e80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:07.104 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.101+0000 7f2e5ea57740 1 --2- 172.21.15.19:0/714439477 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b90a1ed9a0 0x55b90a1f81f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:07.104 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.101+0000 7f2e5ea57740 1 -- 172.21.15.19:0/714439477 >> 172.21.15.19:0/714439477 conn(0x55b90a1e9010 msgr2=0x55b90a1e79a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:07.104 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.101+0000 7f2e5ea57740 1 -- 172.21.15.19:0/714439477 shutdown_connections 2024-09-19T08:56:07.104 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.101+0000 7f2e5ea57740 1 -- 172.21.15.19:0/714439477 wait complete. 2024-09-19T08:56:07.104 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.101+0000 7f2e5ea57740 1 -- start start 2024-09-19T08:56:07.104 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.101+0000 7f2e5ea57740 1 Processor -- start 2024-09-19T08:56:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.102+0000 7f2e5ea57740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b90a1ed9a0 0x55b90a1fc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.102+0000 7f2e5ea57740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b90a1ee2e0 0x55b90a1fcd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.102+0000 7f2e5ea57740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b90a1f3370 0x55b90a1fdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.102+0000 7f2e59a56640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b90a1ed9a0 0x55b90a1fc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.102+0000 7f2e5ea57740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2e541aa460 con 0x55b90a1ed9a0 2024-09-19T08:56:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.102+0000 7f2e59255640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b90a1ee2e0 0x55b90a1fcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.102+0000 7f2e59a56640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b90a1ed9a0 0x55b90a1fc7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54124/0 (socket says 172.21.15.19:54124) 2024-09-19T08:56:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.102+0000 7f2e59a56640 1 -- 172.21.15.19:0/3594466935 learned_addr learned my addr 172.21.15.19:0/3594466935 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.102+0000 7f2e59255640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b90a1ee2e0 0x55b90a1fcd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:34108/0 (socket says 172.21.15.19:34108) 2024-09-19T08:56:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.102+0000 7f2e5ea57740 1 -- 172.21.15.19:0/3594466935 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2e541a9d90 con 0x55b90a1ee2e0 2024-09-19T08:56:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.102+0000 7f2e5ea57740 1 -- 172.21.15.19:0/3594466935 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2e541a6f30 con 0x55b90a1f3370 2024-09-19T08:56:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.103+0000 7f2e5a257640 1 --2- 172.21.15.19:0/3594466935 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b90a1f3370 0x55b90a1fdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:07.105 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.103+0000 7f2e5ea57740 10 client.0 _ll_register_callbacks cb 0x7f2e440b3070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:07.106 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.103+0000 7f2e59a56640 1 -- 172.21.15.19:0/3594466935 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b90a1f3370 msgr2=0x55b90a1fdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:07.106 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.103+0000 7f2e59a56640 1 --2- 172.21.15.19:0/3594466935 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b90a1f3370 0x55b90a1fdd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:07.106 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.103+0000 7f2e59a56640 1 -- 172.21.15.19:0/3594466935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b90a1ee2e0 msgr2=0x55b90a1fcd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:07.106 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.103+0000 7f2e59a56640 1 --2- 172.21.15.19:0/3594466935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b90a1ee2e0 0x55b90a1fcd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:07.106 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.103+0000 7f2e59a56640 1 -- 172.21.15.19:0/3594466935 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b90a1fe320 con 0x55b90a1ed9a0 2024-09-19T08:56:07.106 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.103+0000 7f2e59255640 1 --2- 172.21.15.19:0/3594466935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b90a1ee2e0 0x55b90a1fcd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:07.106 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.103+0000 7f2e59a56640 1 --2- 172.21.15.19:0/3594466935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b90a1ed9a0 0x55b90a1fc7c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f2e5002bd00 tx=0x7f2e5002bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc0d7a5a0184de39 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:07.106 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.103+0000 7f2e3d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:56:07.107 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.103+0000 7f2e3d7fa640 1 -- 172.21.15.19:0/3594466935 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e50005250 con 0x55b90a1ed9a0 2024-09-19T08:56:07.107 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.103+0000 7f2e3d7fa640 1 -- 172.21.15.19:0/3594466935 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2e500053f0 con 0x55b90a1ed9a0 2024-09-19T08:56:07.107 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.103+0000 7f2e5ea57740 1 -- 172.21.15.19:0/3594466935 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2e50003cd0 con 0x55b90a1ed9a0 2024-09-19T08:56:07.107 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.104+0000 7f2e3d7fa640 1 -- 172.21.15.19:0/3594466935 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f2e500055f0 con 0x55b90a1ed9a0 2024-09-19T08:56:07.107 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.104+0000 7f2e5ea57740 10 client.16245 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:07.107 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.104+0000 7f2e5ea57740 1 -- 172.21.15.19:0/3594466935 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55b90a26de10 con 0x55b90a1ed9a0 2024-09-19T08:56:07.107 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.104+0000 7f2e3d7fa640 1 -- 172.21.15.19:0/3594466935 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e50003cd0 con 0x55b90a1ed9a0 2024-09-19T08:56:07.107 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.104+0000 7f2e3d7fa640 1 -- 172.21.15.19:0/3594466935 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f2e50028070 con 0x55b90a1ed9a0 2024-09-19T08:56:07.107 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.104+0000 7f2e5ea57740 10 client.16245 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:07.107 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.104+0000 7f2e5ea57740 10 client.16245 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:56:07.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.104+0000 7f2e5ea57740 20 client.16245 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:07.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.104+0000 7f2e5ea57740 1 --2- 172.21.15.19:0/3594466935 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b90a26e670 0x55b90a270a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:07.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.104+0000 7f2e5ea57740 4 client.16245 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:56:07.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.104+0000 7f2e5ea57740 1 -- 172.21.15.19:0/3594466935 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b90a158d70 con 0x55b90a26e670 2024-09-19T08:56:07.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.104+0000 7f2e59255640 1 --2- 172.21.15.19:0/3594466935 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b90a26e670 0x55b90a270a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:07.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.105+0000 7f2e59255640 1 --2- 172.21.15.19:0/3594466935 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b90a26e670 0x55b90a270a90 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4bf83da1fd867ca server_cookie=476e7ff9316eb8d8 in_seq=0 out_seq=0 2024-09-19T08:56:07.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.105+0000 7f2e3d7fa640 10 client.16245 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:07.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.338+0000 7fd64a31e640 1 -- 172.21.15.19:0/1593838047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd644102df0 msgr2=0x7fd6441031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:07.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.338+0000 7fd64a31e640 1 --2- 172.21.15.19:0/1593838047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd644102df0 0x7fd6441031d0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fd634009900 tx=0x7fd63402a410 comp rx=0 tx=0).stop 2024-09-19T08:56:07.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.338+0000 7fd64a31e640 1 -- 172.21.15.19:0/1593838047 shutdown_connections 2024-09-19T08:56:07.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.338+0000 7fd64a31e640 1 --2- 172.21.15.19:0/1593838047 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd6441037a0 0x7fd64410bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:07.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.338+0000 7fd64a31e640 1 --2- 172.21.15.19:0/1593838047 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd64410c2f0 0x7fd64410e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:07.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.338+0000 7fd64a31e640 1 --2- 172.21.15.19:0/1593838047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd644102df0 0x7fd6441031d0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:07.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.338+0000 7fd64a31e640 1 -- 172.21.15.19:0/1593838047 >> 172.21.15.19:0/1593838047 conn(0x7fd6440fc7d0 msgr2=0x7fd6440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:07.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.338+0000 7fd64a31e640 1 -- 172.21.15.19:0/1593838047 shutdown_connections 2024-09-19T08:56:07.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.338+0000 7fd64a31e640 1 -- 172.21.15.19:0/1593838047 wait complete. 2024-09-19T08:56:07.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.338+0000 7fd64a31e640 1 Processor -- start 2024-09-19T08:56:07.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.339+0000 7fd64a31e640 1 -- start start 2024-09-19T08:56:07.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.339+0000 7fd64a31e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd644102df0 0x7fd644198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:07.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.339+0000 7fd64a31e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd6441037a0 0x7fd644198b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:07.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.339+0000 7fd64a31e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd64410c2f0 0x7fd64419cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:07.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.339+0000 7fd64a31e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd6441120f0 con 0x7fd644102df0 2024-09-19T08:56:07.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.339+0000 7fd64a31e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd644111f70 con 0x7fd64410c2f0 2024-09-19T08:56:07.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.339+0000 7fd64a31e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd644112270 con 0x7fd6441037a0 2024-09-19T08:56:07.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.339+0000 7fd643fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd644102df0 0x7fd644198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:07.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.339+0000 7fd643fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd644102df0 0x7fd644198610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54146/0 (socket says 172.21.15.19:54146) 2024-09-19T08:56:07.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.339+0000 7fd643fff640 1 -- 172.21.15.19:0/3117422564 learned_addr learned my addr 172.21.15.19:0/3117422564 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:07.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.339+0000 7fd6488bb640 1 --2- 172.21.15.19:0/3117422564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd64410c2f0 0x7fd64419cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:07.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.339+0000 7fd6437fe640 1 --2- 172.21.15.19:0/3117422564 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd6441037a0 0x7fd644198b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:07.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.339+0000 7fd643fff640 1 -- 172.21.15.19:0/3117422564 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd6441037a0 msgr2=0x7fd644198b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:07.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.339+0000 7fd643fff640 1 --2- 172.21.15.19:0/3117422564 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd6441037a0 0x7fd644198b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:07.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.339+0000 7fd643fff640 1 -- 172.21.15.19:0/3117422564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd64410c2f0 msgr2=0x7fd64419cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:07.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.339+0000 7fd643fff640 1 --2- 172.21.15.19:0/3117422564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd64410c2f0 0x7fd64419cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:07.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.339+0000 7fd643fff640 1 -- 172.21.15.19:0/3117422564 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd64419d5c0 con 0x7fd644102df0 2024-09-19T08:56:07.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.339+0000 7fd6437fe640 1 --2- 172.21.15.19:0/3117422564 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd6441037a0 0x7fd644198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:07.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.339+0000 7fd6488bb640 1 --2- 172.21.15.19:0/3117422564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd64410c2f0 0x7fd64419cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:07.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.340+0000 7fd643fff640 1 --2- 172.21.15.19:0/3117422564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd644102df0 0x7fd644198610 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fd634006010 tx=0x7fd6340042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:07.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.340+0000 7fd6417fa640 1 -- 172.21.15.19:0/3117422564 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd63403f030 con 0x7fd644102df0 2024-09-19T08:56:07.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.340+0000 7fd6417fa640 1 -- 172.21.15.19:0/3117422564 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd634003ce0 con 0x7fd644102df0 2024-09-19T08:56:07.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.340+0000 7fd6417fa640 1 -- 172.21.15.19:0/3117422564 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd634035070 con 0x7fd644102df0 2024-09-19T08:56:07.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.340+0000 7fd64a31e640 1 -- 172.21.15.19:0/3117422564 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd64419d850 con 0x7fd644102df0 2024-09-19T08:56:07.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.340+0000 7fd64a31e640 1 -- 172.21.15.19:0/3117422564 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd64419dce0 con 0x7fd644102df0 2024-09-19T08:56:07.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.341+0000 7fd64a31e640 1 -- 172.21.15.19:0/3117422564 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6441031d0 con 0x7fd644102df0 2024-09-19T08:56:07.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.342+0000 7fd6417fa640 1 -- 172.21.15.19:0/3117422564 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fd634042030 con 0x7fd644102df0 2024-09-19T08:56:07.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.343+0000 7fd6417fa640 1 --2- 172.21.15.19:0/3117422564 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd62c0a3240 0x7fd62c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:07.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.343+0000 7fd6437fe640 1 --2- 172.21.15.19:0/3117422564 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd62c0a3240 0x7fd62c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:07.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.343+0000 7fd6417fa640 1 -- 172.21.15.19:0/3117422564 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd6340eff40 con 0x7fd644102df0 2024-09-19T08:56:07.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.344+0000 7fd6437fe640 1 --2- 172.21.15.19:0/3117422564 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd62c0a3240 0x7fd62c0a5700 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd644100280 tx=0x7fd63800a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:07.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.348+0000 7fd6417fa640 1 -- 172.21.15.19:0/3117422564 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd6340bccd0 con 0x7fd644102df0 2024-09-19T08:56:07.394 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:07.521 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:07 smithi019 ceph-mon[30976]: pgmap v454: 97 pgs: 97 active+clean; 1.6 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 KiB/s wr, 20 op/s 2024-09-19T08:56:07.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:07 smithi155 ceph-mon[34921]: pgmap v454: 97 pgs: 97 active+clean; 1.6 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 KiB/s wr, 20 op/s 2024-09-19T08:56:07.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.687+0000 7fd64a31e640 1 -- 172.21.15.19:0/3117422564 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6441072c0 con 0x7fd644102df0 2024-09-19T08:56:07.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.691+0000 7fd6417fa640 1 -- 172.21.15.19:0/3117422564 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11984 (secure 0 0 0) 0x7fd6340bc5d0 con 0x7fd644102df0 2024-09-19T08:56:07.692 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:56:07.692 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":33,"btime":"2024-09-19T08:55:57:276679+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2452068876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2452068876},{"type":"v1","addr":"172.21.15.19:6839","nonce":2452068876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T08:55:56.383946+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/2480841559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2480841559},{"type":"v1","addr":"172.21.15.155:6835","nonce":2480841559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24469,24490,24464,24463]},"id":1}]} 2024-09-19T08:56:07.693 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 33 2024-09-19T08:56:07.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.697+0000 7fd64a31e640 1 -- 172.21.15.19:0/3117422564 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd62c0a3240 msgr2=0x7fd62c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:07.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.697+0000 7fd64a31e640 1 --2- 172.21.15.19:0/3117422564 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd62c0a3240 0x7fd62c0a5700 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd644100280 tx=0x7fd63800a5c0 comp rx=0 tx=0).stop 2024-09-19T08:56:07.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.697+0000 7fd64a31e640 1 -- 172.21.15.19:0/3117422564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd644102df0 msgr2=0x7fd644198610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:07.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.697+0000 7fd64a31e640 1 --2- 172.21.15.19:0/3117422564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd644102df0 0x7fd644198610 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fd634006010 tx=0x7fd6340042f0 comp rx=0 tx=0).stop 2024-09-19T08:56:07.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.699+0000 7fd64a31e640 1 -- 172.21.15.19:0/3117422564 shutdown_connections 2024-09-19T08:56:07.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.699+0000 7fd64a31e640 1 --2- 172.21.15.19:0/3117422564 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd62c0a3240 0x7fd62c0a5700 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:07.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.699+0000 7fd64a31e640 1 --2- 172.21.15.19:0/3117422564 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd6441037a0 0x7fd644198b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:07.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.699+0000 7fd64a31e640 1 --2- 172.21.15.19:0/3117422564 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd64410c2f0 0x7fd64419cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:07.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.699+0000 7fd64a31e640 1 --2- 172.21.15.19:0/3117422564 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd644102df0 0x7fd644198610 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:07.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.699+0000 7fd64a31e640 1 -- 172.21.15.19:0/3117422564 >> 172.21.15.19:0/3117422564 conn(0x7fd6440fc7d0 msgr2=0x7fd6440fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:07.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.700+0000 7fd64a31e640 1 -- 172.21.15.19:0/3117422564 shutdown_connections 2024-09-19T08:56:07.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:07.700+0000 7fd64a31e640 1 -- 172.21.15.19:0/3117422564 wait complete. 2024-09-19T08:56:07.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:07 smithi203 ceph-mon[35450]: pgmap v454: 97 pgs: 97 active+clean; 1.6 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 31 KiB/s wr, 20 op/s 2024-09-19T08:56:07.822 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.821+0000 7f2e3d7fa640 1 -- 172.21.15.19:0/3594466935 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b90a158d70 con 0x55b90a26e670 2024-09-19T08:56:07.822 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.821+0000 7f2e3d7fa640 10 client.16245 handle_command_reply: tid=0 2024-09-19T08:56:07.822 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.821+0000 7f2e5ea57740 1 client.16245 shutdown 2024-09-19T08:56:07.822 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.821+0000 7f2e5ea57740 1 -- 172.21.15.19:0/3594466935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b90a1ed9a0 msgr2=0x55b90a1fc7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:07.823 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.821+0000 7f2e5ea57740 1 --2- 172.21.15.19:0/3594466935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b90a1ed9a0 0x55b90a1fc7c0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f2e5002bd00 tx=0x7f2e5002bd30 comp rx=0 tx=0).stop 2024-09-19T08:56:07.823 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.822+0000 7f2e5ea57740 1 -- 172.21.15.19:0/3594466935 shutdown_connections 2024-09-19T08:56:07.823 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.822+0000 7f2e5ea57740 1 --2- 172.21.15.19:0/3594466935 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b90a26e670 0x55b90a270a90 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:07.823 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.822+0000 7f2e5ea57740 1 --2- 172.21.15.19:0/3594466935 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b90a1f3370 0x55b90a1fdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:07.823 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.822+0000 7f2e5ea57740 1 --2- 172.21.15.19:0/3594466935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b90a1ee2e0 0x55b90a1fcd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:07.823 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.822+0000 7f2e5ea57740 1 --2- 172.21.15.19:0/3594466935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b90a1ed9a0 0x55b90a1fc7c0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:07.823 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.822+0000 7f2e5ea57740 1 -- 172.21.15.19:0/3594466935 >> 172.21.15.19:0/3594466935 conn(0x55b90a1e9010 msgr2=0x55b90a1e81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:07.823 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.822+0000 7f2e3d7fa640 0 client.16245 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:07.823 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.822+0000 7f2e5ea57740 1 -- 172.21.15.19:0/3594466935 shutdown_connections 2024-09-19T08:56:07.823 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.822+0000 7f2e5ea57740 1 -- 172.21.15.19:0/3594466935 wait complete. 2024-09-19T08:56:07.823 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.822+0000 7f2e5ea57740 20 client.16245 trim_cache size 0 max 16384 2024-09-19T08:56:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T08:56:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T08:56:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T08:56:07.824 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T08:56:07.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.822+0000 7f2e5bcba640 1 -- 172.21.15.19:0/610056465 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2e400a32f0 msgr2=0x7f2e400a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:07.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.822+0000 7f2e5bcba640 1 --2- 172.21.15.19:0/610056465 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2e400a32f0 0x7f2e400a57b0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2e54199290 tx=0x7f2e50005f90 comp rx=0 tx=0).stop 2024-09-19T08:56:07.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.822+0000 7f2e5bcba640 1 -- 172.21.15.19:0/610056465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e54102de0 msgr2=0x7f2e54198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:07.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.822+0000 7f2e5bcba640 1 --2- 172.21.15.19:0/610056465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e54102de0 0x7f2e54198300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2e4400e9f0 tx=0x7f2e4400eeb0 comp rx=0 tx=0).stop 2024-09-19T08:56:07.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.823+0000 7f2e5bcba640 1 -- 172.21.15.19:0/610056465 shutdown_connections 2024-09-19T08:56:07.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.823+0000 7f2e5bcba640 1 --2- 172.21.15.19:0/610056465 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2e400a32f0 0x7f2e400a57b0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:07.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.823+0000 7f2e5bcba640 1 --2- 172.21.15.19:0/610056465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e541037a0 0x7f2e5419f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:07.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.823+0000 7f2e5bcba640 1 --2- 172.21.15.19:0/610056465 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e54102de0 0x7f2e54198300 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:07.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.823+0000 7f2e5bcba640 1 --2- 172.21.15.19:0/610056465 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e540ffe10 0x7f2e54197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:07.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.823+0000 7f2e5bcba640 1 -- 172.21.15.19:0/610056465 >> 172.21.15.19:0/610056465 conn(0x7f2e540fb930 msgr2=0x7f2e541060e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:07.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.823+0000 7f2e5bcba640 1 -- 172.21.15.19:0/610056465 shutdown_connections 2024-09-19T08:56:07.825 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:07.823+0000 7f2e5bcba640 1 -- 172.21.15.19:0/610056465 wait complete. 2024-09-19T08:56:08.461 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0' 2024-09-19T08:56:08.461 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db / --timeout 90 --expiration 136.6 --await-for 45.0 2024-09-19T08:56:08.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:08 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3117422564' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:08.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:08 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3117422564' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:08.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.688+0000 7fcc900a3640 1 -- 172.21.15.19:0/2671085650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc88102d90 msgr2=0x7fcc88103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:08.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.688+0000 7fcc900a3640 1 --2- 172.21.15.19:0/2671085650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc88102d90 0x7fcc88103170 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fcc84009900 tx=0x7fcc8402a480 comp rx=0 tx=0).stop 2024-09-19T08:56:08.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.688+0000 7fcc900a3640 1 -- 172.21.15.19:0/2671085650 shutdown_connections 2024-09-19T08:56:08.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.688+0000 7fcc900a3640 1 --2- 172.21.15.19:0/2671085650 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc881036b0 0x7fcc8810bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.688+0000 7fcc900a3640 1 --2- 172.21.15.19:0/2671085650 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc8810c170 0x7fcc8810e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.688+0000 7fcc900a3640 1 --2- 172.21.15.19:0/2671085650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc88102d90 0x7fcc88103170 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.688+0000 7fcc900a3640 1 -- 172.21.15.19:0/2671085650 >> 172.21.15.19:0/2671085650 conn(0x7fcc880fc790 msgr2=0x7fcc880febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:08.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.688+0000 7fcc900a3640 1 -- 172.21.15.19:0/2671085650 shutdown_connections 2024-09-19T08:56:08.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.688+0000 7fcc900a3640 1 -- 172.21.15.19:0/2671085650 wait complete. 2024-09-19T08:56:08.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.689+0000 7fcc900a3640 1 Processor -- start 2024-09-19T08:56:08.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.689+0000 7fcc900a3640 1 -- start start 2024-09-19T08:56:08.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.689+0000 7fcc900a3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc88102d90 0x7fcc881009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:08.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.689+0000 7fcc900a3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc881036b0 0x7fcc88100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:08.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.689+0000 7fcc900a3640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc8810c170 0x7fcc88101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:08.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.689+0000 7fcc900a3640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcc88111f50 con 0x7fcc88102d90 2024-09-19T08:56:08.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.689+0000 7fcc900a3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcc88111dd0 con 0x7fcc881036b0 2024-09-19T08:56:08.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.689+0000 7fcc900a3640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcc881120d0 con 0x7fcc8810c170 2024-09-19T08:56:08.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.689+0000 7fcc8d63e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc881036b0 0x7fcc88100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:08.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.689+0000 7fcc8d63e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc881036b0 0x7fcc88100f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:34148/0 (socket says 172.21.15.19:34148) 2024-09-19T08:56:08.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.689+0000 7fcc8d63e640 1 -- 172.21.15.19:0/3581077406 learned_addr learned my addr 172.21.15.19:0/3581077406 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:08.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.690+0000 7fcc8de3f640 1 --2- 172.21.15.19:0/3581077406 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc88102d90 0x7fcc881009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:08.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.690+0000 7fcc8e640640 1 --2- 172.21.15.19:0/3581077406 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc8810c170 0x7fcc88101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:08.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.690+0000 7fcc8d63e640 1 -- 172.21.15.19:0/3581077406 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc8810c170 msgr2=0x7fcc88101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:08.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.690+0000 7fcc8d63e640 1 --2- 172.21.15.19:0/3581077406 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc8810c170 0x7fcc88101470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.690+0000 7fcc8d63e640 1 -- 172.21.15.19:0/3581077406 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc88102d90 msgr2=0x7fcc881009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:08.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.690+0000 7fcc8d63e640 1 --2- 172.21.15.19:0/3581077406 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc88102d90 0x7fcc881009f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.690+0000 7fcc8d63e640 1 -- 172.21.15.19:0/3581077406 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc881a6850 con 0x7fcc881036b0 2024-09-19T08:56:08.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.690+0000 7fcc8d63e640 1 --2- 172.21.15.19:0/3581077406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc881036b0 0x7fcc88100f30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcc7800c920 tx=0x7fcc7800cde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:08.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.690+0000 7fcc7effd640 1 -- 172.21.15.19:0/3581077406 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc78007c70 con 0x7fcc881036b0 2024-09-19T08:56:08.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.690+0000 7fcc900a3640 1 -- 172.21.15.19:0/3581077406 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc881a6b40 con 0x7fcc881036b0 2024-09-19T08:56:08.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.690+0000 7fcc7effd640 1 -- 172.21.15.19:0/3581077406 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc78007e10 con 0x7fcc881036b0 2024-09-19T08:56:08.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.690+0000 7fcc900a3640 1 -- 172.21.15.19:0/3581077406 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc881a70d0 con 0x7fcc881036b0 2024-09-19T08:56:08.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.690+0000 7fcc7effd640 1 -- 172.21.15.19:0/3581077406 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc78018890 con 0x7fcc881036b0 2024-09-19T08:56:08.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.692+0000 7fcc7effd640 1 -- 172.21.15.19:0/3581077406 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fcc78018b30 con 0x7fcc881036b0 2024-09-19T08:56:08.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.693+0000 7fcc9247c740 1 Processor -- start 2024-09-19T08:56:08.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.693+0000 7fcc9247c740 1 -- start start 2024-09-19T08:56:08.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.693+0000 7fcc7effd640 1 --2- 172.21.15.19:0/3581077406 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fcc740a32c0 0x7fcc740a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:08.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.694+0000 7fcc8e640640 1 --2- 172.21.15.19:0/3581077406 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fcc740a32c0 0x7fcc740a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:08.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.694+0000 7fcc9247c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a459403b40 0x55a459402090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:08.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.694+0000 7fcc9247c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a4594025d0 0x55a459402a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:08.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.694+0000 7fcc9247c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a45940d370 0x55a45940f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:08.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.694+0000 7fcc9247c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a4593682f0 con 0x55a459403b40 2024-09-19T08:56:08.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.694+0000 7fcc9247c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55a45930fcf0 con 0x55a45940d370 2024-09-19T08:56:08.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.694+0000 7fcc9247c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a4593642b0 con 0x55a4594025d0 2024-09-19T08:56:08.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.694+0000 7fcc7effd640 1 -- 172.21.15.19:0/3581077406 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fcc780cfad0 con 0x7fcc881036b0 2024-09-19T08:56:08.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.694+0000 7fcc8de3f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a459403b40 0x55a459402090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:08.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.694+0000 7fcc8de3f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a459403b40 0x55a459402090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54172/0 (socket says 172.21.15.19:54172) 2024-09-19T08:56:08.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.694+0000 7fcc8de3f640 1 -- 172.21.15.19:0/225612796 learned_addr learned my addr 172.21.15.19:0/225612796 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:08.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.694+0000 7fcc8d63e640 1 --2- 172.21.15.19:0/225612796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a4594025d0 0x55a459402a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:08.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.694+0000 7fcc8de3f640 1 -- 172.21.15.19:0/225612796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a4594025d0 msgr2=0x55a459402a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:08.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.694+0000 7fcc8de3f640 1 --2- 172.21.15.19:0/225612796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a4594025d0 0x55a459402a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.694+0000 7fcc8de3f640 1 -- 172.21.15.19:0/225612796 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a45940d370 msgr2=0x55a45940f760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T08:56:08.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.694+0000 7fcc8de3f640 1 --2- 172.21.15.19:0/225612796 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a45940d370 0x55a45940f760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.694+0000 7fcc8de3f640 1 -- 172.21.15.19:0/225612796 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4592f43a0 con 0x55a459403b40 2024-09-19T08:56:08.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.694+0000 7fcc8d63e640 1 --2- 172.21.15.19:0/225612796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a4594025d0 0x55a459402a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:08.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.695+0000 7fcc8de3f640 1 --2- 172.21.15.19:0/225612796 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a459403b40 0x55a459402090 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fcc84006010 tx=0x7fcc84031510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebb4ba021d708e7d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:08.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.695+0000 7fcc8e640640 1 --2- 172.21.15.19:0/3581077406 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fcc740a32c0 0x7fcc740a5780 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x55a459403070 tx=0x7fcc80009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:08.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.695+0000 7fcc73fff640 1 -- 172.21.15.19:0/225612796 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc8403f070 con 0x55a459403b40 2024-09-19T08:56:08.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.695+0000 7fcc73fff640 1 -- 172.21.15.19:0/225612796 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc84004030 con 0x55a459403b40 2024-09-19T08:56:08.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.695+0000 7fcc73fff640 1 -- 172.21.15.19:0/225612796 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc84035070 con 0x55a459403b40 2024-09-19T08:56:08.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.696+0000 7fcc9247c740 1 -- 172.21.15.19:0/225612796 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a459403b40 msgr2=0x55a459402090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:08.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.696+0000 7fcc9247c740 1 --2- 172.21.15.19:0/225612796 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a459403b40 0x55a459402090 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fcc84006010 tx=0x7fcc84031510 comp rx=0 tx=0).stop 2024-09-19T08:56:08.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.696+0000 7fcc9247c740 1 -- 172.21.15.19:0/225612796 shutdown_connections 2024-09-19T08:56:08.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.696+0000 7fcc9247c740 1 --2- 172.21.15.19:0/225612796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a4594025d0 0x55a459402a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.696+0000 7fcc9247c740 1 --2- 172.21.15.19:0/225612796 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a45940d370 0x55a45940f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.696+0000 7fcc9247c740 1 --2- 172.21.15.19:0/225612796 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a459403b40 0x55a459402090 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.696+0000 7fcc9247c740 1 -- 172.21.15.19:0/225612796 >> 172.21.15.19:0/225612796 conn(0x55a4593cb310 msgr2=0x55a4593fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:08.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.697+0000 7fcc9247c740 1 -- 172.21.15.19:0/225612796 shutdown_connections 2024-09-19T08:56:08.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.697+0000 7fcc9247c740 1 -- 172.21.15.19:0/225612796 wait complete. 2024-09-19T08:56:08.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.697+0000 7fcc9247c740 1 -- start start 2024-09-19T08:56:08.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.697+0000 7fcc9247c740 1 Processor -- start 2024-09-19T08:56:08.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.698+0000 7fcc9247c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a4594025d0 0x55a45940cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:08.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.698+0000 7fcc9247c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a459403b40 0x55a45940a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:08.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.698+0000 7fcc9247c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a45940d370 0x55a45940a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:08.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.698+0000 7fcc9247c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a459410010 con 0x55a459403b40 2024-09-19T08:56:08.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.698+0000 7fcc9247c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55a459323060 con 0x55a4594025d0 2024-09-19T08:56:08.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.698+0000 7fcc9247c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a459410190 con 0x55a45940d370 2024-09-19T08:56:08.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.698+0000 7fcc8d63e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a459403b40 0x55a45940a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:08.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.698+0000 7fcc8de3f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a4594025d0 0x55a45940cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:08.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.698+0000 7fcc8de3f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a4594025d0 0x55a45940cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:34158/0 (socket says 172.21.15.19:34158) 2024-09-19T08:56:08.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.698+0000 7fcc8d63e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a459403b40 0x55a45940a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54186/0 (socket says 172.21.15.19:54186) 2024-09-19T08:56:08.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.698+0000 7fcc8de3f640 1 -- 172.21.15.19:0/1888218748 learned_addr learned my addr 172.21.15.19:0/1888218748 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:08.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.698+0000 7fcc8e640640 1 --2- 172.21.15.19:0/1888218748 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a45940d370 0x55a45940a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:08.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.698+0000 7fcc9247c740 10 client.0 _ll_register_callbacks cb 0x55a4590768c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:08.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.698+0000 7fcc8d63e640 1 -- 172.21.15.19:0/1888218748 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a45940d370 msgr2=0x55a45940a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:08.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.698+0000 7fcc8d63e640 1 --2- 172.21.15.19:0/1888218748 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a45940d370 0x55a45940a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.698+0000 7fcc8d63e640 1 -- 172.21.15.19:0/1888218748 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a4594025d0 msgr2=0x55a45940cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:08.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.698+0000 7fcc8d63e640 1 --2- 172.21.15.19:0/1888218748 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a4594025d0 0x55a45940cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.698+0000 7fcc8d63e640 1 -- 172.21.15.19:0/1888218748 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4590d93c0 con 0x55a459403b40 2024-09-19T08:56:08.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.698+0000 7fcc8de3f640 1 --2- 172.21.15.19:0/1888218748 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a4594025d0 0x55a45940cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:08.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.698+0000 7fcc8d63e640 1 --2- 172.21.15.19:0/1888218748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a459403b40 0x55a45940a010 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fcc7809c030 tx=0x7fcc7809c160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422f718168cd1cc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:08.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.698+0000 7fcc717fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:56:08.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.699+0000 7fcc717fa640 1 -- 172.21.15.19:0/1888218748 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc780b5070 con 0x55a459403b40 2024-09-19T08:56:08.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.699+0000 7fcc717fa640 1 -- 172.21.15.19:0/1888218748 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fcc780bc0b0 con 0x55a459403b40 2024-09-19T08:56:08.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.699+0000 7fcc9247c740 1 -- 172.21.15.19:0/1888218748 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc84004030 con 0x55a459403b40 2024-09-19T08:56:08.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.699+0000 7fcc717fa640 1 -- 172.21.15.19:0/1888218748 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fcc7800fb30 con 0x55a459403b40 2024-09-19T08:56:08.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.699+0000 7fcc9247c740 10 client.16260 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:08.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.699+0000 7fcc9247c740 1 -- 172.21.15.19:0/1888218748 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55a45941baf0 con 0x55a459403b40 2024-09-19T08:56:08.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.699+0000 7fcc717fa640 1 -- 172.21.15.19:0/1888218748 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc84004030 con 0x55a459403b40 2024-09-19T08:56:08.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.699+0000 7fcc717fa640 1 -- 172.21.15.19:0/1888218748 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7fcc780bace0 con 0x55a459403b40 2024-09-19T08:56:08.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.699+0000 7fcc9247c740 10 client.16260 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:08.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.699+0000 7fcc9247c740 10 client.16260 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:56:08.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.699+0000 7fcc9247c740 20 client.16260 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:08.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.699+0000 7fcc9247c740 1 --2- 172.21.15.19:0/1888218748 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a45941d300 0x55a45941f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:08.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.699+0000 7fcc9247c740 4 client.16260 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:56:08.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.699+0000 7fcc9247c740 1 -- 172.21.15.19:0/1888218748 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a459375860 con 0x55a45941d300 2024-09-19T08:56:08.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.699+0000 7fcc8de3f640 1 --2- 172.21.15.19:0/1888218748 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a45941d300 0x55a45941f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:08.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.700+0000 7fcc8de3f640 1 --2- 172.21.15.19:0/1888218748 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a45941d300 0x55a45941f7a0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7de21eac1910ecbc server_cookie=94b2dd2482dffe1f in_seq=0 out_seq=0 2024-09-19T08:56:08.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.700+0000 7fcc717fa640 10 client.16260 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:08.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.701+0000 7fcc717fa640 1 -- 172.21.15.19:0/1888218748 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a459375860 con 0x55a45941d300 2024-09-19T08:56:08.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.701+0000 7fcc717fa640 10 client.16260 handle_command_reply: tid=0 2024-09-19T08:56:08.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.701+0000 7fcc9247c740 1 client.16260 shutdown 2024-09-19T08:56:08.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.702+0000 7fcc9247c740 1 -- 172.21.15.19:0/1888218748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a459403b40 msgr2=0x55a45940a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:08.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.702+0000 7fcc9247c740 1 --2- 172.21.15.19:0/1888218748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a459403b40 0x55a45940a010 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fcc7809c030 tx=0x7fcc7809c160 comp rx=0 tx=0).stop 2024-09-19T08:56:08.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.702+0000 7fcc9247c740 1 -- 172.21.15.19:0/1888218748 shutdown_connections 2024-09-19T08:56:08.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.702+0000 7fcc9247c740 1 --2- 172.21.15.19:0/1888218748 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a45941d300 0x55a45941f7a0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.702+0000 7fcc717fa640 0 client.16260 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:08.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.702+0000 7fcc9247c740 1 --2- 172.21.15.19:0/1888218748 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a45940d370 0x55a45940a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.702+0000 7fcc9247c740 1 --2- 172.21.15.19:0/1888218748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a459403b40 0x55a45940a010 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.702+0000 7fcc9247c740 1 --2- 172.21.15.19:0/1888218748 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a4594025d0 0x55a45940cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.702+0000 7fcc9247c740 1 -- 172.21.15.19:0/1888218748 >> 172.21.15.19:0/1888218748 conn(0x55a4593cb310 msgr2=0x55a459404960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:08.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.702+0000 7fcc9247c740 1 -- 172.21.15.19:0/1888218748 shutdown_connections 2024-09-19T08:56:08.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.702+0000 7fcc9247c740 1 -- 172.21.15.19:0/1888218748 wait complete. 2024-09-19T08:56:08.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.702+0000 7fcc9247c740 20 client.16260 trim_cache size 0 max 16384 2024-09-19T08:56:08.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.717+0000 7fcc9247c740 1 Processor -- start 2024-09-19T08:56:08.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.717+0000 7fcc9247c740 1 -- start start 2024-09-19T08:56:08.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.717+0000 7fcc9247c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a4594025d0 0x55a459403300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:08.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.717+0000 7fcc9247c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a459403b40 0x55a4594088e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:08.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.717+0000 7fcc9247c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a45940d370 0x55a459408e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:08.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.717+0000 7fcc9247c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcc881af6f0 con 0x55a45940d370 2024-09-19T08:56:08.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.717+0000 7fcc9247c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcc881b1260 con 0x55a459403b40 2024-09-19T08:56:08.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.717+0000 7fcc9247c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcc881afdc0 con 0x55a4594025d0 2024-09-19T08:56:08.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.717+0000 7fcc8e640640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a45940d370 0x55a459408e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:08.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.717+0000 7fcc8e640640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a45940d370 0x55a459408e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54196/0 (socket says 172.21.15.19:54196) 2024-09-19T08:56:08.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.717+0000 7fcc8e640640 1 -- 172.21.15.19:0/4130921710 learned_addr learned my addr 172.21.15.19:0/4130921710 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:08.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.717+0000 7fcc8d63e640 1 --2- 172.21.15.19:0/4130921710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a459403b40 0x55a4594088e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:08.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.718+0000 7fcc8de3f640 1 --2- 172.21.15.19:0/4130921710 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a4594025d0 0x55a459403300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:08.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.718+0000 7fcc8e640640 1 -- 172.21.15.19:0/4130921710 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a4594025d0 msgr2=0x55a459403300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:08.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.718+0000 7fcc8e640640 1 --2- 172.21.15.19:0/4130921710 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a4594025d0 0x55a459403300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.718+0000 7fcc8e640640 1 -- 172.21.15.19:0/4130921710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a459403b40 msgr2=0x55a4594088e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:08.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.718+0000 7fcc8e640640 1 --2- 172.21.15.19:0/4130921710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a459403b40 0x55a4594088e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.718+0000 7fcc8e640640 1 -- 172.21.15.19:0/4130921710 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a459408560 con 0x55a45940d370 2024-09-19T08:56:08.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.718+0000 7fcc8e640640 1 --2- 172.21.15.19:0/4130921710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a45940d370 0x55a459408e20 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fcc80011600 tx=0x7fcc80012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab13d01a173a3230 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:08.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.718+0000 7fcc737fe640 1 -- 172.21.15.19:0/4130921710 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc80010710 con 0x55a45940d370 2024-09-19T08:56:08.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.718+0000 7fcc737fe640 1 -- 172.21.15.19:0/4130921710 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc80023070 con 0x55a45940d370 2024-09-19T08:56:08.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.718+0000 7fcc737fe640 1 -- 172.21.15.19:0/4130921710 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc80028dd0 con 0x55a45940d370 2024-09-19T08:56:08.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.719+0000 7fcc9247c740 1 -- 172.21.15.19:0/4130921710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a45940d370 msgr2=0x55a459408e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:08.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.719+0000 7fcc9247c740 1 --2- 172.21.15.19:0/4130921710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a45940d370 0x55a459408e20 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fcc80011600 tx=0x7fcc80012000 comp rx=0 tx=0).stop 2024-09-19T08:56:08.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.719+0000 7fcc9247c740 1 -- 172.21.15.19:0/4130921710 shutdown_connections 2024-09-19T08:56:08.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.719+0000 7fcc9247c740 1 --2- 172.21.15.19:0/4130921710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a45940d370 0x55a459408e20 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.719+0000 7fcc9247c740 1 --2- 172.21.15.19:0/4130921710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a459403b40 0x55a4594088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.719+0000 7fcc9247c740 1 --2- 172.21.15.19:0/4130921710 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a4594025d0 0x55a459403300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.719+0000 7fcc9247c740 1 -- 172.21.15.19:0/4130921710 >> 172.21.15.19:0/4130921710 conn(0x55a4593cb310 msgr2=0x55a4593f9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:08.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.719+0000 7fcc9247c740 1 -- 172.21.15.19:0/4130921710 shutdown_connections 2024-09-19T08:56:08.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.719+0000 7fcc9247c740 1 -- 172.21.15.19:0/4130921710 wait complete. 2024-09-19T08:56:08.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.720+0000 7fcc9247c740 1 -- start start 2024-09-19T08:56:08.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.720+0000 7fcc9247c740 1 Processor -- start 2024-09-19T08:56:08.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.720+0000 7fcc9247c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a4594025d0 0x55a459422670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:08.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.720+0000 7fcc9247c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a459403b40 0x55a459422bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:08.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.721+0000 7fcc9247c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a45940d370 0x55a45947ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:08.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.721+0000 7fcc9247c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcc881b0b90 con 0x55a4594025d0 2024-09-19T08:56:08.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.721+0000 7fcc9247c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcc881b04c0 con 0x55a45940d370 2024-09-19T08:56:08.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.721+0000 7fcc9247c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcc881ad6d0 con 0x55a459403b40 2024-09-19T08:56:08.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.721+0000 7fcc9247c740 10 client.0 _ll_register_callbacks cb 0x7fcc7809c7e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:08.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.721+0000 7fcc8de3f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a4594025d0 0x55a459422670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:08.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.721+0000 7fcc8d63e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a459403b40 0x55a459422bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:08.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.721+0000 7fcc8de3f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a4594025d0 0x55a459422670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54202/0 (socket says 172.21.15.19:54202) 2024-09-19T08:56:08.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.721+0000 7fcc8de3f640 1 -- 172.21.15.19:0/768305992 learned_addr learned my addr 172.21.15.19:0/768305992 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:08.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.721+0000 7fcc8e640640 1 --2- 172.21.15.19:0/768305992 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a45940d370 0x55a45947ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:08.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.721+0000 7fcc8d63e640 1 -- 172.21.15.19:0/768305992 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a45940d370 msgr2=0x55a45947ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:08.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.721+0000 7fcc8d63e640 1 --2- 172.21.15.19:0/768305992 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a45940d370 0x55a45947ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.721+0000 7fcc8d63e640 1 -- 172.21.15.19:0/768305992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a4594025d0 msgr2=0x55a459422670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:08.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.721+0000 7fcc8d63e640 1 --2- 172.21.15.19:0/768305992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a4594025d0 0x55a459422670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.721+0000 7fcc8d63e640 1 -- 172.21.15.19:0/768305992 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a45947f480 con 0x55a459403b40 2024-09-19T08:56:08.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.721+0000 7fcc8d63e640 1 --2- 172.21.15.19:0/768305992 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a459403b40 0x55a459422bb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x55a45940b5c0 tx=0x7fcc780cd4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7690610b2766b1b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:08.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.721+0000 7fcc717fa640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T08:56:08.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.722+0000 7fcc717fa640 1 -- 172.21.15.19:0/768305992 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc780b5040 con 0x55a459403b40 2024-09-19T08:56:08.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.722+0000 7fcc717fa640 1 -- 172.21.15.19:0/768305992 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fcc780a4880 con 0x55a459403b40 2024-09-19T08:56:08.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.722+0000 7fcc9247c740 1 -- 172.21.15.19:0/768305992 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc80023070 con 0x55a459403b40 2024-09-19T08:56:08.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.722+0000 7fcc717fa640 1 -- 172.21.15.19:0/768305992 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fcc780a0450 con 0x55a459403b40 2024-09-19T08:56:08.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.722+0000 7fcc9247c740 10 client.25771 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:08.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.722+0000 7fcc9247c740 1 -- 172.21.15.19:0/768305992 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55a4594879f0 con 0x55a459403b40 2024-09-19T08:56:08.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.722+0000 7fcc717fa640 1 -- 172.21.15.19:0/768305992 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcc80023070 con 0x55a459403b40 2024-09-19T08:56:08.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.722+0000 7fcc717fa640 1 -- 172.21.15.19:0/768305992 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7fcc780bace0 con 0x55a459403b40 2024-09-19T08:56:08.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.722+0000 7fcc9247c740 10 client.25771 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:08.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.722+0000 7fcc9247c740 10 client.25771 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:56:08.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.722+0000 7fcc9247c740 20 client.25771 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:08.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.722+0000 7fcc9247c740 1 --2- 172.21.15.19:0/768305992 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a45941d300 0x55a459489fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:08.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.722+0000 7fcc9247c740 4 client.25771 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:56:08.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.722+0000 7fcc9247c740 1 -- 172.21.15.19:0/768305992 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a45936fd70 con 0x55a45941d300 2024-09-19T08:56:08.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.723+0000 7fcc8de3f640 1 --2- 172.21.15.19:0/768305992 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a45941d300 0x55a459489fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:08.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.723+0000 7fcc717fa640 10 client.25771 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:08.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.723+0000 7fcc8de3f640 1 --2- 172.21.15.19:0/768305992 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a45941d300 0x55a459489fd0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de73332ac07f4019 server_cookie=f65da104a079a7a5 in_seq=0 out_seq=0 2024-09-19T08:56:08.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.724+0000 7fcc717fa640 1 -- 172.21.15.19:0/768305992 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a45936fd70 con 0x55a45941d300 2024-09-19T08:56:08.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.724+0000 7fcc717fa640 10 client.25771 handle_command_reply: tid=0 2024-09-19T08:56:08.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.724+0000 7fcc9247c740 1 client.25771 shutdown 2024-09-19T08:56:08.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.724+0000 7fcc9247c740 1 -- 172.21.15.19:0/768305992 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a459403b40 msgr2=0x55a459422bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:08.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.724+0000 7fcc9247c740 1 --2- 172.21.15.19:0/768305992 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a459403b40 0x55a459422bb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x55a45940b5c0 tx=0x7fcc780cd4c0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.724+0000 7fcc9247c740 1 -- 172.21.15.19:0/768305992 shutdown_connections 2024-09-19T08:56:08.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.724+0000 7fcc9247c740 1 --2- 172.21.15.19:0/768305992 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a45941d300 0x55a459489fd0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.724+0000 7fcc9247c740 1 --2- 172.21.15.19:0/768305992 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a459403b40 0x55a459422bb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.724+0000 7fcc9247c740 1 --2- 172.21.15.19:0/768305992 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a45940d370 0x55a45947ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.724+0000 7fcc717fa640 0 client.25771 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:08.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.724+0000 7fcc9247c740 1 --2- 172.21.15.19:0/768305992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a4594025d0 0x55a459422670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.724+0000 7fcc9247c740 1 -- 172.21.15.19:0/768305992 >> 172.21.15.19:0/768305992 conn(0x55a4593cb310 msgr2=0x55a4594088a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:08.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.725+0000 7fcc9247c740 1 -- 172.21.15.19:0/768305992 shutdown_connections 2024-09-19T08:56:08.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.725+0000 7fcc9247c740 1 -- 172.21.15.19:0/768305992 wait complete. 2024-09-19T08:56:08.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.725+0000 7fcc9247c740 20 client.25771 trim_cache size 0 max 16384 2024-09-19T08:56:08.728 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T08:56:08.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.725+0000 7fcc900a3640 1 -- 172.21.15.19:0/3581077406 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fcc740a32c0 msgr2=0x7fcc740a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:08.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.725+0000 7fcc900a3640 1 --2- 172.21.15.19:0/3581077406 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fcc740a32c0 0x7fcc740a5780 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x55a459403070 tx=0x7fcc80009500 comp rx=0 tx=0).stop 2024-09-19T08:56:08.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.725+0000 7fcc900a3640 1 -- 172.21.15.19:0/3581077406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc881036b0 msgr2=0x7fcc88100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:08.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.725+0000 7fcc900a3640 1 --2- 172.21.15.19:0/3581077406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc881036b0 0x7fcc88100f30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcc7800c920 tx=0x7fcc7800cde0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.726+0000 7fcc900a3640 1 -- 172.21.15.19:0/3581077406 shutdown_connections 2024-09-19T08:56:08.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.726+0000 7fcc900a3640 1 --2- 172.21.15.19:0/3581077406 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fcc740a32c0 0x7fcc740a5780 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.726+0000 7fcc900a3640 1 --2- 172.21.15.19:0/3581077406 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcc8810c170 0x7fcc88101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.726+0000 7fcc900a3640 1 --2- 172.21.15.19:0/3581077406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcc881036b0 0x7fcc88100f30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.726+0000 7fcc900a3640 1 --2- 172.21.15.19:0/3581077406 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcc88102d90 0x7fcc881009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:08.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.726+0000 7fcc900a3640 1 -- 172.21.15.19:0/3581077406 >> 172.21.15.19:0/3581077406 conn(0x7fcc880fc790 msgr2=0x7fcc880fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:08.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.726+0000 7fcc900a3640 1 -- 172.21.15.19:0/3581077406 shutdown_connections 2024-09-19T08:56:08.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:08.726+0000 7fcc900a3640 1 -- 172.21.15.19:0/3581077406 wait complete. 2024-09-19T08:56:08.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:08 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3117422564' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:09.479 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:09 smithi019 ceph-mon[30976]: pgmap v455: 97 pgs: 97 active+clean; 1.6 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 82 KiB/s wr, 85 op/s 2024-09-19T08:56:09.512 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:09.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:09 smithi155 ceph-mon[34921]: pgmap v455: 97 pgs: 97 active+clean; 1.6 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 82 KiB/s wr, 85 op/s 2024-09-19T08:56:09.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:09 smithi203 ceph-mon[35450]: pgmap v455: 97 pgs: 97 active+clean; 1.6 MiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 82 KiB/s wr, 85 op/s 2024-09-19T08:56:10.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.169+0000 7f72c4d7a640 1 -- 172.21.15.19:0/725304634 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72c0102ef0 msgr2=0x7f72c010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:10.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.169+0000 7f72c4d7a640 1 --2- 172.21.15.19:0/725304634 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72c0102ef0 0x7f72c010da40 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f72b8009ca0 tx=0x7f72b802a950 comp rx=0 tx=0).stop 2024-09-19T08:56:10.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.169+0000 7f72c4d7a640 1 -- 172.21.15.19:0/725304634 shutdown_connections 2024-09-19T08:56:10.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.169+0000 7f72c4d7a640 1 --2- 172.21.15.19:0/725304634 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72c0102ef0 0x7f72c010da40 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:10.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.169+0000 7f72c4d7a640 1 --2- 172.21.15.19:0/725304634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72c0102570 0x7f72c01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:10.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.169+0000 7f72c4d7a640 1 --2- 172.21.15.19:0/725304634 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72c0100e20 0x7f72c0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:10.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.169+0000 7f72c4d7a640 1 -- 172.21.15.19:0/725304634 >> 172.21.15.19:0/725304634 conn(0x7f72c00fc7d0 msgr2=0x7f72c00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:10.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.169+0000 7f72c4d7a640 1 -- 172.21.15.19:0/725304634 shutdown_connections 2024-09-19T08:56:10.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.169+0000 7f72c4d7a640 1 -- 172.21.15.19:0/725304634 wait complete. 2024-09-19T08:56:10.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.170+0000 7f72c4d7a640 1 Processor -- start 2024-09-19T08:56:10.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.170+0000 7f72c4d7a640 1 -- start start 2024-09-19T08:56:10.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.170+0000 7f72c4d7a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72c0100e20 0x7f72c00fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:10.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.170+0000 7f72c4d7a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72c0102570 0x7f72c00fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:10.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.170+0000 7f72c4d7a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72c0102ef0 0x7f72c00fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:10.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.170+0000 7f72c4d7a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f72c0110f80 con 0x7f72c0100e20 2024-09-19T08:56:10.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.170+0000 7f72c4d7a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f72c0110e00 con 0x7f72c0102570 2024-09-19T08:56:10.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.170+0000 7f72c4d7a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f72c0111100 con 0x7f72c0102ef0 2024-09-19T08:56:10.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.171+0000 7f72be59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72c0100e20 0x7f72c00fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:10.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.171+0000 7f72be59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72c0100e20 0x7f72c00fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54220/0 (socket says 172.21.15.19:54220) 2024-09-19T08:56:10.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.171+0000 7f72be59c640 1 -- 172.21.15.19:0/1900724984 learned_addr learned my addr 172.21.15.19:0/1900724984 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:10.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.171+0000 7f72b7fff640 1 --2- 172.21.15.19:0/1900724984 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72c0102570 0x7f72c00fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:10.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.171+0000 7f72bed9d640 1 --2- 172.21.15.19:0/1900724984 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72c0102ef0 0x7f72c00fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:10.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.171+0000 7f72be59c640 1 -- 172.21.15.19:0/1900724984 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72c0102ef0 msgr2=0x7f72c00fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:10.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.171+0000 7f72be59c640 1 --2- 172.21.15.19:0/1900724984 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72c0102ef0 0x7f72c00fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:10.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.171+0000 7f72be59c640 1 -- 172.21.15.19:0/1900724984 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72c0102570 msgr2=0x7f72c00fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:10.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.171+0000 7f72be59c640 1 --2- 172.21.15.19:0/1900724984 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72c0102570 0x7f72c00fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:10.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.171+0000 7f72be59c640 1 -- 172.21.15.19:0/1900724984 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c01a6980 con 0x7f72c0100e20 2024-09-19T08:56:10.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.171+0000 7f72be59c640 1 --2- 172.21.15.19:0/1900724984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72c0100e20 0x7f72c00fcc80 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f72b000d950 tx=0x7f72b000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:10.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.171+0000 7f72b77fe640 1 -- 172.21.15.19:0/1900724984 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0017030 con 0x7f72c0100e20 2024-09-19T08:56:10.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.171+0000 7f72b77fe640 1 -- 172.21.15.19:0/1900724984 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72b0004020 con 0x7f72c0100e20 2024-09-19T08:56:10.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.171+0000 7f72b77fe640 1 -- 172.21.15.19:0/1900724984 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b00047a0 con 0x7f72c0100e20 2024-09-19T08:56:10.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.171+0000 7f72c4d7a640 1 -- 172.21.15.19:0/1900724984 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72c01a6c70 con 0x7f72c0100e20 2024-09-19T08:56:10.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.172+0000 7f72c4d7a640 1 -- 172.21.15.19:0/1900724984 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72c01a7160 con 0x7f72c0100e20 2024-09-19T08:56:10.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.174+0000 7f72c7153740 1 Processor -- start 2024-09-19T08:56:10.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.174+0000 7f72b77fe640 1 -- 172.21.15.19:0/1900724984 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f72b00041d0 con 0x7f72c0100e20 2024-09-19T08:56:10.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.175+0000 7f72c7153740 1 -- start start 2024-09-19T08:56:10.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.175+0000 7f72c7153740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558788d97760 0x558788d97b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:10.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.175+0000 7f72c7153740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558788d98080 0x558788da2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:10.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.175+0000 7f72c7153740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558788da2940 0x558788da4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:10.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.175+0000 7f72c7153740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x558788cfd2a0 con 0x558788d98080 2024-09-19T08:56:10.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.175+0000 7f72c7153740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x558788ca4b10 con 0x558788da2940 2024-09-19T08:56:10.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.175+0000 7f72c7153740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558788cf9260 con 0x558788d97760 2024-09-19T08:56:10.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.175+0000 7f72b7fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558788da2940 0x558788da4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:10.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.175+0000 7f72b7fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558788da2940 0x558788da4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:34214/0 (socket says 172.21.15.19:34214) 2024-09-19T08:56:10.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.175+0000 7f72b7fff640 1 -- 172.21.15.19:0/2714104675 learned_addr learned my addr 172.21.15.19:0/2714104675 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:10.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.175+0000 7f72bed9d640 1 --2- 172.21.15.19:0/2714104675 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558788d97760 0x558788d97b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:10.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.175+0000 7f72b7fff640 1 -- 172.21.15.19:0/2714104675 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558788d97760 msgr2=0x558788d97b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:10.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.175+0000 7f72b7fff640 1 --2- 172.21.15.19:0/2714104675 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558788d97760 0x558788d97b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:10.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.175+0000 7f72be59c640 1 --2- 172.21.15.19:0/2714104675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558788d98080 0x558788da2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:10.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.175+0000 7f72b7fff640 1 -- 172.21.15.19:0/2714104675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558788d98080 msgr2=0x558788da2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:10.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.176+0000 7f72b7fff640 1 --2- 172.21.15.19:0/2714104675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558788d98080 0x558788da2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:10.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.176+0000 7f72b7fff640 1 -- 172.21.15.19:0/2714104675 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558788a6eb90 con 0x558788da2940 2024-09-19T08:56:10.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.176+0000 7f72be59c640 1 --2- 172.21.15.19:0/2714104675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558788d98080 0x558788da2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:56:10.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.176+0000 7f72b77fe640 1 --2- 172.21.15.19:0/1900724984 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f72ac0a32c0 0x7f72ac0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:10.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.176+0000 7f72bed9d640 1 --2- 172.21.15.19:0/1900724984 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f72ac0a32c0 0x7f72ac0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:10.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.176+0000 7f72b7fff640 1 --2- 172.21.15.19:0/2714104675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558788da2940 0x558788da4d30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f72a8009c10 tx=0x7f72a8011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4ce31db4720829a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:10.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.176+0000 7f72b77fe640 1 -- 172.21.15.19:0/1900724984 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f72b00cf1d0 con 0x7f72c0100e20 2024-09-19T08:56:10.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.176+0000 7f72b4ff9640 1 -- 172.21.15.19:0/2714104675 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a8004230 con 0x558788da2940 2024-09-19T08:56:10.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.176+0000 7f72b4ff9640 1 -- 172.21.15.19:0/2714104675 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72a80043d0 con 0x558788da2940 2024-09-19T08:56:10.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.176+0000 7f72b4ff9640 1 -- 172.21.15.19:0/2714104675 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a8004e60 con 0x558788da2940 2024-09-19T08:56:10.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.177+0000 7f72c7153740 1 -- 172.21.15.19:0/2714104675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558788da2940 msgr2=0x558788da4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:10.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.177+0000 7f72bed9d640 1 --2- 172.21.15.19:0/1900724984 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f72ac0a32c0 0x7f72ac0a5780 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f72b8005e30 tx=0x7f72b8005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:10.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.177+0000 7f72c7153740 1 --2- 172.21.15.19:0/2714104675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558788da2940 0x558788da4d30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f72a8009c10 tx=0x7f72a8011810 comp rx=0 tx=0).stop 2024-09-19T08:56:10.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.177+0000 7f72c7153740 1 -- 172.21.15.19:0/2714104675 shutdown_connections 2024-09-19T08:56:10.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.177+0000 7f72c7153740 1 --2- 172.21.15.19:0/2714104675 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558788da2940 0x558788da4d30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:10.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.177+0000 7f72c7153740 1 --2- 172.21.15.19:0/2714104675 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558788d98080 0x558788da2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:10.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.177+0000 7f72c7153740 1 --2- 172.21.15.19:0/2714104675 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558788d97760 0x558788d97b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:10.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.177+0000 7f72c7153740 1 -- 172.21.15.19:0/2714104675 >> 172.21.15.19:0/2714104675 conn(0x558788d93cf0 msgr2=0x558788d940d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:10.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.177+0000 7f72c7153740 1 -- 172.21.15.19:0/2714104675 shutdown_connections 2024-09-19T08:56:10.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.177+0000 7f72c7153740 1 -- 172.21.15.19:0/2714104675 wait complete. 2024-09-19T08:56:10.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.178+0000 7f72c7153740 1 -- start start 2024-09-19T08:56:10.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.178+0000 7f72c7153740 1 Processor -- start 2024-09-19T08:56:10.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.178+0000 7f72c7153740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558788d97760 0x558788d9f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:10.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.178+0000 7f72c7153740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558788d98080 0x558788d9fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:10.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.178+0000 7f72c7153740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558788da2940 0x558788da01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:10.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.178+0000 7f72c7153740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x558788da5510 con 0x558788da2940 2024-09-19T08:56:10.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.178+0000 7f72c7153740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x558788c856e0 con 0x558788d97760 2024-09-19T08:56:10.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.178+0000 7f72c7153740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558788da5690 con 0x558788d98080 2024-09-19T08:56:10.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.178+0000 7f72c7153740 10 client.0 _ll_register_callbacks cb 0x558788ca9a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:10.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.178+0000 7f72be59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558788d97760 0x558788d9f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:10.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.178+0000 7f72be59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558788d97760 0x558788d9f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:34220/0 (socket says 172.21.15.19:34220) 2024-09-19T08:56:10.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.178+0000 7f72be59c640 1 -- 172.21.15.19:0/242155411 learned_addr learned my addr 172.21.15.19:0/242155411 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:10.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.179+0000 7f72bed9d640 1 --2- 172.21.15.19:0/242155411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558788da2940 0x558788da01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:10.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.179+0000 7f72b7fff640 1 --2- 172.21.15.19:0/242155411 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558788d98080 0x558788d9fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:10.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.179+0000 7f72be59c640 1 -- 172.21.15.19:0/242155411 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558788d98080 msgr2=0x558788d9fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:10.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.179+0000 7f72be59c640 1 --2- 172.21.15.19:0/242155411 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558788d98080 0x558788d9fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:10.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.179+0000 7f72be59c640 1 -- 172.21.15.19:0/242155411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558788da2940 msgr2=0x558788da01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:10.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.179+0000 7f72be59c640 1 --2- 172.21.15.19:0/242155411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558788da2940 0x558788da01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:10.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.179+0000 7f72be59c640 1 -- 172.21.15.19:0/242155411 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558788dae9e0 con 0x558788d97760 2024-09-19T08:56:10.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.179+0000 7f72bed9d640 1 --2- 172.21.15.19:0/242155411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558788da2940 0x558788da01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:10.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.179+0000 7f72be59c640 1 --2- 172.21.15.19:0/242155411 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558788d97760 0x558788d9f770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f72b009b790 tx=0x7f72b009b400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e56190c33b6bf03 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:10.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.179+0000 7f72a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T08:56:10.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.179+0000 7f72a5ffb640 1 -- 172.21.15.19:0/242155411 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0014070 con 0x558788d97760 2024-09-19T08:56:10.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.179+0000 7f72a5ffb640 1 -- 172.21.15.19:0/242155411 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f72b0084b50 con 0x558788d97760 2024-09-19T08:56:10.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.179+0000 7f72c7153740 1 -- 172.21.15.19:0/242155411 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72a80043d0 con 0x558788d97760 2024-09-19T08:56:10.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.180+0000 7f72a5ffb640 1 -- 172.21.15.19:0/242155411 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f72b009b800 con 0x558788d97760 2024-09-19T08:56:10.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.180+0000 7f72c7153740 10 client.25802 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:10.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.180+0000 7f72c7153740 1 -- 172.21.15.19:0/242155411 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558788db1310 con 0x558788d97760 2024-09-19T08:56:10.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.180+0000 7f72a5ffb640 1 -- 172.21.15.19:0/242155411 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72a80043d0 con 0x558788d97760 2024-09-19T08:56:10.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.180+0000 7f72a5ffb640 1 -- 172.21.15.19:0/242155411 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f72b009cb30 con 0x558788d97760 2024-09-19T08:56:10.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.180+0000 7f72c7153740 10 client.25802 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:10.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.180+0000 7f72c7153740 10 client.25802 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T08:56:10.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.180+0000 7f72c7153740 20 client.25802 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:10.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.180+0000 7f72c7153740 1 --2- 172.21.15.19:0/242155411 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x558788db27d0 0x558788db4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:10.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.180+0000 7f72c7153740 4 client.25802 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:56:10.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.180+0000 7f72c7153740 1 -- 172.21.15.19:0/242155411 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558788d0a9d0 con 0x558788db27d0 2024-09-19T08:56:10.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.180+0000 7f72b7fff640 1 --2- 172.21.15.19:0/242155411 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x558788db27d0 0x558788db4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:10.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.181+0000 7f72a5ffb640 10 client.25802 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:10.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.181+0000 7f72b7fff640 1 --2- 172.21.15.19:0/242155411 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x558788db27d0 0x558788db4bc0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cbad08c86b8684de server_cookie=15ddf8cde87bada1 in_seq=0 out_seq=0 2024-09-19T08:56:10.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.182+0000 7f72a5ffb640 1 -- 172.21.15.19:0/242155411 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558788d0a9d0 con 0x558788db27d0 2024-09-19T08:56:10.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.182+0000 7f72a5ffb640 10 client.25802 handle_command_reply: tid=0 2024-09-19T08:56:10.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.182+0000 7f72c7153740 1 client.25802 shutdown 2024-09-19T08:56:10.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.183+0000 7f72c7153740 1 -- 172.21.15.19:0/242155411 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558788d97760 msgr2=0x558788d9f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:10.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.183+0000 7f72c7153740 1 --2- 172.21.15.19:0/242155411 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558788d97760 0x558788d9f770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f72b009b790 tx=0x7f72b009b400 comp rx=0 tx=0).stop 2024-09-19T08:56:10.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.183+0000 7f72c7153740 1 -- 172.21.15.19:0/242155411 shutdown_connections 2024-09-19T08:56:10.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.183+0000 7f72c7153740 1 --2- 172.21.15.19:0/242155411 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x558788db27d0 0x558788db4bc0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:10.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.183+0000 7f72c7153740 1 --2- 172.21.15.19:0/242155411 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558788d98080 0x558788d9fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:10.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.183+0000 7f72c7153740 1 --2- 172.21.15.19:0/242155411 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558788da2940 0x558788da01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:10.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.183+0000 7f72c7153740 1 --2- 172.21.15.19:0/242155411 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558788d97760 0x558788d9f770 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:10.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.183+0000 7f72c7153740 1 -- 172.21.15.19:0/242155411 >> 172.21.15.19:0/242155411 conn(0x558788d93cf0 msgr2=0x558788d99a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:10.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.183+0000 7f72a5ffb640 0 client.25802 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:10.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.183+0000 7f72c7153740 1 -- 172.21.15.19:0/242155411 shutdown_connections 2024-09-19T08:56:10.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.183+0000 7f72c7153740 1 -- 172.21.15.19:0/242155411 wait complete. 2024-09-19T08:56:10.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.183+0000 7f72c7153740 20 client.25802 trim_cache size 0 max 16384 2024-09-19T08:56:10.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.202+0000 7f72c7153740 1 Processor -- start 2024-09-19T08:56:10.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.202+0000 7f72c7153740 1 -- start start 2024-09-19T08:56:10.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.202+0000 7f72c7153740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558788d97760 0x558788d9f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:10.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.202+0000 7f72c7153740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558788d98080 0x558788dba420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:10.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.202+0000 7f72c7153740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558788da2940 0x558788dba960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:10.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.202+0000 7f72c7153740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f72c01af890 con 0x558788da2940 2024-09-19T08:56:10.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.202+0000 7f72be59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558788d97760 0x558788d9f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:10.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.202+0000 7f72bed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558788da2940 0x558788dba960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:10.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.202+0000 7f72be59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558788d97760 0x558788d9f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:34232/0 (socket says 172.21.15.19:34232) 2024-09-19T08:56:10.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.202+0000 7f72be59c640 1 -- 172.21.15.19:0/3948610514 learned_addr learned my addr 172.21.15.19:0/3948610514 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:10.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.202+0000 7f72c7153740 1 -- 172.21.15.19:0/3948610514 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f72c01b1400 con 0x558788d97760 2024-09-19T08:56:10.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.202+0000 7f72c7153740 1 -- 172.21.15.19:0/3948610514 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f72c01aff60 con 0x558788d98080 2024-09-19T08:56:10.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.202+0000 7f72b7fff640 1 --2- 172.21.15.19:0/3948610514 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558788d98080 0x558788dba420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:10.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.203+0000 7f72be59c640 1 -- 172.21.15.19:0/3948610514 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558788d98080 msgr2=0x558788dba420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:10.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.203+0000 7f72be59c640 1 --2- 172.21.15.19:0/3948610514 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558788d98080 0x558788dba420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:10.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.203+0000 7f72be59c640 1 -- 172.21.15.19:0/3948610514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558788da2940 msgr2=0x558788dba960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:10.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.203+0000 7f72be59c640 1 --2- 172.21.15.19:0/3948610514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558788da2940 0x558788dba960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:10.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.203+0000 7f72be59c640 1 -- 172.21.15.19:0/3948610514 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558788d97eb0 con 0x558788d97760 2024-09-19T08:56:10.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.203+0000 7f72bed9d640 1 --2- 172.21.15.19:0/3948610514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558788da2940 0x558788dba960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:10.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.203+0000 7f72be59c640 1 --2- 172.21.15.19:0/3948610514 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558788d97760 0x558788d9f050 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f72b0005fd0 tx=0x7f72b0099d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efc236082fcd7e61 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:10.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.203+0000 7f72a7fff640 1 -- 172.21.15.19:0/3948610514 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b0014070 con 0x558788d97760 2024-09-19T08:56:10.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.203+0000 7f72a7fff640 1 -- 172.21.15.19:0/3948610514 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72b009fbb0 con 0x558788d97760 2024-09-19T08:56:10.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.203+0000 7f72a7fff640 1 -- 172.21.15.19:0/3948610514 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72b009cb30 con 0x558788d97760 2024-09-19T08:56:10.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.204+0000 7f72c7153740 1 -- 172.21.15.19:0/3948610514 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558788d97760 msgr2=0x558788d9f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:10.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.204+0000 7f72c7153740 1 --2- 172.21.15.19:0/3948610514 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558788d97760 0x558788d9f050 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f72b0005fd0 tx=0x7f72b0099d10 comp rx=0 tx=0).stop 2024-09-19T08:56:10.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.204+0000 7f72c7153740 1 -- 172.21.15.19:0/3948610514 shutdown_connections 2024-09-19T08:56:10.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.204+0000 7f72c7153740 1 --2- 172.21.15.19:0/3948610514 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558788d98080 0x558788dba420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:10.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.204+0000 7f72c7153740 1 --2- 172.21.15.19:0/3948610514 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558788da2940 0x558788dba960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:10.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.204+0000 7f72c7153740 1 --2- 172.21.15.19:0/3948610514 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558788d97760 0x558788d9f050 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:10.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.204+0000 7f72c7153740 1 -- 172.21.15.19:0/3948610514 >> 172.21.15.19:0/3948610514 conn(0x558788d93cf0 msgr2=0x558788d9ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:10.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.204+0000 7f72c7153740 1 -- 172.21.15.19:0/3948610514 shutdown_connections 2024-09-19T08:56:10.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.204+0000 7f72c7153740 1 -- 172.21.15.19:0/3948610514 wait complete. 2024-09-19T08:56:10.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.204+0000 7f72c7153740 1 -- start start 2024-09-19T08:56:10.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.205+0000 7f72c7153740 1 Processor -- start 2024-09-19T08:56:10.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.205+0000 7f72c7153740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558788d97760 0x558788da6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:10.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.205+0000 7f72c7153740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558788d98080 0x558788da7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:10.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.205+0000 7f72c7153740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558788da2940 0x558788e16430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:10.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.205+0000 7f72c7153740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f72c01b0d30 con 0x558788d97760 2024-09-19T08:56:10.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.205+0000 7f72c7153740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f72c01b0660 con 0x558788d98080 2024-09-19T08:56:10.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.205+0000 7f72c7153740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f72c01ad870 con 0x558788da2940 2024-09-19T08:56:10.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.205+0000 7f72c7153740 10 client.0 _ll_register_callbacks cb 0x7f72b0097aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:10.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.205+0000 7f72b7fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558788d98080 0x558788da7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:10.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.205+0000 7f72be59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558788d97760 0x558788da6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:10.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.205+0000 7f72be59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558788d97760 0x558788da6fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54256/0 (socket says 172.21.15.19:54256) 2024-09-19T08:56:10.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.205+0000 7f72b7fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558788d98080 0x558788da7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:34242/0 (socket says 172.21.15.19:34242) 2024-09-19T08:56:10.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.205+0000 7f72be59c640 1 -- 172.21.15.19:0/2833789200 learned_addr learned my addr 172.21.15.19:0/2833789200 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:10.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.205+0000 7f72bed9d640 1 --2- 172.21.15.19:0/2833789200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558788da2940 0x558788e16430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:10.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.205+0000 7f72b7fff640 1 -- 172.21.15.19:0/2833789200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558788da2940 msgr2=0x558788e16430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:10.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.205+0000 7f72b7fff640 1 --2- 172.21.15.19:0/2833789200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558788da2940 0x558788e16430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:10.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.205+0000 7f72b7fff640 1 -- 172.21.15.19:0/2833789200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558788d97760 msgr2=0x558788da6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:10.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.205+0000 7f72b7fff640 1 --2- 172.21.15.19:0/2833789200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558788d97760 0x558788da6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:10.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.205+0000 7f72b7fff640 1 -- 172.21.15.19:0/2833789200 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558788e16a70 con 0x558788d98080 2024-09-19T08:56:10.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.205+0000 7f72be59c640 1 --2- 172.21.15.19:0/2833789200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558788d97760 0x558788da6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:10.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.206+0000 7f72b7fff640 1 --2- 172.21.15.19:0/2833789200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558788d98080 0x558788da7520 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f72a8000c00 tx=0x7f72a80049c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8152bfe23a1e6d86 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:10.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.206+0000 7f72a5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T08:56:10.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.206+0000 7f72a5ffb640 1 -- 172.21.15.19:0/2833789200 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a8009e80 con 0x558788d98080 2024-09-19T08:56:10.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.206+0000 7f72a5ffb640 1 -- 172.21.15.19:0/2833789200 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f72a8025640 con 0x558788d98080 2024-09-19T08:56:10.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.206+0000 7f72c7153740 1 -- 172.21.15.19:0/2833789200 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72b009fbb0 con 0x558788d98080 2024-09-19T08:56:10.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.206+0000 7f72a5ffb640 1 -- 172.21.15.19:0/2833789200 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f72a8025860 con 0x558788d98080 2024-09-19T08:56:10.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.206+0000 7f72c7153740 10 client.25808 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:10.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.206+0000 7f72c7153740 1 -- 172.21.15.19:0/2833789200 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x558788e1ddc0 con 0x558788d98080 2024-09-19T08:56:10.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.206+0000 7f72a5ffb640 1 -- 172.21.15.19:0/2833789200 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f72b009fbb0 con 0x558788d98080 2024-09-19T08:56:10.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.207+0000 7f72a5ffb640 1 -- 172.21.15.19:0/2833789200 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f72a8018070 con 0x558788d98080 2024-09-19T08:56:10.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.207+0000 7f72c7153740 10 client.25808 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:10.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.207+0000 7f72c7153740 10 client.25808 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T08:56:10.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.207+0000 7f72c7153740 20 client.25808 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:10.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.207+0000 7f72c7153740 1 --2- 172.21.15.19:0/2833789200 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x558788e1e360 0x558788e20750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:10.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.207+0000 7f72c7153740 4 client.25808 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}] 2024-09-19T08:56:10.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.207+0000 7f72c7153740 1 -- 172.21.15.19:0/2833789200 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 136.6, "await_for": 45.0}) -- 0x558788d04d20 con 0x558788e1e360 2024-09-19T08:56:10.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.207+0000 7f72be59c640 1 --2- 172.21.15.19:0/2833789200 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x558788e1e360 0x558788e20750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:10.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.207+0000 7f72be59c640 1 --2- 172.21.15.19:0/2833789200 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x558788e1e360 0x558788e20750 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24920c464e80070b server_cookie=876008654610310 in_seq=0 out_seq=0 2024-09-19T08:56:10.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:10.207+0000 7f72a5ffb640 10 client.25808 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:10.510 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:56:10.511 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:56:10.781 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:11.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.274+0000 7f19ae070640 1 -- 172.21.15.19:0/2478639939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19a8106f10 msgr2=0x7f19a810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:11.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.274+0000 7f19ae070640 1 --2- 172.21.15.19:0/2478639939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19a8106f10 0x7f19a810ea90 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f19a0009ca0 tx=0x7f19a002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.274+0000 7f19ae070640 1 -- 172.21.15.19:0/2478639939 shutdown_connections 2024-09-19T08:56:11.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.274+0000 7f19ae070640 1 --2- 172.21.15.19:0/2478639939 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19a8102790 0x7f19a81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.274+0000 7f19ae070640 1 --2- 172.21.15.19:0/2478639939 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19a8106f10 0x7f19a810ea90 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.274+0000 7f19ae070640 1 --2- 172.21.15.19:0/2478639939 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19a8101de0 0x7f19a81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.274+0000 7f19ae070640 1 -- 172.21.15.19:0/2478639939 >> 172.21.15.19:0/2478639939 conn(0x7f19a80fd8c0 msgr2=0x7f19a80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:11.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.274+0000 7f19ae070640 1 -- 172.21.15.19:0/2478639939 shutdown_connections 2024-09-19T08:56:11.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.274+0000 7f19ae070640 1 -- 172.21.15.19:0/2478639939 wait complete. 2024-09-19T08:56:11.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.275+0000 7f19ae070640 1 Processor -- start 2024-09-19T08:56:11.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.275+0000 7f19ae070640 1 -- start start 2024-09-19T08:56:11.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.275+0000 7f19ae070640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19a8101de0 0x7f19a8198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:11.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.275+0000 7f19ae070640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19a8102790 0x7f19a8198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:11.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.275+0000 7f19ae070640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19a8106f10 0x7f19a819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:11.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.275+0000 7f19ae070640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f19a8111f70 con 0x7f19a8106f10 2024-09-19T08:56:11.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.275+0000 7f19ae070640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f19a8111df0 con 0x7f19a8102790 2024-09-19T08:56:11.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.275+0000 7f19ae070640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f19a81120f0 con 0x7f19a8101de0 2024-09-19T08:56:11.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.276+0000 7f19a7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19a8106f10 0x7f19a819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:11.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.276+0000 7f19a77fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19a8101de0 0x7f19a8198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:11.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.276+0000 7f19a7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19a8106f10 0x7f19a819cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54280/0 (socket says 172.21.15.19:54280) 2024-09-19T08:56:11.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.276+0000 7f19a7fff640 1 -- 172.21.15.19:0/3010587316 learned_addr learned my addr 172.21.15.19:0/3010587316 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:11.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.276+0000 7f19a6ffd640 1 --2- 172.21.15.19:0/3010587316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19a8102790 0x7f19a8198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:11.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.276+0000 7f19a7fff640 1 -- 172.21.15.19:0/3010587316 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19a8101de0 msgr2=0x7f19a8198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:11.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.276+0000 7f19a7fff640 1 --2- 172.21.15.19:0/3010587316 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19a8101de0 0x7f19a8198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.276+0000 7f19a7fff640 1 -- 172.21.15.19:0/3010587316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19a8102790 msgr2=0x7f19a8198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:11.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.276+0000 7f19a7fff640 1 --2- 172.21.15.19:0/3010587316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19a8102790 0x7f19a8198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.276+0000 7f19a7fff640 1 -- 172.21.15.19:0/3010587316 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19a819d3c0 con 0x7f19a8106f10 2024-09-19T08:56:11.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.276+0000 7f19a77fe640 1 --2- 172.21.15.19:0/3010587316 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19a8101de0 0x7f19a8198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:11.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.276+0000 7f19a7fff640 1 --2- 172.21.15.19:0/3010587316 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19a8106f10 0x7f19a819cce0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f19a0030ca0 tx=0x7f19a0030cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:11.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.276+0000 7f19a4ff9640 1 -- 172.21.15.19:0/3010587316 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a0003b70 con 0x7f19a8106f10 2024-09-19T08:56:11.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.276+0000 7f19ae070640 1 -- 172.21.15.19:0/3010587316 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19a819d650 con 0x7f19a8106f10 2024-09-19T08:56:11.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.276+0000 7f19a4ff9640 1 -- 172.21.15.19:0/3010587316 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f19a0031930 con 0x7f19a8106f10 2024-09-19T08:56:11.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.276+0000 7f19a4ff9640 1 -- 172.21.15.19:0/3010587316 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19a003a420 con 0x7f19a8106f10 2024-09-19T08:56:11.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.276+0000 7f19ae070640 1 -- 172.21.15.19:0/3010587316 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19a81a4f90 con 0x7f19a8106f10 2024-09-19T08:56:11.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.279+0000 7f19a4ff9640 1 -- 172.21.15.19:0/3010587316 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f19a0004050 con 0x7f19a8106f10 2024-09-19T08:56:11.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.279+0000 7f19b0449740 1 Processor -- start 2024-09-19T08:56:11.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.279+0000 7f19b0449740 1 -- start start 2024-09-19T08:56:11.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.279+0000 7f19b0449740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636218f7b60 0x5636218f7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:11.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.279+0000 7f19b0449740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636218f8480 0x563621902800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:11.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.279+0000 7f19b0449740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563621902d40 0x563621905130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:11.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.279+0000 7f19b0449740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56362185d280 con 0x5636218f7b60 2024-09-19T08:56:11.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.279+0000 7f19b0449740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x563621804b10 con 0x563621902d40 2024-09-19T08:56:11.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.279+0000 7f19b0449740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563621859240 con 0x5636218f8480 2024-09-19T08:56:11.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.280+0000 7f19a77fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636218f8480 0x563621902800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:11.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.280+0000 7f19a77fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636218f8480 0x563621902800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:36334/0 (socket says 172.21.15.19:36334) 2024-09-19T08:56:11.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.280+0000 7f19a77fe640 1 -- 172.21.15.19:0/603188356 learned_addr learned my addr 172.21.15.19:0/603188356 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:11.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.280+0000 7f19a6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636218f7b60 0x5636218f7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:11.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.280+0000 7f19a4ff9640 1 --2- 172.21.15.19:0/3010587316 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f19900a3240 0x7f19900a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:11.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.280+0000 7f19a6ffd640 1 --2- 172.21.15.19:0/603188356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563621902d40 0x563621905130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:11.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.280+0000 7f19a77fe640 1 -- 172.21.15.19:0/603188356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563621902d40 msgr2=0x563621905130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:11.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.280+0000 7f19a77fe640 1 --2- 172.21.15.19:0/603188356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563621902d40 0x563621905130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.280+0000 7f19a77fe640 1 -- 172.21.15.19:0/603188356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636218f7b60 msgr2=0x5636218f7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:11.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.280+0000 7f19a77fe640 1 --2- 172.21.15.19:0/603188356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636218f7b60 0x5636218f7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.280+0000 7f19a77fe640 1 -- 172.21.15.19:0/603188356 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636218111f0 con 0x5636218f8480 2024-09-19T08:56:11.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.280+0000 7f19a4ff9640 1 -- 172.21.15.19:0/3010587316 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f19a00f0960 con 0x7f19a8106f10 2024-09-19T08:56:11.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.280+0000 7f19a7fff640 1 --2- 172.21.15.19:0/3010587316 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f19900a3240 0x7f19900a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:11.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.280+0000 7f19a77fe640 1 --2- 172.21.15.19:0/603188356 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636218f8480 0x563621902800 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1998009f60 tx=0x7f1998009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8032e7bb1b75bba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:11.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.280+0000 7f19a7fff640 1 --2- 172.21.15.19:0/3010587316 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f19900a3240 0x7f19900a5700 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f19a0030930 tx=0x7f19a003d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:11.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.280+0000 7f198dffb640 1 -- 172.21.15.19:0/603188356 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1998023070 con 0x5636218f8480 2024-09-19T08:56:11.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.281+0000 7f198dffb640 1 -- 172.21.15.19:0/603188356 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f199800fd20 con 0x5636218f8480 2024-09-19T08:56:11.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.281+0000 7f198dffb640 1 -- 172.21.15.19:0/603188356 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1998016d60 con 0x5636218f8480 2024-09-19T08:56:11.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.281+0000 7f19b0449740 1 -- 172.21.15.19:0/603188356 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636218f8480 msgr2=0x563621902800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:11.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.281+0000 7f19b0449740 1 --2- 172.21.15.19:0/603188356 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636218f8480 0x563621902800 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1998009f60 tx=0x7f1998009f90 comp rx=0 tx=0).stop 2024-09-19T08:56:11.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.281+0000 7f19b0449740 1 -- 172.21.15.19:0/603188356 shutdown_connections 2024-09-19T08:56:11.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.281+0000 7f19b0449740 1 --2- 172.21.15.19:0/603188356 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636218f8480 0x563621902800 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.281+0000 7f19b0449740 1 --2- 172.21.15.19:0/603188356 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563621902d40 0x563621905130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.281+0000 7f19b0449740 1 --2- 172.21.15.19:0/603188356 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636218f7b60 0x5636218f7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.281+0000 7f19b0449740 1 -- 172.21.15.19:0/603188356 >> 172.21.15.19:0/603188356 conn(0x5636218f40f0 msgr2=0x5636218f44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:11.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.281+0000 7f19b0449740 1 -- 172.21.15.19:0/603188356 shutdown_connections 2024-09-19T08:56:11.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.281+0000 7f19b0449740 1 -- 172.21.15.19:0/603188356 wait complete. 2024-09-19T08:56:11.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.282+0000 7f19b0449740 1 -- start start 2024-09-19T08:56:11.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.282+0000 7f19b0449740 1 Processor -- start 2024-09-19T08:56:11.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.282+0000 7f19b0449740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636218f7b60 0x5636218ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:11.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.282+0000 7f19b0449740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636218f8480 0x5636219000f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:11.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.282+0000 7f19b0449740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563621902d40 0x563621900630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:11.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.282+0000 7f19b0449740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563621905910 con 0x5636218f7b60 2024-09-19T08:56:11.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.282+0000 7f19b0449740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x563621817f10 con 0x563621902d40 2024-09-19T08:56:11.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.282+0000 7f19b0449740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563621905a90 con 0x5636218f8480 2024-09-19T08:56:11.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.283+0000 7f19b0449740 10 client.0 _ll_register_callbacks cb 0x5636217e0a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:11.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.283+0000 7f19a6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636218f7b60 0x5636218ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:11.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.283+0000 7f19a77fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636218f8480 0x5636219000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:11.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.283+0000 7f19a6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636218f7b60 0x5636218ffbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54294/0 (socket says 172.21.15.19:54294) 2024-09-19T08:56:11.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.283+0000 7f19a6ffd640 1 -- 172.21.15.19:0/1076314294 learned_addr learned my addr 172.21.15.19:0/1076314294 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:11.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.283+0000 7f19a6ffd640 1 --2- 172.21.15.19:0/1076314294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563621902d40 0x563621900630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:11.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.283+0000 7f19a6ffd640 1 -- 172.21.15.19:0/1076314294 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636218f8480 msgr2=0x5636219000f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:11.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.283+0000 7f19a6ffd640 1 --2- 172.21.15.19:0/1076314294 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636218f8480 0x5636219000f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.283+0000 7f19a6ffd640 1 -- 172.21.15.19:0/1076314294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563621902d40 msgr2=0x563621900630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:11.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.283+0000 7f19a6ffd640 1 --2- 172.21.15.19:0/1076314294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563621902d40 0x563621900630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.283+0000 7f19a6ffd640 1 -- 172.21.15.19:0/1076314294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5636215ce6a0 con 0x5636218f7b60 2024-09-19T08:56:11.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.283+0000 7f19a77fe640 1 --2- 172.21.15.19:0/1076314294 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636218f8480 0x5636219000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:11.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.283+0000 7f19a6ffd640 1 --2- 172.21.15.19:0/1076314294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636218f7b60 0x5636218ffbb0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f199c013fd0 tx=0x7f199c005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9c85b5cbaadcba4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:11.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.283+0000 7f1986ffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:56:11.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.283+0000 7f1986ffd640 1 -- 172.21.15.19:0/1076314294 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f199c01a040 con 0x5636218f7b60 2024-09-19T08:56:11.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.283+0000 7f1986ffd640 1 -- 172.21.15.19:0/1076314294 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f199c0131b0 con 0x5636218f7b60 2024-09-19T08:56:11.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.283+0000 7f19b0449740 1 -- 172.21.15.19:0/1076314294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f199800fd20 con 0x5636218f7b60 2024-09-19T08:56:11.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.284+0000 7f1986ffd640 1 -- 172.21.15.19:0/1076314294 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f199c004030 con 0x5636218f7b60 2024-09-19T08:56:11.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.284+0000 7f19b0449740 10 client.16293 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:11.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.284+0000 7f19b0449740 1 -- 172.21.15.19:0/1076314294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x563621911530 con 0x5636218f7b60 2024-09-19T08:56:11.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.284+0000 7f1986ffd640 1 -- 172.21.15.19:0/1076314294 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f199800fd20 con 0x5636218f7b60 2024-09-19T08:56:11.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.284+0000 7f1986ffd640 1 -- 172.21.15.19:0/1076314294 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f199c021430 con 0x5636218f7b60 2024-09-19T08:56:11.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.284+0000 7f19b0449740 10 client.16293 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:11.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.284+0000 7f19b0449740 10 client.16293 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:56:11.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.284+0000 7f19b0449740 20 client.16293 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:11.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.284+0000 7f19b0449740 1 --2- 172.21.15.19:0/1076314294 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563621912940 0x563621914d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:11.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.284+0000 7f19b0449740 4 client.16293 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:56:11.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.284+0000 7f19b0449740 1 -- 172.21.15.19:0/1076314294 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56362186a7f0 con 0x563621912940 2024-09-19T08:56:11.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.284+0000 7f19a77fe640 1 --2- 172.21.15.19:0/1076314294 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563621912940 0x563621914d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:11.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.285+0000 7f19a77fe640 1 --2- 172.21.15.19:0/1076314294 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563621912940 0x563621914d90 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fb08959bf54173 server_cookie=d03febafe81896fa in_seq=0 out_seq=0 2024-09-19T08:56:11.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.285+0000 7f1986ffd640 10 client.16293 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:11.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.289+0000 7f1986ffd640 1 -- 172.21.15.19:0/1076314294 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56362186a7f0 con 0x563621912940 2024-09-19T08:56:11.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.289+0000 7f1986ffd640 10 client.16293 handle_command_reply: tid=0 2024-09-19T08:56:11.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.289+0000 7f19b0449740 1 client.16293 shutdown 2024-09-19T08:56:11.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.289+0000 7f19b0449740 1 -- 172.21.15.19:0/1076314294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636218f7b60 msgr2=0x5636218ffbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:11.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.289+0000 7f19b0449740 1 --2- 172.21.15.19:0/1076314294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636218f7b60 0x5636218ffbb0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f199c013fd0 tx=0x7f199c005f90 comp rx=0 tx=0).stop 2024-09-19T08:56:11.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.289+0000 7f19b0449740 1 -- 172.21.15.19:0/1076314294 shutdown_connections 2024-09-19T08:56:11.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.289+0000 7f19b0449740 1 --2- 172.21.15.19:0/1076314294 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563621912940 0x563621914d90 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.289+0000 7f19b0449740 1 --2- 172.21.15.19:0/1076314294 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636218f8480 0x5636219000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.289+0000 7f19b0449740 1 --2- 172.21.15.19:0/1076314294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563621902d40 0x563621900630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.289+0000 7f19b0449740 1 --2- 172.21.15.19:0/1076314294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636218f7b60 0x5636218ffbb0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.289+0000 7f19b0449740 1 -- 172.21.15.19:0/1076314294 >> 172.21.15.19:0/1076314294 conn(0x5636218f40f0 msgr2=0x5636218f3270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:11.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.289+0000 7f1986ffd640 0 client.16293 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:11.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.289+0000 7f19b0449740 1 -- 172.21.15.19:0/1076314294 shutdown_connections 2024-09-19T08:56:11.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.289+0000 7f19b0449740 1 -- 172.21.15.19:0/1076314294 wait complete. 2024-09-19T08:56:11.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.289+0000 7f19b0449740 20 client.16293 trim_cache size 0 max 16384 2024-09-19T08:56:11.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.307+0000 7f19b0449740 1 Processor -- start 2024-09-19T08:56:11.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.308+0000 7f19b0449740 1 -- start start 2024-09-19T08:56:11.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.308+0000 7f19b0449740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636218f7b60 0x56362191a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:11.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.308+0000 7f19b0449740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636218f8480 0x56362191aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:11.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.308+0000 7f19b0449740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563621902d40 0x5636218fe350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:11.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.308+0000 7f19b0449740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f19a81ab310 con 0x5636218f8480 2024-09-19T08:56:11.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.308+0000 7f19b0449740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f19a81ace80 con 0x563621902d40 2024-09-19T08:56:11.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.308+0000 7f19b0449740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f19a81ab9e0 con 0x5636218f7b60 2024-09-19T08:56:11.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.308+0000 7f19a77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636218f8480 0x56362191aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:11.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.308+0000 7f19a77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636218f8480 0x56362191aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54308/0 (socket says 172.21.15.19:54308) 2024-09-19T08:56:11.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.308+0000 7f19a77fe640 1 -- 172.21.15.19:0/3364913362 learned_addr learned my addr 172.21.15.19:0/3364913362 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:11.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.308+0000 7f19a6ffd640 1 --2- 172.21.15.19:0/3364913362 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636218f7b60 0x56362191a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:11.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.308+0000 7f19a6ffd640 1 --2- 172.21.15.19:0/3364913362 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563621902d40 0x5636218fe350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:11.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.308+0000 7f19a77fe640 1 -- 172.21.15.19:0/3364913362 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636218f7b60 msgr2=0x56362191a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:11.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.308+0000 7f19a77fe640 1 --2- 172.21.15.19:0/3364913362 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636218f7b60 0x56362191a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.308+0000 7f19a77fe640 1 -- 172.21.15.19:0/3364913362 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563621902d40 msgr2=0x5636218fe350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:11.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.308+0000 7f19a77fe640 1 --2- 172.21.15.19:0/3364913362 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563621902d40 0x5636218fe350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.308+0000 7f19a77fe640 1 -- 172.21.15.19:0/3364913362 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636218f3f20 con 0x5636218f8480 2024-09-19T08:56:11.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.308+0000 7f19a6ffd640 1 --2- 172.21.15.19:0/3364913362 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636218f7b60 0x56362191a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:11.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.309+0000 7f19a77fe640 1 --2- 172.21.15.19:0/3364913362 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636218f8480 0x56362191aba0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f1998009f60 tx=0x7f1998009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b419404efb3b60e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:11.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.311+0000 7f198d7fa640 1 -- 172.21.15.19:0/3364913362 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1998023040 con 0x5636218f8480 2024-09-19T08:56:11.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.311+0000 7f198d7fa640 1 -- 172.21.15.19:0/3364913362 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1998005520 con 0x5636218f8480 2024-09-19T08:56:11.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.311+0000 7f198d7fa640 1 -- 172.21.15.19:0/3364913362 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f199800fad0 con 0x5636218f8480 2024-09-19T08:56:11.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.312+0000 7f19b0449740 1 -- 172.21.15.19:0/3364913362 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636218f8480 msgr2=0x56362191aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:11.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.312+0000 7f19b0449740 1 --2- 172.21.15.19:0/3364913362 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636218f8480 0x56362191aba0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f1998009f60 tx=0x7f1998009b50 comp rx=0 tx=0).stop 2024-09-19T08:56:11.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.312+0000 7f19b0449740 1 -- 172.21.15.19:0/3364913362 shutdown_connections 2024-09-19T08:56:11.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.312+0000 7f19b0449740 1 --2- 172.21.15.19:0/3364913362 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563621902d40 0x5636218fe350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.312+0000 7f19b0449740 1 --2- 172.21.15.19:0/3364913362 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636218f8480 0x56362191aba0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.312+0000 7f19b0449740 1 --2- 172.21.15.19:0/3364913362 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636218f7b60 0x56362191a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.312+0000 7f19b0449740 1 -- 172.21.15.19:0/3364913362 >> 172.21.15.19:0/3364913362 conn(0x5636218f40f0 msgr2=0x563621901b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:11.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.312+0000 7f19b0449740 1 -- 172.21.15.19:0/3364913362 shutdown_connections 2024-09-19T08:56:11.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.312+0000 7f19b0449740 1 -- 172.21.15.19:0/3364913362 wait complete. 2024-09-19T08:56:11.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.312+0000 7f19b0449740 1 -- start start 2024-09-19T08:56:11.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.312+0000 7f19b0449740 1 Processor -- start 2024-09-19T08:56:11.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.313+0000 7f19b0449740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636218f7b60 0x563621906aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:11.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.313+0000 7f19b0449740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636218f8480 0x563621906fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:11.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.313+0000 7f19b0449740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563621902d40 0x563621907520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:11.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.313+0000 7f19b0449740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f19a81ac7b0 con 0x5636218f8480 2024-09-19T08:56:11.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.313+0000 7f19b0449740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f19a81ac0e0 con 0x563621902d40 2024-09-19T08:56:11.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.313+0000 7f19b0449740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f19a81a92f0 con 0x5636218f7b60 2024-09-19T08:56:11.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.313+0000 7f19b0449740 10 client.0 _ll_register_callbacks cb 0x7f199c009b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:11.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.313+0000 7f19a77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636218f8480 0x563621906fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:11.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.313+0000 7f19a77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636218f8480 0x563621906fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54310/0 (socket says 172.21.15.19:54310) 2024-09-19T08:56:11.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.313+0000 7f19a77fe640 1 -- 172.21.15.19:0/3786325536 learned_addr learned my addr 172.21.15.19:0/3786325536 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:11.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.313+0000 7f19a6ffd640 1 --2- 172.21.15.19:0/3786325536 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636218f7b60 0x563621906aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:11.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.313+0000 7f19a6ffd640 1 --2- 172.21.15.19:0/3786325536 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563621902d40 0x563621907520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:11.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.313+0000 7f19a77fe640 1 -- 172.21.15.19:0/3786325536 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636218f7b60 msgr2=0x563621906aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:11.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.313+0000 7f19a77fe640 1 --2- 172.21.15.19:0/3786325536 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636218f7b60 0x563621906aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.313+0000 7f19a77fe640 1 -- 172.21.15.19:0/3786325536 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563621902d40 msgr2=0x563621907520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:11.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.313+0000 7f19a77fe640 1 --2- 172.21.15.19:0/3786325536 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563621902d40 0x563621907520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.313+0000 7f19a77fe640 1 -- 172.21.15.19:0/3786325536 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56362197c680 con 0x5636218f8480 2024-09-19T08:56:11.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.313+0000 7f19a77fe640 1 --2- 172.21.15.19:0/3786325536 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636218f8480 0x563621906fe0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f1998010010 tx=0x7f19980096e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b612152de22e1cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:11.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.313+0000 7f1986ffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:56:11.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.314+0000 7f1986ffd640 1 -- 172.21.15.19:0/3786325536 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1998023070 con 0x5636218f8480 2024-09-19T08:56:11.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.314+0000 7f19b0449740 1 -- 172.21.15.19:0/3786325536 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1998005520 con 0x5636218f8480 2024-09-19T08:56:11.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.314+0000 7f1986ffd640 1 -- 172.21.15.19:0/3786325536 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1998016550 con 0x5636218f8480 2024-09-19T08:56:11.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.314+0000 7f1986ffd640 1 -- 172.21.15.19:0/3786325536 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f1998016750 con 0x5636218f8480 2024-09-19T08:56:11.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.314+0000 7f19b0449740 10 client.16299 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:11.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.314+0000 7f19b0449740 1 -- 172.21.15.19:0/3786325536 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56362197d980 con 0x5636218f8480 2024-09-19T08:56:11.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.314+0000 7f1986ffd640 1 -- 172.21.15.19:0/3786325536 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1998005520 con 0x5636218f8480 2024-09-19T08:56:11.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.314+0000 7f1986ffd640 1 -- 172.21.15.19:0/3786325536 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f199800f850 con 0x5636218f8480 2024-09-19T08:56:11.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.314+0000 7f19b0449740 10 client.16299 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:11.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.314+0000 7f19b0449740 10 client.16299 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:56:11.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.314+0000 7f19b0449740 20 client.16299 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:11.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.314+0000 7f19b0449740 1 --2- 172.21.15.19:0/3786325536 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56362197deb0 0x5636219802a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:11.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.314+0000 7f19b0449740 4 client.16299 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:56:11.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.314+0000 7f19b0449740 1 -- 172.21.15.19:0/3786325536 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563621864d00 con 0x56362197deb0 2024-09-19T08:56:11.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.315+0000 7f19a6ffd640 1 --2- 172.21.15.19:0/3786325536 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56362197deb0 0x5636219802a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:11.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.315+0000 7f19a6ffd640 1 --2- 172.21.15.19:0/3786325536 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56362197deb0 0x5636219802a0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cb1d6860c2f564a server_cookie=d28bed2376cf1f38 in_seq=0 out_seq=0 2024-09-19T08:56:11.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.315+0000 7f1986ffd640 10 client.16299 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:11.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:11 smithi019 ceph-mon[30976]: pgmap v456: 97 pgs: 97 active+clean; 1.3 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 435 KiB/s wr, 129 op/s 2024-09-19T08:56:11.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:11 smithi155 ceph-mon[34921]: pgmap v456: 97 pgs: 97 active+clean; 1.3 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 435 KiB/s wr, 129 op/s 2024-09-19T08:56:11.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:11 smithi203 ceph-mon[35450]: pgmap v456: 97 pgs: 97 active+clean; 1.3 MiB data, 363 MiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 435 KiB/s wr, 129 op/s 2024-09-19T08:56:11.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.854+0000 7f1986ffd640 1 -- 172.21.15.19:0/3786325536 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563621864d00 con 0x56362197deb0 2024-09-19T08:56:11.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.854+0000 7f1986ffd640 10 client.16299 handle_command_reply: tid=0 2024-09-19T08:56:11.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.854+0000 7f19b0449740 1 client.16299 shutdown 2024-09-19T08:56:11.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.854+0000 7f19b0449740 1 -- 172.21.15.19:0/3786325536 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636218f8480 msgr2=0x563621906fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:11.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.854+0000 7f19b0449740 1 --2- 172.21.15.19:0/3786325536 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636218f8480 0x563621906fe0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f1998010010 tx=0x7f19980096e0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.854+0000 7f19b0449740 1 -- 172.21.15.19:0/3786325536 shutdown_connections 2024-09-19T08:56:11.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.854+0000 7f19b0449740 1 --2- 172.21.15.19:0/3786325536 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56362197deb0 0x5636219802a0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.854+0000 7f19b0449740 1 --2- 172.21.15.19:0/3786325536 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563621902d40 0x563621907520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.854+0000 7f19b0449740 1 --2- 172.21.15.19:0/3786325536 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636218f8480 0x563621906fe0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.854+0000 7f19b0449740 1 --2- 172.21.15.19:0/3786325536 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5636218f7b60 0x563621906aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.854+0000 7f19b0449740 1 -- 172.21.15.19:0/3786325536 >> 172.21.15.19:0/3786325536 conn(0x5636218f40f0 msgr2=0x5636218f2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:11.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.854+0000 7f1986ffd640 0 client.16299 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:11.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.855+0000 7f19b0449740 1 -- 172.21.15.19:0/3786325536 shutdown_connections 2024-09-19T08:56:11.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.855+0000 7f19b0449740 1 -- 172.21.15.19:0/3786325536 wait complete. 2024-09-19T08:56:11.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.855+0000 7f19b0449740 20 client.16299 trim_cache size 0 max 16384 2024-09-19T08:56:11.857 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:56:11.857 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-19T08:56:11.857 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "e95d7067-22e9-4e7f-a9aa-c6bd996a2696", 2024-09-19T08:56:11.858 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-19T08:56:11.858 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:56:11.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.855+0000 7f19ae070640 1 -- 172.21.15.19:0/3010587316 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f19900a3240 msgr2=0x7f19900a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:11.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.855+0000 7f19ae070640 1 --2- 172.21.15.19:0/3010587316 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f19900a3240 0x7f19900a5700 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f19a0030930 tx=0x7f19a003d040 comp rx=0 tx=0).stop 2024-09-19T08:56:11.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.855+0000 7f19ae070640 1 -- 172.21.15.19:0/3010587316 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19a8106f10 msgr2=0x7f19a819cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:11.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.855+0000 7f19ae070640 1 --2- 172.21.15.19:0/3010587316 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19a8106f10 0x7f19a819cce0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f19a0030ca0 tx=0x7f19a0030cd0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.855+0000 7f19ae070640 1 -- 172.21.15.19:0/3010587316 shutdown_connections 2024-09-19T08:56:11.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.855+0000 7f19ae070640 1 --2- 172.21.15.19:0/3010587316 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f19900a3240 0x7f19900a5700 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.855+0000 7f19ae070640 1 --2- 172.21.15.19:0/3010587316 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f19a8106f10 0x7f19a819cce0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.855+0000 7f19ae070640 1 --2- 172.21.15.19:0/3010587316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f19a8102790 0x7f19a8198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.855+0000 7f19ae070640 1 --2- 172.21.15.19:0/3010587316 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f19a8101de0 0x7f19a8198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:11.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.855+0000 7f19ae070640 1 -- 172.21.15.19:0/3010587316 >> 172.21.15.19:0/3010587316 conn(0x7f19a80fd8c0 msgr2=0x7f19a80feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:11.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.856+0000 7f19ae070640 1 -- 172.21.15.19:0/3010587316 shutdown_connections 2024-09-19T08:56:11.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:11.856+0000 7f19ae070640 1 -- 172.21.15.19:0/3010587316 wait complete. 2024-09-19T08:56:12.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:12 smithi019 ceph-mon[30976]: scrub queued for path: / 2024-09-19T08:56:12.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:12 smithi019 ceph-mon[30976]: scrub summary: idle+waiting paths [/] 2024-09-19T08:56:12.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:12 smithi019 ceph-mon[30976]: scrub summary: active paths [/] 2024-09-19T08:56:12.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:12 smithi155 ceph-mon[34921]: scrub queued for path: / 2024-09-19T08:56:12.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:12 smithi155 ceph-mon[34921]: scrub summary: idle+waiting paths [/] 2024-09-19T08:56:12.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:12 smithi155 ceph-mon[34921]: scrub summary: active paths [/] 2024-09-19T08:56:12.694 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:56:12.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:12 smithi203 ceph-mon[35450]: scrub queued for path: / 2024-09-19T08:56:12.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:12 smithi203 ceph-mon[35450]: scrub summary: idle+waiting paths [/] 2024-09-19T08:56:12.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:12 smithi203 ceph-mon[35450]: scrub summary: active paths [/] 2024-09-19T08:56:13.008 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:13.423 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:13 smithi019 ceph-mon[30976]: pgmap v457: 97 pgs: 97 active+clean; 5.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 812 KiB/s wr, 411 op/s 2024-09-19T08:56:13.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.511+0000 7f3a895ed640 1 -- 172.21.15.19:0/468108332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a84074ee0 msgr2=0x7f3a8410dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:13.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.511+0000 7f3a895ed640 1 --2- 172.21.15.19:0/468108332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a84074ee0 0x7f3a8410dee0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c009900 tx=0x7f3a6c02a480 comp rx=0 tx=0).stop 2024-09-19T08:56:13.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.511+0000 7f3a895ed640 1 -- 172.21.15.19:0/468108332 shutdown_connections 2024-09-19T08:56:13.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.511+0000 7f3a895ed640 1 --2- 172.21.15.19:0/468108332 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a8410e420 0x7f3a84110810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:13.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.511+0000 7f3a895ed640 1 --2- 172.21.15.19:0/468108332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a84074ee0 0x7f3a8410dee0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:13.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.511+0000 7f3a895ed640 1 --2- 172.21.15.19:0/468108332 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a840745c0 0x7f3a840749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:13.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.511+0000 7f3a895ed640 1 -- 172.21.15.19:0/468108332 >> 172.21.15.19:0/468108332 conn(0x7f3a840fd8c0 msgr2=0x7f3a840ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:13.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.511+0000 7f3a895ed640 1 -- 172.21.15.19:0/468108332 shutdown_connections 2024-09-19T08:56:13.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.511+0000 7f3a895ed640 1 -- 172.21.15.19:0/468108332 wait complete. 2024-09-19T08:56:13.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.512+0000 7f3a895ed640 1 Processor -- start 2024-09-19T08:56:13.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.512+0000 7f3a895ed640 1 -- start start 2024-09-19T08:56:13.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.512+0000 7f3a895ed640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a840745c0 0x7f3a8419a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:13.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.512+0000 7f3a895ed640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a84074ee0 0x7f3a8419ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:13.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.512+0000 7f3a895ed640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a8410e420 0x7f3a8419ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:13.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.512+0000 7f3a895ed640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3a84114170 con 0x7f3a84074ee0 2024-09-19T08:56:13.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.512+0000 7f3a895ed640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3a84113ff0 con 0x7f3a8410e420 2024-09-19T08:56:13.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.512+0000 7f3a895ed640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3a841142f0 con 0x7f3a840745c0 2024-09-19T08:56:13.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.512+0000 7f3a7bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a84074ee0 0x7f3a8419ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:13.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.512+0000 7f3a7bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a84074ee0 0x7f3a8419ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54326/0 (socket says 172.21.15.19:54326) 2024-09-19T08:56:13.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.512+0000 7f3a7bfff640 1 -- 172.21.15.19:0/1099144290 learned_addr learned my addr 172.21.15.19:0/1099144290 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:13.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.512+0000 7f3a82ffd640 1 --2- 172.21.15.19:0/1099144290 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a840745c0 0x7f3a8419a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:13.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.512+0000 7f3a837fe640 1 --2- 172.21.15.19:0/1099144290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a8410e420 0x7f3a8419ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:13.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.513+0000 7f3a7bfff640 1 -- 172.21.15.19:0/1099144290 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a840745c0 msgr2=0x7f3a8419a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:13.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.513+0000 7f3a7bfff640 1 --2- 172.21.15.19:0/1099144290 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a840745c0 0x7f3a8419a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:13.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.513+0000 7f3a7bfff640 1 -- 172.21.15.19:0/1099144290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a8410e420 msgr2=0x7f3a8419ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:13.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.513+0000 7f3a7bfff640 1 --2- 172.21.15.19:0/1099144290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a8410e420 0x7f3a8419ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:13.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.513+0000 7f3a7bfff640 1 -- 172.21.15.19:0/1099144290 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a8419f600 con 0x7f3a84074ee0 2024-09-19T08:56:13.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.513+0000 7f3a7bfff640 1 --2- 172.21.15.19:0/1099144290 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a84074ee0 0x7f3a8419ab90 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c006010 tx=0x7f3a6c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:13.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.513+0000 7f3a80ff9640 1 -- 172.21.15.19:0/1099144290 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c03f030 con 0x7f3a84074ee0 2024-09-19T08:56:13.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.513+0000 7f3a80ff9640 1 -- 172.21.15.19:0/1099144290 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a6c004440 con 0x7f3a84074ee0 2024-09-19T08:56:13.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.513+0000 7f3a895ed640 1 -- 172.21.15.19:0/1099144290 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a8419f890 con 0x7f3a84074ee0 2024-09-19T08:56:13.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.513+0000 7f3a80ff9640 1 -- 172.21.15.19:0/1099144290 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c035070 con 0x7f3a84074ee0 2024-09-19T08:56:13.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.513+0000 7f3a895ed640 1 -- 172.21.15.19:0/1099144290 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a841a71d0 con 0x7f3a84074ee0 2024-09-19T08:56:13.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.516+0000 7f3a8b9c6740 1 Processor -- start 2024-09-19T08:56:13.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.516+0000 7f3a8b9c6740 1 -- start start 2024-09-19T08:56:13.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.516+0000 7f3a80ff9640 1 -- 172.21.15.19:0/1099144290 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f3a6c042030 con 0x7f3a84074ee0 2024-09-19T08:56:13.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.517+0000 7f3a8b9c6740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e7053b4a0 0x556e7053b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:13.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.517+0000 7f3a8b9c6740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556e7053bdc0 0x556e70546140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:13.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.517+0000 7f3a8b9c6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556e70546680 0x556e70548a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:13.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.517+0000 7f3a8b9c6740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556e704a12e0 con 0x556e7053b4a0 2024-09-19T08:56:13.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.517+0000 7f3a8b9c6740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x556e70448ce0 con 0x556e7053bdc0 2024-09-19T08:56:13.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.517+0000 7f3a8b9c6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x556e7049d2a0 con 0x556e70546680 2024-09-19T08:56:13.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.517+0000 7f3a837fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e7053b4a0 0x556e7053b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:13.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.517+0000 7f3a837fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e7053b4a0 0x556e7053b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54336/0 (socket says 172.21.15.19:54336) 2024-09-19T08:56:13.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.517+0000 7f3a837fe640 1 -- 172.21.15.19:0/1662383967 learned_addr learned my addr 172.21.15.19:0/1662383967 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:13.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.517+0000 7f3a82ffd640 1 --2- 172.21.15.19:0/1662383967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556e7053bdc0 0x556e70546140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:13.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.517+0000 7f3a7bfff640 1 --2- 172.21.15.19:0/1662383967 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556e70546680 0x556e70548a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:13.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.517+0000 7f3a837fe640 1 -- 172.21.15.19:0/1662383967 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556e70546680 msgr2=0x556e70548a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:13.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.517+0000 7f3a837fe640 1 --2- 172.21.15.19:0/1662383967 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556e70546680 0x556e70548a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:13.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.517+0000 7f3a837fe640 1 -- 172.21.15.19:0/1662383967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556e7053bdc0 msgr2=0x556e70546140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:13.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.517+0000 7f3a837fe640 1 --2- 172.21.15.19:0/1662383967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556e7053bdc0 0x556e70546140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:13.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.517+0000 7f3a837fe640 1 -- 172.21.15.19:0/1662383967 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e7042d440 con 0x556e7053b4a0 2024-09-19T08:56:13.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.517+0000 7f3a82ffd640 1 --2- 172.21.15.19:0/1662383967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556e7053bdc0 0x556e70546140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:13.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.517+0000 7f3a837fe640 1 --2- 172.21.15.19:0/1662383967 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e7053b4a0 0x556e7053b880 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c009f30 tx=0x7f3a7c0118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0cdd9c371f3c627 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:13.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.518+0000 7f3a80ff9640 1 --2- 172.21.15.19:0/1099144290 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3a700a3240 0x7f3a700a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:13.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.518+0000 7f3a797fa640 1 -- 172.21.15.19:0/1662383967 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c004d20 con 0x556e7053b4a0 2024-09-19T08:56:13.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.518+0000 7f3a797fa640 1 -- 172.21.15.19:0/1662383967 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a7c004050 con 0x556e7053b4a0 2024-09-19T08:56:13.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.518+0000 7f3a82ffd640 1 --2- 172.21.15.19:0/1099144290 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3a700a3240 0x7f3a700a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:13.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.518+0000 7f3a797fa640 1 -- 172.21.15.19:0/1662383967 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c005280 con 0x556e7053b4a0 2024-09-19T08:56:13.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.518+0000 7f3a80ff9640 1 -- 172.21.15.19:0/1099144290 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f3a6c0efc50 con 0x7f3a84074ee0 2024-09-19T08:56:13.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.518+0000 7f3a8b9c6740 1 -- 172.21.15.19:0/1662383967 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e7053b4a0 msgr2=0x556e7053b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:13.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.518+0000 7f3a82ffd640 1 --2- 172.21.15.19:0/1099144290 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3a700a3240 0x7f3a700a5700 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x556e70538890 tx=0x7f3a74005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:13.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.518+0000 7f3a8b9c6740 1 --2- 172.21.15.19:0/1662383967 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e7053b4a0 0x556e7053b880 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c009f30 tx=0x7f3a7c0118d0 comp rx=0 tx=0).stop 2024-09-19T08:56:13.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.519+0000 7f3a8b9c6740 1 -- 172.21.15.19:0/1662383967 shutdown_connections 2024-09-19T08:56:13.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.519+0000 7f3a8b9c6740 1 --2- 172.21.15.19:0/1662383967 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556e70546680 0x556e70548a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:13.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.519+0000 7f3a8b9c6740 1 --2- 172.21.15.19:0/1662383967 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556e7053bdc0 0x556e70546140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:13.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.519+0000 7f3a8b9c6740 1 --2- 172.21.15.19:0/1662383967 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e7053b4a0 0x556e7053b880 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:13.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.519+0000 7f3a8b9c6740 1 -- 172.21.15.19:0/1662383967 >> 172.21.15.19:0/1662383967 conn(0x556e70537a30 msgr2=0x556e70537e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:13.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.519+0000 7f3a8b9c6740 1 -- 172.21.15.19:0/1662383967 shutdown_connections 2024-09-19T08:56:13.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.519+0000 7f3a8b9c6740 1 -- 172.21.15.19:0/1662383967 wait complete. 2024-09-19T08:56:13.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.519+0000 7f3a8b9c6740 1 -- start start 2024-09-19T08:56:13.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.519+0000 7f3a8b9c6740 1 Processor -- start 2024-09-19T08:56:13.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.519+0000 7f3a8b9c6740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556e7053b4a0 0x556e70545fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:13.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.519+0000 7f3a8b9c6740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e7053bdc0 0x556e70543250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:13.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.519+0000 7f3a8b9c6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556e70546680 0x556e70543790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:13.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.519+0000 7f3a8b9c6740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556e70549250 con 0x556e7053bdc0 2024-09-19T08:56:13.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.519+0000 7f3a8b9c6740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x556e7045c050 con 0x556e7053b4a0 2024-09-19T08:56:13.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.519+0000 7f3a8b9c6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x556e705493d0 con 0x556e70546680 2024-09-19T08:56:13.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.520+0000 7f3a8b9c6740 10 client.0 _ll_register_callbacks cb 0x556e7049c160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:13.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.520+0000 7f3a7bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e7053bdc0 0x556e70543250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:13.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.520+0000 7f3a82ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556e7053b4a0 0x556e70545fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:13.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.520+0000 7f3a7bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e7053bdc0 0x556e70543250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54342/0 (socket says 172.21.15.19:54342) 2024-09-19T08:56:13.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.520+0000 7f3a7bfff640 1 -- 172.21.15.19:0/3667161681 learned_addr learned my addr 172.21.15.19:0/3667161681 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:13.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.520+0000 7f3a837fe640 1 --2- 172.21.15.19:0/3667161681 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556e70546680 0x556e70543790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:13.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.520+0000 7f3a7bfff640 1 -- 172.21.15.19:0/3667161681 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556e70546680 msgr2=0x556e70543790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:13.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.520+0000 7f3a7bfff640 1 --2- 172.21.15.19:0/3667161681 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556e70546680 0x556e70543790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:13.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.520+0000 7f3a7bfff640 1 -- 172.21.15.19:0/3667161681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556e7053b4a0 msgr2=0x556e70545fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:13.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.520+0000 7f3a7bfff640 1 --2- 172.21.15.19:0/3667161681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556e7053b4a0 0x556e70545fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:13.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.520+0000 7f3a7bfff640 1 -- 172.21.15.19:0/3667161681 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e702123c0 con 0x556e7053bdc0 2024-09-19T08:56:13.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.520+0000 7f3a82ffd640 1 --2- 172.21.15.19:0/3667161681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556e7053b4a0 0x556e70545fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:13.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.520+0000 7f3a7bfff640 1 --2- 172.21.15.19:0/3667161681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e7053bdc0 0x556e70543250 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c0c49c0 tx=0x7f3a6c009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14424df5c90fc18b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:13.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.520+0000 7f3a6a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:56:13.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.520+0000 7f3a6a7fc640 1 -- 172.21.15.19:0/3667161681 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6c049070 con 0x556e7053bdc0 2024-09-19T08:56:13.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.520+0000 7f3a6a7fc640 1 -- 172.21.15.19:0/3667161681 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f3a6c0b89a0 con 0x556e7053bdc0 2024-09-19T08:56:13.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.520+0000 7f3a8b9c6740 1 -- 172.21.15.19:0/3667161681 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a7c004050 con 0x556e7053bdc0 2024-09-19T08:56:13.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.521+0000 7f3a6a7fc640 1 -- 172.21.15.19:0/3667161681 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f3a6c0bbe70 con 0x556e7053bdc0 2024-09-19T08:56:13.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.521+0000 7f3a8b9c6740 10 client.16311 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:13.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.521+0000 7f3a8b9c6740 1 -- 172.21.15.19:0/3667161681 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x556e70554bd0 con 0x556e7053bdc0 2024-09-19T08:56:13.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.521+0000 7f3a6a7fc640 1 -- 172.21.15.19:0/3667161681 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a7c004050 con 0x556e7053bdc0 2024-09-19T08:56:13.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.521+0000 7f3a6a7fc640 1 -- 172.21.15.19:0/3667161681 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f3a6c0f6060 con 0x556e7053bdc0 2024-09-19T08:56:13.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.521+0000 7f3a8b9c6740 10 client.16311 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:13.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.521+0000 7f3a8b9c6740 10 client.16311 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:56:13.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.521+0000 7f3a8b9c6740 20 client.16311 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:13.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.521+0000 7f3a8b9c6740 1 --2- 172.21.15.19:0/3667161681 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x556e70555f70 0x556e705583a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:13.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.521+0000 7f3a8b9c6740 4 client.16311 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:56:13.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.521+0000 7f3a8b9c6740 1 -- 172.21.15.19:0/3667161681 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556e704ae850 con 0x556e70555f70 2024-09-19T08:56:13.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.521+0000 7f3a82ffd640 1 --2- 172.21.15.19:0/3667161681 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x556e70555f70 0x556e705583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:13.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.522+0000 7f3a82ffd640 1 --2- 172.21.15.19:0/3667161681 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x556e70555f70 0x556e705583a0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b42f53d6cd98072a server_cookie=52fdcf8f5e95c9b5 in_seq=0 out_seq=0 2024-09-19T08:56:13.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.522+0000 7f3a6a7fc640 10 client.16311 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:13.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.523+0000 7f3a6a7fc640 1 -- 172.21.15.19:0/3667161681 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556e704ae850 con 0x556e70555f70 2024-09-19T08:56:13.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.523+0000 7f3a6a7fc640 10 client.16311 handle_command_reply: tid=0 2024-09-19T08:56:13.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.523+0000 7f3a8b9c6740 1 client.16311 shutdown 2024-09-19T08:56:13.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.523+0000 7f3a8b9c6740 1 -- 172.21.15.19:0/3667161681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e7053bdc0 msgr2=0x556e70543250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:13.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.523+0000 7f3a8b9c6740 1 --2- 172.21.15.19:0/3667161681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e7053bdc0 0x556e70543250 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c0c49c0 tx=0x7f3a6c009560 comp rx=0 tx=0).stop 2024-09-19T08:56:13.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.523+0000 7f3a8b9c6740 1 -- 172.21.15.19:0/3667161681 shutdown_connections 2024-09-19T08:56:13.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.523+0000 7f3a8b9c6740 1 --2- 172.21.15.19:0/3667161681 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x556e70555f70 0x556e705583a0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:13.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.523+0000 7f3a6a7fc640 0 client.16311 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:13.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.523+0000 7f3a8b9c6740 1 --2- 172.21.15.19:0/3667161681 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556e70546680 0x556e70543790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:13.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.523+0000 7f3a8b9c6740 1 --2- 172.21.15.19:0/3667161681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e7053bdc0 0x556e70543250 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:13.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.523+0000 7f3a8b9c6740 1 --2- 172.21.15.19:0/3667161681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556e7053b4a0 0x556e70545fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:13.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.523+0000 7f3a8b9c6740 1 -- 172.21.15.19:0/3667161681 >> 172.21.15.19:0/3667161681 conn(0x556e70537a30 msgr2=0x556e70536b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:13.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.523+0000 7f3a8b9c6740 1 -- 172.21.15.19:0/3667161681 shutdown_connections 2024-09-19T08:56:13.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.523+0000 7f3a8b9c6740 1 -- 172.21.15.19:0/3667161681 wait complete. 2024-09-19T08:56:13.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.523+0000 7f3a8b9c6740 20 client.16311 trim_cache size 0 max 16384 2024-09-19T08:56:13.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.541+0000 7f3a8b9c6740 1 Processor -- start 2024-09-19T08:56:13.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.541+0000 7f3a8b9c6740 1 -- start start 2024-09-19T08:56:13.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.541+0000 7f3a8b9c6740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556e70537a30 0x556e705524b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:13.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.541+0000 7f3a8b9c6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556e7053b4a0 0x556e7055dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:13.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.541+0000 7f3a8b9c6740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e7053bdc0 0x556e7055e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:13.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.541+0000 7f3a8b9c6740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3a841af700 con 0x556e7053bdc0 2024-09-19T08:56:13.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.541+0000 7f3a8b9c6740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3a841b1270 con 0x556e70537a30 2024-09-19T08:56:13.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.541+0000 7f3a8b9c6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3a841afdd0 con 0x556e7053b4a0 2024-09-19T08:56:13.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.541+0000 7f3a837fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e7053bdc0 0x556e7055e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:13.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.541+0000 7f3a82ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556e70537a30 0x556e705524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:13.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.541+0000 7f3a82ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556e70537a30 0x556e705524b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:34358/0 (socket says 172.21.15.19:34358) 2024-09-19T08:56:13.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.541+0000 7f3a82ffd640 1 -- 172.21.15.19:0/529287500 learned_addr learned my addr 172.21.15.19:0/529287500 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:13.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.541+0000 7f3a7bfff640 1 --2- 172.21.15.19:0/529287500 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556e7053b4a0 0x556e7055dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:13.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.541+0000 7f3a82ffd640 1 -- 172.21.15.19:0/529287500 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556e7053b4a0 msgr2=0x556e7055dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:13.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.541+0000 7f3a82ffd640 1 --2- 172.21.15.19:0/529287500 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556e7053b4a0 0x556e7055dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:13.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.541+0000 7f3a82ffd640 1 -- 172.21.15.19:0/529287500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e7053bdc0 msgr2=0x556e7055e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:13.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.541+0000 7f3a82ffd640 1 --2- 172.21.15.19:0/529287500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e7053bdc0 0x556e7055e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:13.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.541+0000 7f3a82ffd640 1 -- 172.21.15.19:0/529287500 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556e7053b2d0 con 0x556e70537a30 2024-09-19T08:56:13.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.541+0000 7f3a837fe640 1 --2- 172.21.15.19:0/529287500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e7053bdc0 0x556e7055e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:13.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.542+0000 7f3a82ffd640 1 --2- 172.21.15.19:0/529287500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556e70537a30 0x556e705524b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x556e70558c10 tx=0x7f3a7401b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40211d5cfb9a1a9d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:13.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.542+0000 7f3a78ff9640 1 -- 172.21.15.19:0/529287500 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a74003da0 con 0x556e70537a30 2024-09-19T08:56:13.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.542+0000 7f3a78ff9640 1 -- 172.21.15.19:0/529287500 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a7402b420 con 0x556e70537a30 2024-09-19T08:56:13.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.542+0000 7f3a78ff9640 1 -- 172.21.15.19:0/529287500 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7401fe60 con 0x556e70537a30 2024-09-19T08:56:13.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.543+0000 7f3a8b9c6740 1 -- 172.21.15.19:0/529287500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556e70537a30 msgr2=0x556e705524b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:13.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.543+0000 7f3a8b9c6740 1 --2- 172.21.15.19:0/529287500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556e70537a30 0x556e705524b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x556e70558c10 tx=0x7f3a7401b000 comp rx=0 tx=0).stop 2024-09-19T08:56:13.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.543+0000 7f3a8b9c6740 1 -- 172.21.15.19:0/529287500 shutdown_connections 2024-09-19T08:56:13.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.543+0000 7f3a8b9c6740 1 --2- 172.21.15.19:0/529287500 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556e7053b4a0 0x556e7055dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:13.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.543+0000 7f3a8b9c6740 1 --2- 172.21.15.19:0/529287500 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e7053bdc0 0x556e7055e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:13.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.543+0000 7f3a8b9c6740 1 --2- 172.21.15.19:0/529287500 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556e70537a30 0x556e705524b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:13.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.543+0000 7f3a8b9c6740 1 -- 172.21.15.19:0/529287500 >> 172.21.15.19:0/529287500 conn(0x556e705438f0 msgr2=0x556e7053e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:13.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.543+0000 7f3a8b9c6740 1 -- 172.21.15.19:0/529287500 shutdown_connections 2024-09-19T08:56:13.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.543+0000 7f3a8b9c6740 1 -- 172.21.15.19:0/529287500 wait complete. 2024-09-19T08:56:13.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.543+0000 7f3a8b9c6740 1 -- start start 2024-09-19T08:56:13.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.543+0000 7f3a8b9c6740 1 Processor -- start 2024-09-19T08:56:13.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.543+0000 7f3a8b9c6740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e70537a30 0x556e7054eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:13.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.543+0000 7f3a8b9c6740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556e7053b4a0 0x556e70549e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:13.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.544+0000 7f3a8b9c6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556e7053bdc0 0x556e7054a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:13.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.544+0000 7f3a8b9c6740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3a841b0ba0 con 0x556e70537a30 2024-09-19T08:56:13.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.544+0000 7f3a8b9c6740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3a841b04d0 con 0x556e7053b4a0 2024-09-19T08:56:13.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.544+0000 7f3a8b9c6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3a841ad6e0 con 0x556e7053bdc0 2024-09-19T08:56:13.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.544+0000 7f3a8b9c6740 10 client.0 _ll_register_callbacks cb 0x7f3a6c03b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:13.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.544+0000 7f3a82ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e70537a30 0x556e7054eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:13.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.544+0000 7f3a82ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e70537a30 0x556e7054eaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54360/0 (socket says 172.21.15.19:54360) 2024-09-19T08:56:13.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.544+0000 7f3a82ffd640 1 -- 172.21.15.19:0/2675376856 learned_addr learned my addr 172.21.15.19:0/2675376856 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:13.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.544+0000 7f3a837fe640 1 --2- 172.21.15.19:0/2675376856 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556e7053bdc0 0x556e7054a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:13.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.544+0000 7f3a7bfff640 1 --2- 172.21.15.19:0/2675376856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556e7053b4a0 0x556e70549e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:13.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.544+0000 7f3a82ffd640 1 -- 172.21.15.19:0/2675376856 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556e7053bdc0 msgr2=0x556e7054a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:13.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.544+0000 7f3a82ffd640 1 --2- 172.21.15.19:0/2675376856 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556e7053bdc0 0x556e7054a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:13.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.544+0000 7f3a82ffd640 1 -- 172.21.15.19:0/2675376856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556e7053b4a0 msgr2=0x556e70549e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:13.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.544+0000 7f3a82ffd640 1 --2- 172.21.15.19:0/2675376856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556e7053b4a0 0x556e70549e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:13.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.544+0000 7f3a82ffd640 1 -- 172.21.15.19:0/2675376856 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556e7054a920 con 0x556e70537a30 2024-09-19T08:56:13.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.544+0000 7f3a82ffd640 1 --2- 172.21.15.19:0/2675376856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e70537a30 0x556e7054eaf0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f3a740038e0 tx=0x7f3a7402bc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6123186789a3b04d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:13.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.544+0000 7f3a6a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:56:13.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.544+0000 7f3a6a7fc640 1 -- 172.21.15.19:0/2675376856 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7402b5d0 con 0x556e70537a30 2024-09-19T08:56:13.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.544+0000 7f3a8b9c6740 1 -- 172.21.15.19:0/2675376856 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a7402b420 con 0x556e70537a30 2024-09-19T08:56:13.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.544+0000 7f3a6a7fc640 1 -- 172.21.15.19:0/2675376856 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f3a7402b770 con 0x556e70537a30 2024-09-19T08:56:13.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.545+0000 7f3a6a7fc640 1 -- 172.21.15.19:0/2675376856 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f3a7401f900 con 0x556e70537a30 2024-09-19T08:56:13.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.545+0000 7f3a8b9c6740 10 client.16317 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:13.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.545+0000 7f3a8b9c6740 1 -- 172.21.15.19:0/2675376856 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x556e705c09c0 con 0x556e70537a30 2024-09-19T08:56:13.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.545+0000 7f3a6a7fc640 1 -- 172.21.15.19:0/2675376856 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3a7402b420 con 0x556e70537a30 2024-09-19T08:56:13.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.545+0000 7f3a6a7fc640 1 -- 172.21.15.19:0/2675376856 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f3a7403d070 con 0x556e70537a30 2024-09-19T08:56:13.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.545+0000 7f3a8b9c6740 10 client.16317 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:13.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.545+0000 7f3a8b9c6740 10 client.16317 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:56:13.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.545+0000 7f3a8b9c6740 20 client.16317 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:13.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.545+0000 7f3a8b9c6740 1 --2- 172.21.15.19:0/2675376856 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x556e70546680 0x556e705c30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:13.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.545+0000 7f3a8b9c6740 4 client.16317 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:56:13.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.545+0000 7f3a8b9c6740 1 -- 172.21.15.19:0/2675376856 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556e704a8d60 con 0x556e70546680 2024-09-19T08:56:13.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.545+0000 7f3a7bfff640 1 --2- 172.21.15.19:0/2675376856 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x556e70546680 0x556e705c30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:13.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.546+0000 7f3a7bfff640 1 --2- 172.21.15.19:0/2675376856 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x556e70546680 0x556e705c30a0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98676859784c5e3e server_cookie=1052a6f30352eda3 in_seq=0 out_seq=0 2024-09-19T08:56:13.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.546+0000 7f3a6a7fc640 10 client.16317 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:13.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.547+0000 7f3a6a7fc640 1 -- 172.21.15.19:0/2675376856 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+267 (crc 0 0 0) 0x556e704a8d60 con 0x556e70546680 2024-09-19T08:56:13.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.547+0000 7f3a6a7fc640 10 client.16317 handle_command_reply: tid=0 2024-09-19T08:56:13.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.547+0000 7f3a8b9c6740 1 client.16317 shutdown 2024-09-19T08:56:13.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.547+0000 7f3a8b9c6740 1 -- 172.21.15.19:0/2675376856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e70537a30 msgr2=0x556e7054eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:13.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.547+0000 7f3a8b9c6740 1 --2- 172.21.15.19:0/2675376856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e70537a30 0x556e7054eaf0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f3a740038e0 tx=0x7f3a7402bc00 comp rx=0 tx=0).stop 2024-09-19T08:56:13.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.547+0000 7f3a8b9c6740 1 -- 172.21.15.19:0/2675376856 shutdown_connections 2024-09-19T08:56:13.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.547+0000 7f3a8b9c6740 1 --2- 172.21.15.19:0/2675376856 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x556e70546680 0x556e705c30a0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:13.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.547+0000 7f3a8b9c6740 1 --2- 172.21.15.19:0/2675376856 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556e7053bdc0 0x556e7054a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:13.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.547+0000 7f3a8b9c6740 1 --2- 172.21.15.19:0/2675376856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556e7053b4a0 0x556e70549e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:13.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.547+0000 7f3a6a7fc640 0 client.16317 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:13.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.547+0000 7f3a8b9c6740 1 --2- 172.21.15.19:0/2675376856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556e70537a30 0x556e7054eaf0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:13.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.547+0000 7f3a8b9c6740 1 -- 172.21.15.19:0/2675376856 >> 172.21.15.19:0/2675376856 conn(0x556e705438f0 msgr2=0x556e705419f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:13.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.547+0000 7f3a8b9c6740 1 -- 172.21.15.19:0/2675376856 shutdown_connections 2024-09-19T08:56:13.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.547+0000 7f3a8b9c6740 1 -- 172.21.15.19:0/2675376856 wait complete. 2024-09-19T08:56:13.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.547+0000 7f3a8b9c6740 20 client.16317 trim_cache size 0 max 16384 2024-09-19T08:56:13.554 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:56:13.554 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "scrub active (929 inodes in the stack)", 2024-09-19T08:56:13.554 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-19T08:56:13.554 INFO:teuthology.orchestra.run.smithi019.stdout: "e95d7067-22e9-4e7f-a9aa-c6bd996a2696": { 2024-09-19T08:56:13.554 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-19T08:56:13.554 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "e95d7067-22e9-4e7f-a9aa-c6bd996a2696", 2024-09-19T08:56:13.554 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-19T08:56:13.554 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:56:13.554 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:56:13.554 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:56:13.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.548+0000 7f3a895ed640 1 -- 172.21.15.19:0/1099144290 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3a700a3240 msgr2=0x7f3a700a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:13.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.548+0000 7f3a895ed640 1 --2- 172.21.15.19:0/1099144290 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3a700a3240 0x7f3a700a5700 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x556e70538890 tx=0x7f3a74005f90 comp rx=0 tx=0).stop 2024-09-19T08:56:13.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.548+0000 7f3a895ed640 1 -- 172.21.15.19:0/1099144290 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a84074ee0 msgr2=0x7f3a8419ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:13.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.548+0000 7f3a895ed640 1 --2- 172.21.15.19:0/1099144290 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a84074ee0 0x7f3a8419ab90 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f3a6c006010 tx=0x7f3a6c004040 comp rx=0 tx=0).stop 2024-09-19T08:56:13.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.548+0000 7f3a895ed640 1 -- 172.21.15.19:0/1099144290 shutdown_connections 2024-09-19T08:56:13.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.548+0000 7f3a895ed640 1 --2- 172.21.15.19:0/1099144290 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3a700a3240 0x7f3a700a5700 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:13.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.548+0000 7f3a895ed640 1 --2- 172.21.15.19:0/1099144290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3a8410e420 0x7f3a8419ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:13.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.548+0000 7f3a895ed640 1 --2- 172.21.15.19:0/1099144290 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3a84074ee0 0x7f3a8419ab90 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:13.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.548+0000 7f3a895ed640 1 --2- 172.21.15.19:0/1099144290 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a840745c0 0x7f3a8419a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:13.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.548+0000 7f3a895ed640 1 -- 172.21.15.19:0/1099144290 >> 172.21.15.19:0/1099144290 conn(0x7f3a840fd8c0 msgr2=0x7f3a840fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:13.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.548+0000 7f3a895ed640 1 -- 172.21.15.19:0/1099144290 shutdown_connections 2024-09-19T08:56:13.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:13.548+0000 7f3a895ed640 1 -- 172.21.15.19:0/1099144290 wait complete. 2024-09-19T08:56:13.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:13 smithi155 ceph-mon[34921]: pgmap v457: 97 pgs: 97 active+clean; 5.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 812 KiB/s wr, 411 op/s 2024-09-19T08:56:13.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:13 smithi203 ceph-mon[35450]: pgmap v457: 97 pgs: 97 active+clean; 5.3 MiB data, 378 MiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 812 KiB/s wr, 411 op/s 2024-09-19T08:56:14.585 INFO:tasks.cephfs.filesystem:scrub status for tag:e95d7067-22e9-4e7f-a9aa-c6bd996a2696 - {'path': '/', 'tag': 'e95d7067-22e9-4e7f-a9aa-c6bd996a2696', 'options': 'recursive,force'} 2024-09-19T08:56:15.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:15 smithi155 ceph-mon[34921]: pgmap v458: 97 pgs: 97 active+clean; 13 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 616 op/s 2024-09-19T08:56:15.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:15 smithi203 ceph-mon[35450]: pgmap v458: 97 pgs: 97 active+clean; 13 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 616 op/s 2024-09-19T08:56:15.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:15 smithi019 ceph-mon[30976]: pgmap v458: 97 pgs: 97 active+clean; 13 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 616 op/s 2024-09-19T08:56:17.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:17 smithi155 ceph-mon[34921]: pgmap v459: 97 pgs: 97 active+clean; 13 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 622 op/s 2024-09-19T08:56:17.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:17 smithi203 ceph-mon[35450]: pgmap v459: 97 pgs: 97 active+clean; 13 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 622 op/s 2024-09-19T08:56:17.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:17 smithi019 ceph-mon[30976]: pgmap v459: 97 pgs: 97 active+clean; 13 MiB data, 420 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 622 op/s 2024-09-19T08:56:18.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:18.527+0000 7f72a5ffb640 1 -- 172.21.15.19:0/2833789200 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x558788d04d20 con 0x558788e1e360 2024-09-19T08:56:18.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:18.527+0000 7f72a5ffb640 10 client.25808 handle_command_reply: tid=0 2024-09-19T08:56:18.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:18.527+0000 7f72c7153740 1 client.25808 shutdown 2024-09-19T08:56:18.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:18.528+0000 7f72c7153740 1 -- 172.21.15.19:0/2833789200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558788d98080 msgr2=0x558788da7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:18.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:18.528+0000 7f72c7153740 1 --2- 172.21.15.19:0/2833789200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558788d98080 0x558788da7520 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f72a8000c00 tx=0x7f72a80049c0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:18.528+0000 7f72c7153740 1 -- 172.21.15.19:0/2833789200 shutdown_connections 2024-09-19T08:56:18.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:18.528+0000 7f72c7153740 1 --2- 172.21.15.19:0/2833789200 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x558788e1e360 0x558788e20750 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:18.528+0000 7f72c7153740 1 --2- 172.21.15.19:0/2833789200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558788da2940 0x558788e16430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:18.528+0000 7f72c7153740 1 --2- 172.21.15.19:0/2833789200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558788d98080 0x558788da7520 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:18.528+0000 7f72c7153740 1 --2- 172.21.15.19:0/2833789200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558788d97760 0x558788da6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:18.528+0000 7f72c7153740 1 -- 172.21.15.19:0/2833789200 >> 172.21.15.19:0/2833789200 conn(0x558788d93cf0 msgr2=0x558788dad7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:18.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:18.528+0000 7f72a5ffb640 0 client.25808 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:18.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:18.528+0000 7f72c7153740 1 -- 172.21.15.19:0/2833789200 shutdown_connections 2024-09-19T08:56:18.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:18.528+0000 7f72c7153740 1 -- 172.21.15.19:0/2833789200 wait complete. 2024-09-19T08:56:18.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:18.528+0000 7f72c7153740 20 client.25808 trim_cache size 0 max 16384 2024-09-19T08:56:18.530 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:56:18.530 INFO:teuthology.orchestra.run.smithi019.stdout: "epoch": 33, 2024-09-19T08:56:18.530 INFO:teuthology.orchestra.run.smithi019.stdout: "leader": 24497, 2024-09-19T08:56:18.530 INFO:teuthology.orchestra.run.smithi019.stdout: "set_version": 14, 2024-09-19T08:56:18.530 INFO:teuthology.orchestra.run.smithi019.stdout: "sets": { 2024-09-19T08:56:18.531 INFO:teuthology.orchestra.run.smithi019.stdout: "725423db": { 2024-09-19T08:56:18.531 INFO:teuthology.orchestra.run.smithi019.stdout: "version": 14, 2024-09-19T08:56:18.531 INFO:teuthology.orchestra.run.smithi019.stdout: "age_ref": 0.0, 2024-09-19T08:56:18.531 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T08:56:18.531 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "QUIESCED", 2024-09-19T08:56:18.531 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T08:56:18.531 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T08:56:18.531 INFO:teuthology.orchestra.run.smithi019.stdout: "timeout": 90.0, 2024-09-19T08:56:18.531 INFO:teuthology.orchestra.run.smithi019.stdout: "expiration": 136.6, 2024-09-19T08:56:18.531 INFO:teuthology.orchestra.run.smithi019.stdout: "members": { 2024-09-19T08:56:18.531 INFO:teuthology.orchestra.run.smithi019.stdout: "file:/": { 2024-09-19T08:56:18.531 INFO:teuthology.orchestra.run.smithi019.stdout: "excluded": false, 2024-09-19T08:56:18.531 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T08:56:18.531 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "QUIESCED", 2024-09-19T08:56:18.532 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T08:56:18.532 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:56:18.532 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:56:18.532 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:56:18.532 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:56:18.532 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:56:18.532 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:56:18.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:18.529+0000 7f72c4d7a640 1 -- 172.21.15.19:0/1900724984 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f72ac0a32c0 msgr2=0x7f72ac0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:18.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:18.529+0000 7f72c4d7a640 1 --2- 172.21.15.19:0/1900724984 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f72ac0a32c0 0x7f72ac0a5780 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f72b8005e30 tx=0x7f72b8005c50 comp rx=0 tx=0).stop 2024-09-19T08:56:18.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:18.529+0000 7f72c4d7a640 1 -- 172.21.15.19:0/1900724984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72c0100e20 msgr2=0x7f72c00fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:18.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:18.529+0000 7f72c4d7a640 1 --2- 172.21.15.19:0/1900724984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72c0100e20 0x7f72c00fcc80 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f72b000d950 tx=0x7f72b000de10 comp rx=0 tx=0).stop 2024-09-19T08:56:18.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:18.529+0000 7f72c4d7a640 1 -- 172.21.15.19:0/1900724984 shutdown_connections 2024-09-19T08:56:18.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:18.529+0000 7f72c4d7a640 1 --2- 172.21.15.19:0/1900724984 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f72ac0a32c0 0x7f72ac0a5780 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:18.529+0000 7f72c4d7a640 1 --2- 172.21.15.19:0/1900724984 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72c0102ef0 0x7f72c00fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:18.529+0000 7f72c4d7a640 1 --2- 172.21.15.19:0/1900724984 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f72c0102570 0x7f72c00fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:18.529+0000 7f72c4d7a640 1 --2- 172.21.15.19:0/1900724984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f72c0100e20 0x7f72c00fcc80 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:18.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:18.529+0000 7f72c4d7a640 1 -- 172.21.15.19:0/1900724984 >> 172.21.15.19:0/1900724984 conn(0x7f72c00fc7d0 msgr2=0x7f72c006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:18.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:18.529+0000 7f72c4d7a640 1 -- 172.21.15.19:0/1900724984 shutdown_connections 2024-09-19T08:56:18.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:18.529+0000 7f72c4d7a640 1 -- 172.21.15.19:0/1900724984 wait complete. 2024-09-19T08:56:19.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:19 smithi155 ceph-mon[34921]: pgmap v460: 97 pgs: 97 active+clean; 13 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 625 op/s 2024-09-19T08:56:19.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:19 smithi203 ceph-mon[35450]: pgmap v460: 97 pgs: 97 active+clean; 13 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 625 op/s 2024-09-19T08:56:19.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:19 smithi019 ceph-mon[30976]: pgmap v460: 97 pgs: 97 active+clean; 13 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 625 op/s 2024-09-19T08:56:20.123 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '725423db', quiesce took 13.6 seconds. Will release after: 3.0000000000000018 2024-09-19T08:56:20.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:20 smithi155 ceph-mon[34921]: scrub summary: idle+waiting paths [/] 2024-09-19T08:56:20.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:20 smithi155 ceph-mon[34921]: scrub summary: idle 2024-09-19T08:56:20.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:20 smithi203 ceph-mon[35450]: scrub summary: idle+waiting paths [/] 2024-09-19T08:56:20.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:20 smithi203 ceph-mon[35450]: scrub summary: idle 2024-09-19T08:56:20.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:20 smithi019 ceph-mon[30976]: scrub summary: idle+waiting paths [/] 2024-09-19T08:56:20.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:20 smithi019 ceph-mon[30976]: scrub summary: idle 2024-09-19T08:56:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.937+0000 7f913592c640 1 -- 172.21.15.19:0/2041436393 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9130103710 msgr2=0x7f9130109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.937+0000 7f913592c640 1 --2- 172.21.15.19:0/2041436393 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9130103710 0x7f9130109fa0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f9128009ca0 tx=0x7f912802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:56:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.937+0000 7f913592c640 1 -- 172.21.15.19:0/2041436393 shutdown_connections 2024-09-19T08:56:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.937+0000 7f913592c640 1 --2- 172.21.15.19:0/2041436393 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9130102d50 0x7f91301031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.937+0000 7f913592c640 1 --2- 172.21.15.19:0/2041436393 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9130103710 0x7f9130109fa0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.937+0000 7f913592c640 1 --2- 172.21.15.19:0/2041436393 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9130101b60 0x7f9130101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.937+0000 7f913592c640 1 -- 172.21.15.19:0/2041436393 >> 172.21.15.19:0/2041436393 conn(0x7f91300fd2e0 msgr2=0x7f91300ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.937+0000 7f913592c640 1 -- 172.21.15.19:0/2041436393 shutdown_connections 2024-09-19T08:56:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.937+0000 7f913592c640 1 -- 172.21.15.19:0/2041436393 wait complete. 2024-09-19T08:56:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.938+0000 7f913592c640 1 Processor -- start 2024-09-19T08:56:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.938+0000 7f913592c640 1 -- start start 2024-09-19T08:56:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.938+0000 7f913592c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9130101b60 0x7f9130197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:20.941 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.938+0000 7f913592c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9130102d50 0x7f9130198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:20.941 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.938+0000 7f913592c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9130103710 0x7f913019f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:20.941 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.938+0000 7f913592c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f913010d7e0 con 0x7f9130101b60 2024-09-19T08:56:20.941 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.938+0000 7f913592c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f913010d660 con 0x7f9130102d50 2024-09-19T08:56:20.941 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.938+0000 7f913592c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f913010d960 con 0x7f9130103710 2024-09-19T08:56:20.941 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.938+0000 7f912effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9130101b60 0x7f9130197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:20.941 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.938+0000 7f912effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9130101b60 0x7f9130197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59356/0 (socket says 172.21.15.19:59356) 2024-09-19T08:56:20.941 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.938+0000 7f912effd640 1 -- 172.21.15.19:0/299255383 learned_addr learned my addr 172.21.15.19:0/299255383 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:20.941 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.938+0000 7f912e7fc640 1 --2- 172.21.15.19:0/299255383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9130102d50 0x7f9130198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:20.941 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.939+0000 7f912effd640 1 -- 172.21.15.19:0/299255383 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9130103710 msgr2=0x7f913019f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:20.941 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.939+0000 7f912effd640 1 --2- 172.21.15.19:0/299255383 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9130103710 0x7f913019f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:20.942 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.939+0000 7f912effd640 1 -- 172.21.15.19:0/299255383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9130102d50 msgr2=0x7f9130198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:20.942 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.939+0000 7f912effd640 1 --2- 172.21.15.19:0/299255383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9130102d50 0x7f9130198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:20.942 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.939+0000 7f912effd640 1 -- 172.21.15.19:0/299255383 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f913019f9f0 con 0x7f9130101b60 2024-09-19T08:56:20.942 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.939+0000 7f912effd640 1 --2- 172.21.15.19:0/299255383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9130101b60 0x7f9130197dd0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f912000d770 tx=0x7f912000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:20.942 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.939+0000 7f913492a640 1 -- 172.21.15.19:0/299255383 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9120017070 con 0x7f9130101b60 2024-09-19T08:56:20.942 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.939+0000 7f913492a640 1 -- 172.21.15.19:0/299255383 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9120009c30 con 0x7f9130101b60 2024-09-19T08:56:20.942 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.939+0000 7f913592c640 1 -- 172.21.15.19:0/299255383 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f913019fce0 con 0x7f9130101b60 2024-09-19T08:56:20.942 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.939+0000 7f913492a640 1 -- 172.21.15.19:0/299255383 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9120003dd0 con 0x7f9130101b60 2024-09-19T08:56:20.942 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.939+0000 7f913592c640 1 -- 172.21.15.19:0/299255383 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91301a0180 con 0x7f9130101b60 2024-09-19T08:56:20.950 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.941+0000 7f913492a640 1 -- 172.21.15.19:0/299255383 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f9120003fb0 con 0x7f9130101b60 2024-09-19T08:56:20.950 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.941+0000 7f91386be740 1 Processor -- start 2024-09-19T08:56:20.950 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.942+0000 7f91386be740 1 -- start start 2024-09-19T08:56:20.950 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.942+0000 7f91386be740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55788be3f9a0 0x55788be3fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:20.950 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.942+0000 7f91386be740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55788be402e0 0x55788be44da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:20.950 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.942+0000 7f91386be740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55788be45370 0x55788be47830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:20.950 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.942+0000 7f91386be740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55788bda32f0 con 0x55788be3f9a0 2024-09-19T08:56:20.950 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.942+0000 7f91386be740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55788bd4b270 con 0x55788be402e0 2024-09-19T08:56:20.950 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.942+0000 7f91386be740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55788bd9f2b0 con 0x55788be45370 2024-09-19T08:56:20.950 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.942+0000 7f912f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55788be3f9a0 0x55788be3fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.942+0000 7f912f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55788be3f9a0 0x55788be3fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59364/0 (socket says 172.21.15.19:59364) 2024-09-19T08:56:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.942+0000 7f912f7fe640 1 -- 172.21.15.19:0/3102072456 learned_addr learned my addr 172.21.15.19:0/3102072456 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.942+0000 7f912e7fc640 1 --2- 172.21.15.19:0/3102072456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55788be45370 0x55788be47830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.942+0000 7f912effd640 1 --2- 172.21.15.19:0/3102072456 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55788be402e0 0x55788be44da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.942+0000 7f913492a640 1 --2- 172.21.15.19:0/299255383 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f91180a32f0 0x7f91180a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.942+0000 7f912e7fc640 1 -- 172.21.15.19:0/3102072456 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55788be402e0 msgr2=0x55788be44da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.942+0000 7f912e7fc640 1 --2- 172.21.15.19:0/3102072456 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55788be402e0 0x55788be44da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.942+0000 7f912e7fc640 1 -- 172.21.15.19:0/3102072456 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55788be3f9a0 msgr2=0x55788be3fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.942+0000 7f912e7fc640 1 --2- 172.21.15.19:0/3102072456 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55788be3f9a0 0x55788be3fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.942+0000 7f912e7fc640 1 -- 172.21.15.19:0/3102072456 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55788bd4a340 con 0x55788be45370 2024-09-19T08:56:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.942+0000 7f912f7fe640 1 --2- 172.21.15.19:0/299255383 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f91180a32f0 0x7f91180a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.943+0000 7f913492a640 1 -- 172.21.15.19:0/299255383 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f91200cf360 con 0x7f9130101b60 2024-09-19T08:56:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.943+0000 7f912e7fc640 1 --2- 172.21.15.19:0/3102072456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55788be45370 0x55788be47830 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9124009b40 tx=0x7f91240113e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f727ae4f3faee123 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.943+0000 7f9115ffb640 1 -- 172.21.15.19:0/3102072456 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9124011d90 con 0x55788be45370 2024-09-19T08:56:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.943+0000 7f9115ffb640 1 -- 172.21.15.19:0/3102072456 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9124012930 con 0x55788be45370 2024-09-19T08:56:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.943+0000 7f9115ffb640 1 -- 172.21.15.19:0/3102072456 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912400faa0 con 0x55788be45370 2024-09-19T08:56:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.944+0000 7f91386be740 1 -- 172.21.15.19:0/3102072456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55788be45370 msgr2=0x55788be47830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.944+0000 7f91386be740 1 --2- 172.21.15.19:0/3102072456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55788be45370 0x55788be47830 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9124009b40 tx=0x7f91240113e0 comp rx=0 tx=0).stop 2024-09-19T08:56:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.944+0000 7f912f7fe640 1 --2- 172.21.15.19:0/299255383 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f91180a32f0 0x7f91180a57b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9128031c10 tx=0x7f9128004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.944+0000 7f91386be740 1 -- 172.21.15.19:0/3102072456 shutdown_connections 2024-09-19T08:56:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.944+0000 7f91386be740 1 --2- 172.21.15.19:0/3102072456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55788be45370 0x55788be47830 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.944+0000 7f91386be740 1 --2- 172.21.15.19:0/3102072456 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55788be402e0 0x55788be44da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.944+0000 7f91386be740 1 --2- 172.21.15.19:0/3102072456 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55788be3f9a0 0x55788be3fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.944+0000 7f91386be740 1 -- 172.21.15.19:0/3102072456 >> 172.21.15.19:0/3102072456 conn(0x55788be3b010 msgr2=0x55788be3b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.944+0000 7f91386be740 1 -- 172.21.15.19:0/3102072456 shutdown_connections 2024-09-19T08:56:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.944+0000 7f91386be740 1 -- 172.21.15.19:0/3102072456 wait complete. 2024-09-19T08:56:20.952 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.944+0000 7f91386be740 1 -- start start 2024-09-19T08:56:20.953 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.944+0000 7f91386be740 1 Processor -- start 2024-09-19T08:56:20.953 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.945+0000 7f91386be740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55788be3f9a0 0x55788be49b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:20.953 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.945+0000 7f91386be740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55788be402e0 0x55788be4a040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:20.953 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.945+0000 7f91386be740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55788be45370 0x55788be51080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:20.953 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.945+0000 7f91386be740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55788be48340 con 0x55788be3f9a0 2024-09-19T08:56:20.953 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.945+0000 7f91386be740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55788bd2c290 con 0x55788be45370 2024-09-19T08:56:20.953 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.945+0000 7f91386be740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55788be484c0 con 0x55788be402e0 2024-09-19T08:56:20.953 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.945+0000 7f91386be740 10 client.0 _ll_register_callbacks cb 0x55788bd5d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:20.953 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.945+0000 7f912effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55788be3f9a0 0x55788be49b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:20.953 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.945+0000 7f912effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55788be3f9a0 0x55788be49b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59372/0 (socket says 172.21.15.19:59372) 2024-09-19T08:56:20.953 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.945+0000 7f912effd640 1 -- 172.21.15.19:0/2789539986 learned_addr learned my addr 172.21.15.19:0/2789539986 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:20.953 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.945+0000 7f912e7fc640 1 --2- 172.21.15.19:0/2789539986 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55788be402e0 0x55788be4a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:20.953 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.945+0000 7f912f7fe640 1 --2- 172.21.15.19:0/2789539986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55788be45370 0x55788be51080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:20.953 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.945+0000 7f912effd640 1 -- 172.21.15.19:0/2789539986 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55788be402e0 msgr2=0x55788be4a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.945+0000 7f912effd640 1 --2- 172.21.15.19:0/2789539986 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55788be402e0 0x55788be4a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.945+0000 7f912effd640 1 -- 172.21.15.19:0/2789539986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55788be45370 msgr2=0x55788be51080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.945+0000 7f912effd640 1 --2- 172.21.15.19:0/2789539986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55788be45370 0x55788be51080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.945+0000 7f912effd640 1 -- 172.21.15.19:0/2789539986 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55788bab6210 con 0x55788be3f9a0 2024-09-19T08:56:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.945+0000 7f912f7fe640 1 --2- 172.21.15.19:0/2789539986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55788be45370 0x55788be51080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.945+0000 7f912effd640 1 --2- 172.21.15.19:0/2789539986 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55788be3f9a0 0x55788be49b00 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f912009b690 tx=0x7f91200036b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7178bc23952e4966 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.945+0000 7f910effd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:56:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.946+0000 7f910effd640 1 -- 172.21.15.19:0/2789539986 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9120020070 con 0x55788be3f9a0 2024-09-19T08:56:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.946+0000 7f910effd640 1 -- 172.21.15.19:0/2789539986 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f91200860b0 con 0x55788be3f9a0 2024-09-19T08:56:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.946+0000 7f91386be740 1 -- 172.21.15.19:0/2789539986 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9124012930 con 0x55788be3f9a0 2024-09-19T08:56:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.946+0000 7f910effd640 1 -- 172.21.15.19:0/2789539986 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f912009b4d0 con 0x55788be3f9a0 2024-09-19T08:56:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.946+0000 7f91386be740 10 client.16329 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.946+0000 7f91386be740 1 -- 172.21.15.19:0/2789539986 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55788bb82620 con 0x55788be3f9a0 2024-09-19T08:56:20.954 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.946+0000 7f910effd640 1 -- 172.21.15.19:0/2789539986 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9124012930 con 0x55788be3f9a0 2024-09-19T08:56:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.946+0000 7f910effd640 1 -- 172.21.15.19:0/2789539986 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f9120084ce0 con 0x55788be3f9a0 2024-09-19T08:56:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.946+0000 7f91386be740 10 client.16329 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.946+0000 7f91386be740 10 client.16329 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:56:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.946+0000 7f91386be740 20 client.16329 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.946+0000 7f91386be740 1 --2- 172.21.15.19:0/2789539986 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55788be557c0 0x55788be57bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.946+0000 7f91386be740 4 client.16329 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:56:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.946+0000 7f91386be740 1 -- 172.21.15.19:0/2789539986 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55788bdb0a20 con 0x55788be557c0 2024-09-19T08:56:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.947+0000 7f912e7fc640 1 --2- 172.21.15.19:0/2789539986 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55788be557c0 0x55788be57bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.947+0000 7f912e7fc640 1 --2- 172.21.15.19:0/2789539986 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55788be557c0 0x55788be57bb0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79907ed594adaf27 server_cookie=aeaf488630cd5cf in_seq=0 out_seq=0 2024-09-19T08:56:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.947+0000 7f910effd640 10 client.16329 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.948+0000 7f910effd640 1 -- 172.21.15.19:0/2789539986 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55788bdb0a20 con 0x55788be557c0 2024-09-19T08:56:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.948+0000 7f910effd640 10 client.16329 handle_command_reply: tid=0 2024-09-19T08:56:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.948+0000 7f91386be740 1 client.16329 shutdown 2024-09-19T08:56:20.955 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.948+0000 7f91386be740 1 -- 172.21.15.19:0/2789539986 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55788be3f9a0 msgr2=0x55788be49b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.948+0000 7f91386be740 1 --2- 172.21.15.19:0/2789539986 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55788be3f9a0 0x55788be49b00 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f912009b690 tx=0x7f91200036b0 comp rx=0 tx=0).stop 2024-09-19T08:56:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.948+0000 7f91386be740 1 -- 172.21.15.19:0/2789539986 shutdown_connections 2024-09-19T08:56:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.948+0000 7f91386be740 1 --2- 172.21.15.19:0/2789539986 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55788be557c0 0x55788be57bb0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.948+0000 7f91386be740 1 --2- 172.21.15.19:0/2789539986 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55788be402e0 0x55788be4a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.948+0000 7f91386be740 1 --2- 172.21.15.19:0/2789539986 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55788be45370 0x55788be51080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.948+0000 7f910effd640 0 client.16329 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.948+0000 7f91386be740 1 --2- 172.21.15.19:0/2789539986 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55788be3f9a0 0x55788be49b00 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.948+0000 7f91386be740 1 -- 172.21.15.19:0/2789539986 >> 172.21.15.19:0/2789539986 conn(0x55788be3b010 msgr2=0x55788be3c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.948+0000 7f91386be740 1 -- 172.21.15.19:0/2789539986 shutdown_connections 2024-09-19T08:56:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.948+0000 7f91386be740 1 -- 172.21.15.19:0/2789539986 wait complete. 2024-09-19T08:56:20.956 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.948+0000 7f91386be740 20 client.16329 trim_cache size 0 max 16384 2024-09-19T08:56:20.965 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.963+0000 7f91386be740 1 Processor -- start 2024-09-19T08:56:20.965 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.963+0000 7f91386be740 1 -- start start 2024-09-19T08:56:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.963+0000 7f91386be740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55788be3f9a0 0x55788be49f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.963+0000 7f91386be740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55788be402e0 0x55788be50fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.963+0000 7f91386be740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55788be45370 0x55788be5c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.963+0000 7f91386be740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f91301a8f80 con 0x55788be3f9a0 2024-09-19T08:56:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.963+0000 7f91386be740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f91301aaaf0 con 0x55788be45370 2024-09-19T08:56:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.963+0000 7f91386be740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f91301a9650 con 0x55788be402e0 2024-09-19T08:56:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.963+0000 7f912effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55788be3f9a0 0x55788be49f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.963+0000 7f912effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55788be3f9a0 0x55788be49f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59384/0 (socket says 172.21.15.19:59384) 2024-09-19T08:56:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.963+0000 7f912effd640 1 -- 172.21.15.19:0/2928795216 learned_addr learned my addr 172.21.15.19:0/2928795216 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.964+0000 7f912e7fc640 1 --2- 172.21.15.19:0/2928795216 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55788be402e0 0x55788be50fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.964+0000 7f912effd640 1 -- 172.21.15.19:0/2928795216 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55788be402e0 msgr2=0x55788be50fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.964+0000 7f912f7fe640 1 --2- 172.21.15.19:0/2928795216 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55788be45370 0x55788be5c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.964+0000 7f912effd640 1 --2- 172.21.15.19:0/2928795216 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55788be402e0 0x55788be50fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.964+0000 7f912effd640 1 -- 172.21.15.19:0/2928795216 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55788be45370 msgr2=0x55788be5c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.964+0000 7f912effd640 1 --2- 172.21.15.19:0/2928795216 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55788be45370 0x55788be5c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.964+0000 7f912effd640 1 -- 172.21.15.19:0/2928795216 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55788be57f20 con 0x55788be3f9a0 2024-09-19T08:56:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.964+0000 7f912effd640 1 --2- 172.21.15.19:0/2928795216 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55788be3f9a0 0x55788be49f20 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f912009b920 tx=0x7f9120097560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2047d67317817aa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.964+0000 7f91157fa640 1 -- 172.21.15.19:0/2928795216 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9120020050 con 0x55788be3f9a0 2024-09-19T08:56:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.964+0000 7f91157fa640 1 -- 172.21.15.19:0/2928795216 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9120009de0 con 0x55788be3f9a0 2024-09-19T08:56:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.964+0000 7f91157fa640 1 -- 172.21.15.19:0/2928795216 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912009b2f0 con 0x55788be3f9a0 2024-09-19T08:56:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.965+0000 7f91386be740 1 -- 172.21.15.19:0/2928795216 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55788be3f9a0 msgr2=0x55788be49f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.965+0000 7f91386be740 1 --2- 172.21.15.19:0/2928795216 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55788be3f9a0 0x55788be49f20 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f912009b920 tx=0x7f9120097560 comp rx=0 tx=0).stop 2024-09-19T08:56:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.965+0000 7f91386be740 1 -- 172.21.15.19:0/2928795216 shutdown_connections 2024-09-19T08:56:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.965+0000 7f91386be740 1 --2- 172.21.15.19:0/2928795216 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55788be402e0 0x55788be50fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.965+0000 7f91386be740 1 --2- 172.21.15.19:0/2928795216 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55788be45370 0x55788be5c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.965+0000 7f91386be740 1 --2- 172.21.15.19:0/2928795216 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55788be3f9a0 0x55788be49f20 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:20.968 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.965+0000 7f91386be740 1 -- 172.21.15.19:0/2928795216 >> 172.21.15.19:0/2928795216 conn(0x55788be3b010 msgr2=0x55788be3a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:20.968 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.965+0000 7f91386be740 1 -- 172.21.15.19:0/2928795216 shutdown_connections 2024-09-19T08:56:20.968 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.965+0000 7f91386be740 1 -- 172.21.15.19:0/2928795216 wait complete. 2024-09-19T08:56:20.968 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.965+0000 7f91386be740 1 -- start start 2024-09-19T08:56:20.968 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.965+0000 7f91386be740 1 Processor -- start 2024-09-19T08:56:20.970 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.965+0000 7f91386be740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55788be3f9a0 0x55788be4e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:20.970 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.966+0000 7f91386be740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55788be402e0 0x55788be4ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:20.970 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.966+0000 7f91386be740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55788be45370 0x55788be4fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:20.970 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.966+0000 7f91386be740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f91301aa420 con 0x55788be402e0 2024-09-19T08:56:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.966+0000 7f91386be740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f91301a9d50 con 0x55788be3f9a0 2024-09-19T08:56:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.966+0000 7f91386be740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f91301a6f60 con 0x55788be45370 2024-09-19T08:56:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.966+0000 7f91386be740 10 client.0 _ll_register_callbacks cb 0x7f912000d6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.966+0000 7f912e7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55788be402e0 0x55788be4ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.966+0000 7f912e7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55788be402e0 0x55788be4ec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59386/0 (socket says 172.21.15.19:59386) 2024-09-19T08:56:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.966+0000 7f912e7fc640 1 -- 172.21.15.19:0/2685379826 learned_addr learned my addr 172.21.15.19:0/2685379826 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.966+0000 7f912f7fe640 1 --2- 172.21.15.19:0/2685379826 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55788be45370 0x55788be4fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.966+0000 7f912effd640 1 --2- 172.21.15.19:0/2685379826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55788be3f9a0 0x55788be4e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.966+0000 7f912e7fc640 1 -- 172.21.15.19:0/2685379826 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55788be45370 msgr2=0x55788be4fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.966+0000 7f912e7fc640 1 --2- 172.21.15.19:0/2685379826 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55788be45370 0x55788be4fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.966+0000 7f912e7fc640 1 -- 172.21.15.19:0/2685379826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55788be3f9a0 msgr2=0x55788be4e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.966+0000 7f912e7fc640 1 --2- 172.21.15.19:0/2685379826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55788be3f9a0 0x55788be4e750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.966+0000 7f912e7fc640 1 -- 172.21.15.19:0/2685379826 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55788be502b0 con 0x55788be402e0 2024-09-19T08:56:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.966+0000 7f912f7fe640 1 --2- 172.21.15.19:0/2685379826 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55788be45370 0x55788be4fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.966+0000 7f912e7fc640 1 --2- 172.21.15.19:0/2685379826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55788be402e0 0x55788be4ec90 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x55788be3be90 tx=0x7f91240095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8952705ae192adb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.966+0000 7f910effd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:56:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.966+0000 7f910effd640 1 -- 172.21.15.19:0/2685379826 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91240052d0 con 0x55788be402e0 2024-09-19T08:56:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.966+0000 7f91386be740 1 -- 172.21.15.19:0/2685379826 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9120009de0 con 0x55788be402e0 2024-09-19T08:56:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.966+0000 7f910effd640 1 -- 172.21.15.19:0/2685379826 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9124005470 con 0x55788be402e0 2024-09-19T08:56:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.966+0000 7f910effd640 1 -- 172.21.15.19:0/2685379826 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f9124005670 con 0x55788be402e0 2024-09-19T08:56:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.966+0000 7f91386be740 10 client.16335 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.967+0000 7f91386be740 1 -- 172.21.15.19:0/2685379826 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55788bec05e0 con 0x55788be402e0 2024-09-19T08:56:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.967+0000 7f910effd640 1 -- 172.21.15.19:0/2685379826 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9120009de0 con 0x55788be402e0 2024-09-19T08:56:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.967+0000 7f910effd640 1 -- 172.21.15.19:0/2685379826 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f9124012860 con 0x55788be402e0 2024-09-19T08:56:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.967+0000 7f91386be740 10 client.16335 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.967+0000 7f91386be740 10 client.16335 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:56:20.973 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.967+0000 7f91386be740 20 client.16335 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:20.973 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.967+0000 7f91386be740 1 --2- 172.21.15.19:0/2685379826 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55788bec0dd0 0x55788bec31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:20.973 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.967+0000 7f91386be740 4 client.16335 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:56:20.973 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.967+0000 7f91386be740 1 -- 172.21.15.19:0/2685379826 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55788bdaad70 con 0x55788bec0dd0 2024-09-19T08:56:20.973 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.967+0000 7f912effd640 1 --2- 172.21.15.19:0/2685379826 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55788bec0dd0 0x55788bec31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:20.973 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.968+0000 7f912effd640 1 --2- 172.21.15.19:0/2685379826 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55788bec0dd0 0x55788bec31f0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac2e869814556dbe server_cookie=38282c11ca2ab01b in_seq=0 out_seq=0 2024-09-19T08:56:20.973 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:20.968+0000 7f910effd640 10 client.16335 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:21.516 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:21.515+0000 7f910effd640 1 -- 172.21.15.19:0/2685379826 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55788bdaad70 con 0x55788bec0dd0 2024-09-19T08:56:21.516 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:21.515+0000 7f910effd640 10 client.16335 handle_command_reply: tid=0 2024-09-19T08:56:21.516 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:21.515+0000 7f91386be740 1 client.16335 shutdown 2024-09-19T08:56:21.516 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:21.515+0000 7f91386be740 1 -- 172.21.15.19:0/2685379826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55788be402e0 msgr2=0x55788be4ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:21.516 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:21.515+0000 7f91386be740 1 --2- 172.21.15.19:0/2685379826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55788be402e0 0x55788be4ec90 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x55788be3be90 tx=0x7f91240095c0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.516 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:21.515+0000 7f91386be740 1 -- 172.21.15.19:0/2685379826 shutdown_connections 2024-09-19T08:56:21.517 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:21.515+0000 7f91386be740 1 --2- 172.21.15.19:0/2685379826 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55788bec0dd0 0x55788bec31f0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.517 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:21.515+0000 7f91386be740 1 --2- 172.21.15.19:0/2685379826 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55788be45370 0x55788be4fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.517 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:21.515+0000 7f91386be740 1 --2- 172.21.15.19:0/2685379826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55788be402e0 0x55788be4ec90 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.517 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:21.515+0000 7f91386be740 1 --2- 172.21.15.19:0/2685379826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55788be3f9a0 0x55788be4e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.517 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:21.515+0000 7f910effd640 0 client.16335 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:21.517 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:21.515+0000 7f91386be740 1 -- 172.21.15.19:0/2685379826 >> 172.21.15.19:0/2685379826 conn(0x55788be3b010 msgr2=0x55788be3bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:21.517 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:21.515+0000 7f91386be740 1 -- 172.21.15.19:0/2685379826 shutdown_connections 2024-09-19T08:56:21.517 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:21.515+0000 7f91386be740 1 -- 172.21.15.19:0/2685379826 wait complete. 2024-09-19T08:56:21.517 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:21.515+0000 7f91386be740 20 client.16335 trim_cache size 0 max 16384 2024-09-19T08:56:21.518 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T08:56:21.518 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T08:56:21.518 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T08:56:21.518 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T08:56:21.519 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:21.516+0000 7f913592c640 1 -- 172.21.15.19:0/299255383 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f91180a32f0 msgr2=0x7f91180a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:21.519 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:21.516+0000 7f913592c640 1 --2- 172.21.15.19:0/299255383 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f91180a32f0 0x7f91180a57b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f9128031c10 tx=0x7f9128004ab0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.519 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:21.516+0000 7f913592c640 1 -- 172.21.15.19:0/299255383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9130101b60 msgr2=0x7f9130197dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:21.519 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:21.516+0000 7f913592c640 1 --2- 172.21.15.19:0/299255383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9130101b60 0x7f9130197dd0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f912000d770 tx=0x7f912000dc30 comp rx=0 tx=0).stop 2024-09-19T08:56:21.519 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:21.516+0000 7f913592c640 1 -- 172.21.15.19:0/299255383 shutdown_connections 2024-09-19T08:56:21.519 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:21.516+0000 7f913592c640 1 --2- 172.21.15.19:0/299255383 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f91180a32f0 0x7f91180a57b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.519 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:21.516+0000 7f913592c640 1 --2- 172.21.15.19:0/299255383 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9130103710 0x7f913019f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.519 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:21.516+0000 7f913592c640 1 --2- 172.21.15.19:0/299255383 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9130102d50 0x7f9130198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.519 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:21.516+0000 7f913592c640 1 --2- 172.21.15.19:0/299255383 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9130101b60 0x7f9130197dd0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:21.519 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:21.516+0000 7f913592c640 1 -- 172.21.15.19:0/299255383 >> 172.21.15.19:0/299255383 conn(0x7f91300fd2e0 msgr2=0x7f9130105ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:21.519 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:21.516+0000 7f913592c640 1 -- 172.21.15.19:0/299255383 shutdown_connections 2024-09-19T08:56:21.520 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:21.516+0000 7f913592c640 1 -- 172.21.15.19:0/299255383 wait complete. 2024-09-19T08:56:21.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:21 smithi155 ceph-mon[34921]: pgmap v461: 97 pgs: 97 active+clean; 17 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.2 MiB/s wr, 771 op/s 2024-09-19T08:56:21.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:21 smithi203 ceph-mon[35450]: pgmap v461: 97 pgs: 97 active+clean; 17 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.2 MiB/s wr, 771 op/s 2024-09-19T08:56:21.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:21 smithi019 ceph-mon[30976]: pgmap v461: 97 pgs: 97 active+clean; 17 MiB data, 433 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.2 MiB/s wr, 771 op/s 2024-09-19T08:56:23.125 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:56:23.399 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:23.520 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:23 smithi019 ceph-mon[30976]: pgmap v462: 97 pgs: 97 active+clean; 19 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 1.05k op/s 2024-09-19T08:56:23.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:23 smithi155 ceph-mon[34921]: pgmap v462: 97 pgs: 97 active+clean; 19 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 1.05k op/s 2024-09-19T08:56:23.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:23 smithi203 ceph-mon[35450]: pgmap v462: 97 pgs: 97 active+clean; 19 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 1.05k op/s 2024-09-19T08:56:24.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.890+0000 7f7a07d61640 1 -- 172.21.15.19:0/2511550144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a00101440 msgr2=0x7f7a0010df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:24.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.890+0000 7f7a07d61640 1 --2- 172.21.15.19:0/2511550144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a00101440 0x7f7a0010df30 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f79f4009900 tx=0x7f79f402a410 comp rx=0 tx=0).stop 2024-09-19T08:56:24.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.890+0000 7f7a07d61640 1 -- 172.21.15.19:0/2511550144 shutdown_connections 2024-09-19T08:56:24.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.890+0000 7f7a07d61640 1 --2- 172.21.15.19:0/2511550144 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a0010e500 0x7f7a00110910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:24.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.890+0000 7f7a07d61640 1 --2- 172.21.15.19:0/2511550144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a00101440 0x7f7a0010df30 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:24.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.890+0000 7f7a07d61640 1 --2- 172.21.15.19:0/2511550144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a00100b20 0x7f7a00100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:24.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.890+0000 7f7a07d61640 1 -- 172.21.15.19:0/2511550144 >> 172.21.15.19:0/2511550144 conn(0x7f7a000fc7d0 msgr2=0x7f7a000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:24.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.890+0000 7f7a07d61640 1 -- 172.21.15.19:0/2511550144 shutdown_connections 2024-09-19T08:56:24.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.890+0000 7f7a07d61640 1 -- 172.21.15.19:0/2511550144 wait complete. 2024-09-19T08:56:24.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.891+0000 7f7a07d61640 1 Processor -- start 2024-09-19T08:56:24.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.892+0000 7f7a07d61640 1 -- start start 2024-09-19T08:56:24.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.892+0000 7f7a07d61640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a00100b20 0x7f7a001a0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:24.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.892+0000 7f7a07d61640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a00101440 0x7f7a001a0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:24.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.892+0000 7f7a07d61640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a0010e500 0x7f7a0019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:24.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.892+0000 7f7a07d61640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7a00114270 con 0x7f7a00100b20 2024-09-19T08:56:24.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.892+0000 7f7a07d61640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7a001140f0 con 0x7f7a00101440 2024-09-19T08:56:24.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.892+0000 7f7a07d61640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7a001143f0 con 0x7f7a0010e500 2024-09-19T08:56:24.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.892+0000 7f7a05afd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a00100b20 0x7f7a001a0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:24.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.892+0000 7f7a052fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a00101440 0x7f7a001a0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:24.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.892+0000 7f7a062fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a0010e500 0x7f7a0019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:24.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.892+0000 7f7a05afd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a00100b20 0x7f7a001a0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59404/0 (socket says 172.21.15.19:59404) 2024-09-19T08:56:24.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.892+0000 7f7a052fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a00101440 0x7f7a001a0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:35762/0 (socket says 172.21.15.19:35762) 2024-09-19T08:56:24.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.892+0000 7f7a05afd640 1 -- 172.21.15.19:0/4127996410 learned_addr learned my addr 172.21.15.19:0/4127996410 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:24.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.893+0000 7f7a05afd640 1 -- 172.21.15.19:0/4127996410 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a0010e500 msgr2=0x7f7a0019a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:24.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.893+0000 7f7a05afd640 1 --2- 172.21.15.19:0/4127996410 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a0010e500 0x7f7a0019a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:24.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.893+0000 7f7a05afd640 1 -- 172.21.15.19:0/4127996410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a00101440 msgr2=0x7f7a001a0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:24.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.893+0000 7f7a05afd640 1 --2- 172.21.15.19:0/4127996410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a00101440 0x7f7a001a0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:24.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.893+0000 7f7a05afd640 1 -- 172.21.15.19:0/4127996410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a0019acf0 con 0x7f7a00100b20 2024-09-19T08:56:24.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.893+0000 7f7a05afd640 1 --2- 172.21.15.19:0/4127996410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a00100b20 0x7f7a001a0400 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f79f800d950 tx=0x7f79f800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:24.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.893+0000 7f79feffd640 1 -- 172.21.15.19:0/4127996410 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f8017030 con 0x7f7a00100b20 2024-09-19T08:56:24.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.893+0000 7f79feffd640 1 -- 172.21.15.19:0/4127996410 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f79f8004020 con 0x7f7a00100b20 2024-09-19T08:56:24.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.893+0000 7f7a07d61640 1 -- 172.21.15.19:0/4127996410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a0019afe0 con 0x7f7a00100b20 2024-09-19T08:56:24.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.893+0000 7f79feffd640 1 -- 172.21.15.19:0/4127996410 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f80047a0 con 0x7f7a00100b20 2024-09-19T08:56:24.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.893+0000 7f7a07d61640 1 -- 172.21.15.19:0/4127996410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a001a72d0 con 0x7f7a00100b20 2024-09-19T08:56:24.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.895+0000 7f7a07d61640 1 -- 172.21.15.19:0/4127996410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a00100f00 con 0x7f7a00100b20 2024-09-19T08:56:24.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.896+0000 7f79feffd640 1 -- 172.21.15.19:0/4127996410 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f79f80041d0 con 0x7f7a00100b20 2024-09-19T08:56:24.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.897+0000 7f79feffd640 1 --2- 172.21.15.19:0/4127996410 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f79e80a32c0 0x7f79e80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:24.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.897+0000 7f7a052fc640 1 --2- 172.21.15.19:0/4127996410 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f79e80a32c0 0x7f79e80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:24.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.897+0000 7f79feffd640 1 -- 172.21.15.19:0/4127996410 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f79f80cec20 con 0x7f7a00100b20 2024-09-19T08:56:24.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.897+0000 7f7a052fc640 1 --2- 172.21.15.19:0/4127996410 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f79e80a32c0 0x7f79e80a5780 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f79f4004770 tx=0x7f79f40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:24.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:23.902+0000 7f79feffd640 1 -- 172.21.15.19:0/4127996410 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f79f809b950 con 0x7f7a00100b20 2024-09-19T08:56:24.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:24.114+0000 7f7a07d61640 1 -- 172.21.15.19:0/4127996410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7a0019baf0 con 0x7f7a00100b20 2024-09-19T08:56:24.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:24.114+0000 7f79feffd640 1 -- 172.21.15.19:0/4127996410 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11984 (secure 0 0 0) 0x7f79f809b250 con 0x7f7a00100b20 2024-09-19T08:56:24.115 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:56:24.115 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":33,"btime":"2024-09-19T08:55:57:276679+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2452068876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2452068876},{"type":"v1","addr":"172.21.15.19:6839","nonce":2452068876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T08:55:56.383946+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/2480841559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2480841559},{"type":"v1","addr":"172.21.15.155:6835","nonce":2480841559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24469,24490,24464,24463]},"id":1}]} 2024-09-19T08:56:24.116 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 33 2024-09-19T08:56:24.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:24.116+0000 7f7a07d61640 1 -- 172.21.15.19:0/4127996410 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f79e80a32c0 msgr2=0x7f79e80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:24.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:24.116+0000 7f7a07d61640 1 --2- 172.21.15.19:0/4127996410 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f79e80a32c0 0x7f79e80a5780 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f79f4004770 tx=0x7f79f40058d0 comp rx=0 tx=0).stop 2024-09-19T08:56:24.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:24.116+0000 7f7a07d61640 1 -- 172.21.15.19:0/4127996410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a00100b20 msgr2=0x7f7a001a0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:24.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:24.116+0000 7f7a07d61640 1 --2- 172.21.15.19:0/4127996410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a00100b20 0x7f7a001a0400 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f79f800d950 tx=0x7f79f800de10 comp rx=0 tx=0).stop 2024-09-19T08:56:24.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:24.117+0000 7f7a07d61640 1 -- 172.21.15.19:0/4127996410 shutdown_connections 2024-09-19T08:56:24.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:24.117+0000 7f7a07d61640 1 --2- 172.21.15.19:0/4127996410 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f79e80a32c0 0x7f79e80a5780 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:24.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:24.117+0000 7f7a07d61640 1 --2- 172.21.15.19:0/4127996410 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a0010e500 0x7f7a0019a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:24.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:24.117+0000 7f7a07d61640 1 --2- 172.21.15.19:0/4127996410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a00101440 0x7f7a001a0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:24.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:24.117+0000 7f7a07d61640 1 --2- 172.21.15.19:0/4127996410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a00100b20 0x7f7a001a0400 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:24.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:24.117+0000 7f7a07d61640 1 -- 172.21.15.19:0/4127996410 >> 172.21.15.19:0/4127996410 conn(0x7f7a000fc7d0 msgr2=0x7f7a000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:24.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:24.117+0000 7f7a07d61640 1 -- 172.21.15.19:0/4127996410 shutdown_connections 2024-09-19T08:56:24.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:24.117+0000 7f7a07d61640 1 -- 172.21.15.19:0/4127996410 wait complete. 2024-09-19T08:56:24.550 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:24 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/4127996410' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:24.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:24 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/4127996410' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:24.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:24 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/4127996410' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:24.901 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db --set-id 725423db --release --await' 2024-09-19T08:56:24.902 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db --set-id 725423db --release --await 2024-09-19T08:56:25.160 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:25.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:25 smithi019 ceph-mon[30976]: pgmap v463: 97 pgs: 97 active+clean; 7.3 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 986 op/s 2024-09-19T08:56:25.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:25 smithi155 ceph-mon[34921]: pgmap v463: 97 pgs: 97 active+clean; 7.3 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 986 op/s 2024-09-19T08:56:25.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.682+0000 7fef8e6b7640 1 -- 172.21.15.19:0/1100943782 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef88100e20 msgr2=0x7fef88101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:25.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.682+0000 7fef8e6b7640 1 --2- 172.21.15.19:0/1100943782 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef88100e20 0x7fef88101200 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fef78009900 tx=0x7fef7802a480 comp rx=0 tx=0).stop 2024-09-19T08:56:25.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.682+0000 7fef8e6b7640 1 -- 172.21.15.19:0/1100943782 shutdown_connections 2024-09-19T08:56:25.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.682+0000 7fef8e6b7640 1 --2- 172.21.15.19:0/1100943782 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef88102ef0 0x7fef8810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.682+0000 7fef8e6b7640 1 --2- 172.21.15.19:0/1100943782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef88102570 0x7fef881029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.682+0000 7fef8e6b7640 1 --2- 172.21.15.19:0/1100943782 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef88100e20 0x7fef88101200 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.682+0000 7fef8e6b7640 1 -- 172.21.15.19:0/1100943782 >> 172.21.15.19:0/1100943782 conn(0x7fef880fc7d0 msgr2=0x7fef880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:25.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.682+0000 7fef8e6b7640 1 -- 172.21.15.19:0/1100943782 shutdown_connections 2024-09-19T08:56:25.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.682+0000 7fef8e6b7640 1 -- 172.21.15.19:0/1100943782 wait complete. 2024-09-19T08:56:25.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.682+0000 7fef8e6b7640 1 Processor -- start 2024-09-19T08:56:25.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.682+0000 7fef8e6b7640 1 -- start start 2024-09-19T08:56:25.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.683+0000 7fef8e6b7640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef88100e20 0x7fef8819a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:25.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.683+0000 7fef8e6b7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef88102570 0x7fef8819ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:25.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.683+0000 7fef8e6b7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef88102ef0 0x7fef8819efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:25.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.683+0000 7fef8e6b7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fef8810fe40 con 0x7fef88102570 2024-09-19T08:56:25.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.683+0000 7fef8e6b7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fef8810fcc0 con 0x7fef88102ef0 2024-09-19T08:56:25.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.683+0000 7fef8e6b7640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fef8810ffc0 con 0x7fef88100e20 2024-09-19T08:56:25.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.683+0000 7fef877fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef88102570 0x7fef8819ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:25.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.683+0000 7fef877fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef88102570 0x7fef8819ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38192/0 (socket says 172.21.15.19:38192) 2024-09-19T08:56:25.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.683+0000 7fef877fe640 1 -- 172.21.15.19:0/2912570638 learned_addr learned my addr 172.21.15.19:0/2912570638 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:25.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.683+0000 7fef8cc54640 1 --2- 172.21.15.19:0/2912570638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef88102ef0 0x7fef8819efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:25.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.683+0000 7fef877fe640 1 -- 172.21.15.19:0/2912570638 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef88100e20 msgr2=0x7fef8819a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:25.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.683+0000 7fef87fff640 1 --2- 172.21.15.19:0/2912570638 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef88100e20 0x7fef8819a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:25.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.683+0000 7fef877fe640 1 --2- 172.21.15.19:0/2912570638 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef88100e20 0x7fef8819a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.683+0000 7fef877fe640 1 -- 172.21.15.19:0/2912570638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef88102ef0 msgr2=0x7fef8819efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:25.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.683+0000 7fef877fe640 1 --2- 172.21.15.19:0/2912570638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef88102ef0 0x7fef8819efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.683+0000 7fef877fe640 1 -- 172.21.15.19:0/2912570638 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef8819f6a0 con 0x7fef88102570 2024-09-19T08:56:25.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.683+0000 7fef877fe640 1 --2- 172.21.15.19:0/2912570638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef88102570 0x7fef8819ac30 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fef7c00d950 tx=0x7fef7c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:25.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.684+0000 7fef857fa640 1 -- 172.21.15.19:0/2912570638 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7c017030 con 0x7fef88102570 2024-09-19T08:56:25.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.684+0000 7fef857fa640 1 -- 172.21.15.19:0/2912570638 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef7c004020 con 0x7fef88102570 2024-09-19T08:56:25.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.684+0000 7fef8e6b7640 1 -- 172.21.15.19:0/2912570638 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef8819f990 con 0x7fef88102570 2024-09-19T08:56:25.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.684+0000 7fef857fa640 1 -- 172.21.15.19:0/2912570638 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7c0047a0 con 0x7fef88102570 2024-09-19T08:56:25.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.684+0000 7fef8e6b7640 1 -- 172.21.15.19:0/2912570638 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef881a7270 con 0x7fef88102570 2024-09-19T08:56:25.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.687+0000 7fef857fa640 1 -- 172.21.15.19:0/2912570638 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fef7c0041d0 con 0x7fef88102570 2024-09-19T08:56:25.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.687+0000 7fef90a90740 1 Processor -- start 2024-09-19T08:56:25.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.687+0000 7fef90a90740 1 -- start start 2024-09-19T08:56:25.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.687+0000 7fef90a90740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560fc337b060 0x560fc337b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:25.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.687+0000 7fef90a90740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560fc337b980 0x560fc3385d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:25.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.687+0000 7fef90a90740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560fc3386240 0x560fc3388630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:25.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.687+0000 7fef90a90740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560fc32e0620 con 0x560fc337b060 2024-09-19T08:56:25.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.687+0000 7fef90a90740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x560fc3287e50 con 0x560fc3386240 2024-09-19T08:56:25.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.687+0000 7fef90a90740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560fc32dc5e0 con 0x560fc337b980 2024-09-19T08:56:25.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.687+0000 7fef8cc54640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560fc337b060 0x560fc337b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:25.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.687+0000 7fef8cc54640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560fc337b060 0x560fc337b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38206/0 (socket says 172.21.15.19:38206) 2024-09-19T08:56:25.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.687+0000 7fef8cc54640 1 -- 172.21.15.19:0/1683437211 learned_addr learned my addr 172.21.15.19:0/1683437211 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:25.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.688+0000 7fef87fff640 1 --2- 172.21.15.19:0/1683437211 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560fc337b980 0x560fc3385d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:25.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.688+0000 7fef877fe640 1 --2- 172.21.15.19:0/1683437211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560fc3386240 0x560fc3388630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:25.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.688+0000 7fef857fa640 1 --2- 172.21.15.19:0/2912570638 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fef700a3230 0x7fef700a56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:25.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.688+0000 7fef8cc54640 1 -- 172.21.15.19:0/1683437211 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560fc337b980 msgr2=0x560fc3385d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:25.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.688+0000 7fef8cc54640 1 --2- 172.21.15.19:0/1683437211 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560fc337b980 0x560fc3385d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.688+0000 7fef8cc54640 1 -- 172.21.15.19:0/1683437211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560fc3386240 msgr2=0x560fc3388630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:25.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.688+0000 7fef8cc54640 1 --2- 172.21.15.19:0/1683437211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560fc3386240 0x560fc3388630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.688+0000 7fef8cc54640 1 -- 172.21.15.19:0/1683437211 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fc3278d40 con 0x560fc337b060 2024-09-19T08:56:25.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.688+0000 7fef87fff640 1 --2- 172.21.15.19:0/1683437211 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560fc337b980 0x560fc3385d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:25.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.688+0000 7fef857fa640 1 -- 172.21.15.19:0/2912570638 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fef7c0cf370 con 0x7fef88102570 2024-09-19T08:56:25.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.688+0000 7fef8cc54640 1 --2- 172.21.15.19:0/2912570638 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fef700a3230 0x7fef700a56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:25.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.688+0000 7fef8cc54640 1 --2- 172.21.15.19:0/1683437211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560fc337b060 0x560fc337b440 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fef80010440 tx=0x7fef80010900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ea3015e44d42f15 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:25.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.688+0000 7fef6e7fc640 1 -- 172.21.15.19:0/1683437211 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8001d400 con 0x560fc337b060 2024-09-19T08:56:25.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.689+0000 7fef6e7fc640 1 -- 172.21.15.19:0/1683437211 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef80013520 con 0x560fc337b060 2024-09-19T08:56:25.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.689+0000 7fef6e7fc640 1 -- 172.21.15.19:0/1683437211 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef80011880 con 0x560fc337b060 2024-09-19T08:56:25.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.689+0000 7fef8cc54640 1 --2- 172.21.15.19:0/2912570638 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fef700a3230 0x7fef700a56f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fef80021000 tx=0x7fef8001e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:25.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.689+0000 7fef90a90740 1 -- 172.21.15.19:0/1683437211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560fc337b060 msgr2=0x560fc337b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:25.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.689+0000 7fef90a90740 1 --2- 172.21.15.19:0/1683437211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560fc337b060 0x560fc337b440 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fef80010440 tx=0x7fef80010900 comp rx=0 tx=0).stop 2024-09-19T08:56:25.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.689+0000 7fef90a90740 1 -- 172.21.15.19:0/1683437211 shutdown_connections 2024-09-19T08:56:25.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.689+0000 7fef90a90740 1 --2- 172.21.15.19:0/1683437211 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560fc337b980 0x560fc3385d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.689+0000 7fef90a90740 1 --2- 172.21.15.19:0/1683437211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560fc3386240 0x560fc3388630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.689+0000 7fef90a90740 1 --2- 172.21.15.19:0/1683437211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560fc337b060 0x560fc337b440 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.689+0000 7fef90a90740 1 -- 172.21.15.19:0/1683437211 >> 172.21.15.19:0/1683437211 conn(0x560fc33775f0 msgr2=0x560fc33779d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:25.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.689+0000 7fef90a90740 1 -- 172.21.15.19:0/1683437211 shutdown_connections 2024-09-19T08:56:25.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.689+0000 7fef90a90740 1 -- 172.21.15.19:0/1683437211 wait complete. 2024-09-19T08:56:25.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.690+0000 7fef90a90740 1 -- start start 2024-09-19T08:56:25.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.690+0000 7fef90a90740 1 Processor -- start 2024-09-19T08:56:25.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.690+0000 7fef90a90740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560fc337b060 0x560fc3383190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:25.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.690+0000 7fef90a90740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560fc337b980 0x560fc33836d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:25.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.690+0000 7fef90a90740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560fc3386240 0x560fc3383c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:25.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.690+0000 7fef90a90740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560fc3388e10 con 0x560fc337b060 2024-09-19T08:56:25.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.690+0000 7fef90a90740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x560fc3268f10 con 0x560fc3386240 2024-09-19T08:56:25.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.690+0000 7fef90a90740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560fc3388f90 con 0x560fc337b980 2024-09-19T08:56:25.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.690+0000 7fef90a90740 10 client.0 _ll_register_callbacks cb 0x560fc328cdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:25.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.690+0000 7fef87fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560fc337b060 0x560fc3383190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:25.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.690+0000 7fef87fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560fc337b060 0x560fc3383190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38214/0 (socket says 172.21.15.19:38214) 2024-09-19T08:56:25.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.690+0000 7fef87fff640 1 -- 172.21.15.19:0/2286455029 learned_addr learned my addr 172.21.15.19:0/2286455029 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:25.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.690+0000 7fef8cc54640 1 --2- 172.21.15.19:0/2286455029 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560fc3386240 0x560fc3383c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:25.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.691+0000 7fef877fe640 1 --2- 172.21.15.19:0/2286455029 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560fc337b980 0x560fc33836d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:25.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.691+0000 7fef87fff640 1 -- 172.21.15.19:0/2286455029 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560fc337b980 msgr2=0x560fc33836d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:25.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.691+0000 7fef87fff640 1 --2- 172.21.15.19:0/2286455029 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560fc337b980 0x560fc33836d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.691+0000 7fef87fff640 1 -- 172.21.15.19:0/2286455029 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560fc3386240 msgr2=0x560fc3383c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:25.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.691+0000 7fef87fff640 1 --2- 172.21.15.19:0/2286455029 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560fc3386240 0x560fc3383c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.691+0000 7fef87fff640 1 -- 172.21.15.19:0/2286455029 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fc2fef580 con 0x560fc337b060 2024-09-19T08:56:25.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.691+0000 7fef87fff640 1 --2- 172.21.15.19:0/2286455029 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560fc337b060 0x560fc3383190 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fef78009230 tx=0x7fef780042e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=628ebcc387dc485a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:25.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.691+0000 7fef677fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:56:25.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.691+0000 7fef677fe640 1 -- 172.21.15.19:0/2286455029 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef78035040 con 0x560fc337b060 2024-09-19T08:56:25.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.691+0000 7fef677fe640 1 -- 172.21.15.19:0/2286455029 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fef78005450 con 0x560fc337b060 2024-09-19T08:56:25.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.691+0000 7fef90a90740 1 -- 172.21.15.19:0/2286455029 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef80013520 con 0x560fc337b060 2024-09-19T08:56:25.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.691+0000 7fef677fe640 1 -- 172.21.15.19:0/2286455029 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fef780046c0 con 0x560fc337b060 2024-09-19T08:56:25.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.691+0000 7fef90a90740 10 client.16353 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:25.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.691+0000 7fef90a90740 1 -- 172.21.15.19:0/2286455029 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560fc30b9960 con 0x560fc337b060 2024-09-19T08:56:25.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.692+0000 7fef677fe640 1 -- 172.21.15.19:0/2286455029 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef80013520 con 0x560fc337b060 2024-09-19T08:56:25.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.692+0000 7fef677fe640 1 -- 172.21.15.19:0/2286455029 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7fef78003af0 con 0x560fc337b060 2024-09-19T08:56:25.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.692+0000 7fef90a90740 10 client.16353 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:25.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.692+0000 7fef90a90740 10 client.16353 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T08:56:25.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.692+0000 7fef90a90740 20 client.16353 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:25.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.692+0000 7fef90a90740 1 --2- 172.21.15.19:0/2286455029 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560fc3395e10 0x560fc3398200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:25.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.692+0000 7fef90a90740 4 client.16353 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:56:25.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.692+0000 7fef90a90740 1 -- 172.21.15.19:0/2286455029 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560fc32edb90 con 0x560fc3395e10 2024-09-19T08:56:25.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.692+0000 7fef877fe640 1 --2- 172.21.15.19:0/2286455029 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560fc3395e10 0x560fc3398200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:25.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.693+0000 7fef877fe640 1 --2- 172.21.15.19:0/2286455029 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560fc3395e10 0x560fc3398200 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8d0b79a1a4ca176 server_cookie=23add66cc4fa28c2 in_seq=0 out_seq=0 2024-09-19T08:56:25.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.693+0000 7fef677fe640 10 client.16353 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:25.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.693+0000 7fef677fe640 1 -- 172.21.15.19:0/2286455029 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560fc32edb90 con 0x560fc3395e10 2024-09-19T08:56:25.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.693+0000 7fef677fe640 10 client.16353 handle_command_reply: tid=0 2024-09-19T08:56:25.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.694+0000 7fef90a90740 1 client.16353 shutdown 2024-09-19T08:56:25.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.694+0000 7fef90a90740 1 -- 172.21.15.19:0/2286455029 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560fc337b060 msgr2=0x560fc3383190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:25.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.694+0000 7fef90a90740 1 --2- 172.21.15.19:0/2286455029 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560fc337b060 0x560fc3383190 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fef78009230 tx=0x7fef780042e0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.694+0000 7fef90a90740 1 -- 172.21.15.19:0/2286455029 shutdown_connections 2024-09-19T08:56:25.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.694+0000 7fef90a90740 1 --2- 172.21.15.19:0/2286455029 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560fc3395e10 0x560fc3398200 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.694+0000 7fef90a90740 1 --2- 172.21.15.19:0/2286455029 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560fc337b980 0x560fc33836d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.694+0000 7fef90a90740 1 --2- 172.21.15.19:0/2286455029 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560fc3386240 0x560fc3383c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.694+0000 7fef90a90740 1 --2- 172.21.15.19:0/2286455029 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560fc337b060 0x560fc3383190 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.694+0000 7fef90a90740 1 -- 172.21.15.19:0/2286455029 >> 172.21.15.19:0/2286455029 conn(0x560fc33775f0 msgr2=0x560fc3376750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:25.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.694+0000 7fef677fe640 0 client.16353 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:25.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.694+0000 7fef90a90740 1 -- 172.21.15.19:0/2286455029 shutdown_connections 2024-09-19T08:56:25.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.694+0000 7fef90a90740 1 -- 172.21.15.19:0/2286455029 wait complete. 2024-09-19T08:56:25.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.694+0000 7fef90a90740 20 client.16353 trim_cache size 0 max 16384 2024-09-19T08:56:25.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.711+0000 7fef90a90740 1 Processor -- start 2024-09-19T08:56:25.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.711+0000 7fef90a90740 1 -- start start 2024-09-19T08:56:25.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.711+0000 7fef90a90740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560fc337b060 0x560fc337dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:25.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.711+0000 7fef90a90740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560fc337b980 0x560fc3376640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:25.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.711+0000 7fef90a90740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560fc3386240 0x560fc339dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:25.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.711+0000 7fef90a90740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fef881af770 con 0x560fc337b060 2024-09-19T08:56:25.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.711+0000 7fef90a90740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fef881b12e0 con 0x560fc3386240 2024-09-19T08:56:25.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.711+0000 7fef90a90740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fef881afe40 con 0x560fc337b980 2024-09-19T08:56:25.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.712+0000 7fef87fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560fc337b060 0x560fc337dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:25.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.712+0000 7fef87fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560fc337b060 0x560fc337dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38218/0 (socket says 172.21.15.19:38218) 2024-09-19T08:56:25.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.712+0000 7fef87fff640 1 -- 172.21.15.19:0/3302656366 learned_addr learned my addr 172.21.15.19:0/3302656366 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:25.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.712+0000 7fef877fe640 1 --2- 172.21.15.19:0/3302656366 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560fc337b980 0x560fc3376640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:25.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.712+0000 7fef8cc54640 1 --2- 172.21.15.19:0/3302656366 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560fc3386240 0x560fc339dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:25.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.712+0000 7fef87fff640 1 -- 172.21.15.19:0/3302656366 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560fc337b980 msgr2=0x560fc3376640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:25.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.712+0000 7fef87fff640 1 --2- 172.21.15.19:0/3302656366 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560fc337b980 0x560fc3376640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.712+0000 7fef87fff640 1 -- 172.21.15.19:0/3302656366 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560fc3386240 msgr2=0x560fc339dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:25.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.712+0000 7fef87fff640 1 --2- 172.21.15.19:0/3302656366 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560fc3386240 0x560fc339dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.712+0000 7fef87fff640 1 -- 172.21.15.19:0/3302656366 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560fc337e000 con 0x560fc337b060 2024-09-19T08:56:25.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.712+0000 7fef87fff640 1 --2- 172.21.15.19:0/3302656366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560fc337b060 0x560fc337dac0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fef78000c00 tx=0x7fef7802a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=367c97200159ca70 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:25.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.712+0000 7fef6dffb640 1 -- 172.21.15.19:0/3302656366 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef78035070 con 0x560fc337b060 2024-09-19T08:56:25.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.712+0000 7fef6dffb640 1 -- 172.21.15.19:0/3302656366 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef78031e20 con 0x560fc337b060 2024-09-19T08:56:25.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.712+0000 7fef6dffb640 1 -- 172.21.15.19:0/3302656366 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef780035f0 con 0x560fc337b060 2024-09-19T08:56:25.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.713+0000 7fef90a90740 1 -- 172.21.15.19:0/3302656366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560fc337b060 msgr2=0x560fc337dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:25.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.713+0000 7fef90a90740 1 --2- 172.21.15.19:0/3302656366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560fc337b060 0x560fc337dac0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fef78000c00 tx=0x7fef7802a480 comp rx=0 tx=0).stop 2024-09-19T08:56:25.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.713+0000 7fef90a90740 1 -- 172.21.15.19:0/3302656366 shutdown_connections 2024-09-19T08:56:25.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.713+0000 7fef90a90740 1 --2- 172.21.15.19:0/3302656366 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560fc337b980 0x560fc3376640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.713+0000 7fef90a90740 1 --2- 172.21.15.19:0/3302656366 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560fc3386240 0x560fc339dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.713+0000 7fef90a90740 1 --2- 172.21.15.19:0/3302656366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560fc337b060 0x560fc337dac0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.713+0000 7fef90a90740 1 -- 172.21.15.19:0/3302656366 >> 172.21.15.19:0/3302656366 conn(0x560fc33775f0 msgr2=0x560fc3375f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:25.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.713+0000 7fef90a90740 1 -- 172.21.15.19:0/3302656366 shutdown_connections 2024-09-19T08:56:25.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.713+0000 7fef90a90740 1 -- 172.21.15.19:0/3302656366 wait complete. 2024-09-19T08:56:25.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.713+0000 7fef90a90740 1 -- start start 2024-09-19T08:56:25.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.714+0000 7fef90a90740 1 Processor -- start 2024-09-19T08:56:25.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.714+0000 7fef90a90740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560fc337b060 0x560fc3380350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:25.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.714+0000 7fef90a90740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560fc337b980 0x560fc3380890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:25.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.714+0000 7fef90a90740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560fc3386240 0x560fc3380dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:25.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.714+0000 7fef90a90740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fef881b0c10 con 0x560fc337b060 2024-09-19T08:56:25.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.714+0000 7fef90a90740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fef881b0540 con 0x560fc3386240 2024-09-19T08:56:25.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.714+0000 7fef90a90740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fef881ad750 con 0x560fc337b980 2024-09-19T08:56:25.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.714+0000 7fef90a90740 10 client.0 _ll_register_callbacks cb 0x7fef78005de0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:25.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.714+0000 7fef87fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560fc337b060 0x560fc3380350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:25.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.714+0000 7fef87fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560fc337b060 0x560fc3380350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38222/0 (socket says 172.21.15.19:38222) 2024-09-19T08:56:25.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.714+0000 7fef87fff640 1 -- 172.21.15.19:0/3095001595 learned_addr learned my addr 172.21.15.19:0/3095001595 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:25.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.714+0000 7fef8cc54640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560fc3386240 0x560fc3380dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:25.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.714+0000 7fef877fe640 1 --2- 172.21.15.19:0/3095001595 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560fc337b980 0x560fc3380890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:25.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.714+0000 7fef87fff640 1 -- 172.21.15.19:0/3095001595 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560fc337b980 msgr2=0x560fc3380890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:25.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.714+0000 7fef87fff640 1 --2- 172.21.15.19:0/3095001595 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560fc337b980 0x560fc3380890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.714+0000 7fef87fff640 1 -- 172.21.15.19:0/3095001595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560fc3386240 msgr2=0x560fc3380dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:25.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.714+0000 7fef87fff640 1 --2- 172.21.15.19:0/3095001595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560fc3386240 0x560fc3380dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.714+0000 7fef87fff640 1 -- 172.21.15.19:0/3095001595 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560fc33ffbb0 con 0x560fc337b060 2024-09-19T08:56:25.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.714+0000 7fef8cc54640 1 --2- 172.21.15.19:0/3095001595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560fc3386240 0x560fc3380dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:25.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.715+0000 7fef87fff640 1 --2- 172.21.15.19:0/3095001595 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560fc337b060 0x560fc3380350 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fef78009900 tx=0x7fef78004860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cbc57ceaf60adf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:25.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.715+0000 7fef677fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:56:25.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.715+0000 7fef677fe640 1 -- 172.21.15.19:0/3095001595 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7805d060 con 0x560fc337b060 2024-09-19T08:56:25.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.715+0000 7fef677fe640 1 -- 172.21.15.19:0/3095001595 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fef78005250 con 0x560fc337b060 2024-09-19T08:56:25.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.715+0000 7fef90a90740 1 -- 172.21.15.19:0/3095001595 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef78031e20 con 0x560fc337b060 2024-09-19T08:56:25.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.715+0000 7fef677fe640 1 -- 172.21.15.19:0/3095001595 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fef78035040 con 0x560fc337b060 2024-09-19T08:56:25.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.715+0000 7fef90a90740 10 client.16359 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:25.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.715+0000 7fef90a90740 1 -- 172.21.15.19:0/3095001595 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x560fc3400ed0 con 0x560fc337b060 2024-09-19T08:56:25.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.715+0000 7fef677fe640 1 -- 172.21.15.19:0/3095001595 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fef78031e20 con 0x560fc337b060 2024-09-19T08:56:25.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.715+0000 7fef677fe640 1 -- 172.21.15.19:0/3095001595 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7fef78057070 con 0x560fc337b060 2024-09-19T08:56:25.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.715+0000 7fef90a90740 10 client.16359 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:25.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.715+0000 7fef90a90740 10 client.16359 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T08:56:25.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.715+0000 7fef90a90740 20 client.16359 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:25.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.715+0000 7fef90a90740 1 --2- 172.21.15.19:0/3095001595 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560fc34014d0 0x560fc34038c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:25.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.715+0000 7fef90a90740 4 client.16359 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "725423db", "release": true, "await": true}] 2024-09-19T08:56:25.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.716+0000 7fef90a90740 1 -- 172.21.15.19:0/3095001595 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "quiesce db", "set_id": "725423db", "release": true, "await": true}) -- 0x560fc32e80a0 con 0x560fc34014d0 2024-09-19T08:56:25.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.716+0000 7fef877fe640 1 --2- 172.21.15.19:0/3095001595 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560fc34014d0 0x560fc34038c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:25.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.716+0000 7fef877fe640 1 --2- 172.21.15.19:0/3095001595 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560fc34014d0 0x560fc34038c0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fe364d054529a9a server_cookie=7da8685700147749 in_seq=0 out_seq=0 2024-09-19T08:56:25.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.716+0000 7fef677fe640 10 client.16359 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:25.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:25 smithi203 ceph-mon[35450]: pgmap v463: 97 pgs: 97 active+clean; 7.3 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 986 op/s 2024-09-19T08:56:25.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.937+0000 7fef677fe640 1 -- 172.21.15.19:0/3095001595 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x560fc32e80a0 con 0x560fc34014d0 2024-09-19T08:56:25.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.937+0000 7fef677fe640 10 client.16359 handle_command_reply: tid=0 2024-09-19T08:56:25.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.937+0000 7fef90a90740 1 client.16359 shutdown 2024-09-19T08:56:25.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.937+0000 7fef90a90740 1 -- 172.21.15.19:0/3095001595 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560fc337b060 msgr2=0x560fc3380350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:25.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.937+0000 7fef90a90740 1 --2- 172.21.15.19:0/3095001595 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560fc337b060 0x560fc3380350 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fef78009900 tx=0x7fef78004860 comp rx=0 tx=0).stop 2024-09-19T08:56:25.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.937+0000 7fef90a90740 1 -- 172.21.15.19:0/3095001595 shutdown_connections 2024-09-19T08:56:25.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.937+0000 7fef90a90740 1 --2- 172.21.15.19:0/3095001595 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560fc34014d0 0x560fc34038c0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.937+0000 7fef90a90740 1 --2- 172.21.15.19:0/3095001595 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560fc337b980 0x560fc3380890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.937+0000 7fef90a90740 1 --2- 172.21.15.19:0/3095001595 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560fc3386240 0x560fc3380dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.937+0000 7fef90a90740 1 --2- 172.21.15.19:0/3095001595 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560fc337b060 0x560fc3380350 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.937+0000 7fef90a90740 1 -- 172.21.15.19:0/3095001595 >> 172.21.15.19:0/3095001595 conn(0x560fc33775f0 msgr2=0x560fc3376750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:25.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.937+0000 7fef677fe640 0 client.16359 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:25.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.937+0000 7fef90a90740 1 -- 172.21.15.19:0/3095001595 shutdown_connections 2024-09-19T08:56:25.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.938+0000 7fef90a90740 1 -- 172.21.15.19:0/3095001595 wait complete. 2024-09-19T08:56:25.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.938+0000 7fef90a90740 20 client.16359 trim_cache size 0 max 16384 2024-09-19T08:56:25.940 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:56:25.940 INFO:teuthology.orchestra.run.smithi019.stdout: "epoch": 33, 2024-09-19T08:56:25.940 INFO:teuthology.orchestra.run.smithi019.stdout: "leader": 24497, 2024-09-19T08:56:25.940 INFO:teuthology.orchestra.run.smithi019.stdout: "set_version": 16, 2024-09-19T08:56:25.940 INFO:teuthology.orchestra.run.smithi019.stdout: "sets": { 2024-09-19T08:56:25.940 INFO:teuthology.orchestra.run.smithi019.stdout: "725423db": { 2024-09-19T08:56:25.940 INFO:teuthology.orchestra.run.smithi019.stdout: "version": 16, 2024-09-19T08:56:25.940 INFO:teuthology.orchestra.run.smithi019.stdout: "age_ref": 0.0, 2024-09-19T08:56:25.940 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T08:56:25.940 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RELEASED", 2024-09-19T08:56:25.941 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T08:56:25.941 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T08:56:25.941 INFO:teuthology.orchestra.run.smithi019.stdout: "timeout": 90.0, 2024-09-19T08:56:25.941 INFO:teuthology.orchestra.run.smithi019.stdout: "expiration": 136.6, 2024-09-19T08:56:25.941 INFO:teuthology.orchestra.run.smithi019.stdout: "members": { 2024-09-19T08:56:25.941 INFO:teuthology.orchestra.run.smithi019.stdout: "file:/": { 2024-09-19T08:56:25.941 INFO:teuthology.orchestra.run.smithi019.stdout: "excluded": false, 2024-09-19T08:56:25.941 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T08:56:25.941 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RELEASED", 2024-09-19T08:56:25.941 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T08:56:25.941 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:56:25.941 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:56:25.941 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:56:25.941 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:56:25.942 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:56:25.942 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:56:25.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.938+0000 7fef8e6b7640 1 -- 172.21.15.19:0/2912570638 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fef700a3230 msgr2=0x7fef700a56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:25.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.938+0000 7fef8e6b7640 1 --2- 172.21.15.19:0/2912570638 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fef700a3230 0x7fef700a56f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fef80021000 tx=0x7fef8001e000 comp rx=0 tx=0).stop 2024-09-19T08:56:25.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.938+0000 7fef8e6b7640 1 -- 172.21.15.19:0/2912570638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef88102570 msgr2=0x7fef8819ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:25.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.938+0000 7fef8e6b7640 1 --2- 172.21.15.19:0/2912570638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef88102570 0x7fef8819ac30 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fef7c00d950 tx=0x7fef7c00de10 comp rx=0 tx=0).stop 2024-09-19T08:56:25.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.938+0000 7fef8e6b7640 1 -- 172.21.15.19:0/2912570638 shutdown_connections 2024-09-19T08:56:25.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.938+0000 7fef8e6b7640 1 --2- 172.21.15.19:0/2912570638 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fef700a3230 0x7fef700a56f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.938+0000 7fef8e6b7640 1 --2- 172.21.15.19:0/2912570638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fef88102ef0 0x7fef8819efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.938+0000 7fef8e6b7640 1 --2- 172.21.15.19:0/2912570638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fef88102570 0x7fef8819ac30 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.938+0000 7fef8e6b7640 1 --2- 172.21.15.19:0/2912570638 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef88100e20 0x7fef8819a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:25.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.938+0000 7fef8e6b7640 1 -- 172.21.15.19:0/2912570638 >> 172.21.15.19:0/2912570638 conn(0x7fef880fc7d0 msgr2=0x7fef880febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:25.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.939+0000 7fef8e6b7640 1 -- 172.21.15.19:0/2912570638 shutdown_connections 2024-09-19T08:56:25.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:25.939+0000 7fef8e6b7640 1 -- 172.21.15.19:0/2912570638 wait complete. 2024-09-19T08:56:26.756 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '725423db', total seconds elapsed: 20.3 2024-09-19T08:56:27.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:27 smithi155 ceph-mon[34921]: pgmap v464: 97 pgs: 97 active+clean; 3.3 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 827 KiB/s rd, 1.1 MiB/s wr, 1.02k op/s 2024-09-19T08:56:27.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:27 smithi203 ceph-mon[35450]: pgmap v464: 97 pgs: 97 active+clean; 3.3 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 827 KiB/s rd, 1.1 MiB/s wr, 1.02k op/s 2024-09-19T08:56:27.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:27 smithi019 ceph-mon[30976]: pgmap v464: 97 pgs: 97 active+clean; 3.3 MiB data, 469 MiB used, 1.0 TiB / 1.0 TiB avail; 827 KiB/s rd, 1.1 MiB/s wr, 1.02k op/s 2024-09-19T08:56:29.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:29 smithi155 ceph-mon[34921]: pgmap v465: 97 pgs: 97 active+clean; 11 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 1.04k op/s 2024-09-19T08:56:29.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:29 smithi203 ceph-mon[35450]: pgmap v465: 97 pgs: 97 active+clean; 11 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 1.04k op/s 2024-09-19T08:56:29.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:29 smithi019 ceph-mon[30976]: pgmap v465: 97 pgs: 97 active+clean; 11 MiB data, 471 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 1.04k op/s 2024-09-19T08:56:31.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:31 smithi155 ceph-mon[34921]: pgmap v466: 97 pgs: 97 active+clean; 11 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 1.04k op/s 2024-09-19T08:56:31.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:31 smithi203 ceph-mon[35450]: pgmap v466: 97 pgs: 97 active+clean; 11 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 1.04k op/s 2024-09-19T08:56:31.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:31 smithi019 ceph-mon[30976]: pgmap v466: 97 pgs: 97 active+clean; 11 MiB data, 455 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 1.04k op/s 2024-09-19T08:56:33.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:33 smithi155 ceph-mon[34921]: pgmap v467: 97 pgs: 97 active+clean; 12 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 947 KiB/s rd, 1.4 MiB/s wr, 855 op/s 2024-09-19T08:56:33.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:33 smithi203 ceph-mon[35450]: pgmap v467: 97 pgs: 97 active+clean; 12 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 947 KiB/s rd, 1.4 MiB/s wr, 855 op/s 2024-09-19T08:56:33.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:33 smithi019 ceph-mon[30976]: pgmap v467: 97 pgs: 97 active+clean; 12 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 947 KiB/s rd, 1.4 MiB/s wr, 855 op/s 2024-09-19T08:56:34.612 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.610+0000 7f6c077c4640 1 -- 172.21.15.19:0/2341162853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c001016f0 msgr2=0x7f6c00101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:34.613 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.610+0000 7f6c077c4640 1 --2- 172.21.15.19:0/2341162853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c001016f0 0x7f6c00101ba0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8009ca0 tx=0x7f6bf802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.613 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.610+0000 7f6c077c4640 1 -- 172.21.15.19:0/2341162853 shutdown_connections 2024-09-19T08:56:34.613 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.610+0000 7f6c077c4640 1 --2- 172.21.15.19:0/2341162853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c00100d50 0x7f6c001011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.613 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.610+0000 7f6c077c4640 1 --2- 172.21.15.19:0/2341162853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c001016f0 0x7f6c00101ba0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.613 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.610+0000 7f6c077c4640 1 --2- 172.21.15.19:0/2341162853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c00100410 0x7f6c00100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.613 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.610+0000 7f6c077c4640 1 -- 172.21.15.19:0/2341162853 >> 172.21.15.19:0/2341162853 conn(0x7f6c000fc1e0 msgr2=0x7f6c000fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:34.613 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.610+0000 7f6c077c4640 1 -- 172.21.15.19:0/2341162853 shutdown_connections 2024-09-19T08:56:34.613 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.610+0000 7f6c077c4640 1 -- 172.21.15.19:0/2341162853 wait complete. 2024-09-19T08:56:34.613 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.611+0000 7f6c077c4640 1 Processor -- start 2024-09-19T08:56:34.613 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.611+0000 7f6c077c4640 1 -- start start 2024-09-19T08:56:34.613 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.611+0000 7f6c077c4640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c00100410 0x7f6c00199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:34.613 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.611+0000 7f6c077c4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c00100d50 0x7f6c0019a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:34.613 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.611+0000 7f6c077c4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c001016f0 0x7f6c001a14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:34.614 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.611+0000 7f6c077c4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0010f930 con 0x7f6c001016f0 2024-09-19T08:56:34.614 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.611+0000 7f6c077c4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0010f7b0 con 0x7f6c00100d50 2024-09-19T08:56:34.614 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.611+0000 7f6c077c4640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0010fab0 con 0x7f6c00100410 2024-09-19T08:56:34.614 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.611+0000 7f6c05d61640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c001016f0 0x7f6c001a14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:34.614 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.611+0000 7f6c05d61640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c001016f0 0x7f6c001a14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38250/0 (socket says 172.21.15.19:38250) 2024-09-19T08:56:34.614 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.611+0000 7f6c04d5f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c00100d50 0x7f6c0019a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:34.614 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.611+0000 7f6c05d61640 1 -- 172.21.15.19:0/1426708302 learned_addr learned my addr 172.21.15.19:0/1426708302 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:34.614 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.611+0000 7f6c05560640 1 --2- 172.21.15.19:0/1426708302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c00100410 0x7f6c00199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:34.614 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.611+0000 7f6c05d61640 1 -- 172.21.15.19:0/1426708302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c00100410 msgr2=0x7f6c00199f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:34.614 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.611+0000 7f6c05d61640 1 --2- 172.21.15.19:0/1426708302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c00100410 0x7f6c00199f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.614 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.611+0000 7f6c05d61640 1 -- 172.21.15.19:0/1426708302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c00100d50 msgr2=0x7f6c0019a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:34.614 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.611+0000 7f6c05d61640 1 --2- 172.21.15.19:0/1426708302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c00100d50 0x7f6c0019a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.615 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.611+0000 7f6c05d61640 1 -- 172.21.15.19:0/1426708302 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c001a1b40 con 0x7f6c001016f0 2024-09-19T08:56:34.615 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.612+0000 7f6c05d61640 1 --2- 172.21.15.19:0/1426708302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c001016f0 0x7f6c001a14d0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8005e30 tx=0x7f6bf8009890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:34.615 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.612+0000 7f6bf67fc640 1 -- 172.21.15.19:0/1426708302 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf8003c30 con 0x7f6c001016f0 2024-09-19T08:56:34.615 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.612+0000 7f6bf67fc640 1 -- 172.21.15.19:0/1426708302 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bf8003dd0 con 0x7f6c001016f0 2024-09-19T08:56:34.615 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.612+0000 7f6c077c4640 1 -- 172.21.15.19:0/1426708302 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c001a1dd0 con 0x7f6c001016f0 2024-09-19T08:56:34.615 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.612+0000 7f6bf67fc640 1 -- 172.21.15.19:0/1426708302 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf802fc10 con 0x7f6c001016f0 2024-09-19T08:56:34.615 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.612+0000 7f6c077c4640 1 -- 172.21.15.19:0/1426708302 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c001a22e0 con 0x7f6c001016f0 2024-09-19T08:56:34.620 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.615+0000 7f6c0a63b740 1 Processor -- start 2024-09-19T08:56:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.615+0000 7f6bf67fc640 1 -- 172.21.15.19:0/1426708302 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f6bf8004050 con 0x7f6c001016f0 2024-09-19T08:56:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.615+0000 7f6c0a63b740 1 -- start start 2024-09-19T08:56:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.615+0000 7f6c0a63b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564198c619a0 0x564198c61da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.615+0000 7f6c0a63b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564198c622e0 0x564198c66da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.615+0000 7f6c0a63b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564198c67370 0x564198c69830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.615+0000 7f6c0a63b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x564198bc52f0 con 0x564198c67370 2024-09-19T08:56:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.615+0000 7f6c0a63b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x564198b6d270 con 0x564198c622e0 2024-09-19T08:56:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.615+0000 7f6c0a63b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564198bc12b0 con 0x564198c619a0 2024-09-19T08:56:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.615+0000 7f6c05560640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564198c622e0 0x564198c66da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.615+0000 7f6c04d5f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564198c67370 0x564198c69830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:34.621 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.615+0000 7f6c05560640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564198c622e0 0x564198c66da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:42188/0 (socket says 172.21.15.19:42188) 2024-09-19T08:56:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.615+0000 7f6c05560640 1 -- 172.21.15.19:0/590106368 learned_addr learned my addr 172.21.15.19:0/590106368 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.615+0000 7f6c04d5f640 1 --2- 172.21.15.19:0/590106368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564198c67370 0x564198c69830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38256/0 (socket says 172.21.15.19:38256) 2024-09-19T08:56:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.615+0000 7f6c05560640 1 -- 172.21.15.19:0/590106368 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564198c619a0 msgr2=0x564198c61da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.615+0000 7f6c05560640 1 --2- 172.21.15.19:0/590106368 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564198c619a0 0x564198c61da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.615+0000 7f6c05560640 1 -- 172.21.15.19:0/590106368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564198c67370 msgr2=0x564198c69830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.615+0000 7f6c05560640 1 --2- 172.21.15.19:0/590106368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564198c67370 0x564198c69830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.615+0000 7f6c05560640 1 -- 172.21.15.19:0/590106368 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564198b6c340 con 0x564198c622e0 2024-09-19T08:56:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.615+0000 7f6c04d5f640 1 --2- 172.21.15.19:0/590106368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564198c67370 0x564198c69830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.615+0000 7f6bf67fc640 1 --2- 172.21.15.19:0/1426708302 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6bec0a3370 0x7f6bec0a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.616+0000 7f6c04d5f640 1 --2- 172.21.15.19:0/1426708302 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6bec0a3370 0x7f6bec0a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.616+0000 7f6c05560640 1 --2- 172.21.15.19:0/590106368 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564198c622e0 0x564198c66da0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc009cf0 tx=0x7f6bfc011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdae7a9c9d309824 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.616+0000 7f6bf67fc640 1 -- 172.21.15.19:0/1426708302 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6bf80f0cc0 con 0x7f6c001016f0 2024-09-19T08:56:34.622 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.616+0000 7f6beb7fe640 1 -- 172.21.15.19:0/590106368 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc004230 con 0x564198c622e0 2024-09-19T08:56:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.616+0000 7f6beb7fe640 1 -- 172.21.15.19:0/590106368 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bfc0043d0 con 0x564198c622e0 2024-09-19T08:56:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.616+0000 7f6beb7fe640 1 -- 172.21.15.19:0/590106368 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc0198c0 con 0x564198c622e0 2024-09-19T08:56:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.617+0000 7f6c0a63b740 1 -- 172.21.15.19:0/590106368 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564198c622e0 msgr2=0x564198c66da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.617+0000 7f6c04d5f640 1 --2- 172.21.15.19:0/1426708302 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6bec0a3370 0x7f6bec0a5830 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6c0019b430 tx=0x7f6bf000a6d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.617+0000 7f6c0a63b740 1 --2- 172.21.15.19:0/590106368 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564198c622e0 0x564198c66da0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc009cf0 tx=0x7f6bfc011810 comp rx=0 tx=0).stop 2024-09-19T08:56:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.617+0000 7f6c0a63b740 1 -- 172.21.15.19:0/590106368 shutdown_connections 2024-09-19T08:56:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.617+0000 7f6c0a63b740 1 --2- 172.21.15.19:0/590106368 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564198c67370 0x564198c69830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.617+0000 7f6c0a63b740 1 --2- 172.21.15.19:0/590106368 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564198c622e0 0x564198c66da0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.617+0000 7f6c0a63b740 1 --2- 172.21.15.19:0/590106368 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564198c619a0 0x564198c61da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.617+0000 7f6c0a63b740 1 -- 172.21.15.19:0/590106368 >> 172.21.15.19:0/590106368 conn(0x564198c5d010 msgr2=0x564198c5d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.617+0000 7f6c0a63b740 1 -- 172.21.15.19:0/590106368 shutdown_connections 2024-09-19T08:56:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.617+0000 7f6c0a63b740 1 -- 172.21.15.19:0/590106368 wait complete. 2024-09-19T08:56:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.617+0000 7f6c0a63b740 1 -- start start 2024-09-19T08:56:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.617+0000 7f6c0a63b740 1 Processor -- start 2024-09-19T08:56:34.623 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.617+0000 7f6c0a63b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564198c619a0 0x564198c6bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.618+0000 7f6c0a63b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564198c622e0 0x564198c6c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.618+0000 7f6c0a63b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564198c67370 0x564198c730e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.618+0000 7f6c0a63b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x564198c6a340 con 0x564198c67370 2024-09-19T08:56:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.618+0000 7f6c0a63b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x564198b4e290 con 0x564198c622e0 2024-09-19T08:56:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.618+0000 7f6c0a63b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564198c6a4c0 con 0x564198c619a0 2024-09-19T08:56:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.618+0000 7f6c0a63b740 10 client.0 _ll_register_callbacks cb 0x564198b7f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.618+0000 7f6c05d61640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564198c67370 0x564198c730e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.618+0000 7f6c05d61640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564198c67370 0x564198c730e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38270/0 (socket says 172.21.15.19:38270) 2024-09-19T08:56:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.618+0000 7f6c05d61640 1 -- 172.21.15.19:0/3713682647 learned_addr learned my addr 172.21.15.19:0/3713682647 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.618+0000 7f6c04d5f640 1 --2- 172.21.15.19:0/3713682647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564198c622e0 0x564198c6c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.618+0000 7f6c05560640 1 --2- 172.21.15.19:0/3713682647 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564198c619a0 0x564198c6bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:34.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.618+0000 7f6c05d61640 1 -- 172.21.15.19:0/3713682647 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564198c619a0 msgr2=0x564198c6bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.618+0000 7f6c05d61640 1 --2- 172.21.15.19:0/3713682647 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564198c619a0 0x564198c6bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.618+0000 7f6c05d61640 1 -- 172.21.15.19:0/3713682647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564198c622e0 msgr2=0x564198c6c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.618+0000 7f6c05d61640 1 --2- 172.21.15.19:0/3713682647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564198c622e0 0x564198c6c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.618+0000 7f6c05d61640 1 -- 172.21.15.19:0/3713682647 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641988d8210 con 0x564198c67370 2024-09-19T08:56:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.618+0000 7f6c05d61640 1 --2- 172.21.15.19:0/3713682647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564198c67370 0x564198c730e0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8031f80 tx=0x7f6bf80bcd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74ebdf4f7f75fba8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.618+0000 7f6be8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:56:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.618+0000 7f6be8ff9640 1 -- 172.21.15.19:0/3713682647 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf80d6060 con 0x564198c67370 2024-09-19T08:56:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.618+0000 7f6be8ff9640 1 -- 172.21.15.19:0/3713682647 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6bf80d6200 con 0x564198c67370 2024-09-19T08:56:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.618+0000 7f6c0a63b740 1 -- 172.21.15.19:0/3713682647 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bfc0043d0 con 0x564198c67370 2024-09-19T08:56:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.618+0000 7f6be8ff9640 1 -- 172.21.15.19:0/3713682647 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f6bf80b7e60 con 0x564198c67370 2024-09-19T08:56:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.618+0000 7f6c0a63b740 10 client.16371 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:34.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.619+0000 7f6c0a63b740 1 -- 172.21.15.19:0/3713682647 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5641989a4620 con 0x564198c67370 2024-09-19T08:56:34.626 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.619+0000 7f6be8ff9640 1 -- 172.21.15.19:0/3713682647 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bfc0043d0 con 0x564198c67370 2024-09-19T08:56:34.626 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.619+0000 7f6be8ff9640 1 -- 172.21.15.19:0/3713682647 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f6bf80bd550 con 0x564198c67370 2024-09-19T08:56:34.626 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.619+0000 7f6c0a63b740 10 client.16371 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:34.626 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.619+0000 7f6c0a63b740 10 client.16371 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:56:34.626 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.619+0000 7f6c0a63b740 20 client.16371 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:34.626 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.619+0000 7f6c0a63b740 1 --2- 172.21.15.19:0/3713682647 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x564198c777c0 0x564198c79c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:34.626 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.619+0000 7f6c0a63b740 4 client.16371 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:56:34.626 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.619+0000 7f6c0a63b740 1 -- 172.21.15.19:0/3713682647 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564198bd2a20 con 0x564198c777c0 2024-09-19T08:56:34.626 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.619+0000 7f6c05560640 1 --2- 172.21.15.19:0/3713682647 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x564198c777c0 0x564198c79c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:34.626 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.620+0000 7f6be8ff9640 10 client.16371 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:34.626 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.620+0000 7f6c05560640 1 --2- 172.21.15.19:0/3713682647 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x564198c777c0 0x564198c79c10 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea0b3af7666f7440 server_cookie=70c9b49251b6e5c9 in_seq=0 out_seq=0 2024-09-19T08:56:34.627 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.621+0000 7f6be8ff9640 1 -- 172.21.15.19:0/3713682647 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564198bd2a20 con 0x564198c777c0 2024-09-19T08:56:34.627 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.621+0000 7f6be8ff9640 10 client.16371 handle_command_reply: tid=0 2024-09-19T08:56:34.627 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.621+0000 7f6c0a63b740 1 client.16371 shutdown 2024-09-19T08:56:34.627 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.621+0000 7f6c0a63b740 1 -- 172.21.15.19:0/3713682647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564198c67370 msgr2=0x564198c730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:34.628 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.621+0000 7f6c0a63b740 1 --2- 172.21.15.19:0/3713682647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564198c67370 0x564198c730e0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8031f80 tx=0x7f6bf80bcd10 comp rx=0 tx=0).stop 2024-09-19T08:56:34.628 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.621+0000 7f6c0a63b740 1 -- 172.21.15.19:0/3713682647 shutdown_connections 2024-09-19T08:56:34.628 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.621+0000 7f6c0a63b740 1 --2- 172.21.15.19:0/3713682647 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x564198c777c0 0x564198c79c10 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.628 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.621+0000 7f6c0a63b740 1 --2- 172.21.15.19:0/3713682647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564198c67370 0x564198c730e0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.628 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.621+0000 7f6c0a63b740 1 --2- 172.21.15.19:0/3713682647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564198c622e0 0x564198c6c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.628 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.621+0000 7f6c0a63b740 1 --2- 172.21.15.19:0/3713682647 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564198c619a0 0x564198c6bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.628 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.621+0000 7f6c0a63b740 1 -- 172.21.15.19:0/3713682647 >> 172.21.15.19:0/3713682647 conn(0x564198c5d010 msgr2=0x564198c5e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:34.628 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.621+0000 7f6be8ff9640 0 client.16371 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:34.628 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.621+0000 7f6c0a63b740 1 -- 172.21.15.19:0/3713682647 shutdown_connections 2024-09-19T08:56:34.628 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.621+0000 7f6c0a63b740 1 -- 172.21.15.19:0/3713682647 wait complete. 2024-09-19T08:56:34.628 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.621+0000 7f6c0a63b740 20 client.16371 trim_cache size 0 max 16384 2024-09-19T08:56:34.641 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.636+0000 7f6c0a63b740 1 Processor -- start 2024-09-19T08:56:34.641 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.636+0000 7f6c0a63b740 1 -- start start 2024-09-19T08:56:34.641 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.636+0000 7f6c0a63b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564198c619a0 0x564198c61d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:34.642 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.637+0000 7f6c0a63b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564198c622e0 0x564198c730a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:34.642 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.637+0000 7f6c0a63b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564198c67370 0x564198c5dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:34.642 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.637+0000 7f6c0a63b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6c001ab0f0 con 0x564198c619a0 2024-09-19T08:56:34.642 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.637+0000 7f6c0a63b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6c001acc60 con 0x564198c67370 2024-09-19T08:56:34.642 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.637+0000 7f6c0a63b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6c001ab7c0 con 0x564198c622e0 2024-09-19T08:56:34.642 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.637+0000 7f6c05560640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564198c619a0 0x564198c61d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:34.642 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.637+0000 7f6c05560640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564198c619a0 0x564198c61d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38276/0 (socket says 172.21.15.19:38276) 2024-09-19T08:56:34.642 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.637+0000 7f6c05560640 1 -- 172.21.15.19:0/1465569576 learned_addr learned my addr 172.21.15.19:0/1465569576 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:34.642 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.637+0000 7f6c04d5f640 1 --2- 172.21.15.19:0/1465569576 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564198c622e0 0x564198c730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:34.642 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.637+0000 7f6c05d61640 1 --2- 172.21.15.19:0/1465569576 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564198c67370 0x564198c5dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:34.642 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.637+0000 7f6c05560640 1 -- 172.21.15.19:0/1465569576 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564198c622e0 msgr2=0x564198c730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:34.642 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.637+0000 7f6c05560640 1 --2- 172.21.15.19:0/1465569576 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564198c622e0 0x564198c730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.637+0000 7f6c05560640 1 -- 172.21.15.19:0/1465569576 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564198c67370 msgr2=0x564198c5dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.637+0000 7f6c05560640 1 --2- 172.21.15.19:0/1465569576 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564198c67370 0x564198c5dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.637+0000 7f6c05560640 1 -- 172.21.15.19:0/1465569576 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564198c62f70 con 0x564198c619a0 2024-09-19T08:56:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.637+0000 7f6c04d5f640 1 --2- 172.21.15.19:0/1465569576 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564198c622e0 0x564198c730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.637+0000 7f6c05d61640 1 --2- 172.21.15.19:0/1465569576 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564198c67370 0x564198c5dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.637+0000 7f6c05560640 1 --2- 172.21.15.19:0/1465569576 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564198c619a0 0x564198c61d80 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc000c00 tx=0x7f6bfc011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa2e8519ff918345 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.637+0000 7f6beaffd640 1 -- 172.21.15.19:0/1465569576 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc031070 con 0x564198c619a0 2024-09-19T08:56:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.637+0000 7f6beaffd640 1 -- 172.21.15.19:0/1465569576 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bfc005600 con 0x564198c619a0 2024-09-19T08:56:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.637+0000 7f6beaffd640 1 -- 172.21.15.19:0/1465569576 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc02b7f0 con 0x564198c619a0 2024-09-19T08:56:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.638+0000 7f6c0a63b740 1 -- 172.21.15.19:0/1465569576 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564198c619a0 msgr2=0x564198c61d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.638+0000 7f6c0a63b740 1 --2- 172.21.15.19:0/1465569576 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564198c619a0 0x564198c61d80 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc000c00 tx=0x7f6bfc011810 comp rx=0 tx=0).stop 2024-09-19T08:56:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.638+0000 7f6c0a63b740 1 -- 172.21.15.19:0/1465569576 shutdown_connections 2024-09-19T08:56:34.643 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.638+0000 7f6c0a63b740 1 --2- 172.21.15.19:0/1465569576 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564198c622e0 0x564198c730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.644 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.638+0000 7f6c0a63b740 1 --2- 172.21.15.19:0/1465569576 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564198c67370 0x564198c5dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.644 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.638+0000 7f6c0a63b740 1 --2- 172.21.15.19:0/1465569576 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564198c619a0 0x564198c61d80 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.644 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.638+0000 7f6c0a63b740 1 -- 172.21.15.19:0/1465569576 >> 172.21.15.19:0/1465569576 conn(0x564198c5d010 msgr2=0x564198c6bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:34.644 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.638+0000 7f6c0a63b740 1 -- 172.21.15.19:0/1465569576 shutdown_connections 2024-09-19T08:56:34.644 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.638+0000 7f6c0a63b740 1 -- 172.21.15.19:0/1465569576 wait complete. 2024-09-19T08:56:34.644 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.638+0000 7f6c0a63b740 1 -- start start 2024-09-19T08:56:34.644 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.638+0000 7f6c0a63b740 1 Processor -- start 2024-09-19T08:56:34.644 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.639+0000 7f6c0a63b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564198c619a0 0x564198c703c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:34.644 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.639+0000 7f6c0a63b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564198c622e0 0x564198c70900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:34.644 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.639+0000 7f6c0a63b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564198c67370 0x564198c71910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:34.644 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.639+0000 7f6c0a63b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6c001ac590 con 0x564198c619a0 2024-09-19T08:56:34.644 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.639+0000 7f6c0a63b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6c001abec0 con 0x564198c622e0 2024-09-19T08:56:34.644 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.639+0000 7f6c0a63b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6c001a90d0 con 0x564198c67370 2024-09-19T08:56:34.645 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.639+0000 7f6c0a63b740 10 client.0 _ll_register_callbacks cb 0x7f6bf802f610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:34.645 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.639+0000 7f6c05560640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564198c619a0 0x564198c703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:34.645 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.639+0000 7f6c05560640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564198c619a0 0x564198c703c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38290/0 (socket says 172.21.15.19:38290) 2024-09-19T08:56:34.645 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.639+0000 7f6c05560640 1 -- 172.21.15.19:0/823519140 learned_addr learned my addr 172.21.15.19:0/823519140 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:34.645 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.639+0000 7f6c04d5f640 1 --2- 172.21.15.19:0/823519140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564198c622e0 0x564198c70900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:34.645 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.639+0000 7f6c05560640 1 -- 172.21.15.19:0/823519140 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564198c67370 msgr2=0x564198c71910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:34.645 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.639+0000 7f6c05560640 1 --2- 172.21.15.19:0/823519140 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564198c67370 0x564198c71910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.645 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.639+0000 7f6c05560640 1 -- 172.21.15.19:0/823519140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564198c622e0 msgr2=0x564198c70900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:34.645 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.639+0000 7f6c05560640 1 --2- 172.21.15.19:0/823519140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564198c622e0 0x564198c70900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:34.645 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.639+0000 7f6c05560640 1 -- 172.21.15.19:0/823519140 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564198c71f20 con 0x564198c619a0 2024-09-19T08:56:34.645 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.639+0000 7f6c04d5f640 1 --2- 172.21.15.19:0/823519140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564198c622e0 0x564198c70900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:34.645 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.639+0000 7f6c05560640 1 --2- 172.21.15.19:0/823519140 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564198c619a0 0x564198c703c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc009ab0 tx=0x7f6bfc0096d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b79264dc79f0c6ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:34.645 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.639+0000 7f6be8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:56:34.646 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.639+0000 7f6be8ff9640 1 -- 172.21.15.19:0/823519140 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc031050 con 0x564198c619a0 2024-09-19T08:56:34.646 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.639+0000 7f6be8ff9640 1 -- 172.21.15.19:0/823519140 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6bfc003800 con 0x564198c619a0 2024-09-19T08:56:34.646 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.639+0000 7f6c0a63b740 1 -- 172.21.15.19:0/823519140 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bfc005600 con 0x564198c619a0 2024-09-19T08:56:34.646 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.640+0000 7f6be8ff9640 1 -- 172.21.15.19:0/823519140 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f6bfc011d10 con 0x564198c619a0 2024-09-19T08:56:34.646 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.640+0000 7f6c0a63b740 10 client.16377 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:34.646 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.640+0000 7f6c0a63b740 1 -- 172.21.15.19:0/823519140 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564198c73230 con 0x564198c619a0 2024-09-19T08:56:34.646 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.640+0000 7f6be8ff9640 1 -- 172.21.15.19:0/823519140 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6bfc005600 con 0x564198c619a0 2024-09-19T08:56:34.646 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.640+0000 7f6be8ff9640 1 -- 172.21.15.19:0/823519140 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f6bfc038500 con 0x564198c619a0 2024-09-19T08:56:34.646 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.640+0000 7f6c0a63b740 10 client.16377 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:34.646 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.640+0000 7f6c0a63b740 10 client.16377 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:56:34.646 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.640+0000 7f6c0a63b740 20 client.16377 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:34.646 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.640+0000 7f6c0a63b740 1 --2- 172.21.15.19:0/823519140 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x564198ceb140 0x564198ced560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:34.646 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.640+0000 7f6c0a63b740 4 client.16377 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:56:34.646 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.640+0000 7f6c0a63b740 1 -- 172.21.15.19:0/823519140 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564198bccd70 con 0x564198ceb140 2024-09-19T08:56:34.647 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.640+0000 7f6c04d5f640 1 --2- 172.21.15.19:0/823519140 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x564198ceb140 0x564198ced560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:34.647 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.641+0000 7f6be8ff9640 10 client.16377 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:34.647 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:34.641+0000 7f6c04d5f640 1 --2- 172.21.15.19:0/823519140 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x564198ceb140 0x564198ced560 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=546c5654d77fd0c4 server_cookie=57202d80a6978a42 in_seq=0 out_seq=0 2024-09-19T08:56:35.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:35 smithi155 ceph-mon[34921]: pgmap v468: 97 pgs: 97 active+clean; 15 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 1.5 MiB/s wr, 538 op/s 2024-09-19T08:56:35.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:35 smithi203 ceph-mon[35450]: pgmap v468: 97 pgs: 97 active+clean; 15 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 1.5 MiB/s wr, 538 op/s 2024-09-19T08:56:35.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:35 smithi019 ceph-mon[30976]: pgmap v468: 97 pgs: 97 active+clean; 15 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 1011 KiB/s rd, 1.5 MiB/s wr, 538 op/s 2024-09-19T08:56:36.788 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:36.788+0000 7f6be8ff9640 1 -- 172.21.15.19:0/823519140 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564198bccd70 con 0x564198ceb140 2024-09-19T08:56:36.789 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:36.788+0000 7f6be8ff9640 10 client.16377 handle_command_reply: tid=0 2024-09-19T08:56:36.789 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:36.788+0000 7f6c0a63b740 1 client.16377 shutdown 2024-09-19T08:56:36.789 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:36.788+0000 7f6c0a63b740 1 -- 172.21.15.19:0/823519140 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564198c619a0 msgr2=0x564198c703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:36.789 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:36.788+0000 7f6c0a63b740 1 --2- 172.21.15.19:0/823519140 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564198c619a0 0x564198c703c0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc009ab0 tx=0x7f6bfc0096d0 comp rx=0 tx=0).stop 2024-09-19T08:56:36.789 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:36.788+0000 7f6c0a63b740 1 -- 172.21.15.19:0/823519140 shutdown_connections 2024-09-19T08:56:36.789 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:36.788+0000 7f6c0a63b740 1 --2- 172.21.15.19:0/823519140 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x564198ceb140 0x564198ced560 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:36.789 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:36.788+0000 7f6c0a63b740 1 --2- 172.21.15.19:0/823519140 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564198c67370 0x564198c71910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:36.789 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:36.788+0000 7f6c0a63b740 1 --2- 172.21.15.19:0/823519140 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x564198c622e0 0x564198c70900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:36.789 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:36.788+0000 7f6c0a63b740 1 --2- 172.21.15.19:0/823519140 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x564198c619a0 0x564198c703c0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:36.789 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:36.788+0000 7f6c0a63b740 1 -- 172.21.15.19:0/823519140 >> 172.21.15.19:0/823519140 conn(0x564198c5d010 msgr2=0x564198c5b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:36.789 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:36.788+0000 7f6be8ff9640 0 client.16377 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:36.789 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:36.788+0000 7f6c0a63b740 1 -- 172.21.15.19:0/823519140 shutdown_connections 2024-09-19T08:56:36.790 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:36.788+0000 7f6c0a63b740 1 -- 172.21.15.19:0/823519140 wait complete. 2024-09-19T08:56:36.790 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:36.788+0000 7f6c0a63b740 20 client.16377 trim_cache size 0 max 16384 2024-09-19T08:56:36.790 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T08:56:36.790 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T08:56:36.790 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T08:56:36.790 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T08:56:36.791 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:36.789+0000 7f6c077c4640 1 -- 172.21.15.19:0/1426708302 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6bec0a3370 msgr2=0x7f6bec0a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:36.791 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:36.789+0000 7f6c077c4640 1 --2- 172.21.15.19:0/1426708302 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6bec0a3370 0x7f6bec0a5830 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f6c0019b430 tx=0x7f6bf000a6d0 comp rx=0 tx=0).stop 2024-09-19T08:56:36.791 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:36.789+0000 7f6c077c4640 1 -- 172.21.15.19:0/1426708302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c001016f0 msgr2=0x7f6c001a14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:36.791 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:36.789+0000 7f6c077c4640 1 --2- 172.21.15.19:0/1426708302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c001016f0 0x7f6c001a14d0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8005e30 tx=0x7f6bf8009890 comp rx=0 tx=0).stop 2024-09-19T08:56:36.791 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:36.789+0000 7f6c077c4640 1 -- 172.21.15.19:0/1426708302 shutdown_connections 2024-09-19T08:56:36.791 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:36.789+0000 7f6c077c4640 1 --2- 172.21.15.19:0/1426708302 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6bec0a3370 0x7f6bec0a5830 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:36.791 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:36.789+0000 7f6c077c4640 1 --2- 172.21.15.19:0/1426708302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c001016f0 0x7f6c001a14d0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:36.791 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:36.789+0000 7f6c077c4640 1 --2- 172.21.15.19:0/1426708302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c00100d50 0x7f6c0019a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:36.791 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:36.789+0000 7f6c077c4640 1 --2- 172.21.15.19:0/1426708302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c00100410 0x7f6c00199f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:36.791 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:36.789+0000 7f6c077c4640 1 -- 172.21.15.19:0/1426708302 >> 172.21.15.19:0/1426708302 conn(0x7f6c000fc1e0 msgr2=0x7f6c000fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:36.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:36.789+0000 7f6c077c4640 1 -- 172.21.15.19:0/1426708302 shutdown_connections 2024-09-19T08:56:36.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:36.790+0000 7f6c077c4640 1 -- 172.21.15.19:0/1426708302 wait complete. 2024-09-19T08:56:37.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:37 smithi155 ceph-mon[34921]: pgmap v469: 97 pgs: 97 active+clean; 19 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 467 op/s 2024-09-19T08:56:37.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:37 smithi203 ceph-mon[35450]: pgmap v469: 97 pgs: 97 active+clean; 19 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 467 op/s 2024-09-19T08:56:37.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:37 smithi019 ceph-mon[30976]: pgmap v469: 97 pgs: 97 active+clean; 19 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 467 op/s 2024-09-19T08:56:39.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:39 smithi019 ceph-mon[30976]: pgmap v470: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.2 MiB/s wr, 838 op/s 2024-09-19T08:56:39.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:39 smithi155 ceph-mon[34921]: pgmap v470: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.2 MiB/s wr, 838 op/s 2024-09-19T08:56:39.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:39 smithi203 ceph-mon[35450]: pgmap v470: 97 pgs: 97 active+clean; 16 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.2 MiB/s wr, 838 op/s 2024-09-19T08:56:41.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:41 smithi155 ceph-mon[34921]: pgmap v471: 97 pgs: 97 active+clean; 16 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 941 op/s 2024-09-19T08:56:41.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:41 smithi203 ceph-mon[35450]: pgmap v471: 97 pgs: 97 active+clean; 16 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 941 op/s 2024-09-19T08:56:41.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:41 smithi019 ceph-mon[30976]: pgmap v471: 97 pgs: 97 active+clean; 16 MiB data, 488 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 941 op/s 2024-09-19T08:56:43.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:43 smithi155 ceph-mon[34921]: pgmap v472: 97 pgs: 97 active+clean; 10 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.2 MiB/s wr, 1.33k op/s 2024-09-19T08:56:43.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:43 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:43.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:43 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:43.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:43 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:43.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:43 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:56:43.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:43 smithi203 ceph-mon[35450]: pgmap v472: 97 pgs: 97 active+clean; 10 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.2 MiB/s wr, 1.33k op/s 2024-09-19T08:56:43.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:43 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:43.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:43 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:43.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:43 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:43.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:43 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:56:43.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:43 smithi019 ceph-mon[30976]: pgmap v472: 97 pgs: 97 active+clean; 10 MiB data, 533 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.2 MiB/s wr, 1.33k op/s 2024-09-19T08:56:43.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:43 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:56:43.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:43 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:56:43.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:43 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:56:43.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:43 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:56:44.587 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:56:44.861 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:45.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.355+0000 7f21a11a9640 1 -- 172.21.15.19:0/1961741997 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f219c102ef0 msgr2=0x7f219c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:45.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.355+0000 7f21a11a9640 1 --2- 172.21.15.19:0/1961741997 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f219c102ef0 0x7f219c10da40 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f2194009ca0 tx=0x7f219402a950 comp rx=0 tx=0).stop 2024-09-19T08:56:45.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.355+0000 7f21a11a9640 1 -- 172.21.15.19:0/1961741997 shutdown_connections 2024-09-19T08:56:45.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.355+0000 7f21a11a9640 1 --2- 172.21.15.19:0/1961741997 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f219c102ef0 0x7f219c10da40 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:45.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.355+0000 7f21a11a9640 1 --2- 172.21.15.19:0/1961741997 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f219c102570 0x7f219c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:45.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.355+0000 7f21a11a9640 1 --2- 172.21.15.19:0/1961741997 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f219c100e20 0x7f219c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:45.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.355+0000 7f21a11a9640 1 -- 172.21.15.19:0/1961741997 >> 172.21.15.19:0/1961741997 conn(0x7f219c0fc7d0 msgr2=0x7f219c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:45.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.355+0000 7f21a11a9640 1 -- 172.21.15.19:0/1961741997 shutdown_connections 2024-09-19T08:56:45.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.355+0000 7f21a11a9640 1 -- 172.21.15.19:0/1961741997 wait complete. 2024-09-19T08:56:45.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.356+0000 7f21a11a9640 1 Processor -- start 2024-09-19T08:56:45.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.356+0000 7f21a11a9640 1 -- start start 2024-09-19T08:56:45.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.356+0000 7f21a11a9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f219c100e20 0x7f219c19a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:45.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.356+0000 7f21a11a9640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f219c102570 0x7f219c19abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:45.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.356+0000 7f21a11a9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f219c102ef0 0x7f219c19ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:45.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.356+0000 7f21a11a9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f219c114290 con 0x7f219c100e20 2024-09-19T08:56:45.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.356+0000 7f21a11a9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f219c114110 con 0x7f219c102ef0 2024-09-19T08:56:45.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.356+0000 7f21a11a9640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f219c114410 con 0x7f219c102570 2024-09-19T08:56:45.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.356+0000 7f219ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f219c100e20 0x7f219c19a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:45.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.356+0000 7f219ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f219c100e20 0x7f219c19a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47004/0 (socket says 172.21.15.19:47004) 2024-09-19T08:56:45.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.356+0000 7f219ad9d640 1 -- 172.21.15.19:0/944671496 learned_addr learned my addr 172.21.15.19:0/944671496 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:45.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.356+0000 7f219b59e640 1 --2- 172.21.15.19:0/944671496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f219c102ef0 0x7f219c19ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:45.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.357+0000 7f2193fff640 1 --2- 172.21.15.19:0/944671496 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f219c102570 0x7f219c19abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:45.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.357+0000 7f219ad9d640 1 -- 172.21.15.19:0/944671496 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f219c102570 msgr2=0x7f219c19abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:45.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.357+0000 7f219ad9d640 1 --2- 172.21.15.19:0/944671496 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f219c102570 0x7f219c19abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:45.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.357+0000 7f219ad9d640 1 -- 172.21.15.19:0/944671496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f219c102ef0 msgr2=0x7f219c19ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:45.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.357+0000 7f219ad9d640 1 --2- 172.21.15.19:0/944671496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f219c102ef0 0x7f219c19ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:45.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.357+0000 7f219ad9d640 1 -- 172.21.15.19:0/944671496 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f219c19f620 con 0x7f219c100e20 2024-09-19T08:56:45.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.357+0000 7f219ad9d640 1 --2- 172.21.15.19:0/944671496 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f219c100e20 0x7f219c19a670 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f218c00d950 tx=0x7f218c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:45.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.357+0000 7f2198d99640 1 -- 172.21.15.19:0/944671496 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f218c017070 con 0x7f219c100e20 2024-09-19T08:56:45.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.357+0000 7f2198d99640 1 -- 172.21.15.19:0/944671496 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f218c009c30 con 0x7f219c100e20 2024-09-19T08:56:45.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.357+0000 7f21a11a9640 1 -- 172.21.15.19:0/944671496 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f219c19f910 con 0x7f219c100e20 2024-09-19T08:56:45.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.357+0000 7f2198d99640 1 -- 172.21.15.19:0/944671496 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f218c00f6b0 con 0x7f219c100e20 2024-09-19T08:56:45.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.357+0000 7f21a11a9640 1 -- 172.21.15.19:0/944671496 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f219c1a71f0 con 0x7f219c100e20 2024-09-19T08:56:45.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.360+0000 7f21a3582740 1 Processor -- start 2024-09-19T08:56:45.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.360+0000 7f21a3582740 1 -- start start 2024-09-19T08:56:45.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.361+0000 7f21a3582740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609b149b4a0 0x5609b149b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:45.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.361+0000 7f21a3582740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609b149bdc0 0x5609b14a6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:45.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.361+0000 7f21a3582740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609b14a6680 0x5609b14a8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:45.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.361+0000 7f21a3582740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5609b14012e0 con 0x5609b149b4a0 2024-09-19T08:56:45.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.361+0000 7f21a3582740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5609b13a8ce0 con 0x5609b14a6680 2024-09-19T08:56:45.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.361+0000 7f21a3582740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5609b13fd2a0 con 0x5609b149bdc0 2024-09-19T08:56:45.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.361+0000 7f2198d99640 1 -- 172.21.15.19:0/944671496 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f218c00f850 con 0x7f219c100e20 2024-09-19T08:56:45.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.361+0000 7f219b59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609b149b4a0 0x5609b149b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:45.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.361+0000 7f219b59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609b149b4a0 0x5609b149b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47008/0 (socket says 172.21.15.19:47008) 2024-09-19T08:56:45.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.361+0000 7f219b59e640 1 -- 172.21.15.19:0/34744605 learned_addr learned my addr 172.21.15.19:0/34744605 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:45.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.361+0000 7f2193fff640 1 --2- 172.21.15.19:0/34744605 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609b14a6680 0x5609b14a8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:45.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.361+0000 7f219ad9d640 1 --2- 172.21.15.19:0/34744605 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609b149bdc0 0x5609b14a6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:45.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.361+0000 7f219b59e640 1 -- 172.21.15.19:0/34744605 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609b149bdc0 msgr2=0x5609b14a6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:45.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.361+0000 7f219b59e640 1 --2- 172.21.15.19:0/34744605 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609b149bdc0 0x5609b14a6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:45.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.361+0000 7f219b59e640 1 -- 172.21.15.19:0/34744605 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609b14a6680 msgr2=0x5609b14a8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:45.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.361+0000 7f219b59e640 1 --2- 172.21.15.19:0/34744605 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609b14a6680 0x5609b14a8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:45.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.361+0000 7f219b59e640 1 -- 172.21.15.19:0/34744605 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609b138d440 con 0x5609b149b4a0 2024-09-19T08:56:45.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.361+0000 7f219ad9d640 1 --2- 172.21.15.19:0/34744605 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609b149bdc0 0x5609b14a6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:56:45.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.362+0000 7f219b59e640 1 --2- 172.21.15.19:0/34744605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609b149b4a0 0x5609b149b880 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f2194035000 tx=0x7f2194005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6c42cb3d79822c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:45.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.362+0000 7f2198d99640 1 --2- 172.21.15.19:0/944671496 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f21880a3230 0x7f21880a56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:45.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.362+0000 7f21917fa640 1 -- 172.21.15.19:0/34744605 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2194048070 con 0x5609b149b4a0 2024-09-19T08:56:45.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.362+0000 7f21917fa640 1 -- 172.21.15.19:0/34744605 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f219402f930 con 0x5609b149b4a0 2024-09-19T08:56:45.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.362+0000 7f21917fa640 1 -- 172.21.15.19:0/34744605 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2194034040 con 0x5609b149b4a0 2024-09-19T08:56:45.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.362+0000 7f2198d99640 1 -- 172.21.15.19:0/944671496 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f218c0cf570 con 0x7f219c100e20 2024-09-19T08:56:45.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.363+0000 7f219ad9d640 1 --2- 172.21.15.19:0/944671496 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f21880a3230 0x7f21880a56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:45.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.363+0000 7f21a3582740 1 -- 172.21.15.19:0/34744605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609b149b4a0 msgr2=0x5609b149b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:45.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.363+0000 7f21a3582740 1 --2- 172.21.15.19:0/34744605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609b149b4a0 0x5609b149b880 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f2194035000 tx=0x7f2194005fa0 comp rx=0 tx=0).stop 2024-09-19T08:56:45.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.363+0000 7f219ad9d640 1 --2- 172.21.15.19:0/944671496 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f21880a3230 0x7f21880a56f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f218c0cd3f0 tx=0x7f218c005880 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:45.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.363+0000 7f21a3582740 1 -- 172.21.15.19:0/34744605 shutdown_connections 2024-09-19T08:56:45.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.363+0000 7f21a3582740 1 --2- 172.21.15.19:0/34744605 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609b149bdc0 0x5609b14a6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:45.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.363+0000 7f21a3582740 1 --2- 172.21.15.19:0/34744605 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609b14a6680 0x5609b14a8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:45.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.363+0000 7f21a3582740 1 --2- 172.21.15.19:0/34744605 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609b149b4a0 0x5609b149b880 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:45.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.363+0000 7f21a3582740 1 -- 172.21.15.19:0/34744605 >> 172.21.15.19:0/34744605 conn(0x5609b1497a30 msgr2=0x5609b1497e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:45.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.363+0000 7f21a3582740 1 -- 172.21.15.19:0/34744605 shutdown_connections 2024-09-19T08:56:45.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.363+0000 7f21a3582740 1 -- 172.21.15.19:0/34744605 wait complete. 2024-09-19T08:56:45.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.364+0000 7f21a3582740 1 -- start start 2024-09-19T08:56:45.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.364+0000 7f21a3582740 1 Processor -- start 2024-09-19T08:56:45.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.364+0000 7f21a3582740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609b149b4a0 0x5609b14a5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:45.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.364+0000 7f21a3582740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609b149bdc0 0x5609b14a3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:45.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.364+0000 7f21a3582740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609b14a6680 0x5609b14a3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:45.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.364+0000 7f21a3582740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5609b14a9250 con 0x5609b149b4a0 2024-09-19T08:56:45.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.364+0000 7f21a3582740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5609b13bc050 con 0x5609b149bdc0 2024-09-19T08:56:45.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.364+0000 7f21a3582740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5609b14a93d0 con 0x5609b14a6680 2024-09-19T08:56:45.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.364+0000 7f21a3582740 10 client.0 _ll_register_callbacks cb 0x5609b13fc160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:45.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.364+0000 7f219b59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609b149b4a0 0x5609b14a5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:45.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.364+0000 7f219b59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609b149b4a0 0x5609b14a5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47010/0 (socket says 172.21.15.19:47010) 2024-09-19T08:56:45.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.365+0000 7f219b59e640 1 -- 172.21.15.19:0/1931685050 learned_addr learned my addr 172.21.15.19:0/1931685050 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:45.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.365+0000 7f2193fff640 1 --2- 172.21.15.19:0/1931685050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609b149bdc0 0x5609b14a3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:45.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.365+0000 7f219b59e640 1 --2- 172.21.15.19:0/1931685050 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609b14a6680 0x5609b14a3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:45.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.365+0000 7f219b59e640 1 -- 172.21.15.19:0/1931685050 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609b14a6680 msgr2=0x5609b14a3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:45.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.365+0000 7f219b59e640 1 --2- 172.21.15.19:0/1931685050 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609b14a6680 0x5609b14a3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:45.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.365+0000 7f219b59e640 1 -- 172.21.15.19:0/1931685050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609b149bdc0 msgr2=0x5609b14a3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:45.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.365+0000 7f219b59e640 1 --2- 172.21.15.19:0/1931685050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609b149bdc0 0x5609b14a3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:45.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.365+0000 7f219b59e640 1 -- 172.21.15.19:0/1931685050 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609b11723c0 con 0x5609b149b4a0 2024-09-19T08:56:45.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.365+0000 7f219b59e640 1 --2- 172.21.15.19:0/1931685050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609b149b4a0 0x5609b14a5fa0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f2194003c60 tx=0x7f2194009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd309bd38fce5d21 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:45.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.365+0000 7f21827fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:56:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.365+0000 7f21827fc640 1 -- 172.21.15.19:0/1931685050 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2194048040 con 0x5609b149b4a0 2024-09-19T08:56:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.365+0000 7f21827fc640 1 -- 172.21.15.19:0/1931685050 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2194004070 con 0x5609b149b4a0 2024-09-19T08:56:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.365+0000 7f21a3582740 1 -- 172.21.15.19:0/1931685050 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f219402f930 con 0x5609b149b4a0 2024-09-19T08:56:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.366+0000 7f21827fc640 1 -- 172.21.15.19:0/1931685050 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f2194034040 con 0x5609b149b4a0 2024-09-19T08:56:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.366+0000 7f21a3582740 10 client.16389 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.366+0000 7f21a3582740 1 -- 172.21.15.19:0/1931685050 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5609b14b4b40 con 0x5609b149b4a0 2024-09-19T08:56:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.366+0000 7f21827fc640 1 -- 172.21.15.19:0/1931685050 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f219402f930 con 0x5609b149b4a0 2024-09-19T08:56:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.366+0000 7f21827fc640 1 -- 172.21.15.19:0/1931685050 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f2194030950 con 0x5609b149b4a0 2024-09-19T08:56:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.366+0000 7f21a3582740 10 client.16389 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.366+0000 7f21a3582740 10 client.16389 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:56:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.366+0000 7f21a3582740 20 client.16389 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.366+0000 7f21a3582740 1 --2- 172.21.15.19:0/1931685050 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5609b14b5e90 0x5609b14b8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.366+0000 7f21a3582740 4 client.16389 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:56:45.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.366+0000 7f21a3582740 1 -- 172.21.15.19:0/1931685050 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5609b140e850 con 0x5609b14b5e90 2024-09-19T08:56:45.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.366+0000 7f2193fff640 1 --2- 172.21.15.19:0/1931685050 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5609b14b5e90 0x5609b14b8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:45.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.367+0000 7f2193fff640 1 --2- 172.21.15.19:0/1931685050 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5609b14b5e90 0x5609b14b8280 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b7a4a3d655948e4 server_cookie=6354bfd294a9d87b in_seq=0 out_seq=0 2024-09-19T08:56:45.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.367+0000 7f21827fc640 10 client.16389 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:45.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.368+0000 7f21827fc640 1 -- 172.21.15.19:0/1931685050 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5609b140e850 con 0x5609b14b5e90 2024-09-19T08:56:45.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.368+0000 7f21827fc640 10 client.16389 handle_command_reply: tid=0 2024-09-19T08:56:45.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.368+0000 7f21a3582740 1 client.16389 shutdown 2024-09-19T08:56:45.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.368+0000 7f21a3582740 1 -- 172.21.15.19:0/1931685050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609b149b4a0 msgr2=0x5609b14a5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:45.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.368+0000 7f21a3582740 1 --2- 172.21.15.19:0/1931685050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609b149b4a0 0x5609b14a5fa0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f2194003c60 tx=0x7f2194009580 comp rx=0 tx=0).stop 2024-09-19T08:56:45.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.368+0000 7f21a3582740 1 -- 172.21.15.19:0/1931685050 shutdown_connections 2024-09-19T08:56:45.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.368+0000 7f21a3582740 1 --2- 172.21.15.19:0/1931685050 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5609b14b5e90 0x5609b14b8280 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:45.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.368+0000 7f21a3582740 1 --2- 172.21.15.19:0/1931685050 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609b14a6680 0x5609b14a3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:45.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.368+0000 7f21a3582740 1 --2- 172.21.15.19:0/1931685050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609b149bdc0 0x5609b14a3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:45.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.368+0000 7f21a3582740 1 --2- 172.21.15.19:0/1931685050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609b149b4a0 0x5609b14a5fa0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:45.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.368+0000 7f21a3582740 1 -- 172.21.15.19:0/1931685050 >> 172.21.15.19:0/1931685050 conn(0x5609b1497a30 msgr2=0x5609b1496b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:45.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.368+0000 7f21827fc640 0 client.16389 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:45.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.369+0000 7f21a3582740 1 -- 172.21.15.19:0/1931685050 shutdown_connections 2024-09-19T08:56:45.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.369+0000 7f21a3582740 1 -- 172.21.15.19:0/1931685050 wait complete. 2024-09-19T08:56:45.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.369+0000 7f21a3582740 20 client.16389 trim_cache size 0 max 16384 2024-09-19T08:56:45.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.406+0000 7f21a3582740 1 Processor -- start 2024-09-19T08:56:45.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.406+0000 7f21a3582740 1 -- start start 2024-09-19T08:56:45.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.406+0000 7f21a3582740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609b1497a30 0x5609b14b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:45.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.406+0000 7f21a3582740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609b149b4a0 0x5609b14a1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:45.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.406+0000 7f21a3582740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609b149bdc0 0x5609b14bd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:45.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.406+0000 7f21a3582740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f219c1af660 con 0x5609b1497a30 2024-09-19T08:56:45.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.406+0000 7f21a3582740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f219c1b11d0 con 0x5609b149bdc0 2024-09-19T08:56:45.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.406+0000 7f21a3582740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f219c1afd30 con 0x5609b149b4a0 2024-09-19T08:56:45.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.407+0000 7f219b59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609b1497a30 0x5609b14b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:45.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.407+0000 7f219b59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609b1497a30 0x5609b14b24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47020/0 (socket says 172.21.15.19:47020) 2024-09-19T08:56:45.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.407+0000 7f2193fff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609b149b4a0 0x5609b14a1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:45.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.407+0000 7f219b59e640 1 -- 172.21.15.19:0/537942593 learned_addr learned my addr 172.21.15.19:0/537942593 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:45.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.407+0000 7f219b59e640 1 --2- 172.21.15.19:0/537942593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609b149bdc0 0x5609b14bd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:45.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.407+0000 7f219b59e640 1 -- 172.21.15.19:0/537942593 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609b149b4a0 msgr2=0x5609b14a1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:45.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.407+0000 7f219b59e640 1 --2- 172.21.15.19:0/537942593 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609b149b4a0 0x5609b14a1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:45.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.407+0000 7f219b59e640 1 -- 172.21.15.19:0/537942593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609b149bdc0 msgr2=0x5609b14bd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:45.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.407+0000 7f219b59e640 1 --2- 172.21.15.19:0/537942593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609b149bdc0 0x5609b14bd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:45.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.407+0000 7f219b59e640 1 -- 172.21.15.19:0/537942593 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609b14a2200 con 0x5609b1497a30 2024-09-19T08:56:45.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.407+0000 7f219b59e640 1 --2- 172.21.15.19:0/537942593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609b1497a30 0x5609b14b24b0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f219402f800 tx=0x7f2194000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12267cbe70f5ded6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:45.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.407+0000 7f2190ff9640 1 -- 172.21.15.19:0/537942593 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2194048070 con 0x5609b1497a30 2024-09-19T08:56:45.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.407+0000 7f2190ff9640 1 -- 172.21.15.19:0/537942593 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f219405f020 con 0x5609b1497a30 2024-09-19T08:56:45.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.407+0000 7f2190ff9640 1 -- 172.21.15.19:0/537942593 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2194004070 con 0x5609b1497a30 2024-09-19T08:56:45.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.408+0000 7f21a3582740 1 -- 172.21.15.19:0/537942593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609b1497a30 msgr2=0x5609b14b24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:45.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.408+0000 7f21a3582740 1 --2- 172.21.15.19:0/537942593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609b1497a30 0x5609b14b24b0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f219402f800 tx=0x7f2194000f40 comp rx=0 tx=0).stop 2024-09-19T08:56:45.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.408+0000 7f21a3582740 1 -- 172.21.15.19:0/537942593 shutdown_connections 2024-09-19T08:56:45.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.408+0000 7f21a3582740 1 --2- 172.21.15.19:0/537942593 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609b149b4a0 0x5609b14a1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:45.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.408+0000 7f21a3582740 1 --2- 172.21.15.19:0/537942593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609b149bdc0 0x5609b14bd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:45.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.408+0000 7f21a3582740 1 --2- 172.21.15.19:0/537942593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609b1497a30 0x5609b14b24b0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:45.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.408+0000 7f21a3582740 1 -- 172.21.15.19:0/537942593 >> 172.21.15.19:0/537942593 conn(0x5609b14a38f0 msgr2=0x5609b149e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:45.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.408+0000 7f21a3582740 1 -- 172.21.15.19:0/537942593 shutdown_connections 2024-09-19T08:56:45.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.408+0000 7f21a3582740 1 -- 172.21.15.19:0/537942593 wait complete. 2024-09-19T08:56:45.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.409+0000 7f21a3582740 1 -- start start 2024-09-19T08:56:45.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.409+0000 7f21a3582740 1 Processor -- start 2024-09-19T08:56:45.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.409+0000 7f21a3582740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609b1497a30 0x5609b14aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:45.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.409+0000 7f21a3582740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609b149b4a0 0x5609b14aa930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:45.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.409+0000 7f21a3582740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609b149bdc0 0x5609b14aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:45.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.409+0000 7f21a3582740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f219c1b0b00 con 0x5609b149bdc0 2024-09-19T08:56:45.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.409+0000 7f21a3582740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f219c1b0430 con 0x5609b149b4a0 2024-09-19T08:56:45.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.409+0000 7f21a3582740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f219c1ad640 con 0x5609b1497a30 2024-09-19T08:56:45.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.409+0000 7f21a3582740 10 client.0 _ll_register_callbacks cb 0x7f2194046070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:45.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.409+0000 7f219b59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609b149bdc0 0x5609b14aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:45.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.409+0000 7f219b59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609b149bdc0 0x5609b14aae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47030/0 (socket says 172.21.15.19:47030) 2024-09-19T08:56:45.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.409+0000 7f219b59e640 1 -- 172.21.15.19:0/2929261722 learned_addr learned my addr 172.21.15.19:0/2929261722 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:45.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.409+0000 7f219b59e640 1 --2- 172.21.15.19:0/2929261722 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609b1497a30 0x5609b14aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:45.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.410+0000 7f2193fff640 1 --2- 172.21.15.19:0/2929261722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609b149b4a0 0x5609b14aa930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:45.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.410+0000 7f219b59e640 1 -- 172.21.15.19:0/2929261722 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609b1497a30 msgr2=0x5609b14aa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:45.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.410+0000 7f219b59e640 1 --2- 172.21.15.19:0/2929261722 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609b1497a30 0x5609b14aa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:45.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.410+0000 7f219b59e640 1 -- 172.21.15.19:0/2929261722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609b149b4a0 msgr2=0x5609b14aa930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:45.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.410+0000 7f219b59e640 1 --2- 172.21.15.19:0/2929261722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609b149b4a0 0x5609b14aa930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:45.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.410+0000 7f219b59e640 1 -- 172.21.15.19:0/2929261722 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609b151f8a0 con 0x5609b149bdc0 2024-09-19T08:56:45.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.410+0000 7f219b59e640 1 --2- 172.21.15.19:0/2929261722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609b149bdc0 0x5609b14aae70 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f2194030040 tx=0x7f2194030a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f09b0e8a6546dc79 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:45.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.410+0000 7f21827fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:56:45.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.410+0000 7f21827fc640 1 -- 172.21.15.19:0/2929261722 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2194048040 con 0x5609b149bdc0 2024-09-19T08:56:45.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.410+0000 7f21827fc640 1 -- 172.21.15.19:0/2929261722 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2194060040 con 0x5609b149bdc0 2024-09-19T08:56:45.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.410+0000 7f21a3582740 1 -- 172.21.15.19:0/2929261722 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f219405f020 con 0x5609b149bdc0 2024-09-19T08:56:45.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.410+0000 7f21827fc640 1 -- 172.21.15.19:0/2929261722 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f2194009b20 con 0x5609b149bdc0 2024-09-19T08:56:45.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.410+0000 7f21a3582740 10 client.16395 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:45.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.410+0000 7f21a3582740 1 -- 172.21.15.19:0/2929261722 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5609b1520b90 con 0x5609b149bdc0 2024-09-19T08:56:45.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.411+0000 7f21827fc640 1 -- 172.21.15.19:0/2929261722 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f219405f020 con 0x5609b149bdc0 2024-09-19T08:56:45.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.411+0000 7f21827fc640 1 -- 172.21.15.19:0/2929261722 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f2194071020 con 0x5609b149bdc0 2024-09-19T08:56:45.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.411+0000 7f21a3582740 10 client.16395 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:45.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.411+0000 7f21a3582740 10 client.16395 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:56:45.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.411+0000 7f21a3582740 20 client.16395 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:45.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.411+0000 7f21a3582740 1 --2- 172.21.15.19:0/2929261722 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5609b14a6680 0x5609b15231f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:45.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.411+0000 7f21a3582740 4 client.16395 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:56:45.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.411+0000 7f21a3582740 1 -- 172.21.15.19:0/2929261722 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5609b1408d60 con 0x5609b14a6680 2024-09-19T08:56:45.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.411+0000 7f2193fff640 1 --2- 172.21.15.19:0/2929261722 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5609b14a6680 0x5609b15231f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:45.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.412+0000 7f2193fff640 1 --2- 172.21.15.19:0/2929261722 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5609b14a6680 0x5609b15231f0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4c61e49a2c82af5 server_cookie=f00ad0b26bef7375 in_seq=0 out_seq=0 2024-09-19T08:56:45.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.412+0000 7f21827fc640 10 client.16395 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:45.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.413+0000 7f21827fc640 1 -- 172.21.15.19:0/2929261722 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5609b1408d60 con 0x5609b14a6680 2024-09-19T08:56:45.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.413+0000 7f21827fc640 10 client.16395 handle_command_reply: tid=0 2024-09-19T08:56:45.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.413+0000 7f21a3582740 1 client.16395 shutdown 2024-09-19T08:56:45.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.413+0000 7f21a3582740 1 -- 172.21.15.19:0/2929261722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609b149bdc0 msgr2=0x5609b14aae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:45.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.413+0000 7f21a3582740 1 --2- 172.21.15.19:0/2929261722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609b149bdc0 0x5609b14aae70 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f2194030040 tx=0x7f2194030a60 comp rx=0 tx=0).stop 2024-09-19T08:56:45.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.413+0000 7f21a3582740 1 -- 172.21.15.19:0/2929261722 shutdown_connections 2024-09-19T08:56:45.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.413+0000 7f21a3582740 1 --2- 172.21.15.19:0/2929261722 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5609b14a6680 0x5609b15231f0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:45.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.413+0000 7f21a3582740 1 --2- 172.21.15.19:0/2929261722 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609b149bdc0 0x5609b14aae70 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:45.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.413+0000 7f21a3582740 1 --2- 172.21.15.19:0/2929261722 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609b149b4a0 0x5609b14aa930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:45.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.413+0000 7f21a3582740 1 --2- 172.21.15.19:0/2929261722 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609b1497a30 0x5609b14aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:45.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.413+0000 7f21827fc640 0 client.16395 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:45.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.413+0000 7f21a3582740 1 -- 172.21.15.19:0/2929261722 >> 172.21.15.19:0/2929261722 conn(0x5609b14a38f0 msgr2=0x5609b149d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:45.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.413+0000 7f21a3582740 1 -- 172.21.15.19:0/2929261722 shutdown_connections 2024-09-19T08:56:45.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.413+0000 7f21a3582740 1 -- 172.21.15.19:0/2929261722 wait complete. 2024-09-19T08:56:45.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.413+0000 7f21a3582740 20 client.16395 trim_cache size 0 max 16384 2024-09-19T08:56:45.418 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:56:45.419 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-19T08:56:45.419 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {} 2024-09-19T08:56:45.419 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:56:45.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.414+0000 7f21a11a9640 1 -- 172.21.15.19:0/944671496 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f21880a3230 msgr2=0x7f21880a56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:45.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.414+0000 7f21a11a9640 1 --2- 172.21.15.19:0/944671496 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f21880a3230 0x7f21880a56f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f218c0cd3f0 tx=0x7f218c005880 comp rx=0 tx=0).stop 2024-09-19T08:56:45.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.414+0000 7f21a11a9640 1 -- 172.21.15.19:0/944671496 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f219c100e20 msgr2=0x7f219c19a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:45.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.414+0000 7f21a11a9640 1 --2- 172.21.15.19:0/944671496 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f219c100e20 0x7f219c19a670 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f218c00d950 tx=0x7f218c00de10 comp rx=0 tx=0).stop 2024-09-19T08:56:45.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.414+0000 7f21a11a9640 1 -- 172.21.15.19:0/944671496 shutdown_connections 2024-09-19T08:56:45.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.414+0000 7f21a11a9640 1 --2- 172.21.15.19:0/944671496 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f21880a3230 0x7f21880a56f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:45.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.414+0000 7f21a11a9640 1 --2- 172.21.15.19:0/944671496 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f219c102570 0x7f219c19abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:45.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.414+0000 7f21a11a9640 1 --2- 172.21.15.19:0/944671496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f219c102ef0 0x7f219c19ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:45.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.414+0000 7f21a11a9640 1 --2- 172.21.15.19:0/944671496 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f219c100e20 0x7f219c19a670 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:45.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.414+0000 7f21a11a9640 1 -- 172.21.15.19:0/944671496 >> 172.21.15.19:0/944671496 conn(0x7f219c0fc7d0 msgr2=0x7f219c106820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:45.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.414+0000 7f21a11a9640 1 -- 172.21.15.19:0/944671496 shutdown_connections 2024-09-19T08:56:45.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:45.414+0000 7f21a11a9640 1 -- 172.21.15.19:0/944671496 wait complete. 2024-09-19T08:56:45.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:45 smithi019 ceph-mon[30976]: pgmap v473: 97 pgs: 97 active+clean; 10 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 1.30k op/s 2024-09-19T08:56:45.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:45 smithi155 ceph-mon[34921]: pgmap v473: 97 pgs: 97 active+clean; 10 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 1.30k op/s 2024-09-19T08:56:45.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:45 smithi203 ceph-mon[35450]: pgmap v473: 97 pgs: 97 active+clean; 10 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 1.30k op/s 2024-09-19T08:56:46.202 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:56:46.202 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:56:46.493 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:46.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.962+0000 7fd268e55640 1 -- 172.21.15.19:0/217440538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd264100a80 msgr2=0x7fd264100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:46.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.962+0000 7fd268e55640 1 --2- 172.21.15.19:0/217440538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd264100a80 0x7fd264100ee0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fd258009930 tx=0x7fd25802a420 comp rx=0 tx=0).stop 2024-09-19T08:56:46.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.962+0000 7fd268e55640 1 -- 172.21.15.19:0/217440538 shutdown_connections 2024-09-19T08:56:46.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.962+0000 7fd268e55640 1 --2- 172.21.15.19:0/217440538 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd264101420 0x7fd26410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:46.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.962+0000 7fd268e55640 1 --2- 172.21.15.19:0/217440538 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd264100a80 0x7fd264100ee0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:46.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.962+0000 7fd268e55640 1 --2- 172.21.15.19:0/217440538 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd264106a80 0x7fd264106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:46.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.962+0000 7fd268e55640 1 -- 172.21.15.19:0/217440538 >> 172.21.15.19:0/217440538 conn(0x7fd2640fc7a0 msgr2=0x7fd2640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:46.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.962+0000 7fd268e55640 1 -- 172.21.15.19:0/217440538 shutdown_connections 2024-09-19T08:56:46.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.962+0000 7fd268e55640 1 -- 172.21.15.19:0/217440538 wait complete. 2024-09-19T08:56:46.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.963+0000 7fd268e55640 1 Processor -- start 2024-09-19T08:56:46.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.963+0000 7fd268e55640 1 -- start start 2024-09-19T08:56:46.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.963+0000 7fd268e55640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd264100a80 0x7fd2641992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:46.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.963+0000 7fd268e55640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd264101420 0x7fd264199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:46.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.963+0000 7fd268e55640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd264106a80 0x7fd2641a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:46.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.963+0000 7fd268e55640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd264110e80 con 0x7fd264106a80 2024-09-19T08:56:46.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.963+0000 7fd268e55640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd264110d00 con 0x7fd264101420 2024-09-19T08:56:46.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.963+0000 7fd268e55640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd264111000 con 0x7fd264100a80 2024-09-19T08:56:46.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.963+0000 7fd262d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd264106a80 0x7fd2641a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:46.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.963+0000 7fd261d9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd264101420 0x7fd264199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:46.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.963+0000 7fd262d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd264106a80 0x7fd2641a4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47044/0 (socket says 172.21.15.19:47044) 2024-09-19T08:56:46.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.963+0000 7fd262d9d640 1 -- 172.21.15.19:0/38968341 learned_addr learned my addr 172.21.15.19:0/38968341 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:46.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.963+0000 7fd261d9b640 1 --2- 172.21.15.19:0/38968341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd264101420 0x7fd264199820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:39488/0 (socket says 172.21.15.19:39488) 2024-09-19T08:56:46.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.964+0000 7fd26259c640 1 --2- 172.21.15.19:0/38968341 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd264100a80 0x7fd2641992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:46.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.964+0000 7fd262d9d640 1 -- 172.21.15.19:0/38968341 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd264100a80 msgr2=0x7fd2641992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:46.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.964+0000 7fd262d9d640 1 --2- 172.21.15.19:0/38968341 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd264100a80 0x7fd2641992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:46.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.964+0000 7fd262d9d640 1 -- 172.21.15.19:0/38968341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd264101420 msgr2=0x7fd264199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:46.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.964+0000 7fd262d9d640 1 --2- 172.21.15.19:0/38968341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd264101420 0x7fd264199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:46.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.964+0000 7fd262d9d640 1 -- 172.21.15.19:0/38968341 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2641a48a0 con 0x7fd264106a80 2024-09-19T08:56:46.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.964+0000 7fd261d9b640 1 --2- 172.21.15.19:0/38968341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd264101420 0x7fd264199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:46.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.964+0000 7fd262d9d640 1 --2- 172.21.15.19:0/38968341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd264106a80 0x7fd2641a4360 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fd25c00cad0 tx=0x7fd25c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:46.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.964+0000 7fd2537fe640 1 -- 172.21.15.19:0/38968341 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd25c00ae20 con 0x7fd264106a80 2024-09-19T08:56:46.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.964+0000 7fd2537fe640 1 -- 172.21.15.19:0/38968341 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd25c005020 con 0x7fd264106a80 2024-09-19T08:56:46.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.964+0000 7fd268e55640 1 -- 172.21.15.19:0/38968341 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2641a4a70 con 0x7fd264106a80 2024-09-19T08:56:46.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.964+0000 7fd2537fe640 1 -- 172.21.15.19:0/38968341 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd25c00f6f0 con 0x7fd264106a80 2024-09-19T08:56:46.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.964+0000 7fd268e55640 1 -- 172.21.15.19:0/38968341 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2641a4f80 con 0x7fd264106a80 2024-09-19T08:56:46.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.965+0000 7fd268e55640 1 -- 172.21.15.19:0/38968341 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd264100ee0 con 0x7fd264106a80 2024-09-19T08:56:46.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.967+0000 7fd2537fe640 1 -- 172.21.15.19:0/38968341 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fd25c0051d0 con 0x7fd264106a80 2024-09-19T08:56:46.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.967+0000 7fd2537fe640 1 --2- 172.21.15.19:0/38968341 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd24c0a32c0 0x7fd24c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:46.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.967+0000 7fd26259c640 1 --2- 172.21.15.19:0/38968341 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd24c0a32c0 0x7fd24c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:46.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.967+0000 7fd2537fe640 1 -- 172.21.15.19:0/38968341 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd25c0cf840 con 0x7fd264106a80 2024-09-19T08:56:46.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.968+0000 7fd26259c640 1 --2- 172.21.15.19:0/38968341 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd24c0a32c0 0x7fd24c0a5780 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd254009b50 tx=0x7fd254005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:46.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:46.972+0000 7fd2537fe640 1 -- 172.21.15.19:0/38968341 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd25c014030 con 0x7fd264106a80 2024-09-19T08:56:47.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:47.192+0000 7fd268e55640 1 -- 172.21.15.19:0/38968341 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd264108ff0 con 0x7fd264106a80 2024-09-19T08:56:47.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:47.192+0000 7fd2537fe640 1 -- 172.21.15.19:0/38968341 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11984 (secure 0 0 0) 0x7fd25c09bf20 con 0x7fd264106a80 2024-09-19T08:56:47.193 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:56:47.193 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":33,"btime":"2024-09-19T08:55:57:276679+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2452068876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2452068876},{"type":"v1","addr":"172.21.15.19:6839","nonce":2452068876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T08:55:56.383946+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/2480841559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2480841559},{"type":"v1","addr":"172.21.15.155:6835","nonce":2480841559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24469,24490,24464,24463]},"id":1}]} 2024-09-19T08:56:47.193 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 33 2024-09-19T08:56:47.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:47.195+0000 7fd268e55640 1 -- 172.21.15.19:0/38968341 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd24c0a32c0 msgr2=0x7fd24c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:47.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:47.195+0000 7fd268e55640 1 --2- 172.21.15.19:0/38968341 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd24c0a32c0 0x7fd24c0a5780 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd254009b50 tx=0x7fd254005f90 comp rx=0 tx=0).stop 2024-09-19T08:56:47.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:47.195+0000 7fd268e55640 1 -- 172.21.15.19:0/38968341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd264106a80 msgr2=0x7fd2641a4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:47.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:47.195+0000 7fd268e55640 1 --2- 172.21.15.19:0/38968341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd264106a80 0x7fd2641a4360 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fd25c00cad0 tx=0x7fd25c00cf90 comp rx=0 tx=0).stop 2024-09-19T08:56:47.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:47.195+0000 7fd268e55640 1 -- 172.21.15.19:0/38968341 shutdown_connections 2024-09-19T08:56:47.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:47.195+0000 7fd268e55640 1 --2- 172.21.15.19:0/38968341 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd24c0a32c0 0x7fd24c0a5780 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:47.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:47.195+0000 7fd268e55640 1 --2- 172.21.15.19:0/38968341 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd264106a80 0x7fd2641a4360 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:47.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:47.195+0000 7fd268e55640 1 --2- 172.21.15.19:0/38968341 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd264101420 0x7fd264199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:47.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:47.195+0000 7fd268e55640 1 --2- 172.21.15.19:0/38968341 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd264100a80 0x7fd2641992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:47.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:47.195+0000 7fd268e55640 1 -- 172.21.15.19:0/38968341 >> 172.21.15.19:0/38968341 conn(0x7fd2640fc7a0 msgr2=0x7fd2640fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:47.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:47.195+0000 7fd268e55640 1 -- 172.21.15.19:0/38968341 shutdown_connections 2024-09-19T08:56:47.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:47.195+0000 7fd268e55640 1 -- 172.21.15.19:0/38968341 wait complete. 2024-09-19T08:56:47.510 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:47 smithi019 ceph-mon[30976]: pgmap v474: 97 pgs: 97 active+clean; 17 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 1.30k op/s 2024-09-19T08:56:47.510 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:47 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/38968341' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:47.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:47 smithi155 ceph-mon[34921]: pgmap v474: 97 pgs: 97 active+clean; 17 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 1.30k op/s 2024-09-19T08:56:47.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:47 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/38968341' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:47.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:47 smithi203 ceph-mon[35450]: pgmap v474: 97 pgs: 97 active+clean; 17 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.3 MiB/s wr, 1.30k op/s 2024-09-19T08:56:47.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:47 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/38968341' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:47.940 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T08:56:48.213 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:48.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.713+0000 7f37e09fc640 1 -- 172.21.15.19:0/558006978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37dc1036e0 msgr2=0x7f37dc107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:48.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.713+0000 7f37e09fc640 1 --2- 172.21.15.19:0/558006978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37dc1036e0 0x7f37dc107b90 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f37c4009930 tx=0x7f37c402a420 comp rx=0 tx=0).stop 2024-09-19T08:56:48.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.713+0000 7f37e09fc640 1 -- 172.21.15.19:0/558006978 shutdown_connections 2024-09-19T08:56:48.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.713+0000 7f37e09fc640 1 --2- 172.21.15.19:0/558006978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37dc1082a0 0x7f37dc10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:48.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.713+0000 7f37e09fc640 1 --2- 172.21.15.19:0/558006978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37dc1036e0 0x7f37dc107b90 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:48.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.713+0000 7f37e09fc640 1 --2- 172.21.15.19:0/558006978 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f37dc102d30 0x7f37dc103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:48.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.713+0000 7f37e09fc640 1 -- 172.21.15.19:0/558006978 >> 172.21.15.19:0/558006978 conn(0x7f37dc0fc7d0 msgr2=0x7f37dc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:48.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.713+0000 7f37e09fc640 1 -- 172.21.15.19:0/558006978 shutdown_connections 2024-09-19T08:56:48.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.713+0000 7f37e09fc640 1 -- 172.21.15.19:0/558006978 wait complete. 2024-09-19T08:56:48.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.714+0000 7f37e09fc640 1 Processor -- start 2024-09-19T08:56:48.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.714+0000 7f37e09fc640 1 -- start start 2024-09-19T08:56:48.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.714+0000 7f37e09fc640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f37dc102d30 0x7f37dc1a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:48.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.714+0000 7f37e09fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37dc1036e0 0x7f37dc1a0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:48.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.714+0000 7f37e09fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37dc1082a0 0x7f37dc19a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:48.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.714+0000 7f37e09fc640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc112090 con 0x7f37dc1082a0 2024-09-19T08:56:48.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.714+0000 7f37e09fc640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc111f10 con 0x7f37dc1036e0 2024-09-19T08:56:48.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.714+0000 7f37e09fc640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc112210 con 0x7f37dc102d30 2024-09-19T08:56:48.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.714+0000 7f37d3fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37dc1036e0 0x7f37dc1a0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:48.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.714+0000 7f37dad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37dc1082a0 0x7f37dc19a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:48.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.714+0000 7f37dad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37dc1082a0 0x7f37dc19a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47060/0 (socket says 172.21.15.19:47060) 2024-09-19T08:56:48.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.714+0000 7f37d3fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37dc1036e0 0x7f37dc1a0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:39516/0 (socket says 172.21.15.19:39516) 2024-09-19T08:56:48.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.714+0000 7f37dad9d640 1 -- 172.21.15.19:0/4005346667 learned_addr learned my addr 172.21.15.19:0/4005346667 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:48.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.714+0000 7f37da59c640 1 --2- 172.21.15.19:0/4005346667 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f37dc102d30 0x7f37dc1a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:48.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.714+0000 7f37dad9d640 1 -- 172.21.15.19:0/4005346667 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f37dc102d30 msgr2=0x7f37dc1a0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:48.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.714+0000 7f37dad9d640 1 --2- 172.21.15.19:0/4005346667 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f37dc102d30 0x7f37dc1a0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:48.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.714+0000 7f37dad9d640 1 -- 172.21.15.19:0/4005346667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37dc1036e0 msgr2=0x7f37dc1a0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:48.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.714+0000 7f37dad9d640 1 --2- 172.21.15.19:0/4005346667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37dc1036e0 0x7f37dc1a0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:48.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.715+0000 7f37dad9d640 1 -- 172.21.15.19:0/4005346667 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37dc19ad10 con 0x7f37dc1082a0 2024-09-19T08:56:48.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.715+0000 7f37dad9d640 1 --2- 172.21.15.19:0/4005346667 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37dc1082a0 0x7f37dc19a5e0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f37d400eb10 tx=0x7f37d400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:48.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.715+0000 7f37d37fe640 1 -- 172.21.15.19:0/4005346667 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d4004b20 con 0x7f37dc1082a0 2024-09-19T08:56:48.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.715+0000 7f37d37fe640 1 -- 172.21.15.19:0/4005346667 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37d4004cc0 con 0x7f37dc1082a0 2024-09-19T08:56:48.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.715+0000 7f37e09fc640 1 -- 172.21.15.19:0/4005346667 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37dc19b000 con 0x7f37dc1082a0 2024-09-19T08:56:48.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.715+0000 7f37d37fe640 1 -- 172.21.15.19:0/4005346667 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d4010760 con 0x7f37dc1082a0 2024-09-19T08:56:48.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.715+0000 7f37e09fc640 1 -- 172.21.15.19:0/4005346667 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37dc1a72f0 con 0x7f37dc1082a0 2024-09-19T08:56:48.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.718+0000 7f37d37fe640 1 -- 172.21.15.19:0/4005346667 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f37d4005020 con 0x7f37dc1082a0 2024-09-19T08:56:48.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.718+0000 7f37e2dd5740 1 Processor -- start 2024-09-19T08:56:48.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.718+0000 7f37e2dd5740 1 -- start start 2024-09-19T08:56:48.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.718+0000 7f37e2dd5740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56302c669b40 0x56302c668090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:48.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.718+0000 7f37d37fe640 1 --2- 172.21.15.19:0/4005346667 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f37c80a32c0 0x7f37c80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:48.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.718+0000 7f37e2dd5740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56302c6685d0 0x56302c668a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:48.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.719+0000 7f37e2dd5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56302c673370 0x56302c675760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:48.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.719+0000 7f37e2dd5740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56302c5ce2f0 con 0x56302c6685d0 2024-09-19T08:56:48.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.719+0000 7f37e2dd5740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56302c575cf0 con 0x56302c669b40 2024-09-19T08:56:48.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.719+0000 7f37e2dd5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56302c5ca2b0 con 0x56302c673370 2024-09-19T08:56:48.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.719+0000 7f37da59c640 1 --2- 172.21.15.19:0/4005346667 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f37c80a32c0 0x7f37c80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:48.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.719+0000 7f37d3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56302c6685d0 0x56302c668a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:48.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.719+0000 7f37d37fe640 1 -- 172.21.15.19:0/4005346667 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f37d40cfea0 con 0x7f37dc1082a0 2024-09-19T08:56:48.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.719+0000 7f37dad9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56302c673370 0x56302c675760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:48.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.719+0000 7f37dad9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56302c673370 0x56302c675760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:55048/0 (socket says 172.21.15.19:55048) 2024-09-19T08:56:48.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.719+0000 7f37d3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56302c6685d0 0x56302c668a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47062/0 (socket says 172.21.15.19:47062) 2024-09-19T08:56:48.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.719+0000 7f37dad9d640 1 -- 172.21.15.19:0/2021100730 learned_addr learned my addr 172.21.15.19:0/2021100730 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:48.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.719+0000 7f37d3fff640 1 --2- 172.21.15.19:0/2021100730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56302c669b40 0x56302c668090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:48.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.719+0000 7f37da59c640 1 --2- 172.21.15.19:0/4005346667 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f37c80a32c0 0x7f37c80a5780 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f37cc005fd0 tx=0x7f37cc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:48.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.719+0000 7f37dad9d640 1 -- 172.21.15.19:0/2021100730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56302c669b40 msgr2=0x56302c668090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:48.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.719+0000 7f37dad9d640 1 --2- 172.21.15.19:0/2021100730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56302c669b40 0x56302c668090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:48.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.719+0000 7f37dad9d640 1 -- 172.21.15.19:0/2021100730 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56302c6685d0 msgr2=0x56302c668a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:48.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.719+0000 7f37dad9d640 1 --2- 172.21.15.19:0/2021100730 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56302c6685d0 0x56302c668a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:48.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.719+0000 7f37dad9d640 1 -- 172.21.15.19:0/2021100730 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56302c55a3a0 con 0x56302c673370 2024-09-19T08:56:48.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.720+0000 7f37dad9d640 1 --2- 172.21.15.19:0/2021100730 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56302c673370 0x56302c675760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f37d40a4bb0 tx=0x7f37d40987d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=849e69b9e5e6cfb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:48.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.720+0000 7f37d0ff9640 1 -- 172.21.15.19:0/2021100730 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d407ff60 con 0x56302c673370 2024-09-19T08:56:48.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.720+0000 7f37d0ff9640 1 -- 172.21.15.19:0/2021100730 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37d409cb70 con 0x56302c673370 2024-09-19T08:56:48.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.720+0000 7f37d0ff9640 1 -- 172.21.15.19:0/2021100730 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d4098ae0 con 0x56302c673370 2024-09-19T08:56:48.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.721+0000 7f37e2dd5740 1 -- 172.21.15.19:0/2021100730 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56302c673370 msgr2=0x56302c675760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:48.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.721+0000 7f37e2dd5740 1 --2- 172.21.15.19:0/2021100730 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56302c673370 0x56302c675760 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f37d40a4bb0 tx=0x7f37d40987d0 comp rx=0 tx=0).stop 2024-09-19T08:56:48.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.721+0000 7f37e2dd5740 1 -- 172.21.15.19:0/2021100730 shutdown_connections 2024-09-19T08:56:48.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.721+0000 7f37e2dd5740 1 --2- 172.21.15.19:0/2021100730 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56302c673370 0x56302c675760 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:48.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.721+0000 7f37e2dd5740 1 --2- 172.21.15.19:0/2021100730 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56302c6685d0 0x56302c668a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:48.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.721+0000 7f37e2dd5740 1 --2- 172.21.15.19:0/2021100730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56302c669b40 0x56302c668090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:48.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.721+0000 7f37e2dd5740 1 -- 172.21.15.19:0/2021100730 >> 172.21.15.19:0/2021100730 conn(0x56302c631310 msgr2=0x56302c664c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:48.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.721+0000 7f37e2dd5740 1 -- 172.21.15.19:0/2021100730 shutdown_connections 2024-09-19T08:56:48.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.721+0000 7f37e2dd5740 1 -- 172.21.15.19:0/2021100730 wait complete. 2024-09-19T08:56:48.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.721+0000 7f37e2dd5740 1 -- start start 2024-09-19T08:56:48.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.721+0000 7f37e2dd5740 1 Processor -- start 2024-09-19T08:56:48.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.722+0000 7f37e2dd5740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56302c6685d0 0x56302c672ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:48.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.722+0000 7f37e2dd5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56302c669b40 0x56302c66ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:48.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.722+0000 7f37e2dd5740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56302c673370 0x56302c6704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:48.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.722+0000 7f37e2dd5740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56302c676070 con 0x56302c6685d0 2024-09-19T08:56:48.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.722+0000 7f37e2dd5740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56302c589060 con 0x56302c673370 2024-09-19T08:56:48.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.722+0000 7f37e2dd5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56302c6761f0 con 0x56302c669b40 2024-09-19T08:56:48.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.722+0000 7f37e2dd5740 10 client.0 _ll_register_callbacks cb 0x56302c2dc8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:48.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.722+0000 7f37da59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56302c6685d0 0x56302c672ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:48.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.722+0000 7f37da59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56302c6685d0 0x56302c672ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47076/0 (socket says 172.21.15.19:47076) 2024-09-19T08:56:48.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.722+0000 7f37da59c640 1 -- 172.21.15.19:0/2128219868 learned_addr learned my addr 172.21.15.19:0/2128219868 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:48.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.722+0000 7f37d3fff640 1 --2- 172.21.15.19:0/2128219868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56302c669b40 0x56302c66ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:48.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.722+0000 7f37dad9d640 1 --2- 172.21.15.19:0/2128219868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56302c673370 0x56302c6704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:48.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.722+0000 7f37da59c640 1 -- 172.21.15.19:0/2128219868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56302c669b40 msgr2=0x56302c66ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:48.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.722+0000 7f37da59c640 1 --2- 172.21.15.19:0/2128219868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56302c669b40 0x56302c66ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:48.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.722+0000 7f37da59c640 1 -- 172.21.15.19:0/2128219868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56302c673370 msgr2=0x56302c6704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:48.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.722+0000 7f37da59c640 1 --2- 172.21.15.19:0/2128219868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56302c673370 0x56302c6704f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:48.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.722+0000 7f37da59c640 1 -- 172.21.15.19:0/2128219868 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56302c33f3c0 con 0x56302c6685d0 2024-09-19T08:56:48.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.722+0000 7f37d3fff640 1 --2- 172.21.15.19:0/2128219868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56302c669b40 0x56302c66ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:48.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.722+0000 7f37da59c640 1 --2- 172.21.15.19:0/2128219868 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56302c6685d0 0x56302c672ce0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f37cc011440 tx=0x7f37cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf2e4491f0a67ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:48.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.722+0000 7f37c1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:56:48.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.722+0000 7f37c1ffb640 1 -- 172.21.15.19:0/2128219868 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc022070 con 0x56302c6685d0 2024-09-19T08:56:48.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.723+0000 7f37c1ffb640 1 -- 172.21.15.19:0/2128219868 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f37cc01e860 con 0x56302c6685d0 2024-09-19T08:56:48.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.723+0000 7f37e2dd5740 1 -- 172.21.15.19:0/2128219868 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37d409cb70 con 0x56302c6685d0 2024-09-19T08:56:48.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.723+0000 7f37c1ffb640 1 -- 172.21.15.19:0/2128219868 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f37cc02e050 con 0x56302c6685d0 2024-09-19T08:56:48.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.723+0000 7f37e2dd5740 10 client.16413 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:48.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.723+0000 7f37e2dd5740 1 -- 172.21.15.19:0/2128219868 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56302c681ae0 con 0x56302c6685d0 2024-09-19T08:56:48.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.723+0000 7f37c1ffb640 1 -- 172.21.15.19:0/2128219868 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37d409cb70 con 0x56302c6685d0 2024-09-19T08:56:48.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.723+0000 7f37c1ffb640 1 -- 172.21.15.19:0/2128219868 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f37cc010c40 con 0x56302c6685d0 2024-09-19T08:56:48.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.723+0000 7f37e2dd5740 10 client.16413 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:48.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.723+0000 7f37e2dd5740 10 client.16413 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T08:56:48.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.723+0000 7f37e2dd5740 20 client.16413 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:48.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.723+0000 7f37e2dd5740 1 --2- 172.21.15.19:0/2128219868 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x56302c682ef0 0x56302c685320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:48.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.723+0000 7f37e2dd5740 4 client.16413 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:56:48.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.723+0000 7f37e2dd5740 1 -- 172.21.15.19:0/2128219868 --> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56302c5db860 con 0x56302c682ef0 2024-09-19T08:56:48.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.724+0000 7f37d3fff640 1 --2- 172.21.15.19:0/2128219868 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x56302c682ef0 0x56302c685320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:48.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.724+0000 7f37c1ffb640 10 client.16413 ms_handle_connect on v2:172.21.15.203:6834/2702758353 2024-09-19T08:56:48.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.724+0000 7f37d3fff640 1 --2- 172.21.15.19:0/2128219868 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x56302c682ef0 0x56302c685320 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=446dff8911904564 server_cookie=ef036d4a57ee7e57 in_seq=0 out_seq=0 2024-09-19T08:56:48.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.725+0000 7f37c1ffb640 1 -- 172.21.15.19:0/2128219868 <== mds.4 v2:172.21.15.203:6834/2702758353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56302c5db860 con 0x56302c682ef0 2024-09-19T08:56:48.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.725+0000 7f37c1ffb640 10 client.16413 handle_command_reply: tid=0 2024-09-19T08:56:48.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.725+0000 7f37e2dd5740 1 client.16413 shutdown 2024-09-19T08:56:48.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.725+0000 7f37e2dd5740 1 -- 172.21.15.19:0/2128219868 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56302c6685d0 msgr2=0x56302c672ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:48.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.725+0000 7f37e2dd5740 1 --2- 172.21.15.19:0/2128219868 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56302c6685d0 0x56302c672ce0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f37cc011440 tx=0x7f37cc0046c0 comp rx=0 tx=0).stop 2024-09-19T08:56:48.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.725+0000 7f37e2dd5740 1 -- 172.21.15.19:0/2128219868 shutdown_connections 2024-09-19T08:56:48.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.725+0000 7f37e2dd5740 1 --2- 172.21.15.19:0/2128219868 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x56302c682ef0 0x56302c685320 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:48.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.725+0000 7f37e2dd5740 1 --2- 172.21.15.19:0/2128219868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56302c669b40 0x56302c66ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:48.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.725+0000 7f37e2dd5740 1 --2- 172.21.15.19:0/2128219868 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56302c673370 0x56302c6704f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:48.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.725+0000 7f37e2dd5740 1 --2- 172.21.15.19:0/2128219868 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56302c6685d0 0x56302c672ce0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:48.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.725+0000 7f37e2dd5740 1 -- 172.21.15.19:0/2128219868 >> 172.21.15.19:0/2128219868 conn(0x56302c631310 msgr2=0x56302c66a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:48.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.725+0000 7f37c1ffb640 0 client.16413 ms_handle_reset on v2:172.21.15.203:6834/2702758353 2024-09-19T08:56:48.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.725+0000 7f37e2dd5740 1 -- 172.21.15.19:0/2128219868 shutdown_connections 2024-09-19T08:56:48.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.726+0000 7f37e2dd5740 1 -- 172.21.15.19:0/2128219868 wait complete. 2024-09-19T08:56:48.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.726+0000 7f37e2dd5740 20 client.16413 trim_cache size 0 max 16384 2024-09-19T08:56:48.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.740+0000 7f37e2dd5740 1 Processor -- start 2024-09-19T08:56:48.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.740+0000 7f37e2dd5740 1 -- start start 2024-09-19T08:56:48.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.741+0000 7f37e2dd5740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56302c6685d0 0x56302c67f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:48.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.741+0000 7f37e2dd5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56302c669b40 0x56302c671f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:48.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.741+0000 7f37e2dd5740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56302c673370 0x56302c672440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:48.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.741+0000 7f37e2dd5740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc1af740 con 0x56302c6685d0 2024-09-19T08:56:48.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.741+0000 7f37e2dd5740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc1b12b0 con 0x56302c673370 2024-09-19T08:56:48.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.741+0000 7f37e2dd5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc1afe10 con 0x56302c669b40 2024-09-19T08:56:48.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.741+0000 7f37da59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56302c6685d0 0x56302c67f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:48.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.741+0000 7f37dad9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56302c673370 0x56302c672440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:48.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.741+0000 7f37dad9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56302c673370 0x56302c672440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:39542/0 (socket says 172.21.15.19:39542) 2024-09-19T08:56:48.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.741+0000 7f37dad9d640 1 -- 172.21.15.19:0/1707668524 learned_addr learned my addr 172.21.15.19:0/1707668524 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:48.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.741+0000 7f37d3fff640 1 --2- 172.21.15.19:0/1707668524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56302c669b40 0x56302c671f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:48.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.741+0000 7f37da59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56302c6685d0 0x56302c67f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47082/0 (socket says 172.21.15.19:47082) 2024-09-19T08:56:48.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.741+0000 7f37dad9d640 1 -- 172.21.15.19:0/1707668524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56302c669b40 msgr2=0x56302c671f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:48.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.741+0000 7f37dad9d640 1 --2- 172.21.15.19:0/1707668524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56302c669b40 0x56302c671f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:48.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.741+0000 7f37dad9d640 1 -- 172.21.15.19:0/1707668524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56302c6685d0 msgr2=0x56302c67f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:48.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.741+0000 7f37dad9d640 1 --2- 172.21.15.19:0/1707668524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56302c6685d0 0x56302c67f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:48.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.741+0000 7f37dad9d640 1 -- 172.21.15.19:0/1707668524 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56302c670860 con 0x56302c673370 2024-09-19T08:56:48.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.741+0000 7f37da59c640 1 --2- 172.21.15.19:0/1707668524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56302c6685d0 0x56302c67f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:48.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.741+0000 7f37d3fff640 1 --2- 172.21.15.19:0/1707668524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56302c669b40 0x56302c671f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:48.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.741+0000 7f37dad9d640 1 --2- 172.21.15.19:0/1707668524 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56302c673370 0x56302c672440 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f37d4098e40 tx=0x7f37d4098840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=415cc434dd38de51 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:48.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.742+0000 7f37c3fff640 1 -- 172.21.15.19:0/1707668524 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d408a030 con 0x56302c673370 2024-09-19T08:56:48.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.742+0000 7f37c3fff640 1 -- 172.21.15.19:0/1707668524 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37d40a0820 con 0x56302c673370 2024-09-19T08:56:48.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.742+0000 7f37c3fff640 1 -- 172.21.15.19:0/1707668524 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d40a4c50 con 0x56302c673370 2024-09-19T08:56:48.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.742+0000 7f37e2dd5740 1 -- 172.21.15.19:0/1707668524 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56302c673370 msgr2=0x56302c672440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:48.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.742+0000 7f37e2dd5740 1 --2- 172.21.15.19:0/1707668524 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56302c673370 0x56302c672440 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f37d4098e40 tx=0x7f37d4098840 comp rx=0 tx=0).stop 2024-09-19T08:56:48.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.743+0000 7f37e2dd5740 1 -- 172.21.15.19:0/1707668524 shutdown_connections 2024-09-19T08:56:48.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.743+0000 7f37e2dd5740 1 --2- 172.21.15.19:0/1707668524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56302c669b40 0x56302c671f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:48.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.743+0000 7f37e2dd5740 1 --2- 172.21.15.19:0/1707668524 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56302c673370 0x56302c672440 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:48.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.743+0000 7f37e2dd5740 1 --2- 172.21.15.19:0/1707668524 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56302c6685d0 0x56302c67f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:48.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.743+0000 7f37e2dd5740 1 -- 172.21.15.19:0/1707668524 >> 172.21.15.19:0/1707668524 conn(0x56302c631310 msgr2=0x56302c6717f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:48.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.743+0000 7f37e2dd5740 1 -- 172.21.15.19:0/1707668524 shutdown_connections 2024-09-19T08:56:48.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.743+0000 7f37e2dd5740 1 -- 172.21.15.19:0/1707668524 wait complete. 2024-09-19T08:56:48.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.743+0000 7f37e2dd5740 1 -- start start 2024-09-19T08:56:48.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.743+0000 7f37e2dd5740 1 Processor -- start 2024-09-19T08:56:48.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.743+0000 7f37e2dd5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56302c6685d0 0x56302c66d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:48.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.743+0000 7f37e2dd5740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56302c669b40 0x56302c66d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:48.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.743+0000 7f37e2dd5740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56302c673370 0x56302c66dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:48.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.743+0000 7f37e2dd5740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc1b0be0 con 0x56302c673370 2024-09-19T08:56:48.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.743+0000 7f37e2dd5740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc1b0510 con 0x56302c669b40 2024-09-19T08:56:48.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.743+0000 7f37e2dd5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc1ad720 con 0x56302c6685d0 2024-09-19T08:56:48.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.743+0000 7f37e2dd5740 10 client.0 _ll_register_callbacks cb 0x7f37cc00fcd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:48.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.744+0000 7f37dad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56302c673370 0x56302c66dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:48.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.744+0000 7f37dad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56302c673370 0x56302c66dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47086/0 (socket says 172.21.15.19:47086) 2024-09-19T08:56:48.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.744+0000 7f37dad9d640 1 -- 172.21.15.19:0/2078073303 learned_addr learned my addr 172.21.15.19:0/2078073303 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:48.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.744+0000 7f37d3fff640 1 --2- 172.21.15.19:0/2078073303 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56302c669b40 0x56302c66d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:48.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.744+0000 7f37da59c640 1 --2- 172.21.15.19:0/2078073303 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56302c6685d0 0x56302c66d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:48.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.744+0000 7f37dad9d640 1 -- 172.21.15.19:0/2078073303 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56302c6685d0 msgr2=0x56302c66d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:48.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.744+0000 7f37dad9d640 1 --2- 172.21.15.19:0/2078073303 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56302c6685d0 0x56302c66d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:48.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.744+0000 7f37dad9d640 1 -- 172.21.15.19:0/2078073303 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56302c669b40 msgr2=0x56302c66d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:48.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.744+0000 7f37dad9d640 1 --2- 172.21.15.19:0/2078073303 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56302c669b40 0x56302c66d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:48.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.744+0000 7f37dad9d640 1 -- 172.21.15.19:0/2078073303 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56302c6eceb0 con 0x56302c673370 2024-09-19T08:56:48.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.744+0000 7f37dad9d640 1 --2- 172.21.15.19:0/2078073303 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56302c673370 0x56302c66dc10 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f37d409c170 tx=0x7f37d400cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed267e8a3fe4f748 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:48.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.744+0000 7f37c1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:56:48.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.744+0000 7f37c1ffb640 1 -- 172.21.15.19:0/2078073303 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d408a040 con 0x56302c673370 2024-09-19T08:56:48.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.744+0000 7f37c1ffb640 1 -- 172.21.15.19:0/2078073303 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f37d40a4c50 con 0x56302c673370 2024-09-19T08:56:48.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.744+0000 7f37e2dd5740 1 -- 172.21.15.19:0/2078073303 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37d40a0820 con 0x56302c673370 2024-09-19T08:56:48.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.744+0000 7f37c1ffb640 1 -- 172.21.15.19:0/2078073303 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f37d40b5460 con 0x56302c673370 2024-09-19T08:56:48.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.744+0000 7f37e2dd5740 10 client.16419 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:48.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.744+0000 7f37e2dd5740 1 -- 172.21.15.19:0/2078073303 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56302c6ee0f0 con 0x56302c673370 2024-09-19T08:56:48.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.745+0000 7f37c1ffb640 1 -- 172.21.15.19:0/2078073303 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37d40a0820 con 0x56302c673370 2024-09-19T08:56:48.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.745+0000 7f37c1ffb640 1 -- 172.21.15.19:0/2078073303 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f37d4005310 con 0x56302c673370 2024-09-19T08:56:48.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.745+0000 7f37e2dd5740 10 client.16419 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:48.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.745+0000 7f37e2dd5740 10 client.16419 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T08:56:48.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.745+0000 7f37e2dd5740 20 client.16419 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:48.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.745+0000 7f37e2dd5740 1 --2- 172.21.15.19:0/2078073303 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x56302c6ee310 0x56302c6f0700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:48.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.745+0000 7f37e2dd5740 4 client.16419 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:56:48.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.745+0000 7f37e2dd5740 1 -- 172.21.15.19:0/2078073303 --> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56302c5d5d70 con 0x56302c6ee310 2024-09-19T08:56:48.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.745+0000 7f37da59c640 1 --2- 172.21.15.19:0/2078073303 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x56302c6ee310 0x56302c6f0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:48.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.746+0000 7f37c1ffb640 10 client.16419 ms_handle_connect on v2:172.21.15.203:6834/2702758353 2024-09-19T08:56:48.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.746+0000 7f37da59c640 1 --2- 172.21.15.19:0/2078073303 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x56302c6ee310 0x56302c6f0700 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c02bb385e9855ce server_cookie=22f4756d32ca9c in_seq=0 out_seq=0 2024-09-19T08:56:48.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.746+0000 7f37c1ffb640 1 -- 172.21.15.19:0/2078073303 <== mds.4 v2:172.21.15.203:6834/2702758353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56302c5d5d70 con 0x56302c6ee310 2024-09-19T08:56:48.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.746+0000 7f37c1ffb640 10 client.16419 handle_command_reply: tid=0 2024-09-19T08:56:48.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.746+0000 7f37e2dd5740 1 client.16419 shutdown 2024-09-19T08:56:48.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.746+0000 7f37e2dd5740 1 -- 172.21.15.19:0/2078073303 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56302c673370 msgr2=0x56302c66dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:48.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.746+0000 7f37e2dd5740 1 --2- 172.21.15.19:0/2078073303 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56302c673370 0x56302c66dc10 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f37d409c170 tx=0x7f37d400cf70 comp rx=0 tx=0).stop 2024-09-19T08:56:48.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.746+0000 7f37e2dd5740 1 -- 172.21.15.19:0/2078073303 shutdown_connections 2024-09-19T08:56:48.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.746+0000 7f37e2dd5740 1 --2- 172.21.15.19:0/2078073303 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x56302c6ee310 0x56302c6f0700 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:48.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.746+0000 7f37e2dd5740 1 --2- 172.21.15.19:0/2078073303 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56302c673370 0x56302c66dc10 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:48.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.746+0000 7f37e2dd5740 1 --2- 172.21.15.19:0/2078073303 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56302c669b40 0x56302c66d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:48.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.746+0000 7f37c1ffb640 0 client.16419 ms_handle_reset on v2:172.21.15.203:6834/2702758353 2024-09-19T08:56:48.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.746+0000 7f37e2dd5740 1 --2- 172.21.15.19:0/2078073303 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56302c6685d0 0x56302c66d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:48.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.746+0000 7f37e2dd5740 1 -- 172.21.15.19:0/2078073303 >> 172.21.15.19:0/2078073303 conn(0x56302c631310 msgr2=0x56302c672010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:48.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.746+0000 7f37e2dd5740 1 -- 172.21.15.19:0/2078073303 shutdown_connections 2024-09-19T08:56:48.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.746+0000 7f37e2dd5740 1 -- 172.21.15.19:0/2078073303 wait complete. 2024-09-19T08:56:48.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.746+0000 7f37e2dd5740 20 client.16419 trim_cache size 0 max 16384 2024-09-19T08:56:48.752 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T08:56:48.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.747+0000 7f37e09fc640 1 -- 172.21.15.19:0/4005346667 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f37c80a32c0 msgr2=0x7f37c80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:48.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.747+0000 7f37e09fc640 1 --2- 172.21.15.19:0/4005346667 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f37c80a32c0 0x7f37c80a5780 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f37cc005fd0 tx=0x7f37cc005850 comp rx=0 tx=0).stop 2024-09-19T08:56:48.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.747+0000 7f37e09fc640 1 -- 172.21.15.19:0/4005346667 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37dc1082a0 msgr2=0x7f37dc19a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:48.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.747+0000 7f37e09fc640 1 --2- 172.21.15.19:0/4005346667 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37dc1082a0 0x7f37dc19a5e0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f37d400eb10 tx=0x7f37d400c2d0 comp rx=0 tx=0).stop 2024-09-19T08:56:48.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.747+0000 7f37e09fc640 1 -- 172.21.15.19:0/4005346667 shutdown_connections 2024-09-19T08:56:48.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.747+0000 7f37e09fc640 1 --2- 172.21.15.19:0/4005346667 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f37c80a32c0 0x7f37c80a5780 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:48.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.747+0000 7f37e09fc640 1 --2- 172.21.15.19:0/4005346667 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f37dc1082a0 0x7f37dc19a5e0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:48.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.747+0000 7f37e09fc640 1 --2- 172.21.15.19:0/4005346667 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f37dc1036e0 0x7f37dc1a0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:48.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.747+0000 7f37e09fc640 1 --2- 172.21.15.19:0/4005346667 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f37dc102d30 0x7f37dc1a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:48.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.747+0000 7f37e09fc640 1 -- 172.21.15.19:0/4005346667 >> 172.21.15.19:0/4005346667 conn(0x7f37dc0fc7d0 msgr2=0x7f37dc100d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:48.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.747+0000 7f37e09fc640 1 -- 172.21.15.19:0/4005346667 shutdown_connections 2024-09-19T08:56:48.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:48.747+0000 7f37e09fc640 1 -- 172.21.15.19:0/4005346667 wait complete. 2024-09-19T08:56:49.655 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:49 smithi019 ceph-mon[30976]: pgmap v475: 97 pgs: 97 active+clean; 21 MiB data, 540 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 1.15k op/s 2024-09-19T08:56:49.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:49 smithi155 ceph-mon[34921]: pgmap v475: 97 pgs: 97 active+clean; 21 MiB data, 540 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 1.15k op/s 2024-09-19T08:56:49.688 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T08:56:49.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:49 smithi203 ceph-mon[35450]: pgmap v475: 97 pgs: 97 active+clean; 21 MiB data, 540 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.2 MiB/s wr, 1.15k op/s 2024-09-19T08:56:49.886 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.885+0000 7fca94dcf640 1 -- 172.21.15.19:0/1418795757 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca90100a50 msgr2=0x7fca90100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:49.886 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.885+0000 7fca94dcf640 1 --2- 172.21.15.19:0/1418795757 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca90100a50 0x7fca90100e50 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fca80009900 tx=0x7fca8002a410 comp rx=0 tx=0).stop 2024-09-19T08:56:49.886 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.886+0000 7fca94dcf640 1 -- 172.21.15.19:0/1418795757 shutdown_connections 2024-09-19T08:56:49.886 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.886+0000 7fca94dcf640 1 --2- 172.21.15.19:0/1418795757 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca90101c40 0x7fca901020c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:49.886 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.886+0000 7fca94dcf640 1 --2- 172.21.15.19:0/1418795757 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca90102600 0x7fca90108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:49.887 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.886+0000 7fca94dcf640 1 --2- 172.21.15.19:0/1418795757 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca90100a50 0x7fca90100e50 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:49.887 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.886+0000 7fca94dcf640 1 -- 172.21.15.19:0/1418795757 >> 172.21.15.19:0/1418795757 conn(0x7fca900fc1b0 msgr2=0x7fca900fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:49.887 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.886+0000 7fca94dcf640 1 -- 172.21.15.19:0/1418795757 shutdown_connections 2024-09-19T08:56:49.887 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.886+0000 7fca94dcf640 1 -- 172.21.15.19:0/1418795757 wait complete. 2024-09-19T08:56:49.889 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.887+0000 7fca94dcf640 1 Processor -- start 2024-09-19T08:56:49.889 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.887+0000 7fca94dcf640 1 -- start start 2024-09-19T08:56:49.889 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.887+0000 7fca94dcf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca90100a50 0x7fca9006ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:49.889 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.887+0000 7fca94dcf640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca90101c40 0x7fca9019cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:49.889 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.887+0000 7fca94dcf640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca90102600 0x7fca9019f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.887+0000 7fca94dcf640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fca9010c6b0 con 0x7fca90100a50 2024-09-19T08:56:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.887+0000 7fca94dcf640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fca9010c530 con 0x7fca90101c40 2024-09-19T08:56:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.887+0000 7fca94dcf640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fca9010c830 con 0x7fca90102600 2024-09-19T08:56:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.887+0000 7fca8e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca90100a50 0x7fca9006ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.887+0000 7fca8dd9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca90101c40 0x7fca9019cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.887+0000 7fca8e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca90100a50 0x7fca9006ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47110/0 (socket says 172.21.15.19:47110) 2024-09-19T08:56:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.887+0000 7fca8e59c640 1 -- 172.21.15.19:0/3405308689 learned_addr learned my addr 172.21.15.19:0/3405308689 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.887+0000 7fca8ed9d640 1 --2- 172.21.15.19:0/3405308689 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca90102600 0x7fca9019f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.887+0000 7fca8dd9b640 1 -- 172.21.15.19:0/3405308689 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca90102600 msgr2=0x7fca9019f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.887+0000 7fca8dd9b640 1 --2- 172.21.15.19:0/3405308689 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca90102600 0x7fca9019f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.888+0000 7fca8dd9b640 1 -- 172.21.15.19:0/3405308689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca90100a50 msgr2=0x7fca9006ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.888+0000 7fca8dd9b640 1 --2- 172.21.15.19:0/3405308689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca90100a50 0x7fca9006ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.888+0000 7fca8dd9b640 1 -- 172.21.15.19:0/3405308689 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca9019fab0 con 0x7fca90101c40 2024-09-19T08:56:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.888+0000 7fca8e59c640 1 --2- 172.21.15.19:0/3405308689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca90100a50 0x7fca9006ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.888+0000 7fca8dd9b640 1 --2- 172.21.15.19:0/3405308689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca90101c40 0x7fca9019cb80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fca84005fd0 tx=0x7fca8400dd20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.888+0000 7fca7f7fe640 1 -- 172.21.15.19:0/3405308689 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca84009c30 con 0x7fca90101c40 2024-09-19T08:56:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.888+0000 7fca7f7fe640 1 -- 172.21.15.19:0/3405308689 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca8400be30 con 0x7fca90101c40 2024-09-19T08:56:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.888+0000 7fca94dcf640 1 -- 172.21.15.19:0/3405308689 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca901969b0 con 0x7fca90101c40 2024-09-19T08:56:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.888+0000 7fca7f7fe640 1 -- 172.21.15.19:0/3405308689 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca84003e20 con 0x7fca90101c40 2024-09-19T08:56:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.888+0000 7fca94dcf640 1 -- 172.21.15.19:0/3405308689 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca90196f00 con 0x7fca90101c40 2024-09-19T08:56:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.891+0000 7fca97c47740 1 Processor -- start 2024-09-19T08:56:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.892+0000 7fca97c47740 1 -- start start 2024-09-19T08:56:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.892+0000 7fca97c47740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56325b0399a0 0x56325b039da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.892+0000 7fca97c47740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56325b03a2e0 0x56325b03eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.892+0000 7fca97c47740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56325b03f370 0x56325b041830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.892+0000 7fca97c47740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56325af9d2f0 con 0x56325b03a2e0 2024-09-19T08:56:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.892+0000 7fca97c47740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56325af45270 con 0x56325b0399a0 2024-09-19T08:56:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.892+0000 7fca97c47740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56325af992b0 con 0x56325b03f370 2024-09-19T08:56:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.892+0000 7fca7f7fe640 1 -- 172.21.15.19:0/3405308689 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fca84003fc0 con 0x7fca90101c40 2024-09-19T08:56:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.892+0000 7fca8e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56325b03a2e0 0x56325b03eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.892+0000 7fca8ed9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56325b0399a0 0x56325b039da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.892+0000 7fca8ed9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56325b0399a0 0x56325b039da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:39576/0 (socket says 172.21.15.19:39576) 2024-09-19T08:56:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.892+0000 7fca8e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56325b03a2e0 0x56325b03eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47114/0 (socket says 172.21.15.19:47114) 2024-09-19T08:56:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.893+0000 7fca8ed9d640 1 -- 172.21.15.19:0/3197427206 learned_addr learned my addr 172.21.15.19:0/3197427206 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.893+0000 7fca8dd9b640 1 --2- 172.21.15.19:0/3197427206 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56325b03f370 0x56325b041830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.893+0000 7fca8ed9d640 1 -- 172.21.15.19:0/3197427206 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56325b03f370 msgr2=0x56325b041830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.893+0000 7fca8ed9d640 1 --2- 172.21.15.19:0/3197427206 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56325b03f370 0x56325b041830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.893+0000 7fca8ed9d640 1 -- 172.21.15.19:0/3197427206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56325b03a2e0 msgr2=0x56325b03eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.893+0000 7fca8ed9d640 1 --2- 172.21.15.19:0/3197427206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56325b03a2e0 0x56325b03eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.893+0000 7fca8ed9d640 1 -- 172.21.15.19:0/3197427206 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56325af44340 con 0x56325b0399a0 2024-09-19T08:56:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.893+0000 7fca8ed9d640 1 --2- 172.21.15.19:0/3197427206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56325b0399a0 0x56325b039da0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fca88009f60 tx=0x7fca88009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=916d0513531ed2da server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:49.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.893+0000 7fca7cff9640 1 -- 172.21.15.19:0/3197427206 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8801e070 con 0x56325b0399a0 2024-09-19T08:56:49.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.893+0000 7fca7cff9640 1 -- 172.21.15.19:0/3197427206 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca88004030 con 0x56325b0399a0 2024-09-19T08:56:49.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.893+0000 7fca7cff9640 1 -- 172.21.15.19:0/3197427206 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8800f720 con 0x56325b0399a0 2024-09-19T08:56:49.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.894+0000 7fca7f7fe640 1 --2- 172.21.15.19:0/3405308689 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fca780a32f0 0x7fca780a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:49.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.894+0000 7fca7f7fe640 1 -- 172.21.15.19:0/3405308689 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fca840cf3f0 con 0x7fca90101c40 2024-09-19T08:56:49.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.894+0000 7fca8e59c640 1 --2- 172.21.15.19:0/3405308689 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fca780a32f0 0x7fca780a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:49.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.894+0000 7fca97c47740 1 -- 172.21.15.19:0/3197427206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56325b0399a0 msgr2=0x56325b039da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:49.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.894+0000 7fca97c47740 1 --2- 172.21.15.19:0/3197427206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56325b0399a0 0x56325b039da0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fca88009f60 tx=0x7fca88009f90 comp rx=0 tx=0).stop 2024-09-19T08:56:49.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.895+0000 7fca8e59c640 1 --2- 172.21.15.19:0/3405308689 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fca780a32f0 0x7fca780a57b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fca80000c00 tx=0x7fca800046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:49.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.895+0000 7fca97c47740 1 -- 172.21.15.19:0/3197427206 shutdown_connections 2024-09-19T08:56:49.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.895+0000 7fca97c47740 1 --2- 172.21.15.19:0/3197427206 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56325b03f370 0x56325b041830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:49.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.895+0000 7fca97c47740 1 --2- 172.21.15.19:0/3197427206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56325b03a2e0 0x56325b03eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:49.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.895+0000 7fca97c47740 1 --2- 172.21.15.19:0/3197427206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56325b0399a0 0x56325b039da0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:49.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.895+0000 7fca97c47740 1 -- 172.21.15.19:0/3197427206 >> 172.21.15.19:0/3197427206 conn(0x56325b035010 msgr2=0x56325b035410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:49.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.895+0000 7fca97c47740 1 -- 172.21.15.19:0/3197427206 shutdown_connections 2024-09-19T08:56:49.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.895+0000 7fca97c47740 1 -- 172.21.15.19:0/3197427206 wait complete. 2024-09-19T08:56:49.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.895+0000 7fca97c47740 1 -- start start 2024-09-19T08:56:49.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.895+0000 7fca97c47740 1 Processor -- start 2024-09-19T08:56:49.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.896+0000 7fca97c47740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56325b0399a0 0x56325b04c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:49.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.896+0000 7fca97c47740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56325b03a2e0 0x56325b04c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:49.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.896+0000 7fca97c47740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56325b03f370 0x56325b053990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:49.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.896+0000 7fca8e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56325b0399a0 0x56325b04c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:49.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.896+0000 7fca8dd9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56325b03a2e0 0x56325b04c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:49.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.896+0000 7fca8e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56325b0399a0 0x56325b04c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47124/0 (socket says 172.21.15.19:47124) 2024-09-19T08:56:49.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.896+0000 7fca8e59c640 1 -- 172.21.15.19:0/4118828352 learned_addr learned my addr 172.21.15.19:0/4118828352 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:49.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.896+0000 7fca97c47740 1 -- 172.21.15.19:0/4118828352 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56325b04ab50 con 0x56325b0399a0 2024-09-19T08:56:49.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.896+0000 7fca97c47740 1 -- 172.21.15.19:0/4118828352 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56325af26290 con 0x56325b03a2e0 2024-09-19T08:56:49.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.896+0000 7fca97c47740 1 -- 172.21.15.19:0/4118828352 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56325b04acd0 con 0x56325b03f370 2024-09-19T08:56:49.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.896+0000 7fca97c47740 10 client.0 _ll_register_callbacks cb 0x56325af57140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:49.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.896+0000 7fca8e59c640 1 -- 172.21.15.19:0/4118828352 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56325b03f370 msgr2=0x56325b053990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:49.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.896+0000 7fca8e59c640 1 --2- 172.21.15.19:0/4118828352 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56325b03f370 0x56325b053990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:49.900 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.896+0000 7fca8e59c640 1 -- 172.21.15.19:0/4118828352 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56325b03a2e0 msgr2=0x56325b04c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:49.900 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.896+0000 7fca8e59c640 1 --2- 172.21.15.19:0/4118828352 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56325b03a2e0 0x56325b04c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:49.900 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.896+0000 7fca8e59c640 1 -- 172.21.15.19:0/4118828352 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56325acb0210 con 0x56325b0399a0 2024-09-19T08:56:49.900 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.897+0000 7fca8e59c640 1 --2- 172.21.15.19:0/4118828352 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56325b0399a0 0x56325b04c410 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fca80031440 tx=0x7fca80009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15214c7325bf4991 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:49.900 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.897+0000 7fca75ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:56:49.902 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.897+0000 7fca75ffb640 1 -- 172.21.15.19:0/4118828352 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8004d070 con 0x56325b0399a0 2024-09-19T08:56:49.902 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.897+0000 7fca75ffb640 1 -- 172.21.15.19:0/4118828352 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fca80005220 con 0x56325b0399a0 2024-09-19T08:56:49.902 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.897+0000 7fca97c47740 1 -- 172.21.15.19:0/4118828352 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca88004030 con 0x56325b0399a0 2024-09-19T08:56:49.902 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.898+0000 7fca75ffb640 1 -- 172.21.15.19:0/4118828352 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fca80043070 con 0x56325b0399a0 2024-09-19T08:56:49.902 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.898+0000 7fca97c47740 10 client.16431 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:49.902 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.898+0000 7fca97c47740 1 -- 172.21.15.19:0/4118828352 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56325ad7c620 con 0x56325b0399a0 2024-09-19T08:56:49.902 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.898+0000 7fca75ffb640 1 -- 172.21.15.19:0/4118828352 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca88004030 con 0x56325b0399a0 2024-09-19T08:56:49.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.898+0000 7fca75ffb640 1 -- 172.21.15.19:0/4118828352 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7fca80004950 con 0x56325b0399a0 2024-09-19T08:56:49.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.898+0000 7fca97c47740 10 client.16431 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:49.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.898+0000 7fca97c47740 10 client.16431 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:56:49.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.898+0000 7fca97c47740 20 client.16431 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:49.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.898+0000 7fca97c47740 1 --2- 172.21.15.19:0/4118828352 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56325b058010 0x56325b05a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:49.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.898+0000 7fca97c47740 4 client.16431 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:56:49.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.898+0000 7fca97c47740 1 -- 172.21.15.19:0/4118828352 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56325afaaa20 con 0x56325b058010 2024-09-19T08:56:49.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.898+0000 7fca8dd9b640 1 --2- 172.21.15.19:0/4118828352 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56325b058010 0x56325b05a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:49.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.899+0000 7fca8dd9b640 1 --2- 172.21.15.19:0/4118828352 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56325b058010 0x56325b05a460 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c89d1f62649eecf server_cookie=264f1c1e0e422544 in_seq=0 out_seq=0 2024-09-19T08:56:49.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.899+0000 7fca75ffb640 10 client.16431 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:49.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.901+0000 7fca75ffb640 1 -- 172.21.15.19:0/4118828352 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56325afaaa20 con 0x56325b058010 2024-09-19T08:56:49.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.901+0000 7fca75ffb640 10 client.16431 handle_command_reply: tid=0 2024-09-19T08:56:49.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.901+0000 7fca97c47740 1 client.16431 shutdown 2024-09-19T08:56:49.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.901+0000 7fca97c47740 1 -- 172.21.15.19:0/4118828352 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56325b0399a0 msgr2=0x56325b04c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:49.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.901+0000 7fca97c47740 1 --2- 172.21.15.19:0/4118828352 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56325b0399a0 0x56325b04c410 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fca80031440 tx=0x7fca80009260 comp rx=0 tx=0).stop 2024-09-19T08:56:49.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.901+0000 7fca97c47740 1 -- 172.21.15.19:0/4118828352 shutdown_connections 2024-09-19T08:56:49.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.901+0000 7fca97c47740 1 --2- 172.21.15.19:0/4118828352 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56325b058010 0x56325b05a460 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:49.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.901+0000 7fca97c47740 1 --2- 172.21.15.19:0/4118828352 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56325b03f370 0x56325b053990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:49.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.901+0000 7fca97c47740 1 --2- 172.21.15.19:0/4118828352 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56325b03a2e0 0x56325b04c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:49.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.901+0000 7fca97c47740 1 --2- 172.21.15.19:0/4118828352 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56325b0399a0 0x56325b04c410 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:49.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.901+0000 7fca97c47740 1 -- 172.21.15.19:0/4118828352 >> 172.21.15.19:0/4118828352 conn(0x56325b035010 msgr2=0x56325b036820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:49.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.901+0000 7fca75ffb640 0 client.16431 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:49.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.901+0000 7fca97c47740 1 -- 172.21.15.19:0/4118828352 shutdown_connections 2024-09-19T08:56:49.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.901+0000 7fca97c47740 1 -- 172.21.15.19:0/4118828352 wait complete. 2024-09-19T08:56:49.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.901+0000 7fca97c47740 20 client.16431 trim_cache size 0 max 16384 2024-09-19T08:56:49.919 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.918+0000 7fca97c47740 1 Processor -- start 2024-09-19T08:56:49.919 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.918+0000 7fca97c47740 1 -- start start 2024-09-19T08:56:49.920 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.919+0000 7fca97c47740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56325b0399a0 0x56325b04b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:49.920 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.919+0000 7fca97c47740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56325b03a2e0 0x56325b053950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:49.921 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.919+0000 7fca97c47740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56325b03f370 0x56325b0340b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:49.921 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.919+0000 7fca97c47740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fca901a6e90 con 0x56325b03a2e0 2024-09-19T08:56:49.921 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.919+0000 7fca97c47740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fca901a8a00 con 0x56325b0399a0 2024-09-19T08:56:49.921 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.919+0000 7fca97c47740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fca901a7560 con 0x56325b03f370 2024-09-19T08:56:49.921 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.919+0000 7fca8e59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56325b0399a0 0x56325b04b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:49.921 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.919+0000 7fca8e59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56325b0399a0 0x56325b04b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:39590/0 (socket says 172.21.15.19:39590) 2024-09-19T08:56:49.921 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.919+0000 7fca8e59c640 1 -- 172.21.15.19:0/3676882349 learned_addr learned my addr 172.21.15.19:0/3676882349 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:49.921 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.919+0000 7fca8dd9b640 1 --2- 172.21.15.19:0/3676882349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56325b03a2e0 0x56325b053950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:49.921 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.919+0000 7fca8ed9d640 1 --2- 172.21.15.19:0/3676882349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56325b03f370 0x56325b0340b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:49.921 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.919+0000 7fca8e59c640 1 -- 172.21.15.19:0/3676882349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56325b03f370 msgr2=0x56325b0340b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:49.921 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.919+0000 7fca8e59c640 1 --2- 172.21.15.19:0/3676882349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56325b03f370 0x56325b0340b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:49.921 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.919+0000 7fca8e59c640 1 -- 172.21.15.19:0/3676882349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56325b03a2e0 msgr2=0x56325b053950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:49.921 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.919+0000 7fca8e59c640 1 --2- 172.21.15.19:0/3676882349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56325b03a2e0 0x56325b053950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:49.922 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.919+0000 7fca8e59c640 1 -- 172.21.15.19:0/3676882349 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56325b034e30 con 0x56325b0399a0 2024-09-19T08:56:49.922 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.919+0000 7fca8ed9d640 1 --2- 172.21.15.19:0/3676882349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56325b03f370 0x56325b0340b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:56:49.922 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.920+0000 7fca8e59c640 1 --2- 172.21.15.19:0/3676882349 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56325b0399a0 0x56325b04b070 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fca80004f10 tx=0x7fca800316b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e737f9dc7b31b56 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:49.922 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.920+0000 7fca77fff640 1 -- 172.21.15.19:0/3676882349 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8004d070 con 0x56325b0399a0 2024-09-19T08:56:49.922 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.920+0000 7fca77fff640 1 -- 172.21.15.19:0/3676882349 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca80005500 con 0x56325b0399a0 2024-09-19T08:56:49.922 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.920+0000 7fca77fff640 1 -- 172.21.15.19:0/3676882349 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca80035040 con 0x56325b0399a0 2024-09-19T08:56:49.925 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.921+0000 7fca97c47740 1 -- 172.21.15.19:0/3676882349 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56325b0399a0 msgr2=0x56325b04b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:49.925 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.921+0000 7fca97c47740 1 --2- 172.21.15.19:0/3676882349 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56325b0399a0 0x56325b04b070 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fca80004f10 tx=0x7fca800316b0 comp rx=0 tx=0).stop 2024-09-19T08:56:49.925 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.921+0000 7fca97c47740 1 -- 172.21.15.19:0/3676882349 shutdown_connections 2024-09-19T08:56:49.925 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.921+0000 7fca97c47740 1 --2- 172.21.15.19:0/3676882349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56325b03f370 0x56325b0340b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:49.925 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.921+0000 7fca97c47740 1 --2- 172.21.15.19:0/3676882349 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56325b03a2e0 0x56325b053950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:49.925 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.921+0000 7fca97c47740 1 --2- 172.21.15.19:0/3676882349 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56325b0399a0 0x56325b04b070 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:49.925 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.921+0000 7fca97c47740 1 -- 172.21.15.19:0/3676882349 >> 172.21.15.19:0/3676882349 conn(0x56325b035010 msgr2=0x56325b0339a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:49.925 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.921+0000 7fca97c47740 1 -- 172.21.15.19:0/3676882349 shutdown_connections 2024-09-19T08:56:49.925 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.921+0000 7fca97c47740 1 -- 172.21.15.19:0/3676882349 wait complete. 2024-09-19T08:56:49.925 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.921+0000 7fca97c47740 1 -- start start 2024-09-19T08:56:49.925 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.921+0000 7fca97c47740 1 Processor -- start 2024-09-19T08:56:49.926 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.922+0000 7fca97c47740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56325b0399a0 0x56325b050af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:49.926 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.922+0000 7fca97c47740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56325b03a2e0 0x56325b051030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:49.926 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.922+0000 7fca97c47740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56325b03f370 0x56325b052040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:49.926 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.922+0000 7fca97c47740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fca901a8330 con 0x56325b0399a0 2024-09-19T08:56:49.926 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.922+0000 7fca97c47740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fca901a7c60 con 0x56325b03a2e0 2024-09-19T08:56:49.926 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.922+0000 7fca97c47740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fca901a4e70 con 0x56325b03f370 2024-09-19T08:56:49.926 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.922+0000 7fca97c47740 10 client.0 _ll_register_callbacks cb 0x7fca80005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:49.926 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.922+0000 7fca8e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56325b0399a0 0x56325b050af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:49.926 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.922+0000 7fca8dd9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56325b03a2e0 0x56325b051030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:49.926 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.922+0000 7fca8ed9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56325b03f370 0x56325b052040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:49.926 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.922+0000 7fca8dd9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56325b03a2e0 0x56325b051030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:39602/0 (socket says 172.21.15.19:39602) 2024-09-19T08:56:49.926 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.922+0000 7fca8dd9b640 1 -- 172.21.15.19:0/1980219901 learned_addr learned my addr 172.21.15.19:0/1980219901 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:49.926 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.922+0000 7fca8e59c640 1 -- 172.21.15.19:0/1980219901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56325b03f370 msgr2=0x56325b052040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:49.927 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.922+0000 7fca8e59c640 1 --2- 172.21.15.19:0/1980219901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56325b03f370 0x56325b052040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:49.927 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.922+0000 7fca8e59c640 1 -- 172.21.15.19:0/1980219901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56325b03a2e0 msgr2=0x56325b051030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:49.927 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.922+0000 7fca8e59c640 1 --2- 172.21.15.19:0/1980219901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56325b03a2e0 0x56325b051030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:49.927 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.922+0000 7fca8e59c640 1 -- 172.21.15.19:0/1980219901 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56325b052650 con 0x56325b0399a0 2024-09-19T08:56:49.927 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.922+0000 7fca8dd9b640 1 --2- 172.21.15.19:0/1980219901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56325b03a2e0 0x56325b051030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:49.927 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.923+0000 7fca8e59c640 1 --2- 172.21.15.19:0/1980219901 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56325b0399a0 0x56325b050af0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fca80004da0 tx=0x7fca80003a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2be521fb70a03586 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:49.927 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.923+0000 7fca75ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:56:49.927 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.923+0000 7fca75ffb640 1 -- 172.21.15.19:0/1980219901 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8006a020 con 0x56325b0399a0 2024-09-19T08:56:49.927 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.923+0000 7fca97c47740 1 -- 172.21.15.19:0/1980219901 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca80005500 con 0x56325b0399a0 2024-09-19T08:56:49.927 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.923+0000 7fca75ffb640 1 -- 172.21.15.19:0/1980219901 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fca80005220 con 0x56325b0399a0 2024-09-19T08:56:49.927 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.923+0000 7fca75ffb640 1 -- 172.21.15.19:0/1980219901 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fca8004d070 con 0x56325b0399a0 2024-09-19T08:56:49.927 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.923+0000 7fca97c47740 10 client.16437 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:49.927 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.923+0000 7fca97c47740 1 -- 172.21.15.19:0/1980219901 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56325b0538d0 con 0x56325b0399a0 2024-09-19T08:56:49.927 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.923+0000 7fca75ffb640 1 -- 172.21.15.19:0/1980219901 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fca80005500 con 0x56325b0399a0 2024-09-19T08:56:49.928 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.924+0000 7fca75ffb640 1 -- 172.21.15.19:0/1980219901 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7fca8005dbd0 con 0x56325b0399a0 2024-09-19T08:56:49.928 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.924+0000 7fca97c47740 10 client.16437 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:49.928 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.924+0000 7fca97c47740 10 client.16437 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:56:49.928 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.924+0000 7fca97c47740 20 client.16437 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:49.928 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.924+0000 7fca97c47740 1 --2- 172.21.15.19:0/1980219901 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56325b0c3010 0x56325b0c5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:49.928 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.924+0000 7fca97c47740 4 client.16437 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:56:49.928 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.924+0000 7fca97c47740 1 -- 172.21.15.19:0/1980219901 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56325b04cde0 con 0x56325b0c3010 2024-09-19T08:56:49.928 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.924+0000 7fca8dd9b640 1 --2- 172.21.15.19:0/1980219901 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56325b0c3010 0x56325b0c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:49.928 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.924+0000 7fca8dd9b640 1 --2- 172.21.15.19:0/1980219901 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56325b0c3010 0x56325b0c5400 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c95761b9ea47ccc8 server_cookie=bcc14b4b796a3521 in_seq=0 out_seq=0 2024-09-19T08:56:49.928 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:49.924+0000 7fca75ffb640 10 client.16437 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:49.969 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:50.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.439+0000 7f7beab17640 1 -- 172.21.15.19:0/989780715 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7be4102790 msgr2=0x7f7be41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:50.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.439+0000 7f7beab17640 1 --2- 172.21.15.19:0/989780715 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7be4102790 0x7f7be41067e0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc009900 tx=0x7f7bcc02a410 comp rx=0 tx=0).stop 2024-09-19T08:56:50.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.439+0000 7f7beab17640 1 -- 172.21.15.19:0/989780715 shutdown_connections 2024-09-19T08:56:50.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.439+0000 7f7beab17640 1 --2- 172.21.15.19:0/989780715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7be4106f10 0x7f7be410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:50.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.439+0000 7f7beab17640 1 --2- 172.21.15.19:0/989780715 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7be4102790 0x7f7be41067e0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:50.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.439+0000 7f7beab17640 1 --2- 172.21.15.19:0/989780715 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7be4101de0 0x7f7be41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:50.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.439+0000 7f7beab17640 1 -- 172.21.15.19:0/989780715 >> 172.21.15.19:0/989780715 conn(0x7f7be40fd8c0 msgr2=0x7f7be40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:50.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.439+0000 7f7beab17640 1 -- 172.21.15.19:0/989780715 shutdown_connections 2024-09-19T08:56:50.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.439+0000 7f7beab17640 1 -- 172.21.15.19:0/989780715 wait complete. 2024-09-19T08:56:50.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.439+0000 7f7beab17640 1 Processor -- start 2024-09-19T08:56:50.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.439+0000 7f7beab17640 1 -- start start 2024-09-19T08:56:50.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.440+0000 7f7beab17640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7be4101de0 0x7f7be4198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:50.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.440+0000 7f7beab17640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7be4102790 0x7f7be41989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:50.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.440+0000 7f7beab17640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7be4106f10 0x7f7be419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:50.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.440+0000 7f7beab17640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7be4111f90 con 0x7f7be4102790 2024-09-19T08:56:50.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.440+0000 7f7beab17640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7be4111e10 con 0x7f7be4106f10 2024-09-19T08:56:50.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.440+0000 7f7beab17640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7be4112110 con 0x7f7be4101de0 2024-09-19T08:56:50.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.440+0000 7f7be3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7be4102790 0x7f7be41989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:50.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.440+0000 7f7be88b3640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7be4101de0 0x7f7be4198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:50.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.440+0000 7f7be88b3640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7be4101de0 0x7f7be4198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:55160/0 (socket says 172.21.15.19:55160) 2024-09-19T08:56:50.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.440+0000 7f7be88b3640 1 -- 172.21.15.19:0/1130378322 learned_addr learned my addr 172.21.15.19:0/1130378322 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:50.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.440+0000 7f7be90b4640 1 --2- 172.21.15.19:0/1130378322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7be4106f10 0x7f7be419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:50.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.440+0000 7f7be3fff640 1 -- 172.21.15.19:0/1130378322 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7be4101de0 msgr2=0x7f7be4198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:50.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.440+0000 7f7be3fff640 1 --2- 172.21.15.19:0/1130378322 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7be4101de0 0x7f7be4198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:50.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.440+0000 7f7be3fff640 1 -- 172.21.15.19:0/1130378322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7be4106f10 msgr2=0x7f7be419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:50.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.440+0000 7f7be3fff640 1 --2- 172.21.15.19:0/1130378322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7be4106f10 0x7f7be419cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:50.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.440+0000 7f7be3fff640 1 -- 172.21.15.19:0/1130378322 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7be419d460 con 0x7f7be4102790 2024-09-19T08:56:50.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.441+0000 7f7be3fff640 1 --2- 172.21.15.19:0/1130378322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7be4102790 0x7f7be41989d0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc005940 tx=0x7f7bcc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:50.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.441+0000 7f7be1ffb640 1 -- 172.21.15.19:0/1130378322 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc03f030 con 0x7f7be4102790 2024-09-19T08:56:50.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.441+0000 7f7be1ffb640 1 -- 172.21.15.19:0/1130378322 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bcc003ad0 con 0x7f7be4102790 2024-09-19T08:56:50.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.441+0000 7f7beab17640 1 -- 172.21.15.19:0/1130378322 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7be419d6f0 con 0x7f7be4102790 2024-09-19T08:56:50.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.441+0000 7f7be1ffb640 1 -- 172.21.15.19:0/1130378322 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc035070 con 0x7f7be4102790 2024-09-19T08:56:50.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.441+0000 7f7beab17640 1 -- 172.21.15.19:0/1130378322 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7be406bc10 con 0x7f7be4102790 2024-09-19T08:56:50.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.444+0000 7f7be1ffb640 1 -- 172.21.15.19:0/1130378322 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f7bcc042030 con 0x7f7be4102790 2024-09-19T08:56:50.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.444+0000 7f7becef0740 1 Processor -- start 2024-09-19T08:56:50.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.444+0000 7f7becef0740 1 -- start start 2024-09-19T08:56:50.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.444+0000 7f7becef0740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ded011cb40 0x55ded011b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:50.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.444+0000 7f7becef0740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ded011b5d0 0x55ded011ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:50.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.444+0000 7f7becef0740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ded0126370 0x55ded0128760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:50.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.444+0000 7f7becef0740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ded00812f0 con 0x55ded0126370 2024-09-19T08:56:50.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.444+0000 7f7becef0740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55ded0028cf0 con 0x55ded011cb40 2024-09-19T08:56:50.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.444+0000 7f7becef0740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ded007d2b0 con 0x55ded011b5d0 2024-09-19T08:56:50.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.444+0000 7f7be90b4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ded011cb40 0x55ded011b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:50.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.444+0000 7f7be3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ded0126370 0x55ded0128760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:50.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.444+0000 7f7be1ffb640 1 --2- 172.21.15.19:0/1130378322 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7bd00a3240 0x7f7bd00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:50.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.444+0000 7f7be90b4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ded011cb40 0x55ded011b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:39626/0 (socket says 172.21.15.19:39626) 2024-09-19T08:56:50.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.444+0000 7f7be90b4640 1 -- 172.21.15.19:0/3073862813 learned_addr learned my addr 172.21.15.19:0/3073862813 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:50.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.444+0000 7f7be88b3640 1 --2- 172.21.15.19:0/3073862813 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ded011b5d0 0x55ded011ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:50.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.445+0000 7f7be90b4640 1 --2- 172.21.15.19:0/1130378322 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7bd00a3240 0x7f7bd00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:50.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.445+0000 7f7be90b4640 1 -- 172.21.15.19:0/3073862813 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ded011b5d0 msgr2=0x55ded011ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:50.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.445+0000 7f7be1ffb640 1 -- 172.21.15.19:0/1130378322 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7bcc0efcc0 con 0x7f7be4102790 2024-09-19T08:56:50.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.445+0000 7f7be90b4640 1 --2- 172.21.15.19:0/3073862813 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ded011b5d0 0x55ded011ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:50.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.445+0000 7f7be90b4640 1 -- 172.21.15.19:0/3073862813 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ded0126370 msgr2=0x55ded0128760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:50.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.445+0000 7f7be90b4640 1 --2- 172.21.15.19:0/3073862813 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ded0126370 0x55ded0128760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:50.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.445+0000 7f7be90b4640 1 -- 172.21.15.19:0/3073862813 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ded000d3a0 con 0x55ded011cb40 2024-09-19T08:56:50.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.445+0000 7f7be90b4640 1 --2- 172.21.15.19:0/3073862813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ded011cb40 0x55ded011b090 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc009870 tx=0x7f7bdc009d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3360ba61598a8b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:50.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.445+0000 7f7be90b4640 1 --2- 172.21.15.19:0/1130378322 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7bd00a3240 0x7f7bd00a5700 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc021000 tx=0x7f7bdc023000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:50.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.445+0000 7f7bdaffd640 1 -- 172.21.15.19:0/3073862813 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc023070 con 0x55ded011cb40 2024-09-19T08:56:50.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.445+0000 7f7bdaffd640 1 -- 172.21.15.19:0/3073862813 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bdc01fca0 con 0x55ded011cb40 2024-09-19T08:56:50.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.445+0000 7f7bdaffd640 1 -- 172.21.15.19:0/3073862813 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc028be0 con 0x55ded011cb40 2024-09-19T08:56:50.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.446+0000 7f7becef0740 1 -- 172.21.15.19:0/3073862813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ded011cb40 msgr2=0x55ded011b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:50.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.446+0000 7f7becef0740 1 --2- 172.21.15.19:0/3073862813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ded011cb40 0x55ded011b090 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc009870 tx=0x7f7bdc009d30 comp rx=0 tx=0).stop 2024-09-19T08:56:50.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.446+0000 7f7becef0740 1 -- 172.21.15.19:0/3073862813 shutdown_connections 2024-09-19T08:56:50.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.446+0000 7f7becef0740 1 --2- 172.21.15.19:0/3073862813 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ded011b5d0 0x55ded011ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:50.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.446+0000 7f7becef0740 1 --2- 172.21.15.19:0/3073862813 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ded0126370 0x55ded0128760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:50.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.446+0000 7f7becef0740 1 --2- 172.21.15.19:0/3073862813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ded011cb40 0x55ded011b090 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:50.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.446+0000 7f7becef0740 1 -- 172.21.15.19:0/3073862813 >> 172.21.15.19:0/3073862813 conn(0x55ded00e4310 msgr2=0x55ded0117c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:50.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.446+0000 7f7becef0740 1 -- 172.21.15.19:0/3073862813 shutdown_connections 2024-09-19T08:56:50.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.446+0000 7f7becef0740 1 -- 172.21.15.19:0/3073862813 wait complete. 2024-09-19T08:56:50.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.446+0000 7f7becef0740 1 -- start start 2024-09-19T08:56:50.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.446+0000 7f7becef0740 1 Processor -- start 2024-09-19T08:56:50.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.447+0000 7f7becef0740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ded011b5d0 0x55ded0125d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:50.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.447+0000 7f7becef0740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ded011cb40 0x55ded0122fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:50.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.447+0000 7f7becef0740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ded0126370 0x55ded0123570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:50.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.447+0000 7f7becef0740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ded0129010 con 0x55ded011cb40 2024-09-19T08:56:50.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.447+0000 7f7becef0740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55ded003c060 con 0x55ded0126370 2024-09-19T08:56:50.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.447+0000 7f7becef0740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ded0129190 con 0x55ded011b5d0 2024-09-19T08:56:50.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.447+0000 7f7becef0740 10 client.0 _ll_register_callbacks cb 0x55decfd8f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:50.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.447+0000 7f7be3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ded011cb40 0x55ded0122fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:50.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.447+0000 7f7be3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ded011cb40 0x55ded0122fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47160/0 (socket says 172.21.15.19:47160) 2024-09-19T08:56:50.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.447+0000 7f7be3fff640 1 -- 172.21.15.19:0/1431435802 learned_addr learned my addr 172.21.15.19:0/1431435802 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:50.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.447+0000 7f7be90b4640 1 --2- 172.21.15.19:0/1431435802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ded0126370 0x55ded0123570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:50.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.447+0000 7f7be88b3640 1 --2- 172.21.15.19:0/1431435802 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ded011b5d0 0x55ded0125d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:50.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.447+0000 7f7be3fff640 1 -- 172.21.15.19:0/1431435802 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ded011b5d0 msgr2=0x55ded0125d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:50.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.447+0000 7f7be3fff640 1 --2- 172.21.15.19:0/1431435802 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ded011b5d0 0x55ded0125d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:50.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.447+0000 7f7be3fff640 1 -- 172.21.15.19:0/1431435802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ded0126370 msgr2=0x55ded0123570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:50.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.447+0000 7f7be3fff640 1 --2- 172.21.15.19:0/1431435802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ded0126370 0x55ded0123570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:50.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.447+0000 7f7be3fff640 1 -- 172.21.15.19:0/1431435802 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55decfdf23c0 con 0x55ded011cb40 2024-09-19T08:56:50.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.447+0000 7f7be3fff640 1 --2- 172.21.15.19:0/1431435802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ded011cb40 0x55ded0122fd0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc0c49d0 tx=0x7f7bcc031a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2750995f9c9cf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:50.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.447+0000 7f7bc3fff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:56:50.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.448+0000 7f7bc3fff640 1 -- 172.21.15.19:0/1431435802 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc049070 con 0x55ded011cb40 2024-09-19T08:56:50.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.448+0000 7f7bc3fff640 1 -- 172.21.15.19:0/1431435802 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7bcc0035f0 con 0x55ded011cb40 2024-09-19T08:56:50.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.448+0000 7f7becef0740 1 -- 172.21.15.19:0/1431435802 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7bdc01fca0 con 0x55ded011cb40 2024-09-19T08:56:50.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.448+0000 7f7bc3fff640 1 -- 172.21.15.19:0/1431435802 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f7bcc0c4f00 con 0x55ded011cb40 2024-09-19T08:56:50.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.448+0000 7f7becef0740 10 client.16449 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:50.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.448+0000 7f7becef0740 1 -- 172.21.15.19:0/1431435802 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ded0134a60 con 0x55ded011cb40 2024-09-19T08:56:50.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.448+0000 7f7bc3fff640 1 -- 172.21.15.19:0/1431435802 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bdc01fca0 con 0x55ded011cb40 2024-09-19T08:56:50.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.448+0000 7f7bc3fff640 1 -- 172.21.15.19:0/1431435802 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f7bcc0bc5a0 con 0x55ded011cb40 2024-09-19T08:56:50.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.448+0000 7f7becef0740 10 client.16449 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:50.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.448+0000 7f7becef0740 10 client.16449 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-19T08:56:50.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.448+0000 7f7becef0740 20 client.16449 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:50.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.448+0000 7f7becef0740 1 --2- 172.21.15.19:0/1431435802 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55ded0135f60 0x55ded0138370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:50.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.448+0000 7f7becef0740 4 client.16449 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:56:50.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.448+0000 7f7becef0740 1 -- 172.21.15.19:0/1431435802 --> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ded008e860 con 0x55ded0135f60 2024-09-19T08:56:50.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.449+0000 7f7be88b3640 1 --2- 172.21.15.19:0/1431435802 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55ded0135f60 0x55ded0138370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:50.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.449+0000 7f7bc3fff640 10 client.16449 ms_handle_connect on v2:172.21.15.155:6836/3381010945 2024-09-19T08:56:50.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.449+0000 7f7be88b3640 1 --2- 172.21.15.19:0/1431435802 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55ded0135f60 0x55ded0138370 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=871e0afdee517d90 server_cookie=8ea3851ee865b5d1 in_seq=0 out_seq=0 2024-09-19T08:56:50.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.449+0000 7f7bc3fff640 1 -- 172.21.15.19:0/1431435802 <== mds.3 v2:172.21.15.155:6836/3381010945 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ded008e860 con 0x55ded0135f60 2024-09-19T08:56:50.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.449+0000 7f7bc3fff640 10 client.16449 handle_command_reply: tid=0 2024-09-19T08:56:50.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.450+0000 7f7becef0740 1 client.16449 shutdown 2024-09-19T08:56:50.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.450+0000 7f7becef0740 1 -- 172.21.15.19:0/1431435802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ded011cb40 msgr2=0x55ded0122fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:50.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.450+0000 7f7becef0740 1 --2- 172.21.15.19:0/1431435802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ded011cb40 0x55ded0122fd0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc0c49d0 tx=0x7f7bcc031a60 comp rx=0 tx=0).stop 2024-09-19T08:56:50.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.450+0000 7f7becef0740 1 -- 172.21.15.19:0/1431435802 shutdown_connections 2024-09-19T08:56:50.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.450+0000 7f7becef0740 1 --2- 172.21.15.19:0/1431435802 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55ded0135f60 0x55ded0138370 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:50.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.450+0000 7f7becef0740 1 --2- 172.21.15.19:0/1431435802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ded0126370 0x55ded0123570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:50.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.450+0000 7f7becef0740 1 --2- 172.21.15.19:0/1431435802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ded011cb40 0x55ded0122fd0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:50.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.450+0000 7f7becef0740 1 --2- 172.21.15.19:0/1431435802 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ded011b5d0 0x55ded0125d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:50.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.450+0000 7f7bc3fff640 0 client.16449 ms_handle_reset on v2:172.21.15.155:6836/3381010945 2024-09-19T08:56:50.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.450+0000 7f7becef0740 1 -- 172.21.15.19:0/1431435802 >> 172.21.15.19:0/1431435802 conn(0x55ded00e4310 msgr2=0x55ded011d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:50.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.450+0000 7f7becef0740 1 -- 172.21.15.19:0/1431435802 shutdown_connections 2024-09-19T08:56:50.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.450+0000 7f7becef0740 1 -- 172.21.15.19:0/1431435802 wait complete. 2024-09-19T08:56:50.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.450+0000 7f7becef0740 20 client.16449 trim_cache size 0 max 16384 2024-09-19T08:56:50.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.463+0000 7f7becef0740 1 Processor -- start 2024-09-19T08:56:50.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.463+0000 7f7becef0740 1 -- start start 2024-09-19T08:56:50.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.464+0000 7f7becef0740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ded011b5d0 0x55ded0117e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:50.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.464+0000 7f7becef0740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ded011cb40 0x55ded01322b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:50.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.464+0000 7f7becef0740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ded0126370 0x55ded011e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:50.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.464+0000 7f7becef0740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7be4074140 con 0x55ded011b5d0 2024-09-19T08:56:50.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.464+0000 7f7becef0740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7be4075cb0 con 0x55ded011cb40 2024-09-19T08:56:50.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.464+0000 7f7becef0740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7be4074810 con 0x55ded0126370 2024-09-19T08:56:50.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.464+0000 7f7be88b3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ded011b5d0 0x55ded0117e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:50.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.464+0000 7f7be88b3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ded011b5d0 0x55ded0117e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47174/0 (socket says 172.21.15.19:47174) 2024-09-19T08:56:50.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.464+0000 7f7be88b3640 1 -- 172.21.15.19:0/225270664 learned_addr learned my addr 172.21.15.19:0/225270664 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:50.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.464+0000 7f7be90b4640 1 --2- 172.21.15.19:0/225270664 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ded0126370 0x55ded011e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:50.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.464+0000 7f7be3fff640 1 --2- 172.21.15.19:0/225270664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ded011cb40 0x55ded01322b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:50.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.464+0000 7f7be88b3640 1 -- 172.21.15.19:0/225270664 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ded0126370 msgr2=0x55ded011e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:50.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.464+0000 7f7be88b3640 1 --2- 172.21.15.19:0/225270664 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ded0126370 0x55ded011e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:50.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.464+0000 7f7be88b3640 1 -- 172.21.15.19:0/225270664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ded011cb40 msgr2=0x55ded01322b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:50.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.464+0000 7f7be88b3640 1 --2- 172.21.15.19:0/225270664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ded011cb40 0x55ded01322b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:50.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.464+0000 7f7be88b3640 1 -- 172.21.15.19:0/225270664 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ded01238e0 con 0x55ded011b5d0 2024-09-19T08:56:50.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.464+0000 7f7be88b3640 1 --2- 172.21.15.19:0/225270664 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ded011b5d0 0x55ded0117e10 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f7bd40145a0 tx=0x7f7bd400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae76aeea29d30dc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:50.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.464+0000 7f7bda7fc640 1 -- 172.21.15.19:0/225270664 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd4016640 con 0x55ded011b5d0 2024-09-19T08:56:50.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.465+0000 7f7bda7fc640 1 -- 172.21.15.19:0/225270664 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bd4016cc0 con 0x55ded011b5d0 2024-09-19T08:56:50.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.465+0000 7f7bda7fc640 1 -- 172.21.15.19:0/225270664 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bd4015390 con 0x55ded011b5d0 2024-09-19T08:56:50.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.465+0000 7f7becef0740 1 -- 172.21.15.19:0/225270664 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ded011b5d0 msgr2=0x55ded0117e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:50.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.465+0000 7f7becef0740 1 --2- 172.21.15.19:0/225270664 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ded011b5d0 0x55ded0117e10 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f7bd40145a0 tx=0x7f7bd400b040 comp rx=0 tx=0).stop 2024-09-19T08:56:50.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.465+0000 7f7becef0740 1 -- 172.21.15.19:0/225270664 shutdown_connections 2024-09-19T08:56:50.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.465+0000 7f7becef0740 1 --2- 172.21.15.19:0/225270664 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ded0126370 0x55ded011e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:50.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.465+0000 7f7becef0740 1 --2- 172.21.15.19:0/225270664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ded011cb40 0x55ded01322b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:50.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.465+0000 7f7becef0740 1 --2- 172.21.15.19:0/225270664 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ded011b5d0 0x55ded0117e10 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:50.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.465+0000 7f7becef0740 1 -- 172.21.15.19:0/225270664 >> 172.21.15.19:0/225270664 conn(0x55ded00e4310 msgr2=0x55ded0117700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:50.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.465+0000 7f7becef0740 1 -- 172.21.15.19:0/225270664 shutdown_connections 2024-09-19T08:56:50.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.465+0000 7f7becef0740 1 -- 172.21.15.19:0/225270664 wait complete. 2024-09-19T08:56:50.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.466+0000 7f7becef0740 1 -- start start 2024-09-19T08:56:50.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.466+0000 7f7becef0740 1 Processor -- start 2024-09-19T08:56:50.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.466+0000 7f7becef0740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ded011b5d0 0x55ded0129980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:50.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.466+0000 7f7becef0740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ded011cb40 0x55ded0129ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:50.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.466+0000 7f7becef0740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ded0126370 0x55ded019ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:50.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.466+0000 7f7becef0740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7be40755e0 con 0x55ded011b5d0 2024-09-19T08:56:50.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.466+0000 7f7becef0740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7be4074f10 con 0x55ded011cb40 2024-09-19T08:56:50.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.466+0000 7f7becef0740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7be4072120 con 0x55ded0126370 2024-09-19T08:56:50.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.466+0000 7f7becef0740 10 client.0 _ll_register_callbacks cb 0x7f7bcc0b6d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:50.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.466+0000 7f7be88b3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ded011b5d0 0x55ded0129980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:50.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.466+0000 7f7be90b4640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ded0126370 0x55ded019ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:50.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.466+0000 7f7be88b3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ded011b5d0 0x55ded0129980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47190/0 (socket says 172.21.15.19:47190) 2024-09-19T08:56:50.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.466+0000 7f7be88b3640 1 -- 172.21.15.19:0/1782282331 learned_addr learned my addr 172.21.15.19:0/1782282331 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:50.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.466+0000 7f7be3fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ded011cb40 0x55ded0129ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:50.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.467+0000 7f7be3fff640 1 -- 172.21.15.19:0/1782282331 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ded0126370 msgr2=0x55ded019ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:50.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.467+0000 7f7be3fff640 1 --2- 172.21.15.19:0/1782282331 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ded0126370 0x55ded019ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:50.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.467+0000 7f7be3fff640 1 -- 172.21.15.19:0/1782282331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ded011b5d0 msgr2=0x55ded0129980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:50.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.467+0000 7f7be3fff640 1 --2- 172.21.15.19:0/1782282331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ded011b5d0 0x55ded0129980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:50.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.467+0000 7f7be3fff640 1 -- 172.21.15.19:0/1782282331 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ded019f1c0 con 0x55ded011cb40 2024-09-19T08:56:50.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.467+0000 7f7be88b3640 1 --2- 172.21.15.19:0/1782282331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ded011b5d0 0x55ded0129980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:50.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.467+0000 7f7be3fff640 1 --2- 172.21.15.19:0/1782282331 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ded011cb40 0x55ded0129ec0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc0b8d10 tx=0x7f7bcc0bc1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f32caa1a25feae5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:50.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.467+0000 7f7bc3fff640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T08:56:50.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.467+0000 7f7bc3fff640 1 -- 172.21.15.19:0/1782282331 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc049070 con 0x55ded011cb40 2024-09-19T08:56:50.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.467+0000 7f7bc3fff640 1 -- 172.21.15.19:0/1782282331 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7bcc0bc5a0 con 0x55ded011cb40 2024-09-19T08:56:50.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.467+0000 7f7becef0740 1 -- 172.21.15.19:0/1782282331 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7bd4016cc0 con 0x55ded011cb40 2024-09-19T08:56:50.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.467+0000 7f7bc3fff640 1 -- 172.21.15.19:0/1782282331 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f7bcc0bc340 con 0x55ded011cb40 2024-09-19T08:56:50.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.467+0000 7f7becef0740 10 client.25973 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:50.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.467+0000 7f7becef0740 1 -- 172.21.15.19:0/1782282331 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ded01a04c0 con 0x55ded011cb40 2024-09-19T08:56:50.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.468+0000 7f7bc3fff640 1 -- 172.21.15.19:0/1782282331 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7bd4016cc0 con 0x55ded011cb40 2024-09-19T08:56:50.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.468+0000 7f7bc3fff640 1 -- 172.21.15.19:0/1782282331 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f7bcc031bd0 con 0x55ded011cb40 2024-09-19T08:56:50.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.468+0000 7f7becef0740 10 client.25973 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:50.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.468+0000 7f7becef0740 10 client.25973 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-19T08:56:50.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.468+0000 7f7becef0740 20 client.25973 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:50.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.468+0000 7f7becef0740 1 --2- 172.21.15.19:0/1782282331 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55ded01a0b00 0x55ded01a2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:50.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.468+0000 7f7becef0740 4 client.25973 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:56:50.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.468+0000 7f7becef0740 1 -- 172.21.15.19:0/1782282331 --> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ded0088d70 con 0x55ded01a0b00 2024-09-19T08:56:50.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.468+0000 7f7be88b3640 1 --2- 172.21.15.19:0/1782282331 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55ded01a0b00 0x55ded01a2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:50.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.468+0000 7f7be88b3640 1 --2- 172.21.15.19:0/1782282331 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55ded01a0b00 0x55ded01a2f20 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=70178c33738e9c9c server_cookie=8d7fda7a53c43399 in_seq=0 out_seq=0 2024-09-19T08:56:50.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.468+0000 7f7bc3fff640 10 client.25973 ms_handle_connect on v2:172.21.15.155:6836/3381010945 2024-09-19T08:56:50.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.469+0000 7f7bc3fff640 1 -- 172.21.15.19:0/1782282331 <== mds.3 v2:172.21.15.155:6836/3381010945 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ded0088d70 con 0x55ded01a0b00 2024-09-19T08:56:50.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.469+0000 7f7bc3fff640 10 client.25973 handle_command_reply: tid=0 2024-09-19T08:56:50.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.469+0000 7f7becef0740 1 client.25973 shutdown 2024-09-19T08:56:50.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.469+0000 7f7becef0740 1 -- 172.21.15.19:0/1782282331 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ded011cb40 msgr2=0x55ded0129ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:50.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.469+0000 7f7becef0740 1 --2- 172.21.15.19:0/1782282331 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ded011cb40 0x55ded0129ec0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc0b8d10 tx=0x7f7bcc0bc1c0 comp rx=0 tx=0).stop 2024-09-19T08:56:50.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.469+0000 7f7becef0740 1 -- 172.21.15.19:0/1782282331 shutdown_connections 2024-09-19T08:56:50.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.469+0000 7f7becef0740 1 --2- 172.21.15.19:0/1782282331 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55ded01a0b00 0x55ded01a2f20 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:50.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.469+0000 7f7becef0740 1 --2- 172.21.15.19:0/1782282331 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ded0126370 0x55ded019ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:50.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.469+0000 7f7becef0740 1 --2- 172.21.15.19:0/1782282331 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ded011cb40 0x55ded0129ec0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:50.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.469+0000 7f7bc3fff640 0 client.25973 ms_handle_reset on v2:172.21.15.155:6836/3381010945 2024-09-19T08:56:50.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.469+0000 7f7becef0740 1 --2- 172.21.15.19:0/1782282331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ded011b5d0 0x55ded0129980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:50.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.469+0000 7f7becef0740 1 -- 172.21.15.19:0/1782282331 >> 172.21.15.19:0/1782282331 conn(0x55ded00e4310 msgr2=0x55ded0121cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:50.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.469+0000 7f7becef0740 1 -- 172.21.15.19:0/1782282331 shutdown_connections 2024-09-19T08:56:50.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.469+0000 7f7becef0740 1 -- 172.21.15.19:0/1782282331 wait complete. 2024-09-19T08:56:50.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.469+0000 7f7becef0740 20 client.25973 trim_cache size 0 max 16384 2024-09-19T08:56:50.475 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T08:56:50.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.470+0000 7f7beab17640 1 -- 172.21.15.19:0/1130378322 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7bd00a3240 msgr2=0x7f7bd00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:50.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.470+0000 7f7beab17640 1 --2- 172.21.15.19:0/1130378322 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7bd00a3240 0x7f7bd00a5700 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc021000 tx=0x7f7bdc023000 comp rx=0 tx=0).stop 2024-09-19T08:56:50.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.470+0000 7f7beab17640 1 -- 172.21.15.19:0/1130378322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7be4102790 msgr2=0x7f7be41989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:50.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.470+0000 7f7beab17640 1 --2- 172.21.15.19:0/1130378322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7be4102790 0x7f7be41989d0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc005940 tx=0x7f7bcc004270 comp rx=0 tx=0).stop 2024-09-19T08:56:50.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.470+0000 7f7beab17640 1 -- 172.21.15.19:0/1130378322 shutdown_connections 2024-09-19T08:56:50.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.470+0000 7f7beab17640 1 --2- 172.21.15.19:0/1130378322 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7bd00a3240 0x7f7bd00a5700 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:50.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.470+0000 7f7beab17640 1 --2- 172.21.15.19:0/1130378322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7be4106f10 0x7f7be419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:50.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.470+0000 7f7beab17640 1 --2- 172.21.15.19:0/1130378322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7be4102790 0x7f7be41989d0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:50.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.470+0000 7f7beab17640 1 --2- 172.21.15.19:0/1130378322 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7be4101de0 0x7f7be4198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:50.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.470+0000 7f7beab17640 1 -- 172.21.15.19:0/1130378322 >> 172.21.15.19:0/1130378322 conn(0x7f7be40fd8c0 msgr2=0x7f7be40fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:50.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.470+0000 7f7beab17640 1 -- 172.21.15.19:0/1130378322 shutdown_connections 2024-09-19T08:56:50.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:50.470+0000 7f7beab17640 1 -- 172.21.15.19:0/1130378322 wait complete. 2024-09-19T08:56:51.364 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T08:56:51.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:51 smithi019 ceph-mon[30976]: pgmap v476: 97 pgs: 97 active+clean; 21 MiB data, 540 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 538 op/s 2024-09-19T08:56:51.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:51 smithi155 ceph-mon[34921]: pgmap v476: 97 pgs: 97 active+clean; 21 MiB data, 540 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 538 op/s 2024-09-19T08:56:51.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:51 smithi203 ceph-mon[35450]: pgmap v476: 97 pgs: 97 active+clean; 21 MiB data, 540 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 538 op/s 2024-09-19T08:56:51.942 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:52.479 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:52.477+0000 7fca75ffb640 1 -- 172.21.15.19:0/1980219901 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56325b04cde0 con 0x56325b0c3010 2024-09-19T08:56:52.479 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:52.478+0000 7fca75ffb640 10 client.16437 handle_command_reply: tid=0 2024-09-19T08:56:52.479 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:52.478+0000 7fca97c47740 1 client.16437 shutdown 2024-09-19T08:56:52.479 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:52.478+0000 7fca97c47740 1 -- 172.21.15.19:0/1980219901 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56325b0399a0 msgr2=0x56325b050af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:52.479 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:52.478+0000 7fca97c47740 1 --2- 172.21.15.19:0/1980219901 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56325b0399a0 0x56325b050af0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fca80004da0 tx=0x7fca80003a30 comp rx=0 tx=0).stop 2024-09-19T08:56:52.479 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:52.478+0000 7fca97c47740 1 -- 172.21.15.19:0/1980219901 shutdown_connections 2024-09-19T08:56:52.479 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:52.478+0000 7fca97c47740 1 --2- 172.21.15.19:0/1980219901 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56325b0c3010 0x56325b0c5400 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.480 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:52.478+0000 7fca97c47740 1 --2- 172.21.15.19:0/1980219901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56325b03f370 0x56325b052040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.480 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:52.478+0000 7fca97c47740 1 --2- 172.21.15.19:0/1980219901 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56325b03a2e0 0x56325b051030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.480 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:52.478+0000 7fca75ffb640 0 client.16437 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:52.480 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:52.478+0000 7fca97c47740 1 --2- 172.21.15.19:0/1980219901 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56325b0399a0 0x56325b050af0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.480 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:52.478+0000 7fca97c47740 1 -- 172.21.15.19:0/1980219901 >> 172.21.15.19:0/1980219901 conn(0x56325b035010 msgr2=0x56325b0341c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:52.480 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:52.478+0000 7fca97c47740 1 -- 172.21.15.19:0/1980219901 shutdown_connections 2024-09-19T08:56:52.480 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:52.478+0000 7fca97c47740 1 -- 172.21.15.19:0/1980219901 wait complete. 2024-09-19T08:56:52.480 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:52.478+0000 7fca97c47740 20 client.16437 trim_cache size 0 max 16384 2024-09-19T08:56:52.480 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T08:56:52.481 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T08:56:52.481 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T08:56:52.481 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T08:56:52.482 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:52.479+0000 7fca94dcf640 1 -- 172.21.15.19:0/3405308689 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fca780a32f0 msgr2=0x7fca780a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:52.482 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:52.479+0000 7fca94dcf640 1 --2- 172.21.15.19:0/3405308689 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fca780a32f0 0x7fca780a57b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fca80000c00 tx=0x7fca800046c0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.482 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:52.479+0000 7fca94dcf640 1 -- 172.21.15.19:0/3405308689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca90101c40 msgr2=0x7fca9019cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:52.482 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:52.479+0000 7fca94dcf640 1 --2- 172.21.15.19:0/3405308689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca90101c40 0x7fca9019cb80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fca84005fd0 tx=0x7fca8400dd20 comp rx=0 tx=0).stop 2024-09-19T08:56:52.482 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:52.479+0000 7fca94dcf640 1 -- 172.21.15.19:0/3405308689 shutdown_connections 2024-09-19T08:56:52.482 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:52.479+0000 7fca94dcf640 1 --2- 172.21.15.19:0/3405308689 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fca780a32f0 0x7fca780a57b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.483 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:52.479+0000 7fca94dcf640 1 --2- 172.21.15.19:0/3405308689 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fca90102600 0x7fca9019f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.483 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:52.479+0000 7fca94dcf640 1 --2- 172.21.15.19:0/3405308689 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fca90101c40 0x7fca9019cb80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.483 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:52.479+0000 7fca94dcf640 1 --2- 172.21.15.19:0/3405308689 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fca90100a50 0x7fca9006ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.483 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:52.479+0000 7fca94dcf640 1 -- 172.21.15.19:0/3405308689 >> 172.21.15.19:0/3405308689 conn(0x7fca900fc1b0 msgr2=0x7fca90104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:52.483 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:52.479+0000 7fca94dcf640 1 -- 172.21.15.19:0/3405308689 shutdown_connections 2024-09-19T08:56:52.483 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:56:52.479+0000 7fca94dcf640 1 -- 172.21.15.19:0/3405308689 wait complete. 2024-09-19T08:56:52.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.629+0000 7f3725d11640 1 -- 172.21.15.19:0/3140573890 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3720103740 msgr2=0x7f3720107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:52.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.629+0000 7f3725d11640 1 --2- 172.21.15.19:0/3140573890 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3720103740 0x7f3720107b80 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f3714009930 tx=0x7f371402a420 comp rx=0 tx=0).stop 2024-09-19T08:56:52.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.629+0000 7f3725d11640 1 -- 172.21.15.19:0/3140573890 shutdown_connections 2024-09-19T08:56:52.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.629+0000 7f3725d11640 1 --2- 172.21.15.19:0/3140573890 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3720108290 0x7f372010ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.629+0000 7f3725d11640 1 --2- 172.21.15.19:0/3140573890 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3720103740 0x7f3720107b80 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.629+0000 7f3725d11640 1 --2- 172.21.15.19:0/3140573890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3720102d90 0x7f3720103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.629+0000 7f3725d11640 1 -- 172.21.15.19:0/3140573890 >> 172.21.15.19:0/3140573890 conn(0x7f37200fc7d0 msgr2=0x7f37200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:52.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.629+0000 7f3725d11640 1 -- 172.21.15.19:0/3140573890 shutdown_connections 2024-09-19T08:56:52.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.629+0000 7f3725d11640 1 -- 172.21.15.19:0/3140573890 wait complete. 2024-09-19T08:56:52.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.630+0000 7f3725d11640 1 Processor -- start 2024-09-19T08:56:52.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.630+0000 7f3725d11640 1 -- start start 2024-09-19T08:56:52.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.630+0000 7f3725d11640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3720102d90 0x7f37201985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:52.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.630+0000 7f3725d11640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3720103740 0x7f3720198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:52.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.630+0000 7f3725d11640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3720108290 0x7f372019cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:52.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.631+0000 7f3725d11640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3720112090 con 0x7f3720102d90 2024-09-19T08:56:52.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.631+0000 7f3725d11640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3720111f10 con 0x7f3720108290 2024-09-19T08:56:52.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.631+0000 7f3725d11640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3720112210 con 0x7f3720103740 2024-09-19T08:56:52.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.631+0000 7f371f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3720102d90 0x7f37201985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:52.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.631+0000 7f371f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3720102d90 0x7f37201985d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47196/0 (socket says 172.21.15.19:47196) 2024-09-19T08:56:52.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.631+0000 7f371f7fe640 1 -- 172.21.15.19:0/1496106779 learned_addr learned my addr 172.21.15.19:0/1496106779 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:52.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.631+0000 7f371ffff640 1 --2- 172.21.15.19:0/1496106779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3720108290 0x7f372019cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:52.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.631+0000 7f371effd640 1 --2- 172.21.15.19:0/1496106779 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3720103740 0x7f3720198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:52.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.631+0000 7f371f7fe640 1 -- 172.21.15.19:0/1496106779 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3720103740 msgr2=0x7f3720198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:52.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.631+0000 7f371f7fe640 1 --2- 172.21.15.19:0/1496106779 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3720103740 0x7f3720198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.631+0000 7f371f7fe640 1 -- 172.21.15.19:0/1496106779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3720108290 msgr2=0x7f372019cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:52.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.631+0000 7f371f7fe640 1 --2- 172.21.15.19:0/1496106779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3720108290 0x7f372019cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.631+0000 7f371f7fe640 1 -- 172.21.15.19:0/1496106779 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f372019d580 con 0x7f3720102d90 2024-09-19T08:56:52.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.631+0000 7f371ffff640 1 --2- 172.21.15.19:0/1496106779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3720108290 0x7f372019cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:52.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.631+0000 7f371f7fe640 1 --2- 172.21.15.19:0/1496106779 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3720102d90 0x7f37201985d0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f371000e9f0 tx=0x7f371000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:52.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.632+0000 7f371cff9640 1 -- 172.21.15.19:0/1496106779 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371000cd80 con 0x7f3720102d90 2024-09-19T08:56:52.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.632+0000 7f3725d11640 1 -- 172.21.15.19:0/1496106779 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f372019d870 con 0x7f3720102d90 2024-09-19T08:56:52.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.632+0000 7f371cff9640 1 -- 172.21.15.19:0/1496106779 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3710010910 con 0x7f3720102d90 2024-09-19T08:56:52.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.632+0000 7f371cff9640 1 -- 172.21.15.19:0/1496106779 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37100188f0 con 0x7f3720102d90 2024-09-19T08:56:52.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.632+0000 7f3725d11640 1 -- 172.21.15.19:0/1496106779 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37201a5150 con 0x7f3720102d90 2024-09-19T08:56:52.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.634+0000 7f371cff9640 1 -- 172.21.15.19:0/1496106779 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f3710010ac0 con 0x7f3720102d90 2024-09-19T08:56:52.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.634+0000 7f37280ea740 1 Processor -- start 2024-09-19T08:56:52.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.634+0000 7f37280ea740 1 -- start start 2024-09-19T08:56:52.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.635+0000 7f37280ea740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562eb2d28b40 0x562eb2d27090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:52.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.635+0000 7f37280ea740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562eb2d275d0 0x562eb2d27a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:52.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.635+0000 7f37280ea740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562eb2d36780 0x562eb2d38b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:52.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.635+0000 7f371cff9640 1 --2- 172.21.15.19:0/1496106779 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f37080a3240 0x7f37080a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:52.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.635+0000 7f37280ea740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562eb2c8d2f0 con 0x562eb2d28b40 2024-09-19T08:56:52.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.635+0000 7f37280ea740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x562eb2c34cf0 con 0x562eb2d275d0 2024-09-19T08:56:52.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.635+0000 7f37280ea740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562eb2c892b0 con 0x562eb2d36780 2024-09-19T08:56:52.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.635+0000 7f371ffff640 1 --2- 172.21.15.19:0/1496106779 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f37080a3240 0x7f37080a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:52.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.635+0000 7f371cff9640 1 -- 172.21.15.19:0/1496106779 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f37100cfc70 con 0x7f3720102d90 2024-09-19T08:56:52.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.635+0000 7f371ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562eb2d28b40 0x562eb2d27090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:52.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.635+0000 7f371ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562eb2d28b40 0x562eb2d27090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47202/0 (socket says 172.21.15.19:47202) 2024-09-19T08:56:52.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.635+0000 7f371ffff640 1 -- 172.21.15.19:0/3638912329 learned_addr learned my addr 172.21.15.19:0/3638912329 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:52.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.635+0000 7f371effd640 1 --2- 172.21.15.19:0/3638912329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562eb2d36780 0x562eb2d38b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:52.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.635+0000 7f371f7fe640 1 --2- 172.21.15.19:0/3638912329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562eb2d275d0 0x562eb2d27a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:52.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.636+0000 7f371effd640 1 -- 172.21.15.19:0/3638912329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562eb2d275d0 msgr2=0x562eb2d27a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:52.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.636+0000 7f371effd640 1 --2- 172.21.15.19:0/3638912329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562eb2d275d0 0x562eb2d27a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.636+0000 7f371effd640 1 -- 172.21.15.19:0/3638912329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562eb2d28b40 msgr2=0x562eb2d27090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:52.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.636+0000 7f371effd640 1 --2- 172.21.15.19:0/3638912329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562eb2d28b40 0x562eb2d27090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.636+0000 7f371effd640 1 -- 172.21.15.19:0/3638912329 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562eb2c193a0 con 0x562eb2d36780 2024-09-19T08:56:52.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.636+0000 7f371ffff640 1 --2- 172.21.15.19:0/1496106779 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f37080a3240 0x7f37080a5700 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3718009fd0 tx=0x7f3718012700 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:52.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.636+0000 7f371effd640 1 --2- 172.21.15.19:0/3638912329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562eb2d36780 0x562eb2d38b70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3714009230 tx=0x7f3714005dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c7444ff98ed0bf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:52.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.636+0000 7f3705ffb640 1 -- 172.21.15.19:0/3638912329 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3714040070 con 0x562eb2d36780 2024-09-19T08:56:52.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.636+0000 7f3705ffb640 1 -- 172.21.15.19:0/3638912329 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37140318f0 con 0x562eb2d36780 2024-09-19T08:56:52.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.636+0000 7f3705ffb640 1 -- 172.21.15.19:0/3638912329 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3714035040 con 0x562eb2d36780 2024-09-19T08:56:52.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.637+0000 7f37280ea740 1 -- 172.21.15.19:0/3638912329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562eb2d36780 msgr2=0x562eb2d38b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:52.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.637+0000 7f37280ea740 1 --2- 172.21.15.19:0/3638912329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562eb2d36780 0x562eb2d38b70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3714009230 tx=0x7f3714005dd0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.637+0000 7f37280ea740 1 -- 172.21.15.19:0/3638912329 shutdown_connections 2024-09-19T08:56:52.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.637+0000 7f37280ea740 1 --2- 172.21.15.19:0/3638912329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562eb2d36780 0x562eb2d38b70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.637+0000 7f37280ea740 1 --2- 172.21.15.19:0/3638912329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562eb2d275d0 0x562eb2d27a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.637+0000 7f37280ea740 1 --2- 172.21.15.19:0/3638912329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562eb2d28b40 0x562eb2d27090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.637+0000 7f37280ea740 1 -- 172.21.15.19:0/3638912329 >> 172.21.15.19:0/3638912329 conn(0x562eb2cf0310 msgr2=0x562eb2d23c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:52.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.637+0000 7f37280ea740 1 -- 172.21.15.19:0/3638912329 shutdown_connections 2024-09-19T08:56:52.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.637+0000 7f37280ea740 1 -- 172.21.15.19:0/3638912329 wait complete. 2024-09-19T08:56:52.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.638+0000 7f37280ea740 1 -- start start 2024-09-19T08:56:52.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.638+0000 7f37280ea740 1 Processor -- start 2024-09-19T08:56:52.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.638+0000 7f37280ea740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562eb2d275d0 0x562eb2d36160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:52.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.638+0000 7f37280ea740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562eb2d28b40 0x562eb2d33410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:52.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.638+0000 7f37280ea740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562eb2d36780 0x562eb2d339e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:52.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.638+0000 7f37280ea740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562eb2d39420 con 0x562eb2d275d0 2024-09-19T08:56:52.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.638+0000 7f37280ea740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x562eb2c48060 con 0x562eb2d28b40 2024-09-19T08:56:52.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.638+0000 7f37280ea740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562eb2d395a0 con 0x562eb2d36780 2024-09-19T08:56:52.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.638+0000 7f37280ea740 10 client.0 _ll_register_callbacks cb 0x562eb299b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:52.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.638+0000 7f371f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562eb2d275d0 0x562eb2d36160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:52.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.638+0000 7f371f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562eb2d275d0 0x562eb2d36160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47208/0 (socket says 172.21.15.19:47208) 2024-09-19T08:56:52.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.638+0000 7f371f7fe640 1 -- 172.21.15.19:0/3707114888 learned_addr learned my addr 172.21.15.19:0/3707114888 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:52.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.638+0000 7f371effd640 1 --2- 172.21.15.19:0/3707114888 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562eb2d28b40 0x562eb2d33410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:52.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.639+0000 7f371ffff640 1 --2- 172.21.15.19:0/3707114888 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562eb2d36780 0x562eb2d339e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:52.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.639+0000 7f371effd640 1 -- 172.21.15.19:0/3707114888 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562eb2d36780 msgr2=0x562eb2d339e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:52.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.639+0000 7f371effd640 1 --2- 172.21.15.19:0/3707114888 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562eb2d36780 0x562eb2d339e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.639+0000 7f371effd640 1 -- 172.21.15.19:0/3707114888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562eb2d275d0 msgr2=0x562eb2d36160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:52.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.639+0000 7f371effd640 1 --2- 172.21.15.19:0/3707114888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562eb2d275d0 0x562eb2d36160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.639+0000 7f371effd640 1 -- 172.21.15.19:0/3707114888 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562eb29fe3c0 con 0x562eb2d28b40 2024-09-19T08:56:52.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.639+0000 7f371f7fe640 1 --2- 172.21.15.19:0/3707114888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562eb2d275d0 0x562eb2d36160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:52.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.639+0000 7f371effd640 1 --2- 172.21.15.19:0/3707114888 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562eb2d28b40 0x562eb2d33410 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3714009930 tx=0x7f3714009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ced2054cc16f123f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:52.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.639+0000 7f36feffd640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T08:56:52.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.639+0000 7f36feffd640 1 -- 172.21.15.19:0/3707114888 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371404c070 con 0x562eb2d28b40 2024-09-19T08:56:52.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.639+0000 7f37280ea740 1 -- 172.21.15.19:0/3707114888 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37140318f0 con 0x562eb2d28b40 2024-09-19T08:56:52.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.639+0000 7f36feffd640 1 -- 172.21.15.19:0/3707114888 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f3714004240 con 0x562eb2d28b40 2024-09-19T08:56:52.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.640+0000 7f36feffd640 1 -- 172.21.15.19:0/3707114888 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f3714058050 con 0x562eb2d28b40 2024-09-19T08:56:52.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.640+0000 7f37280ea740 10 client.25985 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:52.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.640+0000 7f37280ea740 1 -- 172.21.15.19:0/3707114888 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x562eb2d44ea0 con 0x562eb2d28b40 2024-09-19T08:56:52.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.640+0000 7f36feffd640 1 -- 172.21.15.19:0/3707114888 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f37140318f0 con 0x562eb2d28b40 2024-09-19T08:56:52.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.640+0000 7f36feffd640 1 -- 172.21.15.19:0/3707114888 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f37140035f0 con 0x562eb2d28b40 2024-09-19T08:56:52.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.640+0000 7f37280ea740 10 client.25985 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:52.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.640+0000 7f37280ea740 10 client.25985 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T08:56:52.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.640+0000 7f37280ea740 20 client.25985 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:52.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.640+0000 7f37280ea740 1 --2- 172.21.15.19:0/3707114888 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x562eb2d461f0 0x562eb2d485e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:52.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.640+0000 7f37280ea740 4 client.25985 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:56:52.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.640+0000 7f37280ea740 1 -- 172.21.15.19:0/3707114888 --> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562eb2c9a860 con 0x562eb2d461f0 2024-09-19T08:56:52.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.641+0000 7f371f7fe640 1 --2- 172.21.15.19:0/3707114888 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x562eb2d461f0 0x562eb2d485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:52.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.641+0000 7f371f7fe640 1 --2- 172.21.15.19:0/3707114888 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x562eb2d461f0 0x562eb2d485e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c738e42c3337d58f server_cookie=6b942f63ed185a8 in_seq=0 out_seq=0 2024-09-19T08:56:52.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.641+0000 7f36feffd640 10 client.25985 ms_handle_connect on v2:172.21.15.203:6836/3684671619 2024-09-19T08:56:52.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.642+0000 7f36feffd640 1 -- 172.21.15.19:0/3707114888 <== mds.2 v2:172.21.15.203:6836/3684671619 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562eb2c9a860 con 0x562eb2d461f0 2024-09-19T08:56:52.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.642+0000 7f36feffd640 10 client.25985 handle_command_reply: tid=0 2024-09-19T08:56:52.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.642+0000 7f37280ea740 1 client.25985 shutdown 2024-09-19T08:56:52.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.642+0000 7f37280ea740 1 -- 172.21.15.19:0/3707114888 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562eb2d28b40 msgr2=0x562eb2d33410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:52.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.642+0000 7f37280ea740 1 --2- 172.21.15.19:0/3707114888 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562eb2d28b40 0x562eb2d33410 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3714009930 tx=0x7f3714009260 comp rx=0 tx=0).stop 2024-09-19T08:56:52.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.642+0000 7f37280ea740 1 -- 172.21.15.19:0/3707114888 shutdown_connections 2024-09-19T08:56:52.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.642+0000 7f37280ea740 1 --2- 172.21.15.19:0/3707114888 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x562eb2d461f0 0x562eb2d485e0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.642+0000 7f37280ea740 1 --2- 172.21.15.19:0/3707114888 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562eb2d36780 0x562eb2d339e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.642+0000 7f37280ea740 1 --2- 172.21.15.19:0/3707114888 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562eb2d28b40 0x562eb2d33410 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.642+0000 7f37280ea740 1 --2- 172.21.15.19:0/3707114888 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562eb2d275d0 0x562eb2d36160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.642+0000 7f37280ea740 1 -- 172.21.15.19:0/3707114888 >> 172.21.15.19:0/3707114888 conn(0x562eb2cf0310 msgr2=0x562eb2d29960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:52.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.642+0000 7f36feffd640 0 client.25985 ms_handle_reset on v2:172.21.15.203:6836/3684671619 2024-09-19T08:56:52.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.642+0000 7f37280ea740 1 -- 172.21.15.19:0/3707114888 shutdown_connections 2024-09-19T08:56:52.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.642+0000 7f37280ea740 1 -- 172.21.15.19:0/3707114888 wait complete. 2024-09-19T08:56:52.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.642+0000 7f37280ea740 20 client.25985 trim_cache size 0 max 16384 2024-09-19T08:56:52.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.656+0000 7f37280ea740 1 Processor -- start 2024-09-19T08:56:52.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.657+0000 7f37280ea740 1 -- start start 2024-09-19T08:56:52.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.657+0000 7f37280ea740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562eb2d275d0 0x562eb2d306d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:52.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.657+0000 7f37280ea740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562eb2d28b40 0x562eb2d30c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:52.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.657+0000 7f37280ea740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562eb2d36780 0x562eb2d29110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:52.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.657+0000 7f37280ea740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f37201ab440 con 0x562eb2d36780 2024-09-19T08:56:52.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.657+0000 7f37280ea740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f37201acfb0 con 0x562eb2d275d0 2024-09-19T08:56:52.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.657+0000 7f37280ea740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f37201abb10 con 0x562eb2d28b40 2024-09-19T08:56:52.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.657+0000 7f371f7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562eb2d275d0 0x562eb2d306d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:52.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.657+0000 7f371ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562eb2d36780 0x562eb2d29110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:52.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.657+0000 7f371f7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562eb2d275d0 0x562eb2d306d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:39690/0 (socket says 172.21.15.19:39690) 2024-09-19T08:56:52.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.657+0000 7f371ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562eb2d36780 0x562eb2d29110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47222/0 (socket says 172.21.15.19:47222) 2024-09-19T08:56:52.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.657+0000 7f371f7fe640 1 -- 172.21.15.19:0/106485073 learned_addr learned my addr 172.21.15.19:0/106485073 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:52.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.657+0000 7f371effd640 1 --2- 172.21.15.19:0/106485073 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562eb2d28b40 0x562eb2d30c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:52.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.657+0000 7f371f7fe640 1 -- 172.21.15.19:0/106485073 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562eb2d28b40 msgr2=0x562eb2d30c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:52.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.657+0000 7f371f7fe640 1 --2- 172.21.15.19:0/106485073 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562eb2d28b40 0x562eb2d30c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.657+0000 7f371f7fe640 1 -- 172.21.15.19:0/106485073 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562eb2d36780 msgr2=0x562eb2d29110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:52.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.657+0000 7f371f7fe640 1 --2- 172.21.15.19:0/106485073 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562eb2d36780 0x562eb2d29110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.657+0000 7f371f7fe640 1 -- 172.21.15.19:0/106485073 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562eb2d24960 con 0x562eb2d275d0 2024-09-19T08:56:52.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.658+0000 7f371effd640 1 --2- 172.21.15.19:0/106485073 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562eb2d28b40 0x562eb2d30c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:56:52.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.658+0000 7f371f7fe640 1 --2- 172.21.15.19:0/106485073 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562eb2d275d0 0x562eb2d306d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f371009c050 tx=0x7f37100cd650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7891d5a37ab9bb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:52.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.658+0000 7f37057fa640 1 -- 172.21.15.19:0/106485073 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37100a4f10 con 0x562eb2d275d0 2024-09-19T08:56:52.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.658+0000 7f37057fa640 1 -- 172.21.15.19:0/106485073 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f371009a3f0 con 0x562eb2d275d0 2024-09-19T08:56:52.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.658+0000 7f37057fa640 1 -- 172.21.15.19:0/106485073 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371009b7a0 con 0x562eb2d275d0 2024-09-19T08:56:52.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.659+0000 7f37280ea740 1 -- 172.21.15.19:0/106485073 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562eb2d275d0 msgr2=0x562eb2d306d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:52.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.659+0000 7f37280ea740 1 --2- 172.21.15.19:0/106485073 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562eb2d275d0 0x562eb2d306d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f371009c050 tx=0x7f37100cd650 comp rx=0 tx=0).stop 2024-09-19T08:56:52.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.659+0000 7f37280ea740 1 -- 172.21.15.19:0/106485073 shutdown_connections 2024-09-19T08:56:52.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.659+0000 7f37280ea740 1 --2- 172.21.15.19:0/106485073 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562eb2d28b40 0x562eb2d30c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.659+0000 7f37280ea740 1 --2- 172.21.15.19:0/106485073 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562eb2d36780 0x562eb2d29110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.659+0000 7f37280ea740 1 --2- 172.21.15.19:0/106485073 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562eb2d275d0 0x562eb2d306d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.659+0000 7f37280ea740 1 -- 172.21.15.19:0/106485073 >> 172.21.15.19:0/106485073 conn(0x562eb2cf0310 msgr2=0x562eb2d35490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:52.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.659+0000 7f37280ea740 1 -- 172.21.15.19:0/106485073 shutdown_connections 2024-09-19T08:56:52.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.659+0000 7f37280ea740 1 -- 172.21.15.19:0/106485073 wait complete. 2024-09-19T08:56:52.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.660+0000 7f37280ea740 1 -- start start 2024-09-19T08:56:52.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.660+0000 7f37280ea740 1 Processor -- start 2024-09-19T08:56:52.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.660+0000 7f37280ea740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562eb2d275d0 0x562eb2d2c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:52.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.660+0000 7f37280ea740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562eb2d28b40 0x562eb2d2cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:52.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.660+0000 7f37280ea740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562eb2d36780 0x562eb2d2d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:52.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.660+0000 7f37280ea740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f37201ac8e0 con 0x562eb2d36780 2024-09-19T08:56:52.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.661+0000 7f37280ea740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f37201ac210 con 0x562eb2d28b40 2024-09-19T08:56:52.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.661+0000 7f37280ea740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f37201a9420 con 0x562eb2d275d0 2024-09-19T08:56:52.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.661+0000 7f37280ea740 10 client.0 _ll_register_callbacks cb 0x7f37180125d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:52.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.661+0000 7f371ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562eb2d36780 0x562eb2d2d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:52.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.661+0000 7f371ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562eb2d36780 0x562eb2d2d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47232/0 (socket says 172.21.15.19:47232) 2024-09-19T08:56:52.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.661+0000 7f371ffff640 1 -- 172.21.15.19:0/199026078 learned_addr learned my addr 172.21.15.19:0/199026078 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:52.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.661+0000 7f371effd640 1 --2- 172.21.15.19:0/199026078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562eb2d28b40 0x562eb2d2cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:52.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.661+0000 7f371f7fe640 1 --2- 172.21.15.19:0/199026078 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562eb2d275d0 0x562eb2d2c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:52.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.661+0000 7f371effd640 1 -- 172.21.15.19:0/199026078 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562eb2d275d0 msgr2=0x562eb2d2c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:52.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.661+0000 7f371effd640 1 --2- 172.21.15.19:0/199026078 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562eb2d275d0 0x562eb2d2c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.661+0000 7f371effd640 1 -- 172.21.15.19:0/199026078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562eb2d36780 msgr2=0x562eb2d2d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:52.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.661+0000 7f371effd640 1 --2- 172.21.15.19:0/199026078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562eb2d36780 0x562eb2d2d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.661+0000 7f371effd640 1 -- 172.21.15.19:0/199026078 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562eb2d4a360 con 0x562eb2d28b40 2024-09-19T08:56:52.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.661+0000 7f371effd640 1 --2- 172.21.15.19:0/199026078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562eb2d28b40 0x562eb2d2cd00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x562eb2cd2610 tx=0x7f3714003820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23cd932e0bbdbd52 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:52.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.661+0000 7f36feffd640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T08:56:52.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.661+0000 7f36feffd640 1 -- 172.21.15.19:0/199026078 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371404c040 con 0x562eb2d28b40 2024-09-19T08:56:52.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.662+0000 7f36feffd640 1 -- 172.21.15.19:0/199026078 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f37140316f0 con 0x562eb2d28b40 2024-09-19T08:56:52.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.662+0000 7f37280ea740 1 -- 172.21.15.19:0/199026078 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f371009a3f0 con 0x562eb2d28b40 2024-09-19T08:56:52.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.662+0000 7f36feffd640 1 -- 172.21.15.19:0/199026078 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f3714040050 con 0x562eb2d28b40 2024-09-19T08:56:52.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.662+0000 7f37280ea740 10 client.25991 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:52.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.662+0000 7f37280ea740 1 -- 172.21.15.19:0/199026078 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x562eb2d4b5d0 con 0x562eb2d28b40 2024-09-19T08:56:52.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.662+0000 7f36feffd640 1 -- 172.21.15.19:0/199026078 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3714003d70 con 0x562eb2d28b40 2024-09-19T08:56:52.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.662+0000 7f36feffd640 1 -- 172.21.15.19:0/199026078 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f3714004900 con 0x562eb2d28b40 2024-09-19T08:56:52.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.662+0000 7f37280ea740 10 client.25991 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:52.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.662+0000 7f37280ea740 10 client.25991 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T08:56:52.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.662+0000 7f37280ea740 20 client.25991 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:52.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.662+0000 7f37280ea740 1 --2- 172.21.15.19:0/199026078 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x562eb2db5310 0x562eb2db7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:52.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.662+0000 7f37280ea740 4 client.25991 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:56:52.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.662+0000 7f37280ea740 1 -- 172.21.15.19:0/199026078 --> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f371009a3f0 con 0x562eb2db5310 2024-09-19T08:56:52.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.663+0000 7f371f7fe640 1 --2- 172.21.15.19:0/199026078 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x562eb2db5310 0x562eb2db7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:52.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.663+0000 7f36feffd640 10 client.25991 ms_handle_connect on v2:172.21.15.203:6836/3684671619 2024-09-19T08:56:52.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.663+0000 7f371f7fe640 1 --2- 172.21.15.19:0/199026078 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x562eb2db5310 0x562eb2db7700 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8c95f2ee5eaaa031 server_cookie=ff517915fe871a63 in_seq=0 out_seq=0 2024-09-19T08:56:52.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.663+0000 7f36feffd640 1 -- 172.21.15.19:0/199026078 <== mds.2 v2:172.21.15.203:6836/3684671619 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f371009a3f0 con 0x562eb2db5310 2024-09-19T08:56:52.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.663+0000 7f36feffd640 10 client.25991 handle_command_reply: tid=0 2024-09-19T08:56:52.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.663+0000 7f37280ea740 1 client.25991 shutdown 2024-09-19T08:56:52.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.664+0000 7f37280ea740 1 -- 172.21.15.19:0/199026078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562eb2d28b40 msgr2=0x562eb2d2cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:52.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.664+0000 7f37280ea740 1 --2- 172.21.15.19:0/199026078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562eb2d28b40 0x562eb2d2cd00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x562eb2cd2610 tx=0x7f3714003820 comp rx=0 tx=0).stop 2024-09-19T08:56:52.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.664+0000 7f37280ea740 1 -- 172.21.15.19:0/199026078 shutdown_connections 2024-09-19T08:56:52.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.664+0000 7f37280ea740 1 --2- 172.21.15.19:0/199026078 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x562eb2db5310 0x562eb2db7700 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.664+0000 7f37280ea740 1 --2- 172.21.15.19:0/199026078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562eb2d36780 0x562eb2d2d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.664+0000 7f37280ea740 1 --2- 172.21.15.19:0/199026078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562eb2d28b40 0x562eb2d2cd00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.664+0000 7f36feffd640 0 client.25991 ms_handle_reset on v2:172.21.15.203:6836/3684671619 2024-09-19T08:56:52.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.664+0000 7f37280ea740 1 --2- 172.21.15.19:0/199026078 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562eb2d275d0 0x562eb2d2c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.664+0000 7f37280ea740 1 -- 172.21.15.19:0/199026078 >> 172.21.15.19:0/199026078 conn(0x562eb2cf0310 msgr2=0x562eb2d31bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:52.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.664+0000 7f37280ea740 1 -- 172.21.15.19:0/199026078 shutdown_connections 2024-09-19T08:56:52.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.664+0000 7f37280ea740 1 -- 172.21.15.19:0/199026078 wait complete. 2024-09-19T08:56:52.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.664+0000 7f37280ea740 20 client.25991 trim_cache size 0 max 16384 2024-09-19T08:56:52.669 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T08:56:52.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.665+0000 7f3725d11640 1 -- 172.21.15.19:0/1496106779 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f37080a3240 msgr2=0x7f37080a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:52.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.665+0000 7f3725d11640 1 --2- 172.21.15.19:0/1496106779 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f37080a3240 0x7f37080a5700 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3718009fd0 tx=0x7f3718012700 comp rx=0 tx=0).stop 2024-09-19T08:56:52.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.665+0000 7f3725d11640 1 -- 172.21.15.19:0/1496106779 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3720102d90 msgr2=0x7f37201985d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:52.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.665+0000 7f3725d11640 1 --2- 172.21.15.19:0/1496106779 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3720102d90 0x7f37201985d0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f371000e9f0 tx=0x7f371000eeb0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.665+0000 7f3725d11640 1 -- 172.21.15.19:0/1496106779 shutdown_connections 2024-09-19T08:56:52.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.665+0000 7f3725d11640 1 --2- 172.21.15.19:0/1496106779 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f37080a3240 0x7f37080a5700 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.665+0000 7f3725d11640 1 --2- 172.21.15.19:0/1496106779 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3720103740 0x7f3720198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.665+0000 7f3725d11640 1 --2- 172.21.15.19:0/1496106779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3720108290 0x7f372019cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.665+0000 7f3725d11640 1 --2- 172.21.15.19:0/1496106779 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3720102d90 0x7f37201985d0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:52.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.665+0000 7f3725d11640 1 -- 172.21.15.19:0/1496106779 >> 172.21.15.19:0/1496106779 conn(0x7f37200fc7d0 msgr2=0x7f3720105e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:52.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.665+0000 7f3725d11640 1 -- 172.21.15.19:0/1496106779 shutdown_connections 2024-09-19T08:56:52.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:52.665+0000 7f3725d11640 1 -- 172.21.15.19:0/1496106779 wait complete. 2024-09-19T08:56:53.513 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T08:56:53.538 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:53 smithi019 ceph-mon[30976]: pgmap v477: 97 pgs: 97 active+clean; 27 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 642 op/s 2024-09-19T08:56:53.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:53 smithi155 ceph-mon[34921]: pgmap v477: 97 pgs: 97 active+clean; 27 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 642 op/s 2024-09-19T08:56:53.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:53 smithi203 ceph-mon[35450]: pgmap v477: 97 pgs: 97 active+clean; 27 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 642 op/s 2024-09-19T08:56:53.780 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:54.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.918+0000 7fb582d3a640 1 -- 172.21.15.19:0/1727998449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb57c103670 msgr2=0x7fb57c10bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:54.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.918+0000 7fb582d3a640 1 --2- 172.21.15.19:0/1727998449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb57c103670 0x7fb57c10bb60 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fb568009900 tx=0x7fb56802a480 comp rx=0 tx=0).stop 2024-09-19T08:56:54.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.918+0000 7fb582d3a640 1 -- 172.21.15.19:0/1727998449 shutdown_connections 2024-09-19T08:56:54.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.918+0000 7fb582d3a640 1 --2- 172.21.15.19:0/1727998449 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb57c10c180 0x7fb57c10e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.918+0000 7fb582d3a640 1 --2- 172.21.15.19:0/1727998449 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb57c103670 0x7fb57c10bb60 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.918+0000 7fb582d3a640 1 --2- 172.21.15.19:0/1727998449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb57c102d50 0x7fb57c103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.918+0000 7fb582d3a640 1 -- 172.21.15.19:0/1727998449 >> 172.21.15.19:0/1727998449 conn(0x7fb57c0fc7d0 msgr2=0x7fb57c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:54.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.918+0000 7fb582d3a640 1 -- 172.21.15.19:0/1727998449 shutdown_connections 2024-09-19T08:56:54.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.918+0000 7fb582d3a640 1 -- 172.21.15.19:0/1727998449 wait complete. 2024-09-19T08:56:54.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.919+0000 7fb582d3a640 1 Processor -- start 2024-09-19T08:56:54.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.919+0000 7fb582d3a640 1 -- start start 2024-09-19T08:56:54.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.919+0000 7fb582d3a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb57c102d50 0x7fb57c1984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:54.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.919+0000 7fb582d3a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb57c103670 0x7fb57c198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:54.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.919+0000 7fb582d3a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb57c10c180 0x7fb57c19cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:54.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.919+0000 7fb582d3a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb57c111f80 con 0x7fb57c103670 2024-09-19T08:56:54.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.919+0000 7fb582d3a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb57c111e00 con 0x7fb57c10c180 2024-09-19T08:56:54.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.919+0000 7fb582d3a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb57c112100 con 0x7fb57c102d50 2024-09-19T08:56:54.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.919+0000 7fb57bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb57c103670 0x7fb57c198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:54.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.919+0000 7fb5812d7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb57c10c180 0x7fb57c19cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:54.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.919+0000 7fb580ad6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb57c102d50 0x7fb57c1984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:54.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.919+0000 7fb580ad6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb57c102d50 0x7fb57c1984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:55248/0 (socket says 172.21.15.19:55248) 2024-09-19T08:56:54.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.919+0000 7fb580ad6640 1 -- 172.21.15.19:0/2691032111 learned_addr learned my addr 172.21.15.19:0/2691032111 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:54.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.919+0000 7fb5812d7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb57c10c180 0x7fb57c19cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:39708/0 (socket says 172.21.15.19:39708) 2024-09-19T08:56:54.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.920+0000 7fb5812d7640 1 -- 172.21.15.19:0/2691032111 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb57c102d50 msgr2=0x7fb57c1984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:54.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.920+0000 7fb5812d7640 1 --2- 172.21.15.19:0/2691032111 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb57c102d50 0x7fb57c1984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.920+0000 7fb5812d7640 1 -- 172.21.15.19:0/2691032111 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb57c103670 msgr2=0x7fb57c198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:54.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.920+0000 7fb5812d7640 1 --2- 172.21.15.19:0/2691032111 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb57c103670 0x7fb57c198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.920+0000 7fb5812d7640 1 -- 172.21.15.19:0/2691032111 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb57c19d490 con 0x7fb57c10c180 2024-09-19T08:56:54.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.920+0000 7fb57bfff640 1 --2- 172.21.15.19:0/2691032111 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb57c103670 0x7fb57c198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:54.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.920+0000 7fb580ad6640 1 --2- 172.21.15.19:0/2691032111 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb57c102d50 0x7fb57c1984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:54.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.920+0000 7fb5812d7640 1 --2- 172.21.15.19:0/2691032111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb57c10c180 0x7fb57c19cdb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb574009fd0 tx=0x7fb57400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:54.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.920+0000 7fb579ffb640 1 -- 172.21.15.19:0/2691032111 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb57400ce20 con 0x7fb57c10c180 2024-09-19T08:56:54.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.920+0000 7fb579ffb640 1 -- 172.21.15.19:0/2691032111 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb574005020 con 0x7fb57c10c180 2024-09-19T08:56:54.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.920+0000 7fb582d3a640 1 -- 172.21.15.19:0/2691032111 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb57c19d780 con 0x7fb57c10c180 2024-09-19T08:56:54.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.920+0000 7fb579ffb640 1 -- 172.21.15.19:0/2691032111 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb574010720 con 0x7fb57c10c180 2024-09-19T08:56:54.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.921+0000 7fb582d3a640 1 -- 172.21.15.19:0/2691032111 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb57c1a5060 con 0x7fb57c10c180 2024-09-19T08:56:54.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.924+0000 7fb579ffb640 1 -- 172.21.15.19:0/2691032111 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fb574005540 con 0x7fb57c10c180 2024-09-19T08:56:54.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.924+0000 7fb585113740 1 Processor -- start 2024-09-19T08:56:54.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.924+0000 7fb585113740 1 -- start start 2024-09-19T08:56:54.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.924+0000 7fb585113740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f644cd4b40 0x55f644cd3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:54.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.924+0000 7fb585113740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f644cd35d0 0x55f644cd3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:54.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.924+0000 7fb585113740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f644cde370 0x55f644ce0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:54.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.924+0000 7fb585113740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f644c392f0 con 0x55f644cd35d0 2024-09-19T08:56:54.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.924+0000 7fb585113740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f644be0cf0 con 0x55f644cde370 2024-09-19T08:56:54.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.924+0000 7fb585113740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f644c352b0 con 0x55f644cd4b40 2024-09-19T08:56:54.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.925+0000 7fb579ffb640 1 --2- 172.21.15.19:0/2691032111 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb56c0a32c0 0x7fb56c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:54.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.925+0000 7fb57bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f644cde370 0x55f644ce0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:54.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.925+0000 7fb580ad6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f644cd35d0 0x55f644cd3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:54.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.925+0000 7fb580ad6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f644cd35d0 0x55f644cd3a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47266/0 (socket says 172.21.15.19:47266) 2024-09-19T08:56:54.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.925+0000 7fb580ad6640 1 -- 172.21.15.19:0/1011429599 learned_addr learned my addr 172.21.15.19:0/1011429599 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:54.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.925+0000 7fb579ffb640 1 -- 172.21.15.19:0/2691032111 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb5740cfec0 con 0x7fb57c10c180 2024-09-19T08:56:54.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.925+0000 7fb57bfff640 1 --2- 172.21.15.19:0/1011429599 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f644cd4b40 0x55f644cd3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:54.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.925+0000 7fb5812d7640 1 --2- 172.21.15.19:0/2691032111 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb56c0a32c0 0x7fb56c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:54.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.925+0000 7fb580ad6640 1 -- 172.21.15.19:0/1011429599 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f644cd4b40 msgr2=0x55f644cd3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:54.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.925+0000 7fb580ad6640 1 --2- 172.21.15.19:0/1011429599 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f644cd4b40 0x55f644cd3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.925+0000 7fb580ad6640 1 -- 172.21.15.19:0/1011429599 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f644cde370 msgr2=0x55f644ce0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:54.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.925+0000 7fb580ad6640 1 --2- 172.21.15.19:0/1011429599 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f644cde370 0x55f644ce0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.925+0000 7fb580ad6640 1 -- 172.21.15.19:0/1011429599 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f644bc53a0 con 0x55f644cd35d0 2024-09-19T08:56:54.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.925+0000 7fb5812d7640 1 --2- 172.21.15.19:0/2691032111 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb56c0a32c0 0x7fb56c0a5780 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb574005ba0 tx=0x7fb574005f70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:54.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.925+0000 7fb580ad6640 1 --2- 172.21.15.19:0/1011429599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f644cd35d0 0x55f644cd3a10 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fb570011630 tx=0x7fb570011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76515968d44654f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:54.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.926+0000 7fb566ffd640 1 -- 172.21.15.19:0/1011429599 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb57001e070 con 0x55f644cd35d0 2024-09-19T08:56:54.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.926+0000 7fb566ffd640 1 -- 172.21.15.19:0/1011429599 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb57000fb50 con 0x55f644cd35d0 2024-09-19T08:56:54.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.926+0000 7fb566ffd640 1 -- 172.21.15.19:0/1011429599 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb570019c80 con 0x55f644cd35d0 2024-09-19T08:56:54.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.926+0000 7fb585113740 1 -- 172.21.15.19:0/1011429599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f644cd35d0 msgr2=0x55f644cd3a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:54.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.926+0000 7fb585113740 1 --2- 172.21.15.19:0/1011429599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f644cd35d0 0x55f644cd3a10 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fb570011630 tx=0x7fb570011af0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.927+0000 7fb585113740 1 -- 172.21.15.19:0/1011429599 shutdown_connections 2024-09-19T08:56:54.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.927+0000 7fb585113740 1 --2- 172.21.15.19:0/1011429599 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f644cde370 0x55f644ce0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.927+0000 7fb585113740 1 --2- 172.21.15.19:0/1011429599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f644cd35d0 0x55f644cd3a10 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.927+0000 7fb585113740 1 --2- 172.21.15.19:0/1011429599 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f644cd4b40 0x55f644cd3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.927+0000 7fb585113740 1 -- 172.21.15.19:0/1011429599 >> 172.21.15.19:0/1011429599 conn(0x55f644c9c310 msgr2=0x55f644ccfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:54.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.927+0000 7fb585113740 1 -- 172.21.15.19:0/1011429599 shutdown_connections 2024-09-19T08:56:54.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.927+0000 7fb585113740 1 -- 172.21.15.19:0/1011429599 wait complete. 2024-09-19T08:56:54.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.927+0000 7fb585113740 1 -- start start 2024-09-19T08:56:54.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.927+0000 7fb585113740 1 Processor -- start 2024-09-19T08:56:54.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.927+0000 7fb585113740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f644cd35d0 0x55f644cddb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:54.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.927+0000 7fb585113740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f644cd4b40 0x55f644cdb030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:54.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.927+0000 7fb585113740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f644cde370 0x55f644cdb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:54.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.927+0000 7fb585113740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f644ce1070 con 0x55f644cd35d0 2024-09-19T08:56:54.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.928+0000 7fb585113740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f644bf4060 con 0x55f644cd4b40 2024-09-19T08:56:54.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.928+0000 7fb585113740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f644ce11f0 con 0x55f644cde370 2024-09-19T08:56:54.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.928+0000 7fb585113740 10 client.0 _ll_register_callbacks cb 0x55f6449478c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:54.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.928+0000 7fb57bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f644cd35d0 0x55f644cddb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:54.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.928+0000 7fb57bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f644cd35d0 0x55f644cddb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47278/0 (socket says 172.21.15.19:47278) 2024-09-19T08:56:54.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.928+0000 7fb57bfff640 1 -- 172.21.15.19:0/3945758096 learned_addr learned my addr 172.21.15.19:0/3945758096 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:54.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.928+0000 7fb580ad6640 1 --2- 172.21.15.19:0/3945758096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f644cd4b40 0x55f644cdb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:54.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.928+0000 7fb57bfff640 1 --2- 172.21.15.19:0/3945758096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f644cde370 0x55f644cdb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:54.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.928+0000 7fb57bfff640 1 -- 172.21.15.19:0/3945758096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f644cde370 msgr2=0x55f644cdb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:54.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.928+0000 7fb57bfff640 1 --2- 172.21.15.19:0/3945758096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f644cde370 0x55f644cdb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.928+0000 7fb57bfff640 1 -- 172.21.15.19:0/3945758096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f644cd4b40 msgr2=0x55f644cdb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:54.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.928+0000 7fb57bfff640 1 --2- 172.21.15.19:0/3945758096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f644cd4b40 0x55f644cdb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.928+0000 7fb57bfff640 1 -- 172.21.15.19:0/3945758096 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f6449aa3c0 con 0x55f644cd35d0 2024-09-19T08:56:54.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.928+0000 7fb580ad6640 1 --2- 172.21.15.19:0/3945758096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f644cd4b40 0x55f644cdb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:56:54.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.928+0000 7fb57bfff640 1 --2- 172.21.15.19:0/3945758096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f644cd35d0 0x55f644cddb10 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fb56802a9a0 tx=0x7fb568041040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e5326d010e7b398 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:54.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.928+0000 7fb55bfff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:56:54.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.928+0000 7fb55bfff640 1 -- 172.21.15.19:0/3945758096 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb568035040 con 0x55f644cd35d0 2024-09-19T08:56:54.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.928+0000 7fb585113740 1 -- 172.21.15.19:0/3945758096 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb57000fb50 con 0x55f644cd35d0 2024-09-19T08:56:54.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.928+0000 7fb55bfff640 1 -- 172.21.15.19:0/3945758096 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb568005020 con 0x55f644cd35d0 2024-09-19T08:56:54.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.929+0000 7fb55bfff640 1 -- 172.21.15.19:0/3945758096 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb568054050 con 0x55f644cd35d0 2024-09-19T08:56:54.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.929+0000 7fb585113740 10 client.16485 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:54.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.929+0000 7fb585113740 1 -- 172.21.15.19:0/3945758096 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55f644cf53a0 con 0x55f644cd35d0 2024-09-19T08:56:54.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.929+0000 7fb55bfff640 1 -- 172.21.15.19:0/3945758096 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb57000fb50 con 0x55f644cd35d0 2024-09-19T08:56:54.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.929+0000 7fb55bfff640 1 -- 172.21.15.19:0/3945758096 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7fb568004cf0 con 0x55f644cd35d0 2024-09-19T08:56:54.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.929+0000 7fb585113740 10 client.16485 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:54.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.929+0000 7fb585113740 10 client.16485 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:56:54.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.929+0000 7fb585113740 20 client.16485 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:54.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.929+0000 7fb585113740 1 --2- 172.21.15.19:0/3945758096 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55f644cf6c40 0x55f644cf9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:54.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.929+0000 7fb585113740 4 client.16485 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:56:54.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.929+0000 7fb585113740 1 -- 172.21.15.19:0/3945758096 --> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f644c46860 con 0x55f644cf6c40 2024-09-19T08:56:54.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.929+0000 7fb580ad6640 1 --2- 172.21.15.19:0/3945758096 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55f644cf6c40 0x55f644cf9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:54.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.930+0000 7fb580ad6640 1 --2- 172.21.15.19:0/3945758096 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55f644cf6c40 0x55f644cf9100 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=48485141e67d93d2 server_cookie=f43db3e6ace8c0cb in_seq=0 out_seq=0 2024-09-19T08:56:54.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.930+0000 7fb55bfff640 10 client.16485 ms_handle_connect on v2:172.21.15.203:6838/2547507299 2024-09-19T08:56:54.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.931+0000 7fb55bfff640 1 -- 172.21.15.19:0/3945758096 <== mds.1 v2:172.21.15.203:6838/2547507299 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f644c46860 con 0x55f644cf6c40 2024-09-19T08:56:54.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.931+0000 7fb55bfff640 10 client.16485 handle_command_reply: tid=0 2024-09-19T08:56:54.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.931+0000 7fb585113740 1 client.16485 shutdown 2024-09-19T08:56:54.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.931+0000 7fb585113740 1 -- 172.21.15.19:0/3945758096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f644cd35d0 msgr2=0x55f644cddb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:54.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.931+0000 7fb585113740 1 --2- 172.21.15.19:0/3945758096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f644cd35d0 0x55f644cddb10 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fb56802a9a0 tx=0x7fb568041040 comp rx=0 tx=0).stop 2024-09-19T08:56:54.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.931+0000 7fb585113740 1 -- 172.21.15.19:0/3945758096 shutdown_connections 2024-09-19T08:56:54.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.931+0000 7fb585113740 1 --2- 172.21.15.19:0/3945758096 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55f644cf6c40 0x55f644cf9100 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.931+0000 7fb585113740 1 --2- 172.21.15.19:0/3945758096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f644cde370 0x55f644cdb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.931+0000 7fb585113740 1 --2- 172.21.15.19:0/3945758096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f644cd4b40 0x55f644cdb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.931+0000 7fb55bfff640 0 client.16485 ms_handle_reset on v2:172.21.15.203:6838/2547507299 2024-09-19T08:56:54.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.931+0000 7fb585113740 1 --2- 172.21.15.19:0/3945758096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f644cd35d0 0x55f644cddb10 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.931+0000 7fb585113740 1 -- 172.21.15.19:0/3945758096 >> 172.21.15.19:0/3945758096 conn(0x55f644c9c310 msgr2=0x55f644cd5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:54.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.931+0000 7fb585113740 1 -- 172.21.15.19:0/3945758096 shutdown_connections 2024-09-19T08:56:54.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.931+0000 7fb585113740 1 -- 172.21.15.19:0/3945758096 wait complete. 2024-09-19T08:56:54.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.931+0000 7fb585113740 20 client.16485 trim_cache size 0 max 16384 2024-09-19T08:56:54.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.945+0000 7fb585113740 1 Processor -- start 2024-09-19T08:56:54.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.945+0000 7fb585113740 1 -- start start 2024-09-19T08:56:54.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.945+0000 7fb585113740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f644cd4b40 0x55f644ce3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:54.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.945+0000 7fb585113740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f644cde370 0x55f644cd6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:54.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.945+0000 7fb585113740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f644cd6660 0x55f644cfea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:54.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.945+0000 7fb585113740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb57c1ab260 con 0x55f644cd6660 2024-09-19T08:56:54.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.945+0000 7fb585113740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb57c1acdd0 con 0x55f644cd4b40 2024-09-19T08:56:54.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.945+0000 7fb585113740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb57c1ab930 con 0x55f644cde370 2024-09-19T08:56:54.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.945+0000 7fb57bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f644cd6660 0x55f644cfea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:54.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.945+0000 7fb57bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f644cd6660 0x55f644cfea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47286/0 (socket says 172.21.15.19:47286) 2024-09-19T08:56:54.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.945+0000 7fb57bfff640 1 -- 172.21.15.19:0/3979859165 learned_addr learned my addr 172.21.15.19:0/3979859165 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:54.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.945+0000 7fb57bfff640 1 --2- 172.21.15.19:0/3979859165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f644cd4b40 0x55f644ce3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:54.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.945+0000 7fb580ad6640 1 --2- 172.21.15.19:0/3979859165 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f644cde370 0x55f644cd6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:54.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.945+0000 7fb57bfff640 1 -- 172.21.15.19:0/3979859165 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f644cde370 msgr2=0x55f644cd6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:54.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.945+0000 7fb57bfff640 1 --2- 172.21.15.19:0/3979859165 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f644cde370 0x55f644cd6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.945+0000 7fb57bfff640 1 -- 172.21.15.19:0/3979859165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f644cd4b40 msgr2=0x55f644ce3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:54.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.945+0000 7fb57bfff640 1 --2- 172.21.15.19:0/3979859165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f644cd4b40 0x55f644ce3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.946+0000 7fb57bfff640 1 -- 172.21.15.19:0/3979859165 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f644ccf320 con 0x55f644cd6660 2024-09-19T08:56:54.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.946+0000 7fb580ad6640 1 --2- 172.21.15.19:0/3979859165 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f644cde370 0x55f644cd6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:56:54.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.946+0000 7fb57bfff640 1 --2- 172.21.15.19:0/3979859165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f644cd6660 0x55f644cfea10 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fb568031ba0 tx=0x7fb568040040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd3c83ef2b27e49 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:54.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.946+0000 7fb5667fc640 1 -- 172.21.15.19:0/3979859165 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb568004490 con 0x55f644cd6660 2024-09-19T08:56:54.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.946+0000 7fb5667fc640 1 -- 172.21.15.19:0/3979859165 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb568003960 con 0x55f644cd6660 2024-09-19T08:56:54.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.946+0000 7fb5667fc640 1 -- 172.21.15.19:0/3979859165 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb56803dc20 con 0x55f644cd6660 2024-09-19T08:56:54.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.947+0000 7fb585113740 1 -- 172.21.15.19:0/3979859165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f644cd6660 msgr2=0x55f644cfea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:54.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.947+0000 7fb585113740 1 --2- 172.21.15.19:0/3979859165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f644cd6660 0x55f644cfea10 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fb568031ba0 tx=0x7fb568040040 comp rx=0 tx=0).stop 2024-09-19T08:56:54.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.947+0000 7fb585113740 1 -- 172.21.15.19:0/3979859165 shutdown_connections 2024-09-19T08:56:54.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.947+0000 7fb585113740 1 --2- 172.21.15.19:0/3979859165 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f644cde370 0x55f644cd6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.947+0000 7fb585113740 1 --2- 172.21.15.19:0/3979859165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f644cd6660 0x55f644cfea10 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.947+0000 7fb585113740 1 --2- 172.21.15.19:0/3979859165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f644cd4b40 0x55f644ce3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.947+0000 7fb585113740 1 -- 172.21.15.19:0/3979859165 >> 172.21.15.19:0/3979859165 conn(0x55f644c9c310 msgr2=0x55f644cdb110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:54.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.947+0000 7fb585113740 1 -- 172.21.15.19:0/3979859165 shutdown_connections 2024-09-19T08:56:54.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.947+0000 7fb585113740 1 -- 172.21.15.19:0/3979859165 wait complete. 2024-09-19T08:56:54.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.947+0000 7fb585113740 1 -- start start 2024-09-19T08:56:54.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.947+0000 7fb585113740 1 Processor -- start 2024-09-19T08:56:54.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.948+0000 7fb585113740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f644cd4b40 0x55f644cf3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:54.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.948+0000 7fb585113740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f644cd6660 0x55f644cf39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:54.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.948+0000 7fb585113740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f644cde370 0x55f644cf00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:54.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.948+0000 7fb585113740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb57c1ac700 con 0x55f644cde370 2024-09-19T08:56:54.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.948+0000 7fb585113740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb57c1ac030 con 0x55f644cd6660 2024-09-19T08:56:54.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.948+0000 7fb585113740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb57c1a9240 con 0x55f644cd4b40 2024-09-19T08:56:54.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.948+0000 7fb585113740 10 client.0 _ll_register_callbacks cb 0x7fb568009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:54.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.948+0000 7fb580ad6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f644cd6660 0x55f644cf39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:54.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.948+0000 7fb57bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f644cde370 0x55f644cf00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:54.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.948+0000 7fb580ad6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f644cd6660 0x55f644cf39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:39740/0 (socket says 172.21.15.19:39740) 2024-09-19T08:56:54.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.948+0000 7fb580ad6640 1 -- 172.21.15.19:0/2324020552 learned_addr learned my addr 172.21.15.19:0/2324020552 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:54.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.948+0000 7fb57bfff640 1 --2- 172.21.15.19:0/2324020552 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f644cd4b40 0x55f644cf3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:54.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.948+0000 7fb57bfff640 1 -- 172.21.15.19:0/2324020552 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f644cd4b40 msgr2=0x55f644cf3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:54.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.948+0000 7fb57bfff640 1 --2- 172.21.15.19:0/2324020552 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f644cd4b40 0x55f644cf3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.948+0000 7fb57bfff640 1 -- 172.21.15.19:0/2324020552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f644cd6660 msgr2=0x55f644cf39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:54.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.948+0000 7fb57bfff640 1 --2- 172.21.15.19:0/2324020552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f644cd6660 0x55f644cf39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.948+0000 7fb57bfff640 1 -- 172.21.15.19:0/2324020552 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f644cf08f0 con 0x55f644cde370 2024-09-19T08:56:54.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.948+0000 7fb580ad6640 1 --2- 172.21.15.19:0/2324020552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f644cd6660 0x55f644cf39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:54.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.949+0000 7fb57bfff640 1 --2- 172.21.15.19:0/2324020552 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f644cde370 0x55f644cf00f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fb568009310 tx=0x7fb568005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c05da01f8405890 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:54.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.949+0000 7fb55bfff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:56:54.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.949+0000 7fb55bfff640 1 -- 172.21.15.19:0/2324020552 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb568035040 con 0x55f644cde370 2024-09-19T08:56:54.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.949+0000 7fb55bfff640 1 -- 172.21.15.19:0/2324020552 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb56803d450 con 0x55f644cde370 2024-09-19T08:56:54.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.949+0000 7fb585113740 1 -- 172.21.15.19:0/2324020552 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb568003960 con 0x55f644cde370 2024-09-19T08:56:54.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.949+0000 7fb55bfff640 1 -- 172.21.15.19:0/2324020552 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb568061020 con 0x55f644cde370 2024-09-19T08:56:54.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.949+0000 7fb585113740 10 client.16491 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:54.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.949+0000 7fb585113740 1 -- 172.21.15.19:0/2324020552 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55f644d62490 con 0x55f644cde370 2024-09-19T08:56:54.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.949+0000 7fb55bfff640 1 -- 172.21.15.19:0/2324020552 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb568003960 con 0x55f644cde370 2024-09-19T08:56:54.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.950+0000 7fb55bfff640 1 -- 172.21.15.19:0/2324020552 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7fb56803c590 con 0x55f644cde370 2024-09-19T08:56:54.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.950+0000 7fb585113740 10 client.16491 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:54.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.950+0000 7fb585113740 10 client.16491 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:56:54.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.950+0000 7fb585113740 20 client.16491 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:54.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.950+0000 7fb585113740 1 --2- 172.21.15.19:0/2324020552 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55f644d62910 0x55f644d64d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:54.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.950+0000 7fb585113740 4 client.16491 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:56:54.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.950+0000 7fb585113740 1 -- 172.21.15.19:0/2324020552 --> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f644c40d70 con 0x55f644d62910 2024-09-19T08:56:54.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.950+0000 7fb580ad6640 1 --2- 172.21.15.19:0/2324020552 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55f644d62910 0x55f644d64d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:54.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.950+0000 7fb580ad6640 1 --2- 172.21.15.19:0/2324020552 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55f644d62910 0x55f644d64d00 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f51f15cf43294a0d server_cookie=d370d3ffdb1cb160 in_seq=0 out_seq=0 2024-09-19T08:56:54.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.950+0000 7fb55bfff640 10 client.16491 ms_handle_connect on v2:172.21.15.203:6838/2547507299 2024-09-19T08:56:54.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.951+0000 7fb55bfff640 1 -- 172.21.15.19:0/2324020552 <== mds.1 v2:172.21.15.203:6838/2547507299 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f644c40d70 con 0x55f644d62910 2024-09-19T08:56:54.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.951+0000 7fb55bfff640 10 client.16491 handle_command_reply: tid=0 2024-09-19T08:56:54.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.951+0000 7fb585113740 1 client.16491 shutdown 2024-09-19T08:56:54.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.951+0000 7fb585113740 1 -- 172.21.15.19:0/2324020552 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f644cde370 msgr2=0x55f644cf00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:54.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.951+0000 7fb585113740 1 --2- 172.21.15.19:0/2324020552 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f644cde370 0x55f644cf00f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fb568009310 tx=0x7fb568005e00 comp rx=0 tx=0).stop 2024-09-19T08:56:54.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.951+0000 7fb585113740 1 -- 172.21.15.19:0/2324020552 shutdown_connections 2024-09-19T08:56:54.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.951+0000 7fb585113740 1 --2- 172.21.15.19:0/2324020552 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55f644d62910 0x55f644d64d00 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.951+0000 7fb585113740 1 --2- 172.21.15.19:0/2324020552 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f644cde370 0x55f644cf00f0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.951+0000 7fb585113740 1 --2- 172.21.15.19:0/2324020552 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f644cd6660 0x55f644cf39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.951+0000 7fb585113740 1 --2- 172.21.15.19:0/2324020552 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f644cd4b40 0x55f644cf3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.951+0000 7fb585113740 1 -- 172.21.15.19:0/2324020552 >> 172.21.15.19:0/2324020552 conn(0x55f644c9c310 msgr2=0x55f644cda8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:54.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.951+0000 7fb55bfff640 0 client.16491 ms_handle_reset on v2:172.21.15.203:6838/2547507299 2024-09-19T08:56:54.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.951+0000 7fb585113740 1 -- 172.21.15.19:0/2324020552 shutdown_connections 2024-09-19T08:56:54.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.951+0000 7fb585113740 1 -- 172.21.15.19:0/2324020552 wait complete. 2024-09-19T08:56:54.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.951+0000 7fb585113740 20 client.16491 trim_cache size 0 max 16384 2024-09-19T08:56:54.957 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T08:56:54.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.952+0000 7fb582d3a640 1 -- 172.21.15.19:0/2691032111 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb56c0a32c0 msgr2=0x7fb56c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:54.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.952+0000 7fb582d3a640 1 --2- 172.21.15.19:0/2691032111 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb56c0a32c0 0x7fb56c0a5780 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb574005ba0 tx=0x7fb574005f70 comp rx=0 tx=0).stop 2024-09-19T08:56:54.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.952+0000 7fb582d3a640 1 -- 172.21.15.19:0/2691032111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb57c10c180 msgr2=0x7fb57c19cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:54.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.952+0000 7fb582d3a640 1 --2- 172.21.15.19:0/2691032111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb57c10c180 0x7fb57c19cdb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb574009fd0 tx=0x7fb57400ef10 comp rx=0 tx=0).stop 2024-09-19T08:56:54.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.952+0000 7fb582d3a640 1 -- 172.21.15.19:0/2691032111 shutdown_connections 2024-09-19T08:56:54.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.952+0000 7fb582d3a640 1 --2- 172.21.15.19:0/2691032111 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb56c0a32c0 0x7fb56c0a5780 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.952+0000 7fb582d3a640 1 --2- 172.21.15.19:0/2691032111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb57c10c180 0x7fb57c19cdb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.952+0000 7fb582d3a640 1 --2- 172.21.15.19:0/2691032111 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb57c103670 0x7fb57c198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.952+0000 7fb582d3a640 1 --2- 172.21.15.19:0/2691032111 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb57c102d50 0x7fb57c1984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:54.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.952+0000 7fb582d3a640 1 -- 172.21.15.19:0/2691032111 >> 172.21.15.19:0/2691032111 conn(0x7fb57c0fc7d0 msgr2=0x7fb57c0fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:54.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.952+0000 7fb582d3a640 1 -- 172.21.15.19:0/2691032111 shutdown_connections 2024-09-19T08:56:54.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:54.952+0000 7fb582d3a640 1 -- 172.21.15.19:0/2691032111 wait complete. 2024-09-19T08:56:55.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:55 smithi155 ceph-mon[34921]: pgmap v478: 97 pgs: 97 active+clean; 27 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 887 op/s 2024-09-19T08:56:55.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:55 smithi203 ceph-mon[35450]: pgmap v478: 97 pgs: 97 active+clean; 27 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 887 op/s 2024-09-19T08:56:55.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:55 smithi019 ceph-mon[30976]: pgmap v478: 97 pgs: 97 active+clean; 27 MiB data, 594 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.9 MiB/s wr, 887 op/s 2024-09-19T08:56:55.870 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:56:56.298 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:56.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.776+0000 7f3b72660640 1 -- 172.21.15.19:0/843694271 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b6c101de0 msgr2=0x7f3b6c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:56.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.776+0000 7f3b72660640 1 --2- 172.21.15.19:0/843694271 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b6c101de0 0x7f3b6c1021c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c009900 tx=0x7f3b5c02a3f0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.776+0000 7f3b72660640 1 -- 172.21.15.19:0/843694271 shutdown_connections 2024-09-19T08:56:56.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.776+0000 7f3b72660640 1 --2- 172.21.15.19:0/843694271 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b6c102790 0x7f3b6c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.776+0000 7f3b72660640 1 --2- 172.21.15.19:0/843694271 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b6c106f10 0x7f3b6c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.776+0000 7f3b72660640 1 --2- 172.21.15.19:0/843694271 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b6c101de0 0x7f3b6c1021c0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.776+0000 7f3b72660640 1 -- 172.21.15.19:0/843694271 >> 172.21.15.19:0/843694271 conn(0x7f3b6c0fd880 msgr2=0x7f3b6c0ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:56.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.776+0000 7f3b72660640 1 -- 172.21.15.19:0/843694271 shutdown_connections 2024-09-19T08:56:56.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.776+0000 7f3b72660640 1 -- 172.21.15.19:0/843694271 wait complete. 2024-09-19T08:56:56.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.777+0000 7f3b72660640 1 Processor -- start 2024-09-19T08:56:56.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.777+0000 7f3b72660640 1 -- start start 2024-09-19T08:56:56.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.777+0000 7f3b72660640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b6c101de0 0x7f3b6c198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:56.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.777+0000 7f3b72660640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b6c102790 0x7f3b6c198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:56.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.777+0000 7f3b72660640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b6c106f10 0x7f3b6c19ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:56.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.777+0000 7f3b72660640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6c111fc0 con 0x7f3b6c106f10 2024-09-19T08:56:56.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.777+0000 7f3b72660640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6c111e40 con 0x7f3b6c102790 2024-09-19T08:56:56.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.777+0000 7f3b72660640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6c112140 con 0x7f3b6c101de0 2024-09-19T08:56:56.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.778+0000 7f3b70bfd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b6c106f10 0x7f3b6c19ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:56.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.778+0000 7f3b70bfd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b6c106f10 0x7f3b6c19ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43074/0 (socket says 172.21.15.19:43074) 2024-09-19T08:56:56.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.778+0000 7f3b70bfd640 1 -- 172.21.15.19:0/2494087803 learned_addr learned my addr 172.21.15.19:0/2494087803 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:56.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.778+0000 7f3b6b7fe640 1 --2- 172.21.15.19:0/2494087803 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b6c102790 0x7f3b6c198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:56.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.778+0000 7f3b6bfff640 1 --2- 172.21.15.19:0/2494087803 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b6c101de0 0x7f3b6c198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:56.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.778+0000 7f3b70bfd640 1 -- 172.21.15.19:0/2494087803 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b6c101de0 msgr2=0x7f3b6c198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:56.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.778+0000 7f3b70bfd640 1 --2- 172.21.15.19:0/2494087803 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b6c101de0 0x7f3b6c198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.778+0000 7f3b70bfd640 1 -- 172.21.15.19:0/2494087803 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b6c102790 msgr2=0x7f3b6c198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:56.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.778+0000 7f3b70bfd640 1 --2- 172.21.15.19:0/2494087803 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b6c102790 0x7f3b6c198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.778+0000 7f3b70bfd640 1 -- 172.21.15.19:0/2494087803 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b6c19d3d0 con 0x7f3b6c106f10 2024-09-19T08:56:56.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.778+0000 7f3b6b7fe640 1 --2- 172.21.15.19:0/2494087803 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b6c102790 0x7f3b6c198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:56.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.778+0000 7f3b70bfd640 1 --2- 172.21.15.19:0/2494087803 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b6c106f10 0x7f3b6c19ccf0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f3b6400eb10 tx=0x7f3b6400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:56.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.778+0000 7f3b697fa640 1 -- 172.21.15.19:0/2494087803 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b64004b20 con 0x7f3b6c106f10 2024-09-19T08:56:56.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.778+0000 7f3b697fa640 1 -- 172.21.15.19:0/2494087803 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b64004cc0 con 0x7f3b6c106f10 2024-09-19T08:56:56.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.778+0000 7f3b72660640 1 -- 172.21.15.19:0/2494087803 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b6c19d6c0 con 0x7f3b6c106f10 2024-09-19T08:56:56.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.778+0000 7f3b697fa640 1 -- 172.21.15.19:0/2494087803 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b64010760 con 0x7f3b6c106f10 2024-09-19T08:56:56.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.778+0000 7f3b72660640 1 -- 172.21.15.19:0/2494087803 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b6c1a4fa0 con 0x7f3b6c106f10 2024-09-19T08:56:56.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.781+0000 7f3b697fa640 1 -- 172.21.15.19:0/2494087803 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f3b64005020 con 0x7f3b6c106f10 2024-09-19T08:56:56.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.781+0000 7f3b74a39740 1 Processor -- start 2024-09-19T08:56:56.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.782+0000 7f3b74a39740 1 -- start start 2024-09-19T08:56:56.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.782+0000 7f3b74a39740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e41e7b40 0x55d6e41e6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:56.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.782+0000 7f3b74a39740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e41e65d0 0x55d6e41e6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:56.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.782+0000 7f3b74a39740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e41f1370 0x55d6e41f3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:56.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.782+0000 7f3b74a39740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d6e414c2f0 con 0x55d6e41f1370 2024-09-19T08:56:56.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.782+0000 7f3b74a39740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55d6e40f3cf0 con 0x55d6e41e7b40 2024-09-19T08:56:56.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.782+0000 7f3b74a39740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d6e41482b0 con 0x55d6e41e65d0 2024-09-19T08:56:56.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.782+0000 7f3b6b7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e41e7b40 0x55d6e41e6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:56.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.782+0000 7f3b6b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e41f1370 0x55d6e41f3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:56.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.782+0000 7f3b6b7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e41e7b40 0x55d6e41e6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:53518/0 (socket says 172.21.15.19:53518) 2024-09-19T08:56:56.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.782+0000 7f3b6b7fe640 1 -- 172.21.15.19:0/3958848190 learned_addr learned my addr 172.21.15.19:0/3958848190 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:56.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.782+0000 7f3b6bfff640 1 --2- 172.21.15.19:0/3958848190 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e41e65d0 0x55d6e41e6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:56.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.782+0000 7f3b6b7fe640 1 -- 172.21.15.19:0/3958848190 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e41e65d0 msgr2=0x55d6e41e6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:56.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.782+0000 7f3b6b7fe640 1 --2- 172.21.15.19:0/3958848190 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e41e65d0 0x55d6e41e6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.782+0000 7f3b6b7fe640 1 -- 172.21.15.19:0/3958848190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e41f1370 msgr2=0x55d6e41f3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:56.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.782+0000 7f3b6b7fe640 1 --2- 172.21.15.19:0/3958848190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e41f1370 0x55d6e41f3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.782+0000 7f3b6b7fe640 1 -- 172.21.15.19:0/3958848190 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6e40d83a0 con 0x55d6e41e7b40 2024-09-19T08:56:56.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.783+0000 7f3b697fa640 1 --2- 172.21.15.19:0/2494087803 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3b540a32c0 0x7f3b540a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:56.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.783+0000 7f3b6b7fe640 1 --2- 172.21.15.19:0/3958848190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e41e7b40 0x55d6e41e6090 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3b6000b640 tx=0x7f3b60005c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e44a1472e5e43ce6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:56.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.783+0000 7f3b6bfff640 1 --2- 172.21.15.19:0/2494087803 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3b540a32c0 0x7f3b540a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:56.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.783+0000 7f3b697fa640 1 -- 172.21.15.19:0/2494087803 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f3b640cfea0 con 0x7f3b6c106f10 2024-09-19T08:56:56.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.783+0000 7f3b527fc640 1 -- 172.21.15.19:0/3958848190 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6000dd70 con 0x55d6e41e7b40 2024-09-19T08:56:56.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.783+0000 7f3b527fc640 1 -- 172.21.15.19:0/3958848190 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b60026d30 con 0x55d6e41e7b40 2024-09-19T08:56:56.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.783+0000 7f3b527fc640 1 -- 172.21.15.19:0/3958848190 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b60004a00 con 0x55d6e41e7b40 2024-09-19T08:56:56.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.784+0000 7f3b74a39740 1 -- 172.21.15.19:0/3958848190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e41e7b40 msgr2=0x55d6e41e6090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:56.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.784+0000 7f3b6bfff640 1 --2- 172.21.15.19:0/2494087803 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3b540a32c0 0x7f3b540a5780 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c000c00 tx=0x7f3b5c005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:56.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.784+0000 7f3b74a39740 1 --2- 172.21.15.19:0/3958848190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e41e7b40 0x55d6e41e6090 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f3b6000b640 tx=0x7f3b60005c90 comp rx=0 tx=0).stop 2024-09-19T08:56:56.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.784+0000 7f3b74a39740 1 -- 172.21.15.19:0/3958848190 shutdown_connections 2024-09-19T08:56:56.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.784+0000 7f3b74a39740 1 --2- 172.21.15.19:0/3958848190 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e41e65d0 0x55d6e41e6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.784+0000 7f3b74a39740 1 --2- 172.21.15.19:0/3958848190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e41f1370 0x55d6e41f3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.784+0000 7f3b74a39740 1 --2- 172.21.15.19:0/3958848190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e41e7b40 0x55d6e41e6090 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.784+0000 7f3b74a39740 1 -- 172.21.15.19:0/3958848190 >> 172.21.15.19:0/3958848190 conn(0x55d6e41af310 msgr2=0x55d6e41e2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:56.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.784+0000 7f3b74a39740 1 -- 172.21.15.19:0/3958848190 shutdown_connections 2024-09-19T08:56:56.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.784+0000 7f3b74a39740 1 -- 172.21.15.19:0/3958848190 wait complete. 2024-09-19T08:56:56.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.784+0000 7f3b74a39740 1 -- start start 2024-09-19T08:56:56.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.785+0000 7f3b74a39740 1 Processor -- start 2024-09-19T08:56:56.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.785+0000 7f3b74a39740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e41e65d0 0x55d6e41f0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:56.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.785+0000 7f3b74a39740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e41e7b40 0x55d6e41ee080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:56.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.785+0000 7f3b74a39740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e41f1370 0x55d6e41ee810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:56.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.785+0000 7f3b74a39740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d6e41f4070 con 0x55d6e41f1370 2024-09-19T08:56:56.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.785+0000 7f3b74a39740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55d6e4107060 con 0x55d6e41e65d0 2024-09-19T08:56:56.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.785+0000 7f3b74a39740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d6e41f41f0 con 0x55d6e41e7b40 2024-09-19T08:56:56.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.785+0000 7f3b74a39740 10 client.0 _ll_register_callbacks cb 0x55d6e3e5a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:56.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.786+0000 7f3b6bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e41e65d0 0x55d6e41f0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:56.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.786+0000 7f3b6bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e41e65d0 0x55d6e41f0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:53520/0 (socket says 172.21.15.19:53520) 2024-09-19T08:56:56.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.786+0000 7f3b6bfff640 1 -- 172.21.15.19:0/1749158891 learned_addr learned my addr 172.21.15.19:0/1749158891 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:56.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.786+0000 7f3b70bfd640 1 --2- 172.21.15.19:0/1749158891 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e41f1370 0x55d6e41ee810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:56.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.786+0000 7f3b6b7fe640 1 --2- 172.21.15.19:0/1749158891 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e41e7b40 0x55d6e41ee080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:56.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.786+0000 7f3b70bfd640 1 -- 172.21.15.19:0/1749158891 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e41e7b40 msgr2=0x55d6e41ee080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:56.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.786+0000 7f3b70bfd640 1 --2- 172.21.15.19:0/1749158891 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e41e7b40 0x55d6e41ee080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.786+0000 7f3b70bfd640 1 -- 172.21.15.19:0/1749158891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e41e65d0 msgr2=0x55d6e41f0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:56.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.786+0000 7f3b70bfd640 1 --2- 172.21.15.19:0/1749158891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e41e65d0 0x55d6e41f0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.786+0000 7f3b70bfd640 1 -- 172.21.15.19:0/1749158891 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6e3ebd3c0 con 0x55d6e41f1370 2024-09-19T08:56:56.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.786+0000 7f3b70bfd640 1 --2- 172.21.15.19:0/1749158891 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e41f1370 0x55d6e41ee810 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f3b6409c170 tx=0x7f3b6409bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a3fb0ddadeb16c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:56.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.786+0000 7f3b4b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:56:56.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.787+0000 7f3b4b7fe640 1 -- 172.21.15.19:0/1749158891 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b640b5060 con 0x55d6e41f1370 2024-09-19T08:56:56.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.787+0000 7f3b4b7fe640 1 -- 172.21.15.19:0/1749158891 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f3b640b5400 con 0x55d6e41f1370 2024-09-19T08:56:56.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.787+0000 7f3b74a39740 1 -- 172.21.15.19:0/1749158891 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b60026d30 con 0x55d6e41f1370 2024-09-19T08:56:56.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.787+0000 7f3b4b7fe640 1 -- 172.21.15.19:0/1749158891 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f3b6409c470 con 0x55d6e41f1370 2024-09-19T08:56:56.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.787+0000 7f3b74a39740 10 client.16503 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:56.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.787+0000 7f3b74a39740 1 -- 172.21.15.19:0/1749158891 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55d6e41ffb90 con 0x55d6e41f1370 2024-09-19T08:56:56.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.787+0000 7f3b4b7fe640 1 -- 172.21.15.19:0/1749158891 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b60026d30 con 0x55d6e41f1370 2024-09-19T08:56:56.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.788+0000 7f3b4b7fe640 1 -- 172.21.15.19:0/1749158891 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f3b6409b8c0 con 0x55d6e41f1370 2024-09-19T08:56:56.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.788+0000 7f3b74a39740 10 client.16503 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:56.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.788+0000 7f3b74a39740 10 client.16503 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:56:56.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.788+0000 7f3b74a39740 20 client.16503 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:56.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.788+0000 7f3b74a39740 1 --2- 172.21.15.19:0/1749158891 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d6e4200fa0 0x55d6e4203390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:56.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.788+0000 7f3b74a39740 4 client.16503 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:56:56.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.788+0000 7f3b74a39740 1 -- 172.21.15.19:0/1749158891 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6e4159860 con 0x55d6e4200fa0 2024-09-19T08:56:56.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.788+0000 7f3b6bfff640 1 --2- 172.21.15.19:0/1749158891 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d6e4200fa0 0x55d6e4203390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:56.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.788+0000 7f3b6bfff640 1 --2- 172.21.15.19:0/1749158891 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d6e4200fa0 0x55d6e4203390 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73b0fae9818fc2e9 server_cookie=12e6941cf471fc6c in_seq=0 out_seq=0 2024-09-19T08:56:56.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.788+0000 7f3b4b7fe640 10 client.16503 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:56.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.791+0000 7f3b4b7fe640 1 -- 172.21.15.19:0/1749158891 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d6e4159860 con 0x55d6e4200fa0 2024-09-19T08:56:56.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.791+0000 7f3b4b7fe640 10 client.16503 handle_command_reply: tid=0 2024-09-19T08:56:56.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.791+0000 7f3b74a39740 1 client.16503 shutdown 2024-09-19T08:56:56.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.792+0000 7f3b74a39740 1 -- 172.21.15.19:0/1749158891 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e41f1370 msgr2=0x55d6e41ee810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:56.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.792+0000 7f3b74a39740 1 --2- 172.21.15.19:0/1749158891 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e41f1370 0x55d6e41ee810 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f3b6409c170 tx=0x7f3b6409bfb0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.792+0000 7f3b74a39740 1 -- 172.21.15.19:0/1749158891 shutdown_connections 2024-09-19T08:56:56.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.792+0000 7f3b74a39740 1 --2- 172.21.15.19:0/1749158891 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d6e4200fa0 0x55d6e4203390 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.792+0000 7f3b74a39740 1 --2- 172.21.15.19:0/1749158891 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e41e7b40 0x55d6e41ee080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.792+0000 7f3b74a39740 1 --2- 172.21.15.19:0/1749158891 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e41f1370 0x55d6e41ee810 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.792+0000 7f3b4b7fe640 0 client.16503 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:56.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.792+0000 7f3b74a39740 1 --2- 172.21.15.19:0/1749158891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e41e65d0 0x55d6e41f0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.792+0000 7f3b74a39740 1 -- 172.21.15.19:0/1749158891 >> 172.21.15.19:0/1749158891 conn(0x55d6e41af310 msgr2=0x55d6e41e8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:56.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.792+0000 7f3b74a39740 1 -- 172.21.15.19:0/1749158891 shutdown_connections 2024-09-19T08:56:56.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.792+0000 7f3b74a39740 1 -- 172.21.15.19:0/1749158891 wait complete. 2024-09-19T08:56:56.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.792+0000 7f3b74a39740 20 client.16503 trim_cache size 0 max 16384 2024-09-19T08:56:56.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.805+0000 7f3b74a39740 1 Processor -- start 2024-09-19T08:56:56.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.806+0000 7f3b74a39740 1 -- start start 2024-09-19T08:56:56.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.806+0000 7f3b74a39740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e41e65d0 0x55d6e41ed940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:56.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.806+0000 7f3b74a39740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e41e7b40 0x55d6e41e1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:56.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.806+0000 7f3b74a39740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e41f1370 0x55d6e41e9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:56.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.806+0000 7f3b74a39740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6c1ab350 con 0x55d6e41f1370 2024-09-19T08:56:56.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.806+0000 7f3b74a39740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6c1acec0 con 0x55d6e41e65d0 2024-09-19T08:56:56.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.806+0000 7f3b74a39740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6c1aba20 con 0x55d6e41e7b40 2024-09-19T08:56:56.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.806+0000 7f3b70bfd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e41f1370 0x55d6e41e9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:56.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.806+0000 7f3b6bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e41e65d0 0x55d6e41ed940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:56.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.806+0000 7f3b6bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e41e65d0 0x55d6e41ed940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:53528/0 (socket says 172.21.15.19:53528) 2024-09-19T08:56:56.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.806+0000 7f3b6bfff640 1 -- 172.21.15.19:0/150929829 learned_addr learned my addr 172.21.15.19:0/150929829 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:56.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.806+0000 7f3b6b7fe640 1 --2- 172.21.15.19:0/150929829 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e41e7b40 0x55d6e41e1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:56.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.806+0000 7f3b70bfd640 1 -- 172.21.15.19:0/150929829 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e41e7b40 msgr2=0x55d6e41e1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:56.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.806+0000 7f3b70bfd640 1 --2- 172.21.15.19:0/150929829 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e41e7b40 0x55d6e41e1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.806+0000 7f3b70bfd640 1 -- 172.21.15.19:0/150929829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e41e65d0 msgr2=0x55d6e41ed940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:56.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.806+0000 7f3b70bfd640 1 --2- 172.21.15.19:0/150929829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e41e65d0 0x55d6e41ed940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.806+0000 7f3b70bfd640 1 -- 172.21.15.19:0/150929829 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6e41e3960 con 0x55d6e41f1370 2024-09-19T08:56:56.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.806+0000 7f3b6bfff640 1 --2- 172.21.15.19:0/150929829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e41e65d0 0x55d6e41ed940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:56.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.807+0000 7f3b70bfd640 1 --2- 172.21.15.19:0/150929829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e41f1370 0x55d6e41e9120 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f3b64098df0 tx=0x7f3b6409a980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf55fd58cf82982e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:56.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.807+0000 7f3b51ffb640 1 -- 172.21.15.19:0/150929829 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b640b5040 con 0x55d6e41f1370 2024-09-19T08:56:56.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.807+0000 7f3b51ffb640 1 -- 172.21.15.19:0/150929829 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b640a0820 con 0x55d6e41f1370 2024-09-19T08:56:56.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.807+0000 7f3b51ffb640 1 -- 172.21.15.19:0/150929829 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6407e070 con 0x55d6e41f1370 2024-09-19T08:56:56.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.807+0000 7f3b74a39740 1 -- 172.21.15.19:0/150929829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e41f1370 msgr2=0x55d6e41e9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:56.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.807+0000 7f3b74a39740 1 --2- 172.21.15.19:0/150929829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e41f1370 0x55d6e41e9120 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f3b64098df0 tx=0x7f3b6409a980 comp rx=0 tx=0).stop 2024-09-19T08:56:56.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.808+0000 7f3b74a39740 1 -- 172.21.15.19:0/150929829 shutdown_connections 2024-09-19T08:56:56.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.808+0000 7f3b74a39740 1 --2- 172.21.15.19:0/150929829 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e41e7b40 0x55d6e41e1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.808+0000 7f3b74a39740 1 --2- 172.21.15.19:0/150929829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e41f1370 0x55d6e41e9120 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.808+0000 7f3b74a39740 1 --2- 172.21.15.19:0/150929829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e41e65d0 0x55d6e41ed940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.808+0000 7f3b74a39740 1 -- 172.21.15.19:0/150929829 >> 172.21.15.19:0/150929829 conn(0x55d6e41af310 msgr2=0x55d6e41e14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:56.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.808+0000 7f3b74a39740 1 -- 172.21.15.19:0/150929829 shutdown_connections 2024-09-19T08:56:56.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.808+0000 7f3b74a39740 1 -- 172.21.15.19:0/150929829 wait complete. 2024-09-19T08:56:56.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.808+0000 7f3b74a39740 1 -- start start 2024-09-19T08:56:56.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.808+0000 7f3b74a39740 1 Processor -- start 2024-09-19T08:56:56.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.808+0000 7f3b74a39740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e41e65d0 0x55d6e41f5380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:56.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.809+0000 7f3b74a39740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e41e7b40 0x55d6e41f58c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:56.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.809+0000 7f3b74a39740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e41f1370 0x55d6e41f5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:56.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.809+0000 7f3b74a39740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6c1ac7f0 con 0x55d6e41e7b40 2024-09-19T08:56:56.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.809+0000 7f3b74a39740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6c1ac120 con 0x55d6e41e65d0 2024-09-19T08:56:56.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.809+0000 7f3b74a39740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6c1a9330 con 0x55d6e41f1370 2024-09-19T08:56:56.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.809+0000 7f3b6bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e41e65d0 0x55d6e41f5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:56.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.809+0000 7f3b6bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e41e65d0 0x55d6e41f5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:53534/0 (socket says 172.21.15.19:53534) 2024-09-19T08:56:56.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.809+0000 7f3b6bfff640 1 -- 172.21.15.19:0/2391109262 learned_addr learned my addr 172.21.15.19:0/2391109262 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:56.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.809+0000 7f3b74a39740 10 client.0 _ll_register_callbacks cb 0x7f3b64098730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:56:56.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.809+0000 7f3b70bfd640 1 --2- 172.21.15.19:0/2391109262 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e41f1370 0x55d6e41f5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:56.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.809+0000 7f3b6b7fe640 1 --2- 172.21.15.19:0/2391109262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e41e7b40 0x55d6e41f58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:56.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.809+0000 7f3b6bfff640 1 -- 172.21.15.19:0/2391109262 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e41f1370 msgr2=0x55d6e41f5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:56.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.809+0000 7f3b6bfff640 1 --2- 172.21.15.19:0/2391109262 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e41f1370 0x55d6e41f5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.809+0000 7f3b6bfff640 1 -- 172.21.15.19:0/2391109262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e41e7b40 msgr2=0x55d6e41f58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:56:56.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.809+0000 7f3b6bfff640 1 --2- 172.21.15.19:0/2391109262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e41e7b40 0x55d6e41f58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.809+0000 7f3b6bfff640 1 -- 172.21.15.19:0/2391109262 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6e426adb0 con 0x55d6e41e65d0 2024-09-19T08:56:56.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.809+0000 7f3b6bfff640 1 --2- 172.21.15.19:0/2391109262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e41e65d0 0x55d6e41f5380 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55d6e4203bb0 tx=0x7f3b5c02a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=364c803457b8a7ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:56.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.809+0000 7f3b4b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T08:56:56.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.810+0000 7f3b4b7fe640 1 -- 172.21.15.19:0/2391109262 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c035050 con 0x55d6e41e65d0 2024-09-19T08:56:56.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.810+0000 7f3b4b7fe640 1 -- 172.21.15.19:0/2391109262 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f3b5c004b90 con 0x55d6e41e65d0 2024-09-19T08:56:56.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.810+0000 7f3b74a39740 1 -- 172.21.15.19:0/2391109262 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b640a0820 con 0x55d6e41e65d0 2024-09-19T08:56:56.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.810+0000 7f3b4b7fe640 1 -- 172.21.15.19:0/2391109262 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f3b5c004d90 con 0x55d6e41e65d0 2024-09-19T08:56:56.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.810+0000 7f3b74a39740 10 client.26024 fetch_fsmap learned FSMap version 33 2024-09-19T08:56:56.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.810+0000 7f3b74a39740 1 -- 172.21.15.19:0/2391109262 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55d6e426c0f0 con 0x55d6e41e65d0 2024-09-19T08:56:56.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.810+0000 7f3b4b7fe640 1 -- 172.21.15.19:0/2391109262 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3b640a0820 con 0x55d6e41e65d0 2024-09-19T08:56:56.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.811+0000 7f3b4b7fe640 1 -- 172.21.15.19:0/2391109262 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f3b5c059070 con 0x55d6e41e65d0 2024-09-19T08:56:56.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.811+0000 7f3b74a39740 10 client.26024 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:56:56.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.811+0000 7f3b74a39740 10 client.26024 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:56:56.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.811+0000 7f3b74a39740 20 client.26024 populate_metadata read hostname 'smithi019' 2024-09-19T08:56:56.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.811+0000 7f3b74a39740 1 --2- 172.21.15.19:0/2391109262 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d6e426c7f0 0x55d6e426ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:56.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.811+0000 7f3b74a39740 4 client.26024 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:56:56.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.811+0000 7f3b74a39740 1 -- 172.21.15.19:0/2391109262 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d6e4153d70 con 0x55d6e426c7f0 2024-09-19T08:56:56.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.811+0000 7f3b6b7fe640 1 --2- 172.21.15.19:0/2391109262 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d6e426c7f0 0x55d6e426ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:56.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.812+0000 7f3b6b7fe640 1 --2- 172.21.15.19:0/2391109262 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d6e426c7f0 0x55d6e426ec10 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba18b1bf6e1b2bef server_cookie=66afa3850f740505 in_seq=0 out_seq=0 2024-09-19T08:56:56.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.812+0000 7f3b4b7fe640 10 client.26024 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:56.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.815+0000 7f3b4b7fe640 1 -- 172.21.15.19:0/2391109262 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d6e4153d70 con 0x55d6e426c7f0 2024-09-19T08:56:56.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.815+0000 7f3b4b7fe640 10 client.26024 handle_command_reply: tid=0 2024-09-19T08:56:56.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.815+0000 7f3b74a39740 1 client.26024 shutdown 2024-09-19T08:56:56.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.816+0000 7f3b74a39740 1 -- 172.21.15.19:0/2391109262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e41e65d0 msgr2=0x55d6e41f5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:56.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.816+0000 7f3b74a39740 1 --2- 172.21.15.19:0/2391109262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e41e65d0 0x55d6e41f5380 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x55d6e4203bb0 tx=0x7f3b5c02a3f0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.816+0000 7f3b74a39740 1 -- 172.21.15.19:0/2391109262 shutdown_connections 2024-09-19T08:56:56.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.816+0000 7f3b74a39740 1 --2- 172.21.15.19:0/2391109262 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d6e426c7f0 0x55d6e426ec10 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.816+0000 7f3b74a39740 1 --2- 172.21.15.19:0/2391109262 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e41f1370 0x55d6e41f5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.816+0000 7f3b74a39740 1 --2- 172.21.15.19:0/2391109262 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e41e7b40 0x55d6e41f58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.816+0000 7f3b4b7fe640 0 client.26024 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:56:56.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.816+0000 7f3b74a39740 1 --2- 172.21.15.19:0/2391109262 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e41e65d0 0x55d6e41f5380 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.816+0000 7f3b74a39740 1 -- 172.21.15.19:0/2391109262 >> 172.21.15.19:0/2391109262 conn(0x55d6e41af310 msgr2=0x55d6e41ef8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:56.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.816+0000 7f3b74a39740 1 -- 172.21.15.19:0/2391109262 shutdown_connections 2024-09-19T08:56:56.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.816+0000 7f3b74a39740 1 -- 172.21.15.19:0/2391109262 wait complete. 2024-09-19T08:56:56.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.816+0000 7f3b74a39740 20 client.26024 trim_cache size 0 max 16384 2024-09-19T08:56:56.818 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T08:56:56.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.817+0000 7f3b72660640 1 -- 172.21.15.19:0/2494087803 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3b540a32c0 msgr2=0x7f3b540a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:56.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.817+0000 7f3b72660640 1 --2- 172.21.15.19:0/2494087803 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3b540a32c0 0x7f3b540a5780 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c000c00 tx=0x7f3b5c005b50 comp rx=0 tx=0).stop 2024-09-19T08:56:56.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.817+0000 7f3b72660640 1 -- 172.21.15.19:0/2494087803 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b6c106f10 msgr2=0x7f3b6c19ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:56.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.817+0000 7f3b72660640 1 --2- 172.21.15.19:0/2494087803 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b6c106f10 0x7f3b6c19ccf0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f3b6400eb10 tx=0x7f3b6400c2d0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.817+0000 7f3b72660640 1 -- 172.21.15.19:0/2494087803 shutdown_connections 2024-09-19T08:56:56.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.817+0000 7f3b72660640 1 --2- 172.21.15.19:0/2494087803 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3b540a32c0 0x7f3b540a5780 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.817+0000 7f3b72660640 1 --2- 172.21.15.19:0/2494087803 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3b6c106f10 0x7f3b6c19ccf0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.817+0000 7f3b72660640 1 --2- 172.21.15.19:0/2494087803 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3b6c102790 0x7f3b6c198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.817+0000 7f3b72660640 1 --2- 172.21.15.19:0/2494087803 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3b6c101de0 0x7f3b6c198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:56.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.817+0000 7f3b72660640 1 -- 172.21.15.19:0/2494087803 >> 172.21.15.19:0/2494087803 conn(0x7f3b6c0fd880 msgr2=0x7f3b6c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:56.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.817+0000 7f3b72660640 1 -- 172.21.15.19:0/2494087803 shutdown_connections 2024-09-19T08:56:56.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:56.817+0000 7f3b72660640 1 -- 172.21.15.19:0/2494087803 wait complete. 2024-09-19T08:56:57.585 INFO:tasks.quiescer.fs.[cephfs]:Total duration (59.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T08:56:57.586 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.8 2024-09-19T08:56:57.586 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:56:57.656 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:57 smithi019 ceph-mon[30976]: pgmap v479: 97 pgs: 97 active+clean; 18 MiB data, 610 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 1.60k op/s 2024-09-19T08:56:57.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:57 smithi155 ceph-mon[34921]: pgmap v479: 97 pgs: 97 active+clean; 18 MiB data, 610 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 1.60k op/s 2024-09-19T08:56:57.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:57 smithi203 ceph-mon[35450]: pgmap v479: 97 pgs: 97 active+clean; 18 MiB data, 610 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 1.60k op/s 2024-09-19T08:56:58.201 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:56:58.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.712+0000 7f7f2ceb6640 1 -- 172.21.15.19:0/605488207 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f28100e20 msgr2=0x7f7f28101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:58.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.712+0000 7f7f2ceb6640 1 --2- 172.21.15.19:0/605488207 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f28100e20 0x7f7f28101200 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f7f18009900 tx=0x7f7f1802a480 comp rx=0 tx=0).stop 2024-09-19T08:56:58.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.712+0000 7f7f2ceb6640 1 -- 172.21.15.19:0/605488207 shutdown_connections 2024-09-19T08:56:58.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.712+0000 7f7f2ceb6640 1 --2- 172.21.15.19:0/605488207 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f28102ef0 0x7f7f2810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:58.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.712+0000 7f7f2ceb6640 1 --2- 172.21.15.19:0/605488207 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f28102570 0x7f7f281029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:58.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.712+0000 7f7f2ceb6640 1 --2- 172.21.15.19:0/605488207 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f28100e20 0x7f7f28101200 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:58.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.712+0000 7f7f2ceb6640 1 -- 172.21.15.19:0/605488207 >> 172.21.15.19:0/605488207 conn(0x7f7f280fc7d0 msgr2=0x7f7f280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:58.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.712+0000 7f7f2ceb6640 1 -- 172.21.15.19:0/605488207 shutdown_connections 2024-09-19T08:56:58.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.712+0000 7f7f2ceb6640 1 -- 172.21.15.19:0/605488207 wait complete. 2024-09-19T08:56:58.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.713+0000 7f7f2ceb6640 1 Processor -- start 2024-09-19T08:56:58.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.713+0000 7f7f2ceb6640 1 -- start start 2024-09-19T08:56:58.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.713+0000 7f7f2ceb6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f28100e20 0x7f7f281984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:58.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.713+0000 7f7f2ceb6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f28102570 0x7f7f28198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:58.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.713+0000 7f7f2ceb6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f28102ef0 0x7f7f2819cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:58.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.713+0000 7f7f2ceb6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7f281120d0 con 0x7f7f28100e20 2024-09-19T08:56:58.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.713+0000 7f7f2ceb6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7f28111f50 con 0x7f7f28102ef0 2024-09-19T08:56:58.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.713+0000 7f7f2ceb6640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7f28112250 con 0x7f7f28102570 2024-09-19T08:56:58.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.713+0000 7f7f2659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f28100e20 0x7f7f281984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:58.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.713+0000 7f7f2659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f28100e20 0x7f7f281984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43122/0 (socket says 172.21.15.19:43122) 2024-09-19T08:56:58.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.713+0000 7f7f2659c640 1 -- 172.21.15.19:0/481717797 learned_addr learned my addr 172.21.15.19:0/481717797 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:56:58.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.713+0000 7f7f26d9d640 1 --2- 172.21.15.19:0/481717797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f28102ef0 0x7f7f2819cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:58.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.713+0000 7f7f25d9b640 1 --2- 172.21.15.19:0/481717797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f28102570 0x7f7f28198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:58.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.714+0000 7f7f26d9d640 1 -- 172.21.15.19:0/481717797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f28102570 msgr2=0x7f7f28198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:58.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.714+0000 7f7f26d9d640 1 --2- 172.21.15.19:0/481717797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f28102570 0x7f7f28198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:58.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.714+0000 7f7f26d9d640 1 -- 172.21.15.19:0/481717797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f28100e20 msgr2=0x7f7f281984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:58.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.714+0000 7f7f26d9d640 1 --2- 172.21.15.19:0/481717797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f28100e20 0x7f7f281984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:58.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.714+0000 7f7f26d9d640 1 -- 172.21.15.19:0/481717797 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f2819d4a0 con 0x7f7f28102ef0 2024-09-19T08:56:58.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.714+0000 7f7f2659c640 1 --2- 172.21.15.19:0/481717797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f28100e20 0x7f7f281984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:56:58.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.714+0000 7f7f26d9d640 1 --2- 172.21.15.19:0/481717797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f28102ef0 0x7f7f2819cdc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7f2000ca30 tx=0x7f7f2000cef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:58.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.714+0000 7f7f177fe640 1 -- 172.21.15.19:0/481717797 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f20007d90 con 0x7f7f28102ef0 2024-09-19T08:56:58.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.714+0000 7f7f177fe640 1 -- 172.21.15.19:0/481717797 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7f20005020 con 0x7f7f28102ef0 2024-09-19T08:56:58.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.714+0000 7f7f177fe640 1 -- 172.21.15.19:0/481717797 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f2000f780 con 0x7f7f28102ef0 2024-09-19T08:56:58.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.714+0000 7f7f2ceb6640 1 -- 172.21.15.19:0/481717797 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f2819d790 con 0x7f7f28102ef0 2024-09-19T08:56:58.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.714+0000 7f7f2ceb6640 1 -- 172.21.15.19:0/481717797 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f281a5070 con 0x7f7f28102ef0 2024-09-19T08:56:58.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.715+0000 7f7f2ceb6640 1 -- 172.21.15.19:0/481717797 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f28101200 con 0x7f7f28102ef0 2024-09-19T08:56:58.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.717+0000 7f7f177fe640 1 -- 172.21.15.19:0/481717797 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f7f200051d0 con 0x7f7f28102ef0 2024-09-19T08:56:58.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.717+0000 7f7f177fe640 1 --2- 172.21.15.19:0/481717797 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7f100a3240 0x7f7f100a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:56:58.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.718+0000 7f7f2659c640 1 --2- 172.21.15.19:0/481717797 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7f100a3240 0x7f7f100a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:56:58.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.718+0000 7f7f177fe640 1 -- 172.21.15.19:0/481717797 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7f200cfca0 con 0x7f7f28102ef0 2024-09-19T08:56:58.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.718+0000 7f7f2659c640 1 --2- 172.21.15.19:0/481717797 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7f100a3240 0x7f7f100a5700 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7f18000c00 tx=0x7f7f180046c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:56:58.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.721+0000 7f7f177fe640 1 -- 172.21.15.19:0/481717797 <== mon.2 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7f20014070 con 0x7f7f28102ef0 2024-09-19T08:56:58.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.956+0000 7f7f2ceb6640 1 -- 172.21.15.19:0/481717797 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7f28199850 con 0x7f7f28102ef0 2024-09-19T08:56:58.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.957+0000 7f7f177fe640 1 -- 172.21.15.19:0/481717797 <== mon.2 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11984 (secure 0 0 0) 0x7f7f28199850 con 0x7f7f28102ef0 2024-09-19T08:56:58.958 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:56:58.958 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":33,"btime":"2024-09-19T08:55:57:276679+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2452068876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2452068876},{"type":"v1","addr":"172.21.15.19:6839","nonce":2452068876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T08:55:56.383946+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/2480841559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2480841559},{"type":"v1","addr":"172.21.15.155:6835","nonce":2480841559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24469,24490,24464,24463]},"id":1}]} 2024-09-19T08:56:58.958 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 33 2024-09-19T08:56:58.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.960+0000 7f7f2ceb6640 1 -- 172.21.15.19:0/481717797 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7f100a3240 msgr2=0x7f7f100a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:58.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.960+0000 7f7f2ceb6640 1 --2- 172.21.15.19:0/481717797 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7f100a3240 0x7f7f100a5700 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7f18000c00 tx=0x7f7f180046c0 comp rx=0 tx=0).stop 2024-09-19T08:56:58.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.960+0000 7f7f2ceb6640 1 -- 172.21.15.19:0/481717797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f28102ef0 msgr2=0x7f7f2819cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:56:58.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.960+0000 7f7f2ceb6640 1 --2- 172.21.15.19:0/481717797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f28102ef0 0x7f7f2819cdc0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7f2000ca30 tx=0x7f7f2000cef0 comp rx=0 tx=0).stop 2024-09-19T08:56:58.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.960+0000 7f7f2ceb6640 1 -- 172.21.15.19:0/481717797 shutdown_connections 2024-09-19T08:56:58.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.960+0000 7f7f2ceb6640 1 --2- 172.21.15.19:0/481717797 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7f100a3240 0x7f7f100a5700 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:58.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.960+0000 7f7f2ceb6640 1 --2- 172.21.15.19:0/481717797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f28102570 0x7f7f28198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:58.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.960+0000 7f7f2ceb6640 1 --2- 172.21.15.19:0/481717797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7f28102ef0 0x7f7f2819cdc0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:58.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.960+0000 7f7f2ceb6640 1 --2- 172.21.15.19:0/481717797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7f28100e20 0x7f7f281984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:56:58.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.960+0000 7f7f2ceb6640 1 -- 172.21.15.19:0/481717797 >> 172.21.15.19:0/481717797 conn(0x7f7f280fc7d0 msgr2=0x7f7f280fe180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:56:58.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.960+0000 7f7f2ceb6640 1 -- 172.21.15.19:0/481717797 shutdown_connections 2024-09-19T08:56:58.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:56:58.960+0000 7f7f2ceb6640 1 -- 172.21.15.19:0/481717797 wait complete. 2024-09-19T08:56:59.080 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:56:59.081 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:56:59.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:59 smithi155 ceph-mon[34921]: pgmap v480: 97 pgs: 97 active+clean; 7.9 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 2.07k op/s 2024-09-19T08:56:59.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:56:59 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/481717797' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:59.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:59 smithi203 ceph-mon[35450]: pgmap v480: 97 pgs: 97 active+clean; 7.9 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 2.07k op/s 2024-09-19T08:56:59.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:56:59 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/481717797' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:56:59.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:59 smithi019 ceph-mon[30976]: pgmap v480: 97 pgs: 97 active+clean; 7.9 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.9 MiB/s wr, 2.07k op/s 2024-09-19T08:56:59.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:56:59 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/481717797' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:57:00.325 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0' 2024-09-19T08:57:00.325 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0 2024-09-19T08:57:00.409 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:57:00.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.937+0000 7fb2c2983640 1 -- 172.21.15.19:0/2137411388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2bc1082a0 msgr2=0x7fb2bc10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:00.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.937+0000 7fb2c2983640 1 --2- 172.21.15.19:0/2137411388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2bc1082a0 0x7fb2bc10ec40 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fb2b4009cd0 tx=0x7fb2b402a8e0 comp rx=0 tx=0).stop 2024-09-19T08:57:00.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.937+0000 7fb2c2983640 1 -- 172.21.15.19:0/2137411388 shutdown_connections 2024-09-19T08:57:00.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.937+0000 7fb2c2983640 1 --2- 172.21.15.19:0/2137411388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2bc1082a0 0x7fb2bc10ec40 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:00.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.937+0000 7fb2c2983640 1 --2- 172.21.15.19:0/2137411388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2bc1036e0 0x7fb2bc107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:00.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.937+0000 7fb2c2983640 1 --2- 172.21.15.19:0/2137411388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb2bc102d30 0x7fb2bc103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:00.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.937+0000 7fb2c2983640 1 -- 172.21.15.19:0/2137411388 >> 172.21.15.19:0/2137411388 conn(0x7fb2bc0fc7d0 msgr2=0x7fb2bc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:00.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.937+0000 7fb2c2983640 1 -- 172.21.15.19:0/2137411388 shutdown_connections 2024-09-19T08:57:00.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.937+0000 7fb2c2983640 1 -- 172.21.15.19:0/2137411388 wait complete. 2024-09-19T08:57:00.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.938+0000 7fb2c2983640 1 Processor -- start 2024-09-19T08:57:00.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.938+0000 7fb2c2983640 1 -- start start 2024-09-19T08:57:00.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.938+0000 7fb2c2983640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2bc102d30 0x7fb2bc198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:00.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.938+0000 7fb2c2983640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb2bc1036e0 0x7fb2bc198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:00.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.938+0000 7fb2c2983640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2bc1082a0 0x7fb2bc19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:00.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.938+0000 7fb2c2983640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc1120a0 con 0x7fb2bc102d30 2024-09-19T08:57:00.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.938+0000 7fb2c2983640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc111f20 con 0x7fb2bc1082a0 2024-09-19T08:57:00.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.938+0000 7fb2c2983640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc112220 con 0x7fb2bc1036e0 2024-09-19T08:57:00.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.938+0000 7fb2bbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2bc102d30 0x7fb2bc198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:00.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.938+0000 7fb2bbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2bc102d30 0x7fb2bc198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43138/0 (socket says 172.21.15.19:43138) 2024-09-19T08:57:00.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.938+0000 7fb2bbfff640 1 -- 172.21.15.19:0/2633367320 learned_addr learned my addr 172.21.15.19:0/2633367320 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:00.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.938+0000 7fb2c0f20640 1 --2- 172.21.15.19:0/2633367320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2bc1082a0 0x7fb2bc19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:00.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.939+0000 7fb2b3fff640 1 --2- 172.21.15.19:0/2633367320 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb2bc1036e0 0x7fb2bc198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:00.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.939+0000 7fb2c0f20640 1 -- 172.21.15.19:0/2633367320 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb2bc1036e0 msgr2=0x7fb2bc198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:00.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.939+0000 7fb2c0f20640 1 --2- 172.21.15.19:0/2633367320 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb2bc1036e0 0x7fb2bc198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:00.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.939+0000 7fb2c0f20640 1 -- 172.21.15.19:0/2633367320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2bc102d30 msgr2=0x7fb2bc198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:00.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.939+0000 7fb2c0f20640 1 --2- 172.21.15.19:0/2633367320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2bc102d30 0x7fb2bc198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:00.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.939+0000 7fb2c0f20640 1 -- 172.21.15.19:0/2633367320 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2bc19d4e0 con 0x7fb2bc1082a0 2024-09-19T08:57:00.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.939+0000 7fb2bbfff640 1 --2- 172.21.15.19:0/2633367320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2bc102d30 0x7fb2bc198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:57:00.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.939+0000 7fb2c0f20640 1 --2- 172.21.15.19:0/2633367320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2bc1082a0 0x7fb2bc19ce00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb2b402ae00 tx=0x7fb2b4031e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:00.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.939+0000 7fb2b9ffb640 1 -- 172.21.15.19:0/2633367320 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b4040070 con 0x7fb2bc1082a0 2024-09-19T08:57:00.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.939+0000 7fb2b9ffb640 1 -- 172.21.15.19:0/2633367320 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2b4057070 con 0x7fb2bc1082a0 2024-09-19T08:57:00.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.940+0000 7fb2c2983640 1 -- 172.21.15.19:0/2633367320 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2bc19d770 con 0x7fb2bc1082a0 2024-09-19T08:57:00.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.940+0000 7fb2b9ffb640 1 -- 172.21.15.19:0/2633367320 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b4030ad0 con 0x7fb2bc1082a0 2024-09-19T08:57:00.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.940+0000 7fb2c2983640 1 -- 172.21.15.19:0/2633367320 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2bc1008c0 con 0x7fb2bc1082a0 2024-09-19T08:57:00.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.943+0000 7fb2b9ffb640 1 -- 172.21.15.19:0/2633367320 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fb2b4004620 con 0x7fb2bc1082a0 2024-09-19T08:57:00.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.943+0000 7fb2c4d5c740 1 Processor -- start 2024-09-19T08:57:00.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.944+0000 7fb2c4d5c740 1 -- start start 2024-09-19T08:57:00.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.944+0000 7fb2c4d5c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55587aaf3b60 0x55587aaf3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:00.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.944+0000 7fb2c4d5c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55587aaf4480 0x55587aafe800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:00.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.944+0000 7fb2c4d5c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55587aafed40 0x55587ab01130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:00.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.944+0000 7fb2c4d5c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55587aa59280 con 0x55587aaf3b60 2024-09-19T08:57:00.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.944+0000 7fb2c4d5c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55587aa00b10 con 0x55587aafed40 2024-09-19T08:57:00.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.944+0000 7fb2c4d5c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55587aa55240 con 0x55587aaf4480 2024-09-19T08:57:00.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.944+0000 7fb2b3fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55587aafed40 0x55587ab01130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:00.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.944+0000 7fb2b3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55587aaf3b60 0x55587aaf3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:00.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.945+0000 7fb2b3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55587aaf3b60 0x55587aaf3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43154/0 (socket says 172.21.15.19:43154) 2024-09-19T08:57:00.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.945+0000 7fb2b3fff640 1 -- 172.21.15.19:0/3337750639 learned_addr learned my addr 172.21.15.19:0/3337750639 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:00.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.945+0000 7fb2bbfff640 1 --2- 172.21.15.19:0/3337750639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55587aaf4480 0x55587aafe800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:00.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.946+0000 7fb2bbfff640 1 -- 172.21.15.19:0/3337750639 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55587aafed40 msgr2=0x55587ab01130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:00.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.946+0000 7fb2bbfff640 1 --2- 172.21.15.19:0/3337750639 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55587aafed40 0x55587ab01130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:00.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.946+0000 7fb2bbfff640 1 -- 172.21.15.19:0/3337750639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55587aaf3b60 msgr2=0x55587aaf3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:00.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.946+0000 7fb2bbfff640 1 --2- 172.21.15.19:0/3337750639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55587aaf3b60 0x55587aaf3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:00.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.946+0000 7fb2bbfff640 1 -- 172.21.15.19:0/3337750639 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55587aa0d1f0 con 0x55587aaf4480 2024-09-19T08:57:00.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.947+0000 7fb2b9ffb640 1 --2- 172.21.15.19:0/2633367320 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb2a80a32c0 0x7fb2a80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:00.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.947+0000 7fb2b3fff640 1 --2- 172.21.15.19:0/3337750639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55587aaf3b60 0x55587aaf3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:57:00.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.947+0000 7fb2b9ffb640 1 -- 172.21.15.19:0/2633367320 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb2b402e020 con 0x7fb2bc1082a0 2024-09-19T08:57:00.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.948+0000 7fb2bbfff640 1 --2- 172.21.15.19:0/3337750639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55587aaf4480 0x55587aafe800 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac00d460 tx=0x7fb2ac00f820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1298ab2f7fbb1ef5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:00.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.948+0000 7fb2b3fff640 1 --2- 172.21.15.19:0/2633367320 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb2a80a32c0 0x7fb2a80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:00.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.948+0000 7fb2b27fc640 1 -- 172.21.15.19:0/3337750639 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac00b4a0 con 0x55587aaf4480 2024-09-19T08:57:00.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.948+0000 7fb2b27fc640 1 -- 172.21.15.19:0/3337750639 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2ac00bb20 con 0x55587aaf4480 2024-09-19T08:57:00.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.948+0000 7fb2b27fc640 1 -- 172.21.15.19:0/3337750639 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac019b70 con 0x55587aaf4480 2024-09-19T08:57:00.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.949+0000 7fb2c4d5c740 1 -- 172.21.15.19:0/3337750639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55587aaf4480 msgr2=0x55587aafe800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:00.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.949+0000 7fb2c4d5c740 1 --2- 172.21.15.19:0/3337750639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55587aaf4480 0x55587aafe800 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac00d460 tx=0x7fb2ac00f820 comp rx=0 tx=0).stop 2024-09-19T08:57:00.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.949+0000 7fb2b3fff640 1 --2- 172.21.15.19:0/2633367320 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb2a80a32c0 0x7fb2a80a5780 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x55587aaf1470 tx=0x7fb2a4012040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:00.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.950+0000 7fb2c4d5c740 1 -- 172.21.15.19:0/3337750639 shutdown_connections 2024-09-19T08:57:00.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.950+0000 7fb2c4d5c740 1 --2- 172.21.15.19:0/3337750639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55587aaf4480 0x55587aafe800 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:00.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.950+0000 7fb2c4d5c740 1 --2- 172.21.15.19:0/3337750639 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55587aafed40 0x55587ab01130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:00.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.950+0000 7fb2c4d5c740 1 --2- 172.21.15.19:0/3337750639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55587aaf3b60 0x55587aaf3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:00.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.950+0000 7fb2c4d5c740 1 -- 172.21.15.19:0/3337750639 >> 172.21.15.19:0/3337750639 conn(0x55587aaf00f0 msgr2=0x55587aaf04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:00.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.950+0000 7fb2c4d5c740 1 -- 172.21.15.19:0/3337750639 shutdown_connections 2024-09-19T08:57:00.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.950+0000 7fb2c4d5c740 1 -- 172.21.15.19:0/3337750639 wait complete. 2024-09-19T08:57:00.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.951+0000 7fb2c4d5c740 1 -- start start 2024-09-19T08:57:00.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.951+0000 7fb2c4d5c740 1 Processor -- start 2024-09-19T08:57:00.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.952+0000 7fb2c4d5c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55587aaf3b60 0x55587aafbc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:00.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.952+0000 7fb2c4d5c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55587aaf4480 0x55587aafc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:00.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.952+0000 7fb2c4d5c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55587aafed40 0x55587aafc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:00.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.952+0000 7fb2c4d5c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55587ab01910 con 0x55587aaf4480 2024-09-19T08:57:00.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.952+0000 7fb2c4d5c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55587aa13f10 con 0x55587aafed40 2024-09-19T08:57:00.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.952+0000 7fb2bbfff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55587aaf3b60 0x55587aafbc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:00.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.952+0000 7fb2c4d5c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55587ab01a90 con 0x55587aaf3b60 2024-09-19T08:57:00.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.952+0000 7fb2bbfff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55587aaf3b60 0x55587aafbc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:42096/0 (socket says 172.21.15.19:42096) 2024-09-19T08:57:00.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.952+0000 7fb2bbfff640 1 -- 172.21.15.19:0/4173485141 learned_addr learned my addr 172.21.15.19:0/4173485141 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:00.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.952+0000 7fb2c4d5c740 10 client.0 _ll_register_callbacks cb 0x55587a9dca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:00.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.952+0000 7fb2c0f20640 1 --2- 172.21.15.19:0/4173485141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55587aafed40 0x55587aafc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:00.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.953+0000 7fb2b3fff640 1 --2- 172.21.15.19:0/4173485141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55587aaf4480 0x55587aafc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:00.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.953+0000 7fb2bbfff640 1 -- 172.21.15.19:0/4173485141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55587aafed40 msgr2=0x55587aafc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:00.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.953+0000 7fb2bbfff640 1 --2- 172.21.15.19:0/4173485141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55587aafed40 0x55587aafc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:00.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.953+0000 7fb2bbfff640 1 -- 172.21.15.19:0/4173485141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55587aaf4480 msgr2=0x55587aafc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:00.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.953+0000 7fb2bbfff640 1 --2- 172.21.15.19:0/4173485141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55587aaf4480 0x55587aafc160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:00.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.953+0000 7fb2bbfff640 1 -- 172.21.15.19:0/4173485141 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55587a7ca6a0 con 0x55587aaf3b60 2024-09-19T08:57:00.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.953+0000 7fb2b3fff640 1 --2- 172.21.15.19:0/4173485141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55587aaf4480 0x55587aafc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:57:00.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.953+0000 7fb2bbfff640 1 --2- 172.21.15.19:0/4173485141 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55587aaf3b60 0x55587aafbc20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac00bfd0 tx=0x7fb2ac00b4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=600e633720ef7dac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:00.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.953+0000 7fb29b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T08:57:00.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.953+0000 7fb29b7fe640 1 -- 172.21.15.19:0/4173485141 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac028020 con 0x55587aaf3b60 2024-09-19T08:57:00.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.953+0000 7fb2c4d5c740 1 -- 172.21.15.19:0/4173485141 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2ac00bb20 con 0x55587aaf3b60 2024-09-19T08:57:00.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.953+0000 7fb29b7fe640 1 -- 172.21.15.19:0/4173485141 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb2ac00b850 con 0x55587aaf3b60 2024-09-19T08:57:00.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.954+0000 7fb29b7fe640 1 -- 172.21.15.19:0/4173485141 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb2ac0197b0 con 0x55587aaf3b60 2024-09-19T08:57:00.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.954+0000 7fb2c4d5c740 10 client.25999 fetch_fsmap learned FSMap version 33 2024-09-19T08:57:00.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.954+0000 7fb2c4d5c740 1 -- 172.21.15.19:0/4173485141 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55587ab0d550 con 0x55587aaf3b60 2024-09-19T08:57:00.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.954+0000 7fb29b7fe640 1 -- 172.21.15.19:0/4173485141 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2ac00bb20 con 0x55587aaf3b60 2024-09-19T08:57:00.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.954+0000 7fb29b7fe640 1 -- 172.21.15.19:0/4173485141 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7fb2ac023b30 con 0x55587aaf3b60 2024-09-19T08:57:00.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.954+0000 7fb2c4d5c740 10 client.25999 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:57:00.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.954+0000 7fb2c4d5c740 10 client.25999 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:57:00.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.954+0000 7fb2c4d5c740 20 client.25999 populate_metadata read hostname 'smithi019' 2024-09-19T08:57:00.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.954+0000 7fb2c4d5c740 1 --2- 172.21.15.19:0/4173485141 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55587ab0ed40 0x55587ab11200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:00.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.954+0000 7fb2c4d5c740 4 client.25999 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:57:00.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.954+0000 7fb2c4d5c740 1 -- 172.21.15.19:0/4173485141 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55587aa667f0 con 0x55587ab0ed40 2024-09-19T08:57:00.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.954+0000 7fb2b3fff640 1 --2- 172.21.15.19:0/4173485141 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55587ab0ed40 0x55587ab11200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:00.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.955+0000 7fb29b7fe640 10 client.25999 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:57:00.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.955+0000 7fb2b3fff640 1 --2- 172.21.15.19:0/4173485141 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55587ab0ed40 0x55587ab11200 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=425cc9e0aa24594 server_cookie=d0343c40e9f213d8 in_seq=0 out_seq=0 2024-09-19T08:57:00.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.959+0000 7fb29b7fe640 1 -- 172.21.15.19:0/4173485141 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55587aa667f0 con 0x55587ab0ed40 2024-09-19T08:57:00.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.959+0000 7fb29b7fe640 10 client.25999 handle_command_reply: tid=0 2024-09-19T08:57:00.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.959+0000 7fb2c4d5c740 1 client.25999 shutdown 2024-09-19T08:57:00.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.960+0000 7fb2c4d5c740 1 -- 172.21.15.19:0/4173485141 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55587aaf3b60 msgr2=0x55587aafbc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:00.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.960+0000 7fb2c4d5c740 1 --2- 172.21.15.19:0/4173485141 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55587aaf3b60 0x55587aafbc20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac00bfd0 tx=0x7fb2ac00b4a0 comp rx=0 tx=0).stop 2024-09-19T08:57:00.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.960+0000 7fb2c4d5c740 1 -- 172.21.15.19:0/4173485141 shutdown_connections 2024-09-19T08:57:00.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.960+0000 7fb2c4d5c740 1 --2- 172.21.15.19:0/4173485141 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55587ab0ed40 0x55587ab11200 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:00.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.960+0000 7fb2c4d5c740 1 --2- 172.21.15.19:0/4173485141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55587aafed40 0x55587aafc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:00.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.960+0000 7fb2c4d5c740 1 --2- 172.21.15.19:0/4173485141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55587aaf4480 0x55587aafc160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:00.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.960+0000 7fb29b7fe640 0 client.25999 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:57:00.961 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.960+0000 7fb2c4d5c740 1 --2- 172.21.15.19:0/4173485141 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55587aaf3b60 0x55587aafbc20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:00.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.960+0000 7fb2c4d5c740 1 -- 172.21.15.19:0/4173485141 >> 172.21.15.19:0/4173485141 conn(0x55587aaf00f0 msgr2=0x55587aaef270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:00.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.960+0000 7fb2c4d5c740 1 -- 172.21.15.19:0/4173485141 shutdown_connections 2024-09-19T08:57:00.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.960+0000 7fb2c4d5c740 1 -- 172.21.15.19:0/4173485141 wait complete. 2024-09-19T08:57:00.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.960+0000 7fb2c4d5c740 20 client.25999 trim_cache size 0 max 16384 2024-09-19T08:57:00.970 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:57:00.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.982+0000 7fb2c4d5c740 1 Processor -- start 2024-09-19T08:57:00.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.982+0000 7fb2c4d5c740 1 -- start start 2024-09-19T08:57:00.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.982+0000 7fb2c4d5c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55587aaf3b60 0x55587aaf65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:00.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.982+0000 7fb2c4d5c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55587aaf4480 0x55587aafda80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:00.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.982+0000 7fb2c4d5c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55587aafed40 0x55587ab16ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:00.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.982+0000 7fb2c4d5c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc1ab260 con 0x55587aaf4480 2024-09-19T08:57:00.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.982+0000 7fb2c4d5c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc1acdd0 con 0x55587aafed40 2024-09-19T08:57:00.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.982+0000 7fb2c4d5c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc1ab930 con 0x55587aaf3b60 2024-09-19T08:57:00.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.982+0000 7fb2b3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55587aaf4480 0x55587aafda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:00.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.983+0000 7fb2c0f20640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55587aafed40 0x55587ab16ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:00.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.983+0000 7fb2b3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55587aaf4480 0x55587aafda80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43178/0 (socket says 172.21.15.19:43178) 2024-09-19T08:57:00.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.983+0000 7fb2b3fff640 1 -- 172.21.15.19:0/708304819 learned_addr learned my addr 172.21.15.19:0/708304819 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:00.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.983+0000 7fb2bbfff640 1 --2- 172.21.15.19:0/708304819 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55587aaf3b60 0x55587aaf65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:00.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.983+0000 7fb2bbfff640 1 -- 172.21.15.19:0/708304819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55587aafed40 msgr2=0x55587ab16ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:00.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.983+0000 7fb2bbfff640 1 --2- 172.21.15.19:0/708304819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55587aafed40 0x55587ab16ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:00.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.983+0000 7fb2bbfff640 1 -- 172.21.15.19:0/708304819 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55587aaf4480 msgr2=0x55587aafda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:00.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.983+0000 7fb2bbfff640 1 --2- 172.21.15.19:0/708304819 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55587aaf4480 0x55587aafda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:00.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.983+0000 7fb2bbfff640 1 -- 172.21.15.19:0/708304819 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55587aaf42b0 con 0x55587aaf3b60 2024-09-19T08:57:00.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.983+0000 7fb2c0f20640 1 --2- 172.21.15.19:0/708304819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55587aafed40 0x55587ab16ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:57:00.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.983+0000 7fb2bbfff640 1 --2- 172.21.15.19:0/708304819 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55587aaf3b60 0x55587aaf65c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac019780 tx=0x7fb2ac00f820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e1dc67a312cd1ed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:00.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.983+0000 7fb2b1ffb640 1 -- 172.21.15.19:0/708304819 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac028070 con 0x55587aaf3b60 2024-09-19T08:57:00.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.984+0000 7fb2b1ffb640 1 -- 172.21.15.19:0/708304819 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2ac00ddb0 con 0x55587aaf3b60 2024-09-19T08:57:00.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.984+0000 7fb2b1ffb640 1 -- 172.21.15.19:0/708304819 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac019c80 con 0x55587aaf3b60 2024-09-19T08:57:00.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.984+0000 7fb2c4d5c740 1 -- 172.21.15.19:0/708304819 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55587aaf3b60 msgr2=0x55587aaf65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:00.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.984+0000 7fb2c4d5c740 1 --2- 172.21.15.19:0/708304819 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55587aaf3b60 0x55587aaf65c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac019780 tx=0x7fb2ac00f820 comp rx=0 tx=0).stop 2024-09-19T08:57:00.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.984+0000 7fb2c4d5c740 1 -- 172.21.15.19:0/708304819 shutdown_connections 2024-09-19T08:57:00.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.984+0000 7fb2c4d5c740 1 --2- 172.21.15.19:0/708304819 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55587aafed40 0x55587ab16ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:00.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.984+0000 7fb2c4d5c740 1 --2- 172.21.15.19:0/708304819 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55587aaf4480 0x55587aafda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:00.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.984+0000 7fb2c4d5c740 1 --2- 172.21.15.19:0/708304819 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55587aaf3b60 0x55587aaf65c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:00.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.984+0000 7fb2c4d5c740 1 -- 172.21.15.19:0/708304819 >> 172.21.15.19:0/708304819 conn(0x55587aaf00f0 msgr2=0x55587aafd370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:00.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.985+0000 7fb2c4d5c740 1 -- 172.21.15.19:0/708304819 shutdown_connections 2024-09-19T08:57:00.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.985+0000 7fb2c4d5c740 1 -- 172.21.15.19:0/708304819 wait complete. 2024-09-19T08:57:00.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.985+0000 7fb2c4d5c740 1 -- start start 2024-09-19T08:57:00.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.985+0000 7fb2c4d5c740 1 Processor -- start 2024-09-19T08:57:00.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.985+0000 7fb2c4d5c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55587aaf3b60 0x55587ab07130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:00.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.986+0000 7fb2c4d5c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55587aaf4480 0x55587ab07670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:00.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.986+0000 7fb2c4d5c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55587aafed40 0x55587ab026b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:00.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.986+0000 7fb2c4d5c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc1ac700 con 0x55587aaf3b60 2024-09-19T08:57:00.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.986+0000 7fb2c4d5c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc1ac030 con 0x55587aafed40 2024-09-19T08:57:00.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.986+0000 7fb2c4d5c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc1a9240 con 0x55587aaf4480 2024-09-19T08:57:00.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.986+0000 7fb2c4d5c740 10 client.0 _ll_register_callbacks cb 0x7fb2a40097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:00.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.986+0000 7fb2bbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55587aaf3b60 0x55587ab07130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:00.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.986+0000 7fb2bbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55587aaf3b60 0x55587ab07130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43182/0 (socket says 172.21.15.19:43182) 2024-09-19T08:57:00.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.986+0000 7fb2bbfff640 1 -- 172.21.15.19:0/466399895 learned_addr learned my addr 172.21.15.19:0/466399895 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:00.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.986+0000 7fb2c0f20640 1 --2- 172.21.15.19:0/466399895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55587aafed40 0x55587ab026b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:00.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.986+0000 7fb2b3fff640 1 --2- 172.21.15.19:0/466399895 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55587aaf4480 0x55587ab07670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:00.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.986+0000 7fb2bbfff640 1 -- 172.21.15.19:0/466399895 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55587aaf4480 msgr2=0x55587ab07670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:00.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.986+0000 7fb2bbfff640 1 --2- 172.21.15.19:0/466399895 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55587aaf4480 0x55587ab07670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:00.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.986+0000 7fb2bbfff640 1 -- 172.21.15.19:0/466399895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55587aafed40 msgr2=0x55587ab026b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:00.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.986+0000 7fb2bbfff640 1 --2- 172.21.15.19:0/466399895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55587aafed40 0x55587ab026b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:00.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.986+0000 7fb2bbfff640 1 -- 172.21.15.19:0/466399895 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55587ab02ee0 con 0x55587aaf3b60 2024-09-19T08:57:00.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.986+0000 7fb2b3fff640 1 --2- 172.21.15.19:0/466399895 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55587aaf4480 0x55587ab07670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:57:00.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.986+0000 7fb2bbfff640 1 --2- 172.21.15.19:0/466399895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55587aaf3b60 0x55587ab07130 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac00f990 tx=0x7fb2ac00f420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18c7127787fed81c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:00.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.986+0000 7fb29b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:57:00.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.987+0000 7fb29b7fe640 1 -- 172.21.15.19:0/466399895 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac03c070 con 0x55587aaf3b60 2024-09-19T08:57:00.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.987+0000 7fb29b7fe640 1 -- 172.21.15.19:0/466399895 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb2ac019950 con 0x55587aaf3b60 2024-09-19T08:57:00.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.987+0000 7fb2c4d5c740 1 -- 172.21.15.19:0/466399895 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb2ac00ddb0 con 0x55587aaf3b60 2024-09-19T08:57:00.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.987+0000 7fb29b7fe640 1 -- 172.21.15.19:0/466399895 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb2ac048050 con 0x55587aaf3b60 2024-09-19T08:57:00.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.987+0000 7fb2c4d5c740 10 client.16530 fetch_fsmap learned FSMap version 33 2024-09-19T08:57:00.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.987+0000 7fb2c4d5c740 1 -- 172.21.15.19:0/466399895 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55587ab79790 con 0x55587aaf3b60 2024-09-19T08:57:00.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.987+0000 7fb29b7fe640 1 -- 172.21.15.19:0/466399895 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb2ac00ddb0 con 0x55587aaf3b60 2024-09-19T08:57:00.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.987+0000 7fb29b7fe640 1 -- 172.21.15.19:0/466399895 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7fb2ac004730 con 0x55587aaf3b60 2024-09-19T08:57:00.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.987+0000 7fb2c4d5c740 10 client.16530 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:57:00.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.987+0000 7fb2c4d5c740 10 client.16530 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:57:00.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.987+0000 7fb2c4d5c740 20 client.16530 populate_metadata read hostname 'smithi019' 2024-09-19T08:57:00.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.987+0000 7fb2c4d5c740 1 --2- 172.21.15.19:0/466399895 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55587ab0ed40 0x55587ab7be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:00.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.987+0000 7fb2c4d5c740 4 client.16530 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:57:00.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.987+0000 7fb2c4d5c740 1 -- 172.21.15.19:0/466399895 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55587aa60d00 con 0x55587ab0ed40 2024-09-19T08:57:00.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.988+0000 7fb2b3fff640 1 --2- 172.21.15.19:0/466399895 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55587ab0ed40 0x55587ab7be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:00.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.988+0000 7fb29b7fe640 10 client.16530 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:57:00.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:00.988+0000 7fb2b3fff640 1 --2- 172.21.15.19:0/466399895 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55587ab0ed40 0x55587ab7be00 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d066526c99c4bf1e server_cookie=80ab2c42c923223f in_seq=0 out_seq=0 2024-09-19T08:57:01.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:01.002+0000 7fb29b7fe640 1 -- 172.21.15.19:0/466399895 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55587aa60d00 con 0x55587ab0ed40 2024-09-19T08:57:01.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:01.002+0000 7fb29b7fe640 10 client.16530 handle_command_reply: tid=0 2024-09-19T08:57:01.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:01.002+0000 7fb2c4d5c740 1 client.16530 shutdown 2024-09-19T08:57:01.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:01.003+0000 7fb2c4d5c740 1 -- 172.21.15.19:0/466399895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55587aaf3b60 msgr2=0x55587ab07130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:01.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:01.003+0000 7fb2c4d5c740 1 --2- 172.21.15.19:0/466399895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55587aaf3b60 0x55587ab07130 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac00f990 tx=0x7fb2ac00f420 comp rx=0 tx=0).stop 2024-09-19T08:57:01.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:01.003+0000 7fb2c4d5c740 1 -- 172.21.15.19:0/466399895 shutdown_connections 2024-09-19T08:57:01.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:01.003+0000 7fb2c4d5c740 1 --2- 172.21.15.19:0/466399895 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55587ab0ed40 0x55587ab7be00 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:01.003+0000 7fb2c4d5c740 1 --2- 172.21.15.19:0/466399895 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55587aaf4480 0x55587ab07670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:01.003+0000 7fb29b7fe640 0 client.16530 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:57:01.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:01.003+0000 7fb2c4d5c740 1 --2- 172.21.15.19:0/466399895 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55587aafed40 0x55587ab026b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:01.003+0000 7fb2c4d5c740 1 --2- 172.21.15.19:0/466399895 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55587aaf3b60 0x55587ab07130 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:01.003+0000 7fb2c4d5c740 1 -- 172.21.15.19:0/466399895 >> 172.21.15.19:0/466399895 conn(0x55587aaf00f0 msgr2=0x55587aaef270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:01.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:01.004+0000 7fb2c4d5c740 1 -- 172.21.15.19:0/466399895 shutdown_connections 2024-09-19T08:57:01.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:01.004+0000 7fb2c4d5c740 1 -- 172.21.15.19:0/466399895 wait complete. 2024-09-19T08:57:01.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:01.004+0000 7fb2c4d5c740 20 client.16530 trim_cache size 0 max 16384 2024-09-19T08:57:01.005 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:57:01.005 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-19T08:57:01.005 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "47374fe5-f9de-44f5-8d9e-4282ecef02b9", 2024-09-19T08:57:01.005 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-19T08:57:01.005 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:57:01.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:01.005+0000 7fb2c2983640 1 -- 172.21.15.19:0/2633367320 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb2a80a32c0 msgr2=0x7fb2a80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:01.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:01.005+0000 7fb2c2983640 1 --2- 172.21.15.19:0/2633367320 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb2a80a32c0 0x7fb2a80a5780 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x55587aaf1470 tx=0x7fb2a4012040 comp rx=0 tx=0).stop 2024-09-19T08:57:01.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:01.005+0000 7fb2c2983640 1 -- 172.21.15.19:0/2633367320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2bc1082a0 msgr2=0x7fb2bc19ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:01.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:01.005+0000 7fb2c2983640 1 --2- 172.21.15.19:0/2633367320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2bc1082a0 0x7fb2bc19ce00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb2b402ae00 tx=0x7fb2b4031e60 comp rx=0 tx=0).stop 2024-09-19T08:57:01.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:01.005+0000 7fb2c2983640 1 -- 172.21.15.19:0/2633367320 shutdown_connections 2024-09-19T08:57:01.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:01.005+0000 7fb2c2983640 1 --2- 172.21.15.19:0/2633367320 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb2a80a32c0 0x7fb2a80a5780 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:01.005+0000 7fb2c2983640 1 --2- 172.21.15.19:0/2633367320 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb2bc1036e0 0x7fb2bc198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:01.005+0000 7fb2c2983640 1 --2- 172.21.15.19:0/2633367320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb2bc1082a0 0x7fb2bc19ce00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:01.005+0000 7fb2c2983640 1 --2- 172.21.15.19:0/2633367320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb2bc102d30 0x7fb2bc198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:01.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:01.005+0000 7fb2c2983640 1 -- 172.21.15.19:0/2633367320 >> 172.21.15.19:0/2633367320 conn(0x7fb2bc0fc7d0 msgr2=0x7fb2bc105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:01.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:01.005+0000 7fb2c2983640 1 -- 172.21.15.19:0/2633367320 shutdown_connections 2024-09-19T08:57:01.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:01.005+0000 7fb2c2983640 1 -- 172.21.15.19:0/2633367320 wait complete. 2024-09-19T08:57:01.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:01 smithi019 ceph-mon[30976]: pgmap v481: 97 pgs: 97 active+clean; 7.9 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 KiB/s rd, 1.6 MiB/s wr, 2.07k op/s 2024-09-19T08:57:01.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:01 smithi019 ceph-mon[30976]: scrub queued for path: / 2024-09-19T08:57:01.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:01 smithi019 ceph-mon[30976]: scrub summary: idle+waiting paths [/] 2024-09-19T08:57:01.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:01 smithi019 ceph-mon[30976]: scrub summary: active paths [/] 2024-09-19T08:57:01.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:01 smithi155 ceph-mon[34921]: pgmap v481: 97 pgs: 97 active+clean; 7.9 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 KiB/s rd, 1.6 MiB/s wr, 2.07k op/s 2024-09-19T08:57:01.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:01 smithi155 ceph-mon[34921]: scrub queued for path: / 2024-09-19T08:57:01.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:01 smithi155 ceph-mon[34921]: scrub summary: idle+waiting paths [/] 2024-09-19T08:57:01.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:01 smithi155 ceph-mon[34921]: scrub summary: active paths [/] 2024-09-19T08:57:01.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:01 smithi203 ceph-mon[35450]: pgmap v481: 97 pgs: 97 active+clean; 7.9 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 KiB/s rd, 1.6 MiB/s wr, 2.07k op/s 2024-09-19T08:57:01.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:01 smithi203 ceph-mon[35450]: scrub queued for path: / 2024-09-19T08:57:01.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:01 smithi203 ceph-mon[35450]: scrub summary: idle+waiting paths [/] 2024-09-19T08:57:01.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:01 smithi203 ceph-mon[35450]: scrub summary: active paths [/] 2024-09-19T08:57:02.442 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:57:02.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.690+0000 7fd7826cf640 1 -- 172.21.15.19:0/4097877247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd77c101e20 msgr2=0x7fd77c1056b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:02.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.690+0000 7fd7826cf640 1 --2- 172.21.15.19:0/4097877247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd77c101e20 0x7fd77c1056b0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fd770009900 tx=0x7fd77002a410 comp rx=0 tx=0).stop 2024-09-19T08:57:02.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.690+0000 7fd7826cf640 1 -- 172.21.15.19:0/4097877247 shutdown_connections 2024-09-19T08:57:02.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.690+0000 7fd7826cf640 1 --2- 172.21.15.19:0/4097877247 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd77c105de0 0x7fd77c10d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:02.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.690+0000 7fd7826cf640 1 --2- 172.21.15.19:0/4097877247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd77c101e20 0x7fd77c1056b0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:02.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.690+0000 7fd7826cf640 1 --2- 172.21.15.19:0/4097877247 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd77c101470 0x7fd77c101850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:02.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.690+0000 7fd7826cf640 1 -- 172.21.15.19:0/4097877247 >> 172.21.15.19:0/4097877247 conn(0x7fd77c077230 msgr2=0x7fd77c0fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:02.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.690+0000 7fd7826cf640 1 -- 172.21.15.19:0/4097877247 shutdown_connections 2024-09-19T08:57:02.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.690+0000 7fd7826cf640 1 -- 172.21.15.19:0/4097877247 wait complete. 2024-09-19T08:57:02.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.691+0000 7fd7826cf640 1 Processor -- start 2024-09-19T08:57:02.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.691+0000 7fd7826cf640 1 -- start start 2024-09-19T08:57:02.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.692+0000 7fd7826cf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd77c101470 0x7fd77c1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:02.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.692+0000 7fd7826cf640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd77c101e20 0x7fd77c198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:02.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.692+0000 7fd7826cf640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd77c105de0 0x7fd77c19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:02.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.692+0000 7fd7826cf640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd77c110e00 con 0x7fd77c101470 2024-09-19T08:57:02.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.692+0000 7fd7826cf640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd77c110c80 con 0x7fd77c101e20 2024-09-19T08:57:02.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.692+0000 7fd7826cf640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd77c110f80 con 0x7fd77c105de0 2024-09-19T08:57:02.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.692+0000 7fd77bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd77c101470 0x7fd77c1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:02.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.692+0000 7fd77bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd77c101470 0x7fd77c1983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43198/0 (socket says 172.21.15.19:43198) 2024-09-19T08:57:02.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.692+0000 7fd77bfff640 1 -- 172.21.15.19:0/576201629 learned_addr learned my addr 172.21.15.19:0/576201629 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:02.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.692+0000 7fd77b7fe640 1 --2- 172.21.15.19:0/576201629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd77c101e20 0x7fd77c198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:02.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.692+0000 7fd780c6c640 1 --2- 172.21.15.19:0/576201629 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd77c105de0 0x7fd77c19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:02.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.692+0000 7fd77bfff640 1 -- 172.21.15.19:0/576201629 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd77c105de0 msgr2=0x7fd77c19cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:02.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.692+0000 7fd77bfff640 1 --2- 172.21.15.19:0/576201629 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd77c105de0 0x7fd77c19cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:02.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.692+0000 7fd77bfff640 1 -- 172.21.15.19:0/576201629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd77c101e20 msgr2=0x7fd77c198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:02.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.692+0000 7fd77bfff640 1 --2- 172.21.15.19:0/576201629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd77c101e20 0x7fd77c198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:02.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.692+0000 7fd77bfff640 1 -- 172.21.15.19:0/576201629 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd77c19d380 con 0x7fd77c101470 2024-09-19T08:57:02.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.693+0000 7fd77bfff640 1 --2- 172.21.15.19:0/576201629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd77c101470 0x7fd77c1983d0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fd76c00c920 tx=0x7fd76c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:02.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.693+0000 7fd7797fa640 1 -- 172.21.15.19:0/576201629 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c007c70 con 0x7fd77c101470 2024-09-19T08:57:02.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.693+0000 7fd7797fa640 1 -- 172.21.15.19:0/576201629 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd76c007e10 con 0x7fd77c101470 2024-09-19T08:57:02.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.693+0000 7fd7797fa640 1 -- 172.21.15.19:0/576201629 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c018890 con 0x7fd77c101470 2024-09-19T08:57:02.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.693+0000 7fd7826cf640 1 -- 172.21.15.19:0/576201629 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd77c19d670 con 0x7fd77c101470 2024-09-19T08:57:02.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.693+0000 7fd7826cf640 1 -- 172.21.15.19:0/576201629 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd77c1a4f50 con 0x7fd77c101470 2024-09-19T08:57:02.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.696+0000 7fd7797fa640 1 -- 172.21.15.19:0/576201629 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fd76c018a70 con 0x7fd77c101470 2024-09-19T08:57:02.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.696+0000 7fd7797fa640 1 --2- 172.21.15.19:0/576201629 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd7640a3240 0x7fd7640a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:02.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.696+0000 7fd77b7fe640 1 --2- 172.21.15.19:0/576201629 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd7640a3240 0x7fd7640a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:02.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.696+0000 7fd7797fa640 1 -- 172.21.15.19:0/576201629 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd76c0cfab0 con 0x7fd77c101470 2024-09-19T08:57:02.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.697+0000 7fd784aa8740 1 Processor -- start 2024-09-19T08:57:02.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.697+0000 7fd784aa8740 1 -- start start 2024-09-19T08:57:02.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.697+0000 7fd784aa8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56231d29c760 0x56231d29cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:02.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.697+0000 7fd784aa8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56231d29d080 0x56231d2a7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:02.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.697+0000 7fd77b7fe640 1 --2- 172.21.15.19:0/576201629 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd7640a3240 0x7fd7640a5700 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd770009230 tx=0x7fd7700058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:02.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.697+0000 7fd784aa8740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56231d2a7940 0x56231d2a9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:02.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.697+0000 7fd784aa8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56231d2022a0 con 0x56231d29c760 2024-09-19T08:57:02.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.697+0000 7fd784aa8740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56231d1a9b10 con 0x56231d2a7940 2024-09-19T08:57:02.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.697+0000 7fd784aa8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56231d1fe260 con 0x56231d29d080 2024-09-19T08:57:02.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.697+0000 7fd77bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56231d29c760 0x56231d29cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:02.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.697+0000 7fd77bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56231d29c760 0x56231d29cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43204/0 (socket says 172.21.15.19:43204) 2024-09-19T08:57:02.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.697+0000 7fd77bfff640 1 -- 172.21.15.19:0/2617350302 learned_addr learned my addr 172.21.15.19:0/2617350302 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:02.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.697+0000 7fd77b7fe640 1 --2- 172.21.15.19:0/2617350302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56231d29d080 0x56231d2a7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:02.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.697+0000 7fd780c6c640 1 --2- 172.21.15.19:0/2617350302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56231d2a7940 0x56231d2a9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:02.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.698+0000 7fd77bfff640 1 -- 172.21.15.19:0/2617350302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56231d29d080 msgr2=0x56231d2a7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:02.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.698+0000 7fd77bfff640 1 --2- 172.21.15.19:0/2617350302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56231d29d080 0x56231d2a7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:02.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.698+0000 7fd77bfff640 1 -- 172.21.15.19:0/2617350302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56231d2a7940 msgr2=0x56231d2a9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:02.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.698+0000 7fd77bfff640 1 --2- 172.21.15.19:0/2617350302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56231d2a7940 0x56231d2a9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:02.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.698+0000 7fd77bfff640 1 -- 172.21.15.19:0/2617350302 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56231cf73b90 con 0x56231d29c760 2024-09-19T08:57:02.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.698+0000 7fd77bfff640 1 --2- 172.21.15.19:0/2617350302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56231d29c760 0x56231d29cb40 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fd76c09bd80 tx=0x7fd76c09c140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28ee1d282dc092d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:02.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.698+0000 7fd7627fc640 1 -- 172.21.15.19:0/2617350302 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c09a380 con 0x56231d29c760 2024-09-19T08:57:02.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.698+0000 7fd7627fc640 1 -- 172.21.15.19:0/2617350302 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd76c0b5070 con 0x56231d29c760 2024-09-19T08:57:02.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.698+0000 7fd7627fc640 1 -- 172.21.15.19:0/2617350302 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c0a00f0 con 0x56231d29c760 2024-09-19T08:57:02.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.699+0000 7fd784aa8740 1 -- 172.21.15.19:0/2617350302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56231d29c760 msgr2=0x56231d29cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:02.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.699+0000 7fd784aa8740 1 --2- 172.21.15.19:0/2617350302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56231d29c760 0x56231d29cb40 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fd76c09bd80 tx=0x7fd76c09c140 comp rx=0 tx=0).stop 2024-09-19T08:57:02.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.699+0000 7fd784aa8740 1 -- 172.21.15.19:0/2617350302 shutdown_connections 2024-09-19T08:57:02.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.699+0000 7fd784aa8740 1 --2- 172.21.15.19:0/2617350302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56231d29d080 0x56231d2a7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:02.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.699+0000 7fd784aa8740 1 --2- 172.21.15.19:0/2617350302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56231d2a7940 0x56231d2a9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:02.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.699+0000 7fd784aa8740 1 --2- 172.21.15.19:0/2617350302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56231d29c760 0x56231d29cb40 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:02.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.699+0000 7fd784aa8740 1 -- 172.21.15.19:0/2617350302 >> 172.21.15.19:0/2617350302 conn(0x56231d298cf0 msgr2=0x56231d2990d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:02.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.699+0000 7fd784aa8740 1 -- 172.21.15.19:0/2617350302 shutdown_connections 2024-09-19T08:57:02.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.699+0000 7fd784aa8740 1 -- 172.21.15.19:0/2617350302 wait complete. 2024-09-19T08:57:02.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.699+0000 7fd784aa8740 1 -- start start 2024-09-19T08:57:02.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.700+0000 7fd784aa8740 1 Processor -- start 2024-09-19T08:57:02.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.700+0000 7fd784aa8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56231d29c760 0x56231d2a4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:02.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.700+0000 7fd784aa8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56231d29d080 0x56231d2a4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:02.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.700+0000 7fd784aa8740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56231d2a7940 0x56231d2a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:02.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.700+0000 7fd784aa8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56231d2aa510 con 0x56231d29c760 2024-09-19T08:57:02.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.700+0000 7fd784aa8740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56231d18a6e0 con 0x56231d2a7940 2024-09-19T08:57:02.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.700+0000 7fd784aa8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56231d2aa690 con 0x56231d29d080 2024-09-19T08:57:02.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.700+0000 7fd77bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56231d29c760 0x56231d2a4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:02.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.700+0000 7fd784aa8740 10 client.0 _ll_register_callbacks cb 0x56231d1aea80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:02.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.700+0000 7fd77bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56231d29c760 0x56231d2a4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43208/0 (socket says 172.21.15.19:43208) 2024-09-19T08:57:02.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.700+0000 7fd77bfff640 1 -- 172.21.15.19:0/15195921 learned_addr learned my addr 172.21.15.19:0/15195921 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:02.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.700+0000 7fd780c6c640 1 --2- 172.21.15.19:0/15195921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56231d2a7940 0x56231d2a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:02.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.700+0000 7fd77b7fe640 1 --2- 172.21.15.19:0/15195921 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56231d29d080 0x56231d2a4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:02.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.700+0000 7fd77bfff640 1 -- 172.21.15.19:0/15195921 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56231d29d080 msgr2=0x56231d2a4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:02.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.700+0000 7fd77bfff640 1 --2- 172.21.15.19:0/15195921 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56231d29d080 0x56231d2a4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:02.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.700+0000 7fd77bfff640 1 -- 172.21.15.19:0/15195921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56231d2a7940 msgr2=0x56231d2a52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:02.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.700+0000 7fd77bfff640 1 --2- 172.21.15.19:0/15195921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56231d2a7940 0x56231d2a52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:02.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.700+0000 7fd77bfff640 1 -- 172.21.15.19:0/15195921 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56231d2b3a30 con 0x56231d29c760 2024-09-19T08:57:02.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.701+0000 7fd77bfff640 1 --2- 172.21.15.19:0/15195921 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56231d29c760 0x56231d2a4860 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fd76c0bc2f0 tx=0x7fd76c00a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72c7f984827eabc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:02.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.701+0000 7fd75b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:57:02.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.701+0000 7fd75b7fe640 1 -- 172.21.15.19:0/15195921 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c066030 con 0x56231d29c760 2024-09-19T08:57:02.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.701+0000 7fd75b7fe640 1 -- 172.21.15.19:0/15195921 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd76c0a00d0 con 0x56231d29c760 2024-09-19T08:57:02.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.701+0000 7fd784aa8740 1 -- 172.21.15.19:0/15195921 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd76c0b5070 con 0x56231d29c760 2024-09-19T08:57:02.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.701+0000 7fd75b7fe640 1 -- 172.21.15.19:0/15195921 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fd76c00fc60 con 0x56231d29c760 2024-09-19T08:57:02.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.701+0000 7fd784aa8740 10 client.16542 fetch_fsmap learned FSMap version 33 2024-09-19T08:57:02.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.701+0000 7fd784aa8740 1 -- 172.21.15.19:0/15195921 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56231d2b63c0 con 0x56231d29c760 2024-09-19T08:57:02.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.701+0000 7fd75b7fe640 1 -- 172.21.15.19:0/15195921 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd76c0b5070 con 0x56231d29c760 2024-09-19T08:57:02.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.701+0000 7fd75b7fe640 1 -- 172.21.15.19:0/15195921 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7fd76c09af40 con 0x56231d29c760 2024-09-19T08:57:02.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.702+0000 7fd784aa8740 10 client.16542 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:57:02.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.702+0000 7fd784aa8740 10 client.16542 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T08:57:02.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.702+0000 7fd784aa8740 20 client.16542 populate_metadata read hostname 'smithi019' 2024-09-19T08:57:02.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.702+0000 7fd784aa8740 1 --2- 172.21.15.19:0/15195921 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56231d2b7710 0x56231d2b9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:02.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.702+0000 7fd784aa8740 4 client.16542 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:57:02.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.702+0000 7fd784aa8740 1 -- 172.21.15.19:0/15195921 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56231d20f9d0 con 0x56231d2b7710 2024-09-19T08:57:02.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.702+0000 7fd77b7fe640 1 --2- 172.21.15.19:0/15195921 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56231d2b7710 0x56231d2b9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:02.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.702+0000 7fd75b7fe640 10 client.16542 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:57:02.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.702+0000 7fd77b7fe640 1 --2- 172.21.15.19:0/15195921 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56231d2b7710 0x56231d2b9b00 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=174b032f1e505221 server_cookie=9a1a92ffa4e9e79e in_seq=0 out_seq=0 2024-09-19T08:57:02.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.705+0000 7fd75b7fe640 1 -- 172.21.15.19:0/15195921 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56231d20f9d0 con 0x56231d2b7710 2024-09-19T08:57:02.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.705+0000 7fd75b7fe640 10 client.16542 handle_command_reply: tid=0 2024-09-19T08:57:02.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.705+0000 7fd784aa8740 1 client.16542 shutdown 2024-09-19T08:57:02.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.705+0000 7fd784aa8740 1 -- 172.21.15.19:0/15195921 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56231d29c760 msgr2=0x56231d2a4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:02.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.705+0000 7fd784aa8740 1 --2- 172.21.15.19:0/15195921 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56231d29c760 0x56231d2a4860 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fd76c0bc2f0 tx=0x7fd76c00a560 comp rx=0 tx=0).stop 2024-09-19T08:57:02.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.705+0000 7fd784aa8740 1 -- 172.21.15.19:0/15195921 shutdown_connections 2024-09-19T08:57:02.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.705+0000 7fd784aa8740 1 --2- 172.21.15.19:0/15195921 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56231d2b7710 0x56231d2b9b00 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:02.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.705+0000 7fd784aa8740 1 --2- 172.21.15.19:0/15195921 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56231d29d080 0x56231d2a4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:02.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.705+0000 7fd784aa8740 1 --2- 172.21.15.19:0/15195921 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56231d2a7940 0x56231d2a52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:02.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.705+0000 7fd75b7fe640 0 client.16542 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:57:02.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.705+0000 7fd784aa8740 1 --2- 172.21.15.19:0/15195921 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56231d29c760 0x56231d2a4860 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:02.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.705+0000 7fd784aa8740 1 -- 172.21.15.19:0/15195921 >> 172.21.15.19:0/15195921 conn(0x56231d298cf0 msgr2=0x56231d297e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:02.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.705+0000 7fd784aa8740 1 -- 172.21.15.19:0/15195921 shutdown_connections 2024-09-19T08:57:02.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.705+0000 7fd784aa8740 1 -- 172.21.15.19:0/15195921 wait complete. 2024-09-19T08:57:02.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.705+0000 7fd784aa8740 20 client.16542 trim_cache size 0 max 16384 2024-09-19T08:57:02.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.724+0000 7fd784aa8740 1 Processor -- start 2024-09-19T08:57:02.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.724+0000 7fd784aa8740 1 -- start start 2024-09-19T08:57:02.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.725+0000 7fd784aa8740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56231d29c760 0x56231d2a3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:02.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.725+0000 7fd784aa8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56231d29d080 0x56231d2a6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:02.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.725+0000 7fd784aa8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56231d2a7940 0x56231d29e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:02.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.725+0000 7fd784aa8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd77c1ab2c0 con 0x56231d2a7940 2024-09-19T08:57:02.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.725+0000 7fd784aa8740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd77c1ace30 con 0x56231d29c760 2024-09-19T08:57:02.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.725+0000 7fd784aa8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd77c1ab990 con 0x56231d29d080 2024-09-19T08:57:02.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.725+0000 7fd77b7fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56231d29d080 0x56231d2a6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:02.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.725+0000 7fd77bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56231d29c760 0x56231d2a3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:02.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.725+0000 7fd780c6c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56231d2a7940 0x56231d29e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:02.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.725+0000 7fd77b7fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56231d29d080 0x56231d2a6730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:42150/0 (socket says 172.21.15.19:42150) 2024-09-19T08:57:02.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.725+0000 7fd77b7fe640 1 -- 172.21.15.19:0/4209897063 learned_addr learned my addr 172.21.15.19:0/4209897063 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:02.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.725+0000 7fd77bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56231d29c760 0x56231d2a3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:53654/0 (socket says 172.21.15.19:53654) 2024-09-19T08:57:02.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.725+0000 7fd77b7fe640 1 -- 172.21.15.19:0/4209897063 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56231d29c760 msgr2=0x56231d2a3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:02.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.725+0000 7fd77b7fe640 1 --2- 172.21.15.19:0/4209897063 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56231d29c760 0x56231d2a3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:02.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.725+0000 7fd77b7fe640 1 -- 172.21.15.19:0/4209897063 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56231d2a7940 msgr2=0x56231d29e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:02.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.725+0000 7fd77b7fe640 1 --2- 172.21.15.19:0/4209897063 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56231d2a7940 0x56231d29e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:02.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.725+0000 7fd77b7fe640 1 -- 172.21.15.19:0/4209897063 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56231d2a73b0 con 0x56231d29d080 2024-09-19T08:57:02.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.726+0000 7fd77b7fe640 1 --2- 172.21.15.19:0/4209897063 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56231d29d080 0x56231d2a6730 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd77002a930 tx=0x7fd770041000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddd768c35ae3c70e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:02.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.726+0000 7fd761ffb640 1 -- 172.21.15.19:0/4209897063 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd770035040 con 0x56231d29d080 2024-09-19T08:57:02.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.726+0000 7fd761ffb640 1 -- 172.21.15.19:0/4209897063 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd770059070 con 0x56231d29d080 2024-09-19T08:57:02.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.726+0000 7fd761ffb640 1 -- 172.21.15.19:0/4209897063 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7700549c0 con 0x56231d29d080 2024-09-19T08:57:02.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.727+0000 7fd784aa8740 1 -- 172.21.15.19:0/4209897063 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56231d29d080 msgr2=0x56231d2a6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:02.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.727+0000 7fd784aa8740 1 --2- 172.21.15.19:0/4209897063 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56231d29d080 0x56231d2a6730 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd77002a930 tx=0x7fd770041000 comp rx=0 tx=0).stop 2024-09-19T08:57:02.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.727+0000 7fd784aa8740 1 -- 172.21.15.19:0/4209897063 shutdown_connections 2024-09-19T08:57:02.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.727+0000 7fd784aa8740 1 --2- 172.21.15.19:0/4209897063 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56231d29d080 0x56231d2a6730 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:02.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.727+0000 7fd784aa8740 1 --2- 172.21.15.19:0/4209897063 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56231d2a7940 0x56231d29e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:02.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.727+0000 7fd784aa8740 1 --2- 172.21.15.19:0/4209897063 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56231d29c760 0x56231d2a3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:02.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.727+0000 7fd784aa8740 1 -- 172.21.15.19:0/4209897063 >> 172.21.15.19:0/4209897063 conn(0x56231d298cf0 msgr2=0x56231d29e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:02.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.727+0000 7fd784aa8740 1 -- 172.21.15.19:0/4209897063 shutdown_connections 2024-09-19T08:57:02.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.727+0000 7fd784aa8740 1 -- 172.21.15.19:0/4209897063 wait complete. 2024-09-19T08:57:02.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.727+0000 7fd784aa8740 1 -- start start 2024-09-19T08:57:02.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.728+0000 7fd784aa8740 1 Processor -- start 2024-09-19T08:57:02.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.728+0000 7fd784aa8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56231d29c760 0x56231d2baee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:02.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.728+0000 7fd784aa8740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56231d29d080 0x56231d2bb420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:02.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.728+0000 7fd784aa8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56231d2a7940 0x56231d321050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:02.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.728+0000 7fd784aa8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd77c1ac760 con 0x56231d29c760 2024-09-19T08:57:02.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.728+0000 7fd784aa8740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd77c1ac090 con 0x56231d29d080 2024-09-19T08:57:02.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.728+0000 7fd784aa8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd77c1a92c0 con 0x56231d2a7940 2024-09-19T08:57:02.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.728+0000 7fd784aa8740 10 client.0 _ll_register_callbacks cb 0x7fd770040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:02.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.728+0000 7fd77bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56231d29c760 0x56231d2baee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:02.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.728+0000 7fd77bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56231d29c760 0x56231d2baee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43232/0 (socket says 172.21.15.19:43232) 2024-09-19T08:57:02.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.728+0000 7fd77b7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56231d29d080 0x56231d2bb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:02.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.728+0000 7fd77bfff640 1 -- 172.21.15.19:0/1398433881 learned_addr learned my addr 172.21.15.19:0/1398433881 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:02.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.728+0000 7fd780c6c640 1 --2- 172.21.15.19:0/1398433881 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56231d2a7940 0x56231d321050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:02.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.729+0000 7fd77b7fe640 1 -- 172.21.15.19:0/1398433881 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56231d2a7940 msgr2=0x56231d321050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:02.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.729+0000 7fd77b7fe640 1 --2- 172.21.15.19:0/1398433881 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56231d2a7940 0x56231d321050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:02.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.729+0000 7fd77b7fe640 1 -- 172.21.15.19:0/1398433881 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56231d29c760 msgr2=0x56231d2baee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:02.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.729+0000 7fd77b7fe640 1 --2- 172.21.15.19:0/1398433881 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56231d29c760 0x56231d2baee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:02.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.729+0000 7fd77b7fe640 1 -- 172.21.15.19:0/1398433881 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56231d321590 con 0x56231d29d080 2024-09-19T08:57:02.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.729+0000 7fd77bfff640 1 --2- 172.21.15.19:0/1398433881 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56231d29c760 0x56231d2baee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:57:02.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.729+0000 7fd77b7fe640 1 --2- 172.21.15.19:0/1398433881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56231d29d080 0x56231d2bb420 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd770056040 tx=0x7fd770009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2ca99d01b494ed5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:02.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.729+0000 7fd75b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T08:57:02.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.729+0000 7fd75b7fe640 1 -- 172.21.15.19:0/1398433881 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd770061070 con 0x56231d29d080 2024-09-19T08:57:02.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.729+0000 7fd784aa8740 1 -- 172.21.15.19:0/1398433881 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd770059070 con 0x56231d29d080 2024-09-19T08:57:02.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.729+0000 7fd75b7fe640 1 -- 172.21.15.19:0/1398433881 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd770054740 con 0x56231d29d080 2024-09-19T08:57:02.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.729+0000 7fd75b7fe640 1 -- 172.21.15.19:0/1398433881 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fd770035040 con 0x56231d29d080 2024-09-19T08:57:02.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.730+0000 7fd784aa8740 10 client.26063 fetch_fsmap learned FSMap version 33 2024-09-19T08:57:02.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.730+0000 7fd784aa8740 1 -- 172.21.15.19:0/1398433881 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56231d322770 con 0x56231d29d080 2024-09-19T08:57:02.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.730+0000 7fd75b7fe640 1 -- 172.21.15.19:0/1398433881 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd770059070 con 0x56231d29d080 2024-09-19T08:57:02.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.730+0000 7fd75b7fe640 1 -- 172.21.15.19:0/1398433881 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7fd770003cd0 con 0x56231d29d080 2024-09-19T08:57:02.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.730+0000 7fd784aa8740 10 client.26063 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:57:02.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.730+0000 7fd784aa8740 10 client.26063 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T08:57:02.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.730+0000 7fd784aa8740 20 client.26063 populate_metadata read hostname 'smithi019' 2024-09-19T08:57:02.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.730+0000 7fd784aa8740 1 --2- 172.21.15.19:0/1398433881 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56231d322f10 0x56231d325330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:02.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.730+0000 7fd784aa8740 4 client.26063 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}] 2024-09-19T08:57:02.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.730+0000 7fd784aa8740 1 -- 172.21.15.19:0/1398433881 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}) -- 0x56231d209d20 con 0x56231d322f10 2024-09-19T08:57:02.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.730+0000 7fd77bfff640 1 --2- 172.21.15.19:0/1398433881 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56231d322f10 0x56231d325330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:02.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.731+0000 7fd77bfff640 1 --2- 172.21.15.19:0/1398433881 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56231d322f10 0x56231d325330 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=443850148943b50 server_cookie=173e885137d5758e in_seq=0 out_seq=0 2024-09-19T08:57:02.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:02.731+0000 7fd75b7fe640 10 client.26063 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:57:02.780 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:57:03.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.258+0000 7f348bdd5640 1 -- 172.21.15.19:0/1964392521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3484102df0 msgr2=0x7f34841031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:03.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.258+0000 7f348bdd5640 1 --2- 172.21.15.19:0/1964392521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3484102df0 0x7f34841031d0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f3480009ca0 tx=0x7f348002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:57:03.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.258+0000 7f348bdd5640 1 -- 172.21.15.19:0/1964392521 shutdown_connections 2024-09-19T08:57:03.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.258+0000 7f348bdd5640 1 --2- 172.21.15.19:0/1964392521 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f348410c2f0 0x7f348410e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:03.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.258+0000 7f348bdd5640 1 --2- 172.21.15.19:0/1964392521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34841037a0 0x7f348410bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:03.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.258+0000 7f348bdd5640 1 --2- 172.21.15.19:0/1964392521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3484102df0 0x7f34841031d0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:03.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.258+0000 7f348bdd5640 1 -- 172.21.15.19:0/1964392521 >> 172.21.15.19:0/1964392521 conn(0x7f34840fc7d0 msgr2=0x7f34840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:03.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.258+0000 7f348bdd5640 1 -- 172.21.15.19:0/1964392521 shutdown_connections 2024-09-19T08:57:03.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.258+0000 7f348bdd5640 1 -- 172.21.15.19:0/1964392521 wait complete. 2024-09-19T08:57:03.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.259+0000 7f348bdd5640 1 Processor -- start 2024-09-19T08:57:03.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.259+0000 7f348bdd5640 1 -- start start 2024-09-19T08:57:03.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.259+0000 7f348bdd5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3484102df0 0x7f34841986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:03.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.259+0000 7f348bdd5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34841037a0 0x7f3484198c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:03.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.259+0000 7f348bdd5640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f348410c2f0 0x7f348419cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:03.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.259+0000 7f348bdd5640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3484112170 con 0x7f3484102df0 2024-09-19T08:57:03.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.259+0000 7f348bdd5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3484111ff0 con 0x7f34841037a0 2024-09-19T08:57:03.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.259+0000 7f348bdd5640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f34841122f0 con 0x7f348410c2f0 2024-09-19T08:57:03.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.259+0000 7f3489b71640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3484102df0 0x7f34841986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:03.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.259+0000 7f3489b71640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3484102df0 0x7f34841986d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43252/0 (socket says 172.21.15.19:43252) 2024-09-19T08:57:03.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.259+0000 7f3489b71640 1 -- 172.21.15.19:0/2168590837 learned_addr learned my addr 172.21.15.19:0/2168590837 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:03.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.259+0000 7f3489370640 1 --2- 172.21.15.19:0/2168590837 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34841037a0 0x7f3484198c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:03.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.259+0000 7f348a372640 1 --2- 172.21.15.19:0/2168590837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f348410c2f0 0x7f348419cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:03.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.259+0000 7f3489b71640 1 -- 172.21.15.19:0/2168590837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f348410c2f0 msgr2=0x7f348419cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:03.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.259+0000 7f3489b71640 1 --2- 172.21.15.19:0/2168590837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f348410c2f0 0x7f348419cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:03.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.259+0000 7f3489b71640 1 -- 172.21.15.19:0/2168590837 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34841037a0 msgr2=0x7f3484198c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:03.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.259+0000 7f3489b71640 1 --2- 172.21.15.19:0/2168590837 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34841037a0 0x7f3484198c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:03.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.259+0000 7f3489b71640 1 -- 172.21.15.19:0/2168590837 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f348419d680 con 0x7f3484102df0 2024-09-19T08:57:03.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.260+0000 7f3489b71640 1 --2- 172.21.15.19:0/2168590837 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3484102df0 0x7f34841986d0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f348002ade0 tx=0x7f34800319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:03.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.260+0000 7f347affd640 1 -- 172.21.15.19:0/2168590837 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348002fa20 con 0x7f3484102df0 2024-09-19T08:57:03.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.260+0000 7f347affd640 1 -- 172.21.15.19:0/2168590837 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f348002fbc0 con 0x7f3484102df0 2024-09-19T08:57:03.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.260+0000 7f348bdd5640 1 -- 172.21.15.19:0/2168590837 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f348419d910 con 0x7f3484102df0 2024-09-19T08:57:03.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.260+0000 7f347affd640 1 -- 172.21.15.19:0/2168590837 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34800467b0 con 0x7f3484102df0 2024-09-19T08:57:03.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.260+0000 7f348bdd5640 1 -- 172.21.15.19:0/2168590837 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34841a5250 con 0x7f3484102df0 2024-09-19T08:57:03.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.263+0000 7f347affd640 1 -- 172.21.15.19:0/2168590837 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f3480046950 con 0x7f3484102df0 2024-09-19T08:57:03.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.263+0000 7f348e1ae740 1 Processor -- start 2024-09-19T08:57:03.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.263+0000 7f348e1ae740 1 -- start start 2024-09-19T08:57:03.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.263+0000 7f348e1ae740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648b0a29360 0x5648b0a29740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:03.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.263+0000 7f348e1ae740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648b0a29c80 0x5648b0a38550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:03.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.263+0000 7f348e1ae740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648b0a38a90 0x5648b0a3ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:03.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.263+0000 7f348e1ae740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5648b098f2e0 con 0x5648b0a29360 2024-09-19T08:57:03.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.263+0000 7f348e1ae740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5648b0936ce0 con 0x5648b0a38a90 2024-09-19T08:57:03.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.263+0000 7f348e1ae740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5648b098b2a0 con 0x5648b0a29c80 2024-09-19T08:57:03.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.264+0000 7f348a372640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648b0a29360 0x5648b0a29740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:03.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.264+0000 7f348a372640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648b0a29360 0x5648b0a29740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43256/0 (socket says 172.21.15.19:43256) 2024-09-19T08:57:03.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.264+0000 7f348a372640 1 -- 172.21.15.19:0/790126070 learned_addr learned my addr 172.21.15.19:0/790126070 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:03.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.264+0000 7f3489b71640 1 --2- 172.21.15.19:0/790126070 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648b0a29c80 0x5648b0a38550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:03.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.264+0000 7f3489370640 1 --2- 172.21.15.19:0/790126070 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648b0a38a90 0x5648b0a3ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:03.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.264+0000 7f347affd640 1 --2- 172.21.15.19:0/2168590837 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f34700a32c0 0x7f34700a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:03.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.265+0000 7f347affd640 1 -- 172.21.15.19:0/2168590837 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f34800f0d60 con 0x7f3484102df0 2024-09-19T08:57:03.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.265+0000 7f348a372640 1 -- 172.21.15.19:0/790126070 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648b0a29c80 msgr2=0x5648b0a38550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:03.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.265+0000 7f348a372640 1 --2- 172.21.15.19:0/790126070 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648b0a29c80 0x5648b0a38550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:03.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.265+0000 7f348a372640 1 -- 172.21.15.19:0/790126070 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648b0a38a90 msgr2=0x5648b0a3ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:03.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.265+0000 7f348a372640 1 --2- 172.21.15.19:0/790126070 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648b0a38a90 0x5648b0a3ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:03.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.265+0000 7f348a372640 1 -- 172.21.15.19:0/790126070 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648b091b440 con 0x5648b0a29360 2024-09-19T08:57:03.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.265+0000 7f3489370640 1 --2- 172.21.15.19:0/790126070 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648b0a38a90 0x5648b0a3ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:57:03.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.265+0000 7f348a372640 1 --2- 172.21.15.19:0/2168590837 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f34700a32c0 0x7f34700a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:03.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.265+0000 7f348a372640 1 --2- 172.21.15.19:0/790126070 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648b0a29360 0x5648b0a29740 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f347c00b8e0 tx=0x7f347c00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89c759afd6871419 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:03.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.265+0000 7f346ffff640 1 -- 172.21.15.19:0/790126070 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347c016be0 con 0x5648b0a29360 2024-09-19T08:57:03.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.266+0000 7f348a372640 1 --2- 172.21.15.19:0/2168590837 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f34700a32c0 0x7f34700a5780 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f347c01e000 tx=0x7f347c01f000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:03.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.266+0000 7f346ffff640 1 -- 172.21.15.19:0/790126070 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f347c016d80 con 0x5648b0a29360 2024-09-19T08:57:03.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.266+0000 7f346ffff640 1 -- 172.21.15.19:0/790126070 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f347c0155f0 con 0x5648b0a29360 2024-09-19T08:57:03.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.266+0000 7f348e1ae740 1 -- 172.21.15.19:0/790126070 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648b0a29360 msgr2=0x5648b0a29740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:03.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.266+0000 7f348e1ae740 1 --2- 172.21.15.19:0/790126070 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648b0a29360 0x5648b0a29740 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f347c00b8e0 tx=0x7f347c00bda0 comp rx=0 tx=0).stop 2024-09-19T08:57:03.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.266+0000 7f348e1ae740 1 -- 172.21.15.19:0/790126070 shutdown_connections 2024-09-19T08:57:03.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.266+0000 7f348e1ae740 1 --2- 172.21.15.19:0/790126070 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648b0a29c80 0x5648b0a38550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:03.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.266+0000 7f348e1ae740 1 --2- 172.21.15.19:0/790126070 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648b0a38a90 0x5648b0a3ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:03.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.266+0000 7f348e1ae740 1 --2- 172.21.15.19:0/790126070 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648b0a29360 0x5648b0a29740 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:03.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.266+0000 7f348e1ae740 1 -- 172.21.15.19:0/790126070 >> 172.21.15.19:0/790126070 conn(0x5648b0a25a30 msgr2=0x5648b0a25e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:03.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.267+0000 7f348e1ae740 1 -- 172.21.15.19:0/790126070 shutdown_connections 2024-09-19T08:57:03.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.267+0000 7f348e1ae740 1 -- 172.21.15.19:0/790126070 wait complete. 2024-09-19T08:57:03.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.267+0000 7f348e1ae740 1 -- start start 2024-09-19T08:57:03.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.267+0000 7f348e1ae740 1 Processor -- start 2024-09-19T08:57:03.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.268+0000 7f348e1ae740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648b0a29360 0x5648b0a38480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:03.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.268+0000 7f348e1ae740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648b0a29c80 0x5648b0a35730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:03.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.268+0000 7f348e1ae740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648b0a38a90 0x5648b0a35d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:03.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.268+0000 7f348e1ae740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5648b0a3b660 con 0x5648b0a29c80 2024-09-19T08:57:03.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.268+0000 7f348e1ae740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5648b094a050 con 0x5648b0a29360 2024-09-19T08:57:03.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.268+0000 7f348e1ae740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5648b0a3b7e0 con 0x5648b0a38a90 2024-09-19T08:57:03.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.268+0000 7f348e1ae740 10 client.0 _ll_register_callbacks cb 0x5648b098a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:03.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.268+0000 7f3489370640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648b0a29c80 0x5648b0a35730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:03.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.268+0000 7f3489370640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648b0a29c80 0x5648b0a35730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43272/0 (socket says 172.21.15.19:43272) 2024-09-19T08:57:03.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.268+0000 7f3489370640 1 -- 172.21.15.19:0/4169210781 learned_addr learned my addr 172.21.15.19:0/4169210781 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:03.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.268+0000 7f3489b71640 1 --2- 172.21.15.19:0/4169210781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648b0a29360 0x5648b0a38480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:03.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.268+0000 7f348a372640 1 --2- 172.21.15.19:0/4169210781 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648b0a38a90 0x5648b0a35d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:03.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.268+0000 7f3489370640 1 -- 172.21.15.19:0/4169210781 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648b0a38a90 msgr2=0x5648b0a35d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:03.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.268+0000 7f3489370640 1 --2- 172.21.15.19:0/4169210781 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648b0a38a90 0x5648b0a35d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:03.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.268+0000 7f3489370640 1 -- 172.21.15.19:0/4169210781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648b0a29360 msgr2=0x5648b0a38480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:03.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.268+0000 7f3489370640 1 --2- 172.21.15.19:0/4169210781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648b0a29360 0x5648b0a38480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:03.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.268+0000 7f3489370640 1 -- 172.21.15.19:0/4169210781 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648b07003c0 con 0x5648b0a29c80 2024-09-19T08:57:03.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.268+0000 7f348a372640 1 --2- 172.21.15.19:0/4169210781 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648b0a38a90 0x5648b0a35d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:57:03.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.268+0000 7f3489370640 1 --2- 172.21.15.19:0/4169210781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648b0a29c80 0x5648b0a35730 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f347400bad0 tx=0x7f347400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d2a22a57df5a4b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:03.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.268+0000 7f346d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:57:03.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.268+0000 7f346d7fa640 1 -- 172.21.15.19:0/4169210781 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3474003d60 con 0x5648b0a29c80 2024-09-19T08:57:03.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.268+0000 7f346d7fa640 1 -- 172.21.15.19:0/4169210781 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f3474011440 con 0x5648b0a29c80 2024-09-19T08:57:03.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.269+0000 7f348e1ae740 1 -- 172.21.15.19:0/4169210781 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f347c016d80 con 0x5648b0a29c80 2024-09-19T08:57:03.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.269+0000 7f346d7fa640 1 -- 172.21.15.19:0/4169210781 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f3474011640 con 0x5648b0a29c80 2024-09-19T08:57:03.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.269+0000 7f348e1ae740 10 client.16560 fetch_fsmap learned FSMap version 33 2024-09-19T08:57:03.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.269+0000 7f348e1ae740 1 -- 172.21.15.19:0/4169210781 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5648b0a47160 con 0x5648b0a29c80 2024-09-19T08:57:03.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.269+0000 7f346d7fa640 1 -- 172.21.15.19:0/4169210781 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f347c016d80 con 0x5648b0a29c80 2024-09-19T08:57:03.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.269+0000 7f346d7fa640 1 -- 172.21.15.19:0/4169210781 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f347401b9b0 con 0x5648b0a29c80 2024-09-19T08:57:03.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.269+0000 7f348e1ae740 10 client.16560 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:57:03.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.269+0000 7f348e1ae740 10 client.16560 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:57:03.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.269+0000 7f348e1ae740 20 client.16560 populate_metadata read hostname 'smithi019' 2024-09-19T08:57:03.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.269+0000 7f348e1ae740 1 --2- 172.21.15.19:0/4169210781 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5648b0a48630 0x5648b0a4aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:03.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.269+0000 7f348e1ae740 4 client.16560 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:57:03.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.269+0000 7f348e1ae740 1 -- 172.21.15.19:0/4169210781 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648b099c850 con 0x5648b0a48630 2024-09-19T08:57:03.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.269+0000 7f3489b71640 1 --2- 172.21.15.19:0/4169210781 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5648b0a48630 0x5648b0a4aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:03.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.270+0000 7f3489b71640 1 --2- 172.21.15.19:0/4169210781 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5648b0a48630 0x5648b0a4aa70 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38db2fe398ddffe1 server_cookie=92a107cec98d90c9 in_seq=0 out_seq=0 2024-09-19T08:57:03.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:03.270+0000 7f346d7fa640 10 client.16560 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:57:03.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:03 smithi155 ceph-mon[34921]: pgmap v482: 97 pgs: 97 active+clean; 13 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 2.10k op/s 2024-09-19T08:57:03.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:03 smithi203 ceph-mon[35450]: pgmap v482: 97 pgs: 97 active+clean; 13 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 2.10k op/s 2024-09-19T08:57:03.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:03 smithi019 ceph-mon[30976]: pgmap v482: 97 pgs: 97 active+clean; 13 MiB data, 622 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.1 MiB/s wr, 2.10k op/s 2024-09-19T08:57:04.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.112+0000 7f346d7fa640 1 -- 172.21.15.19:0/4169210781 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5648b099c850 con 0x5648b0a48630 2024-09-19T08:57:04.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.112+0000 7f346d7fa640 10 client.16560 handle_command_reply: tid=0 2024-09-19T08:57:04.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.112+0000 7f348e1ae740 1 client.16560 shutdown 2024-09-19T08:57:04.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.112+0000 7f348e1ae740 1 -- 172.21.15.19:0/4169210781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648b0a29c80 msgr2=0x5648b0a35730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:04.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.112+0000 7f348e1ae740 1 --2- 172.21.15.19:0/4169210781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648b0a29c80 0x5648b0a35730 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f347400bad0 tx=0x7f347400bed0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.112+0000 7f348e1ae740 1 -- 172.21.15.19:0/4169210781 shutdown_connections 2024-09-19T08:57:04.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.112+0000 7f348e1ae740 1 --2- 172.21.15.19:0/4169210781 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5648b0a48630 0x5648b0a4aa70 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.112+0000 7f348e1ae740 1 --2- 172.21.15.19:0/4169210781 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648b0a38a90 0x5648b0a35d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.112+0000 7f348e1ae740 1 --2- 172.21.15.19:0/4169210781 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648b0a29c80 0x5648b0a35730 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.112+0000 7f346d7fa640 0 client.16560 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:57:04.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.112+0000 7f348e1ae740 1 --2- 172.21.15.19:0/4169210781 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648b0a29360 0x5648b0a38480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.112+0000 7f348e1ae740 1 -- 172.21.15.19:0/4169210781 >> 172.21.15.19:0/4169210781 conn(0x5648b0a25a30 msgr2=0x5648b0a2b790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:04.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.112+0000 7f348e1ae740 1 -- 172.21.15.19:0/4169210781 shutdown_connections 2024-09-19T08:57:04.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.112+0000 7f348e1ae740 1 -- 172.21.15.19:0/4169210781 wait complete. 2024-09-19T08:57:04.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.113+0000 7f348e1ae740 20 client.16560 trim_cache size 0 max 16384 2024-09-19T08:57:04.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.130+0000 7f348e1ae740 1 Processor -- start 2024-09-19T08:57:04.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.130+0000 7f348e1ae740 1 -- start start 2024-09-19T08:57:04.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.130+0000 7f348e1ae740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648b0a29360 0x5648b0a44900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:04.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.130+0000 7f348e1ae740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648b0a29c80 0x5648b0a50340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:04.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.130+0000 7f348e1ae740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648b0a38a90 0x5648b0a50880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:04.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.130+0000 7f348e1ae740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f34841ab2e0 con 0x5648b0a29c80 2024-09-19T08:57:04.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.130+0000 7f348e1ae740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f34841ace50 con 0x5648b0a38a90 2024-09-19T08:57:04.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.130+0000 7f348e1ae740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f34841ab9b0 con 0x5648b0a29360 2024-09-19T08:57:04.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.131+0000 7f3489370640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648b0a29c80 0x5648b0a50340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:04.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.131+0000 7f3489370640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648b0a29c80 0x5648b0a50340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43280/0 (socket says 172.21.15.19:43280) 2024-09-19T08:57:04.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.131+0000 7f3489370640 1 -- 172.21.15.19:0/2501501855 learned_addr learned my addr 172.21.15.19:0/2501501855 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:04.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.131+0000 7f3489b71640 1 --2- 172.21.15.19:0/2501501855 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648b0a29360 0x5648b0a44900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:04.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.131+0000 7f348a372640 1 --2- 172.21.15.19:0/2501501855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648b0a38a90 0x5648b0a50880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:04.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.131+0000 7f3489370640 1 -- 172.21.15.19:0/2501501855 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648b0a29360 msgr2=0x5648b0a44900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:04.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.131+0000 7f3489370640 1 --2- 172.21.15.19:0/2501501855 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648b0a29360 0x5648b0a44900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.131+0000 7f3489370640 1 -- 172.21.15.19:0/2501501855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648b0a38a90 msgr2=0x5648b0a50880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:04.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.131+0000 7f3489370640 1 --2- 172.21.15.19:0/2501501855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648b0a38a90 0x5648b0a50880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.131+0000 7f3489370640 1 -- 172.21.15.19:0/2501501855 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648b0a33c80 con 0x5648b0a29c80 2024-09-19T08:57:04.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.131+0000 7f3489370640 1 --2- 172.21.15.19:0/2501501855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648b0a29c80 0x5648b0a50340 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f347401cff0 tx=0x7f3474011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e123c2a160f25e9c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:04.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.131+0000 7f346f7fe640 1 -- 172.21.15.19:0/2501501855 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3474003ea0 con 0x5648b0a29c80 2024-09-19T08:57:04.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.131+0000 7f346f7fe640 1 -- 172.21.15.19:0/2501501855 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3474021030 con 0x5648b0a29c80 2024-09-19T08:57:04.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.131+0000 7f346f7fe640 1 -- 172.21.15.19:0/2501501855 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3474011ce0 con 0x5648b0a29c80 2024-09-19T08:57:04.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.132+0000 7f348e1ae740 1 -- 172.21.15.19:0/2501501855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648b0a29c80 msgr2=0x5648b0a50340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:04.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.132+0000 7f348e1ae740 1 --2- 172.21.15.19:0/2501501855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648b0a29c80 0x5648b0a50340 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f347401cff0 tx=0x7f3474011440 comp rx=0 tx=0).stop 2024-09-19T08:57:04.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.132+0000 7f348e1ae740 1 -- 172.21.15.19:0/2501501855 shutdown_connections 2024-09-19T08:57:04.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.132+0000 7f348e1ae740 1 --2- 172.21.15.19:0/2501501855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648b0a38a90 0x5648b0a50880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.132+0000 7f348e1ae740 1 --2- 172.21.15.19:0/2501501855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648b0a29c80 0x5648b0a50340 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.132+0000 7f348e1ae740 1 --2- 172.21.15.19:0/2501501855 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648b0a29360 0x5648b0a44900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.132+0000 7f348e1ae740 1 -- 172.21.15.19:0/2501501855 >> 172.21.15.19:0/2501501855 conn(0x5648b0a25a30 msgr2=0x5648b0a30d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:04.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.132+0000 7f348e1ae740 1 -- 172.21.15.19:0/2501501855 shutdown_connections 2024-09-19T08:57:04.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.132+0000 7f348e1ae740 1 -- 172.21.15.19:0/2501501855 wait complete. 2024-09-19T08:57:04.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.133+0000 7f348e1ae740 1 -- start start 2024-09-19T08:57:04.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.133+0000 7f348e1ae740 1 Processor -- start 2024-09-19T08:57:04.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.133+0000 7f348e1ae740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648b0a29360 0x5648b0a40e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:04.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.133+0000 7f348e1ae740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648b0a29c80 0x5648b0a3c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:04.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.133+0000 7f348e1ae740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648b0a38a90 0x5648b0a3c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:04.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.133+0000 7f348e1ae740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f34841ac780 con 0x5648b0a29360 2024-09-19T08:57:04.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.133+0000 7f348e1ae740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f34841ac0b0 con 0x5648b0a29c80 2024-09-19T08:57:04.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.133+0000 7f348e1ae740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f34841a92c0 con 0x5648b0a38a90 2024-09-19T08:57:04.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.133+0000 7f348e1ae740 10 client.0 _ll_register_callbacks cb 0x7f3474004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:04.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.133+0000 7f3489b71640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648b0a29360 0x5648b0a40e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:04.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.133+0000 7f3489b71640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648b0a29360 0x5648b0a40e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43288/0 (socket says 172.21.15.19:43288) 2024-09-19T08:57:04.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.133+0000 7f3489b71640 1 -- 172.21.15.19:0/1781361396 learned_addr learned my addr 172.21.15.19:0/1781361396 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:04.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.133+0000 7f3489370640 1 --2- 172.21.15.19:0/1781361396 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648b0a29c80 0x5648b0a3c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:04.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.133+0000 7f348a372640 1 --2- 172.21.15.19:0/1781361396 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648b0a38a90 0x5648b0a3c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:04.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.134+0000 7f3489b71640 1 -- 172.21.15.19:0/1781361396 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648b0a38a90 msgr2=0x5648b0a3c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:04.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.134+0000 7f3489b71640 1 --2- 172.21.15.19:0/1781361396 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648b0a38a90 0x5648b0a3c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.134+0000 7f3489b71640 1 -- 172.21.15.19:0/1781361396 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648b0a29c80 msgr2=0x5648b0a3c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:04.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.134+0000 7f3489b71640 1 --2- 172.21.15.19:0/1781361396 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648b0a29c80 0x5648b0a3c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.134+0000 7f3489b71640 1 -- 172.21.15.19:0/1781361396 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648b0a3cc30 con 0x5648b0a29360 2024-09-19T08:57:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.134+0000 7f3489370640 1 --2- 172.21.15.19:0/1781361396 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648b0a29c80 0x5648b0a3c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:57:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.134+0000 7f3489b71640 1 --2- 172.21.15.19:0/1781361396 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648b0a29360 0x5648b0a40e80 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f3480006010 tx=0x7f34800b7f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bead4590c8b21fb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.134+0000 7f346d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:57:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.134+0000 7f346d7fa640 1 -- 172.21.15.19:0/1781361396 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34800c6000 con 0x5648b0a29360 2024-09-19T08:57:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.134+0000 7f346d7fa640 1 -- 172.21.15.19:0/1781361396 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f348002fd70 con 0x5648b0a29360 2024-09-19T08:57:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.134+0000 7f348e1ae740 1 -- 172.21.15.19:0/1781361396 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3474021030 con 0x5648b0a29360 2024-09-19T08:57:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.134+0000 7f346d7fa640 1 -- 172.21.15.19:0/1781361396 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f34800b9a90 con 0x5648b0a29360 2024-09-19T08:57:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.134+0000 7f348e1ae740 10 client.16566 fetch_fsmap learned FSMap version 33 2024-09-19T08:57:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.134+0000 7f348e1ae740 1 -- 172.21.15.19:0/1781361396 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5648b0ab2ff0 con 0x5648b0a29360 2024-09-19T08:57:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.134+0000 7f346d7fa640 1 -- 172.21.15.19:0/1781361396 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3474021030 con 0x5648b0a29360 2024-09-19T08:57:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.135+0000 7f346d7fa640 1 -- 172.21.15.19:0/1781361396 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f348004e030 con 0x5648b0a29360 2024-09-19T08:57:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.135+0000 7f348e1ae740 10 client.16566 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:57:04.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.135+0000 7f348e1ae740 10 client.16566 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:57:04.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.135+0000 7f348e1ae740 20 client.16566 populate_metadata read hostname 'smithi019' 2024-09-19T08:57:04.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.135+0000 7f348e1ae740 1 --2- 172.21.15.19:0/1781361396 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5648b0ab3710 0x5648b0ab5b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:04.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.135+0000 7f348e1ae740 4 client.16566 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:57:04.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.135+0000 7f348e1ae740 1 -- 172.21.15.19:0/1781361396 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5648b0996d60 con 0x5648b0ab3710 2024-09-19T08:57:04.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.135+0000 7f3489370640 1 --2- 172.21.15.19:0/1781361396 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5648b0ab3710 0x5648b0ab5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:04.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.135+0000 7f346d7fa640 10 client.16566 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:57:04.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.135+0000 7f3489370640 1 --2- 172.21.15.19:0/1781361396 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5648b0ab3710 0x5648b0ab5b00 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ee4bc23da6625ee server_cookie=3205bd85e5a51158 in_seq=0 out_seq=0 2024-09-19T08:57:04.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.141+0000 7f346d7fa640 1 -- 172.21.15.19:0/1781361396 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+268 (crc 0 0 0) 0x5648b0996d60 con 0x5648b0ab3710 2024-09-19T08:57:04.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.141+0000 7f346d7fa640 10 client.16566 handle_command_reply: tid=0 2024-09-19T08:57:04.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.141+0000 7f348e1ae740 1 client.16566 shutdown 2024-09-19T08:57:04.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.141+0000 7f348e1ae740 1 -- 172.21.15.19:0/1781361396 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648b0a29360 msgr2=0x5648b0a40e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:04.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.141+0000 7f348e1ae740 1 --2- 172.21.15.19:0/1781361396 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648b0a29360 0x5648b0a40e80 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f3480006010 tx=0x7f34800b7f90 comp rx=0 tx=0).stop 2024-09-19T08:57:04.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.141+0000 7f348e1ae740 1 -- 172.21.15.19:0/1781361396 shutdown_connections 2024-09-19T08:57:04.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.141+0000 7f348e1ae740 1 --2- 172.21.15.19:0/1781361396 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5648b0ab3710 0x5648b0ab5b00 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.141+0000 7f348e1ae740 1 --2- 172.21.15.19:0/1781361396 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5648b0a38a90 0x5648b0a3c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.141+0000 7f348e1ae740 1 --2- 172.21.15.19:0/1781361396 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5648b0a29c80 0x5648b0a3c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.141+0000 7f348e1ae740 1 --2- 172.21.15.19:0/1781361396 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5648b0a29360 0x5648b0a40e80 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.141+0000 7f348e1ae740 1 -- 172.21.15.19:0/1781361396 >> 172.21.15.19:0/1781361396 conn(0x5648b0a25a30 msgr2=0x5648b0a36f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:04.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.141+0000 7f346d7fa640 0 client.16566 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:57:04.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.142+0000 7f348e1ae740 1 -- 172.21.15.19:0/1781361396 shutdown_connections 2024-09-19T08:57:04.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.142+0000 7f348e1ae740 1 -- 172.21.15.19:0/1781361396 wait complete. 2024-09-19T08:57:04.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.142+0000 7f348e1ae740 20 client.16566 trim_cache size 0 max 16384 2024-09-19T08:57:04.143 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:57:04.143 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "scrub active (5643 inodes in the stack)", 2024-09-19T08:57:04.143 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-19T08:57:04.143 INFO:teuthology.orchestra.run.smithi019.stdout: "47374fe5-f9de-44f5-8d9e-4282ecef02b9": { 2024-09-19T08:57:04.144 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-19T08:57:04.144 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "47374fe5-f9de-44f5-8d9e-4282ecef02b9", 2024-09-19T08:57:04.144 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-19T08:57:04.144 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:57:04.144 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:57:04.144 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:57:04.144 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.142+0000 7f348bdd5640 1 -- 172.21.15.19:0/2168590837 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f34700a32c0 msgr2=0x7f34700a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:04.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.142+0000 7f348bdd5640 1 --2- 172.21.15.19:0/2168590837 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f34700a32c0 0x7f34700a5780 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f347c01e000 tx=0x7f347c01f000 comp rx=0 tx=0).stop 2024-09-19T08:57:04.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.142+0000 7f348bdd5640 1 -- 172.21.15.19:0/2168590837 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3484102df0 msgr2=0x7f34841986d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:04.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.142+0000 7f348bdd5640 1 --2- 172.21.15.19:0/2168590837 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3484102df0 0x7f34841986d0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f348002ade0 tx=0x7f34800319f0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.142+0000 7f348bdd5640 1 -- 172.21.15.19:0/2168590837 shutdown_connections 2024-09-19T08:57:04.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.142+0000 7f348bdd5640 1 --2- 172.21.15.19:0/2168590837 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f34700a32c0 0x7f34700a5780 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.142+0000 7f348bdd5640 1 --2- 172.21.15.19:0/2168590837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f348410c2f0 0x7f348419cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.142+0000 7f348bdd5640 1 --2- 172.21.15.19:0/2168590837 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f34841037a0 0x7f3484198c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.142+0000 7f348bdd5640 1 --2- 172.21.15.19:0/2168590837 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3484102df0 0x7f34841986d0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:04.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.142+0000 7f348bdd5640 1 -- 172.21.15.19:0/2168590837 >> 172.21.15.19:0/2168590837 conn(0x7f34840fc7d0 msgr2=0x7f34840fdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:04.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.142+0000 7f348bdd5640 1 -- 172.21.15.19:0/2168590837 shutdown_connections 2024-09-19T08:57:04.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:04.142+0000 7f348bdd5640 1 -- 172.21.15.19:0/2168590837 wait complete. 2024-09-19T08:57:04.957 INFO:tasks.cephfs.filesystem:scrub status for tag:47374fe5-f9de-44f5-8d9e-4282ecef02b9 - {'path': '/', 'tag': '47374fe5-f9de-44f5-8d9e-4282ecef02b9', 'options': 'recursive,force'} 2024-09-19T08:57:05.576 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.573+0000 7fb74a7a2640 1 -- 172.21.15.19:0/3068686770 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb744101a70 msgr2=0x7fb744101ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:05.576 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.573+0000 7fb74a7a2640 1 --2- 172.21.15.19:0/3068686770 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb744101a70 0x7fb744101ef0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb734009860 tx=0x7fb73402a340 comp rx=0 tx=0).stop 2024-09-19T08:57:05.576 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.574+0000 7fb74a7a2640 1 -- 172.21.15.19:0/3068686770 shutdown_connections 2024-09-19T08:57:05.576 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.574+0000 7fb74a7a2640 1 --2- 172.21.15.19:0/3068686770 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb744102430 0x7fb744108cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:05.576 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.574+0000 7fb74a7a2640 1 --2- 172.21.15.19:0/3068686770 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb744101a70 0x7fb744101ef0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:05.576 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.574+0000 7fb74a7a2640 1 --2- 172.21.15.19:0/3068686770 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb744100880 0x7fb744100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:05.576 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.574+0000 7fb74a7a2640 1 -- 172.21.15.19:0/3068686770 >> 172.21.15.19:0/3068686770 conn(0x7fb7440fbfe0 msgr2=0x7fb7440fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:05.576 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.574+0000 7fb74a7a2640 1 -- 172.21.15.19:0/3068686770 shutdown_connections 2024-09-19T08:57:05.576 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.574+0000 7fb74a7a2640 1 -- 172.21.15.19:0/3068686770 wait complete. 2024-09-19T08:57:05.577 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.574+0000 7fb74a7a2640 1 Processor -- start 2024-09-19T08:57:05.577 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.574+0000 7fb74a7a2640 1 -- start start 2024-09-19T08:57:05.577 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.574+0000 7fb74a7a2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb744100880 0x7fb744197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:05.577 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.574+0000 7fb74a7a2640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb744101a70 0x7fb744198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:05.577 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.574+0000 7fb74a7a2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb744102430 0x7fb74419f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:05.577 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.574+0000 7fb74a7a2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb74410d650 con 0x7fb744102430 2024-09-19T08:57:05.577 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.574+0000 7fb74a7a2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb74410d4d0 con 0x7fb744100880 2024-09-19T08:57:05.577 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.574+0000 7fb74a7a2640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb74410d7d0 con 0x7fb744101a70 2024-09-19T08:57:05.577 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.575+0000 7fb749fa1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb744102430 0x7fb74419f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:05.577 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.575+0000 7fb7497a0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb744100880 0x7fb744197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:05.577 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.575+0000 7fb748f9f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb744101a70 0x7fb744198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:05.577 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.575+0000 7fb749fa1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb744102430 0x7fb74419f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58408/0 (socket says 172.21.15.19:58408) 2024-09-19T08:57:05.577 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.575+0000 7fb749fa1640 1 -- 172.21.15.19:0/2683983651 learned_addr learned my addr 172.21.15.19:0/2683983651 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:05.577 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.575+0000 7fb748f9f640 1 -- 172.21.15.19:0/2683983651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb744100880 msgr2=0x7fb744197d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:05.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.575+0000 7fb748f9f640 1 --2- 172.21.15.19:0/2683983651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb744100880 0x7fb744197d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:05.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.575+0000 7fb748f9f640 1 -- 172.21.15.19:0/2683983651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb744102430 msgr2=0x7fb74419f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:05.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.575+0000 7fb748f9f640 1 --2- 172.21.15.19:0/2683983651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb744102430 0x7fb74419f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:05.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.575+0000 7fb748f9f640 1 -- 172.21.15.19:0/2683983651 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb74419f930 con 0x7fb744101a70 2024-09-19T08:57:05.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.575+0000 7fb749fa1640 1 --2- 172.21.15.19:0/2683983651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb744102430 0x7fb74419f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:57:05.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.575+0000 7fb748f9f640 1 --2- 172.21.15.19:0/2683983651 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb744101a70 0x7fb744198260 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb73402a860 tx=0x7fb734033ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:05.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.575+0000 7fb73a7fc640 1 -- 172.21.15.19:0/2683983651 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73403f020 con 0x7fb744101a70 2024-09-19T08:57:05.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.575+0000 7fb74a7a2640 1 -- 172.21.15.19:0/2683983651 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb74419fbc0 con 0x7fb744101a70 2024-09-19T08:57:05.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.575+0000 7fb74a7a2640 1 -- 172.21.15.19:0/2683983651 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7441a0100 con 0x7fb744101a70 2024-09-19T08:57:05.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.575+0000 7fb73a7fc640 1 -- 172.21.15.19:0/2683983651 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb734004040 con 0x7fb744101a70 2024-09-19T08:57:05.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.575+0000 7fb73a7fc640 1 -- 172.21.15.19:0/2683983651 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb734037040 con 0x7fb744101a70 2024-09-19T08:57:05.584 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.578+0000 7fb74e879740 1 Processor -- start 2024-09-19T08:57:05.584 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.578+0000 7fb74e879740 1 -- start start 2024-09-19T08:57:05.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.578+0000 7fb73a7fc640 1 -- 172.21.15.19:0/2683983651 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fb734042020 con 0x7fb744101a70 2024-09-19T08:57:05.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.578+0000 7fb74e879740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b29cdef80 0x562b29cdf380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:05.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.578+0000 7fb74e879740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562b29cdf8c0 0x562b29ce4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:05.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.578+0000 7fb74e879740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b29ce4950 0x562b29ce6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:05.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.578+0000 7fb74e879740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562b29c3e2f0 con 0x562b29ce4950 2024-09-19T08:57:05.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.578+0000 7fb74e879740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x562b29be6270 con 0x562b29cdf8c0 2024-09-19T08:57:05.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.578+0000 7fb74e879740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562b29c3a2b0 con 0x562b29cdef80 2024-09-19T08:57:05.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.578+0000 7fb748f9f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b29ce4950 0x562b29ce6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:05.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.578+0000 7fb7497a0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562b29cdf8c0 0x562b29ce4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:05.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.578+0000 7fb749fa1640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b29cdef80 0x562b29cdf380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:05.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.578+0000 7fb7497a0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562b29cdf8c0 0x562b29ce4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:56492/0 (socket says 172.21.15.19:56492) 2024-09-19T08:57:05.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.578+0000 7fb7497a0640 1 -- 172.21.15.19:0/2337806652 learned_addr learned my addr 172.21.15.19:0/2337806652 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:05.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.579+0000 7fb749fa1640 1 -- 172.21.15.19:0/2337806652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562b29cdf8c0 msgr2=0x562b29ce4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:05.585 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.579+0000 7fb749fa1640 1 --2- 172.21.15.19:0/2337806652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562b29cdf8c0 0x562b29ce4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:05.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.579+0000 7fb749fa1640 1 -- 172.21.15.19:0/2337806652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b29ce4950 msgr2=0x562b29ce6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:05.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.579+0000 7fb749fa1640 1 --2- 172.21.15.19:0/2337806652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b29ce4950 0x562b29ce6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:05.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.579+0000 7fb749fa1640 1 -- 172.21.15.19:0/2337806652 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b29be5340 con 0x562b29cdef80 2024-09-19T08:57:05.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.579+0000 7fb73a7fc640 1 --2- 172.21.15.19:0/2683983651 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb7300a3240 0x7fb7300a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:05.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.579+0000 7fb749fa1640 1 --2- 172.21.15.19:0/2337806652 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b29cdef80 0x562b29cdf380 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb73c00e7f0 tx=0x7fb73c00ebf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11559cd4d200a801 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:05.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.579+0000 7fb7497a0640 1 --2- 172.21.15.19:0/2683983651 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb7300a3240 0x7fb7300a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:05.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.579+0000 7fb73a7fc640 1 -- 172.21.15.19:0/2683983651 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb7340ef3f0 con 0x7fb744101a70 2024-09-19T08:57:05.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.579+0000 7fb72f7fe640 1 -- 172.21.15.19:0/2337806652 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73c00cce0 con 0x562b29cdef80 2024-09-19T08:57:05.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.579+0000 7fb72f7fe640 1 -- 172.21.15.19:0/2337806652 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb73c01d070 con 0x562b29cdef80 2024-09-19T08:57:05.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.579+0000 7fb72f7fe640 1 -- 172.21.15.19:0/2337806652 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73c00b5c0 con 0x562b29cdef80 2024-09-19T08:57:05.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.580+0000 7fb74e879740 1 -- 172.21.15.19:0/2337806652 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b29cdef80 msgr2=0x562b29cdf380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:05.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.580+0000 7fb7497a0640 1 --2- 172.21.15.19:0/2683983651 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb7300a3240 0x7fb7300a5700 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x562b29ce02f0 tx=0x7fb740005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:05.586 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.580+0000 7fb74e879740 1 --2- 172.21.15.19:0/2337806652 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b29cdef80 0x562b29cdf380 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb73c00e7f0 tx=0x7fb73c00ebf0 comp rx=0 tx=0).stop 2024-09-19T08:57:05.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.580+0000 7fb74e879740 1 -- 172.21.15.19:0/2337806652 shutdown_connections 2024-09-19T08:57:05.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.580+0000 7fb74e879740 1 --2- 172.21.15.19:0/2337806652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b29ce4950 0x562b29ce6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:05.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.580+0000 7fb74e879740 1 --2- 172.21.15.19:0/2337806652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562b29cdf8c0 0x562b29ce4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:05.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.580+0000 7fb74e879740 1 --2- 172.21.15.19:0/2337806652 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b29cdef80 0x562b29cdf380 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:05.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.580+0000 7fb74e879740 1 -- 172.21.15.19:0/2337806652 >> 172.21.15.19:0/2337806652 conn(0x562b29cda5f0 msgr2=0x562b29cda9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:05.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.580+0000 7fb74e879740 1 -- 172.21.15.19:0/2337806652 shutdown_connections 2024-09-19T08:57:05.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.580+0000 7fb74e879740 1 -- 172.21.15.19:0/2337806652 wait complete. 2024-09-19T08:57:05.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.580+0000 7fb74e879740 1 -- start start 2024-09-19T08:57:05.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.580+0000 7fb74e879740 1 Processor -- start 2024-09-19T08:57:05.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.581+0000 7fb74e879740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b29cdef80 0x562b29ce91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:05.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.581+0000 7fb74e879740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b29cdf8c0 0x562b29ce96e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:05.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.581+0000 7fb74e879740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562b29ce4950 0x562b29cf0720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:05.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.581+0000 7fb74e879740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562b29ce7920 con 0x562b29cdf8c0 2024-09-19T08:57:05.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.581+0000 7fb74e879740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x562b29bc7290 con 0x562b29ce4950 2024-09-19T08:57:05.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.581+0000 7fb74e879740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562b29ce7aa0 con 0x562b29cdef80 2024-09-19T08:57:05.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.581+0000 7fb74e879740 10 client.0 _ll_register_callbacks cb 0x562b29bf8140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:05.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.581+0000 7fb748f9f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b29cdf8c0 0x562b29ce96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:05.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.581+0000 7fb7497a0640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b29cdef80 0x562b29ce91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:05.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.581+0000 7fb7497a0640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b29cdef80 0x562b29ce91a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:49776/0 (socket says 172.21.15.19:49776) 2024-09-19T08:57:05.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.581+0000 7fb7497a0640 1 -- 172.21.15.19:0/1658422394 learned_addr learned my addr 172.21.15.19:0/1658422394 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:05.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.581+0000 7fb749fa1640 1 --2- 172.21.15.19:0/1658422394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562b29ce4950 0x562b29cf0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:05.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.581+0000 7fb748f9f640 1 -- 172.21.15.19:0/1658422394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b29cdef80 msgr2=0x562b29ce91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:05.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.581+0000 7fb748f9f640 1 --2- 172.21.15.19:0/1658422394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b29cdef80 0x562b29ce91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:05.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.581+0000 7fb748f9f640 1 -- 172.21.15.19:0/1658422394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562b29ce4950 msgr2=0x562b29cf0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:05.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.581+0000 7fb748f9f640 1 --2- 172.21.15.19:0/1658422394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562b29ce4950 0x562b29cf0720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:05.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.581+0000 7fb748f9f640 1 -- 172.21.15.19:0/1658422394 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b29951210 con 0x562b29cdf8c0 2024-09-19T08:57:05.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.581+0000 7fb7497a0640 1 --2- 172.21.15.19:0/1658422394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b29cdef80 0x562b29ce91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:57:05.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.581+0000 7fb748f9f640 1 --2- 172.21.15.19:0/1658422394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b29cdf8c0 0x562b29ce96e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fb7340ecf50 tx=0x7fb7340f2ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70be95901da1a784 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:05.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.581+0000 7fb72cff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:57:05.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.582+0000 7fb72cff9640 1 -- 172.21.15.19:0/1658422394 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7340bb7f0 con 0x562b29cdf8c0 2024-09-19T08:57:05.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.582+0000 7fb72cff9640 1 -- 172.21.15.19:0/1658422394 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb734003c50 con 0x562b29cdf8c0 2024-09-19T08:57:05.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.582+0000 7fb74e879740 1 -- 172.21.15.19:0/1658422394 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb73c01d070 con 0x562b29cdf8c0 2024-09-19T08:57:05.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.582+0000 7fb72cff9640 1 -- 172.21.15.19:0/1658422394 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb7340035f0 con 0x562b29cdf8c0 2024-09-19T08:57:05.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.582+0000 7fb74e879740 10 client.16578 fetch_fsmap learned FSMap version 33 2024-09-19T08:57:05.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.582+0000 7fb74e879740 1 -- 172.21.15.19:0/1658422394 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x562b29a1d620 con 0x562b29cdf8c0 2024-09-19T08:57:05.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.582+0000 7fb72cff9640 1 -- 172.21.15.19:0/1658422394 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb73c01d070 con 0x562b29cdf8c0 2024-09-19T08:57:05.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.582+0000 7fb72cff9640 1 -- 172.21.15.19:0/1658422394 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7fb7340a4ce0 con 0x562b29cdf8c0 2024-09-19T08:57:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.582+0000 7fb74e879740 10 client.16578 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:57:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.582+0000 7fb74e879740 10 client.16578 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:57:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.582+0000 7fb74e879740 20 client.16578 populate_metadata read hostname 'smithi019' 2024-09-19T08:57:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.582+0000 7fb74e879740 1 --2- 172.21.15.19:0/1658422394 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x562b29cf4e10 0x562b29cf7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.582+0000 7fb74e879740 4 client.16578 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:57:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.582+0000 7fb74e879740 1 -- 172.21.15.19:0/1658422394 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b29c4ba20 con 0x562b29cf4e10 2024-09-19T08:57:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.582+0000 7fb7497a0640 1 --2- 172.21.15.19:0/1658422394 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x562b29cf4e10 0x562b29cf7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.583+0000 7fb7497a0640 1 --2- 172.21.15.19:0/1658422394 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x562b29cf4e10 0x562b29cf7270 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9850e476ec4d572e server_cookie=3817155c069c876 in_seq=0 out_seq=0 2024-09-19T08:57:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.583+0000 7fb72cff9640 10 client.16578 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:57:05.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.586+0000 7fb72cff9640 1 -- 172.21.15.19:0/1658422394 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562b29c4ba20 con 0x562b29cf4e10 2024-09-19T08:57:05.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.586+0000 7fb72cff9640 10 client.16578 handle_command_reply: tid=0 2024-09-19T08:57:05.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.586+0000 7fb74e879740 1 client.16578 shutdown 2024-09-19T08:57:05.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.586+0000 7fb74e879740 1 -- 172.21.15.19:0/1658422394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b29cdf8c0 msgr2=0x562b29ce96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:05.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.586+0000 7fb74e879740 1 --2- 172.21.15.19:0/1658422394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b29cdf8c0 0x562b29ce96e0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fb7340ecf50 tx=0x7fb7340f2ac0 comp rx=0 tx=0).stop 2024-09-19T08:57:05.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.586+0000 7fb74e879740 1 -- 172.21.15.19:0/1658422394 shutdown_connections 2024-09-19T08:57:05.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.586+0000 7fb74e879740 1 --2- 172.21.15.19:0/1658422394 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x562b29cf4e10 0x562b29cf7270 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:05.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.586+0000 7fb74e879740 1 --2- 172.21.15.19:0/1658422394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562b29ce4950 0x562b29cf0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:05.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.586+0000 7fb74e879740 1 --2- 172.21.15.19:0/1658422394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b29cdf8c0 0x562b29ce96e0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:05.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.586+0000 7fb74e879740 1 --2- 172.21.15.19:0/1658422394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b29cdef80 0x562b29ce91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:05.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.586+0000 7fb72cff9640 0 client.16578 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:57:05.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.586+0000 7fb74e879740 1 -- 172.21.15.19:0/1658422394 >> 172.21.15.19:0/1658422394 conn(0x562b29cda5f0 msgr2=0x562b29cdbe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:05.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.587+0000 7fb74e879740 1 -- 172.21.15.19:0/1658422394 shutdown_connections 2024-09-19T08:57:05.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.587+0000 7fb74e879740 1 -- 172.21.15.19:0/1658422394 wait complete. 2024-09-19T08:57:05.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.587+0000 7fb74e879740 20 client.16578 trim_cache size 0 max 16384 2024-09-19T08:57:05.606 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.601+0000 7fb74e879740 1 Processor -- start 2024-09-19T08:57:05.606 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.601+0000 7fb74e879740 1 -- start start 2024-09-19T08:57:05.606 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.601+0000 7fb74e879740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b29cdef80 0x562b29cf6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:05.606 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.601+0000 7fb74e879740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562b29cdf8c0 0x562b29cf06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:05.606 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.601+0000 7fb74e879740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b29ce4950 0x562b29cd51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:05.606 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.601+0000 7fb74e879740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb72800e390 con 0x562b29cdef80 2024-09-19T08:57:05.606 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.601+0000 7fb74e879740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb72800ff00 con 0x562b29cdf8c0 2024-09-19T08:57:05.607 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.601+0000 7fb74e879740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb72800ea60 con 0x562b29ce4950 2024-09-19T08:57:05.607 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.601+0000 7fb7497a0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b29cdef80 0x562b29cf6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:05.607 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.601+0000 7fb7497a0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b29cdef80 0x562b29cf6e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58434/0 (socket says 172.21.15.19:58434) 2024-09-19T08:57:05.607 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.601+0000 7fb7497a0640 1 -- 172.21.15.19:0/138708311 learned_addr learned my addr 172.21.15.19:0/138708311 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:05.607 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.601+0000 7fb749fa1640 1 --2- 172.21.15.19:0/138708311 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b29ce4950 0x562b29cd51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:05.607 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.601+0000 7fb748f9f640 1 --2- 172.21.15.19:0/138708311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562b29cdf8c0 0x562b29cf06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:05.607 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.601+0000 7fb7497a0640 1 -- 172.21.15.19:0/138708311 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b29ce4950 msgr2=0x562b29cd51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:05.607 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.602+0000 7fb7497a0640 1 --2- 172.21.15.19:0/138708311 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b29ce4950 0x562b29cd51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:05.607 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.602+0000 7fb7497a0640 1 -- 172.21.15.19:0/138708311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562b29cdf8c0 msgr2=0x562b29cf06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:05.607 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.602+0000 7fb7497a0640 1 --2- 172.21.15.19:0/138708311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562b29cdf8c0 0x562b29cf06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:05.607 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.602+0000 7fb7497a0640 1 -- 172.21.15.19:0/138708311 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b29ce8ce0 con 0x562b29cdef80 2024-09-19T08:57:05.607 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.602+0000 7fb748f9f640 1 --2- 172.21.15.19:0/138708311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562b29cdf8c0 0x562b29cf06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:57:05.607 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.602+0000 7fb7497a0640 1 --2- 172.21.15.19:0/138708311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b29cdef80 0x562b29cf6e20 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fb740012cb0 tx=0x7fb74001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fbaad16f289926 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:05.608 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.602+0000 7fb72effd640 1 -- 172.21.15.19:0/138708311 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb74002b420 con 0x562b29cdef80 2024-09-19T08:57:05.608 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.602+0000 7fb72effd640 1 -- 172.21.15.19:0/138708311 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb74002baa0 con 0x562b29cdef80 2024-09-19T08:57:05.608 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.602+0000 7fb72effd640 1 -- 172.21.15.19:0/138708311 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb74001fd90 con 0x562b29cdef80 2024-09-19T08:57:05.608 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.602+0000 7fb74e879740 1 -- 172.21.15.19:0/138708311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b29cdef80 msgr2=0x562b29cf6e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:05.608 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.602+0000 7fb74e879740 1 --2- 172.21.15.19:0/138708311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b29cdef80 0x562b29cf6e20 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fb740012cb0 tx=0x7fb74001b000 comp rx=0 tx=0).stop 2024-09-19T08:57:05.608 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.602+0000 7fb74e879740 1 -- 172.21.15.19:0/138708311 shutdown_connections 2024-09-19T08:57:05.608 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.602+0000 7fb74e879740 1 --2- 172.21.15.19:0/138708311 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b29ce4950 0x562b29cd51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:05.608 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.602+0000 7fb74e879740 1 --2- 172.21.15.19:0/138708311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562b29cdf8c0 0x562b29cf06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:05.608 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.602+0000 7fb74e879740 1 --2- 172.21.15.19:0/138708311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b29cdef80 0x562b29cf6e20 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:05.608 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.603+0000 7fb74e879740 1 -- 172.21.15.19:0/138708311 >> 172.21.15.19:0/138708311 conn(0x562b29cda5f0 msgr2=0x562b29cd4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:05.609 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.603+0000 7fb74e879740 1 -- 172.21.15.19:0/138708311 shutdown_connections 2024-09-19T08:57:05.609 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.603+0000 7fb74e879740 1 -- 172.21.15.19:0/138708311 wait complete. 2024-09-19T08:57:05.609 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.603+0000 7fb74e879740 1 -- start start 2024-09-19T08:57:05.609 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.603+0000 7fb74e879740 1 Processor -- start 2024-09-19T08:57:05.609 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.603+0000 7fb74e879740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562b29cdef80 0x562b29cede40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:05.609 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.603+0000 7fb74e879740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b29cdf8c0 0x562b29cee380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:05.609 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.603+0000 7fb74e879740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b29ce4950 0x562b29cef390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:05.609 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.603+0000 7fb74e879740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb72800f830 con 0x562b29ce4950 2024-09-19T08:57:05.609 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.603+0000 7fb74e879740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb72800f160 con 0x562b29cdef80 2024-09-19T08:57:05.609 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.603+0000 7fb74e879740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb72800c370 con 0x562b29cdf8c0 2024-09-19T08:57:05.609 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.603+0000 7fb74e879740 10 client.0 _ll_register_callbacks cb 0x7fb7340f2bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:05.609 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.603+0000 7fb749fa1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b29ce4950 0x562b29cef390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:05.609 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.603+0000 7fb749fa1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b29ce4950 0x562b29cef390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58446/0 (socket says 172.21.15.19:58446) 2024-09-19T08:57:05.610 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.603+0000 7fb749fa1640 1 -- 172.21.15.19:0/957368322 learned_addr learned my addr 172.21.15.19:0/957368322 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:05.610 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.603+0000 7fb7497a0640 1 --2- 172.21.15.19:0/957368322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562b29cdef80 0x562b29cede40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:05.610 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.604+0000 7fb748f9f640 1 --2- 172.21.15.19:0/957368322 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b29cdf8c0 0x562b29cee380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:05.610 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.604+0000 7fb749fa1640 1 -- 172.21.15.19:0/957368322 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b29cdf8c0 msgr2=0x562b29cee380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:05.610 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.604+0000 7fb749fa1640 1 --2- 172.21.15.19:0/957368322 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b29cdf8c0 0x562b29cee380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:05.610 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.604+0000 7fb749fa1640 1 -- 172.21.15.19:0/957368322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562b29cdef80 msgr2=0x562b29cede40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:05.610 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.604+0000 7fb749fa1640 1 --2- 172.21.15.19:0/957368322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562b29cdef80 0x562b29cede40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:05.610 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.604+0000 7fb749fa1640 1 -- 172.21.15.19:0/957368322 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b29cef9a0 con 0x562b29ce4950 2024-09-19T08:57:05.610 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.604+0000 7fb749fa1640 1 --2- 172.21.15.19:0/957368322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b29ce4950 0x562b29cef390 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fb73c009c50 tx=0x7fb73c004ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6a83dece485af5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:05.610 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.604+0000 7fb72cff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:57:05.610 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.604+0000 7fb72cff9640 1 -- 172.21.15.19:0/957368322 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73c003b70 con 0x562b29ce4950 2024-09-19T08:57:05.610 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.604+0000 7fb72cff9640 1 -- 172.21.15.19:0/957368322 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb73c003d10 con 0x562b29ce4950 2024-09-19T08:57:05.610 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.604+0000 7fb74e879740 1 -- 172.21.15.19:0/957368322 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb74002baa0 con 0x562b29ce4950 2024-09-19T08:57:05.611 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.604+0000 7fb72cff9640 1 -- 172.21.15.19:0/957368322 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb73c004e10 con 0x562b29ce4950 2024-09-19T08:57:05.611 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.604+0000 7fb74e879740 10 client.16584 fetch_fsmap learned FSMap version 33 2024-09-19T08:57:05.611 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.604+0000 7fb74e879740 1 -- 172.21.15.19:0/957368322 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x562b29d5fb50 con 0x562b29ce4950 2024-09-19T08:57:05.611 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.604+0000 7fb72cff9640 1 -- 172.21.15.19:0/957368322 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb74002baa0 con 0x562b29ce4950 2024-09-19T08:57:05.611 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.605+0000 7fb72cff9640 1 -- 172.21.15.19:0/957368322 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7fb73c00b040 con 0x562b29ce4950 2024-09-19T08:57:05.611 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.605+0000 7fb74e879740 10 client.16584 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:57:05.611 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.605+0000 7fb74e879740 10 client.16584 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:57:05.611 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.605+0000 7fb74e879740 20 client.16584 populate_metadata read hostname 'smithi019' 2024-09-19T08:57:05.611 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.605+0000 7fb74e879740 1 --2- 172.21.15.19:0/957368322 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x562b29d602a0 0x562b29d626c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:05.612 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.605+0000 7fb74e879740 4 client.16584 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:57:05.612 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.605+0000 7fb74e879740 1 -- 172.21.15.19:0/957368322 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562b29c45d70 con 0x562b29d602a0 2024-09-19T08:57:05.612 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.605+0000 7fb7497a0640 1 --2- 172.21.15.19:0/957368322 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x562b29d602a0 0x562b29d626c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:05.612 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.605+0000 7fb72cff9640 10 client.16584 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:57:05.612 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:05.605+0000 7fb7497a0640 1 --2- 172.21.15.19:0/957368322 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x562b29d602a0 0x562b29d626c0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17dc1ea4094f2188 server_cookie=1b142874a487ee40 in_seq=0 out_seq=0 2024-09-19T08:57:05.674 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:05 smithi155 ceph-mon[34921]: pgmap v483: 97 pgs: 97 active+clean; 20 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 1.92k op/s 2024-09-19T08:57:05.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:05 smithi203 ceph-mon[35450]: pgmap v483: 97 pgs: 97 active+clean; 20 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 1.92k op/s 2024-09-19T08:57:05.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:05 smithi019 ceph-mon[30976]: pgmap v483: 97 pgs: 97 active+clean; 20 MiB data, 628 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 1.92k op/s 2024-09-19T08:57:07.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:07 smithi155 ceph-mon[34921]: pgmap v484: 97 pgs: 97 active+clean; 20 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 1.32k op/s 2024-09-19T08:57:07.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:07 smithi203 ceph-mon[35450]: pgmap v484: 97 pgs: 97 active+clean; 20 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 1.32k op/s 2024-09-19T08:57:07.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:07 smithi019 ceph-mon[30976]: pgmap v484: 97 pgs: 97 active+clean; 20 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.0 MiB/s wr, 1.32k op/s 2024-09-19T08:57:09.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:09 smithi155 ceph-mon[34921]: pgmap v485: 97 pgs: 97 active+clean; 25 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 818 op/s 2024-09-19T08:57:09.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:09 smithi203 ceph-mon[35450]: pgmap v485: 97 pgs: 97 active+clean; 25 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 818 op/s 2024-09-19T08:57:09.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:09 smithi019 ceph-mon[30976]: pgmap v485: 97 pgs: 97 active+clean; 25 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.3 MiB/s wr, 818 op/s 2024-09-19T08:57:11.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:11 smithi155 ceph-mon[34921]: pgmap v486: 97 pgs: 97 active+clean; 25 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 489 op/s 2024-09-19T08:57:11.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:11 smithi203 ceph-mon[35450]: pgmap v486: 97 pgs: 97 active+clean; 25 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 489 op/s 2024-09-19T08:57:11.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:11 smithi019 ceph-mon[30976]: pgmap v486: 97 pgs: 97 active+clean; 25 MiB data, 665 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.2 MiB/s wr, 489 op/s 2024-09-19T08:57:13.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:13 smithi155 ceph-mon[34921]: pgmap v487: 97 pgs: 97 active+clean; 29 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.9 MiB/s wr, 1.68k op/s 2024-09-19T08:57:13.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:13 smithi203 ceph-mon[35450]: pgmap v487: 97 pgs: 97 active+clean; 29 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.9 MiB/s wr, 1.68k op/s 2024-09-19T08:57:13.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:13 smithi019 ceph-mon[30976]: pgmap v487: 97 pgs: 97 active+clean; 29 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.9 MiB/s wr, 1.68k op/s 2024-09-19T08:57:14.169 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:14.169+0000 7fb72cff9640 1 -- 172.21.15.19:0/957368322 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562b29c45d70 con 0x562b29d602a0 2024-09-19T08:57:14.169 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:14.169+0000 7fb72cff9640 10 client.16584 handle_command_reply: tid=0 2024-09-19T08:57:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:14.169+0000 7fb74e879740 1 client.16584 shutdown 2024-09-19T08:57:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:14.169+0000 7fb74e879740 1 -- 172.21.15.19:0/957368322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b29ce4950 msgr2=0x562b29cef390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:14.169+0000 7fb74e879740 1 --2- 172.21.15.19:0/957368322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b29ce4950 0x562b29cef390 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fb73c009c50 tx=0x7fb73c004ca0 comp rx=0 tx=0).stop 2024-09-19T08:57:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:14.169+0000 7fb74e879740 1 -- 172.21.15.19:0/957368322 shutdown_connections 2024-09-19T08:57:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:14.169+0000 7fb74e879740 1 --2- 172.21.15.19:0/957368322 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x562b29d602a0 0x562b29d626c0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:14.169+0000 7fb74e879740 1 --2- 172.21.15.19:0/957368322 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562b29cdf8c0 0x562b29cee380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:14.169+0000 7fb74e879740 1 --2- 172.21.15.19:0/957368322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562b29ce4950 0x562b29cef390 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:14.169+0000 7fb74e879740 1 --2- 172.21.15.19:0/957368322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562b29cdef80 0x562b29cede40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:14.169+0000 7fb72cff9640 0 client.16584 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:57:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:14.169+0000 7fb74e879740 1 -- 172.21.15.19:0/957368322 >> 172.21.15.19:0/957368322 conn(0x562b29cda5f0 msgr2=0x562b29cd52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:14.169+0000 7fb74e879740 1 -- 172.21.15.19:0/957368322 shutdown_connections 2024-09-19T08:57:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:14.169+0000 7fb74e879740 1 -- 172.21.15.19:0/957368322 wait complete. 2024-09-19T08:57:14.170 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:14.170+0000 7fb74e879740 20 client.16584 trim_cache size 0 max 16384 2024-09-19T08:57:14.171 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T08:57:14.171 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T08:57:14.171 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T08:57:14.171 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T08:57:14.172 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:14.170+0000 7fb74a7a2640 1 -- 172.21.15.19:0/2683983651 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb7300a3240 msgr2=0x7fb7300a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:14.172 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:14.170+0000 7fb74a7a2640 1 --2- 172.21.15.19:0/2683983651 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb7300a3240 0x7fb7300a5700 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x562b29ce02f0 tx=0x7fb740005f90 comp rx=0 tx=0).stop 2024-09-19T08:57:14.172 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:14.170+0000 7fb74a7a2640 1 -- 172.21.15.19:0/2683983651 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb744101a70 msgr2=0x7fb744198260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:14.172 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:14.170+0000 7fb74a7a2640 1 --2- 172.21.15.19:0/2683983651 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb744101a70 0x7fb744198260 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb73402a860 tx=0x7fb734033ae0 comp rx=0 tx=0).stop 2024-09-19T08:57:14.172 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:14.170+0000 7fb74a7a2640 1 -- 172.21.15.19:0/2683983651 shutdown_connections 2024-09-19T08:57:14.172 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:14.170+0000 7fb74a7a2640 1 --2- 172.21.15.19:0/2683983651 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb7300a3240 0x7fb7300a5700 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:14.172 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:14.170+0000 7fb74a7a2640 1 --2- 172.21.15.19:0/2683983651 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb744101a70 0x7fb744198260 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:14.172 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:14.170+0000 7fb74a7a2640 1 --2- 172.21.15.19:0/2683983651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb744102430 0x7fb74419f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:14.173 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:14.170+0000 7fb74a7a2640 1 --2- 172.21.15.19:0/2683983651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb744100880 0x7fb744197d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:14.173 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:14.170+0000 7fb74a7a2640 1 -- 172.21.15.19:0/2683983651 >> 172.21.15.19:0/2683983651 conn(0x7fb7440fbfe0 msgr2=0x7fb744104e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:14.173 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:14.170+0000 7fb74a7a2640 1 -- 172.21.15.19:0/2683983651 shutdown_connections 2024-09-19T08:57:14.173 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:14.170+0000 7fb74a7a2640 1 -- 172.21.15.19:0/2683983651 wait complete. 2024-09-19T08:57:15.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:15 smithi155 ceph-mon[34921]: pgmap v488: 97 pgs: 97 active+clean; 33 MiB data, 839 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.0 MiB/s wr, 2.17k op/s 2024-09-19T08:57:15.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:15 smithi203 ceph-mon[35450]: pgmap v488: 97 pgs: 97 active+clean; 33 MiB data, 839 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.0 MiB/s wr, 2.17k op/s 2024-09-19T08:57:15.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:15 smithi019 ceph-mon[30976]: pgmap v488: 97 pgs: 97 active+clean; 33 MiB data, 839 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.0 MiB/s wr, 2.17k op/s 2024-09-19T08:57:17.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:17 smithi155 ceph-mon[34921]: pgmap v489: 97 pgs: 97 active+clean; 25 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 2.13k op/s 2024-09-19T08:57:17.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:17 smithi203 ceph-mon[35450]: pgmap v489: 97 pgs: 97 active+clean; 25 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 2.13k op/s 2024-09-19T08:57:17.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:17 smithi019 ceph-mon[30976]: pgmap v489: 97 pgs: 97 active+clean; 25 MiB data, 887 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 2.13k op/s 2024-09-19T08:57:19.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:19 smithi155 ceph-mon[34921]: pgmap v490: 97 pgs: 97 active+clean; 17 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 2.16k op/s 2024-09-19T08:57:19.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:19 smithi203 ceph-mon[35450]: pgmap v490: 97 pgs: 97 active+clean; 17 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 2.16k op/s 2024-09-19T08:57:19.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:19 smithi019 ceph-mon[30976]: pgmap v490: 97 pgs: 97 active+clean; 17 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.6 MiB/s wr, 2.16k op/s 2024-09-19T08:57:21.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:21 smithi203 ceph-mon[35450]: pgmap v491: 97 pgs: 97 active+clean; 21 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.4 MiB/s wr, 2.15k op/s 2024-09-19T08:57:21.821 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:21 smithi019 ceph-mon[30976]: pgmap v491: 97 pgs: 97 active+clean; 21 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.4 MiB/s wr, 2.15k op/s 2024-09-19T08:57:21.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:21 smithi155 ceph-mon[34921]: pgmap v491: 97 pgs: 97 active+clean; 21 MiB data, 937 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.4 MiB/s wr, 2.15k op/s 2024-09-19T08:57:23.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:23 smithi203 ceph-mon[35450]: pgmap v492: 97 pgs: 97 active+clean; 26 MiB data, 994 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 2.23k op/s 2024-09-19T08:57:23.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:23 smithi019 ceph-mon[30976]: pgmap v492: 97 pgs: 97 active+clean; 26 MiB data, 994 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 2.23k op/s 2024-09-19T08:57:23.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:23 smithi155 ceph-mon[34921]: pgmap v492: 97 pgs: 97 active+clean; 26 MiB data, 994 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 2.23k op/s 2024-09-19T08:57:25.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:25 smithi203 ceph-mon[35450]: pgmap v493: 97 pgs: 97 active+clean; 26 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 1.04k op/s 2024-09-19T08:57:25.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:25 smithi019 ceph-mon[30976]: pgmap v493: 97 pgs: 97 active+clean; 26 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 1.04k op/s 2024-09-19T08:57:25.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:25 smithi155 ceph-mon[34921]: pgmap v493: 97 pgs: 97 active+clean; 26 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.2 MiB/s wr, 1.04k op/s 2024-09-19T08:57:27.267 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.267+0000 7f955d92a640 1 -- 172.21.15.19:0/1040730965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95581078f0 msgr2=0x7f9558109ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:27.267 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.267+0000 7f955d92a640 1 --2- 172.21.15.19:0/1040730965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95581078f0 0x7f9558109ce0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f9550009900 tx=0x7f955002a410 comp rx=0 tx=0).stop 2024-09-19T08:57:27.267 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.267+0000 7f955d92a640 1 -- 172.21.15.19:0/1040730965 shutdown_connections 2024-09-19T08:57:27.267 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.267+0000 7f955d92a640 1 --2- 172.21.15.19:0/1040730965 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f95581078f0 0x7f9558109ce0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:27.267 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.267+0000 7f955d92a640 1 --2- 172.21.15.19:0/1040730965 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9558104fc0 0x7f95581073b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:27.267 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.267+0000 7f955d92a640 1 --2- 172.21.15.19:0/1040730965 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9558102690 0x7f9558104a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:27.267 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.267+0000 7f955d92a640 1 -- 172.21.15.19:0/1040730965 >> 172.21.15.19:0/1040730965 conn(0x7f95580fc1b0 msgr2=0x7f95580fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:27.268 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.267+0000 7f955d92a640 1 -- 172.21.15.19:0/1040730965 shutdown_connections 2024-09-19T08:57:27.268 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.267+0000 7f955d92a640 1 -- 172.21.15.19:0/1040730965 wait complete. 2024-09-19T08:57:27.268 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.268+0000 7f955d92a640 1 Processor -- start 2024-09-19T08:57:27.268 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.268+0000 7f955d92a640 1 -- start start 2024-09-19T08:57:27.269 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.268+0000 7f955d92a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9558102690 0x7f9558197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.268+0000 7f955d92a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9558104fc0 0x7f9558198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.268+0000 7f955d92a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95581078f0 0x7f955819f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.268+0000 7f955d92a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f955810d800 con 0x7f9558102690 2024-09-19T08:57:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.268+0000 7f955d92a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f955810d680 con 0x7f9558104fc0 2024-09-19T08:57:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.268+0000 7f955d92a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f955810d980 con 0x7f95581078f0 2024-09-19T08:57:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.268+0000 7f9556ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9558102690 0x7f9558197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.268+0000 7f9556ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9558102690 0x7f9558197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45130/0 (socket says 172.21.15.19:45130) 2024-09-19T08:57:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.268+0000 7f9556ffd640 1 -- 172.21.15.19:0/797935188 learned_addr learned my addr 172.21.15.19:0/797935188 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.268+0000 7f95567fc640 1 --2- 172.21.15.19:0/797935188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9558104fc0 0x7f9558198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.269+0000 7f95577fe640 1 --2- 172.21.15.19:0/797935188 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95581078f0 0x7f955819f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.269+0000 7f9556ffd640 1 -- 172.21.15.19:0/797935188 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95581078f0 msgr2=0x7f955819f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:27.270 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.269+0000 7f9556ffd640 1 --2- 172.21.15.19:0/797935188 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95581078f0 0x7f955819f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:27.271 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.269+0000 7f9556ffd640 1 -- 172.21.15.19:0/797935188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9558104fc0 msgr2=0x7f9558198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:27.271 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.269+0000 7f9556ffd640 1 --2- 172.21.15.19:0/797935188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9558104fc0 0x7f9558198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:27.271 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.269+0000 7f9556ffd640 1 -- 172.21.15.19:0/797935188 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f955819f9e0 con 0x7f9558102690 2024-09-19T08:57:27.271 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.269+0000 7f9556ffd640 1 --2- 172.21.15.19:0/797935188 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9558102690 0x7f9558197dc0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f954800ea80 tx=0x7f954800ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:27.271 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.269+0000 7f955c928640 1 -- 172.21.15.19:0/797935188 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f954800ce40 con 0x7f9558102690 2024-09-19T08:57:27.271 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.269+0000 7f955c928640 1 -- 172.21.15.19:0/797935188 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9548005020 con 0x7f9558102690 2024-09-19T08:57:27.271 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.269+0000 7f955d92a640 1 -- 172.21.15.19:0/797935188 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f955819fcd0 con 0x7f9558102690 2024-09-19T08:57:27.271 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.269+0000 7f955c928640 1 -- 172.21.15.19:0/797935188 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9548011760 con 0x7f9558102690 2024-09-19T08:57:27.271 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.269+0000 7f955d92a640 1 -- 172.21.15.19:0/797935188 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95581a01d0 con 0x7f9558102690 2024-09-19T08:57:27.276 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.272+0000 7f95606c4740 1 Processor -- start 2024-09-19T08:57:27.276 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.272+0000 7f95606c4740 1 -- start start 2024-09-19T08:57:27.276 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.272+0000 7f955c928640 1 -- 172.21.15.19:0/797935188 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f95480051d0 con 0x7f9558102690 2024-09-19T08:57:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.272+0000 7f95606c4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5625972d89a0 0x5625972d8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.272+0000 7f95606c4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625972d92e0 0x5625972ddda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.272+0000 7f95606c4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625972de370 0x5625972e0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.272+0000 7f95606c4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56259723c2f0 con 0x5625972d89a0 2024-09-19T08:57:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.272+0000 7f95606c4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5625971e4270 con 0x5625972de370 2024-09-19T08:57:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.272+0000 7f95606c4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5625972382b0 con 0x5625972d92e0 2024-09-19T08:57:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.272+0000 7f95577fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5625972d89a0 0x5625972d8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.272+0000 7f95577fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5625972d89a0 0x5625972d8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45132/0 (socket says 172.21.15.19:45132) 2024-09-19T08:57:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.272+0000 7f95567fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625972de370 0x5625972e0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.272+0000 7f95577fe640 1 -- 172.21.15.19:0/903166779 learned_addr learned my addr 172.21.15.19:0/903166779 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.272+0000 7f9556ffd640 1 --2- 172.21.15.19:0/903166779 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625972d92e0 0x5625972ddda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.273+0000 7f95567fc640 1 -- 172.21.15.19:0/903166779 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625972d92e0 msgr2=0x5625972ddda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:27.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.273+0000 7f95567fc640 1 --2- 172.21.15.19:0/903166779 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625972d92e0 0x5625972ddda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:27.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.273+0000 7f95567fc640 1 -- 172.21.15.19:0/903166779 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5625972d89a0 msgr2=0x5625972d8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:27.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.273+0000 7f95567fc640 1 --2- 172.21.15.19:0/903166779 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5625972d89a0 0x5625972d8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:27.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.273+0000 7f95567fc640 1 -- 172.21.15.19:0/903166779 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625971e3340 con 0x5625972de370 2024-09-19T08:57:27.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.273+0000 7f955c928640 1 --2- 172.21.15.19:0/797935188 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f95440a32f0 0x7f95440a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:27.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.273+0000 7f95567fc640 1 --2- 172.21.15.19:0/903166779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625972de370 0x5625972e0830 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f955806adc0 tx=0x7f9540011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=320aafebef1d54d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:27.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.273+0000 7f95577fe640 1 --2- 172.21.15.19:0/797935188 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f95440a32f0 0x7f95440a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:27.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.273+0000 7f954dffb640 1 -- 172.21.15.19:0/903166779 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9540004050 con 0x5625972de370 2024-09-19T08:57:27.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.273+0000 7f955c928640 1 -- 172.21.15.19:0/797935188 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f95480cff90 con 0x7f9558102690 2024-09-19T08:57:27.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.273+0000 7f954dffb640 1 -- 172.21.15.19:0/903166779 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9540005500 con 0x5625972de370 2024-09-19T08:57:27.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.273+0000 7f954dffb640 1 -- 172.21.15.19:0/903166779 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9540004d90 con 0x5625972de370 2024-09-19T08:57:27.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.274+0000 7f95606c4740 1 -- 172.21.15.19:0/903166779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625972de370 msgr2=0x5625972e0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:27.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.274+0000 7f95577fe640 1 --2- 172.21.15.19:0/797935188 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f95440a32f0 0x7f95440a57b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9550005ab0 tx=0x7f9550005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:27.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.274+0000 7f95606c4740 1 --2- 172.21.15.19:0/903166779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625972de370 0x5625972e0830 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f955806adc0 tx=0x7f9540011810 comp rx=0 tx=0).stop 2024-09-19T08:57:27.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.274+0000 7f95606c4740 1 -- 172.21.15.19:0/903166779 shutdown_connections 2024-09-19T08:57:27.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.274+0000 7f95606c4740 1 --2- 172.21.15.19:0/903166779 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625972d92e0 0x5625972ddda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:27.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.274+0000 7f95606c4740 1 --2- 172.21.15.19:0/903166779 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625972de370 0x5625972e0830 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:27.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.274+0000 7f95606c4740 1 --2- 172.21.15.19:0/903166779 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5625972d89a0 0x5625972d8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:27.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.274+0000 7f95606c4740 1 -- 172.21.15.19:0/903166779 >> 172.21.15.19:0/903166779 conn(0x5625972d4010 msgr2=0x5625972d4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:27.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.274+0000 7f95606c4740 1 -- 172.21.15.19:0/903166779 shutdown_connections 2024-09-19T08:57:27.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.274+0000 7f95606c4740 1 -- 172.21.15.19:0/903166779 wait complete. 2024-09-19T08:57:27.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.274+0000 7f95606c4740 1 -- start start 2024-09-19T08:57:27.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.275+0000 7f95606c4740 1 Processor -- start 2024-09-19T08:57:27.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.275+0000 7f95606c4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625972d89a0 0x5625972e2b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:27.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.275+0000 7f95606c4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625972d92e0 0x5625972e30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:27.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.275+0000 7f95606c4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5625972de370 0x5625972ea0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:27.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.275+0000 7f95606c4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5625972e1340 con 0x5625972de370 2024-09-19T08:57:27.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.275+0000 7f95606c4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5625971c5290 con 0x5625972d89a0 2024-09-19T08:57:27.280 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.275+0000 7f95606c4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5625972e14c0 con 0x5625972d92e0 2024-09-19T08:57:27.280 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.275+0000 7f95606c4740 10 client.0 _ll_register_callbacks cb 0x5625971f6140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:27.280 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.275+0000 7f95567fc640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625972d92e0 0x5625972e30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:27.280 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.275+0000 7f95577fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5625972de370 0x5625972ea0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:27.280 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.275+0000 7f9556ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625972d89a0 0x5625972e2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:27.280 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.275+0000 7f95567fc640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625972d92e0 0x5625972e30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:36378/0 (socket says 172.21.15.19:36378) 2024-09-19T08:57:27.280 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.275+0000 7f95567fc640 1 -- 172.21.15.19:0/228580281 learned_addr learned my addr 172.21.15.19:0/228580281 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:27.280 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.275+0000 7f95567fc640 1 -- 172.21.15.19:0/228580281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625972d89a0 msgr2=0x5625972e2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:27.280 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.275+0000 7f95567fc640 1 --2- 172.21.15.19:0/228580281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625972d89a0 0x5625972e2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:27.280 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.275+0000 7f95567fc640 1 -- 172.21.15.19:0/228580281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5625972de370 msgr2=0x5625972ea0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:27.280 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.275+0000 7f95567fc640 1 --2- 172.21.15.19:0/228580281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5625972de370 0x5625972ea0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:27.280 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.275+0000 7f95567fc640 1 -- 172.21.15.19:0/228580281 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562596f4f210 con 0x5625972d92e0 2024-09-19T08:57:27.280 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.276+0000 7f95567fc640 1 --2- 172.21.15.19:0/228580281 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625972d92e0 0x5625972e30b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f954001b040 tx=0x7f9540004460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ac47ac2a7a0644 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:27.281 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.276+0000 7f9536ffd640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T08:57:27.281 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.276+0000 7f9536ffd640 1 -- 172.21.15.19:0/228580281 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9540029070 con 0x5625972d92e0 2024-09-19T08:57:27.281 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.276+0000 7f95606c4740 1 -- 172.21.15.19:0/228580281 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9540005500 con 0x5625972d92e0 2024-09-19T08:57:27.281 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.276+0000 7f9536ffd640 1 -- 172.21.15.19:0/228580281 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9540004f20 con 0x5625972d92e0 2024-09-19T08:57:27.281 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.276+0000 7f9536ffd640 1 -- 172.21.15.19:0/228580281 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f9540035050 con 0x5625972d92e0 2024-09-19T08:57:27.281 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.276+0000 7f95606c4740 10 client.26062 fetch_fsmap learned FSMap version 33 2024-09-19T08:57:27.281 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.276+0000 7f95606c4740 1 -- 172.21.15.19:0/228580281 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56259701b620 con 0x5625972d92e0 2024-09-19T08:57:27.281 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.276+0000 7f9536ffd640 1 -- 172.21.15.19:0/228580281 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9540005500 con 0x5625972d92e0 2024-09-19T08:57:27.281 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.277+0000 7f9536ffd640 1 -- 172.21.15.19:0/228580281 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f9540023430 con 0x5625972d92e0 2024-09-19T08:57:27.281 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.277+0000 7f95606c4740 10 client.26062 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:57:27.281 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.277+0000 7f95606c4740 10 client.26062 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:57:27.281 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.277+0000 7f95606c4740 20 client.26062 populate_metadata read hostname 'smithi019' 2024-09-19T08:57:27.281 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.277+0000 7f95606c4740 1 --2- 172.21.15.19:0/228580281 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5625972ee5c0 0x5625972f09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:27.282 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.277+0000 7f95606c4740 4 client.26062 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:57:27.282 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.277+0000 7f95606c4740 1 -- 172.21.15.19:0/228580281 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562597249a20 con 0x5625972ee5c0 2024-09-19T08:57:27.282 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.277+0000 7f9556ffd640 1 --2- 172.21.15.19:0/228580281 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5625972ee5c0 0x5625972f09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:27.283 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.277+0000 7f9556ffd640 1 --2- 172.21.15.19:0/228580281 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5625972ee5c0 0x5625972f09b0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4dce50b11124103 server_cookie=ec13442c1977fd02 in_seq=0 out_seq=0 2024-09-19T08:57:27.283 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.277+0000 7f9536ffd640 10 client.26062 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:57:27.283 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.282+0000 7f9536ffd640 1 -- 172.21.15.19:0/228580281 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562597249a20 con 0x5625972ee5c0 2024-09-19T08:57:27.283 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.282+0000 7f9536ffd640 10 client.26062 handle_command_reply: tid=0 2024-09-19T08:57:27.283 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.282+0000 7f95606c4740 1 client.26062 shutdown 2024-09-19T08:57:27.283 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.282+0000 7f95606c4740 1 -- 172.21.15.19:0/228580281 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625972d92e0 msgr2=0x5625972e30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:27.283 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.282+0000 7f95606c4740 1 --2- 172.21.15.19:0/228580281 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625972d92e0 0x5625972e30b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f954001b040 tx=0x7f9540004460 comp rx=0 tx=0).stop 2024-09-19T08:57:27.283 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.282+0000 7f95606c4740 1 -- 172.21.15.19:0/228580281 shutdown_connections 2024-09-19T08:57:27.283 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.282+0000 7f95606c4740 1 --2- 172.21.15.19:0/228580281 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5625972ee5c0 0x5625972f09b0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:27.283 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.282+0000 7f95606c4740 1 --2- 172.21.15.19:0/228580281 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625972d92e0 0x5625972e30b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:27.284 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.282+0000 7f95606c4740 1 --2- 172.21.15.19:0/228580281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5625972de370 0x5625972ea0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:27.284 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.282+0000 7f95606c4740 1 --2- 172.21.15.19:0/228580281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625972d89a0 0x5625972e2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:27.284 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.282+0000 7f9536ffd640 0 client.26062 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:57:27.284 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.282+0000 7f95606c4740 1 -- 172.21.15.19:0/228580281 >> 172.21.15.19:0/228580281 conn(0x5625972d4010 msgr2=0x5625972d5820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:27.284 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.282+0000 7f95606c4740 1 -- 172.21.15.19:0/228580281 shutdown_connections 2024-09-19T08:57:27.284 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.282+0000 7f95606c4740 1 -- 172.21.15.19:0/228580281 wait complete. 2024-09-19T08:57:27.284 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.283+0000 7f95606c4740 20 client.26062 trim_cache size 0 max 16384 2024-09-19T08:57:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.298+0000 7f95606c4740 1 Processor -- start 2024-09-19T08:57:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.298+0000 7f95606c4740 1 -- start start 2024-09-19T08:57:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.298+0000 7f95606c4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625972d89a0 0x5625972d43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:27.299 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.298+0000 7f95606c4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5625972d92e0 0x5625972ea0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.298+0000 7f95606c4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625972de370 0x5625972d4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.298+0000 7f95606c4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f95581a8fd0 con 0x5625972d92e0 2024-09-19T08:57:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.298+0000 7f95606c4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f95581aab40 con 0x5625972de370 2024-09-19T08:57:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.298+0000 7f95606c4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f95581a96a0 con 0x5625972d89a0 2024-09-19T08:57:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.298+0000 7f95567fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5625972d92e0 0x5625972ea0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.298+0000 7f95567fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5625972d92e0 0x5625972ea0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45148/0 (socket says 172.21.15.19:45148) 2024-09-19T08:57:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.298+0000 7f95567fc640 1 -- 172.21.15.19:0/2826911002 learned_addr learned my addr 172.21.15.19:0/2826911002 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.298+0000 7f95577fe640 1 --2- 172.21.15.19:0/2826911002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625972de370 0x5625972d4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.299+0000 7f9556ffd640 1 --2- 172.21.15.19:0/2826911002 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625972d89a0 0x5625972d43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.299+0000 7f95567fc640 1 -- 172.21.15.19:0/2826911002 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625972d89a0 msgr2=0x5625972d43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.299+0000 7f95567fc640 1 --2- 172.21.15.19:0/2826911002 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625972d89a0 0x5625972d43f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.299+0000 7f95567fc640 1 -- 172.21.15.19:0/2826911002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625972de370 msgr2=0x5625972d4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:27.300 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.299+0000 7f95567fc640 1 --2- 172.21.15.19:0/2826911002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625972de370 0x5625972d4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.299+0000 7f95567fc640 1 -- 172.21.15.19:0/2826911002 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5625972d3e30 con 0x5625972d92e0 2024-09-19T08:57:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.299+0000 7f9556ffd640 1 --2- 172.21.15.19:0/2826911002 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625972d89a0 0x5625972d43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:57:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.299+0000 7f95567fc640 1 --2- 172.21.15.19:0/2826911002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5625972d92e0 0x5625972ea0b0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f9540006010 tx=0x7f9540005b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89920a537f820f4b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.299+0000 7f954d7fa640 1 -- 172.21.15.19:0/2826911002 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9540029050 con 0x5625972d92e0 2024-09-19T08:57:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.299+0000 7f954d7fa640 1 -- 172.21.15.19:0/2826911002 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9540023a40 con 0x5625972d92e0 2024-09-19T08:57:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.299+0000 7f954d7fa640 1 -- 172.21.15.19:0/2826911002 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9540003c10 con 0x5625972d92e0 2024-09-19T08:57:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.300+0000 7f95606c4740 1 -- 172.21.15.19:0/2826911002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5625972d92e0 msgr2=0x5625972ea0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.300+0000 7f95606c4740 1 --2- 172.21.15.19:0/2826911002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5625972d92e0 0x5625972ea0b0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f9540006010 tx=0x7f9540005b90 comp rx=0 tx=0).stop 2024-09-19T08:57:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.300+0000 7f95606c4740 1 -- 172.21.15.19:0/2826911002 shutdown_connections 2024-09-19T08:57:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.300+0000 7f95606c4740 1 --2- 172.21.15.19:0/2826911002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625972de370 0x5625972d4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.300+0000 7f95606c4740 1 --2- 172.21.15.19:0/2826911002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5625972d92e0 0x5625972ea0b0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:27.301 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.300+0000 7f95606c4740 1 --2- 172.21.15.19:0/2826911002 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625972d89a0 0x5625972d43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.300+0000 7f95606c4740 1 -- 172.21.15.19:0/2826911002 >> 172.21.15.19:0/2826911002 conn(0x5625972d4010 msgr2=0x5625972da420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.300+0000 7f95606c4740 1 -- 172.21.15.19:0/2826911002 shutdown_connections 2024-09-19T08:57:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.300+0000 7f95606c4740 1 -- 172.21.15.19:0/2826911002 wait complete. 2024-09-19T08:57:27.302 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.300+0000 7f95606c4740 1 -- start start 2024-09-19T08:57:27.304 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.301+0000 7f95606c4740 1 Processor -- start 2024-09-19T08:57:27.305 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.301+0000 7f95606c4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625972d89a0 0x5625972e6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:27.305 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.301+0000 7f95606c4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625972d92e0 0x5625972e74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:27.305 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.301+0000 7f95606c4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5625972de370 0x562597357280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:27.305 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.301+0000 7f95606c4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f95581aa470 con 0x5625972de370 2024-09-19T08:57:27.305 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.301+0000 7f95606c4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f95581a9da0 con 0x5625972d92e0 2024-09-19T08:57:27.305 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.301+0000 7f95606c4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f95581a6fb0 con 0x5625972d89a0 2024-09-19T08:57:27.305 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.301+0000 7f95606c4740 10 client.0 _ll_register_callbacks cb 0x7f9540005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:27.305 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.301+0000 7f95577fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5625972de370 0x562597357280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:27.305 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.301+0000 7f95577fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5625972de370 0x562597357280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45150/0 (socket says 172.21.15.19:45150) 2024-09-19T08:57:27.305 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.301+0000 7f95567fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625972d92e0 0x5625972e74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:27.305 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.301+0000 7f95577fe640 1 -- 172.21.15.19:0/2467060115 learned_addr learned my addr 172.21.15.19:0/2467060115 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:27.305 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.301+0000 7f9556ffd640 1 --2- 172.21.15.19:0/2467060115 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625972d89a0 0x5625972e6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:27.305 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.301+0000 7f95577fe640 1 -- 172.21.15.19:0/2467060115 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625972d89a0 msgr2=0x5625972e6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.301+0000 7f95577fe640 1 --2- 172.21.15.19:0/2467060115 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625972d89a0 0x5625972e6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.301+0000 7f95577fe640 1 -- 172.21.15.19:0/2467060115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625972d92e0 msgr2=0x5625972e74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.301+0000 7f95577fe640 1 --2- 172.21.15.19:0/2467060115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625972d92e0 0x5625972e74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.301+0000 7f95577fe640 1 -- 172.21.15.19:0/2467060115 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5625973577c0 con 0x5625972de370 2024-09-19T08:57:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.301+0000 7f9556ffd640 1 --2- 172.21.15.19:0/2467060115 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625972d89a0 0x5625972e6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:57:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.302+0000 7f95577fe640 1 --2- 172.21.15.19:0/2467060115 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5625972de370 0x562597357280 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f95500314e0 tx=0x7f9550009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5df716db9a209694 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.302+0000 7f9536ffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:57:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.302+0000 7f9536ffd640 1 -- 172.21.15.19:0/2467060115 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9550035040 con 0x5625972de370 2024-09-19T08:57:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.302+0000 7f9536ffd640 1 -- 172.21.15.19:0/2467060115 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9550005250 con 0x5625972de370 2024-09-19T08:57:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.302+0000 7f95606c4740 1 -- 172.21.15.19:0/2467060115 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9540023a40 con 0x5625972de370 2024-09-19T08:57:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.302+0000 7f9536ffd640 1 -- 172.21.15.19:0/2467060115 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f9550005450 con 0x5625972de370 2024-09-19T08:57:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.302+0000 7f95606c4740 10 client.16602 fetch_fsmap learned FSMap version 33 2024-09-19T08:57:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.302+0000 7f95606c4740 1 -- 172.21.15.19:0/2467060115 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x562597358aa0 con 0x5625972de370 2024-09-19T08:57:27.306 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.302+0000 7f9536ffd640 1 -- 172.21.15.19:0/2467060115 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9540023a40 con 0x5625972de370 2024-09-19T08:57:27.307 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.302+0000 7f9536ffd640 1 -- 172.21.15.19:0/2467060115 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f95500038c0 con 0x5625972de370 2024-09-19T08:57:27.307 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.302+0000 7f95606c4740 10 client.16602 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:57:27.307 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.302+0000 7f95606c4740 10 client.16602 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:57:27.307 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.302+0000 7f95606c4740 20 client.16602 populate_metadata read hostname 'smithi019' 2024-09-19T08:57:27.307 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.302+0000 7f95606c4740 1 --2- 172.21.15.19:0/2467060115 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x562597359450 0x56259735b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:27.307 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.302+0000 7f95606c4740 4 client.16602 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:57:27.307 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.302+0000 7f95606c4740 1 -- 172.21.15.19:0/2467060115 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562597243d70 con 0x562597359450 2024-09-19T08:57:27.307 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.303+0000 7f9556ffd640 1 --2- 172.21.15.19:0/2467060115 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x562597359450 0x56259735b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:27.307 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.303+0000 7f9536ffd640 10 client.16602 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:57:27.307 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:27.303+0000 7f9556ffd640 1 --2- 172.21.15.19:0/2467060115 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x562597359450 0x56259735b870 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=386c099d1826db8e server_cookie=4fe9c56f399c37a7 in_seq=0 out_seq=0 2024-09-19T08:57:27.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:27 smithi203 ceph-mon[35450]: pgmap v494: 97 pgs: 97 active+clean; 26 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 525 op/s 2024-09-19T08:57:27.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:27 smithi019 ceph-mon[30976]: pgmap v494: 97 pgs: 97 active+clean; 26 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 525 op/s 2024-09-19T08:57:27.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:27 smithi155 ceph-mon[34921]: pgmap v494: 97 pgs: 97 active+clean; 26 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 525 op/s 2024-09-19T08:57:29.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:29 smithi203 ceph-mon[35450]: pgmap v495: 97 pgs: 97 active+clean; 33 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 805 op/s 2024-09-19T08:57:29.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:29 smithi019 ceph-mon[30976]: pgmap v495: 97 pgs: 97 active+clean; 33 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 805 op/s 2024-09-19T08:57:29.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:29 smithi155 ceph-mon[34921]: pgmap v495: 97 pgs: 97 active+clean; 33 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.4 MiB/s wr, 805 op/s 2024-09-19T08:57:31.724 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:31 smithi155 ceph-mon[34921]: pgmap v496: 97 pgs: 97 active+clean; 35 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 806 op/s 2024-09-19T08:57:31.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:31 smithi203 ceph-mon[35450]: pgmap v496: 97 pgs: 97 active+clean; 35 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 806 op/s 2024-09-19T08:57:31.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:31 smithi019 ceph-mon[30976]: pgmap v496: 97 pgs: 97 active+clean; 35 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.2 MiB/s wr, 806 op/s 2024-09-19T08:57:33.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:33 smithi203 ceph-mon[35450]: pgmap v497: 97 pgs: 97 active+clean; 35 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 613 op/s 2024-09-19T08:57:33.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:33 smithi019 ceph-mon[30976]: pgmap v497: 97 pgs: 97 active+clean; 35 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 613 op/s 2024-09-19T08:57:33.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:33 smithi155 ceph-mon[34921]: pgmap v497: 97 pgs: 97 active+clean; 35 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 613 op/s 2024-09-19T08:57:34.959 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:57:35.249 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:57:35.625 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:35 smithi019 ceph-mon[30976]: pgmap v498: 97 pgs: 97 active+clean; 40 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 714 op/s 2024-09-19T08:57:35.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:35 smithi203 ceph-mon[35450]: pgmap v498: 97 pgs: 97 active+clean; 40 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 714 op/s 2024-09-19T08:57:35.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.727+0000 7f4f03a08640 1 -- 172.21.15.19:0/1180199934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4efc106f40 msgr2=0x7f4efc10eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:35.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.727+0000 7f4f03a08640 1 --2- 172.21.15.19:0/1180199934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4efc106f40 0x7f4efc10eac0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4009ca0 tx=0x7f4ef402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.727+0000 7f4f03a08640 1 -- 172.21.15.19:0/1180199934 shutdown_connections 2024-09-19T08:57:35.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.727+0000 7f4f03a08640 1 --2- 172.21.15.19:0/1180199934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4efc106f40 0x7f4efc10eac0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.727+0000 7f4f03a08640 1 --2- 172.21.15.19:0/1180199934 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4efc1027c0 0x7f4efc106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.727+0000 7f4f03a08640 1 --2- 172.21.15.19:0/1180199934 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4efc101e10 0x7f4efc1021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.727+0000 7f4f03a08640 1 -- 172.21.15.19:0/1180199934 >> 172.21.15.19:0/1180199934 conn(0x7f4efc0fd8d0 msgr2=0x7f4efc0ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:35.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.728+0000 7f4f03a08640 1 -- 172.21.15.19:0/1180199934 shutdown_connections 2024-09-19T08:57:35.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.728+0000 7f4f03a08640 1 -- 172.21.15.19:0/1180199934 wait complete. 2024-09-19T08:57:35.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.728+0000 7f4f03a08640 1 Processor -- start 2024-09-19T08:57:35.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.728+0000 7f4f03a08640 1 -- start start 2024-09-19T08:57:35.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.728+0000 7f4f03a08640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4efc101e10 0x7f4efc198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:35.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.728+0000 7f4f03a08640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4efc1027c0 0x7f4efc198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:35.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.729+0000 7f4f03a08640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4efc106f40 0x7f4efc19ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:35.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.729+0000 7f4f03a08640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4efc111fa0 con 0x7f4efc1027c0 2024-09-19T08:57:35.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.729+0000 7f4f03a08640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4efc111e20 con 0x7f4efc106f40 2024-09-19T08:57:35.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.729+0000 7f4f03a08640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4efc112120 con 0x7f4efc101e10 2024-09-19T08:57:35.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.729+0000 7f4f017a4640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4efc101e10 0x7f4efc198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:35.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.729+0000 7f4f00fa3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4efc1027c0 0x7f4efc198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:35.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.729+0000 7f4f017a4640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4efc101e10 0x7f4efc198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:46966/0 (socket says 172.21.15.19:46966) 2024-09-19T08:57:35.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.729+0000 7f4f017a4640 1 -- 172.21.15.19:0/2088348657 learned_addr learned my addr 172.21.15.19:0/2088348657 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:35.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.729+0000 7f4f01fa5640 1 --2- 172.21.15.19:0/2088348657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4efc106f40 0x7f4efc19ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:35.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.729+0000 7f4f00fa3640 1 -- 172.21.15.19:0/2088348657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4efc101e10 msgr2=0x7f4efc198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:35.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.729+0000 7f4f00fa3640 1 --2- 172.21.15.19:0/2088348657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4efc101e10 0x7f4efc198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.729+0000 7f4f00fa3640 1 -- 172.21.15.19:0/2088348657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4efc106f40 msgr2=0x7f4efc19ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:35.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.729+0000 7f4f00fa3640 1 --2- 172.21.15.19:0/2088348657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4efc106f40 0x7f4efc19ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.729+0000 7f4f00fa3640 1 -- 172.21.15.19:0/2088348657 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4efc19d3b0 con 0x7f4efc1027c0 2024-09-19T08:57:35.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.729+0000 7f4f017a4640 1 --2- 172.21.15.19:0/2088348657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4efc101e10 0x7f4efc198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:57:35.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.729+0000 7f4f00fa3640 1 --2- 172.21.15.19:0/2088348657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4efc1027c0 0x7f4efc198940 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f4eec00e9f0 tx=0x7f4eec00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:35.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.730+0000 7f4ef27fc640 1 -- 172.21.15.19:0/2088348657 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eec00ccc0 con 0x7f4efc1027c0 2024-09-19T08:57:35.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.730+0000 7f4ef27fc640 1 -- 172.21.15.19:0/2088348657 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4eec010910 con 0x7f4efc1027c0 2024-09-19T08:57:35.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.730+0000 7f4f03a08640 1 -- 172.21.15.19:0/2088348657 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4efc19d6a0 con 0x7f4efc1027c0 2024-09-19T08:57:35.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.730+0000 7f4ef27fc640 1 -- 172.21.15.19:0/2088348657 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eec018960 con 0x7f4efc1027c0 2024-09-19T08:57:35.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.730+0000 7f4f03a08640 1 -- 172.21.15.19:0/2088348657 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4efc1a4f80 con 0x7f4efc1027c0 2024-09-19T08:57:35.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.732+0000 7f4ef27fc640 1 -- 172.21.15.19:0/2088348657 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f4eec010ac0 con 0x7f4efc1027c0 2024-09-19T08:57:35.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.733+0000 7f4f05de1740 1 Processor -- start 2024-09-19T08:57:35.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.733+0000 7f4f05de1740 1 -- start start 2024-09-19T08:57:35.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.733+0000 7f4f05de1740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c6195e4a0 0x557c6195e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:35.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.733+0000 7f4f05de1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c6195edc0 0x557c61969140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:35.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.733+0000 7f4f05de1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c61969680 0x557c6196ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:35.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.733+0000 7f4f05de1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557c618c42e0 con 0x557c61969680 2024-09-19T08:57:35.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.733+0000 7f4f05de1740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x557c6186bce0 con 0x557c6195e4a0 2024-09-19T08:57:35.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.733+0000 7f4f05de1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557c618c02a0 con 0x557c6195edc0 2024-09-19T08:57:35.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.733+0000 7f4ef27fc640 1 --2- 172.21.15.19:0/2088348657 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4ee80a32c0 0x7f4ee80a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:35.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.734+0000 7f4f017a4640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c6195edc0 0x557c61969140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:35.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.734+0000 7f4f017a4640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c6195edc0 0x557c61969140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:46968/0 (socket says 172.21.15.19:46968) 2024-09-19T08:57:35.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.734+0000 7f4f017a4640 1 -- 172.21.15.19:0/3351401359 learned_addr learned my addr 172.21.15.19:0/3351401359 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:35.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.734+0000 7f4f00fa3640 1 --2- 172.21.15.19:0/3351401359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c61969680 0x557c6196ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:35.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.734+0000 7f4f01fa5640 1 --2- 172.21.15.19:0/2088348657 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4ee80a32c0 0x7f4ee80a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:35.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.734+0000 7f4ef27fc640 1 -- 172.21.15.19:0/2088348657 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4eec0cfbb0 con 0x7f4efc1027c0 2024-09-19T08:57:35.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.734+0000 7f4f01fa5640 1 --2- 172.21.15.19:0/3351401359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c6195e4a0 0x557c6195e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:35.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.734+0000 7f4f01fa5640 1 -- 172.21.15.19:0/3351401359 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c6195edc0 msgr2=0x557c61969140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:35.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.734+0000 7f4f01fa5640 1 --2- 172.21.15.19:0/3351401359 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c6195edc0 0x557c61969140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.734+0000 7f4f01fa5640 1 -- 172.21.15.19:0/3351401359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c61969680 msgr2=0x557c6196ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:35.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.734+0000 7f4f01fa5640 1 --2- 172.21.15.19:0/3351401359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c61969680 0x557c6196ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.734+0000 7f4f01fa5640 1 -- 172.21.15.19:0/3351401359 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c61850440 con 0x557c6195e4a0 2024-09-19T08:57:35.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.735+0000 7f4f017a4640 1 --2- 172.21.15.19:0/3351401359 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c6195edc0 0x557c61969140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:57:35.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.735+0000 7f4f01fa5640 1 --2- 172.21.15.19:0/3351401359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c6195e4a0 0x557c6195e880 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4006010 tx=0x7f4ef40039f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a02b120dd6b2d1e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:35.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.735+0000 7f4f01fa5640 1 --2- 172.21.15.19:0/2088348657 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4ee80a32c0 0x7f4ee80a5780 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4009bf0 tx=0x7f4ef403c000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:35.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.735+0000 7f4ee77fe640 1 -- 172.21.15.19:0/3351401359 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef404e070 con 0x557c6195e4a0 2024-09-19T08:57:35.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.735+0000 7f4ee77fe640 1 -- 172.21.15.19:0/3351401359 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ef4036040 con 0x557c6195e4a0 2024-09-19T08:57:35.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.735+0000 7f4ee77fe640 1 -- 172.21.15.19:0/3351401359 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef4003ea0 con 0x557c6195e4a0 2024-09-19T08:57:35.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.736+0000 7f4f05de1740 1 -- 172.21.15.19:0/3351401359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c6195e4a0 msgr2=0x557c6195e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:35.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.736+0000 7f4f05de1740 1 --2- 172.21.15.19:0/3351401359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c6195e4a0 0x557c6195e880 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4006010 tx=0x7f4ef40039f0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.736+0000 7f4f05de1740 1 -- 172.21.15.19:0/3351401359 shutdown_connections 2024-09-19T08:57:35.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.736+0000 7f4f05de1740 1 --2- 172.21.15.19:0/3351401359 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c6195edc0 0x557c61969140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.736+0000 7f4f05de1740 1 --2- 172.21.15.19:0/3351401359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c61969680 0x557c6196ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.736+0000 7f4f05de1740 1 --2- 172.21.15.19:0/3351401359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c6195e4a0 0x557c6195e880 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.736+0000 7f4f05de1740 1 -- 172.21.15.19:0/3351401359 >> 172.21.15.19:0/3351401359 conn(0x557c6195aa30 msgr2=0x557c6195ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:35.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.736+0000 7f4f05de1740 1 -- 172.21.15.19:0/3351401359 shutdown_connections 2024-09-19T08:57:35.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.736+0000 7f4f05de1740 1 -- 172.21.15.19:0/3351401359 wait complete. 2024-09-19T08:57:35.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.737+0000 7f4f05de1740 1 -- start start 2024-09-19T08:57:35.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.737+0000 7f4f05de1740 1 Processor -- start 2024-09-19T08:57:35.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.737+0000 7f4f05de1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c6195e4a0 0x557c61968ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:35.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.737+0000 7f4f05de1740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c6195edc0 0x557c619662a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:35.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.737+0000 7f4f05de1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c61969680 0x557c61966800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:35.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.737+0000 7f4f05de1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557c6196c0d0 con 0x557c6195e4a0 2024-09-19T08:57:35.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.737+0000 7f4f05de1740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x557c6187f050 con 0x557c6195edc0 2024-09-19T08:57:35.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.737+0000 7f4f05de1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557c6196c250 con 0x557c61969680 2024-09-19T08:57:35.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.737+0000 7f4f05de1740 10 client.0 _ll_register_callbacks cb 0x557c618bf160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:35.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.738+0000 7f4f00fa3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c6195edc0 0x557c619662a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:35.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.738+0000 7f4f01fa5640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c61969680 0x557c61966800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:35.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.738+0000 7f4f017a4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c6195e4a0 0x557c61968ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:35.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.738+0000 7f4f00fa3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c6195edc0 0x557c619662a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:44140/0 (socket says 172.21.15.19:44140) 2024-09-19T08:57:35.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.738+0000 7f4f00fa3640 1 -- 172.21.15.19:0/725822401 learned_addr learned my addr 172.21.15.19:0/725822401 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:35.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.738+0000 7f4f00fa3640 1 -- 172.21.15.19:0/725822401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c61969680 msgr2=0x557c61966800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:35.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.738+0000 7f4f00fa3640 1 --2- 172.21.15.19:0/725822401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c61969680 0x557c61966800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.738+0000 7f4f00fa3640 1 -- 172.21.15.19:0/725822401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c6195e4a0 msgr2=0x557c61968ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:35.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.738+0000 7f4f00fa3640 1 --2- 172.21.15.19:0/725822401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c6195e4a0 0x557c61968ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.738+0000 7f4f00fa3640 1 -- 172.21.15.19:0/725822401 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c616353c0 con 0x557c6195edc0 2024-09-19T08:57:35.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.738+0000 7f4f017a4640 1 --2- 172.21.15.19:0/725822401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c6195e4a0 0x557c61968ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:57:35.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.738+0000 7f4f01fa5640 1 --2- 172.21.15.19:0/725822401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c61969680 0x557c61966800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:57:35.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.738+0000 7f4f00fa3640 1 --2- 172.21.15.19:0/725822401 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c6195edc0 0x557c619662a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4eec00c6a0 tx=0x7f4eec0985f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d75634ed5c0e42d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:35.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.738+0000 7f4ee4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T08:57:35.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.738+0000 7f4ee4ff9640 1 -- 172.21.15.19:0/725822401 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eec085380 con 0x557c6195edc0 2024-09-19T08:57:35.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.738+0000 7f4ee4ff9640 1 -- 172.21.15.19:0/725822401 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4eec0a49c0 con 0x557c6195edc0 2024-09-19T08:57:35.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.738+0000 7f4f05de1740 1 -- 172.21.15.19:0/725822401 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ef4036040 con 0x557c6195edc0 2024-09-19T08:57:35.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.739+0000 7f4ee4ff9640 1 -- 172.21.15.19:0/725822401 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f4eec09c290 con 0x557c6195edc0 2024-09-19T08:57:35.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.739+0000 7f4f05de1740 10 client.26129 fetch_fsmap learned FSMap version 33 2024-09-19T08:57:35.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.739+0000 7f4f05de1740 1 -- 172.21.15.19:0/725822401 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x557c61977aa0 con 0x557c6195edc0 2024-09-19T08:57:35.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.739+0000 7f4ee4ff9640 1 -- 172.21.15.19:0/725822401 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ef4036040 con 0x557c6195edc0 2024-09-19T08:57:35.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.739+0000 7f4ee4ff9640 1 -- 172.21.15.19:0/725822401 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f4eec0cdca0 con 0x557c6195edc0 2024-09-19T08:57:35.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.739+0000 7f4f05de1740 10 client.26129 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:57:35.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.739+0000 7f4f05de1740 10 client.26129 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:57:35.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.739+0000 7f4f05de1740 20 client.26129 populate_metadata read hostname 'smithi019' 2024-09-19T08:57:35.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.739+0000 7f4f05de1740 1 --2- 172.21.15.19:0/725822401 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557c61978f20 0x557c6197b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:35.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.739+0000 7f4f05de1740 4 client.26129 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:57:35.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.739+0000 7f4f05de1740 1 -- 172.21.15.19:0/725822401 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c618d1850 con 0x557c61978f20 2024-09-19T08:57:35.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.739+0000 7f4f017a4640 1 --2- 172.21.15.19:0/725822401 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557c61978f20 0x557c6197b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:35.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.740+0000 7f4ee4ff9640 10 client.26129 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:57:35.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.740+0000 7f4f017a4640 1 --2- 172.21.15.19:0/725822401 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557c61978f20 0x557c6197b330 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e35b3cd168a3dac server_cookie=333cea167b65e5dc in_seq=0 out_seq=0 2024-09-19T08:57:35.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.742+0000 7f4ee4ff9640 1 -- 172.21.15.19:0/725822401 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557c618d1850 con 0x557c61978f20 2024-09-19T08:57:35.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.742+0000 7f4ee4ff9640 10 client.26129 handle_command_reply: tid=0 2024-09-19T08:57:35.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.742+0000 7f4f05de1740 1 client.26129 shutdown 2024-09-19T08:57:35.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.743+0000 7f4f05de1740 1 -- 172.21.15.19:0/725822401 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c6195edc0 msgr2=0x557c619662a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:35.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.743+0000 7f4f05de1740 1 --2- 172.21.15.19:0/725822401 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c6195edc0 0x557c619662a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4eec00c6a0 tx=0x7f4eec0985f0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.743+0000 7f4f05de1740 1 -- 172.21.15.19:0/725822401 shutdown_connections 2024-09-19T08:57:35.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.743+0000 7f4f05de1740 1 --2- 172.21.15.19:0/725822401 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557c61978f20 0x557c6197b330 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.743+0000 7f4f05de1740 1 --2- 172.21.15.19:0/725822401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c61969680 0x557c61966800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.743+0000 7f4f05de1740 1 --2- 172.21.15.19:0/725822401 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c6195edc0 0x557c619662a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.743+0000 7f4f05de1740 1 --2- 172.21.15.19:0/725822401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c6195e4a0 0x557c61968ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.743+0000 7f4f05de1740 1 -- 172.21.15.19:0/725822401 >> 172.21.15.19:0/725822401 conn(0x557c6195aa30 msgr2=0x557c61960760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:35.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.743+0000 7f4ee4ff9640 0 client.26129 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:57:35.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.743+0000 7f4f05de1740 1 -- 172.21.15.19:0/725822401 shutdown_connections 2024-09-19T08:57:35.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.743+0000 7f4f05de1740 1 -- 172.21.15.19:0/725822401 wait complete. 2024-09-19T08:57:35.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.743+0000 7f4f05de1740 20 client.26129 trim_cache size 0 max 16384 2024-09-19T08:57:35.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.767+0000 7f4f05de1740 1 Processor -- start 2024-09-19T08:57:35.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.767+0000 7f4f05de1740 1 -- start start 2024-09-19T08:57:35.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.767+0000 7f4f05de1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c6195e4a0 0x557c61975330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:35.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.767+0000 7f4f05de1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c61969680 0x557c6195ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:35.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.767+0000 7f4f05de1740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c6195a380 0x557c61980bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:35.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.767+0000 7f4f05de1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4efc1ad440 con 0x557c6195e4a0 2024-09-19T08:57:35.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.767+0000 7f4f05de1740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4efc1aefb0 con 0x557c6195a380 2024-09-19T08:57:35.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.767+0000 7f4f05de1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4efc1adb10 con 0x557c61969680 2024-09-19T08:57:35.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.767+0000 7f4f017a4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c6195e4a0 0x557c61975330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:35.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.767+0000 7f4f017a4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c6195e4a0 0x557c61975330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34360/0 (socket says 172.21.15.19:34360) 2024-09-19T08:57:35.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.767+0000 7f4f017a4640 1 -- 172.21.15.19:0/2880008401 learned_addr learned my addr 172.21.15.19:0/2880008401 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:35.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.767+0000 7f4f01fa5640 1 --2- 172.21.15.19:0/2880008401 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c6195a380 0x557c61980bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:35.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.767+0000 7f4f00fa3640 1 --2- 172.21.15.19:0/2880008401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c61969680 0x557c6195ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:35.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.768+0000 7f4f017a4640 1 -- 172.21.15.19:0/2880008401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c61969680 msgr2=0x557c6195ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:35.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.768+0000 7f4f017a4640 1 --2- 172.21.15.19:0/2880008401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c61969680 0x557c6195ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.768+0000 7f4f017a4640 1 -- 172.21.15.19:0/2880008401 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c6195a380 msgr2=0x557c61980bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:35.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.768+0000 7f4f017a4640 1 --2- 172.21.15.19:0/2880008401 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c6195a380 0x557c61980bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.768+0000 7f4f017a4640 1 -- 172.21.15.19:0/2880008401 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c61966b70 con 0x557c6195e4a0 2024-09-19T08:57:35.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.768+0000 7f4f017a4640 1 --2- 172.21.15.19:0/2880008401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c6195e4a0 0x557c61975330 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8009dd0 tx=0x7f4ef8005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1d549fb0c859728 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:35.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.768+0000 7f4ee6ffd640 1 -- 172.21.15.19:0/2880008401 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef800f960 con 0x557c6195e4a0 2024-09-19T08:57:35.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.768+0000 7f4ee6ffd640 1 -- 172.21.15.19:0/2880008401 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ef8005020 con 0x557c6195e4a0 2024-09-19T08:57:35.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.768+0000 7f4ee6ffd640 1 -- 172.21.15.19:0/2880008401 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef8004ca0 con 0x557c6195e4a0 2024-09-19T08:57:35.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.769+0000 7f4f05de1740 1 -- 172.21.15.19:0/2880008401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c6195e4a0 msgr2=0x557c61975330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:35.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.769+0000 7f4f05de1740 1 --2- 172.21.15.19:0/2880008401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c6195e4a0 0x557c61975330 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f4ef8009dd0 tx=0x7f4ef8005f90 comp rx=0 tx=0).stop 2024-09-19T08:57:35.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.769+0000 7f4f05de1740 1 -- 172.21.15.19:0/2880008401 shutdown_connections 2024-09-19T08:57:35.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.769+0000 7f4f05de1740 1 --2- 172.21.15.19:0/2880008401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c61969680 0x557c6195ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.769+0000 7f4f05de1740 1 --2- 172.21.15.19:0/2880008401 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c6195a380 0x557c61980bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.769+0000 7f4f05de1740 1 --2- 172.21.15.19:0/2880008401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c6195e4a0 0x557c61975330 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.769+0000 7f4f05de1740 1 -- 172.21.15.19:0/2880008401 >> 172.21.15.19:0/2880008401 conn(0x557c6195aa30 msgr2=0x557c61961900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:35.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.769+0000 7f4f05de1740 1 -- 172.21.15.19:0/2880008401 shutdown_connections 2024-09-19T08:57:35.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.769+0000 7f4f05de1740 1 -- 172.21.15.19:0/2880008401 wait complete. 2024-09-19T08:57:35.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.770+0000 7f4f05de1740 1 -- start start 2024-09-19T08:57:35.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.770+0000 7f4f05de1740 1 Processor -- start 2024-09-19T08:57:35.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.770+0000 7f4f05de1740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c6195a380 0x557c61971b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:35.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.770+0000 7f4f05de1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c6195e4a0 0x557c6196ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:35.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.770+0000 7f4f05de1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c61969680 0x557c6196d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:35.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.770+0000 7f4f05de1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4efc1ae8e0 con 0x557c61969680 2024-09-19T08:57:35.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.770+0000 7f4f05de1740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4efc1ae210 con 0x557c6195a380 2024-09-19T08:57:35.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.770+0000 7f4f05de1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4efc1ab420 con 0x557c6195e4a0 2024-09-19T08:57:35.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.770+0000 7f4f05de1740 10 client.0 _ll_register_callbacks cb 0x7f4eec097e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:35.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.770+0000 7f4f01fa5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c61969680 0x557c6196d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:35.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.770+0000 7f4f017a4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c6195a380 0x557c61971b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:35.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.770+0000 7f4f00fa3640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c6195e4a0 0x557c6196ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:35.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.770+0000 7f4f017a4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c6195a380 0x557c61971b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:44162/0 (socket says 172.21.15.19:44162) 2024-09-19T08:57:35.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.770+0000 7f4f017a4640 1 -- 172.21.15.19:0/1989229444 learned_addr learned my addr 172.21.15.19:0/1989229444 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:35.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.771+0000 7f4f00fa3640 1 -- 172.21.15.19:0/1989229444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c6195a380 msgr2=0x557c61971b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:35.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.771+0000 7f4f00fa3640 1 --2- 172.21.15.19:0/1989229444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c6195a380 0x557c61971b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.771+0000 7f4f00fa3640 1 -- 172.21.15.19:0/1989229444 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c61969680 msgr2=0x557c6196d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:35.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.771+0000 7f4f00fa3640 1 --2- 172.21.15.19:0/1989229444 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c61969680 0x557c6196d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.771+0000 7f4f00fa3640 1 -- 172.21.15.19:0/1989229444 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c6196dbc0 con 0x557c6195e4a0 2024-09-19T08:57:35.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.771+0000 7f4f00fa3640 1 --2- 172.21.15.19:0/1989229444 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c6195e4a0 0x557c6196ce80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x557c61967390 tx=0x7f4eec098b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a11c40f10768cb1d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:35.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.771+0000 7f4ee4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T08:57:35.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.771+0000 7f4ee4ff9640 1 -- 172.21.15.19:0/1989229444 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eec09bdd0 con 0x557c6195e4a0 2024-09-19T08:57:35.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.771+0000 7f4f05de1740 1 -- 172.21.15.19:0/1989229444 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ef8005020 con 0x557c6195e4a0 2024-09-19T08:57:35.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.771+0000 7f4ee4ff9640 1 -- 172.21.15.19:0/1989229444 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4eec0a49c0 con 0x557c6195e4a0 2024-09-19T08:57:35.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.772+0000 7f4ee4ff9640 1 -- 172.21.15.19:0/1989229444 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f4eec085380 con 0x557c6195e4a0 2024-09-19T08:57:35.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.772+0000 7f4f05de1740 10 client.26086 fetch_fsmap learned FSMap version 33 2024-09-19T08:57:35.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.772+0000 7f4f05de1740 1 -- 172.21.15.19:0/1989229444 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x557c619e3b00 con 0x557c6195e4a0 2024-09-19T08:57:35.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.772+0000 7f4ee4ff9640 1 -- 172.21.15.19:0/1989229444 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4ef8005020 con 0x557c6195e4a0 2024-09-19T08:57:35.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.772+0000 7f4ee4ff9640 1 -- 172.21.15.19:0/1989229444 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f4eec0cdb80 con 0x557c6195e4a0 2024-09-19T08:57:35.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.772+0000 7f4f05de1740 10 client.26086 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:57:35.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.772+0000 7f4f05de1740 10 client.26086 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:57:35.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.772+0000 7f4f05de1740 20 client.26086 populate_metadata read hostname 'smithi019' 2024-09-19T08:57:35.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.772+0000 7f4f05de1740 1 --2- 172.21.15.19:0/1989229444 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557c619e4220 0x557c619e6610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:35.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.772+0000 7f4f05de1740 4 client.26086 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:57:35.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.772+0000 7f4f05de1740 1 -- 172.21.15.19:0/1989229444 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub status"}) -- 0x557c618cbd60 con 0x557c619e4220 2024-09-19T08:57:35.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.772+0000 7f4f017a4640 1 --2- 172.21.15.19:0/1989229444 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557c619e4220 0x557c619e6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:35.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.773+0000 7f4ee4ff9640 10 client.26086 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:57:35.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.773+0000 7f4f017a4640 1 --2- 172.21.15.19:0/1989229444 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557c619e4220 0x557c619e6610 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=168f235bc478a563 server_cookie=f8116f8aa1222fc6 in_seq=0 out_seq=0 2024-09-19T08:57:35.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.775+0000 7f4ee4ff9640 1 -- 172.21.15.19:0/1989229444 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+268 (crc 0 0 0) 0x557c618cbd60 con 0x557c619e4220 2024-09-19T08:57:35.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.775+0000 7f4ee4ff9640 10 client.26086 handle_command_reply: tid=0 2024-09-19T08:57:35.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.775+0000 7f4f05de1740 1 client.26086 shutdown 2024-09-19T08:57:35.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.775+0000 7f4f05de1740 1 -- 172.21.15.19:0/1989229444 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c6195e4a0 msgr2=0x557c6196ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:35.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.775+0000 7f4f05de1740 1 --2- 172.21.15.19:0/1989229444 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c6195e4a0 0x557c6196ce80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x557c61967390 tx=0x7f4eec098b20 comp rx=0 tx=0).stop 2024-09-19T08:57:35.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.776+0000 7f4f05de1740 1 -- 172.21.15.19:0/1989229444 shutdown_connections 2024-09-19T08:57:35.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.776+0000 7f4f05de1740 1 --2- 172.21.15.19:0/1989229444 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557c619e4220 0x557c619e6610 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.776+0000 7f4f05de1740 1 --2- 172.21.15.19:0/1989229444 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c6195e4a0 0x557c6196ce80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.776+0000 7f4f05de1740 1 --2- 172.21.15.19:0/1989229444 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c61969680 0x557c6196d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.776+0000 7f4ee4ff9640 0 client.26086 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:57:35.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.776+0000 7f4f05de1740 1 --2- 172.21.15.19:0/1989229444 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c6195a380 0x557c61971b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.776+0000 7f4f05de1740 1 -- 172.21.15.19:0/1989229444 >> 172.21.15.19:0/1989229444 conn(0x557c6195aa30 msgr2=0x557c61959350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:35.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.776+0000 7f4f05de1740 1 -- 172.21.15.19:0/1989229444 shutdown_connections 2024-09-19T08:57:35.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.776+0000 7f4f05de1740 1 -- 172.21.15.19:0/1989229444 wait complete. 2024-09-19T08:57:35.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.776+0000 7f4f05de1740 20 client.26086 trim_cache size 0 max 16384 2024-09-19T08:57:35.782 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:57:35.782 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "scrub active (5428 inodes in the stack)", 2024-09-19T08:57:35.782 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-19T08:57:35.782 INFO:teuthology.orchestra.run.smithi019.stdout: "47374fe5-f9de-44f5-8d9e-4282ecef02b9": { 2024-09-19T08:57:35.782 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-19T08:57:35.782 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "47374fe5-f9de-44f5-8d9e-4282ecef02b9", 2024-09-19T08:57:35.783 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-19T08:57:35.783 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:57:35.783 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:57:35.783 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:57:35.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.776+0000 7f4f03a08640 1 -- 172.21.15.19:0/2088348657 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4ee80a32c0 msgr2=0x7f4ee80a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:35.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.776+0000 7f4f03a08640 1 --2- 172.21.15.19:0/2088348657 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4ee80a32c0 0x7f4ee80a5780 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4009bf0 tx=0x7f4ef403c000 comp rx=0 tx=0).stop 2024-09-19T08:57:35.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.776+0000 7f4f03a08640 1 -- 172.21.15.19:0/2088348657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4efc1027c0 msgr2=0x7f4efc198940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:35.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.776+0000 7f4f03a08640 1 --2- 172.21.15.19:0/2088348657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4efc1027c0 0x7f4efc198940 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f4eec00e9f0 tx=0x7f4eec00eeb0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.777+0000 7f4f03a08640 1 -- 172.21.15.19:0/2088348657 shutdown_connections 2024-09-19T08:57:35.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.777+0000 7f4f03a08640 1 --2- 172.21.15.19:0/2088348657 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4ee80a32c0 0x7f4ee80a5780 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.777+0000 7f4f03a08640 1 --2- 172.21.15.19:0/2088348657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4efc106f40 0x7f4efc19ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.777+0000 7f4f03a08640 1 --2- 172.21.15.19:0/2088348657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4efc1027c0 0x7f4efc198940 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.777+0000 7f4f03a08640 1 --2- 172.21.15.19:0/2088348657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4efc101e10 0x7f4efc198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:35.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.777+0000 7f4f03a08640 1 -- 172.21.15.19:0/2088348657 >> 172.21.15.19:0/2088348657 conn(0x7f4efc0fd8d0 msgr2=0x7f4efc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:35.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.777+0000 7f4f03a08640 1 -- 172.21.15.19:0/2088348657 shutdown_connections 2024-09-19T08:57:35.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:35.777+0000 7f4f03a08640 1 -- 172.21.15.19:0/2088348657 wait complete. 2024-09-19T08:57:35.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:35 smithi155 ceph-mon[34921]: pgmap v498: 97 pgs: 97 active+clean; 40 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 714 op/s 2024-09-19T08:57:36.688 INFO:tasks.cephfs.filesystem:scrub status for tag:47374fe5-f9de-44f5-8d9e-4282ecef02b9 - {'path': '/', 'tag': '47374fe5-f9de-44f5-8d9e-4282ecef02b9', 'options': 'recursive,force'} 2024-09-19T08:57:37.384 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:37.384+0000 7f9536ffd640 1 -- 172.21.15.19:0/2467060115 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562597243d70 con 0x562597359450 2024-09-19T08:57:37.384 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:37.384+0000 7f9536ffd640 10 client.16602 handle_command_reply: tid=0 2024-09-19T08:57:37.384 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:37.384+0000 7f95606c4740 1 client.16602 shutdown 2024-09-19T08:57:37.384 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:37.384+0000 7f95606c4740 1 -- 172.21.15.19:0/2467060115 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5625972de370 msgr2=0x562597357280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:37.384 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:37.384+0000 7f95606c4740 1 --2- 172.21.15.19:0/2467060115 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5625972de370 0x562597357280 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f95500314e0 tx=0x7f9550009260 comp rx=0 tx=0).stop 2024-09-19T08:57:37.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:37.384+0000 7f95606c4740 1 -- 172.21.15.19:0/2467060115 shutdown_connections 2024-09-19T08:57:37.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:37.384+0000 7f95606c4740 1 --2- 172.21.15.19:0/2467060115 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x562597359450 0x56259735b870 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:37.384+0000 7f95606c4740 1 --2- 172.21.15.19:0/2467060115 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5625972de370 0x562597357280 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:37.384+0000 7f95606c4740 1 --2- 172.21.15.19:0/2467060115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5625972d92e0 0x5625972e74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:37.384+0000 7f95606c4740 1 --2- 172.21.15.19:0/2467060115 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5625972d89a0 0x5625972e6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:37.384+0000 7f9536ffd640 0 client.16602 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:57:37.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:37.384+0000 7f95606c4740 1 -- 172.21.15.19:0/2467060115 >> 172.21.15.19:0/2467060115 conn(0x5625972d4010 msgr2=0x5625972d29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:37.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:37.384+0000 7f95606c4740 1 -- 172.21.15.19:0/2467060115 shutdown_connections 2024-09-19T08:57:37.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:37.384+0000 7f95606c4740 1 -- 172.21.15.19:0/2467060115 wait complete. 2024-09-19T08:57:37.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:37.384+0000 7f95606c4740 20 client.16602 trim_cache size 0 max 16384 2024-09-19T08:57:37.386 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T08:57:37.386 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T08:57:37.386 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T08:57:37.386 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T08:57:37.387 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:37.385+0000 7f955d92a640 1 -- 172.21.15.19:0/797935188 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f95440a32f0 msgr2=0x7f95440a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:37.387 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:37.385+0000 7f955d92a640 1 --2- 172.21.15.19:0/797935188 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f95440a32f0 0x7f95440a57b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9550005ab0 tx=0x7f9550005a20 comp rx=0 tx=0).stop 2024-09-19T08:57:37.387 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:37.385+0000 7f955d92a640 1 -- 172.21.15.19:0/797935188 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9558102690 msgr2=0x7f9558197dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:37.387 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:37.385+0000 7f955d92a640 1 --2- 172.21.15.19:0/797935188 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9558102690 0x7f9558197dc0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f954800ea80 tx=0x7f954800ef40 comp rx=0 tx=0).stop 2024-09-19T08:57:37.387 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:37.386+0000 7f955d92a640 1 -- 172.21.15.19:0/797935188 shutdown_connections 2024-09-19T08:57:37.387 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:37.386+0000 7f955d92a640 1 --2- 172.21.15.19:0/797935188 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f95440a32f0 0x7f95440a57b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.387 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:37.386+0000 7f955d92a640 1 --2- 172.21.15.19:0/797935188 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95581078f0 0x7f955819f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.387 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:37.386+0000 7f955d92a640 1 --2- 172.21.15.19:0/797935188 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9558104fc0 0x7f9558198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.387 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:37.386+0000 7f955d92a640 1 --2- 172.21.15.19:0/797935188 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9558102690 0x7f9558197dc0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:37.387 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:37.386+0000 7f955d92a640 1 -- 172.21.15.19:0/797935188 >> 172.21.15.19:0/797935188 conn(0x7f95580fc1b0 msgr2=0x7f9558103070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:37.387 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:37.386+0000 7f955d92a640 1 -- 172.21.15.19:0/797935188 shutdown_connections 2024-09-19T08:57:37.388 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:37.386+0000 7f955d92a640 1 -- 172.21.15.19:0/797935188 wait complete. 2024-09-19T08:57:37.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:37 smithi203 ceph-mon[35450]: pgmap v499: 97 pgs: 97 active+clean; 32 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 805 op/s 2024-09-19T08:57:37.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:37 smithi019 ceph-mon[30976]: pgmap v499: 97 pgs: 97 active+clean; 32 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 805 op/s 2024-09-19T08:57:37.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:37 smithi155 ceph-mon[34921]: pgmap v499: 97 pgs: 97 active+clean; 32 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 805 op/s 2024-09-19T08:57:39.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:39 smithi203 ceph-mon[35450]: pgmap v500: 97 pgs: 97 active+clean; 28 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 1.04k op/s 2024-09-19T08:57:39.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:39 smithi019 ceph-mon[30976]: pgmap v500: 97 pgs: 97 active+clean; 28 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 1.04k op/s 2024-09-19T08:57:39.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:39 smithi155 ceph-mon[34921]: pgmap v500: 97 pgs: 97 active+clean; 28 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 2.9 MiB/s wr, 1.04k op/s 2024-09-19T08:57:41.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:41 smithi203 ceph-mon[35450]: pgmap v501: 97 pgs: 97 active+clean; 21 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1014 KiB/s rd, 2.2 MiB/s wr, 791 op/s 2024-09-19T08:57:41.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:41 smithi019 ceph-mon[30976]: pgmap v501: 97 pgs: 97 active+clean; 21 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1014 KiB/s rd, 2.2 MiB/s wr, 791 op/s 2024-09-19T08:57:41.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:41 smithi155 ceph-mon[34921]: pgmap v501: 97 pgs: 97 active+clean; 21 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1014 KiB/s rd, 2.2 MiB/s wr, 791 op/s 2024-09-19T08:57:43.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:43 smithi203 ceph-mon[35450]: pgmap v502: 97 pgs: 97 active+clean; 26 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.4 MiB/s wr, 877 op/s 2024-09-19T08:57:43.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:43 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:43.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:43 smithi019 ceph-mon[30976]: pgmap v502: 97 pgs: 97 active+clean; 26 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.4 MiB/s wr, 877 op/s 2024-09-19T08:57:43.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:43 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:43.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:43 smithi155 ceph-mon[34921]: pgmap v502: 97 pgs: 97 active+clean; 26 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.4 MiB/s wr, 877 op/s 2024-09-19T08:57:43.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:43 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:57:44.015 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:57:44.015 INFO:teuthology.orchestra.run.smithi019.stdout: "epoch": 33, 2024-09-19T08:57:44.015 INFO:teuthology.orchestra.run.smithi019.stdout: "leader": 24497, 2024-09-19T08:57:44.015 INFO:teuthology.orchestra.run.smithi019.stdout: "set_version": 18, 2024-09-19T08:57:44.015 INFO:teuthology.orchestra.run.smithi019.stdout: "sets": { 2024-09-19T08:57:44.015 INFO:teuthology.orchestra.run.smithi019.stdout: "a8cb4dbc": { 2024-09-19T08:57:44.015 INFO:teuthology.orchestra.run.smithi019.stdout: "version": 18, 2024-09-19T08:57:44.016 INFO:teuthology.orchestra.run.smithi019.stdout: "age_ref": 0.0, 2024-09-19T08:57:44.016 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T08:57:44.016 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "QUIESCED", 2024-09-19T08:57:44.016 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T08:57:44.016 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T08:57:44.016 INFO:teuthology.orchestra.run.smithi019.stdout: "timeout": 90.0, 2024-09-19T08:57:44.016 INFO:teuthology.orchestra.run.smithi019.stdout: "expiration": 149.8, 2024-09-19T08:57:44.017 INFO:teuthology.orchestra.run.smithi019.stdout: "members": { 2024-09-19T08:57:44.017 INFO:teuthology.orchestra.run.smithi019.stdout: "file:/": { 2024-09-19T08:57:44.017 INFO:teuthology.orchestra.run.smithi019.stdout: "excluded": false, 2024-09-19T08:57:44.017 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T08:57:44.017 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "QUIESCED", 2024-09-19T08:57:44.017 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T08:57:44.017 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:57:44.017 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:57:44.017 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:57:44.017 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:57:44.017 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:57:44.017 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:57:44.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:44.014+0000 7fd75b7fe640 1 -- 172.21.15.19:0/1398433881 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56231d209d20 con 0x56231d322f10 2024-09-19T08:57:44.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:44.014+0000 7fd75b7fe640 10 client.26063 handle_command_reply: tid=0 2024-09-19T08:57:44.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:44.014+0000 7fd784aa8740 1 client.26063 shutdown 2024-09-19T08:57:44.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:44.014+0000 7fd784aa8740 1 -- 172.21.15.19:0/1398433881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56231d29d080 msgr2=0x56231d2bb420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:44.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:44.014+0000 7fd784aa8740 1 --2- 172.21.15.19:0/1398433881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56231d29d080 0x56231d2bb420 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd770056040 tx=0x7fd770009260 comp rx=0 tx=0).stop 2024-09-19T08:57:44.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:44.014+0000 7fd784aa8740 1 -- 172.21.15.19:0/1398433881 shutdown_connections 2024-09-19T08:57:44.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:44.014+0000 7fd784aa8740 1 --2- 172.21.15.19:0/1398433881 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56231d322f10 0x56231d325330 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:44.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:44.014+0000 7fd784aa8740 1 --2- 172.21.15.19:0/1398433881 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56231d2a7940 0x56231d321050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:44.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:44.014+0000 7fd784aa8740 1 --2- 172.21.15.19:0/1398433881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56231d29d080 0x56231d2bb420 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:44.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:44.014+0000 7fd784aa8740 1 --2- 172.21.15.19:0/1398433881 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56231d29c760 0x56231d2baee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:44.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:44.014+0000 7fd784aa8740 1 -- 172.21.15.19:0/1398433881 >> 172.21.15.19:0/1398433881 conn(0x56231d298cf0 msgr2=0x56231d2b3100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:44.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:44.014+0000 7fd75b7fe640 0 client.26063 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:57:44.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:44.015+0000 7fd784aa8740 1 -- 172.21.15.19:0/1398433881 shutdown_connections 2024-09-19T08:57:44.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:44.015+0000 7fd784aa8740 1 -- 172.21.15.19:0/1398433881 wait complete. 2024-09-19T08:57:44.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:44.015+0000 7fd784aa8740 20 client.26063 trim_cache size 0 max 16384 2024-09-19T08:57:44.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:44.015+0000 7fd7826cf640 1 -- 172.21.15.19:0/576201629 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd7640a3240 msgr2=0x7fd7640a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:44.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:44.015+0000 7fd7826cf640 1 --2- 172.21.15.19:0/576201629 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd7640a3240 0x7fd7640a5700 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fd770009230 tx=0x7fd7700058d0 comp rx=0 tx=0).stop 2024-09-19T08:57:44.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:44.015+0000 7fd7826cf640 1 -- 172.21.15.19:0/576201629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd77c101470 msgr2=0x7fd77c1983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:44.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:44.015+0000 7fd7826cf640 1 --2- 172.21.15.19:0/576201629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd77c101470 0x7fd77c1983d0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fd76c00c920 tx=0x7fd76c00cde0 comp rx=0 tx=0).stop 2024-09-19T08:57:44.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:44.016+0000 7fd7826cf640 1 -- 172.21.15.19:0/576201629 shutdown_connections 2024-09-19T08:57:44.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:44.016+0000 7fd7826cf640 1 --2- 172.21.15.19:0/576201629 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd7640a3240 0x7fd7640a5700 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:44.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:44.016+0000 7fd7826cf640 1 --2- 172.21.15.19:0/576201629 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd77c105de0 0x7fd77c19cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:44.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:44.016+0000 7fd7826cf640 1 --2- 172.21.15.19:0/576201629 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd77c101e20 0x7fd77c198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:44.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:44.016+0000 7fd7826cf640 1 --2- 172.21.15.19:0/576201629 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd77c101470 0x7fd77c1983d0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:44.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:44.016+0000 7fd7826cf640 1 -- 172.21.15.19:0/576201629 >> 172.21.15.19:0/576201629 conn(0x7fd77c077230 msgr2=0x7fd77c100300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:44.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:44.016+0000 7fd7826cf640 1 -- 172.21.15.19:0/576201629 shutdown_connections 2024-09-19T08:57:44.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:44.016+0000 7fd7826cf640 1 -- 172.21.15.19:0/576201629 wait complete. 2024-09-19T08:57:44.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:44 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:44.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:44 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:44.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:44 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:57:44.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:44 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:44.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:44 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:44.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:44 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:57:44.903 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'a8cb4dbc', quiesce took 47.3 seconds. Will release after: -17.499999999999996 2024-09-19T08:57:44.904 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:57:44.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:44 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:57:44.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:44 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:57:44.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:44 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:57:45.180 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:57:45.557 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:45 smithi019 ceph-mon[30976]: pgmap v503: 97 pgs: 97 active+clean; 30 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.8 MiB/s wr, 998 op/s 2024-09-19T08:57:45.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.651+0000 7f94b5b62640 1 -- 172.21.15.19:0/546549096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f94b0105de0 msgr2=0x7f94b010d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:45.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.651+0000 7f94b5b62640 1 --2- 172.21.15.19:0/546549096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f94b0105de0 0x7f94b010d960 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f94a8009be0 tx=0x7f94a802a6c0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.652+0000 7f94b5b62640 1 -- 172.21.15.19:0/546549096 shutdown_connections 2024-09-19T08:57:45.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.652+0000 7f94b5b62640 1 --2- 172.21.15.19:0/546549096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f94b0105de0 0x7f94b010d960 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.652+0000 7f94b5b62640 1 --2- 172.21.15.19:0/546549096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94b0101e20 0x7f94b01056b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.652+0000 7f94b5b62640 1 --2- 172.21.15.19:0/546549096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94b0101470 0x7f94b0101850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.652+0000 7f94b5b62640 1 -- 172.21.15.19:0/546549096 >> 172.21.15.19:0/546549096 conn(0x7f94b0077230 msgr2=0x7f94b00fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:45.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.652+0000 7f94b5b62640 1 -- 172.21.15.19:0/546549096 shutdown_connections 2024-09-19T08:57:45.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.652+0000 7f94b5b62640 1 -- 172.21.15.19:0/546549096 wait complete. 2024-09-19T08:57:45.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.653+0000 7f94b5b62640 1 Processor -- start 2024-09-19T08:57:45.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.653+0000 7f94b5b62640 1 -- start start 2024-09-19T08:57:45.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.653+0000 7f94b5b62640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94b0101470 0x7f94b0073770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:45.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.653+0000 7f94b5b62640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94b0101e20 0x7f94b0073cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:45.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.653+0000 7f94b5b62640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f94b0105de0 0x7f94b0100100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:45.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.653+0000 7f94b5b62640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f94b0110e40 con 0x7f94b0101e20 2024-09-19T08:57:45.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.653+0000 7f94b5b62640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f94b0110cc0 con 0x7f94b0101470 2024-09-19T08:57:45.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.653+0000 7f94b5b62640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f94b0110fc0 con 0x7f94b0105de0 2024-09-19T08:57:45.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.653+0000 7f94a7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94b0101e20 0x7f94b0073cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:45.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.653+0000 7f94af7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94b0101470 0x7f94b0073770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:45.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.653+0000 7f94af7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94b0101470 0x7f94b0073770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:34894/0 (socket says 172.21.15.19:34894) 2024-09-19T08:57:45.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.653+0000 7f94af7fe640 1 -- 172.21.15.19:0/2052167505 learned_addr learned my addr 172.21.15.19:0/2052167505 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:45.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.653+0000 7f94a7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94b0101e20 0x7f94b0073cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37252/0 (socket says 172.21.15.19:37252) 2024-09-19T08:57:45.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.653+0000 7f94affff640 1 --2- 172.21.15.19:0/2052167505 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f94b0105de0 0x7f94b0100100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:45.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.654+0000 7f94affff640 1 -- 172.21.15.19:0/2052167505 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94b0101470 msgr2=0x7f94b0073770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:45.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.654+0000 7f94affff640 1 --2- 172.21.15.19:0/2052167505 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94b0101470 0x7f94b0073770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.654+0000 7f94affff640 1 -- 172.21.15.19:0/2052167505 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94b0101e20 msgr2=0x7f94b0073cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:45.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.654+0000 7f94affff640 1 --2- 172.21.15.19:0/2052167505 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94b0101e20 0x7f94b0073cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.654+0000 7f94affff640 1 -- 172.21.15.19:0/2052167505 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94b01008d0 con 0x7f94b0105de0 2024-09-19T08:57:45.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.654+0000 7f94affff640 1 --2- 172.21.15.19:0/2052167505 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f94b0105de0 0x7f94b0100100 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f94a8009b30 tx=0x7f94a8030890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:45.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.654+0000 7f94ad7fa640 1 -- 172.21.15.19:0/2052167505 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a8041020 con 0x7f94b0105de0 2024-09-19T08:57:45.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.654+0000 7f94ad7fa640 1 -- 172.21.15.19:0/2052167505 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f94a8031920 con 0x7f94b0105de0 2024-09-19T08:57:45.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.655+0000 7f94b5b62640 1 -- 172.21.15.19:0/2052167505 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94b0100b60 con 0x7f94b0105de0 2024-09-19T08:57:45.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.655+0000 7f94ad7fa640 1 -- 172.21.15.19:0/2052167505 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94a8036040 con 0x7f94b0105de0 2024-09-19T08:57:45.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.655+0000 7f94b5b62640 1 -- 172.21.15.19:0/2052167505 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94b01a72c0 con 0x7f94b0105de0 2024-09-19T08:57:45.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.656+0000 7f94b5b62640 1 -- 172.21.15.19:0/2052167505 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94b0102220 con 0x7f94b0105de0 2024-09-19T08:57:45.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.657+0000 7f94ad7fa640 1 -- 172.21.15.19:0/2052167505 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f94a8044020 con 0x7f94b0105de0 2024-09-19T08:57:45.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.658+0000 7f94ad7fa640 1 --2- 172.21.15.19:0/2052167505 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f949c0a32c0 0x7f949c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:45.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.659+0000 7f94ad7fa640 1 -- 172.21.15.19:0/2052167505 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f94a80f0380 con 0x7f94b0105de0 2024-09-19T08:57:45.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.659+0000 7f94af7fe640 1 --2- 172.21.15.19:0/2052167505 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f949c0a32c0 0x7f949c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:45.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.660+0000 7f94af7fe640 1 --2- 172.21.15.19:0/2052167505 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f949c0a32c0 0x7f949c0a5780 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f94a0005c80 tx=0x7f94a0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:45.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.663+0000 7f94ad7fa640 1 -- 172.21.15.19:0/2052167505 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f94a804b020 con 0x7f94b0105de0 2024-09-19T08:57:45.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:45 smithi155 ceph-mon[34921]: pgmap v503: 97 pgs: 97 active+clean; 30 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.8 MiB/s wr, 998 op/s 2024-09-19T08:57:45.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.936+0000 7f94b5b62640 1 -- 172.21.15.19:0/2052167505 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94b01a76e0 con 0x7f94b0105de0 2024-09-19T08:57:45.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.937+0000 7f94ad7fa640 1 -- 172.21.15.19:0/2052167505 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11984 (secure 0 0 0) 0x7f94a80bd0b0 con 0x7f94b0105de0 2024-09-19T08:57:45.940 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:57:45.940 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":33,"btime":"2024-09-19T08:55:57:276679+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2452068876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2452068876},{"type":"v1","addr":"172.21.15.19:6839","nonce":2452068876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T08:55:56.383946+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/2480841559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2480841559},{"type":"v1","addr":"172.21.15.155:6835","nonce":2480841559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24469,24490,24464,24463]},"id":1}]} 2024-09-19T08:57:45.941 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 33 2024-09-19T08:57:45.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.940+0000 7f94b5b62640 1 -- 172.21.15.19:0/2052167505 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f949c0a32c0 msgr2=0x7f949c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:45.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.940+0000 7f94b5b62640 1 --2- 172.21.15.19:0/2052167505 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f949c0a32c0 0x7f949c0a5780 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f94a0005c80 tx=0x7f94a0009260 comp rx=0 tx=0).stop 2024-09-19T08:57:45.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.940+0000 7f94b5b62640 1 -- 172.21.15.19:0/2052167505 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f94b0105de0 msgr2=0x7f94b0100100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:45.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.940+0000 7f94b5b62640 1 --2- 172.21.15.19:0/2052167505 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f94b0105de0 0x7f94b0100100 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f94a8009b30 tx=0x7f94a8030890 comp rx=0 tx=0).stop 2024-09-19T08:57:45.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.940+0000 7f94b5b62640 1 -- 172.21.15.19:0/2052167505 shutdown_connections 2024-09-19T08:57:45.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.940+0000 7f94b5b62640 1 --2- 172.21.15.19:0/2052167505 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f949c0a32c0 0x7f949c0a5780 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.940+0000 7f94b5b62640 1 --2- 172.21.15.19:0/2052167505 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f94b0105de0 0x7f94b0100100 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.940+0000 7f94b5b62640 1 --2- 172.21.15.19:0/2052167505 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f94b0101e20 0x7f94b0073cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.940+0000 7f94b5b62640 1 --2- 172.21.15.19:0/2052167505 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f94b0101470 0x7f94b0073770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:45.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.940+0000 7f94b5b62640 1 -- 172.21.15.19:0/2052167505 >> 172.21.15.19:0/2052167505 conn(0x7f94b0077230 msgr2=0x7f94b01054d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:45.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.940+0000 7f94b5b62640 1 -- 172.21.15.19:0/2052167505 shutdown_connections 2024-09-19T08:57:45.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:45.940+0000 7f94b5b62640 1 -- 172.21.15.19:0/2052167505 wait complete. 2024-09-19T08:57:45.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:45 smithi203 ceph-mon[35450]: pgmap v503: 97 pgs: 97 active+clean; 30 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.8 MiB/s wr, 998 op/s 2024-09-19T08:57:46.701 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:46 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/2052167505' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:57:46.733 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db --set-id a8cb4dbc --release --await' 2024-09-19T08:57:46.734 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db --set-id a8cb4dbc --release --await 2024-09-19T08:57:46.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:46 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/2052167505' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:57:46.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:46 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/2052167505' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:57:47.037 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:57:47.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:47 smithi019 ceph-mon[30976]: pgmap v504: 97 pgs: 97 active+clean; 30 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 1.12k op/s 2024-09-19T08:57:47.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:47 smithi155 ceph-mon[34921]: pgmap v504: 97 pgs: 97 active+clean; 30 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 1.12k op/s 2024-09-19T08:57:47.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:47 smithi203 ceph-mon[35450]: pgmap v504: 97 pgs: 97 active+clean; 30 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 1.12k op/s 2024-09-19T08:57:48.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.363+0000 7f8548506640 1 -- 172.21.15.19:0/2800236487 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8540102d40 msgr2=0x7f8540103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:48.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.363+0000 7f8548506640 1 --2- 172.21.15.19:0/2800236487 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8540102d40 0x7f8540103120 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f853c009900 tx=0x7f853c02a480 comp rx=0 tx=0).stop 2024-09-19T08:57:48.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.363+0000 7f8548506640 1 -- 172.21.15.19:0/2800236487 shutdown_connections 2024-09-19T08:57:48.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.363+0000 7f8548506640 1 --2- 172.21.15.19:0/2800236487 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8540103660 0x7f854010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.363+0000 7f8548506640 1 --2- 172.21.15.19:0/2800236487 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f854010c170 0x7f854010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.363+0000 7f8548506640 1 --2- 172.21.15.19:0/2800236487 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8540102d40 0x7f8540103120 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.363+0000 7f8548506640 1 -- 172.21.15.19:0/2800236487 >> 172.21.15.19:0/2800236487 conn(0x7f85400fc7a0 msgr2=0x7f85400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:48.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.363+0000 7f8548506640 1 -- 172.21.15.19:0/2800236487 shutdown_connections 2024-09-19T08:57:48.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.363+0000 7f8548506640 1 -- 172.21.15.19:0/2800236487 wait complete. 2024-09-19T08:57:48.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.363+0000 7f8548506640 1 Processor -- start 2024-09-19T08:57:48.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.363+0000 7f8548506640 1 -- start start 2024-09-19T08:57:48.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.364+0000 7f8548506640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8540102d40 0x7f85401009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:48.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.364+0000 7f8548506640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8540103660 0x7f8540100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:48.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.364+0000 7f8548506640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f854010c170 0x7f8540101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:48.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.364+0000 7f8548506640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8540111f70 con 0x7f8540102d40 2024-09-19T08:57:48.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.364+0000 7f8548506640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8540111df0 con 0x7f854010c170 2024-09-19T08:57:48.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.364+0000 7f8548506640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f85401120f0 con 0x7f8540103660 2024-09-19T08:57:48.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.364+0000 7f85462a2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8540102d40 0x7f85401009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:48.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.364+0000 7f85462a2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8540102d40 0x7f85401009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37264/0 (socket says 172.21.15.19:37264) 2024-09-19T08:57:48.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.364+0000 7f85462a2640 1 -- 172.21.15.19:0/3683164252 learned_addr learned my addr 172.21.15.19:0/3683164252 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:48.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.364+0000 7f8545aa1640 1 --2- 172.21.15.19:0/3683164252 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8540103660 0x7f8540100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:48.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.364+0000 7f8546aa3640 1 --2- 172.21.15.19:0/3683164252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f854010c170 0x7f8540101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:48.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.364+0000 7f85462a2640 1 -- 172.21.15.19:0/3683164252 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8540103660 msgr2=0x7f8540100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:48.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.364+0000 7f85462a2640 1 --2- 172.21.15.19:0/3683164252 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8540103660 0x7f8540100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.364+0000 7f85462a2640 1 -- 172.21.15.19:0/3683164252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f854010c170 msgr2=0x7f8540101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:48.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.364+0000 7f85462a2640 1 --2- 172.21.15.19:0/3683164252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f854010c170 0x7f8540101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.364+0000 7f85462a2640 1 -- 172.21.15.19:0/3683164252 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85401a6910 con 0x7f8540102d40 2024-09-19T08:57:48.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.364+0000 7f8545aa1640 1 --2- 172.21.15.19:0/3683164252 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8540103660 0x7f8540100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:57:48.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.364+0000 7f85462a2640 1 --2- 172.21.15.19:0/3683164252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8540102d40 0x7f85401009a0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f853c006010 tx=0x7f853c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:48.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.365+0000 7f85377fe640 1 -- 172.21.15.19:0/3683164252 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c03f030 con 0x7f8540102d40 2024-09-19T08:57:48.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.365+0000 7f85377fe640 1 -- 172.21.15.19:0/3683164252 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f853c003ce0 con 0x7f8540102d40 2024-09-19T08:57:48.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.365+0000 7f8548506640 1 -- 172.21.15.19:0/3683164252 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85401a6ba0 con 0x7f8540102d40 2024-09-19T08:57:48.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.365+0000 7f85377fe640 1 -- 172.21.15.19:0/3683164252 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c035070 con 0x7f8540102d40 2024-09-19T08:57:48.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.365+0000 7f8548506640 1 -- 172.21.15.19:0/3683164252 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85401a7080 con 0x7f8540102d40 2024-09-19T08:57:48.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.367+0000 7f85377fe640 1 -- 172.21.15.19:0/3683164252 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f853c042030 con 0x7f8540102d40 2024-09-19T08:57:48.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.367+0000 7f854a8df740 1 Processor -- start 2024-09-19T08:57:48.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.368+0000 7f854a8df740 1 -- start start 2024-09-19T08:57:48.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.368+0000 7f854a8df740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563b00bd8060 0x563b00bd8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:48.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.368+0000 7f854a8df740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b00bd8980 0x563b00be2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:48.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.368+0000 7f854a8df740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b00be3240 0x563b00be5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:48.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.368+0000 7f854a8df740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563b00b3d620 con 0x563b00bd8980 2024-09-19T08:57:48.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.368+0000 7f854a8df740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x563b00ae4e50 con 0x563b00bd8060 2024-09-19T08:57:48.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.368+0000 7f854a8df740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563b00b395e0 con 0x563b00be3240 2024-09-19T08:57:48.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.368+0000 7f85462a2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b00bd8980 0x563b00be2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:48.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.368+0000 7f85462a2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b00bd8980 0x563b00be2d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37266/0 (socket says 172.21.15.19:37266) 2024-09-19T08:57:48.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.368+0000 7f85462a2640 1 -- 172.21.15.19:0/524183385 learned_addr learned my addr 172.21.15.19:0/524183385 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:48.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.368+0000 7f85377fe640 1 --2- 172.21.15.19:0/3683164252 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f852c0a3240 0x7f852c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:48.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.368+0000 7f8546aa3640 1 --2- 172.21.15.19:0/524183385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563b00bd8060 0x563b00bd8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:48.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.368+0000 7f8545aa1640 1 --2- 172.21.15.19:0/524183385 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b00be3240 0x563b00be5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:48.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.368+0000 7f8546aa3640 1 --2- 172.21.15.19:0/3683164252 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f852c0a3240 0x7f852c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:48.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.368+0000 7f85377fe640 1 -- 172.21.15.19:0/3683164252 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f853c0efe10 con 0x7f8540102d40 2024-09-19T08:57:48.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.368+0000 7f85462a2640 1 -- 172.21.15.19:0/524183385 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b00be3240 msgr2=0x563b00be5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:48.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.368+0000 7f85462a2640 1 --2- 172.21.15.19:0/524183385 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b00be3240 0x563b00be5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.368+0000 7f85462a2640 1 -- 172.21.15.19:0/524183385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563b00bd8060 msgr2=0x563b00bd8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:48.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.368+0000 7f85462a2640 1 --2- 172.21.15.19:0/524183385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563b00bd8060 0x563b00bd8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.369+0000 7f85462a2640 1 -- 172.21.15.19:0/524183385 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b00ad5d40 con 0x563b00bd8980 2024-09-19T08:57:48.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.369+0000 7f8546aa3640 1 --2- 172.21.15.19:0/524183385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563b00bd8060 0x563b00bd8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:57:48.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.369+0000 7f85462a2640 1 --2- 172.21.15.19:0/524183385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b00bd8980 0x563b00be2d00 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f853c0bc490 tx=0x7f853c02a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=819a7fc5060d0e6e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:48.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.369+0000 7f8534ff9640 1 -- 172.21.15.19:0/524183385 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c049070 con 0x563b00bd8980 2024-09-19T08:57:48.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.369+0000 7f8534ff9640 1 -- 172.21.15.19:0/524183385 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f853c03b580 con 0x563b00bd8980 2024-09-19T08:57:48.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.369+0000 7f8534ff9640 1 -- 172.21.15.19:0/524183385 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c0c08b0 con 0x563b00bd8980 2024-09-19T08:57:48.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.370+0000 7f854a8df740 1 -- 172.21.15.19:0/524183385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b00bd8980 msgr2=0x563b00be2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:48.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.370+0000 7f8546aa3640 1 --2- 172.21.15.19:0/3683164252 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f852c0a3240 0x7f852c0a5700 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8538005fd0 tx=0x7f8538009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:48.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.370+0000 7f854a8df740 1 --2- 172.21.15.19:0/524183385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b00bd8980 0x563b00be2d00 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f853c0bc490 tx=0x7f853c02a480 comp rx=0 tx=0).stop 2024-09-19T08:57:48.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.370+0000 7f854a8df740 1 -- 172.21.15.19:0/524183385 shutdown_connections 2024-09-19T08:57:48.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.370+0000 7f854a8df740 1 --2- 172.21.15.19:0/524183385 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b00be3240 0x563b00be5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.370+0000 7f854a8df740 1 --2- 172.21.15.19:0/524183385 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b00bd8980 0x563b00be2d00 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.370+0000 7f854a8df740 1 --2- 172.21.15.19:0/524183385 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563b00bd8060 0x563b00bd8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.370+0000 7f854a8df740 1 -- 172.21.15.19:0/524183385 >> 172.21.15.19:0/524183385 conn(0x563b00bd45f0 msgr2=0x563b00bd49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:48.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.370+0000 7f854a8df740 1 -- 172.21.15.19:0/524183385 shutdown_connections 2024-09-19T08:57:48.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.370+0000 7f854a8df740 1 -- 172.21.15.19:0/524183385 wait complete. 2024-09-19T08:57:48.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.370+0000 7f854a8df740 1 -- start start 2024-09-19T08:57:48.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.370+0000 7f854a8df740 1 Processor -- start 2024-09-19T08:57:48.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.371+0000 7f854a8df740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b00bd8060 0x563b00be00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:48.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.371+0000 7f854a8df740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563b00bd8980 0x563b00be0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:48.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.371+0000 7f854a8df740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b00be3240 0x563b00be0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:48.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.371+0000 7f854a8df740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563b00be5bd0 con 0x563b00bd8060 2024-09-19T08:57:48.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.371+0000 7f854a8df740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x563b00ac5f10 con 0x563b00bd8980 2024-09-19T08:57:48.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.371+0000 7f854a8df740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563b00be5d50 con 0x563b00be3240 2024-09-19T08:57:48.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.371+0000 7f854a8df740 10 client.0 _ll_register_callbacks cb 0x563b00ae9db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:48.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.371+0000 7f85462a2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b00bd8060 0x563b00be00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:48.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.371+0000 7f85462a2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b00bd8060 0x563b00be00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37278/0 (socket says 172.21.15.19:37278) 2024-09-19T08:57:48.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.371+0000 7f85462a2640 1 -- 172.21.15.19:0/1624792208 learned_addr learned my addr 172.21.15.19:0/1624792208 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:48.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.371+0000 7f8546aa3640 1 --2- 172.21.15.19:0/1624792208 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b00be3240 0x563b00be0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:48.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.371+0000 7f8545aa1640 1 --2- 172.21.15.19:0/1624792208 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563b00bd8980 0x563b00be0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:48.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.371+0000 7f85462a2640 1 -- 172.21.15.19:0/1624792208 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b00be3240 msgr2=0x563b00be0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:48.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.371+0000 7f85462a2640 1 --2- 172.21.15.19:0/1624792208 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b00be3240 0x563b00be0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.371+0000 7f85462a2640 1 -- 172.21.15.19:0/1624792208 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563b00bd8980 msgr2=0x563b00be0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:48.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.371+0000 7f85462a2640 1 --2- 172.21.15.19:0/1624792208 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563b00bd8980 0x563b00be0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.371+0000 7f85462a2640 1 -- 172.21.15.19:0/1624792208 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b0084c580 con 0x563b00bd8060 2024-09-19T08:57:48.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.371+0000 7f8545aa1640 1 --2- 172.21.15.19:0/1624792208 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563b00bd8980 0x563b00be0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:57:48.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.371+0000 7f85462a2640 1 --2- 172.21.15.19:0/1624792208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b00bd8060 0x563b00be00d0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f853c0c4c40 tx=0x7f853c0bbee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71f0bd0720564ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:48.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.371+0000 7f8529ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:57:48.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.371+0000 7f8529ffb640 1 -- 172.21.15.19:0/1624792208 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c0da060 con 0x563b00bd8060 2024-09-19T08:57:48.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.371+0000 7f8529ffb640 1 -- 172.21.15.19:0/1624792208 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f853c0b8250 con 0x563b00bd8060 2024-09-19T08:57:48.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.371+0000 7f854a8df740 1 -- 172.21.15.19:0/1624792208 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563b00b4ab90 con 0x563b00bd8060 2024-09-19T08:57:48.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.372+0000 7f8529ffb640 1 -- 172.21.15.19:0/1624792208 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f853c049040 con 0x563b00bd8060 2024-09-19T08:57:48.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.372+0000 7f854a8df740 10 client.16638 fetch_fsmap learned FSMap version 33 2024-09-19T08:57:48.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.372+0000 7f854a8df740 1 -- 172.21.15.19:0/1624792208 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x563b00916960 con 0x563b00bd8060 2024-09-19T08:57:48.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.372+0000 7f8529ffb640 1 -- 172.21.15.19:0/1624792208 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x563b00b4ab90 con 0x563b00bd8060 2024-09-19T08:57:48.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.372+0000 7f8529ffb640 1 -- 172.21.15.19:0/1624792208 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f853c0bc760 con 0x563b00bd8060 2024-09-19T08:57:48.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.372+0000 7f854a8df740 10 client.16638 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:57:48.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.372+0000 7f854a8df740 10 client.16638 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T08:57:48.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.372+0000 7f854a8df740 20 client.16638 populate_metadata read hostname 'smithi019' 2024-09-19T08:57:48.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.372+0000 7f854a8df740 1 --2- 172.21.15.19:0/1624792208 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563b00bf28c0 0x563b00bf4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:48.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.372+0000 7f854a8df740 4 client.16638 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:57:48.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.372+0000 7f854a8df740 1 -- 172.21.15.19:0/1624792208 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b00b450a0 con 0x563b00bf28c0 2024-09-19T08:57:48.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.372+0000 7f8545aa1640 1 --2- 172.21.15.19:0/1624792208 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563b00bf28c0 0x563b00bf4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:48.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.373+0000 7f8545aa1640 1 --2- 172.21.15.19:0/1624792208 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563b00bf28c0 0x563b00bf4cb0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd68f0cb93912083 server_cookie=bbc6e6848f773d9a in_seq=0 out_seq=0 2024-09-19T08:57:48.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.373+0000 7f8529ffb640 10 client.16638 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:57:48.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.374+0000 7f8529ffb640 1 -- 172.21.15.19:0/1624792208 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563b00b450a0 con 0x563b00bf28c0 2024-09-19T08:57:48.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.374+0000 7f8529ffb640 10 client.16638 handle_command_reply: tid=0 2024-09-19T08:57:48.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.374+0000 7f854a8df740 1 client.16638 shutdown 2024-09-19T08:57:48.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.374+0000 7f854a8df740 1 -- 172.21.15.19:0/1624792208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b00bd8060 msgr2=0x563b00be00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:48.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.374+0000 7f854a8df740 1 --2- 172.21.15.19:0/1624792208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b00bd8060 0x563b00be00d0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f853c0c4c40 tx=0x7f853c0bbee0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.374+0000 7f854a8df740 1 -- 172.21.15.19:0/1624792208 shutdown_connections 2024-09-19T08:57:48.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.374+0000 7f854a8df740 1 --2- 172.21.15.19:0/1624792208 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563b00bf28c0 0x563b00bf4cb0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.374+0000 7f854a8df740 1 --2- 172.21.15.19:0/1624792208 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b00be3240 0x563b00be0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.374+0000 7f854a8df740 1 --2- 172.21.15.19:0/1624792208 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563b00bd8980 0x563b00be0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.374+0000 7f854a8df740 1 --2- 172.21.15.19:0/1624792208 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b00bd8060 0x563b00be00d0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.374+0000 7f854a8df740 1 -- 172.21.15.19:0/1624792208 >> 172.21.15.19:0/1624792208 conn(0x563b00bd45f0 msgr2=0x563b00bda320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:48.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.374+0000 7f8529ffb640 0 client.16638 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:57:48.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.374+0000 7f854a8df740 1 -- 172.21.15.19:0/1624792208 shutdown_connections 2024-09-19T08:57:48.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.374+0000 7f854a8df740 1 -- 172.21.15.19:0/1624792208 wait complete. 2024-09-19T08:57:48.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.374+0000 7f854a8df740 20 client.16638 trim_cache size 0 max 16384 2024-09-19T08:57:48.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.391+0000 7f854a8df740 1 Processor -- start 2024-09-19T08:57:48.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.391+0000 7f854a8df740 1 -- start start 2024-09-19T08:57:48.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.391+0000 7f854a8df740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563b00bd8060 0x563b00bd49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:48.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.391+0000 7f854a8df740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b00bd8980 0x563b00bee620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:48.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.391+0000 7f854a8df740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b00be3240 0x563b00bdd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:48.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.391+0000 7f854a8df740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f85401af6d0 con 0x563b00bd8980 2024-09-19T08:57:48.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.391+0000 7f854a8df740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f85401b1240 con 0x563b00bd8060 2024-09-19T08:57:48.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.391+0000 7f854a8df740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f85401afda0 con 0x563b00be3240 2024-09-19T08:57:48.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.391+0000 7f8545aa1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b00bd8980 0x563b00bee620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:48.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.391+0000 7f8545aa1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b00bd8980 0x563b00bee620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37286/0 (socket says 172.21.15.19:37286) 2024-09-19T08:57:48.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.392+0000 7f8545aa1640 1 -- 172.21.15.19:0/531169206 learned_addr learned my addr 172.21.15.19:0/531169206 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:48.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.392+0000 7f85462a2640 1 --2- 172.21.15.19:0/531169206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563b00bd8060 0x563b00bd49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:48.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.392+0000 7f8546aa3640 1 --2- 172.21.15.19:0/531169206 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b00be3240 0x563b00bdd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:48.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.392+0000 7f8545aa1640 1 -- 172.21.15.19:0/531169206 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b00be3240 msgr2=0x563b00bdd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:48.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.392+0000 7f8545aa1640 1 --2- 172.21.15.19:0/531169206 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b00be3240 0x563b00bdd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.392+0000 7f8545aa1640 1 -- 172.21.15.19:0/531169206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563b00bd8060 msgr2=0x563b00bd49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:48.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.392+0000 7f8545aa1640 1 --2- 172.21.15.19:0/531169206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563b00bd8060 0x563b00bd49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.392+0000 7f8545aa1640 1 -- 172.21.15.19:0/531169206 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b00be2010 con 0x563b00bd8980 2024-09-19T08:57:48.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.392+0000 7f8546aa3640 1 --2- 172.21.15.19:0/531169206 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b00be3240 0x563b00bdd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:57:48.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.392+0000 7f85462a2640 1 --2- 172.21.15.19:0/531169206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563b00bd8060 0x563b00bd49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:57:48.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.392+0000 7f8545aa1640 1 --2- 172.21.15.19:0/531169206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b00bd8980 0x563b00bee620 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f8530005fd0 tx=0x7f85300118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8ad2ec6813d61f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:48.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.392+0000 7f852bfff640 1 -- 172.21.15.19:0/531169206 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8530005220 con 0x563b00bd8980 2024-09-19T08:57:48.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.392+0000 7f852bfff640 1 -- 172.21.15.19:0/531169206 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8530004c80 con 0x563b00bd8980 2024-09-19T08:57:48.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.392+0000 7f852bfff640 1 -- 172.21.15.19:0/531169206 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853001d980 con 0x563b00bd8980 2024-09-19T08:57:48.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.393+0000 7f854a8df740 1 -- 172.21.15.19:0/531169206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b00bd8980 msgr2=0x563b00bee620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:48.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.393+0000 7f854a8df740 1 --2- 172.21.15.19:0/531169206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b00bd8980 0x563b00bee620 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f8530005fd0 tx=0x7f85300118d0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.393+0000 7f854a8df740 1 -- 172.21.15.19:0/531169206 shutdown_connections 2024-09-19T08:57:48.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.393+0000 7f854a8df740 1 --2- 172.21.15.19:0/531169206 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b00be3240 0x563b00bdd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.393+0000 7f854a8df740 1 --2- 172.21.15.19:0/531169206 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b00bd8980 0x563b00bee620 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.393+0000 7f854a8df740 1 --2- 172.21.15.19:0/531169206 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563b00bd8060 0x563b00bd49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.393+0000 7f854a8df740 1 -- 172.21.15.19:0/531169206 >> 172.21.15.19:0/531169206 conn(0x563b00bd45f0 msgr2=0x563b00bedf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:48.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.393+0000 7f854a8df740 1 -- 172.21.15.19:0/531169206 shutdown_connections 2024-09-19T08:57:48.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.393+0000 7f854a8df740 1 -- 172.21.15.19:0/531169206 wait complete. 2024-09-19T08:57:48.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.393+0000 7f854a8df740 1 -- start start 2024-09-19T08:57:48.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.393+0000 7f854a8df740 1 Processor -- start 2024-09-19T08:57:48.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.393+0000 7f854a8df740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b00bd8060 0x563b00bf55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:48.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.393+0000 7f854a8df740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563b00bd8980 0x563b00bf5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:48.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.394+0000 7f854a8df740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b00be3240 0x563b00bf6020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:48.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.394+0000 7f854a8df740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f85401b0b70 con 0x563b00bd8060 2024-09-19T08:57:48.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.394+0000 7f854a8df740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f85401b04a0 con 0x563b00bd8980 2024-09-19T08:57:48.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.394+0000 7f854a8df740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f85401ad6b0 con 0x563b00be3240 2024-09-19T08:57:48.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.394+0000 7f854a8df740 10 client.0 _ll_register_callbacks cb 0x7f853c03b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:48.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.394+0000 7f85462a2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b00bd8060 0x563b00bf55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:48.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.394+0000 7f85462a2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b00bd8060 0x563b00bf55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37290/0 (socket says 172.21.15.19:37290) 2024-09-19T08:57:48.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.394+0000 7f85462a2640 1 -- 172.21.15.19:0/3759111550 learned_addr learned my addr 172.21.15.19:0/3759111550 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:48.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.394+0000 7f8546aa3640 1 --2- 172.21.15.19:0/3759111550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b00be3240 0x563b00bf6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:48.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.394+0000 7f8545aa1640 1 --2- 172.21.15.19:0/3759111550 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563b00bd8980 0x563b00bf5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:48.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.394+0000 7f85462a2640 1 -- 172.21.15.19:0/3759111550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b00be3240 msgr2=0x563b00bf6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:48.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.394+0000 7f85462a2640 1 --2- 172.21.15.19:0/3759111550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b00be3240 0x563b00bf6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.394+0000 7f85462a2640 1 -- 172.21.15.19:0/3759111550 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563b00bd8980 msgr2=0x563b00bf5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:48.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.394+0000 7f85462a2640 1 --2- 172.21.15.19:0/3759111550 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563b00bd8980 0x563b00bf5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:48.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.394+0000 7f85462a2640 1 -- 172.21.15.19:0/3759111550 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b00c5c200 con 0x563b00bd8060 2024-09-19T08:57:48.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.394+0000 7f8546aa3640 1 --2- 172.21.15.19:0/3759111550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b00be3240 0x563b00bf6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:57:48.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.394+0000 7f8545aa1640 1 --2- 172.21.15.19:0/3759111550 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563b00bd8980 0x563b00bf5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:57:48.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.394+0000 7f85462a2640 1 --2- 172.21.15.19:0/3759111550 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b00bd8060 0x563b00bf55a0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f853c0bc490 tx=0x7f853c0c0900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4c66179253bce2f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:48.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.394+0000 7f8529ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:57:48.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.394+0000 7f8529ffb640 1 -- 172.21.15.19:0/3759111550 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c0da040 con 0x563b00bd8060 2024-09-19T08:57:48.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.394+0000 7f8529ffb640 1 -- 172.21.15.19:0/3759111550 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f853c0bb950 con 0x563b00bd8060 2024-09-19T08:57:48.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.394+0000 7f854a8df740 1 -- 172.21.15.19:0/3759111550 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8530004c80 con 0x563b00bd8060 2024-09-19T08:57:48.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.395+0000 7f8529ffb640 1 -- 172.21.15.19:0/3759111550 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f853c0b87a0 con 0x563b00bd8060 2024-09-19T08:57:48.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.395+0000 7f854a8df740 10 client.16644 fetch_fsmap learned FSMap version 33 2024-09-19T08:57:48.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.395+0000 7f854a8df740 1 -- 172.21.15.19:0/3759111550 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x563b00c5c200 con 0x563b00bd8060 2024-09-19T08:57:48.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.395+0000 7f8529ffb640 1 -- 172.21.15.19:0/3759111550 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8530004c80 con 0x563b00bd8060 2024-09-19T08:57:48.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.395+0000 7f8529ffb640 1 -- 172.21.15.19:0/3759111550 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f853c0b8250 con 0x563b00bd8060 2024-09-19T08:57:48.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.395+0000 7f854a8df740 10 client.16644 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:57:48.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.395+0000 7f854a8df740 10 client.16644 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T08:57:48.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.395+0000 7f854a8df740 20 client.16644 populate_metadata read hostname 'smithi019' 2024-09-19T08:57:48.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.395+0000 7f854a8df740 1 --2- 172.21.15.19:0/3759111550 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563b00c5d740 0x563b00c5fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:48.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.395+0000 7f854a8df740 4 client.16644 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "a8cb4dbc", "release": true, "await": true}] 2024-09-19T08:57:48.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.395+0000 7f854a8df740 1 -- 172.21.15.19:0/3759111550 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "quiesce db", "set_id": "a8cb4dbc", "release": true, "await": true}) -- 0x563b00ac15a0 con 0x563b00c5d740 2024-09-19T08:57:48.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.395+0000 7f8545aa1640 1 --2- 172.21.15.19:0/3759111550 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563b00c5d740 0x563b00c5fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:48.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.396+0000 7f8545aa1640 1 --2- 172.21.15.19:0/3759111550 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563b00c5d740 0x563b00c5fb80 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae7c36e0ffffc035 server_cookie=d7f340846657e1cd in_seq=0 out_seq=0 2024-09-19T08:57:48.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:48.396+0000 7f8529ffb640 10 client.16644 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:57:48.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:48 smithi019 ceph-mon[30976]: scrub summary: idle+waiting paths [/] 2024-09-19T08:57:48.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:48 smithi155 ceph-mon[34921]: scrub summary: idle+waiting paths [/] 2024-09-19T08:57:48.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:48 smithi203 ceph-mon[35450]: scrub summary: idle+waiting paths [/] 2024-09-19T08:57:49.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:49 smithi019 ceph-mon[30976]: pgmap v505: 97 pgs: 97 active+clean; 34 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.0 MiB/s wr, 2.34k op/s 2024-09-19T08:57:49.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:49.840+0000 7f8529ffb640 1 -- 172.21.15.19:0/3759111550 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x563b00ac15a0 con 0x563b00c5d740 2024-09-19T08:57:49.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:49.840+0000 7f8529ffb640 10 client.16644 handle_command_reply: tid=0 2024-09-19T08:57:49.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:49.840+0000 7f854a8df740 1 client.16644 shutdown 2024-09-19T08:57:49.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:49.841+0000 7f854a8df740 1 -- 172.21.15.19:0/3759111550 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b00bd8060 msgr2=0x563b00bf55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:49.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:49.841+0000 7f854a8df740 1 --2- 172.21.15.19:0/3759111550 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b00bd8060 0x563b00bf55a0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f853c0bc490 tx=0x7f853c0c0900 comp rx=0 tx=0).stop 2024-09-19T08:57:49.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:49.841+0000 7f854a8df740 1 -- 172.21.15.19:0/3759111550 shutdown_connections 2024-09-19T08:57:49.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:49.841+0000 7f854a8df740 1 --2- 172.21.15.19:0/3759111550 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563b00c5d740 0x563b00c5fb80 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:49.841+0000 7f8529ffb640 0 client.16644 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:57:49.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:49.841+0000 7f854a8df740 1 --2- 172.21.15.19:0/3759111550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563b00be3240 0x563b00bf6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:49.841+0000 7f854a8df740 1 --2- 172.21.15.19:0/3759111550 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563b00bd8980 0x563b00bf5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:49.841+0000 7f854a8df740 1 --2- 172.21.15.19:0/3759111550 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563b00bd8060 0x563b00bf55a0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:49.841+0000 7f854a8df740 1 -- 172.21.15.19:0/3759111550 >> 172.21.15.19:0/3759111550 conn(0x563b00bd45f0 msgr2=0x563b00bee730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:49.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:49.841+0000 7f854a8df740 1 -- 172.21.15.19:0/3759111550 shutdown_connections 2024-09-19T08:57:49.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:49.841+0000 7f854a8df740 1 -- 172.21.15.19:0/3759111550 wait complete. 2024-09-19T08:57:49.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:49.841+0000 7f854a8df740 20 client.16644 trim_cache size 0 max 16384 2024-09-19T08:57:49.842 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:57:49.842 INFO:teuthology.orchestra.run.smithi019.stdout: "epoch": 33, 2024-09-19T08:57:49.842 INFO:teuthology.orchestra.run.smithi019.stdout: "leader": 24497, 2024-09-19T08:57:49.842 INFO:teuthology.orchestra.run.smithi019.stdout: "set_version": 20, 2024-09-19T08:57:49.842 INFO:teuthology.orchestra.run.smithi019.stdout: "sets": { 2024-09-19T08:57:49.842 INFO:teuthology.orchestra.run.smithi019.stdout: "a8cb4dbc": { 2024-09-19T08:57:49.842 INFO:teuthology.orchestra.run.smithi019.stdout: "version": 20, 2024-09-19T08:57:49.842 INFO:teuthology.orchestra.run.smithi019.stdout: "age_ref": 0.0, 2024-09-19T08:57:49.842 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T08:57:49.843 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RELEASED", 2024-09-19T08:57:49.843 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T08:57:49.843 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T08:57:49.843 INFO:teuthology.orchestra.run.smithi019.stdout: "timeout": 90.0, 2024-09-19T08:57:49.843 INFO:teuthology.orchestra.run.smithi019.stdout: "expiration": 149.8, 2024-09-19T08:57:49.843 INFO:teuthology.orchestra.run.smithi019.stdout: "members": { 2024-09-19T08:57:49.843 INFO:teuthology.orchestra.run.smithi019.stdout: "file:/": { 2024-09-19T08:57:49.843 INFO:teuthology.orchestra.run.smithi019.stdout: "excluded": false, 2024-09-19T08:57:49.843 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T08:57:49.843 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RELEASED", 2024-09-19T08:57:49.843 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T08:57:49.843 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:57:49.843 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:57:49.843 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:57:49.844 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:57:49.844 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:57:49.844 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:57:49.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:49.842+0000 7f8548506640 1 -- 172.21.15.19:0/3683164252 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f852c0a3240 msgr2=0x7f852c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:49.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:49.842+0000 7f8548506640 1 --2- 172.21.15.19:0/3683164252 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f852c0a3240 0x7f852c0a5700 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8538005fd0 tx=0x7f8538009600 comp rx=0 tx=0).stop 2024-09-19T08:57:49.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:49.842+0000 7f8548506640 1 -- 172.21.15.19:0/3683164252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8540102d40 msgr2=0x7f85401009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:49.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:49.842+0000 7f8548506640 1 --2- 172.21.15.19:0/3683164252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8540102d40 0x7f85401009a0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f853c006010 tx=0x7f853c0042f0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:49.843+0000 7f8548506640 1 -- 172.21.15.19:0/3683164252 shutdown_connections 2024-09-19T08:57:49.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:49.843+0000 7f8548506640 1 --2- 172.21.15.19:0/3683164252 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f852c0a3240 0x7f852c0a5700 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:49.843+0000 7f8548506640 1 --2- 172.21.15.19:0/3683164252 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8540103660 0x7f8540100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:49.843+0000 7f8548506640 1 --2- 172.21.15.19:0/3683164252 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f854010c170 0x7f8540101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:49.843+0000 7f8548506640 1 --2- 172.21.15.19:0/3683164252 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8540102d40 0x7f85401009a0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:49.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:49.843+0000 7f8548506640 1 -- 172.21.15.19:0/3683164252 >> 172.21.15.19:0/3683164252 conn(0x7f85400fc7a0 msgr2=0x7f85400fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:49.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:49.843+0000 7f8548506640 1 -- 172.21.15.19:0/3683164252 shutdown_connections 2024-09-19T08:57:49.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:49.843+0000 7f8548506640 1 -- 172.21.15.19:0/3683164252 wait complete. 2024-09-19T08:57:49.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:49 smithi155 ceph-mon[34921]: pgmap v505: 97 pgs: 97 active+clean; 34 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.0 MiB/s wr, 2.34k op/s 2024-09-19T08:57:49.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:49 smithi203 ceph-mon[35450]: pgmap v505: 97 pgs: 97 active+clean; 34 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 2.0 MiB/s wr, 2.34k op/s 2024-09-19T08:57:50.485 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.484+0000 7f20cf2af640 1 -- 172.21.15.19:0/4217627285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20c8104f90 msgr2=0x7f20c8107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:50.486 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.484+0000 7f20cf2af640 1 --2- 172.21.15.19:0/4217627285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20c8104f90 0x7f20c8107380 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f20b8009860 tx=0x7f20b802a340 comp rx=0 tx=0).stop 2024-09-19T08:57:50.486 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.484+0000 7f20cf2af640 1 -- 172.21.15.19:0/4217627285 shutdown_connections 2024-09-19T08:57:50.486 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.484+0000 7f20cf2af640 1 --2- 172.21.15.19:0/4217627285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f20c81078c0 0x7f20c8109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.486 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.484+0000 7f20cf2af640 1 --2- 172.21.15.19:0/4217627285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20c8104f90 0x7f20c8107380 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.486 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.484+0000 7f20cf2af640 1 --2- 172.21.15.19:0/4217627285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20c8102660 0x7f20c8104a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.486 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.484+0000 7f20cf2af640 1 -- 172.21.15.19:0/4217627285 >> 172.21.15.19:0/4217627285 conn(0x7f20c80fc1e0 msgr2=0x7f20c80fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:50.486 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.484+0000 7f20cf2af640 1 -- 172.21.15.19:0/4217627285 shutdown_connections 2024-09-19T08:57:50.486 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.484+0000 7f20cf2af640 1 -- 172.21.15.19:0/4217627285 wait complete. 2024-09-19T08:57:50.486 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.484+0000 7f20cf2af640 1 Processor -- start 2024-09-19T08:57:50.486 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.484+0000 7f20cf2af640 1 -- start start 2024-09-19T08:57:50.486 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.485+0000 7f20cf2af640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20c8102660 0x7f20c8070ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:50.486 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.485+0000 7f20cf2af640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20c8104f90 0x7f20c80710e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:50.486 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.485+0000 7f20cf2af640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f20c81078c0 0x7f20c81a7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:50.487 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.485+0000 7f20cf2af640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f20c810d7d0 con 0x7f20c8104f90 2024-09-19T08:57:50.487 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.485+0000 7f20cf2af640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f20c810d650 con 0x7f20c8102660 2024-09-19T08:57:50.487 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.485+0000 7f20cf2af640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f20c810d950 con 0x7f20c81078c0 2024-09-19T08:57:50.487 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.485+0000 7f20cc84a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20c8104f90 0x7f20c80710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:50.487 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.485+0000 7f20cd04b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20c8102660 0x7f20c8070ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:50.487 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.485+0000 7f20cc84a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20c8104f90 0x7f20c80710e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37308/0 (socket says 172.21.15.19:37308) 2024-09-19T08:57:50.487 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.485+0000 7f20cc84a640 1 -- 172.21.15.19:0/578381098 learned_addr learned my addr 172.21.15.19:0/578381098 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:50.487 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.485+0000 7f20cd84c640 1 --2- 172.21.15.19:0/578381098 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f20c81078c0 0x7f20c81a7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:50.487 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.485+0000 7f20cc84a640 1 -- 172.21.15.19:0/578381098 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f20c81078c0 msgr2=0x7f20c81a7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:50.487 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.485+0000 7f20cc84a640 1 --2- 172.21.15.19:0/578381098 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f20c81078c0 0x7f20c81a7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.487 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.485+0000 7f20cc84a640 1 -- 172.21.15.19:0/578381098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20c8102660 msgr2=0x7f20c8070ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:50.487 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.485+0000 7f20cc84a640 1 --2- 172.21.15.19:0/578381098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20c8102660 0x7f20c8070ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.488 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.485+0000 7f20cc84a640 1 -- 172.21.15.19:0/578381098 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20c81a8420 con 0x7f20c8104f90 2024-09-19T08:57:50.488 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.485+0000 7f20cd04b640 1 --2- 172.21.15.19:0/578381098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20c8102660 0x7f20c8070ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:57:50.488 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.485+0000 7f20cc84a640 1 --2- 172.21.15.19:0/578381098 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20c8104f90 0x7f20c80710e0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f20b80305b0 tx=0x7f20b8033d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:50.488 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.485+0000 7f20be7fc640 1 -- 172.21.15.19:0/578381098 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b803f020 con 0x7f20c8104f90 2024-09-19T08:57:50.488 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.486+0000 7f20be7fc640 1 -- 172.21.15.19:0/578381098 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20b8030850 con 0x7f20c8104f90 2024-09-19T08:57:50.488 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.486+0000 7f20cf2af640 1 -- 172.21.15.19:0/578381098 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20c81a85f0 con 0x7f20c8104f90 2024-09-19T08:57:50.488 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.486+0000 7f20be7fc640 1 -- 172.21.15.19:0/578381098 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b8037040 con 0x7f20c8104f90 2024-09-19T08:57:50.488 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.486+0000 7f20cf2af640 1 -- 172.21.15.19:0/578381098 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20c81a8ab0 con 0x7f20c8104f90 2024-09-19T08:57:50.493 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.488+0000 7f20be7fc640 1 -- 172.21.15.19:0/578381098 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f20b8042020 con 0x7f20c8104f90 2024-09-19T08:57:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.488+0000 7f20d203d740 1 Processor -- start 2024-09-19T08:57:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.488+0000 7f20d203d740 1 -- start start 2024-09-19T08:57:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.488+0000 7f20d203d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d111a6edb0 0x55d111a6f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.488+0000 7f20d203d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d111a6f6f0 0x55d111a741b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.488+0000 7f20d203d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d111a74780 0x55d111a76c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.488+0000 7f20d203d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d1119ce2f0 con 0x55d111a6edb0 2024-09-19T08:57:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.489+0000 7f20d203d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55d111976270 con 0x55d111a74780 2024-09-19T08:57:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.489+0000 7f20d203d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d1119ca2b0 con 0x55d111a6f6f0 2024-09-19T08:57:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.489+0000 7f20cd84c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d111a6edb0 0x55d111a6f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.489+0000 7f20cd84c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d111a6edb0 0x55d111a6f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37320/0 (socket says 172.21.15.19:37320) 2024-09-19T08:57:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.489+0000 7f20cd84c640 1 -- 172.21.15.19:0/3742421097 learned_addr learned my addr 172.21.15.19:0/3742421097 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:50.494 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.489+0000 7f20cc84a640 1 --2- 172.21.15.19:0/3742421097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d111a74780 0x55d111a76c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.489+0000 7f20cd04b640 1 --2- 172.21.15.19:0/3742421097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d111a6f6f0 0x55d111a741b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.489+0000 7f20be7fc640 1 --2- 172.21.15.19:0/578381098 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f20b40a3370 0x7f20b40a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.489+0000 7f20cd84c640 1 -- 172.21.15.19:0/3742421097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d111a6f6f0 msgr2=0x55d111a741b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.489+0000 7f20cd84c640 1 --2- 172.21.15.19:0/3742421097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d111a6f6f0 0x55d111a741b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.489+0000 7f20cd84c640 1 -- 172.21.15.19:0/3742421097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d111a74780 msgr2=0x55d111a76c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.489+0000 7f20cd84c640 1 --2- 172.21.15.19:0/3742421097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d111a74780 0x55d111a76c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.489+0000 7f20cd84c640 1 -- 172.21.15.19:0/3742421097 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d111975340 con 0x55d111a6edb0 2024-09-19T08:57:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.489+0000 7f20be7fc640 1 -- 172.21.15.19:0/578381098 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f20b80efc00 con 0x7f20c8104f90 2024-09-19T08:57:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.489+0000 7f20cd84c640 1 --2- 172.21.15.19:0/578381098 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f20b40a3370 0x7f20b40a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.489+0000 7f20cd84c640 1 --2- 172.21.15.19:0/3742421097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d111a6edb0 0x55d111a6f1b0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f20c000e570 tx=0x7f20c000ea30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1100e64ae01b45c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.490+0000 7f20b37fe640 1 -- 172.21.15.19:0/3742421097 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c001bb50 con 0x55d111a6edb0 2024-09-19T08:57:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.490+0000 7f20b37fe640 1 -- 172.21.15.19:0/3742421097 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20c001bcf0 con 0x55d111a6edb0 2024-09-19T08:57:50.495 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.490+0000 7f20cd84c640 1 --2- 172.21.15.19:0/578381098 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f20b40a3370 0x7f20b40a5830 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f20c0023000 tx=0x7f20c0024000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.490+0000 7f20b37fe640 1 -- 172.21.15.19:0/3742421097 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c001a640 con 0x55d111a6edb0 2024-09-19T08:57:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.490+0000 7f20d203d740 1 -- 172.21.15.19:0/3742421097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d111a6edb0 msgr2=0x55d111a6f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.490+0000 7f20d203d740 1 --2- 172.21.15.19:0/3742421097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d111a6edb0 0x55d111a6f1b0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f20c000e570 tx=0x7f20c000ea30 comp rx=0 tx=0).stop 2024-09-19T08:57:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.490+0000 7f20d203d740 1 -- 172.21.15.19:0/3742421097 shutdown_connections 2024-09-19T08:57:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.490+0000 7f20d203d740 1 --2- 172.21.15.19:0/3742421097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d111a6f6f0 0x55d111a741b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.490+0000 7f20d203d740 1 --2- 172.21.15.19:0/3742421097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d111a74780 0x55d111a76c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.490+0000 7f20d203d740 1 --2- 172.21.15.19:0/3742421097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d111a6edb0 0x55d111a6f1b0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.490+0000 7f20d203d740 1 -- 172.21.15.19:0/3742421097 >> 172.21.15.19:0/3742421097 conn(0x55d111a66010 msgr2=0x55d111a66410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.491+0000 7f20d203d740 1 -- 172.21.15.19:0/3742421097 shutdown_connections 2024-09-19T08:57:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.491+0000 7f20d203d740 1 -- 172.21.15.19:0/3742421097 wait complete. 2024-09-19T08:57:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.491+0000 7f20d203d740 1 -- start start 2024-09-19T08:57:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.491+0000 7f20d203d740 1 Processor -- start 2024-09-19T08:57:50.496 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.491+0000 7f20d203d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d111a6edb0 0x55d111a790c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.491+0000 7f20d203d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d111a6f6f0 0x55d111a79600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.491+0000 7f20d203d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d111a74780 0x55d111a805d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.491+0000 7f20d203d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d111a77750 con 0x55d111a6f6f0 2024-09-19T08:57:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.491+0000 7f20d203d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55d111957290 con 0x55d111a6edb0 2024-09-19T08:57:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.491+0000 7f20d203d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d111a778d0 con 0x55d111a74780 2024-09-19T08:57:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.492+0000 7f20d203d740 10 client.0 _ll_register_callbacks cb 0x55d111988140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.492+0000 7f20cc84a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d111a6f6f0 0x55d111a79600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.492+0000 7f20cc84a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d111a6f6f0 0x55d111a79600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37324/0 (socket says 172.21.15.19:37324) 2024-09-19T08:57:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.492+0000 7f20cc84a640 1 -- 172.21.15.19:0/1499994876 learned_addr learned my addr 172.21.15.19:0/1499994876 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.492+0000 7f20cd04b640 1 --2- 172.21.15.19:0/1499994876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d111a6edb0 0x55d111a790c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.492+0000 7f20cd84c640 1 --2- 172.21.15.19:0/1499994876 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d111a74780 0x55d111a805d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:50.497 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.492+0000 7f20cc84a640 1 -- 172.21.15.19:0/1499994876 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d111a74780 msgr2=0x55d111a805d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.492+0000 7f20cc84a640 1 --2- 172.21.15.19:0/1499994876 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d111a74780 0x55d111a805d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.492+0000 7f20cc84a640 1 -- 172.21.15.19:0/1499994876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d111a6edb0 msgr2=0x55d111a790c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.492+0000 7f20cc84a640 1 --2- 172.21.15.19:0/1499994876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d111a6edb0 0x55d111a790c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.492+0000 7f20cc84a640 1 -- 172.21.15.19:0/1499994876 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1116e1210 con 0x55d111a6f6f0 2024-09-19T08:57:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.492+0000 7f20cd04b640 1 --2- 172.21.15.19:0/1499994876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d111a6edb0 0x55d111a790c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:57:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.492+0000 7f20cc84a640 1 --2- 172.21.15.19:0/1499994876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d111a6f6f0 0x55d111a79600 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f20b80ed6b0 tx=0x7f20b8005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4418c572dc33f70b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.492+0000 7f20b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:57:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.492+0000 7f20b0ff9640 1 -- 172.21.15.19:0/1499994876 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b80f4040 con 0x55d111a6f6f0 2024-09-19T08:57:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.492+0000 7f20b0ff9640 1 -- 172.21.15.19:0/1499994876 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f20b80dc0b0 con 0x55d111a6f6f0 2024-09-19T08:57:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.492+0000 7f20d203d740 1 -- 172.21.15.19:0/1499994876 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20c001bcf0 con 0x55d111a6f6f0 2024-09-19T08:57:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.492+0000 7f20b0ff9640 1 -- 172.21.15.19:0/1499994876 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f20b80bbb30 con 0x55d111a6f6f0 2024-09-19T08:57:50.498 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.492+0000 7f20d203d740 10 client.16656 fetch_fsmap learned FSMap version 33 2024-09-19T08:57:50.499 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.492+0000 7f20d203d740 1 -- 172.21.15.19:0/1499994876 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55d1117ad620 con 0x55d111a6f6f0 2024-09-19T08:57:50.499 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.493+0000 7f20b0ff9640 1 -- 172.21.15.19:0/1499994876 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20c001bcf0 con 0x55d111a6f6f0 2024-09-19T08:57:50.499 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.493+0000 7f20b0ff9640 1 -- 172.21.15.19:0/1499994876 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f20b803a030 con 0x55d111a6f6f0 2024-09-19T08:57:50.499 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.493+0000 7f20d203d740 10 client.16656 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:57:50.499 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.493+0000 7f20d203d740 10 client.16656 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:57:50.499 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.493+0000 7f20d203d740 20 client.16656 populate_metadata read hostname 'smithi019' 2024-09-19T08:57:50.499 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.493+0000 7f20d203d740 1 --2- 172.21.15.19:0/1499994876 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d111a84c90 0x55d111a870e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:50.499 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.493+0000 7f20d203d740 4 client.16656 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:57:50.499 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.493+0000 7f20d203d740 1 -- 172.21.15.19:0/1499994876 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d1119dba20 con 0x55d111a84c90 2024-09-19T08:57:50.499 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.493+0000 7f20cd04b640 1 --2- 172.21.15.19:0/1499994876 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d111a84c90 0x55d111a870e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:50.499 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.493+0000 7f20cd04b640 1 --2- 172.21.15.19:0/1499994876 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d111a84c90 0x55d111a870e0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97c1948becfafbad server_cookie=5204e8563850c73c in_seq=0 out_seq=0 2024-09-19T08:57:50.499 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.493+0000 7f20b0ff9640 10 client.16656 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:57:50.500 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.497+0000 7f20b0ff9640 1 -- 172.21.15.19:0/1499994876 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d1119dba20 con 0x55d111a84c90 2024-09-19T08:57:50.500 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.497+0000 7f20b0ff9640 10 client.16656 handle_command_reply: tid=0 2024-09-19T08:57:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.497+0000 7f20d203d740 1 client.16656 shutdown 2024-09-19T08:57:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.498+0000 7f20d203d740 1 -- 172.21.15.19:0/1499994876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d111a6f6f0 msgr2=0x55d111a79600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.498+0000 7f20d203d740 1 --2- 172.21.15.19:0/1499994876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d111a6f6f0 0x55d111a79600 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f20b80ed6b0 tx=0x7f20b8005760 comp rx=0 tx=0).stop 2024-09-19T08:57:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.498+0000 7f20d203d740 1 -- 172.21.15.19:0/1499994876 shutdown_connections 2024-09-19T08:57:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.498+0000 7f20d203d740 1 --2- 172.21.15.19:0/1499994876 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d111a84c90 0x55d111a870e0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.498+0000 7f20d203d740 1 --2- 172.21.15.19:0/1499994876 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d111a74780 0x55d111a805d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.498+0000 7f20b0ff9640 0 client.16656 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:57:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.498+0000 7f20d203d740 1 --2- 172.21.15.19:0/1499994876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d111a6f6f0 0x55d111a79600 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.498+0000 7f20d203d740 1 --2- 172.21.15.19:0/1499994876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d111a6edb0 0x55d111a790c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.498+0000 7f20d203d740 1 -- 172.21.15.19:0/1499994876 >> 172.21.15.19:0/1499994876 conn(0x55d111a66010 msgr2=0x55d111a67820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.498+0000 7f20d203d740 1 -- 172.21.15.19:0/1499994876 shutdown_connections 2024-09-19T08:57:50.501 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.498+0000 7f20d203d740 1 -- 172.21.15.19:0/1499994876 wait complete. 2024-09-19T08:57:50.502 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.498+0000 7f20d203d740 20 client.16656 trim_cache size 0 max 16384 2024-09-19T08:57:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.526+0000 7f20d203d740 1 Processor -- start 2024-09-19T08:57:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.526+0000 7f20d203d740 1 -- start start 2024-09-19T08:57:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.526+0000 7f20d203d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d111a6edb0 0x55d111a650b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.526+0000 7f20d203d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d111a6f6f0 0x55d111a80590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.526+0000 7f20d203d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d111a74780 0x55d111a8b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.526+0000 7f20d203d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f20c81af610 con 0x55d111a74780 2024-09-19T08:57:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.526+0000 7f20d203d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f20c81b1180 con 0x55d111a6f6f0 2024-09-19T08:57:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.526+0000 7f20d203d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f20c81afce0 con 0x55d111a6edb0 2024-09-19T08:57:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.527+0000 7f20cd84c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d111a74780 0x55d111a8b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:50.527 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.527+0000 7f20cd84c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d111a74780 0x55d111a8b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37328/0 (socket says 172.21.15.19:37328) 2024-09-19T08:57:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.527+0000 7f20cd84c640 1 -- 172.21.15.19:0/3850121005 learned_addr learned my addr 172.21.15.19:0/3850121005 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.527+0000 7f20cc84a640 1 --2- 172.21.15.19:0/3850121005 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d111a6f6f0 0x55d111a80590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.527+0000 7f20cd04b640 1 --2- 172.21.15.19:0/3850121005 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d111a6edb0 0x55d111a650b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.527+0000 7f20cd04b640 1 -- 172.21.15.19:0/3850121005 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d111a6f6f0 msgr2=0x55d111a80590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.527+0000 7f20cd04b640 1 --2- 172.21.15.19:0/3850121005 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d111a6f6f0 0x55d111a80590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.527+0000 7f20cd04b640 1 -- 172.21.15.19:0/3850121005 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d111a74780 msgr2=0x55d111a8b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.527+0000 7f20cd04b640 1 --2- 172.21.15.19:0/3850121005 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d111a74780 0x55d111a8b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.527+0000 7f20cd04b640 1 -- 172.21.15.19:0/3850121005 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d111a87760 con 0x55d111a6edb0 2024-09-19T08:57:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.527+0000 7f20cd84c640 1 --2- 172.21.15.19:0/3850121005 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d111a74780 0x55d111a8b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:57:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.527+0000 7f20cc84a640 1 --2- 172.21.15.19:0/3850121005 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d111a6f6f0 0x55d111a80590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:57:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.527+0000 7f20cd04b640 1 --2- 172.21.15.19:0/3850121005 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d111a6edb0 0x55d111a650b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x55d111a87960 tx=0x7f20c4005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99d25a629b1132f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:50.528 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.527+0000 7f20b2ffd640 1 -- 172.21.15.19:0/3850121005 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c4012110 con 0x55d111a6edb0 2024-09-19T08:57:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.527+0000 7f20b2ffd640 1 -- 172.21.15.19:0/3850121005 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20c4005020 con 0x55d111a6edb0 2024-09-19T08:57:50.529 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.527+0000 7f20b2ffd640 1 -- 172.21.15.19:0/3850121005 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c40122b0 con 0x55d111a6edb0 2024-09-19T08:57:50.532 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.528+0000 7f20d203d740 1 -- 172.21.15.19:0/3850121005 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d111a6edb0 msgr2=0x55d111a650b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:50.532 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.528+0000 7f20d203d740 1 --2- 172.21.15.19:0/3850121005 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d111a6edb0 0x55d111a650b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x55d111a87960 tx=0x7f20c4005f90 comp rx=0 tx=0).stop 2024-09-19T08:57:50.532 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.528+0000 7f20d203d740 1 -- 172.21.15.19:0/3850121005 shutdown_connections 2024-09-19T08:57:50.532 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.528+0000 7f20d203d740 1 --2- 172.21.15.19:0/3850121005 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d111a74780 0x55d111a8b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.533 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.528+0000 7f20d203d740 1 --2- 172.21.15.19:0/3850121005 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d111a6f6f0 0x55d111a80590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.533 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.528+0000 7f20d203d740 1 --2- 172.21.15.19:0/3850121005 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d111a6edb0 0x55d111a650b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.533 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.528+0000 7f20d203d740 1 -- 172.21.15.19:0/3850121005 >> 172.21.15.19:0/3850121005 conn(0x55d111a66010 msgr2=0x55d111a649a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:50.533 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.528+0000 7f20d203d740 1 -- 172.21.15.19:0/3850121005 shutdown_connections 2024-09-19T08:57:50.533 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.528+0000 7f20d203d740 1 -- 172.21.15.19:0/3850121005 wait complete. 2024-09-19T08:57:50.533 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.529+0000 7f20d203d740 1 -- start start 2024-09-19T08:57:50.533 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.529+0000 7f20d203d740 1 Processor -- start 2024-09-19T08:57:50.533 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.529+0000 7f20d203d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d111a6edb0 0x55d111a7ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:50.533 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.529+0000 7f20d203d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d111a6f6f0 0x55d111a7e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:50.533 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.529+0000 7f20d203d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d111a74780 0x55d111a7f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:50.533 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.529+0000 7f20d203d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f20c81b0ab0 con 0x55d111a74780 2024-09-19T08:57:50.533 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.529+0000 7f20d203d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f20c81b03e0 con 0x55d111a6edb0 2024-09-19T08:57:50.533 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.529+0000 7f20d203d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f20c81ad5f0 con 0x55d111a6f6f0 2024-09-19T08:57:50.534 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.529+0000 7f20d203d740 10 client.0 _ll_register_callbacks cb 0x7f20b80097b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:50.534 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.529+0000 7f20cd04b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d111a6edb0 0x55d111a7ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:50.534 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.529+0000 7f20cd04b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d111a6edb0 0x55d111a7ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:35006/0 (socket says 172.21.15.19:35006) 2024-09-19T08:57:50.534 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.529+0000 7f20cd04b640 1 -- 172.21.15.19:0/967374490 learned_addr learned my addr 172.21.15.19:0/967374490 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:50.534 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.529+0000 7f20cd84c640 1 --2- 172.21.15.19:0/967374490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d111a74780 0x55d111a7f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:50.534 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.530+0000 7f20cc84a640 1 --2- 172.21.15.19:0/967374490 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d111a6f6f0 0x55d111a7e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:50.534 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.530+0000 7f20cd04b640 1 -- 172.21.15.19:0/967374490 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d111a6f6f0 msgr2=0x55d111a7e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:50.534 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.530+0000 7f20cd04b640 1 --2- 172.21.15.19:0/967374490 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d111a6f6f0 0x55d111a7e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.534 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.530+0000 7f20cd04b640 1 -- 172.21.15.19:0/967374490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d111a74780 msgr2=0x55d111a7f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:50.534 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.530+0000 7f20cd04b640 1 --2- 172.21.15.19:0/967374490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d111a74780 0x55d111a7f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:50.534 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.530+0000 7f20cd04b640 1 -- 172.21.15.19:0/967374490 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d111a7f920 con 0x55d111a6edb0 2024-09-19T08:57:50.534 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.530+0000 7f20cc84a640 1 --2- 172.21.15.19:0/967374490 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d111a6f6f0 0x55d111a7e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:57:50.534 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.530+0000 7f20cd04b640 1 --2- 172.21.15.19:0/967374490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d111a6edb0 0x55d111a7ddc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f20c4000c00 tx=0x7f20c4012b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4367299f461fb0b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:50.534 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.530+0000 7f20b0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T08:57:50.535 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.530+0000 7f20b0ff9640 1 -- 172.21.15.19:0/967374490 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c40053d0 con 0x55d111a6edb0 2024-09-19T08:57:50.535 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.530+0000 7f20d203d740 1 -- 172.21.15.19:0/967374490 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20c4005020 con 0x55d111a6edb0 2024-09-19T08:57:50.535 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.530+0000 7f20b0ff9640 1 -- 172.21.15.19:0/967374490 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f20c4005570 con 0x55d111a6edb0 2024-09-19T08:57:50.535 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.531+0000 7f20b0ff9640 1 -- 172.21.15.19:0/967374490 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f20c403b050 con 0x55d111a6edb0 2024-09-19T08:57:50.535 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.531+0000 7f20d203d740 10 client.26174 fetch_fsmap learned FSMap version 33 2024-09-19T08:57:50.535 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.531+0000 7f20d203d740 1 -- 172.21.15.19:0/967374490 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55d111aefa70 con 0x55d111a6edb0 2024-09-19T08:57:50.535 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.531+0000 7f20b0ff9640 1 -- 172.21.15.19:0/967374490 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f20c4004ba0 con 0x55d111a6edb0 2024-09-19T08:57:50.535 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.531+0000 7f20b0ff9640 1 -- 172.21.15.19:0/967374490 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7f20c40298a0 con 0x55d111a6edb0 2024-09-19T08:57:50.535 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.531+0000 7f20d203d740 10 client.26174 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:57:50.535 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.531+0000 7f20d203d740 10 client.26174 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:57:50.535 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.531+0000 7f20d203d740 20 client.26174 populate_metadata read hostname 'smithi019' 2024-09-19T08:57:50.535 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.531+0000 7f20d203d740 1 --2- 172.21.15.19:0/967374490 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d111af0400 0x55d111af2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:50.535 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.531+0000 7f20d203d740 4 client.26174 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:57:50.536 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.531+0000 7f20d203d740 1 -- 172.21.15.19:0/967374490 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f20c4005020 con 0x55d111af0400 2024-09-19T08:57:50.536 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.531+0000 7f20cc84a640 1 --2- 172.21.15.19:0/967374490 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d111af0400 0x55d111af2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:50.536 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.532+0000 7f20b0ff9640 10 client.26174 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:57:50.536 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:50.532+0000 7f20cc84a640 1 --2- 172.21.15.19:0/967374490 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d111af0400 0x55d111af2820 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f92388bbb3418c09 server_cookie=9781490873c0dce8 in_seq=0 out_seq=0 2024-09-19T08:57:50.537 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'a8cb4dbc', total seconds elapsed: 53.0 2024-09-19T08:57:50.537 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.8 2024-09-19T08:57:50.537 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:57:50.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:50 smithi019 ceph-mon[30976]: scrub summary: idle 2024-09-19T08:57:50.849 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:57:50.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:50 smithi155 ceph-mon[34921]: scrub summary: idle 2024-09-19T08:57:50.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:50 smithi203 ceph-mon[35450]: scrub summary: idle 2024-09-19T08:57:51.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.337+0000 7f1bc562a640 1 -- 172.21.15.19:0/3714333187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bc0102d30 msgr2=0x7f1bc0103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:51.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.337+0000 7f1bc562a640 1 --2- 172.21.15.19:0/3714333187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bc0102d30 0x7f1bc0103110 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0009930 tx=0x7f1bb002a420 comp rx=0 tx=0).stop 2024-09-19T08:57:51.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.338+0000 7f1bc562a640 1 -- 172.21.15.19:0/3714333187 shutdown_connections 2024-09-19T08:57:51.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.338+0000 7f1bc562a640 1 --2- 172.21.15.19:0/3714333187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1bc01082a0 0x7f1bc010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:51.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.338+0000 7f1bc562a640 1 --2- 172.21.15.19:0/3714333187 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1bc01036e0 0x7f1bc0107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:51.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.338+0000 7f1bc562a640 1 --2- 172.21.15.19:0/3714333187 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bc0102d30 0x7f1bc0103110 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:51.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.338+0000 7f1bc562a640 1 -- 172.21.15.19:0/3714333187 >> 172.21.15.19:0/3714333187 conn(0x7f1bc00fc7d0 msgr2=0x7f1bc00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:51.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.338+0000 7f1bc562a640 1 -- 172.21.15.19:0/3714333187 shutdown_connections 2024-09-19T08:57:51.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.338+0000 7f1bc562a640 1 -- 172.21.15.19:0/3714333187 wait complete. 2024-09-19T08:57:51.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.338+0000 7f1bc562a640 1 Processor -- start 2024-09-19T08:57:51.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.339+0000 7f1bc562a640 1 -- start start 2024-09-19T08:57:51.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.339+0000 7f1bc562a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1bc0102d30 0x7f1bc01985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:51.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.339+0000 7f1bc562a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1bc01036e0 0x7f1bc0198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:51.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.339+0000 7f1bc562a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bc01082a0 0x7f1bc019ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:51.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.339+0000 7f1bc562a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc01120a0 con 0x7f1bc01082a0 2024-09-19T08:57:51.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.339+0000 7f1bc562a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc0111f20 con 0x7f1bc0102d30 2024-09-19T08:57:51.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.339+0000 7f1bc562a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc0112220 con 0x7f1bc01036e0 2024-09-19T08:57:51.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.339+0000 7f1bbf7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bc01082a0 0x7f1bc019ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:51.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.339+0000 7f1bbeffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1bc0102d30 0x7f1bc01985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:51.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.339+0000 7f1bbf7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bc01082a0 0x7f1bc019ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37356/0 (socket says 172.21.15.19:37356) 2024-09-19T08:57:51.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.339+0000 7f1bbf7fe640 1 -- 172.21.15.19:0/2606191205 learned_addr learned my addr 172.21.15.19:0/2606191205 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:51.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.339+0000 7f1bbe7fc640 1 --2- 172.21.15.19:0/2606191205 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1bc01036e0 0x7f1bc0198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:51.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.339+0000 7f1bbeffd640 1 -- 172.21.15.19:0/2606191205 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1bc01036e0 msgr2=0x7f1bc0198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:51.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.340+0000 7f1bbeffd640 1 --2- 172.21.15.19:0/2606191205 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1bc01036e0 0x7f1bc0198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:51.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.340+0000 7f1bbeffd640 1 -- 172.21.15.19:0/2606191205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bc01082a0 msgr2=0x7f1bc019ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:51.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.340+0000 7f1bbeffd640 1 --2- 172.21.15.19:0/2606191205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bc01082a0 0x7f1bc019ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:51.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.340+0000 7f1bbeffd640 1 -- 172.21.15.19:0/2606191205 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc019d570 con 0x7f1bc0102d30 2024-09-19T08:57:51.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.340+0000 7f1bbe7fc640 1 --2- 172.21.15.19:0/2606191205 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1bc01036e0 0x7f1bc0198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:57:51.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.340+0000 7f1bbeffd640 1 --2- 172.21.15.19:0/2606191205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1bc0102d30 0x7f1bc01985c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0005940 tx=0x7f1bb00040c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:51.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.340+0000 7f1bb7fff640 1 -- 172.21.15.19:0/2606191205 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb003f070 con 0x7f1bc0102d30 2024-09-19T08:57:51.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.340+0000 7f1bc562a640 1 -- 172.21.15.19:0/2606191205 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bc019d800 con 0x7f1bc0102d30 2024-09-19T08:57:51.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.340+0000 7f1bb7fff640 1 -- 172.21.15.19:0/2606191205 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1bb00044c0 con 0x7f1bc0102d30 2024-09-19T08:57:51.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.340+0000 7f1bb7fff640 1 -- 172.21.15.19:0/2606191205 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb0035070 con 0x7f1bc0102d30 2024-09-19T08:57:51.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.340+0000 7f1bc562a640 1 -- 172.21.15.19:0/2606191205 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bc01008c0 con 0x7f1bc0102d30 2024-09-19T08:57:51.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.341+0000 7f1bc562a640 1 -- 172.21.15.19:0/2606191205 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bc006a850 con 0x7f1bc0102d30 2024-09-19T08:57:51.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.343+0000 7f1bb7fff640 1 -- 172.21.15.19:0/2606191205 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f1bb003b460 con 0x7f1bc0102d30 2024-09-19T08:57:51.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.343+0000 7f1bb7fff640 1 --2- 172.21.15.19:0/2606191205 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1bac0a3240 0x7f1bac0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:51.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.343+0000 7f1bb7fff640 1 -- 172.21.15.19:0/2606191205 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1bb00f00d0 con 0x7f1bc0102d30 2024-09-19T08:57:51.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.343+0000 7f1bbe7fc640 1 --2- 172.21.15.19:0/2606191205 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1bac0a3240 0x7f1bac0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:51.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.344+0000 7f1bbe7fc640 1 --2- 172.21.15.19:0/2606191205 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1bac0a3240 0x7f1bac0a5700 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1bc00fee70 tx=0x7f1ba8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:51.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.347+0000 7f1bb7fff640 1 -- 172.21.15.19:0/2606191205 <== mon.2 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1bb00bce00 con 0x7f1bc0102d30 2024-09-19T08:57:51.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.569+0000 7f1bc562a640 1 -- 172.21.15.19:0/2606191205 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1bc0103110 con 0x7f1bc0102d30 2024-09-19T08:57:51.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.574+0000 7f1bb7fff640 1 -- 172.21.15.19:0/2606191205 <== mon.2 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11984 (secure 0 0 0) 0x7f1bb00bc700 con 0x7f1bc0102d30 2024-09-19T08:57:51.574 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:57:51.574 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":33,"btime":"2024-09-19T08:55:57:276679+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2452068876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2452068876},{"type":"v1","addr":"172.21.15.19:6839","nonce":2452068876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T08:55:56.383946+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/2480841559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2480841559},{"type":"v1","addr":"172.21.15.155:6835","nonce":2480841559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24469,24490,24464,24463]},"id":1}]} 2024-09-19T08:57:51.575 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 33 2024-09-19T08:57:51.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.576+0000 7f1bc562a640 1 -- 172.21.15.19:0/2606191205 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1bac0a3240 msgr2=0x7f1bac0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:51.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.576+0000 7f1bc562a640 1 --2- 172.21.15.19:0/2606191205 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1bac0a3240 0x7f1bac0a5700 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f1bc00fee70 tx=0x7f1ba8005f90 comp rx=0 tx=0).stop 2024-09-19T08:57:51.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.576+0000 7f1bc562a640 1 -- 172.21.15.19:0/2606191205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1bc0102d30 msgr2=0x7f1bc01985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:51.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.576+0000 7f1bc562a640 1 --2- 172.21.15.19:0/2606191205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1bc0102d30 0x7f1bc01985c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0005940 tx=0x7f1bb00040c0 comp rx=0 tx=0).stop 2024-09-19T08:57:51.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.577+0000 7f1bc562a640 1 -- 172.21.15.19:0/2606191205 shutdown_connections 2024-09-19T08:57:51.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.577+0000 7f1bc562a640 1 --2- 172.21.15.19:0/2606191205 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1bac0a3240 0x7f1bac0a5700 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:51.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.577+0000 7f1bc562a640 1 --2- 172.21.15.19:0/2606191205 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1bc01036e0 0x7f1bc0198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:51.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.577+0000 7f1bc562a640 1 --2- 172.21.15.19:0/2606191205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1bc01082a0 0x7f1bc019ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:51.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.577+0000 7f1bc562a640 1 --2- 172.21.15.19:0/2606191205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1bc0102d30 0x7f1bc01985c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:51.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.577+0000 7f1bc562a640 1 -- 172.21.15.19:0/2606191205 >> 172.21.15.19:0/2606191205 conn(0x7f1bc00fc7d0 msgr2=0x7f1bc0105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:51.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.577+0000 7f1bc562a640 1 -- 172.21.15.19:0/2606191205 shutdown_connections 2024-09-19T08:57:51.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:51.577+0000 7f1bc562a640 1 -- 172.21.15.19:0/2606191205 wait complete. 2024-09-19T08:57:51.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:51 smithi155 ceph-mon[34921]: pgmap v506: 97 pgs: 97 active+clean; 34 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.4 MiB/s wr, 2.34k op/s 2024-09-19T08:57:51.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:51 smithi203 ceph-mon[35450]: pgmap v506: 97 pgs: 97 active+clean; 34 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.4 MiB/s wr, 2.34k op/s 2024-09-19T08:57:52.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:51 smithi019 ceph-mon[30976]: pgmap v506: 97 pgs: 97 active+clean; 34 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 1.4 MiB/s wr, 2.34k op/s 2024-09-19T08:57:52.245 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0' 2024-09-19T08:57:52.246 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db / --timeout 90 --expiration 149.8 --await-for 45.0 2024-09-19T08:57:52.515 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:57:52.893 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:52 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/2606191205' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:57:52.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:52 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/2606191205' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:57:52.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:52 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/2606191205' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:57:53.384 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:53.384+0000 7f20b0ff9640 1 -- 172.21.15.19:0/967374490 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f20c4005020 con 0x55d111af0400 2024-09-19T08:57:53.384 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:53.384+0000 7f20b0ff9640 10 client.26174 handle_command_reply: tid=0 2024-09-19T08:57:53.384 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:53.384+0000 7f20d203d740 1 client.26174 shutdown 2024-09-19T08:57:53.384 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:53.384+0000 7f20d203d740 1 -- 172.21.15.19:0/967374490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d111a6edb0 msgr2=0x55d111a7ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:53.384 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:53.384+0000 7f20d203d740 1 --2- 172.21.15.19:0/967374490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d111a6edb0 0x55d111a7ddc0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f20c4000c00 tx=0x7f20c4012b30 comp rx=0 tx=0).stop 2024-09-19T08:57:53.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:53.384+0000 7f20d203d740 1 -- 172.21.15.19:0/967374490 shutdown_connections 2024-09-19T08:57:53.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:53.384+0000 7f20d203d740 1 --2- 172.21.15.19:0/967374490 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d111af0400 0x55d111af2820 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:53.384+0000 7f20d203d740 1 --2- 172.21.15.19:0/967374490 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d111a6f6f0 0x55d111a7e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:53.384+0000 7f20d203d740 1 --2- 172.21.15.19:0/967374490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d111a74780 0x55d111a7f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:53.384+0000 7f20d203d740 1 --2- 172.21.15.19:0/967374490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d111a6edb0 0x55d111a7ddc0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:53.384+0000 7f20d203d740 1 -- 172.21.15.19:0/967374490 >> 172.21.15.19:0/967374490 conn(0x55d111a66010 msgr2=0x55d111a651c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:53.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:53.384+0000 7f20b0ff9640 0 client.26174 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:57:53.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:53.384+0000 7f20d203d740 1 -- 172.21.15.19:0/967374490 shutdown_connections 2024-09-19T08:57:53.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:53.384+0000 7f20d203d740 1 -- 172.21.15.19:0/967374490 wait complete. 2024-09-19T08:57:53.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:53.385+0000 7f20d203d740 20 client.26174 trim_cache size 0 max 16384 2024-09-19T08:57:53.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T08:57:53.386 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T08:57:53.386 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T08:57:53.386 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T08:57:53.387 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:53.388+0000 7f20cf2af640 1 -- 172.21.15.19:0/578381098 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f20b40a3370 msgr2=0x7f20b40a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:53.387 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:53.388+0000 7f20cf2af640 1 --2- 172.21.15.19:0/578381098 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f20b40a3370 0x7f20b40a5830 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f20c0023000 tx=0x7f20c0024000 comp rx=0 tx=0).stop 2024-09-19T08:57:53.387 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:53.388+0000 7f20cf2af640 1 -- 172.21.15.19:0/578381098 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20c8104f90 msgr2=0x7f20c80710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:53.388 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:53.388+0000 7f20cf2af640 1 --2- 172.21.15.19:0/578381098 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20c8104f90 0x7f20c80710e0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f20b80305b0 tx=0x7f20b8033d90 comp rx=0 tx=0).stop 2024-09-19T08:57:53.388 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:53.388+0000 7f20cf2af640 1 -- 172.21.15.19:0/578381098 shutdown_connections 2024-09-19T08:57:53.388 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:53.388+0000 7f20cf2af640 1 --2- 172.21.15.19:0/578381098 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f20b40a3370 0x7f20b40a5830 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.388 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:53.388+0000 7f20cf2af640 1 --2- 172.21.15.19:0/578381098 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f20c81078c0 0x7f20c81a7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.388 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:53.388+0000 7f20cf2af640 1 --2- 172.21.15.19:0/578381098 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f20c8104f90 0x7f20c80710e0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.388 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:53.388+0000 7f20cf2af640 1 --2- 172.21.15.19:0/578381098 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f20c8102660 0x7f20c8070ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.388 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:53.388+0000 7f20cf2af640 1 -- 172.21.15.19:0/578381098 >> 172.21.15.19:0/578381098 conn(0x7f20c80fc1e0 msgr2=0x7f20c8102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:53.388 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:53.388+0000 7f20cf2af640 1 -- 172.21.15.19:0/578381098 shutdown_connections 2024-09-19T08:57:53.388 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:57:53.388+0000 7f20cf2af640 1 -- 172.21.15.19:0/578381098 wait complete. 2024-09-19T08:57:53.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.990+0000 7feb678d1640 1 -- 172.21.15.19:0/3960498111 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb601009b0 msgr2=0x7feb60100d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:53.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.990+0000 7feb678d1640 1 --2- 172.21.15.19:0/3960498111 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb601009b0 0x7feb60100d90 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7feb5c009900 tx=0x7feb5c02a410 comp rx=0 tx=0).stop 2024-09-19T08:57:53.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.990+0000 7feb678d1640 1 -- 172.21.15.19:0/3960498111 shutdown_connections 2024-09-19T08:57:53.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.990+0000 7feb678d1640 1 --2- 172.21.15.19:0/3960498111 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb60101360 0x7feb6010df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.990+0000 7feb678d1640 1 --2- 172.21.15.19:0/3960498111 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb6010e4d0 0x7feb601108e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.990+0000 7feb678d1640 1 --2- 172.21.15.19:0/3960498111 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb601009b0 0x7feb60100d90 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.990+0000 7feb678d1640 1 -- 172.21.15.19:0/3960498111 >> 172.21.15.19:0/3960498111 conn(0x7feb600fc7d0 msgr2=0x7feb600febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:53.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.990+0000 7feb678d1640 1 -- 172.21.15.19:0/3960498111 shutdown_connections 2024-09-19T08:57:53.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.990+0000 7feb678d1640 1 -- 172.21.15.19:0/3960498111 wait complete. 2024-09-19T08:57:53.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.991+0000 7feb678d1640 1 Processor -- start 2024-09-19T08:57:53.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.991+0000 7feb678d1640 1 -- start start 2024-09-19T08:57:53.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.991+0000 7feb678d1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb601009b0 0x7feb6019a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:53.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.991+0000 7feb678d1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb60101360 0x7feb6019ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:53.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.991+0000 7feb678d1640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb6010e4d0 0x7feb6019efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:53.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.991+0000 7feb678d1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7feb60114210 con 0x7feb60101360 2024-09-19T08:57:53.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.991+0000 7feb678d1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7feb60114090 con 0x7feb601009b0 2024-09-19T08:57:53.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.991+0000 7feb678d1640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7feb60114390 con 0x7feb6010e4d0 2024-09-19T08:57:53.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.992+0000 7feb64e6c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb60101360 0x7feb6019ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:53.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.992+0000 7feb64e6c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb60101360 0x7feb6019ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37370/0 (socket says 172.21.15.19:37370) 2024-09-19T08:57:53.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.992+0000 7feb64e6c640 1 -- 172.21.15.19:0/2464691910 learned_addr learned my addr 172.21.15.19:0/2464691910 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:53.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.992+0000 7feb6566d640 1 --2- 172.21.15.19:0/2464691910 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb601009b0 0x7feb6019a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:53.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.992+0000 7feb65e6e640 1 --2- 172.21.15.19:0/2464691910 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb6010e4d0 0x7feb6019efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:53.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.992+0000 7feb64e6c640 1 -- 172.21.15.19:0/2464691910 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb6010e4d0 msgr2=0x7feb6019efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:53.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.992+0000 7feb64e6c640 1 --2- 172.21.15.19:0/2464691910 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb6010e4d0 0x7feb6019efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.992+0000 7feb64e6c640 1 -- 172.21.15.19:0/2464691910 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb601009b0 msgr2=0x7feb6019a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.992+0000 7feb64e6c640 1 --2- 172.21.15.19:0/2464691910 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb601009b0 0x7feb6019a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.992+0000 7feb64e6c640 1 -- 172.21.15.19:0/2464691910 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb6019f6a0 con 0x7feb60101360 2024-09-19T08:57:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.992+0000 7feb64e6c640 1 --2- 172.21.15.19:0/2464691910 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb60101360 0x7feb6019ac30 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7feb5000d950 tx=0x7feb5000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.992+0000 7feb567fc640 1 -- 172.21.15.19:0/2464691910 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb50017030 con 0x7feb60101360 2024-09-19T08:57:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.992+0000 7feb567fc640 1 -- 172.21.15.19:0/2464691910 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb50004020 con 0x7feb60101360 2024-09-19T08:57:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.992+0000 7feb567fc640 1 -- 172.21.15.19:0/2464691910 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb500047a0 con 0x7feb60101360 2024-09-19T08:57:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.992+0000 7feb678d1640 1 -- 172.21.15.19:0/2464691910 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb6019f990 con 0x7feb60101360 2024-09-19T08:57:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.992+0000 7feb678d1640 1 -- 172.21.15.19:0/2464691910 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb601a7270 con 0x7feb60101360 2024-09-19T08:57:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.995+0000 7feb567fc640 1 -- 172.21.15.19:0/2464691910 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7feb500041d0 con 0x7feb60101360 2024-09-19T08:57:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.995+0000 7feb69caa740 1 Processor -- start 2024-09-19T08:57:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.995+0000 7feb69caa740 1 -- start start 2024-09-19T08:57:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.996+0000 7feb69caa740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599e4837f70 0x5599e4838350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.996+0000 7feb69caa740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5599e4838890 0x5599e4842c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.996+0000 7feb69caa740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599e4843150 0x5599e4845540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:53.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.996+0000 7feb69caa740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5599e47952a0 con 0x5599e4838890 2024-09-19T08:57:53.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.996+0000 7feb69caa740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5599e473cb10 con 0x5599e4843150 2024-09-19T08:57:53.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.996+0000 7feb69caa740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5599e4791260 con 0x5599e4837f70 2024-09-19T08:57:53.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.996+0000 7feb567fc640 1 --2- 172.21.15.19:0/2464691910 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7feb4c0a32c0 0x7feb4c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:53.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.996+0000 7feb65e6e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599e4837f70 0x5599e4838350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:53.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.996+0000 7feb64e6c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599e4843150 0x5599e4845540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:53.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.996+0000 7feb65e6e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599e4837f70 0x5599e4838350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:59350/0 (socket says 172.21.15.19:59350) 2024-09-19T08:57:53.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.996+0000 7feb65e6e640 1 -- 172.21.15.19:0/3048679956 learned_addr learned my addr 172.21.15.19:0/3048679956 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:53.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.996+0000 7feb6566d640 1 --2- 172.21.15.19:0/3048679956 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5599e4838890 0x5599e4842c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:53.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.996+0000 7feb65e6e640 1 --2- 172.21.15.19:0/2464691910 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7feb4c0a32c0 0x7feb4c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:53.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.996+0000 7feb567fc640 1 -- 172.21.15.19:0/2464691910 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7feb500cf1c0 con 0x7feb60101360 2024-09-19T08:57:53.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.996+0000 7feb64e6c640 1 -- 172.21.15.19:0/3048679956 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599e4837f70 msgr2=0x5599e4838350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:53.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.996+0000 7feb64e6c640 1 --2- 172.21.15.19:0/3048679956 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599e4837f70 0x5599e4838350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.996+0000 7feb64e6c640 1 -- 172.21.15.19:0/3048679956 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5599e4838890 msgr2=0x5599e4842c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:53.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.996+0000 7feb64e6c640 1 --2- 172.21.15.19:0/3048679956 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5599e4838890 0x5599e4842c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.996+0000 7feb64e6c640 1 -- 172.21.15.19:0/3048679956 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599e4506b90 con 0x5599e4843150 2024-09-19T08:57:53.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.996+0000 7feb65e6e640 1 --2- 172.21.15.19:0/3048679956 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599e4837f70 0x5599e4838350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:57:53.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.996+0000 7feb64e6c640 1 --2- 172.21.15.19:0/3048679956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599e4843150 0x5599e4845540 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7feb500ccd20 tx=0x7feb50096250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9a84c0b69933d2a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:53.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.997+0000 7feb65e6e640 1 --2- 172.21.15.19:0/2464691910 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7feb4c0a32c0 0x7feb4c0a5780 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7feb580099e0 tx=0x7feb58009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:53.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.997+0000 7feb4b7fe640 1 -- 172.21.15.19:0/3048679956 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5009b150 con 0x5599e4843150 2024-09-19T08:57:53.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.997+0000 7feb4b7fe640 1 -- 172.21.15.19:0/3048679956 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb5009bef0 con 0x5599e4843150 2024-09-19T08:57:53.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.997+0000 7feb4b7fe640 1 -- 172.21.15.19:0/3048679956 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb500a3fd0 con 0x5599e4843150 2024-09-19T08:57:53.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.997+0000 7feb69caa740 1 -- 172.21.15.19:0/3048679956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599e4843150 msgr2=0x5599e4845540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:53.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.997+0000 7feb69caa740 1 --2- 172.21.15.19:0/3048679956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599e4843150 0x5599e4845540 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7feb500ccd20 tx=0x7feb50096250 comp rx=0 tx=0).stop 2024-09-19T08:57:53.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.997+0000 7feb69caa740 1 -- 172.21.15.19:0/3048679956 shutdown_connections 2024-09-19T08:57:53.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.998+0000 7feb69caa740 1 --2- 172.21.15.19:0/3048679956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599e4843150 0x5599e4845540 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.998+0000 7feb69caa740 1 --2- 172.21.15.19:0/3048679956 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5599e4838890 0x5599e4842c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.998+0000 7feb69caa740 1 --2- 172.21.15.19:0/3048679956 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599e4837f70 0x5599e4838350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.998+0000 7feb69caa740 1 -- 172.21.15.19:0/3048679956 >> 172.21.15.19:0/3048679956 conn(0x5599e4834500 msgr2=0x5599e48348e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:53.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.998+0000 7feb69caa740 1 -- 172.21.15.19:0/3048679956 shutdown_connections 2024-09-19T08:57:53.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.998+0000 7feb69caa740 1 -- 172.21.15.19:0/3048679956 wait complete. 2024-09-19T08:57:53.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.998+0000 7feb69caa740 1 -- start start 2024-09-19T08:57:53.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.998+0000 7feb69caa740 1 Processor -- start 2024-09-19T08:57:53.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.999+0000 7feb69caa740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599e4837f70 0x5599e4840070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:53.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.999+0000 7feb69caa740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5599e4838890 0x5599e48405b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:53.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.999+0000 7feb69caa740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599e4843150 0x5599e4840af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:53.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.999+0000 7feb69caa740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5599e4845d20 con 0x5599e4838890 2024-09-19T08:57:53.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.999+0000 7feb69caa740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5599e471d6e0 con 0x5599e4843150 2024-09-19T08:57:53.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.999+0000 7feb69caa740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5599e4845ea0 con 0x5599e4837f70 2024-09-19T08:57:53.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.999+0000 7feb69caa740 10 client.0 _ll_register_callbacks cb 0x5599e4741a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:53.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.999+0000 7feb64e6c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5599e4838890 0x5599e48405b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:53.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.999+0000 7feb64e6c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5599e4838890 0x5599e48405b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37384/0 (socket says 172.21.15.19:37384) 2024-09-19T08:57:53.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.999+0000 7feb65e6e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599e4843150 0x5599e4840af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:53.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.999+0000 7feb64e6c640 1 -- 172.21.15.19:0/1957880342 learned_addr learned my addr 172.21.15.19:0/1957880342 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:53.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.999+0000 7feb6566d640 1 --2- 172.21.15.19:0/1957880342 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599e4837f70 0x5599e4840070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:53.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.999+0000 7feb64e6c640 1 -- 172.21.15.19:0/1957880342 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599e4837f70 msgr2=0x5599e4840070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:53.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.999+0000 7feb64e6c640 1 --2- 172.21.15.19:0/1957880342 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599e4837f70 0x5599e4840070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.999+0000 7feb64e6c640 1 -- 172.21.15.19:0/1957880342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599e4843150 msgr2=0x5599e4840af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:53.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.999+0000 7feb64e6c640 1 --2- 172.21.15.19:0/1957880342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599e4843150 0x5599e4840af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.999+0000 7feb64e6c640 1 -- 172.21.15.19:0/1957880342 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599e484f240 con 0x5599e4838890 2024-09-19T08:57:53.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.999+0000 7feb65e6e640 1 --2- 172.21.15.19:0/1957880342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599e4843150 0x5599e4840af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:57:53.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.999+0000 7feb64e6c640 1 --2- 172.21.15.19:0/1957880342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5599e4838890 0x5599e48405b0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7feb5009b4f0 tx=0x7feb500a4550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ecc171656d097d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:53.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:52.999+0000 7feb48ff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:57:53.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.000+0000 7feb48ff9640 1 -- 172.21.15.19:0/1957880342 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb500b4060 con 0x5599e4838890 2024-09-19T08:57:53.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.000+0000 7feb48ff9640 1 -- 172.21.15.19:0/1957880342 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7feb500a41d0 con 0x5599e4838890 2024-09-19T08:57:53.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.000+0000 7feb69caa740 1 -- 172.21.15.19:0/1957880342 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb5009bef0 con 0x5599e4838890 2024-09-19T08:57:53.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.000+0000 7feb48ff9640 1 -- 172.21.15.19:0/1957880342 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7feb5009fba0 con 0x5599e4838890 2024-09-19T08:57:53.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.000+0000 7feb69caa740 10 client.16680 fetch_fsmap learned FSMap version 33 2024-09-19T08:57:53.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.000+0000 7feb69caa740 1 -- 172.21.15.19:0/1957880342 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5599e4845d20 con 0x5599e4838890 2024-09-19T08:57:53.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.000+0000 7feb48ff9640 1 -- 172.21.15.19:0/1957880342 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb5009bef0 con 0x5599e4838890 2024-09-19T08:57:53.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.000+0000 7feb48ff9640 1 -- 172.21.15.19:0/1957880342 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7feb5009ac40 con 0x5599e4838890 2024-09-19T08:57:53.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.000+0000 7feb69caa740 10 client.16680 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:57:53.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.000+0000 7feb69caa740 10 client.16680 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T08:57:53.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.000+0000 7feb69caa740 20 client.16680 populate_metadata read hostname 'smithi019' 2024-09-19T08:57:53.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.000+0000 7feb69caa740 1 --2- 172.21.15.19:0/1957880342 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5599e4852d50 0x5599e4855140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:53.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.000+0000 7feb69caa740 4 client.16680 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:57:53.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.000+0000 7feb69caa740 1 -- 172.21.15.19:0/1957880342 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599e47a29d0 con 0x5599e4852d50 2024-09-19T08:57:53.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.001+0000 7feb6566d640 1 --2- 172.21.15.19:0/1957880342 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5599e4852d50 0x5599e4855140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:53.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.001+0000 7feb6566d640 1 --2- 172.21.15.19:0/1957880342 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5599e4852d50 0x5599e4855140 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be778beebb2c90a6 server_cookie=4df948fd9a6a285b in_seq=0 out_seq=0 2024-09-19T08:57:53.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.001+0000 7feb48ff9640 10 client.16680 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:57:53.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.005+0000 7feb48ff9640 1 -- 172.21.15.19:0/1957880342 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5599e47a29d0 con 0x5599e4852d50 2024-09-19T08:57:53.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.005+0000 7feb48ff9640 10 client.16680 handle_command_reply: tid=0 2024-09-19T08:57:53.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.005+0000 7feb69caa740 1 client.16680 shutdown 2024-09-19T08:57:53.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.005+0000 7feb69caa740 1 -- 172.21.15.19:0/1957880342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5599e4838890 msgr2=0x5599e48405b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:53.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.005+0000 7feb69caa740 1 --2- 172.21.15.19:0/1957880342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5599e4838890 0x5599e48405b0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7feb5009b4f0 tx=0x7feb500a4550 comp rx=0 tx=0).stop 2024-09-19T08:57:53.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.005+0000 7feb69caa740 1 -- 172.21.15.19:0/1957880342 shutdown_connections 2024-09-19T08:57:53.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.005+0000 7feb69caa740 1 --2- 172.21.15.19:0/1957880342 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5599e4852d50 0x5599e4855140 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.006+0000 7feb48ff9640 0 client.16680 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:57:53.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.006+0000 7feb69caa740 1 --2- 172.21.15.19:0/1957880342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599e4843150 0x5599e4840af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.006+0000 7feb69caa740 1 --2- 172.21.15.19:0/1957880342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5599e4838890 0x5599e48405b0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.006+0000 7feb69caa740 1 --2- 172.21.15.19:0/1957880342 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599e4837f70 0x5599e4840070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.006+0000 7feb69caa740 1 -- 172.21.15.19:0/1957880342 >> 172.21.15.19:0/1957880342 conn(0x5599e4834500 msgr2=0x5599e482ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:53.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.006+0000 7feb69caa740 1 -- 172.21.15.19:0/1957880342 shutdown_connections 2024-09-19T08:57:53.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.006+0000 7feb69caa740 1 -- 172.21.15.19:0/1957880342 wait complete. 2024-09-19T08:57:53.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.006+0000 7feb69caa740 20 client.16680 trim_cache size 0 max 16384 2024-09-19T08:57:53.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.024+0000 7feb69caa740 1 Processor -- start 2024-09-19T08:57:53.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.024+0000 7feb69caa740 1 -- start start 2024-09-19T08:57:53.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.024+0000 7feb69caa740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599e4837f70 0x5599e482acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:53.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.024+0000 7feb69caa740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5599e4838890 0x5599e4840940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:53.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.024+0000 7feb69caa740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599e4843150 0x5599e485a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:53.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.024+0000 7feb69caa740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7feb601ab2d0 con 0x5599e4838890 2024-09-19T08:57:53.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.024+0000 7feb69caa740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7feb601ace40 con 0x5599e4837f70 2024-09-19T08:57:53.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.024+0000 7feb69caa740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7feb601ab9a0 con 0x5599e4843150 2024-09-19T08:57:53.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.024+0000 7feb64e6c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5599e4838890 0x5599e4840940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:53.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.024+0000 7feb64e6c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5599e4838890 0x5599e4840940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37390/0 (socket says 172.21.15.19:37390) 2024-09-19T08:57:53.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.024+0000 7feb64e6c640 1 -- 172.21.15.19:0/1705809923 learned_addr learned my addr 172.21.15.19:0/1705809923 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:53.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.024+0000 7feb6566d640 1 --2- 172.21.15.19:0/1705809923 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599e4837f70 0x5599e482acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:53.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.024+0000 7feb64e6c640 1 -- 172.21.15.19:0/1705809923 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599e4843150 msgr2=0x5599e485a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:53.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.024+0000 7feb64e6c640 1 --2- 172.21.15.19:0/1705809923 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599e4843150 0x5599e485a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.024+0000 7feb64e6c640 1 -- 172.21.15.19:0/1705809923 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599e4837f70 msgr2=0x5599e482acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:53.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.024+0000 7feb64e6c640 1 --2- 172.21.15.19:0/1705809923 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599e4837f70 0x5599e482acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.024+0000 7feb64e6c640 1 -- 172.21.15.19:0/1705809923 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599e4834330 con 0x5599e4838890 2024-09-19T08:57:53.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.025+0000 7feb64e6c640 1 --2- 172.21.15.19:0/1705809923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5599e4838890 0x5599e4840940 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7feb500a3f30 tx=0x7feb50097540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e871a0c3562001ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:53.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.025+0000 7feb4affd640 1 -- 172.21.15.19:0/1705809923 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb500b4070 con 0x5599e4838890 2024-09-19T08:57:53.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.025+0000 7feb4affd640 1 -- 172.21.15.19:0/1705809923 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb5009bef0 con 0x5599e4838890 2024-09-19T08:57:53.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.025+0000 7feb4affd640 1 -- 172.21.15.19:0/1705809923 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5009ac40 con 0x5599e4838890 2024-09-19T08:57:53.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.026+0000 7feb69caa740 1 -- 172.21.15.19:0/1705809923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5599e4838890 msgr2=0x5599e4840940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:57:53.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.026+0000 7feb69caa740 1 --2- 172.21.15.19:0/1705809923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5599e4838890 0x5599e4840940 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7feb500a3f30 tx=0x7feb50097540 comp rx=0 tx=0).stop 2024-09-19T08:57:53.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.026+0000 7feb69caa740 1 -- 172.21.15.19:0/1705809923 shutdown_connections 2024-09-19T08:57:53.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.026+0000 7feb69caa740 1 --2- 172.21.15.19:0/1705809923 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599e4843150 0x5599e485a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.026+0000 7feb69caa740 1 --2- 172.21.15.19:0/1705809923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5599e4838890 0x5599e4840940 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.026+0000 7feb69caa740 1 --2- 172.21.15.19:0/1705809923 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599e4837f70 0x5599e482acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.026+0000 7feb69caa740 1 -- 172.21.15.19:0/1705809923 >> 172.21.15.19:0/1705809923 conn(0x5599e4834500 msgr2=0x5599e483f030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:57:53.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.026+0000 7feb69caa740 1 -- 172.21.15.19:0/1705809923 shutdown_connections 2024-09-19T08:57:53.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.026+0000 7feb69caa740 1 -- 172.21.15.19:0/1705809923 wait complete. 2024-09-19T08:57:53.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.026+0000 7feb69caa740 1 -- start start 2024-09-19T08:57:53.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.026+0000 7feb69caa740 1 Processor -- start 2024-09-19T08:57:53.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.027+0000 7feb69caa740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5599e4837f70 0x5599e484b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:53.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.027+0000 7feb69caa740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599e4838890 0x5599e4847990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:53.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.027+0000 7feb69caa740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599e4843150 0x5599e4847ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:53.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.027+0000 7feb69caa740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7feb601ac770 con 0x5599e4837f70 2024-09-19T08:57:53.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.027+0000 7feb69caa740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7feb601ac0a0 con 0x5599e4838890 2024-09-19T08:57:53.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.027+0000 7feb69caa740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7feb601a92b0 con 0x5599e4843150 2024-09-19T08:57:53.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.027+0000 7feb69caa740 10 client.0 _ll_register_callbacks cb 0x7feb50097a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:57:53.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.027+0000 7feb6566d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5599e4837f70 0x5599e484b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:53.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.027+0000 7feb6566d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5599e4837f70 0x5599e484b650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:37396/0 (socket says 172.21.15.19:37396) 2024-09-19T08:57:53.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.027+0000 7feb6566d640 1 -- 172.21.15.19:0/2494174754 learned_addr learned my addr 172.21.15.19:0/2494174754 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:57:53.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.027+0000 7feb64e6c640 1 --2- 172.21.15.19:0/2494174754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599e4838890 0x5599e4847990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:53.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.027+0000 7feb65e6e640 1 --2- 172.21.15.19:0/2494174754 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599e4843150 0x5599e4847ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:53.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.027+0000 7feb6566d640 1 -- 172.21.15.19:0/2494174754 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599e4843150 msgr2=0x5599e4847ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:53.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.027+0000 7feb6566d640 1 --2- 172.21.15.19:0/2494174754 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599e4843150 0x5599e4847ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.027+0000 7feb6566d640 1 -- 172.21.15.19:0/2494174754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599e4838890 msgr2=0x5599e4847990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:57:53.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.027+0000 7feb6566d640 1 --2- 172.21.15.19:0/2494174754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599e4838890 0x5599e4847990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:57:53.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.027+0000 7feb6566d640 1 -- 172.21.15.19:0/2494174754 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599e483ade0 con 0x5599e4837f70 2024-09-19T08:57:53.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.027+0000 7feb6566d640 1 --2- 172.21.15.19:0/2494174754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5599e4837f70 0x5599e484b650 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7feb5c02a930 tx=0x7feb5c031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7066ce851967beb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:57:53.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.027+0000 7feb48ff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:57:53.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.028+0000 7feb48ff9640 1 -- 172.21.15.19:0/2494174754 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5c035040 con 0x5599e4837f70 2024-09-19T08:57:53.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.028+0000 7feb48ff9640 1 -- 172.21.15.19:0/2494174754 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7feb5c004240 con 0x5599e4837f70 2024-09-19T08:57:53.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.028+0000 7feb69caa740 1 -- 172.21.15.19:0/2494174754 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb5009bef0 con 0x5599e4837f70 2024-09-19T08:57:53.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.028+0000 7feb48ff9640 1 -- 172.21.15.19:0/2494174754 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7feb5c004440 con 0x5599e4837f70 2024-09-19T08:57:53.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.028+0000 7feb69caa740 10 client.16686 fetch_fsmap learned FSMap version 33 2024-09-19T08:57:53.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.028+0000 7feb69caa740 1 -- 172.21.15.19:0/2494174754 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5599e48be3d0 con 0x5599e4837f70 2024-09-19T08:57:53.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.028+0000 7feb48ff9640 1 -- 172.21.15.19:0/2494174754 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feb5009bef0 con 0x5599e4837f70 2024-09-19T08:57:53.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.028+0000 7feb48ff9640 1 -- 172.21.15.19:0/2494174754 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 33) ==== 8366+0+0 (secure 0 0 0) 0x7feb5c03d750 con 0x5599e4837f70 2024-09-19T08:57:53.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.028+0000 7feb69caa740 10 client.16686 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T08:57:53.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.028+0000 7feb69caa740 10 client.16686 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T08:57:53.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.028+0000 7feb69caa740 20 client.16686 populate_metadata read hostname 'smithi019' 2024-09-19T08:57:53.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.028+0000 7feb69caa740 1 --2- 172.21.15.19:0/2494174754 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5599e4852d50 0x5599e48c0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:57:53.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.028+0000 7feb69caa740 4 client.16686 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}] 2024-09-19T08:57:53.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.028+0000 7feb69caa740 1 -- 172.21.15.19:0/2494174754 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 149.8, "await_for": 45.0}) -- 0x5599e479cd20 con 0x5599e4852d50 2024-09-19T08:57:53.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.028+0000 7feb64e6c640 1 --2- 172.21.15.19:0/2494174754 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5599e4852d50 0x5599e48c0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:57:53.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.029+0000 7feb64e6c640 1 --2- 172.21.15.19:0/2494174754 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5599e4852d50 0x5599e48c0bd0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=148a7700caef958 server_cookie=cee9e4fe7fcdd1cc in_seq=0 out_seq=0 2024-09-19T08:57:53.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:57:53.029+0000 7feb48ff9640 10 client.16686 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:57:53.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:53 smithi019 ceph-mon[30976]: pgmap v507: 97 pgs: 97 active+clean; 30 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 1.3 MiB/s wr, 3.05k op/s 2024-09-19T08:57:53.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:53 smithi155 ceph-mon[34921]: pgmap v507: 97 pgs: 97 active+clean; 30 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 1.3 MiB/s wr, 3.05k op/s 2024-09-19T08:57:53.986 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:53 smithi203 ceph-mon[35450]: pgmap v507: 97 pgs: 97 active+clean; 30 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 1.3 MiB/s wr, 3.05k op/s 2024-09-19T08:57:55.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:55 smithi155 ceph-mon[34921]: pgmap v508: 97 pgs: 97 active+clean; 21 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.5 MiB/s wr, 3.06k op/s 2024-09-19T08:57:55.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:55 smithi203 ceph-mon[35450]: pgmap v508: 97 pgs: 97 active+clean; 21 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.5 MiB/s wr, 3.06k op/s 2024-09-19T08:57:56.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:55 smithi019 ceph-mon[30976]: pgmap v508: 97 pgs: 97 active+clean; 21 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 1.5 MiB/s wr, 3.06k op/s 2024-09-19T08:57:57.874 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:57 smithi019 ceph-mon[30976]: pgmap v509: 97 pgs: 97 active+clean; 17 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 1.3 MiB/s wr, 3.05k op/s 2024-09-19T08:57:57.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:57 smithi155 ceph-mon[34921]: pgmap v509: 97 pgs: 97 active+clean; 17 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 1.3 MiB/s wr, 3.05k op/s 2024-09-19T08:57:57.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:57 smithi203 ceph-mon[35450]: pgmap v509: 97 pgs: 97 active+clean; 17 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 1.3 MiB/s wr, 3.05k op/s 2024-09-19T08:57:59.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:57:59 smithi155 ceph-mon[34921]: pgmap v510: 97 pgs: 97 active+clean; 7.3 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 1.6 MiB/s wr, 2.71k op/s 2024-09-19T08:57:59.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:57:59 smithi203 ceph-mon[35450]: pgmap v510: 97 pgs: 97 active+clean; 7.3 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 1.6 MiB/s wr, 2.71k op/s 2024-09-19T08:58:00.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:57:59 smithi019 ceph-mon[30976]: pgmap v510: 97 pgs: 97 active+clean; 7.3 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 1.6 MiB/s wr, 2.71k op/s 2024-09-19T08:58:01.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:01 smithi155 ceph-mon[34921]: pgmap v511: 97 pgs: 97 active+clean; 7.3 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 1.40k op/s 2024-09-19T08:58:01.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:01 smithi203 ceph-mon[35450]: pgmap v511: 97 pgs: 97 active+clean; 7.3 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 1.40k op/s 2024-09-19T08:58:02.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:01 smithi019 ceph-mon[30976]: pgmap v511: 97 pgs: 97 active+clean; 7.3 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 1.40k op/s 2024-09-19T08:58:02.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:02 smithi155 ceph-mon[34921]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T08:58:02.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:02 smithi203 ceph-mon[35450]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T08:58:03.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:02 smithi019 ceph-mon[30976]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T08:58:03.297 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:58:03.298 INFO:teuthology.orchestra.run.smithi019.stdout: "epoch": 34, 2024-09-19T08:58:03.298 INFO:teuthology.orchestra.run.smithi019.stdout: "leader": 24497, 2024-09-19T08:58:03.298 INFO:teuthology.orchestra.run.smithi019.stdout: "set_version": 22, 2024-09-19T08:58:03.298 INFO:teuthology.orchestra.run.smithi019.stdout: "sets": { 2024-09-19T08:58:03.298 INFO:teuthology.orchestra.run.smithi019.stdout: "c98ecb3a": { 2024-09-19T08:58:03.298 INFO:teuthology.orchestra.run.smithi019.stdout: "version": 22, 2024-09-19T08:58:03.298 INFO:teuthology.orchestra.run.smithi019.stdout: "age_ref": 0.0, 2024-09-19T08:58:03.298 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T08:58:03.298 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "QUIESCED", 2024-09-19T08:58:03.298 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T08:58:03.298 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T08:58:03.299 INFO:teuthology.orchestra.run.smithi019.stdout: "timeout": 90.0, 2024-09-19T08:58:03.299 INFO:teuthology.orchestra.run.smithi019.stdout: "expiration": 149.8, 2024-09-19T08:58:03.299 INFO:teuthology.orchestra.run.smithi019.stdout: "members": { 2024-09-19T08:58:03.299 INFO:teuthology.orchestra.run.smithi019.stdout: "file:/": { 2024-09-19T08:58:03.299 INFO:teuthology.orchestra.run.smithi019.stdout: "excluded": false, 2024-09-19T08:58:03.299 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T08:58:03.299 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "QUIESCED", 2024-09-19T08:58:03.299 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T08:58:03.299 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:58:03.299 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:58:03.299 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:58:03.299 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:58:03.299 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:58:03.299 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:58:03.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:03.296+0000 7feb48ff9640 1 -- 172.21.15.19:0/2494174754 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5599e479cd20 con 0x5599e4852d50 2024-09-19T08:58:03.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:03.296+0000 7feb48ff9640 10 client.16686 handle_command_reply: tid=0 2024-09-19T08:58:03.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:03.296+0000 7feb69caa740 1 client.16686 shutdown 2024-09-19T08:58:03.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:03.296+0000 7feb69caa740 1 -- 172.21.15.19:0/2494174754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5599e4837f70 msgr2=0x5599e484b650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:03.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:03.296+0000 7feb69caa740 1 --2- 172.21.15.19:0/2494174754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5599e4837f70 0x5599e484b650 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7feb5c02a930 tx=0x7feb5c031a50 comp rx=0 tx=0).stop 2024-09-19T08:58:03.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:03.296+0000 7feb69caa740 1 -- 172.21.15.19:0/2494174754 shutdown_connections 2024-09-19T08:58:03.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:03.296+0000 7feb69caa740 1 --2- 172.21.15.19:0/2494174754 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5599e4852d50 0x5599e48c0bd0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:03.296+0000 7feb69caa740 1 --2- 172.21.15.19:0/2494174754 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5599e4843150 0x5599e4847ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:03.296+0000 7feb69caa740 1 --2- 172.21.15.19:0/2494174754 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5599e4838890 0x5599e4847990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:03.296+0000 7feb69caa740 1 --2- 172.21.15.19:0/2494174754 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5599e4837f70 0x5599e484b650 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:03.296+0000 7feb48ff9640 0 client.16686 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:03.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:03.296+0000 7feb69caa740 1 -- 172.21.15.19:0/2494174754 >> 172.21.15.19:0/2494174754 conn(0x5599e4834500 msgr2=0x5599e484df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:03.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:03.296+0000 7feb69caa740 1 -- 172.21.15.19:0/2494174754 shutdown_connections 2024-09-19T08:58:03.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:03.296+0000 7feb69caa740 1 -- 172.21.15.19:0/2494174754 wait complete. 2024-09-19T08:58:03.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:03.297+0000 7feb69caa740 20 client.16686 trim_cache size 0 max 16384 2024-09-19T08:58:03.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:03.297+0000 7feb678d1640 1 -- 172.21.15.19:0/2464691910 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7feb4c0a32c0 msgr2=0x7feb4c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:03.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:03.297+0000 7feb678d1640 1 --2- 172.21.15.19:0/2464691910 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7feb4c0a32c0 0x7feb4c0a5780 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7feb580099e0 tx=0x7feb58009500 comp rx=0 tx=0).stop 2024-09-19T08:58:03.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:03.297+0000 7feb678d1640 1 -- 172.21.15.19:0/2464691910 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb60101360 msgr2=0x7feb6019ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:03.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:03.297+0000 7feb678d1640 1 --2- 172.21.15.19:0/2464691910 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb60101360 0x7feb6019ac30 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7feb5000d950 tx=0x7feb5000de10 comp rx=0 tx=0).stop 2024-09-19T08:58:03.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:03.297+0000 7feb678d1640 1 -- 172.21.15.19:0/2464691910 shutdown_connections 2024-09-19T08:58:03.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:03.297+0000 7feb678d1640 1 --2- 172.21.15.19:0/2464691910 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7feb4c0a32c0 0x7feb4c0a5780 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:03.297+0000 7feb678d1640 1 --2- 172.21.15.19:0/2464691910 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feb6010e4d0 0x7feb6019efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:03.297+0000 7feb678d1640 1 --2- 172.21.15.19:0/2464691910 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feb60101360 0x7feb6019ac30 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:03.297+0000 7feb678d1640 1 --2- 172.21.15.19:0/2464691910 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feb601009b0 0x7feb6019a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:03.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:03.297+0000 7feb678d1640 1 -- 172.21.15.19:0/2464691910 >> 172.21.15.19:0/2464691910 conn(0x7feb600fc7d0 msgr2=0x7feb6010f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:03.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:03.298+0000 7feb678d1640 1 -- 172.21.15.19:0/2464691910 shutdown_connections 2024-09-19T08:58:03.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:03.298+0000 7feb678d1640 1 -- 172.21.15.19:0/2464691910 wait complete. 2024-09-19T08:58:03.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:03 smithi155 ceph-mon[34921]: pgmap v512: 97 pgs: 97 active+clean; 9.3 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 1.24k op/s 2024-09-19T08:58:03.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:03 smithi203 ceph-mon[35450]: pgmap v512: 97 pgs: 97 active+clean; 9.3 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 1.24k op/s 2024-09-19T08:58:04.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:03 smithi019 ceph-mon[30976]: pgmap v512: 97 pgs: 97 active+clean; 9.3 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 1.24k op/s 2024-09-19T08:58:04.151 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'c98ecb3a', quiesce took 13.6 seconds. Will release after: 16.200000000000003 2024-09-19T08:58:05.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:05 smithi155 ceph-mon[34921]: pgmap v513: 97 pgs: 97 active+clean; 13 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 1.9 MiB/s wr, 576 op/s 2024-09-19T08:58:05.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:05 smithi203 ceph-mon[35450]: pgmap v513: 97 pgs: 97 active+clean; 13 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 1.9 MiB/s wr, 576 op/s 2024-09-19T08:58:06.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:05 smithi019 ceph-mon[30976]: pgmap v513: 97 pgs: 97 active+clean; 13 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 1.9 MiB/s wr, 576 op/s 2024-09-19T08:58:06.489 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.489+0000 7f9d39b98640 1 -- 172.21.15.19:0/3518274652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d34101c50 msgr2=0x7f9d341020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:06.490 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.489+0000 7f9d39b98640 1 --2- 172.21.15.19:0/3518274652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d34101c50 0x7f9d341020d0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f9d28009900 tx=0x7f9d2802a410 comp rx=0 tx=0).stop 2024-09-19T08:58:06.490 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.489+0000 7f9d39b98640 1 -- 172.21.15.19:0/3518274652 shutdown_connections 2024-09-19T08:58:06.490 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.489+0000 7f9d39b98640 1 --2- 172.21.15.19:0/3518274652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d34102610 0x7f9d34108ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:06.490 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.489+0000 7f9d39b98640 1 --2- 172.21.15.19:0/3518274652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d34101c50 0x7f9d341020d0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:06.490 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.489+0000 7f9d39b98640 1 --2- 172.21.15.19:0/3518274652 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d34100a60 0x7f9d34100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:06.490 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.489+0000 7f9d39b98640 1 -- 172.21.15.19:0/3518274652 >> 172.21.15.19:0/3518274652 conn(0x7f9d340fc1e0 msgr2=0x7f9d340fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:06.490 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.489+0000 7f9d39b98640 1 -- 172.21.15.19:0/3518274652 shutdown_connections 2024-09-19T08:58:06.490 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.489+0000 7f9d39b98640 1 -- 172.21.15.19:0/3518274652 wait complete. 2024-09-19T08:58:06.492 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.490+0000 7f9d39b98640 1 Processor -- start 2024-09-19T08:58:06.492 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.490+0000 7f9d39b98640 1 -- start start 2024-09-19T08:58:06.492 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.490+0000 7f9d39b98640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d34100a60 0x7f9d3406ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:06.492 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.490+0000 7f9d39b98640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d34101c50 0x7f9d3419cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:06.493 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.490+0000 7f9d39b98640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d34102610 0x7f9d3419f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:06.493 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.490+0000 7f9d39b98640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3410c6c0 con 0x7f9d34101c50 2024-09-19T08:58:06.493 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.490+0000 7f9d39b98640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3410c540 con 0x7f9d34100a60 2024-09-19T08:58:06.493 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.490+0000 7f9d39b98640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9d3410c840 con 0x7f9d34102610 2024-09-19T08:58:06.493 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.490+0000 7f9d32ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d34101c50 0x7f9d3419cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:06.493 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.490+0000 7f9d32ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d34101c50 0x7f9d3419cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47938/0 (socket says 172.21.15.19:47938) 2024-09-19T08:58:06.493 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.490+0000 7f9d32ffd640 1 -- 172.21.15.19:0/4091800854 learned_addr learned my addr 172.21.15.19:0/4091800854 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:06.493 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.490+0000 7f9d337fe640 1 --2- 172.21.15.19:0/4091800854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d34100a60 0x7f9d3406ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:06.493 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.490+0000 7f9d33fff640 1 --2- 172.21.15.19:0/4091800854 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d34102610 0x7f9d3419f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:06.493 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.491+0000 7f9d32ffd640 1 -- 172.21.15.19:0/4091800854 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d34102610 msgr2=0x7f9d3419f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:06.493 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.491+0000 7f9d32ffd640 1 --2- 172.21.15.19:0/4091800854 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d34102610 0x7f9d3419f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:06.493 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.491+0000 7f9d32ffd640 1 -- 172.21.15.19:0/4091800854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d34100a60 msgr2=0x7f9d3406ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:06.493 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.491+0000 7f9d32ffd640 1 --2- 172.21.15.19:0/4091800854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d34100a60 0x7f9d3406ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:06.493 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.491+0000 7f9d32ffd640 1 -- 172.21.15.19:0/4091800854 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d3419fa70 con 0x7f9d34101c50 2024-09-19T08:58:06.494 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.491+0000 7f9d33fff640 1 --2- 172.21.15.19:0/4091800854 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d34102610 0x7f9d3419f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:58:06.494 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.491+0000 7f9d32ffd640 1 --2- 172.21.15.19:0/4091800854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d34101c50 0x7f9d3419cb40 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f9d28009230 tx=0x7f9d28031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:06.494 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.491+0000 7f9d30ff9640 1 -- 172.21.15.19:0/4091800854 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2803f030 con 0x7f9d34101c50 2024-09-19T08:58:06.494 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.491+0000 7f9d30ff9640 1 -- 172.21.15.19:0/4091800854 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d28003ad0 con 0x7f9d34101c50 2024-09-19T08:58:06.494 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.491+0000 7f9d30ff9640 1 -- 172.21.15.19:0/4091800854 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d28035070 con 0x7f9d34101c50 2024-09-19T08:58:06.494 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.491+0000 7f9d39b98640 1 -- 172.21.15.19:0/4091800854 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d3419fca0 con 0x7f9d34101c50 2024-09-19T08:58:06.494 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.491+0000 7f9d39b98640 1 -- 172.21.15.19:0/4091800854 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d341a0140 con 0x7f9d34101c50 2024-09-19T08:58:06.499 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.493+0000 7f9d30ff9640 1 -- 172.21.15.19:0/4091800854 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f9d28042030 con 0x7f9d34101c50 2024-09-19T08:58:06.499 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.494+0000 7f9d3ca13740 1 Processor -- start 2024-09-19T08:58:06.500 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.494+0000 7f9d3ca13740 1 -- start start 2024-09-19T08:58:06.500 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.494+0000 7f9d3ca13740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e3c61f9a0 0x563e3c61fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:06.500 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.494+0000 7f9d3ca13740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e3c6202e0 0x563e3c624da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:06.500 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.494+0000 7f9d3ca13740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3c625370 0x563e3c627830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:06.500 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.494+0000 7f9d3ca13740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563e3c5832f0 con 0x563e3c625370 2024-09-19T08:58:06.501 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.494+0000 7f9d3ca13740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x563e3c52b270 con 0x563e3c61f9a0 2024-09-19T08:58:06.501 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.494+0000 7f9d3ca13740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563e3c57f2b0 con 0x563e3c6202e0 2024-09-19T08:58:06.501 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.494+0000 7f9d32ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3c625370 0x563e3c627830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:06.501 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.494+0000 7f9d33fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e3c61f9a0 0x563e3c61fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:06.501 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.494+0000 7f9d32ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3c625370 0x563e3c627830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47954/0 (socket says 172.21.15.19:47954) 2024-09-19T08:58:06.501 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.494+0000 7f9d32ffd640 1 -- 172.21.15.19:0/1737972547 learned_addr learned my addr 172.21.15.19:0/1737972547 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:06.501 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.494+0000 7f9d337fe640 1 --2- 172.21.15.19:0/1737972547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e3c6202e0 0x563e3c624da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:06.501 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.494+0000 7f9d30ff9640 1 --2- 172.21.15.19:0/4091800854 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9d1c0a32f0 0x7f9d1c0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:06.501 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.495+0000 7f9d33fff640 1 -- 172.21.15.19:0/1737972547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e3c6202e0 msgr2=0x563e3c624da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:06.501 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.495+0000 7f9d33fff640 1 --2- 172.21.15.19:0/1737972547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e3c6202e0 0x563e3c624da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:06.501 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.495+0000 7f9d33fff640 1 -- 172.21.15.19:0/1737972547 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3c625370 msgr2=0x563e3c627830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:06.501 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.495+0000 7f9d33fff640 1 --2- 172.21.15.19:0/1737972547 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3c625370 0x563e3c627830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:06.501 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.495+0000 7f9d33fff640 1 -- 172.21.15.19:0/1737972547 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e3c52a340 con 0x563e3c61f9a0 2024-09-19T08:58:06.502 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.495+0000 7f9d337fe640 1 --2- 172.21.15.19:0/1737972547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e3c6202e0 0x563e3c624da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:58:06.502 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.495+0000 7f9d32ffd640 1 --2- 172.21.15.19:0/1737972547 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3c625370 0x563e3c627830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:58:06.502 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.495+0000 7f9d33fff640 1 --2- 172.21.15.19:0/4091800854 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9d1c0a32f0 0x7f9d1c0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:06.502 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.495+0000 7f9d30ff9640 1 -- 172.21.15.19:0/4091800854 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9d280efb70 con 0x7f9d34101c50 2024-09-19T08:58:06.502 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.495+0000 7f9d33fff640 1 --2- 172.21.15.19:0/1737972547 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e3c61f9a0 0x563e3c61fda0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c005fd0 tx=0x7f9d2c00f840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e0982266c5bafde server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:06.502 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.495+0000 7f9d19ffb640 1 -- 172.21.15.19:0/1737972547 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c023070 con 0x563e3c61f9a0 2024-09-19T08:58:06.502 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.495+0000 7f9d33fff640 1 --2- 172.21.15.19:0/4091800854 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9d1c0a32f0 0x7f9d1c0a57b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c020000 tx=0x7f9d2c01d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:06.502 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.495+0000 7f9d19ffb640 1 -- 172.21.15.19:0/1737972547 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d2c01d930 con 0x563e3c61f9a0 2024-09-19T08:58:06.502 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.495+0000 7f9d19ffb640 1 -- 172.21.15.19:0/1737972547 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c01b8b0 con 0x563e3c61f9a0 2024-09-19T08:58:06.502 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.496+0000 7f9d3ca13740 1 -- 172.21.15.19:0/1737972547 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e3c61f9a0 msgr2=0x563e3c61fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:06.502 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.496+0000 7f9d3ca13740 1 --2- 172.21.15.19:0/1737972547 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e3c61f9a0 0x563e3c61fda0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c005fd0 tx=0x7f9d2c00f840 comp rx=0 tx=0).stop 2024-09-19T08:58:06.502 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.496+0000 7f9d3ca13740 1 -- 172.21.15.19:0/1737972547 shutdown_connections 2024-09-19T08:58:06.502 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.496+0000 7f9d3ca13740 1 --2- 172.21.15.19:0/1737972547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e3c6202e0 0x563e3c624da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:06.503 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.496+0000 7f9d3ca13740 1 --2- 172.21.15.19:0/1737972547 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3c625370 0x563e3c627830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:06.503 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.496+0000 7f9d3ca13740 1 --2- 172.21.15.19:0/1737972547 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e3c61f9a0 0x563e3c61fda0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:06.503 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.496+0000 7f9d3ca13740 1 -- 172.21.15.19:0/1737972547 >> 172.21.15.19:0/1737972547 conn(0x563e3c61b010 msgr2=0x563e3c61b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:06.503 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.496+0000 7f9d3ca13740 1 -- 172.21.15.19:0/1737972547 shutdown_connections 2024-09-19T08:58:06.503 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.496+0000 7f9d3ca13740 1 -- 172.21.15.19:0/1737972547 wait complete. 2024-09-19T08:58:06.503 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.496+0000 7f9d3ca13740 1 -- start start 2024-09-19T08:58:06.503 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.497+0000 7f9d3ca13740 1 Processor -- start 2024-09-19T08:58:06.503 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.497+0000 7f9d3ca13740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e3c61f9a0 0x563e3c629c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:06.503 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.497+0000 7f9d3ca13740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3c6202e0 0x563e3c62a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:06.503 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.497+0000 7f9d3ca13740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e3c625370 0x563e3c6311a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:06.503 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.497+0000 7f9d3ca13740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563e3c628340 con 0x563e3c6202e0 2024-09-19T08:58:06.503 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.497+0000 7f9d3ca13740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x563e3c50c290 con 0x563e3c625370 2024-09-19T08:58:06.503 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.497+0000 7f9d3ca13740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563e3c6284c0 con 0x563e3c61f9a0 2024-09-19T08:58:06.503 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.497+0000 7f9d3ca13740 10 client.0 _ll_register_callbacks cb 0x563e3c53d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:06.504 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.497+0000 7f9d32ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3c6202e0 0x563e3c62a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:06.504 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.497+0000 7f9d32ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3c6202e0 0x563e3c62a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47960/0 (socket says 172.21.15.19:47960) 2024-09-19T08:58:06.504 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.497+0000 7f9d32ffd640 1 -- 172.21.15.19:0/2260914323 learned_addr learned my addr 172.21.15.19:0/2260914323 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:06.504 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.497+0000 7f9d33fff640 1 --2- 172.21.15.19:0/2260914323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e3c625370 0x563e3c6311a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:06.504 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.497+0000 7f9d337fe640 1 --2- 172.21.15.19:0/2260914323 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e3c61f9a0 0x563e3c629c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:06.504 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.497+0000 7f9d32ffd640 1 -- 172.21.15.19:0/2260914323 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e3c61f9a0 msgr2=0x563e3c629c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:06.504 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.497+0000 7f9d32ffd640 1 --2- 172.21.15.19:0/2260914323 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e3c61f9a0 0x563e3c629c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:06.504 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.497+0000 7f9d32ffd640 1 -- 172.21.15.19:0/2260914323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e3c625370 msgr2=0x563e3c6311a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:06.504 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.497+0000 7f9d32ffd640 1 --2- 172.21.15.19:0/2260914323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e3c625370 0x563e3c6311a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:06.504 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.497+0000 7f9d32ffd640 1 -- 172.21.15.19:0/2260914323 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e3c296210 con 0x563e3c6202e0 2024-09-19T08:58:06.504 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.498+0000 7f9d32ffd640 1 --2- 172.21.15.19:0/2260914323 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3c6202e0 0x563e3c62a1d0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f9d28000c00 tx=0x7f9d28009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6e8d5cd24b910c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:06.504 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.498+0000 7f9d12ffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:58:06.505 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.498+0000 7f9d12ffd640 1 -- 172.21.15.19:0/2260914323 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d28049070 con 0x563e3c6202e0 2024-09-19T08:58:06.505 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.498+0000 7f9d12ffd640 1 -- 172.21.15.19:0/2260914323 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9d2803b460 con 0x563e3c6202e0 2024-09-19T08:58:06.505 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.498+0000 7f9d3ca13740 1 -- 172.21.15.19:0/2260914323 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d2c01d930 con 0x563e3c6202e0 2024-09-19T08:58:06.505 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.498+0000 7f9d12ffd640 1 -- 172.21.15.19:0/2260914323 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9d280f7040 con 0x563e3c6202e0 2024-09-19T08:58:06.505 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.498+0000 7f9d3ca13740 10 client.16698 fetch_fsmap learned FSMap version 34 2024-09-19T08:58:06.505 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.498+0000 7f9d3ca13740 1 -- 172.21.15.19:0/2260914323 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x563e3c362620 con 0x563e3c6202e0 2024-09-19T08:58:06.505 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.498+0000 7f9d12ffd640 1 -- 172.21.15.19:0/2260914323 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d2c01d930 con 0x563e3c6202e0 2024-09-19T08:58:06.505 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.498+0000 7f9d12ffd640 1 -- 172.21.15.19:0/2260914323 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7f9d280dc0b0 con 0x563e3c6202e0 2024-09-19T08:58:06.505 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.498+0000 7f9d3ca13740 10 client.16698 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T08:58:06.505 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.498+0000 7f9d3ca13740 10 client.16698 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:58:06.505 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.498+0000 7f9d3ca13740 20 client.16698 populate_metadata read hostname 'smithi019' 2024-09-19T08:58:06.505 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.498+0000 7f9d3ca13740 1 --2- 172.21.15.19:0/2260914323 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563e3c635810 0x563e3c637c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:06.505 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.498+0000 7f9d3ca13740 4 client.16698 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:58:06.505 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.498+0000 7f9d3ca13740 1 -- 172.21.15.19:0/2260914323 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563e3c590a20 con 0x563e3c635810 2024-09-19T08:58:06.506 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.499+0000 7f9d337fe640 1 --2- 172.21.15.19:0/2260914323 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563e3c635810 0x563e3c637c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:06.506 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.499+0000 7f9d337fe640 1 --2- 172.21.15.19:0/2260914323 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563e3c635810 0x563e3c637c30 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=839301efc27e703c server_cookie=73b9595f4c51730e in_seq=0 out_seq=0 2024-09-19T08:58:06.506 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.499+0000 7f9d12ffd640 10 client.16698 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:06.507 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.500+0000 7f9d12ffd640 1 -- 172.21.15.19:0/2260914323 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563e3c590a20 con 0x563e3c635810 2024-09-19T08:58:06.507 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.500+0000 7f9d12ffd640 10 client.16698 handle_command_reply: tid=0 2024-09-19T08:58:06.507 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.500+0000 7f9d3ca13740 1 client.16698 shutdown 2024-09-19T08:58:06.507 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.500+0000 7f9d3ca13740 1 -- 172.21.15.19:0/2260914323 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3c6202e0 msgr2=0x563e3c62a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:06.507 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.500+0000 7f9d3ca13740 1 --2- 172.21.15.19:0/2260914323 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3c6202e0 0x563e3c62a1d0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f9d28000c00 tx=0x7f9d28009680 comp rx=0 tx=0).stop 2024-09-19T08:58:06.507 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.500+0000 7f9d3ca13740 1 -- 172.21.15.19:0/2260914323 shutdown_connections 2024-09-19T08:58:06.507 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.500+0000 7f9d3ca13740 1 --2- 172.21.15.19:0/2260914323 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563e3c635810 0x563e3c637c30 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:06.507 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.500+0000 7f9d3ca13740 1 --2- 172.21.15.19:0/2260914323 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e3c625370 0x563e3c6311a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:06.507 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.500+0000 7f9d12ffd640 0 client.16698 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:06.507 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.500+0000 7f9d3ca13740 1 --2- 172.21.15.19:0/2260914323 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3c6202e0 0x563e3c62a1d0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:06.508 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.500+0000 7f9d3ca13740 1 --2- 172.21.15.19:0/2260914323 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e3c61f9a0 0x563e3c629c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:06.508 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.500+0000 7f9d3ca13740 1 -- 172.21.15.19:0/2260914323 >> 172.21.15.19:0/2260914323 conn(0x563e3c61b010 msgr2=0x563e3c61c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:06.508 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.500+0000 7f9d3ca13740 1 -- 172.21.15.19:0/2260914323 shutdown_connections 2024-09-19T08:58:06.508 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.500+0000 7f9d3ca13740 1 -- 172.21.15.19:0/2260914323 wait complete. 2024-09-19T08:58:06.508 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.501+0000 7f9d3ca13740 20 client.16698 trim_cache size 0 max 16384 2024-09-19T08:58:06.521 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.515+0000 7f9d3ca13740 1 Processor -- start 2024-09-19T08:58:06.521 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.515+0000 7f9d3ca13740 1 -- start start 2024-09-19T08:58:06.521 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.515+0000 7f9d3ca13740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e3c61f9a0 0x563e3c61bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:06.521 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.515+0000 7f9d3ca13740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3c6202e0 0x563e3c631160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:06.521 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.515+0000 7f9d3ca13740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e3c625370 0x563e3c61c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.515+0000 7f9d3ca13740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9d341a8f70 con 0x563e3c6202e0 2024-09-19T08:58:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.515+0000 7f9d3ca13740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9d341aaab0 con 0x563e3c625370 2024-09-19T08:58:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.515+0000 7f9d3ca13740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9d341a9640 con 0x563e3c61f9a0 2024-09-19T08:58:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.515+0000 7f9d32ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3c6202e0 0x563e3c631160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.515+0000 7f9d32ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3c6202e0 0x563e3c631160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47976/0 (socket says 172.21.15.19:47976) 2024-09-19T08:58:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.515+0000 7f9d32ffd640 1 -- 172.21.15.19:0/2617706247 learned_addr learned my addr 172.21.15.19:0/2617706247 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.516+0000 7f9d32ffd640 1 -- 172.21.15.19:0/2617706247 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e3c61f9a0 msgr2=0x563e3c61bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.516+0000 7f9d337fe640 1 --2- 172.21.15.19:0/2617706247 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e3c61f9a0 0x563e3c61bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.516+0000 7f9d33fff640 1 --2- 172.21.15.19:0/2617706247 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e3c625370 0x563e3c61c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.516+0000 7f9d32ffd640 1 --2- 172.21.15.19:0/2617706247 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e3c61f9a0 0x563e3c61bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.516+0000 7f9d32ffd640 1 -- 172.21.15.19:0/2617706247 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e3c625370 msgr2=0x563e3c61c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.516+0000 7f9d32ffd640 1 --2- 172.21.15.19:0/2617706247 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e3c625370 0x563e3c61c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.516+0000 7f9d32ffd640 1 -- 172.21.15.19:0/2617706247 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563e3c6382b0 con 0x563e3c6202e0 2024-09-19T08:58:06.523 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.516+0000 7f9d337fe640 1 --2- 172.21.15.19:0/2617706247 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e3c61f9a0 0x563e3c61bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:58:06.523 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.516+0000 7f9d32ffd640 1 --2- 172.21.15.19:0/2617706247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3c6202e0 0x563e3c631160 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f9d280bc0d0 tx=0x7f9d28005b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a26ae416a5a025cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:06.523 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.516+0000 7f9d197fa640 1 -- 172.21.15.19:0/2617706247 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d28049070 con 0x563e3c6202e0 2024-09-19T08:58:06.523 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.516+0000 7f9d197fa640 1 -- 172.21.15.19:0/2617706247 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d280bc140 con 0x563e3c6202e0 2024-09-19T08:58:06.523 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.516+0000 7f9d197fa640 1 -- 172.21.15.19:0/2617706247 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d28003c80 con 0x563e3c6202e0 2024-09-19T08:58:06.523 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.517+0000 7f9d3ca13740 1 -- 172.21.15.19:0/2617706247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3c6202e0 msgr2=0x563e3c631160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:06.523 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.517+0000 7f9d3ca13740 1 --2- 172.21.15.19:0/2617706247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3c6202e0 0x563e3c631160 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f9d280bc0d0 tx=0x7f9d28005b90 comp rx=0 tx=0).stop 2024-09-19T08:58:06.523 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.517+0000 7f9d3ca13740 1 -- 172.21.15.19:0/2617706247 shutdown_connections 2024-09-19T08:58:06.523 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.517+0000 7f9d3ca13740 1 --2- 172.21.15.19:0/2617706247 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e3c625370 0x563e3c61c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:06.523 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.517+0000 7f9d3ca13740 1 --2- 172.21.15.19:0/2617706247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3c6202e0 0x563e3c631160 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:06.523 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.517+0000 7f9d3ca13740 1 --2- 172.21.15.19:0/2617706247 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e3c61f9a0 0x563e3c61bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:06.523 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.517+0000 7f9d3ca13740 1 -- 172.21.15.19:0/2617706247 >> 172.21.15.19:0/2617706247 conn(0x563e3c61b010 msgr2=0x563e3c6215c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:06.523 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.517+0000 7f9d3ca13740 1 -- 172.21.15.19:0/2617706247 shutdown_connections 2024-09-19T08:58:06.523 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.517+0000 7f9d3ca13740 1 -- 172.21.15.19:0/2617706247 wait complete. 2024-09-19T08:58:06.524 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.517+0000 7f9d3ca13740 1 -- start start 2024-09-19T08:58:06.524 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.517+0000 7f9d3ca13740 1 Processor -- start 2024-09-19T08:58:06.524 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.517+0000 7f9d3ca13740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e3c61f9a0 0x563e3c62f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:06.524 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.517+0000 7f9d3ca13740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e3c6202e0 0x563e3c62f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:06.524 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.518+0000 7f9d3ca13740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3c625370 0x563e3c630740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:06.524 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.518+0000 7f9d3ca13740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9d341aa3e0 con 0x563e3c625370 2024-09-19T08:58:06.524 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.518+0000 7f9d3ca13740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9d341a9d10 con 0x563e3c61f9a0 2024-09-19T08:58:06.524 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.518+0000 7f9d3ca13740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9d341a6f50 con 0x563e3c6202e0 2024-09-19T08:58:06.524 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.518+0000 7f9d3ca13740 10 client.0 _ll_register_callbacks cb 0x7f9d280f32a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:06.524 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.518+0000 7f9d33fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3c625370 0x563e3c630740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:06.524 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.518+0000 7f9d33fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3c625370 0x563e3c630740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47986/0 (socket says 172.21.15.19:47986) 2024-09-19T08:58:06.524 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.518+0000 7f9d33fff640 1 -- 172.21.15.19:0/3672901145 learned_addr learned my addr 172.21.15.19:0/3672901145 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:06.524 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.518+0000 7f9d337fe640 1 --2- 172.21.15.19:0/3672901145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e3c61f9a0 0x563e3c62f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.518+0000 7f9d32ffd640 1 --2- 172.21.15.19:0/3672901145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e3c6202e0 0x563e3c62f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.518+0000 7f9d33fff640 1 -- 172.21.15.19:0/3672901145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e3c6202e0 msgr2=0x563e3c62f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.518+0000 7f9d33fff640 1 --2- 172.21.15.19:0/3672901145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e3c6202e0 0x563e3c62f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.518+0000 7f9d33fff640 1 -- 172.21.15.19:0/3672901145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e3c61f9a0 msgr2=0x563e3c62f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.518+0000 7f9d33fff640 1 --2- 172.21.15.19:0/3672901145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e3c61f9a0 0x563e3c62f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.518+0000 7f9d33fff640 1 -- 172.21.15.19:0/3672901145 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563e3c630d50 con 0x563e3c625370 2024-09-19T08:58:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.518+0000 7f9d33fff640 1 --2- 172.21.15.19:0/3672901145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3c625370 0x563e3c630740 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c003fa0 tx=0x7f9d2c005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5bd04ea422b397d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.518+0000 7f9d12ffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:58:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.518+0000 7f9d12ffd640 1 -- 172.21.15.19:0/3672901145 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c023040 con 0x563e3c625370 2024-09-19T08:58:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.518+0000 7f9d12ffd640 1 -- 172.21.15.19:0/3672901145 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9d2c0128c0 con 0x563e3c625370 2024-09-19T08:58:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.518+0000 7f9d3ca13740 1 -- 172.21.15.19:0/3672901145 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d280bc140 con 0x563e3c625370 2024-09-19T08:58:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.519+0000 7f9d12ffd640 1 -- 172.21.15.19:0/3672901145 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9d2c012ac0 con 0x563e3c625370 2024-09-19T08:58:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.519+0000 7f9d3ca13740 10 client.16704 fetch_fsmap learned FSMap version 34 2024-09-19T08:58:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.519+0000 7f9d3ca13740 1 -- 172.21.15.19:0/3672901145 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x563e3c6a0da0 con 0x563e3c625370 2024-09-19T08:58:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.519+0000 7f9d12ffd640 1 -- 172.21.15.19:0/3672901145 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d280bc140 con 0x563e3c625370 2024-09-19T08:58:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.519+0000 7f9d12ffd640 1 -- 172.21.15.19:0/3672901145 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7f9d2c027a50 con 0x563e3c625370 2024-09-19T08:58:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.519+0000 7f9d3ca13740 10 client.16704 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T08:58:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.519+0000 7f9d3ca13740 10 client.16704 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:58:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.519+0000 7f9d3ca13740 20 client.16704 populate_metadata read hostname 'smithi019' 2024-09-19T08:58:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.519+0000 7f9d3ca13740 1 --2- 172.21.15.19:0/3672901145 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563e3c6a1600 0x563e3c6a3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.519+0000 7f9d3ca13740 4 client.16704 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:58:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.519+0000 7f9d3ca13740 1 -- 172.21.15.19:0/3672901145 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563e3c58ad70 con 0x563e3c6a1600 2024-09-19T08:58:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.520+0000 7f9d337fe640 1 --2- 172.21.15.19:0/3672901145 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563e3c6a1600 0x563e3c6a3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.520+0000 7f9d337fe640 1 --2- 172.21.15.19:0/3672901145 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563e3c6a1600 0x563e3c6a3a20 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7703a809c60d7337 server_cookie=5ca9ae5c1d4721e3 in_seq=0 out_seq=0 2024-09-19T08:58:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:06.520+0000 7f9d12ffd640 10 client.16704 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:06.689 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:58:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:07.132+0000 7f9d12ffd640 1 -- 172.21.15.19:0/3672901145 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563e3c58ad70 con 0x563e3c6a1600 2024-09-19T08:58:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:07.132+0000 7f9d12ffd640 10 client.16704 handle_command_reply: tid=0 2024-09-19T08:58:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:07.132+0000 7f9d3ca13740 1 client.16704 shutdown 2024-09-19T08:58:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:07.132+0000 7f9d3ca13740 1 -- 172.21.15.19:0/3672901145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3c625370 msgr2=0x563e3c630740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:07.132+0000 7f9d3ca13740 1 --2- 172.21.15.19:0/3672901145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3c625370 0x563e3c630740 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c003fa0 tx=0x7f9d2c005f30 comp rx=0 tx=0).stop 2024-09-19T08:58:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:07.132+0000 7f9d3ca13740 1 -- 172.21.15.19:0/3672901145 shutdown_connections 2024-09-19T08:58:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:07.132+0000 7f9d3ca13740 1 --2- 172.21.15.19:0/3672901145 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563e3c6a1600 0x563e3c6a3a20 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:07.132+0000 7f9d3ca13740 1 --2- 172.21.15.19:0/3672901145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563e3c6202e0 0x563e3c62f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:07.132+0000 7f9d3ca13740 1 --2- 172.21.15.19:0/3672901145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563e3c625370 0x563e3c630740 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:07.132+0000 7f9d12ffd640 0 client.16704 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:07.132+0000 7f9d3ca13740 1 --2- 172.21.15.19:0/3672901145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563e3c61f9a0 0x563e3c62f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:07.132+0000 7f9d3ca13740 1 -- 172.21.15.19:0/3672901145 >> 172.21.15.19:0/3672901145 conn(0x563e3c61b010 msgr2=0x563e3c6199a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:07.132+0000 7f9d3ca13740 1 -- 172.21.15.19:0/3672901145 shutdown_connections 2024-09-19T08:58:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:07.132+0000 7f9d3ca13740 1 -- 172.21.15.19:0/3672901145 wait complete. 2024-09-19T08:58:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:07.133+0000 7f9d3ca13740 20 client.16704 trim_cache size 0 max 16384 2024-09-19T08:58:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T08:58:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T08:58:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T08:58:07.134 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T08:58:07.135 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:07.133+0000 7f9d39b98640 1 -- 172.21.15.19:0/4091800854 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9d1c0a32f0 msgr2=0x7f9d1c0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:07.135 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:07.133+0000 7f9d39b98640 1 --2- 172.21.15.19:0/4091800854 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9d1c0a32f0 0x7f9d1c0a57b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c020000 tx=0x7f9d2c01d000 comp rx=0 tx=0).stop 2024-09-19T08:58:07.135 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:07.133+0000 7f9d39b98640 1 -- 172.21.15.19:0/4091800854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d34101c50 msgr2=0x7f9d3419cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:07.135 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:07.133+0000 7f9d39b98640 1 --2- 172.21.15.19:0/4091800854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d34101c50 0x7f9d3419cb40 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f9d28009230 tx=0x7f9d28031b60 comp rx=0 tx=0).stop 2024-09-19T08:58:07.135 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:07.134+0000 7f9d39b98640 1 -- 172.21.15.19:0/4091800854 shutdown_connections 2024-09-19T08:58:07.135 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:07.134+0000 7f9d39b98640 1 --2- 172.21.15.19:0/4091800854 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9d1c0a32f0 0x7f9d1c0a57b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:07.134+0000 7f9d39b98640 1 --2- 172.21.15.19:0/4091800854 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d34102610 0x7f9d3419f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:07.134+0000 7f9d39b98640 1 --2- 172.21.15.19:0/4091800854 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d34101c50 0x7f9d3419cb40 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:07.134+0000 7f9d39b98640 1 --2- 172.21.15.19:0/4091800854 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d34100a60 0x7f9d3406ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:07.134+0000 7f9d39b98640 1 -- 172.21.15.19:0/4091800854 >> 172.21.15.19:0/4091800854 conn(0x7f9d340fc1e0 msgr2=0x7f9d34104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:07.134+0000 7f9d39b98640 1 -- 172.21.15.19:0/4091800854 shutdown_connections 2024-09-19T08:58:07.136 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:07.135+0000 7f9d39b98640 1 -- 172.21.15.19:0/4091800854 wait complete. 2024-09-19T08:58:07.148 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:58:07.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.690+0000 7f2c73c24640 1 -- 172.21.15.19:0/2056609654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c6c106f10 msgr2=0x7f2c6c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.690+0000 7f2c73c24640 1 --2- 172.21.15.19:0/2056609654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c6c106f10 0x7f2c6c10ea90 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f2c64009ca0 tx=0x7f2c6402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.690+0000 7f2c73c24640 1 -- 172.21.15.19:0/2056609654 shutdown_connections 2024-09-19T08:58:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.690+0000 7f2c73c24640 1 --2- 172.21.15.19:0/2056609654 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c6c106f10 0x7f2c6c10ea90 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.690+0000 7f2c73c24640 1 --2- 172.21.15.19:0/2056609654 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c6c102790 0x7f2c6c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.690+0000 7f2c73c24640 1 --2- 172.21.15.19:0/2056609654 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2c6c101de0 0x7f2c6c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.690+0000 7f2c73c24640 1 -- 172.21.15.19:0/2056609654 >> 172.21.15.19:0/2056609654 conn(0x7f2c6c0fd8c0 msgr2=0x7f2c6c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.690+0000 7f2c73c24640 1 -- 172.21.15.19:0/2056609654 shutdown_connections 2024-09-19T08:58:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.690+0000 7f2c73c24640 1 -- 172.21.15.19:0/2056609654 wait complete. 2024-09-19T08:58:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.691+0000 7f2c73c24640 1 Processor -- start 2024-09-19T08:58:07.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.691+0000 7f2c73c24640 1 -- start start 2024-09-19T08:58:07.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.691+0000 7f2c73c24640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c6c101de0 0x7f2c6c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:07.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.691+0000 7f2c73c24640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c6c102790 0x7f2c6c1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:07.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.691+0000 7f2c73c24640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2c6c106f10 0x7f2c6c19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:07.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.691+0000 7f2c73c24640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c111f90 con 0x7f2c6c102790 2024-09-19T08:58:07.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.691+0000 7f2c73c24640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c111e10 con 0x7f2c6c101de0 2024-09-19T08:58:07.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.691+0000 7f2c73c24640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c112110 con 0x7f2c6c106f10 2024-09-19T08:58:07.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.691+0000 7f2c711bf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c6c102790 0x7f2c6c1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:07.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.691+0000 7f2c711bf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c6c102790 0x7f2c6c1989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48018/0 (socket says 172.21.15.19:48018) 2024-09-19T08:58:07.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.691+0000 7f2c711bf640 1 -- 172.21.15.19:0/1517098145 learned_addr learned my addr 172.21.15.19:0/1517098145 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:07.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.692+0000 7f2c719c0640 1 --2- 172.21.15.19:0/1517098145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c6c101de0 0x7f2c6c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:07.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.692+0000 7f2c721c1640 1 --2- 172.21.15.19:0/1517098145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2c6c106f10 0x7f2c6c19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:07.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.692+0000 7f2c711bf640 1 -- 172.21.15.19:0/1517098145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2c6c106f10 msgr2=0x7f2c6c19cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:07.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.692+0000 7f2c711bf640 1 --2- 172.21.15.19:0/1517098145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2c6c106f10 0x7f2c6c19cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.692+0000 7f2c711bf640 1 -- 172.21.15.19:0/1517098145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c6c101de0 msgr2=0x7f2c6c198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:07.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.692+0000 7f2c711bf640 1 --2- 172.21.15.19:0/1517098145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c6c101de0 0x7f2c6c198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.692+0000 7f2c711bf640 1 -- 172.21.15.19:0/1517098145 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c6c19d420 con 0x7f2c6c102790 2024-09-19T08:58:07.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.692+0000 7f2c711bf640 1 --2- 172.21.15.19:0/1517098145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c6c102790 0x7f2c6c1989b0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c00d950 tx=0x7f2c5c00dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:07.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.692+0000 7f2c62ffd640 1 -- 172.21.15.19:0/1517098145 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c017030 con 0x7f2c6c102790 2024-09-19T08:58:07.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.692+0000 7f2c73c24640 1 -- 172.21.15.19:0/1517098145 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c6c19d710 con 0x7f2c6c102790 2024-09-19T08:58:07.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.692+0000 7f2c62ffd640 1 -- 172.21.15.19:0/1517098145 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c5c004020 con 0x7f2c6c102790 2024-09-19T08:58:07.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.692+0000 7f2c62ffd640 1 -- 172.21.15.19:0/1517098145 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c005650 con 0x7f2c6c102790 2024-09-19T08:58:07.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.692+0000 7f2c73c24640 1 -- 172.21.15.19:0/1517098145 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c6c1a4ff0 con 0x7f2c6c102790 2024-09-19T08:58:07.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.694+0000 7f2c62ffd640 1 -- 172.21.15.19:0/1517098145 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f2c5c0041d0 con 0x7f2c6c102790 2024-09-19T08:58:07.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.695+0000 7f2c75ffd740 1 Processor -- start 2024-09-19T08:58:07.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.695+0000 7f2c75ffd740 1 -- start start 2024-09-19T08:58:07.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.695+0000 7f2c75ffd740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55df794bd4a0 0x55df794bd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:07.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.695+0000 7f2c75ffd740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55df794bddc0 0x55df794c8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:07.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.695+0000 7f2c75ffd740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55df794c8680 0x55df794caa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:07.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.695+0000 7f2c75ffd740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55df794232e0 con 0x55df794c8680 2024-09-19T08:58:07.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.695+0000 7f2c75ffd740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55df793cace0 con 0x55df794bd4a0 2024-09-19T08:58:07.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.695+0000 7f2c75ffd740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55df7941f2a0 con 0x55df794bddc0 2024-09-19T08:58:07.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.695+0000 7f2c711bf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55df794c8680 0x55df794caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:07.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.695+0000 7f2c711bf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55df794c8680 0x55df794caa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48032/0 (socket says 172.21.15.19:48032) 2024-09-19T08:58:07.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.695+0000 7f2c711bf640 1 -- 172.21.15.19:0/1234070410 learned_addr learned my addr 172.21.15.19:0/1234070410 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:07.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.695+0000 7f2c62ffd640 1 --2- 172.21.15.19:0/1517098145 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2c580a3240 0x7f2c580a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:07.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.696+0000 7f2c719c0640 1 --2- 172.21.15.19:0/1234070410 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55df794bddc0 0x55df794c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:07.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.696+0000 7f2c711bf640 1 -- 172.21.15.19:0/1234070410 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55df794bddc0 msgr2=0x55df794c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:07.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.696+0000 7f2c721c1640 1 --2- 172.21.15.19:0/1234070410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55df794bd4a0 0x55df794bd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:07.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.696+0000 7f2c711bf640 1 --2- 172.21.15.19:0/1234070410 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55df794bddc0 0x55df794c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.696+0000 7f2c711bf640 1 -- 172.21.15.19:0/1234070410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55df794bd4a0 msgr2=0x55df794bd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:07.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.696+0000 7f2c711bf640 1 --2- 172.21.15.19:0/1234070410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55df794bd4a0 0x55df794bd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.696+0000 7f2c711bf640 1 -- 172.21.15.19:0/1234070410 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df793af440 con 0x55df794c8680 2024-09-19T08:58:07.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.696+0000 7f2c719c0640 1 --2- 172.21.15.19:0/1234070410 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55df794bddc0 0x55df794c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:58:07.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.696+0000 7f2c721c1640 1 --2- 172.21.15.19:0/1234070410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55df794bd4a0 0x55df794bd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:58:07.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.696+0000 7f2c721c1640 1 --2- 172.21.15.19:0/1517098145 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2c580a3240 0x7f2c580a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:07.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.696+0000 7f2c62ffd640 1 -- 172.21.15.19:0/1517098145 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2c5c0cf300 con 0x7f2c6c102790 2024-09-19T08:58:07.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.696+0000 7f2c711bf640 1 --2- 172.21.15.19:0/1234070410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55df794c8680 0x55df794caa70 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c0d2fd0 tx=0x7f2c5c00df90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebc689cd3feb803d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:07.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.696+0000 7f2c57fff640 1 -- 172.21.15.19:0/1234070410 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c09b470 con 0x55df794c8680 2024-09-19T08:58:07.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.696+0000 7f2c57fff640 1 -- 172.21.15.19:0/1234070410 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c5c0a3060 con 0x55df794c8680 2024-09-19T08:58:07.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.696+0000 7f2c57fff640 1 -- 172.21.15.19:0/1234070410 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c09b290 con 0x55df794c8680 2024-09-19T08:58:07.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.697+0000 7f2c75ffd740 1 -- 172.21.15.19:0/1234070410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55df794c8680 msgr2=0x55df794caa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:07.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.697+0000 7f2c75ffd740 1 --2- 172.21.15.19:0/1234070410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55df794c8680 0x55df794caa70 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c0d2fd0 tx=0x7f2c5c00df90 comp rx=0 tx=0).stop 2024-09-19T08:58:07.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.697+0000 7f2c721c1640 1 --2- 172.21.15.19:0/1517098145 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2c580a3240 0x7f2c580a5700 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2c64005cc0 tx=0x7f2c64005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:07.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.697+0000 7f2c75ffd740 1 -- 172.21.15.19:0/1234070410 shutdown_connections 2024-09-19T08:58:07.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.697+0000 7f2c75ffd740 1 --2- 172.21.15.19:0/1234070410 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55df794bddc0 0x55df794c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.697+0000 7f2c75ffd740 1 --2- 172.21.15.19:0/1234070410 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55df794c8680 0x55df794caa70 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.697+0000 7f2c75ffd740 1 --2- 172.21.15.19:0/1234070410 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55df794bd4a0 0x55df794bd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.697+0000 7f2c75ffd740 1 -- 172.21.15.19:0/1234070410 >> 172.21.15.19:0/1234070410 conn(0x55df794b9a30 msgr2=0x55df794b9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:07.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.697+0000 7f2c75ffd740 1 -- 172.21.15.19:0/1234070410 shutdown_connections 2024-09-19T08:58:07.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.697+0000 7f2c75ffd740 1 -- 172.21.15.19:0/1234070410 wait complete. 2024-09-19T08:58:07.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.698+0000 7f2c75ffd740 1 -- start start 2024-09-19T08:58:07.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.698+0000 7f2c75ffd740 1 Processor -- start 2024-09-19T08:58:07.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.698+0000 7f2c75ffd740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55df794bd4a0 0x55df794c7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:07.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.698+0000 7f2c75ffd740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55df794bddc0 0x55df794c5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:07.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.698+0000 7f2c75ffd740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55df794c8680 0x55df794c5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:07.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.698+0000 7f2c75ffd740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55df794cb1f0 con 0x55df794c8680 2024-09-19T08:58:07.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.698+0000 7f2c75ffd740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55df793de050 con 0x55df794bd4a0 2024-09-19T08:58:07.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.698+0000 7f2c75ffd740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55df794cb370 con 0x55df794bddc0 2024-09-19T08:58:07.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.698+0000 7f2c75ffd740 10 client.0 _ll_register_callbacks cb 0x55df7941e160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:07.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.698+0000 7f2c721c1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55df794c8680 0x55df794c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:07.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.698+0000 7f2c719c0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55df794bd4a0 0x55df794c7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:07.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.698+0000 7f2c721c1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55df794c8680 0x55df794c5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48040/0 (socket says 172.21.15.19:48040) 2024-09-19T08:58:07.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.698+0000 7f2c721c1640 1 -- 172.21.15.19:0/484847738 learned_addr learned my addr 172.21.15.19:0/484847738 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:07.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.698+0000 7f2c711bf640 1 --2- 172.21.15.19:0/484847738 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55df794bddc0 0x55df794c5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:07.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.699+0000 7f2c721c1640 1 -- 172.21.15.19:0/484847738 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55df794bddc0 msgr2=0x55df794c5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:07.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.699+0000 7f2c721c1640 1 --2- 172.21.15.19:0/484847738 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55df794bddc0 0x55df794c5250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.699+0000 7f2c721c1640 1 -- 172.21.15.19:0/484847738 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55df794bd4a0 msgr2=0x55df794c7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:07.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.699+0000 7f2c721c1640 1 --2- 172.21.15.19:0/484847738 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55df794bd4a0 0x55df794c7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.699+0000 7f2c721c1640 1 -- 172.21.15.19:0/484847738 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df791943c0 con 0x55df794c8680 2024-09-19T08:58:07.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.699+0000 7f2c711bf640 1 --2- 172.21.15.19:0/484847738 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55df794bddc0 0x55df794c5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:58:07.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.699+0000 7f2c719c0640 1 --2- 172.21.15.19:0/484847738 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55df794bd4a0 0x55df794c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:58:07.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.699+0000 7f2c721c1640 1 --2- 172.21.15.19:0/484847738 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55df794c8680 0x55df794c5790 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f2c64035000 tx=0x7f2c640095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=116ba4b29e65469e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:07.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.699+0000 7f2c557fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:58:07.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.699+0000 7f2c557fa640 1 -- 172.21.15.19:0/484847738 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c64004250 con 0x55df794c8680 2024-09-19T08:58:07.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.699+0000 7f2c75ffd740 1 -- 172.21.15.19:0/484847738 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55df79430850 con 0x55df794c8680 2024-09-19T08:58:07.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.699+0000 7f2c557fa640 1 -- 172.21.15.19:0/484847738 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2c640043f0 con 0x55df794c8680 2024-09-19T08:58:07.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.699+0000 7f2c557fa640 1 -- 172.21.15.19:0/484847738 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2c640045f0 con 0x55df794c8680 2024-09-19T08:58:07.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.699+0000 7f2c75ffd740 10 client.16716 fetch_fsmap learned FSMap version 34 2024-09-19T08:58:07.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.699+0000 7f2c75ffd740 1 -- 172.21.15.19:0/484847738 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55df794d6ae0 con 0x55df794c8680 2024-09-19T08:58:07.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.699+0000 7f2c557fa640 1 -- 172.21.15.19:0/484847738 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55df79430850 con 0x55df794c8680 2024-09-19T08:58:07.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.700+0000 7f2c557fa640 1 -- 172.21.15.19:0/484847738 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7f2c640306c0 con 0x55df794c8680 2024-09-19T08:58:07.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.700+0000 7f2c75ffd740 10 client.16716 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T08:58:07.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.700+0000 7f2c75ffd740 10 client.16716 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:58:07.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.700+0000 7f2c75ffd740 20 client.16716 populate_metadata read hostname 'smithi019' 2024-09-19T08:58:07.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.700+0000 7f2c75ffd740 1 --2- 172.21.15.19:0/484847738 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55df794d7f90 0x55df794da410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:07.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.700+0000 7f2c75ffd740 4 client.16716 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:58:07.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.700+0000 7f2c75ffd740 1 -- 172.21.15.19:0/484847738 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55df7942ad60 con 0x55df794d7f90 2024-09-19T08:58:07.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.700+0000 7f2c719c0640 1 --2- 172.21.15.19:0/484847738 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55df794d7f90 0x55df794da410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:07.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.700+0000 7f2c719c0640 1 --2- 172.21.15.19:0/484847738 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55df794d7f90 0x55df794da410 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6e9ef4875150374 server_cookie=a88e0694e66ee028 in_seq=0 out_seq=0 2024-09-19T08:58:07.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.700+0000 7f2c557fa640 10 client.16716 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:07.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.701+0000 7f2c557fa640 1 -- 172.21.15.19:0/484847738 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55df7942ad60 con 0x55df794d7f90 2024-09-19T08:58:07.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.701+0000 7f2c557fa640 10 client.16716 handle_command_reply: tid=0 2024-09-19T08:58:07.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.701+0000 7f2c75ffd740 1 client.16716 shutdown 2024-09-19T08:58:07.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.701+0000 7f2c75ffd740 1 -- 172.21.15.19:0/484847738 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55df794c8680 msgr2=0x55df794c5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:07.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.701+0000 7f2c75ffd740 1 --2- 172.21.15.19:0/484847738 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55df794c8680 0x55df794c5790 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f2c64035000 tx=0x7f2c640095c0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.701+0000 7f2c75ffd740 1 -- 172.21.15.19:0/484847738 shutdown_connections 2024-09-19T08:58:07.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.701+0000 7f2c75ffd740 1 --2- 172.21.15.19:0/484847738 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55df794d7f90 0x55df794da410 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.701+0000 7f2c75ffd740 1 --2- 172.21.15.19:0/484847738 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55df794bddc0 0x55df794c5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.701+0000 7f2c75ffd740 1 --2- 172.21.15.19:0/484847738 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55df794c8680 0x55df794c5790 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.701+0000 7f2c75ffd740 1 --2- 172.21.15.19:0/484847738 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55df794bd4a0 0x55df794c7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.701+0000 7f2c557fa640 0 client.16716 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:07.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.701+0000 7f2c75ffd740 1 -- 172.21.15.19:0/484847738 >> 172.21.15.19:0/484847738 conn(0x55df794b9a30 msgr2=0x55df794bf760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:07.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.701+0000 7f2c75ffd740 1 -- 172.21.15.19:0/484847738 shutdown_connections 2024-09-19T08:58:07.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.701+0000 7f2c75ffd740 1 -- 172.21.15.19:0/484847738 wait complete. 2024-09-19T08:58:07.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.701+0000 7f2c75ffd740 20 client.16716 trim_cache size 0 max 16384 2024-09-19T08:58:07.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.719+0000 7f2c75ffd740 1 Processor -- start 2024-09-19T08:58:07.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.719+0000 7f2c75ffd740 1 -- start start 2024-09-19T08:58:07.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.719+0000 7f2c75ffd740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55df794bd4a0 0x55df794d4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:07.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.719+0000 7f2c75ffd740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55df794bddc0 0x55df794c3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:07.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.719+0000 7f2c75ffd740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55df794c8680 0x55df794c07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:07.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.719+0000 7f2c75ffd740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c1ad5c0 con 0x55df794c8680 2024-09-19T08:58:07.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.719+0000 7f2c75ffd740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c1af100 con 0x55df794bd4a0 2024-09-19T08:58:07.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.719+0000 7f2c75ffd740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c1adc90 con 0x55df794bddc0 2024-09-19T08:58:07.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.720+0000 7f2c721c1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55df794c8680 0x55df794c07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:07.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.720+0000 7f2c721c1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55df794c8680 0x55df794c07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48054/0 (socket says 172.21.15.19:48054) 2024-09-19T08:58:07.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.720+0000 7f2c721c1640 1 -- 172.21.15.19:0/3288694550 learned_addr learned my addr 172.21.15.19:0/3288694550 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:07.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.720+0000 7f2c719c0640 1 --2- 172.21.15.19:0/3288694550 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55df794bd4a0 0x55df794d4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:07.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.720+0000 7f2c711bf640 1 --2- 172.21.15.19:0/3288694550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55df794bddc0 0x55df794c3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:07.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.720+0000 7f2c721c1640 1 -- 172.21.15.19:0/3288694550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55df794bddc0 msgr2=0x55df794c3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:07.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.720+0000 7f2c721c1640 1 --2- 172.21.15.19:0/3288694550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55df794bddc0 0x55df794c3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.720+0000 7f2c721c1640 1 -- 172.21.15.19:0/3288694550 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55df794bd4a0 msgr2=0x55df794d4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:07.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.720+0000 7f2c721c1640 1 --2- 172.21.15.19:0/3288694550 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55df794bd4a0 0x55df794d4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.720+0000 7f2c721c1640 1 -- 172.21.15.19:0/3288694550 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55df794c4200 con 0x55df794c8680 2024-09-19T08:58:07.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.720+0000 7f2c721c1640 1 --2- 172.21.15.19:0/3288694550 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55df794c8680 0x55df794c07a0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f2c64009ca0 tx=0x7f2c64003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa5b94a9bb8fca15 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:07.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.720+0000 7f2c577fe640 1 -- 172.21.15.19:0/3288694550 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c640305c0 con 0x55df794c8680 2024-09-19T08:58:07.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.720+0000 7f2c577fe640 1 -- 172.21.15.19:0/3288694550 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c6404b030 con 0x55df794c8680 2024-09-19T08:58:07.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.720+0000 7f2c577fe640 1 -- 172.21.15.19:0/3288694550 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c6402f970 con 0x55df794c8680 2024-09-19T08:58:07.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.721+0000 7f2c75ffd740 1 -- 172.21.15.19:0/3288694550 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55df794c8680 msgr2=0x55df794c07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:07.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.721+0000 7f2c75ffd740 1 --2- 172.21.15.19:0/3288694550 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55df794c8680 0x55df794c07a0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f2c64009ca0 tx=0x7f2c64003f80 comp rx=0 tx=0).stop 2024-09-19T08:58:07.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.721+0000 7f2c75ffd740 1 -- 172.21.15.19:0/3288694550 shutdown_connections 2024-09-19T08:58:07.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.721+0000 7f2c75ffd740 1 --2- 172.21.15.19:0/3288694550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55df794bddc0 0x55df794c3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.721+0000 7f2c75ffd740 1 --2- 172.21.15.19:0/3288694550 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55df794c8680 0x55df794c07a0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.721+0000 7f2c75ffd740 1 --2- 172.21.15.19:0/3288694550 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55df794bd4a0 0x55df794d4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.721+0000 7f2c75ffd740 1 -- 172.21.15.19:0/3288694550 >> 172.21.15.19:0/3288694550 conn(0x55df794b9a30 msgr2=0x55df794c0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:07.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.721+0000 7f2c75ffd740 1 -- 172.21.15.19:0/3288694550 shutdown_connections 2024-09-19T08:58:07.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.721+0000 7f2c75ffd740 1 -- 172.21.15.19:0/3288694550 wait complete. 2024-09-19T08:58:07.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.721+0000 7f2c75ffd740 1 -- start start 2024-09-19T08:58:07.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.722+0000 7f2c75ffd740 1 Processor -- start 2024-09-19T08:58:07.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.722+0000 7f2c75ffd740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55df794bd4a0 0x55df794d0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:07.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.722+0000 7f2c75ffd740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55df794bddc0 0x55df794d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:07.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.722+0000 7f2c75ffd740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55df794c8680 0x55df794cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:07.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.722+0000 7f2c75ffd740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c1aea30 con 0x55df794bddc0 2024-09-19T08:58:07.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.722+0000 7f2c75ffd740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c1ae360 con 0x55df794c8680 2024-09-19T08:58:07.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.722+0000 7f2c75ffd740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6c1ab5a0 con 0x55df794bd4a0 2024-09-19T08:58:07.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.722+0000 7f2c75ffd740 10 client.0 _ll_register_callbacks cb 0x7f2c64009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:07.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.722+0000 7f2c711bf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55df794bddc0 0x55df794d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:07.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.722+0000 7f2c711bf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55df794bddc0 0x55df794d0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48066/0 (socket says 172.21.15.19:48066) 2024-09-19T08:58:07.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.722+0000 7f2c711bf640 1 -- 172.21.15.19:0/2118569816 learned_addr learned my addr 172.21.15.19:0/2118569816 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:07.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.722+0000 7f2c721c1640 1 --2- 172.21.15.19:0/2118569816 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55df794c8680 0x55df794cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:07.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.722+0000 7f2c719c0640 1 --2- 172.21.15.19:0/2118569816 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55df794bd4a0 0x55df794d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:07.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.722+0000 7f2c711bf640 1 -- 172.21.15.19:0/2118569816 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55df794bd4a0 msgr2=0x55df794d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:07.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.722+0000 7f2c711bf640 1 --2- 172.21.15.19:0/2118569816 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55df794bd4a0 0x55df794d0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.722+0000 7f2c711bf640 1 -- 172.21.15.19:0/2118569816 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55df794c8680 msgr2=0x55df794cbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:07.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.722+0000 7f2c711bf640 1 --2- 172.21.15.19:0/2118569816 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55df794c8680 0x55df794cbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.722+0000 7f2c711bf640 1 -- 172.21.15.19:0/2118569816 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55df794cc700 con 0x55df794bddc0 2024-09-19T08:58:07.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.723+0000 7f2c711bf640 1 --2- 172.21.15.19:0/2118569816 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55df794bddc0 0x55df794d0ec0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c0cd180 tx=0x7f2c5c09b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f907fbe012364054 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:07.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.723+0000 7f2c557fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:58:07.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.723+0000 7f2c557fa640 1 -- 172.21.15.19:0/2118569816 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c09b930 con 0x55df794bddc0 2024-09-19T08:58:07.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.723+0000 7f2c557fa640 1 -- 172.21.15.19:0/2118569816 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2c5c097fa0 con 0x55df794bddc0 2024-09-19T08:58:07.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.723+0000 7f2c75ffd740 1 -- 172.21.15.19:0/2118569816 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c6404b030 con 0x55df794bddc0 2024-09-19T08:58:07.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.723+0000 7f2c557fa640 1 -- 172.21.15.19:0/2118569816 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2c5c09fce0 con 0x55df794bddc0 2024-09-19T08:58:07.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.723+0000 7f2c75ffd740 10 client.16722 fetch_fsmap learned FSMap version 34 2024-09-19T08:58:07.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.723+0000 7f2c75ffd740 1 -- 172.21.15.19:0/2118569816 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55df79542940 con 0x55df794bddc0 2024-09-19T08:58:07.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.723+0000 7f2c557fa640 1 -- 172.21.15.19:0/2118569816 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c5c0afe50 con 0x55df794bddc0 2024-09-19T08:58:07.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.723+0000 7f2c557fa640 1 -- 172.21.15.19:0/2118569816 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7f2c5c0a4110 con 0x55df794bddc0 2024-09-19T08:58:07.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.723+0000 7f2c75ffd740 10 client.16722 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T08:58:07.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.723+0000 7f2c75ffd740 10 client.16722 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:58:07.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.723+0000 7f2c75ffd740 20 client.16722 populate_metadata read hostname 'smithi019' 2024-09-19T08:58:07.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.724+0000 7f2c75ffd740 1 --2- 172.21.15.19:0/2118569816 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55df79542c80 0x55df79545070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:07.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.724+0000 7f2c75ffd740 4 client.16722 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:58:07.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.724+0000 7f2c75ffd740 1 -- 172.21.15.19:0/2118569816 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55df793a7210 con 0x55df79542c80 2024-09-19T08:58:07.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.724+0000 7f2c719c0640 1 --2- 172.21.15.19:0/2118569816 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55df79542c80 0x55df79545070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:07.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.724+0000 7f2c557fa640 10 client.16722 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:07.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.724+0000 7f2c719c0640 1 --2- 172.21.15.19:0/2118569816 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55df79542c80 0x55df79545070 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=183eb76919fc19df server_cookie=238dc74dd3f8ecab in_seq=0 out_seq=0 2024-09-19T08:58:07.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.724+0000 7f2c557fa640 1 -- 172.21.15.19:0/2118569816 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55df793a7210 con 0x55df79542c80 2024-09-19T08:58:07.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.724+0000 7f2c557fa640 10 client.16722 handle_command_reply: tid=0 2024-09-19T08:58:07.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.724+0000 7f2c75ffd740 1 client.16722 shutdown 2024-09-19T08:58:07.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.724+0000 7f2c75ffd740 1 -- 172.21.15.19:0/2118569816 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55df794bddc0 msgr2=0x55df794d0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:07.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.724+0000 7f2c75ffd740 1 --2- 172.21.15.19:0/2118569816 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55df794bddc0 0x55df794d0ec0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c0cd180 tx=0x7f2c5c09b4e0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.725+0000 7f2c75ffd740 1 -- 172.21.15.19:0/2118569816 shutdown_connections 2024-09-19T08:58:07.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.725+0000 7f2c75ffd740 1 --2- 172.21.15.19:0/2118569816 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55df79542c80 0x55df79545070 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.725+0000 7f2c75ffd740 1 --2- 172.21.15.19:0/2118569816 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55df794c8680 0x55df794cbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.725+0000 7f2c75ffd740 1 --2- 172.21.15.19:0/2118569816 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55df794bddc0 0x55df794d0ec0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.725+0000 7f2c557fa640 0 client.16722 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:07.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.725+0000 7f2c75ffd740 1 --2- 172.21.15.19:0/2118569816 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55df794bd4a0 0x55df794d0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.725+0000 7f2c75ffd740 1 -- 172.21.15.19:0/2118569816 >> 172.21.15.19:0/2118569816 conn(0x55df794b9a30 msgr2=0x55df794c08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:07.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.725+0000 7f2c75ffd740 1 -- 172.21.15.19:0/2118569816 shutdown_connections 2024-09-19T08:58:07.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.725+0000 7f2c75ffd740 1 -- 172.21.15.19:0/2118569816 wait complete. 2024-09-19T08:58:07.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.725+0000 7f2c75ffd740 20 client.16722 trim_cache size 0 max 16384 2024-09-19T08:58:07.733 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:58:07.733 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-19T08:58:07.733 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {} 2024-09-19T08:58:07.733 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:58:07.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.725+0000 7f2c73c24640 1 -- 172.21.15.19:0/1517098145 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2c580a3240 msgr2=0x7f2c580a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:07.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.725+0000 7f2c73c24640 1 --2- 172.21.15.19:0/1517098145 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2c580a3240 0x7f2c580a5700 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2c64005cc0 tx=0x7f2c64005d80 comp rx=0 tx=0).stop 2024-09-19T08:58:07.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.725+0000 7f2c73c24640 1 -- 172.21.15.19:0/1517098145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c6c102790 msgr2=0x7f2c6c1989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:07.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.725+0000 7f2c73c24640 1 --2- 172.21.15.19:0/1517098145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c6c102790 0x7f2c6c1989b0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c00d950 tx=0x7f2c5c00dd50 comp rx=0 tx=0).stop 2024-09-19T08:58:07.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.726+0000 7f2c73c24640 1 -- 172.21.15.19:0/1517098145 shutdown_connections 2024-09-19T08:58:07.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.726+0000 7f2c73c24640 1 --2- 172.21.15.19:0/1517098145 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2c580a3240 0x7f2c580a5700 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.726+0000 7f2c73c24640 1 --2- 172.21.15.19:0/1517098145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2c6c106f10 0x7f2c6c19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.726+0000 7f2c73c24640 1 --2- 172.21.15.19:0/1517098145 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c6c102790 0x7f2c6c1989b0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.726+0000 7f2c73c24640 1 --2- 172.21.15.19:0/1517098145 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c6c101de0 0x7f2c6c198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:07.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.726+0000 7f2c73c24640 1 -- 172.21.15.19:0/1517098145 >> 172.21.15.19:0/1517098145 conn(0x7f2c6c0fd8c0 msgr2=0x7f2c6c0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:07.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.726+0000 7f2c73c24640 1 -- 172.21.15.19:0/1517098145 shutdown_connections 2024-09-19T08:58:07.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:07.726+0000 7f2c73c24640 1 -- 172.21.15.19:0/1517098145 wait complete. 2024-09-19T08:58:07.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:07 smithi155 ceph-mon[34921]: pgmap v514: 97 pgs: 97 active+clean; 13 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 1.2 MiB/s wr, 403 op/s 2024-09-19T08:58:07.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:07 smithi203 ceph-mon[35450]: pgmap v514: 97 pgs: 97 active+clean; 13 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 1.2 MiB/s wr, 403 op/s 2024-09-19T08:58:08.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:07 smithi019 ceph-mon[30976]: pgmap v514: 97 pgs: 97 active+clean; 13 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 759 KiB/s rd, 1.2 MiB/s wr, 403 op/s 2024-09-19T08:58:08.523 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:58:08.523 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:58:08.797 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:58:09.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.247+0000 7fda466a2640 1 -- 172.21.15.19:0/472555006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda40103660 msgr2=0x7fda4010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:09.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.247+0000 7fda466a2640 1 --2- 172.21.15.19:0/472555006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda40103660 0x7fda4010bb50 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fda34009900 tx=0x7fda3402a480 comp rx=0 tx=0).stop 2024-09-19T08:58:09.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.247+0000 7fda466a2640 1 -- 172.21.15.19:0/472555006 shutdown_connections 2024-09-19T08:58:09.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.247+0000 7fda466a2640 1 --2- 172.21.15.19:0/472555006 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda4010c170 0x7fda4010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:09.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.247+0000 7fda466a2640 1 --2- 172.21.15.19:0/472555006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda40103660 0x7fda4010bb50 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:09.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.247+0000 7fda466a2640 1 --2- 172.21.15.19:0/472555006 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fda40102d40 0x7fda40103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:09.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.247+0000 7fda466a2640 1 -- 172.21.15.19:0/472555006 >> 172.21.15.19:0/472555006 conn(0x7fda400fc7a0 msgr2=0x7fda400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:09.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.247+0000 7fda466a2640 1 -- 172.21.15.19:0/472555006 shutdown_connections 2024-09-19T08:58:09.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.247+0000 7fda466a2640 1 -- 172.21.15.19:0/472555006 wait complete. 2024-09-19T08:58:09.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.248+0000 7fda466a2640 1 Processor -- start 2024-09-19T08:58:09.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.248+0000 7fda466a2640 1 -- start start 2024-09-19T08:58:09.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.248+0000 7fda466a2640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fda40102d40 0x7fda401009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:09.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.248+0000 7fda466a2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda40103660 0x7fda40100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:09.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.248+0000 7fda466a2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda4010c170 0x7fda40101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:09.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.248+0000 7fda466a2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fda40111fd0 con 0x7fda4010c170 2024-09-19T08:58:09.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.248+0000 7fda466a2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fda40111e50 con 0x7fda40103660 2024-09-19T08:58:09.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.248+0000 7fda466a2640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fda40112150 con 0x7fda40102d40 2024-09-19T08:58:09.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.248+0000 7fda44c3f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda4010c170 0x7fda40101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:09.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.248+0000 7fda3ffff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fda40102d40 0x7fda401009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:09.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.248+0000 7fda44c3f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda4010c170 0x7fda40101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48082/0 (socket says 172.21.15.19:48082) 2024-09-19T08:58:09.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.248+0000 7fda44c3f640 1 -- 172.21.15.19:0/1157802532 learned_addr learned my addr 172.21.15.19:0/1157802532 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:09.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.248+0000 7fda3ffff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fda40102d40 0x7fda401009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:49000/0 (socket says 172.21.15.19:49000) 2024-09-19T08:58:09.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.248+0000 7fda3f7fe640 1 --2- 172.21.15.19:0/1157802532 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda40103660 0x7fda40100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:09.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.249+0000 7fda44c3f640 1 -- 172.21.15.19:0/1157802532 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fda40102d40 msgr2=0x7fda401009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:09.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.249+0000 7fda44c3f640 1 --2- 172.21.15.19:0/1157802532 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fda40102d40 0x7fda401009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:09.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.249+0000 7fda44c3f640 1 -- 172.21.15.19:0/1157802532 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda40103660 msgr2=0x7fda40100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:09.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.249+0000 7fda44c3f640 1 --2- 172.21.15.19:0/1157802532 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda40103660 0x7fda40100ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:09.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.249+0000 7fda44c3f640 1 -- 172.21.15.19:0/1157802532 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda401a6960 con 0x7fda4010c170 2024-09-19T08:58:09.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.249+0000 7fda44c3f640 1 --2- 172.21.15.19:0/1157802532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda4010c170 0x7fda40101420 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fda3800b970 tx=0x7fda3800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:09.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.249+0000 7fda3d7fa640 1 -- 172.21.15.19:0/1157802532 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda38019070 con 0x7fda4010c170 2024-09-19T08:58:09.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.249+0000 7fda466a2640 1 -- 172.21.15.19:0/1157802532 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda401a6c50 con 0x7fda4010c170 2024-09-19T08:58:09.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.249+0000 7fda3d7fa640 1 -- 172.21.15.19:0/1157802532 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fda3800cb40 con 0x7fda4010c170 2024-09-19T08:58:09.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.249+0000 7fda3d7fa640 1 -- 172.21.15.19:0/1157802532 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda38007650 con 0x7fda4010c170 2024-09-19T08:58:09.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.249+0000 7fda466a2640 1 -- 172.21.15.19:0/1157802532 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda401a7160 con 0x7fda4010c170 2024-09-19T08:58:09.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.250+0000 7fda466a2640 1 -- 172.21.15.19:0/1157802532 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda4006b070 con 0x7fda4010c170 2024-09-19T08:58:09.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.251+0000 7fda3d7fa640 1 -- 172.21.15.19:0/1157802532 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fda3801c070 con 0x7fda4010c170 2024-09-19T08:58:09.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.252+0000 7fda3d7fa640 1 --2- 172.21.15.19:0/1157802532 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fda280a3240 0x7fda280a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:09.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.252+0000 7fda3d7fa640 1 -- 172.21.15.19:0/1157802532 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fda380ceed0 con 0x7fda4010c170 2024-09-19T08:58:09.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.252+0000 7fda3ffff640 1 --2- 172.21.15.19:0/1157802532 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fda280a3240 0x7fda280a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:09.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.253+0000 7fda3ffff640 1 --2- 172.21.15.19:0/1157802532 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fda280a3240 0x7fda280a5700 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fda30005fd0 tx=0x7fda3000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:09.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.257+0000 7fda3d7fa640 1 -- 172.21.15.19:0/1157802532 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fda3809b5b0 con 0x7fda4010c170 2024-09-19T08:58:09.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.472+0000 7fda466a2640 1 -- 172.21.15.19:0/1157802532 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda401071e0 con 0x7fda4010c170 2024-09-19T08:58:09.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.473+0000 7fda3d7fa640 1 -- 172.21.15.19:0/1157802532 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11983 (secure 0 0 0) 0x7fda3809f8b0 con 0x7fda4010c170 2024-09-19T08:58:09.473 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:58:09.474 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":34,"btime":"2024-09-19T08:58:01:585647+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2452068876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2452068876},{"type":"v1","addr":"172.21.15.19:6839","nonce":2452068876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T08:58:01.386094+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/2480841559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2480841559},{"type":"v1","addr":"172.21.15.155:6835","nonce":2480841559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24463,24464,24490,24469,24497]},"id":1}]} 2024-09-19T08:58:09.474 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 34 2024-09-19T08:58:09.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.475+0000 7fda466a2640 1 -- 172.21.15.19:0/1157802532 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fda280a3240 msgr2=0x7fda280a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:09.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.475+0000 7fda466a2640 1 --2- 172.21.15.19:0/1157802532 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fda280a3240 0x7fda280a5700 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fda30005fd0 tx=0x7fda3000b390 comp rx=0 tx=0).stop 2024-09-19T08:58:09.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.475+0000 7fda466a2640 1 -- 172.21.15.19:0/1157802532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda4010c170 msgr2=0x7fda40101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:09.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.475+0000 7fda466a2640 1 --2- 172.21.15.19:0/1157802532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda4010c170 0x7fda40101420 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fda3800b970 tx=0x7fda3800be30 comp rx=0 tx=0).stop 2024-09-19T08:58:09.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.475+0000 7fda466a2640 1 -- 172.21.15.19:0/1157802532 shutdown_connections 2024-09-19T08:58:09.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.475+0000 7fda466a2640 1 --2- 172.21.15.19:0/1157802532 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fda280a3240 0x7fda280a5700 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:09.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.475+0000 7fda466a2640 1 --2- 172.21.15.19:0/1157802532 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fda4010c170 0x7fda40101420 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:09.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.475+0000 7fda466a2640 1 --2- 172.21.15.19:0/1157802532 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fda40103660 0x7fda40100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:09.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.475+0000 7fda466a2640 1 --2- 172.21.15.19:0/1157802532 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fda40102d40 0x7fda401009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:09.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.475+0000 7fda466a2640 1 -- 172.21.15.19:0/1157802532 >> 172.21.15.19:0/1157802532 conn(0x7fda400fc7a0 msgr2=0x7fda400fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:09.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.476+0000 7fda466a2640 1 -- 172.21.15.19:0/1157802532 shutdown_connections 2024-09-19T08:58:09.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:09.476+0000 7fda466a2640 1 -- 172.21.15.19:0/1157802532 wait complete. 2024-09-19T08:58:09.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:09 smithi019 ceph-mon[30976]: pgmap v515: 97 pgs: 97 active+clean; 11 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 860 KiB/s rd, 1.2 MiB/s wr, 495 op/s 2024-09-19T08:58:09.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:09 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1157802532' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:58:09.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:09 smithi155 ceph-mon[34921]: pgmap v515: 97 pgs: 97 active+clean; 11 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 860 KiB/s rd, 1.2 MiB/s wr, 495 op/s 2024-09-19T08:58:09.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:09 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1157802532' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:58:09.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:09 smithi203 ceph-mon[35450]: pgmap v515: 97 pgs: 97 active+clean; 11 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 860 KiB/s rd, 1.2 MiB/s wr, 495 op/s 2024-09-19T08:58:09.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:09 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1157802532' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:58:10.267 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T08:58:10.533 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:58:11.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.027+0000 7f89358d3640 1 -- 172.21.15.19:0/1858720421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8930101de0 msgr2=0x7f89301021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:11.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.027+0000 7f89358d3640 1 --2- 172.21.15.19:0/1858720421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8930101de0 0x7f89301021c0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f8920009900 tx=0x7f892002a410 comp rx=0 tx=0).stop 2024-09-19T08:58:11.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.027+0000 7f89358d3640 1 -- 172.21.15.19:0/1858720421 shutdown_connections 2024-09-19T08:58:11.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.027+0000 7f89358d3640 1 --2- 172.21.15.19:0/1858720421 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8930106f10 0x7f893010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.027+0000 7f89358d3640 1 --2- 172.21.15.19:0/1858720421 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8930102790 0x7f89301067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.027+0000 7f89358d3640 1 --2- 172.21.15.19:0/1858720421 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8930101de0 0x7f89301021c0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.027+0000 7f89358d3640 1 -- 172.21.15.19:0/1858720421 >> 172.21.15.19:0/1858720421 conn(0x7f89300fd8c0 msgr2=0x7f89300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:11.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.027+0000 7f89358d3640 1 -- 172.21.15.19:0/1858720421 shutdown_connections 2024-09-19T08:58:11.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.027+0000 7f89358d3640 1 -- 172.21.15.19:0/1858720421 wait complete. 2024-09-19T08:58:11.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.028+0000 7f89358d3640 1 Processor -- start 2024-09-19T08:58:11.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.028+0000 7f89358d3640 1 -- start start 2024-09-19T08:58:11.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.028+0000 7f89358d3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8930101de0 0x7f8930198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:11.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.028+0000 7f89358d3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8930102790 0x7f8930198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:11.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.028+0000 7f89358d3640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8930106f10 0x7f893019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:11.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.028+0000 7f89358d3640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8930111f70 con 0x7f8930101de0 2024-09-19T08:58:11.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.028+0000 7f89358d3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8930111df0 con 0x7f8930102790 2024-09-19T08:58:11.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.028+0000 7f89358d3640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f89301120f0 con 0x7f8930106f10 2024-09-19T08:58:11.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.028+0000 7f892effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8930101de0 0x7f8930198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:11.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.028+0000 7f892effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8930101de0 0x7f8930198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48110/0 (socket says 172.21.15.19:48110) 2024-09-19T08:58:11.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.028+0000 7f892effd640 1 -- 172.21.15.19:0/3690016 learned_addr learned my addr 172.21.15.19:0/3690016 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:11.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.028+0000 7f892e7fc640 1 --2- 172.21.15.19:0/3690016 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8930102790 0x7f8930198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:11.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.028+0000 7f892f7fe640 1 --2- 172.21.15.19:0/3690016 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8930106f10 0x7f893019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:11.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.028+0000 7f892effd640 1 -- 172.21.15.19:0/3690016 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8930106f10 msgr2=0x7f893019cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:11.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.028+0000 7f892effd640 1 --2- 172.21.15.19:0/3690016 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8930106f10 0x7f893019cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.028+0000 7f892effd640 1 -- 172.21.15.19:0/3690016 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8930102790 msgr2=0x7f8930198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:11.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.028+0000 7f892effd640 1 --2- 172.21.15.19:0/3690016 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8930102790 0x7f8930198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.028+0000 7f892effd640 1 -- 172.21.15.19:0/3690016 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f893019d400 con 0x7f8930101de0 2024-09-19T08:58:11.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.029+0000 7f892e7fc640 1 --2- 172.21.15.19:0/3690016 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8930102790 0x7f8930198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:58:11.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.029+0000 7f892effd640 1 --2- 172.21.15.19:0/3690016 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8930101de0 0x7f8930198450 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f8920006010 tx=0x7f89200042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:11.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.029+0000 7f89348d1640 1 -- 172.21.15.19:0/3690016 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892003f030 con 0x7f8930101de0 2024-09-19T08:58:11.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.029+0000 7f89358d3640 1 -- 172.21.15.19:0/3690016 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f893019d690 con 0x7f8930101de0 2024-09-19T08:58:11.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.029+0000 7f89348d1640 1 -- 172.21.15.19:0/3690016 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8920003ce0 con 0x7f8930101de0 2024-09-19T08:58:11.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.029+0000 7f89348d1640 1 -- 172.21.15.19:0/3690016 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8920035070 con 0x7f8930101de0 2024-09-19T08:58:11.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.029+0000 7f89358d3640 1 -- 172.21.15.19:0/3690016 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89301a4fd0 con 0x7f8930101de0 2024-09-19T08:58:11.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.031+0000 7f89348d1640 1 -- 172.21.15.19:0/3690016 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f8920042030 con 0x7f8930101de0 2024-09-19T08:58:11.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.031+0000 7f8937cac740 1 Processor -- start 2024-09-19T08:58:11.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.032+0000 7f8937cac740 1 -- start start 2024-09-19T08:58:11.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.032+0000 7f8937cac740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c772eaab40 0x55c772ea9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:11.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.032+0000 7f8937cac740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c772ea95d0 0x55c772ea9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:11.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.032+0000 7f8937cac740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c772eb4370 0x55c772eb6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:11.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.032+0000 7f8937cac740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c772e0f2f0 con 0x55c772eb4370 2024-09-19T08:58:11.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.032+0000 7f8937cac740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55c772db6cf0 con 0x55c772eaab40 2024-09-19T08:58:11.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.032+0000 7f8937cac740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c772e0b2b0 con 0x55c772ea95d0 2024-09-19T08:58:11.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.032+0000 7f892e7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c772eb4370 0x55c772eb6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:11.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.032+0000 7f892e7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c772eb4370 0x55c772eb6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48116/0 (socket says 172.21.15.19:48116) 2024-09-19T08:58:11.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.032+0000 7f892e7fc640 1 -- 172.21.15.19:0/278570311 learned_addr learned my addr 172.21.15.19:0/278570311 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:11.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.032+0000 7f89348d1640 1 --2- 172.21.15.19:0/3690016 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f89180a3240 0x7f89180a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:11.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.032+0000 7f892f7fe640 1 --2- 172.21.15.19:0/278570311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c772eaab40 0x55c772ea9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:11.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.032+0000 7f892effd640 1 --2- 172.21.15.19:0/278570311 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c772ea95d0 0x55c772ea9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:11.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.032+0000 7f892f7fe640 1 --2- 172.21.15.19:0/3690016 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f89180a3240 0x7f89180a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:11.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.032+0000 7f892e7fc640 1 -- 172.21.15.19:0/278570311 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c772ea95d0 msgr2=0x55c772ea9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:11.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.032+0000 7f892e7fc640 1 --2- 172.21.15.19:0/278570311 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c772ea95d0 0x55c772ea9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.032+0000 7f892e7fc640 1 -- 172.21.15.19:0/278570311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c772eaab40 msgr2=0x55c772ea9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:11.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.032+0000 7f892e7fc640 1 --2- 172.21.15.19:0/278570311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c772eaab40 0x55c772ea9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.032+0000 7f892e7fc640 1 -- 172.21.15.19:0/278570311 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c772d9b3a0 con 0x55c772eb4370 2024-09-19T08:58:11.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.032+0000 7f89348d1640 1 -- 172.21.15.19:0/3690016 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f89200f00d0 con 0x7f8930101de0 2024-09-19T08:58:11.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.033+0000 7f892e7fc640 1 --2- 172.21.15.19:0/278570311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c772eb4370 0x55c772eb6760 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f892400bd30 tx=0x7f892400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=161d2d2cd28d6e58 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:11.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.033+0000 7f892f7fe640 1 --2- 172.21.15.19:0/3690016 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f89180a3240 0x7f89180a5700 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8928005c40 tx=0x7f8928004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:11.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.033+0000 7f8915ffb640 1 -- 172.21.15.19:0/278570311 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8924015070 con 0x55c772eb4370 2024-09-19T08:58:11.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.033+0000 7f8915ffb640 1 -- 172.21.15.19:0/278570311 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f892400be20 con 0x55c772eb4370 2024-09-19T08:58:11.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.033+0000 7f8915ffb640 1 -- 172.21.15.19:0/278570311 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8924011aa0 con 0x55c772eb4370 2024-09-19T08:58:11.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.033+0000 7f8937cac740 1 -- 172.21.15.19:0/278570311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c772eb4370 msgr2=0x55c772eb6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:11.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.033+0000 7f8937cac740 1 --2- 172.21.15.19:0/278570311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c772eb4370 0x55c772eb6760 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f892400bd30 tx=0x7f892400f730 comp rx=0 tx=0).stop 2024-09-19T08:58:11.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.034+0000 7f8937cac740 1 -- 172.21.15.19:0/278570311 shutdown_connections 2024-09-19T08:58:11.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.034+0000 7f8937cac740 1 --2- 172.21.15.19:0/278570311 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c772ea95d0 0x55c772ea9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.034+0000 7f8937cac740 1 --2- 172.21.15.19:0/278570311 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c772eb4370 0x55c772eb6760 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.034+0000 7f8937cac740 1 --2- 172.21.15.19:0/278570311 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c772eaab40 0x55c772ea9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.034+0000 7f8937cac740 1 -- 172.21.15.19:0/278570311 >> 172.21.15.19:0/278570311 conn(0x55c772e72310 msgr2=0x55c772ea5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:11.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.034+0000 7f8937cac740 1 -- 172.21.15.19:0/278570311 shutdown_connections 2024-09-19T08:58:11.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.034+0000 7f8937cac740 1 -- 172.21.15.19:0/278570311 wait complete. 2024-09-19T08:58:11.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.034+0000 7f8937cac740 1 -- start start 2024-09-19T08:58:11.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.034+0000 7f8937cac740 1 Processor -- start 2024-09-19T08:58:11.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.035+0000 7f8937cac740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c772ea95d0 0x55c772eb3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:11.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.035+0000 7f8937cac740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c772eaab40 0x55c772eb1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:11.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.035+0000 7f8937cac740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c772eb4370 0x55c772eb1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:11.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.035+0000 7f8937cac740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c772eb7070 con 0x55c772eaab40 2024-09-19T08:58:11.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.035+0000 7f8937cac740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55c772dca060 con 0x55c772eb4370 2024-09-19T08:58:11.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.035+0000 7f8937cac740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c772eb71f0 con 0x55c772ea95d0 2024-09-19T08:58:11.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.035+0000 7f8937cac740 10 client.0 _ll_register_callbacks cb 0x55c772b1d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:11.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.035+0000 7f892e7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c772eaab40 0x55c772eb1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:11.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.035+0000 7f892e7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c772eaab40 0x55c772eb1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48126/0 (socket says 172.21.15.19:48126) 2024-09-19T08:58:11.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.035+0000 7f892e7fc640 1 -- 172.21.15.19:0/2331984634 learned_addr learned my addr 172.21.15.19:0/2331984634 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:11.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.035+0000 7f892effd640 1 --2- 172.21.15.19:0/2331984634 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c772ea95d0 0x55c772eb3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:11.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.035+0000 7f892f7fe640 1 --2- 172.21.15.19:0/2331984634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c772eb4370 0x55c772eb1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:11.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.035+0000 7f892e7fc640 1 -- 172.21.15.19:0/2331984634 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c772ea95d0 msgr2=0x55c772eb3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:11.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.035+0000 7f892e7fc640 1 --2- 172.21.15.19:0/2331984634 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c772ea95d0 0x55c772eb3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.035+0000 7f892e7fc640 1 -- 172.21.15.19:0/2331984634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c772eb4370 msgr2=0x55c772eb1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:11.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.035+0000 7f892e7fc640 1 --2- 172.21.15.19:0/2331984634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c772eb4370 0x55c772eb1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.035+0000 7f892e7fc640 1 -- 172.21.15.19:0/2331984634 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c772b803c0 con 0x55c772eaab40 2024-09-19T08:58:11.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.035+0000 7f892e7fc640 1 --2- 172.21.15.19:0/2331984634 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c772eaab40 0x55c772eb1040 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f892400ba70 tx=0x7f8924005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad2c9b92e283f051 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:11.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.035+0000 7f890effd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:58:11.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.035+0000 7f890effd640 1 -- 172.21.15.19:0/2331984634 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8924015070 con 0x55c772eaab40 2024-09-19T08:58:11.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.035+0000 7f8937cac740 1 -- 172.21.15.19:0/2331984634 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f892400be20 con 0x55c772eaab40 2024-09-19T08:58:11.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.035+0000 7f890effd640 1 -- 172.21.15.19:0/2331984634 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f89240054b0 con 0x55c772eaab40 2024-09-19T08:58:11.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.036+0000 7f890effd640 1 -- 172.21.15.19:0/2331984634 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8924011820 con 0x55c772eaab40 2024-09-19T08:58:11.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.036+0000 7f8937cac740 10 client.16740 fetch_fsmap learned FSMap version 34 2024-09-19T08:58:11.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.036+0000 7f8937cac740 1 -- 172.21.15.19:0/2331984634 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55c772ec2b40 con 0x55c772eaab40 2024-09-19T08:58:11.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.036+0000 7f890effd640 1 -- 172.21.15.19:0/2331984634 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f892400be20 con 0x55c772eaab40 2024-09-19T08:58:11.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.036+0000 7f890effd640 1 -- 172.21.15.19:0/2331984634 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7f892401a460 con 0x55c772eaab40 2024-09-19T08:58:11.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.036+0000 7f8937cac740 10 client.16740 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T08:58:11.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.036+0000 7f8937cac740 10 client.16740 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T08:58:11.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.036+0000 7f8937cac740 20 client.16740 populate_metadata read hostname 'smithi019' 2024-09-19T08:58:11.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.036+0000 7f8937cac740 1 --2- 172.21.15.19:0/2331984634 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55c772ec3e90 0x55c772ec6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:11.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.036+0000 7f8937cac740 4 client.16740 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:58:11.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.036+0000 7f8937cac740 1 -- 172.21.15.19:0/2331984634 --> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c772e1c860 con 0x55c772ec3e90 2024-09-19T08:58:11.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.036+0000 7f892effd640 1 --2- 172.21.15.19:0/2331984634 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55c772ec3e90 0x55c772ec6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:11.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.037+0000 7f892effd640 1 --2- 172.21.15.19:0/2331984634 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55c772ec3e90 0x55c772ec6280 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d642ccc19e19a0b3 server_cookie=8f104198ac465ddf in_seq=0 out_seq=0 2024-09-19T08:58:11.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.037+0000 7f890effd640 10 client.16740 ms_handle_connect on v2:172.21.15.203:6834/2702758353 2024-09-19T08:58:11.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.037+0000 7f890effd640 1 -- 172.21.15.19:0/2331984634 <== mds.4 v2:172.21.15.203:6834/2702758353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c772e1c860 con 0x55c772ec3e90 2024-09-19T08:58:11.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.037+0000 7f890effd640 10 client.16740 handle_command_reply: tid=0 2024-09-19T08:58:11.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.038+0000 7f8937cac740 1 client.16740 shutdown 2024-09-19T08:58:11.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.038+0000 7f8937cac740 1 -- 172.21.15.19:0/2331984634 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c772eaab40 msgr2=0x55c772eb1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:11.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.038+0000 7f8937cac740 1 --2- 172.21.15.19:0/2331984634 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c772eaab40 0x55c772eb1040 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f892400ba70 tx=0x7f8924005040 comp rx=0 tx=0).stop 2024-09-19T08:58:11.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.038+0000 7f8937cac740 1 -- 172.21.15.19:0/2331984634 shutdown_connections 2024-09-19T08:58:11.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.038+0000 7f8937cac740 1 --2- 172.21.15.19:0/2331984634 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55c772ec3e90 0x55c772ec6280 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.038+0000 7f890effd640 0 client.16740 ms_handle_reset on v2:172.21.15.203:6834/2702758353 2024-09-19T08:58:11.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.038+0000 7f8937cac740 1 --2- 172.21.15.19:0/2331984634 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c772eb4370 0x55c772eb1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.038+0000 7f8937cac740 1 --2- 172.21.15.19:0/2331984634 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c772eaab40 0x55c772eb1040 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.038+0000 7f8937cac740 1 --2- 172.21.15.19:0/2331984634 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c772ea95d0 0x55c772eb3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.038+0000 7f8937cac740 1 -- 172.21.15.19:0/2331984634 >> 172.21.15.19:0/2331984634 conn(0x55c772e72310 msgr2=0x55c772eab960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:11.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.038+0000 7f8937cac740 1 -- 172.21.15.19:0/2331984634 shutdown_connections 2024-09-19T08:58:11.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.038+0000 7f8937cac740 1 -- 172.21.15.19:0/2331984634 wait complete. 2024-09-19T08:58:11.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.038+0000 7f8937cac740 20 client.16740 trim_cache size 0 max 16384 2024-09-19T08:58:11.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.051+0000 7f8937cac740 1 Processor -- start 2024-09-19T08:58:11.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.051+0000 7f8937cac740 1 -- start start 2024-09-19T08:58:11.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.051+0000 7f8937cac740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c772ea95d0 0x55c772ec0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:11.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.051+0000 7f8937cac740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c772eaab40 0x55c772eafef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:11.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.051+0000 7f8937cac740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c772eb4370 0x55c772ecba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:11.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.051+0000 7f8937cac740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f89301ad590 con 0x55c772eb4370 2024-09-19T08:58:11.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.051+0000 7f8937cac740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f89301af0d0 con 0x55c772ea95d0 2024-09-19T08:58:11.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.051+0000 7f8937cac740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f89301adc60 con 0x55c772eaab40 2024-09-19T08:58:11.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.051+0000 7f892f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c772eb4370 0x55c772ecba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:11.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.051+0000 7f892f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c772eb4370 0x55c772ecba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48128/0 (socket says 172.21.15.19:48128) 2024-09-19T08:58:11.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.051+0000 7f892f7fe640 1 -- 172.21.15.19:0/2563676091 learned_addr learned my addr 172.21.15.19:0/2563676091 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:11.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.051+0000 7f892effd640 1 --2- 172.21.15.19:0/2563676091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c772ea95d0 0x55c772ec0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:11.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.051+0000 7f892e7fc640 1 --2- 172.21.15.19:0/2563676091 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c772eaab40 0x55c772eafef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:11.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.052+0000 7f892f7fe640 1 -- 172.21.15.19:0/2563676091 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c772eaab40 msgr2=0x55c772eafef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:11.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.052+0000 7f892f7fe640 1 --2- 172.21.15.19:0/2563676091 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c772eaab40 0x55c772eafef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.052+0000 7f892f7fe640 1 -- 172.21.15.19:0/2563676091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c772ea95d0 msgr2=0x55c772ec0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:11.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.052+0000 7f892f7fe640 1 --2- 172.21.15.19:0/2563676091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c772ea95d0 0x55c772ec0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.052+0000 7f892f7fe640 1 -- 172.21.15.19:0/2563676091 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c772eb1fe0 con 0x55c772eb4370 2024-09-19T08:58:11.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.052+0000 7f892e7fc640 1 --2- 172.21.15.19:0/2563676091 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c772eaab40 0x55c772eafef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:58:11.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.052+0000 7f892f7fe640 1 --2- 172.21.15.19:0/2563676091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c772eb4370 0x55c772ecba60 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f892800f780 tx=0x7f892800e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3302a79f1ac80da server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:11.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.052+0000 7f89157fa640 1 -- 172.21.15.19:0/2563676091 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89280117d0 con 0x55c772eb4370 2024-09-19T08:58:11.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.052+0000 7f89157fa640 1 -- 172.21.15.19:0/2563676091 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8928018070 con 0x55c772eb4370 2024-09-19T08:58:11.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.052+0000 7f89157fa640 1 -- 172.21.15.19:0/2563676091 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f892801ee40 con 0x55c772eb4370 2024-09-19T08:58:11.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.053+0000 7f8937cac740 1 -- 172.21.15.19:0/2563676091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c772eb4370 msgr2=0x55c772ecba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.053+0000 7f8937cac740 1 --2- 172.21.15.19:0/2563676091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c772eb4370 0x55c772ecba60 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f892800f780 tx=0x7f892800e000 comp rx=0 tx=0).stop 2024-09-19T08:58:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.053+0000 7f8937cac740 1 -- 172.21.15.19:0/2563676091 shutdown_connections 2024-09-19T08:58:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.053+0000 7f8937cac740 1 --2- 172.21.15.19:0/2563676091 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c772eaab40 0x55c772eafef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.053+0000 7f8937cac740 1 --2- 172.21.15.19:0/2563676091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c772eb4370 0x55c772ecba60 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.053+0000 7f8937cac740 1 --2- 172.21.15.19:0/2563676091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c772ea95d0 0x55c772ec0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.053+0000 7f8937cac740 1 -- 172.21.15.19:0/2563676091 >> 172.21.15.19:0/2563676091 conn(0x55c772e72310 msgr2=0x55c772eaf7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.053+0000 7f8937cac740 1 -- 172.21.15.19:0/2563676091 shutdown_connections 2024-09-19T08:58:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.053+0000 7f8937cac740 1 -- 172.21.15.19:0/2563676091 wait complete. 2024-09-19T08:58:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.053+0000 7f8937cac740 1 -- start start 2024-09-19T08:58:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.053+0000 7f8937cac740 1 Processor -- start 2024-09-19T08:58:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.054+0000 7f8937cac740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c772ea95d0 0x55c772ebcb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.054+0000 7f8937cac740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c772eaab40 0x55c772eb7e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.054+0000 7f8937cac740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c772eb4370 0x55c772eb83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:11.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.054+0000 7f8937cac740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f89301aea00 con 0x55c772ea95d0 2024-09-19T08:58:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.054+0000 7f8937cac740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f89301ae330 con 0x55c772eb4370 2024-09-19T08:58:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.054+0000 7f8937cac740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f89301ab570 con 0x55c772eaab40 2024-09-19T08:58:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.054+0000 7f892effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c772ea95d0 0x55c772ebcb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.054+0000 7f8937cac740 10 client.0 _ll_register_callbacks cb 0x7f892400bb80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.054+0000 7f892effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c772ea95d0 0x55c772ebcb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48140/0 (socket says 172.21.15.19:48140) 2024-09-19T08:58:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.054+0000 7f892effd640 1 -- 172.21.15.19:0/3600244439 learned_addr learned my addr 172.21.15.19:0/3600244439 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.054+0000 7f892f7fe640 1 --2- 172.21.15.19:0/3600244439 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c772eb4370 0x55c772eb83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.054+0000 7f892e7fc640 1 --2- 172.21.15.19:0/3600244439 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c772eaab40 0x55c772eb7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.054+0000 7f892effd640 1 -- 172.21.15.19:0/3600244439 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c772eaab40 msgr2=0x55c772eb7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.054+0000 7f892effd640 1 --2- 172.21.15.19:0/3600244439 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c772eaab40 0x55c772eb7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.054+0000 7f892effd640 1 -- 172.21.15.19:0/3600244439 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c772eb4370 msgr2=0x55c772eb83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.054+0000 7f892effd640 1 --2- 172.21.15.19:0/3600244439 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c772eb4370 0x55c772eb83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.054+0000 7f892effd640 1 -- 172.21.15.19:0/3600244439 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c772eb8bc0 con 0x55c772ea95d0 2024-09-19T08:58:11.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.054+0000 7f892e7fc640 1 --2- 172.21.15.19:0/3600244439 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c772eaab40 0x55c772eb7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:58:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.054+0000 7f892effd640 1 --2- 172.21.15.19:0/3600244439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c772ea95d0 0x55c772ebcb40 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f8920000c00 tx=0x7f892008b560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b80b7cf21444bded server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.054+0000 7f890effd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:58:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.054+0000 7f890effd640 1 -- 172.21.15.19:0/3600244439 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8920049040 con 0x55c772ea95d0 2024-09-19T08:58:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.054+0000 7f890effd640 1 -- 172.21.15.19:0/3600244439 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f89200b8dd0 con 0x55c772ea95d0 2024-09-19T08:58:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.054+0000 7f8937cac740 1 -- 172.21.15.19:0/3600244439 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8928018070 con 0x55c772ea95d0 2024-09-19T08:58:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.055+0000 7f890effd640 1 -- 172.21.15.19:0/3600244439 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f89200bc2a0 con 0x55c772ea95d0 2024-09-19T08:58:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.055+0000 7f8937cac740 10 client.16746 fetch_fsmap learned FSMap version 34 2024-09-19T08:58:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.055+0000 7f8937cac740 1 -- 172.21.15.19:0/3600244439 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55c772f2e970 con 0x55c772ea95d0 2024-09-19T08:58:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.055+0000 7f890effd640 1 -- 172.21.15.19:0/3600244439 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8928018070 con 0x55c772ea95d0 2024-09-19T08:58:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.055+0000 7f890effd640 1 -- 172.21.15.19:0/3600244439 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7f892008b1b0 con 0x55c772ea95d0 2024-09-19T08:58:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.055+0000 7f8937cac740 10 client.16746 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T08:58:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.055+0000 7f8937cac740 10 client.16746 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T08:58:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.055+0000 7f8937cac740 20 client.16746 populate_metadata read hostname 'smithi019' 2024-09-19T08:58:11.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.055+0000 7f8937cac740 1 --2- 172.21.15.19:0/3600244439 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55c772ec3e90 0x55c772f310a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:11.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.055+0000 7f8937cac740 4 client.16746 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:58:11.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.055+0000 7f8937cac740 1 -- 172.21.15.19:0/3600244439 --> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c772e16d70 con 0x55c772ec3e90 2024-09-19T08:58:11.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.055+0000 7f892e7fc640 1 --2- 172.21.15.19:0/3600244439 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55c772ec3e90 0x55c772f310a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:11.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.056+0000 7f892e7fc640 1 --2- 172.21.15.19:0/3600244439 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55c772ec3e90 0x55c772f310a0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1409e9af5d72b170 server_cookie=379e8dfe367f452 in_seq=0 out_seq=0 2024-09-19T08:58:11.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.056+0000 7f890effd640 10 client.16746 ms_handle_connect on v2:172.21.15.203:6834/2702758353 2024-09-19T08:58:11.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.056+0000 7f890effd640 1 -- 172.21.15.19:0/3600244439 <== mds.4 v2:172.21.15.203:6834/2702758353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c772e16d70 con 0x55c772ec3e90 2024-09-19T08:58:11.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.056+0000 7f890effd640 10 client.16746 handle_command_reply: tid=0 2024-09-19T08:58:11.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.056+0000 7f8937cac740 1 client.16746 shutdown 2024-09-19T08:58:11.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.056+0000 7f8937cac740 1 -- 172.21.15.19:0/3600244439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c772ea95d0 msgr2=0x55c772ebcb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:11.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.056+0000 7f8937cac740 1 --2- 172.21.15.19:0/3600244439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c772ea95d0 0x55c772ebcb40 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f8920000c00 tx=0x7f892008b560 comp rx=0 tx=0).stop 2024-09-19T08:58:11.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.056+0000 7f8937cac740 1 -- 172.21.15.19:0/3600244439 shutdown_connections 2024-09-19T08:58:11.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.056+0000 7f8937cac740 1 --2- 172.21.15.19:0/3600244439 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55c772ec3e90 0x55c772f310a0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.056+0000 7f8937cac740 1 --2- 172.21.15.19:0/3600244439 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c772eaab40 0x55c772eb7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.056+0000 7f8937cac740 1 --2- 172.21.15.19:0/3600244439 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c772eb4370 0x55c772eb83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.056+0000 7f890effd640 0 client.16746 ms_handle_reset on v2:172.21.15.203:6834/2702758353 2024-09-19T08:58:11.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.056+0000 7f8937cac740 1 --2- 172.21.15.19:0/3600244439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c772ea95d0 0x55c772ebcb40 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.056+0000 7f8937cac740 1 -- 172.21.15.19:0/3600244439 >> 172.21.15.19:0/3600244439 conn(0x55c772e72310 msgr2=0x55c772ea4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:11.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.057+0000 7f8937cac740 1 -- 172.21.15.19:0/3600244439 shutdown_connections 2024-09-19T08:58:11.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.057+0000 7f8937cac740 1 -- 172.21.15.19:0/3600244439 wait complete. 2024-09-19T08:58:11.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.057+0000 7f8937cac740 20 client.16746 trim_cache size 0 max 16384 2024-09-19T08:58:11.064 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T08:58:11.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.057+0000 7f89358d3640 1 -- 172.21.15.19:0/3690016 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f89180a3240 msgr2=0x7f89180a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:11.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.057+0000 7f89358d3640 1 --2- 172.21.15.19:0/3690016 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f89180a3240 0x7f89180a5700 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f8928005c40 tx=0x7f8928004a40 comp rx=0 tx=0).stop 2024-09-19T08:58:11.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.057+0000 7f89358d3640 1 -- 172.21.15.19:0/3690016 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8930101de0 msgr2=0x7f8930198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:11.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.057+0000 7f89358d3640 1 --2- 172.21.15.19:0/3690016 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8930101de0 0x7f8930198450 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f8920006010 tx=0x7f89200042f0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.057+0000 7f89358d3640 1 -- 172.21.15.19:0/3690016 shutdown_connections 2024-09-19T08:58:11.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.057+0000 7f89358d3640 1 --2- 172.21.15.19:0/3690016 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f89180a3240 0x7f89180a5700 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.057+0000 7f89358d3640 1 --2- 172.21.15.19:0/3690016 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8930106f10 0x7f893019cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.057+0000 7f89358d3640 1 --2- 172.21.15.19:0/3690016 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8930102790 0x7f8930198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.057+0000 7f89358d3640 1 --2- 172.21.15.19:0/3690016 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8930101de0 0x7f8930198450 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:11.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.057+0000 7f89358d3640 1 -- 172.21.15.19:0/3690016 >> 172.21.15.19:0/3690016 conn(0x7f89300fd8c0 msgr2=0x7f89300fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:11.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.057+0000 7f89358d3640 1 -- 172.21.15.19:0/3690016 shutdown_connections 2024-09-19T08:58:11.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:11.057+0000 7f89358d3640 1 -- 172.21.15.19:0/3690016 wait complete. 2024-09-19T08:58:11.848 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T08:58:11.873 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:11 smithi019 ceph-mon[30976]: pgmap v516: 97 pgs: 97 active+clean; 6.5 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 878 KiB/s wr, 466 op/s 2024-09-19T08:58:11.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:11 smithi155 ceph-mon[34921]: pgmap v516: 97 pgs: 97 active+clean; 6.5 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 878 KiB/s wr, 466 op/s 2024-09-19T08:58:11.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:11 smithi203 ceph-mon[35450]: pgmap v516: 97 pgs: 97 active+clean; 6.5 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 623 KiB/s rd, 878 KiB/s wr, 466 op/s 2024-09-19T08:58:12.109 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:58:12.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.578+0000 7f23da9ab640 1 -- 172.21.15.19:0/2590610797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23d410c180 msgr2=0x7f23d410e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:12.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.578+0000 7f23da9ab640 1 --2- 172.21.15.19:0/2590610797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23d410c180 0x7f23d410e600 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f23cc009ca0 tx=0x7f23cc02a950 comp rx=0 tx=0).stop 2024-09-19T08:58:12.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.578+0000 7f23da9ab640 1 -- 172.21.15.19:0/2590610797 shutdown_connections 2024-09-19T08:58:12.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.578+0000 7f23da9ab640 1 --2- 172.21.15.19:0/2590610797 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23d410c180 0x7f23d410e600 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.578+0000 7f23da9ab640 1 --2- 172.21.15.19:0/2590610797 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23d41036c0 0x7f23d410bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.578+0000 7f23da9ab640 1 --2- 172.21.15.19:0/2590610797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f23d4102da0 0x7f23d4103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.578+0000 7f23da9ab640 1 -- 172.21.15.19:0/2590610797 >> 172.21.15.19:0/2590610797 conn(0x7f23d40fc7a0 msgr2=0x7f23d40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.578+0000 7f23da9ab640 1 -- 172.21.15.19:0/2590610797 shutdown_connections 2024-09-19T08:58:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.578+0000 7f23da9ab640 1 -- 172.21.15.19:0/2590610797 wait complete. 2024-09-19T08:58:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.578+0000 7f23da9ab640 1 Processor -- start 2024-09-19T08:58:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.579+0000 7f23da9ab640 1 -- start start 2024-09-19T08:58:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.579+0000 7f23da9ab640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23d4102da0 0x7f23d41983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.579+0000 7f23da9ab640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23d41036c0 0x7f23d4198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.579+0000 7f23da9ab640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f23d410c180 0x7f23d419cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.579+0000 7f23da9ab640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f23d4111f60 con 0x7f23d41036c0 2024-09-19T08:58:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.579+0000 7f23da9ab640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f23d4111de0 con 0x7f23d4102da0 2024-09-19T08:58:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.579+0000 7f23da9ab640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f23d41120e0 con 0x7f23d410c180 2024-09-19T08:58:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.579+0000 7f23cbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23d41036c0 0x7f23d4198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.579+0000 7f23cbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23d41036c0 0x7f23d4198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48166/0 (socket says 172.21.15.19:48166) 2024-09-19T08:58:12.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.579+0000 7f23cbfff640 1 -- 172.21.15.19:0/1320781870 learned_addr learned my addr 172.21.15.19:0/1320781870 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.579+0000 7f23d8f48640 1 --2- 172.21.15.19:0/1320781870 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f23d410c180 0x7f23d419cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.579+0000 7f23d3fff640 1 --2- 172.21.15.19:0/1320781870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23d4102da0 0x7f23d41983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.579+0000 7f23cbfff640 1 -- 172.21.15.19:0/1320781870 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f23d410c180 msgr2=0x7f23d419cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.579+0000 7f23cbfff640 1 --2- 172.21.15.19:0/1320781870 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f23d410c180 0x7f23d419cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.579+0000 7f23cbfff640 1 -- 172.21.15.19:0/1320781870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23d4102da0 msgr2=0x7f23d41983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.579+0000 7f23cbfff640 1 --2- 172.21.15.19:0/1320781870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23d4102da0 0x7f23d41983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.579+0000 7f23cbfff640 1 -- 172.21.15.19:0/1320781870 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23d419d370 con 0x7f23d41036c0 2024-09-19T08:58:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.579+0000 7f23cbfff640 1 --2- 172.21.15.19:0/1320781870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23d41036c0 0x7f23d4198900 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f23bc00c890 tx=0x7f23bc00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.579+0000 7f23d1ffb640 1 -- 172.21.15.19:0/1320781870 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23bc004220 con 0x7f23d41036c0 2024-09-19T08:58:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.580+0000 7f23da9ab640 1 -- 172.21.15.19:0/1320781870 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23d419d660 con 0x7f23d41036c0 2024-09-19T08:58:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.580+0000 7f23d1ffb640 1 -- 172.21.15.19:0/1320781870 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23bc0043c0 con 0x7f23d41036c0 2024-09-19T08:58:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.580+0000 7f23d1ffb640 1 -- 172.21.15.19:0/1320781870 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23bc004a00 con 0x7f23d41036c0 2024-09-19T08:58:12.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.580+0000 7f23da9ab640 1 -- 172.21.15.19:0/1320781870 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23d41a4f40 con 0x7f23d41036c0 2024-09-19T08:58:12.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.582+0000 7f23d1ffb640 1 -- 172.21.15.19:0/1320781870 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f23bc0079b0 con 0x7f23d41036c0 2024-09-19T08:58:12.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.582+0000 7f23dcd84740 1 Processor -- start 2024-09-19T08:58:12.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.582+0000 7f23dcd84740 1 -- start start 2024-09-19T08:58:12.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.582+0000 7f23dcd84740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d16033cb40 0x55d16033b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:12.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.582+0000 7f23dcd84740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d16033b5d0 0x55d16033ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:12.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.582+0000 7f23dcd84740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d160346370 0x55d160348760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:12.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.582+0000 7f23dcd84740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d1602a12f0 con 0x55d16033b5d0 2024-09-19T08:58:12.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.582+0000 7f23dcd84740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55d160248cf0 con 0x55d16033cb40 2024-09-19T08:58:12.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.582+0000 7f23dcd84740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d16029d2b0 con 0x55d160346370 2024-09-19T08:58:12.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.582+0000 7f23d3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d16033b5d0 0x55d16033ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:12.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.582+0000 7f23d3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d16033b5d0 0x55d16033ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48172/0 (socket says 172.21.15.19:48172) 2024-09-19T08:58:12.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.582+0000 7f23d3fff640 1 -- 172.21.15.19:0/1578153849 learned_addr learned my addr 172.21.15.19:0/1578153849 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:12.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.583+0000 7f23d8f48640 1 --2- 172.21.15.19:0/1578153849 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d16033cb40 0x55d16033b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:12.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.583+0000 7f23cbfff640 1 --2- 172.21.15.19:0/1578153849 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d160346370 0x55d160348760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:12.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.583+0000 7f23d1ffb640 1 --2- 172.21.15.19:0/1320781870 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f23c00a3240 0x7f23c00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:12.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.583+0000 7f23d3fff640 1 -- 172.21.15.19:0/1578153849 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d160346370 msgr2=0x55d160348760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:12.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.583+0000 7f23d3fff640 1 --2- 172.21.15.19:0/1578153849 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d160346370 0x55d160348760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.583+0000 7f23d3fff640 1 -- 172.21.15.19:0/1578153849 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d16033cb40 msgr2=0x55d16033b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:12.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.583+0000 7f23d3fff640 1 --2- 172.21.15.19:0/1578153849 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d16033cb40 0x55d16033b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.583+0000 7f23d3fff640 1 -- 172.21.15.19:0/1578153849 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d16022d3a0 con 0x55d16033b5d0 2024-09-19T08:58:12.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.583+0000 7f23d8f48640 1 --2- 172.21.15.19:0/1320781870 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f23c00a3240 0x7f23c00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:12.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.583+0000 7f23d1ffb640 1 -- 172.21.15.19:0/1320781870 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f23bc0cf640 con 0x7f23d41036c0 2024-09-19T08:58:12.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.583+0000 7f23d3fff640 1 --2- 172.21.15.19:0/1578153849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d16033b5d0 0x55d16033ba10 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f23c400bcb0 tx=0x7f23c400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c59484619caf83d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:12.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.583+0000 7f23ca7fc640 1 -- 172.21.15.19:0/1578153849 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c4015070 con 0x55d16033b5d0 2024-09-19T08:58:12.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.583+0000 7f23ca7fc640 1 -- 172.21.15.19:0/1578153849 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23c401a940 con 0x55d16033b5d0 2024-09-19T08:58:12.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.583+0000 7f23ca7fc640 1 -- 172.21.15.19:0/1578153849 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c4011a30 con 0x55d16033b5d0 2024-09-19T08:58:12.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.584+0000 7f23dcd84740 1 -- 172.21.15.19:0/1578153849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d16033b5d0 msgr2=0x55d16033ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:12.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.584+0000 7f23d8f48640 1 --2- 172.21.15.19:0/1320781870 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f23c00a3240 0x7f23c00a5700 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f23cc009430 tx=0x7f23cc0095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:12.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.584+0000 7f23dcd84740 1 --2- 172.21.15.19:0/1578153849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d16033b5d0 0x55d16033ba10 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f23c400bcb0 tx=0x7f23c400f730 comp rx=0 tx=0).stop 2024-09-19T08:58:12.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.584+0000 7f23dcd84740 1 -- 172.21.15.19:0/1578153849 shutdown_connections 2024-09-19T08:58:12.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.584+0000 7f23dcd84740 1 --2- 172.21.15.19:0/1578153849 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d160346370 0x55d160348760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.584+0000 7f23dcd84740 1 --2- 172.21.15.19:0/1578153849 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d16033b5d0 0x55d16033ba10 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.584+0000 7f23dcd84740 1 --2- 172.21.15.19:0/1578153849 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d16033cb40 0x55d16033b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.584+0000 7f23dcd84740 1 -- 172.21.15.19:0/1578153849 >> 172.21.15.19:0/1578153849 conn(0x55d160304310 msgr2=0x55d160337c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:12.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.584+0000 7f23dcd84740 1 -- 172.21.15.19:0/1578153849 shutdown_connections 2024-09-19T08:58:12.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.584+0000 7f23dcd84740 1 -- 172.21.15.19:0/1578153849 wait complete. 2024-09-19T08:58:12.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.584+0000 7f23dcd84740 1 -- start start 2024-09-19T08:58:12.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.585+0000 7f23dcd84740 1 Processor -- start 2024-09-19T08:58:12.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.585+0000 7f23dcd84740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d16033b5d0 0x55d160345d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:12.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.585+0000 7f23dcd84740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d16033cb40 0x55d160342ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:12.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.585+0000 7f23dcd84740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d160346370 0x55d1603435e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:12.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.585+0000 7f23dcd84740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d160349070 con 0x55d16033b5d0 2024-09-19T08:58:12.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.585+0000 7f23dcd84740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55d16025c060 con 0x55d16033cb40 2024-09-19T08:58:12.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.585+0000 7f23dcd84740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d1603491f0 con 0x55d160346370 2024-09-19T08:58:12.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.585+0000 7f23dcd84740 10 client.0 _ll_register_callbacks cb 0x55d15ffaf8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:12.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.585+0000 7f23d3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d16033b5d0 0x55d160345d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:12.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.585+0000 7f23d3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d16033b5d0 0x55d160345d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48182/0 (socket says 172.21.15.19:48182) 2024-09-19T08:58:12.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.585+0000 7f23d3fff640 1 -- 172.21.15.19:0/553491502 learned_addr learned my addr 172.21.15.19:0/553491502 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:12.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.585+0000 7f23cbfff640 1 --2- 172.21.15.19:0/553491502 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d16033cb40 0x55d160342ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:12.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.585+0000 7f23d3fff640 1 -- 172.21.15.19:0/553491502 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d160346370 msgr2=0x55d1603435e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:12.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.585+0000 7f23d8f48640 1 --2- 172.21.15.19:0/553491502 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d160346370 0x55d1603435e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:12.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.585+0000 7f23d3fff640 1 --2- 172.21.15.19:0/553491502 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d160346370 0x55d1603435e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.585+0000 7f23d3fff640 1 -- 172.21.15.19:0/553491502 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d16033cb40 msgr2=0x55d160342ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:12.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.585+0000 7f23d3fff640 1 --2- 172.21.15.19:0/553491502 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d16033cb40 0x55d160342ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.585+0000 7f23d3fff640 1 -- 172.21.15.19:0/553491502 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d1600123c0 con 0x55d16033b5d0 2024-09-19T08:58:12.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.585+0000 7f23cbfff640 1 --2- 172.21.15.19:0/553491502 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d16033cb40 0x55d160342ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:58:12.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.585+0000 7f23d8f48640 1 --2- 172.21.15.19:0/553491502 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d160346370 0x55d1603435e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:58:12.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.586+0000 7f23d3fff640 1 --2- 172.21.15.19:0/553491502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d16033b5d0 0x55d160345d40 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f23c400bfd0 tx=0x7f23c4011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6d4cc451e0d1343 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:12.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.586+0000 7f23b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:58:12.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.586+0000 7f23b37fe640 1 -- 172.21.15.19:0/553491502 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c4015070 con 0x55d16033b5d0 2024-09-19T08:58:12.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.586+0000 7f23b37fe640 1 -- 172.21.15.19:0/553491502 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f23c401aaf0 con 0x55d16033b5d0 2024-09-19T08:58:12.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.586+0000 7f23dcd84740 1 -- 172.21.15.19:0/553491502 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23c401a940 con 0x55d16033b5d0 2024-09-19T08:58:12.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.586+0000 7f23b37fe640 1 -- 172.21.15.19:0/553491502 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f23c401ad10 con 0x55d16033b5d0 2024-09-19T08:58:12.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.586+0000 7f23dcd84740 10 client.16758 fetch_fsmap learned FSMap version 34 2024-09-19T08:58:12.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.586+0000 7f23dcd84740 1 -- 172.21.15.19:0/553491502 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d160354ae0 con 0x55d16033b5d0 2024-09-19T08:58:12.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.586+0000 7f23b37fe640 1 -- 172.21.15.19:0/553491502 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23c401a940 con 0x55d16033b5d0 2024-09-19T08:58:12.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.586+0000 7f23b37fe640 1 -- 172.21.15.19:0/553491502 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7f23c40117b0 con 0x55d16033b5d0 2024-09-19T08:58:12.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.586+0000 7f23dcd84740 10 client.16758 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T08:58:12.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.586+0000 7f23dcd84740 10 client.16758 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-19T08:58:12.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.586+0000 7f23dcd84740 20 client.16758 populate_metadata read hostname 'smithi019' 2024-09-19T08:58:12.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.586+0000 7f23dcd84740 1 --2- 172.21.15.19:0/553491502 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55d160355e30 0x55d160358220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:12.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.586+0000 7f23dcd84740 4 client.16758 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:58:12.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.586+0000 7f23dcd84740 1 -- 172.21.15.19:0/553491502 --> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d1602ae860 con 0x55d160355e30 2024-09-19T08:58:12.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.587+0000 7f23cbfff640 1 --2- 172.21.15.19:0/553491502 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55d160355e30 0x55d160358220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:12.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.587+0000 7f23b37fe640 10 client.16758 ms_handle_connect on v2:172.21.15.155:6836/3381010945 2024-09-19T08:58:12.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.587+0000 7f23cbfff640 1 --2- 172.21.15.19:0/553491502 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55d160355e30 0x55d160358220 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=50c57ff56992f6ea server_cookie=3329cc8a2dc075ab in_seq=0 out_seq=0 2024-09-19T08:58:12.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.588+0000 7f23b37fe640 1 -- 172.21.15.19:0/553491502 <== mds.3 v2:172.21.15.155:6836/3381010945 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d1602ae860 con 0x55d160355e30 2024-09-19T08:58:12.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.588+0000 7f23b37fe640 10 client.16758 handle_command_reply: tid=0 2024-09-19T08:58:12.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.588+0000 7f23dcd84740 1 client.16758 shutdown 2024-09-19T08:58:12.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.588+0000 7f23dcd84740 1 -- 172.21.15.19:0/553491502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d16033b5d0 msgr2=0x55d160345d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:12.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.588+0000 7f23dcd84740 1 --2- 172.21.15.19:0/553491502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d16033b5d0 0x55d160345d40 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f23c400bfd0 tx=0x7f23c4011440 comp rx=0 tx=0).stop 2024-09-19T08:58:12.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.588+0000 7f23dcd84740 1 -- 172.21.15.19:0/553491502 shutdown_connections 2024-09-19T08:58:12.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.588+0000 7f23dcd84740 1 --2- 172.21.15.19:0/553491502 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55d160355e30 0x55d160358220 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.588+0000 7f23dcd84740 1 --2- 172.21.15.19:0/553491502 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d160346370 0x55d1603435e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.588+0000 7f23dcd84740 1 --2- 172.21.15.19:0/553491502 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d16033cb40 0x55d160342ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.588+0000 7f23b37fe640 0 client.16758 ms_handle_reset on v2:172.21.15.155:6836/3381010945 2024-09-19T08:58:12.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.588+0000 7f23dcd84740 1 --2- 172.21.15.19:0/553491502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d16033b5d0 0x55d160345d40 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.588+0000 7f23dcd84740 1 -- 172.21.15.19:0/553491502 >> 172.21.15.19:0/553491502 conn(0x55d160304310 msgr2=0x55d16033d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:12.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.588+0000 7f23dcd84740 1 -- 172.21.15.19:0/553491502 shutdown_connections 2024-09-19T08:58:12.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.588+0000 7f23dcd84740 1 -- 172.21.15.19:0/553491502 wait complete. 2024-09-19T08:58:12.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.588+0000 7f23dcd84740 20 client.16758 trim_cache size 0 max 16384 2024-09-19T08:58:12.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.601+0000 7f23dcd84740 1 Processor -- start 2024-09-19T08:58:12.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.601+0000 7f23dcd84740 1 -- start start 2024-09-19T08:58:12.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.602+0000 7f23dcd84740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d16033b5d0 0x55d1603418e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:12.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.602+0000 7f23dcd84740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d16033cb40 0x55d16033e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:12.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.602+0000 7f23dcd84740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d160346370 0x55d16033e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:12.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.602+0000 7f23dcd84740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f23d41ad5f0 con 0x55d16033cb40 2024-09-19T08:58:12.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.602+0000 7f23dcd84740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f23d41af130 con 0x55d16033b5d0 2024-09-19T08:58:12.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.602+0000 7f23dcd84740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f23d41adcc0 con 0x55d160346370 2024-09-19T08:58:12.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.602+0000 7f23cbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d16033cb40 0x55d16033e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:12.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.602+0000 7f23cbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d16033cb40 0x55d16033e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48190/0 (socket says 172.21.15.19:48190) 2024-09-19T08:58:12.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.602+0000 7f23cbfff640 1 -- 172.21.15.19:0/2413728162 learned_addr learned my addr 172.21.15.19:0/2413728162 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:12.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.602+0000 7f23d3fff640 1 --2- 172.21.15.19:0/2413728162 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d16033b5d0 0x55d1603418e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:12.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.602+0000 7f23cbfff640 1 -- 172.21.15.19:0/2413728162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d160346370 msgr2=0x55d16033e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:12.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.602+0000 7f23cbfff640 1 --2- 172.21.15.19:0/2413728162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d160346370 0x55d16033e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.602+0000 7f23cbfff640 1 -- 172.21.15.19:0/2413728162 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d16033b5d0 msgr2=0x55d1603418e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:12.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.602+0000 7f23cbfff640 1 --2- 172.21.15.19:0/2413728162 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d16033b5d0 0x55d1603418e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.602+0000 7f23cbfff640 1 -- 172.21.15.19:0/2413728162 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d160345960 con 0x55d16033cb40 2024-09-19T08:58:12.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.602+0000 7f23cbfff640 1 --2- 172.21.15.19:0/2413728162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d16033cb40 0x55d16033e120 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f23bc0cd150 tx=0x7f23bc086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc143a5557dfcbc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:12.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.602+0000 7f23c9ffb640 1 -- 172.21.15.19:0/2413728162 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23bc01d040 con 0x55d16033cb40 2024-09-19T08:58:12.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.602+0000 7f23c9ffb640 1 -- 172.21.15.19:0/2413728162 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23bc0d6040 con 0x55d16033cb40 2024-09-19T08:58:12.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.602+0000 7f23c9ffb640 1 -- 172.21.15.19:0/2413728162 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23bc09a000 con 0x55d16033cb40 2024-09-19T08:58:12.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.603+0000 7f23dcd84740 1 -- 172.21.15.19:0/2413728162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d16033cb40 msgr2=0x55d16033e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:12.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.603+0000 7f23dcd84740 1 --2- 172.21.15.19:0/2413728162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d16033cb40 0x55d16033e120 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f23bc0cd150 tx=0x7f23bc086040 comp rx=0 tx=0).stop 2024-09-19T08:58:12.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.603+0000 7f23dcd84740 1 -- 172.21.15.19:0/2413728162 shutdown_connections 2024-09-19T08:58:12.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.603+0000 7f23dcd84740 1 --2- 172.21.15.19:0/2413728162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d160346370 0x55d16033e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.603+0000 7f23dcd84740 1 --2- 172.21.15.19:0/2413728162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d16033cb40 0x55d16033e120 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.603+0000 7f23dcd84740 1 --2- 172.21.15.19:0/2413728162 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d16033b5d0 0x55d1603418e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.604+0000 7f23dcd84740 1 -- 172.21.15.19:0/2413728162 >> 172.21.15.19:0/2413728162 conn(0x55d160304310 msgr2=0x55d160345070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:12.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.604+0000 7f23dcd84740 1 -- 172.21.15.19:0/2413728162 shutdown_connections 2024-09-19T08:58:12.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.604+0000 7f23dcd84740 1 -- 172.21.15.19:0/2413728162 wait complete. 2024-09-19T08:58:12.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.604+0000 7f23dcd84740 1 -- start start 2024-09-19T08:58:12.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.604+0000 7f23dcd84740 1 Processor -- start 2024-09-19T08:58:12.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.604+0000 7f23dcd84740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d16033b5d0 0x55d16034e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:12.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.604+0000 7f23dcd84740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d16033cb40 0x55d16034eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:12.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.605+0000 7f23dcd84740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d160346370 0x55d16034b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:12.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.605+0000 7f23dcd84740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f23d41aea60 con 0x55d160346370 2024-09-19T08:58:12.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.605+0000 7f23dcd84740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f23d41ae390 con 0x55d16033b5d0 2024-09-19T08:58:12.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.605+0000 7f23dcd84740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f23d41ab5d0 con 0x55d16033cb40 2024-09-19T08:58:12.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.605+0000 7f23dcd84740 10 client.0 _ll_register_callbacks cb 0x7f23cc009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:12.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.605+0000 7f23d8f48640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d160346370 0x55d16034b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:12.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.605+0000 7f23d8f48640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d160346370 0x55d16034b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48196/0 (socket says 172.21.15.19:48196) 2024-09-19T08:58:12.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.605+0000 7f23d8f48640 1 -- 172.21.15.19:0/2159516922 learned_addr learned my addr 172.21.15.19:0/2159516922 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:12.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.605+0000 7f23cbfff640 1 --2- 172.21.15.19:0/2159516922 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d16033cb40 0x55d16034eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:12.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.605+0000 7f23d3fff640 1 --2- 172.21.15.19:0/2159516922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d16033b5d0 0x55d16034e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:12.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.605+0000 7f23d8f48640 1 -- 172.21.15.19:0/2159516922 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d16033cb40 msgr2=0x55d16034eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:12.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.605+0000 7f23d8f48640 1 --2- 172.21.15.19:0/2159516922 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d16033cb40 0x55d16034eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.605+0000 7f23d8f48640 1 -- 172.21.15.19:0/2159516922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d16033b5d0 msgr2=0x55d16034e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:12.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.605+0000 7f23d8f48640 1 --2- 172.21.15.19:0/2159516922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d16033b5d0 0x55d16034e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.605+0000 7f23d8f48640 1 -- 172.21.15.19:0/2159516922 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d16034bc80 con 0x55d160346370 2024-09-19T08:58:12.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.605+0000 7f23d8f48640 1 --2- 172.21.15.19:0/2159516922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d160346370 0x55d16034b450 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f23cc0049d0 tx=0x7f23cc009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4c46658c128edef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:12.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.605+0000 7f23b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:58:12.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.606+0000 7f23b37fe640 1 -- 172.21.15.19:0/2159516922 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23cc034040 con 0x55d160346370 2024-09-19T08:58:12.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.606+0000 7f23b37fe640 1 -- 172.21.15.19:0/2159516922 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f23cc0308c0 con 0x55d160346370 2024-09-19T08:58:12.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.606+0000 7f23dcd84740 1 -- 172.21.15.19:0/2159516922 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23bc0d6040 con 0x55d160346370 2024-09-19T08:58:12.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.606+0000 7f23b37fe640 1 -- 172.21.15.19:0/2159516922 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f23cc030ae0 con 0x55d160346370 2024-09-19T08:58:12.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.606+0000 7f23dcd84740 10 client.16764 fetch_fsmap learned FSMap version 34 2024-09-19T08:58:12.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.606+0000 7f23dcd84740 1 -- 172.21.15.19:0/2159516922 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d1603c1270 con 0x55d160346370 2024-09-19T08:58:12.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.606+0000 7f23b37fe640 1 -- 172.21.15.19:0/2159516922 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f23bc0d6040 con 0x55d160346370 2024-09-19T08:58:12.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.606+0000 7f23b37fe640 1 -- 172.21.15.19:0/2159516922 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7f23cc039420 con 0x55d160346370 2024-09-19T08:58:12.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.606+0000 7f23dcd84740 10 client.16764 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T08:58:12.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.606+0000 7f23dcd84740 10 client.16764 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-19T08:58:12.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.606+0000 7f23dcd84740 20 client.16764 populate_metadata read hostname 'smithi019' 2024-09-19T08:58:12.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.606+0000 7f23dcd84740 1 --2- 172.21.15.19:0/2159516922 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55d1603c19e0 0x55d1603c3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:12.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.606+0000 7f23dcd84740 4 client.16764 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:58:12.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.606+0000 7f23dcd84740 1 -- 172.21.15.19:0/2159516922 --> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d1602a8d70 con 0x55d1603c19e0 2024-09-19T08:58:12.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.606+0000 7f23d3fff640 1 --2- 172.21.15.19:0/2159516922 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55d1603c19e0 0x55d1603c3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:12.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.607+0000 7f23b37fe640 10 client.16764 ms_handle_connect on v2:172.21.15.155:6836/3381010945 2024-09-19T08:58:12.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.607+0000 7f23d3fff640 1 --2- 172.21.15.19:0/2159516922 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55d1603c19e0 0x55d1603c3dd0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f6733ed136792bfe server_cookie=71e18a1154da9a9e in_seq=0 out_seq=0 2024-09-19T08:58:12.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.607+0000 7f23b37fe640 1 -- 172.21.15.19:0/2159516922 <== mds.3 v2:172.21.15.155:6836/3381010945 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d1602a8d70 con 0x55d1603c19e0 2024-09-19T08:58:12.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.607+0000 7f23b37fe640 10 client.16764 handle_command_reply: tid=0 2024-09-19T08:58:12.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.607+0000 7f23dcd84740 1 client.16764 shutdown 2024-09-19T08:58:12.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.607+0000 7f23dcd84740 1 -- 172.21.15.19:0/2159516922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d160346370 msgr2=0x55d16034b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:12.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.607+0000 7f23dcd84740 1 --2- 172.21.15.19:0/2159516922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d160346370 0x55d16034b450 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f23cc0049d0 tx=0x7f23cc009360 comp rx=0 tx=0).stop 2024-09-19T08:58:12.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.607+0000 7f23dcd84740 1 -- 172.21.15.19:0/2159516922 shutdown_connections 2024-09-19T08:58:12.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.607+0000 7f23dcd84740 1 --2- 172.21.15.19:0/2159516922 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55d1603c19e0 0x55d1603c3dd0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.607+0000 7f23dcd84740 1 --2- 172.21.15.19:0/2159516922 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d16033cb40 0x55d16034eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.607+0000 7f23dcd84740 1 --2- 172.21.15.19:0/2159516922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d160346370 0x55d16034b450 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.607+0000 7f23dcd84740 1 --2- 172.21.15.19:0/2159516922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d16033b5d0 0x55d16034e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.607+0000 7f23dcd84740 1 -- 172.21.15.19:0/2159516922 >> 172.21.15.19:0/2159516922 conn(0x55d160304310 msgr2=0x55d160336310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:12.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.607+0000 7f23b37fe640 0 client.16764 ms_handle_reset on v2:172.21.15.155:6836/3381010945 2024-09-19T08:58:12.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.607+0000 7f23dcd84740 1 -- 172.21.15.19:0/2159516922 shutdown_connections 2024-09-19T08:58:12.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.608+0000 7f23dcd84740 1 -- 172.21.15.19:0/2159516922 wait complete. 2024-09-19T08:58:12.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.608+0000 7f23dcd84740 20 client.16764 trim_cache size 0 max 16384 2024-09-19T08:58:12.624 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T08:58:12.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.608+0000 7f23da9ab640 1 -- 172.21.15.19:0/1320781870 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f23c00a3240 msgr2=0x7f23c00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:12.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.608+0000 7f23da9ab640 1 --2- 172.21.15.19:0/1320781870 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f23c00a3240 0x7f23c00a5700 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f23cc009430 tx=0x7f23cc0095c0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.608+0000 7f23da9ab640 1 -- 172.21.15.19:0/1320781870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23d41036c0 msgr2=0x7f23d4198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:12.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.608+0000 7f23da9ab640 1 --2- 172.21.15.19:0/1320781870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23d41036c0 0x7f23d4198900 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f23bc00c890 tx=0x7f23bc00cd50 comp rx=0 tx=0).stop 2024-09-19T08:58:12.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.608+0000 7f23da9ab640 1 -- 172.21.15.19:0/1320781870 shutdown_connections 2024-09-19T08:58:12.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.608+0000 7f23da9ab640 1 --2- 172.21.15.19:0/1320781870 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f23c00a3240 0x7f23c00a5700 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.608+0000 7f23da9ab640 1 --2- 172.21.15.19:0/1320781870 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f23d410c180 0x7f23d419cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.608+0000 7f23da9ab640 1 --2- 172.21.15.19:0/1320781870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f23d41036c0 0x7f23d4198900 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.608+0000 7f23da9ab640 1 --2- 172.21.15.19:0/1320781870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f23d4102da0 0x7f23d41983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:12.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.608+0000 7f23da9ab640 1 -- 172.21.15.19:0/1320781870 >> 172.21.15.19:0/1320781870 conn(0x7f23d40fc7a0 msgr2=0x7f23d40fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:12.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.608+0000 7f23da9ab640 1 -- 172.21.15.19:0/1320781870 shutdown_connections 2024-09-19T08:58:12.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:12.608+0000 7f23da9ab640 1 -- 172.21.15.19:0/1320781870 wait complete. 2024-09-19T08:58:13.280 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T08:58:13.579 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:58:13.865 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:13 smithi019 ceph-mon[30976]: pgmap v517: 97 pgs: 97 active+clean; 2.5 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 924 KiB/s wr, 764 op/s 2024-09-19T08:58:13.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:13 smithi155 ceph-mon[34921]: pgmap v517: 97 pgs: 97 active+clean; 2.5 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 924 KiB/s wr, 764 op/s 2024-09-19T08:58:13.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:13 smithi203 ceph-mon[35450]: pgmap v517: 97 pgs: 97 active+clean; 2.5 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 622 KiB/s rd, 924 KiB/s wr, 764 op/s 2024-09-19T08:58:14.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.104+0000 7f2f570e6640 1 -- 172.21.15.19:0/1063447478 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f50102ef0 msgr2=0x7f2f5010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:14.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.104+0000 7f2f570e6640 1 --2- 172.21.15.19:0/1063447478 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f50102ef0 0x7f2f5010da40 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f2f48009ca0 tx=0x7f2f4802a950 comp rx=0 tx=0).stop 2024-09-19T08:58:14.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.104+0000 7f2f570e6640 1 -- 172.21.15.19:0/1063447478 shutdown_connections 2024-09-19T08:58:14.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.104+0000 7f2f570e6640 1 --2- 172.21.15.19:0/1063447478 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f50102ef0 0x7f2f5010da40 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.104+0000 7f2f570e6640 1 --2- 172.21.15.19:0/1063447478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f50102570 0x7f2f501029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.104+0000 7f2f570e6640 1 --2- 172.21.15.19:0/1063447478 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2f50100e20 0x7f2f50101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.104+0000 7f2f570e6640 1 -- 172.21.15.19:0/1063447478 >> 172.21.15.19:0/1063447478 conn(0x7f2f500fc7d0 msgr2=0x7f2f500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:14.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.104+0000 7f2f570e6640 1 -- 172.21.15.19:0/1063447478 shutdown_connections 2024-09-19T08:58:14.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.104+0000 7f2f570e6640 1 -- 172.21.15.19:0/1063447478 wait complete. 2024-09-19T08:58:14.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.104+0000 7f2f570e6640 1 Processor -- start 2024-09-19T08:58:14.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.104+0000 7f2f570e6640 1 -- start start 2024-09-19T08:58:14.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.105+0000 7f2f570e6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f50100e20 0x7f2f500fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:14.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.105+0000 7f2f570e6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f50102570 0x7f2f500fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:14.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.105+0000 7f2f570e6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2f50102ef0 0x7f2f500fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:14.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.105+0000 7f2f570e6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2f50111020 con 0x7f2f50100e20 2024-09-19T08:58:14.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.105+0000 7f2f570e6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2f50110ea0 con 0x7f2f50102570 2024-09-19T08:58:14.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.105+0000 7f2f570e6640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2f501111a0 con 0x7f2f50102ef0 2024-09-19T08:58:14.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.105+0000 7f2f54e82640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f50100e20 0x7f2f500fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:14.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.105+0000 7f2f54e82640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f50100e20 0x7f2f500fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48214/0 (socket says 172.21.15.19:48214) 2024-09-19T08:58:14.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.105+0000 7f2f54e82640 1 -- 172.21.15.19:0/3122938095 learned_addr learned my addr 172.21.15.19:0/3122938095 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:14.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.105+0000 7f2f55683640 1 --2- 172.21.15.19:0/3122938095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2f50102ef0 0x7f2f500fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:14.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.105+0000 7f2f4ffff640 1 --2- 172.21.15.19:0/3122938095 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f50102570 0x7f2f500fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:14.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.105+0000 7f2f54e82640 1 -- 172.21.15.19:0/3122938095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2f50102ef0 msgr2=0x7f2f500fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:14.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.105+0000 7f2f54e82640 1 --2- 172.21.15.19:0/3122938095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2f50102ef0 0x7f2f500fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.105+0000 7f2f54e82640 1 -- 172.21.15.19:0/3122938095 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f50102570 msgr2=0x7f2f500fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:14.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.105+0000 7f2f54e82640 1 --2- 172.21.15.19:0/3122938095 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f50102570 0x7f2f500fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.105+0000 7f2f54e82640 1 -- 172.21.15.19:0/3122938095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f501a6aa0 con 0x7f2f50100e20 2024-09-19T08:58:14.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.105+0000 7f2f54e82640 1 --2- 172.21.15.19:0/3122938095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f50100e20 0x7f2f500fcc80 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f2f4000b4a0 tx=0x7f2f4000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:14.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.105+0000 7f2f4dffb640 1 -- 172.21.15.19:0/3122938095 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f40014070 con 0x7f2f50100e20 2024-09-19T08:58:14.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.105+0000 7f2f570e6640 1 -- 172.21.15.19:0/3122938095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f501a6d90 con 0x7f2f50100e20 2024-09-19T08:58:14.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.105+0000 7f2f4dffb640 1 -- 172.21.15.19:0/3122938095 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f40010af0 con 0x7f2f50100e20 2024-09-19T08:58:14.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.105+0000 7f2f4dffb640 1 -- 172.21.15.19:0/3122938095 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f40017d10 con 0x7f2f50100e20 2024-09-19T08:58:14.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.106+0000 7f2f570e6640 1 -- 172.21.15.19:0/3122938095 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f501a7250 con 0x7f2f50100e20 2024-09-19T08:58:14.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.108+0000 7f2f4dffb640 1 -- 172.21.15.19:0/3122938095 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f2f40017070 con 0x7f2f50100e20 2024-09-19T08:58:14.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.108+0000 7f2f594bf740 1 Processor -- start 2024-09-19T08:58:14.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.108+0000 7f2f594bf740 1 -- start start 2024-09-19T08:58:14.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.108+0000 7f2f594bf740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab7de2cb40 0x55ab7de2b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:14.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.108+0000 7f2f594bf740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab7de2b5d0 0x55ab7de2ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:14.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.108+0000 7f2f594bf740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ab7de36370 0x55ab7de38760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:14.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.108+0000 7f2f594bf740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ab7dd912f0 con 0x55ab7de2cb40 2024-09-19T08:58:14.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.108+0000 7f2f594bf740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55ab7dd38cf0 con 0x55ab7de36370 2024-09-19T08:58:14.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.108+0000 7f2f594bf740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ab7dd8d2b0 con 0x55ab7de2b5d0 2024-09-19T08:58:14.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.108+0000 7f2f55683640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab7de2cb40 0x55ab7de2b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:14.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.109+0000 7f2f55683640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab7de2cb40 0x55ab7de2b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48222/0 (socket says 172.21.15.19:48222) 2024-09-19T08:58:14.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.109+0000 7f2f55683640 1 -- 172.21.15.19:0/217265668 learned_addr learned my addr 172.21.15.19:0/217265668 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:14.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.109+0000 7f2f4dffb640 1 --2- 172.21.15.19:0/3122938095 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2f380a3240 0x7f2f380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:14.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.109+0000 7f2f4ffff640 1 --2- 172.21.15.19:0/217265668 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ab7de36370 0x55ab7de38760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:14.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.109+0000 7f2f54e82640 1 --2- 172.21.15.19:0/217265668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab7de2b5d0 0x55ab7de2ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:14.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.109+0000 7f2f55683640 1 -- 172.21.15.19:0/217265668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab7de2b5d0 msgr2=0x55ab7de2ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:14.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.109+0000 7f2f4dffb640 1 -- 172.21.15.19:0/3122938095 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2f400cecd0 con 0x7f2f50100e20 2024-09-19T08:58:14.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.109+0000 7f2f55683640 1 --2- 172.21.15.19:0/217265668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab7de2b5d0 0x55ab7de2ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.109+0000 7f2f55683640 1 -- 172.21.15.19:0/217265668 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ab7de36370 msgr2=0x55ab7de38760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:14.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.109+0000 7f2f55683640 1 --2- 172.21.15.19:0/217265668 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ab7de36370 0x55ab7de38760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.109+0000 7f2f55683640 1 -- 172.21.15.19:0/217265668 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab7dd1d3a0 con 0x55ab7de2cb40 2024-09-19T08:58:14.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.109+0000 7f2f54e82640 1 --2- 172.21.15.19:0/217265668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab7de2b5d0 0x55ab7de2ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:58:14.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.109+0000 7f2f4ffff640 1 --2- 172.21.15.19:0/217265668 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ab7de36370 0x55ab7de38760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:58:14.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.109+0000 7f2f55683640 1 --2- 172.21.15.19:0/3122938095 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2f380a3240 0x7f2f380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:14.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.109+0000 7f2f55683640 1 --2- 172.21.15.19:0/217265668 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab7de2cb40 0x55ab7de2b090 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f2f48035000 tx=0x7f2f4802fff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=764c0b321bb7940a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:14.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.109+0000 7f2f36ffd640 1 -- 172.21.15.19:0/217265668 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f48034040 con 0x55ab7de2cb40 2024-09-19T08:58:14.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.109+0000 7f2f36ffd640 1 -- 172.21.15.19:0/217265668 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f48004520 con 0x55ab7de2cb40 2024-09-19T08:58:14.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.109+0000 7f2f36ffd640 1 -- 172.21.15.19:0/217265668 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f48046860 con 0x55ab7de2cb40 2024-09-19T08:58:14.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.109+0000 7f2f55683640 1 --2- 172.21.15.19:0/3122938095 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2f380a3240 0x7f2f380a5700 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2f4804d000 tx=0x7f2f4804a000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:14.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.110+0000 7f2f594bf740 1 -- 172.21.15.19:0/217265668 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab7de2cb40 msgr2=0x55ab7de2b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:14.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.110+0000 7f2f594bf740 1 --2- 172.21.15.19:0/217265668 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab7de2cb40 0x55ab7de2b090 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f2f48035000 tx=0x7f2f4802fff0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.110+0000 7f2f594bf740 1 -- 172.21.15.19:0/217265668 shutdown_connections 2024-09-19T08:58:14.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.110+0000 7f2f594bf740 1 --2- 172.21.15.19:0/217265668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab7de2b5d0 0x55ab7de2ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.110+0000 7f2f594bf740 1 --2- 172.21.15.19:0/217265668 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ab7de36370 0x55ab7de38760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.110+0000 7f2f594bf740 1 --2- 172.21.15.19:0/217265668 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab7de2cb40 0x55ab7de2b090 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.110+0000 7f2f594bf740 1 -- 172.21.15.19:0/217265668 >> 172.21.15.19:0/217265668 conn(0x55ab7ddf4310 msgr2=0x55ab7de27c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:14.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.110+0000 7f2f594bf740 1 -- 172.21.15.19:0/217265668 shutdown_connections 2024-09-19T08:58:14.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.110+0000 7f2f594bf740 1 -- 172.21.15.19:0/217265668 wait complete. 2024-09-19T08:58:14.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.111+0000 7f2f594bf740 1 -- start start 2024-09-19T08:58:14.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.111+0000 7f2f594bf740 1 Processor -- start 2024-09-19T08:58:14.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.111+0000 7f2f594bf740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab7de2b5d0 0x55ab7de35d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:14.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.111+0000 7f2f594bf740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ab7de2cb40 0x55ab7de33000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:14.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.111+0000 7f2f594bf740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab7de36370 0x55ab7de335d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:14.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.111+0000 7f2f594bf740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ab7de39070 con 0x55ab7de36370 2024-09-19T08:58:14.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.111+0000 7f2f594bf740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55ab7dd4c060 con 0x55ab7de2cb40 2024-09-19T08:58:14.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.111+0000 7f2f594bf740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ab7de391f0 con 0x55ab7de2b5d0 2024-09-19T08:58:14.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.111+0000 7f2f594bf740 10 client.0 _ll_register_callbacks cb 0x55ab7da9f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:14.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.111+0000 7f2f55683640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab7de36370 0x55ab7de335d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:14.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.111+0000 7f2f55683640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab7de36370 0x55ab7de335d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48228/0 (socket says 172.21.15.19:48228) 2024-09-19T08:58:14.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.111+0000 7f2f55683640 1 -- 172.21.15.19:0/3826433329 learned_addr learned my addr 172.21.15.19:0/3826433329 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:14.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.111+0000 7f2f4ffff640 1 --2- 172.21.15.19:0/3826433329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ab7de2cb40 0x55ab7de33000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:14.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.112+0000 7f2f54e82640 1 --2- 172.21.15.19:0/3826433329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab7de2b5d0 0x55ab7de35d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:14.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.112+0000 7f2f55683640 1 -- 172.21.15.19:0/3826433329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab7de2b5d0 msgr2=0x55ab7de35d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:14.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.112+0000 7f2f55683640 1 --2- 172.21.15.19:0/3826433329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab7de2b5d0 0x55ab7de35d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.112+0000 7f2f55683640 1 -- 172.21.15.19:0/3826433329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ab7de2cb40 msgr2=0x55ab7de33000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:14.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.112+0000 7f2f55683640 1 --2- 172.21.15.19:0/3826433329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ab7de2cb40 0x55ab7de33000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.112+0000 7f2f55683640 1 -- 172.21.15.19:0/3826433329 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab7db023c0 con 0x55ab7de36370 2024-09-19T08:58:14.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.112+0000 7f2f55683640 1 --2- 172.21.15.19:0/3826433329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab7de36370 0x55ab7de335d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f2f4802f890 tx=0x7f2f4802f3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8156e3a4d99d4b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:14.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.112+0000 7f2f2ffff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:58:14.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.112+0000 7f2f2ffff640 1 -- 172.21.15.19:0/3826433329 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f48046d70 con 0x55ab7de36370 2024-09-19T08:58:14.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.112+0000 7f2f2ffff640 1 -- 172.21.15.19:0/3826433329 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2f48004040 con 0x55ab7de36370 2024-09-19T08:58:14.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.112+0000 7f2f594bf740 1 -- 172.21.15.19:0/3826433329 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f48004520 con 0x55ab7de36370 2024-09-19T08:58:14.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.112+0000 7f2f2ffff640 1 -- 172.21.15.19:0/3826433329 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2f480098d0 con 0x55ab7de36370 2024-09-19T08:58:14.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.112+0000 7f2f594bf740 10 client.16776 fetch_fsmap learned FSMap version 34 2024-09-19T08:58:14.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.112+0000 7f2f594bf740 1 -- 172.21.15.19:0/3826433329 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ab7de39070 con 0x55ab7de36370 2024-09-19T08:58:14.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.113+0000 7f2f2ffff640 1 -- 172.21.15.19:0/3826433329 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f48004520 con 0x55ab7de36370 2024-09-19T08:58:14.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.113+0000 7f2f2ffff640 1 -- 172.21.15.19:0/3826433329 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7f2f48051440 con 0x55ab7de36370 2024-09-19T08:58:14.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.113+0000 7f2f594bf740 10 client.16776 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T08:58:14.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.113+0000 7f2f594bf740 10 client.16776 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T08:58:14.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.113+0000 7f2f594bf740 20 client.16776 populate_metadata read hostname 'smithi019' 2024-09-19T08:58:14.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.113+0000 7f2f594bf740 1 --2- 172.21.15.19:0/3826433329 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55ab7de45c10 0x55ab7de48000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:14.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.113+0000 7f2f594bf740 4 client.16776 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:58:14.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.113+0000 7f2f594bf740 1 -- 172.21.15.19:0/3826433329 --> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab7dd9e860 con 0x55ab7de45c10 2024-09-19T08:58:14.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.113+0000 7f2f54e82640 1 --2- 172.21.15.19:0/3826433329 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55ab7de45c10 0x55ab7de48000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:14.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.114+0000 7f2f54e82640 1 --2- 172.21.15.19:0/3826433329 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55ab7de45c10 0x55ab7de48000 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3835363dfa2424e0 server_cookie=cd021c605724f82c in_seq=0 out_seq=0 2024-09-19T08:58:14.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.114+0000 7f2f2ffff640 10 client.16776 ms_handle_connect on v2:172.21.15.203:6836/3684671619 2024-09-19T08:58:14.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.114+0000 7f2f2ffff640 1 -- 172.21.15.19:0/3826433329 <== mds.2 v2:172.21.15.203:6836/3684671619 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ab7dd9e860 con 0x55ab7de45c10 2024-09-19T08:58:14.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.114+0000 7f2f2ffff640 10 client.16776 handle_command_reply: tid=0 2024-09-19T08:58:14.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.114+0000 7f2f594bf740 1 client.16776 shutdown 2024-09-19T08:58:14.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.115+0000 7f2f594bf740 1 -- 172.21.15.19:0/3826433329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab7de36370 msgr2=0x55ab7de335d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:14.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.115+0000 7f2f594bf740 1 --2- 172.21.15.19:0/3826433329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab7de36370 0x55ab7de335d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f2f4802f890 tx=0x7f2f4802f3a0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.115+0000 7f2f594bf740 1 -- 172.21.15.19:0/3826433329 shutdown_connections 2024-09-19T08:58:14.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.115+0000 7f2f594bf740 1 --2- 172.21.15.19:0/3826433329 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55ab7de45c10 0x55ab7de48000 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.115+0000 7f2f594bf740 1 --2- 172.21.15.19:0/3826433329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab7de36370 0x55ab7de335d0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.115+0000 7f2f594bf740 1 --2- 172.21.15.19:0/3826433329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ab7de2cb40 0x55ab7de33000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.115+0000 7f2f594bf740 1 --2- 172.21.15.19:0/3826433329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab7de2b5d0 0x55ab7de35d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.115+0000 7f2f594bf740 1 -- 172.21.15.19:0/3826433329 >> 172.21.15.19:0/3826433329 conn(0x55ab7ddf4310 msgr2=0x55ab7de2d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:14.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.115+0000 7f2f2ffff640 0 client.16776 ms_handle_reset on v2:172.21.15.203:6836/3684671619 2024-09-19T08:58:14.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.115+0000 7f2f594bf740 1 -- 172.21.15.19:0/3826433329 shutdown_connections 2024-09-19T08:58:14.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.115+0000 7f2f594bf740 1 -- 172.21.15.19:0/3826433329 wait complete. 2024-09-19T08:58:14.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.115+0000 7f2f594bf740 20 client.16776 trim_cache size 0 max 16384 2024-09-19T08:58:14.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.128+0000 7f2f594bf740 1 Processor -- start 2024-09-19T08:58:14.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.128+0000 7f2f594bf740 1 -- start start 2024-09-19T08:58:14.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.128+0000 7f2f594bf740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab7de2b5d0 0x55ab7de27d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:14.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.128+0000 7f2f594bf740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab7de2cb40 0x55ab7de42340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:14.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.128+0000 7f2f594bf740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ab7de36370 0x55ab7de2e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:14.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.128+0000 7f2f594bf740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2f501af840 con 0x55ab7de2cb40 2024-09-19T08:58:14.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.128+0000 7f2f594bf740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2f501b1380 con 0x55ab7de36370 2024-09-19T08:58:14.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.128+0000 7f2f594bf740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2f501aff10 con 0x55ab7de2b5d0 2024-09-19T08:58:14.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.128+0000 7f2f4ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab7de2cb40 0x55ab7de42340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:14.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.129+0000 7f2f54e82640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab7de2b5d0 0x55ab7de27d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:14.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.129+0000 7f2f4ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab7de2cb40 0x55ab7de42340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48240/0 (socket says 172.21.15.19:48240) 2024-09-19T08:58:14.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.129+0000 7f2f4ffff640 1 -- 172.21.15.19:0/750748934 learned_addr learned my addr 172.21.15.19:0/750748934 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:14.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.129+0000 7f2f55683640 1 --2- 172.21.15.19:0/750748934 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ab7de36370 0x55ab7de2e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:14.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.129+0000 7f2f4ffff640 1 -- 172.21.15.19:0/750748934 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab7de2b5d0 msgr2=0x55ab7de27d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:14.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.129+0000 7f2f4ffff640 1 --2- 172.21.15.19:0/750748934 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab7de2b5d0 0x55ab7de27d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.129+0000 7f2f4ffff640 1 -- 172.21.15.19:0/750748934 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ab7de36370 msgr2=0x55ab7de2e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:14.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.129+0000 7f2f4ffff640 1 --2- 172.21.15.19:0/750748934 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ab7de36370 0x55ab7de2e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.129+0000 7f2f4ffff640 1 -- 172.21.15.19:0/750748934 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab7de338d0 con 0x55ab7de2cb40 2024-09-19T08:58:14.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.129+0000 7f2f54e82640 1 --2- 172.21.15.19:0/750748934 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab7de2b5d0 0x55ab7de27d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:58:14.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.129+0000 7f2f4ffff640 1 --2- 172.21.15.19:0/750748934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab7de2cb40 0x55ab7de42340 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f2f4400b7c0 tx=0x7f2f4400bbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de5917d3dcf5d3d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:14.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.129+0000 7f2f367fc640 1 -- 172.21.15.19:0/750748934 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4401b070 con 0x55ab7de2cb40 2024-09-19T08:58:14.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.129+0000 7f2f367fc640 1 -- 172.21.15.19:0/750748934 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f4400be10 con 0x55ab7de2cb40 2024-09-19T08:58:14.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.129+0000 7f2f367fc640 1 -- 172.21.15.19:0/750748934 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f44015d80 con 0x55ab7de2cb40 2024-09-19T08:58:14.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.130+0000 7f2f594bf740 1 -- 172.21.15.19:0/750748934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab7de2cb40 msgr2=0x55ab7de42340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:14.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.130+0000 7f2f594bf740 1 --2- 172.21.15.19:0/750748934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab7de2cb40 0x55ab7de42340 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f2f4400b7c0 tx=0x7f2f4400bbc0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.130+0000 7f2f594bf740 1 -- 172.21.15.19:0/750748934 shutdown_connections 2024-09-19T08:58:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.130+0000 7f2f594bf740 1 --2- 172.21.15.19:0/750748934 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ab7de36370 0x55ab7de2e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.130+0000 7f2f594bf740 1 --2- 172.21.15.19:0/750748934 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab7de2cb40 0x55ab7de42340 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.130+0000 7f2f594bf740 1 --2- 172.21.15.19:0/750748934 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab7de2b5d0 0x55ab7de27d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.130+0000 7f2f594bf740 1 -- 172.21.15.19:0/750748934 >> 172.21.15.19:0/750748934 conn(0x55ab7ddf4310 msgr2=0x55ab7de320f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.130+0000 7f2f594bf740 1 -- 172.21.15.19:0/750748934 shutdown_connections 2024-09-19T08:58:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.130+0000 7f2f594bf740 1 -- 172.21.15.19:0/750748934 wait complete. 2024-09-19T08:58:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.130+0000 7f2f594bf740 1 -- start start 2024-09-19T08:58:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.130+0000 7f2f594bf740 1 Processor -- start 2024-09-19T08:58:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.131+0000 7f2f594bf740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ab7de2b5d0 0x55ab7de3e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.131+0000 7f2f594bf740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab7de2cb40 0x55ab7de3e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.131+0000 7f2f594bf740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab7de36370 0x55ab7de318d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.131+0000 7f2f594bf740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2f501b0cb0 con 0x55ab7de36370 2024-09-19T08:58:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.131+0000 7f2f594bf740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2f501b05e0 con 0x55ab7de2b5d0 2024-09-19T08:58:14.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.131+0000 7f2f594bf740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2f501ad820 con 0x55ab7de2cb40 2024-09-19T08:58:14.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.131+0000 7f2f594bf740 10 client.0 _ll_register_callbacks cb 0x7f2f4802ff20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:14.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.131+0000 7f2f55683640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab7de36370 0x55ab7de318d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:14.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.131+0000 7f2f55683640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab7de36370 0x55ab7de318d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:48242/0 (socket says 172.21.15.19:48242) 2024-09-19T08:58:14.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.131+0000 7f2f55683640 1 -- 172.21.15.19:0/3498284802 learned_addr learned my addr 172.21.15.19:0/3498284802 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:14.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.131+0000 7f2f54e82640 1 --2- 172.21.15.19:0/3498284802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ab7de2b5d0 0x55ab7de3e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:14.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.131+0000 7f2f4ffff640 1 --2- 172.21.15.19:0/3498284802 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab7de2cb40 0x55ab7de3e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:14.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.131+0000 7f2f55683640 1 -- 172.21.15.19:0/3498284802 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab7de2cb40 msgr2=0x55ab7de3e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:14.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.131+0000 7f2f55683640 1 --2- 172.21.15.19:0/3498284802 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab7de2cb40 0x55ab7de3e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.131+0000 7f2f55683640 1 -- 172.21.15.19:0/3498284802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ab7de2b5d0 msgr2=0x55ab7de3e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:14.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.131+0000 7f2f55683640 1 --2- 172.21.15.19:0/3498284802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ab7de2b5d0 0x55ab7de3e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.131+0000 7f2f55683640 1 -- 172.21.15.19:0/3498284802 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab7de3f030 con 0x55ab7de36370 2024-09-19T08:58:14.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.131+0000 7f2f4ffff640 1 --2- 172.21.15.19:0/3498284802 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab7de2cb40 0x55ab7de3e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:58:14.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.131+0000 7f2f55683640 1 --2- 172.21.15.19:0/3498284802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab7de36370 0x55ab7de318d0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f2f48003fd0 tx=0x7f2f48046da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5addd88749ef5179 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:14.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.131+0000 7f2f2ffff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:58:14.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.132+0000 7f2f2ffff640 1 -- 172.21.15.19:0/3498284802 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f48046870 con 0x55ab7de36370 2024-09-19T08:58:14.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.132+0000 7f2f2ffff640 1 -- 172.21.15.19:0/3498284802 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2f48004040 con 0x55ab7de36370 2024-09-19T08:58:14.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.132+0000 7f2f594bf740 1 -- 172.21.15.19:0/3498284802 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f4400be10 con 0x55ab7de36370 2024-09-19T08:58:14.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.132+0000 7f2f2ffff640 1 -- 172.21.15.19:0/3498284802 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2f48071050 con 0x55ab7de36370 2024-09-19T08:58:14.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.132+0000 7f2f594bf740 10 client.16782 fetch_fsmap learned FSMap version 34 2024-09-19T08:58:14.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.132+0000 7f2f594bf740 1 -- 172.21.15.19:0/3498284802 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ab7deafcd0 con 0x55ab7de36370 2024-09-19T08:58:14.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.132+0000 7f2f2ffff640 1 -- 172.21.15.19:0/3498284802 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f4400be10 con 0x55ab7de36370 2024-09-19T08:58:14.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.132+0000 7f2f2ffff640 1 -- 172.21.15.19:0/3498284802 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7f2f48069020 con 0x55ab7de36370 2024-09-19T08:58:14.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.132+0000 7f2f594bf740 10 client.16782 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T08:58:14.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.132+0000 7f2f594bf740 10 client.16782 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T08:58:14.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.132+0000 7f2f594bf740 20 client.16782 populate_metadata read hostname 'smithi019' 2024-09-19T08:58:14.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.132+0000 7f2f594bf740 1 --2- 172.21.15.19:0/3498284802 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55ab7deb03b0 0x55ab7deb27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:14.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.132+0000 7f2f594bf740 4 client.16782 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:58:14.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.132+0000 7f2f594bf740 1 -- 172.21.15.19:0/3498284802 --> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ab7dd98d70 con 0x55ab7deb03b0 2024-09-19T08:58:14.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.133+0000 7f2f54e82640 1 --2- 172.21.15.19:0/3498284802 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55ab7deb03b0 0x55ab7deb27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:14.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.133+0000 7f2f2ffff640 10 client.16782 ms_handle_connect on v2:172.21.15.203:6836/3684671619 2024-09-19T08:58:14.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.133+0000 7f2f54e82640 1 --2- 172.21.15.19:0/3498284802 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55ab7deb03b0 0x55ab7deb27d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3482082d37c65ed0 server_cookie=e954872ab39d9342 in_seq=0 out_seq=0 2024-09-19T08:58:14.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.133+0000 7f2f2ffff640 1 -- 172.21.15.19:0/3498284802 <== mds.2 v2:172.21.15.203:6836/3684671619 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ab7dd98d70 con 0x55ab7deb03b0 2024-09-19T08:58:14.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.133+0000 7f2f2ffff640 10 client.16782 handle_command_reply: tid=0 2024-09-19T08:58:14.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.133+0000 7f2f594bf740 1 client.16782 shutdown 2024-09-19T08:58:14.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.133+0000 7f2f594bf740 1 -- 172.21.15.19:0/3498284802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab7de36370 msgr2=0x55ab7de318d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:14.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.133+0000 7f2f594bf740 1 --2- 172.21.15.19:0/3498284802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab7de36370 0x55ab7de318d0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f2f48003fd0 tx=0x7f2f48046da0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.133+0000 7f2f594bf740 1 -- 172.21.15.19:0/3498284802 shutdown_connections 2024-09-19T08:58:14.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.134+0000 7f2f594bf740 1 --2- 172.21.15.19:0/3498284802 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55ab7deb03b0 0x55ab7deb27d0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.134+0000 7f2f594bf740 1 --2- 172.21.15.19:0/3498284802 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab7de2cb40 0x55ab7de3e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.134+0000 7f2f594bf740 1 --2- 172.21.15.19:0/3498284802 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ab7de36370 0x55ab7de318d0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.134+0000 7f2f594bf740 1 --2- 172.21.15.19:0/3498284802 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ab7de2b5d0 0x55ab7de3e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.134+0000 7f2f594bf740 1 -- 172.21.15.19:0/3498284802 >> 172.21.15.19:0/3498284802 conn(0x55ab7ddf4310 msgr2=0x55ab7de264e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:14.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.134+0000 7f2f2ffff640 0 client.16782 ms_handle_reset on v2:172.21.15.203:6836/3684671619 2024-09-19T08:58:14.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.134+0000 7f2f594bf740 1 -- 172.21.15.19:0/3498284802 shutdown_connections 2024-09-19T08:58:14.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.134+0000 7f2f594bf740 1 -- 172.21.15.19:0/3498284802 wait complete. 2024-09-19T08:58:14.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.134+0000 7f2f594bf740 20 client.16782 trim_cache size 0 max 16384 2024-09-19T08:58:14.139 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T08:58:14.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.134+0000 7f2f570e6640 1 -- 172.21.15.19:0/3122938095 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2f380a3240 msgr2=0x7f2f380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:14.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.134+0000 7f2f570e6640 1 --2- 172.21.15.19:0/3122938095 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2f380a3240 0x7f2f380a5700 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2f4804d000 tx=0x7f2f4804a000 comp rx=0 tx=0).stop 2024-09-19T08:58:14.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.134+0000 7f2f570e6640 1 -- 172.21.15.19:0/3122938095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f50100e20 msgr2=0x7f2f500fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:14.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.134+0000 7f2f570e6640 1 --2- 172.21.15.19:0/3122938095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f50100e20 0x7f2f500fcc80 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f2f4000b4a0 tx=0x7f2f4000b960 comp rx=0 tx=0).stop 2024-09-19T08:58:14.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.134+0000 7f2f570e6640 1 -- 172.21.15.19:0/3122938095 shutdown_connections 2024-09-19T08:58:14.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.134+0000 7f2f570e6640 1 --2- 172.21.15.19:0/3122938095 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2f380a3240 0x7f2f380a5700 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.134+0000 7f2f570e6640 1 --2- 172.21.15.19:0/3122938095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2f50102ef0 0x7f2f500fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.134+0000 7f2f570e6640 1 --2- 172.21.15.19:0/3122938095 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f50102570 0x7f2f500fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.134+0000 7f2f570e6640 1 --2- 172.21.15.19:0/3122938095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f50100e20 0x7f2f500fcc80 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:14.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.134+0000 7f2f570e6640 1 -- 172.21.15.19:0/3122938095 >> 172.21.15.19:0/3122938095 conn(0x7f2f500fc7d0 msgr2=0x7f2f5006a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:14.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.135+0000 7f2f570e6640 1 -- 172.21.15.19:0/3122938095 shutdown_connections 2024-09-19T08:58:14.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:14.135+0000 7f2f570e6640 1 -- 172.21.15.19:0/3122938095 wait complete. 2024-09-19T08:58:14.791 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T08:58:15.050 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:58:15.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.514+0000 7f2c47fae640 1 -- 172.21.15.19:0/645559463 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c40102da0 msgr2=0x7f2c40103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:15.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.514+0000 7f2c47fae640 1 --2- 172.21.15.19:0/645559463 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c40102da0 0x7f2c40103180 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c009900 tx=0x7f2c3c02a480 comp rx=0 tx=0).stop 2024-09-19T08:58:15.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.514+0000 7f2c47fae640 1 -- 172.21.15.19:0/645559463 shutdown_connections 2024-09-19T08:58:15.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.514+0000 7f2c47fae640 1 --2- 172.21.15.19:0/645559463 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2c4010c180 0x7f2c4010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:15.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.514+0000 7f2c47fae640 1 --2- 172.21.15.19:0/645559463 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c401036c0 0x7f2c4010bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:15.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.514+0000 7f2c47fae640 1 --2- 172.21.15.19:0/645559463 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c40102da0 0x7f2c40103180 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:15.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.514+0000 7f2c47fae640 1 -- 172.21.15.19:0/645559463 >> 172.21.15.19:0/645559463 conn(0x7f2c400fc7a0 msgr2=0x7f2c400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:15.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.514+0000 7f2c47fae640 1 -- 172.21.15.19:0/645559463 shutdown_connections 2024-09-19T08:58:15.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.514+0000 7f2c47fae640 1 -- 172.21.15.19:0/645559463 wait complete. 2024-09-19T08:58:15.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.515+0000 7f2c47fae640 1 Processor -- start 2024-09-19T08:58:15.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.515+0000 7f2c47fae640 1 -- start start 2024-09-19T08:58:15.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.515+0000 7f2c47fae640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2c40102da0 0x7f2c40198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:15.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.515+0000 7f2c47fae640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c401036c0 0x7f2c40198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:15.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.515+0000 7f2c47fae640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c4010c180 0x7f2c4019ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:15.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.515+0000 7f2c47fae640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2c40111f60 con 0x7f2c4010c180 2024-09-19T08:58:15.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.515+0000 7f2c47fae640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2c40111de0 con 0x7f2c401036c0 2024-09-19T08:58:15.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.515+0000 7f2c47fae640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2c401120e0 con 0x7f2c40102da0 2024-09-19T08:58:15.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.515+0000 7f2c4654b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c4010c180 0x7f2c4019ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:15.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.515+0000 7f2c4654b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c4010c180 0x7f2c4019ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54884/0 (socket says 172.21.15.19:54884) 2024-09-19T08:58:15.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.515+0000 7f2c4654b640 1 -- 172.21.15.19:0/602502974 learned_addr learned my addr 172.21.15.19:0/602502974 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:15.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.515+0000 7f2c45549640 1 --2- 172.21.15.19:0/602502974 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c401036c0 0x7f2c40198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:15.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.516+0000 7f2c45d4a640 1 --2- 172.21.15.19:0/602502974 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2c40102da0 0x7f2c40198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:15.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.516+0000 7f2c4654b640 1 -- 172.21.15.19:0/602502974 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2c40102da0 msgr2=0x7f2c40198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:15.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.516+0000 7f2c4654b640 1 --2- 172.21.15.19:0/602502974 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2c40102da0 0x7f2c40198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:15.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.516+0000 7f2c4654b640 1 -- 172.21.15.19:0/602502974 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c401036c0 msgr2=0x7f2c40198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:15.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.516+0000 7f2c4654b640 1 --2- 172.21.15.19:0/602502974 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c401036c0 0x7f2c40198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:15.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.516+0000 7f2c4654b640 1 -- 172.21.15.19:0/602502974 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c4019d3d0 con 0x7f2c4010c180 2024-09-19T08:58:15.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.516+0000 7f2c4654b640 1 --2- 172.21.15.19:0/602502974 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c4010c180 0x7f2c4019ccf0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f2c3800eaa0 tx=0x7f2c3800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:15.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.516+0000 7f2c36ffd640 1 -- 172.21.15.19:0/602502974 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3800cdb0 con 0x7f2c4010c180 2024-09-19T08:58:15.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.516+0000 7f2c36ffd640 1 -- 172.21.15.19:0/602502974 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c38005020 con 0x7f2c4010c180 2024-09-19T08:58:15.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.516+0000 7f2c47fae640 1 -- 172.21.15.19:0/602502974 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c4019d6c0 con 0x7f2c4010c180 2024-09-19T08:58:15.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.516+0000 7f2c36ffd640 1 -- 172.21.15.19:0/602502974 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c380116d0 con 0x7f2c4010c180 2024-09-19T08:58:15.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.516+0000 7f2c47fae640 1 -- 172.21.15.19:0/602502974 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c401a4fa0 con 0x7f2c4010c180 2024-09-19T08:58:15.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.518+0000 7f2c36ffd640 1 -- 172.21.15.19:0/602502974 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f2c380054d0 con 0x7f2c4010c180 2024-09-19T08:58:15.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.519+0000 7f2c4a387740 1 Processor -- start 2024-09-19T08:58:15.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.519+0000 7f2c4a387740 1 -- start start 2024-09-19T08:58:15.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.519+0000 7f2c4a387740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e406c10b40 0x55e406c0f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:15.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.519+0000 7f2c4a387740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e406c0f5d0 0x55e406c0fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:15.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.519+0000 7f2c4a387740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e406c1e780 0x55e406c20b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:15.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.519+0000 7f2c4a387740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e406b752f0 con 0x55e406c1e780 2024-09-19T08:58:15.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.519+0000 7f2c4a387740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55e406b1ccf0 con 0x55e406c10b40 2024-09-19T08:58:15.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.519+0000 7f2c4a387740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e406b712b0 con 0x55e406c0f5d0 2024-09-19T08:58:15.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.519+0000 7f2c45549640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e406c1e780 0x55e406c20b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:15.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.519+0000 7f2c36ffd640 1 --2- 172.21.15.19:0/602502974 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2c2c0a3240 0x7f2c2c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:15.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.519+0000 7f2c45549640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e406c1e780 0x55e406c20b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54898/0 (socket says 172.21.15.19:54898) 2024-09-19T08:58:15.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.519+0000 7f2c45549640 1 -- 172.21.15.19:0/975801865 learned_addr learned my addr 172.21.15.19:0/975801865 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:15.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.519+0000 7f2c45549640 1 --2- 172.21.15.19:0/975801865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e406c10b40 0x55e406c0f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:15.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.519+0000 7f2c4654b640 1 --2- 172.21.15.19:0/602502974 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2c2c0a3240 0x7f2c2c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:15.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.519+0000 7f2c45d4a640 1 --2- 172.21.15.19:0/975801865 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e406c0f5d0 0x55e406c0fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:15.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.520+0000 7f2c36ffd640 1 -- 172.21.15.19:0/602502974 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2c380cfb60 con 0x7f2c4010c180 2024-09-19T08:58:15.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.520+0000 7f2c45549640 1 -- 172.21.15.19:0/975801865 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e406c0f5d0 msgr2=0x55e406c0fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:15.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.520+0000 7f2c45549640 1 --2- 172.21.15.19:0/975801865 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e406c0f5d0 0x55e406c0fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:15.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.520+0000 7f2c45549640 1 -- 172.21.15.19:0/975801865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e406c10b40 msgr2=0x55e406c0f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:15.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.520+0000 7f2c45549640 1 --2- 172.21.15.19:0/975801865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e406c10b40 0x55e406c0f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:15.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.520+0000 7f2c45549640 1 -- 172.21.15.19:0/975801865 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e406b013a0 con 0x55e406c1e780 2024-09-19T08:58:15.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.520+0000 7f2c4654b640 1 --2- 172.21.15.19:0/602502974 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2c2c0a3240 0x7f2c2c0a5700 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2c38098590 tx=0x7f2c38066b70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:15.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.520+0000 7f2c45549640 1 --2- 172.21.15.19:0/975801865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e406c1e780 0x55e406c20b70 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f2c300127d0 tx=0x7f2c3000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20127640b7d9d457 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:15.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.520+0000 7f2c2bfff640 1 -- 172.21.15.19:0/975801865 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c30010770 con 0x55e406c1e780 2024-09-19T08:58:15.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.520+0000 7f2c2bfff640 1 -- 172.21.15.19:0/975801865 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c30010df0 con 0x55e406c1e780 2024-09-19T08:58:15.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.520+0000 7f2c2bfff640 1 -- 172.21.15.19:0/975801865 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3001fbe0 con 0x55e406c1e780 2024-09-19T08:58:15.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.521+0000 7f2c4a387740 1 -- 172.21.15.19:0/975801865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e406c1e780 msgr2=0x55e406c20b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:15.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.521+0000 7f2c4a387740 1 --2- 172.21.15.19:0/975801865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e406c1e780 0x55e406c20b70 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f2c300127d0 tx=0x7f2c3000b870 comp rx=0 tx=0).stop 2024-09-19T08:58:15.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.521+0000 7f2c4a387740 1 -- 172.21.15.19:0/975801865 shutdown_connections 2024-09-19T08:58:15.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.521+0000 7f2c4a387740 1 --2- 172.21.15.19:0/975801865 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e406c0f5d0 0x55e406c0fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:15.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.521+0000 7f2c4a387740 1 --2- 172.21.15.19:0/975801865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e406c1e780 0x55e406c20b70 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:15.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.521+0000 7f2c4a387740 1 --2- 172.21.15.19:0/975801865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e406c10b40 0x55e406c0f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:15.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.521+0000 7f2c4a387740 1 -- 172.21.15.19:0/975801865 >> 172.21.15.19:0/975801865 conn(0x55e406bd8310 msgr2=0x55e406c0bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:15.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.521+0000 7f2c4a387740 1 -- 172.21.15.19:0/975801865 shutdown_connections 2024-09-19T08:58:15.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.521+0000 7f2c4a387740 1 -- 172.21.15.19:0/975801865 wait complete. 2024-09-19T08:58:15.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.521+0000 7f2c4a387740 1 -- start start 2024-09-19T08:58:15.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.522+0000 7f2c4a387740 1 Processor -- start 2024-09-19T08:58:15.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.522+0000 7f2c4a387740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e406c0f5d0 0x55e406c1e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:15.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.522+0000 7f2c4a387740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e406c10b40 0x55e406c1b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:15.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.522+0000 7f2c4a387740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e406c1e780 0x55e406c1ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:15.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.522+0000 7f2c4a387740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e406c21480 con 0x55e406c0f5d0 2024-09-19T08:58:15.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.522+0000 7f2c4a387740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55e406b30060 con 0x55e406c10b40 2024-09-19T08:58:15.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.522+0000 7f2c4a387740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e406c21600 con 0x55e406c1e780 2024-09-19T08:58:15.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.522+0000 7f2c4a387740 10 client.0 _ll_register_callbacks cb 0x55e4068838c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:15.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.522+0000 7f2c45549640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e406c0f5d0 0x55e406c1e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:15.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.522+0000 7f2c45549640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e406c0f5d0 0x55e406c1e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54908/0 (socket says 172.21.15.19:54908) 2024-09-19T08:58:15.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.522+0000 7f2c45549640 1 -- 172.21.15.19:0/1720974976 learned_addr learned my addr 172.21.15.19:0/1720974976 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:15.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.522+0000 7f2c45d4a640 1 --2- 172.21.15.19:0/1720974976 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e406c10b40 0x55e406c1b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:15.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.522+0000 7f2c45549640 1 -- 172.21.15.19:0/1720974976 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e406c1e780 msgr2=0x55e406c1ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:15.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.522+0000 7f2c45549640 1 --2- 172.21.15.19:0/1720974976 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e406c1e780 0x55e406c1ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:15.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.522+0000 7f2c45549640 1 -- 172.21.15.19:0/1720974976 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e406c10b40 msgr2=0x55e406c1b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:15.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.522+0000 7f2c45549640 1 --2- 172.21.15.19:0/1720974976 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e406c10b40 0x55e406c1b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:15.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.522+0000 7f2c45549640 1 -- 172.21.15.19:0/1720974976 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e4068e63c0 con 0x55e406c0f5d0 2024-09-19T08:58:15.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.523+0000 7f2c45549640 1 --2- 172.21.15.19:0/1720974976 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e406c0f5d0 0x55e406c1e190 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f2c3001f7c0 tx=0x7f2c3000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7daeebb5d7300dc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:15.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.523+0000 7f2c297fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:58:15.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.523+0000 7f2c297fa640 1 -- 172.21.15.19:0/1720974976 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3002c060 con 0x55e406c0f5d0 2024-09-19T08:58:15.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.523+0000 7f2c297fa640 1 -- 172.21.15.19:0/1720974976 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2c3001fdd0 con 0x55e406c0f5d0 2024-09-19T08:58:15.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.523+0000 7f2c4a387740 1 -- 172.21.15.19:0/1720974976 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c30010df0 con 0x55e406c0f5d0 2024-09-19T08:58:15.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.523+0000 7f2c297fa640 1 -- 172.21.15.19:0/1720974976 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2c30010740 con 0x55e406c0f5d0 2024-09-19T08:58:15.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.523+0000 7f2c4a387740 10 client.16794 fetch_fsmap learned FSMap version 34 2024-09-19T08:58:15.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.523+0000 7f2c4a387740 1 -- 172.21.15.19:0/1720974976 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e406c2cf50 con 0x55e406c0f5d0 2024-09-19T08:58:15.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.523+0000 7f2c297fa640 1 -- 172.21.15.19:0/1720974976 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c30010df0 con 0x55e406c0f5d0 2024-09-19T08:58:15.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.524+0000 7f2c297fa640 1 -- 172.21.15.19:0/1720974976 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7f2c30027a90 con 0x55e406c0f5d0 2024-09-19T08:58:15.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.524+0000 7f2c4a387740 10 client.16794 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T08:58:15.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.524+0000 7f2c4a387740 10 client.16794 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:58:15.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.524+0000 7f2c4a387740 20 client.16794 populate_metadata read hostname 'smithi019' 2024-09-19T08:58:15.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.524+0000 7f2c4a387740 1 --2- 172.21.15.19:0/1720974976 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55e406c2e300 0x55e406c306f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:15.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.524+0000 7f2c4a387740 4 client.16794 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:58:15.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.524+0000 7f2c4a387740 1 -- 172.21.15.19:0/1720974976 --> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e406b82860 con 0x55e406c2e300 2024-09-19T08:58:15.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.524+0000 7f2c45d4a640 1 --2- 172.21.15.19:0/1720974976 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55e406c2e300 0x55e406c306f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:15.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.524+0000 7f2c297fa640 10 client.16794 ms_handle_connect on v2:172.21.15.203:6838/2547507299 2024-09-19T08:58:15.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.524+0000 7f2c45d4a640 1 --2- 172.21.15.19:0/1720974976 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55e406c2e300 0x55e406c306f0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f95bad92fe563768 server_cookie=186e1c166833fcb7 in_seq=0 out_seq=0 2024-09-19T08:58:15.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.525+0000 7f2c297fa640 1 -- 172.21.15.19:0/1720974976 <== mds.1 v2:172.21.15.203:6838/2547507299 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e406b82860 con 0x55e406c2e300 2024-09-19T08:58:15.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.525+0000 7f2c297fa640 10 client.16794 handle_command_reply: tid=0 2024-09-19T08:58:15.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.525+0000 7f2c4a387740 1 client.16794 shutdown 2024-09-19T08:58:15.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.525+0000 7f2c4a387740 1 -- 172.21.15.19:0/1720974976 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e406c0f5d0 msgr2=0x55e406c1e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:15.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.525+0000 7f2c4a387740 1 --2- 172.21.15.19:0/1720974976 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e406c0f5d0 0x55e406c1e190 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f2c3001f7c0 tx=0x7f2c3000b480 comp rx=0 tx=0).stop 2024-09-19T08:58:15.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.525+0000 7f2c4a387740 1 -- 172.21.15.19:0/1720974976 shutdown_connections 2024-09-19T08:58:15.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.525+0000 7f2c4a387740 1 --2- 172.21.15.19:0/1720974976 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55e406c2e300 0x55e406c306f0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:15.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.525+0000 7f2c4a387740 1 --2- 172.21.15.19:0/1720974976 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e406c1e780 0x55e406c1ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:15.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.525+0000 7f2c297fa640 0 client.16794 ms_handle_reset on v2:172.21.15.203:6838/2547507299 2024-09-19T08:58:15.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.525+0000 7f2c4a387740 1 --2- 172.21.15.19:0/1720974976 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e406c10b40 0x55e406c1b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:15.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.525+0000 7f2c4a387740 1 --2- 172.21.15.19:0/1720974976 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e406c0f5d0 0x55e406c1e190 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:15.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.525+0000 7f2c4a387740 1 -- 172.21.15.19:0/1720974976 >> 172.21.15.19:0/1720974976 conn(0x55e406bd8310 msgr2=0x55e406c11960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:15.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.526+0000 7f2c4a387740 1 -- 172.21.15.19:0/1720974976 shutdown_connections 2024-09-19T08:58:15.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.526+0000 7f2c4a387740 1 -- 172.21.15.19:0/1720974976 wait complete. 2024-09-19T08:58:15.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.526+0000 7f2c4a387740 20 client.16794 trim_cache size 0 max 16384 2024-09-19T08:58:15.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.539+0000 7f2c4a387740 1 Processor -- start 2024-09-19T08:58:15.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.539+0000 7f2c4a387740 1 -- start start 2024-09-19T08:58:15.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.539+0000 7f2c4a387740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e406c0f5d0 0x55e406c0bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:15.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.539+0000 7f2c4a387740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e406c10b40 0x55e406c2a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:15.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.539+0000 7f2c4a387740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e406c1e780 0x55e406c35da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:15.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.539+0000 7f2c4a387740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2c401ab430 con 0x55e406c10b40 2024-09-19T08:58:15.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.539+0000 7f2c4a387740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2c401acf70 con 0x55e406c1e780 2024-09-19T08:58:15.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.539+0000 7f2c4a387740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2c401abb00 con 0x55e406c0f5d0 2024-09-19T08:58:15.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.539+0000 7f2c45d4a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e406c10b40 0x55e406c2a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:15.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.539+0000 7f2c45d4a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e406c10b40 0x55e406c2a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54916/0 (socket says 172.21.15.19:54916) 2024-09-19T08:58:15.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.539+0000 7f2c45d4a640 1 -- 172.21.15.19:0/3635733077 learned_addr learned my addr 172.21.15.19:0/3635733077 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:15.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.539+0000 7f2c45549640 1 --2- 172.21.15.19:0/3635733077 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e406c1e780 0x55e406c35da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:15.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.539+0000 7f2c45549640 1 --2- 172.21.15.19:0/3635733077 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e406c0f5d0 0x55e406c0bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:15.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.539+0000 7f2c45d4a640 1 -- 172.21.15.19:0/3635733077 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e406c0f5d0 msgr2=0x55e406c0bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:15.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.539+0000 7f2c45d4a640 1 --2- 172.21.15.19:0/3635733077 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e406c0f5d0 0x55e406c0bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:15.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.539+0000 7f2c45d4a640 1 -- 172.21.15.19:0/3635733077 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e406c1e780 msgr2=0x55e406c35da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:15.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.539+0000 7f2c45d4a640 1 --2- 172.21.15.19:0/3635733077 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e406c1e780 0x55e406c35da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:15.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.539+0000 7f2c45d4a640 1 -- 172.21.15.19:0/3635733077 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e406c0c1a0 con 0x55e406c10b40 2024-09-19T08:58:15.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.539+0000 7f2c45549640 1 --2- 172.21.15.19:0/3635733077 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e406c1e780 0x55e406c35da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:58:15.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.540+0000 7f2c45d4a640 1 --2- 172.21.15.19:0/3635733077 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e406c10b40 0x55e406c2a720 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c02a9a0 tx=0x7f2c3c0058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d79fe498a635cce5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:15.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.540+0000 7f2c2b7fe640 1 -- 172.21.15.19:0/3635733077 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c04a070 con 0x55e406c10b40 2024-09-19T08:58:15.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.540+0000 7f2c2b7fe640 1 -- 172.21.15.19:0/3635733077 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c3c005520 con 0x55e406c10b40 2024-09-19T08:58:15.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.540+0000 7f2c2b7fe640 1 -- 172.21.15.19:0/3635733077 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3c035040 con 0x55e406c10b40 2024-09-19T08:58:15.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.540+0000 7f2c4a387740 1 -- 172.21.15.19:0/3635733077 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e406c10b40 msgr2=0x55e406c2a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:15.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.540+0000 7f2c4a387740 1 --2- 172.21.15.19:0/3635733077 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e406c10b40 0x55e406c2a720 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c02a9a0 tx=0x7f2c3c0058b0 comp rx=0 tx=0).stop 2024-09-19T08:58:15.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.541+0000 7f2c4a387740 1 -- 172.21.15.19:0/3635733077 shutdown_connections 2024-09-19T08:58:15.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.541+0000 7f2c4a387740 1 --2- 172.21.15.19:0/3635733077 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e406c1e780 0x55e406c35da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:15.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.541+0000 7f2c4a387740 1 --2- 172.21.15.19:0/3635733077 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e406c10b40 0x55e406c2a720 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:15.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.541+0000 7f2c4a387740 1 --2- 172.21.15.19:0/3635733077 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e406c0f5d0 0x55e406c0bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:15.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.541+0000 7f2c4a387740 1 -- 172.21.15.19:0/3635733077 >> 172.21.15.19:0/3635733077 conn(0x55e406bd8310 msgr2=0x55e406c1a550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:15.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.541+0000 7f2c4a387740 1 -- 172.21.15.19:0/3635733077 shutdown_connections 2024-09-19T08:58:15.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.541+0000 7f2c4a387740 1 -- 172.21.15.19:0/3635733077 wait complete. 2024-09-19T08:58:15.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.541+0000 7f2c4a387740 1 -- start start 2024-09-19T08:58:15.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.541+0000 7f2c4a387740 1 Processor -- start 2024-09-19T08:58:15.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.541+0000 7f2c4a387740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e406c0f5d0 0x55e406c183a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:15.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.541+0000 7f2c4a387740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e406c10b40 0x55e406c188e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:15.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.541+0000 7f2c4a387740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e406c1e780 0x55e406c18e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:15.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.541+0000 7f2c4a387740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2c401ac8a0 con 0x55e406c1e780 2024-09-19T08:58:15.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.541+0000 7f2c4a387740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2c401ac1d0 con 0x55e406c10b40 2024-09-19T08:58:15.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.541+0000 7f2c4a387740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2c401a9430 con 0x55e406c0f5d0 2024-09-19T08:58:15.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.541+0000 7f2c4a387740 10 client.0 _ll_register_callbacks cb 0x7f2c3000bdd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:15.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.542+0000 7f2c45549640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e406c1e780 0x55e406c18e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:15.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.542+0000 7f2c45549640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e406c1e780 0x55e406c18e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54920/0 (socket says 172.21.15.19:54920) 2024-09-19T08:58:15.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.542+0000 7f2c45549640 1 -- 172.21.15.19:0/2164939832 learned_addr learned my addr 172.21.15.19:0/2164939832 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:15.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.542+0000 7f2c45549640 1 --2- 172.21.15.19:0/2164939832 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e406c0f5d0 0x55e406c183a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:15.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.542+0000 7f2c45d4a640 1 --2- 172.21.15.19:0/2164939832 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e406c10b40 0x55e406c188e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:15.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.542+0000 7f2c45549640 1 -- 172.21.15.19:0/2164939832 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e406c0f5d0 msgr2=0x55e406c183a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:15.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.542+0000 7f2c45549640 1 --2- 172.21.15.19:0/2164939832 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e406c0f5d0 0x55e406c183a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:15.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.542+0000 7f2c45549640 1 -- 172.21.15.19:0/2164939832 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e406c10b40 msgr2=0x55e406c188e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:15.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.542+0000 7f2c45549640 1 --2- 172.21.15.19:0/2164939832 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e406c10b40 0x55e406c188e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:15.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.542+0000 7f2c45549640 1 -- 172.21.15.19:0/2164939832 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e406c97d70 con 0x55e406c1e780 2024-09-19T08:58:15.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.542+0000 7f2c45d4a640 1 --2- 172.21.15.19:0/2164939832 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e406c10b40 0x55e406c188e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:58:15.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.542+0000 7f2c45549640 1 --2- 172.21.15.19:0/2164939832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e406c1e780 0x55e406c18e20 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f2c30032520 tx=0x7f2c3000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=353b43b836c9b6bc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:15.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.542+0000 7f2c297fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:58:15.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.542+0000 7f2c297fa640 1 -- 172.21.15.19:0/2164939832 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c3002c070 con 0x55e406c1e780 2024-09-19T08:58:15.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.542+0000 7f2c297fa640 1 -- 172.21.15.19:0/2164939832 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2c30012070 con 0x55e406c1e780 2024-09-19T08:58:15.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.542+0000 7f2c4a387740 1 -- 172.21.15.19:0/2164939832 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c3c005520 con 0x55e406c1e780 2024-09-19T08:58:15.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.542+0000 7f2c297fa640 1 -- 172.21.15.19:0/2164939832 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2c30037040 con 0x55e406c1e780 2024-09-19T08:58:15.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.542+0000 7f2c4a387740 10 client.16800 fetch_fsmap learned FSMap version 34 2024-09-19T08:58:15.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.543+0000 7f2c4a387740 1 -- 172.21.15.19:0/2164939832 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e406c98f00 con 0x55e406c1e780 2024-09-19T08:58:15.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.543+0000 7f2c297fa640 1 -- 172.21.15.19:0/2164939832 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c3c005520 con 0x55e406c1e780 2024-09-19T08:58:15.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.543+0000 7f2c297fa640 1 -- 172.21.15.19:0/2164939832 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7f2c300328c0 con 0x55e406c1e780 2024-09-19T08:58:15.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.543+0000 7f2c4a387740 10 client.16800 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T08:58:15.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.543+0000 7f2c4a387740 10 client.16800 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:58:15.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.543+0000 7f2c4a387740 20 client.16800 populate_metadata read hostname 'smithi019' 2024-09-19T08:58:15.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.543+0000 7f2c4a387740 1 --2- 172.21.15.19:0/2164939832 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55e406c99590 0x55e406c9b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:15.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.543+0000 7f2c4a387740 4 client.16800 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:58:15.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.543+0000 7f2c4a387740 1 -- 172.21.15.19:0/2164939832 --> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e406b7cd70 con 0x55e406c99590 2024-09-19T08:58:15.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.543+0000 7f2c45d4a640 1 --2- 172.21.15.19:0/2164939832 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55e406c99590 0x55e406c9b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:15.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.544+0000 7f2c45d4a640 1 --2- 172.21.15.19:0/2164939832 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55e406c99590 0x55e406c9b9b0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=44024728d3139790 server_cookie=b71be6f43542a931 in_seq=0 out_seq=0 2024-09-19T08:58:15.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.544+0000 7f2c297fa640 10 client.16800 ms_handle_connect on v2:172.21.15.203:6838/2547507299 2024-09-19T08:58:15.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.544+0000 7f2c297fa640 1 -- 172.21.15.19:0/2164939832 <== mds.1 v2:172.21.15.203:6838/2547507299 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e406b7cd70 con 0x55e406c99590 2024-09-19T08:58:15.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.544+0000 7f2c297fa640 10 client.16800 handle_command_reply: tid=0 2024-09-19T08:58:15.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.544+0000 7f2c4a387740 1 client.16800 shutdown 2024-09-19T08:58:15.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.544+0000 7f2c4a387740 1 -- 172.21.15.19:0/2164939832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e406c1e780 msgr2=0x55e406c18e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:15.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.544+0000 7f2c4a387740 1 --2- 172.21.15.19:0/2164939832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e406c1e780 0x55e406c18e20 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f2c30032520 tx=0x7f2c3000b480 comp rx=0 tx=0).stop 2024-09-19T08:58:15.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.544+0000 7f2c4a387740 1 -- 172.21.15.19:0/2164939832 shutdown_connections 2024-09-19T08:58:15.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.544+0000 7f2c4a387740 1 --2- 172.21.15.19:0/2164939832 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55e406c99590 0x55e406c9b9b0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:15.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.544+0000 7f2c4a387740 1 --2- 172.21.15.19:0/2164939832 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e406c1e780 0x55e406c18e20 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:15.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.544+0000 7f2c4a387740 1 --2- 172.21.15.19:0/2164939832 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e406c10b40 0x55e406c188e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:15.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.544+0000 7f2c4a387740 1 --2- 172.21.15.19:0/2164939832 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e406c0f5d0 0x55e406c183a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:15.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.544+0000 7f2c297fa640 0 client.16800 ms_handle_reset on v2:172.21.15.203:6838/2547507299 2024-09-19T08:58:15.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.544+0000 7f2c4a387740 1 -- 172.21.15.19:0/2164939832 >> 172.21.15.19:0/2164939832 conn(0x55e406bd8310 msgr2=0x55e406c0a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:15.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.544+0000 7f2c4a387740 1 -- 172.21.15.19:0/2164939832 shutdown_connections 2024-09-19T08:58:15.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.544+0000 7f2c4a387740 1 -- 172.21.15.19:0/2164939832 wait complete. 2024-09-19T08:58:15.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.544+0000 7f2c4a387740 20 client.16800 trim_cache size 0 max 16384 2024-09-19T08:58:15.564 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T08:58:15.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.545+0000 7f2c47fae640 1 -- 172.21.15.19:0/602502974 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2c2c0a3240 msgr2=0x7f2c2c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:15.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.545+0000 7f2c47fae640 1 --2- 172.21.15.19:0/602502974 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2c2c0a3240 0x7f2c2c0a5700 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2c38098590 tx=0x7f2c38066b70 comp rx=0 tx=0).stop 2024-09-19T08:58:15.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.545+0000 7f2c47fae640 1 -- 172.21.15.19:0/602502974 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c4010c180 msgr2=0x7f2c4019ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:15.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.545+0000 7f2c47fae640 1 --2- 172.21.15.19:0/602502974 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c4010c180 0x7f2c4019ccf0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f2c3800eaa0 tx=0x7f2c3800ef60 comp rx=0 tx=0).stop 2024-09-19T08:58:15.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.545+0000 7f2c47fae640 1 -- 172.21.15.19:0/602502974 shutdown_connections 2024-09-19T08:58:15.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.545+0000 7f2c47fae640 1 --2- 172.21.15.19:0/602502974 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2c2c0a3240 0x7f2c2c0a5700 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:15.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.545+0000 7f2c47fae640 1 --2- 172.21.15.19:0/602502974 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c4010c180 0x7f2c4019ccf0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:15.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.545+0000 7f2c47fae640 1 --2- 172.21.15.19:0/602502974 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c401036c0 0x7f2c40198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:15.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.545+0000 7f2c47fae640 1 --2- 172.21.15.19:0/602502974 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2c40102da0 0x7f2c40198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:15.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.545+0000 7f2c47fae640 1 -- 172.21.15.19:0/602502974 >> 172.21.15.19:0/602502974 conn(0x7f2c400fc7a0 msgr2=0x7f2c400fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:15.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.545+0000 7f2c47fae640 1 -- 172.21.15.19:0/602502974 shutdown_connections 2024-09-19T08:58:15.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:15.545+0000 7f2c47fae640 1 -- 172.21.15.19:0/602502974 wait complete. 2024-09-19T08:58:15.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:15 smithi019 ceph-mon[30976]: pgmap v518: 97 pgs: 97 active+clean; 2.5 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 648 KiB/s wr, 685 op/s 2024-09-19T08:58:15.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:15 smithi155 ceph-mon[34921]: pgmap v518: 97 pgs: 97 active+clean; 2.5 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 648 KiB/s wr, 685 op/s 2024-09-19T08:58:15.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:15 smithi203 ceph-mon[35450]: pgmap v518: 97 pgs: 97 active+clean; 2.5 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 449 KiB/s rd, 648 KiB/s wr, 685 op/s 2024-09-19T08:58:16.250 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:58:16.507 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:58:16.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.967+0000 7fce941c8640 1 -- 172.21.15.19:0/1101649626 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce8c10c2f0 msgr2=0x7fce8c10e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:16.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.967+0000 7fce941c8640 1 --2- 172.21.15.19:0/1101649626 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce8c10c2f0 0x7fce8c10e790 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fce84009ca0 tx=0x7fce8402a8c0 comp rx=0 tx=0).stop 2024-09-19T08:58:16.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.967+0000 7fce941c8640 1 -- 172.21.15.19:0/1101649626 shutdown_connections 2024-09-19T08:58:16.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.967+0000 7fce941c8640 1 --2- 172.21.15.19:0/1101649626 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce8c10c2f0 0x7fce8c10e790 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:16.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.967+0000 7fce941c8640 1 --2- 172.21.15.19:0/1101649626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce8c1037a0 0x7fce8c10bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:16.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.967+0000 7fce941c8640 1 --2- 172.21.15.19:0/1101649626 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fce8c102df0 0x7fce8c1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:16.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.967+0000 7fce941c8640 1 -- 172.21.15.19:0/1101649626 >> 172.21.15.19:0/1101649626 conn(0x7fce8c0fc7d0 msgr2=0x7fce8c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:16.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.967+0000 7fce941c8640 1 -- 172.21.15.19:0/1101649626 shutdown_connections 2024-09-19T08:58:16.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.967+0000 7fce941c8640 1 -- 172.21.15.19:0/1101649626 wait complete. 2024-09-19T08:58:16.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.968+0000 7fce941c8640 1 Processor -- start 2024-09-19T08:58:16.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.968+0000 7fce941c8640 1 -- start start 2024-09-19T08:58:16.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.968+0000 7fce941c8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce8c102df0 0x7fce8c198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:16.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.968+0000 7fce941c8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce8c1037a0 0x7fce8c198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:16.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.968+0000 7fce941c8640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fce8c10c2f0 0x7fce8c19ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:16.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.968+0000 7fce941c8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fce8c112110 con 0x7fce8c102df0 2024-09-19T08:58:16.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.968+0000 7fce941c8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fce8c111f90 con 0x7fce8c1037a0 2024-09-19T08:58:16.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.968+0000 7fce941c8640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fce8c112290 con 0x7fce8c10c2f0 2024-09-19T08:58:16.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.968+0000 7fce91f64640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce8c102df0 0x7fce8c198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:16.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.968+0000 7fce91f64640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce8c102df0 0x7fce8c198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54938/0 (socket says 172.21.15.19:54938) 2024-09-19T08:58:16.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.968+0000 7fce91f64640 1 -- 172.21.15.19:0/2337658817 learned_addr learned my addr 172.21.15.19:0/2337658817 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:16.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.968+0000 7fce91763640 1 --2- 172.21.15.19:0/2337658817 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce8c1037a0 0x7fce8c198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:16.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.968+0000 7fce92765640 1 --2- 172.21.15.19:0/2337658817 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fce8c10c2f0 0x7fce8c19ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:16.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.969+0000 7fce91f64640 1 -- 172.21.15.19:0/2337658817 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fce8c10c2f0 msgr2=0x7fce8c19ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:16.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.969+0000 7fce91f64640 1 --2- 172.21.15.19:0/2337658817 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fce8c10c2f0 0x7fce8c19ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:16.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.969+0000 7fce91f64640 1 -- 172.21.15.19:0/2337658817 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce8c1037a0 msgr2=0x7fce8c198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:16.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.969+0000 7fce91f64640 1 --2- 172.21.15.19:0/2337658817 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce8c1037a0 0x7fce8c198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:16.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.969+0000 7fce91f64640 1 -- 172.21.15.19:0/2337658817 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce8c19d540 con 0x7fce8c102df0 2024-09-19T08:58:16.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.969+0000 7fce91f64640 1 --2- 172.21.15.19:0/2337658817 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce8c102df0 0x7fce8c198590 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fce8800d770 tx=0x7fce8800db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:16.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.969+0000 7fce82ffd640 1 -- 172.21.15.19:0/2337658817 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce88017070 con 0x7fce8c102df0 2024-09-19T08:58:16.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.969+0000 7fce82ffd640 1 -- 172.21.15.19:0/2337658817 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce88009820 con 0x7fce8c102df0 2024-09-19T08:58:16.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.969+0000 7fce941c8640 1 -- 172.21.15.19:0/2337658817 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce8c19d830 con 0x7fce8c102df0 2024-09-19T08:58:16.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.969+0000 7fce82ffd640 1 -- 172.21.15.19:0/2337658817 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce88004cd0 con 0x7fce8c102df0 2024-09-19T08:58:16.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.969+0000 7fce941c8640 1 -- 172.21.15.19:0/2337658817 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce8c1a5110 con 0x7fce8c102df0 2024-09-19T08:58:16.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.972+0000 7fce82ffd640 1 -- 172.21.15.19:0/2337658817 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fce880099d0 con 0x7fce8c102df0 2024-09-19T08:58:16.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.972+0000 7fce965a1740 1 Processor -- start 2024-09-19T08:58:16.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.972+0000 7fce965a1740 1 -- start start 2024-09-19T08:58:16.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.972+0000 7fce965a1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ec03794b40 0x55ec03793090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:16.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.972+0000 7fce965a1740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ec037935d0 0x55ec03793a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:16.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.972+0000 7fce965a1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ec037a2780 0x55ec037a4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:16.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.972+0000 7fce965a1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ec036f92f0 con 0x55ec03794b40 2024-09-19T08:58:16.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.972+0000 7fce965a1740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55ec036a0cf0 con 0x55ec037935d0 2024-09-19T08:58:16.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.972+0000 7fce965a1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ec036f52b0 con 0x55ec037a2780 2024-09-19T08:58:16.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.972+0000 7fce82ffd640 1 --2- 172.21.15.19:0/2337658817 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fce780a32c0 0x7fce780a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:16.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.973+0000 7fce92765640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ec03794b40 0x55ec03793090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:16.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.973+0000 7fce92765640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ec03794b40 0x55ec03793090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54950/0 (socket says 172.21.15.19:54950) 2024-09-19T08:58:16.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.973+0000 7fce92765640 1 -- 172.21.15.19:0/3037517347 learned_addr learned my addr 172.21.15.19:0/3037517347 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:16.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.973+0000 7fce82ffd640 1 -- 172.21.15.19:0/2337658817 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fce880cf2a0 con 0x7fce8c102df0 2024-09-19T08:58:16.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.973+0000 7fce91763640 1 --2- 172.21.15.19:0/3037517347 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ec037a2780 0x55ec037a4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:16.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.973+0000 7fce91f64640 1 --2- 172.21.15.19:0/3037517347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ec037935d0 0x55ec03793a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:16.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.973+0000 7fce92765640 1 --2- 172.21.15.19:0/2337658817 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fce780a32c0 0x7fce780a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:16.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.973+0000 7fce92765640 1 -- 172.21.15.19:0/3037517347 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ec037a2780 msgr2=0x55ec037a4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:16.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.973+0000 7fce92765640 1 --2- 172.21.15.19:0/3037517347 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ec037a2780 0x55ec037a4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:16.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.973+0000 7fce92765640 1 -- 172.21.15.19:0/3037517347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ec037935d0 msgr2=0x55ec03793a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:16.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.973+0000 7fce92765640 1 --2- 172.21.15.19:0/3037517347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ec037935d0 0x55ec03793a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:16.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.973+0000 7fce92765640 1 -- 172.21.15.19:0/3037517347 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec036853a0 con 0x55ec03794b40 2024-09-19T08:58:16.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.973+0000 7fce92765640 1 --2- 172.21.15.19:0/3037517347 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ec03794b40 0x55ec03793090 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fce84009ca0 tx=0x7fce84031e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32224ba10a9df643 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:16.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.973+0000 7fce77fff640 1 -- 172.21.15.19:0/3037517347 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce84009880 con 0x55ec03794b40 2024-09-19T08:58:16.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.974+0000 7fce77fff640 1 -- 172.21.15.19:0/3037517347 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce8404e070 con 0x55ec03794b40 2024-09-19T08:58:16.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.974+0000 7fce77fff640 1 -- 172.21.15.19:0/3037517347 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce84030a70 con 0x55ec03794b40 2024-09-19T08:58:16.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.974+0000 7fce965a1740 1 -- 172.21.15.19:0/3037517347 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ec03794b40 msgr2=0x55ec03793090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:16.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.974+0000 7fce92765640 1 --2- 172.21.15.19:0/2337658817 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fce780a32c0 0x7fce780a5780 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fce8404d000 tx=0x7fce84049000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:16.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.974+0000 7fce965a1740 1 --2- 172.21.15.19:0/3037517347 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ec03794b40 0x55ec03793090 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fce84009ca0 tx=0x7fce84031e40 comp rx=0 tx=0).stop 2024-09-19T08:58:16.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.974+0000 7fce965a1740 1 -- 172.21.15.19:0/3037517347 shutdown_connections 2024-09-19T08:58:16.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.974+0000 7fce965a1740 1 --2- 172.21.15.19:0/3037517347 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ec037a2780 0x55ec037a4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:16.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.974+0000 7fce965a1740 1 --2- 172.21.15.19:0/3037517347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ec037935d0 0x55ec03793a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:16.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.974+0000 7fce965a1740 1 --2- 172.21.15.19:0/3037517347 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ec03794b40 0x55ec03793090 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:16.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.974+0000 7fce965a1740 1 -- 172.21.15.19:0/3037517347 >> 172.21.15.19:0/3037517347 conn(0x55ec0375c310 msgr2=0x55ec0378fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:16.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.974+0000 7fce965a1740 1 -- 172.21.15.19:0/3037517347 shutdown_connections 2024-09-19T08:58:16.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.974+0000 7fce965a1740 1 -- 172.21.15.19:0/3037517347 wait complete. 2024-09-19T08:58:16.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.975+0000 7fce965a1740 1 -- start start 2024-09-19T08:58:16.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.975+0000 7fce965a1740 1 Processor -- start 2024-09-19T08:58:16.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.975+0000 7fce965a1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ec037935d0 0x55ec037a21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:16.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.975+0000 7fce965a1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ec03794b40 0x55ec0379f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:16.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.975+0000 7fce965a1740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ec037a2780 0x55ec0379fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:16.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.975+0000 7fce965a1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ec037a5480 con 0x55ec037935d0 2024-09-19T08:58:16.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.975+0000 7fce965a1740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55ec036b4060 con 0x55ec037a2780 2024-09-19T08:58:16.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.975+0000 7fce965a1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ec037a5600 con 0x55ec03794b40 2024-09-19T08:58:16.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.975+0000 7fce965a1740 10 client.0 _ll_register_callbacks cb 0x55ec034078c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:16.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.975+0000 7fce91f64640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ec037935d0 0x55ec037a21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:16.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.975+0000 7fce91f64640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ec037935d0 0x55ec037a21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54958/0 (socket says 172.21.15.19:54958) 2024-09-19T08:58:16.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.975+0000 7fce91f64640 1 -- 172.21.15.19:0/2912262650 learned_addr learned my addr 172.21.15.19:0/2912262650 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:16.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.976+0000 7fce92765640 1 --2- 172.21.15.19:0/2912262650 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ec037a2780 0x55ec0379fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:16.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.976+0000 7fce91763640 1 --2- 172.21.15.19:0/2912262650 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ec03794b40 0x55ec0379f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:16.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.976+0000 7fce91f64640 1 -- 172.21.15.19:0/2912262650 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ec03794b40 msgr2=0x55ec0379f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:16.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.976+0000 7fce91f64640 1 --2- 172.21.15.19:0/2912262650 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ec03794b40 0x55ec0379f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:16.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.976+0000 7fce91f64640 1 -- 172.21.15.19:0/2912262650 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ec037a2780 msgr2=0x55ec0379fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:16.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.976+0000 7fce91f64640 1 --2- 172.21.15.19:0/2912262650 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ec037a2780 0x55ec0379fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:16.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.976+0000 7fce91f64640 1 -- 172.21.15.19:0/2912262650 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec0346a3c0 con 0x55ec037935d0 2024-09-19T08:58:16.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.976+0000 7fce91f64640 1 --2- 172.21.15.19:0/2912262650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ec037935d0 0x55ec037a21a0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fce880ccd50 tx=0x7fce8809b740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad1f0d1aeeb15993 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:16.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.976+0000 7fce757fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:58:16.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.976+0000 7fce757fa640 1 -- 172.21.15.19:0/2912262650 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce880b3020 con 0x55ec037935d0 2024-09-19T08:58:16.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.976+0000 7fce757fa640 1 -- 172.21.15.19:0/2912262650 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fce88097ee0 con 0x55ec037935d0 2024-09-19T08:58:16.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.976+0000 7fce965a1740 1 -- 172.21.15.19:0/2912262650 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce8404e070 con 0x55ec037935d0 2024-09-19T08:58:16.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.976+0000 7fce757fa640 1 -- 172.21.15.19:0/2912262650 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fce88020040 con 0x55ec037935d0 2024-09-19T08:58:16.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.976+0000 7fce965a1740 10 client.16812 fetch_fsmap learned FSMap version 34 2024-09-19T08:58:16.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.976+0000 7fce965a1740 1 -- 172.21.15.19:0/2912262650 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ec037b0fa0 con 0x55ec037935d0 2024-09-19T08:58:16.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.977+0000 7fce757fa640 1 -- 172.21.15.19:0/2912262650 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce8404e070 con 0x55ec037935d0 2024-09-19T08:58:16.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.977+0000 7fce757fa640 1 -- 172.21.15.19:0/2912262650 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7fce88084c50 con 0x55ec037935d0 2024-09-19T08:58:16.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.977+0000 7fce965a1740 10 client.16812 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T08:58:16.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.977+0000 7fce965a1740 10 client.16812 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:58:16.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.977+0000 7fce965a1740 20 client.16812 populate_metadata read hostname 'smithi019' 2024-09-19T08:58:16.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.977+0000 7fce965a1740 1 --2- 172.21.15.19:0/2912262650 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ec037b24b0 0x55ec037b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:16.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.977+0000 7fce965a1740 4 client.16812 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:58:16.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.977+0000 7fce965a1740 1 -- 172.21.15.19:0/2912262650 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec03706860 con 0x55ec037b24b0 2024-09-19T08:58:16.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.977+0000 7fce91763640 1 --2- 172.21.15.19:0/2912262650 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ec037b24b0 0x55ec037b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:16.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.978+0000 7fce91763640 1 --2- 172.21.15.19:0/2912262650 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ec037b24b0 0x55ec037b48c0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4af3c147665ec8a6 server_cookie=a91189b6588cab38 in_seq=0 out_seq=0 2024-09-19T08:58:16.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.978+0000 7fce757fa640 10 client.16812 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:16.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.978+0000 7fce757fa640 1 -- 172.21.15.19:0/2912262650 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ec03706860 con 0x55ec037b24b0 2024-09-19T08:58:16.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.978+0000 7fce757fa640 10 client.16812 handle_command_reply: tid=0 2024-09-19T08:58:16.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.978+0000 7fce965a1740 1 client.16812 shutdown 2024-09-19T08:58:16.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.978+0000 7fce965a1740 1 -- 172.21.15.19:0/2912262650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ec037935d0 msgr2=0x55ec037a21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:16.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.978+0000 7fce965a1740 1 --2- 172.21.15.19:0/2912262650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ec037935d0 0x55ec037a21a0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fce880ccd50 tx=0x7fce8809b740 comp rx=0 tx=0).stop 2024-09-19T08:58:16.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.979+0000 7fce965a1740 1 -- 172.21.15.19:0/2912262650 shutdown_connections 2024-09-19T08:58:16.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.979+0000 7fce965a1740 1 --2- 172.21.15.19:0/2912262650 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ec037b24b0 0x55ec037b48c0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:16.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.979+0000 7fce965a1740 1 --2- 172.21.15.19:0/2912262650 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ec03794b40 0x55ec0379f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:16.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.979+0000 7fce965a1740 1 --2- 172.21.15.19:0/2912262650 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ec037a2780 0x55ec0379fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:16.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.979+0000 7fce757fa640 0 client.16812 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:16.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.979+0000 7fce965a1740 1 --2- 172.21.15.19:0/2912262650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ec037935d0 0x55ec037a21a0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:16.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.979+0000 7fce965a1740 1 -- 172.21.15.19:0/2912262650 >> 172.21.15.19:0/2912262650 conn(0x55ec0375c310 msgr2=0x55ec03795960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:16.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.979+0000 7fce965a1740 1 -- 172.21.15.19:0/2912262650 shutdown_connections 2024-09-19T08:58:16.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.979+0000 7fce965a1740 1 -- 172.21.15.19:0/2912262650 wait complete. 2024-09-19T08:58:16.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.979+0000 7fce965a1740 20 client.16812 trim_cache size 0 max 16384 2024-09-19T08:58:16.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.992+0000 7fce965a1740 1 Processor -- start 2024-09-19T08:58:16.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.992+0000 7fce965a1740 1 -- start start 2024-09-19T08:58:16.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.992+0000 7fce965a1740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ec037935d0 0x55ec037ae720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:16.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.992+0000 7fce965a1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ec03794b40 0x55ec037ba190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:16.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.992+0000 7fce965a1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ec037a2780 0x55ec037ba6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:16.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.992+0000 7fce965a1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fce8c1ab220 con 0x55ec03794b40 2024-09-19T08:58:16.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.992+0000 7fce965a1740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fce8c1acd60 con 0x55ec037935d0 2024-09-19T08:58:16.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.992+0000 7fce965a1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fce8c1ab8f0 con 0x55ec037a2780 2024-09-19T08:58:16.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.992+0000 7fce91763640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ec03794b40 0x55ec037ba190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:16.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.992+0000 7fce91763640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ec03794b40 0x55ec037ba190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54966/0 (socket says 172.21.15.19:54966) 2024-09-19T08:58:16.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.992+0000 7fce91763640 1 -- 172.21.15.19:0/1461521601 learned_addr learned my addr 172.21.15.19:0/1461521601 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:16.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.992+0000 7fce91763640 1 -- 172.21.15.19:0/1461521601 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ec037a2780 msgr2=0x55ec037ba6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:16.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.992+0000 7fce91763640 1 --2- 172.21.15.19:0/1461521601 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ec037a2780 0x55ec037ba6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:16.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.992+0000 7fce91763640 1 -- 172.21.15.19:0/1461521601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ec037935d0 msgr2=0x55ec037ae720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:16.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.992+0000 7fce91f64640 1 --2- 172.21.15.19:0/1461521601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ec037935d0 0x55ec037ae720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:16.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.992+0000 7fce91763640 1 --2- 172.21.15.19:0/1461521601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ec037935d0 0x55ec037ae720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:16.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.992+0000 7fce91763640 1 -- 172.21.15.19:0/1461521601 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec03790960 con 0x55ec03794b40 2024-09-19T08:58:16.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.992+0000 7fce91f64640 1 --2- 172.21.15.19:0/1461521601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ec037935d0 0x55ec037ae720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:58:16.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.993+0000 7fce91763640 1 --2- 172.21.15.19:0/1461521601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ec03794b40 0x55ec037ba190 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fce8c10ec10 tx=0x7fce7c010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc4d68714ae1c54 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:16.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.993+0000 7fce777fe640 1 -- 172.21.15.19:0/1461521601 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce7c02a070 con 0x55ec03794b40 2024-09-19T08:58:16.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.993+0000 7fce777fe640 1 -- 172.21.15.19:0/1461521601 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce7c01eaf0 con 0x55ec03794b40 2024-09-19T08:58:16.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.993+0000 7fce777fe640 1 -- 172.21.15.19:0/1461521601 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce7c025c00 con 0x55ec03794b40 2024-09-19T08:58:16.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.993+0000 7fce965a1740 1 -- 172.21.15.19:0/1461521601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ec03794b40 msgr2=0x55ec037ba190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:16.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.993+0000 7fce965a1740 1 --2- 172.21.15.19:0/1461521601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ec03794b40 0x55ec037ba190 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fce8c10ec10 tx=0x7fce7c010800 comp rx=0 tx=0).stop 2024-09-19T08:58:16.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.993+0000 7fce965a1740 1 -- 172.21.15.19:0/1461521601 shutdown_connections 2024-09-19T08:58:16.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.993+0000 7fce965a1740 1 --2- 172.21.15.19:0/1461521601 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ec037a2780 0x55ec037ba6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:16.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.993+0000 7fce965a1740 1 --2- 172.21.15.19:0/1461521601 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ec03794b40 0x55ec037ba190 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:16.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.994+0000 7fce965a1740 1 --2- 172.21.15.19:0/1461521601 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ec037935d0 0x55ec037ae720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:16.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.994+0000 7fce965a1740 1 -- 172.21.15.19:0/1461521601 >> 172.21.15.19:0/1461521601 conn(0x55ec0375c310 msgr2=0x55ec0379a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:16.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.994+0000 7fce965a1740 1 -- 172.21.15.19:0/1461521601 shutdown_connections 2024-09-19T08:58:16.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.994+0000 7fce965a1740 1 -- 172.21.15.19:0/1461521601 wait complete. 2024-09-19T08:58:16.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.994+0000 7fce965a1740 1 -- start start 2024-09-19T08:58:16.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.994+0000 7fce965a1740 1 Processor -- start 2024-09-19T08:58:16.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.994+0000 7fce965a1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ec037935d0 0x55ec037a6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:16.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.994+0000 7fce965a1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ec03794b40 0x55ec037a6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:16.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.994+0000 7fce965a1740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ec037a2780 0x55ec0381c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:16.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.994+0000 7fce965a1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fce8c1ac690 con 0x55ec037935d0 2024-09-19T08:58:16.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.994+0000 7fce965a1740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fce8c1abfc0 con 0x55ec037a2780 2024-09-19T08:58:16.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.994+0000 7fce965a1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fce8c1a9200 con 0x55ec03794b40 2024-09-19T08:58:16.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.994+0000 7fce965a1740 10 client.0 _ll_register_callbacks cb 0x7fce8809b1d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:16.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.995+0000 7fce91f64640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ec037935d0 0x55ec037a6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:16.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.995+0000 7fce91f64640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ec037935d0 0x55ec037a6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54974/0 (socket says 172.21.15.19:54974) 2024-09-19T08:58:16.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.995+0000 7fce91f64640 1 -- 172.21.15.19:0/1259235518 learned_addr learned my addr 172.21.15.19:0/1259235518 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:16.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.995+0000 7fce91763640 1 --2- 172.21.15.19:0/1259235518 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ec03794b40 0x55ec037a6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:16.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.995+0000 7fce92765640 1 --2- 172.21.15.19:0/1259235518 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ec037a2780 0x55ec0381c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:16.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.995+0000 7fce91f64640 1 -- 172.21.15.19:0/1259235518 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ec03794b40 msgr2=0x55ec037a6e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:16.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.995+0000 7fce91f64640 1 --2- 172.21.15.19:0/1259235518 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ec03794b40 0x55ec037a6e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:16.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.995+0000 7fce91f64640 1 -- 172.21.15.19:0/1259235518 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ec037a2780 msgr2=0x55ec0381c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:16.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.995+0000 7fce91f64640 1 --2- 172.21.15.19:0/1259235518 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ec037a2780 0x55ec0381c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.995+0000 7fce91f64640 1 -- 172.21.15.19:0/1259235518 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec037a76e0 con 0x55ec037935d0 2024-09-19T08:58:17.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.995+0000 7fce92765640 1 --2- 172.21.15.19:0/1259235518 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ec037a2780 0x55ec0381c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:58:17.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.995+0000 7fce91f64640 1 --2- 172.21.15.19:0/1259235518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ec037935d0 0x55ec037a6910 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fce8809b7b0 tx=0x7fce88005790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7886bfa14b04cd0f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:17.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.995+0000 7fce757fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:58:17.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.995+0000 7fce757fa640 1 -- 172.21.15.19:0/1259235518 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce880b3070 con 0x55ec037935d0 2024-09-19T08:58:17.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.995+0000 7fce757fa640 1 -- 172.21.15.19:0/1259235518 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fce8809adc0 con 0x55ec037935d0 2024-09-19T08:58:17.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.995+0000 7fce965a1740 1 -- 172.21.15.19:0/1259235518 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce7c01eaf0 con 0x55ec037935d0 2024-09-19T08:58:17.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.995+0000 7fce757fa640 1 -- 172.21.15.19:0/1259235518 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fce88084dc0 con 0x55ec037935d0 2024-09-19T08:58:17.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.995+0000 7fce965a1740 10 client.16818 fetch_fsmap learned FSMap version 34 2024-09-19T08:58:17.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.995+0000 7fce965a1740 1 -- 172.21.15.19:0/1259235518 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ec0381d6e0 con 0x55ec037935d0 2024-09-19T08:58:17.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.996+0000 7fce757fa640 1 -- 172.21.15.19:0/1259235518 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce7c01eaf0 con 0x55ec037935d0 2024-09-19T08:58:17.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.996+0000 7fce757fa640 1 -- 172.21.15.19:0/1259235518 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7fce8809a930 con 0x55ec037935d0 2024-09-19T08:58:17.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.996+0000 7fce965a1740 10 client.16818 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T08:58:17.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.996+0000 7fce965a1740 10 client.16818 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:58:17.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.996+0000 7fce965a1740 20 client.16818 populate_metadata read hostname 'smithi019' 2024-09-19T08:58:17.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.996+0000 7fce965a1740 1 --2- 172.21.15.19:0/1259235518 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ec0381de00 0x55ec038201f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:17.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.996+0000 7fce965a1740 4 client.16818 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:58:17.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.996+0000 7fce965a1740 1 -- 172.21.15.19:0/1259235518 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ec03700d70 con 0x55ec0381de00 2024-09-19T08:58:17.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.996+0000 7fce91763640 1 --2- 172.21.15.19:0/1259235518 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ec0381de00 0x55ec038201f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:17.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.997+0000 7fce91763640 1 --2- 172.21.15.19:0/1259235518 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ec0381de00 0x55ec038201f0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=963d536a4f6c01f0 server_cookie=8308e2b4ec9637a0 in_seq=0 out_seq=0 2024-09-19T08:58:17.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.997+0000 7fce757fa640 10 client.16818 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:17.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.997+0000 7fce757fa640 1 -- 172.21.15.19:0/1259235518 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ec03700d70 con 0x55ec0381de00 2024-09-19T08:58:17.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.997+0000 7fce757fa640 10 client.16818 handle_command_reply: tid=0 2024-09-19T08:58:17.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.997+0000 7fce965a1740 1 client.16818 shutdown 2024-09-19T08:58:17.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.997+0000 7fce965a1740 1 -- 172.21.15.19:0/1259235518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ec037935d0 msgr2=0x55ec037a6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:17.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.997+0000 7fce965a1740 1 --2- 172.21.15.19:0/1259235518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ec037935d0 0x55ec037a6910 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fce8809b7b0 tx=0x7fce88005790 comp rx=0 tx=0).stop 2024-09-19T08:58:17.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.997+0000 7fce965a1740 1 -- 172.21.15.19:0/1259235518 shutdown_connections 2024-09-19T08:58:17.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.997+0000 7fce965a1740 1 --2- 172.21.15.19:0/1259235518 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ec0381de00 0x55ec038201f0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.997+0000 7fce965a1740 1 --2- 172.21.15.19:0/1259235518 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ec03794b40 0x55ec037a6e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.997+0000 7fce965a1740 1 --2- 172.21.15.19:0/1259235518 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ec037a2780 0x55ec0381c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.997+0000 7fce757fa640 0 client.16818 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:17.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.997+0000 7fce965a1740 1 --2- 172.21.15.19:0/1259235518 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ec037935d0 0x55ec037a6910 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.997+0000 7fce965a1740 1 -- 172.21.15.19:0/1259235518 >> 172.21.15.19:0/1259235518 conn(0x55ec0375c310 msgr2=0x55ec0378e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:17.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.997+0000 7fce965a1740 1 -- 172.21.15.19:0/1259235518 shutdown_connections 2024-09-19T08:58:17.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.997+0000 7fce965a1740 1 -- 172.21.15.19:0/1259235518 wait complete. 2024-09-19T08:58:17.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.997+0000 7fce965a1740 20 client.16818 trim_cache size 0 max 16384 2024-09-19T08:58:17.002 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T08:58:17.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.998+0000 7fce941c8640 1 -- 172.21.15.19:0/2337658817 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fce780a32c0 msgr2=0x7fce780a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:17.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.998+0000 7fce941c8640 1 --2- 172.21.15.19:0/2337658817 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fce780a32c0 0x7fce780a5780 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fce8404d000 tx=0x7fce84049000 comp rx=0 tx=0).stop 2024-09-19T08:58:17.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.998+0000 7fce941c8640 1 -- 172.21.15.19:0/2337658817 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce8c102df0 msgr2=0x7fce8c198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:17.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.998+0000 7fce941c8640 1 --2- 172.21.15.19:0/2337658817 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce8c102df0 0x7fce8c198590 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fce8800d770 tx=0x7fce8800db70 comp rx=0 tx=0).stop 2024-09-19T08:58:17.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.998+0000 7fce941c8640 1 -- 172.21.15.19:0/2337658817 shutdown_connections 2024-09-19T08:58:17.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.998+0000 7fce941c8640 1 --2- 172.21.15.19:0/2337658817 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fce780a32c0 0x7fce780a5780 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.998+0000 7fce941c8640 1 --2- 172.21.15.19:0/2337658817 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fce8c10c2f0 0x7fce8c19ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.998+0000 7fce941c8640 1 --2- 172.21.15.19:0/2337658817 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce8c1037a0 0x7fce8c198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.998+0000 7fce941c8640 1 --2- 172.21.15.19:0/2337658817 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce8c102df0 0x7fce8c198590 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:17.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.998+0000 7fce941c8640 1 -- 172.21.15.19:0/2337658817 >> 172.21.15.19:0/2337658817 conn(0x7fce8c0fc7d0 msgr2=0x7fce8c0fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:17.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.998+0000 7fce941c8640 1 -- 172.21.15.19:0/2337658817 shutdown_connections 2024-09-19T08:58:17.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:16.998+0000 7fce941c8640 1 -- 172.21.15.19:0/2337658817 wait complete. 2024-09-19T08:58:17.655 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:17 smithi019 ceph-mon[30976]: pgmap v519: 97 pgs: 97 active+clean; 2.5 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 253 KiB/s wr, 603 op/s 2024-09-19T08:58:17.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:17 smithi155 ceph-mon[34921]: pgmap v519: 97 pgs: 97 active+clean; 2.5 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 253 KiB/s wr, 603 op/s 2024-09-19T08:58:17.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:17 smithi203 ceph-mon[35450]: pgmap v519: 97 pgs: 97 active+clean; 2.5 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 253 KiB/s wr, 603 op/s 2024-09-19T08:58:18.687 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:58:18.687 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:58:18.960 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:58:19.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.453+0000 7faf94252640 1 -- 172.21.15.19:0/1811359168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf8c101280 msgr2=0x7faf8c10df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:19.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.453+0000 7faf94252640 1 --2- 172.21.15.19:0/1811359168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf8c101280 0x7faf8c10df40 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7faf7c009900 tx=0x7faf7c02a410 comp rx=0 tx=0).stop 2024-09-19T08:58:19.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.453+0000 7faf94252640 1 -- 172.21.15.19:0/1811359168 shutdown_connections 2024-09-19T08:58:19.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.453+0000 7faf94252640 1 --2- 172.21.15.19:0/1811359168 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf8c10e480 0x7faf8c110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.453+0000 7faf94252640 1 --2- 172.21.15.19:0/1811359168 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf8c101280 0x7faf8c10df40 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.453+0000 7faf94252640 1 --2- 172.21.15.19:0/1811359168 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf8c1008d0 0x7faf8c100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.453+0000 7faf94252640 1 -- 172.21.15.19:0/1811359168 >> 172.21.15.19:0/1811359168 conn(0x7faf8c0fc7a0 msgr2=0x7faf8c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:19.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.453+0000 7faf94252640 1 -- 172.21.15.19:0/1811359168 shutdown_connections 2024-09-19T08:58:19.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.453+0000 7faf94252640 1 -- 172.21.15.19:0/1811359168 wait complete. 2024-09-19T08:58:19.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.454+0000 7faf94252640 1 Processor -- start 2024-09-19T08:58:19.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.454+0000 7faf94252640 1 -- start start 2024-09-19T08:58:19.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.454+0000 7faf94252640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf8c1008d0 0x7faf8c19a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:19.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.454+0000 7faf94252640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf8c101280 0x7faf8c19ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:19.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.454+0000 7faf94252640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf8c10e480 0x7faf8c19efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:19.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.454+0000 7faf94252640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c114190 con 0x7faf8c101280 2024-09-19T08:58:19.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.454+0000 7faf94252640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c114010 con 0x7faf8c10e480 2024-09-19T08:58:19.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.454+0000 7faf94252640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c114310 con 0x7faf8c1008d0 2024-09-19T08:58:19.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.454+0000 7faf917ed640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf8c101280 0x7faf8c19ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:19.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.454+0000 7faf917ed640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf8c101280 0x7faf8c19ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54988/0 (socket says 172.21.15.19:54988) 2024-09-19T08:58:19.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.454+0000 7faf917ed640 1 -- 172.21.15.19:0/3083590617 learned_addr learned my addr 172.21.15.19:0/3083590617 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:19.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.454+0000 7faf927ef640 1 --2- 172.21.15.19:0/3083590617 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf8c10e480 0x7faf8c19efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:19.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.454+0000 7faf91fee640 1 --2- 172.21.15.19:0/3083590617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf8c1008d0 0x7faf8c19a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:19.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.454+0000 7faf917ed640 1 -- 172.21.15.19:0/3083590617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf8c1008d0 msgr2=0x7faf8c19a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:19.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.454+0000 7faf917ed640 1 --2- 172.21.15.19:0/3083590617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf8c1008d0 0x7faf8c19a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.454+0000 7faf917ed640 1 -- 172.21.15.19:0/3083590617 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf8c10e480 msgr2=0x7faf8c19efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:19.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.454+0000 7faf917ed640 1 --2- 172.21.15.19:0/3083590617 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf8c10e480 0x7faf8c19efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.454+0000 7faf917ed640 1 -- 172.21.15.19:0/3083590617 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf8c19f6c0 con 0x7faf8c101280 2024-09-19T08:58:19.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.454+0000 7faf927ef640 1 --2- 172.21.15.19:0/3083590617 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf8c10e480 0x7faf8c19efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:58:19.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.454+0000 7faf91fee640 1 --2- 172.21.15.19:0/3083590617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf8c1008d0 0x7faf8c19a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:58:19.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.454+0000 7faf917ed640 1 --2- 172.21.15.19:0/3083590617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf8c101280 0x7faf8c19ac50 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7faf7c006010 tx=0x7faf7c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:19.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.455+0000 7faf82ffd640 1 -- 172.21.15.19:0/3083590617 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c03f030 con 0x7faf8c101280 2024-09-19T08:58:19.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.455+0000 7faf94252640 1 -- 172.21.15.19:0/3083590617 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf8c19f950 con 0x7faf8c101280 2024-09-19T08:58:19.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.455+0000 7faf82ffd640 1 -- 172.21.15.19:0/3083590617 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf7c003ce0 con 0x7faf8c101280 2024-09-19T08:58:19.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.455+0000 7faf82ffd640 1 -- 172.21.15.19:0/3083590617 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c035070 con 0x7faf8c101280 2024-09-19T08:58:19.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.455+0000 7faf94252640 1 -- 172.21.15.19:0/3083590617 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf8c1a7290 con 0x7faf8c101280 2024-09-19T08:58:19.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.457+0000 7faf82ffd640 1 -- 172.21.15.19:0/3083590617 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7faf7c042030 con 0x7faf8c101280 2024-09-19T08:58:19.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.457+0000 7faf9662b740 1 Processor -- start 2024-09-19T08:58:19.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.457+0000 7faf9662b740 1 -- start start 2024-09-19T08:58:19.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.458+0000 7faf9662b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641442e3b60 0x5641442e3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:19.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.458+0000 7faf9662b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641442e4480 0x5641442ee800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:19.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.458+0000 7faf9662b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641442eed40 0x5641442f1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:19.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.458+0000 7faf9662b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x564144249280 con 0x5641442e3b60 2024-09-19T08:58:19.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.458+0000 7faf9662b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5641441f0b10 con 0x5641442eed40 2024-09-19T08:58:19.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.458+0000 7faf9662b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564144245240 con 0x5641442e4480 2024-09-19T08:58:19.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.458+0000 7faf927ef640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641442e3b60 0x5641442e3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:19.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.458+0000 7faf927ef640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641442e3b60 0x5641442e3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54992/0 (socket says 172.21.15.19:54992) 2024-09-19T08:58:19.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.458+0000 7faf927ef640 1 -- 172.21.15.19:0/2596536795 learned_addr learned my addr 172.21.15.19:0/2596536795 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:19.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.458+0000 7faf917ed640 1 --2- 172.21.15.19:0/2596536795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641442eed40 0x5641442f1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:19.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.458+0000 7faf91fee640 1 --2- 172.21.15.19:0/2596536795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641442e4480 0x5641442ee800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:19.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.458+0000 7faf82ffd640 1 --2- 172.21.15.19:0/3083590617 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7faf780a32c0 0x7faf780a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:19.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.458+0000 7faf927ef640 1 -- 172.21.15.19:0/2596536795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641442e4480 msgr2=0x5641442ee800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:19.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.458+0000 7faf927ef640 1 --2- 172.21.15.19:0/2596536795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641442e4480 0x5641442ee800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.458+0000 7faf927ef640 1 -- 172.21.15.19:0/2596536795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641442eed40 msgr2=0x5641442f1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:19.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.458+0000 7faf927ef640 1 --2- 172.21.15.19:0/2596536795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641442eed40 0x5641442f1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.458+0000 7faf927ef640 1 -- 172.21.15.19:0/2596536795 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641441fd1f0 con 0x5641442e3b60 2024-09-19T08:58:19.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.458+0000 7faf91fee640 1 --2- 172.21.15.19:0/2596536795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641442e4480 0x5641442ee800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:58:19.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.458+0000 7faf927ef640 1 --2- 172.21.15.19:0/2596536795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641442e3b60 0x5641442e3f40 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7faf84007e10 tx=0x7faf8400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf072f848567eea6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:19.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.458+0000 7faf82ffd640 1 -- 172.21.15.19:0/3083590617 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7faf7c0f00d0 con 0x7faf8c101280 2024-09-19T08:58:19.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.458+0000 7faf927ef640 1 --2- 172.21.15.19:0/3083590617 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7faf780a32c0 0x7faf780a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:19.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.459+0000 7faf77fff640 1 -- 172.21.15.19:0/2596536795 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf84020070 con 0x5641442e3b60 2024-09-19T08:58:19.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.459+0000 7faf77fff640 1 -- 172.21.15.19:0/2596536795 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf8400f3c0 con 0x5641442e3b60 2024-09-19T08:58:19.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.459+0000 7faf77fff640 1 -- 172.21.15.19:0/2596536795 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf84014070 con 0x5641442e3b60 2024-09-19T08:58:19.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.459+0000 7faf9662b740 1 -- 172.21.15.19:0/2596536795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641442e3b60 msgr2=0x5641442e3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:19.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.459+0000 7faf927ef640 1 --2- 172.21.15.19:0/3083590617 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7faf780a32c0 0x7faf780a5780 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7faf8401d000 tx=0x7faf84020000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:19.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.459+0000 7faf9662b740 1 --2- 172.21.15.19:0/2596536795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641442e3b60 0x5641442e3f40 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7faf84007e10 tx=0x7faf8400e720 comp rx=0 tx=0).stop 2024-09-19T08:58:19.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.460+0000 7faf9662b740 1 -- 172.21.15.19:0/2596536795 shutdown_connections 2024-09-19T08:58:19.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.460+0000 7faf9662b740 1 --2- 172.21.15.19:0/2596536795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641442e4480 0x5641442ee800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.460+0000 7faf9662b740 1 --2- 172.21.15.19:0/2596536795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641442eed40 0x5641442f1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.460+0000 7faf9662b740 1 --2- 172.21.15.19:0/2596536795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641442e3b60 0x5641442e3f40 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.460+0000 7faf9662b740 1 -- 172.21.15.19:0/2596536795 >> 172.21.15.19:0/2596536795 conn(0x5641442e00f0 msgr2=0x5641442e04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:19.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.460+0000 7faf9662b740 1 -- 172.21.15.19:0/2596536795 shutdown_connections 2024-09-19T08:58:19.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.460+0000 7faf9662b740 1 -- 172.21.15.19:0/2596536795 wait complete. 2024-09-19T08:58:19.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.460+0000 7faf9662b740 1 -- start start 2024-09-19T08:58:19.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.460+0000 7faf9662b740 1 Processor -- start 2024-09-19T08:58:19.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.461+0000 7faf9662b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641442e3b60 0x5641442ebb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:19.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.461+0000 7faf9662b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641442e4480 0x5641442ec0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:19.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.461+0000 7faf9662b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641442eed40 0x5641442ec5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:19.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.461+0000 7faf9662b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5641442f1910 con 0x5641442e3b60 2024-09-19T08:58:19.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.461+0000 7faf9662b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x564144203f10 con 0x5641442eed40 2024-09-19T08:58:19.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.461+0000 7faf9662b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5641442f1a90 con 0x5641442e4480 2024-09-19T08:58:19.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.461+0000 7faf9662b740 10 client.0 _ll_register_callbacks cb 0x5641441cca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:19.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.461+0000 7faf91fee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641442e3b60 0x5641442ebb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:19.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.461+0000 7faf91fee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641442e3b60 0x5641442ebb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54994/0 (socket says 172.21.15.19:54994) 2024-09-19T08:58:19.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.461+0000 7faf91fee640 1 -- 172.21.15.19:0/2765951831 learned_addr learned my addr 172.21.15.19:0/2765951831 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:19.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.461+0000 7faf917ed640 1 --2- 172.21.15.19:0/2765951831 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641442e4480 0x5641442ec0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:19.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.461+0000 7faf927ef640 1 --2- 172.21.15.19:0/2765951831 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641442eed40 0x5641442ec5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:19.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.461+0000 7faf91fee640 1 -- 172.21.15.19:0/2765951831 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641442e4480 msgr2=0x5641442ec0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:19.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.461+0000 7faf91fee640 1 --2- 172.21.15.19:0/2765951831 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641442e4480 0x5641442ec0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.461+0000 7faf91fee640 1 -- 172.21.15.19:0/2765951831 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641442eed40 msgr2=0x5641442ec5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:19.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.461+0000 7faf91fee640 1 --2- 172.21.15.19:0/2765951831 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641442eed40 0x5641442ec5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.461+0000 7faf91fee640 1 -- 172.21.15.19:0/2765951831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564143fba6a0 con 0x5641442e3b60 2024-09-19T08:58:19.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.461+0000 7faf91fee640 1 --2- 172.21.15.19:0/2765951831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641442e3b60 0x5641442ebb60 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7faf8800de70 tx=0x7faf8800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1cc1cf6d7d587f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:19.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.461+0000 7faf757fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:58:19.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.461+0000 7faf757fa640 1 -- 172.21.15.19:0/2765951831 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf88004020 con 0x5641442e3b60 2024-09-19T08:58:19.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.461+0000 7faf757fa640 1 -- 172.21.15.19:0/2765951831 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7faf880041c0 con 0x5641442e3b60 2024-09-19T08:58:19.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.461+0000 7faf9662b740 1 -- 172.21.15.19:0/2765951831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf8400f3c0 con 0x5641442e3b60 2024-09-19T08:58:19.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.462+0000 7faf757fa640 1 -- 172.21.15.19:0/2765951831 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7faf880043c0 con 0x5641442e3b60 2024-09-19T08:58:19.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.462+0000 7faf9662b740 10 client.16830 fetch_fsmap learned FSMap version 34 2024-09-19T08:58:19.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.462+0000 7faf9662b740 1 -- 172.21.15.19:0/2765951831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5641442fd4c0 con 0x5641442e3b60 2024-09-19T08:58:19.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.462+0000 7faf757fa640 1 -- 172.21.15.19:0/2765951831 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf8400f3c0 con 0x5641442e3b60 2024-09-19T08:58:19.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.462+0000 7faf757fa640 1 -- 172.21.15.19:0/2765951831 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7faf88003a60 con 0x5641442e3b60 2024-09-19T08:58:19.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.462+0000 7faf9662b740 10 client.16830 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T08:58:19.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.462+0000 7faf9662b740 10 client.16830 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:58:19.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.462+0000 7faf9662b740 20 client.16830 populate_metadata read hostname 'smithi019' 2024-09-19T08:58:19.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.462+0000 7faf9662b740 1 --2- 172.21.15.19:0/2765951831 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5641442fe980 0x564144300d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:19.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.462+0000 7faf9662b740 4 client.16830 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:58:19.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.462+0000 7faf9662b740 1 -- 172.21.15.19:0/2765951831 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641442567f0 con 0x5641442fe980 2024-09-19T08:58:19.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.462+0000 7faf917ed640 1 --2- 172.21.15.19:0/2765951831 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5641442fe980 0x564144300d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:19.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.463+0000 7faf917ed640 1 --2- 172.21.15.19:0/2765951831 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5641442fe980 0x564144300d70 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5e8ad4d25f3470a server_cookie=af9c471fbb946eed in_seq=0 out_seq=0 2024-09-19T08:58:19.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.463+0000 7faf757fa640 10 client.16830 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:19.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.464+0000 7faf757fa640 1 -- 172.21.15.19:0/2765951831 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5641442567f0 con 0x5641442fe980 2024-09-19T08:58:19.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.464+0000 7faf757fa640 10 client.16830 handle_command_reply: tid=0 2024-09-19T08:58:19.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.464+0000 7faf9662b740 1 client.16830 shutdown 2024-09-19T08:58:19.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.464+0000 7faf9662b740 1 -- 172.21.15.19:0/2765951831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641442e3b60 msgr2=0x5641442ebb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:19.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.464+0000 7faf9662b740 1 --2- 172.21.15.19:0/2765951831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641442e3b60 0x5641442ebb60 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7faf8800de70 tx=0x7faf8800f730 comp rx=0 tx=0).stop 2024-09-19T08:58:19.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.464+0000 7faf9662b740 1 -- 172.21.15.19:0/2765951831 shutdown_connections 2024-09-19T08:58:19.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.464+0000 7faf9662b740 1 --2- 172.21.15.19:0/2765951831 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5641442fe980 0x564144300d70 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.464+0000 7faf9662b740 1 --2- 172.21.15.19:0/2765951831 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641442e4480 0x5641442ec0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.464+0000 7faf9662b740 1 --2- 172.21.15.19:0/2765951831 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641442eed40 0x5641442ec5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.464+0000 7faf757fa640 0 client.16830 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:19.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.464+0000 7faf9662b740 1 --2- 172.21.15.19:0/2765951831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641442e3b60 0x5641442ebb60 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.464+0000 7faf9662b740 1 -- 172.21.15.19:0/2765951831 >> 172.21.15.19:0/2765951831 conn(0x5641442e00f0 msgr2=0x5641442df270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:19.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.464+0000 7faf9662b740 1 -- 172.21.15.19:0/2765951831 shutdown_connections 2024-09-19T08:58:19.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.464+0000 7faf9662b740 1 -- 172.21.15.19:0/2765951831 wait complete. 2024-09-19T08:58:19.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.464+0000 7faf9662b740 20 client.16830 trim_cache size 0 max 16384 2024-09-19T08:58:19.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.481+0000 7faf9662b740 1 Processor -- start 2024-09-19T08:58:19.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.481+0000 7faf9662b740 1 -- start start 2024-09-19T08:58:19.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.482+0000 7faf9662b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641442e3b60 0x5641442ed9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:19.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.482+0000 7faf9662b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641442e4480 0x564144306620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:19.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.482+0000 7faf9662b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641442eed40 0x564144306b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:19.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.482+0000 7faf9662b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c1af790 con 0x5641442e4480 2024-09-19T08:58:19.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.482+0000 7faf9662b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c1b12d0 con 0x5641442e3b60 2024-09-19T08:58:19.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.482+0000 7faf9662b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c1afe60 con 0x5641442eed40 2024-09-19T08:58:19.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.482+0000 7faf917ed640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641442e4480 0x564144306620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:19.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.482+0000 7faf917ed640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641442e4480 0x564144306620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55010/0 (socket says 172.21.15.19:55010) 2024-09-19T08:58:19.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.482+0000 7faf917ed640 1 -- 172.21.15.19:0/797646792 learned_addr learned my addr 172.21.15.19:0/797646792 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:19.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.482+0000 7faf91fee640 1 --2- 172.21.15.19:0/797646792 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641442e3b60 0x5641442ed9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:19.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.482+0000 7faf917ed640 1 -- 172.21.15.19:0/797646792 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641442eed40 msgr2=0x564144306b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:19.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.482+0000 7faf917ed640 1 --2- 172.21.15.19:0/797646792 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641442eed40 0x564144306b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.482+0000 7faf917ed640 1 -- 172.21.15.19:0/797646792 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641442e3b60 msgr2=0x5641442ed9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:19.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.482+0000 7faf917ed640 1 --2- 172.21.15.19:0/797646792 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641442e3b60 0x5641442ed9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.482+0000 7faf917ed640 1 -- 172.21.15.19:0/797646792 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641442dff20 con 0x5641442e4480 2024-09-19T08:58:19.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.482+0000 7faf91fee640 1 --2- 172.21.15.19:0/797646792 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641442e3b60 0x5641442ed9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:58:19.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.482+0000 7faf917ed640 1 --2- 172.21.15.19:0/797646792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641442e4480 0x564144306620 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7faf7c0bc460 tx=0x7faf7c0a7040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15190505e6cddd07 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:19.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.482+0000 7faf777fe640 1 -- 172.21.15.19:0/797646792 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c049040 con 0x5641442e4480 2024-09-19T08:58:19.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.483+0000 7faf777fe640 1 -- 172.21.15.19:0/797646792 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7faf7c03b580 con 0x5641442e4480 2024-09-19T08:58:19.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.483+0000 7faf777fe640 1 -- 172.21.15.19:0/797646792 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c0c53d0 con 0x5641442e4480 2024-09-19T08:58:19.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.483+0000 7faf9662b740 1 -- 172.21.15.19:0/797646792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641442e4480 msgr2=0x564144306620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:19.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.483+0000 7faf9662b740 1 --2- 172.21.15.19:0/797646792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641442e4480 0x564144306620 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7faf7c0bc460 tx=0x7faf7c0a7040 comp rx=0 tx=0).stop 2024-09-19T08:58:19.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.483+0000 7faf9662b740 1 -- 172.21.15.19:0/797646792 shutdown_connections 2024-09-19T08:58:19.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.483+0000 7faf9662b740 1 --2- 172.21.15.19:0/797646792 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641442eed40 0x564144306b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.483+0000 7faf9662b740 1 --2- 172.21.15.19:0/797646792 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641442e4480 0x564144306620 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.483+0000 7faf9662b740 1 --2- 172.21.15.19:0/797646792 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641442e3b60 0x5641442ed9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.483+0000 7faf9662b740 1 -- 172.21.15.19:0/797646792 >> 172.21.15.19:0/797646792 conn(0x5641442e00f0 msgr2=0x5641442ed2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:19.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.483+0000 7faf9662b740 1 -- 172.21.15.19:0/797646792 shutdown_connections 2024-09-19T08:58:19.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.483+0000 7faf9662b740 1 -- 172.21.15.19:0/797646792 wait complete. 2024-09-19T08:58:19.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.484+0000 7faf9662b740 1 -- start start 2024-09-19T08:58:19.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.484+0000 7faf9662b740 1 Processor -- start 2024-09-19T08:58:19.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.484+0000 7faf9662b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641442e3b60 0x5641442f6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:19.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.484+0000 7faf9662b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641442e4480 0x5641442f7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:19.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.484+0000 7faf9662b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641442eed40 0x5641442e7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:19.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.484+0000 7faf9662b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c1b0c00 con 0x5641442e4480 2024-09-19T08:58:19.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.484+0000 7faf9662b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c1b0530 con 0x5641442e3b60 2024-09-19T08:58:19.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.484+0000 7faf9662b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7faf8c1ad770 con 0x5641442eed40 2024-09-19T08:58:19.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.484+0000 7faf9662b740 10 client.0 _ll_register_callbacks cb 0x7faf8800d380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:19.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.484+0000 7faf917ed640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641442e4480 0x5641442f7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:19.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.484+0000 7faf917ed640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641442e4480 0x5641442f7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55016/0 (socket says 172.21.15.19:55016) 2024-09-19T08:58:19.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.484+0000 7faf917ed640 1 -- 172.21.15.19:0/3674218748 learned_addr learned my addr 172.21.15.19:0/3674218748 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:19.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.484+0000 7faf91fee640 1 --2- 172.21.15.19:0/3674218748 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641442e3b60 0x5641442f6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:19.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.484+0000 7faf927ef640 1 --2- 172.21.15.19:0/3674218748 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641442eed40 0x5641442e7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:19.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.484+0000 7faf917ed640 1 -- 172.21.15.19:0/3674218748 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641442eed40 msgr2=0x5641442e7dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:19.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.484+0000 7faf917ed640 1 --2- 172.21.15.19:0/3674218748 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641442eed40 0x5641442e7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.484+0000 7faf917ed640 1 -- 172.21.15.19:0/3674218748 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641442e3b60 msgr2=0x5641442f6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:19.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.484+0000 7faf917ed640 1 --2- 172.21.15.19:0/3674218748 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641442e3b60 0x5641442f6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.485+0000 7faf917ed640 1 -- 172.21.15.19:0/3674218748 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641442e8310 con 0x5641442e4480 2024-09-19T08:58:19.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.485+0000 7faf917ed640 1 --2- 172.21.15.19:0/3674218748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641442e4480 0x5641442f7220 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7faf7c005ab0 tx=0x7faf7c0b8b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6299106653a49cdd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:19.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.485+0000 7faf757fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:58:19.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.485+0000 7faf757fa640 1 -- 172.21.15.19:0/3674218748 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7c0da070 con 0x5641442e4480 2024-09-19T08:58:19.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.485+0000 7faf9662b740 1 -- 172.21.15.19:0/3674218748 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564144250d00 con 0x5641442e4480 2024-09-19T08:58:19.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.485+0000 7faf757fa640 1 -- 172.21.15.19:0/3674218748 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7faf7c0baa60 con 0x5641442e4480 2024-09-19T08:58:19.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.485+0000 7faf757fa640 1 -- 172.21.15.19:0/3674218748 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7faf7c049070 con 0x5641442e4480 2024-09-19T08:58:19.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.485+0000 7faf9662b740 10 client.16836 fetch_fsmap learned FSMap version 34 2024-09-19T08:58:19.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.485+0000 7faf9662b740 1 -- 172.21.15.19:0/3674218748 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5641442e9560 con 0x5641442e4480 2024-09-19T08:58:19.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.485+0000 7faf757fa640 1 -- 172.21.15.19:0/3674218748 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x564144250d00 con 0x5641442e4480 2024-09-19T08:58:19.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.485+0000 7faf757fa640 1 -- 172.21.15.19:0/3674218748 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7faf7c0c4f40 con 0x5641442e4480 2024-09-19T08:58:19.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.485+0000 7faf9662b740 10 client.16836 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T08:58:19.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.485+0000 7faf9662b740 10 client.16836 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:58:19.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.485+0000 7faf9662b740 20 client.16836 populate_metadata read hostname 'smithi019' 2024-09-19T08:58:19.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.485+0000 7faf9662b740 1 --2- 172.21.15.19:0/3674218748 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56414436a600 0x56414436c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:19.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.485+0000 7faf9662b740 4 client.16836 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:58:19.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.485+0000 7faf9662b740 1 -- 172.21.15.19:0/3674218748 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5641441cd110 con 0x56414436a600 2024-09-19T08:58:19.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.486+0000 7faf91fee640 1 --2- 172.21.15.19:0/3674218748 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56414436a600 0x56414436c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:19.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.486+0000 7faf91fee640 1 --2- 172.21.15.19:0/3674218748 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56414436a600 0x56414436c9f0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f48de5eb4db778 server_cookie=a55db03ebe4a769 in_seq=0 out_seq=0 2024-09-19T08:58:19.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.486+0000 7faf757fa640 10 client.16836 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:19.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.487+0000 7faf757fa640 1 -- 172.21.15.19:0/3674218748 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5641441cd110 con 0x56414436a600 2024-09-19T08:58:19.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.487+0000 7faf757fa640 10 client.16836 handle_command_reply: tid=0 2024-09-19T08:58:19.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.487+0000 7faf9662b740 1 client.16836 shutdown 2024-09-19T08:58:19.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.487+0000 7faf9662b740 1 -- 172.21.15.19:0/3674218748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641442e4480 msgr2=0x5641442f7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:19.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.487+0000 7faf9662b740 1 --2- 172.21.15.19:0/3674218748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641442e4480 0x5641442f7220 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7faf7c005ab0 tx=0x7faf7c0b8b30 comp rx=0 tx=0).stop 2024-09-19T08:58:19.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.487+0000 7faf9662b740 1 -- 172.21.15.19:0/3674218748 shutdown_connections 2024-09-19T08:58:19.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.487+0000 7faf9662b740 1 --2- 172.21.15.19:0/3674218748 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56414436a600 0x56414436c9f0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.487+0000 7faf9662b740 1 --2- 172.21.15.19:0/3674218748 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641442eed40 0x5641442e7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.487+0000 7faf9662b740 1 --2- 172.21.15.19:0/3674218748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641442e4480 0x5641442f7220 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.487+0000 7faf9662b740 1 --2- 172.21.15.19:0/3674218748 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641442e3b60 0x5641442f6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.487+0000 7faf757fa640 0 client.16836 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:19.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.487+0000 7faf9662b740 1 -- 172.21.15.19:0/3674218748 >> 172.21.15.19:0/3674218748 conn(0x5641442e00f0 msgr2=0x5641442df270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:19.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.488+0000 7faf9662b740 1 -- 172.21.15.19:0/3674218748 shutdown_connections 2024-09-19T08:58:19.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.488+0000 7faf9662b740 1 -- 172.21.15.19:0/3674218748 wait complete. 2024-09-19T08:58:19.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.488+0000 7faf9662b740 20 client.16836 trim_cache size 0 max 16384 2024-09-19T08:58:19.501 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:58:19.501 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-19T08:58:19.501 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "1f6e77ba-cc14-4c6e-9760-9962baf34f02", 2024-09-19T08:58:19.501 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-19T08:58:19.501 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:58:19.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.488+0000 7faf94252640 1 -- 172.21.15.19:0/3083590617 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7faf780a32c0 msgr2=0x7faf780a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:19.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.488+0000 7faf94252640 1 --2- 172.21.15.19:0/3083590617 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7faf780a32c0 0x7faf780a5780 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7faf8401d000 tx=0x7faf84020000 comp rx=0 tx=0).stop 2024-09-19T08:58:19.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.488+0000 7faf94252640 1 -- 172.21.15.19:0/3083590617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf8c101280 msgr2=0x7faf8c19ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:19.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.488+0000 7faf94252640 1 --2- 172.21.15.19:0/3083590617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf8c101280 0x7faf8c19ac50 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7faf7c006010 tx=0x7faf7c0042f0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.488+0000 7faf94252640 1 -- 172.21.15.19:0/3083590617 shutdown_connections 2024-09-19T08:58:19.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.488+0000 7faf94252640 1 --2- 172.21.15.19:0/3083590617 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7faf780a32c0 0x7faf780a5780 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.488+0000 7faf94252640 1 --2- 172.21.15.19:0/3083590617 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7faf8c10e480 0x7faf8c19efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.488+0000 7faf94252640 1 --2- 172.21.15.19:0/3083590617 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7faf8c101280 0x7faf8c19ac50 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.488+0000 7faf94252640 1 --2- 172.21.15.19:0/3083590617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faf8c1008d0 0x7faf8c19a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:19.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.488+0000 7faf94252640 1 -- 172.21.15.19:0/3083590617 >> 172.21.15.19:0/3083590617 conn(0x7faf8c0fc7a0 msgr2=0x7faf8c0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:19.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.489+0000 7faf94252640 1 -- 172.21.15.19:0/3083590617 shutdown_connections 2024-09-19T08:58:19.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:19.489+0000 7faf94252640 1 -- 172.21.15.19:0/3083590617 wait complete. 2024-09-19T08:58:19.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:19 smithi155 ceph-mon[34921]: pgmap v520: 97 pgs: 97 active+clean; 2.6 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 258 KiB/s wr, 604 op/s 2024-09-19T08:58:19.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:19 smithi203 ceph-mon[35450]: pgmap v520: 97 pgs: 97 active+clean; 2.6 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 258 KiB/s wr, 604 op/s 2024-09-19T08:58:20.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:19 smithi019 ceph-mon[30976]: pgmap v520: 97 pgs: 97 active+clean; 2.6 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 258 KiB/s wr, 604 op/s 2024-09-19T08:58:20.240 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.239+0000 7fe0705b7640 1 -- 172.21.15.19:0/2668114426 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe068107820 msgr2=0x7fe068109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:20.240 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.239+0000 7fe0705b7640 1 --2- 172.21.15.19:0/2668114426 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe068107820 0x7fe068109c90 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fe060009ca0 tx=0x7fe06002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.240 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.239+0000 7fe0705b7640 1 -- 172.21.15.19:0/2668114426 shutdown_connections 2024-09-19T08:58:20.240 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.239+0000 7fe0705b7640 1 --2- 172.21.15.19:0/2668114426 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe068107820 0x7fe068109c90 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.240 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.239+0000 7fe0705b7640 1 --2- 172.21.15.19:0/2668114426 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe068104ef0 0x7fe0681072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.240 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.239+0000 7fe0705b7640 1 --2- 172.21.15.19:0/2668114426 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0681025c0 0x7fe0681049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.240 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.239+0000 7fe0705b7640 1 -- 172.21.15.19:0/2668114426 >> 172.21.15.19:0/2668114426 conn(0x7fe0680fc1e0 msgr2=0x7fe0680fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:20.240 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.239+0000 7fe0705b7640 1 -- 172.21.15.19:0/2668114426 shutdown_connections 2024-09-19T08:58:20.241 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.239+0000 7fe0705b7640 1 -- 172.21.15.19:0/2668114426 wait complete. 2024-09-19T08:58:20.242 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.240+0000 7fe0705b7640 1 Processor -- start 2024-09-19T08:58:20.242 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.240+0000 7fe0705b7640 1 -- start start 2024-09-19T08:58:20.243 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.240+0000 7fe0705b7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0681025c0 0x7fe06819a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:20.243 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.240+0000 7fe0705b7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe068104ef0 0x7fe06819a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:20.243 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.240+0000 7fe0705b7640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe068107820 0x7fe0681a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:20.243 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.240+0000 7fe0705b7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe06810d850 con 0x7fe0681025c0 2024-09-19T08:58:20.243 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.240+0000 7fe0705b7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe06810d6d0 con 0x7fe068104ef0 2024-09-19T08:58:20.243 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.240+0000 7fe0705b7640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe06810d9d0 con 0x7fe068107820 2024-09-19T08:58:20.243 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.241+0000 7fe06e353640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0681025c0 0x7fe06819a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:20.243 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.241+0000 7fe06db52640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe068104ef0 0x7fe06819a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:20.243 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.241+0000 7fe06e353640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0681025c0 0x7fe06819a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55036/0 (socket says 172.21.15.19:55036) 2024-09-19T08:58:20.243 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.241+0000 7fe06e353640 1 -- 172.21.15.19:0/2575450504 learned_addr learned my addr 172.21.15.19:0/2575450504 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:20.243 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.241+0000 7fe06eb54640 1 --2- 172.21.15.19:0/2575450504 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe068107820 0x7fe0681a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:20.243 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.241+0000 7fe06e353640 1 -- 172.21.15.19:0/2575450504 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe068107820 msgr2=0x7fe0681a1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:20.243 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.241+0000 7fe06e353640 1 --2- 172.21.15.19:0/2575450504 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe068107820 0x7fe0681a1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.244 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.241+0000 7fe06e353640 1 -- 172.21.15.19:0/2575450504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe068104ef0 msgr2=0x7fe06819a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:20.244 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.241+0000 7fe06e353640 1 --2- 172.21.15.19:0/2575450504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe068104ef0 0x7fe06819a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.244 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.241+0000 7fe06e353640 1 -- 172.21.15.19:0/2575450504 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0681a1c70 con 0x7fe0681025c0 2024-09-19T08:58:20.244 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.241+0000 7fe06e353640 1 --2- 172.21.15.19:0/2575450504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0681025c0 0x7fe06819a050 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fe06400e9f0 tx=0x7fe06400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:20.244 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.241+0000 7fe05f7fe640 1 -- 172.21.15.19:0/2575450504 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06400cd80 con 0x7fe0681025c0 2024-09-19T08:58:20.244 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.242+0000 7fe05f7fe640 1 -- 172.21.15.19:0/2575450504 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe064005500 con 0x7fe0681025c0 2024-09-19T08:58:20.244 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.242+0000 7fe05f7fe640 1 -- 172.21.15.19:0/2575450504 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe064010690 con 0x7fe0681025c0 2024-09-19T08:58:20.244 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.242+0000 7fe0705b7640 1 -- 172.21.15.19:0/2575450504 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0681a1f60 con 0x7fe0681025c0 2024-09-19T08:58:20.244 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.242+0000 7fe0705b7640 1 -- 172.21.15.19:0/2575450504 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0681a23c0 con 0x7fe0681025c0 2024-09-19T08:58:20.246 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.245+0000 7fe073429740 1 Processor -- start 2024-09-19T08:58:20.247 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.245+0000 7fe05f7fe640 1 -- 172.21.15.19:0/2575450504 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fe0640046c0 con 0x7fe0681025c0 2024-09-19T08:58:20.247 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.245+0000 7fe073429740 1 -- start start 2024-09-19T08:58:20.247 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.245+0000 7fe073429740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562ab2e5d9a0 0x562ab2e5dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:20.247 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.245+0000 7fe073429740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ab2e5e2e0 0x562ab2e62da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:20.247 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.245+0000 7fe073429740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562ab2e63370 0x562ab2e65830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:20.247 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.245+0000 7fe073429740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562ab2dc12f0 con 0x562ab2e5e2e0 2024-09-19T08:58:20.247 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.245+0000 7fe073429740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x562ab2d69270 con 0x562ab2e5d9a0 2024-09-19T08:58:20.247 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.245+0000 7fe073429740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562ab2dbd2b0 con 0x562ab2e63370 2024-09-19T08:58:20.247 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.245+0000 7fe06eb54640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562ab2e5d9a0 0x562ab2e5dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:20.247 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.245+0000 7fe06db52640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562ab2e63370 0x562ab2e65830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:20.247 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.245+0000 7fe06eb54640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562ab2e5d9a0 0x562ab2e5dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:57226/0 (socket says 172.21.15.19:57226) 2024-09-19T08:58:20.247 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.245+0000 7fe06e353640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ab2e5e2e0 0x562ab2e62da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.245+0000 7fe06eb54640 1 -- 172.21.15.19:0/4029099522 learned_addr learned my addr 172.21.15.19:0/4029099522 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.246+0000 7fe06eb54640 1 -- 172.21.15.19:0/4029099522 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562ab2e63370 msgr2=0x562ab2e65830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.246+0000 7fe06eb54640 1 --2- 172.21.15.19:0/4029099522 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562ab2e63370 0x562ab2e65830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.246+0000 7fe06eb54640 1 -- 172.21.15.19:0/4029099522 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ab2e5e2e0 msgr2=0x562ab2e62da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.246+0000 7fe06eb54640 1 --2- 172.21.15.19:0/4029099522 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ab2e5e2e0 0x562ab2e62da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.246+0000 7fe06eb54640 1 -- 172.21.15.19:0/4029099522 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ab2d68340 con 0x562ab2e5d9a0 2024-09-19T08:58:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.246+0000 7fe06db52640 1 --2- 172.21.15.19:0/4029099522 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562ab2e63370 0x562ab2e65830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:58:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.246+0000 7fe05f7fe640 1 --2- 172.21.15.19:0/2575450504 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe0540a3370 0x7fe0540a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.246+0000 7fe06eb54640 1 --2- 172.21.15.19:0/4029099522 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562ab2e5d9a0 0x562ab2e5dda0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe06806a980 tx=0x7fe060005fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7c9b8e659f02fd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.246+0000 7fe06e353640 1 --2- 172.21.15.19:0/2575450504 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe0540a3370 0x7fe0540a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.246+0000 7fe05f7fe640 1 -- 172.21.15.19:0/2575450504 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fe0640cfc80 con 0x7fe0681025c0 2024-09-19T08:58:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.246+0000 7fe05cbfe640 1 -- 172.21.15.19:0/4029099522 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe060031650 con 0x562ab2e5d9a0 2024-09-19T08:58:20.248 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.246+0000 7fe05cbfe640 1 -- 172.21.15.19:0/4029099522 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe060036030 con 0x562ab2e5d9a0 2024-09-19T08:58:20.249 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.246+0000 7fe05cbfe640 1 -- 172.21.15.19:0/4029099522 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe060004780 con 0x562ab2e5d9a0 2024-09-19T08:58:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.247+0000 7fe073429740 1 -- 172.21.15.19:0/4029099522 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562ab2e5d9a0 msgr2=0x562ab2e5dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.247+0000 7fe06e353640 1 --2- 172.21.15.19:0/2575450504 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe0540a3370 0x7fe0540a5830 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe0640cdb00 tx=0x7fe0640d3760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.247+0000 7fe073429740 1 --2- 172.21.15.19:0/4029099522 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562ab2e5d9a0 0x562ab2e5dda0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe06806a980 tx=0x7fe060005fa0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.248+0000 7fe073429740 1 -- 172.21.15.19:0/4029099522 shutdown_connections 2024-09-19T08:58:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.248+0000 7fe073429740 1 --2- 172.21.15.19:0/4029099522 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562ab2e63370 0x562ab2e65830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.248+0000 7fe073429740 1 --2- 172.21.15.19:0/4029099522 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ab2e5e2e0 0x562ab2e62da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.248+0000 7fe073429740 1 --2- 172.21.15.19:0/4029099522 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562ab2e5d9a0 0x562ab2e5dda0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.248+0000 7fe073429740 1 -- 172.21.15.19:0/4029099522 >> 172.21.15.19:0/4029099522 conn(0x562ab2e59010 msgr2=0x562ab2e59410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.248+0000 7fe073429740 1 -- 172.21.15.19:0/4029099522 shutdown_connections 2024-09-19T08:58:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.248+0000 7fe073429740 1 -- 172.21.15.19:0/4029099522 wait complete. 2024-09-19T08:58:20.252 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.248+0000 7fe073429740 1 -- start start 2024-09-19T08:58:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.248+0000 7fe073429740 1 Processor -- start 2024-09-19T08:58:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.249+0000 7fe073429740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562ab2e5d9a0 0x562ab2e67a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.249+0000 7fe073429740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ab2e5e2e0 0x562ab2e67f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.249+0000 7fe073429740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562ab2e63370 0x562ab2e6ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.249+0000 7fe073429740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x562ab2e66160 con 0x562ab2e5e2e0 2024-09-19T08:58:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.249+0000 7fe073429740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x562ab2d4a290 con 0x562ab2e63370 2024-09-19T08:58:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.249+0000 7fe06db52640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ab2e5e2e0 0x562ab2e67f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.249+0000 7fe073429740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562ab2e662e0 con 0x562ab2e5d9a0 2024-09-19T08:58:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.249+0000 7fe06eb54640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562ab2e5d9a0 0x562ab2e67a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.249+0000 7fe06db52640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ab2e5e2e0 0x562ab2e67f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55064/0 (socket says 172.21.15.19:55064) 2024-09-19T08:58:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.249+0000 7fe06db52640 1 -- 172.21.15.19:0/2549980306 learned_addr learned my addr 172.21.15.19:0/2549980306 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.249+0000 7fe073429740 10 client.0 _ll_register_callbacks cb 0x562ab2d7b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.249+0000 7fe06eb54640 1 --2- 172.21.15.19:0/2549980306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562ab2e63370 0x562ab2e6ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:20.253 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.249+0000 7fe06db52640 1 -- 172.21.15.19:0/2549980306 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562ab2e5d9a0 msgr2=0x562ab2e67a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.249+0000 7fe06db52640 1 --2- 172.21.15.19:0/2549980306 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562ab2e5d9a0 0x562ab2e67a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.249+0000 7fe06db52640 1 -- 172.21.15.19:0/2549980306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562ab2e63370 msgr2=0x562ab2e6ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.249+0000 7fe06db52640 1 --2- 172.21.15.19:0/2549980306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562ab2e63370 0x562ab2e6ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.249+0000 7fe06db52640 1 -- 172.21.15.19:0/2549980306 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ab2ad4210 con 0x562ab2e5e2e0 2024-09-19T08:58:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.249+0000 7fe06eb54640 1 --2- 172.21.15.19:0/2549980306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562ab2e63370 0x562ab2e6ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:58:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.249+0000 7fe06db52640 1 --2- 172.21.15.19:0/2549980306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ab2e5e2e0 0x562ab2e67f50 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fe05800bf50 tx=0x7fe0580118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fdefe6872a6beb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.249+0000 7fe051ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:58:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.250+0000 7fe051ffb640 1 -- 172.21.15.19:0/2549980306 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe058004020 con 0x562ab2e5e2e0 2024-09-19T08:58:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.250+0000 7fe051ffb640 1 -- 172.21.15.19:0/2549980306 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fe0580041c0 con 0x562ab2e5e2e0 2024-09-19T08:58:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.250+0000 7fe073429740 1 -- 172.21.15.19:0/2549980306 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe060036030 con 0x562ab2e5e2e0 2024-09-19T08:58:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.250+0000 7fe051ffb640 1 -- 172.21.15.19:0/2549980306 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe0580043c0 con 0x562ab2e5e2e0 2024-09-19T08:58:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.250+0000 7fe073429740 10 client.16848 fetch_fsmap learned FSMap version 34 2024-09-19T08:58:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.250+0000 7fe073429740 1 -- 172.21.15.19:0/2549980306 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562ab2ba0620 con 0x562ab2e5e2e0 2024-09-19T08:58:20.254 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.250+0000 7fe051ffb640 1 -- 172.21.15.19:0/2549980306 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe060036030 con 0x562ab2e5e2e0 2024-09-19T08:58:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.250+0000 7fe051ffb640 1 -- 172.21.15.19:0/2549980306 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7fe058010700 con 0x562ab2e5e2e0 2024-09-19T08:58:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.251+0000 7fe073429740 10 client.16848 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T08:58:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.251+0000 7fe073429740 10 client.16848 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:58:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.251+0000 7fe073429740 20 client.16848 populate_metadata read hostname 'smithi019' 2024-09-19T08:58:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.251+0000 7fe073429740 1 --2- 172.21.15.19:0/2549980306 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x562ab2e736f0 0x562ab2e75ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.251+0000 7fe073429740 4 client.16848 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:58:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.251+0000 7fe073429740 1 -- 172.21.15.19:0/2549980306 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562ab2dcea20 con 0x562ab2e736f0 2024-09-19T08:58:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.251+0000 7fe06eb54640 1 --2- 172.21.15.19:0/2549980306 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x562ab2e736f0 0x562ab2e75ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.251+0000 7fe051ffb640 10 client.16848 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:20.255 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.251+0000 7fe06eb54640 1 --2- 172.21.15.19:0/2549980306 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x562ab2e736f0 0x562ab2e75ae0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40cd203cb2cb900e server_cookie=79f465c450babda4 in_seq=0 out_seq=0 2024-09-19T08:58:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.252+0000 7fe051ffb640 1 -- 172.21.15.19:0/2549980306 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562ab2dcea20 con 0x562ab2e736f0 2024-09-19T08:58:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.252+0000 7fe051ffb640 10 client.16848 handle_command_reply: tid=0 2024-09-19T08:58:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.253+0000 7fe073429740 1 client.16848 shutdown 2024-09-19T08:58:20.256 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.253+0000 7fe073429740 1 -- 172.21.15.19:0/2549980306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ab2e5e2e0 msgr2=0x562ab2e67f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.253+0000 7fe073429740 1 --2- 172.21.15.19:0/2549980306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ab2e5e2e0 0x562ab2e67f50 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fe05800bf50 tx=0x7fe0580118d0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.253+0000 7fe073429740 1 -- 172.21.15.19:0/2549980306 shutdown_connections 2024-09-19T08:58:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.253+0000 7fe073429740 1 --2- 172.21.15.19:0/2549980306 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x562ab2e736f0 0x562ab2e75ae0 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.253+0000 7fe073429740 1 --2- 172.21.15.19:0/2549980306 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562ab2e63370 0x562ab2e6ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.253+0000 7fe073429740 1 --2- 172.21.15.19:0/2549980306 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ab2e5e2e0 0x562ab2e67f50 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.253+0000 7fe073429740 1 --2- 172.21.15.19:0/2549980306 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562ab2e5d9a0 0x562ab2e67a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.253+0000 7fe051ffb640 0 client.16848 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.253+0000 7fe073429740 1 -- 172.21.15.19:0/2549980306 >> 172.21.15.19:0/2549980306 conn(0x562ab2e59010 msgr2=0x562ab2e5a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.253+0000 7fe073429740 1 -- 172.21.15.19:0/2549980306 shutdown_connections 2024-09-19T08:58:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.253+0000 7fe073429740 1 -- 172.21.15.19:0/2549980306 wait complete. 2024-09-19T08:58:20.257 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.253+0000 7fe073429740 20 client.16848 trim_cache size 0 max 16384 2024-09-19T08:58:20.272 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.271+0000 7fe073429740 1 Processor -- start 2024-09-19T08:58:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.271+0000 7fe073429740 1 -- start start 2024-09-19T08:58:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.271+0000 7fe073429740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562ab2e5d9a0 0x562ab2e593f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.271+0000 7fe073429740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ab2e5e2e0 0x562ab2e6ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.271+0000 7fe073429740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562ab2e63370 0x562ab2e59930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.271+0000 7fe073429740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe0681ab0f0 con 0x562ab2e5e2e0 2024-09-19T08:58:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.271+0000 7fe073429740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe0681acc30 con 0x562ab2e63370 2024-09-19T08:58:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.271+0000 7fe073429740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe0681ab7c0 con 0x562ab2e5d9a0 2024-09-19T08:58:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.272+0000 7fe06db52640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ab2e5e2e0 0x562ab2e6ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.272+0000 7fe06db52640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ab2e5e2e0 0x562ab2e6ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55072/0 (socket says 172.21.15.19:55072) 2024-09-19T08:58:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.272+0000 7fe06db52640 1 -- 172.21.15.19:0/3090880632 learned_addr learned my addr 172.21.15.19:0/3090880632 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.272+0000 7fe06eb54640 1 --2- 172.21.15.19:0/3090880632 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562ab2e5d9a0 0x562ab2e593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:20.273 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.272+0000 7fe06eb54640 1 --2- 172.21.15.19:0/3090880632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562ab2e63370 0x562ab2e59930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.272+0000 7fe06db52640 1 -- 172.21.15.19:0/3090880632 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562ab2e5d9a0 msgr2=0x562ab2e593f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.272+0000 7fe06db52640 1 --2- 172.21.15.19:0/3090880632 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562ab2e5d9a0 0x562ab2e593f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.272+0000 7fe06db52640 1 -- 172.21.15.19:0/3090880632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562ab2e63370 msgr2=0x562ab2e59930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.272+0000 7fe06db52640 1 --2- 172.21.15.19:0/3090880632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562ab2e63370 0x562ab2e59930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.272+0000 7fe06db52640 1 -- 172.21.15.19:0/3090880632 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562ab2e72050 con 0x562ab2e5e2e0 2024-09-19T08:58:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.272+0000 7fe06db52640 1 --2- 172.21.15.19:0/3090880632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ab2e5e2e0 0x562ab2e6ef50 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fe0580058c0 tx=0x7fe05800b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ddea6e771c60be4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.272+0000 7fe053fff640 1 -- 172.21.15.19:0/3090880632 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe05802a070 con 0x562ab2e5e2e0 2024-09-19T08:58:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.272+0000 7fe053fff640 1 -- 172.21.15.19:0/3090880632 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe058005550 con 0x562ab2e5e2e0 2024-09-19T08:58:20.274 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.272+0000 7fe053fff640 1 -- 172.21.15.19:0/3090880632 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe058004970 con 0x562ab2e5e2e0 2024-09-19T08:58:20.277 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.273+0000 7fe073429740 1 -- 172.21.15.19:0/3090880632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ab2e5e2e0 msgr2=0x562ab2e6ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:20.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.273+0000 7fe073429740 1 --2- 172.21.15.19:0/3090880632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ab2e5e2e0 0x562ab2e6ef50 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fe0580058c0 tx=0x7fe05800b940 comp rx=0 tx=0).stop 2024-09-19T08:58:20.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.273+0000 7fe073429740 1 -- 172.21.15.19:0/3090880632 shutdown_connections 2024-09-19T08:58:20.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.273+0000 7fe073429740 1 --2- 172.21.15.19:0/3090880632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562ab2e63370 0x562ab2e59930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.273+0000 7fe073429740 1 --2- 172.21.15.19:0/3090880632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ab2e5e2e0 0x562ab2e6ef50 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.273+0000 7fe073429740 1 --2- 172.21.15.19:0/3090880632 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562ab2e5d9a0 0x562ab2e593f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.273+0000 7fe073429740 1 -- 172.21.15.19:0/3090880632 >> 172.21.15.19:0/3090880632 conn(0x562ab2e59010 msgr2=0x562ab2e67a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:20.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.273+0000 7fe073429740 1 -- 172.21.15.19:0/3090880632 shutdown_connections 2024-09-19T08:58:20.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.273+0000 7fe073429740 1 -- 172.21.15.19:0/3090880632 wait complete. 2024-09-19T08:58:20.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.273+0000 7fe073429740 1 -- start start 2024-09-19T08:58:20.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.274+0000 7fe073429740 1 Processor -- start 2024-09-19T08:58:20.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.274+0000 7fe073429740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ab2e5d9a0 0x562ab2e6c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:20.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.274+0000 7fe073429740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562ab2e5e2e0 0x562ab2e6c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:20.278 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.274+0000 7fe073429740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562ab2e63370 0x562ab2e6d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.274+0000 7fe073429740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe0681ac560 con 0x562ab2e5d9a0 2024-09-19T08:58:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.274+0000 7fe073429740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe0681abe90 con 0x562ab2e5e2e0 2024-09-19T08:58:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.274+0000 7fe073429740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe0681a90d0 con 0x562ab2e63370 2024-09-19T08:58:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.274+0000 7fe073429740 10 client.0 _ll_register_callbacks cb 0x7fe05800bb90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.274+0000 7fe06eb54640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ab2e5d9a0 0x562ab2e6c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.274+0000 7fe06eb54640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ab2e5d9a0 0x562ab2e6c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55078/0 (socket says 172.21.15.19:55078) 2024-09-19T08:58:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.274+0000 7fe06eb54640 1 -- 172.21.15.19:0/638956462 learned_addr learned my addr 172.21.15.19:0/638956462 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.274+0000 7fe06db52640 1 --2- 172.21.15.19:0/638956462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562ab2e5e2e0 0x562ab2e6c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.274+0000 7fe06eb54640 1 --2- 172.21.15.19:0/638956462 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562ab2e63370 0x562ab2e6d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.274+0000 7fe06eb54640 1 -- 172.21.15.19:0/638956462 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562ab2e63370 msgr2=0x562ab2e6d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.274+0000 7fe06eb54640 1 --2- 172.21.15.19:0/638956462 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562ab2e63370 0x562ab2e6d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.279 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.274+0000 7fe06eb54640 1 -- 172.21.15.19:0/638956462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562ab2e5e2e0 msgr2=0x562ab2e6c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.274+0000 7fe06eb54640 1 --2- 172.21.15.19:0/638956462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562ab2e5e2e0 0x562ab2e6c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.274+0000 7fe06eb54640 1 -- 172.21.15.19:0/638956462 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562ab2e6dbb0 con 0x562ab2e5d9a0 2024-09-19T08:58:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.274+0000 7fe06eb54640 1 --2- 172.21.15.19:0/638956462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ab2e5d9a0 0x562ab2e6c050 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fe06002f470 tx=0x7fe05800bb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b499049e019af61c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.274+0000 7fe051ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:58:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.275+0000 7fe051ffb640 1 -- 172.21.15.19:0/638956462 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe060031450 con 0x562ab2e5d9a0 2024-09-19T08:58:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.275+0000 7fe051ffb640 1 -- 172.21.15.19:0/638956462 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fe0600315f0 con 0x562ab2e5d9a0 2024-09-19T08:58:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.275+0000 7fe073429740 1 -- 172.21.15.19:0/638956462 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe058005550 con 0x562ab2e5d9a0 2024-09-19T08:58:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.275+0000 7fe051ffb640 1 -- 172.21.15.19:0/638956462 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe0600317f0 con 0x562ab2e5d9a0 2024-09-19T08:58:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.275+0000 7fe073429740 10 client.16854 fetch_fsmap learned FSMap version 34 2024-09-19T08:58:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.275+0000 7fe073429740 1 -- 172.21.15.19:0/638956462 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562ab2e6ef30 con 0x562ab2e5d9a0 2024-09-19T08:58:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.275+0000 7fe051ffb640 1 -- 172.21.15.19:0/638956462 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe058005550 con 0x562ab2e5d9a0 2024-09-19T08:58:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.275+0000 7fe051ffb640 1 -- 172.21.15.19:0/638956462 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7fe060050040 con 0x562ab2e5d9a0 2024-09-19T08:58:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.275+0000 7fe073429740 10 client.16854 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T08:58:20.280 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.275+0000 7fe073429740 10 client.16854 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:58:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.275+0000 7fe073429740 20 client.16854 populate_metadata read hostname 'smithi019' 2024-09-19T08:58:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.275+0000 7fe073429740 1 --2- 172.21.15.19:0/638956462 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x562ab2ede4f0 0x562ab2ee08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.275+0000 7fe073429740 4 client.16854 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:58:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.275+0000 7fe073429740 1 -- 172.21.15.19:0/638956462 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562ab2dc8d70 con 0x562ab2ede4f0 2024-09-19T08:58:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.276+0000 7fe06db52640 1 --2- 172.21.15.19:0/638956462 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x562ab2ede4f0 0x562ab2ee08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.276+0000 7fe06db52640 1 --2- 172.21.15.19:0/638956462 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x562ab2ede4f0 0x562ab2ee08e0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=749b1d7494eae107 server_cookie=11f3461d2d336f72 in_seq=0 out_seq=0 2024-09-19T08:58:20.281 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.276+0000 7fe051ffb640 10 client.16854 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:20.352 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:58:20.435 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.433+0000 7fe051ffb640 1 -- 172.21.15.19:0/638956462 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fe058034040 con 0x562ab2ede4f0 2024-09-19T08:58:20.435 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.433+0000 7fe051ffb640 10 client.16854 handle_command_reply: tid=0 2024-09-19T08:58:20.435 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.433+0000 7fe073429740 1 client.16854 shutdown 2024-09-19T08:58:20.435 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.434+0000 7fe073429740 1 -- 172.21.15.19:0/638956462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ab2e5d9a0 msgr2=0x562ab2e6c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:20.435 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.434+0000 7fe073429740 1 --2- 172.21.15.19:0/638956462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ab2e5d9a0 0x562ab2e6c050 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fe06002f470 tx=0x7fe05800bb00 comp rx=0 tx=0).stop 2024-09-19T08:58:20.435 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.434+0000 7fe073429740 1 -- 172.21.15.19:0/638956462 shutdown_connections 2024-09-19T08:58:20.435 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.434+0000 7fe073429740 1 --2- 172.21.15.19:0/638956462 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x562ab2ede4f0 0x562ab2ee08e0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.435 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.434+0000 7fe073429740 1 --2- 172.21.15.19:0/638956462 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562ab2e63370 0x562ab2e6d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.435 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.434+0000 7fe073429740 1 --2- 172.21.15.19:0/638956462 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x562ab2e5e2e0 0x562ab2e6c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.435 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.434+0000 7fe073429740 1 --2- 172.21.15.19:0/638956462 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x562ab2e5d9a0 0x562ab2e6c050 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.435 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.434+0000 7fe051ffb640 0 client.16854 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:20.436 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.434+0000 7fe073429740 1 -- 172.21.15.19:0/638956462 >> 172.21.15.19:0/638956462 conn(0x562ab2e59010 msgr2=0x562ab2e579a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:20.436 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.434+0000 7fe073429740 1 -- 172.21.15.19:0/638956462 shutdown_connections 2024-09-19T08:58:20.436 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.434+0000 7fe073429740 1 -- 172.21.15.19:0/638956462 wait complete. 2024-09-19T08:58:20.436 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.434+0000 7fe073429740 20 client.16854 trim_cache size 0 max 16384 2024-09-19T08:58:20.436 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T08:58:20.436 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T08:58:20.436 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T08:58:20.436 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T08:58:20.437 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.435+0000 7fe0705b7640 1 -- 172.21.15.19:0/2575450504 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe0540a3370 msgr2=0x7fe0540a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:20.437 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.435+0000 7fe0705b7640 1 --2- 172.21.15.19:0/2575450504 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe0540a3370 0x7fe0540a5830 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe0640cdb00 tx=0x7fe0640d3760 comp rx=0 tx=0).stop 2024-09-19T08:58:20.437 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.435+0000 7fe0705b7640 1 -- 172.21.15.19:0/2575450504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0681025c0 msgr2=0x7fe06819a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:20.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.435+0000 7fe0705b7640 1 --2- 172.21.15.19:0/2575450504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0681025c0 0x7fe06819a050 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fe06400e9f0 tx=0x7fe06400edf0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.435+0000 7fe0705b7640 1 -- 172.21.15.19:0/2575450504 shutdown_connections 2024-09-19T08:58:20.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.435+0000 7fe0705b7640 1 --2- 172.21.15.19:0/2575450504 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe0540a3370 0x7fe0540a5830 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.435+0000 7fe0705b7640 1 --2- 172.21.15.19:0/2575450504 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe068107820 0x7fe0681a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.435+0000 7fe0705b7640 1 --2- 172.21.15.19:0/2575450504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe068104ef0 0x7fe06819a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.435+0000 7fe0705b7640 1 --2- 172.21.15.19:0/2575450504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0681025c0 0x7fe06819a050 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:20.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.435+0000 7fe0705b7640 1 -- 172.21.15.19:0/2575450504 >> 172.21.15.19:0/2575450504 conn(0x7fe0680fc1e0 msgr2=0x7fe068101b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:20.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.435+0000 7fe0705b7640 1 -- 172.21.15.19:0/2575450504 shutdown_connections 2024-09-19T08:58:20.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:20.435+0000 7fe0705b7640 1 -- 172.21.15.19:0/2575450504 wait complete. 2024-09-19T08:58:20.458 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:58:20.712 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:58:20.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:20 smithi019 ceph-mon[30976]: scrub queued for path: / 2024-09-19T08:58:20.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:20 smithi019 ceph-mon[30976]: scrub summary: idle+waiting paths [/] 2024-09-19T08:58:20.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:20 smithi019 ceph-mon[30976]: scrub summary: active paths [/] 2024-09-19T08:58:20.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:20 smithi155 ceph-mon[34921]: scrub queued for path: / 2024-09-19T08:58:20.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:20 smithi155 ceph-mon[34921]: scrub summary: idle+waiting paths [/] 2024-09-19T08:58:20.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:20 smithi155 ceph-mon[34921]: scrub summary: active paths [/] 2024-09-19T08:58:20.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:20 smithi203 ceph-mon[35450]: scrub queued for path: / 2024-09-19T08:58:20.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:20 smithi203 ceph-mon[35450]: scrub summary: idle+waiting paths [/] 2024-09-19T08:58:20.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:20 smithi203 ceph-mon[35450]: scrub summary: active paths [/] 2024-09-19T08:58:21.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.263+0000 7fee02113640 1 -- 172.21.15.19:0/3463627358 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedfc1082a0 msgr2=0x7fedfc10ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:21.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.263+0000 7fee02113640 1 --2- 172.21.15.19:0/3463627358 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedfc1082a0 0x7fedfc10ec40 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fedf4009cd0 tx=0x7fedf402a8e0 comp rx=0 tx=0).stop 2024-09-19T08:58:21.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.263+0000 7fee02113640 1 -- 172.21.15.19:0/3463627358 shutdown_connections 2024-09-19T08:58:21.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.263+0000 7fee02113640 1 --2- 172.21.15.19:0/3463627358 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedfc1082a0 0x7fedfc10ec40 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:21.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.263+0000 7fee02113640 1 --2- 172.21.15.19:0/3463627358 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedfc1036e0 0x7fedfc107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:21.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.263+0000 7fee02113640 1 --2- 172.21.15.19:0/3463627358 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedfc102d30 0x7fedfc103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:21.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.263+0000 7fee02113640 1 -- 172.21.15.19:0/3463627358 >> 172.21.15.19:0/3463627358 conn(0x7fedfc0fc7d0 msgr2=0x7fedfc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:21.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.263+0000 7fee02113640 1 -- 172.21.15.19:0/3463627358 shutdown_connections 2024-09-19T08:58:21.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.263+0000 7fee02113640 1 -- 172.21.15.19:0/3463627358 wait complete. 2024-09-19T08:58:21.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.264+0000 7fee02113640 1 Processor -- start 2024-09-19T08:58:21.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.264+0000 7fee02113640 1 -- start start 2024-09-19T08:58:21.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.265+0000 7fee02113640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedfc102d30 0x7fedfc19a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:21.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.265+0000 7fee02113640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedfc1036e0 0x7fedfc19ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:21.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.265+0000 7fee02113640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedfc1082a0 0x7fedfc19f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:21.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.265+0000 7fee02113640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fedfc1120a0 con 0x7fedfc1036e0 2024-09-19T08:58:21.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.265+0000 7fee02113640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fedfc111f20 con 0x7fedfc1082a0 2024-09-19T08:58:21.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.265+0000 7fee02113640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fedfc112220 con 0x7fedfc102d30 2024-09-19T08:58:21.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.265+0000 7fedfb7fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedfc102d30 0x7fedfc19a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:21.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.265+0000 7fedfb7fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedfc102d30 0x7fedfc19a740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:42590/0 (socket says 172.21.15.19:42590) 2024-09-19T08:58:21.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.265+0000 7fedfb7fe640 1 -- 172.21.15.19:0/1107853416 learned_addr learned my addr 172.21.15.19:0/1107853416 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:21.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.265+0000 7fedfb7fe640 1 -- 172.21.15.19:0/1107853416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedfc1082a0 msgr2=0x7fedfc19f010 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T08:58:21.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.265+0000 7fedfb7fe640 1 --2- 172.21.15.19:0/1107853416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedfc1082a0 0x7fedfc19f010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:21.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.265+0000 7fedfb7fe640 1 -- 172.21.15.19:0/1107853416 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedfc1036e0 msgr2=0x7fedfc19ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:21.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.265+0000 7fedfb7fe640 1 --2- 172.21.15.19:0/1107853416 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedfc1036e0 0x7fedfc19ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:21.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.265+0000 7fedfb7fe640 1 -- 172.21.15.19:0/1107853416 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedfc19f6f0 con 0x7fedfc102d30 2024-09-19T08:58:21.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.265+0000 7fedfb7fe640 1 --2- 172.21.15.19:0/1107853416 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedfc102d30 0x7fedfc19a740 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fedec00e9f0 tx=0x7fedec00edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:21.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.266+0000 7fedf8ff9640 1 -- 172.21.15.19:0/1107853416 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedec00cd80 con 0x7fedfc102d30 2024-09-19T08:58:21.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.266+0000 7fedf8ff9640 1 -- 172.21.15.19:0/1107853416 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fedec005500 con 0x7fedfc102d30 2024-09-19T08:58:21.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.266+0000 7fee02113640 1 -- 172.21.15.19:0/1107853416 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedfc19f9e0 con 0x7fedfc102d30 2024-09-19T08:58:21.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.266+0000 7fedf8ff9640 1 -- 172.21.15.19:0/1107853416 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedec010690 con 0x7fedfc102d30 2024-09-19T08:58:21.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.266+0000 7fee02113640 1 -- 172.21.15.19:0/1107853416 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedfc1a72c0 con 0x7fedfc102d30 2024-09-19T08:58:21.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.267+0000 7fee02113640 1 -- 172.21.15.19:0/1107853416 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedfc103110 con 0x7fedfc102d30 2024-09-19T08:58:21.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.269+0000 7fedf8ff9640 1 -- 172.21.15.19:0/1107853416 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fedec0046c0 con 0x7fedfc102d30 2024-09-19T08:58:21.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.270+0000 7fedf8ff9640 1 --2- 172.21.15.19:0/1107853416 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fede40a3240 0x7fede40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:21.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.270+0000 7fedf8ff9640 1 -- 172.21.15.19:0/1107853416 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fedec0cfe60 con 0x7fedfc102d30 2024-09-19T08:58:21.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.270+0000 7fedfaffd640 1 --2- 172.21.15.19:0/1107853416 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fede40a3240 0x7fede40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:21.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.270+0000 7fedfaffd640 1 --2- 172.21.15.19:0/1107853416 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fede40a3240 0x7fede40a5700 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fedfc0fded0 tx=0x7fedf0009590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:21.271 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:58:21.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.275+0000 7fedf8ff9640 1 -- 172.21.15.19:0/1107853416 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fedec09cb90 con 0x7fedfc102d30 2024-09-19T08:58:21.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.545+0000 7fee02113640 1 -- 172.21.15.19:0/1107853416 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fedfc10c2c0 con 0x7fedfc102d30 2024-09-19T08:58:21.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.546+0000 7fedf8ff9640 1 -- 172.21.15.19:0/1107853416 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11983 (secure 0 0 0) 0x7fedec09c490 con 0x7fedfc102d30 2024-09-19T08:58:21.554 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:58:21.554 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":34,"btime":"2024-09-19T08:58:01:585647+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/2452068876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2452068876},{"type":"v1","addr":"172.21.15.19:6839","nonce":2452068876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T08:58:01.386094+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/2480841559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":2480841559},{"type":"v1","addr":"172.21.15.155:6835","nonce":2480841559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24463,24464,24490,24469,24497]},"id":1}]} 2024-09-19T08:58:21.555 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 34 2024-09-19T08:58:21.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.548+0000 7fee02113640 1 -- 172.21.15.19:0/1107853416 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fede40a3240 msgr2=0x7fede40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:21.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.548+0000 7fee02113640 1 --2- 172.21.15.19:0/1107853416 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fede40a3240 0x7fede40a5700 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fedfc0fded0 tx=0x7fedf0009590 comp rx=0 tx=0).stop 2024-09-19T08:58:21.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.548+0000 7fee02113640 1 -- 172.21.15.19:0/1107853416 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedfc102d30 msgr2=0x7fedfc19a740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:21.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.548+0000 7fee02113640 1 --2- 172.21.15.19:0/1107853416 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedfc102d30 0x7fedfc19a740 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fedec00e9f0 tx=0x7fedec00edf0 comp rx=0 tx=0).stop 2024-09-19T08:58:21.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.548+0000 7fee02113640 1 -- 172.21.15.19:0/1107853416 shutdown_connections 2024-09-19T08:58:21.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.548+0000 7fee02113640 1 --2- 172.21.15.19:0/1107853416 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fede40a3240 0x7fede40a5700 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:21.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.548+0000 7fee02113640 1 --2- 172.21.15.19:0/1107853416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fedfc1082a0 0x7fedfc19f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:21.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.548+0000 7fee02113640 1 --2- 172.21.15.19:0/1107853416 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fedfc1036e0 0x7fedfc19ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:21.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.548+0000 7fee02113640 1 --2- 172.21.15.19:0/1107853416 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fedfc102d30 0x7fedfc19a740 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:21.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.548+0000 7fee02113640 1 -- 172.21.15.19:0/1107853416 >> 172.21.15.19:0/1107853416 conn(0x7fedfc0fc7d0 msgr2=0x7fedfc1013a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:21.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.548+0000 7fee02113640 1 -- 172.21.15.19:0/1107853416 shutdown_connections 2024-09-19T08:58:21.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.548+0000 7fee02113640 1 -- 172.21.15.19:0/1107853416 wait complete. 2024-09-19T08:58:21.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:21 smithi019 ceph-mon[30976]: pgmap v521: 97 pgs: 97 active+clean; 2.6 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 105 KiB/s wr, 395 op/s 2024-09-19T08:58:21.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:21 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1107853416' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:58:21.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:21 smithi155 ceph-mon[34921]: pgmap v521: 97 pgs: 97 active+clean; 2.6 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 105 KiB/s wr, 395 op/s 2024-09-19T08:58:21.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:21 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1107853416' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:58:21.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:21 smithi203 ceph-mon[35450]: pgmap v521: 97 pgs: 97 active+clean; 2.6 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 105 KiB/s wr, 395 op/s 2024-09-19T08:58:21.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:21 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1107853416' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:58:22.573 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db --set-id c98ecb3a --release --await' 2024-09-19T08:58:22.573 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db --set-id c98ecb3a --release --await 2024-09-19T08:58:22.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.988+0000 7fe25b62f640 1 -- 172.21.15.19:0/2217252583 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe254102790 msgr2=0x7fe2541067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:22.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.989+0000 7fe25b62f640 1 --2- 172.21.15.19:0/2217252583 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe254102790 0x7fe2541067e0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fe244009900 tx=0x7fe24402a410 comp rx=0 tx=0).stop 2024-09-19T08:58:22.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.989+0000 7fe25b62f640 1 -- 172.21.15.19:0/2217252583 shutdown_connections 2024-09-19T08:58:22.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.989+0000 7fe25b62f640 1 --2- 172.21.15.19:0/2217252583 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe254106f10 0x7fe25410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.989+0000 7fe25b62f640 1 --2- 172.21.15.19:0/2217252583 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe254102790 0x7fe2541067e0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.989+0000 7fe25b62f640 1 --2- 172.21.15.19:0/2217252583 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe254101de0 0x7fe2541021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.989+0000 7fe25b62f640 1 -- 172.21.15.19:0/2217252583 >> 172.21.15.19:0/2217252583 conn(0x7fe2540fd8c0 msgr2=0x7fe2540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:22.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.989+0000 7fe25b62f640 1 -- 172.21.15.19:0/2217252583 shutdown_connections 2024-09-19T08:58:22.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.989+0000 7fe25b62f640 1 -- 172.21.15.19:0/2217252583 wait complete. 2024-09-19T08:58:22.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.989+0000 7fe25b62f640 1 Processor -- start 2024-09-19T08:58:22.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.990+0000 7fe25b62f640 1 -- start start 2024-09-19T08:58:22.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.990+0000 7fe25b62f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe254101de0 0x7fe254198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:22.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.990+0000 7fe25b62f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe254102790 0x7fe254198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:22.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.990+0000 7fe25b62f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe254106f10 0x7fe25419cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:22.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.990+0000 7fe25b62f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe254111f70 con 0x7fe254101de0 2024-09-19T08:58:22.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.990+0000 7fe25b62f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe254111df0 con 0x7fe254106f10 2024-09-19T08:58:22.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.990+0000 7fe25b62f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe2541120f0 con 0x7fe254102790 2024-09-19T08:58:22.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.990+0000 7fe2593cb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe254101de0 0x7fe254198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:22.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.990+0000 7fe2593cb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe254101de0 0x7fe254198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55094/0 (socket says 172.21.15.19:55094) 2024-09-19T08:58:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.990+0000 7fe2593cb640 1 -- 172.21.15.19:0/2359373052 learned_addr learned my addr 172.21.15.19:0/2359373052 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.990+0000 7fe258bca640 1 --2- 172.21.15.19:0/2359373052 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe254102790 0x7fe254198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.990+0000 7fe259bcc640 1 --2- 172.21.15.19:0/2359373052 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe254106f10 0x7fe25419cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.990+0000 7fe2593cb640 1 -- 172.21.15.19:0/2359373052 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe254102790 msgr2=0x7fe254198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.990+0000 7fe2593cb640 1 --2- 172.21.15.19:0/2359373052 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe254102790 0x7fe254198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.990+0000 7fe2593cb640 1 -- 172.21.15.19:0/2359373052 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe254106f10 msgr2=0x7fe25419cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.990+0000 7fe2593cb640 1 --2- 172.21.15.19:0/2359373052 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe254106f10 0x7fe25419cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.990+0000 7fe2593cb640 1 -- 172.21.15.19:0/2359373052 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe25419d400 con 0x7fe254101de0 2024-09-19T08:58:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.990+0000 7fe258bca640 1 --2- 172.21.15.19:0/2359373052 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe254102790 0x7fe254198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:58:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.990+0000 7fe259bcc640 1 --2- 172.21.15.19:0/2359373052 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe254106f10 0x7fe25419cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:58:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.991+0000 7fe2593cb640 1 --2- 172.21.15.19:0/2359373052 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe254101de0 0x7fe254198450 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fe25000ebc0 tx=0x7fe25000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.991+0000 7fe24a7fc640 1 -- 172.21.15.19:0/2359373052 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe250010630 con 0x7fe254101de0 2024-09-19T08:58:22.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.991+0000 7fe24a7fc640 1 -- 172.21.15.19:0/2359373052 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe250010cb0 con 0x7fe254101de0 2024-09-19T08:58:22.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.991+0000 7fe24a7fc640 1 -- 172.21.15.19:0/2359373052 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe250018bd0 con 0x7fe254101de0 2024-09-19T08:58:22.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.991+0000 7fe25b62f640 1 -- 172.21.15.19:0/2359373052 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe25419d6f0 con 0x7fe254101de0 2024-09-19T08:58:22.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.991+0000 7fe25b62f640 1 -- 172.21.15.19:0/2359373052 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2541a4fd0 con 0x7fe254101de0 2024-09-19T08:58:22.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.994+0000 7fe24a7fc640 1 -- 172.21.15.19:0/2359373052 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fe2500107d0 con 0x7fe254101de0 2024-09-19T08:58:22.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.995+0000 7fe25da08740 1 Processor -- start 2024-09-19T08:58:22.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.995+0000 7fe25da08740 1 -- start start 2024-09-19T08:58:22.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.995+0000 7fe25da08740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cbe7fe54a0 0x55cbe7fe5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:22.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.995+0000 7fe25da08740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbe7fe5dc0 0x55cbe7ff0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:22.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.995+0000 7fe25da08740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cbe7ff0680 0x55cbe7ff2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:22.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.995+0000 7fe25da08740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55cbe7f4b2e0 con 0x55cbe7fe54a0 2024-09-19T08:58:22.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.995+0000 7fe25da08740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55cbe7ef2ce0 con 0x55cbe7ff0680 2024-09-19T08:58:22.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.995+0000 7fe25da08740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55cbe7f472a0 con 0x55cbe7fe5dc0 2024-09-19T08:58:22.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.995+0000 7fe24a7fc640 1 --2- 172.21.15.19:0/2359373052 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe2400a3240 0x7fe2400a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:22.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.996+0000 7fe259bcc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cbe7fe54a0 0x55cbe7fe5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:22.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.996+0000 7fe258bca640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cbe7ff0680 0x55cbe7ff2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:22.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.996+0000 7fe259bcc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cbe7fe54a0 0x55cbe7fe5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55110/0 (socket says 172.21.15.19:55110) 2024-09-19T08:58:22.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.996+0000 7fe259bcc640 1 -- 172.21.15.19:0/156309246 learned_addr learned my addr 172.21.15.19:0/156309246 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:22.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.996+0000 7fe2593cb640 1 --2- 172.21.15.19:0/156309246 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbe7fe5dc0 0x55cbe7ff0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:22.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.996+0000 7fe24a7fc640 1 -- 172.21.15.19:0/2359373052 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fe2500cff20 con 0x7fe254101de0 2024-09-19T08:58:22.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.996+0000 7fe259bcc640 1 --2- 172.21.15.19:0/2359373052 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe2400a3240 0x7fe2400a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:22.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.996+0000 7fe258bca640 1 -- 172.21.15.19:0/156309246 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbe7fe5dc0 msgr2=0x55cbe7ff0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:22.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.996+0000 7fe258bca640 1 --2- 172.21.15.19:0/156309246 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbe7fe5dc0 0x55cbe7ff0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.996+0000 7fe258bca640 1 -- 172.21.15.19:0/156309246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cbe7fe54a0 msgr2=0x55cbe7fe5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:22.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.996+0000 7fe258bca640 1 --2- 172.21.15.19:0/156309246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cbe7fe54a0 0x55cbe7fe5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.996+0000 7fe258bca640 1 -- 172.21.15.19:0/156309246 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbe7ed7440 con 0x55cbe7ff0680 2024-09-19T08:58:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.996+0000 7fe2593cb640 1 --2- 172.21.15.19:0/156309246 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbe7fe5dc0 0x55cbe7ff0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:58:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.996+0000 7fe259bcc640 1 --2- 172.21.15.19:0/156309246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cbe7fe54a0 0x55cbe7fe5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:58:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.997+0000 7fe259bcc640 1 --2- 172.21.15.19:0/2359373052 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe2400a3240 0x7fe2400a5700 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe24c009fd0 tx=0x7fe24c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.997+0000 7fe258bca640 1 --2- 172.21.15.19:0/156309246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cbe7ff0680 0x55cbe7ff2a70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe244005940 tx=0x7fe244005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5ae4ce835c102da server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.997+0000 7fe23f7fe640 1 -- 172.21.15.19:0/156309246 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe244035040 con 0x55cbe7ff0680 2024-09-19T08:58:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.997+0000 7fe23f7fe640 1 -- 172.21.15.19:0/156309246 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe244031830 con 0x55cbe7ff0680 2024-09-19T08:58:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.997+0000 7fe23f7fe640 1 -- 172.21.15.19:0/156309246 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe244004750 con 0x55cbe7ff0680 2024-09-19T08:58:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.998+0000 7fe25da08740 1 -- 172.21.15.19:0/156309246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cbe7ff0680 msgr2=0x55cbe7ff2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.998+0000 7fe25da08740 1 --2- 172.21.15.19:0/156309246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cbe7ff0680 0x55cbe7ff2a70 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe244005940 tx=0x7fe244005d50 comp rx=0 tx=0).stop 2024-09-19T08:58:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.998+0000 7fe25da08740 1 -- 172.21.15.19:0/156309246 shutdown_connections 2024-09-19T08:58:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.998+0000 7fe25da08740 1 --2- 172.21.15.19:0/156309246 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbe7fe5dc0 0x55cbe7ff0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.998+0000 7fe25da08740 1 --2- 172.21.15.19:0/156309246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cbe7ff0680 0x55cbe7ff2a70 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.998+0000 7fe25da08740 1 --2- 172.21.15.19:0/156309246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cbe7fe54a0 0x55cbe7fe5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.998+0000 7fe25da08740 1 -- 172.21.15.19:0/156309246 >> 172.21.15.19:0/156309246 conn(0x55cbe7fe1a30 msgr2=0x55cbe7fe1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:22.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.998+0000 7fe25da08740 1 -- 172.21.15.19:0/156309246 shutdown_connections 2024-09-19T08:58:22.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.998+0000 7fe25da08740 1 -- 172.21.15.19:0/156309246 wait complete. 2024-09-19T08:58:22.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.998+0000 7fe25da08740 1 -- start start 2024-09-19T08:58:22.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.999+0000 7fe25da08740 1 Processor -- start 2024-09-19T08:58:22.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.999+0000 7fe25da08740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cbe7fe54a0 0x55cbe7feff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:22.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.999+0000 7fe25da08740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbe7fe5dc0 0x55cbe7fed1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:22.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.999+0000 7fe25da08740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cbe7ff0680 0x55cbe7fed720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:22.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.999+0000 7fe25da08740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55cbe7ff3250 con 0x55cbe7fe54a0 2024-09-19T08:58:22.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.999+0000 7fe25da08740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55cbe7f06050 con 0x55cbe7ff0680 2024-09-19T08:58:22.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.999+0000 7fe25da08740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55cbe7ff33d0 con 0x55cbe7fe5dc0 2024-09-19T08:58:22.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.999+0000 7fe25da08740 10 client.0 _ll_register_callbacks cb 0x55cbe7f46160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:22.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.999+0000 7fe2593cb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cbe7fe54a0 0x55cbe7feff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:22.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.999+0000 7fe2593cb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cbe7fe54a0 0x55cbe7feff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55124/0 (socket says 172.21.15.19:55124) 2024-09-19T08:58:22.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.999+0000 7fe2593cb640 1 -- 172.21.15.19:0/1448868715 learned_addr learned my addr 172.21.15.19:0/1448868715 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:22.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.999+0000 7fe258bca640 1 --2- 172.21.15.19:0/1448868715 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbe7fe5dc0 0x55cbe7fed1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:22.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:21.999+0000 7fe259bcc640 1 --2- 172.21.15.19:0/1448868715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cbe7ff0680 0x55cbe7fed720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:22.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.000+0000 7fe2593cb640 1 -- 172.21.15.19:0/1448868715 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbe7fe5dc0 msgr2=0x55cbe7fed1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:22.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.000+0000 7fe2593cb640 1 --2- 172.21.15.19:0/1448868715 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbe7fe5dc0 0x55cbe7fed1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.000+0000 7fe2593cb640 1 -- 172.21.15.19:0/1448868715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cbe7ff0680 msgr2=0x55cbe7fed720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:22.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.000+0000 7fe2593cb640 1 --2- 172.21.15.19:0/1448868715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cbe7ff0680 0x55cbe7fed720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.000+0000 7fe2593cb640 1 -- 172.21.15.19:0/1448868715 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbe7cbc3c0 con 0x55cbe7fe54a0 2024-09-19T08:58:22.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.000+0000 7fe2593cb640 1 --2- 172.21.15.19:0/1448868715 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cbe7fe54a0 0x55cbe7feff30 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fe250098a60 tx=0x7fe25001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=167aa2c9c0c0c51a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:22.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.000+0000 7fe23cff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:58:22.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.000+0000 7fe23cff9640 1 -- 172.21.15.19:0/1448868715 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe250098040 con 0x55cbe7fe54a0 2024-09-19T08:58:22.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.000+0000 7fe23cff9640 1 -- 172.21.15.19:0/1448868715 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fe25001dcb0 con 0x55cbe7fe54a0 2024-09-19T08:58:22.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.000+0000 7fe25da08740 1 -- 172.21.15.19:0/1448868715 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe244031830 con 0x55cbe7fe54a0 2024-09-19T08:58:22.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.000+0000 7fe23cff9640 1 -- 172.21.15.19:0/1448868715 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe250010e60 con 0x55cbe7fe54a0 2024-09-19T08:58:22.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.000+0000 7fe25da08740 10 client.16869 fetch_fsmap learned FSMap version 34 2024-09-19T08:58:22.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.000+0000 7fe25da08740 1 -- 172.21.15.19:0/1448868715 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55cbe7ffeae0 con 0x55cbe7fe54a0 2024-09-19T08:58:22.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.000+0000 7fe23cff9640 1 -- 172.21.15.19:0/1448868715 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe25009c600 con 0x55cbe7fe54a0 2024-09-19T08:58:22.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.001+0000 7fe23cff9640 1 -- 172.21.15.19:0/1448868715 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7fe250013bd0 con 0x55cbe7fe54a0 2024-09-19T08:58:22.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.001+0000 7fe25da08740 10 client.16869 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T08:58:22.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.001+0000 7fe25da08740 10 client.16869 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:58:22.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.001+0000 7fe25da08740 20 client.16869 populate_metadata read hostname 'smithi019' 2024-09-19T08:58:22.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.001+0000 7fe25da08740 1 --2- 172.21.15.19:0/1448868715 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55cbe7ffffa0 0x55cbe8002390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:22.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.001+0000 7fe25da08740 4 client.16869 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:58:22.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.001+0000 7fe25da08740 1 -- 172.21.15.19:0/1448868715 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fe244031830 con 0x55cbe7ffffa0 2024-09-19T08:58:22.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.001+0000 7fe258bca640 1 --2- 172.21.15.19:0/1448868715 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55cbe7ffffa0 0x55cbe8002390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:22.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.002+0000 7fe258bca640 1 --2- 172.21.15.19:0/1448868715 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55cbe7ffffa0 0x55cbe8002390 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=690e0ed98fab4b60 server_cookie=8fde6792e54c889c in_seq=0 out_seq=0 2024-09-19T08:58:22.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.002+0000 7fe23cff9640 10 client.16869 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:22.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.002+0000 7fe23cff9640 1 -- 172.21.15.19:0/1448868715 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fe244031830 con 0x55cbe7ffffa0 2024-09-19T08:58:22.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.002+0000 7fe23cff9640 10 client.16869 handle_command_reply: tid=0 2024-09-19T08:58:22.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.003+0000 7fe25da08740 1 client.16869 shutdown 2024-09-19T08:58:22.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.003+0000 7fe25da08740 1 -- 172.21.15.19:0/1448868715 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cbe7fe54a0 msgr2=0x55cbe7feff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:22.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.003+0000 7fe25da08740 1 --2- 172.21.15.19:0/1448868715 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cbe7fe54a0 0x55cbe7feff30 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fe250098a60 tx=0x7fe25001f000 comp rx=0 tx=0).stop 2024-09-19T08:58:22.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.003+0000 7fe25da08740 1 -- 172.21.15.19:0/1448868715 shutdown_connections 2024-09-19T08:58:22.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.003+0000 7fe25da08740 1 --2- 172.21.15.19:0/1448868715 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55cbe7ffffa0 0x55cbe8002390 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.003+0000 7fe25da08740 1 --2- 172.21.15.19:0/1448868715 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbe7fe5dc0 0x55cbe7fed1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.003+0000 7fe25da08740 1 --2- 172.21.15.19:0/1448868715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cbe7ff0680 0x55cbe7fed720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.003+0000 7fe25da08740 1 --2- 172.21.15.19:0/1448868715 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cbe7fe54a0 0x55cbe7feff30 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.003+0000 7fe23cff9640 0 client.16869 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:22.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.003+0000 7fe25da08740 1 -- 172.21.15.19:0/1448868715 >> 172.21.15.19:0/1448868715 conn(0x55cbe7fe1a30 msgr2=0x55cbe7fe7760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:22.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.003+0000 7fe25da08740 1 -- 172.21.15.19:0/1448868715 shutdown_connections 2024-09-19T08:58:22.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.003+0000 7fe25da08740 1 -- 172.21.15.19:0/1448868715 wait complete. 2024-09-19T08:58:22.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.003+0000 7fe25da08740 20 client.16869 trim_cache size 0 max 16384 2024-09-19T08:58:22.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.024+0000 7fe25da08740 1 Processor -- start 2024-09-19T08:58:22.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.024+0000 7fe25da08740 1 -- start start 2024-09-19T08:58:22.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.024+0000 7fe25da08740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cbe7fe1a30 0x55cbe7fe0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:22.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.024+0000 7fe25da08740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cbe7fe54a0 0x55cbe8007c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:22.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.024+0000 7fe25da08740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbe7fe5dc0 0x55cbe8008140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:22.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.024+0000 7fe25da08740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe2541ab360 con 0x55cbe7fe54a0 2024-09-19T08:58:22.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.024+0000 7fe25da08740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe2541acea0 con 0x55cbe7fe1a30 2024-09-19T08:58:22.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.024+0000 7fe25da08740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe2541aba30 con 0x55cbe7fe5dc0 2024-09-19T08:58:22.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.024+0000 7fe258bca640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cbe7fe54a0 0x55cbe8007c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:22.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.024+0000 7fe259bcc640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbe7fe5dc0 0x55cbe8008140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:22.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.024+0000 7fe2593cb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cbe7fe1a30 0x55cbe7fe0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:22.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.024+0000 7fe258bca640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cbe7fe54a0 0x55cbe8007c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55138/0 (socket says 172.21.15.19:55138) 2024-09-19T08:58:22.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.024+0000 7fe258bca640 1 -- 172.21.15.19:0/4041132458 learned_addr learned my addr 172.21.15.19:0/4041132458 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:22.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.025+0000 7fe258bca640 1 -- 172.21.15.19:0/4041132458 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbe7fe5dc0 msgr2=0x55cbe8008140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:22.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.025+0000 7fe258bca640 1 --2- 172.21.15.19:0/4041132458 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbe7fe5dc0 0x55cbe8008140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.025+0000 7fe258bca640 1 -- 172.21.15.19:0/4041132458 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cbe7fe1a30 msgr2=0x55cbe7fe0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:22.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.025+0000 7fe258bca640 1 --2- 172.21.15.19:0/4041132458 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cbe7fe1a30 0x55cbe7fe0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.025+0000 7fe258bca640 1 -- 172.21.15.19:0/4041132458 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbe8002700 con 0x55cbe7fe54a0 2024-09-19T08:58:22.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.025+0000 7fe258bca640 1 --2- 172.21.15.19:0/4041132458 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cbe7fe54a0 0x55cbe8007c00 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x55cbe7fe2db0 tx=0x7fe2440058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bcba7549f80f6dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:22.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.025+0000 7fe23effd640 1 -- 172.21.15.19:0/4041132458 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe244035050 con 0x55cbe7fe54a0 2024-09-19T08:58:22.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.025+0000 7fe23effd640 1 -- 172.21.15.19:0/4041132458 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe244031b40 con 0x55cbe7fe54a0 2024-09-19T08:58:22.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.025+0000 7fe23effd640 1 -- 172.21.15.19:0/4041132458 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe244004750 con 0x55cbe7fe54a0 2024-09-19T08:58:22.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.026+0000 7fe25da08740 1 -- 172.21.15.19:0/4041132458 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cbe7fe54a0 msgr2=0x55cbe8007c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:22.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.026+0000 7fe25da08740 1 --2- 172.21.15.19:0/4041132458 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cbe7fe54a0 0x55cbe8007c00 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x55cbe7fe2db0 tx=0x7fe2440058d0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.026+0000 7fe25da08740 1 -- 172.21.15.19:0/4041132458 shutdown_connections 2024-09-19T08:58:22.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.026+0000 7fe25da08740 1 --2- 172.21.15.19:0/4041132458 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbe7fe5dc0 0x55cbe8008140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.026+0000 7fe25da08740 1 --2- 172.21.15.19:0/4041132458 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cbe7fe54a0 0x55cbe8007c00 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.026+0000 7fe25da08740 1 --2- 172.21.15.19:0/4041132458 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cbe7fe1a30 0x55cbe7fe0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.026+0000 7fe25da08740 1 -- 172.21.15.19:0/4041132458 >> 172.21.15.19:0/4041132458 conn(0x55cbe7fed880 msgr2=0x55cbe7fe0350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:22.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.026+0000 7fe25da08740 1 -- 172.21.15.19:0/4041132458 shutdown_connections 2024-09-19T08:58:22.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.026+0000 7fe25da08740 1 -- 172.21.15.19:0/4041132458 wait complete. 2024-09-19T08:58:22.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.026+0000 7fe25da08740 1 -- start start 2024-09-19T08:58:22.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.026+0000 7fe25da08740 1 Processor -- start 2024-09-19T08:58:22.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.027+0000 7fe25da08740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cbe7fe1a30 0x55cbe7ff8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:22.731 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:58:22.731 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "scrub active (6925 inodes in the stack)", 2024-09-19T08:58:22.731 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-19T08:58:22.731 INFO:teuthology.orchestra.run.smithi019.stdout: "1f6e77ba-cc14-4c6e-9760-9962baf34f02": { 2024-09-19T08:58:22.731 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-19T08:58:22.731 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "1f6e77ba-cc14-4c6e-9760-9962baf34f02", 2024-09-19T08:58:22.731 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-19T08:58:22.732 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:58:22.732 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:58:22.732 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:58:22.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.027+0000 7fe25da08740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cbe7fe54a0 0x55cbe7ff61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:22.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.027+0000 7fe25da08740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbe7fe5dc0 0x55cbe7ff6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:22.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.027+0000 7fe25da08740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe2541ac7d0 con 0x55cbe7fe1a30 2024-09-19T08:58:22.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.027+0000 7fe25da08740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe2541ac100 con 0x55cbe7fe54a0 2024-09-19T08:58:22.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.027+0000 7fe25da08740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe2541a9340 con 0x55cbe7fe5dc0 2024-09-19T08:58:22.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.027+0000 7fe25da08740 10 client.0 _ll_register_callbacks cb 0x7fe2500988a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:22.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.027+0000 7fe259bcc640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbe7fe5dc0 0x55cbe7ff6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:22.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.027+0000 7fe259bcc640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbe7fe5dc0 0x55cbe7ff6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:42634/0 (socket says 172.21.15.19:42634) 2024-09-19T08:58:22.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.027+0000 7fe259bcc640 1 -- 172.21.15.19:0/3875927429 learned_addr learned my addr 172.21.15.19:0/3875927429 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:22.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.027+0000 7fe258bca640 1 --2- 172.21.15.19:0/3875927429 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cbe7fe54a0 0x55cbe7ff61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:22.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.027+0000 7fe2593cb640 1 --2- 172.21.15.19:0/3875927429 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cbe7fe1a30 0x55cbe7ff8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:22.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.027+0000 7fe259bcc640 1 -- 172.21.15.19:0/3875927429 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cbe7fe54a0 msgr2=0x55cbe7ff61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:22.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.027+0000 7fe259bcc640 1 --2- 172.21.15.19:0/3875927429 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cbe7fe54a0 0x55cbe7ff61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.027+0000 7fe259bcc640 1 -- 172.21.15.19:0/3875927429 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cbe7fe1a30 msgr2=0x55cbe7ff8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:22.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.027+0000 7fe259bcc640 1 --2- 172.21.15.19:0/3875927429 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cbe7fe1a30 0x55cbe7ff8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.027+0000 7fe259bcc640 1 -- 172.21.15.19:0/3875927429 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbe7ff7030 con 0x55cbe7fe5dc0 2024-09-19T08:58:22.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.028+0000 7fe2593cb640 1 --2- 172.21.15.19:0/3875927429 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cbe7fe1a30 0x55cbe7ff8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:58:22.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.028+0000 7fe259bcc640 1 --2- 172.21.15.19:0/3875927429 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbe7fe5dc0 0x55cbe7ff6800 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe24c005850 tx=0x7fe24c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c8adb166e4088fe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:22.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.028+0000 7fe23cff9640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T08:58:22.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.028+0000 7fe23cff9640 1 -- 172.21.15.19:0/3875927429 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24c03a060 con 0x55cbe7fe5dc0 2024-09-19T08:58:22.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.028+0000 7fe23cff9640 1 -- 172.21.15.19:0/3875927429 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fe24c00f750 con 0x55cbe7fe5dc0 2024-09-19T08:58:22.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.028+0000 7fe25da08740 1 -- 172.21.15.19:0/3875927429 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe244031b40 con 0x55cbe7fe5dc0 2024-09-19T08:58:22.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.028+0000 7fe23cff9640 1 -- 172.21.15.19:0/3875927429 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe24c024040 con 0x55cbe7fe5dc0 2024-09-19T08:58:22.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.028+0000 7fe25da08740 10 client.26278 fetch_fsmap learned FSMap version 34 2024-09-19T08:58:22.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.028+0000 7fe25da08740 1 -- 172.21.15.19:0/3875927429 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55cbe806ad20 con 0x55cbe7fe5dc0 2024-09-19T08:58:22.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.028+0000 7fe23cff9640 1 -- 172.21.15.19:0/3875927429 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe244031b40 con 0x55cbe7fe5dc0 2024-09-19T08:58:22.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.029+0000 7fe23cff9640 1 -- 172.21.15.19:0/3875927429 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7fe24c010880 con 0x55cbe7fe5dc0 2024-09-19T08:58:22.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.029+0000 7fe25da08740 10 client.26278 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T08:58:22.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.029+0000 7fe25da08740 10 client.26278 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:58:22.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.029+0000 7fe25da08740 20 client.26278 populate_metadata read hostname 'smithi019' 2024-09-19T08:58:22.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.029+0000 7fe25da08740 1 --2- 172.21.15.19:0/3875927429 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55cbe7ff0680 0x55cbe806d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:22.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.029+0000 7fe25da08740 4 client.26278 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:58:22.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.029+0000 7fe25da08740 1 -- 172.21.15.19:0/3875927429 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cbe7f58850 con 0x55cbe7ff0680 2024-09-19T08:58:22.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.029+0000 7fe2593cb640 1 --2- 172.21.15.19:0/3875927429 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55cbe7ff0680 0x55cbe806d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:22.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.030+0000 7fe23cff9640 10 client.26278 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:22.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.030+0000 7fe2593cb640 1 --2- 172.21.15.19:0/3875927429 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55cbe7ff0680 0x55cbe806d4e0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a1aa6f86f2732d3 server_cookie=ca69ac7c95d2f19a in_seq=0 out_seq=0 2024-09-19T08:58:22.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.030+0000 7fe23cff9640 1 -- 172.21.15.19:0/3875927429 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+268 (crc 0 0 0) 0x55cbe7f58850 con 0x55cbe7ff0680 2024-09-19T08:58:22.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.030+0000 7fe23cff9640 10 client.26278 handle_command_reply: tid=0 2024-09-19T08:58:22.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.030+0000 7fe25da08740 1 client.26278 shutdown 2024-09-19T08:58:22.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.030+0000 7fe25da08740 1 -- 172.21.15.19:0/3875927429 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbe7fe5dc0 msgr2=0x55cbe7ff6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:22.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.030+0000 7fe25da08740 1 --2- 172.21.15.19:0/3875927429 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbe7fe5dc0 0x55cbe7ff6800 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe24c005850 tx=0x7fe24c0046c0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.030+0000 7fe25da08740 1 -- 172.21.15.19:0/3875927429 shutdown_connections 2024-09-19T08:58:22.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.030+0000 7fe25da08740 1 --2- 172.21.15.19:0/3875927429 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55cbe7ff0680 0x55cbe806d4e0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.030+0000 7fe25da08740 1 --2- 172.21.15.19:0/3875927429 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbe7fe5dc0 0x55cbe7ff6800 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.030+0000 7fe25da08740 1 --2- 172.21.15.19:0/3875927429 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cbe7fe54a0 0x55cbe7ff61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.030+0000 7fe23cff9640 0 client.26278 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:22.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.030+0000 7fe25da08740 1 --2- 172.21.15.19:0/3875927429 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cbe7fe1a30 0x55cbe7ff8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.030+0000 7fe25da08740 1 -- 172.21.15.19:0/3875927429 >> 172.21.15.19:0/3875927429 conn(0x55cbe7fed880 msgr2=0x55cbe7fe0350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:22.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.030+0000 7fe25da08740 1 -- 172.21.15.19:0/3875927429 shutdown_connections 2024-09-19T08:58:22.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.030+0000 7fe25da08740 1 -- 172.21.15.19:0/3875927429 wait complete. 2024-09-19T08:58:22.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.030+0000 7fe25da08740 20 client.26278 trim_cache size 0 max 16384 2024-09-19T08:58:22.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.031+0000 7fe25b62f640 1 -- 172.21.15.19:0/2359373052 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe2400a3240 msgr2=0x7fe2400a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:22.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.031+0000 7fe25b62f640 1 --2- 172.21.15.19:0/2359373052 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe2400a3240 0x7fe2400a5700 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe24c009fd0 tx=0x7fe24c005f90 comp rx=0 tx=0).stop 2024-09-19T08:58:22.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.031+0000 7fe25b62f640 1 -- 172.21.15.19:0/2359373052 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe254101de0 msgr2=0x7fe254198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:22.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.031+0000 7fe25b62f640 1 --2- 172.21.15.19:0/2359373052 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe254101de0 0x7fe254198450 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fe25000ebc0 tx=0x7fe25000c6a0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.031+0000 7fe25b62f640 1 -- 172.21.15.19:0/2359373052 shutdown_connections 2024-09-19T08:58:22.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.031+0000 7fe25b62f640 1 --2- 172.21.15.19:0/2359373052 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe2400a3240 0x7fe2400a5700 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.031+0000 7fe25b62f640 1 --2- 172.21.15.19:0/2359373052 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe254102790 0x7fe254198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.031+0000 7fe25b62f640 1 --2- 172.21.15.19:0/2359373052 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe254106f10 0x7fe25419cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.031+0000 7fe25b62f640 1 --2- 172.21.15.19:0/2359373052 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe254101de0 0x7fe254198450 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:22.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.031+0000 7fe25b62f640 1 -- 172.21.15.19:0/2359373052 >> 172.21.15.19:0/2359373052 conn(0x7fe2540fd8c0 msgr2=0x7fe2540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:22.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.031+0000 7fe25b62f640 1 -- 172.21.15.19:0/2359373052 shutdown_connections 2024-09-19T08:58:22.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:22.031+0000 7fe25b62f640 1 -- 172.21.15.19:0/2359373052 wait complete. 2024-09-19T08:58:23.373 INFO:tasks.cephfs.filesystem:scrub status for tag:1f6e77ba-cc14-4c6e-9760-9962baf34f02 - {'path': '/', 'tag': '1f6e77ba-cc14-4c6e-9760-9962baf34f02', 'options': 'recursive,force'} 2024-09-19T08:58:23.414 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:58:23.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:23 smithi155 ceph-mon[34921]: pgmap v522: 97 pgs: 97 active+clean; 2.6 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 78 KiB/s wr, 1.20k op/s 2024-09-19T08:58:23.927 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:23 smithi019 ceph-mon[30976]: pgmap v522: 97 pgs: 97 active+clean; 2.6 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 78 KiB/s wr, 1.20k op/s 2024-09-19T08:58:23.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.928+0000 7fa6127f0640 1 -- 172.21.15.19:0/1757261442 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa60c100460 msgr2=0x7fa60c100840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:23.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.928+0000 7fa6127f0640 1 --2- 172.21.15.19:0/1757261442 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa60c100460 0x7fa60c100840 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc009900 tx=0x7fa5fc02a410 comp rx=0 tx=0).stop 2024-09-19T08:58:23.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.928+0000 7fa6127f0640 1 -- 172.21.15.19:0/1757261442 shutdown_connections 2024-09-19T08:58:23.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.928+0000 7fa6127f0640 1 --2- 172.21.15.19:0/1757261442 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa60c100e10 0x7fa60c104e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:23.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.928+0000 7fa6127f0640 1 --2- 172.21.15.19:0/1757261442 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa60c105590 0x7fa60c10d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:23.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.928+0000 7fa6127f0640 1 --2- 172.21.15.19:0/1757261442 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa60c100460 0x7fa60c100840 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:23.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.928+0000 7fa6127f0640 1 -- 172.21.15.19:0/1757261442 >> 172.21.15.19:0/1757261442 conn(0x7fa60c0fbee0 msgr2=0x7fa60c0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:23.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.928+0000 7fa6127f0640 1 -- 172.21.15.19:0/1757261442 shutdown_connections 2024-09-19T08:58:23.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.928+0000 7fa6127f0640 1 -- 172.21.15.19:0/1757261442 wait complete. 2024-09-19T08:58:23.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.928+0000 7fa6127f0640 1 Processor -- start 2024-09-19T08:58:23.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.928+0000 7fa6127f0640 1 -- start start 2024-09-19T08:58:23.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.929+0000 7fa6127f0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa60c100460 0x7fa60c101f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:23.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.929+0000 7fa6127f0640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa60c100e10 0x7fa60c102440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:23.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.929+0000 7fa6127f0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa60c105590 0x7fa60c102980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:23.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.929+0000 7fa6127f0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c10fd70 con 0x7fa60c105590 2024-09-19T08:58:23.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.929+0000 7fa6127f0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c10fbf0 con 0x7fa60c100460 2024-09-19T08:58:23.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.929+0000 7fa6127f0640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c10fef0 con 0x7fa60c100e10 2024-09-19T08:58:23.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.929+0000 7fa610d8d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa60c105590 0x7fa60c102980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:23.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.929+0000 7fa610d8d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa60c105590 0x7fa60c102980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55162/0 (socket says 172.21.15.19:55162) 2024-09-19T08:58:23.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.929+0000 7fa610d8d640 1 -- 172.21.15.19:0/3857960244 learned_addr learned my addr 172.21.15.19:0/3857960244 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:23.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.929+0000 7fa60bfff640 1 --2- 172.21.15.19:0/3857960244 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa60c100460 0x7fa60c101f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:23.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.929+0000 7fa60b7fe640 1 --2- 172.21.15.19:0/3857960244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa60c100e10 0x7fa60c102440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:23.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.929+0000 7fa610d8d640 1 -- 172.21.15.19:0/3857960244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa60c100e10 msgr2=0x7fa60c102440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:23.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.929+0000 7fa610d8d640 1 --2- 172.21.15.19:0/3857960244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa60c100e10 0x7fa60c102440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:23.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.929+0000 7fa610d8d640 1 -- 172.21.15.19:0/3857960244 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa60c100460 msgr2=0x7fa60c101f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:23.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.929+0000 7fa610d8d640 1 --2- 172.21.15.19:0/3857960244 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa60c100460 0x7fa60c101f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:23.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.929+0000 7fa610d8d640 1 -- 172.21.15.19:0/3857960244 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa60c1a6930 con 0x7fa60c105590 2024-09-19T08:58:23.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.929+0000 7fa610d8d640 1 --2- 172.21.15.19:0/3857960244 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa60c105590 0x7fa60c102980 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fa60400dd70 tx=0x7fa60400b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:23.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.930+0000 7fa6097fa640 1 -- 172.21.15.19:0/3857960244 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa604004d20 con 0x7fa60c105590 2024-09-19T08:58:23.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.930+0000 7fa6097fa640 1 -- 172.21.15.19:0/3857960244 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa60400be40 con 0x7fa60c105590 2024-09-19T08:58:23.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.930+0000 7fa6127f0640 1 -- 172.21.15.19:0/3857960244 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa60c1a6c20 con 0x7fa60c105590 2024-09-19T08:58:23.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.930+0000 7fa6097fa640 1 -- 172.21.15.19:0/3857960244 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa604005720 con 0x7fa60c105590 2024-09-19T08:58:23.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.930+0000 7fa6127f0640 1 -- 172.21.15.19:0/3857960244 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa60c1a7160 con 0x7fa60c105590 2024-09-19T08:58:23.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.933+0000 7fa6097fa640 1 -- 172.21.15.19:0/3857960244 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fa6040058c0 con 0x7fa60c105590 2024-09-19T08:58:23.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.933+0000 7fa614bc9740 1 Processor -- start 2024-09-19T08:58:23.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.933+0000 7fa614bc9740 1 -- start start 2024-09-19T08:58:23.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.933+0000 7fa614bc9740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1ef284060 0x55a1ef284440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:23.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.934+0000 7fa614bc9740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1ef284980 0x55a1ef28ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:23.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.934+0000 7fa614bc9740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1ef28f240 0x55a1ef291630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:23.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.934+0000 7fa614bc9740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a1ef1e9620 con 0x55a1ef284060 2024-09-19T08:58:23.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.934+0000 7fa614bc9740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55a1ef190e50 con 0x55a1ef284980 2024-09-19T08:58:23.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.934+0000 7fa614bc9740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a1ef1e55e0 con 0x55a1ef28f240 2024-09-19T08:58:23.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.934+0000 7fa60b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1ef284060 0x55a1ef284440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:23.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.934+0000 7fa60b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1ef284060 0x55a1ef284440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55166/0 (socket says 172.21.15.19:55166) 2024-09-19T08:58:23.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.934+0000 7fa60b7fe640 1 -- 172.21.15.19:0/3004611160 learned_addr learned my addr 172.21.15.19:0/3004611160 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:23.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.934+0000 7fa60bfff640 1 --2- 172.21.15.19:0/3004611160 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1ef284980 0x55a1ef28ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:23.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.934+0000 7fa60b7fe640 1 --2- 172.21.15.19:0/3004611160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1ef28f240 0x55a1ef291630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:23.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.934+0000 7fa6097fa640 1 --2- 172.21.15.19:0/3857960244 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa5f40a32c0 0x7fa5f40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:23.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.934+0000 7fa60b7fe640 1 -- 172.21.15.19:0/3004611160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1ef28f240 msgr2=0x55a1ef291630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:23.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.934+0000 7fa60b7fe640 1 --2- 172.21.15.19:0/3004611160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1ef28f240 0x55a1ef291630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:23.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.934+0000 7fa60b7fe640 1 -- 172.21.15.19:0/3004611160 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1ef284980 msgr2=0x55a1ef28ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:23.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.934+0000 7fa60b7fe640 1 --2- 172.21.15.19:0/3004611160 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1ef284980 0x55a1ef28ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:23.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.934+0000 7fa60b7fe640 1 -- 172.21.15.19:0/3004611160 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1ef181d40 con 0x55a1ef284060 2024-09-19T08:58:23.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.934+0000 7fa610d8d640 1 --2- 172.21.15.19:0/3857960244 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa5f40a32c0 0x7fa5f40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:23.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.934+0000 7fa6097fa640 1 -- 172.21.15.19:0/3857960244 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa6040cfe90 con 0x7fa60c105590 2024-09-19T08:58:23.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.934+0000 7fa60b7fe640 1 --2- 172.21.15.19:0/3004611160 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1ef284060 0x55a1ef284440 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fa6000058c0 tx=0x7fa60000b6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ecea309452c82c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:23.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.935+0000 7fa5f27fc640 1 -- 172.21.15.19:0/3004611160 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa600019030 con 0x55a1ef284060 2024-09-19T08:58:23.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.935+0000 7fa5f27fc640 1 -- 172.21.15.19:0/3004611160 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6000119a0 con 0x55a1ef284060 2024-09-19T08:58:23.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.935+0000 7fa5f27fc640 1 -- 172.21.15.19:0/3004611160 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60001d820 con 0x55a1ef284060 2024-09-19T08:58:23.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.935+0000 7fa614bc9740 1 -- 172.21.15.19:0/3004611160 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1ef284060 msgr2=0x55a1ef284440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:23.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.935+0000 7fa610d8d640 1 --2- 172.21.15.19:0/3857960244 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa5f40a32c0 0x7fa5f40a5780 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa6040a4c00 tx=0x7fa60406f340 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:23.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.935+0000 7fa614bc9740 1 --2- 172.21.15.19:0/3004611160 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1ef284060 0x55a1ef284440 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fa6000058c0 tx=0x7fa60000b6b0 comp rx=0 tx=0).stop 2024-09-19T08:58:23.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.935+0000 7fa614bc9740 1 -- 172.21.15.19:0/3004611160 shutdown_connections 2024-09-19T08:58:23.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.935+0000 7fa614bc9740 1 --2- 172.21.15.19:0/3004611160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1ef28f240 0x55a1ef291630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:23.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.935+0000 7fa614bc9740 1 --2- 172.21.15.19:0/3004611160 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1ef284980 0x55a1ef28ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:23.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.935+0000 7fa614bc9740 1 --2- 172.21.15.19:0/3004611160 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1ef284060 0x55a1ef284440 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:23.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.935+0000 7fa614bc9740 1 -- 172.21.15.19:0/3004611160 >> 172.21.15.19:0/3004611160 conn(0x55a1ef2805f0 msgr2=0x55a1ef2809d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:23.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.935+0000 7fa614bc9740 1 -- 172.21.15.19:0/3004611160 shutdown_connections 2024-09-19T08:58:23.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.935+0000 7fa614bc9740 1 -- 172.21.15.19:0/3004611160 wait complete. 2024-09-19T08:58:23.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.936+0000 7fa614bc9740 1 -- start start 2024-09-19T08:58:23.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.936+0000 7fa614bc9740 1 Processor -- start 2024-09-19T08:58:23.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.936+0000 7fa614bc9740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1ef284060 0x55a1ef28c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:23.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.936+0000 7fa614bc9740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1ef284980 0x55a1ef28c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:23.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.936+0000 7fa614bc9740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1ef28f240 0x55a1ef28cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:23.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.936+0000 7fa614bc9740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a1ef291e10 con 0x55a1ef28f240 2024-09-19T08:58:23.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.936+0000 7fa614bc9740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55a1ef171f10 con 0x55a1ef284060 2024-09-19T08:58:23.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.936+0000 7fa614bc9740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a1ef291f90 con 0x55a1ef284980 2024-09-19T08:58:23.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.936+0000 7fa614bc9740 10 client.0 _ll_register_callbacks cb 0x55a1ef195db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:23.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.936+0000 7fa60b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1ef28f240 0x55a1ef28cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:23.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.937+0000 7fa60b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1ef28f240 0x55a1ef28cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55182/0 (socket says 172.21.15.19:55182) 2024-09-19T08:58:23.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.937+0000 7fa60b7fe640 1 -- 172.21.15.19:0/3768464700 learned_addr learned my addr 172.21.15.19:0/3768464700 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:23.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.937+0000 7fa60b7fe640 1 --2- 172.21.15.19:0/3768464700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1ef284060 0x55a1ef28c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:23.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.937+0000 7fa60bfff640 1 --2- 172.21.15.19:0/3768464700 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1ef284980 0x55a1ef28c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:23.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.937+0000 7fa60b7fe640 1 -- 172.21.15.19:0/3768464700 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1ef284980 msgr2=0x55a1ef28c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:23.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.937+0000 7fa60b7fe640 1 --2- 172.21.15.19:0/3768464700 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1ef284980 0x55a1ef28c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:23.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.937+0000 7fa60b7fe640 1 -- 172.21.15.19:0/3768464700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1ef284060 msgr2=0x55a1ef28c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:23.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.937+0000 7fa60b7fe640 1 --2- 172.21.15.19:0/3768464700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1ef284060 0x55a1ef28c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:23.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.937+0000 7fa60b7fe640 1 -- 172.21.15.19:0/3768464700 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1eeef8580 con 0x55a1ef28f240 2024-09-19T08:58:23.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.937+0000 7fa60b7fe640 1 --2- 172.21.15.19:0/3768464700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1ef28f240 0x55a1ef28cb00 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fa60001d560 tx=0x7fa60001d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c78005feae165431 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:23.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.937+0000 7fa5eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:58:23.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.937+0000 7fa5eb7fe640 1 -- 172.21.15.19:0/3768464700 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa600019040 con 0x55a1ef28f240 2024-09-19T08:58:23.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.937+0000 7fa5eb7fe640 1 -- 172.21.15.19:0/3768464700 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa6000114c0 con 0x55a1ef28f240 2024-09-19T08:58:23.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.937+0000 7fa614bc9740 1 -- 172.21.15.19:0/3768464700 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6000119a0 con 0x55a1ef28f240 2024-09-19T08:58:23.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.937+0000 7fa5eb7fe640 1 -- 172.21.15.19:0/3768464700 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa6000116c0 con 0x55a1ef28f240 2024-09-19T08:58:23.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.937+0000 7fa614bc9740 10 client.16884 fetch_fsmap learned FSMap version 34 2024-09-19T08:58:23.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.938+0000 7fa614bc9740 1 -- 172.21.15.19:0/3768464700 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a1eefc2960 con 0x55a1ef28f240 2024-09-19T08:58:23.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.938+0000 7fa5eb7fe640 1 -- 172.21.15.19:0/3768464700 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6000119a0 con 0x55a1ef28f240 2024-09-19T08:58:23.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.938+0000 7fa5eb7fe640 1 -- 172.21.15.19:0/3768464700 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7fa600004980 con 0x55a1ef28f240 2024-09-19T08:58:23.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.938+0000 7fa614bc9740 10 client.16884 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T08:58:23.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.938+0000 7fa614bc9740 10 client.16884 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T08:58:23.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.938+0000 7fa614bc9740 20 client.16884 populate_metadata read hostname 'smithi019' 2024-09-19T08:58:23.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.938+0000 7fa614bc9740 1 --2- 172.21.15.19:0/3768464700 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a1ef29eca0 0x55a1ef2a1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:23.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.938+0000 7fa614bc9740 4 client.16884 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:58:23.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.938+0000 7fa614bc9740 1 -- 172.21.15.19:0/3768464700 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1ef1f6b90 con 0x55a1ef29eca0 2024-09-19T08:58:23.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.938+0000 7fa60bfff640 1 --2- 172.21.15.19:0/3768464700 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a1ef29eca0 0x55a1ef2a1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:23.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.939+0000 7fa60bfff640 1 --2- 172.21.15.19:0/3768464700 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a1ef29eca0 0x55a1ef2a1090 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48d483d04ce2db6d server_cookie=8cfe718cf5aa55ed in_seq=0 out_seq=0 2024-09-19T08:58:23.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.939+0000 7fa5eb7fe640 10 client.16884 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:23.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.939+0000 7fa5eb7fe640 1 -- 172.21.15.19:0/3768464700 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a1ef1f6b90 con 0x55a1ef29eca0 2024-09-19T08:58:23.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.939+0000 7fa5eb7fe640 10 client.16884 handle_command_reply: tid=0 2024-09-19T08:58:23.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.939+0000 7fa614bc9740 1 client.16884 shutdown 2024-09-19T08:58:23.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.940+0000 7fa614bc9740 1 -- 172.21.15.19:0/3768464700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1ef28f240 msgr2=0x55a1ef28cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:23.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.940+0000 7fa614bc9740 1 --2- 172.21.15.19:0/3768464700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1ef28f240 0x55a1ef28cb00 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fa60001d560 tx=0x7fa60001d460 comp rx=0 tx=0).stop 2024-09-19T08:58:23.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.940+0000 7fa614bc9740 1 -- 172.21.15.19:0/3768464700 shutdown_connections 2024-09-19T08:58:23.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.940+0000 7fa614bc9740 1 --2- 172.21.15.19:0/3768464700 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a1ef29eca0 0x55a1ef2a1090 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:23.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.940+0000 7fa614bc9740 1 --2- 172.21.15.19:0/3768464700 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1ef284980 0x55a1ef28c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:23.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.940+0000 7fa614bc9740 1 --2- 172.21.15.19:0/3768464700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1ef28f240 0x55a1ef28cb00 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:23.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.940+0000 7fa614bc9740 1 --2- 172.21.15.19:0/3768464700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1ef284060 0x55a1ef28c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:23.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.940+0000 7fa614bc9740 1 -- 172.21.15.19:0/3768464700 >> 172.21.15.19:0/3768464700 conn(0x55a1ef2805f0 msgr2=0x55a1ef286320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:23.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.940+0000 7fa5eb7fe640 0 client.16884 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:23.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.940+0000 7fa614bc9740 1 -- 172.21.15.19:0/3768464700 shutdown_connections 2024-09-19T08:58:23.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.940+0000 7fa614bc9740 1 -- 172.21.15.19:0/3768464700 wait complete. 2024-09-19T08:58:23.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.940+0000 7fa614bc9740 20 client.16884 trim_cache size 0 max 16384 2024-09-19T08:58:23.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.957+0000 7fa614bc9740 1 Processor -- start 2024-09-19T08:58:23.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.957+0000 7fa614bc9740 1 -- start start 2024-09-19T08:58:23.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.957+0000 7fa614bc9740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1ef284060 0x55a1ef28af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:23.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.957+0000 7fa614bc9740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1ef284980 0x55a1ef2a6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:23.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.957+0000 7fa614bc9740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1ef28f240 0x55a1ef2a6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:23.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.957+0000 7fa614bc9740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c1af770 con 0x55a1ef284060 2024-09-19T08:58:23.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.957+0000 7fa614bc9740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c1b12b0 con 0x55a1ef28f240 2024-09-19T08:58:23.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.957+0000 7fa614bc9740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c1afe40 con 0x55a1ef284980 2024-09-19T08:58:23.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.957+0000 7fa60b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1ef284060 0x55a1ef28af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:23.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.957+0000 7fa60b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1ef284060 0x55a1ef28af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55188/0 (socket says 172.21.15.19:55188) 2024-09-19T08:58:23.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.957+0000 7fa60b7fe640 1 -- 172.21.15.19:0/1100479473 learned_addr learned my addr 172.21.15.19:0/1100479473 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:23.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.958+0000 7fa60bfff640 1 --2- 172.21.15.19:0/1100479473 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1ef284980 0x55a1ef2a6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:23.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.958+0000 7fa60b7fe640 1 --2- 172.21.15.19:0/1100479473 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1ef28f240 0x55a1ef2a6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:23.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.958+0000 7fa60b7fe640 1 -- 172.21.15.19:0/1100479473 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1ef284980 msgr2=0x55a1ef2a6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:23.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.958+0000 7fa60b7fe640 1 --2- 172.21.15.19:0/1100479473 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1ef284980 0x55a1ef2a6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:23.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.958+0000 7fa60b7fe640 1 -- 172.21.15.19:0/1100479473 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1ef28f240 msgr2=0x55a1ef2a6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:23.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.958+0000 7fa60b7fe640 1 --2- 172.21.15.19:0/1100479473 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1ef28f240 0x55a1ef2a6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:23.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.958+0000 7fa60b7fe640 1 -- 172.21.15.19:0/1100479473 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1ef280420 con 0x55a1ef284060 2024-09-19T08:58:23.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.958+0000 7fa60b7fe640 1 --2- 172.21.15.19:0/1100479473 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1ef284060 0x55a1ef28af50 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fa60000b5b0 tx=0x7fa600005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e75e085c00e398 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:23.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.958+0000 7fa5f1ffb640 1 -- 172.21.15.19:0/1100479473 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa600019070 con 0x55a1ef284060 2024-09-19T08:58:23.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.958+0000 7fa5f1ffb640 1 -- 172.21.15.19:0/1100479473 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6000114c0 con 0x55a1ef284060 2024-09-19T08:58:23.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.958+0000 7fa5f1ffb640 1 -- 172.21.15.19:0/1100479473 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60001d590 con 0x55a1ef284060 2024-09-19T08:58:23.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.959+0000 7fa614bc9740 1 -- 172.21.15.19:0/1100479473 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1ef284060 msgr2=0x55a1ef28af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:23.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.959+0000 7fa614bc9740 1 --2- 172.21.15.19:0/1100479473 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1ef284060 0x55a1ef28af50 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fa60000b5b0 tx=0x7fa600005c50 comp rx=0 tx=0).stop 2024-09-19T08:58:23.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.959+0000 7fa614bc9740 1 -- 172.21.15.19:0/1100479473 shutdown_connections 2024-09-19T08:58:23.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.959+0000 7fa614bc9740 1 --2- 172.21.15.19:0/1100479473 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1ef284980 0x55a1ef2a6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:23.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.959+0000 7fa614bc9740 1 --2- 172.21.15.19:0/1100479473 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1ef28f240 0x55a1ef2a6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:23.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.959+0000 7fa614bc9740 1 --2- 172.21.15.19:0/1100479473 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1ef284060 0x55a1ef28af50 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:23.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.959+0000 7fa614bc9740 1 -- 172.21.15.19:0/1100479473 >> 172.21.15.19:0/1100479473 conn(0x55a1ef2805f0 msgr2=0x55a1ef28a840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:23.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.959+0000 7fa614bc9740 1 -- 172.21.15.19:0/1100479473 shutdown_connections 2024-09-19T08:58:23.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.959+0000 7fa614bc9740 1 -- 172.21.15.19:0/1100479473 wait complete. 2024-09-19T08:58:23.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.959+0000 7fa614bc9740 1 -- start start 2024-09-19T08:58:23.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.960+0000 7fa614bc9740 1 Processor -- start 2024-09-19T08:58:23.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.960+0000 7fa614bc9740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1ef284060 0x55a1ef297a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:23.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.960+0000 7fa614bc9740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1ef284980 0x55a1ef288ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:23.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.960+0000 7fa614bc9740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1ef28f240 0x55a1ef2894e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:23.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.960+0000 7fa614bc9740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c1b0be0 con 0x55a1ef28f240 2024-09-19T08:58:23.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.960+0000 7fa614bc9740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c1b0510 con 0x55a1ef284980 2024-09-19T08:58:23.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.960+0000 7fa614bc9740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa60c1ad750 con 0x55a1ef284060 2024-09-19T08:58:23.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.960+0000 7fa614bc9740 10 client.0 _ll_register_callbacks cb 0x7fa600011cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:23.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.960+0000 7fa60b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1ef28f240 0x55a1ef2894e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:23.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.960+0000 7fa60b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1ef28f240 0x55a1ef2894e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55194/0 (socket says 172.21.15.19:55194) 2024-09-19T08:58:23.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.960+0000 7fa60b7fe640 1 -- 172.21.15.19:0/20573008 learned_addr learned my addr 172.21.15.19:0/20573008 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:23.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.960+0000 7fa60b7fe640 1 --2- 172.21.15.19:0/20573008 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1ef284060 0x55a1ef297a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:23.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.960+0000 7fa60bfff640 1 --2- 172.21.15.19:0/20573008 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1ef284980 0x55a1ef288ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:23.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.960+0000 7fa60b7fe640 1 -- 172.21.15.19:0/20573008 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1ef284060 msgr2=0x55a1ef297a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:23.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.960+0000 7fa60b7fe640 1 --2- 172.21.15.19:0/20573008 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1ef284060 0x55a1ef297a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:23.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.960+0000 7fa60b7fe640 1 -- 172.21.15.19:0/20573008 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1ef284980 msgr2=0x55a1ef288ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:23.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.960+0000 7fa60b7fe640 1 --2- 172.21.15.19:0/20573008 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1ef284980 0x55a1ef288ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:23.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.960+0000 7fa60b7fe640 1 -- 172.21.15.19:0/20573008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1ef289d10 con 0x55a1ef28f240 2024-09-19T08:58:23.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.961+0000 7fa60b7fe640 1 --2- 172.21.15.19:0/20573008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1ef28f240 0x55a1ef2894e0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa60000bee0 tx=0x7fa60000bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2d88cb5e29d47c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:23.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.961+0000 7fa5eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:58:23.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.961+0000 7fa5eb7fe640 1 -- 172.21.15.19:0/20573008 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa600019070 con 0x55a1ef28f240 2024-09-19T08:58:23.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.961+0000 7fa5eb7fe640 1 -- 172.21.15.19:0/20573008 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa60001dbd0 con 0x55a1ef28f240 2024-09-19T08:58:23.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.961+0000 7fa614bc9740 1 -- 172.21.15.19:0/20573008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6000114c0 con 0x55a1ef28f240 2024-09-19T08:58:23.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.961+0000 7fa5eb7fe640 1 -- 172.21.15.19:0/20573008 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa60000b610 con 0x55a1ef28f240 2024-09-19T08:58:23.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.961+0000 7fa614bc9740 10 client.16890 fetch_fsmap learned FSMap version 34 2024-09-19T08:58:23.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.961+0000 7fa614bc9740 1 -- 172.21.15.19:0/20573008 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a1ef309830 con 0x55a1ef28f240 2024-09-19T08:58:23.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.961+0000 7fa5eb7fe640 1 -- 172.21.15.19:0/20573008 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa6000114c0 con 0x55a1ef28f240 2024-09-19T08:58:23.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.961+0000 7fa5eb7fe640 1 -- 172.21.15.19:0/20573008 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7fa600048030 con 0x55a1ef28f240 2024-09-19T08:58:23.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.961+0000 7fa614bc9740 10 client.16890 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T08:58:23.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.961+0000 7fa614bc9740 10 client.16890 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T08:58:23.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.961+0000 7fa614bc9740 20 client.16890 populate_metadata read hostname 'smithi019' 2024-09-19T08:58:23.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.961+0000 7fa614bc9740 1 --2- 172.21.15.19:0/20573008 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a1ef309e90 0x55a1ef30c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:23.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.961+0000 7fa614bc9740 4 client.16890 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "c98ecb3a", "release": true, "await": true}] 2024-09-19T08:58:23.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.961+0000 7fa614bc9740 1 -- 172.21.15.19:0/20573008 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "quiesce db", "set_id": "c98ecb3a", "release": true, "await": true}) -- 0x55a1ef1f10a0 con 0x55a1ef309e90 2024-09-19T08:58:23.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.962+0000 7fa60bfff640 1 --2- 172.21.15.19:0/20573008 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a1ef309e90 0x55a1ef30c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:23.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.962+0000 7fa60bfff640 1 --2- 172.21.15.19:0/20573008 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a1ef309e90 0x55a1ef30c280 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1a134d856a6d37a server_cookie=c0d000ceac8d3d75 in_seq=0 out_seq=0 2024-09-19T08:58:23.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:23.962+0000 7fa5eb7fe640 10 client.16890 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:23.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:23 smithi203 ceph-mon[35450]: pgmap v522: 97 pgs: 97 active+clean; 2.6 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 78 KiB/s wr, 1.20k op/s 2024-09-19T08:58:24.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:24 smithi155 ceph-mon[34921]: scrub summary: idle+waiting paths [/] 2024-09-19T08:58:24.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:24 smithi203 ceph-mon[35450]: scrub summary: idle+waiting paths [/] 2024-09-19T08:58:25.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:24 smithi019 ceph-mon[30976]: scrub summary: idle+waiting paths [/] 2024-09-19T08:58:25.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:25.484+0000 7fa5eb7fe640 1 -- 172.21.15.19:0/20573008 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55a1ef1f10a0 con 0x55a1ef309e90 2024-09-19T08:58:25.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:25.484+0000 7fa5eb7fe640 10 client.16890 handle_command_reply: tid=0 2024-09-19T08:58:25.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:25.484+0000 7fa614bc9740 1 client.16890 shutdown 2024-09-19T08:58:25.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:25.485+0000 7fa614bc9740 1 -- 172.21.15.19:0/20573008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1ef28f240 msgr2=0x55a1ef2894e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:25.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:25.485+0000 7fa614bc9740 1 --2- 172.21.15.19:0/20573008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1ef28f240 0x55a1ef2894e0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa60000bee0 tx=0x7fa60000bde0 comp rx=0 tx=0).stop 2024-09-19T08:58:25.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:25.485+0000 7fa614bc9740 1 -- 172.21.15.19:0/20573008 shutdown_connections 2024-09-19T08:58:25.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:25.485+0000 7fa614bc9740 1 --2- 172.21.15.19:0/20573008 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55a1ef309e90 0x55a1ef30c280 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:25.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:25.485+0000 7fa614bc9740 1 --2- 172.21.15.19:0/20573008 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a1ef28f240 0x55a1ef2894e0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:25.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:25.485+0000 7fa5eb7fe640 0 client.16890 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:25.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:25.485+0000 7fa614bc9740 1 --2- 172.21.15.19:0/20573008 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a1ef284980 0x55a1ef288ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:25.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:25.485+0000 7fa614bc9740 1 --2- 172.21.15.19:0/20573008 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1ef284060 0x55a1ef297a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:25.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:25.485+0000 7fa614bc9740 1 -- 172.21.15.19:0/20573008 >> 172.21.15.19:0/20573008 conn(0x55a1ef2805f0 msgr2=0x55a1ef28c860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:25.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:25.485+0000 7fa614bc9740 1 -- 172.21.15.19:0/20573008 shutdown_connections 2024-09-19T08:58:25.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:25.485+0000 7fa614bc9740 1 -- 172.21.15.19:0/20573008 wait complete. 2024-09-19T08:58:25.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:25.485+0000 7fa614bc9740 20 client.16890 trim_cache size 0 max 16384 2024-09-19T08:58:25.487 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:58:25.487 INFO:teuthology.orchestra.run.smithi019.stdout: "epoch": 34, 2024-09-19T08:58:25.487 INFO:teuthology.orchestra.run.smithi019.stdout: "leader": 24497, 2024-09-19T08:58:25.487 INFO:teuthology.orchestra.run.smithi019.stdout: "set_version": 24, 2024-09-19T08:58:25.488 INFO:teuthology.orchestra.run.smithi019.stdout: "sets": { 2024-09-19T08:58:25.488 INFO:teuthology.orchestra.run.smithi019.stdout: "c98ecb3a": { 2024-09-19T08:58:25.488 INFO:teuthology.orchestra.run.smithi019.stdout: "version": 24, 2024-09-19T08:58:25.488 INFO:teuthology.orchestra.run.smithi019.stdout: "age_ref": 0.1, 2024-09-19T08:58:25.488 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T08:58:25.488 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RELEASED", 2024-09-19T08:58:25.488 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T08:58:25.488 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T08:58:25.488 INFO:teuthology.orchestra.run.smithi019.stdout: "timeout": 90.0, 2024-09-19T08:58:25.488 INFO:teuthology.orchestra.run.smithi019.stdout: "expiration": 149.8, 2024-09-19T08:58:25.488 INFO:teuthology.orchestra.run.smithi019.stdout: "members": { 2024-09-19T08:58:25.488 INFO:teuthology.orchestra.run.smithi019.stdout: "file:/": { 2024-09-19T08:58:25.488 INFO:teuthology.orchestra.run.smithi019.stdout: "excluded": false, 2024-09-19T08:58:25.489 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T08:58:25.489 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RELEASED", 2024-09-19T08:58:25.489 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T08:58:25.489 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:58:25.489 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:58:25.489 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:58:25.489 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:58:25.489 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:58:25.489 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:58:25.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:25.487+0000 7fa6127f0640 1 -- 172.21.15.19:0/3857960244 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa5f40a32c0 msgr2=0x7fa5f40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:25.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:25.487+0000 7fa6127f0640 1 --2- 172.21.15.19:0/3857960244 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa5f40a32c0 0x7fa5f40a5780 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa6040a4c00 tx=0x7fa60406f340 comp rx=0 tx=0).stop 2024-09-19T08:58:25.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:25.487+0000 7fa6127f0640 1 -- 172.21.15.19:0/3857960244 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa60c105590 msgr2=0x7fa60c102980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:25.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:25.487+0000 7fa6127f0640 1 --2- 172.21.15.19:0/3857960244 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa60c105590 0x7fa60c102980 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fa60400dd70 tx=0x7fa60400b730 comp rx=0 tx=0).stop 2024-09-19T08:58:25.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:25.487+0000 7fa6127f0640 1 -- 172.21.15.19:0/3857960244 shutdown_connections 2024-09-19T08:58:25.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:25.487+0000 7fa6127f0640 1 --2- 172.21.15.19:0/3857960244 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa5f40a32c0 0x7fa5f40a5780 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:25.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:25.487+0000 7fa6127f0640 1 --2- 172.21.15.19:0/3857960244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa60c100e10 0x7fa60c102440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:25.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:25.487+0000 7fa6127f0640 1 --2- 172.21.15.19:0/3857960244 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa60c105590 0x7fa60c102980 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:25.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:25.487+0000 7fa6127f0640 1 --2- 172.21.15.19:0/3857960244 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa60c100460 0x7fa60c101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:25.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:25.487+0000 7fa6127f0640 1 -- 172.21.15.19:0/3857960244 >> 172.21.15.19:0/3857960244 conn(0x7fa60c0fbee0 msgr2=0x7fa60c0fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:25.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:25.488+0000 7fa6127f0640 1 -- 172.21.15.19:0/3857960244 shutdown_connections 2024-09-19T08:58:25.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:25.488+0000 7fa6127f0640 1 -- 172.21.15.19:0/3857960244 wait complete. 2024-09-19T08:58:25.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:25 smithi019 ceph-mon[30976]: pgmap v523: 97 pgs: 97 active+clean; 2.6 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 7.8 KiB/s wr, 1.70k op/s 2024-09-19T08:58:25.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:25 smithi155 ceph-mon[34921]: pgmap v523: 97 pgs: 97 active+clean; 2.6 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 7.8 KiB/s wr, 1.70k op/s 2024-09-19T08:58:25.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:25 smithi203 ceph-mon[35450]: pgmap v523: 97 pgs: 97 active+clean; 2.6 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 7.8 KiB/s wr, 1.70k op/s 2024-09-19T08:58:26.257 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'c98ecb3a', total seconds elapsed: 35.7 2024-09-19T08:58:26.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:26 smithi155 ceph-mon[34921]: scrub summary: idle 2024-09-19T08:58:26.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:26 smithi203 ceph-mon[35450]: scrub summary: idle 2024-09-19T08:58:27.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:26 smithi019 ceph-mon[30976]: scrub summary: idle 2024-09-19T08:58:27.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:27 smithi155 ceph-mon[34921]: pgmap v524: 97 pgs: 97 active+clean; 2.6 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 77 KiB/s wr, 2.41k op/s 2024-09-19T08:58:27.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:27 smithi203 ceph-mon[35450]: pgmap v524: 97 pgs: 97 active+clean; 2.6 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 77 KiB/s wr, 2.41k op/s 2024-09-19T08:58:28.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:27 smithi019 ceph-mon[30976]: pgmap v524: 97 pgs: 97 active+clean; 2.6 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 77 KiB/s wr, 2.41k op/s 2024-09-19T08:58:29.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:29 smithi155 ceph-mon[34921]: pgmap v525: 97 pgs: 97 active+clean; 5.3 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 445 KiB/s wr, 3.08k op/s 2024-09-19T08:58:29.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:29 smithi203 ceph-mon[35450]: pgmap v525: 97 pgs: 97 active+clean; 5.3 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 445 KiB/s wr, 3.08k op/s 2024-09-19T08:58:30.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:29 smithi019 ceph-mon[30976]: pgmap v525: 97 pgs: 97 active+clean; 5.3 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 445 KiB/s wr, 3.08k op/s 2024-09-19T08:58:31.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:31 smithi155 ceph-mon[34921]: pgmap v526: 97 pgs: 97 active+clean; 7.5 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 679 KiB/s wr, 3.09k op/s 2024-09-19T08:58:31.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:31 smithi203 ceph-mon[35450]: pgmap v526: 97 pgs: 97 active+clean; 7.5 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 679 KiB/s wr, 3.09k op/s 2024-09-19T08:58:32.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:31 smithi019 ceph-mon[30976]: pgmap v526: 97 pgs: 97 active+clean; 7.5 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 679 KiB/s wr, 3.09k op/s 2024-09-19T08:58:33.539 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.535+0000 7fe3dfb2c640 1 -- 172.21.15.19:0/1097449984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3d8104ef0 msgr2=0x7fe3d81072e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:33.539 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.535+0000 7fe3dfb2c640 1 --2- 172.21.15.19:0/1097449984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3d8104ef0 0x7fe3d81072e0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8009900 tx=0x7fe3c802a410 comp rx=0 tx=0).stop 2024-09-19T08:58:33.539 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.536+0000 7fe3dfb2c640 1 -- 172.21.15.19:0/1097449984 shutdown_connections 2024-09-19T08:58:33.539 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.536+0000 7fe3dfb2c640 1 --2- 172.21.15.19:0/1097449984 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3d8107820 0x7fe3d8109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.539 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.536+0000 7fe3dfb2c640 1 --2- 172.21.15.19:0/1097449984 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3d8104ef0 0x7fe3d81072e0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.539 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.536+0000 7fe3dfb2c640 1 --2- 172.21.15.19:0/1097449984 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3d81025c0 0x7fe3d81049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.539 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.536+0000 7fe3dfb2c640 1 -- 172.21.15.19:0/1097449984 >> 172.21.15.19:0/1097449984 conn(0x7fe3d80fc1e0 msgr2=0x7fe3d80fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:33.539 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.536+0000 7fe3dfb2c640 1 -- 172.21.15.19:0/1097449984 shutdown_connections 2024-09-19T08:58:33.540 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.536+0000 7fe3dfb2c640 1 -- 172.21.15.19:0/1097449984 wait complete. 2024-09-19T08:58:33.540 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.536+0000 7fe3dfb2c640 1 Processor -- start 2024-09-19T08:58:33.540 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.536+0000 7fe3dfb2c640 1 -- start start 2024-09-19T08:58:33.540 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.536+0000 7fe3dfb2c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3d81025c0 0x7fe3d8197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:33.540 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.536+0000 7fe3dfb2c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3d8104ef0 0x7fe3d8198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:33.540 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.536+0000 7fe3dfb2c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3d8107820 0x7fe3d819f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:33.540 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.536+0000 7fe3dfb2c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d810d820 con 0x7fe3d8107820 2024-09-19T08:58:33.540 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.536+0000 7fe3dfb2c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d810d6a0 con 0x7fe3d8104ef0 2024-09-19T08:58:33.540 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.536+0000 7fe3dfb2c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d810d9a0 con 0x7fe3d81025c0 2024-09-19T08:58:33.541 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.537+0000 7fe3de0c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3d8107820 0x7fe3d819f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:33.541 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.537+0000 7fe3de0c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3d8107820 0x7fe3d819f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57042/0 (socket says 172.21.15.19:57042) 2024-09-19T08:58:33.541 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.537+0000 7fe3de0c9640 1 -- 172.21.15.19:0/519784291 learned_addr learned my addr 172.21.15.19:0/519784291 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:33.541 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.537+0000 7fe3dd0c7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3d8104ef0 0x7fe3d8198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:33.541 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.537+0000 7fe3dd8c8640 1 --2- 172.21.15.19:0/519784291 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3d81025c0 0x7fe3d8197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:33.541 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.537+0000 7fe3de0c9640 1 -- 172.21.15.19:0/519784291 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3d81025c0 msgr2=0x7fe3d8197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:33.541 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.537+0000 7fe3de0c9640 1 --2- 172.21.15.19:0/519784291 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3d81025c0 0x7fe3d8197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.541 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.537+0000 7fe3de0c9640 1 -- 172.21.15.19:0/519784291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3d8104ef0 msgr2=0x7fe3d8198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:33.542 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.537+0000 7fe3de0c9640 1 --2- 172.21.15.19:0/519784291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3d8104ef0 0x7fe3d8198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.542 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.537+0000 7fe3de0c9640 1 -- 172.21.15.19:0/519784291 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d819fa40 con 0x7fe3d8107820 2024-09-19T08:58:33.542 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.537+0000 7fe3dd0c7640 1 --2- 172.21.15.19:0/519784291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3d8104ef0 0x7fe3d8198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:58:33.542 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.537+0000 7fe3dd8c8640 1 --2- 172.21.15.19:0/519784291 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3d81025c0 0x7fe3d8197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:58:33.542 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.537+0000 7fe3de0c9640 1 --2- 172.21.15.19:0/519784291 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3d8107820 0x7fe3d819f3d0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fe3d000eb40 tx=0x7fe3d000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:33.543 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.537+0000 7fe3ceffd640 1 -- 172.21.15.19:0/519784291 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d0004b20 con 0x7fe3d8107820 2024-09-19T08:58:33.543 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.537+0000 7fe3ceffd640 1 -- 172.21.15.19:0/519784291 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3d0004cc0 con 0x7fe3d8107820 2024-09-19T08:58:33.543 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.537+0000 7fe3dfb2c640 1 -- 172.21.15.19:0/519784291 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3d819fd30 con 0x7fe3d8107820 2024-09-19T08:58:33.543 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.537+0000 7fe3ceffd640 1 -- 172.21.15.19:0/519784291 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d0010850 con 0x7fe3d8107820 2024-09-19T08:58:33.543 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.537+0000 7fe3dfb2c640 1 -- 172.21.15.19:0/519784291 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3d81a01a0 con 0x7fe3d8107820 2024-09-19T08:58:33.551 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.540+0000 7fe3e28c0740 1 Processor -- start 2024-09-19T08:58:33.551 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.540+0000 7fe3ceffd640 1 -- 172.21.15.19:0/519784291 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fe3d0005020 con 0x7fe3d8107820 2024-09-19T08:58:33.551 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.541+0000 7fe3e28c0740 1 -- start start 2024-09-19T08:58:33.551 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.541+0000 7fe3e28c0740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612b9f779a0 0x5612b9f77da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:33.551 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.541+0000 7fe3e28c0740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5612b9f782e0 0x5612b9f7cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:33.551 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.541+0000 7fe3e28c0740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5612b9f7d370 0x5612b9f7f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:33.551 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.541+0000 7fe3e28c0740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5612b9edb2f0 con 0x5612b9f782e0 2024-09-19T08:58:33.552 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.541+0000 7fe3e28c0740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5612b9e83270 con 0x5612b9f7d370 2024-09-19T08:58:33.552 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.541+0000 7fe3e28c0740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5612b9ed72b0 con 0x5612b9f779a0 2024-09-19T08:58:33.552 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.541+0000 7fe3dd8c8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5612b9f782e0 0x5612b9f7cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:33.552 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.541+0000 7fe3dd0c7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5612b9f7d370 0x5612b9f7f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:33.552 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.541+0000 7fe3dd0c7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5612b9f7d370 0x5612b9f7f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:37812/0 (socket says 172.21.15.19:37812) 2024-09-19T08:58:33.552 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.541+0000 7fe3dd0c7640 1 -- 172.21.15.19:0/4291132106 learned_addr learned my addr 172.21.15.19:0/4291132106 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:33.552 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.541+0000 7fe3dd8c8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5612b9f782e0 0x5612b9f7cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57050/0 (socket says 172.21.15.19:57050) 2024-09-19T08:58:33.552 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.541+0000 7fe3dd0c7640 1 --2- 172.21.15.19:0/4291132106 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612b9f779a0 0x5612b9f77da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:33.552 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.541+0000 7fe3dd0c7640 1 -- 172.21.15.19:0/4291132106 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612b9f779a0 msgr2=0x5612b9f77da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:33.552 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.541+0000 7fe3dd0c7640 1 --2- 172.21.15.19:0/4291132106 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612b9f779a0 0x5612b9f77da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.541+0000 7fe3dd0c7640 1 -- 172.21.15.19:0/4291132106 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5612b9f782e0 msgr2=0x5612b9f7cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:33.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.541+0000 7fe3dd0c7640 1 --2- 172.21.15.19:0/4291132106 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5612b9f782e0 0x5612b9f7cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.541+0000 7fe3dd0c7640 1 -- 172.21.15.19:0/4291132106 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612b9e82340 con 0x5612b9f7d370 2024-09-19T08:58:33.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.541+0000 7fe3ceffd640 1 --2- 172.21.15.19:0/519784291 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe3c40a32f0 0x7fe3c40a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:33.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.542+0000 7fe3dd8c8640 1 --2- 172.21.15.19:0/519784291 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe3c40a32f0 0x7fe3c40a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:33.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.542+0000 7fe3dd0c7640 1 --2- 172.21.15.19:0/4291132106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5612b9f7d370 0x5612b9f7f830 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8006010 tx=0x7fe3c8005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66abfd3d304f1c31 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:33.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.542+0000 7fe3ceffd640 1 -- 172.21.15.19:0/519784291 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fe3d00d01d0 con 0x7fe3d8107820 2024-09-19T08:58:33.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.542+0000 7fe3c3fff640 1 -- 172.21.15.19:0/4291132106 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8035070 con 0x5612b9f7d370 2024-09-19T08:58:33.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.542+0000 7fe3c3fff640 1 -- 172.21.15.19:0/4291132106 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3c8032dd0 con 0x5612b9f7d370 2024-09-19T08:58:33.554 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.542+0000 7fe3c3fff640 1 -- 172.21.15.19:0/4291132106 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c8004e10 con 0x5612b9f7d370 2024-09-19T08:58:33.554 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.543+0000 7fe3e28c0740 1 -- 172.21.15.19:0/4291132106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5612b9f7d370 msgr2=0x5612b9f7f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:33.554 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.543+0000 7fe3e28c0740 1 --2- 172.21.15.19:0/4291132106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5612b9f7d370 0x5612b9f7f830 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8006010 tx=0x7fe3c8005d50 comp rx=0 tx=0).stop 2024-09-19T08:58:33.554 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.543+0000 7fe3dd8c8640 1 --2- 172.21.15.19:0/519784291 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe3c40a32f0 0x7fe3c40a57b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x5612b9f78d10 tx=0x7fe3d40118f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:33.554 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.543+0000 7fe3e28c0740 1 -- 172.21.15.19:0/4291132106 shutdown_connections 2024-09-19T08:58:33.554 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.543+0000 7fe3e28c0740 1 --2- 172.21.15.19:0/4291132106 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5612b9f7d370 0x5612b9f7f830 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.554 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.543+0000 7fe3e28c0740 1 --2- 172.21.15.19:0/4291132106 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5612b9f782e0 0x5612b9f7cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.554 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.543+0000 7fe3e28c0740 1 --2- 172.21.15.19:0/4291132106 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612b9f779a0 0x5612b9f77da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.554 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.543+0000 7fe3e28c0740 1 -- 172.21.15.19:0/4291132106 >> 172.21.15.19:0/4291132106 conn(0x5612b9f73010 msgr2=0x5612b9f73410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:33.554 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.543+0000 7fe3e28c0740 1 -- 172.21.15.19:0/4291132106 shutdown_connections 2024-09-19T08:58:33.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.543+0000 7fe3e28c0740 1 -- 172.21.15.19:0/4291132106 wait complete. 2024-09-19T08:58:33.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.543+0000 7fe3e28c0740 1 -- start start 2024-09-19T08:58:33.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.543+0000 7fe3e28c0740 1 Processor -- start 2024-09-19T08:58:33.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.544+0000 7fe3e28c0740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612b9f779a0 0x5612b9f81bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:33.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.544+0000 7fe3e28c0740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5612b9f782e0 0x5612b9f82100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:33.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.544+0000 7fe3e28c0740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5612b9f7d370 0x5612b9f89140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:33.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.544+0000 7fe3e28c0740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5612b9f802e0 con 0x5612b9f7d370 2024-09-19T08:58:33.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.544+0000 7fe3e28c0740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5612b9e64290 con 0x5612b9f782e0 2024-09-19T08:58:33.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.544+0000 7fe3e28c0740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5612b9f80460 con 0x5612b9f779a0 2024-09-19T08:58:33.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.544+0000 7fe3e28c0740 10 client.0 _ll_register_callbacks cb 0x5612b9e95140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:33.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.544+0000 7fe3de0c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5612b9f7d370 0x5612b9f89140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:33.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.544+0000 7fe3dd0c7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5612b9f782e0 0x5612b9f82100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:33.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.544+0000 7fe3de0c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5612b9f7d370 0x5612b9f89140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57056/0 (socket says 172.21.15.19:57056) 2024-09-19T08:58:33.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.544+0000 7fe3de0c9640 1 -- 172.21.15.19:0/2580205142 learned_addr learned my addr 172.21.15.19:0/2580205142 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:33.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.544+0000 7fe3dd8c8640 1 --2- 172.21.15.19:0/2580205142 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612b9f779a0 0x5612b9f81bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:33.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.544+0000 7fe3dd0c7640 1 -- 172.21.15.19:0/2580205142 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612b9f779a0 msgr2=0x5612b9f81bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:33.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.544+0000 7fe3dd0c7640 1 --2- 172.21.15.19:0/2580205142 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612b9f779a0 0x5612b9f81bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.544+0000 7fe3dd0c7640 1 -- 172.21.15.19:0/2580205142 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5612b9f7d370 msgr2=0x5612b9f89140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:33.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.544+0000 7fe3dd0c7640 1 --2- 172.21.15.19:0/2580205142 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5612b9f7d370 0x5612b9f89140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.544+0000 7fe3dd0c7640 1 -- 172.21.15.19:0/2580205142 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612b9bee210 con 0x5612b9f782e0 2024-09-19T08:58:33.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.544+0000 7fe3dd8c8640 1 --2- 172.21.15.19:0/2580205142 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612b9f779a0 0x5612b9f81bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:58:33.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.544+0000 7fe3de0c9640 1 --2- 172.21.15.19:0/2580205142 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5612b9f7d370 0x5612b9f89140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:58:33.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.545+0000 7fe3dd0c7640 1 --2- 172.21.15.19:0/2580205142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5612b9f782e0 0x5612b9f82100 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe3c80057c0 tx=0x7fe3c80043f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3fe0b8a6759a94b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:33.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.545+0000 7fe3c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T08:58:33.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.545+0000 7fe3c17fa640 1 -- 172.21.15.19:0/2580205142 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c804e070 con 0x5612b9f782e0 2024-09-19T08:58:33.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.545+0000 7fe3e28c0740 1 -- 172.21.15.19:0/2580205142 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3c8032dd0 con 0x5612b9f782e0 2024-09-19T08:58:33.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.545+0000 7fe3c17fa640 1 -- 172.21.15.19:0/2580205142 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fe3c80037f0 con 0x5612b9f782e0 2024-09-19T08:58:33.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.545+0000 7fe3c17fa640 1 -- 172.21.15.19:0/2580205142 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe3c8035070 con 0x5612b9f782e0 2024-09-19T08:58:33.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.545+0000 7fe3e28c0740 10 client.26381 fetch_fsmap learned FSMap version 34 2024-09-19T08:58:33.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.545+0000 7fe3e28c0740 1 -- 172.21.15.19:0/2580205142 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5612b9cba620 con 0x5612b9f782e0 2024-09-19T08:58:33.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.545+0000 7fe3c17fa640 1 -- 172.21.15.19:0/2580205142 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3c8032dd0 con 0x5612b9f782e0 2024-09-19T08:58:33.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.545+0000 7fe3c17fa640 1 -- 172.21.15.19:0/2580205142 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7fe3c8053ab0 con 0x5612b9f782e0 2024-09-19T08:58:33.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.545+0000 7fe3e28c0740 10 client.26381 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T08:58:33.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.545+0000 7fe3e28c0740 10 client.26381 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:58:33.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.545+0000 7fe3e28c0740 20 client.26381 populate_metadata read hostname 'smithi019' 2024-09-19T08:58:33.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.545+0000 7fe3e28c0740 1 --2- 172.21.15.19:0/2580205142 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5612b9f8d440 0x5612b9f8f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:33.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.545+0000 7fe3e28c0740 4 client.26381 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:58:33.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.545+0000 7fe3e28c0740 1 -- 172.21.15.19:0/2580205142 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5612b9ee8a20 con 0x5612b9f8d440 2024-09-19T08:58:33.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.546+0000 7fe3dd8c8640 1 --2- 172.21.15.19:0/2580205142 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5612b9f8d440 0x5612b9f8f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:33.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.546+0000 7fe3dd8c8640 1 --2- 172.21.15.19:0/2580205142 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5612b9f8d440 0x5612b9f8f830 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70d6d3548c3f0fea server_cookie=a9bffba1cf451c7e in_seq=0 out_seq=0 2024-09-19T08:58:33.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.546+0000 7fe3c17fa640 10 client.26381 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:33.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.547+0000 7fe3c17fa640 1 -- 172.21.15.19:0/2580205142 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5612b9ee8a20 con 0x5612b9f8d440 2024-09-19T08:58:33.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.547+0000 7fe3c17fa640 10 client.26381 handle_command_reply: tid=0 2024-09-19T08:58:33.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.548+0000 7fe3e28c0740 1 client.26381 shutdown 2024-09-19T08:58:33.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.548+0000 7fe3e28c0740 1 -- 172.21.15.19:0/2580205142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5612b9f782e0 msgr2=0x5612b9f82100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:33.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.548+0000 7fe3e28c0740 1 --2- 172.21.15.19:0/2580205142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5612b9f782e0 0x5612b9f82100 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe3c80057c0 tx=0x7fe3c80043f0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.548+0000 7fe3e28c0740 1 -- 172.21.15.19:0/2580205142 shutdown_connections 2024-09-19T08:58:33.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.548+0000 7fe3e28c0740 1 --2- 172.21.15.19:0/2580205142 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5612b9f8d440 0x5612b9f8f830 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.548+0000 7fe3e28c0740 1 --2- 172.21.15.19:0/2580205142 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5612b9f7d370 0x5612b9f89140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.548+0000 7fe3e28c0740 1 --2- 172.21.15.19:0/2580205142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5612b9f782e0 0x5612b9f82100 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.548+0000 7fe3c17fa640 0 client.26381 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:33.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.548+0000 7fe3e28c0740 1 --2- 172.21.15.19:0/2580205142 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612b9f779a0 0x5612b9f81bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.548+0000 7fe3e28c0740 1 -- 172.21.15.19:0/2580205142 >> 172.21.15.19:0/2580205142 conn(0x5612b9f73010 msgr2=0x5612b9f74820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:33.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.548+0000 7fe3e28c0740 1 -- 172.21.15.19:0/2580205142 shutdown_connections 2024-09-19T08:58:33.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.548+0000 7fe3e28c0740 1 -- 172.21.15.19:0/2580205142 wait complete. 2024-09-19T08:58:33.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.548+0000 7fe3e28c0740 20 client.26381 trim_cache size 0 max 16384 2024-09-19T08:58:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.562+0000 7fe3e28c0740 1 Processor -- start 2024-09-19T08:58:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.562+0000 7fe3e28c0740 1 -- start start 2024-09-19T08:58:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.563+0000 7fe3e28c0740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5612b9f779a0 0x5612b9f73ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.563+0000 7fe3e28c0740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612b9f782e0 0x5612b9f89100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.563+0000 7fe3e28c0740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5612b9f7d370 0x5612b9f74400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.563+0000 7fe3e28c0740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d81a6c40 con 0x5612b9f779a0 2024-09-19T08:58:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.563+0000 7fe3e28c0740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d81a8780 con 0x5612b9f7d370 2024-09-19T08:58:33.564 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.563+0000 7fe3e28c0740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d81a7310 con 0x5612b9f782e0 2024-09-19T08:58:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.563+0000 7fe3dd8c8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5612b9f779a0 0x5612b9f73ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.563+0000 7fe3de0c9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5612b9f7d370 0x5612b9f74400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.563+0000 7fe3dd8c8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5612b9f779a0 0x5612b9f73ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57072/0 (socket says 172.21.15.19:57072) 2024-09-19T08:58:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.563+0000 7fe3dd8c8640 1 -- 172.21.15.19:0/2301494632 learned_addr learned my addr 172.21.15.19:0/2301494632 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.563+0000 7fe3dd0c7640 1 --2- 172.21.15.19:0/2301494632 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612b9f782e0 0x5612b9f89100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.563+0000 7fe3dd8c8640 1 -- 172.21.15.19:0/2301494632 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612b9f782e0 msgr2=0x5612b9f89100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.563+0000 7fe3dd8c8640 1 --2- 172.21.15.19:0/2301494632 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612b9f782e0 0x5612b9f89100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.563+0000 7fe3dd8c8640 1 -- 172.21.15.19:0/2301494632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5612b9f7d370 msgr2=0x5612b9f74400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.563+0000 7fe3dd8c8640 1 --2- 172.21.15.19:0/2301494632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5612b9f7d370 0x5612b9f74400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.563+0000 7fe3dd8c8640 1 -- 172.21.15.19:0/2301494632 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612b9f72e30 con 0x5612b9f779a0 2024-09-19T08:58:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.563+0000 7fe3de0c9640 1 --2- 172.21.15.19:0/2301494632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5612b9f7d370 0x5612b9f74400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:58:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.563+0000 7fe3dd8c8640 1 --2- 172.21.15.19:0/2301494632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5612b9f779a0 0x5612b9f73ec0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x5612b9f810f0 tx=0x7fe3d4013050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88c3b1bfacc2ac4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:33.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.563+0000 7fe3c37fe640 1 -- 172.21.15.19:0/2301494632 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d401dae0 con 0x5612b9f779a0 2024-09-19T08:58:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.564+0000 7fe3c37fe640 1 -- 172.21.15.19:0/2301494632 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3d401dc80 con 0x5612b9f779a0 2024-09-19T08:58:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.564+0000 7fe3c37fe640 1 -- 172.21.15.19:0/2301494632 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d401b620 con 0x5612b9f779a0 2024-09-19T08:58:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.564+0000 7fe3e28c0740 1 -- 172.21.15.19:0/2301494632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5612b9f779a0 msgr2=0x5612b9f73ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.564+0000 7fe3e28c0740 1 --2- 172.21.15.19:0/2301494632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5612b9f779a0 0x5612b9f73ec0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x5612b9f810f0 tx=0x7fe3d4013050 comp rx=0 tx=0).stop 2024-09-19T08:58:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.564+0000 7fe3e28c0740 1 -- 172.21.15.19:0/2301494632 shutdown_connections 2024-09-19T08:58:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.564+0000 7fe3e28c0740 1 --2- 172.21.15.19:0/2301494632 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612b9f782e0 0x5612b9f89100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.564+0000 7fe3e28c0740 1 --2- 172.21.15.19:0/2301494632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5612b9f7d370 0x5612b9f74400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.564+0000 7fe3e28c0740 1 --2- 172.21.15.19:0/2301494632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5612b9f779a0 0x5612b9f73ec0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.564+0000 7fe3e28c0740 1 -- 172.21.15.19:0/2301494632 >> 172.21.15.19:0/2301494632 conn(0x5612b9f73010 msgr2=0x5612b9f794c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.564+0000 7fe3e28c0740 1 -- 172.21.15.19:0/2301494632 shutdown_connections 2024-09-19T08:58:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.564+0000 7fe3e28c0740 1 -- 172.21.15.19:0/2301494632 wait complete. 2024-09-19T08:58:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.565+0000 7fe3e28c0740 1 -- start start 2024-09-19T08:58:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.565+0000 7fe3e28c0740 1 Processor -- start 2024-09-19T08:58:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.565+0000 7fe3e28c0740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612b9f779a0 0x5612b9f864e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.565+0000 7fe3e28c0740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5612b9f782e0 0x5612b9f86a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.565+0000 7fe3e28c0740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5612b9f7d370 0x5612b9f87990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.565+0000 7fe3e28c0740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d81a80b0 con 0x5612b9f7d370 2024-09-19T08:58:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.565+0000 7fe3e28c0740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d81a79e0 con 0x5612b9f782e0 2024-09-19T08:58:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.565+0000 7fe3e28c0740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d81a4c20 con 0x5612b9f779a0 2024-09-19T08:58:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.565+0000 7fe3e28c0740 10 client.0 _ll_register_callbacks cb 0x7fe3d4011790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.565+0000 7fe3de0c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5612b9f7d370 0x5612b9f87990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.565+0000 7fe3de0c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5612b9f7d370 0x5612b9f87990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57084/0 (socket says 172.21.15.19:57084) 2024-09-19T08:58:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.565+0000 7fe3de0c9640 1 -- 172.21.15.19:0/2977370560 learned_addr learned my addr 172.21.15.19:0/2977370560 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.565+0000 7fe3dd0c7640 1 --2- 172.21.15.19:0/2977370560 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5612b9f782e0 0x5612b9f86a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.565+0000 7fe3dd8c8640 1 --2- 172.21.15.19:0/2977370560 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612b9f779a0 0x5612b9f864e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.565+0000 7fe3de0c9640 1 -- 172.21.15.19:0/2977370560 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612b9f779a0 msgr2=0x5612b9f864e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.565+0000 7fe3de0c9640 1 --2- 172.21.15.19:0/2977370560 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612b9f779a0 0x5612b9f864e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.565+0000 7fe3de0c9640 1 -- 172.21.15.19:0/2977370560 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5612b9f782e0 msgr2=0x5612b9f86a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.565+0000 7fe3de0c9640 1 --2- 172.21.15.19:0/2977370560 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5612b9f782e0 0x5612b9f86a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.566+0000 7fe3de0c9640 1 -- 172.21.15.19:0/2977370560 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612b9f87fa0 con 0x5612b9f7d370 2024-09-19T08:58:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.566+0000 7fe3dd8c8640 1 --2- 172.21.15.19:0/2977370560 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612b9f779a0 0x5612b9f864e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:58:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.566+0000 7fe3de0c9640 1 --2- 172.21.15.19:0/2977370560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5612b9f7d370 0x5612b9f87990 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fe3d00058c0 tx=0x7fe3d009c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f27b4f083119bb2c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.566+0000 7fe3c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:58:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.566+0000 7fe3c17fa640 1 -- 172.21.15.19:0/2977370560 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3d00ba060 con 0x5612b9f7d370 2024-09-19T08:58:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.566+0000 7fe3c17fa640 1 -- 172.21.15.19:0/2977370560 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fe3d0085b50 con 0x5612b9f7d370 2024-09-19T08:58:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.566+0000 7fe3e28c0740 1 -- 172.21.15.19:0/2977370560 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3d401dc80 con 0x5612b9f7d370 2024-09-19T08:58:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.566+0000 7fe3c17fa640 1 -- 172.21.15.19:0/2977370560 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe3d009c800 con 0x5612b9f7d370 2024-09-19T08:58:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.566+0000 7fe3e28c0740 10 client.16908 fetch_fsmap learned FSMap version 34 2024-09-19T08:58:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.566+0000 7fe3e28c0740 1 -- 172.21.15.19:0/2977370560 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5612b9f89380 con 0x5612b9f7d370 2024-09-19T08:58:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.566+0000 7fe3c17fa640 1 -- 172.21.15.19:0/2977370560 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe3d401dc80 con 0x5612b9f7d370 2024-09-19T08:58:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.566+0000 7fe3c17fa640 1 -- 172.21.15.19:0/2977370560 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7fe3d009db30 con 0x5612b9f7d370 2024-09-19T08:58:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.567+0000 7fe3e28c0740 10 client.16908 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T08:58:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.567+0000 7fe3e28c0740 10 client.16908 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:58:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.567+0000 7fe3e28c0740 20 client.16908 populate_metadata read hostname 'smithi019' 2024-09-19T08:58:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.567+0000 7fe3e28c0740 1 --2- 172.21.15.19:0/2977370560 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5612b9ff85b0 0x5612b9ffa9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.567+0000 7fe3e28c0740 4 client.16908 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:58:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.567+0000 7fe3e28c0740 1 -- 172.21.15.19:0/2977370560 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5612b9ee2d70 con 0x5612b9ff85b0 2024-09-19T08:58:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.567+0000 7fe3dd8c8640 1 --2- 172.21.15.19:0/2977370560 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5612b9ff85b0 0x5612b9ffa9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.567+0000 7fe3dd8c8640 1 --2- 172.21.15.19:0/2977370560 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5612b9ff85b0 0x5612b9ffa9d0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b4200402736785a server_cookie=546193b752ccf6b2 in_seq=0 out_seq=0 2024-09-19T08:58:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:33.567+0000 7fe3c17fa640 10 client.16908 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:33.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:33 smithi155 ceph-mon[34921]: pgmap v527: 97 pgs: 97 active+clean; 7.5 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 723 KiB/s wr, 3.11k op/s 2024-09-19T08:58:33.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:33 smithi203 ceph-mon[35450]: pgmap v527: 97 pgs: 97 active+clean; 7.5 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 723 KiB/s wr, 3.11k op/s 2024-09-19T08:58:34.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:33 smithi019 ceph-mon[30976]: pgmap v527: 97 pgs: 97 active+clean; 7.5 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 723 KiB/s wr, 3.11k op/s 2024-09-19T08:58:35.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:35 smithi155 ceph-mon[34921]: pgmap v528: 97 pgs: 97 active+clean; 13 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.3 MiB/s wr, 2.26k op/s 2024-09-19T08:58:35.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:35 smithi203 ceph-mon[35450]: pgmap v528: 97 pgs: 97 active+clean; 13 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.3 MiB/s wr, 2.26k op/s 2024-09-19T08:58:36.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:35 smithi019 ceph-mon[30976]: pgmap v528: 97 pgs: 97 active+clean; 13 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 1.3 MiB/s wr, 2.26k op/s 2024-09-19T08:58:36.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:36.782+0000 7fe3c17fa640 1 -- 172.21.15.19:0/2977370560 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5612b9ee2d70 con 0x5612b9ff85b0 2024-09-19T08:58:36.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:36.782+0000 7fe3c17fa640 10 client.16908 handle_command_reply: tid=0 2024-09-19T08:58:36.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:36.782+0000 7fe3e28c0740 1 client.16908 shutdown 2024-09-19T08:58:36.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:36.782+0000 7fe3e28c0740 1 -- 172.21.15.19:0/2977370560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5612b9f7d370 msgr2=0x5612b9f87990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:36.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:36.782+0000 7fe3e28c0740 1 --2- 172.21.15.19:0/2977370560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5612b9f7d370 0x5612b9f87990 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fe3d00058c0 tx=0x7fe3d009c400 comp rx=0 tx=0).stop 2024-09-19T08:58:36.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:36.782+0000 7fe3e28c0740 1 -- 172.21.15.19:0/2977370560 shutdown_connections 2024-09-19T08:58:36.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:36.782+0000 7fe3e28c0740 1 --2- 172.21.15.19:0/2977370560 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5612b9ff85b0 0x5612b9ffa9d0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:36.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:36.782+0000 7fe3e28c0740 1 --2- 172.21.15.19:0/2977370560 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5612b9f7d370 0x5612b9f87990 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:36.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:36.782+0000 7fe3e28c0740 1 --2- 172.21.15.19:0/2977370560 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5612b9f782e0 0x5612b9f86a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:36.783 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:36.782+0000 7fe3c17fa640 0 client.16908 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:36.782+0000 7fe3e28c0740 1 --2- 172.21.15.19:0/2977370560 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612b9f779a0 0x5612b9f864e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:36.782+0000 7fe3e28c0740 1 -- 172.21.15.19:0/2977370560 >> 172.21.15.19:0/2977370560 conn(0x5612b9f73010 msgr2=0x5612b9f73ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:36.782+0000 7fe3e28c0740 1 -- 172.21.15.19:0/2977370560 shutdown_connections 2024-09-19T08:58:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:36.782+0000 7fe3e28c0740 1 -- 172.21.15.19:0/2977370560 wait complete. 2024-09-19T08:58:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:36.782+0000 7fe3e28c0740 20 client.16908 trim_cache size 0 max 16384 2024-09-19T08:58:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T08:58:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T08:58:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T08:58:36.784 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T08:58:36.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:36.783+0000 7fe3dfb2c640 1 -- 172.21.15.19:0/519784291 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe3c40a32f0 msgr2=0x7fe3c40a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:36.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:36.783+0000 7fe3dfb2c640 1 --2- 172.21.15.19:0/519784291 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe3c40a32f0 0x7fe3c40a57b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x5612b9f78d10 tx=0x7fe3d40118f0 comp rx=0 tx=0).stop 2024-09-19T08:58:36.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:36.783+0000 7fe3dfb2c640 1 -- 172.21.15.19:0/519784291 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3d8107820 msgr2=0x7fe3d819f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:36.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:36.783+0000 7fe3dfb2c640 1 --2- 172.21.15.19:0/519784291 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3d8107820 0x7fe3d819f3d0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fe3d000eb40 tx=0x7fe3d000c2d0 comp rx=0 tx=0).stop 2024-09-19T08:58:36.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:36.783+0000 7fe3dfb2c640 1 -- 172.21.15.19:0/519784291 shutdown_connections 2024-09-19T08:58:36.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:36.783+0000 7fe3dfb2c640 1 --2- 172.21.15.19:0/519784291 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe3c40a32f0 0x7fe3c40a57b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:36.783+0000 7fe3dfb2c640 1 --2- 172.21.15.19:0/519784291 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe3d8107820 0x7fe3d819f3d0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:36.783+0000 7fe3dfb2c640 1 --2- 172.21.15.19:0/519784291 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe3d8104ef0 0x7fe3d8198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:36.783+0000 7fe3dfb2c640 1 --2- 172.21.15.19:0/519784291 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3d81025c0 0x7fe3d8197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:36.783+0000 7fe3dfb2c640 1 -- 172.21.15.19:0/519784291 >> 172.21.15.19:0/519784291 conn(0x7fe3d80fc1e0 msgr2=0x7fe3d8102f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:36.783+0000 7fe3dfb2c640 1 -- 172.21.15.19:0/519784291 shutdown_connections 2024-09-19T08:58:36.786 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:36.783+0000 7fe3dfb2c640 1 -- 172.21.15.19:0/519784291 wait complete. 2024-09-19T08:58:37.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:37 smithi155 ceph-mon[34921]: pgmap v529: 97 pgs: 97 active+clean; 16 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 1.91k op/s 2024-09-19T08:58:37.923 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:58:37 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-e[65222]: *** Caught signal (Segmentation fault) ** 2024-09-19T08:58:37.923 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:58:37 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-e[65222]: in thread 7ff407c14640 thread_name:MR_Finisher 2024-09-19T08:58:37.923 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:58:37 smithi155 podman[68576]: 2024-09-19 08:58:37.728354725 +0000 UTC m=+0.022256591 container died 2b5274a37fe54b288ae13a5388b1509a265ba25574bc43693f95caa7a1b2782e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:58:37.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:37 smithi203 ceph-mon[35450]: pgmap v529: 97 pgs: 97 active+clean; 16 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 1.91k op/s 2024-09-19T08:58:38.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:37 smithi019 ceph-mon[30976]: pgmap v529: 97 pgs: 97 active+clean; 16 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.8 MiB/s wr, 1.91k op/s 2024-09-19T08:58:39.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:39 smithi155 ceph-mon[34921]: pgmap v530: 97 pgs: 97 active+clean; 8.3 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 1.88k op/s 2024-09-19T08:58:39.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:39 smithi203 ceph-mon[35450]: pgmap v530: 97 pgs: 97 active+clean; 8.3 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 1.88k op/s 2024-09-19T08:58:40.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:39 smithi019 ceph-mon[30976]: pgmap v530: 97 pgs: 97 active+clean; 8.3 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 1.88k op/s 2024-09-19T08:58:41.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:41 smithi155 ceph-mon[34921]: pgmap v531: 97 pgs: 97 active+clean; 4.3 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 1.7 MiB/s wr, 1.36k op/s 2024-09-19T08:58:41.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:41 smithi203 ceph-mon[35450]: pgmap v531: 97 pgs: 97 active+clean; 4.3 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 1.7 MiB/s wr, 1.36k op/s 2024-09-19T08:58:42.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:41 smithi019 ceph-mon[30976]: pgmap v531: 97 pgs: 97 active+clean; 4.3 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 938 KiB/s rd, 1.7 MiB/s wr, 1.36k op/s 2024-09-19T08:58:43.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:43 smithi155 ceph-mon[34921]: pgmap v532: 97 pgs: 97 active+clean; 9.3 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 1.38k op/s 2024-09-19T08:58:43.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:43 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:43.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:43 smithi203 ceph-mon[35450]: pgmap v532: 97 pgs: 97 active+clean; 9.3 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 1.38k op/s 2024-09-19T08:58:43.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:43 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:44.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:43 smithi019 ceph-mon[30976]: pgmap v532: 97 pgs: 97 active+clean; 9.3 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.0 MiB/s wr, 1.38k op/s 2024-09-19T08:58:44.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:43 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:58:44.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:44 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:44.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:44 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:44.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:44 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:44.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:44 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:44.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:44 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:44.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:44 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:44.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:44 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:58:44.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:44 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:44.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:44 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:44.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:44 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:44.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:44 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:44.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:44 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:44.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:44 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:44.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:44 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:58:45.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:44 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:45.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:44 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:45.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:44 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:45.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:44 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:58:45.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:44 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:58:45.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:44 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:58:45.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:44 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:58:45.758 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:45 smithi155 ceph-mon[34921]: Adjusting osd_memory_target on smithi019 to 177.0M 2024-09-19T08:58:45.758 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:45 smithi155 ceph-mon[34921]: Unable to set osd_memory_target on smithi019 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-19T08:58:45.758 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:45 smithi155 ceph-mon[34921]: pgmap v533: 97 pgs: 97 active+clean; 13 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 1.38k op/s 2024-09-19T08:58:45.758 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:58:45 smithi155 podman[68576]: 2024-09-19 08:58:45.466035893 +0000 UTC m=+7.759937758 container remove 2b5274a37fe54b288ae13a5388b1509a265ba25574bc43693f95caa7a1b2782e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-e, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-19T08:58:45.759 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:58:45 smithi155 systemd[1]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.e.service: Main process exited, code=exited, status=139/n/a 2024-09-19T08:58:45.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:45 smithi203 ceph-mon[35450]: Adjusting osd_memory_target on smithi019 to 177.0M 2024-09-19T08:58:45.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:45 smithi203 ceph-mon[35450]: Unable to set osd_memory_target on smithi019 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-19T08:58:45.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:45 smithi203 ceph-mon[35450]: pgmap v533: 97 pgs: 97 active+clean; 13 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 1.38k op/s 2024-09-19T08:58:46.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:45 smithi019 ceph-mon[30976]: Adjusting osd_memory_target on smithi019 to 177.0M 2024-09-19T08:58:46.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:45 smithi019 ceph-mon[30976]: Unable to set osd_memory_target on smithi019 to 185688473: error parsing value: Value '185688473' is below minimum 939524096 2024-09-19T08:58:46.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:45 smithi019 ceph-mon[30976]: pgmap v533: 97 pgs: 97 active+clean; 13 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 1.38k op/s 2024-09-19T08:58:46.172 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:58:45 smithi155 systemd[1]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.e.service: Failed with result 'exit-code'. 2024-09-19T08:58:46.172 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:58:45 smithi155 systemd[1]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.e.service: Consumed 15.716s CPU time. 2024-09-19T08:58:47.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:47 smithi155 ceph-mon[34921]: pgmap v534: 97 pgs: 97 active+clean; 17 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 2.0 MiB/s wr, 1.34k op/s 2024-09-19T08:58:47.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:47 smithi203 ceph-mon[35450]: pgmap v534: 97 pgs: 97 active+clean; 17 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 2.0 MiB/s wr, 1.34k op/s 2024-09-19T08:58:48.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:47 smithi019 ceph-mon[30976]: pgmap v534: 97 pgs: 97 active+clean; 17 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 527 KiB/s rd, 2.0 MiB/s wr, 1.34k op/s 2024-09-19T08:58:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.875+0000 7f7a7c8c9640 1 -- 172.21.15.19:0/2701987922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a78107820 msgr2=0x7f7a78109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.875+0000 7f7a7c8c9640 1 --2- 172.21.15.19:0/2701987922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a78107820 0x7f7a78109c90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7a70009ca0 tx=0x7f7a7002a8c0 comp rx=0 tx=0).stop 2024-09-19T08:58:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.875+0000 7f7a7c8c9640 1 -- 172.21.15.19:0/2701987922 shutdown_connections 2024-09-19T08:58:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.875+0000 7f7a7c8c9640 1 --2- 172.21.15.19:0/2701987922 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a78104ef0 0x7f7a781072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.875+0000 7f7a7c8c9640 1 --2- 172.21.15.19:0/2701987922 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a78107820 0x7f7a78109c90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.875+0000 7f7a7c8c9640 1 --2- 172.21.15.19:0/2701987922 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a781025c0 0x7f7a781049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.875+0000 7f7a7c8c9640 1 -- 172.21.15.19:0/2701987922 >> 172.21.15.19:0/2701987922 conn(0x7f7a780fc1e0 msgr2=0x7f7a780fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.875+0000 7f7a7c8c9640 1 -- 172.21.15.19:0/2701987922 shutdown_connections 2024-09-19T08:58:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.875+0000 7f7a7c8c9640 1 -- 172.21.15.19:0/2701987922 wait complete. 2024-09-19T08:58:49.878 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.876+0000 7f7a7c8c9640 1 Processor -- start 2024-09-19T08:58:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.876+0000 7f7a7c8c9640 1 -- start start 2024-09-19T08:58:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.876+0000 7f7a7c8c9640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a781025c0 0x7f7a78101f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.876+0000 7f7a7c8c9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a78104ef0 0x7f7a78100570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.876+0000 7f7a7c8c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a78107820 0x7f7a78100ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.876+0000 7f7a7c8c9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7810d800 con 0x7f7a78107820 2024-09-19T08:58:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.876+0000 7f7a7c8c9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7810d680 con 0x7f7a78104ef0 2024-09-19T08:58:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.876+0000 7f7a7c8c9640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7a7810d980 con 0x7f7a781025c0 2024-09-19T08:58:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.876+0000 7f7a76d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a78107820 0x7f7a78100ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.876+0000 7f7a75d9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a78104ef0 0x7f7a78100570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.876+0000 7f7a76d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a78107820 0x7f7a78100ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46528/0 (socket says 172.21.15.19:46528) 2024-09-19T08:58:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.876+0000 7f7a76d9d640 1 -- 172.21.15.19:0/2368851296 learned_addr learned my addr 172.21.15.19:0/2368851296 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.876+0000 7f7a7659c640 1 --2- 172.21.15.19:0/2368851296 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a781025c0 0x7f7a78101f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:49.879 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.876+0000 7f7a76d9d640 1 -- 172.21.15.19:0/2368851296 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a781025c0 msgr2=0x7f7a78101f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.876+0000 7f7a76d9d640 1 --2- 172.21.15.19:0/2368851296 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a781025c0 0x7f7a78101f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.876+0000 7f7a76d9d640 1 -- 172.21.15.19:0/2368851296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a78104ef0 msgr2=0x7f7a78100570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.876+0000 7f7a76d9d640 1 --2- 172.21.15.19:0/2368851296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a78104ef0 0x7f7a78100570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.876+0000 7f7a76d9d640 1 -- 172.21.15.19:0/2368851296 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a78101340 con 0x7f7a78107820 2024-09-19T08:58:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.876+0000 7f7a75d9b640 1 --2- 172.21.15.19:0/2368851296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a78104ef0 0x7f7a78100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:58:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.877+0000 7f7a76d9d640 1 --2- 172.21.15.19:0/2368851296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a78107820 0x7f7a78100ab0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f7a7002f540 tx=0x7f7a70031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.877+0000 7f7a677fe640 1 -- 172.21.15.19:0/2368851296 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a70003c30 con 0x7f7a78107820 2024-09-19T08:58:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.877+0000 7f7a677fe640 1 -- 172.21.15.19:0/2368851296 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a70003dd0 con 0x7f7a78107820 2024-09-19T08:58:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.877+0000 7f7a677fe640 1 -- 172.21.15.19:0/2368851296 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7002fd90 con 0x7f7a78107820 2024-09-19T08:58:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.877+0000 7f7a7c8c9640 1 -- 172.21.15.19:0/2368851296 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a781a1fa0 con 0x7f7a78107820 2024-09-19T08:58:49.880 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.877+0000 7f7a7c8c9640 1 -- 172.21.15.19:0/2368851296 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a781a23b0 con 0x7f7a78107820 2024-09-19T08:58:49.886 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.879+0000 7f7a677fe640 1 -- 172.21.15.19:0/2368851296 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f7a70004050 con 0x7f7a78107820 2024-09-19T08:58:49.887 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.879+0000 7f7a7f662740 1 Processor -- start 2024-09-19T08:58:49.887 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.880+0000 7f7a7f662740 1 -- start start 2024-09-19T08:58:49.887 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.880+0000 7f7a7f662740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565212d1e9a0 0x565212d1eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:49.887 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.880+0000 7f7a7f662740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565212d1f2e0 0x565212d23da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:49.888 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.880+0000 7f7a7f662740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565212d24370 0x565212d26830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:49.888 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.880+0000 7f7a7f662740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x565212c822f0 con 0x565212d1f2e0 2024-09-19T08:58:49.888 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.880+0000 7f7a7f662740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x565212c2a270 con 0x565212d1e9a0 2024-09-19T08:58:49.888 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.880+0000 7f7a7f662740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x565212c7e2b0 con 0x565212d24370 2024-09-19T08:58:49.888 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.880+0000 7f7a7659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565212d1f2e0 0x565212d23da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:49.888 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.880+0000 7f7a75d9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565212d1e9a0 0x565212d1eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:49.888 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.880+0000 7f7a75d9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565212d1e9a0 0x565212d1eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:46902/0 (socket says 172.21.15.19:46902) 2024-09-19T08:58:49.888 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.880+0000 7f7a75d9b640 1 -- 172.21.15.19:0/3375471148 learned_addr learned my addr 172.21.15.19:0/3375471148 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:49.888 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.880+0000 7f7a677fe640 1 --2- 172.21.15.19:0/2368851296 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7a600a32f0 0x7f7a600a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:49.888 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.880+0000 7f7a75d9b640 1 --2- 172.21.15.19:0/3375471148 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565212d24370 0x565212d26830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:49.889 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.880+0000 7f7a75d9b640 1 -- 172.21.15.19:0/3375471148 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565212d24370 msgr2=0x565212d26830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:49.889 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.880+0000 7f7a75d9b640 1 --2- 172.21.15.19:0/3375471148 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565212d24370 0x565212d26830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:49.889 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.880+0000 7f7a75d9b640 1 -- 172.21.15.19:0/3375471148 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565212d1f2e0 msgr2=0x565212d23da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:49.889 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.880+0000 7f7a75d9b640 1 --2- 172.21.15.19:0/3375471148 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565212d1f2e0 0x565212d23da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:49.889 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.880+0000 7f7a75d9b640 1 -- 172.21.15.19:0/3375471148 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565212c29340 con 0x565212d1e9a0 2024-09-19T08:58:49.889 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.880+0000 7f7a76d9d640 1 --2- 172.21.15.19:0/2368851296 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7a600a32f0 0x7f7a600a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:49.889 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.881+0000 7f7a677fe640 1 -- 172.21.15.19:0/2368851296 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7a700f0990 con 0x7f7a78107820 2024-09-19T08:58:49.889 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.881+0000 7f7a75d9b640 1 --2- 172.21.15.19:0/3375471148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565212d1e9a0 0x565212d1eda0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c0128f0 tx=0x7f7a6c00bc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5b5cc84ce389926 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:49.889 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.881+0000 7f7a64ff9640 1 -- 172.21.15.19:0/3375471148 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c004030 con 0x565212d1e9a0 2024-09-19T08:58:49.889 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.881+0000 7f7a76d9d640 1 --2- 172.21.15.19:0/2368851296 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7a600a32f0 0x7f7a600a57b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7a700bcf50 tx=0x7f7a7008bd00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.881+0000 7f7a64ff9640 1 -- 172.21.15.19:0/3375471148 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a6c00edb0 con 0x565212d1e9a0 2024-09-19T08:58:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.881+0000 7f7a64ff9640 1 -- 172.21.15.19:0/3375471148 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c0055c0 con 0x565212d1e9a0 2024-09-19T08:58:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.882+0000 7f7a7f662740 1 -- 172.21.15.19:0/3375471148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565212d1e9a0 msgr2=0x565212d1eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.882+0000 7f7a7f662740 1 --2- 172.21.15.19:0/3375471148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565212d1e9a0 0x565212d1eda0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c0128f0 tx=0x7f7a6c00bc20 comp rx=0 tx=0).stop 2024-09-19T08:58:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.882+0000 7f7a7f662740 1 -- 172.21.15.19:0/3375471148 shutdown_connections 2024-09-19T08:58:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.882+0000 7f7a7f662740 1 --2- 172.21.15.19:0/3375471148 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565212d24370 0x565212d26830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.882+0000 7f7a7f662740 1 --2- 172.21.15.19:0/3375471148 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565212d1f2e0 0x565212d23da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.882+0000 7f7a7f662740 1 --2- 172.21.15.19:0/3375471148 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565212d1e9a0 0x565212d1eda0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.882+0000 7f7a7f662740 1 -- 172.21.15.19:0/3375471148 >> 172.21.15.19:0/3375471148 conn(0x565212d1a010 msgr2=0x565212d1a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:49.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.882+0000 7f7a7f662740 1 -- 172.21.15.19:0/3375471148 shutdown_connections 2024-09-19T08:58:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.882+0000 7f7a7f662740 1 -- 172.21.15.19:0/3375471148 wait complete. 2024-09-19T08:58:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.882+0000 7f7a7f662740 1 -- start start 2024-09-19T08:58:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.882+0000 7f7a7f662740 1 Processor -- start 2024-09-19T08:58:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.882+0000 7f7a7f662740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565212d1e9a0 0x565212d28bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.883+0000 7f7a7f662740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565212d1f2e0 0x565212d29130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.883+0000 7f7a7f662740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565212d24370 0x565212d30170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.883+0000 7f7a7f662740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x565212d27340 con 0x565212d24370 2024-09-19T08:58:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.883+0000 7f7a7f662740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x565212c0b290 con 0x565212d1f2e0 2024-09-19T08:58:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.883+0000 7f7a7f662740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x565212d274c0 con 0x565212d1e9a0 2024-09-19T08:58:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.883+0000 7f7a7f662740 10 client.0 _ll_register_callbacks cb 0x565212c3c140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:49.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.883+0000 7f7a75d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565212d24370 0x565212d30170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.883+0000 7f7a7659c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565212d1f2e0 0x565212d29130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.883+0000 7f7a75d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565212d24370 0x565212d30170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46544/0 (socket says 172.21.15.19:46544) 2024-09-19T08:58:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.883+0000 7f7a75d9b640 1 -- 172.21.15.19:0/2839311394 learned_addr learned my addr 172.21.15.19:0/2839311394 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.883+0000 7f7a75d9b640 1 --2- 172.21.15.19:0/2839311394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565212d1e9a0 0x565212d28bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.883+0000 7f7a7659c640 1 -- 172.21.15.19:0/2839311394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565212d1e9a0 msgr2=0x565212d28bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.883+0000 7f7a7659c640 1 --2- 172.21.15.19:0/2839311394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565212d1e9a0 0x565212d28bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.883+0000 7f7a7659c640 1 -- 172.21.15.19:0/2839311394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565212d24370 msgr2=0x565212d30170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:49.892 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.883+0000 7f7a7659c640 1 --2- 172.21.15.19:0/2839311394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565212d24370 0x565212d30170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.883+0000 7f7a7659c640 1 -- 172.21.15.19:0/2839311394 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565212995210 con 0x565212d1f2e0 2024-09-19T08:58:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.883+0000 7f7a75d9b640 1 --2- 172.21.15.19:0/2839311394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565212d1e9a0 0x565212d28bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:58:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.883+0000 7f7a7659c640 1 --2- 172.21.15.19:0/2839311394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565212d1f2e0 0x565212d29130 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x565212d1fd10 tx=0x7f7a68012b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=379cf8b9e6a7d01c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.883+0000 7f7a5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T08:58:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.883+0000 7f7a5dffb640 1 -- 172.21.15.19:0/2839311394 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6800f8c0 con 0x565212d1f2e0 2024-09-19T08:58:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.883+0000 7f7a7f662740 1 -- 172.21.15.19:0/2839311394 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a6c00edb0 con 0x565212d1f2e0 2024-09-19T08:58:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.883+0000 7f7a5dffb640 1 -- 172.21.15.19:0/2839311394 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7a6800fa60 con 0x565212d1f2e0 2024-09-19T08:58:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.884+0000 7f7a5dffb640 1 -- 172.21.15.19:0/2839311394 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f7a6800fc60 con 0x565212d1f2e0 2024-09-19T08:58:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.884+0000 7f7a7f662740 10 client.26399 fetch_fsmap learned FSMap version 34 2024-09-19T08:58:49.893 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.884+0000 7f7a7f662740 1 -- 172.21.15.19:0/2839311394 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x565212a61620 con 0x565212d1f2e0 2024-09-19T08:58:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.884+0000 7f7a5dffb640 1 -- 172.21.15.19:0/2839311394 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a6c00edb0 con 0x565212d1f2e0 2024-09-19T08:58:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.884+0000 7f7a5dffb640 1 -- 172.21.15.19:0/2839311394 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7f7a6801c420 con 0x565212d1f2e0 2024-09-19T08:58:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.884+0000 7f7a7f662740 10 client.26399 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T08:58:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.884+0000 7f7a7f662740 10 client.26399 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:58:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.884+0000 7f7a7f662740 20 client.26399 populate_metadata read hostname 'smithi019' 2024-09-19T08:58:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.884+0000 7f7a7f662740 1 --2- 172.21.15.19:0/2839311394 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x565212d34910 0x565212d36d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.884+0000 7f7a7f662740 4 client.26399 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:58:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.884+0000 7f7a7f662740 1 -- 172.21.15.19:0/2839311394 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565212c8fa20 con 0x565212d34910 2024-09-19T08:58:49.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.884+0000 7f7a75d9b640 1 --2- 172.21.15.19:0/2839311394 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x565212d34910 0x565212d36d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:49.895 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.885+0000 7f7a75d9b640 1 --2- 172.21.15.19:0/2839311394 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x565212d34910 0x565212d36d20 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3185841fa36b219 server_cookie=ff539e74984584dc in_seq=0 out_seq=0 2024-09-19T08:58:49.895 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.885+0000 7f7a5dffb640 10 client.26399 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:49.896 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.888+0000 7f7a5dffb640 1 -- 172.21.15.19:0/2839311394 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x565212c8fa20 con 0x565212d34910 2024-09-19T08:58:49.896 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.888+0000 7f7a5dffb640 10 client.26399 handle_command_reply: tid=0 2024-09-19T08:58:49.896 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.888+0000 7f7a7f662740 1 client.26399 shutdown 2024-09-19T08:58:49.896 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.888+0000 7f7a7f662740 1 -- 172.21.15.19:0/2839311394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565212d1f2e0 msgr2=0x565212d29130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:49.896 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.888+0000 7f7a7f662740 1 --2- 172.21.15.19:0/2839311394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565212d1f2e0 0x565212d29130 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x565212d1fd10 tx=0x7f7a68012b60 comp rx=0 tx=0).stop 2024-09-19T08:58:49.896 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.888+0000 7f7a7f662740 1 -- 172.21.15.19:0/2839311394 shutdown_connections 2024-09-19T08:58:49.896 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.888+0000 7f7a7f662740 1 --2- 172.21.15.19:0/2839311394 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x565212d34910 0x565212d36d20 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:49.896 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.888+0000 7f7a7f662740 1 --2- 172.21.15.19:0/2839311394 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565212d24370 0x565212d30170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:49.896 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.888+0000 7f7a5dffb640 0 client.26399 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:49.896 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.888+0000 7f7a7f662740 1 --2- 172.21.15.19:0/2839311394 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565212d1f2e0 0x565212d29130 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:49.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.888+0000 7f7a7f662740 1 --2- 172.21.15.19:0/2839311394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565212d1e9a0 0x565212d28bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:49.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.888+0000 7f7a7f662740 1 -- 172.21.15.19:0/2839311394 >> 172.21.15.19:0/2839311394 conn(0x565212d1a010 msgr2=0x565212d1b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:49.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.888+0000 7f7a7f662740 1 -- 172.21.15.19:0/2839311394 shutdown_connections 2024-09-19T08:58:49.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.888+0000 7f7a7f662740 1 -- 172.21.15.19:0/2839311394 wait complete. 2024-09-19T08:58:49.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.889+0000 7f7a7f662740 20 client.26399 trim_cache size 0 max 16384 2024-09-19T08:58:49.908 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.903+0000 7f7a7f662740 1 Processor -- start 2024-09-19T08:58:49.908 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.903+0000 7f7a7f662740 1 -- start start 2024-09-19T08:58:49.909 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.903+0000 7f7a7f662740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565212d1e9a0 0x565212d1ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:49.909 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.903+0000 7f7a7f662740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565212d1f2e0 0x565212d30130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:49.909 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.903+0000 7f7a7f662740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565212d24370 0x565212d1aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:49.909 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.903+0000 7f7a7f662740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7a781ab260 con 0x565212d1e9a0 2024-09-19T08:58:49.909 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.903+0000 7f7a7f662740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7a781acda0 con 0x565212d1f2e0 2024-09-19T08:58:49.909 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.903+0000 7f7a7f662740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7a781ab930 con 0x565212d24370 2024-09-19T08:58:49.909 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.903+0000 7f7a7659c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565212d1f2e0 0x565212d30130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:49.909 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.903+0000 7f7a75d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565212d1e9a0 0x565212d1ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:49.909 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.903+0000 7f7a7659c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565212d1f2e0 0x565212d30130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:46910/0 (socket says 172.21.15.19:46910) 2024-09-19T08:58:49.909 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.903+0000 7f7a7659c640 1 -- 172.21.15.19:0/352591672 learned_addr learned my addr 172.21.15.19:0/352591672 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:49.909 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.904+0000 7f7a75d9b640 1 -- 172.21.15.19:0/352591672 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565212d24370 msgr2=0x565212d1aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:49.909 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.904+0000 7f7a75d9b640 1 --2- 172.21.15.19:0/352591672 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565212d24370 0x565212d1aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:49.910 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.904+0000 7f7a75d9b640 1 -- 172.21.15.19:0/352591672 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565212d1f2e0 msgr2=0x565212d30130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:49.910 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.904+0000 7f7a75d9b640 1 --2- 172.21.15.19:0/352591672 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565212d1f2e0 0x565212d30130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:49.910 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.904+0000 7f7a75d9b640 1 -- 172.21.15.19:0/352591672 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565212d1f7c0 con 0x565212d1e9a0 2024-09-19T08:58:49.910 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.904+0000 7f7a7659c640 1 --2- 172.21.15.19:0/352591672 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565212d1f2e0 0x565212d30130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:58:49.910 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.904+0000 7f7a75d9b640 1 --2- 172.21.15.19:0/352591672 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565212d1e9a0 0x565212d1ed80 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c012650 tx=0x7f7a6c012450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a140eb9ed561e3a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:49.910 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.904+0000 7f7a5ffff640 1 -- 172.21.15.19:0/352591672 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c005360 con 0x565212d1e9a0 2024-09-19T08:58:49.910 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.904+0000 7f7a5ffff640 1 -- 172.21.15.19:0/352591672 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a6c00edb0 con 0x565212d1e9a0 2024-09-19T08:58:49.910 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.904+0000 7f7a5ffff640 1 -- 172.21.15.19:0/352591672 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c003b50 con 0x565212d1e9a0 2024-09-19T08:58:49.910 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.905+0000 7f7a7f662740 1 -- 172.21.15.19:0/352591672 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565212d1e9a0 msgr2=0x565212d1ed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:49.910 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.905+0000 7f7a7f662740 1 --2- 172.21.15.19:0/352591672 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565212d1e9a0 0x565212d1ed80 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c012650 tx=0x7f7a6c012450 comp rx=0 tx=0).stop 2024-09-19T08:58:49.910 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.905+0000 7f7a7f662740 1 -- 172.21.15.19:0/352591672 shutdown_connections 2024-09-19T08:58:49.910 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.905+0000 7f7a7f662740 1 --2- 172.21.15.19:0/352591672 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565212d24370 0x565212d1aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:49.910 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.905+0000 7f7a7f662740 1 --2- 172.21.15.19:0/352591672 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565212d1f2e0 0x565212d30130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:49.911 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.905+0000 7f7a7f662740 1 --2- 172.21.15.19:0/352591672 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565212d1e9a0 0x565212d1ed80 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:49.911 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.905+0000 7f7a7f662740 1 -- 172.21.15.19:0/352591672 >> 172.21.15.19:0/352591672 conn(0x565212d1a010 msgr2=0x565212d204c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:49.911 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.905+0000 7f7a7f662740 1 -- 172.21.15.19:0/352591672 shutdown_connections 2024-09-19T08:58:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.905+0000 7f7a7f662740 1 -- 172.21.15.19:0/352591672 wait complete. 2024-09-19T08:58:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.905+0000 7f7a7f662740 1 -- start start 2024-09-19T08:58:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.905+0000 7f7a7f662740 1 Processor -- start 2024-09-19T08:58:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.905+0000 7f7a7f662740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565212d1e9a0 0x565212d2d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.905+0000 7f7a7f662740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565212d1f2e0 0x565212d2deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.905+0000 7f7a7f662740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565212d24370 0x565212d2ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.905+0000 7f7a7f662740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7a781ac6d0 con 0x565212d1f2e0 2024-09-19T08:58:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.905+0000 7f7a7f662740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7a781ac000 con 0x565212d1e9a0 2024-09-19T08:58:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.905+0000 7f7a7f662740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7a781a9240 con 0x565212d24370 2024-09-19T08:58:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.905+0000 7f7a7f662740 10 client.0 _ll_register_callbacks cb 0x7f7a68009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:49.912 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.905+0000 7f7a7659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565212d1f2e0 0x565212d2deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.905+0000 7f7a7659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565212d1f2e0 0x565212d2deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46564/0 (socket says 172.21.15.19:46564) 2024-09-19T08:58:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.905+0000 7f7a7659c640 1 -- 172.21.15.19:0/267141775 learned_addr learned my addr 172.21.15.19:0/267141775 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.906+0000 7f7a75d9b640 1 --2- 172.21.15.19:0/267141775 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565212d1e9a0 0x565212d2d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.906+0000 7f7a75d9b640 1 --2- 172.21.15.19:0/267141775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565212d24370 0x565212d2ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.906+0000 7f7a7659c640 1 -- 172.21.15.19:0/267141775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565212d24370 msgr2=0x565212d2ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.906+0000 7f7a7659c640 1 --2- 172.21.15.19:0/267141775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565212d24370 0x565212d2ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.906+0000 7f7a7659c640 1 -- 172.21.15.19:0/267141775 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565212d1e9a0 msgr2=0x565212d2d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.906+0000 7f7a7659c640 1 --2- 172.21.15.19:0/267141775 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565212d1e9a0 0x565212d2d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:49.913 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.906+0000 7f7a7659c640 1 -- 172.21.15.19:0/267141775 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565212d2f460 con 0x565212d1f2e0 2024-09-19T08:58:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.906+0000 7f7a7659c640 1 --2- 172.21.15.19:0/267141775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565212d1f2e0 0x565212d2deb0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f7a680059f0 tx=0x7f7a6800ff60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1078d9089a3a6a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.906+0000 7f7a5dffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:58:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.906+0000 7f7a5dffb640 1 -- 172.21.15.19:0/267141775 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6800f790 con 0x565212d1f2e0 2024-09-19T08:58:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.906+0000 7f7a5dffb640 1 -- 172.21.15.19:0/267141775 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7a68018040 con 0x565212d1f2e0 2024-09-19T08:58:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.906+0000 7f7a7f662740 1 -- 172.21.15.19:0/267141775 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a6c00edb0 con 0x565212d1f2e0 2024-09-19T08:58:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.906+0000 7f7a5dffb640 1 -- 172.21.15.19:0/267141775 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f7a6800f930 con 0x565212d1f2e0 2024-09-19T08:58:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.906+0000 7f7a7f662740 10 client.16926 fetch_fsmap learned FSMap version 34 2024-09-19T08:58:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.906+0000 7f7a7f662740 1 -- 172.21.15.19:0/267141775 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x565212d9f600 con 0x565212d1f2e0 2024-09-19T08:58:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.907+0000 7f7a5dffb640 1 -- 172.21.15.19:0/267141775 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7a6c00edb0 con 0x565212d1f2e0 2024-09-19T08:58:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.907+0000 7f7a5dffb640 1 -- 172.21.15.19:0/267141775 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 34) ==== 8362+0+0 (secure 0 0 0) 0x7f7a68003a70 con 0x565212d1f2e0 2024-09-19T08:58:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.907+0000 7f7a7f662740 10 client.16926 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T08:58:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.907+0000 7f7a7f662740 10 client.16926 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:58:49.914 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.907+0000 7f7a7f662740 20 client.16926 populate_metadata read hostname 'smithi019' 2024-09-19T08:58:49.915 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.907+0000 7f7a7f662740 1 --2- 172.21.15.19:0/267141775 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x565212d34910 0x565212da2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:49.915 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.907+0000 7f7a7f662740 4 client.16926 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:58:49.915 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.907+0000 7f7a7f662740 1 -- 172.21.15.19:0/267141775 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x565212d240f0 con 0x565212d34910 2024-09-19T08:58:49.915 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.907+0000 7f7a75d9b640 1 --2- 172.21.15.19:0/267141775 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x565212d34910 0x565212da2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:49.915 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.907+0000 7f7a75d9b640 1 --2- 172.21.15.19:0/267141775 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x565212d34910 0x565212da2010 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cf642cf63647b9 server_cookie=56da3d06c85198b6 in_seq=0 out_seq=0 2024-09-19T08:58:49.915 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:49.907+0000 7f7a5dffb640 10 client.16926 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:49.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:49 smithi203 ceph-mon[35450]: pgmap v535: 97 pgs: 97 active+clean; 21 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 1.8 MiB/s wr, 889 op/s 2024-09-19T08:58:50.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:49 smithi019 ceph-mon[30976]: pgmap v535: 97 pgs: 97 active+clean; 21 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 1.8 MiB/s wr, 889 op/s 2024-09-19T08:58:50.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:49 smithi155 ceph-mon[34921]: pgmap v535: 97 pgs: 97 active+clean; 21 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 1.8 MiB/s wr, 889 op/s 2024-09-19T08:58:50.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:50 smithi203 ceph-mon[35450]: MDS daemon mds.e is removed because it is dead or otherwise unavailable. 2024-09-19T08:58:50.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:50 smithi203 ceph-mon[35450]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2024-09-19T08:58:51.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:50 smithi019 ceph-mon[30976]: MDS daemon mds.e is removed because it is dead or otherwise unavailable. 2024-09-19T08:58:51.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:50 smithi019 ceph-mon[30976]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2024-09-19T08:58:51.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:50 smithi155 ceph-mon[34921]: MDS daemon mds.e is removed because it is dead or otherwise unavailable. 2024-09-19T08:58:51.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:50 smithi155 ceph-mon[34921]: fsmap cephfs:5 5 up:standby-replay 1 up:standby 5 up:active 2024-09-19T08:58:51.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:51 smithi203 ceph-mon[35450]: pgmap v536: 97 pgs: 97 active+clean; 23 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 1.8 MiB/s wr, 210 op/s 2024-09-19T08:58:52.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:51 smithi019 ceph-mon[30976]: pgmap v536: 97 pgs: 97 active+clean; 23 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 1.8 MiB/s wr, 210 op/s 2024-09-19T08:58:52.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:51 smithi155 ceph-mon[34921]: pgmap v536: 97 pgs: 97 active+clean; 23 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 1.8 MiB/s wr, 210 op/s 2024-09-19T08:58:53.374 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:58:53.640 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:58:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:53.791+0000 7f7a5dffb640 1 -- 172.21.15.19:0/267141775 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x565212d240f0 con 0x565212d34910 2024-09-19T08:58:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:53.791+0000 7f7a5dffb640 10 client.16926 handle_command_reply: tid=0 2024-09-19T08:58:53.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:53.791+0000 7f7a7f662740 1 client.16926 shutdown 2024-09-19T08:58:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:53.792+0000 7f7a7f662740 1 -- 172.21.15.19:0/267141775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565212d1f2e0 msgr2=0x565212d2deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:53.792+0000 7f7a7f662740 1 --2- 172.21.15.19:0/267141775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565212d1f2e0 0x565212d2deb0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f7a680059f0 tx=0x7f7a6800ff60 comp rx=0 tx=0).stop 2024-09-19T08:58:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:53.792+0000 7f7a7f662740 1 -- 172.21.15.19:0/267141775 shutdown_connections 2024-09-19T08:58:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:53.792+0000 7f7a7f662740 1 --2- 172.21.15.19:0/267141775 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x565212d34910 0x565212da2010 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:53.792+0000 7f7a7f662740 1 --2- 172.21.15.19:0/267141775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565212d24370 0x565212d2ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:53.792+0000 7f7a7f662740 1 --2- 172.21.15.19:0/267141775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565212d1f2e0 0x565212d2deb0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:53.792+0000 7f7a7f662740 1 --2- 172.21.15.19:0/267141775 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565212d1e9a0 0x565212d2d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:53.792+0000 7f7a7f662740 1 -- 172.21.15.19:0/267141775 >> 172.21.15.19:0/267141775 conn(0x565212d1a010 msgr2=0x565212d189a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:53.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:53.792+0000 7f7a5dffb640 0 client.16926 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:53.793+0000 7f7a7f662740 1 -- 172.21.15.19:0/267141775 shutdown_connections 2024-09-19T08:58:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:53.793+0000 7f7a7f662740 1 -- 172.21.15.19:0/267141775 wait complete. 2024-09-19T08:58:53.794 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:53.794+0000 7f7a7f662740 20 client.16926 trim_cache size 0 max 16384 2024-09-19T08:58:53.795 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T08:58:53.795 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T08:58:53.795 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T08:58:53.795 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T08:58:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:53.795+0000 7f7a7c8c9640 1 -- 172.21.15.19:0/2368851296 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7a600a32f0 msgr2=0x7f7a600a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:53.795+0000 7f7a7c8c9640 1 --2- 172.21.15.19:0/2368851296 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7a600a32f0 0x7f7a600a57b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7a700bcf50 tx=0x7f7a7008bd00 comp rx=0 tx=0).stop 2024-09-19T08:58:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:53.795+0000 7f7a7c8c9640 1 -- 172.21.15.19:0/2368851296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a78107820 msgr2=0x7f7a78100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:53.795+0000 7f7a7c8c9640 1 --2- 172.21.15.19:0/2368851296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a78107820 0x7f7a78100ab0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f7a7002f540 tx=0x7f7a70031ee0 comp rx=0 tx=0).stop 2024-09-19T08:58:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:53.795+0000 7f7a7c8c9640 1 -- 172.21.15.19:0/2368851296 shutdown_connections 2024-09-19T08:58:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:53.795+0000 7f7a7c8c9640 1 --2- 172.21.15.19:0/2368851296 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7a600a32f0 0x7f7a600a57b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:53.795+0000 7f7a7c8c9640 1 --2- 172.21.15.19:0/2368851296 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7a78107820 0x7f7a78100ab0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:53.795+0000 7f7a7c8c9640 1 --2- 172.21.15.19:0/2368851296 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7a78104ef0 0x7f7a78100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:53.797 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:53.795+0000 7f7a7c8c9640 1 --2- 172.21.15.19:0/2368851296 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a781025c0 0x7f7a78101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:53.797 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:53.795+0000 7f7a7c8c9640 1 -- 172.21.15.19:0/2368851296 >> 172.21.15.19:0/2368851296 conn(0x7f7a780fc1e0 msgr2=0x7f7a78102f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:53.797 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:53.795+0000 7f7a7c8c9640 1 -- 172.21.15.19:0/2368851296 shutdown_connections 2024-09-19T08:58:53.797 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:58:53.795+0000 7f7a7c8c9640 1 -- 172.21.15.19:0/2368851296 wait complete. 2024-09-19T08:58:53.942 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:53 smithi019 ceph-mon[30976]: pgmap v537: 97 pgs: 97 active+clean; 25 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 111 op/s 2024-09-19T08:58:53.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:53 smithi203 ceph-mon[35450]: pgmap v537: 97 pgs: 97 active+clean; 25 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 111 op/s 2024-09-19T08:58:54.031 INFO:tasks.workunit.client.0.smithi019.stdout:created hierarchy, now cleaning up 2024-09-19T08:58:54.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.158+0000 7f2d1137d640 1 -- 172.21.15.19:0/3529934316 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d0c10e4f0 msgr2=0x7f2d0c110900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:54.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.158+0000 7f2d1137d640 1 --2- 172.21.15.19:0/3529934316 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d0c10e4f0 0x7f2d0c110900 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f2d04009900 tx=0x7f2d0402a410 comp rx=0 tx=0).stop 2024-09-19T08:58:54.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.158+0000 7f2d1137d640 1 -- 172.21.15.19:0/3529934316 shutdown_connections 2024-09-19T08:58:54.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.158+0000 7f2d1137d640 1 --2- 172.21.15.19:0/3529934316 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d0c101380 0x7f2d0c10dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.158+0000 7f2d1137d640 1 --2- 172.21.15.19:0/3529934316 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d0c10e4f0 0x7f2d0c110900 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.158+0000 7f2d1137d640 1 --2- 172.21.15.19:0/3529934316 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d0c1009d0 0x7f2d0c100db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.158+0000 7f2d1137d640 1 -- 172.21.15.19:0/3529934316 >> 172.21.15.19:0/3529934316 conn(0x7f2d0c0fc7d0 msgr2=0x7f2d0c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:54.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.158+0000 7f2d1137d640 1 -- 172.21.15.19:0/3529934316 shutdown_connections 2024-09-19T08:58:54.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.158+0000 7f2d1137d640 1 -- 172.21.15.19:0/3529934316 wait complete. 2024-09-19T08:58:54.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.159+0000 7f2d1137d640 1 Processor -- start 2024-09-19T08:58:54.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.159+0000 7f2d1137d640 1 -- start start 2024-09-19T08:58:54.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.159+0000 7f2d1137d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d0c1009d0 0x7f2d0c19a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:54.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.159+0000 7f2d1137d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d0c101380 0x7f2d0c19ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:54.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.159+0000 7f2d1137d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d0c10e4f0 0x7f2d0c19f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:54.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.159+0000 7f2d1137d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0c114280 con 0x7f2d0c10e4f0 2024-09-19T08:58:54.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.159+0000 7f2d1137d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0c114100 con 0x7f2d0c101380 2024-09-19T08:58:54.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.159+0000 7f2d1137d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0c114400 con 0x7f2d0c1009d0 2024-09-19T08:58:54.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.159+0000 7f2d0b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d0c10e4f0 0x7f2d0c19f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:54.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.159+0000 7f2d0a7fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d0c101380 0x7f2d0c19ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:54.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.159+0000 7f2d0affd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d0c1009d0 0x7f2d0c19a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:54.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.159+0000 7f2d0b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d0c10e4f0 0x7f2d0c19f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46578/0 (socket says 172.21.15.19:46578) 2024-09-19T08:58:54.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.159+0000 7f2d0b7fe640 1 -- 172.21.15.19:0/2364852744 learned_addr learned my addr 172.21.15.19:0/2364852744 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:54.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.160+0000 7f2d0b7fe640 1 -- 172.21.15.19:0/2364852744 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d0c1009d0 msgr2=0x7f2d0c19a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:54.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.160+0000 7f2d0b7fe640 1 --2- 172.21.15.19:0/2364852744 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d0c1009d0 0x7f2d0c19a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.160+0000 7f2d0b7fe640 1 -- 172.21.15.19:0/2364852744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d0c101380 msgr2=0x7f2d0c19ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:54.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.160+0000 7f2d0b7fe640 1 --2- 172.21.15.19:0/2364852744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d0c101380 0x7f2d0c19ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.160+0000 7f2d0b7fe640 1 -- 172.21.15.19:0/2364852744 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d0c19f6f0 con 0x7f2d0c10e4f0 2024-09-19T08:58:54.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.160+0000 7f2d0affd640 1 --2- 172.21.15.19:0/2364852744 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d0c1009d0 0x7f2d0c19a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:58:54.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.160+0000 7f2d0b7fe640 1 --2- 172.21.15.19:0/2364852744 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d0c10e4f0 0x7f2d0c19f010 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f2d04004770 tx=0x7f2d04003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:54.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.160+0000 7f2d03fff640 1 -- 172.21.15.19:0/2364852744 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0403f070 con 0x7f2d0c10e4f0 2024-09-19T08:58:54.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.160+0000 7f2d1137d640 1 -- 172.21.15.19:0/2364852744 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d0c19f980 con 0x7f2d0c10e4f0 2024-09-19T08:58:54.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.160+0000 7f2d03fff640 1 -- 172.21.15.19:0/2364852744 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2d04031c90 con 0x7f2d0c10e4f0 2024-09-19T08:58:54.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.160+0000 7f2d03fff640 1 -- 172.21.15.19:0/2364852744 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d04035030 con 0x7f2d0c10e4f0 2024-09-19T08:58:54.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.160+0000 7f2d1137d640 1 -- 172.21.15.19:0/2364852744 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d0c1a72c0 con 0x7f2d0c10e4f0 2024-09-19T08:58:54.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.164+0000 7f2d03fff640 1 -- 172.21.15.19:0/2364852744 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f2d04042070 con 0x7f2d0c10e4f0 2024-09-19T08:58:54.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.164+0000 7f2d13756740 1 Processor -- start 2024-09-19T08:58:54.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.164+0000 7f2d13756740 1 -- start start 2024-09-19T08:58:54.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.164+0000 7f2d13756740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56079ec544a0 0x56079ec54880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:54.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.164+0000 7f2d13756740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56079ec54dc0 0x56079ec5f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:54.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.164+0000 7f2d13756740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56079ec5f680 0x56079ec61a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:54.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.164+0000 7f2d13756740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56079ebba2e0 con 0x56079ec54dc0 2024-09-19T08:58:54.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.164+0000 7f2d13756740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56079eb61ce0 con 0x56079ec544a0 2024-09-19T08:58:54.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.164+0000 7f2d13756740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56079ebb62a0 con 0x56079ec5f680 2024-09-19T08:58:54.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.164+0000 7f2d0affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56079ec54dc0 0x56079ec5f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:54.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.164+0000 7f2d0affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56079ec54dc0 0x56079ec5f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46580/0 (socket says 172.21.15.19:46580) 2024-09-19T08:58:54.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.164+0000 7f2d0affd640 1 -- 172.21.15.19:0/3797304173 learned_addr learned my addr 172.21.15.19:0/3797304173 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:54.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.164+0000 7f2d0a7fc640 1 --2- 172.21.15.19:0/3797304173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56079ec544a0 0x56079ec54880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:54.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.164+0000 7f2d0a7fc640 1 --2- 172.21.15.19:0/3797304173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56079ec5f680 0x56079ec61a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:54.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.165+0000 7f2d0affd640 1 -- 172.21.15.19:0/3797304173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56079ec5f680 msgr2=0x56079ec61a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:54.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.165+0000 7f2d0affd640 1 --2- 172.21.15.19:0/3797304173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56079ec5f680 0x56079ec61a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.165+0000 7f2d0affd640 1 -- 172.21.15.19:0/3797304173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56079ec544a0 msgr2=0x56079ec54880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:54.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.165+0000 7f2d0affd640 1 --2- 172.21.15.19:0/3797304173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56079ec544a0 0x56079ec54880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.165+0000 7f2d0affd640 1 -- 172.21.15.19:0/3797304173 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56079eb46440 con 0x56079ec54dc0 2024-09-19T08:58:54.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.165+0000 7f2d03fff640 1 --2- 172.21.15.19:0/2364852744 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2cf80a3240 0x7f2cf80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:54.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.165+0000 7f2d0a7fc640 1 --2- 172.21.15.19:0/2364852744 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2cf80a3240 0x7f2cf80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:54.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.165+0000 7f2d0affd640 1 --2- 172.21.15.19:0/3797304173 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56079ec54dc0 0x56079ec5f140 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc005f40 tx=0x7f2cfc011d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc3b98682843708 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:54.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.165+0000 7f2d03fff640 1 -- 172.21.15.19:0/2364852744 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2d040efea0 con 0x7f2d0c10e4f0 2024-09-19T08:58:54.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.165+0000 7f2d017fa640 1 -- 172.21.15.19:0/3797304173 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc011330 con 0x56079ec54dc0 2024-09-19T08:58:54.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.165+0000 7f2d017fa640 1 -- 172.21.15.19:0/3797304173 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cfc00fe00 con 0x56079ec54dc0 2024-09-19T08:58:54.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.165+0000 7f2d017fa640 1 -- 172.21.15.19:0/3797304173 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc0193e0 con 0x56079ec54dc0 2024-09-19T08:58:54.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.166+0000 7f2d13756740 1 -- 172.21.15.19:0/3797304173 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56079ec54dc0 msgr2=0x56079ec5f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:54.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.166+0000 7f2d0a7fc640 1 --2- 172.21.15.19:0/2364852744 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2cf80a3240 0x7f2cf80a5700 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x56079ec51db0 tx=0x7f2cf4004730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:54.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.166+0000 7f2d13756740 1 --2- 172.21.15.19:0/3797304173 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56079ec54dc0 0x56079ec5f140 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc005f40 tx=0x7f2cfc011d30 comp rx=0 tx=0).stop 2024-09-19T08:58:54.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.166+0000 7f2d13756740 1 -- 172.21.15.19:0/3797304173 shutdown_connections 2024-09-19T08:58:54.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.166+0000 7f2d13756740 1 --2- 172.21.15.19:0/3797304173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56079ec5f680 0x56079ec61a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.166+0000 7f2d13756740 1 --2- 172.21.15.19:0/3797304173 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56079ec54dc0 0x56079ec5f140 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.166+0000 7f2d13756740 1 --2- 172.21.15.19:0/3797304173 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56079ec544a0 0x56079ec54880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.166+0000 7f2d13756740 1 -- 172.21.15.19:0/3797304173 >> 172.21.15.19:0/3797304173 conn(0x56079ec50a30 msgr2=0x56079ec50e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:54.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.166+0000 7f2d13756740 1 -- 172.21.15.19:0/3797304173 shutdown_connections 2024-09-19T08:58:54.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.166+0000 7f2d13756740 1 -- 172.21.15.19:0/3797304173 wait complete. 2024-09-19T08:58:54.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.166+0000 7f2d13756740 1 -- start start 2024-09-19T08:58:54.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.167+0000 7f2d13756740 1 Processor -- start 2024-09-19T08:58:54.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.167+0000 7f2d13756740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56079ec544a0 0x56079ec5ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:54.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.167+0000 7f2d13756740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56079ec54dc0 0x56079ec5c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:54.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.167+0000 7f2d13756740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56079ec5f680 0x56079ec5c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:54.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.167+0000 7f2d13756740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56079ec62250 con 0x56079ec5f680 2024-09-19T08:58:54.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.167+0000 7f2d13756740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56079eb75050 con 0x56079ec54dc0 2024-09-19T08:58:54.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.167+0000 7f2d13756740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56079ec623d0 con 0x56079ec544a0 2024-09-19T08:58:54.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.167+0000 7f2d13756740 10 client.0 _ll_register_callbacks cb 0x56079ebb5160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:54.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.167+0000 7f2d0b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56079ec5f680 0x56079ec5c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:54.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.167+0000 7f2d0a7fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56079ec54dc0 0x56079ec5c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:54.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.167+0000 7f2d0b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56079ec5f680 0x56079ec5c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46596/0 (socket says 172.21.15.19:46596) 2024-09-19T08:58:54.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.167+0000 7f2d0b7fe640 1 -- 172.21.15.19:0/1671020083 learned_addr learned my addr 172.21.15.19:0/1671020083 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:54.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.167+0000 7f2d0affd640 1 --2- 172.21.15.19:0/1671020083 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56079ec544a0 0x56079ec5ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:54.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.167+0000 7f2d0b7fe640 1 -- 172.21.15.19:0/1671020083 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56079ec544a0 msgr2=0x56079ec5ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:54.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.167+0000 7f2d0b7fe640 1 --2- 172.21.15.19:0/1671020083 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56079ec544a0 0x56079ec5ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.167+0000 7f2d0b7fe640 1 -- 172.21.15.19:0/1671020083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56079ec54dc0 msgr2=0x56079ec5c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:54.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.167+0000 7f2d0b7fe640 1 --2- 172.21.15.19:0/1671020083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56079ec54dc0 0x56079ec5c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.167+0000 7f2d0b7fe640 1 -- 172.21.15.19:0/1671020083 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56079e92b3c0 con 0x56079ec5f680 2024-09-19T08:58:54.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.168+0000 7f2d0b7fe640 1 --2- 172.21.15.19:0/1671020083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56079ec5f680 0x56079ec5c6f0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f2d0402a9d0 tx=0x7f2d040bc200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc8a6cb155b6c03 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:54.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.168+0000 7f2cf27fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:58:54.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.168+0000 7f2cf27fc640 1 -- 172.21.15.19:0/1671020083 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d04049070 con 0x56079ec5f680 2024-09-19T08:58:54.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.168+0000 7f2cf27fc640 1 -- 172.21.15.19:0/1671020083 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2d0403b460 con 0x56079ec5f680 2024-09-19T08:58:54.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.168+0000 7f2d13756740 1 -- 172.21.15.19:0/1671020083 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2cfc00fe00 con 0x56079ec5f680 2024-09-19T08:58:54.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.168+0000 7f2cf27fc640 1 -- 172.21.15.19:0/1671020083 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f2d040c5200 con 0x56079ec5f680 2024-09-19T08:58:54.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.168+0000 7f2d13756740 10 client.16938 fetch_fsmap learned FSMap version 35 2024-09-19T08:58:54.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.168+0000 7f2d13756740 1 -- 172.21.15.19:0/1671020083 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56079ec6db60 con 0x56079ec5f680 2024-09-19T08:58:54.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.168+0000 7f2cf27fc640 1 -- 172.21.15.19:0/1671020083 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cfc00fe00 con 0x56079ec5f680 2024-09-19T08:58:54.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.168+0000 7f2cf27fc640 1 -- 172.21.15.19:0/1671020083 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 7757+0+0 (secure 0 0 0) 0x7f2d040c4d70 con 0x56079ec5f680 2024-09-19T08:58:54.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.168+0000 7f2d13756740 10 client.16938 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:58:54.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.168+0000 7f2d13756740 10 client.16938 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:58:54.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.168+0000 7f2d13756740 20 client.16938 populate_metadata read hostname 'smithi019' 2024-09-19T08:58:54.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.168+0000 7f2d13756740 1 --2- 172.21.15.19:0/1671020083 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56079ec6f010 0x56079ec714a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:54.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.168+0000 7f2d13756740 4 client.16938 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:58:54.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.168+0000 7f2d13756740 1 -- 172.21.15.19:0/1671020083 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56079ebc7850 con 0x56079ec6f010 2024-09-19T08:58:54.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.169+0000 7f2d0affd640 1 --2- 172.21.15.19:0/1671020083 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56079ec6f010 0x56079ec714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:54.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.169+0000 7f2d0affd640 1 --2- 172.21.15.19:0/1671020083 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56079ec6f010 0x56079ec714a0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a173a38ad83c4f5 server_cookie=430f17b19b7df931 in_seq=0 out_seq=0 2024-09-19T08:58:54.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.169+0000 7f2cf27fc640 10 client.16938 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:54.177 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:53 smithi155 ceph-mon[34921]: pgmap v537: 97 pgs: 97 active+clean; 25 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 111 op/s 2024-09-19T08:58:54.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.175+0000 7f2cf27fc640 1 -- 172.21.15.19:0/1671020083 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56079ebc7850 con 0x56079ec6f010 2024-09-19T08:58:54.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.175+0000 7f2cf27fc640 10 client.16938 handle_command_reply: tid=0 2024-09-19T08:58:54.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.175+0000 7f2d13756740 1 client.16938 shutdown 2024-09-19T08:58:54.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.175+0000 7f2d13756740 1 -- 172.21.15.19:0/1671020083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56079ec5f680 msgr2=0x56079ec5c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:54.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.175+0000 7f2d13756740 1 --2- 172.21.15.19:0/1671020083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56079ec5f680 0x56079ec5c6f0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f2d0402a9d0 tx=0x7f2d040bc200 comp rx=0 tx=0).stop 2024-09-19T08:58:54.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.175+0000 7f2d13756740 1 -- 172.21.15.19:0/1671020083 shutdown_connections 2024-09-19T08:58:54.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.175+0000 7f2d13756740 1 --2- 172.21.15.19:0/1671020083 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56079ec6f010 0x56079ec714a0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.175+0000 7f2d13756740 1 --2- 172.21.15.19:0/1671020083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56079ec5f680 0x56079ec5c6f0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.175+0000 7f2d13756740 1 --2- 172.21.15.19:0/1671020083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56079ec54dc0 0x56079ec5c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.175+0000 7f2d13756740 1 --2- 172.21.15.19:0/1671020083 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56079ec544a0 0x56079ec5ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.175+0000 7f2d13756740 1 -- 172.21.15.19:0/1671020083 >> 172.21.15.19:0/1671020083 conn(0x56079ec50a30 msgr2=0x56079ec56760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:54.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.175+0000 7f2cf27fc640 0 client.16938 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:54.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.175+0000 7f2d13756740 1 -- 172.21.15.19:0/1671020083 shutdown_connections 2024-09-19T08:58:54.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.175+0000 7f2d13756740 1 -- 172.21.15.19:0/1671020083 wait complete. 2024-09-19T08:58:54.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.175+0000 7f2d13756740 20 client.16938 trim_cache size 0 max 16384 2024-09-19T08:58:54.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.192+0000 7f2d13756740 1 Processor -- start 2024-09-19T08:58:54.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.192+0000 7f2d13756740 1 -- start start 2024-09-19T08:58:54.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.193+0000 7f2d13756740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56079ec544a0 0x56079ec5e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:54.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.193+0000 7f2d13756740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56079ec54dc0 0x56079ec76db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:54.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.193+0000 7f2d13756740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56079ec5f680 0x56079ec772f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:54.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.193+0000 7f2d13756740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0c1b10e0 con 0x56079ec54dc0 2024-09-19T08:58:54.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.193+0000 7f2d13756740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0c1aeed0 con 0x56079ec5f680 2024-09-19T08:58:54.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.193+0000 7f2d13756740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0c1b0a10 con 0x56079ec544a0 2024-09-19T08:58:54.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.193+0000 7f2d0a7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56079ec54dc0 0x56079ec76db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:54.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.193+0000 7f2d0affd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56079ec544a0 0x56079ec5e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:54.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.193+0000 7f2d0affd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56079ec544a0 0x56079ec5e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:47306/0 (socket says 172.21.15.19:47306) 2024-09-19T08:58:54.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.193+0000 7f2d0a7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56079ec54dc0 0x56079ec76db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46604/0 (socket says 172.21.15.19:46604) 2024-09-19T08:58:54.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.193+0000 7f2d0affd640 1 -- 172.21.15.19:0/3599084319 learned_addr learned my addr 172.21.15.19:0/3599084319 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:54.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.193+0000 7f2d0b7fe640 1 --2- 172.21.15.19:0/3599084319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56079ec5f680 0x56079ec772f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:54.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.193+0000 7f2d0affd640 1 -- 172.21.15.19:0/3599084319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56079ec5f680 msgr2=0x56079ec772f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:54.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.193+0000 7f2d0affd640 1 --2- 172.21.15.19:0/3599084319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56079ec5f680 0x56079ec772f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.193+0000 7f2d0affd640 1 -- 172.21.15.19:0/3599084319 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56079ec54dc0 msgr2=0x56079ec76db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:54.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.193+0000 7f2d0affd640 1 --2- 172.21.15.19:0/3599084319 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56079ec54dc0 0x56079ec76db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.193+0000 7f2d0affd640 1 -- 172.21.15.19:0/3599084319 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56079ec5b160 con 0x56079ec544a0 2024-09-19T08:58:54.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.193+0000 7f2d0affd640 1 --2- 172.21.15.19:0/3599084319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56079ec544a0 0x56079ec5e120 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc005f40 tx=0x7f2cfc009f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63dcc7fb5828ee3b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:54.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.194+0000 7f2d00ff9640 1 -- 172.21.15.19:0/3599084319 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc01f040 con 0x56079ec544a0 2024-09-19T08:58:54.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.194+0000 7f2d00ff9640 1 -- 172.21.15.19:0/3599084319 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cfc010d70 con 0x56079ec544a0 2024-09-19T08:58:54.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.194+0000 7f2d00ff9640 1 -- 172.21.15.19:0/3599084319 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc00fb80 con 0x56079ec544a0 2024-09-19T08:58:54.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.194+0000 7f2d13756740 1 -- 172.21.15.19:0/3599084319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56079ec544a0 msgr2=0x56079ec5e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:54.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.194+0000 7f2d13756740 1 --2- 172.21.15.19:0/3599084319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56079ec544a0 0x56079ec5e120 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc005f40 tx=0x7f2cfc009f00 comp rx=0 tx=0).stop 2024-09-19T08:58:54.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.195+0000 7f2d13756740 1 -- 172.21.15.19:0/3599084319 shutdown_connections 2024-09-19T08:58:54.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.195+0000 7f2d13756740 1 --2- 172.21.15.19:0/3599084319 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56079ec5f680 0x56079ec772f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.195+0000 7f2d13756740 1 --2- 172.21.15.19:0/3599084319 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56079ec54dc0 0x56079ec76db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.195+0000 7f2d13756740 1 --2- 172.21.15.19:0/3599084319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56079ec544a0 0x56079ec5e120 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.195+0000 7f2d13756740 1 -- 172.21.15.19:0/3599084319 >> 172.21.15.19:0/3599084319 conn(0x56079ec50a30 msgr2=0x56079ec5da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:54.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.195+0000 7f2d13756740 1 -- 172.21.15.19:0/3599084319 shutdown_connections 2024-09-19T08:58:54.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.195+0000 7f2d13756740 1 -- 172.21.15.19:0/3599084319 wait complete. 2024-09-19T08:58:54.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.195+0000 7f2d13756740 1 -- start start 2024-09-19T08:58:54.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.195+0000 7f2d13756740 1 Processor -- start 2024-09-19T08:58:54.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.195+0000 7f2d13756740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56079ec544a0 0x56079ec67c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:54.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.195+0000 7f2d13756740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56079ec54dc0 0x56079ec64fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:54.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.195+0000 7f2d13756740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56079ec5f680 0x56079ec65510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:54.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.195+0000 7f2d13756740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0c1afc70 con 0x56079ec544a0 2024-09-19T08:58:54.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.195+0000 7f2d13756740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0c1af5a0 con 0x56079ec5f680 2024-09-19T08:58:54.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.195+0000 7f2d13756740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0c1b0340 con 0x56079ec54dc0 2024-09-19T08:58:54.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.195+0000 7f2d13756740 10 client.0 _ll_register_callbacks cb 0x7f2d04005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:54.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.196+0000 7f2d0affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56079ec544a0 0x56079ec67c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:54.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.196+0000 7f2d0affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56079ec544a0 0x56079ec67c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:46610/0 (socket says 172.21.15.19:46610) 2024-09-19T08:58:54.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.196+0000 7f2d0affd640 1 -- 172.21.15.19:0/3001801794 learned_addr learned my addr 172.21.15.19:0/3001801794 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:54.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.196+0000 7f2d0a7fc640 1 --2- 172.21.15.19:0/3001801794 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56079ec54dc0 0x56079ec64fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:54.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.196+0000 7f2d0b7fe640 1 --2- 172.21.15.19:0/3001801794 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56079ec5f680 0x56079ec65510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:54.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.196+0000 7f2d0affd640 1 -- 172.21.15.19:0/3001801794 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56079ec54dc0 msgr2=0x56079ec64fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:54.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.196+0000 7f2d0affd640 1 --2- 172.21.15.19:0/3001801794 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56079ec54dc0 0x56079ec64fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.196+0000 7f2d0affd640 1 -- 172.21.15.19:0/3001801794 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56079ec5f680 msgr2=0x56079ec65510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:54.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.196+0000 7f2d0affd640 1 --2- 172.21.15.19:0/3001801794 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56079ec5f680 0x56079ec65510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.196+0000 7f2d0affd640 1 -- 172.21.15.19:0/3001801794 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56079ec65c00 con 0x56079ec544a0 2024-09-19T08:58:54.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.196+0000 7f2d0affd640 1 --2- 172.21.15.19:0/3001801794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56079ec544a0 0x56079ec67c30 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc011660 tx=0x7f2cfc010b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8698c1d093580d60 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:54.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.196+0000 7f2cf27fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:58:54.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.196+0000 7f2cf27fc640 1 -- 172.21.15.19:0/3001801794 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc037060 con 0x56079ec544a0 2024-09-19T08:58:54.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.196+0000 7f2cf27fc640 1 -- 172.21.15.19:0/3001801794 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2cfc003970 con 0x56079ec544a0 2024-09-19T08:58:54.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.196+0000 7f2d13756740 1 -- 172.21.15.19:0/3001801794 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2cfc010d70 con 0x56079ec544a0 2024-09-19T08:58:54.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.197+0000 7f2cf27fc640 1 -- 172.21.15.19:0/3001801794 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f2cfc0108d0 con 0x56079ec544a0 2024-09-19T08:58:54.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.197+0000 7f2d13756740 10 client.16944 fetch_fsmap learned FSMap version 35 2024-09-19T08:58:54.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.197+0000 7f2d13756740 1 -- 172.21.15.19:0/3001801794 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56079ecd9c60 con 0x56079ec544a0 2024-09-19T08:58:54.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.197+0000 7f2cf27fc640 1 -- 172.21.15.19:0/3001801794 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2cfc010d70 con 0x56079ec544a0 2024-09-19T08:58:54.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.197+0000 7f2cf27fc640 1 -- 172.21.15.19:0/3001801794 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 7757+0+0 (secure 0 0 0) 0x7f2cfc02e030 con 0x56079ec544a0 2024-09-19T08:58:54.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.197+0000 7f2d13756740 10 client.16944 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:58:54.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.197+0000 7f2d13756740 10 client.16944 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:58:54.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.197+0000 7f2d13756740 20 client.16944 populate_metadata read hostname 'smithi019' 2024-09-19T08:58:54.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.197+0000 7f2d13756740 1 --2- 172.21.15.19:0/3001801794 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56079ecda0d0 0x56079ecdc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:54.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.197+0000 7f2d13756740 4 client.16944 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:58:54.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.197+0000 7f2d13756740 1 -- 172.21.15.19:0/3001801794 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56079ebc1d60 con 0x56079ecda0d0 2024-09-19T08:58:54.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.197+0000 7f2d0a7fc640 1 --2- 172.21.15.19:0/3001801794 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56079ecda0d0 0x56079ecdc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:54.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.198+0000 7f2cf27fc640 10 client.16944 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:54.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.198+0000 7f2d0a7fc640 1 --2- 172.21.15.19:0/3001801794 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56079ecda0d0 0x56079ecdc4c0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bb2bc58f80d6162 server_cookie=afb3bd0ac3b40799 in_seq=0 out_seq=0 2024-09-19T08:58:54.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.203+0000 7f2cf27fc640 1 -- 172.21.15.19:0/3001801794 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56079ebc1d60 con 0x56079ecda0d0 2024-09-19T08:58:54.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.203+0000 7f2cf27fc640 10 client.16944 handle_command_reply: tid=0 2024-09-19T08:58:54.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.203+0000 7f2d13756740 1 client.16944 shutdown 2024-09-19T08:58:54.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.203+0000 7f2d13756740 1 -- 172.21.15.19:0/3001801794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56079ec544a0 msgr2=0x56079ec67c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:54.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.203+0000 7f2d13756740 1 --2- 172.21.15.19:0/3001801794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56079ec544a0 0x56079ec67c30 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc011660 tx=0x7f2cfc010b70 comp rx=0 tx=0).stop 2024-09-19T08:58:54.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.204+0000 7f2d13756740 1 -- 172.21.15.19:0/3001801794 shutdown_connections 2024-09-19T08:58:54.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.204+0000 7f2d13756740 1 --2- 172.21.15.19:0/3001801794 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56079ecda0d0 0x56079ecdc4c0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.204+0000 7f2d13756740 1 --2- 172.21.15.19:0/3001801794 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56079ec54dc0 0x56079ec64fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.204+0000 7f2d13756740 1 --2- 172.21.15.19:0/3001801794 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56079ec5f680 0x56079ec65510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.204+0000 7f2d13756740 1 --2- 172.21.15.19:0/3001801794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56079ec544a0 0x56079ec67c30 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.204+0000 7f2d13756740 1 -- 172.21.15.19:0/3001801794 >> 172.21.15.19:0/3001801794 conn(0x56079ec50a30 msgr2=0x56079ec4fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:54.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.204+0000 7f2cf27fc640 0 client.16944 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:58:54.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.204+0000 7f2d13756740 1 -- 172.21.15.19:0/3001801794 shutdown_connections 2024-09-19T08:58:54.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.204+0000 7f2d13756740 1 -- 172.21.15.19:0/3001801794 wait complete. 2024-09-19T08:58:54.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.204+0000 7f2d13756740 20 client.16944 trim_cache size 0 max 16384 2024-09-19T08:58:54.206 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:58:54.206 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-19T08:58:54.206 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {} 2024-09-19T08:58:54.206 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:58:54.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.204+0000 7f2d1137d640 1 -- 172.21.15.19:0/2364852744 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2cf80a3240 msgr2=0x7f2cf80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:54.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.204+0000 7f2d1137d640 1 --2- 172.21.15.19:0/2364852744 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2cf80a3240 0x7f2cf80a5700 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x56079ec51db0 tx=0x7f2cf4004730 comp rx=0 tx=0).stop 2024-09-19T08:58:54.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.204+0000 7f2d1137d640 1 -- 172.21.15.19:0/2364852744 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d0c10e4f0 msgr2=0x7f2d0c19f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:54.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.204+0000 7f2d1137d640 1 --2- 172.21.15.19:0/2364852744 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d0c10e4f0 0x7f2d0c19f010 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f2d04004770 tx=0x7f2d04003b90 comp rx=0 tx=0).stop 2024-09-19T08:58:54.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.204+0000 7f2d1137d640 1 -- 172.21.15.19:0/2364852744 shutdown_connections 2024-09-19T08:58:54.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.204+0000 7f2d1137d640 1 --2- 172.21.15.19:0/2364852744 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2cf80a3240 0x7f2cf80a5700 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.204+0000 7f2d1137d640 1 --2- 172.21.15.19:0/2364852744 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2d0c10e4f0 0x7f2d0c19f010 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.204+0000 7f2d1137d640 1 --2- 172.21.15.19:0/2364852744 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2d0c101380 0x7f2d0c19ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.204+0000 7f2d1137d640 1 --2- 172.21.15.19:0/2364852744 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2d0c1009d0 0x7f2d0c19a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:54.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.204+0000 7f2d1137d640 1 -- 172.21.15.19:0/2364852744 >> 172.21.15.19:0/2364852744 conn(0x7f2d0c0fc7d0 msgr2=0x7f2d0c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:54.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.205+0000 7f2d1137d640 1 -- 172.21.15.19:0/2364852744 shutdown_connections 2024-09-19T08:58:54.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:54.205+0000 7f2d1137d640 1 -- 172.21.15.19:0/2364852744 wait complete. 2024-09-19T08:58:54.972 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T08:58:54.972 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T08:58:55.229 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:58:55.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.772+0000 7f10b0e29640 1 -- 172.21.15.19:0/2354466302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10ac101420 msgr2=0x7f10ac10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:55.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.772+0000 7f10b0e29640 1 --2- 172.21.15.19:0/2354466302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10ac101420 0x7f10ac10d950 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f10a4009cd0 tx=0x7f10a402a8e0 comp rx=0 tx=0).stop 2024-09-19T08:58:55.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.773+0000 7f10b0e29640 1 -- 172.21.15.19:0/2354466302 shutdown_connections 2024-09-19T08:58:55.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.773+0000 7f10b0e29640 1 --2- 172.21.15.19:0/2354466302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f10ac100a80 0x7f10ac100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:55.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.773+0000 7f10b0e29640 1 --2- 172.21.15.19:0/2354466302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10ac101420 0x7f10ac10d950 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:55.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.773+0000 7f10b0e29640 1 --2- 172.21.15.19:0/2354466302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10ac106a80 0x7f10ac106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:55.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.773+0000 7f10b0e29640 1 -- 172.21.15.19:0/2354466302 >> 172.21.15.19:0/2354466302 conn(0x7f10ac0fc7a0 msgr2=0x7f10ac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:55.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.773+0000 7f10b0e29640 1 -- 172.21.15.19:0/2354466302 shutdown_connections 2024-09-19T08:58:55.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.773+0000 7f10b0e29640 1 -- 172.21.15.19:0/2354466302 wait complete. 2024-09-19T08:58:55.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.773+0000 7f10b0e29640 1 Processor -- start 2024-09-19T08:58:55.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.773+0000 7f10b0e29640 1 -- start start 2024-09-19T08:58:55.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.774+0000 7f10b0e29640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f10ac100a80 0x7f10ac1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:55.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.774+0000 7f10b0e29640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10ac101420 0x7f10ac1989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:55.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.774+0000 7f10b0e29640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10ac106a80 0x7f10ac19cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:55.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.774+0000 7f10b0e29640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f10ac110e80 con 0x7f10ac106a80 2024-09-19T08:58:55.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.774+0000 7f10b0e29640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f10ac110d00 con 0x7f10ac101420 2024-09-19T08:58:55.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.774+0000 7f10b0e29640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f10ac111000 con 0x7f10ac100a80 2024-09-19T08:58:55.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.774+0000 7f10aad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10ac106a80 0x7f10ac19cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:55.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.774+0000 7f10aa59c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f10ac100a80 0x7f10ac1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:55.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.774+0000 7f10a9d9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10ac101420 0x7f10ac1989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:55.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.774+0000 7f10aa59c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f10ac100a80 0x7f10ac1984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:60642/0 (socket says 172.21.15.19:60642) 2024-09-19T08:58:55.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.774+0000 7f10aa59c640 1 -- 172.21.15.19:0/877032037 learned_addr learned my addr 172.21.15.19:0/877032037 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:55.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.774+0000 7f10aad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10ac106a80 0x7f10ac19cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56426/0 (socket says 172.21.15.19:56426) 2024-09-19T08:58:55.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.774+0000 7f10aa59c640 1 -- 172.21.15.19:0/877032037 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10ac101420 msgr2=0x7f10ac1989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:55.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.774+0000 7f10aa59c640 1 --2- 172.21.15.19:0/877032037 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10ac101420 0x7f10ac1989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:55.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.774+0000 7f10aa59c640 1 -- 172.21.15.19:0/877032037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10ac106a80 msgr2=0x7f10ac19cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:55.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.774+0000 7f10aa59c640 1 --2- 172.21.15.19:0/877032037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10ac106a80 0x7f10ac19cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:55.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.774+0000 7f10aa59c640 1 -- 172.21.15.19:0/877032037 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10ac19d450 con 0x7f10ac100a80 2024-09-19T08:58:55.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.774+0000 7f10aad9d640 1 --2- 172.21.15.19:0/877032037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10ac106a80 0x7f10ac19cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:58:55.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.774+0000 7f10aa59c640 1 --2- 172.21.15.19:0/877032037 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f10ac100a80 0x7f10ac1984a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f109c00e9f0 tx=0x7f109c00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:55.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.775+0000 7f109b7fe640 1 -- 172.21.15.19:0/877032037 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109c00cd80 con 0x7f10ac100a80 2024-09-19T08:58:55.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.775+0000 7f10b0e29640 1 -- 172.21.15.19:0/877032037 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10ac19d740 con 0x7f10ac100a80 2024-09-19T08:58:55.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.775+0000 7f109b7fe640 1 -- 172.21.15.19:0/877032037 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f109c010910 con 0x7f10ac100a80 2024-09-19T08:58:55.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.775+0000 7f109b7fe640 1 -- 172.21.15.19:0/877032037 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f109c0188f0 con 0x7f10ac100a80 2024-09-19T08:58:55.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.775+0000 7f10b0e29640 1 -- 172.21.15.19:0/877032037 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10ac1a5020 con 0x7f10ac100a80 2024-09-19T08:58:55.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.776+0000 7f10b0e29640 1 -- 172.21.15.19:0/877032037 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10ac100ee0 con 0x7f10ac100a80 2024-09-19T08:58:55.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.777+0000 7f109b7fe640 1 -- 172.21.15.19:0/877032037 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f109c010ac0 con 0x7f10ac100a80 2024-09-19T08:58:55.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.778+0000 7f109b7fe640 1 --2- 172.21.15.19:0/877032037 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f10940a3240 0x7f10940a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:55.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.778+0000 7f10a9d9b640 1 --2- 172.21.15.19:0/877032037 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f10940a3240 0x7f10940a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:55.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.778+0000 7f109b7fe640 1 -- 172.21.15.19:0/877032037 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f109c0cffc0 con 0x7f10ac100a80 2024-09-19T08:58:55.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.778+0000 7f10a9d9b640 1 --2- 172.21.15.19:0/877032037 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f10940a3240 0x7f10940a5700 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f10ac1051e0 tx=0x7f10a0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:55.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:55.782+0000 7f109b7fe640 1 -- 172.21.15.19:0/877032037 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f109c09c640 con 0x7f10ac100a80 2024-09-19T08:58:55.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:55 smithi203 ceph-mon[35450]: pgmap v538: 97 pgs: 97 active+clean; 24 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 799 op/s 2024-09-19T08:58:56.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:56.000+0000 7f10b0e29640 1 -- 172.21.15.19:0/877032037 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10ac10a020 con 0x7f10ac100a80 2024-09-19T08:58:56.001 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:55 smithi019 ceph-mon[30976]: pgmap v538: 97 pgs: 97 active+clean; 24 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 799 op/s 2024-09-19T08:58:56.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:56.001+0000 7f109b7fe640 1 -- 172.21.15.19:0/877032037 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11154 (secure 0 0 0) 0x7f109c098070 con 0x7f10ac100a80 2024-09-19T08:58:56.002 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T08:58:56.002 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":35,"btime":"2024-09-19T08:58:50:493998+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T08:58:50.493979+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6839/2452068876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2452068876},{"type":"v1","addr":"172.21.15.19:6839","nonce":2452068876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24469,24490,24464,24463]},"id":1}]} 2024-09-19T08:58:56.002 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 35 2024-09-19T08:58:56.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:56.003+0000 7f10b0e29640 1 -- 172.21.15.19:0/877032037 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f10940a3240 msgr2=0x7f10940a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:56.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:56.003+0000 7f10b0e29640 1 --2- 172.21.15.19:0/877032037 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f10940a3240 0x7f10940a5700 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f10ac1051e0 tx=0x7f10a0005f90 comp rx=0 tx=0).stop 2024-09-19T08:58:56.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:56.003+0000 7f10b0e29640 1 -- 172.21.15.19:0/877032037 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f10ac100a80 msgr2=0x7f10ac1984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:56.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:56.003+0000 7f10b0e29640 1 --2- 172.21.15.19:0/877032037 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f10ac100a80 0x7f10ac1984a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f109c00e9f0 tx=0x7f109c00eeb0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:56.003+0000 7f10b0e29640 1 -- 172.21.15.19:0/877032037 shutdown_connections 2024-09-19T08:58:56.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:56.003+0000 7f10b0e29640 1 --2- 172.21.15.19:0/877032037 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f10940a3240 0x7f10940a5700 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:56.003+0000 7f10b0e29640 1 --2- 172.21.15.19:0/877032037 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f10ac106a80 0x7f10ac19cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:56.003+0000 7f10b0e29640 1 --2- 172.21.15.19:0/877032037 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f10ac101420 0x7f10ac1989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:56.003+0000 7f10b0e29640 1 --2- 172.21.15.19:0/877032037 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f10ac100a80 0x7f10ac1984a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:56.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:56.003+0000 7f10b0e29640 1 -- 172.21.15.19:0/877032037 >> 172.21.15.19:0/877032037 conn(0x7f10ac0fc7a0 msgr2=0x7f10ac06aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:56.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:56.003+0000 7f10b0e29640 1 -- 172.21.15.19:0/877032037 shutdown_connections 2024-09-19T08:58:56.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:56.004+0000 7f10b0e29640 1 -- 172.21.15.19:0/877032037 wait complete. 2024-09-19T08:58:56.162 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:55 smithi155 ceph-mon[34921]: pgmap v538: 97 pgs: 97 active+clean; 24 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.0 MiB/s wr, 799 op/s 2024-09-19T08:58:56.162 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:58:55 smithi155 systemd[1]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.e.service: Scheduled restart job, restart counter is at 1. 2024-09-19T08:58:56.162 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:58:55 smithi155 systemd[1]: Stopped Ceph mds.e for f26c9d84-7662-11ef-bceb-c7b262605968. 2024-09-19T08:58:56.162 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:58:55 smithi155 systemd[1]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.e.service: Consumed 15.716s CPU time. 2024-09-19T08:58:56.162 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:58:55 smithi155 systemd[1]: Starting Ceph mds.e for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T08:58:56.422 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:58:56 smithi155 podman[68793]: 2024-09-19 08:58:56.067141561 +0000 UTC m=+0.021928999 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T08:58:56.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:56 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/877032037' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:58:57.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:56 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/877032037' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:58:57.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:56 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/877032037' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T08:58:57.650 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T08:58:57.917 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:58:57.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:57 smithi155 ceph-mon[34921]: pgmap v539: 97 pgs: 97 active+clean; 12 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 1.53k op/s 2024-09-19T08:58:57.923 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:58:57 smithi155 podman[68793]: 2024-09-19 08:58:57.634222882 +0000 UTC m=+1.589010294 container create b8d118788cbe26ea4ea9cfa793d01584f0a586bd599dc0b168ddf1d7b4466cc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-e, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T08:58:57.988 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:57 smithi203 ceph-mon[35450]: pgmap v539: 97 pgs: 97 active+clean; 12 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 1.53k op/s 2024-09-19T08:58:58.038 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:57 smithi019 ceph-mon[30976]: pgmap v539: 97 pgs: 97 active+clean; 12 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.8 MiB/s wr, 1.53k op/s 2024-09-19T08:58:58.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.394+0000 7f55acb8c640 1 -- 172.21.15.19:0/3464662790 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55a8101420 msgr2=0x7f55a810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:58.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.394+0000 7f55acb8c640 1 --2- 172.21.15.19:0/3464662790 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55a8101420 0x7f55a810d950 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f55a0009cd0 tx=0x7f55a002a8e0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.394+0000 7f55acb8c640 1 -- 172.21.15.19:0/3464662790 shutdown_connections 2024-09-19T08:58:58.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.394+0000 7f55acb8c640 1 --2- 172.21.15.19:0/3464662790 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f55a8100a80 0x7f55a8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.394+0000 7f55acb8c640 1 --2- 172.21.15.19:0/3464662790 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55a8101420 0x7f55a810d950 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.394+0000 7f55acb8c640 1 --2- 172.21.15.19:0/3464662790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55a8106a80 0x7f55a8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.394+0000 7f55acb8c640 1 -- 172.21.15.19:0/3464662790 >> 172.21.15.19:0/3464662790 conn(0x7f55a80fc7a0 msgr2=0x7f55a80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:58.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.395+0000 7f55acb8c640 1 -- 172.21.15.19:0/3464662790 shutdown_connections 2024-09-19T08:58:58.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.395+0000 7f55acb8c640 1 -- 172.21.15.19:0/3464662790 wait complete. 2024-09-19T08:58:58.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.395+0000 7f55acb8c640 1 Processor -- start 2024-09-19T08:58:58.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.395+0000 7f55acb8c640 1 -- start start 2024-09-19T08:58:58.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.396+0000 7f55acb8c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55a8100a80 0x7f55a819a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:58.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.396+0000 7f55acb8c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55a8101420 0x7f55a819abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:58.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.396+0000 7f55acb8c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f55a8106a80 0x7f55a819ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:58.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.396+0000 7f55acb8c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f55a8110e80 con 0x7f55a8100a80 2024-09-19T08:58:58.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.396+0000 7f55acb8c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f55a8110d00 con 0x7f55a8101420 2024-09-19T08:58:58.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.396+0000 7f55acb8c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f55a8111000 con 0x7f55a8106a80 2024-09-19T08:58:58.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.396+0000 7f55a659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55a8100a80 0x7f55a819a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:58.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.396+0000 7f55a659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55a8100a80 0x7f55a819a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56450/0 (socket says 172.21.15.19:56450) 2024-09-19T08:58:58.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.396+0000 7f55a659c640 1 -- 172.21.15.19:0/2280562443 learned_addr learned my addr 172.21.15.19:0/2280562443 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:58.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.396+0000 7f55a6d9d640 1 --2- 172.21.15.19:0/2280562443 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f55a8106a80 0x7f55a819ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:58.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.396+0000 7f55a5d9b640 1 --2- 172.21.15.19:0/2280562443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55a8101420 0x7f55a819abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:58.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.396+0000 7f55a659c640 1 -- 172.21.15.19:0/2280562443 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f55a8106a80 msgr2=0x7f55a819ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:58.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.396+0000 7f55a659c640 1 --2- 172.21.15.19:0/2280562443 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f55a8106a80 0x7f55a819ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.396+0000 7f55a659c640 1 -- 172.21.15.19:0/2280562443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55a8101420 msgr2=0x7f55a819abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:58.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.396+0000 7f55a659c640 1 --2- 172.21.15.19:0/2280562443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55a8101420 0x7f55a819abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.396+0000 7f55a659c640 1 -- 172.21.15.19:0/2280562443 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a819f640 con 0x7f55a8100a80 2024-09-19T08:58:58.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.396+0000 7f55a5d9b640 1 --2- 172.21.15.19:0/2280562443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55a8101420 0x7f55a819abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:58:58.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.396+0000 7f55a659c640 1 --2- 172.21.15.19:0/2280562443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55a8100a80 0x7f55a819a690 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f559800e9f0 tx=0x7f559800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:58.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.396+0000 7f55977fe640 1 -- 172.21.15.19:0/2280562443 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559800cd80 con 0x7f55a8100a80 2024-09-19T08:58:58.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.397+0000 7f55acb8c640 1 -- 172.21.15.19:0/2280562443 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55a819f930 con 0x7f55a8100a80 2024-09-19T08:58:58.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.397+0000 7f55977fe640 1 -- 172.21.15.19:0/2280562443 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5598010910 con 0x7f55a8100a80 2024-09-19T08:58:58.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.397+0000 7f55977fe640 1 -- 172.21.15.19:0/2280562443 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5598018990 con 0x7f55a8100a80 2024-09-19T08:58:58.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.397+0000 7f55acb8c640 1 -- 172.21.15.19:0/2280562443 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55a81a7210 con 0x7f55a8100a80 2024-09-19T08:58:58.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.399+0000 7f55977fe640 1 -- 172.21.15.19:0/2280562443 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f5598010ac0 con 0x7f55a8100a80 2024-09-19T08:58:58.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.399+0000 7f55aef65740 1 Processor -- start 2024-09-19T08:58:58.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.399+0000 7f55aef65740 1 -- start start 2024-09-19T08:58:58.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.400+0000 7f55aef65740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55854113ab40 0x558541139090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:58.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.400+0000 7f55aef65740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5585411395d0 0x558541139a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:58.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.400+0000 7f55aef65740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558541144370 0x558541146760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:58.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.400+0000 7f55aef65740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55854109f2f0 con 0x5585411395d0 2024-09-19T08:58:58.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.400+0000 7f55aef65740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x558541046cf0 con 0x558541144370 2024-09-19T08:58:58.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.400+0000 7f55aef65740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55854109b2b0 con 0x55854113ab40 2024-09-19T08:58:58.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.400+0000 7f55a659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5585411395d0 0x558541139a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:58.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.400+0000 7f55a6d9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55854113ab40 0x558541139090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:58.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.400+0000 7f55a6d9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55854113ab40 0x558541139090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:60666/0 (socket says 172.21.15.19:60666) 2024-09-19T08:58:58.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.400+0000 7f55a5d9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558541144370 0x558541146760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:58.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.400+0000 7f55a6d9d640 1 -- 172.21.15.19:0/861489203 learned_addr learned my addr 172.21.15.19:0/861489203 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:58.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.400+0000 7f55a659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5585411395d0 0x558541139a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56462/0 (socket says 172.21.15.19:56462) 2024-09-19T08:58:58.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.400+0000 7f55977fe640 1 --2- 172.21.15.19:0/2280562443 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f55900a3240 0x7f55900a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:58.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.400+0000 7f55a6d9d640 1 -- 172.21.15.19:0/861489203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558541144370 msgr2=0x558541146760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:58.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.400+0000 7f55a6d9d640 1 --2- 172.21.15.19:0/861489203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558541144370 0x558541146760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.400+0000 7f55a6d9d640 1 -- 172.21.15.19:0/861489203 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5585411395d0 msgr2=0x558541139a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:58.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.400+0000 7f55a6d9d640 1 --2- 172.21.15.19:0/861489203 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5585411395d0 0x558541139a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.400+0000 7f55a6d9d640 1 -- 172.21.15.19:0/861489203 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55854102b3a0 con 0x55854113ab40 2024-09-19T08:58:58.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.400+0000 7f55a659c640 1 --2- 172.21.15.19:0/861489203 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5585411395d0 0x558541139a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:58:58.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.400+0000 7f55a6d9d640 1 --2- 172.21.15.19:0/2280562443 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f55900a3240 0x7f55900a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:58.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.400+0000 7f55977fe640 1 -- 172.21.15.19:0/2280562443 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f55980cfca0 con 0x7f55a8100a80 2024-09-19T08:58:58.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.401+0000 7f55a6d9d640 1 --2- 172.21.15.19:0/861489203 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55854113ab40 0x558541139090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f55a0009cd0 tx=0x7f55a0031500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcf2b76e52096072 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:58.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.401+0000 7f5594ff9640 1 -- 172.21.15.19:0/861489203 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a0041040 con 0x55854113ab40 2024-09-19T08:58:58.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.401+0000 7f5594ff9640 1 -- 172.21.15.19:0/861489203 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55a0043070 con 0x55854113ab40 2024-09-19T08:58:58.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.401+0000 7f5594ff9640 1 -- 172.21.15.19:0/861489203 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a0030c60 con 0x55854113ab40 2024-09-19T08:58:58.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.402+0000 7f55aef65740 1 -- 172.21.15.19:0/861489203 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55854113ab40 msgr2=0x558541139090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:58.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.402+0000 7f55a6d9d640 1 --2- 172.21.15.19:0/2280562443 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f55900a3240 0x7f55900a5700 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f55a004c000 tx=0x7f55a004d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:58.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.402+0000 7f55aef65740 1 --2- 172.21.15.19:0/861489203 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55854113ab40 0x558541139090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f55a0009cd0 tx=0x7f55a0031500 comp rx=0 tx=0).stop 2024-09-19T08:58:58.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.402+0000 7f55aef65740 1 -- 172.21.15.19:0/861489203 shutdown_connections 2024-09-19T08:58:58.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.402+0000 7f55aef65740 1 --2- 172.21.15.19:0/861489203 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558541144370 0x558541146760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.402+0000 7f55aef65740 1 --2- 172.21.15.19:0/861489203 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5585411395d0 0x558541139a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.402+0000 7f55aef65740 1 --2- 172.21.15.19:0/861489203 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55854113ab40 0x558541139090 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.402+0000 7f55aef65740 1 -- 172.21.15.19:0/861489203 >> 172.21.15.19:0/861489203 conn(0x558541102310 msgr2=0x558541135c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:58.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.402+0000 7f55aef65740 1 -- 172.21.15.19:0/861489203 shutdown_connections 2024-09-19T08:58:58.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.402+0000 7f55aef65740 1 -- 172.21.15.19:0/861489203 wait complete. 2024-09-19T08:58:58.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.402+0000 7f55aef65740 1 -- start start 2024-09-19T08:58:58.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.402+0000 7f55aef65740 1 Processor -- start 2024-09-19T08:58:58.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.403+0000 7f55aef65740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5585411395d0 0x558541143d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:58.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.403+0000 7f55aef65740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55854113ab40 0x558541140fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:58.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.403+0000 7f55aef65740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558541144370 0x558541141570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:58.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.403+0000 7f55aef65740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5585411470c0 con 0x55854113ab40 2024-09-19T08:58:58.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.403+0000 7f55aef65740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55854105a060 con 0x5585411395d0 2024-09-19T08:58:58.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.403+0000 7f55aef65740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558541147240 con 0x558541144370 2024-09-19T08:58:58.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.403+0000 7f55aef65740 10 client.0 _ll_register_callbacks cb 0x558540dad8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:58.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.403+0000 7f55a5d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55854113ab40 0x558541140fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:58.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.403+0000 7f55a659c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5585411395d0 0x558541143d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:58.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.403+0000 7f55a5d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55854113ab40 0x558541140fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56472/0 (socket says 172.21.15.19:56472) 2024-09-19T08:58:58.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.403+0000 7f55a5d9b640 1 -- 172.21.15.19:0/476489859 learned_addr learned my addr 172.21.15.19:0/476489859 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:58.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.403+0000 7f55a6d9d640 1 --2- 172.21.15.19:0/476489859 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558541144370 0x558541141570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:58.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.403+0000 7f55a659c640 1 -- 172.21.15.19:0/476489859 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558541144370 msgr2=0x558541141570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:58.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.403+0000 7f55a659c640 1 --2- 172.21.15.19:0/476489859 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558541144370 0x558541141570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.403+0000 7f55a659c640 1 -- 172.21.15.19:0/476489859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55854113ab40 msgr2=0x558541140fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:58.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.403+0000 7f55a659c640 1 --2- 172.21.15.19:0/476489859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55854113ab40 0x558541140fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.403+0000 7f55a659c640 1 -- 172.21.15.19:0/476489859 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558540e103c0 con 0x5585411395d0 2024-09-19T08:58:58.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.403+0000 7f55a5d9b640 1 --2- 172.21.15.19:0/476489859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55854113ab40 0x558541140fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:58:58.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.403+0000 7f55a659c640 1 --2- 172.21.15.19:0/476489859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5585411395d0 0x558541143d20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x558541136ac0 tx=0x7f559809c0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f8391606f6dcff7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:58.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.403+0000 7f558dffb640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T08:58:58.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.403+0000 7f558dffb640 1 -- 172.21.15.19:0/476489859 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55980bc2b0 con 0x5585411395d0 2024-09-19T08:58:58.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.404+0000 7f558dffb640 1 -- 172.21.15.19:0/476489859 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5598018b30 con 0x5585411395d0 2024-09-19T08:58:58.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.404+0000 7f55aef65740 1 -- 172.21.15.19:0/476489859 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55a0043070 con 0x5585411395d0 2024-09-19T08:58:58.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.404+0000 7f558dffb640 1 -- 172.21.15.19:0/476489859 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f559809c970 con 0x5585411395d0 2024-09-19T08:58:58.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.404+0000 7f55aef65740 10 client.26441 fetch_fsmap learned FSMap version 35 2024-09-19T08:58:58.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.404+0000 7f55aef65740 1 -- 172.21.15.19:0/476489859 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x558541152b60 con 0x5585411395d0 2024-09-19T08:58:58.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.404+0000 7f558dffb640 1 -- 172.21.15.19:0/476489859 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55a0043070 con 0x5585411395d0 2024-09-19T08:58:58.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.404+0000 7f558dffb640 1 -- 172.21.15.19:0/476489859 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 35) ==== 7757+0+0 (secure 0 0 0) 0x7f55980a0180 con 0x5585411395d0 2024-09-19T08:58:58.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.404+0000 7f55aef65740 10 client.26441 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:58:58.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.404+0000 7f55aef65740 10 client.26441 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T08:58:58.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.404+0000 7f55aef65740 20 client.26441 populate_metadata read hostname 'smithi019' 2024-09-19T08:58:58.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.404+0000 7f55aef65740 1 --2- 172.21.15.19:0/476489859 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x558541153f70 0x5585411563a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:58.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.404+0000 7f55aef65740 4 client.26441 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:58:58.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.404+0000 7f55aef65740 1 -- 172.21.15.19:0/476489859 --> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585410ac860 con 0x558541153f70 2024-09-19T08:58:58.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.404+0000 7f55a5d9b640 1 --2- 172.21.15.19:0/476489859 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x558541153f70 0x5585411563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:58.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.405+0000 7f55a5d9b640 1 --2- 172.21.15.19:0/476489859 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x558541153f70 0x5585411563a0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6e55eb505c41f031 server_cookie=558d51820b9073ee in_seq=0 out_seq=0 2024-09-19T08:58:58.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.405+0000 7f558dffb640 10 client.26441 ms_handle_connect on v2:172.21.15.203:6834/2702758353 2024-09-19T08:58:58.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.406+0000 7f558dffb640 1 -- 172.21.15.19:0/476489859 <== mds.4 v2:172.21.15.203:6834/2702758353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5585410ac860 con 0x558541153f70 2024-09-19T08:58:58.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.406+0000 7f558dffb640 10 client.26441 handle_command_reply: tid=0 2024-09-19T08:58:58.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.406+0000 7f55aef65740 1 client.26441 shutdown 2024-09-19T08:58:58.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.406+0000 7f55aef65740 1 -- 172.21.15.19:0/476489859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5585411395d0 msgr2=0x558541143d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:58.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.406+0000 7f55aef65740 1 --2- 172.21.15.19:0/476489859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5585411395d0 0x558541143d20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x558541136ac0 tx=0x7f559809c0f0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.406+0000 7f55aef65740 1 -- 172.21.15.19:0/476489859 shutdown_connections 2024-09-19T08:58:58.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.406+0000 7f55aef65740 1 --2- 172.21.15.19:0/476489859 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x558541153f70 0x5585411563a0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.406+0000 7f55aef65740 1 --2- 172.21.15.19:0/476489859 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558541144370 0x558541141570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.406+0000 7f55aef65740 1 --2- 172.21.15.19:0/476489859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55854113ab40 0x558541140fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.406+0000 7f558dffb640 0 client.26441 ms_handle_reset on v2:172.21.15.203:6834/2702758353 2024-09-19T08:58:58.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.406+0000 7f55aef65740 1 --2- 172.21.15.19:0/476489859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5585411395d0 0x558541143d20 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.406+0000 7f55aef65740 1 -- 172.21.15.19:0/476489859 >> 172.21.15.19:0/476489859 conn(0x558541102310 msgr2=0x55854113b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:58.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.406+0000 7f55aef65740 1 -- 172.21.15.19:0/476489859 shutdown_connections 2024-09-19T08:58:58.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.406+0000 7f55aef65740 1 -- 172.21.15.19:0/476489859 wait complete. 2024-09-19T08:58:58.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.406+0000 7f55aef65740 20 client.26441 trim_cache size 0 max 16384 2024-09-19T08:58:58.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.419+0000 7f55aef65740 1 Processor -- start 2024-09-19T08:58:58.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.419+0000 7f55aef65740 1 -- start start 2024-09-19T08:58:58.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.419+0000 7f55aef65740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5585411395d0 0x558541150360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:58.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.419+0000 7f55aef65740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55854113ab40 0x558541140890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:58.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.419+0000 7f55aef65740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558541144370 0x55854115bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:58.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.419+0000 7f55aef65740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f55a81b11b0 con 0x55854113ab40 2024-09-19T08:58:58.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.419+0000 7f55aef65740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f55a81aefa0 con 0x5585411395d0 2024-09-19T08:58:58.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.419+0000 7f55aef65740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f55a81b0ae0 con 0x558541144370 2024-09-19T08:58:58.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.419+0000 7f55a5d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55854113ab40 0x558541140890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:58.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.420+0000 7f55a5d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55854113ab40 0x558541140890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56482/0 (socket says 172.21.15.19:56482) 2024-09-19T08:58:58.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.420+0000 7f55a5d9b640 1 -- 172.21.15.19:0/3981190821 learned_addr learned my addr 172.21.15.19:0/3981190821 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:58.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.420+0000 7f55a659c640 1 --2- 172.21.15.19:0/3981190821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5585411395d0 0x558541150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:58.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.420+0000 7f55a6d9d640 1 --2- 172.21.15.19:0/3981190821 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558541144370 0x55854115bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:58.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.420+0000 7f55a5d9b640 1 -- 172.21.15.19:0/3981190821 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558541144370 msgr2=0x55854115bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:58.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.420+0000 7f55a5d9b640 1 --2- 172.21.15.19:0/3981190821 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558541144370 0x55854115bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.420+0000 7f55a5d9b640 1 -- 172.21.15.19:0/3981190821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5585411395d0 msgr2=0x558541150360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:58.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.420+0000 7f55a5d9b640 1 --2- 172.21.15.19:0/3981190821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5585411395d0 0x558541150360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.420+0000 7f55a5d9b640 1 -- 172.21.15.19:0/3981190821 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558541136bc0 con 0x55854113ab40 2024-09-19T08:58:58.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.420+0000 7f55a5d9b640 1 --2- 172.21.15.19:0/3981190821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55854113ab40 0x558541140890 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x558541142610 tx=0x7f559c013bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9f3aef6b2fe75b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:58.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.420+0000 7f558ffff640 1 -- 172.21.15.19:0/3981190821 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559c0130d0 con 0x55854113ab40 2024-09-19T08:58:58.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.420+0000 7f558ffff640 1 -- 172.21.15.19:0/3981190821 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f559c013270 con 0x55854113ab40 2024-09-19T08:58:58.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.420+0000 7f558ffff640 1 -- 172.21.15.19:0/3981190821 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559c01cbc0 con 0x55854113ab40 2024-09-19T08:58:58.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.421+0000 7f55aef65740 1 -- 172.21.15.19:0/3981190821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55854113ab40 msgr2=0x558541140890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:58.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.421+0000 7f55aef65740 1 --2- 172.21.15.19:0/3981190821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55854113ab40 0x558541140890 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x558541142610 tx=0x7f559c013bc0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.421+0000 7f55aef65740 1 -- 172.21.15.19:0/3981190821 shutdown_connections 2024-09-19T08:58:58.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.421+0000 7f55aef65740 1 --2- 172.21.15.19:0/3981190821 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558541144370 0x55854115bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.421+0000 7f55aef65740 1 --2- 172.21.15.19:0/3981190821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55854113ab40 0x558541140890 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.421+0000 7f55aef65740 1 --2- 172.21.15.19:0/3981190821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5585411395d0 0x558541150360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.421+0000 7f55aef65740 1 -- 172.21.15.19:0/3981190821 >> 172.21.15.19:0/3981190821 conn(0x558541102310 msgr2=0x55854113f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:58.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.421+0000 7f55aef65740 1 -- 172.21.15.19:0/3981190821 shutdown_connections 2024-09-19T08:58:58.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.421+0000 7f55aef65740 1 -- 172.21.15.19:0/3981190821 wait complete. 2024-09-19T08:58:58.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.421+0000 7f55aef65740 1 -- start start 2024-09-19T08:58:58.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.421+0000 7f55aef65740 1 Processor -- start 2024-09-19T08:58:58.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.422+0000 7f55aef65740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5585411395d0 0x55854114cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:58.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.422+0000 7f55aef65740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55854113ab40 0x55854113db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:58.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.422+0000 7f55aef65740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558541144370 0x55854113e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:58.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.422+0000 7f55aef65740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f55a81afd40 con 0x558541144370 2024-09-19T08:58:58.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.422+0000 7f55aef65740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f55a81af670 con 0x5585411395d0 2024-09-19T08:58:58.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.422+0000 7f55aef65740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f55a81b0410 con 0x55854113ab40 2024-09-19T08:58:58.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.422+0000 7f55aef65740 10 client.0 _ll_register_callbacks cb 0x7f55980d33d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:58:58.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.422+0000 7f55a6d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558541144370 0x55854113e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:58.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.422+0000 7f55a659c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5585411395d0 0x55854114cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:58.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.422+0000 7f55a6d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558541144370 0x55854113e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56484/0 (socket says 172.21.15.19:56484) 2024-09-19T08:58:58.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.422+0000 7f55a6d9d640 1 -- 172.21.15.19:0/3768399775 learned_addr learned my addr 172.21.15.19:0/3768399775 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:58:58.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.422+0000 7f55a5d9b640 1 --2- 172.21.15.19:0/3768399775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55854113ab40 0x55854113db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:58.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.422+0000 7f55a6d9d640 1 -- 172.21.15.19:0/3768399775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55854113ab40 msgr2=0x55854113db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:58.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.422+0000 7f55a6d9d640 1 --2- 172.21.15.19:0/3768399775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55854113ab40 0x55854113db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.422+0000 7f55a6d9d640 1 -- 172.21.15.19:0/3768399775 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5585411395d0 msgr2=0x55854114cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:58:58.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.422+0000 7f55a6d9d640 1 --2- 172.21.15.19:0/3768399775 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5585411395d0 0x55854114cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.422+0000 7f55a6d9d640 1 -- 172.21.15.19:0/3768399775 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55854113e780 con 0x558541144370 2024-09-19T08:58:58.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.422+0000 7f55a6d9d640 1 --2- 172.21.15.19:0/3768399775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558541144370 0x55854113e090 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f55a0009ca0 tx=0x7f55a00095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=660b2dad379c6bec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:58:58.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.422+0000 7f558dffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:58:58.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.422+0000 7f558dffb640 1 -- 172.21.15.19:0/3768399775 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a0041040 con 0x558541144370 2024-09-19T08:58:58.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.423+0000 7f558dffb640 1 -- 172.21.15.19:0/3768399775 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f55a002e070 con 0x558541144370 2024-09-19T08:58:58.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.423+0000 7f55aef65740 1 -- 172.21.15.19:0/3768399775 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f559c013270 con 0x558541144370 2024-09-19T08:58:58.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.423+0000 7f558dffb640 1 -- 172.21.15.19:0/3768399775 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f55a00309b0 con 0x558541144370 2024-09-19T08:58:58.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.423+0000 7f55aef65740 10 client.16968 fetch_fsmap learned FSMap version 35 2024-09-19T08:58:58.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.423+0000 7f55aef65740 1 -- 172.21.15.19:0/3768399775 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5585411beb00 con 0x558541144370 2024-09-19T08:58:58.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.423+0000 7f558dffb640 1 -- 172.21.15.19:0/3768399775 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f55a0036050 con 0x558541144370 2024-09-19T08:58:58.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.423+0000 7f558dffb640 1 -- 172.21.15.19:0/3768399775 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 7757+0+0 (secure 0 0 0) 0x7f55a0030070 con 0x558541144370 2024-09-19T08:58:58.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.423+0000 7f55aef65740 10 client.16968 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:58:58.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.423+0000 7f55aef65740 10 client.16968 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T08:58:58.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.423+0000 7f55aef65740 20 client.16968 populate_metadata read hostname 'smithi019' 2024-09-19T08:58:58.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.423+0000 7f55aef65740 1 --2- 172.21.15.19:0/3768399775 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5585411bee30 0x5585411c1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:58:58.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.423+0000 7f55aef65740 4 client.16968 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:58:58.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.423+0000 7f55aef65740 1 -- 172.21.15.19:0/3768399775 --> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f559c013270 con 0x5585411bee30 2024-09-19T08:58:58.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.423+0000 7f55a659c640 1 --2- 172.21.15.19:0/3768399775 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5585411bee30 0x5585411c1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:58:58.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.424+0000 7f55a659c640 1 --2- 172.21.15.19:0/3768399775 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5585411bee30 0x5585411c1220 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2b38f264a2802e2f server_cookie=8ee10f11f7c6ef4e in_seq=0 out_seq=0 2024-09-19T08:58:58.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.424+0000 7f558dffb640 10 client.16968 ms_handle_connect on v2:172.21.15.203:6834/2702758353 2024-09-19T08:58:58.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.425+0000 7f558dffb640 1 -- 172.21.15.19:0/3768399775 <== mds.4 v2:172.21.15.203:6834/2702758353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f559c013270 con 0x5585411bee30 2024-09-19T08:58:58.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.425+0000 7f558dffb640 10 client.16968 handle_command_reply: tid=0 2024-09-19T08:58:58.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.425+0000 7f55aef65740 1 client.16968 shutdown 2024-09-19T08:58:58.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.425+0000 7f55aef65740 1 -- 172.21.15.19:0/3768399775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558541144370 msgr2=0x55854113e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:58.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.425+0000 7f55aef65740 1 --2- 172.21.15.19:0/3768399775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558541144370 0x55854113e090 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f55a0009ca0 tx=0x7f55a00095c0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.425+0000 7f55aef65740 1 -- 172.21.15.19:0/3768399775 shutdown_connections 2024-09-19T08:58:58.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.425+0000 7f55aef65740 1 --2- 172.21.15.19:0/3768399775 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5585411bee30 0x5585411c1220 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.425+0000 7f55aef65740 1 --2- 172.21.15.19:0/3768399775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55854113ab40 0x55854113db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.425+0000 7f55aef65740 1 --2- 172.21.15.19:0/3768399775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558541144370 0x55854113e090 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.425+0000 7f55aef65740 1 --2- 172.21.15.19:0/3768399775 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5585411395d0 0x55854114cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.425+0000 7f55aef65740 1 -- 172.21.15.19:0/3768399775 >> 172.21.15.19:0/3768399775 conn(0x558541102310 msgr2=0x558541134d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:58.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.425+0000 7f558dffb640 0 client.16968 ms_handle_reset on v2:172.21.15.203:6834/2702758353 2024-09-19T08:58:58.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.426+0000 7f55aef65740 1 -- 172.21.15.19:0/3768399775 shutdown_connections 2024-09-19T08:58:58.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.426+0000 7f55aef65740 1 -- 172.21.15.19:0/3768399775 wait complete. 2024-09-19T08:58:58.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.426+0000 7f55aef65740 20 client.16968 trim_cache size 0 max 16384 2024-09-19T08:58:58.431 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T08:58:58.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.426+0000 7f55acb8c640 1 -- 172.21.15.19:0/2280562443 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f55900a3240 msgr2=0x7f55900a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:58.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.426+0000 7f55acb8c640 1 --2- 172.21.15.19:0/2280562443 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f55900a3240 0x7f55900a5700 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f55a004c000 tx=0x7f55a004d000 comp rx=0 tx=0).stop 2024-09-19T08:58:58.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.426+0000 7f55acb8c640 1 -- 172.21.15.19:0/2280562443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55a8100a80 msgr2=0x7f55a819a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:58:58.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.426+0000 7f55acb8c640 1 --2- 172.21.15.19:0/2280562443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55a8100a80 0x7f55a819a690 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f559800e9f0 tx=0x7f559800eeb0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.426+0000 7f55acb8c640 1 -- 172.21.15.19:0/2280562443 shutdown_connections 2024-09-19T08:58:58.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.426+0000 7f55acb8c640 1 --2- 172.21.15.19:0/2280562443 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f55900a3240 0x7f55900a5700 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.426+0000 7f55acb8c640 1 --2- 172.21.15.19:0/2280562443 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f55a8106a80 0x7f55a819ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.426+0000 7f55acb8c640 1 --2- 172.21.15.19:0/2280562443 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f55a8101420 0x7f55a819abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.426+0000 7f55acb8c640 1 --2- 172.21.15.19:0/2280562443 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f55a8100a80 0x7f55a819a690 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:58:58.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.426+0000 7f55acb8c640 1 -- 172.21.15.19:0/2280562443 >> 172.21.15.19:0/2280562443 conn(0x7f55a80fc7a0 msgr2=0x7f55a806a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:58:58.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.426+0000 7f55acb8c640 1 -- 172.21.15.19:0/2280562443 shutdown_connections 2024-09-19T08:58:58.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:58:58.426+0000 7f55acb8c640 1 -- 172.21.15.19:0/2280562443 wait complete. 2024-09-19T08:58:59.627 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T08:58:59.894 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:58:59.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:58:59 smithi155 ceph-mon[34921]: pgmap v540: 97 pgs: 97 active+clean; 5.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.6 MiB/s wr, 2.12k op/s 2024-09-19T08:58:59.923 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:58:59 smithi155 podman[68793]: 2024-09-19 08:58:59.663565917 +0000 UTC m=+3.618353343 container init b8d118788cbe26ea4ea9cfa793d01584f0a586bd599dc0b168ddf1d7b4466cc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-e, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD) 2024-09-19T08:58:59.923 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:58:59 smithi155 podman[68793]: 2024-09-19 08:58:59.667526688 +0000 UTC m=+3.622314109 container start b8d118788cbe26ea4ea9cfa793d01584f0a586bd599dc0b168ddf1d7b4466cc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-e, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T08:58:59.923 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:58:59 smithi155 ceph-mds[68812]: -- 172.21.15.155:0/3331101407 <== mon.2 v2:172.21.15.155:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5597078f9c20 con 0x5597078d7400 2024-09-19T08:58:59.923 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:58:59 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-e[68808]: starting mds.e at 2024-09-19T08:58:59.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:58:59 smithi203 ceph-mon[35450]: pgmap v540: 97 pgs: 97 active+clean; 5.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.6 MiB/s wr, 2.12k op/s 2024-09-19T08:59:00.016 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:58:59 smithi019 ceph-mon[30976]: pgmap v540: 97 pgs: 97 active+clean; 5.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.6 MiB/s wr, 2.12k op/s 2024-09-19T08:59:00.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.405+0000 7f8d75798640 1 -- 172.21.15.19:0/1065115169 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d70101420 msgr2=0x7f8d7010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:00.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.405+0000 7f8d75798640 1 --2- 172.21.15.19:0/1065115169 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d70101420 0x7f8d7010d950 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f8d68009cd0 tx=0x7f8d6802a8e0 comp rx=0 tx=0).stop 2024-09-19T08:59:00.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.405+0000 7f8d75798640 1 -- 172.21.15.19:0/1065115169 shutdown_connections 2024-09-19T08:59:00.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.405+0000 7f8d75798640 1 --2- 172.21.15.19:0/1065115169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d70100a80 0x7f8d70100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:00.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.405+0000 7f8d75798640 1 --2- 172.21.15.19:0/1065115169 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d70101420 0x7f8d7010d950 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:00.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.405+0000 7f8d75798640 1 --2- 172.21.15.19:0/1065115169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d70106a80 0x7f8d70106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:00.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.405+0000 7f8d75798640 1 -- 172.21.15.19:0/1065115169 >> 172.21.15.19:0/1065115169 conn(0x7f8d700fc7a0 msgr2=0x7f8d700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:00.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.405+0000 7f8d75798640 1 -- 172.21.15.19:0/1065115169 shutdown_connections 2024-09-19T08:59:00.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.405+0000 7f8d75798640 1 -- 172.21.15.19:0/1065115169 wait complete. 2024-09-19T08:59:00.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.406+0000 7f8d75798640 1 Processor -- start 2024-09-19T08:59:00.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.406+0000 7f8d75798640 1 -- start start 2024-09-19T08:59:00.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.406+0000 7f8d75798640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d70100a80 0x7f8d700fce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:00.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.406+0000 7f8d75798640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d70101420 0x7f8d700fd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:00.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.406+0000 7f8d75798640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d70106a80 0x7f8d700fd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:00.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.406+0000 7f8d75798640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8d70110e80 con 0x7f8d70101420 2024-09-19T08:59:00.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.406+0000 7f8d75798640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8d70110d00 con 0x7f8d70100a80 2024-09-19T08:59:00.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.406+0000 7f8d75798640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8d70111000 con 0x7f8d70106a80 2024-09-19T08:59:00.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.406+0000 7f8d667fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d70101420 0x7f8d700fd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:00.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.406+0000 7f8d667fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d70101420 0x7f8d700fd360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56502/0 (socket says 172.21.15.19:56502) 2024-09-19T08:59:00.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.407+0000 7f8d6effd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d70100a80 0x7f8d700fce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:00.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.407+0000 7f8d667fc640 1 -- 172.21.15.19:0/1340444434 learned_addr learned my addr 172.21.15.19:0/1340444434 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:00.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.407+0000 7f8d6f7fe640 1 --2- 172.21.15.19:0/1340444434 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d70106a80 0x7f8d700fd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:00.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.407+0000 7f8d667fc640 1 -- 172.21.15.19:0/1340444434 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d70106a80 msgr2=0x7f8d700fd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:00.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.407+0000 7f8d667fc640 1 --2- 172.21.15.19:0/1340444434 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d70106a80 0x7f8d700fd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:00.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.407+0000 7f8d667fc640 1 -- 172.21.15.19:0/1340444434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d70100a80 msgr2=0x7f8d700fce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:00.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.407+0000 7f8d667fc640 1 --2- 172.21.15.19:0/1340444434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d70100a80 0x7f8d700fce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:00.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.407+0000 7f8d667fc640 1 -- 172.21.15.19:0/1340444434 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d701aadf0 con 0x7f8d70101420 2024-09-19T08:59:00.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.407+0000 7f8d6effd640 1 --2- 172.21.15.19:0/1340444434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d70100a80 0x7f8d700fce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:00.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.407+0000 7f8d667fc640 1 --2- 172.21.15.19:0/1340444434 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d70101420 0x7f8d700fd360 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f8d5800c890 tx=0x7f8d5800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:00.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.407+0000 7f8d6cff9640 1 -- 172.21.15.19:0/1340444434 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d58004220 con 0x7f8d70101420 2024-09-19T08:59:00.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.407+0000 7f8d6cff9640 1 -- 172.21.15.19:0/1340444434 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d580043c0 con 0x7f8d70101420 2024-09-19T08:59:00.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.407+0000 7f8d75798640 1 -- 172.21.15.19:0/1340444434 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d701aafc0 con 0x7f8d70101420 2024-09-19T08:59:00.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.407+0000 7f8d6cff9640 1 -- 172.21.15.19:0/1340444434 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d580049e0 con 0x7f8d70101420 2024-09-19T08:59:00.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.407+0000 7f8d75798640 1 -- 172.21.15.19:0/1340444434 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d701ab470 con 0x7f8d70101420 2024-09-19T08:59:00.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.410+0000 7f8d77b71740 1 Processor -- start 2024-09-19T08:59:00.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.410+0000 7f8d6cff9640 1 -- 172.21.15.19:0/1340444434 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f8d580079b0 con 0x7f8d70101420 2024-09-19T08:59:00.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.410+0000 7f8d77b71740 1 -- start start 2024-09-19T08:59:00.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.410+0000 7f8d77b71740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563f17e11b40 0x563f17e10090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:00.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.410+0000 7f8d77b71740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563f17e105d0 0x563f17e10a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:00.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.410+0000 7f8d77b71740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f17e1b370 0x563f17e1d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:00.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.410+0000 7f8d77b71740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563f17d762f0 con 0x563f17e1b370 2024-09-19T08:59:00.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.410+0000 7f8d77b71740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x563f17d1dcf0 con 0x563f17e105d0 2024-09-19T08:59:00.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.410+0000 7f8d77b71740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563f17d722b0 con 0x563f17e11b40 2024-09-19T08:59:00.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.410+0000 7f8d667fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f17e1b370 0x563f17e1d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:00.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.410+0000 7f8d6f7fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563f17e11b40 0x563f17e10090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:00.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.410+0000 7f8d6effd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563f17e105d0 0x563f17e10a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:00.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.410+0000 7f8d6f7fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563f17e11b40 0x563f17e10090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:60730/0 (socket says 172.21.15.19:60730) 2024-09-19T08:59:00.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.410+0000 7f8d667fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f17e1b370 0x563f17e1d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56516/0 (socket says 172.21.15.19:56516) 2024-09-19T08:59:00.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.410+0000 7f8d667fc640 1 -- 172.21.15.19:0/567316695 learned_addr learned my addr 172.21.15.19:0/567316695 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:00.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.411+0000 7f8d6f7fe640 1 -- 172.21.15.19:0/567316695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563f17e105d0 msgr2=0x563f17e10a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:00.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.411+0000 7f8d6f7fe640 1 --2- 172.21.15.19:0/567316695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563f17e105d0 0x563f17e10a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:00.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.411+0000 7f8d6f7fe640 1 -- 172.21.15.19:0/567316695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f17e1b370 msgr2=0x563f17e1d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:00.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.411+0000 7f8d6f7fe640 1 --2- 172.21.15.19:0/567316695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f17e1b370 0x563f17e1d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:00.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.411+0000 7f8d6f7fe640 1 -- 172.21.15.19:0/567316695 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f17d023a0 con 0x563f17e11b40 2024-09-19T08:59:00.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.411+0000 7f8d667fc640 1 --2- 172.21.15.19:0/567316695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f17e1b370 0x563f17e1d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:00.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.411+0000 7f8d6cff9640 1 --2- 172.21.15.19:0/1340444434 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8d5c0a3240 0x7f8d5c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:00.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.411+0000 7f8d6effd640 1 --2- 172.21.15.19:0/1340444434 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8d5c0a3240 0x7f8d5c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:00.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.411+0000 7f8d6f7fe640 1 --2- 172.21.15.19:0/567316695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563f17e11b40 0x563f17e10090 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8d68009ca0 tx=0x7f8d68009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3b6a7730a7f997c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:00.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.411+0000 7f8d6cff9640 1 -- 172.21.15.19:0/1340444434 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f8d580cf940 con 0x7f8d70101420 2024-09-19T08:59:00.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.411+0000 7f8d657fa640 1 -- 172.21.15.19:0/567316695 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d68048070 con 0x563f17e11b40 2024-09-19T08:59:00.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.411+0000 7f8d657fa640 1 -- 172.21.15.19:0/567316695 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d68036070 con 0x563f17e11b40 2024-09-19T08:59:00.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.411+0000 7f8d657fa640 1 -- 172.21.15.19:0/567316695 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d68004480 con 0x563f17e11b40 2024-09-19T08:59:00.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.412+0000 7f8d77b71740 1 -- 172.21.15.19:0/567316695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563f17e11b40 msgr2=0x563f17e10090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:00.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.412+0000 7f8d77b71740 1 --2- 172.21.15.19:0/567316695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563f17e11b40 0x563f17e10090 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8d68009ca0 tx=0x7f8d68009a20 comp rx=0 tx=0).stop 2024-09-19T08:59:00.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.412+0000 7f8d6effd640 1 --2- 172.21.15.19:0/1340444434 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8d5c0a3240 0x7f8d5c0a5700 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x563f17e0dac0 tx=0x7f8d60005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:00.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.412+0000 7f8d77b71740 1 -- 172.21.15.19:0/567316695 shutdown_connections 2024-09-19T08:59:00.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.412+0000 7f8d77b71740 1 --2- 172.21.15.19:0/567316695 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f17e1b370 0x563f17e1d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:00.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.412+0000 7f8d77b71740 1 --2- 172.21.15.19:0/567316695 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563f17e105d0 0x563f17e10a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:00.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.412+0000 7f8d77b71740 1 --2- 172.21.15.19:0/567316695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563f17e11b40 0x563f17e10090 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:00.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.412+0000 7f8d77b71740 1 -- 172.21.15.19:0/567316695 >> 172.21.15.19:0/567316695 conn(0x563f17dd9310 msgr2=0x563f17e0cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:00.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.412+0000 7f8d77b71740 1 -- 172.21.15.19:0/567316695 shutdown_connections 2024-09-19T08:59:00.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.412+0000 7f8d77b71740 1 -- 172.21.15.19:0/567316695 wait complete. 2024-09-19T08:59:00.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.413+0000 7f8d77b71740 1 -- start start 2024-09-19T08:59:00.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.413+0000 7f8d77b71740 1 Processor -- start 2024-09-19T08:59:00.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.413+0000 7f8d77b71740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563f17e105d0 0x563f17e1ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:00.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.413+0000 7f8d77b71740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f17e11b40 0x563f17e18000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:00.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.413+0000 7f8d77b71740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563f17e1b370 0x563f17e185d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:00.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.413+0000 7f8d77b71740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563f17e1e010 con 0x563f17e11b40 2024-09-19T08:59:00.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.413+0000 7f8d77b71740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x563f17d31060 con 0x563f17e105d0 2024-09-19T08:59:00.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.413+0000 7f8d77b71740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563f17e1e190 con 0x563f17e1b370 2024-09-19T08:59:00.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.413+0000 7f8d77b71740 10 client.0 _ll_register_callbacks cb 0x563f17a848c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:00.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.413+0000 7f8d667fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f17e11b40 0x563f17e18000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:00.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.413+0000 7f8d667fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f17e11b40 0x563f17e18000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56520/0 (socket says 172.21.15.19:56520) 2024-09-19T08:59:00.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.413+0000 7f8d667fc640 1 -- 172.21.15.19:0/2913042408 learned_addr learned my addr 172.21.15.19:0/2913042408 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:00.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.413+0000 7f8d6f7fe640 1 --2- 172.21.15.19:0/2913042408 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563f17e1b370 0x563f17e185d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:00.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.413+0000 7f8d6effd640 1 --2- 172.21.15.19:0/2913042408 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563f17e105d0 0x563f17e1ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:00.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.414+0000 7f8d667fc640 1 -- 172.21.15.19:0/2913042408 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563f17e1b370 msgr2=0x563f17e185d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:00.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.414+0000 7f8d667fc640 1 --2- 172.21.15.19:0/2913042408 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563f17e1b370 0x563f17e185d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:00.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.414+0000 7f8d667fc640 1 -- 172.21.15.19:0/2913042408 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563f17e105d0 msgr2=0x563f17e1ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:00.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.414+0000 7f8d667fc640 1 --2- 172.21.15.19:0/2913042408 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563f17e105d0 0x563f17e1ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:00.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.414+0000 7f8d667fc640 1 -- 172.21.15.19:0/2913042408 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f17ae73c0 con 0x563f17e11b40 2024-09-19T08:59:00.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.414+0000 7f8d667fc640 1 --2- 172.21.15.19:0/2913042408 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f17e11b40 0x563f17e18000 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f8d580cd4a0 tx=0x7f8d580d5240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a63e3875e8d1c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:00.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.414+0000 7f8d567fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:59:00.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.414+0000 7f8d567fc640 1 -- 172.21.15.19:0/2913042408 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5801d040 con 0x563f17e11b40 2024-09-19T08:59:00.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.414+0000 7f8d567fc640 1 -- 172.21.15.19:0/2913042408 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f8d58007ca0 con 0x563f17e11b40 2024-09-19T08:59:00.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.414+0000 7f8d77b71740 1 -- 172.21.15.19:0/2913042408 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d68036070 con 0x563f17e11b40 2024-09-19T08:59:00.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.414+0000 7f8d567fc640 1 -- 172.21.15.19:0/2913042408 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f8d580b6030 con 0x563f17e11b40 2024-09-19T08:59:00.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.414+0000 7f8d77b71740 10 client.16986 fetch_fsmap learned FSMap version 35 2024-09-19T08:59:00.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.414+0000 7f8d77b71740 1 -- 172.21.15.19:0/2913042408 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x563f17e29af0 con 0x563f17e11b40 2024-09-19T08:59:00.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.414+0000 7f8d567fc640 1 -- 172.21.15.19:0/2913042408 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d68036070 con 0x563f17e11b40 2024-09-19T08:59:00.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.414+0000 7f8d567fc640 1 -- 172.21.15.19:0/2913042408 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 7757+0+0 (secure 0 0 0) 0x7f8d580a4750 con 0x563f17e11b40 2024-09-19T08:59:00.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.415+0000 7f8d77b71740 10 client.16986 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:59:00.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.415+0000 7f8d77b71740 10 client.16986 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-19T08:59:00.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.415+0000 7f8d77b71740 20 client.16986 populate_metadata read hostname 'smithi019' 2024-09-19T08:59:00.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.415+0000 7f8d77b71740 1 --2- 172.21.15.19:0/2913042408 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x563f17e2af00 0x563f17e2d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:00.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.415+0000 7f8d77b71740 4 client.16986 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:59:00.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.415+0000 7f8d77b71740 1 -- 172.21.15.19:0/2913042408 --> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f17d83860 con 0x563f17e2af00 2024-09-19T08:59:00.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.415+0000 7f8d6effd640 1 --2- 172.21.15.19:0/2913042408 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x563f17e2af00 0x563f17e2d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:00.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.415+0000 7f8d6effd640 1 --2- 172.21.15.19:0/2913042408 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x563f17e2af00 0x563f17e2d2f0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e1ddce66cabfd6f2 server_cookie=1b4c0cbe4e818838 in_seq=0 out_seq=0 2024-09-19T08:59:00.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.415+0000 7f8d567fc640 10 client.16986 ms_handle_connect on v2:172.21.15.155:6836/3381010945 2024-09-19T08:59:00.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.417+0000 7f8d567fc640 1 -- 172.21.15.19:0/2913042408 <== mds.3 v2:172.21.15.155:6836/3381010945 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563f17d83860 con 0x563f17e2af00 2024-09-19T08:59:00.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.417+0000 7f8d567fc640 10 client.16986 handle_command_reply: tid=0 2024-09-19T08:59:00.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.417+0000 7f8d77b71740 1 client.16986 shutdown 2024-09-19T08:59:00.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.417+0000 7f8d77b71740 1 -- 172.21.15.19:0/2913042408 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f17e11b40 msgr2=0x563f17e18000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:00.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.417+0000 7f8d77b71740 1 --2- 172.21.15.19:0/2913042408 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f17e11b40 0x563f17e18000 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f8d580cd4a0 tx=0x7f8d580d5240 comp rx=0 tx=0).stop 2024-09-19T08:59:00.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.417+0000 7f8d77b71740 1 -- 172.21.15.19:0/2913042408 shutdown_connections 2024-09-19T08:59:00.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.417+0000 7f8d77b71740 1 --2- 172.21.15.19:0/2913042408 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x563f17e2af00 0x563f17e2d2f0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:00.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.417+0000 7f8d77b71740 1 --2- 172.21.15.19:0/2913042408 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563f17e1b370 0x563f17e185d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:00.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.417+0000 7f8d77b71740 1 --2- 172.21.15.19:0/2913042408 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f17e11b40 0x563f17e18000 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:00.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.417+0000 7f8d77b71740 1 --2- 172.21.15.19:0/2913042408 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563f17e105d0 0x563f17e1ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:00.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.417+0000 7f8d567fc640 0 client.16986 ms_handle_reset on v2:172.21.15.155:6836/3381010945 2024-09-19T08:59:00.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.417+0000 7f8d77b71740 1 -- 172.21.15.19:0/2913042408 >> 172.21.15.19:0/2913042408 conn(0x563f17dd9310 msgr2=0x563f17e12960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:00.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.417+0000 7f8d77b71740 1 -- 172.21.15.19:0/2913042408 shutdown_connections 2024-09-19T08:59:00.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.417+0000 7f8d77b71740 1 -- 172.21.15.19:0/2913042408 wait complete. 2024-09-19T08:59:00.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.418+0000 7f8d77b71740 20 client.16986 trim_cache size 0 max 16384 2024-09-19T08:59:00.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.431+0000 7f8d77b71740 1 Processor -- start 2024-09-19T08:59:00.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.431+0000 7f8d77b71740 1 -- start start 2024-09-19T08:59:00.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.431+0000 7f8d77b71740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563f17e105d0 0x563f17e13120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:00.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.431+0000 7f8d77b71740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563f17e11b40 0x563f17e13660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:00.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.431+0000 7f8d77b71740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f17e1b370 0x563f17e32bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:00.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.431+0000 7f8d77b71740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8d701b5610 con 0x563f17e1b370 2024-09-19T08:59:00.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.431+0000 7f8d77b71740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8d701b3400 con 0x563f17e11b40 2024-09-19T08:59:00.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.431+0000 7f8d77b71740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8d701b4f40 con 0x563f17e105d0 2024-09-19T08:59:00.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.432+0000 7f8d6f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f17e1b370 0x563f17e32bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:00.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.432+0000 7f8d6f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f17e1b370 0x563f17e32bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56524/0 (socket says 172.21.15.19:56524) 2024-09-19T08:59:00.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.432+0000 7f8d667fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563f17e11b40 0x563f17e13660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:00.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.432+0000 7f8d6f7fe640 1 -- 172.21.15.19:0/1521668727 learned_addr learned my addr 172.21.15.19:0/1521668727 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:00.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.432+0000 7f8d6effd640 1 --2- 172.21.15.19:0/1521668727 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563f17e105d0 0x563f17e13120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:00.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.432+0000 7f8d6f7fe640 1 -- 172.21.15.19:0/1521668727 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563f17e105d0 msgr2=0x563f17e13120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:00.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.432+0000 7f8d6f7fe640 1 --2- 172.21.15.19:0/1521668727 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563f17e105d0 0x563f17e13120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:00.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.432+0000 7f8d6f7fe640 1 -- 172.21.15.19:0/1521668727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563f17e11b40 msgr2=0x563f17e13660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:00.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.432+0000 7f8d6f7fe640 1 --2- 172.21.15.19:0/1521668727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563f17e11b40 0x563f17e13660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:00.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.432+0000 7f8d6f7fe640 1 -- 172.21.15.19:0/1521668727 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f17e1b0c0 con 0x563f17e1b370 2024-09-19T08:59:00.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.432+0000 7f8d667fc640 1 --2- 172.21.15.19:0/1521668727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563f17e11b40 0x563f17e13660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:00.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.432+0000 7f8d6f7fe640 1 --2- 172.21.15.19:0/1521668727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f17e1b370 0x563f17e32bc0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f8d68009ca0 tx=0x7f8d680040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f41281240571c80 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:00.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.432+0000 7f8d64ff9640 1 -- 172.21.15.19:0/1521668727 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d68048040 con 0x563f17e1b370 2024-09-19T08:59:00.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.432+0000 7f8d64ff9640 1 -- 172.21.15.19:0/1521668727 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d68036040 con 0x563f17e1b370 2024-09-19T08:59:00.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.432+0000 7f8d64ff9640 1 -- 172.21.15.19:0/1521668727 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d68004440 con 0x563f17e1b370 2024-09-19T08:59:00.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.433+0000 7f8d77b71740 1 -- 172.21.15.19:0/1521668727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f17e1b370 msgr2=0x563f17e32bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:00.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.433+0000 7f8d77b71740 1 --2- 172.21.15.19:0/1521668727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f17e1b370 0x563f17e32bc0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f8d68009ca0 tx=0x7f8d680040e0 comp rx=0 tx=0).stop 2024-09-19T08:59:00.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.433+0000 7f8d77b71740 1 -- 172.21.15.19:0/1521668727 shutdown_connections 2024-09-19T08:59:00.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.433+0000 7f8d77b71740 1 --2- 172.21.15.19:0/1521668727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f17e1b370 0x563f17e32bc0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:00.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.433+0000 7f8d77b71740 1 --2- 172.21.15.19:0/1521668727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563f17e11b40 0x563f17e13660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:00.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.433+0000 7f8d77b71740 1 --2- 172.21.15.19:0/1521668727 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563f17e105d0 0x563f17e13120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:00.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.433+0000 7f8d77b71740 1 -- 172.21.15.19:0/1521668727 >> 172.21.15.19:0/1521668727 conn(0x563f17dd9310 msgr2=0x563f17e1a080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:00.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.433+0000 7f8d77b71740 1 -- 172.21.15.19:0/1521668727 shutdown_connections 2024-09-19T08:59:00.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.433+0000 7f8d77b71740 1 -- 172.21.15.19:0/1521668727 wait complete. 2024-09-19T08:59:00.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.434+0000 7f8d77b71740 1 -- start start 2024-09-19T08:59:00.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.434+0000 7f8d77b71740 1 Processor -- start 2024-09-19T08:59:00.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.434+0000 7f8d77b71740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563f17e105d0 0x563f17e23ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:00.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.434+0000 7f8d77b71740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f17e11b40 0x563f17e14ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:00.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.434+0000 7f8d77b71740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563f17e1b370 0x563f17e15680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:00.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.434+0000 7f8d77b71740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8d701b41a0 con 0x563f17e11b40 2024-09-19T08:59:00.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.434+0000 7f8d77b71740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8d701b3ad0 con 0x563f17e1b370 2024-09-19T08:59:00.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.434+0000 7f8d77b71740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8d701b4870 con 0x563f17e105d0 2024-09-19T08:59:00.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.434+0000 7f8d77b71740 10 client.0 _ll_register_callbacks cb 0x7f8d580058c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:00.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.434+0000 7f8d667fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f17e11b40 0x563f17e14ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:00.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.434+0000 7f8d667fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f17e11b40 0x563f17e14ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56526/0 (socket says 172.21.15.19:56526) 2024-09-19T08:59:00.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.434+0000 7f8d667fc640 1 -- 172.21.15.19:0/3744521913 learned_addr learned my addr 172.21.15.19:0/3744521913 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:00.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.434+0000 7f8d6effd640 1 --2- 172.21.15.19:0/3744521913 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563f17e105d0 0x563f17e23ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:00.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.434+0000 7f8d6f7fe640 1 --2- 172.21.15.19:0/3744521913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563f17e1b370 0x563f17e15680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:00.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.434+0000 7f8d667fc640 1 -- 172.21.15.19:0/3744521913 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563f17e105d0 msgr2=0x563f17e23ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:00.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.434+0000 7f8d667fc640 1 --2- 172.21.15.19:0/3744521913 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563f17e105d0 0x563f17e23ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:00.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.434+0000 7f8d667fc640 1 -- 172.21.15.19:0/3744521913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563f17e1b370 msgr2=0x563f17e15680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:00.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.435+0000 7f8d667fc640 1 --2- 172.21.15.19:0/3744521913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563f17e1b370 0x563f17e15680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:00.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.435+0000 7f8d667fc640 1 -- 172.21.15.19:0/3744521913 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f17e94b90 con 0x563f17e11b40 2024-09-19T08:59:00.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.435+0000 7f8d667fc640 1 --2- 172.21.15.19:0/3744521913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f17e11b40 0x563f17e14ef0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f8d580989f0 tx=0x7f8d580d5600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=467501293d6b9fb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:00.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.435+0000 7f8d567fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:59:00.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.435+0000 7f8d567fc640 1 -- 172.21.15.19:0/3744521913 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d5801d040 con 0x563f17e11b40 2024-09-19T08:59:00.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.435+0000 7f8d567fc640 1 -- 172.21.15.19:0/3744521913 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f8d580babb0 con 0x563f17e11b40 2024-09-19T08:59:00.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.435+0000 7f8d77b71740 1 -- 172.21.15.19:0/3744521913 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d68036040 con 0x563f17e11b40 2024-09-19T08:59:00.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.435+0000 7f8d567fc640 1 -- 172.21.15.19:0/3744521913 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f8d5809bb60 con 0x563f17e11b40 2024-09-19T08:59:00.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.435+0000 7f8d77b71740 10 client.16992 fetch_fsmap learned FSMap version 35 2024-09-19T08:59:00.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.435+0000 7f8d77b71740 1 -- 172.21.15.19:0/3744521913 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x563f17e95d50 con 0x563f17e11b40 2024-09-19T08:59:00.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.435+0000 7f8d567fc640 1 -- 172.21.15.19:0/3744521913 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d68036040 con 0x563f17e11b40 2024-09-19T08:59:00.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.435+0000 7f8d567fc640 1 -- 172.21.15.19:0/3744521913 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 35) ==== 7757+0+0 (secure 0 0 0) 0x7f8d58096b90 con 0x563f17e11b40 2024-09-19T08:59:00.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.435+0000 7f8d77b71740 10 client.16992 fetch_fsmap finished waiting for FSMap version 35 2024-09-19T08:59:00.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.435+0000 7f8d77b71740 10 client.16992 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-19T08:59:00.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.435+0000 7f8d77b71740 20 client.16992 populate_metadata read hostname 'smithi019' 2024-09-19T08:59:00.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.435+0000 7f8d77b71740 1 --2- 172.21.15.19:0/3744521913 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x563f17e962b0 0x563f17e986d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:00.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.435+0000 7f8d77b71740 4 client.16992 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:59:00.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.435+0000 7f8d77b71740 1 -- 172.21.15.19:0/3744521913 --> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563f17d7dd70 con 0x563f17e962b0 2024-09-19T08:59:00.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.436+0000 7f8d6effd640 1 --2- 172.21.15.19:0/3744521913 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x563f17e962b0 0x563f17e986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:00.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.436+0000 7f8d6effd640 1 --2- 172.21.15.19:0/3744521913 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x563f17e962b0 0x563f17e986d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e7e4ff6a36e8d2a4 server_cookie=d30570c8c84de4b in_seq=0 out_seq=0 2024-09-19T08:59:00.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.436+0000 7f8d567fc640 10 client.16992 ms_handle_connect on v2:172.21.15.155:6836/3381010945 2024-09-19T08:59:00.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.438+0000 7f8d567fc640 1 -- 172.21.15.19:0/3744521913 <== mds.3 v2:172.21.15.155:6836/3381010945 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563f17d7dd70 con 0x563f17e962b0 2024-09-19T08:59:00.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.438+0000 7f8d567fc640 10 client.16992 handle_command_reply: tid=0 2024-09-19T08:59:00.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.438+0000 7f8d77b71740 1 client.16992 shutdown 2024-09-19T08:59:00.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.438+0000 7f8d77b71740 1 -- 172.21.15.19:0/3744521913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f17e11b40 msgr2=0x563f17e14ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:00.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.438+0000 7f8d77b71740 1 --2- 172.21.15.19:0/3744521913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f17e11b40 0x563f17e14ef0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f8d580989f0 tx=0x7f8d580d5600 comp rx=0 tx=0).stop 2024-09-19T08:59:00.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.438+0000 7f8d77b71740 1 -- 172.21.15.19:0/3744521913 shutdown_connections 2024-09-19T08:59:00.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.438+0000 7f8d77b71740 1 --2- 172.21.15.19:0/3744521913 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x563f17e962b0 0x563f17e986d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:00.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.438+0000 7f8d77b71740 1 --2- 172.21.15.19:0/3744521913 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563f17e1b370 0x563f17e15680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:00.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.438+0000 7f8d77b71740 1 --2- 172.21.15.19:0/3744521913 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563f17e11b40 0x563f17e14ef0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:00.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.438+0000 7f8d77b71740 1 --2- 172.21.15.19:0/3744521913 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563f17e105d0 0x563f17e23ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:00.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.438+0000 7f8d77b71740 1 -- 172.21.15.19:0/3744521913 >> 172.21.15.19:0/3744521913 conn(0x563f17dd9310 msgr2=0x563f17e0b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:00.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.438+0000 7f8d567fc640 0 client.16992 ms_handle_reset on v2:172.21.15.155:6836/3381010945 2024-09-19T08:59:00.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.438+0000 7f8d77b71740 1 -- 172.21.15.19:0/3744521913 shutdown_connections 2024-09-19T08:59:00.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.438+0000 7f8d77b71740 1 -- 172.21.15.19:0/3744521913 wait complete. 2024-09-19T08:59:00.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.438+0000 7f8d77b71740 20 client.16992 trim_cache size 0 max 16384 2024-09-19T08:59:00.444 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T08:59:00.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.439+0000 7f8d75798640 1 -- 172.21.15.19:0/1340444434 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8d5c0a3240 msgr2=0x7f8d5c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:00.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.439+0000 7f8d75798640 1 --2- 172.21.15.19:0/1340444434 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8d5c0a3240 0x7f8d5c0a5700 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x563f17e0dac0 tx=0x7f8d60005f90 comp rx=0 tx=0).stop 2024-09-19T08:59:00.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.439+0000 7f8d75798640 1 -- 172.21.15.19:0/1340444434 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d70101420 msgr2=0x7f8d700fd360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:00.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.439+0000 7f8d75798640 1 --2- 172.21.15.19:0/1340444434 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d70101420 0x7f8d700fd360 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f8d5800c890 tx=0x7f8d5800cd50 comp rx=0 tx=0).stop 2024-09-19T08:59:00.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.439+0000 7f8d75798640 1 -- 172.21.15.19:0/1340444434 shutdown_connections 2024-09-19T08:59:00.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.439+0000 7f8d75798640 1 --2- 172.21.15.19:0/1340444434 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8d5c0a3240 0x7f8d5c0a5700 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:00.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.439+0000 7f8d75798640 1 --2- 172.21.15.19:0/1340444434 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d70106a80 0x7f8d700fd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:00.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.439+0000 7f8d75798640 1 --2- 172.21.15.19:0/1340444434 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d70101420 0x7f8d700fd360 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:00.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.439+0000 7f8d75798640 1 --2- 172.21.15.19:0/1340444434 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d70100a80 0x7f8d700fce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:00.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.439+0000 7f8d75798640 1 -- 172.21.15.19:0/1340444434 >> 172.21.15.19:0/1340444434 conn(0x7f8d700fc7a0 msgr2=0x7f8d7006aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:00.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.439+0000 7f8d75798640 1 -- 172.21.15.19:0/1340444434 shutdown_connections 2024-09-19T08:59:00.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:00.439+0000 7f8d75798640 1 -- 172.21.15.19:0/1340444434 wait complete. 2024-09-19T08:59:01.422 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:59:00 smithi155 bash[68793]: b8d118788cbe26ea4ea9cfa793d01584f0a586bd599dc0b168ddf1d7b4466cc6 2024-09-19T08:59:01.423 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 08:59:00 smithi155 systemd[1]: Started Ceph mds.e for f26c9d84-7662-11ef-bceb-c7b262605968. 2024-09-19T08:59:01.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:01 smithi203 ceph-mon[35450]: pgmap v541: 97 pgs: 97 active+clean; 5.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.4 MiB/s wr, 2.12k op/s 2024-09-19T08:59:01.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:01 smithi203 ceph-mon[35450]: mds.? [v2:172.21.15.155:6834/3907362737,v1:172.21.15.155:6835/3907362737] up:boot 2024-09-19T08:59:01.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:01 smithi203 ceph-mon[35450]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T08:59:01.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:01 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T08:59:02.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:01 smithi019 ceph-mon[30976]: pgmap v541: 97 pgs: 97 active+clean; 5.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.4 MiB/s wr, 2.12k op/s 2024-09-19T08:59:02.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:01 smithi019 ceph-mon[30976]: mds.? [v2:172.21.15.155:6834/3907362737,v1:172.21.15.155:6835/3907362737] up:boot 2024-09-19T08:59:02.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:01 smithi019 ceph-mon[30976]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T08:59:02.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:01 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T08:59:02.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:01 smithi155 ceph-mon[34921]: pgmap v541: 97 pgs: 97 active+clean; 5.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.4 MiB/s wr, 2.12k op/s 2024-09-19T08:59:02.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:01 smithi155 ceph-mon[34921]: mds.? [v2:172.21.15.155:6834/3907362737,v1:172.21.15.155:6835/3907362737] up:boot 2024-09-19T08:59:02.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:01 smithi155 ceph-mon[34921]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T08:59:02.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:01 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T08:59:02.833 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T08:59:03.093 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:59:03.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.558+0000 7fa547851640 1 -- 172.21.15.19:0/2196531803 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa54010e480 msgr2=0x7fa540110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:03.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.558+0000 7fa547851640 1 --2- 172.21.15.19:0/2196531803 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa54010e480 0x7fa540110870 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fa538009ca0 tx=0x7fa53802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:59:03.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.558+0000 7fa547851640 1 -- 172.21.15.19:0/2196531803 shutdown_connections 2024-09-19T08:59:03.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.558+0000 7fa547851640 1 --2- 172.21.15.19:0/2196531803 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa54010e480 0x7fa540110870 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:03.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.558+0000 7fa547851640 1 --2- 172.21.15.19:0/2196531803 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa540101280 0x7fa54010df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:03.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.558+0000 7fa547851640 1 --2- 172.21.15.19:0/2196531803 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa5401008d0 0x7fa540100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:03.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.558+0000 7fa547851640 1 -- 172.21.15.19:0/2196531803 >> 172.21.15.19:0/2196531803 conn(0x7fa5400fc7a0 msgr2=0x7fa5400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:03.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.558+0000 7fa547851640 1 -- 172.21.15.19:0/2196531803 shutdown_connections 2024-09-19T08:59:03.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.558+0000 7fa547851640 1 -- 172.21.15.19:0/2196531803 wait complete. 2024-09-19T08:59:03.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.558+0000 7fa547851640 1 Processor -- start 2024-09-19T08:59:03.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.559+0000 7fa547851640 1 -- start start 2024-09-19T08:59:03.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.559+0000 7fa547851640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa5401008d0 0x7fa54019a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:03.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.559+0000 7fa547851640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa540101280 0x7fa54019ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:03.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.559+0000 7fa547851640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa54010e480 0x7fa54019ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:03.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.559+0000 7fa547851640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa540114170 con 0x7fa54010e480 2024-09-19T08:59:03.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.559+0000 7fa547851640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa540113ff0 con 0x7fa540101280 2024-09-19T08:59:03.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.559+0000 7fa547851640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa5401142f0 con 0x7fa5401008d0 2024-09-19T08:59:03.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.559+0000 7fa545dee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa54010e480 0x7fa54019ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:03.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.559+0000 7fa545dee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa54010e480 0x7fa54019ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56538/0 (socket says 172.21.15.19:56538) 2024-09-19T08:59:03.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.559+0000 7fa545dee640 1 -- 172.21.15.19:0/2384808192 learned_addr learned my addr 172.21.15.19:0/2384808192 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:03.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.559+0000 7fa544dec640 1 --2- 172.21.15.19:0/2384808192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa540101280 0x7fa54019ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:03.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.559+0000 7fa5455ed640 1 --2- 172.21.15.19:0/2384808192 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa5401008d0 0x7fa54019a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:03.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.559+0000 7fa545dee640 1 -- 172.21.15.19:0/2384808192 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa5401008d0 msgr2=0x7fa54019a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:03.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.559+0000 7fa545dee640 1 --2- 172.21.15.19:0/2384808192 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa5401008d0 0x7fa54019a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:03.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.559+0000 7fa545dee640 1 -- 172.21.15.19:0/2384808192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa540101280 msgr2=0x7fa54019ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:03.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.559+0000 7fa545dee640 1 --2- 172.21.15.19:0/2384808192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa540101280 0x7fa54019ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:03.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.559+0000 7fa545dee640 1 -- 172.21.15.19:0/2384808192 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa54019f600 con 0x7fa54010e480 2024-09-19T08:59:03.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.560+0000 7fa545dee640 1 --2- 172.21.15.19:0/2384808192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa54010e480 0x7fa54019ef20 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fa53802ade0 tx=0x7fa5380319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:03.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.560+0000 7fa5367fc640 1 -- 172.21.15.19:0/2384808192 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa538003c30 con 0x7fa54010e480 2024-09-19T08:59:03.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.560+0000 7fa5367fc640 1 -- 172.21.15.19:0/2384808192 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa538003dd0 con 0x7fa54010e480 2024-09-19T08:59:03.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.560+0000 7fa547851640 1 -- 172.21.15.19:0/2384808192 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa54019f890 con 0x7fa54010e480 2024-09-19T08:59:03.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.560+0000 7fa5367fc640 1 -- 172.21.15.19:0/2384808192 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53802fc40 con 0x7fa54010e480 2024-09-19T08:59:03.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.560+0000 7fa547851640 1 -- 172.21.15.19:0/2384808192 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5401a71d0 con 0x7fa54010e480 2024-09-19T08:59:03.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.562+0000 7fa5367fc640 1 -- 172.21.15.19:0/2384808192 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fa538004050 con 0x7fa54010e480 2024-09-19T08:59:03.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.562+0000 7fa549c2a740 1 Processor -- start 2024-09-19T08:59:03.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.563+0000 7fa549c2a740 1 -- start start 2024-09-19T08:59:03.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.563+0000 7fa549c2a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565148d60b40 0x565148d5f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:03.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.563+0000 7fa549c2a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565148d5f5d0 0x565148d5fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:03.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.563+0000 7fa549c2a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565148d6a370 0x565148d6c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:03.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.563+0000 7fa549c2a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x565148cc52f0 con 0x565148d60b40 2024-09-19T08:59:03.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.563+0000 7fa549c2a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x565148c6ccf0 con 0x565148d5f5d0 2024-09-19T08:59:03.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.563+0000 7fa549c2a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x565148cc12b0 con 0x565148d6a370 2024-09-19T08:59:03.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.563+0000 7fa544dec640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565148d60b40 0x565148d5f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:03.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.563+0000 7fa544dec640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565148d60b40 0x565148d5f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56548/0 (socket says 172.21.15.19:56548) 2024-09-19T08:59:03.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.563+0000 7fa544dec640 1 -- 172.21.15.19:0/1532457302 learned_addr learned my addr 172.21.15.19:0/1532457302 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:03.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.563+0000 7fa5455ed640 1 --2- 172.21.15.19:0/1532457302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565148d5f5d0 0x565148d5fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:03.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.563+0000 7fa544dec640 1 --2- 172.21.15.19:0/1532457302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565148d6a370 0x565148d6c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:03.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.563+0000 7fa544dec640 1 -- 172.21.15.19:0/1532457302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565148d6a370 msgr2=0x565148d6c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:03.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.563+0000 7fa544dec640 1 --2- 172.21.15.19:0/1532457302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565148d6a370 0x565148d6c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:03.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.563+0000 7fa544dec640 1 -- 172.21.15.19:0/1532457302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565148d5f5d0 msgr2=0x565148d5fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:03.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.563+0000 7fa544dec640 1 --2- 172.21.15.19:0/1532457302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565148d5f5d0 0x565148d5fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:03.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.563+0000 7fa544dec640 1 -- 172.21.15.19:0/1532457302 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565148c513a0 con 0x565148d60b40 2024-09-19T08:59:03.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.563+0000 7fa5367fc640 1 --2- 172.21.15.19:0/2384808192 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa52c0a3240 0x7fa52c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:03.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.563+0000 7fa544dec640 1 --2- 172.21.15.19:0/1532457302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565148d60b40 0x565148d5f090 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fa5300058c0 tx=0x7fa530005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=579e9a8b7cef6f4c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:03.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.563+0000 7fa5455ed640 1 --2- 172.21.15.19:0/2384808192 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa52c0a3240 0x7fa52c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:03.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.564+0000 7fa5367fc640 1 -- 172.21.15.19:0/2384808192 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa5380f09b0 con 0x7fa54010e480 2024-09-19T08:59:03.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.564+0000 7fa52b7fe640 1 -- 172.21.15.19:0/1532457302 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa530004050 con 0x565148d60b40 2024-09-19T08:59:03.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.564+0000 7fa52b7fe640 1 -- 172.21.15.19:0/1532457302 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa5300041f0 con 0x565148d60b40 2024-09-19T08:59:03.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.564+0000 7fa52b7fe640 1 -- 172.21.15.19:0/1532457302 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53000f740 con 0x565148d60b40 2024-09-19T08:59:03.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.564+0000 7fa549c2a740 1 -- 172.21.15.19:0/1532457302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565148d60b40 msgr2=0x565148d5f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:03.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.564+0000 7fa549c2a740 1 --2- 172.21.15.19:0/1532457302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565148d60b40 0x565148d5f090 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fa5300058c0 tx=0x7fa530005850 comp rx=0 tx=0).stop 2024-09-19T08:59:03.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.564+0000 7fa5455ed640 1 --2- 172.21.15.19:0/2384808192 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa52c0a3240 0x7fa52c0a5700 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x565148d5cac0 tx=0x7fa53c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:03.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.565+0000 7fa549c2a740 1 -- 172.21.15.19:0/1532457302 shutdown_connections 2024-09-19T08:59:03.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.565+0000 7fa549c2a740 1 --2- 172.21.15.19:0/1532457302 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565148d6a370 0x565148d6c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:03.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.565+0000 7fa549c2a740 1 --2- 172.21.15.19:0/1532457302 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565148d5f5d0 0x565148d5fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:03.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.565+0000 7fa549c2a740 1 --2- 172.21.15.19:0/1532457302 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565148d60b40 0x565148d5f090 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:03.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.565+0000 7fa549c2a740 1 -- 172.21.15.19:0/1532457302 >> 172.21.15.19:0/1532457302 conn(0x565148d28310 msgr2=0x565148d5bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:03.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.565+0000 7fa549c2a740 1 -- 172.21.15.19:0/1532457302 shutdown_connections 2024-09-19T08:59:03.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.565+0000 7fa549c2a740 1 -- 172.21.15.19:0/1532457302 wait complete. 2024-09-19T08:59:03.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.565+0000 7fa549c2a740 1 -- start start 2024-09-19T08:59:03.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.565+0000 7fa549c2a740 1 Processor -- start 2024-09-19T08:59:03.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.565+0000 7fa549c2a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565148d5f5d0 0x565148d69d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:03.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.565+0000 7fa549c2a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565148d60b40 0x565148d66fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:03.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.565+0000 7fa549c2a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565148d6a370 0x565148d675d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:03.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.565+0000 7fa549c2a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x565148d6d010 con 0x565148d5f5d0 2024-09-19T08:59:03.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.565+0000 7fa549c2a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x565148c80060 con 0x565148d6a370 2024-09-19T08:59:03.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.566+0000 7fa549c2a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x565148d6d190 con 0x565148d60b40 2024-09-19T08:59:03.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.566+0000 7fa549c2a740 10 client.0 _ll_register_callbacks cb 0x5651489d38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:03.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.566+0000 7fa5455ed640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565148d5f5d0 0x565148d69d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:03.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.566+0000 7fa5455ed640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565148d5f5d0 0x565148d69d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56560/0 (socket says 172.21.15.19:56560) 2024-09-19T08:59:03.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.566+0000 7fa545dee640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565148d6a370 0x565148d675d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:03.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.566+0000 7fa5455ed640 1 -- 172.21.15.19:0/1347317153 learned_addr learned my addr 172.21.15.19:0/1347317153 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:03.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.566+0000 7fa544dec640 1 --2- 172.21.15.19:0/1347317153 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565148d60b40 0x565148d66fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:03.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.566+0000 7fa5455ed640 1 -- 172.21.15.19:0/1347317153 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565148d60b40 msgr2=0x565148d66fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:03.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.566+0000 7fa5455ed640 1 --2- 172.21.15.19:0/1347317153 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565148d60b40 0x565148d66fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:03.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.566+0000 7fa5455ed640 1 -- 172.21.15.19:0/1347317153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565148d6a370 msgr2=0x565148d675d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:03.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.566+0000 7fa5455ed640 1 --2- 172.21.15.19:0/1347317153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565148d6a370 0x565148d675d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:03.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.566+0000 7fa5455ed640 1 -- 172.21.15.19:0/1347317153 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565148a363c0 con 0x565148d5f5d0 2024-09-19T08:59:03.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.566+0000 7fa545dee640 1 --2- 172.21.15.19:0/1347317153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565148d6a370 0x565148d675d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:03.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.566+0000 7fa5455ed640 1 --2- 172.21.15.19:0/1347317153 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565148d5f5d0 0x565148d69d30 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fa53c003e60 tx=0x7fa53c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df968a922a707baf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:03.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.566+0000 7fa528ff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:59:03.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.566+0000 7fa528ff9640 1 -- 172.21.15.19:0/1347317153 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53c02c060 con 0x565148d5f5d0 2024-09-19T08:59:03.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.566+0000 7fa528ff9640 1 -- 172.21.15.19:0/1347317153 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa53c017030 con 0x565148d5f5d0 2024-09-19T08:59:03.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.566+0000 7fa549c2a740 1 -- 172.21.15.19:0/1347317153 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5300041f0 con 0x565148d5f5d0 2024-09-19T08:59:03.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.567+0000 7fa528ff9640 1 -- 172.21.15.19:0/1347317153 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fa53c027410 con 0x565148d5f5d0 2024-09-19T08:59:03.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.567+0000 7fa549c2a740 10 client.17004 fetch_fsmap learned FSMap version 36 2024-09-19T08:59:03.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.567+0000 7fa549c2a740 1 -- 172.21.15.19:0/1347317153 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x565148d78ad0 con 0x565148d5f5d0 2024-09-19T08:59:03.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.567+0000 7fa528ff9640 1 -- 172.21.15.19:0/1347317153 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa5300041f0 con 0x565148d5f5d0 2024-09-19T08:59:03.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.567+0000 7fa528ff9640 1 -- 172.21.15.19:0/1347317153 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fa53c0117e0 con 0x565148d5f5d0 2024-09-19T08:59:03.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.567+0000 7fa549c2a740 10 client.17004 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T08:59:03.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.567+0000 7fa549c2a740 10 client.17004 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T08:59:03.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.567+0000 7fa549c2a740 20 client.17004 populate_metadata read hostname 'smithi019' 2024-09-19T08:59:03.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.567+0000 7fa549c2a740 1 --2- 172.21.15.19:0/1347317153 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x565148d79f90 0x565148d7c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:03.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.567+0000 7fa549c2a740 4 client.17004 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:59:03.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.567+0000 7fa549c2a740 1 -- 172.21.15.19:0/1347317153 --> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565148cd2860 con 0x565148d79f90 2024-09-19T08:59:03.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.567+0000 7fa544dec640 1 --2- 172.21.15.19:0/1347317153 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x565148d79f90 0x565148d7c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:03.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.568+0000 7fa544dec640 1 --2- 172.21.15.19:0/1347317153 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x565148d79f90 0x565148d7c380 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7db2a536c034059 server_cookie=e7190efc9fed49ac in_seq=0 out_seq=0 2024-09-19T08:59:03.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.568+0000 7fa528ff9640 10 client.17004 ms_handle_connect on v2:172.21.15.203:6836/3684671619 2024-09-19T08:59:03.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.568+0000 7fa528ff9640 1 -- 172.21.15.19:0/1347317153 <== mds.2 v2:172.21.15.203:6836/3684671619 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x565148cd2860 con 0x565148d79f90 2024-09-19T08:59:03.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.568+0000 7fa528ff9640 10 client.17004 handle_command_reply: tid=0 2024-09-19T08:59:03.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.569+0000 7fa549c2a740 1 client.17004 shutdown 2024-09-19T08:59:03.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.569+0000 7fa549c2a740 1 -- 172.21.15.19:0/1347317153 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565148d5f5d0 msgr2=0x565148d69d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:03.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.569+0000 7fa549c2a740 1 --2- 172.21.15.19:0/1347317153 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565148d5f5d0 0x565148d69d30 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fa53c003e60 tx=0x7fa53c004730 comp rx=0 tx=0).stop 2024-09-19T08:59:03.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.569+0000 7fa549c2a740 1 -- 172.21.15.19:0/1347317153 shutdown_connections 2024-09-19T08:59:03.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.569+0000 7fa549c2a740 1 --2- 172.21.15.19:0/1347317153 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x565148d79f90 0x565148d7c380 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:03.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.569+0000 7fa549c2a740 1 --2- 172.21.15.19:0/1347317153 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565148d60b40 0x565148d66fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:03.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.569+0000 7fa549c2a740 1 --2- 172.21.15.19:0/1347317153 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565148d6a370 0x565148d675d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:03.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.569+0000 7fa549c2a740 1 --2- 172.21.15.19:0/1347317153 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565148d5f5d0 0x565148d69d30 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:03.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.569+0000 7fa549c2a740 1 -- 172.21.15.19:0/1347317153 >> 172.21.15.19:0/1347317153 conn(0x565148d28310 msgr2=0x565148d61930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:03.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.569+0000 7fa528ff9640 0 client.17004 ms_handle_reset on v2:172.21.15.203:6836/3684671619 2024-09-19T08:59:03.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.569+0000 7fa549c2a740 1 -- 172.21.15.19:0/1347317153 shutdown_connections 2024-09-19T08:59:03.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.569+0000 7fa549c2a740 1 -- 172.21.15.19:0/1347317153 wait complete. 2024-09-19T08:59:03.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.569+0000 7fa549c2a740 20 client.17004 trim_cache size 0 max 16384 2024-09-19T08:59:03.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.582+0000 7fa549c2a740 1 Processor -- start 2024-09-19T08:59:03.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.582+0000 7fa549c2a740 1 -- start start 2024-09-19T08:59:03.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.582+0000 7fa549c2a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565148d5f5d0 0x565148d62120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:03.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.582+0000 7fa549c2a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565148d60b40 0x565148d62660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:03.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.582+0000 7fa549c2a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565148d6a370 0x565148d81c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:03.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.582+0000 7fa549c2a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa5401af730 con 0x565148d6a370 2024-09-19T08:59:03.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.582+0000 7fa549c2a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa5401b1270 con 0x565148d60b40 2024-09-19T08:59:03.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.582+0000 7fa549c2a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa5401afe00 con 0x565148d5f5d0 2024-09-19T08:59:03.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.583+0000 7fa545dee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565148d6a370 0x565148d81c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:03.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.583+0000 7fa545dee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565148d6a370 0x565148d81c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56568/0 (socket says 172.21.15.19:56568) 2024-09-19T08:59:03.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.583+0000 7fa545dee640 1 -- 172.21.15.19:0/2056919864 learned_addr learned my addr 172.21.15.19:0/2056919864 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:03.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.583+0000 7fa544dec640 1 --2- 172.21.15.19:0/2056919864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565148d60b40 0x565148d62660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:03.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.583+0000 7fa5455ed640 1 --2- 172.21.15.19:0/2056919864 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565148d5f5d0 0x565148d62120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:03.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.583+0000 7fa545dee640 1 -- 172.21.15.19:0/2056919864 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565148d5f5d0 msgr2=0x565148d62120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:03.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.583+0000 7fa545dee640 1 --2- 172.21.15.19:0/2056919864 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565148d5f5d0 0x565148d62120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:03.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.583+0000 7fa545dee640 1 -- 172.21.15.19:0/2056919864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565148d60b40 msgr2=0x565148d62660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:03.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.583+0000 7fa545dee640 1 --2- 172.21.15.19:0/2056919864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565148d60b40 0x565148d62660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:03.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.583+0000 7fa545dee640 1 -- 172.21.15.19:0/2056919864 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565148d6a0a0 con 0x565148d6a370 2024-09-19T08:59:03.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.583+0000 7fa545dee640 1 --2- 172.21.15.19:0/2056919864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565148d6a370 0x565148d81c00 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fa5380ee830 tx=0x7fa53803d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6692694c926d27e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:03.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.583+0000 7fa52affd640 1 -- 172.21.15.19:0/2056919864 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5380c14b0 con 0x565148d6a370 2024-09-19T08:59:03.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.583+0000 7fa52affd640 1 -- 172.21.15.19:0/2056919864 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa538036040 con 0x565148d6a370 2024-09-19T08:59:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.583+0000 7fa52affd640 1 -- 172.21.15.19:0/2056919864 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5380b9770 con 0x565148d6a370 2024-09-19T08:59:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.584+0000 7fa549c2a740 1 -- 172.21.15.19:0/2056919864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565148d6a370 msgr2=0x565148d81c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.584+0000 7fa549c2a740 1 --2- 172.21.15.19:0/2056919864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565148d6a370 0x565148d81c00 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fa5380ee830 tx=0x7fa53803d040 comp rx=0 tx=0).stop 2024-09-19T08:59:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.584+0000 7fa549c2a740 1 -- 172.21.15.19:0/2056919864 shutdown_connections 2024-09-19T08:59:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.584+0000 7fa549c2a740 1 --2- 172.21.15.19:0/2056919864 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565148d6a370 0x565148d81c00 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.584+0000 7fa549c2a740 1 --2- 172.21.15.19:0/2056919864 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565148d60b40 0x565148d62660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.584+0000 7fa549c2a740 1 --2- 172.21.15.19:0/2056919864 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565148d5f5d0 0x565148d62120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.584+0000 7fa549c2a740 1 -- 172.21.15.19:0/2056919864 >> 172.21.15.19:0/2056919864 conn(0x565148d28310 msgr2=0x565148d5ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.584+0000 7fa549c2a740 1 -- 172.21.15.19:0/2056919864 shutdown_connections 2024-09-19T08:59:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.584+0000 7fa549c2a740 1 -- 172.21.15.19:0/2056919864 wait complete. 2024-09-19T08:59:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.584+0000 7fa549c2a740 1 -- start start 2024-09-19T08:59:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.585+0000 7fa549c2a740 1 Processor -- start 2024-09-19T08:59:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.585+0000 7fa549c2a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565148d5f5d0 0x565148d6e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:03.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.585+0000 7fa549c2a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565148d60b40 0x565148d6e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:03.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.585+0000 7fa549c2a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565148d6a370 0x565148d6ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:03.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.585+0000 7fa549c2a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa5401b0ba0 con 0x565148d5f5d0 2024-09-19T08:59:03.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.585+0000 7fa549c2a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa5401b04d0 con 0x565148d60b40 2024-09-19T08:59:03.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.585+0000 7fa549c2a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa5401ad710 con 0x565148d6a370 2024-09-19T08:59:03.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.585+0000 7fa549c2a740 10 client.0 _ll_register_callbacks cb 0x7fa53c00bdb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:03.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.585+0000 7fa5455ed640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565148d5f5d0 0x565148d6e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:03.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.585+0000 7fa5455ed640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565148d5f5d0 0x565148d6e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56574/0 (socket says 172.21.15.19:56574) 2024-09-19T08:59:03.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.585+0000 7fa5455ed640 1 -- 172.21.15.19:0/500372484 learned_addr learned my addr 172.21.15.19:0/500372484 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:03.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.585+0000 7fa544dec640 1 --2- 172.21.15.19:0/500372484 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565148d60b40 0x565148d6e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:03.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.585+0000 7fa545dee640 1 --2- 172.21.15.19:0/500372484 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565148d6a370 0x565148d6ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:03.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.586+0000 7fa5455ed640 1 -- 172.21.15.19:0/500372484 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565148d6a370 msgr2=0x565148d6ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:03.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.586+0000 7fa5455ed640 1 --2- 172.21.15.19:0/500372484 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565148d6a370 0x565148d6ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:03.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.586+0000 7fa5455ed640 1 -- 172.21.15.19:0/500372484 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565148d60b40 msgr2=0x565148d6e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:03.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.586+0000 7fa5455ed640 1 --2- 172.21.15.19:0/500372484 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565148d60b40 0x565148d6e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:03.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.586+0000 7fa5455ed640 1 -- 172.21.15.19:0/500372484 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565148de3dd0 con 0x565148d5f5d0 2024-09-19T08:59:03.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.586+0000 7fa5455ed640 1 --2- 172.21.15.19:0/500372484 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565148d5f5d0 0x565148d6e3d0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fa53c004010 tx=0x7fa53c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22330e0e031b5e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:03.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.586+0000 7fa528ff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:59:03.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.586+0000 7fa528ff9640 1 -- 172.21.15.19:0/500372484 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53c037030 con 0x565148d5f5d0 2024-09-19T08:59:03.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.586+0000 7fa549c2a740 1 -- 172.21.15.19:0/500372484 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa538036040 con 0x565148d5f5d0 2024-09-19T08:59:03.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.586+0000 7fa528ff9640 1 -- 172.21.15.19:0/500372484 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa53c011e40 con 0x565148d5f5d0 2024-09-19T08:59:03.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.586+0000 7fa528ff9640 1 -- 172.21.15.19:0/500372484 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fa53c005e50 con 0x565148d5f5d0 2024-09-19T08:59:03.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.586+0000 7fa549c2a740 10 client.17010 fetch_fsmap learned FSMap version 36 2024-09-19T08:59:03.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.586+0000 7fa549c2a740 1 -- 172.21.15.19:0/500372484 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x565148de50b0 con 0x565148d5f5d0 2024-09-19T08:59:03.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.586+0000 7fa528ff9640 1 -- 172.21.15.19:0/500372484 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa538036040 con 0x565148d5f5d0 2024-09-19T08:59:03.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.587+0000 7fa528ff9640 1 -- 172.21.15.19:0/500372484 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fa53c004a10 con 0x565148d5f5d0 2024-09-19T08:59:03.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.587+0000 7fa549c2a740 10 client.17010 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T08:59:03.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.587+0000 7fa549c2a740 10 client.17010 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T08:59:03.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.587+0000 7fa549c2a740 20 client.17010 populate_metadata read hostname 'smithi019' 2024-09-19T08:59:03.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.587+0000 7fa549c2a740 1 --2- 172.21.15.19:0/500372484 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x565148de57d0 0x565148de7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:03.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.587+0000 7fa549c2a740 4 client.17010 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:59:03.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.587+0000 7fa549c2a740 1 -- 172.21.15.19:0/500372484 --> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] -- command(tid 0: {"prefix": "damage ls"}) -- 0x565148cccd70 con 0x565148de57d0 2024-09-19T08:59:03.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.587+0000 7fa544dec640 1 --2- 172.21.15.19:0/500372484 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x565148de57d0 0x565148de7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:03.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.587+0000 7fa528ff9640 10 client.17010 ms_handle_connect on v2:172.21.15.203:6836/3684671619 2024-09-19T08:59:03.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.587+0000 7fa544dec640 1 --2- 172.21.15.19:0/500372484 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x565148de57d0 0x565148de7bf0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b633ad601cab05d5 server_cookie=235f79d894f3a9aa in_seq=0 out_seq=0 2024-09-19T08:59:03.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.587+0000 7fa528ff9640 1 -- 172.21.15.19:0/500372484 <== mds.2 v2:172.21.15.203:6836/3684671619 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x565148cccd70 con 0x565148de57d0 2024-09-19T08:59:03.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.587+0000 7fa528ff9640 10 client.17010 handle_command_reply: tid=0 2024-09-19T08:59:03.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.587+0000 7fa549c2a740 1 client.17010 shutdown 2024-09-19T08:59:03.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.588+0000 7fa549c2a740 1 -- 172.21.15.19:0/500372484 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565148d5f5d0 msgr2=0x565148d6e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:03.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.588+0000 7fa549c2a740 1 --2- 172.21.15.19:0/500372484 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565148d5f5d0 0x565148d6e3d0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fa53c004010 tx=0x7fa53c0046c0 comp rx=0 tx=0).stop 2024-09-19T08:59:03.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.588+0000 7fa549c2a740 1 -- 172.21.15.19:0/500372484 shutdown_connections 2024-09-19T08:59:03.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.588+0000 7fa549c2a740 1 --2- 172.21.15.19:0/500372484 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x565148de57d0 0x565148de7bf0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:03.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.588+0000 7fa549c2a740 1 --2- 172.21.15.19:0/500372484 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x565148d6a370 0x565148d6ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:03.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.588+0000 7fa549c2a740 1 --2- 172.21.15.19:0/500372484 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x565148d60b40 0x565148d6e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:03.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.588+0000 7fa549c2a740 1 --2- 172.21.15.19:0/500372484 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x565148d5f5d0 0x565148d6e3d0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:03.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.588+0000 7fa549c2a740 1 -- 172.21.15.19:0/500372484 >> 172.21.15.19:0/500372484 conn(0x565148d28310 msgr2=0x565148d68840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:03.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.588+0000 7fa528ff9640 0 client.17010 ms_handle_reset on v2:172.21.15.203:6836/3684671619 2024-09-19T08:59:03.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.588+0000 7fa549c2a740 1 -- 172.21.15.19:0/500372484 shutdown_connections 2024-09-19T08:59:03.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.588+0000 7fa549c2a740 1 -- 172.21.15.19:0/500372484 wait complete. 2024-09-19T08:59:03.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.588+0000 7fa549c2a740 20 client.17010 trim_cache size 0 max 16384 2024-09-19T08:59:03.596 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T08:59:03.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.588+0000 7fa547851640 1 -- 172.21.15.19:0/2384808192 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa52c0a3240 msgr2=0x7fa52c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:03.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.588+0000 7fa547851640 1 --2- 172.21.15.19:0/2384808192 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa52c0a3240 0x7fa52c0a5700 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x565148d5cac0 tx=0x7fa53c00b390 comp rx=0 tx=0).stop 2024-09-19T08:59:03.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.588+0000 7fa547851640 1 -- 172.21.15.19:0/2384808192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa54010e480 msgr2=0x7fa54019ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:03.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.588+0000 7fa547851640 1 --2- 172.21.15.19:0/2384808192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa54010e480 0x7fa54019ef20 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fa53802ade0 tx=0x7fa5380319f0 comp rx=0 tx=0).stop 2024-09-19T08:59:03.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.588+0000 7fa547851640 1 -- 172.21.15.19:0/2384808192 shutdown_connections 2024-09-19T08:59:03.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.588+0000 7fa547851640 1 --2- 172.21.15.19:0/2384808192 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa52c0a3240 0x7fa52c0a5700 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:03.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.588+0000 7fa547851640 1 --2- 172.21.15.19:0/2384808192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa54010e480 0x7fa54019ef20 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:03.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.588+0000 7fa547851640 1 --2- 172.21.15.19:0/2384808192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa540101280 0x7fa54019ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:03.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.588+0000 7fa547851640 1 --2- 172.21.15.19:0/2384808192 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa5401008d0 0x7fa54019a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:03.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.588+0000 7fa547851640 1 -- 172.21.15.19:0/2384808192 >> 172.21.15.19:0/2384808192 conn(0x7fa5400fc7a0 msgr2=0x7fa5400feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:03.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.589+0000 7fa547851640 1 -- 172.21.15.19:0/2384808192 shutdown_connections 2024-09-19T08:59:03.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:03.589+0000 7fa547851640 1 -- 172.21.15.19:0/2384808192 wait complete. 2024-09-19T08:59:03.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:03 smithi019 ceph-mon[30976]: pgmap v542: 97 pgs: 97 active+clean; 5.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.2 MiB/s wr, 2.12k op/s 2024-09-19T08:59:03.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:03 smithi203 ceph-mon[35450]: pgmap v542: 97 pgs: 97 active+clean; 5.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.2 MiB/s wr, 2.12k op/s 2024-09-19T08:59:04.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:03 smithi155 ceph-mon[34921]: pgmap v542: 97 pgs: 97 active+clean; 5.5 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 1.2 MiB/s wr, 2.12k op/s 2024-09-19T08:59:04.300 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T08:59:04.557 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:59:05.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.029+0000 7f4a289b0640 1 -- 172.21.15.19:0/2826584442 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a24101380 msgr2=0x7f4a2410dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:05.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.029+0000 7f4a289b0640 1 --2- 172.21.15.19:0/2826584442 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a24101380 0x7f4a2410dfb0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009900 tx=0x7f4a1802a410 comp rx=0 tx=0).stop 2024-09-19T08:59:05.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.029+0000 7f4a289b0640 1 -- 172.21.15.19:0/2826584442 shutdown_connections 2024-09-19T08:59:05.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.029+0000 7f4a289b0640 1 --2- 172.21.15.19:0/2826584442 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a2410e4f0 0x7f4a24110900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:05.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.029+0000 7f4a289b0640 1 --2- 172.21.15.19:0/2826584442 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a24101380 0x7f4a2410dfb0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:05.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.029+0000 7f4a289b0640 1 --2- 172.21.15.19:0/2826584442 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a241009d0 0x7f4a24100db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:05.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.029+0000 7f4a289b0640 1 -- 172.21.15.19:0/2826584442 >> 172.21.15.19:0/2826584442 conn(0x7f4a240fc7d0 msgr2=0x7f4a240febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:05.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.029+0000 7f4a289b0640 1 -- 172.21.15.19:0/2826584442 shutdown_connections 2024-09-19T08:59:05.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.029+0000 7f4a289b0640 1 -- 172.21.15.19:0/2826584442 wait complete. 2024-09-19T08:59:05.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.030+0000 7f4a289b0640 1 Processor -- start 2024-09-19T08:59:05.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.030+0000 7f4a289b0640 1 -- start start 2024-09-19T08:59:05.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.030+0000 7f4a289b0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a241009d0 0x7f4a241a0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:05.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.030+0000 7f4a289b0640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a24101380 0x7f4a241a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:05.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.030+0000 7f4a289b0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a2410e4f0 0x7f4a2419a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:05.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.030+0000 7f4a289b0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4a24114240 con 0x7f4a2410e4f0 2024-09-19T08:59:05.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.030+0000 7f4a289b0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4a241140c0 con 0x7f4a241009d0 2024-09-19T08:59:05.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.030+0000 7f4a289b0640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4a241143c0 con 0x7f4a24101380 2024-09-19T08:59:05.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.030+0000 7f4a22d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a2410e4f0 0x7f4a2419a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:05.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.030+0000 7f4a22d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a2410e4f0 0x7f4a2419a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56584/0 (socket says 172.21.15.19:56584) 2024-09-19T08:59:05.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.030+0000 7f4a2259c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a241009d0 0x7f4a241a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:05.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.030+0000 7f4a22d9d640 1 -- 172.21.15.19:0/1545417184 learned_addr learned my addr 172.21.15.19:0/1545417184 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:05.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.030+0000 7f4a21d9b640 1 --2- 172.21.15.19:0/1545417184 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a24101380 0x7f4a241a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:05.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.031+0000 7f4a2259c640 1 -- 172.21.15.19:0/1545417184 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a24101380 msgr2=0x7f4a241a0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:05.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.031+0000 7f4a2259c640 1 --2- 172.21.15.19:0/1545417184 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a24101380 0x7f4a241a0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:05.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.031+0000 7f4a2259c640 1 -- 172.21.15.19:0/1545417184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a2410e4f0 msgr2=0x7f4a2419a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:05.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.031+0000 7f4a2259c640 1 --2- 172.21.15.19:0/1545417184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a2410e4f0 0x7f4a2419a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:05.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.031+0000 7f4a2259c640 1 -- 172.21.15.19:0/1545417184 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a2419ad00 con 0x7f4a241009d0 2024-09-19T08:59:05.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.031+0000 7f4a22d9d640 1 --2- 172.21.15.19:0/1545417184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a2410e4f0 0x7f4a2419a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:05.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.031+0000 7f4a2259c640 1 --2- 172.21.15.19:0/1545417184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a241009d0 0x7f4a241a0410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4a1400eb00 tx=0x7f4a1400c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:05.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.031+0000 7f4a137fe640 1 -- 172.21.15.19:0/1545417184 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a14010430 con 0x7f4a241009d0 2024-09-19T08:59:05.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.031+0000 7f4a137fe640 1 -- 172.21.15.19:0/1545417184 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a14010ab0 con 0x7f4a241009d0 2024-09-19T08:59:05.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.031+0000 7f4a137fe640 1 -- 172.21.15.19:0/1545417184 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a14017bb0 con 0x7f4a241009d0 2024-09-19T08:59:05.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.031+0000 7f4a289b0640 1 -- 172.21.15.19:0/1545417184 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a2419aff0 con 0x7f4a241009d0 2024-09-19T08:59:05.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.031+0000 7f4a289b0640 1 -- 172.21.15.19:0/1545417184 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a241a72e0 con 0x7f4a241009d0 2024-09-19T08:59:05.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.033+0000 7f4a2ad89740 1 Processor -- start 2024-09-19T08:59:05.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.033+0000 7f4a137fe640 1 -- 172.21.15.19:0/1545417184 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f4a14010c60 con 0x7f4a241009d0 2024-09-19T08:59:05.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.034+0000 7f4a2ad89740 1 -- start start 2024-09-19T08:59:05.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.034+0000 7f4a2ad89740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5575ac872b40 0x5575ac871090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:05.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.034+0000 7f4a2ad89740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575ac8715d0 0x5575ac871a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:05.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.034+0000 7f4a2ad89740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575ac87c370 0x5575ac87e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:05.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.034+0000 7f4a2ad89740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5575ac7d72f0 con 0x5575ac8715d0 2024-09-19T08:59:05.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.034+0000 7f4a2ad89740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5575ac77ecf0 con 0x5575ac872b40 2024-09-19T08:59:05.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.034+0000 7f4a2ad89740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5575ac7d32b0 con 0x5575ac87c370 2024-09-19T08:59:05.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.034+0000 7f4a22d9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5575ac872b40 0x5575ac871090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:05.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.034+0000 7f4a2259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575ac8715d0 0x5575ac871a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:05.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.034+0000 7f4a22d9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5575ac872b40 0x5575ac871090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:44836/0 (socket says 172.21.15.19:44836) 2024-09-19T08:59:05.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.034+0000 7f4a22d9d640 1 -- 172.21.15.19:0/577457903 learned_addr learned my addr 172.21.15.19:0/577457903 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:05.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.034+0000 7f4a21d9b640 1 --2- 172.21.15.19:0/577457903 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575ac87c370 0x5575ac87e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:05.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.034+0000 7f4a22d9d640 1 -- 172.21.15.19:0/577457903 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575ac87c370 msgr2=0x5575ac87e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:05.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.034+0000 7f4a22d9d640 1 --2- 172.21.15.19:0/577457903 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575ac87c370 0x5575ac87e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:05.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.034+0000 7f4a22d9d640 1 -- 172.21.15.19:0/577457903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575ac8715d0 msgr2=0x5575ac871a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:05.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.034+0000 7f4a22d9d640 1 --2- 172.21.15.19:0/577457903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575ac8715d0 0x5575ac871a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:05.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.034+0000 7f4a22d9d640 1 -- 172.21.15.19:0/577457903 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575ac7633a0 con 0x5575ac872b40 2024-09-19T08:59:05.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.034+0000 7f4a137fe640 1 --2- 172.21.15.19:0/1545417184 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4a0c0a3240 0x7f4a0c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:05.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.035+0000 7f4a2259c640 1 --2- 172.21.15.19:0/1545417184 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4a0c0a3240 0x7f4a0c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:05.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.035+0000 7f4a137fe640 1 -- 172.21.15.19:0/1545417184 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4a140d0360 con 0x7f4a241009d0 2024-09-19T08:59:05.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.035+0000 7f4a22d9d640 1 --2- 172.21.15.19:0/577457903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5575ac872b40 0x5575ac871090 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c010480 tx=0x7f4a1c010940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f234a3b6f32462 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:05.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.035+0000 7f4a10ff9640 1 -- 172.21.15.19:0/577457903 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c005220 con 0x5575ac872b40 2024-09-19T08:59:05.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.035+0000 7f4a10ff9640 1 -- 172.21.15.19:0/577457903 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a1c004c80 con 0x5575ac872b40 2024-09-19T08:59:05.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.035+0000 7f4a10ff9640 1 -- 172.21.15.19:0/577457903 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c011af0 con 0x5575ac872b40 2024-09-19T08:59:05.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.036+0000 7f4a2ad89740 1 -- 172.21.15.19:0/577457903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5575ac872b40 msgr2=0x5575ac871090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:05.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.036+0000 7f4a2259c640 1 --2- 172.21.15.19:0/1545417184 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4a0c0a3240 0x7f4a0c0a5700 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4a14000f80 tx=0x7f4a140d3e30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:05.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.036+0000 7f4a2ad89740 1 --2- 172.21.15.19:0/577457903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5575ac872b40 0x5575ac871090 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c010480 tx=0x7f4a1c010940 comp rx=0 tx=0).stop 2024-09-19T08:59:05.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.036+0000 7f4a2ad89740 1 -- 172.21.15.19:0/577457903 shutdown_connections 2024-09-19T08:59:05.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.036+0000 7f4a2ad89740 1 --2- 172.21.15.19:0/577457903 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575ac87c370 0x5575ac87e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:05.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.036+0000 7f4a2ad89740 1 --2- 172.21.15.19:0/577457903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575ac8715d0 0x5575ac871a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:05.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.036+0000 7f4a2ad89740 1 --2- 172.21.15.19:0/577457903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5575ac872b40 0x5575ac871090 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:05.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.036+0000 7f4a2ad89740 1 -- 172.21.15.19:0/577457903 >> 172.21.15.19:0/577457903 conn(0x5575ac83a310 msgr2=0x5575ac86dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:05.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.036+0000 7f4a2ad89740 1 -- 172.21.15.19:0/577457903 shutdown_connections 2024-09-19T08:59:05.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.036+0000 7f4a2ad89740 1 -- 172.21.15.19:0/577457903 wait complete. 2024-09-19T08:59:05.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.036+0000 7f4a2ad89740 1 -- start start 2024-09-19T08:59:05.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.036+0000 7f4a2ad89740 1 Processor -- start 2024-09-19T08:59:05.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.036+0000 7f4a2ad89740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575ac8715d0 0x5575ac87bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:05.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.036+0000 7f4a2ad89740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575ac872b40 0x5575ac879000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:05.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.036+0000 7f4a2ad89740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5575ac87c370 0x5575ac8795d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:05.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.036+0000 7f4a2ad89740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5575ac87f070 con 0x5575ac872b40 2024-09-19T08:59:05.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.036+0000 7f4a2ad89740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5575ac792060 con 0x5575ac87c370 2024-09-19T08:59:05.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.036+0000 7f4a2ad89740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5575ac87f1f0 con 0x5575ac8715d0 2024-09-19T08:59:05.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.036+0000 7f4a2ad89740 10 client.0 _ll_register_callbacks cb 0x5575ac4e58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:05.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.036+0000 7f4a21d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575ac872b40 0x5575ac879000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:05.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.037+0000 7f4a22d9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575ac8715d0 0x5575ac87bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:05.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.037+0000 7f4a22d9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575ac8715d0 0x5575ac87bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:60850/0 (socket says 172.21.15.19:60850) 2024-09-19T08:59:05.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.037+0000 7f4a21d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575ac872b40 0x5575ac879000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56592/0 (socket says 172.21.15.19:56592) 2024-09-19T08:59:05.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.037+0000 7f4a22d9d640 1 -- 172.21.15.19:0/632068911 learned_addr learned my addr 172.21.15.19:0/632068911 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:05.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.037+0000 7f4a22d9d640 1 --2- 172.21.15.19:0/632068911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5575ac87c370 0x5575ac8795d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:05.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.037+0000 7f4a21d9b640 1 -- 172.21.15.19:0/632068911 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575ac8715d0 msgr2=0x5575ac87bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:05.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.037+0000 7f4a21d9b640 1 --2- 172.21.15.19:0/632068911 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575ac8715d0 0x5575ac87bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:05.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.037+0000 7f4a21d9b640 1 -- 172.21.15.19:0/632068911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5575ac87c370 msgr2=0x5575ac8795d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:05.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.037+0000 7f4a21d9b640 1 --2- 172.21.15.19:0/632068911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5575ac87c370 0x5575ac8795d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:05.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.037+0000 7f4a21d9b640 1 -- 172.21.15.19:0/632068911 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575ac5483c0 con 0x5575ac872b40 2024-09-19T08:59:05.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.037+0000 7f4a22d9d640 1 --2- 172.21.15.19:0/632068911 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575ac8715d0 0x5575ac87bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:05.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.037+0000 7f4a21d9b640 1 --2- 172.21.15.19:0/632068911 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575ac872b40 0x5575ac879000 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009230 tx=0x7f4a180317e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b37e7fca1df813b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:05.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.037+0000 7f4a09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:59:05.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.037+0000 7f4a09ffb640 1 -- 172.21.15.19:0/632068911 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a18035040 con 0x5575ac872b40 2024-09-19T08:59:05.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.037+0000 7f4a09ffb640 1 -- 172.21.15.19:0/632068911 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4a18004040 con 0x5575ac872b40 2024-09-19T08:59:05.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.037+0000 7f4a2ad89740 1 -- 172.21.15.19:0/632068911 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a1c004c80 con 0x5575ac872b40 2024-09-19T08:59:05.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.037+0000 7f4a09ffb640 1 -- 172.21.15.19:0/632068911 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f4a18004240 con 0x5575ac872b40 2024-09-19T08:59:05.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.037+0000 7f4a2ad89740 10 client.17022 fetch_fsmap learned FSMap version 36 2024-09-19T08:59:05.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.037+0000 7f4a2ad89740 1 -- 172.21.15.19:0/632068911 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5575ac88aaf0 con 0x5575ac872b40 2024-09-19T08:59:05.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.038+0000 7f4a09ffb640 1 -- 172.21.15.19:0/632068911 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a1c004c80 con 0x5575ac872b40 2024-09-19T08:59:05.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.038+0000 7f4a09ffb640 1 -- 172.21.15.19:0/632068911 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f4a18004a30 con 0x5575ac872b40 2024-09-19T08:59:05.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.038+0000 7f4a2ad89740 10 client.17022 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T08:59:05.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.038+0000 7f4a2ad89740 10 client.17022 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:59:05.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.038+0000 7f4a2ad89740 20 client.17022 populate_metadata read hostname 'smithi019' 2024-09-19T08:59:05.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.038+0000 7f4a2ad89740 1 --2- 172.21.15.19:0/632068911 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x5575ac88bfb0 0x5575ac88e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:05.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.038+0000 7f4a2ad89740 4 client.17022 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:59:05.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.038+0000 7f4a2ad89740 1 -- 172.21.15.19:0/632068911 --> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575ac7e4860 con 0x5575ac88bfb0 2024-09-19T08:59:05.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.038+0000 7f4a22d9d640 1 --2- 172.21.15.19:0/632068911 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x5575ac88bfb0 0x5575ac88e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:05.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.038+0000 7f4a22d9d640 1 --2- 172.21.15.19:0/632068911 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x5575ac88bfb0 0x5575ac88e3a0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=875e6a6ef1c3e77c server_cookie=cbd4ed0160d7a881 in_seq=0 out_seq=0 2024-09-19T08:59:05.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.038+0000 7f4a09ffb640 10 client.17022 ms_handle_connect on v2:172.21.15.203:6838/2547507299 2024-09-19T08:59:05.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.039+0000 7f4a09ffb640 1 -- 172.21.15.19:0/632068911 <== mds.1 v2:172.21.15.203:6838/2547507299 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5575ac7e4860 con 0x5575ac88bfb0 2024-09-19T08:59:05.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.039+0000 7f4a09ffb640 10 client.17022 handle_command_reply: tid=0 2024-09-19T08:59:05.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.039+0000 7f4a2ad89740 1 client.17022 shutdown 2024-09-19T08:59:05.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.039+0000 7f4a2ad89740 1 -- 172.21.15.19:0/632068911 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575ac872b40 msgr2=0x5575ac879000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:05.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.039+0000 7f4a2ad89740 1 --2- 172.21.15.19:0/632068911 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575ac872b40 0x5575ac879000 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009230 tx=0x7f4a180317e0 comp rx=0 tx=0).stop 2024-09-19T08:59:05.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.039+0000 7f4a2ad89740 1 -- 172.21.15.19:0/632068911 shutdown_connections 2024-09-19T08:59:05.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.039+0000 7f4a2ad89740 1 --2- 172.21.15.19:0/632068911 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x5575ac88bfb0 0x5575ac88e3a0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:05.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.039+0000 7f4a2ad89740 1 --2- 172.21.15.19:0/632068911 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5575ac87c370 0x5575ac8795d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:05.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.039+0000 7f4a09ffb640 0 client.17022 ms_handle_reset on v2:172.21.15.203:6838/2547507299 2024-09-19T08:59:05.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.039+0000 7f4a2ad89740 1 --2- 172.21.15.19:0/632068911 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575ac872b40 0x5575ac879000 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:05.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.039+0000 7f4a2ad89740 1 --2- 172.21.15.19:0/632068911 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575ac8715d0 0x5575ac87bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:05.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.039+0000 7f4a2ad89740 1 -- 172.21.15.19:0/632068911 >> 172.21.15.19:0/632068911 conn(0x5575ac83a310 msgr2=0x5575ac873960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:05.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.039+0000 7f4a2ad89740 1 -- 172.21.15.19:0/632068911 shutdown_connections 2024-09-19T08:59:05.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.039+0000 7f4a2ad89740 1 -- 172.21.15.19:0/632068911 wait complete. 2024-09-19T08:59:05.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.039+0000 7f4a2ad89740 20 client.17022 trim_cache size 0 max 16384 2024-09-19T08:59:05.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.053+0000 7f4a2ad89740 1 Processor -- start 2024-09-19T08:59:05.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.053+0000 7f4a2ad89740 1 -- start start 2024-09-19T08:59:05.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.053+0000 7f4a2ad89740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5575ac8715d0 0x5575ac888310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:05.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.053+0000 7f4a2ad89740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575ac872b40 0x5575ac877fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:05.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.053+0000 7f4a2ad89740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575ac87c370 0x5575ac893c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:05.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.053+0000 7f4a2ad89740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4a241af820 con 0x5575ac872b40 2024-09-19T08:59:05.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.053+0000 7f4a2ad89740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4a241b1360 con 0x5575ac8715d0 2024-09-19T08:59:05.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.053+0000 7f4a2ad89740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4a241afef0 con 0x5575ac87c370 2024-09-19T08:59:05.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.053+0000 7f4a21d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575ac872b40 0x5575ac877fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:05.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.053+0000 7f4a21d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575ac872b40 0x5575ac877fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56594/0 (socket says 172.21.15.19:56594) 2024-09-19T08:59:05.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.053+0000 7f4a21d9b640 1 -- 172.21.15.19:0/2985031184 learned_addr learned my addr 172.21.15.19:0/2985031184 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:05.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.053+0000 7f4a22d9d640 1 --2- 172.21.15.19:0/2985031184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5575ac8715d0 0x5575ac888310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:05.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.053+0000 7f4a22d9d640 1 --2- 172.21.15.19:0/2985031184 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575ac87c370 0x5575ac893c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:05.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.053+0000 7f4a21d9b640 1 -- 172.21.15.19:0/2985031184 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575ac87c370 msgr2=0x5575ac893c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:05.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.053+0000 7f4a21d9b640 1 --2- 172.21.15.19:0/2985031184 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575ac87c370 0x5575ac893c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:05.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.053+0000 7f4a21d9b640 1 -- 172.21.15.19:0/2985031184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5575ac8715d0 msgr2=0x5575ac888310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:05.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.053+0000 7f4a21d9b640 1 --2- 172.21.15.19:0/2985031184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5575ac8715d0 0x5575ac888310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:05.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.053+0000 7f4a21d9b640 1 -- 172.21.15.19:0/2985031184 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575ac86e730 con 0x5575ac872b40 2024-09-19T08:59:05.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.054+0000 7f4a21d9b640 1 --2- 172.21.15.19:0/2985031184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575ac872b40 0x5575ac877fe0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009900 tx=0x7f4a180314b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1ca8d9a6b056fa9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:05.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.054+0000 7f4a0bfff640 1 -- 172.21.15.19:0/2985031184 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a18035070 con 0x5575ac872b40 2024-09-19T08:59:05.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.054+0000 7f4a0bfff640 1 -- 172.21.15.19:0/2985031184 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a18054020 con 0x5575ac872b40 2024-09-19T08:59:05.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.054+0000 7f4a0bfff640 1 -- 172.21.15.19:0/2985031184 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a18003a30 con 0x5575ac872b40 2024-09-19T08:59:05.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.054+0000 7f4a2ad89740 1 -- 172.21.15.19:0/2985031184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575ac872b40 msgr2=0x5575ac877fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:05.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.054+0000 7f4a2ad89740 1 --2- 172.21.15.19:0/2985031184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575ac872b40 0x5575ac877fe0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f4a18009900 tx=0x7f4a180314b0 comp rx=0 tx=0).stop 2024-09-19T08:59:05.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.055+0000 7f4a2ad89740 1 -- 172.21.15.19:0/2985031184 shutdown_connections 2024-09-19T08:59:05.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.055+0000 7f4a2ad89740 1 --2- 172.21.15.19:0/2985031184 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575ac87c370 0x5575ac893c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:05.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.055+0000 7f4a2ad89740 1 --2- 172.21.15.19:0/2985031184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575ac872b40 0x5575ac877fe0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:05.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.055+0000 7f4a2ad89740 1 --2- 172.21.15.19:0/2985031184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5575ac8715d0 0x5575ac888310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:05.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.055+0000 7f4a2ad89740 1 -- 172.21.15.19:0/2985031184 >> 172.21.15.19:0/2985031184 conn(0x5575ac83a310 msgr2=0x5575ac8778d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:05.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.055+0000 7f4a2ad89740 1 -- 172.21.15.19:0/2985031184 shutdown_connections 2024-09-19T08:59:05.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.055+0000 7f4a2ad89740 1 -- 172.21.15.19:0/2985031184 wait complete. 2024-09-19T08:59:05.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.055+0000 7f4a2ad89740 1 -- start start 2024-09-19T08:59:05.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.055+0000 7f4a2ad89740 1 Processor -- start 2024-09-19T08:59:05.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.055+0000 7f4a2ad89740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575ac8715d0 0x5575ac87fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:05.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.055+0000 7f4a2ad89740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5575ac872b40 0x5575ac880100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:05.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.055+0000 7f4a2ad89740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575ac87c370 0x5575ac8f4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:05.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.055+0000 7f4a2ad89740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4a241b0c90 con 0x5575ac8715d0 2024-09-19T08:59:05.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.055+0000 7f4a2ad89740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4a241b05c0 con 0x5575ac872b40 2024-09-19T08:59:05.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.055+0000 7f4a2ad89740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4a241ad800 con 0x5575ac87c370 2024-09-19T08:59:05.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.055+0000 7f4a2ad89740 10 client.0 _ll_register_callbacks cb 0x7f4a18009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:05.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.055+0000 7f4a22d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575ac8715d0 0x5575ac87fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:05.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.055+0000 7f4a21d9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5575ac872b40 0x5575ac880100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:05.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.055+0000 7f4a22d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575ac8715d0 0x5575ac87fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56606/0 (socket says 172.21.15.19:56606) 2024-09-19T08:59:05.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.056+0000 7f4a21d9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5575ac872b40 0x5575ac880100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:44846/0 (socket says 172.21.15.19:44846) 2024-09-19T08:59:05.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.056+0000 7f4a22d9d640 1 -- 172.21.15.19:0/2656185956 learned_addr learned my addr 172.21.15.19:0/2656185956 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:05.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.056+0000 7f4a22d9d640 1 --2- 172.21.15.19:0/2656185956 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575ac87c370 0x5575ac8f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:05.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.056+0000 7f4a21d9b640 1 -- 172.21.15.19:0/2656185956 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575ac87c370 msgr2=0x5575ac8f4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:05.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.056+0000 7f4a21d9b640 1 --2- 172.21.15.19:0/2656185956 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575ac87c370 0x5575ac8f4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:05.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.056+0000 7f4a21d9b640 1 -- 172.21.15.19:0/2656185956 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575ac8715d0 msgr2=0x5575ac87fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:05.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.056+0000 7f4a21d9b640 1 --2- 172.21.15.19:0/2656185956 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575ac8715d0 0x5575ac87fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:05.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.056+0000 7f4a21d9b640 1 -- 172.21.15.19:0/2656185956 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575ac8f5270 con 0x5575ac872b40 2024-09-19T08:59:05.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.056+0000 7f4a21d9b640 1 --2- 172.21.15.19:0/2656185956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5575ac872b40 0x5575ac880100 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x5575ac888ef0 tx=0x7f4a18000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ff8286e3a6eab13 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:05.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.056+0000 7f4a09ffb640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T08:59:05.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.056+0000 7f4a09ffb640 1 -- 172.21.15.19:0/2656185956 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1805d070 con 0x5575ac872b40 2024-09-19T08:59:05.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.056+0000 7f4a09ffb640 1 -- 172.21.15.19:0/2656185956 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4a180046c0 con 0x5575ac872b40 2024-09-19T08:59:05.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.056+0000 7f4a2ad89740 1 -- 172.21.15.19:0/2656185956 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a18054020 con 0x5575ac872b40 2024-09-19T08:59:05.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.056+0000 7f4a09ffb640 1 -- 172.21.15.19:0/2656185956 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f4a18035030 con 0x5575ac872b40 2024-09-19T08:59:05.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.056+0000 7f4a2ad89740 10 client.26507 fetch_fsmap learned FSMap version 36 2024-09-19T08:59:05.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.056+0000 7f4a2ad89740 1 -- 172.21.15.19:0/2656185956 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5575ac8f6550 con 0x5575ac872b40 2024-09-19T08:59:05.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.057+0000 7f4a09ffb640 1 -- 172.21.15.19:0/2656185956 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4a18054020 con 0x5575ac872b40 2024-09-19T08:59:05.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.057+0000 7f4a09ffb640 1 -- 172.21.15.19:0/2656185956 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f4a18060030 con 0x5575ac872b40 2024-09-19T08:59:05.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.057+0000 7f4a2ad89740 10 client.26507 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T08:59:05.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.057+0000 7f4a2ad89740 10 client.26507 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T08:59:05.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.057+0000 7f4a2ad89740 20 client.26507 populate_metadata read hostname 'smithi019' 2024-09-19T08:59:05.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.057+0000 7f4a2ad89740 1 --2- 172.21.15.19:0/2656185956 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x5575ac8f6b50 0x5575ac8f8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:05.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.057+0000 7f4a2ad89740 4 client.26507 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:59:05.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.057+0000 7f4a2ad89740 1 -- 172.21.15.19:0/2656185956 --> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5575ac7ded70 con 0x5575ac8f6b50 2024-09-19T08:59:05.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.057+0000 7f4a22d9d640 1 --2- 172.21.15.19:0/2656185956 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x5575ac8f6b50 0x5575ac8f8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:05.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.057+0000 7f4a22d9d640 1 --2- 172.21.15.19:0/2656185956 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x5575ac8f6b50 0x5575ac8f8f40 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=464d58f8e6e471b0 server_cookie=1066f7f26ea51613 in_seq=0 out_seq=0 2024-09-19T08:59:05.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.057+0000 7f4a09ffb640 10 client.26507 ms_handle_connect on v2:172.21.15.203:6838/2547507299 2024-09-19T08:59:05.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.058+0000 7f4a09ffb640 1 -- 172.21.15.19:0/2656185956 <== mds.1 v2:172.21.15.203:6838/2547507299 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5575ac7ded70 con 0x5575ac8f6b50 2024-09-19T08:59:05.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.058+0000 7f4a09ffb640 10 client.26507 handle_command_reply: tid=0 2024-09-19T08:59:05.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.058+0000 7f4a2ad89740 1 client.26507 shutdown 2024-09-19T08:59:05.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.058+0000 7f4a2ad89740 1 -- 172.21.15.19:0/2656185956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5575ac872b40 msgr2=0x5575ac880100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:05.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.058+0000 7f4a2ad89740 1 --2- 172.21.15.19:0/2656185956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5575ac872b40 0x5575ac880100 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x5575ac888ef0 tx=0x7f4a18000bc0 comp rx=0 tx=0).stop 2024-09-19T08:59:05.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.058+0000 7f4a2ad89740 1 -- 172.21.15.19:0/2656185956 shutdown_connections 2024-09-19T08:59:05.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.058+0000 7f4a2ad89740 1 --2- 172.21.15.19:0/2656185956 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x5575ac8f6b50 0x5575ac8f8f40 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:05.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.058+0000 7f4a2ad89740 1 --2- 172.21.15.19:0/2656185956 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575ac87c370 0x5575ac8f4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:05.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.058+0000 7f4a2ad89740 1 --2- 172.21.15.19:0/2656185956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5575ac872b40 0x5575ac880100 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:05.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.058+0000 7f4a09ffb640 0 client.26507 ms_handle_reset on v2:172.21.15.203:6838/2547507299 2024-09-19T08:59:05.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.058+0000 7f4a2ad89740 1 --2- 172.21.15.19:0/2656185956 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5575ac8715d0 0x5575ac87fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:05.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.058+0000 7f4a2ad89740 1 -- 172.21.15.19:0/2656185956 >> 172.21.15.19:0/2656185956 conn(0x5575ac83a310 msgr2=0x5575ac87a860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:05.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.058+0000 7f4a2ad89740 1 -- 172.21.15.19:0/2656185956 shutdown_connections 2024-09-19T08:59:05.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.058+0000 7f4a2ad89740 1 -- 172.21.15.19:0/2656185956 wait complete. 2024-09-19T08:59:05.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.058+0000 7f4a2ad89740 20 client.26507 trim_cache size 0 max 16384 2024-09-19T08:59:05.066 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T08:59:05.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.058+0000 7f4a289b0640 1 -- 172.21.15.19:0/1545417184 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4a0c0a3240 msgr2=0x7f4a0c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:05.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.058+0000 7f4a289b0640 1 --2- 172.21.15.19:0/1545417184 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4a0c0a3240 0x7f4a0c0a5700 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f4a14000f80 tx=0x7f4a140d3e30 comp rx=0 tx=0).stop 2024-09-19T08:59:05.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.058+0000 7f4a289b0640 1 -- 172.21.15.19:0/1545417184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a241009d0 msgr2=0x7f4a241a0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:05.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.058+0000 7f4a289b0640 1 --2- 172.21.15.19:0/1545417184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a241009d0 0x7f4a241a0410 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4a1400eb00 tx=0x7f4a1400c2d0 comp rx=0 tx=0).stop 2024-09-19T08:59:05.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.058+0000 7f4a289b0640 1 -- 172.21.15.19:0/1545417184 shutdown_connections 2024-09-19T08:59:05.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.058+0000 7f4a289b0640 1 --2- 172.21.15.19:0/1545417184 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4a0c0a3240 0x7f4a0c0a5700 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:05.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.058+0000 7f4a289b0640 1 --2- 172.21.15.19:0/1545417184 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4a24101380 0x7f4a241a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:05.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.058+0000 7f4a289b0640 1 --2- 172.21.15.19:0/1545417184 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4a2410e4f0 0x7f4a2419a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:05.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.058+0000 7f4a289b0640 1 --2- 172.21.15.19:0/1545417184 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4a241009d0 0x7f4a241a0410 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:05.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.059+0000 7f4a289b0640 1 -- 172.21.15.19:0/1545417184 >> 172.21.15.19:0/1545417184 conn(0x7f4a240fc7d0 msgr2=0x7f4a2410f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:05.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.059+0000 7f4a289b0640 1 -- 172.21.15.19:0/1545417184 shutdown_connections 2024-09-19T08:59:05.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:05.059+0000 7f4a289b0640 1 -- 172.21.15.19:0/1545417184 wait complete. 2024-09-19T08:59:05.757 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:05 smithi019 ceph-mon[30976]: pgmap v543: 97 pgs: 97 active+clean; 9.3 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 2.07k op/s 2024-09-19T08:59:05.787 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T08:59:05.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:05 smithi203 ceph-mon[35450]: pgmap v543: 97 pgs: 97 active+clean; 9.3 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 2.07k op/s 2024-09-19T08:59:06.050 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:59:06.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:05 smithi155 ceph-mon[34921]: pgmap v543: 97 pgs: 97 active+clean; 9.3 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.2 MiB/s wr, 2.07k op/s 2024-09-19T08:59:06.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.530+0000 7f1e11e7c640 1 -- 172.21.15.19:0/3770811663 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e0c102ef0 msgr2=0x7f1e0c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:06.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.530+0000 7f1e11e7c640 1 --2- 172.21.15.19:0/3770811663 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e0c102ef0 0x7f1e0c10da40 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f1e04009ca0 tx=0x7f1e0402a950 comp rx=0 tx=0).stop 2024-09-19T08:59:06.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.530+0000 7f1e11e7c640 1 -- 172.21.15.19:0/3770811663 shutdown_connections 2024-09-19T08:59:06.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.530+0000 7f1e11e7c640 1 --2- 172.21.15.19:0/3770811663 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e0c102570 0x7f1e0c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.530+0000 7f1e11e7c640 1 --2- 172.21.15.19:0/3770811663 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e0c102ef0 0x7f1e0c10da40 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.530+0000 7f1e11e7c640 1 --2- 172.21.15.19:0/3770811663 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e0c100e20 0x7f1e0c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.530+0000 7f1e11e7c640 1 -- 172.21.15.19:0/3770811663 >> 172.21.15.19:0/3770811663 conn(0x7f1e0c0fc7d0 msgr2=0x7f1e0c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:06.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.530+0000 7f1e11e7c640 1 -- 172.21.15.19:0/3770811663 shutdown_connections 2024-09-19T08:59:06.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.530+0000 7f1e11e7c640 1 -- 172.21.15.19:0/3770811663 wait complete. 2024-09-19T08:59:06.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.531+0000 7f1e11e7c640 1 Processor -- start 2024-09-19T08:59:06.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.531+0000 7f1e11e7c640 1 -- start start 2024-09-19T08:59:06.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.531+0000 7f1e11e7c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e0c100e20 0x7f1e0c1992b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.531+0000 7f1e11e7c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e0c102570 0x7f1e0c1997f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.531+0000 7f1e11e7c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e0c102ef0 0x7f1e0c1a4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.531+0000 7f1e11e7c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0c110f80 con 0x7f1e0c102ef0 2024-09-19T08:59:06.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.531+0000 7f1e11e7c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0c110e00 con 0x7f1e0c102570 2024-09-19T08:59:06.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.531+0000 7f1e11e7c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0c111100 con 0x7f1e0c100e20 2024-09-19T08:59:06.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.531+0000 7f1e0bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e0c102ef0 0x7f1e0c1a4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.531+0000 7f1e0bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e0c102ef0 0x7f1e0c1a4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50564/0 (socket says 172.21.15.19:50564) 2024-09-19T08:59:06.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.531+0000 7f1e0bfff640 1 -- 172.21.15.19:0/2724441214 learned_addr learned my addr 172.21.15.19:0/2724441214 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:06.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.531+0000 7f1e0b7fe640 1 --2- 172.21.15.19:0/2724441214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e0c100e20 0x7f1e0c1992b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.531+0000 7f1e03fff640 1 --2- 172.21.15.19:0/2724441214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e0c102570 0x7f1e0c1997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.532+0000 7f1e0bfff640 1 -- 172.21.15.19:0/2724441214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e0c100e20 msgr2=0x7f1e0c1992b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:06.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.532+0000 7f1e0bfff640 1 --2- 172.21.15.19:0/2724441214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e0c100e20 0x7f1e0c1992b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.532+0000 7f1e0bfff640 1 -- 172.21.15.19:0/2724441214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e0c102570 msgr2=0x7f1e0c1997f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:06.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.532+0000 7f1e0bfff640 1 --2- 172.21.15.19:0/2724441214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e0c102570 0x7f1e0c1997f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.532+0000 7f1e0bfff640 1 -- 172.21.15.19:0/2724441214 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e0c1a4870 con 0x7f1e0c102ef0 2024-09-19T08:59:06.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.532+0000 7f1e03fff640 1 --2- 172.21.15.19:0/2724441214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e0c102570 0x7f1e0c1997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:06.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.532+0000 7f1e0bfff640 1 --2- 172.21.15.19:0/2724441214 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e0c102ef0 0x7f1e0c1a4330 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f1e04004af0 tx=0x7f1e0402f3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:06.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.532+0000 7f1e097fa640 1 -- 172.21.15.19:0/2724441214 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e04034040 con 0x7f1e0c102ef0 2024-09-19T08:59:06.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.532+0000 7f1e11e7c640 1 -- 172.21.15.19:0/2724441214 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e0c1a4a40 con 0x7f1e0c102ef0 2024-09-19T08:59:06.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.532+0000 7f1e097fa640 1 -- 172.21.15.19:0/2724441214 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1e04030920 con 0x7f1e0c102ef0 2024-09-19T08:59:06.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.532+0000 7f1e097fa640 1 -- 172.21.15.19:0/2724441214 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e04004630 con 0x7f1e0c102ef0 2024-09-19T08:59:06.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.532+0000 7f1e11e7c640 1 -- 172.21.15.19:0/2724441214 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e0c1a4ef0 con 0x7f1e0c102ef0 2024-09-19T08:59:06.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.535+0000 7f1e097fa640 1 -- 172.21.15.19:0/2724441214 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f1e04037020 con 0x7f1e0c102ef0 2024-09-19T08:59:06.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.535+0000 7f1e14255740 1 Processor -- start 2024-09-19T08:59:06.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.535+0000 7f1e14255740 1 -- start start 2024-09-19T08:59:06.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.535+0000 7f1e14255740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558834b9db40 0x558834b9c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.535+0000 7f1e14255740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558834b9c5d0 0x558834b9ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.535+0000 7f1e14255740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558834ba7370 0x558834ba9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.535+0000 7f1e14255740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x558834b022f0 con 0x558834ba7370 2024-09-19T08:59:06.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.535+0000 7f1e14255740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x558834aa9cf0 con 0x558834b9db40 2024-09-19T08:59:06.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.535+0000 7f1e14255740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558834afe2b0 con 0x558834b9c5d0 2024-09-19T08:59:06.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.535+0000 7f1e03fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558834ba7370 0x558834ba9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.535+0000 7f1e0b7fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558834b9c5d0 0x558834b9ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.535+0000 7f1e03fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558834ba7370 0x558834ba9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50568/0 (socket says 172.21.15.19:50568) 2024-09-19T08:59:06.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.535+0000 7f1e03fff640 1 -- 172.21.15.19:0/263225456 learned_addr learned my addr 172.21.15.19:0/263225456 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:06.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.535+0000 7f1e03fff640 1 --2- 172.21.15.19:0/263225456 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558834b9db40 0x558834b9c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.535+0000 7f1e097fa640 1 --2- 172.21.15.19:0/2724441214 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1df80a3240 0x7f1df80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.536+0000 7f1e03fff640 1 -- 172.21.15.19:0/263225456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558834b9c5d0 msgr2=0x558834b9ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:06.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.536+0000 7f1e03fff640 1 --2- 172.21.15.19:0/263225456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558834b9c5d0 0x558834b9ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.536+0000 7f1e03fff640 1 -- 172.21.15.19:0/263225456 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558834b9db40 msgr2=0x558834b9c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:06.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.536+0000 7f1e03fff640 1 --2- 172.21.15.19:0/263225456 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558834b9db40 0x558834b9c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.536+0000 7f1e03fff640 1 -- 172.21.15.19:0/263225456 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558834a8e3a0 con 0x558834ba7370 2024-09-19T08:59:06.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.536+0000 7f1e0b7fe640 1 --2- 172.21.15.19:0/263225456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558834b9c5d0 0x558834b9ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:06.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.536+0000 7f1e0bfff640 1 --2- 172.21.15.19:0/2724441214 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1df80a3240 0x7f1df80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.536+0000 7f1e097fa640 1 -- 172.21.15.19:0/2724441214 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1e040f0640 con 0x7f1e0c102ef0 2024-09-19T08:59:06.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.536+0000 7f1e03fff640 1 --2- 172.21.15.19:0/263225456 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558834ba7370 0x558834ba9760 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f1df4011b60 tx=0x7f1df4005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f9d0bbd6069bc22 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:06.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.536+0000 7f1e01ffb640 1 -- 172.21.15.19:0/263225456 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df400fc50 con 0x558834ba7370 2024-09-19T08:59:06.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.536+0000 7f1e01ffb640 1 -- 172.21.15.19:0/263225456 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1df400fdf0 con 0x558834ba7370 2024-09-19T08:59:06.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.536+0000 7f1e01ffb640 1 -- 172.21.15.19:0/263225456 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df4010d90 con 0x558834ba7370 2024-09-19T08:59:06.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.537+0000 7f1e14255740 1 -- 172.21.15.19:0/263225456 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558834ba7370 msgr2=0x558834ba9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:06.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.537+0000 7f1e14255740 1 --2- 172.21.15.19:0/263225456 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558834ba7370 0x558834ba9760 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f1df4011b60 tx=0x7f1df4005850 comp rx=0 tx=0).stop 2024-09-19T08:59:06.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.537+0000 7f1e0bfff640 1 --2- 172.21.15.19:0/2724441214 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1df80a3240 0x7f1df80a5700 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1e040b9640 tx=0x7f1e04003f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:06.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.537+0000 7f1e14255740 1 -- 172.21.15.19:0/263225456 shutdown_connections 2024-09-19T08:59:06.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.537+0000 7f1e14255740 1 --2- 172.21.15.19:0/263225456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558834b9c5d0 0x558834b9ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.537+0000 7f1e14255740 1 --2- 172.21.15.19:0/263225456 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558834ba7370 0x558834ba9760 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.537+0000 7f1e14255740 1 --2- 172.21.15.19:0/263225456 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558834b9db40 0x558834b9c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.537+0000 7f1e14255740 1 -- 172.21.15.19:0/263225456 >> 172.21.15.19:0/263225456 conn(0x558834b65310 msgr2=0x558834b98c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:06.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.537+0000 7f1e14255740 1 -- 172.21.15.19:0/263225456 shutdown_connections 2024-09-19T08:59:06.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.537+0000 7f1e14255740 1 -- 172.21.15.19:0/263225456 wait complete. 2024-09-19T08:59:06.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.537+0000 7f1e14255740 1 -- start start 2024-09-19T08:59:06.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.538+0000 7f1e14255740 1 Processor -- start 2024-09-19T08:59:06.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.538+0000 7f1e14255740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558834b9c5d0 0x558834ba6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.538+0000 7f1e14255740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558834b9db40 0x558834ba3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.538+0000 7f1e14255740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558834ba7370 0x558834ba45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.538+0000 7f1e14255740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x558834baa070 con 0x558834b9db40 2024-09-19T08:59:06.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.538+0000 7f1e14255740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x558834abd060 con 0x558834b9c5d0 2024-09-19T08:59:06.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.538+0000 7f1e14255740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558834baa1f0 con 0x558834ba7370 2024-09-19T08:59:06.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.538+0000 7f1e14255740 10 client.0 _ll_register_callbacks cb 0x5588348108c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:06.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.538+0000 7f1e0b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558834b9db40 0x558834ba3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.538+0000 7f1e0b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558834b9db40 0x558834ba3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50578/0 (socket says 172.21.15.19:50578) 2024-09-19T08:59:06.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.538+0000 7f1e0b7fe640 1 -- 172.21.15.19:0/2484068879 learned_addr learned my addr 172.21.15.19:0/2484068879 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:06.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.538+0000 7f1e03fff640 1 --2- 172.21.15.19:0/2484068879 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558834b9c5d0 0x558834ba6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.538+0000 7f1e03fff640 1 --2- 172.21.15.19:0/2484068879 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558834ba7370 0x558834ba45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.538+0000 7f1e0b7fe640 1 -- 172.21.15.19:0/2484068879 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558834ba7370 msgr2=0x558834ba45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:06.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.538+0000 7f1e0b7fe640 1 --2- 172.21.15.19:0/2484068879 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558834ba7370 0x558834ba45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.538+0000 7f1e0b7fe640 1 -- 172.21.15.19:0/2484068879 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558834b9c5d0 msgr2=0x558834ba6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:06.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.538+0000 7f1e0b7fe640 1 --2- 172.21.15.19:0/2484068879 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558834b9c5d0 0x558834ba6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.538+0000 7f1e0b7fe640 1 -- 172.21.15.19:0/2484068879 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588348733c0 con 0x558834b9db40 2024-09-19T08:59:06.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.538+0000 7f1e03fff640 1 --2- 172.21.15.19:0/2484068879 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558834b9c5d0 0x558834ba6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:59:06.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.538+0000 7f1e0b7fe640 1 --2- 172.21.15.19:0/2484068879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558834b9db40 0x558834ba3fe0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc012740 tx=0x7f1dfc012c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae0be9aa6817b90 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:06.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.538+0000 7f1deaffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:59:06.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.538+0000 7f1deaffd640 1 -- 172.21.15.19:0/2484068879 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc004030 con 0x558834b9db40 2024-09-19T08:59:06.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.539+0000 7f1e14255740 1 -- 172.21.15.19:0/2484068879 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1df400fdf0 con 0x558834b9db40 2024-09-19T08:59:06.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.539+0000 7f1deaffd640 1 -- 172.21.15.19:0/2484068879 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1dfc0041d0 con 0x558834b9db40 2024-09-19T08:59:06.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.539+0000 7f1deaffd640 1 -- 172.21.15.19:0/2484068879 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f1dfc0043d0 con 0x558834b9db40 2024-09-19T08:59:06.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.539+0000 7f1e14255740 10 client.17040 fetch_fsmap learned FSMap version 36 2024-09-19T08:59:06.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.539+0000 7f1e14255740 1 -- 172.21.15.19:0/2484068879 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x558834bb5bb0 con 0x558834b9db40 2024-09-19T08:59:06.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.539+0000 7f1deaffd640 1 -- 172.21.15.19:0/2484068879 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1df400fdf0 con 0x558834b9db40 2024-09-19T08:59:06.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.539+0000 7f1deaffd640 1 -- 172.21.15.19:0/2484068879 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f1dfc003c30 con 0x558834b9db40 2024-09-19T08:59:06.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.539+0000 7f1e14255740 10 client.17040 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T08:59:06.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.539+0000 7f1e14255740 10 client.17040 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:59:06.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.539+0000 7f1e14255740 20 client.17040 populate_metadata read hostname 'smithi019' 2024-09-19T08:59:06.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.539+0000 7f1e14255740 1 --2- 172.21.15.19:0/2484068879 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x558834bb70c0 0x558834bb94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.539+0000 7f1e14255740 4 client.17040 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:59:06.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.539+0000 7f1e14255740 1 -- 172.21.15.19:0/2484068879 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558834b0f860 con 0x558834bb70c0 2024-09-19T08:59:06.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.539+0000 7f1e03fff640 1 --2- 172.21.15.19:0/2484068879 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x558834bb70c0 0x558834bb94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.540+0000 7f1deaffd640 10 client.17040 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:59:06.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.540+0000 7f1e03fff640 1 --2- 172.21.15.19:0/2484068879 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x558834bb70c0 0x558834bb94b0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d08d91c5ba879a00 server_cookie=fcdd43b751a04f0e in_seq=0 out_seq=0 2024-09-19T08:59:06.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.544+0000 7f1deaffd640 1 -- 172.21.15.19:0/2484068879 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558834b0f860 con 0x558834bb70c0 2024-09-19T08:59:06.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.545+0000 7f1deaffd640 10 client.17040 handle_command_reply: tid=0 2024-09-19T08:59:06.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.545+0000 7f1e14255740 1 client.17040 shutdown 2024-09-19T08:59:06.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.545+0000 7f1e14255740 1 -- 172.21.15.19:0/2484068879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558834b9db40 msgr2=0x558834ba3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:06.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.545+0000 7f1e14255740 1 --2- 172.21.15.19:0/2484068879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558834b9db40 0x558834ba3fe0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc012740 tx=0x7f1dfc012c00 comp rx=0 tx=0).stop 2024-09-19T08:59:06.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.545+0000 7f1e14255740 1 -- 172.21.15.19:0/2484068879 shutdown_connections 2024-09-19T08:59:06.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.545+0000 7f1e14255740 1 --2- 172.21.15.19:0/2484068879 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x558834bb70c0 0x558834bb94b0 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.545+0000 7f1e14255740 1 --2- 172.21.15.19:0/2484068879 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558834ba7370 0x558834ba45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.545+0000 7f1e14255740 1 --2- 172.21.15.19:0/2484068879 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558834b9db40 0x558834ba3fe0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.545+0000 7f1e14255740 1 --2- 172.21.15.19:0/2484068879 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558834b9c5d0 0x558834ba6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.545+0000 7f1deaffd640 0 client.17040 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:59:06.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.545+0000 7f1e14255740 1 -- 172.21.15.19:0/2484068879 >> 172.21.15.19:0/2484068879 conn(0x558834b65310 msgr2=0x558834b9e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:06.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.545+0000 7f1e14255740 1 -- 172.21.15.19:0/2484068879 shutdown_connections 2024-09-19T08:59:06.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.545+0000 7f1e14255740 1 -- 172.21.15.19:0/2484068879 wait complete. 2024-09-19T08:59:06.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.545+0000 7f1e14255740 20 client.17040 trim_cache size 0 max 16384 2024-09-19T08:59:06.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.558+0000 7f1e14255740 1 Processor -- start 2024-09-19T08:59:06.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.558+0000 7f1e14255740 1 -- start start 2024-09-19T08:59:06.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.558+0000 7f1e14255740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558834b9c5d0 0x558834b98e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.558+0000 7f1e14255740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558834b9db40 0x558834bb3340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.558+0000 7f1e14255740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558834ba7370 0x558834ba38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.558+0000 7f1e14255740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0c1ad430 con 0x558834ba7370 2024-09-19T08:59:06.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.558+0000 7f1e14255740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0c1aef70 con 0x558834b9c5d0 2024-09-19T08:59:06.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.558+0000 7f1e14255740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0c1adb00 con 0x558834b9db40 2024-09-19T08:59:06.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.559+0000 7f1e03fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558834ba7370 0x558834ba38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.559+0000 7f1e03fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558834ba7370 0x558834ba38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50586/0 (socket says 172.21.15.19:50586) 2024-09-19T08:59:06.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.559+0000 7f1e03fff640 1 -- 172.21.15.19:0/2968279293 learned_addr learned my addr 172.21.15.19:0/2968279293 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:06.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.559+0000 7f1e0b7fe640 1 --2- 172.21.15.19:0/2968279293 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558834b9db40 0x558834bb3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.559+0000 7f1e03fff640 1 --2- 172.21.15.19:0/2968279293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558834b9c5d0 0x558834b98e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.559+0000 7f1e03fff640 1 -- 172.21.15.19:0/2968279293 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558834b9db40 msgr2=0x558834bb3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:06.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.559+0000 7f1e03fff640 1 --2- 172.21.15.19:0/2968279293 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558834b9db40 0x558834bb3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.559+0000 7f1e03fff640 1 -- 172.21.15.19:0/2968279293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558834b9c5d0 msgr2=0x558834b98e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:06.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.559+0000 7f1e03fff640 1 --2- 172.21.15.19:0/2968279293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558834b9c5d0 0x558834b98e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.559+0000 7f1e03fff640 1 -- 172.21.15.19:0/2968279293 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558834b99960 con 0x558834ba7370 2024-09-19T08:59:06.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.559+0000 7f1e03fff640 1 --2- 172.21.15.19:0/2968279293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558834ba7370 0x558834ba38a0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f1df4010a40 tx=0x7f1df4009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe8959875c880ee5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:06.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.559+0000 7f1e017fa640 1 -- 172.21.15.19:0/2968279293 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df4005040 con 0x558834ba7370 2024-09-19T08:59:06.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.559+0000 7f1e017fa640 1 -- 172.21.15.19:0/2968279293 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1df4004640 con 0x558834ba7370 2024-09-19T08:59:06.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.559+0000 7f1e017fa640 1 -- 172.21.15.19:0/2968279293 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df4010d20 con 0x558834ba7370 2024-09-19T08:59:06.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.560+0000 7f1e14255740 1 -- 172.21.15.19:0/2968279293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558834ba7370 msgr2=0x558834ba38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:06.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.560+0000 7f1e14255740 1 --2- 172.21.15.19:0/2968279293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558834ba7370 0x558834ba38a0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f1df4010a40 tx=0x7f1df4009ed0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.560+0000 7f1e14255740 1 -- 172.21.15.19:0/2968279293 shutdown_connections 2024-09-19T08:59:06.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.560+0000 7f1e14255740 1 --2- 172.21.15.19:0/2968279293 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558834b9db40 0x558834bb3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.560+0000 7f1e14255740 1 --2- 172.21.15.19:0/2968279293 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558834ba7370 0x558834ba38a0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.560+0000 7f1e14255740 1 --2- 172.21.15.19:0/2968279293 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558834b9c5d0 0x558834b98e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.560+0000 7f1e14255740 1 -- 172.21.15.19:0/2968279293 >> 172.21.15.19:0/2968279293 conn(0x558834b65310 msgr2=0x558834b98700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:06.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.560+0000 7f1e14255740 1 -- 172.21.15.19:0/2968279293 shutdown_connections 2024-09-19T08:59:06.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.560+0000 7f1e14255740 1 -- 172.21.15.19:0/2968279293 wait complete. 2024-09-19T08:59:06.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.560+0000 7f1e14255740 1 -- start start 2024-09-19T08:59:06.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.561+0000 7f1e14255740 1 Processor -- start 2024-09-19T08:59:06.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.561+0000 7f1e14255740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558834b9c5d0 0x558834baf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.561+0000 7f1e14255740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558834b9db40 0x558834baf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.561+0000 7f1e14255740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558834ba7370 0x558834ba0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.561+0000 7f1e14255740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0c1ae8a0 con 0x558834b9db40 2024-09-19T08:59:06.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.561+0000 7f1e14255740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0c1ae1d0 con 0x558834ba7370 2024-09-19T08:59:06.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.561+0000 7f1e14255740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1e0c1ab410 con 0x558834b9c5d0 2024-09-19T08:59:06.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.561+0000 7f1e14255740 10 client.0 _ll_register_callbacks cb 0x7f1dfc009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:06.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.561+0000 7f1e0b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558834b9db40 0x558834baf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.561+0000 7f1e0b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558834b9db40 0x558834baf9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50596/0 (socket says 172.21.15.19:50596) 2024-09-19T08:59:06.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.561+0000 7f1e03fff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558834b9c5d0 0x558834baf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.561+0000 7f1e0b7fe640 1 -- 172.21.15.19:0/4286500232 learned_addr learned my addr 172.21.15.19:0/4286500232 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:06.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.561+0000 7f1e03fff640 1 --2- 172.21.15.19:0/4286500232 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558834ba7370 0x558834ba0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.561+0000 7f1e0b7fe640 1 -- 172.21.15.19:0/4286500232 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558834b9c5d0 msgr2=0x558834baf4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:06.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.561+0000 7f1e0b7fe640 1 --2- 172.21.15.19:0/4286500232 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558834b9c5d0 0x558834baf4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.561+0000 7f1e0b7fe640 1 -- 172.21.15.19:0/4286500232 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558834ba7370 msgr2=0x558834ba0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:06.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.561+0000 7f1e0b7fe640 1 --2- 172.21.15.19:0/4286500232 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558834ba7370 0x558834ba0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.561+0000 7f1e0b7fe640 1 -- 172.21.15.19:0/4286500232 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558834ba0b70 con 0x558834b9db40 2024-09-19T08:59:06.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.562+0000 7f1e0b7fe640 1 --2- 172.21.15.19:0/4286500232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558834b9db40 0x558834baf9f0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc0104d0 tx=0x7f1dfc00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d94859c1d4dba772 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:06.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.562+0000 7f1deaffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:59:06.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.562+0000 7f1deaffd640 1 -- 172.21.15.19:0/4286500232 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dfc005250 con 0x558834b9db40 2024-09-19T08:59:06.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.562+0000 7f1deaffd640 1 -- 172.21.15.19:0/4286500232 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1dfc018040 con 0x558834b9db40 2024-09-19T08:59:06.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.562+0000 7f1e14255740 1 -- 172.21.15.19:0/4286500232 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1df4004640 con 0x558834b9db40 2024-09-19T08:59:06.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.562+0000 7f1deaffd640 1 -- 172.21.15.19:0/4286500232 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f1dfc0053f0 con 0x558834b9db40 2024-09-19T08:59:06.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.562+0000 7f1e14255740 10 client.17046 fetch_fsmap learned FSMap version 36 2024-09-19T08:59:06.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.562+0000 7f1e14255740 1 -- 172.21.15.19:0/4286500232 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x558834c21530 con 0x558834b9db40 2024-09-19T08:59:06.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.562+0000 7f1deaffd640 1 -- 172.21.15.19:0/4286500232 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1df4004640 con 0x558834b9db40 2024-09-19T08:59:06.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.562+0000 7f1deaffd640 1 -- 172.21.15.19:0/4286500232 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f1dfc004600 con 0x558834b9db40 2024-09-19T08:59:06.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.562+0000 7f1e14255740 10 client.17046 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T08:59:06.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.562+0000 7f1e14255740 10 client.17046 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:59:06.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.562+0000 7f1e14255740 20 client.17046 populate_metadata read hostname 'smithi019' 2024-09-19T08:59:06.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.562+0000 7f1e14255740 1 --2- 172.21.15.19:0/4286500232 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x558834c21c40 0x558834c24060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.562+0000 7f1e14255740 4 client.17046 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T08:59:06.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.562+0000 7f1e14255740 1 -- 172.21.15.19:0/4286500232 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558834b09d70 con 0x558834c21c40 2024-09-19T08:59:06.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.563+0000 7f1e03fff640 1 --2- 172.21.15.19:0/4286500232 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x558834c21c40 0x558834c24060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.563+0000 7f1e03fff640 1 --2- 172.21.15.19:0/4286500232 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x558834c21c40 0x558834c24060 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=212231cd935f3330 server_cookie=5ad44304dfa8d59 in_seq=0 out_seq=0 2024-09-19T08:59:06.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.563+0000 7f1deaffd640 10 client.17046 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:59:06.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.567+0000 7f1deaffd640 1 -- 172.21.15.19:0/4286500232 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558834b09d70 con 0x558834c21c40 2024-09-19T08:59:06.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.567+0000 7f1deaffd640 10 client.17046 handle_command_reply: tid=0 2024-09-19T08:59:06.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.567+0000 7f1e14255740 1 client.17046 shutdown 2024-09-19T08:59:06.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.567+0000 7f1e14255740 1 -- 172.21.15.19:0/4286500232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558834b9db40 msgr2=0x558834baf9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:06.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.567+0000 7f1e14255740 1 --2- 172.21.15.19:0/4286500232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558834b9db40 0x558834baf9f0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc0104d0 tx=0x7f1dfc00f790 comp rx=0 tx=0).stop 2024-09-19T08:59:06.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.567+0000 7f1e14255740 1 -- 172.21.15.19:0/4286500232 shutdown_connections 2024-09-19T08:59:06.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.567+0000 7f1e14255740 1 --2- 172.21.15.19:0/4286500232 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x558834c21c40 0x558834c24060 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.567+0000 7f1e14255740 1 --2- 172.21.15.19:0/4286500232 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558834ba7370 0x558834ba0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.567+0000 7f1e14255740 1 --2- 172.21.15.19:0/4286500232 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558834b9db40 0x558834baf9f0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.567+0000 7f1e14255740 1 --2- 172.21.15.19:0/4286500232 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558834b9c5d0 0x558834baf4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.567+0000 7f1e14255740 1 -- 172.21.15.19:0/4286500232 >> 172.21.15.19:0/4286500232 conn(0x558834b65310 msgr2=0x558834ba38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:06.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.567+0000 7f1deaffd640 0 client.17046 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:59:06.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.567+0000 7f1e14255740 1 -- 172.21.15.19:0/4286500232 shutdown_connections 2024-09-19T08:59:06.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.567+0000 7f1e14255740 1 -- 172.21.15.19:0/4286500232 wait complete. 2024-09-19T08:59:06.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.568+0000 7f1e14255740 20 client.17046 trim_cache size 0 max 16384 2024-09-19T08:59:06.574 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T08:59:06.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.568+0000 7f1e11e7c640 1 -- 172.21.15.19:0/2724441214 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1df80a3240 msgr2=0x7f1df80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:06.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.568+0000 7f1e11e7c640 1 --2- 172.21.15.19:0/2724441214 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1df80a3240 0x7f1df80a5700 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1e040b9640 tx=0x7f1e04003f90 comp rx=0 tx=0).stop 2024-09-19T08:59:06.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.568+0000 7f1e11e7c640 1 -- 172.21.15.19:0/2724441214 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e0c102ef0 msgr2=0x7f1e0c1a4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:06.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.568+0000 7f1e11e7c640 1 --2- 172.21.15.19:0/2724441214 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e0c102ef0 0x7f1e0c1a4330 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f1e04004af0 tx=0x7f1e0402f3a0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.568+0000 7f1e11e7c640 1 -- 172.21.15.19:0/2724441214 shutdown_connections 2024-09-19T08:59:06.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.568+0000 7f1e11e7c640 1 --2- 172.21.15.19:0/2724441214 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1df80a3240 0x7f1df80a5700 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.568+0000 7f1e11e7c640 1 --2- 172.21.15.19:0/2724441214 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1e0c102ef0 0x7f1e0c1a4330 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.568+0000 7f1e11e7c640 1 --2- 172.21.15.19:0/2724441214 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1e0c102570 0x7f1e0c1997f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.568+0000 7f1e11e7c640 1 --2- 172.21.15.19:0/2724441214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1e0c100e20 0x7f1e0c1992b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.568+0000 7f1e11e7c640 1 -- 172.21.15.19:0/2724441214 >> 172.21.15.19:0/2724441214 conn(0x7f1e0c0fc7d0 msgr2=0x7f1e0c106820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:06.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.568+0000 7f1e11e7c640 1 -- 172.21.15.19:0/2724441214 shutdown_connections 2024-09-19T08:59:06.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:06.568+0000 7f1e11e7c640 1 -- 172.21.15.19:0/2724441214 wait complete. 2024-09-19T08:59:06.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.890+0000 7f935d05e640 1 -- 172.21.15.19:0/3784059112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9358100a40 msgr2=0x7f9358100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:06.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.890+0000 7f935d05e640 1 --2- 172.21.15.19:0/3784059112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9358100a40 0x7f9358100e40 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f9348009900 tx=0x7f934802a410 comp rx=0 tx=0).stop 2024-09-19T08:59:06.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.890+0000 7f935d05e640 1 -- 172.21.15.19:0/3784059112 shutdown_connections 2024-09-19T08:59:06.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.890+0000 7f935d05e640 1 --2- 172.21.15.19:0/3784059112 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9358101c30 0x7f93581020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.890+0000 7f935d05e640 1 --2- 172.21.15.19:0/3784059112 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f93581025f0 0x7f9358108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.890+0000 7f935d05e640 1 --2- 172.21.15.19:0/3784059112 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9358100a40 0x7f9358100e40 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.890+0000 7f935d05e640 1 -- 172.21.15.19:0/3784059112 >> 172.21.15.19:0/3784059112 conn(0x7f93580fc1e0 msgr2=0x7f93580fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:06.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.890+0000 7f935d05e640 1 -- 172.21.15.19:0/3784059112 shutdown_connections 2024-09-19T08:59:06.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.890+0000 7f935d05e640 1 -- 172.21.15.19:0/3784059112 wait complete. 2024-09-19T08:59:06.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.891+0000 7f935d05e640 1 Processor -- start 2024-09-19T08:59:06.893 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.891+0000 7f935d05e640 1 -- start start 2024-09-19T08:59:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.891+0000 7f935d05e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9358100a40 0x7f9358197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.891+0000 7f935d05e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9358101c30 0x7f9358198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.891+0000 7f935d05e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93581025f0 0x7f935819f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.891+0000 7f935d05e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f935810d810 con 0x7f93581025f0 2024-09-19T08:59:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.891+0000 7f935d05e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f935810d690 con 0x7f9358101c30 2024-09-19T08:59:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.891+0000 7f935d05e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f935810d990 con 0x7f9358100a40 2024-09-19T08:59:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.891+0000 7f935759e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93581025f0 0x7f935819f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.891+0000 7f935659c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9358101c30 0x7f9358198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.891+0000 7f935659c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9358101c30 0x7f9358198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:35818/0 (socket says 172.21.15.19:35818) 2024-09-19T08:59:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.891+0000 7f935759e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93581025f0 0x7f935819f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50612/0 (socket says 172.21.15.19:50612) 2024-09-19T08:59:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.891+0000 7f935659c640 1 -- 172.21.15.19:0/2183133342 learned_addr learned my addr 172.21.15.19:0/2183133342 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.891+0000 7f9356d9d640 1 --2- 172.21.15.19:0/2183133342 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9358100a40 0x7f9358197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.892+0000 7f935759e640 1 -- 172.21.15.19:0/2183133342 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9358100a40 msgr2=0x7f9358197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.892+0000 7f935759e640 1 --2- 172.21.15.19:0/2183133342 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9358100a40 0x7f9358197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.892+0000 7f935759e640 1 -- 172.21.15.19:0/2183133342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9358101c30 msgr2=0x7f9358198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.892+0000 7f935759e640 1 --2- 172.21.15.19:0/2183133342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9358101c30 0x7f9358198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.892+0000 7f935759e640 1 -- 172.21.15.19:0/2183133342 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f935819fa10 con 0x7f93581025f0 2024-09-19T08:59:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.892+0000 7f935659c640 1 --2- 172.21.15.19:0/2183133342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9358101c30 0x7f9358198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.892+0000 7f935759e640 1 --2- 172.21.15.19:0/2183133342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93581025f0 0x7f935819f3a0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f9350009fd0 tx=0x7f935000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.892+0000 7f933ffff640 1 -- 172.21.15.19:0/2183133342 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f935000ce20 con 0x7f93581025f0 2024-09-19T08:59:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.892+0000 7f933ffff640 1 -- 172.21.15.19:0/2183133342 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9350005020 con 0x7f93581025f0 2024-09-19T08:59:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.892+0000 7f935d05e640 1 -- 172.21.15.19:0/2183133342 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f935819fd00 con 0x7f93581025f0 2024-09-19T08:59:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.892+0000 7f933ffff640 1 -- 172.21.15.19:0/2183133342 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9350010720 con 0x7f93581025f0 2024-09-19T08:59:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.892+0000 7f935d05e640 1 -- 172.21.15.19:0/2183133342 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93581a01f0 con 0x7f93581025f0 2024-09-19T08:59:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.894+0000 7f933ffff640 1 -- 172.21.15.19:0/2183133342 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f9350005540 con 0x7f93581025f0 2024-09-19T08:59:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.895+0000 7f935fdf8740 1 Processor -- start 2024-09-19T08:59:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.895+0000 7f935fdf8740 1 -- start start 2024-09-19T08:59:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.895+0000 7f935fdf8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8c97ec9a0 0x55e8c97ecda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.895+0000 7f935fdf8740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e8c97ed2e0 0x55e8c97f1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.895+0000 7f935fdf8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c97f2370 0x55e8c97f4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.895+0000 7f935fdf8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e8c97502f0 con 0x55e8c97f2370 2024-09-19T08:59:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.895+0000 7f935fdf8740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55e8c96f8270 con 0x55e8c97ed2e0 2024-09-19T08:59:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.895+0000 7f935fdf8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e8c974c2b0 con 0x55e8c97ec9a0 2024-09-19T08:59:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.895+0000 7f935659c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8c97ec9a0 0x55e8c97ecda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.895+0000 7f9356d9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e8c97ed2e0 0x55e8c97f1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.895+0000 7f9356d9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e8c97ed2e0 0x55e8c97f1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:35820/0 (socket says 172.21.15.19:35820) 2024-09-19T08:59:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.895+0000 7f935659c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8c97ec9a0 0x55e8c97ecda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:44044/0 (socket says 172.21.15.19:44044) 2024-09-19T08:59:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.895+0000 7f9356d9d640 1 -- 172.21.15.19:0/1543726937 learned_addr learned my addr 172.21.15.19:0/1543726937 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.895+0000 7f935659c640 1 --2- 172.21.15.19:0/1543726937 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c97f2370 0x55e8c97f4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.895+0000 7f933ffff640 1 --2- 172.21.15.19:0/2183133342 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f93400a3370 0x7f93400a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.895+0000 7f9356d9d640 1 -- 172.21.15.19:0/1543726937 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8c97ec9a0 msgr2=0x55e8c97ecda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.895+0000 7f9356d9d640 1 --2- 172.21.15.19:0/1543726937 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8c97ec9a0 0x55e8c97ecda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.895+0000 7f9356d9d640 1 -- 172.21.15.19:0/1543726937 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c97f2370 msgr2=0x55e8c97f4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.895+0000 7f9356d9d640 1 --2- 172.21.15.19:0/1543726937 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c97f2370 0x55e8c97f4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.896+0000 7f9356d9d640 1 -- 172.21.15.19:0/1543726937 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8c96f7340 con 0x55e8c97ed2e0 2024-09-19T08:59:06.900 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.896+0000 7f935659c640 1 --2- 172.21.15.19:0/1543726937 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8c97ec9a0 0x55e8c97ecda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:06.900 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.896+0000 7f935759e640 1 --2- 172.21.15.19:0/2183133342 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f93400a3370 0x7f93400a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.900 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.896+0000 7f933ffff640 1 -- 172.21.15.19:0/2183133342 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f93500cffe0 con 0x7f93581025f0 2024-09-19T08:59:06.900 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.896+0000 7f9356d9d640 1 --2- 172.21.15.19:0/1543726937 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e8c97ed2e0 0x55e8c97f1da0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9348031610 tx=0x7f9348005de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bd6e0f9413e7be5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:06.900 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.896+0000 7f933d7fa640 1 -- 172.21.15.19:0/1543726937 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9348040070 con 0x55e8c97ed2e0 2024-09-19T08:59:06.900 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.896+0000 7f935759e640 1 --2- 172.21.15.19:0/2183133342 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f93400a3370 0x7f93400a5830 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9350098a10 tx=0x7f9350066ff0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:06.900 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.896+0000 7f933d7fa640 1 -- 172.21.15.19:0/1543726937 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9348004030 con 0x55e8c97ed2e0 2024-09-19T08:59:06.900 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.896+0000 7f933d7fa640 1 -- 172.21.15.19:0/1543726937 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9348035040 con 0x55e8c97ed2e0 2024-09-19T08:59:06.900 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.897+0000 7f935fdf8740 1 -- 172.21.15.19:0/1543726937 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e8c97ed2e0 msgr2=0x55e8c97f1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:06.900 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.897+0000 7f935fdf8740 1 --2- 172.21.15.19:0/1543726937 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e8c97ed2e0 0x55e8c97f1da0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9348031610 tx=0x7f9348005de0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.900 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.897+0000 7f935fdf8740 1 -- 172.21.15.19:0/1543726937 shutdown_connections 2024-09-19T08:59:06.900 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.897+0000 7f935fdf8740 1 --2- 172.21.15.19:0/1543726937 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c97f2370 0x55e8c97f4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.900 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.897+0000 7f935fdf8740 1 --2- 172.21.15.19:0/1543726937 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e8c97ed2e0 0x55e8c97f1da0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.897+0000 7f935fdf8740 1 --2- 172.21.15.19:0/1543726937 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8c97ec9a0 0x55e8c97ecda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.897+0000 7f935fdf8740 1 -- 172.21.15.19:0/1543726937 >> 172.21.15.19:0/1543726937 conn(0x55e8c97e8010 msgr2=0x55e8c97e8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.897+0000 7f935fdf8740 1 -- 172.21.15.19:0/1543726937 shutdown_connections 2024-09-19T08:59:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.897+0000 7f935fdf8740 1 -- 172.21.15.19:0/1543726937 wait complete. 2024-09-19T08:59:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.897+0000 7f935fdf8740 1 -- start start 2024-09-19T08:59:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.897+0000 7f935fdf8740 1 Processor -- start 2024-09-19T08:59:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.898+0000 7f935fdf8740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e8c97ec9a0 0x55e8c97f6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.898+0000 7f935fdf8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c97ed2e0 0x55e8c97f70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.898+0000 7f935fdf8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8c97f2370 0x55e8c97fe0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.898+0000 7f935fdf8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e8c97f52e0 con 0x55e8c97ed2e0 2024-09-19T08:59:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.898+0000 7f935fdf8740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55e8c96d9290 con 0x55e8c97ec9a0 2024-09-19T08:59:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.898+0000 7f935fdf8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e8c97f5460 con 0x55e8c97f2370 2024-09-19T08:59:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.898+0000 7f935fdf8740 10 client.0 _ll_register_callbacks cb 0x55e8c970a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:06.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.898+0000 7f9356d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c97ed2e0 0x55e8c97f70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.899+0000 7f9356d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c97ed2e0 0x55e8c97f70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50630/0 (socket says 172.21.15.19:50630) 2024-09-19T08:59:06.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.899+0000 7f9356d9d640 1 -- 172.21.15.19:0/1841320003 learned_addr learned my addr 172.21.15.19:0/1841320003 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:06.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.899+0000 7f935659c640 1 --2- 172.21.15.19:0/1841320003 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e8c97ec9a0 0x55e8c97f6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.899+0000 7f935659c640 1 --2- 172.21.15.19:0/1841320003 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8c97f2370 0x55e8c97fe0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.899+0000 7f9356d9d640 1 -- 172.21.15.19:0/1841320003 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8c97f2370 msgr2=0x55e8c97fe0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:06.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.899+0000 7f9356d9d640 1 --2- 172.21.15.19:0/1841320003 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8c97f2370 0x55e8c97fe0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.899+0000 7f9356d9d640 1 -- 172.21.15.19:0/1841320003 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e8c97ec9a0 msgr2=0x55e8c97f6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:06.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.899+0000 7f9356d9d640 1 --2- 172.21.15.19:0/1841320003 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e8c97ec9a0 0x55e8c97f6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.899+0000 7f9356d9d640 1 -- 172.21.15.19:0/1841320003 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8c9463210 con 0x55e8c97ed2e0 2024-09-19T08:59:06.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.899+0000 7f9356d9d640 1 --2- 172.21.15.19:0/1841320003 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c97ed2e0 0x55e8c97f70b0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f9348000c00 tx=0x7f9348009590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c7bffd3cfc22036 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:06.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.899+0000 7f933aff5640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:59:06.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.899+0000 7f933aff5640 1 -- 172.21.15.19:0/1841320003 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934804c020 con 0x55e8c97ed2e0 2024-09-19T08:59:06.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.899+0000 7f933aff5640 1 -- 172.21.15.19:0/1841320003 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f93480043e0 con 0x55e8c97ed2e0 2024-09-19T08:59:06.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.899+0000 7f935fdf8740 1 -- 172.21.15.19:0/1841320003 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9348004030 con 0x55e8c97ed2e0 2024-09-19T08:59:06.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.900+0000 7f933aff5640 1 -- 172.21.15.19:0/1841320003 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f9348040070 con 0x55e8c97ed2e0 2024-09-19T08:59:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.900+0000 7f935fdf8740 10 client.17058 fetch_fsmap learned FSMap version 36 2024-09-19T08:59:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.900+0000 7f935fdf8740 1 -- 172.21.15.19:0/1841320003 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55e8c952f620 con 0x55e8c97ed2e0 2024-09-19T08:59:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.900+0000 7f933aff5640 1 -- 172.21.15.19:0/1841320003 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9348004030 con 0x55e8c97ed2e0 2024-09-19T08:59:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.900+0000 7f933aff5640 1 -- 172.21.15.19:0/1841320003 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f93480035f0 con 0x55e8c97ed2e0 2024-09-19T08:59:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.900+0000 7f935fdf8740 10 client.17058 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T08:59:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.900+0000 7f935fdf8740 10 client.17058 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:59:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.900+0000 7f935fdf8740 20 client.17058 populate_metadata read hostname 'smithi019' 2024-09-19T08:59:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.900+0000 7f935fdf8740 1 --2- 172.21.15.19:0/1841320003 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e8c9817810 0x55e8c9819c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.900+0000 7f935fdf8740 4 client.17058 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:59:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.900+0000 7f935fdf8740 1 -- 172.21.15.19:0/1841320003 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e8c975da20 con 0x55e8c9817810 2024-09-19T08:59:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.900+0000 7f935659c640 1 --2- 172.21.15.19:0/1841320003 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e8c9817810 0x55e8c9819c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.901+0000 7f933aff5640 10 client.17058 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:59:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.901+0000 7f935659c640 1 --2- 172.21.15.19:0/1841320003 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e8c9817810 0x55e8c9819c00 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d4a9d784627a509 server_cookie=aca4fb9d5475124f in_seq=0 out_seq=0 2024-09-19T08:59:06.906 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.904+0000 7f933aff5640 1 -- 172.21.15.19:0/1841320003 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e8c975da20 con 0x55e8c9817810 2024-09-19T08:59:06.907 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.904+0000 7f933aff5640 10 client.17058 handle_command_reply: tid=0 2024-09-19T08:59:06.907 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.904+0000 7f935fdf8740 1 client.17058 shutdown 2024-09-19T08:59:06.907 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.904+0000 7f935fdf8740 1 -- 172.21.15.19:0/1841320003 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c97ed2e0 msgr2=0x55e8c97f70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:06.907 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.904+0000 7f935fdf8740 1 --2- 172.21.15.19:0/1841320003 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c97ed2e0 0x55e8c97f70b0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f9348000c00 tx=0x7f9348009590 comp rx=0 tx=0).stop 2024-09-19T08:59:06.907 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.904+0000 7f935fdf8740 1 -- 172.21.15.19:0/1841320003 shutdown_connections 2024-09-19T08:59:06.907 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.904+0000 7f935fdf8740 1 --2- 172.21.15.19:0/1841320003 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e8c9817810 0x55e8c9819c00 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.907 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.904+0000 7f935fdf8740 1 --2- 172.21.15.19:0/1841320003 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8c97f2370 0x55e8c97fe0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.907 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.904+0000 7f935fdf8740 1 --2- 172.21.15.19:0/1841320003 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c97ed2e0 0x55e8c97f70b0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.907 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.904+0000 7f933aff5640 0 client.17058 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:59:06.907 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.904+0000 7f935fdf8740 1 --2- 172.21.15.19:0/1841320003 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e8c97ec9a0 0x55e8c97f6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.907 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.904+0000 7f935fdf8740 1 -- 172.21.15.19:0/1841320003 >> 172.21.15.19:0/1841320003 conn(0x55e8c97e8010 msgr2=0x55e8c97e9820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:06.907 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.904+0000 7f935fdf8740 1 -- 172.21.15.19:0/1841320003 shutdown_connections 2024-09-19T08:59:06.908 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.904+0000 7f935fdf8740 1 -- 172.21.15.19:0/1841320003 wait complete. 2024-09-19T08:59:06.908 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.904+0000 7f935fdf8740 20 client.17058 trim_cache size 0 max 16384 2024-09-19T08:59:06.924 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.919+0000 7f935fdf8740 1 Processor -- start 2024-09-19T08:59:06.924 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.919+0000 7f935fdf8740 1 -- start start 2024-09-19T08:59:06.924 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.919+0000 7f935fdf8740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e8c97ec9a0 0x55e8c97e70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.924 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.919+0000 7f935fdf8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c97ed2e0 0x55e8c97fe0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.924 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.919+0000 7f935fdf8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8c97f2370 0x55e8c97e9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.924 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.919+0000 7f935fdf8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9358072430 con 0x55e8c97ed2e0 2024-09-19T08:59:06.924 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.919+0000 7f935fdf8740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9358073f70 con 0x55e8c97ec9a0 2024-09-19T08:59:06.924 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.919+0000 7f935fdf8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9358072b00 con 0x55e8c97f2370 2024-09-19T08:59:06.925 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.919+0000 7f9356d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c97ed2e0 0x55e8c97fe0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.925 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.919+0000 7f9356d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c97ed2e0 0x55e8c97fe0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50642/0 (socket says 172.21.15.19:50642) 2024-09-19T08:59:06.925 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.919+0000 7f9356d9d640 1 -- 172.21.15.19:0/1759467735 learned_addr learned my addr 172.21.15.19:0/1759467735 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:06.925 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.919+0000 7f935659c640 1 --2- 172.21.15.19:0/1759467735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8c97f2370 0x55e8c97e9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.925 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.919+0000 7f935659c640 1 --2- 172.21.15.19:0/1759467735 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e8c97ec9a0 0x55e8c97e70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.925 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.920+0000 7f9356d9d640 1 -- 172.21.15.19:0/1759467735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8c97f2370 msgr2=0x55e8c97e9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:06.925 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.920+0000 7f9356d9d640 1 --2- 172.21.15.19:0/1759467735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8c97f2370 0x55e8c97e9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.925 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.920+0000 7f9356d9d640 1 -- 172.21.15.19:0/1759467735 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e8c97ec9a0 msgr2=0x55e8c97e70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:06.925 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.920+0000 7f9356d9d640 1 --2- 172.21.15.19:0/1759467735 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e8c97ec9a0 0x55e8c97e70b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.925 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.920+0000 7f9356d9d640 1 -- 172.21.15.19:0/1759467735 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8c981a190 con 0x55e8c97ed2e0 2024-09-19T08:59:06.925 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.920+0000 7f935659c640 1 --2- 172.21.15.19:0/1759467735 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e8c97ec9a0 0x55e8c97e70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:59:06.925 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.920+0000 7f9356d9d640 1 --2- 172.21.15.19:0/1759467735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c97ed2e0 0x55e8c97fe0b0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f934802a930 tx=0x7f9348005de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad76c231e9b67793 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:06.925 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.920+0000 7f933cff9640 1 -- 172.21.15.19:0/1759467735 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f934804c030 con 0x55e8c97ed2e0 2024-09-19T08:59:06.926 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.920+0000 7f933cff9640 1 -- 172.21.15.19:0/1759467735 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93480037f0 con 0x55e8c97ed2e0 2024-09-19T08:59:06.926 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.920+0000 7f933cff9640 1 -- 172.21.15.19:0/1759467735 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9348035040 con 0x55e8c97ed2e0 2024-09-19T08:59:06.926 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.921+0000 7f935fdf8740 1 -- 172.21.15.19:0/1759467735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c97ed2e0 msgr2=0x55e8c97fe0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:06.926 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.921+0000 7f935fdf8740 1 --2- 172.21.15.19:0/1759467735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c97ed2e0 0x55e8c97fe0b0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f934802a930 tx=0x7f9348005de0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.926 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.921+0000 7f935fdf8740 1 -- 172.21.15.19:0/1759467735 shutdown_connections 2024-09-19T08:59:06.926 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.921+0000 7f935fdf8740 1 --2- 172.21.15.19:0/1759467735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8c97f2370 0x55e8c97e9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.926 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.921+0000 7f935fdf8740 1 --2- 172.21.15.19:0/1759467735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c97ed2e0 0x55e8c97fe0b0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.926 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.921+0000 7f935fdf8740 1 --2- 172.21.15.19:0/1759467735 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e8c97ec9a0 0x55e8c97e70b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.926 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.921+0000 7f935fdf8740 1 -- 172.21.15.19:0/1759467735 >> 172.21.15.19:0/1759467735 conn(0x55e8c97e8010 msgr2=0x55e8c97e69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:06.926 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.921+0000 7f935fdf8740 1 -- 172.21.15.19:0/1759467735 shutdown_connections 2024-09-19T08:59:06.926 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.921+0000 7f935fdf8740 1 -- 172.21.15.19:0/1759467735 wait complete. 2024-09-19T08:59:06.926 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.921+0000 7f935fdf8740 1 -- start start 2024-09-19T08:59:06.926 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.921+0000 7f935fdf8740 1 Processor -- start 2024-09-19T08:59:06.926 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.921+0000 7f935fdf8740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e8c97ec9a0 0x55e8c97fbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.927 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.921+0000 7f935fdf8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c97ed2e0 0x55e8c97fc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.927 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.921+0000 7f935fdf8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8c97f2370 0x55e8c97fd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.927 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.921+0000 7f935fdf8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f93580738a0 con 0x55e8c97ed2e0 2024-09-19T08:59:06.927 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.921+0000 7f935fdf8740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f93580731d0 con 0x55e8c97ec9a0 2024-09-19T08:59:06.927 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.921+0000 7f935fdf8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9358070410 con 0x55e8c97f2370 2024-09-19T08:59:06.927 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.921+0000 7f935fdf8740 10 client.0 _ll_register_callbacks cb 0x7f934c011740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:06.927 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.921+0000 7f9356d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c97ed2e0 0x55e8c97fc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.927 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.921+0000 7f9356d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c97ed2e0 0x55e8c97fc0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50654/0 (socket says 172.21.15.19:50654) 2024-09-19T08:59:06.927 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.921+0000 7f9356d9d640 1 -- 172.21.15.19:0/2615561705 learned_addr learned my addr 172.21.15.19:0/2615561705 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:06.927 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.921+0000 7f935659c640 1 --2- 172.21.15.19:0/2615561705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e8c97ec9a0 0x55e8c97fbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.927 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.922+0000 7f935659c640 1 --2- 172.21.15.19:0/2615561705 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8c97f2370 0x55e8c97fd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.927 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.922+0000 7f9356d9d640 1 -- 172.21.15.19:0/2615561705 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8c97f2370 msgr2=0x55e8c97fd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:06.927 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.922+0000 7f9356d9d640 1 --2- 172.21.15.19:0/2615561705 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8c97f2370 0x55e8c97fd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.928 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.922+0000 7f9356d9d640 1 -- 172.21.15.19:0/2615561705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e8c97ec9a0 msgr2=0x55e8c97fbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:06.928 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.922+0000 7f9356d9d640 1 --2- 172.21.15.19:0/2615561705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e8c97ec9a0 0x55e8c97fbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:06.928 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.922+0000 7f9356d9d640 1 -- 172.21.15.19:0/2615561705 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8c97fd680 con 0x55e8c97ed2e0 2024-09-19T08:59:06.928 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.922+0000 7f935659c640 1 --2- 172.21.15.19:0/2615561705 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8c97f2370 0x55e8c97fd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:59:06.928 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.922+0000 7f9356d9d640 1 --2- 172.21.15.19:0/2615561705 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c97ed2e0 0x55e8c97fc0b0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f93480314e0 tx=0x7f9348031960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8168fab620a5eae5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:06.928 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.922+0000 7f933aff5640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:59:06.928 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.922+0000 7f933aff5640 1 -- 172.21.15.19:0/2615561705 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9348035030 con 0x55e8c97ed2e0 2024-09-19T08:59:06.928 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.922+0000 7f935fdf8740 1 -- 172.21.15.19:0/2615561705 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93480037f0 con 0x55e8c97ed2e0 2024-09-19T08:59:06.928 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.922+0000 7f933aff5640 1 -- 172.21.15.19:0/2615561705 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9348004480 con 0x55e8c97ed2e0 2024-09-19T08:59:06.928 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.922+0000 7f933aff5640 1 -- 172.21.15.19:0/2615561705 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f934804c040 con 0x55e8c97ed2e0 2024-09-19T08:59:06.928 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.922+0000 7f935fdf8740 10 client.17064 fetch_fsmap learned FSMap version 36 2024-09-19T08:59:06.928 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.922+0000 7f935fdf8740 1 -- 172.21.15.19:0/2615561705 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55e8c9882750 con 0x55e8c97ed2e0 2024-09-19T08:59:06.928 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.922+0000 7f933aff5640 1 -- 172.21.15.19:0/2615561705 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93480037f0 con 0x55e8c97ed2e0 2024-09-19T08:59:06.928 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.923+0000 7f933aff5640 1 -- 172.21.15.19:0/2615561705 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f934803cc10 con 0x55e8c97ed2e0 2024-09-19T08:59:06.929 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.923+0000 7f935fdf8740 10 client.17064 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T08:59:06.929 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.923+0000 7f935fdf8740 10 client.17064 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:59:06.929 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.923+0000 7f935fdf8740 20 client.17064 populate_metadata read hostname 'smithi019' 2024-09-19T08:59:06.929 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.923+0000 7f935fdf8740 1 --2- 172.21.15.19:0/2615561705 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e8c9882f60 0x55e8c9885380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:06.929 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.923+0000 7f935fdf8740 4 client.17064 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:59:06.929 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.923+0000 7f935fdf8740 1 -- 172.21.15.19:0/2615561705 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e8c9757d70 con 0x55e8c9882f60 2024-09-19T08:59:06.929 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.923+0000 7f935659c640 1 --2- 172.21.15.19:0/2615561705 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e8c9882f60 0x55e8c9885380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:06.929 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.923+0000 7f935659c640 1 --2- 172.21.15.19:0/2615561705 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e8c9882f60 0x55e8c9885380 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16bf1821dc96b8d0 server_cookie=e3cfc79aad377df9 in_seq=0 out_seq=0 2024-09-19T08:59:06.929 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:06.923+0000 7f933aff5640 10 client.17064 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:59:07.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:07 smithi203 ceph-mon[35450]: pgmap v544: 97 pgs: 97 active+clean; 13 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 863 KiB/s rd, 1.0 MiB/s wr, 1.35k op/s 2024-09-19T08:59:08.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:07 smithi019 ceph-mon[30976]: pgmap v544: 97 pgs: 97 active+clean; 13 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 863 KiB/s rd, 1.0 MiB/s wr, 1.35k op/s 2024-09-19T08:59:08.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:07 smithi155 ceph-mon[34921]: pgmap v544: 97 pgs: 97 active+clean; 13 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 863 KiB/s rd, 1.0 MiB/s wr, 1.35k op/s 2024-09-19T08:59:08.400 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T08:59:08.400 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T08:59:08.658 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:59:09.011 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:09.011+0000 7f933aff5640 1 -- 172.21.15.19:0/2615561705 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e8c9757d70 con 0x55e8c9882f60 2024-09-19T08:59:09.011 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:09.011+0000 7f933aff5640 10 client.17064 handle_command_reply: tid=0 2024-09-19T08:59:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:09.011+0000 7f935fdf8740 1 client.17064 shutdown 2024-09-19T08:59:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:09.011+0000 7f935fdf8740 1 -- 172.21.15.19:0/2615561705 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c97ed2e0 msgr2=0x55e8c97fc0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:09.011+0000 7f935fdf8740 1 --2- 172.21.15.19:0/2615561705 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c97ed2e0 0x55e8c97fc0b0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f93480314e0 tx=0x7f9348031960 comp rx=0 tx=0).stop 2024-09-19T08:59:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:09.011+0000 7f935fdf8740 1 -- 172.21.15.19:0/2615561705 shutdown_connections 2024-09-19T08:59:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:09.011+0000 7f935fdf8740 1 --2- 172.21.15.19:0/2615561705 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e8c9882f60 0x55e8c9885380 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:09.011+0000 7f935fdf8740 1 --2- 172.21.15.19:0/2615561705 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8c97f2370 0x55e8c97fd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:09.011+0000 7f935fdf8740 1 --2- 172.21.15.19:0/2615561705 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e8c97ed2e0 0x55e8c97fc0b0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:09.011+0000 7f933aff5640 0 client.17064 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:59:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:09.011+0000 7f935fdf8740 1 --2- 172.21.15.19:0/2615561705 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e8c97ec9a0 0x55e8c97fbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:09.011+0000 7f935fdf8740 1 -- 172.21.15.19:0/2615561705 >> 172.21.15.19:0/2615561705 conn(0x55e8c97e8010 msgr2=0x55e8c97e71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:09.011+0000 7f935fdf8740 1 -- 172.21.15.19:0/2615561705 shutdown_connections 2024-09-19T08:59:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:09.011+0000 7f935fdf8740 1 -- 172.21.15.19:0/2615561705 wait complete. 2024-09-19T08:59:09.012 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:09.011+0000 7f935fdf8740 20 client.17064 trim_cache size 0 max 16384 2024-09-19T08:59:09.013 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T08:59:09.013 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T08:59:09.013 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T08:59:09.013 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T08:59:09.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:09.011+0000 7f935d05e640 1 -- 172.21.15.19:0/2183133342 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f93400a3370 msgr2=0x7f93400a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:09.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:09.011+0000 7f935d05e640 1 --2- 172.21.15.19:0/2183133342 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f93400a3370 0x7f93400a5830 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f9350098a10 tx=0x7f9350066ff0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:09.011+0000 7f935d05e640 1 -- 172.21.15.19:0/2183133342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93581025f0 msgr2=0x7f935819f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:09.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:09.011+0000 7f935d05e640 1 --2- 172.21.15.19:0/2183133342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93581025f0 0x7f935819f3a0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f9350009fd0 tx=0x7f935000ef10 comp rx=0 tx=0).stop 2024-09-19T08:59:09.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:09.011+0000 7f935d05e640 1 -- 172.21.15.19:0/2183133342 shutdown_connections 2024-09-19T08:59:09.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:09.011+0000 7f935d05e640 1 --2- 172.21.15.19:0/2183133342 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f93400a3370 0x7f93400a5830 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:09.011+0000 7f935d05e640 1 --2- 172.21.15.19:0/2183133342 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f93581025f0 0x7f935819f3a0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.015 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:09.011+0000 7f935d05e640 1 --2- 172.21.15.19:0/2183133342 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9358101c30 0x7f9358198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.015 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:09.011+0000 7f935d05e640 1 --2- 172.21.15.19:0/2183133342 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9358100a40 0x7f9358197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.015 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:09.011+0000 7f935d05e640 1 -- 172.21.15.19:0/2183133342 >> 172.21.15.19:0/2183133342 conn(0x7f93580fc1e0 msgr2=0x7f9358104f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:09.015 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:09.011+0000 7f935d05e640 1 -- 172.21.15.19:0/2183133342 shutdown_connections 2024-09-19T08:59:09.015 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:09.011+0000 7f935d05e640 1 -- 172.21.15.19:0/2183133342 wait complete. 2024-09-19T08:59:09.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.134+0000 7f9e9efea640 1 -- 172.21.15.19:0/1501862893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e98101420 msgr2=0x7f9e9810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:09.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.134+0000 7f9e9efea640 1 --2- 172.21.15.19:0/1501862893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e98101420 0x7f9e9810d950 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f9e90009cd0 tx=0x7f9e9002a8e0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.134+0000 7f9e9efea640 1 -- 172.21.15.19:0/1501862893 shutdown_connections 2024-09-19T08:59:09.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.134+0000 7f9e9efea640 1 --2- 172.21.15.19:0/1501862893 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e98101420 0x7f9e9810d950 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.134+0000 7f9e9efea640 1 --2- 172.21.15.19:0/1501862893 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e98100a80 0x7f9e98100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.134+0000 7f9e9efea640 1 --2- 172.21.15.19:0/1501862893 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e98106a80 0x7f9e98106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.134+0000 7f9e9efea640 1 -- 172.21.15.19:0/1501862893 >> 172.21.15.19:0/1501862893 conn(0x7f9e980fc7a0 msgr2=0x7f9e980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:09.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.134+0000 7f9e9efea640 1 -- 172.21.15.19:0/1501862893 shutdown_connections 2024-09-19T08:59:09.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.134+0000 7f9e9efea640 1 -- 172.21.15.19:0/1501862893 wait complete. 2024-09-19T08:59:09.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.135+0000 7f9e9efea640 1 Processor -- start 2024-09-19T08:59:09.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.135+0000 7f9e9efea640 1 -- start start 2024-09-19T08:59:09.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.135+0000 7f9e9efea640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e98100a80 0x7f9e98102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.135+0000 7f9e9efea640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e98101420 0x7f9e98102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.135+0000 7f9e9efea640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e98106a80 0x7f9e981030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.135+0000 7f9e9efea640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9e98110e80 con 0x7f9e98101420 2024-09-19T08:59:09.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.135+0000 7f9e9efea640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9e98110d00 con 0x7f9e98106a80 2024-09-19T08:59:09.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.135+0000 7f9e9efea640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9e98111000 con 0x7f9e98100a80 2024-09-19T08:59:09.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.136+0000 7f9e97fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e98101420 0x7f9e98102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.136+0000 7f9e97fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e98101420 0x7f9e98102b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50666/0 (socket says 172.21.15.19:50666) 2024-09-19T08:59:09.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.136+0000 7f9e97fff640 1 -- 172.21.15.19:0/1292734681 learned_addr learned my addr 172.21.15.19:0/1292734681 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:09.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.136+0000 7f9e9cd86640 1 --2- 172.21.15.19:0/1292734681 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e98100a80 0x7f9e98102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.136+0000 7f9e9d587640 1 --2- 172.21.15.19:0/1292734681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e98106a80 0x7f9e981030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.136+0000 7f9e97fff640 1 -- 172.21.15.19:0/1292734681 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e98100a80 msgr2=0x7f9e98102650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:09.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.136+0000 7f9e97fff640 1 --2- 172.21.15.19:0/1292734681 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e98100a80 0x7f9e98102650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.136+0000 7f9e97fff640 1 -- 172.21.15.19:0/1292734681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e98106a80 msgr2=0x7f9e981030d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:09.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.136+0000 7f9e97fff640 1 --2- 172.21.15.19:0/1292734681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e98106a80 0x7f9e981030d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.136+0000 7f9e97fff640 1 -- 172.21.15.19:0/1292734681 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e981a68f0 con 0x7f9e98101420 2024-09-19T08:59:09.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.136+0000 7f9e97fff640 1 --2- 172.21.15.19:0/1292734681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e98101420 0x7f9e98102b90 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400e9f0 tx=0x7f9e8400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:09.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.136+0000 7f9e95ffb640 1 -- 172.21.15.19:0/1292734681 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8400cd80 con 0x7f9e98101420 2024-09-19T08:59:09.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.136+0000 7f9e95ffb640 1 -- 172.21.15.19:0/1292734681 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e84010910 con 0x7f9e98101420 2024-09-19T08:59:09.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.136+0000 7f9e9efea640 1 -- 172.21.15.19:0/1292734681 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e981a6be0 con 0x7f9e98101420 2024-09-19T08:59:09.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.136+0000 7f9e95ffb640 1 -- 172.21.15.19:0/1292734681 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e84018990 con 0x7f9e98101420 2024-09-19T08:59:09.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.136+0000 7f9e9efea640 1 -- 172.21.15.19:0/1292734681 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e981a7170 con 0x7f9e98101420 2024-09-19T08:59:09.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.139+0000 7f9e95ffb640 1 -- 172.21.15.19:0/1292734681 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f9e84010ac0 con 0x7f9e98101420 2024-09-19T08:59:09.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.139+0000 7f9ea13c3740 1 Processor -- start 2024-09-19T08:59:09.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.140+0000 7f9ea13c3740 1 -- start start 2024-09-19T08:59:09.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.140+0000 7f9ea13c3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee5fef3b60 0x55ee5fef3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.140+0000 7f9ea13c3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee5fef4480 0x55ee5fefe800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.140+0000 7f9ea13c3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ee5fefed40 0x55ee5ff01130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.140+0000 7f9ea13c3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ee5fe59280 con 0x55ee5fefed40 2024-09-19T08:59:09.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.140+0000 7f9ea13c3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55ee5fe00b10 con 0x55ee5fef4480 2024-09-19T08:59:09.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.140+0000 7f9ea13c3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ee5fe55240 con 0x55ee5fef3b60 2024-09-19T08:59:09.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.140+0000 7f9e97fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ee5fefed40 0x55ee5ff01130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.140+0000 7f9e95ffb640 1 --2- 172.21.15.19:0/1292734681 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9e880a32c0 0x7f9e880a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.140+0000 7f9e97fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ee5fefed40 0x55ee5ff01130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50678/0 (socket says 172.21.15.19:50678) 2024-09-19T08:59:09.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.140+0000 7f9e97fff640 1 -- 172.21.15.19:0/4165488566 learned_addr learned my addr 172.21.15.19:0/4165488566 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:09.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.140+0000 7f9e9d587640 1 --2- 172.21.15.19:0/4165488566 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee5fef3b60 0x55ee5fef3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.140+0000 7f9e9cd86640 1 --2- 172.21.15.19:0/4165488566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee5fef4480 0x55ee5fefe800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.141+0000 7f9e9d587640 1 --2- 172.21.15.19:0/1292734681 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9e880a32c0 0x7f9e880a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.141+0000 7f9e95ffb640 1 -- 172.21.15.19:0/1292734681 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9e840cfb70 con 0x7f9e98101420 2024-09-19T08:59:09.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.141+0000 7f9e97fff640 1 -- 172.21.15.19:0/4165488566 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee5fef3b60 msgr2=0x55ee5fef3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:09.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.141+0000 7f9e97fff640 1 --2- 172.21.15.19:0/4165488566 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee5fef3b60 0x55ee5fef3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.141+0000 7f9e97fff640 1 -- 172.21.15.19:0/4165488566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee5fef4480 msgr2=0x55ee5fefe800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:09.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.141+0000 7f9e97fff640 1 --2- 172.21.15.19:0/4165488566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee5fef4480 0x55ee5fefe800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.141+0000 7f9e97fff640 1 -- 172.21.15.19:0/4165488566 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee5fe0d1f0 con 0x55ee5fefed40 2024-09-19T08:59:09.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.141+0000 7f9e9d587640 1 --2- 172.21.15.19:0/4165488566 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee5fef3b60 0x55ee5fef3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:09.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.141+0000 7f9e9cd86640 1 --2- 172.21.15.19:0/4165488566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee5fef4480 0x55ee5fefe800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:09.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.141+0000 7f9e97fff640 1 --2- 172.21.15.19:0/4165488566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ee5fefed40 0x55ee5ff01130 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f9e8409bf50 tx=0x7f9e84018420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=885e33d21fc1c820 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:09.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.141+0000 7f9e9d587640 1 --2- 172.21.15.19:0/1292734681 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9e880a32c0 0x7f9e880a5780 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9e90004ab0 tx=0x7f9e90004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:09.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.141+0000 7f9e82ffd640 1 -- 172.21.15.19:0/4165488566 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8409c250 con 0x55ee5fefed40 2024-09-19T08:59:09.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.141+0000 7f9e82ffd640 1 -- 172.21.15.19:0/4165488566 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e840a0550 con 0x55ee5fefed40 2024-09-19T08:59:09.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.141+0000 7f9e82ffd640 1 -- 172.21.15.19:0/4165488566 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e840bc070 con 0x55ee5fefed40 2024-09-19T08:59:09.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.142+0000 7f9ea13c3740 1 -- 172.21.15.19:0/4165488566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ee5fefed40 msgr2=0x55ee5ff01130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:09.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.142+0000 7f9ea13c3740 1 --2- 172.21.15.19:0/4165488566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ee5fefed40 0x55ee5ff01130 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f9e8409bf50 tx=0x7f9e84018420 comp rx=0 tx=0).stop 2024-09-19T08:59:09.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.142+0000 7f9ea13c3740 1 -- 172.21.15.19:0/4165488566 shutdown_connections 2024-09-19T08:59:09.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.142+0000 7f9ea13c3740 1 --2- 172.21.15.19:0/4165488566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ee5fefed40 0x55ee5ff01130 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.142+0000 7f9ea13c3740 1 --2- 172.21.15.19:0/4165488566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee5fef4480 0x55ee5fefe800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.142+0000 7f9ea13c3740 1 --2- 172.21.15.19:0/4165488566 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee5fef3b60 0x55ee5fef3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.142+0000 7f9ea13c3740 1 -- 172.21.15.19:0/4165488566 >> 172.21.15.19:0/4165488566 conn(0x55ee5fef00f0 msgr2=0x55ee5fef04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:09.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.142+0000 7f9ea13c3740 1 -- 172.21.15.19:0/4165488566 shutdown_connections 2024-09-19T08:59:09.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.142+0000 7f9ea13c3740 1 -- 172.21.15.19:0/4165488566 wait complete. 2024-09-19T08:59:09.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.142+0000 7f9ea13c3740 1 -- start start 2024-09-19T08:59:09.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.143+0000 7f9ea13c3740 1 Processor -- start 2024-09-19T08:59:09.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.143+0000 7f9ea13c3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee5fef3b60 0x55ee5fefbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.143+0000 7f9ea13c3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ee5fef4480 0x55ee5fefc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.143+0000 7f9ea13c3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee5fefed40 0x55ee5fefc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.143+0000 7f9ea13c3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ee5ff01910 con 0x55ee5fef4480 2024-09-19T08:59:09.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.143+0000 7f9ea13c3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55ee5fe13f10 con 0x55ee5fefed40 2024-09-19T08:59:09.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.143+0000 7f9ea13c3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ee5ff01a90 con 0x55ee5fef3b60 2024-09-19T08:59:09.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.143+0000 7f9ea13c3740 10 client.0 _ll_register_callbacks cb 0x55ee5fddca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:09.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.143+0000 7f9e97fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ee5fef4480 0x55ee5fefc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.143+0000 7f9e9cd86640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee5fef3b60 0x55ee5fefbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.143+0000 7f9e9cd86640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee5fef3b60 0x55ee5fefbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:44120/0 (socket says 172.21.15.19:44120) 2024-09-19T08:59:09.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.143+0000 7f9e9cd86640 1 -- 172.21.15.19:0/3699941840 learned_addr learned my addr 172.21.15.19:0/3699941840 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:09.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.143+0000 7f9e9d587640 1 --2- 172.21.15.19:0/3699941840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee5fefed40 0x55ee5fefc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.143+0000 7f9e9cd86640 1 -- 172.21.15.19:0/3699941840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee5fefed40 msgr2=0x55ee5fefc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:09.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.143+0000 7f9e9cd86640 1 --2- 172.21.15.19:0/3699941840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee5fefed40 0x55ee5fefc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.143+0000 7f9e9cd86640 1 -- 172.21.15.19:0/3699941840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ee5fef4480 msgr2=0x55ee5fefc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:09.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.144+0000 7f9e9cd86640 1 --2- 172.21.15.19:0/3699941840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ee5fef4480 0x55ee5fefc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.144+0000 7f9e9cd86640 1 -- 172.21.15.19:0/3699941840 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee5fbca6a0 con 0x55ee5fef3b60 2024-09-19T08:59:09.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.144+0000 7f9e97fff640 1 --2- 172.21.15.19:0/3699941840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ee5fef4480 0x55ee5fefc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:09.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.144+0000 7f9e9cd86640 1 --2- 172.21.15.19:0/3699941840 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee5fef3b60 0x55ee5fefbc30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c0126e0 tx=0x7f9e8c012ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20bd2c264446d9dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:09.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.144+0000 7f9e77fff640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T08:59:09.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.144+0000 7f9e77fff640 1 -- 172.21.15.19:0/3699941840 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8c0120d0 con 0x55ee5fef3b60 2024-09-19T08:59:09.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.144+0000 7f9ea13c3740 1 -- 172.21.15.19:0/3699941840 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e840a0550 con 0x55ee5fef3b60 2024-09-19T08:59:09.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.144+0000 7f9e77fff640 1 -- 172.21.15.19:0/3699941840 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9e8c00f920 con 0x55ee5fef3b60 2024-09-19T08:59:09.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.144+0000 7f9e77fff640 1 -- 172.21.15.19:0/3699941840 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f9e8c012270 con 0x55ee5fef3b60 2024-09-19T08:59:09.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.144+0000 7f9ea13c3740 10 client.26473 fetch_fsmap learned FSMap version 36 2024-09-19T08:59:09.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.144+0000 7f9ea13c3740 1 -- 172.21.15.19:0/3699941840 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55ee5ff0d600 con 0x55ee5fef3b60 2024-09-19T08:59:09.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.144+0000 7f9e77fff640 1 -- 172.21.15.19:0/3699941840 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e840a0550 con 0x55ee5fef3b60 2024-09-19T08:59:09.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.145+0000 7f9e77fff640 1 -- 172.21.15.19:0/3699941840 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f9e8c01c420 con 0x55ee5fef3b60 2024-09-19T08:59:09.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.145+0000 7f9ea13c3740 10 client.26473 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T08:59:09.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.145+0000 7f9ea13c3740 10 client.26473 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:59:09.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.145+0000 7f9ea13c3740 20 client.26473 populate_metadata read hostname 'smithi019' 2024-09-19T08:59:09.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.145+0000 7f9ea13c3740 1 --2- 172.21.15.19:0/3699941840 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ee5ff0eab0 0x55ee5ff10ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.145+0000 7f9ea13c3740 4 client.26473 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:59:09.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.145+0000 7f9ea13c3740 1 -- 172.21.15.19:0/3699941840 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee5fe667f0 con 0x55ee5ff0eab0 2024-09-19T08:59:09.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.145+0000 7f9e97fff640 1 --2- 172.21.15.19:0/3699941840 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ee5ff0eab0 0x55ee5ff10ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.145+0000 7f9e97fff640 1 --2- 172.21.15.19:0/3699941840 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ee5ff0eab0 0x55ee5ff10ec0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90d8bd52478a5178 server_cookie=14c2730981137431 in_seq=0 out_seq=0 2024-09-19T08:59:09.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.145+0000 7f9e77fff640 10 client.26473 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:59:09.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.147+0000 7f9e77fff640 1 -- 172.21.15.19:0/3699941840 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ee5fe667f0 con 0x55ee5ff0eab0 2024-09-19T08:59:09.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.147+0000 7f9e77fff640 10 client.26473 handle_command_reply: tid=0 2024-09-19T08:59:09.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.147+0000 7f9ea13c3740 1 client.26473 shutdown 2024-09-19T08:59:09.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.147+0000 7f9ea13c3740 1 -- 172.21.15.19:0/3699941840 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee5fef3b60 msgr2=0x55ee5fefbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:09.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.147+0000 7f9ea13c3740 1 --2- 172.21.15.19:0/3699941840 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee5fef3b60 0x55ee5fefbc30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c0126e0 tx=0x7f9e8c012ba0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.147+0000 7f9ea13c3740 1 -- 172.21.15.19:0/3699941840 shutdown_connections 2024-09-19T08:59:09.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.147+0000 7f9ea13c3740 1 --2- 172.21.15.19:0/3699941840 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ee5ff0eab0 0x55ee5ff10ec0 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.147+0000 7f9ea13c3740 1 --2- 172.21.15.19:0/3699941840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee5fefed40 0x55ee5fefc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.147+0000 7f9ea13c3740 1 --2- 172.21.15.19:0/3699941840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ee5fef4480 0x55ee5fefc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.147+0000 7f9e77fff640 0 client.26473 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:59:09.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.147+0000 7f9ea13c3740 1 --2- 172.21.15.19:0/3699941840 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee5fef3b60 0x55ee5fefbc30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.147+0000 7f9ea13c3740 1 -- 172.21.15.19:0/3699941840 >> 172.21.15.19:0/3699941840 conn(0x55ee5fef00f0 msgr2=0x55ee5feef270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:09.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.148+0000 7f9ea13c3740 1 -- 172.21.15.19:0/3699941840 shutdown_connections 2024-09-19T08:59:09.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.148+0000 7f9ea13c3740 1 -- 172.21.15.19:0/3699941840 wait complete. 2024-09-19T08:59:09.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.148+0000 7f9ea13c3740 20 client.26473 trim_cache size 0 max 16384 2024-09-19T08:59:09.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.165+0000 7f9ea13c3740 1 Processor -- start 2024-09-19T08:59:09.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.165+0000 7f9ea13c3740 1 -- start start 2024-09-19T08:59:09.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.165+0000 7f9ea13c3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee5fef3b60 0x55ee5ff16790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.165+0000 7f9ea13c3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ee5fef4480 0x55ee5ff16cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.165+0000 7f9ea13c3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee5fefed40 0x55ee5feeea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.165+0000 7f9ea13c3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9e981af780 con 0x55ee5fef4480 2024-09-19T08:59:09.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.165+0000 7f9ea13c3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9e981b12c0 con 0x55ee5fefed40 2024-09-19T08:59:09.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.165+0000 7f9ea13c3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9e981afe50 con 0x55ee5fef3b60 2024-09-19T08:59:09.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.166+0000 7f9e97fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ee5fef4480 0x55ee5ff16cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.166+0000 7f9e97fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ee5fef4480 0x55ee5ff16cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50704/0 (socket says 172.21.15.19:50704) 2024-09-19T08:59:09.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.166+0000 7f9e97fff640 1 -- 172.21.15.19:0/480514287 learned_addr learned my addr 172.21.15.19:0/480514287 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:09.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.166+0000 7f9e9cd86640 1 --2- 172.21.15.19:0/480514287 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee5fef3b60 0x55ee5ff16790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.166+0000 7f9e9d587640 1 --2- 172.21.15.19:0/480514287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee5fefed40 0x55ee5feeea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.166+0000 7f9e97fff640 1 -- 172.21.15.19:0/480514287 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee5fef3b60 msgr2=0x55ee5ff16790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:09.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.166+0000 7f9e97fff640 1 --2- 172.21.15.19:0/480514287 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee5fef3b60 0x55ee5ff16790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.166+0000 7f9e97fff640 1 -- 172.21.15.19:0/480514287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee5fefed40 msgr2=0x55ee5feeea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:09.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.166+0000 7f9e97fff640 1 --2- 172.21.15.19:0/480514287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee5fefed40 0x55ee5feeea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.166+0000 7f9e97fff640 1 -- 172.21.15.19:0/480514287 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee5fefe500 con 0x55ee5fef4480 2024-09-19T08:59:09.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.166+0000 7f9e9d587640 1 --2- 172.21.15.19:0/480514287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee5fefed40 0x55ee5feeea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:59:09.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.166+0000 7f9e97fff640 1 --2- 172.21.15.19:0/480514287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ee5fef4480 0x55ee5ff16cd0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f9e840986b0 tx=0x7f9e840bc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b24a5252119e85c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:09.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.166+0000 7f9e827fc640 1 -- 172.21.15.19:0/480514287 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e840b5070 con 0x55ee5fef4480 2024-09-19T08:59:09.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.166+0000 7f9e827fc640 1 -- 172.21.15.19:0/480514287 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e8409c250 con 0x55ee5fef4480 2024-09-19T08:59:09.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.166+0000 7f9e827fc640 1 -- 172.21.15.19:0/480514287 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e840a0170 con 0x55ee5fef4480 2024-09-19T08:59:09.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.167+0000 7f9ea13c3740 1 -- 172.21.15.19:0/480514287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ee5fef4480 msgr2=0x55ee5ff16cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:09.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.167+0000 7f9ea13c3740 1 --2- 172.21.15.19:0/480514287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ee5fef4480 0x55ee5ff16cd0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f9e840986b0 tx=0x7f9e840bc040 comp rx=0 tx=0).stop 2024-09-19T08:59:09.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.167+0000 7f9ea13c3740 1 -- 172.21.15.19:0/480514287 shutdown_connections 2024-09-19T08:59:09.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.167+0000 7f9ea13c3740 1 --2- 172.21.15.19:0/480514287 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee5fefed40 0x55ee5feeea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.167+0000 7f9ea13c3740 1 --2- 172.21.15.19:0/480514287 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ee5fef4480 0x55ee5ff16cd0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.167+0000 7f9ea13c3740 1 --2- 172.21.15.19:0/480514287 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee5fef3b60 0x55ee5ff16790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.167+0000 7f9ea13c3740 1 -- 172.21.15.19:0/480514287 >> 172.21.15.19:0/480514287 conn(0x55ee5fef00f0 msgr2=0x55ee5fefa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:09.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.167+0000 7f9ea13c3740 1 -- 172.21.15.19:0/480514287 shutdown_connections 2024-09-19T08:59:09.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.167+0000 7f9ea13c3740 1 -- 172.21.15.19:0/480514287 wait complete. 2024-09-19T08:59:09.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.167+0000 7f9ea13c3740 1 -- start start 2024-09-19T08:59:09.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.167+0000 7f9ea13c3740 1 Processor -- start 2024-09-19T08:59:09.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.168+0000 7f9ea13c3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee5fef3b60 0x55ee5ff07130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.168+0000 7f9ea13c3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee5fef4480 0x55ee5fef8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.168+0000 7f9ea13c3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ee5fefed40 0x55ee5fef8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.168+0000 7f9ea13c3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9e981b0bf0 con 0x55ee5fefed40 2024-09-19T08:59:09.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.168+0000 7f9ea13c3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9e981b0520 con 0x55ee5fef4480 2024-09-19T08:59:09.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.168+0000 7f9ea13c3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9e981ad760 con 0x55ee5fef3b60 2024-09-19T08:59:09.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.168+0000 7f9ea13c3740 10 client.0 _ll_register_callbacks cb 0x7f9e8c009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:09.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.168+0000 7f9e9d587640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ee5fefed40 0x55ee5fef8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.168+0000 7f9e97fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee5fef4480 0x55ee5fef8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.168+0000 7f9e97fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee5fef4480 0x55ee5fef8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:35888/0 (socket says 172.21.15.19:35888) 2024-09-19T08:59:09.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.168+0000 7f9e97fff640 1 -- 172.21.15.19:0/2441132762 learned_addr learned my addr 172.21.15.19:0/2441132762 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:09.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.168+0000 7f9e9cd86640 1 --2- 172.21.15.19:0/2441132762 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee5fef3b60 0x55ee5ff07130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.168+0000 7f9e9d587640 1 -- 172.21.15.19:0/2441132762 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee5fef3b60 msgr2=0x55ee5ff07130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:09.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.168+0000 7f9e9d587640 1 --2- 172.21.15.19:0/2441132762 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee5fef3b60 0x55ee5ff07130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.168+0000 7f9e9d587640 1 -- 172.21.15.19:0/2441132762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee5fef4480 msgr2=0x55ee5fef8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:09.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.168+0000 7f9e9d587640 1 --2- 172.21.15.19:0/2441132762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee5fef4480 0x55ee5fef8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.168+0000 7f9e9d587640 1 -- 172.21.15.19:0/2441132762 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee5fef90f0 con 0x55ee5fefed40 2024-09-19T08:59:09.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.169+0000 7f9e9d587640 1 --2- 172.21.15.19:0/2441132762 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ee5fefed40 0x55ee5fef8bb0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f9e90009ca0 tx=0x7f9e9002a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f141256c1313a46 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:09.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.169+0000 7f9e77fff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:59:09.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.169+0000 7f9e77fff640 1 -- 172.21.15.19:0/2441132762 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e90058060 con 0x55ee5fefed40 2024-09-19T08:59:09.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.169+0000 7f9e77fff640 1 -- 172.21.15.19:0/2441132762 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9e900305a0 con 0x55ee5fefed40 2024-09-19T08:59:09.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.169+0000 7f9ea13c3740 1 -- 172.21.15.19:0/2441132762 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e8409c250 con 0x55ee5fefed40 2024-09-19T08:59:09.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.169+0000 7f9e77fff640 1 -- 172.21.15.19:0/2441132762 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f9e900307a0 con 0x55ee5fefed40 2024-09-19T08:59:09.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.169+0000 7f9ea13c3740 10 client.17082 fetch_fsmap learned FSMap version 36 2024-09-19T08:59:09.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.169+0000 7f9ea13c3740 1 -- 172.21.15.19:0/2441132762 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55ee5ff79430 con 0x55ee5fefed40 2024-09-19T08:59:09.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.169+0000 7f9e77fff640 1 -- 172.21.15.19:0/2441132762 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9e8409c250 con 0x55ee5fefed40 2024-09-19T08:59:09.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.169+0000 7f9e77fff640 1 -- 172.21.15.19:0/2441132762 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f9e90030070 con 0x55ee5fefed40 2024-09-19T08:59:09.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.169+0000 7f9ea13c3740 10 client.17082 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T08:59:09.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.169+0000 7f9ea13c3740 10 client.17082 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:59:09.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.169+0000 7f9ea13c3740 20 client.17082 populate_metadata read hostname 'smithi019' 2024-09-19T08:59:09.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.169+0000 7f9ea13c3740 1 --2- 172.21.15.19:0/2441132762 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ee5ff79b50 0x55ee5ff7bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:09.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.169+0000 7f9ea13c3740 4 client.17082 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T08:59:09.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.169+0000 7f9ea13c3740 1 -- 172.21.15.19:0/2441132762 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ee5fe60d00 con 0x55ee5ff79b50 2024-09-19T08:59:09.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.170+0000 7f9e9cd86640 1 --2- 172.21.15.19:0/2441132762 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ee5ff79b50 0x55ee5ff7bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:09.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.170+0000 7f9e77fff640 10 client.17082 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:59:09.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.170+0000 7f9e9cd86640 1 --2- 172.21.15.19:0/2441132762 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ee5ff79b50 0x55ee5ff7bf40 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51719197a855f66e server_cookie=89f3dbc629f63248 in_seq=0 out_seq=0 2024-09-19T08:59:09.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.174+0000 7f9e77fff640 1 -- 172.21.15.19:0/2441132762 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ee5fe60d00 con 0x55ee5ff79b50 2024-09-19T08:59:09.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.174+0000 7f9e77fff640 10 client.17082 handle_command_reply: tid=0 2024-09-19T08:59:09.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.174+0000 7f9ea13c3740 1 client.17082 shutdown 2024-09-19T08:59:09.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.174+0000 7f9ea13c3740 1 -- 172.21.15.19:0/2441132762 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ee5fefed40 msgr2=0x55ee5fef8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:09.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.174+0000 7f9ea13c3740 1 --2- 172.21.15.19:0/2441132762 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ee5fefed40 0x55ee5fef8bb0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f9e90009ca0 tx=0x7f9e9002a8e0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.174+0000 7f9ea13c3740 1 -- 172.21.15.19:0/2441132762 shutdown_connections 2024-09-19T08:59:09.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.174+0000 7f9ea13c3740 1 --2- 172.21.15.19:0/2441132762 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ee5ff79b50 0x55ee5ff7bf40 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.174+0000 7f9ea13c3740 1 --2- 172.21.15.19:0/2441132762 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ee5fefed40 0x55ee5fef8bb0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.174+0000 7f9ea13c3740 1 --2- 172.21.15.19:0/2441132762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ee5fef4480 0x55ee5fef8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.174+0000 7f9e77fff640 0 client.17082 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:59:09.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.174+0000 7f9ea13c3740 1 --2- 172.21.15.19:0/2441132762 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ee5fef3b60 0x55ee5ff07130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.174+0000 7f9ea13c3740 1 -- 172.21.15.19:0/2441132762 >> 172.21.15.19:0/2441132762 conn(0x55ee5fef00f0 msgr2=0x55ee5feeea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:09.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.174+0000 7f9ea13c3740 1 -- 172.21.15.19:0/2441132762 shutdown_connections 2024-09-19T08:59:09.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.174+0000 7f9ea13c3740 1 -- 172.21.15.19:0/2441132762 wait complete. 2024-09-19T08:59:09.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.174+0000 7f9ea13c3740 20 client.17082 trim_cache size 0 max 16384 2024-09-19T08:59:09.180 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:59:09.180 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-19T08:59:09.180 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "bc3d29b1-7057-487a-b805-bce062af7107", 2024-09-19T08:59:09.180 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-19T08:59:09.180 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:59:09.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.175+0000 7f9e9efea640 1 -- 172.21.15.19:0/1292734681 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9e880a32c0 msgr2=0x7f9e880a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:09.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.175+0000 7f9e9efea640 1 --2- 172.21.15.19:0/1292734681 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9e880a32c0 0x7f9e880a5780 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9e90004ab0 tx=0x7f9e90004a40 comp rx=0 tx=0).stop 2024-09-19T08:59:09.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.175+0000 7f9e9efea640 1 -- 172.21.15.19:0/1292734681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e98101420 msgr2=0x7f9e98102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:09.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.175+0000 7f9e9efea640 1 --2- 172.21.15.19:0/1292734681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e98101420 0x7f9e98102b90 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400e9f0 tx=0x7f9e8400eeb0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.175+0000 7f9e9efea640 1 -- 172.21.15.19:0/1292734681 shutdown_connections 2024-09-19T08:59:09.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.175+0000 7f9e9efea640 1 --2- 172.21.15.19:0/1292734681 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9e880a32c0 0x7f9e880a5780 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.175+0000 7f9e9efea640 1 --2- 172.21.15.19:0/1292734681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9e98106a80 0x7f9e981030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.175+0000 7f9e9efea640 1 --2- 172.21.15.19:0/1292734681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9e98101420 0x7f9e98102b90 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.175+0000 7f9e9efea640 1 --2- 172.21.15.19:0/1292734681 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e98100a80 0x7f9e98102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:09.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.175+0000 7f9e9efea640 1 -- 172.21.15.19:0/1292734681 >> 172.21.15.19:0/1292734681 conn(0x7f9e980fc7a0 msgr2=0x7f9e9806a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:09.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.175+0000 7f9e9efea640 1 -- 172.21.15.19:0/1292734681 shutdown_connections 2024-09-19T08:59:09.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:09.175+0000 7f9e9efea640 1 -- 172.21.15.19:0/1292734681 wait complete. 2024-09-19T08:59:09.882 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:59:09.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:09 smithi203 ceph-mon[35450]: pgmap v545: 97 pgs: 97 active+clean; 13 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 863 KiB/s rd, 931 KiB/s wr, 772 op/s 2024-09-19T08:59:10.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:09 smithi019 ceph-mon[30976]: pgmap v545: 97 pgs: 97 active+clean; 13 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 863 KiB/s rd, 931 KiB/s wr, 772 op/s 2024-09-19T08:59:10.144 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:59:10.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:09 smithi155 ceph-mon[34921]: pgmap v545: 97 pgs: 97 active+clean; 13 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 863 KiB/s rd, 931 KiB/s wr, 772 op/s 2024-09-19T08:59:10.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.620+0000 7f5df5965640 1 -- 172.21.15.19:0/1827305867 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5df0106f10 msgr2=0x7f5df010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:10.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.620+0000 7f5df5965640 1 --2- 172.21.15.19:0/1827305867 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5df0106f10 0x7f5df010ea90 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f5de8009ca0 tx=0x7f5de802a8c0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.620+0000 7f5df5965640 1 -- 172.21.15.19:0/1827305867 shutdown_connections 2024-09-19T08:59:10.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.620+0000 7f5df5965640 1 --2- 172.21.15.19:0/1827305867 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5df0106f10 0x7f5df010ea90 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.620+0000 7f5df5965640 1 --2- 172.21.15.19:0/1827305867 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5df0102790 0x7f5df01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.620+0000 7f5df5965640 1 --2- 172.21.15.19:0/1827305867 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5df0101de0 0x7f5df01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.620+0000 7f5df5965640 1 -- 172.21.15.19:0/1827305867 >> 172.21.15.19:0/1827305867 conn(0x7f5df00fd8c0 msgr2=0x7f5df00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:10.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.620+0000 7f5df5965640 1 -- 172.21.15.19:0/1827305867 shutdown_connections 2024-09-19T08:59:10.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.620+0000 7f5df5965640 1 -- 172.21.15.19:0/1827305867 wait complete. 2024-09-19T08:59:10.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.621+0000 7f5df5965640 1 Processor -- start 2024-09-19T08:59:10.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.621+0000 7f5df5965640 1 -- start start 2024-09-19T08:59:10.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.621+0000 7f5df5965640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5df0101de0 0x7f5df01983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:10.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.622+0000 7f5df5965640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5df0102790 0x7f5df0198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:10.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.622+0000 7f5df5965640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5df0106f10 0x7f5df019cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:10.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.622+0000 7f5df5965640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5df0111f70 con 0x7f5df0106f10 2024-09-19T08:59:10.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.622+0000 7f5df5965640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5df0111df0 con 0x7f5df0102790 2024-09-19T08:59:10.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.622+0000 7f5df5965640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5df01120f0 con 0x7f5df0101de0 2024-09-19T08:59:10.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.622+0000 7f5def7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5df0106f10 0x7f5df019cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:10.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.622+0000 7f5def7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5df0106f10 0x7f5df019cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50744/0 (socket says 172.21.15.19:50744) 2024-09-19T08:59:10.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.622+0000 7f5def7fe640 1 -- 172.21.15.19:0/2253418376 learned_addr learned my addr 172.21.15.19:0/2253418376 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:10.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.622+0000 7f5de67fc640 1 --2- 172.21.15.19:0/2253418376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5df0102790 0x7f5df0198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:10.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.622+0000 7f5deeffd640 1 --2- 172.21.15.19:0/2253418376 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5df0101de0 0x7f5df01983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:10.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.622+0000 7f5def7fe640 1 -- 172.21.15.19:0/2253418376 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5df0101de0 msgr2=0x7f5df01983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:10.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.622+0000 7f5def7fe640 1 --2- 172.21.15.19:0/2253418376 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5df0101de0 0x7f5df01983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.622+0000 7f5def7fe640 1 -- 172.21.15.19:0/2253418376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5df0102790 msgr2=0x7f5df0198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:10.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.622+0000 7f5def7fe640 1 --2- 172.21.15.19:0/2253418376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5df0102790 0x7f5df0198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.622+0000 7f5def7fe640 1 -- 172.21.15.19:0/2253418376 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5df019d380 con 0x7f5df0106f10 2024-09-19T08:59:10.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.622+0000 7f5def7fe640 1 --2- 172.21.15.19:0/2253418376 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5df0106f10 0x7f5df019cca0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f5de8031a20 tx=0x7f5de8031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:10.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.622+0000 7f5df4963640 1 -- 172.21.15.19:0/2253418376 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de8003c30 con 0x7f5df0106f10 2024-09-19T08:59:10.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.622+0000 7f5df4963640 1 -- 172.21.15.19:0/2253418376 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5de8003dd0 con 0x7f5df0106f10 2024-09-19T08:59:10.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.622+0000 7f5df5965640 1 -- 172.21.15.19:0/2253418376 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5df019d610 con 0x7f5df0106f10 2024-09-19T08:59:10.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.622+0000 7f5df4963640 1 -- 172.21.15.19:0/2253418376 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de802fcf0 con 0x7f5df0106f10 2024-09-19T08:59:10.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.623+0000 7f5df5965640 1 -- 172.21.15.19:0/2253418376 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5df01a4f50 con 0x7f5df0106f10 2024-09-19T08:59:10.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.625+0000 7f5df4963640 1 -- 172.21.15.19:0/2253418376 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f5de8004050 con 0x7f5df0106f10 2024-09-19T08:59:10.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.625+0000 7f5df7d3e740 1 Processor -- start 2024-09-19T08:59:10.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.625+0000 7f5df7d3e740 1 -- start start 2024-09-19T08:59:10.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.625+0000 7f5df7d3e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ba204c4a0 0x555ba204c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:10.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.625+0000 7f5df7d3e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555ba204cdc0 0x555ba2057140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:10.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.625+0000 7f5df7d3e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ba2057680 0x555ba2059a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:10.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.625+0000 7f5df7d3e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x555ba1fb22e0 con 0x555ba204cdc0 2024-09-19T08:59:10.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.625+0000 7f5df7d3e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x555ba1f59ce0 con 0x555ba204c4a0 2024-09-19T08:59:10.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.625+0000 7f5df7d3e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x555ba1fae2a0 con 0x555ba2057680 2024-09-19T08:59:10.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.625+0000 7f5deeffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555ba204cdc0 0x555ba2057140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:10.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.625+0000 7f5deeffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555ba204cdc0 0x555ba2057140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50756/0 (socket says 172.21.15.19:50756) 2024-09-19T08:59:10.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.625+0000 7f5deeffd640 1 -- 172.21.15.19:0/3352388128 learned_addr learned my addr 172.21.15.19:0/3352388128 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:10.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.625+0000 7f5de67fc640 1 --2- 172.21.15.19:0/3352388128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ba204c4a0 0x555ba204c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:10.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.626+0000 7f5de67fc640 1 --2- 172.21.15.19:0/3352388128 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ba2057680 0x555ba2059a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:10.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.626+0000 7f5deeffd640 1 -- 172.21.15.19:0/3352388128 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ba2057680 msgr2=0x555ba2059a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:10.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.626+0000 7f5deeffd640 1 --2- 172.21.15.19:0/3352388128 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ba2057680 0x555ba2059a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.626+0000 7f5deeffd640 1 -- 172.21.15.19:0/3352388128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ba204c4a0 msgr2=0x555ba204c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:10.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.626+0000 7f5deeffd640 1 --2- 172.21.15.19:0/3352388128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ba204c4a0 0x555ba204c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.626+0000 7f5deeffd640 1 -- 172.21.15.19:0/3352388128 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ba1f3e440 con 0x555ba204cdc0 2024-09-19T08:59:10.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.626+0000 7f5df4963640 1 --2- 172.21.15.19:0/2253418376 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5ddc0a3240 0x7f5ddc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:10.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.626+0000 7f5deeffd640 1 --2- 172.21.15.19:0/3352388128 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555ba204cdc0 0x555ba2057140 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f5de000ac10 tx=0x7f5de000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af442c0a0c4099dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:10.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.626+0000 7f5de67fc640 1 --2- 172.21.15.19:0/2253418376 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5ddc0a3240 0x7f5ddc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:10.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.626+0000 7f5df4963640 1 -- 172.21.15.19:0/2253418376 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5de80f0c00 con 0x7f5df0106f10 2024-09-19T08:59:10.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.626+0000 7f5de5ffb640 1 -- 172.21.15.19:0/3352388128 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de001d070 con 0x555ba204cdc0 2024-09-19T08:59:10.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.626+0000 7f5de5ffb640 1 -- 172.21.15.19:0/3352388128 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5de0018b20 con 0x555ba204cdc0 2024-09-19T08:59:10.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.626+0000 7f5de5ffb640 1 -- 172.21.15.19:0/3352388128 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de0010b10 con 0x555ba204cdc0 2024-09-19T08:59:10.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.627+0000 7f5df7d3e740 1 -- 172.21.15.19:0/3352388128 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555ba204cdc0 msgr2=0x555ba2057140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:10.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.627+0000 7f5de67fc640 1 --2- 172.21.15.19:0/2253418376 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5ddc0a3240 0x7f5ddc0a5700 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x555ba2049db0 tx=0x7f5dd800b650 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:10.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.627+0000 7f5df7d3e740 1 --2- 172.21.15.19:0/3352388128 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555ba204cdc0 0x555ba2057140 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f5de000ac10 tx=0x7f5de000f790 comp rx=0 tx=0).stop 2024-09-19T08:59:10.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.627+0000 7f5df7d3e740 1 -- 172.21.15.19:0/3352388128 shutdown_connections 2024-09-19T08:59:10.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.627+0000 7f5df7d3e740 1 --2- 172.21.15.19:0/3352388128 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ba2057680 0x555ba2059a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.627+0000 7f5df7d3e740 1 --2- 172.21.15.19:0/3352388128 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555ba204cdc0 0x555ba2057140 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.627+0000 7f5df7d3e740 1 --2- 172.21.15.19:0/3352388128 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ba204c4a0 0x555ba204c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.627+0000 7f5df7d3e740 1 -- 172.21.15.19:0/3352388128 >> 172.21.15.19:0/3352388128 conn(0x555ba2048a30 msgr2=0x555ba2048e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:10.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.627+0000 7f5df7d3e740 1 -- 172.21.15.19:0/3352388128 shutdown_connections 2024-09-19T08:59:10.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.627+0000 7f5df7d3e740 1 -- 172.21.15.19:0/3352388128 wait complete. 2024-09-19T08:59:10.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.628+0000 7f5df7d3e740 1 -- start start 2024-09-19T08:59:10.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.628+0000 7f5df7d3e740 1 Processor -- start 2024-09-19T08:59:10.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.629+0000 7f5df7d3e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ba204c4a0 0x555ba2057000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:10.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.629+0000 7f5df7d3e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555ba204cdc0 0x555ba20542b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:10.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.629+0000 7f5df7d3e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ba2057680 0x555ba2054830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:10.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.629+0000 7f5df7d3e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x555ba205a250 con 0x555ba204cdc0 2024-09-19T08:59:10.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.629+0000 7f5df7d3e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x555ba1f6d050 con 0x555ba2057680 2024-09-19T08:59:10.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.629+0000 7f5df7d3e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x555ba205a3d0 con 0x555ba204c4a0 2024-09-19T08:59:10.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.629+0000 7f5df7d3e740 10 client.0 _ll_register_callbacks cb 0x555ba1fad160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:10.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.629+0000 7f5de67fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555ba204cdc0 0x555ba20542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:10.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.629+0000 7f5def7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ba2057680 0x555ba2054830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:10.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.629+0000 7f5de67fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555ba204cdc0 0x555ba20542b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50760/0 (socket says 172.21.15.19:50760) 2024-09-19T08:59:10.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.629+0000 7f5de67fc640 1 -- 172.21.15.19:0/3643001957 learned_addr learned my addr 172.21.15.19:0/3643001957 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:10.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.629+0000 7f5deeffd640 1 --2- 172.21.15.19:0/3643001957 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ba204c4a0 0x555ba2057000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:10.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.629+0000 7f5de67fc640 1 -- 172.21.15.19:0/3643001957 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ba204c4a0 msgr2=0x555ba2057000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:10.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.629+0000 7f5de67fc640 1 --2- 172.21.15.19:0/3643001957 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ba204c4a0 0x555ba2057000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.629+0000 7f5de67fc640 1 -- 172.21.15.19:0/3643001957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ba2057680 msgr2=0x555ba2054830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:10.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.629+0000 7f5de67fc640 1 --2- 172.21.15.19:0/3643001957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ba2057680 0x555ba2054830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.629+0000 7f5de67fc640 1 -- 172.21.15.19:0/3643001957 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ba1d233c0 con 0x555ba204cdc0 2024-09-19T08:59:10.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.629+0000 7f5def7fe640 1 --2- 172.21.15.19:0/3643001957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ba2057680 0x555ba2054830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:10.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.629+0000 7f5deeffd640 1 --2- 172.21.15.19:0/3643001957 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ba204c4a0 0x555ba2057000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:59:10.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.629+0000 7f5de67fc640 1 --2- 172.21.15.19:0/3643001957 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555ba204cdc0 0x555ba20542b0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8012fb0 tx=0x7f5dd8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=408821ba509d368e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:10.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.629+0000 7f5dceffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:59:10.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.630+0000 7f5dceffd640 1 -- 172.21.15.19:0/3643001957 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8004020 con 0x555ba204cdc0 2024-09-19T08:59:10.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.630+0000 7f5dceffd640 1 -- 172.21.15.19:0/3643001957 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5dd80041c0 con 0x555ba204cdc0 2024-09-19T08:59:10.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.630+0000 7f5df7d3e740 1 -- 172.21.15.19:0/3643001957 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5de0018b20 con 0x555ba204cdc0 2024-09-19T08:59:10.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.630+0000 7f5dceffd640 1 -- 172.21.15.19:0/3643001957 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f5dd8004400 con 0x555ba204cdc0 2024-09-19T08:59:10.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.630+0000 7f5df7d3e740 10 client.17094 fetch_fsmap learned FSMap version 36 2024-09-19T08:59:10.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.630+0000 7f5df7d3e740 1 -- 172.21.15.19:0/3643001957 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x555ba2065c40 con 0x555ba204cdc0 2024-09-19T08:59:10.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.630+0000 7f5dceffd640 1 -- 172.21.15.19:0/3643001957 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5de0018b20 con 0x555ba204cdc0 2024-09-19T08:59:10.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.630+0000 7f5dceffd640 1 -- 172.21.15.19:0/3643001957 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f5dd8029030 con 0x555ba204cdc0 2024-09-19T08:59:10.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.630+0000 7f5df7d3e740 10 client.17094 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T08:59:10.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.630+0000 7f5df7d3e740 10 client.17094 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:59:10.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.630+0000 7f5df7d3e740 20 client.17094 populate_metadata read hostname 'smithi019' 2024-09-19T08:59:10.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.630+0000 7f5df7d3e740 1 --2- 172.21.15.19:0/3643001957 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x555ba2067150 0x555ba20695d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:10.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.630+0000 7f5df7d3e740 4 client.17094 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:59:10.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.630+0000 7f5df7d3e740 1 -- 172.21.15.19:0/3643001957 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555ba1fbf850 con 0x555ba2067150 2024-09-19T08:59:10.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.631+0000 7f5deeffd640 1 --2- 172.21.15.19:0/3643001957 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x555ba2067150 0x555ba20695d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:10.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.631+0000 7f5deeffd640 1 --2- 172.21.15.19:0/3643001957 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x555ba2067150 0x555ba20695d0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=402aabe0624a972a server_cookie=1ca8099245791ae5 in_seq=0 out_seq=0 2024-09-19T08:59:10.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.631+0000 7f5dceffd640 10 client.17094 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:59:10.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.636+0000 7f5dceffd640 1 -- 172.21.15.19:0/3643001957 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555ba1fbf850 con 0x555ba2067150 2024-09-19T08:59:10.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.636+0000 7f5dceffd640 10 client.17094 handle_command_reply: tid=0 2024-09-19T08:59:10.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.636+0000 7f5df7d3e740 1 client.17094 shutdown 2024-09-19T08:59:10.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.636+0000 7f5df7d3e740 1 -- 172.21.15.19:0/3643001957 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555ba204cdc0 msgr2=0x555ba20542b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:10.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.636+0000 7f5df7d3e740 1 --2- 172.21.15.19:0/3643001957 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555ba204cdc0 0x555ba20542b0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8012fb0 tx=0x7f5dd8004730 comp rx=0 tx=0).stop 2024-09-19T08:59:10.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.637+0000 7f5df7d3e740 1 -- 172.21.15.19:0/3643001957 shutdown_connections 2024-09-19T08:59:10.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.637+0000 7f5df7d3e740 1 --2- 172.21.15.19:0/3643001957 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x555ba2067150 0x555ba20695d0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.637+0000 7f5df7d3e740 1 --2- 172.21.15.19:0/3643001957 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ba2057680 0x555ba2054830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.637+0000 7f5df7d3e740 1 --2- 172.21.15.19:0/3643001957 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555ba204cdc0 0x555ba20542b0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.637+0000 7f5df7d3e740 1 --2- 172.21.15.19:0/3643001957 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ba204c4a0 0x555ba2057000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.637+0000 7f5dceffd640 0 client.17094 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:59:10.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.637+0000 7f5df7d3e740 1 -- 172.21.15.19:0/3643001957 >> 172.21.15.19:0/3643001957 conn(0x555ba2048a30 msgr2=0x555ba204e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:10.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.637+0000 7f5df7d3e740 1 -- 172.21.15.19:0/3643001957 shutdown_connections 2024-09-19T08:59:10.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.637+0000 7f5df7d3e740 1 -- 172.21.15.19:0/3643001957 wait complete. 2024-09-19T08:59:10.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.637+0000 7f5df7d3e740 20 client.17094 trim_cache size 0 max 16384 2024-09-19T08:59:10.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.654+0000 7f5df7d3e740 1 Processor -- start 2024-09-19T08:59:10.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.655+0000 7f5df7d3e740 1 -- start start 2024-09-19T08:59:10.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.655+0000 7f5df7d3e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ba204c4a0 0x555ba2052b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:10.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.655+0000 7f5df7d3e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555ba204cdc0 0x555ba206eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:10.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.655+0000 7f5df7d3e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ba2057680 0x555ba206f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:10.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.655+0000 7f5df7d3e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5df01ab2a0 con 0x555ba204cdc0 2024-09-19T08:59:10.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.655+0000 7f5df7d3e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5df01acde0 con 0x555ba204c4a0 2024-09-19T08:59:10.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.655+0000 7f5df7d3e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5df01ab970 con 0x555ba2057680 2024-09-19T08:59:10.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.655+0000 7f5de67fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555ba204cdc0 0x555ba206eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:10.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.655+0000 7f5de67fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555ba204cdc0 0x555ba206eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50774/0 (socket says 172.21.15.19:50774) 2024-09-19T08:59:10.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.655+0000 7f5de67fc640 1 -- 172.21.15.19:0/2500665334 learned_addr learned my addr 172.21.15.19:0/2500665334 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:10.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.655+0000 7f5deeffd640 1 --2- 172.21.15.19:0/2500665334 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ba204c4a0 0x555ba2052b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:10.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.655+0000 7f5def7fe640 1 --2- 172.21.15.19:0/2500665334 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ba2057680 0x555ba206f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:10.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.655+0000 7f5de67fc640 1 -- 172.21.15.19:0/2500665334 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ba2057680 msgr2=0x555ba206f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:10.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.655+0000 7f5de67fc640 1 --2- 172.21.15.19:0/2500665334 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ba2057680 0x555ba206f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.655+0000 7f5de67fc640 1 -- 172.21.15.19:0/2500665334 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ba204c4a0 msgr2=0x555ba2052b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:10.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.655+0000 7f5de67fc640 1 --2- 172.21.15.19:0/2500665334 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ba204c4a0 0x555ba2052b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.655+0000 7f5de67fc640 1 -- 172.21.15.19:0/2500665334 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ba2053260 con 0x555ba204cdc0 2024-09-19T08:59:10.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.655+0000 7f5def7fe640 1 --2- 172.21.15.19:0/2500665334 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ba2057680 0x555ba206f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:59:10.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.656+0000 7f5de67fc640 1 --2- 172.21.15.19:0/2500665334 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555ba204cdc0 0x555ba206eea0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f5dd80038a0 tx=0x7f5dd8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf9daee994191f62 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:10.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.656+0000 7f5de57fa640 1 -- 172.21.15.19:0/2500665334 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8039030 con 0x555ba204cdc0 2024-09-19T08:59:10.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.656+0000 7f5de57fa640 1 -- 172.21.15.19:0/2500665334 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5dd800b410 con 0x555ba204cdc0 2024-09-19T08:59:10.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.656+0000 7f5de57fa640 1 -- 172.21.15.19:0/2500665334 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8004250 con 0x555ba204cdc0 2024-09-19T08:59:10.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.656+0000 7f5df7d3e740 1 -- 172.21.15.19:0/2500665334 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555ba204cdc0 msgr2=0x555ba206eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:10.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.656+0000 7f5df7d3e740 1 --2- 172.21.15.19:0/2500665334 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555ba204cdc0 0x555ba206eea0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f5dd80038a0 tx=0x7f5dd8000bc0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.657+0000 7f5df7d3e740 1 -- 172.21.15.19:0/2500665334 shutdown_connections 2024-09-19T08:59:10.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.657+0000 7f5df7d3e740 1 --2- 172.21.15.19:0/2500665334 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ba2057680 0x555ba206f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.657+0000 7f5df7d3e740 1 --2- 172.21.15.19:0/2500665334 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555ba204cdc0 0x555ba206eea0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.657+0000 7f5df7d3e740 1 --2- 172.21.15.19:0/2500665334 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ba204c4a0 0x555ba2052b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.657+0000 7f5df7d3e740 1 -- 172.21.15.19:0/2500665334 >> 172.21.15.19:0/2500665334 conn(0x555ba2048a30 msgr2=0x555ba2056330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:10.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.657+0000 7f5df7d3e740 1 -- 172.21.15.19:0/2500665334 shutdown_connections 2024-09-19T08:59:10.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.657+0000 7f5df7d3e740 1 -- 172.21.15.19:0/2500665334 wait complete. 2024-09-19T08:59:10.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.657+0000 7f5df7d3e740 1 -- start start 2024-09-19T08:59:10.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.657+0000 7f5df7d3e740 1 Processor -- start 2024-09-19T08:59:10.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.657+0000 7f5df7d3e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ba204c4a0 0x555ba205fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:10.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.657+0000 7f5df7d3e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555ba204cdc0 0x555ba20cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:10.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.657+0000 7f5df7d3e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ba2057680 0x555ba20cd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:10.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.657+0000 7f5df7d3e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5df01ac710 con 0x555ba204cdc0 2024-09-19T08:59:10.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.657+0000 7f5df7d3e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5df01ac040 con 0x555ba204c4a0 2024-09-19T08:59:10.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.658+0000 7f5df7d3e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5df01a9280 con 0x555ba2057680 2024-09-19T08:59:10.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.658+0000 7f5df7d3e740 10 client.0 _ll_register_callbacks cb 0x7f5dd8012d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:10.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.658+0000 7f5de67fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555ba204cdc0 0x555ba20cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:10.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.658+0000 7f5de67fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555ba204cdc0 0x555ba20cce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:50786/0 (socket says 172.21.15.19:50786) 2024-09-19T08:59:10.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.658+0000 7f5de67fc640 1 -- 172.21.15.19:0/1906556899 learned_addr learned my addr 172.21.15.19:0/1906556899 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:10.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.658+0000 7f5deeffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ba204c4a0 0x555ba205fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:10.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.658+0000 7f5def7fe640 1 --2- 172.21.15.19:0/1906556899 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ba2057680 0x555ba20cd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:10.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.658+0000 7f5de67fc640 1 -- 172.21.15.19:0/1906556899 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ba2057680 msgr2=0x555ba20cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:10.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.658+0000 7f5de67fc640 1 --2- 172.21.15.19:0/1906556899 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ba2057680 0x555ba20cd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.658+0000 7f5de67fc640 1 -- 172.21.15.19:0/1906556899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ba204c4a0 msgr2=0x555ba205fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:10.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.658+0000 7f5de67fc640 1 --2- 172.21.15.19:0/1906556899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ba204c4a0 0x555ba205fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.658+0000 7f5de67fc640 1 -- 172.21.15.19:0/1906556899 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ba204cbf0 con 0x555ba204cdc0 2024-09-19T08:59:10.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.658+0000 7f5deeffd640 1 --2- 172.21.15.19:0/1906556899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ba204c4a0 0x555ba205fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:10.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.658+0000 7f5de67fc640 1 --2- 172.21.15.19:0/1906556899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555ba204cdc0 0x555ba20cce60 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f5dd801c040 tx=0x7f5dd800bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b0171840ba499c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:10.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.658+0000 7f5dceffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:59:10.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.658+0000 7f5dceffd640 1 -- 172.21.15.19:0/1906556899 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8025030 con 0x555ba204cdc0 2024-09-19T08:59:10.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.658+0000 7f5dceffd640 1 -- 172.21.15.19:0/1906556899 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5dd80035f0 con 0x555ba204cdc0 2024-09-19T08:59:10.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.658+0000 7f5df7d3e740 1 -- 172.21.15.19:0/1906556899 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555ba1fb9d60 con 0x555ba204cdc0 2024-09-19T08:59:10.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.659+0000 7f5dceffd640 1 -- 172.21.15.19:0/1906556899 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f5dd8039040 con 0x555ba204cdc0 2024-09-19T08:59:10.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.659+0000 7f5df7d3e740 10 client.17100 fetch_fsmap learned FSMap version 36 2024-09-19T08:59:10.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.659+0000 7f5df7d3e740 1 -- 172.21.15.19:0/1906556899 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x555ba2054ba0 con 0x555ba204cdc0 2024-09-19T08:59:10.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.659+0000 7f5dceffd640 1 -- 172.21.15.19:0/1906556899 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x555ba1fb9d60 con 0x555ba204cdc0 2024-09-19T08:59:10.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.659+0000 7f5dceffd640 1 -- 172.21.15.19:0/1906556899 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f5dd8029040 con 0x555ba204cdc0 2024-09-19T08:59:10.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.659+0000 7f5df7d3e740 10 client.17100 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T08:59:10.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.659+0000 7f5df7d3e740 10 client.17100 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:59:10.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.659+0000 7f5df7d3e740 20 client.17100 populate_metadata read hostname 'smithi019' 2024-09-19T08:59:10.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.659+0000 7f5df7d3e740 1 --2- 172.21.15.19:0/1906556899 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x555ba20da9f0 0x555ba20dce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:10.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.659+0000 7f5df7d3e740 4 client.17100 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:59:10.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.659+0000 7f5df7d3e740 1 -- 172.21.15.19:0/1906556899 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555ba1f36210 con 0x555ba20da9f0 2024-09-19T08:59:10.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.659+0000 7f5deeffd640 1 --2- 172.21.15.19:0/1906556899 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x555ba20da9f0 0x555ba20dce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:10.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.660+0000 7f5deeffd640 1 --2- 172.21.15.19:0/1906556899 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x555ba20da9f0 0x555ba20dce10 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fd60e54bd3605e1 server_cookie=3e9b07b7edc426b4 in_seq=0 out_seq=0 2024-09-19T08:59:10.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.660+0000 7f5dceffd640 10 client.17100 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:59:10.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.664+0000 7f5dceffd640 1 -- 172.21.15.19:0/1906556899 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+268 (crc 0 0 0) 0x555ba1f36210 con 0x555ba20da9f0 2024-09-19T08:59:10.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.664+0000 7f5dceffd640 10 client.17100 handle_command_reply: tid=0 2024-09-19T08:59:10.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.664+0000 7f5df7d3e740 1 client.17100 shutdown 2024-09-19T08:59:10.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.664+0000 7f5df7d3e740 1 -- 172.21.15.19:0/1906556899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555ba204cdc0 msgr2=0x555ba20cce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:10.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.664+0000 7f5df7d3e740 1 --2- 172.21.15.19:0/1906556899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555ba204cdc0 0x555ba20cce60 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f5dd801c040 tx=0x7f5dd800bd40 comp rx=0 tx=0).stop 2024-09-19T08:59:10.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.664+0000 7f5df7d3e740 1 -- 172.21.15.19:0/1906556899 shutdown_connections 2024-09-19T08:59:10.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.664+0000 7f5df7d3e740 1 --2- 172.21.15.19:0/1906556899 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x555ba20da9f0 0x555ba20dce10 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.664+0000 7f5df7d3e740 1 --2- 172.21.15.19:0/1906556899 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555ba2057680 0x555ba20cd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.664+0000 7f5df7d3e740 1 --2- 172.21.15.19:0/1906556899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555ba204cdc0 0x555ba20cce60 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.664+0000 7f5df7d3e740 1 --2- 172.21.15.19:0/1906556899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555ba204c4a0 0x555ba205fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.664+0000 7f5df7d3e740 1 -- 172.21.15.19:0/1906556899 >> 172.21.15.19:0/1906556899 conn(0x555ba2048a30 msgr2=0x555ba2056330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:10.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.664+0000 7f5dceffd640 0 client.17100 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:59:10.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.664+0000 7f5df7d3e740 1 -- 172.21.15.19:0/1906556899 shutdown_connections 2024-09-19T08:59:10.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.664+0000 7f5df7d3e740 1 -- 172.21.15.19:0/1906556899 wait complete. 2024-09-19T08:59:10.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.664+0000 7f5df7d3e740 20 client.17100 trim_cache size 0 max 16384 2024-09-19T08:59:10.666 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:59:10.667 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "scrub active (8292 inodes in the stack)", 2024-09-19T08:59:10.667 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-19T08:59:10.667 INFO:teuthology.orchestra.run.smithi019.stdout: "bc3d29b1-7057-487a-b805-bce062af7107": { 2024-09-19T08:59:10.667 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-19T08:59:10.667 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "bc3d29b1-7057-487a-b805-bce062af7107", 2024-09-19T08:59:10.667 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-19T08:59:10.667 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:59:10.667 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:59:10.667 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:59:10.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.665+0000 7f5df5965640 1 -- 172.21.15.19:0/2253418376 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5ddc0a3240 msgr2=0x7f5ddc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:10.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.665+0000 7f5df5965640 1 --2- 172.21.15.19:0/2253418376 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5ddc0a3240 0x7f5ddc0a5700 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x555ba2049db0 tx=0x7f5dd800b650 comp rx=0 tx=0).stop 2024-09-19T08:59:10.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.665+0000 7f5df5965640 1 -- 172.21.15.19:0/2253418376 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5df0106f10 msgr2=0x7f5df019cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:10.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.665+0000 7f5df5965640 1 --2- 172.21.15.19:0/2253418376 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5df0106f10 0x7f5df019cca0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f5de8031a20 tx=0x7f5de8031a50 comp rx=0 tx=0).stop 2024-09-19T08:59:10.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.665+0000 7f5df5965640 1 -- 172.21.15.19:0/2253418376 shutdown_connections 2024-09-19T08:59:10.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.665+0000 7f5df5965640 1 --2- 172.21.15.19:0/2253418376 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5ddc0a3240 0x7f5ddc0a5700 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.665+0000 7f5df5965640 1 --2- 172.21.15.19:0/2253418376 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5df0106f10 0x7f5df019cca0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.665+0000 7f5df5965640 1 --2- 172.21.15.19:0/2253418376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5df0102790 0x7f5df0198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.665+0000 7f5df5965640 1 --2- 172.21.15.19:0/2253418376 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5df0101de0 0x7f5df01983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:10.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.665+0000 7f5df5965640 1 -- 172.21.15.19:0/2253418376 >> 172.21.15.19:0/2253418376 conn(0x7f5df00fd8c0 msgr2=0x7f5df00feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:10.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.665+0000 7f5df5965640 1 -- 172.21.15.19:0/2253418376 shutdown_connections 2024-09-19T08:59:10.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:10.665+0000 7f5df5965640 1 -- 172.21.15.19:0/2253418376 wait complete. 2024-09-19T08:59:10.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:10 smithi019 ceph-mon[30976]: scrub queued for path: / 2024-09-19T08:59:10.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:10 smithi019 ceph-mon[30976]: scrub summary: idle+waiting paths [/] 2024-09-19T08:59:10.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:10 smithi019 ceph-mon[30976]: scrub summary: active paths [/] 2024-09-19T08:59:10.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:10 smithi203 ceph-mon[35450]: scrub queued for path: / 2024-09-19T08:59:10.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:10 smithi203 ceph-mon[35450]: scrub summary: idle+waiting paths [/] 2024-09-19T08:59:10.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:10 smithi203 ceph-mon[35450]: scrub summary: active paths [/] 2024-09-19T08:59:11.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:10 smithi155 ceph-mon[34921]: scrub queued for path: / 2024-09-19T08:59:11.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:10 smithi155 ceph-mon[34921]: scrub summary: idle+waiting paths [/] 2024-09-19T08:59:11.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:10 smithi155 ceph-mon[34921]: scrub summary: active paths [/] 2024-09-19T08:59:11.301 INFO:tasks.cephfs.filesystem:scrub status for tag:bc3d29b1-7057-487a-b805-bce062af7107 - {'path': '/', 'tag': 'bc3d29b1-7057-487a-b805-bce062af7107', 'options': 'recursive,force'} 2024-09-19T08:59:11.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:11 smithi203 ceph-mon[35450]: pgmap v546: 97 pgs: 97 active+clean; 13 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 638 KiB/s rd, 755 KiB/s wr, 296 op/s 2024-09-19T08:59:12.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:11 smithi019 ceph-mon[30976]: pgmap v546: 97 pgs: 97 active+clean; 13 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 638 KiB/s rd, 755 KiB/s wr, 296 op/s 2024-09-19T08:59:12.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:11 smithi155 ceph-mon[34921]: pgmap v546: 97 pgs: 97 active+clean; 13 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 638 KiB/s rd, 755 KiB/s wr, 296 op/s 2024-09-19T08:59:13.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:13 smithi203 ceph-mon[35450]: pgmap v547: 97 pgs: 97 active+clean; 9.6 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 800 KiB/s rd, 967 KiB/s wr, 819 op/s 2024-09-19T08:59:14.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:13 smithi019 ceph-mon[30976]: pgmap v547: 97 pgs: 97 active+clean; 9.6 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 800 KiB/s rd, 967 KiB/s wr, 819 op/s 2024-09-19T08:59:14.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:13 smithi155 ceph-mon[34921]: pgmap v547: 97 pgs: 97 active+clean; 9.6 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 800 KiB/s rd, 967 KiB/s wr, 819 op/s 2024-09-19T08:59:15.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:15 smithi203 ceph-mon[35450]: pgmap v548: 97 pgs: 97 active+clean; 5.6 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 1.0 MiB/s wr, 1.11k op/s 2024-09-19T08:59:16.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:15 smithi019 ceph-mon[30976]: pgmap v548: 97 pgs: 97 active+clean; 5.6 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 1.0 MiB/s wr, 1.11k op/s 2024-09-19T08:59:16.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:15 smithi155 ceph-mon[34921]: pgmap v548: 97 pgs: 97 active+clean; 5.6 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 961 KiB/s rd, 1.0 MiB/s wr, 1.11k op/s 2024-09-19T08:59:17.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:17 smithi203 ceph-mon[35450]: pgmap v549: 97 pgs: 97 active+clean; 5.6 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 703 KiB/s wr, 1.24k op/s 2024-09-19T08:59:18.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:17 smithi019 ceph-mon[30976]: pgmap v549: 97 pgs: 97 active+clean; 5.6 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 703 KiB/s wr, 1.24k op/s 2024-09-19T08:59:18.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:17 smithi155 ceph-mon[34921]: pgmap v549: 97 pgs: 97 active+clean; 5.6 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 764 KiB/s rd, 703 KiB/s wr, 1.24k op/s 2024-09-19T08:59:19.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:19 smithi203 ceph-mon[35450]: pgmap v550: 97 pgs: 97 active+clean; 14 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 1.38k op/s 2024-09-19T08:59:20.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:19 smithi019 ceph-mon[30976]: pgmap v550: 97 pgs: 97 active+clean; 14 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 1.38k op/s 2024-09-19T08:59:20.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:19 smithi155 ceph-mon[34921]: pgmap v550: 97 pgs: 97 active+clean; 14 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.1 MiB/s wr, 1.38k op/s 2024-09-19T08:59:21.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:21 smithi203 ceph-mon[35450]: pgmap v551: 97 pgs: 97 active+clean; 14 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 1.24k op/s 2024-09-19T08:59:22.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:21 smithi019 ceph-mon[30976]: pgmap v551: 97 pgs: 97 active+clean; 14 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 1.24k op/s 2024-09-19T08:59:22.112 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.110+0000 7f4e7aa50640 1 -- 172.21.15.19:0/836526217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e741025f0 msgr2=0x7f4e74108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:22.112 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.110+0000 7f4e7aa50640 1 --2- 172.21.15.19:0/836526217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e741025f0 0x7f4e74108e80 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c009ca0 tx=0x7f4e6c02a8c0 comp rx=0 tx=0).stop 2024-09-19T08:59:22.112 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.110+0000 7f4e7aa50640 1 -- 172.21.15.19:0/836526217 shutdown_connections 2024-09-19T08:59:22.112 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.110+0000 7f4e7aa50640 1 --2- 172.21.15.19:0/836526217 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e74101c30 0x7f4e741020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:22.113 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.110+0000 7f4e7aa50640 1 --2- 172.21.15.19:0/836526217 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e741025f0 0x7f4e74108e80 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:22.113 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.110+0000 7f4e7aa50640 1 --2- 172.21.15.19:0/836526217 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e74100a40 0x7f4e74100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:22.113 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.110+0000 7f4e7aa50640 1 -- 172.21.15.19:0/836526217 >> 172.21.15.19:0/836526217 conn(0x7f4e740fc1e0 msgr2=0x7f4e740fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:22.113 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.111+0000 7f4e7aa50640 1 -- 172.21.15.19:0/836526217 shutdown_connections 2024-09-19T08:59:22.113 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.111+0000 7f4e7aa50640 1 -- 172.21.15.19:0/836526217 wait complete. 2024-09-19T08:59:22.113 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.111+0000 7f4e7aa50640 1 Processor -- start 2024-09-19T08:59:22.113 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.111+0000 7f4e7aa50640 1 -- start start 2024-09-19T08:59:22.113 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.111+0000 7f4e7aa50640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e74100a40 0x7f4e7406a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:22.113 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.112+0000 7f4e7aa50640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e74101c30 0x7f4e7419ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:22.113 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.112+0000 7f4e7aa50640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e741025f0 0x7f4e7419f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:22.113 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.112+0000 7f4e7aa50640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7410c6a0 con 0x7f4e74101c30 2024-09-19T08:59:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.112+0000 7f4e7aa50640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7410c520 con 0x7f4e741025f0 2024-09-19T08:59:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.112+0000 7f4e7aa50640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7410c820 con 0x7f4e74100a40 2024-09-19T08:59:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.112+0000 7f4e737fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e74101c30 0x7f4e7419ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.112+0000 7f4e78fed640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e741025f0 0x7f4e7419f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.112+0000 7f4e73fff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e74100a40 0x7f4e7406a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.112+0000 7f4e737fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e74101c30 0x7f4e7419ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52494/0 (socket says 172.21.15.19:52494) 2024-09-19T08:59:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.112+0000 7f4e737fe640 1 -- 172.21.15.19:0/450255686 learned_addr learned my addr 172.21.15.19:0/450255686 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.112+0000 7f4e73fff640 1 -- 172.21.15.19:0/450255686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e741025f0 msgr2=0x7f4e7419f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.112+0000 7f4e73fff640 1 --2- 172.21.15.19:0/450255686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e741025f0 0x7f4e7419f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.112+0000 7f4e73fff640 1 -- 172.21.15.19:0/450255686 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e74101c30 msgr2=0x7f4e7419ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.112+0000 7f4e73fff640 1 --2- 172.21.15.19:0/450255686 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e74101c30 0x7f4e7419ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.112+0000 7f4e73fff640 1 -- 172.21.15.19:0/450255686 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e7419f9b0 con 0x7f4e74100a40 2024-09-19T08:59:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.112+0000 7f4e737fe640 1 --2- 172.21.15.19:0/450255686 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e74101c30 0x7f4e7419ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.112+0000 7f4e73fff640 1 --2- 172.21.15.19:0/450255686 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e74100a40 0x7f4e7406a410 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4e6400e9c0 tx=0x7f4e6400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.112+0000 7f4e717fa640 1 -- 172.21.15.19:0/450255686 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6400cd80 con 0x7f4e74100a40 2024-09-19T08:59:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.113+0000 7f4e717fa640 1 -- 172.21.15.19:0/450255686 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e64010910 con 0x7f4e74100a40 2024-09-19T08:59:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.113+0000 7f4e7aa50640 1 -- 172.21.15.19:0/450255686 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e7419fc40 con 0x7f4e74100a40 2024-09-19T08:59:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.113+0000 7f4e717fa640 1 -- 172.21.15.19:0/450255686 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e64018980 con 0x7f4e74100a40 2024-09-19T08:59:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.113+0000 7f4e7aa50640 1 -- 172.21.15.19:0/450255686 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e741a0190 con 0x7f4e74100a40 2024-09-19T08:59:22.120 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.115+0000 7f4e717fa640 1 -- 172.21.15.19:0/450255686 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f4e6401f020 con 0x7f4e74100a40 2024-09-19T08:59:22.120 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.115+0000 7f4e7d7e1740 1 Processor -- start 2024-09-19T08:59:22.120 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.115+0000 7f4e7d7e1740 1 -- start start 2024-09-19T08:59:22.120 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.116+0000 7f4e7d7e1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5596a0dab9a0 0x5596a0dabda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:22.121 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.116+0000 7f4e7d7e1740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596a0dac2e0 0x5596a0db0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:22.121 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.116+0000 7f4e7d7e1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596a0db1370 0x5596a0db3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:22.121 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.116+0000 7f4e7d7e1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5596a0d0f2f0 con 0x5596a0dab9a0 2024-09-19T08:59:22.121 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.116+0000 7f4e7d7e1740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5596a0cb7270 con 0x5596a0dac2e0 2024-09-19T08:59:22.121 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.116+0000 7f4e7d7e1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5596a0d0b2b0 con 0x5596a0db1370 2024-09-19T08:59:22.121 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.116+0000 7f4e78fed640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5596a0dab9a0 0x5596a0dabda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:22.121 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.116+0000 7f4e73fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596a0dac2e0 0x5596a0db0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:22.121 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.116+0000 7f4e78fed640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5596a0dab9a0 0x5596a0dabda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52506/0 (socket says 172.21.15.19:52506) 2024-09-19T08:59:22.121 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.116+0000 7f4e737fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596a0db1370 0x5596a0db3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:22.121 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.116+0000 7f4e78fed640 1 -- 172.21.15.19:0/1919245179 learned_addr learned my addr 172.21.15.19:0/1919245179 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:22.121 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.116+0000 7f4e717fa640 1 --2- 172.21.15.19:0/450255686 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4e5c0a3370 0x7f4e5c0a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:22.122 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.116+0000 7f4e78fed640 1 -- 172.21.15.19:0/1919245179 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596a0db1370 msgr2=0x5596a0db3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:22.122 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.116+0000 7f4e78fed640 1 --2- 172.21.15.19:0/1919245179 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596a0db1370 0x5596a0db3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:22.122 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.116+0000 7f4e78fed640 1 -- 172.21.15.19:0/1919245179 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596a0dac2e0 msgr2=0x5596a0db0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:22.122 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.116+0000 7f4e78fed640 1 --2- 172.21.15.19:0/1919245179 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596a0dac2e0 0x5596a0db0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:22.122 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.116+0000 7f4e78fed640 1 -- 172.21.15.19:0/1919245179 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596a0cb6340 con 0x5596a0dab9a0 2024-09-19T08:59:22.122 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.116+0000 7f4e737fe640 1 --2- 172.21.15.19:0/1919245179 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596a0db1370 0x5596a0db3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:22.122 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.116+0000 7f4e717fa640 1 -- 172.21.15.19:0/450255686 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4e640cf850 con 0x7f4e74100a40 2024-09-19T08:59:22.122 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.116+0000 7f4e78fed640 1 --2- 172.21.15.19:0/450255686 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4e5c0a3370 0x7f4e5c0a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:22.122 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.116+0000 7f4e78fed640 1 --2- 172.21.15.19:0/1919245179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5596a0dab9a0 0x5596a0dabda0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c009ca0 tx=0x7f4e6c005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec7ff729d87bf69 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:22.122 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.117+0000 7f4e5a7fc640 1 -- 172.21.15.19:0/1919245179 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c042040 con 0x5596a0dab9a0 2024-09-19T08:59:22.122 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.117+0000 7f4e5a7fc640 1 -- 172.21.15.19:0/1919245179 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e6c044070 con 0x5596a0dab9a0 2024-09-19T08:59:22.122 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.117+0000 7f4e5a7fc640 1 -- 172.21.15.19:0/1919245179 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c048430 con 0x5596a0dab9a0 2024-09-19T08:59:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.117+0000 7f4e78fed640 1 --2- 172.21.15.19:0/450255686 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4e5c0a3370 0x7f4e5c0a5830 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c04d000 tx=0x7f4e6c04e000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.117+0000 7f4e7d7e1740 1 -- 172.21.15.19:0/1919245179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5596a0dab9a0 msgr2=0x5596a0dabda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.117+0000 7f4e7d7e1740 1 --2- 172.21.15.19:0/1919245179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5596a0dab9a0 0x5596a0dabda0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c009ca0 tx=0x7f4e6c005ef0 comp rx=0 tx=0).stop 2024-09-19T08:59:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.117+0000 7f4e7d7e1740 1 -- 172.21.15.19:0/1919245179 shutdown_connections 2024-09-19T08:59:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.117+0000 7f4e7d7e1740 1 --2- 172.21.15.19:0/1919245179 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596a0db1370 0x5596a0db3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.117+0000 7f4e7d7e1740 1 --2- 172.21.15.19:0/1919245179 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596a0dac2e0 0x5596a0db0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.117+0000 7f4e7d7e1740 1 --2- 172.21.15.19:0/1919245179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5596a0dab9a0 0x5596a0dabda0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.117+0000 7f4e7d7e1740 1 -- 172.21.15.19:0/1919245179 >> 172.21.15.19:0/1919245179 conn(0x5596a0da7010 msgr2=0x5596a0da7410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.117+0000 7f4e7d7e1740 1 -- 172.21.15.19:0/1919245179 shutdown_connections 2024-09-19T08:59:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.118+0000 7f4e7d7e1740 1 -- 172.21.15.19:0/1919245179 wait complete. 2024-09-19T08:59:22.123 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.118+0000 7f4e7d7e1740 1 -- start start 2024-09-19T08:59:22.124 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.118+0000 7f4e7d7e1740 1 Processor -- start 2024-09-19T08:59:22.124 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.118+0000 7f4e7d7e1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5596a0dab9a0 0x5596a0db5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:22.124 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.118+0000 7f4e7d7e1740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596a0dac2e0 0x5596a0db6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:22.124 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.118+0000 7f4e7d7e1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596a0db1370 0x5596a0dbd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:22.124 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.118+0000 7f4e7d7e1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5596a0db4340 con 0x5596a0dab9a0 2024-09-19T08:59:22.124 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.118+0000 7f4e7d7e1740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5596a0c98290 con 0x5596a0dac2e0 2024-09-19T08:59:22.124 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.118+0000 7f4e7d7e1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5596a0db44c0 con 0x5596a0db1370 2024-09-19T08:59:22.124 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.118+0000 7f4e7d7e1740 10 client.0 _ll_register_callbacks cb 0x5596a0cc9140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:22.124 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.118+0000 7f4e73fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5596a0dab9a0 0x5596a0db5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:22.124 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.118+0000 7f4e737fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596a0dac2e0 0x5596a0db6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:22.125 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.118+0000 7f4e737fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596a0dac2e0 0x5596a0db6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:48236/0 (socket says 172.21.15.19:48236) 2024-09-19T08:59:22.125 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.118+0000 7f4e737fe640 1 -- 172.21.15.19:0/57316413 learned_addr learned my addr 172.21.15.19:0/57316413 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:22.125 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.119+0000 7f4e78fed640 1 --2- 172.21.15.19:0/57316413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596a0db1370 0x5596a0dbd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:22.125 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.119+0000 7f4e737fe640 1 -- 172.21.15.19:0/57316413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596a0db1370 msgr2=0x5596a0dbd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:22.125 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.119+0000 7f4e737fe640 1 --2- 172.21.15.19:0/57316413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596a0db1370 0x5596a0dbd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:22.125 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.119+0000 7f4e737fe640 1 -- 172.21.15.19:0/57316413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5596a0dab9a0 msgr2=0x5596a0db5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:22.125 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.119+0000 7f4e737fe640 1 --2- 172.21.15.19:0/57316413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5596a0dab9a0 0x5596a0db5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:22.125 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.119+0000 7f4e737fe640 1 -- 172.21.15.19:0/57316413 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596a0a22210 con 0x5596a0dac2e0 2024-09-19T08:59:22.125 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.119+0000 7f4e78fed640 1 --2- 172.21.15.19:0/57316413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596a0db1370 0x5596a0dbd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T08:59:22.125 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.119+0000 7f4e737fe640 1 --2- 172.21.15.19:0/57316413 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596a0dac2e0 0x5596a0db6170 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4e68011870 tx=0x7f4e68011c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23cfd88535e14d7a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:22.126 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.119+0000 7f4e537fe640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T08:59:22.126 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.119+0000 7f4e537fe640 1 -- 172.21.15.19:0/57316413 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e68010c60 con 0x5596a0dac2e0 2024-09-19T08:59:22.126 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.119+0000 7f4e537fe640 1 -- 172.21.15.19:0/57316413 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4e68010e00 con 0x5596a0dac2e0 2024-09-19T08:59:22.126 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.119+0000 7f4e7d7e1740 1 -- 172.21.15.19:0/57316413 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e6c044070 con 0x5596a0dac2e0 2024-09-19T08:59:22.126 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.119+0000 7f4e537fe640 1 -- 172.21.15.19:0/57316413 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f4e68004030 con 0x5596a0dac2e0 2024-09-19T08:59:22.126 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.119+0000 7f4e7d7e1740 10 client.26591 fetch_fsmap learned FSMap version 36 2024-09-19T08:59:22.126 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.119+0000 7f4e7d7e1740 1 -- 172.21.15.19:0/57316413 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5596a0aee620 con 0x5596a0dac2e0 2024-09-19T08:59:22.126 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.120+0000 7f4e537fe640 1 -- 172.21.15.19:0/57316413 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e6c044070 con 0x5596a0dac2e0 2024-09-19T08:59:22.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.120+0000 7f4e537fe640 1 -- 172.21.15.19:0/57316413 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f4e6801a410 con 0x5596a0dac2e0 2024-09-19T08:59:22.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.120+0000 7f4e7d7e1740 10 client.26591 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T08:59:22.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.120+0000 7f4e7d7e1740 10 client.26591 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:59:22.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.120+0000 7f4e7d7e1740 20 client.26591 populate_metadata read hostname 'smithi019' 2024-09-19T08:59:22.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.120+0000 7f4e7d7e1740 1 --2- 172.21.15.19:0/57316413 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5596a0dc1970 0x5596a0dc3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:22.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.120+0000 7f4e7d7e1740 4 client.26591 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:59:22.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.120+0000 7f4e7d7e1740 1 -- 172.21.15.19:0/57316413 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596a0d1ca20 con 0x5596a0dc1970 2024-09-19T08:59:22.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.120+0000 7f4e73fff640 1 --2- 172.21.15.19:0/57316413 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5596a0dc1970 0x5596a0dc3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:22.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.121+0000 7f4e537fe640 10 client.26591 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:59:22.129 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.121+0000 7f4e73fff640 1 --2- 172.21.15.19:0/57316413 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5596a0dc1970 0x5596a0dc3da0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45246d4320722be3 server_cookie=8f26f3c6d003aae8 in_seq=0 out_seq=0 2024-09-19T08:59:22.130 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.123+0000 7f4e537fe640 1 -- 172.21.15.19:0/57316413 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5596a0d1ca20 con 0x5596a0dc1970 2024-09-19T08:59:22.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.123+0000 7f4e537fe640 10 client.26591 handle_command_reply: tid=0 2024-09-19T08:59:22.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.123+0000 7f4e7d7e1740 1 client.26591 shutdown 2024-09-19T08:59:22.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.123+0000 7f4e7d7e1740 1 -- 172.21.15.19:0/57316413 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596a0dac2e0 msgr2=0x5596a0db6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:22.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.123+0000 7f4e7d7e1740 1 --2- 172.21.15.19:0/57316413 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596a0dac2e0 0x5596a0db6170 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f4e68011870 tx=0x7f4e68011c70 comp rx=0 tx=0).stop 2024-09-19T08:59:22.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.123+0000 7f4e7d7e1740 1 -- 172.21.15.19:0/57316413 shutdown_connections 2024-09-19T08:59:22.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.123+0000 7f4e7d7e1740 1 --2- 172.21.15.19:0/57316413 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5596a0dc1970 0x5596a0dc3da0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:22.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.123+0000 7f4e7d7e1740 1 --2- 172.21.15.19:0/57316413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596a0db1370 0x5596a0dbd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:22.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.123+0000 7f4e7d7e1740 1 --2- 172.21.15.19:0/57316413 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596a0dac2e0 0x5596a0db6170 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:22.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.123+0000 7f4e537fe640 0 client.26591 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:59:22.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.123+0000 7f4e7d7e1740 1 --2- 172.21.15.19:0/57316413 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5596a0dab9a0 0x5596a0db5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:22.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.123+0000 7f4e7d7e1740 1 -- 172.21.15.19:0/57316413 >> 172.21.15.19:0/57316413 conn(0x5596a0da7010 msgr2=0x5596a0da8820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:22.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.123+0000 7f4e7d7e1740 1 -- 172.21.15.19:0/57316413 shutdown_connections 2024-09-19T08:59:22.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.123+0000 7f4e7d7e1740 1 -- 172.21.15.19:0/57316413 wait complete. 2024-09-19T08:59:22.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.123+0000 7f4e7d7e1740 20 client.26591 trim_cache size 0 max 16384 2024-09-19T08:59:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.139+0000 7f4e7d7e1740 1 Processor -- start 2024-09-19T08:59:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.139+0000 7f4e7d7e1740 1 -- start start 2024-09-19T08:59:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.139+0000 7f4e7d7e1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5596a0dab9a0 0x5596a0da73f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.139+0000 7f4e7d7e1740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596a0dac2e0 0x5596a0dbd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.139+0000 7f4e7d7e1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596a0db1370 0x5596a0da7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.139+0000 7f4e7d7e1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4e741a8e30 con 0x5596a0dab9a0 2024-09-19T08:59:22.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.139+0000 7f4e7d7e1740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4e741aa970 con 0x5596a0dac2e0 2024-09-19T08:59:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.139+0000 7f4e7d7e1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4e741a9500 con 0x5596a0db1370 2024-09-19T08:59:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.139+0000 7f4e73fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5596a0dab9a0 0x5596a0da73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.139+0000 7f4e737fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596a0dac2e0 0x5596a0dbd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.139+0000 7f4e737fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596a0dac2e0 0x5596a0dbd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:48252/0 (socket says 172.21.15.19:48252) 2024-09-19T08:59:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.139+0000 7f4e737fe640 1 -- 172.21.15.19:0/1957389886 learned_addr learned my addr 172.21.15.19:0/1957389886 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.139+0000 7f4e73fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5596a0dab9a0 0x5596a0da73f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52520/0 (socket says 172.21.15.19:52520) 2024-09-19T08:59:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.140+0000 7f4e78fed640 1 --2- 172.21.15.19:0/1957389886 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596a0db1370 0x5596a0da7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.140+0000 7f4e737fe640 1 -- 172.21.15.19:0/1957389886 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596a0db1370 msgr2=0x5596a0da7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.140+0000 7f4e737fe640 1 --2- 172.21.15.19:0/1957389886 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596a0db1370 0x5596a0da7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.140+0000 7f4e737fe640 1 -- 172.21.15.19:0/1957389886 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5596a0dab9a0 msgr2=0x5596a0da73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.140+0000 7f4e737fe640 1 --2- 172.21.15.19:0/1957389886 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5596a0dab9a0 0x5596a0da73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:22.141 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.140+0000 7f4e737fe640 1 -- 172.21.15.19:0/1957389886 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596a0db3760 con 0x5596a0dac2e0 2024-09-19T08:59:22.142 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.140+0000 7f4e73fff640 1 --2- 172.21.15.19:0/1957389886 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5596a0dab9a0 0x5596a0da73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:22.142 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.140+0000 7f4e737fe640 1 --2- 172.21.15.19:0/1957389886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596a0dac2e0 0x5596a0dbd170 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4e6801a830 tx=0x7f4e6800b5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbbea6fbd492069d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:22.142 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.140+0000 7f4e59ffb640 1 -- 172.21.15.19:0/1957389886 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6802a070 con 0x5596a0dac2e0 2024-09-19T08:59:22.142 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.140+0000 7f4e59ffb640 1 -- 172.21.15.19:0/1957389886 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e68020030 con 0x5596a0dac2e0 2024-09-19T08:59:22.142 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.140+0000 7f4e59ffb640 1 -- 172.21.15.19:0/1957389886 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e68005460 con 0x5596a0dac2e0 2024-09-19T08:59:22.146 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.141+0000 7f4e7d7e1740 1 -- 172.21.15.19:0/1957389886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596a0dac2e0 msgr2=0x5596a0dbd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:22.146 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.141+0000 7f4e7d7e1740 1 --2- 172.21.15.19:0/1957389886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596a0dac2e0 0x5596a0dbd170 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4e6801a830 tx=0x7f4e6800b5d0 comp rx=0 tx=0).stop 2024-09-19T08:59:22.146 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.141+0000 7f4e7d7e1740 1 -- 172.21.15.19:0/1957389886 shutdown_connections 2024-09-19T08:59:22.146 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.141+0000 7f4e7d7e1740 1 --2- 172.21.15.19:0/1957389886 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596a0db1370 0x5596a0da7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:22.146 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.141+0000 7f4e7d7e1740 1 --2- 172.21.15.19:0/1957389886 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596a0dac2e0 0x5596a0dbd170 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:22.146 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.141+0000 7f4e7d7e1740 1 --2- 172.21.15.19:0/1957389886 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5596a0dab9a0 0x5596a0da73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:22.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.141+0000 7f4e7d7e1740 1 -- 172.21.15.19:0/1957389886 >> 172.21.15.19:0/1957389886 conn(0x5596a0da7010 msgr2=0x5596a0db5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:22.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.141+0000 7f4e7d7e1740 1 -- 172.21.15.19:0/1957389886 shutdown_connections 2024-09-19T08:59:22.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.141+0000 7f4e7d7e1740 1 -- 172.21.15.19:0/1957389886 wait complete. 2024-09-19T08:59:22.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.141+0000 7f4e7d7e1740 1 -- start start 2024-09-19T08:59:22.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.142+0000 7f4e7d7e1740 1 Processor -- start 2024-09-19T08:59:22.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.142+0000 7f4e7d7e1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5596a0dab9a0 0x5596a0dba620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:22.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.142+0000 7f4e7d7e1740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596a0dac2e0 0x5596a0dbab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:22.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.142+0000 7f4e7d7e1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596a0db1370 0x5596a0dbbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:22.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.142+0000 7f4e7d7e1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4e741aa2a0 con 0x5596a0dab9a0 2024-09-19T08:59:22.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.142+0000 7f4e7d7e1740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4e741a9bd0 con 0x5596a0dac2e0 2024-09-19T08:59:22.147 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.142+0000 7f4e7d7e1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4e741a6e10 con 0x5596a0db1370 2024-09-19T08:59:22.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.142+0000 7f4e7d7e1740 10 client.0 _ll_register_callbacks cb 0x7f4e6800be00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:22.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.142+0000 7f4e73fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5596a0dab9a0 0x5596a0dba620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:22.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.142+0000 7f4e737fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596a0dac2e0 0x5596a0dbab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:22.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.142+0000 7f4e73fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5596a0dab9a0 0x5596a0dba620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:52528/0 (socket says 172.21.15.19:52528) 2024-09-19T08:59:22.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.142+0000 7f4e73fff640 1 -- 172.21.15.19:0/2540670946 learned_addr learned my addr 172.21.15.19:0/2540670946 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:22.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.142+0000 7f4e78fed640 1 --2- 172.21.15.19:0/2540670946 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596a0db1370 0x5596a0dbbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:22.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.142+0000 7f4e73fff640 1 -- 172.21.15.19:0/2540670946 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596a0db1370 msgr2=0x5596a0dbbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:22.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.142+0000 7f4e73fff640 1 --2- 172.21.15.19:0/2540670946 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596a0db1370 0x5596a0dbbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:22.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.142+0000 7f4e73fff640 1 -- 172.21.15.19:0/2540670946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596a0dac2e0 msgr2=0x5596a0dbab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:22.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.142+0000 7f4e73fff640 1 --2- 172.21.15.19:0/2540670946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596a0dac2e0 0x5596a0dbab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:22.148 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.142+0000 7f4e73fff640 1 -- 172.21.15.19:0/2540670946 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596a0dbc180 con 0x5596a0dab9a0 2024-09-19T08:59:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.142+0000 7f4e737fe640 1 --2- 172.21.15.19:0/2540670946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596a0dac2e0 0x5596a0dbab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.143+0000 7f4e73fff640 1 --2- 172.21.15.19:0/2540670946 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5596a0dab9a0 0x5596a0dba620 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f4e64098850 tx=0x7f4e640bc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1f3ff75ac44b25f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.143+0000 7f4e537fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:59:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.143+0000 7f4e537fe640 1 -- 172.21.15.19:0/2540670946 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e640d5040 con 0x5596a0dab9a0 2024-09-19T08:59:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.143+0000 7f4e537fe640 1 -- 172.21.15.19:0/2540670946 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4e640cd470 con 0x5596a0dab9a0 2024-09-19T08:59:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.143+0000 7f4e7d7e1740 1 -- 172.21.15.19:0/2540670946 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e68020030 con 0x5596a0dab9a0 2024-09-19T08:59:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.143+0000 7f4e537fe640 1 -- 172.21.15.19:0/2540670946 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f4e6409c580 con 0x5596a0dab9a0 2024-09-19T08:59:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.143+0000 7f4e7d7e1740 10 client.17118 fetch_fsmap learned FSMap version 36 2024-09-19T08:59:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.143+0000 7f4e7d7e1740 1 -- 172.21.15.19:0/2540670946 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5596a0dbd500 con 0x5596a0dab9a0 2024-09-19T08:59:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.143+0000 7f4e537fe640 1 -- 172.21.15.19:0/2540670946 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4e68020030 con 0x5596a0dab9a0 2024-09-19T08:59:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.143+0000 7f4e537fe640 1 -- 172.21.15.19:0/2540670946 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f4e640984f0 con 0x5596a0dab9a0 2024-09-19T08:59:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.143+0000 7f4e7d7e1740 10 client.17118 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T08:59:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.143+0000 7f4e7d7e1740 10 client.17118 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:59:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.143+0000 7f4e7d7e1740 20 client.17118 populate_metadata read hostname 'smithi019' 2024-09-19T08:59:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.143+0000 7f4e7d7e1740 1 --2- 172.21.15.19:0/2540670946 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5596a0e2cca0 0x5596a0e2f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.143+0000 7f4e7d7e1740 4 client.17118 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:59:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.143+0000 7f4e7d7e1740 1 -- 172.21.15.19:0/2540670946 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5596a0d16d70 con 0x5596a0e2cca0 2024-09-19T08:59:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.144+0000 7f4e737fe640 1 --2- 172.21.15.19:0/2540670946 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5596a0e2cca0 0x5596a0e2f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.144+0000 7f4e737fe640 1 --2- 172.21.15.19:0/2540670946 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5596a0e2cca0 0x5596a0e2f0c0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de700cd122f65db7 server_cookie=a5bcd6798a58e2d1 in_seq=0 out_seq=0 2024-09-19T08:59:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:22.144+0000 7f4e537fe640 10 client.17118 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:59:22.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:21 smithi155 ceph-mon[34921]: pgmap v551: 97 pgs: 97 active+clean; 14 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 1.24k op/s 2024-09-19T08:59:24.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:23 smithi019 ceph-mon[30976]: pgmap v552: 97 pgs: 97 active+clean; 23 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.7 MiB/s wr, 1.26k op/s 2024-09-19T08:59:24.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:23 smithi155 ceph-mon[34921]: pgmap v552: 97 pgs: 97 active+clean; 23 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.7 MiB/s wr, 1.26k op/s 2024-09-19T08:59:24.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:23 smithi203 ceph-mon[35450]: pgmap v552: 97 pgs: 97 active+clean; 23 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 1.7 MiB/s wr, 1.26k op/s 2024-09-19T08:59:26.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:25 smithi019 ceph-mon[30976]: pgmap v553: 97 pgs: 97 active+clean; 23 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 806 op/s 2024-09-19T08:59:26.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:25 smithi155 ceph-mon[34921]: pgmap v553: 97 pgs: 97 active+clean; 23 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 806 op/s 2024-09-19T08:59:26.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:25 smithi203 ceph-mon[35450]: pgmap v553: 97 pgs: 97 active+clean; 23 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 1.5 MiB/s wr, 806 op/s 2024-09-19T08:59:28.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:27 smithi019 ceph-mon[30976]: pgmap v554: 97 pgs: 97 active+clean; 29 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.1 MiB/s wr, 777 op/s 2024-09-19T08:59:28.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:27 smithi155 ceph-mon[34921]: pgmap v554: 97 pgs: 97 active+clean; 29 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.1 MiB/s wr, 777 op/s 2024-09-19T08:59:28.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:27 smithi203 ceph-mon[35450]: pgmap v554: 97 pgs: 97 active+clean; 29 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.1 MiB/s wr, 777 op/s 2024-09-19T08:59:30.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:29 smithi019 ceph-mon[30976]: pgmap v555: 97 pgs: 97 active+clean; 29 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 1.01k op/s 2024-09-19T08:59:30.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:29 smithi155 ceph-mon[34921]: pgmap v555: 97 pgs: 97 active+clean; 29 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 1.01k op/s 2024-09-19T08:59:30.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:29 smithi203 ceph-mon[35450]: pgmap v555: 97 pgs: 97 active+clean; 29 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.4 MiB/s wr, 1.01k op/s 2024-09-19T08:59:32.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:31 smithi019 ceph-mon[30976]: pgmap v556: 97 pgs: 97 active+clean; 37 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 981 op/s 2024-09-19T08:59:32.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:31 smithi155 ceph-mon[34921]: pgmap v556: 97 pgs: 97 active+clean; 37 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 981 op/s 2024-09-19T08:59:32.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:31 smithi203 ceph-mon[35450]: pgmap v556: 97 pgs: 97 active+clean; 37 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 2.4 MiB/s wr, 981 op/s 2024-09-19T08:59:33.309 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:33.309+0000 7f4e537fe640 1 -- 172.21.15.19:0/2540670946 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5596a0d16d70 con 0x5596a0e2cca0 2024-09-19T08:59:33.309 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:33.309+0000 7f4e537fe640 10 client.17118 handle_command_reply: tid=0 2024-09-19T08:59:33.309 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:33.309+0000 7f4e7d7e1740 1 client.17118 shutdown 2024-09-19T08:59:33.309 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:33.309+0000 7f4e7d7e1740 1 -- 172.21.15.19:0/2540670946 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5596a0dab9a0 msgr2=0x5596a0dba620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:33.309 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:33.309+0000 7f4e7d7e1740 1 --2- 172.21.15.19:0/2540670946 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5596a0dab9a0 0x5596a0dba620 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f4e64098850 tx=0x7f4e640bc040 comp rx=0 tx=0).stop 2024-09-19T08:59:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:33.309+0000 7f4e7d7e1740 1 -- 172.21.15.19:0/2540670946 shutdown_connections 2024-09-19T08:59:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:33.309+0000 7f4e7d7e1740 1 --2- 172.21.15.19:0/2540670946 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5596a0e2cca0 0x5596a0e2f0c0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:33.309+0000 7f4e7d7e1740 1 --2- 172.21.15.19:0/2540670946 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5596a0db1370 0x5596a0dbbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:33.309+0000 7f4e7d7e1740 1 --2- 172.21.15.19:0/2540670946 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5596a0dac2e0 0x5596a0dbab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:33.309+0000 7f4e537fe640 0 client.17118 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:59:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:33.309+0000 7f4e7d7e1740 1 --2- 172.21.15.19:0/2540670946 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5596a0dab9a0 0x5596a0dba620 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:33.309+0000 7f4e7d7e1740 1 -- 172.21.15.19:0/2540670946 >> 172.21.15.19:0/2540670946 conn(0x5596a0da7010 msgr2=0x5596a0dad530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:33.309+0000 7f4e7d7e1740 1 -- 172.21.15.19:0/2540670946 shutdown_connections 2024-09-19T08:59:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:33.309+0000 7f4e7d7e1740 1 -- 172.21.15.19:0/2540670946 wait complete. 2024-09-19T08:59:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:33.309+0000 7f4e7d7e1740 20 client.17118 trim_cache size 0 max 16384 2024-09-19T08:59:33.310 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T08:59:33.311 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T08:59:33.311 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T08:59:33.311 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T08:59:33.311 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:33.310+0000 7f4e7aa50640 1 -- 172.21.15.19:0/450255686 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4e5c0a3370 msgr2=0x7f4e5c0a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:33.311 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:33.310+0000 7f4e7aa50640 1 --2- 172.21.15.19:0/450255686 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4e5c0a3370 0x7f4e5c0a5830 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c04d000 tx=0x7f4e6c04e000 comp rx=0 tx=0).stop 2024-09-19T08:59:33.311 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:33.310+0000 7f4e7aa50640 1 -- 172.21.15.19:0/450255686 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e74100a40 msgr2=0x7f4e7406a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:33.312 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:33.310+0000 7f4e7aa50640 1 --2- 172.21.15.19:0/450255686 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e74100a40 0x7f4e7406a410 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4e6400e9c0 tx=0x7f4e6400ee80 comp rx=0 tx=0).stop 2024-09-19T08:59:33.312 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:33.310+0000 7f4e7aa50640 1 -- 172.21.15.19:0/450255686 shutdown_connections 2024-09-19T08:59:33.312 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:33.310+0000 7f4e7aa50640 1 --2- 172.21.15.19:0/450255686 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4e5c0a3370 0x7f4e5c0a5830 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:33.312 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:33.310+0000 7f4e7aa50640 1 --2- 172.21.15.19:0/450255686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4e741025f0 0x7f4e7419f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:33.312 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:33.310+0000 7f4e7aa50640 1 --2- 172.21.15.19:0/450255686 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4e74101c30 0x7f4e7419ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:33.312 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:33.310+0000 7f4e7aa50640 1 --2- 172.21.15.19:0/450255686 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e74100a40 0x7f4e7406a410 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:33.312 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:33.310+0000 7f4e7aa50640 1 -- 172.21.15.19:0/450255686 >> 172.21.15.19:0/450255686 conn(0x7f4e740fc1e0 msgr2=0x7f4e74104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:33.312 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:33.310+0000 7f4e7aa50640 1 -- 172.21.15.19:0/450255686 shutdown_connections 2024-09-19T08:59:33.312 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:33.310+0000 7f4e7aa50640 1 -- 172.21.15.19:0/450255686 wait complete. 2024-09-19T08:59:34.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:33 smithi019 ceph-mon[30976]: pgmap v557: 97 pgs: 97 active+clean; 38 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 990 op/s 2024-09-19T08:59:34.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:33 smithi155 ceph-mon[34921]: pgmap v557: 97 pgs: 97 active+clean; 38 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 990 op/s 2024-09-19T08:59:34.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:33 smithi203 ceph-mon[35450]: pgmap v557: 97 pgs: 97 active+clean; 38 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 990 op/s 2024-09-19T08:59:36.034 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:35 smithi203 ceph-mon[35450]: pgmap v558: 97 pgs: 97 active+clean; 38 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 858 op/s 2024-09-19T08:59:36.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:35 smithi019 ceph-mon[30976]: pgmap v558: 97 pgs: 97 active+clean; 38 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 858 op/s 2024-09-19T08:59:36.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:35 smithi155 ceph-mon[34921]: pgmap v558: 97 pgs: 97 active+clean; 38 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.1 MiB/s wr, 858 op/s 2024-09-19T08:59:38.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:37 smithi019 ceph-mon[30976]: pgmap v559: 97 pgs: 97 active+clean; 34 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 841 op/s 2024-09-19T08:59:38.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:37 smithi155 ceph-mon[34921]: pgmap v559: 97 pgs: 97 active+clean; 34 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 841 op/s 2024-09-19T08:59:38.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:37 smithi203 ceph-mon[35450]: pgmap v559: 97 pgs: 97 active+clean; 34 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 2.4 MiB/s wr, 841 op/s 2024-09-19T08:59:40.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:39 smithi019 ceph-mon[30976]: pgmap v560: 97 pgs: 97 active+clean; 30 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 654 op/s 2024-09-19T08:59:40.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:39 smithi155 ceph-mon[34921]: pgmap v560: 97 pgs: 97 active+clean; 30 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 654 op/s 2024-09-19T08:59:40.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:39 smithi203 ceph-mon[35450]: pgmap v560: 97 pgs: 97 active+clean; 30 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 654 op/s 2024-09-19T08:59:41.303 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T08:59:41.581 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T08:59:41.969 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:41 smithi019 ceph-mon[30976]: pgmap v561: 97 pgs: 97 active+clean; 30 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 309 op/s 2024-09-19T08:59:42.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.064+0000 7fd06266b640 1 -- 172.21.15.19:0/3767946937 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd05c100eb0 msgr2=0x7fd05c106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:42.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.064+0000 7fd06266b640 1 --2- 172.21.15.19:0/3767946937 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd05c100eb0 0x7fd05c106840 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fd044009900 tx=0x7fd04402a410 comp rx=0 tx=0).stop 2024-09-19T08:59:42.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.064+0000 7fd06266b640 1 -- 172.21.15.19:0/3767946937 shutdown_connections 2024-09-19T08:59:42.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.064+0000 7fd06266b640 1 --2- 172.21.15.19:0/3767946937 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd05c106f70 0x7fd05c10eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.064+0000 7fd06266b640 1 --2- 172.21.15.19:0/3767946937 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd05c100eb0 0x7fd05c106840 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.064+0000 7fd06266b640 1 --2- 172.21.15.19:0/3767946937 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd05c100500 0x7fd05c1008e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.064+0000 7fd06266b640 1 -- 172.21.15.19:0/3767946937 >> 172.21.15.19:0/3767946937 conn(0x7fd05c0fc5c0 msgr2=0x7fd05c0fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:42.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.064+0000 7fd06266b640 1 -- 172.21.15.19:0/3767946937 shutdown_connections 2024-09-19T08:59:42.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.064+0000 7fd06266b640 1 -- 172.21.15.19:0/3767946937 wait complete. 2024-09-19T08:59:42.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.065+0000 7fd06266b640 1 Processor -- start 2024-09-19T08:59:42.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.065+0000 7fd06266b640 1 -- start start 2024-09-19T08:59:42.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.066+0000 7fd06266b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd05c100500 0x7fd05c198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:42.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.066+0000 7fd06266b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd05c100eb0 0x7fd05c1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:42.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.066+0000 7fd06266b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd05c106f70 0x7fd05c19cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:42.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.066+0000 7fd06266b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd05c111f90 con 0x7fd05c106f70 2024-09-19T08:59:42.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.066+0000 7fd06266b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd05c111e10 con 0x7fd05c100eb0 2024-09-19T08:59:42.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.066+0000 7fd06266b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd05c112110 con 0x7fd05c100500 2024-09-19T08:59:42.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.066+0000 7fd060c08640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd05c106f70 0x7fd05c19cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:42.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.066+0000 7fd053fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd05c100eb0 0x7fd05c1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:42.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.066+0000 7fd060c08640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd05c106f70 0x7fd05c19cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56106/0 (socket says 172.21.15.19:56106) 2024-09-19T08:59:42.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.066+0000 7fd060c08640 1 -- 172.21.15.19:0/694178983 learned_addr learned my addr 172.21.15.19:0/694178983 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:42.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.066+0000 7fd05bfff640 1 --2- 172.21.15.19:0/694178983 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd05c100500 0x7fd05c198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:42.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.066+0000 7fd060c08640 1 -- 172.21.15.19:0/694178983 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd05c100500 msgr2=0x7fd05c198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:42.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.066+0000 7fd060c08640 1 --2- 172.21.15.19:0/694178983 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd05c100500 0x7fd05c198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.066+0000 7fd060c08640 1 -- 172.21.15.19:0/694178983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd05c100eb0 msgr2=0x7fd05c1989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:42.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.066+0000 7fd060c08640 1 --2- 172.21.15.19:0/694178983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd05c100eb0 0x7fd05c1989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.066+0000 7fd060c08640 1 -- 172.21.15.19:0/694178983 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd05c19d410 con 0x7fd05c106f70 2024-09-19T08:59:42.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.066+0000 7fd060c08640 1 --2- 172.21.15.19:0/694178983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd05c106f70 0x7fd05c19cd30 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fd05400eb10 tx=0x7fd05400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:42.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.066+0000 7fd059ffb640 1 -- 172.21.15.19:0/694178983 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd054004b20 con 0x7fd05c106f70 2024-09-19T08:59:42.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.066+0000 7fd06266b640 1 -- 172.21.15.19:0/694178983 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd05c19d700 con 0x7fd05c106f70 2024-09-19T08:59:42.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.067+0000 7fd059ffb640 1 -- 172.21.15.19:0/694178983 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd054004cc0 con 0x7fd05c106f70 2024-09-19T08:59:42.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.067+0000 7fd059ffb640 1 -- 172.21.15.19:0/694178983 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd054010760 con 0x7fd05c106f70 2024-09-19T08:59:42.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.067+0000 7fd06266b640 1 -- 172.21.15.19:0/694178983 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd05c1a4fe0 con 0x7fd05c106f70 2024-09-19T08:59:42.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.070+0000 7fd059ffb640 1 -- 172.21.15.19:0/694178983 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fd054005020 con 0x7fd05c106f70 2024-09-19T08:59:42.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.070+0000 7fd064a44740 1 Processor -- start 2024-09-19T08:59:42.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.070+0000 7fd064a44740 1 -- start start 2024-09-19T08:59:42.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.071+0000 7fd064a44740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6874bd4a0 0x55b6874bd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:42.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.071+0000 7fd064a44740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6874bddc0 0x55b6874c8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:42.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.071+0000 7fd064a44740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6874c8680 0x55b6874caa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:42.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.071+0000 7fd064a44740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b6874232e0 con 0x55b6874bd4a0 2024-09-19T08:59:42.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.071+0000 7fd064a44740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b6873cace0 con 0x55b6874bddc0 2024-09-19T08:59:42.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.071+0000 7fd064a44740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b68741f2a0 con 0x55b6874c8680 2024-09-19T08:59:42.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.071+0000 7fd059ffb640 1 --2- 172.21.15.19:0/694178983 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd0480a3240 0x7fd0480a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:42.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.071+0000 7fd05bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6874bddc0 0x55b6874c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:42.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.071+0000 7fd053fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6874bd4a0 0x55b6874bd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:42.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.071+0000 7fd05bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6874bddc0 0x55b6874c8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:38344/0 (socket says 172.21.15.19:38344) 2024-09-19T08:59:42.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.071+0000 7fd05bfff640 1 -- 172.21.15.19:0/3055325121 learned_addr learned my addr 172.21.15.19:0/3055325121 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:42.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.071+0000 7fd060c08640 1 --2- 172.21.15.19:0/694178983 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd0480a3240 0x7fd0480a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:42.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.071+0000 7fd053fff640 1 --2- 172.21.15.19:0/3055325121 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6874c8680 0x55b6874caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:42.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.071+0000 7fd05bfff640 1 -- 172.21.15.19:0/3055325121 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6874c8680 msgr2=0x55b6874caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:42.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.071+0000 7fd05bfff640 1 --2- 172.21.15.19:0/3055325121 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6874c8680 0x55b6874caa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.071+0000 7fd05bfff640 1 -- 172.21.15.19:0/3055325121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6874bd4a0 msgr2=0x55b6874bd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:42.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.071+0000 7fd05bfff640 1 --2- 172.21.15.19:0/3055325121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6874bd4a0 0x55b6874bd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.071+0000 7fd05bfff640 1 -- 172.21.15.19:0/3055325121 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6873af440 con 0x55b6874bddc0 2024-09-19T08:59:42.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.071+0000 7fd053fff640 1 --2- 172.21.15.19:0/3055325121 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6874c8680 0x55b6874caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T08:59:42.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.072+0000 7fd05bfff640 1 --2- 172.21.15.19:0/3055325121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6874bddc0 0x55b6874c8140 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd04c009ca0 tx=0x7fd04c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=530df444a6090517 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:42.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.072+0000 7fd059ffb640 1 -- 172.21.15.19:0/694178983 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd0540cfdf0 con 0x7fd05c106f70 2024-09-19T08:59:42.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.072+0000 7fd060c08640 1 --2- 172.21.15.19:0/694178983 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd0480a3240 0x7fd0480a5700 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd054098df0 tx=0x7fd054078040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:42.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.072+0000 7fd0527fc640 1 -- 172.21.15.19:0/3055325121 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04c004220 con 0x55b6874bddc0 2024-09-19T08:59:42.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.072+0000 7fd0527fc640 1 -- 172.21.15.19:0/3055325121 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd04c0043c0 con 0x55b6874bddc0 2024-09-19T08:59:42.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.072+0000 7fd0527fc640 1 -- 172.21.15.19:0/3055325121 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04c019930 con 0x55b6874bddc0 2024-09-19T08:59:42.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.073+0000 7fd064a44740 1 -- 172.21.15.19:0/3055325121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6874bddc0 msgr2=0x55b6874c8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:42.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.073+0000 7fd064a44740 1 --2- 172.21.15.19:0/3055325121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6874bddc0 0x55b6874c8140 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd04c009ca0 tx=0x7fd04c011810 comp rx=0 tx=0).stop 2024-09-19T08:59:42.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.073+0000 7fd064a44740 1 -- 172.21.15.19:0/3055325121 shutdown_connections 2024-09-19T08:59:42.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.073+0000 7fd064a44740 1 --2- 172.21.15.19:0/3055325121 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6874c8680 0x55b6874caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.073+0000 7fd064a44740 1 --2- 172.21.15.19:0/3055325121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6874bddc0 0x55b6874c8140 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.073+0000 7fd064a44740 1 --2- 172.21.15.19:0/3055325121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6874bd4a0 0x55b6874bd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.073+0000 7fd064a44740 1 -- 172.21.15.19:0/3055325121 >> 172.21.15.19:0/3055325121 conn(0x55b6874b9a30 msgr2=0x55b6874b9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.073+0000 7fd064a44740 1 -- 172.21.15.19:0/3055325121 shutdown_connections 2024-09-19T08:59:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.073+0000 7fd064a44740 1 -- 172.21.15.19:0/3055325121 wait complete. 2024-09-19T08:59:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.074+0000 7fd064a44740 1 -- start start 2024-09-19T08:59:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.074+0000 7fd064a44740 1 Processor -- start 2024-09-19T08:59:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.074+0000 7fd064a44740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6874bd4a0 0x55b6874c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.074+0000 7fd064a44740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6874bddc0 0x55b6874c51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.074+0000 7fd064a44740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6874c8680 0x55b6874c5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.074+0000 7fd064a44740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b6874cb250 con 0x55b6874bddc0 2024-09-19T08:59:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.074+0000 7fd064a44740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b6873de050 con 0x55b6874bd4a0 2024-09-19T08:59:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.074+0000 7fd064a44740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b6874cb3d0 con 0x55b6874c8680 2024-09-19T08:59:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.074+0000 7fd064a44740 10 client.0 _ll_register_callbacks cb 0x55b68741e160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.074+0000 7fd05bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6874bddc0 0x55b6874c51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:42.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.074+0000 7fd053fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6874bd4a0 0x55b6874c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:42.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.074+0000 7fd053fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6874bd4a0 0x55b6874c7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:38360/0 (socket says 172.21.15.19:38360) 2024-09-19T08:59:42.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.074+0000 7fd05bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6874bddc0 0x55b6874c51d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56122/0 (socket says 172.21.15.19:56122) 2024-09-19T08:59:42.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.074+0000 7fd053fff640 1 -- 172.21.15.19:0/2474170330 learned_addr learned my addr 172.21.15.19:0/2474170330 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:42.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.075+0000 7fd053fff640 1 --2- 172.21.15.19:0/2474170330 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6874c8680 0x55b6874c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:42.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.075+0000 7fd05bfff640 1 -- 172.21.15.19:0/2474170330 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6874c8680 msgr2=0x55b6874c5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:42.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.075+0000 7fd05bfff640 1 --2- 172.21.15.19:0/2474170330 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6874c8680 0x55b6874c5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.075+0000 7fd05bfff640 1 -- 172.21.15.19:0/2474170330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6874bd4a0 msgr2=0x55b6874c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:42.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.075+0000 7fd05bfff640 1 --2- 172.21.15.19:0/2474170330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6874bd4a0 0x55b6874c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.075+0000 7fd05bfff640 1 -- 172.21.15.19:0/2474170330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6871943c0 con 0x55b6874bddc0 2024-09-19T08:59:42.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.075+0000 7fd053fff640 1 --2- 172.21.15.19:0/2474170330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6874bd4a0 0x55b6874c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:42.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.075+0000 7fd05bfff640 1 --2- 172.21.15.19:0/2474170330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6874bddc0 0x55b6874c51d0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fd04c01b040 tx=0x7fd04c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe15604e627be63 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:42.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.075+0000 7fd03b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:59:42.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.075+0000 7fd03b7fe640 1 -- 172.21.15.19:0/2474170330 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04c028070 con 0x55b6874bddc0 2024-09-19T08:59:42.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.075+0000 7fd03b7fe640 1 -- 172.21.15.19:0/2474170330 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd04c005040 con 0x55b6874bddc0 2024-09-19T08:59:42.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.075+0000 7fd064a44740 1 -- 172.21.15.19:0/2474170330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd04c0043c0 con 0x55b6874bddc0 2024-09-19T08:59:42.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.076+0000 7fd03b7fe640 1 -- 172.21.15.19:0/2474170330 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fd04c034050 con 0x55b6874bddc0 2024-09-19T08:59:42.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.076+0000 7fd064a44740 10 client.17130 fetch_fsmap learned FSMap version 36 2024-09-19T08:59:42.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.076+0000 7fd064a44740 1 -- 172.21.15.19:0/2474170330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55b6874d6ae0 con 0x55b6874bddc0 2024-09-19T08:59:42.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.076+0000 7fd03b7fe640 1 -- 172.21.15.19:0/2474170330 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd04c0043c0 con 0x55b6874bddc0 2024-09-19T08:59:42.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.076+0000 7fd03b7fe640 1 -- 172.21.15.19:0/2474170330 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fd04c004c70 con 0x55b6874bddc0 2024-09-19T08:59:42.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.076+0000 7fd064a44740 10 client.17130 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T08:59:42.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.076+0000 7fd064a44740 10 client.17130 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:59:42.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.076+0000 7fd064a44740 20 client.17130 populate_metadata read hostname 'smithi019' 2024-09-19T08:59:42.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.076+0000 7fd064a44740 1 --2- 172.21.15.19:0/2474170330 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b6874d7e90 0x55b6874da280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:42.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.076+0000 7fd064a44740 4 client.17130 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:59:42.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.076+0000 7fd064a44740 1 -- 172.21.15.19:0/2474170330 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b687430850 con 0x55b6874d7e90 2024-09-19T08:59:42.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.076+0000 7fd053fff640 1 --2- 172.21.15.19:0/2474170330 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b6874d7e90 0x55b6874da280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:42.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.077+0000 7fd053fff640 1 --2- 172.21.15.19:0/2474170330 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b6874d7e90 0x55b6874da280 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3992f762d94d5b4 server_cookie=3e2017086110c4fb in_seq=0 out_seq=0 2024-09-19T08:59:42.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.077+0000 7fd03b7fe640 10 client.17130 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:59:42.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.082+0000 7fd03b7fe640 1 -- 172.21.15.19:0/2474170330 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b687430850 con 0x55b6874d7e90 2024-09-19T08:59:42.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.082+0000 7fd03b7fe640 10 client.17130 handle_command_reply: tid=0 2024-09-19T08:59:42.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.082+0000 7fd064a44740 1 client.17130 shutdown 2024-09-19T08:59:42.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.083+0000 7fd064a44740 1 -- 172.21.15.19:0/2474170330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6874bddc0 msgr2=0x55b6874c51d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:42.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.083+0000 7fd064a44740 1 --2- 172.21.15.19:0/2474170330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6874bddc0 0x55b6874c51d0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fd04c01b040 tx=0x7fd04c0038a0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.083+0000 7fd064a44740 1 -- 172.21.15.19:0/2474170330 shutdown_connections 2024-09-19T08:59:42.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.083+0000 7fd064a44740 1 --2- 172.21.15.19:0/2474170330 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b6874d7e90 0x55b6874da280 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.083+0000 7fd064a44740 1 --2- 172.21.15.19:0/2474170330 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6874c8680 0x55b6874c5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.083+0000 7fd03b7fe640 0 client.17130 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:59:42.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.083+0000 7fd064a44740 1 --2- 172.21.15.19:0/2474170330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6874bddc0 0x55b6874c51d0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.083+0000 7fd064a44740 1 --2- 172.21.15.19:0/2474170330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6874bd4a0 0x55b6874c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.083+0000 7fd064a44740 1 -- 172.21.15.19:0/2474170330 >> 172.21.15.19:0/2474170330 conn(0x55b6874b9a30 msgr2=0x55b6874b8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:42.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.083+0000 7fd064a44740 1 -- 172.21.15.19:0/2474170330 shutdown_connections 2024-09-19T08:59:42.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.083+0000 7fd064a44740 1 -- 172.21.15.19:0/2474170330 wait complete. 2024-09-19T08:59:42.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.083+0000 7fd064a44740 20 client.17130 trim_cache size 0 max 16384 2024-09-19T08:59:42.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.116+0000 7fd064a44740 1 Processor -- start 2024-09-19T08:59:42.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.116+0000 7fd064a44740 1 -- start start 2024-09-19T08:59:42.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.116+0000 7fd064a44740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6874bd4a0 0x55b6874c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:42.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.116+0000 7fd064a44740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6874bddc0 0x55b6874c7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:42.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.116+0000 7fd064a44740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6874c8680 0x55b6874df9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:42.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.116+0000 7fd064a44740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd05c1ad570 con 0x55b6874bddc0 2024-09-19T08:59:42.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.116+0000 7fd064a44740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd05c1af0b0 con 0x55b6874bd4a0 2024-09-19T08:59:42.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.116+0000 7fd064a44740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd05c1adc40 con 0x55b6874c8680 2024-09-19T08:59:42.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.117+0000 7fd053fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6874bd4a0 0x55b6874c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:42.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.117+0000 7fd05bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6874bddc0 0x55b6874c7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:42.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.117+0000 7fd053fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6874bd4a0 0x55b6874c0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:38366/0 (socket says 172.21.15.19:38366) 2024-09-19T08:59:42.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.117+0000 7fd05bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6874bddc0 0x55b6874c7030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56126/0 (socket says 172.21.15.19:56126) 2024-09-19T08:59:42.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.117+0000 7fd053fff640 1 -- 172.21.15.19:0/114639433 learned_addr learned my addr 172.21.15.19:0/114639433 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:42.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.117+0000 7fd053fff640 1 --2- 172.21.15.19:0/114639433 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6874c8680 0x55b6874df9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:42.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.117+0000 7fd053fff640 1 -- 172.21.15.19:0/114639433 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6874c8680 msgr2=0x55b6874df9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:42.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.117+0000 7fd053fff640 1 --2- 172.21.15.19:0/114639433 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6874c8680 0x55b6874df9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.117+0000 7fd053fff640 1 -- 172.21.15.19:0/114639433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6874bddc0 msgr2=0x55b6874c7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:42.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.117+0000 7fd053fff640 1 --2- 172.21.15.19:0/114639433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6874bddc0 0x55b6874c7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.117+0000 7fd053fff640 1 -- 172.21.15.19:0/114639433 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6874c4180 con 0x55b6874bd4a0 2024-09-19T08:59:42.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.117+0000 7fd05bfff640 1 --2- 172.21.15.19:0/114639433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6874bddc0 0x55b6874c7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:42.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.117+0000 7fd053fff640 1 --2- 172.21.15.19:0/114639433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6874bd4a0 0x55b6874c0900 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd04402a930 tx=0x7fd044009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=822b443244699d84 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:42.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.118+0000 7fd051ffb640 1 -- 172.21.15.19:0/114639433 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd044035040 con 0x55b6874bd4a0 2024-09-19T08:59:42.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.118+0000 7fd051ffb640 1 -- 172.21.15.19:0/114639433 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0440050f0 con 0x55b6874bd4a0 2024-09-19T08:59:42.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.118+0000 7fd051ffb640 1 -- 172.21.15.19:0/114639433 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd044004b40 con 0x55b6874bd4a0 2024-09-19T08:59:42.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.118+0000 7fd064a44740 1 -- 172.21.15.19:0/114639433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6874bd4a0 msgr2=0x55b6874c0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:42.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.118+0000 7fd064a44740 1 --2- 172.21.15.19:0/114639433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6874bd4a0 0x55b6874c0900 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd04402a930 tx=0x7fd044009260 comp rx=0 tx=0).stop 2024-09-19T08:59:42.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.118+0000 7fd064a44740 1 -- 172.21.15.19:0/114639433 shutdown_connections 2024-09-19T08:59:42.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.118+0000 7fd064a44740 1 --2- 172.21.15.19:0/114639433 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6874c8680 0x55b6874df9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.118+0000 7fd064a44740 1 --2- 172.21.15.19:0/114639433 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6874bddc0 0x55b6874c7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.118+0000 7fd064a44740 1 --2- 172.21.15.19:0/114639433 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6874bd4a0 0x55b6874c0900 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.118+0000 7fd064a44740 1 -- 172.21.15.19:0/114639433 >> 172.21.15.19:0/114639433 conn(0x55b6874b9a30 msgr2=0x55b6874c6920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:42.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.119+0000 7fd064a44740 1 -- 172.21.15.19:0/114639433 shutdown_connections 2024-09-19T08:59:42.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.119+0000 7fd064a44740 1 -- 172.21.15.19:0/114639433 wait complete. 2024-09-19T08:59:42.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.119+0000 7fd064a44740 1 -- start start 2024-09-19T08:59:42.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.119+0000 7fd064a44740 1 Processor -- start 2024-09-19T08:59:42.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.119+0000 7fd064a44740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6874bd4a0 0x55b6874d0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:42.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.119+0000 7fd064a44740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6874bddc0 0x55b6874cc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:42.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.119+0000 7fd064a44740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6874c8680 0x55b6874cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:42.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.119+0000 7fd064a44740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd05c1ae9e0 con 0x55b6874c8680 2024-09-19T08:59:42.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.119+0000 7fd064a44740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd05c1ae310 con 0x55b6874bddc0 2024-09-19T08:59:42.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.119+0000 7fd064a44740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd05c1ab550 con 0x55b6874bd4a0 2024-09-19T08:59:42.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.120+0000 7fd064a44740 10 client.0 _ll_register_callbacks cb 0x7fd04c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:42.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.120+0000 7fd053fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6874c8680 0x55b6874cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:42.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.120+0000 7fd05bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6874bddc0 0x55b6874cc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:42.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.120+0000 7fd053fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6874c8680 0x55b6874cc9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56132/0 (socket says 172.21.15.19:56132) 2024-09-19T08:59:42.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.120+0000 7fd053fff640 1 -- 172.21.15.19:0/1901278377 learned_addr learned my addr 172.21.15.19:0/1901278377 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:42.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.120+0000 7fd053fff640 1 --2- 172.21.15.19:0/1901278377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6874bd4a0 0x55b6874d0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:42.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.120+0000 7fd05bfff640 1 -- 172.21.15.19:0/1901278377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6874bd4a0 msgr2=0x55b6874d0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:42.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.120+0000 7fd05bfff640 1 --2- 172.21.15.19:0/1901278377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6874bd4a0 0x55b6874d0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.120+0000 7fd05bfff640 1 -- 172.21.15.19:0/1901278377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6874c8680 msgr2=0x55b6874cc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:42.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.120+0000 7fd05bfff640 1 --2- 172.21.15.19:0/1901278377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6874c8680 0x55b6874cc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.120+0000 7fd05bfff640 1 -- 172.21.15.19:0/1901278377 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6874c81f0 con 0x55b6874bddc0 2024-09-19T08:59:42.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.120+0000 7fd05bfff640 1 --2- 172.21.15.19:0/1901278377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6874bddc0 0x55b6874cc220 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd04c009250 tx=0x7fd04c0099d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11c69761c2df3c37 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:42.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.120+0000 7fd03b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T08:59:42.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.120+0000 7fd03b7fe640 1 -- 172.21.15.19:0/1901278377 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04c028070 con 0x55b6874bddc0 2024-09-19T08:59:42.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.120+0000 7fd03b7fe640 1 -- 172.21.15.19:0/1901278377 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd04c005040 con 0x55b6874bddc0 2024-09-19T08:59:42.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.120+0000 7fd064a44740 1 -- 172.21.15.19:0/1901278377 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0440050f0 con 0x55b6874bddc0 2024-09-19T08:59:42.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.121+0000 7fd03b7fe640 1 -- 172.21.15.19:0/1901278377 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fd04c011d10 con 0x55b6874bddc0 2024-09-19T08:59:42.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.121+0000 7fd064a44740 10 client.26615 fetch_fsmap learned FSMap version 36 2024-09-19T08:59:42.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.121+0000 7fd064a44740 1 -- 172.21.15.19:0/1901278377 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55b687546d50 con 0x55b6874bddc0 2024-09-19T08:59:42.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.121+0000 7fd03b7fe640 1 -- 172.21.15.19:0/1901278377 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd0440050f0 con 0x55b6874bddc0 2024-09-19T08:59:42.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.121+0000 7fd03b7fe640 1 -- 172.21.15.19:0/1901278377 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fd04c041080 con 0x55b6874bddc0 2024-09-19T08:59:42.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.121+0000 7fd064a44740 10 client.26615 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T08:59:42.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.121+0000 7fd064a44740 10 client.26615 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T08:59:42.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.121+0000 7fd064a44740 20 client.26615 populate_metadata read hostname 'smithi019' 2024-09-19T08:59:42.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.121+0000 7fd064a44740 1 --2- 172.21.15.19:0/1901278377 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b6874d7e90 0x55b687549420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:42.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.121+0000 7fd064a44740 4 client.26615 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T08:59:42.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.121+0000 7fd064a44740 1 -- 172.21.15.19:0/1901278377 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b68742ad60 con 0x55b6874d7e90 2024-09-19T08:59:42.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.121+0000 7fd053fff640 1 --2- 172.21.15.19:0/1901278377 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b6874d7e90 0x55b687549420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:42.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.122+0000 7fd03b7fe640 10 client.26615 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:59:42.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.122+0000 7fd053fff640 1 --2- 172.21.15.19:0/1901278377 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b6874d7e90 0x55b687549420 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=130d8c87f0d48c82 server_cookie=af69a0154175c630 in_seq=0 out_seq=0 2024-09-19T08:59:42.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.126+0000 7fd03b7fe640 1 -- 172.21.15.19:0/1901278377 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+269 (crc 0 0 0) 0x55b68742ad60 con 0x55b6874d7e90 2024-09-19T08:59:42.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.126+0000 7fd03b7fe640 10 client.26615 handle_command_reply: tid=0 2024-09-19T08:59:42.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.126+0000 7fd064a44740 1 client.26615 shutdown 2024-09-19T08:59:42.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.126+0000 7fd064a44740 1 -- 172.21.15.19:0/1901278377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6874bddc0 msgr2=0x55b6874cc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:42.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.126+0000 7fd064a44740 1 --2- 172.21.15.19:0/1901278377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6874bddc0 0x55b6874cc220 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fd04c009250 tx=0x7fd04c0099d0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.126+0000 7fd064a44740 1 -- 172.21.15.19:0/1901278377 shutdown_connections 2024-09-19T08:59:42.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.126+0000 7fd064a44740 1 --2- 172.21.15.19:0/1901278377 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b6874d7e90 0x55b687549420 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.126+0000 7fd064a44740 1 --2- 172.21.15.19:0/1901278377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6874c8680 0x55b6874cc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.126+0000 7fd064a44740 1 --2- 172.21.15.19:0/1901278377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6874bddc0 0x55b6874cc220 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.126+0000 7fd064a44740 1 --2- 172.21.15.19:0/1901278377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6874bd4a0 0x55b6874d0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.126+0000 7fd03b7fe640 0 client.26615 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:59:42.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.126+0000 7fd064a44740 1 -- 172.21.15.19:0/1901278377 >> 172.21.15.19:0/1901278377 conn(0x55b6874b9a30 msgr2=0x55b6874c07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:42.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.126+0000 7fd064a44740 1 -- 172.21.15.19:0/1901278377 shutdown_connections 2024-09-19T08:59:42.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.126+0000 7fd064a44740 1 -- 172.21.15.19:0/1901278377 wait complete. 2024-09-19T08:59:42.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.126+0000 7fd064a44740 20 client.26615 trim_cache size 0 max 16384 2024-09-19T08:59:42.128 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T08:59:42.128 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "scrub active (10700 inodes in the stack)", 2024-09-19T08:59:42.128 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-19T08:59:42.128 INFO:teuthology.orchestra.run.smithi019.stdout: "bc3d29b1-7057-487a-b805-bce062af7107": { 2024-09-19T08:59:42.129 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-19T08:59:42.129 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "bc3d29b1-7057-487a-b805-bce062af7107", 2024-09-19T08:59:42.129 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-19T08:59:42.129 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:59:42.129 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T08:59:42.129 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T08:59:42.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.127+0000 7fd06266b640 1 -- 172.21.15.19:0/694178983 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd0480a3240 msgr2=0x7fd0480a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:42.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.127+0000 7fd06266b640 1 --2- 172.21.15.19:0/694178983 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd0480a3240 0x7fd0480a5700 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd054098df0 tx=0x7fd054078040 comp rx=0 tx=0).stop 2024-09-19T08:59:42.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.127+0000 7fd06266b640 1 -- 172.21.15.19:0/694178983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd05c106f70 msgr2=0x7fd05c19cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:42.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.127+0000 7fd06266b640 1 --2- 172.21.15.19:0/694178983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd05c106f70 0x7fd05c19cd30 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fd05400eb10 tx=0x7fd05400c2d0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.127+0000 7fd06266b640 1 -- 172.21.15.19:0/694178983 shutdown_connections 2024-09-19T08:59:42.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.127+0000 7fd06266b640 1 --2- 172.21.15.19:0/694178983 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd0480a3240 0x7fd0480a5700 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.127+0000 7fd06266b640 1 --2- 172.21.15.19:0/694178983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd05c106f70 0x7fd05c19cd30 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.127+0000 7fd06266b640 1 --2- 172.21.15.19:0/694178983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd05c100eb0 0x7fd05c1989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.127+0000 7fd06266b640 1 --2- 172.21.15.19:0/694178983 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd05c100500 0x7fd05c198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:42.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.127+0000 7fd06266b640 1 -- 172.21.15.19:0/694178983 >> 172.21.15.19:0/694178983 conn(0x7fd05c0fc5c0 msgr2=0x7fd05c105390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:42.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.127+0000 7fd06266b640 1 -- 172.21.15.19:0/694178983 shutdown_connections 2024-09-19T08:59:42.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T08:59:42.127+0000 7fd06266b640 1 -- 172.21.15.19:0/694178983 wait complete. 2024-09-19T08:59:42.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:41 smithi155 ceph-mon[34921]: pgmap v561: 97 pgs: 97 active+clean; 30 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 309 op/s 2024-09-19T08:59:42.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:41 smithi203 ceph-mon[35450]: pgmap v561: 97 pgs: 97 active+clean; 30 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.8 MiB/s wr, 309 op/s 2024-09-19T08:59:42.934 INFO:tasks.cephfs.filesystem:scrub status for tag:bc3d29b1-7057-487a-b805-bce062af7107 - {'path': '/', 'tag': 'bc3d29b1-7057-487a-b805-bce062af7107', 'options': 'recursive,force'} 2024-09-19T08:59:44.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:43 smithi019 ceph-mon[30976]: pgmap v562: 97 pgs: 97 active+clean; 35 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 281 op/s 2024-09-19T08:59:44.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:43 smithi155 ceph-mon[34921]: pgmap v562: 97 pgs: 97 active+clean; 35 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 281 op/s 2024-09-19T08:59:44.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:43 smithi203 ceph-mon[35450]: pgmap v562: 97 pgs: 97 active+clean; 35 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 281 op/s 2024-09-19T08:59:45.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:44 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:45.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:44 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:45.238 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:44 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T08:59:46.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:45 smithi019 ceph-mon[30976]: pgmap v563: 97 pgs: 97 active+clean; 35 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 1.1 MiB/s wr, 298 op/s 2024-09-19T08:59:46.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:45 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:46.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:45 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:46.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:45 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:46.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:45 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:46.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:45 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:46.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:45 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:46.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:45 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:46.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:45 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:46.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:45 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:46.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:45 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:46.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:45 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:59:46.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:45 smithi155 ceph-mon[34921]: pgmap v563: 97 pgs: 97 active+clean; 35 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 1.1 MiB/s wr, 298 op/s 2024-09-19T08:59:46.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:45 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:46.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:45 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:46.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:45 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:46.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:45 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:46.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:45 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:46.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:45 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:46.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:45 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:46.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:45 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:46.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:45 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:46.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:45 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:46.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:45 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:59:46.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:45 smithi203 ceph-mon[35450]: pgmap v563: 97 pgs: 97 active+clean; 35 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 1.1 MiB/s wr, 298 op/s 2024-09-19T08:59:46.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:45 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:46.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:45 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:46.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:45 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:46.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:45 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:46.233 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:45 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:46.233 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:45 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:46.233 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:45 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:46.233 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:45 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T08:59:46.233 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:45 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T08:59:46.233 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:45 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T08:59:46.233 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:45 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T08:59:46.402 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.400+0000 7f75706c9640 1 -- 172.21.15.19:0/1943172932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75681025d0 msgr2=0x7f75681049c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:46.402 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.400+0000 7f75706c9640 1 --2- 172.21.15.19:0/1943172932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75681025d0 0x7f75681049c0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f7564009900 tx=0x7f756402a410 comp rx=0 tx=0).stop 2024-09-19T08:59:46.402 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.401+0000 7f75706c9640 1 -- 172.21.15.19:0/1943172932 shutdown_connections 2024-09-19T08:59:46.402 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.401+0000 7f75706c9640 1 --2- 172.21.15.19:0/1943172932 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7568107830 0x7f7568109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:46.402 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.401+0000 7f75706c9640 1 --2- 172.21.15.19:0/1943172932 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7568104f00 0x7f75681072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:46.402 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.401+0000 7f75706c9640 1 --2- 172.21.15.19:0/1943172932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f75681025d0 0x7f75681049c0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:46.402 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.401+0000 7f75706c9640 1 -- 172.21.15.19:0/1943172932 >> 172.21.15.19:0/1943172932 conn(0x7f75680fc1b0 msgr2=0x7f75680fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:46.402 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.401+0000 7f75706c9640 1 -- 172.21.15.19:0/1943172932 shutdown_connections 2024-09-19T08:59:46.402 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.401+0000 7f75706c9640 1 -- 172.21.15.19:0/1943172932 wait complete. 2024-09-19T08:59:46.403 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.401+0000 7f75706c9640 1 Processor -- start 2024-09-19T08:59:46.403 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.401+0000 7f75706c9640 1 -- start start 2024-09-19T08:59:46.403 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.401+0000 7f75706c9640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75681025d0 0x7f7568101f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:46.403 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.401+0000 7f75706c9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7568104f00 0x7f7568100580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:46.403 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.401+0000 7f75706c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7568107830 0x7f7568100ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:46.403 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.401+0000 7f75706c9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f756810d840 con 0x7f7568107830 2024-09-19T08:59:46.403 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.401+0000 7f75706c9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f756810d6c0 con 0x7f7568104f00 2024-09-19T08:59:46.403 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.401+0000 7f75706c9640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f756810d9c0 con 0x7f75681025d0 2024-09-19T08:59:46.403 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.401+0000 7f756ec66640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7568107830 0x7f7568100ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:46.403 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.402+0000 7f756ec66640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7568107830 0x7f7568100ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38952/0 (socket says 172.21.15.19:38952) 2024-09-19T08:59:46.403 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.402+0000 7f756ec66640 1 -- 172.21.15.19:0/65385640 learned_addr learned my addr 172.21.15.19:0/65385640 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:46.403 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.402+0000 7f756dc64640 1 --2- 172.21.15.19:0/65385640 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7568104f00 0x7f7568100580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:46.403 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.402+0000 7f756e465640 1 --2- 172.21.15.19:0/65385640 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75681025d0 0x7f7568101f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:46.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.402+0000 7f756ec66640 1 -- 172.21.15.19:0/65385640 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75681025d0 msgr2=0x7f7568101f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:46.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.402+0000 7f756ec66640 1 --2- 172.21.15.19:0/65385640 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75681025d0 0x7f7568101f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:46.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.402+0000 7f756ec66640 1 -- 172.21.15.19:0/65385640 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7568104f00 msgr2=0x7f7568100580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:46.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.402+0000 7f756ec66640 1 --2- 172.21.15.19:0/65385640 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7568104f00 0x7f7568100580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:46.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.402+0000 7f756ec66640 1 -- 172.21.15.19:0/65385640 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7568101350 con 0x7f7568107830 2024-09-19T08:59:46.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.402+0000 7f756ec66640 1 --2- 172.21.15.19:0/65385640 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7568107830 0x7f7568100ac0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f756000eb40 tx=0x7f756000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:46.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.402+0000 7f755f7fe640 1 -- 172.21.15.19:0/65385640 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7560004b20 con 0x7f7568107830 2024-09-19T08:59:46.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.402+0000 7f755f7fe640 1 -- 172.21.15.19:0/65385640 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7560004cc0 con 0x7f7568107830 2024-09-19T08:59:46.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.402+0000 7f755f7fe640 1 -- 172.21.15.19:0/65385640 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7560010850 con 0x7f7568107830 2024-09-19T08:59:46.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.402+0000 7f75706c9640 1 -- 172.21.15.19:0/65385640 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75681a1f60 con 0x7f7568107830 2024-09-19T08:59:46.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.402+0000 7f75706c9640 1 -- 172.21.15.19:0/65385640 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75681a2420 con 0x7f7568107830 2024-09-19T08:59:46.407 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.405+0000 7f755f7fe640 1 -- 172.21.15.19:0/65385640 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f7560005020 con 0x7f7568107830 2024-09-19T08:59:46.407 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.405+0000 7f757345f740 1 Processor -- start 2024-09-19T08:59:46.407 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.405+0000 7f757345f740 1 -- start start 2024-09-19T08:59:46.407 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.405+0000 7f757345f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c326179a0 0x563c32617da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:46.407 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.405+0000 7f757345f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c326182e0 0x563c3261cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:46.407 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.405+0000 7f757345f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c3261d370 0x563c3261f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:46.407 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.405+0000 7f757345f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563c3257b2f0 con 0x563c3261d370 2024-09-19T08:59:46.407 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.405+0000 7f757345f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x563c32523270 con 0x563c326182e0 2024-09-19T08:59:46.407 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.405+0000 7f757345f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563c325772b0 con 0x563c326179a0 2024-09-19T08:59:46.407 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.406+0000 7f756e465640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c326182e0 0x563c3261cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:46.407 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.406+0000 7f756dc64640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c3261d370 0x563c3261f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:46.408 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.406+0000 7f756e465640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c326182e0 0x563c3261cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:57460/0 (socket says 172.21.15.19:57460) 2024-09-19T08:59:46.408 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.406+0000 7f756e465640 1 -- 172.21.15.19:0/1801632215 learned_addr learned my addr 172.21.15.19:0/1801632215 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:46.408 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.406+0000 7f756dc64640 1 --2- 172.21.15.19:0/1801632215 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c326179a0 0x563c32617da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:46.408 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.406+0000 7f756e465640 1 -- 172.21.15.19:0/1801632215 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c326179a0 msgr2=0x563c32617da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:46.408 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.406+0000 7f756e465640 1 --2- 172.21.15.19:0/1801632215 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c326179a0 0x563c32617da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:46.408 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.406+0000 7f756e465640 1 -- 172.21.15.19:0/1801632215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c3261d370 msgr2=0x563c3261f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:46.408 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.406+0000 7f756e465640 1 --2- 172.21.15.19:0/1801632215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c3261d370 0x563c3261f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:46.408 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.406+0000 7f756e465640 1 -- 172.21.15.19:0/1801632215 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c32522340 con 0x563c326182e0 2024-09-19T08:59:46.408 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.406+0000 7f755f7fe640 1 --2- 172.21.15.19:0/65385640 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f75540a3370 0x7f75540a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:46.408 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.406+0000 7f756dc64640 1 --2- 172.21.15.19:0/65385640 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f75540a3370 0x7f75540a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:46.408 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.406+0000 7f756e465640 1 --2- 172.21.15.19:0/1801632215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c326182e0 0x563c3261cda0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f756402a930 tx=0x7f7564032cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8664f4788273b18 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:46.408 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.406+0000 7f755f7fe640 1 -- 172.21.15.19:0/65385640 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f75600d0090 con 0x7f7568107830 2024-09-19T08:59:46.408 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.406+0000 7f755cff9640 1 -- 172.21.15.19:0/1801632215 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f756403f070 con 0x563c326182e0 2024-09-19T08:59:46.409 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.406+0000 7f755cff9640 1 -- 172.21.15.19:0/1801632215 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75640318b0 con 0x563c326182e0 2024-09-19T08:59:46.409 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.406+0000 7f755cff9640 1 -- 172.21.15.19:0/1801632215 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7564035070 con 0x563c326182e0 2024-09-19T08:59:46.409 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.407+0000 7f757345f740 1 -- 172.21.15.19:0/1801632215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c326182e0 msgr2=0x563c3261cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:46.409 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.407+0000 7f757345f740 1 --2- 172.21.15.19:0/1801632215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c326182e0 0x563c3261cda0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f756402a930 tx=0x7f7564032cb0 comp rx=0 tx=0).stop 2024-09-19T08:59:46.409 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.407+0000 7f756dc64640 1 --2- 172.21.15.19:0/65385640 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f75540a3370 0x7f75540a5830 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7558009730 tx=0x7f75580096c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:46.409 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.407+0000 7f757345f740 1 -- 172.21.15.19:0/1801632215 shutdown_connections 2024-09-19T08:59:46.409 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.407+0000 7f757345f740 1 --2- 172.21.15.19:0/1801632215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c3261d370 0x563c3261f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:46.409 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.407+0000 7f757345f740 1 --2- 172.21.15.19:0/1801632215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c326182e0 0x563c3261cda0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:46.409 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.407+0000 7f757345f740 1 --2- 172.21.15.19:0/1801632215 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c326179a0 0x563c32617da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:46.409 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.407+0000 7f757345f740 1 -- 172.21.15.19:0/1801632215 >> 172.21.15.19:0/1801632215 conn(0x563c32613010 msgr2=0x563c32613410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:46.409 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.407+0000 7f757345f740 1 -- 172.21.15.19:0/1801632215 shutdown_connections 2024-09-19T08:59:46.409 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.407+0000 7f757345f740 1 -- 172.21.15.19:0/1801632215 wait complete. 2024-09-19T08:59:46.409 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.408+0000 7f757345f740 1 -- start start 2024-09-19T08:59:46.409 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.408+0000 7f757345f740 1 Processor -- start 2024-09-19T08:59:46.412 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.408+0000 7f757345f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c326179a0 0x563c32621b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:46.412 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.408+0000 7f757345f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c326182e0 0x563c32622070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:46.412 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.408+0000 7f757345f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c3261d370 0x563c326290b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:46.412 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.408+0000 7f757345f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563c326202e0 con 0x563c326179a0 2024-09-19T08:59:46.412 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.408+0000 7f757345f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x563c32504290 con 0x563c3261d370 2024-09-19T08:59:46.412 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.408+0000 7f757345f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563c32620460 con 0x563c326182e0 2024-09-19T08:59:46.413 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.408+0000 7f757345f740 10 client.0 _ll_register_callbacks cb 0x563c32535140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:46.413 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.408+0000 7f756e465640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c326179a0 0x563c32621b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:46.413 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.408+0000 7f756e465640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c326179a0 0x563c32621b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38976/0 (socket says 172.21.15.19:38976) 2024-09-19T08:59:46.413 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.408+0000 7f756e465640 1 -- 172.21.15.19:0/2153473239 learned_addr learned my addr 172.21.15.19:0/2153473239 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:46.413 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.408+0000 7f756ec66640 1 --2- 172.21.15.19:0/2153473239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c3261d370 0x563c326290b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:46.413 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.408+0000 7f756dc64640 1 --2- 172.21.15.19:0/2153473239 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c326182e0 0x563c32622070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:46.413 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.408+0000 7f756e465640 1 -- 172.21.15.19:0/2153473239 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c326182e0 msgr2=0x563c32622070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:46.413 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.408+0000 7f756e465640 1 --2- 172.21.15.19:0/2153473239 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c326182e0 0x563c32622070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:46.413 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.408+0000 7f756e465640 1 -- 172.21.15.19:0/2153473239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c3261d370 msgr2=0x563c326290b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:46.413 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.408+0000 7f756e465640 1 --2- 172.21.15.19:0/2153473239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c3261d370 0x563c326290b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:46.413 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.408+0000 7f756e465640 1 -- 172.21.15.19:0/2153473239 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c3228e210 con 0x563c326179a0 2024-09-19T08:59:46.413 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.408+0000 7f756ec66640 1 --2- 172.21.15.19:0/2153473239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c3261d370 0x563c326290b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T08:59:46.413 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.409+0000 7f756e465640 1 --2- 172.21.15.19:0/2153473239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c326179a0 0x563c32621b30 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f7564000c00 tx=0x7f756402aa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec27e5d8ae29fe74 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:46.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.409+0000 7f7551ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:59:46.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.409+0000 7f7551ffb640 1 -- 172.21.15.19:0/2153473239 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f756404a020 con 0x563c326179a0 2024-09-19T08:59:46.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.409+0000 7f7551ffb640 1 -- 172.21.15.19:0/2153473239 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f75640037f0 con 0x563c326179a0 2024-09-19T08:59:46.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.409+0000 7f757345f740 1 -- 172.21.15.19:0/2153473239 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75640318b0 con 0x563c326179a0 2024-09-19T08:59:46.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.409+0000 7f7551ffb640 1 -- 172.21.15.19:0/2153473239 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f756403f070 con 0x563c326179a0 2024-09-19T08:59:46.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.409+0000 7f757345f740 10 client.17148 fetch_fsmap learned FSMap version 36 2024-09-19T08:59:46.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.409+0000 7f757345f740 1 -- 172.21.15.19:0/2153473239 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x563c3235a620 con 0x563c326179a0 2024-09-19T08:59:46.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.409+0000 7f7551ffb640 1 -- 172.21.15.19:0/2153473239 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f75640318b0 con 0x563c326179a0 2024-09-19T08:59:46.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.409+0000 7f7551ffb640 1 -- 172.21.15.19:0/2153473239 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f756403bb00 con 0x563c326179a0 2024-09-19T08:59:46.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.409+0000 7f757345f740 10 client.17148 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T08:59:46.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.409+0000 7f757345f740 10 client.17148 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:59:46.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.409+0000 7f757345f740 20 client.17148 populate_metadata read hostname 'smithi019' 2024-09-19T08:59:46.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.409+0000 7f757345f740 1 --2- 172.21.15.19:0/2153473239 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563c3262d3b0 0x563c3262f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:46.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.409+0000 7f757345f740 4 client.17148 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T08:59:46.415 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.409+0000 7f757345f740 1 -- 172.21.15.19:0/2153473239 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c32588a20 con 0x563c3262d3b0 2024-09-19T08:59:46.415 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.410+0000 7f756dc64640 1 --2- 172.21.15.19:0/2153473239 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563c3262d3b0 0x563c3262f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:46.415 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.410+0000 7f756dc64640 1 --2- 172.21.15.19:0/2153473239 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563c3262d3b0 0x563c3262f7c0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cc14f0c1b565964 server_cookie=3e836f2553df14c3 in_seq=0 out_seq=0 2024-09-19T08:59:46.415 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.410+0000 7f7551ffb640 10 client.17148 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:59:46.416 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.416+0000 7f7551ffb640 1 -- 172.21.15.19:0/2153473239 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563c32588a20 con 0x563c3262d3b0 2024-09-19T08:59:46.416 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.416+0000 7f7551ffb640 10 client.17148 handle_command_reply: tid=0 2024-09-19T08:59:46.416 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.416+0000 7f757345f740 1 client.17148 shutdown 2024-09-19T08:59:46.416 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.416+0000 7f757345f740 1 -- 172.21.15.19:0/2153473239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c326179a0 msgr2=0x563c32621b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:46.416 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.416+0000 7f757345f740 1 --2- 172.21.15.19:0/2153473239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c326179a0 0x563c32621b30 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f7564000c00 tx=0x7f756402aa90 comp rx=0 tx=0).stop 2024-09-19T08:59:46.416 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.416+0000 7f757345f740 1 -- 172.21.15.19:0/2153473239 shutdown_connections 2024-09-19T08:59:46.416 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.416+0000 7f757345f740 1 --2- 172.21.15.19:0/2153473239 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563c3262d3b0 0x563c3262f7c0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:46.416 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.416+0000 7f757345f740 1 --2- 172.21.15.19:0/2153473239 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c326182e0 0x563c32622070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:46.416 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.416+0000 7f757345f740 1 --2- 172.21.15.19:0/2153473239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c3261d370 0x563c326290b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:46.417 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.416+0000 7f7551ffb640 0 client.17148 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:59:46.417 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.416+0000 7f757345f740 1 --2- 172.21.15.19:0/2153473239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c326179a0 0x563c32621b30 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:46.417 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.416+0000 7f757345f740 1 -- 172.21.15.19:0/2153473239 >> 172.21.15.19:0/2153473239 conn(0x563c32613010 msgr2=0x563c32614820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:46.417 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.416+0000 7f757345f740 1 -- 172.21.15.19:0/2153473239 shutdown_connections 2024-09-19T08:59:46.417 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.416+0000 7f757345f740 1 -- 172.21.15.19:0/2153473239 wait complete. 2024-09-19T08:59:46.417 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.416+0000 7f757345f740 20 client.17148 trim_cache size 0 max 16384 2024-09-19T08:59:46.437 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.436+0000 7f757345f740 1 Processor -- start 2024-09-19T08:59:46.437 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.436+0000 7f757345f740 1 -- start start 2024-09-19T08:59:46.437 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.436+0000 7f757345f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c326179a0 0x563c3262f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:46.437 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.436+0000 7f757345f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c326182e0 0x563c32629070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:46.437 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.436+0000 7f757345f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c3261d370 0x563c32621f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:46.437 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.436+0000 7f757345f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f75681ab120 con 0x563c326182e0 2024-09-19T08:59:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.436+0000 7f757345f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f75681acc60 con 0x563c3261d370 2024-09-19T08:59:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.436+0000 7f757345f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f75681ab7f0 con 0x563c326179a0 2024-09-19T08:59:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.437+0000 7f756dc64640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c326182e0 0x563c32629070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.437+0000 7f756dc64640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c326182e0 0x563c32629070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38984/0 (socket says 172.21.15.19:38984) 2024-09-19T08:59:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.437+0000 7f756dc64640 1 -- 172.21.15.19:0/700425044 learned_addr learned my addr 172.21.15.19:0/700425044 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.437+0000 7f756ec66640 1 --2- 172.21.15.19:0/700425044 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c3261d370 0x563c32621f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.437+0000 7f756e465640 1 --2- 172.21.15.19:0/700425044 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c326179a0 0x563c3262f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.437+0000 7f756dc64640 1 -- 172.21.15.19:0/700425044 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c326179a0 msgr2=0x563c3262f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.437+0000 7f756dc64640 1 --2- 172.21.15.19:0/700425044 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c326179a0 0x563c3262f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.437+0000 7f756dc64640 1 -- 172.21.15.19:0/700425044 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c3261d370 msgr2=0x563c32621f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.437+0000 7f756dc64640 1 --2- 172.21.15.19:0/700425044 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c3261d370 0x563c32621f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.437+0000 7f756dc64640 1 -- 172.21.15.19:0/700425044 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c3262fe40 con 0x563c326182e0 2024-09-19T08:59:46.439 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.437+0000 7f756dc64640 1 --2- 172.21.15.19:0/700425044 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c326182e0 0x563c32629070 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f7568101cb0 tx=0x7f7558012070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ff3ace64e1c000 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:46.439 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.437+0000 7f7553fff640 1 -- 172.21.15.19:0/700425044 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f755801e450 con 0x563c326182e0 2024-09-19T08:59:46.439 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.437+0000 7f7553fff640 1 -- 172.21.15.19:0/700425044 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f755801ead0 con 0x563c326182e0 2024-09-19T08:59:46.439 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.437+0000 7f7553fff640 1 -- 172.21.15.19:0/700425044 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7558010aa0 con 0x563c326182e0 2024-09-19T08:59:46.442 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.438+0000 7f757345f740 1 -- 172.21.15.19:0/700425044 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c326182e0 msgr2=0x563c32629070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:46.442 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.438+0000 7f757345f740 1 --2- 172.21.15.19:0/700425044 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c326182e0 0x563c32629070 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f7568101cb0 tx=0x7f7558012070 comp rx=0 tx=0).stop 2024-09-19T08:59:46.442 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.438+0000 7f757345f740 1 -- 172.21.15.19:0/700425044 shutdown_connections 2024-09-19T08:59:46.442 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.438+0000 7f757345f740 1 --2- 172.21.15.19:0/700425044 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c3261d370 0x563c32621f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:46.442 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.438+0000 7f757345f740 1 --2- 172.21.15.19:0/700425044 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c326182e0 0x563c32629070 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:46.442 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.438+0000 7f757345f740 1 --2- 172.21.15.19:0/700425044 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c326179a0 0x563c3262f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:46.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.438+0000 7f757345f740 1 -- 172.21.15.19:0/700425044 >> 172.21.15.19:0/700425044 conn(0x563c32613010 msgr2=0x563c326121c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:46.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.438+0000 7f757345f740 1 -- 172.21.15.19:0/700425044 shutdown_connections 2024-09-19T08:59:46.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.438+0000 7f757345f740 1 -- 172.21.15.19:0/700425044 wait complete. 2024-09-19T08:59:46.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.438+0000 7f757345f740 1 -- start start 2024-09-19T08:59:46.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.439+0000 7f757345f740 1 Processor -- start 2024-09-19T08:59:46.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.439+0000 7f757345f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c326179a0 0x563c326263b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:46.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.439+0000 7f757345f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c326182e0 0x563c326268f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:46.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.439+0000 7f757345f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c3261d370 0x563c32627900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:46.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.439+0000 7f757345f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f75681ac590 con 0x563c3261d370 2024-09-19T08:59:46.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.439+0000 7f757345f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f75681abec0 con 0x563c326179a0 2024-09-19T08:59:46.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.439+0000 7f757345f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f75681a9100 con 0x563c326182e0 2024-09-19T08:59:46.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.439+0000 7f757345f740 10 client.0 _ll_register_callbacks cb 0x7f75580097f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T08:59:46.443 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.439+0000 7f756ec66640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c3261d370 0x563c32627900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:46.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.439+0000 7f756e465640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c326179a0 0x563c326263b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:46.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.439+0000 7f756e465640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c326179a0 0x563c326263b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:57478/0 (socket says 172.21.15.19:57478) 2024-09-19T08:59:46.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.439+0000 7f756ec66640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c3261d370 0x563c32627900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38994/0 (socket says 172.21.15.19:38994) 2024-09-19T08:59:46.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.439+0000 7f756e465640 1 -- 172.21.15.19:0/1146497884 learned_addr learned my addr 172.21.15.19:0/1146497884 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T08:59:46.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.439+0000 7f756dc64640 1 --2- 172.21.15.19:0/1146497884 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c326182e0 0x563c326268f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:46.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.439+0000 7f756ec66640 1 -- 172.21.15.19:0/1146497884 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c326182e0 msgr2=0x563c326268f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:46.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.439+0000 7f756ec66640 1 --2- 172.21.15.19:0/1146497884 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c326182e0 0x563c326268f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:46.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.439+0000 7f756ec66640 1 -- 172.21.15.19:0/1146497884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c326179a0 msgr2=0x563c326263b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T08:59:46.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.439+0000 7f756ec66640 1 --2- 172.21.15.19:0/1146497884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c326179a0 0x563c326263b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:46.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.439+0000 7f756ec66640 1 -- 172.21.15.19:0/1146497884 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c32627f10 con 0x563c3261d370 2024-09-19T08:59:46.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.439+0000 7f756ec66640 1 --2- 172.21.15.19:0/1146497884 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c3261d370 0x563c32627900 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f75600cdba0 tx=0x7f756009ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b70a5f5237c98e4b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T08:59:46.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.439+0000 7f7551ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T08:59:46.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.440+0000 7f7551ffb640 1 -- 172.21.15.19:0/1146497884 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f756009cdc0 con 0x563c3261d370 2024-09-19T08:59:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.440+0000 7f7551ffb640 1 -- 172.21.15.19:0/1146497884 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f75600b0be0 con 0x563c3261d370 2024-09-19T08:59:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.440+0000 7f757345f740 1 -- 172.21.15.19:0/1146497884 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f755801ead0 con 0x563c3261d370 2024-09-19T08:59:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.440+0000 7f7551ffb640 1 -- 172.21.15.19:0/1146497884 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f756009c6c0 con 0x563c3261d370 2024-09-19T08:59:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.440+0000 7f757345f740 10 client.17154 fetch_fsmap learned FSMap version 36 2024-09-19T08:59:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.440+0000 7f757345f740 1 -- 172.21.15.19:0/1146497884 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x563c326292f0 con 0x563c3261d370 2024-09-19T08:59:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.440+0000 7f7551ffb640 1 -- 172.21.15.19:0/1146497884 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f755801ead0 con 0x563c3261d370 2024-09-19T08:59:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.440+0000 7f7551ffb640 1 -- 172.21.15.19:0/1146497884 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f756007c060 con 0x563c3261d370 2024-09-19T08:59:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.440+0000 7f757345f740 10 client.17154 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T08:59:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.440+0000 7f757345f740 10 client.17154 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T08:59:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.440+0000 7f757345f740 20 client.17154 populate_metadata read hostname 'smithi019' 2024-09-19T08:59:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.440+0000 7f757345f740 1 --2- 172.21.15.19:0/1146497884 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563c32698710 0x563c3269ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T08:59:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.440+0000 7f757345f740 4 client.17154 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T08:59:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.440+0000 7f757345f740 1 -- 172.21.15.19:0/1146497884 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563c32582d70 con 0x563c32698710 2024-09-19T08:59:46.446 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.440+0000 7f756e465640 1 --2- 172.21.15.19:0/1146497884 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563c32698710 0x563c3269ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T08:59:46.446 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.441+0000 7f756e465640 1 --2- 172.21.15.19:0/1146497884 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563c32698710 0x563c3269ab00 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7d40135dfea697c server_cookie=54df9206f05b28ae in_seq=0 out_seq=0 2024-09-19T08:59:46.446 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:46.441+0000 7f7551ffb640 10 client.17154 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T08:59:47.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:46 smithi019 ceph-mon[30976]: Adjusting osd_memory_target on smithi203 to 176.0M 2024-09-19T08:59:47.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:46 smithi019 ceph-mon[30976]: Unable to set osd_memory_target on smithi203 to 184563097: error parsing value: Value '184563097' is below minimum 939524096 2024-09-19T08:59:47.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:46 smithi019 ceph-mon[30976]: Adjusting osd_memory_target on smithi155 to 176.0M 2024-09-19T08:59:47.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:46 smithi019 ceph-mon[30976]: Unable to set osd_memory_target on smithi155 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-19T08:59:47.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:46 smithi155 ceph-mon[34921]: Adjusting osd_memory_target on smithi203 to 176.0M 2024-09-19T08:59:47.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:46 smithi155 ceph-mon[34921]: Unable to set osd_memory_target on smithi203 to 184563097: error parsing value: Value '184563097' is below minimum 939524096 2024-09-19T08:59:47.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:46 smithi155 ceph-mon[34921]: Adjusting osd_memory_target on smithi155 to 176.0M 2024-09-19T08:59:47.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:46 smithi155 ceph-mon[34921]: Unable to set osd_memory_target on smithi155 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-19T08:59:47.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:46 smithi203 ceph-mon[35450]: Adjusting osd_memory_target on smithi203 to 176.0M 2024-09-19T08:59:47.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:46 smithi203 ceph-mon[35450]: Unable to set osd_memory_target on smithi203 to 184563097: error parsing value: Value '184563097' is below minimum 939524096 2024-09-19T08:59:47.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:46 smithi203 ceph-mon[35450]: Adjusting osd_memory_target on smithi155 to 176.0M 2024-09-19T08:59:47.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:46 smithi203 ceph-mon[35450]: Unable to set osd_memory_target on smithi155 to 184592486: error parsing value: Value '184592486' is below minimum 939524096 2024-09-19T08:59:48.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:47 smithi019 ceph-mon[30976]: pgmap v564: 97 pgs: 97 active+clean; 41 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 340 op/s 2024-09-19T08:59:48.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:47 smithi155 ceph-mon[34921]: pgmap v564: 97 pgs: 97 active+clean; 41 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 340 op/s 2024-09-19T08:59:48.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:47 smithi203 ceph-mon[35450]: pgmap v564: 97 pgs: 97 active+clean; 41 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 340 op/s 2024-09-19T08:59:50.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:49 smithi019 ceph-mon[30976]: pgmap v565: 97 pgs: 97 active+clean; 44 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 382 op/s 2024-09-19T08:59:50.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:49 smithi155 ceph-mon[34921]: pgmap v565: 97 pgs: 97 active+clean; 44 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 382 op/s 2024-09-19T08:59:50.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:49 smithi203 ceph-mon[35450]: pgmap v565: 97 pgs: 97 active+clean; 44 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 382 op/s 2024-09-19T08:59:52.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:51 smithi019 ceph-mon[30976]: pgmap v566: 97 pgs: 97 active+clean; 44 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 320 op/s 2024-09-19T08:59:52.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:51 smithi155 ceph-mon[34921]: pgmap v566: 97 pgs: 97 active+clean; 44 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 320 op/s 2024-09-19T08:59:52.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:51 smithi203 ceph-mon[35450]: pgmap v566: 97 pgs: 97 active+clean; 44 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 320 op/s 2024-09-19T08:59:54.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:53 smithi019 ceph-mon[30976]: pgmap v567: 97 pgs: 97 active+clean; 44 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 597 op/s 2024-09-19T08:59:54.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:53 smithi155 ceph-mon[34921]: pgmap v567: 97 pgs: 97 active+clean; 44 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 597 op/s 2024-09-19T08:59:54.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:53 smithi203 ceph-mon[35450]: pgmap v567: 97 pgs: 97 active+clean; 44 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 597 op/s 2024-09-19T08:59:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:56.028+0000 7f7551ffb640 1 -- 172.21.15.19:0/1146497884 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563c32582d70 con 0x563c32698710 2024-09-19T08:59:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:56.028+0000 7f7551ffb640 10 client.17154 handle_command_reply: tid=0 2024-09-19T08:59:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:56.028+0000 7f757345f740 1 client.17154 shutdown 2024-09-19T08:59:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:56.028+0000 7f757345f740 1 -- 172.21.15.19:0/1146497884 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c3261d370 msgr2=0x563c32627900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:56.028+0000 7f757345f740 1 --2- 172.21.15.19:0/1146497884 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c3261d370 0x563c32627900 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f75600cdba0 tx=0x7f756009ccb0 comp rx=0 tx=0).stop 2024-09-19T08:59:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:56.028+0000 7f757345f740 1 -- 172.21.15.19:0/1146497884 shutdown_connections 2024-09-19T08:59:56.029 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:56.029+0000 7f757345f740 1 --2- 172.21.15.19:0/1146497884 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563c32698710 0x563c3269ab00 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:56.029+0000 7f757345f740 1 --2- 172.21.15.19:0/1146497884 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c326182e0 0x563c326268f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:56.029+0000 7f757345f740 1 --2- 172.21.15.19:0/1146497884 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c3261d370 0x563c32627900 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:56.029+0000 7f757345f740 1 --2- 172.21.15.19:0/1146497884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c326179a0 0x563c326263b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:56.029+0000 7f7551ffb640 0 client.17154 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T08:59:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:56.029+0000 7f757345f740 1 -- 172.21.15.19:0/1146497884 >> 172.21.15.19:0/1146497884 conn(0x563c32613010 msgr2=0x563c326121c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:56.029+0000 7f757345f740 1 -- 172.21.15.19:0/1146497884 shutdown_connections 2024-09-19T08:59:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:56.029+0000 7f757345f740 1 -- 172.21.15.19:0/1146497884 wait complete. 2024-09-19T08:59:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:56.029+0000 7f757345f740 20 client.17154 trim_cache size 0 max 16384 2024-09-19T08:59:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T08:59:56.030 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T08:59:56.031 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T08:59:56.031 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T08:59:56.032 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:56.029+0000 7f75706c9640 1 -- 172.21.15.19:0/65385640 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f75540a3370 msgr2=0x7f75540a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:56.032 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:56.029+0000 7f75706c9640 1 --2- 172.21.15.19:0/65385640 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f75540a3370 0x7f75540a5830 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7558009730 tx=0x7f75580096c0 comp rx=0 tx=0).stop 2024-09-19T08:59:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:56.029+0000 7f75706c9640 1 -- 172.21.15.19:0/65385640 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7568107830 msgr2=0x7f7568100ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T08:59:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:56.029+0000 7f75706c9640 1 --2- 172.21.15.19:0/65385640 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7568107830 0x7f7568100ac0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f756000eb40 tx=0x7f756000c2d0 comp rx=0 tx=0).stop 2024-09-19T08:59:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:56.029+0000 7f75706c9640 1 -- 172.21.15.19:0/65385640 shutdown_connections 2024-09-19T08:59:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:56.029+0000 7f75706c9640 1 --2- 172.21.15.19:0/65385640 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f75540a3370 0x7f75540a5830 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:56.029+0000 7f75706c9640 1 --2- 172.21.15.19:0/65385640 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7568107830 0x7f7568100ac0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:56.029+0000 7f75706c9640 1 --2- 172.21.15.19:0/65385640 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7568104f00 0x7f7568100580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:56.029+0000 7f75706c9640 1 --2- 172.21.15.19:0/65385640 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f75681025d0 0x7f7568101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T08:59:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:56.029+0000 7f75706c9640 1 -- 172.21.15.19:0/65385640 >> 172.21.15.19:0/65385640 conn(0x7f75680fc1b0 msgr2=0x7f7568102f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T08:59:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:56.029+0000 7f75706c9640 1 -- 172.21.15.19:0/65385640 shutdown_connections 2024-09-19T08:59:56.033 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T08:59:56.029+0000 7f75706c9640 1 -- 172.21.15.19:0/65385640 wait complete. 2024-09-19T08:59:56.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:55 smithi019 ceph-mon[30976]: pgmap v568: 97 pgs: 97 active+clean; 50 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 801 op/s 2024-09-19T08:59:56.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:55 smithi155 ceph-mon[34921]: pgmap v568: 97 pgs: 97 active+clean; 50 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 801 op/s 2024-09-19T08:59:56.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:55 smithi203 ceph-mon[35450]: pgmap v568: 97 pgs: 97 active+clean; 50 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 801 op/s 2024-09-19T08:59:58.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:57 smithi019 ceph-mon[30976]: pgmap v569: 97 pgs: 97 active+clean; 26 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 923 op/s 2024-09-19T08:59:58.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:57 smithi155 ceph-mon[34921]: pgmap v569: 97 pgs: 97 active+clean; 26 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 923 op/s 2024-09-19T08:59:58.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:57 smithi203 ceph-mon[35450]: pgmap v569: 97 pgs: 97 active+clean; 26 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.9 MiB/s wr, 923 op/s 2024-09-19T09:00:00.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 08:59:59 smithi019 ceph-mon[30976]: pgmap v570: 97 pgs: 97 active+clean; 25 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 943 op/s 2024-09-19T09:00:00.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 08:59:59 smithi155 ceph-mon[34921]: pgmap v570: 97 pgs: 97 active+clean; 25 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 943 op/s 2024-09-19T09:00:00.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 08:59:59 smithi203 ceph-mon[35450]: pgmap v570: 97 pgs: 97 active+clean; 25 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 943 op/s 2024-09-19T09:00:01.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:00 smithi019 ceph-mon[30976]: overall HEALTH_OK 2024-09-19T09:00:01.073 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:00 smithi155 ceph-mon[34921]: overall HEALTH_OK 2024-09-19T09:00:01.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:00 smithi203 ceph-mon[35450]: overall HEALTH_OK 2024-09-19T09:00:02.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:01 smithi019 ceph-mon[30976]: pgmap v571: 97 pgs: 97 active+clean; 17 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 877 op/s 2024-09-19T09:00:02.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:01 smithi155 ceph-mon[34921]: pgmap v571: 97 pgs: 97 active+clean; 17 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 877 op/s 2024-09-19T09:00:02.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:01 smithi203 ceph-mon[35450]: pgmap v571: 97 pgs: 97 active+clean; 17 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 877 op/s 2024-09-19T09:00:04.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:03 smithi019 ceph-mon[30976]: pgmap v572: 97 pgs: 97 active+clean; 19 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 990 op/s 2024-09-19T09:00:04.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:03 smithi155 ceph-mon[34921]: pgmap v572: 97 pgs: 97 active+clean; 19 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 990 op/s 2024-09-19T09:00:04.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:03 smithi203 ceph-mon[35450]: pgmap v572: 97 pgs: 97 active+clean; 19 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.6 MiB/s wr, 990 op/s 2024-09-19T09:00:06.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:05 smithi019 ceph-mon[30976]: pgmap v573: 97 pgs: 97 active+clean; 23 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 759 op/s 2024-09-19T09:00:06.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:05 smithi155 ceph-mon[34921]: pgmap v573: 97 pgs: 97 active+clean; 23 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 759 op/s 2024-09-19T09:00:06.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:05 smithi203 ceph-mon[35450]: pgmap v573: 97 pgs: 97 active+clean; 23 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 759 op/s 2024-09-19T09:00:08.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:07 smithi019 ceph-mon[30976]: pgmap v574: 97 pgs: 97 active+clean; 23 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 519 op/s 2024-09-19T09:00:08.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:07 smithi155 ceph-mon[34921]: pgmap v574: 97 pgs: 97 active+clean; 23 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 519 op/s 2024-09-19T09:00:08.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:07 smithi203 ceph-mon[35450]: pgmap v574: 97 pgs: 97 active+clean; 23 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 519 op/s 2024-09-19T09:00:09.125 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.123+0000 7f1a80f9f640 1 -- 172.21.15.19:0/3869329650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a7c1025f0 msgr2=0x7f1a7c108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.123+0000 7f1a80f9f640 1 --2- 172.21.15.19:0/3869329650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a7c1025f0 0x7f1a7c108e80 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f1a74009ca0 tx=0x7f1a7402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:00:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.123+0000 7f1a80f9f640 1 -- 172.21.15.19:0/3869329650 shutdown_connections 2024-09-19T09:00:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.123+0000 7f1a80f9f640 1 --2- 172.21.15.19:0/3869329650 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a7c1025f0 0x7f1a7c108e80 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.123+0000 7f1a80f9f640 1 --2- 172.21.15.19:0/3869329650 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a7c101c30 0x7f1a7c1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.123+0000 7f1a80f9f640 1 --2- 172.21.15.19:0/3869329650 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a7c100a40 0x7f1a7c100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.123+0000 7f1a80f9f640 1 -- 172.21.15.19:0/3869329650 >> 172.21.15.19:0/3869329650 conn(0x7f1a7c0fc1e0 msgr2=0x7f1a7c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.123+0000 7f1a80f9f640 1 -- 172.21.15.19:0/3869329650 shutdown_connections 2024-09-19T09:00:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.123+0000 7f1a80f9f640 1 -- 172.21.15.19:0/3869329650 wait complete. 2024-09-19T09:00:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.124+0000 7f1a80f9f640 1 Processor -- start 2024-09-19T09:00:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.124+0000 7f1a80f9f640 1 -- start start 2024-09-19T09:00:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.124+0000 7f1a80f9f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a7c100a40 0x7f1a7c06a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:09.126 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.124+0000 7f1a80f9f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a7c101c30 0x7f1a7c19ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:09.127 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.124+0000 7f1a80f9f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a7c1025f0 0x7f1a7c19f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:09.127 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.124+0000 7f1a80f9f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7c10c710 con 0x7f1a7c1025f0 2024-09-19T09:00:09.127 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.124+0000 7f1a80f9f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7c10c590 con 0x7f1a7c100a40 2024-09-19T09:00:09.127 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.124+0000 7f1a80f9f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7c10c890 con 0x7f1a7c101c30 2024-09-19T09:00:09.127 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.124+0000 7f1a7a59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a7c100a40 0x7f1a7c06a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:09.127 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.124+0000 7f1a7ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a7c1025f0 0x7f1a7c19f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:09.127 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.124+0000 7f1a7a59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a7c100a40 0x7f1a7c06a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:33774/0 (socket says 172.21.15.19:33774) 2024-09-19T09:00:09.127 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.124+0000 7f1a7a59c640 1 -- 172.21.15.19:0/1288982358 learned_addr learned my addr 172.21.15.19:0/1288982358 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:09.127 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.124+0000 7f1a79d9b640 1 --2- 172.21.15.19:0/1288982358 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a7c101c30 0x7f1a7c19ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:09.127 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.124+0000 7f1a7a59c640 1 -- 172.21.15.19:0/1288982358 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a7c101c30 msgr2=0x7f1a7c19ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:09.127 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.124+0000 7f1a7a59c640 1 --2- 172.21.15.19:0/1288982358 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a7c101c30 0x7f1a7c19ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:09.127 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.124+0000 7f1a7a59c640 1 -- 172.21.15.19:0/1288982358 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a7c1025f0 msgr2=0x7f1a7c19f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:09.127 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.124+0000 7f1a7a59c640 1 --2- 172.21.15.19:0/1288982358 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a7c1025f0 0x7f1a7c19f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:09.128 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.125+0000 7f1a7a59c640 1 -- 172.21.15.19:0/1288982358 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a7c19f9a0 con 0x7f1a7c100a40 2024-09-19T09:00:09.128 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.125+0000 7f1a7a59c640 1 --2- 172.21.15.19:0/1288982358 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a7c100a40 0x7f1a7c06a450 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c00e9c0 tx=0x7f1a6c00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:09.128 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.125+0000 7f1a6b7fe640 1 -- 172.21.15.19:0/1288982358 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c00cd80 con 0x7f1a7c100a40 2024-09-19T09:00:09.128 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.125+0000 7f1a80f9f640 1 -- 172.21.15.19:0/1288982358 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a7c19fc90 con 0x7f1a7c100a40 2024-09-19T09:00:09.128 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.125+0000 7f1a6b7fe640 1 -- 172.21.15.19:0/1288982358 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a6c0035f0 con 0x7f1a7c100a40 2024-09-19T09:00:09.128 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.125+0000 7f1a6b7fe640 1 -- 172.21.15.19:0/1288982358 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c010690 con 0x7f1a7c100a40 2024-09-19T09:00:09.128 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.125+0000 7f1a80f9f640 1 -- 172.21.15.19:0/1288982358 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a7c1a0190 con 0x7f1a7c100a40 2024-09-19T09:00:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.127+0000 7f1a6b7fe640 1 -- 172.21.15.19:0/1288982358 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f1a6c0037a0 con 0x7f1a7c100a40 2024-09-19T09:00:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.127+0000 7f1a83e15740 1 Processor -- start 2024-09-19T09:00:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.128+0000 7f1a83e15740 1 -- start start 2024-09-19T09:00:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.128+0000 7f1a83e15740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b9080d9a0 0x557b9080dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.128+0000 7f1a83e15740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557b9080e2e0 0x557b90812da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.128+0000 7f1a83e15740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557b90813370 0x557b90815830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.128+0000 7f1a83e15740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557b907712f0 con 0x557b9080e2e0 2024-09-19T09:00:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.128+0000 7f1a83e15740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x557b90719270 con 0x557b90813370 2024-09-19T09:00:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.128+0000 7f1a83e15740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557b9076d2b0 con 0x557b9080d9a0 2024-09-19T09:00:09.131 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.128+0000 7f1a7a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557b9080e2e0 0x557b90812da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:09.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.128+0000 7f1a7a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557b9080e2e0 0x557b90812da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43496/0 (socket says 172.21.15.19:43496) 2024-09-19T09:00:09.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.128+0000 7f1a7a59c640 1 -- 172.21.15.19:0/3647632161 learned_addr learned my addr 172.21.15.19:0/3647632161 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:09.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.128+0000 7f1a79d9b640 1 --2- 172.21.15.19:0/3647632161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557b90813370 0x557b90815830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:09.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.128+0000 7f1a7ad9d640 1 --2- 172.21.15.19:0/3647632161 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b9080d9a0 0x557b9080dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:09.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.128+0000 7f1a7a59c640 1 -- 172.21.15.19:0/3647632161 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b9080d9a0 msgr2=0x557b9080dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:09.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.128+0000 7f1a7a59c640 1 --2- 172.21.15.19:0/3647632161 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b9080d9a0 0x557b9080dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:09.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.128+0000 7f1a7a59c640 1 -- 172.21.15.19:0/3647632161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557b90813370 msgr2=0x557b90815830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:09.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.128+0000 7f1a7a59c640 1 --2- 172.21.15.19:0/3647632161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557b90813370 0x557b90815830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:09.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.128+0000 7f1a7a59c640 1 -- 172.21.15.19:0/3647632161 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b90718340 con 0x557b9080e2e0 2024-09-19T09:00:09.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.128+0000 7f1a79d9b640 1 --2- 172.21.15.19:0/3647632161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557b90813370 0x557b90815830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:09.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.128+0000 7f1a6b7fe640 1 --2- 172.21.15.19:0/1288982358 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1a640a32f0 0x7f1a640a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:09.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.129+0000 7f1a7ad9d640 1 --2- 172.21.15.19:0/1288982358 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1a640a32f0 0x7f1a640a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:09.132 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.129+0000 7f1a7a59c640 1 --2- 172.21.15.19:0/3647632161 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557b9080e2e0 0x557b90812da0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c0d3c60 tx=0x7f1a6c0d3d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9328a7f157b382cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.129+0000 7f1a6b7fe640 1 -- 172.21.15.19:0/1288982358 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1a6c0cfc50 con 0x7f1a7c100a40 2024-09-19T09:00:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.129+0000 7f1a68ff9640 1 -- 172.21.15.19:0/3647632161 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c098520 con 0x557b9080e2e0 2024-09-19T09:00:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.129+0000 7f1a68ff9640 1 -- 172.21.15.19:0/3647632161 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a6c09c980 con 0x557b9080e2e0 2024-09-19T09:00:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.129+0000 7f1a68ff9640 1 -- 172.21.15.19:0/3647632161 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c09bbe0 con 0x557b9080e2e0 2024-09-19T09:00:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.130+0000 7f1a83e15740 1 -- 172.21.15.19:0/3647632161 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557b9080e2e0 msgr2=0x557b90812da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.130+0000 7f1a83e15740 1 --2- 172.21.15.19:0/3647632161 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557b9080e2e0 0x557b90812da0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c0d3c60 tx=0x7f1a6c0d3d50 comp rx=0 tx=0).stop 2024-09-19T09:00:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.130+0000 7f1a7ad9d640 1 --2- 172.21.15.19:0/1288982358 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1a640a32f0 0x7f1a640a57b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1a74005e30 tx=0x7f1a74031bb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.130+0000 7f1a83e15740 1 -- 172.21.15.19:0/3647632161 shutdown_connections 2024-09-19T09:00:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.130+0000 7f1a83e15740 1 --2- 172.21.15.19:0/3647632161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557b90813370 0x557b90815830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.130+0000 7f1a83e15740 1 --2- 172.21.15.19:0/3647632161 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557b9080e2e0 0x557b90812da0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.130+0000 7f1a83e15740 1 --2- 172.21.15.19:0/3647632161 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b9080d9a0 0x557b9080dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.130+0000 7f1a83e15740 1 -- 172.21.15.19:0/3647632161 >> 172.21.15.19:0/3647632161 conn(0x557b90809010 msgr2=0x557b90809410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.130+0000 7f1a83e15740 1 -- 172.21.15.19:0/3647632161 shutdown_connections 2024-09-19T09:00:09.133 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.130+0000 7f1a83e15740 1 -- 172.21.15.19:0/3647632161 wait complete. 2024-09-19T09:00:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.131+0000 7f1a83e15740 1 -- start start 2024-09-19T09:00:09.134 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.131+0000 7f1a83e15740 1 Processor -- start 2024-09-19T09:00:09.137 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.131+0000 7f1a83e15740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557b9080d9a0 0x557b90817c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:09.137 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.131+0000 7f1a83e15740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b9080e2e0 0x557b908181b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:09.137 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.131+0000 7f1a83e15740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557b90813370 0x557b9081f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:09.137 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.131+0000 7f1a83e15740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557b90816340 con 0x557b9080d9a0 2024-09-19T09:00:09.137 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.131+0000 7f1a83e15740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x557b906fa290 con 0x557b90813370 2024-09-19T09:00:09.138 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.131+0000 7f1a83e15740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557b908164c0 con 0x557b9080e2e0 2024-09-19T09:00:09.138 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.131+0000 7f1a83e15740 10 client.0 _ll_register_callbacks cb 0x557b9072b140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:09.138 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.131+0000 7f1a7a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557b9080d9a0 0x557b90817c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:09.138 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.131+0000 7f1a7a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557b9080d9a0 0x557b90817c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43512/0 (socket says 172.21.15.19:43512) 2024-09-19T09:00:09.138 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.131+0000 7f1a7a59c640 1 -- 172.21.15.19:0/2660622775 learned_addr learned my addr 172.21.15.19:0/2660622775 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:09.138 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.131+0000 7f1a79d9b640 1 --2- 172.21.15.19:0/2660622775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b9080e2e0 0x557b908181b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:09.138 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.131+0000 7f1a7ad9d640 1 --2- 172.21.15.19:0/2660622775 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557b90813370 0x557b9081f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:09.138 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.131+0000 7f1a7a59c640 1 -- 172.21.15.19:0/2660622775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b9080e2e0 msgr2=0x557b908181b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:09.138 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.131+0000 7f1a7a59c640 1 --2- 172.21.15.19:0/2660622775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b9080e2e0 0x557b908181b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:09.138 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.131+0000 7f1a7a59c640 1 -- 172.21.15.19:0/2660622775 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557b90813370 msgr2=0x557b9081f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:09.138 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.131+0000 7f1a7a59c640 1 --2- 172.21.15.19:0/2660622775 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557b90813370 0x557b9081f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:09.138 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.131+0000 7f1a7a59c640 1 -- 172.21.15.19:0/2660622775 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b90484210 con 0x557b9080d9a0 2024-09-19T09:00:09.138 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.131+0000 7f1a7ad9d640 1 --2- 172.21.15.19:0/2660622775 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557b90813370 0x557b9081f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:00:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.131+0000 7f1a7a59c640 1 --2- 172.21.15.19:0/2660622775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557b9080d9a0 0x557b90817c70 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c0cdad0 tx=0x7f1a6c0d3fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72c09f913d575283 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.131+0000 7f1a61ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:00:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.132+0000 7f1a61ffb640 1 -- 172.21.15.19:0/2660622775 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c0b5060 con 0x557b9080d9a0 2024-09-19T09:00:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.132+0000 7f1a61ffb640 1 -- 172.21.15.19:0/2660622775 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1a6c09a580 con 0x557b9080d9a0 2024-09-19T09:00:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.132+0000 7f1a83e15740 1 -- 172.21.15.19:0/2660622775 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a6c09c980 con 0x557b9080d9a0 2024-09-19T09:00:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.132+0000 7f1a61ffb640 1 -- 172.21.15.19:0/2660622775 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f1a6c09bdc0 con 0x557b9080d9a0 2024-09-19T09:00:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.132+0000 7f1a83e15740 10 client.17166 fetch_fsmap learned FSMap version 36 2024-09-19T09:00:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.132+0000 7f1a83e15740 1 -- 172.21.15.19:0/2660622775 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x557b90550620 con 0x557b9080d9a0 2024-09-19T09:00:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.132+0000 7f1a61ffb640 1 -- 172.21.15.19:0/2660622775 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a6c09c980 con 0x557b9080d9a0 2024-09-19T09:00:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.132+0000 7f1a61ffb640 1 -- 172.21.15.19:0/2660622775 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f1a6c09c4e0 con 0x557b9080d9a0 2024-09-19T09:00:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.132+0000 7f1a83e15740 10 client.17166 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:00:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.132+0000 7f1a83e15740 10 client.17166 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:00:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.132+0000 7f1a83e15740 20 client.17166 populate_metadata read hostname 'smithi019' 2024-09-19T09:00:09.139 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.132+0000 7f1a83e15740 1 --2- 172.21.15.19:0/2660622775 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557b908234f0 0x557b908258e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.132+0000 7f1a83e15740 4 client.17166 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:00:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.132+0000 7f1a83e15740 1 -- 172.21.15.19:0/2660622775 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b9077ea20 con 0x557b908234f0 2024-09-19T09:00:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.133+0000 7f1a79d9b640 1 --2- 172.21.15.19:0/2660622775 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557b908234f0 0x557b908258e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.133+0000 7f1a79d9b640 1 --2- 172.21.15.19:0/2660622775 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557b908234f0 0x557b908258e0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27bef98036e14b11 server_cookie=6fdd5467982d1768 in_seq=0 out_seq=0 2024-09-19T09:00:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.133+0000 7f1a61ffb640 10 client.17166 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:00:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.136+0000 7f1a61ffb640 1 -- 172.21.15.19:0/2660622775 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557b9077ea20 con 0x557b908234f0 2024-09-19T09:00:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.136+0000 7f1a61ffb640 10 client.17166 handle_command_reply: tid=0 2024-09-19T09:00:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.136+0000 7f1a83e15740 1 client.17166 shutdown 2024-09-19T09:00:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.136+0000 7f1a83e15740 1 -- 172.21.15.19:0/2660622775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557b9080d9a0 msgr2=0x557b90817c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.136+0000 7f1a83e15740 1 --2- 172.21.15.19:0/2660622775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557b9080d9a0 0x557b90817c70 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c0cdad0 tx=0x7f1a6c0d3fa0 comp rx=0 tx=0).stop 2024-09-19T09:00:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.136+0000 7f1a83e15740 1 -- 172.21.15.19:0/2660622775 shutdown_connections 2024-09-19T09:00:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.136+0000 7f1a83e15740 1 --2- 172.21.15.19:0/2660622775 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557b908234f0 0x557b908258e0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.136+0000 7f1a83e15740 1 --2- 172.21.15.19:0/2660622775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b9080e2e0 0x557b908181b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:09.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.136+0000 7f1a83e15740 1 --2- 172.21.15.19:0/2660622775 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557b90813370 0x557b9081f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:09.141 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.136+0000 7f1a61ffb640 0 client.17166 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:00:09.141 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.136+0000 7f1a83e15740 1 --2- 172.21.15.19:0/2660622775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557b9080d9a0 0x557b90817c70 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:09.141 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.136+0000 7f1a83e15740 1 -- 172.21.15.19:0/2660622775 >> 172.21.15.19:0/2660622775 conn(0x557b90809010 msgr2=0x557b9080a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:09.141 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.136+0000 7f1a83e15740 1 -- 172.21.15.19:0/2660622775 shutdown_connections 2024-09-19T09:00:09.141 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.136+0000 7f1a83e15740 1 -- 172.21.15.19:0/2660622775 wait complete. 2024-09-19T09:00:09.141 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.136+0000 7f1a83e15740 20 client.17166 trim_cache size 0 max 16384 2024-09-19T09:00:09.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.151+0000 7f1a83e15740 1 Processor -- start 2024-09-19T09:00:09.156 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.151+0000 7f1a83e15740 1 -- start start 2024-09-19T09:00:09.156 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.152+0000 7f1a83e15740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b9080d9a0 0x557b90818130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:09.156 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.152+0000 7f1a83e15740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557b9080e2e0 0x557b9081f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:09.156 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.152+0000 7f1a83e15740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557b90813370 0x557b908079a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:09.156 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.152+0000 7f1a83e15740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7c1a8fe0 con 0x557b9080e2e0 2024-09-19T09:00:09.156 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.152+0000 7f1a83e15740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7c1aab20 con 0x557b90813370 2024-09-19T09:00:09.156 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.152+0000 7f1a83e15740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7c1a96b0 con 0x557b9080d9a0 2024-09-19T09:00:09.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.152+0000 7f1a79d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557b9080e2e0 0x557b9081f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:09.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.152+0000 7f1a79d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557b9080e2e0 0x557b9081f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43518/0 (socket says 172.21.15.19:43518) 2024-09-19T09:00:09.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.152+0000 7f1a79d9b640 1 -- 172.21.15.19:0/2407108215 learned_addr learned my addr 172.21.15.19:0/2407108215 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:09.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.152+0000 7f1a7ad9d640 1 --2- 172.21.15.19:0/2407108215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557b90813370 0x557b908079a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:09.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.152+0000 7f1a7a59c640 1 --2- 172.21.15.19:0/2407108215 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b9080d9a0 0x557b90818130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:09.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.152+0000 7f1a79d9b640 1 -- 172.21.15.19:0/2407108215 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b9080d9a0 msgr2=0x557b90818130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:09.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.152+0000 7f1a79d9b640 1 --2- 172.21.15.19:0/2407108215 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b9080d9a0 0x557b90818130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:09.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.152+0000 7f1a79d9b640 1 -- 172.21.15.19:0/2407108215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557b90813370 msgr2=0x557b908079a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:09.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.152+0000 7f1a79d9b640 1 --2- 172.21.15.19:0/2407108215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557b90813370 0x557b908079a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:09.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.152+0000 7f1a79d9b640 1 -- 172.21.15.19:0/2407108215 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b908127b0 con 0x557b9080e2e0 2024-09-19T09:00:09.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.152+0000 7f1a7ad9d640 1 --2- 172.21.15.19:0/2407108215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557b90813370 0x557b908079a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:09.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.152+0000 7f1a79d9b640 1 --2- 172.21.15.19:0/2407108215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557b9080e2e0 0x557b9081f180 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c06a1c0 tx=0x7f1a700044d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b64ae3c1044c7bf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:09.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.153+0000 7f1a63fff640 1 -- 172.21.15.19:0/2407108215 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a70003e20 con 0x557b9080e2e0 2024-09-19T09:00:09.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.153+0000 7f1a63fff640 1 -- 172.21.15.19:0/2407108215 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a70010910 con 0x557b9080e2e0 2024-09-19T09:00:09.158 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.153+0000 7f1a63fff640 1 -- 172.21.15.19:0/2407108215 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a7001eac0 con 0x557b9080e2e0 2024-09-19T09:00:09.161 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.153+0000 7f1a83e15740 1 -- 172.21.15.19:0/2407108215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557b9080e2e0 msgr2=0x557b9081f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:09.161 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.153+0000 7f1a83e15740 1 --2- 172.21.15.19:0/2407108215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557b9080e2e0 0x557b9081f180 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f1a7c06a1c0 tx=0x7f1a700044d0 comp rx=0 tx=0).stop 2024-09-19T09:00:09.161 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.153+0000 7f1a83e15740 1 -- 172.21.15.19:0/2407108215 shutdown_connections 2024-09-19T09:00:09.161 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.153+0000 7f1a83e15740 1 --2- 172.21.15.19:0/2407108215 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557b90813370 0x557b908079a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:09.161 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.153+0000 7f1a83e15740 1 --2- 172.21.15.19:0/2407108215 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557b9080e2e0 0x557b9081f180 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:09.161 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.153+0000 7f1a83e15740 1 --2- 172.21.15.19:0/2407108215 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b9080d9a0 0x557b90818130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:09.161 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.153+0000 7f1a83e15740 1 -- 172.21.15.19:0/2407108215 >> 172.21.15.19:0/2407108215 conn(0x557b90809010 msgr2=0x557b90817a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:09.161 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.154+0000 7f1a83e15740 1 -- 172.21.15.19:0/2407108215 shutdown_connections 2024-09-19T09:00:09.161 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.154+0000 7f1a83e15740 1 -- 172.21.15.19:0/2407108215 wait complete. 2024-09-19T09:00:09.161 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.154+0000 7f1a83e15740 1 -- start start 2024-09-19T09:00:09.161 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.154+0000 7f1a83e15740 1 Processor -- start 2024-09-19T09:00:09.161 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.154+0000 7f1a83e15740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557b9080d9a0 0x557b9081c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.154+0000 7f1a83e15740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557b9080e2e0 0x557b9081cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.154+0000 7f1a83e15740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b90813370 0x557b9081df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.154+0000 7f1a83e15740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7c1aa450 con 0x557b9080d9a0 2024-09-19T09:00:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.154+0000 7f1a83e15740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7c1a9d80 con 0x557b9080e2e0 2024-09-19T09:00:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.154+0000 7f1a83e15740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7c1a6fc0 con 0x557b90813370 2024-09-19T09:00:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.154+0000 7f1a83e15740 10 client.0 _ll_register_callbacks cb 0x7f1a700097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.154+0000 7f1a7a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557b9080d9a0 0x557b9081c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.154+0000 7f1a7a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557b9080d9a0 0x557b9081c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43522/0 (socket says 172.21.15.19:43522) 2024-09-19T09:00:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.154+0000 7f1a7a59c640 1 -- 172.21.15.19:0/2423042767 learned_addr learned my addr 172.21.15.19:0/2423042767 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.154+0000 7f1a79d9b640 1 --2- 172.21.15.19:0/2423042767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557b9080e2e0 0x557b9081cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.154+0000 7f1a7ad9d640 1 --2- 172.21.15.19:0/2423042767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b90813370 0x557b9081df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.154+0000 7f1a7a59c640 1 -- 172.21.15.19:0/2423042767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b90813370 msgr2=0x557b9081df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.154+0000 7f1a7a59c640 1 --2- 172.21.15.19:0/2423042767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b90813370 0x557b9081df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:09.162 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.154+0000 7f1a7a59c640 1 -- 172.21.15.19:0/2423042767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557b9080e2e0 msgr2=0x557b9081cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.154+0000 7f1a7a59c640 1 --2- 172.21.15.19:0/2423042767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557b9080e2e0 0x557b9081cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.155+0000 7f1a7a59c640 1 -- 172.21.15.19:0/2423042767 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b9081e510 con 0x557b9080d9a0 2024-09-19T09:00:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.155+0000 7f1a7a59c640 1 --2- 172.21.15.19:0/2423042767 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557b9080d9a0 0x557b9081c9b0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c0986e0 tx=0x7f1a6c003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5255efcdc6b6113 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.155+0000 7f1a61ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:00:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.155+0000 7f1a61ffb640 1 -- 172.21.15.19:0/2423042767 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a6c0b5040 con 0x557b9080d9a0 2024-09-19T09:00:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.155+0000 7f1a61ffb640 1 -- 172.21.15.19:0/2423042767 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1a6c0a0170 con 0x557b9080d9a0 2024-09-19T09:00:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.155+0000 7f1a83e15740 1 -- 172.21.15.19:0/2423042767 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a70010910 con 0x557b9080d9a0 2024-09-19T09:00:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.155+0000 7f1a61ffb640 1 -- 172.21.15.19:0/2423042767 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f1a6c09c050 con 0x557b9080d9a0 2024-09-19T09:00:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.155+0000 7f1a83e15740 10 client.17172 fetch_fsmap learned FSMap version 36 2024-09-19T09:00:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.155+0000 7f1a83e15740 1 -- 172.21.15.19:0/2423042767 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x557b9088e060 con 0x557b9080d9a0 2024-09-19T09:00:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.155+0000 7f1a61ffb640 1 -- 172.21.15.19:0/2423042767 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a70010910 con 0x557b9080d9a0 2024-09-19T09:00:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.155+0000 7f1a61ffb640 1 -- 172.21.15.19:0/2423042767 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f1a6c0bc0b0 con 0x557b9080d9a0 2024-09-19T09:00:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.155+0000 7f1a83e15740 10 client.17172 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:00:09.163 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.156+0000 7f1a83e15740 10 client.17172 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:00:09.164 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.156+0000 7f1a83e15740 20 client.17172 populate_metadata read hostname 'smithi019' 2024-09-19T09:00:09.164 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.156+0000 7f1a83e15740 1 --2- 172.21.15.19:0/2423042767 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557b9088e680 0x557b90890a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:09.164 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.156+0000 7f1a83e15740 4 client.17172 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:00:09.164 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.156+0000 7f1a83e15740 1 -- 172.21.15.19:0/2423042767 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557b90778d70 con 0x557b9088e680 2024-09-19T09:00:09.164 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.156+0000 7f1a79d9b640 1 --2- 172.21.15.19:0/2423042767 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557b9088e680 0x557b90890a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:09.164 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.156+0000 7f1a79d9b640 1 --2- 172.21.15.19:0/2423042767 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557b9088e680 0x557b90890a70 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e604203219aea287 server_cookie=919fabc24d0e8ea4 in_seq=0 out_seq=0 2024-09-19T09:00:09.164 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:09.156+0000 7f1a61ffb640 10 client.17172 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:00:10.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:09 smithi019 ceph-mon[30976]: pgmap v575: 97 pgs: 97 active+clean; 29 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 431 op/s 2024-09-19T09:00:10.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:09 smithi155 ceph-mon[34921]: pgmap v575: 97 pgs: 97 active+clean; 29 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 431 op/s 2024-09-19T09:00:10.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:09 smithi203 ceph-mon[35450]: pgmap v575: 97 pgs: 97 active+clean; 29 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 431 op/s 2024-09-19T09:00:12.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:11 smithi019 ceph-mon[30976]: pgmap v576: 97 pgs: 97 active+clean; 29 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1007 KiB/s wr, 362 op/s 2024-09-19T09:00:12.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:11 smithi155 ceph-mon[34921]: pgmap v576: 97 pgs: 97 active+clean; 29 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1007 KiB/s wr, 362 op/s 2024-09-19T09:00:12.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:11 smithi203 ceph-mon[35450]: pgmap v576: 97 pgs: 97 active+clean; 29 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1007 KiB/s wr, 362 op/s 2024-09-19T09:00:12.935 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:00:13.208 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:13.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.866+0000 7f91d10bc640 1 -- 172.21.15.19:0/3066352567 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91cc11b140 msgr2=0x7f91cc11d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:13.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.866+0000 7f91d10bc640 1 --2- 172.21.15.19:0/3066352567 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91cc11b140 0x7f91cc11d530 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f91c401acb0 tx=0x7f91c403b900 comp rx=0 tx=0).stop 2024-09-19T09:00:13.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.867+0000 7f91d10bc640 1 -- 172.21.15.19:0/3066352567 shutdown_connections 2024-09-19T09:00:13.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.867+0000 7f91d10bc640 1 --2- 172.21.15.19:0/3066352567 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91cc109830 0x7f91cc109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.867+0000 7f91d10bc640 1 --2- 172.21.15.19:0/3066352567 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91cc11b140 0x7f91cc11d530 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.867+0000 7f91d10bc640 1 --2- 172.21.15.19:0/3066352567 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91cc109450 0x7f91cc110250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.867+0000 7f91d10bc640 1 -- 172.21.15.19:0/3066352567 >> 172.21.15.19:0/3066352567 conn(0x7f91cc06e140 msgr2=0x7f91cc06e550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:13.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.870+0000 7f91d10bc640 1 -- 172.21.15.19:0/3066352567 shutdown_connections 2024-09-19T09:00:13.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.870+0000 7f91d10bc640 1 -- 172.21.15.19:0/3066352567 wait complete. 2024-09-19T09:00:13.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.871+0000 7f91d10bc640 1 Processor -- start 2024-09-19T09:00:13.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.871+0000 7f91d10bc640 1 -- start start 2024-09-19T09:00:13.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.872+0000 7f91d10bc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91cc109450 0x7f91cc11a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:13.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.872+0000 7f91d10bc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91cc109830 0x7f91cc1169b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:13.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.872+0000 7f91d10bc640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91cc11b140 0x7f91cc116ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:13.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.872+0000 7f91d10bc640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f91cc113370 con 0x7f91cc109830 2024-09-19T09:00:13.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.872+0000 7f91d10bc640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f91cc1131f0 con 0x7f91cc109450 2024-09-19T09:00:13.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.873+0000 7f91cb59e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91cc11b140 0x7f91cc116ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:13.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.873+0000 7f91cb59e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91cc11b140 0x7f91cc116ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:58606/0 (socket says 172.21.15.19:58606) 2024-09-19T09:00:13.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.873+0000 7f91cb59e640 1 -- 172.21.15.19:0/3703617201 learned_addr learned my addr 172.21.15.19:0/3703617201 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:13.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.873+0000 7f91d10bc640 1 -- 172.21.15.19:0/3703617201 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f91cc1134f0 con 0x7f91cc11b140 2024-09-19T09:00:13.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.873+0000 7f91ca59c640 1 --2- 172.21.15.19:0/3703617201 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91cc109830 0x7f91cc1169b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:13.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.873+0000 7f91cad9d640 1 --2- 172.21.15.19:0/3703617201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91cc109450 0x7f91cc11a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:13.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.874+0000 7f91cb59e640 1 -- 172.21.15.19:0/3703617201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91cc109450 msgr2=0x7f91cc11a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:13.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.874+0000 7f91cb59e640 1 --2- 172.21.15.19:0/3703617201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91cc109450 0x7f91cc11a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.874+0000 7f91cb59e640 1 -- 172.21.15.19:0/3703617201 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91cc109830 msgr2=0x7f91cc1169b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:13.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.874+0000 7f91cb59e640 1 --2- 172.21.15.19:0/3703617201 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91cc109830 0x7f91cc1169b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.874+0000 7f91cb59e640 1 -- 172.21.15.19:0/3703617201 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91cc117620 con 0x7f91cc11b140 2024-09-19T09:00:13.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.874+0000 7f91cb59e640 1 --2- 172.21.15.19:0/3703617201 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91cc11b140 0x7f91cc116ef0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f91c40405d0 tx=0x7f91c4040600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:13.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.874+0000 7f91ca59c640 1 --2- 172.21.15.19:0/3703617201 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91cc109830 0x7f91cc1169b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:13.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.874+0000 7f91b3fff640 1 -- 172.21.15.19:0/3703617201 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c4012070 con 0x7f91cc11b140 2024-09-19T09:00:13.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.874+0000 7f91b3fff640 1 -- 172.21.15.19:0/3703617201 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91c4003e50 con 0x7f91cc11b140 2024-09-19T09:00:13.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.874+0000 7f91b3fff640 1 -- 172.21.15.19:0/3703617201 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c4045020 con 0x7f91cc11b140 2024-09-19T09:00:13.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.874+0000 7f91d10bc640 1 -- 172.21.15.19:0/3703617201 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91cc1cd180 con 0x7f91cc11b140 2024-09-19T09:00:13.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.874+0000 7f91d10bc640 1 -- 172.21.15.19:0/3703617201 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91cc1cd520 con 0x7f91cc11b140 2024-09-19T09:00:13.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.877+0000 7f91b3fff640 1 -- 172.21.15.19:0/3703617201 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f91c4015070 con 0x7f91cc11b140 2024-09-19T09:00:13.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.878+0000 7f91d3495740 1 Processor -- start 2024-09-19T09:00:13.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.878+0000 7f91d3495740 1 -- start start 2024-09-19T09:00:13.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.878+0000 7f91d3495740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cca6adb4a0 0x55cca6adb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:13.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.878+0000 7f91d3495740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cca6adbdc0 0x55cca6ae6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:13.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.878+0000 7f91d3495740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cca6ae6680 0x55cca6ae8a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:13.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.878+0000 7f91d3495740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55cca6a412e0 con 0x55cca6ae6680 2024-09-19T09:00:13.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.878+0000 7f91d3495740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55cca69e8ce0 con 0x55cca6adbdc0 2024-09-19T09:00:13.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.878+0000 7f91d3495740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55cca6a3d2a0 con 0x55cca6adb4a0 2024-09-19T09:00:13.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.878+0000 7f91ca59c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cca6adb4a0 0x55cca6adb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:13.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.878+0000 7f91ca59c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cca6adb4a0 0x55cca6adb880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:58620/0 (socket says 172.21.15.19:58620) 2024-09-19T09:00:13.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.878+0000 7f91ca59c640 1 -- 172.21.15.19:0/613833367 learned_addr learned my addr 172.21.15.19:0/613833367 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:13.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.878+0000 7f91cad9d640 1 --2- 172.21.15.19:0/613833367 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cca6adbdc0 0x55cca6ae6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:13.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.878+0000 7f91ca59c640 1 --2- 172.21.15.19:0/613833367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cca6ae6680 0x55cca6ae8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:13.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.879+0000 7f91b3fff640 1 --2- 172.21.15.19:0/3703617201 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f91b40a32c0 0x7f91b40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:13.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.879+0000 7f91ca59c640 1 -- 172.21.15.19:0/613833367 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cca6adbdc0 msgr2=0x55cca6ae6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:13.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.879+0000 7f91ca59c640 1 --2- 172.21.15.19:0/613833367 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cca6adbdc0 0x55cca6ae6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.879+0000 7f91ca59c640 1 -- 172.21.15.19:0/613833367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cca6ae6680 msgr2=0x55cca6ae8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:13.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.879+0000 7f91ca59c640 1 --2- 172.21.15.19:0/613833367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cca6ae6680 0x55cca6ae8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.879+0000 7f91ca59c640 1 -- 172.21.15.19:0/613833367 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cca69cd440 con 0x55cca6adb4a0 2024-09-19T09:00:13.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.879+0000 7f91b3fff640 1 -- 172.21.15.19:0/3703617201 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f91c40f0df0 con 0x7f91cc11b140 2024-09-19T09:00:13.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.879+0000 7f91cb59e640 1 --2- 172.21.15.19:0/3703617201 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f91b40a32c0 0x7f91b40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:13.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.879+0000 7f91ca59c640 1 --2- 172.21.15.19:0/613833367 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cca6adb4a0 0x55cca6adb880 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f91bc015a40 tx=0x7f91bc0098b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=968c47414d058367 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:13.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.879+0000 7f91b17fa640 1 -- 172.21.15.19:0/613833367 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91bc00e8a0 con 0x55cca6adb4a0 2024-09-19T09:00:13.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.879+0000 7f91cb59e640 1 --2- 172.21.15.19:0/3703617201 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f91b40a32c0 0x7f91b40a5780 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f91c40b9820 tx=0x7f91c4040820 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:13.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.880+0000 7f91b17fa640 1 -- 172.21.15.19:0/613833367 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91bc018450 con 0x55cca6adb4a0 2024-09-19T09:00:13.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.880+0000 7f91b17fa640 1 -- 172.21.15.19:0/613833367 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91bc017440 con 0x55cca6adb4a0 2024-09-19T09:00:13.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.880+0000 7f91d3495740 1 -- 172.21.15.19:0/613833367 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cca6adb4a0 msgr2=0x55cca6adb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:13.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.880+0000 7f91d3495740 1 --2- 172.21.15.19:0/613833367 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cca6adb4a0 0x55cca6adb880 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f91bc015a40 tx=0x7f91bc0098b0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.880+0000 7f91d3495740 1 -- 172.21.15.19:0/613833367 shutdown_connections 2024-09-19T09:00:13.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.880+0000 7f91d3495740 1 --2- 172.21.15.19:0/613833367 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cca6ae6680 0x55cca6ae8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.880+0000 7f91d3495740 1 --2- 172.21.15.19:0/613833367 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cca6adbdc0 0x55cca6ae6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.880+0000 7f91d3495740 1 --2- 172.21.15.19:0/613833367 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cca6adb4a0 0x55cca6adb880 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.880+0000 7f91d3495740 1 -- 172.21.15.19:0/613833367 >> 172.21.15.19:0/613833367 conn(0x55cca6ad7a30 msgr2=0x55cca6ad7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:13.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.880+0000 7f91d3495740 1 -- 172.21.15.19:0/613833367 shutdown_connections 2024-09-19T09:00:13.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.881+0000 7f91d3495740 1 -- 172.21.15.19:0/613833367 wait complete. 2024-09-19T09:00:13.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.881+0000 7f91d3495740 1 -- start start 2024-09-19T09:00:13.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.881+0000 7f91d3495740 1 Processor -- start 2024-09-19T09:00:13.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.881+0000 7f91d3495740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cca6adb4a0 0x55cca6ae6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:13.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.881+0000 7f91d3495740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cca6adbdc0 0x55cca6ae3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:13.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.881+0000 7f91d3495740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cca6ae6680 0x55cca6ae38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:13.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.881+0000 7f91d3495740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55cca6ae9250 con 0x55cca6ae6680 2024-09-19T09:00:13.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.881+0000 7f91d3495740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55cca69fc050 con 0x55cca6adbdc0 2024-09-19T09:00:13.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.881+0000 7f91d3495740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55cca6ae93d0 con 0x55cca6adb4a0 2024-09-19T09:00:13.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.881+0000 7f91d3495740 10 client.0 _ll_register_callbacks cb 0x55cca6a3c160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:13.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.881+0000 7f91cad9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cca6adbdc0 0x55cca6ae3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:13.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.881+0000 7f91cad9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cca6adbdc0 0x55cca6ae3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:33848/0 (socket says 172.21.15.19:33848) 2024-09-19T09:00:13.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.881+0000 7f91cad9d640 1 -- 172.21.15.19:0/2675011239 learned_addr learned my addr 172.21.15.19:0/2675011239 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:13.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.882+0000 7f91ca59c640 1 --2- 172.21.15.19:0/2675011239 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cca6adb4a0 0x55cca6ae6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:13.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.882+0000 7f91cad9d640 1 -- 172.21.15.19:0/2675011239 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cca6adb4a0 msgr2=0x55cca6ae6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:13.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.882+0000 7f91cad9d640 1 --2- 172.21.15.19:0/2675011239 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cca6adb4a0 0x55cca6ae6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.882+0000 7f91cad9d640 1 -- 172.21.15.19:0/2675011239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cca6ae6680 msgr2=0x55cca6ae38e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:00:13.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.882+0000 7f91cad9d640 1 --2- 172.21.15.19:0/2675011239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cca6ae6680 0x55cca6ae38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.882+0000 7f91cad9d640 1 -- 172.21.15.19:0/2675011239 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cca67b23c0 con 0x55cca6adbdc0 2024-09-19T09:00:13.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.882+0000 7f91cad9d640 1 --2- 172.21.15.19:0/2675011239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cca6adbdc0 0x55cca6ae3310 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f91c00104d0 tx=0x7f91c0010990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da468c29322130e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:13.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.882+0000 7f91aeff5640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T09:00:13.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.882+0000 7f91aeff5640 1 -- 172.21.15.19:0/2675011239 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c001a020 con 0x55cca6adbdc0 2024-09-19T09:00:13.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.882+0000 7f91d3495740 1 -- 172.21.15.19:0/2675011239 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91bc018450 con 0x55cca6adbdc0 2024-09-19T09:00:13.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.882+0000 7f91aeff5640 1 -- 172.21.15.19:0/2675011239 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f91c0016690 con 0x55cca6adbdc0 2024-09-19T09:00:13.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.883+0000 7f91aeff5640 1 -- 172.21.15.19:0/2675011239 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f91c0016890 con 0x55cca6adbdc0 2024-09-19T09:00:13.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.883+0000 7f91d3495740 10 client.26660 fetch_fsmap learned FSMap version 36 2024-09-19T09:00:13.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.883+0000 7f91d3495740 1 -- 172.21.15.19:0/2675011239 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55cca6af4cf0 con 0x55cca6adbdc0 2024-09-19T09:00:13.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.883+0000 7f91aeff5640 1 -- 172.21.15.19:0/2675011239 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91bc018450 con 0x55cca6adbdc0 2024-09-19T09:00:13.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.883+0000 7f91aeff5640 1 -- 172.21.15.19:0/2675011239 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f91c0014c70 con 0x55cca6adbdc0 2024-09-19T09:00:13.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.883+0000 7f91d3495740 10 client.26660 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:00:13.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.883+0000 7f91d3495740 10 client.26660 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:00:13.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.883+0000 7f91d3495740 20 client.26660 populate_metadata read hostname 'smithi019' 2024-09-19T09:00:13.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.883+0000 7f91d3495740 1 --2- 172.21.15.19:0/2675011239 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55cca6af6250 0x55cca6af8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:13.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.883+0000 7f91d3495740 4 client.26660 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:00:13.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.883+0000 7f91d3495740 1 -- 172.21.15.19:0/2675011239 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cca6a4e850 con 0x55cca6af6250 2024-09-19T09:00:13.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.884+0000 7f91ca59c640 1 --2- 172.21.15.19:0/2675011239 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55cca6af6250 0x55cca6af8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:13.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.884+0000 7f91aeff5640 10 client.26660 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:00:13.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.884+0000 7f91ca59c640 1 --2- 172.21.15.19:0/2675011239 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55cca6af6250 0x55cca6af8690 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4298836dcb58510f server_cookie=2bfa4f88cd0e875d in_seq=0 out_seq=0 2024-09-19T09:00:13.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.889+0000 7f91aeff5640 1 -- 172.21.15.19:0/2675011239 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cca6a4e850 con 0x55cca6af6250 2024-09-19T09:00:13.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.889+0000 7f91aeff5640 10 client.26660 handle_command_reply: tid=0 2024-09-19T09:00:13.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.889+0000 7f91d3495740 1 client.26660 shutdown 2024-09-19T09:00:13.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.889+0000 7f91d3495740 1 -- 172.21.15.19:0/2675011239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cca6adbdc0 msgr2=0x55cca6ae3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:13.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.889+0000 7f91d3495740 1 --2- 172.21.15.19:0/2675011239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cca6adbdc0 0x55cca6ae3310 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f91c00104d0 tx=0x7f91c0010990 comp rx=0 tx=0).stop 2024-09-19T09:00:13.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.889+0000 7f91d3495740 1 -- 172.21.15.19:0/2675011239 shutdown_connections 2024-09-19T09:00:13.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.889+0000 7f91d3495740 1 --2- 172.21.15.19:0/2675011239 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55cca6af6250 0x55cca6af8690 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.889+0000 7f91d3495740 1 --2- 172.21.15.19:0/2675011239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cca6ae6680 0x55cca6ae38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.889+0000 7f91aeff5640 0 client.26660 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:00:13.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.889+0000 7f91d3495740 1 --2- 172.21.15.19:0/2675011239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cca6adbdc0 0x55cca6ae3310 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.889+0000 7f91d3495740 1 --2- 172.21.15.19:0/2675011239 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cca6adb4a0 0x55cca6ae6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.889+0000 7f91d3495740 1 -- 172.21.15.19:0/2675011239 >> 172.21.15.19:0/2675011239 conn(0x55cca6ad7a30 msgr2=0x55cca6add710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:13.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.890+0000 7f91d3495740 1 -- 172.21.15.19:0/2675011239 shutdown_connections 2024-09-19T09:00:13.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.890+0000 7f91d3495740 1 -- 172.21.15.19:0/2675011239 wait complete. 2024-09-19T09:00:13.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.890+0000 7f91d3495740 20 client.26660 trim_cache size 0 max 16384 2024-09-19T09:00:13.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.927+0000 7f91d3495740 1 Processor -- start 2024-09-19T09:00:13.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.927+0000 7f91d3495740 1 -- start start 2024-09-19T09:00:13.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.927+0000 7f91d3495740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cca6adb4a0 0x55cca6ae2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:13.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.927+0000 7f91d3495740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cca6adbdc0 0x55cca6af24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:13.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.927+0000 7f91d3495740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cca6ae6680 0x55cca6ad7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:13.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.927+0000 7f91d3495740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f91cc1d5bf0 con 0x55cca6adb4a0 2024-09-19T09:00:13.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.927+0000 7f91d3495740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f91cc1d7730 con 0x55cca6ae6680 2024-09-19T09:00:13.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.927+0000 7f91d3495740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f91cc1d62c0 con 0x55cca6adbdc0 2024-09-19T09:00:13.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.927+0000 7f91cad9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cca6adbdc0 0x55cca6af24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:13.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.927+0000 7f91cad9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cca6adbdc0 0x55cca6af24b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:58652/0 (socket says 172.21.15.19:58652) 2024-09-19T09:00:13.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.927+0000 7f91cad9d640 1 -- 172.21.15.19:0/3454698590 learned_addr learned my addr 172.21.15.19:0/3454698590 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:13.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.927+0000 7f91cad9d640 1 -- 172.21.15.19:0/3454698590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cca6ae6680 msgr2=0x55cca6ad7e10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:00:13.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.927+0000 7f91cad9d640 1 --2- 172.21.15.19:0/3454698590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cca6ae6680 0x55cca6ad7e10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.927+0000 7f91cad9d640 1 -- 172.21.15.19:0/3454698590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cca6adb4a0 msgr2=0x55cca6ae2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:13.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.927+0000 7f91cad9d640 1 --2- 172.21.15.19:0/3454698590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cca6adb4a0 0x55cca6ae2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.927+0000 7f91cad9d640 1 -- 172.21.15.19:0/3454698590 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cca6ae63d0 con 0x55cca6adbdc0 2024-09-19T09:00:13.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.928+0000 7f91cad9d640 1 --2- 172.21.15.19:0/3454698590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cca6adbdc0 0x55cca6af24b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f91c0000c00 tx=0x7f91c000b2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e95f3c5b316dc4d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:13.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.928+0000 7f91b0ff9640 1 -- 172.21.15.19:0/3454698590 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c001a040 con 0x55cca6adbdc0 2024-09-19T09:00:13.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.928+0000 7f91b0ff9640 1 -- 172.21.15.19:0/3454698590 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f91c000bd80 con 0x55cca6adbdc0 2024-09-19T09:00:13.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.928+0000 7f91b0ff9640 1 -- 172.21.15.19:0/3454698590 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c002a440 con 0x55cca6adbdc0 2024-09-19T09:00:13.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.929+0000 7f91d3495740 1 -- 172.21.15.19:0/3454698590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cca6adbdc0 msgr2=0x55cca6af24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:13.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.929+0000 7f91d3495740 1 --2- 172.21.15.19:0/3454698590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cca6adbdc0 0x55cca6af24b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f91c0000c00 tx=0x7f91c000b2e0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.929+0000 7f91d3495740 1 -- 172.21.15.19:0/3454698590 shutdown_connections 2024-09-19T09:00:13.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.929+0000 7f91d3495740 1 --2- 172.21.15.19:0/3454698590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cca6adbdc0 0x55cca6af24b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.929+0000 7f91d3495740 1 --2- 172.21.15.19:0/3454698590 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cca6ae6680 0x55cca6ad7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.929+0000 7f91d3495740 1 --2- 172.21.15.19:0/3454698590 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cca6adb4a0 0x55cca6ae2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.929+0000 7f91d3495740 1 -- 172.21.15.19:0/3454698590 >> 172.21.15.19:0/3454698590 conn(0x55cca6ad7a30 msgr2=0x55cca6ae2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:13.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.929+0000 7f91d3495740 1 -- 172.21.15.19:0/3454698590 shutdown_connections 2024-09-19T09:00:13.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.929+0000 7f91d3495740 1 -- 172.21.15.19:0/3454698590 wait complete. 2024-09-19T09:00:13.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.929+0000 7f91d3495740 1 -- start start 2024-09-19T09:00:13.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.929+0000 7f91d3495740 1 Processor -- start 2024-09-19T09:00:13.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.930+0000 7f91d3495740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cca6adb4a0 0x55cca6aeeae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:13.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.930+0000 7f91d3495740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cca6adbdc0 0x55cca6ae9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:13.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.930+0000 7f91d3495740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cca6ae6680 0x55cca6aea350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:13.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.930+0000 7f91ca59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cca6ae6680 0x55cca6aea350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:13.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.930+0000 7f91cad9d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cca6adbdc0 0x55cca6ae9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:13.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.930+0000 7f91ca59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cca6ae6680 0x55cca6aea350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43578/0 (socket says 172.21.15.19:43578) 2024-09-19T09:00:13.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.930+0000 7f91ca59c640 1 -- 172.21.15.19:0/4020129013 learned_addr learned my addr 172.21.15.19:0/4020129013 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:13.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.930+0000 7f91d3495740 1 -- 172.21.15.19:0/4020129013 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f91cc1d7060 con 0x55cca6ae6680 2024-09-19T09:00:13.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.930+0000 7f91d3495740 1 -- 172.21.15.19:0/4020129013 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f91cc1d6990 con 0x55cca6adb4a0 2024-09-19T09:00:13.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.930+0000 7f91d3495740 1 -- 172.21.15.19:0/4020129013 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f91cc1d3bd0 con 0x55cca6adbdc0 2024-09-19T09:00:13.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.931+0000 7f91cad9d640 1 -- 172.21.15.19:0/4020129013 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cca6adb4a0 msgr2=0x55cca6aeeae0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:00:13.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.931+0000 7f91cad9d640 1 --2- 172.21.15.19:0/4020129013 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cca6adb4a0 0x55cca6aeeae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.931+0000 7f91cad9d640 1 -- 172.21.15.19:0/4020129013 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cca6ae6680 msgr2=0x55cca6aea350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:13.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.931+0000 7f91cad9d640 1 --2- 172.21.15.19:0/4020129013 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cca6ae6680 0x55cca6aea350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.931+0000 7f91cad9d640 1 -- 172.21.15.19:0/4020129013 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cca6aea8c0 con 0x55cca6adbdc0 2024-09-19T09:00:13.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.931+0000 7f91ca59c640 1 --2- 172.21.15.19:0/4020129013 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cca6ae6680 0x55cca6aea350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:13.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.931+0000 7f91d3495740 10 client.0 _ll_register_callbacks cb 0x7f91c000b520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:13.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.931+0000 7f91d3495740 1 -- 172.21.15.19:0/4020129013 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91c000bd80 con 0x55cca6adbdc0 2024-09-19T09:00:13.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.931+0000 7f91cad9d640 1 --2- 172.21.15.19:0/4020129013 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cca6adbdc0 0x55cca6ae9e10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f91c0021570 tx=0x7f91c0021910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=172dacf292b46f06 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:13.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.931+0000 7f91aeff5640 10 client.26572 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T09:00:13.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.931+0000 7f91aeff5640 1 -- 172.21.15.19:0/4020129013 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91c0039050 con 0x55cca6adbdc0 2024-09-19T09:00:13.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.931+0000 7f91aeff5640 1 -- 172.21.15.19:0/4020129013 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f91c002a640 con 0x55cca6adbdc0 2024-09-19T09:00:13.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.931+0000 7f91aeff5640 1 -- 172.21.15.19:0/4020129013 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f91c001a040 con 0x55cca6adbdc0 2024-09-19T09:00:13.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.931+0000 7f91d3495740 10 client.26572 fetch_fsmap learned FSMap version 36 2024-09-19T09:00:13.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.931+0000 7f91d3495740 1 -- 172.21.15.19:0/4020129013 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({fsmap=36}) -- 0x55cca6b60a80 con 0x55cca6adbdc0 2024-09-19T09:00:13.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.932+0000 7f91aeff5640 1 -- 172.21.15.19:0/4020129013 <== mon.1 v2:172.21.15.203:3300/0 4 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f91c002a840 con 0x55cca6adbdc0 2024-09-19T09:00:13.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.932+0000 7f91d3495740 10 client.26572 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:00:13.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.932+0000 7f91d3495740 10 client.26572 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:00:13.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.932+0000 7f91d3495740 20 client.26572 populate_metadata read hostname 'smithi019' 2024-09-19T09:00:13.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.932+0000 7f91d3495740 1 --2- 172.21.15.19:0/4020129013 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55cca6af6250 0x55cca6b630c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:13.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.932+0000 7f91d3495740 4 client.26572 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:00:13.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.932+0000 7f91d3495740 1 -- 172.21.15.19:0/4020129013 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cca6a48d60 con 0x55cca6af6250 2024-09-19T09:00:13.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.932+0000 7f91ca59c640 1 --2- 172.21.15.19:0/4020129013 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55cca6af6250 0x55cca6b630c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:13.936 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:13 smithi019 ceph-mon[30976]: pgmap v577: 97 pgs: 97 active+clean; 35 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 511 op/s 2024-09-19T09:00:13.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.933+0000 7f91ca59c640 1 --2- 172.21.15.19:0/4020129013 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55cca6af6250 0x55cca6b630c0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c458fd504b653b1 server_cookie=dab73d6c7d69b7b3 in_seq=0 out_seq=0 2024-09-19T09:00:13.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.933+0000 7f91aeff5640 10 client.26572 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:00:13.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.942+0000 7f91aeff5640 1 -- 172.21.15.19:0/4020129013 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+268 (crc 0 0 0) 0x55cca6a48d60 con 0x55cca6af6250 2024-09-19T09:00:13.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.942+0000 7f91aeff5640 10 client.26572 handle_command_reply: tid=0 2024-09-19T09:00:13.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.942+0000 7f91d3495740 1 client.26572 shutdown 2024-09-19T09:00:13.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.942+0000 7f91d3495740 1 -- 172.21.15.19:0/4020129013 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cca6adbdc0 msgr2=0x55cca6ae9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:13.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.942+0000 7f91d3495740 1 --2- 172.21.15.19:0/4020129013 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cca6adbdc0 0x55cca6ae9e10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f91c0021570 tx=0x7f91c0021910 comp rx=0 tx=0).stop 2024-09-19T09:00:13.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.942+0000 7f91d3495740 1 -- 172.21.15.19:0/4020129013 shutdown_connections 2024-09-19T09:00:13.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.942+0000 7f91d3495740 1 --2- 172.21.15.19:0/4020129013 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55cca6af6250 0x55cca6b630c0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.942+0000 7f91d3495740 1 --2- 172.21.15.19:0/4020129013 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cca6adbdc0 0x55cca6ae9e10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.942+0000 7f91aeff5640 0 client.26572 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:00:13.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.942+0000 7f91d3495740 1 --2- 172.21.15.19:0/4020129013 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55cca6ae6680 0x55cca6aea350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.942+0000 7f91d3495740 1 --2- 172.21.15.19:0/4020129013 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55cca6adb4a0 0x55cca6aeeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.942+0000 7f91d3495740 1 -- 172.21.15.19:0/4020129013 >> 172.21.15.19:0/4020129013 conn(0x55cca6ad7a30 msgr2=0x55cca6ade0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:13.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.942+0000 7f91d3495740 1 -- 172.21.15.19:0/4020129013 shutdown_connections 2024-09-19T09:00:13.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.942+0000 7f91d3495740 1 -- 172.21.15.19:0/4020129013 wait complete. 2024-09-19T09:00:13.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.942+0000 7f91d3495740 20 client.26572 trim_cache size 0 max 16384 2024-09-19T09:00:13.945 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T09:00:13.945 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "scrub active (9099 inodes in the stack)", 2024-09-19T09:00:13.945 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-19T09:00:13.945 INFO:teuthology.orchestra.run.smithi019.stdout: "bc3d29b1-7057-487a-b805-bce062af7107": { 2024-09-19T09:00:13.945 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-19T09:00:13.945 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "bc3d29b1-7057-487a-b805-bce062af7107", 2024-09-19T09:00:13.945 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-19T09:00:13.945 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:00:13.945 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:00:13.946 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T09:00:13.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.943+0000 7f91d10bc640 1 -- 172.21.15.19:0/3703617201 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f91b40a32c0 msgr2=0x7f91b40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:13.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.943+0000 7f91d10bc640 1 --2- 172.21.15.19:0/3703617201 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f91b40a32c0 0x7f91b40a5780 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f91c40b9820 tx=0x7f91c4040820 comp rx=0 tx=0).stop 2024-09-19T09:00:13.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.943+0000 7f91d10bc640 1 -- 172.21.15.19:0/3703617201 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91cc11b140 msgr2=0x7f91cc116ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:13.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.943+0000 7f91d10bc640 1 --2- 172.21.15.19:0/3703617201 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91cc11b140 0x7f91cc116ef0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f91c40405d0 tx=0x7f91c4040600 comp rx=0 tx=0).stop 2024-09-19T09:00:13.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.943+0000 7f91d10bc640 1 -- 172.21.15.19:0/3703617201 shutdown_connections 2024-09-19T09:00:13.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.943+0000 7f91d10bc640 1 --2- 172.21.15.19:0/3703617201 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f91b40a32c0 0x7f91b40a5780 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.943+0000 7f91d10bc640 1 --2- 172.21.15.19:0/3703617201 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f91cc11b140 0x7f91cc116ef0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.944+0000 7f91d10bc640 1 --2- 172.21.15.19:0/3703617201 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f91cc109830 0x7f91cc1169b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.944+0000 7f91d10bc640 1 --2- 172.21.15.19:0/3703617201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f91cc109450 0x7f91cc11a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:13.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.944+0000 7f91d10bc640 1 -- 172.21.15.19:0/3703617201 >> 172.21.15.19:0/3703617201 conn(0x7f91cc06e140 msgr2=0x7f91cc072260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:13.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.944+0000 7f91d10bc640 1 -- 172.21.15.19:0/3703617201 shutdown_connections 2024-09-19T09:00:13.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:13.944+0000 7f91d10bc640 1 -- 172.21.15.19:0/3703617201 wait complete. 2024-09-19T09:00:14.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:13 smithi155 ceph-mon[34921]: pgmap v577: 97 pgs: 97 active+clean; 35 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 511 op/s 2024-09-19T09:00:14.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:13 smithi203 ceph-mon[35450]: pgmap v577: 97 pgs: 97 active+clean; 35 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 511 op/s 2024-09-19T09:00:14.721 INFO:tasks.cephfs.filesystem:scrub status for tag:bc3d29b1-7057-487a-b805-bce062af7107 - {'path': '/', 'tag': 'bc3d29b1-7057-487a-b805-bce062af7107', 'options': 'recursive,force'} 2024-09-19T09:00:16.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:15 smithi019 ceph-mon[30976]: pgmap v578: 97 pgs: 97 active+clean; 35 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 617 op/s 2024-09-19T09:00:16.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:15 smithi155 ceph-mon[34921]: pgmap v578: 97 pgs: 97 active+clean; 35 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 617 op/s 2024-09-19T09:00:16.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:15 smithi203 ceph-mon[35450]: pgmap v578: 97 pgs: 97 active+clean; 35 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 617 op/s 2024-09-19T09:00:16.944 INFO:tasks.quiescer.fs.[cephfs]:Total duration (51.5) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T09:00:16.944 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.75 2024-09-19T09:00:16.944 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:00:17.236 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:17.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.758+0000 7fdfc8c96640 1 -- 172.21.15.19:0/502660205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfc4102570 msgr2=0x7fdfc41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:17.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.758+0000 7fdfc8c96640 1 --2- 172.21.15.19:0/502660205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfc4102570 0x7fdfc41029b0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fdfac009900 tx=0x7fdfac02a480 comp rx=0 tx=0).stop 2024-09-19T09:00:17.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.758+0000 7fdfc8c96640 1 -- 172.21.15.19:0/502660205 shutdown_connections 2024-09-19T09:00:17.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.758+0000 7fdfc8c96640 1 --2- 172.21.15.19:0/502660205 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfc4102ef0 0x7fdfc410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:17.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.758+0000 7fdfc8c96640 1 --2- 172.21.15.19:0/502660205 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfc4102570 0x7fdfc41029b0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:17.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.758+0000 7fdfc8c96640 1 --2- 172.21.15.19:0/502660205 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdfc4100e20 0x7fdfc4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:17.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.758+0000 7fdfc8c96640 1 -- 172.21.15.19:0/502660205 >> 172.21.15.19:0/502660205 conn(0x7fdfc40fc7d0 msgr2=0x7fdfc40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:17.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.758+0000 7fdfc8c96640 1 -- 172.21.15.19:0/502660205 shutdown_connections 2024-09-19T09:00:17.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.759+0000 7fdfc8c96640 1 -- 172.21.15.19:0/502660205 wait complete. 2024-09-19T09:00:17.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.759+0000 7fdfc8c96640 1 Processor -- start 2024-09-19T09:00:17.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.759+0000 7fdfc8c96640 1 -- start start 2024-09-19T09:00:17.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.760+0000 7fdfc8c96640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdfc4100e20 0x7fdfc410d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:17.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.760+0000 7fdfc8c96640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfc4102570 0x7fdfc4109650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:17.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.760+0000 7fdfc8c96640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfc4102ef0 0x7fdfc4109b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:17.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.760+0000 7fdfc8c96640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc410fec0 con 0x7fdfc4102ef0 2024-09-19T09:00:17.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.760+0000 7fdfc8c96640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc410fd40 con 0x7fdfc4102570 2024-09-19T09:00:17.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.760+0000 7fdfc8c96640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdfc4110040 con 0x7fdfc4100e20 2024-09-19T09:00:17.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.760+0000 7fdfc2d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfc4102ef0 0x7fdfc4109b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:17.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.760+0000 7fdfc2d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfc4102ef0 0x7fdfc4109b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40772/0 (socket says 172.21.15.19:40772) 2024-09-19T09:00:17.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.760+0000 7fdfc2d9d640 1 -- 172.21.15.19:0/1823021563 learned_addr learned my addr 172.21.15.19:0/1823021563 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:17.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.760+0000 7fdfc1d9b640 1 --2- 172.21.15.19:0/1823021563 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfc4102570 0x7fdfc4109650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:17.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.760+0000 7fdfc259c640 1 --2- 172.21.15.19:0/1823021563 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdfc4100e20 0x7fdfc410d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:17.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.760+0000 7fdfc2d9d640 1 -- 172.21.15.19:0/1823021563 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdfc4100e20 msgr2=0x7fdfc410d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:17.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.760+0000 7fdfc2d9d640 1 --2- 172.21.15.19:0/1823021563 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdfc4100e20 0x7fdfc410d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:17.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.760+0000 7fdfc2d9d640 1 -- 172.21.15.19:0/1823021563 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfc4102570 msgr2=0x7fdfc4109650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:17.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.760+0000 7fdfc2d9d640 1 --2- 172.21.15.19:0/1823021563 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfc4102570 0x7fdfc4109650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:17.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.760+0000 7fdfc2d9d640 1 -- 172.21.15.19:0/1823021563 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfc410a150 con 0x7fdfc4102ef0 2024-09-19T09:00:17.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.760+0000 7fdfc1d9b640 1 --2- 172.21.15.19:0/1823021563 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfc4102570 0x7fdfc4109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:17.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.760+0000 7fdfc2d9d640 1 --2- 172.21.15.19:0/1823021563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfc4102ef0 0x7fdfc4109b90 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc00eb40 tx=0x7fdfbc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:17.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.761+0000 7fdfbb7fe640 1 -- 172.21.15.19:0/1823021563 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc004b20 con 0x7fdfc4102ef0 2024-09-19T09:00:17.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.761+0000 7fdfc8c96640 1 -- 172.21.15.19:0/1823021563 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfc410a440 con 0x7fdfc4102ef0 2024-09-19T09:00:17.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.761+0000 7fdfbb7fe640 1 -- 172.21.15.19:0/1823021563 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdfbc004cc0 con 0x7fdfc4102ef0 2024-09-19T09:00:17.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.761+0000 7fdfbb7fe640 1 -- 172.21.15.19:0/1823021563 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc010760 con 0x7fdfc4102ef0 2024-09-19T09:00:17.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.761+0000 7fdfc8c96640 1 -- 172.21.15.19:0/1823021563 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfc41ab590 con 0x7fdfc4102ef0 2024-09-19T09:00:17.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.762+0000 7fdfc8c96640 1 -- 172.21.15.19:0/1823021563 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfc41021b0 con 0x7fdfc4102ef0 2024-09-19T09:00:17.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.763+0000 7fdfbb7fe640 1 -- 172.21.15.19:0/1823021563 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fdfbc005020 con 0x7fdfc4102ef0 2024-09-19T09:00:17.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.764+0000 7fdfbb7fe640 1 --2- 172.21.15.19:0/1823021563 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fdfb00a3270 0x7fdfb00a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:17.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.764+0000 7fdfbb7fe640 1 -- 172.21.15.19:0/1823021563 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fdfbc0cfe60 con 0x7fdfc4102ef0 2024-09-19T09:00:17.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.764+0000 7fdfc259c640 1 --2- 172.21.15.19:0/1823021563 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fdfb00a3270 0x7fdfb00a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:17.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.765+0000 7fdfc259c640 1 --2- 172.21.15.19:0/1823021563 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fdfb00a3270 0x7fdfb00a5730 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4005fd0 tx=0x7fdfb400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:17.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.769+0000 7fdfbb7fe640 1 -- 172.21.15.19:0/1823021563 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdfbc09cb90 con 0x7fdfc4102ef0 2024-09-19T09:00:17.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.990+0000 7fdfc8c96640 1 -- 172.21.15.19:0/1823021563 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdfc41ab820 con 0x7fdfc4102ef0 2024-09-19T09:00:17.991 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:17 smithi019 ceph-mon[30976]: pgmap v579: 97 pgs: 97 active+clean; 38 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 761 op/s 2024-09-19T09:00:17.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.991+0000 7fdfbb7fe640 1 -- 172.21.15.19:0/1823021563 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11983 (secure 0 0 0) 0x7fdfbc09c490 con 0x7fdfc4102ef0 2024-09-19T09:00:17.992 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T09:00:17.992 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":36,"btime":"2024-09-19T08:59:00:695758+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":26453,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3907362737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3907362737},{"type":"v1","addr":"172.21.15.155:6835","nonce":3907362737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":35,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T08:58:50.493979+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6839/2452068876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2452068876},{"type":"v1","addr":"172.21.15.19:6839","nonce":2452068876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24463,24464,24490,24469,24497]},"id":1}]} 2024-09-19T09:00:17.993 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 36 2024-09-19T09:00:17.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.994+0000 7fdfc8c96640 1 -- 172.21.15.19:0/1823021563 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fdfb00a3270 msgr2=0x7fdfb00a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:17.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.994+0000 7fdfc8c96640 1 --2- 172.21.15.19:0/1823021563 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fdfb00a3270 0x7fdfb00a5730 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4005fd0 tx=0x7fdfb400b390 comp rx=0 tx=0).stop 2024-09-19T09:00:17.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.994+0000 7fdfc8c96640 1 -- 172.21.15.19:0/1823021563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfc4102ef0 msgr2=0x7fdfc4109b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:17.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.994+0000 7fdfc8c96640 1 --2- 172.21.15.19:0/1823021563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfc4102ef0 0x7fdfc4109b90 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc00eb40 tx=0x7fdfbc00c2d0 comp rx=0 tx=0).stop 2024-09-19T09:00:17.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.994+0000 7fdfc8c96640 1 -- 172.21.15.19:0/1823021563 shutdown_connections 2024-09-19T09:00:17.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.994+0000 7fdfc8c96640 1 --2- 172.21.15.19:0/1823021563 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fdfb00a3270 0x7fdfb00a5730 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:17.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.994+0000 7fdfc8c96640 1 --2- 172.21.15.19:0/1823021563 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdfc4102ef0 0x7fdfc4109b90 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:17.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.994+0000 7fdfc8c96640 1 --2- 172.21.15.19:0/1823021563 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdfc4102570 0x7fdfc4109650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:17.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.994+0000 7fdfc8c96640 1 --2- 172.21.15.19:0/1823021563 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdfc4100e20 0x7fdfc410d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:17.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.994+0000 7fdfc8c96640 1 -- 172.21.15.19:0/1823021563 >> 172.21.15.19:0/1823021563 conn(0x7fdfc40fc7d0 msgr2=0x7fdfc40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:17.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.994+0000 7fdfc8c96640 1 -- 172.21.15.19:0/1823021563 shutdown_connections 2024-09-19T09:00:17.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:17.994+0000 7fdfc8c96640 1 -- 172.21.15.19:0/1823021563 wait complete. 2024-09-19T09:00:18.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:17 smithi155 ceph-mon[34921]: pgmap v579: 97 pgs: 97 active+clean; 38 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 761 op/s 2024-09-19T09:00:18.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:17 smithi203 ceph-mon[35450]: pgmap v579: 97 pgs: 97 active+clean; 38 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 761 op/s 2024-09-19T09:00:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:18.563+0000 7f1a61ffb640 1 -- 172.21.15.19:0/2423042767 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557b90778d70 con 0x557b9088e680 2024-09-19T09:00:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:18.563+0000 7f1a61ffb640 10 client.17172 handle_command_reply: tid=0 2024-09-19T09:00:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:18.563+0000 7f1a83e15740 1 client.17172 shutdown 2024-09-19T09:00:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:18.563+0000 7f1a83e15740 1 -- 172.21.15.19:0/2423042767 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557b9080d9a0 msgr2=0x557b9081c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:18.563+0000 7f1a83e15740 1 --2- 172.21.15.19:0/2423042767 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557b9080d9a0 0x557b9081c9b0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c0986e0 tx=0x7f1a6c003d50 comp rx=0 tx=0).stop 2024-09-19T09:00:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:18.563+0000 7f1a83e15740 1 -- 172.21.15.19:0/2423042767 shutdown_connections 2024-09-19T09:00:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:18.563+0000 7f1a83e15740 1 --2- 172.21.15.19:0/2423042767 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557b9088e680 0x557b90890a70 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:18.563+0000 7f1a83e15740 1 --2- 172.21.15.19:0/2423042767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b90813370 0x557b9081df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:18.565 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:18.563+0000 7f1a83e15740 1 --2- 172.21.15.19:0/2423042767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557b9080e2e0 0x557b9081cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:18.566 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:18.563+0000 7f1a61ffb640 0 client.17172 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:00:18.566 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:18.563+0000 7f1a83e15740 1 --2- 172.21.15.19:0/2423042767 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557b9080d9a0 0x557b9081c9b0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:18.566 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:18.563+0000 7f1a83e15740 1 -- 172.21.15.19:0/2423042767 >> 172.21.15.19:0/2423042767 conn(0x557b90809010 msgr2=0x557b90809ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:18.566 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:18.563+0000 7f1a83e15740 1 -- 172.21.15.19:0/2423042767 shutdown_connections 2024-09-19T09:00:18.566 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:18.563+0000 7f1a83e15740 1 -- 172.21.15.19:0/2423042767 wait complete. 2024-09-19T09:00:18.566 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:18.564+0000 7f1a83e15740 20 client.17172 trim_cache size 0 max 16384 2024-09-19T09:00:18.566 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T09:00:18.566 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T09:00:18.566 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T09:00:18.566 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T09:00:18.567 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:18.564+0000 7f1a80f9f640 1 -- 172.21.15.19:0/1288982358 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1a640a32f0 msgr2=0x7f1a640a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:18.568 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:18.564+0000 7f1a80f9f640 1 --2- 172.21.15.19:0/1288982358 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1a640a32f0 0x7f1a640a57b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1a74005e30 tx=0x7f1a74031bb0 comp rx=0 tx=0).stop 2024-09-19T09:00:18.568 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:18.564+0000 7f1a80f9f640 1 -- 172.21.15.19:0/1288982358 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a7c100a40 msgr2=0x7f1a7c06a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:18.568 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:18.564+0000 7f1a80f9f640 1 --2- 172.21.15.19:0/1288982358 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a7c100a40 0x7f1a7c06a450 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c00e9c0 tx=0x7f1a6c00ee80 comp rx=0 tx=0).stop 2024-09-19T09:00:18.568 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:18.564+0000 7f1a80f9f640 1 -- 172.21.15.19:0/1288982358 shutdown_connections 2024-09-19T09:00:18.568 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:18.564+0000 7f1a80f9f640 1 --2- 172.21.15.19:0/1288982358 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1a640a32f0 0x7f1a640a57b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:18.568 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:18.564+0000 7f1a80f9f640 1 --2- 172.21.15.19:0/1288982358 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a7c101c30 0x7f1a7c19ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:18.568 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:18.564+0000 7f1a80f9f640 1 --2- 172.21.15.19:0/1288982358 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a7c1025f0 0x7f1a7c19f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:18.568 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:18.564+0000 7f1a80f9f640 1 --2- 172.21.15.19:0/1288982358 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a7c100a40 0x7f1a7c06a450 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:18.569 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:18.564+0000 7f1a80f9f640 1 -- 172.21.15.19:0/1288982358 >> 172.21.15.19:0/1288982358 conn(0x7f1a7c0fc1e0 msgr2=0x7f1a7c104ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:18.569 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:18.564+0000 7f1a80f9f640 1 -- 172.21.15.19:0/1288982358 shutdown_connections 2024-09-19T09:00:18.569 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:18.564+0000 7f1a80f9f640 1 -- 172.21.15.19:0/1288982358 wait complete. 2024-09-19T09:00:18.602 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db / --timeout 90 --expiration 145.75 --await-for 45.0' 2024-09-19T09:00:18.603 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db / --timeout 90 --expiration 145.75 --await-for 45.0 2024-09-19T09:00:18.815 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:18 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1823021563' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:18.905 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:19.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:18 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1823021563' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:19.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:18 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1823021563' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:19.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.408+0000 7f60498a7640 1 -- 172.21.15.19:0/1117596557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60441036e0 msgr2=0x7f6044107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:19.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.408+0000 7f60498a7640 1 --2- 172.21.15.19:0/1117596557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60441036e0 0x7f6044107b90 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f6038009930 tx=0x7f603802a420 comp rx=0 tx=0).stop 2024-09-19T09:00:19.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.408+0000 7f60498a7640 1 -- 172.21.15.19:0/1117596557 shutdown_connections 2024-09-19T09:00:19.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.408+0000 7f60498a7640 1 --2- 172.21.15.19:0/1117596557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60441082a0 0x7f604410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:19.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.408+0000 7f60498a7640 1 --2- 172.21.15.19:0/1117596557 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60441036e0 0x7f6044107b90 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:19.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.408+0000 7f60498a7640 1 --2- 172.21.15.19:0/1117596557 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6044102d30 0x7f6044103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:19.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.408+0000 7f60498a7640 1 -- 172.21.15.19:0/1117596557 >> 172.21.15.19:0/1117596557 conn(0x7f60440fc7d0 msgr2=0x7f60440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:19.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.408+0000 7f60498a7640 1 -- 172.21.15.19:0/1117596557 shutdown_connections 2024-09-19T09:00:19.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.408+0000 7f60498a7640 1 -- 172.21.15.19:0/1117596557 wait complete. 2024-09-19T09:00:19.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.408+0000 7f60498a7640 1 Processor -- start 2024-09-19T09:00:19.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.409+0000 7f60498a7640 1 -- start start 2024-09-19T09:00:19.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.409+0000 7f60498a7640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6044102d30 0x7f60441985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:19.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.409+0000 7f60498a7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60441036e0 0x7f6044198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:19.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.409+0000 7f60498a7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60441082a0 0x7f604419ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:19.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.409+0000 7f60498a7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6044112060 con 0x7f60441036e0 2024-09-19T09:00:19.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.409+0000 7f60498a7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6044111ee0 con 0x7f60441082a0 2024-09-19T09:00:19.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.409+0000 7f60498a7640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f60441121e0 con 0x7f6044102d30 2024-09-19T09:00:19.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.409+0000 7f6042ffd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6044102d30 0x7f60441985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:19.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.409+0000 7f60427fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60441036e0 0x7f6044198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:19.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.409+0000 7f6042ffd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6044102d30 0x7f60441985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:32784/0 (socket says 172.21.15.19:32784) 2024-09-19T09:00:19.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.409+0000 7f6042ffd640 1 -- 172.21.15.19:0/2677498865 learned_addr learned my addr 172.21.15.19:0/2677498865 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:19.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.409+0000 7f60437fe640 1 --2- 172.21.15.19:0/2677498865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60441082a0 0x7f604419ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:19.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.410+0000 7f60437fe640 1 -- 172.21.15.19:0/2677498865 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6044102d30 msgr2=0x7f60441985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:19.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.410+0000 7f60437fe640 1 --2- 172.21.15.19:0/2677498865 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6044102d30 0x7f60441985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:19.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.410+0000 7f60437fe640 1 -- 172.21.15.19:0/2677498865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60441036e0 msgr2=0x7f6044198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:19.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.410+0000 7f60437fe640 1 --2- 172.21.15.19:0/2677498865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60441036e0 0x7f6044198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:19.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.410+0000 7f60437fe640 1 -- 172.21.15.19:0/2677498865 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f604419d570 con 0x7f60441082a0 2024-09-19T09:00:19.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.410+0000 7f60437fe640 1 --2- 172.21.15.19:0/2677498865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60441082a0 0x7f604419ce90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f603c009fd0 tx=0x7f603c00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:19.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.410+0000 7f60488a5640 1 -- 172.21.15.19:0/2677498865 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f603c00ce20 con 0x7f60441082a0 2024-09-19T09:00:19.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.410+0000 7f60498a7640 1 -- 172.21.15.19:0/2677498865 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f604419d860 con 0x7f60441082a0 2024-09-19T09:00:19.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.410+0000 7f60498a7640 1 -- 172.21.15.19:0/2677498865 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60441008c0 con 0x7f60441082a0 2024-09-19T09:00:19.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.411+0000 7f60488a5640 1 -- 172.21.15.19:0/2677498865 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f603c005020 con 0x7f60441082a0 2024-09-19T09:00:19.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.411+0000 7f60488a5640 1 -- 172.21.15.19:0/2677498865 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f603c010690 con 0x7f60441082a0 2024-09-19T09:00:19.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.413+0000 7f60488a5640 1 -- 172.21.15.19:0/2677498865 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f603c004a40 con 0x7f60441082a0 2024-09-19T09:00:19.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.414+0000 7f60488a5640 1 --2- 172.21.15.19:0/2677498865 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f602c0a32c0 0x7f602c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:19.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.414+0000 7f604bc80740 1 Processor -- start 2024-09-19T09:00:19.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.414+0000 7f604bc80740 1 -- start start 2024-09-19T09:00:19.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.414+0000 7f6042ffd640 1 --2- 172.21.15.19:0/2677498865 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f602c0a32c0 0x7f602c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:19.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.414+0000 7f60488a5640 1 -- 172.21.15.19:0/2677498865 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f603c0cff50 con 0x7f60441082a0 2024-09-19T09:00:19.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.415+0000 7f604bc80740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d54d255850 0x55d54d255c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:19.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.415+0000 7f604bc80740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d54d256170 0x55d54d2604f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:19.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.415+0000 7f604bc80740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d54d260a30 0x55d54d262e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:19.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.415+0000 7f604bc80740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d54d1ba160 con 0x55d54d256170 2024-09-19T09:00:19.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.415+0000 7f604bc80740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55d54d161720 con 0x55d54d260a30 2024-09-19T09:00:19.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.415+0000 7f604bc80740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d54d1b6120 con 0x55d54d255850 2024-09-19T09:00:19.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.415+0000 7f60427fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d54d256170 0x55d54d2604f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:19.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.415+0000 7f60427fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d54d256170 0x55d54d2604f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40784/0 (socket says 172.21.15.19:40784) 2024-09-19T09:00:19.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.415+0000 7f60427fc640 1 -- 172.21.15.19:0/3360751591 learned_addr learned my addr 172.21.15.19:0/3360751591 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:19.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.415+0000 7f60437fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d54d260a30 0x55d54d262e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:19.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.415+0000 7f6042ffd640 1 --2- 172.21.15.19:0/3360751591 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d54d255850 0x55d54d255c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:19.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.415+0000 7f60437fe640 1 -- 172.21.15.19:0/3360751591 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d54d255850 msgr2=0x55d54d255c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:19.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.415+0000 7f60437fe640 1 --2- 172.21.15.19:0/3360751591 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d54d255850 0x55d54d255c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:19.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.415+0000 7f60437fe640 1 -- 172.21.15.19:0/3360751591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d54d256170 msgr2=0x55d54d2604f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:19.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.415+0000 7f60437fe640 1 --2- 172.21.15.19:0/3360751591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d54d256170 0x55d54d2604f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:19.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.415+0000 7f60437fe640 1 -- 172.21.15.19:0/3360751591 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d54cf2bba0 con 0x55d54d260a30 2024-09-19T09:00:19.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.415+0000 7f6042ffd640 1 --2- 172.21.15.19:0/2677498865 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f602c0a32c0 0x7f602c0a5780 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6034009c70 tx=0x7f60340117b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:19.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.415+0000 7f60437fe640 1 --2- 172.21.15.19:0/3360751591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d54d260a30 0x55d54d262e20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f603c005a50 tx=0x7f603c09cd20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=767a6161df370e1a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:19.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.416+0000 7f6029ffb640 1 -- 172.21.15.19:0/3360751591 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f603c09a5c0 con 0x55d54d260a30 2024-09-19T09:00:19.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.416+0000 7f6029ffb640 1 -- 172.21.15.19:0/3360751591 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f603c09a820 con 0x55d54d260a30 2024-09-19T09:00:19.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.416+0000 7f6029ffb640 1 -- 172.21.15.19:0/3360751591 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f603c0a4d00 con 0x55d54d260a30 2024-09-19T09:00:19.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.416+0000 7f604bc80740 1 -- 172.21.15.19:0/3360751591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d54d260a30 msgr2=0x55d54d262e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:19.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.416+0000 7f604bc80740 1 --2- 172.21.15.19:0/3360751591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d54d260a30 0x55d54d262e20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f603c005a50 tx=0x7f603c09cd20 comp rx=0 tx=0).stop 2024-09-19T09:00:19.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.417+0000 7f604bc80740 1 -- 172.21.15.19:0/3360751591 shutdown_connections 2024-09-19T09:00:19.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.417+0000 7f604bc80740 1 --2- 172.21.15.19:0/3360751591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d54d260a30 0x55d54d262e20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:19.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.417+0000 7f604bc80740 1 --2- 172.21.15.19:0/3360751591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d54d256170 0x55d54d2604f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:19.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.417+0000 7f604bc80740 1 --2- 172.21.15.19:0/3360751591 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d54d255850 0x55d54d255c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:19.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.417+0000 7f604bc80740 1 -- 172.21.15.19:0/3360751591 >> 172.21.15.19:0/3360751591 conn(0x55d54d251de0 msgr2=0x55d54d2521c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:19.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.417+0000 7f604bc80740 1 -- 172.21.15.19:0/3360751591 shutdown_connections 2024-09-19T09:00:19.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.417+0000 7f604bc80740 1 -- 172.21.15.19:0/3360751591 wait complete. 2024-09-19T09:00:19.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.417+0000 7f604bc80740 1 -- start start 2024-09-19T09:00:19.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.417+0000 7f604bc80740 1 Processor -- start 2024-09-19T09:00:19.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.418+0000 7f604bc80740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d54d255850 0x55d54d25d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:19.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.418+0000 7f604bc80740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d54d256170 0x55d54d25de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:19.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.418+0000 7f604bc80740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d54d260a30 0x55d54d25e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:19.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.418+0000 7f604bc80740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d54d263600 con 0x55d54d256170 2024-09-19T09:00:19.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.418+0000 7f604bc80740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55d54d142900 con 0x55d54d260a30 2024-09-19T09:00:19.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.418+0000 7f604bc80740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d54d263780 con 0x55d54d255850 2024-09-19T09:00:19.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.418+0000 7f604bc80740 10 client.0 _ll_register_callbacks cb 0x55d54d140780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:19.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.418+0000 7f60427fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d54d256170 0x55d54d25de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:19.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.418+0000 7f60427fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d54d256170 0x55d54d25de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40798/0 (socket says 172.21.15.19:40798) 2024-09-19T09:00:19.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.418+0000 7f60427fc640 1 -- 172.21.15.19:0/77850095 learned_addr learned my addr 172.21.15.19:0/77850095 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:19.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.418+0000 7f60437fe640 1 --2- 172.21.15.19:0/77850095 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d54d260a30 0x55d54d25e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:19.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.418+0000 7f6042ffd640 1 --2- 172.21.15.19:0/77850095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d54d255850 0x55d54d25d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:19.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.418+0000 7f60437fe640 1 -- 172.21.15.19:0/77850095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d54d255850 msgr2=0x55d54d25d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:19.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.418+0000 7f60437fe640 1 --2- 172.21.15.19:0/77850095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d54d255850 0x55d54d25d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:19.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.418+0000 7f60437fe640 1 -- 172.21.15.19:0/77850095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d54d256170 msgr2=0x55d54d25de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:19.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.418+0000 7f60437fe640 1 --2- 172.21.15.19:0/77850095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d54d256170 0x55d54d25de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:19.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.418+0000 7f60437fe640 1 -- 172.21.15.19:0/77850095 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d54d182c50 con 0x55d54d260a30 2024-09-19T09:00:19.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.419+0000 7f60437fe640 1 --2- 172.21.15.19:0/77850095 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d54d260a30 0x55d54d25e360 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f603c09c360 tx=0x7f603c098de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d2de3d4cadbf548 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:19.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.419+0000 7f6022ffd640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T09:00:19.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.419+0000 7f6022ffd640 1 -- 172.21.15.19:0/77850095 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f603c0b9070 con 0x55d54d260a30 2024-09-19T09:00:19.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.419+0000 7f6022ffd640 1 -- 172.21.15.19:0/77850095 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f603c0b5240 con 0x55d54d260a30 2024-09-19T09:00:19.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.419+0000 7f604bc80740 1 -- 172.21.15.19:0/77850095 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f603c09a820 con 0x55d54d260a30 2024-09-19T09:00:19.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.419+0000 7f6022ffd640 1 -- 172.21.15.19:0/77850095 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f603c098b90 con 0x55d54d260a30 2024-09-19T09:00:19.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.419+0000 7f604bc80740 10 client.26678 fetch_fsmap learned FSMap version 36 2024-09-19T09:00:19.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.419+0000 7f604bc80740 1 -- 172.21.15.19:0/77850095 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55d54d26f2e0 con 0x55d54d260a30 2024-09-19T09:00:19.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.419+0000 7f6022ffd640 1 -- 172.21.15.19:0/77850095 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f603c09a820 con 0x55d54d260a30 2024-09-19T09:00:19.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.419+0000 7f6022ffd640 1 -- 172.21.15.19:0/77850095 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f603c09b3e0 con 0x55d54d260a30 2024-09-19T09:00:19.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.420+0000 7f604bc80740 10 client.26678 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:00:19.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.420+0000 7f604bc80740 10 client.26678 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:00:19.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.420+0000 7f604bc80740 20 client.26678 populate_metadata read hostname 'smithi019' 2024-09-19T09:00:19.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.420+0000 7f604bc80740 1 --2- 172.21.15.19:0/77850095 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d54d270630 0x55d54d272a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:19.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.420+0000 7f604bc80740 4 client.26678 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:00:19.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.420+0000 7f604bc80740 1 -- 172.21.15.19:0/77850095 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d54d1c7890 con 0x55d54d270630 2024-09-19T09:00:19.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.420+0000 7f6042ffd640 1 --2- 172.21.15.19:0/77850095 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d54d270630 0x55d54d272a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:19.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.420+0000 7f6022ffd640 10 client.26678 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:00:19.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.420+0000 7f6042ffd640 1 --2- 172.21.15.19:0/77850095 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d54d270630 0x55d54d272a20 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5ee3dd680856b4f server_cookie=70545a9522be2989 in_seq=0 out_seq=0 2024-09-19T09:00:19.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.425+0000 7f6022ffd640 1 -- 172.21.15.19:0/77850095 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d54d1c7890 con 0x55d54d270630 2024-09-19T09:00:19.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.425+0000 7f6022ffd640 10 client.26678 handle_command_reply: tid=0 2024-09-19T09:00:19.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.425+0000 7f604bc80740 1 client.26678 shutdown 2024-09-19T09:00:19.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.425+0000 7f604bc80740 1 -- 172.21.15.19:0/77850095 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d54d260a30 msgr2=0x55d54d25e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:19.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.425+0000 7f604bc80740 1 --2- 172.21.15.19:0/77850095 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d54d260a30 0x55d54d25e360 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f603c09c360 tx=0x7f603c098de0 comp rx=0 tx=0).stop 2024-09-19T09:00:19.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.425+0000 7f604bc80740 1 -- 172.21.15.19:0/77850095 shutdown_connections 2024-09-19T09:00:19.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.425+0000 7f604bc80740 1 --2- 172.21.15.19:0/77850095 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d54d270630 0x55d54d272a20 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:19.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.425+0000 7f604bc80740 1 --2- 172.21.15.19:0/77850095 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d54d260a30 0x55d54d25e360 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:19.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.425+0000 7f604bc80740 1 --2- 172.21.15.19:0/77850095 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d54d256170 0x55d54d25de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:19.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.425+0000 7f604bc80740 1 --2- 172.21.15.19:0/77850095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d54d255850 0x55d54d25d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:19.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.425+0000 7f6022ffd640 0 client.26678 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:00:19.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.425+0000 7f604bc80740 1 -- 172.21.15.19:0/77850095 >> 172.21.15.19:0/77850095 conn(0x55d54d251de0 msgr2=0x55d54d257b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:19.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.425+0000 7f604bc80740 1 -- 172.21.15.19:0/77850095 shutdown_connections 2024-09-19T09:00:19.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.425+0000 7f604bc80740 1 -- 172.21.15.19:0/77850095 wait complete. 2024-09-19T09:00:19.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.425+0000 7f604bc80740 20 client.26678 trim_cache size 0 max 16384 2024-09-19T09:00:19.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.444+0000 7f604bc80740 1 Processor -- start 2024-09-19T09:00:19.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.444+0000 7f604bc80740 1 -- start start 2024-09-19T09:00:19.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.445+0000 7f604bc80740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d54d255850 0x55d54d25f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:19.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.445+0000 7f604bc80740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d54d256170 0x55d54d25c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:19.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.445+0000 7f604bc80740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d54d260a30 0x55d54d25e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:19.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.445+0000 7f604bc80740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f603000e400 con 0x55d54d256170 2024-09-19T09:00:19.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.445+0000 7f604bc80740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f603000ff40 con 0x55d54d255850 2024-09-19T09:00:19.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.445+0000 7f604bc80740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f603000ead0 con 0x55d54d260a30 2024-09-19T09:00:19.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.445+0000 7f60427fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d54d256170 0x55d54d25c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:19.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.445+0000 7f60427fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d54d256170 0x55d54d25c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:40814/0 (socket says 172.21.15.19:40814) 2024-09-19T09:00:19.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.445+0000 7f60427fc640 1 -- 172.21.15.19:0/1153014973 learned_addr learned my addr 172.21.15.19:0/1153014973 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:19.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.445+0000 7f6042ffd640 1 --2- 172.21.15.19:0/1153014973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d54d255850 0x55d54d25f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:19.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.445+0000 7f60437fe640 1 --2- 172.21.15.19:0/1153014973 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d54d260a30 0x55d54d25e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:19.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.445+0000 7f60427fc640 1 -- 172.21.15.19:0/1153014973 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d54d260a30 msgr2=0x55d54d25e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:19.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.445+0000 7f60427fc640 1 --2- 172.21.15.19:0/1153014973 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d54d260a30 0x55d54d25e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:19.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.445+0000 7f60427fc640 1 -- 172.21.15.19:0/1153014973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d54d255850 msgr2=0x55d54d25f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:19.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.445+0000 7f60427fc640 1 --2- 172.21.15.19:0/1153014973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d54d255850 0x55d54d25f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:19.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.445+0000 7f60427fc640 1 -- 172.21.15.19:0/1153014973 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d54d255fa0 con 0x55d54d256170 2024-09-19T09:00:19.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.445+0000 7f60427fc640 1 --2- 172.21.15.19:0/1153014973 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d54d256170 0x55d54d25c1b0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f6038006010 tx=0x7f6038032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5416055d131d80bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:19.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.446+0000 7f60297fa640 1 -- 172.21.15.19:0/1153014973 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6038035040 con 0x55d54d256170 2024-09-19T09:00:19.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.446+0000 7f60297fa640 1 -- 172.21.15.19:0/1153014973 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6038032e50 con 0x55d54d256170 2024-09-19T09:00:19.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.446+0000 7f60297fa640 1 -- 172.21.15.19:0/1153014973 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60380055d0 con 0x55d54d256170 2024-09-19T09:00:19.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.446+0000 7f604bc80740 1 -- 172.21.15.19:0/1153014973 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d54d256170 msgr2=0x55d54d25c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:19.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.446+0000 7f604bc80740 1 --2- 172.21.15.19:0/1153014973 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d54d256170 0x55d54d25c1b0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f6038006010 tx=0x7f6038032ce0 comp rx=0 tx=0).stop 2024-09-19T09:00:19.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.446+0000 7f604bc80740 1 -- 172.21.15.19:0/1153014973 shutdown_connections 2024-09-19T09:00:19.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.446+0000 7f604bc80740 1 --2- 172.21.15.19:0/1153014973 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d54d260a30 0x55d54d25e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:19.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.446+0000 7f604bc80740 1 --2- 172.21.15.19:0/1153014973 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d54d256170 0x55d54d25c1b0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:19.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.446+0000 7f604bc80740 1 --2- 172.21.15.19:0/1153014973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d54d255850 0x55d54d25f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:19.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.446+0000 7f604bc80740 1 -- 172.21.15.19:0/1153014973 >> 172.21.15.19:0/1153014973 conn(0x55d54d251de0 msgr2=0x55d54d257b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:19.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.447+0000 7f604bc80740 1 -- 172.21.15.19:0/1153014973 shutdown_connections 2024-09-19T09:00:19.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.447+0000 7f604bc80740 1 -- 172.21.15.19:0/1153014973 wait complete. 2024-09-19T09:00:19.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.447+0000 7f604bc80740 1 -- start start 2024-09-19T09:00:19.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.447+0000 7f604bc80740 1 Processor -- start 2024-09-19T09:00:19.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.447+0000 7f604bc80740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d54d255850 0x55d54d2737e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:19.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.447+0000 7f604bc80740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d54d256170 0x55d54d273d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:19.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.447+0000 7f604bc80740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d54d260a30 0x55d54d2d9f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:19.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.447+0000 7f604bc80740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f603000f870 con 0x55d54d255850 2024-09-19T09:00:19.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.447+0000 7f604bc80740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f603000f1a0 con 0x55d54d256170 2024-09-19T09:00:19.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.447+0000 7f604bc80740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f603000c3e0 con 0x55d54d260a30 2024-09-19T09:00:19.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.448+0000 7f604bc80740 10 client.0 _ll_register_callbacks cb 0x7f603c0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:19.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.448+0000 7f6042ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d54d255850 0x55d54d2737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:19.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.448+0000 7f60427fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d54d256170 0x55d54d273d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:19.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.448+0000 7f60427fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d54d256170 0x55d54d273d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:58986/0 (socket says 172.21.15.19:58986) 2024-09-19T09:00:19.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.448+0000 7f60427fc640 1 -- 172.21.15.19:0/2987871160 learned_addr learned my addr 172.21.15.19:0/2987871160 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:19.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.448+0000 7f60437fe640 1 --2- 172.21.15.19:0/2987871160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d54d260a30 0x55d54d2d9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:19.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.448+0000 7f60427fc640 1 -- 172.21.15.19:0/2987871160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d54d260a30 msgr2=0x55d54d2d9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:19.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.448+0000 7f60427fc640 1 --2- 172.21.15.19:0/2987871160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d54d260a30 0x55d54d2d9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:19.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.448+0000 7f60427fc640 1 -- 172.21.15.19:0/2987871160 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d54d255850 msgr2=0x55d54d2737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:19.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.448+0000 7f60427fc640 1 --2- 172.21.15.19:0/2987871160 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d54d255850 0x55d54d2737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:19.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.448+0000 7f60427fc640 1 -- 172.21.15.19:0/2987871160 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d54d2da4b0 con 0x55d54d256170 2024-09-19T09:00:19.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.448+0000 7f6042ffd640 1 --2- 172.21.15.19:0/2987871160 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d54d255850 0x55d54d2737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:19.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.448+0000 7f60427fc640 1 --2- 172.21.15.19:0/2987871160 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d54d256170 0x55d54d273d20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6038005940 tx=0x7f6038005670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=886a6a21631429a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:19.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.448+0000 7f6022ffd640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T09:00:19.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.448+0000 7f6022ffd640 1 -- 172.21.15.19:0/2987871160 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6038035040 con 0x55d54d256170 2024-09-19T09:00:19.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.448+0000 7f6022ffd640 1 -- 172.21.15.19:0/2987871160 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6038004030 con 0x55d54d256170 2024-09-19T09:00:19.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.448+0000 7f604bc80740 1 -- 172.21.15.19:0/2987871160 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6038032e50 con 0x55d54d256170 2024-09-19T09:00:19.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.449+0000 7f6022ffd640 1 -- 172.21.15.19:0/2987871160 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f6038004250 con 0x55d54d256170 2024-09-19T09:00:19.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.449+0000 7f604bc80740 10 client.26684 fetch_fsmap learned FSMap version 36 2024-09-19T09:00:19.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.449+0000 7f604bc80740 1 -- 172.21.15.19:0/2987871160 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55d54d2db630 con 0x55d54d256170 2024-09-19T09:00:19.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.449+0000 7f6022ffd640 1 -- 172.21.15.19:0/2987871160 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6038032e50 con 0x55d54d256170 2024-09-19T09:00:19.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.449+0000 7f6022ffd640 1 -- 172.21.15.19:0/2987871160 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f6038004800 con 0x55d54d256170 2024-09-19T09:00:19.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.449+0000 7f604bc80740 10 client.26684 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:00:19.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.449+0000 7f604bc80740 10 client.26684 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:00:19.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.449+0000 7f604bc80740 20 client.26684 populate_metadata read hostname 'smithi019' 2024-09-19T09:00:19.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.449+0000 7f604bc80740 1 --2- 172.21.15.19:0/2987871160 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d54d2dbd70 0x55d54d2de190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:19.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.449+0000 7f604bc80740 4 client.26684 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.75, "await_for": 45.0}] 2024-09-19T09:00:19.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.449+0000 7f604bc80740 1 -- 172.21.15.19:0/2987871160 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.75, "await_for": 45.0}) -- 0x55d54d1c1be0 con 0x55d54d2dbd70 2024-09-19T09:00:19.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.449+0000 7f6042ffd640 1 --2- 172.21.15.19:0/2987871160 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d54d2dbd70 0x55d54d2de190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:19.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.450+0000 7f6042ffd640 1 --2- 172.21.15.19:0/2987871160 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d54d2dbd70 0x55d54d2de190 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=633ac73cc2f33b04 server_cookie=8b8b88a2bd430127 in_seq=0 out_seq=0 2024-09-19T09:00:19.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:19.450+0000 7f6022ffd640 10 client.26684 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:00:20.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:19 smithi019 ceph-mon[30976]: pgmap v580: 97 pgs: 97 active+clean; 25 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 821 op/s 2024-09-19T09:00:20.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:19 smithi155 ceph-mon[34921]: pgmap v580: 97 pgs: 97 active+clean; 25 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 821 op/s 2024-09-19T09:00:20.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:19 smithi203 ceph-mon[35450]: pgmap v580: 97 pgs: 97 active+clean; 25 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.6 MiB/s wr, 821 op/s 2024-09-19T09:00:22.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:21 smithi019 ceph-mon[30976]: pgmap v581: 97 pgs: 97 active+clean; 25 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 1.1 MiB/s wr, 760 op/s 2024-09-19T09:00:22.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:21 smithi155 ceph-mon[34921]: pgmap v581: 97 pgs: 97 active+clean; 25 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 1.1 MiB/s wr, 760 op/s 2024-09-19T09:00:22.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:21 smithi203 ceph-mon[35450]: pgmap v581: 97 pgs: 97 active+clean; 25 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 1.1 MiB/s wr, 760 op/s 2024-09-19T09:00:24.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:23 smithi155 ceph-mon[34921]: pgmap v582: 97 pgs: 97 active+clean; 19 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 833 op/s 2024-09-19T09:00:24.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:23 smithi203 ceph-mon[35450]: pgmap v582: 97 pgs: 97 active+clean; 19 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 833 op/s 2024-09-19T09:00:24.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:23 smithi019 ceph-mon[30976]: pgmap v582: 97 pgs: 97 active+clean; 19 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.6 MiB/s wr, 833 op/s 2024-09-19T09:00:26.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:25 smithi155 ceph-mon[34921]: pgmap v583: 97 pgs: 97 active+clean; 22 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 691 op/s 2024-09-19T09:00:26.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:25 smithi203 ceph-mon[35450]: pgmap v583: 97 pgs: 97 active+clean; 22 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 691 op/s 2024-09-19T09:00:26.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:25 smithi019 ceph-mon[30976]: pgmap v583: 97 pgs: 97 active+clean; 22 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 691 op/s 2024-09-19T09:00:28.121 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:27 smithi019 ceph-mon[30976]: pgmap v584: 97 pgs: 97 active+clean; 22 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 480 op/s 2024-09-19T09:00:28.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:27 smithi155 ceph-mon[34921]: pgmap v584: 97 pgs: 97 active+clean; 22 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 480 op/s 2024-09-19T09:00:28.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:27 smithi203 ceph-mon[35450]: pgmap v584: 97 pgs: 97 active+clean; 22 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 480 op/s 2024-09-19T09:00:29.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:29.779+0000 7f6022ffd640 1 -- 172.21.15.19:0/2987871160 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55d54d1c1be0 con 0x55d54d2dbd70 2024-09-19T09:00:29.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:29.779+0000 7f6022ffd640 10 client.26684 handle_command_reply: tid=0 2024-09-19T09:00:29.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:29.779+0000 7f604bc80740 1 client.26684 shutdown 2024-09-19T09:00:29.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:29.780+0000 7f604bc80740 1 -- 172.21.15.19:0/2987871160 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d54d256170 msgr2=0x55d54d273d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:29.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:29.780+0000 7f604bc80740 1 --2- 172.21.15.19:0/2987871160 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d54d256170 0x55d54d273d20 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6038005940 tx=0x7f6038005670 comp rx=0 tx=0).stop 2024-09-19T09:00:29.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:29.780+0000 7f604bc80740 1 -- 172.21.15.19:0/2987871160 shutdown_connections 2024-09-19T09:00:29.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:29.780+0000 7f604bc80740 1 --2- 172.21.15.19:0/2987871160 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d54d2dbd70 0x55d54d2de190 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:29.780+0000 7f6022ffd640 0 client.26684 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:00:29.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:29.780+0000 7f604bc80740 1 --2- 172.21.15.19:0/2987871160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d54d260a30 0x55d54d2d9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:29.780+0000 7f604bc80740 1 --2- 172.21.15.19:0/2987871160 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d54d256170 0x55d54d273d20 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:29.780+0000 7f604bc80740 1 --2- 172.21.15.19:0/2987871160 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d54d255850 0x55d54d2737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:29.780+0000 7f604bc80740 1 -- 172.21.15.19:0/2987871160 >> 172.21.15.19:0/2987871160 conn(0x55d54d251de0 msgr2=0x55d54d26ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:29.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:29.780+0000 7f604bc80740 1 -- 172.21.15.19:0/2987871160 shutdown_connections 2024-09-19T09:00:29.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:29.780+0000 7f604bc80740 1 -- 172.21.15.19:0/2987871160 wait complete. 2024-09-19T09:00:29.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:29.780+0000 7f604bc80740 20 client.26684 trim_cache size 0 max 16384 2024-09-19T09:00:29.783 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T09:00:29.783 INFO:teuthology.orchestra.run.smithi019.stdout: "epoch": 35, 2024-09-19T09:00:29.783 INFO:teuthology.orchestra.run.smithi019.stdout: "leader": 24497, 2024-09-19T09:00:29.783 INFO:teuthology.orchestra.run.smithi019.stdout: "set_version": 26, 2024-09-19T09:00:29.783 INFO:teuthology.orchestra.run.smithi019.stdout: "sets": { 2024-09-19T09:00:29.783 INFO:teuthology.orchestra.run.smithi019.stdout: "30ed91a0": { 2024-09-19T09:00:29.783 INFO:teuthology.orchestra.run.smithi019.stdout: "version": 26, 2024-09-19T09:00:29.783 INFO:teuthology.orchestra.run.smithi019.stdout: "age_ref": 0.0, 2024-09-19T09:00:29.783 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T09:00:29.783 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "QUIESCED", 2024-09-19T09:00:29.783 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T09:00:29.784 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:00:29.784 INFO:teuthology.orchestra.run.smithi019.stdout: "timeout": 90.0, 2024-09-19T09:00:29.784 INFO:teuthology.orchestra.run.smithi019.stdout: "expiration": 145.8, 2024-09-19T09:00:29.784 INFO:teuthology.orchestra.run.smithi019.stdout: "members": { 2024-09-19T09:00:29.784 INFO:teuthology.orchestra.run.smithi019.stdout: "file:/": { 2024-09-19T09:00:29.784 INFO:teuthology.orchestra.run.smithi019.stdout: "excluded": false, 2024-09-19T09:00:29.784 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T09:00:29.784 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "QUIESCED", 2024-09-19T09:00:29.784 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T09:00:29.784 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:00:29.784 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:00:29.784 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:00:29.784 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:00:29.785 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:00:29.785 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T09:00:29.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:29.781+0000 7f60498a7640 1 -- 172.21.15.19:0/2677498865 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f602c0a32c0 msgr2=0x7f602c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:29.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:29.781+0000 7f60498a7640 1 --2- 172.21.15.19:0/2677498865 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f602c0a32c0 0x7f602c0a5780 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6034009c70 tx=0x7f60340117b0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:29.781+0000 7f60498a7640 1 -- 172.21.15.19:0/2677498865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60441082a0 msgr2=0x7f604419ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:29.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:29.781+0000 7f60498a7640 1 --2- 172.21.15.19:0/2677498865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60441082a0 0x7f604419ce90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f603c009fd0 tx=0x7f603c00ef10 comp rx=0 tx=0).stop 2024-09-19T09:00:29.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:29.781+0000 7f60498a7640 1 -- 172.21.15.19:0/2677498865 shutdown_connections 2024-09-19T09:00:29.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:29.781+0000 7f60498a7640 1 --2- 172.21.15.19:0/2677498865 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f602c0a32c0 0x7f602c0a5780 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:29.781+0000 7f60498a7640 1 --2- 172.21.15.19:0/2677498865 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f60441082a0 0x7f604419ce90 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:29.781+0000 7f60498a7640 1 --2- 172.21.15.19:0/2677498865 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f60441036e0 0x7f6044198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:29.781+0000 7f60498a7640 1 --2- 172.21.15.19:0/2677498865 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6044102d30 0x7f60441985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:29.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:29.781+0000 7f60498a7640 1 -- 172.21.15.19:0/2677498865 >> 172.21.15.19:0/2677498865 conn(0x7f60440fc7d0 msgr2=0x7f6044105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:29.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:29.782+0000 7f60498a7640 1 -- 172.21.15.19:0/2677498865 shutdown_connections 2024-09-19T09:00:29.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:29.782+0000 7f60498a7640 1 -- 172.21.15.19:0/2677498865 wait complete. 2024-09-19T09:00:30.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:29 smithi019 ceph-mon[30976]: pgmap v585: 97 pgs: 97 active+clean; 22 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 311 op/s 2024-09-19T09:00:30.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:29 smithi155 ceph-mon[34921]: pgmap v585: 97 pgs: 97 active+clean; 22 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 311 op/s 2024-09-19T09:00:30.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:29 smithi203 ceph-mon[35450]: pgmap v585: 97 pgs: 97 active+clean; 22 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.0 MiB/s wr, 311 op/s 2024-09-19T09:00:30.623 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '30ed91a0', quiesce took 13.7 seconds. Will release after: 12.05 2024-09-19T09:00:31.698 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.697+0000 7feabde17640 1 -- 172.21.15.19:0/4234551680 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feab8101b60 msgr2=0x7feab8101f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:31.698 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.698+0000 7feabde17640 1 --2- 172.21.15.19:0/4234551680 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feab8101b60 0x7feab8101f60 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7feaa8009900 tx=0x7feaa802a410 comp rx=0 tx=0).stop 2024-09-19T09:00:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.698+0000 7feabde17640 1 -- 172.21.15.19:0/4234551680 shutdown_connections 2024-09-19T09:00:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.698+0000 7feabde17640 1 --2- 172.21.15.19:0/4234551680 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feab8103710 0x7feab8109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.698+0000 7feabde17640 1 --2- 172.21.15.19:0/4234551680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feab8102d50 0x7feab81031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.698+0000 7feabde17640 1 --2- 172.21.15.19:0/4234551680 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feab8101b60 0x7feab8101f60 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.698+0000 7feabde17640 1 -- 172.21.15.19:0/4234551680 >> 172.21.15.19:0/4234551680 conn(0x7feab80fd2e0 msgr2=0x7feab80ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.698+0000 7feabde17640 1 -- 172.21.15.19:0/4234551680 shutdown_connections 2024-09-19T09:00:31.699 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.699+0000 7feabde17640 1 -- 172.21.15.19:0/4234551680 wait complete. 2024-09-19T09:00:31.700 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.699+0000 7feabde17640 1 Processor -- start 2024-09-19T09:00:31.700 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.700+0000 7feabde17640 1 -- start start 2024-09-19T09:00:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.700+0000 7feabde17640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feab8101b60 0x7feab8197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.700+0000 7feabde17640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feab8102d50 0x7feab8198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.700+0000 7feabde17640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feab8103710 0x7feab819f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.700+0000 7feabde17640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7feab810d830 con 0x7feab8102d50 2024-09-19T09:00:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.700+0000 7feabde17640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7feab810d6b0 con 0x7feab8101b60 2024-09-19T09:00:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.700+0000 7feabde17640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7feab810d9b0 con 0x7feab8103710 2024-09-19T09:00:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.700+0000 7feab6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feab8102d50 0x7feab8198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.700+0000 7feab6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feab8102d50 0x7feab8198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57226/0 (socket says 172.21.15.19:57226) 2024-09-19T09:00:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.700+0000 7feab6ffd640 1 -- 172.21.15.19:0/919625704 learned_addr learned my addr 172.21.15.19:0/919625704 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.700+0000 7feab7fff640 1 --2- 172.21.15.19:0/919625704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feab8103710 0x7feab819f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:31.701 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.700+0000 7feab77fe640 1 --2- 172.21.15.19:0/919625704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feab8101b60 0x7feab8197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.701+0000 7feab6ffd640 1 -- 172.21.15.19:0/919625704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feab8103710 msgr2=0x7feab819f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.701+0000 7feab6ffd640 1 --2- 172.21.15.19:0/919625704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feab8103710 0x7feab819f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.701+0000 7feab6ffd640 1 -- 172.21.15.19:0/919625704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feab8101b60 msgr2=0x7feab8197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:31.702 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.701+0000 7feab6ffd640 1 --2- 172.21.15.19:0/919625704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feab8101b60 0x7feab8197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.701+0000 7feab6ffd640 1 -- 172.21.15.19:0/919625704 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feab819fa10 con 0x7feab8102d50 2024-09-19T09:00:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.701+0000 7feab6ffd640 1 --2- 172.21.15.19:0/919625704 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feab8102d50 0x7feab8198330 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7feaac00e9f0 tx=0x7feaac00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.702+0000 7feab4ff9640 1 -- 172.21.15.19:0/919625704 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaac00cd80 con 0x7feab8102d50 2024-09-19T09:00:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.702+0000 7feab4ff9640 1 -- 172.21.15.19:0/919625704 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feaac010910 con 0x7feab8102d50 2024-09-19T09:00:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.702+0000 7feabde17640 1 -- 172.21.15.19:0/919625704 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feab819fd00 con 0x7feab8102d50 2024-09-19T09:00:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.702+0000 7feabde17640 1 -- 172.21.15.19:0/919625704 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feab81a01f0 con 0x7feab8102d50 2024-09-19T09:00:31.703 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.702+0000 7feab4ff9640 1 -- 172.21.15.19:0/919625704 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaac018990 con 0x7feab8102d50 2024-09-19T09:00:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.705+0000 7feac0c88740 1 Processor -- start 2024-09-19T09:00:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.706+0000 7feac0c88740 1 -- start start 2024-09-19T09:00:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.706+0000 7feac0c88740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641da7749a0 0x5641da774da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.706+0000 7feac0c88740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641da7752e0 0x5641da784680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.706+0000 7feac0c88740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641da784bc0 0x5641da787030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.706+0000 7feac0c88740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5641da6da2f0 con 0x5641da784bc0 2024-09-19T09:00:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.706+0000 7feac0c88740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5641da682270 con 0x5641da7752e0 2024-09-19T09:00:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.706+0000 7feac0c88740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5641da6d62b0 con 0x5641da7749a0 2024-09-19T09:00:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.706+0000 7feab4ff9640 1 -- 172.21.15.19:0/919625704 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7feaac018c10 con 0x7feab8102d50 2024-09-19T09:00:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.706+0000 7feab77fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641da7752e0 0x5641da784680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.706+0000 7feab77fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641da7752e0 0x5641da784680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:39572/0 (socket says 172.21.15.19:39572) 2024-09-19T09:00:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.706+0000 7feab77fe640 1 -- 172.21.15.19:0/3118600793 learned_addr learned my addr 172.21.15.19:0/3118600793 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.707+0000 7feab6ffd640 1 --2- 172.21.15.19:0/3118600793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641da784bc0 0x5641da787030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:31.708 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.707+0000 7feab7fff640 1 --2- 172.21.15.19:0/3118600793 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641da7749a0 0x5641da774da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.707+0000 7feab77fe640 1 -- 172.21.15.19:0/3118600793 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641da7749a0 msgr2=0x5641da774da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.707+0000 7feab77fe640 1 --2- 172.21.15.19:0/3118600793 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641da7749a0 0x5641da774da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.707+0000 7feab77fe640 1 -- 172.21.15.19:0/3118600793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641da784bc0 msgr2=0x5641da787030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.707+0000 7feab77fe640 1 --2- 172.21.15.19:0/3118600793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641da784bc0 0x5641da787030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.707+0000 7feab77fe640 1 -- 172.21.15.19:0/3118600793 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641da681340 con 0x5641da7752e0 2024-09-19T09:00:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.708+0000 7feab77fe640 1 --2- 172.21.15.19:0/3118600793 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641da7752e0 0x5641da784680 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feaa8006010 tx=0x7feaa8004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d592d51f5f84252b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.708+0000 7feab4ff9640 1 --2- 172.21.15.19:0/919625704 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7feaa00a3460 0x7feaa00a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.708+0000 7feab4ff9640 1 -- 172.21.15.19:0/919625704 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7feaac0cfa90 con 0x7feab8102d50 2024-09-19T09:00:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.708+0000 7feab7fff640 1 --2- 172.21.15.19:0/919625704 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7feaa00a3460 0x7feaa00a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:31.710 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.709+0000 7fea9dffb640 1 -- 172.21.15.19:0/3118600793 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa8035040 con 0x5641da7752e0 2024-09-19T09:00:31.710 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.709+0000 7fea9dffb640 1 -- 172.21.15.19:0/3118600793 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feaa8004430 con 0x5641da7752e0 2024-09-19T09:00:31.710 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.709+0000 7fea9dffb640 1 -- 172.21.15.19:0/3118600793 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa80316b0 con 0x5641da7752e0 2024-09-19T09:00:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.710+0000 7feac0c88740 1 -- 172.21.15.19:0/3118600793 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641da7752e0 msgr2=0x5641da784680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.710+0000 7feab7fff640 1 --2- 172.21.15.19:0/919625704 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7feaa00a3460 0x7feaa00a5920 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7feab0005fd0 tx=0x7feab0009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.710+0000 7feac0c88740 1 --2- 172.21.15.19:0/3118600793 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641da7752e0 0x5641da784680 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7feaa8006010 tx=0x7feaa8004040 comp rx=0 tx=0).stop 2024-09-19T09:00:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.710+0000 7feac0c88740 1 -- 172.21.15.19:0/3118600793 shutdown_connections 2024-09-19T09:00:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.710+0000 7feac0c88740 1 --2- 172.21.15.19:0/3118600793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641da784bc0 0x5641da787030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.710+0000 7feac0c88740 1 --2- 172.21.15.19:0/3118600793 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641da7752e0 0x5641da784680 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.710+0000 7feac0c88740 1 --2- 172.21.15.19:0/3118600793 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641da7749a0 0x5641da774da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.710+0000 7feac0c88740 1 -- 172.21.15.19:0/3118600793 >> 172.21.15.19:0/3118600793 conn(0x5641da771f90 msgr2=0x5641da772370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.710+0000 7feac0c88740 1 -- 172.21.15.19:0/3118600793 shutdown_connections 2024-09-19T09:00:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.710+0000 7feac0c88740 1 -- 172.21.15.19:0/3118600793 wait complete. 2024-09-19T09:00:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.711+0000 7feac0c88740 1 -- start start 2024-09-19T09:00:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.711+0000 7feac0c88740 1 Processor -- start 2024-09-19T09:00:31.714 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.711+0000 7feac0c88740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641da7749a0 0x5641da789450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:31.714 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.711+0000 7feac0c88740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641da7752e0 0x5641da789990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:31.714 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.711+0000 7feac0c88740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641da784bc0 0x5641da7909d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:31.714 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.711+0000 7feac0c88740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5641da787ae0 con 0x5641da784bc0 2024-09-19T09:00:31.714 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.711+0000 7feac0c88740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5641da663290 con 0x5641da7749a0 2024-09-19T09:00:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.711+0000 7feab77fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641da7749a0 0x5641da789450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.711+0000 7feab6ffd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641da7752e0 0x5641da789990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.711+0000 7feab77fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641da7749a0 0x5641da789450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:39586/0 (socket says 172.21.15.19:39586) 2024-09-19T09:00:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.711+0000 7feab77fe640 1 -- 172.21.15.19:0/4040290290 learned_addr learned my addr 172.21.15.19:0/4040290290 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.711+0000 7feab7fff640 1 --2- 172.21.15.19:0/4040290290 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641da784bc0 0x5641da7909d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.711+0000 7feac0c88740 1 -- 172.21.15.19:0/4040290290 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5641da787c60 con 0x5641da7752e0 2024-09-19T09:00:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.712+0000 7feac0c88740 10 client.0 _ll_register_callbacks cb 0x5641da694140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.712+0000 7feab77fe640 1 -- 172.21.15.19:0/4040290290 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641da7752e0 msgr2=0x5641da789990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.712+0000 7feab77fe640 1 --2- 172.21.15.19:0/4040290290 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641da7752e0 0x5641da789990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.712+0000 7feab77fe640 1 -- 172.21.15.19:0/4040290290 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641da784bc0 msgr2=0x5641da7909d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.712+0000 7feab77fe640 1 --2- 172.21.15.19:0/4040290290 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641da784bc0 0x5641da7909d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.712+0000 7feab77fe640 1 -- 172.21.15.19:0/4040290290 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641da3ed210 con 0x5641da7749a0 2024-09-19T09:00:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.712+0000 7feab77fe640 1 --2- 172.21.15.19:0/4040290290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641da7749a0 0x5641da789450 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7feaa802aa00 tx=0x7feaa80049a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fd6280daa68db7c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.712+0000 7fea96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T09:00:31.716 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.713+0000 7fea96ffd640 1 -- 172.21.15.19:0/4040290290 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaa8053060 con 0x5641da7749a0 2024-09-19T09:00:31.716 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.713+0000 7feac0c88740 1 -- 172.21.15.19:0/4040290290 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feaa8004430 con 0x5641da7749a0 2024-09-19T09:00:31.716 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.713+0000 7fea96ffd640 1 -- 172.21.15.19:0/4040290290 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7feaa8004230 con 0x5641da7749a0 2024-09-19T09:00:31.716 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.714+0000 7fea96ffd640 1 -- 172.21.15.19:0/4040290290 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7feaa8035050 con 0x5641da7749a0 2024-09-19T09:00:31.716 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.714+0000 7feac0c88740 10 client.26696 fetch_fsmap learned FSMap version 36 2024-09-19T09:00:31.716 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.714+0000 7feac0c88740 1 -- 172.21.15.19:0/4040290290 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5641da4b9620 con 0x5641da7749a0 2024-09-19T09:00:31.717 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.715+0000 7fea96ffd640 1 -- 172.21.15.19:0/4040290290 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feaa8004430 con 0x5641da7749a0 2024-09-19T09:00:31.717 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.715+0000 7fea96ffd640 1 -- 172.21.15.19:0/4040290290 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7feaa80035f0 con 0x5641da7749a0 2024-09-19T09:00:31.717 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.715+0000 7feac0c88740 10 client.26696 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:00:31.717 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.715+0000 7feac0c88740 10 client.26696 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:00:31.718 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.715+0000 7feac0c88740 20 client.26696 populate_metadata read hostname 'smithi019' 2024-09-19T09:00:31.718 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.715+0000 7feac0c88740 1 --2- 172.21.15.19:0/4040290290 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5641da794cd0 0x5641da7970c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:31.718 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.715+0000 7feac0c88740 4 client.26696 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:00:31.718 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.715+0000 7feac0c88740 1 -- 172.21.15.19:0/4040290290 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641da6e7a20 con 0x5641da794cd0 2024-09-19T09:00:31.718 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.715+0000 7feab6ffd640 1 --2- 172.21.15.19:0/4040290290 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5641da794cd0 0x5641da7970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:31.718 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.717+0000 7feab6ffd640 1 --2- 172.21.15.19:0/4040290290 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5641da794cd0 0x5641da7970c0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2450b90bce2fce8 server_cookie=e1314119cc9096ff in_seq=0 out_seq=0 2024-09-19T09:00:31.718 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.717+0000 7fea96ffd640 10 client.26696 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:00:31.719 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.719+0000 7fea96ffd640 1 -- 172.21.15.19:0/4040290290 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5641da6e7a20 con 0x5641da794cd0 2024-09-19T09:00:31.719 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.719+0000 7fea96ffd640 10 client.26696 handle_command_reply: tid=0 2024-09-19T09:00:31.719 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.719+0000 7feac0c88740 1 client.26696 shutdown 2024-09-19T09:00:31.720 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.719+0000 7feac0c88740 1 -- 172.21.15.19:0/4040290290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641da7749a0 msgr2=0x5641da789450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:31.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.719+0000 7feac0c88740 1 --2- 172.21.15.19:0/4040290290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641da7749a0 0x5641da789450 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7feaa802aa00 tx=0x7feaa80049a0 comp rx=0 tx=0).stop 2024-09-19T09:00:31.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.720+0000 7feac0c88740 1 -- 172.21.15.19:0/4040290290 shutdown_connections 2024-09-19T09:00:31.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.720+0000 7feac0c88740 1 --2- 172.21.15.19:0/4040290290 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5641da794cd0 0x5641da7970c0 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:31.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.720+0000 7feac0c88740 1 --2- 172.21.15.19:0/4040290290 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641da7752e0 0x5641da789990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:31.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.720+0000 7feac0c88740 1 --2- 172.21.15.19:0/4040290290 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641da784bc0 0x5641da7909d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:31.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.720+0000 7feac0c88740 1 --2- 172.21.15.19:0/4040290290 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641da7749a0 0x5641da789450 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:31.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.720+0000 7fea96ffd640 0 client.26696 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:00:31.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.720+0000 7feac0c88740 1 -- 172.21.15.19:0/4040290290 >> 172.21.15.19:0/4040290290 conn(0x5641da771f90 msgr2=0x5641da7737a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:31.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.720+0000 7feac0c88740 1 -- 172.21.15.19:0/4040290290 shutdown_connections 2024-09-19T09:00:31.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.720+0000 7feac0c88740 1 -- 172.21.15.19:0/4040290290 wait complete. 2024-09-19T09:00:31.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.720+0000 7feac0c88740 20 client.26696 trim_cache size 0 max 16384 2024-09-19T09:00:31.749 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.747+0000 7feac0c88740 1 Processor -- start 2024-09-19T09:00:31.749 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.748+0000 7feac0c88740 1 -- start start 2024-09-19T09:00:31.749 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.748+0000 7feac0c88740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641da7749a0 0x5641da789910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:31.749 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.748+0000 7feac0c88740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641da7752e0 0x5641da790990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:31.749 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.748+0000 7feac0c88740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641da784bc0 0x5641da772ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:31.749 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.748+0000 7feac0c88740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7feaa400e410 con 0x5641da7752e0 2024-09-19T09:00:31.749 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.748+0000 7feac0c88740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7feaa400ff50 con 0x5641da784bc0 2024-09-19T09:00:31.749 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.748+0000 7feac0c88740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7feaa400eae0 con 0x5641da7749a0 2024-09-19T09:00:31.749 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.748+0000 7feab6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641da7752e0 0x5641da790990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:31.749 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.748+0000 7feab6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641da7752e0 0x5641da790990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57250/0 (socket says 172.21.15.19:57250) 2024-09-19T09:00:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.748+0000 7feab6ffd640 1 -- 172.21.15.19:0/2774702760 learned_addr learned my addr 172.21.15.19:0/2774702760 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.748+0000 7feab77fe640 1 --2- 172.21.15.19:0/2774702760 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641da7749a0 0x5641da789910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.748+0000 7feab7fff640 1 --2- 172.21.15.19:0/2774702760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641da784bc0 0x5641da772ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.748+0000 7feab6ffd640 1 -- 172.21.15.19:0/2774702760 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641da7749a0 msgr2=0x5641da789910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.748+0000 7feab6ffd640 1 --2- 172.21.15.19:0/2774702760 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641da7749a0 0x5641da789910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.748+0000 7feab6ffd640 1 -- 172.21.15.19:0/2774702760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641da784bc0 msgr2=0x5641da772ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.748+0000 7feab6ffd640 1 --2- 172.21.15.19:0/2774702760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641da784bc0 0x5641da772ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.748+0000 7feab6ffd640 1 -- 172.21.15.19:0/2774702760 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641da76d2d0 con 0x5641da7752e0 2024-09-19T09:00:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.748+0000 7feab7fff640 1 --2- 172.21.15.19:0/2774702760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641da784bc0 0x5641da772ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:00:31.750 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.749+0000 7feab6ffd640 1 --2- 172.21.15.19:0/2774702760 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641da7752e0 0x5641da790990 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7feaac09be10 tx=0x7feaac0bc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38d04c23032ca8b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:31.752 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.749+0000 7fea9d7fa640 1 -- 172.21.15.19:0/2774702760 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaac0a4cd0 con 0x5641da7752e0 2024-09-19T09:00:31.752 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.749+0000 7fea9d7fa640 1 -- 172.21.15.19:0/2774702760 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feaac0bc0b0 con 0x5641da7752e0 2024-09-19T09:00:31.752 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.749+0000 7fea9d7fa640 1 -- 172.21.15.19:0/2774702760 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaac09b560 con 0x5641da7752e0 2024-09-19T09:00:31.752 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.750+0000 7feac0c88740 1 -- 172.21.15.19:0/2774702760 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641da7752e0 msgr2=0x5641da790990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:31.752 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.750+0000 7feac0c88740 1 --2- 172.21.15.19:0/2774702760 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641da7752e0 0x5641da790990 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7feaac09be10 tx=0x7feaac0bc040 comp rx=0 tx=0).stop 2024-09-19T09:00:31.752 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.750+0000 7feac0c88740 1 -- 172.21.15.19:0/2774702760 shutdown_connections 2024-09-19T09:00:31.752 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.750+0000 7feac0c88740 1 --2- 172.21.15.19:0/2774702760 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641da784bc0 0x5641da772ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:31.752 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.750+0000 7feac0c88740 1 --2- 172.21.15.19:0/2774702760 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641da7752e0 0x5641da790990 secure :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7feaac09be10 tx=0x7feaac0bc040 comp rx=0 tx=0).stop 2024-09-19T09:00:31.752 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.750+0000 7feac0c88740 1 --2- 172.21.15.19:0/2774702760 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641da7749a0 0x5641da789910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:31.752 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.750+0000 7feac0c88740 1 -- 172.21.15.19:0/2774702760 >> 172.21.15.19:0/2774702760 conn(0x5641da771f90 msgr2=0x5641da789200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:31.752 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.750+0000 7feac0c88740 1 -- 172.21.15.19:0/2774702760 shutdown_connections 2024-09-19T09:00:31.752 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.750+0000 7feac0c88740 1 -- 172.21.15.19:0/2774702760 wait complete. 2024-09-19T09:00:31.753 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.750+0000 7feac0c88740 1 -- start start 2024-09-19T09:00:31.753 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.751+0000 7feac0c88740 1 Processor -- start 2024-09-19T09:00:31.753 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.751+0000 7feac0c88740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641da7749a0 0x5641da78e720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:31.753 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.751+0000 7feac0c88740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641da784bc0 0x5641da78ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:31.755 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.751+0000 7feac0c88740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641da78fc70 0x5641da7900d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:31.755 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.751+0000 7feac0c88740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7feaa400f880 con 0x5641da784bc0 2024-09-19T09:00:31.755 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.751+0000 7feac0c88740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7feaa400f1b0 con 0x5641da7749a0 2024-09-19T09:00:31.755 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.751+0000 7feab6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641da784bc0 0x5641da78ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:31.755 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.751+0000 7feac0c88740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7feaa400c3f0 con 0x5641da78fc70 2024-09-19T09:00:31.755 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.751+0000 7feab6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641da784bc0 0x5641da78ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57256/0 (socket says 172.21.15.19:57256) 2024-09-19T09:00:31.755 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.751+0000 7feab6ffd640 1 -- 172.21.15.19:0/3599205582 learned_addr learned my addr 172.21.15.19:0/3599205582 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:31.755 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.751+0000 7feac0c88740 10 client.0 _ll_register_callbacks cb 0x7feaa8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:31.755 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.751+0000 7feab77fe640 1 --2- 172.21.15.19:0/3599205582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641da7749a0 0x5641da78e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:31.755 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.751+0000 7feab7fff640 1 --2- 172.21.15.19:0/3599205582 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641da78fc70 0x5641da7900d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:31.755 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.752+0000 7feab6ffd640 1 -- 172.21.15.19:0/3599205582 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641da78fc70 msgr2=0x5641da7900d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:31.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.752+0000 7feab6ffd640 1 --2- 172.21.15.19:0/3599205582 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641da78fc70 0x5641da7900d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:31.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.752+0000 7feab6ffd640 1 -- 172.21.15.19:0/3599205582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641da7749a0 msgr2=0x5641da78e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:31.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.752+0000 7feab6ffd640 1 --2- 172.21.15.19:0/3599205582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641da7749a0 0x5641da78e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:31.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.752+0000 7feab6ffd640 1 -- 172.21.15.19:0/3599205582 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641da790660 con 0x5641da784bc0 2024-09-19T09:00:31.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.752+0000 7feab6ffd640 1 --2- 172.21.15.19:0/3599205582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641da784bc0 0x5641da78ec60 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7feaac09c0a0 tx=0x7feaac000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dabfa67f4de45d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:31.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.752+0000 7fea96ffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:00:31.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.752+0000 7fea96ffd640 1 -- 172.21.15.19:0/3599205582 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaac0a4cd0 con 0x5641da784bc0 2024-09-19T09:00:31.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.752+0000 7feac0c88740 1 -- 172.21.15.19:0/3599205582 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feaac0bc0b0 con 0x5641da784bc0 2024-09-19T09:00:31.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.752+0000 7fea96ffd640 1 -- 172.21.15.19:0/3599205582 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7feaac098780 con 0x5641da784bc0 2024-09-19T09:00:31.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.753+0000 7fea96ffd640 1 -- 172.21.15.19:0/3599205582 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7feaac09b560 con 0x5641da784bc0 2024-09-19T09:00:31.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.753+0000 7feac0c88740 10 client.17226 fetch_fsmap learned FSMap version 36 2024-09-19T09:00:31.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.753+0000 7feac0c88740 1 -- 172.21.15.19:0/3599205582 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5641da800230 con 0x5641da784bc0 2024-09-19T09:00:31.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.753+0000 7fea96ffd640 1 -- 172.21.15.19:0/3599205582 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7feaac0bc0b0 con 0x5641da784bc0 2024-09-19T09:00:31.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.753+0000 7fea96ffd640 1 -- 172.21.15.19:0/3599205582 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7feaac010ac0 con 0x5641da784bc0 2024-09-19T09:00:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.753+0000 7feac0c88740 10 client.17226 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:00:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.753+0000 7feac0c88740 10 client.17226 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:00:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.753+0000 7feac0c88740 20 client.17226 populate_metadata read hostname 'smithi019' 2024-09-19T09:00:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.753+0000 7feac0c88740 1 --2- 172.21.15.19:0/3599205582 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5641da8009e0 0x5641da802e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.753+0000 7feac0c88740 4 client.17226 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:00:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.753+0000 7feac0c88740 1 -- 172.21.15.19:0/3599205582 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5641da6e1d70 con 0x5641da8009e0 2024-09-19T09:00:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.753+0000 7feab77fe640 1 --2- 172.21.15.19:0/3599205582 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5641da8009e0 0x5641da802e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.754+0000 7feab77fe640 1 --2- 172.21.15.19:0/3599205582 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5641da8009e0 0x5641da802e00 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d63fc4048fc0630e server_cookie=91d21c9e2b6380ca in_seq=0 out_seq=0 2024-09-19T09:00:31.757 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:31.754+0000 7fea96ffd640 10 client.17226 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:00:32.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:31 smithi155 ceph-mon[34921]: pgmap v586: 97 pgs: 97 active+clean; 23 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 845 KiB/s wr, 208 op/s 2024-09-19T09:00:32.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:31 smithi203 ceph-mon[35450]: pgmap v586: 97 pgs: 97 active+clean; 23 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 845 KiB/s wr, 208 op/s 2024-09-19T09:00:32.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:31 smithi019 ceph-mon[30976]: pgmap v586: 97 pgs: 97 active+clean; 23 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1021 KiB/s rd, 845 KiB/s wr, 208 op/s 2024-09-19T09:00:32.531 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:32.530+0000 7fea96ffd640 1 -- 172.21.15.19:0/3599205582 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5641da6e1d70 con 0x5641da8009e0 2024-09-19T09:00:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:32.530+0000 7fea96ffd640 10 client.17226 handle_command_reply: tid=0 2024-09-19T09:00:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:32.530+0000 7feac0c88740 1 client.17226 shutdown 2024-09-19T09:00:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:32.530+0000 7feac0c88740 1 -- 172.21.15.19:0/3599205582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641da784bc0 msgr2=0x5641da78ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:32.530+0000 7feac0c88740 1 --2- 172.21.15.19:0/3599205582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641da784bc0 0x5641da78ec60 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7feaac09c0a0 tx=0x7feaac000bc0 comp rx=0 tx=0).stop 2024-09-19T09:00:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:32.530+0000 7feac0c88740 1 -- 172.21.15.19:0/3599205582 shutdown_connections 2024-09-19T09:00:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:32.530+0000 7feac0c88740 1 --2- 172.21.15.19:0/3599205582 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5641da8009e0 0x5641da802e00 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:32.530+0000 7fea96ffd640 0 client.17226 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:00:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:32.530+0000 7feac0c88740 1 --2- 172.21.15.19:0/3599205582 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5641da78fc70 0x5641da7900d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:32.530+0000 7feac0c88740 1 --2- 172.21.15.19:0/3599205582 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5641da784bc0 0x5641da78ec60 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:32.530+0000 7feac0c88740 1 --2- 172.21.15.19:0/3599205582 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5641da7749a0 0x5641da78e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:32.531+0000 7feac0c88740 1 -- 172.21.15.19:0/3599205582 >> 172.21.15.19:0/3599205582 conn(0x5641da771f90 msgr2=0x5641da7709a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:32.531+0000 7feac0c88740 1 -- 172.21.15.19:0/3599205582 shutdown_connections 2024-09-19T09:00:32.532 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:32.531+0000 7feac0c88740 1 -- 172.21.15.19:0/3599205582 wait complete. 2024-09-19T09:00:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:32.531+0000 7feac0c88740 20 client.17226 trim_cache size 0 max 16384 2024-09-19T09:00:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T09:00:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T09:00:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T09:00:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T09:00:32.534 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:32.532+0000 7feabde17640 1 -- 172.21.15.19:0/919625704 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7feaa00a3460 msgr2=0x7feaa00a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:32.535 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:32.532+0000 7feabde17640 1 --2- 172.21.15.19:0/919625704 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7feaa00a3460 0x7feaa00a5920 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7feab0005fd0 tx=0x7feab0009500 comp rx=0 tx=0).stop 2024-09-19T09:00:32.535 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:32.532+0000 7feabde17640 1 -- 172.21.15.19:0/919625704 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feab8102d50 msgr2=0x7feab8198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:32.535 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:32.532+0000 7feabde17640 1 --2- 172.21.15.19:0/919625704 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feab8102d50 0x7feab8198330 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7feaac00e9f0 tx=0x7feaac00eeb0 comp rx=0 tx=0).stop 2024-09-19T09:00:32.535 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:32.532+0000 7feabde17640 1 -- 172.21.15.19:0/919625704 shutdown_connections 2024-09-19T09:00:32.535 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:32.532+0000 7feabde17640 1 --2- 172.21.15.19:0/919625704 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7feaa00a3460 0x7feaa00a5920 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:32.535 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:32.532+0000 7feabde17640 1 --2- 172.21.15.19:0/919625704 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feab8103710 0x7feab819f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:32.535 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:32.532+0000 7feabde17640 1 --2- 172.21.15.19:0/919625704 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7feab8102d50 0x7feab8198330 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:32.535 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:32.532+0000 7feabde17640 1 --2- 172.21.15.19:0/919625704 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7feab8101b60 0x7feab8197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:32.535 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:32.532+0000 7feabde17640 1 -- 172.21.15.19:0/919625704 >> 172.21.15.19:0/919625704 conn(0x7feab80fd2e0 msgr2=0x7feab8106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:32.535 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:32.532+0000 7feabde17640 1 -- 172.21.15.19:0/919625704 shutdown_connections 2024-09-19T09:00:32.535 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:32.532+0000 7feabde17640 1 -- 172.21.15.19:0/919625704 wait complete. 2024-09-19T09:00:34.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:33 smithi155 ceph-mon[34921]: pgmap v587: 97 pgs: 97 active+clean; 24 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 945 KiB/s wr, 886 op/s 2024-09-19T09:00:34.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:33 smithi203 ceph-mon[35450]: pgmap v587: 97 pgs: 97 active+clean; 24 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 945 KiB/s wr, 886 op/s 2024-09-19T09:00:34.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:33 smithi019 ceph-mon[30976]: pgmap v587: 97 pgs: 97 active+clean; 24 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 945 KiB/s wr, 886 op/s 2024-09-19T09:00:35.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:34 smithi155 ceph-mon[34921]: scrub summary: idle+waiting paths [/] 2024-09-19T09:00:35.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:34 smithi203 ceph-mon[35450]: scrub summary: idle+waiting paths [/] 2024-09-19T09:00:35.321 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:34 smithi019 ceph-mon[30976]: scrub summary: idle+waiting paths [/] 2024-09-19T09:00:36.133 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:35 smithi203 ceph-mon[35450]: pgmap v588: 97 pgs: 97 active+clean; 20 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 452 KiB/s wr, 1.44k op/s 2024-09-19T09:00:36.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:35 smithi155 ceph-mon[34921]: pgmap v588: 97 pgs: 97 active+clean; 20 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 452 KiB/s wr, 1.44k op/s 2024-09-19T09:00:36.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:35 smithi019 ceph-mon[30976]: pgmap v588: 97 pgs: 97 active+clean; 20 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 452 KiB/s wr, 1.44k op/s 2024-09-19T09:00:37.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:36 smithi155 ceph-mon[34921]: scrub summary: idle 2024-09-19T09:00:37.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:36 smithi203 ceph-mon[35450]: scrub summary: idle 2024-09-19T09:00:37.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:36 smithi019 ceph-mon[30976]: scrub summary: idle 2024-09-19T09:00:38.177 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:37 smithi155 ceph-mon[34921]: pgmap v589: 97 pgs: 97 active+clean; 9.7 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 340 KiB/s wr, 2.11k op/s 2024-09-19T09:00:38.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:37 smithi203 ceph-mon[35450]: pgmap v589: 97 pgs: 97 active+clean; 9.7 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 340 KiB/s wr, 2.11k op/s 2024-09-19T09:00:38.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:37 smithi019 ceph-mon[30976]: pgmap v589: 97 pgs: 97 active+clean; 9.7 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 340 KiB/s wr, 2.11k op/s 2024-09-19T09:00:40.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:39 smithi155 ceph-mon[34921]: pgmap v590: 97 pgs: 97 active+clean; 5.7 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 335 KiB/s wr, 2.82k op/s 2024-09-19T09:00:40.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:39 smithi203 ceph-mon[35450]: pgmap v590: 97 pgs: 97 active+clean; 5.7 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 335 KiB/s wr, 2.82k op/s 2024-09-19T09:00:40.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:39 smithi019 ceph-mon[30976]: pgmap v590: 97 pgs: 97 active+clean; 5.7 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 335 KiB/s wr, 2.82k op/s 2024-09-19T09:00:42.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:41 smithi155 ceph-mon[34921]: pgmap v591: 97 pgs: 97 active+clean; 5.7 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 335 KiB/s wr, 2.81k op/s 2024-09-19T09:00:42.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:41 smithi203 ceph-mon[35450]: pgmap v591: 97 pgs: 97 active+clean; 5.7 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 335 KiB/s wr, 2.81k op/s 2024-09-19T09:00:42.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:41 smithi019 ceph-mon[30976]: pgmap v591: 97 pgs: 97 active+clean; 5.7 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 335 KiB/s wr, 2.81k op/s 2024-09-19T09:00:42.675 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:00:42.951 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:43.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.430+0000 7f15df25e640 1 -- 172.21.15.19:0/1750262569 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15d81027a0 msgr2=0x7f15d81067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:43.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.430+0000 7f15df25e640 1 --2- 172.21.15.19:0/1750262569 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15d81027a0 0x7f15d81067f0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f15cc009900 tx=0x7f15cc02a410 comp rx=0 tx=0).stop 2024-09-19T09:00:43.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.430+0000 7f15df25e640 1 -- 172.21.15.19:0/1750262569 shutdown_connections 2024-09-19T09:00:43.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.430+0000 7f15df25e640 1 --2- 172.21.15.19:0/1750262569 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15d8106f20 0x7f15d810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:43.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.430+0000 7f15df25e640 1 --2- 172.21.15.19:0/1750262569 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15d81027a0 0x7f15d81067f0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:43.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.430+0000 7f15df25e640 1 --2- 172.21.15.19:0/1750262569 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f15d8101df0 0x7f15d81021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:43.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.430+0000 7f15df25e640 1 -- 172.21.15.19:0/1750262569 >> 172.21.15.19:0/1750262569 conn(0x7f15d80fd8b0 msgr2=0x7f15d80ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:43.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.430+0000 7f15df25e640 1 -- 172.21.15.19:0/1750262569 shutdown_connections 2024-09-19T09:00:43.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.430+0000 7f15df25e640 1 -- 172.21.15.19:0/1750262569 wait complete. 2024-09-19T09:00:43.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.431+0000 7f15df25e640 1 Processor -- start 2024-09-19T09:00:43.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.431+0000 7f15df25e640 1 -- start start 2024-09-19T09:00:43.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.431+0000 7f15df25e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15d8101df0 0x7f15d8198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:43.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.431+0000 7f15df25e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f15d81027a0 0x7f15d8198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:43.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.431+0000 7f15df25e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15d8106f20 0x7f15d819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:43.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.431+0000 7f15df25e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f15d8111f80 con 0x7f15d8106f20 2024-09-19T09:00:43.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.431+0000 7f15df25e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f15d8111e00 con 0x7f15d8101df0 2024-09-19T09:00:43.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.431+0000 7f15df25e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f15d8112100 con 0x7f15d81027a0 2024-09-19T09:00:43.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.431+0000 7f15dd7fb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15d8106f20 0x7f15d819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:43.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.431+0000 7f15dd7fb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15d8106f20 0x7f15d819cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59140/0 (socket says 172.21.15.19:59140) 2024-09-19T09:00:43.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.431+0000 7f15dd7fb640 1 -- 172.21.15.19:0/1938502468 learned_addr learned my addr 172.21.15.19:0/1938502468 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:43.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.431+0000 7f15dcffa640 1 --2- 172.21.15.19:0/1938502468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15d8101df0 0x7f15d8198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:43.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.431+0000 7f15d7fff640 1 --2- 172.21.15.19:0/1938502468 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f15d81027a0 0x7f15d8198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:43.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.431+0000 7f15dd7fb640 1 -- 172.21.15.19:0/1938502468 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f15d81027a0 msgr2=0x7f15d8198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:43.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.431+0000 7f15dd7fb640 1 --2- 172.21.15.19:0/1938502468 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f15d81027a0 0x7f15d8198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:43.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.431+0000 7f15dd7fb640 1 -- 172.21.15.19:0/1938502468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15d8101df0 msgr2=0x7f15d8198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:43.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.432+0000 7f15dd7fb640 1 --2- 172.21.15.19:0/1938502468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15d8101df0 0x7f15d8198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:43.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.432+0000 7f15dd7fb640 1 -- 172.21.15.19:0/1938502468 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15d819d3f0 con 0x7f15d8106f20 2024-09-19T09:00:43.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.432+0000 7f15dd7fb640 1 --2- 172.21.15.19:0/1938502468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15d8106f20 0x7f15d819cd10 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f15d000eaa0 tx=0x7f15d000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:43.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.432+0000 7f15d5ffb640 1 -- 172.21.15.19:0/1938502468 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d000cdb0 con 0x7f15d8106f20 2024-09-19T09:00:43.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.432+0000 7f15d5ffb640 1 -- 172.21.15.19:0/1938502468 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15d0005020 con 0x7f15d8106f20 2024-09-19T09:00:43.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.432+0000 7f15d5ffb640 1 -- 172.21.15.19:0/1938502468 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15d00116b0 con 0x7f15d8106f20 2024-09-19T09:00:43.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.432+0000 7f15df25e640 1 -- 172.21.15.19:0/1938502468 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15d819d6e0 con 0x7f15d8106f20 2024-09-19T09:00:43.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.432+0000 7f15df25e640 1 -- 172.21.15.19:0/1938502468 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15d81a4fc0 con 0x7f15d8106f20 2024-09-19T09:00:43.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.433+0000 7f15df25e640 1 -- 172.21.15.19:0/1938502468 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15d81021d0 con 0x7f15d8106f20 2024-09-19T09:00:43.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.434+0000 7f15d5ffb640 1 -- 172.21.15.19:0/1938502468 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f15d0005560 con 0x7f15d8106f20 2024-09-19T09:00:43.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.435+0000 7f15d5ffb640 1 --2- 172.21.15.19:0/1938502468 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f15c00a3240 0x7f15c00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:43.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.435+0000 7f15d5ffb640 1 -- 172.21.15.19:0/1938502468 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f15d00cfac0 con 0x7f15d8106f20 2024-09-19T09:00:43.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.435+0000 7f15dcffa640 1 --2- 172.21.15.19:0/1938502468 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f15c00a3240 0x7f15c00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:43.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.435+0000 7f15dcffa640 1 --2- 172.21.15.19:0/1938502468 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f15c00a3240 0x7f15c00a5700 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f15c80058c0 tx=0x7f15c800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:43.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.439+0000 7f15d5ffb640 1 -- 172.21.15.19:0/1938502468 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f15d0016030 con 0x7f15d8106f20 2024-09-19T09:00:43.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.653+0000 7f15df25e640 1 -- 172.21.15.19:0/1938502468 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15d810a1c0 con 0x7f15d8106f20 2024-09-19T09:00:43.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.654+0000 7f15d5ffb640 1 -- 172.21.15.19:0/1938502468 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11983 (secure 0 0 0) 0x7f15d009c140 con 0x7f15d8106f20 2024-09-19T09:00:43.654 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T09:00:43.654 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":36,"btime":"2024-09-19T08:59:00:695758+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":26453,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3907362737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3907362737},{"type":"v1","addr":"172.21.15.155:6835","nonce":3907362737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":35,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T08:58:50.493979+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6839/2452068876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2452068876},{"type":"v1","addr":"172.21.15.19:6839","nonce":2452068876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24463,24464,24490,24469,24497]},"id":1}]} 2024-09-19T09:00:43.655 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 36 2024-09-19T09:00:43.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.656+0000 7f15df25e640 1 -- 172.21.15.19:0/1938502468 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f15c00a3240 msgr2=0x7f15c00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:43.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.656+0000 7f15df25e640 1 --2- 172.21.15.19:0/1938502468 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f15c00a3240 0x7f15c00a5700 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f15c80058c0 tx=0x7f15c800a2d0 comp rx=0 tx=0).stop 2024-09-19T09:00:43.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.656+0000 7f15df25e640 1 -- 172.21.15.19:0/1938502468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15d8106f20 msgr2=0x7f15d819cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:43.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.656+0000 7f15df25e640 1 --2- 172.21.15.19:0/1938502468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15d8106f20 0x7f15d819cd10 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f15d000eaa0 tx=0x7f15d000ef60 comp rx=0 tx=0).stop 2024-09-19T09:00:43.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.656+0000 7f15df25e640 1 -- 172.21.15.19:0/1938502468 shutdown_connections 2024-09-19T09:00:43.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.656+0000 7f15df25e640 1 --2- 172.21.15.19:0/1938502468 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f15c00a3240 0x7f15c00a5700 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:43.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.656+0000 7f15df25e640 1 --2- 172.21.15.19:0/1938502468 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f15d81027a0 0x7f15d8198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:43.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.656+0000 7f15df25e640 1 --2- 172.21.15.19:0/1938502468 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15d8106f20 0x7f15d819cd10 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:43.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.656+0000 7f15df25e640 1 --2- 172.21.15.19:0/1938502468 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15d8101df0 0x7f15d8198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:43.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.656+0000 7f15df25e640 1 -- 172.21.15.19:0/1938502468 >> 172.21.15.19:0/1938502468 conn(0x7f15d80fd8b0 msgr2=0x7f15d80febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:43.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.656+0000 7f15df25e640 1 -- 172.21.15.19:0/1938502468 shutdown_connections 2024-09-19T09:00:43.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:43.656+0000 7f15df25e640 1 -- 172.21.15.19:0/1938502468 wait complete. 2024-09-19T09:00:43.953 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:43 smithi019 ceph-mon[30976]: pgmap v592: 97 pgs: 97 active+clean; 5.9 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 279 KiB/s wr, 2.81k op/s 2024-09-19T09:00:43.953 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:43 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1938502468' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:44.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:43 smithi155 ceph-mon[34921]: pgmap v592: 97 pgs: 97 active+clean; 5.9 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 279 KiB/s wr, 2.81k op/s 2024-09-19T09:00:44.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:43 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1938502468' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:44.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:43 smithi203 ceph-mon[35450]: pgmap v592: 97 pgs: 97 active+clean; 5.9 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 279 KiB/s wr, 2.81k op/s 2024-09-19T09:00:44.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:43 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1938502468' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:44.371 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db --set-id 30ed91a0 --release --await' 2024-09-19T09:00:44.372 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db --set-id 30ed91a0 --release --await 2024-09-19T09:00:44.646 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:44.722 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:00:45.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.146+0000 7f9d3cdf4640 1 -- 172.21.15.19:0/2114754680 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d38106f20 msgr2=0x7f9d3810eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:45.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.146+0000 7f9d3cdf4640 1 --2- 172.21.15.19:0/2114754680 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d38106f20 0x7f9d3810eaa0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f9d30009900 tx=0x7f9d3002a410 comp rx=0 tx=0).stop 2024-09-19T09:00:45.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.146+0000 7f9d3cdf4640 1 -- 172.21.15.19:0/2114754680 shutdown_connections 2024-09-19T09:00:45.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.146+0000 7f9d3cdf4640 1 --2- 172.21.15.19:0/2114754680 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d381027a0 0x7f9d381067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.146+0000 7f9d3cdf4640 1 --2- 172.21.15.19:0/2114754680 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d38106f20 0x7f9d3810eaa0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.146+0000 7f9d3cdf4640 1 --2- 172.21.15.19:0/2114754680 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d38101df0 0x7f9d381021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.146+0000 7f9d3cdf4640 1 -- 172.21.15.19:0/2114754680 >> 172.21.15.19:0/2114754680 conn(0x7f9d380fd8f0 msgr2=0x7f9d380ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:45.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.146+0000 7f9d3cdf4640 1 -- 172.21.15.19:0/2114754680 shutdown_connections 2024-09-19T09:00:45.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.146+0000 7f9d3cdf4640 1 -- 172.21.15.19:0/2114754680 wait complete. 2024-09-19T09:00:45.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.147+0000 7f9d3cdf4640 1 Processor -- start 2024-09-19T09:00:45.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.147+0000 7f9d3cdf4640 1 -- start start 2024-09-19T09:00:45.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.147+0000 7f9d3cdf4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d38101df0 0x7f9d381983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.147+0000 7f9d3cdf4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d381027a0 0x7f9d38198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.147+0000 7f9d3cdf4640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d38106f20 0x7f9d3819ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.147+0000 7f9d3cdf4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9d38111f80 con 0x7f9d38101df0 2024-09-19T09:00:45.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.148+0000 7f9d3cdf4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9d38111e00 con 0x7f9d381027a0 2024-09-19T09:00:45.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.148+0000 7f9d3cdf4640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9d38112100 con 0x7f9d38106f20 2024-09-19T09:00:45.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.148+0000 7f9d3659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d38101df0 0x7f9d381983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.148+0000 7f9d3659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d38101df0 0x7f9d381983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59160/0 (socket says 172.21.15.19:59160) 2024-09-19T09:00:45.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.148+0000 7f9d3659c640 1 -- 172.21.15.19:0/3841421268 learned_addr learned my addr 172.21.15.19:0/3841421268 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:45.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.148+0000 7f9d36d9d640 1 --2- 172.21.15.19:0/3841421268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d38106f20 0x7f9d3819ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.148+0000 7f9d3659c640 1 -- 172.21.15.19:0/3841421268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d38106f20 msgr2=0x7f9d3819ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:45.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.148+0000 7f9d3659c640 1 --2- 172.21.15.19:0/3841421268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d38106f20 0x7f9d3819ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.148+0000 7f9d3659c640 1 -- 172.21.15.19:0/3841421268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d381027a0 msgr2=0x7f9d38198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:45.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.148+0000 7f9d35d9b640 1 --2- 172.21.15.19:0/3841421268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d381027a0 0x7f9d38198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.148+0000 7f9d3659c640 1 --2- 172.21.15.19:0/3841421268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d381027a0 0x7f9d38198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.148+0000 7f9d3659c640 1 -- 172.21.15.19:0/3841421268 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d3819d390 con 0x7f9d38101df0 2024-09-19T09:00:45.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.148+0000 7f9d35d9b640 1 --2- 172.21.15.19:0/3841421268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d381027a0 0x7f9d38198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:00:45.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.148+0000 7f9d3659c640 1 --2- 172.21.15.19:0/3841421268 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d38101df0 0x7f9d381983e0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f9d2800d950 tx=0x7f9d2800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:45.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.148+0000 7f9d277fe640 1 -- 172.21.15.19:0/3841421268 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d28017070 con 0x7f9d38101df0 2024-09-19T09:00:45.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.148+0000 7f9d277fe640 1 -- 172.21.15.19:0/3841421268 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d28009c30 con 0x7f9d38101df0 2024-09-19T09:00:45.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.148+0000 7f9d3cdf4640 1 -- 172.21.15.19:0/3841421268 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d3819d680 con 0x7f9d38101df0 2024-09-19T09:00:45.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.148+0000 7f9d277fe640 1 -- 172.21.15.19:0/3841421268 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2800f6b0 con 0x7f9d38101df0 2024-09-19T09:00:45.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.148+0000 7f9d3cdf4640 1 -- 172.21.15.19:0/3841421268 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d381a4f60 con 0x7f9d38101df0 2024-09-19T09:00:45.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.151+0000 7f9d277fe640 1 -- 172.21.15.19:0/3841421268 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f9d280109d0 con 0x7f9d38101df0 2024-09-19T09:00:45.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.151+0000 7f9d3f1cd740 1 Processor -- start 2024-09-19T09:00:45.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.151+0000 7f9d3f1cd740 1 -- start start 2024-09-19T09:00:45.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.151+0000 7f9d3f1cd740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55740be74470 0x55740be74850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.151+0000 7f9d3f1cd740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55740be74d90 0x55740be7f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.151+0000 7f9d3f1cd740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55740be7f650 0x55740be81a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.151+0000 7f9d277fe640 1 --2- 172.21.15.19:0/3841421268 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9d200a3240 0x7f9d200a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.152+0000 7f9d3f1cd740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55740bdd5620 con 0x55740be74d90 2024-09-19T09:00:45.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.152+0000 7f9d3f1cd740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55740bd7ce50 con 0x55740be7f650 2024-09-19T09:00:45.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.152+0000 7f9d3f1cd740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55740bdd15e0 con 0x55740be74470 2024-09-19T09:00:45.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.152+0000 7f9d3659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55740be74d90 0x55740be7f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.152+0000 7f9d3659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55740be74d90 0x55740be7f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59168/0 (socket says 172.21.15.19:59168) 2024-09-19T09:00:45.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.152+0000 7f9d3659c640 1 -- 172.21.15.19:0/620667581 learned_addr learned my addr 172.21.15.19:0/620667581 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:45.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.152+0000 7f9d36d9d640 1 --2- 172.21.15.19:0/3841421268 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9d200a3240 0x7f9d200a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.152+0000 7f9d36d9d640 1 --2- 172.21.15.19:0/620667581 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55740be74470 0x55740be74850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.152+0000 7f9d277fe640 1 -- 172.21.15.19:0/3841421268 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9d280cf6a0 con 0x7f9d38101df0 2024-09-19T09:00:45.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.152+0000 7f9d35d9b640 1 --2- 172.21.15.19:0/620667581 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55740be7f650 0x55740be81a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.152+0000 7f9d3659c640 1 -- 172.21.15.19:0/620667581 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55740be74470 msgr2=0x55740be74850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:45.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.152+0000 7f9d3659c640 1 --2- 172.21.15.19:0/620667581 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55740be74470 0x55740be74850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.152+0000 7f9d3659c640 1 -- 172.21.15.19:0/620667581 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55740be7f650 msgr2=0x55740be81a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:45.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.152+0000 7f9d3659c640 1 --2- 172.21.15.19:0/620667581 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55740be7f650 0x55740be81a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.152+0000 7f9d3659c640 1 -- 172.21.15.19:0/620667581 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55740bd6dd40 con 0x55740be74d90 2024-09-19T09:00:45.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.152+0000 7f9d35d9b640 1 --2- 172.21.15.19:0/620667581 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55740be7f650 0x55740be81a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:00:45.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.152+0000 7f9d3659c640 1 --2- 172.21.15.19:0/620667581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55740be74d90 0x55740be7f110 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f9d2809b6d0 tx=0x7f9d2806eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ea7ec56aa7bebc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:45.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.152+0000 7f9d36d9d640 1 --2- 172.21.15.19:0/3841421268 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9d200a3240 0x7f9d200a5700 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9d30031550 tx=0x7f9d300058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:45.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.152+0000 7f9d24ff9640 1 -- 172.21.15.19:0/620667581 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d28066b10 con 0x55740be74d90 2024-09-19T09:00:45.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.153+0000 7f9d24ff9640 1 -- 172.21.15.19:0/620667581 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d28009de0 con 0x55740be74d90 2024-09-19T09:00:45.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.153+0000 7f9d24ff9640 1 -- 172.21.15.19:0/620667581 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d280982e0 con 0x55740be74d90 2024-09-19T09:00:45.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.153+0000 7f9d3f1cd740 1 -- 172.21.15.19:0/620667581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55740be74d90 msgr2=0x55740be7f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:45.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.153+0000 7f9d3f1cd740 1 --2- 172.21.15.19:0/620667581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55740be74d90 0x55740be7f110 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f9d2809b6d0 tx=0x7f9d2806eaf0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.153+0000 7f9d3f1cd740 1 -- 172.21.15.19:0/620667581 shutdown_connections 2024-09-19T09:00:45.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.153+0000 7f9d3f1cd740 1 --2- 172.21.15.19:0/620667581 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55740be7f650 0x55740be81a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.153+0000 7f9d3f1cd740 1 --2- 172.21.15.19:0/620667581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55740be74d90 0x55740be7f110 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.153+0000 7f9d3f1cd740 1 --2- 172.21.15.19:0/620667581 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55740be74470 0x55740be74850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.153+0000 7f9d3f1cd740 1 -- 172.21.15.19:0/620667581 >> 172.21.15.19:0/620667581 conn(0x55740be70a00 msgr2=0x55740be70de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:45.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.153+0000 7f9d3f1cd740 1 -- 172.21.15.19:0/620667581 shutdown_connections 2024-09-19T09:00:45.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.153+0000 7f9d3f1cd740 1 -- 172.21.15.19:0/620667581 wait complete. 2024-09-19T09:00:45.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.154+0000 7f9d3f1cd740 1 -- start start 2024-09-19T09:00:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.154+0000 7f9d3f1cd740 1 Processor -- start 2024-09-19T09:00:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.154+0000 7f9d3f1cd740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55740be74470 0x55740be7c520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.154+0000 7f9d3f1cd740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55740be74d90 0x55740be7ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.154+0000 7f9d3f1cd740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55740be7f650 0x55740be7cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.154+0000 7f9d3f1cd740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55740be82220 con 0x55740be74d90 2024-09-19T09:00:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.154+0000 7f9d3f1cd740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55740bd5df10 con 0x55740be74470 2024-09-19T09:00:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.154+0000 7f9d3f1cd740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55740be823a0 con 0x55740be7f650 2024-09-19T09:00:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.154+0000 7f9d3f1cd740 10 client.0 _ll_register_callbacks cb 0x55740bd81db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.154+0000 7f9d35d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55740be74d90 0x55740be7ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.154+0000 7f9d35d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55740be74d90 0x55740be7ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59176/0 (socket says 172.21.15.19:59176) 2024-09-19T09:00:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.154+0000 7f9d35d9b640 1 -- 172.21.15.19:0/4212211144 learned_addr learned my addr 172.21.15.19:0/4212211144 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.154+0000 7f9d3659c640 1 --2- 172.21.15.19:0/4212211144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55740be74470 0x55740be7c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.154+0000 7f9d36d9d640 1 --2- 172.21.15.19:0/4212211144 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55740be7f650 0x55740be7cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.154+0000 7f9d35d9b640 1 -- 172.21.15.19:0/4212211144 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55740be7f650 msgr2=0x55740be7cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:45.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.154+0000 7f9d35d9b640 1 --2- 172.21.15.19:0/4212211144 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55740be7f650 0x55740be7cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.155+0000 7f9d35d9b640 1 -- 172.21.15.19:0/4212211144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55740be74470 msgr2=0x55740be7c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:45.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.155+0000 7f9d35d9b640 1 --2- 172.21.15.19:0/4212211144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55740be74470 0x55740be7c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.155+0000 7f9d35d9b640 1 -- 172.21.15.19:0/4212211144 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55740bae4580 con 0x55740be74d90 2024-09-19T09:00:45.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.155+0000 7f9d36d9d640 1 --2- 172.21.15.19:0/4212211144 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55740be7f650 0x55740be7cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:00:45.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.155+0000 7f9d35d9b640 1 --2- 172.21.15.19:0/4212211144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55740be74d90 0x55740be7ca60 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c00fa90 tx=0x7f9d2c00ff50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5709ed2a3d3cadaa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:45.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.155+0000 7f9d1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:00:45.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.155+0000 7f9d1dffb640 1 -- 172.21.15.19:0/4212211144 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d2c00ddf0 con 0x55740be74d90 2024-09-19T09:00:45.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.155+0000 7f9d1dffb640 1 -- 172.21.15.19:0/4212211144 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9d2c01b480 con 0x55740be74d90 2024-09-19T09:00:45.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.155+0000 7f9d3f1cd740 1 -- 172.21.15.19:0/4212211144 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d28009de0 con 0x55740be74d90 2024-09-19T09:00:45.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.155+0000 7f9d1dffb640 1 -- 172.21.15.19:0/4212211144 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f9d2c01b680 con 0x55740be74d90 2024-09-19T09:00:45.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.155+0000 7f9d3f1cd740 10 client.17244 fetch_fsmap learned FSMap version 36 2024-09-19T09:00:45.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.155+0000 7f9d3f1cd740 1 -- 172.21.15.19:0/4212211144 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55740bbae960 con 0x55740be74d90 2024-09-19T09:00:45.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.155+0000 7f9d1dffb640 1 -- 172.21.15.19:0/4212211144 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d28009de0 con 0x55740be74d90 2024-09-19T09:00:45.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.155+0000 7f9d1dffb640 1 -- 172.21.15.19:0/4212211144 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f9d2c010a00 con 0x55740be74d90 2024-09-19T09:00:45.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.156+0000 7f9d3f1cd740 10 client.17244 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:00:45.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.156+0000 7f9d3f1cd740 10 client.17244 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:00:45.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.156+0000 7f9d3f1cd740 20 client.17244 populate_metadata read hostname 'smithi019' 2024-09-19T09:00:45.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.156+0000 7f9d3f1cd740 1 --2- 172.21.15.19:0/4212211144 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55740be8f250 0x55740be91690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.156+0000 7f9d3f1cd740 4 client.17244 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:00:45.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.156+0000 7f9d3f1cd740 1 -- 172.21.15.19:0/4212211144 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55740bde2b90 con 0x55740be8f250 2024-09-19T09:00:45.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.156+0000 7f9d3659c640 1 --2- 172.21.15.19:0/4212211144 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55740be8f250 0x55740be91690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.157+0000 7f9d3659c640 1 --2- 172.21.15.19:0/4212211144 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55740be8f250 0x55740be91690 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddea601d94f296cb server_cookie=adc3bf31656e583d in_seq=0 out_seq=0 2024-09-19T09:00:45.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.157+0000 7f9d1dffb640 10 client.17244 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:00:45.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.157+0000 7f9d1dffb640 1 -- 172.21.15.19:0/4212211144 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55740bde2b90 con 0x55740be8f250 2024-09-19T09:00:45.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.157+0000 7f9d1dffb640 10 client.17244 handle_command_reply: tid=0 2024-09-19T09:00:45.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.157+0000 7f9d3f1cd740 1 client.17244 shutdown 2024-09-19T09:00:45.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.157+0000 7f9d3f1cd740 1 -- 172.21.15.19:0/4212211144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55740be74d90 msgr2=0x55740be7ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:45.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.157+0000 7f9d3f1cd740 1 --2- 172.21.15.19:0/4212211144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55740be74d90 0x55740be7ca60 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c00fa90 tx=0x7f9d2c00ff50 comp rx=0 tx=0).stop 2024-09-19T09:00:45.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.157+0000 7f9d3f1cd740 1 -- 172.21.15.19:0/4212211144 shutdown_connections 2024-09-19T09:00:45.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.157+0000 7f9d3f1cd740 1 --2- 172.21.15.19:0/4212211144 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55740be8f250 0x55740be91690 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.157+0000 7f9d3f1cd740 1 --2- 172.21.15.19:0/4212211144 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55740be7f650 0x55740be7cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.157+0000 7f9d3f1cd740 1 --2- 172.21.15.19:0/4212211144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55740be74d90 0x55740be7ca60 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.157+0000 7f9d1dffb640 0 client.17244 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:00:45.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.157+0000 7f9d3f1cd740 1 --2- 172.21.15.19:0/4212211144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55740be74470 0x55740be7c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.158+0000 7f9d3f1cd740 1 -- 172.21.15.19:0/4212211144 >> 172.21.15.19:0/4212211144 conn(0x55740be70a00 msgr2=0x55740be6b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:45.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.158+0000 7f9d3f1cd740 1 -- 172.21.15.19:0/4212211144 shutdown_connections 2024-09-19T09:00:45.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.158+0000 7f9d3f1cd740 1 -- 172.21.15.19:0/4212211144 wait complete. 2024-09-19T09:00:45.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.158+0000 7f9d3f1cd740 20 client.17244 trim_cache size 0 max 16384 2024-09-19T09:00:45.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.175+0000 7f9d3f1cd740 1 Processor -- start 2024-09-19T09:00:45.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.175+0000 7f9d3f1cd740 1 -- start start 2024-09-19T09:00:45.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.175+0000 7f9d3f1cd740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55740be70a00 0x55740be76ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.175+0000 7f9d3f1cd740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55740be74470 0x55740be6b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.175+0000 7f9d3f1cd740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55740be74d90 0x55740be96f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.175+0000 7f9d3f1cd740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9d381ab380 con 0x55740be74d90 2024-09-19T09:00:45.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.175+0000 7f9d3f1cd740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9d381acec0 con 0x55740be74470 2024-09-19T09:00:45.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.175+0000 7f9d3f1cd740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9d381aba50 con 0x55740be70a00 2024-09-19T09:00:45.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.175+0000 7f9d36d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55740be74d90 0x55740be96f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.175+0000 7f9d36d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55740be74d90 0x55740be96f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59180/0 (socket says 172.21.15.19:59180) 2024-09-19T09:00:45.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.175+0000 7f9d36d9d640 1 -- 172.21.15.19:0/2848405664 learned_addr learned my addr 172.21.15.19:0/2848405664 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:45.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.175+0000 7f9d35d9b640 1 --2- 172.21.15.19:0/2848405664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55740be74470 0x55740be6b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.176+0000 7f9d3659c640 1 --2- 172.21.15.19:0/2848405664 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55740be70a00 0x55740be76ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.176+0000 7f9d36d9d640 1 -- 172.21.15.19:0/2848405664 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55740be70a00 msgr2=0x55740be76ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:45.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.176+0000 7f9d36d9d640 1 --2- 172.21.15.19:0/2848405664 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55740be70a00 0x55740be76ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.176+0000 7f9d36d9d640 1 -- 172.21.15.19:0/2848405664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55740be74470 msgr2=0x55740be6b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:45.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.176+0000 7f9d36d9d640 1 --2- 172.21.15.19:0/2848405664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55740be74470 0x55740be6b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.176+0000 7f9d36d9d640 1 -- 172.21.15.19:0/2848405664 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55740be70830 con 0x55740be74d90 2024-09-19T09:00:45.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.176+0000 7f9d36d9d640 1 --2- 172.21.15.19:0/2848405664 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55740be74d90 0x55740be96f60 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f9d30033000 tx=0x7f9d3003d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17d53a1e006080c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:45.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.176+0000 7f9d1ffff640 1 -- 172.21.15.19:0/2848405664 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d3004e070 con 0x55740be74d90 2024-09-19T09:00:45.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.176+0000 7f9d1ffff640 1 -- 172.21.15.19:0/2848405664 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d30005520 con 0x55740be74d90 2024-09-19T09:00:45.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.176+0000 7f9d1ffff640 1 -- 172.21.15.19:0/2848405664 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d30035040 con 0x55740be74d90 2024-09-19T09:00:45.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.177+0000 7f9d3f1cd740 1 -- 172.21.15.19:0/2848405664 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55740be74d90 msgr2=0x55740be96f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:45.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.177+0000 7f9d3f1cd740 1 --2- 172.21.15.19:0/2848405664 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55740be74d90 0x55740be96f60 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f9d30033000 tx=0x7f9d3003d000 comp rx=0 tx=0).stop 2024-09-19T09:00:45.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.177+0000 7f9d3f1cd740 1 -- 172.21.15.19:0/2848405664 shutdown_connections 2024-09-19T09:00:45.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.177+0000 7f9d3f1cd740 1 --2- 172.21.15.19:0/2848405664 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55740be74d90 0x55740be96f60 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.177+0000 7f9d3f1cd740 1 --2- 172.21.15.19:0/2848405664 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55740be74470 0x55740be6b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.177+0000 7f9d3f1cd740 1 --2- 172.21.15.19:0/2848405664 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55740be70a00 0x55740be76ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.177+0000 7f9d3f1cd740 1 -- 172.21.15.19:0/2848405664 >> 172.21.15.19:0/2848405664 conn(0x55740be67720 msgr2=0x55740be6af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:45.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.177+0000 7f9d3f1cd740 1 -- 172.21.15.19:0/2848405664 shutdown_connections 2024-09-19T09:00:45.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.177+0000 7f9d3f1cd740 1 -- 172.21.15.19:0/2848405664 wait complete. 2024-09-19T09:00:45.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.177+0000 7f9d3f1cd740 1 -- start start 2024-09-19T09:00:45.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.177+0000 7f9d3f1cd740 1 Processor -- start 2024-09-19T09:00:45.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.178+0000 7f9d3f1cd740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55740be70a00 0x55740be83c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.178+0000 7f9d3f1cd740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55740be74470 0x55740be841b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.178+0000 7f9d3f1cd740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55740be74d90 0x55740bef2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.178+0000 7f9d3f1cd740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9d381ac7f0 con 0x55740be70a00 2024-09-19T09:00:45.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.178+0000 7f9d3f1cd740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9d381ac120 con 0x55740be74d90 2024-09-19T09:00:45.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.178+0000 7f9d3f1cd740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9d381a9360 con 0x55740be74470 2024-09-19T09:00:45.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.178+0000 7f9d3f1cd740 10 client.0 _ll_register_callbacks cb 0x7f9d2c00f5f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:45.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.178+0000 7f9d3659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55740be70a00 0x55740be83c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.178+0000 7f9d3659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55740be70a00 0x55740be83c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59192/0 (socket says 172.21.15.19:59192) 2024-09-19T09:00:45.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.178+0000 7f9d3659c640 1 -- 172.21.15.19:0/2576207944 learned_addr learned my addr 172.21.15.19:0/2576207944 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:45.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.178+0000 7f9d35d9b640 1 --2- 172.21.15.19:0/2576207944 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55740be74470 0x55740be841b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.178+0000 7f9d36d9d640 1 --2- 172.21.15.19:0/2576207944 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55740be74d90 0x55740bef2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.178+0000 7f9d3659c640 1 -- 172.21.15.19:0/2576207944 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55740be74470 msgr2=0x55740be841b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:45.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.178+0000 7f9d3659c640 1 --2- 172.21.15.19:0/2576207944 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55740be74470 0x55740be841b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.178+0000 7f9d3659c640 1 -- 172.21.15.19:0/2576207944 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55740be74d90 msgr2=0x55740bef2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:45.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.178+0000 7f9d3659c640 1 --2- 172.21.15.19:0/2576207944 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55740be74d90 0x55740bef2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.178+0000 7f9d3659c640 1 -- 172.21.15.19:0/2576207944 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55740bef35b0 con 0x55740be70a00 2024-09-19T09:00:45.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.179+0000 7f9d3659c640 1 --2- 172.21.15.19:0/2576207944 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55740be70a00 0x55740be83c70 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f9d2809bc00 tx=0x7f9d28010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba6210a50ee00b11 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:45.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.179+0000 7f9d1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:00:45.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.179+0000 7f9d1dffb640 1 -- 172.21.15.19:0/2576207944 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d28020070 con 0x55740be70a00 2024-09-19T09:00:45.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.179+0000 7f9d1dffb640 1 -- 172.21.15.19:0/2576207944 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9d28066a40 con 0x55740be70a00 2024-09-19T09:00:45.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.179+0000 7f9d3f1cd740 1 -- 172.21.15.19:0/2576207944 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d30005520 con 0x55740be70a00 2024-09-19T09:00:45.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.179+0000 7f9d1dffb640 1 -- 172.21.15.19:0/2576207944 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f9d28009de0 con 0x55740be70a00 2024-09-19T09:00:45.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.179+0000 7f9d3f1cd740 10 client.17250 fetch_fsmap learned FSMap version 36 2024-09-19T09:00:45.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.179+0000 7f9d3f1cd740 1 -- 172.21.15.19:0/2576207944 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55740befa9a0 con 0x55740be70a00 2024-09-19T09:00:45.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.179+0000 7f9d1dffb640 1 -- 172.21.15.19:0/2576207944 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9d30005520 con 0x55740be70a00 2024-09-19T09:00:45.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.179+0000 7f9d1dffb640 1 -- 172.21.15.19:0/2576207944 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f9d2809b0c0 con 0x55740be70a00 2024-09-19T09:00:45.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.179+0000 7f9d3f1cd740 10 client.17250 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:00:45.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.179+0000 7f9d3f1cd740 10 client.17250 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:00:45.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.179+0000 7f9d3f1cd740 20 client.17250 populate_metadata read hostname 'smithi019' 2024-09-19T09:00:45.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.179+0000 7f9d3f1cd740 1 --2- 172.21.15.19:0/2576207944 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55740be7f650 0x55740befcb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.180+0000 7f9d3f1cd740 4 client.17250 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "30ed91a0", "release": true, "await": true}] 2024-09-19T09:00:45.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.180+0000 7f9d3f1cd740 1 -- 172.21.15.19:0/2576207944 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "quiesce db", "set_id": "30ed91a0", "release": true, "await": true}) -- 0x55740bddd0a0 con 0x55740be7f650 2024-09-19T09:00:45.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.180+0000 7f9d35d9b640 1 --2- 172.21.15.19:0/2576207944 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55740be7f650 0x55740befcb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.180+0000 7f9d1dffb640 10 client.17250 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:00:45.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.180+0000 7f9d35d9b640 1 --2- 172.21.15.19:0/2576207944 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55740be7f650 0x55740befcb80 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2981c679e8147b24 server_cookie=56e7534afe7ed46b in_seq=0 out_seq=0 2024-09-19T09:00:45.242 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:45.625 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.624+0000 7fde729ed640 1 -- 172.21.15.19:0/2623729603 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde6c104f50 msgr2=0x7fde6c107340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:45.626 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.624+0000 7fde729ed640 1 --2- 172.21.15.19:0/2623729603 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde6c104f50 0x7fde6c107340 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fde60009900 tx=0x7fde6002a410 comp rx=0 tx=0).stop 2024-09-19T09:00:45.626 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.624+0000 7fde729ed640 1 -- 172.21.15.19:0/2623729603 shutdown_connections 2024-09-19T09:00:45.626 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.624+0000 7fde729ed640 1 --2- 172.21.15.19:0/2623729603 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde6c107880 0x7fde6c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.626 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.624+0000 7fde729ed640 1 --2- 172.21.15.19:0/2623729603 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde6c104f50 0x7fde6c107340 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.626 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.624+0000 7fde729ed640 1 --2- 172.21.15.19:0/2623729603 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde6c102620 0x7fde6c104a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.626 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.624+0000 7fde729ed640 1 -- 172.21.15.19:0/2623729603 >> 172.21.15.19:0/2623729603 conn(0x7fde6c0fc1e0 msgr2=0x7fde6c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:45.626 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.624+0000 7fde729ed640 1 -- 172.21.15.19:0/2623729603 shutdown_connections 2024-09-19T09:00:45.626 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.624+0000 7fde729ed640 1 -- 172.21.15.19:0/2623729603 wait complete. 2024-09-19T09:00:45.626 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.625+0000 7fde729ed640 1 Processor -- start 2024-09-19T09:00:45.626 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.625+0000 7fde729ed640 1 -- start start 2024-09-19T09:00:45.628 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.625+0000 7fde729ed640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde6c102620 0x7fde6c197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.628 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.625+0000 7fde729ed640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde6c104f50 0x7fde6c1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.628 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.625+0000 7fde729ed640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde6c107880 0x7fde6c19f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.628 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.625+0000 7fde729ed640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fde6c10d850 con 0x7fde6c107880 2024-09-19T09:00:45.628 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.625+0000 7fde729ed640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fde6c10d6d0 con 0x7fde6c102620 2024-09-19T09:00:45.628 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.625+0000 7fde729ed640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fde6c10d9d0 con 0x7fde6c104f50 2024-09-19T09:00:45.628 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.626+0000 7fde70f8a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde6c107880 0x7fde6c19f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.629 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.626+0000 7fde6bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde6c102620 0x7fde6c197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.629 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.626+0000 7fde70f8a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde6c107880 0x7fde6c19f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60782/0 (socket says 172.21.15.19:60782) 2024-09-19T09:00:45.629 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.626+0000 7fde70f8a640 1 -- 172.21.15.19:0/4250224750 learned_addr learned my addr 172.21.15.19:0/4250224750 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:45.629 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.626+0000 7fde6b7fe640 1 --2- 172.21.15.19:0/4250224750 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde6c104f50 0x7fde6c1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.629 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.626+0000 7fde6bfff640 1 -- 172.21.15.19:0/4250224750 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde6c104f50 msgr2=0x7fde6c1983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:45.629 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.626+0000 7fde6bfff640 1 --2- 172.21.15.19:0/4250224750 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde6c104f50 0x7fde6c1983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.629 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.626+0000 7fde6bfff640 1 -- 172.21.15.19:0/4250224750 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde6c107880 msgr2=0x7fde6c19f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:45.629 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.626+0000 7fde6bfff640 1 --2- 172.21.15.19:0/4250224750 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde6c107880 0x7fde6c19f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.629 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.626+0000 7fde6bfff640 1 -- 172.21.15.19:0/4250224750 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde6c19fac0 con 0x7fde6c102620 2024-09-19T09:00:45.629 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.626+0000 7fde6b7fe640 1 --2- 172.21.15.19:0/4250224750 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde6c104f50 0x7fde6c1983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:00:45.629 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.626+0000 7fde6bfff640 1 --2- 172.21.15.19:0/4250224750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde6c102620 0x7fde6c197ea0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fde5c00d720 tx=0x7fde5c00dbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:45.629 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.626+0000 7fde697fa640 1 -- 172.21.15.19:0/4250224750 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde5c017070 con 0x7fde6c102620 2024-09-19T09:00:45.629 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.626+0000 7fde697fa640 1 -- 172.21.15.19:0/4250224750 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde5c00de30 con 0x7fde6c102620 2024-09-19T09:00:45.629 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.626+0000 7fde729ed640 1 -- 172.21.15.19:0/4250224750 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde6c19fdb0 con 0x7fde6c102620 2024-09-19T09:00:45.630 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.626+0000 7fde697fa640 1 -- 172.21.15.19:0/4250224750 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde5c0047a0 con 0x7fde6c102620 2024-09-19T09:00:45.630 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.626+0000 7fde729ed640 1 -- 172.21.15.19:0/4250224750 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde6c1a01c0 con 0x7fde6c102620 2024-09-19T09:00:45.632 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.630+0000 7fde7585d740 1 Processor -- start 2024-09-19T09:00:45.632 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.630+0000 7fde697fa640 1 -- 172.21.15.19:0/4250224750 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fde5c0099d0 con 0x7fde6c102620 2024-09-19T09:00:45.632 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.630+0000 7fde7585d740 1 -- start start 2024-09-19T09:00:45.632 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.630+0000 7fde7585d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564f4f40db0 0x5564f4f411b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.632 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.630+0000 7fde7585d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564f4f416f0 0x5564f4f461b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.632 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.630+0000 7fde7585d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564f4f46780 0x5564f4f48c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.632 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.630+0000 7fde7585d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5564f4ea02f0 con 0x5564f4f46780 2024-09-19T09:00:45.632 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.630+0000 7fde7585d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5564f4e48270 con 0x5564f4f40db0 2024-09-19T09:00:45.632 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.630+0000 7fde7585d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5564f4e9c2b0 con 0x5564f4f416f0 2024-09-19T09:00:45.632 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.630+0000 7fde6b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564f4f46780 0x5564f4f48c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.632 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.630+0000 7fde70f8a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564f4f40db0 0x5564f4f411b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.633 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.630+0000 7fde6b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564f4f46780 0x5564f4f48c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60794/0 (socket says 172.21.15.19:60794) 2024-09-19T09:00:45.633 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.630+0000 7fde70f8a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564f4f40db0 0x5564f4f411b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:52560/0 (socket says 172.21.15.19:52560) 2024-09-19T09:00:45.633 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.630+0000 7fde6b7fe640 1 -- 172.21.15.19:0/3233346956 learned_addr learned my addr 172.21.15.19:0/3233346956 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:45.633 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.630+0000 7fde6bfff640 1 --2- 172.21.15.19:0/3233346956 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564f4f416f0 0x5564f4f461b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.633 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.630+0000 7fde70f8a640 1 -- 172.21.15.19:0/3233346956 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564f4f416f0 msgr2=0x5564f4f461b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:45.633 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.630+0000 7fde70f8a640 1 --2- 172.21.15.19:0/3233346956 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564f4f416f0 0x5564f4f461b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.633 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.630+0000 7fde70f8a640 1 -- 172.21.15.19:0/3233346956 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564f4f46780 msgr2=0x5564f4f48c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:45.633 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.630+0000 7fde70f8a640 1 --2- 172.21.15.19:0/3233346956 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564f4f46780 0x5564f4f48c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.633 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.630+0000 7fde70f8a640 1 -- 172.21.15.19:0/3233346956 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564f4e47340 con 0x5564f4f40db0 2024-09-19T09:00:45.633 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.630+0000 7fde697fa640 1 --2- 172.21.15.19:0/4250224750 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fde540a32f0 0x7fde540a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.633 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.631+0000 7fde6bfff640 1 --2- 172.21.15.19:0/4250224750 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fde540a32f0 0x7fde540a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.633 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.631+0000 7fde70f8a640 1 --2- 172.21.15.19:0/3233346956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564f4f40db0 0x5564f4f411b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fde64009f90 tx=0x7fde640118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4c4b6396a1fe654 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:45.633 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.631+0000 7fde697fa640 1 -- 172.21.15.19:0/4250224750 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fde5c0cf5c0 con 0x7fde6c102620 2024-09-19T09:00:45.633 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.631+0000 7fde527fc640 1 -- 172.21.15.19:0/3233346956 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde64004d20 con 0x5564f4f40db0 2024-09-19T09:00:45.634 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.631+0000 7fde527fc640 1 -- 172.21.15.19:0/3233346956 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde64004050 con 0x5564f4f40db0 2024-09-19T09:00:45.634 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.631+0000 7fde527fc640 1 -- 172.21.15.19:0/3233346956 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde64005280 con 0x5564f4f40db0 2024-09-19T09:00:45.637 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.632+0000 7fde7585d740 1 -- 172.21.15.19:0/3233346956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564f4f40db0 msgr2=0x5564f4f411b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:45.637 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.632+0000 7fde6bfff640 1 --2- 172.21.15.19:0/4250224750 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fde540a32f0 0x7fde540a57b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fde5c0cd440 tx=0x7fde5c086040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:45.637 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.632+0000 7fde7585d740 1 --2- 172.21.15.19:0/3233346956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564f4f40db0 0x5564f4f411b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fde64009f90 tx=0x7fde640118d0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.638 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.632+0000 7fde7585d740 1 -- 172.21.15.19:0/3233346956 shutdown_connections 2024-09-19T09:00:45.638 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.632+0000 7fde7585d740 1 --2- 172.21.15.19:0/3233346956 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564f4f416f0 0x5564f4f461b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.638 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.632+0000 7fde7585d740 1 --2- 172.21.15.19:0/3233346956 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564f4f46780 0x5564f4f48c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.638 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.632+0000 7fde7585d740 1 --2- 172.21.15.19:0/3233346956 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564f4f40db0 0x5564f4f411b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.638 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.632+0000 7fde7585d740 1 -- 172.21.15.19:0/3233346956 >> 172.21.15.19:0/3233346956 conn(0x5564f4f38010 msgr2=0x5564f4f38410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:45.638 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.632+0000 7fde7585d740 1 -- 172.21.15.19:0/3233346956 shutdown_connections 2024-09-19T09:00:45.638 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.632+0000 7fde7585d740 1 -- 172.21.15.19:0/3233346956 wait complete. 2024-09-19T09:00:45.638 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.632+0000 7fde7585d740 1 -- start start 2024-09-19T09:00:45.638 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.632+0000 7fde7585d740 1 Processor -- start 2024-09-19T09:00:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.633+0000 7fde7585d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564f4f40db0 0x5564f4f4afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.633+0000 7fde7585d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564f4f416f0 0x5564f4f4b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.633+0000 7fde7585d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564f4f46780 0x5564f4f52530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.633+0000 7fde7585d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5564f4f49750 con 0x5564f4f46780 2024-09-19T09:00:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.633+0000 7fde7585d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5564f4e29290 con 0x5564f4f40db0 2024-09-19T09:00:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.633+0000 7fde7585d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5564f4f498d0 con 0x5564f4f416f0 2024-09-19T09:00:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.633+0000 7fde7585d740 10 client.0 _ll_register_callbacks cb 0x5564f4e5a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.633+0000 7fde70f8a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564f4f40db0 0x5564f4f4afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.633+0000 7fde6b7fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564f4f416f0 0x5564f4f4b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.633+0000 7fde70f8a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564f4f40db0 0x5564f4f4afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:52576/0 (socket says 172.21.15.19:52576) 2024-09-19T09:00:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.633+0000 7fde70f8a640 1 -- 172.21.15.19:0/263346127 learned_addr learned my addr 172.21.15.19:0/263346127 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.633+0000 7fde70f8a640 1 --2- 172.21.15.19:0/263346127 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564f4f46780 0x5564f4f52530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.639 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.633+0000 7fde6b7fe640 1 -- 172.21.15.19:0/263346127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564f4f40db0 msgr2=0x5564f4f4afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:45.640 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.633+0000 7fde6b7fe640 1 --2- 172.21.15.19:0/263346127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564f4f40db0 0x5564f4f4afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.640 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.633+0000 7fde6b7fe640 1 -- 172.21.15.19:0/263346127 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564f4f46780 msgr2=0x5564f4f52530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:45.640 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.633+0000 7fde6b7fe640 1 --2- 172.21.15.19:0/263346127 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564f4f46780 0x5564f4f52530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.640 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.633+0000 7fde6b7fe640 1 -- 172.21.15.19:0/263346127 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564f4bb3210 con 0x5564f4f416f0 2024-09-19T09:00:45.640 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.633+0000 7fde6b7fe640 1 --2- 172.21.15.19:0/263346127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564f4f416f0 0x5564f4f4b4f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fde60031610 tx=0x7fde60005270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41af20fa1a80c03d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:45.640 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.633+0000 7fde4b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T09:00:45.640 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.634+0000 7fde4b7fe640 1 -- 172.21.15.19:0/263346127 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde60035040 con 0x5564f4f416f0 2024-09-19T09:00:45.640 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.634+0000 7fde7585d740 1 -- 172.21.15.19:0/263346127 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde64004050 con 0x5564f4f416f0 2024-09-19T09:00:45.640 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.634+0000 7fde4b7fe640 1 -- 172.21.15.19:0/263346127 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fde600316b0 con 0x5564f4f416f0 2024-09-19T09:00:45.640 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.634+0000 7fde4b7fe640 1 -- 172.21.15.19:0/263346127 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fde600318b0 con 0x5564f4f416f0 2024-09-19T09:00:45.640 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.634+0000 7fde7585d740 10 client.26641 fetch_fsmap learned FSMap version 36 2024-09-19T09:00:45.640 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.634+0000 7fde7585d740 1 -- 172.21.15.19:0/263346127 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5564f4c7f620 con 0x5564f4f416f0 2024-09-19T09:00:45.640 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.634+0000 7fde4b7fe640 1 -- 172.21.15.19:0/263346127 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde64004050 con 0x5564f4f416f0 2024-09-19T09:00:45.640 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.634+0000 7fde4b7fe640 1 -- 172.21.15.19:0/263346127 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fde600035f0 con 0x5564f4f416f0 2024-09-19T09:00:45.641 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.634+0000 7fde7585d740 10 client.26641 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:00:45.641 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.634+0000 7fde7585d740 10 client.26641 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:00:45.641 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.634+0000 7fde7585d740 20 client.26641 populate_metadata read hostname 'smithi019' 2024-09-19T09:00:45.641 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.634+0000 7fde7585d740 1 --2- 172.21.15.19:0/263346127 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5564f4f56c20 0x5564f4f59010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.641 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.634+0000 7fde7585d740 4 client.26641 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:00:45.641 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.634+0000 7fde7585d740 1 -- 172.21.15.19:0/263346127 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5564f4eada20 con 0x5564f4f56c20 2024-09-19T09:00:45.641 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.634+0000 7fde70f8a640 1 --2- 172.21.15.19:0/263346127 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5564f4f56c20 0x5564f4f59010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.641 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.635+0000 7fde4b7fe640 10 client.26641 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:00:45.641 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:45.635+0000 7fde70f8a640 1 --2- 172.21.15.19:0/263346127 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5564f4f56c20 0x5564f4f59010 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb0375bd5442ce4c server_cookie=2b39227cbb2a5d1f in_seq=0 out_seq=0 2024-09-19T09:00:45.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.732+0000 7fde5ae2b640 1 -- 172.21.15.19:0/474812859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde54100e20 msgr2=0x7fde54101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:45.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.732+0000 7fde5ae2b640 1 --2- 172.21.15.19:0/474812859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde54100e20 0x7fde54101200 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fde48009900 tx=0x7fde4802a480 comp rx=0 tx=0).stop 2024-09-19T09:00:45.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.732+0000 7fde5ae2b640 1 -- 172.21.15.19:0/474812859 shutdown_connections 2024-09-19T09:00:45.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.732+0000 7fde5ae2b640 1 --2- 172.21.15.19:0/474812859 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde54102570 0x7fde541029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.732+0000 7fde5ae2b640 1 --2- 172.21.15.19:0/474812859 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde54102ef0 0x7fde5410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.732+0000 7fde5ae2b640 1 --2- 172.21.15.19:0/474812859 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde54100e20 0x7fde54101200 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.732+0000 7fde5ae2b640 1 -- 172.21.15.19:0/474812859 >> 172.21.15.19:0/474812859 conn(0x7fde540fc7d0 msgr2=0x7fde540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:45.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.732+0000 7fde5ae2b640 1 -- 172.21.15.19:0/474812859 shutdown_connections 2024-09-19T09:00:45.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.732+0000 7fde5ae2b640 1 -- 172.21.15.19:0/474812859 wait complete. 2024-09-19T09:00:45.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.733+0000 7fde5ae2b640 1 Processor -- start 2024-09-19T09:00:45.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.733+0000 7fde5ae2b640 1 -- start start 2024-09-19T09:00:45.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.733+0000 7fde5ae2b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde54100e20 0x7fde54103750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.733+0000 7fde5ae2b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde54102570 0x7fde54103c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.733+0000 7fde5ae2b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde54102ef0 0x7fde541041d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.733+0000 7fde5ae2b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fde54110fd0 con 0x7fde54102570 2024-09-19T09:00:45.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.733+0000 7fde5ae2b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fde54110e50 con 0x7fde54100e20 2024-09-19T09:00:45.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.733+0000 7fde5ae2b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fde54111150 con 0x7fde54102ef0 2024-09-19T09:00:45.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.733+0000 7fde53fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde54102570 0x7fde54103c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.733+0000 7fde53fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde54102570 0x7fde54103c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60820/0 (socket says 172.21.15.19:60820) 2024-09-19T09:00:45.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.733+0000 7fde53fff640 1 -- 172.21.15.19:0/3283531007 learned_addr learned my addr 172.21.15.19:0/3283531007 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:45.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.733+0000 7fde58bc7640 1 --2- 172.21.15.19:0/3283531007 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde54100e20 0x7fde54103750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.733+0000 7fde593c8640 1 --2- 172.21.15.19:0/3283531007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde54102ef0 0x7fde541041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.734+0000 7fde53fff640 1 -- 172.21.15.19:0/3283531007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde54102ef0 msgr2=0x7fde541041d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:45.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.734+0000 7fde53fff640 1 --2- 172.21.15.19:0/3283531007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde54102ef0 0x7fde541041d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.734+0000 7fde53fff640 1 -- 172.21.15.19:0/3283531007 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde54100e20 msgr2=0x7fde54103750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:45.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.734+0000 7fde53fff640 1 --2- 172.21.15.19:0/3283531007 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde54100e20 0x7fde54103750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.734+0000 7fde53fff640 1 -- 172.21.15.19:0/3283531007 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde541a6a20 con 0x7fde54102570 2024-09-19T09:00:45.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.734+0000 7fde593c8640 1 --2- 172.21.15.19:0/3283531007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde54102ef0 0x7fde541041d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:00:45.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.734+0000 7fde53fff640 1 --2- 172.21.15.19:0/3283531007 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde54102570 0x7fde54103c90 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fde4000d770 tx=0x7fde4000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:45.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.734+0000 7fde51ffb640 1 -- 172.21.15.19:0/3283531007 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde40017070 con 0x7fde54102570 2024-09-19T09:00:45.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.734+0000 7fde5ae2b640 1 -- 172.21.15.19:0/3283531007 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde541a6d10 con 0x7fde54102570 2024-09-19T09:00:45.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.734+0000 7fde51ffb640 1 -- 172.21.15.19:0/3283531007 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde40005500 con 0x7fde54102570 2024-09-19T09:00:45.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.734+0000 7fde51ffb640 1 -- 172.21.15.19:0/3283531007 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde40004e00 con 0x7fde54102570 2024-09-19T09:00:45.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.734+0000 7fde5ae2b640 1 -- 172.21.15.19:0/3283531007 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde541a71a0 con 0x7fde54102570 2024-09-19T09:00:45.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.737+0000 7fde5d204740 1 Processor -- start 2024-09-19T09:00:45.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.737+0000 7fde51ffb640 1 -- 172.21.15.19:0/3283531007 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fde40004fa0 con 0x7fde54102570 2024-09-19T09:00:45.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.738+0000 7fde5d204740 1 -- start start 2024-09-19T09:00:45.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.738+0000 7fde5d204740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619708da4a0 0x5619708da880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.738+0000 7fde5d204740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619708dadc0 0x5619708e5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.738+0000 7fde5d204740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619708e5680 0x5619708e7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.738+0000 7fde5d204740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5619708402e0 con 0x5619708dadc0 2024-09-19T09:00:45.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.738+0000 7fde5d204740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5619707e7ce0 con 0x5619708e5680 2024-09-19T09:00:45.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.738+0000 7fde5d204740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56197083c2a0 con 0x5619708da4a0 2024-09-19T09:00:45.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.738+0000 7fde58bc7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619708dadc0 0x5619708e5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.738+0000 7fde58bc7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619708dadc0 0x5619708e5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60830/0 (socket says 172.21.15.19:60830) 2024-09-19T09:00:45.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.738+0000 7fde58bc7640 1 -- 172.21.15.19:0/1711599696 learned_addr learned my addr 172.21.15.19:0/1711599696 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:45.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.738+0000 7fde53fff640 1 --2- 172.21.15.19:0/1711599696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619708e5680 0x5619708e7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.738+0000 7fde593c8640 1 --2- 172.21.15.19:0/1711599696 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619708da4a0 0x5619708da880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.738+0000 7fde593c8640 1 -- 172.21.15.19:0/1711599696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619708e5680 msgr2=0x5619708e7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:45.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.738+0000 7fde593c8640 1 --2- 172.21.15.19:0/1711599696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619708e5680 0x5619708e7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.738+0000 7fde593c8640 1 -- 172.21.15.19:0/1711599696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619708dadc0 msgr2=0x5619708e5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:45.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.738+0000 7fde593c8640 1 --2- 172.21.15.19:0/1711599696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619708dadc0 0x5619708e5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.738+0000 7fde593c8640 1 -- 172.21.15.19:0/1711599696 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619707cc440 con 0x5619708da4a0 2024-09-19T09:00:45.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.739+0000 7fde58bc7640 1 --2- 172.21.15.19:0/1711599696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619708dadc0 0x5619708e5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:45.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.739+0000 7fde51ffb640 1 --2- 172.21.15.19:0/3283531007 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fde440a3240 0x7fde440a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.739+0000 7fde58bc7640 1 --2- 172.21.15.19:0/3283531007 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fde440a3240 0x7fde440a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.739+0000 7fde593c8640 1 --2- 172.21.15.19:0/1711599696 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619708da4a0 0x5619708da880 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fde4c009f10 tx=0x7fde4c0107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d12b11c7808fa136 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:45.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.739+0000 7fde51ffb640 1 -- 172.21.15.19:0/3283531007 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fde400cf380 con 0x7fde54102570 2024-09-19T09:00:45.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.739+0000 7fde3effd640 1 -- 172.21.15.19:0/1711599696 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde4c01c680 con 0x5619708da4a0 2024-09-19T09:00:45.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.739+0000 7fde3effd640 1 -- 172.21.15.19:0/1711599696 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde4c01cd00 con 0x5619708da4a0 2024-09-19T09:00:45.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.739+0000 7fde3effd640 1 -- 172.21.15.19:0/1711599696 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde4c01a380 con 0x5619708da4a0 2024-09-19T09:00:45.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.740+0000 7fde5d204740 1 -- 172.21.15.19:0/1711599696 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619708da4a0 msgr2=0x5619708da880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:45.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.740+0000 7fde5d204740 1 --2- 172.21.15.19:0/1711599696 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619708da4a0 0x5619708da880 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fde4c009f10 tx=0x7fde4c0107a0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.740+0000 7fde58bc7640 1 --2- 172.21.15.19:0/3283531007 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fde440a3240 0x7fde440a5700 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x5619708d7890 tx=0x7fde48005b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:45.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.740+0000 7fde5d204740 1 -- 172.21.15.19:0/1711599696 shutdown_connections 2024-09-19T09:00:45.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.740+0000 7fde5d204740 1 --2- 172.21.15.19:0/1711599696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619708e5680 0x5619708e7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.740+0000 7fde5d204740 1 --2- 172.21.15.19:0/1711599696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619708dadc0 0x5619708e5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.740+0000 7fde5d204740 1 --2- 172.21.15.19:0/1711599696 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619708da4a0 0x5619708da880 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.740+0000 7fde5d204740 1 -- 172.21.15.19:0/1711599696 >> 172.21.15.19:0/1711599696 conn(0x5619708d6a30 msgr2=0x5619708d6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:45.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.740+0000 7fde5d204740 1 -- 172.21.15.19:0/1711599696 shutdown_connections 2024-09-19T09:00:45.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.740+0000 7fde5d204740 1 -- 172.21.15.19:0/1711599696 wait complete. 2024-09-19T09:00:45.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.740+0000 7fde5d204740 1 -- start start 2024-09-19T09:00:45.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.741+0000 7fde5d204740 1 Processor -- start 2024-09-19T09:00:45.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.741+0000 7fde5d204740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619708da4a0 0x5619708e4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.741+0000 7fde5d204740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619708dadc0 0x5619708e22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.741+0000 7fde5d204740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619708e5680 0x5619708e2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.741+0000 7fde5d204740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5619708e8250 con 0x5619708da4a0 2024-09-19T09:00:45.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.741+0000 7fde5d204740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5619707fb050 con 0x5619708dadc0 2024-09-19T09:00:45.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.741+0000 7fde5d204740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5619708e83d0 con 0x5619708e5680 2024-09-19T09:00:45.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.741+0000 7fde5d204740 10 client.0 _ll_register_callbacks cb 0x56197083b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:45.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.741+0000 7fde58bc7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619708da4a0 0x5619708e4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.741+0000 7fde58bc7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619708da4a0 0x5619708e4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60846/0 (socket says 172.21.15.19:60846) 2024-09-19T09:00:45.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.741+0000 7fde58bc7640 1 -- 172.21.15.19:0/448711775 learned_addr learned my addr 172.21.15.19:0/448711775 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:45.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.741+0000 7fde53fff640 1 --2- 172.21.15.19:0/448711775 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619708dadc0 0x5619708e22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.741+0000 7fde593c8640 1 --2- 172.21.15.19:0/448711775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619708e5680 0x5619708e2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.742+0000 7fde58bc7640 1 -- 172.21.15.19:0/448711775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619708e5680 msgr2=0x5619708e2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:45.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.742+0000 7fde58bc7640 1 --2- 172.21.15.19:0/448711775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619708e5680 0x5619708e2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.742+0000 7fde58bc7640 1 -- 172.21.15.19:0/448711775 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619708dadc0 msgr2=0x5619708e22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:45.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.742+0000 7fde58bc7640 1 --2- 172.21.15.19:0/448711775 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619708dadc0 0x5619708e22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:45.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.742+0000 7fde58bc7640 1 -- 172.21.15.19:0/448711775 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619705b13c0 con 0x5619708da4a0 2024-09-19T09:00:45.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.742+0000 7fde53fff640 1 --2- 172.21.15.19:0/448711775 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619708dadc0 0x5619708e22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:45.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.742+0000 7fde58bc7640 1 --2- 172.21.15.19:0/448711775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619708da4a0 0x5619708e4ff0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fde4802a9a0 tx=0x7fde48009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3bbefbc4003d99b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:45.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.742+0000 7fde33fff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:00:45.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.742+0000 7fde33fff640 1 -- 172.21.15.19:0/448711775 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde4804e070 con 0x5619708da4a0 2024-09-19T09:00:45.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.742+0000 7fde33fff640 1 -- 172.21.15.19:0/448711775 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fde48004cb0 con 0x5619708da4a0 2024-09-19T09:00:45.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.742+0000 7fde5d204740 1 -- 172.21.15.19:0/448711775 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde4c01cd00 con 0x5619708da4a0 2024-09-19T09:00:45.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.742+0000 7fde33fff640 1 -- 172.21.15.19:0/448711775 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fde4805a050 con 0x5619708da4a0 2024-09-19T09:00:45.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.742+0000 7fde5d204740 10 client.17274 fetch_fsmap learned FSMap version 36 2024-09-19T09:00:45.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.742+0000 7fde5d204740 1 -- 172.21.15.19:0/448711775 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5619708f3c50 con 0x5619708da4a0 2024-09-19T09:00:45.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.743+0000 7fde33fff640 1 -- 172.21.15.19:0/448711775 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde4c01cd00 con 0x5619708da4a0 2024-09-19T09:00:45.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.743+0000 7fde33fff640 1 -- 172.21.15.19:0/448711775 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fde480327f0 con 0x5619708da4a0 2024-09-19T09:00:45.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.743+0000 7fde5d204740 10 client.17274 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:00:45.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.743+0000 7fde5d204740 10 client.17274 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:00:45.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.743+0000 7fde5d204740 20 client.17274 populate_metadata read hostname 'smithi019' 2024-09-19T09:00:45.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.743+0000 7fde5d204740 1 --2- 172.21.15.19:0/448711775 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5619708f5060 0x5619708f7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:45.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.743+0000 7fde5d204740 4 client.17274 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:00:45.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.743+0000 7fde5d204740 1 -- 172.21.15.19:0/448711775 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56197084d850 con 0x5619708f5060 2024-09-19T09:00:45.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.743+0000 7fde53fff640 1 --2- 172.21.15.19:0/448711775 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5619708f5060 0x5619708f7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:45.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.744+0000 7fde33fff640 10 client.17274 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:00:45.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:45.744+0000 7fde53fff640 1 --2- 172.21.15.19:0/448711775 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5619708f5060 0x5619708f7490 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=176d4c12b386102d server_cookie=e979330c822be8bc in_seq=0 out_seq=0 2024-09-19T09:00:46.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:45 smithi019 ceph-mon[30976]: pgmap v593: 97 pgs: 97 active+clean; 5.9 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 179 KiB/s wr, 2.11k op/s 2024-09-19T09:00:46.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:45 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:00:46.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:45 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:46.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:45 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:00:46.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:45 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:00:46.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:45 smithi155 ceph-mon[34921]: pgmap v593: 97 pgs: 97 active+clean; 5.9 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 179 KiB/s wr, 2.11k op/s 2024-09-19T09:00:46.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:45 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:00:46.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:45 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:46.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:45 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:00:46.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:45 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:00:46.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:45 smithi203 ceph-mon[35450]: pgmap v593: 97 pgs: 97 active+clean; 5.9 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 179 KiB/s wr, 2.11k op/s 2024-09-19T09:00:46.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:45 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:00:46.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:45 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:00:46.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:45 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:00:46.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:45 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:00:46.567 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.567+0000 7fde4b7fe640 1 -- 172.21.15.19:0/263346127 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5564f4eada20 con 0x5564f4f56c20 2024-09-19T09:00:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.567+0000 7fde4b7fe640 10 client.26641 handle_command_reply: tid=0 2024-09-19T09:00:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.567+0000 7fde7585d740 1 client.26641 shutdown 2024-09-19T09:00:46.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.567+0000 7f9d1dffb640 1 -- 172.21.15.19:0/2576207944 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55740bddd0a0 con 0x55740be7f650 2024-09-19T09:00:46.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.567+0000 7f9d1dffb640 10 client.17250 handle_command_reply: tid=0 2024-09-19T09:00:46.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.567+0000 7f9d3f1cd740 1 client.17250 shutdown 2024-09-19T09:00:46.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.567+0000 7f9d3f1cd740 1 -- 172.21.15.19:0/2576207944 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55740be70a00 msgr2=0x55740be83c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:46.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.567+0000 7f9d3f1cd740 1 --2- 172.21.15.19:0/2576207944 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55740be70a00 0x55740be83c70 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f9d2809bc00 tx=0x7f9d28010d70 comp rx=0 tx=0).stop 2024-09-19T09:00:46.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.567+0000 7fde33fff640 1 -- 172.21.15.19:0/448711775 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56197084d850 con 0x5619708f5060 2024-09-19T09:00:46.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.567+0000 7fde33fff640 10 client.17274 handle_command_reply: tid=0 2024-09-19T09:00:46.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.567+0000 7fde5d204740 1 client.17274 shutdown 2024-09-19T09:00:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.567+0000 7fde7585d740 1 -- 172.21.15.19:0/263346127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564f4f416f0 msgr2=0x5564f4f4b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.567+0000 7fde7585d740 1 --2- 172.21.15.19:0/263346127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564f4f416f0 0x5564f4f4b4f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fde60031610 tx=0x7fde60005270 comp rx=0 tx=0).stop 2024-09-19T09:00:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.567+0000 7fde7585d740 1 -- 172.21.15.19:0/263346127 shutdown_connections 2024-09-19T09:00:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.567+0000 7fde7585d740 1 --2- 172.21.15.19:0/263346127 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5564f4f56c20 0x5564f4f59010 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.567+0000 7fde7585d740 1 --2- 172.21.15.19:0/263346127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564f4f416f0 0x5564f4f4b4f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.599 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.567+0000 7fde7585d740 1 --2- 172.21.15.19:0/263346127 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564f4f46780 0x5564f4f52530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.599 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.567+0000 7fde7585d740 1 --2- 172.21.15.19:0/263346127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564f4f40db0 0x5564f4f4afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.599 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.567+0000 7fde7585d740 1 -- 172.21.15.19:0/263346127 >> 172.21.15.19:0/263346127 conn(0x5564f4f38010 msgr2=0x5564f4f39820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:46.599 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.567+0000 7fde4b7fe640 0 client.26641 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:00:46.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.567+0000 7f9d3f1cd740 1 -- 172.21.15.19:0/2576207944 shutdown_connections 2024-09-19T09:00:46.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.567+0000 7f9d3f1cd740 1 --2- 172.21.15.19:0/2576207944 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55740be7f650 0x55740befcb80 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.567+0000 7f9d3f1cd740 1 --2- 172.21.15.19:0/2576207944 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55740be74470 0x55740be841b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.567+0000 7f9d3f1cd740 1 --2- 172.21.15.19:0/2576207944 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55740be74d90 0x55740bef2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.567+0000 7f9d3f1cd740 1 --2- 172.21.15.19:0/2576207944 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55740be70a00 0x55740be83c70 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.567+0000 7f9d1dffb640 0 client.17250 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:00:46.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.567+0000 7f9d3f1cd740 1 -- 172.21.15.19:0/2576207944 >> 172.21.15.19:0/2576207944 conn(0x55740be67720 msgr2=0x55740be6b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:46.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.567+0000 7fde5d204740 1 -- 172.21.15.19:0/448711775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619708da4a0 msgr2=0x5619708e4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:46.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.567+0000 7f9d3f1cd740 1 -- 172.21.15.19:0/2576207944 shutdown_connections 2024-09-19T09:00:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.567+0000 7fde7585d740 1 -- 172.21.15.19:0/263346127 shutdown_connections 2024-09-19T09:00:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.567+0000 7fde7585d740 1 -- 172.21.15.19:0/263346127 wait complete. 2024-09-19T09:00:46.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.567+0000 7fde5d204740 1 --2- 172.21.15.19:0/448711775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619708da4a0 0x5619708e4ff0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7fde4802a9a0 tx=0x7fde48009260 comp rx=0 tx=0).stop 2024-09-19T09:00:46.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.567+0000 7fde5d204740 1 -- 172.21.15.19:0/448711775 shutdown_connections 2024-09-19T09:00:46.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.567+0000 7fde5d204740 1 --2- 172.21.15.19:0/448711775 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5619708f5060 0x5619708f7490 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.567+0000 7fde5d204740 1 --2- 172.21.15.19:0/448711775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619708e5680 0x5619708e2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.567+0000 7fde5d204740 1 --2- 172.21.15.19:0/448711775 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619708dadc0 0x5619708e22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.567+0000 7fde5d204740 1 --2- 172.21.15.19:0/448711775 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619708da4a0 0x5619708e4ff0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.567+0000 7fde33fff640 0 client.17274 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:00:46.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.567+0000 7fde5d204740 1 -- 172.21.15.19:0/448711775 >> 172.21.15.19:0/448711775 conn(0x5619708d6a30 msgr2=0x5619708d5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:46.602 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.568+0000 7fde7585d740 20 client.26641 trim_cache size 0 max 16384 2024-09-19T09:00:46.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.567+0000 7f9d3f1cd740 1 -- 172.21.15.19:0/2576207944 wait complete. 2024-09-19T09:00:46.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.568+0000 7fde5d204740 1 -- 172.21.15.19:0/448711775 shutdown_connections 2024-09-19T09:00:46.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.568+0000 7f9d3f1cd740 20 client.17250 trim_cache size 0 max 16384 2024-09-19T09:00:46.603 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T09:00:46.603 INFO:teuthology.orchestra.run.smithi019.stdout: "epoch": 35, 2024-09-19T09:00:46.603 INFO:teuthology.orchestra.run.smithi019.stdout: "leader": 24497, 2024-09-19T09:00:46.603 INFO:teuthology.orchestra.run.smithi019.stdout: "set_version": 28, 2024-09-19T09:00:46.603 INFO:teuthology.orchestra.run.smithi019.stdout: "sets": { 2024-09-19T09:00:46.604 INFO:teuthology.orchestra.run.smithi019.stdout: "30ed91a0": { 2024-09-19T09:00:46.604 INFO:teuthology.orchestra.run.smithi019.stdout: "version": 28, 2024-09-19T09:00:46.604 INFO:teuthology.orchestra.run.smithi019.stdout: "age_ref": 0.0, 2024-09-19T09:00:46.604 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T09:00:46.604 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RELEASED", 2024-09-19T09:00:46.604 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T09:00:46.605 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:00:46.605 INFO:teuthology.orchestra.run.smithi019.stdout: "timeout": 90.0, 2024-09-19T09:00:46.605 INFO:teuthology.orchestra.run.smithi019.stdout: "expiration": 145.8, 2024-09-19T09:00:46.605 INFO:teuthology.orchestra.run.smithi019.stdout: "members": { 2024-09-19T09:00:46.605 INFO:teuthology.orchestra.run.smithi019.stdout: "file:/": { 2024-09-19T09:00:46.605 INFO:teuthology.orchestra.run.smithi019.stdout: "excluded": false, 2024-09-19T09:00:46.606 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T09:00:46.606 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RELEASED", 2024-09-19T09:00:46.606 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T09:00:46.606 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:00:46.606 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:00:46.606 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:00:46.607 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:00:46.607 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:00:46.607 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T09:00:46.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.568+0000 7fde5d204740 1 -- 172.21.15.19:0/448711775 wait complete. 2024-09-19T09:00:46.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.568+0000 7fde5d204740 20 client.17274 trim_cache size 0 max 16384 2024-09-19T09:00:46.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.569+0000 7f9d3cdf4640 1 -- 172.21.15.19:0/3841421268 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9d200a3240 msgr2=0x7f9d200a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:46.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.569+0000 7f9d3cdf4640 1 --2- 172.21.15.19:0/3841421268 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9d200a3240 0x7f9d200a5700 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9d30031550 tx=0x7f9d300058b0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.569+0000 7f9d3cdf4640 1 -- 172.21.15.19:0/3841421268 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d38101df0 msgr2=0x7f9d381983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:46.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.569+0000 7f9d3cdf4640 1 --2- 172.21.15.19:0/3841421268 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d38101df0 0x7f9d381983e0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f9d2800d950 tx=0x7f9d2800de10 comp rx=0 tx=0).stop 2024-09-19T09:00:46.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.569+0000 7f9d3cdf4640 1 -- 172.21.15.19:0/3841421268 shutdown_connections 2024-09-19T09:00:46.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.569+0000 7f9d3cdf4640 1 --2- 172.21.15.19:0/3841421268 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9d200a3240 0x7f9d200a5700 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.569+0000 7f9d3cdf4640 1 --2- 172.21.15.19:0/3841421268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d38106f20 0x7f9d3819ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.569+0000 7f9d3cdf4640 1 --2- 172.21.15.19:0/3841421268 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9d381027a0 0x7f9d38198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.569+0000 7f9d3cdf4640 1 --2- 172.21.15.19:0/3841421268 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9d38101df0 0x7f9d381983e0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.569+0000 7f9d3cdf4640 1 -- 172.21.15.19:0/3841421268 >> 172.21.15.19:0/3841421268 conn(0x7f9d380fd8f0 msgr2=0x7f9d380fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:46.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.569+0000 7f9d3cdf4640 1 -- 172.21.15.19:0/3841421268 shutdown_connections 2024-09-19T09:00:46.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.569+0000 7f9d3cdf4640 1 -- 172.21.15.19:0/3841421268 wait complete. 2024-09-19T09:00:46.612 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.587+0000 7fde7585d740 1 Processor -- start 2024-09-19T09:00:46.612 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.587+0000 7fde7585d740 1 -- start start 2024-09-19T09:00:46.612 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.587+0000 7fde7585d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564f4f40db0 0x5564f4f370b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.612 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.587+0000 7fde7585d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564f4f416f0 0x5564f4f524f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.587+0000 7fde7585d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564f4f46780 0x5564f4f39400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.587+0000 7fde7585d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fde6c1a6df0 con 0x5564f4f46780 2024-09-19T09:00:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.587+0000 7fde7585d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fde6c1a8930 con 0x5564f4f40db0 2024-09-19T09:00:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.587+0000 7fde7585d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fde6c1a74c0 con 0x5564f4f416f0 2024-09-19T09:00:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.588+0000 7fde70f8a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564f4f46780 0x5564f4f39400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.588+0000 7fde70f8a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564f4f46780 0x5564f4f39400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60852/0 (socket says 172.21.15.19:60852) 2024-09-19T09:00:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.588+0000 7fde70f8a640 1 -- 172.21.15.19:0/2829910897 learned_addr learned my addr 172.21.15.19:0/2829910897 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:46.613 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.588+0000 7fde70f8a640 1 --2- 172.21.15.19:0/2829910897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564f4f40db0 0x5564f4f370b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.614 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.588+0000 7fde6b7fe640 1 --2- 172.21.15.19:0/2829910897 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564f4f416f0 0x5564f4f524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.614 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.588+0000 7fde70f8a640 1 -- 172.21.15.19:0/2829910897 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564f4f416f0 msgr2=0x5564f4f524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:46.614 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.588+0000 7fde70f8a640 1 --2- 172.21.15.19:0/2829910897 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564f4f416f0 0x5564f4f524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.614 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.588+0000 7fde70f8a640 1 -- 172.21.15.19:0/2829910897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564f4f40db0 msgr2=0x5564f4f370b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:46.614 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.588+0000 7fde70f8a640 1 --2- 172.21.15.19:0/2829910897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564f4f40db0 0x5564f4f370b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.614 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.588+0000 7fde70f8a640 1 -- 172.21.15.19:0/2829910897 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564f4f37e30 con 0x5564f4f46780 2024-09-19T09:00:46.614 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.588+0000 7fde70f8a640 1 --2- 172.21.15.19:0/2829910897 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564f4f46780 0x5564f4f39400 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fde64004860 tx=0x7fde64009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87d2257ecbf0e8ed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:46.614 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.589+0000 7fde51ffb640 1 -- 172.21.15.19:0/2829910897 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde64004250 con 0x5564f4f46780 2024-09-19T09:00:46.614 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.589+0000 7fde51ffb640 1 -- 172.21.15.19:0/2829910897 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde640043f0 con 0x5564f4f46780 2024-09-19T09:00:46.615 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.589+0000 7fde51ffb640 1 -- 172.21.15.19:0/2829910897 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde64027440 con 0x5564f4f46780 2024-09-19T09:00:46.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.589+0000 7fde5d204740 1 Processor -- start 2024-09-19T09:00:46.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.589+0000 7fde5d204740 1 -- start start 2024-09-19T09:00:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.589+0000 7fde7585d740 1 -- 172.21.15.19:0/2829910897 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564f4f46780 msgr2=0x5564f4f39400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.590+0000 7fde7585d740 1 --2- 172.21.15.19:0/2829910897 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564f4f46780 0x5564f4f39400 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fde64004860 tx=0x7fde64009500 comp rx=0 tx=0).stop 2024-09-19T09:00:46.616 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.590+0000 7fde7585d740 1 -- 172.21.15.19:0/2829910897 shutdown_connections 2024-09-19T09:00:46.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.590+0000 7fde5d204740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619708dadc0 0x5619708f14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.590+0000 7fde5d204740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619708e5680 0x5619708dd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.590+0000 7fde7585d740 1 --2- 172.21.15.19:0/2829910897 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564f4f416f0 0x5564f4f524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.590+0000 7fde7585d740 1 --2- 172.21.15.19:0/2829910897 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564f4f46780 0x5564f4f39400 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.590+0000 7fde7585d740 1 --2- 172.21.15.19:0/2829910897 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564f4f40db0 0x5564f4f370b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.590+0000 7fde7585d740 1 -- 172.21.15.19:0/2829910897 >> 172.21.15.19:0/2829910897 conn(0x5564f4f38010 msgr2=0x5564f4f369a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:46.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.590+0000 7fde5d204740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619708e0fd0 0x5619708fcdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.590+0000 7fde58bc7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619708dadc0 0x5619708f14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.590+0000 7fde53fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619708e5680 0x5619708dd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.590+0000 7fde5d204740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fde541af700 con 0x5619708e5680 2024-09-19T09:00:46.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.590+0000 7fde5d204740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fde541b1240 con 0x5619708dadc0 2024-09-19T09:00:46.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.590+0000 7fde53fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619708e5680 0x5619708dd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60856/0 (socket says 172.21.15.19:60856) 2024-09-19T09:00:46.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.590+0000 7fde58bc7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619708dadc0 0x5619708f14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:52614/0 (socket says 172.21.15.19:52614) 2024-09-19T09:00:46.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.590+0000 7fde53fff640 1 -- 172.21.15.19:0/1215421923 learned_addr learned my addr 172.21.15.19:0/1215421923 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:46.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.590+0000 7fde5d204740 1 -- 172.21.15.19:0/1215421923 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fde541afdd0 con 0x5619708e0fd0 2024-09-19T09:00:46.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.590+0000 7fde593c8640 1 --2- 172.21.15.19:0/1215421923 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619708e0fd0 0x5619708fcdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.590+0000 7fde7585d740 1 -- 172.21.15.19:0/2829910897 shutdown_connections 2024-09-19T09:00:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.590+0000 7fde7585d740 1 -- 172.21.15.19:0/2829910897 wait complete. 2024-09-19T09:00:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.591+0000 7fde7585d740 1 -- start start 2024-09-19T09:00:46.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.590+0000 7fde53fff640 1 -- 172.21.15.19:0/1215421923 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619708e0fd0 msgr2=0x5619708fcdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:46.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.590+0000 7fde53fff640 1 --2- 172.21.15.19:0/1215421923 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619708e0fd0 0x5619708fcdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.590+0000 7fde53fff640 1 -- 172.21.15.19:0/1215421923 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619708dadc0 msgr2=0x5619708f14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:46.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.590+0000 7fde53fff640 1 --2- 172.21.15.19:0/1215421923 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619708dadc0 0x5619708f14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.590+0000 7fde53fff640 1 -- 172.21.15.19:0/1215421923 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619708dabf0 con 0x5619708e5680 2024-09-19T09:00:46.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.591+0000 7fde53fff640 1 --2- 172.21.15.19:0/1215421923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619708e5680 0x5619708dd6d0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fde40098380 tx=0x7fde400ccd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fc23407eec47ab9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:46.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.591+0000 7fde58bc7640 1 --2- 172.21.15.19:0/1215421923 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619708dadc0 0x5619708f14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:46.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.591+0000 7fde3e7fc640 1 -- 172.21.15.19:0/1215421923 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde40020040 con 0x5619708e5680 2024-09-19T09:00:46.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.591+0000 7fde3e7fc640 1 -- 172.21.15.19:0/1215421923 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde400046c0 con 0x5619708e5680 2024-09-19T09:00:46.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.591+0000 7fde3e7fc640 1 -- 172.21.15.19:0/1215421923 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde400a4620 con 0x5619708e5680 2024-09-19T09:00:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.592+0000 7fde7585d740 1 Processor -- start 2024-09-19T09:00:46.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.592+0000 7fde5d204740 1 -- 172.21.15.19:0/1215421923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619708e5680 msgr2=0x5619708dd6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:46.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.592+0000 7fde5d204740 1 --2- 172.21.15.19:0/1215421923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619708e5680 0x5619708dd6d0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fde40098380 tx=0x7fde400ccd60 comp rx=0 tx=0).stop 2024-09-19T09:00:46.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.592+0000 7fde5d204740 1 -- 172.21.15.19:0/1215421923 shutdown_connections 2024-09-19T09:00:46.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.592+0000 7fde5d204740 1 --2- 172.21.15.19:0/1215421923 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619708e0fd0 0x5619708fcdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.592+0000 7fde5d204740 1 --2- 172.21.15.19:0/1215421923 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619708e5680 0x5619708dd6d0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.592+0000 7fde5d204740 1 --2- 172.21.15.19:0/1215421923 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619708dadc0 0x5619708f14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.592+0000 7fde5d204740 1 -- 172.21.15.19:0/1215421923 >> 172.21.15.19:0/1215421923 conn(0x5619708d6a30 msgr2=0x5619708dcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:46.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.592+0000 7fde5d204740 1 -- 172.21.15.19:0/1215421923 shutdown_connections 2024-09-19T09:00:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.592+0000 7fde7585d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564f4f40db0 0x5564f4f4f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.592+0000 7fde7585d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564f4f416f0 0x5564f4f4fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.592+0000 7fde7585d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564f4f46780 0x5564f4f50d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.592+0000 7fde5d204740 1 -- 172.21.15.19:0/1215421923 wait complete. 2024-09-19T09:00:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.592+0000 7fde7585d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fde6c1a8260 con 0x5564f4f416f0 2024-09-19T09:00:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.592+0000 7fde7585d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fde6c1a7b90 con 0x5564f4f40db0 2024-09-19T09:00:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.592+0000 7fde7585d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fde6c1a4dd0 con 0x5564f4f46780 2024-09-19T09:00:46.629 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.592+0000 7fde7585d740 10 client.0 _ll_register_callbacks cb 0x7fde60009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.592+0000 7fde70f8a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564f4f40db0 0x5564f4f4f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.592+0000 7fde70f8a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564f4f40db0 0x5564f4f4f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:52616/0 (socket says 172.21.15.19:52616) 2024-09-19T09:00:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.592+0000 7fde70f8a640 1 -- 172.21.15.19:0/1812700661 learned_addr learned my addr 172.21.15.19:0/1812700661 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.592+0000 7fde6b7fe640 1 --2- 172.21.15.19:0/1812700661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564f4f416f0 0x5564f4f4fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.630 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.593+0000 7fde70f8a640 1 --2- 172.21.15.19:0/1812700661 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564f4f46780 0x5564f4f50d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.593+0000 7fde5d204740 1 -- start start 2024-09-19T09:00:46.631 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.593+0000 7fde70f8a640 1 -- 172.21.15.19:0/1812700661 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564f4f46780 msgr2=0x5564f4f50d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:46.631 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.593+0000 7fde70f8a640 1 --2- 172.21.15.19:0/1812700661 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564f4f46780 0x5564f4f50d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.631 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.593+0000 7fde70f8a640 1 -- 172.21.15.19:0/1812700661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564f4f416f0 msgr2=0x5564f4f4fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:46.632 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.593+0000 7fde70f8a640 1 --2- 172.21.15.19:0/1812700661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564f4f416f0 0x5564f4f4fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.593+0000 7fde5d204740 1 Processor -- start 2024-09-19T09:00:46.633 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.593+0000 7fde70f8a640 1 -- 172.21.15.19:0/1812700661 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564f4f51320 con 0x5564f4f40db0 2024-09-19T09:00:46.633 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.593+0000 7fde6b7fe640 1 --2- 172.21.15.19:0/1812700661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564f4f416f0 0x5564f4f4fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:46.633 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.593+0000 7fde70f8a640 1 --2- 172.21.15.19:0/1812700661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564f4f40db0 0x5564f4f4f7c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fde64009270 tx=0x7fde64005bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6e73fbe547a036f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:46.633 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.593+0000 7fde4b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T09:00:46.634 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.593+0000 7fde4b7fe640 1 -- 172.21.15.19:0/1812700661 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde64003a30 con 0x5564f4f40db0 2024-09-19T09:00:46.634 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.593+0000 7fde4b7fe640 1 -- 172.21.15.19:0/1812700661 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fde64004050 con 0x5564f4f40db0 2024-09-19T09:00:46.634 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.593+0000 7fde7585d740 1 -- 172.21.15.19:0/1812700661 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde640043f0 con 0x5564f4f40db0 2024-09-19T09:00:46.634 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.594+0000 7fde4b7fe640 1 -- 172.21.15.19:0/1812700661 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fde64004250 con 0x5564f4f40db0 2024-09-19T09:00:46.634 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.594+0000 7fde7585d740 10 client.26753 fetch_fsmap learned FSMap version 36 2024-09-19T09:00:46.634 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.594+0000 7fde7585d740 1 -- 172.21.15.19:0/1812700661 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5564f4f52630 con 0x5564f4f40db0 2024-09-19T09:00:46.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.594+0000 7fde5d204740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619708dadc0 0x5619708e9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.594+0000 7fde5d204740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619708e0fd0 0x5619708ea0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.594+0000 7fde5d204740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619708e5680 0x56197095ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.594+0000 7fde5d204740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fde541b0b70 con 0x5619708e5680 2024-09-19T09:00:46.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.594+0000 7fde5d204740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fde541b04a0 con 0x5619708dadc0 2024-09-19T09:00:46.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.594+0000 7fde5d204740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fde541ad6e0 con 0x5619708e0fd0 2024-09-19T09:00:46.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.594+0000 7fde5d204740 10 client.0 _ll_register_callbacks cb 0x7fde48004530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:46.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.594+0000 7fde58bc7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619708dadc0 0x5619708e9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.594+0000 7fde593c8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619708e5680 0x56197095ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.594+0000 7fde4b7fe640 1 -- 172.21.15.19:0/1812700661 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde640043f0 con 0x5564f4f40db0 2024-09-19T09:00:46.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.594+0000 7fde58bc7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619708dadc0 0x5619708e9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:52630/0 (socket says 172.21.15.19:52630) 2024-09-19T09:00:46.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.594+0000 7fde593c8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619708e5680 0x56197095ed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60860/0 (socket says 172.21.15.19:60860) 2024-09-19T09:00:46.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.594+0000 7fde58bc7640 1 -- 172.21.15.19:0/3032227845 learned_addr learned my addr 172.21.15.19:0/3032227845 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:46.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.594+0000 7fde53fff640 1 --2- 172.21.15.19:0/3032227845 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619708e0fd0 0x5619708ea0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.594+0000 7fde4b7fe640 1 -- 172.21.15.19:0/1812700661 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fde64027910 con 0x5564f4f40db0 2024-09-19T09:00:46.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.594+0000 7fde58bc7640 1 -- 172.21.15.19:0/3032227845 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619708e0fd0 msgr2=0x5619708ea0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:46.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.594+0000 7fde58bc7640 1 --2- 172.21.15.19:0/3032227845 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619708e0fd0 0x5619708ea0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.594+0000 7fde58bc7640 1 -- 172.21.15.19:0/3032227845 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619708e5680 msgr2=0x56197095ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:46.638 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.594+0000 7fde7585d740 10 client.26753 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:00:46.638 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.594+0000 7fde7585d740 10 client.26753 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:00:46.638 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.594+0000 7fde7585d740 20 client.26753 populate_metadata read hostname 'smithi019' 2024-09-19T09:00:46.638 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.594+0000 7fde7585d740 1 --2- 172.21.15.19:0/1812700661 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5564f4fc1ce0 0x5564f4fc4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.638 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.594+0000 7fde7585d740 4 client.26753 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:00:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.594+0000 7fde7585d740 1 -- 172.21.15.19:0/1812700661 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5564f4ea7d70 con 0x5564f4fc1ce0 2024-09-19T09:00:46.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.594+0000 7fde58bc7640 1 --2- 172.21.15.19:0/3032227845 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619708e5680 0x56197095ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.594+0000 7fde58bc7640 1 -- 172.21.15.19:0/3032227845 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56197095f370 con 0x5619708dadc0 2024-09-19T09:00:46.639 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.595+0000 7fde6b7fe640 1 --2- 172.21.15.19:0/1812700661 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5564f4fc1ce0 0x5564f4fc4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.595+0000 7fde58bc7640 1 --2- 172.21.15.19:0/3032227845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619708dadc0 0x5619708e9bb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fde48032c40 tx=0x7fde48004390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa5d52a30046080f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:46.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.595+0000 7fde33fff640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T09:00:46.640 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.595+0000 7fde4b7fe640 10 client.26753 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:00:46.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.595+0000 7fde33fff640 1 -- 172.21.15.19:0/3032227845 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde48063060 con 0x5619708dadc0 2024-09-19T09:00:46.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.595+0000 7fde33fff640 1 -- 172.21.15.19:0/3032227845 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fde48004cc0 con 0x5619708dadc0 2024-09-19T09:00:46.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.595+0000 7fde5d204740 1 -- 172.21.15.19:0/3032227845 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x561970847d60 con 0x5619708dadc0 2024-09-19T09:00:46.641 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:46.595+0000 7fde6b7fe640 1 --2- 172.21.15.19:0/1812700661 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5564f4fc1ce0 0x5564f4fc4100 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbb65acf133242d0 server_cookie=520dfd7d60c3d98b in_seq=0 out_seq=0 2024-09-19T09:00:46.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.595+0000 7fde33fff640 1 -- 172.21.15.19:0/3032227845 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fde4804e070 con 0x5619708dadc0 2024-09-19T09:00:46.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.595+0000 7fde5d204740 10 client.26756 fetch_fsmap learned FSMap version 36 2024-09-19T09:00:46.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.595+0000 7fde5d204740 1 -- 172.21.15.19:0/3032227845 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x561970960640 con 0x5619708dadc0 2024-09-19T09:00:46.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.596+0000 7fde33fff640 1 -- 172.21.15.19:0/3032227845 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde480035f0 con 0x5619708dadc0 2024-09-19T09:00:46.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.596+0000 7fde33fff640 1 -- 172.21.15.19:0/3032227845 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fde4804a520 con 0x5619708dadc0 2024-09-19T09:00:46.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.596+0000 7fde5d204740 10 client.26756 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:00:46.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.596+0000 7fde5d204740 10 client.26756 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:00:46.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.596+0000 7fde5d204740 20 client.26756 populate_metadata read hostname 'smithi019' 2024-09-19T09:00:46.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.596+0000 7fde5d204740 1 --2- 172.21.15.19:0/3032227845 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x561970960d60 0x561970963180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:46.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.596+0000 7fde5d204740 4 client.26756 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:00:46.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.596+0000 7fde5d204740 1 -- 172.21.15.19:0/3032227845 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561970847d60 con 0x561970960d60 2024-09-19T09:00:46.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.596+0000 7fde53fff640 1 --2- 172.21.15.19:0/3032227845 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x561970960d60 0x561970963180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:46.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.597+0000 7fde53fff640 1 --2- 172.21.15.19:0/3032227845 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x561970960d60 0x561970963180 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91bbec9b4a68587b server_cookie=5ef9ee4a5930690e in_seq=0 out_seq=0 2024-09-19T09:00:46.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.597+0000 7fde33fff640 10 client.26756 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:00:46.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.627+0000 7fde33fff640 1 -- 172.21.15.19:0/3032227845 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x561970847d60 con 0x561970960d60 2024-09-19T09:00:46.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.627+0000 7fde33fff640 10 client.26756 handle_command_reply: tid=0 2024-09-19T09:00:46.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.627+0000 7fde5d204740 1 client.26756 shutdown 2024-09-19T09:00:46.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.627+0000 7fde5d204740 1 -- 172.21.15.19:0/3032227845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619708dadc0 msgr2=0x5619708e9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:46.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.627+0000 7fde5d204740 1 --2- 172.21.15.19:0/3032227845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619708dadc0 0x5619708e9bb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fde48032c40 tx=0x7fde48004390 comp rx=0 tx=0).stop 2024-09-19T09:00:46.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.627+0000 7fde5d204740 1 -- 172.21.15.19:0/3032227845 shutdown_connections 2024-09-19T09:00:46.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.627+0000 7fde5d204740 1 --2- 172.21.15.19:0/3032227845 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x561970960d60 0x561970963180 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.627+0000 7fde5d204740 1 --2- 172.21.15.19:0/3032227845 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619708e0fd0 0x5619708ea0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.627+0000 7fde5d204740 1 --2- 172.21.15.19:0/3032227845 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619708e5680 0x56197095ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.627+0000 7fde33fff640 0 client.26756 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:00:46.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.627+0000 7fde5d204740 1 --2- 172.21.15.19:0/3032227845 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619708dadc0 0x5619708e9bb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.627+0000 7fde5d204740 1 -- 172.21.15.19:0/3032227845 >> 172.21.15.19:0/3032227845 conn(0x5619708d6a30 msgr2=0x5619708dd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:46.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.627+0000 7fde5d204740 1 -- 172.21.15.19:0/3032227845 shutdown_connections 2024-09-19T09:00:46.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.627+0000 7fde5d204740 1 -- 172.21.15.19:0/3032227845 wait complete. 2024-09-19T09:00:46.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.628+0000 7fde5d204740 20 client.26756 trim_cache size 0 max 16384 2024-09-19T09:00:46.645 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T09:00:46.646 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-19T09:00:46.646 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {} 2024-09-19T09:00:46.646 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T09:00:46.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.629+0000 7fde5ae2b640 1 -- 172.21.15.19:0/3283531007 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fde440a3240 msgr2=0x7fde440a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:46.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.629+0000 7fde5ae2b640 1 --2- 172.21.15.19:0/3283531007 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fde440a3240 0x7fde440a5700 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x5619708d7890 tx=0x7fde48005b50 comp rx=0 tx=0).stop 2024-09-19T09:00:46.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.629+0000 7fde5ae2b640 1 -- 172.21.15.19:0/3283531007 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde54102570 msgr2=0x7fde54103c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:46.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.629+0000 7fde5ae2b640 1 --2- 172.21.15.19:0/3283531007 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde54102570 0x7fde54103c90 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7fde4000d770 tx=0x7fde4000dc30 comp rx=0 tx=0).stop 2024-09-19T09:00:46.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.629+0000 7fde5ae2b640 1 -- 172.21.15.19:0/3283531007 shutdown_connections 2024-09-19T09:00:46.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.629+0000 7fde5ae2b640 1 --2- 172.21.15.19:0/3283531007 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fde440a3240 0x7fde440a5700 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.629+0000 7fde5ae2b640 1 --2- 172.21.15.19:0/3283531007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde54102ef0 0x7fde541041d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.629+0000 7fde5ae2b640 1 --2- 172.21.15.19:0/3283531007 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde54102570 0x7fde54103c90 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.629+0000 7fde5ae2b640 1 --2- 172.21.15.19:0/3283531007 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde54100e20 0x7fde54103750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:46.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.629+0000 7fde5ae2b640 1 -- 172.21.15.19:0/3283531007 >> 172.21.15.19:0/3283531007 conn(0x7fde540fc7d0 msgr2=0x7fde5406a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:46.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.629+0000 7fde5ae2b640 1 -- 172.21.15.19:0/3283531007 shutdown_connections 2024-09-19T09:00:46.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:46.629+0000 7fde5ae2b640 1 -- 172.21.15.19:0/3283531007 wait complete. 2024-09-19T09:00:47.265 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '30ed91a0', total seconds elapsed: 30.3 2024-09-19T09:00:47.265 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 25.75 2024-09-19T09:00:47.265 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:00:47.905 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:00:47.905 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:00:47.978 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:48.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:47 smithi155 ceph-mon[34921]: pgmap v594: 97 pgs: 97 active+clean; 5.9 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 175 KiB/s wr, 1.48k op/s 2024-09-19T09:00:48.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:47 smithi203 ceph-mon[35450]: pgmap v594: 97 pgs: 97 active+clean; 5.9 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 175 KiB/s wr, 1.48k op/s 2024-09-19T09:00:48.241 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:47 smithi019 ceph-mon[30976]: pgmap v594: 97 pgs: 97 active+clean; 5.9 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 175 KiB/s wr, 1.48k op/s 2024-09-19T09:00:48.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.588+0000 7f8d88e80640 1 -- 172.21.15.19:0/4012040662 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d84102ef0 msgr2=0x7f8d8410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:48.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.588+0000 7f8d88e80640 1 --2- 172.21.15.19:0/4012040662 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d84102ef0 0x7f8d8410da40 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f8d74009ca0 tx=0x7f8d7402a950 comp rx=0 tx=0).stop 2024-09-19T09:00:48.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.588+0000 7f8d88e80640 1 -- 172.21.15.19:0/4012040662 shutdown_connections 2024-09-19T09:00:48.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.588+0000 7f8d88e80640 1 --2- 172.21.15.19:0/4012040662 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d84102570 0x7f8d841029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:48.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.588+0000 7f8d88e80640 1 --2- 172.21.15.19:0/4012040662 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d84102ef0 0x7f8d8410da40 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:48.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.588+0000 7f8d88e80640 1 --2- 172.21.15.19:0/4012040662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d84100e20 0x7f8d84101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:48.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.588+0000 7f8d88e80640 1 -- 172.21.15.19:0/4012040662 >> 172.21.15.19:0/4012040662 conn(0x7f8d840fc7d0 msgr2=0x7f8d840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:48.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.588+0000 7f8d88e80640 1 -- 172.21.15.19:0/4012040662 shutdown_connections 2024-09-19T09:00:48.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.588+0000 7f8d88e80640 1 -- 172.21.15.19:0/4012040662 wait complete. 2024-09-19T09:00:48.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.589+0000 7f8d88e80640 1 Processor -- start 2024-09-19T09:00:48.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.589+0000 7f8d88e80640 1 -- start start 2024-09-19T09:00:48.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.589+0000 7f8d88e80640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d84100e20 0x7f8d840fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:48.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.589+0000 7f8d88e80640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d84102570 0x7f8d840fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:48.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.589+0000 7f8d88e80640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d84102ef0 0x7f8d840fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:48.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.589+0000 7f8d88e80640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8d84110f80 con 0x7f8d84100e20 2024-09-19T09:00:48.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.589+0000 7f8d88e80640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8d84110e00 con 0x7f8d84102ef0 2024-09-19T09:00:48.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.589+0000 7f8d88e80640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8d84111100 con 0x7f8d84102570 2024-09-19T09:00:48.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.589+0000 7f8d8259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d84100e20 0x7f8d840fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:48.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.589+0000 7f8d8259c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d84100e20 0x7f8d840fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60872/0 (socket says 172.21.15.19:60872) 2024-09-19T09:00:48.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.589+0000 7f8d8259c640 1 -- 172.21.15.19:0/2201690055 learned_addr learned my addr 172.21.15.19:0/2201690055 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:48.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.589+0000 7f8d82d9d640 1 --2- 172.21.15.19:0/2201690055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d84102ef0 0x7f8d840fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:48.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.589+0000 7f8d81d9b640 1 --2- 172.21.15.19:0/2201690055 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d84102570 0x7f8d840fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:48.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.590+0000 7f8d8259c640 1 -- 172.21.15.19:0/2201690055 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d84102570 msgr2=0x7f8d840fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:48.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.590+0000 7f8d8259c640 1 --2- 172.21.15.19:0/2201690055 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d84102570 0x7f8d840fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:48.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.590+0000 7f8d8259c640 1 -- 172.21.15.19:0/2201690055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d84102ef0 msgr2=0x7f8d840fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:48.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.590+0000 7f8d8259c640 1 --2- 172.21.15.19:0/2201690055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d84102ef0 0x7f8d840fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:48.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.590+0000 7f8d8259c640 1 -- 172.21.15.19:0/2201690055 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d841a6910 con 0x7f8d84100e20 2024-09-19T09:00:48.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.590+0000 7f8d82d9d640 1 --2- 172.21.15.19:0/2201690055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d84102ef0 0x7f8d840fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:48.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.590+0000 7f8d8259c640 1 --2- 172.21.15.19:0/2201690055 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d84100e20 0x7f8d840fcc80 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c00e9f0 tx=0x7f8d7c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:48.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.590+0000 7f8d7b7fe640 1 -- 172.21.15.19:0/2201690055 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c00cd80 con 0x7f8d84100e20 2024-09-19T09:00:48.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.590+0000 7f8d88e80640 1 -- 172.21.15.19:0/2201690055 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d841a6c00 con 0x7f8d84100e20 2024-09-19T09:00:48.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.590+0000 7f8d7b7fe640 1 -- 172.21.15.19:0/2201690055 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8d7c010910 con 0x7f8d84100e20 2024-09-19T09:00:48.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.590+0000 7f8d7b7fe640 1 -- 172.21.15.19:0/2201690055 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c0188f0 con 0x7f8d84100e20 2024-09-19T09:00:48.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.590+0000 7f8d88e80640 1 -- 172.21.15.19:0/2201690055 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d841a7190 con 0x7f8d84100e20 2024-09-19T09:00:48.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.591+0000 7f8d88e80640 1 -- 172.21.15.19:0/2201690055 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d84101200 con 0x7f8d84100e20 2024-09-19T09:00:48.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.592+0000 7f8d7b7fe640 1 -- 172.21.15.19:0/2201690055 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f8d7c010ac0 con 0x7f8d84100e20 2024-09-19T09:00:48.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.593+0000 7f8d7b7fe640 1 --2- 172.21.15.19:0/2201690055 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8d700a32c0 0x7f8d700a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:48.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.593+0000 7f8d81d9b640 1 --2- 172.21.15.19:0/2201690055 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8d700a32c0 0x7f8d700a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:48.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.593+0000 7f8d7b7fe640 1 -- 172.21.15.19:0/2201690055 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f8d7c0cfc80 con 0x7f8d84100e20 2024-09-19T09:00:48.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.594+0000 7f8d81d9b640 1 --2- 172.21.15.19:0/2201690055 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8d700a32c0 0x7f8d700a5780 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8d840fe710 tx=0x7f8d6c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:48.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.598+0000 7f8d7b7fe640 1 -- 172.21.15.19:0/2201690055 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8d7c09c300 con 0x7f8d84100e20 2024-09-19T09:00:48.718 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:48.763 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:48.762+0000 7fde4b7fe640 1 -- 172.21.15.19:0/1812700661 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5564f4ea7d70 con 0x5564f4fc1ce0 2024-09-19T09:00:48.763 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:48.762+0000 7fde4b7fe640 10 client.26753 handle_command_reply: tid=0 2024-09-19T09:00:48.763 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:48.762+0000 7fde7585d740 1 client.26753 shutdown 2024-09-19T09:00:48.763 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:48.762+0000 7fde7585d740 1 -- 172.21.15.19:0/1812700661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564f4f40db0 msgr2=0x5564f4f4f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:48.763 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:48.762+0000 7fde7585d740 1 --2- 172.21.15.19:0/1812700661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564f4f40db0 0x5564f4f4f7c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fde64009270 tx=0x7fde64005bd0 comp rx=0 tx=0).stop 2024-09-19T09:00:48.764 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:48.762+0000 7fde7585d740 1 -- 172.21.15.19:0/1812700661 shutdown_connections 2024-09-19T09:00:48.764 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:48.762+0000 7fde7585d740 1 --2- 172.21.15.19:0/1812700661 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5564f4fc1ce0 0x5564f4fc4100 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:48.764 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:48.762+0000 7fde7585d740 1 --2- 172.21.15.19:0/1812700661 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5564f4f46780 0x5564f4f50d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:48.764 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:48.762+0000 7fde4b7fe640 0 client.26753 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:00:48.764 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:48.762+0000 7fde7585d740 1 --2- 172.21.15.19:0/1812700661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5564f4f416f0 0x5564f4f4fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:48.764 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:48.762+0000 7fde7585d740 1 --2- 172.21.15.19:0/1812700661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5564f4f40db0 0x5564f4f4f7c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:48.764 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:48.762+0000 7fde7585d740 1 -- 172.21.15.19:0/1812700661 >> 172.21.15.19:0/1812700661 conn(0x5564f4f38010 msgr2=0x5564f4f371c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:48.764 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:48.762+0000 7fde7585d740 1 -- 172.21.15.19:0/1812700661 shutdown_connections 2024-09-19T09:00:48.764 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:48.762+0000 7fde7585d740 1 -- 172.21.15.19:0/1812700661 wait complete. 2024-09-19T09:00:48.764 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:48.762+0000 7fde7585d740 20 client.26753 trim_cache size 0 max 16384 2024-09-19T09:00:48.764 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T09:00:48.765 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T09:00:48.765 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T09:00:48.765 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T09:00:48.765 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:48.763+0000 7fde729ed640 1 -- 172.21.15.19:0/4250224750 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fde540a32f0 msgr2=0x7fde540a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:48.763+0000 7fde729ed640 1 --2- 172.21.15.19:0/4250224750 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fde540a32f0 0x7fde540a57b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fde5c0cd440 tx=0x7fde5c086040 comp rx=0 tx=0).stop 2024-09-19T09:00:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:48.763+0000 7fde729ed640 1 -- 172.21.15.19:0/4250224750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde6c102620 msgr2=0x7fde6c197ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:48.763+0000 7fde729ed640 1 --2- 172.21.15.19:0/4250224750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde6c102620 0x7fde6c197ea0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fde5c00d720 tx=0x7fde5c00dbe0 comp rx=0 tx=0).stop 2024-09-19T09:00:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:48.763+0000 7fde729ed640 1 -- 172.21.15.19:0/4250224750 shutdown_connections 2024-09-19T09:00:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:48.763+0000 7fde729ed640 1 --2- 172.21.15.19:0/4250224750 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fde540a32f0 0x7fde540a57b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:48.763+0000 7fde729ed640 1 --2- 172.21.15.19:0/4250224750 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fde6c104f50 0x7fde6c1983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:48.763+0000 7fde729ed640 1 --2- 172.21.15.19:0/4250224750 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fde6c107880 0x7fde6c19f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:48.763+0000 7fde729ed640 1 --2- 172.21.15.19:0/4250224750 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fde6c102620 0x7fde6c197ea0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:48.763+0000 7fde729ed640 1 -- 172.21.15.19:0/4250224750 >> 172.21.15.19:0/4250224750 conn(0x7fde6c0fc1e0 msgr2=0x7fde6c102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:48.763+0000 7fde729ed640 1 -- 172.21.15.19:0/4250224750 shutdown_connections 2024-09-19T09:00:48.766 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:00:48.763+0000 7fde729ed640 1 -- 172.21.15.19:0/4250224750 wait complete. 2024-09-19T09:00:48.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.840+0000 7f8d88e80640 1 -- 172.21.15.19:0/2201690055 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d8402d7c0 con 0x7f8d84100e20 2024-09-19T09:00:48.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.841+0000 7f8d7b7fe640 1 -- 172.21.15.19:0/2201690055 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11983 (secure 0 0 0) 0x7f8d7c0a0600 con 0x7f8d84100e20 2024-09-19T09:00:48.842 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T09:00:48.842 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":36,"btime":"2024-09-19T08:59:00:695758+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":26453,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3907362737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3907362737},{"type":"v1","addr":"172.21.15.155:6835","nonce":3907362737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":35,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T08:58:50.493979+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6839/2452068876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2452068876},{"type":"v1","addr":"172.21.15.19:6839","nonce":2452068876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24463,24464,24490,24469,24497]},"id":1}]} 2024-09-19T09:00:48.842 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 36 2024-09-19T09:00:48.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.844+0000 7f8d88e80640 1 -- 172.21.15.19:0/2201690055 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8d700a32c0 msgr2=0x7f8d700a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:48.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.844+0000 7f8d88e80640 1 --2- 172.21.15.19:0/2201690055 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8d700a32c0 0x7f8d700a5780 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8d840fe710 tx=0x7f8d6c005f90 comp rx=0 tx=0).stop 2024-09-19T09:00:48.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.844+0000 7f8d88e80640 1 -- 172.21.15.19:0/2201690055 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d84100e20 msgr2=0x7f8d840fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:48.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.844+0000 7f8d88e80640 1 --2- 172.21.15.19:0/2201690055 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d84100e20 0x7f8d840fcc80 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c00e9f0 tx=0x7f8d7c00eeb0 comp rx=0 tx=0).stop 2024-09-19T09:00:48.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.844+0000 7f8d88e80640 1 -- 172.21.15.19:0/2201690055 shutdown_connections 2024-09-19T09:00:48.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.844+0000 7f8d88e80640 1 --2- 172.21.15.19:0/2201690055 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8d700a32c0 0x7f8d700a5780 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:48.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.845+0000 7f8d88e80640 1 --2- 172.21.15.19:0/2201690055 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d84102570 0x7f8d840fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:48.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.845+0000 7f8d88e80640 1 --2- 172.21.15.19:0/2201690055 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8d84102ef0 0x7f8d840fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:48.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.845+0000 7f8d88e80640 1 --2- 172.21.15.19:0/2201690055 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8d84100e20 0x7f8d840fcc80 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:48.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.845+0000 7f8d88e80640 1 -- 172.21.15.19:0/2201690055 >> 172.21.15.19:0/2201690055 conn(0x7f8d840fc7d0 msgr2=0x7f8d8406a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:48.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.845+0000 7f8d88e80640 1 -- 172.21.15.19:0/2201690055 shutdown_connections 2024-09-19T09:00:48.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:48.845+0000 7f8d88e80640 1 -- 172.21.15.19:0/2201690055 wait complete. 2024-09-19T09:00:49.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:48 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/2201690055' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:49.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:48 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/2201690055' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:49.316 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:48 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/2201690055' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:49.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.403+0000 7fb77b5df640 1 -- 172.21.15.19:0/1006269403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb774100e20 msgr2=0x7fb774101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:49.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.403+0000 7fb77b5df640 1 --2- 172.21.15.19:0/1006269403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb774100e20 0x7fb774101200 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fb770009900 tx=0x7fb77002a480 comp rx=0 tx=0).stop 2024-09-19T09:00:49.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.403+0000 7fb77b5df640 1 -- 172.21.15.19:0/1006269403 shutdown_connections 2024-09-19T09:00:49.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.403+0000 7fb77b5df640 1 --2- 172.21.15.19:0/1006269403 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb774102ef0 0x7fb77410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:49.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.403+0000 7fb77b5df640 1 --2- 172.21.15.19:0/1006269403 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb774102570 0x7fb7741029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:49.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.403+0000 7fb77b5df640 1 --2- 172.21.15.19:0/1006269403 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb774100e20 0x7fb774101200 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:49.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.403+0000 7fb77b5df640 1 -- 172.21.15.19:0/1006269403 >> 172.21.15.19:0/1006269403 conn(0x7fb7740fc7d0 msgr2=0x7fb7740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:49.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.403+0000 7fb77b5df640 1 -- 172.21.15.19:0/1006269403 shutdown_connections 2024-09-19T09:00:49.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.403+0000 7fb77b5df640 1 -- 172.21.15.19:0/1006269403 wait complete. 2024-09-19T09:00:49.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.404+0000 7fb77b5df640 1 Processor -- start 2024-09-19T09:00:49.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.404+0000 7fb77b5df640 1 -- start start 2024-09-19T09:00:49.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.404+0000 7fb77b5df640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb774100e20 0x7fb774197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:49.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.404+0000 7fb77b5df640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb774102570 0x7fb7741978a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:49.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.405+0000 7fb77b5df640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb774102ef0 0x7fb77419bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:49.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.405+0000 7fb77b5df640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb774110f80 con 0x7fb774102570 2024-09-19T09:00:49.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.405+0000 7fb77b5df640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb774110e00 con 0x7fb774102ef0 2024-09-19T09:00:49.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.405+0000 7fb77b5df640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb774111100 con 0x7fb774100e20 2024-09-19T09:00:49.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.405+0000 7fb778b7a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb774102570 0x7fb7741978a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:49.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.405+0000 7fb778b7a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb774102570 0x7fb7741978a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60900/0 (socket says 172.21.15.19:60900) 2024-09-19T09:00:49.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.405+0000 7fb778b7a640 1 -- 172.21.15.19:0/4107632676 learned_addr learned my addr 172.21.15.19:0/4107632676 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:49.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.405+0000 7fb779b7c640 1 --2- 172.21.15.19:0/4107632676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb774102ef0 0x7fb77419bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:49.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.405+0000 7fb77937b640 1 --2- 172.21.15.19:0/4107632676 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb774100e20 0x7fb774197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:49.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.405+0000 7fb778b7a640 1 -- 172.21.15.19:0/4107632676 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb774100e20 msgr2=0x7fb774197360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:49.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.405+0000 7fb778b7a640 1 --2- 172.21.15.19:0/4107632676 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb774100e20 0x7fb774197360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:49.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.405+0000 7fb778b7a640 1 -- 172.21.15.19:0/4107632676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb774102ef0 msgr2=0x7fb77419bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:49.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.405+0000 7fb778b7a640 1 --2- 172.21.15.19:0/4107632676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb774102ef0 0x7fb77419bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:49.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.405+0000 7fb778b7a640 1 -- 172.21.15.19:0/4107632676 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb77419c330 con 0x7fb774102570 2024-09-19T09:00:49.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.405+0000 7fb77937b640 1 --2- 172.21.15.19:0/4107632676 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb774100e20 0x7fb774197360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:00:49.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.405+0000 7fb778b7a640 1 --2- 172.21.15.19:0/4107632676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb774102570 0x7fb7741978a0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fb76400e9f0 tx=0x7fb76400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:49.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.405+0000 7fb76a7fc640 1 -- 172.21.15.19:0/4107632676 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb76400cd80 con 0x7fb774102570 2024-09-19T09:00:49.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.405+0000 7fb76a7fc640 1 -- 172.21.15.19:0/4107632676 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb764010910 con 0x7fb774102570 2024-09-19T09:00:49.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.405+0000 7fb76a7fc640 1 -- 172.21.15.19:0/4107632676 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb764018990 con 0x7fb774102570 2024-09-19T09:00:49.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.405+0000 7fb77b5df640 1 -- 172.21.15.19:0/4107632676 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb77419c620 con 0x7fb774102570 2024-09-19T09:00:49.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.406+0000 7fb77b5df640 1 -- 172.21.15.19:0/4107632676 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb774069f70 con 0x7fb774102570 2024-09-19T09:00:49.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.407+0000 7fb77b5df640 1 -- 172.21.15.19:0/4107632676 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7741021b0 con 0x7fb774102570 2024-09-19T09:00:49.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.408+0000 7fb76a7fc640 1 -- 172.21.15.19:0/4107632676 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fb764010ac0 con 0x7fb774102570 2024-09-19T09:00:49.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.409+0000 7fb76a7fc640 1 --2- 172.21.15.19:0/4107632676 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb7600a3240 0x7fb7600a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:49.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.409+0000 7fb77937b640 1 --2- 172.21.15.19:0/4107632676 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb7600a3240 0x7fb7600a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:49.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.409+0000 7fb76a7fc640 1 -- 172.21.15.19:0/4107632676 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb7640cfd40 con 0x7fb774102570 2024-09-19T09:00:49.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.409+0000 7fb77937b640 1 --2- 172.21.15.19:0/4107632676 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb7600a3240 0x7fb7600a5700 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb770005ab0 tx=0x7fb770005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:49.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.413+0000 7fb76a7fc640 1 -- 172.21.15.19:0/4107632676 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb76409ca10 con 0x7fb774102570 2024-09-19T09:00:49.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.641+0000 7fb77b5df640 1 -- 172.21.15.19:0/4107632676 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb77406a290 con 0x7fb774102570 2024-09-19T09:00:49.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.642+0000 7fb76a7fc640 1 -- 172.21.15.19:0/4107632676 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11983 (secure 0 0 0) 0x7fb76409c310 con 0x7fb774102570 2024-09-19T09:00:49.643 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T09:00:49.643 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":36,"btime":"2024-09-19T08:59:00:695758+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":26453,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3907362737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3907362737},{"type":"v1","addr":"172.21.15.155:6835","nonce":3907362737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":35,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T08:58:50.493979+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6839/2452068876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2452068876},{"type":"v1","addr":"172.21.15.19:6839","nonce":2452068876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24463,24464,24490,24469,24497]},"id":1}]} 2024-09-19T09:00:49.643 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 36 2024-09-19T09:00:49.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.644+0000 7fb77b5df640 1 -- 172.21.15.19:0/4107632676 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb7600a3240 msgr2=0x7fb7600a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:49.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.644+0000 7fb77b5df640 1 --2- 172.21.15.19:0/4107632676 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb7600a3240 0x7fb7600a5700 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb770005ab0 tx=0x7fb770005a20 comp rx=0 tx=0).stop 2024-09-19T09:00:49.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.644+0000 7fb77b5df640 1 -- 172.21.15.19:0/4107632676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb774102570 msgr2=0x7fb7741978a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:49.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.644+0000 7fb77b5df640 1 --2- 172.21.15.19:0/4107632676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb774102570 0x7fb7741978a0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fb76400e9f0 tx=0x7fb76400eeb0 comp rx=0 tx=0).stop 2024-09-19T09:00:49.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.644+0000 7fb77b5df640 1 -- 172.21.15.19:0/4107632676 shutdown_connections 2024-09-19T09:00:49.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.644+0000 7fb77b5df640 1 --2- 172.21.15.19:0/4107632676 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb7600a3240 0x7fb7600a5700 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:49.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.644+0000 7fb77b5df640 1 --2- 172.21.15.19:0/4107632676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb774102ef0 0x7fb77419bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:49.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.644+0000 7fb77b5df640 1 --2- 172.21.15.19:0/4107632676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb774102570 0x7fb7741978a0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:49.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.644+0000 7fb77b5df640 1 --2- 172.21.15.19:0/4107632676 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb774100e20 0x7fb774197360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:49.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.644+0000 7fb77b5df640 1 -- 172.21.15.19:0/4107632676 >> 172.21.15.19:0/4107632676 conn(0x7fb7740fc7d0 msgr2=0x7fb7740fe060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:49.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.644+0000 7fb77b5df640 1 -- 172.21.15.19:0/4107632676 shutdown_connections 2024-09-19T09:00:49.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:49.644+0000 7fb77b5df640 1 -- 172.21.15.19:0/4107632676 wait complete. 2024-09-19T09:00:49.861 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db / --timeout 90 --expiration 145.75 --await-for 45.0' 2024-09-19T09:00:49.861 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db / --timeout 90 --expiration 145.75 --await-for 45.0 2024-09-19T09:00:50.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:49 smithi019 ceph-mon[30976]: pgmap v595: 97 pgs: 97 active+clean; 5.9 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 24 KiB/s wr, 820 op/s 2024-09-19T09:00:50.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:49 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/4107632676' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:50.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:49 smithi155 ceph-mon[34921]: pgmap v595: 97 pgs: 97 active+clean; 5.9 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 24 KiB/s wr, 820 op/s 2024-09-19T09:00:50.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:49 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/4107632676' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:50.233 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:49 smithi203 ceph-mon[35450]: pgmap v595: 97 pgs: 97 active+clean; 5.9 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 24 KiB/s wr, 820 op/s 2024-09-19T09:00:50.233 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:49 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/4107632676' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:00:50.608 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T09:00:50.643 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:51.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.115+0000 7f2efbac5640 1 -- 172.21.15.19:0/1583329450 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ef4100a70 msgr2=0x7f2ef4100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:51.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.115+0000 7f2efbac5640 1 --2- 172.21.15.19:0/1583329450 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ef4100a70 0x7f2ef4100ed0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4009900 tx=0x7f2ee402a3f0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.116+0000 7f2efbac5640 1 -- 172.21.15.19:0/1583329450 shutdown_connections 2024-09-19T09:00:51.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.116+0000 7f2efbac5640 1 --2- 172.21.15.19:0/1583329450 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ef4101410 0x7f2ef410d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.116+0000 7f2efbac5640 1 --2- 172.21.15.19:0/1583329450 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ef4100a70 0x7f2ef4100ed0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.116+0000 7f2efbac5640 1 --2- 172.21.15.19:0/1583329450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ef4106a70 0x7f2ef4106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.116+0000 7f2efbac5640 1 -- 172.21.15.19:0/1583329450 >> 172.21.15.19:0/1583329450 conn(0x7f2ef40fc790 msgr2=0x7f2ef40febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:51.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.116+0000 7f2efbac5640 1 -- 172.21.15.19:0/1583329450 shutdown_connections 2024-09-19T09:00:51.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.116+0000 7f2efbac5640 1 -- 172.21.15.19:0/1583329450 wait complete. 2024-09-19T09:00:51.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.116+0000 7f2efbac5640 1 Processor -- start 2024-09-19T09:00:51.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.116+0000 7f2efbac5640 1 -- start start 2024-09-19T09:00:51.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.117+0000 7f2efbac5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ef4100a70 0x7f2ef4199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:51.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.117+0000 7f2efbac5640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ef4101410 0x7f2ef4199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:51.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.117+0000 7f2efbac5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ef4106a70 0x7f2ef41a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:51.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.117+0000 7f2efbac5640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef4110e70 con 0x7f2ef4106a70 2024-09-19T09:00:51.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.117+0000 7f2efbac5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef4110cf0 con 0x7f2ef4100a70 2024-09-19T09:00:51.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.117+0000 7f2efbac5640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef4110ff0 con 0x7f2ef4101410 2024-09-19T09:00:51.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.117+0000 7f2ef9861640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ef4100a70 0x7f2ef4199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:51.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.117+0000 7f2efa062640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ef4106a70 0x7f2ef41a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:51.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.117+0000 7f2ef9060640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ef4101410 0x7f2ef4199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:51.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.117+0000 7f2ef9861640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ef4100a70 0x7f2ef4199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:52674/0 (socket says 172.21.15.19:52674) 2024-09-19T09:00:51.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.117+0000 7f2ef9861640 1 -- 172.21.15.19:0/1973317354 learned_addr learned my addr 172.21.15.19:0/1973317354 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:51.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.117+0000 7f2efa062640 1 -- 172.21.15.19:0/1973317354 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ef4101410 msgr2=0x7f2ef4199780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:51.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.117+0000 7f2efa062640 1 --2- 172.21.15.19:0/1973317354 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ef4101410 0x7f2ef4199780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.117+0000 7f2efa062640 1 -- 172.21.15.19:0/1973317354 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ef4100a70 msgr2=0x7f2ef4199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:51.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.117+0000 7f2efa062640 1 --2- 172.21.15.19:0/1973317354 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ef4100a70 0x7f2ef4199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.117+0000 7f2efa062640 1 -- 172.21.15.19:0/1973317354 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ef41a4800 con 0x7f2ef4106a70 2024-09-19T09:00:51.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.117+0000 7f2ef9861640 1 --2- 172.21.15.19:0/1973317354 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ef4100a70 0x7f2ef4199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:51.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.117+0000 7f2ef9060640 1 --2- 172.21.15.19:0/1973317354 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ef4101410 0x7f2ef4199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:51.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.118+0000 7f2efa062640 1 --2- 172.21.15.19:0/1973317354 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ef4106a70 0x7f2ef41a42c0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f2eec009d10 tx=0x7f2eec007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:51.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.118+0000 7f2eeaffd640 1 -- 172.21.15.19:0/1973317354 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eec009e60 con 0x7f2ef4106a70 2024-09-19T09:00:51.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.118+0000 7f2efbac5640 1 -- 172.21.15.19:0/1973317354 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ef4197030 con 0x7f2ef4106a70 2024-09-19T09:00:51.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.118+0000 7f2eeaffd640 1 -- 172.21.15.19:0/1973317354 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2eec0100d0 con 0x7f2ef4106a70 2024-09-19T09:00:51.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.118+0000 7f2eeaffd640 1 -- 172.21.15.19:0/1973317354 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eec00ed80 con 0x7f2ef4106a70 2024-09-19T09:00:51.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.118+0000 7f2efbac5640 1 -- 172.21.15.19:0/1973317354 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ef41974e0 con 0x7f2ef4106a70 2024-09-19T09:00:51.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.121+0000 7f2efde9e740 1 Processor -- start 2024-09-19T09:00:51.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.121+0000 7f2eeaffd640 1 -- 172.21.15.19:0/1973317354 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f2eec010280 con 0x7f2ef4106a70 2024-09-19T09:00:51.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.122+0000 7f2efde9e740 1 -- start start 2024-09-19T09:00:51.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.122+0000 7f2efde9e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593da4b3850 0x5593da4b3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:51.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.122+0000 7f2efde9e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593da4b4170 0x5593da4be4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:51.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.122+0000 7f2efde9e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593da4bea30 0x5593da4c0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:51.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.122+0000 7f2efde9e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5593da418160 con 0x5593da4bea30 2024-09-19T09:00:51.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.122+0000 7f2efde9e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5593da3bf720 con 0x5593da4b4170 2024-09-19T09:00:51.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.122+0000 7f2efde9e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5593da414120 con 0x5593da4b3850 2024-09-19T09:00:51.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.122+0000 7f2ef9861640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593da4b4170 0x5593da4be4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:51.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.122+0000 7f2ef9861640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593da4b4170 0x5593da4be4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:52682/0 (socket says 172.21.15.19:52682) 2024-09-19T09:00:51.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.122+0000 7f2ef9861640 1 -- 172.21.15.19:0/3465902962 learned_addr learned my addr 172.21.15.19:0/3465902962 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:51.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.122+0000 7f2ef9060640 1 --2- 172.21.15.19:0/3465902962 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593da4bea30 0x5593da4c0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:51.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.122+0000 7f2ef9060640 1 --2- 172.21.15.19:0/3465902962 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593da4b3850 0x5593da4b3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:51.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.123+0000 7f2ef9861640 1 -- 172.21.15.19:0/3465902962 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593da4b3850 msgr2=0x5593da4b3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:51.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.123+0000 7f2ef9861640 1 --2- 172.21.15.19:0/3465902962 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593da4b3850 0x5593da4b3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.123+0000 7f2ef9861640 1 -- 172.21.15.19:0/3465902962 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593da4bea30 msgr2=0x5593da4c0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:51.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.123+0000 7f2ef9861640 1 --2- 172.21.15.19:0/3465902962 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593da4bea30 0x5593da4c0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.123+0000 7f2ef9861640 1 -- 172.21.15.19:0/3465902962 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593da189ba0 con 0x5593da4b4170 2024-09-19T09:00:51.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.123+0000 7f2ef9060640 1 --2- 172.21.15.19:0/3465902962 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593da4bea30 0x5593da4c0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:00:51.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.123+0000 7f2eeaffd640 1 --2- 172.21.15.19:0/1973317354 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2ee00a32c0 0x7f2ee00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:51.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.123+0000 7f2ef9861640 1 --2- 172.21.15.19:0/3465902962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593da4b4170 0x5593da4be4f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2ef00115c0 tx=0x7f2ef0011a80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=506f38982a2090e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:51.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.123+0000 7f2eeaffd640 1 -- 172.21.15.19:0/1973317354 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2eec0d2e30 con 0x7f2ef4106a70 2024-09-19T09:00:51.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.123+0000 7f2ef9060640 1 --2- 172.21.15.19:0/1973317354 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2ee00a32c0 0x7f2ee00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:51.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.123+0000 7f2edffff640 1 -- 172.21.15.19:0/3465902962 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef000f660 con 0x5593da4b4170 2024-09-19T09:00:51.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.123+0000 7f2edffff640 1 -- 172.21.15.19:0/3465902962 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ef000fce0 con 0x5593da4b4170 2024-09-19T09:00:51.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.123+0000 7f2edffff640 1 -- 172.21.15.19:0/3465902962 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef00183b0 con 0x5593da4b4170 2024-09-19T09:00:51.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.124+0000 7f2efde9e740 1 -- 172.21.15.19:0/3465902962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593da4b4170 msgr2=0x5593da4be4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:51.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.124+0000 7f2ef9060640 1 --2- 172.21.15.19:0/1973317354 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2ee00a32c0 0x7f2ee00a5780 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4009230 tx=0x7f2ee403f040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:51.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.124+0000 7f2efde9e740 1 --2- 172.21.15.19:0/3465902962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593da4b4170 0x5593da4be4f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2ef00115c0 tx=0x7f2ef0011a80 comp rx=0 tx=0).stop 2024-09-19T09:00:51.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.124+0000 7f2efde9e740 1 -- 172.21.15.19:0/3465902962 shutdown_connections 2024-09-19T09:00:51.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.124+0000 7f2efde9e740 1 --2- 172.21.15.19:0/3465902962 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593da4bea30 0x5593da4c0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.124+0000 7f2efde9e740 1 --2- 172.21.15.19:0/3465902962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593da4b4170 0x5593da4be4f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.124+0000 7f2efde9e740 1 --2- 172.21.15.19:0/3465902962 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593da4b3850 0x5593da4b3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.124+0000 7f2efde9e740 1 -- 172.21.15.19:0/3465902962 >> 172.21.15.19:0/3465902962 conn(0x5593da4afde0 msgr2=0x5593da4b01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:51.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.124+0000 7f2efde9e740 1 -- 172.21.15.19:0/3465902962 shutdown_connections 2024-09-19T09:00:51.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.124+0000 7f2efde9e740 1 -- 172.21.15.19:0/3465902962 wait complete. 2024-09-19T09:00:51.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.125+0000 7f2efde9e740 1 -- start start 2024-09-19T09:00:51.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.125+0000 7f2efde9e740 1 Processor -- start 2024-09-19T09:00:51.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.125+0000 7f2efde9e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593da4b3850 0x5593da4bb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:51.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.125+0000 7f2efde9e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593da4b4170 0x5593da4bbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:51.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.125+0000 7f2efde9e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593da4bea30 0x5593da4bc390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:51.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.125+0000 7f2efde9e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5593da4c1600 con 0x5593da4b3850 2024-09-19T09:00:51.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.125+0000 7f2efde9e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5593da3a0900 con 0x5593da4b4170 2024-09-19T09:00:51.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.125+0000 7f2efde9e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5593da4c1780 con 0x5593da4bea30 2024-09-19T09:00:51.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.125+0000 7f2efde9e740 10 client.0 _ll_register_callbacks cb 0x5593da39e780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:51.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.125+0000 7f2ef9861640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593da4b3850 0x5593da4bb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:51.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.125+0000 7f2ef9060640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593da4b4170 0x5593da4bbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:51.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.125+0000 7f2ef9861640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593da4b3850 0x5593da4bb910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60936/0 (socket says 172.21.15.19:60936) 2024-09-19T09:00:51.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.125+0000 7f2ef9861640 1 -- 172.21.15.19:0/2216018522 learned_addr learned my addr 172.21.15.19:0/2216018522 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:51.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.125+0000 7f2efa062640 1 --2- 172.21.15.19:0/2216018522 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593da4bea30 0x5593da4bc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:51.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.126+0000 7f2ef9060640 1 -- 172.21.15.19:0/2216018522 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593da4bea30 msgr2=0x5593da4bc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:51.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.126+0000 7f2ef9060640 1 --2- 172.21.15.19:0/2216018522 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593da4bea30 0x5593da4bc390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.126+0000 7f2ef9060640 1 -- 172.21.15.19:0/2216018522 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593da4b3850 msgr2=0x5593da4bb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:51.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.126+0000 7f2ef9060640 1 --2- 172.21.15.19:0/2216018522 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593da4b3850 0x5593da4bb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.126+0000 7f2ef9060640 1 -- 172.21.15.19:0/2216018522 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593da3e0c50 con 0x5593da4b4170 2024-09-19T09:00:51.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.126+0000 7f2ef9060640 1 --2- 172.21.15.19:0/2216018522 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593da4b4170 0x5593da4bbe50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4005940 tx=0x7f2ee40058d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d378a129db5a7d8c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:51.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.126+0000 7f2edd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T09:00:51.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.126+0000 7f2edd7fa640 1 -- 172.21.15.19:0/2216018522 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee4043030 con 0x5593da4b4170 2024-09-19T09:00:51.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.127+0000 7f2edd7fa640 1 -- 172.21.15.19:0/2216018522 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2ee4031950 con 0x5593da4b4170 2024-09-19T09:00:51.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.127+0000 7f2efde9e740 1 -- 172.21.15.19:0/2216018522 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ef000fce0 con 0x5593da4b4170 2024-09-19T09:00:51.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.127+0000 7f2edd7fa640 1 -- 172.21.15.19:0/2216018522 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f2ee4035040 con 0x5593da4b4170 2024-09-19T09:00:51.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.127+0000 7f2efde9e740 10 client.26780 fetch_fsmap learned FSMap version 36 2024-09-19T09:00:51.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.127+0000 7f2efde9e740 1 -- 172.21.15.19:0/2216018522 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5593da4cd2b0 con 0x5593da4b4170 2024-09-19T09:00:51.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.127+0000 7f2edd7fa640 1 -- 172.21.15.19:0/2216018522 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ef000fce0 con 0x5593da4b4170 2024-09-19T09:00:51.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.127+0000 7f2edd7fa640 1 -- 172.21.15.19:0/2216018522 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f2ee404ccb0 con 0x5593da4b4170 2024-09-19T09:00:51.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.127+0000 7f2efde9e740 10 client.26780 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:00:51.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.127+0000 7f2efde9e740 10 client.26780 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:00:51.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.127+0000 7f2efde9e740 20 client.26780 populate_metadata read hostname 'smithi019' 2024-09-19T09:00:51.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.127+0000 7f2efde9e740 1 --2- 172.21.15.19:0/2216018522 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5593da4ce7c0 0x5593da4d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:51.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.127+0000 7f2efde9e740 4 client.26780 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:00:51.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.127+0000 7f2efde9e740 1 -- 172.21.15.19:0/2216018522 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593da425890 con 0x5593da4ce7c0 2024-09-19T09:00:51.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.127+0000 7f2ef9861640 1 --2- 172.21.15.19:0/2216018522 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5593da4ce7c0 0x5593da4d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:51.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.128+0000 7f2edd7fa640 10 client.26780 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:00:51.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.128+0000 7f2ef9861640 1 --2- 172.21.15.19:0/2216018522 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5593da4ce7c0 0x5593da4d0c00 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=672791fe1126df7a server_cookie=785247fe62a1cebb in_seq=0 out_seq=0 2024-09-19T09:00:51.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.135+0000 7f2edd7fa640 1 -- 172.21.15.19:0/2216018522 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5593da425890 con 0x5593da4ce7c0 2024-09-19T09:00:51.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.135+0000 7f2edd7fa640 10 client.26780 handle_command_reply: tid=0 2024-09-19T09:00:51.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.135+0000 7f2efde9e740 1 client.26780 shutdown 2024-09-19T09:00:51.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.135+0000 7f2efde9e740 1 -- 172.21.15.19:0/2216018522 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593da4b4170 msgr2=0x5593da4bbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:51.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.135+0000 7f2efde9e740 1 --2- 172.21.15.19:0/2216018522 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593da4b4170 0x5593da4bbe50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4005940 tx=0x7f2ee40058d0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.135+0000 7f2efde9e740 1 -- 172.21.15.19:0/2216018522 shutdown_connections 2024-09-19T09:00:51.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.135+0000 7f2efde9e740 1 --2- 172.21.15.19:0/2216018522 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5593da4ce7c0 0x5593da4d0c00 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.135+0000 7f2edd7fa640 0 client.26780 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:00:51.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.135+0000 7f2efde9e740 1 --2- 172.21.15.19:0/2216018522 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593da4bea30 0x5593da4bc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.135+0000 7f2efde9e740 1 --2- 172.21.15.19:0/2216018522 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593da4b4170 0x5593da4bbe50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.135+0000 7f2efde9e740 1 --2- 172.21.15.19:0/2216018522 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593da4b3850 0x5593da4bb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.136+0000 7f2efde9e740 1 -- 172.21.15.19:0/2216018522 >> 172.21.15.19:0/2216018522 conn(0x5593da4afde0 msgr2=0x5593da4b5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:51.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.136+0000 7f2efde9e740 1 -- 172.21.15.19:0/2216018522 shutdown_connections 2024-09-19T09:00:51.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.136+0000 7f2efde9e740 1 -- 172.21.15.19:0/2216018522 wait complete. 2024-09-19T09:00:51.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.136+0000 7f2efde9e740 20 client.26780 trim_cache size 0 max 16384 2024-09-19T09:00:51.146 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:51.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.155+0000 7f2efde9e740 1 Processor -- start 2024-09-19T09:00:51.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.155+0000 7f2efde9e740 1 -- start start 2024-09-19T09:00:51.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.155+0000 7f2efde9e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593da4b3850 0x5593da4aad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:51.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.155+0000 7f2efde9e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593da4b4170 0x5593da4b59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:51.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.155+0000 7f2efde9e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593da4bea30 0x5593da4d64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:51.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.155+0000 7f2efde9e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef41ab240 con 0x5593da4b3850 2024-09-19T09:00:51.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.155+0000 7f2efde9e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef41acd80 con 0x5593da4b4170 2024-09-19T09:00:51.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.155+0000 7f2efde9e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef41ab910 con 0x5593da4bea30 2024-09-19T09:00:51.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.155+0000 7f2ef9861640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593da4b3850 0x5593da4aad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:51.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.155+0000 7f2ef9861640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593da4b3850 0x5593da4aad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60942/0 (socket says 172.21.15.19:60942) 2024-09-19T09:00:51.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.155+0000 7f2ef9861640 1 -- 172.21.15.19:0/3854219222 learned_addr learned my addr 172.21.15.19:0/3854219222 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:51.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.155+0000 7f2ef9060640 1 --2- 172.21.15.19:0/3854219222 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593da4b4170 0x5593da4b59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:51.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.155+0000 7f2efa062640 1 --2- 172.21.15.19:0/3854219222 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593da4bea30 0x5593da4d64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:51.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.156+0000 7f2ef9060640 1 -- 172.21.15.19:0/3854219222 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593da4bea30 msgr2=0x5593da4d64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:51.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.156+0000 7f2ef9060640 1 --2- 172.21.15.19:0/3854219222 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593da4bea30 0x5593da4d64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.156+0000 7f2ef9060640 1 -- 172.21.15.19:0/3854219222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593da4b3850 msgr2=0x5593da4aad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:51.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.156+0000 7f2ef9060640 1 --2- 172.21.15.19:0/3854219222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593da4b3850 0x5593da4aad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.156+0000 7f2ef9060640 1 -- 172.21.15.19:0/3854219222 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593da4ba8c0 con 0x5593da4b4170 2024-09-19T09:00:51.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.156+0000 7f2ef9861640 1 --2- 172.21.15.19:0/3854219222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593da4b3850 0x5593da4aad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:51.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.156+0000 7f2ef9060640 1 --2- 172.21.15.19:0/3854219222 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593da4b4170 0x5593da4b59b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2ee402a910 tx=0x7f2ee402a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88e7a9119e7d2b88 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:51.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.156+0000 7f2edf7fe640 1 -- 172.21.15.19:0/3854219222 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee4064070 con 0x5593da4b4170 2024-09-19T09:00:51.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.156+0000 7f2edf7fe640 1 -- 172.21.15.19:0/3854219222 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ee4045070 con 0x5593da4b4170 2024-09-19T09:00:51.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.156+0000 7f2edf7fe640 1 -- 172.21.15.19:0/3854219222 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ee4043070 con 0x5593da4b4170 2024-09-19T09:00:51.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.157+0000 7f2efde9e740 1 -- 172.21.15.19:0/3854219222 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593da4b4170 msgr2=0x5593da4b59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:51.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.157+0000 7f2efde9e740 1 --2- 172.21.15.19:0/3854219222 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593da4b4170 0x5593da4b59b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2ee402a910 tx=0x7f2ee402a3f0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.157+0000 7f2efde9e740 1 -- 172.21.15.19:0/3854219222 shutdown_connections 2024-09-19T09:00:51.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.157+0000 7f2efde9e740 1 --2- 172.21.15.19:0/3854219222 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593da4bea30 0x5593da4d64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.157+0000 7f2efde9e740 1 --2- 172.21.15.19:0/3854219222 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593da4b4170 0x5593da4b59b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.157+0000 7f2efde9e740 1 --2- 172.21.15.19:0/3854219222 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593da4b3850 0x5593da4aad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.157+0000 7f2efde9e740 1 -- 172.21.15.19:0/3854219222 >> 172.21.15.19:0/3854219222 conn(0x5593da4afde0 msgr2=0x5593da4b52a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:51.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.157+0000 7f2efde9e740 1 -- 172.21.15.19:0/3854219222 shutdown_connections 2024-09-19T09:00:51.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.157+0000 7f2efde9e740 1 -- 172.21.15.19:0/3854219222 wait complete. 2024-09-19T09:00:51.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.158+0000 7f2efde9e740 1 -- start start 2024-09-19T09:00:51.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.158+0000 7f2efde9e740 1 Processor -- start 2024-09-19T09:00:51.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.158+0000 7f2efde9e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593da4b3850 0x5593da4c7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:51.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.159+0000 7f2efde9e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593da4b4170 0x5593da4c2470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:51.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.159+0000 7f2efde9e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593da4bea30 0x5593da4c29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:51.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.159+0000 7f2efde9e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef41ac6b0 con 0x5593da4b4170 2024-09-19T09:00:51.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.159+0000 7f2efde9e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef41abfe0 con 0x5593da4b3850 2024-09-19T09:00:51.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.159+0000 7f2efde9e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2ef41a9240 con 0x5593da4bea30 2024-09-19T09:00:51.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.159+0000 7f2ef9060640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593da4b4170 0x5593da4c2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:51.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.159+0000 7f2ef9060640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593da4b4170 0x5593da4c2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60958/0 (socket says 172.21.15.19:60958) 2024-09-19T09:00:51.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.159+0000 7f2ef9861640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593da4b3850 0x5593da4c7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:51.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.159+0000 7f2ef9060640 1 -- 172.21.15.19:0/2205850134 learned_addr learned my addr 172.21.15.19:0/2205850134 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:51.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.159+0000 7f2efde9e740 10 client.0 _ll_register_callbacks cb 0x7f2ee4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:51.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.159+0000 7f2efa062640 1 --2- 172.21.15.19:0/2205850134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593da4bea30 0x5593da4c29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:51.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.159+0000 7f2ef9861640 1 -- 172.21.15.19:0/2205850134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593da4bea30 msgr2=0x5593da4c29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:51.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.159+0000 7f2ef9861640 1 --2- 172.21.15.19:0/2205850134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593da4bea30 0x5593da4c29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.159+0000 7f2ef9861640 1 -- 172.21.15.19:0/2205850134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593da4b4170 msgr2=0x5593da4c2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:51.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.159+0000 7f2ef9861640 1 --2- 172.21.15.19:0/2205850134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593da4b4170 0x5593da4c2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.159+0000 7f2ef9861640 1 -- 172.21.15.19:0/2205850134 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593da4c3200 con 0x5593da4b3850 2024-09-19T09:00:51.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.159+0000 7f2ef9060640 1 --2- 172.21.15.19:0/2205850134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593da4b4170 0x5593da4c2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:51.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.159+0000 7f2efde9e740 1 -- 172.21.15.19:0/2205850134 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ee4045070 con 0x5593da4b3850 2024-09-19T09:00:51.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.159+0000 7f2ef9861640 1 --2- 172.21.15.19:0/2205850134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593da4b3850 0x5593da4c7140 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0014040 tx=0x7f2ef0019bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4957f68136dcf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:51.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.159+0000 7f2edd7fa640 10 client.26786 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T09:00:51.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.160+0000 7f2edd7fa640 1 -- 172.21.15.19:0/2205850134 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ef0019410 con 0x5593da4b3850 2024-09-19T09:00:51.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.160+0000 7f2edd7fa640 1 -- 172.21.15.19:0/2205850134 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2ef00195b0 con 0x5593da4b3850 2024-09-19T09:00:51.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.160+0000 7f2edd7fa640 1 -- 172.21.15.19:0/2205850134 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f2ef0019830 con 0x5593da4b3850 2024-09-19T09:00:51.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.160+0000 7f2efde9e740 10 client.26786 fetch_fsmap learned FSMap version 36 2024-09-19T09:00:51.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.160+0000 7f2efde9e740 1 -- 172.21.15.19:0/2205850134 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({fsmap=36}) -- 0x5593da539380 con 0x5593da4b3850 2024-09-19T09:00:51.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.160+0000 7f2edd7fa640 1 -- 172.21.15.19:0/2205850134 <== mon.2 v2:172.21.15.155:3300/0 4 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f2ef00050b0 con 0x5593da4b3850 2024-09-19T09:00:51.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.160+0000 7f2efde9e740 10 client.26786 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:00:51.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.160+0000 7f2efde9e740 10 client.26786 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:00:51.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.160+0000 7f2efde9e740 20 client.26786 populate_metadata read hostname 'smithi019' 2024-09-19T09:00:51.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.160+0000 7f2efde9e740 1 --2- 172.21.15.19:0/2205850134 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5593da4ce7c0 0x5593da53b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:51.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.160+0000 7f2efde9e740 4 client.26786 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.75, "await_for": 45.0}] 2024-09-19T09:00:51.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.160+0000 7f2efde9e740 1 -- 172.21.15.19:0/2205850134 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 145.75, "await_for": 45.0}) -- 0x5593da41fbe0 con 0x5593da4ce7c0 2024-09-19T09:00:51.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.161+0000 7f2ef9060640 1 --2- 172.21.15.19:0/2205850134 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5593da4ce7c0 0x5593da53b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:51.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.161+0000 7f2ef9060640 1 --2- 172.21.15.19:0/2205850134 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5593da4ce7c0 0x5593da53b870 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b6ffc3e3c7449f5 server_cookie=f78cb9bb11bc311d in_seq=0 out_seq=0 2024-09-19T09:00:51.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.161+0000 7f2edd7fa640 10 client.26786 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:00:51.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.606+0000 7f2f2d2ef640 1 -- 172.21.15.19:0/678230782 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f28106f10 msgr2=0x7f2f2810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:51.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.606+0000 7f2f2d2ef640 1 --2- 172.21.15.19:0/678230782 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f28106f10 0x7f2f2810ea90 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f2f20009ca0 tx=0x7f2f2002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.606+0000 7f2f2d2ef640 1 -- 172.21.15.19:0/678230782 shutdown_connections 2024-09-19T09:00:51.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.606+0000 7f2f2d2ef640 1 --2- 172.21.15.19:0/678230782 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2f28102790 0x7f2f281067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.606+0000 7f2f2d2ef640 1 --2- 172.21.15.19:0/678230782 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f28106f10 0x7f2f2810ea90 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.606+0000 7f2f2d2ef640 1 --2- 172.21.15.19:0/678230782 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f28101de0 0x7f2f281021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.606+0000 7f2f2d2ef640 1 -- 172.21.15.19:0/678230782 >> 172.21.15.19:0/678230782 conn(0x7f2f280fd8c0 msgr2=0x7f2f280ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:51.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.606+0000 7f2f2d2ef640 1 -- 172.21.15.19:0/678230782 shutdown_connections 2024-09-19T09:00:51.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.607+0000 7f2f2d2ef640 1 -- 172.21.15.19:0/678230782 wait complete. 2024-09-19T09:00:51.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.607+0000 7f2f2d2ef640 1 Processor -- start 2024-09-19T09:00:51.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.607+0000 7f2f2d2ef640 1 -- start start 2024-09-19T09:00:51.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.607+0000 7f2f2d2ef640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f28101de0 0x7f2f280744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:51.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.607+0000 7f2f2d2ef640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f28102790 0x7f2f28074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:51.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.607+0000 7f2f2d2ef640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2f28106f10 0x7f2f28074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:51.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.607+0000 7f2f2d2ef640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2f28111f90 con 0x7f2f28102790 2024-09-19T09:00:51.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.607+0000 7f2f2d2ef640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2f28111e10 con 0x7f2f28101de0 2024-09-19T09:00:51.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.607+0000 7f2f2d2ef640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2f28112110 con 0x7f2f28106f10 2024-09-19T09:00:51.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.608+0000 7f2f267fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f28102790 0x7f2f28074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:51.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.608+0000 7f2f267fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f28102790 0x7f2f28074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60974/0 (socket says 172.21.15.19:60974) 2024-09-19T09:00:51.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.608+0000 7f2f267fc640 1 -- 172.21.15.19:0/2767855978 learned_addr learned my addr 172.21.15.19:0/2767855978 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:51.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.608+0000 7f2f26ffd640 1 --2- 172.21.15.19:0/2767855978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f28101de0 0x7f2f280744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:51.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.608+0000 7f2f277fe640 1 --2- 172.21.15.19:0/2767855978 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2f28106f10 0x7f2f28074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:51.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.608+0000 7f2f267fc640 1 -- 172.21.15.19:0/2767855978 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2f28106f10 msgr2=0x7f2f28074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:51.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.608+0000 7f2f267fc640 1 --2- 172.21.15.19:0/2767855978 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2f28106f10 0x7f2f28074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.608+0000 7f2f267fc640 1 -- 172.21.15.19:0/2767855978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f28101de0 msgr2=0x7f2f280744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:51.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.608+0000 7f2f267fc640 1 --2- 172.21.15.19:0/2767855978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f28101de0 0x7f2f280744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.608+0000 7f2f267fc640 1 -- 172.21.15.19:0/2767855978 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f281a69c0 con 0x7f2f28102790 2024-09-19T09:00:51.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.608+0000 7f2f26ffd640 1 --2- 172.21.15.19:0/2767855978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f28101de0 0x7f2f280744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:51.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.608+0000 7f2f267fc640 1 --2- 172.21.15.19:0/2767855978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f28102790 0x7f2f28074a30 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c00b4a0 tx=0x7f2f1c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:51.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.608+0000 7f2f0ffff640 1 -- 172.21.15.19:0/2767855978 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c014070 con 0x7f2f28102790 2024-09-19T09:00:51.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.608+0000 7f2f2d2ef640 1 -- 172.21.15.19:0/2767855978 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f281a6cb0 con 0x7f2f28102790 2024-09-19T09:00:51.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.609+0000 7f2f0ffff640 1 -- 172.21.15.19:0/2767855978 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f1c010af0 con 0x7f2f28102790 2024-09-19T09:00:51.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.609+0000 7f2f2d2ef640 1 -- 172.21.15.19:0/2767855978 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f281a71e0 con 0x7f2f28102790 2024-09-19T09:00:51.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.609+0000 7f2f0ffff640 1 -- 172.21.15.19:0/2767855978 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c017d10 con 0x7f2f28102790 2024-09-19T09:00:51.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.612+0000 7f2f2f6c8740 1 Processor -- start 2024-09-19T09:00:51.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.612+0000 7f2f0ffff640 1 -- 172.21.15.19:0/2767855978 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f2f1c017070 con 0x7f2f28102790 2024-09-19T09:00:51.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.612+0000 7f2f2f6c8740 1 -- start start 2024-09-19T09:00:51.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.612+0000 7f2f2f6c8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6eeb8fb40 0x55b6eeb8e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:51.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.612+0000 7f2f2f6c8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6eeb8e5d0 0x55b6eeb8ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:51.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.612+0000 7f2f2f6c8740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6eeb99370 0x55b6eeb9b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:51.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.612+0000 7f2f2f6c8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b6eeaf42f0 con 0x55b6eeb8fb40 2024-09-19T09:00:51.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.612+0000 7f2f2f6c8740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b6eea9bcf0 con 0x55b6eeb99370 2024-09-19T09:00:51.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.612+0000 7f2f2f6c8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b6eeaf02b0 con 0x55b6eeb8e5d0 2024-09-19T09:00:51.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.613+0000 7f2f277fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6eeb8fb40 0x55b6eeb8e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:51.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.613+0000 7f2f267fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6eeb99370 0x55b6eeb9b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:51.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.613+0000 7f2f277fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6eeb8fb40 0x55b6eeb8e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60986/0 (socket says 172.21.15.19:60986) 2024-09-19T09:00:51.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.613+0000 7f2f277fe640 1 -- 172.21.15.19:0/3036077038 learned_addr learned my addr 172.21.15.19:0/3036077038 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:51.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.613+0000 7f2f26ffd640 1 --2- 172.21.15.19:0/3036077038 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6eeb8e5d0 0x55b6eeb8ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:51.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.613+0000 7f2f267fc640 1 -- 172.21.15.19:0/3036077038 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6eeb8e5d0 msgr2=0x55b6eeb8ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:51.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.613+0000 7f2f267fc640 1 --2- 172.21.15.19:0/3036077038 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6eeb8e5d0 0x55b6eeb8ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.613+0000 7f2f267fc640 1 -- 172.21.15.19:0/3036077038 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6eeb8fb40 msgr2=0x55b6eeb8e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:51.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.613+0000 7f2f267fc640 1 --2- 172.21.15.19:0/3036077038 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6eeb8fb40 0x55b6eeb8e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.613+0000 7f2f267fc640 1 -- 172.21.15.19:0/3036077038 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6eea803a0 con 0x55b6eeb99370 2024-09-19T09:00:51.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.613+0000 7f2f0ffff640 1 --2- 172.21.15.19:0/2767855978 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2f100a32c0 0x7f2f100a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:51.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.613+0000 7f2f277fe640 1 --2- 172.21.15.19:0/2767855978 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2f100a32c0 0x7f2f100a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:51.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.613+0000 7f2f267fc640 1 --2- 172.21.15.19:0/3036077038 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6eeb99370 0x55b6eeb9b760 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0cc620 tx=0x7f2f1c0974c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db6a4b58514b82a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:51.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.613+0000 7f2f0ffff640 1 -- 172.21.15.19:0/2767855978 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2f1c0ceb40 con 0x7f2f28102790 2024-09-19T09:00:51.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.613+0000 7f2f0d7fa640 1 -- 172.21.15.19:0/3036077038 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c01e070 con 0x55b6eeb99370 2024-09-19T09:00:51.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.614+0000 7f2f0d7fa640 1 -- 172.21.15.19:0/3036077038 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f1c09b220 con 0x55b6eeb99370 2024-09-19T09:00:51.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.614+0000 7f2f0d7fa640 1 -- 172.21.15.19:0/3036077038 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c09ad60 con 0x55b6eeb99370 2024-09-19T09:00:51.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.614+0000 7f2f2f6c8740 1 -- 172.21.15.19:0/3036077038 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6eeb99370 msgr2=0x55b6eeb9b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:51.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.614+0000 7f2f277fe640 1 --2- 172.21.15.19:0/2767855978 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2f100a32c0 0x7f2f100a5780 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2f20004af0 tx=0x7f2f20004a80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:51.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.614+0000 7f2f2f6c8740 1 --2- 172.21.15.19:0/3036077038 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6eeb99370 0x55b6eeb9b760 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0cc620 tx=0x7f2f1c0974c0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.614+0000 7f2f2f6c8740 1 -- 172.21.15.19:0/3036077038 shutdown_connections 2024-09-19T09:00:51.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.614+0000 7f2f2f6c8740 1 --2- 172.21.15.19:0/3036077038 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6eeb8e5d0 0x55b6eeb8ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.614+0000 7f2f2f6c8740 1 --2- 172.21.15.19:0/3036077038 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6eeb99370 0x55b6eeb9b760 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.614+0000 7f2f2f6c8740 1 --2- 172.21.15.19:0/3036077038 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6eeb8fb40 0x55b6eeb8e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.614+0000 7f2f2f6c8740 1 -- 172.21.15.19:0/3036077038 >> 172.21.15.19:0/3036077038 conn(0x55b6eeb57310 msgr2=0x55b6eeb8ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:51.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.615+0000 7f2f2f6c8740 1 -- 172.21.15.19:0/3036077038 shutdown_connections 2024-09-19T09:00:51.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.615+0000 7f2f2f6c8740 1 -- 172.21.15.19:0/3036077038 wait complete. 2024-09-19T09:00:51.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.615+0000 7f2f2f6c8740 1 -- start start 2024-09-19T09:00:51.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.615+0000 7f2f2f6c8740 1 Processor -- start 2024-09-19T09:00:51.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.615+0000 7f2f2f6c8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6eeb8e5d0 0x55b6eeb98d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:51.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.615+0000 7f2f2f6c8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6eeb8fb40 0x55b6eeb96000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:51.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.615+0000 7f2f2f6c8740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6eeb99370 0x55b6eeb965d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:51.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.615+0000 7f2f2f6c8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b6eeb9c110 con 0x55b6eeb8fb40 2024-09-19T09:00:51.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.615+0000 7f2f2f6c8740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b6eeaaf060 con 0x55b6eeb99370 2024-09-19T09:00:51.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.615+0000 7f2f2f6c8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b6eeb9c290 con 0x55b6eeb8e5d0 2024-09-19T09:00:51.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.615+0000 7f2f2f6c8740 10 client.0 _ll_register_callbacks cb 0x55b6ee8028c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:51.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.615+0000 7f2f267fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6eeb8fb40 0x55b6eeb96000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:51.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.615+0000 7f2f277fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6eeb99370 0x55b6eeb965d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:51.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.616+0000 7f2f277fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6eeb99370 0x55b6eeb965d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:52722/0 (socket says 172.21.15.19:52722) 2024-09-19T09:00:51.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.616+0000 7f2f277fe640 1 -- 172.21.15.19:0/1993847584 learned_addr learned my addr 172.21.15.19:0/1993847584 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:51.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.616+0000 7f2f26ffd640 1 --2- 172.21.15.19:0/1993847584 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6eeb8e5d0 0x55b6eeb98d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:51.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.616+0000 7f2f277fe640 1 -- 172.21.15.19:0/1993847584 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6eeb8e5d0 msgr2=0x55b6eeb98d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:51.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.616+0000 7f2f277fe640 1 --2- 172.21.15.19:0/1993847584 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6eeb8e5d0 0x55b6eeb98d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.616+0000 7f2f277fe640 1 -- 172.21.15.19:0/1993847584 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6eeb8fb40 msgr2=0x55b6eeb96000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:51.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.616+0000 7f2f277fe640 1 --2- 172.21.15.19:0/1993847584 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6eeb8fb40 0x55b6eeb96000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.616+0000 7f2f277fe640 1 -- 172.21.15.19:0/1993847584 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6ee8653c0 con 0x55b6eeb99370 2024-09-19T09:00:51.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.616+0000 7f2f267fc640 1 --2- 172.21.15.19:0/1993847584 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6eeb8fb40 0x55b6eeb96000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:51.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.616+0000 7f2f277fe640 1 --2- 172.21.15.19:0/1993847584 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6eeb99370 0x55b6eeb965d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2f20003bd0 tx=0x7f2f2002a8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fa312aa97b14889 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:51.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.616+0000 7f2f0aff5640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T09:00:51.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.616+0000 7f2f0aff5640 1 -- 172.21.15.19:0/1993847584 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f20004250 con 0x55b6eeb99370 2024-09-19T09:00:51.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.616+0000 7f2f0aff5640 1 -- 172.21.15.19:0/1993847584 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2f200043f0 con 0x55b6eeb99370 2024-09-19T09:00:51.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.616+0000 7f2f2f6c8740 1 -- 172.21.15.19:0/1993847584 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f1c09b220 con 0x55b6eeb99370 2024-09-19T09:00:51.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.617+0000 7f2f0aff5640 1 -- 172.21.15.19:0/1993847584 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f2f200045f0 con 0x55b6eeb99370 2024-09-19T09:00:51.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.617+0000 7f2f2f6c8740 10 client.26798 fetch_fsmap learned FSMap version 36 2024-09-19T09:00:51.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.617+0000 7f2f2f6c8740 1 -- 172.21.15.19:0/1993847584 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55b6eeba7bc0 con 0x55b6eeb99370 2024-09-19T09:00:51.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.617+0000 7f2f0aff5640 1 -- 172.21.15.19:0/1993847584 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f1c09b220 con 0x55b6eeb99370 2024-09-19T09:00:51.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.617+0000 7f2f0aff5640 1 -- 172.21.15.19:0/1993847584 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f2f200306e0 con 0x55b6eeb99370 2024-09-19T09:00:51.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.617+0000 7f2f2f6c8740 10 client.26798 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:00:51.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.617+0000 7f2f2f6c8740 10 client.26798 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T09:00:51.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.617+0000 7f2f2f6c8740 20 client.26798 populate_metadata read hostname 'smithi019' 2024-09-19T09:00:51.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.617+0000 7f2f2f6c8740 1 --2- 172.21.15.19:0/1993847584 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55b6eeba9080 0x55b6eebab470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:51.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.617+0000 7f2f2f6c8740 4 client.26798 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:00:51.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.617+0000 7f2f2f6c8740 1 -- 172.21.15.19:0/1993847584 --> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b6eeb01860 con 0x55b6eeba9080 2024-09-19T09:00:51.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.617+0000 7f2f26ffd640 1 --2- 172.21.15.19:0/1993847584 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55b6eeba9080 0x55b6eebab470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:51.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.618+0000 7f2f26ffd640 1 --2- 172.21.15.19:0/1993847584 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55b6eeba9080 0x55b6eebab470 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e60c73575ea29a41 server_cookie=173c8d3db3c7e769 in_seq=0 out_seq=0 2024-09-19T09:00:51.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.618+0000 7f2f0aff5640 10 client.26798 ms_handle_connect on v2:172.21.15.203:6834/2702758353 2024-09-19T09:00:51.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.618+0000 7f2f0aff5640 1 -- 172.21.15.19:0/1993847584 <== mds.4 v2:172.21.15.203:6834/2702758353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b6eeb01860 con 0x55b6eeba9080 2024-09-19T09:00:51.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.619+0000 7f2f0aff5640 10 client.26798 handle_command_reply: tid=0 2024-09-19T09:00:51.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.619+0000 7f2f2f6c8740 1 client.26798 shutdown 2024-09-19T09:00:51.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.619+0000 7f2f2f6c8740 1 -- 172.21.15.19:0/1993847584 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6eeb99370 msgr2=0x55b6eeb965d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:51.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.619+0000 7f2f2f6c8740 1 --2- 172.21.15.19:0/1993847584 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6eeb99370 0x55b6eeb965d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2f20003bd0 tx=0x7f2f2002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.619+0000 7f2f2f6c8740 1 -- 172.21.15.19:0/1993847584 shutdown_connections 2024-09-19T09:00:51.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.619+0000 7f2f2f6c8740 1 --2- 172.21.15.19:0/1993847584 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55b6eeba9080 0x55b6eebab470 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.619+0000 7f2f2f6c8740 1 --2- 172.21.15.19:0/1993847584 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6eeb99370 0x55b6eeb965d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.619+0000 7f2f2f6c8740 1 --2- 172.21.15.19:0/1993847584 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6eeb8fb40 0x55b6eeb96000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.619+0000 7f2f2f6c8740 1 --2- 172.21.15.19:0/1993847584 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6eeb8e5d0 0x55b6eeb98d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.619+0000 7f2f2f6c8740 1 -- 172.21.15.19:0/1993847584 >> 172.21.15.19:0/1993847584 conn(0x55b6eeb57310 msgr2=0x55b6eeb90930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:51.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.619+0000 7f2f0aff5640 0 client.26798 ms_handle_reset on v2:172.21.15.203:6834/2702758353 2024-09-19T09:00:51.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.619+0000 7f2f2f6c8740 1 -- 172.21.15.19:0/1993847584 shutdown_connections 2024-09-19T09:00:51.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.619+0000 7f2f2f6c8740 1 -- 172.21.15.19:0/1993847584 wait complete. 2024-09-19T09:00:51.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.619+0000 7f2f2f6c8740 20 client.26798 trim_cache size 0 max 16384 2024-09-19T09:00:51.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.632+0000 7f2f2f6c8740 1 Processor -- start 2024-09-19T09:00:51.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.632+0000 7f2f2f6c8740 1 -- start start 2024-09-19T09:00:51.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.632+0000 7f2f2f6c8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6eeb8e5d0 0x55b6eeb8ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:51.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.632+0000 7f2f2f6c8740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6eeb8fb40 0x55b6eeba53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:51.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.632+0000 7f2f2f6c8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6eeb99370 0x55b6eeb91120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:51.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.632+0000 7f2f2f6c8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2f281af810 con 0x55b6eeb8e5d0 2024-09-19T09:00:51.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.632+0000 7f2f2f6c8740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2f281b1350 con 0x55b6eeb8fb40 2024-09-19T09:00:51.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.632+0000 7f2f2f6c8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2f281afee0 con 0x55b6eeb99370 2024-09-19T09:00:51.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.632+0000 7f2f26ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6eeb8e5d0 0x55b6eeb8ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:51.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.632+0000 7f2f26ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6eeb8e5d0 0x55b6eeb8ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32778/0 (socket says 172.21.15.19:32778) 2024-09-19T09:00:51.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.632+0000 7f2f26ffd640 1 -- 172.21.15.19:0/3875026951 learned_addr learned my addr 172.21.15.19:0/3875026951 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:51.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.632+0000 7f2f267fc640 1 --2- 172.21.15.19:0/3875026951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6eeb8fb40 0x55b6eeba53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:51.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.632+0000 7f2f277fe640 1 --2- 172.21.15.19:0/3875026951 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6eeb99370 0x55b6eeb91120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:51.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.633+0000 7f2f277fe640 1 -- 172.21.15.19:0/3875026951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6eeb8fb40 msgr2=0x55b6eeba53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:51.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.633+0000 7f2f277fe640 1 --2- 172.21.15.19:0/3875026951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6eeb8fb40 0x55b6eeba53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.633+0000 7f2f277fe640 1 -- 172.21.15.19:0/3875026951 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6eeb8e5d0 msgr2=0x55b6eeb8ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:51.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.633+0000 7f2f277fe640 1 --2- 172.21.15.19:0/3875026951 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6eeb8e5d0 0x55b6eeb8ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.633+0000 7f2f277fe640 1 -- 172.21.15.19:0/3875026951 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6eeb98970 con 0x55b6eeb99370 2024-09-19T09:00:51.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.633+0000 7f2f26ffd640 1 --2- 172.21.15.19:0/3875026951 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6eeb8e5d0 0x55b6eeb8ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:51.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.633+0000 7f2f267fc640 1 --2- 172.21.15.19:0/3875026951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6eeb8fb40 0x55b6eeba53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:51.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.633+0000 7f2f277fe640 1 --2- 172.21.15.19:0/3875026951 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6eeb99370 0x55b6eeb91120 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2f20030cc0 tx=0x7f2f20031a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e3efec6da96d162 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:51.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.633+0000 7f2f0cff9640 1 -- 172.21.15.19:0/3875026951 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f20030d40 con 0x55b6eeb99370 2024-09-19T09:00:51.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.633+0000 7f2f0cff9640 1 -- 172.21.15.19:0/3875026951 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f2004e070 con 0x55b6eeb99370 2024-09-19T09:00:51.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.633+0000 7f2f0cff9640 1 -- 172.21.15.19:0/3875026951 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f2002faf0 con 0x55b6eeb99370 2024-09-19T09:00:51.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.634+0000 7f2f2f6c8740 1 -- 172.21.15.19:0/3875026951 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6eeb99370 msgr2=0x55b6eeb91120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:51.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.634+0000 7f2f2f6c8740 1 --2- 172.21.15.19:0/3875026951 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6eeb99370 0x55b6eeb91120 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2f20030cc0 tx=0x7f2f20031a60 comp rx=0 tx=0).stop 2024-09-19T09:00:51.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.634+0000 7f2f2f6c8740 1 -- 172.21.15.19:0/3875026951 shutdown_connections 2024-09-19T09:00:51.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.634+0000 7f2f2f6c8740 1 --2- 172.21.15.19:0/3875026951 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6eeb99370 0x55b6eeb91120 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.634+0000 7f2f2f6c8740 1 --2- 172.21.15.19:0/3875026951 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6eeb8fb40 0x55b6eeba53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.634+0000 7f2f2f6c8740 1 --2- 172.21.15.19:0/3875026951 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6eeb8e5d0 0x55b6eeb8ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.634+0000 7f2f2f6c8740 1 -- 172.21.15.19:0/3875026951 >> 172.21.15.19:0/3875026951 conn(0x55b6eeb57310 msgr2=0x55b6eeb8a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:51.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.634+0000 7f2f2f6c8740 1 -- 172.21.15.19:0/3875026951 shutdown_connections 2024-09-19T09:00:51.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.634+0000 7f2f2f6c8740 1 -- 172.21.15.19:0/3875026951 wait complete. 2024-09-19T09:00:51.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.635+0000 7f2f2f6c8740 1 -- start start 2024-09-19T09:00:51.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.635+0000 7f2f2f6c8740 1 Processor -- start 2024-09-19T09:00:51.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.635+0000 7f2f2f6c8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6eeb8e5d0 0x55b6eec0beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:51.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.635+0000 7f2f2f6c8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6eeb8fb40 0x55b6eec0c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:51.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.635+0000 7f2f2f6c8740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6eeb99370 0x55b6eeba11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:51.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.635+0000 7f2f2f6c8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2f281b0c80 con 0x55b6eeb8e5d0 2024-09-19T09:00:51.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.635+0000 7f2f2f6c8740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2f281b05b0 con 0x55b6eeb99370 2024-09-19T09:00:51.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.635+0000 7f2f2f6c8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2f281ad7f0 con 0x55b6eeb8fb40 2024-09-19T09:00:51.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.635+0000 7f2f2f6c8740 10 client.0 _ll_register_callbacks cb 0x7f2f20009bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:51.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.635+0000 7f2f26ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6eeb8e5d0 0x55b6eec0beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:51.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.635+0000 7f2f26ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6eeb8e5d0 0x55b6eec0beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32790/0 (socket says 172.21.15.19:32790) 2024-09-19T09:00:51.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.635+0000 7f2f26ffd640 1 -- 172.21.15.19:0/528963289 learned_addr learned my addr 172.21.15.19:0/528963289 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:51.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.635+0000 7f2f277fe640 1 --2- 172.21.15.19:0/528963289 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6eeb99370 0x55b6eeba11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:51.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.635+0000 7f2f267fc640 1 --2- 172.21.15.19:0/528963289 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6eeb8fb40 0x55b6eec0c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:51.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.636+0000 7f2f26ffd640 1 -- 172.21.15.19:0/528963289 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6eeb8fb40 msgr2=0x55b6eec0c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:51.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.636+0000 7f2f26ffd640 1 --2- 172.21.15.19:0/528963289 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6eeb8fb40 0x55b6eec0c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.636+0000 7f2f26ffd640 1 -- 172.21.15.19:0/528963289 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6eeb99370 msgr2=0x55b6eeba11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:51.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.636+0000 7f2f26ffd640 1 --2- 172.21.15.19:0/528963289 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6eeb99370 0x55b6eeba11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.636+0000 7f2f26ffd640 1 -- 172.21.15.19:0/528963289 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6eeba1850 con 0x55b6eeb8e5d0 2024-09-19T09:00:51.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.636+0000 7f2f26ffd640 1 --2- 172.21.15.19:0/528963289 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6eeb8e5d0 0x55b6eec0beb0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f2f18012410 tx=0x7f2f18012be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8439404184706a9b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:51.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.636+0000 7f2f0aff5640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:00:51.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.636+0000 7f2f0aff5640 1 -- 172.21.15.19:0/528963289 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f18011920 con 0x55b6eeb8e5d0 2024-09-19T09:00:51.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.636+0000 7f2f2f6c8740 1 -- 172.21.15.19:0/528963289 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f2004e070 con 0x55b6eeb8e5d0 2024-09-19T09:00:51.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.636+0000 7f2f0aff5640 1 -- 172.21.15.19:0/528963289 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2f18011ac0 con 0x55b6eeb8e5d0 2024-09-19T09:00:51.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.636+0000 7f2f0aff5640 1 -- 172.21.15.19:0/528963289 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f2f18011cc0 con 0x55b6eeb8e5d0 2024-09-19T09:00:51.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.636+0000 7f2f2f6c8740 10 client.17334 fetch_fsmap learned FSMap version 36 2024-09-19T09:00:51.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.636+0000 7f2f2f6c8740 1 -- 172.21.15.19:0/528963289 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55b6eec13790 con 0x55b6eeb8e5d0 2024-09-19T09:00:51.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.636+0000 7f2f0aff5640 1 -- 172.21.15.19:0/528963289 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2f2004e070 con 0x55b6eeb8e5d0 2024-09-19T09:00:51.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.637+0000 7f2f0aff5640 1 -- 172.21.15.19:0/528963289 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f2f180263f0 con 0x55b6eeb8e5d0 2024-09-19T09:00:51.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.637+0000 7f2f2f6c8740 10 client.17334 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:00:51.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.637+0000 7f2f2f6c8740 10 client.17334 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T09:00:51.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.637+0000 7f2f2f6c8740 20 client.17334 populate_metadata read hostname 'smithi019' 2024-09-19T09:00:51.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.637+0000 7f2f2f6c8740 1 --2- 172.21.15.19:0/528963289 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55b6eec13f10 0x55b6eec16330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:51.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.637+0000 7f2f2f6c8740 4 client.17334 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:00:51.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.637+0000 7f2f2f6c8740 1 -- 172.21.15.19:0/528963289 --> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b6eeafbd70 con 0x55b6eec13f10 2024-09-19T09:00:51.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.637+0000 7f2f267fc640 1 --2- 172.21.15.19:0/528963289 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55b6eec13f10 0x55b6eec16330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:51.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.637+0000 7f2f0aff5640 10 client.17334 ms_handle_connect on v2:172.21.15.203:6834/2702758353 2024-09-19T09:00:51.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.637+0000 7f2f267fc640 1 --2- 172.21.15.19:0/528963289 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55b6eec13f10 0x55b6eec16330 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5236b54a4296e1f7 server_cookie=5a75f9d984f5e8c2 in_seq=0 out_seq=0 2024-09-19T09:00:51.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.637+0000 7f2f0aff5640 1 -- 172.21.15.19:0/528963289 <== mds.4 v2:172.21.15.203:6834/2702758353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b6eeafbd70 con 0x55b6eec13f10 2024-09-19T09:00:51.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.637+0000 7f2f0aff5640 10 client.17334 handle_command_reply: tid=0 2024-09-19T09:00:51.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.637+0000 7f2f2f6c8740 1 client.17334 shutdown 2024-09-19T09:00:51.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.637+0000 7f2f2f6c8740 1 -- 172.21.15.19:0/528963289 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6eeb8e5d0 msgr2=0x55b6eec0beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:51.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.637+0000 7f2f2f6c8740 1 --2- 172.21.15.19:0/528963289 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6eeb8e5d0 0x55b6eec0beb0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f2f18012410 tx=0x7f2f18012be0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.637+0000 7f2f2f6c8740 1 -- 172.21.15.19:0/528963289 shutdown_connections 2024-09-19T09:00:51.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.638+0000 7f2f2f6c8740 1 --2- 172.21.15.19:0/528963289 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55b6eec13f10 0x55b6eec16330 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.638+0000 7f2f2f6c8740 1 --2- 172.21.15.19:0/528963289 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6eeb8fb40 0x55b6eec0c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.638+0000 7f2f2f6c8740 1 --2- 172.21.15.19:0/528963289 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6eeb99370 0x55b6eeba11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.638+0000 7f2f2f6c8740 1 --2- 172.21.15.19:0/528963289 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6eeb8e5d0 0x55b6eec0beb0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.638+0000 7f2f0aff5640 0 client.17334 ms_handle_reset on v2:172.21.15.203:6834/2702758353 2024-09-19T09:00:51.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.638+0000 7f2f2f6c8740 1 -- 172.21.15.19:0/528963289 >> 172.21.15.19:0/528963289 conn(0x55b6eeb57310 msgr2=0x55b6eeb894e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:51.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.638+0000 7f2f2f6c8740 1 -- 172.21.15.19:0/528963289 shutdown_connections 2024-09-19T09:00:51.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.638+0000 7f2f2f6c8740 1 -- 172.21.15.19:0/528963289 wait complete. 2024-09-19T09:00:51.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.638+0000 7f2f2f6c8740 20 client.17334 trim_cache size 0 max 16384 2024-09-19T09:00:51.643 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:00:51.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.638+0000 7f2f2d2ef640 1 -- 172.21.15.19:0/2767855978 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2f100a32c0 msgr2=0x7f2f100a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:51.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.638+0000 7f2f2d2ef640 1 --2- 172.21.15.19:0/2767855978 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2f100a32c0 0x7f2f100a5780 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2f20004af0 tx=0x7f2f20004a80 comp rx=0 tx=0).stop 2024-09-19T09:00:51.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.638+0000 7f2f2d2ef640 1 -- 172.21.15.19:0/2767855978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f28102790 msgr2=0x7f2f28074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:51.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.638+0000 7f2f2d2ef640 1 --2- 172.21.15.19:0/2767855978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f28102790 0x7f2f28074a30 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c00b4a0 tx=0x7f2f1c00b960 comp rx=0 tx=0).stop 2024-09-19T09:00:51.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.639+0000 7f2f2d2ef640 1 -- 172.21.15.19:0/2767855978 shutdown_connections 2024-09-19T09:00:51.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.639+0000 7f2f2d2ef640 1 --2- 172.21.15.19:0/2767855978 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2f100a32c0 0x7f2f100a5780 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.639+0000 7f2f2d2ef640 1 --2- 172.21.15.19:0/2767855978 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2f28106f10 0x7f2f28074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.639+0000 7f2f2d2ef640 1 --2- 172.21.15.19:0/2767855978 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2f28102790 0x7f2f28074a30 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.639+0000 7f2f2d2ef640 1 --2- 172.21.15.19:0/2767855978 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2f28101de0 0x7f2f280744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:51.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.639+0000 7f2f2d2ef640 1 -- 172.21.15.19:0/2767855978 >> 172.21.15.19:0/2767855978 conn(0x7f2f280fd8c0 msgr2=0x7f2f280fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:51.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.639+0000 7f2f2d2ef640 1 -- 172.21.15.19:0/2767855978 shutdown_connections 2024-09-19T09:00:51.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:51.639+0000 7f2f2d2ef640 1 -- 172.21.15.19:0/2767855978 wait complete. 2024-09-19T09:00:52.172 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:51 smithi155 ceph-mon[34921]: pgmap v596: 97 pgs: 97 active+clean; 5.9 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 25 KiB/s wr, 115 op/s 2024-09-19T09:00:52.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:51 smithi203 ceph-mon[35450]: pgmap v596: 97 pgs: 97 active+clean; 5.9 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 25 KiB/s wr, 115 op/s 2024-09-19T09:00:52.244 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:51 smithi019 ceph-mon[30976]: pgmap v596: 97 pgs: 97 active+clean; 5.9 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 25 KiB/s wr, 115 op/s 2024-09-19T09:00:52.339 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T09:00:52.690 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:53.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.152+0000 7fc7b7918640 1 -- 172.21.15.19:0/1449811924 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7b0102790 msgr2=0x7fc7b01067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:53.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.152+0000 7fc7b7918640 1 --2- 172.21.15.19:0/1449811924 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7b0102790 0x7fc7b01067e0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0009900 tx=0x7fc7a002a410 comp rx=0 tx=0).stop 2024-09-19T09:00:53.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.152+0000 7fc7b7918640 1 -- 172.21.15.19:0/1449811924 shutdown_connections 2024-09-19T09:00:53.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.152+0000 7fc7b7918640 1 --2- 172.21.15.19:0/1449811924 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7b0106f10 0x7fc7b010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.152+0000 7fc7b7918640 1 --2- 172.21.15.19:0/1449811924 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7b0102790 0x7fc7b01067e0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.152+0000 7fc7b7918640 1 --2- 172.21.15.19:0/1449811924 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7b0101de0 0x7fc7b01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.152+0000 7fc7b7918640 1 -- 172.21.15.19:0/1449811924 >> 172.21.15.19:0/1449811924 conn(0x7fc7b00fd8c0 msgr2=0x7fc7b00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:53.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.152+0000 7fc7b7918640 1 -- 172.21.15.19:0/1449811924 shutdown_connections 2024-09-19T09:00:53.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.152+0000 7fc7b7918640 1 -- 172.21.15.19:0/1449811924 wait complete. 2024-09-19T09:00:53.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.152+0000 7fc7b7918640 1 Processor -- start 2024-09-19T09:00:53.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.152+0000 7fc7b7918640 1 -- start start 2024-09-19T09:00:53.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.153+0000 7fc7b7918640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7b0101de0 0x7fc7b0198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:53.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.153+0000 7fc7b7918640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7b0102790 0x7fc7b0198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:53.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.153+0000 7fc7b7918640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7b0106f10 0x7fc7b019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:53.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.153+0000 7fc7b7918640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b0111f30 con 0x7fc7b0102790 2024-09-19T09:00:53.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.153+0000 7fc7b7918640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b0111db0 con 0x7fc7b0101de0 2024-09-19T09:00:53.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.153+0000 7fc7b7918640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b01120b0 con 0x7fc7b0106f10 2024-09-19T09:00:53.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.153+0000 7fc7b4eb3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7b0102790 0x7fc7b0198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:53.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.153+0000 7fc7b4eb3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7b0102790 0x7fc7b0198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32818/0 (socket says 172.21.15.19:32818) 2024-09-19T09:00:53.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.153+0000 7fc7b4eb3640 1 -- 172.21.15.19:0/2433854548 learned_addr learned my addr 172.21.15.19:0/2433854548 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:53.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.153+0000 7fc7b56b4640 1 --2- 172.21.15.19:0/2433854548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7b0101de0 0x7fc7b0198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:53.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.153+0000 7fc7b5eb5640 1 --2- 172.21.15.19:0/2433854548 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7b0106f10 0x7fc7b019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:53.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.153+0000 7fc7b4eb3640 1 -- 172.21.15.19:0/2433854548 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7b0106f10 msgr2=0x7fc7b019cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:53.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.153+0000 7fc7b4eb3640 1 --2- 172.21.15.19:0/2433854548 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7b0106f10 0x7fc7b019cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.153+0000 7fc7b4eb3640 1 -- 172.21.15.19:0/2433854548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7b0101de0 msgr2=0x7fc7b0198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:53.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.153+0000 7fc7b4eb3640 1 --2- 172.21.15.19:0/2433854548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7b0101de0 0x7fc7b0198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.153+0000 7fc7b4eb3640 1 -- 172.21.15.19:0/2433854548 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7b019d3e0 con 0x7fc7b0102790 2024-09-19T09:00:53.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.153+0000 7fc7b4eb3640 1 --2- 172.21.15.19:0/2433854548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7b0102790 0x7fc7b0198970 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0006010 tx=0x7fc7a00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:53.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.153+0000 7fc7a67fc640 1 -- 172.21.15.19:0/2433854548 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a003f030 con 0x7fc7b0102790 2024-09-19T09:00:53.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.153+0000 7fc7a67fc640 1 -- 172.21.15.19:0/2433854548 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7a0003ce0 con 0x7fc7b0102790 2024-09-19T09:00:53.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.153+0000 7fc7b7918640 1 -- 172.21.15.19:0/2433854548 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7b019d670 con 0x7fc7b0102790 2024-09-19T09:00:53.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.154+0000 7fc7a67fc640 1 -- 172.21.15.19:0/2433854548 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a0035070 con 0x7fc7b0102790 2024-09-19T09:00:53.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.154+0000 7fc7b7918640 1 -- 172.21.15.19:0/2433854548 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7b01a4fb0 con 0x7fc7b0102790 2024-09-19T09:00:53.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.156+0000 7fc7a67fc640 1 -- 172.21.15.19:0/2433854548 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fc7a0042030 con 0x7fc7b0102790 2024-09-19T09:00:53.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.156+0000 7fc7b9cf1740 1 Processor -- start 2024-09-19T09:00:53.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.156+0000 7fc7b9cf1740 1 -- start start 2024-09-19T09:00:53.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.157+0000 7fc7b9cf1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ceb8fcb40 0x558ceb8fb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:53.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.157+0000 7fc7a67fc640 1 --2- 172.21.15.19:0/2433854548 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc79c0a32c0 0x7fc79c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:53.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.157+0000 7fc7b9cf1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ceb8fb5d0 0x558ceb8fba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:53.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.157+0000 7fc7b9cf1740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558ceb906370 0x558ceb908760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:53.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.157+0000 7fc7b9cf1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x558ceb8612f0 con 0x558ceb8fb5d0 2024-09-19T09:00:53.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.157+0000 7fc7b9cf1740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x558ceb808cf0 con 0x558ceb906370 2024-09-19T09:00:53.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.157+0000 7fc7b9cf1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558ceb85d2b0 con 0x558ceb8fcb40 2024-09-19T09:00:53.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.157+0000 7fc7b4eb3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ceb8fb5d0 0x558ceb8fba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:53.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.157+0000 7fc7b56b4640 1 --2- 172.21.15.19:0/2433854548 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc79c0a32c0 0x7fc79c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:53.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.157+0000 7fc7b5eb5640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ceb8fcb40 0x558ceb8fb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:53.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.157+0000 7fc7b4eb3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ceb8fb5d0 0x558ceb8fba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32822/0 (socket says 172.21.15.19:32822) 2024-09-19T09:00:53.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.157+0000 7fc7b4eb3640 1 -- 172.21.15.19:0/1831145121 learned_addr learned my addr 172.21.15.19:0/1831145121 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:53.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.157+0000 7fc7a67fc640 1 -- 172.21.15.19:0/2433854548 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc7a00efef0 con 0x7fc7b0102790 2024-09-19T09:00:53.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.157+0000 7fc7b5eb5640 1 --2- 172.21.15.19:0/1831145121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558ceb906370 0x558ceb908760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:53.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.157+0000 7fc7b4eb3640 1 -- 172.21.15.19:0/1831145121 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ceb8fcb40 msgr2=0x558ceb8fb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:53.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.157+0000 7fc7b4eb3640 1 --2- 172.21.15.19:0/1831145121 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ceb8fcb40 0x558ceb8fb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.157+0000 7fc7b4eb3640 1 -- 172.21.15.19:0/1831145121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558ceb906370 msgr2=0x558ceb908760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:53.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.157+0000 7fc7b4eb3640 1 --2- 172.21.15.19:0/1831145121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558ceb906370 0x558ceb908760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.157+0000 7fc7b4eb3640 1 -- 172.21.15.19:0/1831145121 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ceb7ed3a0 con 0x558ceb8fb5d0 2024-09-19T09:00:53.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.157+0000 7fc7b56b4640 1 --2- 172.21.15.19:0/2433854548 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc79c0a32c0 0x7fc79c0a5780 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac00bbe0 tx=0x7fc7ac00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:53.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.157+0000 7fc7b4eb3640 1 --2- 172.21.15.19:0/1831145121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ceb8fb5d0 0x558ceb8fba10 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0031ad0 tx=0x7fc7a0049bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e134598ee30bfe9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:53.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.157+0000 7fc79b7fe640 1 -- 172.21.15.19:0/1831145121 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a0049070 con 0x558ceb8fb5d0 2024-09-19T09:00:53.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.158+0000 7fc79b7fe640 1 -- 172.21.15.19:0/1831145121 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7a003b580 con 0x558ceb8fb5d0 2024-09-19T09:00:53.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.158+0000 7fc79b7fe640 1 -- 172.21.15.19:0/1831145121 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a00ede60 con 0x558ceb8fb5d0 2024-09-19T09:00:53.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.158+0000 7fc7b9cf1740 1 -- 172.21.15.19:0/1831145121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ceb8fb5d0 msgr2=0x558ceb8fba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:53.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.158+0000 7fc7b9cf1740 1 --2- 172.21.15.19:0/1831145121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ceb8fb5d0 0x558ceb8fba10 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0031ad0 tx=0x7fc7a0049bd0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.158+0000 7fc7b9cf1740 1 -- 172.21.15.19:0/1831145121 shutdown_connections 2024-09-19T09:00:53.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.158+0000 7fc7b9cf1740 1 --2- 172.21.15.19:0/1831145121 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558ceb906370 0x558ceb908760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.158+0000 7fc7b9cf1740 1 --2- 172.21.15.19:0/1831145121 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ceb8fb5d0 0x558ceb8fba10 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.158+0000 7fc7b9cf1740 1 --2- 172.21.15.19:0/1831145121 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ceb8fcb40 0x558ceb8fb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.158+0000 7fc7b9cf1740 1 -- 172.21.15.19:0/1831145121 >> 172.21.15.19:0/1831145121 conn(0x558ceb8c4310 msgr2=0x558ceb8f7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:53.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.158+0000 7fc7b9cf1740 1 -- 172.21.15.19:0/1831145121 shutdown_connections 2024-09-19T09:00:53.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.158+0000 7fc7b9cf1740 1 -- 172.21.15.19:0/1831145121 wait complete. 2024-09-19T09:00:53.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.159+0000 7fc7b9cf1740 1 -- start start 2024-09-19T09:00:53.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.159+0000 7fc7b9cf1740 1 Processor -- start 2024-09-19T09:00:53.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.159+0000 7fc7b9cf1740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558ceb8fb5d0 0x558ceb905da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:53.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.159+0000 7fc7b9cf1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ceb8fcb40 0x558ceb903050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:53.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.159+0000 7fc7b9cf1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ceb906370 0x558ceb9037e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:53.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.159+0000 7fc7b9cf1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x558ceb908e30 con 0x558ceb906370 2024-09-19T09:00:53.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.159+0000 7fc7b9cf1740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x558ceb81c060 con 0x558ceb8fb5d0 2024-09-19T09:00:53.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.159+0000 7fc7b9cf1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558ceb908fb0 con 0x558ceb8fcb40 2024-09-19T09:00:53.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.159+0000 7fc7b9cf1740 10 client.0 _ll_register_callbacks cb 0x558ceb56f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:53.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.159+0000 7fc7b5eb5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ceb906370 0x558ceb9037e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:53.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.159+0000 7fc7b5eb5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ceb906370 0x558ceb9037e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32828/0 (socket says 172.21.15.19:32828) 2024-09-19T09:00:53.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.159+0000 7fc7b5eb5640 1 -- 172.21.15.19:0/4020630853 learned_addr learned my addr 172.21.15.19:0/4020630853 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:53.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.160+0000 7fc7b56b4640 1 --2- 172.21.15.19:0/4020630853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558ceb8fb5d0 0x558ceb905da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:53.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.160+0000 7fc7b4eb3640 1 --2- 172.21.15.19:0/4020630853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ceb8fcb40 0x558ceb903050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:53.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.160+0000 7fc7b5eb5640 1 -- 172.21.15.19:0/4020630853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ceb8fcb40 msgr2=0x558ceb903050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:53.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.160+0000 7fc7b5eb5640 1 --2- 172.21.15.19:0/4020630853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ceb8fcb40 0x558ceb903050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.160+0000 7fc7b5eb5640 1 -- 172.21.15.19:0/4020630853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558ceb8fb5d0 msgr2=0x558ceb905da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:53.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.160+0000 7fc7b5eb5640 1 --2- 172.21.15.19:0/4020630853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558ceb8fb5d0 0x558ceb905da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.160+0000 7fc7b5eb5640 1 -- 172.21.15.19:0/4020630853 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ceb5d23c0 con 0x558ceb906370 2024-09-19T09:00:53.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.160+0000 7fc7b4eb3640 1 --2- 172.21.15.19:0/4020630853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ceb8fcb40 0x558ceb903050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:00:53.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.160+0000 7fc7b56b4640 1 --2- 172.21.15.19:0/4020630853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558ceb8fb5d0 0x558ceb905da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:53.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.160+0000 7fc7b5eb5640 1 --2- 172.21.15.19:0/4020630853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ceb906370 0x558ceb9037e0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fc7a80107d0 tx=0x7fc7a8010c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9972b3c08d25e016 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:53.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.160+0000 7fc798ff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:00:53.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.160+0000 7fc798ff9640 1 -- 172.21.15.19:0/4020630853 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a8023060 con 0x558ceb906370 2024-09-19T09:00:53.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.160+0000 7fc798ff9640 1 -- 172.21.15.19:0/4020630853 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc7a800f9f0 con 0x558ceb906370 2024-09-19T09:00:53.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.160+0000 7fc7b9cf1740 1 -- 172.21.15.19:0/4020630853 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558ceb86e860 con 0x558ceb906370 2024-09-19T09:00:53.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.160+0000 7fc798ff9640 1 -- 172.21.15.19:0/4020630853 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fc7a800fbf0 con 0x558ceb906370 2024-09-19T09:00:53.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.160+0000 7fc7b9cf1740 10 client.17346 fetch_fsmap learned FSMap version 36 2024-09-19T09:00:53.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.160+0000 7fc7b9cf1740 1 -- 172.21.15.19:0/4020630853 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x558ceb914850 con 0x558ceb906370 2024-09-19T09:00:53.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.160+0000 7fc798ff9640 1 -- 172.21.15.19:0/4020630853 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x558ceb86e860 con 0x558ceb906370 2024-09-19T09:00:53.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.161+0000 7fc798ff9640 1 -- 172.21.15.19:0/4020630853 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fc7a801e670 con 0x558ceb906370 2024-09-19T09:00:53.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.161+0000 7fc7b9cf1740 10 client.17346 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:00:53.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.161+0000 7fc7b9cf1740 10 client.17346 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-19T09:00:53.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.161+0000 7fc7b9cf1740 20 client.17346 populate_metadata read hostname 'smithi019' 2024-09-19T09:00:53.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.161+0000 7fc7b9cf1740 1 --2- 172.21.15.19:0/4020630853 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x558ceb915d10 0x558ceb918140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:53.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.161+0000 7fc7b9cf1740 4 client.17346 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:00:53.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.161+0000 7fc7b9cf1740 1 -- 172.21.15.19:0/4020630853 --> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ceb868d70 con 0x558ceb915d10 2024-09-19T09:00:53.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.161+0000 7fc7b56b4640 1 --2- 172.21.15.19:0/4020630853 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x558ceb915d10 0x558ceb918140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:53.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.161+0000 7fc7b56b4640 1 --2- 172.21.15.19:0/4020630853 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x558ceb915d10 0x558ceb918140 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=80309b69ed963807 server_cookie=e54a4d3bcd038307 in_seq=0 out_seq=0 2024-09-19T09:00:53.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.161+0000 7fc798ff9640 10 client.17346 ms_handle_connect on v2:172.21.15.155:6836/3381010945 2024-09-19T09:00:53.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.162+0000 7fc798ff9640 1 -- 172.21.15.19:0/4020630853 <== mds.3 v2:172.21.15.155:6836/3381010945 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558ceb868d70 con 0x558ceb915d10 2024-09-19T09:00:53.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.162+0000 7fc798ff9640 10 client.17346 handle_command_reply: tid=0 2024-09-19T09:00:53.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.162+0000 7fc7b9cf1740 1 client.17346 shutdown 2024-09-19T09:00:53.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.163+0000 7fc7b9cf1740 1 -- 172.21.15.19:0/4020630853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ceb906370 msgr2=0x558ceb9037e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:53.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.163+0000 7fc7b9cf1740 1 --2- 172.21.15.19:0/4020630853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ceb906370 0x558ceb9037e0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fc7a80107d0 tx=0x7fc7a8010c90 comp rx=0 tx=0).stop 2024-09-19T09:00:53.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.163+0000 7fc7b9cf1740 1 -- 172.21.15.19:0/4020630853 shutdown_connections 2024-09-19T09:00:53.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.163+0000 7fc7b9cf1740 1 --2- 172.21.15.19:0/4020630853 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x558ceb915d10 0x558ceb918140 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.163+0000 7fc7b9cf1740 1 --2- 172.21.15.19:0/4020630853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ceb8fcb40 0x558ceb903050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.163+0000 7fc798ff9640 0 client.17346 ms_handle_reset on v2:172.21.15.155:6836/3381010945 2024-09-19T09:00:53.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.163+0000 7fc7b9cf1740 1 --2- 172.21.15.19:0/4020630853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ceb906370 0x558ceb9037e0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.163+0000 7fc7b9cf1740 1 --2- 172.21.15.19:0/4020630853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558ceb8fb5d0 0x558ceb905da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.163+0000 7fc7b9cf1740 1 -- 172.21.15.19:0/4020630853 >> 172.21.15.19:0/4020630853 conn(0x558ceb8c4310 msgr2=0x558ceb8fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:53.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.163+0000 7fc7b9cf1740 1 -- 172.21.15.19:0/4020630853 shutdown_connections 2024-09-19T09:00:53.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.163+0000 7fc7b9cf1740 1 -- 172.21.15.19:0/4020630853 wait complete. 2024-09-19T09:00:53.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.163+0000 7fc7b9cf1740 20 client.17346 trim_cache size 0 max 16384 2024-09-19T09:00:53.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.176+0000 7fc7b9cf1740 1 Processor -- start 2024-09-19T09:00:53.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.176+0000 7fc7b9cf1740 1 -- start start 2024-09-19T09:00:53.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.176+0000 7fc7b9cf1740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558ceb8fb5d0 0x558ceb91da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:53.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.176+0000 7fc7b9cf1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ceb8fcb40 0x558ceb91df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:53.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.176+0000 7fc7b9cf1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ceb906370 0x558ceb9002b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:53.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.176+0000 7fc7b9cf1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b01ad530 con 0x558ceb8fcb40 2024-09-19T09:00:53.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.176+0000 7fc7b9cf1740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b01af070 con 0x558ceb8fb5d0 2024-09-19T09:00:53.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.176+0000 7fc7b9cf1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b01adc00 con 0x558ceb906370 2024-09-19T09:00:53.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.176+0000 7fc7b4eb3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ceb8fcb40 0x558ceb91df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:53.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.176+0000 7fc7b4eb3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ceb8fcb40 0x558ceb91df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32842/0 (socket says 172.21.15.19:32842) 2024-09-19T09:00:53.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.176+0000 7fc7b4eb3640 1 -- 172.21.15.19:0/2310422890 learned_addr learned my addr 172.21.15.19:0/2310422890 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:53.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.176+0000 7fc7b56b4640 1 --2- 172.21.15.19:0/2310422890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558ceb8fb5d0 0x558ceb91da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:53.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.177+0000 7fc7b4eb3640 1 -- 172.21.15.19:0/2310422890 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ceb906370 msgr2=0x558ceb9002b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:53.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.177+0000 7fc7b5eb5640 1 --2- 172.21.15.19:0/2310422890 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ceb906370 0x558ceb9002b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:53.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.177+0000 7fc7b4eb3640 1 --2- 172.21.15.19:0/2310422890 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ceb906370 0x558ceb9002b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.177+0000 7fc7b4eb3640 1 -- 172.21.15.19:0/2310422890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558ceb8fb5d0 msgr2=0x558ceb91da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:53.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.177+0000 7fc7b4eb3640 1 --2- 172.21.15.19:0/2310422890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558ceb8fb5d0 0x558ceb91da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.177+0000 7fc7b4eb3640 1 -- 172.21.15.19:0/2310422890 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ceb8f8cf0 con 0x558ceb8fcb40 2024-09-19T09:00:53.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.177+0000 7fc7b56b4640 1 --2- 172.21.15.19:0/2310422890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558ceb8fb5d0 0x558ceb91da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:00:53.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.177+0000 7fc7b4eb3640 1 --2- 172.21.15.19:0/2310422890 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ceb8fcb40 0x558ceb91df50 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fc7a00ba830 tx=0x7fc7a00057e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f0ec4a968e8ed30 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:53.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.177+0000 7fc79affd640 1 -- 172.21.15.19:0/2310422890 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a00d9070 con 0x558ceb8fcb40 2024-09-19T09:00:53.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.177+0000 7fc79affd640 1 -- 172.21.15.19:0/2310422890 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7a00bcc80 con 0x558ceb8fcb40 2024-09-19T09:00:53.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.177+0000 7fc79affd640 1 -- 172.21.15.19:0/2310422890 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a0049050 con 0x558ceb8fcb40 2024-09-19T09:00:53.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.177+0000 7fc7b9cf1740 1 -- 172.21.15.19:0/2310422890 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ceb8fcb40 msgr2=0x558ceb91df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:53.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.178+0000 7fc7b9cf1740 1 --2- 172.21.15.19:0/2310422890 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ceb8fcb40 0x558ceb91df50 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fc7a00ba830 tx=0x7fc7a00057e0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.178+0000 7fc7b9cf1740 1 -- 172.21.15.19:0/2310422890 shutdown_connections 2024-09-19T09:00:53.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.178+0000 7fc7b9cf1740 1 --2- 172.21.15.19:0/2310422890 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ceb906370 0x558ceb9002b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.178+0000 7fc7b9cf1740 1 --2- 172.21.15.19:0/2310422890 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ceb8fcb40 0x558ceb91df50 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.178+0000 7fc7b9cf1740 1 --2- 172.21.15.19:0/2310422890 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558ceb8fb5d0 0x558ceb91da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.178+0000 7fc7b9cf1740 1 -- 172.21.15.19:0/2310422890 >> 172.21.15.19:0/2310422890 conn(0x558ceb8c4310 msgr2=0x558ceb8fe230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.178+0000 7fc7b9cf1740 1 -- 172.21.15.19:0/2310422890 shutdown_connections 2024-09-19T09:00:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.178+0000 7fc7b9cf1740 1 -- 172.21.15.19:0/2310422890 wait complete. 2024-09-19T09:00:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.178+0000 7fc7b9cf1740 1 -- start start 2024-09-19T09:00:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.178+0000 7fc7b9cf1740 1 Processor -- start 2024-09-19T09:00:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.178+0000 7fc7b9cf1740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558ceb8fb5d0 0x558ceb90a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.178+0000 7fc7b9cf1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ceb8fcb40 0x558ceb90a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.178+0000 7fc7b9cf1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ceb906370 0x558ceb90aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.178+0000 7fc7b9cf1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b01ae9a0 con 0x558ceb8fcb40 2024-09-19T09:00:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.178+0000 7fc7b9cf1740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b01ae2d0 con 0x558ceb8fb5d0 2024-09-19T09:00:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.178+0000 7fc7b9cf1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b01ab510 con 0x558ceb906370 2024-09-19T09:00:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.179+0000 7fc7b9cf1740 10 client.0 _ll_register_callbacks cb 0x7fc7a8009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.179+0000 7fc7b4eb3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ceb8fcb40 0x558ceb90a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:53.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.179+0000 7fc7b4eb3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ceb8fcb40 0x558ceb90a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32858/0 (socket says 172.21.15.19:32858) 2024-09-19T09:00:53.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.179+0000 7fc7b4eb3640 1 -- 172.21.15.19:0/1633888067 learned_addr learned my addr 172.21.15.19:0/1633888067 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:53.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.179+0000 7fc7b56b4640 1 --2- 172.21.15.19:0/1633888067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558ceb8fb5d0 0x558ceb90a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:53.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.179+0000 7fc7b5eb5640 1 --2- 172.21.15.19:0/1633888067 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ceb906370 0x558ceb90aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:53.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.179+0000 7fc7b4eb3640 1 -- 172.21.15.19:0/1633888067 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ceb906370 msgr2=0x558ceb90aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:53.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.179+0000 7fc7b4eb3640 1 --2- 172.21.15.19:0/1633888067 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ceb906370 0x558ceb90aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.179+0000 7fc7b4eb3640 1 -- 172.21.15.19:0/1633888067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558ceb8fb5d0 msgr2=0x558ceb90a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:53.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.179+0000 7fc7b4eb3640 1 --2- 172.21.15.19:0/1633888067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558ceb8fb5d0 0x558ceb90a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.179+0000 7fc7b4eb3640 1 -- 172.21.15.19:0/1633888067 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ceb9882a0 con 0x558ceb8fcb40 2024-09-19T09:00:53.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.179+0000 7fc7b4eb3640 1 --2- 172.21.15.19:0/1633888067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ceb8fcb40 0x558ceb90a550 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fc7a00bc280 tx=0x7fc7a0009230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=465827d0f1dcc42b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:53.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.179+0000 7fc798ff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:00:53.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.179+0000 7fc798ff9640 1 -- 172.21.15.19:0/1633888067 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a0049070 con 0x558ceb8fcb40 2024-09-19T09:00:53.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.179+0000 7fc798ff9640 1 -- 172.21.15.19:0/1633888067 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc7a00b9bd0 con 0x558ceb8fcb40 2024-09-19T09:00:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.179+0000 7fc7b9cf1740 1 -- 172.21.15.19:0/1633888067 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc7a00bcc80 con 0x558ceb8fcb40 2024-09-19T09:00:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.179+0000 7fc798ff9640 1 -- 172.21.15.19:0/1633888067 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fc7a00d9070 con 0x558ceb8fcb40 2024-09-19T09:00:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.179+0000 7fc7b9cf1740 10 client.17352 fetch_fsmap learned FSMap version 36 2024-09-19T09:00:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.179+0000 7fc7b9cf1740 1 -- 172.21.15.19:0/1633888067 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x558ceb9882a0 con 0x558ceb8fcb40 2024-09-19T09:00:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.180+0000 7fc798ff9640 1 -- 172.21.15.19:0/1633888067 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc7a00bcc80 con 0x558ceb8fcb40 2024-09-19T09:00:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.180+0000 7fc798ff9640 1 -- 172.21.15.19:0/1633888067 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fc7a00bab40 con 0x558ceb8fcb40 2024-09-19T09:00:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.180+0000 7fc7b9cf1740 10 client.17352 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:00:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.180+0000 7fc7b9cf1740 10 client.17352 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-19T09:00:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.180+0000 7fc7b9cf1740 20 client.17352 populate_metadata read hostname 'smithi019' 2024-09-19T09:00:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.180+0000 7fc7b9cf1740 1 --2- 172.21.15.19:0/1633888067 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x558ceb989740 0x558ceb98bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.180+0000 7fc7b9cf1740 4 client.17352 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:00:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.180+0000 7fc7b9cf1740 1 -- 172.21.15.19:0/1633888067 --> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558ceb7e5170 con 0x558ceb989740 2024-09-19T09:00:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.180+0000 7fc7b56b4640 1 --2- 172.21.15.19:0/1633888067 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x558ceb989740 0x558ceb98bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.180+0000 7fc798ff9640 10 client.17352 ms_handle_connect on v2:172.21.15.155:6836/3381010945 2024-09-19T09:00:53.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.180+0000 7fc7b56b4640 1 --2- 172.21.15.19:0/1633888067 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x558ceb989740 0x558ceb98bb60 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=99f2a2d32977b518 server_cookie=ce9ae7df7d71c985 in_seq=0 out_seq=0 2024-09-19T09:00:53.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.181+0000 7fc798ff9640 1 -- 172.21.15.19:0/1633888067 <== mds.3 v2:172.21.15.155:6836/3381010945 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558ceb7e5170 con 0x558ceb989740 2024-09-19T09:00:53.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.181+0000 7fc798ff9640 10 client.17352 handle_command_reply: tid=0 2024-09-19T09:00:53.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.181+0000 7fc7b9cf1740 1 client.17352 shutdown 2024-09-19T09:00:53.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.181+0000 7fc7b9cf1740 1 -- 172.21.15.19:0/1633888067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ceb8fcb40 msgr2=0x558ceb90a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:53.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.181+0000 7fc7b9cf1740 1 --2- 172.21.15.19:0/1633888067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ceb8fcb40 0x558ceb90a550 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fc7a00bc280 tx=0x7fc7a0009230 comp rx=0 tx=0).stop 2024-09-19T09:00:53.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.181+0000 7fc7b9cf1740 1 -- 172.21.15.19:0/1633888067 shutdown_connections 2024-09-19T09:00:53.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.181+0000 7fc7b9cf1740 1 --2- 172.21.15.19:0/1633888067 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x558ceb989740 0x558ceb98bb60 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.181+0000 7fc7b9cf1740 1 --2- 172.21.15.19:0/1633888067 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ceb906370 0x558ceb90aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.181+0000 7fc7b9cf1740 1 --2- 172.21.15.19:0/1633888067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558ceb8fcb40 0x558ceb90a550 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.181+0000 7fc798ff9640 0 client.17352 ms_handle_reset on v2:172.21.15.155:6836/3381010945 2024-09-19T09:00:53.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.181+0000 7fc7b9cf1740 1 --2- 172.21.15.19:0/1633888067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558ceb8fb5d0 0x558ceb90a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.181+0000 7fc7b9cf1740 1 -- 172.21.15.19:0/1633888067 >> 172.21.15.19:0/1633888067 conn(0x558ceb8c4310 msgr2=0x558ceb8fd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:53.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.181+0000 7fc7b9cf1740 1 -- 172.21.15.19:0/1633888067 shutdown_connections 2024-09-19T09:00:53.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.181+0000 7fc7b9cf1740 1 -- 172.21.15.19:0/1633888067 wait complete. 2024-09-19T09:00:53.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.181+0000 7fc7b9cf1740 20 client.17352 trim_cache size 0 max 16384 2024-09-19T09:00:53.207 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:00:53.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.181+0000 7fc7b7918640 1 -- 172.21.15.19:0/2433854548 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc79c0a32c0 msgr2=0x7fc79c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:53.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.181+0000 7fc7b7918640 1 --2- 172.21.15.19:0/2433854548 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc79c0a32c0 0x7fc79c0a5780 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac00bbe0 tx=0x7fc7ac00b390 comp rx=0 tx=0).stop 2024-09-19T09:00:53.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.181+0000 7fc7b7918640 1 -- 172.21.15.19:0/2433854548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7b0102790 msgr2=0x7fc7b0198970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:53.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.181+0000 7fc7b7918640 1 --2- 172.21.15.19:0/2433854548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7b0102790 0x7fc7b0198970 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fc7a0006010 tx=0x7fc7a00042f0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.181+0000 7fc7b7918640 1 -- 172.21.15.19:0/2433854548 shutdown_connections 2024-09-19T09:00:53.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.181+0000 7fc7b7918640 1 --2- 172.21.15.19:0/2433854548 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc79c0a32c0 0x7fc79c0a5780 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.181+0000 7fc7b7918640 1 --2- 172.21.15.19:0/2433854548 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7b0106f10 0x7fc7b019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.181+0000 7fc7b7918640 1 --2- 172.21.15.19:0/2433854548 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc7b0102790 0x7fc7b0198970 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.181+0000 7fc7b7918640 1 --2- 172.21.15.19:0/2433854548 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc7b0101de0 0x7fc7b0198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:53.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.181+0000 7fc7b7918640 1 -- 172.21.15.19:0/2433854548 >> 172.21.15.19:0/2433854548 conn(0x7fc7b00fd8c0 msgr2=0x7fc7b00fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:53.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.182+0000 7fc7b7918640 1 -- 172.21.15.19:0/2433854548 shutdown_connections 2024-09-19T09:00:53.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:53.182+0000 7fc7b7918640 1 -- 172.21.15.19:0/2433854548 wait complete. 2024-09-19T09:00:54.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:53 smithi155 ceph-mon[34921]: pgmap v597: 97 pgs: 97 active+clean; 11 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 467 KiB/s wr, 233 op/s 2024-09-19T09:00:54.182 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:53 smithi019 ceph-mon[30976]: pgmap v597: 97 pgs: 97 active+clean; 11 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 467 KiB/s wr, 233 op/s 2024-09-19T09:00:54.216 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:00:54.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:53 smithi203 ceph-mon[35450]: pgmap v597: 97 pgs: 97 active+clean; 11 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 467 KiB/s wr, 233 op/s 2024-09-19T09:00:54.521 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:55.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.009+0000 7f5e6cbc4640 1 -- 172.21.15.19:0/2346145487 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e68102570 msgr2=0x7f5e681029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:55.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.009+0000 7f5e6cbc4640 1 --2- 172.21.15.19:0/2346145487 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e68102570 0x7f5e681029b0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c009900 tx=0x7f5e5c02a480 comp rx=0 tx=0).stop 2024-09-19T09:00:55.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.009+0000 7f5e6cbc4640 1 -- 172.21.15.19:0/2346145487 shutdown_connections 2024-09-19T09:00:55.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.009+0000 7f5e6cbc4640 1 --2- 172.21.15.19:0/2346145487 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e68102ef0 0x7f5e6810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.009+0000 7f5e6cbc4640 1 --2- 172.21.15.19:0/2346145487 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e68102570 0x7f5e681029b0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.009+0000 7f5e6cbc4640 1 --2- 172.21.15.19:0/2346145487 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e68100e20 0x7f5e68101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.009+0000 7f5e6cbc4640 1 -- 172.21.15.19:0/2346145487 >> 172.21.15.19:0/2346145487 conn(0x7f5e680fc7d0 msgr2=0x7f5e680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:55.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.009+0000 7f5e6cbc4640 1 -- 172.21.15.19:0/2346145487 shutdown_connections 2024-09-19T09:00:55.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.009+0000 7f5e6cbc4640 1 -- 172.21.15.19:0/2346145487 wait complete. 2024-09-19T09:00:55.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.010+0000 7f5e6cbc4640 1 Processor -- start 2024-09-19T09:00:55.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.010+0000 7f5e6cbc4640 1 -- start start 2024-09-19T09:00:55.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.010+0000 7f5e6cbc4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e68100e20 0x7f5e68198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.010+0000 7f5e6cbc4640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e68102570 0x7f5e68198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.010+0000 7f5e6cbc4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e68102ef0 0x7f5e6819cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.010+0000 7f5e6cbc4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5e68110fa0 con 0x7f5e68100e20 2024-09-19T09:00:55.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.010+0000 7f5e6cbc4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5e68110e20 con 0x7f5e68102ef0 2024-09-19T09:00:55.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.010+0000 7f5e6cbc4640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5e68111120 con 0x7f5e68102570 2024-09-19T09:00:55.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.010+0000 7f5e6659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e68100e20 0x7f5e68198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.010+0000 7f5e66d9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e68102ef0 0x7f5e6819cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.010+0000 7f5e6659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e68100e20 0x7f5e68198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32868/0 (socket says 172.21.15.19:32868) 2024-09-19T09:00:55.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.010+0000 7f5e6659c640 1 -- 172.21.15.19:0/2763764870 learned_addr learned my addr 172.21.15.19:0/2763764870 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:55.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.010+0000 7f5e65d9b640 1 --2- 172.21.15.19:0/2763764870 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e68102570 0x7f5e68198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.011+0000 7f5e66d9d640 1 -- 172.21.15.19:0/2763764870 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e68102570 msgr2=0x7f5e68198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:55.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.011+0000 7f5e66d9d640 1 --2- 172.21.15.19:0/2763764870 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e68102570 0x7f5e68198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.011+0000 7f5e66d9d640 1 -- 172.21.15.19:0/2763764870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e68100e20 msgr2=0x7f5e68198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:55.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.011+0000 7f5e66d9d640 1 --2- 172.21.15.19:0/2763764870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e68100e20 0x7f5e68198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.011+0000 7f5e66d9d640 1 -- 172.21.15.19:0/2763764870 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e6819d4d0 con 0x7f5e68102ef0 2024-09-19T09:00:55.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.011+0000 7f5e6659c640 1 --2- 172.21.15.19:0/2763764870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e68100e20 0x7f5e68198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:55.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.011+0000 7f5e66d9d640 1 --2- 172.21.15.19:0/2763764870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e68102ef0 0x7f5e6819cdf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5e60009fd0 tx=0x7f5e6000ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:55.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.011+0000 7f5e577fe640 1 -- 172.21.15.19:0/2763764870 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e6000ce20 con 0x7f5e68102ef0 2024-09-19T09:00:55.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.011+0000 7f5e577fe640 1 -- 172.21.15.19:0/2763764870 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e60005020 con 0x7f5e68102ef0 2024-09-19T09:00:55.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.011+0000 7f5e6cbc4640 1 -- 172.21.15.19:0/2763764870 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e6819d7c0 con 0x7f5e68102ef0 2024-09-19T09:00:55.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.011+0000 7f5e577fe640 1 -- 172.21.15.19:0/2763764870 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e60010720 con 0x7f5e68102ef0 2024-09-19T09:00:55.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.011+0000 7f5e6cbc4640 1 -- 172.21.15.19:0/2763764870 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e681a50a0 con 0x7f5e68102ef0 2024-09-19T09:00:55.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.014+0000 7f5e6ef9d740 1 Processor -- start 2024-09-19T09:00:55.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.014+0000 7f5e577fe640 1 -- 172.21.15.19:0/2763764870 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f5e60005540 con 0x7f5e68102ef0 2024-09-19T09:00:55.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.015+0000 7f5e6ef9d740 1 -- start start 2024-09-19T09:00:55.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.015+0000 7f5e6ef9d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633f45aab40 0x5633f45a9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.015+0000 7f5e6ef9d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5633f45a95d0 0x5633f45a9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.015+0000 7f5e6ef9d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633f45b4370 0x5633f45b6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.015+0000 7f5e6ef9d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5633f450f2f0 con 0x5633f45a95d0 2024-09-19T09:00:55.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.015+0000 7f5e6ef9d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5633f44b6cf0 con 0x5633f45aab40 2024-09-19T09:00:55.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.015+0000 7f5e6ef9d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5633f450b2b0 con 0x5633f45b4370 2024-09-19T09:00:55.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.015+0000 7f5e6659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5633f45a95d0 0x5633f45a9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.015+0000 7f5e65d9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633f45aab40 0x5633f45a9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.015+0000 7f5e6659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5633f45a95d0 0x5633f45a9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:32876/0 (socket says 172.21.15.19:32876) 2024-09-19T09:00:55.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.015+0000 7f5e6659c640 1 -- 172.21.15.19:0/856526752 learned_addr learned my addr 172.21.15.19:0/856526752 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:55.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.015+0000 7f5e65d9b640 1 --2- 172.21.15.19:0/856526752 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633f45b4370 0x5633f45b6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.015+0000 7f5e65d9b640 1 -- 172.21.15.19:0/856526752 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633f45b4370 msgr2=0x5633f45b6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:55.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.015+0000 7f5e65d9b640 1 --2- 172.21.15.19:0/856526752 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633f45b4370 0x5633f45b6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.016+0000 7f5e65d9b640 1 -- 172.21.15.19:0/856526752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5633f45a95d0 msgr2=0x5633f45a9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:55.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.016+0000 7f5e65d9b640 1 --2- 172.21.15.19:0/856526752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5633f45a95d0 0x5633f45a9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.016+0000 7f5e65d9b640 1 -- 172.21.15.19:0/856526752 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633f449b3a0 con 0x5633f45aab40 2024-09-19T09:00:55.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.016+0000 7f5e577fe640 1 --2- 172.21.15.19:0/2763764870 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5e500a3240 0x7f5e500a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.016+0000 7f5e6659c640 1 --2- 172.21.15.19:0/2763764870 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5e500a3240 0x7f5e500a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.016+0000 7f5e65d9b640 1 --2- 172.21.15.19:0/856526752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633f45aab40 0x5633f45a9090 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c02aa70 tx=0x7f5e5c005b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c33950c342e87a1b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:55.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.016+0000 7f5e577fe640 1 -- 172.21.15.19:0/2763764870 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5e600d00b0 con 0x7f5e68102ef0 2024-09-19T09:00:55.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.016+0000 7f5e54ff9640 1 -- 172.21.15.19:0/856526752 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c043020 con 0x5633f45aab40 2024-09-19T09:00:55.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.016+0000 7f5e54ff9640 1 -- 172.21.15.19:0/856526752 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e5c0046c0 con 0x5633f45aab40 2024-09-19T09:00:55.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.016+0000 7f5e54ff9640 1 -- 172.21.15.19:0/856526752 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c035070 con 0x5633f45aab40 2024-09-19T09:00:55.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.017+0000 7f5e6ef9d740 1 -- 172.21.15.19:0/856526752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633f45aab40 msgr2=0x5633f45a9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:55.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.017+0000 7f5e6ef9d740 1 --2- 172.21.15.19:0/856526752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633f45aab40 0x5633f45a9090 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c02aa70 tx=0x7f5e5c005b50 comp rx=0 tx=0).stop 2024-09-19T09:00:55.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.017+0000 7f5e6659c640 1 --2- 172.21.15.19:0/2763764870 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5e500a3240 0x7f5e500a5700 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x5633f45a6ac0 tx=0x7f5e58005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:55.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.017+0000 7f5e6ef9d740 1 -- 172.21.15.19:0/856526752 shutdown_connections 2024-09-19T09:00:55.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.017+0000 7f5e6ef9d740 1 --2- 172.21.15.19:0/856526752 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633f45b4370 0x5633f45b6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.017+0000 7f5e6ef9d740 1 --2- 172.21.15.19:0/856526752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5633f45a95d0 0x5633f45a9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.017+0000 7f5e6ef9d740 1 --2- 172.21.15.19:0/856526752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633f45aab40 0x5633f45a9090 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.017+0000 7f5e6ef9d740 1 -- 172.21.15.19:0/856526752 >> 172.21.15.19:0/856526752 conn(0x5633f4572310 msgr2=0x5633f45a5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:55.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.017+0000 7f5e6ef9d740 1 -- 172.21.15.19:0/856526752 shutdown_connections 2024-09-19T09:00:55.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.017+0000 7f5e6ef9d740 1 -- 172.21.15.19:0/856526752 wait complete. 2024-09-19T09:00:55.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.018+0000 7f5e6ef9d740 1 -- start start 2024-09-19T09:00:55.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.018+0000 7f5e6ef9d740 1 Processor -- start 2024-09-19T09:00:55.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.018+0000 7f5e6ef9d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5633f45a95d0 0x5633f45b1190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.018+0000 7f5e6ef9d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633f45aab40 0x5633f45b16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.018+0000 7f5e6ef9d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633f45b4370 0x5633f45b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.018+0000 7f5e6ef9d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5633f45bb300 con 0x5633f45a95d0 2024-09-19T09:00:55.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.018+0000 7f5e6ef9d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5633f44ca060 con 0x5633f45aab40 2024-09-19T09:00:55.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.018+0000 7f5e6ef9d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5633f45bb480 con 0x5633f45b4370 2024-09-19T09:00:55.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.018+0000 7f5e6ef9d740 10 client.0 _ll_register_callbacks cb 0x5633f421d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:55.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.018+0000 7f5e65d9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633f45aab40 0x5633f45b16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.018+0000 7f5e6659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5633f45a95d0 0x5633f45b1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.018+0000 7f5e65d9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633f45aab40 0x5633f45b16d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:52856/0 (socket says 172.21.15.19:52856) 2024-09-19T09:00:55.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.019+0000 7f5e65d9b640 1 -- 172.21.15.19:0/4085404415 learned_addr learned my addr 172.21.15.19:0/4085404415 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:55.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.019+0000 7f5e66d9d640 1 --2- 172.21.15.19:0/4085404415 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633f45b4370 0x5633f45b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.019+0000 7f5e65d9b640 1 -- 172.21.15.19:0/4085404415 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633f45b4370 msgr2=0x5633f45b1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:55.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.019+0000 7f5e65d9b640 1 --2- 172.21.15.19:0/4085404415 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633f45b4370 0x5633f45b1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.019+0000 7f5e65d9b640 1 -- 172.21.15.19:0/4085404415 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5633f45a95d0 msgr2=0x5633f45b1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:55.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.019+0000 7f5e65d9b640 1 --2- 172.21.15.19:0/4085404415 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5633f45a95d0 0x5633f45b1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.019+0000 7f5e65d9b640 1 -- 172.21.15.19:0/4085404415 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633f42803c0 con 0x5633f45aab40 2024-09-19T09:00:55.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.019+0000 7f5e6659c640 1 --2- 172.21.15.19:0/4085404415 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5633f45a95d0 0x5633f45b1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:55.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.019+0000 7f5e65d9b640 1 --2- 172.21.15.19:0/4085404415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633f45aab40 0x5633f45b16d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c003c20 tx=0x7f5e5c003c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83006a461482dc27 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:55.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.019+0000 7f5e4dffb640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T09:00:55.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.019+0000 7f5e4dffb640 1 -- 172.21.15.19:0/4085404415 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c04c070 con 0x5633f45aab40 2024-09-19T09:00:55.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.020+0000 7f5e4dffb640 1 -- 172.21.15.19:0/4085404415 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5e5c031740 con 0x5633f45aab40 2024-09-19T09:00:55.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.020+0000 7f5e6ef9d740 1 -- 172.21.15.19:0/4085404415 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e5c0046c0 con 0x5633f45aab40 2024-09-19T09:00:55.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.020+0000 7f5e4dffb640 1 -- 172.21.15.19:0/4085404415 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f5e5c058050 con 0x5633f45aab40 2024-09-19T09:00:55.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.020+0000 7f5e6ef9d740 10 client.26834 fetch_fsmap learned FSMap version 36 2024-09-19T09:00:55.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.020+0000 7f5e6ef9d740 1 -- 172.21.15.19:0/4085404415 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5633f45c6f40 con 0x5633f45aab40 2024-09-19T09:00:55.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.020+0000 7f5e4dffb640 1 -- 172.21.15.19:0/4085404415 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e5c0046c0 con 0x5633f45aab40 2024-09-19T09:00:55.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.020+0000 7f5e4dffb640 1 -- 172.21.15.19:0/4085404415 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f5e5c03d790 con 0x5633f45aab40 2024-09-19T09:00:55.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.020+0000 7f5e6ef9d740 10 client.26834 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:00:55.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.020+0000 7f5e6ef9d740 10 client.26834 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T09:00:55.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.021+0000 7f5e6ef9d740 20 client.26834 populate_metadata read hostname 'smithi019' 2024-09-19T09:00:55.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.021+0000 7f5e6ef9d740 1 --2- 172.21.15.19:0/4085404415 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x5633f45c83f0 0x5633f45ca840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.021+0000 7f5e6ef9d740 4 client.26834 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:00:55.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.021+0000 7f5e6ef9d740 1 -- 172.21.15.19:0/4085404415 --> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5633f451c860 con 0x5633f45c83f0 2024-09-19T09:00:55.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.021+0000 7f5e6659c640 1 --2- 172.21.15.19:0/4085404415 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x5633f45c83f0 0x5633f45ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.021+0000 7f5e6659c640 1 --2- 172.21.15.19:0/4085404415 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x5633f45c83f0 0x5633f45ca840 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2521fc70a0013368 server_cookie=e70148fdeebcd283 in_seq=0 out_seq=0 2024-09-19T09:00:55.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.021+0000 7f5e4dffb640 10 client.26834 ms_handle_connect on v2:172.21.15.203:6836/3684671619 2024-09-19T09:00:55.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.022+0000 7f5e4dffb640 1 -- 172.21.15.19:0/4085404415 <== mds.2 v2:172.21.15.203:6836/3684671619 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5633f451c860 con 0x5633f45c83f0 2024-09-19T09:00:55.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.022+0000 7f5e4dffb640 10 client.26834 handle_command_reply: tid=0 2024-09-19T09:00:55.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.022+0000 7f5e6ef9d740 1 client.26834 shutdown 2024-09-19T09:00:55.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.022+0000 7f5e6ef9d740 1 -- 172.21.15.19:0/4085404415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633f45aab40 msgr2=0x5633f45b16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:55.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.022+0000 7f5e6ef9d740 1 --2- 172.21.15.19:0/4085404415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633f45aab40 0x5633f45b16d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c003c20 tx=0x7f5e5c003c50 comp rx=0 tx=0).stop 2024-09-19T09:00:55.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.023+0000 7f5e6ef9d740 1 -- 172.21.15.19:0/4085404415 shutdown_connections 2024-09-19T09:00:55.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.023+0000 7f5e6ef9d740 1 --2- 172.21.15.19:0/4085404415 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x5633f45c83f0 0x5633f45ca840 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.023+0000 7f5e6ef9d740 1 --2- 172.21.15.19:0/4085404415 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633f45b4370 0x5633f45b1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.023+0000 7f5e6ef9d740 1 --2- 172.21.15.19:0/4085404415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633f45aab40 0x5633f45b16d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.023+0000 7f5e4dffb640 0 client.26834 ms_handle_reset on v2:172.21.15.203:6836/3684671619 2024-09-19T09:00:55.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.023+0000 7f5e6ef9d740 1 --2- 172.21.15.19:0/4085404415 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5633f45a95d0 0x5633f45b1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.023+0000 7f5e6ef9d740 1 -- 172.21.15.19:0/4085404415 >> 172.21.15.19:0/4085404415 conn(0x5633f4572310 msgr2=0x5633f45ab960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:55.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.023+0000 7f5e6ef9d740 1 -- 172.21.15.19:0/4085404415 shutdown_connections 2024-09-19T09:00:55.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.023+0000 7f5e6ef9d740 1 -- 172.21.15.19:0/4085404415 wait complete. 2024-09-19T09:00:55.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.023+0000 7f5e6ef9d740 20 client.26834 trim_cache size 0 max 16384 2024-09-19T09:00:55.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.037+0000 7f5e6ef9d740 1 Processor -- start 2024-09-19T09:00:55.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.037+0000 7f5e6ef9d740 1 -- start start 2024-09-19T09:00:55.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.037+0000 7f5e6ef9d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633f45a95d0 0x5633f45ac120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.037+0000 7f5e6ef9d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633f45aab40 0x5633f45ac660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.037+0000 7f5e6ef9d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5633f45b4370 0x5633f45d0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.037+0000 7f5e6ef9d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5e681ab250 con 0x5633f45b4370 2024-09-19T09:00:55.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.037+0000 7f5e6ef9d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5e681acd90 con 0x5633f45a95d0 2024-09-19T09:00:55.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.037+0000 7f5e6ef9d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5e681ab920 con 0x5633f45aab40 2024-09-19T09:00:55.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.037+0000 7f5e6659c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633f45a95d0 0x5633f45ac120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.037+0000 7f5e6659c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633f45a95d0 0x5633f45ac120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:52868/0 (socket says 172.21.15.19:52868) 2024-09-19T09:00:55.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.037+0000 7f5e6659c640 1 -- 172.21.15.19:0/2680582855 learned_addr learned my addr 172.21.15.19:0/2680582855 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:55.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.037+0000 7f5e66d9d640 1 --2- 172.21.15.19:0/2680582855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5633f45b4370 0x5633f45d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.038+0000 7f5e65d9b640 1 --2- 172.21.15.19:0/2680582855 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633f45aab40 0x5633f45ac660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.038+0000 7f5e6659c640 1 -- 172.21.15.19:0/2680582855 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633f45aab40 msgr2=0x5633f45ac660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:55.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.038+0000 7f5e6659c640 1 --2- 172.21.15.19:0/2680582855 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633f45aab40 0x5633f45ac660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.038+0000 7f5e6659c640 1 -- 172.21.15.19:0/2680582855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5633f45b4370 msgr2=0x5633f45d0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:55.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.038+0000 7f5e6659c640 1 --2- 172.21.15.19:0/2680582855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5633f45b4370 0x5633f45d0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.038+0000 7f5e6659c640 1 -- 172.21.15.19:0/2680582855 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633f45caec0 con 0x5633f45a95d0 2024-09-19T09:00:55.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.038+0000 7f5e6659c640 1 --2- 172.21.15.19:0/2680582855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633f45a95d0 0x5633f45ac120 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x5633f45cb0f0 tx=0x7f5e58019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0504bedce1422f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:55.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.038+0000 7f5e4ffff640 1 -- 172.21.15.19:0/2680582855 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e58004020 con 0x5633f45a95d0 2024-09-19T09:00:55.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.038+0000 7f5e4ffff640 1 -- 172.21.15.19:0/2680582855 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e580041c0 con 0x5633f45a95d0 2024-09-19T09:00:55.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.038+0000 7f5e4ffff640 1 -- 172.21.15.19:0/2680582855 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e58005610 con 0x5633f45a95d0 2024-09-19T09:00:55.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.039+0000 7f5e6ef9d740 1 -- 172.21.15.19:0/2680582855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633f45a95d0 msgr2=0x5633f45ac120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:55.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.039+0000 7f5e6ef9d740 1 --2- 172.21.15.19:0/2680582855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633f45a95d0 0x5633f45ac120 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x5633f45cb0f0 tx=0x7f5e58019000 comp rx=0 tx=0).stop 2024-09-19T09:00:55.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.039+0000 7f5e6ef9d740 1 -- 172.21.15.19:0/2680582855 shutdown_connections 2024-09-19T09:00:55.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.039+0000 7f5e6ef9d740 1 --2- 172.21.15.19:0/2680582855 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633f45aab40 0x5633f45ac660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.039+0000 7f5e6ef9d740 1 --2- 172.21.15.19:0/2680582855 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5633f45b4370 0x5633f45d0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.039+0000 7f5e6ef9d740 1 --2- 172.21.15.19:0/2680582855 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633f45a95d0 0x5633f45ac120 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.039+0000 7f5e6ef9d740 1 -- 172.21.15.19:0/2680582855 >> 172.21.15.19:0/2680582855 conn(0x5633f4572310 msgr2=0x5633f45b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:55.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.039+0000 7f5e6ef9d740 1 -- 172.21.15.19:0/2680582855 shutdown_connections 2024-09-19T09:00:55.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.040+0000 7f5e6ef9d740 1 -- 172.21.15.19:0/2680582855 wait complete. 2024-09-19T09:00:55.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.040+0000 7f5e6ef9d740 1 -- start start 2024-09-19T09:00:55.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.040+0000 7f5e6ef9d740 1 Processor -- start 2024-09-19T09:00:55.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.040+0000 7f5e6ef9d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633f45a95d0 0x5633f462b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.040+0000 7f5e6ef9d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5633f45aab40 0x5633f462b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.040+0000 7f5e6ef9d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633f45b4370 0x5633f45c03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.040+0000 7f5e6ef9d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5e681ac6c0 con 0x5633f45aab40 2024-09-19T09:00:55.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.040+0000 7f5e6ef9d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5e681abff0 con 0x5633f45a95d0 2024-09-19T09:00:55.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.040+0000 7f5e6ef9d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5e681a9250 con 0x5633f45b4370 2024-09-19T09:00:55.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.040+0000 7f5e6ef9d740 10 client.0 _ll_register_callbacks cb 0x7f5e58009c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:55.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.040+0000 7f5e6659c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633f45a95d0 0x5633f462b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.041+0000 7f5e6659c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633f45a95d0 0x5633f462b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:52880/0 (socket says 172.21.15.19:52880) 2024-09-19T09:00:55.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.041+0000 7f5e6659c640 1 -- 172.21.15.19:0/1670558589 learned_addr learned my addr 172.21.15.19:0/1670558589 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:55.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.041+0000 7f5e66d9d640 1 --2- 172.21.15.19:0/1670558589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633f45b4370 0x5633f45c03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.041+0000 7f5e65d9b640 1 --2- 172.21.15.19:0/1670558589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5633f45aab40 0x5633f462b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.041+0000 7f5e6659c640 1 -- 172.21.15.19:0/1670558589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633f45b4370 msgr2=0x5633f45c03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:55.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.041+0000 7f5e6659c640 1 --2- 172.21.15.19:0/1670558589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633f45b4370 0x5633f45c03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.041+0000 7f5e6659c640 1 -- 172.21.15.19:0/1670558589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5633f45aab40 msgr2=0x5633f462b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:55.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.041+0000 7f5e6659c640 1 --2- 172.21.15.19:0/1670558589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5633f45aab40 0x5633f462b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.041+0000 7f5e6659c640 1 -- 172.21.15.19:0/1670558589 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633f45c0a30 con 0x5633f45a95d0 2024-09-19T09:00:55.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.041+0000 7f5e65d9b640 1 --2- 172.21.15.19:0/1670558589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5633f45aab40 0x5633f462b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:00:55.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.041+0000 7f5e66d9d640 1 --2- 172.21.15.19:0/1670558589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633f45b4370 0x5633f45c03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:55.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.041+0000 7f5e6659c640 1 --2- 172.21.15.19:0/1670558589 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633f45a95d0 0x5633f462b2c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5e58010010 tx=0x7f5e58004370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2220990c0bbe07c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:55.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.041+0000 7f5e4dffb640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T09:00:55.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.041+0000 7f5e4dffb640 1 -- 172.21.15.19:0/1670558589 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e5801d9a0 con 0x5633f45a95d0 2024-09-19T09:00:55.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.041+0000 7f5e4dffb640 1 -- 172.21.15.19:0/1670558589 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5e5801db40 con 0x5633f45a95d0 2024-09-19T09:00:55.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.041+0000 7f5e6ef9d740 1 -- 172.21.15.19:0/1670558589 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e580041c0 con 0x5633f45a95d0 2024-09-19T09:00:55.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.042+0000 7f5e4dffb640 1 -- 172.21.15.19:0/1670558589 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f5e5801dd40 con 0x5633f45a95d0 2024-09-19T09:00:55.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.042+0000 7f5e6ef9d740 10 client.26840 fetch_fsmap learned FSMap version 36 2024-09-19T09:00:55.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.042+0000 7f5e6ef9d740 1 -- 172.21.15.19:0/1670558589 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5633f4632af0 con 0x5633f45a95d0 2024-09-19T09:00:55.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.042+0000 7f5e4dffb640 1 -- 172.21.15.19:0/1670558589 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e580041c0 con 0x5633f45a95d0 2024-09-19T09:00:55.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.042+0000 7f5e4dffb640 1 -- 172.21.15.19:0/1670558589 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f5e5803f4d0 con 0x5633f45a95d0 2024-09-19T09:00:55.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.042+0000 7f5e6ef9d740 10 client.26840 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:00:55.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.042+0000 7f5e6ef9d740 10 client.26840 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T09:00:55.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.042+0000 7f5e6ef9d740 20 client.26840 populate_metadata read hostname 'smithi019' 2024-09-19T09:00:55.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.042+0000 7f5e6ef9d740 1 --2- 172.21.15.19:0/1670558589 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x5633f4633180 0x5633f46355a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:55.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.042+0000 7f5e6ef9d740 4 client.26840 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:00:55.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.042+0000 7f5e6ef9d740 1 -- 172.21.15.19:0/1670558589 --> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5633f4516d70 con 0x5633f4633180 2024-09-19T09:00:55.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.043+0000 7f5e65d9b640 1 --2- 172.21.15.19:0/1670558589 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x5633f4633180 0x5633f46355a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:55.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.043+0000 7f5e65d9b640 1 --2- 172.21.15.19:0/1670558589 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x5633f4633180 0x5633f46355a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5bd43acc25710968 server_cookie=9d32307e1f552cdb in_seq=0 out_seq=0 2024-09-19T09:00:55.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.043+0000 7f5e4dffb640 10 client.26840 ms_handle_connect on v2:172.21.15.203:6836/3684671619 2024-09-19T09:00:55.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.044+0000 7f5e4dffb640 1 -- 172.21.15.19:0/1670558589 <== mds.2 v2:172.21.15.203:6836/3684671619 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5633f4516d70 con 0x5633f4633180 2024-09-19T09:00:55.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.044+0000 7f5e4dffb640 10 client.26840 handle_command_reply: tid=0 2024-09-19T09:00:55.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.044+0000 7f5e6ef9d740 1 client.26840 shutdown 2024-09-19T09:00:55.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.044+0000 7f5e6ef9d740 1 -- 172.21.15.19:0/1670558589 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633f45a95d0 msgr2=0x5633f462b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:55.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.044+0000 7f5e6ef9d740 1 --2- 172.21.15.19:0/1670558589 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633f45a95d0 0x5633f462b2c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5e58010010 tx=0x7f5e58004370 comp rx=0 tx=0).stop 2024-09-19T09:00:55.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.044+0000 7f5e6ef9d740 1 -- 172.21.15.19:0/1670558589 shutdown_connections 2024-09-19T09:00:55.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.044+0000 7f5e6ef9d740 1 --2- 172.21.15.19:0/1670558589 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x5633f4633180 0x5633f46355a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.044+0000 7f5e6ef9d740 1 --2- 172.21.15.19:0/1670558589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633f45b4370 0x5633f45c03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.044+0000 7f5e6ef9d740 1 --2- 172.21.15.19:0/1670558589 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5633f45aab40 0x5633f462b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.044+0000 7f5e4dffb640 0 client.26840 ms_handle_reset on v2:172.21.15.203:6836/3684671619 2024-09-19T09:00:55.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.044+0000 7f5e6ef9d740 1 --2- 172.21.15.19:0/1670558589 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5633f45a95d0 0x5633f462b2c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.044+0000 7f5e6ef9d740 1 -- 172.21.15.19:0/1670558589 >> 172.21.15.19:0/1670558589 conn(0x5633f4572310 msgr2=0x5633f45b1130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:55.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.044+0000 7f5e6ef9d740 1 -- 172.21.15.19:0/1670558589 shutdown_connections 2024-09-19T09:00:55.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.044+0000 7f5e6ef9d740 1 -- 172.21.15.19:0/1670558589 wait complete. 2024-09-19T09:00:55.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.044+0000 7f5e6ef9d740 20 client.26840 trim_cache size 0 max 16384 2024-09-19T09:00:55.049 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:00:55.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.045+0000 7f5e6cbc4640 1 -- 172.21.15.19:0/2763764870 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5e500a3240 msgr2=0x7f5e500a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:55.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.045+0000 7f5e6cbc4640 1 --2- 172.21.15.19:0/2763764870 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5e500a3240 0x7f5e500a5700 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x5633f45a6ac0 tx=0x7f5e58005f90 comp rx=0 tx=0).stop 2024-09-19T09:00:55.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.045+0000 7f5e6cbc4640 1 -- 172.21.15.19:0/2763764870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e68102ef0 msgr2=0x7f5e6819cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:55.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.045+0000 7f5e6cbc4640 1 --2- 172.21.15.19:0/2763764870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e68102ef0 0x7f5e6819cdf0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5e60009fd0 tx=0x7f5e6000ef10 comp rx=0 tx=0).stop 2024-09-19T09:00:55.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.045+0000 7f5e6cbc4640 1 -- 172.21.15.19:0/2763764870 shutdown_connections 2024-09-19T09:00:55.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.045+0000 7f5e6cbc4640 1 --2- 172.21.15.19:0/2763764870 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5e500a3240 0x7f5e500a5700 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.045+0000 7f5e6cbc4640 1 --2- 172.21.15.19:0/2763764870 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e68102570 0x7f5e68198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.045+0000 7f5e6cbc4640 1 --2- 172.21.15.19:0/2763764870 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e68102ef0 0x7f5e6819cdf0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.045+0000 7f5e6cbc4640 1 --2- 172.21.15.19:0/2763764870 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e68100e20 0x7f5e68198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:55.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.045+0000 7f5e6cbc4640 1 -- 172.21.15.19:0/2763764870 >> 172.21.15.19:0/2763764870 conn(0x7f5e680fc7d0 msgr2=0x7f5e68069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:55.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.046+0000 7f5e6cbc4640 1 -- 172.21.15.19:0/2763764870 shutdown_connections 2024-09-19T09:00:55.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:55.046+0000 7f5e6cbc4640 1 -- 172.21.15.19:0/2763764870 wait complete. 2024-09-19T09:00:55.721 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:00:55.990 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:56.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:55 smithi019 ceph-mon[30976]: pgmap v598: 97 pgs: 97 active+clean; 15 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 756 KiB/s wr, 277 op/s 2024-09-19T09:00:56.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:55 smithi155 ceph-mon[34921]: pgmap v598: 97 pgs: 97 active+clean; 15 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 756 KiB/s wr, 277 op/s 2024-09-19T09:00:56.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:55 smithi203 ceph-mon[35450]: pgmap v598: 97 pgs: 97 active+clean; 15 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 719 KiB/s rd, 756 KiB/s wr, 277 op/s 2024-09-19T09:00:56.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.452+0000 7f175aaf7640 1 -- 172.21.15.19:0/1677201599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17541019c0 msgr2=0x7f1754101e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:56.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.452+0000 7f175aaf7640 1 --2- 172.21.15.19:0/1677201599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17541019c0 0x7f1754101e20 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f1744009930 tx=0x7f174402a420 comp rx=0 tx=0).stop 2024-09-19T09:00:56.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.452+0000 7f175aaf7640 1 -- 172.21.15.19:0/1677201599 shutdown_connections 2024-09-19T09:00:56.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.452+0000 7f175aaf7640 1 --2- 172.21.15.19:0/1677201599 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1754102360 0x7f175410e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.452+0000 7f175aaf7640 1 --2- 172.21.15.19:0/1677201599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f17541019c0 0x7f1754101e20 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.452+0000 7f175aaf7640 1 --2- 172.21.15.19:0/1677201599 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f17541079c0 0x7f1754107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.452+0000 7f175aaf7640 1 -- 172.21.15.19:0/1677201599 >> 172.21.15.19:0/1677201599 conn(0x7f17540fd740 msgr2=0x7f17540ffb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:56.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.452+0000 7f175aaf7640 1 -- 172.21.15.19:0/1677201599 shutdown_connections 2024-09-19T09:00:56.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.452+0000 7f175aaf7640 1 -- 172.21.15.19:0/1677201599 wait complete. 2024-09-19T09:00:56.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.453+0000 7f175aaf7640 1 Processor -- start 2024-09-19T09:00:56.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.453+0000 7f175aaf7640 1 -- start start 2024-09-19T09:00:56.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.453+0000 7f175aaf7640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f17541019c0 0x7f17541982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:56.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.453+0000 7f175aaf7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1754102360 0x7f1754198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:56.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.453+0000 7f175aaf7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17541079c0 0x7f175419cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:56.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.453+0000 7f175aaf7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1754111dc0 con 0x7f1754102360 2024-09-19T09:00:56.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.453+0000 7f175aaf7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1754111c40 con 0x7f17541079c0 2024-09-19T09:00:56.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.453+0000 7f175aaf7640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1754111f40 con 0x7f17541019c0 2024-09-19T09:00:56.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.453+0000 7f17592f4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1754102360 0x7f1754198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:56.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.453+0000 7f17592f4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1754102360 0x7f1754198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33162/0 (socket says 172.21.15.19:33162) 2024-09-19T09:00:56.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.453+0000 7f17592f4640 1 -- 172.21.15.19:0/2238465450 learned_addr learned my addr 172.21.15.19:0/2238465450 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:56.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.453+0000 7f1759af5640 1 --2- 172.21.15.19:0/2238465450 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f17541019c0 0x7f17541982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:56.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.453+0000 7f175a2f6640 1 --2- 172.21.15.19:0/2238465450 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17541079c0 0x7f175419cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:56.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.453+0000 7f175a2f6640 1 -- 172.21.15.19:0/2238465450 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f17541019c0 msgr2=0x7f17541982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:56.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.453+0000 7f175a2f6640 1 --2- 172.21.15.19:0/2238465450 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f17541019c0 0x7f17541982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.453+0000 7f175a2f6640 1 -- 172.21.15.19:0/2238465450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1754102360 msgr2=0x7f1754198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:56.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.453+0000 7f175a2f6640 1 --2- 172.21.15.19:0/2238465450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1754102360 0x7f1754198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.453+0000 7f175a2f6640 1 -- 172.21.15.19:0/2238465450 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f175419d290 con 0x7f17541079c0 2024-09-19T09:00:56.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.453+0000 7f17592f4640 1 --2- 172.21.15.19:0/2238465450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1754102360 0x7f1754198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:56.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.453+0000 7f1759af5640 1 --2- 172.21.15.19:0/2238465450 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f17541019c0 0x7f17541982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:00:56.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.454+0000 7f175a2f6640 1 --2- 172.21.15.19:0/2238465450 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17541079c0 0x7f175419cbb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f174c009fd0 tx=0x7f174c00ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:56.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.454+0000 7f174affd640 1 -- 172.21.15.19:0/2238465450 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174c00ce20 con 0x7f17541079c0 2024-09-19T09:00:56.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.454+0000 7f174affd640 1 -- 172.21.15.19:0/2238465450 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f174c005020 con 0x7f17541079c0 2024-09-19T09:00:56.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.454+0000 7f175aaf7640 1 -- 172.21.15.19:0/2238465450 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f175419d580 con 0x7f17541079c0 2024-09-19T09:00:56.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.454+0000 7f174affd640 1 -- 172.21.15.19:0/2238465450 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174c010720 con 0x7f17541079c0 2024-09-19T09:00:56.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.454+0000 7f175aaf7640 1 -- 172.21.15.19:0/2238465450 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17541a4e60 con 0x7f17541079c0 2024-09-19T09:00:56.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.456+0000 7f174affd640 1 -- 172.21.15.19:0/2238465450 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f174c005540 con 0x7f17541079c0 2024-09-19T09:00:56.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.457+0000 7f175e132740 1 Processor -- start 2024-09-19T09:00:56.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.457+0000 7f175e132740 1 -- start start 2024-09-19T09:00:56.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.457+0000 7f174affd640 1 --2- 172.21.15.19:0/2238465450 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f17400a32c0 0x7f17400a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:56.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.457+0000 7f175e132740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558d5004bd20 0x558d5004a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:56.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.457+0000 7f175e132740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558d5004a7b0 0x558d5004abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:56.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.457+0000 7f175e132740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558d50059960 0x558d5005bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:56.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.457+0000 7f175e132740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x558d4ffb02f0 con 0x558d5004bd20 2024-09-19T09:00:56.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.457+0000 7f175e132740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x558d4ff57cf0 con 0x558d5004a7b0 2024-09-19T09:00:56.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.457+0000 7f175e132740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558d4ffac2b0 con 0x558d50059960 2024-09-19T09:00:56.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.457+0000 7f1759af5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558d5004bd20 0x558d5004a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:56.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.458+0000 7f174affd640 1 -- 172.21.15.19:0/2238465450 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f174c0cfff0 con 0x7f17541079c0 2024-09-19T09:00:56.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.458+0000 7f1759af5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558d5004bd20 0x558d5004a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33164/0 (socket says 172.21.15.19:33164) 2024-09-19T09:00:56.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.458+0000 7f1759af5640 1 -- 172.21.15.19:0/1346424972 learned_addr learned my addr 172.21.15.19:0/1346424972 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:56.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.458+0000 7f17592f4640 1 --2- 172.21.15.19:0/2238465450 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f17400a32c0 0x7f17400a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:56.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.458+0000 7f175a2f6640 1 --2- 172.21.15.19:0/1346424972 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558d50059960 0x558d5005bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:56.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.458+0000 7f17592f4640 1 --2- 172.21.15.19:0/1346424972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558d5004a7b0 0x558d5004abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:56.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.458+0000 7f1759af5640 1 -- 172.21.15.19:0/1346424972 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558d50059960 msgr2=0x558d5005bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:56.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.458+0000 7f1759af5640 1 --2- 172.21.15.19:0/1346424972 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558d50059960 0x558d5005bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.458+0000 7f1759af5640 1 -- 172.21.15.19:0/1346424972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558d5004a7b0 msgr2=0x558d5004abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:56.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.458+0000 7f1759af5640 1 --2- 172.21.15.19:0/1346424972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558d5004a7b0 0x558d5004abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.458+0000 7f1759af5640 1 -- 172.21.15.19:0/1346424972 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d4ff3c3a0 con 0x558d5004bd20 2024-09-19T09:00:56.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.458+0000 7f175a2f6640 1 --2- 172.21.15.19:0/1346424972 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558d50059960 0x558d5005bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:00:56.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.458+0000 7f17592f4640 1 --2- 172.21.15.19:0/2238465450 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f17400a32c0 0x7f17400a5780 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f17540ffd50 tx=0x7f1744005e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:56.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.459+0000 7f1759af5640 1 --2- 172.21.15.19:0/1346424972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558d5004bd20 0x558d5004a270 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f175000bcc0 tx=0x7f175000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614947619eb732b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:56.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.459+0000 7f173ffff640 1 -- 172.21.15.19:0/1346424972 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1750015070 con 0x558d5004bd20 2024-09-19T09:00:56.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.459+0000 7f173ffff640 1 -- 172.21.15.19:0/1346424972 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1750005500 con 0x558d5004bd20 2024-09-19T09:00:56.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.459+0000 7f173ffff640 1 -- 172.21.15.19:0/1346424972 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17500116a0 con 0x558d5004bd20 2024-09-19T09:00:56.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.459+0000 7f175e132740 1 -- 172.21.15.19:0/1346424972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558d5004bd20 msgr2=0x558d5004a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:56.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.460+0000 7f175e132740 1 --2- 172.21.15.19:0/1346424972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558d5004bd20 0x558d5004a270 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f175000bcc0 tx=0x7f175000f730 comp rx=0 tx=0).stop 2024-09-19T09:00:56.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.460+0000 7f175e132740 1 -- 172.21.15.19:0/1346424972 shutdown_connections 2024-09-19T09:00:56.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.460+0000 7f175e132740 1 --2- 172.21.15.19:0/1346424972 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558d50059960 0x558d5005bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.460+0000 7f175e132740 1 --2- 172.21.15.19:0/1346424972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558d5004a7b0 0x558d5004abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.460+0000 7f175e132740 1 --2- 172.21.15.19:0/1346424972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558d5004bd20 0x558d5004a270 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.460+0000 7f175e132740 1 -- 172.21.15.19:0/1346424972 >> 172.21.15.19:0/1346424972 conn(0x558d50013310 msgr2=0x558d50046e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:56.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.460+0000 7f175e132740 1 -- 172.21.15.19:0/1346424972 shutdown_connections 2024-09-19T09:00:56.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.460+0000 7f175e132740 1 -- 172.21.15.19:0/1346424972 wait complete. 2024-09-19T09:00:56.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.460+0000 7f175e132740 1 -- start start 2024-09-19T09:00:56.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.460+0000 7f175e132740 1 Processor -- start 2024-09-19T09:00:56.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.461+0000 7f175e132740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558d5004a7b0 0x558d50059320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:56.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.461+0000 7f175e132740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558d5004bd20 0x558d500565d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:56.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.461+0000 7f175e132740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558d50059960 0x558d50056bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:56.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.461+0000 7f175e132740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x558d5005c660 con 0x558d5004bd20 2024-09-19T09:00:56.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.461+0000 7f175e132740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x558d4ff6b060 con 0x558d5004a7b0 2024-09-19T09:00:56.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.461+0000 7f175e132740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558d5005c7e0 con 0x558d50059960 2024-09-19T09:00:56.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.461+0000 7f175e132740 10 client.0 _ll_register_callbacks cb 0x558d4fcbe8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:56.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.461+0000 7f17592f4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558d5004bd20 0x558d500565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:56.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.461+0000 7f1759af5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558d5004a7b0 0x558d50059320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:56.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.461+0000 7f17592f4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558d5004bd20 0x558d500565d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33166/0 (socket says 172.21.15.19:33166) 2024-09-19T09:00:56.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.461+0000 7f17592f4640 1 -- 172.21.15.19:0/3104013162 learned_addr learned my addr 172.21.15.19:0/3104013162 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:56.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.461+0000 7f175a2f6640 1 --2- 172.21.15.19:0/3104013162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558d50059960 0x558d50056bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:56.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.461+0000 7f17592f4640 1 -- 172.21.15.19:0/3104013162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558d50059960 msgr2=0x558d50056bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:56.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.461+0000 7f17592f4640 1 --2- 172.21.15.19:0/3104013162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558d50059960 0x558d50056bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.461+0000 7f17592f4640 1 -- 172.21.15.19:0/3104013162 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558d5004a7b0 msgr2=0x558d50059320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:56.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.461+0000 7f17592f4640 1 --2- 172.21.15.19:0/3104013162 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558d5004a7b0 0x558d50059320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.461+0000 7f17592f4640 1 -- 172.21.15.19:0/3104013162 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d4fd213c0 con 0x558d5004bd20 2024-09-19T09:00:56.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.461+0000 7f1759af5640 1 --2- 172.21.15.19:0/3104013162 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558d5004a7b0 0x558d50059320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:56.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.461+0000 7f17592f4640 1 --2- 172.21.15.19:0/3104013162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558d5004bd20 0x558d500565d0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f1744006010 tx=0x7f1744046000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf213fb1e33867c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:56.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.461+0000 7f173d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:00:56.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.461+0000 7f173d7fa640 1 -- 172.21.15.19:0/3104013162 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1744052070 con 0x558d5004bd20 2024-09-19T09:00:56.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.462+0000 7f173d7fa640 1 -- 172.21.15.19:0/3104013162 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f174404c480 con 0x558d5004bd20 2024-09-19T09:00:56.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.462+0000 7f175e132740 1 -- 172.21.15.19:0/3104013162 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1750005500 con 0x558d5004bd20 2024-09-19T09:00:56.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.462+0000 7f173d7fa640 1 -- 172.21.15.19:0/3104013162 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f174405e050 con 0x558d5004bd20 2024-09-19T09:00:56.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.462+0000 7f175e132740 10 client.17382 fetch_fsmap learned FSMap version 36 2024-09-19T09:00:56.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.462+0000 7f175e132740 1 -- 172.21.15.19:0/3104013162 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x558d500680c0 con 0x558d5004bd20 2024-09-19T09:00:56.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.462+0000 7f173d7fa640 1 -- 172.21.15.19:0/3104013162 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1750005500 con 0x558d5004bd20 2024-09-19T09:00:56.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.462+0000 7f173d7fa640 1 -- 172.21.15.19:0/3104013162 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f174403d5b0 con 0x558d5004bd20 2024-09-19T09:00:56.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.462+0000 7f175e132740 10 client.17382 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:00:56.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.462+0000 7f175e132740 10 client.17382 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:00:56.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.462+0000 7f175e132740 20 client.17382 populate_metadata read hostname 'smithi019' 2024-09-19T09:00:56.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.462+0000 7f175e132740 1 --2- 172.21.15.19:0/3104013162 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x558d50069590 0x558d5006ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:56.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.462+0000 7f175e132740 4 client.17382 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:00:56.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.462+0000 7f175e132740 1 -- 172.21.15.19:0/3104013162 --> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d4ffbd860 con 0x558d50069590 2024-09-19T09:00:56.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.462+0000 7f1759af5640 1 --2- 172.21.15.19:0/3104013162 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x558d50069590 0x558d5006ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:56.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.463+0000 7f1759af5640 1 --2- 172.21.15.19:0/3104013162 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x558d50069590 0x558d5006ba10 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3b26d29a76feb022 server_cookie=f9c8b106669d51bb in_seq=0 out_seq=0 2024-09-19T09:00:56.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.463+0000 7f173d7fa640 10 client.17382 ms_handle_connect on v2:172.21.15.203:6838/2547507299 2024-09-19T09:00:56.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.464+0000 7f173d7fa640 1 -- 172.21.15.19:0/3104013162 <== mds.1 v2:172.21.15.203:6838/2547507299 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558d4ffbd860 con 0x558d50069590 2024-09-19T09:00:56.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.464+0000 7f173d7fa640 10 client.17382 handle_command_reply: tid=0 2024-09-19T09:00:56.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.464+0000 7f175e132740 1 client.17382 shutdown 2024-09-19T09:00:56.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.464+0000 7f175e132740 1 -- 172.21.15.19:0/3104013162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558d5004bd20 msgr2=0x558d500565d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:56.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.464+0000 7f175e132740 1 --2- 172.21.15.19:0/3104013162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558d5004bd20 0x558d500565d0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f1744006010 tx=0x7f1744046000 comp rx=0 tx=0).stop 2024-09-19T09:00:56.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.464+0000 7f175e132740 1 -- 172.21.15.19:0/3104013162 shutdown_connections 2024-09-19T09:00:56.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.464+0000 7f175e132740 1 --2- 172.21.15.19:0/3104013162 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x558d50069590 0x558d5006ba10 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.464+0000 7f175e132740 1 --2- 172.21.15.19:0/3104013162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558d50059960 0x558d50056bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.464+0000 7f175e132740 1 --2- 172.21.15.19:0/3104013162 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558d5004bd20 0x558d500565d0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.464+0000 7f175e132740 1 --2- 172.21.15.19:0/3104013162 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558d5004a7b0 0x558d50059320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.464+0000 7f175e132740 1 -- 172.21.15.19:0/3104013162 >> 172.21.15.19:0/3104013162 conn(0x558d50013310 msgr2=0x558d5004cb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:56.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.464+0000 7f173d7fa640 0 client.17382 ms_handle_reset on v2:172.21.15.203:6838/2547507299 2024-09-19T09:00:56.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.464+0000 7f175e132740 1 -- 172.21.15.19:0/3104013162 shutdown_connections 2024-09-19T09:00:56.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.464+0000 7f175e132740 1 -- 172.21.15.19:0/3104013162 wait complete. 2024-09-19T09:00:56.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.464+0000 7f175e132740 20 client.17382 trim_cache size 0 max 16384 2024-09-19T09:00:56.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.478+0000 7f175e132740 1 Processor -- start 2024-09-19T09:00:56.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.478+0000 7f175e132740 1 -- start start 2024-09-19T09:00:56.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.478+0000 7f175e132740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558d5004a7b0 0x558d50065900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:56.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.478+0000 7f175e132740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558d5004bd20 0x558d50058540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:56.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.478+0000 7f175e132740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558d50059960 0x558d500712e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:56.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.478+0000 7f175e132740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f17541ab180 con 0x558d5004bd20 2024-09-19T09:00:56.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.478+0000 7f175e132740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f17541accc0 con 0x558d5004a7b0 2024-09-19T09:00:56.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.478+0000 7f175e132740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f17541ab850 con 0x558d50059960 2024-09-19T09:00:56.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.478+0000 7f17592f4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558d5004bd20 0x558d50058540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:56.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.478+0000 7f17592f4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558d5004bd20 0x558d50058540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33172/0 (socket says 172.21.15.19:33172) 2024-09-19T09:00:56.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.478+0000 7f1759af5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558d5004a7b0 0x558d50065900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:56.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.478+0000 7f17592f4640 1 -- 172.21.15.19:0/78499198 learned_addr learned my addr 172.21.15.19:0/78499198 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:56.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.478+0000 7f175a2f6640 1 --2- 172.21.15.19:0/78499198 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558d50059960 0x558d500712e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:56.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.478+0000 7f17592f4640 1 -- 172.21.15.19:0/78499198 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558d50059960 msgr2=0x558d500712e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:56.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.478+0000 7f17592f4640 1 --2- 172.21.15.19:0/78499198 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558d50059960 0x558d500712e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.478+0000 7f17592f4640 1 -- 172.21.15.19:0/78499198 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558d5004a7b0 msgr2=0x558d50065900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:56.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.478+0000 7f17592f4640 1 --2- 172.21.15.19:0/78499198 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558d5004a7b0 0x558d50065900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.478+0000 7f17592f4640 1 -- 172.21.15.19:0/78499198 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d50059690 con 0x558d5004bd20 2024-09-19T09:00:56.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.478+0000 7f1759af5640 1 --2- 172.21.15.19:0/78499198 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558d5004a7b0 0x558d50065900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:56.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.479+0000 7f175a2f6640 1 --2- 172.21.15.19:0/78499198 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558d50059960 0x558d500712e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:00:56.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.479+0000 7f17592f4640 1 --2- 172.21.15.19:0/78499198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558d5004bd20 0x558d50058540 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f1744009900 tx=0x7f17440316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ed795cedbfbf4c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:56.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.479+0000 7f173f7fe640 1 -- 172.21.15.19:0/78499198 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174405b020 con 0x558d5004bd20 2024-09-19T09:00:56.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.479+0000 7f173f7fe640 1 -- 172.21.15.19:0/78499198 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f174403dbf0 con 0x558d5004bd20 2024-09-19T09:00:56.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.479+0000 7f173f7fe640 1 -- 172.21.15.19:0/78499198 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1744052070 con 0x558d5004bd20 2024-09-19T09:00:56.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.480+0000 7f175e132740 1 -- 172.21.15.19:0/78499198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558d5004bd20 msgr2=0x558d50058540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:56.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.480+0000 7f175e132740 1 --2- 172.21.15.19:0/78499198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558d5004bd20 0x558d50058540 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f1744009900 tx=0x7f17440316d0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.480+0000 7f175e132740 1 -- 172.21.15.19:0/78499198 shutdown_connections 2024-09-19T09:00:56.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.480+0000 7f175e132740 1 --2- 172.21.15.19:0/78499198 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558d50059960 0x558d500712e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.480+0000 7f175e132740 1 --2- 172.21.15.19:0/78499198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558d5004bd20 0x558d50058540 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.480+0000 7f175e132740 1 --2- 172.21.15.19:0/78499198 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558d5004a7b0 0x558d50065900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.480+0000 7f175e132740 1 -- 172.21.15.19:0/78499198 >> 172.21.15.19:0/78499198 conn(0x558d50013310 msgr2=0x558d50057e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:56.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.480+0000 7f175e132740 1 -- 172.21.15.19:0/78499198 shutdown_connections 2024-09-19T09:00:56.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.480+0000 7f175e132740 1 -- 172.21.15.19:0/78499198 wait complete. 2024-09-19T09:00:56.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.480+0000 7f175e132740 1 -- start start 2024-09-19T09:00:56.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.480+0000 7f175e132740 1 Processor -- start 2024-09-19T09:00:56.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.481+0000 7f175e132740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558d5004a7b0 0x558d50061e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:56.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.481+0000 7f175e132740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558d5004bd20 0x558d50062360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:56.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.481+0000 7f175e132740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558d50059960 0x558d50053210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:56.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.481+0000 7f175e132740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f17541ac5f0 con 0x558d50059960 2024-09-19T09:00:56.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.481+0000 7f175e132740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f17541abf20 con 0x558d5004bd20 2024-09-19T09:00:56.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.481+0000 7f175e132740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f17541a9160 con 0x558d5004a7b0 2024-09-19T09:00:56.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.481+0000 7f175e132740 10 client.0 _ll_register_callbacks cb 0x7f17440317a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:56.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.481+0000 7f175a2f6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558d50059960 0x558d50053210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:56.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.481+0000 7f17592f4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558d5004bd20 0x558d50062360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:56.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.481+0000 7f175a2f6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558d50059960 0x558d50053210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33184/0 (socket says 172.21.15.19:33184) 2024-09-19T09:00:56.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.481+0000 7f175a2f6640 1 -- 172.21.15.19:0/2187888767 learned_addr learned my addr 172.21.15.19:0/2187888767 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:56.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.481+0000 7f1759af5640 1 --2- 172.21.15.19:0/2187888767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558d5004a7b0 0x558d50061e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:56.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.481+0000 7f175a2f6640 1 -- 172.21.15.19:0/2187888767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558d5004a7b0 msgr2=0x558d50061e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:56.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.481+0000 7f175a2f6640 1 --2- 172.21.15.19:0/2187888767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558d5004a7b0 0x558d50061e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.481+0000 7f175a2f6640 1 -- 172.21.15.19:0/2187888767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558d5004bd20 msgr2=0x558d50062360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:56.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.481+0000 7f175a2f6640 1 --2- 172.21.15.19:0/2187888767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558d5004bd20 0x558d50062360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.481+0000 7f175a2f6640 1 -- 172.21.15.19:0/2187888767 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d50053a40 con 0x558d50059960 2024-09-19T09:00:56.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.481+0000 7f17592f4640 1 --2- 172.21.15.19:0/2187888767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558d5004bd20 0x558d50062360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:56.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.481+0000 7f175a2f6640 1 --2- 172.21.15.19:0/2187888767 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558d50059960 0x558d50053210 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f174c0cdb40 tx=0x7f174c0744e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be9f130480b99d85 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:56.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.481+0000 7f173d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:00:56.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.482+0000 7f173d7fa640 1 -- 172.21.15.19:0/2187888767 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174c0a0a10 con 0x558d50059960 2024-09-19T09:00:56.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.482+0000 7f173d7fa640 1 -- 172.21.15.19:0/2187888767 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f174c0051d0 con 0x558d50059960 2024-09-19T09:00:56.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.482+0000 7f175e132740 1 -- 172.21.15.19:0/2187888767 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f174403dbf0 con 0x558d50059960 2024-09-19T09:00:56.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.482+0000 7f173d7fa640 1 -- 172.21.15.19:0/2187888767 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f174c0a52d0 con 0x558d50059960 2024-09-19T09:00:56.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.482+0000 7f175e132740 10 client.17388 fetch_fsmap learned FSMap version 36 2024-09-19T09:00:56.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.482+0000 7f175e132740 1 -- 172.21.15.19:0/2187888767 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x558d500d3f70 con 0x558d50059960 2024-09-19T09:00:56.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.482+0000 7f173d7fa640 1 -- 172.21.15.19:0/2187888767 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f174403dbf0 con 0x558d50059960 2024-09-19T09:00:56.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.482+0000 7f173d7fa640 1 -- 172.21.15.19:0/2187888767 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f174c0a4ed0 con 0x558d50059960 2024-09-19T09:00:56.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.482+0000 7f175e132740 10 client.17388 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:00:56.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.482+0000 7f175e132740 10 client.17388 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:00:56.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.482+0000 7f175e132740 20 client.17388 populate_metadata read hostname 'smithi019' 2024-09-19T09:00:56.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.482+0000 7f175e132740 1 --2- 172.21.15.19:0/2187888767 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x558d500d46e0 0x558d500d6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:56.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.482+0000 7f175e132740 4 client.17388 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:00:56.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.482+0000 7f175e132740 1 -- 172.21.15.19:0/2187888767 --> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558d4ffb7d70 con 0x558d500d46e0 2024-09-19T09:00:56.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.483+0000 7f1759af5640 1 --2- 172.21.15.19:0/2187888767 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x558d500d46e0 0x558d500d6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:56.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.483+0000 7f1759af5640 1 --2- 172.21.15.19:0/2187888767 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x558d500d46e0 0x558d500d6b00 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6a9ca23af84ccba8 server_cookie=db1b2b25bcf25c39 in_seq=0 out_seq=0 2024-09-19T09:00:56.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.483+0000 7f173d7fa640 10 client.17388 ms_handle_connect on v2:172.21.15.203:6838/2547507299 2024-09-19T09:00:56.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.483+0000 7f173d7fa640 1 -- 172.21.15.19:0/2187888767 <== mds.1 v2:172.21.15.203:6838/2547507299 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558d4ffb7d70 con 0x558d500d46e0 2024-09-19T09:00:56.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.483+0000 7f173d7fa640 10 client.17388 handle_command_reply: tid=0 2024-09-19T09:00:56.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.483+0000 7f175e132740 1 client.17388 shutdown 2024-09-19T09:00:56.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.484+0000 7f175e132740 1 -- 172.21.15.19:0/2187888767 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558d50059960 msgr2=0x558d50053210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:56.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.484+0000 7f175e132740 1 --2- 172.21.15.19:0/2187888767 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558d50059960 0x558d50053210 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f174c0cdb40 tx=0x7f174c0744e0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.484+0000 7f175e132740 1 -- 172.21.15.19:0/2187888767 shutdown_connections 2024-09-19T09:00:56.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.484+0000 7f175e132740 1 --2- 172.21.15.19:0/2187888767 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x558d500d46e0 0x558d500d6b00 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.484+0000 7f175e132740 1 --2- 172.21.15.19:0/2187888767 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558d50059960 0x558d50053210 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.484+0000 7f175e132740 1 --2- 172.21.15.19:0/2187888767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558d5004bd20 0x558d50062360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.484+0000 7f173d7fa640 0 client.17388 ms_handle_reset on v2:172.21.15.203:6838/2547507299 2024-09-19T09:00:56.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.484+0000 7f175e132740 1 --2- 172.21.15.19:0/2187888767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558d5004a7b0 0x558d50061e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.484+0000 7f175e132740 1 -- 172.21.15.19:0/2187888767 >> 172.21.15.19:0/2187888767 conn(0x558d50013310 msgr2=0x558d50058650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:56.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.484+0000 7f175e132740 1 -- 172.21.15.19:0/2187888767 shutdown_connections 2024-09-19T09:00:56.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.484+0000 7f175e132740 1 -- 172.21.15.19:0/2187888767 wait complete. 2024-09-19T09:00:56.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.484+0000 7f175e132740 20 client.17388 trim_cache size 0 max 16384 2024-09-19T09:00:56.490 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:00:56.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.484+0000 7f175aaf7640 1 -- 172.21.15.19:0/2238465450 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f17400a32c0 msgr2=0x7f17400a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:56.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.484+0000 7f175aaf7640 1 --2- 172.21.15.19:0/2238465450 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f17400a32c0 0x7f17400a5780 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f17540ffd50 tx=0x7f1744005e40 comp rx=0 tx=0).stop 2024-09-19T09:00:56.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.484+0000 7f175aaf7640 1 -- 172.21.15.19:0/2238465450 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17541079c0 msgr2=0x7f175419cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:56.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.484+0000 7f175aaf7640 1 --2- 172.21.15.19:0/2238465450 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17541079c0 0x7f175419cbb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f174c009fd0 tx=0x7f174c00ef10 comp rx=0 tx=0).stop 2024-09-19T09:00:56.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.484+0000 7f175aaf7640 1 -- 172.21.15.19:0/2238465450 shutdown_connections 2024-09-19T09:00:56.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.484+0000 7f175aaf7640 1 --2- 172.21.15.19:0/2238465450 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f17400a32c0 0x7f17400a5780 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.484+0000 7f175aaf7640 1 --2- 172.21.15.19:0/2238465450 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f17541079c0 0x7f175419cbb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.484+0000 7f175aaf7640 1 --2- 172.21.15.19:0/2238465450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1754102360 0x7f1754198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.484+0000 7f175aaf7640 1 --2- 172.21.15.19:0/2238465450 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f17541019c0 0x7f17541982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:56.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.484+0000 7f175aaf7640 1 -- 172.21.15.19:0/2238465450 >> 172.21.15.19:0/2238465450 conn(0x7f17540fd740 msgr2=0x7f17540fdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:56.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.485+0000 7f175aaf7640 1 -- 172.21.15.19:0/2238465450 shutdown_connections 2024-09-19T09:00:56.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:56.485+0000 7f175aaf7640 1 -- 172.21.15.19:0/2238465450 wait complete. 2024-09-19T09:00:57.147 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:00:57.403 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:00:58.121 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:57 smithi019 ceph-mon[30976]: pgmap v599: 97 pgs: 97 active+clean; 15 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 764 KiB/s wr, 311 op/s 2024-09-19T09:00:58.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:57 smithi155 ceph-mon[34921]: pgmap v599: 97 pgs: 97 active+clean; 15 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 764 KiB/s wr, 311 op/s 2024-09-19T09:00:58.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.956+0000 7f3e30abe640 1 -- 172.21.15.19:0/2896984474 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e2c102ef0 msgr2=0x7f3e2c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:58.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.956+0000 7f3e30abe640 1 --2- 172.21.15.19:0/2896984474 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e2c102ef0 0x7f3e2c10da40 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f3e24009ca0 tx=0x7f3e2402a950 comp rx=0 tx=0).stop 2024-09-19T09:00:58.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.956+0000 7f3e30abe640 1 -- 172.21.15.19:0/2896984474 shutdown_connections 2024-09-19T09:00:58.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.956+0000 7f3e30abe640 1 --2- 172.21.15.19:0/2896984474 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e2c102570 0x7f3e2c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.956+0000 7f3e30abe640 1 --2- 172.21.15.19:0/2896984474 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e2c102ef0 0x7f3e2c10da40 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.956+0000 7f3e30abe640 1 --2- 172.21.15.19:0/2896984474 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e2c100e20 0x7f3e2c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.956+0000 7f3e30abe640 1 -- 172.21.15.19:0/2896984474 >> 172.21.15.19:0/2896984474 conn(0x7f3e2c0fc7d0 msgr2=0x7f3e2c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:58.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.956+0000 7f3e30abe640 1 -- 172.21.15.19:0/2896984474 shutdown_connections 2024-09-19T09:00:58.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.956+0000 7f3e30abe640 1 -- 172.21.15.19:0/2896984474 wait complete. 2024-09-19T09:00:58.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.956+0000 7f3e30abe640 1 Processor -- start 2024-09-19T09:00:58.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.957+0000 7f3e30abe640 1 -- start start 2024-09-19T09:00:58.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.957+0000 7f3e30abe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e2c100e20 0x7f3e2c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:58.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.957+0000 7f3e30abe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e2c102570 0x7f3e2c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:58.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.957+0000 7f3e30abe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e2c102ef0 0x7f3e2c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:58.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.957+0000 7f3e30abe640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c110fd0 con 0x7f3e2c100e20 2024-09-19T09:00:58.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.957+0000 7f3e30abe640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c110e50 con 0x7f3e2c102ef0 2024-09-19T09:00:58.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.957+0000 7f3e30abe640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c111150 con 0x7f3e2c102570 2024-09-19T09:00:58.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.957+0000 7f3e2a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e2c100e20 0x7f3e2c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:58.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.957+0000 7f3e2a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e2c100e20 0x7f3e2c0fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33200/0 (socket says 172.21.15.19:33200) 2024-09-19T09:00:58.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.957+0000 7f3e2a59c640 1 -- 172.21.15.19:0/3093717478 learned_addr learned my addr 172.21.15.19:0/3093717478 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:58.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.957+0000 7f3e2ad9d640 1 --2- 172.21.15.19:0/3093717478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e2c102ef0 0x7f3e2c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:58.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.957+0000 7f3e21d9b640 1 --2- 172.21.15.19:0/3093717478 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e2c102570 0x7f3e2c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:58.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.957+0000 7f3e2a59c640 1 -- 172.21.15.19:0/3093717478 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e2c102570 msgr2=0x7f3e2c0fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:58.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.957+0000 7f3e2a59c640 1 --2- 172.21.15.19:0/3093717478 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e2c102570 0x7f3e2c0fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.957+0000 7f3e2a59c640 1 -- 172.21.15.19:0/3093717478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e2c102ef0 msgr2=0x7f3e2c0fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:58.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.957+0000 7f3e2a59c640 1 --2- 172.21.15.19:0/3093717478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e2c102ef0 0x7f3e2c0fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.957+0000 7f3e2a59c640 1 -- 172.21.15.19:0/3093717478 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e2c1a69c0 con 0x7f3e2c100e20 2024-09-19T09:00:58.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.957+0000 7f3e21d9b640 1 --2- 172.21.15.19:0/3093717478 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e2c102570 0x7f3e2c0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:00:58.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.958+0000 7f3e2a59c640 1 --2- 172.21.15.19:0/3093717478 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e2c100e20 0x7f3e2c0fcc80 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c00d950 tx=0x7f3e1c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:58.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.958+0000 7f3e23fff640 1 -- 172.21.15.19:0/3093717478 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c017030 con 0x7f3e2c100e20 2024-09-19T09:00:58.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.958+0000 7f3e30abe640 1 -- 172.21.15.19:0/3093717478 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e2c1a6cb0 con 0x7f3e2c100e20 2024-09-19T09:00:58.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.958+0000 7f3e23fff640 1 -- 172.21.15.19:0/3093717478 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e1c004020 con 0x7f3e2c100e20 2024-09-19T09:00:58.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.958+0000 7f3e23fff640 1 -- 172.21.15.19:0/3093717478 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c0047a0 con 0x7f3e2c100e20 2024-09-19T09:00:58.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.958+0000 7f3e30abe640 1 -- 172.21.15.19:0/3093717478 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e2c1a71a0 con 0x7f3e2c100e20 2024-09-19T09:00:58.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.960+0000 7f3e23fff640 1 -- 172.21.15.19:0/3093717478 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f3e1c0041d0 con 0x7f3e2c100e20 2024-09-19T09:00:58.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.961+0000 7f3e32e97740 1 Processor -- start 2024-09-19T09:00:58.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.961+0000 7f3e32e97740 1 -- start start 2024-09-19T09:00:58.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.961+0000 7f3e23fff640 1 --2- 172.21.15.19:0/3093717478 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3e180a3240 0x7f3e180a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:58.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.961+0000 7f3e32e97740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b9b7f3fb40 0x55b9b7f3e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:58.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.961+0000 7f3e32e97740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b9b7f3e5d0 0x55b9b7f3ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:58.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.961+0000 7f3e32e97740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b9b7f49370 0x55b9b7f4b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:58.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.961+0000 7f3e32e97740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b9b7ea42f0 con 0x55b9b7f3e5d0 2024-09-19T09:00:58.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.961+0000 7f3e32e97740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b9b7e4bcf0 con 0x55b9b7f49370 2024-09-19T09:00:58.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.961+0000 7f3e32e97740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b9b7ea02b0 con 0x55b9b7f3fb40 2024-09-19T09:00:58.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.961+0000 7f3e2ad9d640 1 --2- 172.21.15.19:0/3093717478 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3e180a3240 0x7f3e180a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:58.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.961+0000 7f3e23fff640 1 -- 172.21.15.19:0/3093717478 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f3e1c0cf2e0 con 0x7f3e2c100e20 2024-09-19T09:00:58.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.962+0000 7f3e21d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b9b7f3e5d0 0x55b9b7f3ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:58.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.962+0000 7f3e2ad9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b9b7f49370 0x55b9b7f4b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:58.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.962+0000 7f3e21d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b9b7f3e5d0 0x55b9b7f3ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33216/0 (socket says 172.21.15.19:33216) 2024-09-19T09:00:58.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.962+0000 7f3e2ad9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b9b7f49370 0x55b9b7f4b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:59062/0 (socket says 172.21.15.19:59062) 2024-09-19T09:00:58.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.962+0000 7f3e21d9b640 1 -- 172.21.15.19:0/110458536 learned_addr learned my addr 172.21.15.19:0/110458536 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:58.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.962+0000 7f3e2a59c640 1 --2- 172.21.15.19:0/110458536 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b9b7f3fb40 0x55b9b7f3e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:58.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.962+0000 7f3e21d9b640 1 -- 172.21.15.19:0/110458536 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b9b7f3fb40 msgr2=0x55b9b7f3e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:58.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.962+0000 7f3e21d9b640 1 --2- 172.21.15.19:0/110458536 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b9b7f3fb40 0x55b9b7f3e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.962+0000 7f3e21d9b640 1 -- 172.21.15.19:0/110458536 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b9b7f49370 msgr2=0x55b9b7f4b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:58.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.962+0000 7f3e21d9b640 1 --2- 172.21.15.19:0/110458536 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b9b7f49370 0x55b9b7f4b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.962+0000 7f3e21d9b640 1 -- 172.21.15.19:0/110458536 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9b7e303a0 con 0x55b9b7f3e5d0 2024-09-19T09:00:58.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.962+0000 7f3e2ad9d640 1 --2- 172.21.15.19:0/3093717478 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3e180a3240 0x7f3e180a5700 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3e24006010 tx=0x7f3e2402f430 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:58.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.962+0000 7f3e21d9b640 1 --2- 172.21.15.19:0/110458536 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b9b7f3e5d0 0x55b9b7f3ea10 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f3e1400cbd0 tx=0x7f3e1400e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c413307a7f74df4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:58.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.962+0000 7f3e20d99640 1 -- 172.21.15.19:0/110458536 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e14005220 con 0x55b9b7f3e5d0 2024-09-19T09:00:58.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.962+0000 7f3e20d99640 1 -- 172.21.15.19:0/110458536 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e14004c80 con 0x55b9b7f3e5d0 2024-09-19T09:00:58.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.962+0000 7f3e20d99640 1 -- 172.21.15.19:0/110458536 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e14010890 con 0x55b9b7f3e5d0 2024-09-19T09:00:58.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.963+0000 7f3e32e97740 1 -- 172.21.15.19:0/110458536 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b9b7f3e5d0 msgr2=0x55b9b7f3ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:58.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.963+0000 7f3e32e97740 1 --2- 172.21.15.19:0/110458536 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b9b7f3e5d0 0x55b9b7f3ea10 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f3e1400cbd0 tx=0x7f3e1400e720 comp rx=0 tx=0).stop 2024-09-19T09:00:58.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.963+0000 7f3e32e97740 1 -- 172.21.15.19:0/110458536 shutdown_connections 2024-09-19T09:00:58.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.963+0000 7f3e32e97740 1 --2- 172.21.15.19:0/110458536 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b9b7f49370 0x55b9b7f4b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.963+0000 7f3e32e97740 1 --2- 172.21.15.19:0/110458536 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b9b7f3e5d0 0x55b9b7f3ea10 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.963+0000 7f3e32e97740 1 --2- 172.21.15.19:0/110458536 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b9b7f3fb40 0x55b9b7f3e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.963+0000 7f3e32e97740 1 -- 172.21.15.19:0/110458536 >> 172.21.15.19:0/110458536 conn(0x55b9b7f07310 msgr2=0x55b9b7f3ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:58.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.963+0000 7f3e32e97740 1 -- 172.21.15.19:0/110458536 shutdown_connections 2024-09-19T09:00:58.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.963+0000 7f3e32e97740 1 -- 172.21.15.19:0/110458536 wait complete. 2024-09-19T09:00:58.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.964+0000 7f3e32e97740 1 -- start start 2024-09-19T09:00:58.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.964+0000 7f3e32e97740 1 Processor -- start 2024-09-19T09:00:58.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.964+0000 7f3e32e97740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b9b7f3e5d0 0x55b9b7f48d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:58.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.964+0000 7f3e32e97740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b9b7f3fb40 0x55b9b7f46020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:58.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.964+0000 7f3e32e97740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b9b7f49370 0x55b9b7f46610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:58.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.964+0000 7f3e32e97740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b9b7f4c070 con 0x55b9b7f49370 2024-09-19T09:00:58.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.964+0000 7f3e32e97740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b9b7e5f060 con 0x55b9b7f3fb40 2024-09-19T09:00:58.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.964+0000 7f3e32e97740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b9b7f4c1f0 con 0x55b9b7f3e5d0 2024-09-19T09:00:58.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.964+0000 7f3e32e97740 10 client.0 _ll_register_callbacks cb 0x55b9b7bb28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:58.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.964+0000 7f3e2ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b9b7f49370 0x55b9b7f46610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:58.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.964+0000 7f3e2ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b9b7f49370 0x55b9b7f46610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33232/0 (socket says 172.21.15.19:33232) 2024-09-19T09:00:58.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.964+0000 7f3e21d9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b9b7f3fb40 0x55b9b7f46020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:58.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.964+0000 7f3e2ad9d640 1 -- 172.21.15.19:0/2517411404 learned_addr learned my addr 172.21.15.19:0/2517411404 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:58.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.964+0000 7f3e2a59c640 1 --2- 172.21.15.19:0/2517411404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b9b7f3e5d0 0x55b9b7f48d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:58.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.964+0000 7f3e2ad9d640 1 -- 172.21.15.19:0/2517411404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b9b7f3e5d0 msgr2=0x55b9b7f48d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:58.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.964+0000 7f3e2ad9d640 1 --2- 172.21.15.19:0/2517411404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b9b7f3e5d0 0x55b9b7f48d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.964+0000 7f3e2ad9d640 1 -- 172.21.15.19:0/2517411404 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b9b7f3fb40 msgr2=0x55b9b7f46020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:58.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.964+0000 7f3e2ad9d640 1 --2- 172.21.15.19:0/2517411404 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b9b7f3fb40 0x55b9b7f46020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.964+0000 7f3e2ad9d640 1 -- 172.21.15.19:0/2517411404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9b7c153c0 con 0x55b9b7f49370 2024-09-19T09:00:58.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.964+0000 7f3e2a59c640 1 --2- 172.21.15.19:0/2517411404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b9b7f3e5d0 0x55b9b7f48d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:00:58.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.964+0000 7f3e21d9b640 1 --2- 172.21.15.19:0/2517411404 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b9b7f3fb40 0x55b9b7f46020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:00:58.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.965+0000 7f3e2ad9d640 1 --2- 172.21.15.19:0/2517411404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b9b7f49370 0x55b9b7f46610 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f3e24009890 tx=0x7f3e24048000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac3bc6ee602a8c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:58.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.965+0000 7f3e11ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:00:58.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.965+0000 7f3e11ffb640 1 -- 172.21.15.19:0/2517411404 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e24034040 con 0x55b9b7f49370 2024-09-19T09:00:58.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.965+0000 7f3e11ffb640 1 -- 172.21.15.19:0/2517411404 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f3e2404a670 con 0x55b9b7f49370 2024-09-19T09:00:58.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.965+0000 7f3e32e97740 1 -- 172.21.15.19:0/2517411404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3e14004c80 con 0x55b9b7f49370 2024-09-19T09:00:58.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.965+0000 7f3e11ffb640 1 -- 172.21.15.19:0/2517411404 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f3e2402fe80 con 0x55b9b7f49370 2024-09-19T09:00:58.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.965+0000 7f3e32e97740 10 client.17400 fetch_fsmap learned FSMap version 36 2024-09-19T09:00:58.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.965+0000 7f3e32e97740 1 -- 172.21.15.19:0/2517411404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55b9b7f57b40 con 0x55b9b7f49370 2024-09-19T09:00:58.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.965+0000 7f3e11ffb640 1 -- 172.21.15.19:0/2517411404 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e14004c80 con 0x55b9b7f49370 2024-09-19T09:00:58.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.965+0000 7f3e11ffb640 1 -- 172.21.15.19:0/2517411404 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f3e240056f0 con 0x55b9b7f49370 2024-09-19T09:00:58.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.965+0000 7f3e32e97740 10 client.17400 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:00:58.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.965+0000 7f3e32e97740 10 client.17400 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:00:58.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.965+0000 7f3e32e97740 20 client.17400 populate_metadata read hostname 'smithi019' 2024-09-19T09:00:58.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.965+0000 7f3e32e97740 1 --2- 172.21.15.19:0/2517411404 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b9b7f59000 0x55b9b7f5b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:58.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.965+0000 7f3e32e97740 4 client.17400 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:00:58.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.965+0000 7f3e32e97740 1 -- 172.21.15.19:0/2517411404 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9b7eb1860 con 0x55b9b7f59000 2024-09-19T09:00:58.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.966+0000 7f3e2a59c640 1 --2- 172.21.15.19:0/2517411404 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b9b7f59000 0x55b9b7f5b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:58.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.966+0000 7f3e11ffb640 10 client.17400 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:00:58.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:57.966+0000 7f3e2a59c640 1 --2- 172.21.15.19:0/2517411404 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b9b7f59000 0x55b9b7f5b410 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c74c51feaa084bfc server_cookie=7e69a12217ff0563 in_seq=0 out_seq=0 2024-09-19T09:00:58.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.105+0000 7f3e11ffb640 1 -- 172.21.15.19:0/2517411404 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b9b7eb1860 con 0x55b9b7f59000 2024-09-19T09:00:58.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.105+0000 7f3e11ffb640 10 client.17400 handle_command_reply: tid=0 2024-09-19T09:00:58.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.105+0000 7f3e32e97740 1 client.17400 shutdown 2024-09-19T09:00:58.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.105+0000 7f3e32e97740 1 -- 172.21.15.19:0/2517411404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b9b7f49370 msgr2=0x55b9b7f46610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:58.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.105+0000 7f3e32e97740 1 --2- 172.21.15.19:0/2517411404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b9b7f49370 0x55b9b7f46610 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f3e24009890 tx=0x7f3e24048000 comp rx=0 tx=0).stop 2024-09-19T09:00:58.186 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:00:58.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.105+0000 7f3e32e97740 1 -- 172.21.15.19:0/2517411404 shutdown_connections 2024-09-19T09:00:58.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.105+0000 7f3e32e97740 1 --2- 172.21.15.19:0/2517411404 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b9b7f59000 0x55b9b7f5b410 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.105+0000 7f3e32e97740 1 --2- 172.21.15.19:0/2517411404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b9b7f49370 0x55b9b7f46610 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.105+0000 7f3e32e97740 1 --2- 172.21.15.19:0/2517411404 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b9b7f3fb40 0x55b9b7f46020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.105+0000 7f3e11ffb640 0 client.17400 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:00:58.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.105+0000 7f3e32e97740 1 --2- 172.21.15.19:0/2517411404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b9b7f3e5d0 0x55b9b7f48d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.105+0000 7f3e32e97740 1 -- 172.21.15.19:0/2517411404 >> 172.21.15.19:0/2517411404 conn(0x55b9b7f07310 msgr2=0x55b9b7f40930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:58.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.105+0000 7f3e32e97740 1 -- 172.21.15.19:0/2517411404 shutdown_connections 2024-09-19T09:00:58.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.105+0000 7f3e32e97740 1 -- 172.21.15.19:0/2517411404 wait complete. 2024-09-19T09:00:58.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.105+0000 7f3e32e97740 20 client.17400 trim_cache size 0 max 16384 2024-09-19T09:00:58.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.118+0000 7f3e32e97740 1 Processor -- start 2024-09-19T09:00:58.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.118+0000 7f3e32e97740 1 -- start start 2024-09-19T09:00:58.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.118+0000 7f3e32e97740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b9b7f3e5d0 0x55b9b7f458e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:58.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.118+0000 7f3e32e97740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b9b7f3fb40 0x55b9b7f47f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:58.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.118+0000 7f3e32e97740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b9b7f49370 0x55b9b7f41120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:58.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.118+0000 7f3e32e97740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c1af7a0 con 0x55b9b7f49370 2024-09-19T09:00:58.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.118+0000 7f3e32e97740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c1b12e0 con 0x55b9b7f3fb40 2024-09-19T09:00:58.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.118+0000 7f3e32e97740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c1afe70 con 0x55b9b7f3e5d0 2024-09-19T09:00:58.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.119+0000 7f3e2ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b9b7f49370 0x55b9b7f41120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:58.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.119+0000 7f3e2ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b9b7f49370 0x55b9b7f41120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33246/0 (socket says 172.21.15.19:33246) 2024-09-19T09:00:58.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.119+0000 7f3e2ad9d640 1 -- 172.21.15.19:0/1562581480 learned_addr learned my addr 172.21.15.19:0/1562581480 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:58.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.119+0000 7f3e21d9b640 1 --2- 172.21.15.19:0/1562581480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b9b7f3fb40 0x55b9b7f47f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:58.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.119+0000 7f3e2a59c640 1 --2- 172.21.15.19:0/1562581480 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b9b7f3e5d0 0x55b9b7f458e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:58.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.119+0000 7f3e2ad9d640 1 -- 172.21.15.19:0/1562581480 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b9b7f3e5d0 msgr2=0x55b9b7f458e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:58.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.119+0000 7f3e2ad9d640 1 --2- 172.21.15.19:0/1562581480 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b9b7f3e5d0 0x55b9b7f458e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.119+0000 7f3e2ad9d640 1 -- 172.21.15.19:0/1562581480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b9b7f3fb40 msgr2=0x55b9b7f47f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:58.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.119+0000 7f3e2ad9d640 1 --2- 172.21.15.19:0/1562581480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b9b7f3fb40 0x55b9b7f47f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.119+0000 7f3e2ad9d640 1 -- 172.21.15.19:0/1562581480 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9b7f44fd0 con 0x55b9b7f49370 2024-09-19T09:00:58.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.119+0000 7f3e2ad9d640 1 --2- 172.21.15.19:0/1562581480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b9b7f49370 0x55b9b7f41120 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f3e24005e30 tx=0x7f3e2403b740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e91fcf38ab16fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:58.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.119+0000 7f3e13fff640 1 -- 172.21.15.19:0/1562581480 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e24034070 con 0x55b9b7f49370 2024-09-19T09:00:58.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.119+0000 7f3e13fff640 1 -- 172.21.15.19:0/1562581480 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3e24003b20 con 0x55b9b7f49370 2024-09-19T09:00:58.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.119+0000 7f3e13fff640 1 -- 172.21.15.19:0/1562581480 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e2404acf0 con 0x55b9b7f49370 2024-09-19T09:00:58.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.120+0000 7f3e32e97740 1 -- 172.21.15.19:0/1562581480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b9b7f49370 msgr2=0x55b9b7f41120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:58.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.120+0000 7f3e32e97740 1 --2- 172.21.15.19:0/1562581480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b9b7f49370 0x55b9b7f41120 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f3e24005e30 tx=0x7f3e2403b740 comp rx=0 tx=0).stop 2024-09-19T09:00:58.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.120+0000 7f3e32e97740 1 -- 172.21.15.19:0/1562581480 shutdown_connections 2024-09-19T09:00:58.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.120+0000 7f3e32e97740 1 --2- 172.21.15.19:0/1562581480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b9b7f49370 0x55b9b7f41120 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.120+0000 7f3e32e97740 1 --2- 172.21.15.19:0/1562581480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b9b7f3fb40 0x55b9b7f47f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.120+0000 7f3e32e97740 1 --2- 172.21.15.19:0/1562581480 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b9b7f3e5d0 0x55b9b7f458e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.120+0000 7f3e32e97740 1 -- 172.21.15.19:0/1562581480 >> 172.21.15.19:0/1562581480 conn(0x55b9b7f07310 msgr2=0x55b9b7f47880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:58.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.120+0000 7f3e32e97740 1 -- 172.21.15.19:0/1562581480 shutdown_connections 2024-09-19T09:00:58.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.120+0000 7f3e32e97740 1 -- 172.21.15.19:0/1562581480 wait complete. 2024-09-19T09:00:58.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.121+0000 7f3e32e97740 1 -- start start 2024-09-19T09:00:58.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.121+0000 7f3e32e97740 1 Processor -- start 2024-09-19T09:00:58.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.121+0000 7f3e32e97740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b9b7f3e5d0 0x55b9b7f519e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:58.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.121+0000 7f3e32e97740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b9b7f3fb40 0x55b9b7f42ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:58.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.121+0000 7f3e32e97740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b9b7f49370 0x55b9b7f43000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:58.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.121+0000 7f3e32e97740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c1b0c10 con 0x55b9b7f3e5d0 2024-09-19T09:00:58.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.121+0000 7f3e32e97740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c1b0540 con 0x55b9b7f49370 2024-09-19T09:00:58.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.121+0000 7f3e32e97740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3e2c1ad780 con 0x55b9b7f3fb40 2024-09-19T09:00:58.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.121+0000 7f3e32e97740 10 client.0 _ll_register_callbacks cb 0x7f3e240099e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:00:58.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.121+0000 7f3e2a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b9b7f3e5d0 0x55b9b7f519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:58.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.121+0000 7f3e2a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b9b7f3e5d0 0x55b9b7f519e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33262/0 (socket says 172.21.15.19:33262) 2024-09-19T09:00:58.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.121+0000 7f3e2ad9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b9b7f49370 0x55b9b7f43000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:58.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.121+0000 7f3e2a59c640 1 -- 172.21.15.19:0/2448520541 learned_addr learned my addr 172.21.15.19:0/2448520541 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:00:58.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.122+0000 7f3e21d9b640 1 --2- 172.21.15.19:0/2448520541 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b9b7f3fb40 0x55b9b7f42ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:58.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.122+0000 7f3e2a59c640 1 -- 172.21.15.19:0/2448520541 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b9b7f3fb40 msgr2=0x55b9b7f42ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:58.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.122+0000 7f3e2a59c640 1 --2- 172.21.15.19:0/2448520541 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b9b7f3fb40 0x55b9b7f42ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.122+0000 7f3e2a59c640 1 -- 172.21.15.19:0/2448520541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b9b7f49370 msgr2=0x55b9b7f43000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:00:58.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.122+0000 7f3e2a59c640 1 --2- 172.21.15.19:0/2448520541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b9b7f49370 0x55b9b7f43000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.122+0000 7f3e2a59c640 1 -- 172.21.15.19:0/2448520541 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9b7f435f0 con 0x55b9b7f3e5d0 2024-09-19T09:00:58.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.122+0000 7f3e21d9b640 1 --2- 172.21.15.19:0/2448520541 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b9b7f3fb40 0x55b9b7f42ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:00:58.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.122+0000 7f3e2a59c640 1 --2- 172.21.15.19:0/2448520541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b9b7f3e5d0 0x55b9b7f519e0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c0982e0 tx=0x7f3e1c00d8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b2f6be33fec0ece server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:00:58.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.122+0000 7f3e11ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:00:58.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.122+0000 7f3e11ffb640 1 -- 172.21.15.19:0/2448520541 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c0a4580 con 0x55b9b7f3e5d0 2024-09-19T09:00:58.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.122+0000 7f3e11ffb640 1 -- 172.21.15.19:0/2448520541 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f3e1c099c10 con 0x55b9b7f3e5d0 2024-09-19T09:00:58.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.122+0000 7f3e32e97740 1 -- 172.21.15.19:0/2448520541 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b9b7eabd70 con 0x55b9b7f3e5d0 2024-09-19T09:00:58.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.122+0000 7f3e11ffb640 1 -- 172.21.15.19:0/2448520541 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f3e1c0c01f0 con 0x55b9b7f3e5d0 2024-09-19T09:00:58.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.122+0000 7f3e32e97740 10 client.17406 fetch_fsmap learned FSMap version 36 2024-09-19T09:00:58.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.122+0000 7f3e32e97740 1 -- 172.21.15.19:0/2448520541 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55b9b7fc3a90 con 0x55b9b7f3e5d0 2024-09-19T09:00:58.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.122+0000 7f3e11ffb640 1 -- 172.21.15.19:0/2448520541 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55b9b7eabd70 con 0x55b9b7f3e5d0 2024-09-19T09:00:58.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.123+0000 7f3e11ffb640 1 -- 172.21.15.19:0/2448520541 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f3e1c09a7d0 con 0x55b9b7f3e5d0 2024-09-19T09:00:58.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.123+0000 7f3e32e97740 10 client.17406 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:00:58.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.123+0000 7f3e32e97740 10 client.17406 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:00:58.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.123+0000 7f3e32e97740 20 client.17406 populate_metadata read hostname 'smithi019' 2024-09-19T09:00:58.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.123+0000 7f3e32e97740 1 --2- 172.21.15.19:0/2448520541 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b9b7fc4160 0x55b9b7fc6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:00:58.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.123+0000 7f3e32e97740 4 client.17406 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:00:58.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.123+0000 7f3e32e97740 1 -- 172.21.15.19:0/2448520541 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b9b7e28170 con 0x55b9b7fc4160 2024-09-19T09:00:58.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.123+0000 7f3e21d9b640 1 --2- 172.21.15.19:0/2448520541 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b9b7fc4160 0x55b9b7fc6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:00:58.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.123+0000 7f3e11ffb640 10 client.17406 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:00:58.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.124+0000 7f3e21d9b640 1 --2- 172.21.15.19:0/2448520541 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b9b7fc4160 0x55b9b7fc6550 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73644fb9afccb6ba server_cookie=10c612f1b4f3612a in_seq=0 out_seq=0 2024-09-19T09:00:58.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.126+0000 7f3e11ffb640 1 -- 172.21.15.19:0/2448520541 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b9b7e28170 con 0x55b9b7fc4160 2024-09-19T09:00:58.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.126+0000 7f3e11ffb640 10 client.17406 handle_command_reply: tid=0 2024-09-19T09:00:58.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.126+0000 7f3e32e97740 1 client.17406 shutdown 2024-09-19T09:00:58.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.126+0000 7f3e32e97740 1 -- 172.21.15.19:0/2448520541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b9b7f3e5d0 msgr2=0x55b9b7f519e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:58.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.126+0000 7f3e32e97740 1 --2- 172.21.15.19:0/2448520541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b9b7f3e5d0 0x55b9b7f519e0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c0982e0 tx=0x7f3e1c00d8d0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.126+0000 7f3e32e97740 1 -- 172.21.15.19:0/2448520541 shutdown_connections 2024-09-19T09:00:58.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.126+0000 7f3e32e97740 1 --2- 172.21.15.19:0/2448520541 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b9b7fc4160 0x55b9b7fc6550 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.126+0000 7f3e32e97740 1 --2- 172.21.15.19:0/2448520541 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b9b7f3fb40 0x55b9b7f42ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.126+0000 7f3e11ffb640 0 client.17406 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:00:58.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.126+0000 7f3e32e97740 1 --2- 172.21.15.19:0/2448520541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b9b7f49370 0x55b9b7f43000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.126+0000 7f3e32e97740 1 --2- 172.21.15.19:0/2448520541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b9b7f3e5d0 0x55b9b7f519e0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.126+0000 7f3e32e97740 1 -- 172.21.15.19:0/2448520541 >> 172.21.15.19:0/2448520541 conn(0x55b9b7f07310 msgr2=0x55b9b7f480a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:58.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.126+0000 7f3e32e97740 1 -- 172.21.15.19:0/2448520541 shutdown_connections 2024-09-19T09:00:58.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.126+0000 7f3e32e97740 1 -- 172.21.15.19:0/2448520541 wait complete. 2024-09-19T09:00:58.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.126+0000 7f3e32e97740 20 client.17406 trim_cache size 0 max 16384 2024-09-19T09:00:58.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.127+0000 7f3e30abe640 1 -- 172.21.15.19:0/3093717478 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3e180a3240 msgr2=0x7f3e180a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:58.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.127+0000 7f3e30abe640 1 --2- 172.21.15.19:0/3093717478 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3e180a3240 0x7f3e180a5700 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3e24006010 tx=0x7f3e2402f430 comp rx=0 tx=0).stop 2024-09-19T09:00:58.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.127+0000 7f3e30abe640 1 -- 172.21.15.19:0/3093717478 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e2c100e20 msgr2=0x7f3e2c0fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:00:58.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.127+0000 7f3e30abe640 1 --2- 172.21.15.19:0/3093717478 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e2c100e20 0x7f3e2c0fcc80 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c00d950 tx=0x7f3e1c00de10 comp rx=0 tx=0).stop 2024-09-19T09:00:58.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.127+0000 7f3e30abe640 1 -- 172.21.15.19:0/3093717478 shutdown_connections 2024-09-19T09:00:58.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.127+0000 7f3e30abe640 1 --2- 172.21.15.19:0/3093717478 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f3e180a3240 0x7f3e180a5700 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.127+0000 7f3e30abe640 1 --2- 172.21.15.19:0/3093717478 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e2c102570 0x7f3e2c0fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.127+0000 7f3e30abe640 1 --2- 172.21.15.19:0/3093717478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3e2c102ef0 0x7f3e2c0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.127+0000 7f3e30abe640 1 --2- 172.21.15.19:0/3093717478 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3e2c100e20 0x7f3e2c0fcc80 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:00:58.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.127+0000 7f3e30abe640 1 -- 172.21.15.19:0/3093717478 >> 172.21.15.19:0/3093717478 conn(0x7f3e2c0fc7d0 msgr2=0x7f3e2c06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:00:58.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.127+0000 7f3e30abe640 1 -- 172.21.15.19:0/3093717478 shutdown_connections 2024-09-19T09:00:58.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:00:58.127+0000 7f3e30abe640 1 -- 172.21.15.19:0/3093717478 wait complete. 2024-09-19T09:00:58.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:57 smithi203 ceph-mon[35450]: pgmap v599: 97 pgs: 97 active+clean; 15 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 726 KiB/s rd, 764 KiB/s wr, 311 op/s 2024-09-19T09:01:00.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:00:59 smithi155 ceph-mon[34921]: pgmap v600: 97 pgs: 97 active+clean; 16 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 894 KiB/s rd, 895 KiB/s wr, 363 op/s 2024-09-19T09:01:00.220 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:01:00.220 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:01:00.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:00:59 smithi203 ceph-mon[35450]: pgmap v600: 97 pgs: 97 active+clean; 16 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 894 KiB/s rd, 895 KiB/s wr, 363 op/s 2024-09-19T09:01:00.250 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:00:59 smithi019 ceph-mon[30976]: pgmap v600: 97 pgs: 97 active+clean; 16 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 894 KiB/s rd, 895 KiB/s wr, 363 op/s 2024-09-19T09:01:00.494 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.965+0000 7f05ea557640 1 -- 172.21.15.19:0/3052974226 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05e41082a0 msgr2=0x7f05e410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.965+0000 7f05ea557640 1 --2- 172.21.15.19:0/3052974226 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05e41082a0 0x7f05e410ec40 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f05dc009cd0 tx=0x7f05dc02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:01:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.965+0000 7f05ea557640 1 -- 172.21.15.19:0/3052974226 shutdown_connections 2024-09-19T09:01:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.965+0000 7f05ea557640 1 --2- 172.21.15.19:0/3052974226 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05e41082a0 0x7f05e410ec40 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.965+0000 7f05ea557640 1 --2- 172.21.15.19:0/3052974226 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05e41036e0 0x7f05e4107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:00.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.965+0000 7f05ea557640 1 --2- 172.21.15.19:0/3052974226 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05e4102d30 0x7f05e4103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.965+0000 7f05ea557640 1 -- 172.21.15.19:0/3052974226 >> 172.21.15.19:0/3052974226 conn(0x7f05e40fc7d0 msgr2=0x7f05e40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.965+0000 7f05ea557640 1 -- 172.21.15.19:0/3052974226 shutdown_connections 2024-09-19T09:01:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.965+0000 7f05ea557640 1 -- 172.21.15.19:0/3052974226 wait complete. 2024-09-19T09:01:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.966+0000 7f05ea557640 1 Processor -- start 2024-09-19T09:01:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.966+0000 7f05ea557640 1 -- start start 2024-09-19T09:01:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.966+0000 7f05ea557640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05e4102d30 0x7f05e4198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.966+0000 7f05ea557640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05e41036e0 0x7f05e4198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.966+0000 7f05ea557640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05e41082a0 0x7f05e419ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.966+0000 7f05ea557640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f05e41120a0 con 0x7f05e4102d30 2024-09-19T09:01:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.966+0000 7f05ea557640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f05e4111f20 con 0x7f05e41082a0 2024-09-19T09:01:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.966+0000 7f05ea557640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f05e4112220 con 0x7f05e41036e0 2024-09-19T09:01:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.966+0000 7f05e3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05e4102d30 0x7f05e4198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:00.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.966+0000 7f05e3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05e4102d30 0x7f05e4198570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33274/0 (socket says 172.21.15.19:33274) 2024-09-19T09:01:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.966+0000 7f05e3fff640 1 -- 172.21.15.19:0/764036795 learned_addr learned my addr 172.21.15.19:0/764036795 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.966+0000 7f05e8af4640 1 --2- 172.21.15.19:0/764036795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05e41082a0 0x7f05e419ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.966+0000 7f05dbfff640 1 --2- 172.21.15.19:0/764036795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05e41036e0 0x7f05e4198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.966+0000 7f05e3fff640 1 -- 172.21.15.19:0/764036795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05e41036e0 msgr2=0x7f05e4198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.966+0000 7f05e3fff640 1 --2- 172.21.15.19:0/764036795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05e41036e0 0x7f05e4198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.966+0000 7f05e3fff640 1 -- 172.21.15.19:0/764036795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05e41082a0 msgr2=0x7f05e419ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.966+0000 7f05e3fff640 1 --2- 172.21.15.19:0/764036795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05e41082a0 0x7f05e419ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.966+0000 7f05e3fff640 1 -- 172.21.15.19:0/764036795 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e419d520 con 0x7f05e4102d30 2024-09-19T09:01:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.966+0000 7f05dbfff640 1 --2- 172.21.15.19:0/764036795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05e41036e0 0x7f05e4198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:01:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.966+0000 7f05e3fff640 1 --2- 172.21.15.19:0/764036795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05e4102d30 0x7f05e4198570 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f05d400d770 tx=0x7f05d400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.967+0000 7f05e1ffb640 1 -- 172.21.15.19:0/764036795 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4017070 con 0x7f05e4102d30 2024-09-19T09:01:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.967+0000 7f05ea557640 1 -- 172.21.15.19:0/764036795 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05e419d810 con 0x7f05e4102d30 2024-09-19T09:01:00.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.967+0000 7f05e1ffb640 1 -- 172.21.15.19:0/764036795 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05d4005500 con 0x7f05e4102d30 2024-09-19T09:01:00.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.967+0000 7f05e1ffb640 1 -- 172.21.15.19:0/764036795 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4004e00 con 0x7f05e4102d30 2024-09-19T09:01:00.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.967+0000 7f05ea557640 1 -- 172.21.15.19:0/764036795 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05e41a50f0 con 0x7f05e4102d30 2024-09-19T09:01:00.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.969+0000 7f05e1ffb640 1 -- 172.21.15.19:0/764036795 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f05d4004fa0 con 0x7f05e4102d30 2024-09-19T09:01:00.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.969+0000 7f05ec930740 1 Processor -- start 2024-09-19T09:01:00.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.969+0000 7f05ec930740 1 -- start start 2024-09-19T09:01:00.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.969+0000 7f05ec930740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556432c0db60 0x556432c0df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:00.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.969+0000 7f05ec930740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556432c0e480 0x556432c18800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:00.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.969+0000 7f05ec930740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556432c18d40 0x556432c1b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:00.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.969+0000 7f05ec930740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556432b73280 con 0x556432c18d40 2024-09-19T09:01:00.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.969+0000 7f05ec930740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x556432b1ab10 con 0x556432c0db60 2024-09-19T09:01:00.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.969+0000 7f05ec930740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x556432b6f240 con 0x556432c0e480 2024-09-19T09:01:00.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.970+0000 7f05dbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556432c18d40 0x556432c1b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:00.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.970+0000 7f05e8af4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556432c0db60 0x556432c0df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:00.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.970+0000 7f05dbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556432c18d40 0x556432c1b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33290/0 (socket says 172.21.15.19:33290) 2024-09-19T09:01:00.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.970+0000 7f05dbfff640 1 -- 172.21.15.19:0/3355621476 learned_addr learned my addr 172.21.15.19:0/3355621476 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:00.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.970+0000 7f05e1ffb640 1 --2- 172.21.15.19:0/764036795 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f05d00a3240 0x7f05d00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:00.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.970+0000 7f05e3fff640 1 --2- 172.21.15.19:0/3355621476 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556432c0e480 0x556432c18800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:00.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.970+0000 7f05dbfff640 1 -- 172.21.15.19:0/3355621476 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556432c0e480 msgr2=0x556432c18800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:00.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.970+0000 7f05dbfff640 1 --2- 172.21.15.19:0/3355621476 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556432c0e480 0x556432c18800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:00.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.970+0000 7f05dbfff640 1 -- 172.21.15.19:0/3355621476 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556432c0db60 msgr2=0x556432c0df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:00.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.970+0000 7f05dbfff640 1 --2- 172.21.15.19:0/3355621476 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556432c0db60 0x556432c0df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:00.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.970+0000 7f05dbfff640 1 -- 172.21.15.19:0/3355621476 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556432b271f0 con 0x556432c18d40 2024-09-19T09:01:00.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.970+0000 7f05e8af4640 1 --2- 172.21.15.19:0/3355621476 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556432c0db60 0x556432c0df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:00.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.970+0000 7f05e8af4640 1 --2- 172.21.15.19:0/764036795 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f05d00a3240 0x7f05d00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:00.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.970+0000 7f05e1ffb640 1 -- 172.21.15.19:0/764036795 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f05d40cf390 con 0x7f05e4102d30 2024-09-19T09:01:00.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.970+0000 7f05dbfff640 1 --2- 172.21.15.19:0/3355621476 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556432c18d40 0x556432c1b130 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f05cc009b30 tx=0x7f05cc00e2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fe2d9ff0d218730 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:00.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.970+0000 7f05da7fc640 1 -- 172.21.15.19:0/3355621476 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05cc016070 con 0x556432c18d40 2024-09-19T09:01:00.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.970+0000 7f05da7fc640 1 -- 172.21.15.19:0/3355621476 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05cc005500 con 0x556432c18d40 2024-09-19T09:01:00.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.970+0000 7f05da7fc640 1 -- 172.21.15.19:0/3355621476 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05cc011470 con 0x556432c18d40 2024-09-19T09:01:00.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.971+0000 7f05ec930740 1 -- 172.21.15.19:0/3355621476 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556432c18d40 msgr2=0x556432c1b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:00.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.971+0000 7f05e8af4640 1 --2- 172.21.15.19:0/764036795 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f05d00a3240 0x7f05d00a5700 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f05dc004ab0 tx=0x7f05dc0095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:00.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.971+0000 7f05ec930740 1 --2- 172.21.15.19:0/3355621476 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556432c18d40 0x556432c1b130 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f05cc009b30 tx=0x7f05cc00e2f0 comp rx=0 tx=0).stop 2024-09-19T09:01:00.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.971+0000 7f05ec930740 1 -- 172.21.15.19:0/3355621476 shutdown_connections 2024-09-19T09:01:00.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.971+0000 7f05ec930740 1 --2- 172.21.15.19:0/3355621476 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556432c0e480 0x556432c18800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:00.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.971+0000 7f05ec930740 1 --2- 172.21.15.19:0/3355621476 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556432c18d40 0x556432c1b130 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:00.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.971+0000 7f05ec930740 1 --2- 172.21.15.19:0/3355621476 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556432c0db60 0x556432c0df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:00.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.971+0000 7f05ec930740 1 -- 172.21.15.19:0/3355621476 >> 172.21.15.19:0/3355621476 conn(0x556432c0a0f0 msgr2=0x556432c0a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:00.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.971+0000 7f05ec930740 1 -- 172.21.15.19:0/3355621476 shutdown_connections 2024-09-19T09:01:00.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.971+0000 7f05ec930740 1 -- 172.21.15.19:0/3355621476 wait complete. 2024-09-19T09:01:00.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.971+0000 7f05ec930740 1 -- start start 2024-09-19T09:01:00.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.972+0000 7f05ec930740 1 Processor -- start 2024-09-19T09:01:00.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.972+0000 7f05ec930740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556432c0db60 0x556432c187f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:00.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.972+0000 7f05ec930740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556432c0e480 0x556432c15b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:00.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.972+0000 7f05ec930740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556432c18d40 0x556432c162d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:00.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.972+0000 7f05ec930740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x556432c1b910 con 0x556432c0e480 2024-09-19T09:01:00.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.972+0000 7f05ec930740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x556432b2df10 con 0x556432c18d40 2024-09-19T09:01:00.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.972+0000 7f05ec930740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x556432c1ba90 con 0x556432c0db60 2024-09-19T09:01:00.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.972+0000 7f05ec930740 10 client.0 _ll_register_callbacks cb 0x556432af6a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:00.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.972+0000 7f05dbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556432c0e480 0x556432c15b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:00.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.972+0000 7f05dbfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556432c0e480 0x556432c15b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33306/0 (socket says 172.21.15.19:33306) 2024-09-19T09:01:00.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.972+0000 7f05dbfff640 1 -- 172.21.15.19:0/436955218 learned_addr learned my addr 172.21.15.19:0/436955218 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:00.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.972+0000 7f05e8af4640 1 --2- 172.21.15.19:0/436955218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556432c18d40 0x556432c162d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:00.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.972+0000 7f05e3fff640 1 --2- 172.21.15.19:0/436955218 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556432c0db60 0x556432c187f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:00.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.972+0000 7f05dbfff640 1 -- 172.21.15.19:0/436955218 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556432c0db60 msgr2=0x556432c187f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:00.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.972+0000 7f05dbfff640 1 --2- 172.21.15.19:0/436955218 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556432c0db60 0x556432c187f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:00.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.972+0000 7f05dbfff640 1 -- 172.21.15.19:0/436955218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556432c18d40 msgr2=0x556432c162d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:00.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.972+0000 7f05dbfff640 1 --2- 172.21.15.19:0/436955218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556432c18d40 0x556432c162d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:00.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.972+0000 7f05dbfff640 1 -- 172.21.15.19:0/436955218 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564328e46a0 con 0x556432c0e480 2024-09-19T09:01:00.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.973+0000 7f05dbfff640 1 --2- 172.21.15.19:0/436955218 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556432c0e480 0x556432c15b40 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f05cc000c00 tx=0x7f05cc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4edec8e5cd351bfc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:00.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.973+0000 7f05c37fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:01:00.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.973+0000 7f05c37fe640 1 -- 172.21.15.19:0/436955218 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05cc016040 con 0x556432c0e480 2024-09-19T09:01:00.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.973+0000 7f05c37fe640 1 -- 172.21.15.19:0/436955218 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f05cc004020 con 0x556432c0e480 2024-09-19T09:01:00.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.973+0000 7f05ec930740 1 -- 172.21.15.19:0/436955218 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05cc005500 con 0x556432c0e480 2024-09-19T09:01:00.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.973+0000 7f05c37fe640 1 -- 172.21.15.19:0/436955218 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f05cc009730 con 0x556432c0e480 2024-09-19T09:01:00.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.973+0000 7f05ec930740 10 client.17418 fetch_fsmap learned FSMap version 36 2024-09-19T09:01:00.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.973+0000 7f05ec930740 1 -- 172.21.15.19:0/436955218 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x556432c27440 con 0x556432c0e480 2024-09-19T09:01:00.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.973+0000 7f05c37fe640 1 -- 172.21.15.19:0/436955218 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05cc005500 con 0x556432c0e480 2024-09-19T09:01:00.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.973+0000 7f05c37fe640 1 -- 172.21.15.19:0/436955218 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f05cc00f040 con 0x556432c0e480 2024-09-19T09:01:00.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.973+0000 7f05ec930740 10 client.17418 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:01:00.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.973+0000 7f05ec930740 10 client.17418 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:01:00.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.973+0000 7f05ec930740 20 client.17418 populate_metadata read hostname 'smithi019' 2024-09-19T09:01:00.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.973+0000 7f05ec930740 1 --2- 172.21.15.19:0/436955218 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x556432c287f0 0x556432c2abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:00.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.973+0000 7f05ec930740 4 client.17418 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:01:00.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.973+0000 7f05ec930740 1 -- 172.21.15.19:0/436955218 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556432b807f0 con 0x556432c287f0 2024-09-19T09:01:00.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.974+0000 7f05e3fff640 1 --2- 172.21.15.19:0/436955218 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x556432c287f0 0x556432c2abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:00.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.974+0000 7f05c37fe640 10 client.17418 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:00.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:00.974+0000 7f05e3fff640 1 --2- 172.21.15.19:0/436955218 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x556432c287f0 0x556432c2abe0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9dcbe60973a9c8a6 server_cookie=a44b4728032ebf47 in_seq=0 out_seq=0 2024-09-19T09:01:01.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.250+0000 7f05c37fe640 1 -- 172.21.15.19:0/436955218 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556432b807f0 con 0x556432c287f0 2024-09-19T09:01:01.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.250+0000 7f05c37fe640 10 client.17418 handle_command_reply: tid=0 2024-09-19T09:01:01.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.251+0000 7f05ec930740 1 client.17418 shutdown 2024-09-19T09:01:01.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.251+0000 7f05ec930740 1 -- 172.21.15.19:0/436955218 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556432c0e480 msgr2=0x556432c15b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:01.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.251+0000 7f05ec930740 1 --2- 172.21.15.19:0/436955218 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556432c0e480 0x556432c15b40 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f05cc000c00 tx=0x7f05cc0048f0 comp rx=0 tx=0).stop 2024-09-19T09:01:01.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.251+0000 7f05ec930740 1 -- 172.21.15.19:0/436955218 shutdown_connections 2024-09-19T09:01:01.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.251+0000 7f05ec930740 1 --2- 172.21.15.19:0/436955218 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x556432c287f0 0x556432c2abe0 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:01.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.251+0000 7f05ec930740 1 --2- 172.21.15.19:0/436955218 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556432c18d40 0x556432c162d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:01.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.251+0000 7f05ec930740 1 --2- 172.21.15.19:0/436955218 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556432c0e480 0x556432c15b40 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:01.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.251+0000 7f05ec930740 1 --2- 172.21.15.19:0/436955218 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556432c0db60 0x556432c187f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:01.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.251+0000 7f05c37fe640 0 client.17418 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:01.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.251+0000 7f05ec930740 1 -- 172.21.15.19:0/436955218 >> 172.21.15.19:0/436955218 conn(0x556432c0a0f0 msgr2=0x556432c0fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:01.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.251+0000 7f05ec930740 1 -- 172.21.15.19:0/436955218 shutdown_connections 2024-09-19T09:01:01.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.251+0000 7f05ec930740 1 -- 172.21.15.19:0/436955218 wait complete. 2024-09-19T09:01:01.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.251+0000 7f05ec930740 20 client.17418 trim_cache size 0 max 16384 2024-09-19T09:01:01.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.271+0000 7f05ec930740 1 Processor -- start 2024-09-19T09:01:01.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.271+0000 7f05ec930740 1 -- start start 2024-09-19T09:01:01.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.271+0000 7f05ec930740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556432c0db60 0x556432c210c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:01.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.271+0000 7f05ec930740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556432c18d40 0x556432c21600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:01.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.271+0000 7f05ec930740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556432c30290 0x556432c30720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:01.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.271+0000 7f05ec930740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f05e41ad560 con 0x556432c0db60 2024-09-19T09:01:01.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.271+0000 7f05ec930740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f05e41af0a0 con 0x556432c30290 2024-09-19T09:01:01.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.271+0000 7f05ec930740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f05e41adc30 con 0x556432c18d40 2024-09-19T09:01:01.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.271+0000 7f05e3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556432c0db60 0x556432c210c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:01.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.271+0000 7f05e3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556432c0db60 0x556432c210c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33312/0 (socket says 172.21.15.19:33312) 2024-09-19T09:01:01.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.271+0000 7f05e3fff640 1 -- 172.21.15.19:0/1558295230 learned_addr learned my addr 172.21.15.19:0/1558295230 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:01.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.272+0000 7f05e8af4640 1 --2- 172.21.15.19:0/1558295230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556432c30290 0x556432c30720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:01.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.272+0000 7f05e3fff640 1 -- 172.21.15.19:0/1558295230 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556432c18d40 msgr2=0x556432c21600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:01.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.272+0000 7f05e3fff640 1 --2- 172.21.15.19:0/1558295230 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556432c18d40 0x556432c21600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:01.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.272+0000 7f05e3fff640 1 -- 172.21.15.19:0/1558295230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556432c30290 msgr2=0x556432c30720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:01.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.272+0000 7f05e3fff640 1 --2- 172.21.15.19:0/1558295230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556432c30290 0x556432c30720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:01.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.272+0000 7f05e3fff640 1 -- 172.21.15.19:0/1558295230 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556432c16640 con 0x556432c0db60 2024-09-19T09:01:01.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.272+0000 7f05e8af4640 1 --2- 172.21.15.19:0/1558295230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556432c30290 0x556432c30720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:01:01.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.272+0000 7f05e3fff640 1 --2- 172.21.15.19:0/1558295230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556432c0db60 0x556432c210c0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f05d4097dc0 tx=0x7f05d4086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e250f900dae8661 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:01.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.273+0000 7f05d9ffb640 1 -- 172.21.15.19:0/1558295230 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4020040 con 0x556432c0db60 2024-09-19T09:01:01.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.273+0000 7f05d9ffb640 1 -- 172.21.15.19:0/1558295230 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05d409b960 con 0x556432c0db60 2024-09-19T09:01:01.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.273+0000 7f05d9ffb640 1 -- 172.21.15.19:0/1558295230 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05d4009cc0 con 0x556432c0db60 2024-09-19T09:01:01.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.275+0000 7f05ec930740 1 -- 172.21.15.19:0/1558295230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556432c0db60 msgr2=0x556432c210c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:01.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.275+0000 7f05ec930740 1 --2- 172.21.15.19:0/1558295230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556432c0db60 0x556432c210c0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f05d4097dc0 tx=0x7f05d4086040 comp rx=0 tx=0).stop 2024-09-19T09:01:01.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.276+0000 7f05ec930740 1 -- 172.21.15.19:0/1558295230 shutdown_connections 2024-09-19T09:01:01.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.276+0000 7f05ec930740 1 --2- 172.21.15.19:0/1558295230 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556432c18d40 0x556432c21600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:01.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.276+0000 7f05ec930740 1 --2- 172.21.15.19:0/1558295230 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556432c30290 0x556432c30720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:01.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.276+0000 7f05ec930740 1 --2- 172.21.15.19:0/1558295230 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556432c0db60 0x556432c210c0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:01.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.276+0000 7f05ec930740 1 -- 172.21.15.19:0/1558295230 >> 172.21.15.19:0/1558295230 conn(0x556432c0a0f0 msgr2=0x556432c17ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:01.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.276+0000 7f05ec930740 1 -- 172.21.15.19:0/1558295230 shutdown_connections 2024-09-19T09:01:01.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.276+0000 7f05ec930740 1 -- 172.21.15.19:0/1558295230 wait complete. 2024-09-19T09:01:01.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.276+0000 7f05ec930740 1 -- start start 2024-09-19T09:01:01.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.277+0000 7f05ec930740 1 Processor -- start 2024-09-19T09:01:01.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.277+0000 7f05ec930740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556432c0db60 0x556432c1bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:01.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.277+0000 7f05ec930740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556432c18d40 0x556432c1c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:01.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.277+0000 7f05ec930740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556432c30290 0x556432c1c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:01.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.277+0000 7f05ec930740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f05e41ae9d0 con 0x556432c30290 2024-09-19T09:01:01.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.277+0000 7f05ec930740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f05e41ae300 con 0x556432c0db60 2024-09-19T09:01:01.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.277+0000 7f05ec930740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f05e41ab540 con 0x556432c18d40 2024-09-19T09:01:01.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.277+0000 7f05ec930740 10 client.0 _ll_register_callbacks cb 0x7f05dc009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:01.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.277+0000 7f05e8af4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556432c30290 0x556432c1c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:01.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.277+0000 7f05e8af4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556432c30290 0x556432c1c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33316/0 (socket says 172.21.15.19:33316) 2024-09-19T09:01:01.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.277+0000 7f05e8af4640 1 -- 172.21.15.19:0/3356640255 learned_addr learned my addr 172.21.15.19:0/3356640255 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:01.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.278+0000 7f05e3fff640 1 --2- 172.21.15.19:0/3356640255 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556432c0db60 0x556432c1bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:01.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.278+0000 7f05e8af4640 1 -- 172.21.15.19:0/3356640255 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556432c18d40 msgr2=0x556432c1c1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:01:01.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.278+0000 7f05e8af4640 1 --2- 172.21.15.19:0/3356640255 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556432c18d40 0x556432c1c1e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:01.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.278+0000 7f05e8af4640 1 -- 172.21.15.19:0/3356640255 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556432c0db60 msgr2=0x556432c1bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:01.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.278+0000 7f05e8af4640 1 --2- 172.21.15.19:0/3356640255 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556432c0db60 0x556432c1bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:01.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.278+0000 7f05e8af4640 1 -- 172.21.15.19:0/3356640255 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556432c9bac0 con 0x556432c30290 2024-09-19T09:01:01.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.278+0000 7f05e8af4640 1 --2- 172.21.15.19:0/3356640255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556432c30290 0x556432c1c720 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f05dc009cd0 tx=0x7f05dc02a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0bad0106e7bfcdd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:01.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.279+0000 7f05c37fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:01:01.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.279+0000 7f05c37fe640 1 -- 172.21.15.19:0/3356640255 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05dc058060 con 0x556432c30290 2024-09-19T09:01:01.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.279+0000 7f05c37fe640 1 -- 172.21.15.19:0/3356640255 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f05dc0307a0 con 0x556432c30290 2024-09-19T09:01:01.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.279+0000 7f05ec930740 1 -- 172.21.15.19:0/3356640255 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05d409b960 con 0x556432c30290 2024-09-19T09:01:01.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.281+0000 7f05c37fe640 1 -- 172.21.15.19:0/3356640255 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f05dc0309a0 con 0x556432c30290 2024-09-19T09:01:01.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.282+0000 7f05ec930740 10 client.17424 fetch_fsmap learned FSMap version 36 2024-09-19T09:01:01.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.282+0000 7f05ec930740 1 -- 172.21.15.19:0/3356640255 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x556432c9cd80 con 0x556432c30290 2024-09-19T09:01:01.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.283+0000 7f05c37fe640 1 -- 172.21.15.19:0/3356640255 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05dc036040 con 0x556432c30290 2024-09-19T09:01:01.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.284+0000 7f05c37fe640 1 -- 172.21.15.19:0/3356640255 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f05dc030070 con 0x556432c30290 2024-09-19T09:01:01.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.284+0000 7f05ec930740 10 client.17424 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:01:01.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.284+0000 7f05ec930740 10 client.17424 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:01:01.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.284+0000 7f05ec930740 20 client.17424 populate_metadata read hostname 'smithi019' 2024-09-19T09:01:01.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.284+0000 7f05ec930740 1 --2- 172.21.15.19:0/3356640255 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x556432c9d450 0x556432c9f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:01.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.284+0000 7f05ec930740 4 client.17424 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:01:01.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.284+0000 7f05ec930740 1 -- 172.21.15.19:0/3356640255 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f05d409b960 con 0x556432c9d450 2024-09-19T09:01:01.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.285+0000 7f05e3fff640 1 --2- 172.21.15.19:0/3356640255 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x556432c9d450 0x556432c9f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:01.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.287+0000 7f05c37fe640 10 client.17424 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:01.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.287+0000 7f05e3fff640 1 --2- 172.21.15.19:0/3356640255 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x556432c9d450 0x556432c9f840 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=804a38ee10988def server_cookie=74391b25d1680a72 in_seq=0 out_seq=0 2024-09-19T09:01:01.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.460+0000 7f05c37fe640 1 -- 172.21.15.19:0/3356640255 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f05d409b960 con 0x556432c9d450 2024-09-19T09:01:01.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.460+0000 7f05c37fe640 10 client.17424 handle_command_reply: tid=0 2024-09-19T09:01:01.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.460+0000 7f05ec930740 1 client.17424 shutdown 2024-09-19T09:01:01.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.460+0000 7f05ec930740 1 -- 172.21.15.19:0/3356640255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556432c30290 msgr2=0x556432c1c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:01.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.460+0000 7f05ec930740 1 --2- 172.21.15.19:0/3356640255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556432c30290 0x556432c1c720 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f05dc009cd0 tx=0x7f05dc02a8e0 comp rx=0 tx=0).stop 2024-09-19T09:01:01.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.460+0000 7f05ec930740 1 -- 172.21.15.19:0/3356640255 shutdown_connections 2024-09-19T09:01:01.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.460+0000 7f05ec930740 1 --2- 172.21.15.19:0/3356640255 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x556432c9d450 0x556432c9f840 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:01.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.460+0000 7f05ec930740 1 --2- 172.21.15.19:0/3356640255 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556432c18d40 0x556432c1c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:01.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.460+0000 7f05ec930740 1 --2- 172.21.15.19:0/3356640255 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x556432c30290 0x556432c1c720 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:01.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.460+0000 7f05ec930740 1 --2- 172.21.15.19:0/3356640255 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x556432c0db60 0x556432c1bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:01.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.460+0000 7f05ec930740 1 -- 172.21.15.19:0/3356640255 >> 172.21.15.19:0/3356640255 conn(0x556432c0a0f0 msgr2=0x556432c2faa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:01.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.460+0000 7f05c37fe640 0 client.17424 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:01.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.461+0000 7f05ec930740 1 -- 172.21.15.19:0/3356640255 shutdown_connections 2024-09-19T09:01:01.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.461+0000 7f05ec930740 1 -- 172.21.15.19:0/3356640255 wait complete. 2024-09-19T09:01:01.464 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T09:01:01.465 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-19T09:01:01.465 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "1924c463-f0ce-4f0e-9188-83da7db1be50", 2024-09-19T09:01:01.465 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-19T09:01:01.465 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T09:01:01.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.461+0000 7f05ec930740 20 client.17424 trim_cache size 0 max 16384 2024-09-19T09:01:01.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.462+0000 7f05ea557640 1 -- 172.21.15.19:0/764036795 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f05d00a3240 msgr2=0x7f05d00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:01.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.462+0000 7f05ea557640 1 --2- 172.21.15.19:0/764036795 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f05d00a3240 0x7f05d00a5700 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f05dc004ab0 tx=0x7f05dc0095c0 comp rx=0 tx=0).stop 2024-09-19T09:01:01.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.462+0000 7f05ea557640 1 -- 172.21.15.19:0/764036795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05e4102d30 msgr2=0x7f05e4198570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:01.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.462+0000 7f05ea557640 1 --2- 172.21.15.19:0/764036795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05e4102d30 0x7f05e4198570 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f05d400d770 tx=0x7f05d400dc30 comp rx=0 tx=0).stop 2024-09-19T09:01:01.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.462+0000 7f05ea557640 1 -- 172.21.15.19:0/764036795 shutdown_connections 2024-09-19T09:01:01.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.462+0000 7f05ea557640 1 --2- 172.21.15.19:0/764036795 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f05d00a3240 0x7f05d00a5700 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:01.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.462+0000 7f05ea557640 1 --2- 172.21.15.19:0/764036795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05e41036e0 0x7f05e4198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:01.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.462+0000 7f05ea557640 1 --2- 172.21.15.19:0/764036795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05e41082a0 0x7f05e419ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:01.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.462+0000 7f05ea557640 1 --2- 172.21.15.19:0/764036795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f05e4102d30 0x7f05e4198570 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:01.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.462+0000 7f05ea557640 1 -- 172.21.15.19:0/764036795 >> 172.21.15.19:0/764036795 conn(0x7f05e40fc7d0 msgr2=0x7f05e4105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:01.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.464+0000 7f05ea557640 1 -- 172.21.15.19:0/764036795 shutdown_connections 2024-09-19T09:01:01.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:01.464+0000 7f05ea557640 1 -- 172.21.15.19:0/764036795 wait complete. 2024-09-19T09:01:01.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.860+0000 7f856b98d640 1 -- 172.21.15.19:0/3380553935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8564103710 msgr2=0x7f8564109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:01.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.860+0000 7f856b98d640 1 --2- 172.21.15.19:0/3380553935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8564103710 0x7f8564109fa0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f855c009ca0 tx=0x7f855c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:01:01.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.860+0000 7f856b98d640 1 -- 172.21.15.19:0/3380553935 shutdown_connections 2024-09-19T09:01:01.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.860+0000 7f856b98d640 1 --2- 172.21.15.19:0/3380553935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8564103710 0x7f8564109fa0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:01.865 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.860+0000 7f856b98d640 1 --2- 172.21.15.19:0/3380553935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8564102d50 0x7f85641031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:01.865 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.860+0000 7f856b98d640 1 --2- 172.21.15.19:0/3380553935 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8564101b60 0x7f8564101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:01.865 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.860+0000 7f856b98d640 1 -- 172.21.15.19:0/3380553935 >> 172.21.15.19:0/3380553935 conn(0x7f85640fd2e0 msgr2=0x7f85640ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:01.865 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.860+0000 7f856b98d640 1 -- 172.21.15.19:0/3380553935 shutdown_connections 2024-09-19T09:01:01.865 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.860+0000 7f856b98d640 1 -- 172.21.15.19:0/3380553935 wait complete. 2024-09-19T09:01:01.865 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.860+0000 7f856b98d640 1 Processor -- start 2024-09-19T09:01:01.866 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.860+0000 7f856b98d640 1 -- start start 2024-09-19T09:01:01.866 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.861+0000 7f856b98d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8564101b60 0x7f8564075fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:01.866 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.861+0000 7f856b98d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8564102d50 0x7f85640745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:01.866 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.861+0000 7f856b98d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8564103710 0x7f8564074b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:01.866 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.861+0000 7f856b98d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f856410d7e0 con 0x7f8564103710 2024-09-19T09:01:01.866 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.861+0000 7f856b98d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f856410d660 con 0x7f8564101b60 2024-09-19T09:01:01.866 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.861+0000 7f856b98d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f856410d960 con 0x7f8564102d50 2024-09-19T09:01:01.867 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.861+0000 7f8569f2a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8564103710 0x7f8564074b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:01.867 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.861+0000 7f8569729640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8564101b60 0x7f8564075fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:01.867 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.861+0000 7f8568f28640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8564102d50 0x7f85640745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:01.867 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.861+0000 7f8569f2a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8564103710 0x7f8564074b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33338/0 (socket says 172.21.15.19:33338) 2024-09-19T09:01:01.867 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.861+0000 7f8568f28640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8564102d50 0x7f85640745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:40406/0 (socket says 172.21.15.19:40406) 2024-09-19T09:01:01.867 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.861+0000 7f8569f2a640 1 -- 172.21.15.19:0/2022293666 learned_addr learned my addr 172.21.15.19:0/2022293666 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:01.867 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.861+0000 7f8569729640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8564101b60 0x7f8564075fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:59194/0 (socket says 172.21.15.19:59194) 2024-09-19T09:01:01.867 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.861+0000 7f8568f28640 1 -- 172.21.15.19:0/2022293666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8564101b60 msgr2=0x7f8564075fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:01.868 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.861+0000 7f8568f28640 1 --2- 172.21.15.19:0/2022293666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8564101b60 0x7f8564075fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:01.868 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.861+0000 7f8568f28640 1 -- 172.21.15.19:0/2022293666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8564103710 msgr2=0x7f8564074b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:01.868 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.861+0000 7f8568f28640 1 --2- 172.21.15.19:0/2022293666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8564103710 0x7f8564074b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:01.868 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.861+0000 7f8568f28640 1 -- 172.21.15.19:0/2022293666 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85640753b0 con 0x7f8564102d50 2024-09-19T09:01:01.868 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.861+0000 7f8569f2a640 1 --2- 172.21.15.19:0/2022293666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8564103710 0x7f8564074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:01.868 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.861+0000 7f8568f28640 1 --2- 172.21.15.19:0/2022293666 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8564102d50 0x7f85640745e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f855400e9f0 tx=0x7f855400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:01.868 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.862+0000 7f855a7fc640 1 -- 172.21.15.19:0/2022293666 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855400ccc0 con 0x7f8564102d50 2024-09-19T09:01:01.869 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.862+0000 7f855a7fc640 1 -- 172.21.15.19:0/2022293666 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8554010910 con 0x7f8564102d50 2024-09-19T09:01:01.869 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.862+0000 7f856b98d640 1 -- 172.21.15.19:0/2022293666 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85641a1ed0 con 0x7f8564102d50 2024-09-19T09:01:01.869 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.862+0000 7f855a7fc640 1 -- 172.21.15.19:0/2022293666 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8554018960 con 0x7f8564102d50 2024-09-19T09:01:01.869 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.862+0000 7f856b98d640 1 -- 172.21.15.19:0/2022293666 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85641a2330 con 0x7f8564102d50 2024-09-19T09:01:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.864+0000 7f856e804740 1 Processor -- start 2024-09-19T09:01:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.864+0000 7f856e804740 1 -- start start 2024-09-19T09:01:01.881 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.864+0000 7f855a7fc640 1 -- 172.21.15.19:0/2022293666 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f8554010ac0 con 0x7f8564102d50 2024-09-19T09:01:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.864+0000 7f856e804740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5568bc6cc9a0 0x5568bc6ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.864+0000 7f856e804740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568bc6cd2e0 0x5568bc6d1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.864+0000 7f856e804740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5568bc6d2370 0x5568bc6d4830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.865+0000 7f856e804740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5568bc6302f0 con 0x5568bc6cc9a0 2024-09-19T09:01:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.865+0000 7f856e804740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5568bc5d8270 con 0x5568bc6d2370 2024-09-19T09:01:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.865+0000 7f856e804740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5568bc62c2b0 con 0x5568bc6cd2e0 2024-09-19T09:01:01.882 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.865+0000 7f8569f2a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5568bc6cc9a0 0x5568bc6ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:01.883 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.865+0000 7f8568f28640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5568bc6d2370 0x5568bc6d4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:01.883 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.865+0000 7f8569f2a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5568bc6cc9a0 0x5568bc6ccda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33342/0 (socket says 172.21.15.19:33342) 2024-09-19T09:01:01.883 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.865+0000 7f8569f2a640 1 -- 172.21.15.19:0/3042977092 learned_addr learned my addr 172.21.15.19:0/3042977092 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:01.883 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.865+0000 7f8569729640 1 --2- 172.21.15.19:0/3042977092 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568bc6cd2e0 0x5568bc6d1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:01.883 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.865+0000 7f8569f2a640 1 -- 172.21.15.19:0/3042977092 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568bc6cd2e0 msgr2=0x5568bc6d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:01.883 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.865+0000 7f8569f2a640 1 --2- 172.21.15.19:0/3042977092 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568bc6cd2e0 0x5568bc6d1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:01.884 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.865+0000 7f8569f2a640 1 -- 172.21.15.19:0/3042977092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5568bc6d2370 msgr2=0x5568bc6d4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:01.884 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.865+0000 7f8569f2a640 1 --2- 172.21.15.19:0/3042977092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5568bc6d2370 0x5568bc6d4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:01.884 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.865+0000 7f8569f2a640 1 -- 172.21.15.19:0/3042977092 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568bc5d7340 con 0x5568bc6cc9a0 2024-09-19T09:01:01.884 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.865+0000 7f8568f28640 1 --2- 172.21.15.19:0/3042977092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5568bc6d2370 0x5568bc6d4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:01.884 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.865+0000 7f855a7fc640 1 --2- 172.21.15.19:0/2022293666 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f85500a32f0 0x7f85500a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:01.884 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.865+0000 7f8569f2a640 1 --2- 172.21.15.19:0/3042977092 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5568bc6cc9a0 0x5568bc6ccda0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f855c02f530 tx=0x7f855c009360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd24d75e86de6c05 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:01.884 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.865+0000 7f8569729640 1 --2- 172.21.15.19:0/2022293666 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f85500a32f0 0x7f85500a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.865+0000 7f855a7fc640 1 -- 172.21.15.19:0/2022293666 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f85540cfc20 con 0x7f8564102d50 2024-09-19T09:01:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.865+0000 7f854f7fe640 1 -- 172.21.15.19:0/3042977092 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c049070 con 0x5568bc6cc9a0 2024-09-19T09:01:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.866+0000 7f854f7fe640 1 -- 172.21.15.19:0/3042977092 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f855c036040 con 0x5568bc6cc9a0 2024-09-19T09:01:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.866+0000 7f854f7fe640 1 -- 172.21.15.19:0/3042977092 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c0305c0 con 0x5568bc6cc9a0 2024-09-19T09:01:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.866+0000 7f856e804740 1 -- 172.21.15.19:0/3042977092 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5568bc6cc9a0 msgr2=0x5568bc6ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:01.885 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.866+0000 7f856e804740 1 --2- 172.21.15.19:0/3042977092 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5568bc6cc9a0 0x5568bc6ccda0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f855c02f530 tx=0x7f855c009360 comp rx=0 tx=0).stop 2024-09-19T09:01:01.886 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.866+0000 7f8569729640 1 --2- 172.21.15.19:0/2022293666 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f85500a32f0 0x7f85500a57b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x5568bc6cdd10 tx=0x7f8560005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:01.886 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.866+0000 7f856e804740 1 -- 172.21.15.19:0/3042977092 shutdown_connections 2024-09-19T09:01:01.886 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.866+0000 7f856e804740 1 --2- 172.21.15.19:0/3042977092 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568bc6cd2e0 0x5568bc6d1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:01.886 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.866+0000 7f856e804740 1 --2- 172.21.15.19:0/3042977092 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5568bc6d2370 0x5568bc6d4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:01.886 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.866+0000 7f856e804740 1 --2- 172.21.15.19:0/3042977092 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5568bc6cc9a0 0x5568bc6ccda0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:01.886 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.866+0000 7f856e804740 1 -- 172.21.15.19:0/3042977092 >> 172.21.15.19:0/3042977092 conn(0x5568bc6c8010 msgr2=0x5568bc6c8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:01.887 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.866+0000 7f856e804740 1 -- 172.21.15.19:0/3042977092 shutdown_connections 2024-09-19T09:01:01.887 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.866+0000 7f856e804740 1 -- 172.21.15.19:0/3042977092 wait complete. 2024-09-19T09:01:01.887 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.867+0000 7f856e804740 1 -- start start 2024-09-19T09:01:01.887 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.867+0000 7f856e804740 1 Processor -- start 2024-09-19T09:01:01.887 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.867+0000 7f856e804740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5568bc6cc9a0 0x5568bc6d6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:01.887 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.867+0000 7f856e804740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5568bc6cd2e0 0x5568bc6d6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:01.887 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.867+0000 7f856e804740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568bc6d2370 0x5568bc6ddfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:01.887 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.867+0000 7f856e804740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5568bc6d5160 con 0x5568bc6cc9a0 2024-09-19T09:01:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.867+0000 7f856e804740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5568bc5b9290 con 0x5568bc6cd2e0 2024-09-19T09:01:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.867+0000 7f856e804740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5568bc6d52e0 con 0x5568bc6d2370 2024-09-19T09:01:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.867+0000 7f856e804740 10 client.0 _ll_register_callbacks cb 0x5568bc5ea140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.867+0000 7f8569729640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5568bc6cc9a0 0x5568bc6d6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.867+0000 7f8569729640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5568bc6cc9a0 0x5568bc6d6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33358/0 (socket says 172.21.15.19:33358) 2024-09-19T09:01:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.867+0000 7f8569729640 1 -- 172.21.15.19:0/3912388239 learned_addr learned my addr 172.21.15.19:0/3912388239 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:01.888 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.867+0000 7f8568f28640 1 --2- 172.21.15.19:0/3912388239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5568bc6cd2e0 0x5568bc6d6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.867+0000 7f8569f2a640 1 --2- 172.21.15.19:0/3912388239 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568bc6d2370 0x5568bc6ddfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.868+0000 7f8569729640 1 -- 172.21.15.19:0/3912388239 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568bc6d2370 msgr2=0x5568bc6ddfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.868+0000 7f8569729640 1 --2- 172.21.15.19:0/3912388239 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568bc6d2370 0x5568bc6ddfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.868+0000 7f8569729640 1 -- 172.21.15.19:0/3912388239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5568bc6cd2e0 msgr2=0x5568bc6d6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.868+0000 7f8569729640 1 --2- 172.21.15.19:0/3912388239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5568bc6cd2e0 0x5568bc6d6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.868+0000 7f8569729640 1 -- 172.21.15.19:0/3912388239 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568bc343210 con 0x5568bc6cc9a0 2024-09-19T09:01:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.868+0000 7f8568f28640 1 --2- 172.21.15.19:0/3912388239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5568bc6cd2e0 0x5568bc6d6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:01.889 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.868+0000 7f8569729640 1 --2- 172.21.15.19:0/3912388239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5568bc6cc9a0 0x5568bc6d6a20 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f8560005bc0 tx=0x7f8560004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=838159c13455d2d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.868+0000 7f854cff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:01:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.868+0000 7f854cff9640 1 -- 172.21.15.19:0/3912388239 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8560009e60 con 0x5568bc6cc9a0 2024-09-19T09:01:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.868+0000 7f854cff9640 1 -- 172.21.15.19:0/3912388239 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f856001f630 con 0x5568bc6cc9a0 2024-09-19T09:01:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.868+0000 7f856e804740 1 -- 172.21.15.19:0/3912388239 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f855c036040 con 0x5568bc6cc9a0 2024-09-19T09:01:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.868+0000 7f854cff9640 1 -- 172.21.15.19:0/3912388239 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f856001f830 con 0x5568bc6cc9a0 2024-09-19T09:01:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.868+0000 7f856e804740 10 client.17436 fetch_fsmap learned FSMap version 36 2024-09-19T09:01:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.868+0000 7f856e804740 1 -- 172.21.15.19:0/3912388239 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5568bc40f620 con 0x5568bc6cc9a0 2024-09-19T09:01:01.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.868+0000 7f854cff9640 1 -- 172.21.15.19:0/3912388239 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f855c036040 con 0x5568bc6cc9a0 2024-09-19T09:01:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.868+0000 7f854cff9640 1 -- 172.21.15.19:0/3912388239 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f8560027070 con 0x5568bc6cc9a0 2024-09-19T09:01:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.868+0000 7f856e804740 10 client.17436 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:01:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.868+0000 7f856e804740 10 client.17436 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:01:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.868+0000 7f856e804740 20 client.17436 populate_metadata read hostname 'smithi019' 2024-09-19T09:01:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.868+0000 7f856e804740 1 --2- 172.21.15.19:0/3912388239 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5568bc6e2740 0x5568bc6e4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.869+0000 7f856e804740 4 client.17436 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:01:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.869+0000 7f856e804740 1 -- 172.21.15.19:0/3912388239 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5568bc63da20 con 0x5568bc6e2740 2024-09-19T09:01:01.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.869+0000 7f8568f28640 1 --2- 172.21.15.19:0/3912388239 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5568bc6e2740 0x5568bc6e4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.869+0000 7f854cff9640 10 client.17436 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:01.892 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:01.869+0000 7f8568f28640 1 --2- 172.21.15.19:0/3912388239 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5568bc6e2740 0x5568bc6e4b70 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=932726b89223fd51 server_cookie=946c56455778e461 in_seq=0 out_seq=0 2024-09-19T09:01:02.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:01 smithi019 ceph-mon[30976]: pgmap v601: 97 pgs: 97 active+clean; 16 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 895 KiB/s wr, 327 op/s 2024-09-19T09:01:02.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:01 smithi155 ceph-mon[34921]: pgmap v601: 97 pgs: 97 active+clean; 16 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 895 KiB/s wr, 327 op/s 2024-09-19T09:01:02.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:01 smithi203 ceph-mon[35450]: pgmap v601: 97 pgs: 97 active+clean; 16 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 896 KiB/s rd, 895 KiB/s wr, 327 op/s 2024-09-19T09:01:02.286 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:01:02.382 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.382+0000 7f854cff9640 1 -- 172.21.15.19:0/3912388239 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5568bc63da20 con 0x5568bc6e2740 2024-09-19T09:01:02.382 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.382+0000 7f854cff9640 10 client.17436 handle_command_reply: tid=0 2024-09-19T09:01:02.383 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.382+0000 7f856e804740 1 client.17436 shutdown 2024-09-19T09:01:02.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:02.381+0000 7f2edd7fa640 1 -- 172.21.15.19:0/2205850134 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5593da41fbe0 con 0x5593da4ce7c0 2024-09-19T09:01:02.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:02.381+0000 7f2edd7fa640 10 client.26786 handle_command_reply: tid=0 2024-09-19T09:01:02.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:02.381+0000 7f2efde9e740 1 client.26786 shutdown 2024-09-19T09:01:02.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:02.381+0000 7f2efde9e740 1 -- 172.21.15.19:0/2205850134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593da4b3850 msgr2=0x5593da4c7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:02.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:02.381+0000 7f2efde9e740 1 --2- 172.21.15.19:0/2205850134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593da4b3850 0x5593da4c7140 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2ef0014040 tx=0x7f2ef0019bb0 comp rx=0 tx=0).stop 2024-09-19T09:01:02.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:02.381+0000 7f2efde9e740 1 -- 172.21.15.19:0/2205850134 shutdown_connections 2024-09-19T09:01:02.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:02.381+0000 7f2efde9e740 1 --2- 172.21.15.19:0/2205850134 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5593da4ce7c0 0x5593da53b870 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:02.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:02.381+0000 7f2efde9e740 1 --2- 172.21.15.19:0/2205850134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593da4bea30 0x5593da4c29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:02.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:02.381+0000 7f2efde9e740 1 --2- 172.21.15.19:0/2205850134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593da4b4170 0x5593da4c2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:02.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:02.381+0000 7f2efde9e740 1 --2- 172.21.15.19:0/2205850134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593da4b3850 0x5593da4c7140 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:02.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:02.381+0000 7f2edd7fa640 0 client.26786 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:02.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:02.381+0000 7f2efde9e740 1 -- 172.21.15.19:0/2205850134 >> 172.21.15.19:0/2205850134 conn(0x5593da4afde0 msgr2=0x5593da4bd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:02.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:02.381+0000 7f2efde9e740 1 -- 172.21.15.19:0/2205850134 shutdown_connections 2024-09-19T09:01:02.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:02.382+0000 7f2efde9e740 1 -- 172.21.15.19:0/2205850134 wait complete. 2024-09-19T09:01:02.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:02.382+0000 7f2efde9e740 20 client.26786 trim_cache size 0 max 16384 2024-09-19T09:01:02.384 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.382+0000 7f856e804740 1 -- 172.21.15.19:0/3912388239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5568bc6cc9a0 msgr2=0x5568bc6d6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.382+0000 7f856e804740 1 --2- 172.21.15.19:0/3912388239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5568bc6cc9a0 0x5568bc6d6a20 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f8560005bc0 tx=0x7f8560004730 comp rx=0 tx=0).stop 2024-09-19T09:01:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.382+0000 7f856e804740 1 -- 172.21.15.19:0/3912388239 shutdown_connections 2024-09-19T09:01:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.382+0000 7f856e804740 1 --2- 172.21.15.19:0/3912388239 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5568bc6e2740 0x5568bc6e4b70 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.382+0000 7f856e804740 1 --2- 172.21.15.19:0/3912388239 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568bc6d2370 0x5568bc6ddfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.382+0000 7f856e804740 1 --2- 172.21.15.19:0/3912388239 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5568bc6cd2e0 0x5568bc6d6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.382+0000 7f856e804740 1 --2- 172.21.15.19:0/3912388239 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5568bc6cc9a0 0x5568bc6d6a20 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.382+0000 7f856e804740 1 -- 172.21.15.19:0/3912388239 >> 172.21.15.19:0/3912388239 conn(0x5568bc6c8010 msgr2=0x5568bc6c9820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:02.385 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.382+0000 7f854cff9640 0 client.17436 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:02.385 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T09:01:02.385 INFO:teuthology.orchestra.run.smithi019.stdout: "epoch": 35, 2024-09-19T09:01:02.386 INFO:teuthology.orchestra.run.smithi019.stdout: "leader": 24497, 2024-09-19T09:01:02.386 INFO:teuthology.orchestra.run.smithi019.stdout: "set_version": 30, 2024-09-19T09:01:02.386 INFO:teuthology.orchestra.run.smithi019.stdout: "sets": { 2024-09-19T09:01:02.386 INFO:teuthology.orchestra.run.smithi019.stdout: "eb8ec178": { 2024-09-19T09:01:02.386 INFO:teuthology.orchestra.run.smithi019.stdout: "version": 30, 2024-09-19T09:01:02.386 INFO:teuthology.orchestra.run.smithi019.stdout: "age_ref": 0.0, 2024-09-19T09:01:02.386 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T09:01:02.386 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "QUIESCED", 2024-09-19T09:01:02.386 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T09:01:02.386 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:01:02.386 INFO:teuthology.orchestra.run.smithi019.stdout: "timeout": 90.0, 2024-09-19T09:01:02.386 INFO:teuthology.orchestra.run.smithi019.stdout: "expiration": 145.8, 2024-09-19T09:01:02.386 INFO:teuthology.orchestra.run.smithi019.stdout: "members": { 2024-09-19T09:01:02.387 INFO:teuthology.orchestra.run.smithi019.stdout: "file:/": { 2024-09-19T09:01:02.387 INFO:teuthology.orchestra.run.smithi019.stdout: "excluded": false, 2024-09-19T09:01:02.387 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T09:01:02.387 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "QUIESCED", 2024-09-19T09:01:02.387 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T09:01:02.387 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:01:02.387 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:01:02.387 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:01:02.387 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:01:02.387 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:01:02.388 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T09:01:02.388 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.382+0000 7f856e804740 1 -- 172.21.15.19:0/3912388239 shutdown_connections 2024-09-19T09:01:02.388 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.382+0000 7f856e804740 1 -- 172.21.15.19:0/3912388239 wait complete. 2024-09-19T09:01:02.388 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.383+0000 7f856e804740 20 client.17436 trim_cache size 0 max 16384 2024-09-19T09:01:02.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:02.383+0000 7f2efbac5640 1 -- 172.21.15.19:0/1973317354 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2ee00a32c0 msgr2=0x7f2ee00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:02.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:02.383+0000 7f2efbac5640 1 --2- 172.21.15.19:0/1973317354 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2ee00a32c0 0x7f2ee00a5780 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2ee4009230 tx=0x7f2ee403f040 comp rx=0 tx=0).stop 2024-09-19T09:01:02.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:02.383+0000 7f2efbac5640 1 -- 172.21.15.19:0/1973317354 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ef4106a70 msgr2=0x7f2ef41a42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:02.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:02.383+0000 7f2efbac5640 1 --2- 172.21.15.19:0/1973317354 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ef4106a70 0x7f2ef41a42c0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f2eec009d10 tx=0x7f2eec007590 comp rx=0 tx=0).stop 2024-09-19T09:01:02.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:02.383+0000 7f2efbac5640 1 -- 172.21.15.19:0/1973317354 shutdown_connections 2024-09-19T09:01:02.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:02.383+0000 7f2efbac5640 1 --2- 172.21.15.19:0/1973317354 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2ee00a32c0 0x7f2ee00a5780 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:02.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:02.383+0000 7f2efbac5640 1 --2- 172.21.15.19:0/1973317354 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ef4101410 0x7f2ef4199780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:02.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:02.383+0000 7f2efbac5640 1 --2- 172.21.15.19:0/1973317354 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ef4106a70 0x7f2ef41a42c0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:02.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:02.383+0000 7f2efbac5640 1 --2- 172.21.15.19:0/1973317354 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ef4100a70 0x7f2ef4199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:02.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:02.383+0000 7f2efbac5640 1 -- 172.21.15.19:0/1973317354 >> 172.21.15.19:0/1973317354 conn(0x7f2ef40fc790 msgr2=0x7f2ef40fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:02.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:02.383+0000 7f2efbac5640 1 -- 172.21.15.19:0/1973317354 shutdown_connections 2024-09-19T09:01:02.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:02.385+0000 7f2efbac5640 1 -- 172.21.15.19:0/1973317354 wait complete. 2024-09-19T09:01:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.401+0000 7f856e804740 1 Processor -- start 2024-09-19T09:01:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.401+0000 7f856e804740 1 -- start start 2024-09-19T09:01:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.402+0000 7f856e804740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568bc6cc9a0 0x5568bc6c8e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.402+0000 7f856e804740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5568bc6cd2e0 0x5568bc6ddf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.402+0000 7f856e804740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5568bc6d2370 0x5568bc6c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:02.402 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.402+0000 7f856e804740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f85641ab0c0 con 0x5568bc6cd2e0 2024-09-19T09:01:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.402+0000 7f856e804740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f85641acc00 con 0x5568bc6d2370 2024-09-19T09:01:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.402+0000 7f856e804740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f85641ab790 con 0x5568bc6cc9a0 2024-09-19T09:01:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.402+0000 7f8569f2a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5568bc6d2370 0x5568bc6c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:02.403 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.402+0000 7f8569f2a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5568bc6d2370 0x5568bc6c93a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:59222/0 (socket says 172.21.15.19:59222) 2024-09-19T09:01:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.402+0000 7f8569f2a640 1 -- 172.21.15.19:0/3896372423 learned_addr learned my addr 172.21.15.19:0/3896372423 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.403+0000 7f8569729640 1 --2- 172.21.15.19:0/3896372423 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568bc6cc9a0 0x5568bc6c8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.403+0000 7f8568f28640 1 --2- 172.21.15.19:0/3896372423 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5568bc6cd2e0 0x5568bc6ddf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.403+0000 7f8569f2a640 1 -- 172.21.15.19:0/3896372423 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568bc6cc9a0 msgr2=0x5568bc6c8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.403+0000 7f8569f2a640 1 --2- 172.21.15.19:0/3896372423 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568bc6cc9a0 0x5568bc6c8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.403+0000 7f8569f2a640 1 -- 172.21.15.19:0/3896372423 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5568bc6cd2e0 msgr2=0x5568bc6ddf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.403+0000 7f8569f2a640 1 --2- 172.21.15.19:0/3896372423 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5568bc6cd2e0 0x5568bc6ddf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:02.404 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.403+0000 7f8569f2a640 1 -- 172.21.15.19:0/3896372423 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568bc6d17c0 con 0x5568bc6d2370 2024-09-19T09:01:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.403+0000 7f8569f2a640 1 --2- 172.21.15.19:0/3896372423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5568bc6d2370 0x5568bc6c93a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f855c006010 tx=0x7f855c000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78a3dd9bb9c6a716 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.404+0000 7f854effd640 1 -- 172.21.15.19:0/3896372423 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c054070 con 0x5568bc6d2370 2024-09-19T09:01:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.404+0000 7f854effd640 1 -- 172.21.15.19:0/3896372423 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f855c036040 con 0x5568bc6d2370 2024-09-19T09:01:02.405 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.404+0000 7f854effd640 1 -- 172.21.15.19:0/3896372423 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855c049070 con 0x5568bc6d2370 2024-09-19T09:01:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.405+0000 7f856e804740 1 -- 172.21.15.19:0/3896372423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5568bc6d2370 msgr2=0x5568bc6c93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.405+0000 7f856e804740 1 --2- 172.21.15.19:0/3896372423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5568bc6d2370 0x5568bc6c93a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f855c006010 tx=0x7f855c000f40 comp rx=0 tx=0).stop 2024-09-19T09:01:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.405+0000 7f856e804740 1 -- 172.21.15.19:0/3896372423 shutdown_connections 2024-09-19T09:01:02.406 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.405+0000 7f856e804740 1 --2- 172.21.15.19:0/3896372423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5568bc6d2370 0x5568bc6c93a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.405+0000 7f856e804740 1 --2- 172.21.15.19:0/3896372423 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5568bc6cd2e0 0x5568bc6ddf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.405+0000 7f856e804740 1 --2- 172.21.15.19:0/3896372423 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568bc6cc9a0 0x5568bc6c8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.405+0000 7f856e804740 1 -- 172.21.15.19:0/3896372423 >> 172.21.15.19:0/3896372423 conn(0x5568bc6c8010 msgr2=0x5568bc6d67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.405+0000 7f856e804740 1 -- 172.21.15.19:0/3896372423 shutdown_connections 2024-09-19T09:01:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.405+0000 7f856e804740 1 -- 172.21.15.19:0/3896372423 wait complete. 2024-09-19T09:01:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.406+0000 7f856e804740 1 -- start start 2024-09-19T09:01:02.407 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.406+0000 7f856e804740 1 Processor -- start 2024-09-19T09:01:02.411 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.407+0000 7f856e804740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568bc6cc9a0 0x5568bc6d9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:02.411 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.407+0000 7f856e804740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5568bc6cd2e0 0x5568bc6d9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:02.411 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.407+0000 7f856e804740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5568bc6d2370 0x5568bc6dcec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:02.411 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.407+0000 7f856e804740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f85641ac530 con 0x5568bc6d2370 2024-09-19T09:01:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.407+0000 7f856e804740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f85641abe60 con 0x5568bc6cd2e0 2024-09-19T09:01:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.407+0000 7f856e804740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f85641a90a0 con 0x5568bc6cc9a0 2024-09-19T09:01:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.407+0000 7f856e804740 10 client.0 _ll_register_callbacks cb 0x7f8560009ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.407+0000 7f8568f28640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5568bc6cd2e0 0x5568bc6d9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:02.412 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.407+0000 7f8569729640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568bc6cc9a0 0x5568bc6d9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.407+0000 7f8568f28640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5568bc6cd2e0 0x5568bc6d9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:59232/0 (socket says 172.21.15.19:59232) 2024-09-19T09:01:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.407+0000 7f8568f28640 1 -- 172.21.15.19:0/1682596480 learned_addr learned my addr 172.21.15.19:0/1682596480 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.407+0000 7f8569729640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568bc6cc9a0 0x5568bc6d9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:40446/0 (socket says 172.21.15.19:40446) 2024-09-19T09:01:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.407+0000 7f8569f2a640 1 --2- 172.21.15.19:0/1682596480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5568bc6d2370 0x5568bc6dcec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.407+0000 7f8568f28640 1 -- 172.21.15.19:0/1682596480 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568bc6cc9a0 msgr2=0x5568bc6d9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:02.413 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.407+0000 7f8568f28640 1 --2- 172.21.15.19:0/1682596480 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568bc6cc9a0 0x5568bc6d9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.407+0000 7f8568f28640 1 -- 172.21.15.19:0/1682596480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5568bc6d2370 msgr2=0x5568bc6dcec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.407+0000 7f8568f28640 1 --2- 172.21.15.19:0/1682596480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5568bc6d2370 0x5568bc6dcec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.407+0000 7f8568f28640 1 -- 172.21.15.19:0/1682596480 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568bc6dd4d0 con 0x5568bc6cd2e0 2024-09-19T09:01:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.408+0000 7f8568f28640 1 --2- 172.21.15.19:0/1682596480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5568bc6cd2e0 0x5568bc6d9ea0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8554098c20 tx=0x7f85540bc040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43c587e1aba2f7cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.408+0000 7f854cff9640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T09:01:02.414 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.408+0000 7f854cff9640 1 -- 172.21.15.19:0/1682596480 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f855409c2a0 con 0x5568bc6cd2e0 2024-09-19T09:01:02.415 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.408+0000 7f854cff9640 1 -- 172.21.15.19:0/1682596480 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f85540a0150 con 0x5568bc6cd2e0 2024-09-19T09:01:02.415 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.408+0000 7f856e804740 1 -- 172.21.15.19:0/1682596480 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f855c036040 con 0x5568bc6cd2e0 2024-09-19T09:01:02.415 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.408+0000 7f854cff9640 1 -- 172.21.15.19:0/1682596480 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f85540a05a0 con 0x5568bc6cd2e0 2024-09-19T09:01:02.415 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.408+0000 7f856e804740 10 client.26906 fetch_fsmap learned FSMap version 36 2024-09-19T09:01:02.415 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.408+0000 7f856e804740 1 -- 172.21.15.19:0/1682596480 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5568bc756070 con 0x5568bc6cd2e0 2024-09-19T09:01:02.415 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.409+0000 7f854cff9640 1 -- 172.21.15.19:0/1682596480 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f855c036040 con 0x5568bc6cd2e0 2024-09-19T09:01:02.416 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.409+0000 7f854cff9640 1 -- 172.21.15.19:0/1682596480 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f85540cdb90 con 0x5568bc6cd2e0 2024-09-19T09:01:02.416 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.409+0000 7f856e804740 10 client.26906 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:01:02.416 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.409+0000 7f856e804740 10 client.26906 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:01:02.416 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.409+0000 7f856e804740 20 client.26906 populate_metadata read hostname 'smithi019' 2024-09-19T09:01:02.416 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.409+0000 7f856e804740 1 --2- 172.21.15.19:0/1682596480 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5568bc756a40 0x5568bc758e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:02.416 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.409+0000 7f856e804740 4 client.26906 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:01:02.417 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.409+0000 7f856e804740 1 -- 172.21.15.19:0/1682596480 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5568bc637d70 con 0x5568bc756a40 2024-09-19T09:01:02.417 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.409+0000 7f8569729640 1 --2- 172.21.15.19:0/1682596480 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5568bc756a40 0x5568bc758e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:02.417 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.410+0000 7f8569729640 1 --2- 172.21.15.19:0/1682596480 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5568bc756a40 0x5568bc758e60 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2fcb34d2ccc7ff9 server_cookie=96bf0ef3d7e394b4 in_seq=0 out_seq=0 2024-09-19T09:01:02.417 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.410+0000 7f854cff9640 10 client.26906 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:02.997 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.996+0000 7f854cff9640 1 -- 172.21.15.19:0/1682596480 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5568bc637d70 con 0x5568bc756a40 2024-09-19T09:01:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.996+0000 7f854cff9640 10 client.26906 handle_command_reply: tid=0 2024-09-19T09:01:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.996+0000 7f856e804740 1 client.26906 shutdown 2024-09-19T09:01:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.996+0000 7f856e804740 1 -- 172.21.15.19:0/1682596480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5568bc6cd2e0 msgr2=0x5568bc6d9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.996+0000 7f856e804740 1 --2- 172.21.15.19:0/1682596480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5568bc6cd2e0 0x5568bc6d9ea0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8554098c20 tx=0x7f85540bc040 comp rx=0 tx=0).stop 2024-09-19T09:01:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.996+0000 7f856e804740 1 -- 172.21.15.19:0/1682596480 shutdown_connections 2024-09-19T09:01:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.996+0000 7f856e804740 1 --2- 172.21.15.19:0/1682596480 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5568bc756a40 0x5568bc758e60 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.996+0000 7f856e804740 1 --2- 172.21.15.19:0/1682596480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5568bc6d2370 0x5568bc6dcec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.996+0000 7f854cff9640 0 client.26906 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.996+0000 7f856e804740 1 --2- 172.21.15.19:0/1682596480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5568bc6cd2e0 0x5568bc6d9ea0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.996+0000 7f856e804740 1 --2- 172.21.15.19:0/1682596480 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568bc6cc9a0 0x5568bc6d9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.996+0000 7f856e804740 1 -- 172.21.15.19:0/1682596480 >> 172.21.15.19:0/1682596480 conn(0x5568bc6c8010 msgr2=0x5568bc6c69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.996+0000 7f856e804740 1 -- 172.21.15.19:0/1682596480 shutdown_connections 2024-09-19T09:01:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.996+0000 7f856e804740 1 -- 172.21.15.19:0/1682596480 wait complete. 2024-09-19T09:01:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.997+0000 7f856e804740 20 client.26906 trim_cache size 0 max 16384 2024-09-19T09:01:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T09:01:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T09:01:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T09:01:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T09:01:03.000 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.997+0000 7f856b98d640 1 -- 172.21.15.19:0/2022293666 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f85500a32f0 msgr2=0x7f85500a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:03.000 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.997+0000 7f856b98d640 1 --2- 172.21.15.19:0/2022293666 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f85500a32f0 0x7f85500a57b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x5568bc6cdd10 tx=0x7f8560005f90 comp rx=0 tx=0).stop 2024-09-19T09:01:03.000 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.997+0000 7f856b98d640 1 -- 172.21.15.19:0/2022293666 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8564102d50 msgr2=0x7f85640745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:03.000 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.997+0000 7f856b98d640 1 --2- 172.21.15.19:0/2022293666 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8564102d50 0x7f85640745e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f855400e9f0 tx=0x7f855400eeb0 comp rx=0 tx=0).stop 2024-09-19T09:01:03.001 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.998+0000 7f856b98d640 1 -- 172.21.15.19:0/2022293666 shutdown_connections 2024-09-19T09:01:03.001 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.998+0000 7f856b98d640 1 --2- 172.21.15.19:0/2022293666 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f85500a32f0 0x7f85500a57b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:03.001 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.998+0000 7f856b98d640 1 --2- 172.21.15.19:0/2022293666 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8564102d50 0x7f85640745e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:03.001 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.998+0000 7f856b98d640 1 --2- 172.21.15.19:0/2022293666 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8564103710 0x7f8564074b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:03.001 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.998+0000 7f856b98d640 1 --2- 172.21.15.19:0/2022293666 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8564101b60 0x7f8564075fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:03.001 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.998+0000 7f856b98d640 1 -- 172.21.15.19:0/2022293666 >> 172.21.15.19:0/2022293666 conn(0x7f85640fd2e0 msgr2=0x7f8564106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:03.001 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.998+0000 7f856b98d640 1 -- 172.21.15.19:0/2022293666 shutdown_connections 2024-09-19T09:01:03.001 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:02.998+0000 7f856b98d640 1 -- 172.21.15.19:0/2022293666 wait complete. 2024-09-19T09:01:03.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:02 smithi155 ceph-mon[34921]: scrub queued for path: / 2024-09-19T09:01:03.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:02 smithi155 ceph-mon[34921]: scrub summary: idle+waiting paths [/] 2024-09-19T09:01:03.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:02 smithi155 ceph-mon[34921]: scrub summary: active paths [/] 2024-09-19T09:01:03.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:02 smithi203 ceph-mon[35450]: scrub queued for path: / 2024-09-19T09:01:03.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:02 smithi203 ceph-mon[35450]: scrub summary: idle+waiting paths [/] 2024-09-19T09:01:03.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:02 smithi203 ceph-mon[35450]: scrub summary: active paths [/] 2024-09-19T09:01:03.307 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:02 smithi019 ceph-mon[30976]: scrub queued for path: / 2024-09-19T09:01:03.307 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:02 smithi019 ceph-mon[30976]: scrub summary: idle+waiting paths [/] 2024-09-19T09:01:03.307 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:02 smithi019 ceph-mon[30976]: scrub summary: active paths [/] 2024-09-19T09:01:03.338 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'eb8ec178', quiesce took 16.1 seconds. Will release after: 9.649999999999999 2024-09-19T09:01:03.417 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:03.954 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:03 smithi019 ceph-mon[30976]: pgmap v602: 97 pgs: 97 active+clean; 19 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 326 op/s 2024-09-19T09:01:04.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.058+0000 7f0df0a29640 1 -- 172.21.15.19:0/3049297811 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0dec102ef0 msgr2=0x7f0dec10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:04.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.058+0000 7f0df0a29640 1 --2- 172.21.15.19:0/3049297811 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0dec102ef0 0x7f0dec10da40 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f0de4009ca0 tx=0x7f0de402a950 comp rx=0 tx=0).stop 2024-09-19T09:01:04.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.058+0000 7f0df0a29640 1 -- 172.21.15.19:0/3049297811 shutdown_connections 2024-09-19T09:01:04.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.058+0000 7f0df0a29640 1 --2- 172.21.15.19:0/3049297811 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0dec102ef0 0x7f0dec10da40 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:04.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.058+0000 7f0df0a29640 1 --2- 172.21.15.19:0/3049297811 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0dec102570 0x7f0dec1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:04.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.058+0000 7f0df0a29640 1 --2- 172.21.15.19:0/3049297811 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0dec100e20 0x7f0dec101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:04.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.058+0000 7f0df0a29640 1 -- 172.21.15.19:0/3049297811 >> 172.21.15.19:0/3049297811 conn(0x7f0dec0fc7d0 msgr2=0x7f0dec0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:04.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.058+0000 7f0df0a29640 1 -- 172.21.15.19:0/3049297811 shutdown_connections 2024-09-19T09:01:04.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.058+0000 7f0df0a29640 1 -- 172.21.15.19:0/3049297811 wait complete. 2024-09-19T09:01:04.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.059+0000 7f0df0a29640 1 Processor -- start 2024-09-19T09:01:04.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.059+0000 7f0df0a29640 1 -- start start 2024-09-19T09:01:04.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.059+0000 7f0df0a29640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0dec100e20 0x7f0dec199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:04.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.059+0000 7f0df0a29640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0dec102570 0x7f0dec199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:04.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.059+0000 7f0df0a29640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0dec102ef0 0x7f0dec1a4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:04.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.059+0000 7f0df0a29640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec110fd0 con 0x7f0dec102ef0 2024-09-19T09:01:04.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.059+0000 7f0df0a29640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec110e50 con 0x7f0dec102570 2024-09-19T09:01:04.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.059+0000 7f0df0a29640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec111150 con 0x7f0dec100e20 2024-09-19T09:01:04.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.060+0000 7f0dea59c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0dec100e20 0x7f0dec199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:04.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.060+0000 7f0dea59c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0dec100e20 0x7f0dec199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:40458/0 (socket says 172.21.15.19:40458) 2024-09-19T09:01:04.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.060+0000 7f0dea59c640 1 -- 172.21.15.19:0/1657259286 learned_addr learned my addr 172.21.15.19:0/1657259286 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:04.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.060+0000 7f0de9d9b640 1 --2- 172.21.15.19:0/1657259286 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0dec102570 0x7f0dec199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:04.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.060+0000 7f0dead9d640 1 --2- 172.21.15.19:0/1657259286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0dec102ef0 0x7f0dec1a4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:04.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.060+0000 7f0dea59c640 1 -- 172.21.15.19:0/1657259286 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0dec102570 msgr2=0x7f0dec199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:04.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.060+0000 7f0dea59c640 1 --2- 172.21.15.19:0/1657259286 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0dec102570 0x7f0dec199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:04.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.060+0000 7f0dea59c640 1 -- 172.21.15.19:0/1657259286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0dec102ef0 msgr2=0x7f0dec1a4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:04.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.060+0000 7f0dea59c640 1 --2- 172.21.15.19:0/1657259286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0dec102ef0 0x7f0dec1a4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:04.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.060+0000 7f0dea59c640 1 -- 172.21.15.19:0/1657259286 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dec1a48c0 con 0x7f0dec100e20 2024-09-19T09:01:04.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.060+0000 7f0de9d9b640 1 --2- 172.21.15.19:0/1657259286 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0dec102570 0x7f0dec199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:04.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.060+0000 7f0dea59c640 1 --2- 172.21.15.19:0/1657259286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0dec100e20 0x7f0dec199300 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc00e9f0 tx=0x7f0ddc00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:04.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.060+0000 7f0ddb7fe640 1 -- 172.21.15.19:0/1657259286 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc00cd80 con 0x7f0dec100e20 2024-09-19T09:01:04.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.060+0000 7f0ddb7fe640 1 -- 172.21.15.19:0/1657259286 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0ddc010910 con 0x7f0dec100e20 2024-09-19T09:01:04.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.060+0000 7f0ddb7fe640 1 -- 172.21.15.19:0/1657259286 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc018990 con 0x7f0dec100e20 2024-09-19T09:01:04.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.060+0000 7f0df0a29640 1 -- 172.21.15.19:0/1657259286 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dec1a4a90 con 0x7f0dec100e20 2024-09-19T09:01:04.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.061+0000 7f0df0a29640 1 -- 172.21.15.19:0/1657259286 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dec1a4ec0 con 0x7f0dec100e20 2024-09-19T09:01:04.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.064+0000 7f0ddb7fe640 1 -- 172.21.15.19:0/1657259286 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f0ddc010ac0 con 0x7f0dec100e20 2024-09-19T09:01:04.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.064+0000 7f0df2e02740 1 Processor -- start 2024-09-19T09:01:04.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.065+0000 7f0df2e02740 1 -- start start 2024-09-19T09:01:04.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.065+0000 7f0ddb7fe640 1 --2- 172.21.15.19:0/1657259286 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f0dd40a3240 0x7f0dd40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:04.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.065+0000 7f0df2e02740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba58a75340 0x55ba58a75720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:04.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.065+0000 7f0df2e02740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ba58a75c60 0x55ba58a84550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:04.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.065+0000 7f0df2e02740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba58a84a90 0x55ba58a86e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:04.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.065+0000 7f0df2e02740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ba589db2e0 con 0x55ba58a75c60 2024-09-19T09:01:04.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.065+0000 7f0df2e02740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55ba58982ce0 con 0x55ba58a75340 2024-09-19T09:01:04.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.065+0000 7f0df2e02740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ba589d72a0 con 0x55ba58a84a90 2024-09-19T09:01:04.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.065+0000 7f0ddb7fe640 1 -- 172.21.15.19:0/1657259286 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0ddc0cfc10 con 0x7f0dec100e20 2024-09-19T09:01:04.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.065+0000 7f0de9d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ba58a75c60 0x55ba58a84550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:04.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.065+0000 7f0de9d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ba58a75c60 0x55ba58a84550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33388/0 (socket says 172.21.15.19:33388) 2024-09-19T09:01:04.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.065+0000 7f0de9d9b640 1 -- 172.21.15.19:0/1387586179 learned_addr learned my addr 172.21.15.19:0/1387586179 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:04.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.066+0000 7f0dea59c640 1 --2- 172.21.15.19:0/1387586179 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba58a75340 0x55ba58a75720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:04.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.066+0000 7f0de9d9b640 1 -- 172.21.15.19:0/1387586179 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba58a84a90 msgr2=0x55ba58a86e80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:01:04.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.066+0000 7f0de9d9b640 1 --2- 172.21.15.19:0/1387586179 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba58a84a90 0x55ba58a86e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:04.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.066+0000 7f0dead9d640 1 --2- 172.21.15.19:0/1657259286 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f0dd40a3240 0x7f0dd40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:04.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.066+0000 7f0de9d9b640 1 -- 172.21.15.19:0/1387586179 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba58a75340 msgr2=0x55ba58a75720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:04.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.066+0000 7f0de9d9b640 1 --2- 172.21.15.19:0/1387586179 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba58a75340 0x55ba58a75720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:04.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.066+0000 7f0de9d9b640 1 -- 172.21.15.19:0/1387586179 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba58967440 con 0x55ba58a75c60 2024-09-19T09:01:04.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.066+0000 7f0de9d9b640 1 --2- 172.21.15.19:0/1387586179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ba58a75c60 0x55ba58a84550 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f0de0011470 tx=0x7f0de0011930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc66424c097f8088 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:04.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.067+0000 7f0dd8ff9640 1 -- 172.21.15.19:0/1387586179 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de001e070 con 0x55ba58a75c60 2024-09-19T09:01:04.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.067+0000 7f0dd8ff9640 1 -- 172.21.15.19:0/1387586179 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0de00035f0 con 0x55ba58a75c60 2024-09-19T09:01:04.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.067+0000 7f0dd8ff9640 1 -- 172.21.15.19:0/1387586179 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de000f860 con 0x55ba58a75c60 2024-09-19T09:01:04.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.067+0000 7f0df2e02740 1 -- 172.21.15.19:0/1387586179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ba58a75c60 msgr2=0x55ba58a84550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:04.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.067+0000 7f0dead9d640 1 --2- 172.21.15.19:0/1657259286 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f0dd40a3240 0x7f0dd40a5700 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f0de4006010 tx=0x7f0de4005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:04.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.067+0000 7f0df2e02740 1 --2- 172.21.15.19:0/1387586179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ba58a75c60 0x55ba58a84550 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f0de0011470 tx=0x7f0de0011930 comp rx=0 tx=0).stop 2024-09-19T09:01:04.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.068+0000 7f0df2e02740 1 -- 172.21.15.19:0/1387586179 shutdown_connections 2024-09-19T09:01:04.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.068+0000 7f0df2e02740 1 --2- 172.21.15.19:0/1387586179 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba58a84a90 0x55ba58a86e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:04.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.068+0000 7f0df2e02740 1 --2- 172.21.15.19:0/1387586179 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ba58a75c60 0x55ba58a84550 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:04.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.068+0000 7f0df2e02740 1 --2- 172.21.15.19:0/1387586179 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba58a75340 0x55ba58a75720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:04.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.068+0000 7f0df2e02740 1 -- 172.21.15.19:0/1387586179 >> 172.21.15.19:0/1387586179 conn(0x55ba58a71a30 msgr2=0x55ba58a71e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:04.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.068+0000 7f0df2e02740 1 -- 172.21.15.19:0/1387586179 shutdown_connections 2024-09-19T09:01:04.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.068+0000 7f0df2e02740 1 -- 172.21.15.19:0/1387586179 wait complete. 2024-09-19T09:01:04.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.068+0000 7f0df2e02740 1 -- start start 2024-09-19T09:01:04.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.068+0000 7f0df2e02740 1 Processor -- start 2024-09-19T09:01:04.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.069+0000 7f0df2e02740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba58a75340 0x55ba58a84030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:04.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.069+0000 7f0df2e02740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ba58a75c60 0x55ba58a7d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:04.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.069+0000 7f0df2e02740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba58a84a90 0x55ba58a7d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:04.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.069+0000 7f0df2e02740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ba58a87660 con 0x55ba58a75c60 2024-09-19T09:01:04.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.069+0000 7f0df2e02740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55ba58996050 con 0x55ba58a75340 2024-09-19T09:01:04.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.069+0000 7f0df2e02740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ba58a877e0 con 0x55ba58a84a90 2024-09-19T09:01:04.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.069+0000 7f0df2e02740 10 client.0 _ll_register_callbacks cb 0x55ba589d6160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:04.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.069+0000 7f0de9d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ba58a75c60 0x55ba58a7d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:04.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.069+0000 7f0dea59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba58a75340 0x55ba58a84030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:04.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.069+0000 7f0dea59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba58a75340 0x55ba58a84030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:59276/0 (socket says 172.21.15.19:59276) 2024-09-19T09:01:04.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.069+0000 7f0dea59c640 1 -- 172.21.15.19:0/2889352074 learned_addr learned my addr 172.21.15.19:0/2889352074 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:04.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.069+0000 7f0dead9d640 1 --2- 172.21.15.19:0/2889352074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba58a84a90 0x55ba58a7d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:04.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.069+0000 7f0de9d9b640 1 -- 172.21.15.19:0/2889352074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba58a84a90 msgr2=0x55ba58a7d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:04.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.069+0000 7f0de9d9b640 1 --2- 172.21.15.19:0/2889352074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba58a84a90 0x55ba58a7d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:04.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.069+0000 7f0de9d9b640 1 -- 172.21.15.19:0/2889352074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba58a75340 msgr2=0x55ba58a84030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:04.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.069+0000 7f0de9d9b640 1 --2- 172.21.15.19:0/2889352074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba58a75340 0x55ba58a84030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:04.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.069+0000 7f0de9d9b640 1 -- 172.21.15.19:0/2889352074 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba5874c3c0 con 0x55ba58a75c60 2024-09-19T09:01:04.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.069+0000 7f0dea59c640 1 --2- 172.21.15.19:0/2889352074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba58a75340 0x55ba58a84030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:04.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.070+0000 7f0de9d9b640 1 --2- 172.21.15.19:0/2889352074 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ba58a75c60 0x55ba58a7d2c0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f0de0011440 tx=0x7f0de00039d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de84f544dbf4a9af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:04.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.070+0000 7f0dd1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:01:04.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.070+0000 7f0dd1ffb640 1 -- 172.21.15.19:0/2889352074 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de001e040 con 0x55ba58a75c60 2024-09-19T09:01:04.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.070+0000 7f0dd1ffb640 1 -- 172.21.15.19:0/2889352074 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0de0003b40 con 0x55ba58a75c60 2024-09-19T09:01:04.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.070+0000 7f0df2e02740 1 -- 172.21.15.19:0/2889352074 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0de00035f0 con 0x55ba58a75c60 2024-09-19T09:01:04.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.070+0000 7f0dd1ffb640 1 -- 172.21.15.19:0/2889352074 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f0de0005040 con 0x55ba58a75c60 2024-09-19T09:01:04.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.070+0000 7f0df2e02740 10 client.17454 fetch_fsmap learned FSMap version 36 2024-09-19T09:01:04.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.070+0000 7f0df2e02740 1 -- 172.21.15.19:0/2889352074 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55ba58a974d0 con 0x55ba58a75c60 2024-09-19T09:01:04.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.071+0000 7f0dd1ffb640 1 -- 172.21.15.19:0/2889352074 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0de00035f0 con 0x55ba58a75c60 2024-09-19T09:01:04.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.071+0000 7f0dd1ffb640 1 -- 172.21.15.19:0/2889352074 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f0de0021070 con 0x55ba58a75c60 2024-09-19T09:01:04.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.071+0000 7f0df2e02740 10 client.17454 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:01:04.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.071+0000 7f0df2e02740 10 client.17454 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:01:04.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.071+0000 7f0df2e02740 20 client.17454 populate_metadata read hostname 'smithi019' 2024-09-19T09:01:04.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.071+0000 7f0df2e02740 1 --2- 172.21.15.19:0/2889352074 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ba58a98880 0x55ba58a9ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:04.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.071+0000 7f0df2e02740 4 client.17454 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:01:04.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.071+0000 7f0df2e02740 1 -- 172.21.15.19:0/2889352074 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba589e8850 con 0x55ba58a98880 2024-09-19T09:01:04.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.071+0000 7f0dea59c640 1 --2- 172.21.15.19:0/2889352074 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ba58a98880 0x55ba58a9ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:04.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.071+0000 7f0dea59c640 1 --2- 172.21.15.19:0/2889352074 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ba58a98880 0x55ba58a9ac70 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3200fa18f46ddb3 server_cookie=1ad615bccf025cd0 in_seq=0 out_seq=0 2024-09-19T09:01:04.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.071+0000 7f0dd1ffb640 10 client.17454 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:04.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.072+0000 7f0dd1ffb640 1 -- 172.21.15.19:0/2889352074 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ba589e8850 con 0x55ba58a98880 2024-09-19T09:01:04.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.072+0000 7f0dd1ffb640 10 client.17454 handle_command_reply: tid=0 2024-09-19T09:01:04.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.072+0000 7f0df2e02740 1 client.17454 shutdown 2024-09-19T09:01:04.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.072+0000 7f0df2e02740 1 -- 172.21.15.19:0/2889352074 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ba58a75c60 msgr2=0x55ba58a7d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:04.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.072+0000 7f0df2e02740 1 --2- 172.21.15.19:0/2889352074 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ba58a75c60 0x55ba58a7d2c0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f0de0011440 tx=0x7f0de00039d0 comp rx=0 tx=0).stop 2024-09-19T09:01:04.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.072+0000 7f0df2e02740 1 -- 172.21.15.19:0/2889352074 shutdown_connections 2024-09-19T09:01:04.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.073+0000 7f0df2e02740 1 --2- 172.21.15.19:0/2889352074 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ba58a98880 0x55ba58a9ac70 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:04.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.073+0000 7f0df2e02740 1 --2- 172.21.15.19:0/2889352074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba58a84a90 0x55ba58a7d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:04.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.073+0000 7f0dd1ffb640 0 client.17454 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:04.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.073+0000 7f0df2e02740 1 --2- 172.21.15.19:0/2889352074 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ba58a75c60 0x55ba58a7d2c0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:04.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.073+0000 7f0df2e02740 1 --2- 172.21.15.19:0/2889352074 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba58a75340 0x55ba58a84030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:04.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.073+0000 7f0df2e02740 1 -- 172.21.15.19:0/2889352074 >> 172.21.15.19:0/2889352074 conn(0x55ba58a71a30 msgr2=0x55ba58a77790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:04.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.073+0000 7f0df2e02740 1 -- 172.21.15.19:0/2889352074 shutdown_connections 2024-09-19T09:01:04.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.073+0000 7f0df2e02740 1 -- 172.21.15.19:0/2889352074 wait complete. 2024-09-19T09:01:04.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.073+0000 7f0df2e02740 20 client.17454 trim_cache size 0 max 16384 2024-09-19T09:01:04.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.095+0000 7f0df2e02740 1 Processor -- start 2024-09-19T09:01:04.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.095+0000 7f0df2e02740 1 -- start start 2024-09-19T09:01:04.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.096+0000 7f0df2e02740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba58a75340 0x55ba58aa0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:04.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.096+0000 7f0df2e02740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ba58a75c60 0x55ba58aa0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:04.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.096+0000 7f0df2e02740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba58a84a90 0x55ba58a7a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:04.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.096+0000 7f0df2e02740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec1ab3a0 con 0x55ba58a75c60 2024-09-19T09:01:04.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.096+0000 7f0df2e02740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec1acee0 con 0x55ba58a84a90 2024-09-19T09:01:04.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.096+0000 7f0df2e02740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec1aba70 con 0x55ba58a75340 2024-09-19T09:01:04.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.096+0000 7f0de9d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ba58a75c60 0x55ba58aa0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:04.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.096+0000 7f0de9d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ba58a75c60 0x55ba58aa0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33412/0 (socket says 172.21.15.19:33412) 2024-09-19T09:01:04.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.096+0000 7f0de9d9b640 1 -- 172.21.15.19:0/2532952904 learned_addr learned my addr 172.21.15.19:0/2532952904 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:04.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.096+0000 7f0dea59c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba58a75340 0x55ba58aa0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:04.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.096+0000 7f0dead9d640 1 --2- 172.21.15.19:0/2532952904 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba58a84a90 0x55ba58a7a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:04.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.096+0000 7f0de9d9b640 1 -- 172.21.15.19:0/2532952904 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba58a75340 msgr2=0x55ba58aa0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:04.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.096+0000 7f0de9d9b640 1 --2- 172.21.15.19:0/2532952904 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba58a75340 0x55ba58aa0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:04.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.096+0000 7f0de9d9b640 1 -- 172.21.15.19:0/2532952904 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba58a84a90 msgr2=0x55ba58a7a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:04.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.096+0000 7f0de9d9b640 1 --2- 172.21.15.19:0/2532952904 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba58a84a90 0x55ba58a7a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:04.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.096+0000 7f0de9d9b640 1 -- 172.21.15.19:0/2532952904 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba58a7b810 con 0x55ba58a75c60 2024-09-19T09:01:04.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.096+0000 7f0dea59c640 1 --2- 172.21.15.19:0/2532952904 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba58a75340 0x55ba58aa0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:04.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.096+0000 7f0dead9d640 1 --2- 172.21.15.19:0/2532952904 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba58a84a90 0x55ba58a7a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:01:04.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.097+0000 7f0de9d9b640 1 --2- 172.21.15.19:0/2532952904 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ba58a75c60 0x55ba58aa0940 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f0de0000c00 tx=0x7f0de0005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9935a6053d7936ca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:04.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.097+0000 7f0dd3fff640 1 -- 172.21.15.19:0/2532952904 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de001e040 con 0x55ba58a75c60 2024-09-19T09:01:04.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.097+0000 7f0dd3fff640 1 -- 172.21.15.19:0/2532952904 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0de0027070 con 0x55ba58a75c60 2024-09-19T09:01:04.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.097+0000 7f0dd3fff640 1 -- 172.21.15.19:0/2532952904 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de00051e0 con 0x55ba58a75c60 2024-09-19T09:01:04.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.098+0000 7f0df2e02740 1 -- 172.21.15.19:0/2532952904 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ba58a75c60 msgr2=0x55ba58aa0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:04.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.098+0000 7f0df2e02740 1 --2- 172.21.15.19:0/2532952904 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ba58a75c60 0x55ba58aa0940 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f0de0000c00 tx=0x7f0de0005fd0 comp rx=0 tx=0).stop 2024-09-19T09:01:04.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.098+0000 7f0df2e02740 1 -- 172.21.15.19:0/2532952904 shutdown_connections 2024-09-19T09:01:04.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.098+0000 7f0df2e02740 1 --2- 172.21.15.19:0/2532952904 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba58a84a90 0x55ba58a7a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:04.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.098+0000 7f0df2e02740 1 --2- 172.21.15.19:0/2532952904 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ba58a75c60 0x55ba58aa0940 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:04.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.098+0000 7f0df2e02740 1 --2- 172.21.15.19:0/2532952904 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba58a75340 0x55ba58aa0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:04.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.098+0000 7f0df2e02740 1 -- 172.21.15.19:0/2532952904 >> 172.21.15.19:0/2532952904 conn(0x55ba58a71a30 msgr2=0x55ba58a81350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:04.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.098+0000 7f0df2e02740 1 -- 172.21.15.19:0/2532952904 shutdown_connections 2024-09-19T09:01:04.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.098+0000 7f0df2e02740 1 -- 172.21.15.19:0/2532952904 wait complete. 2024-09-19T09:01:04.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.098+0000 7f0df2e02740 1 -- start start 2024-09-19T09:01:04.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.098+0000 7f0df2e02740 1 Processor -- start 2024-09-19T09:01:04.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.099+0000 7f0df2e02740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba58a75340 0x55ba58a95910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:04.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.099+0000 7f0df2e02740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba58a75c60 0x55ba58a92cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:04.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.099+0000 7f0df2e02740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ba58a84a90 0x55ba58a931f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:04.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.099+0000 7f0df2e02740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec1ac810 con 0x55ba58a84a90 2024-09-19T09:01:04.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.099+0000 7f0df2e02740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec1ac140 con 0x55ba58a75340 2024-09-19T09:01:04.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.099+0000 7f0df2e02740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec1a9380 con 0x55ba58a75c60 2024-09-19T09:01:04.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.099+0000 7f0dea59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba58a75340 0x55ba58a95910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:04.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.099+0000 7f0de9d9b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba58a75c60 0x55ba58a92cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:04.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.099+0000 7f0dea59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba58a75340 0x55ba58a95910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:59308/0 (socket says 172.21.15.19:59308) 2024-09-19T09:01:04.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.099+0000 7f0dea59c640 1 -- 172.21.15.19:0/3383815423 learned_addr learned my addr 172.21.15.19:0/3383815423 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:04.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.099+0000 7f0dead9d640 1 --2- 172.21.15.19:0/3383815423 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ba58a84a90 0x55ba58a931f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:04.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.099+0000 7f0df2e02740 10 client.0 _ll_register_callbacks cb 0x7f0de001c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:04.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.099+0000 7f0dead9d640 1 -- 172.21.15.19:0/3383815423 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba58a75c60 msgr2=0x55ba58a92cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:04.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.099+0000 7f0dead9d640 1 --2- 172.21.15.19:0/3383815423 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba58a75c60 0x55ba58a92cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:04.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.099+0000 7f0dead9d640 1 -- 172.21.15.19:0/3383815423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba58a75340 msgr2=0x55ba58a95910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:04.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.099+0000 7f0dead9d640 1 --2- 172.21.15.19:0/3383815423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba58a75340 0x55ba58a95910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:04.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.099+0000 7f0dead9d640 1 -- 172.21.15.19:0/3383815423 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba58a93730 con 0x55ba58a84a90 2024-09-19T09:01:04.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.100+0000 7f0dead9d640 1 --2- 172.21.15.19:0/3383815423 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ba58a84a90 0x55ba58a931f0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f0de4005e30 tx=0x7f0de40095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a992eb07b2bf81cc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:04.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.100+0000 7f0dd1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:01:04.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.100+0000 7f0dd1ffb640 1 -- 172.21.15.19:0/3383815423 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de4034040 con 0x55ba58a84a90 2024-09-19T09:01:04.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.100+0000 7f0dd1ffb640 1 -- 172.21.15.19:0/3383815423 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0de4040030 con 0x55ba58a84a90 2024-09-19T09:01:04.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.100+0000 7f0df2e02740 1 -- 172.21.15.19:0/3383815423 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0de0027070 con 0x55ba58a84a90 2024-09-19T09:01:04.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.100+0000 7f0dd1ffb640 1 -- 172.21.15.19:0/3383815423 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f0de4003e50 con 0x55ba58a84a90 2024-09-19T09:01:04.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.100+0000 7f0df2e02740 10 client.17460 fetch_fsmap learned FSMap version 36 2024-09-19T09:01:04.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.100+0000 7f0df2e02740 1 -- 172.21.15.19:0/3383815423 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55ba58b03100 con 0x55ba58a84a90 2024-09-19T09:01:04.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.100+0000 7f0dd1ffb640 1 -- 172.21.15.19:0/3383815423 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0de0027070 con 0x55ba58a84a90 2024-09-19T09:01:04.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.101+0000 7f0dd1ffb640 1 -- 172.21.15.19:0/3383815423 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f0de40307d0 con 0x55ba58a84a90 2024-09-19T09:01:04.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.101+0000 7f0df2e02740 10 client.17460 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:01:04.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.101+0000 7f0df2e02740 10 client.17460 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:01:04.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.101+0000 7f0df2e02740 20 client.17460 populate_metadata read hostname 'smithi019' 2024-09-19T09:01:04.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.101+0000 7f0df2e02740 1 --2- 172.21.15.19:0/3383815423 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ba58b03870 0x55ba58b05ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:04.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.101+0000 7f0df2e02740 4 client.17460 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:01:04.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.101+0000 7f0df2e02740 1 -- 172.21.15.19:0/3383815423 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ba589e2d60 con 0x55ba58b03870 2024-09-19T09:01:04.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.101+0000 7f0dea59c640 1 --2- 172.21.15.19:0/3383815423 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ba58b03870 0x55ba58b05ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:04.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.101+0000 7f0dd1ffb640 10 client.17460 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:04.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.101+0000 7f0dea59c640 1 --2- 172.21.15.19:0/3383815423 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ba58b03870 0x55ba58b05ca0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=362b706be3167e15 server_cookie=4d1523f81988b73 in_seq=0 out_seq=0 2024-09-19T09:01:04.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.102+0000 7f0dd1ffb640 1 -- 172.21.15.19:0/3383815423 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+268 (crc 0 0 0) 0x55ba589e2d60 con 0x55ba58b03870 2024-09-19T09:01:04.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.102+0000 7f0dd1ffb640 10 client.17460 handle_command_reply: tid=0 2024-09-19T09:01:04.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.102+0000 7f0df2e02740 1 client.17460 shutdown 2024-09-19T09:01:04.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.102+0000 7f0df2e02740 1 -- 172.21.15.19:0/3383815423 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ba58a84a90 msgr2=0x55ba58a931f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:04.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.102+0000 7f0df2e02740 1 --2- 172.21.15.19:0/3383815423 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ba58a84a90 0x55ba58a931f0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f0de4005e30 tx=0x7f0de40095c0 comp rx=0 tx=0).stop 2024-09-19T09:01:04.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.102+0000 7f0df2e02740 1 -- 172.21.15.19:0/3383815423 shutdown_connections 2024-09-19T09:01:04.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.102+0000 7f0df2e02740 1 --2- 172.21.15.19:0/3383815423 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ba58b03870 0x55ba58b05ca0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:04.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.102+0000 7f0df2e02740 1 --2- 172.21.15.19:0/3383815423 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ba58a75c60 0x55ba58a92cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:04.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.102+0000 7f0df2e02740 1 --2- 172.21.15.19:0/3383815423 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ba58a84a90 0x55ba58a931f0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:04.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.102+0000 7f0dd1ffb640 0 client.17460 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:04.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.102+0000 7f0df2e02740 1 --2- 172.21.15.19:0/3383815423 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ba58a75340 0x55ba58a95910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:04.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.102+0000 7f0df2e02740 1 -- 172.21.15.19:0/3383815423 >> 172.21.15.19:0/3383815423 conn(0x55ba58a71a30 msgr2=0x55ba58a7ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:04.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.102+0000 7f0df2e02740 1 -- 172.21.15.19:0/3383815423 shutdown_connections 2024-09-19T09:01:04.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.102+0000 7f0df2e02740 1 -- 172.21.15.19:0/3383815423 wait complete. 2024-09-19T09:01:04.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.102+0000 7f0df2e02740 20 client.17460 trim_cache size 0 max 16384 2024-09-19T09:01:04.108 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T09:01:04.108 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "scrub active (1943 inodes in the stack)", 2024-09-19T09:01:04.109 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-19T09:01:04.109 INFO:teuthology.orchestra.run.smithi019.stdout: "1924c463-f0ce-4f0e-9188-83da7db1be50": { 2024-09-19T09:01:04.109 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-19T09:01:04.109 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "1924c463-f0ce-4f0e-9188-83da7db1be50", 2024-09-19T09:01:04.109 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-19T09:01:04.109 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:01:04.109 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:01:04.109 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T09:01:04.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.103+0000 7f0df0a29640 1 -- 172.21.15.19:0/1657259286 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f0dd40a3240 msgr2=0x7f0dd40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:04.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.103+0000 7f0df0a29640 1 --2- 172.21.15.19:0/1657259286 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f0dd40a3240 0x7f0dd40a5700 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f0de4006010 tx=0x7f0de4005d80 comp rx=0 tx=0).stop 2024-09-19T09:01:04.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.103+0000 7f0df0a29640 1 -- 172.21.15.19:0/1657259286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0dec100e20 msgr2=0x7f0dec199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:04.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.103+0000 7f0df0a29640 1 --2- 172.21.15.19:0/1657259286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0dec100e20 0x7f0dec199300 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc00e9f0 tx=0x7f0ddc00eeb0 comp rx=0 tx=0).stop 2024-09-19T09:01:04.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.103+0000 7f0df0a29640 1 -- 172.21.15.19:0/1657259286 shutdown_connections 2024-09-19T09:01:04.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.103+0000 7f0df0a29640 1 --2- 172.21.15.19:0/1657259286 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f0dd40a3240 0x7f0dd40a5700 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:04.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.103+0000 7f0df0a29640 1 --2- 172.21.15.19:0/1657259286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0dec102ef0 0x7f0dec1a4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:04.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.103+0000 7f0df0a29640 1 --2- 172.21.15.19:0/1657259286 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0dec102570 0x7f0dec199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:04.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.103+0000 7f0df0a29640 1 --2- 172.21.15.19:0/1657259286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0dec100e20 0x7f0dec199300 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:04.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.103+0000 7f0df0a29640 1 -- 172.21.15.19:0/1657259286 >> 172.21.15.19:0/1657259286 conn(0x7f0dec0fc7d0 msgr2=0x7f0dec106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:04.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.103+0000 7f0df0a29640 1 -- 172.21.15.19:0/1657259286 shutdown_connections 2024-09-19T09:01:04.110 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:04.103+0000 7f0df0a29640 1 -- 172.21.15.19:0/1657259286 wait complete. 2024-09-19T09:01:04.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:03 smithi155 ceph-mon[34921]: pgmap v602: 97 pgs: 97 active+clean; 19 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 326 op/s 2024-09-19T09:01:04.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:03 smithi203 ceph-mon[35450]: pgmap v602: 97 pgs: 97 active+clean; 19 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 326 op/s 2024-09-19T09:01:04.885 INFO:tasks.cephfs.filesystem:scrub status for tag:1924c463-f0ce-4f0e-9188-83da7db1be50 - {'path': '/', 'tag': '1924c463-f0ce-4f0e-9188-83da7db1be50', 'options': 'recursive,force'} 2024-09-19T09:01:05.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:04 smithi019 ceph-mon[30976]: pgmap v603: 97 pgs: 97 active+clean; 20 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 776 KiB/s wr, 369 op/s 2024-09-19T09:01:05.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:04 smithi155 ceph-mon[34921]: pgmap v603: 97 pgs: 97 active+clean; 20 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 776 KiB/s wr, 369 op/s 2024-09-19T09:01:05.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:04 smithi203 ceph-mon[35450]: pgmap v603: 97 pgs: 97 active+clean; 20 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 776 KiB/s wr, 369 op/s 2024-09-19T09:01:06.481 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:06 smithi203 ceph-mon[35450]: scrub summary: idle+waiting paths [/] 2024-09-19T09:01:06.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:06 smithi019 ceph-mon[30976]: scrub summary: idle+waiting paths [/] 2024-09-19T09:01:06.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:06 smithi155 ceph-mon[34921]: scrub summary: idle+waiting paths [/] 2024-09-19T09:01:07.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:07 smithi203 ceph-mon[35450]: pgmap v604: 97 pgs: 97 active+clean; 12 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 473 KiB/s wr, 1.22k op/s 2024-09-19T09:01:07.482 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:07 smithi203 ceph-mon[35450]: scrub summary: idle 2024-09-19T09:01:07.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:07 smithi019 ceph-mon[30976]: pgmap v604: 97 pgs: 97 active+clean; 12 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 473 KiB/s wr, 1.22k op/s 2024-09-19T09:01:07.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:07 smithi019 ceph-mon[30976]: scrub summary: idle 2024-09-19T09:01:07.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:07 smithi155 ceph-mon[34921]: pgmap v604: 97 pgs: 97 active+clean; 12 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 473 KiB/s wr, 1.22k op/s 2024-09-19T09:01:07.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:07 smithi155 ceph-mon[34921]: scrub summary: idle 2024-09-19T09:01:09.540 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:09 smithi019 ceph-mon[30976]: pgmap v605: 97 pgs: 97 active+clean; 4.2 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 466 KiB/s wr, 2.65k op/s 2024-09-19T09:01:09.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:09 smithi155 ceph-mon[34921]: pgmap v605: 97 pgs: 97 active+clean; 4.2 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 466 KiB/s wr, 2.65k op/s 2024-09-19T09:01:09.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:09 smithi203 ceph-mon[35450]: pgmap v605: 97 pgs: 97 active+clean; 4.2 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 466 KiB/s wr, 2.65k op/s 2024-09-19T09:01:11.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:11 smithi019 ceph-mon[30976]: pgmap v606: 97 pgs: 97 active+clean; 4.2 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 338 KiB/s wr, 2.75k op/s 2024-09-19T09:01:11.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:11 smithi155 ceph-mon[34921]: pgmap v606: 97 pgs: 97 active+clean; 4.2 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 338 KiB/s wr, 2.75k op/s 2024-09-19T09:01:11.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:11 smithi203 ceph-mon[35450]: pgmap v606: 97 pgs: 97 active+clean; 4.2 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 338 KiB/s wr, 2.75k op/s 2024-09-19T09:01:12.989 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:01:13.261 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:13.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:13 smithi019 ceph-mon[30976]: pgmap v607: 97 pgs: 97 active+clean; 4.2 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 337 KiB/s wr, 2.82k op/s 2024-09-19T09:01:13.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:13 smithi155 ceph-mon[34921]: pgmap v607: 97 pgs: 97 active+clean; 4.2 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 337 KiB/s wr, 2.82k op/s 2024-09-19T09:01:13.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:13 smithi203 ceph-mon[35450]: pgmap v607: 97 pgs: 97 active+clean; 4.2 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 337 KiB/s wr, 2.82k op/s 2024-09-19T09:01:13.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.908+0000 7f8983ca0640 1 -- 172.21.15.19:0/47514041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f897c100b20 msgr2=0x7f897c100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:13.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.908+0000 7f8983ca0640 1 --2- 172.21.15.19:0/47514041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f897c100b20 0x7f897c100f00 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f8978009900 tx=0x7f897802a410 comp rx=0 tx=0).stop 2024-09-19T09:01:13.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.908+0000 7f8983ca0640 1 -- 172.21.15.19:0/47514041 shutdown_connections 2024-09-19T09:01:13.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.908+0000 7f8983ca0640 1 --2- 172.21.15.19:0/47514041 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f897c10e500 0x7f897c110910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.908+0000 7f8983ca0640 1 --2- 172.21.15.19:0/47514041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f897c101440 0x7f897c10df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.908+0000 7f8983ca0640 1 --2- 172.21.15.19:0/47514041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f897c100b20 0x7f897c100f00 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.908+0000 7f8983ca0640 1 -- 172.21.15.19:0/47514041 >> 172.21.15.19:0/47514041 conn(0x7f897c0fc7d0 msgr2=0x7f897c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:13.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.909+0000 7f8983ca0640 1 -- 172.21.15.19:0/47514041 shutdown_connections 2024-09-19T09:01:13.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.909+0000 7f8983ca0640 1 -- 172.21.15.19:0/47514041 wait complete. 2024-09-19T09:01:13.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.909+0000 7f8983ca0640 1 Processor -- start 2024-09-19T09:01:13.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.909+0000 7f8983ca0640 1 -- start start 2024-09-19T09:01:13.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.909+0000 7f8983ca0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f897c100b20 0x7f897c1a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:13.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.909+0000 7f8983ca0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f897c101440 0x7f897c1a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:13.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.909+0000 7f8983ca0640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f897c10e500 0x7f897c19a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:13.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.909+0000 7f8983ca0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f897c114280 con 0x7f897c101440 2024-09-19T09:01:13.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.909+0000 7f8983ca0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f897c114100 con 0x7f897c100b20 2024-09-19T09:01:13.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.909+0000 7f8983ca0640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f897c114400 con 0x7f897c10e500 2024-09-19T09:01:13.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.910+0000 7f898123b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f897c101440 0x7f897c1a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:13.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.910+0000 7f898123b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f897c101440 0x7f897c1a0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55698/0 (socket says 172.21.15.19:55698) 2024-09-19T09:01:13.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.910+0000 7f898123b640 1 -- 172.21.15.19:0/1508692732 learned_addr learned my addr 172.21.15.19:0/1508692732 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:13.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.910+0000 7f898223d640 1 --2- 172.21.15.19:0/1508692732 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f897c10e500 0x7f897c19a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:13.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.910+0000 7f8981a3c640 1 --2- 172.21.15.19:0/1508692732 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f897c100b20 0x7f897c1a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:13.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.910+0000 7f898123b640 1 -- 172.21.15.19:0/1508692732 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f897c10e500 msgr2=0x7f897c19a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:13.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.910+0000 7f898123b640 1 --2- 172.21.15.19:0/1508692732 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f897c10e500 0x7f897c19a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.910+0000 7f898123b640 1 -- 172.21.15.19:0/1508692732 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f897c100b20 msgr2=0x7f897c1a03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:13.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.910+0000 7f898123b640 1 --2- 172.21.15.19:0/1508692732 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f897c100b20 0x7f897c1a03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:13.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.910+0000 7f898123b640 1 -- 172.21.15.19:0/1508692732 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f897c19ace0 con 0x7f897c101440 2024-09-19T09:01:13.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.910+0000 7f898123b640 1 --2- 172.21.15.19:0/1508692732 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f897c101440 0x7f897c1a0930 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f896c00d770 tx=0x7f896c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:13.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.910+0000 7f8972ffd640 1 -- 172.21.15.19:0/1508692732 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896c017070 con 0x7f897c101440 2024-09-19T09:01:13.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.910+0000 7f8972ffd640 1 -- 172.21.15.19:0/1508692732 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f896c009c30 con 0x7f897c101440 2024-09-19T09:01:13.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.910+0000 7f8983ca0640 1 -- 172.21.15.19:0/1508692732 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f897c19afd0 con 0x7f897c101440 2024-09-19T09:01:13.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.910+0000 7f8972ffd640 1 -- 172.21.15.19:0/1508692732 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f896c003dd0 con 0x7f897c101440 2024-09-19T09:01:13.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.911+0000 7f8983ca0640 1 -- 172.21.15.19:0/1508692732 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f897c1a72c0 con 0x7f897c101440 2024-09-19T09:01:13.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.911+0000 7f8983ca0640 1 -- 172.21.15.19:0/1508692732 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f897c06a850 con 0x7f897c101440 2024-09-19T09:01:13.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.913+0000 7f8972ffd640 1 -- 172.21.15.19:0/1508692732 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f896c003f90 con 0x7f897c101440 2024-09-19T09:01:13.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.914+0000 7f8972ffd640 1 --2- 172.21.15.19:0/1508692732 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f89680a3240 0x7f89680a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:13.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.914+0000 7f8981a3c640 1 --2- 172.21.15.19:0/1508692732 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f89680a3240 0x7f89680a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:13.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.914+0000 7f8972ffd640 1 -- 172.21.15.19:0/1508692732 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f896c0cf290 con 0x7f897c101440 2024-09-19T09:01:13.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.914+0000 7f8981a3c640 1 --2- 172.21.15.19:0/1508692732 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f89680a3240 0x7f89680a5700 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8978005ab0 tx=0x7f8978005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:13.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:13.918+0000 7f8972ffd640 1 -- 172.21.15.19:0/1508692732 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f896c09bfc0 con 0x7f897c101440 2024-09-19T09:01:14.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:14.132+0000 7f8983ca0640 1 -- 172.21.15.19:0/1508692732 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f897c109600 con 0x7f897c101440 2024-09-19T09:01:14.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:14.133+0000 7f8972ffd640 1 -- 172.21.15.19:0/1508692732 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11983 (secure 0 0 0) 0x7f896c009de0 con 0x7f897c101440 2024-09-19T09:01:14.133 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T09:01:14.133 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":36,"btime":"2024-09-19T08:59:00:695758+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":26453,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3907362737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3907362737},{"type":"v1","addr":"172.21.15.155:6835","nonce":3907362737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":35,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T08:58:50.493979+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6839/2452068876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2452068876},{"type":"v1","addr":"172.21.15.19:6839","nonce":2452068876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24463,24464,24490,24469,24497]},"id":1}]} 2024-09-19T09:01:14.133 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 36 2024-09-19T09:01:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:14.135+0000 7f8983ca0640 1 -- 172.21.15.19:0/1508692732 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f89680a3240 msgr2=0x7f89680a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:14.135+0000 7f8983ca0640 1 --2- 172.21.15.19:0/1508692732 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f89680a3240 0x7f89680a5700 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8978005ab0 tx=0x7f8978005a20 comp rx=0 tx=0).stop 2024-09-19T09:01:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:14.135+0000 7f8983ca0640 1 -- 172.21.15.19:0/1508692732 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f897c101440 msgr2=0x7f897c1a0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:14.135+0000 7f8983ca0640 1 --2- 172.21.15.19:0/1508692732 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f897c101440 0x7f897c1a0930 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f896c00d770 tx=0x7f896c00dc30 comp rx=0 tx=0).stop 2024-09-19T09:01:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:14.135+0000 7f8983ca0640 1 -- 172.21.15.19:0/1508692732 shutdown_connections 2024-09-19T09:01:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:14.135+0000 7f8983ca0640 1 --2- 172.21.15.19:0/1508692732 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f89680a3240 0x7f89680a5700 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:14.135+0000 7f8983ca0640 1 --2- 172.21.15.19:0/1508692732 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f897c10e500 0x7f897c19a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:14.135+0000 7f8983ca0640 1 --2- 172.21.15.19:0/1508692732 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f897c101440 0x7f897c1a0930 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:14.135+0000 7f8983ca0640 1 --2- 172.21.15.19:0/1508692732 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f897c100b20 0x7f897c1a03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:14.135+0000 7f8983ca0640 1 -- 172.21.15.19:0/1508692732 >> 172.21.15.19:0/1508692732 conn(0x7f897c0fc7d0 msgr2=0x7f897c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:14.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:14.135+0000 7f8983ca0640 1 -- 172.21.15.19:0/1508692732 shutdown_connections 2024-09-19T09:01:14.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:14.135+0000 7f8983ca0640 1 -- 172.21.15.19:0/1508692732 wait complete. 2024-09-19T09:01:14.469 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:14 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1508692732' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:14.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:14 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1508692732' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:14.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:14 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1508692732' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:14.958 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db --set-id eb8ec178 --release --await' 2024-09-19T09:01:14.959 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db --set-id eb8ec178 --release --await 2024-09-19T09:01:15.218 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:15.504 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:15 smithi019 ceph-mon[30976]: pgmap v608: 97 pgs: 97 active+clean; 4.5 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 120 KiB/s wr, 2.79k op/s 2024-09-19T09:01:15.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:15 smithi155 ceph-mon[34921]: pgmap v608: 97 pgs: 97 active+clean; 4.5 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 120 KiB/s wr, 2.79k op/s 2024-09-19T09:01:15.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.699+0000 7f2eea40c640 1 -- 172.21.15.19:0/4138121748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ee4106f20 msgr2=0x7f2ee410eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:15.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.699+0000 7f2eea40c640 1 --2- 172.21.15.19:0/4138121748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ee4106f20 0x7f2ee410eaa0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f2edc009ca0 tx=0x7f2edc02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.699+0000 7f2eea40c640 1 -- 172.21.15.19:0/4138121748 shutdown_connections 2024-09-19T09:01:15.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.699+0000 7f2eea40c640 1 --2- 172.21.15.19:0/4138121748 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ee41027a0 0x7f2ee41067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.699+0000 7f2eea40c640 1 --2- 172.21.15.19:0/4138121748 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ee4106f20 0x7f2ee410eaa0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.699+0000 7f2eea40c640 1 --2- 172.21.15.19:0/4138121748 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ee4101df0 0x7f2ee41021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.699+0000 7f2eea40c640 1 -- 172.21.15.19:0/4138121748 >> 172.21.15.19:0/4138121748 conn(0x7f2ee40fd8f0 msgr2=0x7f2ee40ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:15.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.699+0000 7f2eea40c640 1 -- 172.21.15.19:0/4138121748 shutdown_connections 2024-09-19T09:01:15.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.699+0000 7f2eea40c640 1 -- 172.21.15.19:0/4138121748 wait complete. 2024-09-19T09:01:15.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.699+0000 7f2eea40c640 1 Processor -- start 2024-09-19T09:01:15.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.699+0000 7f2eea40c640 1 -- start start 2024-09-19T09:01:15.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.700+0000 7f2eea40c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ee4101df0 0x7f2ee40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:15.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.700+0000 7f2eea40c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ee41027a0 0x7f2ee4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:15.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.700+0000 7f2eea40c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ee4106f20 0x7f2ee4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:15.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.700+0000 7f2eea40c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee4111f80 con 0x7f2ee41027a0 2024-09-19T09:01:15.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.700+0000 7f2eea40c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee4111e00 con 0x7f2ee4101df0 2024-09-19T09:01:15.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.700+0000 7f2eea40c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee4112100 con 0x7f2ee4106f20 2024-09-19T09:01:15.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.700+0000 7f2ee37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ee41027a0 0x7f2ee4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:15.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.700+0000 7f2ee37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ee41027a0 0x7f2ee4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33888/0 (socket says 172.21.15.19:33888) 2024-09-19T09:01:15.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.700+0000 7f2ee37fe640 1 -- 172.21.15.19:0/1925728229 learned_addr learned my addr 172.21.15.19:0/1925728229 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:15.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.700+0000 7f2ee89a9640 1 --2- 172.21.15.19:0/1925728229 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ee4106f20 0x7f2ee4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:15.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.700+0000 7f2ee3fff640 1 --2- 172.21.15.19:0/1925728229 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ee4101df0 0x7f2ee40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:15.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.700+0000 7f2ee37fe640 1 -- 172.21.15.19:0/1925728229 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ee4106f20 msgr2=0x7f2ee4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:15.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.700+0000 7f2ee37fe640 1 --2- 172.21.15.19:0/1925728229 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ee4106f20 0x7f2ee4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.700+0000 7f2ee37fe640 1 -- 172.21.15.19:0/1925728229 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ee4101df0 msgr2=0x7f2ee40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:15.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.700+0000 7f2ee37fe640 1 --2- 172.21.15.19:0/1925728229 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ee4101df0 0x7f2ee40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.700+0000 7f2ee37fe640 1 -- 172.21.15.19:0/1925728229 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ee41a6890 con 0x7f2ee41027a0 2024-09-19T09:01:15.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.700+0000 7f2ee37fe640 1 --2- 172.21.15.19:0/1925728229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ee41027a0 0x7f2ee4074a30 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f2ed800d770 tx=0x7f2ed800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:15.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.701+0000 7f2ee17fa640 1 -- 172.21.15.19:0/1925728229 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8017070 con 0x7f2ee41027a0 2024-09-19T09:01:15.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.701+0000 7f2ee17fa640 1 -- 172.21.15.19:0/1925728229 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ed8005500 con 0x7f2ee41027a0 2024-09-19T09:01:15.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.701+0000 7f2eea40c640 1 -- 172.21.15.19:0/1925728229 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ee41a6b80 con 0x7f2ee41027a0 2024-09-19T09:01:15.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.701+0000 7f2ee17fa640 1 -- 172.21.15.19:0/1925728229 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed8004e00 con 0x7f2ee41027a0 2024-09-19T09:01:15.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.701+0000 7f2eea40c640 1 -- 172.21.15.19:0/1925728229 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ee41a7070 con 0x7f2ee41027a0 2024-09-19T09:01:15.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.703+0000 7f2ee17fa640 1 -- 172.21.15.19:0/1925728229 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f2ed8004fa0 con 0x7f2ee41027a0 2024-09-19T09:01:15.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.703+0000 7f2eec7e5740 1 Processor -- start 2024-09-19T09:01:15.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.703+0000 7f2eec7e5740 1 -- start start 2024-09-19T09:01:15.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.704+0000 7f2eec7e5740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560052246060 0x560052246440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:15.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.704+0000 7f2eec7e5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560052246980 0x560052250d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:15.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.704+0000 7f2eec7e5740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560052251240 0x560052253630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:15.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.704+0000 7f2eec7e5740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5600521ab620 con 0x560052246060 2024-09-19T09:01:15.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.704+0000 7f2eec7e5740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x560052152e50 con 0x560052251240 2024-09-19T09:01:15.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.704+0000 7f2eec7e5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5600521a75e0 con 0x560052246980 2024-09-19T09:01:15.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.704+0000 7f2ee89a9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560052246060 0x560052246440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:15.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.704+0000 7f2ee89a9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560052246060 0x560052246440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33900/0 (socket says 172.21.15.19:33900) 2024-09-19T09:01:15.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.704+0000 7f2ee89a9640 1 -- 172.21.15.19:0/1807338211 learned_addr learned my addr 172.21.15.19:0/1807338211 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:15.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.704+0000 7f2ee17fa640 1 --2- 172.21.15.19:0/1925728229 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2ecc0a3240 0x7f2ecc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:15.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.704+0000 7f2ee3fff640 1 --2- 172.21.15.19:0/1807338211 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560052246980 0x560052250d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:15.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.704+0000 7f2ee89a9640 1 --2- 172.21.15.19:0/1925728229 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2ecc0a3240 0x7f2ecc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:15.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.704+0000 7f2ee17fa640 1 -- 172.21.15.19:0/1925728229 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2ed80cf2d0 con 0x7f2ee41027a0 2024-09-19T09:01:15.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.704+0000 7f2ee37fe640 1 --2- 172.21.15.19:0/1807338211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560052251240 0x560052253630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:15.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.704+0000 7f2ee89a9640 1 -- 172.21.15.19:0/1807338211 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560052246980 msgr2=0x560052250d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:15.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.704+0000 7f2ee89a9640 1 --2- 172.21.15.19:0/1807338211 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560052246980 0x560052250d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.704+0000 7f2ee89a9640 1 -- 172.21.15.19:0/1807338211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560052251240 msgr2=0x560052253630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:15.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.704+0000 7f2ee89a9640 1 --2- 172.21.15.19:0/1807338211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560052251240 0x560052253630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.704+0000 7f2ee89a9640 1 -- 172.21.15.19:0/1807338211 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560052143d40 con 0x560052246060 2024-09-19T09:01:15.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.704+0000 7f2ee89a9640 1 --2- 172.21.15.19:0/1807338211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560052246060 0x560052246440 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f2edc009430 tx=0x7f2edc0039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e5d2917d32b953 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:15.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.705+0000 7f2eca7fc640 1 -- 172.21.15.19:0/1807338211 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2edc0319a0 con 0x560052246060 2024-09-19T09:01:15.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.705+0000 7f2eca7fc640 1 -- 172.21.15.19:0/1807338211 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2edc04f070 con 0x560052246060 2024-09-19T09:01:15.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.705+0000 7f2eca7fc640 1 -- 172.21.15.19:0/1807338211 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2edc02fc40 con 0x560052246060 2024-09-19T09:01:15.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.705+0000 7f2eec7e5740 1 -- 172.21.15.19:0/1807338211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560052246060 msgr2=0x560052246440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:15.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.705+0000 7f2eec7e5740 1 --2- 172.21.15.19:0/1807338211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560052246060 0x560052246440 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f2edc009430 tx=0x7f2edc0039f0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.705+0000 7f2ee89a9640 1 --2- 172.21.15.19:0/1925728229 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2ecc0a3240 0x7f2ecc0a5700 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2edc004af0 tx=0x7f2edc04c000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:15.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.705+0000 7f2eec7e5740 1 -- 172.21.15.19:0/1807338211 shutdown_connections 2024-09-19T09:01:15.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.705+0000 7f2eec7e5740 1 --2- 172.21.15.19:0/1807338211 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560052246980 0x560052250d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.705+0000 7f2eec7e5740 1 --2- 172.21.15.19:0/1807338211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560052251240 0x560052253630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.705+0000 7f2eec7e5740 1 --2- 172.21.15.19:0/1807338211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560052246060 0x560052246440 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.705+0000 7f2eec7e5740 1 -- 172.21.15.19:0/1807338211 >> 172.21.15.19:0/1807338211 conn(0x5600522425f0 msgr2=0x5600522429d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:15.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.705+0000 7f2eec7e5740 1 -- 172.21.15.19:0/1807338211 shutdown_connections 2024-09-19T09:01:15.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.705+0000 7f2eec7e5740 1 -- 172.21.15.19:0/1807338211 wait complete. 2024-09-19T09:01:15.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.706+0000 7f2eec7e5740 1 -- start start 2024-09-19T09:01:15.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.706+0000 7f2eec7e5740 1 Processor -- start 2024-09-19T09:01:15.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.706+0000 7f2eec7e5740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560052246060 0x56005224e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:15.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.706+0000 7f2eec7e5740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560052246980 0x56005224e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:15.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.706+0000 7f2eec7e5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560052251240 0x56005224eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:15.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.706+0000 7f2eec7e5740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560052253c90 con 0x560052246060 2024-09-19T09:01:15.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.706+0000 7f2eec7e5740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x560052133f10 con 0x560052246980 2024-09-19T09:01:15.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.706+0000 7f2eec7e5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560052253e10 con 0x560052251240 2024-09-19T09:01:15.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.706+0000 7f2eec7e5740 10 client.0 _ll_register_callbacks cb 0x560052157db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:15.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.706+0000 7f2ee3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560052246060 0x56005224e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:15.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.706+0000 7f2ee3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560052246060 0x56005224e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33908/0 (socket says 172.21.15.19:33908) 2024-09-19T09:01:15.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.706+0000 7f2ee3fff640 1 -- 172.21.15.19:0/4088744686 learned_addr learned my addr 172.21.15.19:0/4088744686 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:15.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.707+0000 7f2ee37fe640 1 --2- 172.21.15.19:0/4088744686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560052246980 0x56005224e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:15.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.707+0000 7f2ee89a9640 1 --2- 172.21.15.19:0/4088744686 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560052251240 0x56005224eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:15.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.707+0000 7f2ee3fff640 1 -- 172.21.15.19:0/4088744686 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560052251240 msgr2=0x56005224eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:15.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.707+0000 7f2ee3fff640 1 --2- 172.21.15.19:0/4088744686 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560052251240 0x56005224eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.707+0000 7f2ee3fff640 1 -- 172.21.15.19:0/4088744686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560052246980 msgr2=0x56005224e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:15.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.707+0000 7f2ee3fff640 1 --2- 172.21.15.19:0/4088744686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560052246980 0x56005224e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.707+0000 7f2ee3fff640 1 -- 172.21.15.19:0/4088744686 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560051eba580 con 0x560052246060 2024-09-19T09:01:15.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.707+0000 7f2ee37fe640 1 --2- 172.21.15.19:0/4088744686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560052246980 0x56005224e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:01:15.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.707+0000 7f2ee3fff640 1 --2- 172.21.15.19:0/4088744686 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560052246060 0x56005224e0c0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f2ed400ded0 tx=0x7f2ed40117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5977b21c1cbf741c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:15.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.707+0000 7f2ec37fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:01:15.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.707+0000 7f2ec37fe640 1 -- 172.21.15.19:0/4088744686 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed4004220 con 0x560052246060 2024-09-19T09:01:15.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.707+0000 7f2ec37fe640 1 -- 172.21.15.19:0/4088744686 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2ed40043c0 con 0x560052246060 2024-09-19T09:01:15.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.707+0000 7f2eec7e5740 1 -- 172.21.15.19:0/4088744686 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2edc04f070 con 0x560052246060 2024-09-19T09:01:15.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.707+0000 7f2ec37fe640 1 -- 172.21.15.19:0/4088744686 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f2ed4005020 con 0x560052246060 2024-09-19T09:01:15.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.707+0000 7f2eec7e5740 10 client.17478 fetch_fsmap learned FSMap version 36 2024-09-19T09:01:15.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.707+0000 7f2eec7e5740 1 -- 172.21.15.19:0/4088744686 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x560051f84960 con 0x560052246060 2024-09-19T09:01:15.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.708+0000 7f2ec37fe640 1 -- 172.21.15.19:0/4088744686 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2edc04f070 con 0x560052246060 2024-09-19T09:01:15.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.708+0000 7f2ec37fe640 1 -- 172.21.15.19:0/4088744686 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f2ed40035f0 con 0x560052246060 2024-09-19T09:01:15.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.708+0000 7f2eec7e5740 10 client.17478 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:01:15.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.708+0000 7f2eec7e5740 10 client.17478 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:01:15.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.708+0000 7f2eec7e5740 20 client.17478 populate_metadata read hostname 'smithi019' 2024-09-19T09:01:15.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.708+0000 7f2eec7e5740 1 --2- 172.21.15.19:0/4088744686 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560052260ca0 0x560052263160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:15.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.708+0000 7f2eec7e5740 4 client.17478 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:01:15.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.708+0000 7f2eec7e5740 1 -- 172.21.15.19:0/4088744686 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5600521b8b90 con 0x560052260ca0 2024-09-19T09:01:15.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.708+0000 7f2ee37fe640 1 --2- 172.21.15.19:0/4088744686 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560052260ca0 0x560052263160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:15.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.709+0000 7f2ee37fe640 1 --2- 172.21.15.19:0/4088744686 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560052260ca0 0x560052263160 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4e74f02a84eeb91 server_cookie=14e8973b109f3f27 in_seq=0 out_seq=0 2024-09-19T09:01:15.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.709+0000 7f2ec37fe640 10 client.17478 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:15.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.709+0000 7f2ec37fe640 1 -- 172.21.15.19:0/4088744686 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5600521b8b90 con 0x560052260ca0 2024-09-19T09:01:15.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.709+0000 7f2ec37fe640 10 client.17478 handle_command_reply: tid=0 2024-09-19T09:01:15.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.709+0000 7f2eec7e5740 1 client.17478 shutdown 2024-09-19T09:01:15.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.710+0000 7f2eec7e5740 1 -- 172.21.15.19:0/4088744686 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560052246060 msgr2=0x56005224e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:15.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.710+0000 7f2eec7e5740 1 --2- 172.21.15.19:0/4088744686 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560052246060 0x56005224e0c0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f2ed400ded0 tx=0x7f2ed40117b0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.710+0000 7f2eec7e5740 1 -- 172.21.15.19:0/4088744686 shutdown_connections 2024-09-19T09:01:15.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.710+0000 7f2eec7e5740 1 --2- 172.21.15.19:0/4088744686 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560052260ca0 0x560052263160 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.710+0000 7f2eec7e5740 1 --2- 172.21.15.19:0/4088744686 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560052251240 0x56005224eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.710+0000 7f2eec7e5740 1 --2- 172.21.15.19:0/4088744686 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560052246980 0x56005224e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.710+0000 7f2ec37fe640 0 client.17478 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:15.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.710+0000 7f2eec7e5740 1 --2- 172.21.15.19:0/4088744686 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560052246060 0x56005224e0c0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.710+0000 7f2eec7e5740 1 -- 172.21.15.19:0/4088744686 >> 172.21.15.19:0/4088744686 conn(0x5600522425f0 msgr2=0x5600522482d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:15.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.710+0000 7f2eec7e5740 1 -- 172.21.15.19:0/4088744686 shutdown_connections 2024-09-19T09:01:15.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.710+0000 7f2eec7e5740 1 -- 172.21.15.19:0/4088744686 wait complete. 2024-09-19T09:01:15.719 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.710+0000 7f2eec7e5740 20 client.17478 trim_cache size 0 max 16384 2024-09-19T09:01:15.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.727+0000 7f2eec7e5740 1 Processor -- start 2024-09-19T09:01:15.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.727+0000 7f2eec7e5740 1 -- start start 2024-09-19T09:01:15.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.727+0000 7f2eec7e5740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560052246060 0x560052268a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:15.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.727+0000 7f2eec7e5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560052246980 0x560052268fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:15.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.727+0000 7f2eec7e5740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560052251240 0x56005224b340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:15.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.727+0000 7f2eec7e5740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee41af5d0 con 0x560052246060 2024-09-19T09:01:15.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.727+0000 7f2eec7e5740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee41b1110 con 0x560052251240 2024-09-19T09:01:15.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.727+0000 7f2eec7e5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee41afca0 con 0x560052246980 2024-09-19T09:01:15.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.727+0000 7f2ee3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560052246060 0x560052268a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:15.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.727+0000 7f2ee3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560052246060 0x560052268a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33924/0 (socket says 172.21.15.19:33924) 2024-09-19T09:01:15.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.727+0000 7f2ee3fff640 1 -- 172.21.15.19:0/3899483871 learned_addr learned my addr 172.21.15.19:0/3899483871 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:15.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.727+0000 7f2ee89a9640 1 --2- 172.21.15.19:0/3899483871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560052251240 0x56005224b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:15.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.727+0000 7f2ee37fe640 1 --2- 172.21.15.19:0/3899483871 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560052246980 0x560052268fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:15.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.728+0000 7f2ee3fff640 1 -- 172.21.15.19:0/3899483871 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560052246980 msgr2=0x560052268fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:15.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.728+0000 7f2ee3fff640 1 --2- 172.21.15.19:0/3899483871 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560052246980 0x560052268fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.728+0000 7f2ee3fff640 1 -- 172.21.15.19:0/3899483871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560052251240 msgr2=0x56005224b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:15.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.728+0000 7f2ee3fff640 1 --2- 172.21.15.19:0/3899483871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560052251240 0x56005224b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.728+0000 7f2ee3fff640 1 -- 172.21.15.19:0/3899483871 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560052242420 con 0x560052246060 2024-09-19T09:01:15.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.728+0000 7f2ee3fff640 1 --2- 172.21.15.19:0/3899483871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560052246060 0x560052268a80 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f2ed400dea0 tx=0x7f2ed4003e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a97f1a4d8935fdf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:15.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.728+0000 7f2ec9ffb640 1 -- 172.21.15.19:0/3899483871 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed4003670 con 0x560052246060 2024-09-19T09:01:15.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.728+0000 7f2ec9ffb640 1 -- 172.21.15.19:0/3899483871 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ed4003810 con 0x560052246060 2024-09-19T09:01:15.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.728+0000 7f2ec9ffb640 1 -- 172.21.15.19:0/3899483871 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed4004970 con 0x560052246060 2024-09-19T09:01:15.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.729+0000 7f2eec7e5740 1 -- 172.21.15.19:0/3899483871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560052246060 msgr2=0x560052268a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:15.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.729+0000 7f2eec7e5740 1 --2- 172.21.15.19:0/3899483871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560052246060 0x560052268a80 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f2ed400dea0 tx=0x7f2ed4003e80 comp rx=0 tx=0).stop 2024-09-19T09:01:15.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.729+0000 7f2eec7e5740 1 -- 172.21.15.19:0/3899483871 shutdown_connections 2024-09-19T09:01:15.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.729+0000 7f2eec7e5740 1 --2- 172.21.15.19:0/3899483871 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560052246980 0x560052268fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.729+0000 7f2eec7e5740 1 --2- 172.21.15.19:0/3899483871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560052251240 0x56005224b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.729+0000 7f2eec7e5740 1 --2- 172.21.15.19:0/3899483871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560052246060 0x560052268a80 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.729+0000 7f2eec7e5740 1 -- 172.21.15.19:0/3899483871 >> 172.21.15.19:0/3899483871 conn(0x5600522425f0 msgr2=0x56005224c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:15.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.729+0000 7f2eec7e5740 1 -- 172.21.15.19:0/3899483871 shutdown_connections 2024-09-19T09:01:15.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.729+0000 7f2eec7e5740 1 -- 172.21.15.19:0/3899483871 wait complete. 2024-09-19T09:01:15.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.729+0000 7f2eec7e5740 1 -- start start 2024-09-19T09:01:15.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.729+0000 7f2eec7e5740 1 Processor -- start 2024-09-19T09:01:15.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.730+0000 7f2eec7e5740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560052246060 0x560052259090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:15.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.730+0000 7f2eec7e5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560052246980 0x5600522595d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:15.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.730+0000 7f2eec7e5740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560052251240 0x560052256060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:15.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.730+0000 7f2eec7e5740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee41b0a40 con 0x560052246060 2024-09-19T09:01:15.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.730+0000 7f2eec7e5740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee41b0370 con 0x560052251240 2024-09-19T09:01:15.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.730+0000 7f2eec7e5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2ee41ad5b0 con 0x560052246980 2024-09-19T09:01:15.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.730+0000 7f2eec7e5740 10 client.0 _ll_register_callbacks cb 0x7f2ed400da60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:15.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.730+0000 7f2ee3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560052246060 0x560052259090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:15.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.730+0000 7f2ee3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560052246060 0x560052259090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33936/0 (socket says 172.21.15.19:33936) 2024-09-19T09:01:15.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.730+0000 7f2ee3fff640 1 -- 172.21.15.19:0/1447460942 learned_addr learned my addr 172.21.15.19:0/1447460942 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:15.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.730+0000 7f2ee37fe640 1 --2- 172.21.15.19:0/1447460942 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560052246980 0x5600522595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:15.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.730+0000 7f2ee89a9640 1 --2- 172.21.15.19:0/1447460942 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560052251240 0x560052256060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:15.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.730+0000 7f2ee3fff640 1 -- 172.21.15.19:0/1447460942 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560052246980 msgr2=0x5600522595d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:15.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.730+0000 7f2ee3fff640 1 --2- 172.21.15.19:0/1447460942 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560052246980 0x5600522595d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.730+0000 7f2ee3fff640 1 -- 172.21.15.19:0/1447460942 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560052251240 msgr2=0x560052256060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:15.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.730+0000 7f2ee3fff640 1 --2- 172.21.15.19:0/1447460942 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560052251240 0x560052256060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:15.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.730+0000 7f2ee3fff640 1 -- 172.21.15.19:0/1447460942 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5600522565d0 con 0x560052246060 2024-09-19T09:01:15.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.730+0000 7f2ee3fff640 1 --2- 172.21.15.19:0/1447460942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560052246060 0x560052259090 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f2ed40039e0 tx=0x7f2ed4004320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c78b879e1502a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:15.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.730+0000 7f2ec37fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:01:15.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.730+0000 7f2ec37fe640 1 -- 172.21.15.19:0/1447460942 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ed4038060 con 0x560052246060 2024-09-19T09:01:15.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.731+0000 7f2ec37fe640 1 -- 172.21.15.19:0/1447460942 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2ed40051c0 con 0x560052246060 2024-09-19T09:01:15.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.731+0000 7f2eec7e5740 1 -- 172.21.15.19:0/1447460942 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ed4003810 con 0x560052246060 2024-09-19T09:01:15.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.731+0000 7f2ec37fe640 1 -- 172.21.15.19:0/1447460942 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f2ed4011cb0 con 0x560052246060 2024-09-19T09:01:15.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.731+0000 7f2eec7e5740 10 client.17484 fetch_fsmap learned FSMap version 36 2024-09-19T09:01:15.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.731+0000 7f2eec7e5740 1 -- 172.21.15.19:0/1447460942 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5600522cc300 con 0x560052246060 2024-09-19T09:01:15.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.731+0000 7f2ec37fe640 1 -- 172.21.15.19:0/1447460942 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2ed4003810 con 0x560052246060 2024-09-19T09:01:15.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.731+0000 7f2ec37fe640 1 -- 172.21.15.19:0/1447460942 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f2ed401b480 con 0x560052246060 2024-09-19T09:01:15.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.731+0000 7f2eec7e5740 10 client.17484 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:01:15.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.731+0000 7f2eec7e5740 10 client.17484 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:01:15.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.731+0000 7f2eec7e5740 20 client.17484 populate_metadata read hostname 'smithi019' 2024-09-19T09:01:15.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.731+0000 7f2eec7e5740 1 --2- 172.21.15.19:0/1447460942 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560052260ca0 0x5600522cea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:15.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.731+0000 7f2eec7e5740 4 client.17484 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "eb8ec178", "release": true, "await": true}] 2024-09-19T09:01:15.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.731+0000 7f2eec7e5740 1 -- 172.21.15.19:0/1447460942 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "quiesce db", "set_id": "eb8ec178", "release": true, "await": true}) -- 0x5600521b30a0 con 0x560052260ca0 2024-09-19T09:01:15.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.731+0000 7f2ee37fe640 1 --2- 172.21.15.19:0/1447460942 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560052260ca0 0x5600522cea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:15.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.732+0000 7f2ee37fe640 1 --2- 172.21.15.19:0/1447460942 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560052260ca0 0x5600522cea90 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4d7c174ce5fe393 server_cookie=3a191d9ea56babdb in_seq=0 out_seq=0 2024-09-19T09:01:15.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:15.732+0000 7f2ec37fe640 10 client.17484 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:15.736 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:15 smithi203 ceph-mon[35450]: pgmap v608: 97 pgs: 97 active+clean; 4.5 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 120 KiB/s wr, 2.79k op/s 2024-09-19T09:01:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.095+0000 7fc142ffd640 1 -- 172.21.15.19:0/2349511970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc13c102610 msgr2=0x7fc13c108ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.095+0000 7fc142ffd640 1 --2- 172.21.15.19:0/2349511970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc13c102610 0x7fc13c108ea0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fc134009ca0 tx=0x7fc13402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:01:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.095+0000 7fc142ffd640 1 -- 172.21.15.19:0/2349511970 shutdown_connections 2024-09-19T09:01:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.095+0000 7fc142ffd640 1 --2- 172.21.15.19:0/2349511970 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc13c102610 0x7fc13c108ea0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.095+0000 7fc142ffd640 1 --2- 172.21.15.19:0/2349511970 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc13c101c50 0x7fc13c1020d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.095+0000 7fc142ffd640 1 --2- 172.21.15.19:0/2349511970 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc13c100a60 0x7fc13c100e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.095+0000 7fc142ffd640 1 -- 172.21.15.19:0/2349511970 >> 172.21.15.19:0/2349511970 conn(0x7fc13c0fc1e0 msgr2=0x7fc13c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.095+0000 7fc142ffd640 1 -- 172.21.15.19:0/2349511970 shutdown_connections 2024-09-19T09:01:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.095+0000 7fc142ffd640 1 -- 172.21.15.19:0/2349511970 wait complete. 2024-09-19T09:01:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.095+0000 7fc142ffd640 1 Processor -- start 2024-09-19T09:01:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.095+0000 7fc142ffd640 1 -- start start 2024-09-19T09:01:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.096+0000 7fc142ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc13c100a60 0x7fc13c196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.096+0000 7fc142ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc13c101c50 0x7fc13c1971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.096+0000 7fc142ffd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc13c102610 0x7fc13c19e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.096+0000 7fc142ffd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc13c10c6e0 con 0x7fc13c100a60 2024-09-19T09:01:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.096+0000 7fc142ffd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc13c10c560 con 0x7fc13c101c50 2024-09-19T09:01:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.096+0000 7fc142ffd640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc13c10c860 con 0x7fc13c102610 2024-09-19T09:01:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.096+0000 7fc140d99640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc13c100a60 0x7fc13c196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.096+0000 7fc140d99640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc13c100a60 0x7fc13c196ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33948/0 (socket says 172.21.15.19:33948) 2024-09-19T09:01:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.096+0000 7fc140d99640 1 -- 172.21.15.19:0/1629633887 learned_addr learned my addr 172.21.15.19:0/1629633887 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.096+0000 7fc14159a640 1 --2- 172.21.15.19:0/1629633887 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc13c102610 0x7fc13c19e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.096+0000 7fc13bfff640 1 --2- 172.21.15.19:0/1629633887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc13c101c50 0x7fc13c1971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:16.098 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.096+0000 7fc140d99640 1 -- 172.21.15.19:0/1629633887 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc13c102610 msgr2=0x7fc13c19e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.096+0000 7fc140d99640 1 --2- 172.21.15.19:0/1629633887 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc13c102610 0x7fc13c19e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.096+0000 7fc140d99640 1 -- 172.21.15.19:0/1629633887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc13c101c50 msgr2=0x7fc13c1971e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.096+0000 7fc140d99640 1 --2- 172.21.15.19:0/1629633887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc13c101c50 0x7fc13c1971e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.096+0000 7fc140d99640 1 -- 172.21.15.19:0/1629633887 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc13c19e8e0 con 0x7fc13c100a60 2024-09-19T09:01:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.096+0000 7fc140d99640 1 --2- 172.21.15.19:0/1629633887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc13c100a60 0x7fc13c196ca0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fc12c00d950 tx=0x7fc12c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.096+0000 7fc139ffb640 1 -- 172.21.15.19:0/1629633887 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc12c017070 con 0x7fc13c100a60 2024-09-19T09:01:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.096+0000 7fc139ffb640 1 -- 172.21.15.19:0/1629633887 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc12c009c30 con 0x7fc13c100a60 2024-09-19T09:01:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.096+0000 7fc142ffd640 1 -- 172.21.15.19:0/1629633887 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc13c19ebd0 con 0x7fc13c100a60 2024-09-19T09:01:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.096+0000 7fc139ffb640 1 -- 172.21.15.19:0/1629633887 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc12c00f600 con 0x7fc13c100a60 2024-09-19T09:01:16.099 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.097+0000 7fc142ffd640 1 -- 172.21.15.19:0/1629633887 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc13c19f0d0 con 0x7fc13c100a60 2024-09-19T09:01:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.100+0000 7fc145e7f740 1 Processor -- start 2024-09-19T09:01:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.100+0000 7fc139ffb640 1 -- 172.21.15.19:0/1629633887 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fc12c01a070 con 0x7fc13c100a60 2024-09-19T09:01:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.100+0000 7fc145e7f740 1 -- start start 2024-09-19T09:01:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.100+0000 7fc145e7f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55708bf97f30 0x55708bf96770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.100+0000 7fc145e7f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55708bf98330 0x55708bf96cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.100+0000 7fc145e7f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55708bf972d0 0x55708bfa2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.100+0000 7fc145e7f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55708befa2f0 con 0x55708bf972d0 2024-09-19T09:01:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.100+0000 7fc145e7f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55708bea2270 con 0x55708bf97f30 2024-09-19T09:01:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.100+0000 7fc145e7f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55708bef62b0 con 0x55708bf98330 2024-09-19T09:01:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.100+0000 7fc13bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55708bf972d0 0x55708bfa2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.100+0000 7fc14159a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55708bf97f30 0x55708bf96770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.100+0000 7fc14159a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55708bf97f30 0x55708bf96770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:36146/0 (socket says 172.21.15.19:36146) 2024-09-19T09:01:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.100+0000 7fc14159a640 1 -- 172.21.15.19:0/893256786 learned_addr learned my addr 172.21.15.19:0/893256786 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.100+0000 7fc140d99640 1 --2- 172.21.15.19:0/893256786 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55708bf98330 0x55708bf96cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.100+0000 7fc14159a640 1 -- 172.21.15.19:0/893256786 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55708bf98330 msgr2=0x55708bf96cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.100+0000 7fc14159a640 1 --2- 172.21.15.19:0/893256786 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55708bf98330 0x55708bf96cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.100+0000 7fc14159a640 1 -- 172.21.15.19:0/893256786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55708bf972d0 msgr2=0x55708bfa2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.100+0000 7fc14159a640 1 --2- 172.21.15.19:0/893256786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55708bf972d0 0x55708bfa2cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.100+0000 7fc14159a640 1 -- 172.21.15.19:0/893256786 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55708bea1340 con 0x55708bf97f30 2024-09-19T09:01:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.100+0000 7fc139ffb640 1 --2- 172.21.15.19:0/1629633887 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc1240a32f0 0x7fc1240a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.101+0000 7fc140d99640 1 --2- 172.21.15.19:0/1629633887 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc1240a32f0 0x7fc1240a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.101+0000 7fc14159a640 1 --2- 172.21.15.19:0/893256786 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55708bf97f30 0x55708bf96770 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc134009ca0 tx=0x7fc134009360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a49c0049695d63 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.101+0000 7fc139ffb640 1 -- 172.21.15.19:0/1629633887 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc12c0cf2e0 con 0x7fc13c100a60 2024-09-19T09:01:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.101+0000 7fc122ffd640 1 -- 172.21.15.19:0/893256786 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1340098c0 con 0x55708bf97f30 2024-09-19T09:01:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.101+0000 7fc122ffd640 1 -- 172.21.15.19:0/893256786 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc134036040 con 0x55708bf97f30 2024-09-19T09:01:16.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.101+0000 7fc122ffd640 1 -- 172.21.15.19:0/893256786 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc134004230 con 0x55708bf97f30 2024-09-19T09:01:16.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.102+0000 7fc145e7f740 1 -- 172.21.15.19:0/893256786 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55708bf97f30 msgr2=0x55708bf96770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:16.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.102+0000 7fc140d99640 1 --2- 172.21.15.19:0/1629633887 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc1240a32f0 0x7fc1240a57b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc12c0cd160 tx=0x7fc12c010ce0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:16.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.102+0000 7fc145e7f740 1 --2- 172.21.15.19:0/893256786 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55708bf97f30 0x55708bf96770 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc134009ca0 tx=0x7fc134009360 comp rx=0 tx=0).stop 2024-09-19T09:01:16.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.102+0000 7fc145e7f740 1 -- 172.21.15.19:0/893256786 shutdown_connections 2024-09-19T09:01:16.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.102+0000 7fc145e7f740 1 --2- 172.21.15.19:0/893256786 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55708bf98330 0x55708bf96cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:16.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.102+0000 7fc145e7f740 1 --2- 172.21.15.19:0/893256786 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55708bf972d0 0x55708bfa2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:16.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.102+0000 7fc145e7f740 1 --2- 172.21.15.19:0/893256786 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55708bf97f30 0x55708bf96770 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:16.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.102+0000 7fc145e7f740 1 -- 172.21.15.19:0/893256786 >> 172.21.15.19:0/893256786 conn(0x55708bf92010 msgr2=0x55708bf92410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:16.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.102+0000 7fc145e7f740 1 -- 172.21.15.19:0/893256786 shutdown_connections 2024-09-19T09:01:16.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.102+0000 7fc145e7f740 1 -- 172.21.15.19:0/893256786 wait complete. 2024-09-19T09:01:16.108 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.102+0000 7fc145e7f740 1 -- start start 2024-09-19T09:01:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.102+0000 7fc145e7f740 1 Processor -- start 2024-09-19T09:01:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.103+0000 7fc145e7f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55708bf972d0 0x55708bfa4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.103+0000 7fc145e7f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55708bf97f30 0x55708bfa5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.103+0000 7fc145e7f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55708bf98330 0x55708bfac2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.103+0000 7fc145e7f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55708bfa3510 con 0x55708bf97f30 2024-09-19T09:01:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.103+0000 7fc145e7f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55708be83290 con 0x55708bf972d0 2024-09-19T09:01:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.103+0000 7fc145e7f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55708bfa3690 con 0x55708bf98330 2024-09-19T09:01:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.103+0000 7fc145e7f740 10 client.0 _ll_register_callbacks cb 0x55708beb4140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.103+0000 7fc13bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55708bf97f30 0x55708bfa5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.103+0000 7fc14159a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55708bf972d0 0x55708bfa4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.103+0000 7fc14159a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55708bf972d0 0x55708bfa4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:36148/0 (socket says 172.21.15.19:36148) 2024-09-19T09:01:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.103+0000 7fc14159a640 1 -- 172.21.15.19:0/1542219501 learned_addr learned my addr 172.21.15.19:0/1542219501 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.103+0000 7fc13bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55708bf97f30 0x55708bfa5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33970/0 (socket says 172.21.15.19:33970) 2024-09-19T09:01:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.103+0000 7fc14159a640 1 --2- 172.21.15.19:0/1542219501 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55708bf98330 0x55708bfac2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.103+0000 7fc13bfff640 1 -- 172.21.15.19:0/1542219501 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55708bf98330 msgr2=0x55708bfac2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.103+0000 7fc13bfff640 1 --2- 172.21.15.19:0/1542219501 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55708bf98330 0x55708bfac2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.103+0000 7fc13bfff640 1 -- 172.21.15.19:0/1542219501 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55708bf972d0 msgr2=0x55708bfa4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.103+0000 7fc13bfff640 1 --2- 172.21.15.19:0/1542219501 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55708bf972d0 0x55708bfa4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.103+0000 7fc13bfff640 1 -- 172.21.15.19:0/1542219501 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55708bc0d210 con 0x55708bf97f30 2024-09-19T09:01:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.103+0000 7fc14159a640 1 --2- 172.21.15.19:0/1542219501 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55708bf972d0 0x55708bfa4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.103+0000 7fc13bfff640 1 --2- 172.21.15.19:0/1542219501 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55708bf97f30 0x55708bfa5310 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fc13c1981a0 tx=0x7fc130012b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbe8df6d1ba8be28 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.103+0000 7fc11bfff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:01:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.103+0000 7fc11bfff640 1 -- 172.21.15.19:0/1542219501 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc13000f8c0 con 0x55708bf97f30 2024-09-19T09:01:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.103+0000 7fc11bfff640 1 -- 172.21.15.19:0/1542219501 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc13000fa60 con 0x55708bf97f30 2024-09-19T09:01:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.103+0000 7fc145e7f740 1 -- 172.21.15.19:0/1542219501 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc134036040 con 0x55708bf97f30 2024-09-19T09:01:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.104+0000 7fc11bfff640 1 -- 172.21.15.19:0/1542219501 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fc13000fc60 con 0x55708bf97f30 2024-09-19T09:01:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.104+0000 7fc145e7f740 10 client.17496 fetch_fsmap learned FSMap version 36 2024-09-19T09:01:16.111 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.104+0000 7fc145e7f740 1 -- 172.21.15.19:0/1542219501 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55708bcd9620 con 0x55708bf97f30 2024-09-19T09:01:16.111 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.104+0000 7fc11bfff640 1 -- 172.21.15.19:0/1542219501 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc134036040 con 0x55708bf97f30 2024-09-19T09:01:16.111 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.104+0000 7fc11bfff640 1 -- 172.21.15.19:0/1542219501 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fc13001c420 con 0x55708bf97f30 2024-09-19T09:01:16.111 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.104+0000 7fc145e7f740 10 client.17496 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:01:16.111 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.104+0000 7fc145e7f740 10 client.17496 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:01:16.111 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.104+0000 7fc145e7f740 20 client.17496 populate_metadata read hostname 'smithi019' 2024-09-19T09:01:16.111 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.104+0000 7fc145e7f740 1 --2- 172.21.15.19:0/1542219501 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55708bfb0a60 0x55708bfb2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:16.111 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.104+0000 7fc145e7f740 4 client.17496 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:01:16.111 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.104+0000 7fc145e7f740 1 -- 172.21.15.19:0/1542219501 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55708bf07a20 con 0x55708bfb0a60 2024-09-19T09:01:16.111 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.104+0000 7fc14159a640 1 --2- 172.21.15.19:0/1542219501 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55708bfb0a60 0x55708bfb2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:16.111 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.105+0000 7fc14159a640 1 --2- 172.21.15.19:0/1542219501 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55708bfb0a60 0x55708bfb2eb0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aeabf044f9a9834e server_cookie=18236be89a75851e in_seq=0 out_seq=0 2024-09-19T09:01:16.111 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.105+0000 7fc11bfff640 10 client.17496 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:16.994 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.993+0000 7fc11bfff640 1 -- 172.21.15.19:0/1542219501 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55708bf07a20 con 0x55708bfb0a60 2024-09-19T09:01:16.994 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.993+0000 7fc11bfff640 10 client.17496 handle_command_reply: tid=0 2024-09-19T09:01:16.994 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.993+0000 7fc145e7f740 1 client.17496 shutdown 2024-09-19T09:01:16.994 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.993+0000 7fc145e7f740 1 -- 172.21.15.19:0/1542219501 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55708bf97f30 msgr2=0x55708bfa5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:16.994 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.993+0000 7fc145e7f740 1 --2- 172.21.15.19:0/1542219501 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55708bf97f30 0x55708bfa5310 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fc13c1981a0 tx=0x7fc130012b60 comp rx=0 tx=0).stop 2024-09-19T09:01:16.994 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.993+0000 7fc145e7f740 1 -- 172.21.15.19:0/1542219501 shutdown_connections 2024-09-19T09:01:16.994 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.993+0000 7fc145e7f740 1 --2- 172.21.15.19:0/1542219501 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55708bfb0a60 0x55708bfb2eb0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:16.995 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.993+0000 7fc11bfff640 0 client.17496 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:16.995 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.993+0000 7fc145e7f740 1 --2- 172.21.15.19:0/1542219501 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55708bf98330 0x55708bfac2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:16.995 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.993+0000 7fc145e7f740 1 --2- 172.21.15.19:0/1542219501 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55708bf97f30 0x55708bfa5310 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:16.995 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.993+0000 7fc145e7f740 1 --2- 172.21.15.19:0/1542219501 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55708bf972d0 0x55708bfa4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:16.995 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.993+0000 7fc145e7f740 1 -- 172.21.15.19:0/1542219501 >> 172.21.15.19:0/1542219501 conn(0x55708bf92010 msgr2=0x55708bf93000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:16.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:16.993+0000 7f2ec37fe640 1 -- 172.21.15.19:0/1447460942 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5600521b30a0 con 0x560052260ca0 2024-09-19T09:01:16.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:16.993+0000 7f2ec37fe640 10 client.17484 handle_command_reply: tid=0 2024-09-19T09:01:16.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:16.993+0000 7f2eec7e5740 1 client.17484 shutdown 2024-09-19T09:01:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.994+0000 7fc145e7f740 1 -- 172.21.15.19:0/1542219501 shutdown_connections 2024-09-19T09:01:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.994+0000 7fc145e7f740 1 -- 172.21.15.19:0/1542219501 wait complete. 2024-09-19T09:01:16.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:16.994+0000 7f2eec7e5740 1 -- 172.21.15.19:0/1447460942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560052246060 msgr2=0x560052259090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:16.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:16.994+0000 7f2eec7e5740 1 --2- 172.21.15.19:0/1447460942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560052246060 0x560052259090 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f2ed40039e0 tx=0x7f2ed4004320 comp rx=0 tx=0).stop 2024-09-19T09:01:16.997 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:16.994+0000 7fc145e7f740 20 client.17496 trim_cache size 0 max 16384 2024-09-19T09:01:16.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:16.994+0000 7f2eec7e5740 1 -- 172.21.15.19:0/1447460942 shutdown_connections 2024-09-19T09:01:16.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:16.994+0000 7f2eec7e5740 1 --2- 172.21.15.19:0/1447460942 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560052260ca0 0x5600522cea90 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:16.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:16.994+0000 7f2eec7e5740 1 --2- 172.21.15.19:0/1447460942 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560052246980 0x5600522595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:16.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:16.994+0000 7f2eec7e5740 1 --2- 172.21.15.19:0/1447460942 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560052251240 0x560052256060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:16.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:16.994+0000 7f2eec7e5740 1 --2- 172.21.15.19:0/1447460942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560052246060 0x560052259090 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:16.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:16.994+0000 7f2eec7e5740 1 -- 172.21.15.19:0/1447460942 >> 172.21.15.19:0/1447460942 conn(0x5600522425f0 msgr2=0x560052240f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:16.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:16.994+0000 7f2ec37fe640 0 client.17484 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:16.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:16.994+0000 7f2eec7e5740 1 -- 172.21.15.19:0/1447460942 shutdown_connections 2024-09-19T09:01:16.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:16.994+0000 7f2eec7e5740 1 -- 172.21.15.19:0/1447460942 wait complete. 2024-09-19T09:01:16.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:16.994+0000 7f2eec7e5740 20 client.17484 trim_cache size 0 max 16384 2024-09-19T09:01:16.999 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T09:01:16.999 INFO:teuthology.orchestra.run.smithi019.stdout: "epoch": 35, 2024-09-19T09:01:16.999 INFO:teuthology.orchestra.run.smithi019.stdout: "leader": 24497, 2024-09-19T09:01:16.999 INFO:teuthology.orchestra.run.smithi019.stdout: "set_version": 32, 2024-09-19T09:01:16.999 INFO:teuthology.orchestra.run.smithi019.stdout: "sets": { 2024-09-19T09:01:16.999 INFO:teuthology.orchestra.run.smithi019.stdout: "eb8ec178": { 2024-09-19T09:01:16.999 INFO:teuthology.orchestra.run.smithi019.stdout: "version": 32, 2024-09-19T09:01:16.999 INFO:teuthology.orchestra.run.smithi019.stdout: "age_ref": 0.0, 2024-09-19T09:01:16.999 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T09:01:16.999 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RELEASED", 2024-09-19T09:01:16.999 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T09:01:17.000 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:01:17.000 INFO:teuthology.orchestra.run.smithi019.stdout: "timeout": 90.0, 2024-09-19T09:01:17.000 INFO:teuthology.orchestra.run.smithi019.stdout: "expiration": 145.8, 2024-09-19T09:01:17.000 INFO:teuthology.orchestra.run.smithi019.stdout: "members": { 2024-09-19T09:01:17.000 INFO:teuthology.orchestra.run.smithi019.stdout: "file:/": { 2024-09-19T09:01:17.000 INFO:teuthology.orchestra.run.smithi019.stdout: "excluded": false, 2024-09-19T09:01:17.000 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T09:01:17.000 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RELEASED", 2024-09-19T09:01:17.000 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T09:01:17.000 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:01:17.000 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:01:17.000 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:01:17.000 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:01:17.000 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:01:17.001 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T09:01:17.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:16.995+0000 7f2eea40c640 1 -- 172.21.15.19:0/1925728229 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2ecc0a3240 msgr2=0x7f2ecc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:17.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:16.995+0000 7f2eea40c640 1 --2- 172.21.15.19:0/1925728229 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2ecc0a3240 0x7f2ecc0a5700 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2edc004af0 tx=0x7f2edc04c000 comp rx=0 tx=0).stop 2024-09-19T09:01:17.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:16.995+0000 7f2eea40c640 1 -- 172.21.15.19:0/1925728229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ee41027a0 msgr2=0x7f2ee4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:17.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:16.995+0000 7f2eea40c640 1 --2- 172.21.15.19:0/1925728229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ee41027a0 0x7f2ee4074a30 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f2ed800d770 tx=0x7f2ed800dc30 comp rx=0 tx=0).stop 2024-09-19T09:01:17.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:16.995+0000 7f2eea40c640 1 -- 172.21.15.19:0/1925728229 shutdown_connections 2024-09-19T09:01:17.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:16.995+0000 7f2eea40c640 1 --2- 172.21.15.19:0/1925728229 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2ecc0a3240 0x7f2ecc0a5700 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:17.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:16.995+0000 7f2eea40c640 1 --2- 172.21.15.19:0/1925728229 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ee4106f20 0x7f2ee4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:17.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:16.995+0000 7f2eea40c640 1 --2- 172.21.15.19:0/1925728229 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2ee41027a0 0x7f2ee4074a30 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:17.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:16.995+0000 7f2eea40c640 1 --2- 172.21.15.19:0/1925728229 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2ee4101df0 0x7f2ee40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:17.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:16.995+0000 7f2eea40c640 1 -- 172.21.15.19:0/1925728229 >> 172.21.15.19:0/1925728229 conn(0x7f2ee40fd8f0 msgr2=0x7f2ee40fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:17.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:16.995+0000 7f2eea40c640 1 -- 172.21.15.19:0/1925728229 shutdown_connections 2024-09-19T09:01:17.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:16.995+0000 7f2eea40c640 1 -- 172.21.15.19:0/1925728229 wait complete. 2024-09-19T09:01:17.011 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.011+0000 7fc145e7f740 1 Processor -- start 2024-09-19T09:01:17.011 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.011+0000 7fc145e7f740 1 -- start start 2024-09-19T09:01:17.011 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.011+0000 7fc145e7f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55708bf972d0 0x55708bf910b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:17.011 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.011+0000 7fc145e7f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55708bf97f30 0x55708bfac2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:17.011 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.011+0000 7fc145e7f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55708bf98330 0x55708bf93400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:17.011 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.011+0000 7fc145e7f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc13c1a6c30 con 0x55708bf972d0 2024-09-19T09:01:17.011 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.011+0000 7fc145e7f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc13c1a8770 con 0x55708bf97f30 2024-09-19T09:01:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.011+0000 7fc145e7f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc13c1a7300 con 0x55708bf98330 2024-09-19T09:01:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.012+0000 7fc14159a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55708bf972d0 0x55708bf910b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.012+0000 7fc13bfff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55708bf97f30 0x55708bfac2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.012+0000 7fc14159a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55708bf972d0 0x55708bf910b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33986/0 (socket says 172.21.15.19:33986) 2024-09-19T09:01:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.012+0000 7fc14159a640 1 -- 172.21.15.19:0/3467087730 learned_addr learned my addr 172.21.15.19:0/3467087730 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:17.012 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.012+0000 7fc14159a640 1 --2- 172.21.15.19:0/3467087730 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55708bf98330 0x55708bf93400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.012+0000 7fc14159a640 1 -- 172.21.15.19:0/3467087730 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55708bf98330 msgr2=0x55708bf93400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.012+0000 7fc14159a640 1 --2- 172.21.15.19:0/3467087730 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55708bf98330 0x55708bf93400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.012+0000 7fc14159a640 1 -- 172.21.15.19:0/3467087730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55708bf97f30 msgr2=0x55708bfac2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.012+0000 7fc14159a640 1 --2- 172.21.15.19:0/3467087730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55708bf97f30 0x55708bfac2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.012+0000 7fc14159a640 1 -- 172.21.15.19:0/3467087730 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55708bfad780 con 0x55708bf972d0 2024-09-19T09:01:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.012+0000 7fc13bfff640 1 --2- 172.21.15.19:0/3467087730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55708bf97f30 0x55708bfac2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.012+0000 7fc14159a640 1 --2- 172.21.15.19:0/3467087730 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55708bf972d0 0x55708bf910b0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fc134000f80 tx=0x7fc134005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e6da304c645836 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.013+0000 7fc1227fc640 1 -- 172.21.15.19:0/3467087730 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc134056070 con 0x55708bf972d0 2024-09-19T09:01:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.013+0000 7fc1227fc640 1 -- 172.21.15.19:0/3467087730 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc134036070 con 0x55708bf972d0 2024-09-19T09:01:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.013+0000 7fc1227fc640 1 -- 172.21.15.19:0/3467087730 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc134030900 con 0x55708bf972d0 2024-09-19T09:01:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.013+0000 7fc145e7f740 1 -- 172.21.15.19:0/3467087730 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55708bf972d0 msgr2=0x55708bf910b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.014+0000 7fc145e7f740 1 --2- 172.21.15.19:0/3467087730 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55708bf972d0 0x55708bf910b0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fc134000f80 tx=0x7fc134005d80 comp rx=0 tx=0).stop 2024-09-19T09:01:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.014+0000 7fc145e7f740 1 -- 172.21.15.19:0/3467087730 shutdown_connections 2024-09-19T09:01:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.014+0000 7fc145e7f740 1 --2- 172.21.15.19:0/3467087730 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55708bf98330 0x55708bf93400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.014+0000 7fc145e7f740 1 --2- 172.21.15.19:0/3467087730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55708bf97f30 0x55708bfac2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.014+0000 7fc145e7f740 1 --2- 172.21.15.19:0/3467087730 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55708bf972d0 0x55708bf910b0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.014+0000 7fc145e7f740 1 -- 172.21.15.19:0/3467087730 >> 172.21.15.19:0/3467087730 conn(0x55708bf92010 msgr2=0x55708bf909a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.014+0000 7fc145e7f740 1 -- 172.21.15.19:0/3467087730 shutdown_connections 2024-09-19T09:01:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.014+0000 7fc145e7f740 1 -- 172.21.15.19:0/3467087730 wait complete. 2024-09-19T09:01:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.014+0000 7fc145e7f740 1 -- start start 2024-09-19T09:01:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.014+0000 7fc145e7f740 1 Processor -- start 2024-09-19T09:01:17.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.015+0000 7fc145e7f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55708bf972d0 0x55708bfa9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:17.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.015+0000 7fc145e7f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55708bf97f30 0x55708bfa9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:17.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.015+0000 7fc145e7f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55708bf98330 0x55708bfaa920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.015+0000 7fc145e7f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc13c1a80a0 con 0x55708bf98330 2024-09-19T09:01:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.015+0000 7fc145e7f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc13c1a79d0 con 0x55708bf97f30 2024-09-19T09:01:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.015+0000 7fc145e7f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc13c1a4c10 con 0x55708bf972d0 2024-09-19T09:01:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.015+0000 7fc145e7f740 10 client.0 _ll_register_callbacks cb 0x7fc130009930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.015+0000 7fc14159a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55708bf98330 0x55708bfaa920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.015+0000 7fc14159a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55708bf98330 0x55708bfaa920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33994/0 (socket says 172.21.15.19:33994) 2024-09-19T09:01:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.015+0000 7fc14159a640 1 -- 172.21.15.19:0/1704856622 learned_addr learned my addr 172.21.15.19:0/1704856622 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.015+0000 7fc13bfff640 1 --2- 172.21.15.19:0/1704856622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55708bf97f30 0x55708bfa9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.015+0000 7fc14159a640 1 --2- 172.21.15.19:0/1704856622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55708bf972d0 0x55708bfa9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.015+0000 7fc14159a640 1 -- 172.21.15.19:0/1704856622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55708bf972d0 msgr2=0x55708bfa9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.015+0000 7fc14159a640 1 --2- 172.21.15.19:0/1704856622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55708bf972d0 0x55708bfa9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.015+0000 7fc14159a640 1 -- 172.21.15.19:0/1704856622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55708bf97f30 msgr2=0x55708bfa9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.015+0000 7fc14159a640 1 --2- 172.21.15.19:0/1704856622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55708bf97f30 0x55708bfa9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.015+0000 7fc14159a640 1 -- 172.21.15.19:0/1704856622 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55708bfaaf30 con 0x55708bf98330 2024-09-19T09:01:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.016+0000 7fc14159a640 1 --2- 172.21.15.19:0/1704856622 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55708bf98330 0x55708bfaa920 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fc134009620 tx=0x7fc13403d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51db0d5a41288639 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.016+0000 7fc11bfff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:01:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.016+0000 7fc11bfff640 1 -- 172.21.15.19:0/1704856622 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc134056070 con 0x55708bf98330 2024-09-19T09:01:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.016+0000 7fc11bfff640 1 -- 172.21.15.19:0/1704856622 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc13402f9d0 con 0x55708bf98330 2024-09-19T09:01:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.016+0000 7fc145e7f740 1 -- 172.21.15.19:0/1704856622 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc134036070 con 0x55708bf98330 2024-09-19T09:01:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.016+0000 7fc11bfff640 1 -- 172.21.15.19:0/1704856622 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fc13402fbd0 con 0x55708bf98330 2024-09-19T09:01:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.016+0000 7fc145e7f740 10 client.17502 fetch_fsmap learned FSMap version 36 2024-09-19T09:01:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.016+0000 7fc145e7f740 1 -- 172.21.15.19:0/1704856622 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55708bfac240 con 0x55708bf98330 2024-09-19T09:01:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.016+0000 7fc11bfff640 1 -- 172.21.15.19:0/1704856622 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc134036070 con 0x55708bf98330 2024-09-19T09:01:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.017+0000 7fc11bfff640 1 -- 172.21.15.19:0/1704856622 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fc1340525b0 con 0x55708bf98330 2024-09-19T09:01:17.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.017+0000 7fc145e7f740 10 client.17502 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:01:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.017+0000 7fc145e7f740 10 client.17502 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:01:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.017+0000 7fc145e7f740 20 client.17502 populate_metadata read hostname 'smithi019' 2024-09-19T09:01:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.017+0000 7fc145e7f740 1 --2- 172.21.15.19:0/1704856622 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55708bfb0a60 0x55708c01d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.017+0000 7fc145e7f740 4 client.17502 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:01:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.017+0000 7fc145e7f740 1 -- 172.21.15.19:0/1704856622 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55708bf01d70 con 0x55708bfb0a60 2024-09-19T09:01:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.017+0000 7fc13bfff640 1 --2- 172.21.15.19:0/1704856622 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55708bfb0a60 0x55708c01d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.018+0000 7fc13bfff640 1 --2- 172.21.15.19:0/1704856622 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55708bfb0a60 0x55708c01d7f0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aaef8051f7e7ca3b server_cookie=f877d12d22b090a8 in_seq=0 out_seq=0 2024-09-19T09:01:17.020 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:17.018+0000 7fc11bfff640 10 client.17502 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:17.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:17 smithi019 ceph-mon[30976]: pgmap v609: 97 pgs: 97 active+clean; 4.5 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 43 KiB/s wr, 2.61k op/s 2024-09-19T09:01:17.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:17 smithi155 ceph-mon[34921]: pgmap v609: 97 pgs: 97 active+clean; 4.5 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 43 KiB/s wr, 2.61k op/s 2024-09-19T09:01:17.702 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'eb8ec178', total seconds elapsed: 30.4 2024-09-19T09:01:17.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:17 smithi203 ceph-mon[35450]: pgmap v609: 97 pgs: 97 active+clean; 4.5 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 43 KiB/s wr, 2.61k op/s 2024-09-19T09:01:19.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:19 smithi019 ceph-mon[30976]: pgmap v610: 97 pgs: 97 active+clean; 4.5 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 35 KiB/s wr, 1.71k op/s 2024-09-19T09:01:19.672 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:19 smithi155 ceph-mon[34921]: pgmap v610: 97 pgs: 97 active+clean; 4.5 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 35 KiB/s wr, 1.71k op/s 2024-09-19T09:01:19.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:19 smithi203 ceph-mon[35450]: pgmap v610: 97 pgs: 97 active+clean; 4.5 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 35 KiB/s wr, 1.71k op/s 2024-09-19T09:01:21.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:21 smithi019 ceph-mon[30976]: pgmap v611: 97 pgs: 97 active+clean; 7.3 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 268 KiB/s wr, 249 op/s 2024-09-19T09:01:21.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:21 smithi155 ceph-mon[34921]: pgmap v611: 97 pgs: 97 active+clean; 7.3 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 268 KiB/s wr, 249 op/s 2024-09-19T09:01:21.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:21 smithi203 ceph-mon[35450]: pgmap v611: 97 pgs: 97 active+clean; 7.3 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 268 KiB/s wr, 249 op/s 2024-09-19T09:01:23.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:23 smithi019 ceph-mon[30976]: pgmap v612: 97 pgs: 97 active+clean; 8.8 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 393 KiB/s wr, 255 op/s 2024-09-19T09:01:23.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:23 smithi155 ceph-mon[34921]: pgmap v612: 97 pgs: 97 active+clean; 8.8 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 393 KiB/s wr, 255 op/s 2024-09-19T09:01:23.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:23 smithi203 ceph-mon[35450]: pgmap v612: 97 pgs: 97 active+clean; 8.8 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 255 KiB/s rd, 393 KiB/s wr, 255 op/s 2024-09-19T09:01:24.551 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:24.551+0000 7fc11bfff640 1 -- 172.21.15.19:0/1704856622 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55708bf01d70 con 0x55708bfb0a60 2024-09-19T09:01:24.551 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:24.551+0000 7fc11bfff640 10 client.17502 handle_command_reply: tid=0 2024-09-19T09:01:24.551 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:24.551+0000 7fc145e7f740 1 client.17502 shutdown 2024-09-19T09:01:24.552 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:24.552+0000 7fc145e7f740 1 -- 172.21.15.19:0/1704856622 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55708bf98330 msgr2=0x55708bfaa920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:24.552 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:24.552+0000 7fc145e7f740 1 --2- 172.21.15.19:0/1704856622 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55708bf98330 0x55708bfaa920 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fc134009620 tx=0x7fc13403d040 comp rx=0 tx=0).stop 2024-09-19T09:01:24.552 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:24.552+0000 7fc145e7f740 1 -- 172.21.15.19:0/1704856622 shutdown_connections 2024-09-19T09:01:24.552 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:24.552+0000 7fc145e7f740 1 --2- 172.21.15.19:0/1704856622 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55708bfb0a60 0x55708c01d7f0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.552 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:24.552+0000 7fc145e7f740 1 --2- 172.21.15.19:0/1704856622 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55708bf98330 0x55708bfaa920 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.552 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:24.552+0000 7fc145e7f740 1 --2- 172.21.15.19:0/1704856622 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55708bf97f30 0x55708bfa9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.552 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:24.552+0000 7fc145e7f740 1 --2- 172.21.15.19:0/1704856622 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55708bf972d0 0x55708bfa9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.552 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:24.552+0000 7fc145e7f740 1 -- 172.21.15.19:0/1704856622 >> 172.21.15.19:0/1704856622 conn(0x55708bf92010 msgr2=0x55708bf911c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:24.552 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:24.552+0000 7fc11bfff640 0 client.17502 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:24.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:24.552+0000 7fc145e7f740 1 -- 172.21.15.19:0/1704856622 shutdown_connections 2024-09-19T09:01:24.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:24.552+0000 7fc145e7f740 1 -- 172.21.15.19:0/1704856622 wait complete. 2024-09-19T09:01:24.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:24.552+0000 7fc145e7f740 20 client.17502 trim_cache size 0 max 16384 2024-09-19T09:01:24.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T09:01:24.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T09:01:24.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T09:01:24.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T09:01:24.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:24.553+0000 7fc142ffd640 1 -- 172.21.15.19:0/1629633887 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc1240a32f0 msgr2=0x7fc1240a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:24.553+0000 7fc142ffd640 1 --2- 172.21.15.19:0/1629633887 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc1240a32f0 0x7fc1240a57b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fc12c0cd160 tx=0x7fc12c010ce0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:24.553+0000 7fc142ffd640 1 -- 172.21.15.19:0/1629633887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc13c100a60 msgr2=0x7fc13c196ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:24.553+0000 7fc142ffd640 1 --2- 172.21.15.19:0/1629633887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc13c100a60 0x7fc13c196ca0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fc12c00d950 tx=0x7fc12c00de10 comp rx=0 tx=0).stop 2024-09-19T09:01:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:24.553+0000 7fc142ffd640 1 -- 172.21.15.19:0/1629633887 shutdown_connections 2024-09-19T09:01:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:24.553+0000 7fc142ffd640 1 --2- 172.21.15.19:0/1629633887 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc1240a32f0 0x7fc1240a57b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:24.553+0000 7fc142ffd640 1 --2- 172.21.15.19:0/1629633887 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc13c102610 0x7fc13c19e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:24.553+0000 7fc142ffd640 1 --2- 172.21.15.19:0/1629633887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc13c101c50 0x7fc13c1971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:24.553+0000 7fc142ffd640 1 --2- 172.21.15.19:0/1629633887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc13c100a60 0x7fc13c196ca0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:24.553+0000 7fc142ffd640 1 -- 172.21.15.19:0/1629633887 >> 172.21.15.19:0/1629633887 conn(0x7fc13c0fc1e0 msgr2=0x7fc13c104f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:24.553+0000 7fc142ffd640 1 -- 172.21.15.19:0/1629633887 shutdown_connections 2024-09-19T09:01:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:24.553+0000 7fc142ffd640 1 -- 172.21.15.19:0/1629633887 wait complete. 2024-09-19T09:01:25.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:25 smithi019 ceph-mon[30976]: pgmap v613: 97 pgs: 97 active+clean; 8.8 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 395 KiB/s wr, 312 op/s 2024-09-19T09:01:25.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:25 smithi155 ceph-mon[34921]: pgmap v613: 97 pgs: 97 active+clean; 8.8 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 395 KiB/s wr, 312 op/s 2024-09-19T09:01:25.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:25 smithi203 ceph-mon[35450]: pgmap v613: 97 pgs: 97 active+clean; 8.8 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 395 KiB/s wr, 312 op/s 2024-09-19T09:01:27.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:27 smithi019 ceph-mon[30976]: pgmap v614: 97 pgs: 97 active+clean; 13 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 717 KiB/s wr, 347 op/s 2024-09-19T09:01:27.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:27 smithi155 ceph-mon[34921]: pgmap v614: 97 pgs: 97 active+clean; 13 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 717 KiB/s wr, 347 op/s 2024-09-19T09:01:27.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:27 smithi203 ceph-mon[35450]: pgmap v614: 97 pgs: 97 active+clean; 13 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 718 KiB/s rd, 717 KiB/s wr, 347 op/s 2024-09-19T09:01:29.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:29 smithi019 ceph-mon[30976]: pgmap v615: 97 pgs: 97 active+clean; 16 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 980 KiB/s rd, 979 KiB/s wr, 414 op/s 2024-09-19T09:01:29.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:29 smithi155 ceph-mon[34921]: pgmap v615: 97 pgs: 97 active+clean; 16 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 980 KiB/s rd, 979 KiB/s wr, 414 op/s 2024-09-19T09:01:29.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:29 smithi203 ceph-mon[35450]: pgmap v615: 97 pgs: 97 active+clean; 16 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 980 KiB/s rd, 979 KiB/s wr, 414 op/s 2024-09-19T09:01:31.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:31 smithi019 ceph-mon[30976]: pgmap v616: 97 pgs: 97 active+clean; 16 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 979 KiB/s wr, 427 op/s 2024-09-19T09:01:31.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:31 smithi155 ceph-mon[34921]: pgmap v616: 97 pgs: 97 active+clean; 16 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 979 KiB/s wr, 427 op/s 2024-09-19T09:01:31.731 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:31 smithi203 ceph-mon[35450]: pgmap v616: 97 pgs: 97 active+clean; 16 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 982 KiB/s rd, 979 KiB/s wr, 427 op/s 2024-09-19T09:01:33.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:33 smithi019 ceph-mon[30976]: pgmap v617: 97 pgs: 97 active+clean; 20 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 531 op/s 2024-09-19T09:01:33.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:33 smithi155 ceph-mon[34921]: pgmap v617: 97 pgs: 97 active+clean; 20 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 531 op/s 2024-09-19T09:01:33.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:33 smithi203 ceph-mon[35450]: pgmap v617: 97 pgs: 97 active+clean; 20 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.0 MiB/s wr, 531 op/s 2024-09-19T09:01:34.886 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:01:35.230 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:35.525 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:35 smithi019 ceph-mon[30976]: pgmap v618: 97 pgs: 97 active+clean; 24 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 411 op/s 2024-09-19T09:01:35.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:35 smithi155 ceph-mon[34921]: pgmap v618: 97 pgs: 97 active+clean; 24 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 411 op/s 2024-09-19T09:01:35.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:35 smithi203 ceph-mon[35450]: pgmap v618: 97 pgs: 97 active+clean; 24 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.3 MiB/s wr, 411 op/s 2024-09-19T09:01:35.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.739+0000 7fa9c5f5d640 1 -- 172.21.15.19:0/1315211033 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9c0101420 msgr2=0x7fa9c010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:35.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.739+0000 7fa9c5f5d640 1 --2- 172.21.15.19:0/1315211033 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9c0101420 0x7fa9c010d950 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7fa9b8009c10 tx=0x7fa9b802a6e0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.739+0000 7fa9c5f5d640 1 -- 172.21.15.19:0/1315211033 shutdown_connections 2024-09-19T09:01:35.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.739+0000 7fa9c5f5d640 1 --2- 172.21.15.19:0/1315211033 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9c0101420 0x7fa9c010d950 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.739+0000 7fa9c5f5d640 1 --2- 172.21.15.19:0/1315211033 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9c0100a80 0x7fa9c0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.739+0000 7fa9c5f5d640 1 --2- 172.21.15.19:0/1315211033 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9c0106a80 0x7fa9c0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.739+0000 7fa9c5f5d640 1 -- 172.21.15.19:0/1315211033 >> 172.21.15.19:0/1315211033 conn(0x7fa9c00fc7a0 msgr2=0x7fa9c00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:35.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.739+0000 7fa9c5f5d640 1 -- 172.21.15.19:0/1315211033 shutdown_connections 2024-09-19T09:01:35.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.739+0000 7fa9c5f5d640 1 -- 172.21.15.19:0/1315211033 wait complete. 2024-09-19T09:01:35.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.739+0000 7fa9c5f5d640 1 Processor -- start 2024-09-19T09:01:35.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.739+0000 7fa9c5f5d640 1 -- start start 2024-09-19T09:01:35.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.740+0000 7fa9c5f5d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9c0100a80 0x7fa9c0197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.740+0000 7fa9c5f5d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9c0101420 0x7fa9c0197870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.740+0000 7fa9c5f5d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9c0106a80 0x7fa9c019bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.740+0000 7fa9c5f5d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c0110e30 con 0x7fa9c0100a80 2024-09-19T09:01:35.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.740+0000 7fa9c5f5d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c0110cb0 con 0x7fa9c0106a80 2024-09-19T09:01:35.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.740+0000 7fa9c5f5d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c0110fb0 con 0x7fa9c0101420 2024-09-19T09:01:35.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.740+0000 7fa9bf7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9c0100a80 0x7fa9c0197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.740+0000 7fa9b7fff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9c0101420 0x7fa9c0197870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.740+0000 7fa9bf7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9c0100a80 0x7fa9c0197330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58580/0 (socket says 172.21.15.19:58580) 2024-09-19T09:01:35.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.740+0000 7fa9bf7fe640 1 -- 172.21.15.19:0/3267521559 learned_addr learned my addr 172.21.15.19:0/3267521559 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:35.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.740+0000 7fa9bffff640 1 --2- 172.21.15.19:0/3267521559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9c0106a80 0x7fa9c019bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.740+0000 7fa9b7fff640 1 -- 172.21.15.19:0/3267521559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9c0106a80 msgr2=0x7fa9c019bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:35.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.740+0000 7fa9b7fff640 1 --2- 172.21.15.19:0/3267521559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9c0106a80 0x7fa9c019bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.740+0000 7fa9b7fff640 1 -- 172.21.15.19:0/3267521559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9c0100a80 msgr2=0x7fa9c0197330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:35.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.740+0000 7fa9b7fff640 1 --2- 172.21.15.19:0/3267521559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9c0100a80 0x7fa9c0197330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.740+0000 7fa9b7fff640 1 -- 172.21.15.19:0/3267521559 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9c019c2e0 con 0x7fa9c0101420 2024-09-19T09:01:35.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.740+0000 7fa9bf7fe640 1 --2- 172.21.15.19:0/3267521559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9c0100a80 0x7fa9c0197330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:35.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.740+0000 7fa9bffff640 1 --2- 172.21.15.19:0/3267521559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9c0106a80 0x7fa9c019bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:35.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.740+0000 7fa9b7fff640 1 --2- 172.21.15.19:0/3267521559 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9c0101420 0x7fa9c0197870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa9a800e790 tx=0x7fa9a800ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:35.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.741+0000 7fa9bd7fa640 1 -- 172.21.15.19:0/3267521559 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a800eea0 con 0x7fa9c0101420 2024-09-19T09:01:35.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.741+0000 7fa9bd7fa640 1 -- 172.21.15.19:0/3267521559 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9a800ccc0 con 0x7fa9c0101420 2024-09-19T09:01:35.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.741+0000 7fa9c5f5d640 1 -- 172.21.15.19:0/3267521559 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9c019c5d0 con 0x7fa9c0101420 2024-09-19T09:01:35.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.741+0000 7fa9bd7fa640 1 -- 172.21.15.19:0/3267521559 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a8018780 con 0x7fa9c0101420 2024-09-19T09:01:35.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.741+0000 7fa9c5f5d640 1 -- 172.21.15.19:0/3267521559 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9c006a790 con 0x7fa9c0101420 2024-09-19T09:01:35.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.743+0000 7fa9bd7fa640 1 -- 172.21.15.19:0/3267521559 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fa9a8010430 con 0x7fa9c0101420 2024-09-19T09:01:35.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.743+0000 7fa9c8336740 1 Processor -- start 2024-09-19T09:01:35.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.743+0000 7fa9c8336740 1 -- start start 2024-09-19T09:01:35.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.743+0000 7fa9c8336740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577b1a8c4a0 0x5577b1a8c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.743+0000 7fa9c8336740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577b1a8cdc0 0x5577b1a97140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.743+0000 7fa9c8336740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5577b1a97680 0x5577b1a99a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.743+0000 7fa9c8336740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5577b19f22e0 con 0x5577b1a8cdc0 2024-09-19T09:01:35.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.743+0000 7fa9c8336740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5577b1999ce0 con 0x5577b1a8c4a0 2024-09-19T09:01:35.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.743+0000 7fa9c8336740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5577b19ee2a0 con 0x5577b1a97680 2024-09-19T09:01:35.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.744+0000 7fa9bffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577b1a8c4a0 0x5577b1a8c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.744+0000 7fa9bf7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577b1a8cdc0 0x5577b1a97140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.744+0000 7fa9bffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577b1a8c4a0 0x5577b1a8c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:56984/0 (socket says 172.21.15.19:56984) 2024-09-19T09:01:35.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.744+0000 7fa9bffff640 1 -- 172.21.15.19:0/1267926872 learned_addr learned my addr 172.21.15.19:0/1267926872 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:35.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.744+0000 7fa9bd7fa640 1 --2- 172.21.15.19:0/3267521559 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa9ac0a3240 0x7fa9ac0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.744+0000 7fa9b7fff640 1 --2- 172.21.15.19:0/1267926872 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5577b1a97680 0x5577b1a99a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.744+0000 7fa9bffff640 1 --2- 172.21.15.19:0/3267521559 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa9ac0a3240 0x7fa9ac0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.744+0000 7fa9bf7fe640 1 -- 172.21.15.19:0/1267926872 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5577b1a97680 msgr2=0x5577b1a99a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:35.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.744+0000 7fa9bf7fe640 1 --2- 172.21.15.19:0/1267926872 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5577b1a97680 0x5577b1a99a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.744+0000 7fa9bf7fe640 1 -- 172.21.15.19:0/1267926872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577b1a8c4a0 msgr2=0x5577b1a8c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:35.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.744+0000 7fa9bf7fe640 1 --2- 172.21.15.19:0/1267926872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577b1a8c4a0 0x5577b1a8c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.744+0000 7fa9bf7fe640 1 -- 172.21.15.19:0/1267926872 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577b197e440 con 0x5577b1a8cdc0 2024-09-19T09:01:35.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.744+0000 7fa9bd7fa640 1 -- 172.21.15.19:0/3267521559 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa9a80cfaa0 con 0x7fa9c0101420 2024-09-19T09:01:35.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.744+0000 7fa9bf7fe640 1 --2- 172.21.15.19:0/1267926872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577b1a8cdc0 0x5577b1a97140 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0010480 tx=0x7fa9b000bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=230cb0471fdff0c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:35.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.744+0000 7fa9bffff640 1 --2- 172.21.15.19:0/3267521559 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa9ac0a3240 0x7fa9ac0a5700 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa9b80092f0 tx=0x7fa9b802a6e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:35.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.745+0000 7fa9b5ffb640 1 -- 172.21.15.19:0/1267926872 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b0011820 con 0x5577b1a8cdc0 2024-09-19T09:01:35.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.745+0000 7fa9b5ffb640 1 -- 172.21.15.19:0/1267926872 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9b001c480 con 0x5577b1a8cdc0 2024-09-19T09:01:35.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.745+0000 7fa9b5ffb640 1 -- 172.21.15.19:0/1267926872 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b001a5e0 con 0x5577b1a8cdc0 2024-09-19T09:01:35.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.745+0000 7fa9c8336740 1 -- 172.21.15.19:0/1267926872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577b1a8cdc0 msgr2=0x5577b1a97140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:35.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.745+0000 7fa9c8336740 1 --2- 172.21.15.19:0/1267926872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577b1a8cdc0 0x5577b1a97140 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0010480 tx=0x7fa9b000bf90 comp rx=0 tx=0).stop 2024-09-19T09:01:35.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.745+0000 7fa9c8336740 1 -- 172.21.15.19:0/1267926872 shutdown_connections 2024-09-19T09:01:35.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.745+0000 7fa9c8336740 1 --2- 172.21.15.19:0/1267926872 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5577b1a97680 0x5577b1a99a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.745+0000 7fa9c8336740 1 --2- 172.21.15.19:0/1267926872 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577b1a8cdc0 0x5577b1a97140 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.745+0000 7fa9c8336740 1 --2- 172.21.15.19:0/1267926872 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577b1a8c4a0 0x5577b1a8c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.745+0000 7fa9c8336740 1 -- 172.21.15.19:0/1267926872 >> 172.21.15.19:0/1267926872 conn(0x5577b1a88a30 msgr2=0x5577b1a88e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:35.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.745+0000 7fa9c8336740 1 -- 172.21.15.19:0/1267926872 shutdown_connections 2024-09-19T09:01:35.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.745+0000 7fa9c8336740 1 -- 172.21.15.19:0/1267926872 wait complete. 2024-09-19T09:01:35.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.746+0000 7fa9c8336740 1 -- start start 2024-09-19T09:01:35.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.746+0000 7fa9c8336740 1 Processor -- start 2024-09-19T09:01:35.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.746+0000 7fa9c8336740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577b1a8c4a0 0x5577b1a96fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.746+0000 7fa9c8336740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5577b1a8cdc0 0x5577b1a94290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.746+0000 7fa9c8336740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577b1a97680 0x5577b1a947f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.746+0000 7fa9c8336740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5577b1a9a250 con 0x5577b1a8c4a0 2024-09-19T09:01:35.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.746+0000 7fa9c8336740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5577b19ad050 con 0x5577b1a97680 2024-09-19T09:01:35.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.746+0000 7fa9c8336740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5577b1a9a3d0 con 0x5577b1a8cdc0 2024-09-19T09:01:35.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.746+0000 7fa9c8336740 10 client.0 _ll_register_callbacks cb 0x5577b19ed160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:35.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.746+0000 7fa9bf7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577b1a8c4a0 0x5577b1a96fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.746+0000 7fa9bf7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577b1a8c4a0 0x5577b1a96fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58598/0 (socket says 172.21.15.19:58598) 2024-09-19T09:01:35.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.746+0000 7fa9bf7fe640 1 -- 172.21.15.19:0/126328185 learned_addr learned my addr 172.21.15.19:0/126328185 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:35.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.747+0000 7fa9bffff640 1 --2- 172.21.15.19:0/126328185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577b1a97680 0x5577b1a947f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.747+0000 7fa9b7fff640 1 --2- 172.21.15.19:0/126328185 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5577b1a8cdc0 0x5577b1a94290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.747+0000 7fa9bf7fe640 1 -- 172.21.15.19:0/126328185 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5577b1a8cdc0 msgr2=0x5577b1a94290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:35.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.747+0000 7fa9bf7fe640 1 --2- 172.21.15.19:0/126328185 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5577b1a8cdc0 0x5577b1a94290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.747+0000 7fa9bf7fe640 1 -- 172.21.15.19:0/126328185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577b1a97680 msgr2=0x5577b1a947f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:35.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.747+0000 7fa9bf7fe640 1 --2- 172.21.15.19:0/126328185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577b1a97680 0x5577b1a947f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.747+0000 7fa9bf7fe640 1 -- 172.21.15.19:0/126328185 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577b17633c0 con 0x5577b1a8c4a0 2024-09-19T09:01:35.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.747+0000 7fa9b7fff640 1 --2- 172.21.15.19:0/126328185 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5577b1a8cdc0 0x5577b1a94290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:01:35.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.747+0000 7fa9bf7fe640 1 --2- 172.21.15.19:0/126328185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577b1a8c4a0 0x5577b1a96fe0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fa9b001c860 tx=0x7fa9b001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8474daf615d58085 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:35.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.747+0000 7fa99effd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:01:35.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.747+0000 7fa99effd640 1 -- 172.21.15.19:0/126328185 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b002b060 con 0x5577b1a8c4a0 2024-09-19T09:01:35.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.747+0000 7fa99effd640 1 -- 172.21.15.19:0/126328185 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa9b0011620 con 0x5577b1a8c4a0 2024-09-19T09:01:35.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.747+0000 7fa9c8336740 1 -- 172.21.15.19:0/126328185 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9b001c480 con 0x5577b1a8c4a0 2024-09-19T09:01:35.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.747+0000 7fa99effd640 1 -- 172.21.15.19:0/126328185 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fa9b0011820 con 0x5577b1a8c4a0 2024-09-19T09:01:35.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.748+0000 7fa9c8336740 10 client.17514 fetch_fsmap learned FSMap version 36 2024-09-19T09:01:35.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.748+0000 7fa9c8336740 1 -- 172.21.15.19:0/126328185 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5577b1aa5c20 con 0x5577b1a8c4a0 2024-09-19T09:01:35.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.748+0000 7fa99effd640 1 -- 172.21.15.19:0/126328185 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9b001c480 con 0x5577b1a8c4a0 2024-09-19T09:01:35.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.748+0000 7fa99effd640 1 -- 172.21.15.19:0/126328185 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fa9b0031990 con 0x5577b1a8c4a0 2024-09-19T09:01:35.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.748+0000 7fa9c8336740 10 client.17514 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:01:35.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.748+0000 7fa9c8336740 10 client.17514 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:01:35.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.748+0000 7fa9c8336740 20 client.17514 populate_metadata read hostname 'smithi019' 2024-09-19T09:01:35.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.748+0000 7fa9c8336740 1 --2- 172.21.15.19:0/126328185 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5577b1aa70e0 0x5577b1aa94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.748+0000 7fa9c8336740 4 client.17514 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:01:35.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.748+0000 7fa9c8336740 1 -- 172.21.15.19:0/126328185 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577b19ff850 con 0x5577b1aa70e0 2024-09-19T09:01:35.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.748+0000 7fa9b7fff640 1 --2- 172.21.15.19:0/126328185 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5577b1aa70e0 0x5577b1aa94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.749+0000 7fa99effd640 10 client.17514 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:35.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.749+0000 7fa9b7fff640 1 --2- 172.21.15.19:0/126328185 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5577b1aa70e0 0x5577b1aa94d0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd4545ebc8d11b9e server_cookie=2e86da1e74995b57 in_seq=0 out_seq=0 2024-09-19T09:01:35.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.753+0000 7fa99effd640 1 -- 172.21.15.19:0/126328185 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5577b19ff850 con 0x5577b1aa70e0 2024-09-19T09:01:35.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.753+0000 7fa99effd640 10 client.17514 handle_command_reply: tid=0 2024-09-19T09:01:35.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.753+0000 7fa9c8336740 1 client.17514 shutdown 2024-09-19T09:01:35.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.753+0000 7fa9c8336740 1 -- 172.21.15.19:0/126328185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577b1a8c4a0 msgr2=0x5577b1a96fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:35.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.753+0000 7fa9c8336740 1 --2- 172.21.15.19:0/126328185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577b1a8c4a0 0x5577b1a96fe0 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fa9b001c860 tx=0x7fa9b001c890 comp rx=0 tx=0).stop 2024-09-19T09:01:35.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.753+0000 7fa9c8336740 1 -- 172.21.15.19:0/126328185 shutdown_connections 2024-09-19T09:01:35.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.753+0000 7fa9c8336740 1 --2- 172.21.15.19:0/126328185 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5577b1aa70e0 0x5577b1aa94d0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.753+0000 7fa9c8336740 1 --2- 172.21.15.19:0/126328185 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5577b1a8cdc0 0x5577b1a94290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.753+0000 7fa9c8336740 1 --2- 172.21.15.19:0/126328185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577b1a97680 0x5577b1a947f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.753+0000 7fa99effd640 0 client.17514 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:35.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.753+0000 7fa9c8336740 1 --2- 172.21.15.19:0/126328185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577b1a8c4a0 0x5577b1a96fe0 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.753+0000 7fa9c8336740 1 -- 172.21.15.19:0/126328185 >> 172.21.15.19:0/126328185 conn(0x5577b1a88a30 msgr2=0x5577b1a8e760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:35.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.753+0000 7fa9c8336740 1 -- 172.21.15.19:0/126328185 shutdown_connections 2024-09-19T09:01:35.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.753+0000 7fa9c8336740 1 -- 172.21.15.19:0/126328185 wait complete. 2024-09-19T09:01:35.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.754+0000 7fa9c8336740 20 client.17514 trim_cache size 0 max 16384 2024-09-19T09:01:35.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.772+0000 7fa9c8336740 1 Processor -- start 2024-09-19T09:01:35.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.772+0000 7fa9c8336740 1 -- start start 2024-09-19T09:01:35.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.773+0000 7fa9c8336740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577b1a8c4a0 0x5577b1aaea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.773+0000 7fa9c8336740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577b1a8cdc0 0x5577b1aaefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.773+0000 7fa9c8336740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5577b1a97680 0x5577b1a91510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.773+0000 7fa9c8336740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c01ab380 con 0x5577b1a8cdc0 2024-09-19T09:01:35.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.773+0000 7fa9c8336740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c01acec0 con 0x5577b1a8c4a0 2024-09-19T09:01:35.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.773+0000 7fa9c8336740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c01aba50 con 0x5577b1a97680 2024-09-19T09:01:35.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.773+0000 7fa9b7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577b1a8cdc0 0x5577b1aaefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.773+0000 7fa9b7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577b1a8cdc0 0x5577b1aaefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58608/0 (socket says 172.21.15.19:58608) 2024-09-19T09:01:35.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.773+0000 7fa9b7fff640 1 -- 172.21.15.19:0/1000528200 learned_addr learned my addr 172.21.15.19:0/1000528200 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:35.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.773+0000 7fa9bf7fe640 1 --2- 172.21.15.19:0/1000528200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577b1a8c4a0 0x5577b1aaea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.773+0000 7fa9bffff640 1 --2- 172.21.15.19:0/1000528200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5577b1a97680 0x5577b1a91510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.773+0000 7fa9b7fff640 1 -- 172.21.15.19:0/1000528200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5577b1a97680 msgr2=0x5577b1a91510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:35.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.773+0000 7fa9b7fff640 1 --2- 172.21.15.19:0/1000528200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5577b1a97680 0x5577b1a91510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.773+0000 7fa9b7fff640 1 -- 172.21.15.19:0/1000528200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577b1a8c4a0 msgr2=0x5577b1aaea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:35.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.773+0000 7fa9b7fff640 1 --2- 172.21.15.19:0/1000528200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577b1a8c4a0 0x5577b1aaea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.773+0000 7fa9b7fff640 1 -- 172.21.15.19:0/1000528200 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577b1a94b60 con 0x5577b1a8cdc0 2024-09-19T09:01:35.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.773+0000 7fa9b7fff640 1 --2- 172.21.15.19:0/1000528200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577b1a8cdc0 0x5577b1aaefb0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fa9a800cf90 tx=0x7fa9a80d1ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ad320cd2b0333d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:35.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.774+0000 7fa9b57fa640 1 -- 172.21.15.19:0/1000528200 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a80a0420 con 0x5577b1a8cdc0 2024-09-19T09:01:35.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.774+0000 7fa9b57fa640 1 -- 172.21.15.19:0/1000528200 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9a80a4ce0 con 0x5577b1a8cdc0 2024-09-19T09:01:35.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.774+0000 7fa9b57fa640 1 -- 172.21.15.19:0/1000528200 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9a80a00c0 con 0x5577b1a8cdc0 2024-09-19T09:01:35.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.775+0000 7fa9c8336740 1 -- 172.21.15.19:0/1000528200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577b1a8cdc0 msgr2=0x5577b1aaefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:35.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.775+0000 7fa9c8336740 1 --2- 172.21.15.19:0/1000528200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577b1a8cdc0 0x5577b1aaefb0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fa9a800cf90 tx=0x7fa9a80d1ef0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.775+0000 7fa9c8336740 1 -- 172.21.15.19:0/1000528200 shutdown_connections 2024-09-19T09:01:35.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.775+0000 7fa9c8336740 1 --2- 172.21.15.19:0/1000528200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5577b1a97680 0x5577b1a91510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.775+0000 7fa9c8336740 1 --2- 172.21.15.19:0/1000528200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577b1a8cdc0 0x5577b1aaefb0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.775+0000 7fa9c8336740 1 --2- 172.21.15.19:0/1000528200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577b1a8c4a0 0x5577b1aaea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.775+0000 7fa9c8336740 1 -- 172.21.15.19:0/1000528200 >> 172.21.15.19:0/1000528200 conn(0x5577b1a88a30 msgr2=0x5577b1a87b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:35.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.775+0000 7fa9c8336740 1 -- 172.21.15.19:0/1000528200 shutdown_connections 2024-09-19T09:01:35.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.775+0000 7fa9c8336740 1 -- 172.21.15.19:0/1000528200 wait complete. 2024-09-19T09:01:35.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.775+0000 7fa9c8336740 1 -- start start 2024-09-19T09:01:35.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.775+0000 7fa9c8336740 1 Processor -- start 2024-09-19T09:01:35.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.776+0000 7fa9c8336740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5577b1a8c4a0 0x5577b1a9fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.776+0000 7fa9c8336740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577b1a8cdc0 0x5577b1a9cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.776+0000 7fa9c8336740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577b1a97680 0x5577b1a9d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.776+0000 7fa9c8336740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c01ac7f0 con 0x5577b1a97680 2024-09-19T09:01:35.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.776+0000 7fa9c8336740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c01ac120 con 0x5577b1a8cdc0 2024-09-19T09:01:35.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.776+0000 7fa9c8336740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c01a9360 con 0x5577b1a8c4a0 2024-09-19T09:01:35.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.776+0000 7fa9c8336740 10 client.0 _ll_register_callbacks cb 0x7fa9a8005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:35.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.776+0000 7fa9bf7fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5577b1a8c4a0 0x5577b1a9fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.776+0000 7fa9b7fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577b1a8cdc0 0x5577b1a9cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.776+0000 7fa9bf7fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5577b1a8c4a0 0x5577b1a9fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:39334/0 (socket says 172.21.15.19:39334) 2024-09-19T09:01:35.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.776+0000 7fa9bffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577b1a97680 0x5577b1a9d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.776+0000 7fa9bf7fe640 1 -- 172.21.15.19:0/318235673 learned_addr learned my addr 172.21.15.19:0/318235673 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:35.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.776+0000 7fa9bf7fe640 1 -- 172.21.15.19:0/318235673 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577b1a8cdc0 msgr2=0x5577b1a9cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:35.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.776+0000 7fa9bf7fe640 1 --2- 172.21.15.19:0/318235673 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577b1a8cdc0 0x5577b1a9cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.776+0000 7fa9bf7fe640 1 -- 172.21.15.19:0/318235673 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577b1a97680 msgr2=0x5577b1a9d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:35.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.776+0000 7fa9bf7fe640 1 --2- 172.21.15.19:0/318235673 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577b1a97680 0x5577b1a9d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.776+0000 7fa9bf7fe640 1 -- 172.21.15.19:0/318235673 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577b1a9d810 con 0x5577b1a8c4a0 2024-09-19T09:01:35.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.777+0000 7fa9bf7fe640 1 --2- 172.21.15.19:0/318235673 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5577b1a8c4a0 0x5577b1a9fa40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0010dd0 tx=0x7fa9b000bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6497c7a9bf0d22ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:35.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.777+0000 7fa99effd640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T09:01:35.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.777+0000 7fa99effd640 1 -- 172.21.15.19:0/318235673 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9b003f060 con 0x5577b1a8c4a0 2024-09-19T09:01:35.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.777+0000 7fa99effd640 1 -- 172.21.15.19:0/318235673 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa9b0011620 con 0x5577b1a8c4a0 2024-09-19T09:01:35.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.777+0000 7fa9c8336740 1 -- 172.21.15.19:0/318235673 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9a80a4ce0 con 0x5577b1a8c4a0 2024-09-19T09:01:35.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.777+0000 7fa99effd640 1 -- 172.21.15.19:0/318235673 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fa9b0036070 con 0x5577b1a8c4a0 2024-09-19T09:01:35.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.777+0000 7fa9c8336740 10 client.26866 fetch_fsmap learned FSMap version 36 2024-09-19T09:01:35.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.777+0000 7fa9c8336740 1 -- 172.21.15.19:0/318235673 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5577b1b11730 con 0x5577b1a8c4a0 2024-09-19T09:01:35.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.777+0000 7fa99effd640 1 -- 172.21.15.19:0/318235673 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa9a80a4ce0 con 0x5577b1a8c4a0 2024-09-19T09:01:35.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.778+0000 7fa99effd640 1 -- 172.21.15.19:0/318235673 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fa9b00319b0 con 0x5577b1a8c4a0 2024-09-19T09:01:35.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.778+0000 7fa9c8336740 10 client.26866 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:01:35.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.778+0000 7fa9c8336740 10 client.26866 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:01:35.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.778+0000 7fa9c8336740 20 client.26866 populate_metadata read hostname 'smithi019' 2024-09-19T09:01:35.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.778+0000 7fa9c8336740 1 --2- 172.21.15.19:0/318235673 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5577b1b11d30 0x5577b1b14120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:35.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.778+0000 7fa9c8336740 4 client.26866 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:01:35.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.778+0000 7fa9c8336740 1 -- 172.21.15.19:0/318235673 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5577b19f9d60 con 0x5577b1b11d30 2024-09-19T09:01:35.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.778+0000 7fa9b7fff640 1 --2- 172.21.15.19:0/318235673 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5577b1b11d30 0x5577b1b14120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:35.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.778+0000 7fa9b7fff640 1 --2- 172.21.15.19:0/318235673 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5577b1b11d30 0x5577b1b14120 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc8c1429eed2c4db server_cookie=ea8875e41fc9829d in_seq=0 out_seq=0 2024-09-19T09:01:35.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.778+0000 7fa99effd640 10 client.26866 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:35.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.782+0000 7fa99effd640 1 -- 172.21.15.19:0/318235673 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5577b19f9d60 con 0x5577b1b11d30 2024-09-19T09:01:35.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.782+0000 7fa99effd640 10 client.26866 handle_command_reply: tid=0 2024-09-19T09:01:35.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.782+0000 7fa9c8336740 1 client.26866 shutdown 2024-09-19T09:01:35.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.782+0000 7fa9c8336740 1 -- 172.21.15.19:0/318235673 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5577b1a8c4a0 msgr2=0x5577b1a9fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:35.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.782+0000 7fa9c8336740 1 --2- 172.21.15.19:0/318235673 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5577b1a8c4a0 0x5577b1a9fa40 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa9b0010dd0 tx=0x7fa9b000bf10 comp rx=0 tx=0).stop 2024-09-19T09:01:35.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.782+0000 7fa9c8336740 1 -- 172.21.15.19:0/318235673 shutdown_connections 2024-09-19T09:01:35.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.782+0000 7fa9c8336740 1 --2- 172.21.15.19:0/318235673 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5577b1b11d30 0x5577b1b14120 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.782+0000 7fa9c8336740 1 --2- 172.21.15.19:0/318235673 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5577b1a97680 0x5577b1a9d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.782+0000 7fa9c8336740 1 --2- 172.21.15.19:0/318235673 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5577b1a8cdc0 0x5577b1a9cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.782+0000 7fa9c8336740 1 --2- 172.21.15.19:0/318235673 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5577b1a8c4a0 0x5577b1a9fa40 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.782+0000 7fa99effd640 0 client.26866 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:35.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.782+0000 7fa9c8336740 1 -- 172.21.15.19:0/318235673 >> 172.21.15.19:0/318235673 conn(0x5577b1a88a30 msgr2=0x5577b1a95af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:35.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.782+0000 7fa9c8336740 1 -- 172.21.15.19:0/318235673 shutdown_connections 2024-09-19T09:01:35.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.783+0000 7fa9c8336740 1 -- 172.21.15.19:0/318235673 wait complete. 2024-09-19T09:01:35.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.783+0000 7fa9c8336740 20 client.26866 trim_cache size 0 max 16384 2024-09-19T09:01:35.784 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T09:01:35.784 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-19T09:01:35.784 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {} 2024-09-19T09:01:35.784 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T09:01:35.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.783+0000 7fa9c5f5d640 1 -- 172.21.15.19:0/3267521559 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa9ac0a3240 msgr2=0x7fa9ac0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:35.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.783+0000 7fa9c5f5d640 1 --2- 172.21.15.19:0/3267521559 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa9ac0a3240 0x7fa9ac0a5700 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fa9b80092f0 tx=0x7fa9b802a6e0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.783+0000 7fa9c5f5d640 1 -- 172.21.15.19:0/3267521559 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9c0101420 msgr2=0x7fa9c0197870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:35.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.783+0000 7fa9c5f5d640 1 --2- 172.21.15.19:0/3267521559 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9c0101420 0x7fa9c0197870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa9a800e790 tx=0x7fa9a800ec50 comp rx=0 tx=0).stop 2024-09-19T09:01:35.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.783+0000 7fa9c5f5d640 1 -- 172.21.15.19:0/3267521559 shutdown_connections 2024-09-19T09:01:35.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.783+0000 7fa9c5f5d640 1 --2- 172.21.15.19:0/3267521559 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa9ac0a3240 0x7fa9ac0a5700 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.783+0000 7fa9c5f5d640 1 --2- 172.21.15.19:0/3267521559 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9c0101420 0x7fa9c0197870 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.783+0000 7fa9c5f5d640 1 --2- 172.21.15.19:0/3267521559 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa9c0106a80 0x7fa9c019bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.783+0000 7fa9c5f5d640 1 --2- 172.21.15.19:0/3267521559 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa9c0100a80 0x7fa9c0197330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:35.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.783+0000 7fa9c5f5d640 1 -- 172.21.15.19:0/3267521559 >> 172.21.15.19:0/3267521559 conn(0x7fa9c00fc7a0 msgr2=0x7fa9c00fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:35.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.783+0000 7fa9c5f5d640 1 -- 172.21.15.19:0/3267521559 shutdown_connections 2024-09-19T09:01:35.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:35.783+0000 7fa9c5f5d640 1 -- 172.21.15.19:0/3267521559 wait complete. 2024-09-19T09:01:36.630 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:01:36.630 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:01:36.933 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:37.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.404+0000 7f6d93e91640 1 -- 172.21.15.19:0/2987541298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d8c102570 msgr2=0x7f6d8c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:37.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.404+0000 7f6d93e91640 1 --2- 172.21.15.19:0/2987541298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d8c102570 0x7f6d8c1029b0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c009900 tx=0x7f6d7c02a480 comp rx=0 tx=0).stop 2024-09-19T09:01:37.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.404+0000 7f6d93e91640 1 -- 172.21.15.19:0/2987541298 shutdown_connections 2024-09-19T09:01:37.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.404+0000 7f6d93e91640 1 --2- 172.21.15.19:0/2987541298 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d8c102ef0 0x7f6d8c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.404+0000 7f6d93e91640 1 --2- 172.21.15.19:0/2987541298 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d8c102570 0x7f6d8c1029b0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.404+0000 7f6d93e91640 1 --2- 172.21.15.19:0/2987541298 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d8c100e20 0x7f6d8c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.404+0000 7f6d93e91640 1 -- 172.21.15.19:0/2987541298 >> 172.21.15.19:0/2987541298 conn(0x7f6d8c0fc7d0 msgr2=0x7f6d8c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:37.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.404+0000 7f6d93e91640 1 -- 172.21.15.19:0/2987541298 shutdown_connections 2024-09-19T09:01:37.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.404+0000 7f6d93e91640 1 -- 172.21.15.19:0/2987541298 wait complete. 2024-09-19T09:01:37.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.405+0000 7f6d93e91640 1 Processor -- start 2024-09-19T09:01:37.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.405+0000 7f6d93e91640 1 -- start start 2024-09-19T09:01:37.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.405+0000 7f6d93e91640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d8c100e20 0x7f6d8c198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:37.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.405+0000 7f6d93e91640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d8c102570 0x7f6d8c198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:37.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.405+0000 7f6d93e91640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d8c102ef0 0x7f6d8c19ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:37.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.405+0000 7f6d93e91640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6d8c110f80 con 0x7f6d8c102ef0 2024-09-19T09:01:37.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.405+0000 7f6d93e91640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6d8c110e00 con 0x7f6d8c102570 2024-09-19T09:01:37.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.405+0000 7f6d93e91640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6d8c111100 con 0x7f6d8c100e20 2024-09-19T09:01:37.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.405+0000 7f6d9242e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d8c102ef0 0x7f6d8c19ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:37.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.405+0000 7f6d9142c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d8c102570 0x7f6d8c198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:37.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.405+0000 7f6d9242e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d8c102ef0 0x7f6d8c19ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58626/0 (socket says 172.21.15.19:58626) 2024-09-19T09:01:37.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.405+0000 7f6d9242e640 1 -- 172.21.15.19:0/3296488626 learned_addr learned my addr 172.21.15.19:0/3296488626 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:37.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.405+0000 7f6d91c2d640 1 --2- 172.21.15.19:0/3296488626 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d8c100e20 0x7f6d8c198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:37.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.405+0000 7f6d9142c640 1 -- 172.21.15.19:0/3296488626 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d8c100e20 msgr2=0x7f6d8c198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:37.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.405+0000 7f6d9142c640 1 --2- 172.21.15.19:0/3296488626 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d8c100e20 0x7f6d8c198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.405+0000 7f6d9142c640 1 -- 172.21.15.19:0/3296488626 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d8c102ef0 msgr2=0x7f6d8c19ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:37.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.405+0000 7f6d9142c640 1 --2- 172.21.15.19:0/3296488626 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d8c102ef0 0x7f6d8c19ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.405+0000 7f6d9142c640 1 -- 172.21.15.19:0/3296488626 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d8c19d510 con 0x7f6d8c102570 2024-09-19T09:01:37.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.405+0000 7f6d9242e640 1 --2- 172.21.15.19:0/3296488626 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d8c102ef0 0x7f6d8c19ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:37.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.406+0000 7f6d9142c640 1 --2- 172.21.15.19:0/3296488626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d8c102570 0x7f6d8c198aa0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c005940 tx=0x7f6d7c003c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:37.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.406+0000 7f6d82ffd640 1 -- 172.21.15.19:0/3296488626 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c03f070 con 0x7f6d8c102570 2024-09-19T09:01:37.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.406+0000 7f6d82ffd640 1 -- 172.21.15.19:0/3296488626 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6d7c031c30 con 0x7f6d8c102570 2024-09-19T09:01:37.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.406+0000 7f6d93e91640 1 -- 172.21.15.19:0/3296488626 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d8c19d7a0 con 0x7f6d8c102570 2024-09-19T09:01:37.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.406+0000 7f6d82ffd640 1 -- 172.21.15.19:0/3296488626 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c035030 con 0x7f6d8c102570 2024-09-19T09:01:37.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.406+0000 7f6d93e91640 1 -- 172.21.15.19:0/3296488626 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d8c1a50e0 con 0x7f6d8c102570 2024-09-19T09:01:37.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.407+0000 7f6d93e91640 1 -- 172.21.15.19:0/3296488626 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d8c1021b0 con 0x7f6d8c102570 2024-09-19T09:01:37.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.408+0000 7f6d82ffd640 1 -- 172.21.15.19:0/3296488626 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f6d7c042070 con 0x7f6d8c102570 2024-09-19T09:01:37.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.409+0000 7f6d82ffd640 1 --2- 172.21.15.19:0/3296488626 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6d780a3240 0x7f6d780a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:37.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.409+0000 7f6d91c2d640 1 --2- 172.21.15.19:0/3296488626 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6d780a3240 0x7f6d780a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:37.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.409+0000 7f6d82ffd640 1 -- 172.21.15.19:0/3296488626 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6d7c0f0560 con 0x7f6d8c102570 2024-09-19T09:01:37.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.409+0000 7f6d91c2d640 1 --2- 172.21.15.19:0/3296488626 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6d780a3240 0x7f6d780a5700 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6d88005d00 tx=0x7f6d8800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:37.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.415+0000 7f6d82ffd640 1 -- 172.21.15.19:0/3296488626 <== mon.2 v2:172.21.15.155:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6d7c0bcbe0 con 0x7f6d8c102570 2024-09-19T09:01:37.666 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.666+0000 7f2bd888b640 1 -- 172.21.15.19:0/2948938404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2bd4102680 msgr2=0x7f2bd4104a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:37.667 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.666+0000 7f2bd888b640 1 --2- 172.21.15.19:0/2948938404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2bd4102680 0x7f2bd4104a70 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f2bc4009900 tx=0x7f2bc402a410 comp rx=0 tx=0).stop 2024-09-19T09:01:37.667 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.667+0000 7f2bd888b640 1 -- 172.21.15.19:0/2948938404 shutdown_connections 2024-09-19T09:01:37.667 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.667+0000 7f2bd888b640 1 --2- 172.21.15.19:0/2948938404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2bd41078e0 0x7f2bd4109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.667 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.667+0000 7f2bd888b640 1 --2- 172.21.15.19:0/2948938404 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bd4104fb0 0x7f2bd41073a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.667 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.667+0000 7f2bd888b640 1 --2- 172.21.15.19:0/2948938404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2bd4102680 0x7f2bd4104a70 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.667 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.667+0000 7f2bd888b640 1 -- 172.21.15.19:0/2948938404 >> 172.21.15.19:0/2948938404 conn(0x7f2bd40fc1e0 msgr2=0x7f2bd40fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:37.667 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.667+0000 7f2bd888b640 1 -- 172.21.15.19:0/2948938404 shutdown_connections 2024-09-19T09:01:37.667 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.667+0000 7f2bd888b640 1 -- 172.21.15.19:0/2948938404 wait complete. 2024-09-19T09:01:37.669 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.667+0000 7f2bd888b640 1 Processor -- start 2024-09-19T09:01:37.669 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.667+0000 7f2bd888b640 1 -- start start 2024-09-19T09:01:37.669 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.668+0000 7f2bd888b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bd4102680 0x7f2bd4197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:37.669 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.668+0000 7f2bd888b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2bd4104fb0 0x7f2bd4198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.668+0000 7f2bd888b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2bd41078e0 0x7f2bd419f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.668+0000 7f2bd888b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd410d7f0 con 0x7f2bd41078e0 2024-09-19T09:01:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.668+0000 7f2bd888b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd410d670 con 0x7f2bd4102680 2024-09-19T09:01:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.668+0000 7f2bd888b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd410d970 con 0x7f2bd4104fb0 2024-09-19T09:01:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.668+0000 7f2bd2d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2bd41078e0 0x7f2bd419f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.668+0000 7f2bd2d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2bd41078e0 0x7f2bd419f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58642/0 (socket says 172.21.15.19:58642) 2024-09-19T09:01:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.668+0000 7f2bd2d9d640 1 -- 172.21.15.19:0/3957564308 learned_addr learned my addr 172.21.15.19:0/3957564308 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.668+0000 7f2bd1d9b640 1 --2- 172.21.15.19:0/3957564308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2bd4104fb0 0x7f2bd4198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.668+0000 7f2bd259c640 1 --2- 172.21.15.19:0/3957564308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bd4102680 0x7f2bd4197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.668+0000 7f2bd2d9d640 1 -- 172.21.15.19:0/3957564308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2bd4104fb0 msgr2=0x7f2bd4198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.668+0000 7f2bd2d9d640 1 --2- 172.21.15.19:0/3957564308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2bd4104fb0 0x7f2bd4198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.668+0000 7f2bd2d9d640 1 -- 172.21.15.19:0/3957564308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bd4102680 msgr2=0x7f2bd4197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:37.670 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.668+0000 7f2bd2d9d640 1 --2- 172.21.15.19:0/3957564308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bd4102680 0x7f2bd4197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.671 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.668+0000 7f2bd2d9d640 1 -- 172.21.15.19:0/3957564308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bd419fa60 con 0x7f2bd41078e0 2024-09-19T09:01:37.671 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.668+0000 7f2bd2d9d640 1 --2- 172.21.15.19:0/3957564308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2bd41078e0 0x7f2bd419f3f0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc00eb10 tx=0x7f2bcc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:37.671 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.669+0000 7f2bc37fe640 1 -- 172.21.15.19:0/3957564308 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc004b20 con 0x7f2bd41078e0 2024-09-19T09:01:37.671 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.669+0000 7f2bc37fe640 1 -- 172.21.15.19:0/3957564308 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2bcc004cc0 con 0x7f2bd41078e0 2024-09-19T09:01:37.671 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.669+0000 7f2bd888b640 1 -- 172.21.15.19:0/3957564308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bd419fd50 con 0x7f2bd41078e0 2024-09-19T09:01:37.671 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.669+0000 7f2bc37fe640 1 -- 172.21.15.19:0/3957564308 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc010760 con 0x7f2bd41078e0 2024-09-19T09:01:37.671 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.669+0000 7f2bd888b640 1 -- 172.21.15.19:0/3957564308 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bd41a0260 con 0x7f2bd41078e0 2024-09-19T09:01:37.677 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.671+0000 7f2bc37fe640 1 -- 172.21.15.19:0/3957564308 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f2bcc005020 con 0x7f2bd41078e0 2024-09-19T09:01:37.677 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.671+0000 7f2bdb623740 1 Processor -- start 2024-09-19T09:01:37.677 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.672+0000 7f2bdb623740 1 -- start start 2024-09-19T09:01:37.677 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.672+0000 7f2bdb623740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56273e52fdb0 0x56273e5301b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:37.677 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.672+0000 7f2bdb623740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56273e5306f0 0x56273e5351b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:37.677 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.672+0000 7f2bdb623740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56273e535780 0x56273e537c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:37.677 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.672+0000 7f2bdb623740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56273e48f2f0 con 0x56273e52fdb0 2024-09-19T09:01:37.677 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.672+0000 7f2bdb623740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56273e437270 con 0x56273e5306f0 2024-09-19T09:01:37.677 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.672+0000 7f2bdb623740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56273e48b2b0 con 0x56273e535780 2024-09-19T09:01:37.677 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.672+0000 7f2bd1d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56273e52fdb0 0x56273e5301b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:37.677 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.672+0000 7f2bd1d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56273e52fdb0 0x56273e5301b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58656/0 (socket says 172.21.15.19:58656) 2024-09-19T09:01:37.678 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.672+0000 7f2bd1d9b640 1 -- 172.21.15.19:0/966880928 learned_addr learned my addr 172.21.15.19:0/966880928 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:37.678 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.672+0000 7f2bd259c640 1 --2- 172.21.15.19:0/966880928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56273e5306f0 0x56273e5351b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:37.678 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.672+0000 7f2bd1d9b640 1 --2- 172.21.15.19:0/966880928 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56273e535780 0x56273e537c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:37.678 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.672+0000 7f2bd1d9b640 1 -- 172.21.15.19:0/966880928 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56273e535780 msgr2=0x56273e537c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:37.678 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.672+0000 7f2bd1d9b640 1 --2- 172.21.15.19:0/966880928 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56273e535780 0x56273e537c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.678 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.672+0000 7f2bd1d9b640 1 -- 172.21.15.19:0/966880928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56273e5306f0 msgr2=0x56273e5351b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:37.678 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.672+0000 7f2bd1d9b640 1 --2- 172.21.15.19:0/966880928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56273e5306f0 0x56273e5351b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.678 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.672+0000 7f2bc37fe640 1 --2- 172.21.15.19:0/3957564308 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2bbc0a3370 0x7f2bbc0a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:37.678 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.672+0000 7f2bd1d9b640 1 -- 172.21.15.19:0/966880928 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56273e436340 con 0x56273e52fdb0 2024-09-19T09:01:37.678 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.672+0000 7f2bd259c640 1 --2- 172.21.15.19:0/966880928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56273e5306f0 0x56273e5351b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:37.678 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.673+0000 7f2bc37fe640 1 -- 172.21.15.19:0/3957564308 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2bcc0cff20 con 0x7f2bd41078e0 2024-09-19T09:01:37.679 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.673+0000 7f2bd1d9b640 1 --2- 172.21.15.19:0/966880928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56273e52fdb0 0x56273e5301b0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f2bc80135f0 tx=0x7f2bc80099d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2bbe8ea529066f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:37.679 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.673+0000 7f2bd1d9b640 1 --2- 172.21.15.19:0/3957564308 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2bbc0a3370 0x7f2bbc0a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:37.679 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.673+0000 7f2bc0ff9640 1 -- 172.21.15.19:0/966880928 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc8004050 con 0x56273e52fdb0 2024-09-19T09:01:37.679 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.673+0000 7f2bc0ff9640 1 -- 172.21.15.19:0/966880928 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2bc8004370 con 0x56273e52fdb0 2024-09-19T09:01:37.679 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.673+0000 7f2bc0ff9640 1 -- 172.21.15.19:0/966880928 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc800fbc0 con 0x56273e52fdb0 2024-09-19T09:01:37.679 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.674+0000 7f2bdb623740 1 -- 172.21.15.19:0/966880928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56273e52fdb0 msgr2=0x56273e5301b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:37.679 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.674+0000 7f2bdb623740 1 --2- 172.21.15.19:0/966880928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56273e52fdb0 0x56273e5301b0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f2bc80135f0 tx=0x7f2bc80099d0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.679 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.674+0000 7f2bd1d9b640 1 --2- 172.21.15.19:0/3957564308 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2bbc0a3370 0x7f2bbc0a5830 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2bc80092e0 tx=0x7f2bc8010800 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:37.679 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.674+0000 7f2bdb623740 1 -- 172.21.15.19:0/966880928 shutdown_connections 2024-09-19T09:01:37.679 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.674+0000 7f2bdb623740 1 --2- 172.21.15.19:0/966880928 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56273e535780 0x56273e537c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.679 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.674+0000 7f2bdb623740 1 --2- 172.21.15.19:0/966880928 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56273e5306f0 0x56273e5351b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.679 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.674+0000 7f2bdb623740 1 --2- 172.21.15.19:0/966880928 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56273e52fdb0 0x56273e5301b0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.679 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.674+0000 7f2bdb623740 1 -- 172.21.15.19:0/966880928 >> 172.21.15.19:0/966880928 conn(0x56273e527010 msgr2=0x56273e527410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:37.680 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.674+0000 7f2bdb623740 1 -- 172.21.15.19:0/966880928 shutdown_connections 2024-09-19T09:01:37.680 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.674+0000 7f2bdb623740 1 -- 172.21.15.19:0/966880928 wait complete. 2024-09-19T09:01:37.680 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.674+0000 7f2bdb623740 1 -- start start 2024-09-19T09:01:37.680 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.674+0000 7f2bdb623740 1 Processor -- start 2024-09-19T09:01:37.680 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.674+0000 7f2bdb623740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56273e52fdb0 0x56273e539fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:37.680 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.674+0000 7f2bdb623740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56273e5306f0 0x56273e53a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:37.680 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.675+0000 7f2bdb623740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56273e535780 0x56273e541530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:37.680 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.675+0000 7f2bdb623740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56273e538750 con 0x56273e5306f0 2024-09-19T09:01:37.680 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.675+0000 7f2bdb623740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56273e418290 con 0x56273e52fdb0 2024-09-19T09:01:37.680 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.675+0000 7f2bdb623740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56273e5388d0 con 0x56273e535780 2024-09-19T09:01:37.680 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.675+0000 7f2bdb623740 10 client.0 _ll_register_callbacks cb 0x56273e449140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:37.680 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.675+0000 7f2bd1d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56273e5306f0 0x56273e53a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:37.681 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.675+0000 7f2bd1d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56273e5306f0 0x56273e53a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58672/0 (socket says 172.21.15.19:58672) 2024-09-19T09:01:37.681 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.675+0000 7f2bd1d9b640 1 -- 172.21.15.19:0/3943715144 learned_addr learned my addr 172.21.15.19:0/3943715144 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:37.681 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.675+0000 7f2bd259c640 1 --2- 172.21.15.19:0/3943715144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56273e52fdb0 0x56273e539fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:37.681 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.675+0000 7f2bd2d9d640 1 --2- 172.21.15.19:0/3943715144 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56273e535780 0x56273e541530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:37.681 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.675+0000 7f2bd1d9b640 1 -- 172.21.15.19:0/3943715144 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56273e535780 msgr2=0x56273e541530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:37.681 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.675+0000 7f2bd1d9b640 1 --2- 172.21.15.19:0/3943715144 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56273e535780 0x56273e541530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.681 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.675+0000 7f2bd1d9b640 1 -- 172.21.15.19:0/3943715144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56273e52fdb0 msgr2=0x56273e539fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:37.681 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.675+0000 7f2bd1d9b640 1 --2- 172.21.15.19:0/3943715144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56273e52fdb0 0x56273e539fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.681 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.675+0000 7f2bd1d9b640 1 -- 172.21.15.19:0/3943715144 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56273e1a2210 con 0x56273e5306f0 2024-09-19T09:01:37.681 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.675+0000 7f2bd2d9d640 1 --2- 172.21.15.19:0/3943715144 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56273e535780 0x56273e541530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:01:37.681 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.675+0000 7f2bd259c640 1 --2- 172.21.15.19:0/3943715144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56273e52fdb0 0x56273e539fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:37.681 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.675+0000 7f2bd1d9b640 1 --2- 172.21.15.19:0/3943715144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56273e5306f0 0x56273e53a4f0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f2bc800fc30 tx=0x7f2bc8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8cc901318df2fd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:37.681 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.675+0000 7f2bb9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:01:37.682 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.675+0000 7f2bb9ffb640 1 -- 172.21.15.19:0/3943715144 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc8013180 con 0x56273e5306f0 2024-09-19T09:01:37.682 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.675+0000 7f2bb9ffb640 1 -- 172.21.15.19:0/3943715144 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2bc8028030 con 0x56273e5306f0 2024-09-19T09:01:37.682 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.675+0000 7f2bdb623740 1 -- 172.21.15.19:0/3943715144 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2bc8004370 con 0x56273e5306f0 2024-09-19T09:01:37.682 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.676+0000 7f2bb9ffb640 1 -- 172.21.15.19:0/3943715144 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f2bc800fd10 con 0x56273e5306f0 2024-09-19T09:01:37.682 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.676+0000 7f2bdb623740 10 client.17538 fetch_fsmap learned FSMap version 36 2024-09-19T09:01:37.682 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.676+0000 7f2bdb623740 1 -- 172.21.15.19:0/3943715144 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x56273e26e620 con 0x56273e5306f0 2024-09-19T09:01:37.682 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.676+0000 7f2bb9ffb640 1 -- 172.21.15.19:0/3943715144 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2bc8004370 con 0x56273e5306f0 2024-09-19T09:01:37.682 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.676+0000 7f2bb9ffb640 1 -- 172.21.15.19:0/3943715144 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f2bc8003710 con 0x56273e5306f0 2024-09-19T09:01:37.682 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.676+0000 7f2bdb623740 10 client.17538 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:01:37.682 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.676+0000 7f2bdb623740 10 client.17538 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:01:37.682 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.676+0000 7f2bdb623740 20 client.17538 populate_metadata read hostname 'smithi019' 2024-09-19T09:01:37.682 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.676+0000 7f2bdb623740 1 --2- 172.21.15.19:0/3943715144 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56273e545ac0 0x56273e547f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:37.682 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.676+0000 7f2bdb623740 4 client.17538 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:01:37.683 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.676+0000 7f2bdb623740 1 -- 172.21.15.19:0/3943715144 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56273e49ca20 con 0x56273e545ac0 2024-09-19T09:01:37.683 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.676+0000 7f2bd259c640 1 --2- 172.21.15.19:0/3943715144 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56273e545ac0 0x56273e547f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:37.683 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.677+0000 7f2bb9ffb640 10 client.17538 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:37.683 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.677+0000 7f2bd259c640 1 --2- 172.21.15.19:0/3943715144 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56273e545ac0 0x56273e547f10 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7004e281e153baba server_cookie=7a3ae22ef6c53435 in_seq=0 out_seq=0 2024-09-19T09:01:37.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.696+0000 7f6d93e91640 1 -- 172.21.15.19:0/3296488626 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6d8c10a0a0 con 0x7f6d8c102570 2024-09-19T09:01:37.696 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:37 smithi019 ceph-mon[30976]: pgmap v619: 97 pgs: 97 active+clean; 24 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 326 op/s 2024-09-19T09:01:37.697 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.697+0000 7f2bb9ffb640 1 -- 172.21.15.19:0/3943715144 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56273e49ca20 con 0x56273e545ac0 2024-09-19T09:01:37.697 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.697+0000 7f2bb9ffb640 10 client.17538 handle_command_reply: tid=0 2024-09-19T09:01:37.698 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.697+0000 7f2bdb623740 1 client.17538 shutdown 2024-09-19T09:01:37.698 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.697+0000 7f2bdb623740 1 -- 172.21.15.19:0/3943715144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56273e5306f0 msgr2=0x56273e53a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:37.698 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.697+0000 7f2bdb623740 1 --2- 172.21.15.19:0/3943715144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56273e5306f0 0x56273e53a4f0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f2bc800fc30 tx=0x7f2bc8018000 comp rx=0 tx=0).stop 2024-09-19T09:01:37.698 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.697+0000 7f2bdb623740 1 -- 172.21.15.19:0/3943715144 shutdown_connections 2024-09-19T09:01:37.698 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.697+0000 7f2bdb623740 1 --2- 172.21.15.19:0/3943715144 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56273e545ac0 0x56273e547f10 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.698 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.697+0000 7f2bdb623740 1 --2- 172.21.15.19:0/3943715144 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56273e535780 0x56273e541530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.698 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.697+0000 7f2bb9ffb640 0 client.17538 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:37.698 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.697+0000 7f2bdb623740 1 --2- 172.21.15.19:0/3943715144 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56273e5306f0 0x56273e53a4f0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.698 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.697+0000 7f2bdb623740 1 --2- 172.21.15.19:0/3943715144 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56273e52fdb0 0x56273e539fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.698 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.697+0000 7f2bdb623740 1 -- 172.21.15.19:0/3943715144 >> 172.21.15.19:0/3943715144 conn(0x56273e527010 msgr2=0x56273e528820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:37.698 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.697+0000 7f2bdb623740 1 -- 172.21.15.19:0/3943715144 shutdown_connections 2024-09-19T09:01:37.698 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.697+0000 7f2bdb623740 1 -- 172.21.15.19:0/3943715144 wait complete. 2024-09-19T09:01:37.698 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.697+0000 7f2bdb623740 20 client.17538 trim_cache size 0 max 16384 2024-09-19T09:01:37.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.697+0000 7f6d82ffd640 1 -- 172.21.15.19:0/3296488626 <== mon.2 v2:172.21.15.155:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) ==== 94+0+11983 (secure 0 0 0) 0x7f6d7c0c0ee0 con 0x7f6d8c102570 2024-09-19T09:01:37.699 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T09:01:37.699 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":36,"btime":"2024-09-19T08:59:00:695758+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":26453,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.155:6835/3907362737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3907362737},{"type":"v1","addr":"172.21.15.155:6835","nonce":3907362737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":35,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T08:58:50.493979+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"g","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6839/2452068876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":2452068876},{"type":"v1","addr":"172.21.15.19:6839","nonce":2452068876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24463,24464,24490,24469,24497]},"id":1}]} 2024-09-19T09:01:37.700 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 36 2024-09-19T09:01:37.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.699+0000 7f6d93e91640 1 -- 172.21.15.19:0/3296488626 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6d780a3240 msgr2=0x7f6d780a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:37.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.700+0000 7f6d93e91640 1 --2- 172.21.15.19:0/3296488626 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6d780a3240 0x7f6d780a5700 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6d88005d00 tx=0x7f6d8800b410 comp rx=0 tx=0).stop 2024-09-19T09:01:37.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.700+0000 7f6d93e91640 1 -- 172.21.15.19:0/3296488626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d8c102570 msgr2=0x7f6d8c198aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:37.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.700+0000 7f6d93e91640 1 --2- 172.21.15.19:0/3296488626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d8c102570 0x7f6d8c198aa0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c005940 tx=0x7f6d7c003c10 comp rx=0 tx=0).stop 2024-09-19T09:01:37.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.700+0000 7f6d93e91640 1 -- 172.21.15.19:0/3296488626 shutdown_connections 2024-09-19T09:01:37.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.700+0000 7f6d93e91640 1 --2- 172.21.15.19:0/3296488626 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6d780a3240 0x7f6d780a5700 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.700+0000 7f6d93e91640 1 --2- 172.21.15.19:0/3296488626 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6d8c102ef0 0x7f6d8c19ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.700+0000 7f6d93e91640 1 --2- 172.21.15.19:0/3296488626 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6d8c102570 0x7f6d8c198aa0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.700+0000 7f6d93e91640 1 --2- 172.21.15.19:0/3296488626 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6d8c100e20 0x7f6d8c198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.700+0000 7f6d93e91640 1 -- 172.21.15.19:0/3296488626 >> 172.21.15.19:0/3296488626 conn(0x7f6d8c0fc7d0 msgr2=0x7f6d8c06a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:37.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.700+0000 7f6d93e91640 1 -- 172.21.15.19:0/3296488626 shutdown_connections 2024-09-19T09:01:37.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:37.700+0000 7f6d93e91640 1 -- 172.21.15.19:0/3296488626 wait complete. 2024-09-19T09:01:37.714 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.713+0000 7f2bdb623740 1 Processor -- start 2024-09-19T09:01:37.714 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.713+0000 7f2bdb623740 1 -- start start 2024-09-19T09:01:37.714 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.713+0000 7f2bdb623740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56273e527010 0x56273e528400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:37.714 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.713+0000 7f2bdb623740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56273e52fdb0 0x56273e5414f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:37.715 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.713+0000 7f2bdb623740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56273e5306f0 0x56273e528940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:37.715 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.714+0000 7f2bdb623740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd41a6da0 con 0x56273e52fdb0 2024-09-19T09:01:37.715 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.714+0000 7f2bdb623740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd41a88e0 con 0x56273e527010 2024-09-19T09:01:37.715 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.714+0000 7f2bdb623740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd41a7470 con 0x56273e5306f0 2024-09-19T09:01:37.715 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.714+0000 7f2bd1d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56273e52fdb0 0x56273e5414f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:37.715 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.714+0000 7f2bd259c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56273e527010 0x56273e528400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:37.715 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.714+0000 7f2bd259c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56273e527010 0x56273e528400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:57066/0 (socket says 172.21.15.19:57066) 2024-09-19T09:01:37.715 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.714+0000 7f2bd1d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56273e52fdb0 0x56273e5414f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58688/0 (socket says 172.21.15.19:58688) 2024-09-19T09:01:37.715 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.714+0000 7f2bd259c640 1 -- 172.21.15.19:0/1585518546 learned_addr learned my addr 172.21.15.19:0/1585518546 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:37.715 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.714+0000 7f2bd2d9d640 1 --2- 172.21.15.19:0/1585518546 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56273e5306f0 0x56273e528940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:37.715 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.714+0000 7f2bd1d9b640 1 -- 172.21.15.19:0/1585518546 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56273e5306f0 msgr2=0x56273e528940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:37.715 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.714+0000 7f2bd1d9b640 1 --2- 172.21.15.19:0/1585518546 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56273e5306f0 0x56273e528940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.715 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.714+0000 7f2bd1d9b640 1 -- 172.21.15.19:0/1585518546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56273e527010 msgr2=0x56273e528400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:37.716 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.714+0000 7f2bd1d9b640 1 --2- 172.21.15.19:0/1585518546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56273e527010 0x56273e528400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.716 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.714+0000 7f2bd1d9b640 1 -- 172.21.15.19:0/1585518546 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56273e526e30 con 0x56273e52fdb0 2024-09-19T09:01:37.716 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.714+0000 7f2bd1d9b640 1 --2- 172.21.15.19:0/1585518546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56273e52fdb0 0x56273e5414f0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8003ab0 tx=0x7f2bc8005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d792827ac922162b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:37.716 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.714+0000 7f2bbbfff640 1 -- 172.21.15.19:0/1585518546 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc8034020 con 0x56273e52fdb0 2024-09-19T09:01:37.716 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.714+0000 7f2bbbfff640 1 -- 172.21.15.19:0/1585518546 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2bc8035020 con 0x56273e52fdb0 2024-09-19T09:01:37.716 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.714+0000 7f2bbbfff640 1 -- 172.21.15.19:0/1585518546 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc800fcf0 con 0x56273e52fdb0 2024-09-19T09:01:37.719 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.715+0000 7f2bdb623740 1 -- 172.21.15.19:0/1585518546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56273e52fdb0 msgr2=0x56273e5414f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:37.719 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.715+0000 7f2bdb623740 1 --2- 172.21.15.19:0/1585518546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56273e52fdb0 0x56273e5414f0 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8003ab0 tx=0x7f2bc8005db0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.719 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.715+0000 7f2bdb623740 1 -- 172.21.15.19:0/1585518546 shutdown_connections 2024-09-19T09:01:37.719 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.715+0000 7f2bdb623740 1 --2- 172.21.15.19:0/1585518546 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56273e5306f0 0x56273e528940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.720 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.715+0000 7f2bdb623740 1 --2- 172.21.15.19:0/1585518546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56273e52fdb0 0x56273e5414f0 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.720 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.715+0000 7f2bdb623740 1 --2- 172.21.15.19:0/1585518546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56273e527010 0x56273e528400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.720 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.715+0000 7f2bdb623740 1 -- 172.21.15.19:0/1585518546 >> 172.21.15.19:0/1585518546 conn(0x56273e5352a0 msgr2=0x56273e5261c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:37.720 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.715+0000 7f2bdb623740 1 -- 172.21.15.19:0/1585518546 shutdown_connections 2024-09-19T09:01:37.720 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.715+0000 7f2bdb623740 1 -- 172.21.15.19:0/1585518546 wait complete. 2024-09-19T09:01:37.720 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.716+0000 7f2bdb623740 1 -- start start 2024-09-19T09:01:37.720 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.716+0000 7f2bdb623740 1 Processor -- start 2024-09-19T09:01:37.720 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.716+0000 7f2bdb623740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56273e527010 0x56273e53e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:37.720 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.716+0000 7f2bdb623740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56273e52fdb0 0x56273e53ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:37.720 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.716+0000 7f2bdb623740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56273e5306f0 0x56273e53ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:37.720 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.716+0000 7f2bdb623740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd41a8210 con 0x56273e52fdb0 2024-09-19T09:01:37.720 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.716+0000 7f2bdb623740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd41a7b40 con 0x56273e5306f0 2024-09-19T09:01:37.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.716+0000 7f2bdb623740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2bd41a4d80 con 0x56273e527010 2024-09-19T09:01:37.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.716+0000 7f2bdb623740 10 client.0 _ll_register_callbacks cb 0x7f2bcc0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:37.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.716+0000 7f2bd1d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56273e52fdb0 0x56273e53ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:37.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.716+0000 7f2bd1d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56273e52fdb0 0x56273e53ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58696/0 (socket says 172.21.15.19:58696) 2024-09-19T09:01:37.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.716+0000 7f2bd1d9b640 1 -- 172.21.15.19:0/1089404200 learned_addr learned my addr 172.21.15.19:0/1089404200 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:37.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.716+0000 7f2bd259c640 1 --2- 172.21.15.19:0/1089404200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56273e527010 0x56273e53e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:37.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.716+0000 7f2bd2d9d640 1 --2- 172.21.15.19:0/1089404200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56273e5306f0 0x56273e53ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:37.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.716+0000 7f2bd1d9b640 1 -- 172.21.15.19:0/1089404200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56273e527010 msgr2=0x56273e53e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:37.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.716+0000 7f2bd1d9b640 1 --2- 172.21.15.19:0/1089404200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56273e527010 0x56273e53e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.716+0000 7f2bd1d9b640 1 -- 172.21.15.19:0/1089404200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56273e5306f0 msgr2=0x56273e53ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:37.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.716+0000 7f2bd1d9b640 1 --2- 172.21.15.19:0/1089404200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56273e5306f0 0x56273e53ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:37.721 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.716+0000 7f2bd1d9b640 1 -- 172.21.15.19:0/1089404200 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56273e540520 con 0x56273e52fdb0 2024-09-19T09:01:37.722 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.717+0000 7f2bd1d9b640 1 --2- 172.21.15.19:0/1089404200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56273e52fdb0 0x56273e53ef00 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8010e20 tx=0x7f2bc800f6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abca8bdbce207d5a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:37.722 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.717+0000 7f2bb9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:01:37.722 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.717+0000 7f2bb9ffb640 1 -- 172.21.15.19:0/1089404200 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bc8034070 con 0x56273e52fdb0 2024-09-19T09:01:37.722 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.717+0000 7f2bb9ffb640 1 -- 172.21.15.19:0/1089404200 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2bc8003800 con 0x56273e52fdb0 2024-09-19T09:01:37.722 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.717+0000 7f2bdb623740 1 -- 172.21.15.19:0/1089404200 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2bc8035020 con 0x56273e52fdb0 2024-09-19T09:01:37.722 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.717+0000 7f2bb9ffb640 1 -- 172.21.15.19:0/1089404200 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f2bc800fcd0 con 0x56273e52fdb0 2024-09-19T09:01:37.722 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.717+0000 7f2bdb623740 10 client.17544 fetch_fsmap learned FSMap version 36 2024-09-19T09:01:37.722 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.717+0000 7f2bdb623740 1 -- 172.21.15.19:0/1089404200 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x56273e541830 con 0x56273e52fdb0 2024-09-19T09:01:37.722 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.717+0000 7f2bb9ffb640 1 -- 172.21.15.19:0/1089404200 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2bc8035020 con 0x56273e52fdb0 2024-09-19T09:01:37.722 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.717+0000 7f2bb9ffb640 1 -- 172.21.15.19:0/1089404200 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f2bc8004b60 con 0x56273e52fdb0 2024-09-19T09:01:37.722 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.718+0000 7f2bdb623740 10 client.17544 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:01:37.722 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.718+0000 7f2bdb623740 10 client.17544 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:01:37.722 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.718+0000 7f2bdb623740 20 client.17544 populate_metadata read hostname 'smithi019' 2024-09-19T09:01:37.722 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.718+0000 7f2bdb623740 1 --2- 172.21.15.19:0/1089404200 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56273e535780 0x56273e5b2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:37.723 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.718+0000 7f2bdb623740 4 client.17544 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:01:37.723 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.718+0000 7f2bdb623740 1 -- 172.21.15.19:0/1089404200 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56273e496d70 con 0x56273e535780 2024-09-19T09:01:37.723 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.718+0000 7f2bd259c640 1 --2- 172.21.15.19:0/1089404200 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56273e535780 0x56273e5b2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:37.723 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.718+0000 7f2bb9ffb640 10 client.17544 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:37.723 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:37.718+0000 7f2bd259c640 1 --2- 172.21.15.19:0/1089404200 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56273e535780 0x56273e5b2eb0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9bb37011d43b4ec server_cookie=89a10cd4b220cba4 in_seq=0 out_seq=0 2024-09-19T09:01:37.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:37 smithi155 ceph-mon[34921]: pgmap v619: 97 pgs: 97 active+clean; 24 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 326 op/s 2024-09-19T09:01:37.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:37 smithi203 ceph-mon[35450]: pgmap v619: 97 pgs: 97 active+clean; 24 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 326 op/s 2024-09-19T09:01:38.348 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T09:01:38.620 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:38.745 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:38 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3296488626' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:38.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:38 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3296488626' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:38.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:38 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3296488626' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:01:39.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.155+0000 7f055662b640 1 -- 172.21.15.19:0/2398936318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0550102780 msgr2=0x7f05501067d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:39.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.155+0000 7f055662b640 1 --2- 172.21.15.19:0/2398936318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0550102780 0x7f05501067d0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f0544009900 tx=0x7f054402a410 comp rx=0 tx=0).stop 2024-09-19T09:01:39.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.155+0000 7f055662b640 1 -- 172.21.15.19:0/2398936318 shutdown_connections 2024-09-19T09:01:39.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.155+0000 7f055662b640 1 --2- 172.21.15.19:0/2398936318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0550106f00 0x7f055010ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.155+0000 7f055662b640 1 --2- 172.21.15.19:0/2398936318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0550102780 0x7f05501067d0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.155+0000 7f055662b640 1 --2- 172.21.15.19:0/2398936318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0550101dd0 0x7f05501021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.155+0000 7f055662b640 1 -- 172.21.15.19:0/2398936318 >> 172.21.15.19:0/2398936318 conn(0x7f05500fd890 msgr2=0x7f05500ffcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:39.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.155+0000 7f055662b640 1 -- 172.21.15.19:0/2398936318 shutdown_connections 2024-09-19T09:01:39.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.155+0000 7f055662b640 1 -- 172.21.15.19:0/2398936318 wait complete. 2024-09-19T09:01:39.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.156+0000 7f055662b640 1 Processor -- start 2024-09-19T09:01:39.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.156+0000 7f055662b640 1 -- start start 2024-09-19T09:01:39.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.156+0000 7f055662b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0550101dd0 0x7f0550198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:39.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.156+0000 7f055662b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0550102780 0x7f0550198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:39.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.156+0000 7f055662b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0550106f00 0x7f055019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:39.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.156+0000 7f055662b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0550111f60 con 0x7f0550102780 2024-09-19T09:01:39.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.156+0000 7f055662b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0550111de0 con 0x7f0550106f00 2024-09-19T09:01:39.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.156+0000 7f055662b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f05501120e0 con 0x7f0550101dd0 2024-09-19T09:01:39.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.156+0000 7f0554bc8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0550106f00 0x7f055019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:39.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.156+0000 7f054f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0550102780 0x7f0550198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:39.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.156+0000 7f0554bc8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0550106f00 0x7f055019cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:57092/0 (socket says 172.21.15.19:57092) 2024-09-19T09:01:39.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.156+0000 7f0554bc8640 1 -- 172.21.15.19:0/2446435743 learned_addr learned my addr 172.21.15.19:0/2446435743 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:39.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.156+0000 7f054f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0550102780 0x7f0550198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58716/0 (socket says 172.21.15.19:58716) 2024-09-19T09:01:39.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.157+0000 7f054ffff640 1 --2- 172.21.15.19:0/2446435743 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0550101dd0 0x7f0550198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:39.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.157+0000 7f0554bc8640 1 -- 172.21.15.19:0/2446435743 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0550101dd0 msgr2=0x7f0550198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:39.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.157+0000 7f0554bc8640 1 --2- 172.21.15.19:0/2446435743 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0550101dd0 0x7f0550198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.157+0000 7f0554bc8640 1 -- 172.21.15.19:0/2446435743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0550102780 msgr2=0x7f0550198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:39.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.157+0000 7f0554bc8640 1 --2- 172.21.15.19:0/2446435743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0550102780 0x7f0550198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.157+0000 7f0554bc8640 1 -- 172.21.15.19:0/2446435743 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f055019d3f0 con 0x7f0550106f00 2024-09-19T09:01:39.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.157+0000 7f0554bc8640 1 --2- 172.21.15.19:0/2446435743 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0550106f00 0x7f055019cd10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f054800cce0 tx=0x7f054800a620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:39.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.157+0000 7f054d7fa640 1 -- 172.21.15.19:0/2446435743 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054800f450 con 0x7f0550106f00 2024-09-19T09:01:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.157+0000 7f054d7fa640 1 -- 172.21.15.19:0/2446435743 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f054800fad0 con 0x7f0550106f00 2024-09-19T09:01:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.157+0000 7f055662b640 1 -- 172.21.15.19:0/2446435743 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f055019d6e0 con 0x7f0550106f00 2024-09-19T09:01:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.157+0000 7f054d7fa640 1 -- 172.21.15.19:0/2446435743 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0548018c10 con 0x7f0550106f00 2024-09-19T09:01:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.157+0000 7f055662b640 1 -- 172.21.15.19:0/2446435743 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0550074420 con 0x7f0550106f00 2024-09-19T09:01:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.160+0000 7f054d7fa640 1 -- 172.21.15.19:0/2446435743 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f054800f5f0 con 0x7f0550106f00 2024-09-19T09:01:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.160+0000 7f0558a04740 1 Processor -- start 2024-09-19T09:01:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.160+0000 7f0558a04740 1 -- start start 2024-09-19T09:01:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.161+0000 7f0558a04740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7d61b40 0x5609a7d60090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.161+0000 7f0558a04740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609a7d605d0 0x5609a7d60a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.161+0000 7f0558a04740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609a7d6b370 0x5609a7d6d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.161+0000 7f0558a04740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5609a7cc62f0 con 0x5609a7d61b40 2024-09-19T09:01:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.161+0000 7f0558a04740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5609a7c6dcf0 con 0x5609a7d605d0 2024-09-19T09:01:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.161+0000 7f0558a04740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5609a7cc22b0 con 0x5609a7d6b370 2024-09-19T09:01:39.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.161+0000 7f054d7fa640 1 --2- 172.21.15.19:0/2446435743 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f05380a3240 0x7f05380a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:39.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.161+0000 7f054f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7d61b40 0x5609a7d60090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:39.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.161+0000 7f054f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7d61b40 0x5609a7d60090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58722/0 (socket says 172.21.15.19:58722) 2024-09-19T09:01:39.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.161+0000 7f054f7fe640 1 -- 172.21.15.19:0/3454732039 learned_addr learned my addr 172.21.15.19:0/3454732039 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:39.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.161+0000 7f054f7fe640 1 --2- 172.21.15.19:0/3454732039 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609a7d6b370 0x5609a7d6d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:39.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.161+0000 7f054d7fa640 1 -- 172.21.15.19:0/2446435743 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f05480cff30 con 0x7f0550106f00 2024-09-19T09:01:39.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.161+0000 7f054ffff640 1 --2- 172.21.15.19:0/3454732039 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609a7d605d0 0x5609a7d60a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:39.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.161+0000 7f0554bc8640 1 --2- 172.21.15.19:0/2446435743 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f05380a3240 0x7f05380a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:39.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.161+0000 7f054f7fe640 1 -- 172.21.15.19:0/3454732039 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609a7d6b370 msgr2=0x5609a7d6d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:39.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.161+0000 7f054f7fe640 1 --2- 172.21.15.19:0/3454732039 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609a7d6b370 0x5609a7d6d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.161+0000 7f054f7fe640 1 -- 172.21.15.19:0/3454732039 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609a7d605d0 msgr2=0x5609a7d60a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:39.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.161+0000 7f054f7fe640 1 --2- 172.21.15.19:0/3454732039 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609a7d605d0 0x5609a7d60a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.161+0000 7f054f7fe640 1 -- 172.21.15.19:0/3454732039 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609a7c523a0 con 0x5609a7d61b40 2024-09-19T09:01:39.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.162+0000 7f054f7fe640 1 --2- 172.21.15.19:0/3454732039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7d61b40 0x5609a7d60090 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f0544000c00 tx=0x7f05440058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e226de2142ead2a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:39.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.162+0000 7f0554bc8640 1 --2- 172.21.15.19:0/2446435743 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f05380a3240 0x7f05380a5700 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f054809c260 tx=0x7f054800af30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:39.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.162+0000 7f05367fc640 1 -- 172.21.15.19:0/3454732039 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0544035070 con 0x5609a7d61b40 2024-09-19T09:01:39.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.162+0000 7f05367fc640 1 -- 172.21.15.19:0/3454732039 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0544005500 con 0x5609a7d61b40 2024-09-19T09:01:39.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.162+0000 7f05367fc640 1 -- 172.21.15.19:0/3454732039 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0544043040 con 0x5609a7d61b40 2024-09-19T09:01:39.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.163+0000 7f0558a04740 1 -- 172.21.15.19:0/3454732039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7d61b40 msgr2=0x5609a7d60090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:39.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.163+0000 7f0558a04740 1 --2- 172.21.15.19:0/3454732039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7d61b40 0x5609a7d60090 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f0544000c00 tx=0x7f05440058d0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.163+0000 7f0558a04740 1 -- 172.21.15.19:0/3454732039 shutdown_connections 2024-09-19T09:01:39.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.163+0000 7f0558a04740 1 --2- 172.21.15.19:0/3454732039 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609a7d6b370 0x5609a7d6d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.163+0000 7f0558a04740 1 --2- 172.21.15.19:0/3454732039 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609a7d605d0 0x5609a7d60a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.163+0000 7f0558a04740 1 --2- 172.21.15.19:0/3454732039 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7d61b40 0x5609a7d60090 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.163+0000 7f0558a04740 1 -- 172.21.15.19:0/3454732039 >> 172.21.15.19:0/3454732039 conn(0x5609a7d29310 msgr2=0x5609a7d5cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:39.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.163+0000 7f0558a04740 1 -- 172.21.15.19:0/3454732039 shutdown_connections 2024-09-19T09:01:39.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.163+0000 7f0558a04740 1 -- 172.21.15.19:0/3454732039 wait complete. 2024-09-19T09:01:39.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.163+0000 7f0558a04740 1 -- start start 2024-09-19T09:01:39.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.163+0000 7f0558a04740 1 Processor -- start 2024-09-19T09:01:39.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.164+0000 7f0558a04740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609a7d605d0 0x5609a7d6ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:39.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.164+0000 7f0558a04740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7d61b40 0x5609a7d68040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:39.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.164+0000 7f054ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7d61b40 0x5609a7d68040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:39.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.164+0000 7f054ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7d61b40 0x5609a7d68040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58730/0 (socket says 172.21.15.19:58730) 2024-09-19T09:01:39.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.164+0000 7f0558a04740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609a7d6b370 0x5609a7d68650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:39.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.164+0000 7f054ffff640 1 -- 172.21.15.19:0/1916558649 learned_addr learned my addr 172.21.15.19:0/1916558649 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:39.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.164+0000 7f0558a04740 1 -- 172.21.15.19:0/1916558649 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5609a7d6e010 con 0x5609a7d61b40 2024-09-19T09:01:39.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.164+0000 7f0558a04740 1 -- 172.21.15.19:0/1916558649 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5609a7c81060 con 0x5609a7d6b370 2024-09-19T09:01:39.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.164+0000 7f0558a04740 1 -- 172.21.15.19:0/1916558649 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5609a7d6e190 con 0x5609a7d605d0 2024-09-19T09:01:39.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.164+0000 7f054f7fe640 1 --2- 172.21.15.19:0/1916558649 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609a7d605d0 0x5609a7d6ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:39.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.164+0000 7f0558a04740 10 client.0 _ll_register_callbacks cb 0x5609a79d48c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:39.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.164+0000 7f054f7fe640 1 --2- 172.21.15.19:0/1916558649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609a7d6b370 0x5609a7d68650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:39.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.164+0000 7f054ffff640 1 -- 172.21.15.19:0/1916558649 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609a7d605d0 msgr2=0x5609a7d6ad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:39.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.164+0000 7f054ffff640 1 --2- 172.21.15.19:0/1916558649 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609a7d605d0 0x5609a7d6ad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.164+0000 7f054ffff640 1 -- 172.21.15.19:0/1916558649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609a7d6b370 msgr2=0x5609a7d68650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:39.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.164+0000 7f054ffff640 1 --2- 172.21.15.19:0/1916558649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609a7d6b370 0x5609a7d68650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.164+0000 7f054ffff640 1 -- 172.21.15.19:0/1916558649 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609a7a373c0 con 0x5609a7d61b40 2024-09-19T09:01:39.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.164+0000 7f0558a04740 1 -- 172.21.15.19:0/1916558649 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0544005500 con 0x5609a7d61b40 2024-09-19T09:01:39.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.164+0000 7f054f7fe640 1 --2- 172.21.15.19:0/1916558649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609a7d6b370 0x5609a7d68650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:01:39.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.164+0000 7f054ffff640 1 --2- 172.21.15.19:0/1916558649 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7d61b40 0x5609a7d68040 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f0540012700 tx=0x7f0540012bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbbab6da6f8e0c20 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:39.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.164+0000 7f052f7fe640 10 client.17556 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:01:39.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.165+0000 7f052f7fe640 1 -- 172.21.15.19:0/1916558649 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0540004260 con 0x5609a7d61b40 2024-09-19T09:01:39.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.165+0000 7f052f7fe640 1 -- 172.21.15.19:0/1916558649 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0540004400 con 0x5609a7d61b40 2024-09-19T09:01:39.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.165+0000 7f052f7fe640 1 -- 172.21.15.19:0/1916558649 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f05400119a0 con 0x5609a7d61b40 2024-09-19T09:01:39.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.165+0000 7f0558a04740 10 client.17556 fetch_fsmap learned FSMap version 36 2024-09-19T09:01:39.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.165+0000 7f0558a04740 1 -- 172.21.15.19:0/1916558649 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({fsmap=36}) -- 0x5609a7d79ae0 con 0x5609a7d61b40 2024-09-19T09:01:39.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.165+0000 7f052f7fe640 1 -- 172.21.15.19:0/1916558649 <== mon.0 v2:172.21.15.19:3300/0 4 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f0540011b40 con 0x5609a7d61b40 2024-09-19T09:01:39.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.165+0000 7f0558a04740 10 client.17556 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:01:39.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.165+0000 7f0558a04740 10 client.17556 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T09:01:39.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.165+0000 7f0558a04740 20 client.17556 populate_metadata read hostname 'smithi019' 2024-09-19T09:01:39.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.165+0000 7f0558a04740 1 --2- 172.21.15.19:0/1916558649 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5609a7d7ae90 0x5609a7d7d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:39.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.165+0000 7f0558a04740 4 client.17556 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:01:39.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.165+0000 7f0558a04740 1 -- 172.21.15.19:0/1916558649 --> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5609a7cd3860 con 0x5609a7d7ae90 2024-09-19T09:01:39.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.165+0000 7f054f7fe640 1 --2- 172.21.15.19:0/1916558649 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5609a7d7ae90 0x5609a7d7d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:39.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.166+0000 7f054f7fe640 1 --2- 172.21.15.19:0/1916558649 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5609a7d7ae90 0x5609a7d7d280 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=63f5f407c0fa0f72 server_cookie=22230f46cef42431 in_seq=0 out_seq=0 2024-09-19T09:01:39.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.166+0000 7f052f7fe640 10 client.17556 ms_handle_connect on v2:172.21.15.203:6834/2702758353 2024-09-19T09:01:39.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.166+0000 7f052f7fe640 1 -- 172.21.15.19:0/1916558649 <== mds.4 v2:172.21.15.203:6834/2702758353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5609a7cd3860 con 0x5609a7d7ae90 2024-09-19T09:01:39.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.166+0000 7f052f7fe640 10 client.17556 handle_command_reply: tid=0 2024-09-19T09:01:39.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.167+0000 7f0558a04740 1 client.17556 shutdown 2024-09-19T09:01:39.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.167+0000 7f0558a04740 1 -- 172.21.15.19:0/1916558649 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7d61b40 msgr2=0x5609a7d68040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:39.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.167+0000 7f0558a04740 1 --2- 172.21.15.19:0/1916558649 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7d61b40 0x5609a7d68040 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f0540012700 tx=0x7f0540012bc0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.167+0000 7f0558a04740 1 -- 172.21.15.19:0/1916558649 shutdown_connections 2024-09-19T09:01:39.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.167+0000 7f0558a04740 1 --2- 172.21.15.19:0/1916558649 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5609a7d7ae90 0x5609a7d7d280 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.167+0000 7f052f7fe640 0 client.17556 ms_handle_reset on v2:172.21.15.203:6834/2702758353 2024-09-19T09:01:39.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.167+0000 7f0558a04740 1 --2- 172.21.15.19:0/1916558649 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609a7d6b370 0x5609a7d68650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.167+0000 7f0558a04740 1 --2- 172.21.15.19:0/1916558649 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7d61b40 0x5609a7d68040 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.167+0000 7f0558a04740 1 --2- 172.21.15.19:0/1916558649 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609a7d605d0 0x5609a7d6ad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.167+0000 7f0558a04740 1 -- 172.21.15.19:0/1916558649 >> 172.21.15.19:0/1916558649 conn(0x5609a7d29310 msgr2=0x5609a7d62930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:39.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.167+0000 7f0558a04740 1 -- 172.21.15.19:0/1916558649 shutdown_connections 2024-09-19T09:01:39.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.167+0000 7f0558a04740 1 -- 172.21.15.19:0/1916558649 wait complete. 2024-09-19T09:01:39.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.167+0000 7f0558a04740 20 client.17556 trim_cache size 0 max 16384 2024-09-19T09:01:39.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.182+0000 7f0558a04740 1 Processor -- start 2024-09-19T09:01:39.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.182+0000 7f0558a04740 1 -- start start 2024-09-19T09:01:39.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.182+0000 7f0558a04740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609a7d605d0 0x5609a7d5ba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:39.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.182+0000 7f0558a04740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609a7d61b40 0x5609a7d5bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:39.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.182+0000 7f0558a04740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7d6b370 0x5609a7d63120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:39.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.182+0000 7f0558a04740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f05501ab1d0 con 0x5609a7d6b370 2024-09-19T09:01:39.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.182+0000 7f0558a04740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f05501acd10 con 0x5609a7d61b40 2024-09-19T09:01:39.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.182+0000 7f0558a04740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f05501ab8a0 con 0x5609a7d605d0 2024-09-19T09:01:39.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.182+0000 7f054ffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609a7d61b40 0x5609a7d5bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:39.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.182+0000 7f054f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7d6b370 0x5609a7d63120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:39.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.182+0000 7f054ffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609a7d61b40 0x5609a7d5bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:57134/0 (socket says 172.21.15.19:57134) 2024-09-19T09:01:39.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.182+0000 7f054ffff640 1 -- 172.21.15.19:0/941579088 learned_addr learned my addr 172.21.15.19:0/941579088 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:39.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.183+0000 7f054f7fe640 1 --2- 172.21.15.19:0/941579088 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609a7d605d0 0x5609a7d5ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:39.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.183+0000 7f054ffff640 1 -- 172.21.15.19:0/941579088 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609a7d605d0 msgr2=0x5609a7d5ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:39.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.183+0000 7f054ffff640 1 --2- 172.21.15.19:0/941579088 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609a7d605d0 0x5609a7d5ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.183+0000 7f054ffff640 1 -- 172.21.15.19:0/941579088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7d6b370 msgr2=0x5609a7d63120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:39.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.183+0000 7f054ffff640 1 --2- 172.21.15.19:0/941579088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7d6b370 0x5609a7d63120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.183+0000 7f054ffff640 1 -- 172.21.15.19:0/941579088 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5609a7d67010 con 0x5609a7d61b40 2024-09-19T09:01:39.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.183+0000 7f054f7fe640 1 --2- 172.21.15.19:0/941579088 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609a7d605d0 0x5609a7d5ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:39.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.183+0000 7f054ffff640 1 --2- 172.21.15.19:0/941579088 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609a7d61b40 0x5609a7d5bf60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0540000c00 tx=0x7f054000e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68eacc0f7a4c9ed8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:39.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.183+0000 7f0535ffb640 1 -- 172.21.15.19:0/941579088 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0540004260 con 0x5609a7d61b40 2024-09-19T09:01:39.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.183+0000 7f0535ffb640 1 -- 172.21.15.19:0/941579088 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0544005500 con 0x5609a7d61b40 2024-09-19T09:01:39.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.183+0000 7f0535ffb640 1 -- 172.21.15.19:0/941579088 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05400316c0 con 0x5609a7d61b40 2024-09-19T09:01:39.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.184+0000 7f0558a04740 1 -- 172.21.15.19:0/941579088 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609a7d61b40 msgr2=0x5609a7d5bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:39.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.184+0000 7f0558a04740 1 --2- 172.21.15.19:0/941579088 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609a7d61b40 0x5609a7d5bf60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0540000c00 tx=0x7f054000e000 comp rx=0 tx=0).stop 2024-09-19T09:01:39.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.184+0000 7f0558a04740 1 -- 172.21.15.19:0/941579088 shutdown_connections 2024-09-19T09:01:39.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.184+0000 7f0558a04740 1 --2- 172.21.15.19:0/941579088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7d6b370 0x5609a7d63120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.184+0000 7f0558a04740 1 --2- 172.21.15.19:0/941579088 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609a7d61b40 0x5609a7d5bf60 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.184+0000 7f0558a04740 1 --2- 172.21.15.19:0/941579088 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609a7d605d0 0x5609a7d5ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.184+0000 7f0558a04740 1 -- 172.21.15.19:0/941579088 >> 172.21.15.19:0/941579088 conn(0x5609a7d29310 msgr2=0x5609a7d5b310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:39.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.184+0000 7f0558a04740 1 -- 172.21.15.19:0/941579088 shutdown_connections 2024-09-19T09:01:39.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.184+0000 7f0558a04740 1 -- 172.21.15.19:0/941579088 wait complete. 2024-09-19T09:01:39.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.185+0000 7f0558a04740 1 -- start start 2024-09-19T09:01:39.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.185+0000 7f0558a04740 1 Processor -- start 2024-09-19T09:01:39.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.185+0000 7f0558a04740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609a7d605d0 0x5609a7d73450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:39.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.185+0000 7f0558a04740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609a7d61b40 0x5609a7d73990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:39.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.185+0000 7f0558a04740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7d6b370 0x5609a7d70420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:39.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.185+0000 7f0558a04740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f05501ac640 con 0x5609a7d6b370 2024-09-19T09:01:39.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.185+0000 7f0558a04740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f05501abf70 con 0x5609a7d605d0 2024-09-19T09:01:39.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.185+0000 7f0558a04740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f05501a91d0 con 0x5609a7d61b40 2024-09-19T09:01:39.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.185+0000 7f0558a04740 10 client.0 _ll_register_callbacks cb 0x7f05400097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:39.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.185+0000 7f054f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7d6b370 0x5609a7d70420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:39.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.185+0000 7f054f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7d6b370 0x5609a7d70420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58748/0 (socket says 172.21.15.19:58748) 2024-09-19T09:01:39.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.186+0000 7f054f7fe640 1 -- 172.21.15.19:0/2415654143 learned_addr learned my addr 172.21.15.19:0/2415654143 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:39.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.186+0000 7f054f7fe640 1 --2- 172.21.15.19:0/2415654143 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609a7d605d0 0x5609a7d73450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:39.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.186+0000 7f054ffff640 1 --2- 172.21.15.19:0/2415654143 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609a7d61b40 0x5609a7d73990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:39.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.186+0000 7f054f7fe640 1 -- 172.21.15.19:0/2415654143 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609a7d61b40 msgr2=0x5609a7d73990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:39.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.186+0000 7f054f7fe640 1 --2- 172.21.15.19:0/2415654143 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609a7d61b40 0x5609a7d73990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.186+0000 7f054f7fe640 1 -- 172.21.15.19:0/2415654143 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609a7d605d0 msgr2=0x5609a7d73450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:39.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.186+0000 7f054f7fe640 1 --2- 172.21.15.19:0/2415654143 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609a7d605d0 0x5609a7d73450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.186+0000 7f054f7fe640 1 -- 172.21.15.19:0/2415654143 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5609a7d73fd0 con 0x5609a7d6b370 2024-09-19T09:01:39.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.186+0000 7f054f7fe640 1 --2- 172.21.15.19:0/2415654143 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7d6b370 0x5609a7d70420 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f0544009800 tx=0x7f0544004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cfffa8fbf3ac8b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:39.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.186+0000 7f052f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:01:39.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.186+0000 7f052f7fe640 1 -- 172.21.15.19:0/2415654143 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054405c070 con 0x5609a7d6b370 2024-09-19T09:01:39.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.186+0000 7f052f7fe640 1 -- 172.21.15.19:0/2415654143 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0544057e80 con 0x5609a7d6b370 2024-09-19T09:01:39.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.186+0000 7f0558a04740 1 -- 172.21.15.19:0/2415654143 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0544005500 con 0x5609a7d6b370 2024-09-19T09:01:39.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.187+0000 7f052f7fe640 1 -- 172.21.15.19:0/2415654143 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f0544035040 con 0x5609a7d6b370 2024-09-19T09:01:39.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.187+0000 7f0558a04740 10 client.17562 fetch_fsmap learned FSMap version 36 2024-09-19T09:01:39.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.187+0000 7f0558a04740 1 -- 172.21.15.19:0/2415654143 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5609a7de5ff0 con 0x5609a7d6b370 2024-09-19T09:01:39.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.187+0000 7f052f7fe640 1 -- 172.21.15.19:0/2415654143 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0544005500 con 0x5609a7d6b370 2024-09-19T09:01:39.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.187+0000 7f052f7fe640 1 -- 172.21.15.19:0/2415654143 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f0544057950 con 0x5609a7d6b370 2024-09-19T09:01:39.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.187+0000 7f0558a04740 10 client.17562 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:01:39.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.187+0000 7f0558a04740 10 client.17562 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T09:01:39.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.187+0000 7f0558a04740 20 client.17562 populate_metadata read hostname 'smithi019' 2024-09-19T09:01:39.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.187+0000 7f0558a04740 1 --2- 172.21.15.19:0/2415654143 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5609a7de6280 0x5609a7de8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:39.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.187+0000 7f0558a04740 4 client.17562 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:01:39.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.187+0000 7f0558a04740 1 -- 172.21.15.19:0/2415654143 --> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5609a7ccdd70 con 0x5609a7de6280 2024-09-19T09:01:39.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.187+0000 7f054ffff640 1 --2- 172.21.15.19:0/2415654143 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5609a7de6280 0x5609a7de8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:39.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.188+0000 7f054ffff640 1 --2- 172.21.15.19:0/2415654143 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5609a7de6280 0x5609a7de8670 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f9769932ccb133c4 server_cookie=53e3c5474dcbf9d1 in_seq=0 out_seq=0 2024-09-19T09:01:39.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.188+0000 7f052f7fe640 10 client.17562 ms_handle_connect on v2:172.21.15.203:6834/2702758353 2024-09-19T09:01:39.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.188+0000 7f052f7fe640 1 -- 172.21.15.19:0/2415654143 <== mds.4 v2:172.21.15.203:6834/2702758353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5609a7ccdd70 con 0x5609a7de6280 2024-09-19T09:01:39.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.188+0000 7f052f7fe640 10 client.17562 handle_command_reply: tid=0 2024-09-19T09:01:39.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.188+0000 7f0558a04740 1 client.17562 shutdown 2024-09-19T09:01:39.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.188+0000 7f0558a04740 1 -- 172.21.15.19:0/2415654143 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7d6b370 msgr2=0x5609a7d70420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:39.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.188+0000 7f0558a04740 1 --2- 172.21.15.19:0/2415654143 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7d6b370 0x5609a7d70420 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f0544009800 tx=0x7f0544004610 comp rx=0 tx=0).stop 2024-09-19T09:01:39.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.188+0000 7f0558a04740 1 -- 172.21.15.19:0/2415654143 shutdown_connections 2024-09-19T09:01:39.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.188+0000 7f0558a04740 1 --2- 172.21.15.19:0/2415654143 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5609a7de6280 0x5609a7de8670 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.188+0000 7f052f7fe640 0 client.17562 ms_handle_reset on v2:172.21.15.203:6834/2702758353 2024-09-19T09:01:39.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.188+0000 7f0558a04740 1 --2- 172.21.15.19:0/2415654143 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5609a7d61b40 0x5609a7d73990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.188+0000 7f0558a04740 1 --2- 172.21.15.19:0/2415654143 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5609a7d6b370 0x5609a7d70420 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.188+0000 7f0558a04740 1 --2- 172.21.15.19:0/2415654143 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5609a7d605d0 0x5609a7d73450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.188+0000 7f0558a04740 1 -- 172.21.15.19:0/2415654143 >> 172.21.15.19:0/2415654143 conn(0x5609a7d29310 msgr2=0x5609a7d5bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:39.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.188+0000 7f0558a04740 1 -- 172.21.15.19:0/2415654143 shutdown_connections 2024-09-19T09:01:39.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.188+0000 7f0558a04740 1 -- 172.21.15.19:0/2415654143 wait complete. 2024-09-19T09:01:39.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.188+0000 7f0558a04740 20 client.17562 trim_cache size 0 max 16384 2024-09-19T09:01:39.193 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:01:39.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.189+0000 7f055662b640 1 -- 172.21.15.19:0/2446435743 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f05380a3240 msgr2=0x7f05380a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:39.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.189+0000 7f055662b640 1 --2- 172.21.15.19:0/2446435743 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f05380a3240 0x7f05380a5700 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f054809c260 tx=0x7f054800af30 comp rx=0 tx=0).stop 2024-09-19T09:01:39.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.189+0000 7f055662b640 1 -- 172.21.15.19:0/2446435743 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0550106f00 msgr2=0x7f055019cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:39.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.189+0000 7f055662b640 1 --2- 172.21.15.19:0/2446435743 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0550106f00 0x7f055019cd10 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f054800cce0 tx=0x7f054800a620 comp rx=0 tx=0).stop 2024-09-19T09:01:39.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.189+0000 7f055662b640 1 -- 172.21.15.19:0/2446435743 shutdown_connections 2024-09-19T09:01:39.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.189+0000 7f055662b640 1 --2- 172.21.15.19:0/2446435743 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f05380a3240 0x7f05380a5700 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.189+0000 7f055662b640 1 --2- 172.21.15.19:0/2446435743 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f0550106f00 0x7f055019cd10 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.189+0000 7f055662b640 1 --2- 172.21.15.19:0/2446435743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0550102780 0x7f0550198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.189+0000 7f055662b640 1 --2- 172.21.15.19:0/2446435743 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0550101dd0 0x7f0550198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:39.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.189+0000 7f055662b640 1 -- 172.21.15.19:0/2446435743 >> 172.21.15.19:0/2446435743 conn(0x7f05500fd890 msgr2=0x7f05500febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:39.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.189+0000 7f055662b640 1 -- 172.21.15.19:0/2446435743 shutdown_connections 2024-09-19T09:01:39.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:39.189+0000 7f055662b640 1 -- 172.21.15.19:0/2446435743 wait complete. 2024-09-19T09:01:39.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:39 smithi019 ceph-mon[30976]: pgmap v620: 97 pgs: 97 active+clean; 31 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 373 op/s 2024-09-19T09:01:39.885 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T09:01:39.922 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:39 smithi155 ceph-mon[34921]: pgmap v620: 97 pgs: 97 active+clean; 31 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 373 op/s 2024-09-19T09:01:39.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:39 smithi203 ceph-mon[35450]: pgmap v620: 97 pgs: 97 active+clean; 31 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 373 op/s 2024-09-19T09:01:40.158 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:40.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.696+0000 7f2c44cc0640 1 -- 172.21.15.19:0/4136961945 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c4010e500 msgr2=0x7f2c40110910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:40.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.696+0000 7f2c44cc0640 1 --2- 172.21.15.19:0/4136961945 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c4010e500 0x7f2c40110910 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f2c38009ca0 tx=0x7f2c3802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.696+0000 7f2c44cc0640 1 -- 172.21.15.19:0/4136961945 shutdown_connections 2024-09-19T09:01:40.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.696+0000 7f2c44cc0640 1 --2- 172.21.15.19:0/4136961945 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2c40101440 0x7f2c4010df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.696+0000 7f2c44cc0640 1 --2- 172.21.15.19:0/4136961945 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c4010e500 0x7f2c40110910 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.696+0000 7f2c44cc0640 1 --2- 172.21.15.19:0/4136961945 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c40100b20 0x7f2c40100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.696+0000 7f2c44cc0640 1 -- 172.21.15.19:0/4136961945 >> 172.21.15.19:0/4136961945 conn(0x7f2c400fc7d0 msgr2=0x7f2c400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:40.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.696+0000 7f2c44cc0640 1 -- 172.21.15.19:0/4136961945 shutdown_connections 2024-09-19T09:01:40.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.696+0000 7f2c44cc0640 1 -- 172.21.15.19:0/4136961945 wait complete. 2024-09-19T09:01:40.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.697+0000 7f2c44cc0640 1 Processor -- start 2024-09-19T09:01:40.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.697+0000 7f2c44cc0640 1 -- start start 2024-09-19T09:01:40.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.697+0000 7f2c44cc0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c40100b20 0x7f2c4019a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:40.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.697+0000 7f2c44cc0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c40101440 0x7f2c4019ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:40.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.697+0000 7f2c44cc0640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2c4010e500 0x7f2c4019f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:40.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.697+0000 7f2c44cc0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2c40114230 con 0x7f2c40100b20 2024-09-19T09:01:40.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.697+0000 7f2c44cc0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2c401140b0 con 0x7f2c40101440 2024-09-19T09:01:40.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.697+0000 7f2c44cc0640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2c401143b0 con 0x7f2c4010e500 2024-09-19T09:01:40.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.697+0000 7f2c3e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c40100b20 0x7f2c4019a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:40.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.697+0000 7f2c37fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c40101440 0x7f2c4019ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:40.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.697+0000 7f2c3e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c40100b20 0x7f2c4019a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58772/0 (socket says 172.21.15.19:58772) 2024-09-19T09:01:40.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.697+0000 7f2c3e59c640 1 -- 172.21.15.19:0/2728659681 learned_addr learned my addr 172.21.15.19:0/2728659681 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:40.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.697+0000 7f2c3ed9d640 1 --2- 172.21.15.19:0/2728659681 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2c4010e500 0x7f2c4019f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:40.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.698+0000 7f2c37fff640 1 -- 172.21.15.19:0/2728659681 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2c4010e500 msgr2=0x7f2c4019f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:40.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.698+0000 7f2c37fff640 1 --2- 172.21.15.19:0/2728659681 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2c4010e500 0x7f2c4019f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.698+0000 7f2c37fff640 1 -- 172.21.15.19:0/2728659681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c40100b20 msgr2=0x7f2c4019a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:40.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.698+0000 7f2c37fff640 1 --2- 172.21.15.19:0/2728659681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c40100b20 0x7f2c4019a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.698+0000 7f2c37fff640 1 -- 172.21.15.19:0/2728659681 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c4019f6e0 con 0x7f2c40101440 2024-09-19T09:01:40.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.698+0000 7f2c37fff640 1 --2- 172.21.15.19:0/2728659681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c40101440 0x7f2c4019ac70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2c2800e9c0 tx=0x7f2c2800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:40.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.698+0000 7f2c377fe640 1 -- 172.21.15.19:0/2728659681 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2800cd80 con 0x7f2c40101440 2024-09-19T09:01:40.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.698+0000 7f2c44cc0640 1 -- 172.21.15.19:0/2728659681 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c4019f9d0 con 0x7f2c40101440 2024-09-19T09:01:40.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.698+0000 7f2c377fe640 1 -- 172.21.15.19:0/2728659681 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c28010910 con 0x7f2c40101440 2024-09-19T09:01:40.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.698+0000 7f2c377fe640 1 -- 172.21.15.19:0/2728659681 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c28018980 con 0x7f2c40101440 2024-09-19T09:01:40.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.698+0000 7f2c44cc0640 1 -- 172.21.15.19:0/2728659681 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c401a72b0 con 0x7f2c40101440 2024-09-19T09:01:40.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.701+0000 7f2c377fe640 1 -- 172.21.15.19:0/2728659681 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f2c2801f020 con 0x7f2c40101440 2024-09-19T09:01:40.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.701+0000 7f2c47099740 1 Processor -- start 2024-09-19T09:01:40.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.701+0000 7f2c47099740 1 -- start start 2024-09-19T09:01:40.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.701+0000 7f2c47099740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6aeb74b40 0x55b6aeb73090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:40.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.701+0000 7f2c47099740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6aeb735d0 0x55b6aeb73a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:40.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.701+0000 7f2c47099740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6aeb7e370 0x55b6aeb80760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:40.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.701+0000 7f2c47099740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b6aead92f0 con 0x55b6aeb74b40 2024-09-19T09:01:40.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.701+0000 7f2c47099740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b6aea80cf0 con 0x55b6aeb7e370 2024-09-19T09:01:40.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.701+0000 7f2c47099740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b6aead52b0 con 0x55b6aeb735d0 2024-09-19T09:01:40.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.701+0000 7f2c3ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6aeb74b40 0x55b6aeb73090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:40.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.701+0000 7f2c3ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6aeb74b40 0x55b6aeb73090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58786/0 (socket says 172.21.15.19:58786) 2024-09-19T09:01:40.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.702+0000 7f2c3ed9d640 1 -- 172.21.15.19:0/744741446 learned_addr learned my addr 172.21.15.19:0/744741446 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:40.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.701+0000 7f2c37fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6aeb7e370 0x55b6aeb80760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:40.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.702+0000 7f2c3e59c640 1 --2- 172.21.15.19:0/744741446 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6aeb735d0 0x55b6aeb73a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:40.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.702+0000 7f2c377fe640 1 --2- 172.21.15.19:0/2728659681 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2c2c0a3240 0x7f2c2c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:40.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.702+0000 7f2c37fff640 1 -- 172.21.15.19:0/744741446 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6aeb735d0 msgr2=0x55b6aeb73a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:40.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.702+0000 7f2c37fff640 1 --2- 172.21.15.19:0/744741446 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6aeb735d0 0x55b6aeb73a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.702+0000 7f2c37fff640 1 -- 172.21.15.19:0/744741446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6aeb74b40 msgr2=0x55b6aeb73090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:40.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.702+0000 7f2c37fff640 1 --2- 172.21.15.19:0/744741446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6aeb74b40 0x55b6aeb73090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.702+0000 7f2c37fff640 1 -- 172.21.15.19:0/744741446 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6aea653a0 con 0x55b6aeb7e370 2024-09-19T09:01:40.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.702+0000 7f2c3e59c640 1 --2- 172.21.15.19:0/744741446 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6aeb735d0 0x55b6aeb73a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:40.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.702+0000 7f2c3ed9d640 1 --2- 172.21.15.19:0/2728659681 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2c2c0a3240 0x7f2c2c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:40.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.702+0000 7f2c377fe640 1 -- 172.21.15.19:0/2728659681 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2c280cf8c0 con 0x7f2c40101440 2024-09-19T09:01:40.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.702+0000 7f2c37fff640 1 --2- 172.21.15.19:0/744741446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6aeb7e370 0x55b6aeb80760 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2c280cd310 tx=0x7f2c2800cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a3e6ec9e8bfbdbd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:40.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.702+0000 7f2c34ff9640 1 -- 172.21.15.19:0/744741446 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2809b7f0 con 0x55b6aeb7e370 2024-09-19T09:01:40.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.703+0000 7f2c34ff9640 1 -- 172.21.15.19:0/744741446 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c2809c590 con 0x55b6aeb7e370 2024-09-19T09:01:40.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.703+0000 7f2c34ff9640 1 -- 172.21.15.19:0/744741446 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c280b0100 con 0x55b6aeb7e370 2024-09-19T09:01:40.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.703+0000 7f2c47099740 1 -- 172.21.15.19:0/744741446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6aeb7e370 msgr2=0x55b6aeb80760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:40.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.703+0000 7f2c3ed9d640 1 --2- 172.21.15.19:0/2728659681 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2c2c0a3240 0x7f2c2c0a5700 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2c38004af0 tx=0x7f2c380095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:40.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.703+0000 7f2c47099740 1 --2- 172.21.15.19:0/744741446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6aeb7e370 0x55b6aeb80760 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2c280cd310 tx=0x7f2c2800cf20 comp rx=0 tx=0).stop 2024-09-19T09:01:40.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.703+0000 7f2c47099740 1 -- 172.21.15.19:0/744741446 shutdown_connections 2024-09-19T09:01:40.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.703+0000 7f2c47099740 1 --2- 172.21.15.19:0/744741446 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6aeb735d0 0x55b6aeb73a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.703+0000 7f2c47099740 1 --2- 172.21.15.19:0/744741446 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6aeb7e370 0x55b6aeb80760 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.703+0000 7f2c47099740 1 --2- 172.21.15.19:0/744741446 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6aeb74b40 0x55b6aeb73090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.703+0000 7f2c47099740 1 -- 172.21.15.19:0/744741446 >> 172.21.15.19:0/744741446 conn(0x55b6aeb3c310 msgr2=0x55b6aeb6fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:40.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.704+0000 7f2c47099740 1 -- 172.21.15.19:0/744741446 shutdown_connections 2024-09-19T09:01:40.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.704+0000 7f2c47099740 1 -- 172.21.15.19:0/744741446 wait complete. 2024-09-19T09:01:40.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.704+0000 7f2c47099740 1 -- start start 2024-09-19T09:01:40.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.704+0000 7f2c47099740 1 Processor -- start 2024-09-19T09:01:40.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.704+0000 7f2c47099740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6aeb735d0 0x55b6aeb7dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:40.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.704+0000 7f2c47099740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6aeb74b40 0x55b6aeb7afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:40.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.704+0000 7f2c47099740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6aeb7e370 0x55b6aeb7b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.704+0000 7f2c47099740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b6aeb81010 con 0x55b6aeb7e370 2024-09-19T09:01:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.704+0000 7f2c47099740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b6aea94060 con 0x55b6aeb74b40 2024-09-19T09:01:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.704+0000 7f2c47099740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b6aeb81190 con 0x55b6aeb735d0 2024-09-19T09:01:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.704+0000 7f2c47099740 10 client.0 _ll_register_callbacks cb 0x55b6ae7e78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.704+0000 7f2c3ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6aeb7e370 0x55b6aeb7b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.704+0000 7f2c37fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6aeb74b40 0x55b6aeb7afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.704+0000 7f2c3ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6aeb7e370 0x55b6aeb7b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58798/0 (socket says 172.21.15.19:58798) 2024-09-19T09:01:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.704+0000 7f2c3ed9d640 1 -- 172.21.15.19:0/1076360942 learned_addr learned my addr 172.21.15.19:0/1076360942 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.705+0000 7f2c3e59c640 1 --2- 172.21.15.19:0/1076360942 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6aeb735d0 0x55b6aeb7dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.705+0000 7f2c37fff640 1 -- 172.21.15.19:0/1076360942 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6aeb735d0 msgr2=0x55b6aeb7dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.705+0000 7f2c37fff640 1 --2- 172.21.15.19:0/1076360942 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6aeb735d0 0x55b6aeb7dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.705+0000 7f2c37fff640 1 -- 172.21.15.19:0/1076360942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6aeb7e370 msgr2=0x55b6aeb7b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:40.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.705+0000 7f2c37fff640 1 --2- 172.21.15.19:0/1076360942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6aeb7e370 0x55b6aeb7b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.705+0000 7f2c37fff640 1 -- 172.21.15.19:0/1076360942 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6ae84a3c0 con 0x55b6aeb74b40 2024-09-19T09:01:40.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.705+0000 7f2c37fff640 1 --2- 172.21.15.19:0/1076360942 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6aeb74b40 0x55b6aeb7afe0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2c280cd310 tx=0x7f2c28010e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc379ef99e7154a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:40.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.705+0000 7f2c25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T09:01:40.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.705+0000 7f2c25ffb640 1 -- 172.21.15.19:0/1076360942 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2809b7f0 con 0x55b6aeb74b40 2024-09-19T09:01:40.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.705+0000 7f2c25ffb640 1 -- 172.21.15.19:0/1076360942 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2c28099f30 con 0x55b6aeb74b40 2024-09-19T09:01:40.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.705+0000 7f2c47099740 1 -- 172.21.15.19:0/1076360942 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c2809c590 con 0x55b6aeb74b40 2024-09-19T09:01:40.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.705+0000 7f2c25ffb640 1 -- 172.21.15.19:0/1076360942 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f2c2809be90 con 0x55b6aeb74b40 2024-09-19T09:01:40.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.705+0000 7f2c47099740 10 client.27032 fetch_fsmap learned FSMap version 36 2024-09-19T09:01:40.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.705+0000 7f2c47099740 1 -- 172.21.15.19:0/1076360942 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55b6aeb8ca70 con 0x55b6aeb74b40 2024-09-19T09:01:40.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.706+0000 7f2c25ffb640 1 -- 172.21.15.19:0/1076360942 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c280a0240 con 0x55b6aeb74b40 2024-09-19T09:01:40.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.706+0000 7f2c25ffb640 1 -- 172.21.15.19:0/1076360942 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f2c280cd3f0 con 0x55b6aeb74b40 2024-09-19T09:01:40.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.706+0000 7f2c47099740 10 client.27032 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:01:40.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.706+0000 7f2c47099740 10 client.27032 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-19T09:01:40.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.706+0000 7f2c47099740 20 client.27032 populate_metadata read hostname 'smithi019' 2024-09-19T09:01:40.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.706+0000 7f2c47099740 1 --2- 172.21.15.19:0/1076360942 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55b6aeb8ddc0 0x55b6aeb901b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:40.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.706+0000 7f2c47099740 4 client.27032 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:01:40.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.706+0000 7f2c47099740 1 -- 172.21.15.19:0/1076360942 --> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f2c2809c590 con 0x55b6aeb8ddc0 2024-09-19T09:01:40.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.706+0000 7f2c3e59c640 1 --2- 172.21.15.19:0/1076360942 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55b6aeb8ddc0 0x55b6aeb901b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:40.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.706+0000 7f2c25ffb640 10 client.27032 ms_handle_connect on v2:172.21.15.155:6836/3381010945 2024-09-19T09:01:40.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.706+0000 7f2c3e59c640 1 --2- 172.21.15.19:0/1076360942 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55b6aeb8ddc0 0x55b6aeb901b0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6e85c19164b9222c server_cookie=45903d106af26639 in_seq=0 out_seq=0 2024-09-19T09:01:40.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.707+0000 7f2c25ffb640 1 -- 172.21.15.19:0/1076360942 <== mds.3 v2:172.21.15.155:6836/3381010945 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f2c2809c590 con 0x55b6aeb8ddc0 2024-09-19T09:01:40.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.707+0000 7f2c25ffb640 10 client.27032 handle_command_reply: tid=0 2024-09-19T09:01:40.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.707+0000 7f2c47099740 1 client.27032 shutdown 2024-09-19T09:01:40.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.707+0000 7f2c47099740 1 -- 172.21.15.19:0/1076360942 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6aeb74b40 msgr2=0x55b6aeb7afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:40.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.707+0000 7f2c47099740 1 --2- 172.21.15.19:0/1076360942 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6aeb74b40 0x55b6aeb7afe0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2c280cd310 tx=0x7f2c28010e90 comp rx=0 tx=0).stop 2024-09-19T09:01:40.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.707+0000 7f2c47099740 1 -- 172.21.15.19:0/1076360942 shutdown_connections 2024-09-19T09:01:40.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.707+0000 7f2c47099740 1 --2- 172.21.15.19:0/1076360942 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55b6aeb8ddc0 0x55b6aeb901b0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.707+0000 7f2c47099740 1 --2- 172.21.15.19:0/1076360942 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6aeb7e370 0x55b6aeb7b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.707+0000 7f2c47099740 1 --2- 172.21.15.19:0/1076360942 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6aeb74b40 0x55b6aeb7afe0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.707+0000 7f2c47099740 1 --2- 172.21.15.19:0/1076360942 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6aeb735d0 0x55b6aeb7dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.707+0000 7f2c25ffb640 0 client.27032 ms_handle_reset on v2:172.21.15.155:6836/3381010945 2024-09-19T09:01:40.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.707+0000 7f2c47099740 1 -- 172.21.15.19:0/1076360942 >> 172.21.15.19:0/1076360942 conn(0x55b6aeb3c310 msgr2=0x55b6aeb75960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:40.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.708+0000 7f2c47099740 1 -- 172.21.15.19:0/1076360942 shutdown_connections 2024-09-19T09:01:40.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.708+0000 7f2c47099740 1 -- 172.21.15.19:0/1076360942 wait complete. 2024-09-19T09:01:40.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.708+0000 7f2c47099740 20 client.27032 trim_cache size 0 max 16384 2024-09-19T09:01:40.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.721+0000 7f2c47099740 1 Processor -- start 2024-09-19T09:01:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.721+0000 7f2c47099740 1 -- start start 2024-09-19T09:01:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.721+0000 7f2c47099740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6aeb735d0 0x55b6aeb8a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.721+0000 7f2c47099740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6aeb74b40 0x55b6aeb95750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.721+0000 7f2c47099740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6aeb7e370 0x55b6aeb95c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.721+0000 7f2c47099740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2c401af7d0 con 0x55b6aeb74b40 2024-09-19T09:01:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.721+0000 7f2c47099740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2c401b1310 con 0x55b6aeb735d0 2024-09-19T09:01:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.721+0000 7f2c47099740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2c401afea0 con 0x55b6aeb7e370 2024-09-19T09:01:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.722+0000 7f2c3e59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6aeb735d0 0x55b6aeb8a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.722+0000 7f2c37fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6aeb74b40 0x55b6aeb95750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.722+0000 7f2c3e59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6aeb735d0 0x55b6aeb8a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:57162/0 (socket says 172.21.15.19:57162) 2024-09-19T09:01:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.722+0000 7f2c3e59c640 1 -- 172.21.15.19:0/3912728635 learned_addr learned my addr 172.21.15.19:0/3912728635 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.722+0000 7f2c3ed9d640 1 --2- 172.21.15.19:0/3912728635 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6aeb7e370 0x55b6aeb95c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:40.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.722+0000 7f2c3e59c640 1 -- 172.21.15.19:0/3912728635 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6aeb7e370 msgr2=0x55b6aeb95c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.722+0000 7f2c3e59c640 1 --2- 172.21.15.19:0/3912728635 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6aeb7e370 0x55b6aeb95c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.722+0000 7f2c3e59c640 1 -- 172.21.15.19:0/3912728635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6aeb74b40 msgr2=0x55b6aeb95750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.722+0000 7f2c3e59c640 1 --2- 172.21.15.19:0/3912728635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6aeb74b40 0x55b6aeb95750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.722+0000 7f2c3e59c640 1 -- 172.21.15.19:0/3912728635 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6aeb7e060 con 0x55b6aeb735d0 2024-09-19T09:01:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.722+0000 7f2c37fff640 1 --2- 172.21.15.19:0/3912728635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6aeb74b40 0x55b6aeb95750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:40.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.722+0000 7f2c3e59c640 1 --2- 172.21.15.19:0/3912728635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6aeb735d0 0x55b6aeb8a2b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2c30009620 tx=0x7f2c30005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0e03398db39fe71 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:40.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.722+0000 7f2c27fff640 1 -- 172.21.15.19:0/3912728635 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c30004310 con 0x55b6aeb735d0 2024-09-19T09:01:40.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.722+0000 7f2c27fff640 1 -- 172.21.15.19:0/3912728635 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c300044b0 con 0x55b6aeb735d0 2024-09-19T09:01:40.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.722+0000 7f2c27fff640 1 -- 172.21.15.19:0/3912728635 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c30003850 con 0x55b6aeb735d0 2024-09-19T09:01:40.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.723+0000 7f2c47099740 1 -- 172.21.15.19:0/3912728635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6aeb735d0 msgr2=0x55b6aeb8a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:40.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.723+0000 7f2c47099740 1 --2- 172.21.15.19:0/3912728635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6aeb735d0 0x55b6aeb8a2b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2c30009620 tx=0x7f2c30005f90 comp rx=0 tx=0).stop 2024-09-19T09:01:40.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.723+0000 7f2c47099740 1 -- 172.21.15.19:0/3912728635 shutdown_connections 2024-09-19T09:01:40.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.723+0000 7f2c47099740 1 --2- 172.21.15.19:0/3912728635 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6aeb7e370 0x55b6aeb95c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.723+0000 7f2c47099740 1 --2- 172.21.15.19:0/3912728635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6aeb74b40 0x55b6aeb95750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.723+0000 7f2c47099740 1 --2- 172.21.15.19:0/3912728635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6aeb735d0 0x55b6aeb8a2b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.723+0000 7f2c47099740 1 -- 172.21.15.19:0/3912728635 >> 172.21.15.19:0/3912728635 conn(0x55b6aeb3c310 msgr2=0x55b6aeb6ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:40.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.723+0000 7f2c47099740 1 -- 172.21.15.19:0/3912728635 shutdown_connections 2024-09-19T09:01:40.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.723+0000 7f2c47099740 1 -- 172.21.15.19:0/3912728635 wait complete. 2024-09-19T09:01:40.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.724+0000 7f2c47099740 1 -- start start 2024-09-19T09:01:40.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.724+0000 7f2c47099740 1 Processor -- start 2024-09-19T09:01:40.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.724+0000 7f2c47099740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6aeb735d0 0x55b6aeb82550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:40.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.724+0000 7f2c47099740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6aeb74b40 0x55b6aeb82a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:40.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.724+0000 7f2c47099740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6aeb7e370 0x55b6aebf7720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:40.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.724+0000 7f2c47099740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2c401b0c40 con 0x55b6aeb74b40 2024-09-19T09:01:40.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.724+0000 7f2c47099740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2c401b0570 con 0x55b6aeb735d0 2024-09-19T09:01:40.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.724+0000 7f2c47099740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2c401ad7b0 con 0x55b6aeb7e370 2024-09-19T09:01:40.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.724+0000 7f2c47099740 10 client.0 _ll_register_callbacks cb 0x7f2c28005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:40.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.724+0000 7f2c3e59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6aeb735d0 0x55b6aeb82550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:40.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.724+0000 7f2c37fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6aeb74b40 0x55b6aeb82a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:40.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.724+0000 7f2c37fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6aeb74b40 0x55b6aeb82a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58818/0 (socket says 172.21.15.19:58818) 2024-09-19T09:01:40.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.724+0000 7f2c37fff640 1 -- 172.21.15.19:0/4007344051 learned_addr learned my addr 172.21.15.19:0/4007344051 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:40.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.724+0000 7f2c3ed9d640 1 --2- 172.21.15.19:0/4007344051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6aeb7e370 0x55b6aebf7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:40.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.725+0000 7f2c37fff640 1 -- 172.21.15.19:0/4007344051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6aeb7e370 msgr2=0x55b6aebf7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:40.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.725+0000 7f2c37fff640 1 --2- 172.21.15.19:0/4007344051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6aeb7e370 0x55b6aebf7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.725+0000 7f2c37fff640 1 -- 172.21.15.19:0/4007344051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6aeb735d0 msgr2=0x55b6aeb82550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:40.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.725+0000 7f2c37fff640 1 --2- 172.21.15.19:0/4007344051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6aeb735d0 0x55b6aeb82550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.725+0000 7f2c37fff640 1 -- 172.21.15.19:0/4007344051 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6aebf7c60 con 0x55b6aeb74b40 2024-09-19T09:01:40.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.725+0000 7f2c3e59c640 1 --2- 172.21.15.19:0/4007344051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6aeb735d0 0x55b6aeb82550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:40.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.725+0000 7f2c37fff640 1 --2- 172.21.15.19:0/4007344051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6aeb74b40 0x55b6aeb82a90 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f2c2809be20 tx=0x7f2c28098070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54cbfa5a64140b3d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:40.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.725+0000 7f2c25ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:01:40.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.725+0000 7f2c25ffb640 1 -- 172.21.15.19:0/4007344051 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c2809b7f0 con 0x55b6aeb74b40 2024-09-19T09:01:40.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.725+0000 7f2c25ffb640 1 -- 172.21.15.19:0/4007344051 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2c2809a190 con 0x55b6aeb74b40 2024-09-19T09:01:40.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.725+0000 7f2c47099740 1 -- 172.21.15.19:0/4007344051 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c300044b0 con 0x55b6aeb74b40 2024-09-19T09:01:40.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.725+0000 7f2c25ffb640 1 -- 172.21.15.19:0/4007344051 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f2c2809c590 con 0x55b6aeb74b40 2024-09-19T09:01:40.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.725+0000 7f2c47099740 10 client.17580 fetch_fsmap learned FSMap version 36 2024-09-19T09:01:40.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.725+0000 7f2c47099740 1 -- 172.21.15.19:0/4007344051 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55b6aebf7c60 con 0x55b6aeb74b40 2024-09-19T09:01:40.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.725+0000 7f2c25ffb640 1 -- 172.21.15.19:0/4007344051 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2c300044b0 con 0x55b6aeb74b40 2024-09-19T09:01:40.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.726+0000 7f2c25ffb640 1 -- 172.21.15.19:0/4007344051 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f2c28098500 con 0x55b6aeb74b40 2024-09-19T09:01:40.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.726+0000 7f2c47099740 10 client.17580 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:01:40.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.726+0000 7f2c47099740 10 client.17580 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-19T09:01:40.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.726+0000 7f2c47099740 20 client.17580 populate_metadata read hostname 'smithi019' 2024-09-19T09:01:40.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.726+0000 7f2c47099740 1 --2- 172.21.15.19:0/4007344051 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55b6aebf9140 0x55b6aebfb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:40.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.726+0000 7f2c47099740 4 client.17580 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:01:40.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.726+0000 7f2c47099740 1 -- 172.21.15.19:0/4007344051 --> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b6aeae6860 con 0x55b6aebf9140 2024-09-19T09:01:40.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.726+0000 7f2c3e59c640 1 --2- 172.21.15.19:0/4007344051 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55b6aebf9140 0x55b6aebfb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:40.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.726+0000 7f2c25ffb640 10 client.17580 ms_handle_connect on v2:172.21.15.155:6836/3381010945 2024-09-19T09:01:40.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.726+0000 7f2c3e59c640 1 --2- 172.21.15.19:0/4007344051 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55b6aebf9140 0x55b6aebfb560 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=af91f0576e2f0113 server_cookie=ed15b29ca2af7c10 in_seq=0 out_seq=0 2024-09-19T09:01:40.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.726+0000 7f2c25ffb640 1 -- 172.21.15.19:0/4007344051 <== mds.3 v2:172.21.15.155:6836/3381010945 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b6aeae6860 con 0x55b6aebf9140 2024-09-19T09:01:40.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.726+0000 7f2c25ffb640 10 client.17580 handle_command_reply: tid=0 2024-09-19T09:01:40.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.726+0000 7f2c47099740 1 client.17580 shutdown 2024-09-19T09:01:40.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.727+0000 7f2c47099740 1 -- 172.21.15.19:0/4007344051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6aeb74b40 msgr2=0x55b6aeb82a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:40.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.727+0000 7f2c47099740 1 --2- 172.21.15.19:0/4007344051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6aeb74b40 0x55b6aeb82a90 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f2c2809be20 tx=0x7f2c28098070 comp rx=0 tx=0).stop 2024-09-19T09:01:40.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.727+0000 7f2c47099740 1 -- 172.21.15.19:0/4007344051 shutdown_connections 2024-09-19T09:01:40.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.727+0000 7f2c47099740 1 --2- 172.21.15.19:0/4007344051 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55b6aebf9140 0x55b6aebfb560 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.727+0000 7f2c25ffb640 0 client.17580 ms_handle_reset on v2:172.21.15.155:6836/3381010945 2024-09-19T09:01:40.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.727+0000 7f2c47099740 1 --2- 172.21.15.19:0/4007344051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b6aeb7e370 0x55b6aebf7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.727+0000 7f2c47099740 1 --2- 172.21.15.19:0/4007344051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b6aeb74b40 0x55b6aeb82a90 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.727+0000 7f2c47099740 1 --2- 172.21.15.19:0/4007344051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b6aeb735d0 0x55b6aeb82550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.727+0000 7f2c47099740 1 -- 172.21.15.19:0/4007344051 >> 172.21.15.19:0/4007344051 conn(0x55b6aeb3c310 msgr2=0x55b6aeb79780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:40.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.727+0000 7f2c47099740 1 -- 172.21.15.19:0/4007344051 shutdown_connections 2024-09-19T09:01:40.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.727+0000 7f2c47099740 1 -- 172.21.15.19:0/4007344051 wait complete. 2024-09-19T09:01:40.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.727+0000 7f2c47099740 20 client.17580 trim_cache size 0 max 16384 2024-09-19T09:01:40.732 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:01:40.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.728+0000 7f2c44cc0640 1 -- 172.21.15.19:0/2728659681 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2c2c0a3240 msgr2=0x7f2c2c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:40.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.728+0000 7f2c44cc0640 1 --2- 172.21.15.19:0/2728659681 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2c2c0a3240 0x7f2c2c0a5700 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f2c38004af0 tx=0x7f2c380095c0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.728+0000 7f2c44cc0640 1 -- 172.21.15.19:0/2728659681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c40101440 msgr2=0x7f2c4019ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:40.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.728+0000 7f2c44cc0640 1 --2- 172.21.15.19:0/2728659681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c40101440 0x7f2c4019ac70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2c2800e9c0 tx=0x7f2c2800ee80 comp rx=0 tx=0).stop 2024-09-19T09:01:40.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.728+0000 7f2c44cc0640 1 -- 172.21.15.19:0/2728659681 shutdown_connections 2024-09-19T09:01:40.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.728+0000 7f2c44cc0640 1 --2- 172.21.15.19:0/2728659681 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2c2c0a3240 0x7f2c2c0a5700 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.728+0000 7f2c44cc0640 1 --2- 172.21.15.19:0/2728659681 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2c4010e500 0x7f2c4019f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.728+0000 7f2c44cc0640 1 --2- 172.21.15.19:0/2728659681 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2c40101440 0x7f2c4019ac70 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.728+0000 7f2c44cc0640 1 --2- 172.21.15.19:0/2728659681 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2c40100b20 0x7f2c4019a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:40.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.728+0000 7f2c44cc0640 1 -- 172.21.15.19:0/2728659681 >> 172.21.15.19:0/2728659681 conn(0x7f2c400fc7d0 msgr2=0x7f2c400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:40.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.728+0000 7f2c44cc0640 1 -- 172.21.15.19:0/2728659681 shutdown_connections 2024-09-19T09:01:40.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:40.728+0000 7f2c44cc0640 1 -- 172.21.15.19:0/2728659681 wait complete. 2024-09-19T09:01:41.448 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:01:41.616 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:41.616+0000 7f2bb9ffb640 1 -- 172.21.15.19:0/1089404200 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56273e496d70 con 0x56273e535780 2024-09-19T09:01:41.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:41.616+0000 7f2bb9ffb640 10 client.17544 handle_command_reply: tid=0 2024-09-19T09:01:41.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:41.616+0000 7f2bdb623740 1 client.17544 shutdown 2024-09-19T09:01:41.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:41.616+0000 7f2bdb623740 1 -- 172.21.15.19:0/1089404200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56273e52fdb0 msgr2=0x56273e53ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:41.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:41.616+0000 7f2bdb623740 1 --2- 172.21.15.19:0/1089404200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56273e52fdb0 0x56273e53ef00 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8010e20 tx=0x7f2bc800f6b0 comp rx=0 tx=0).stop 2024-09-19T09:01:41.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:41.616+0000 7f2bdb623740 1 -- 172.21.15.19:0/1089404200 shutdown_connections 2024-09-19T09:01:41.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:41.616+0000 7f2bdb623740 1 --2- 172.21.15.19:0/1089404200 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56273e535780 0x56273e5b2eb0 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:41.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:41.616+0000 7f2bdb623740 1 --2- 172.21.15.19:0/1089404200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56273e5306f0 0x56273e53ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:41.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:41.616+0000 7f2bb9ffb640 0 client.17544 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:41.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:41.616+0000 7f2bdb623740 1 --2- 172.21.15.19:0/1089404200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56273e52fdb0 0x56273e53ef00 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:41.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:41.616+0000 7f2bdb623740 1 --2- 172.21.15.19:0/1089404200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56273e527010 0x56273e53e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:41.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:41.616+0000 7f2bdb623740 1 -- 172.21.15.19:0/1089404200 >> 172.21.15.19:0/1089404200 conn(0x56273e5352a0 msgr2=0x56273e5261c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:41.617 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:41.616+0000 7f2bdb623740 1 -- 172.21.15.19:0/1089404200 shutdown_connections 2024-09-19T09:01:41.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:41.616+0000 7f2bdb623740 1 -- 172.21.15.19:0/1089404200 wait complete. 2024-09-19T09:01:41.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:41.617+0000 7f2bdb623740 20 client.17544 trim_cache size 0 max 16384 2024-09-19T09:01:41.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T09:01:41.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T09:01:41.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T09:01:41.618 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T09:01:41.619 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:41.617+0000 7f2bd888b640 1 -- 172.21.15.19:0/3957564308 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2bbc0a3370 msgr2=0x7f2bbc0a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:41.619 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:41.617+0000 7f2bd888b640 1 --2- 172.21.15.19:0/3957564308 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2bbc0a3370 0x7f2bbc0a5830 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f2bc80092e0 tx=0x7f2bc8010800 comp rx=0 tx=0).stop 2024-09-19T09:01:41.619 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:41.617+0000 7f2bd888b640 1 -- 172.21.15.19:0/3957564308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2bd41078e0 msgr2=0x7f2bd419f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:41.619 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:41.617+0000 7f2bd888b640 1 --2- 172.21.15.19:0/3957564308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2bd41078e0 0x7f2bd419f3f0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc00eb10 tx=0x7f2bcc00c2d0 comp rx=0 tx=0).stop 2024-09-19T09:01:41.619 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:41.617+0000 7f2bd888b640 1 -- 172.21.15.19:0/3957564308 shutdown_connections 2024-09-19T09:01:41.619 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:41.617+0000 7f2bd888b640 1 --2- 172.21.15.19:0/3957564308 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2bbc0a3370 0x7f2bbc0a5830 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:41.619 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:41.617+0000 7f2bd888b640 1 --2- 172.21.15.19:0/3957564308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2bd4104fb0 0x7f2bd4198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:41.619 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:41.617+0000 7f2bd888b640 1 --2- 172.21.15.19:0/3957564308 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2bd41078e0 0x7f2bd419f3f0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:41.619 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:41.617+0000 7f2bd888b640 1 --2- 172.21.15.19:0/3957564308 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2bd4102680 0x7f2bd4197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:41.620 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:41.617+0000 7f2bd888b640 1 -- 172.21.15.19:0/3957564308 >> 172.21.15.19:0/3957564308 conn(0x7f2bd40fc1e0 msgr2=0x7f2bd4102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:41.620 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:41.617+0000 7f2bd888b640 1 -- 172.21.15.19:0/3957564308 shutdown_connections 2024-09-19T09:01:41.620 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:41.617+0000 7f2bd888b640 1 -- 172.21.15.19:0/3957564308 wait complete. 2024-09-19T09:01:41.718 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:41.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:41 smithi019 ceph-mon[30976]: pgmap v621: 97 pgs: 97 active+clean; 31 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 347 op/s 2024-09-19T09:01:41.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:41 smithi155 ceph-mon[34921]: pgmap v621: 97 pgs: 97 active+clean; 31 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 347 op/s 2024-09-19T09:01:41.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:41 smithi203 ceph-mon[35450]: pgmap v621: 97 pgs: 97 active+clean; 31 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 347 op/s 2024-09-19T09:01:42.099 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:01:42 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-g[71949]: *** Caught signal (Segmentation fault) ** 2024-09-19T09:01:42.099 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:01:42 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-g[71949]: in thread 7fb635212640 thread_name:MR_Finisher 2024-09-19T09:01:42.569 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:01:42 smithi019 podman[182643]: 2024-09-19 09:01:42.09956314 +0000 UTC m=+0.022480540 container died 806be8997683868d9d7ed80fb2bf2404cdf0691b8aa5daef199b632a0f791149 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-g, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True) 2024-09-19T09:01:43.057 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:01:42 smithi019 podman[182643]: 2024-09-19 09:01:42.782230609 +0000 UTC m=+0.705147993 container remove 806be8997683868d9d7ed80fb2bf2404cdf0691b8aa5daef199b632a0f791149 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-g, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-19T09:01:43.057 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:01:42 smithi019 systemd[1]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.g.service: Main process exited, code=exited, status=139/n/a 2024-09-19T09:01:43.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.056+0000 7fb781294640 1 -- 172.21.15.19:0/2496082669 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb77c100e20 msgr2=0x7fb77c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:43.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.056+0000 7fb781294640 1 --2- 172.21.15.19:0/2496082669 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb77c100e20 0x7fb77c101200 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fb76c009900 tx=0x7fb76c02a480 comp rx=0 tx=0).stop 2024-09-19T09:01:43.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.056+0000 7fb781294640 1 -- 172.21.15.19:0/2496082669 shutdown_connections 2024-09-19T09:01:43.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.056+0000 7fb781294640 1 --2- 172.21.15.19:0/2496082669 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb77c102570 0x7fb77c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.056+0000 7fb781294640 1 --2- 172.21.15.19:0/2496082669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb77c102ef0 0x7fb77c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.056+0000 7fb781294640 1 --2- 172.21.15.19:0/2496082669 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb77c100e20 0x7fb77c101200 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.056+0000 7fb781294640 1 -- 172.21.15.19:0/2496082669 >> 172.21.15.19:0/2496082669 conn(0x7fb77c0fc7d0 msgr2=0x7fb77c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:43.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.056+0000 7fb781294640 1 -- 172.21.15.19:0/2496082669 shutdown_connections 2024-09-19T09:01:43.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.056+0000 7fb781294640 1 -- 172.21.15.19:0/2496082669 wait complete. 2024-09-19T09:01:43.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.057+0000 7fb781294640 1 Processor -- start 2024-09-19T09:01:43.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.057+0000 7fb781294640 1 -- start start 2024-09-19T09:01:43.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.058+0000 7fb781294640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb77c100e20 0x7fb77c199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:43.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.058+0000 7fb781294640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb77c102570 0x7fb77c199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:43.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.058+0000 7fb781294640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb77c102ef0 0x7fb77c1a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:43.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.058+0000 7fb781294640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb77c110f80 con 0x7fb77c102ef0 2024-09-19T09:01:43.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.058+0000 7fb781294640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb77c110e00 con 0x7fb77c100e20 2024-09-19T09:01:43.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.058+0000 7fb781294640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb77c111100 con 0x7fb77c102570 2024-09-19T09:01:43.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.058+0000 7fb77b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb77c102ef0 0x7fb77c1a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:43.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.058+0000 7fb77b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb77c102ef0 0x7fb77c1a43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58826/0 (socket says 172.21.15.19:58826) 2024-09-19T09:01:43.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.058+0000 7fb77b7fe640 1 -- 172.21.15.19:0/98668763 learned_addr learned my addr 172.21.15.19:0/98668763 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:43.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.058+0000 7fb77a7fc640 1 --2- 172.21.15.19:0/98668763 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb77c102570 0x7fb77c199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:43.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.058+0000 7fb77affd640 1 --2- 172.21.15.19:0/98668763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb77c100e20 0x7fb77c199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:43.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.058+0000 7fb77b7fe640 1 -- 172.21.15.19:0/98668763 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb77c102570 msgr2=0x7fb77c199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:43.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.058+0000 7fb77b7fe640 1 --2- 172.21.15.19:0/98668763 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb77c102570 0x7fb77c199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.058+0000 7fb77b7fe640 1 -- 172.21.15.19:0/98668763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb77c100e20 msgr2=0x7fb77c199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:43.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.058+0000 7fb77b7fe640 1 --2- 172.21.15.19:0/98668763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb77c100e20 0x7fb77c199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.058+0000 7fb77b7fe640 1 -- 172.21.15.19:0/98668763 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb77c1a4910 con 0x7fb77c102ef0 2024-09-19T09:01:43.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.058+0000 7fb77b7fe640 1 --2- 172.21.15.19:0/98668763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb77c102ef0 0x7fb77c1a43d0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fb77400d950 tx=0x7fb77400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:43.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.058+0000 7fb763fff640 1 -- 172.21.15.19:0/98668763 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb774017030 con 0x7fb77c102ef0 2024-09-19T09:01:43.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.059+0000 7fb763fff640 1 -- 172.21.15.19:0/98668763 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb774004020 con 0x7fb77c102ef0 2024-09-19T09:01:43.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.059+0000 7fb781294640 1 -- 172.21.15.19:0/98668763 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb77c1a4ae0 con 0x7fb77c102ef0 2024-09-19T09:01:43.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.059+0000 7fb763fff640 1 -- 172.21.15.19:0/98668763 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb774003c00 con 0x7fb77c102ef0 2024-09-19T09:01:43.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.059+0000 7fb781294640 1 -- 172.21.15.19:0/98668763 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb77c1a4ff0 con 0x7fb77c102ef0 2024-09-19T09:01:43.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.061+0000 7fb763fff640 1 -- 172.21.15.19:0/98668763 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fb77401a070 con 0x7fb77c102ef0 2024-09-19T09:01:43.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.061+0000 7fb78366d740 1 Processor -- start 2024-09-19T09:01:43.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.062+0000 7fb78366d740 1 -- start start 2024-09-19T09:01:43.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.062+0000 7fb763fff640 1 --2- 172.21.15.19:0/98668763 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb7640a32c0 0x7fb7640a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:43.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.062+0000 7fb78366d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559fdb470b40 0x559fdb46f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:43.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.062+0000 7fb78366d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559fdb46f5d0 0x559fdb46fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:43.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.062+0000 7fb78366d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559fdb47e780 0x559fdb480b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:43.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.062+0000 7fb78366d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559fdb3d52f0 con 0x559fdb47e780 2024-09-19T09:01:43.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.062+0000 7fb78366d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559fdb37ccf0 con 0x559fdb46f5d0 2024-09-19T09:01:43.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.062+0000 7fb78366d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559fdb3d12b0 con 0x559fdb470b40 2024-09-19T09:01:43.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.062+0000 7fb77affd640 1 --2- 172.21.15.19:0/98668763 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb7640a32c0 0x7fb7640a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:43.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.062+0000 7fb77a7fc640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559fdb470b40 0x559fdb46f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:43.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.062+0000 7fb77b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559fdb47e780 0x559fdb480b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:43.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.062+0000 7fb77a7fc640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559fdb470b40 0x559fdb46f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:39554/0 (socket says 172.21.15.19:39554) 2024-09-19T09:01:43.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.062+0000 7fb77a7fc640 1 -- 172.21.15.19:0/4215429726 learned_addr learned my addr 172.21.15.19:0/4215429726 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:43.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.062+0000 7fb77a7fc640 1 --2- 172.21.15.19:0/4215429726 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559fdb46f5d0 0x559fdb46fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:43.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.062+0000 7fb763fff640 1 -- 172.21.15.19:0/98668763 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb7740cf320 con 0x7fb77c102ef0 2024-09-19T09:01:43.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.062+0000 7fb77a7fc640 1 -- 172.21.15.19:0/4215429726 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559fdb46f5d0 msgr2=0x559fdb46fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:43.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.062+0000 7fb77a7fc640 1 --2- 172.21.15.19:0/4215429726 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559fdb46f5d0 0x559fdb46fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.062+0000 7fb77a7fc640 1 -- 172.21.15.19:0/4215429726 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559fdb47e780 msgr2=0x559fdb480b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:43.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.062+0000 7fb77a7fc640 1 --2- 172.21.15.19:0/4215429726 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559fdb47e780 0x559fdb480b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.062+0000 7fb77a7fc640 1 -- 172.21.15.19:0/4215429726 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fdb3613a0 con 0x559fdb470b40 2024-09-19T09:01:43.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.062+0000 7fb77b7fe640 1 --2- 172.21.15.19:0/4215429726 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559fdb47e780 0x559fdb480b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:43.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.063+0000 7fb77a7fc640 1 --2- 172.21.15.19:0/4215429726 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559fdb470b40 0x559fdb46f090 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb770009a30 tx=0x7fb7700099c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=239595ab54d46c3a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:43.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.063+0000 7fb77affd640 1 --2- 172.21.15.19:0/98668763 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb7640a32c0 0x7fb7640a5780 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb76c009230 tx=0x7fb76c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:43.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.063+0000 7fb7617fa640 1 -- 172.21.15.19:0/4215429726 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb770004b20 con 0x559fdb470b40 2024-09-19T09:01:43.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.063+0000 7fb7617fa640 1 -- 172.21.15.19:0/4215429726 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb770003e50 con 0x559fdb470b40 2024-09-19T09:01:43.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.063+0000 7fb7617fa640 1 -- 172.21.15.19:0/4215429726 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb770004290 con 0x559fdb470b40 2024-09-19T09:01:43.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.063+0000 7fb78366d740 1 -- 172.21.15.19:0/4215429726 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559fdb470b40 msgr2=0x559fdb46f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:43.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.063+0000 7fb78366d740 1 --2- 172.21.15.19:0/4215429726 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559fdb470b40 0x559fdb46f090 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb770009a30 tx=0x7fb7700099c0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.064+0000 7fb78366d740 1 -- 172.21.15.19:0/4215429726 shutdown_connections 2024-09-19T09:01:43.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.064+0000 7fb78366d740 1 --2- 172.21.15.19:0/4215429726 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559fdb47e780 0x559fdb480b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.064+0000 7fb78366d740 1 --2- 172.21.15.19:0/4215429726 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559fdb46f5d0 0x559fdb46fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.064+0000 7fb78366d740 1 --2- 172.21.15.19:0/4215429726 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559fdb470b40 0x559fdb46f090 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.064+0000 7fb78366d740 1 -- 172.21.15.19:0/4215429726 >> 172.21.15.19:0/4215429726 conn(0x559fdb438310 msgr2=0x559fdb46bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:43.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.064+0000 7fb78366d740 1 -- 172.21.15.19:0/4215429726 shutdown_connections 2024-09-19T09:01:43.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.064+0000 7fb78366d740 1 -- 172.21.15.19:0/4215429726 wait complete. 2024-09-19T09:01:43.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.064+0000 7fb78366d740 1 -- start start 2024-09-19T09:01:43.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.064+0000 7fb78366d740 1 Processor -- start 2024-09-19T09:01:43.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.064+0000 7fb78366d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559fdb46f5d0 0x559fdb47e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:43.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.064+0000 7fb78366d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559fdb470b40 0x559fdb47b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:43.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.064+0000 7fb78366d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559fdb47e780 0x559fdb47ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:43.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.064+0000 7fb78366d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559fdb481480 con 0x559fdb47e780 2024-09-19T09:01:43.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.064+0000 7fb78366d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559fdb390060 con 0x559fdb470b40 2024-09-19T09:01:43.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.064+0000 7fb78366d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559fdb481600 con 0x559fdb46f5d0 2024-09-19T09:01:43.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.065+0000 7fb78366d740 10 client.0 _ll_register_callbacks cb 0x559fdb0e38c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:43.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.065+0000 7fb77b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559fdb47e780 0x559fdb47ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:43.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.065+0000 7fb77a7fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559fdb470b40 0x559fdb47b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:43.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.065+0000 7fb77affd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559fdb46f5d0 0x559fdb47e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:43.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.065+0000 7fb77a7fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559fdb470b40 0x559fdb47b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:57204/0 (socket says 172.21.15.19:57204) 2024-09-19T09:01:43.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.065+0000 7fb77b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559fdb47e780 0x559fdb47ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58842/0 (socket says 172.21.15.19:58842) 2024-09-19T09:01:43.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.065+0000 7fb77a7fc640 1 -- 172.21.15.19:0/1362898110 learned_addr learned my addr 172.21.15.19:0/1362898110 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:43.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.065+0000 7fb77affd640 1 --2- 172.21.15.19:0/1362898110 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559fdb46f5d0 0x559fdb47e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:39568/0 (socket says 172.21.15.19:39568) 2024-09-19T09:01:43.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.065+0000 7fb77a7fc640 1 -- 172.21.15.19:0/1362898110 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559fdb46f5d0 msgr2=0x559fdb47e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:43.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.065+0000 7fb77a7fc640 1 --2- 172.21.15.19:0/1362898110 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559fdb46f5d0 0x559fdb47e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.065+0000 7fb77a7fc640 1 -- 172.21.15.19:0/1362898110 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559fdb47e780 msgr2=0x559fdb47ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:43.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.065+0000 7fb77a7fc640 1 --2- 172.21.15.19:0/1362898110 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559fdb47e780 0x559fdb47ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.065+0000 7fb77a7fc640 1 -- 172.21.15.19:0/1362898110 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fdb1463c0 con 0x559fdb470b40 2024-09-19T09:01:43.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.065+0000 7fb77b7fe640 1 --2- 172.21.15.19:0/1362898110 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559fdb47e780 0x559fdb47ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:43.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.065+0000 7fb77a7fc640 1 --2- 172.21.15.19:0/1362898110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559fdb470b40 0x559fdb47b420 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb770005f40 tx=0x7fb770010a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c82406ecc9f863a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:43.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.065+0000 7fb75eff5640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T09:01:43.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.065+0000 7fb75eff5640 1 -- 172.21.15.19:0/1362898110 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb770010e90 con 0x559fdb470b40 2024-09-19T09:01:43.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.066+0000 7fb78366d740 1 -- 172.21.15.19:0/1362898110 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb770003e50 con 0x559fdb470b40 2024-09-19T09:01:43.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.066+0000 7fb75eff5640 1 -- 172.21.15.19:0/1362898110 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb770004a40 con 0x559fdb470b40 2024-09-19T09:01:43.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.066+0000 7fb75eff5640 1 -- 172.21.15.19:0/1362898110 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fb770004c40 con 0x559fdb470b40 2024-09-19T09:01:43.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.066+0000 7fb78366d740 10 client.27050 fetch_fsmap learned FSMap version 36 2024-09-19T09:01:43.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.066+0000 7fb78366d740 1 -- 172.21.15.19:0/1362898110 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x559fdb48cf20 con 0x559fdb470b40 2024-09-19T09:01:43.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.066+0000 7fb75eff5640 1 -- 172.21.15.19:0/1362898110 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb770003e50 con 0x559fdb470b40 2024-09-19T09:01:43.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.066+0000 7fb75eff5640 1 -- 172.21.15.19:0/1362898110 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fb770026070 con 0x559fdb470b40 2024-09-19T09:01:43.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.066+0000 7fb78366d740 10 client.27050 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:01:43.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.066+0000 7fb78366d740 10 client.27050 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T09:01:43.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.066+0000 7fb78366d740 20 client.27050 populate_metadata read hostname 'smithi019' 2024-09-19T09:01:43.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.066+0000 7fb78366d740 1 --2- 172.21.15.19:0/1362898110 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x559fdb48e270 0x559fdb490660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:43.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.066+0000 7fb78366d740 4 client.27050 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:01:43.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.066+0000 7fb78366d740 1 -- 172.21.15.19:0/1362898110 --> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559fdb3e2860 con 0x559fdb48e270 2024-09-19T09:01:43.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.067+0000 7fb77affd640 1 --2- 172.21.15.19:0/1362898110 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x559fdb48e270 0x559fdb490660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:43.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.068+0000 7fb75eff5640 10 client.27050 ms_handle_connect on v2:172.21.15.203:6836/3684671619 2024-09-19T09:01:43.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.068+0000 7fb77affd640 1 --2- 172.21.15.19:0/1362898110 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x559fdb48e270 0x559fdb490660 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a14904677c5eef0c server_cookie=9bd7ac96e9ab940c in_seq=0 out_seq=0 2024-09-19T09:01:43.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.069+0000 7fb75eff5640 1 -- 172.21.15.19:0/1362898110 <== mds.2 v2:172.21.15.203:6836/3684671619 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559fdb3e2860 con 0x559fdb48e270 2024-09-19T09:01:43.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.069+0000 7fb75eff5640 10 client.27050 handle_command_reply: tid=0 2024-09-19T09:01:43.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.069+0000 7fb78366d740 1 client.27050 shutdown 2024-09-19T09:01:43.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.069+0000 7fb78366d740 1 -- 172.21.15.19:0/1362898110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559fdb470b40 msgr2=0x559fdb47b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:43.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.069+0000 7fb78366d740 1 --2- 172.21.15.19:0/1362898110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559fdb470b40 0x559fdb47b420 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb770005f40 tx=0x7fb770010a30 comp rx=0 tx=0).stop 2024-09-19T09:01:43.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.069+0000 7fb78366d740 1 -- 172.21.15.19:0/1362898110 shutdown_connections 2024-09-19T09:01:43.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.069+0000 7fb78366d740 1 --2- 172.21.15.19:0/1362898110 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x559fdb48e270 0x559fdb490660 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.069+0000 7fb78366d740 1 --2- 172.21.15.19:0/1362898110 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559fdb47e780 0x559fdb47ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.069+0000 7fb78366d740 1 --2- 172.21.15.19:0/1362898110 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559fdb470b40 0x559fdb47b420 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.069+0000 7fb78366d740 1 --2- 172.21.15.19:0/1362898110 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559fdb46f5d0 0x559fdb47e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.069+0000 7fb75eff5640 0 client.27050 ms_handle_reset on v2:172.21.15.203:6836/3684671619 2024-09-19T09:01:43.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.069+0000 7fb78366d740 1 -- 172.21.15.19:0/1362898110 >> 172.21.15.19:0/1362898110 conn(0x559fdb438310 msgr2=0x559fdb471960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:43.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.069+0000 7fb78366d740 1 -- 172.21.15.19:0/1362898110 shutdown_connections 2024-09-19T09:01:43.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.069+0000 7fb78366d740 1 -- 172.21.15.19:0/1362898110 wait complete. 2024-09-19T09:01:43.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.070+0000 7fb78366d740 20 client.27050 trim_cache size 0 max 16384 2024-09-19T09:01:43.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.084+0000 7fb78366d740 1 Processor -- start 2024-09-19T09:01:43.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.084+0000 7fb78366d740 1 -- start start 2024-09-19T09:01:43.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.084+0000 7fb78366d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559fdb46f5d0 0x559fdb48a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:43.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.084+0000 7fb78366d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559fdb470b40 0x559fdb46abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:43.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.084+0000 7fb78366d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559fdb47e780 0x559fdb495dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:43.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.084+0000 7fb78366d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb77c1ab370 con 0x559fdb47e780 2024-09-19T09:01:43.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.084+0000 7fb78366d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb77c1aceb0 con 0x559fdb470b40 2024-09-19T09:01:43.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.084+0000 7fb78366d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb77c1aba40 con 0x559fdb46f5d0 2024-09-19T09:01:43.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.085+0000 7fb77b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559fdb47e780 0x559fdb495dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:43.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.085+0000 7fb77a7fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559fdb470b40 0x559fdb46abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:43.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.085+0000 7fb77b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559fdb47e780 0x559fdb495dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58858/0 (socket says 172.21.15.19:58858) 2024-09-19T09:01:43.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.085+0000 7fb77b7fe640 1 -- 172.21.15.19:0/507481700 learned_addr learned my addr 172.21.15.19:0/507481700 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:43.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.085+0000 7fb77a7fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559fdb470b40 0x559fdb46abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:57220/0 (socket says 172.21.15.19:57220) 2024-09-19T09:01:43.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.085+0000 7fb77affd640 1 --2- 172.21.15.19:0/507481700 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559fdb46f5d0 0x559fdb48a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:43.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.085+0000 7fb77b7fe640 1 -- 172.21.15.19:0/507481700 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559fdb46f5d0 msgr2=0x559fdb48a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:43.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.085+0000 7fb77b7fe640 1 --2- 172.21.15.19:0/507481700 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559fdb46f5d0 0x559fdb48a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.085+0000 7fb77b7fe640 1 -- 172.21.15.19:0/507481700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559fdb470b40 msgr2=0x559fdb46abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:43.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.085+0000 7fb77b7fe640 1 --2- 172.21.15.19:0/507481700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559fdb470b40 0x559fdb46abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.085+0000 7fb77b7fe640 1 -- 172.21.15.19:0/507481700 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559fdb46c960 con 0x559fdb47e780 2024-09-19T09:01:43.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.085+0000 7fb77a7fc640 1 --2- 172.21.15.19:0/507481700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559fdb470b40 0x559fdb46abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:43.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.085+0000 7fb77b7fe640 1 --2- 172.21.15.19:0/507481700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559fdb47e780 0x559fdb495dd0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fb7740036a0 tx=0x7fb774017740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa71e9392f49aa27 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:43.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.085+0000 7fb760ff9640 1 -- 172.21.15.19:0/507481700 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7740a45c0 con 0x559fdb47e780 2024-09-19T09:01:43.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.085+0000 7fb760ff9640 1 -- 172.21.15.19:0/507481700 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb774016170 con 0x559fdb47e780 2024-09-19T09:01:43.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.085+0000 7fb760ff9640 1 -- 172.21.15.19:0/507481700 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb774097fc0 con 0x559fdb47e780 2024-09-19T09:01:43.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.086+0000 7fb78366d740 1 -- 172.21.15.19:0/507481700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559fdb47e780 msgr2=0x559fdb495dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:43.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.086+0000 7fb78366d740 1 --2- 172.21.15.19:0/507481700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559fdb47e780 0x559fdb495dd0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fb7740036a0 tx=0x7fb774017740 comp rx=0 tx=0).stop 2024-09-19T09:01:43.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.086+0000 7fb78366d740 1 -- 172.21.15.19:0/507481700 shutdown_connections 2024-09-19T09:01:43.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.086+0000 7fb78366d740 1 --2- 172.21.15.19:0/507481700 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559fdb47e780 0x559fdb495dd0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.086+0000 7fb78366d740 1 --2- 172.21.15.19:0/507481700 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559fdb470b40 0x559fdb46abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.086+0000 7fb78366d740 1 --2- 172.21.15.19:0/507481700 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559fdb46f5d0 0x559fdb48a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.087+0000 7fb78366d740 1 -- 172.21.15.19:0/507481700 >> 172.21.15.19:0/507481700 conn(0x559fdb438310 msgr2=0x559fdb46a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:43.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.087+0000 7fb78366d740 1 -- 172.21.15.19:0/507481700 shutdown_connections 2024-09-19T09:01:43.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.087+0000 7fb78366d740 1 -- 172.21.15.19:0/507481700 wait complete. 2024-09-19T09:01:43.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.087+0000 7fb78366d740 1 -- start start 2024-09-19T09:01:43.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.087+0000 7fb78366d740 1 Processor -- start 2024-09-19T09:01:43.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.088+0000 7fb78366d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559fdb46f5d0 0x559fdb482780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:43.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.088+0000 7fb78366d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559fdb470b40 0x559fdb482cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:43.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.088+0000 7fb78366d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559fdb47e780 0x559fdb483200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:43.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.088+0000 7fb78366d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb77c1ac7e0 con 0x559fdb46f5d0 2024-09-19T09:01:43.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.088+0000 7fb78366d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb77c1ac110 con 0x559fdb470b40 2024-09-19T09:01:43.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.088+0000 7fb78366d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb77c1a9350 con 0x559fdb47e780 2024-09-19T09:01:43.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.088+0000 7fb78366d740 10 client.0 _ll_register_callbacks cb 0x7fb7740035f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:43.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.088+0000 7fb77affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559fdb46f5d0 0x559fdb482780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:43.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.088+0000 7fb77affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559fdb46f5d0 0x559fdb482780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58866/0 (socket says 172.21.15.19:58866) 2024-09-19T09:01:43.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.088+0000 7fb77affd640 1 -- 172.21.15.19:0/1746900638 learned_addr learned my addr 172.21.15.19:0/1746900638 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:43.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.088+0000 7fb77a7fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559fdb470b40 0x559fdb482cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:43.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.088+0000 7fb77a7fc640 1 -- 172.21.15.19:0/1746900638 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559fdb47e780 msgr2=0x559fdb483200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:43.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.088+0000 7fb77a7fc640 1 --2- 172.21.15.19:0/1746900638 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559fdb47e780 0x559fdb483200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.088+0000 7fb77a7fc640 1 -- 172.21.15.19:0/1746900638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559fdb46f5d0 msgr2=0x559fdb482780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:43.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.088+0000 7fb77a7fc640 1 --2- 172.21.15.19:0/1746900638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559fdb46f5d0 0x559fdb482780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.088+0000 7fb77a7fc640 1 -- 172.21.15.19:0/1746900638 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559fdb4f7f00 con 0x559fdb470b40 2024-09-19T09:01:43.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.088+0000 7fb77affd640 1 --2- 172.21.15.19:0/1746900638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559fdb46f5d0 0x559fdb482780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:43.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.089+0000 7fb77a7fc640 1 --2- 172.21.15.19:0/1746900638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559fdb470b40 0x559fdb482cc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x559fdb47c9d0 tx=0x7fb770005490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e73ba3f95c29904c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:43.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.089+0000 7fb75eff5640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T09:01:43.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.089+0000 7fb75eff5640 1 -- 172.21.15.19:0/1746900638 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb770037060 con 0x559fdb470b40 2024-09-19T09:01:43.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.089+0000 7fb75eff5640 1 -- 172.21.15.19:0/1746900638 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb770003d80 con 0x559fdb470b40 2024-09-19T09:01:43.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.089+0000 7fb78366d740 1 -- 172.21.15.19:0/1746900638 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb774016170 con 0x559fdb470b40 2024-09-19T09:01:43.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.089+0000 7fb75eff5640 1 -- 172.21.15.19:0/1746900638 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fb770005290 con 0x559fdb470b40 2024-09-19T09:01:43.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.089+0000 7fb78366d740 10 client.27056 fetch_fsmap learned FSMap version 36 2024-09-19T09:01:43.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.089+0000 7fb78366d740 1 -- 172.21.15.19:0/1746900638 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x559fdb4f91c0 con 0x559fdb470b40 2024-09-19T09:01:43.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.089+0000 7fb75eff5640 1 -- 172.21.15.19:0/1746900638 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb774016170 con 0x559fdb470b40 2024-09-19T09:01:43.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.089+0000 7fb75eff5640 1 -- 172.21.15.19:0/1746900638 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fb770026070 con 0x559fdb470b40 2024-09-19T09:01:43.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.089+0000 7fb78366d740 10 client.27056 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:01:43.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.089+0000 7fb78366d740 10 client.27056 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T09:01:43.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.089+0000 7fb78366d740 20 client.27056 populate_metadata read hostname 'smithi019' 2024-09-19T09:01:43.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.089+0000 7fb78366d740 1 --2- 172.21.15.19:0/1746900638 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x559fdb4f9930 0x559fdb4fbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:43.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.089+0000 7fb78366d740 4 client.27056 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:01:43.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.089+0000 7fb78366d740 1 -- 172.21.15.19:0/1746900638 --> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559fdb3dcd70 con 0x559fdb4f9930 2024-09-19T09:01:43.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.090+0000 7fb77affd640 1 --2- 172.21.15.19:0/1746900638 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x559fdb4f9930 0x559fdb4fbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:43.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.090+0000 7fb75eff5640 10 client.27056 ms_handle_connect on v2:172.21.15.203:6836/3684671619 2024-09-19T09:01:43.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.090+0000 7fb77affd640 1 --2- 172.21.15.19:0/1746900638 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x559fdb4f9930 0x559fdb4fbd50 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5a85dfc42c359fc1 server_cookie=49fbff33d67071df in_seq=0 out_seq=0 2024-09-19T09:01:43.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.090+0000 7fb75eff5640 1 -- 172.21.15.19:0/1746900638 <== mds.2 v2:172.21.15.203:6836/3684671619 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559fdb3dcd70 con 0x559fdb4f9930 2024-09-19T09:01:43.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.090+0000 7fb75eff5640 10 client.27056 handle_command_reply: tid=0 2024-09-19T09:01:43.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.090+0000 7fb78366d740 1 client.27056 shutdown 2024-09-19T09:01:43.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.091+0000 7fb78366d740 1 -- 172.21.15.19:0/1746900638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559fdb470b40 msgr2=0x559fdb482cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:43.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.091+0000 7fb78366d740 1 --2- 172.21.15.19:0/1746900638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559fdb470b40 0x559fdb482cc0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x559fdb47c9d0 tx=0x7fb770005490 comp rx=0 tx=0).stop 2024-09-19T09:01:43.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.091+0000 7fb78366d740 1 -- 172.21.15.19:0/1746900638 shutdown_connections 2024-09-19T09:01:43.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.091+0000 7fb78366d740 1 --2- 172.21.15.19:0/1746900638 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x559fdb4f9930 0x559fdb4fbd50 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.091+0000 7fb78366d740 1 --2- 172.21.15.19:0/1746900638 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559fdb47e780 0x559fdb483200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.091+0000 7fb78366d740 1 --2- 172.21.15.19:0/1746900638 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559fdb470b40 0x559fdb482cc0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.091+0000 7fb75eff5640 0 client.27056 ms_handle_reset on v2:172.21.15.203:6836/3684671619 2024-09-19T09:01:43.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.091+0000 7fb78366d740 1 --2- 172.21.15.19:0/1746900638 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559fdb46f5d0 0x559fdb482780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.091+0000 7fb78366d740 1 -- 172.21.15.19:0/1746900638 >> 172.21.15.19:0/1746900638 conn(0x559fdb438310 msgr2=0x559fdb46ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:43.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.091+0000 7fb78366d740 1 -- 172.21.15.19:0/1746900638 shutdown_connections 2024-09-19T09:01:43.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.091+0000 7fb78366d740 1 -- 172.21.15.19:0/1746900638 wait complete. 2024-09-19T09:01:43.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.091+0000 7fb78366d740 20 client.27056 trim_cache size 0 max 16384 2024-09-19T09:01:43.095 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:01:43.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.092+0000 7fb781294640 1 -- 172.21.15.19:0/98668763 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb7640a32c0 msgr2=0x7fb7640a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:43.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.092+0000 7fb781294640 1 --2- 172.21.15.19:0/98668763 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb7640a32c0 0x7fb7640a5780 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb76c009230 tx=0x7fb76c0058d0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.092+0000 7fb781294640 1 -- 172.21.15.19:0/98668763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb77c102ef0 msgr2=0x7fb77c1a43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:43.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.092+0000 7fb781294640 1 --2- 172.21.15.19:0/98668763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb77c102ef0 0x7fb77c1a43d0 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fb77400d950 tx=0x7fb77400de10 comp rx=0 tx=0).stop 2024-09-19T09:01:43.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.092+0000 7fb781294640 1 -- 172.21.15.19:0/98668763 shutdown_connections 2024-09-19T09:01:43.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.092+0000 7fb781294640 1 --2- 172.21.15.19:0/98668763 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb7640a32c0 0x7fb7640a5780 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.092+0000 7fb781294640 1 --2- 172.21.15.19:0/98668763 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb77c102570 0x7fb77c199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.092+0000 7fb781294640 1 --2- 172.21.15.19:0/98668763 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb77c102ef0 0x7fb77c1a43d0 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.092+0000 7fb781294640 1 --2- 172.21.15.19:0/98668763 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb77c100e20 0x7fb77c199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:43.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.092+0000 7fb781294640 1 -- 172.21.15.19:0/98668763 >> 172.21.15.19:0/98668763 conn(0x7fb77c0fc7d0 msgr2=0x7fb77c0fe160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:43.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.093+0000 7fb781294640 1 -- 172.21.15.19:0/98668763 shutdown_connections 2024-09-19T09:01:43.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:43.093+0000 7fb781294640 1 -- 172.21.15.19:0/98668763 wait complete. 2024-09-19T09:01:43.781 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:43 smithi019 ceph-mon[30976]: pgmap v622: 97 pgs: 97 active+clean; 34 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 523 op/s 2024-09-19T09:01:43.828 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:01:43.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:43 smithi155 ceph-mon[34921]: pgmap v622: 97 pgs: 97 active+clean; 34 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 523 op/s 2024-09-19T09:01:43.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:43 smithi203 ceph-mon[35450]: pgmap v622: 97 pgs: 97 active+clean; 34 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 523 op/s 2024-09-19T09:01:44.068 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:01:43 smithi019 systemd[1]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.g.service: Failed with result 'exit-code'. 2024-09-19T09:01:44.069 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:01:43 smithi019 systemd[1]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.g.service: Consumed 17.986s CPU time. 2024-09-19T09:01:44.155 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:44.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.665+0000 7f053c1bd640 1 -- 172.21.15.19:0/3254571412 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0534102db0 msgr2=0x7f0534103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:44.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.665+0000 7f053c1bd640 1 --2- 172.21.15.19:0/3254571412 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0534102db0 0x7f0534103190 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f0530009900 tx=0x7f053002a480 comp rx=0 tx=0).stop 2024-09-19T09:01:44.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.665+0000 7f053c1bd640 1 -- 172.21.15.19:0/3254571412 shutdown_connections 2024-09-19T09:01:44.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.665+0000 7f053c1bd640 1 --2- 172.21.15.19:0/3254571412 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05341036d0 0x7f053410bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.665+0000 7f053c1bd640 1 --2- 172.21.15.19:0/3254571412 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f053410c190 0x7f053410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.665+0000 7f053c1bd640 1 --2- 172.21.15.19:0/3254571412 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0534102db0 0x7f0534103190 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.665+0000 7f053c1bd640 1 -- 172.21.15.19:0/3254571412 >> 172.21.15.19:0/3254571412 conn(0x7f05340fc7d0 msgr2=0x7f05340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:44.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.665+0000 7f053c1bd640 1 -- 172.21.15.19:0/3254571412 shutdown_connections 2024-09-19T09:01:44.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.665+0000 7f053c1bd640 1 -- 172.21.15.19:0/3254571412 wait complete. 2024-09-19T09:01:44.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.665+0000 7f053c1bd640 1 Processor -- start 2024-09-19T09:01:44.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.666+0000 7f053c1bd640 1 -- start start 2024-09-19T09:01:44.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.666+0000 7f053c1bd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0534102db0 0x7f0534100a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:44.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.666+0000 7f053c1bd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05341036d0 0x7f0534100f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:44.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.666+0000 7f053c1bd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f053410c190 0x7f0534101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:44.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.666+0000 7f053c1bd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f0534111fc0 con 0x7f0534102db0 2024-09-19T09:01:44.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.666+0000 7f053c1bd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f0534111e40 con 0x7f05341036d0 2024-09-19T09:01:44.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.666+0000 7f053c1bd640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0534112140 con 0x7f053410c190 2024-09-19T09:01:44.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.666+0000 7f0539f59640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0534102db0 0x7f0534100a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:44.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.666+0000 7f0539758640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05341036d0 0x7f0534100f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:44.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.666+0000 7f0539f59640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0534102db0 0x7f0534100a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58880/0 (socket says 172.21.15.19:58880) 2024-09-19T09:01:44.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.666+0000 7f0539f59640 1 -- 172.21.15.19:0/3874469456 learned_addr learned my addr 172.21.15.19:0/3874469456 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:44.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.666+0000 7f0539758640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05341036d0 0x7f0534100f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:57246/0 (socket says 172.21.15.19:57246) 2024-09-19T09:01:44.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.666+0000 7f053a75a640 1 --2- 172.21.15.19:0/3874469456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f053410c190 0x7f0534101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:44.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.666+0000 7f0539758640 1 -- 172.21.15.19:0/3874469456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f053410c190 msgr2=0x7f0534101490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:44.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.666+0000 7f0539758640 1 --2- 172.21.15.19:0/3874469456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f053410c190 0x7f0534101490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.666+0000 7f0539758640 1 -- 172.21.15.19:0/3874469456 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0534102db0 msgr2=0x7f0534100a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:44.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.666+0000 7f0539758640 1 --2- 172.21.15.19:0/3874469456 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0534102db0 0x7f0534100a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.666+0000 7f0539758640 1 -- 172.21.15.19:0/3874469456 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05341a69a0 con 0x7f05341036d0 2024-09-19T09:01:44.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.666+0000 7f0539f59640 1 --2- 172.21.15.19:0/3874469456 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0534102db0 0x7f0534100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:44.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.666+0000 7f053a75a640 1 --2- 172.21.15.19:0/3874469456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f053410c190 0x7f0534101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:44.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.667+0000 7f0539758640 1 --2- 172.21.15.19:0/3874469456 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05341036d0 0x7f0534100f50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f052400d720 tx=0x7f052400dbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:44.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.667+0000 7f052affd640 1 -- 172.21.15.19:0/3874469456 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0524017070 con 0x7f05341036d0 2024-09-19T09:01:44.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.667+0000 7f053c1bd640 1 -- 172.21.15.19:0/3874469456 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05341a6c90 con 0x7f05341036d0 2024-09-19T09:01:44.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.667+0000 7f052affd640 1 -- 172.21.15.19:0/3874469456 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f052400de30 con 0x7f05341036d0 2024-09-19T09:01:44.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.667+0000 7f052affd640 1 -- 172.21.15.19:0/3874469456 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05240047a0 con 0x7f05341036d0 2024-09-19T09:01:44.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.667+0000 7f053c1bd640 1 -- 172.21.15.19:0/3874469456 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05341a7180 con 0x7f05341036d0 2024-09-19T09:01:44.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.670+0000 7f052affd640 1 -- 172.21.15.19:0/3874469456 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f05240099d0 con 0x7f05341036d0 2024-09-19T09:01:44.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.670+0000 7f053e596740 1 Processor -- start 2024-09-19T09:01:44.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.671+0000 7f053e596740 1 -- start start 2024-09-19T09:01:44.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.671+0000 7f053e596740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff85382b40 0x55ff85381090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:44.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.671+0000 7f053e596740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff853815d0 0x55ff85381a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:44.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.671+0000 7f053e596740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff8538c370 0x55ff8538e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:44.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.671+0000 7f053e596740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ff852e72f0 con 0x55ff853815d0 2024-09-19T09:01:44.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.671+0000 7f053e596740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55ff8528ecf0 con 0x55ff8538c370 2024-09-19T09:01:44.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.671+0000 7f053e596740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ff852e32b0 con 0x55ff85382b40 2024-09-19T09:01:44.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.671+0000 7f0539f59640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff853815d0 0x55ff85381a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:44.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.671+0000 7f0539f59640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff853815d0 0x55ff85381a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58886/0 (socket says 172.21.15.19:58886) 2024-09-19T09:01:44.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.671+0000 7f0539f59640 1 -- 172.21.15.19:0/2156224104 learned_addr learned my addr 172.21.15.19:0/2156224104 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:44.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.671+0000 7f0539758640 1 --2- 172.21.15.19:0/2156224104 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff8538c370 0x55ff8538e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:44.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.671+0000 7f053a75a640 1 --2- 172.21.15.19:0/2156224104 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff85382b40 0x55ff85381090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:44.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.671+0000 7f052affd640 1 --2- 172.21.15.19:0/3874469456 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f05200a3240 0x7f05200a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:44.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.671+0000 7f0539f59640 1 -- 172.21.15.19:0/2156224104 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff85382b40 msgr2=0x55ff85381090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:44.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.671+0000 7f0539f59640 1 --2- 172.21.15.19:0/2156224104 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff85382b40 0x55ff85381090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.671+0000 7f0539f59640 1 -- 172.21.15.19:0/2156224104 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff8538c370 msgr2=0x55ff8538e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:44.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.671+0000 7f0539f59640 1 --2- 172.21.15.19:0/2156224104 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff8538c370 0x55ff8538e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.671+0000 7f0539f59640 1 -- 172.21.15.19:0/2156224104 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff852733a0 con 0x55ff853815d0 2024-09-19T09:01:44.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.671+0000 7f053a75a640 1 --2- 172.21.15.19:0/3874469456 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f05200a3240 0x7f05200a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:44.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.671+0000 7f052affd640 1 -- 172.21.15.19:0/3874469456 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f05240cf510 con 0x7f05341036d0 2024-09-19T09:01:44.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.672+0000 7f0539f59640 1 --2- 172.21.15.19:0/2156224104 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff853815d0 0x55ff85381a10 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f0530004470 tx=0x7f05300044a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=753af4058deb1a95 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:44.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.672+0000 7f053a75a640 1 --2- 172.21.15.19:0/3874469456 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f05200a3240 0x7f05200a5700 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f052c005fd0 tx=0x7f052c004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:44.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.672+0000 7f051ffff640 1 -- 172.21.15.19:0/2156224104 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0530040070 con 0x55ff853815d0 2024-09-19T09:01:44.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.672+0000 7f051ffff640 1 -- 172.21.15.19:0/2156224104 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05300047a0 con 0x55ff853815d0 2024-09-19T09:01:44.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.672+0000 7f051ffff640 1 -- 172.21.15.19:0/2156224104 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0530035040 con 0x55ff853815d0 2024-09-19T09:01:44.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.673+0000 7f053e596740 1 -- 172.21.15.19:0/2156224104 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff853815d0 msgr2=0x55ff85381a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:44.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.673+0000 7f053e596740 1 --2- 172.21.15.19:0/2156224104 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff853815d0 0x55ff85381a10 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f0530004470 tx=0x7f05300044a0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.673+0000 7f053e596740 1 -- 172.21.15.19:0/2156224104 shutdown_connections 2024-09-19T09:01:44.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.673+0000 7f053e596740 1 --2- 172.21.15.19:0/2156224104 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff8538c370 0x55ff8538e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.673+0000 7f053e596740 1 --2- 172.21.15.19:0/2156224104 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff853815d0 0x55ff85381a10 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.673+0000 7f053e596740 1 --2- 172.21.15.19:0/2156224104 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff85382b40 0x55ff85381090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.673+0000 7f053e596740 1 -- 172.21.15.19:0/2156224104 >> 172.21.15.19:0/2156224104 conn(0x55ff8534a310 msgr2=0x55ff8537dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:44.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.673+0000 7f053e596740 1 -- 172.21.15.19:0/2156224104 shutdown_connections 2024-09-19T09:01:44.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.673+0000 7f053e596740 1 -- 172.21.15.19:0/2156224104 wait complete. 2024-09-19T09:01:44.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.673+0000 7f053e596740 1 -- start start 2024-09-19T09:01:44.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.673+0000 7f053e596740 1 Processor -- start 2024-09-19T09:01:44.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.674+0000 7f053e596740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff853815d0 0x55ff8538bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:44.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.674+0000 7f053e596740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff85382b40 0x55ff85389040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:44.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.674+0000 7f053e596740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff8538c370 0x55ff85389650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:44.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.674+0000 7f053e596740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ff8538f010 con 0x55ff853815d0 2024-09-19T09:01:44.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.674+0000 7f053e596740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55ff852a2060 con 0x55ff8538c370 2024-09-19T09:01:44.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.674+0000 7f053e596740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ff8538f190 con 0x55ff85382b40 2024-09-19T09:01:44.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.674+0000 7f053e596740 10 client.0 _ll_register_callbacks cb 0x55ff84ff58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:44.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.674+0000 7f0539f59640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff853815d0 0x55ff8538bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:44.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.674+0000 7f053a75a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff8538c370 0x55ff85389650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:44.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.674+0000 7f053a75a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff8538c370 0x55ff85389650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:57258/0 (socket says 172.21.15.19:57258) 2024-09-19T09:01:44.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.674+0000 7f0539f59640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff853815d0 0x55ff8538bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58890/0 (socket says 172.21.15.19:58890) 2024-09-19T09:01:44.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.674+0000 7f053a75a640 1 -- 172.21.15.19:0/2778811427 learned_addr learned my addr 172.21.15.19:0/2778811427 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:44.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.674+0000 7f0539758640 1 --2- 172.21.15.19:0/2778811427 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff85382b40 0x55ff85389040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:44.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.674+0000 7f053a75a640 1 -- 172.21.15.19:0/2778811427 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff85382b40 msgr2=0x55ff85389040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:44.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.674+0000 7f053a75a640 1 --2- 172.21.15.19:0/2778811427 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff85382b40 0x55ff85389040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.674+0000 7f053a75a640 1 -- 172.21.15.19:0/2778811427 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff853815d0 msgr2=0x55ff8538bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:44.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.674+0000 7f053a75a640 1 --2- 172.21.15.19:0/2778811427 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff853815d0 0x55ff8538bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.674+0000 7f053a75a640 1 -- 172.21.15.19:0/2778811427 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff850583c0 con 0x55ff8538c370 2024-09-19T09:01:44.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.675+0000 7f053a75a640 1 --2- 172.21.15.19:0/2778811427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff8538c370 0x55ff85389650 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f052c009950 tx=0x7f052c004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e050782c04d9be8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:44.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.675+0000 7f051d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T09:01:44.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.675+0000 7f051d7fa640 1 -- 172.21.15.19:0/2778811427 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f052c003b70 con 0x55ff8538c370 2024-09-19T09:01:44.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.675+0000 7f051d7fa640 1 -- 172.21.15.19:0/2778811427 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f052c003d10 con 0x55ff8538c370 2024-09-19T09:01:44.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.675+0000 7f053e596740 1 -- 172.21.15.19:0/2778811427 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05300047a0 con 0x55ff8538c370 2024-09-19T09:01:44.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.675+0000 7f051d7fa640 1 -- 172.21.15.19:0/2778811427 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f052c004050 con 0x55ff8538c370 2024-09-19T09:01:44.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.675+0000 7f053e596740 10 client.27068 fetch_fsmap learned FSMap version 36 2024-09-19T09:01:44.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.675+0000 7f053e596740 1 -- 172.21.15.19:0/2778811427 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55ff8539ab70 con 0x55ff8538c370 2024-09-19T09:01:44.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.675+0000 7f051d7fa640 1 -- 172.21.15.19:0/2778811427 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05300047a0 con 0x55ff8538c370 2024-09-19T09:01:44.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.675+0000 7f051d7fa640 1 -- 172.21.15.19:0/2778811427 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f052c02f800 con 0x55ff8538c370 2024-09-19T09:01:44.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.675+0000 7f053e596740 10 client.27068 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:01:44.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.675+0000 7f053e596740 10 client.27068 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:01:44.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.675+0000 7f053e596740 20 client.27068 populate_metadata read hostname 'smithi019' 2024-09-19T09:01:44.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.675+0000 7f053e596740 1 --2- 172.21.15.19:0/2778811427 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55ff8539bf80 0x55ff8539e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:44.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.675+0000 7f053e596740 4 client.27068 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:01:44.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.675+0000 7f053e596740 1 -- 172.21.15.19:0/2778811427 --> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff852f4860 con 0x55ff8539bf80 2024-09-19T09:01:44.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.676+0000 7f0539f59640 1 --2- 172.21.15.19:0/2778811427 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55ff8539bf80 0x55ff8539e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:44.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.676+0000 7f051d7fa640 10 client.27068 ms_handle_connect on v2:172.21.15.203:6838/2547507299 2024-09-19T09:01:44.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.676+0000 7f0539f59640 1 --2- 172.21.15.19:0/2778811427 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55ff8539bf80 0x55ff8539e420 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3bb8a2c33ea9d792 server_cookie=5c5444894f6f918d in_seq=0 out_seq=0 2024-09-19T09:01:44.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.677+0000 7f051d7fa640 1 -- 172.21.15.19:0/2778811427 <== mds.1 v2:172.21.15.203:6838/2547507299 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ff852f4860 con 0x55ff8539bf80 2024-09-19T09:01:44.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.677+0000 7f051d7fa640 10 client.27068 handle_command_reply: tid=0 2024-09-19T09:01:44.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.677+0000 7f053e596740 1 client.27068 shutdown 2024-09-19T09:01:44.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.677+0000 7f053e596740 1 -- 172.21.15.19:0/2778811427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff8538c370 msgr2=0x55ff85389650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:44.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.677+0000 7f053e596740 1 --2- 172.21.15.19:0/2778811427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff8538c370 0x55ff85389650 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f052c009950 tx=0x7f052c004ab0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.677+0000 7f053e596740 1 -- 172.21.15.19:0/2778811427 shutdown_connections 2024-09-19T09:01:44.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.677+0000 7f053e596740 1 --2- 172.21.15.19:0/2778811427 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55ff8539bf80 0x55ff8539e420 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.677+0000 7f053e596740 1 --2- 172.21.15.19:0/2778811427 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff85382b40 0x55ff85389040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.677+0000 7f051d7fa640 0 client.27068 ms_handle_reset on v2:172.21.15.203:6838/2547507299 2024-09-19T09:01:44.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.677+0000 7f053e596740 1 --2- 172.21.15.19:0/2778811427 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff8538c370 0x55ff85389650 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.677+0000 7f053e596740 1 --2- 172.21.15.19:0/2778811427 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff853815d0 0x55ff8538bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.677+0000 7f053e596740 1 -- 172.21.15.19:0/2778811427 >> 172.21.15.19:0/2778811427 conn(0x55ff8534a310 msgr2=0x55ff85383930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:44.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.677+0000 7f053e596740 1 -- 172.21.15.19:0/2778811427 shutdown_connections 2024-09-19T09:01:44.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.677+0000 7f053e596740 1 -- 172.21.15.19:0/2778811427 wait complete. 2024-09-19T09:01:44.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.677+0000 7f053e596740 20 client.27068 trim_cache size 0 max 16384 2024-09-19T09:01:44.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.691+0000 7f053e596740 1 Processor -- start 2024-09-19T09:01:44.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.691+0000 7f053e596740 1 -- start start 2024-09-19T09:01:44.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.691+0000 7f053e596740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff853815d0 0x55ff85378c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:44.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.691+0000 7f053e596740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff85382b40 0x55ff8537de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:44.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.691+0000 7f053e596740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff8538c370 0x55ff853982e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:44.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.691+0000 7f053e596740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f05341ab2e0 con 0x55ff85382b40 2024-09-19T09:01:44.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.691+0000 7f053e596740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f05341ace20 con 0x55ff853815d0 2024-09-19T09:01:44.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.691+0000 7f053e596740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f05341ab9b0 con 0x55ff8538c370 2024-09-19T09:01:44.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.691+0000 7f0539758640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff85382b40 0x55ff8537de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:44.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.691+0000 7f0539758640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff85382b40 0x55ff8537de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58906/0 (socket says 172.21.15.19:58906) 2024-09-19T09:01:44.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.691+0000 7f0539758640 1 -- 172.21.15.19:0/83967784 learned_addr learned my addr 172.21.15.19:0/83967784 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:44.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.691+0000 7f0539f59640 1 --2- 172.21.15.19:0/83967784 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff853815d0 0x55ff85378c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:44.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.692+0000 7f053a75a640 1 --2- 172.21.15.19:0/83967784 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff8538c370 0x55ff853982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:44.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.692+0000 7f0539758640 1 -- 172.21.15.19:0/83967784 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff8538c370 msgr2=0x55ff853982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:44.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.692+0000 7f0539758640 1 --2- 172.21.15.19:0/83967784 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff8538c370 0x55ff853982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.692+0000 7f0539758640 1 -- 172.21.15.19:0/83967784 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff853815d0 msgr2=0x55ff85378c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:44.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.692+0000 7f0539758640 1 --2- 172.21.15.19:0/83967784 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff853815d0 0x55ff85378c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.692+0000 7f0539758640 1 -- 172.21.15.19:0/83967784 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff85384930 con 0x55ff85382b40 2024-09-19T09:01:44.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.692+0000 7f053a75a640 1 --2- 172.21.15.19:0/83967784 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff8538c370 0x55ff853982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:01:44.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.692+0000 7f0539f59640 1 --2- 172.21.15.19:0/83967784 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff853815d0 0x55ff85378c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:44.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.692+0000 7f0539758640 1 --2- 172.21.15.19:0/83967784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff85382b40 0x55ff8537de10 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f0524097f40 tx=0x7f0524086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46bfd0249af62738 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:44.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.692+0000 7f051f7fe640 1 -- 172.21.15.19:0/83967784 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f052409c1e0 con 0x55ff85382b40 2024-09-19T09:01:44.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.692+0000 7f051f7fe640 1 -- 172.21.15.19:0/83967784 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0524004220 con 0x55ff85382b40 2024-09-19T09:01:44.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.692+0000 7f051f7fe640 1 -- 172.21.15.19:0/83967784 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05240cd0d0 con 0x55ff85382b40 2024-09-19T09:01:44.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.693+0000 7f053e596740 1 -- 172.21.15.19:0/83967784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff85382b40 msgr2=0x55ff8537de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:44.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.693+0000 7f053e596740 1 --2- 172.21.15.19:0/83967784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff85382b40 0x55ff8537de10 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f0524097f40 tx=0x7f0524086040 comp rx=0 tx=0).stop 2024-09-19T09:01:44.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.693+0000 7f053e596740 1 -- 172.21.15.19:0/83967784 shutdown_connections 2024-09-19T09:01:44.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.693+0000 7f053e596740 1 --2- 172.21.15.19:0/83967784 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff8538c370 0x55ff853982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.693+0000 7f053e596740 1 --2- 172.21.15.19:0/83967784 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff85382b40 0x55ff8537de10 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.693+0000 7f053e596740 1 --2- 172.21.15.19:0/83967784 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff853815d0 0x55ff85378c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.693+0000 7f053e596740 1 -- 172.21.15.19:0/83967784 >> 172.21.15.19:0/83967784 conn(0x55ff8534a310 msgr2=0x55ff8537d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:44.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.693+0000 7f053e596740 1 -- 172.21.15.19:0/83967784 shutdown_connections 2024-09-19T09:01:44.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.693+0000 7f053e596740 1 -- 172.21.15.19:0/83967784 wait complete. 2024-09-19T09:01:44.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.693+0000 7f053e596740 1 -- start start 2024-09-19T09:01:44.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.693+0000 7f053e596740 1 Processor -- start 2024-09-19T09:01:44.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.694+0000 7f053e596740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff853815d0 0x55ff85394c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:44.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.694+0000 7f053e596740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff85382b40 0x55ff85385e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:44.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.694+0000 7f053e596740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff8538c370 0x55ff85386440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:44.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.694+0000 7f053e596740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f05341ac750 con 0x55ff853815d0 2024-09-19T09:01:44.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.694+0000 7f053e596740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f05341ac080 con 0x55ff85382b40 2024-09-19T09:01:44.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.694+0000 7f053e596740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f05341a92c0 con 0x55ff8538c370 2024-09-19T09:01:44.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.694+0000 7f053e596740 10 client.0 _ll_register_callbacks cb 0x7f052c00e550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:44.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.694+0000 7f0539f59640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff853815d0 0x55ff85394c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:44.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.694+0000 7f0539f59640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff853815d0 0x55ff85394c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:58916/0 (socket says 172.21.15.19:58916) 2024-09-19T09:01:44.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.694+0000 7f0539f59640 1 -- 172.21.15.19:0/2039445947 learned_addr learned my addr 172.21.15.19:0/2039445947 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:44.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.694+0000 7f0539758640 1 --2- 172.21.15.19:0/2039445947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff85382b40 0x55ff85385e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:44.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.694+0000 7f053a75a640 1 --2- 172.21.15.19:0/2039445947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff8538c370 0x55ff85386440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:44.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.694+0000 7f0539f59640 1 -- 172.21.15.19:0/2039445947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff8538c370 msgr2=0x55ff85386440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:44.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.694+0000 7f0539f59640 1 --2- 172.21.15.19:0/2039445947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff8538c370 0x55ff85386440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.694+0000 7f0539f59640 1 -- 172.21.15.19:0/2039445947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff85382b40 msgr2=0x55ff85385e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:44.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.694+0000 7f0539f59640 1 --2- 172.21.15.19:0/2039445947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff85382b40 0x55ff85385e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.694+0000 7f0539f59640 1 -- 172.21.15.19:0/2039445947 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff85386c40 con 0x55ff853815d0 2024-09-19T09:01:44.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.694+0000 7f0539758640 1 --2- 172.21.15.19:0/2039445947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff85382b40 0x55ff85385e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:44.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.694+0000 7f0539f59640 1 --2- 172.21.15.19:0/2039445947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff853815d0 0x55ff85394c90 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f0530004470 tx=0x7f053002a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=334bb0da8f61a693 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:44.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.694+0000 7f051d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:01:44.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.694+0000 7f051d7fa640 1 -- 172.21.15.19:0/2039445947 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0530040040 con 0x55ff853815d0 2024-09-19T09:01:44.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.695+0000 7f051d7fa640 1 -- 172.21.15.19:0/2039445947 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0530003930 con 0x55ff853815d0 2024-09-19T09:01:44.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.695+0000 7f053e596740 1 -- 172.21.15.19:0/2039445947 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0524004220 con 0x55ff853815d0 2024-09-19T09:01:44.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.695+0000 7f051d7fa640 1 -- 172.21.15.19:0/2039445947 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f0530035040 con 0x55ff853815d0 2024-09-19T09:01:44.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.695+0000 7f053e596740 10 client.17616 fetch_fsmap learned FSMap version 36 2024-09-19T09:01:44.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.695+0000 7f053e596740 1 -- 172.21.15.19:0/2039445947 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55ff85406dc0 con 0x55ff853815d0 2024-09-19T09:01:44.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.695+0000 7f051d7fa640 1 -- 172.21.15.19:0/2039445947 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0524004220 con 0x55ff853815d0 2024-09-19T09:01:44.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.695+0000 7f051d7fa640 1 -- 172.21.15.19:0/2039445947 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f053004e070 con 0x55ff853815d0 2024-09-19T09:01:44.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.695+0000 7f053e596740 10 client.17616 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:01:44.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.695+0000 7f053e596740 10 client.17616 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:01:44.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.695+0000 7f053e596740 20 client.17616 populate_metadata read hostname 'smithi019' 2024-09-19T09:01:44.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.695+0000 7f053e596740 1 --2- 172.21.15.19:0/2039445947 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55ff8539bf80 0x55ff85409110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:44.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.695+0000 7f053e596740 4 client.17616 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:01:44.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.695+0000 7f053e596740 1 -- 172.21.15.19:0/2039445947 --> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ff852eed70 con 0x55ff8539bf80 2024-09-19T09:01:44.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.695+0000 7f0539758640 1 --2- 172.21.15.19:0/2039445947 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55ff8539bf80 0x55ff85409110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:44.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.696+0000 7f0539758640 1 --2- 172.21.15.19:0/2039445947 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55ff8539bf80 0x55ff85409110 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=380268716c27d44 server_cookie=76f804ccce280c89 in_seq=0 out_seq=0 2024-09-19T09:01:44.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.696+0000 7f051d7fa640 10 client.17616 ms_handle_connect on v2:172.21.15.203:6838/2547507299 2024-09-19T09:01:44.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.696+0000 7f051d7fa640 1 -- 172.21.15.19:0/2039445947 <== mds.1 v2:172.21.15.203:6838/2547507299 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ff852eed70 con 0x55ff8539bf80 2024-09-19T09:01:44.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.696+0000 7f051d7fa640 10 client.17616 handle_command_reply: tid=0 2024-09-19T09:01:44.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.696+0000 7f053e596740 1 client.17616 shutdown 2024-09-19T09:01:44.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.696+0000 7f053e596740 1 -- 172.21.15.19:0/2039445947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff853815d0 msgr2=0x55ff85394c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:44.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.696+0000 7f053e596740 1 --2- 172.21.15.19:0/2039445947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff853815d0 0x55ff85394c90 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f0530004470 tx=0x7f053002a480 comp rx=0 tx=0).stop 2024-09-19T09:01:44.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.696+0000 7f053e596740 1 -- 172.21.15.19:0/2039445947 shutdown_connections 2024-09-19T09:01:44.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.696+0000 7f053e596740 1 --2- 172.21.15.19:0/2039445947 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55ff8539bf80 0x55ff85409110 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.696+0000 7f053e596740 1 --2- 172.21.15.19:0/2039445947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff8538c370 0x55ff85386440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.696+0000 7f053e596740 1 --2- 172.21.15.19:0/2039445947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ff85382b40 0x55ff85385e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.696+0000 7f051d7fa640 0 client.17616 ms_handle_reset on v2:172.21.15.203:6838/2547507299 2024-09-19T09:01:44.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.696+0000 7f053e596740 1 --2- 172.21.15.19:0/2039445947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ff853815d0 0x55ff85394c90 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.696+0000 7f053e596740 1 -- 172.21.15.19:0/2039445947 >> 172.21.15.19:0/2039445947 conn(0x55ff8534a310 msgr2=0x55ff8537c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:44.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.696+0000 7f053e596740 1 -- 172.21.15.19:0/2039445947 shutdown_connections 2024-09-19T09:01:44.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.696+0000 7f053e596740 1 -- 172.21.15.19:0/2039445947 wait complete. 2024-09-19T09:01:44.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.697+0000 7f053e596740 20 client.17616 trim_cache size 0 max 16384 2024-09-19T09:01:44.702 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:01:44.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.697+0000 7f053c1bd640 1 -- 172.21.15.19:0/3874469456 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f05200a3240 msgr2=0x7f05200a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:44.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.697+0000 7f053c1bd640 1 --2- 172.21.15.19:0/3874469456 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f05200a3240 0x7f05200a5700 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f052c005fd0 tx=0x7f052c004a40 comp rx=0 tx=0).stop 2024-09-19T09:01:44.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.697+0000 7f053c1bd640 1 -- 172.21.15.19:0/3874469456 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05341036d0 msgr2=0x7f0534100f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:44.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.697+0000 7f053c1bd640 1 --2- 172.21.15.19:0/3874469456 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05341036d0 0x7f0534100f50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f052400d720 tx=0x7f052400dbe0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.697+0000 7f053c1bd640 1 -- 172.21.15.19:0/3874469456 shutdown_connections 2024-09-19T09:01:44.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.697+0000 7f053c1bd640 1 --2- 172.21.15.19:0/3874469456 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f05200a3240 0x7f05200a5700 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.697+0000 7f053c1bd640 1 --2- 172.21.15.19:0/3874469456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f053410c190 0x7f0534101490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.697+0000 7f053c1bd640 1 --2- 172.21.15.19:0/3874469456 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f05341036d0 0x7f0534100f50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.697+0000 7f053c1bd640 1 --2- 172.21.15.19:0/3874469456 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f0534102db0 0x7f0534100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:44.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.697+0000 7f053c1bd640 1 -- 172.21.15.19:0/3874469456 >> 172.21.15.19:0/3874469456 conn(0x7f05340fc7d0 msgr2=0x7f05340fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:44.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.697+0000 7f053c1bd640 1 -- 172.21.15.19:0/3874469456 shutdown_connections 2024-09-19T09:01:44.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:44.698+0000 7f053c1bd640 1 -- 172.21.15.19:0/3874469456 wait complete. 2024-09-19T09:01:45.568 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:45 smithi019 ceph-mon[30976]: pgmap v623: 97 pgs: 97 active+clean; 29 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 520 op/s 2024-09-19T09:01:45.636 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:01:45.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:45 smithi155 ceph-mon[34921]: pgmap v623: 97 pgs: 97 active+clean; 29 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 520 op/s 2024-09-19T09:01:45.949 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:45.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:45 smithi203 ceph-mon[35450]: pgmap v623: 97 pgs: 97 active+clean; 29 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.5 MiB/s wr, 520 op/s 2024-09-19T09:01:46.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.468+0000 7f8a73d9a640 1 -- 172.21.15.19:0/2640303209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a6c101e10 msgr2=0x7f8a6c1021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:46.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.468+0000 7f8a73d9a640 1 --2- 172.21.15.19:0/2640303209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a6c101e10 0x7f8a6c1021f0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f8a68009900 tx=0x7f8a6802a410 comp rx=0 tx=0).stop 2024-09-19T09:01:46.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.468+0000 7f8a73d9a640 1 -- 172.21.15.19:0/2640303209 shutdown_connections 2024-09-19T09:01:46.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.468+0000 7f8a73d9a640 1 --2- 172.21.15.19:0/2640303209 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8a6c1027c0 0x7f8a6c106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.468+0000 7f8a73d9a640 1 --2- 172.21.15.19:0/2640303209 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a6c106f40 0x7f8a6c10eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.468+0000 7f8a73d9a640 1 --2- 172.21.15.19:0/2640303209 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a6c101e10 0x7f8a6c1021f0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.468+0000 7f8a73d9a640 1 -- 172.21.15.19:0/2640303209 >> 172.21.15.19:0/2640303209 conn(0x7f8a6c0fd8d0 msgr2=0x7f8a6c0ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:46.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.468+0000 7f8a73d9a640 1 -- 172.21.15.19:0/2640303209 shutdown_connections 2024-09-19T09:01:46.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.468+0000 7f8a73d9a640 1 -- 172.21.15.19:0/2640303209 wait complete. 2024-09-19T09:01:46.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.469+0000 7f8a73d9a640 1 Processor -- start 2024-09-19T09:01:46.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.469+0000 7f8a73d9a640 1 -- start start 2024-09-19T09:01:46.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.469+0000 7f8a73d9a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a6c101e10 0x7f8a6c1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:46.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.469+0000 7f8a73d9a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a6c1027c0 0x7f8a6c198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:46.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.469+0000 7f8a73d9a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8a6c106f40 0x7f8a6c19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:46.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.469+0000 7f8a71b36640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a6c101e10 0x7f8a6c1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:46.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.469+0000 7f8a73d9a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6c111f60 con 0x7f8a6c101e10 2024-09-19T09:01:46.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.469+0000 7f8a73d9a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6c111de0 con 0x7f8a6c1027c0 2024-09-19T09:01:46.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.469+0000 7f8a73d9a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6c1120e0 con 0x7f8a6c106f40 2024-09-19T09:01:46.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.469+0000 7f8a71b36640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a6c101e10 0x7f8a6c1983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56856/0 (socket says 172.21.15.19:56856) 2024-09-19T09:01:46.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.469+0000 7f8a71b36640 1 -- 172.21.15.19:0/3425119005 learned_addr learned my addr 172.21.15.19:0/3425119005 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:46.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.470+0000 7f8a72337640 1 --2- 172.21.15.19:0/3425119005 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8a6c106f40 0x7f8a6c19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:46.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.470+0000 7f8a71335640 1 --2- 172.21.15.19:0/3425119005 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a6c1027c0 0x7f8a6c198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:46.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.470+0000 7f8a71b36640 1 -- 172.21.15.19:0/3425119005 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8a6c106f40 msgr2=0x7f8a6c19cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:46.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.470+0000 7f8a71b36640 1 --2- 172.21.15.19:0/3425119005 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8a6c106f40 0x7f8a6c19cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.470+0000 7f8a71b36640 1 -- 172.21.15.19:0/3425119005 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a6c1027c0 msgr2=0x7f8a6c198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:46.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.470+0000 7f8a71b36640 1 --2- 172.21.15.19:0/3425119005 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a6c1027c0 0x7f8a6c198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.470+0000 7f8a71b36640 1 -- 172.21.15.19:0/3425119005 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a6c19d380 con 0x7f8a6c101e10 2024-09-19T09:01:46.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.470+0000 7f8a71335640 1 --2- 172.21.15.19:0/3425119005 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a6c1027c0 0x7f8a6c198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:01:46.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.470+0000 7f8a71b36640 1 --2- 172.21.15.19:0/3425119005 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a6c101e10 0x7f8a6c1983d0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f8a68006010 tx=0x7f8a680042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:46.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.470+0000 7f8a62ffd640 1 -- 172.21.15.19:0/3425119005 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6803f030 con 0x7f8a6c101e10 2024-09-19T09:01:46.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.470+0000 7f8a62ffd640 1 -- 172.21.15.19:0/3425119005 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a68003ce0 con 0x7f8a6c101e10 2024-09-19T09:01:46.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.470+0000 7f8a73d9a640 1 -- 172.21.15.19:0/3425119005 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a6c19d610 con 0x7f8a6c101e10 2024-09-19T09:01:46.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.470+0000 7f8a62ffd640 1 -- 172.21.15.19:0/3425119005 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a68035070 con 0x7f8a6c101e10 2024-09-19T09:01:46.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.470+0000 7f8a73d9a640 1 -- 172.21.15.19:0/3425119005 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a6c074420 con 0x7f8a6c101e10 2024-09-19T09:01:46.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.473+0000 7f8a62ffd640 1 -- 172.21.15.19:0/3425119005 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f8a68042030 con 0x7f8a6c101e10 2024-09-19T09:01:46.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.473+0000 7f8a76173740 1 Processor -- start 2024-09-19T09:01:46.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.473+0000 7f8a76173740 1 -- start start 2024-09-19T09:01:46.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.473+0000 7f8a76173740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560302bfdb40 0x560302bfc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:46.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.473+0000 7f8a76173740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560302bfc5d0 0x560302bfca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:46.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.473+0000 7f8a76173740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560302c07370 0x560302c09760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:46.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.473+0000 7f8a76173740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560302b622f0 con 0x560302bfdb40 2024-09-19T09:01:46.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.473+0000 7f8a76173740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x560302b09cf0 con 0x560302bfc5d0 2024-09-19T09:01:46.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.473+0000 7f8a76173740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560302b5e2b0 con 0x560302c07370 2024-09-19T09:01:46.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.474+0000 7f8a72337640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560302bfdb40 0x560302bfc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:46.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.474+0000 7f8a72337640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560302bfdb40 0x560302bfc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56872/0 (socket says 172.21.15.19:56872) 2024-09-19T09:01:46.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.474+0000 7f8a72337640 1 -- 172.21.15.19:0/1769130294 learned_addr learned my addr 172.21.15.19:0/1769130294 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:46.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.474+0000 7f8a71b36640 1 --2- 172.21.15.19:0/1769130294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560302bfc5d0 0x560302bfca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:46.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.474+0000 7f8a71335640 1 --2- 172.21.15.19:0/1769130294 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560302c07370 0x560302c09760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:46.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.474+0000 7f8a72337640 1 -- 172.21.15.19:0/1769130294 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560302c07370 msgr2=0x560302c09760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:46.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.474+0000 7f8a72337640 1 --2- 172.21.15.19:0/1769130294 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560302c07370 0x560302c09760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.474+0000 7f8a72337640 1 -- 172.21.15.19:0/1769130294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560302bfc5d0 msgr2=0x560302bfca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:46.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.474+0000 7f8a72337640 1 --2- 172.21.15.19:0/1769130294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560302bfc5d0 0x560302bfca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.474+0000 7f8a62ffd640 1 --2- 172.21.15.19:0/3425119005 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8a580a3240 0x7f8a580a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:46.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.474+0000 7f8a72337640 1 -- 172.21.15.19:0/1769130294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560302aee3a0 con 0x560302bfdb40 2024-09-19T09:01:46.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.474+0000 7f8a71335640 1 --2- 172.21.15.19:0/3425119005 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8a580a3240 0x7f8a580a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:46.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.474+0000 7f8a62ffd640 1 -- 172.21.15.19:0/3425119005 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f8a680eff40 con 0x7f8a6c101e10 2024-09-19T09:01:46.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.474+0000 7f8a72337640 1 --2- 172.21.15.19:0/1769130294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560302bfdb40 0x560302bfc090 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f8a64009f30 tx=0x7f8a64009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d1c880ec3dfc352 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:46.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.475+0000 7f8a57fff640 1 -- 172.21.15.19:0/1769130294 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a64004b20 con 0x560302bfdb40 2024-09-19T09:01:46.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.475+0000 7f8a57fff640 1 -- 172.21.15.19:0/1769130294 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a64004cc0 con 0x560302bfdb40 2024-09-19T09:01:46.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.475+0000 7f8a57fff640 1 -- 172.21.15.19:0/1769130294 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6400b4e0 con 0x560302bfdb40 2024-09-19T09:01:46.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.476+0000 7f8a76173740 1 -- 172.21.15.19:0/1769130294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560302bfdb40 msgr2=0x560302bfc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:46.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.476+0000 7f8a71335640 1 --2- 172.21.15.19:0/3425119005 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8a580a3240 0x7f8a580a5700 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x560302bfd070 tx=0x7f8a5c0084c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:46.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.476+0000 7f8a76173740 1 --2- 172.21.15.19:0/1769130294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560302bfdb40 0x560302bfc090 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f8a64009f30 tx=0x7f8a64009500 comp rx=0 tx=0).stop 2024-09-19T09:01:46.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.476+0000 7f8a76173740 1 -- 172.21.15.19:0/1769130294 shutdown_connections 2024-09-19T09:01:46.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.476+0000 7f8a76173740 1 --2- 172.21.15.19:0/1769130294 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560302c07370 0x560302c09760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.476+0000 7f8a76173740 1 --2- 172.21.15.19:0/1769130294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560302bfc5d0 0x560302bfca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.476+0000 7f8a76173740 1 --2- 172.21.15.19:0/1769130294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560302bfdb40 0x560302bfc090 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.476+0000 7f8a76173740 1 -- 172.21.15.19:0/1769130294 >> 172.21.15.19:0/1769130294 conn(0x560302bc5310 msgr2=0x560302bf8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:46.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.476+0000 7f8a76173740 1 -- 172.21.15.19:0/1769130294 shutdown_connections 2024-09-19T09:01:46.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.476+0000 7f8a76173740 1 -- 172.21.15.19:0/1769130294 wait complete. 2024-09-19T09:01:46.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.476+0000 7f8a76173740 1 -- start start 2024-09-19T09:01:46.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.477+0000 7f8a76173740 1 Processor -- start 2024-09-19T09:01:46.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.477+0000 7f8a76173740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560302bfc5d0 0x560302c06d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:46.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.477+0000 7f8a76173740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560302bfdb40 0x560302c04040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:46.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.477+0000 7f8a76173740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560302c07370 0x560302c04650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:46.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.477+0000 7f8a76173740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560302c0a070 con 0x560302bfdb40 2024-09-19T09:01:46.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.477+0000 7f8a76173740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x560302b1d060 con 0x560302bfc5d0 2024-09-19T09:01:46.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.477+0000 7f8a76173740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560302c0a1f0 con 0x560302c07370 2024-09-19T09:01:46.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.477+0000 7f8a76173740 10 client.0 _ll_register_callbacks cb 0x5603028708c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:46.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.477+0000 7f8a71b36640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560302bfc5d0 0x560302c06d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:46.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.477+0000 7f8a71335640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560302bfdb40 0x560302c04040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:46.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.477+0000 7f8a71b36640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560302bfc5d0 0x560302c06d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:56252/0 (socket says 172.21.15.19:56252) 2024-09-19T09:01:46.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.477+0000 7f8a71335640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560302bfdb40 0x560302c04040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56878/0 (socket says 172.21.15.19:56878) 2024-09-19T09:01:46.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.477+0000 7f8a71b36640 1 -- 172.21.15.19:0/3154189687 learned_addr learned my addr 172.21.15.19:0/3154189687 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:46.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.478+0000 7f8a72337640 1 --2- 172.21.15.19:0/3154189687 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560302c07370 0x560302c04650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:46.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.478+0000 7f8a71b36640 1 -- 172.21.15.19:0/3154189687 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560302c07370 msgr2=0x560302c04650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:46.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.478+0000 7f8a71b36640 1 --2- 172.21.15.19:0/3154189687 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560302c07370 0x560302c04650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.478+0000 7f8a71b36640 1 -- 172.21.15.19:0/3154189687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560302bfdb40 msgr2=0x560302c04040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:46.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.478+0000 7f8a71b36640 1 --2- 172.21.15.19:0/3154189687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560302bfdb40 0x560302c04040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.478+0000 7f8a71b36640 1 -- 172.21.15.19:0/3154189687 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603028d33c0 con 0x560302bfc5d0 2024-09-19T09:01:46.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.478+0000 7f8a71b36640 1 --2- 172.21.15.19:0/3154189687 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560302bfc5d0 0x560302c06d90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8a680b8a30 tx=0x7f8a680057e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f8276fbde99bad1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:46.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.478+0000 7f8a557fa640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T09:01:46.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.478+0000 7f8a557fa640 1 -- 172.21.15.19:0/3154189687 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a68049070 con 0x560302bfc5d0 2024-09-19T09:01:46.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.478+0000 7f8a557fa640 1 -- 172.21.15.19:0/3154189687 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f8a680bc830 con 0x560302bfc5d0 2024-09-19T09:01:46.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.478+0000 7f8a76173740 1 -- 172.21.15.19:0/3154189687 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a64004cc0 con 0x560302bfc5d0 2024-09-19T09:01:46.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.478+0000 7f8a557fa640 1 -- 172.21.15.19:0/3154189687 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f8a680b8870 con 0x560302bfc5d0 2024-09-19T09:01:46.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.478+0000 7f8a76173740 10 client.27086 fetch_fsmap learned FSMap version 36 2024-09-19T09:01:46.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.478+0000 7f8a76173740 1 -- 172.21.15.19:0/3154189687 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x560302c0a070 con 0x560302bfc5d0 2024-09-19T09:01:46.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.479+0000 7f8a557fa640 1 -- 172.21.15.19:0/3154189687 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a680bccd0 con 0x560302bfc5d0 2024-09-19T09:01:46.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.479+0000 7f8a557fa640 1 -- 172.21.15.19:0/3154189687 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f8a68071bd0 con 0x560302bfc5d0 2024-09-19T09:01:46.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.479+0000 7f8a76173740 10 client.27086 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:01:46.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.479+0000 7f8a76173740 10 client.27086 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:01:46.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.479+0000 7f8a76173740 20 client.27086 populate_metadata read hostname 'smithi019' 2024-09-19T09:01:46.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.479+0000 7f8a76173740 1 --2- 172.21.15.19:0/3154189687 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560302c16f90 0x560302c193d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:46.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.479+0000 7f8a76173740 4 client.27086 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:01:46.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.479+0000 7f8a76173740 1 -- 172.21.15.19:0/3154189687 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8a64004cc0 con 0x560302c16f90 2024-09-19T09:01:46.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.479+0000 7f8a71335640 1 --2- 172.21.15.19:0/3154189687 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560302c16f90 0x560302c193d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:46.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.480+0000 7f8a71335640 1 --2- 172.21.15.19:0/3154189687 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560302c16f90 0x560302c193d0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0979d1221376620 server_cookie=b48b4acf778e94dd in_seq=0 out_seq=0 2024-09-19T09:01:46.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.480+0000 7f8a557fa640 10 client.27086 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:46.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.486+0000 7f8a557fa640 1 -- 172.21.15.19:0/3154189687 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7f8a64004cc0 con 0x560302c16f90 2024-09-19T09:01:46.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.486+0000 7f8a557fa640 10 client.27086 handle_command_reply: tid=0 2024-09-19T09:01:46.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.486+0000 7f8a76173740 1 client.27086 shutdown 2024-09-19T09:01:46.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.486+0000 7f8a76173740 1 -- 172.21.15.19:0/3154189687 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560302bfc5d0 msgr2=0x560302c06d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:46.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.486+0000 7f8a76173740 1 --2- 172.21.15.19:0/3154189687 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560302bfc5d0 0x560302c06d90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8a680b8a30 tx=0x7f8a680057e0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.486+0000 7f8a76173740 1 -- 172.21.15.19:0/3154189687 shutdown_connections 2024-09-19T09:01:46.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.486+0000 7f8a76173740 1 --2- 172.21.15.19:0/3154189687 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560302c16f90 0x560302c193d0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.486+0000 7f8a557fa640 0 client.27086 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:46.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.486+0000 7f8a76173740 1 --2- 172.21.15.19:0/3154189687 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560302c07370 0x560302c04650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.486+0000 7f8a76173740 1 --2- 172.21.15.19:0/3154189687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560302bfdb40 0x560302c04040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.486+0000 7f8a76173740 1 --2- 172.21.15.19:0/3154189687 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560302bfc5d0 0x560302c06d90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.486+0000 7f8a76173740 1 -- 172.21.15.19:0/3154189687 >> 172.21.15.19:0/3154189687 conn(0x560302bc5310 msgr2=0x560302bfe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:46.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.486+0000 7f8a76173740 1 -- 172.21.15.19:0/3154189687 shutdown_connections 2024-09-19T09:01:46.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.486+0000 7f8a76173740 1 -- 172.21.15.19:0/3154189687 wait complete. 2024-09-19T09:01:46.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.486+0000 7f8a76173740 20 client.27086 trim_cache size 0 max 16384 2024-09-19T09:01:46.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.501+0000 7f8a76173740 1 Processor -- start 2024-09-19T09:01:46.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.502+0000 7f8a76173740 1 -- start start 2024-09-19T09:01:46.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.502+0000 7f8a76173740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560302bfc5d0 0x560302bf8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:46.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.502+0000 7f8a76173740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560302bfdb40 0x560302bf7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:46.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.502+0000 7f8a76173740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560302c07370 0x560302bf8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:46.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.502+0000 7f8a76173740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6c1ab220 con 0x560302c07370 2024-09-19T09:01:46.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.502+0000 7f8a76173740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6c1acd60 con 0x560302bfdb40 2024-09-19T09:01:46.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.502+0000 7f8a76173740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6c1ab8f0 con 0x560302bfc5d0 2024-09-19T09:01:46.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.502+0000 7f8a71b36640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560302bfc5d0 0x560302bf8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:46.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.502+0000 7f8a71335640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560302bfdb40 0x560302bf7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:46.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.502+0000 7f8a71b36640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560302bfc5d0 0x560302bf8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:39998/0 (socket says 172.21.15.19:39998) 2024-09-19T09:01:46.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.502+0000 7f8a71b36640 1 -- 172.21.15.19:0/3002670623 learned_addr learned my addr 172.21.15.19:0/3002670623 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:46.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.502+0000 7f8a72337640 1 --2- 172.21.15.19:0/3002670623 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560302c07370 0x560302bf8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:46.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.502+0000 7f8a71b36640 1 -- 172.21.15.19:0/3002670623 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560302bfdb40 msgr2=0x560302bf7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:46.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.502+0000 7f8a71b36640 1 --2- 172.21.15.19:0/3002670623 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560302bfdb40 0x560302bf7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.502+0000 7f8a71b36640 1 -- 172.21.15.19:0/3002670623 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560302c07370 msgr2=0x560302bf8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:46.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.502+0000 7f8a71b36640 1 --2- 172.21.15.19:0/3002670623 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560302c07370 0x560302bf8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.502+0000 7f8a71b36640 1 -- 172.21.15.19:0/3002670623 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560302c049c0 con 0x560302bfc5d0 2024-09-19T09:01:46.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.502+0000 7f8a71335640 1 --2- 172.21.15.19:0/3002670623 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560302bfdb40 0x560302bf7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:46.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.503+0000 7f8a71b36640 1 --2- 172.21.15.19:0/3002670623 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560302bfc5d0 0x560302bf8d70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8a680ba880 tx=0x7f8a680c4f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7acf66c5218c8bcf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:46.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.503+0000 7f8a577fe640 1 -- 172.21.15.19:0/3002670623 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a68049070 con 0x560302bfc5d0 2024-09-19T09:01:46.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.503+0000 7f8a577fe640 1 -- 172.21.15.19:0/3002670623 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a680bc5d0 con 0x560302bfc5d0 2024-09-19T09:01:46.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.503+0000 7f8a577fe640 1 -- 172.21.15.19:0/3002670623 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a680044e0 con 0x560302bfc5d0 2024-09-19T09:01:46.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.503+0000 7f8a76173740 1 -- 172.21.15.19:0/3002670623 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560302bfc5d0 msgr2=0x560302bf8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:46.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.503+0000 7f8a76173740 1 --2- 172.21.15.19:0/3002670623 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560302bfc5d0 0x560302bf8d70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8a680ba880 tx=0x7f8a680c4f80 comp rx=0 tx=0).stop 2024-09-19T09:01:46.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.504+0000 7f8a76173740 1 -- 172.21.15.19:0/3002670623 shutdown_connections 2024-09-19T09:01:46.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.504+0000 7f8a76173740 1 --2- 172.21.15.19:0/3002670623 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560302c07370 0x560302bf8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.504+0000 7f8a76173740 1 --2- 172.21.15.19:0/3002670623 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560302bfdb40 0x560302bf7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.504+0000 7f8a76173740 1 --2- 172.21.15.19:0/3002670623 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560302bfc5d0 0x560302bf8d70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.504+0000 7f8a76173740 1 -- 172.21.15.19:0/3002670623 >> 172.21.15.19:0/3002670623 conn(0x560302bc5310 msgr2=0x560302bf74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:46.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.504+0000 7f8a76173740 1 -- 172.21.15.19:0/3002670623 shutdown_connections 2024-09-19T09:01:46.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.504+0000 7f8a76173740 1 -- 172.21.15.19:0/3002670623 wait complete. 2024-09-19T09:01:46.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.504+0000 7f8a76173740 1 -- start start 2024-09-19T09:01:46.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.504+0000 7f8a76173740 1 Processor -- start 2024-09-19T09:01:46.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.505+0000 7f8a76173740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560302bfc5d0 0x560302c0faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:46.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.505+0000 7f8a76173740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560302bfdb40 0x560302c00c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:46.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.505+0000 7f8a76173740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560302c07370 0x560302c01190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:46.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.505+0000 7f8a76173740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6c1ac690 con 0x560302bfdb40 2024-09-19T09:01:46.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.505+0000 7f8a76173740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6c1abfc0 con 0x560302bfc5d0 2024-09-19T09:01:46.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.505+0000 7f8a76173740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6c1a9200 con 0x560302c07370 2024-09-19T09:01:46.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.505+0000 7f8a76173740 10 client.0 _ll_register_callbacks cb 0x7f8a68005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:46.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.505+0000 7f8a71b36640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560302bfc5d0 0x560302c0faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:46.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.505+0000 7f8a71b36640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560302bfc5d0 0x560302c0faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:56270/0 (socket says 172.21.15.19:56270) 2024-09-19T09:01:46.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.505+0000 7f8a71335640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560302bfdb40 0x560302c00c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:46.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.505+0000 7f8a71b36640 1 -- 172.21.15.19:0/4255073343 learned_addr learned my addr 172.21.15.19:0/4255073343 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:46.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.505+0000 7f8a72337640 1 --2- 172.21.15.19:0/4255073343 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560302c07370 0x560302c01190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:46.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.505+0000 7f8a71b36640 1 -- 172.21.15.19:0/4255073343 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560302c07370 msgr2=0x560302c01190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:46.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.505+0000 7f8a71b36640 1 --2- 172.21.15.19:0/4255073343 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560302c07370 0x560302c01190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.505+0000 7f8a71b36640 1 -- 172.21.15.19:0/4255073343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560302bfdb40 msgr2=0x560302c00c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:46.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.505+0000 7f8a71b36640 1 --2- 172.21.15.19:0/4255073343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560302bfdb40 0x560302c00c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.505+0000 7f8a71b36640 1 -- 172.21.15.19:0/4255073343 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560302c01880 con 0x560302bfc5d0 2024-09-19T09:01:46.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.506+0000 7f8a72337640 1 --2- 172.21.15.19:0/4255073343 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560302c07370 0x560302c01190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:01:46.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.506+0000 7f8a71335640 1 --2- 172.21.15.19:0/4255073343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560302bfdb40 0x560302c00c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:46.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.506+0000 7f8a71b36640 1 --2- 172.21.15.19:0/4255073343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560302bfc5d0 0x560302c0faa0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8a680096c0 tx=0x7f8a6802a410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3228e5676d73409 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:46.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.506+0000 7f8a557fa640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T09:01:46.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.506+0000 7f8a557fa640 1 -- 172.21.15.19:0/4255073343 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a68075070 con 0x560302bfc5d0 2024-09-19T09:01:46.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.506+0000 7f8a557fa640 1 -- 172.21.15.19:0/4255073343 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f8a680bc830 con 0x560302bfc5d0 2024-09-19T09:01:46.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.506+0000 7f8a76173740 1 -- 172.21.15.19:0/4255073343 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a680bc5d0 con 0x560302bfc5d0 2024-09-19T09:01:46.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.506+0000 7f8a557fa640 1 -- 172.21.15.19:0/4255073343 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f8a68049070 con 0x560302bfc5d0 2024-09-19T09:01:46.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.506+0000 7f8a76173740 10 client.27092 fetch_fsmap learned FSMap version 36 2024-09-19T09:01:46.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.506+0000 7f8a76173740 1 -- 172.21.15.19:0/4255073343 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x560302c01880 con 0x560302bfc5d0 2024-09-19T09:01:46.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.506+0000 7f8a557fa640 1 -- 172.21.15.19:0/4255073343 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8a680c0980 con 0x560302bfc5d0 2024-09-19T09:01:46.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.507+0000 7f8a557fa640 1 -- 172.21.15.19:0/4255073343 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f8a680bba20 con 0x560302bfc5d0 2024-09-19T09:01:46.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.507+0000 7f8a76173740 10 client.27092 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:01:46.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.507+0000 7f8a76173740 10 client.27092 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:01:46.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.507+0000 7f8a76173740 20 client.27092 populate_metadata read hostname 'smithi019' 2024-09-19T09:01:46.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.507+0000 7f8a76173740 1 --2- 172.21.15.19:0/4255073343 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560302c16f90 0x560302c83ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:46.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.507+0000 7f8a76173740 4 client.27092 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:01:46.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.507+0000 7f8a76173740 1 -- 172.21.15.19:0/4255073343 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f8a680bc5d0 con 0x560302c16f90 2024-09-19T09:01:46.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.507+0000 7f8a71335640 1 --2- 172.21.15.19:0/4255073343 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560302c16f90 0x560302c83ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:46.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.507+0000 7f8a557fa640 10 client.27092 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:46.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.507+0000 7f8a71335640 1 --2- 172.21.15.19:0/4255073343 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560302c16f90 0x560302c83ed0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7342e3da0bf0297d server_cookie=b5f49253bf96101d in_seq=0 out_seq=0 2024-09-19T09:01:46.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.512+0000 7f8a557fa640 1 -- 172.21.15.19:0/4255073343 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f8a680bc5d0 con 0x560302c16f90 2024-09-19T09:01:46.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.512+0000 7f8a557fa640 10 client.27092 handle_command_reply: tid=0 2024-09-19T09:01:46.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.512+0000 7f8a76173740 1 client.27092 shutdown 2024-09-19T09:01:46.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.512+0000 7f8a76173740 1 -- 172.21.15.19:0/4255073343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560302bfc5d0 msgr2=0x560302c0faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:46.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.512+0000 7f8a76173740 1 --2- 172.21.15.19:0/4255073343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560302bfc5d0 0x560302c0faa0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8a680096c0 tx=0x7f8a6802a410 comp rx=0 tx=0).stop 2024-09-19T09:01:46.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.512+0000 7f8a76173740 1 -- 172.21.15.19:0/4255073343 shutdown_connections 2024-09-19T09:01:46.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.512+0000 7f8a76173740 1 --2- 172.21.15.19:0/4255073343 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560302c16f90 0x560302c83ed0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.512+0000 7f8a76173740 1 --2- 172.21.15.19:0/4255073343 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560302c07370 0x560302c01190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.512+0000 7f8a557fa640 0 client.27092 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:46.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.512+0000 7f8a76173740 1 --2- 172.21.15.19:0/4255073343 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560302bfdb40 0x560302c00c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.512+0000 7f8a76173740 1 --2- 172.21.15.19:0/4255073343 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560302bfc5d0 0x560302c0faa0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.512+0000 7f8a76173740 1 -- 172.21.15.19:0/4255073343 >> 172.21.15.19:0/4255073343 conn(0x560302bc5310 msgr2=0x560302bf7d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:46.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.512+0000 7f8a76173740 1 -- 172.21.15.19:0/4255073343 shutdown_connections 2024-09-19T09:01:46.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.512+0000 7f8a76173740 1 -- 172.21.15.19:0/4255073343 wait complete. 2024-09-19T09:01:46.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.513+0000 7f8a76173740 20 client.27092 trim_cache size 0 max 16384 2024-09-19T09:01:46.513 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:01:46.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.513+0000 7f8a73d9a640 1 -- 172.21.15.19:0/3425119005 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8a580a3240 msgr2=0x7f8a580a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:46.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.513+0000 7f8a73d9a640 1 --2- 172.21.15.19:0/3425119005 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8a580a3240 0x7f8a580a5700 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x560302bfd070 tx=0x7f8a5c0084c0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.513+0000 7f8a73d9a640 1 -- 172.21.15.19:0/3425119005 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a6c101e10 msgr2=0x7f8a6c1983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:46.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.513+0000 7f8a73d9a640 1 --2- 172.21.15.19:0/3425119005 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a6c101e10 0x7f8a6c1983d0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f8a68006010 tx=0x7f8a680042f0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.513+0000 7f8a73d9a640 1 -- 172.21.15.19:0/3425119005 shutdown_connections 2024-09-19T09:01:46.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.513+0000 7f8a73d9a640 1 --2- 172.21.15.19:0/3425119005 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8a580a3240 0x7f8a580a5700 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.513+0000 7f8a73d9a640 1 --2- 172.21.15.19:0/3425119005 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8a6c106f40 0x7f8a6c19cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.513+0000 7f8a73d9a640 1 --2- 172.21.15.19:0/3425119005 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8a6c1027c0 0x7f8a6c198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.513+0000 7f8a73d9a640 1 --2- 172.21.15.19:0/3425119005 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8a6c101e10 0x7f8a6c1983d0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:46.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.513+0000 7f8a73d9a640 1 -- 172.21.15.19:0/3425119005 >> 172.21.15.19:0/3425119005 conn(0x7f8a6c0fd8d0 msgr2=0x7f8a6c0fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:46.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.514+0000 7f8a73d9a640 1 -- 172.21.15.19:0/3425119005 shutdown_connections 2024-09-19T09:01:46.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:46.514+0000 7f8a73d9a640 1 -- 172.21.15.19:0/3425119005 wait complete. 2024-09-19T09:01:46.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:46 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:01:46.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:46 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:01:46.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:46 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:01:47.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:47 smithi019 ceph-mon[30976]: pgmap v624: 97 pgs: 97 active+clean; 32 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 525 op/s 2024-09-19T09:01:47.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:47 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:47.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:47 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:01:47.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:47 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:01:47.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:47 smithi155 ceph-mon[34921]: pgmap v624: 97 pgs: 97 active+clean; 32 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 525 op/s 2024-09-19T09:01:47.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:47 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:47.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:47 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:01:47.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:47 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:01:47.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:47 smithi203 ceph-mon[35450]: pgmap v624: 97 pgs: 97 active+clean; 32 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.7 MiB/s wr, 525 op/s 2024-09-19T09:01:48.030 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:47 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:01:48.030 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:47 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:01:48.030 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:47 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:01:48.341 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:01:48.342 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:01:48.618 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:49.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.176+0000 7fb63d7ca640 1 -- 172.21.15.19:0/2952549826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb638100e20 msgr2=0x7fb638101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:49.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.176+0000 7fb63d7ca640 1 --2- 172.21.15.19:0/2952549826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb638100e20 0x7fb638101200 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fb620009900 tx=0x7fb62002a480 comp rx=0 tx=0).stop 2024-09-19T09:01:49.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.176+0000 7fb63d7ca640 1 -- 172.21.15.19:0/2952549826 shutdown_connections 2024-09-19T09:01:49.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.176+0000 7fb63d7ca640 1 --2- 172.21.15.19:0/2952549826 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb638102570 0x7fb6381029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.176+0000 7fb63d7ca640 1 --2- 172.21.15.19:0/2952549826 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb638102ef0 0x7fb63810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.176+0000 7fb63d7ca640 1 --2- 172.21.15.19:0/2952549826 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb638100e20 0x7fb638101200 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.176+0000 7fb63d7ca640 1 -- 172.21.15.19:0/2952549826 >> 172.21.15.19:0/2952549826 conn(0x7fb6380fc7d0 msgr2=0x7fb6380febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:49.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.176+0000 7fb63d7ca640 1 -- 172.21.15.19:0/2952549826 shutdown_connections 2024-09-19T09:01:49.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.176+0000 7fb63d7ca640 1 -- 172.21.15.19:0/2952549826 wait complete. 2024-09-19T09:01:49.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.177+0000 7fb63d7ca640 1 Processor -- start 2024-09-19T09:01:49.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.177+0000 7fb63d7ca640 1 -- start start 2024-09-19T09:01:49.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.177+0000 7fb63d7ca640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb638100e20 0x7fb6381984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:49.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.177+0000 7fb63d7ca640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb638102570 0x7fb638198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:49.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.177+0000 7fb63d7ca640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb638102ef0 0x7fb63819cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:49.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.177+0000 7fb63d7ca640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb638110f50 con 0x7fb638102570 2024-09-19T09:01:49.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.177+0000 7fb63d7ca640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb638110dd0 con 0x7fb638102ef0 2024-09-19T09:01:49.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.177+0000 7fb63d7ca640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb6381110d0 con 0x7fb638100e20 2024-09-19T09:01:49.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.177+0000 7fb6367fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb638102570 0x7fb638198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:49.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.177+0000 7fb6367fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb638102570 0x7fb638198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56912/0 (socket says 172.21.15.19:56912) 2024-09-19T09:01:49.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.177+0000 7fb636ffd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb638100e20 0x7fb6381984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:49.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.177+0000 7fb6367fc640 1 -- 172.21.15.19:0/494220439 learned_addr learned my addr 172.21.15.19:0/494220439 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:49.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.177+0000 7fb6377fe640 1 --2- 172.21.15.19:0/494220439 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb638102ef0 0x7fb63819cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:49.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.178+0000 7fb6367fc640 1 -- 172.21.15.19:0/494220439 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb638100e20 msgr2=0x7fb6381984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:49.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.178+0000 7fb6367fc640 1 --2- 172.21.15.19:0/494220439 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb638100e20 0x7fb6381984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.178+0000 7fb6367fc640 1 -- 172.21.15.19:0/494220439 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb638102ef0 msgr2=0x7fb63819cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:49.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.178+0000 7fb6367fc640 1 --2- 172.21.15.19:0/494220439 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb638102ef0 0x7fb63819cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.178+0000 7fb6367fc640 1 -- 172.21.15.19:0/494220439 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb63819d490 con 0x7fb638102570 2024-09-19T09:01:49.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.178+0000 7fb6367fc640 1 --2- 172.21.15.19:0/494220439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb638102570 0x7fb638198a00 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fb62800d950 tx=0x7fb62800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:49.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.178+0000 7fb62ffff640 1 -- 172.21.15.19:0/494220439 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb628017030 con 0x7fb638102570 2024-09-19T09:01:49.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.178+0000 7fb63d7ca640 1 -- 172.21.15.19:0/494220439 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb63819d780 con 0x7fb638102570 2024-09-19T09:01:49.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.178+0000 7fb62ffff640 1 -- 172.21.15.19:0/494220439 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb628004020 con 0x7fb638102570 2024-09-19T09:01:49.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.178+0000 7fb62ffff640 1 -- 172.21.15.19:0/494220439 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6280047a0 con 0x7fb638102570 2024-09-19T09:01:49.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.178+0000 7fb63d7ca640 1 -- 172.21.15.19:0/494220439 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6380fcbb0 con 0x7fb638102570 2024-09-19T09:01:49.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.180+0000 7fb62ffff640 1 -- 172.21.15.19:0/494220439 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fb6280041d0 con 0x7fb638102570 2024-09-19T09:01:49.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.181+0000 7fb62ffff640 1 --2- 172.21.15.19:0/494220439 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb6240a3240 0x7fb6240a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:49.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.181+0000 7fb63fba3740 1 Processor -- start 2024-09-19T09:01:49.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.181+0000 7fb636ffd640 1 --2- 172.21.15.19:0/494220439 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb6240a3240 0x7fb6240a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:49.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.181+0000 7fb62ffff640 1 -- 172.21.15.19:0/494220439 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb6280cf2e0 con 0x7fb638102570 2024-09-19T09:01:49.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.181+0000 7fb63fba3740 1 -- start start 2024-09-19T09:01:49.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.182+0000 7fb63fba3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e766dc3b60 0x55e766dc3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:49.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.182+0000 7fb63fba3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e766dc4480 0x55e766dce800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:49.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.182+0000 7fb63fba3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e766dced40 0x55e766dd1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:49.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.182+0000 7fb63fba3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e766d29280 con 0x55e766dc3b60 2024-09-19T09:01:49.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.182+0000 7fb63fba3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55e766cd0b10 con 0x55e766dced40 2024-09-19T09:01:49.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.182+0000 7fb63fba3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e766d25240 con 0x55e766dc4480 2024-09-19T09:01:49.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.182+0000 7fb636ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e766dc3b60 0x55e766dc3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:49.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.182+0000 7fb636ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e766dc3b60 0x55e766dc3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56922/0 (socket says 172.21.15.19:56922) 2024-09-19T09:01:49.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.182+0000 7fb636ffd640 1 -- 172.21.15.19:0/1087423698 learned_addr learned my addr 172.21.15.19:0/1087423698 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:49.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.182+0000 7fb6367fc640 1 --2- 172.21.15.19:0/1087423698 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e766dc4480 0x55e766dce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:49.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.182+0000 7fb6377fe640 1 --2- 172.21.15.19:0/1087423698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e766dced40 0x55e766dd1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:49.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.182+0000 7fb636ffd640 1 --2- 172.21.15.19:0/494220439 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb6240a3240 0x7fb6240a5700 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb620009230 tx=0x7fb6200058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:49.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.182+0000 7fb6367fc640 1 -- 172.21.15.19:0/1087423698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e766dced40 msgr2=0x55e766dd1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:49.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.182+0000 7fb6367fc640 1 --2- 172.21.15.19:0/1087423698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e766dced40 0x55e766dd1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.182+0000 7fb6367fc640 1 -- 172.21.15.19:0/1087423698 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e766dc3b60 msgr2=0x55e766dc3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:49.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.182+0000 7fb6367fc640 1 --2- 172.21.15.19:0/1087423698 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e766dc3b60 0x55e766dc3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.182+0000 7fb6367fc640 1 -- 172.21.15.19:0/1087423698 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e766cdd1f0 con 0x55e766dc4480 2024-09-19T09:01:49.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.182+0000 7fb636ffd640 1 --2- 172.21.15.19:0/1087423698 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e766dc3b60 0x55e766dc3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:49.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.182+0000 7fb6367fc640 1 --2- 172.21.15.19:0/1087423698 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e766dc4480 0x55e766dce800 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb628000c00 tx=0x7fb62809b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b26d35eb7641a8f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:49.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.183+0000 7fb62d7fa640 1 -- 172.21.15.19:0/1087423698 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62809fcc0 con 0x55e766dc4480 2024-09-19T09:01:49.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.183+0000 7fb62d7fa640 1 -- 172.21.15.19:0/1087423698 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6280a4580 con 0x55e766dc4480 2024-09-19T09:01:49.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.183+0000 7fb62d7fa640 1 -- 172.21.15.19:0/1087423698 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62809afc0 con 0x55e766dc4480 2024-09-19T09:01:49.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.183+0000 7fb63fba3740 1 -- 172.21.15.19:0/1087423698 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e766dc4480 msgr2=0x55e766dce800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:49.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.183+0000 7fb63fba3740 1 --2- 172.21.15.19:0/1087423698 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e766dc4480 0x55e766dce800 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb628000c00 tx=0x7fb62809b330 comp rx=0 tx=0).stop 2024-09-19T09:01:49.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.183+0000 7fb63fba3740 1 -- 172.21.15.19:0/1087423698 shutdown_connections 2024-09-19T09:01:49.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.183+0000 7fb63fba3740 1 --2- 172.21.15.19:0/1087423698 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e766dc4480 0x55e766dce800 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.183+0000 7fb63fba3740 1 --2- 172.21.15.19:0/1087423698 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e766dced40 0x55e766dd1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.183+0000 7fb63fba3740 1 --2- 172.21.15.19:0/1087423698 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e766dc3b60 0x55e766dc3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.183+0000 7fb63fba3740 1 -- 172.21.15.19:0/1087423698 >> 172.21.15.19:0/1087423698 conn(0x55e766dc00f0 msgr2=0x55e766dc04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:49.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.184+0000 7fb63fba3740 1 -- 172.21.15.19:0/1087423698 shutdown_connections 2024-09-19T09:01:49.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.184+0000 7fb63fba3740 1 -- 172.21.15.19:0/1087423698 wait complete. 2024-09-19T09:01:49.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.184+0000 7fb63fba3740 1 -- start start 2024-09-19T09:01:49.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.184+0000 7fb63fba3740 1 Processor -- start 2024-09-19T09:01:49.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.184+0000 7fb63fba3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e766dc3b60 0x55e766dcbc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:49.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.184+0000 7fb63fba3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e766dc4480 0x55e766dcc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:49.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.184+0000 7fb63fba3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e766dced40 0x55e766dcc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:49.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.184+0000 7fb63fba3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e766dd1910 con 0x55e766dc3b60 2024-09-19T09:01:49.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.184+0000 7fb63fba3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55e766ce3f10 con 0x55e766dced40 2024-09-19T09:01:49.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.184+0000 7fb63fba3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e766dd1a90 con 0x55e766dc4480 2024-09-19T09:01:49.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.184+0000 7fb63fba3740 10 client.0 _ll_register_callbacks cb 0x55e766caca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:49.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.184+0000 7fb636ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e766dc3b60 0x55e766dcbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:49.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.184+0000 7fb636ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e766dc3b60 0x55e766dcbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56936/0 (socket says 172.21.15.19:56936) 2024-09-19T09:01:49.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.184+0000 7fb636ffd640 1 -- 172.21.15.19:0/287228707 learned_addr learned my addr 172.21.15.19:0/287228707 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:49.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.184+0000 7fb6367fc640 1 --2- 172.21.15.19:0/287228707 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e766dc4480 0x55e766dcc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:49.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.184+0000 7fb6377fe640 1 --2- 172.21.15.19:0/287228707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e766dced40 0x55e766dcc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:49.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.185+0000 7fb636ffd640 1 -- 172.21.15.19:0/287228707 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e766dc4480 msgr2=0x55e766dcc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:49.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.185+0000 7fb636ffd640 1 --2- 172.21.15.19:0/287228707 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e766dc4480 0x55e766dcc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.185+0000 7fb636ffd640 1 -- 172.21.15.19:0/287228707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e766dced40 msgr2=0x55e766dcc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:49.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.185+0000 7fb636ffd640 1 --2- 172.21.15.19:0/287228707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e766dced40 0x55e766dcc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.185+0000 7fb636ffd640 1 -- 172.21.15.19:0/287228707 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e766a9a6a0 con 0x55e766dc3b60 2024-09-19T09:01:49.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.185+0000 7fb636ffd640 1 --2- 172.21.15.19:0/287228707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e766dc3b60 0x55e766dcbc80 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fb6200314e0 tx=0x7fb62002a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=794bb5aacddac918 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:49.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.185+0000 7fb61e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:01:49.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.185+0000 7fb61e7fc640 1 -- 172.21.15.19:0/287228707 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb620035050 con 0x55e766dc3b60 2024-09-19T09:01:49.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.185+0000 7fb61e7fc640 1 -- 172.21.15.19:0/287228707 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb620005220 con 0x55e766dc3b60 2024-09-19T09:01:49.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.185+0000 7fb63fba3740 1 -- 172.21.15.19:0/287228707 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb6280a4580 con 0x55e766dc3b60 2024-09-19T09:01:49.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.185+0000 7fb61e7fc640 1 -- 172.21.15.19:0/287228707 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fb620003e40 con 0x55e766dc3b60 2024-09-19T09:01:49.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.185+0000 7fb63fba3740 10 client.17646 fetch_fsmap learned FSMap version 36 2024-09-19T09:01:49.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.185+0000 7fb63fba3740 1 -- 172.21.15.19:0/287228707 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55e766ddd570 con 0x55e766dc3b60 2024-09-19T09:01:49.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.186+0000 7fb61e7fc640 1 -- 172.21.15.19:0/287228707 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb6280a4580 con 0x55e766dc3b60 2024-09-19T09:01:49.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.186+0000 7fb61e7fc640 1 -- 172.21.15.19:0/287228707 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fb620031a20 con 0x55e766dc3b60 2024-09-19T09:01:49.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.186+0000 7fb63fba3740 10 client.17646 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:01:49.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.186+0000 7fb63fba3740 10 client.17646 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:01:49.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.186+0000 7fb63fba3740 20 client.17646 populate_metadata read hostname 'smithi019' 2024-09-19T09:01:49.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.186+0000 7fb63fba3740 1 --2- 172.21.15.19:0/287228707 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e766ddea30 0x55e766de0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:49.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.186+0000 7fb63fba3740 4 client.17646 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:01:49.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.186+0000 7fb63fba3740 1 -- 172.21.15.19:0/287228707 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e766d367f0 con 0x55e766ddea30 2024-09-19T09:01:49.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.186+0000 7fb6367fc640 1 --2- 172.21.15.19:0/287228707 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e766ddea30 0x55e766de0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:49.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.186+0000 7fb6367fc640 1 --2- 172.21.15.19:0/287228707 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e766ddea30 0x55e766de0e20 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b79a53d20b837a39 server_cookie=b507b3b3c531d4ea in_seq=0 out_seq=0 2024-09-19T09:01:49.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.186+0000 7fb61e7fc640 10 client.17646 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:49.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.189+0000 7fb61e7fc640 1 -- 172.21.15.19:0/287228707 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e766d367f0 con 0x55e766ddea30 2024-09-19T09:01:49.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.189+0000 7fb61e7fc640 10 client.17646 handle_command_reply: tid=0 2024-09-19T09:01:49.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.189+0000 7fb63fba3740 1 client.17646 shutdown 2024-09-19T09:01:49.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.190+0000 7fb63fba3740 1 -- 172.21.15.19:0/287228707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e766dc3b60 msgr2=0x55e766dcbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:49.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.190+0000 7fb63fba3740 1 --2- 172.21.15.19:0/287228707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e766dc3b60 0x55e766dcbc80 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fb6200314e0 tx=0x7fb62002a480 comp rx=0 tx=0).stop 2024-09-19T09:01:49.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.190+0000 7fb63fba3740 1 -- 172.21.15.19:0/287228707 shutdown_connections 2024-09-19T09:01:49.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.190+0000 7fb63fba3740 1 --2- 172.21.15.19:0/287228707 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e766ddea30 0x55e766de0e20 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.190+0000 7fb63fba3740 1 --2- 172.21.15.19:0/287228707 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e766dc4480 0x55e766dcc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.190+0000 7fb61e7fc640 0 client.17646 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:49.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.190+0000 7fb63fba3740 1 --2- 172.21.15.19:0/287228707 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e766dced40 0x55e766dcc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.190+0000 7fb63fba3740 1 --2- 172.21.15.19:0/287228707 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e766dc3b60 0x55e766dcbc80 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.190+0000 7fb63fba3740 1 -- 172.21.15.19:0/287228707 >> 172.21.15.19:0/287228707 conn(0x55e766dc00f0 msgr2=0x55e766dbf270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:49.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.190+0000 7fb63fba3740 1 -- 172.21.15.19:0/287228707 shutdown_connections 2024-09-19T09:01:49.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.190+0000 7fb63fba3740 1 -- 172.21.15.19:0/287228707 wait complete. 2024-09-19T09:01:49.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.190+0000 7fb63fba3740 20 client.17646 trim_cache size 0 max 16384 2024-09-19T09:01:49.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.209+0000 7fb63fba3740 1 Processor -- start 2024-09-19T09:01:49.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.209+0000 7fb63fba3740 1 -- start start 2024-09-19T09:01:49.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.209+0000 7fb63fba3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e766dc3b60 0x55e766dcdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:49.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.209+0000 7fb63fba3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e766dc4480 0x55e766de66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:49.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.209+0000 7fb63fba3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e766dced40 0x55e766de6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:49.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.209+0000 7fb63fba3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb6381b3b60 con 0x55e766dc3b60 2024-09-19T09:01:49.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.209+0000 7fb63fba3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb6381b56a0 con 0x55e766dc4480 2024-09-19T09:01:49.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.209+0000 7fb63fba3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb6381b4230 con 0x55e766dced40 2024-09-19T09:01:49.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.209+0000 7fb636ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e766dc3b60 0x55e766dcdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:49.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.209+0000 7fb636ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e766dc3b60 0x55e766dcdae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56948/0 (socket says 172.21.15.19:56948) 2024-09-19T09:01:49.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.209+0000 7fb636ffd640 1 -- 172.21.15.19:0/4119670756 learned_addr learned my addr 172.21.15.19:0/4119670756 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:49.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.209+0000 7fb6367fc640 1 --2- 172.21.15.19:0/4119670756 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e766dc4480 0x55e766de66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:49.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.210+0000 7fb6377fe640 1 --2- 172.21.15.19:0/4119670756 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e766dced40 0x55e766de6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:49.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.210+0000 7fb6367fc640 1 -- 172.21.15.19:0/4119670756 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e766dced40 msgr2=0x55e766de6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:49.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.210+0000 7fb6367fc640 1 --2- 172.21.15.19:0/4119670756 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e766dced40 0x55e766de6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.210+0000 7fb6367fc640 1 -- 172.21.15.19:0/4119670756 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e766dc3b60 msgr2=0x55e766dcdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:49.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.210+0000 7fb6367fc640 1 --2- 172.21.15.19:0/4119670756 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e766dc3b60 0x55e766dcdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.210+0000 7fb6367fc640 1 -- 172.21.15.19:0/4119670756 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e766dce550 con 0x55e766dc4480 2024-09-19T09:01:49.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.210+0000 7fb636ffd640 1 --2- 172.21.15.19:0/4119670756 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e766dc3b60 0x55e766dcdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:49.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.210+0000 7fb6367fc640 1 --2- 172.21.15.19:0/4119670756 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e766dc4480 0x55e766de66b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb628000c00 tx=0x7fb62809ba50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=632d5291dc5c0088 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:49.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.210+0000 7fb62cff9640 1 -- 172.21.15.19:0/4119670756 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6280a4580 con 0x55e766dc4480 2024-09-19T09:01:49.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.210+0000 7fb62cff9640 1 -- 172.21.15.19:0/4119670756 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb628098000 con 0x55e766dc4480 2024-09-19T09:01:49.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.210+0000 7fb62cff9640 1 -- 172.21.15.19:0/4119670756 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb62809ad60 con 0x55e766dc4480 2024-09-19T09:01:49.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.211+0000 7fb63fba3740 1 -- 172.21.15.19:0/4119670756 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e766dc4480 msgr2=0x55e766de66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:49.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.211+0000 7fb63fba3740 1 --2- 172.21.15.19:0/4119670756 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e766dc4480 0x55e766de66b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb628000c00 tx=0x7fb62809ba50 comp rx=0 tx=0).stop 2024-09-19T09:01:49.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.211+0000 7fb63fba3740 1 -- 172.21.15.19:0/4119670756 shutdown_connections 2024-09-19T09:01:49.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.211+0000 7fb63fba3740 1 --2- 172.21.15.19:0/4119670756 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e766dced40 0x55e766de6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.211+0000 7fb63fba3740 1 --2- 172.21.15.19:0/4119670756 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e766dc4480 0x55e766de66b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.211+0000 7fb63fba3740 1 --2- 172.21.15.19:0/4119670756 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e766dc3b60 0x55e766dcdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.211+0000 7fb63fba3740 1 -- 172.21.15.19:0/4119670756 >> 172.21.15.19:0/4119670756 conn(0x55e766dc00f0 msgr2=0x55e766dcd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:49.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.211+0000 7fb63fba3740 1 -- 172.21.15.19:0/4119670756 shutdown_connections 2024-09-19T09:01:49.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.211+0000 7fb63fba3740 1 -- 172.21.15.19:0/4119670756 wait complete. 2024-09-19T09:01:49.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.212+0000 7fb63fba3740 1 -- start start 2024-09-19T09:01:49.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.212+0000 7fb63fba3740 1 Processor -- start 2024-09-19T09:01:49.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.212+0000 7fb63fba3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e766dc3b60 0x55e766dd3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:49.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.212+0000 7fb63fba3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e766dc4480 0x55e766dd3640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:49.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.212+0000 7fb63fba3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e766dced40 0x55e766e48680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:49.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.212+0000 7fb63fba3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb6381b4fd0 con 0x55e766dced40 2024-09-19T09:01:49.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.212+0000 7fb63fba3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb6381b4900 con 0x55e766dc4480 2024-09-19T09:01:49.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.212+0000 7fb63fba3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb6381b1c60 con 0x55e766dc3b60 2024-09-19T09:01:49.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.212+0000 7fb63fba3740 10 client.0 _ll_register_callbacks cb 0x7fb6200042a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:49.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.212+0000 7fb6367fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e766dc4480 0x55e766dd3640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:49.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.212+0000 7fb636ffd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e766dc3b60 0x55e766dd3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:49.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.212+0000 7fb6367fc640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e766dc4480 0x55e766dd3640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:56344/0 (socket says 172.21.15.19:56344) 2024-09-19T09:01:49.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.212+0000 7fb6367fc640 1 -- 172.21.15.19:0/1889771736 learned_addr learned my addr 172.21.15.19:0/1889771736 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:49.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.212+0000 7fb6377fe640 1 --2- 172.21.15.19:0/1889771736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e766dced40 0x55e766e48680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:49.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.212+0000 7fb636ffd640 1 -- 172.21.15.19:0/1889771736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e766dc4480 msgr2=0x55e766dd3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:49.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.212+0000 7fb636ffd640 1 --2- 172.21.15.19:0/1889771736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e766dc4480 0x55e766dd3640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.212+0000 7fb636ffd640 1 -- 172.21.15.19:0/1889771736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e766dced40 msgr2=0x55e766e48680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:49.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.212+0000 7fb636ffd640 1 --2- 172.21.15.19:0/1889771736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e766dced40 0x55e766e48680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.212+0000 7fb636ffd640 1 -- 172.21.15.19:0/1889771736 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e766e48bc0 con 0x55e766dc3b60 2024-09-19T09:01:49.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.213+0000 7fb636ffd640 1 --2- 172.21.15.19:0/1889771736 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e766dc3b60 0x55e766dd3100 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb620009850 tx=0x7fb620031c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b44137787a3f786b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:49.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.213+0000 7fb61e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T09:01:49.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.213+0000 7fb61e7fc640 1 -- 172.21.15.19:0/1889771736 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb620035040 con 0x55e766dc3b60 2024-09-19T09:01:49.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.213+0000 7fb61e7fc640 1 -- 172.21.15.19:0/1889771736 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb62003c8b0 con 0x55e766dc3b60 2024-09-19T09:01:49.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.213+0000 7fb63fba3740 1 -- 172.21.15.19:0/1889771736 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb628098000 con 0x55e766dc3b60 2024-09-19T09:01:49.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.213+0000 7fb61e7fc640 1 -- 172.21.15.19:0/1889771736 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fb62003cab0 con 0x55e766dc3b60 2024-09-19T09:01:49.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.213+0000 7fb63fba3740 10 client.26983 fetch_fsmap learned FSMap version 36 2024-09-19T09:01:49.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.213+0000 7fb63fba3740 1 -- 172.21.15.19:0/1889771736 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55e766e49e40 con 0x55e766dc3b60 2024-09-19T09:01:49.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.213+0000 7fb61e7fc640 1 -- 172.21.15.19:0/1889771736 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb628098000 con 0x55e766dc3b60 2024-09-19T09:01:49.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.213+0000 7fb61e7fc640 1 -- 172.21.15.19:0/1889771736 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7fb620048430 con 0x55e766dc3b60 2024-09-19T09:01:49.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.213+0000 7fb63fba3740 10 client.26983 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:01:49.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.213+0000 7fb63fba3740 10 client.26983 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:01:49.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.213+0000 7fb63fba3740 20 client.26983 populate_metadata read hostname 'smithi019' 2024-09-19T09:01:49.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.213+0000 7fb63fba3740 1 --2- 172.21.15.19:0/1889771736 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e766ddea30 0x55e766e4c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:49.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.213+0000 7fb63fba3740 4 client.26983 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:01:49.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.213+0000 7fb63fba3740 1 -- 172.21.15.19:0/1889771736 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e766d30d00 con 0x55e766ddea30 2024-09-19T09:01:49.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.214+0000 7fb6367fc640 1 --2- 172.21.15.19:0/1889771736 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e766ddea30 0x55e766e4c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:49.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.214+0000 7fb6367fc640 1 --2- 172.21.15.19:0/1889771736 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e766ddea30 0x55e766e4c5f0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=996f5eac57a60c4b server_cookie=960c33619dd42423 in_seq=0 out_seq=0 2024-09-19T09:01:49.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.214+0000 7fb61e7fc640 10 client.26983 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:49.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.586+0000 7fb61e7fc640 1 -- 172.21.15.19:0/1889771736 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e766d30d00 con 0x55e766ddea30 2024-09-19T09:01:49.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.586+0000 7fb61e7fc640 10 client.26983 handle_command_reply: tid=0 2024-09-19T09:01:49.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.586+0000 7fb63fba3740 1 client.26983 shutdown 2024-09-19T09:01:49.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.586+0000 7fb63fba3740 1 -- 172.21.15.19:0/1889771736 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e766dc3b60 msgr2=0x55e766dd3100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:49.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.586+0000 7fb63fba3740 1 --2- 172.21.15.19:0/1889771736 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e766dc3b60 0x55e766dd3100 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb620009850 tx=0x7fb620031c90 comp rx=0 tx=0).stop 2024-09-19T09:01:49.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.586+0000 7fb63fba3740 1 -- 172.21.15.19:0/1889771736 shutdown_connections 2024-09-19T09:01:49.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.586+0000 7fb63fba3740 1 --2- 172.21.15.19:0/1889771736 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e766ddea30 0x55e766e4c5f0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.586+0000 7fb63fba3740 1 --2- 172.21.15.19:0/1889771736 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e766dced40 0x55e766e48680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.586+0000 7fb61e7fc640 0 client.26983 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:49.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.586+0000 7fb63fba3740 1 --2- 172.21.15.19:0/1889771736 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e766dc4480 0x55e766dd3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.586+0000 7fb63fba3740 1 --2- 172.21.15.19:0/1889771736 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e766dc3b60 0x55e766dd3100 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.586+0000 7fb63fba3740 1 -- 172.21.15.19:0/1889771736 >> 172.21.15.19:0/1889771736 conn(0x55e766dc00f0 msgr2=0x55e766dc5dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:49.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.586+0000 7fb63fba3740 1 -- 172.21.15.19:0/1889771736 shutdown_connections 2024-09-19T09:01:49.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.586+0000 7fb63fba3740 1 -- 172.21.15.19:0/1889771736 wait complete. 2024-09-19T09:01:49.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.586+0000 7fb63fba3740 20 client.26983 trim_cache size 0 max 16384 2024-09-19T09:01:49.587 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T09:01:49.587 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-19T09:01:49.588 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "1d9e868e-87b9-4017-8774-95d75b40397d", 2024-09-19T09:01:49.588 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-19T09:01:49.588 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T09:01:49.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.587+0000 7fb63d7ca640 1 -- 172.21.15.19:0/494220439 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb6240a3240 msgr2=0x7fb6240a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:49.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.587+0000 7fb63d7ca640 1 --2- 172.21.15.19:0/494220439 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb6240a3240 0x7fb6240a5700 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb620009230 tx=0x7fb6200058d0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.587+0000 7fb63d7ca640 1 -- 172.21.15.19:0/494220439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb638102570 msgr2=0x7fb638198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:49.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.587+0000 7fb63d7ca640 1 --2- 172.21.15.19:0/494220439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb638102570 0x7fb638198a00 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fb62800d950 tx=0x7fb62800de10 comp rx=0 tx=0).stop 2024-09-19T09:01:49.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.587+0000 7fb63d7ca640 1 -- 172.21.15.19:0/494220439 shutdown_connections 2024-09-19T09:01:49.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.587+0000 7fb63d7ca640 1 --2- 172.21.15.19:0/494220439 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb6240a3240 0x7fb6240a5700 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.587+0000 7fb63d7ca640 1 --2- 172.21.15.19:0/494220439 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb638102ef0 0x7fb63819cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.587+0000 7fb63d7ca640 1 --2- 172.21.15.19:0/494220439 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb638102570 0x7fb638198a00 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.587+0000 7fb63d7ca640 1 --2- 172.21.15.19:0/494220439 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb638100e20 0x7fb6381984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:49.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.587+0000 7fb63d7ca640 1 -- 172.21.15.19:0/494220439 >> 172.21.15.19:0/494220439 conn(0x7fb6380fc7d0 msgr2=0x7fb63806a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:49.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.587+0000 7fb63d7ca640 1 -- 172.21.15.19:0/494220439 shutdown_connections 2024-09-19T09:01:49.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:49.587+0000 7fb63d7ca640 1 -- 172.21.15.19:0/494220439 wait complete. 2024-09-19T09:01:49.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:49 smithi019 ceph-mon[30976]: pgmap v625: 97 pgs: 97 active+clean; 16 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 563 op/s 2024-09-19T09:01:49.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:49 smithi155 ceph-mon[34921]: pgmap v625: 97 pgs: 97 active+clean; 16 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 563 op/s 2024-09-19T09:01:49.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:49 smithi203 ceph-mon[35450]: pgmap v625: 97 pgs: 97 active+clean; 16 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 563 op/s 2024-09-19T09:01:50.368 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:01:50.632 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:01:50.754 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:50 smithi019 ceph-mon[30976]: scrub queued for path: / 2024-09-19T09:01:50.754 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:50 smithi019 ceph-mon[30976]: scrub summary: idle+waiting paths [/] 2024-09-19T09:01:50.754 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:50 smithi019 ceph-mon[30976]: scrub summary: active paths [/] 2024-09-19T09:01:50.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:50 smithi155 ceph-mon[34921]: scrub queued for path: / 2024-09-19T09:01:50.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:50 smithi155 ceph-mon[34921]: scrub summary: idle+waiting paths [/] 2024-09-19T09:01:50.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:50 smithi155 ceph-mon[34921]: scrub summary: active paths [/] 2024-09-19T09:01:50.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:50 smithi203 ceph-mon[35450]: scrub queued for path: / 2024-09-19T09:01:50.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:50 smithi203 ceph-mon[35450]: scrub summary: idle+waiting paths [/] 2024-09-19T09:01:50.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:50 smithi203 ceph-mon[35450]: scrub summary: active paths [/] 2024-09-19T09:01:51.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.193+0000 7f15b951a640 1 -- 172.21.15.19:0/3747957363 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15b4102dd0 msgr2=0x7f15b41031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:51.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.193+0000 7f15b951a640 1 --2- 172.21.15.19:0/3747957363 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15b4102dd0 0x7f15b41031b0 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f15a4009900 tx=0x7f15a402a480 comp rx=0 tx=0).stop 2024-09-19T09:01:51.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.194+0000 7f15b951a640 1 -- 172.21.15.19:0/3747957363 shutdown_connections 2024-09-19T09:01:51.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.194+0000 7f15b951a640 1 --2- 172.21.15.19:0/3747957363 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f15b410c170 0x7f15b410e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.194+0000 7f15b951a640 1 --2- 172.21.15.19:0/3747957363 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15b41036f0 0x7f15b410bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.194+0000 7f15b951a640 1 --2- 172.21.15.19:0/3747957363 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15b4102dd0 0x7f15b41031b0 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.194+0000 7f15b951a640 1 -- 172.21.15.19:0/3747957363 >> 172.21.15.19:0/3747957363 conn(0x7f15b40fc790 msgr2=0x7f15b40febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:51.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.194+0000 7f15b951a640 1 -- 172.21.15.19:0/3747957363 shutdown_connections 2024-09-19T09:01:51.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.194+0000 7f15b951a640 1 -- 172.21.15.19:0/3747957363 wait complete. 2024-09-19T09:01:51.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.194+0000 7f15b951a640 1 Processor -- start 2024-09-19T09:01:51.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.195+0000 7f15b951a640 1 -- start start 2024-09-19T09:01:51.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.195+0000 7f15b951a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15b4102dd0 0x7f15b41984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:51.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.195+0000 7f15b951a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f15b41036f0 0x7f15b41989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:51.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.195+0000 7f15b951a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15b410c170 0x7f15b419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:51.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.195+0000 7f15b951a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f15b4111f60 con 0x7f15b410c170 2024-09-19T09:01:51.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.195+0000 7f15b951a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f15b4111de0 con 0x7f15b4102dd0 2024-09-19T09:01:51.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.195+0000 7f15b951a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f15b41120e0 con 0x7f15b41036f0 2024-09-19T09:01:51.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.195+0000 7f15b37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15b410c170 0x7f15b419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:51.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.195+0000 7f15b37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15b410c170 0x7f15b419cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56960/0 (socket says 172.21.15.19:56960) 2024-09-19T09:01:51.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.195+0000 7f15b2ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15b4102dd0 0x7f15b41984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:51.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.195+0000 7f15b37fe640 1 -- 172.21.15.19:0/1665584543 learned_addr learned my addr 172.21.15.19:0/1665584543 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:51.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.195+0000 7f15b27fc640 1 --2- 172.21.15.19:0/1665584543 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f15b41036f0 0x7f15b41989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:51.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.195+0000 7f15b37fe640 1 -- 172.21.15.19:0/1665584543 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f15b41036f0 msgr2=0x7f15b41989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:51.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.195+0000 7f15b37fe640 1 --2- 172.21.15.19:0/1665584543 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f15b41036f0 0x7f15b41989f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.195+0000 7f15b37fe640 1 -- 172.21.15.19:0/1665584543 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15b4102dd0 msgr2=0x7f15b41984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:51.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.195+0000 7f15b37fe640 1 --2- 172.21.15.19:0/1665584543 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15b4102dd0 0x7f15b41984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.195+0000 7f15b37fe640 1 -- 172.21.15.19:0/1665584543 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15b419d460 con 0x7f15b410c170 2024-09-19T09:01:51.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.195+0000 7f15b2ffd640 1 --2- 172.21.15.19:0/1665584543 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15b4102dd0 0x7f15b41984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:51.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.196+0000 7f15b37fe640 1 --2- 172.21.15.19:0/1665584543 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15b410c170 0x7f15b419cd80 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f15ac00d750 tx=0x7f15ac00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:51.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.196+0000 7f159bfff640 1 -- 172.21.15.19:0/1665584543 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ac017070 con 0x7f15b410c170 2024-09-19T09:01:51.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.196+0000 7f159bfff640 1 -- 172.21.15.19:0/1665584543 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15ac005500 con 0x7f15b410c170 2024-09-19T09:01:51.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.196+0000 7f15b951a640 1 -- 172.21.15.19:0/1665584543 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15b419d750 con 0x7f15b410c170 2024-09-19T09:01:51.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.196+0000 7f159bfff640 1 -- 172.21.15.19:0/1665584543 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15ac004d90 con 0x7f15b410c170 2024-09-19T09:01:51.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.196+0000 7f15b951a640 1 -- 172.21.15.19:0/1665584543 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15b41a5030 con 0x7f15b410c170 2024-09-19T09:01:51.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.198+0000 7f159bfff640 1 -- 172.21.15.19:0/1665584543 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f15ac004f30 con 0x7f15b410c170 2024-09-19T09:01:51.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.199+0000 7f15bb8f3740 1 Processor -- start 2024-09-19T09:01:51.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.199+0000 7f15bb8f3740 1 -- start start 2024-09-19T09:01:51.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.199+0000 7f15bb8f3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fb72c2340 0x561fb72c2720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:51.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.199+0000 7f15bb8f3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fb72c2c60 0x561fb72d1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:51.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.199+0000 7f15bb8f3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561fb72d1a90 0x561fb72d3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:51.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.199+0000 7f15bb8f3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x561fb72282e0 con 0x561fb72c2c60 2024-09-19T09:01:51.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.199+0000 7f15bb8f3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x561fb71cfce0 con 0x561fb72d1a90 2024-09-19T09:01:51.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.199+0000 7f15bb8f3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x561fb72242a0 con 0x561fb72c2340 2024-09-19T09:01:51.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.199+0000 7f15b2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fb72c2c60 0x561fb72d1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:51.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.199+0000 7f159bfff640 1 --2- 172.21.15.19:0/1665584543 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f159c0a32c0 0x7f159c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:51.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.199+0000 7f15b2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fb72c2c60 0x561fb72d1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56972/0 (socket says 172.21.15.19:56972) 2024-09-19T09:01:51.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.199+0000 7f15b2ffd640 1 -- 172.21.15.19:0/256613398 learned_addr learned my addr 172.21.15.19:0/256613398 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:51.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.199+0000 7f15b27fc640 1 --2- 172.21.15.19:0/256613398 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561fb72d1a90 0x561fb72d3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:51.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.199+0000 7f15b27fc640 1 --2- 172.21.15.19:0/256613398 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fb72c2340 0x561fb72c2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:51.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.199+0000 7f159bfff640 1 -- 172.21.15.19:0/1665584543 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f15ac0cf180 con 0x7f15b410c170 2024-09-19T09:01:51.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.200+0000 7f15b2ffd640 1 -- 172.21.15.19:0/256613398 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fb72c2340 msgr2=0x561fb72c2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:51.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.200+0000 7f15b2ffd640 1 --2- 172.21.15.19:0/256613398 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fb72c2340 0x561fb72c2720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.200+0000 7f15b2ffd640 1 -- 172.21.15.19:0/256613398 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561fb72d1a90 msgr2=0x561fb72d3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:51.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.200+0000 7f15b37fe640 1 --2- 172.21.15.19:0/1665584543 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f159c0a32c0 0x7f159c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:51.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.200+0000 7f15b2ffd640 1 --2- 172.21.15.19:0/256613398 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561fb72d1a90 0x561fb72d3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.200+0000 7f15b2ffd640 1 -- 172.21.15.19:0/256613398 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fb71b4440 con 0x561fb72c2c60 2024-09-19T09:01:51.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.200+0000 7f15b27fc640 1 --2- 172.21.15.19:0/256613398 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561fb72d1a90 0x561fb72d3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:51.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.200+0000 7f15b2ffd640 1 --2- 172.21.15.19:0/256613398 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fb72c2c60 0x561fb72d1550 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f15a4009900 tx=0x7f15a4005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eb0909499082655 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:51.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.200+0000 7f15b37fe640 1 --2- 172.21.15.19:0/1665584543 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f159c0a32c0 0x7f159c0a5780 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f15ac00d720 tx=0x7f15ac009bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:51.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.200+0000 7f15997fa640 1 -- 172.21.15.19:0/256613398 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a4035040 con 0x561fb72c2c60 2024-09-19T09:01:51.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.200+0000 7f15997fa640 1 -- 172.21.15.19:0/256613398 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15a40318b0 con 0x561fb72c2c60 2024-09-19T09:01:51.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.200+0000 7f15997fa640 1 -- 172.21.15.19:0/256613398 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a40047a0 con 0x561fb72c2c60 2024-09-19T09:01:51.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.201+0000 7f15bb8f3740 1 -- 172.21.15.19:0/256613398 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fb72c2c60 msgr2=0x561fb72d1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:51.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.201+0000 7f15bb8f3740 1 --2- 172.21.15.19:0/256613398 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fb72c2c60 0x561fb72d1550 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f15a4009900 tx=0x7f15a4005e80 comp rx=0 tx=0).stop 2024-09-19T09:01:51.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.201+0000 7f15bb8f3740 1 -- 172.21.15.19:0/256613398 shutdown_connections 2024-09-19T09:01:51.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.201+0000 7f15bb8f3740 1 --2- 172.21.15.19:0/256613398 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561fb72d1a90 0x561fb72d3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.201+0000 7f15bb8f3740 1 --2- 172.21.15.19:0/256613398 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fb72c2c60 0x561fb72d1550 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.201+0000 7f15bb8f3740 1 --2- 172.21.15.19:0/256613398 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fb72c2340 0x561fb72c2720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.201+0000 7f15bb8f3740 1 -- 172.21.15.19:0/256613398 >> 172.21.15.19:0/256613398 conn(0x561fb72bea30 msgr2=0x561fb72bee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:51.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.201+0000 7f15bb8f3740 1 -- 172.21.15.19:0/256613398 shutdown_connections 2024-09-19T09:01:51.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.201+0000 7f15bb8f3740 1 -- 172.21.15.19:0/256613398 wait complete. 2024-09-19T09:01:51.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.201+0000 7f15bb8f3740 1 -- start start 2024-09-19T09:01:51.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.201+0000 7f15bb8f3740 1 Processor -- start 2024-09-19T09:01:51.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.202+0000 7f15bb8f3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fb72c2340 0x561fb72d13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:51.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.202+0000 7f15bb8f3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561fb72c2c60 0x561fb72ce690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:51.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.202+0000 7f15bb8f3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fb72d1a90 0x561fb72cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:51.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.202+0000 7f15bb8f3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x561fb72d4660 con 0x561fb72d1a90 2024-09-19T09:01:51.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.202+0000 7f15bb8f3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x561fb71e3050 con 0x561fb72c2c60 2024-09-19T09:01:51.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.202+0000 7f15bb8f3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x561fb72d47e0 con 0x561fb72c2340 2024-09-19T09:01:51.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.202+0000 7f15bb8f3740 10 client.0 _ll_register_callbacks cb 0x561fb7223160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:51.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.202+0000 7f15b27fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fb72d1a90 0x561fb72cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:51.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.202+0000 7f15b2ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561fb72c2c60 0x561fb72ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:51.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.202+0000 7f15b27fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fb72d1a90 0x561fb72cebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56976/0 (socket says 172.21.15.19:56976) 2024-09-19T09:01:51.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.202+0000 7f15b27fc640 1 -- 172.21.15.19:0/1640981714 learned_addr learned my addr 172.21.15.19:0/1640981714 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:51.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.202+0000 7f15b27fc640 1 --2- 172.21.15.19:0/1640981714 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fb72c2340 0x561fb72d13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:51.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.202+0000 7f15b27fc640 1 -- 172.21.15.19:0/1640981714 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fb72c2340 msgr2=0x561fb72d13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:51.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.202+0000 7f15b27fc640 1 --2- 172.21.15.19:0/1640981714 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fb72c2340 0x561fb72d13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.202+0000 7f15b27fc640 1 -- 172.21.15.19:0/1640981714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561fb72c2c60 msgr2=0x561fb72ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:51.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.202+0000 7f15b27fc640 1 --2- 172.21.15.19:0/1640981714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561fb72c2c60 0x561fb72ce690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.202+0000 7f15b27fc640 1 -- 172.21.15.19:0/1640981714 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fb6f993c0 con 0x561fb72d1a90 2024-09-19T09:01:51.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.202+0000 7f15b2ffd640 1 --2- 172.21.15.19:0/1640981714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561fb72c2c60 0x561fb72ce690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:51.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.202+0000 7f15b27fc640 1 --2- 172.21.15.19:0/1640981714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fb72d1a90 0x561fb72cebf0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f15a800f720 tx=0x7f15a8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d9a0858e0ce61ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:51.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.202+0000 7f1596ff5640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:01:51.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.203+0000 7f1596ff5640 1 -- 172.21.15.19:0/1640981714 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a8004d20 con 0x561fb72d1a90 2024-09-19T09:01:51.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.203+0000 7f1596ff5640 1 -- 172.21.15.19:0/1640981714 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f15a8003970 con 0x561fb72d1a90 2024-09-19T09:01:51.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.203+0000 7f15bb8f3740 1 -- 172.21.15.19:0/1640981714 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15a40318b0 con 0x561fb72d1a90 2024-09-19T09:01:51.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.203+0000 7f1596ff5640 1 -- 172.21.15.19:0/1640981714 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f15a8003b70 con 0x561fb72d1a90 2024-09-19T09:01:51.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.203+0000 7f15bb8f3740 10 client.17664 fetch_fsmap learned FSMap version 36 2024-09-19T09:01:51.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.203+0000 7f15bb8f3740 1 -- 172.21.15.19:0/1640981714 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x561fb72e0070 con 0x561fb72d1a90 2024-09-19T09:01:51.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.203+0000 7f1596ff5640 1 -- 172.21.15.19:0/1640981714 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15a40318b0 con 0x561fb72d1a90 2024-09-19T09:01:51.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.203+0000 7f1596ff5640 1 -- 172.21.15.19:0/1640981714 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f15a8013250 con 0x561fb72d1a90 2024-09-19T09:01:51.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.204+0000 7f15bb8f3740 10 client.17664 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:01:51.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.204+0000 7f15bb8f3740 10 client.17664 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:01:51.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.204+0000 7f15bb8f3740 20 client.17664 populate_metadata read hostname 'smithi019' 2024-09-19T09:01:51.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.204+0000 7f15bb8f3740 1 --2- 172.21.15.19:0/1640981714 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x561fb72e1530 0x561fb72e3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:51.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.204+0000 7f15bb8f3740 4 client.17664 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:01:51.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.204+0000 7f15bb8f3740 1 -- 172.21.15.19:0/1640981714 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561fb7235850 con 0x561fb72e1530 2024-09-19T09:01:51.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.204+0000 7f15b2ffd640 1 --2- 172.21.15.19:0/1640981714 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x561fb72e1530 0x561fb72e3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:51.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.204+0000 7f1596ff5640 10 client.17664 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:51.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.204+0000 7f15b2ffd640 1 --2- 172.21.15.19:0/1640981714 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x561fb72e1530 0x561fb72e3920 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37e0aa8a9e36e826 server_cookie=b172e334957c4de2 in_seq=0 out_seq=0 2024-09-19T09:01:51.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.207+0000 7f1596ff5640 1 -- 172.21.15.19:0/1640981714 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561fb7235850 con 0x561fb72e1530 2024-09-19T09:01:51.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.207+0000 7f1596ff5640 10 client.17664 handle_command_reply: tid=0 2024-09-19T09:01:51.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.207+0000 7f15bb8f3740 1 client.17664 shutdown 2024-09-19T09:01:51.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.207+0000 7f15bb8f3740 1 -- 172.21.15.19:0/1640981714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fb72d1a90 msgr2=0x561fb72cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:51.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.207+0000 7f15bb8f3740 1 --2- 172.21.15.19:0/1640981714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fb72d1a90 0x561fb72cebf0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f15a800f720 tx=0x7f15a8004ab0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.207+0000 7f15bb8f3740 1 -- 172.21.15.19:0/1640981714 shutdown_connections 2024-09-19T09:01:51.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.207+0000 7f15bb8f3740 1 --2- 172.21.15.19:0/1640981714 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x561fb72e1530 0x561fb72e3920 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.207+0000 7f15bb8f3740 1 --2- 172.21.15.19:0/1640981714 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fb72d1a90 0x561fb72cebf0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.207+0000 7f15bb8f3740 1 --2- 172.21.15.19:0/1640981714 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561fb72c2c60 0x561fb72ce690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.207+0000 7f15bb8f3740 1 --2- 172.21.15.19:0/1640981714 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fb72c2340 0x561fb72d13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.207+0000 7f1596ff5640 0 client.17664 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:51.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.207+0000 7f15bb8f3740 1 -- 172.21.15.19:0/1640981714 >> 172.21.15.19:0/1640981714 conn(0x561fb72bea30 msgr2=0x561fb72bdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:51.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.207+0000 7f15bb8f3740 1 -- 172.21.15.19:0/1640981714 shutdown_connections 2024-09-19T09:01:51.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.207+0000 7f15bb8f3740 1 -- 172.21.15.19:0/1640981714 wait complete. 2024-09-19T09:01:51.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.207+0000 7f15bb8f3740 20 client.17664 trim_cache size 0 max 16384 2024-09-19T09:01:51.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.226+0000 7f15bb8f3740 1 Processor -- start 2024-09-19T09:01:51.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.226+0000 7f15bb8f3740 1 -- start start 2024-09-19T09:01:51.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.226+0000 7f15bb8f3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fb72c2340 0x561fb72dd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:51.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.226+0000 7f15bb8f3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561fb72c2c60 0x561fb72e91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:51.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.226+0000 7f15bb8f3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fb72d1a90 0x561fb72e9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:51.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.226+0000 7f15bb8f3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f15b41ab430 con 0x561fb72c2340 2024-09-19T09:01:51.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.226+0000 7f15bb8f3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f15b41acf70 con 0x561fb72c2c60 2024-09-19T09:01:51.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.226+0000 7f15bb8f3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f15b41abb00 con 0x561fb72d1a90 2024-09-19T09:01:51.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.226+0000 7f15b27fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fb72c2340 0x561fb72dd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:51.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.226+0000 7f15b27fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fb72c2340 0x561fb72dd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56982/0 (socket says 172.21.15.19:56982) 2024-09-19T09:01:51.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.226+0000 7f15b27fc640 1 -- 172.21.15.19:0/2672436871 learned_addr learned my addr 172.21.15.19:0/2672436871 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:51.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.226+0000 7f15b27fc640 1 --2- 172.21.15.19:0/2672436871 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fb72d1a90 0x561fb72e9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:51.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.226+0000 7f15b2ffd640 1 --2- 172.21.15.19:0/2672436871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561fb72c2c60 0x561fb72e91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:51.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.227+0000 7f15b27fc640 1 -- 172.21.15.19:0/2672436871 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fb72d1a90 msgr2=0x561fb72e9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:51.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.227+0000 7f15b27fc640 1 --2- 172.21.15.19:0/2672436871 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fb72d1a90 0x561fb72e9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.227+0000 7f15b27fc640 1 -- 172.21.15.19:0/2672436871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561fb72c2c60 msgr2=0x561fb72e91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:51.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.227+0000 7f15b27fc640 1 --2- 172.21.15.19:0/2672436871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561fb72c2c60 0x561fb72e91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.227+0000 7f15b27fc640 1 -- 172.21.15.19:0/2672436871 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fb72cef60 con 0x561fb72c2340 2024-09-19T09:01:51.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.227+0000 7f15b27fc640 1 --2- 172.21.15.19:0/2672436871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fb72c2340 0x561fb72dd900 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f15a8006010 tx=0x7f15a800f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be226fab951c1bf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:51.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.227+0000 7f1598ff9640 1 -- 172.21.15.19:0/2672436871 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a8030070 con 0x561fb72c2340 2024-09-19T09:01:51.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.227+0000 7f1598ff9640 1 -- 172.21.15.19:0/2672436871 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15a8031040 con 0x561fb72c2340 2024-09-19T09:01:51.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.227+0000 7f1598ff9640 1 -- 172.21.15.19:0/2672436871 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a8011ac0 con 0x561fb72c2340 2024-09-19T09:01:51.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.228+0000 7f15bb8f3740 1 -- 172.21.15.19:0/2672436871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fb72c2340 msgr2=0x561fb72dd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:51.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.228+0000 7f15bb8f3740 1 --2- 172.21.15.19:0/2672436871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fb72c2340 0x561fb72dd900 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f15a8006010 tx=0x7f15a800f450 comp rx=0 tx=0).stop 2024-09-19T09:01:51.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.228+0000 7f15bb8f3740 1 -- 172.21.15.19:0/2672436871 shutdown_connections 2024-09-19T09:01:51.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.228+0000 7f15bb8f3740 1 --2- 172.21.15.19:0/2672436871 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fb72d1a90 0x561fb72e9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.228+0000 7f15bb8f3740 1 --2- 172.21.15.19:0/2672436871 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561fb72c2c60 0x561fb72e91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.228+0000 7f15bb8f3740 1 --2- 172.21.15.19:0/2672436871 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fb72c2340 0x561fb72dd900 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.228+0000 7f15bb8f3740 1 -- 172.21.15.19:0/2672436871 >> 172.21.15.19:0/2672436871 conn(0x561fb72bea30 msgr2=0x561fb72ccf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:51.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.228+0000 7f15bb8f3740 1 -- 172.21.15.19:0/2672436871 shutdown_connections 2024-09-19T09:01:51.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.228+0000 7f15bb8f3740 1 -- 172.21.15.19:0/2672436871 wait complete. 2024-09-19T09:01:51.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.228+0000 7f15bb8f3740 1 -- start start 2024-09-19T09:01:51.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.228+0000 7f15bb8f3740 1 Processor -- start 2024-09-19T09:01:51.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.229+0000 7f15bb8f3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fb72c2340 0x561fb72d9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:51.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.229+0000 7f15bb8f3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561fb72c2c60 0x561fb72da2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:51.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.229+0000 7f15bb8f3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fb72d1a90 0x561fb72d5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:51.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.229+0000 7f15bb8f3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f15b41ac8a0 con 0x561fb72d1a90 2024-09-19T09:01:51.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.229+0000 7f15bb8f3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f15b41ac1d0 con 0x561fb72c2c60 2024-09-19T09:01:51.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.229+0000 7f15bb8f3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f15b41a9410 con 0x561fb72c2340 2024-09-19T09:01:51.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.229+0000 7f15bb8f3740 10 client.0 _ll_register_callbacks cb 0x7f15a800f590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:51.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.229+0000 7f15b27fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fb72d1a90 0x561fb72d5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:51.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.229+0000 7f15b27fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fb72d1a90 0x561fb72d5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56992/0 (socket says 172.21.15.19:56992) 2024-09-19T09:01:51.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.229+0000 7f15b27fc640 1 -- 172.21.15.19:0/910983006 learned_addr learned my addr 172.21.15.19:0/910983006 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:51.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.229+0000 7f15b27fc640 1 --2- 172.21.15.19:0/910983006 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fb72c2340 0x561fb72d9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:51.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.229+0000 7f15b2ffd640 1 --2- 172.21.15.19:0/910983006 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561fb72c2c60 0x561fb72da2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:51.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.229+0000 7f15b27fc640 1 -- 172.21.15.19:0/910983006 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fb72c2340 msgr2=0x561fb72d9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:51.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.229+0000 7f15b27fc640 1 --2- 172.21.15.19:0/910983006 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fb72c2340 0x561fb72d9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.229+0000 7f15b27fc640 1 -- 172.21.15.19:0/910983006 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561fb72c2c60 msgr2=0x561fb72da2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:51.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.229+0000 7f15b27fc640 1 --2- 172.21.15.19:0/910983006 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561fb72c2c60 0x561fb72da2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.229+0000 7f15b27fc640 1 -- 172.21.15.19:0/910983006 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fb72c2a90 con 0x561fb72d1a90 2024-09-19T09:01:51.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.229+0000 7f15b27fc640 1 --2- 172.21.15.19:0/910983006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fb72d1a90 0x561fb72d5140 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f15a8013c20 tx=0x7f15a800f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=babce9a9a63055e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:51.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.229+0000 7f1596ff5640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:01:51.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.229+0000 7f1596ff5640 1 -- 172.21.15.19:0/910983006 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15a8030070 con 0x561fb72d1a90 2024-09-19T09:01:51.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.229+0000 7f1596ff5640 1 -- 172.21.15.19:0/910983006 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f15a8003d10 con 0x561fb72d1a90 2024-09-19T09:01:51.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.229+0000 7f15bb8f3740 1 -- 172.21.15.19:0/910983006 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f15a8031040 con 0x561fb72d1a90 2024-09-19T09:01:51.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.230+0000 7f1596ff5640 1 -- 172.21.15.19:0/910983006 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f15a8011030 con 0x561fb72d1a90 2024-09-19T09:01:51.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.230+0000 7f15bb8f3740 10 client.17670 fetch_fsmap learned FSMap version 36 2024-09-19T09:01:51.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.230+0000 7f15bb8f3740 1 -- 172.21.15.19:0/910983006 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x561fb734bbb0 con 0x561fb72d1a90 2024-09-19T09:01:51.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.230+0000 7f1596ff5640 1 -- 172.21.15.19:0/910983006 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f15a8031040 con 0x561fb72d1a90 2024-09-19T09:01:51.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.230+0000 7f1596ff5640 1 -- 172.21.15.19:0/910983006 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7f15a800e8b0 con 0x561fb72d1a90 2024-09-19T09:01:51.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.230+0000 7f15bb8f3740 10 client.17670 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:01:51.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.230+0000 7f15bb8f3740 10 client.17670 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:01:51.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.230+0000 7f15bb8f3740 20 client.17670 populate_metadata read hostname 'smithi019' 2024-09-19T09:01:51.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.230+0000 7f15bb8f3740 1 --2- 172.21.15.19:0/910983006 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x561fb734c270 0x561fb734e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:51.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.230+0000 7f15bb8f3740 4 client.17670 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:01:51.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.230+0000 7f15bb8f3740 1 -- 172.21.15.19:0/910983006 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561fb722fd60 con 0x561fb734c270 2024-09-19T09:01:51.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.230+0000 7f15b2ffd640 1 --2- 172.21.15.19:0/910983006 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x561fb734c270 0x561fb734e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:51.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.231+0000 7f1596ff5640 10 client.17670 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:51.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.231+0000 7f15b2ffd640 1 --2- 172.21.15.19:0/910983006 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x561fb734c270 0x561fb734e660 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6412b542802ca59 server_cookie=be84dd2a0f977e67 in_seq=0 out_seq=0 2024-09-19T09:01:51.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.235+0000 7f1596ff5640 1 -- 172.21.15.19:0/910983006 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+268 (crc 0 0 0) 0x561fb722fd60 con 0x561fb734c270 2024-09-19T09:01:51.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.235+0000 7f1596ff5640 10 client.17670 handle_command_reply: tid=0 2024-09-19T09:01:51.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.235+0000 7f15bb8f3740 1 client.17670 shutdown 2024-09-19T09:01:51.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.235+0000 7f15bb8f3740 1 -- 172.21.15.19:0/910983006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fb72d1a90 msgr2=0x561fb72d5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:51.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.235+0000 7f15bb8f3740 1 --2- 172.21.15.19:0/910983006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fb72d1a90 0x561fb72d5140 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f15a8013c20 tx=0x7f15a800f6c0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.235+0000 7f15bb8f3740 1 -- 172.21.15.19:0/910983006 shutdown_connections 2024-09-19T09:01:51.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.235+0000 7f15bb8f3740 1 --2- 172.21.15.19:0/910983006 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x561fb734c270 0x561fb734e660 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.235+0000 7f15bb8f3740 1 --2- 172.21.15.19:0/910983006 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561fb72d1a90 0x561fb72d5140 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.235+0000 7f15bb8f3740 1 --2- 172.21.15.19:0/910983006 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561fb72c2c60 0x561fb72da2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.235+0000 7f15bb8f3740 1 --2- 172.21.15.19:0/910983006 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fb72c2340 0x561fb72d9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.235+0000 7f15bb8f3740 1 -- 172.21.15.19:0/910983006 >> 172.21.15.19:0/910983006 conn(0x561fb72bea30 msgr2=0x561fb72d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:51.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.235+0000 7f1596ff5640 0 client.17670 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:51.494 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T09:01:51.495 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "scrub active (9492 inodes in the stack)", 2024-09-19T09:01:51.495 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-19T09:01:51.495 INFO:teuthology.orchestra.run.smithi019.stdout: "1d9e868e-87b9-4017-8774-95d75b40397d": { 2024-09-19T09:01:51.495 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-19T09:01:51.495 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "1d9e868e-87b9-4017-8774-95d75b40397d", 2024-09-19T09:01:51.495 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-19T09:01:51.495 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:01:51.495 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:01:51.495 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T09:01:51.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.235+0000 7f15bb8f3740 1 -- 172.21.15.19:0/910983006 shutdown_connections 2024-09-19T09:01:51.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.235+0000 7f15bb8f3740 1 -- 172.21.15.19:0/910983006 wait complete. 2024-09-19T09:01:51.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.235+0000 7f15bb8f3740 20 client.17670 trim_cache size 0 max 16384 2024-09-19T09:01:51.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.236+0000 7f15b951a640 1 -- 172.21.15.19:0/1665584543 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f159c0a32c0 msgr2=0x7f159c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:51.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.236+0000 7f15b951a640 1 --2- 172.21.15.19:0/1665584543 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f159c0a32c0 0x7f159c0a5780 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f15ac00d720 tx=0x7f15ac009bd0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.236+0000 7f15b951a640 1 -- 172.21.15.19:0/1665584543 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15b410c170 msgr2=0x7f15b419cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:51.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.236+0000 7f15b951a640 1 --2- 172.21.15.19:0/1665584543 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15b410c170 0x7f15b419cd80 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f15ac00d750 tx=0x7f15ac00dc10 comp rx=0 tx=0).stop 2024-09-19T09:01:51.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.236+0000 7f15b951a640 1 -- 172.21.15.19:0/1665584543 shutdown_connections 2024-09-19T09:01:51.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.236+0000 7f15b951a640 1 --2- 172.21.15.19:0/1665584543 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f159c0a32c0 0x7f159c0a5780 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.236+0000 7f15b951a640 1 --2- 172.21.15.19:0/1665584543 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f15b41036f0 0x7f15b41989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.236+0000 7f15b951a640 1 --2- 172.21.15.19:0/1665584543 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f15b410c170 0x7f15b419cd80 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.236+0000 7f15b951a640 1 --2- 172.21.15.19:0/1665584543 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f15b4102dd0 0x7f15b41984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:51.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.236+0000 7f15b951a640 1 -- 172.21.15.19:0/1665584543 >> 172.21.15.19:0/1665584543 conn(0x7f15b40fc790 msgr2=0x7f15b40fdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:51.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.236+0000 7f15b951a640 1 -- 172.21.15.19:0/1665584543 shutdown_connections 2024-09-19T09:01:51.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:01:51.236+0000 7f15b951a640 1 -- 172.21.15.19:0/1665584543 wait complete. 2024-09-19T09:01:51.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:51 smithi019 ceph-mon[30976]: pgmap v626: 97 pgs: 97 active+clean; 16 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 1.1 MiB/s wr, 495 op/s 2024-09-19T09:01:51.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:51 smithi155 ceph-mon[34921]: pgmap v626: 97 pgs: 97 active+clean; 16 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 1.1 MiB/s wr, 495 op/s 2024-09-19T09:01:51.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:51 smithi203 ceph-mon[35450]: pgmap v626: 97 pgs: 97 active+clean; 16 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 642 KiB/s rd, 1.1 MiB/s wr, 495 op/s 2024-09-19T09:01:52.373 INFO:tasks.cephfs.filesystem:scrub status for tag:1d9e868e-87b9-4017-8774-95d75b40397d - {'path': '/', 'tag': '1d9e868e-87b9-4017-8774-95d75b40397d', 'options': 'recursive,force'} 2024-09-19T09:01:53.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:53 smithi019 ceph-mon[30976]: pgmap v627: 97 pgs: 97 active+clean; 22 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 656 KiB/s rd, 1.6 MiB/s wr, 568 op/s 2024-09-19T09:01:53.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:53 smithi155 ceph-mon[34921]: pgmap v627: 97 pgs: 97 active+clean; 22 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 656 KiB/s rd, 1.6 MiB/s wr, 568 op/s 2024-09-19T09:01:53.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:53 smithi203 ceph-mon[35450]: pgmap v627: 97 pgs: 97 active+clean; 22 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 656 KiB/s rd, 1.6 MiB/s wr, 568 op/s 2024-09-19T09:01:54.389 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:01:54 smithi019 systemd[1]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.g.service: Scheduled restart job, restart counter is at 1. 2024-09-19T09:01:54.389 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:01:54 smithi019 systemd[1]: Stopped Ceph mds.g for f26c9d84-7662-11ef-bceb-c7b262605968. 2024-09-19T09:01:54.389 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:01:54 smithi019 systemd[1]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.g.service: Consumed 17.986s CPU time. 2024-09-19T09:01:54.389 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:01:54 smithi019 systemd[1]: Starting Ceph mds.g for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T09:01:54.646 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:01:54 smithi019 podman[187307]: 2024-09-19 09:01:54.289247333 +0000 UTC m=+0.017732626 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:01:54.647 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:01:54 smithi019 podman[187307]: 2024-09-19 09:01:54.406018001 +0000 UTC m=+0.134503323 container create 1afde72a9cfd38a1b12175a1b7c7c9311e7a2aecbcb90b709733f644488fc762 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-19T09:01:54.752 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.751+0000 7efe5f9af640 1 -- 172.21.15.19:0/1915613067 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe5810a150 msgr2=0x7efe581109e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:54.752 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.751+0000 7efe5f9af640 1 --2- 172.21.15.19:0/1915613067 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe5810a150 0x7efe581109e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efe50009be0 tx=0x7efe5002a6c0 comp rx=0 tx=0).stop 2024-09-19T09:01:54.752 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.752+0000 7efe5f9af640 1 -- 172.21.15.19:0/1915613067 shutdown_connections 2024-09-19T09:01:54.752 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.752+0000 7efe5f9af640 1 --2- 172.21.15.19:0/1915613067 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe5810a150 0x7efe581109e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:54.753 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.752+0000 7efe5f9af640 1 --2- 172.21.15.19:0/1915613067 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe58109790 0x7efe58109c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:54.753 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.752+0000 7efe5f9af640 1 --2- 172.21.15.19:0/1915613067 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe58073730 0x7efe58073b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:54.753 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.752+0000 7efe5f9af640 1 -- 172.21.15.19:0/1915613067 >> 172.21.15.19:0/1915613067 conn(0x7efe5806ef20 msgr2=0x7efe58071360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:54.753 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.752+0000 7efe5f9af640 1 -- 172.21.15.19:0/1915613067 shutdown_connections 2024-09-19T09:01:54.753 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.752+0000 7efe5f9af640 1 -- 172.21.15.19:0/1915613067 wait complete. 2024-09-19T09:01:54.753 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.753+0000 7efe5f9af640 1 Processor -- start 2024-09-19T09:01:54.753 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.753+0000 7efe5f9af640 1 -- start start 2024-09-19T09:01:54.755 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.753+0000 7efe5f9af640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe58073730 0x7efe581a0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:54.755 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.753+0000 7efe5f9af640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe58109790 0x7efe581a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:54.755 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.753+0000 7efe5f9af640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe5810a150 0x7efe581a7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:54.755 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.753+0000 7efe5f9af640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7efe58116010 con 0x7efe58073730 2024-09-19T09:01:54.755 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.753+0000 7efe5f9af640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efe58115e90 con 0x7efe5810a150 2024-09-19T09:01:54.755 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.753+0000 7efe5f9af640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efe58116190 con 0x7efe58109790 2024-09-19T09:01:54.755 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.753+0000 7efe5d74b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe58073730 0x7efe581a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:54.755 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.753+0000 7efe5d74b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe58073730 0x7efe581a0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57010/0 (socket says 172.21.15.19:57010) 2024-09-19T09:01:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.753+0000 7efe5d74b640 1 -- 172.21.15.19:0/767663003 learned_addr learned my addr 172.21.15.19:0/767663003 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.753+0000 7efe5df4c640 1 --2- 172.21.15.19:0/767663003 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe5810a150 0x7efe581a7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.753+0000 7efe5cf4a640 1 --2- 172.21.15.19:0/767663003 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe58109790 0x7efe581a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.754+0000 7efe5d74b640 1 -- 172.21.15.19:0/767663003 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe58109790 msgr2=0x7efe581a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.754+0000 7efe5d74b640 1 --2- 172.21.15.19:0/767663003 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe58109790 0x7efe581a0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.754+0000 7efe5d74b640 1 -- 172.21.15.19:0/767663003 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe5810a150 msgr2=0x7efe581a7b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.754+0000 7efe5d74b640 1 --2- 172.21.15.19:0/767663003 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe5810a150 0x7efe581a7b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.754+0000 7efe5d74b640 1 -- 172.21.15.19:0/767663003 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe581a81a0 con 0x7efe58073730 2024-09-19T09:01:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.754+0000 7efe5d74b640 1 --2- 172.21.15.19:0/767663003 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe58073730 0x7efe581a0580 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7efe5400c970 tx=0x7efe5400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.754+0000 7efe4e7fc640 1 -- 172.21.15.19:0/767663003 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe54004220 con 0x7efe58073730 2024-09-19T09:01:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.754+0000 7efe4e7fc640 1 -- 172.21.15.19:0/767663003 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe540043c0 con 0x7efe58073730 2024-09-19T09:01:54.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.754+0000 7efe5f9af640 1 -- 172.21.15.19:0/767663003 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe581a8490 con 0x7efe58073730 2024-09-19T09:01:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.754+0000 7efe4e7fc640 1 -- 172.21.15.19:0/767663003 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe5400f450 con 0x7efe58073730 2024-09-19T09:01:54.757 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.754+0000 7efe5f9af640 1 -- 172.21.15.19:0/767663003 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe581a8a30 con 0x7efe58073730 2024-09-19T09:01:54.764 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.757+0000 7efe62823740 1 Processor -- start 2024-09-19T09:01:54.765 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.757+0000 7efe4e7fc640 1 -- 172.21.15.19:0/767663003 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7efe540079b0 con 0x7efe58073730 2024-09-19T09:01:54.765 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.757+0000 7efe62823740 1 -- start start 2024-09-19T09:01:54.765 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.758+0000 7efe62823740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e922b309a0 0x55e922b30da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:54.765 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.758+0000 7efe62823740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e922b312e0 0x55e922b35da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:54.765 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.758+0000 7efe62823740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e922b36370 0x55e922b38830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:54.766 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.758+0000 7efe62823740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e922a942f0 con 0x55e922b312e0 2024-09-19T09:01:54.766 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.758+0000 7efe62823740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55e922a3c270 con 0x55e922b309a0 2024-09-19T09:01:54.766 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.758+0000 7efe62823740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e922a902b0 con 0x55e922b36370 2024-09-19T09:01:54.766 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.758+0000 7efe5df4c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e922b309a0 0x55e922b30da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:54.766 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.758+0000 7efe5cf4a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e922b36370 0x55e922b38830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:54.766 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.758+0000 7efe5d74b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e922b312e0 0x55e922b35da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:54.766 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.758+0000 7efe5df4c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e922b309a0 0x55e922b30da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:56406/0 (socket says 172.21.15.19:56406) 2024-09-19T09:01:54.766 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.758+0000 7efe5cf4a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e922b36370 0x55e922b38830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:40126/0 (socket says 172.21.15.19:40126) 2024-09-19T09:01:54.766 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.758+0000 7efe5df4c640 1 -- 172.21.15.19:0/524428350 learned_addr learned my addr 172.21.15.19:0/524428350 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:54.766 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.758+0000 7efe5cf4a640 1 -- 172.21.15.19:0/524428350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e922b309a0 msgr2=0x55e922b30da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:54.766 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.758+0000 7efe5cf4a640 1 --2- 172.21.15.19:0/524428350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e922b309a0 0x55e922b30da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:54.766 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.758+0000 7efe5cf4a640 1 -- 172.21.15.19:0/524428350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e922b312e0 msgr2=0x55e922b35da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:54.766 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.758+0000 7efe5cf4a640 1 --2- 172.21.15.19:0/524428350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e922b312e0 0x55e922b35da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:54.767 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.758+0000 7efe5cf4a640 1 -- 172.21.15.19:0/524428350 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e922a3b340 con 0x55e922b36370 2024-09-19T09:01:54.767 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.758+0000 7efe4e7fc640 1 --2- 172.21.15.19:0/767663003 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7efe440a3370 0x7efe440a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:54.767 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.759+0000 7efe5cf4a640 1 --2- 172.21.15.19:0/524428350 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e922b36370 0x55e922b38830 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efe48005fd0 tx=0x7efe48011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2281ce98e63e6846 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:54.767 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.759+0000 7efe5df4c640 1 --2- 172.21.15.19:0/767663003 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7efe440a3370 0x7efe440a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:54.767 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.759+0000 7efe4e7fc640 1 -- 172.21.15.19:0/767663003 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7efe540cf5b0 con 0x7efe58073730 2024-09-19T09:01:54.767 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.759+0000 7efe437fe640 1 -- 172.21.15.19:0/524428350 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe4801e070 con 0x55e922b36370 2024-09-19T09:01:54.767 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.759+0000 7efe437fe640 1 -- 172.21.15.19:0/524428350 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe480035f0 con 0x55e922b36370 2024-09-19T09:01:54.767 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.759+0000 7efe437fe640 1 -- 172.21.15.19:0/524428350 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe48019690 con 0x55e922b36370 2024-09-19T09:01:54.767 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.760+0000 7efe62823740 1 -- 172.21.15.19:0/524428350 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e922b36370 msgr2=0x55e922b38830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:54.767 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.760+0000 7efe62823740 1 --2- 172.21.15.19:0/524428350 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e922b36370 0x55e922b38830 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efe48005fd0 tx=0x7efe48011810 comp rx=0 tx=0).stop 2024-09-19T09:01:54.767 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.760+0000 7efe5df4c640 1 --2- 172.21.15.19:0/767663003 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7efe440a3370 0x7efe440a5830 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7efe5002acb0 tx=0x7efe50005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:54.767 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.760+0000 7efe62823740 1 -- 172.21.15.19:0/524428350 shutdown_connections 2024-09-19T09:01:54.767 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.760+0000 7efe62823740 1 --2- 172.21.15.19:0/524428350 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e922b36370 0x55e922b38830 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:54.767 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.760+0000 7efe62823740 1 --2- 172.21.15.19:0/524428350 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e922b312e0 0x55e922b35da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.760+0000 7efe62823740 1 --2- 172.21.15.19:0/524428350 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e922b309a0 0x55e922b30da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.760+0000 7efe62823740 1 -- 172.21.15.19:0/524428350 >> 172.21.15.19:0/524428350 conn(0x55e922b2c010 msgr2=0x55e922b2c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.760+0000 7efe62823740 1 -- 172.21.15.19:0/524428350 shutdown_connections 2024-09-19T09:01:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.760+0000 7efe62823740 1 -- 172.21.15.19:0/524428350 wait complete. 2024-09-19T09:01:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.760+0000 7efe62823740 1 -- start start 2024-09-19T09:01:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.760+0000 7efe62823740 1 Processor -- start 2024-09-19T09:01:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.761+0000 7efe62823740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e922b309a0 0x55e922b3abe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.761+0000 7efe62823740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e922b312e0 0x55e922b3b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.761+0000 7efe62823740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e922b36370 0x55e922b42160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.761+0000 7efe62823740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e922b39390 con 0x55e922b36370 2024-09-19T09:01:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.761+0000 7efe62823740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55e922a1d290 con 0x55e922b309a0 2024-09-19T09:01:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.761+0000 7efe62823740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e922b39510 con 0x55e922b312e0 2024-09-19T09:01:54.768 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.761+0000 7efe5cf4a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e922b312e0 0x55e922b3b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.761+0000 7efe5cf4a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e922b312e0 0x55e922b3b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:40142/0 (socket says 172.21.15.19:40142) 2024-09-19T09:01:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.761+0000 7efe5cf4a640 1 -- 172.21.15.19:0/3125054793 learned_addr learned my addr 172.21.15.19:0/3125054793 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.761+0000 7efe5d74b640 1 --2- 172.21.15.19:0/3125054793 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e922b309a0 0x55e922b3abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.761+0000 7efe62823740 10 client.0 _ll_register_callbacks cb 0x55e922a4e140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.761+0000 7efe5df4c640 1 --2- 172.21.15.19:0/3125054793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e922b36370 0x55e922b42160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.761+0000 7efe5cf4a640 1 -- 172.21.15.19:0/3125054793 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e922b309a0 msgr2=0x55e922b3abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.761+0000 7efe5cf4a640 1 --2- 172.21.15.19:0/3125054793 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e922b309a0 0x55e922b3abe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.761+0000 7efe5cf4a640 1 -- 172.21.15.19:0/3125054793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e922b36370 msgr2=0x55e922b42160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.761+0000 7efe5cf4a640 1 --2- 172.21.15.19:0/3125054793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e922b36370 0x55e922b42160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.761+0000 7efe5cf4a640 1 -- 172.21.15.19:0/3125054793 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9227a7210 con 0x55e922b312e0 2024-09-19T09:01:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.761+0000 7efe5df4c640 1 --2- 172.21.15.19:0/3125054793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e922b36370 0x55e922b42160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:01:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.761+0000 7efe5cf4a640 1 --2- 172.21.15.19:0/3125054793 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e922b312e0 0x55e922b3b120 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efe48000c00 tx=0x7efe480039d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cad7892eedaf2b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.761+0000 7efe40ff9640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T09:01:54.769 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.761+0000 7efe40ff9640 1 -- 172.21.15.19:0/3125054793 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe4801e050 con 0x55e922b312e0 2024-09-19T09:01:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.761+0000 7efe40ff9640 1 -- 172.21.15.19:0/3125054793 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7efe48005250 con 0x55e922b312e0 2024-09-19T09:01:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.761+0000 7efe62823740 1 -- 172.21.15.19:0/3125054793 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe480035f0 con 0x55e922b312e0 2024-09-19T09:01:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.762+0000 7efe40ff9640 1 -- 172.21.15.19:0/3125054793 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7efe48005450 con 0x55e922b312e0 2024-09-19T09:01:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.762+0000 7efe62823740 10 client.27013 fetch_fsmap learned FSMap version 36 2024-09-19T09:01:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.762+0000 7efe62823740 1 -- 172.21.15.19:0/3125054793 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55e922873620 con 0x55e922b312e0 2024-09-19T09:01:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.762+0000 7efe40ff9640 1 -- 172.21.15.19:0/3125054793 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe480035f0 con 0x55e922b312e0 2024-09-19T09:01:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.762+0000 7efe40ff9640 1 -- 172.21.15.19:0/3125054793 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7efe48025450 con 0x55e922b312e0 2024-09-19T09:01:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.762+0000 7efe62823740 10 client.27013 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:01:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.762+0000 7efe62823740 10 client.27013 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:01:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.762+0000 7efe62823740 20 client.27013 populate_metadata read hostname 'smithi019' 2024-09-19T09:01:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.762+0000 7efe62823740 1 --2- 172.21.15.19:0/3125054793 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e922b465c0 0x55e922b489d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.762+0000 7efe62823740 4 client.27013 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:01:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.762+0000 7efe62823740 1 -- 172.21.15.19:0/3125054793 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e922aa1a20 con 0x55e922b465c0 2024-09-19T09:01:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.763+0000 7efe5d74b640 1 --2- 172.21.15.19:0/3125054793 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e922b465c0 0x55e922b489d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:54.770 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.763+0000 7efe40ff9640 10 client.27013 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:54.771 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.763+0000 7efe5d74b640 1 --2- 172.21.15.19:0/3125054793 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e922b465c0 0x55e922b489d0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d42938916be038ac server_cookie=9f6d43837f243d96 in_seq=0 out_seq=0 2024-09-19T09:01:54.772 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.768+0000 7efe40ff9640 1 -- 172.21.15.19:0/3125054793 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e922aa1a20 con 0x55e922b465c0 2024-09-19T09:01:54.772 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.768+0000 7efe40ff9640 10 client.27013 handle_command_reply: tid=0 2024-09-19T09:01:54.772 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.768+0000 7efe62823740 1 client.27013 shutdown 2024-09-19T09:01:54.772 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.768+0000 7efe62823740 1 -- 172.21.15.19:0/3125054793 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e922b312e0 msgr2=0x55e922b3b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:54.772 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.768+0000 7efe62823740 1 --2- 172.21.15.19:0/3125054793 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e922b312e0 0x55e922b3b120 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efe48000c00 tx=0x7efe480039d0 comp rx=0 tx=0).stop 2024-09-19T09:01:54.772 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.768+0000 7efe62823740 1 -- 172.21.15.19:0/3125054793 shutdown_connections 2024-09-19T09:01:54.772 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.768+0000 7efe62823740 1 --2- 172.21.15.19:0/3125054793 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e922b465c0 0x55e922b489d0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:54.772 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.768+0000 7efe62823740 1 --2- 172.21.15.19:0/3125054793 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e922b312e0 0x55e922b3b120 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:54.772 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.768+0000 7efe62823740 1 --2- 172.21.15.19:0/3125054793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e922b36370 0x55e922b42160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:54.772 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.768+0000 7efe62823740 1 --2- 172.21.15.19:0/3125054793 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e922b309a0 0x55e922b3abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:54.772 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.768+0000 7efe62823740 1 -- 172.21.15.19:0/3125054793 >> 172.21.15.19:0/3125054793 conn(0x55e922b2c010 msgr2=0x55e922b2d820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:54.772 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.768+0000 7efe40ff9640 0 client.27013 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:54.773 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.768+0000 7efe62823740 1 -- 172.21.15.19:0/3125054793 shutdown_connections 2024-09-19T09:01:54.773 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.768+0000 7efe62823740 1 -- 172.21.15.19:0/3125054793 wait complete. 2024-09-19T09:01:54.773 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.768+0000 7efe62823740 20 client.27013 trim_cache size 0 max 16384 2024-09-19T09:01:54.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.784+0000 7efe62823740 1 Processor -- start 2024-09-19T09:01:54.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.784+0000 7efe62823740 1 -- start start 2024-09-19T09:01:54.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.784+0000 7efe62823740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e922b309a0 0x55e922b30d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:54.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.784+0000 7efe62823740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e922b312e0 0x55e922b42120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:54.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.784+0000 7efe62823740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e922b36370 0x55e922b2c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:54.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.784+0000 7efe62823740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7efe581b17c0 con 0x55e922b309a0 2024-09-19T09:01:54.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.784+0000 7efe62823740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efe581b3300 con 0x55e922b312e0 2024-09-19T09:01:54.785 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.784+0000 7efe62823740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efe581b1e90 con 0x55e922b36370 2024-09-19T09:01:54.786 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.784+0000 7efe5d74b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e922b309a0 0x55e922b30d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:54.786 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.785+0000 7efe5cf4a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e922b312e0 0x55e922b42120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:54.786 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.785+0000 7efe5d74b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e922b309a0 0x55e922b30d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57034/0 (socket says 172.21.15.19:57034) 2024-09-19T09:01:54.786 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.785+0000 7efe5d74b640 1 -- 172.21.15.19:0/1637958507 learned_addr learned my addr 172.21.15.19:0/1637958507 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:54.786 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.785+0000 7efe5df4c640 1 --2- 172.21.15.19:0/1637958507 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e922b36370 0x55e922b2c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:54.786 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.785+0000 7efe5cf4a640 1 -- 172.21.15.19:0/1637958507 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e922b36370 msgr2=0x55e922b2c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:54.786 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.785+0000 7efe5cf4a640 1 --2- 172.21.15.19:0/1637958507 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e922b36370 0x55e922b2c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:54.786 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.785+0000 7efe5cf4a640 1 -- 172.21.15.19:0/1637958507 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e922b309a0 msgr2=0x55e922b30d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:54.786 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.785+0000 7efe5cf4a640 1 --2- 172.21.15.19:0/1637958507 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e922b309a0 0x55e922b30d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:54.786 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.785+0000 7efe5cf4a640 1 -- 172.21.15.19:0/1637958507 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e922b35740 con 0x55e922b312e0 2024-09-19T09:01:54.786 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.785+0000 7efe5d74b640 1 --2- 172.21.15.19:0/1637958507 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e922b309a0 0x55e922b30d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:54.786 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.785+0000 7efe5cf4a640 1 --2- 172.21.15.19:0/1637958507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e922b312e0 0x55e922b42120 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efe480259c0 tx=0x7efe48011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f71b2c9c55b6e4c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:54.786 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.785+0000 7efe42ffd640 1 -- 172.21.15.19:0/1637958507 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe4801e050 con 0x55e922b312e0 2024-09-19T09:01:54.786 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.785+0000 7efe42ffd640 1 -- 172.21.15.19:0/1637958507 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe4802a070 con 0x55e922b312e0 2024-09-19T09:01:54.787 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.785+0000 7efe42ffd640 1 -- 172.21.15.19:0/1637958507 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe48036080 con 0x55e922b312e0 2024-09-19T09:01:54.790 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.786+0000 7efe62823740 1 -- 172.21.15.19:0/1637958507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e922b312e0 msgr2=0x55e922b42120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:54.790 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.786+0000 7efe62823740 1 --2- 172.21.15.19:0/1637958507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e922b312e0 0x55e922b42120 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efe480259c0 tx=0x7efe48011810 comp rx=0 tx=0).stop 2024-09-19T09:01:54.790 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.786+0000 7efe62823740 1 -- 172.21.15.19:0/1637958507 shutdown_connections 2024-09-19T09:01:54.790 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.786+0000 7efe62823740 1 --2- 172.21.15.19:0/1637958507 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e922b36370 0x55e922b2c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:54.790 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.786+0000 7efe62823740 1 --2- 172.21.15.19:0/1637958507 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e922b312e0 0x55e922b42120 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:54.791 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.786+0000 7efe62823740 1 --2- 172.21.15.19:0/1637958507 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e922b309a0 0x55e922b30d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:54.791 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.786+0000 7efe62823740 1 -- 172.21.15.19:0/1637958507 >> 172.21.15.19:0/1637958507 conn(0x55e922b2c010 msgr2=0x55e922b3abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:54.791 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.786+0000 7efe62823740 1 -- 172.21.15.19:0/1637958507 shutdown_connections 2024-09-19T09:01:54.791 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.786+0000 7efe62823740 1 -- 172.21.15.19:0/1637958507 wait complete. 2024-09-19T09:01:54.791 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.786+0000 7efe62823740 1 -- start start 2024-09-19T09:01:54.791 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.787+0000 7efe62823740 1 Processor -- start 2024-09-19T09:01:54.791 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.787+0000 7efe62823740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e922b309a0 0x55e922b3f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:54.791 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.787+0000 7efe62823740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e922b312e0 0x55e922b3f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:54.791 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.787+0000 7efe62823740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e922b36370 0x55e922b40960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:54.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.787+0000 7efe62823740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7efe581b2c30 con 0x55e922b309a0 2024-09-19T09:01:54.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.787+0000 7efe62823740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efe581b2560 con 0x55e922b312e0 2024-09-19T09:01:54.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.787+0000 7efe62823740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efe581af7a0 con 0x55e922b36370 2024-09-19T09:01:54.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.787+0000 7efe62823740 10 client.0 _ll_register_callbacks cb 0x7efe4801c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:01:54.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.787+0000 7efe5d74b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e922b309a0 0x55e922b3f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:54.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.787+0000 7efe5d74b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e922b309a0 0x55e922b3f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57040/0 (socket says 172.21.15.19:57040) 2024-09-19T09:01:54.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.787+0000 7efe5cf4a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e922b312e0 0x55e922b3f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:54.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.787+0000 7efe5d74b640 1 -- 172.21.15.19:0/1911687060 learned_addr learned my addr 172.21.15.19:0/1911687060 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:01:54.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.787+0000 7efe5df4c640 1 --2- 172.21.15.19:0/1911687060 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e922b36370 0x55e922b40960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:54.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.787+0000 7efe5cf4a640 1 -- 172.21.15.19:0/1911687060 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e922b36370 msgr2=0x55e922b40960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:54.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.787+0000 7efe5cf4a640 1 --2- 172.21.15.19:0/1911687060 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e922b36370 0x55e922b40960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:54.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.787+0000 7efe5cf4a640 1 -- 172.21.15.19:0/1911687060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e922b309a0 msgr2=0x55e922b3f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:01:54.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.787+0000 7efe5cf4a640 1 --2- 172.21.15.19:0/1911687060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e922b309a0 0x55e922b3f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:54.792 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.787+0000 7efe5cf4a640 1 -- 172.21.15.19:0/1911687060 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e922b40f70 con 0x55e922b312e0 2024-09-19T09:01:54.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.788+0000 7efe5d74b640 1 --2- 172.21.15.19:0/1911687060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e922b309a0 0x55e922b3f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:01:54.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.788+0000 7efe5df4c640 1 --2- 172.21.15.19:0/1911687060 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e922b36370 0x55e922b40960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:01:54.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.788+0000 7efe5cf4a640 1 --2- 172.21.15.19:0/1911687060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e922b312e0 0x55e922b3f9a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efe48003fd0 tx=0x7efe48009440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d95ab65e3fa868c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:01:54.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.788+0000 7efe40ff9640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T09:01:54.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.788+0000 7efe40ff9640 1 -- 172.21.15.19:0/1911687060 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe48036030 con 0x55e922b312e0 2024-09-19T09:01:54.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.788+0000 7efe62823740 1 -- 172.21.15.19:0/1911687060 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efe4802a070 con 0x55e922b312e0 2024-09-19T09:01:54.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.788+0000 7efe40ff9640 1 -- 172.21.15.19:0/1911687060 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7efe48003be0 con 0x55e922b312e0 2024-09-19T09:01:54.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.788+0000 7efe40ff9640 1 -- 172.21.15.19:0/1911687060 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7efe4801e040 con 0x55e922b312e0 2024-09-19T09:01:54.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.788+0000 7efe62823740 10 client.27146 fetch_fsmap learned FSMap version 36 2024-09-19T09:01:54.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.788+0000 7efe62823740 1 -- 172.21.15.19:0/1911687060 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55e922b42280 con 0x55e922b312e0 2024-09-19T09:01:54.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.788+0000 7efe40ff9640 1 -- 172.21.15.19:0/1911687060 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efe4802a070 con 0x55e922b312e0 2024-09-19T09:01:54.793 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.788+0000 7efe40ff9640 1 -- 172.21.15.19:0/1911687060 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 36) ==== 8362+0+0 (secure 0 0 0) 0x7efe48031cc0 con 0x55e922b312e0 2024-09-19T09:01:54.796 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.789+0000 7efe62823740 10 client.27146 fetch_fsmap finished waiting for FSMap version 36 2024-09-19T09:01:54.796 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.789+0000 7efe62823740 10 client.27146 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:01:54.796 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.789+0000 7efe62823740 20 client.27146 populate_metadata read hostname 'smithi019' 2024-09-19T09:01:54.797 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.789+0000 7efe62823740 1 --2- 172.21.15.19:0/1911687060 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e922bb16e0 0x55e922bb3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:01:54.797 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.789+0000 7efe62823740 4 client.27146 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:01:54.797 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.789+0000 7efe62823740 1 -- 172.21.15.19:0/1911687060 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e922a9bd70 con 0x55e922bb16e0 2024-09-19T09:01:54.797 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.789+0000 7efe5d74b640 1 --2- 172.21.15.19:0/1911687060 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e922bb16e0 0x55e922bb3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:01:54.797 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.790+0000 7efe5d74b640 1 --2- 172.21.15.19:0/1911687060 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e922bb16e0 0x55e922bb3ad0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eedf3101c29bb617 server_cookie=6af4a9919d802e83 in_seq=0 out_seq=0 2024-09-19T09:01:54.797 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:54.790+0000 7efe40ff9640 10 client.27146 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:55.068 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:01:54 smithi019 podman[187307]: 2024-09-19 09:01:54.647054464 +0000 UTC m=+0.375539757 container init 1afde72a9cfd38a1b12175a1b7c7c9311e7a2aecbcb90b709733f644488fc762 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-g, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-19T09:01:55.069 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:01:54 smithi019 podman[187307]: 2024-09-19 09:01:54.652387648 +0000 UTC m=+0.380872932 container start 1afde72a9cfd38a1b12175a1b7c7c9311e7a2aecbcb90b709733f644488fc762 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-g, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-19T09:01:55.069 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:01:54 smithi019 bash[187307]: 1afde72a9cfd38a1b12175a1b7c7c9311e7a2aecbcb90b709733f644488fc762 2024-09-19T09:01:55.069 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:01:54 smithi019 systemd[1]: Started Ceph mds.g for f26c9d84-7662-11ef-bceb-c7b262605968. 2024-09-19T09:01:55.069 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:01:54 smithi019 ceph-mds[187457]: -- 172.21.15.19:0/240898757 <== mon.0 v2:172.21.15.19:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b273275860 con 0x55b273252800 2024-09-19T09:01:55.069 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:01:54 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-g[187420]: starting mds.g at 2024-09-19T09:01:55.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:55 smithi019 ceph-mon[30976]: pgmap v628: 97 pgs: 97 active+clean; 24 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 1.5 MiB/s wr, 426 op/s 2024-09-19T09:01:55.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:55 smithi019 ceph-mon[30976]: daemon mds.g restarted 2024-09-19T09:01:55.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:55 smithi019 ceph-mon[30976]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T09:01:55.820 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:55 smithi019 ceph-mon[30976]: mds.? [v2:172.21.15.19:6838/785412263,v1:172.21.15.19:6839/785412263] up:boot 2024-09-19T09:01:55.820 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:55 smithi019 ceph-mon[30976]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:01:55.820 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:55 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:01:55.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:55 smithi155 ceph-mon[34921]: pgmap v628: 97 pgs: 97 active+clean; 24 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 1.5 MiB/s wr, 426 op/s 2024-09-19T09:01:55.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:55 smithi155 ceph-mon[34921]: daemon mds.g restarted 2024-09-19T09:01:55.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:55 smithi155 ceph-mon[34921]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T09:01:55.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:55 smithi155 ceph-mon[34921]: mds.? [v2:172.21.15.19:6838/785412263,v1:172.21.15.19:6839/785412263] up:boot 2024-09-19T09:01:55.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:55 smithi155 ceph-mon[34921]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:01:55.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:55 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:01:55.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:55 smithi203 ceph-mon[35450]: pgmap v628: 97 pgs: 97 active+clean; 24 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 1.5 MiB/s wr, 426 op/s 2024-09-19T09:01:55.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:55 smithi203 ceph-mon[35450]: daemon mds.g restarted 2024-09-19T09:01:55.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:55 smithi203 ceph-mon[35450]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T09:01:55.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:55 smithi203 ceph-mon[35450]: mds.? [v2:172.21.15.19:6838/785412263,v1:172.21.15.19:6839/785412263] up:boot 2024-09-19T09:01:55.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:55 smithi203 ceph-mon[35450]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:01:55.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:55 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:01:57.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:57 smithi019 ceph-mon[30976]: pgmap v630: 97 pgs: 97 active+clean; 27 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.1 MiB/s wr, 410 op/s 2024-09-19T09:01:57.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:57 smithi155 ceph-mon[34921]: pgmap v630: 97 pgs: 97 active+clean; 27 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.1 MiB/s wr, 410 op/s 2024-09-19T09:01:57.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:57 smithi203 ceph-mon[35450]: pgmap v630: 97 pgs: 97 active+clean; 27 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.1 MiB/s wr, 410 op/s 2024-09-19T09:01:59.698 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:59.696+0000 7efe40ff9640 1 -- 172.21.15.19:0/1911687060 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e922a9bd70 con 0x55e922bb16e0 2024-09-19T09:01:59.698 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:59.696+0000 7efe40ff9640 10 client.27146 handle_command_reply: tid=0 2024-09-19T09:01:59.698 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:59.696+0000 7efe62823740 1 client.27146 shutdown 2024-09-19T09:01:59.698 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:59.697+0000 7efe62823740 1 -- 172.21.15.19:0/1911687060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e922b312e0 msgr2=0x55e922b3f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:59.698 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:59.697+0000 7efe62823740 1 --2- 172.21.15.19:0/1911687060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e922b312e0 0x55e922b3f9a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7efe48003fd0 tx=0x7efe48009440 comp rx=0 tx=0).stop 2024-09-19T09:01:59.698 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:59.697+0000 7efe62823740 1 -- 172.21.15.19:0/1911687060 shutdown_connections 2024-09-19T09:01:59.698 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:59.697+0000 7efe62823740 1 --2- 172.21.15.19:0/1911687060 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e922bb16e0 0x55e922bb3ad0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:59.699 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:59.697+0000 7efe62823740 1 --2- 172.21.15.19:0/1911687060 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e922b36370 0x55e922b40960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:59.699 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:59.697+0000 7efe62823740 1 --2- 172.21.15.19:0/1911687060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e922b312e0 0x55e922b3f9a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:59.699 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:59.697+0000 7efe62823740 1 --2- 172.21.15.19:0/1911687060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e922b309a0 0x55e922b3f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:59.699 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:59.697+0000 7efe62823740 1 -- 172.21.15.19:0/1911687060 >> 172.21.15.19:0/1911687060 conn(0x55e922b2c010 msgr2=0x55e922b2a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:59.699 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:59.697+0000 7efe40ff9640 0 client.27146 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:01:59.699 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:59.697+0000 7efe62823740 1 -- 172.21.15.19:0/1911687060 shutdown_connections 2024-09-19T09:01:59.699 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:59.697+0000 7efe62823740 1 -- 172.21.15.19:0/1911687060 wait complete. 2024-09-19T09:01:59.699 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:59.697+0000 7efe62823740 20 client.27146 trim_cache size 0 max 16384 2024-09-19T09:01:59.699 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T09:01:59.699 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T09:01:59.700 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T09:01:59.700 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T09:01:59.700 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:59.697+0000 7efe5f9af640 1 -- 172.21.15.19:0/767663003 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7efe440a3370 msgr2=0x7efe440a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:59.700 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:59.698+0000 7efe5f9af640 1 --2- 172.21.15.19:0/767663003 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7efe440a3370 0x7efe440a5830 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7efe5002acb0 tx=0x7efe50005fd0 comp rx=0 tx=0).stop 2024-09-19T09:01:59.700 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:59.698+0000 7efe5f9af640 1 -- 172.21.15.19:0/767663003 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe58073730 msgr2=0x7efe581a0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:01:59.701 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:59.698+0000 7efe5f9af640 1 --2- 172.21.15.19:0/767663003 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe58073730 0x7efe581a0580 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7efe5400c970 tx=0x7efe5400cd70 comp rx=0 tx=0).stop 2024-09-19T09:01:59.701 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:59.698+0000 7efe5f9af640 1 -- 172.21.15.19:0/767663003 shutdown_connections 2024-09-19T09:01:59.701 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:59.698+0000 7efe5f9af640 1 --2- 172.21.15.19:0/767663003 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7efe440a3370 0x7efe440a5830 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:59.701 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:59.698+0000 7efe5f9af640 1 --2- 172.21.15.19:0/767663003 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efe58109790 0x7efe581a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:59.701 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:59.698+0000 7efe5f9af640 1 --2- 172.21.15.19:0/767663003 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efe5810a150 0x7efe581a7b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:59.701 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:59.698+0000 7efe5f9af640 1 --2- 172.21.15.19:0/767663003 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efe58073730 0x7efe581a0580 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:01:59.701 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:59.698+0000 7efe5f9af640 1 -- 172.21.15.19:0/767663003 >> 172.21.15.19:0/767663003 conn(0x7efe5806ef20 msgr2=0x7efe5810ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:01:59.701 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:59.698+0000 7efe5f9af640 1 -- 172.21.15.19:0/767663003 shutdown_connections 2024-09-19T09:01:59.701 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:01:59.698+0000 7efe5f9af640 1 -- 172.21.15.19:0/767663003 wait complete. 2024-09-19T09:01:59.914 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:01:59 smithi019 ceph-mon[30976]: pgmap v631: 97 pgs: 97 active+clean; 27 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.1 MiB/s wr, 418 op/s 2024-09-19T09:01:59.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:01:59 smithi155 ceph-mon[34921]: pgmap v631: 97 pgs: 97 active+clean; 27 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.1 MiB/s wr, 418 op/s 2024-09-19T09:01:59.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:01:59 smithi203 ceph-mon[35450]: pgmap v631: 97 pgs: 97 active+clean; 27 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 1.1 MiB/s wr, 418 op/s 2024-09-19T09:02:01.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:01 smithi155 ceph-mon[34921]: pgmap v632: 97 pgs: 97 active+clean; 30 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.4 MiB/s wr, 432 op/s 2024-09-19T09:02:01.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:01 smithi203 ceph-mon[35450]: pgmap v632: 97 pgs: 97 active+clean; 30 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.4 MiB/s wr, 432 op/s 2024-09-19T09:02:02.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:01 smithi019 ceph-mon[30976]: pgmap v632: 97 pgs: 97 active+clean; 30 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 1.4 MiB/s wr, 432 op/s 2024-09-19T09:02:03.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:03 smithi155 ceph-mon[34921]: pgmap v633: 97 pgs: 97 active+clean; 18 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.2 MiB/s wr, 524 op/s 2024-09-19T09:02:03.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:03 smithi203 ceph-mon[35450]: pgmap v633: 97 pgs: 97 active+clean; 18 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.2 MiB/s wr, 524 op/s 2024-09-19T09:02:04.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:03 smithi019 ceph-mon[30976]: pgmap v633: 97 pgs: 97 active+clean; 18 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.2 MiB/s wr, 524 op/s 2024-09-19T09:02:05.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:05 smithi155 ceph-mon[34921]: pgmap v634: 97 pgs: 97 active+clean; 15 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 1.5 MiB/s wr, 572 op/s 2024-09-19T09:02:05.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:05 smithi203 ceph-mon[35450]: pgmap v634: 97 pgs: 97 active+clean; 15 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 1.5 MiB/s wr, 572 op/s 2024-09-19T09:02:06.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:05 smithi019 ceph-mon[30976]: pgmap v634: 97 pgs: 97 active+clean; 15 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 1.5 MiB/s wr, 572 op/s 2024-09-19T09:02:07.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:07 smithi155 ceph-mon[34921]: pgmap v635: 97 pgs: 97 active+clean; 17 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.6 MiB/s wr, 590 op/s 2024-09-19T09:02:07.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:07 smithi203 ceph-mon[35450]: pgmap v635: 97 pgs: 97 active+clean; 17 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.6 MiB/s wr, 590 op/s 2024-09-19T09:02:08.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:07 smithi019 ceph-mon[30976]: pgmap v635: 97 pgs: 97 active+clean; 17 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 1.6 MiB/s wr, 590 op/s 2024-09-19T09:02:09.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:09 smithi155 ceph-mon[34921]: pgmap v636: 97 pgs: 97 active+clean; 18 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 528 op/s 2024-09-19T09:02:09.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:09 smithi203 ceph-mon[35450]: pgmap v636: 97 pgs: 97 active+clean; 18 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 528 op/s 2024-09-19T09:02:10.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:09 smithi019 ceph-mon[30976]: pgmap v636: 97 pgs: 97 active+clean; 18 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.3 MiB/s wr, 528 op/s 2024-09-19T09:02:11.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:11 smithi155 ceph-mon[34921]: pgmap v637: 97 pgs: 97 active+clean; 18 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 453 op/s 2024-09-19T09:02:11.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:11 smithi203 ceph-mon[35450]: pgmap v637: 97 pgs: 97 active+clean; 18 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 453 op/s 2024-09-19T09:02:12.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:11 smithi019 ceph-mon[30976]: pgmap v637: 97 pgs: 97 active+clean; 18 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 453 op/s 2024-09-19T09:02:12.797 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.796+0000 7fd6dc9fd640 1 -- 172.21.15.19:0/3685296693 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6d8104ef0 msgr2=0x7fd6d81072e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:12.797 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.796+0000 7fd6dc9fd640 1 --2- 172.21.15.19:0/3685296693 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6d8104ef0 0x7fd6d81072e0 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc009900 tx=0x7fd6cc02a410 comp rx=0 tx=0).stop 2024-09-19T09:02:12.797 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.796+0000 7fd6dc9fd640 1 -- 172.21.15.19:0/3685296693 shutdown_connections 2024-09-19T09:02:12.798 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.796+0000 7fd6dc9fd640 1 --2- 172.21.15.19:0/3685296693 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd6d8107820 0x7fd6d8109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:12.798 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.796+0000 7fd6dc9fd640 1 --2- 172.21.15.19:0/3685296693 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6d8104ef0 0x7fd6d81072e0 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:12.798 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.796+0000 7fd6dc9fd640 1 --2- 172.21.15.19:0/3685296693 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6d81025c0 0x7fd6d81049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:12.798 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.796+0000 7fd6dc9fd640 1 -- 172.21.15.19:0/3685296693 >> 172.21.15.19:0/3685296693 conn(0x7fd6d80fc1e0 msgr2=0x7fd6d80fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:12.798 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.796+0000 7fd6dc9fd640 1 -- 172.21.15.19:0/3685296693 shutdown_connections 2024-09-19T09:02:12.798 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.796+0000 7fd6dc9fd640 1 -- 172.21.15.19:0/3685296693 wait complete. 2024-09-19T09:02:12.801 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.797+0000 7fd6dc9fd640 1 Processor -- start 2024-09-19T09:02:12.801 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.797+0000 7fd6dc9fd640 1 -- start start 2024-09-19T09:02:12.801 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.798+0000 7fd6dc9fd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6d81025c0 0x7fd6d8101f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:12.801 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.798+0000 7fd6dc9fd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd6d8104ef0 0x7fd6d8100570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:12.801 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.798+0000 7fd6dc9fd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6d8107820 0x7fd6d8100ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:12.801 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.798+0000 7fd6dc9fd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d810d7d0 con 0x7fd6d8107820 2024-09-19T09:02:12.801 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.798+0000 7fd6dc9fd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d810d650 con 0x7fd6d81025c0 2024-09-19T09:02:12.801 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.798+0000 7fd6dc9fd640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d810d950 con 0x7fd6d8104ef0 2024-09-19T09:02:12.801 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.798+0000 7fd6d659c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6d81025c0 0x7fd6d8101f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:12.802 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.798+0000 7fd6d659c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6d81025c0 0x7fd6d8101f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:52076/0 (socket says 172.21.15.19:52076) 2024-09-19T09:02:12.802 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.798+0000 7fd6d659c640 1 -- 172.21.15.19:0/1689848246 learned_addr learned my addr 172.21.15.19:0/1689848246 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:02:12.802 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.798+0000 7fd6d6d9d640 1 --2- 172.21.15.19:0/1689848246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6d8107820 0x7fd6d8100ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:12.802 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.798+0000 7fd6d5d9b640 1 --2- 172.21.15.19:0/1689848246 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd6d8104ef0 0x7fd6d8100570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:12.802 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.798+0000 7fd6d659c640 1 -- 172.21.15.19:0/1689848246 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd6d8104ef0 msgr2=0x7fd6d8100570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:12.802 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.798+0000 7fd6d659c640 1 --2- 172.21.15.19:0/1689848246 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd6d8104ef0 0x7fd6d8100570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:12.802 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.798+0000 7fd6d659c640 1 -- 172.21.15.19:0/1689848246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6d8107820 msgr2=0x7fd6d8100ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:12.802 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.798+0000 7fd6d659c640 1 --2- 172.21.15.19:0/1689848246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6d8107820 0x7fd6d8100ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:12.802 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.798+0000 7fd6d659c640 1 -- 172.21.15.19:0/1689848246 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d8101340 con 0x7fd6d81025c0 2024-09-19T09:02:12.802 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.798+0000 7fd6d5d9b640 1 --2- 172.21.15.19:0/1689848246 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd6d8104ef0 0x7fd6d8100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:02:12.802 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.799+0000 7fd6d659c640 1 --2- 172.21.15.19:0/1689848246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6d81025c0 0x7fd6d8101f30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd6c800e9f0 tx=0x7fd6c800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:12.803 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.799+0000 7fd6c77fe640 1 -- 172.21.15.19:0/1689848246 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c800cd80 con 0x7fd6d81025c0 2024-09-19T09:02:12.803 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.799+0000 7fd6c77fe640 1 -- 172.21.15.19:0/1689848246 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6c8010910 con 0x7fd6d81025c0 2024-09-19T09:02:12.803 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.799+0000 7fd6dc9fd640 1 -- 172.21.15.19:0/1689848246 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6d81a1f70 con 0x7fd6d81025c0 2024-09-19T09:02:12.803 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.799+0000 7fd6c77fe640 1 -- 172.21.15.19:0/1689848246 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8018990 con 0x7fd6d81025c0 2024-09-19T09:02:12.803 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.799+0000 7fd6dc9fd640 1 -- 172.21.15.19:0/1689848246 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6d81a23d0 con 0x7fd6d81025c0 2024-09-19T09:02:12.809 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.802+0000 7fd6c77fe640 1 -- 172.21.15.19:0/1689848246 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fd6c8010ac0 con 0x7fd6d81025c0 2024-09-19T09:02:12.809 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.802+0000 7fd6df881740 1 Processor -- start 2024-09-19T09:02:12.809 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.803+0000 7fd6df881740 1 -- start start 2024-09-19T09:02:12.809 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.803+0000 7fd6c77fe640 1 --2- 172.21.15.19:0/1689848246 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd6c00a3370 0x7fd6c00a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:12.810 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.803+0000 7fd6df881740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ac76fdb9a0 0x55ac76fdbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:12.810 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.803+0000 7fd6df881740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ac76fdc2e0 0x55ac76fe0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:12.810 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.803+0000 7fd6df881740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac76fe1370 0x55ac76fe3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:12.810 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.803+0000 7fd6df881740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ac76f3f2f0 con 0x55ac76fdc2e0 2024-09-19T09:02:12.810 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.803+0000 7fd6df881740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55ac76ee7270 con 0x55ac76fdb9a0 2024-09-19T09:02:12.810 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.803+0000 7fd6df881740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ac76f3b2b0 con 0x55ac76fe1370 2024-09-19T09:02:12.810 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.803+0000 7fd6c77fe640 1 -- 172.21.15.19:0/1689848246 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fd6c80cfb90 con 0x7fd6d81025c0 2024-09-19T09:02:12.810 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.803+0000 7fd6d6d9d640 1 --2- 172.21.15.19:0/1689848246 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd6c00a3370 0x7fd6c00a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:12.810 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.803+0000 7fd6d659c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ac76fdb9a0 0x55ac76fdbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:12.810 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.803+0000 7fd6d5d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ac76fdc2e0 0x55ac76fe0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:12.810 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.803+0000 7fd6d659c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ac76fdb9a0 0x55ac76fdbda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:52092/0 (socket says 172.21.15.19:52092) 2024-09-19T09:02:12.811 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.803+0000 7fd6d659c640 1 -- 172.21.15.19:0/4001922198 learned_addr learned my addr 172.21.15.19:0/4001922198 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:02:12.811 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.803+0000 7fd6d659c640 1 -- 172.21.15.19:0/4001922198 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac76fe1370 msgr2=0x55ac76fe3830 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:02:12.811 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.803+0000 7fd6d659c640 1 --2- 172.21.15.19:0/4001922198 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac76fe1370 0x55ac76fe3830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:12.811 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.803+0000 7fd6d659c640 1 -- 172.21.15.19:0/4001922198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ac76fdc2e0 msgr2=0x55ac76fe0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:12.811 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.803+0000 7fd6d659c640 1 --2- 172.21.15.19:0/4001922198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ac76fdc2e0 0x55ac76fe0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:12.811 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.803+0000 7fd6d659c640 1 -- 172.21.15.19:0/4001922198 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac76ee6340 con 0x55ac76fdb9a0 2024-09-19T09:02:12.811 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.804+0000 7fd6d659c640 1 --2- 172.21.15.19:0/4001922198 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ac76fdb9a0 0x55ac76fdbda0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8098670 tx=0x7fd6c8011e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57ea317fc1082fc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:12.811 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.804+0000 7fd6d6d9d640 1 --2- 172.21.15.19:0/1689848246 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd6c00a3370 0x7fd6c00a5830 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd6d806a980 tx=0x7fd6d0009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:12.811 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.804+0000 7fd6c4ff9640 1 -- 172.21.15.19:0/4001922198 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c80a4dd0 con 0x55ac76fdb9a0 2024-09-19T09:02:12.811 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.804+0000 7fd6c4ff9640 1 -- 172.21.15.19:0/4001922198 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6c809a510 con 0x55ac76fdb9a0 2024-09-19T09:02:12.811 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.804+0000 7fd6c4ff9640 1 -- 172.21.15.19:0/4001922198 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c80a0170 con 0x55ac76fdb9a0 2024-09-19T09:02:12.812 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.804+0000 7fd6df881740 1 -- 172.21.15.19:0/4001922198 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ac76fdb9a0 msgr2=0x55ac76fdbda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:12.812 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.804+0000 7fd6df881740 1 --2- 172.21.15.19:0/4001922198 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ac76fdb9a0 0x55ac76fdbda0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8098670 tx=0x7fd6c8011e20 comp rx=0 tx=0).stop 2024-09-19T09:02:12.812 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.805+0000 7fd6df881740 1 -- 172.21.15.19:0/4001922198 shutdown_connections 2024-09-19T09:02:12.812 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.805+0000 7fd6df881740 1 --2- 172.21.15.19:0/4001922198 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac76fe1370 0x55ac76fe3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:12.812 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.805+0000 7fd6df881740 1 --2- 172.21.15.19:0/4001922198 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ac76fdc2e0 0x55ac76fe0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:12.812 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.805+0000 7fd6df881740 1 --2- 172.21.15.19:0/4001922198 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ac76fdb9a0 0x55ac76fdbda0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:12.812 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.805+0000 7fd6df881740 1 -- 172.21.15.19:0/4001922198 >> 172.21.15.19:0/4001922198 conn(0x55ac76fd7010 msgr2=0x55ac76fd7410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:12.812 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.805+0000 7fd6df881740 1 -- 172.21.15.19:0/4001922198 shutdown_connections 2024-09-19T09:02:12.812 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.805+0000 7fd6df881740 1 -- 172.21.15.19:0/4001922198 wait complete. 2024-09-19T09:02:12.812 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.805+0000 7fd6df881740 1 -- start start 2024-09-19T09:02:12.812 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.805+0000 7fd6df881740 1 Processor -- start 2024-09-19T09:02:12.812 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.805+0000 7fd6df881740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac76fdb9a0 0x55ac76fe5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:12.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.805+0000 7fd6df881740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ac76fdc2e0 0x55ac76fe6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:12.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.805+0000 7fd6df881740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ac76fe1370 0x55ac76fed0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:12.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.805+0000 7fd6df881740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ac76fe4280 con 0x55ac76fdc2e0 2024-09-19T09:02:12.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.805+0000 7fd6df881740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55ac76ec8290 con 0x55ac76fe1370 2024-09-19T09:02:12.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.805+0000 7fd6df881740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ac76fe4400 con 0x55ac76fdb9a0 2024-09-19T09:02:12.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.805+0000 7fd6df881740 10 client.0 _ll_register_callbacks cb 0x55ac76ef9140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:12.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.805+0000 7fd6d5d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ac76fdc2e0 0x55ac76fe6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:12.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.805+0000 7fd6d6d9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ac76fe1370 0x55ac76fed0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:12.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.805+0000 7fd6d5d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ac76fdc2e0 0x55ac76fe6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47168/0 (socket says 172.21.15.19:47168) 2024-09-19T09:02:12.813 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.805+0000 7fd6d5d9b640 1 -- 172.21.15.19:0/1138184163 learned_addr learned my addr 172.21.15.19:0/1138184163 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:02:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.805+0000 7fd6d659c640 1 --2- 172.21.15.19:0/1138184163 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac76fdb9a0 0x55ac76fe5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.806+0000 7fd6d5d9b640 1 -- 172.21.15.19:0/1138184163 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac76fdb9a0 msgr2=0x55ac76fe5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.806+0000 7fd6d5d9b640 1 --2- 172.21.15.19:0/1138184163 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac76fdb9a0 0x55ac76fe5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.806+0000 7fd6d5d9b640 1 -- 172.21.15.19:0/1138184163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ac76fe1370 msgr2=0x55ac76fed0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.806+0000 7fd6d5d9b640 1 --2- 172.21.15.19:0/1138184163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ac76fe1370 0x55ac76fed0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.806+0000 7fd6d5d9b640 1 -- 172.21.15.19:0/1138184163 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac76c52210 con 0x55ac76fdc2e0 2024-09-19T09:02:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.806+0000 7fd6d6d9d640 1 --2- 172.21.15.19:0/1138184163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ac76fe1370 0x55ac76fed0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:02:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.806+0000 7fd6d5d9b640 1 --2- 172.21.15.19:0/1138184163 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ac76fdc2e0 0x55ac76fe6110 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc031610 tx=0x7fd6cc031a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31df88e4cdab77a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.806+0000 7fd6bdffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:02:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.806+0000 7fd6bdffb640 1 -- 172.21.15.19:0/1138184163 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc035040 con 0x55ac76fdc2e0 2024-09-19T09:02:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.806+0000 7fd6bdffb640 1 -- 172.21.15.19:0/1138184163 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fd6cc004240 con 0x55ac76fdc2e0 2024-09-19T09:02:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.806+0000 7fd6df881740 1 -- 172.21.15.19:0/1138184163 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6c809a510 con 0x55ac76fdc2e0 2024-09-19T09:02:12.815 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.806+0000 7fd6bdffb640 1 -- 172.21.15.19:0/1138184163 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fd6cc004440 con 0x55ac76fdc2e0 2024-09-19T09:02:12.815 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.806+0000 7fd6df881740 10 client.17703 fetch_fsmap learned FSMap version 37 2024-09-19T09:02:12.815 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.806+0000 7fd6df881740 1 -- 172.21.15.19:0/1138184163 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55ac76d1e620 con 0x55ac76fdc2e0 2024-09-19T09:02:12.815 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.807+0000 7fd6bdffb640 1 -- 172.21.15.19:0/1138184163 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6c809a510 con 0x55ac76fdc2e0 2024-09-19T09:02:12.815 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.807+0000 7fd6bdffb640 1 -- 172.21.15.19:0/1138184163 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7fd6cc0035f0 con 0x55ac76fdc2e0 2024-09-19T09:02:12.815 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.807+0000 7fd6df881740 10 client.17703 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:02:12.815 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.807+0000 7fd6df881740 10 client.17703 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:02:12.815 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.807+0000 7fd6df881740 20 client.17703 populate_metadata read hostname 'smithi019' 2024-09-19T09:02:12.815 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.807+0000 7fd6df881740 1 --2- 172.21.15.19:0/1138184163 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ac76ff17d0 0x55ac76ff3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:12.815 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.807+0000 7fd6df881740 4 client.17703 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:02:12.815 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.807+0000 7fd6df881740 1 -- 172.21.15.19:0/1138184163 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac76f4ca20 con 0x55ac76ff17d0 2024-09-19T09:02:12.815 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.807+0000 7fd6d659c640 1 --2- 172.21.15.19:0/1138184163 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ac76ff17d0 0x55ac76ff3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:12.816 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.807+0000 7fd6d659c640 1 --2- 172.21.15.19:0/1138184163 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ac76ff17d0 0x55ac76ff3be0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7135a1432b2fe59 server_cookie=d4f027d571d12f20 in_seq=0 out_seq=0 2024-09-19T09:02:12.816 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.807+0000 7fd6bdffb640 10 client.17703 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:02:12.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.811+0000 7fd6bdffb640 1 -- 172.21.15.19:0/1138184163 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ac76f4ca20 con 0x55ac76ff17d0 2024-09-19T09:02:12.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.811+0000 7fd6bdffb640 10 client.17703 handle_command_reply: tid=0 2024-09-19T09:02:12.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.812+0000 7fd6df881740 1 client.17703 shutdown 2024-09-19T09:02:12.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.812+0000 7fd6df881740 1 -- 172.21.15.19:0/1138184163 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ac76fdc2e0 msgr2=0x55ac76fe6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:12.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.812+0000 7fd6df881740 1 --2- 172.21.15.19:0/1138184163 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ac76fdc2e0 0x55ac76fe6110 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc031610 tx=0x7fd6cc031a20 comp rx=0 tx=0).stop 2024-09-19T09:02:12.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.812+0000 7fd6df881740 1 -- 172.21.15.19:0/1138184163 shutdown_connections 2024-09-19T09:02:12.817 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.812+0000 7fd6df881740 1 --2- 172.21.15.19:0/1138184163 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ac76ff17d0 0x55ac76ff3be0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.812+0000 7fd6df881740 1 --2- 172.21.15.19:0/1138184163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ac76fe1370 0x55ac76fed0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.812+0000 7fd6bdffb640 0 client.17703 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:02:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.812+0000 7fd6df881740 1 --2- 172.21.15.19:0/1138184163 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ac76fdc2e0 0x55ac76fe6110 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.812+0000 7fd6df881740 1 --2- 172.21.15.19:0/1138184163 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac76fdb9a0 0x55ac76fe5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.812+0000 7fd6df881740 1 -- 172.21.15.19:0/1138184163 >> 172.21.15.19:0/1138184163 conn(0x55ac76fd7010 msgr2=0x55ac76fd8820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.812+0000 7fd6df881740 1 -- 172.21.15.19:0/1138184163 shutdown_connections 2024-09-19T09:02:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.812+0000 7fd6df881740 1 -- 172.21.15.19:0/1138184163 wait complete. 2024-09-19T09:02:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.812+0000 7fd6df881740 20 client.17703 trim_cache size 0 max 16384 2024-09-19T09:02:12.832 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.827+0000 7fd6df881740 1 Processor -- start 2024-09-19T09:02:12.832 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.827+0000 7fd6df881740 1 -- start start 2024-09-19T09:02:12.833 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.827+0000 7fd6df881740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac76fdb9a0 0x55ac76ff3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:12.833 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.827+0000 7fd6df881740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ac76fdc2e0 0x55ac76fed0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:12.833 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.827+0000 7fd6df881740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ac76fe1370 0x55ac76fd8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:12.833 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.827+0000 7fd6df881740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d81ab250 con 0x55ac76fdc2e0 2024-09-19T09:02:12.833 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.827+0000 7fd6df881740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d81acd90 con 0x55ac76fe1370 2024-09-19T09:02:12.833 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.827+0000 7fd6df881740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d81ab920 con 0x55ac76fdb9a0 2024-09-19T09:02:12.833 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.827+0000 7fd6d5d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ac76fdc2e0 0x55ac76fed0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:12.833 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.827+0000 7fd6d5d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ac76fdc2e0 0x55ac76fed0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47178/0 (socket says 172.21.15.19:47178) 2024-09-19T09:02:12.833 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.827+0000 7fd6d5d9b640 1 -- 172.21.15.19:0/1481094936 learned_addr learned my addr 172.21.15.19:0/1481094936 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:02:12.833 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.827+0000 7fd6d659c640 1 --2- 172.21.15.19:0/1481094936 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac76fdb9a0 0x55ac76ff3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:12.833 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.827+0000 7fd6d6d9d640 1 --2- 172.21.15.19:0/1481094936 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ac76fe1370 0x55ac76fd8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:12.834 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.828+0000 7fd6d5d9b640 1 -- 172.21.15.19:0/1481094936 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac76fdb9a0 msgr2=0x55ac76ff3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:12.834 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.828+0000 7fd6d5d9b640 1 --2- 172.21.15.19:0/1481094936 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac76fdb9a0 0x55ac76ff3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:12.834 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.828+0000 7fd6d5d9b640 1 -- 172.21.15.19:0/1481094936 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ac76fe1370 msgr2=0x55ac76fd8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:12.834 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.828+0000 7fd6d5d9b640 1 --2- 172.21.15.19:0/1481094936 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ac76fe1370 0x55ac76fd8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:12.834 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.828+0000 7fd6d5d9b640 1 -- 172.21.15.19:0/1481094936 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac76fd6e30 con 0x55ac76fdc2e0 2024-09-19T09:02:12.834 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.828+0000 7fd6d5d9b640 1 --2- 172.21.15.19:0/1481094936 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ac76fdc2e0 0x55ac76fed0a0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0039c0 tx=0x7fd6cc001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39866159e4a9f052 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:12.834 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.828+0000 7fd6bffff640 1 -- 172.21.15.19:0/1481094936 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc035030 con 0x55ac76fdc2e0 2024-09-19T09:02:12.834 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.828+0000 7fd6bffff640 1 -- 172.21.15.19:0/1481094936 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6cc055070 con 0x55ac76fdc2e0 2024-09-19T09:02:12.834 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.828+0000 7fd6bffff640 1 -- 172.21.15.19:0/1481094936 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc004e20 con 0x55ac76fdc2e0 2024-09-19T09:02:12.834 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.829+0000 7fd6df881740 1 -- 172.21.15.19:0/1481094936 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ac76fdc2e0 msgr2=0x55ac76fed0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:12.834 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.829+0000 7fd6df881740 1 --2- 172.21.15.19:0/1481094936 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ac76fdc2e0 0x55ac76fed0a0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc0039c0 tx=0x7fd6cc001e70 comp rx=0 tx=0).stop 2024-09-19T09:02:12.834 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.829+0000 7fd6df881740 1 -- 172.21.15.19:0/1481094936 shutdown_connections 2024-09-19T09:02:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.829+0000 7fd6df881740 1 --2- 172.21.15.19:0/1481094936 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ac76fe1370 0x55ac76fd8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.829+0000 7fd6df881740 1 --2- 172.21.15.19:0/1481094936 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ac76fdc2e0 0x55ac76fed0a0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.829+0000 7fd6df881740 1 --2- 172.21.15.19:0/1481094936 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac76fdb9a0 0x55ac76ff3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.829+0000 7fd6df881740 1 -- 172.21.15.19:0/1481094936 >> 172.21.15.19:0/1481094936 conn(0x55ac76fd7010 msgr2=0x55ac76fd61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.829+0000 7fd6df881740 1 -- 172.21.15.19:0/1481094936 shutdown_connections 2024-09-19T09:02:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.829+0000 7fd6df881740 1 -- 172.21.15.19:0/1481094936 wait complete. 2024-09-19T09:02:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.829+0000 7fd6df881740 1 -- start start 2024-09-19T09:02:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.829+0000 7fd6df881740 1 Processor -- start 2024-09-19T09:02:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.829+0000 7fd6df881740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac76fdb9a0 0x55ac76fead70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.829+0000 7fd6df881740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ac76fdc2e0 0x55ac76feb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.829+0000 7fd6df881740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ac76fe1370 0x55ac76fec2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.829+0000 7fd6df881740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d81ac6c0 con 0x55ac76fdc2e0 2024-09-19T09:02:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.829+0000 7fd6df881740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d81abff0 con 0x55ac76fe1370 2024-09-19T09:02:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.829+0000 7fd6df881740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d81a9230 con 0x55ac76fdb9a0 2024-09-19T09:02:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.829+0000 7fd6df881740 10 client.0 _ll_register_callbacks cb 0x7fd6cc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.829+0000 7fd6d5d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ac76fdc2e0 0x55ac76feb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.830+0000 7fd6d5d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ac76fdc2e0 0x55ac76feb2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47190/0 (socket says 172.21.15.19:47190) 2024-09-19T09:02:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.830+0000 7fd6d5d9b640 1 -- 172.21.15.19:0/3831283023 learned_addr learned my addr 172.21.15.19:0/3831283023 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:02:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.830+0000 7fd6d659c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac76fdb9a0 0x55ac76fead70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.830+0000 7fd6d6d9d640 1 --2- 172.21.15.19:0/3831283023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ac76fe1370 0x55ac76fec2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.830+0000 7fd6d5d9b640 1 -- 172.21.15.19:0/3831283023 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac76fdb9a0 msgr2=0x55ac76fead70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.830+0000 7fd6d5d9b640 1 --2- 172.21.15.19:0/3831283023 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac76fdb9a0 0x55ac76fead70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.830+0000 7fd6d5d9b640 1 -- 172.21.15.19:0/3831283023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ac76fe1370 msgr2=0x55ac76fec2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:12.837 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.830+0000 7fd6d5d9b640 1 --2- 172.21.15.19:0/3831283023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ac76fe1370 0x55ac76fec2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:12.837 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.830+0000 7fd6d5d9b640 1 -- 172.21.15.19:0/3831283023 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac76fec8d0 con 0x55ac76fdc2e0 2024-09-19T09:02:12.837 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.830+0000 7fd6d6d9d640 1 --2- 172.21.15.19:0/3831283023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ac76fe1370 0x55ac76fec2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:02:12.837 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.830+0000 7fd6d5d9b640 1 --2- 172.21.15.19:0/3831283023 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ac76fdc2e0 0x55ac76feb2b0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc005dd0 tx=0x7fd6cc031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c350396482b78c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:12.837 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.830+0000 7fd6bdffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:02:12.837 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.830+0000 7fd6bdffb640 1 -- 172.21.15.19:0/3831283023 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc035070 con 0x55ac76fdc2e0 2024-09-19T09:02:12.837 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.830+0000 7fd6bdffb640 1 -- 172.21.15.19:0/3831283023 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fd6cc031a00 con 0x55ac76fdc2e0 2024-09-19T09:02:12.837 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.830+0000 7fd6df881740 1 -- 172.21.15.19:0/3831283023 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6cc055070 con 0x55ac76fdc2e0 2024-09-19T09:02:12.837 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.830+0000 7fd6bdffb640 1 -- 172.21.15.19:0/3831283023 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fd6cc031c00 con 0x55ac76fdc2e0 2024-09-19T09:02:12.837 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.830+0000 7fd6df881740 10 client.17709 fetch_fsmap learned FSMap version 37 2024-09-19T09:02:12.837 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.830+0000 7fd6df881740 1 -- 172.21.15.19:0/3831283023 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55ac7705ca10 con 0x55ac76fdc2e0 2024-09-19T09:02:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.831+0000 7fd6bdffb640 1 -- 172.21.15.19:0/3831283023 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd6cc055070 con 0x55ac76fdc2e0 2024-09-19T09:02:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.831+0000 7fd6bdffb640 1 -- 172.21.15.19:0/3831283023 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7fd6cc004a60 con 0x55ac76fdc2e0 2024-09-19T09:02:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.831+0000 7fd6df881740 10 client.17709 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:02:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.831+0000 7fd6df881740 10 client.17709 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:02:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.831+0000 7fd6df881740 20 client.17709 populate_metadata read hostname 'smithi019' 2024-09-19T09:02:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.831+0000 7fd6df881740 1 --2- 172.21.15.19:0/3831283023 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ac7705d3b0 0x55ac7705f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.831+0000 7fd6df881740 4 client.17709 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:02:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.831+0000 7fd6df881740 1 -- 172.21.15.19:0/3831283023 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ac76f46d70 con 0x55ac7705d3b0 2024-09-19T09:02:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.831+0000 7fd6d659c640 1 --2- 172.21.15.19:0/3831283023 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ac7705d3b0 0x55ac7705f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.832+0000 7fd6d659c640 1 --2- 172.21.15.19:0/3831283023 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ac7705d3b0 0x55ac7705f7d0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de1693ddc0375d0 server_cookie=2ab638d797c363e7 in_seq=0 out_seq=0 2024-09-19T09:02:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:12.832+0000 7fd6bdffb640 10 client.17709 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:02:13.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:13 smithi155 ceph-mon[34921]: pgmap v638: 97 pgs: 97 active+clean; 26 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 558 op/s 2024-09-19T09:02:13.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:13 smithi203 ceph-mon[35450]: pgmap v638: 97 pgs: 97 active+clean; 26 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 558 op/s 2024-09-19T09:02:14.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:13 smithi019 ceph-mon[30976]: pgmap v638: 97 pgs: 97 active+clean; 26 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 558 op/s 2024-09-19T09:02:15.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:15 smithi155 ceph-mon[34921]: pgmap v639: 97 pgs: 97 active+clean; 27 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 419 op/s 2024-09-19T09:02:15.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:15 smithi203 ceph-mon[35450]: pgmap v639: 97 pgs: 97 active+clean; 27 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 419 op/s 2024-09-19T09:02:16.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:15 smithi019 ceph-mon[30976]: pgmap v639: 97 pgs: 97 active+clean; 27 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 419 op/s 2024-09-19T09:02:17.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:17.442+0000 7fd6bdffb640 1 -- 172.21.15.19:0/3831283023 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ac76f46d70 con 0x55ac7705d3b0 2024-09-19T09:02:17.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:17.442+0000 7fd6bdffb640 10 client.17709 handle_command_reply: tid=0 2024-09-19T09:02:17.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:17.442+0000 7fd6df881740 1 client.17709 shutdown 2024-09-19T09:02:17.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:17.442+0000 7fd6df881740 1 -- 172.21.15.19:0/3831283023 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ac76fdc2e0 msgr2=0x55ac76feb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:17.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:17.442+0000 7fd6df881740 1 --2- 172.21.15.19:0/3831283023 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ac76fdc2e0 0x55ac76feb2b0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc005dd0 tx=0x7fd6cc031400 comp rx=0 tx=0).stop 2024-09-19T09:02:17.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:17.442+0000 7fd6df881740 1 -- 172.21.15.19:0/3831283023 shutdown_connections 2024-09-19T09:02:17.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:17.442+0000 7fd6df881740 1 --2- 172.21.15.19:0/3831283023 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ac7705d3b0 0x55ac7705f7d0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:17.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:17.442+0000 7fd6df881740 1 --2- 172.21.15.19:0/3831283023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ac76fe1370 0x55ac76fec2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:17.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:17.442+0000 7fd6df881740 1 --2- 172.21.15.19:0/3831283023 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ac76fdc2e0 0x55ac76feb2b0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:17.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:17.442+0000 7fd6df881740 1 --2- 172.21.15.19:0/3831283023 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac76fdb9a0 0x55ac76fead70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:17.444 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:17.442+0000 7fd6df881740 1 -- 172.21.15.19:0/3831283023 >> 172.21.15.19:0/3831283023 conn(0x55ac76fd7010 msgr2=0x55ac76fd73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:17.445 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:17.442+0000 7fd6bdffb640 0 client.17709 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:02:17.445 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:17.443+0000 7fd6df881740 1 -- 172.21.15.19:0/3831283023 shutdown_connections 2024-09-19T09:02:17.445 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:17.443+0000 7fd6df881740 1 -- 172.21.15.19:0/3831283023 wait complete. 2024-09-19T09:02:17.445 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:17.443+0000 7fd6df881740 20 client.17709 trim_cache size 0 max 16384 2024-09-19T09:02:17.445 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T09:02:17.445 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T09:02:17.445 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T09:02:17.445 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T09:02:17.446 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:17.443+0000 7fd6dc9fd640 1 -- 172.21.15.19:0/1689848246 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd6c00a3370 msgr2=0x7fd6c00a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:17.446 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:17.443+0000 7fd6dc9fd640 1 --2- 172.21.15.19:0/1689848246 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd6c00a3370 0x7fd6c00a5830 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd6d806a980 tx=0x7fd6d0009500 comp rx=0 tx=0).stop 2024-09-19T09:02:17.446 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:17.443+0000 7fd6dc9fd640 1 -- 172.21.15.19:0/1689848246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6d81025c0 msgr2=0x7fd6d8101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:17.446 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:17.443+0000 7fd6dc9fd640 1 --2- 172.21.15.19:0/1689848246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6d81025c0 0x7fd6d8101f30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd6c800e9f0 tx=0x7fd6c800eeb0 comp rx=0 tx=0).stop 2024-09-19T09:02:17.446 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:17.444+0000 7fd6dc9fd640 1 -- 172.21.15.19:0/1689848246 shutdown_connections 2024-09-19T09:02:17.446 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:17.444+0000 7fd6dc9fd640 1 --2- 172.21.15.19:0/1689848246 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd6c00a3370 0x7fd6c00a5830 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:17.447 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:17.444+0000 7fd6dc9fd640 1 --2- 172.21.15.19:0/1689848246 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd6d8104ef0 0x7fd6d8100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:17.447 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:17.444+0000 7fd6dc9fd640 1 --2- 172.21.15.19:0/1689848246 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd6d8107820 0x7fd6d8100ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:17.447 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:17.444+0000 7fd6dc9fd640 1 --2- 172.21.15.19:0/1689848246 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd6d81025c0 0x7fd6d8101f30 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:17.447 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:17.444+0000 7fd6dc9fd640 1 -- 172.21.15.19:0/1689848246 >> 172.21.15.19:0/1689848246 conn(0x7fd6d80fc1e0 msgr2=0x7fd6d8102f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:17.447 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:17.444+0000 7fd6dc9fd640 1 -- 172.21.15.19:0/1689848246 shutdown_connections 2024-09-19T09:02:17.447 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:17.444+0000 7fd6dc9fd640 1 -- 172.21.15.19:0/1689848246 wait complete. 2024-09-19T09:02:17.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:17 smithi155 ceph-mon[34921]: pgmap v640: 97 pgs: 97 active+clean; 27 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 483 op/s 2024-09-19T09:02:17.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:17 smithi203 ceph-mon[35450]: pgmap v640: 97 pgs: 97 active+clean; 27 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 483 op/s 2024-09-19T09:02:18.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:17 smithi019 ceph-mon[30976]: pgmap v640: 97 pgs: 97 active+clean; 27 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 483 op/s 2024-09-19T09:02:19.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:19 smithi155 ceph-mon[34921]: pgmap v641: 97 pgs: 97 active+clean; 26 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 655 op/s 2024-09-19T09:02:19.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:19 smithi203 ceph-mon[35450]: pgmap v641: 97 pgs: 97 active+clean; 26 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 655 op/s 2024-09-19T09:02:20.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:19 smithi019 ceph-mon[30976]: pgmap v641: 97 pgs: 97 active+clean; 26 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.2 MiB/s wr, 655 op/s 2024-09-19T09:02:21.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:21 smithi155 ceph-mon[34921]: pgmap v642: 97 pgs: 97 active+clean; 25 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 634 op/s 2024-09-19T09:02:21.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:21 smithi203 ceph-mon[35450]: pgmap v642: 97 pgs: 97 active+clean; 25 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 634 op/s 2024-09-19T09:02:22.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:21 smithi019 ceph-mon[30976]: pgmap v642: 97 pgs: 97 active+clean; 25 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 634 op/s 2024-09-19T09:02:22.374 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:02:22.649 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:23.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.162+0000 7fa3b08bd640 1 -- 172.21.15.19:0/1422821706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3ac10e4d0 msgr2=0x7fa3ac1108e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:23.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.162+0000 7fa3b08bd640 1 --2- 172.21.15.19:0/1422821706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3ac10e4d0 0x7fa3ac1108e0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4009ca0 tx=0x7fa3a402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.162+0000 7fa3b08bd640 1 -- 172.21.15.19:0/1422821706 shutdown_connections 2024-09-19T09:02:23.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.162+0000 7fa3b08bd640 1 --2- 172.21.15.19:0/1422821706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3ac10e4d0 0x7fa3ac1108e0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.162+0000 7fa3b08bd640 1 --2- 172.21.15.19:0/1422821706 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3ac101360 0x7fa3ac10df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.162+0000 7fa3b08bd640 1 --2- 172.21.15.19:0/1422821706 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa3ac1009b0 0x7fa3ac100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.162+0000 7fa3b08bd640 1 -- 172.21.15.19:0/1422821706 >> 172.21.15.19:0/1422821706 conn(0x7fa3ac0fc7d0 msgr2=0x7fa3ac0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:23.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.162+0000 7fa3b08bd640 1 -- 172.21.15.19:0/1422821706 shutdown_connections 2024-09-19T09:02:23.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.162+0000 7fa3b08bd640 1 -- 172.21.15.19:0/1422821706 wait complete. 2024-09-19T09:02:23.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.163+0000 7fa3b08bd640 1 Processor -- start 2024-09-19T09:02:23.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.163+0000 7fa3b08bd640 1 -- start start 2024-09-19T09:02:23.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.163+0000 7fa3b08bd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3ac1009b0 0x7fa3ac19a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:23.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.163+0000 7fa3b08bd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa3ac101360 0x7fa3ac19ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:23.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.163+0000 7fa3b08bd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3ac10e4d0 0x7fa3ac19efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:23.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.163+0000 7fa3b08bd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ac114220 con 0x7fa3ac1009b0 2024-09-19T09:02:23.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.163+0000 7fa3b08bd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ac1140a0 con 0x7fa3ac10e4d0 2024-09-19T09:02:23.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.163+0000 7fa3b08bd640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ac1143a0 con 0x7fa3ac101360 2024-09-19T09:02:23.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.163+0000 7fa3aa59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3ac1009b0 0x7fa3ac19a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:23.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.163+0000 7fa3aa59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3ac1009b0 0x7fa3ac19a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47760/0 (socket says 172.21.15.19:47760) 2024-09-19T09:02:23.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.163+0000 7fa3a9d9b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa3ac101360 0x7fa3ac19ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:23.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.163+0000 7fa3aa59c640 1 -- 172.21.15.19:0/2216554504 learned_addr learned my addr 172.21.15.19:0/2216554504 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:02:23.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.164+0000 7fa3aad9d640 1 --2- 172.21.15.19:0/2216554504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3ac10e4d0 0x7fa3ac19efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:23.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.164+0000 7fa3aa59c640 1 -- 172.21.15.19:0/2216554504 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa3ac101360 msgr2=0x7fa3ac19ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:23.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.164+0000 7fa3aa59c640 1 --2- 172.21.15.19:0/2216554504 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa3ac101360 0x7fa3ac19ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.164+0000 7fa3aa59c640 1 -- 172.21.15.19:0/2216554504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3ac10e4d0 msgr2=0x7fa3ac19efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:23.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.164+0000 7fa3aa59c640 1 --2- 172.21.15.19:0/2216554504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3ac10e4d0 0x7fa3ac19efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.164+0000 7fa3aa59c640 1 -- 172.21.15.19:0/2216554504 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3ac19f6b0 con 0x7fa3ac1009b0 2024-09-19T09:02:23.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.164+0000 7fa3aa59c640 1 --2- 172.21.15.19:0/2216554504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3ac1009b0 0x7fa3ac19a700 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fa39c00d770 tx=0x7fa39c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:23.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.164+0000 7fa39b7fe640 1 -- 172.21.15.19:0/2216554504 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa39c017070 con 0x7fa3ac1009b0 2024-09-19T09:02:23.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.164+0000 7fa39b7fe640 1 -- 172.21.15.19:0/2216554504 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa39c005500 con 0x7fa3ac1009b0 2024-09-19T09:02:23.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.164+0000 7fa3b08bd640 1 -- 172.21.15.19:0/2216554504 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3ac19f9a0 con 0x7fa3ac1009b0 2024-09-19T09:02:23.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.164+0000 7fa39b7fe640 1 -- 172.21.15.19:0/2216554504 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa39c004e00 con 0x7fa3ac1009b0 2024-09-19T09:02:23.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.164+0000 7fa3b08bd640 1 -- 172.21.15.19:0/2216554504 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3ac1a7280 con 0x7fa3ac1009b0 2024-09-19T09:02:23.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.167+0000 7fa39b7fe640 1 -- 172.21.15.19:0/2216554504 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fa39c010460 con 0x7fa3ac1009b0 2024-09-19T09:02:23.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.167+0000 7fa3b2c96740 1 Processor -- start 2024-09-19T09:02:23.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.167+0000 7fa3b2c96740 1 -- start start 2024-09-19T09:02:23.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.167+0000 7fa3b2c96740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55667e1744a0 0x55667e174880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:23.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.167+0000 7fa3b2c96740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55667e174dc0 0x55667e17f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:23.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.167+0000 7fa3b2c96740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55667e17f680 0x55667e181a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:23.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.167+0000 7fa3b2c96740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55667e0da2e0 con 0x55667e174dc0 2024-09-19T09:02:23.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.167+0000 7fa3b2c96740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55667e081ce0 con 0x55667e1744a0 2024-09-19T09:02:23.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.167+0000 7fa3b2c96740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55667e0d62a0 con 0x55667e17f680 2024-09-19T09:02:23.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.168+0000 7fa3aad9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55667e1744a0 0x55667e174880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:23.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.168+0000 7fa3aad9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55667e1744a0 0x55667e174880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:34264/0 (socket says 172.21.15.19:34264) 2024-09-19T09:02:23.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.168+0000 7fa3aad9d640 1 -- 172.21.15.19:0/3001802660 learned_addr learned my addr 172.21.15.19:0/3001802660 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:02:23.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.168+0000 7fa39b7fe640 1 --2- 172.21.15.19:0/2216554504 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa3940a3240 0x7fa3940a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:23.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.168+0000 7fa3aa59c640 1 --2- 172.21.15.19:0/3001802660 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55667e174dc0 0x55667e17f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:23.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.168+0000 7fa3a9d9b640 1 --2- 172.21.15.19:0/3001802660 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55667e17f680 0x55667e181a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:23.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.168+0000 7fa3aad9d640 1 --2- 172.21.15.19:0/2216554504 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa3940a3240 0x7fa3940a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:23.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.168+0000 7fa39b7fe640 1 -- 172.21.15.19:0/2216554504 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fa39c0cf300 con 0x7fa3ac1009b0 2024-09-19T09:02:23.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.168+0000 7fa3aad9d640 1 -- 172.21.15.19:0/3001802660 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55667e17f680 msgr2=0x55667e181a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:23.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.168+0000 7fa3aad9d640 1 --2- 172.21.15.19:0/3001802660 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55667e17f680 0x55667e181a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.168+0000 7fa3aad9d640 1 -- 172.21.15.19:0/3001802660 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55667e174dc0 msgr2=0x55667e17f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:23.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.168+0000 7fa3aad9d640 1 --2- 172.21.15.19:0/3001802660 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55667e174dc0 0x55667e17f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.168+0000 7fa3aad9d640 1 -- 172.21.15.19:0/3001802660 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55667e066440 con 0x55667e1744a0 2024-09-19T09:02:23.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.168+0000 7fa3aad9d640 1 --2- 172.21.15.19:0/3001802660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55667e1744a0 0x55667e174880 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4009430 tx=0x7fa3a4009a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5eb5f5c17d5c762e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:23.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.168+0000 7fa3aad9d640 1 --2- 172.21.15.19:0/2216554504 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa3940a3240 0x7fa3940a5700 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4048000 tx=0x7fa3a404a000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:23.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.169+0000 7fa398ff9640 1 -- 172.21.15.19:0/3001802660 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a404f070 con 0x55667e1744a0 2024-09-19T09:02:23.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.169+0000 7fa398ff9640 1 -- 172.21.15.19:0/3001802660 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3a4036040 con 0x55667e1744a0 2024-09-19T09:02:23.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.169+0000 7fa398ff9640 1 -- 172.21.15.19:0/3001802660 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a402fb10 con 0x55667e1744a0 2024-09-19T09:02:23.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.169+0000 7fa3b2c96740 1 -- 172.21.15.19:0/3001802660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55667e1744a0 msgr2=0x55667e174880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:23.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.169+0000 7fa3b2c96740 1 --2- 172.21.15.19:0/3001802660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55667e1744a0 0x55667e174880 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4009430 tx=0x7fa3a4009a20 comp rx=0 tx=0).stop 2024-09-19T09:02:23.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.169+0000 7fa3b2c96740 1 -- 172.21.15.19:0/3001802660 shutdown_connections 2024-09-19T09:02:23.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.169+0000 7fa3b2c96740 1 --2- 172.21.15.19:0/3001802660 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55667e17f680 0x55667e181a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.169+0000 7fa3b2c96740 1 --2- 172.21.15.19:0/3001802660 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55667e174dc0 0x55667e17f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.169+0000 7fa3b2c96740 1 --2- 172.21.15.19:0/3001802660 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55667e1744a0 0x55667e174880 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.169+0000 7fa3b2c96740 1 -- 172.21.15.19:0/3001802660 >> 172.21.15.19:0/3001802660 conn(0x55667e170a30 msgr2=0x55667e170e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:23.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.170+0000 7fa3b2c96740 1 -- 172.21.15.19:0/3001802660 shutdown_connections 2024-09-19T09:02:23.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.170+0000 7fa3b2c96740 1 -- 172.21.15.19:0/3001802660 wait complete. 2024-09-19T09:02:23.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.170+0000 7fa3b2c96740 1 -- start start 2024-09-19T09:02:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.170+0000 7fa3b2c96740 1 Processor -- start 2024-09-19T09:02:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.170+0000 7fa3b2c96740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55667e1744a0 0x55667e17ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.170+0000 7fa3b2c96740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55667e174dc0 0x55667e17c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.170+0000 7fa3b2c96740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55667e17f680 0x55667e17c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.170+0000 7fa3b2c96740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55667e1820d0 con 0x55667e1744a0 2024-09-19T09:02:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.171+0000 7fa3b2c96740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55667e095050 con 0x55667e174dc0 2024-09-19T09:02:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.171+0000 7fa3b2c96740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55667e182250 con 0x55667e17f680 2024-09-19T09:02:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.171+0000 7fa3b2c96740 10 client.0 _ll_register_callbacks cb 0x55667e0d5160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.171+0000 7fa3aa59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55667e1744a0 0x55667e17ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.171+0000 7fa3aa59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55667e1744a0 0x55667e17ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47772/0 (socket says 172.21.15.19:47772) 2024-09-19T09:02:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.171+0000 7fa3aa59c640 1 -- 172.21.15.19:0/1114875938 learned_addr learned my addr 172.21.15.19:0/1114875938 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:02:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.171+0000 7fa3a9d9b640 1 --2- 172.21.15.19:0/1114875938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55667e174dc0 0x55667e17c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:23.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.171+0000 7fa3aad9d640 1 --2- 172.21.15.19:0/1114875938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55667e17f680 0x55667e17c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:23.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.171+0000 7fa3aa59c640 1 -- 172.21.15.19:0/1114875938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55667e17f680 msgr2=0x55667e17c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:23.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.171+0000 7fa3aa59c640 1 --2- 172.21.15.19:0/1114875938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55667e17f680 0x55667e17c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.171+0000 7fa3aa59c640 1 -- 172.21.15.19:0/1114875938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55667e174dc0 msgr2=0x55667e17c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:23.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.171+0000 7fa3aa59c640 1 --2- 172.21.15.19:0/1114875938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55667e174dc0 0x55667e17c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.171+0000 7fa3aa59c640 1 -- 172.21.15.19:0/1114875938 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55667de4b3c0 con 0x55667e1744a0 2024-09-19T09:02:23.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.171+0000 7fa3aa59c640 1 --2- 172.21.15.19:0/1114875938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55667e1744a0 0x55667e17ef90 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fa39c0983b0 tx=0x7fa39c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85a817bd26bee846 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:23.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.171+0000 7fa391ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:02:23.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.171+0000 7fa391ffb640 1 -- 172.21.15.19:0/1114875938 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa39c020040 con 0x55667e1744a0 2024-09-19T09:02:23.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.171+0000 7fa391ffb640 1 -- 172.21.15.19:0/1114875938 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fa39c098050 con 0x55667e1744a0 2024-09-19T09:02:23.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.171+0000 7fa3b2c96740 1 -- 172.21.15.19:0/1114875938 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3a4036040 con 0x55667e1744a0 2024-09-19T09:02:23.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.171+0000 7fa391ffb640 1 -- 172.21.15.19:0/1114875938 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fa39c0a45a0 con 0x55667e1744a0 2024-09-19T09:02:23.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.171+0000 7fa3b2c96740 10 client.17721 fetch_fsmap learned FSMap version 37 2024-09-19T09:02:23.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.171+0000 7fa3b2c96740 1 -- 172.21.15.19:0/1114875938 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55667e18daa0 con 0x55667e1744a0 2024-09-19T09:02:23.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.172+0000 7fa391ffb640 1 -- 172.21.15.19:0/1114875938 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa3a4036040 con 0x55667e1744a0 2024-09-19T09:02:23.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.172+0000 7fa391ffb640 1 -- 172.21.15.19:0/1114875938 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7fa39c09ae30 con 0x55667e1744a0 2024-09-19T09:02:23.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.172+0000 7fa3b2c96740 10 client.17721 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:02:23.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.172+0000 7fa3b2c96740 10 client.17721 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:02:23.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.172+0000 7fa3b2c96740 20 client.17721 populate_metadata read hostname 'smithi019' 2024-09-19T09:02:23.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.172+0000 7fa3b2c96740 1 --2- 172.21.15.19:0/1114875938 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55667e18efb0 0x55667e1913e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:23.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.172+0000 7fa3b2c96740 4 client.17721 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:02:23.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.172+0000 7fa3b2c96740 1 -- 172.21.15.19:0/1114875938 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55667e0e7850 con 0x55667e18efb0 2024-09-19T09:02:23.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.172+0000 7fa3a9d9b640 1 --2- 172.21.15.19:0/1114875938 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55667e18efb0 0x55667e1913e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:23.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.173+0000 7fa391ffb640 10 client.17721 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:02:23.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.173+0000 7fa3a9d9b640 1 --2- 172.21.15.19:0/1114875938 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55667e18efb0 0x55667e1913e0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=61b231166ca21ed0 server_cookie=55b11a56e5ad80a5 in_seq=0 out_seq=0 2024-09-19T09:02:23.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.176+0000 7fa391ffb640 1 -- 172.21.15.19:0/1114875938 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55667e0e7850 con 0x55667e18efb0 2024-09-19T09:02:23.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.176+0000 7fa391ffb640 10 client.17721 handle_command_reply: tid=0 2024-09-19T09:02:23.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.176+0000 7fa3b2c96740 1 client.17721 shutdown 2024-09-19T09:02:23.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.176+0000 7fa3b2c96740 1 -- 172.21.15.19:0/1114875938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55667e1744a0 msgr2=0x55667e17ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:23.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.176+0000 7fa3b2c96740 1 --2- 172.21.15.19:0/1114875938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55667e1744a0 0x55667e17ef90 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fa39c0983b0 tx=0x7fa39c0046c0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.176+0000 7fa3b2c96740 1 -- 172.21.15.19:0/1114875938 shutdown_connections 2024-09-19T09:02:23.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.176+0000 7fa3b2c96740 1 --2- 172.21.15.19:0/1114875938 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55667e18efb0 0x55667e1913e0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.176+0000 7fa3b2c96740 1 --2- 172.21.15.19:0/1114875938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55667e17f680 0x55667e17c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.176+0000 7fa3b2c96740 1 --2- 172.21.15.19:0/1114875938 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55667e174dc0 0x55667e17c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.176+0000 7fa3b2c96740 1 --2- 172.21.15.19:0/1114875938 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55667e1744a0 0x55667e17ef90 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.176+0000 7fa391ffb640 0 client.17721 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:02:23.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.176+0000 7fa3b2c96740 1 -- 172.21.15.19:0/1114875938 >> 172.21.15.19:0/1114875938 conn(0x55667e170a30 msgr2=0x55667e16fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:23.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.176+0000 7fa3b2c96740 1 -- 172.21.15.19:0/1114875938 shutdown_connections 2024-09-19T09:02:23.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.176+0000 7fa3b2c96740 1 -- 172.21.15.19:0/1114875938 wait complete. 2024-09-19T09:02:23.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.176+0000 7fa3b2c96740 20 client.17721 trim_cache size 0 max 16384 2024-09-19T09:02:23.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.194+0000 7fa3b2c96740 1 Processor -- start 2024-09-19T09:02:23.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.194+0000 7fa3b2c96740 1 -- start start 2024-09-19T09:02:23.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.194+0000 7fa3b2c96740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55667e1744a0 0x55667e18b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:23.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.194+0000 7fa3b2c96740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55667e174dc0 0x55667e196cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:23.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.194+0000 7fa3b2c96740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55667e17f680 0x55667e1971f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:23.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.194+0000 7fa3b2c96740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ac1af680 con 0x55667e1744a0 2024-09-19T09:02:23.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.194+0000 7fa3b2c96740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ac1b11c0 con 0x55667e17f680 2024-09-19T09:02:23.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.194+0000 7fa3b2c96740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ac1afd50 con 0x55667e174dc0 2024-09-19T09:02:23.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.194+0000 7fa3aa59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55667e1744a0 0x55667e18b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:23.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.194+0000 7fa3aa59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55667e1744a0 0x55667e18b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47774/0 (socket says 172.21.15.19:47774) 2024-09-19T09:02:23.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.194+0000 7fa3aa59c640 1 -- 172.21.15.19:0/3782804002 learned_addr learned my addr 172.21.15.19:0/3782804002 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:02:23.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.194+0000 7fa3aad9d640 1 --2- 172.21.15.19:0/3782804002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55667e17f680 0x55667e1971f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:23.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.194+0000 7fa3a9d9b640 1 --2- 172.21.15.19:0/3782804002 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55667e174dc0 0x55667e196cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:23.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.194+0000 7fa3aa59c640 1 -- 172.21.15.19:0/3782804002 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55667e174dc0 msgr2=0x55667e196cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:23.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.195+0000 7fa3aa59c640 1 --2- 172.21.15.19:0/3782804002 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55667e174dc0 0x55667e196cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.195+0000 7fa3aa59c640 1 -- 172.21.15.19:0/3782804002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55667e17f680 msgr2=0x55667e1971f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:23.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.195+0000 7fa3aa59c640 1 --2- 172.21.15.19:0/3782804002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55667e17f680 0x55667e1971f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.195+0000 7fa3aa59c640 1 -- 172.21.15.19:0/3782804002 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55667e1742d0 con 0x55667e1744a0 2024-09-19T09:02:23.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.195+0000 7fa3aad9d640 1 --2- 172.21.15.19:0/3782804002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55667e17f680 0x55667e1971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:02:23.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.195+0000 7fa3aa59c640 1 --2- 172.21.15.19:0/3782804002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55667e1744a0 0x55667e18b330 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fa39c097e40 tx=0x7fa39c099ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8bee9e278e2024 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:23.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.195+0000 7fa393fff640 1 -- 172.21.15.19:0/3782804002 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa39c07f070 con 0x55667e1744a0 2024-09-19T09:02:23.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.195+0000 7fa393fff640 1 -- 172.21.15.19:0/3782804002 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa39c0afe50 con 0x55667e1744a0 2024-09-19T09:02:23.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.195+0000 7fa393fff640 1 -- 172.21.15.19:0/3782804002 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa39c020070 con 0x55667e1744a0 2024-09-19T09:02:23.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.196+0000 7fa3b2c96740 1 -- 172.21.15.19:0/3782804002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55667e1744a0 msgr2=0x55667e18b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:23.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.196+0000 7fa3b2c96740 1 --2- 172.21.15.19:0/3782804002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55667e1744a0 0x55667e18b330 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fa39c097e40 tx=0x7fa39c099ef0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.196+0000 7fa3b2c96740 1 -- 172.21.15.19:0/3782804002 shutdown_connections 2024-09-19T09:02:23.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.196+0000 7fa3b2c96740 1 --2- 172.21.15.19:0/3782804002 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55667e174dc0 0x55667e196cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.196+0000 7fa3b2c96740 1 --2- 172.21.15.19:0/3782804002 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55667e17f680 0x55667e1971f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.196+0000 7fa3b2c96740 1 --2- 172.21.15.19:0/3782804002 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55667e1744a0 0x55667e18b330 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.196+0000 7fa3b2c96740 1 -- 172.21.15.19:0/3782804002 >> 172.21.15.19:0/3782804002 conn(0x55667e170a30 msgr2=0x55667e17ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:23.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.196+0000 7fa3b2c96740 1 -- 172.21.15.19:0/3782804002 shutdown_connections 2024-09-19T09:02:23.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.196+0000 7fa3b2c96740 1 -- 172.21.15.19:0/3782804002 wait complete. 2024-09-19T09:02:23.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.196+0000 7fa3b2c96740 1 -- start start 2024-09-19T09:02:23.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.196+0000 7fa3b2c96740 1 Processor -- start 2024-09-19T09:02:23.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.197+0000 7fa3b2c96740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55667e1744a0 0x55667e1831a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:23.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.197+0000 7fa3b2c96740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55667e174dc0 0x55667e1836e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:23.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.197+0000 7fa3b2c96740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55667e17f680 0x55667e183c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:23.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.197+0000 7fa3b2c96740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ac1b0af0 con 0x55667e1744a0 2024-09-19T09:02:23.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.197+0000 7fa3b2c96740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ac1b0420 con 0x55667e174dc0 2024-09-19T09:02:23.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.197+0000 7fa3b2c96740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa3ac1ad660 con 0x55667e17f680 2024-09-19T09:02:23.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.197+0000 7fa3b2c96740 10 client.0 _ll_register_callbacks cb 0x7fa39c09b7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:23.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.197+0000 7fa3aa59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55667e1744a0 0x55667e1831a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:23.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.197+0000 7fa3aa59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55667e1744a0 0x55667e1831a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47790/0 (socket says 172.21.15.19:47790) 2024-09-19T09:02:23.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.197+0000 7fa3aa59c640 1 -- 172.21.15.19:0/377566063 learned_addr learned my addr 172.21.15.19:0/377566063 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:02:23.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.197+0000 7fa3a9d9b640 1 --2- 172.21.15.19:0/377566063 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55667e174dc0 0x55667e1836e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:23.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.197+0000 7fa3aad9d640 1 --2- 172.21.15.19:0/377566063 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55667e17f680 0x55667e183c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:23.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.197+0000 7fa3aa59c640 1 -- 172.21.15.19:0/377566063 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55667e17f680 msgr2=0x55667e183c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:23.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.197+0000 7fa3aa59c640 1 --2- 172.21.15.19:0/377566063 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55667e17f680 0x55667e183c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.197+0000 7fa3aa59c640 1 -- 172.21.15.19:0/377566063 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55667e174dc0 msgr2=0x55667e1836e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:23.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.197+0000 7fa3aa59c640 1 --2- 172.21.15.19:0/377566063 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55667e174dc0 0x55667e1836e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.197+0000 7fa3aa59c640 1 -- 172.21.15.19:0/377566063 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55667e1f8c80 con 0x55667e1744a0 2024-09-19T09:02:23.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.197+0000 7fa3aa59c640 1 --2- 172.21.15.19:0/377566063 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55667e1744a0 0x55667e1831a0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fa39c005760 tx=0x7fa39c09b5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d68b9195efdb43eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:23.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.197+0000 7fa391ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:02:23.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.197+0000 7fa391ffb640 1 -- 172.21.15.19:0/377566063 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa39c07f070 con 0x55667e1744a0 2024-09-19T09:02:23.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.197+0000 7fa391ffb640 1 -- 172.21.15.19:0/377566063 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7fa39c0ba1a0 con 0x55667e1744a0 2024-09-19T09:02:23.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.198+0000 7fa3b2c96740 1 -- 172.21.15.19:0/377566063 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa39c0afe50 con 0x55667e1744a0 2024-09-19T09:02:23.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.198+0000 7fa391ffb640 1 -- 172.21.15.19:0/377566063 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fa39c020070 con 0x55667e1744a0 2024-09-19T09:02:23.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.198+0000 7fa3b2c96740 10 client.17727 fetch_fsmap learned FSMap version 37 2024-09-19T09:02:23.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.198+0000 7fa3b2c96740 1 -- 172.21.15.19:0/377566063 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x55667e1f9f10 con 0x55667e1744a0 2024-09-19T09:02:23.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.198+0000 7fa391ffb640 1 -- 172.21.15.19:0/377566063 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa39c0afe50 con 0x55667e1744a0 2024-09-19T09:02:23.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.198+0000 7fa391ffb640 1 -- 172.21.15.19:0/377566063 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7fa39c0b4cc0 con 0x55667e1744a0 2024-09-19T09:02:23.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.198+0000 7fa3b2c96740 10 client.17727 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:02:23.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.198+0000 7fa3b2c96740 10 client.17727 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:02:23.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.198+0000 7fa3b2c96740 20 client.17727 populate_metadata read hostname 'smithi019' 2024-09-19T09:02:23.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.198+0000 7fa3b2c96740 1 --2- 172.21.15.19:0/377566063 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55667e1fa390 0x55667e1fc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:23.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.198+0000 7fa3b2c96740 4 client.17727 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:02:23.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.198+0000 7fa3b2c96740 1 -- 172.21.15.19:0/377566063 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55667e17cb10 con 0x55667e1fa390 2024-09-19T09:02:23.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.198+0000 7fa3a9d9b640 1 --2- 172.21.15.19:0/377566063 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55667e1fa390 0x55667e1fc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:23.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.199+0000 7fa3a9d9b640 1 --2- 172.21.15.19:0/377566063 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55667e1fa390 0x55667e1fc780 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d06286b0a78dc8a server_cookie=d731ec18404235cf in_seq=0 out_seq=0 2024-09-19T09:02:23.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.199+0000 7fa391ffb640 10 client.17727 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:02:23.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.204+0000 7fa391ffb640 1 -- 172.21.15.19:0/377566063 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+268 (crc 0 0 0) 0x55667e17cb10 con 0x55667e1fa390 2024-09-19T09:02:23.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.204+0000 7fa391ffb640 10 client.17727 handle_command_reply: tid=0 2024-09-19T09:02:23.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.204+0000 7fa3b2c96740 1 client.17727 shutdown 2024-09-19T09:02:23.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.204+0000 7fa3b2c96740 1 -- 172.21.15.19:0/377566063 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55667e1744a0 msgr2=0x55667e1831a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:23.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.204+0000 7fa3b2c96740 1 --2- 172.21.15.19:0/377566063 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55667e1744a0 0x55667e1831a0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7fa39c005760 tx=0x7fa39c09b5a0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.204+0000 7fa3b2c96740 1 -- 172.21.15.19:0/377566063 shutdown_connections 2024-09-19T09:02:23.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.204+0000 7fa3b2c96740 1 --2- 172.21.15.19:0/377566063 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55667e1fa390 0x55667e1fc780 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.204+0000 7fa3b2c96740 1 --2- 172.21.15.19:0/377566063 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55667e17f680 0x55667e183c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.204+0000 7fa3b2c96740 1 --2- 172.21.15.19:0/377566063 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55667e174dc0 0x55667e1836e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.204+0000 7fa3b2c96740 1 --2- 172.21.15.19:0/377566063 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55667e1744a0 0x55667e1831a0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.204+0000 7fa391ffb640 0 client.17727 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:02:23.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.204+0000 7fa3b2c96740 1 -- 172.21.15.19:0/377566063 >> 172.21.15.19:0/377566063 conn(0x55667e170a30 msgr2=0x55667e16fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:23.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.204+0000 7fa3b2c96740 1 -- 172.21.15.19:0/377566063 shutdown_connections 2024-09-19T09:02:23.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.204+0000 7fa3b2c96740 1 -- 172.21.15.19:0/377566063 wait complete. 2024-09-19T09:02:23.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.204+0000 7fa3b2c96740 20 client.17727 trim_cache size 0 max 16384 2024-09-19T09:02:23.210 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T09:02:23.210 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "scrub active (6272 inodes in the stack)", 2024-09-19T09:02:23.210 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-19T09:02:23.210 INFO:teuthology.orchestra.run.smithi019.stdout: "1d9e868e-87b9-4017-8774-95d75b40397d": { 2024-09-19T09:02:23.210 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-19T09:02:23.210 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "1d9e868e-87b9-4017-8774-95d75b40397d", 2024-09-19T09:02:23.210 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-19T09:02:23.210 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:02:23.210 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:02:23.210 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T09:02:23.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.205+0000 7fa3b08bd640 1 -- 172.21.15.19:0/2216554504 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa3940a3240 msgr2=0x7fa3940a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:23.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.205+0000 7fa3b08bd640 1 --2- 172.21.15.19:0/2216554504 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa3940a3240 0x7fa3940a5700 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa3a4048000 tx=0x7fa3a404a000 comp rx=0 tx=0).stop 2024-09-19T09:02:23.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.205+0000 7fa3b08bd640 1 -- 172.21.15.19:0/2216554504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3ac1009b0 msgr2=0x7fa3ac19a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:23.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.205+0000 7fa3b08bd640 1 --2- 172.21.15.19:0/2216554504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3ac1009b0 0x7fa3ac19a700 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fa39c00d770 tx=0x7fa39c00dc30 comp rx=0 tx=0).stop 2024-09-19T09:02:23.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.205+0000 7fa3b08bd640 1 -- 172.21.15.19:0/2216554504 shutdown_connections 2024-09-19T09:02:23.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.205+0000 7fa3b08bd640 1 --2- 172.21.15.19:0/2216554504 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa3940a3240 0x7fa3940a5700 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.205+0000 7fa3b08bd640 1 --2- 172.21.15.19:0/2216554504 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa3ac101360 0x7fa3ac19ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.205+0000 7fa3b08bd640 1 --2- 172.21.15.19:0/2216554504 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa3ac10e4d0 0x7fa3ac19efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.205+0000 7fa3b08bd640 1 --2- 172.21.15.19:0/2216554504 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa3ac1009b0 0x7fa3ac19a700 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:23.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.205+0000 7fa3b08bd640 1 -- 172.21.15.19:0/2216554504 >> 172.21.15.19:0/2216554504 conn(0x7fa3ac0fc7d0 msgr2=0x7fa3ac0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:23.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.205+0000 7fa3b08bd640 1 -- 172.21.15.19:0/2216554504 shutdown_connections 2024-09-19T09:02:23.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:23.205+0000 7fa3b08bd640 1 -- 172.21.15.19:0/2216554504 wait complete. 2024-09-19T09:02:23.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:23 smithi019 ceph-mon[30976]: pgmap v643: 97 pgs: 97 active+clean; 20 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 753 op/s 2024-09-19T09:02:23.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:23 smithi155 ceph-mon[34921]: pgmap v643: 97 pgs: 97 active+clean; 20 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 753 op/s 2024-09-19T09:02:23.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:23 smithi203 ceph-mon[35450]: pgmap v643: 97 pgs: 97 active+clean; 20 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.9 MiB/s wr, 753 op/s 2024-09-19T09:02:24.439 INFO:tasks.cephfs.filesystem:scrub status for tag:1d9e868e-87b9-4017-8774-95d75b40397d - {'path': '/', 'tag': '1d9e868e-87b9-4017-8774-95d75b40397d', 'options': 'recursive,force'} 2024-09-19T09:02:25.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:25 smithi155 ceph-mon[34921]: pgmap v644: 97 pgs: 97 active+clean; 21 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 685 op/s 2024-09-19T09:02:25.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:25 smithi203 ceph-mon[35450]: pgmap v644: 97 pgs: 97 active+clean; 21 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 685 op/s 2024-09-19T09:02:26.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:25 smithi019 ceph-mon[30976]: pgmap v644: 97 pgs: 97 active+clean; 21 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.3 MiB/s wr, 685 op/s 2024-09-19T09:02:27.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:27 smithi155 ceph-mon[34921]: pgmap v645: 97 pgs: 97 active+clean; 21 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 698 op/s 2024-09-19T09:02:27.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:27 smithi203 ceph-mon[35450]: pgmap v645: 97 pgs: 97 active+clean; 21 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 698 op/s 2024-09-19T09:02:28.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:27 smithi019 ceph-mon[30976]: pgmap v645: 97 pgs: 97 active+clean; 21 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.2 MiB/s wr, 698 op/s 2024-09-19T09:02:29.871 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:29 smithi019 ceph-mon[30976]: pgmap v646: 97 pgs: 97 active+clean; 25 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 632 op/s 2024-09-19T09:02:29.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:29 smithi155 ceph-mon[34921]: pgmap v646: 97 pgs: 97 active+clean; 25 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 632 op/s 2024-09-19T09:02:29.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:29 smithi203 ceph-mon[35450]: pgmap v646: 97 pgs: 97 active+clean; 25 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.6 MiB/s wr, 632 op/s 2024-09-19T09:02:30.543 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.540+0000 7f5830d4b640 1 -- 172.21.15.19:0/4079688519 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f582c103710 msgr2=0x7f582c109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:30.543 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.540+0000 7f5830d4b640 1 --2- 172.21.15.19:0/4079688519 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f582c103710 0x7f582c109fa0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f5824009ca0 tx=0x7f582402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:02:30.544 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.540+0000 7f5830d4b640 1 -- 172.21.15.19:0/4079688519 shutdown_connections 2024-09-19T09:02:30.544 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.540+0000 7f5830d4b640 1 --2- 172.21.15.19:0/4079688519 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f582c102d50 0x7f582c1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:30.544 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.540+0000 7f5830d4b640 1 --2- 172.21.15.19:0/4079688519 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f582c103710 0x7f582c109fa0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:30.544 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.540+0000 7f5830d4b640 1 --2- 172.21.15.19:0/4079688519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f582c101b60 0x7f582c101f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:30.544 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.540+0000 7f5830d4b640 1 -- 172.21.15.19:0/4079688519 >> 172.21.15.19:0/4079688519 conn(0x7f582c0fd2e0 msgr2=0x7f582c0ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:30.544 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.540+0000 7f5830d4b640 1 -- 172.21.15.19:0/4079688519 shutdown_connections 2024-09-19T09:02:30.544 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.540+0000 7f5830d4b640 1 -- 172.21.15.19:0/4079688519 wait complete. 2024-09-19T09:02:30.544 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.541+0000 7f5830d4b640 1 Processor -- start 2024-09-19T09:02:30.544 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.541+0000 7f5830d4b640 1 -- start start 2024-09-19T09:02:30.544 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.541+0000 7f5830d4b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f582c101b60 0x7f582c199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:30.544 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.541+0000 7f5830d4b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f582c102d50 0x7f582c19a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.541+0000 7f5830d4b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f582c103710 0x7f582c1a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.541+0000 7f5830d4b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f582c10d7e0 con 0x7f582c102d50 2024-09-19T09:02:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.541+0000 7f5830d4b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f582c10d660 con 0x7f582c103710 2024-09-19T09:02:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.541+0000 7f5830d4b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f582c10d960 con 0x7f582c101b60 2024-09-19T09:02:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.541+0000 7f5829d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f582c102d50 0x7f582c19a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.541+0000 7f5829d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f582c102d50 0x7f582c19a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41008/0 (socket says 172.21.15.19:41008) 2024-09-19T09:02:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.541+0000 7f582a59c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f582c101b60 0x7f582c199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.541+0000 7f5829d9b640 1 -- 172.21.15.19:0/3312953935 learned_addr learned my addr 172.21.15.19:0/3312953935 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:02:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.541+0000 7f582ad9d640 1 --2- 172.21.15.19:0/3312953935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f582c103710 0x7f582c1a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.542+0000 7f5829d9b640 1 -- 172.21.15.19:0/3312953935 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f582c101b60 msgr2=0x7f582c199fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.542+0000 7f5829d9b640 1 --2- 172.21.15.19:0/3312953935 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f582c101b60 0x7f582c199fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:30.545 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.542+0000 7f5829d9b640 1 -- 172.21.15.19:0/3312953935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f582c103710 msgr2=0x7f582c1a1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:30.546 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.542+0000 7f5829d9b640 1 --2- 172.21.15.19:0/3312953935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f582c103710 0x7f582c1a1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:30.546 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.542+0000 7f5829d9b640 1 -- 172.21.15.19:0/3312953935 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f582c1a1bf0 con 0x7f582c102d50 2024-09-19T09:02:30.546 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.542+0000 7f582a59c640 1 --2- 172.21.15.19:0/3312953935 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f582c101b60 0x7f582c199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:02:30.546 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.542+0000 7f5829d9b640 1 --2- 172.21.15.19:0/3312953935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f582c102d50 0x7f582c19a510 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f582000e9f0 tx=0x7f582000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:30.546 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.542+0000 7f581b7fe640 1 -- 172.21.15.19:0/3312953935 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582000cd80 con 0x7f582c102d50 2024-09-19T09:02:30.546 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.542+0000 7f581b7fe640 1 -- 172.21.15.19:0/3312953935 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5820005500 con 0x7f582c102d50 2024-09-19T09:02:30.546 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.542+0000 7f5830d4b640 1 -- 172.21.15.19:0/3312953935 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f582c1a1ee0 con 0x7f582c102d50 2024-09-19T09:02:30.546 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.542+0000 7f581b7fe640 1 -- 172.21.15.19:0/3312953935 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5820010690 con 0x7f582c102d50 2024-09-19T09:02:30.546 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.542+0000 7f5830d4b640 1 -- 172.21.15.19:0/3312953935 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f582c1a2350 con 0x7f582c102d50 2024-09-19T09:02:30.552 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.545+0000 7f5833bc7740 1 Processor -- start 2024-09-19T09:02:30.552 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.545+0000 7f581b7fe640 1 -- 172.21.15.19:0/3312953935 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f58200046c0 con 0x7f582c102d50 2024-09-19T09:02:30.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.545+0000 7f5833bc7740 1 -- start start 2024-09-19T09:02:30.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.546+0000 7f5833bc7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5635bf4019a0 0x5635bf401da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:30.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.546+0000 7f5833bc7740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5635bf4022e0 0x5635bf406da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:30.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.546+0000 7f5833bc7740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5635bf407370 0x5635bf409830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:30.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.546+0000 7f5833bc7740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5635bf3652f0 con 0x5635bf4022e0 2024-09-19T09:02:30.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.546+0000 7f5833bc7740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5635bf30d270 con 0x5635bf407370 2024-09-19T09:02:30.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.546+0000 7f5833bc7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5635bf3612b0 con 0x5635bf4019a0 2024-09-19T09:02:30.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.546+0000 7f582a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5635bf4022e0 0x5635bf406da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:30.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.546+0000 7f582a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5635bf4022e0 0x5635bf406da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41014/0 (socket says 172.21.15.19:41014) 2024-09-19T09:02:30.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.546+0000 7f582a59c640 1 -- 172.21.15.19:0/3656236161 learned_addr learned my addr 172.21.15.19:0/3656236161 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:02:30.553 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.546+0000 7f582ad9d640 1 --2- 172.21.15.19:0/3656236161 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5635bf4019a0 0x5635bf401da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:30.554 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.546+0000 7f5829d9b640 1 --2- 172.21.15.19:0/3656236161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5635bf407370 0x5635bf409830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:30.554 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.546+0000 7f582a59c640 1 -- 172.21.15.19:0/3656236161 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5635bf4019a0 msgr2=0x5635bf401da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:30.554 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.546+0000 7f582a59c640 1 --2- 172.21.15.19:0/3656236161 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5635bf4019a0 0x5635bf401da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:30.554 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.546+0000 7f582a59c640 1 -- 172.21.15.19:0/3656236161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5635bf407370 msgr2=0x5635bf409830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:30.554 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.546+0000 7f582a59c640 1 --2- 172.21.15.19:0/3656236161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5635bf407370 0x5635bf409830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:30.554 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.546+0000 7f582a59c640 1 -- 172.21.15.19:0/3656236161 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635bf30c340 con 0x5635bf4022e0 2024-09-19T09:02:30.554 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.546+0000 7f582ad9d640 1 --2- 172.21.15.19:0/3656236161 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5635bf4019a0 0x5635bf401da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:02:30.554 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.546+0000 7f582a59c640 1 --2- 172.21.15.19:0/3656236161 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5635bf4022e0 0x5635bf406da0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f581c0114c0 tx=0x7f581c011980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcb792de7d3c252d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:30.554 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.547+0000 7f5818ff9640 1 -- 172.21.15.19:0/3656236161 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f581c004020 con 0x5635bf4022e0 2024-09-19T09:02:30.554 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.547+0000 7f581b7fe640 1 --2- 172.21.15.19:0/3312953935 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f58140a32f0 0x7f58140a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:30.554 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.547+0000 7f5818ff9640 1 -- 172.21.15.19:0/3656236161 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f581c005500 con 0x5635bf4022e0 2024-09-19T09:02:30.554 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.547+0000 7f5818ff9640 1 -- 172.21.15.19:0/3656236161 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f581c004e10 con 0x5635bf4022e0 2024-09-19T09:02:30.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.547+0000 7f582ad9d640 1 --2- 172.21.15.19:0/3312953935 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f58140a32f0 0x7f58140a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:30.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.547+0000 7f581b7fe640 1 -- 172.21.15.19:0/3312953935 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f58200cfcd0 con 0x7f582c102d50 2024-09-19T09:02:30.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.548+0000 7f582ad9d640 1 --2- 172.21.15.19:0/3312953935 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f58140a32f0 0x7f58140a57b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5824005e30 tx=0x7f582403d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:30.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.548+0000 7f5833bc7740 1 -- 172.21.15.19:0/3656236161 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5635bf4022e0 msgr2=0x5635bf406da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:30.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.548+0000 7f5833bc7740 1 --2- 172.21.15.19:0/3656236161 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5635bf4022e0 0x5635bf406da0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f581c0114c0 tx=0x7f581c011980 comp rx=0 tx=0).stop 2024-09-19T09:02:30.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.548+0000 7f5833bc7740 1 -- 172.21.15.19:0/3656236161 shutdown_connections 2024-09-19T09:02:30.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.548+0000 7f5833bc7740 1 --2- 172.21.15.19:0/3656236161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5635bf407370 0x5635bf409830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:30.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.548+0000 7f5833bc7740 1 --2- 172.21.15.19:0/3656236161 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5635bf4022e0 0x5635bf406da0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:30.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.548+0000 7f5833bc7740 1 --2- 172.21.15.19:0/3656236161 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5635bf4019a0 0x5635bf401da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:30.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.548+0000 7f5833bc7740 1 -- 172.21.15.19:0/3656236161 >> 172.21.15.19:0/3656236161 conn(0x5635bf3fd010 msgr2=0x5635bf3fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:30.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.548+0000 7f5833bc7740 1 -- 172.21.15.19:0/3656236161 shutdown_connections 2024-09-19T09:02:30.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.548+0000 7f5833bc7740 1 -- 172.21.15.19:0/3656236161 wait complete. 2024-09-19T09:02:30.555 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.548+0000 7f5833bc7740 1 -- start start 2024-09-19T09:02:30.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.548+0000 7f5833bc7740 1 Processor -- start 2024-09-19T09:02:30.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.549+0000 7f5833bc7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5635bf4019a0 0x5635bf40bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:30.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.549+0000 7f5833bc7740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5635bf4022e0 0x5635bf40c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:30.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.549+0000 7f5833bc7740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5635bf407370 0x5635bf413140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:30.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.549+0000 7f5833bc7740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5635bf40a340 con 0x5635bf407370 2024-09-19T09:02:30.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.549+0000 7f5833bc7740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5635bf2ee290 con 0x5635bf4022e0 2024-09-19T09:02:30.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.549+0000 7f5833bc7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5635bf40a4c0 con 0x5635bf4019a0 2024-09-19T09:02:30.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.549+0000 7f5833bc7740 10 client.0 _ll_register_callbacks cb 0x5635bf31f140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:30.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.549+0000 7f582ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5635bf407370 0x5635bf413140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:30.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.549+0000 7f582a59c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5635bf4019a0 0x5635bf40bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:30.556 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.549+0000 7f5829d9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5635bf4022e0 0x5635bf40c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:30.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.549+0000 7f582a59c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5635bf4019a0 0x5635bf40bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:56654/0 (socket says 172.21.15.19:56654) 2024-09-19T09:02:30.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.549+0000 7f582a59c640 1 -- 172.21.15.19:0/4254969257 learned_addr learned my addr 172.21.15.19:0/4254969257 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:02:30.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.549+0000 7f582a59c640 1 -- 172.21.15.19:0/4254969257 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5635bf4022e0 msgr2=0x5635bf40c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:30.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.549+0000 7f582a59c640 1 --2- 172.21.15.19:0/4254969257 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5635bf4022e0 0x5635bf40c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:30.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.549+0000 7f582a59c640 1 -- 172.21.15.19:0/4254969257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5635bf407370 msgr2=0x5635bf413140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:30.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.549+0000 7f582a59c640 1 --2- 172.21.15.19:0/4254969257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5635bf407370 0x5635bf413140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:30.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.549+0000 7f582a59c640 1 -- 172.21.15.19:0/4254969257 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635bf078210 con 0x5635bf4019a0 2024-09-19T09:02:30.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.549+0000 7f5829d9b640 1 --2- 172.21.15.19:0/4254969257 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5635bf4022e0 0x5635bf40c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:02:30.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.549+0000 7f582a59c640 1 --2- 172.21.15.19:0/4254969257 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5635bf4019a0 0x5635bf40bbc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f581c005890 tx=0x7f581c0051f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b2e9acfb4b18da9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:30.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.549+0000 7f5811ffb640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T09:02:30.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.549+0000 7f5811ffb640 1 -- 172.21.15.19:0/4254969257 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f581c028020 con 0x5635bf4019a0 2024-09-19T09:02:30.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.549+0000 7f5811ffb640 1 -- 172.21.15.19:0/4254969257 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f581c00f5c0 con 0x5635bf4019a0 2024-09-19T09:02:30.557 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.549+0000 7f5833bc7740 1 -- 172.21.15.19:0/4254969257 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f581c005500 con 0x5635bf4019a0 2024-09-19T09:02:30.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.550+0000 7f5811ffb640 1 -- 172.21.15.19:0/4254969257 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f581c01d040 con 0x5635bf4019a0 2024-09-19T09:02:30.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.550+0000 7f5833bc7740 10 client.27070 fetch_fsmap learned FSMap version 37 2024-09-19T09:02:30.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.550+0000 7f5833bc7740 1 -- 172.21.15.19:0/4254969257 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5635bf144620 con 0x5635bf4019a0 2024-09-19T09:02:30.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.550+0000 7f5811ffb640 1 -- 172.21.15.19:0/4254969257 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f581c005500 con 0x5635bf4019a0 2024-09-19T09:02:30.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.550+0000 7f5811ffb640 1 -- 172.21.15.19:0/4254969257 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f581c023500 con 0x5635bf4019a0 2024-09-19T09:02:30.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.550+0000 7f5833bc7740 10 client.27070 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:02:30.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.550+0000 7f5833bc7740 10 client.27070 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:02:30.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.550+0000 7f5833bc7740 20 client.27070 populate_metadata read hostname 'smithi019' 2024-09-19T09:02:30.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.550+0000 7f5833bc7740 1 --2- 172.21.15.19:0/4254969257 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5635bf4175d0 0x5635bf4199c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:30.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.550+0000 7f5833bc7740 4 client.27070 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:02:30.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.550+0000 7f5833bc7740 1 -- 172.21.15.19:0/4254969257 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5635bf372a20 con 0x5635bf4175d0 2024-09-19T09:02:30.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.550+0000 7f5829d9b640 1 --2- 172.21.15.19:0/4254969257 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5635bf4175d0 0x5635bf4199c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:30.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.551+0000 7f5829d9b640 1 --2- 172.21.15.19:0/4254969257 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5635bf4175d0 0x5635bf4199c0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba7b77bc95f8de76 server_cookie=f16e98846207ad96 in_seq=0 out_seq=0 2024-09-19T09:02:30.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.551+0000 7f5811ffb640 10 client.27070 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:02:30.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.554+0000 7f5811ffb640 1 -- 172.21.15.19:0/4254969257 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5635bf372a20 con 0x5635bf4175d0 2024-09-19T09:02:30.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.554+0000 7f5811ffb640 10 client.27070 handle_command_reply: tid=0 2024-09-19T09:02:30.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.554+0000 7f5833bc7740 1 client.27070 shutdown 2024-09-19T09:02:30.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.554+0000 7f5833bc7740 1 -- 172.21.15.19:0/4254969257 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5635bf4019a0 msgr2=0x5635bf40bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:30.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.554+0000 7f5833bc7740 1 --2- 172.21.15.19:0/4254969257 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5635bf4019a0 0x5635bf40bbc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f581c005890 tx=0x7f581c0051f0 comp rx=0 tx=0).stop 2024-09-19T09:02:30.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.554+0000 7f5833bc7740 1 -- 172.21.15.19:0/4254969257 shutdown_connections 2024-09-19T09:02:30.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.554+0000 7f5833bc7740 1 --2- 172.21.15.19:0/4254969257 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5635bf4175d0 0x5635bf4199c0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:30.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.554+0000 7f5811ffb640 0 client.27070 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:02:30.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.554+0000 7f5833bc7740 1 --2- 172.21.15.19:0/4254969257 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5635bf407370 0x5635bf413140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:30.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.554+0000 7f5833bc7740 1 --2- 172.21.15.19:0/4254969257 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5635bf4022e0 0x5635bf40c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:30.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.554+0000 7f5833bc7740 1 --2- 172.21.15.19:0/4254969257 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5635bf4019a0 0x5635bf40bbc0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:30.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.554+0000 7f5833bc7740 1 -- 172.21.15.19:0/4254969257 >> 172.21.15.19:0/4254969257 conn(0x5635bf3fd010 msgr2=0x5635bf3fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:30.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.554+0000 7f5833bc7740 1 -- 172.21.15.19:0/4254969257 shutdown_connections 2024-09-19T09:02:30.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.555+0000 7f5833bc7740 1 -- 172.21.15.19:0/4254969257 wait complete. 2024-09-19T09:02:30.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.555+0000 7f5833bc7740 20 client.27070 trim_cache size 0 max 16384 2024-09-19T09:02:30.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.572+0000 7f5833bc7740 1 Processor -- start 2024-09-19T09:02:30.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.572+0000 7f5833bc7740 1 -- start start 2024-09-19T09:02:30.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.572+0000 7f5833bc7740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5635bf4019a0 0x5635bf40c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:30.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.572+0000 7f5833bc7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5635bf4022e0 0x5635bf413100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:30.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.572+0000 7f5833bc7740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5635bf407370 0x5635bf3fc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:30.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.572+0000 7f5833bc7740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f582c1ab200 con 0x5635bf407370 2024-09-19T09:02:30.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.572+0000 7f5833bc7740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f582c1acd40 con 0x5635bf4019a0 2024-09-19T09:02:30.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.572+0000 7f5833bc7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f582c1ab8d0 con 0x5635bf4022e0 2024-09-19T09:02:30.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.572+0000 7f582ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5635bf407370 0x5635bf3fc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:30.579 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.572+0000 7f582a59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5635bf4019a0 0x5635bf40c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:30.579 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.572+0000 7f582ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5635bf407370 0x5635bf3fc0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41024/0 (socket says 172.21.15.19:41024) 2024-09-19T09:02:30.579 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.572+0000 7f582ad9d640 1 -- 172.21.15.19:0/2262991632 learned_addr learned my addr 172.21.15.19:0/2262991632 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:02:30.579 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.572+0000 7f582a59c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5635bf4019a0 0x5635bf40c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:45680/0 (socket says 172.21.15.19:45680) 2024-09-19T09:02:30.579 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.572+0000 7f5829d9b640 1 --2- 172.21.15.19:0/2262991632 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5635bf4022e0 0x5635bf413100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:30.579 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.573+0000 7f582ad9d640 1 -- 172.21.15.19:0/2262991632 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5635bf4022e0 msgr2=0x5635bf413100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:30.579 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.573+0000 7f582ad9d640 1 --2- 172.21.15.19:0/2262991632 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5635bf4022e0 0x5635bf413100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:30.579 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.573+0000 7f582ad9d640 1 -- 172.21.15.19:0/2262991632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5635bf4019a0 msgr2=0x5635bf40c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:30.579 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.573+0000 7f582ad9d640 1 --2- 172.21.15.19:0/2262991632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5635bf4019a0 0x5635bf40c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:30.579 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.573+0000 7f582ad9d640 1 -- 172.21.15.19:0/2262991632 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635bf3fce30 con 0x5635bf407370 2024-09-19T09:02:30.579 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.573+0000 7f582a59c640 1 --2- 172.21.15.19:0/2262991632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5635bf4019a0 0x5635bf40c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:02:30.579 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.573+0000 7f5829d9b640 1 --2- 172.21.15.19:0/2262991632 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5635bf4022e0 0x5635bf413100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:02:30.579 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.573+0000 7f582ad9d640 1 --2- 172.21.15.19:0/2262991632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5635bf407370 0x5635bf3fc0b0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f5824009ca0 tx=0x7f5824041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93472e1fff3017dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:30.579 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.573+0000 7f5813fff640 1 -- 172.21.15.19:0/2262991632 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5824004240 con 0x5635bf407370 2024-09-19T09:02:30.580 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.573+0000 7f5813fff640 1 -- 172.21.15.19:0/2262991632 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5824056070 con 0x5635bf407370 2024-09-19T09:02:30.580 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.573+0000 7f5813fff640 1 -- 172.21.15.19:0/2262991632 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58240305c0 con 0x5635bf407370 2024-09-19T09:02:30.580 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.574+0000 7f5833bc7740 1 -- 172.21.15.19:0/2262991632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5635bf407370 msgr2=0x5635bf3fc0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:30.580 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.574+0000 7f5833bc7740 1 --2- 172.21.15.19:0/2262991632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5635bf407370 0x5635bf3fc0b0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f5824009ca0 tx=0x7f5824041000 comp rx=0 tx=0).stop 2024-09-19T09:02:30.580 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.574+0000 7f5833bc7740 1 -- 172.21.15.19:0/2262991632 shutdown_connections 2024-09-19T09:02:30.580 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.574+0000 7f5833bc7740 1 --2- 172.21.15.19:0/2262991632 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5635bf4022e0 0x5635bf413100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:30.580 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.574+0000 7f5833bc7740 1 --2- 172.21.15.19:0/2262991632 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5635bf407370 0x5635bf3fc0b0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:30.580 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.574+0000 7f5833bc7740 1 --2- 172.21.15.19:0/2262991632 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5635bf4019a0 0x5635bf40c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:30.580 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.574+0000 7f5833bc7740 1 -- 172.21.15.19:0/2262991632 >> 172.21.15.19:0/2262991632 conn(0x5635bf3fd010 msgr2=0x5635bf3fb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:30.580 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.574+0000 7f5833bc7740 1 -- 172.21.15.19:0/2262991632 shutdown_connections 2024-09-19T09:02:30.580 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.574+0000 7f5833bc7740 1 -- 172.21.15.19:0/2262991632 wait complete. 2024-09-19T09:02:30.580 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.574+0000 7f5833bc7740 1 -- start start 2024-09-19T09:02:30.580 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.574+0000 7f5833bc7740 1 Processor -- start 2024-09-19T09:02:30.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.574+0000 7f5833bc7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5635bf4019a0 0x5635bf40ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:30.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.574+0000 7f5833bc7740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5635bf4022e0 0x5635bf4104b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:30.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.574+0000 7f5833bc7740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5635bf407370 0x5635bf480270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:30.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.574+0000 7f5833bc7740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f582c1ac670 con 0x5635bf407370 2024-09-19T09:02:30.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.574+0000 7f5833bc7740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f582c1abfa0 con 0x5635bf4022e0 2024-09-19T09:02:30.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.574+0000 7f5833bc7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f582c1a91e0 con 0x5635bf4019a0 2024-09-19T09:02:30.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.574+0000 7f5833bc7740 10 client.0 _ll_register_callbacks cb 0x7f5820005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:30.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.575+0000 7f582ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5635bf407370 0x5635bf480270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:30.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.575+0000 7f5829d9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5635bf4022e0 0x5635bf4104b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:30.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.575+0000 7f582a59c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5635bf4019a0 0x5635bf40ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:30.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.575+0000 7f5829d9b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5635bf4022e0 0x5635bf4104b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:45688/0 (socket says 172.21.15.19:45688) 2024-09-19T09:02:30.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.575+0000 7f582ad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5635bf407370 0x5635bf480270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:41032/0 (socket says 172.21.15.19:41032) 2024-09-19T09:02:30.581 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.575+0000 7f5829d9b640 1 -- 172.21.15.19:0/2051293773 learned_addr learned my addr 172.21.15.19:0/2051293773 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:02:30.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.575+0000 7f582ad9d640 1 -- 172.21.15.19:0/2051293773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5635bf4019a0 msgr2=0x5635bf40ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:30.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.575+0000 7f582ad9d640 1 --2- 172.21.15.19:0/2051293773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5635bf4019a0 0x5635bf40ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:30.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.575+0000 7f582ad9d640 1 -- 172.21.15.19:0/2051293773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5635bf4022e0 msgr2=0x5635bf4104b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:30.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.575+0000 7f582ad9d640 1 --2- 172.21.15.19:0/2051293773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5635bf4022e0 0x5635bf4104b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:30.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.575+0000 7f582ad9d640 1 -- 172.21.15.19:0/2051293773 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635bf4807b0 con 0x5635bf407370 2024-09-19T09:02:30.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.575+0000 7f5829d9b640 1 --2- 172.21.15.19:0/2051293773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5635bf4022e0 0x5635bf4104b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:02:30.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.575+0000 7f582ad9d640 1 --2- 172.21.15.19:0/2051293773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5635bf407370 0x5635bf480270 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f5824031ae0 tx=0x7f582402fb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37fbe29013bfea59 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:30.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.575+0000 7f5811ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:02:30.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.575+0000 7f5811ffb640 1 -- 172.21.15.19:0/2051293773 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f582405e070 con 0x5635bf407370 2024-09-19T09:02:30.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.575+0000 7f5811ffb640 1 -- 172.21.15.19:0/2051293773 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8211+0+0 (secure 0 0 0) 0x7f58240041c0 con 0x5635bf407370 2024-09-19T09:02:30.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.575+0000 7f5833bc7740 1 -- 172.21.15.19:0/2051293773 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5824056070 con 0x5635bf407370 2024-09-19T09:02:30.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.576+0000 7f5811ffb640 1 -- 172.21.15.19:0/2051293773 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f58240043c0 con 0x5635bf407370 2024-09-19T09:02:30.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.576+0000 7f5833bc7740 10 client.17745 fetch_fsmap learned FSMap version 37 2024-09-19T09:02:30.582 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.576+0000 7f5833bc7740 1 -- 172.21.15.19:0/2051293773 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x5635bf481960 con 0x5635bf407370 2024-09-19T09:02:30.583 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.576+0000 7f5811ffb640 1 -- 172.21.15.19:0/2051293773 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5824056070 con 0x5635bf407370 2024-09-19T09:02:30.583 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.576+0000 7f5811ffb640 1 -- 172.21.15.19:0/2051293773 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 37) ==== 8362+0+0 (secure 0 0 0) 0x7f5824063460 con 0x5635bf407370 2024-09-19T09:02:30.583 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.576+0000 7f5833bc7740 10 client.17745 fetch_fsmap finished waiting for FSMap version 37 2024-09-19T09:02:30.583 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.576+0000 7f5833bc7740 10 client.17745 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:02:30.583 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.576+0000 7f5833bc7740 20 client.17745 populate_metadata read hostname 'smithi019' 2024-09-19T09:02:30.583 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.576+0000 7f5833bc7740 1 --2- 172.21.15.19:0/2051293773 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5635bf4175d0 0x5635bf484350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:30.583 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.576+0000 7f5833bc7740 4 client.17745 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:02:30.583 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.576+0000 7f5833bc7740 1 -- 172.21.15.19:0/2051293773 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5635bf36cd70 con 0x5635bf4175d0 2024-09-19T09:02:30.583 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.576+0000 7f582a59c640 1 --2- 172.21.15.19:0/2051293773 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5635bf4175d0 0x5635bf484350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:30.583 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.577+0000 7f582a59c640 1 --2- 172.21.15.19:0/2051293773 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5635bf4175d0 0x5635bf484350 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=906f5b75bbfff029 server_cookie=b64f698155f48c21 in_seq=0 out_seq=0 2024-09-19T09:02:30.583 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:30.577+0000 7f5811ffb640 10 client.17745 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:02:31.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:31 smithi155 ceph-mon[34921]: pgmap v647: 97 pgs: 97 active+clean; 29 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 437 op/s 2024-09-19T09:02:31.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:31 smithi203 ceph-mon[35450]: pgmap v647: 97 pgs: 97 active+clean; 29 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 437 op/s 2024-09-19T09:02:32.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:31 smithi019 ceph-mon[30976]: pgmap v647: 97 pgs: 97 active+clean; 29 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.7 MiB/s wr, 437 op/s 2024-09-19T09:02:33.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:33 smithi155 ceph-mon[34921]: pgmap v648: 97 pgs: 97 active+clean; 34 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 526 op/s 2024-09-19T09:02:33.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:33 smithi203 ceph-mon[35450]: pgmap v648: 97 pgs: 97 active+clean; 34 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 526 op/s 2024-09-19T09:02:34.029 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:33 smithi019 ceph-mon[30976]: pgmap v648: 97 pgs: 97 active+clean; 34 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 526 op/s 2024-09-19T09:02:34.761 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:34.759+0000 7f5811ffb640 1 -- 172.21.15.19:0/2051293773 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5635bf36cd70 con 0x5635bf4175d0 2024-09-19T09:02:34.761 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:34.759+0000 7f5811ffb640 10 client.17745 handle_command_reply: tid=0 2024-09-19T09:02:34.761 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:34.759+0000 7f5833bc7740 1 client.17745 shutdown 2024-09-19T09:02:34.761 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:34.759+0000 7f5833bc7740 1 -- 172.21.15.19:0/2051293773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5635bf407370 msgr2=0x5635bf480270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:34.761 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:34.759+0000 7f5833bc7740 1 --2- 172.21.15.19:0/2051293773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5635bf407370 0x5635bf480270 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f5824031ae0 tx=0x7f582402fb80 comp rx=0 tx=0).stop 2024-09-19T09:02:34.761 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:34.759+0000 7f5833bc7740 1 -- 172.21.15.19:0/2051293773 shutdown_connections 2024-09-19T09:02:34.761 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:34.759+0000 7f5833bc7740 1 --2- 172.21.15.19:0/2051293773 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5635bf4175d0 0x5635bf484350 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:34.762 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:34.759+0000 7f5833bc7740 1 --2- 172.21.15.19:0/2051293773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5635bf407370 0x5635bf480270 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:34.762 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:34.759+0000 7f5811ffb640 0 client.17745 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:02:34.762 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:34.759+0000 7f5833bc7740 1 --2- 172.21.15.19:0/2051293773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5635bf4022e0 0x5635bf4104b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:34.762 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:34.759+0000 7f5833bc7740 1 --2- 172.21.15.19:0/2051293773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5635bf4019a0 0x5635bf40ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:34.762 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:34.759+0000 7f5833bc7740 1 -- 172.21.15.19:0/2051293773 >> 172.21.15.19:0/2051293773 conn(0x5635bf3fd010 msgr2=0x5635bf3fc1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:34.762 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:34.760+0000 7f5833bc7740 1 -- 172.21.15.19:0/2051293773 shutdown_connections 2024-09-19T09:02:34.762 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:34.760+0000 7f5833bc7740 1 -- 172.21.15.19:0/2051293773 wait complete. 2024-09-19T09:02:34.762 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:34.760+0000 7f5833bc7740 20 client.17745 trim_cache size 0 max 16384 2024-09-19T09:02:34.762 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T09:02:34.762 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T09:02:34.763 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T09:02:34.763 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T09:02:34.763 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:34.760+0000 7f5830d4b640 1 -- 172.21.15.19:0/3312953935 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f58140a32f0 msgr2=0x7f58140a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:34.763 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:34.760+0000 7f5830d4b640 1 --2- 172.21.15.19:0/3312953935 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f58140a32f0 0x7f58140a57b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f5824005e30 tx=0x7f582403d040 comp rx=0 tx=0).stop 2024-09-19T09:02:34.763 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:34.760+0000 7f5830d4b640 1 -- 172.21.15.19:0/3312953935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f582c102d50 msgr2=0x7f582c19a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:34.764 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:34.760+0000 7f5830d4b640 1 --2- 172.21.15.19:0/3312953935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f582c102d50 0x7f582c19a510 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f582000e9f0 tx=0x7f582000edf0 comp rx=0 tx=0).stop 2024-09-19T09:02:34.764 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:34.760+0000 7f5830d4b640 1 -- 172.21.15.19:0/3312953935 shutdown_connections 2024-09-19T09:02:34.764 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:34.760+0000 7f5830d4b640 1 --2- 172.21.15.19:0/3312953935 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f58140a32f0 0x7f58140a57b0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:34.764 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:34.760+0000 7f5830d4b640 1 --2- 172.21.15.19:0/3312953935 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f582c103710 0x7f582c1a1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:34.764 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:34.760+0000 7f5830d4b640 1 --2- 172.21.15.19:0/3312953935 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f582c102d50 0x7f582c19a510 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:34.764 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:34.760+0000 7f5830d4b640 1 --2- 172.21.15.19:0/3312953935 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f582c101b60 0x7f582c199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:34.764 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:34.760+0000 7f5830d4b640 1 -- 172.21.15.19:0/3312953935 >> 172.21.15.19:0/3312953935 conn(0x7f582c0fd2e0 msgr2=0x7f582c074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:34.764 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:34.760+0000 7f5830d4b640 1 -- 172.21.15.19:0/3312953935 shutdown_connections 2024-09-19T09:02:34.764 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:34.760+0000 7f5830d4b640 1 -- 172.21.15.19:0/3312953935 wait complete. 2024-09-19T09:02:35.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:35 smithi019 ceph-mon[30976]: pgmap v649: 97 pgs: 97 active+clean; 34 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 484 op/s 2024-09-19T09:02:35.819 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:02:35 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-g[187420]: *** Caught signal (Segmentation fault) ** 2024-09-19T09:02:35.819 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:02:35 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-g[187420]: in thread 7f4db1a1e640 thread_name:MR_Finisher 2024-09-19T09:02:35.819 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:02:35 smithi019 podman[201270]: 2024-09-19 09:02:35.580833637 +0000 UTC m=+0.019481799 container died 1afde72a9cfd38a1b12175a1b7c7c9311e7a2aecbcb90b709733f644488fc762 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-g, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T09:02:35.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:35 smithi155 ceph-mon[34921]: pgmap v649: 97 pgs: 97 active+clean; 34 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 484 op/s 2024-09-19T09:02:35.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:35 smithi203 ceph-mon[35450]: pgmap v649: 97 pgs: 97 active+clean; 34 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 484 op/s 2024-09-19T09:02:36.513 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:02:36 smithi019 podman[201270]: 2024-09-19 09:02:36.231535656 +0000 UTC m=+0.670183820 container remove 1afde72a9cfd38a1b12175a1b7c7c9311e7a2aecbcb90b709733f644488fc762 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4) 2024-09-19T09:02:36.513 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:02:36 smithi019 systemd[1]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.g.service: Main process exited, code=exited, status=139/n/a 2024-09-19T09:02:36.818 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:02:36 smithi019 systemd[1]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.g.service: Failed with result 'exit-code'. 2024-09-19T09:02:36.818 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:02:36 smithi019 systemd[1]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.g.service: Consumed 7.214s CPU time. 2024-09-19T09:02:37.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:37 smithi155 ceph-mon[34921]: pgmap v650: 97 pgs: 97 active+clean; 30 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 575 op/s 2024-09-19T09:02:37.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:37 smithi203 ceph-mon[35450]: pgmap v650: 97 pgs: 97 active+clean; 30 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 575 op/s 2024-09-19T09:02:38.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:37 smithi019 ceph-mon[30976]: pgmap v650: 97 pgs: 97 active+clean; 30 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.2 MiB/s wr, 575 op/s 2024-09-19T09:02:39.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:39 smithi155 ceph-mon[34921]: pgmap v651: 97 pgs: 97 active+clean; 22 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 761 op/s 2024-09-19T09:02:39.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:39 smithi203 ceph-mon[35450]: pgmap v651: 97 pgs: 97 active+clean; 22 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 761 op/s 2024-09-19T09:02:40.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:39 smithi019 ceph-mon[30976]: pgmap v651: 97 pgs: 97 active+clean; 22 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 1.9 MiB/s wr, 761 op/s 2024-09-19T09:02:41.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:41 smithi155 ceph-mon[34921]: pgmap v652: 97 pgs: 97 active+clean; 15 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 702 op/s 2024-09-19T09:02:41.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:41 smithi203 ceph-mon[35450]: pgmap v652: 97 pgs: 97 active+clean; 15 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 702 op/s 2024-09-19T09:02:42.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:41 smithi019 ceph-mon[30976]: pgmap v652: 97 pgs: 97 active+clean; 15 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.6 MiB/s wr, 702 op/s 2024-09-19T09:02:43.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:43 smithi155 ceph-mon[34921]: pgmap v653: 97 pgs: 97 active+clean; 17 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 939 KiB/s rd, 1.4 MiB/s wr, 881 op/s 2024-09-19T09:02:43.981 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:43 smithi203 ceph-mon[35450]: pgmap v653: 97 pgs: 97 active+clean; 17 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 939 KiB/s rd, 1.4 MiB/s wr, 881 op/s 2024-09-19T09:02:44.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:43 smithi019 ceph-mon[30976]: pgmap v653: 97 pgs: 97 active+clean; 17 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 939 KiB/s rd, 1.4 MiB/s wr, 881 op/s 2024-09-19T09:02:45.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:45 smithi155 ceph-mon[34921]: pgmap v654: 97 pgs: 97 active+clean; 20 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 1.3 MiB/s wr, 816 op/s 2024-09-19T09:02:45.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:45 smithi203 ceph-mon[35450]: pgmap v654: 97 pgs: 97 active+clean; 20 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 1.3 MiB/s wr, 816 op/s 2024-09-19T09:02:46.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:45 smithi019 ceph-mon[30976]: pgmap v654: 97 pgs: 97 active+clean; 20 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 1.3 MiB/s wr, 816 op/s 2024-09-19T09:02:46.823 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:02:46 smithi019 systemd[1]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.g.service: Scheduled restart job, restart counter is at 2. 2024-09-19T09:02:46.823 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:02:46 smithi019 systemd[1]: Stopped Ceph mds.g for f26c9d84-7662-11ef-bceb-c7b262605968. 2024-09-19T09:02:46.824 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:02:46 smithi019 systemd[1]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.g.service: Consumed 7.214s CPU time. 2024-09-19T09:02:46.824 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:02:46 smithi019 systemd[1]: Starting Ceph mds.g for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T09:02:46.824 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:02:46 smithi019 podman[205344]: 2024-09-19 09:02:46.700956481 +0000 UTC m=+0.017007972 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:02:46.824 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:02:46 smithi019 podman[205344]: 2024-09-19 09:02:46.823973626 +0000 UTC m=+0.140025118 container create f83aaeebe936bf13065721668f4fa528b3093b78aa4854deb06e315c8ccea37e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-g, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:02:47.569 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:02:47 smithi019 podman[205344]: 2024-09-19 09:02:47.077199448 +0000 UTC m=+0.393250947 container init f83aaeebe936bf13065721668f4fa528b3093b78aa4854deb06e315c8ccea37e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-g, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-19T09:02:47.569 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:02:47 smithi019 podman[205344]: 2024-09-19 09:02:47.080696559 +0000 UTC m=+0.396748057 container start f83aaeebe936bf13065721668f4fa528b3093b78aa4854deb06e315c8ccea37e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-g, RELEASE=squid-2f599a4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-19T09:02:47.569 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:02:47 smithi019 ceph-mds[205526]: -- 172.21.15.19:0/2322400462 <== mon.0 v2:172.21.15.19:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c96707f860 con 0x55c96705d000 2024-09-19T09:02:47.569 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:02:47 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-g[205495]: starting mds.g at 2024-09-19T09:02:47.569 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:02:47 smithi019 bash[205344]: f83aaeebe936bf13065721668f4fa528b3093b78aa4854deb06e315c8ccea37e 2024-09-19T09:02:47.569 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:02:47 smithi019 systemd[1]: Started Ceph mds.g for f26c9d84-7662-11ef-bceb-c7b262605968. 2024-09-19T09:02:47.642 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:47 smithi203 ceph-mon[35450]: pgmap v655: 97 pgs: 97 active+clean; 22 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 1.4 MiB/s wr, 769 op/s 2024-09-19T09:02:47.642 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:47 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:02:47.642 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:47 smithi203 ceph-mon[35450]: daemon mds.g restarted 2024-09-19T09:02:47.867 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.865+0000 7ff85c36d640 1 -- 172.21.15.19:0/2183896643 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff854101c40 msgr2=0x7ff8541020c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:47.868 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.865+0000 7ff85c36d640 1 --2- 172.21.15.19:0/2183896643 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff854101c40 0x7ff8541020c0 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7ff844009900 tx=0x7ff84402a410 comp rx=0 tx=0).stop 2024-09-19T09:02:47.868 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.865+0000 7ff85c36d640 1 -- 172.21.15.19:0/2183896643 shutdown_connections 2024-09-19T09:02:47.868 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.865+0000 7ff85c36d640 1 --2- 172.21.15.19:0/2183896643 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff854102600 0x7ff854108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:47.868 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.865+0000 7ff85c36d640 1 --2- 172.21.15.19:0/2183896643 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff854101c40 0x7ff8541020c0 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:47.868 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.865+0000 7ff85c36d640 1 --2- 172.21.15.19:0/2183896643 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff854100a50 0x7ff854100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:47.868 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.865+0000 7ff85c36d640 1 -- 172.21.15.19:0/2183896643 >> 172.21.15.19:0/2183896643 conn(0x7ff8540fc1b0 msgr2=0x7ff8540fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:47.868 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.865+0000 7ff85c36d640 1 -- 172.21.15.19:0/2183896643 shutdown_connections 2024-09-19T09:02:47.868 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.865+0000 7ff85c36d640 1 -- 172.21.15.19:0/2183896643 wait complete. 2024-09-19T09:02:47.868 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.865+0000 7ff85c36d640 1 Processor -- start 2024-09-19T09:02:47.868 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.865+0000 7ff85c36d640 1 -- start start 2024-09-19T09:02:47.868 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.865+0000 7ff85c36d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff854100a50 0x7ff854196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:47.869 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.865+0000 7ff85c36d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff854101c40 0x7ff854197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:47.869 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.865+0000 7ff85c36d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff854102600 0x7ff85419e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:47.869 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.865+0000 7ff85c36d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff85410c700 con 0x7ff854102600 2024-09-19T09:02:47.869 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.865+0000 7ff85c36d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff85410c580 con 0x7ff854101c40 2024-09-19T09:02:47.869 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.865+0000 7ff85c36d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff85410c880 con 0x7ff854100a50 2024-09-19T09:02:47.869 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.866+0000 7ff85a90a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff854102600 0x7ff85419e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:47.869 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.866+0000 7ff859908640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff854101c40 0x7ff854197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:47.869 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.866+0000 7ff859908640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff854101c40 0x7ff854197250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:37532/0 (socket says 172.21.15.19:37532) 2024-09-19T09:02:47.869 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.866+0000 7ff859908640 1 -- 172.21.15.19:0/4202943315 learned_addr learned my addr 172.21.15.19:0/4202943315 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:02:47.869 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.866+0000 7ff85a109640 1 --2- 172.21.15.19:0/4202943315 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff854100a50 0x7ff854196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:47.869 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.866+0000 7ff85a109640 1 -- 172.21.15.19:0/4202943315 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff854101c40 msgr2=0x7ff854197250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:47.869 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.866+0000 7ff85a109640 1 --2- 172.21.15.19:0/4202943315 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff854101c40 0x7ff854197250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:47.870 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.866+0000 7ff85a109640 1 -- 172.21.15.19:0/4202943315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff854102600 msgr2=0x7ff85419e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:47.870 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.866+0000 7ff85a109640 1 --2- 172.21.15.19:0/4202943315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff854102600 0x7ff85419e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:47.870 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.866+0000 7ff85a109640 1 -- 172.21.15.19:0/4202943315 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff85419e920 con 0x7ff854100a50 2024-09-19T09:02:47.870 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.866+0000 7ff85a90a640 1 --2- 172.21.15.19:0/4202943315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff854102600 0x7ff85419e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:02:47.870 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.866+0000 7ff85a109640 1 --2- 172.21.15.19:0/4202943315 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff854100a50 0x7ff854196d10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff850009b90 tx=0x7ff85000b690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:47.870 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.867+0000 7ff84b7fe640 1 -- 172.21.15.19:0/4202943315 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85000be60 con 0x7ff854100a50 2024-09-19T09:02:47.870 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.867+0000 7ff84b7fe640 1 -- 172.21.15.19:0/4202943315 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff8500035f0 con 0x7ff854100a50 2024-09-19T09:02:47.870 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.867+0000 7ff85c36d640 1 -- 172.21.15.19:0/4202943315 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff85406a120 con 0x7ff854100a50 2024-09-19T09:02:47.870 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.867+0000 7ff84b7fe640 1 -- 172.21.15.19:0/4202943315 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff850019670 con 0x7ff854100a50 2024-09-19T09:02:47.870 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.867+0000 7ff85c36d640 1 -- 172.21.15.19:0/4202943315 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff85406a670 con 0x7ff854100a50 2024-09-19T09:02:47.872 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.869+0000 7ff84b7fe640 1 -- 172.21.15.19:0/4202943315 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7ff850020020 con 0x7ff854100a50 2024-09-19T09:02:47.873 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.870+0000 7ff85f1eb740 1 Processor -- start 2024-09-19T09:02:47.873 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.870+0000 7ff85f1eb740 1 -- start start 2024-09-19T09:02:47.873 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.870+0000 7ff85f1eb740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576f696f9a0 0x5576f696fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:47.873 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.870+0000 7ff85f1eb740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576f69702e0 0x5576f6974da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:47.873 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.870+0000 7ff85f1eb740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576f6975370 0x5576f6977830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:47.873 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.870+0000 7ff85f1eb740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5576f68d32f0 con 0x5576f696f9a0 2024-09-19T09:02:47.873 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.870+0000 7ff85f1eb740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5576f687b270 con 0x5576f6975370 2024-09-19T09:02:47.873 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.870+0000 7ff85f1eb740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5576f68cf2b0 con 0x5576f69702e0 2024-09-19T09:02:47.873 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.870+0000 7ff85a109640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576f69702e0 0x5576f6974da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:47.873 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.870+0000 7ff85a90a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576f696f9a0 0x5576f696fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:47.874 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.870+0000 7ff85a90a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576f696f9a0 0x5576f696fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33958/0 (socket says 172.21.15.19:33958) 2024-09-19T09:02:47.874 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.870+0000 7ff85a109640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576f69702e0 0x5576f6974da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:33676/0 (socket says 172.21.15.19:33676) 2024-09-19T09:02:47.874 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.870+0000 7ff859908640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576f6975370 0x5576f6977830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:47.874 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.870+0000 7ff85a90a640 1 -- 172.21.15.19:0/2910319339 learned_addr learned my addr 172.21.15.19:0/2910319339 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:02:47.874 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.871+0000 7ff84b7fe640 1 --2- 172.21.15.19:0/4202943315 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff8400a32f0 0x7ff8400a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:47.874 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.871+0000 7ff85a109640 1 -- 172.21.15.19:0/2910319339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576f6975370 msgr2=0x5576f6977830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:47.874 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.871+0000 7ff85a109640 1 --2- 172.21.15.19:0/2910319339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576f6975370 0x5576f6977830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:47.874 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.871+0000 7ff85a109640 1 -- 172.21.15.19:0/2910319339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576f696f9a0 msgr2=0x5576f696fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:47.874 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.871+0000 7ff85a109640 1 --2- 172.21.15.19:0/2910319339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576f696f9a0 0x5576f696fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:47.874 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.871+0000 7ff85a109640 1 -- 172.21.15.19:0/2910319339 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576f687a340 con 0x5576f69702e0 2024-09-19T09:02:47.874 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.871+0000 7ff85a90a640 1 --2- 172.21.15.19:0/4202943315 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff8400a32f0 0x7ff8400a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:47.874 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.871+0000 7ff84b7fe640 1 -- 172.21.15.19:0/4202943315 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7ff8500d3310 con 0x7ff854100a50 2024-09-19T09:02:47.874 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.871+0000 7ff85a109640 1 --2- 172.21.15.19:0/2910319339 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576f69702e0 0x5576f6974da0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff85009f5e0 tx=0x7ff850024000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db65d67e0835ebf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:47.874 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.871+0000 7ff85a90a640 1 --2- 172.21.15.19:0/4202943315 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff8400a32f0 0x7ff8400a57b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff84c005fd0 tx=0x7ff84c004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:47.875 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.871+0000 7ff848bfe640 1 -- 172.21.15.19:0/2910319339 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85009f240 con 0x5576f69702e0 2024-09-19T09:02:47.875 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.871+0000 7ff848bfe640 1 -- 172.21.15.19:0/2910319339 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff85009ffe0 con 0x5576f69702e0 2024-09-19T09:02:47.875 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.871+0000 7ff848bfe640 1 -- 172.21.15.19:0/2910319339 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85009da20 con 0x5576f69702e0 2024-09-19T09:02:47.879 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.872+0000 7ff85f1eb740 1 -- 172.21.15.19:0/2910319339 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576f69702e0 msgr2=0x5576f6974da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:47.879 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.872+0000 7ff85f1eb740 1 --2- 172.21.15.19:0/2910319339 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576f69702e0 0x5576f6974da0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff85009f5e0 tx=0x7ff850024000 comp rx=0 tx=0).stop 2024-09-19T09:02:47.879 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.873+0000 7ff85f1eb740 1 -- 172.21.15.19:0/2910319339 shutdown_connections 2024-09-19T09:02:47.879 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.873+0000 7ff85f1eb740 1 --2- 172.21.15.19:0/2910319339 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576f69702e0 0x5576f6974da0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:47.879 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.873+0000 7ff85f1eb740 1 --2- 172.21.15.19:0/2910319339 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576f6975370 0x5576f6977830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:47.879 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.873+0000 7ff85f1eb740 1 --2- 172.21.15.19:0/2910319339 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576f696f9a0 0x5576f696fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:47.879 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.873+0000 7ff85f1eb740 1 -- 172.21.15.19:0/2910319339 >> 172.21.15.19:0/2910319339 conn(0x5576f696b010 msgr2=0x5576f696b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:47.879 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.873+0000 7ff85f1eb740 1 -- 172.21.15.19:0/2910319339 shutdown_connections 2024-09-19T09:02:47.879 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.873+0000 7ff85f1eb740 1 -- 172.21.15.19:0/2910319339 wait complete. 2024-09-19T09:02:47.880 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.873+0000 7ff85f1eb740 1 -- start start 2024-09-19T09:02:47.880 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.873+0000 7ff85f1eb740 1 Processor -- start 2024-09-19T09:02:47.880 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.873+0000 7ff85f1eb740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576f696f9a0 0x5576f6979b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:47.880 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.873+0000 7ff85f1eb740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576f69702e0 0x5576f697a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:47.880 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.873+0000 7ff85f1eb740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576f6975370 0x5576f69810e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:47.880 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.873+0000 7ff85f1eb740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5576f69782e0 con 0x5576f69702e0 2024-09-19T09:02:47.880 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.873+0000 7ff85f1eb740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5576f685c290 con 0x5576f696f9a0 2024-09-19T09:02:47.880 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.873+0000 7ff85f1eb740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5576f6978460 con 0x5576f6975370 2024-09-19T09:02:47.880 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.874+0000 7ff85f1eb740 10 client.0 _ll_register_callbacks cb 0x5576f688d140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:47.880 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.874+0000 7ff859908640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576f69702e0 0x5576f697a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:47.880 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.874+0000 7ff859908640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576f69702e0 0x5576f697a0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33966/0 (socket says 172.21.15.19:33966) 2024-09-19T09:02:47.880 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.874+0000 7ff859908640 1 -- 172.21.15.19:0/3224342113 learned_addr learned my addr 172.21.15.19:0/3224342113 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:02:47.881 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.874+0000 7ff85a90a640 1 --2- 172.21.15.19:0/3224342113 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576f6975370 0x5576f69810e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:47.881 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.874+0000 7ff85a109640 1 --2- 172.21.15.19:0/3224342113 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576f696f9a0 0x5576f6979b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:47.881 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.874+0000 7ff859908640 1 -- 172.21.15.19:0/3224342113 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576f6975370 msgr2=0x5576f69810e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:47.881 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.874+0000 7ff859908640 1 --2- 172.21.15.19:0/3224342113 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576f6975370 0x5576f69810e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:47.881 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.874+0000 7ff859908640 1 -- 172.21.15.19:0/3224342113 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576f696f9a0 msgr2=0x5576f6979b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:47.881 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.874+0000 7ff859908640 1 --2- 172.21.15.19:0/3224342113 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576f696f9a0 0x5576f6979b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:47.881 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.874+0000 7ff859908640 1 -- 172.21.15.19:0/3224342113 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576f65e6210 con 0x5576f69702e0 2024-09-19T09:02:47.881 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.874+0000 7ff85a90a640 1 --2- 172.21.15.19:0/3224342113 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576f6975370 0x5576f69810e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:02:47.881 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.874+0000 7ff859908640 1 --2- 172.21.15.19:0/3224342113 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576f69702e0 0x5576f697a0a0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7ff84402aa00 tx=0x7ff844004580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd12a8e2f3d46ddf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:47.881 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.874+0000 7ff83dffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:02:47.881 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.874+0000 7ff83dffb640 1 -- 172.21.15.19:0/3224342113 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff844035040 con 0x5576f69702e0 2024-09-19T09:02:47.881 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.874+0000 7ff83dffb640 1 -- 172.21.15.19:0/3224342113 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7ff844031b40 con 0x5576f69702e0 2024-09-19T09:02:47.881 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.874+0000 7ff85f1eb740 1 -- 172.21.15.19:0/3224342113 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff85009ffe0 con 0x5576f69702e0 2024-09-19T09:02:47.882 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.874+0000 7ff83dffb640 1 -- 172.21.15.19:0/3224342113 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7ff844031d40 con 0x5576f69702e0 2024-09-19T09:02:47.882 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.874+0000 7ff85f1eb740 10 client.17763 fetch_fsmap learned FSMap version 39 2024-09-19T09:02:47.882 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.874+0000 7ff85f1eb740 1 -- 172.21.15.19:0/3224342113 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5576f66b2620 con 0x5576f69702e0 2024-09-19T09:02:47.882 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.875+0000 7ff83dffb640 1 -- 172.21.15.19:0/3224342113 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff85009ffe0 con 0x5576f69702e0 2024-09-19T09:02:47.882 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.875+0000 7ff83dffb640 1 -- 172.21.15.19:0/3224342113 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7ff844042860 con 0x5576f69702e0 2024-09-19T09:02:47.882 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.875+0000 7ff85f1eb740 10 client.17763 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:02:47.882 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.875+0000 7ff85f1eb740 10 client.17763 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:02:47.882 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.875+0000 7ff85f1eb740 20 client.17763 populate_metadata read hostname 'smithi019' 2024-09-19T09:02:47.882 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.875+0000 7ff85f1eb740 1 --2- 172.21.15.19:0/3224342113 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5576f6985890 0x5576f6987ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:47.882 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.875+0000 7ff85f1eb740 4 client.17763 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:02:47.882 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.875+0000 7ff85f1eb740 1 -- 172.21.15.19:0/3224342113 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576f68e0a20 con 0x5576f6985890 2024-09-19T09:02:47.882 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.875+0000 7ff85a109640 1 --2- 172.21.15.19:0/3224342113 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5576f6985890 0x5576f6987ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:47.882 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.875+0000 7ff85a109640 1 --2- 172.21.15.19:0/3224342113 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5576f6985890 0x5576f6987ca0 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdb57265b00119dd server_cookie=2c65cf05ee5e9a93 in_seq=0 out_seq=0 2024-09-19T09:02:47.882 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.875+0000 7ff83dffb640 10 client.17763 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:02:47.883 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.877+0000 7ff83dffb640 1 -- 172.21.15.19:0/3224342113 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5576f68e0a20 con 0x5576f6985890 2024-09-19T09:02:47.883 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.877+0000 7ff83dffb640 10 client.17763 handle_command_reply: tid=0 2024-09-19T09:02:47.883 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.877+0000 7ff85f1eb740 1 client.17763 shutdown 2024-09-19T09:02:47.883 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.877+0000 7ff85f1eb740 1 -- 172.21.15.19:0/3224342113 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576f69702e0 msgr2=0x5576f697a0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:47.883 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.877+0000 7ff85f1eb740 1 --2- 172.21.15.19:0/3224342113 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576f69702e0 0x5576f697a0a0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7ff84402aa00 tx=0x7ff844004580 comp rx=0 tx=0).stop 2024-09-19T09:02:47.883 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.877+0000 7ff85f1eb740 1 -- 172.21.15.19:0/3224342113 shutdown_connections 2024-09-19T09:02:47.883 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.877+0000 7ff85f1eb740 1 --2- 172.21.15.19:0/3224342113 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5576f6985890 0x5576f6987ca0 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:47.883 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.877+0000 7ff85f1eb740 1 --2- 172.21.15.19:0/3224342113 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576f6975370 0x5576f69810e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:47.883 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.877+0000 7ff85f1eb740 1 --2- 172.21.15.19:0/3224342113 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576f69702e0 0x5576f697a0a0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:47.883 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.877+0000 7ff83dffb640 0 client.17763 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:02:47.883 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.877+0000 7ff85f1eb740 1 --2- 172.21.15.19:0/3224342113 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576f696f9a0 0x5576f6979b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:47.883 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.877+0000 7ff85f1eb740 1 -- 172.21.15.19:0/3224342113 >> 172.21.15.19:0/3224342113 conn(0x5576f696b010 msgr2=0x5576f696c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:47.883 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.877+0000 7ff85f1eb740 1 -- 172.21.15.19:0/3224342113 shutdown_connections 2024-09-19T09:02:47.883 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.877+0000 7ff85f1eb740 1 -- 172.21.15.19:0/3224342113 wait complete. 2024-09-19T09:02:47.884 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.877+0000 7ff85f1eb740 20 client.17763 trim_cache size 0 max 16384 2024-09-19T09:02:47.890 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:47 smithi019 ceph-mon[30976]: pgmap v655: 97 pgs: 97 active+clean; 22 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 1.4 MiB/s wr, 769 op/s 2024-09-19T09:02:47.890 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:47 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:02:47.890 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:47 smithi019 ceph-mon[30976]: daemon mds.g restarted 2024-09-19T09:02:47.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.895+0000 7ff85f1eb740 1 Processor -- start 2024-09-19T09:02:47.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.895+0000 7ff85f1eb740 1 -- start start 2024-09-19T09:02:47.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.896+0000 7ff85f1eb740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576f696f9a0 0x5576f696fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:47.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.896+0000 7ff85f1eb740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576f69702e0 0x5576f69810a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:47.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.896+0000 7ff85f1eb740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576f6975370 0x5576f696a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:47.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.896+0000 7ff85f1eb740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff8541a6cb0 con 0x5576f696f9a0 2024-09-19T09:02:47.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.896+0000 7ff85f1eb740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff8541a87f0 con 0x5576f69702e0 2024-09-19T09:02:47.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.896+0000 7ff85f1eb740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff8541a7380 con 0x5576f6975370 2024-09-19T09:02:47.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.896+0000 7ff85a109640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576f696f9a0 0x5576f696fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:47.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.896+0000 7ff85a109640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576f696f9a0 0x5576f696fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33978/0 (socket says 172.21.15.19:33978) 2024-09-19T09:02:47.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.896+0000 7ff85a109640 1 -- 172.21.15.19:0/1897639834 learned_addr learned my addr 172.21.15.19:0/1897639834 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:02:47.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.896+0000 7ff85a90a640 1 --2- 172.21.15.19:0/1897639834 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576f6975370 0x5576f696a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:47.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.896+0000 7ff859908640 1 --2- 172.21.15.19:0/1897639834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576f69702e0 0x5576f69810a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:47.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.896+0000 7ff85a109640 1 -- 172.21.15.19:0/1897639834 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576f6975370 msgr2=0x5576f696a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:47.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.896+0000 7ff85a109640 1 --2- 172.21.15.19:0/1897639834 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576f6975370 0x5576f696a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:47.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.896+0000 7ff85a109640 1 -- 172.21.15.19:0/1897639834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576f69702e0 msgr2=0x5576f69810a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:47.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.896+0000 7ff85a109640 1 --2- 172.21.15.19:0/1897639834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576f69702e0 0x5576f69810a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:47.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.896+0000 7ff85a109640 1 -- 172.21.15.19:0/1897639834 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576f696ae30 con 0x5576f696f9a0 2024-09-19T09:02:47.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.896+0000 7ff85a109640 1 --2- 172.21.15.19:0/1897639834 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576f696f9a0 0x5576f696fd80 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7ff85009d960 tx=0x7ff850024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21433629822589ea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:47.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.896+0000 7ff83ffff640 1 -- 172.21.15.19:0/1897639834 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85009f240 con 0x5576f696f9a0 2024-09-19T09:02:47.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.896+0000 7ff83ffff640 1 -- 172.21.15.19:0/1897639834 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff85009ffe0 con 0x5576f696f9a0 2024-09-19T09:02:47.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.896+0000 7ff83ffff640 1 -- 172.21.15.19:0/1897639834 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85009bec0 con 0x5576f696f9a0 2024-09-19T09:02:47.902 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.897+0000 7ff85f1eb740 1 -- 172.21.15.19:0/1897639834 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576f696f9a0 msgr2=0x5576f696fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:47.902 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.897+0000 7ff85f1eb740 1 --2- 172.21.15.19:0/1897639834 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576f696f9a0 0x5576f696fd80 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7ff85009d960 tx=0x7ff850024000 comp rx=0 tx=0).stop 2024-09-19T09:02:47.902 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.897+0000 7ff85f1eb740 1 -- 172.21.15.19:0/1897639834 shutdown_connections 2024-09-19T09:02:47.902 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.897+0000 7ff85f1eb740 1 --2- 172.21.15.19:0/1897639834 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576f6975370 0x5576f696a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:47.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.897+0000 7ff85f1eb740 1 --2- 172.21.15.19:0/1897639834 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576f69702e0 0x5576f69810a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:47.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.897+0000 7ff85f1eb740 1 --2- 172.21.15.19:0/1897639834 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576f696f9a0 0x5576f696fd80 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:47.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.897+0000 7ff85f1eb740 1 -- 172.21.15.19:0/1897639834 >> 172.21.15.19:0/1897639834 conn(0x5576f696b010 msgr2=0x5576f69699a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:47.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.897+0000 7ff85f1eb740 1 -- 172.21.15.19:0/1897639834 shutdown_connections 2024-09-19T09:02:47.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.897+0000 7ff85f1eb740 1 -- 172.21.15.19:0/1897639834 wait complete. 2024-09-19T09:02:47.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.898+0000 7ff85f1eb740 1 -- start start 2024-09-19T09:02:47.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.898+0000 7ff85f1eb740 1 Processor -- start 2024-09-19T09:02:47.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.898+0000 7ff85f1eb740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576f696f9a0 0x5576f697e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:47.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.898+0000 7ff85f1eb740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576f69702e0 0x5576f697e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:47.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.898+0000 7ff85f1eb740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576f6975370 0x5576f697f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:47.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.898+0000 7ff85f1eb740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff8541a8120 con 0x5576f696f9a0 2024-09-19T09:02:47.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.898+0000 7ff85f1eb740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff8541a7a50 con 0x5576f6975370 2024-09-19T09:02:47.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.898+0000 7ff85f1eb740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff8541a4ce0 con 0x5576f69702e0 2024-09-19T09:02:47.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.898+0000 7ff85f1eb740 10 client.0 _ll_register_callbacks cb 0x7ff844009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:47.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.898+0000 7ff85a109640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576f696f9a0 0x5576f697e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:47.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.898+0000 7ff85a109640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576f696f9a0 0x5576f697e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:33992/0 (socket says 172.21.15.19:33992) 2024-09-19T09:02:47.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.898+0000 7ff85a109640 1 -- 172.21.15.19:0/2931670971 learned_addr learned my addr 172.21.15.19:0/2931670971 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:02:47.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.898+0000 7ff859908640 1 --2- 172.21.15.19:0/2931670971 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576f69702e0 0x5576f697e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:47.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.898+0000 7ff85a90a640 1 --2- 172.21.15.19:0/2931670971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576f6975370 0x5576f697f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:47.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.898+0000 7ff85a109640 1 -- 172.21.15.19:0/2931670971 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576f69702e0 msgr2=0x5576f697e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:47.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.898+0000 7ff85a109640 1 --2- 172.21.15.19:0/2931670971 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576f69702e0 0x5576f697e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:47.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.898+0000 7ff85a109640 1 -- 172.21.15.19:0/2931670971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576f6975370 msgr2=0x5576f697f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:47.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.898+0000 7ff85a109640 1 --2- 172.21.15.19:0/2931670971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576f6975370 0x5576f697f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:47.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.898+0000 7ff85a109640 1 -- 172.21.15.19:0/2931670971 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576f697fe50 con 0x5576f696f9a0 2024-09-19T09:02:47.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.898+0000 7ff859908640 1 --2- 172.21.15.19:0/2931670971 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576f69702e0 0x5576f697e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:02:47.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.899+0000 7ff85a109640 1 --2- 172.21.15.19:0/2931670971 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576f696f9a0 0x5576f697e2f0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7ff8500d8040 tx=0x7ff85009d8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef3069dfea30023c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:47.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.899+0000 7ff83dffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:02:47.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.899+0000 7ff83dffb640 1 -- 172.21.15.19:0/2931670971 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff85009f240 con 0x5576f696f9a0 2024-09-19T09:02:47.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.899+0000 7ff83dffb640 1 -- 172.21.15.19:0/2931670971 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7ff8500b3e00 con 0x5576f696f9a0 2024-09-19T09:02:47.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.899+0000 7ff85f1eb740 1 -- 172.21.15.19:0/2931670971 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff85009ffe0 con 0x5576f696f9a0 2024-09-19T09:02:47.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.899+0000 7ff83dffb640 1 -- 172.21.15.19:0/2931670971 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7ff850085050 con 0x5576f696f9a0 2024-09-19T09:02:47.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.899+0000 7ff85f1eb740 10 client.17769 fetch_fsmap learned FSMap version 39 2024-09-19T09:02:47.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.899+0000 7ff85f1eb740 1 -- 172.21.15.19:0/2931670971 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5576f6981160 con 0x5576f696f9a0 2024-09-19T09:02:47.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.899+0000 7ff83dffb640 1 -- 172.21.15.19:0/2931670971 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff85009ffe0 con 0x5576f696f9a0 2024-09-19T09:02:47.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.899+0000 7ff83dffb640 1 -- 172.21.15.19:0/2931670971 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7ff85009fb40 con 0x5576f696f9a0 2024-09-19T09:02:47.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.899+0000 7ff85f1eb740 10 client.17769 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:02:47.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.899+0000 7ff85f1eb740 10 client.17769 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:02:47.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.899+0000 7ff85f1eb740 20 client.17769 populate_metadata read hostname 'smithi019' 2024-09-19T09:02:47.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.899+0000 7ff85f1eb740 1 --2- 172.21.15.19:0/2931670971 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5576f69f0580 0x5576f69f2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:47.906 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.899+0000 7ff85f1eb740 4 client.17769 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:02:47.906 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.899+0000 7ff85f1eb740 1 -- 172.21.15.19:0/2931670971 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5576f68dad70 con 0x5576f69f0580 2024-09-19T09:02:47.906 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.900+0000 7ff859908640 1 --2- 172.21.15.19:0/2931670971 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5576f69f0580 0x5576f69f2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:47.906 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.900+0000 7ff83dffb640 10 client.17769 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:02:47.906 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:47.900+0000 7ff859908640 1 --2- 172.21.15.19:0/2931670971 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5576f69f0580 0x5576f69f2970 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a349593d3be0b750 server_cookie=88f241b20da76b78 in_seq=0 out_seq=0 2024-09-19T09:02:47.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:47 smithi155 ceph-mon[34921]: pgmap v655: 97 pgs: 97 active+clean; 22 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 1.4 MiB/s wr, 769 op/s 2024-09-19T09:02:47.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:47 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:02:47.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:47 smithi155 ceph-mon[34921]: daemon mds.g restarted 2024-09-19T09:02:48.731 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:48 smithi155 ceph-mon[34921]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T09:02:48.732 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:48 smithi155 ceph-mon[34921]: mds.? [v2:172.21.15.19:6838/3815927080,v1:172.21.15.19:6839/3815927080] up:boot 2024-09-19T09:02:48.732 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:48 smithi155 ceph-mon[34921]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-09-19T09:02:48.732 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:48 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:02:48.732 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:48 smithi155 ceph-mon[34921]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:02:48.732 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:48 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:02:48.732 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:48 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:02:48.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:48 smithi203 ceph-mon[35450]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T09:02:48.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:48 smithi203 ceph-mon[35450]: mds.? [v2:172.21.15.19:6838/3815927080,v1:172.21.15.19:6839/3815927080] up:boot 2024-09-19T09:02:48.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:48 smithi203 ceph-mon[35450]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-09-19T09:02:48.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:48 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:02:48.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:48 smithi203 ceph-mon[35450]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:02:48.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:48 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:02:48.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:48 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:02:49.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:48 smithi019 ceph-mon[30976]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T09:02:49.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:48 smithi019 ceph-mon[30976]: mds.? [v2:172.21.15.19:6838/3815927080,v1:172.21.15.19:6839/3815927080] up:boot 2024-09-19T09:02:49.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:48 smithi019 ceph-mon[30976]: fsmap cephfs:5 4 up:standby-replay 3 up:standby 5 up:active 2024-09-19T09:02:49.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:48 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T09:02:49.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:48 smithi019 ceph-mon[30976]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:02:49.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:48 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:02:49.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:48 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:02:49.153 INFO:tasks.workunit.client.0.smithi019.stdout:cleaned up hierarchy 2024-09-19T09:02:49.234 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:49.233+0000 7ff83dffb640 1 -- 172.21.15.19:0/2931670971 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5576f68dad70 con 0x5576f69f0580 2024-09-19T09:02:49.234 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:49.233+0000 7ff83dffb640 10 client.17769 handle_command_reply: tid=0 2024-09-19T09:02:49.234 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:49.233+0000 7ff85f1eb740 1 client.17769 shutdown 2024-09-19T09:02:49.234 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:49.233+0000 7ff85f1eb740 1 -- 172.21.15.19:0/2931670971 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576f696f9a0 msgr2=0x5576f697e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:49.234 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:49.233+0000 7ff85f1eb740 1 --2- 172.21.15.19:0/2931670971 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576f696f9a0 0x5576f697e2f0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7ff8500d8040 tx=0x7ff85009d8f0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:49.233+0000 7ff85f1eb740 1 -- 172.21.15.19:0/2931670971 shutdown_connections 2024-09-19T09:02:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:49.233+0000 7ff85f1eb740 1 --2- 172.21.15.19:0/2931670971 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5576f69f0580 0x5576f69f2970 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:49.233+0000 7ff85f1eb740 1 --2- 172.21.15.19:0/2931670971 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576f69702e0 0x5576f697e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:49.233+0000 7ff85f1eb740 1 --2- 172.21.15.19:0/2931670971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5576f6975370 0x5576f697f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:49.233+0000 7ff85f1eb740 1 --2- 172.21.15.19:0/2931670971 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5576f696f9a0 0x5576f697e2f0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:49.233+0000 7ff85f1eb740 1 -- 172.21.15.19:0/2931670971 >> 172.21.15.19:0/2931670971 conn(0x5576f696b010 msgr2=0x5576f696a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:49.233+0000 7ff83dffb640 0 client.17769 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:02:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:49.233+0000 7ff85f1eb740 1 -- 172.21.15.19:0/2931670971 shutdown_connections 2024-09-19T09:02:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:49.233+0000 7ff85f1eb740 1 -- 172.21.15.19:0/2931670971 wait complete. 2024-09-19T09:02:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:49.233+0000 7ff85f1eb740 20 client.17769 trim_cache size 0 max 16384 2024-09-19T09:02:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T09:02:49.236 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T09:02:49.236 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T09:02:49.236 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T09:02:49.237 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:49.234+0000 7ff85c36d640 1 -- 172.21.15.19:0/4202943315 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff8400a32f0 msgr2=0x7ff8400a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:49.237 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:49.234+0000 7ff85c36d640 1 --2- 172.21.15.19:0/4202943315 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff8400a32f0 0x7ff8400a57b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff84c005fd0 tx=0x7ff84c004ab0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.237 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:49.234+0000 7ff85c36d640 1 -- 172.21.15.19:0/4202943315 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff854100a50 msgr2=0x7ff854196d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:49.237 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:49.234+0000 7ff85c36d640 1 --2- 172.21.15.19:0/4202943315 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff854100a50 0x7ff854196d10 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff850009b90 tx=0x7ff85000b690 comp rx=0 tx=0).stop 2024-09-19T09:02:49.237 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:49.234+0000 7ff85c36d640 1 -- 172.21.15.19:0/4202943315 shutdown_connections 2024-09-19T09:02:49.237 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:49.234+0000 7ff85c36d640 1 --2- 172.21.15.19:0/4202943315 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff8400a32f0 0x7ff8400a57b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.237 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:49.234+0000 7ff85c36d640 1 --2- 172.21.15.19:0/4202943315 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff854102600 0x7ff85419e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.237 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:49.234+0000 7ff85c36d640 1 --2- 172.21.15.19:0/4202943315 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff854101c40 0x7ff854197250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.237 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:49.234+0000 7ff85c36d640 1 --2- 172.21.15.19:0/4202943315 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff854100a50 0x7ff854196d10 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:49.237 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:49.234+0000 7ff85c36d640 1 -- 172.21.15.19:0/4202943315 >> 172.21.15.19:0/4202943315 conn(0x7ff8540fc1b0 msgr2=0x7ff854104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:49.237 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:49.234+0000 7ff85c36d640 1 -- 172.21.15.19:0/4202943315 shutdown_connections 2024-09-19T09:02:49.238 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:02:49.234+0000 7ff85c36d640 1 -- 172.21.15.19:0/4202943315 wait complete. 2024-09-19T09:02:49.822 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T09:02:49.822 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T09:02:49.886 INFO:tasks.workunit:Running workunit fs/misc/filelock_deadlock.py... 2024-09-19T09:02:49.887 DEBUG:teuthology.orchestra.run.smithi019:workunit test fs/misc/filelock_deadlock.py> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/filelock_deadlock.py 2024-09-19T09:02:50.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:49 smithi019 ceph-mon[30976]: pgmap v657: 97 pgs: 97 active+clean; 28 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 544 op/s 2024-09-19T09:02:50.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:49 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:02:50.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:49 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:02:50.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:49 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:02:50.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:49 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:02:50.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:49 smithi155 ceph-mon[34921]: pgmap v657: 97 pgs: 97 active+clean; 28 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 544 op/s 2024-09-19T09:02:50.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:49 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:02:50.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:49 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:02:50.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:49 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:02:50.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:49 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:02:50.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:49 smithi203 ceph-mon[35450]: pgmap v657: 97 pgs: 97 active+clean; 28 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 544 op/s 2024-09-19T09:02:50.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:49 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:02:50.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:49 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:02:50.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:49 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:02:50.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:49 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:02:51.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:50 smithi019 ceph-mon[30976]: scrub summary: idle+waiting paths [/] 2024-09-19T09:02:51.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:50 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:02:51.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:50 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:02:51.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:50 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:02:51.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:50 smithi155 ceph-mon[34921]: scrub summary: idle+waiting paths [/] 2024-09-19T09:02:51.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:50 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:02:51.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:50 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:02:51.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:50 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:02:51.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:50 smithi203 ceph-mon[35450]: scrub summary: idle+waiting paths [/] 2024-09-19T09:02:51.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:50 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:02:51.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:50 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:02:51.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:50 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:02:52.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:51 smithi019 ceph-mon[30976]: pgmap v658: 97 pgs: 97 active+clean; 28 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 586 op/s 2024-09-19T09:02:52.178 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:51 smithi155 ceph-mon[34921]: pgmap v658: 97 pgs: 97 active+clean; 28 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 586 op/s 2024-09-19T09:02:52.277 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:51 smithi203 ceph-mon[35450]: pgmap v658: 97 pgs: 97 active+clean; 28 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.5 MiB/s wr, 586 op/s 2024-09-19T09:02:53.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:52 smithi019 ceph-mon[30976]: scrub summary: idle 2024-09-19T09:02:53.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:52 smithi155 ceph-mon[34921]: scrub summary: idle 2024-09-19T09:02:53.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:52 smithi203 ceph-mon[35450]: scrub summary: idle 2024-09-19T09:02:53.346 INFO:tasks.quiescer.fs.[cephfs]:Total duration (60) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-19T09:02:53.346 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-09-19T09:02:53.347 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:02:53.616 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:54.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:53 smithi019 ceph-mon[30976]: pgmap v659: 97 pgs: 97 active+clean; 13 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.4 MiB/s wr, 1.18k op/s 2024-09-19T09:02:54.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:53 smithi155 ceph-mon[34921]: pgmap v659: 97 pgs: 97 active+clean; 13 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.4 MiB/s wr, 1.18k op/s 2024-09-19T09:02:54.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:53 smithi203 ceph-mon[35450]: pgmap v659: 97 pgs: 97 active+clean; 13 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 1.4 MiB/s wr, 1.18k op/s 2024-09-19T09:02:54.441 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:02:54.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.531+0000 7f410373d640 1 -- 172.21.15.19:0/2721978172 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40fc102ef0 msgr2=0x7f40fc10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:54.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.531+0000 7f410373d640 1 --2- 172.21.15.19:0/2721978172 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40fc102ef0 0x7f40fc10da40 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f40f4009ca0 tx=0x7f40f402a950 comp rx=0 tx=0).stop 2024-09-19T09:02:54.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.531+0000 7f410373d640 1 -- 172.21.15.19:0/2721978172 shutdown_connections 2024-09-19T09:02:54.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.531+0000 7f410373d640 1 --2- 172.21.15.19:0/2721978172 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40fc102570 0x7f40fc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.531+0000 7f410373d640 1 --2- 172.21.15.19:0/2721978172 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40fc102ef0 0x7f40fc10da40 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.531+0000 7f410373d640 1 --2- 172.21.15.19:0/2721978172 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40fc100e20 0x7f40fc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.531+0000 7f410373d640 1 -- 172.21.15.19:0/2721978172 >> 172.21.15.19:0/2721978172 conn(0x7f40fc0fc7d0 msgr2=0x7f40fc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:54.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.531+0000 7f410373d640 1 -- 172.21.15.19:0/2721978172 shutdown_connections 2024-09-19T09:02:54.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.531+0000 7f410373d640 1 -- 172.21.15.19:0/2721978172 wait complete. 2024-09-19T09:02:54.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.532+0000 7f410373d640 1 Processor -- start 2024-09-19T09:02:54.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.532+0000 7f410373d640 1 -- start start 2024-09-19T09:02:54.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.532+0000 7f410373d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40fc100e20 0x7f40fc1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:54.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.532+0000 7f410373d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40fc102570 0x7f40fc1989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:54.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.532+0000 7f410373d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40fc102ef0 0x7f40fc19cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:54.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.532+0000 7f410373d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f40fc1120a0 con 0x7f40fc100e20 2024-09-19T09:02:54.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.532+0000 7f410373d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f40fc111f20 con 0x7f40fc102570 2024-09-19T09:02:54.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.532+0000 7f410373d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f40fc112220 con 0x7f40fc102ef0 2024-09-19T09:02:54.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.533+0000 7f41014d9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40fc100e20 0x7f40fc1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:54.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.533+0000 7f41014d9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40fc100e20 0x7f40fc1984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:34014/0 (socket says 172.21.15.19:34014) 2024-09-19T09:02:54.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.533+0000 7f41014d9640 1 -- 172.21.15.19:0/2851488361 learned_addr learned my addr 172.21.15.19:0/2851488361 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:02:54.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.533+0000 7f4100cd8640 1 --2- 172.21.15.19:0/2851488361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40fc102570 0x7f40fc1989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:54.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.533+0000 7f4101cda640 1 --2- 172.21.15.19:0/2851488361 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40fc102ef0 0x7f40fc19cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:54.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.533+0000 7f41014d9640 1 -- 172.21.15.19:0/2851488361 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40fc102ef0 msgr2=0x7f40fc19cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:54.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.533+0000 7f41014d9640 1 --2- 172.21.15.19:0/2851488361 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40fc102ef0 0x7f40fc19cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.533+0000 7f41014d9640 1 -- 172.21.15.19:0/2851488361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40fc102570 msgr2=0x7f40fc1989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:54.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.533+0000 7f41014d9640 1 --2- 172.21.15.19:0/2851488361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40fc102570 0x7f40fc1989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.533+0000 7f41014d9640 1 -- 172.21.15.19:0/2851488361 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40fc19d450 con 0x7f40fc100e20 2024-09-19T09:02:54.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.533+0000 7f4100cd8640 1 --2- 172.21.15.19:0/2851488361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40fc102570 0x7f40fc1989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:54.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.533+0000 7f41014d9640 1 --2- 172.21.15.19:0/2851488361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40fc100e20 0x7f40fc1984a0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f40f800e9f0 tx=0x7f40f800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:54.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.533+0000 7f40f27fc640 1 -- 172.21.15.19:0/2851488361 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f800cd80 con 0x7f40fc100e20 2024-09-19T09:02:54.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.533+0000 7f40f27fc640 1 -- 172.21.15.19:0/2851488361 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40f8010910 con 0x7f40fc100e20 2024-09-19T09:02:54.542 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.533+0000 7f410373d640 1 -- 172.21.15.19:0/2851488361 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40fc19d740 con 0x7f40fc100e20 2024-09-19T09:02:54.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.533+0000 7f40f27fc640 1 -- 172.21.15.19:0/2851488361 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f8018990 con 0x7f40fc100e20 2024-09-19T09:02:54.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.534+0000 7f410373d640 1 -- 172.21.15.19:0/2851488361 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40fc1a5020 con 0x7f40fc100e20 2024-09-19T09:02:54.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.535+0000 7f410373d640 1 -- 172.21.15.19:0/2851488361 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40fc101200 con 0x7f40fc100e20 2024-09-19T09:02:54.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.537+0000 7f40f27fc640 1 -- 172.21.15.19:0/2851488361 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f40f8010ac0 con 0x7f40fc100e20 2024-09-19T09:02:54.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.538+0000 7f40f27fc640 1 --2- 172.21.15.19:0/2851488361 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f40e80a3240 0x7f40e80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:54.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.538+0000 7f40f27fc640 1 -- 172.21.15.19:0/2851488361 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f40f80d01b0 con 0x7f40fc100e20 2024-09-19T09:02:54.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.539+0000 7f4100cd8640 1 --2- 172.21.15.19:0/2851488361 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f40e80a3240 0x7f40e80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:54.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.539+0000 7f4100cd8640 1 --2- 172.21.15.19:0/2851488361 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f40e80a3240 0x7f40e80a5700 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f40fc0fec10 tx=0x7f40ec005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:54.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.544+0000 7f40f27fc640 1 -- 172.21.15.19:0/2851488361 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f40f809cee0 con 0x7f40fc100e20 2024-09-19T09:02:54.726 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:54.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.772+0000 7f410373d640 1 -- 172.21.15.19:0/2851488361 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f40fc199800 con 0x7f40fc100e20 2024-09-19T09:02:54.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.774+0000 7f40f27fc640 1 -- 172.21.15.19:0/2851488361 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+11983 (secure 0 0 0) 0x7f40f809c7e0 con 0x7f40fc100e20 2024-09-19T09:02:54.776 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T09:02:54.777 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":39,"btime":"2024-09-19T09:02:47:631181+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":17751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/3815927080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":3815927080},{"type":"v1","addr":"172.21.15.19:6839","nonce":3815927080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":39,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T09:02:47.631165+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26453":{"gid":26453,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/3907362737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3907362737},{"type":"v1","addr":"172.21.15.155:6835","nonce":3907362737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24469,24490,24464,24463]},"id":1}]} 2024-09-19T09:02:54.778 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 39 2024-09-19T09:02:54.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.776+0000 7f410373d640 1 -- 172.21.15.19:0/2851488361 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f40e80a3240 msgr2=0x7f40e80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:54.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.776+0000 7f410373d640 1 --2- 172.21.15.19:0/2851488361 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f40e80a3240 0x7f40e80a5700 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f40fc0fec10 tx=0x7f40ec005f90 comp rx=0 tx=0).stop 2024-09-19T09:02:54.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.776+0000 7f410373d640 1 -- 172.21.15.19:0/2851488361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40fc100e20 msgr2=0x7f40fc1984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:54.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.776+0000 7f410373d640 1 --2- 172.21.15.19:0/2851488361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40fc100e20 0x7f40fc1984a0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f40f800e9f0 tx=0x7f40f800eeb0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.776+0000 7f410373d640 1 -- 172.21.15.19:0/2851488361 shutdown_connections 2024-09-19T09:02:54.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.776+0000 7f410373d640 1 --2- 172.21.15.19:0/2851488361 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f40e80a3240 0x7f40e80a5700 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.776+0000 7f410373d640 1 --2- 172.21.15.19:0/2851488361 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40fc102ef0 0x7f40fc19cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.776+0000 7f410373d640 1 --2- 172.21.15.19:0/2851488361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f40fc102570 0x7f40fc1989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.776+0000 7f410373d640 1 --2- 172.21.15.19:0/2851488361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f40fc100e20 0x7f40fc1984a0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:54.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.776+0000 7f410373d640 1 -- 172.21.15.19:0/2851488361 >> 172.21.15.19:0/2851488361 conn(0x7f40fc0fc7d0 msgr2=0x7f40fc106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:54.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.777+0000 7f410373d640 1 -- 172.21.15.19:0/2851488361 shutdown_connections 2024-09-19T09:02:54.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:54.777+0000 7f410373d640 1 -- 172.21.15.19:0/2851488361 wait complete. 2024-09-19T09:02:56.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:55 smithi019 ceph-mon[30976]: pgmap v660: 97 pgs: 97 active+clean; 6.6 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.2 MiB/s wr, 1.42k op/s 2024-09-19T09:02:56.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:55 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/2851488361' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:02:56.168 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-09-19T09:02:56.168 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-09-19T09:02:56.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:55 smithi155 ceph-mon[34921]: pgmap v660: 97 pgs: 97 active+clean; 6.6 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.2 MiB/s wr, 1.42k op/s 2024-09-19T09:02:56.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:55 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/2851488361' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:02:56.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:55 smithi203 ceph-mon[35450]: pgmap v660: 97 pgs: 97 active+clean; 6.6 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 1.2 MiB/s wr, 1.42k op/s 2024-09-19T09:02:56.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:55 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/2851488361' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:02:56.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.402+0000 7f23416bd640 1 -- 172.21.15.19:0/2137223163 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f233c1036e0 msgr2=0x7f233c107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:56.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.402+0000 7f23416bd640 1 --2- 172.21.15.19:0/2137223163 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f233c1036e0 0x7f233c107b90 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f2324009930 tx=0x7f232402a420 comp rx=0 tx=0).stop 2024-09-19T09:02:56.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.403+0000 7f23416bd640 1 -- 172.21.15.19:0/2137223163 shutdown_connections 2024-09-19T09:02:56.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.403+0000 7f23416bd640 1 --2- 172.21.15.19:0/2137223163 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f233c1082a0 0x7f233c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.403+0000 7f23416bd640 1 --2- 172.21.15.19:0/2137223163 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f233c1036e0 0x7f233c107b90 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.403+0000 7f23416bd640 1 --2- 172.21.15.19:0/2137223163 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f233c102d30 0x7f233c103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.403+0000 7f23416bd640 1 -- 172.21.15.19:0/2137223163 >> 172.21.15.19:0/2137223163 conn(0x7f233c0fc7d0 msgr2=0x7f233c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:56.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.403+0000 7f23416bd640 1 -- 172.21.15.19:0/2137223163 shutdown_connections 2024-09-19T09:02:56.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.403+0000 7f23416bd640 1 -- 172.21.15.19:0/2137223163 wait complete. 2024-09-19T09:02:56.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.403+0000 7f23416bd640 1 Processor -- start 2024-09-19T09:02:56.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.404+0000 7f23416bd640 1 -- start start 2024-09-19T09:02:56.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.404+0000 7f23416bd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f233c102d30 0x7f233c198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:56.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.404+0000 7f23416bd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f233c1036e0 0x7f233c198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:56.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.404+0000 7f23416bd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f233c1082a0 0x7f233c19cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:56.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.404+0000 7f23416bd640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f233c1120c0 con 0x7f233c1082a0 2024-09-19T09:02:56.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.404+0000 7f23416bd640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f233c111f40 con 0x7f233c102d30 2024-09-19T09:02:56.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.404+0000 7f23416bd640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f233c112240 con 0x7f233c1036e0 2024-09-19T09:02:56.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.404+0000 7f233b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f233c1082a0 0x7f233c19cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:56.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.404+0000 7f233b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f233c1082a0 0x7f233c19cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38596/0 (socket says 172.21.15.19:38596) 2024-09-19T09:02:56.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.404+0000 7f233b7fe640 1 -- 172.21.15.19:0/317121250 learned_addr learned my addr 172.21.15.19:0/317121250 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:02:56.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.404+0000 7f233a7fc640 1 --2- 172.21.15.19:0/317121250 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f233c1036e0 0x7f233c198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:56.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.404+0000 7f233affd640 1 --2- 172.21.15.19:0/317121250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f233c102d30 0x7f233c198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:56.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.404+0000 7f233b7fe640 1 -- 172.21.15.19:0/317121250 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f233c1036e0 msgr2=0x7f233c198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:56.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.404+0000 7f233b7fe640 1 --2- 172.21.15.19:0/317121250 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f233c1036e0 0x7f233c198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.404+0000 7f233b7fe640 1 -- 172.21.15.19:0/317121250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f233c102d30 msgr2=0x7f233c198640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:56.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.404+0000 7f233b7fe640 1 --2- 172.21.15.19:0/317121250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f233c102d30 0x7f233c198640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.404+0000 7f233b7fe640 1 -- 172.21.15.19:0/317121250 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f233c19d5f0 con 0x7f233c1082a0 2024-09-19T09:02:56.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.405+0000 7f233b7fe640 1 --2- 172.21.15.19:0/317121250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f233c1082a0 0x7f233c19cf10 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f232c00eaa0 tx=0x7f232c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:56.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.405+0000 7f2333fff640 1 -- 172.21.15.19:0/317121250 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232c004d20 con 0x7f233c1082a0 2024-09-19T09:02:56.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.405+0000 7f2333fff640 1 -- 172.21.15.19:0/317121250 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f232c005020 con 0x7f233c1082a0 2024-09-19T09:02:56.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.405+0000 7f23416bd640 1 -- 172.21.15.19:0/317121250 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f233c19d8e0 con 0x7f233c1082a0 2024-09-19T09:02:56.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.405+0000 7f2333fff640 1 -- 172.21.15.19:0/317121250 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232c0116d0 con 0x7f233c1082a0 2024-09-19T09:02:56.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.405+0000 7f23416bd640 1 -- 172.21.15.19:0/317121250 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f233c1a51c0 con 0x7f233c1082a0 2024-09-19T09:02:56.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.407+0000 7f2333fff640 1 -- 172.21.15.19:0/317121250 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f232c0051d0 con 0x7f233c1082a0 2024-09-19T09:02:56.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.407+0000 7f2343a96740 1 Processor -- start 2024-09-19T09:02:56.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.408+0000 7f2343a96740 1 -- start start 2024-09-19T09:02:56.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.408+0000 7f2343a96740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a6c9ba4a0 0x559a6c9ba880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:56.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.408+0000 7f2343a96740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559a6c9badc0 0x559a6c9c5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:56.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.408+0000 7f2343a96740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6c9c5680 0x559a6c9c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:56.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.408+0000 7f2333fff640 1 --2- 172.21.15.19:0/317121250 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f23280a3240 0x7f23280a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:56.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.408+0000 7f2343a96740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559a6c9202e0 con 0x559a6c9badc0 2024-09-19T09:02:56.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.408+0000 7f2343a96740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559a6c8c7ce0 con 0x559a6c9ba4a0 2024-09-19T09:02:56.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.408+0000 7f2343a96740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559a6c91c2a0 con 0x559a6c9c5680 2024-09-19T09:02:56.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.408+0000 7f233affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559a6c9badc0 0x559a6c9c5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:56.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.408+0000 7f233affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559a6c9badc0 0x559a6c9c5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38612/0 (socket says 172.21.15.19:38612) 2024-09-19T09:02:56.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.408+0000 7f233affd640 1 -- 172.21.15.19:0/1029579697 learned_addr learned my addr 172.21.15.19:0/1029579697 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:02:56.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.408+0000 7f233a7fc640 1 --2- 172.21.15.19:0/317121250 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f23280a3240 0x7f23280a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:56.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.408+0000 7f2333fff640 1 -- 172.21.15.19:0/317121250 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f232c0cfb40 con 0x7f233c1082a0 2024-09-19T09:02:56.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.408+0000 7f233b7fe640 1 --2- 172.21.15.19:0/1029579697 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6c9c5680 0x559a6c9c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:56.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.408+0000 7f233a7fc640 1 --2- 172.21.15.19:0/1029579697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a6c9ba4a0 0x559a6c9ba880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:56.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.408+0000 7f233affd640 1 -- 172.21.15.19:0/1029579697 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6c9c5680 msgr2=0x559a6c9c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:56.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.408+0000 7f233affd640 1 --2- 172.21.15.19:0/1029579697 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6c9c5680 0x559a6c9c7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.408+0000 7f233affd640 1 -- 172.21.15.19:0/1029579697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a6c9ba4a0 msgr2=0x559a6c9ba880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:56.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.408+0000 7f233affd640 1 --2- 172.21.15.19:0/1029579697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a6c9ba4a0 0x559a6c9ba880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.408+0000 7f233affd640 1 -- 172.21.15.19:0/1029579697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a6c8ac440 con 0x559a6c9badc0 2024-09-19T09:02:56.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.409+0000 7f233affd640 1 --2- 172.21.15.19:0/1029579697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559a6c9badc0 0x559a6c9c5140 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f2334009a70 tx=0x7f2334009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce0a7ba46c504ee3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:56.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.409+0000 7f233a7fc640 1 --2- 172.21.15.19:0/317121250 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f23280a3240 0x7f23280a5700 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2324005940 tx=0x7f2324000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:56.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.409+0000 7f23317fa640 1 -- 172.21.15.19:0/1029579697 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2334017070 con 0x559a6c9badc0 2024-09-19T09:02:56.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.409+0000 7f23317fa640 1 -- 172.21.15.19:0/1029579697 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2334013470 con 0x559a6c9badc0 2024-09-19T09:02:56.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.409+0000 7f23317fa640 1 -- 172.21.15.19:0/1029579697 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2334012630 con 0x559a6c9badc0 2024-09-19T09:02:56.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.410+0000 7f2343a96740 1 -- 172.21.15.19:0/1029579697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559a6c9badc0 msgr2=0x559a6c9c5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:56.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.410+0000 7f2343a96740 1 --2- 172.21.15.19:0/1029579697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559a6c9badc0 0x559a6c9c5140 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f2334009a70 tx=0x7f2334009f30 comp rx=0 tx=0).stop 2024-09-19T09:02:56.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.410+0000 7f2343a96740 1 -- 172.21.15.19:0/1029579697 shutdown_connections 2024-09-19T09:02:56.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.410+0000 7f2343a96740 1 --2- 172.21.15.19:0/1029579697 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6c9c5680 0x559a6c9c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.410+0000 7f2343a96740 1 --2- 172.21.15.19:0/1029579697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559a6c9badc0 0x559a6c9c5140 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.410+0000 7f2343a96740 1 --2- 172.21.15.19:0/1029579697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a6c9ba4a0 0x559a6c9ba880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.410+0000 7f2343a96740 1 -- 172.21.15.19:0/1029579697 >> 172.21.15.19:0/1029579697 conn(0x559a6c9b6a30 msgr2=0x559a6c9b6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:56.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.410+0000 7f2343a96740 1 -- 172.21.15.19:0/1029579697 shutdown_connections 2024-09-19T09:02:56.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.410+0000 7f2343a96740 1 -- 172.21.15.19:0/1029579697 wait complete. 2024-09-19T09:02:56.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.410+0000 7f2343a96740 1 -- start start 2024-09-19T09:02:56.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.410+0000 7f2343a96740 1 Processor -- start 2024-09-19T09:02:56.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.410+0000 7f2343a96740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6c9ba4a0 0x559a6c9c4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:56.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.410+0000 7f2343a96740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a6c9badc0 0x559a6c9c2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:56.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.410+0000 7f2343a96740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559a6c9c5680 0x559a6c9c27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:56.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.410+0000 7f2343a96740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559a6c9c8250 con 0x559a6c9c5680 2024-09-19T09:02:56.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.410+0000 7f2343a96740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559a6c8db050 con 0x559a6c9badc0 2024-09-19T09:02:56.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.410+0000 7f2343a96740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559a6c9c83d0 con 0x559a6c9ba4a0 2024-09-19T09:02:56.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.411+0000 7f2343a96740 10 client.0 _ll_register_callbacks cb 0x559a6c91b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:56.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.411+0000 7f233b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559a6c9c5680 0x559a6c9c27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:56.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.411+0000 7f233b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559a6c9c5680 0x559a6c9c27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38626/0 (socket says 172.21.15.19:38626) 2024-09-19T09:02:56.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.411+0000 7f233b7fe640 1 -- 172.21.15.19:0/2959832903 learned_addr learned my addr 172.21.15.19:0/2959832903 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:02:56.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.411+0000 7f233affd640 1 --2- 172.21.15.19:0/2959832903 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6c9ba4a0 0x559a6c9c4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:56.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.411+0000 7f233a7fc640 1 --2- 172.21.15.19:0/2959832903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a6c9badc0 0x559a6c9c2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:56.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.411+0000 7f233b7fe640 1 -- 172.21.15.19:0/2959832903 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6c9ba4a0 msgr2=0x559a6c9c4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:56.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.411+0000 7f233b7fe640 1 --2- 172.21.15.19:0/2959832903 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6c9ba4a0 0x559a6c9c4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.411+0000 7f233b7fe640 1 -- 172.21.15.19:0/2959832903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a6c9badc0 msgr2=0x559a6c9c2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:56.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.411+0000 7f233b7fe640 1 --2- 172.21.15.19:0/2959832903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a6c9badc0 0x559a6c9c2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.411+0000 7f233b7fe640 1 -- 172.21.15.19:0/2959832903 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a6c6913c0 con 0x559a6c9c5680 2024-09-19T09:02:56.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.411+0000 7f233affd640 1 --2- 172.21.15.19:0/2959832903 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6c9ba4a0 0x559a6c9c4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:56.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.411+0000 7f233a7fc640 1 --2- 172.21.15.19:0/2959832903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a6c9badc0 0x559a6c9c2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:02:56.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.411+0000 7f233b7fe640 1 --2- 172.21.15.19:0/2959832903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559a6c9c5680 0x559a6c9c27f0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f232c004ff0 tx=0x7f232c09c1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae3bd0e8f93d165 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:56.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.411+0000 7f23227fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:02:56.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.411+0000 7f23227fc640 1 -- 172.21.15.19:0/2959832903 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232c01f040 con 0x559a6c9c5680 2024-09-19T09:02:56.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.411+0000 7f23227fc640 1 -- 172.21.15.19:0/2959832903 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f232c0bc0c0 con 0x559a6c9c5680 2024-09-19T09:02:56.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.411+0000 7f2343a96740 1 -- 172.21.15.19:0/2959832903 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2334013470 con 0x559a6c9c5680 2024-09-19T09:02:56.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.411+0000 7f23227fc640 1 -- 172.21.15.19:0/2959832903 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f232c0a0120 con 0x559a6c9c5680 2024-09-19T09:02:56.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.411+0000 7f2343a96740 10 client.17787 fetch_fsmap learned FSMap version 39 2024-09-19T09:02:56.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.411+0000 7f2343a96740 1 -- 172.21.15.19:0/2959832903 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x559a6c9d3c20 con 0x559a6c9c5680 2024-09-19T09:02:56.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.412+0000 7f23227fc640 1 -- 172.21.15.19:0/2959832903 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2334013470 con 0x559a6c9c5680 2024-09-19T09:02:56.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.412+0000 7f23227fc640 1 -- 172.21.15.19:0/2959832903 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f232c00f040 con 0x559a6c9c5680 2024-09-19T09:02:56.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.412+0000 7f2343a96740 10 client.17787 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:02:56.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.412+0000 7f2343a96740 10 client.17787 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:02:56.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.412+0000 7f2343a96740 20 client.17787 populate_metadata read hostname 'smithi019' 2024-09-19T09:02:56.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.412+0000 7f2343a96740 1 --2- 172.21.15.19:0/2959832903 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x559a6c9d5030 0x559a6c9d74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:56.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.412+0000 7f2343a96740 4 client.17787 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:02:56.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.412+0000 7f2343a96740 1 -- 172.21.15.19:0/2959832903 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a6c92d850 con 0x559a6c9d5030 2024-09-19T09:02:56.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.412+0000 7f233affd640 1 --2- 172.21.15.19:0/2959832903 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x559a6c9d5030 0x559a6c9d74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:56.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.413+0000 7f23227fc640 10 client.17787 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:02:56.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.413+0000 7f233affd640 1 --2- 172.21.15.19:0/2959832903 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x559a6c9d5030 0x559a6c9d74c0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3d2ba9ff06ce9f5 server_cookie=c9b85963a50b20aa in_seq=0 out_seq=0 2024-09-19T09:02:56.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.413+0000 7f23227fc640 1 -- 172.21.15.19:0/2959832903 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559a6c92d850 con 0x559a6c9d5030 2024-09-19T09:02:56.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.413+0000 7f23227fc640 10 client.17787 handle_command_reply: tid=0 2024-09-19T09:02:56.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.413+0000 7f2343a96740 1 client.17787 shutdown 2024-09-19T09:02:56.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.414+0000 7f2343a96740 1 -- 172.21.15.19:0/2959832903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559a6c9c5680 msgr2=0x559a6c9c27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:56.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.414+0000 7f2343a96740 1 --2- 172.21.15.19:0/2959832903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559a6c9c5680 0x559a6c9c27f0 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f232c004ff0 tx=0x7f232c09c1d0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.414+0000 7f2343a96740 1 -- 172.21.15.19:0/2959832903 shutdown_connections 2024-09-19T09:02:56.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.414+0000 7f2343a96740 1 --2- 172.21.15.19:0/2959832903 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x559a6c9d5030 0x559a6c9d74c0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.414+0000 7f23227fc640 0 client.17787 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:02:56.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.414+0000 7f2343a96740 1 --2- 172.21.15.19:0/2959832903 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559a6c9c5680 0x559a6c9c27f0 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.414+0000 7f2343a96740 1 --2- 172.21.15.19:0/2959832903 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a6c9badc0 0x559a6c9c2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.414+0000 7f2343a96740 1 --2- 172.21.15.19:0/2959832903 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6c9ba4a0 0x559a6c9c4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.414+0000 7f2343a96740 1 -- 172.21.15.19:0/2959832903 >> 172.21.15.19:0/2959832903 conn(0x559a6c9b6a30 msgr2=0x559a6c9bc760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:56.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.414+0000 7f2343a96740 1 -- 172.21.15.19:0/2959832903 shutdown_connections 2024-09-19T09:02:56.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.414+0000 7f2343a96740 1 -- 172.21.15.19:0/2959832903 wait complete. 2024-09-19T09:02:56.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.414+0000 7f2343a96740 20 client.17787 trim_cache size 0 max 16384 2024-09-19T09:02:56.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.431+0000 7f2343a96740 1 Processor -- start 2024-09-19T09:02:56.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.431+0000 7f2343a96740 1 -- start start 2024-09-19T09:02:56.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.432+0000 7f2343a96740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6c9ba4a0 0x559a6c9c4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:56.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.432+0000 7f2343a96740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559a6c9badc0 0x559a6c9dcde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:56.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.432+0000 7f2343a96740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a6c9c5680 0x559a6c9dd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:56.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.432+0000 7f2343a96740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f233c1ad640 con 0x559a6c9badc0 2024-09-19T09:02:56.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.432+0000 7f2343a96740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f233c1af180 con 0x559a6c9c5680 2024-09-19T09:02:56.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.432+0000 7f2343a96740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f233c1add10 con 0x559a6c9ba4a0 2024-09-19T09:02:56.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.432+0000 7f233a7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559a6c9badc0 0x559a6c9dcde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:56.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.432+0000 7f233affd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6c9ba4a0 0x559a6c9c4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:56.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.432+0000 7f233affd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6c9ba4a0 0x559a6c9c4200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:51336/0 (socket says 172.21.15.19:51336) 2024-09-19T09:02:56.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.432+0000 7f233a7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559a6c9badc0 0x559a6c9dcde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38628/0 (socket says 172.21.15.19:38628) 2024-09-19T09:02:56.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.432+0000 7f233affd640 1 -- 172.21.15.19:0/102992377 learned_addr learned my addr 172.21.15.19:0/102992377 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:02:56.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.432+0000 7f233b7fe640 1 --2- 172.21.15.19:0/102992377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a6c9c5680 0x559a6c9dd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:56.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.432+0000 7f233affd640 1 -- 172.21.15.19:0/102992377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a6c9c5680 msgr2=0x559a6c9dd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:56.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.432+0000 7f233affd640 1 --2- 172.21.15.19:0/102992377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a6c9c5680 0x559a6c9dd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.432+0000 7f233affd640 1 -- 172.21.15.19:0/102992377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559a6c9badc0 msgr2=0x559a6c9dcde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:56.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.432+0000 7f233affd640 1 --2- 172.21.15.19:0/102992377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559a6c9badc0 0x559a6c9dcde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.432+0000 7f233affd640 1 -- 172.21.15.19:0/102992377 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a6c9b6860 con 0x559a6c9ba4a0 2024-09-19T09:02:56.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.433+0000 7f233affd640 1 --2- 172.21.15.19:0/102992377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6c9ba4a0 0x559a6c9c4200 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x559a6c9b7890 tx=0x7f2334013f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0bb7362823e8b0a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:56.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.433+0000 7f2330ff9640 1 -- 172.21.15.19:0/102992377 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2334017040 con 0x559a6c9ba4a0 2024-09-19T09:02:56.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.433+0000 7f2330ff9640 1 -- 172.21.15.19:0/102992377 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2334013950 con 0x559a6c9ba4a0 2024-09-19T09:02:56.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.433+0000 7f2330ff9640 1 -- 172.21.15.19:0/102992377 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f233401c8c0 con 0x559a6c9ba4a0 2024-09-19T09:02:56.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.434+0000 7f2343a96740 1 -- 172.21.15.19:0/102992377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6c9ba4a0 msgr2=0x559a6c9c4200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:56.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.434+0000 7f2343a96740 1 --2- 172.21.15.19:0/102992377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6c9ba4a0 0x559a6c9c4200 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x559a6c9b7890 tx=0x7f2334013f90 comp rx=0 tx=0).stop 2024-09-19T09:02:56.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.434+0000 7f2343a96740 1 -- 172.21.15.19:0/102992377 shutdown_connections 2024-09-19T09:02:56.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.434+0000 7f2343a96740 1 --2- 172.21.15.19:0/102992377 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a6c9c5680 0x559a6c9dd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.434+0000 7f2343a96740 1 --2- 172.21.15.19:0/102992377 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559a6c9badc0 0x559a6c9dcde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.434+0000 7f2343a96740 1 --2- 172.21.15.19:0/102992377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6c9ba4a0 0x559a6c9c4200 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.434+0000 7f2343a96740 1 -- 172.21.15.19:0/102992377 >> 172.21.15.19:0/102992377 conn(0x559a6c9b6a30 msgr2=0x559a6c9c3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:56.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.434+0000 7f2343a96740 1 -- 172.21.15.19:0/102992377 shutdown_connections 2024-09-19T09:02:56.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.434+0000 7f2343a96740 1 -- 172.21.15.19:0/102992377 wait complete. 2024-09-19T09:02:56.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.434+0000 7f2343a96740 1 -- start start 2024-09-19T09:02:56.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.435+0000 7f2343a96740 1 Processor -- start 2024-09-19T09:02:56.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.435+0000 7f2343a96740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a6c9ba4a0 0x559a6c9cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:56.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.435+0000 7f2343a96740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6c9badc0 0x559a6c9cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:56.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.435+0000 7f2343a96740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559a6c9c5680 0x559a6c9cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:56.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.435+0000 7f2343a96740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f233c1aeab0 con 0x559a6c9c5680 2024-09-19T09:02:56.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.435+0000 7f2343a96740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f233c1ae3e0 con 0x559a6c9ba4a0 2024-09-19T09:02:56.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.435+0000 7f2343a96740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f233c1ab620 con 0x559a6c9badc0 2024-09-19T09:02:56.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.435+0000 7f2343a96740 10 client.0 _ll_register_callbacks cb 0x7f232c005830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:56.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.435+0000 7f233b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559a6c9c5680 0x559a6c9cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:56.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.435+0000 7f233b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559a6c9c5680 0x559a6c9cbe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38636/0 (socket says 172.21.15.19:38636) 2024-09-19T09:02:56.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.435+0000 7f233b7fe640 1 -- 172.21.15.19:0/968755669 learned_addr learned my addr 172.21.15.19:0/968755669 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:02:56.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.435+0000 7f233a7fc640 1 --2- 172.21.15.19:0/968755669 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6c9badc0 0x559a6c9cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:56.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.435+0000 7f233affd640 1 --2- 172.21.15.19:0/968755669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a6c9ba4a0 0x559a6c9cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:56.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.435+0000 7f233b7fe640 1 -- 172.21.15.19:0/968755669 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6c9badc0 msgr2=0x559a6c9cb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:56.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.435+0000 7f233b7fe640 1 --2- 172.21.15.19:0/968755669 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6c9badc0 0x559a6c9cb8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.435+0000 7f233b7fe640 1 -- 172.21.15.19:0/968755669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a6c9ba4a0 msgr2=0x559a6c9cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:56.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.435+0000 7f233b7fe640 1 --2- 172.21.15.19:0/968755669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a6c9ba4a0 0x559a6c9cb3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.435+0000 7f233b7fe640 1 -- 172.21.15.19:0/968755669 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a6c9b76c0 con 0x559a6c9c5680 2024-09-19T09:02:56.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.436+0000 7f233b7fe640 1 --2- 172.21.15.19:0/968755669 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559a6c9c5680 0x559a6c9cbe20 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f232c09c0a0 tx=0x7f232c005790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc07b8a5edbbb3c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:56.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.436+0000 7f23227fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:02:56.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.436+0000 7f23227fc640 1 -- 172.21.15.19:0/968755669 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232c01f040 con 0x559a6c9c5680 2024-09-19T09:02:56.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.436+0000 7f23227fc640 1 -- 172.21.15.19:0/968755669 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f232c09b560 con 0x559a6c9c5680 2024-09-19T09:02:56.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.436+0000 7f2343a96740 1 -- 172.21.15.19:0/968755669 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2334013950 con 0x559a6c9c5680 2024-09-19T09:02:56.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.436+0000 7f23227fc640 1 -- 172.21.15.19:0/968755669 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f232c09bee0 con 0x559a6c9c5680 2024-09-19T09:02:56.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.436+0000 7f2343a96740 10 client.17793 fetch_fsmap learned FSMap version 39 2024-09-19T09:02:56.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.436+0000 7f2343a96740 1 -- 172.21.15.19:0/968755669 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x559a6ca3fe90 con 0x559a6c9c5680 2024-09-19T09:02:56.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.436+0000 7f23227fc640 1 -- 172.21.15.19:0/968755669 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2334013950 con 0x559a6c9c5680 2024-09-19T09:02:56.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.436+0000 7f23227fc640 1 -- 172.21.15.19:0/968755669 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f232c097f80 con 0x559a6c9c5680 2024-09-19T09:02:56.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.437+0000 7f2343a96740 10 client.17793 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:02:56.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.437+0000 7f2343a96740 10 client.17793 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:02:56.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.437+0000 7f2343a96740 20 client.17793 populate_metadata read hostname 'smithi019' 2024-09-19T09:02:56.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.437+0000 7f2343a96740 1 --2- 172.21.15.19:0/968755669 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x559a6c9d5030 0x559a6ca425c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:56.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.437+0000 7f2343a96740 4 client.17793 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:02:56.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.437+0000 7f2343a96740 1 -- 172.21.15.19:0/968755669 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559a6c927d60 con 0x559a6c9d5030 2024-09-19T09:02:56.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.437+0000 7f233affd640 1 --2- 172.21.15.19:0/968755669 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x559a6c9d5030 0x559a6ca425c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:56.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.437+0000 7f23227fc640 10 client.17793 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:02:56.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.437+0000 7f233affd640 1 --2- 172.21.15.19:0/968755669 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x559a6c9d5030 0x559a6ca425c0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=407fdce012fdc182 server_cookie=b7538994bd8f4a1 in_seq=0 out_seq=0 2024-09-19T09:02:56.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.438+0000 7f23227fc640 1 -- 172.21.15.19:0/968755669 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559a6c927d60 con 0x559a6c9d5030 2024-09-19T09:02:56.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.438+0000 7f23227fc640 10 client.17793 handle_command_reply: tid=0 2024-09-19T09:02:56.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.438+0000 7f2343a96740 1 client.17793 shutdown 2024-09-19T09:02:56.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.438+0000 7f2343a96740 1 -- 172.21.15.19:0/968755669 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559a6c9c5680 msgr2=0x559a6c9cbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:56.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.438+0000 7f2343a96740 1 --2- 172.21.15.19:0/968755669 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559a6c9c5680 0x559a6c9cbe20 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f232c09c0a0 tx=0x7f232c005790 comp rx=0 tx=0).stop 2024-09-19T09:02:56.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.438+0000 7f2343a96740 1 -- 172.21.15.19:0/968755669 shutdown_connections 2024-09-19T09:02:56.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.438+0000 7f2343a96740 1 --2- 172.21.15.19:0/968755669 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x559a6c9d5030 0x559a6ca425c0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.438+0000 7f2343a96740 1 --2- 172.21.15.19:0/968755669 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a6c9badc0 0x559a6c9cb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.438+0000 7f23227fc640 0 client.17793 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:02:56.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.438+0000 7f2343a96740 1 --2- 172.21.15.19:0/968755669 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559a6c9c5680 0x559a6c9cbe20 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.438+0000 7f2343a96740 1 --2- 172.21.15.19:0/968755669 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559a6c9ba4a0 0x559a6c9cb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.438+0000 7f2343a96740 1 -- 172.21.15.19:0/968755669 >> 172.21.15.19:0/968755669 conn(0x559a6c9b6a30 msgr2=0x559a6c9c4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:56.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.438+0000 7f2343a96740 1 -- 172.21.15.19:0/968755669 shutdown_connections 2024-09-19T09:02:56.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.438+0000 7f2343a96740 1 -- 172.21.15.19:0/968755669 wait complete. 2024-09-19T09:02:56.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.439+0000 7f2343a96740 20 client.17793 trim_cache size 0 max 16384 2024-09-19T09:02:56.444 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T09:02:56.444 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-19T09:02:56.444 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {} 2024-09-19T09:02:56.444 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T09:02:56.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.439+0000 7f23416bd640 1 -- 172.21.15.19:0/317121250 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f23280a3240 msgr2=0x7f23280a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:56.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.439+0000 7f23416bd640 1 --2- 172.21.15.19:0/317121250 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f23280a3240 0x7f23280a5700 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2324005940 tx=0x7f2324000bc0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.439+0000 7f23416bd640 1 -- 172.21.15.19:0/317121250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f233c1082a0 msgr2=0x7f233c19cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:56.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.439+0000 7f23416bd640 1 --2- 172.21.15.19:0/317121250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f233c1082a0 0x7f233c19cf10 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f232c00eaa0 tx=0x7f232c00eea0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.440+0000 7f23416bd640 1 -- 172.21.15.19:0/317121250 shutdown_connections 2024-09-19T09:02:56.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.440+0000 7f23416bd640 1 --2- 172.21.15.19:0/317121250 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f23280a3240 0x7f23280a5700 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.440+0000 7f23416bd640 1 --2- 172.21.15.19:0/317121250 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f233c1036e0 0x7f233c198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.440+0000 7f23416bd640 1 --2- 172.21.15.19:0/317121250 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f233c1082a0 0x7f233c19cf10 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.440+0000 7f23416bd640 1 --2- 172.21.15.19:0/317121250 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f233c102d30 0x7f233c198640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:56.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.440+0000 7f23416bd640 1 -- 172.21.15.19:0/317121250 >> 172.21.15.19:0/317121250 conn(0x7f233c0fc7d0 msgr2=0x7f233c105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:56.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.440+0000 7f23416bd640 1 -- 172.21.15.19:0/317121250 shutdown_connections 2024-09-19T09:02:56.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:56.440+0000 7f23416bd640 1 -- 172.21.15.19:0/317121250 wait complete. 2024-09-19T09:02:57.793 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:02:57.793 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:02:57.799 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:58.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:57 smithi019 ceph-mon[30976]: pgmap v661: 97 pgs: 97 active+clean; 7.7 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 1.2 MiB/s wr, 1.36k op/s 2024-09-19T09:02:58.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:57 smithi155 ceph-mon[34921]: pgmap v661: 97 pgs: 97 active+clean; 7.7 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 1.2 MiB/s wr, 1.36k op/s 2024-09-19T09:02:58.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:57 smithi203 ceph-mon[35450]: pgmap v661: 97 pgs: 97 active+clean; 7.7 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 1.2 MiB/s wr, 1.36k op/s 2024-09-19T09:02:58.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.814+0000 7efde0f5a640 1 -- 172.21.15.19:0/1507182628 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efddc102db0 msgr2=0x7efddc103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:58.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.814+0000 7efde0f5a640 1 --2- 172.21.15.19:0/1507182628 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efddc102db0 0x7efddc103190 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7efdcc009900 tx=0x7efdcc02a480 comp rx=0 tx=0).stop 2024-09-19T09:02:58.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.815+0000 7efde0f5a640 1 -- 172.21.15.19:0/1507182628 shutdown_connections 2024-09-19T09:02:58.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.815+0000 7efde0f5a640 1 --2- 172.21.15.19:0/1507182628 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efddc1036d0 0x7efddc10bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.815+0000 7efde0f5a640 1 --2- 172.21.15.19:0/1507182628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efddc10c190 0x7efddc10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.815+0000 7efde0f5a640 1 --2- 172.21.15.19:0/1507182628 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efddc102db0 0x7efddc103190 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.815+0000 7efde0f5a640 1 -- 172.21.15.19:0/1507182628 >> 172.21.15.19:0/1507182628 conn(0x7efddc0fc790 msgr2=0x7efddc0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:58.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.815+0000 7efde0f5a640 1 -- 172.21.15.19:0/1507182628 shutdown_connections 2024-09-19T09:02:58.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.815+0000 7efde0f5a640 1 -- 172.21.15.19:0/1507182628 wait complete. 2024-09-19T09:02:58.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.816+0000 7efde0f5a640 1 Processor -- start 2024-09-19T09:02:58.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.816+0000 7efde0f5a640 1 -- start start 2024-09-19T09:02:58.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.816+0000 7efde0f5a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efddc102db0 0x7efddc100a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:58.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.816+0000 7efde0f5a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efddc1036d0 0x7efddc100f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:58.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.816+0000 7efde0f5a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efddc10c190 0x7efddc101490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:58.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.816+0000 7efde0f5a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7efddc111f60 con 0x7efddc10c190 2024-09-19T09:02:58.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.816+0000 7efde0f5a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efddc111de0 con 0x7efddc102db0 2024-09-19T09:02:58.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.816+0000 7efde0f5a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efddc1120e0 con 0x7efddc1036d0 2024-09-19T09:02:58.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.816+0000 7efddad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efddc10c190 0x7efddc101490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:58.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.816+0000 7efddad9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efddc10c190 0x7efddc101490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38666/0 (socket says 172.21.15.19:38666) 2024-09-19T09:02:58.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.816+0000 7efddad9d640 1 -- 172.21.15.19:0/3657304194 learned_addr learned my addr 172.21.15.19:0/3657304194 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:02:58.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.816+0000 7efdda59c640 1 --2- 172.21.15.19:0/3657304194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efddc102db0 0x7efddc100a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:58.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.816+0000 7efdd3fff640 1 --2- 172.21.15.19:0/3657304194 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efddc1036d0 0x7efddc100f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:58.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.817+0000 7efddad9d640 1 -- 172.21.15.19:0/3657304194 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efddc1036d0 msgr2=0x7efddc100f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:58.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.817+0000 7efddad9d640 1 --2- 172.21.15.19:0/3657304194 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efddc1036d0 0x7efddc100f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.817+0000 7efddad9d640 1 -- 172.21.15.19:0/3657304194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efddc102db0 msgr2=0x7efddc100a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:58.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.817+0000 7efddad9d640 1 --2- 172.21.15.19:0/3657304194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efddc102db0 0x7efddc100a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.817+0000 7efddad9d640 1 -- 172.21.15.19:0/3657304194 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efddc1a6970 con 0x7efddc10c190 2024-09-19T09:02:58.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.817+0000 7efddad9d640 1 --2- 172.21.15.19:0/3657304194 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efddc10c190 0x7efddc101490 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7efdd400eb10 tx=0x7efdd400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:58.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.817+0000 7efdd37fe640 1 -- 172.21.15.19:0/3657304194 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd4004b20 con 0x7efddc10c190 2024-09-19T09:02:58.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.817+0000 7efdd37fe640 1 -- 172.21.15.19:0/3657304194 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdd4004cc0 con 0x7efddc10c190 2024-09-19T09:02:58.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.817+0000 7efde0f5a640 1 -- 172.21.15.19:0/3657304194 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efddc1a6c60 con 0x7efddc10c190 2024-09-19T09:02:58.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.817+0000 7efdd37fe640 1 -- 172.21.15.19:0/3657304194 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd4010760 con 0x7efddc10c190 2024-09-19T09:02:58.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.817+0000 7efde0f5a640 1 -- 172.21.15.19:0/3657304194 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efddc1a71a0 con 0x7efddc10c190 2024-09-19T09:02:58.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.820+0000 7efde3333740 1 Processor -- start 2024-09-19T09:02:58.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.820+0000 7efdd37fe640 1 -- 172.21.15.19:0/3657304194 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7efdd4005020 con 0x7efddc10c190 2024-09-19T09:02:58.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.821+0000 7efde3333740 1 -- start start 2024-09-19T09:02:58.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.821+0000 7efde3333740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e12ab27760 0x55e12ab27b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:58.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.821+0000 7efde3333740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e12ab28080 0x55e12ab32400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:58.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.821+0000 7efde3333740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e12ab32940 0x55e12ab34d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:58.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.821+0000 7efde3333740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e12aa8d2a0 con 0x55e12ab27760 2024-09-19T09:02:58.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.821+0000 7efde3333740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55e12aa34b10 con 0x55e12ab32940 2024-09-19T09:02:58.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.821+0000 7efde3333740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e12aa89260 con 0x55e12ab28080 2024-09-19T09:02:58.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.821+0000 7efdd3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e12ab27760 0x55e12ab27b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:58.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.821+0000 7efdd3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e12ab27760 0x55e12ab27b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38672/0 (socket says 172.21.15.19:38672) 2024-09-19T09:02:58.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.821+0000 7efdd3fff640 1 -- 172.21.15.19:0/2802687960 learned_addr learned my addr 172.21.15.19:0/2802687960 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:02:58.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.821+0000 7efdda59c640 1 --2- 172.21.15.19:0/2802687960 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e12ab28080 0x55e12ab32400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:58.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.821+0000 7efdd3fff640 1 --2- 172.21.15.19:0/2802687960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e12ab32940 0x55e12ab34d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:58.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.822+0000 7efdd3fff640 1 -- 172.21.15.19:0/2802687960 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e12ab28080 msgr2=0x55e12ab32400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:58.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.822+0000 7efdd3fff640 1 --2- 172.21.15.19:0/2802687960 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e12ab28080 0x55e12ab32400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.822+0000 7efdd3fff640 1 -- 172.21.15.19:0/2802687960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e12ab32940 msgr2=0x55e12ab34d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:58.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.822+0000 7efdd3fff640 1 --2- 172.21.15.19:0/2802687960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e12ab32940 0x55e12ab34d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.822+0000 7efdd37fe640 1 --2- 172.21.15.19:0/3657304194 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7efdc80a3240 0x7efdc80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:58.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.822+0000 7efdd3fff640 1 -- 172.21.15.19:0/2802687960 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e12a7feb90 con 0x55e12ab27760 2024-09-19T09:02:58.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.822+0000 7efddad9d640 1 --2- 172.21.15.19:0/3657304194 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7efdc80a3240 0x7efdc80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:58.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.822+0000 7efdd37fe640 1 -- 172.21.15.19:0/3657304194 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7efdd40cff30 con 0x7efddc10c190 2024-09-19T09:02:58.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.822+0000 7efdd3fff640 1 --2- 172.21.15.19:0/2802687960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e12ab27760 0x55e12ab27b40 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7efdc40058a0 tx=0x7efdc400b770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b011b884768de598 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:58.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.823+0000 7efdd0ff9640 1 -- 172.21.15.19:0/2802687960 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc4012dd0 con 0x55e12ab27760 2024-09-19T09:02:58.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.823+0000 7efdd0ff9640 1 -- 172.21.15.19:0/2802687960 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdc4005500 con 0x55e12ab27760 2024-09-19T09:02:58.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.823+0000 7efdd0ff9640 1 -- 172.21.15.19:0/2802687960 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc4004ce0 con 0x55e12ab27760 2024-09-19T09:02:58.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.823+0000 7efde3333740 1 -- 172.21.15.19:0/2802687960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e12ab27760 msgr2=0x55e12ab27b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:58.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.823+0000 7efde3333740 1 --2- 172.21.15.19:0/2802687960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e12ab27760 0x55e12ab27b40 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7efdc40058a0 tx=0x7efdc400b770 comp rx=0 tx=0).stop 2024-09-19T09:02:58.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.823+0000 7efddad9d640 1 --2- 172.21.15.19:0/3657304194 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7efdc80a3240 0x7efdc80a5700 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7efdd4098f30 tx=0x7efdd4091a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:58.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.823+0000 7efde3333740 1 -- 172.21.15.19:0/2802687960 shutdown_connections 2024-09-19T09:02:58.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.823+0000 7efde3333740 1 --2- 172.21.15.19:0/2802687960 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e12ab28080 0x55e12ab32400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.823+0000 7efde3333740 1 --2- 172.21.15.19:0/2802687960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e12ab32940 0x55e12ab34d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.824+0000 7efde3333740 1 --2- 172.21.15.19:0/2802687960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e12ab27760 0x55e12ab27b40 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.824+0000 7efde3333740 1 -- 172.21.15.19:0/2802687960 >> 172.21.15.19:0/2802687960 conn(0x55e12ab23cf0 msgr2=0x55e12ab240d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:58.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.824+0000 7efde3333740 1 -- 172.21.15.19:0/2802687960 shutdown_connections 2024-09-19T09:02:58.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.824+0000 7efde3333740 1 -- 172.21.15.19:0/2802687960 wait complete. 2024-09-19T09:02:58.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.824+0000 7efde3333740 1 -- start start 2024-09-19T09:02:58.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.824+0000 7efde3333740 1 Processor -- start 2024-09-19T09:02:58.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.824+0000 7efde3333740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e12ab27760 0x55e12ab2f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:58.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.824+0000 7efde3333740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e12ab28080 0x55e12ab2fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:58.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.824+0000 7efde3333740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e12ab32940 0x55e12ab30260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:58.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.824+0000 7efde3333740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e12ab35510 con 0x55e12ab28080 2024-09-19T09:02:58.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.824+0000 7efde3333740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55e12aa156e0 con 0x55e12ab32940 2024-09-19T09:02:58.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.824+0000 7efde3333740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e12ab35690 con 0x55e12ab27760 2024-09-19T09:02:58.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.825+0000 7efde3333740 10 client.0 _ll_register_callbacks cb 0x55e12aa39a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:58.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.825+0000 7efdda59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e12ab28080 0x55e12ab2fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:58.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.825+0000 7efdda59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e12ab28080 0x55e12ab2fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38688/0 (socket says 172.21.15.19:38688) 2024-09-19T09:02:58.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.825+0000 7efdda59c640 1 -- 172.21.15.19:0/3395053133 learned_addr learned my addr 172.21.15.19:0/3395053133 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:02:58.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.825+0000 7efdd3fff640 1 --2- 172.21.15.19:0/3395053133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e12ab32940 0x55e12ab30260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:58.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.825+0000 7efdd3fff640 1 --2- 172.21.15.19:0/3395053133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e12ab27760 0x55e12ab2f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:58.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.825+0000 7efdda59c640 1 -- 172.21.15.19:0/3395053133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e12ab27760 msgr2=0x55e12ab2f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:58.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.825+0000 7efdda59c640 1 --2- 172.21.15.19:0/3395053133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e12ab27760 0x55e12ab2f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.825+0000 7efdda59c640 1 -- 172.21.15.19:0/3395053133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e12ab32940 msgr2=0x55e12ab30260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:58.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.825+0000 7efdda59c640 1 --2- 172.21.15.19:0/3395053133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e12ab32940 0x55e12ab30260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.825+0000 7efdda59c640 1 -- 172.21.15.19:0/3395053133 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e12ab3e9d0 con 0x55e12ab28080 2024-09-19T09:02:58.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.825+0000 7efdd3fff640 1 --2- 172.21.15.19:0/3395053133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e12ab32940 0x55e12ab30260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:58.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.825+0000 7efdda59c640 1 --2- 172.21.15.19:0/3395053133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e12ab28080 0x55e12ab2fd20 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7efdcc009900 tx=0x7efdcc031850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=211e3f218d0d0974 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:58.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.825+0000 7efdc1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:02:58.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.826+0000 7efdc1ffb640 1 -- 172.21.15.19:0/3395053133 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc035040 con 0x55e12ab28080 2024-09-19T09:02:58.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.826+0000 7efdc1ffb640 1 -- 172.21.15.19:0/3395053133 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7efdcc004460 con 0x55e12ab28080 2024-09-19T09:02:58.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.826+0000 7efde3333740 1 -- 172.21.15.19:0/3395053133 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdc4005500 con 0x55e12ab28080 2024-09-19T09:02:58.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.826+0000 7efdc1ffb640 1 -- 172.21.15.19:0/3395053133 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7efdcc0035f0 con 0x55e12ab28080 2024-09-19T09:02:58.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.826+0000 7efde3333740 10 client.17805 fetch_fsmap learned FSMap version 39 2024-09-19T09:02:58.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.826+0000 7efde3333740 1 -- 172.21.15.19:0/3395053133 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55e12ab41340 con 0x55e12ab28080 2024-09-19T09:02:58.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.826+0000 7efdc1ffb640 1 -- 172.21.15.19:0/3395053133 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdc4005500 con 0x55e12ab28080 2024-09-19T09:02:58.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.826+0000 7efdc1ffb640 1 -- 172.21.15.19:0/3395053133 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7efdcc046940 con 0x55e12ab28080 2024-09-19T09:02:58.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.827+0000 7efde3333740 10 client.17805 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:02:58.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.827+0000 7efde3333740 10 client.17805 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:02:58.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.827+0000 7efde3333740 20 client.17805 populate_metadata read hostname 'smithi019' 2024-09-19T09:02:58.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.827+0000 7efde3333740 1 --2- 172.21.15.19:0/3395053133 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e12ab42850 0x55e12ab44c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:58.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.827+0000 7efde3333740 4 client.17805 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:02:58.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.827+0000 7efde3333740 1 -- 172.21.15.19:0/3395053133 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e12aa9a9d0 con 0x55e12ab42850 2024-09-19T09:02:58.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.827+0000 7efdd3fff640 1 --2- 172.21.15.19:0/3395053133 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e12ab42850 0x55e12ab44c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:58.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.828+0000 7efdd3fff640 1 --2- 172.21.15.19:0/3395053133 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e12ab42850 0x55e12ab44c70 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=859e932fc52a2ed5 server_cookie=6c6f7a0463abcda in_seq=0 out_seq=0 2024-09-19T09:02:58.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.828+0000 7efdc1ffb640 10 client.17805 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:02:58.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.828+0000 7efdc1ffb640 1 -- 172.21.15.19:0/3395053133 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e12aa9a9d0 con 0x55e12ab42850 2024-09-19T09:02:58.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.828+0000 7efdc1ffb640 10 client.17805 handle_command_reply: tid=0 2024-09-19T09:02:58.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.828+0000 7efde3333740 1 client.17805 shutdown 2024-09-19T09:02:58.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.829+0000 7efde3333740 1 -- 172.21.15.19:0/3395053133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e12ab28080 msgr2=0x55e12ab2fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:58.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.829+0000 7efde3333740 1 --2- 172.21.15.19:0/3395053133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e12ab28080 0x55e12ab2fd20 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7efdcc009900 tx=0x7efdcc031850 comp rx=0 tx=0).stop 2024-09-19T09:02:58.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.829+0000 7efde3333740 1 -- 172.21.15.19:0/3395053133 shutdown_connections 2024-09-19T09:02:58.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.829+0000 7efde3333740 1 --2- 172.21.15.19:0/3395053133 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e12ab42850 0x55e12ab44c70 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.829+0000 7efde3333740 1 --2- 172.21.15.19:0/3395053133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e12ab32940 0x55e12ab30260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.829+0000 7efde3333740 1 --2- 172.21.15.19:0/3395053133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e12ab28080 0x55e12ab2fd20 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.829+0000 7efde3333740 1 --2- 172.21.15.19:0/3395053133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e12ab27760 0x55e12ab2f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.829+0000 7efde3333740 1 -- 172.21.15.19:0/3395053133 >> 172.21.15.19:0/3395053133 conn(0x55e12ab23cf0 msgr2=0x55e12ab29a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:58.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.829+0000 7efdc1ffb640 0 client.17805 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:02:58.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.829+0000 7efde3333740 1 -- 172.21.15.19:0/3395053133 shutdown_connections 2024-09-19T09:02:58.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.829+0000 7efde3333740 1 -- 172.21.15.19:0/3395053133 wait complete. 2024-09-19T09:02:58.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.829+0000 7efde3333740 20 client.17805 trim_cache size 0 max 16384 2024-09-19T09:02:58.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.849+0000 7efde3333740 1 Processor -- start 2024-09-19T09:02:58.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.849+0000 7efde3333740 1 -- start start 2024-09-19T09:02:58.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.849+0000 7efde3333740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e12ab27760 0x55e12ab316b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:58.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.849+0000 7efde3333740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e12ab28080 0x55e12ab300b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:58.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.849+0000 7efde3333740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e12ab32940 0x55e12ab4a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:58.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.849+0000 7efde3333740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7efddc1af730 con 0x55e12ab27760 2024-09-19T09:02:58.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.849+0000 7efde3333740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efddc1b1270 con 0x55e12ab28080 2024-09-19T09:02:58.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.849+0000 7efde3333740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efddc1afe00 con 0x55e12ab32940 2024-09-19T09:02:58.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.849+0000 7efdd3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e12ab27760 0x55e12ab316b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:58.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.849+0000 7efdd3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e12ab27760 0x55e12ab316b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38692/0 (socket says 172.21.15.19:38692) 2024-09-19T09:02:58.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.849+0000 7efdd3fff640 1 -- 172.21.15.19:0/2373481248 learned_addr learned my addr 172.21.15.19:0/2373481248 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:02:58.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.849+0000 7efdda59c640 1 --2- 172.21.15.19:0/2373481248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e12ab28080 0x55e12ab300b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:58.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.849+0000 7efdd3fff640 1 --2- 172.21.15.19:0/2373481248 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e12ab32940 0x55e12ab4a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:58.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.850+0000 7efdda59c640 1 -- 172.21.15.19:0/2373481248 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e12ab32940 msgr2=0x55e12ab4a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:58.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.850+0000 7efdda59c640 1 --2- 172.21.15.19:0/2373481248 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e12ab32940 0x55e12ab4a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.850+0000 7efdda59c640 1 -- 172.21.15.19:0/2373481248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e12ab27760 msgr2=0x55e12ab316b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:58.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.850+0000 7efdda59c640 1 --2- 172.21.15.19:0/2373481248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e12ab27760 0x55e12ab316b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.850+0000 7efdda59c640 1 -- 172.21.15.19:0/2373481248 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e12ab1f260 con 0x55e12ab28080 2024-09-19T09:02:58.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.850+0000 7efdd3fff640 1 --2- 172.21.15.19:0/2373481248 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e12ab32940 0x55e12ab4a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:02:58.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.850+0000 7efdda59c640 1 --2- 172.21.15.19:0/2373481248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e12ab28080 0x55e12ab300b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efdcc046d10 tx=0x7efdcc02a480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1392efd8593573d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:58.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.850+0000 7efdc3fff640 1 -- 172.21.15.19:0/2373481248 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc055020 con 0x55e12ab28080 2024-09-19T09:02:58.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.850+0000 7efdc3fff640 1 -- 172.21.15.19:0/2373481248 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdcc041070 con 0x55e12ab28080 2024-09-19T09:02:58.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.850+0000 7efdc3fff640 1 -- 172.21.15.19:0/2373481248 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdcc035070 con 0x55e12ab28080 2024-09-19T09:02:58.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.851+0000 7efde3333740 1 -- 172.21.15.19:0/2373481248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e12ab28080 msgr2=0x55e12ab300b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:58.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.851+0000 7efde3333740 1 --2- 172.21.15.19:0/2373481248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e12ab28080 0x55e12ab300b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efdcc046d10 tx=0x7efdcc02a480 comp rx=0 tx=0).stop 2024-09-19T09:02:58.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.851+0000 7efde3333740 1 -- 172.21.15.19:0/2373481248 shutdown_connections 2024-09-19T09:02:58.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.851+0000 7efde3333740 1 --2- 172.21.15.19:0/2373481248 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e12ab32940 0x55e12ab4a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.851+0000 7efde3333740 1 --2- 172.21.15.19:0/2373481248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e12ab28080 0x55e12ab300b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.851+0000 7efde3333740 1 --2- 172.21.15.19:0/2373481248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e12ab27760 0x55e12ab316b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.851+0000 7efde3333740 1 -- 172.21.15.19:0/2373481248 >> 172.21.15.19:0/2373481248 conn(0x55e12ab23cf0 msgr2=0x55e12ab22e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:58.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.851+0000 7efde3333740 1 -- 172.21.15.19:0/2373481248 shutdown_connections 2024-09-19T09:02:58.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.851+0000 7efde3333740 1 -- 172.21.15.19:0/2373481248 wait complete. 2024-09-19T09:02:58.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.851+0000 7efde3333740 1 -- start start 2024-09-19T09:02:58.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.852+0000 7efde3333740 1 Processor -- start 2024-09-19T09:02:58.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.852+0000 7efde3333740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e12ab27760 0x55e12ab36740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:58.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.852+0000 7efde3333740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e12ab28080 0x55e12ab36c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:58.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.852+0000 7efde3333740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e12ab32940 0x55e12ab371c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:58.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.852+0000 7efde3333740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7efddc1b0ba0 con 0x55e12ab27760 2024-09-19T09:02:58.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.852+0000 7efde3333740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7efddc1b04d0 con 0x55e12ab32940 2024-09-19T09:02:58.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.852+0000 7efde3333740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efddc1ad710 con 0x55e12ab28080 2024-09-19T09:02:58.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.852+0000 7efdd3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e12ab27760 0x55e12ab36740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:58.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.852+0000 7efdd3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e12ab27760 0x55e12ab36740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38702/0 (socket says 172.21.15.19:38702) 2024-09-19T09:02:58.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.852+0000 7efdd3fff640 1 -- 172.21.15.19:0/1160575448 learned_addr learned my addr 172.21.15.19:0/1160575448 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:02:58.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.852+0000 7efde3333740 10 client.0 _ll_register_callbacks cb 0x7efdcc009610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:02:58.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.852+0000 7efdda59c640 1 --2- 172.21.15.19:0/1160575448 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e12ab28080 0x55e12ab36c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:58.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.853+0000 7efdd3fff640 1 -- 172.21.15.19:0/1160575448 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e12ab28080 msgr2=0x55e12ab36c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:58.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.853+0000 7efdd3fff640 1 --2- 172.21.15.19:0/1160575448 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e12ab28080 0x55e12ab36c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.853+0000 7efdd3fff640 1 -- 172.21.15.19:0/1160575448 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e12ab32940 msgr2=0x55e12ab371c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:02:58.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.853+0000 7efdd3fff640 1 --2- 172.21.15.19:0/1160575448 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e12ab32940 0x55e12ab371c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.853+0000 7efdd3fff640 1 -- 172.21.15.19:0/1160575448 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e12abac610 con 0x55e12ab27760 2024-09-19T09:02:58.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.853+0000 7efdd3fff640 1 --2- 172.21.15.19:0/1160575448 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e12ab27760 0x55e12ab36740 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7efdc4001eb0 tx=0x7efdc400b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da2df92717ccac35 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:02:58.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.853+0000 7efdc1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:02:58.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.853+0000 7efdc1ffb640 1 -- 172.21.15.19:0/1160575448 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc402f060 con 0x55e12ab27760 2024-09-19T09:02:58.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.853+0000 7efdc1ffb640 1 -- 172.21.15.19:0/1160575448 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7efdc4004240 con 0x55e12ab27760 2024-09-19T09:02:58.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.853+0000 7efde3333740 1 -- 172.21.15.19:0/1160575448 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efdcc041070 con 0x55e12ab27760 2024-09-19T09:02:58.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.853+0000 7efdc1ffb640 1 -- 172.21.15.19:0/1160575448 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7efdc4029040 con 0x55e12ab27760 2024-09-19T09:02:58.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.853+0000 7efde3333740 10 client.17811 fetch_fsmap learned FSMap version 39 2024-09-19T09:02:58.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.853+0000 7efde3333740 1 -- 172.21.15.19:0/1160575448 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55e12abad8d0 con 0x55e12ab27760 2024-09-19T09:02:58.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.854+0000 7efdc1ffb640 1 -- 172.21.15.19:0/1160575448 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7efdcc041070 con 0x55e12ab27760 2024-09-19T09:02:58.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.854+0000 7efdc1ffb640 1 -- 172.21.15.19:0/1160575448 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7efdc4003680 con 0x55e12ab27760 2024-09-19T09:02:58.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.854+0000 7efde3333740 10 client.17811 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:02:58.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.854+0000 7efde3333740 10 client.17811 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:02:58.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.854+0000 7efde3333740 20 client.17811 populate_metadata read hostname 'smithi019' 2024-09-19T09:02:58.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.854+0000 7efde3333740 1 --2- 172.21.15.19:0/1160575448 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e12abade10 0x55e12abb0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:02:58.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.854+0000 7efde3333740 4 client.17811 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-09-19T09:02:58.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.854+0000 7efde3333740 1 -- 172.21.15.19:0/1160575448 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x55e12aa94d20 con 0x55e12abade10 2024-09-19T09:02:58.859 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:02:58.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.854+0000 7efdda59c640 1 --2- 172.21.15.19:0/1160575448 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e12abade10 0x55e12abb0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:02:58.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.855+0000 7efdc1ffb640 10 client.17811 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:02:58.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.855+0000 7efdda59c640 1 --2- 172.21.15.19:0/1160575448 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e12abade10 0x55e12abb0200 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a695c54ecb5827f server_cookie=b762506ad194c93a in_seq=0 out_seq=0 2024-09-19T09:02:58.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.872+0000 7efdc1ffb640 1 -- 172.21.15.19:0/1160575448 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55e12aa94d20 con 0x55e12abade10 2024-09-19T09:02:58.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.872+0000 7efdc1ffb640 10 client.17811 handle_command_reply: tid=0 2024-09-19T09:02:58.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.872+0000 7efde3333740 1 client.17811 shutdown 2024-09-19T09:02:58.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.873+0000 7efde3333740 1 -- 172.21.15.19:0/1160575448 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e12ab27760 msgr2=0x55e12ab36740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:58.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.873+0000 7efde3333740 1 --2- 172.21.15.19:0/1160575448 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e12ab27760 0x55e12ab36740 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7efdc4001eb0 tx=0x7efdc400b7e0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.873+0000 7efde3333740 1 -- 172.21.15.19:0/1160575448 shutdown_connections 2024-09-19T09:02:58.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.873+0000 7efde3333740 1 --2- 172.21.15.19:0/1160575448 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e12abade10 0x55e12abb0200 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.873+0000 7efde3333740 1 --2- 172.21.15.19:0/1160575448 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e12ab28080 0x55e12ab36c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.873+0000 7efde3333740 1 --2- 172.21.15.19:0/1160575448 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e12ab32940 0x55e12ab371c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.873+0000 7efde3333740 1 --2- 172.21.15.19:0/1160575448 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e12ab27760 0x55e12ab36740 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.873+0000 7efdc1ffb640 0 client.17811 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:02:58.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.873+0000 7efde3333740 1 -- 172.21.15.19:0/1160575448 >> 172.21.15.19:0/1160575448 conn(0x55e12ab23cf0 msgr2=0x55e12ab291b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:58.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.873+0000 7efde3333740 1 -- 172.21.15.19:0/1160575448 shutdown_connections 2024-09-19T09:02:58.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.873+0000 7efde3333740 1 -- 172.21.15.19:0/1160575448 wait complete. 2024-09-19T09:02:58.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.873+0000 7efde3333740 20 client.17811 trim_cache size 0 max 16384 2024-09-19T09:02:58.875 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T09:02:58.875 INFO:teuthology.orchestra.run.smithi019.stdout: "epoch": 39, 2024-09-19T09:02:58.875 INFO:teuthology.orchestra.run.smithi019.stdout: "leader": 24497, 2024-09-19T09:02:58.875 INFO:teuthology.orchestra.run.smithi019.stdout: "set_version": 34, 2024-09-19T09:02:58.875 INFO:teuthology.orchestra.run.smithi019.stdout: "sets": { 2024-09-19T09:02:58.876 INFO:teuthology.orchestra.run.smithi019.stdout: "58095ad0": { 2024-09-19T09:02:58.876 INFO:teuthology.orchestra.run.smithi019.stdout: "version": 34, 2024-09-19T09:02:58.876 INFO:teuthology.orchestra.run.smithi019.stdout: "age_ref": 0.0, 2024-09-19T09:02:58.876 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T09:02:58.876 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "QUIESCED", 2024-09-19T09:02:58.876 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T09:02:58.876 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:02:58.876 INFO:teuthology.orchestra.run.smithi019.stdout: "timeout": 90.0, 2024-09-19T09:02:58.876 INFO:teuthology.orchestra.run.smithi019.stdout: "expiration": 150.0, 2024-09-19T09:02:58.876 INFO:teuthology.orchestra.run.smithi019.stdout: "members": { 2024-09-19T09:02:58.876 INFO:teuthology.orchestra.run.smithi019.stdout: "file:/": { 2024-09-19T09:02:58.876 INFO:teuthology.orchestra.run.smithi019.stdout: "excluded": false, 2024-09-19T09:02:58.877 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T09:02:58.877 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "QUIESCED", 2024-09-19T09:02:58.877 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T09:02:58.877 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:02:58.877 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:02:58.877 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:02:58.877 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:02:58.877 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:02:58.877 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T09:02:58.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.874+0000 7efde0f5a640 1 -- 172.21.15.19:0/3657304194 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7efdc80a3240 msgr2=0x7efdc80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:58.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.874+0000 7efde0f5a640 1 --2- 172.21.15.19:0/3657304194 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7efdc80a3240 0x7efdc80a5700 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7efdd4098f30 tx=0x7efdd4091a40 comp rx=0 tx=0).stop 2024-09-19T09:02:58.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.874+0000 7efde0f5a640 1 -- 172.21.15.19:0/3657304194 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efddc10c190 msgr2=0x7efddc101490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:02:58.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.874+0000 7efde0f5a640 1 --2- 172.21.15.19:0/3657304194 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efddc10c190 0x7efddc101490 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7efdd400eb10 tx=0x7efdd400c2d0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.874+0000 7efde0f5a640 1 -- 172.21.15.19:0/3657304194 shutdown_connections 2024-09-19T09:02:58.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.874+0000 7efde0f5a640 1 --2- 172.21.15.19:0/3657304194 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7efdc80a3240 0x7efdc80a5700 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.874+0000 7efde0f5a640 1 --2- 172.21.15.19:0/3657304194 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efddc1036d0 0x7efddc100f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.874+0000 7efde0f5a640 1 --2- 172.21.15.19:0/3657304194 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7efddc10c190 0x7efddc101490 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.874+0000 7efde0f5a640 1 --2- 172.21.15.19:0/3657304194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7efddc102db0 0x7efddc100a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:02:58.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.874+0000 7efde0f5a640 1 -- 172.21.15.19:0/3657304194 >> 172.21.15.19:0/3657304194 conn(0x7efddc0fc790 msgr2=0x7efddc0fdfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:02:58.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.874+0000 7efde0f5a640 1 -- 172.21.15.19:0/3657304194 shutdown_connections 2024-09-19T09:02:58.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:02:58.874+0000 7efde0f5a640 1 -- 172.21.15.19:0/3657304194 wait complete. 2024-09-19T09:03:00.041 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:02:59 smithi019 ceph-mon[30976]: pgmap v662: 97 pgs: 97 active+clean; 7.7 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 723 KiB/s wr, 1.23k op/s 2024-09-19T09:03:00.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:02:59 smithi155 ceph-mon[34921]: pgmap v662: 97 pgs: 97 active+clean; 7.7 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 723 KiB/s wr, 1.23k op/s 2024-09-19T09:03:00.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:02:59 smithi203 ceph-mon[35450]: pgmap v662: 97 pgs: 97 active+clean; 7.7 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 723 KiB/s wr, 1.23k op/s 2024-09-19T09:03:00.460 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '58095ad0', quiesce took 7.1 seconds. Will release after: 22.9 2024-09-19T09:03:00.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.634+0000 7f7225f0d640 1 -- 172.21.15.19:0/2400274717 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7220108300 msgr2=0x7f722010ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:00.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.634+0000 7f7225f0d640 1 --2- 172.21.15.19:0/2400274717 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7220108300 0x7f722010ec70 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f7218009cd0 tx=0x7f721802a8d0 comp rx=0 tx=0).stop 2024-09-19T09:03:00.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.634+0000 7f7225f0d640 1 -- 172.21.15.19:0/2400274717 shutdown_connections 2024-09-19T09:03:00.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.634+0000 7f7225f0d640 1 --2- 172.21.15.19:0/2400274717 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7220108300 0x7f722010ec70 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:00.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.634+0000 7f7225f0d640 1 --2- 172.21.15.19:0/2400274717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7220103780 0x7f7220107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:00.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.634+0000 7f7225f0d640 1 --2- 172.21.15.19:0/2400274717 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7220102dd0 0x7f72201031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:00.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.634+0000 7f7225f0d640 1 -- 172.21.15.19:0/2400274717 >> 172.21.15.19:0/2400274717 conn(0x7f72200fc7d0 msgr2=0x7f72200febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:00.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.634+0000 7f7225f0d640 1 -- 172.21.15.19:0/2400274717 shutdown_connections 2024-09-19T09:03:00.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.634+0000 7f7225f0d640 1 -- 172.21.15.19:0/2400274717 wait complete. 2024-09-19T09:03:00.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.634+0000 7f7225f0d640 1 Processor -- start 2024-09-19T09:03:00.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.634+0000 7f7225f0d640 1 -- start start 2024-09-19T09:03:00.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.635+0000 7f7225f0d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7220102dd0 0x7f7220198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:00.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.635+0000 7f7225f0d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7220103780 0x7f7220198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:00.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.635+0000 7f7225f0d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7220108300 0x7f722019ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:00.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.635+0000 7f7225f0d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f72201120d0 con 0x7f7220102dd0 2024-09-19T09:03:00.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.635+0000 7f7225f0d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7220111f50 con 0x7f7220103780 2024-09-19T09:03:00.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.635+0000 7f7225f0d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7220112250 con 0x7f7220108300 2024-09-19T09:03:00.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.635+0000 7f721f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7220102dd0 0x7f7220198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:00.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.635+0000 7f721f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7220102dd0 0x7f7220198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38720/0 (socket says 172.21.15.19:38720) 2024-09-19T09:03:00.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.635+0000 7f721f7fe640 1 -- 172.21.15.19:0/3309888609 learned_addr learned my addr 172.21.15.19:0/3309888609 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:00.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.635+0000 7f721ffff640 1 --2- 172.21.15.19:0/3309888609 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7220108300 0x7f722019ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:00.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.635+0000 7f721effd640 1 --2- 172.21.15.19:0/3309888609 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7220103780 0x7f7220198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:00.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.635+0000 7f721f7fe640 1 -- 172.21.15.19:0/3309888609 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7220108300 msgr2=0x7f722019ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:00.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.635+0000 7f721f7fe640 1 --2- 172.21.15.19:0/3309888609 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7220108300 0x7f722019ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:00.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.635+0000 7f721f7fe640 1 -- 172.21.15.19:0/3309888609 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7220103780 msgr2=0x7f7220198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:00.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.635+0000 7f721f7fe640 1 --2- 172.21.15.19:0/3309888609 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7220103780 0x7f7220198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:00.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.635+0000 7f721f7fe640 1 -- 172.21.15.19:0/3309888609 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f722019d540 con 0x7f7220102dd0 2024-09-19T09:03:00.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.635+0000 7f721f7fe640 1 --2- 172.21.15.19:0/3309888609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7220102dd0 0x7f7220198590 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f721000e9f0 tx=0x7f721000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:00.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.636+0000 7f721cff9640 1 -- 172.21.15.19:0/3309888609 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f721000cd80 con 0x7f7220102dd0 2024-09-19T09:03:00.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.636+0000 7f7225f0d640 1 -- 172.21.15.19:0/3309888609 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f722019d830 con 0x7f7220102dd0 2024-09-19T09:03:00.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.636+0000 7f721cff9640 1 -- 172.21.15.19:0/3309888609 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7210005500 con 0x7f7220102dd0 2024-09-19T09:03:00.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.636+0000 7f721cff9640 1 -- 172.21.15.19:0/3309888609 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7210010690 con 0x7f7220102dd0 2024-09-19T09:03:00.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.636+0000 7f7225f0d640 1 -- 172.21.15.19:0/3309888609 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72201a5110 con 0x7f7220102dd0 2024-09-19T09:03:00.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.637+0000 7f7225f0d640 1 -- 172.21.15.19:0/3309888609 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72201031b0 con 0x7f7220102dd0 2024-09-19T09:03:00.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.638+0000 7f721cff9640 1 -- 172.21.15.19:0/3309888609 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f72100046c0 con 0x7f7220102dd0 2024-09-19T09:03:00.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.639+0000 7f721cff9640 1 --2- 172.21.15.19:0/3309888609 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f72080a3240 0x7f72080a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:00.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.639+0000 7f721effd640 1 --2- 172.21.15.19:0/3309888609 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f72080a3240 0x7f72080a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:00.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.639+0000 7f721cff9640 1 -- 172.21.15.19:0/3309888609 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f72100cff10 con 0x7f7220102dd0 2024-09-19T09:03:00.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.639+0000 7f721effd640 1 --2- 172.21.15.19:0/3309888609 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f72080a3240 0x7f72080a5700 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f72200fee50 tx=0x7f7214005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:00.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.642+0000 7f721cff9640 1 -- 172.21.15.19:0/3309888609 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7210054210 con 0x7f7220102dd0 2024-09-19T09:03:00.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.854+0000 7f7225f0d640 1 -- 172.21.15.19:0/3309888609 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72201998f0 con 0x7f7220102dd0 2024-09-19T09:03:00.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.854+0000 7f721cff9640 1 -- 172.21.15.19:0/3309888609 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+11983 (secure 0 0 0) 0x7f721009cc40 con 0x7f7220102dd0 2024-09-19T09:03:00.855 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T09:03:00.855 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":39,"btime":"2024-09-19T09:02:47:631181+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":17751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/3815927080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":3815927080},{"type":"v1","addr":"172.21.15.19:6839","nonce":3815927080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":39,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T09:02:47.631165+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26453":{"gid":26453,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/3907362737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3907362737},{"type":"v1","addr":"172.21.15.155:6835","nonce":3907362737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24469,24490,24464,24463]},"id":1}]} 2024-09-19T09:03:00.856 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 39 2024-09-19T09:03:00.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.856+0000 7f7225f0d640 1 -- 172.21.15.19:0/3309888609 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f72080a3240 msgr2=0x7f72080a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.856+0000 7f7225f0d640 1 --2- 172.21.15.19:0/3309888609 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f72080a3240 0x7f72080a5700 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f72200fee50 tx=0x7f7214005f90 comp rx=0 tx=0).stop 2024-09-19T09:03:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.856+0000 7f7225f0d640 1 -- 172.21.15.19:0/3309888609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7220102dd0 msgr2=0x7f7220198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.856+0000 7f7225f0d640 1 --2- 172.21.15.19:0/3309888609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7220102dd0 0x7f7220198590 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f721000e9f0 tx=0x7f721000edf0 comp rx=0 tx=0).stop 2024-09-19T09:03:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.856+0000 7f7225f0d640 1 -- 172.21.15.19:0/3309888609 shutdown_connections 2024-09-19T09:03:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.856+0000 7f7225f0d640 1 --2- 172.21.15.19:0/3309888609 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f72080a3240 0x7f72080a5700 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.856+0000 7f7225f0d640 1 --2- 172.21.15.19:0/3309888609 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7220108300 0x7f722019ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.856+0000 7f7225f0d640 1 --2- 172.21.15.19:0/3309888609 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7220103780 0x7f7220198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.856+0000 7f7225f0d640 1 --2- 172.21.15.19:0/3309888609 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7220102dd0 0x7f7220198590 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.856+0000 7f7225f0d640 1 -- 172.21.15.19:0/3309888609 >> 172.21.15.19:0/3309888609 conn(0x7f72200fc7d0 msgr2=0x7f7220105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.857+0000 7f7225f0d640 1 -- 172.21.15.19:0/3309888609 shutdown_connections 2024-09-19T09:03:00.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:00.857+0000 7f7225f0d640 1 -- 172.21.15.19:0/3309888609 wait complete. 2024-09-19T09:03:01.512 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T09:03:01.776 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:02.038 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:01 smithi019 ceph-mon[30976]: pgmap v663: 97 pgs: 97 active+clean; 7.7 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 406 KiB/s wr, 1.05k op/s 2024-09-19T09:03:02.038 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:01 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3309888609' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:02.071 INFO:tasks.workunit.client.0.smithi019.stdout:ok 2024-09-19T09:03:02.076 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T09:03:02.076 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T09:03:02.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:01 smithi155 ceph-mon[34921]: pgmap v663: 97 pgs: 97 active+clean; 7.7 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 406 KiB/s wr, 1.05k op/s 2024-09-19T09:03:02.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:01 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3309888609' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:02.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:01 smithi203 ceph-mon[35450]: pgmap v663: 97 pgs: 97 active+clean; 7.7 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 406 KiB/s wr, 1.05k op/s 2024-09-19T09:03:02.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:01 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3309888609' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:02.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.248+0000 7f1a465a1640 1 -- 172.21.15.19:0/1772941090 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a401082e0 msgr2=0x7f1a4010ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:02.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.248+0000 7f1a465a1640 1 --2- 172.21.15.19:0/1772941090 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a401082e0 0x7f1a4010ec50 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f1a38009cd0 tx=0x7f1a3802a8e0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.248+0000 7f1a465a1640 1 -- 172.21.15.19:0/1772941090 shutdown_connections 2024-09-19T09:03:02.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.248+0000 7f1a465a1640 1 --2- 172.21.15.19:0/1772941090 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a401082e0 0x7f1a4010ec50 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.248+0000 7f1a465a1640 1 --2- 172.21.15.19:0/1772941090 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a40103760 0x7f1a40107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.248+0000 7f1a465a1640 1 --2- 172.21.15.19:0/1772941090 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a40102db0 0x7f1a40103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.248+0000 7f1a465a1640 1 -- 172.21.15.19:0/1772941090 >> 172.21.15.19:0/1772941090 conn(0x7f1a400fc7d0 msgr2=0x7f1a400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:02.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.248+0000 7f1a465a1640 1 -- 172.21.15.19:0/1772941090 shutdown_connections 2024-09-19T09:03:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.248+0000 7f1a465a1640 1 -- 172.21.15.19:0/1772941090 wait complete. 2024-09-19T09:03:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.249+0000 7f1a465a1640 1 Processor -- start 2024-09-19T09:03:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.249+0000 7f1a465a1640 1 -- start start 2024-09-19T09:03:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.249+0000 7f1a465a1640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a40102db0 0x7f1a40198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.249+0000 7f1a465a1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a40103760 0x7f1a40198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.249+0000 7f1a465a1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a401082e0 0x7f1a4019ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.249+0000 7f1a465a1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1a401120b0 con 0x7f1a40103760 2024-09-19T09:03:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.249+0000 7f1a465a1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1a40111f30 con 0x7f1a401082e0 2024-09-19T09:03:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.249+0000 7f1a465a1640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1a40112230 con 0x7f1a40102db0 2024-09-19T09:03:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.249+0000 7f1a37fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a40103760 0x7f1a40198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.249+0000 7f1a37fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a40103760 0x7f1a40198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38734/0 (socket says 172.21.15.19:38734) 2024-09-19T09:03:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.249+0000 7f1a37fff640 1 -- 172.21.15.19:0/591518877 learned_addr learned my addr 172.21.15.19:0/591518877 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.249+0000 7f1a3ffff640 1 --2- 172.21.15.19:0/591518877 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a40102db0 0x7f1a40198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.249+0000 7f1a44b3e640 1 --2- 172.21.15.19:0/591518877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a401082e0 0x7f1a4019ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.250+0000 7f1a37fff640 1 -- 172.21.15.19:0/591518877 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a40102db0 msgr2=0x7f1a40198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.250+0000 7f1a37fff640 1 --2- 172.21.15.19:0/591518877 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a40102db0 0x7f1a40198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.250+0000 7f1a37fff640 1 -- 172.21.15.19:0/591518877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a401082e0 msgr2=0x7f1a4019ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.250+0000 7f1a37fff640 1 --2- 172.21.15.19:0/591518877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a401082e0 0x7f1a4019ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.250+0000 7f1a37fff640 1 -- 172.21.15.19:0/591518877 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a4019d500 con 0x7f1a40103760 2024-09-19T09:03:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.250+0000 7f1a44b3e640 1 --2- 172.21.15.19:0/591518877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a401082e0 0x7f1a4019ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.250+0000 7f1a37fff640 1 --2- 172.21.15.19:0/591518877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a40103760 0x7f1a40198a90 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f1a2800d740 tx=0x7f1a2800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.250+0000 7f1a3dffb640 1 -- 172.21.15.19:0/591518877 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a28017070 con 0x7f1a40103760 2024-09-19T09:03:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.250+0000 7f1a3dffb640 1 -- 172.21.15.19:0/591518877 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a2800de50 con 0x7f1a40103760 2024-09-19T09:03:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.250+0000 7f1a465a1640 1 -- 172.21.15.19:0/591518877 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a4019d7f0 con 0x7f1a40103760 2024-09-19T09:03:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.250+0000 7f1a3dffb640 1 -- 172.21.15.19:0/591518877 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2800f6b0 con 0x7f1a40103760 2024-09-19T09:03:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.250+0000 7f1a465a1640 1 -- 172.21.15.19:0/591518877 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a401a50d0 con 0x7f1a40103760 2024-09-19T09:03:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.252+0000 7f1a3dffb640 1 -- 172.21.15.19:0/591518877 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f1a2801a070 con 0x7f1a40103760 2024-09-19T09:03:02.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.253+0000 7f1a4897a740 1 Processor -- start 2024-09-19T09:03:02.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.253+0000 7f1a4897a740 1 -- start start 2024-09-19T09:03:02.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.253+0000 7f1a4897a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5563e0bfab40 0x5563e0bf9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.253+0000 7f1a4897a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5563e0bf95d0 0x5563e0bf9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.253+0000 7f1a4897a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5563e0c08780 0x5563e0c0ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.253+0000 7f1a4897a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5563e0b5f2f0 con 0x5563e0bf95d0 2024-09-19T09:03:02.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.253+0000 7f1a4897a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5563e0b06cf0 con 0x5563e0c08780 2024-09-19T09:03:02.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.253+0000 7f1a3dffb640 1 --2- 172.21.15.19:0/591518877 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1a2c0a32c0 0x7f1a2c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.253+0000 7f1a4897a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5563e0b5b2b0 con 0x5563e0bfab40 2024-09-19T09:03:02.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.253+0000 7f1a3ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5563e0bf95d0 0x5563e0bf9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.253+0000 7f1a3ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5563e0bf95d0 0x5563e0bf9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38746/0 (socket says 172.21.15.19:38746) 2024-09-19T09:03:02.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.253+0000 7f1a3ffff640 1 -- 172.21.15.19:0/3759054915 learned_addr learned my addr 172.21.15.19:0/3759054915 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:02.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.253+0000 7f1a44b3e640 1 --2- 172.21.15.19:0/591518877 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1a2c0a32c0 0x7f1a2c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.253+0000 7f1a37fff640 1 --2- 172.21.15.19:0/3759054915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5563e0c08780 0x5563e0c0ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.253+0000 7f1a3dffb640 1 -- 172.21.15.19:0/591518877 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f1a280cf2a0 con 0x7f1a40103760 2024-09-19T09:03:02.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.254+0000 7f1a44b3e640 1 --2- 172.21.15.19:0/3759054915 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5563e0bfab40 0x5563e0bf9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.254+0000 7f1a3ffff640 1 -- 172.21.15.19:0/3759054915 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5563e0bfab40 msgr2=0x5563e0bf9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:02.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.254+0000 7f1a3ffff640 1 --2- 172.21.15.19:0/3759054915 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5563e0bfab40 0x5563e0bf9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.254+0000 7f1a3ffff640 1 -- 172.21.15.19:0/3759054915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5563e0c08780 msgr2=0x5563e0c0ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:02.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.254+0000 7f1a3ffff640 1 --2- 172.21.15.19:0/3759054915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5563e0c08780 0x5563e0c0ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.254+0000 7f1a3ffff640 1 -- 172.21.15.19:0/3759054915 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563e0aeb3a0 con 0x5563e0bf95d0 2024-09-19T09:03:02.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.254+0000 7f1a44b3e640 1 --2- 172.21.15.19:0/591518877 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1a2c0a32c0 0x7f1a2c0a5780 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1a38005fe0 tx=0x7f1a38005d80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:02.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.254+0000 7f1a3ffff640 1 --2- 172.21.15.19:0/3759054915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5563e0bf95d0 0x5563e0bf9a10 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f1a3000b760 tx=0x7f1a3000bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7b590b2238a46cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:02.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.254+0000 7f1a367fc640 1 -- 172.21.15.19:0/3759054915 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a30003dd0 con 0x5563e0bf95d0 2024-09-19T09:03:02.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.254+0000 7f1a367fc640 1 -- 172.21.15.19:0/3759054915 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a30015070 con 0x5563e0bf95d0 2024-09-19T09:03:02.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.254+0000 7f1a367fc640 1 -- 172.21.15.19:0/3759054915 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a30004d90 con 0x5563e0bf95d0 2024-09-19T09:03:02.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.255+0000 7f1a4897a740 1 -- 172.21.15.19:0/3759054915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5563e0bf95d0 msgr2=0x5563e0bf9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:02.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.255+0000 7f1a4897a740 1 --2- 172.21.15.19:0/3759054915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5563e0bf95d0 0x5563e0bf9a10 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f1a3000b760 tx=0x7f1a3000bc20 comp rx=0 tx=0).stop 2024-09-19T09:03:02.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.255+0000 7f1a4897a740 1 -- 172.21.15.19:0/3759054915 shutdown_connections 2024-09-19T09:03:02.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.255+0000 7f1a4897a740 1 --2- 172.21.15.19:0/3759054915 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5563e0c08780 0x5563e0c0ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.255+0000 7f1a4897a740 1 --2- 172.21.15.19:0/3759054915 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5563e0bf95d0 0x5563e0bf9a10 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.255+0000 7f1a4897a740 1 --2- 172.21.15.19:0/3759054915 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5563e0bfab40 0x5563e0bf9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.255+0000 7f1a4897a740 1 -- 172.21.15.19:0/3759054915 >> 172.21.15.19:0/3759054915 conn(0x5563e0bc2310 msgr2=0x5563e0bf5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:02.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.255+0000 7f1a4897a740 1 -- 172.21.15.19:0/3759054915 shutdown_connections 2024-09-19T09:03:02.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.255+0000 7f1a4897a740 1 -- 172.21.15.19:0/3759054915 wait complete. 2024-09-19T09:03:02.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.255+0000 7f1a4897a740 1 -- start start 2024-09-19T09:03:02.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.256+0000 7f1a4897a740 1 Processor -- start 2024-09-19T09:03:02.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.256+0000 7f1a4897a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5563e0bf95d0 0x5563e0c081d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.256+0000 7f1a4897a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5563e0bfab40 0x5563e0c05480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.256+0000 7f1a4897a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5563e0c08780 0x5563e0c05c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.256+0000 7f1a4897a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5563e0c0b480 con 0x5563e0bfab40 2024-09-19T09:03:02.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.256+0000 7f1a4897a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5563e0b1a060 con 0x5563e0c08780 2024-09-19T09:03:02.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.256+0000 7f1a4897a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5563e0c0b600 con 0x5563e0bf95d0 2024-09-19T09:03:02.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.256+0000 7f1a4897a740 10 client.0 _ll_register_callbacks cb 0x5563e086d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:02.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.256+0000 7f1a37fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5563e0bfab40 0x5563e0c05480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.256+0000 7f1a37fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5563e0bfab40 0x5563e0c05480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38748/0 (socket says 172.21.15.19:38748) 2024-09-19T09:03:02.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.256+0000 7f1a37fff640 1 -- 172.21.15.19:0/3751406710 learned_addr learned my addr 172.21.15.19:0/3751406710 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:02.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.256+0000 7f1a3ffff640 1 --2- 172.21.15.19:0/3751406710 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5563e0bf95d0 0x5563e0c081d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.256+0000 7f1a44b3e640 1 --2- 172.21.15.19:0/3751406710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5563e0c08780 0x5563e0c05c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.256+0000 7f1a37fff640 1 -- 172.21.15.19:0/3751406710 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5563e0bf95d0 msgr2=0x5563e0c081d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:02.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.256+0000 7f1a37fff640 1 --2- 172.21.15.19:0/3751406710 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5563e0bf95d0 0x5563e0c081d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.256+0000 7f1a37fff640 1 -- 172.21.15.19:0/3751406710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5563e0c08780 msgr2=0x5563e0c05c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:02.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.256+0000 7f1a37fff640 1 --2- 172.21.15.19:0/3751406710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5563e0c08780 0x5563e0c05c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.256+0000 7f1a37fff640 1 -- 172.21.15.19:0/3751406710 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563e08d03c0 con 0x5563e0bfab40 2024-09-19T09:03:02.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.256+0000 7f1a44b3e640 1 --2- 172.21.15.19:0/3751406710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5563e0c08780 0x5563e0c05c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:02.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.257+0000 7f1a37fff640 1 --2- 172.21.15.19:0/3751406710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5563e0bfab40 0x5563e0c05480 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f1a280ccd50 tx=0x7f1a28017c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f2ca6ed1c548d41 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:02.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.257+0000 7f1a1f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:02.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.257+0000 7f1a1f7fe640 1 -- 172.21.15.19:0/3751406710 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a28021040 con 0x5563e0bfab40 2024-09-19T09:03:02.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.257+0000 7f1a1f7fe640 1 -- 172.21.15.19:0/3751406710 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f1a28017cd0 con 0x5563e0bfab40 2024-09-19T09:03:02.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.257+0000 7f1a4897a740 1 -- 172.21.15.19:0/3751406710 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a30015070 con 0x5563e0bfab40 2024-09-19T09:03:02.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.257+0000 7f1a1f7fe640 1 -- 172.21.15.19:0/3751406710 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f1a280b4050 con 0x5563e0bfab40 2024-09-19T09:03:02.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.257+0000 7f1a4897a740 10 client.17829 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:02.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.257+0000 7f1a4897a740 1 -- 172.21.15.19:0/3751406710 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5563e0c16fe0 con 0x5563e0bfab40 2024-09-19T09:03:02.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.257+0000 7f1a1f7fe640 1 -- 172.21.15.19:0/3751406710 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a30015070 con 0x5563e0bfab40 2024-09-19T09:03:02.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.257+0000 7f1a1f7fe640 1 -- 172.21.15.19:0/3751406710 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f1a28016170 con 0x5563e0bfab40 2024-09-19T09:03:02.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.257+0000 7f1a4897a740 10 client.17829 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:02.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.257+0000 7f1a4897a740 10 client.17829 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T09:03:02.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.258+0000 7f1a4897a740 20 client.17829 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:02.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.258+0000 7f1a4897a740 1 --2- 172.21.15.19:0/3751406710 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5563e0c184a0 0x5563e0c1a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.258+0000 7f1a4897a740 4 client.17829 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:02.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.258+0000 7f1a4897a740 1 -- 172.21.15.19:0/3751406710 --> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5563e0b6c860 con 0x5563e0c184a0 2024-09-19T09:03:02.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.258+0000 7f1a3ffff640 1 --2- 172.21.15.19:0/3751406710 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5563e0c184a0 0x5563e0c1a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.258+0000 7f1a3ffff640 1 --2- 172.21.15.19:0/3751406710 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5563e0c184a0 0x5563e0c1a890 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f7194e74e07a5c6b server_cookie=bb8d522c07e9124a in_seq=0 out_seq=0 2024-09-19T09:03:02.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.258+0000 7f1a1f7fe640 10 client.17829 ms_handle_connect on v2:172.21.15.203:6834/2702758353 2024-09-19T09:03:02.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.259+0000 7f1a1f7fe640 1 -- 172.21.15.19:0/3751406710 <== mds.4 v2:172.21.15.203:6834/2702758353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5563e0b6c860 con 0x5563e0c184a0 2024-09-19T09:03:02.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.259+0000 7f1a1f7fe640 10 client.17829 handle_command_reply: tid=0 2024-09-19T09:03:02.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.259+0000 7f1a4897a740 1 client.17829 shutdown 2024-09-19T09:03:02.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.259+0000 7f1a4897a740 1 -- 172.21.15.19:0/3751406710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5563e0bfab40 msgr2=0x5563e0c05480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:02.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.259+0000 7f1a4897a740 1 --2- 172.21.15.19:0/3751406710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5563e0bfab40 0x5563e0c05480 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f1a280ccd50 tx=0x7f1a28017c60 comp rx=0 tx=0).stop 2024-09-19T09:03:02.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.259+0000 7f1a4897a740 1 -- 172.21.15.19:0/3751406710 shutdown_connections 2024-09-19T09:03:02.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.259+0000 7f1a4897a740 1 --2- 172.21.15.19:0/3751406710 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5563e0c184a0 0x5563e0c1a890 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.259+0000 7f1a4897a740 1 --2- 172.21.15.19:0/3751406710 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5563e0c08780 0x5563e0c05c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.259+0000 7f1a4897a740 1 --2- 172.21.15.19:0/3751406710 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5563e0bfab40 0x5563e0c05480 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.259+0000 7f1a4897a740 1 --2- 172.21.15.19:0/3751406710 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5563e0bf95d0 0x5563e0c081d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.259+0000 7f1a4897a740 1 -- 172.21.15.19:0/3751406710 >> 172.21.15.19:0/3751406710 conn(0x5563e0bc2310 msgr2=0x5563e0bfb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:02.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.259+0000 7f1a1f7fe640 0 client.17829 ms_handle_reset on v2:172.21.15.203:6834/2702758353 2024-09-19T09:03:02.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.259+0000 7f1a4897a740 1 -- 172.21.15.19:0/3751406710 shutdown_connections 2024-09-19T09:03:02.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.259+0000 7f1a4897a740 1 -- 172.21.15.19:0/3751406710 wait complete. 2024-09-19T09:03:02.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.260+0000 7f1a4897a740 20 client.17829 trim_cache size 0 max 16384 2024-09-19T09:03:02.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.272+0000 7f1a4897a740 1 Processor -- start 2024-09-19T09:03:02.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.273+0000 7f1a4897a740 1 -- start start 2024-09-19T09:03:02.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.273+0000 7f1a4897a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5563e0bf95d0 0x5563e0bf5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.273+0000 7f1a4897a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5563e0bfab40 0x5563e0c04d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.273+0000 7f1a4897a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5563e0c08780 0x5563e0c20160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.273+0000 7f1a4897a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1a401ab310 con 0x5563e0c08780 2024-09-19T09:03:02.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.273+0000 7f1a4897a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1a401ace50 con 0x5563e0bfab40 2024-09-19T09:03:02.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.273+0000 7f1a4897a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1a401ab9e0 con 0x5563e0bf95d0 2024-09-19T09:03:02.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.273+0000 7f1a44b3e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5563e0c08780 0x5563e0c20160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.273+0000 7f1a44b3e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5563e0c08780 0x5563e0c20160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38758/0 (socket says 172.21.15.19:38758) 2024-09-19T09:03:02.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.273+0000 7f1a44b3e640 1 -- 172.21.15.19:0/1132461790 learned_addr learned my addr 172.21.15.19:0/1132461790 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:02.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.273+0000 7f1a3ffff640 1 --2- 172.21.15.19:0/1132461790 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5563e0bf95d0 0x5563e0bf5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.273+0000 7f1a37fff640 1 --2- 172.21.15.19:0/1132461790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5563e0bfab40 0x5563e0c04d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.273+0000 7f1a44b3e640 1 -- 172.21.15.19:0/1132461790 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5563e0bf95d0 msgr2=0x5563e0bf5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:02.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.273+0000 7f1a44b3e640 1 --2- 172.21.15.19:0/1132461790 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5563e0bf95d0 0x5563e0bf5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.273+0000 7f1a44b3e640 1 -- 172.21.15.19:0/1132461790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5563e0bfab40 msgr2=0x5563e0c04d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:02.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.273+0000 7f1a44b3e640 1 --2- 172.21.15.19:0/1132461790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5563e0bfab40 0x5563e0c04d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.273+0000 7f1a44b3e640 1 -- 172.21.15.19:0/1132461790 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5563e0c04430 con 0x5563e0c08780 2024-09-19T09:03:02.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.274+0000 7f1a44b3e640 1 --2- 172.21.15.19:0/1132461790 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5563e0c08780 0x5563e0c20160 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f1a38035000 tx=0x7f1a38044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be0c87b55913eb19 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:02.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.274+0000 7f1a35ffb640 1 -- 172.21.15.19:0/1132461790 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a38003c20 con 0x5563e0c08780 2024-09-19T09:03:02.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.274+0000 7f1a35ffb640 1 -- 172.21.15.19:0/1132461790 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a38036040 con 0x5563e0c08780 2024-09-19T09:03:02.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.274+0000 7f1a35ffb640 1 -- 172.21.15.19:0/1132461790 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a380309e0 con 0x5563e0c08780 2024-09-19T09:03:02.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.274+0000 7f1a4897a740 1 -- 172.21.15.19:0/1132461790 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5563e0c08780 msgr2=0x5563e0c20160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:02.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.274+0000 7f1a4897a740 1 --2- 172.21.15.19:0/1132461790 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5563e0c08780 0x5563e0c20160 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f1a38035000 tx=0x7f1a38044000 comp rx=0 tx=0).stop 2024-09-19T09:03:02.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.274+0000 7f1a4897a740 1 -- 172.21.15.19:0/1132461790 shutdown_connections 2024-09-19T09:03:02.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.274+0000 7f1a4897a740 1 --2- 172.21.15.19:0/1132461790 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5563e0c08780 0x5563e0c20160 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.274+0000 7f1a4897a740 1 --2- 172.21.15.19:0/1132461790 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5563e0bfab40 0x5563e0c04d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.274+0000 7f1a4897a740 1 --2- 172.21.15.19:0/1132461790 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5563e0bf95d0 0x5563e0bf5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.274+0000 7f1a4897a740 1 -- 172.21.15.19:0/1132461790 >> 172.21.15.19:0/1132461790 conn(0x5563e0bc2310 msgr2=0x5563e0bf5700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:02.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.275+0000 7f1a4897a740 1 -- 172.21.15.19:0/1132461790 shutdown_connections 2024-09-19T09:03:02.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.275+0000 7f1a4897a740 1 -- 172.21.15.19:0/1132461790 wait complete. 2024-09-19T09:03:02.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.275+0000 7f1a4897a740 1 -- start start 2024-09-19T09:03:02.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.275+0000 7f1a4897a740 1 Processor -- start 2024-09-19T09:03:02.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.275+0000 7f1a4897a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5563e0bf95d0 0x5563e0c11170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.275+0000 7f1a4897a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5563e0bfab40 0x5563e0c02330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.275+0000 7f1a4897a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5563e0c08780 0x5563e0c02a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.275+0000 7f1a4897a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1a401ac780 con 0x5563e0bfab40 2024-09-19T09:03:02.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.275+0000 7f1a4897a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1a401ac0b0 con 0x5563e0c08780 2024-09-19T09:03:02.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.275+0000 7f1a4897a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1a401a9310 con 0x5563e0bf95d0 2024-09-19T09:03:02.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.275+0000 7f1a4897a740 10 client.0 _ll_register_callbacks cb 0x7f1a2809b640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:02.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.276+0000 7f1a37fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5563e0bfab40 0x5563e0c02330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.276+0000 7f1a37fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5563e0bfab40 0x5563e0c02330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38772/0 (socket says 172.21.15.19:38772) 2024-09-19T09:03:02.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.276+0000 7f1a37fff640 1 -- 172.21.15.19:0/323112194 learned_addr learned my addr 172.21.15.19:0/323112194 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:02.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.276+0000 7f1a3ffff640 1 --2- 172.21.15.19:0/323112194 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5563e0bf95d0 0x5563e0c11170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.276+0000 7f1a44b3e640 1 --2- 172.21.15.19:0/323112194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5563e0c08780 0x5563e0c02a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.276+0000 7f1a37fff640 1 -- 172.21.15.19:0/323112194 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5563e0bf95d0 msgr2=0x5563e0c11170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:02.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.276+0000 7f1a37fff640 1 --2- 172.21.15.19:0/323112194 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5563e0bf95d0 0x5563e0c11170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.276+0000 7f1a37fff640 1 -- 172.21.15.19:0/323112194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5563e0c08780 msgr2=0x5563e0c02a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:02.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.276+0000 7f1a37fff640 1 --2- 172.21.15.19:0/323112194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5563e0c08780 0x5563e0c02a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.276+0000 7f1a37fff640 1 -- 172.21.15.19:0/323112194 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5563e0c82130 con 0x5563e0bfab40 2024-09-19T09:03:02.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.276+0000 7f1a44b3e640 1 --2- 172.21.15.19:0/323112194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5563e0c08780 0x5563e0c02a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:02.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.276+0000 7f1a37fff640 1 --2- 172.21.15.19:0/323112194 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5563e0bfab40 0x5563e0c02330 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f1a28097c80 tx=0x7f1a28017f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee75a9e3a3f64cff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:02.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.276+0000 7f1a1f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:02.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.276+0000 7f1a1f7fe640 1 -- 172.21.15.19:0/323112194 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a280b9060 con 0x5563e0bfab40 2024-09-19T09:03:02.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.276+0000 7f1a1f7fe640 1 -- 172.21.15.19:0/323112194 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f1a2809cda0 con 0x5563e0bfab40 2024-09-19T09:03:02.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.276+0000 7f1a4897a740 1 -- 172.21.15.19:0/323112194 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a38036040 con 0x5563e0bfab40 2024-09-19T09:03:02.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.277+0000 7f1a1f7fe640 1 -- 172.21.15.19:0/323112194 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f1a28014070 con 0x5563e0bfab40 2024-09-19T09:03:02.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.277+0000 7f1a4897a740 10 client.17835 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:02.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.277+0000 7f1a4897a740 1 -- 172.21.15.19:0/323112194 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5563e0c832d0 con 0x5563e0bfab40 2024-09-19T09:03:02.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.277+0000 7f1a1f7fe640 1 -- 172.21.15.19:0/323112194 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1a38036040 con 0x5563e0bfab40 2024-09-19T09:03:02.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.277+0000 7f1a1f7fe640 1 -- 172.21.15.19:0/323112194 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f1a2809acc0 con 0x5563e0bfab40 2024-09-19T09:03:02.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.277+0000 7f1a4897a740 10 client.17835 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:02.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.277+0000 7f1a4897a740 10 client.17835 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T09:03:02.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.277+0000 7f1a4897a740 20 client.17835 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:02.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.277+0000 7f1a4897a740 1 --2- 172.21.15.19:0/323112194 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5563e0c83810 0x5563e0c85c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.277+0000 7f1a4897a740 4 client.17835 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:03:02.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.277+0000 7f1a4897a740 1 -- 172.21.15.19:0/323112194 --> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5563e0b66d70 con 0x5563e0c83810 2024-09-19T09:03:02.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.277+0000 7f1a3ffff640 1 --2- 172.21.15.19:0/323112194 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5563e0c83810 0x5563e0c85c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.278+0000 7f1a3ffff640 1 --2- 172.21.15.19:0/323112194 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5563e0c83810 0x5563e0c85c30 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7230a92a68a36329 server_cookie=bc0a099efdd5f308 in_seq=0 out_seq=0 2024-09-19T09:03:02.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.278+0000 7f1a1f7fe640 10 client.17835 ms_handle_connect on v2:172.21.15.203:6834/2702758353 2024-09-19T09:03:02.297 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:03:02.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.278+0000 7f1a1f7fe640 1 -- 172.21.15.19:0/323112194 <== mds.4 v2:172.21.15.203:6834/2702758353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5563e0b66d70 con 0x5563e0c83810 2024-09-19T09:03:02.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.278+0000 7f1a1f7fe640 10 client.17835 handle_command_reply: tid=0 2024-09-19T09:03:02.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.278+0000 7f1a4897a740 1 client.17835 shutdown 2024-09-19T09:03:02.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.278+0000 7f1a4897a740 1 -- 172.21.15.19:0/323112194 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5563e0bfab40 msgr2=0x5563e0c02330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:02.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.278+0000 7f1a4897a740 1 --2- 172.21.15.19:0/323112194 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5563e0bfab40 0x5563e0c02330 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f1a28097c80 tx=0x7f1a28017f00 comp rx=0 tx=0).stop 2024-09-19T09:03:02.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.278+0000 7f1a4897a740 1 -- 172.21.15.19:0/323112194 shutdown_connections 2024-09-19T09:03:02.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.278+0000 7f1a4897a740 1 --2- 172.21.15.19:0/323112194 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5563e0c83810 0x5563e0c85c30 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.278+0000 7f1a4897a740 1 --2- 172.21.15.19:0/323112194 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5563e0c08780 0x5563e0c02a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.278+0000 7f1a4897a740 1 --2- 172.21.15.19:0/323112194 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5563e0bfab40 0x5563e0c02330 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.278+0000 7f1a1f7fe640 0 client.17835 ms_handle_reset on v2:172.21.15.203:6834/2702758353 2024-09-19T09:03:02.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.278+0000 7f1a4897a740 1 --2- 172.21.15.19:0/323112194 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5563e0bf95d0 0x5563e0c11170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.278+0000 7f1a4897a740 1 -- 172.21.15.19:0/323112194 >> 172.21.15.19:0/323112194 conn(0x5563e0bc2310 msgr2=0x5563e0c06ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:02.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.278+0000 7f1a4897a740 1 -- 172.21.15.19:0/323112194 shutdown_connections 2024-09-19T09:03:02.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.278+0000 7f1a4897a740 1 -- 172.21.15.19:0/323112194 wait complete. 2024-09-19T09:03:02.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.278+0000 7f1a4897a740 20 client.17835 trim_cache size 0 max 16384 2024-09-19T09:03:02.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.279+0000 7f1a465a1640 1 -- 172.21.15.19:0/591518877 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1a2c0a32c0 msgr2=0x7f1a2c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:02.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.279+0000 7f1a465a1640 1 --2- 172.21.15.19:0/591518877 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1a2c0a32c0 0x7f1a2c0a5780 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1a38005fe0 tx=0x7f1a38005d80 comp rx=0 tx=0).stop 2024-09-19T09:03:02.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.279+0000 7f1a465a1640 1 -- 172.21.15.19:0/591518877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a40103760 msgr2=0x7f1a40198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:02.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.279+0000 7f1a465a1640 1 --2- 172.21.15.19:0/591518877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a40103760 0x7f1a40198a90 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f1a2800d740 tx=0x7f1a2800dc00 comp rx=0 tx=0).stop 2024-09-19T09:03:02.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.279+0000 7f1a465a1640 1 -- 172.21.15.19:0/591518877 shutdown_connections 2024-09-19T09:03:02.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.279+0000 7f1a465a1640 1 --2- 172.21.15.19:0/591518877 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1a2c0a32c0 0x7f1a2c0a5780 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.279+0000 7f1a465a1640 1 --2- 172.21.15.19:0/591518877 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1a401082e0 0x7f1a4019ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.279+0000 7f1a465a1640 1 --2- 172.21.15.19:0/591518877 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1a40103760 0x7f1a40198a90 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.279+0000 7f1a465a1640 1 --2- 172.21.15.19:0/591518877 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a40102db0 0x7f1a40198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.279+0000 7f1a465a1640 1 -- 172.21.15.19:0/591518877 >> 172.21.15.19:0/591518877 conn(0x7f1a400fc7d0 msgr2=0x7f1a40106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:02.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.279+0000 7f1a465a1640 1 -- 172.21.15.19:0/591518877 shutdown_connections 2024-09-19T09:03:02.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:02.279+0000 7f1a465a1640 1 -- 172.21.15.19:0/591518877 wait complete. 2024-09-19T09:03:02.337 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.336+0000 7fdeb20e6640 1 -- 172.21.15.19:0/4035579186 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdeac100a40 msgr2=0x7fdeac100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:02.337 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.336+0000 7fdeb20e6640 1 --2- 172.21.15.19:0/4035579186 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdeac100a40 0x7fdeac100e40 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fde9c009900 tx=0x7fde9c02a410 comp rx=0 tx=0).stop 2024-09-19T09:03:02.337 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.336+0000 7fdeb20e6640 1 -- 172.21.15.19:0/4035579186 shutdown_connections 2024-09-19T09:03:02.337 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.336+0000 7fdeb20e6640 1 --2- 172.21.15.19:0/4035579186 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdeac101c30 0x7fdeac1020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.338 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.336+0000 7fdeb20e6640 1 --2- 172.21.15.19:0/4035579186 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdeac1025f0 0x7fdeac108e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.338 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.336+0000 7fdeb20e6640 1 --2- 172.21.15.19:0/4035579186 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdeac100a40 0x7fdeac100e40 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.338 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.336+0000 7fdeb20e6640 1 -- 172.21.15.19:0/4035579186 >> 172.21.15.19:0/4035579186 conn(0x7fdeac0fc1e0 msgr2=0x7fdeac0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:02.338 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.336+0000 7fdeb20e6640 1 -- 172.21.15.19:0/4035579186 shutdown_connections 2024-09-19T09:03:02.338 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.336+0000 7fdeb20e6640 1 -- 172.21.15.19:0/4035579186 wait complete. 2024-09-19T09:03:02.338 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.337+0000 7fdeb20e6640 1 Processor -- start 2024-09-19T09:03:02.338 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.337+0000 7fdeb20e6640 1 -- start start 2024-09-19T09:03:02.340 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.337+0000 7fdeb20e6640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdeac100a40 0x7fdeac06a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.340 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.337+0000 7fdeb20e6640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdeac101c30 0x7fdeac19cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.340 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.337+0000 7fdeb20e6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdeac1025f0 0x7fdeac19f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.340 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.337+0000 7fdeb20e6640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdeac10c6a0 con 0x7fdeac1025f0 2024-09-19T09:03:02.340 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.337+0000 7fdeb20e6640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdeac10c520 con 0x7fdeac101c30 2024-09-19T09:03:02.340 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.337+0000 7fdeb20e6640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdeac10c820 con 0x7fdeac100a40 2024-09-19T09:03:02.340 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.337+0000 7fdeabfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdeac1025f0 0x7fdeac19f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.340 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.337+0000 7fdeabfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdeac1025f0 0x7fdeac19f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38780/0 (socket says 172.21.15.19:38780) 2024-09-19T09:03:02.340 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.337+0000 7fdeabfff640 1 -- 172.21.15.19:0/4276530662 learned_addr learned my addr 172.21.15.19:0/4276530662 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:02.341 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.337+0000 7fdea2ffd640 1 --2- 172.21.15.19:0/4276530662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdeac101c30 0x7fdeac19cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.341 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.337+0000 7fdeab7fe640 1 --2- 172.21.15.19:0/4276530662 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdeac100a40 0x7fdeac06a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.341 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.337+0000 7fdeabfff640 1 -- 172.21.15.19:0/4276530662 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdeac100a40 msgr2=0x7fdeac06a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:02.341 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.337+0000 7fdeabfff640 1 --2- 172.21.15.19:0/4276530662 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdeac100a40 0x7fdeac06a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.341 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.337+0000 7fdeabfff640 1 -- 172.21.15.19:0/4276530662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdeac101c30 msgr2=0x7fdeac19cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:02.341 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.337+0000 7fdeabfff640 1 --2- 172.21.15.19:0/4276530662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdeac101c30 0x7fdeac19cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.341 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.337+0000 7fdeabfff640 1 -- 172.21.15.19:0/4276530662 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeac19f9e0 con 0x7fdeac1025f0 2024-09-19T09:03:02.341 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.338+0000 7fdeab7fe640 1 --2- 172.21.15.19:0/4276530662 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdeac100a40 0x7fdeac06a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:02.341 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.338+0000 7fdeabfff640 1 --2- 172.21.15.19:0/4276530662 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdeac1025f0 0x7fdeac19f0d0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fdea400efd0 tx=0x7fdea400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:02.341 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.338+0000 7fdea97fa640 1 -- 172.21.15.19:0/4276530662 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea4003b70 con 0x7fdeac1025f0 2024-09-19T09:03:02.341 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.338+0000 7fdea97fa640 1 -- 172.21.15.19:0/4276530662 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdea4003d10 con 0x7fdeac1025f0 2024-09-19T09:03:02.341 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.338+0000 7fdeb20e6640 1 -- 172.21.15.19:0/4276530662 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdeac19fc70 con 0x7fdeac1025f0 2024-09-19T09:03:02.341 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.338+0000 7fdea97fa640 1 -- 172.21.15.19:0/4276530662 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea40108d0 con 0x7fdeac1025f0 2024-09-19T09:03:02.341 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.338+0000 7fdeb20e6640 1 -- 172.21.15.19:0/4276530662 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdeac1a0170 con 0x7fdeac1025f0 2024-09-19T09:03:02.346 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.340+0000 7fdea97fa640 1 -- 172.21.15.19:0/4276530662 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fdea4004020 con 0x7fdeac1025f0 2024-09-19T09:03:02.346 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.340+0000 7fdeb4e80740 1 Processor -- start 2024-09-19T09:03:02.346 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.340+0000 7fdeb4e80740 1 -- start start 2024-09-19T09:03:02.347 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.341+0000 7fdeb4e80740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e07669a0 0x55d6e0766da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.347 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.341+0000 7fdeb4e80740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e07672e0 0x55d6e076bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.347 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.341+0000 7fdeb4e80740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e076c370 0x55d6e076e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.347 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.341+0000 7fdeb4e80740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d6e06ca2f0 con 0x55d6e076c370 2024-09-19T09:03:02.347 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.341+0000 7fdeb4e80740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55d6e0672270 con 0x55d6e07669a0 2024-09-19T09:03:02.347 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.341+0000 7fdeb4e80740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d6e06c62b0 con 0x55d6e07672e0 2024-09-19T09:03:02.347 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.341+0000 7fdea2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e076c370 0x55d6e076e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.347 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.341+0000 7fdea2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e076c370 0x55d6e076e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38794/0 (socket says 172.21.15.19:38794) 2024-09-19T09:03:02.347 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.341+0000 7fdea2ffd640 1 -- 172.21.15.19:0/2026691322 learned_addr learned my addr 172.21.15.19:0/2026691322 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:02.347 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.341+0000 7fdeab7fe640 1 --2- 172.21.15.19:0/2026691322 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e07672e0 0x55d6e076bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.347 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.341+0000 7fdea2ffd640 1 --2- 172.21.15.19:0/2026691322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e07669a0 0x55d6e0766da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.347 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.341+0000 7fdea2ffd640 1 -- 172.21.15.19:0/2026691322 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e07672e0 msgr2=0x55d6e076bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:02.347 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.341+0000 7fdea2ffd640 1 --2- 172.21.15.19:0/2026691322 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e07672e0 0x55d6e076bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.348 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.341+0000 7fdea2ffd640 1 -- 172.21.15.19:0/2026691322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e07669a0 msgr2=0x55d6e0766da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:02.348 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.341+0000 7fdea2ffd640 1 --2- 172.21.15.19:0/2026691322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e07669a0 0x55d6e0766da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.348 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.341+0000 7fdea2ffd640 1 -- 172.21.15.19:0/2026691322 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6e0671340 con 0x55d6e076c370 2024-09-19T09:03:02.348 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.341+0000 7fdeab7fe640 1 --2- 172.21.15.19:0/2026691322 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e07672e0 0x55d6e076bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:02.348 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.341+0000 7fdea97fa640 1 --2- 172.21.15.19:0/4276530662 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fde980a32f0 0x7fde980a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.348 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.341+0000 7fdea2ffd640 1 --2- 172.21.15.19:0/2026691322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e076c370 0x55d6e076e830 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fde940117e0 tx=0x7fde9400a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=222e2abb0136b16a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:02.348 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.341+0000 7fdeab7fe640 1 --2- 172.21.15.19:0/4276530662 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fde980a32f0 0x7fde980a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.348 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.341+0000 7fdea97fa640 1 -- 172.21.15.19:0/4276530662 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7fdea40cfd80 con 0x7fdeac1025f0 2024-09-19T09:03:02.348 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.342+0000 7fdea1ffb640 1 -- 172.21.15.19:0/2026691322 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde94011e20 con 0x55d6e076c370 2024-09-19T09:03:02.348 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.342+0000 7fdea1ffb640 1 -- 172.21.15.19:0/2026691322 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde94005020 con 0x55d6e076c370 2024-09-19T09:03:02.348 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.342+0000 7fdea1ffb640 1 -- 172.21.15.19:0/2026691322 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde94004a90 con 0x55d6e076c370 2024-09-19T09:03:02.348 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.342+0000 7fdeab7fe640 1 --2- 172.21.15.19:0/4276530662 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fde980a32f0 0x7fde980a57b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fde9c006010 tx=0x7fde9c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:02.348 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.342+0000 7fdeb4e80740 1 -- 172.21.15.19:0/2026691322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e076c370 msgr2=0x55d6e076e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:02.349 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.342+0000 7fdeb4e80740 1 --2- 172.21.15.19:0/2026691322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e076c370 0x55d6e076e830 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fde940117e0 tx=0x7fde9400a760 comp rx=0 tx=0).stop 2024-09-19T09:03:02.349 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.342+0000 7fdeb4e80740 1 -- 172.21.15.19:0/2026691322 shutdown_connections 2024-09-19T09:03:02.349 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.342+0000 7fdeb4e80740 1 --2- 172.21.15.19:0/2026691322 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e07672e0 0x55d6e076bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.349 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.342+0000 7fdeb4e80740 1 --2- 172.21.15.19:0/2026691322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e076c370 0x55d6e076e830 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.349 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.343+0000 7fdeb4e80740 1 --2- 172.21.15.19:0/2026691322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e07669a0 0x55d6e0766da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.349 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.343+0000 7fdeb4e80740 1 -- 172.21.15.19:0/2026691322 >> 172.21.15.19:0/2026691322 conn(0x55d6e0762010 msgr2=0x55d6e0762410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:02.349 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.343+0000 7fdeb4e80740 1 -- 172.21.15.19:0/2026691322 shutdown_connections 2024-09-19T09:03:02.349 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.343+0000 7fdeb4e80740 1 -- 172.21.15.19:0/2026691322 wait complete. 2024-09-19T09:03:02.349 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.343+0000 7fdeb4e80740 1 -- start start 2024-09-19T09:03:02.349 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.343+0000 7fdeb4e80740 1 Processor -- start 2024-09-19T09:03:02.349 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.343+0000 7fdeb4e80740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e07669a0 0x55d6e0770c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.349 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.343+0000 7fdeb4e80740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e07672e0 0x55d6e0771190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.349 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.343+0000 7fdeb4e80740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e076c370 0x55d6e07781d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.350 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.343+0000 7fdeb4e80740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d6e076f340 con 0x55d6e076c370 2024-09-19T09:03:02.350 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.343+0000 7fdeb4e80740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55d6e0653290 con 0x55d6e07669a0 2024-09-19T09:03:02.350 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.343+0000 7fdeb4e80740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d6e076f4c0 con 0x55d6e07672e0 2024-09-19T09:03:02.350 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.343+0000 7fdeb4e80740 10 client.0 _ll_register_callbacks cb 0x55d6e0684140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:02.350 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.344+0000 7fdeabfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e076c370 0x55d6e07781d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.350 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.344+0000 7fdeabfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e076c370 0x55d6e07781d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38804/0 (socket says 172.21.15.19:38804) 2024-09-19T09:03:02.350 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.344+0000 7fdeabfff640 1 -- 172.21.15.19:0/3803651657 learned_addr learned my addr 172.21.15.19:0/3803651657 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:02.350 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.344+0000 7fdea2ffd640 1 --2- 172.21.15.19:0/3803651657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e07672e0 0x55d6e0771190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.350 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.344+0000 7fdeab7fe640 1 --2- 172.21.15.19:0/3803651657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e07669a0 0x55d6e0770c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.350 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.344+0000 7fdeabfff640 1 -- 172.21.15.19:0/3803651657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e07672e0 msgr2=0x55d6e0771190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:02.350 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.344+0000 7fdeabfff640 1 --2- 172.21.15.19:0/3803651657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e07672e0 0x55d6e0771190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.350 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.344+0000 7fdeabfff640 1 -- 172.21.15.19:0/3803651657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e07669a0 msgr2=0x55d6e0770c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:02.350 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.344+0000 7fdeabfff640 1 --2- 172.21.15.19:0/3803651657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e07669a0 0x55d6e0770c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.351 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.344+0000 7fdeabfff640 1 -- 172.21.15.19:0/3803651657 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6e03dd210 con 0x55d6e076c370 2024-09-19T09:03:02.351 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.344+0000 7fdeab7fe640 1 --2- 172.21.15.19:0/3803651657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e07669a0 0x55d6e0770c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:02.351 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.344+0000 7fdeabfff640 1 --2- 172.21.15.19:0/3803651657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e076c370 0x55d6e07781d0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fdea4098810 tx=0x7fdea409bfe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af10d860399a6c83 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:02.351 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.344+0000 7fde8affd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:02.351 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.344+0000 7fde8affd640 1 -- 172.21.15.19:0/3803651657 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea40a0760 con 0x55d6e076c370 2024-09-19T09:03:02.351 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.344+0000 7fde8affd640 1 -- 172.21.15.19:0/3803651657 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7fdea40b5220 con 0x55d6e076c370 2024-09-19T09:03:02.351 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.344+0000 7fdeb4e80740 1 -- 172.21.15.19:0/3803651657 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde94005020 con 0x55d6e076c370 2024-09-19T09:03:02.351 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.344+0000 7fde8affd640 1 -- 172.21.15.19:0/3803651657 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fdea40a5020 con 0x55d6e076c370 2024-09-19T09:03:02.351 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.344+0000 7fdeb4e80740 10 client.17847 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:02.351 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.344+0000 7fdeb4e80740 1 -- 172.21.15.19:0/3803651657 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55d6e04a9620 con 0x55d6e076c370 2024-09-19T09:03:02.351 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.345+0000 7fde8affd640 1 -- 172.21.15.19:0/3803651657 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fde94005020 con 0x55d6e076c370 2024-09-19T09:03:02.351 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.345+0000 7fde8affd640 1 -- 172.21.15.19:0/3803651657 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7fdea401f020 con 0x55d6e076c370 2024-09-19T09:03:02.351 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.345+0000 7fdeb4e80740 10 client.17847 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:02.351 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.345+0000 7fdeb4e80740 10 client.17847 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:02.352 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.345+0000 7fdeb4e80740 20 client.17847 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:02.352 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.345+0000 7fdeb4e80740 1 --2- 172.21.15.19:0/3803651657 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d6e077c910 0x55d6e077ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.352 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.345+0000 7fdeb4e80740 4 client.17847 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:02.352 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.345+0000 7fdeb4e80740 1 -- 172.21.15.19:0/3803651657 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d6e06d7a20 con 0x55d6e077c910 2024-09-19T09:03:02.352 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.345+0000 7fdeab7fe640 1 --2- 172.21.15.19:0/3803651657 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d6e077c910 0x55d6e077ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.352 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.346+0000 7fdeab7fe640 1 --2- 172.21.15.19:0/3803651657 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d6e077c910 0x55d6e077ed20 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a63d7ea9859a1135 server_cookie=ea4aa495ebd017d2 in_seq=0 out_seq=0 2024-09-19T09:03:02.352 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.346+0000 7fde8affd640 10 client.17847 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:02.353 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.347+0000 7fde8affd640 1 -- 172.21.15.19:0/3803651657 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d6e06d7a20 con 0x55d6e077c910 2024-09-19T09:03:02.353 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.347+0000 7fde8affd640 10 client.17847 handle_command_reply: tid=0 2024-09-19T09:03:02.353 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.347+0000 7fdeb4e80740 1 client.17847 shutdown 2024-09-19T09:03:02.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.347+0000 7fdeb4e80740 1 -- 172.21.15.19:0/3803651657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e076c370 msgr2=0x55d6e07781d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:02.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.347+0000 7fdeb4e80740 1 --2- 172.21.15.19:0/3803651657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e076c370 0x55d6e07781d0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fdea4098810 tx=0x7fdea409bfe0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.347+0000 7fdeb4e80740 1 -- 172.21.15.19:0/3803651657 shutdown_connections 2024-09-19T09:03:02.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.347+0000 7fdeb4e80740 1 --2- 172.21.15.19:0/3803651657 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d6e077c910 0x55d6e077ed20 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.347+0000 7fdeb4e80740 1 --2- 172.21.15.19:0/3803651657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e07672e0 0x55d6e0771190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.347+0000 7fde8affd640 0 client.17847 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:02.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.347+0000 7fdeb4e80740 1 --2- 172.21.15.19:0/3803651657 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e076c370 0x55d6e07781d0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.347+0000 7fdeb4e80740 1 --2- 172.21.15.19:0/3803651657 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e07669a0 0x55d6e0770c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.347+0000 7fdeb4e80740 1 -- 172.21.15.19:0/3803651657 >> 172.21.15.19:0/3803651657 conn(0x55d6e0762010 msgr2=0x55d6e0763820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:02.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.347+0000 7fdeb4e80740 1 -- 172.21.15.19:0/3803651657 shutdown_connections 2024-09-19T09:03:02.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.347+0000 7fdeb4e80740 1 -- 172.21.15.19:0/3803651657 wait complete. 2024-09-19T09:03:02.354 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.347+0000 7fdeb4e80740 20 client.17847 trim_cache size 0 max 16384 2024-09-19T09:03:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.362+0000 7fdeb4e80740 1 Processor -- start 2024-09-19T09:03:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.362+0000 7fdeb4e80740 1 -- start start 2024-09-19T09:03:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.363+0000 7fdeb4e80740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e0762010 0x55d6e077ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.363+0000 7fdeb4e80740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e07669a0 0x55d6e0778190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.363+0000 7fdeb4e80740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e07672e0 0x55d6e0763400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.363+0000 7fdeb4e80740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdeac1a8e10 con 0x55d6e07672e0 2024-09-19T09:03:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.363+0000 7fdeb4e80740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdeac1aa950 con 0x55d6e07669a0 2024-09-19T09:03:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.363+0000 7fdeb4e80740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdeac1a94e0 con 0x55d6e0762010 2024-09-19T09:03:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.363+0000 7fdeabfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e07672e0 0x55d6e0763400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.363+0000 7fdeabfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e07672e0 0x55d6e0763400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38806/0 (socket says 172.21.15.19:38806) 2024-09-19T09:03:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.363+0000 7fdeabfff640 1 -- 172.21.15.19:0/3732097126 learned_addr learned my addr 172.21.15.19:0/3732097126 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:02.368 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.363+0000 7fdea2ffd640 1 --2- 172.21.15.19:0/3732097126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e07669a0 0x55d6e0778190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.363+0000 7fdeab7fe640 1 --2- 172.21.15.19:0/3732097126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e0762010 0x55d6e077ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.363+0000 7fdeabfff640 1 -- 172.21.15.19:0/3732097126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e0762010 msgr2=0x55d6e077ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.363+0000 7fdeabfff640 1 --2- 172.21.15.19:0/3732097126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e0762010 0x55d6e077ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.363+0000 7fdeabfff640 1 -- 172.21.15.19:0/3732097126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e07669a0 msgr2=0x55d6e0778190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.363+0000 7fdeabfff640 1 --2- 172.21.15.19:0/3732097126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e07669a0 0x55d6e0778190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.363+0000 7fdeabfff640 1 -- 172.21.15.19:0/3732097126 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6e076b810 con 0x55d6e07672e0 2024-09-19T09:03:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.363+0000 7fdeab7fe640 1 --2- 172.21.15.19:0/3732097126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e0762010 0x55d6e077ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.363+0000 7fdeabfff640 1 --2- 172.21.15.19:0/3732097126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e07672e0 0x55d6e0763400 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fdea40cd8e0 tx=0x7fdea409a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61b457a386fcb2e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.363+0000 7fdea17fa640 1 -- 172.21.15.19:0/3732097126 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea40a0760 con 0x55d6e07672e0 2024-09-19T09:03:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.363+0000 7fdea17fa640 1 -- 172.21.15.19:0/3732097126 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdea4004310 con 0x55d6e07672e0 2024-09-19T09:03:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.363+0000 7fdea17fa640 1 -- 172.21.15.19:0/3732097126 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdea4004da0 con 0x55d6e07672e0 2024-09-19T09:03:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.364+0000 7fdeb4e80740 1 -- 172.21.15.19:0/3732097126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e07672e0 msgr2=0x55d6e0763400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:02.369 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.364+0000 7fdeb4e80740 1 --2- 172.21.15.19:0/3732097126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e07672e0 0x55d6e0763400 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fdea40cd8e0 tx=0x7fdea409a8c0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.370 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.364+0000 7fdeb4e80740 1 -- 172.21.15.19:0/3732097126 shutdown_connections 2024-09-19T09:03:02.370 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.364+0000 7fdeb4e80740 1 --2- 172.21.15.19:0/3732097126 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e07672e0 0x55d6e0763400 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.370 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.364+0000 7fdeb4e80740 1 --2- 172.21.15.19:0/3732097126 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e07669a0 0x55d6e0778190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.370 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.364+0000 7fdeb4e80740 1 --2- 172.21.15.19:0/3732097126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e0762010 0x55d6e077ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.370 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.364+0000 7fdeb4e80740 1 -- 172.21.15.19:0/3732097126 >> 172.21.15.19:0/3732097126 conn(0x55d6e076bf00 msgr2=0x55d6e07611c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:02.370 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.364+0000 7fdeb4e80740 1 -- 172.21.15.19:0/3732097126 shutdown_connections 2024-09-19T09:03:02.370 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.364+0000 7fdeb4e80740 1 -- 172.21.15.19:0/3732097126 wait complete. 2024-09-19T09:03:02.370 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.364+0000 7fdeb4e80740 1 -- start start 2024-09-19T09:03:02.370 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.364+0000 7fdeb4e80740 1 Processor -- start 2024-09-19T09:03:02.370 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.365+0000 7fdeb4e80740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e0762010 0x55d6e0776030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.370 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.365+0000 7fdeb4e80740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e07669a0 0x55d6e0776570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.370 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.365+0000 7fdeb4e80740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e07672e0 0x55d6e0777530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.370 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.365+0000 7fdeb4e80740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fdeac1aa280 con 0x55d6e07669a0 2024-09-19T09:03:02.371 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.365+0000 7fdeb4e80740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fdeac1a9bb0 con 0x55d6e07672e0 2024-09-19T09:03:02.371 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.365+0000 7fdeb4e80740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdeac1a6df0 con 0x55d6e0762010 2024-09-19T09:03:02.371 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.365+0000 7fdeb4e80740 10 client.0 _ll_register_callbacks cb 0x7fdea4009b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:02.371 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.365+0000 7fdea2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e07669a0 0x55d6e0776570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.371 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.365+0000 7fdea2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e07669a0 0x55d6e0776570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38816/0 (socket says 172.21.15.19:38816) 2024-09-19T09:03:02.371 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.365+0000 7fdea2ffd640 1 -- 172.21.15.19:0/2715927651 learned_addr learned my addr 172.21.15.19:0/2715927651 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:02.371 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.365+0000 7fdeab7fe640 1 --2- 172.21.15.19:0/2715927651 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e0762010 0x55d6e0776030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.371 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.365+0000 7fdea2ffd640 1 -- 172.21.15.19:0/2715927651 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e0762010 msgr2=0x55d6e0776030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:02.371 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.365+0000 7fdea2ffd640 1 --2- 172.21.15.19:0/2715927651 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e0762010 0x55d6e0776030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.371 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.365+0000 7fdea2ffd640 1 -- 172.21.15.19:0/2715927651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e07672e0 msgr2=0x55d6e0777530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:02.371 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.365+0000 7fdea2ffd640 1 --2- 172.21.15.19:0/2715927651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e07672e0 0x55d6e0777530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.371 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.365+0000 7fdea2ffd640 1 -- 172.21.15.19:0/2715927651 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6e0777b40 con 0x55d6e07669a0 2024-09-19T09:03:02.371 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.365+0000 7fdea2ffd640 1 --2- 172.21.15.19:0/2715927651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e07669a0 0x55d6e0776570 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fde9400f790 tx=0x7fde9400feb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b99a82cdb7a6471 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:02.371 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.365+0000 7fde8affd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.365+0000 7fde8affd640 1 -- 172.21.15.19:0/2715927651 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde94027020 con 0x55d6e07669a0 2024-09-19T09:03:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.365+0000 7fde8affd640 1 -- 172.21.15.19:0/2715927651 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7fde94005450 con 0x55d6e07669a0 2024-09-19T09:03:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.366+0000 7fdeb4e80740 1 -- 172.21.15.19:0/2715927651 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdea4004310 con 0x55d6e07669a0 2024-09-19T09:03:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.366+0000 7fde8affd640 1 -- 172.21.15.19:0/2715927651 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fde94005650 con 0x55d6e07669a0 2024-09-19T09:03:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.366+0000 7fdeb4e80740 10 client.17853 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.366+0000 7fdeb4e80740 1 -- 172.21.15.19:0/2715927651 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55d6e07e7be0 con 0x55d6e07669a0 2024-09-19T09:03:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.366+0000 7fde8affd640 1 -- 172.21.15.19:0/2715927651 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fdea4004310 con 0x55d6e07669a0 2024-09-19T09:03:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.366+0000 7fde8affd640 1 -- 172.21.15.19:0/2715927651 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7fde9401e770 con 0x55d6e07669a0 2024-09-19T09:03:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.366+0000 7fdeb4e80740 10 client.17853 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.366+0000 7fdeb4e80740 10 client.17853 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.366+0000 7fdeb4e80740 20 client.17853 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.366+0000 7fdeb4e80740 1 --2- 172.21.15.19:0/2715927651 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d6e076c370 0x55d6e07ea330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.366+0000 7fdeb4e80740 4 client.17853 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:03:02.372 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.366+0000 7fdeb4e80740 1 -- 172.21.15.19:0/2715927651 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d6e06d1d70 con 0x55d6e076c370 2024-09-19T09:03:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.366+0000 7fdeab7fe640 1 --2- 172.21.15.19:0/2715927651 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d6e076c370 0x55d6e07ea330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.367+0000 7fde8affd640 10 client.17853 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:02.373 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.367+0000 7fdeab7fe640 1 --2- 172.21.15.19:0/2715927651 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d6e076c370 0x55d6e07ea330 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16e01e7b4c625b51 server_cookie=ec0eb057407f426b in_seq=0 out_seq=0 2024-09-19T09:03:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.457+0000 7fde8affd640 1 -- 172.21.15.19:0/2715927651 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d6e06d1d70 con 0x55d6e076c370 2024-09-19T09:03:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.457+0000 7fde8affd640 10 client.17853 handle_command_reply: tid=0 2024-09-19T09:03:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.458+0000 7fdeb4e80740 1 client.17853 shutdown 2024-09-19T09:03:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.458+0000 7fdeb4e80740 1 -- 172.21.15.19:0/2715927651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e07669a0 msgr2=0x55d6e0776570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:02.459 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.458+0000 7fdeb4e80740 1 --2- 172.21.15.19:0/2715927651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e07669a0 0x55d6e0776570 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fde9400f790 tx=0x7fde9400feb0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.458+0000 7fdeb4e80740 1 -- 172.21.15.19:0/2715927651 shutdown_connections 2024-09-19T09:03:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.458+0000 7fdeb4e80740 1 --2- 172.21.15.19:0/2715927651 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d6e076c370 0x55d6e07ea330 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.458+0000 7fdeb4e80740 1 --2- 172.21.15.19:0/2715927651 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d6e07672e0 0x55d6e0777530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.458+0000 7fde8affd640 0 client.17853 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:02.460 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.458+0000 7fdeb4e80740 1 --2- 172.21.15.19:0/2715927651 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d6e07669a0 0x55d6e0776570 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.458+0000 7fdeb4e80740 1 --2- 172.21.15.19:0/2715927651 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d6e0762010 0x55d6e0776030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.458+0000 7fdeb4e80740 1 -- 172.21.15.19:0/2715927651 >> 172.21.15.19:0/2715927651 conn(0x55d6e076bf00 msgr2=0x55d6e07623f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.458+0000 7fdeb4e80740 1 -- 172.21.15.19:0/2715927651 shutdown_connections 2024-09-19T09:03:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.458+0000 7fdeb4e80740 1 -- 172.21.15.19:0/2715927651 wait complete. 2024-09-19T09:03:02.461 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.458+0000 7fdeb4e80740 20 client.17853 trim_cache size 0 max 16384 2024-09-19T09:03:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T09:03:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T09:03:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T09:03:02.462 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T09:03:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.459+0000 7fdeb20e6640 1 -- 172.21.15.19:0/4276530662 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fde980a32f0 msgr2=0x7fde980a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.459+0000 7fdeb20e6640 1 --2- 172.21.15.19:0/4276530662 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fde980a32f0 0x7fde980a57b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fde9c006010 tx=0x7fde9c0058d0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.459+0000 7fdeb20e6640 1 -- 172.21.15.19:0/4276530662 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdeac1025f0 msgr2=0x7fdeac19f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.459+0000 7fdeb20e6640 1 --2- 172.21.15.19:0/4276530662 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdeac1025f0 0x7fdeac19f0d0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fdea400efd0 tx=0x7fdea400c6a0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.459+0000 7fdeb20e6640 1 -- 172.21.15.19:0/4276530662 shutdown_connections 2024-09-19T09:03:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.459+0000 7fdeb20e6640 1 --2- 172.21.15.19:0/4276530662 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fde980a32f0 0x7fde980a57b0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.463 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.459+0000 7fdeb20e6640 1 --2- 172.21.15.19:0/4276530662 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fdeac1025f0 0x7fdeac19f0d0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.464 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.459+0000 7fdeb20e6640 1 --2- 172.21.15.19:0/4276530662 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fdeac101c30 0x7fdeac19cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.464 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.459+0000 7fdeb20e6640 1 --2- 172.21.15.19:0/4276530662 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdeac100a40 0x7fdeac06a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:02.464 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.459+0000 7fdeb20e6640 1 -- 172.21.15.19:0/4276530662 >> 172.21.15.19:0/4276530662 conn(0x7fdeac0fc1e0 msgr2=0x7fdeac104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:02.464 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.459+0000 7fdeb20e6640 1 -- 172.21.15.19:0/4276530662 shutdown_connections 2024-09-19T09:03:02.464 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:02.459+0000 7fdeb20e6640 1 -- 172.21.15.19:0/4276530662 wait complete. 2024-09-19T09:03:03.170 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T09:03:03.428 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:03.818 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:03 smithi019 ceph-mon[30976]: pgmap v664: 97 pgs: 97 active+clean; 7.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 366 KiB/s wr, 992 op/s 2024-09-19T09:03:03.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.910+0000 7f3606ef2640 1 -- 172.21.15.19:0/2786385652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3600106f20 msgr2=0x7f360010eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:03.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.910+0000 7f3606ef2640 1 --2- 172.21.15.19:0/2786385652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3600106f20 0x7f360010eaa0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f35f8009ca0 tx=0x7f35f802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.910+0000 7f3606ef2640 1 -- 172.21.15.19:0/2786385652 shutdown_connections 2024-09-19T09:03:03.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.910+0000 7f3606ef2640 1 --2- 172.21.15.19:0/2786385652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3600106f20 0x7f360010eaa0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.910+0000 7f3606ef2640 1 --2- 172.21.15.19:0/2786385652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36001027a0 0x7f36001067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.910+0000 7f3606ef2640 1 --2- 172.21.15.19:0/2786385652 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3600101df0 0x7f36001021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.910+0000 7f3606ef2640 1 -- 172.21.15.19:0/2786385652 >> 172.21.15.19:0/2786385652 conn(0x7f36000fd8f0 msgr2=0x7f36000ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:03.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.910+0000 7f3606ef2640 1 -- 172.21.15.19:0/2786385652 shutdown_connections 2024-09-19T09:03:03.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.910+0000 7f3606ef2640 1 -- 172.21.15.19:0/2786385652 wait complete. 2024-09-19T09:03:03.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.911+0000 7f3606ef2640 1 Processor -- start 2024-09-19T09:03:03.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.911+0000 7f3606ef2640 1 -- start start 2024-09-19T09:03:03.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.911+0000 7f3606ef2640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3600101df0 0x7f36000744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:03.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.911+0000 7f3606ef2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36001027a0 0x7f3600074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:03.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.911+0000 7f3606ef2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3600106f20 0x7f3600074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:03.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.911+0000 7f3606ef2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3600111fd0 con 0x7f3600106f20 2024-09-19T09:03:03.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.911+0000 7f3606ef2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3600111e50 con 0x7f36001027a0 2024-09-19T09:03:03.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.911+0000 7f3606ef2640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3600112150 con 0x7f3600101df0 2024-09-19T09:03:03.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.911+0000 7f3604c8e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3600101df0 0x7f36000744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:03.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.911+0000 7f360548f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3600106f20 0x7f3600074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:03.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.911+0000 7f3604c8e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3600101df0 0x7f36000744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:51512/0 (socket says 172.21.15.19:51512) 2024-09-19T09:03:03.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.911+0000 7f3604c8e640 1 -- 172.21.15.19:0/2206365910 learned_addr learned my addr 172.21.15.19:0/2206365910 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:03.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.911+0000 7f35fffff640 1 --2- 172.21.15.19:0/2206365910 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36001027a0 0x7f3600074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:03.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.912+0000 7f360548f640 1 -- 172.21.15.19:0/2206365910 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3600101df0 msgr2=0x7f36000744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:03.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.912+0000 7f360548f640 1 --2- 172.21.15.19:0/2206365910 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3600101df0 0x7f36000744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.912+0000 7f360548f640 1 -- 172.21.15.19:0/2206365910 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36001027a0 msgr2=0x7f3600074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:03.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.912+0000 7f360548f640 1 --2- 172.21.15.19:0/2206365910 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36001027a0 0x7f3600074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.912+0000 7f360548f640 1 -- 172.21.15.19:0/2206365910 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36001a6890 con 0x7f3600106f20 2024-09-19T09:03:03.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.912+0000 7f3604c8e640 1 --2- 172.21.15.19:0/2206365910 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3600101df0 0x7f36000744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:03.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.912+0000 7f35fffff640 1 --2- 172.21.15.19:0/2206365910 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36001027a0 0x7f3600074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:03.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.912+0000 7f360548f640 1 --2- 172.21.15.19:0/2206365910 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3600106f20 0x7f3600074f70 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f35f8005e30 tx=0x7f35f8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:03.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.912+0000 7f35fdffb640 1 -- 172.21.15.19:0/2206365910 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f8031650 con 0x7f3600106f20 2024-09-19T09:03:03.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.912+0000 7f35fdffb640 1 -- 172.21.15.19:0/2206365910 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35f80317f0 con 0x7f3600106f20 2024-09-19T09:03:03.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.912+0000 7f3606ef2640 1 -- 172.21.15.19:0/2206365910 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36001a6b20 con 0x7f3600106f20 2024-09-19T09:03:03.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.912+0000 7f35fdffb640 1 -- 172.21.15.19:0/2206365910 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f802f970 con 0x7f3600106f20 2024-09-19T09:03:03.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.913+0000 7f3606ef2640 1 -- 172.21.15.19:0/2206365910 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36001a70b0 con 0x7f3600106f20 2024-09-19T09:03:03.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.915+0000 7f35fdffb640 1 -- 172.21.15.19:0/2206365910 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f35f802fb30 con 0x7f3600106f20 2024-09-19T09:03:03.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.915+0000 7f36092cb740 1 Processor -- start 2024-09-19T09:03:03.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.915+0000 7f36092cb740 1 -- start start 2024-09-19T09:03:03.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.916+0000 7f36092cb740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6964cb40 0x55ea6964b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:03.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.916+0000 7f36092cb740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea6964b5d0 0x55ea6964ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:03.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.916+0000 7f36092cb740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ea69656370 0x55ea69658760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:03.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.916+0000 7f36092cb740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ea695b12f0 con 0x55ea6964cb40 2024-09-19T09:03:03.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.916+0000 7f36092cb740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55ea69558cf0 con 0x55ea6964b5d0 2024-09-19T09:03:03.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.916+0000 7f36092cb740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ea695ad2b0 con 0x55ea69656370 2024-09-19T09:03:03.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.916+0000 7f35fffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6964cb40 0x55ea6964b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:03.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.916+0000 7f35fffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6964cb40 0x55ea6964b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38858/0 (socket says 172.21.15.19:38858) 2024-09-19T09:03:03.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.916+0000 7f35fffff640 1 -- 172.21.15.19:0/19768432 learned_addr learned my addr 172.21.15.19:0/19768432 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:03.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.916+0000 7f3604c8e640 1 --2- 172.21.15.19:0/19768432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea6964b5d0 0x55ea6964ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:03.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.916+0000 7f35fffff640 1 --2- 172.21.15.19:0/19768432 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ea69656370 0x55ea69658760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:03.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.916+0000 7f3604c8e640 1 -- 172.21.15.19:0/19768432 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ea69656370 msgr2=0x55ea69658760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:03.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.916+0000 7f3604c8e640 1 --2- 172.21.15.19:0/19768432 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ea69656370 0x55ea69658760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.916+0000 7f3604c8e640 1 -- 172.21.15.19:0/19768432 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6964cb40 msgr2=0x55ea6964b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:03.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.916+0000 7f3604c8e640 1 --2- 172.21.15.19:0/19768432 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6964cb40 0x55ea6964b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.916+0000 7f3604c8e640 1 -- 172.21.15.19:0/19768432 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea6953d3a0 con 0x55ea6964b5d0 2024-09-19T09:03:03.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.916+0000 7f35fdffb640 1 --2- 172.21.15.19:0/2206365910 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f35f00a32c0 0x7f35f00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:03.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.917+0000 7f3604c8e640 1 --2- 172.21.15.19:0/19768432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea6964b5d0 0x55ea6964ba10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f35f40114f0 tx=0x7f35f40119b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a72e57b40a492eb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:03.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.917+0000 7f35fffff640 1 --2- 172.21.15.19:0/2206365910 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f35f00a32c0 0x7f35f00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:03.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.917+0000 7f35fdffb640 1 -- 172.21.15.19:0/2206365910 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f35f80f0a30 con 0x7f3600106f20 2024-09-19T09:03:03.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.917+0000 7f35eaffd640 1 -- 172.21.15.19:0/19768432 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f4011250 con 0x55ea6964b5d0 2024-09-19T09:03:03.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.917+0000 7f35eaffd640 1 -- 172.21.15.19:0/19768432 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35f40035f0 con 0x55ea6964b5d0 2024-09-19T09:03:03.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.917+0000 7f35eaffd640 1 -- 172.21.15.19:0/19768432 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f400f800 con 0x55ea6964b5d0 2024-09-19T09:03:03.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.918+0000 7f36092cb740 1 -- 172.21.15.19:0/19768432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea6964b5d0 msgr2=0x55ea6964ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:03.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.918+0000 7f35fffff640 1 --2- 172.21.15.19:0/2206365910 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f35f00a32c0 0x7f35f00a5780 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f35ec0058c0 tx=0x7f35ec005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:03.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.918+0000 7f36092cb740 1 --2- 172.21.15.19:0/19768432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea6964b5d0 0x55ea6964ba10 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f35f40114f0 tx=0x7f35f40119b0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.918+0000 7f36092cb740 1 -- 172.21.15.19:0/19768432 shutdown_connections 2024-09-19T09:03:03.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.918+0000 7f36092cb740 1 --2- 172.21.15.19:0/19768432 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ea69656370 0x55ea69658760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.918+0000 7f36092cb740 1 --2- 172.21.15.19:0/19768432 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea6964b5d0 0x55ea6964ba10 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.918+0000 7f36092cb740 1 --2- 172.21.15.19:0/19768432 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6964cb40 0x55ea6964b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.918+0000 7f36092cb740 1 -- 172.21.15.19:0/19768432 >> 172.21.15.19:0/19768432 conn(0x55ea69614310 msgr2=0x55ea69647c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:03.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.918+0000 7f36092cb740 1 -- 172.21.15.19:0/19768432 shutdown_connections 2024-09-19T09:03:03.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.918+0000 7f36092cb740 1 -- 172.21.15.19:0/19768432 wait complete. 2024-09-19T09:03:03.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.918+0000 7f36092cb740 1 -- start start 2024-09-19T09:03:03.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.918+0000 7f36092cb740 1 Processor -- start 2024-09-19T09:03:03.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.919+0000 7f36092cb740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ea6964b5d0 0x55ea69655cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:03.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.919+0000 7f36092cb740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6964cb40 0x55ea69652f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:03.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.919+0000 7f36092cb740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea69656370 0x55ea696534d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:03.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.919+0000 7f36092cb740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ea69659070 con 0x55ea6964cb40 2024-09-19T09:03:03.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.919+0000 7f36092cb740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55ea6956c060 con 0x55ea69656370 2024-09-19T09:03:03.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.919+0000 7f36092cb740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ea696591f0 con 0x55ea6964b5d0 2024-09-19T09:03:03.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.919+0000 7f36092cb740 10 client.0 _ll_register_callbacks cb 0x55ea692bf8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:03.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.919+0000 7f35fffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6964cb40 0x55ea69652f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:03.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.919+0000 7f35fffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6964cb40 0x55ea69652f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38866/0 (socket says 172.21.15.19:38866) 2024-09-19T09:03:03.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.919+0000 7f35fffff640 1 -- 172.21.15.19:0/3104980048 learned_addr learned my addr 172.21.15.19:0/3104980048 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:03.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.919+0000 7f360548f640 1 --2- 172.21.15.19:0/3104980048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea69656370 0x55ea696534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:03.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.919+0000 7f3604c8e640 1 --2- 172.21.15.19:0/3104980048 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ea6964b5d0 0x55ea69655cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:03.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.919+0000 7f35fffff640 1 -- 172.21.15.19:0/3104980048 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ea6964b5d0 msgr2=0x55ea69655cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:03.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.919+0000 7f35fffff640 1 --2- 172.21.15.19:0/3104980048 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ea6964b5d0 0x55ea69655cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.919+0000 7f35fffff640 1 -- 172.21.15.19:0/3104980048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea69656370 msgr2=0x55ea696534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:03.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.919+0000 7f35fffff640 1 --2- 172.21.15.19:0/3104980048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea69656370 0x55ea696534d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.919+0000 7f35fffff640 1 -- 172.21.15.19:0/3104980048 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea693223c0 con 0x55ea6964cb40 2024-09-19T09:03:03.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.919+0000 7f3604c8e640 1 --2- 172.21.15.19:0/3104980048 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ea6964b5d0 0x55ea69655cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:03.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.920+0000 7f35fffff640 1 --2- 172.21.15.19:0/3104980048 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6964cb40 0x55ea69652f70 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f35ec0133e0 tx=0x7f35ec005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fccf89ea4794b2be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:03.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.920+0000 7f35dffff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:03.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.920+0000 7f35dffff640 1 -- 172.21.15.19:0/3104980048 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35ec02f060 con 0x55ea6964cb40 2024-09-19T09:03:03.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.920+0000 7f35dffff640 1 -- 172.21.15.19:0/3104980048 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f35ec01c030 con 0x55ea6964cb40 2024-09-19T09:03:03.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.920+0000 7f36092cb740 1 -- 172.21.15.19:0/3104980048 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35f40035f0 con 0x55ea6964cb40 2024-09-19T09:03:03.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.920+0000 7f35dffff640 1 -- 172.21.15.19:0/3104980048 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f35ec020650 con 0x55ea6964cb40 2024-09-19T09:03:03.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.920+0000 7f36092cb740 10 client.17865 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:03.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.920+0000 7f36092cb740 1 -- 172.21.15.19:0/3104980048 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55ea69664ab0 con 0x55ea6964cb40 2024-09-19T09:03:03.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.920+0000 7f35dffff640 1 -- 172.21.15.19:0/3104980048 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35f40035f0 con 0x55ea6964cb40 2024-09-19T09:03:03.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.921+0000 7f35dffff640 1 -- 172.21.15.19:0/3104980048 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f35ec02a7f0 con 0x55ea6964cb40 2024-09-19T09:03:03.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.921+0000 7f36092cb740 10 client.17865 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:03.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.921+0000 7f36092cb740 10 client.17865 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-19T09:03:03.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.921+0000 7f36092cb740 20 client.17865 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:03.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.921+0000 7f36092cb740 1 --2- 172.21.15.19:0/3104980048 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55ea69665f70 0x55ea696683f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:03.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.921+0000 7f36092cb740 4 client.17865 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:03.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.921+0000 7f36092cb740 1 -- 172.21.15.19:0/3104980048 --> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea695be860 con 0x55ea69665f70 2024-09-19T09:03:03.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.921+0000 7f3604c8e640 1 --2- 172.21.15.19:0/3104980048 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55ea69665f70 0x55ea696683f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:03.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.921+0000 7f35dffff640 10 client.17865 ms_handle_connect on v2:172.21.15.155:6836/3381010945 2024-09-19T09:03:03.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.921+0000 7f3604c8e640 1 --2- 172.21.15.19:0/3104980048 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55ea69665f70 0x55ea696683f0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c12a2c586ae6ba0 server_cookie=f05bbe71ecfd2ba3 in_seq=0 out_seq=0 2024-09-19T09:03:03.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.922+0000 7f35dffff640 1 -- 172.21.15.19:0/3104980048 <== mds.3 v2:172.21.15.155:6836/3381010945 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ea695be860 con 0x55ea69665f70 2024-09-19T09:03:03.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.922+0000 7f35dffff640 10 client.17865 handle_command_reply: tid=0 2024-09-19T09:03:03.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.922+0000 7f36092cb740 1 client.17865 shutdown 2024-09-19T09:03:03.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.922+0000 7f36092cb740 1 -- 172.21.15.19:0/3104980048 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6964cb40 msgr2=0x55ea69652f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:03.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.922+0000 7f36092cb740 1 --2- 172.21.15.19:0/3104980048 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6964cb40 0x55ea69652f70 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f35ec0133e0 tx=0x7f35ec005f90 comp rx=0 tx=0).stop 2024-09-19T09:03:03.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.922+0000 7f36092cb740 1 -- 172.21.15.19:0/3104980048 shutdown_connections 2024-09-19T09:03:03.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.922+0000 7f36092cb740 1 --2- 172.21.15.19:0/3104980048 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55ea69665f70 0x55ea696683f0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.922+0000 7f35dffff640 0 client.17865 ms_handle_reset on v2:172.21.15.155:6836/3381010945 2024-09-19T09:03:03.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.922+0000 7f36092cb740 1 --2- 172.21.15.19:0/3104980048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea69656370 0x55ea696534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.922+0000 7f36092cb740 1 --2- 172.21.15.19:0/3104980048 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6964cb40 0x55ea69652f70 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.922+0000 7f36092cb740 1 --2- 172.21.15.19:0/3104980048 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ea6964b5d0 0x55ea69655cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.923+0000 7f36092cb740 1 -- 172.21.15.19:0/3104980048 >> 172.21.15.19:0/3104980048 conn(0x55ea69614310 msgr2=0x55ea6964d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:03.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.923+0000 7f36092cb740 1 -- 172.21.15.19:0/3104980048 shutdown_connections 2024-09-19T09:03:03.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.923+0000 7f36092cb740 1 -- 172.21.15.19:0/3104980048 wait complete. 2024-09-19T09:03:03.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.923+0000 7f36092cb740 20 client.17865 trim_cache size 0 max 16384 2024-09-19T09:03:03.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.936+0000 7f36092cb740 1 Processor -- start 2024-09-19T09:03:03.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.936+0000 7f36092cb740 1 -- start start 2024-09-19T09:03:03.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.936+0000 7f36092cb740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6964b5d0 0x55ea69654ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:03.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.936+0000 7f36092cb740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea6964cb40 0x55ea6964e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:03.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.936+0000 7f36092cb740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ea69656370 0x55ea6964e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:03.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.936+0000 7f36092cb740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f36001af760 con 0x55ea6964b5d0 2024-09-19T09:03:03.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.936+0000 7f36092cb740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f36001b12a0 con 0x55ea6964cb40 2024-09-19T09:03:03.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.936+0000 7f36092cb740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f36001afe30 con 0x55ea69656370 2024-09-19T09:03:03.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.936+0000 7f3604c8e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6964b5d0 0x55ea69654ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:03.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.937+0000 7f3604c8e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6964b5d0 0x55ea69654ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38876/0 (socket says 172.21.15.19:38876) 2024-09-19T09:03:03.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.937+0000 7f3604c8e640 1 -- 172.21.15.19:0/1049055607 learned_addr learned my addr 172.21.15.19:0/1049055607 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:03.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.937+0000 7f35fffff640 1 --2- 172.21.15.19:0/1049055607 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea6964cb40 0x55ea6964e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:03.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.937+0000 7f3604c8e640 1 -- 172.21.15.19:0/1049055607 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ea69656370 msgr2=0x55ea6964e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:03.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.937+0000 7f3604c8e640 1 --2- 172.21.15.19:0/1049055607 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ea69656370 0x55ea6964e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.937+0000 7f3604c8e640 1 -- 172.21.15.19:0/1049055607 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea6964cb40 msgr2=0x55ea6964e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:03.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.937+0000 7f3604c8e640 1 --2- 172.21.15.19:0/1049055607 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea6964cb40 0x55ea6964e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.937+0000 7f3604c8e640 1 -- 172.21.15.19:0/1049055607 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea69668a70 con 0x55ea6964b5d0 2024-09-19T09:03:03.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.937+0000 7f3604c8e640 1 --2- 172.21.15.19:0/1049055607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6964b5d0 0x55ea69654ee0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f35f4009250 tx=0x7f35f4011170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=498696171fb679aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:03.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.937+0000 7f35ea7fc640 1 -- 172.21.15.19:0/1049055607 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f40038a0 con 0x55ea6964b5d0 2024-09-19T09:03:03.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.937+0000 7f35ea7fc640 1 -- 172.21.15.19:0/1049055607 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35f4029030 con 0x55ea6964b5d0 2024-09-19T09:03:03.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.937+0000 7f35ea7fc640 1 -- 172.21.15.19:0/1049055607 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f400f820 con 0x55ea6964b5d0 2024-09-19T09:03:03.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.938+0000 7f36092cb740 1 -- 172.21.15.19:0/1049055607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6964b5d0 msgr2=0x55ea69654ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:03.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.938+0000 7f36092cb740 1 --2- 172.21.15.19:0/1049055607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6964b5d0 0x55ea69654ee0 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f35f4009250 tx=0x7f35f4011170 comp rx=0 tx=0).stop 2024-09-19T09:03:03.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.938+0000 7f36092cb740 1 -- 172.21.15.19:0/1049055607 shutdown_connections 2024-09-19T09:03:03.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.938+0000 7f36092cb740 1 --2- 172.21.15.19:0/1049055607 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ea69656370 0x55ea6964e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.938+0000 7f36092cb740 1 --2- 172.21.15.19:0/1049055607 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea6964cb40 0x55ea6964e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.938+0000 7f36092cb740 1 --2- 172.21.15.19:0/1049055607 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6964b5d0 0x55ea69654ee0 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.938+0000 7f36092cb740 1 -- 172.21.15.19:0/1049055607 >> 172.21.15.19:0/1049055607 conn(0x55ea69614310 msgr2=0x55ea696547d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:03.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.938+0000 7f36092cb740 1 -- 172.21.15.19:0/1049055607 shutdown_connections 2024-09-19T09:03:03.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.938+0000 7f36092cb740 1 -- 172.21.15.19:0/1049055607 wait complete. 2024-09-19T09:03:03.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.938+0000 7f36092cb740 1 -- start start 2024-09-19T09:03:03.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.938+0000 7f36092cb740 1 Processor -- start 2024-09-19T09:03:03.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.939+0000 7f36092cb740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6964b5d0 0x55ea6965a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:03.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.939+0000 7f36092cb740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea6964cb40 0x55ea6965a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:03.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.939+0000 7f36092cb740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ea69656370 0x55ea6965aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:03.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.939+0000 7f36092cb740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f36001b0bd0 con 0x55ea6964b5d0 2024-09-19T09:03:03.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.939+0000 7f36092cb740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f36001b0500 con 0x55ea6964cb40 2024-09-19T09:03:03.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.939+0000 7f36092cb740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f36001ad740 con 0x55ea69656370 2024-09-19T09:03:03.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.939+0000 7f3604c8e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6964b5d0 0x55ea6965a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:03.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.939+0000 7f3604c8e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6964b5d0 0x55ea6965a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:38884/0 (socket says 172.21.15.19:38884) 2024-09-19T09:03:03.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.939+0000 7f36092cb740 10 client.0 _ll_register_callbacks cb 0x7f35ec009d70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:03.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.939+0000 7f3604c8e640 1 -- 172.21.15.19:0/4184422631 learned_addr learned my addr 172.21.15.19:0/4184422631 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:03.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.939+0000 7f35fffff640 1 --2- 172.21.15.19:0/4184422631 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea6964cb40 0x55ea6965a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:03.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.939+0000 7f360548f640 1 --2- 172.21.15.19:0/4184422631 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ea69656370 0x55ea6965aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:03.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.939+0000 7f3604c8e640 1 -- 172.21.15.19:0/4184422631 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ea69656370 msgr2=0x55ea6965aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:03.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.939+0000 7f3604c8e640 1 --2- 172.21.15.19:0/4184422631 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ea69656370 0x55ea6965aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.939+0000 7f3604c8e640 1 -- 172.21.15.19:0/4184422631 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea6964cb40 msgr2=0x55ea6965a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:03.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.939+0000 7f3604c8e640 1 --2- 172.21.15.19:0/4184422631 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea6964cb40 0x55ea6965a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.939+0000 7f3604c8e640 1 -- 172.21.15.19:0/4184422631 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea696cfee0 con 0x55ea6964b5d0 2024-09-19T09:03:03.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.939+0000 7f3604c8e640 1 --2- 172.21.15.19:0/4184422631 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6964b5d0 0x55ea6965a460 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f35f4000c00 tx=0x7f35f40035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5da5ee55faee4d84 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:03.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.939+0000 7f35dffff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:03.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.940+0000 7f35dffff640 1 -- 172.21.15.19:0/4184422631 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f4005620 con 0x55ea6964b5d0 2024-09-19T09:03:03.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.940+0000 7f35dffff640 1 -- 172.21.15.19:0/4184422631 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f35f40038a0 con 0x55ea6964b5d0 2024-09-19T09:03:03.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.940+0000 7f36092cb740 1 -- 172.21.15.19:0/4184422631 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f35f4029030 con 0x55ea6964b5d0 2024-09-19T09:03:03.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.940+0000 7f35dffff640 1 -- 172.21.15.19:0/4184422631 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f35f4003aa0 con 0x55ea6964b5d0 2024-09-19T09:03:03.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.940+0000 7f36092cb740 10 client.17871 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:03.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.940+0000 7f36092cb740 1 -- 172.21.15.19:0/4184422631 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55ea696d11c0 con 0x55ea6964b5d0 2024-09-19T09:03:03.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.940+0000 7f35dffff640 1 -- 172.21.15.19:0/4184422631 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f35f4029030 con 0x55ea6964b5d0 2024-09-19T09:03:03.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.940+0000 7f35dffff640 1 -- 172.21.15.19:0/4184422631 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f35f4025420 con 0x55ea6964b5d0 2024-09-19T09:03:03.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.940+0000 7f36092cb740 10 client.17871 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:03.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.940+0000 7f36092cb740 10 client.17871 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-19T09:03:03.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.940+0000 7f36092cb740 20 client.17871 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:03.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.940+0000 7f36092cb740 1 --2- 172.21.15.19:0/4184422631 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55ea696d1630 0x55ea696d3a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:03.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.940+0000 7f36092cb740 4 client.17871 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:03:03.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.940+0000 7f36092cb740 1 -- 172.21.15.19:0/4184422631 --> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ea695b8d70 con 0x55ea696d1630 2024-09-19T09:03:03.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.941+0000 7f35fffff640 1 --2- 172.21.15.19:0/4184422631 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55ea696d1630 0x55ea696d3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:03.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.941+0000 7f35fffff640 1 --2- 172.21.15.19:0/4184422631 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55ea696d1630 0x55ea696d3a20 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=11141bd73a0f6451 server_cookie=8ec6f3df144ff975 in_seq=0 out_seq=0 2024-09-19T09:03:03.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.941+0000 7f35dffff640 10 client.17871 ms_handle_connect on v2:172.21.15.155:6836/3381010945 2024-09-19T09:03:03.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.941+0000 7f35dffff640 1 -- 172.21.15.19:0/4184422631 <== mds.3 v2:172.21.15.155:6836/3381010945 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ea695b8d70 con 0x55ea696d1630 2024-09-19T09:03:03.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.941+0000 7f35dffff640 10 client.17871 handle_command_reply: tid=0 2024-09-19T09:03:03.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.941+0000 7f36092cb740 1 client.17871 shutdown 2024-09-19T09:03:03.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.941+0000 7f36092cb740 1 -- 172.21.15.19:0/4184422631 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6964b5d0 msgr2=0x55ea6965a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:03.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.941+0000 7f36092cb740 1 --2- 172.21.15.19:0/4184422631 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6964b5d0 0x55ea6965a460 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f35f4000c00 tx=0x7f35f40035f0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.941+0000 7f36092cb740 1 -- 172.21.15.19:0/4184422631 shutdown_connections 2024-09-19T09:03:03.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.941+0000 7f36092cb740 1 --2- 172.21.15.19:0/4184422631 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55ea696d1630 0x55ea696d3a20 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.941+0000 7f36092cb740 1 --2- 172.21.15.19:0/4184422631 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ea69656370 0x55ea6965aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.942+0000 7f36092cb740 1 --2- 172.21.15.19:0/4184422631 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ea6964cb40 0x55ea6965a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.942+0000 7f36092cb740 1 --2- 172.21.15.19:0/4184422631 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ea6964b5d0 0x55ea6965a460 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.942+0000 7f35dffff640 0 client.17871 ms_handle_reset on v2:172.21.15.155:6836/3381010945 2024-09-19T09:03:03.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.942+0000 7f36092cb740 1 -- 172.21.15.19:0/4184422631 >> 172.21.15.19:0/4184422631 conn(0x55ea69614310 msgr2=0x55ea69654ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:03.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.942+0000 7f36092cb740 1 -- 172.21.15.19:0/4184422631 shutdown_connections 2024-09-19T09:03:03.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.942+0000 7f36092cb740 1 -- 172.21.15.19:0/4184422631 wait complete. 2024-09-19T09:03:03.948 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.942+0000 7f36092cb740 20 client.17871 trim_cache size 0 max 16384 2024-09-19T09:03:03.948 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:03:03.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.942+0000 7f3606ef2640 1 -- 172.21.15.19:0/2206365910 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f35f00a32c0 msgr2=0x7f35f00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:03.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.942+0000 7f3606ef2640 1 --2- 172.21.15.19:0/2206365910 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f35f00a32c0 0x7f35f00a5780 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f35ec0058c0 tx=0x7f35ec005850 comp rx=0 tx=0).stop 2024-09-19T09:03:03.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.942+0000 7f3606ef2640 1 -- 172.21.15.19:0/2206365910 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3600106f20 msgr2=0x7f3600074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:03.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.942+0000 7f3606ef2640 1 --2- 172.21.15.19:0/2206365910 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3600106f20 0x7f3600074f70 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f35f8005e30 tx=0x7f35f8003f10 comp rx=0 tx=0).stop 2024-09-19T09:03:03.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.942+0000 7f3606ef2640 1 -- 172.21.15.19:0/2206365910 shutdown_connections 2024-09-19T09:03:03.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.942+0000 7f3606ef2640 1 --2- 172.21.15.19:0/2206365910 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f35f00a32c0 0x7f35f00a5780 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.942+0000 7f3606ef2640 1 --2- 172.21.15.19:0/2206365910 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3600106f20 0x7f3600074f70 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.942+0000 7f3606ef2640 1 --2- 172.21.15.19:0/2206365910 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f36001027a0 0x7f3600074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.942+0000 7f3606ef2640 1 --2- 172.21.15.19:0/2206365910 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3600101df0 0x7f36000744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:03.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.942+0000 7f3606ef2640 1 -- 172.21.15.19:0/2206365910 >> 172.21.15.19:0/2206365910 conn(0x7f36000fd8f0 msgr2=0x7f36000ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:03.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.943+0000 7f3606ef2640 1 -- 172.21.15.19:0/2206365910 shutdown_connections 2024-09-19T09:03:03.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:03.943+0000 7f3606ef2640 1 -- 172.21.15.19:0/2206365910 wait complete. 2024-09-19T09:03:04.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:03 smithi155 ceph-mon[34921]: pgmap v664: 97 pgs: 97 active+clean; 7.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 366 KiB/s wr, 992 op/s 2024-09-19T09:03:04.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:03 smithi203 ceph-mon[35450]: pgmap v664: 97 pgs: 97 active+clean; 7.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 366 KiB/s wr, 992 op/s 2024-09-19T09:03:04.806 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:03:05.064 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:05.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.528+0000 7f6c6be3e640 1 -- 172.21.15.19:0/128846635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c64106a80 msgr2=0x7f6c64106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:05.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.528+0000 7f6c6be3e640 1 --2- 172.21.15.19:0/128846635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c64106a80 0x7f6c64106e60 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f6c60009930 tx=0x7f6c6002a420 comp rx=0 tx=0).stop 2024-09-19T09:03:05.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.528+0000 7f6c6be3e640 1 -- 172.21.15.19:0/128846635 shutdown_connections 2024-09-19T09:03:05.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.528+0000 7f6c6be3e640 1 --2- 172.21.15.19:0/128846635 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c64101420 0x7f6c6410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.528+0000 7f6c6be3e640 1 --2- 172.21.15.19:0/128846635 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c64100a80 0x7f6c64100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.528+0000 7f6c6be3e640 1 --2- 172.21.15.19:0/128846635 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c64106a80 0x7f6c64106e60 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.528+0000 7f6c6be3e640 1 -- 172.21.15.19:0/128846635 >> 172.21.15.19:0/128846635 conn(0x7f6c640fc7a0 msgr2=0x7f6c640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:05.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.528+0000 7f6c6be3e640 1 -- 172.21.15.19:0/128846635 shutdown_connections 2024-09-19T09:03:05.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.528+0000 7f6c6be3e640 1 -- 172.21.15.19:0/128846635 wait complete. 2024-09-19T09:03:05.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.529+0000 7f6c6be3e640 1 Processor -- start 2024-09-19T09:03:05.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.529+0000 7f6c6be3e640 1 -- start start 2024-09-19T09:03:05.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.529+0000 7f6c6be3e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c64100a80 0x7f6c64102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:05.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.529+0000 7f6c6be3e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c64101420 0x7f6c64102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:05.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.529+0000 7f6c6be3e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c64106a80 0x7f6c641030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:05.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.529+0000 7f6c6be3e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6c64110e80 con 0x7f6c64106a80 2024-09-19T09:03:05.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.529+0000 7f6c6be3e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6c64110d00 con 0x7f6c64101420 2024-09-19T09:03:05.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.529+0000 7f6c6be3e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6c64111000 con 0x7f6c64100a80 2024-09-19T09:03:05.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.529+0000 7f6c6a3db640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c64106a80 0x7f6c641030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:05.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.529+0000 7f6c6a3db640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c64106a80 0x7f6c641030d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49034/0 (socket says 172.21.15.19:49034) 2024-09-19T09:03:05.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.529+0000 7f6c6a3db640 1 -- 172.21.15.19:0/1378062171 learned_addr learned my addr 172.21.15.19:0/1378062171 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:05.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.529+0000 7f6c693d9640 1 --2- 172.21.15.19:0/1378062171 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c64101420 0x7f6c64102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:05.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.530+0000 7f6c69bda640 1 --2- 172.21.15.19:0/1378062171 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c64100a80 0x7f6c64102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:05.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.530+0000 7f6c6a3db640 1 -- 172.21.15.19:0/1378062171 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c64100a80 msgr2=0x7f6c64102650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:05.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.530+0000 7f6c6a3db640 1 --2- 172.21.15.19:0/1378062171 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c64100a80 0x7f6c64102650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.530+0000 7f6c6a3db640 1 -- 172.21.15.19:0/1378062171 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c64101420 msgr2=0x7f6c64102b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:05.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.530+0000 7f6c6a3db640 1 --2- 172.21.15.19:0/1378062171 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c64101420 0x7f6c64102b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.530+0000 7f6c6a3db640 1 -- 172.21.15.19:0/1378062171 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c641a6900 con 0x7f6c64106a80 2024-09-19T09:03:05.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.530+0000 7f6c6a3db640 1 --2- 172.21.15.19:0/1378062171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c64106a80 0x7f6c641030d0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00eaa0 tx=0x7f6c5c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:05.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.530+0000 7f6c5affd640 1 -- 172.21.15.19:0/1378062171 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c00cdb0 con 0x7f6c64106a80 2024-09-19T09:03:05.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.530+0000 7f6c5affd640 1 -- 172.21.15.19:0/1378062171 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c5c005020 con 0x7f6c64106a80 2024-09-19T09:03:05.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.530+0000 7f6c6be3e640 1 -- 172.21.15.19:0/1378062171 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c641a6bf0 con 0x7f6c64106a80 2024-09-19T09:03:05.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.530+0000 7f6c5affd640 1 -- 172.21.15.19:0/1378062171 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c0116b0 con 0x7f6c64106a80 2024-09-19T09:03:05.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.530+0000 7f6c6be3e640 1 -- 172.21.15.19:0/1378062171 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c641a7130 con 0x7f6c64106a80 2024-09-19T09:03:05.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.533+0000 7f6c6e217740 1 Processor -- start 2024-09-19T09:03:05.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.533+0000 7f6c5affd640 1 -- 172.21.15.19:0/1378062171 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f6c5c005560 con 0x7f6c64106a80 2024-09-19T09:03:05.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.533+0000 7f6c6e217740 1 -- start start 2024-09-19T09:03:05.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.533+0000 7f6c6e217740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563972dd2b40 0x563972dd1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:05.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.533+0000 7f6c6e217740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563972dd15d0 0x563972dd1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:05.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.533+0000 7f6c6e217740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563972ddc370 0x563972dde760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:05.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.533+0000 7f6c6e217740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563972d372f0 con 0x563972ddc370 2024-09-19T09:03:05.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.533+0000 7f6c6e217740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x563972cdecf0 con 0x563972dd15d0 2024-09-19T09:03:05.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.533+0000 7f6c6e217740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563972d332b0 con 0x563972dd2b40 2024-09-19T09:03:05.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.533+0000 7f6c693d9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563972ddc370 0x563972dde760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:05.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.533+0000 7f6c693d9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563972ddc370 0x563972dde760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49040/0 (socket says 172.21.15.19:49040) 2024-09-19T09:03:05.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.533+0000 7f6c693d9640 1 -- 172.21.15.19:0/1146137751 learned_addr learned my addr 172.21.15.19:0/1146137751 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:05.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.533+0000 7f6c693d9640 1 --2- 172.21.15.19:0/1146137751 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563972dd2b40 0x563972dd1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:05.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.533+0000 7f6c69bda640 1 --2- 172.21.15.19:0/1146137751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563972dd15d0 0x563972dd1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:05.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.534+0000 7f6c693d9640 1 -- 172.21.15.19:0/1146137751 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563972dd2b40 msgr2=0x563972dd1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:05.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.534+0000 7f6c693d9640 1 --2- 172.21.15.19:0/1146137751 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563972dd2b40 0x563972dd1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.534+0000 7f6c693d9640 1 -- 172.21.15.19:0/1146137751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563972dd15d0 msgr2=0x563972dd1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:05.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.534+0000 7f6c693d9640 1 --2- 172.21.15.19:0/1146137751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563972dd15d0 0x563972dd1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.534+0000 7f6c693d9640 1 -- 172.21.15.19:0/1146137751 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563972cc33a0 con 0x563972ddc370 2024-09-19T09:03:05.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.534+0000 7f6c693d9640 1 --2- 172.21.15.19:0/1146137751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563972ddc370 0x563972dde760 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f6c540058c0 tx=0x7f6c54005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=444e1f27388742ef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:05.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.534+0000 7f6c5affd640 1 --2- 172.21.15.19:0/1378062171 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6c500a3240 0x7f6c500a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:05.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.534+0000 7f6c69bda640 1 --2- 172.21.15.19:0/1378062171 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6c500a3240 0x7f6c500a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:05.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.534+0000 7f6c4ffff640 1 -- 172.21.15.19:0/1146137751 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c54004030 con 0x563972ddc370 2024-09-19T09:03:05.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.534+0000 7f6c5affd640 1 -- 172.21.15.19:0/1378062171 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f6c5c0cfae0 con 0x7f6c64106a80 2024-09-19T09:03:05.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.534+0000 7f6c4ffff640 1 -- 172.21.15.19:0/1146137751 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c54005500 con 0x563972ddc370 2024-09-19T09:03:05.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.534+0000 7f6c4ffff640 1 -- 172.21.15.19:0/1146137751 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c54004c10 con 0x563972ddc370 2024-09-19T09:03:05.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.535+0000 7f6c6e217740 1 -- 172.21.15.19:0/1146137751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563972ddc370 msgr2=0x563972dde760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:05.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.535+0000 7f6c69bda640 1 --2- 172.21.15.19:0/1378062171 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6c500a3240 0x7f6c500a5700 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6c60000c00 tx=0x7f6c600058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:05.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.535+0000 7f6c6e217740 1 --2- 172.21.15.19:0/1146137751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563972ddc370 0x563972dde760 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f6c540058c0 tx=0x7f6c54005850 comp rx=0 tx=0).stop 2024-09-19T09:03:05.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.535+0000 7f6c6e217740 1 -- 172.21.15.19:0/1146137751 shutdown_connections 2024-09-19T09:03:05.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.535+0000 7f6c6e217740 1 --2- 172.21.15.19:0/1146137751 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563972ddc370 0x563972dde760 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.535+0000 7f6c6e217740 1 --2- 172.21.15.19:0/1146137751 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563972dd15d0 0x563972dd1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.535+0000 7f6c6e217740 1 --2- 172.21.15.19:0/1146137751 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563972dd2b40 0x563972dd1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.535+0000 7f6c6e217740 1 -- 172.21.15.19:0/1146137751 >> 172.21.15.19:0/1146137751 conn(0x563972d9a310 msgr2=0x563972dcdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:05.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.535+0000 7f6c6e217740 1 -- 172.21.15.19:0/1146137751 shutdown_connections 2024-09-19T09:03:05.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.535+0000 7f6c6e217740 1 -- 172.21.15.19:0/1146137751 wait complete. 2024-09-19T09:03:05.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.535+0000 7f6c6e217740 1 -- start start 2024-09-19T09:03:05.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.536+0000 7f6c6e217740 1 Processor -- start 2024-09-19T09:03:05.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.536+0000 7f6c6e217740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563972dd15d0 0x563972ddbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:05.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.536+0000 7f6c6e217740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563972dd2b40 0x563972dd8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:05.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.536+0000 7f6c6e217740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563972ddc370 0x563972dd9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:05.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.536+0000 7f6c6e217740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563972ddf070 con 0x563972dd15d0 2024-09-19T09:03:05.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.536+0000 7f6c6e217740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x563972cf2060 con 0x563972ddc370 2024-09-19T09:03:05.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.536+0000 7f6c6e217740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563972ddf1f0 con 0x563972dd2b40 2024-09-19T09:03:05.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.536+0000 7f6c6e217740 10 client.0 _ll_register_callbacks cb 0x563972a458c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:05.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.536+0000 7f6c69bda640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563972dd15d0 0x563972ddbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:05.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.536+0000 7f6c69bda640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563972dd15d0 0x563972ddbd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49050/0 (socket says 172.21.15.19:49050) 2024-09-19T09:03:05.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.536+0000 7f6c69bda640 1 -- 172.21.15.19:0/2293926036 learned_addr learned my addr 172.21.15.19:0/2293926036 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:05.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.536+0000 7f6c6a3db640 1 --2- 172.21.15.19:0/2293926036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563972ddc370 0x563972dd9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:05.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.536+0000 7f6c693d9640 1 --2- 172.21.15.19:0/2293926036 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563972dd2b40 0x563972dd8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:05.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.537+0000 7f6c69bda640 1 -- 172.21.15.19:0/2293926036 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563972dd2b40 msgr2=0x563972dd8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:05.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.537+0000 7f6c69bda640 1 --2- 172.21.15.19:0/2293926036 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563972dd2b40 0x563972dd8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.537+0000 7f6c69bda640 1 -- 172.21.15.19:0/2293926036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563972ddc370 msgr2=0x563972dd9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:05.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.537+0000 7f6c69bda640 1 --2- 172.21.15.19:0/2293926036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563972ddc370 0x563972dd9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.537+0000 7f6c69bda640 1 -- 172.21.15.19:0/2293926036 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563972aa83c0 con 0x563972dd15d0 2024-09-19T09:03:05.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.537+0000 7f6c69bda640 1 --2- 172.21.15.19:0/2293926036 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563972dd15d0 0x563972ddbd20 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f6c600096c0 tx=0x7f6c60009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f88a7ef237029aad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:05.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.537+0000 7f6c4d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:05.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.537+0000 7f6c4d7fa640 1 -- 172.21.15.19:0/2293926036 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6004b030 con 0x563972dd15d0 2024-09-19T09:03:05.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.537+0000 7f6c4d7fa640 1 -- 172.21.15.19:0/2293926036 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f6c60003ac0 con 0x563972dd15d0 2024-09-19T09:03:05.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.537+0000 7f6c6e217740 1 -- 172.21.15.19:0/2293926036 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c54005500 con 0x563972dd15d0 2024-09-19T09:03:05.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.537+0000 7f6c4d7fa640 1 -- 172.21.15.19:0/2293926036 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f6c60035050 con 0x563972dd15d0 2024-09-19T09:03:05.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.537+0000 7f6c6e217740 10 client.17883 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:05.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.537+0000 7f6c6e217740 1 -- 172.21.15.19:0/2293926036 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x563972deaac0 con 0x563972dd15d0 2024-09-19T09:03:05.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.537+0000 7f6c4d7fa640 1 -- 172.21.15.19:0/2293926036 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c54005500 con 0x563972dd15d0 2024-09-19T09:03:05.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.537+0000 7f6c4d7fa640 1 -- 172.21.15.19:0/2293926036 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f6c60047bf0 con 0x563972dd15d0 2024-09-19T09:03:05.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.538+0000 7f6c6e217740 10 client.17883 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:05.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.538+0000 7f6c6e217740 10 client.17883 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T09:03:05.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.538+0000 7f6c6e217740 20 client.17883 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:05.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.538+0000 7f6c6e217740 1 --2- 172.21.15.19:0/2293926036 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x563972debfd0 0x563972dee450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:05.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.538+0000 7f6c6e217740 4 client.17883 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:05.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.538+0000 7f6c6e217740 1 -- 172.21.15.19:0/2293926036 --> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563972d44860 con 0x563972debfd0 2024-09-19T09:03:05.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.538+0000 7f6c693d9640 1 --2- 172.21.15.19:0/2293926036 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x563972debfd0 0x563972dee450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:05.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.538+0000 7f6c693d9640 1 --2- 172.21.15.19:0/2293926036 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x563972debfd0 0x563972dee450 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bd139107aae1d373 server_cookie=ac0ef3c363123eb1 in_seq=0 out_seq=0 2024-09-19T09:03:05.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.538+0000 7f6c4d7fa640 10 client.17883 ms_handle_connect on v2:172.21.15.203:6836/3684671619 2024-09-19T09:03:05.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.539+0000 7f6c4d7fa640 1 -- 172.21.15.19:0/2293926036 <== mds.2 v2:172.21.15.203:6836/3684671619 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563972d44860 con 0x563972debfd0 2024-09-19T09:03:05.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.539+0000 7f6c4d7fa640 10 client.17883 handle_command_reply: tid=0 2024-09-19T09:03:05.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.539+0000 7f6c6e217740 1 client.17883 shutdown 2024-09-19T09:03:05.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.539+0000 7f6c6e217740 1 -- 172.21.15.19:0/2293926036 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563972dd15d0 msgr2=0x563972ddbd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:05.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.539+0000 7f6c6e217740 1 --2- 172.21.15.19:0/2293926036 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563972dd15d0 0x563972ddbd20 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f6c600096c0 tx=0x7f6c60009260 comp rx=0 tx=0).stop 2024-09-19T09:03:05.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.539+0000 7f6c6e217740 1 -- 172.21.15.19:0/2293926036 shutdown_connections 2024-09-19T09:03:05.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.539+0000 7f6c6e217740 1 --2- 172.21.15.19:0/2293926036 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x563972debfd0 0x563972dee450 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.539+0000 7f6c6e217740 1 --2- 172.21.15.19:0/2293926036 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563972dd2b40 0x563972dd8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.539+0000 7f6c6e217740 1 --2- 172.21.15.19:0/2293926036 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563972ddc370 0x563972dd9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.539+0000 7f6c4d7fa640 0 client.17883 ms_handle_reset on v2:172.21.15.203:6836/3684671619 2024-09-19T09:03:05.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.540+0000 7f6c6e217740 1 --2- 172.21.15.19:0/2293926036 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563972dd15d0 0x563972ddbd20 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.540+0000 7f6c6e217740 1 -- 172.21.15.19:0/2293926036 >> 172.21.15.19:0/2293926036 conn(0x563972d9a310 msgr2=0x563972dd3960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:05.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.540+0000 7f6c6e217740 1 -- 172.21.15.19:0/2293926036 shutdown_connections 2024-09-19T09:03:05.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.540+0000 7f6c6e217740 1 -- 172.21.15.19:0/2293926036 wait complete. 2024-09-19T09:03:05.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.540+0000 7f6c6e217740 20 client.17883 trim_cache size 0 max 16384 2024-09-19T09:03:05.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.553+0000 7f6c6e217740 1 Processor -- start 2024-09-19T09:03:05.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.553+0000 7f6c6e217740 1 -- start start 2024-09-19T09:03:05.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.553+0000 7f6c6e217740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563972dd15d0 0x563972de8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:05.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.553+0000 7f6c6e217740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563972dd2b40 0x563972dd8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:05.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.553+0000 7f6c6e217740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563972ddc370 0x563972ddd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:05.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.553+0000 7f6c6e217740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6c641af7b0 con 0x563972dd15d0 2024-09-19T09:03:05.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.553+0000 7f6c6e217740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6c641b12f0 con 0x563972dd2b40 2024-09-19T09:03:05.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.553+0000 7f6c6e217740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6c641afe80 con 0x563972ddc370 2024-09-19T09:03:05.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.553+0000 7f6c69bda640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563972dd15d0 0x563972de8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:05.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.553+0000 7f6c69bda640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563972dd15d0 0x563972de8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49058/0 (socket says 172.21.15.19:49058) 2024-09-19T09:03:05.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.553+0000 7f6c69bda640 1 -- 172.21.15.19:0/2553949812 learned_addr learned my addr 172.21.15.19:0/2553949812 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:05.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.553+0000 7f6c6a3db640 1 --2- 172.21.15.19:0/2553949812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563972ddc370 0x563972ddd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:05.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.553+0000 7f6c69bda640 1 -- 172.21.15.19:0/2553949812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563972ddc370 msgr2=0x563972ddd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:05.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.553+0000 7f6c69bda640 1 --2- 172.21.15.19:0/2553949812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563972ddc370 0x563972ddd760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.553+0000 7f6c69bda640 1 -- 172.21.15.19:0/2553949812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563972dd2b40 msgr2=0x563972dd8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:05.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.553+0000 7f6c69bda640 1 --2- 172.21.15.19:0/2553949812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563972dd2b40 0x563972dd8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.553+0000 7f6c69bda640 1 -- 172.21.15.19:0/2553949812 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563972dd7520 con 0x563972dd15d0 2024-09-19T09:03:05.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.553+0000 7f6c69bda640 1 --2- 172.21.15.19:0/2553949812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563972dd15d0 0x563972de8310 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f6c60005940 tx=0x7f6c60032fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec8dfccd896c00af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:05.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.553+0000 7f6c4f7fe640 1 -- 172.21.15.19:0/2553949812 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6005f020 con 0x563972dd15d0 2024-09-19T09:03:05.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.554+0000 7f6c4f7fe640 1 -- 172.21.15.19:0/2553949812 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c6003b670 con 0x563972dd15d0 2024-09-19T09:03:05.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.554+0000 7f6c4f7fe640 1 -- 172.21.15.19:0/2553949812 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6004b040 con 0x563972dd15d0 2024-09-19T09:03:05.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.554+0000 7f6c6e217740 1 -- 172.21.15.19:0/2553949812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563972dd15d0 msgr2=0x563972de8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:05.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.554+0000 7f6c6e217740 1 --2- 172.21.15.19:0/2553949812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563972dd15d0 0x563972de8310 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f6c60005940 tx=0x7f6c60032fa0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.554+0000 7f6c6e217740 1 -- 172.21.15.19:0/2553949812 shutdown_connections 2024-09-19T09:03:05.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.554+0000 7f6c6e217740 1 --2- 172.21.15.19:0/2553949812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563972ddc370 0x563972ddd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.554+0000 7f6c6e217740 1 --2- 172.21.15.19:0/2553949812 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563972dd2b40 0x563972dd8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.554+0000 7f6c6e217740 1 --2- 172.21.15.19:0/2553949812 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563972dd15d0 0x563972de8310 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.554+0000 7f6c6e217740 1 -- 172.21.15.19:0/2553949812 >> 172.21.15.19:0/2553949812 conn(0x563972d9a310 msgr2=0x563972dd78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:05.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.554+0000 7f6c6e217740 1 -- 172.21.15.19:0/2553949812 shutdown_connections 2024-09-19T09:03:05.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.554+0000 7f6c6e217740 1 -- 172.21.15.19:0/2553949812 wait complete. 2024-09-19T09:03:05.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.555+0000 7f6c6e217740 1 -- start start 2024-09-19T09:03:05.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.555+0000 7f6c6e217740 1 Processor -- start 2024-09-19T09:03:05.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.555+0000 7f6c6e217740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563972dd15d0 0x563972de49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:05.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.555+0000 7f6c6e217740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563972dd2b40 0x563972df33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:05.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.555+0000 7f6c6e217740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563972ddc370 0x563972df3930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:05.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.555+0000 7f6c6e217740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6c641b0c20 con 0x563972dd2b40 2024-09-19T09:03:05.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.555+0000 7f6c6e217740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6c641b0550 con 0x563972dd15d0 2024-09-19T09:03:05.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.555+0000 7f6c6e217740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6c641ad790 con 0x563972ddc370 2024-09-19T09:03:05.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.555+0000 7f6c6e217740 10 client.0 _ll_register_callbacks cb 0x7f6c54005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:05.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.555+0000 7f6c693d9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563972dd2b40 0x563972df33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:05.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.555+0000 7f6c693d9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563972dd2b40 0x563972df33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49064/0 (socket says 172.21.15.19:49064) 2024-09-19T09:03:05.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.555+0000 7f6c693d9640 1 -- 172.21.15.19:0/2265582141 learned_addr learned my addr 172.21.15.19:0/2265582141 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:05.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.555+0000 7f6c69bda640 1 --2- 172.21.15.19:0/2265582141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563972dd15d0 0x563972de49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:05.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.555+0000 7f6c6a3db640 1 --2- 172.21.15.19:0/2265582141 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563972ddc370 0x563972df3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:05.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.557+0000 7f6c693d9640 1 -- 172.21.15.19:0/2265582141 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563972ddc370 msgr2=0x563972df3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:05.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.557+0000 7f6c693d9640 1 --2- 172.21.15.19:0/2265582141 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563972ddc370 0x563972df3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.557+0000 7f6c693d9640 1 -- 172.21.15.19:0/2265582141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563972dd15d0 msgr2=0x563972de49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:05.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.557+0000 7f6c693d9640 1 --2- 172.21.15.19:0/2265582141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563972dd15d0 0x563972de49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.557+0000 7f6c693d9640 1 -- 172.21.15.19:0/2265582141 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563972df3f20 con 0x563972dd2b40 2024-09-19T09:03:05.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.557+0000 7f6c6a3db640 1 --2- 172.21.15.19:0/2265582141 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563972ddc370 0x563972df3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:05.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.557+0000 7f6c693d9640 1 --2- 172.21.15.19:0/2265582141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563972dd2b40 0x563972df33f0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f6c540058c0 tx=0x7f6c540115e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=407bf1301040909e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:05.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.557+0000 7f6c4d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:05.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.557+0000 7f6c4d7fa640 1 -- 172.21.15.19:0/2265582141 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c54031060 con 0x563972dd2b40 2024-09-19T09:03:05.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.557+0000 7f6c6e217740 1 -- 172.21.15.19:0/2265582141 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c6003b670 con 0x563972dd2b40 2024-09-19T09:03:05.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.557+0000 7f6c4d7fa640 1 -- 172.21.15.19:0/2265582141 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f6c54009ab0 con 0x563972dd2b40 2024-09-19T09:03:05.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.557+0000 7f6c4d7fa640 1 -- 172.21.15.19:0/2265582141 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f6c5400f790 con 0x563972dd2b40 2024-09-19T09:03:05.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.557+0000 7f6c6e217740 10 client.17889 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:05.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.557+0000 7f6c6e217740 1 -- 172.21.15.19:0/2265582141 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x563972de2260 con 0x563972dd2b40 2024-09-19T09:03:05.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.557+0000 7f6c4d7fa640 1 -- 172.21.15.19:0/2265582141 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c6003b670 con 0x563972dd2b40 2024-09-19T09:03:05.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.557+0000 7f6c4d7fa640 1 -- 172.21.15.19:0/2265582141 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f6c5402bb30 con 0x563972dd2b40 2024-09-19T09:03:05.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.557+0000 7f6c6e217740 10 client.17889 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:05.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.557+0000 7f6c6e217740 10 client.17889 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T09:03:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.557+0000 7f6c6e217740 20 client.17889 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.557+0000 7f6c6e217740 1 --2- 172.21.15.19:0/2265582141 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x563972e57050 0x563972e59470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.557+0000 7f6c6e217740 4 client.17889 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:03:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.557+0000 7f6c6e217740 1 -- 172.21.15.19:0/2265582141 --> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563972d3ed70 con 0x563972e57050 2024-09-19T09:03:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.557+0000 7f6c69bda640 1 --2- 172.21.15.19:0/2265582141 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x563972e57050 0x563972e59470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.557+0000 7f6c4d7fa640 10 client.17889 ms_handle_connect on v2:172.21.15.203:6836/3684671619 2024-09-19T09:03:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.557+0000 7f6c69bda640 1 --2- 172.21.15.19:0/2265582141 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x563972e57050 0x563972e59470 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6cf6ed1e5ab8de55 server_cookie=12b5adb66068ef19 in_seq=0 out_seq=0 2024-09-19T09:03:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.558+0000 7f6c4d7fa640 1 -- 172.21.15.19:0/2265582141 <== mds.2 v2:172.21.15.203:6836/3684671619 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563972d3ed70 con 0x563972e57050 2024-09-19T09:03:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.558+0000 7f6c4d7fa640 10 client.17889 handle_command_reply: tid=0 2024-09-19T09:03:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.558+0000 7f6c6e217740 1 client.17889 shutdown 2024-09-19T09:03:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.558+0000 7f6c6e217740 1 -- 172.21.15.19:0/2265582141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563972dd2b40 msgr2=0x563972df33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.558+0000 7f6c6e217740 1 --2- 172.21.15.19:0/2265582141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563972dd2b40 0x563972df33f0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f6c540058c0 tx=0x7f6c540115e0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.558+0000 7f6c6e217740 1 -- 172.21.15.19:0/2265582141 shutdown_connections 2024-09-19T09:03:05.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.558+0000 7f6c6e217740 1 --2- 172.21.15.19:0/2265582141 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x563972e57050 0x563972e59470 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.558+0000 7f6c6e217740 1 --2- 172.21.15.19:0/2265582141 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563972ddc370 0x563972df3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.558+0000 7f6c6e217740 1 --2- 172.21.15.19:0/2265582141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563972dd2b40 0x563972df33f0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.558+0000 7f6c4d7fa640 0 client.17889 ms_handle_reset on v2:172.21.15.203:6836/3684671619 2024-09-19T09:03:05.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.558+0000 7f6c6e217740 1 --2- 172.21.15.19:0/2265582141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563972dd15d0 0x563972de49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.558+0000 7f6c6e217740 1 -- 172.21.15.19:0/2265582141 >> 172.21.15.19:0/2265582141 conn(0x563972d9a310 msgr2=0x563972dcc4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:05.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.558+0000 7f6c6e217740 1 -- 172.21.15.19:0/2265582141 shutdown_connections 2024-09-19T09:03:05.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.558+0000 7f6c6e217740 1 -- 172.21.15.19:0/2265582141 wait complete. 2024-09-19T09:03:05.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.558+0000 7f6c6e217740 20 client.17889 trim_cache size 0 max 16384 2024-09-19T09:03:05.564 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:03:05.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.558+0000 7f6c6be3e640 1 -- 172.21.15.19:0/1378062171 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6c500a3240 msgr2=0x7f6c500a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:05.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.558+0000 7f6c6be3e640 1 --2- 172.21.15.19:0/1378062171 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6c500a3240 0x7f6c500a5700 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6c60000c00 tx=0x7f6c600058d0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.558+0000 7f6c6be3e640 1 -- 172.21.15.19:0/1378062171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c64106a80 msgr2=0x7f6c641030d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:05.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.558+0000 7f6c6be3e640 1 --2- 172.21.15.19:0/1378062171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c64106a80 0x7f6c641030d0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00eaa0 tx=0x7f6c5c00ef60 comp rx=0 tx=0).stop 2024-09-19T09:03:05.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.559+0000 7f6c6be3e640 1 -- 172.21.15.19:0/1378062171 shutdown_connections 2024-09-19T09:03:05.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.559+0000 7f6c6be3e640 1 --2- 172.21.15.19:0/1378062171 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6c500a3240 0x7f6c500a5700 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.559+0000 7f6c6be3e640 1 --2- 172.21.15.19:0/1378062171 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c64106a80 0x7f6c641030d0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.559+0000 7f6c6be3e640 1 --2- 172.21.15.19:0/1378062171 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c64101420 0x7f6c64102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.559+0000 7f6c6be3e640 1 --2- 172.21.15.19:0/1378062171 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c64100a80 0x7f6c64102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:05.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.559+0000 7f6c6be3e640 1 -- 172.21.15.19:0/1378062171 >> 172.21.15.19:0/1378062171 conn(0x7f6c640fc7a0 msgr2=0x7f6c64104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:05.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.559+0000 7f6c6be3e640 1 -- 172.21.15.19:0/1378062171 shutdown_connections 2024-09-19T09:03:05.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:05.559+0000 7f6c6be3e640 1 -- 172.21.15.19:0/1378062171 wait complete. 2024-09-19T09:03:06.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:05 smithi019 ceph-mon[30976]: pgmap v665: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 276 KiB/s wr, 312 op/s 2024-09-19T09:03:06.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:05 smithi155 ceph-mon[34921]: pgmap v665: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 276 KiB/s wr, 312 op/s 2024-09-19T09:03:06.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:05 smithi203 ceph-mon[35450]: pgmap v665: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 276 KiB/s wr, 312 op/s 2024-09-19T09:03:06.256 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:03:06.515 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:07.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.004+0000 7ff30c1ab640 1 -- 172.21.15.19:0/659205088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff304101de0 msgr2=0x7ff3041021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:07.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.004+0000 7ff30c1ab640 1 --2- 172.21.15.19:0/659205088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff304101de0 0x7ff3041021c0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7ff300009900 tx=0x7ff30002a410 comp rx=0 tx=0).stop 2024-09-19T09:03:07.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.004+0000 7ff30c1ab640 1 -- 172.21.15.19:0/659205088 shutdown_connections 2024-09-19T09:03:07.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.004+0000 7ff30c1ab640 1 --2- 172.21.15.19:0/659205088 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff304106f10 0x7ff30410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.004+0000 7ff30c1ab640 1 --2- 172.21.15.19:0/659205088 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff304102790 0x7ff3041067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.004+0000 7ff30c1ab640 1 --2- 172.21.15.19:0/659205088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff304101de0 0x7ff3041021c0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.004+0000 7ff30c1ab640 1 -- 172.21.15.19:0/659205088 >> 172.21.15.19:0/659205088 conn(0x7ff3040fd8c0 msgr2=0x7ff3040ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:07.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.004+0000 7ff30c1ab640 1 -- 172.21.15.19:0/659205088 shutdown_connections 2024-09-19T09:03:07.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.004+0000 7ff30c1ab640 1 -- 172.21.15.19:0/659205088 wait complete. 2024-09-19T09:03:07.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.005+0000 7ff30c1ab640 1 Processor -- start 2024-09-19T09:03:07.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.005+0000 7ff30c1ab640 1 -- start start 2024-09-19T09:03:07.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.005+0000 7ff30c1ab640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff304101de0 0x7ff304198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.005+0000 7ff30c1ab640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff304102790 0x7ff304198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.005+0000 7ff30c1ab640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff304106f10 0x7ff30419cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.005+0000 7ff30c1ab640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff304111f70 con 0x7ff304102790 2024-09-19T09:03:07.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.005+0000 7ff30c1ab640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff304111df0 con 0x7ff304101de0 2024-09-19T09:03:07.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.005+0000 7ff30c1ab640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff3041120f0 con 0x7ff304106f10 2024-09-19T09:03:07.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.005+0000 7ff309746640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff304102790 0x7ff304198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.005+0000 7ff309f47640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff304101de0 0x7ff304198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.005+0000 7ff309746640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff304102790 0x7ff304198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49092/0 (socket says 172.21.15.19:49092) 2024-09-19T09:03:07.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.005+0000 7ff309746640 1 -- 172.21.15.19:0/2384560123 learned_addr learned my addr 172.21.15.19:0/2384560123 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:07.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.005+0000 7ff30a748640 1 --2- 172.21.15.19:0/2384560123 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff304106f10 0x7ff30419cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.006+0000 7ff309746640 1 -- 172.21.15.19:0/2384560123 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff304106f10 msgr2=0x7ff30419cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:07.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.006+0000 7ff309746640 1 --2- 172.21.15.19:0/2384560123 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff304106f10 0x7ff30419cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.006+0000 7ff309746640 1 -- 172.21.15.19:0/2384560123 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff304101de0 msgr2=0x7ff304198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:07.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.006+0000 7ff309746640 1 --2- 172.21.15.19:0/2384560123 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff304101de0 0x7ff304198410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.006+0000 7ff309746640 1 -- 172.21.15.19:0/2384560123 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30419d3c0 con 0x7ff304102790 2024-09-19T09:03:07.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.006+0000 7ff309746640 1 --2- 172.21.15.19:0/2384560123 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff304102790 0x7ff304198950 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400e9f0 tx=0x7ff2f400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:07.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.006+0000 7ff2faffd640 1 -- 172.21.15.19:0/2384560123 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f400cd80 con 0x7ff304102790 2024-09-19T09:03:07.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.006+0000 7ff2faffd640 1 -- 172.21.15.19:0/2384560123 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2f4010910 con 0x7ff304102790 2024-09-19T09:03:07.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.006+0000 7ff30c1ab640 1 -- 172.21.15.19:0/2384560123 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff30419d6b0 con 0x7ff304102790 2024-09-19T09:03:07.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.006+0000 7ff2faffd640 1 -- 172.21.15.19:0/2384560123 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f4018990 con 0x7ff304102790 2024-09-19T09:03:07.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.006+0000 7ff30c1ab640 1 -- 172.21.15.19:0/2384560123 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3041a4f90 con 0x7ff304102790 2024-09-19T09:03:07.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.009+0000 7ff2faffd640 1 -- 172.21.15.19:0/2384560123 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7ff2f4010ac0 con 0x7ff304102790 2024-09-19T09:03:07.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.010+0000 7ff30e584740 1 Processor -- start 2024-09-19T09:03:07.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.010+0000 7ff30e584740 1 -- start start 2024-09-19T09:03:07.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.010+0000 7ff30e584740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c3b7bcb40 0x557c3b7bb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.010+0000 7ff30e584740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c3b7bb5d0 0x557c3b7bba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.010+0000 7ff30e584740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c3b7ca780 0x557c3b7ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.010+0000 7ff30e584740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557c3b7212f0 con 0x557c3b7ca780 2024-09-19T09:03:07.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.010+0000 7ff30e584740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x557c3b6c8cf0 con 0x557c3b7bcb40 2024-09-19T09:03:07.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.010+0000 7ff30e584740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557c3b71d2b0 con 0x557c3b7bb5d0 2024-09-19T09:03:07.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.010+0000 7ff309746640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c3b7ca780 0x557c3b7ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.010+0000 7ff2faffd640 1 --2- 172.21.15.19:0/2384560123 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff2f00a32c0 0x7ff2f00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.010+0000 7ff309746640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c3b7ca780 0x557c3b7ccb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49108/0 (socket says 172.21.15.19:49108) 2024-09-19T09:03:07.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.010+0000 7ff309746640 1 -- 172.21.15.19:0/218097066 learned_addr learned my addr 172.21.15.19:0/218097066 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:07.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.010+0000 7ff30a748640 1 --2- 172.21.15.19:0/2384560123 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff2f00a32c0 0x7ff2f00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.011+0000 7ff30a748640 1 --2- 172.21.15.19:0/218097066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c3b7bcb40 0x557c3b7bb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.011+0000 7ff309f47640 1 --2- 172.21.15.19:0/218097066 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c3b7bb5d0 0x557c3b7bba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.011+0000 7ff2faffd640 1 -- 172.21.15.19:0/2384560123 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7ff2f40cfb70 con 0x7ff304102790 2024-09-19T09:03:07.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.011+0000 7ff309746640 1 -- 172.21.15.19:0/218097066 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c3b7bb5d0 msgr2=0x557c3b7bba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:07.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.011+0000 7ff309746640 1 --2- 172.21.15.19:0/218097066 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c3b7bb5d0 0x557c3b7bba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.011+0000 7ff309746640 1 -- 172.21.15.19:0/218097066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c3b7bcb40 msgr2=0x557c3b7bb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:07.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.011+0000 7ff309746640 1 --2- 172.21.15.19:0/218097066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c3b7bcb40 0x557c3b7bb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.011+0000 7ff309746640 1 -- 172.21.15.19:0/218097066 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c3b6ad3a0 con 0x557c3b7ca780 2024-09-19T09:03:07.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.011+0000 7ff30a748640 1 --2- 172.21.15.19:0/218097066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c3b7bcb40 0x557c3b7bb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:07.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.011+0000 7ff309746640 1 --2- 172.21.15.19:0/218097066 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c3b7ca780 0x557c3b7ccb70 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7ff2f409c410 tx=0x7ff2f4018420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc480263c60cab3a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:07.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.011+0000 7ff30a748640 1 --2- 172.21.15.19:0/2384560123 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff2f00a32c0 0x7ff2f00a5780 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc009fd0 tx=0x7ff2fc004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:07.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.011+0000 7ff2effff640 1 -- 172.21.15.19:0/218097066 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f40a0550 con 0x557c3b7ca780 2024-09-19T09:03:07.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.011+0000 7ff2effff640 1 -- 172.21.15.19:0/218097066 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2f40a4e10 con 0x557c3b7ca780 2024-09-19T09:03:07.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.011+0000 7ff2effff640 1 -- 172.21.15.19:0/218097066 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f40cdda0 con 0x557c3b7ca780 2024-09-19T09:03:07.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.012+0000 7ff30e584740 1 -- 172.21.15.19:0/218097066 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c3b7ca780 msgr2=0x557c3b7ccb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:07.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.012+0000 7ff30e584740 1 --2- 172.21.15.19:0/218097066 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c3b7ca780 0x557c3b7ccb70 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7ff2f409c410 tx=0x7ff2f4018420 comp rx=0 tx=0).stop 2024-09-19T09:03:07.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.012+0000 7ff30e584740 1 -- 172.21.15.19:0/218097066 shutdown_connections 2024-09-19T09:03:07.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.012+0000 7ff30e584740 1 --2- 172.21.15.19:0/218097066 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c3b7bb5d0 0x557c3b7bba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.012+0000 7ff30e584740 1 --2- 172.21.15.19:0/218097066 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c3b7ca780 0x557c3b7ccb70 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.012+0000 7ff30e584740 1 --2- 172.21.15.19:0/218097066 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c3b7bcb40 0x557c3b7bb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.012+0000 7ff30e584740 1 -- 172.21.15.19:0/218097066 >> 172.21.15.19:0/218097066 conn(0x557c3b784310 msgr2=0x557c3b7b7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:07.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.012+0000 7ff30e584740 1 -- 172.21.15.19:0/218097066 shutdown_connections 2024-09-19T09:03:07.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.012+0000 7ff30e584740 1 -- 172.21.15.19:0/218097066 wait complete. 2024-09-19T09:03:07.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.012+0000 7ff30e584740 1 -- start start 2024-09-19T09:03:07.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.012+0000 7ff30e584740 1 Processor -- start 2024-09-19T09:03:07.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.013+0000 7ff30e584740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c3b7bb5d0 0x557c3b7ca1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.013+0000 7ff30e584740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c3b7bcb40 0x557c3b7c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.013+0000 7ff30e584740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c3b7ca780 0x557c3b7c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.013+0000 7ff30e584740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557c3b7cd420 con 0x557c3b7ca780 2024-09-19T09:03:07.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.013+0000 7ff30e584740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x557c3b6dc060 con 0x557c3b7bcb40 2024-09-19T09:03:07.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.013+0000 7ff30e584740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557c3b7cd5a0 con 0x557c3b7bb5d0 2024-09-19T09:03:07.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.013+0000 7ff30e584740 10 client.0 _ll_register_callbacks cb 0x557c3b42f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:07.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.013+0000 7ff30a748640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c3b7ca780 0x557c3b7c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.013+0000 7ff30a748640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c3b7ca780 0x557c3b7c7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49120/0 (socket says 172.21.15.19:49120) 2024-09-19T09:03:07.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.013+0000 7ff30a748640 1 -- 172.21.15.19:0/2199610652 learned_addr learned my addr 172.21.15.19:0/2199610652 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:07.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.013+0000 7ff309f47640 1 --2- 172.21.15.19:0/2199610652 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c3b7bb5d0 0x557c3b7ca1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.013+0000 7ff309746640 1 --2- 172.21.15.19:0/2199610652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c3b7bcb40 0x557c3b7c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.013+0000 7ff30a748640 1 -- 172.21.15.19:0/2199610652 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c3b7bb5d0 msgr2=0x557c3b7ca1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:07.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.013+0000 7ff30a748640 1 --2- 172.21.15.19:0/2199610652 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c3b7bb5d0 0x557c3b7ca1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.013+0000 7ff30a748640 1 -- 172.21.15.19:0/2199610652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c3b7bcb40 msgr2=0x557c3b7c74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:07.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.013+0000 7ff30a748640 1 --2- 172.21.15.19:0/2199610652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c3b7bcb40 0x557c3b7c74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.013+0000 7ff30a748640 1 -- 172.21.15.19:0/2199610652 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c3b4923c0 con 0x557c3b7ca780 2024-09-19T09:03:07.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.014+0000 7ff30a748640 1 --2- 172.21.15.19:0/2199610652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c3b7ca780 0x557c3b7c7be0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc00fa30 tx=0x7ff2fc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57cf76d78bca0176 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:07.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.014+0000 7ff2ed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:07.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.014+0000 7ff2ed7fa640 1 -- 172.21.15.19:0/2199610652 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc024070 con 0x557c3b7ca780 2024-09-19T09:03:07.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.014+0000 7ff2ed7fa640 1 -- 172.21.15.19:0/2199610652 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7ff2fc01dd10 con 0x557c3b7ca780 2024-09-19T09:03:07.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.014+0000 7ff30e584740 1 -- 172.21.15.19:0/2199610652 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2f40a4e10 con 0x557c3b7ca780 2024-09-19T09:03:07.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.014+0000 7ff2ed7fa640 1 -- 172.21.15.19:0/2199610652 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7ff2fc012e60 con 0x557c3b7ca780 2024-09-19T09:03:07.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.014+0000 7ff30e584740 10 client.17901 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:07.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.014+0000 7ff30e584740 1 -- 172.21.15.19:0/2199610652 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x557c3b7d9000 con 0x557c3b7ca780 2024-09-19T09:03:07.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.014+0000 7ff2ed7fa640 1 -- 172.21.15.19:0/2199610652 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff2f40a4e10 con 0x557c3b7ca780 2024-09-19T09:03:07.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.014+0000 7ff2ed7fa640 1 -- 172.21.15.19:0/2199610652 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7ff2fc00f040 con 0x557c3b7ca780 2024-09-19T09:03:07.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.014+0000 7ff30e584740 10 client.17901 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:07.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.014+0000 7ff30e584740 10 client.17901 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:03:07.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.014+0000 7ff30e584740 20 client.17901 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:07.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.014+0000 7ff30e584740 1 --2- 172.21.15.19:0/2199610652 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x557c3b7da510 0x557c3b7dc990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.014+0000 7ff30e584740 4 client.17901 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:07.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.014+0000 7ff30e584740 1 -- 172.21.15.19:0/2199610652 --> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c3b72e860 con 0x557c3b7da510 2024-09-19T09:03:07.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.015+0000 7ff309f47640 1 --2- 172.21.15.19:0/2199610652 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x557c3b7da510 0x557c3b7dc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.015+0000 7ff2ed7fa640 10 client.17901 ms_handle_connect on v2:172.21.15.203:6838/2547507299 2024-09-19T09:03:07.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.015+0000 7ff309f47640 1 --2- 172.21.15.19:0/2199610652 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x557c3b7da510 0x557c3b7dc990 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2e47324ccf52a407 server_cookie=3e7c3ded239b328c in_seq=0 out_seq=0 2024-09-19T09:03:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.016+0000 7ff2ed7fa640 1 -- 172.21.15.19:0/2199610652 <== mds.1 v2:172.21.15.203:6838/2547507299 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557c3b72e860 con 0x557c3b7da510 2024-09-19T09:03:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.016+0000 7ff2ed7fa640 10 client.17901 handle_command_reply: tid=0 2024-09-19T09:03:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.016+0000 7ff30e584740 1 client.17901 shutdown 2024-09-19T09:03:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.016+0000 7ff30e584740 1 -- 172.21.15.19:0/2199610652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c3b7ca780 msgr2=0x557c3b7c7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.016+0000 7ff30e584740 1 --2- 172.21.15.19:0/2199610652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c3b7ca780 0x557c3b7c7be0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc00fa30 tx=0x7ff2fc004ab0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.016+0000 7ff30e584740 1 -- 172.21.15.19:0/2199610652 shutdown_connections 2024-09-19T09:03:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.016+0000 7ff30e584740 1 --2- 172.21.15.19:0/2199610652 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x557c3b7da510 0x557c3b7dc990 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.016+0000 7ff30e584740 1 --2- 172.21.15.19:0/2199610652 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c3b7ca780 0x557c3b7c7be0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.016+0000 7ff30e584740 1 --2- 172.21.15.19:0/2199610652 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c3b7bcb40 0x557c3b7c74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.016+0000 7ff2ed7fa640 0 client.17901 ms_handle_reset on v2:172.21.15.203:6838/2547507299 2024-09-19T09:03:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.016+0000 7ff30e584740 1 --2- 172.21.15.19:0/2199610652 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c3b7bb5d0 0x557c3b7ca1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.016+0000 7ff30e584740 1 -- 172.21.15.19:0/2199610652 >> 172.21.15.19:0/2199610652 conn(0x557c3b784310 msgr2=0x557c3b7bd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.016+0000 7ff30e584740 1 -- 172.21.15.19:0/2199610652 shutdown_connections 2024-09-19T09:03:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.016+0000 7ff30e584740 1 -- 172.21.15.19:0/2199610652 wait complete. 2024-09-19T09:03:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.016+0000 7ff30e584740 20 client.17901 trim_cache size 0 max 16384 2024-09-19T09:03:07.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.030+0000 7ff30e584740 1 Processor -- start 2024-09-19T09:03:07.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.030+0000 7ff30e584740 1 -- start start 2024-09-19T09:03:07.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.030+0000 7ff30e584740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c3b7bb5d0 0x557c3b7d66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.030+0000 7ff30e584740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c3b7bcb40 0x557c3b7c6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.030+0000 7ff30e584740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c3b7ca780 0x557c3b7e2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.030+0000 7ff30e584740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff3041ab2b0 con 0x557c3b7bb5d0 2024-09-19T09:03:07.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.030+0000 7ff30e584740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff3041acdf0 con 0x557c3b7bcb40 2024-09-19T09:03:07.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.030+0000 7ff30e584740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff3041ab980 con 0x557c3b7ca780 2024-09-19T09:03:07.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.030+0000 7ff309f47640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c3b7bb5d0 0x557c3b7d66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.030+0000 7ff309f47640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c3b7bb5d0 0x557c3b7d66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49130/0 (socket says 172.21.15.19:49130) 2024-09-19T09:03:07.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.030+0000 7ff309f47640 1 -- 172.21.15.19:0/1825615836 learned_addr learned my addr 172.21.15.19:0/1825615836 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:07.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.030+0000 7ff309746640 1 --2- 172.21.15.19:0/1825615836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c3b7bcb40 0x557c3b7c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.030+0000 7ff30a748640 1 --2- 172.21.15.19:0/1825615836 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c3b7ca780 0x557c3b7e2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.031+0000 7ff309f47640 1 -- 172.21.15.19:0/1825615836 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c3b7ca780 msgr2=0x557c3b7e2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:07.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.031+0000 7ff309f47640 1 --2- 172.21.15.19:0/1825615836 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c3b7ca780 0x557c3b7e2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.031+0000 7ff309f47640 1 -- 172.21.15.19:0/1825615836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c3b7bcb40 msgr2=0x557c3b7c6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:07.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.031+0000 7ff309f47640 1 --2- 172.21.15.19:0/1825615836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c3b7bcb40 0x557c3b7c6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.031+0000 7ff309f47640 1 -- 172.21.15.19:0/1825615836 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c3b7d6c00 con 0x557c3b7bb5d0 2024-09-19T09:03:07.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.031+0000 7ff309746640 1 --2- 172.21.15.19:0/1825615836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c3b7bcb40 0x557c3b7c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:07.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.031+0000 7ff309f47640 1 --2- 172.21.15.19:0/1825615836 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c3b7bb5d0 0x557c3b7d66c0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7ff300009900 tx=0x7ff300031a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=486bc65e95ab03b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:07.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.031+0000 7ff2ef7fe640 1 -- 172.21.15.19:0/1825615836 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff300035040 con 0x557c3b7bb5d0 2024-09-19T09:03:07.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.031+0000 7ff2ef7fe640 1 -- 172.21.15.19:0/1825615836 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff300005500 con 0x557c3b7bb5d0 2024-09-19T09:03:07.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.031+0000 7ff2ef7fe640 1 -- 172.21.15.19:0/1825615836 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff300004d00 con 0x557c3b7bb5d0 2024-09-19T09:03:07.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.032+0000 7ff30e584740 1 -- 172.21.15.19:0/1825615836 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c3b7bb5d0 msgr2=0x557c3b7d66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:07.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.032+0000 7ff30e584740 1 --2- 172.21.15.19:0/1825615836 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c3b7bb5d0 0x557c3b7d66c0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7ff300009900 tx=0x7ff300031a40 comp rx=0 tx=0).stop 2024-09-19T09:03:07.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.032+0000 7ff30e584740 1 -- 172.21.15.19:0/1825615836 shutdown_connections 2024-09-19T09:03:07.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.032+0000 7ff30e584740 1 --2- 172.21.15.19:0/1825615836 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c3b7ca780 0x557c3b7e2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.032+0000 7ff30e584740 1 --2- 172.21.15.19:0/1825615836 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c3b7bcb40 0x557c3b7c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.032+0000 7ff30e584740 1 --2- 172.21.15.19:0/1825615836 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c3b7bb5d0 0x557c3b7d66c0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.032+0000 7ff30e584740 1 -- 172.21.15.19:0/1825615836 >> 172.21.15.19:0/1825615836 conn(0x557c3b784310 msgr2=0x557c3b7c5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:07.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.032+0000 7ff30e584740 1 -- 172.21.15.19:0/1825615836 shutdown_connections 2024-09-19T09:03:07.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.032+0000 7ff30e584740 1 -- 172.21.15.19:0/1825615836 wait complete. 2024-09-19T09:03:07.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.032+0000 7ff30e584740 1 -- start start 2024-09-19T09:03:07.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.032+0000 7ff30e584740 1 Processor -- start 2024-09-19T09:03:07.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.033+0000 7ff30e584740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c3b7bb5d0 0x557c3b7c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.033+0000 7ff30e584740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c3b7bcb40 0x557c3b7c48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.033+0000 7ff30e584740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c3b7ca780 0x557c3b7c4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.033+0000 7ff30e584740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff3041ac720 con 0x557c3b7bcb40 2024-09-19T09:03:07.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.033+0000 7ff30e584740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff3041ac050 con 0x557c3b7ca780 2024-09-19T09:03:07.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.033+0000 7ff30e584740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff3041a9290 con 0x557c3b7bb5d0 2024-09-19T09:03:07.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.033+0000 7ff30e584740 10 client.0 _ll_register_callbacks cb 0x7ff2fc0125e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:07.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.033+0000 7ff309746640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c3b7bcb40 0x557c3b7c48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.033+0000 7ff309746640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c3b7bcb40 0x557c3b7c48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49142/0 (socket says 172.21.15.19:49142) 2024-09-19T09:03:07.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.033+0000 7ff309746640 1 -- 172.21.15.19:0/974795016 learned_addr learned my addr 172.21.15.19:0/974795016 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:07.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.033+0000 7ff30a748640 1 --2- 172.21.15.19:0/974795016 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c3b7ca780 0x557c3b7c4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.033+0000 7ff309f47640 1 --2- 172.21.15.19:0/974795016 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c3b7bb5d0 0x557c3b7c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.033+0000 7ff309746640 1 -- 172.21.15.19:0/974795016 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c3b7bb5d0 msgr2=0x557c3b7c43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:07.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.033+0000 7ff309746640 1 --2- 172.21.15.19:0/974795016 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c3b7bb5d0 0x557c3b7c43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.033+0000 7ff309746640 1 -- 172.21.15.19:0/974795016 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c3b7ca780 msgr2=0x557c3b7c4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:07.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.033+0000 7ff309746640 1 --2- 172.21.15.19:0/974795016 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c3b7ca780 0x557c3b7c4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.033+0000 7ff309746640 1 -- 172.21.15.19:0/974795016 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c3b844230 con 0x557c3b7bcb40 2024-09-19T09:03:07.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.033+0000 7ff309746640 1 --2- 172.21.15.19:0/974795016 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c3b7bcb40 0x557c3b7c48e0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7ff2f409bf50 tx=0x7ff2f40984f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f846f59e156dbb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:07.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.034+0000 7ff2ed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:07.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.034+0000 7ff2ed7fa640 1 -- 172.21.15.19:0/974795016 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f40a4e10 con 0x557c3b7bcb40 2024-09-19T09:03:07.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.034+0000 7ff2ed7fa640 1 -- 172.21.15.19:0/974795016 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7ff2f40a0130 con 0x557c3b7bcb40 2024-09-19T09:03:07.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.034+0000 7ff30e584740 1 -- 172.21.15.19:0/974795016 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff300005500 con 0x557c3b7bcb40 2024-09-19T09:03:07.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.034+0000 7ff2ed7fa640 1 -- 172.21.15.19:0/974795016 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7ff2f40a0330 con 0x557c3b7bcb40 2024-09-19T09:03:07.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.034+0000 7ff30e584740 10 client.17907 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:07.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.034+0000 7ff30e584740 1 -- 172.21.15.19:0/974795016 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x557c3b845410 con 0x557c3b7bcb40 2024-09-19T09:03:07.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.034+0000 7ff2ed7fa640 1 -- 172.21.15.19:0/974795016 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff300005500 con 0x557c3b7bcb40 2024-09-19T09:03:07.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.034+0000 7ff2ed7fa640 1 -- 172.21.15.19:0/974795016 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7ff2f4018b30 con 0x557c3b7bcb40 2024-09-19T09:03:07.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.034+0000 7ff30e584740 10 client.17907 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:07.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.034+0000 7ff30e584740 10 client.17907 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:03:07.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.034+0000 7ff30e584740 20 client.17907 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:07.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.034+0000 7ff30e584740 1 --2- 172.21.15.19:0/974795016 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x557c3b845750 0x557c3b847b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:07.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.034+0000 7ff30e584740 4 client.17907 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:03:07.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.034+0000 7ff30e584740 1 -- 172.21.15.19:0/974795016 --> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557c3b728d70 con 0x557c3b845750 2024-09-19T09:03:07.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.035+0000 7ff309f47640 1 --2- 172.21.15.19:0/974795016 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x557c3b845750 0x557c3b847b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:07.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.035+0000 7ff309f47640 1 --2- 172.21.15.19:0/974795016 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x557c3b845750 0x557c3b847b40 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d2979af37420cd64 server_cookie=d5a115982ea0b334 in_seq=0 out_seq=0 2024-09-19T09:03:07.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.035+0000 7ff2ed7fa640 10 client.17907 ms_handle_connect on v2:172.21.15.203:6838/2547507299 2024-09-19T09:03:07.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.035+0000 7ff2ed7fa640 1 -- 172.21.15.19:0/974795016 <== mds.1 v2:172.21.15.203:6838/2547507299 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557c3b728d70 con 0x557c3b845750 2024-09-19T09:03:07.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.035+0000 7ff2ed7fa640 10 client.17907 handle_command_reply: tid=0 2024-09-19T09:03:07.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.035+0000 7ff30e584740 1 client.17907 shutdown 2024-09-19T09:03:07.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.035+0000 7ff30e584740 1 -- 172.21.15.19:0/974795016 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c3b7bcb40 msgr2=0x557c3b7c48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:07.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.035+0000 7ff30e584740 1 --2- 172.21.15.19:0/974795016 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c3b7bcb40 0x557c3b7c48e0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7ff2f409bf50 tx=0x7ff2f40984f0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.035+0000 7ff30e584740 1 -- 172.21.15.19:0/974795016 shutdown_connections 2024-09-19T09:03:07.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.035+0000 7ff30e584740 1 --2- 172.21.15.19:0/974795016 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x557c3b845750 0x557c3b847b40 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.035+0000 7ff30e584740 1 --2- 172.21.15.19:0/974795016 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557c3b7ca780 0x557c3b7c4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.035+0000 7ff2ed7fa640 0 client.17907 ms_handle_reset on v2:172.21.15.203:6838/2547507299 2024-09-19T09:03:07.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.035+0000 7ff30e584740 1 --2- 172.21.15.19:0/974795016 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557c3b7bcb40 0x557c3b7c48e0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.035+0000 7ff30e584740 1 --2- 172.21.15.19:0/974795016 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557c3b7bb5d0 0x557c3b7c43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.035+0000 7ff30e584740 1 -- 172.21.15.19:0/974795016 >> 172.21.15.19:0/974795016 conn(0x557c3b784310 msgr2=0x557c3b7c6590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:07.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.036+0000 7ff30e584740 1 -- 172.21.15.19:0/974795016 shutdown_connections 2024-09-19T09:03:07.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.036+0000 7ff30e584740 1 -- 172.21.15.19:0/974795016 wait complete. 2024-09-19T09:03:07.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.036+0000 7ff30e584740 20 client.17907 trim_cache size 0 max 16384 2024-09-19T09:03:07.041 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:03:07.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.036+0000 7ff30c1ab640 1 -- 172.21.15.19:0/2384560123 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff2f00a32c0 msgr2=0x7ff2f00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:07.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.036+0000 7ff30c1ab640 1 --2- 172.21.15.19:0/2384560123 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff2f00a32c0 0x7ff2f00a5780 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc009fd0 tx=0x7ff2fc004a40 comp rx=0 tx=0).stop 2024-09-19T09:03:07.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.036+0000 7ff30c1ab640 1 -- 172.21.15.19:0/2384560123 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff304102790 msgr2=0x7ff304198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:07.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.036+0000 7ff30c1ab640 1 --2- 172.21.15.19:0/2384560123 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff304102790 0x7ff304198950 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7ff2f400e9f0 tx=0x7ff2f400eeb0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.036+0000 7ff30c1ab640 1 -- 172.21.15.19:0/2384560123 shutdown_connections 2024-09-19T09:03:07.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.036+0000 7ff30c1ab640 1 --2- 172.21.15.19:0/2384560123 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff2f00a32c0 0x7ff2f00a5780 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.036+0000 7ff30c1ab640 1 --2- 172.21.15.19:0/2384560123 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff304106f10 0x7ff30419cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.036+0000 7ff30c1ab640 1 --2- 172.21.15.19:0/2384560123 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff304102790 0x7ff304198950 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.036+0000 7ff30c1ab640 1 --2- 172.21.15.19:0/2384560123 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff304101de0 0x7ff304198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:07.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.036+0000 7ff30c1ab640 1 -- 172.21.15.19:0/2384560123 >> 172.21.15.19:0/2384560123 conn(0x7ff3040fd8c0 msgr2=0x7ff3040fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:07.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.036+0000 7ff30c1ab640 1 -- 172.21.15.19:0/2384560123 shutdown_connections 2024-09-19T09:03:07.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:07.037+0000 7ff30c1ab640 1 -- 172.21.15.19:0/2384560123 wait complete. 2024-09-19T09:03:07.865 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:03:08.050 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:07 smithi203 ceph-mon[35450]: pgmap v666: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 102 KiB/s wr, 45 op/s 2024-09-19T09:03:08.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:07 smithi019 ceph-mon[30976]: pgmap v666: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 102 KiB/s wr, 45 op/s 2024-09-19T09:03:08.123 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:08.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:07 smithi155 ceph-mon[34921]: pgmap v666: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 102 KiB/s wr, 45 op/s 2024-09-19T09:03:08.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.605+0000 7f61ec095640 1 -- 172.21.15.19:0/235399749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61e4100cc0 msgr2=0x7f61e4106800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:08.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.605+0000 7f61ec095640 1 --2- 172.21.15.19:0/235399749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61e4100cc0 0x7f61e4106800 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f61d4009900 tx=0x7f61d402a410 comp rx=0 tx=0).stop 2024-09-19T09:03:08.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.605+0000 7f61ec095640 1 -- 172.21.15.19:0/235399749 shutdown_connections 2024-09-19T09:03:08.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.605+0000 7f61ec095640 1 --2- 172.21.15.19:0/235399749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61e4106f30 0x7f61e410eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:08.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.605+0000 7f61ec095640 1 --2- 172.21.15.19:0/235399749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61e4100cc0 0x7f61e4106800 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:08.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.605+0000 7f61ec095640 1 --2- 172.21.15.19:0/235399749 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61e4100310 0x7f61e41006f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:08.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.605+0000 7f61ec095640 1 -- 172.21.15.19:0/235399749 >> 172.21.15.19:0/235399749 conn(0x7f61e4077210 msgr2=0x7f61e40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:08.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.605+0000 7f61ec095640 1 -- 172.21.15.19:0/235399749 shutdown_connections 2024-09-19T09:03:08.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.605+0000 7f61ec095640 1 -- 172.21.15.19:0/235399749 wait complete. 2024-09-19T09:03:08.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.606+0000 7f61ec095640 1 Processor -- start 2024-09-19T09:03:08.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.606+0000 7f61ec095640 1 -- start start 2024-09-19T09:03:08.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.606+0000 7f61ec095640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61e4100310 0x7f61e41984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:08.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.606+0000 7f61ec095640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61e4100cc0 0x7f61e4198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:08.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.606+0000 7f61ec095640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61e4106f30 0x7f61e419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:08.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.606+0000 7f61ec095640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f61e4111f90 con 0x7f61e4100310 2024-09-19T09:03:08.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.606+0000 7f61ec095640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f61e4111e10 con 0x7f61e4100cc0 2024-09-19T09:03:08.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.606+0000 7f61ec095640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f61e4112110 con 0x7f61e4106f30 2024-09-19T09:03:08.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.606+0000 7f61e9e31640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61e4100310 0x7f61e41984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:08.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.606+0000 7f61e9e31640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61e4100310 0x7f61e41984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49168/0 (socket says 172.21.15.19:49168) 2024-09-19T09:03:08.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.606+0000 7f61e9e31640 1 -- 172.21.15.19:0/2931112815 learned_addr learned my addr 172.21.15.19:0/2931112815 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:08.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.606+0000 7f61ea632640 1 --2- 172.21.15.19:0/2931112815 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61e4106f30 0x7f61e419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:08.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.607+0000 7f61e9630640 1 --2- 172.21.15.19:0/2931112815 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61e4100cc0 0x7f61e4198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:08.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.607+0000 7f61e9e31640 1 -- 172.21.15.19:0/2931112815 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61e4106f30 msgr2=0x7f61e419cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:08.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.607+0000 7f61e9e31640 1 --2- 172.21.15.19:0/2931112815 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61e4106f30 0x7f61e419cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:08.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.607+0000 7f61e9e31640 1 -- 172.21.15.19:0/2931112815 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61e4100cc0 msgr2=0x7f61e4198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:08.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.607+0000 7f61e9e31640 1 --2- 172.21.15.19:0/2931112815 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61e4100cc0 0x7f61e4198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:08.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.607+0000 7f61e9e31640 1 -- 172.21.15.19:0/2931112815 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61e419d480 con 0x7f61e4100310 2024-09-19T09:03:08.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.607+0000 7f61e9630640 1 --2- 172.21.15.19:0/2931112815 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61e4100cc0 0x7f61e4198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:08.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.607+0000 7f61e9e31640 1 --2- 172.21.15.19:0/2931112815 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61e4100310 0x7f61e41984d0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f61e000d770 tx=0x7f61e000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:08.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.607+0000 7f61daffd640 1 -- 172.21.15.19:0/2931112815 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e0017070 con 0x7f61e4100310 2024-09-19T09:03:08.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.607+0000 7f61daffd640 1 -- 172.21.15.19:0/2931112815 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61e0005500 con 0x7f61e4100310 2024-09-19T09:03:08.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.607+0000 7f61ec095640 1 -- 172.21.15.19:0/2931112815 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61e419d770 con 0x7f61e4100310 2024-09-19T09:03:08.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.607+0000 7f61daffd640 1 -- 172.21.15.19:0/2931112815 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e0004e00 con 0x7f61e4100310 2024-09-19T09:03:08.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.607+0000 7f61ec095640 1 -- 172.21.15.19:0/2931112815 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61e41a5050 con 0x7f61e4100310 2024-09-19T09:03:08.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.609+0000 7f61daffd640 1 -- 172.21.15.19:0/2931112815 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f61e0004fa0 con 0x7f61e4100310 2024-09-19T09:03:08.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.610+0000 7f61ee46e740 1 Processor -- start 2024-09-19T09:03:08.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.610+0000 7f61ee46e740 1 -- start start 2024-09-19T09:03:08.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.610+0000 7f61ee46e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d4e9aedb40 0x55d4e9aec090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:08.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.610+0000 7f61ee46e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d4e9aec5d0 0x55d4e9aeca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:08.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.610+0000 7f61ee46e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4e9af7370 0x55d4e9af9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:08.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.610+0000 7f61ee46e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d4e9a522f0 con 0x55d4e9af7370 2024-09-19T09:03:08.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.610+0000 7f61ee46e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55d4e99f9cf0 con 0x55d4e9aec5d0 2024-09-19T09:03:08.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.610+0000 7f61ee46e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d4e9a4e2b0 con 0x55d4e9aedb40 2024-09-19T09:03:08.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.610+0000 7f61e9630640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4e9af7370 0x55d4e9af9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:08.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.610+0000 7f61ea632640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d4e9aedb40 0x55d4e9aec090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:08.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.610+0000 7f61e9630640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4e9af7370 0x55d4e9af9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49172/0 (socket says 172.21.15.19:49172) 2024-09-19T09:03:08.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.610+0000 7f61e9630640 1 -- 172.21.15.19:0/3104254995 learned_addr learned my addr 172.21.15.19:0/3104254995 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:08.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.610+0000 7f61e9e31640 1 --2- 172.21.15.19:0/3104254995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d4e9aec5d0 0x55d4e9aeca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:08.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.610+0000 7f61daffd640 1 --2- 172.21.15.19:0/2931112815 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f61d00a32c0 0x7f61d00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:08.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.611+0000 7f61ea632640 1 --2- 172.21.15.19:0/2931112815 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f61d00a32c0 0x7f61d00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:08.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.611+0000 7f61e9630640 1 -- 172.21.15.19:0/3104254995 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d4e9aedb40 msgr2=0x55d4e9aec090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:08.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.611+0000 7f61e9630640 1 --2- 172.21.15.19:0/3104254995 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d4e9aedb40 0x55d4e9aec090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:08.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.611+0000 7f61e9630640 1 -- 172.21.15.19:0/3104254995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d4e9aec5d0 msgr2=0x55d4e9aeca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:08.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.611+0000 7f61e9630640 1 --2- 172.21.15.19:0/3104254995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d4e9aec5d0 0x55d4e9aeca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:08.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.611+0000 7f61e9630640 1 -- 172.21.15.19:0/3104254995 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4e99de3a0 con 0x55d4e9af7370 2024-09-19T09:03:08.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.611+0000 7f61e9e31640 1 --2- 172.21.15.19:0/3104254995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d4e9aec5d0 0x55d4e9aeca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:08.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.611+0000 7f61daffd640 1 -- 172.21.15.19:0/2931112815 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f61e00cf330 con 0x7f61e4100310 2024-09-19T09:03:08.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.611+0000 7f61e9630640 1 --2- 172.21.15.19:0/3104254995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4e9af7370 0x55d4e9af9760 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f61d4005c40 tx=0x7f61d4032cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a448dfd1479b5b1e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:08.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.611+0000 7f61ea632640 1 --2- 172.21.15.19:0/2931112815 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f61d00a32c0 0x7f61d00a5780 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f61dc005fd0 tx=0x7f61dc004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:08.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.611+0000 7f61cffff640 1 -- 172.21.15.19:0/3104254995 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d403f070 con 0x55d4e9af7370 2024-09-19T09:03:08.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.611+0000 7f61cffff640 1 -- 172.21.15.19:0/3104254995 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61d40317b0 con 0x55d4e9af7370 2024-09-19T09:03:08.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.611+0000 7f61cffff640 1 -- 172.21.15.19:0/3104254995 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d4035070 con 0x55d4e9af7370 2024-09-19T09:03:08.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.612+0000 7f61ee46e740 1 -- 172.21.15.19:0/3104254995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4e9af7370 msgr2=0x55d4e9af9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:08.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.612+0000 7f61ee46e740 1 --2- 172.21.15.19:0/3104254995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4e9af7370 0x55d4e9af9760 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f61d4005c40 tx=0x7f61d4032cb0 comp rx=0 tx=0).stop 2024-09-19T09:03:08.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.612+0000 7f61ee46e740 1 -- 172.21.15.19:0/3104254995 shutdown_connections 2024-09-19T09:03:08.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.612+0000 7f61ee46e740 1 --2- 172.21.15.19:0/3104254995 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4e9af7370 0x55d4e9af9760 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:08.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.612+0000 7f61ee46e740 1 --2- 172.21.15.19:0/3104254995 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d4e9aec5d0 0x55d4e9aeca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:08.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.612+0000 7f61ee46e740 1 --2- 172.21.15.19:0/3104254995 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d4e9aedb40 0x55d4e9aec090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:08.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.612+0000 7f61ee46e740 1 -- 172.21.15.19:0/3104254995 >> 172.21.15.19:0/3104254995 conn(0x55d4e9ab5310 msgr2=0x55d4e9ae8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:08.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.612+0000 7f61ee46e740 1 -- 172.21.15.19:0/3104254995 shutdown_connections 2024-09-19T09:03:08.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.612+0000 7f61ee46e740 1 -- 172.21.15.19:0/3104254995 wait complete. 2024-09-19T09:03:08.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.612+0000 7f61ee46e740 1 -- start start 2024-09-19T09:03:08.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.613+0000 7f61ee46e740 1 Processor -- start 2024-09-19T09:03:08.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.613+0000 7f61ee46e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4e9aec5d0 0x55d4e9af6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:08.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.613+0000 7f61ee46e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d4e9aedb40 0x55d4e9af3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:08.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.613+0000 7f61ee46e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d4e9af7370 0x55d4e9af45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:08.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.613+0000 7f61ee46e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d4e9afa010 con 0x55d4e9aec5d0 2024-09-19T09:03:08.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.613+0000 7f61ee46e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55d4e9a0d060 con 0x55d4e9af7370 2024-09-19T09:03:08.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.613+0000 7f61ee46e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d4e9afa190 con 0x55d4e9aedb40 2024-09-19T09:03:08.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.613+0000 7f61ee46e740 10 client.0 _ll_register_callbacks cb 0x55d4e97608c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:08.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.613+0000 7f61e9e31640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4e9aec5d0 0x55d4e9af6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:08.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.613+0000 7f61e9e31640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4e9aec5d0 0x55d4e9af6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49186/0 (socket says 172.21.15.19:49186) 2024-09-19T09:03:08.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.613+0000 7f61e9e31640 1 -- 172.21.15.19:0/871234755 learned_addr learned my addr 172.21.15.19:0/871234755 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:08.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.613+0000 7f61e9630640 1 --2- 172.21.15.19:0/871234755 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d4e9aedb40 0x55d4e9af3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:08.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.613+0000 7f61ea632640 1 --2- 172.21.15.19:0/871234755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d4e9af7370 0x55d4e9af45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:08.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.613+0000 7f61e9e31640 1 -- 172.21.15.19:0/871234755 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d4e9aedb40 msgr2=0x55d4e9af3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:08.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.613+0000 7f61e9e31640 1 --2- 172.21.15.19:0/871234755 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d4e9aedb40 0x55d4e9af3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:08.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.613+0000 7f61e9e31640 1 -- 172.21.15.19:0/871234755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d4e9af7370 msgr2=0x55d4e9af45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:08.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.614+0000 7f61e9e31640 1 --2- 172.21.15.19:0/871234755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d4e9af7370 0x55d4e9af45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:08.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.614+0000 7f61e9e31640 1 -- 172.21.15.19:0/871234755 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4e97c33c0 con 0x55d4e9aec5d0 2024-09-19T09:03:08.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.614+0000 7f61ea632640 1 --2- 172.21.15.19:0/871234755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d4e9af7370 0x55d4e9af45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:08.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.614+0000 7f61e9e31640 1 --2- 172.21.15.19:0/871234755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4e9aec5d0 0x55d4e9af6d30 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f61e00ccde0 tx=0x7f61e009b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b85bdacbcb866d44 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:08.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.614+0000 7f61cd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:08.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.614+0000 7f61cd7fa640 1 -- 172.21.15.19:0/871234755 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e0020070 con 0x55d4e9aec5d0 2024-09-19T09:03:08.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.614+0000 7f61cd7fa640 1 -- 172.21.15.19:0/871234755 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f61e0005290 con 0x55d4e9aec5d0 2024-09-19T09:03:08.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.614+0000 7f61ee46e740 1 -- 172.21.15.19:0/871234755 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61d40317b0 con 0x55d4e9aec5d0 2024-09-19T09:03:08.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.614+0000 7f61cd7fa640 1 -- 172.21.15.19:0/871234755 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f61e009b900 con 0x55d4e9aec5d0 2024-09-19T09:03:08.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.614+0000 7f61ee46e740 10 client.17919 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:08.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.614+0000 7f61ee46e740 1 -- 172.21.15.19:0/871234755 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55d4e9b05ac0 con 0x55d4e9aec5d0 2024-09-19T09:03:08.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.614+0000 7f61cd7fa640 1 -- 172.21.15.19:0/871234755 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61d40317b0 con 0x55d4e9aec5d0 2024-09-19T09:03:08.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.614+0000 7f61cd7fa640 1 -- 172.21.15.19:0/871234755 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f61e0097f70 con 0x55d4e9aec5d0 2024-09-19T09:03:08.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.615+0000 7f61ee46e740 10 client.17919 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:08.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.615+0000 7f61ee46e740 10 client.17919 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:08.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.615+0000 7f61ee46e740 20 client.17919 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:08.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.615+0000 7f61ee46e740 1 --2- 172.21.15.19:0/871234755 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d4e9b06f80 0x55d4e9b09390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:08.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.615+0000 7f61ee46e740 4 client.17919 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:08.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.615+0000 7f61ee46e740 1 -- 172.21.15.19:0/871234755 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d4e9a5f860 con 0x55d4e9b06f80 2024-09-19T09:03:08.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.615+0000 7f61e9630640 1 --2- 172.21.15.19:0/871234755 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d4e9b06f80 0x55d4e9b09390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:08.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.616+0000 7f61e9630640 1 --2- 172.21.15.19:0/871234755 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d4e9b06f80 0x55d4e9b09390 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1680fd95830d2673 server_cookie=ab6ee46e4cf50ed5 in_seq=0 out_seq=0 2024-09-19T09:03:08.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.616+0000 7f61cd7fa640 10 client.17919 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:08.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.617+0000 7f61cd7fa640 1 -- 172.21.15.19:0/871234755 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d4e9a5f860 con 0x55d4e9b06f80 2024-09-19T09:03:08.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.617+0000 7f61cd7fa640 10 client.17919 handle_command_reply: tid=0 2024-09-19T09:03:08.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.617+0000 7f61ee46e740 1 client.17919 shutdown 2024-09-19T09:03:08.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.617+0000 7f61ee46e740 1 -- 172.21.15.19:0/871234755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4e9aec5d0 msgr2=0x55d4e9af6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:08.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.617+0000 7f61ee46e740 1 --2- 172.21.15.19:0/871234755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4e9aec5d0 0x55d4e9af6d30 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f61e00ccde0 tx=0x7f61e009b260 comp rx=0 tx=0).stop 2024-09-19T09:03:08.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.617+0000 7f61ee46e740 1 -- 172.21.15.19:0/871234755 shutdown_connections 2024-09-19T09:03:08.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.617+0000 7f61ee46e740 1 --2- 172.21.15.19:0/871234755 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d4e9b06f80 0x55d4e9b09390 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:08.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.617+0000 7f61ee46e740 1 --2- 172.21.15.19:0/871234755 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d4e9aedb40 0x55d4e9af3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:08.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.617+0000 7f61cd7fa640 0 client.17919 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:08.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.617+0000 7f61ee46e740 1 --2- 172.21.15.19:0/871234755 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d4e9af7370 0x55d4e9af45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:08.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.617+0000 7f61ee46e740 1 --2- 172.21.15.19:0/871234755 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4e9aec5d0 0x55d4e9af6d30 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:08.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.617+0000 7f61ee46e740 1 -- 172.21.15.19:0/871234755 >> 172.21.15.19:0/871234755 conn(0x55d4e9ab5310 msgr2=0x55d4e9aee960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:08.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.617+0000 7f61ee46e740 1 -- 172.21.15.19:0/871234755 shutdown_connections 2024-09-19T09:03:08.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.617+0000 7f61ee46e740 1 -- 172.21.15.19:0/871234755 wait complete. 2024-09-19T09:03:08.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.617+0000 7f61ee46e740 20 client.17919 trim_cache size 0 max 16384 2024-09-19T09:03:08.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.630+0000 7f61ee46e740 1 Processor -- start 2024-09-19T09:03:08.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.630+0000 7f61ee46e740 1 -- start start 2024-09-19T09:03:08.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.630+0000 7f61ee46e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d4e9aec5d0 0x55d4e9b032b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:08.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.630+0000 7f61ee46e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4e9aedb40 0x55d4e9aee820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:08.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.630+0000 7f61ee46e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d4e9af7370 0x55d4e9aeed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:08.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.630+0000 7f61ee46e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f61e41ad4a0 con 0x55d4e9aedb40 2024-09-19T09:03:08.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.630+0000 7f61ee46e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f61e41aefe0 con 0x55d4e9af7370 2024-09-19T09:03:08.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.630+0000 7f61ee46e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f61e41adb70 con 0x55d4e9aec5d0 2024-09-19T09:03:08.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.631+0000 7f61e9630640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4e9aedb40 0x55d4e9aee820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:08.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.631+0000 7f61e9630640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4e9aedb40 0x55d4e9aee820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49202/0 (socket says 172.21.15.19:49202) 2024-09-19T09:03:08.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.631+0000 7f61e9630640 1 -- 172.21.15.19:0/436438721 learned_addr learned my addr 172.21.15.19:0/436438721 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:08.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.631+0000 7f61e9e31640 1 --2- 172.21.15.19:0/436438721 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d4e9aec5d0 0x55d4e9b032b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:08.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.631+0000 7f61ea632640 1 --2- 172.21.15.19:0/436438721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d4e9af7370 0x55d4e9aeed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:08.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.631+0000 7f61e9630640 1 -- 172.21.15.19:0/436438721 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d4e9aec5d0 msgr2=0x55d4e9b032b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:08.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.631+0000 7f61e9630640 1 --2- 172.21.15.19:0/436438721 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d4e9aec5d0 0x55d4e9b032b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:08.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.631+0000 7f61e9630640 1 -- 172.21.15.19:0/436438721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d4e9af7370 msgr2=0x55d4e9aeed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:08.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.631+0000 7f61e9630640 1 --2- 172.21.15.19:0/436438721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d4e9af7370 0x55d4e9aeed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:08.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.631+0000 7f61e9630640 1 -- 172.21.15.19:0/436438721 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4e9af2530 con 0x55d4e9aedb40 2024-09-19T09:03:08.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.631+0000 7f61e9630640 1 --2- 172.21.15.19:0/436438721 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4e9aedb40 0x55d4e9aee820 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f61d4000c00 tx=0x7f61d4009230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b294528d8534c8c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:08.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.631+0000 7f61cf7fe640 1 -- 172.21.15.19:0/436438721 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d4051070 con 0x55d4e9aedb40 2024-09-19T09:03:08.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.631+0000 7f61cf7fe640 1 -- 172.21.15.19:0/436438721 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61d4004040 con 0x55d4e9aedb40 2024-09-19T09:03:08.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.631+0000 7f61cf7fe640 1 -- 172.21.15.19:0/436438721 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d403f040 con 0x55d4e9aedb40 2024-09-19T09:03:08.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.632+0000 7f61ee46e740 1 -- 172.21.15.19:0/436438721 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4e9aedb40 msgr2=0x55d4e9aee820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:08.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.632+0000 7f61ee46e740 1 --2- 172.21.15.19:0/436438721 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4e9aedb40 0x55d4e9aee820 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f61d4000c00 tx=0x7f61d4009230 comp rx=0 tx=0).stop 2024-09-19T09:03:08.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.632+0000 7f61ee46e740 1 -- 172.21.15.19:0/436438721 shutdown_connections 2024-09-19T09:03:08.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.632+0000 7f61ee46e740 1 --2- 172.21.15.19:0/436438721 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d4e9af7370 0x55d4e9aeed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:08.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.632+0000 7f61ee46e740 1 --2- 172.21.15.19:0/436438721 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4e9aedb40 0x55d4e9aee820 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:08.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.632+0000 7f61ee46e740 1 --2- 172.21.15.19:0/436438721 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d4e9aec5d0 0x55d4e9b032b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:08.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.632+0000 7f61ee46e740 1 -- 172.21.15.19:0/436438721 >> 172.21.15.19:0/436438721 conn(0x55d4e9ab5310 msgr2=0x55d4e9aee110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:08.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.632+0000 7f61ee46e740 1 -- 172.21.15.19:0/436438721 shutdown_connections 2024-09-19T09:03:08.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.632+0000 7f61ee46e740 1 -- 172.21.15.19:0/436438721 wait complete. 2024-09-19T09:03:08.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.632+0000 7f61ee46e740 1 -- start start 2024-09-19T09:03:08.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.632+0000 7f61ee46e740 1 Processor -- start 2024-09-19T09:03:08.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.633+0000 7f61ee46e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d4e9aec5d0 0x55d4e9afb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:08.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.633+0000 7f61ee46e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d4e9aedb40 0x55d4e9afb710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:08.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.633+0000 7f61ee46e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4e9af7370 0x55d4e9afbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:08.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.633+0000 7f61ee46e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f61e41ae910 con 0x55d4e9af7370 2024-09-19T09:03:08.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.633+0000 7f61ee46e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f61e41ae240 con 0x55d4e9aec5d0 2024-09-19T09:03:08.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.633+0000 7f61ee46e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f61e41ab480 con 0x55d4e9aedb40 2024-09-19T09:03:08.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.633+0000 7f61ee46e740 10 client.0 _ll_register_callbacks cb 0x7f61e000d6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:08.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.633+0000 7f61ea632640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4e9af7370 0x55d4e9afbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:08.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.633+0000 7f61ea632640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4e9af7370 0x55d4e9afbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49210/0 (socket says 172.21.15.19:49210) 2024-09-19T09:03:08.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.633+0000 7f61ea632640 1 -- 172.21.15.19:0/4007121345 learned_addr learned my addr 172.21.15.19:0/4007121345 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:08.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.633+0000 7f61e9630640 1 --2- 172.21.15.19:0/4007121345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d4e9aedb40 0x55d4e9afb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:08.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.633+0000 7f61e9e31640 1 --2- 172.21.15.19:0/4007121345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d4e9aec5d0 0x55d4e9afb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:08.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.633+0000 7f61ea632640 1 -- 172.21.15.19:0/4007121345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d4e9aedb40 msgr2=0x55d4e9afb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:08.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.633+0000 7f61ea632640 1 --2- 172.21.15.19:0/4007121345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d4e9aedb40 0x55d4e9afb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:08.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.633+0000 7f61ea632640 1 -- 172.21.15.19:0/4007121345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d4e9aec5d0 msgr2=0x55d4e9afb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:08.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.633+0000 7f61ea632640 1 --2- 172.21.15.19:0/4007121345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d4e9aec5d0 0x55d4e9afb1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:08.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.633+0000 7f61ea632640 1 -- 172.21.15.19:0/4007121345 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4e9b70c20 con 0x55d4e9af7370 2024-09-19T09:03:08.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.633+0000 7f61e9630640 1 --2- 172.21.15.19:0/4007121345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d4e9aedb40 0x55d4e9afb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:08.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.634+0000 7f61ea632640 1 --2- 172.21.15.19:0/4007121345 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4e9af7370 0x55d4e9afbc50 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f61dc012d10 tx=0x7f61dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfde724f0acf2f9b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:08.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.634+0000 7f61cd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:08.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.634+0000 7f61cd7fa640 1 -- 172.21.15.19:0/4007121345 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61dc01a070 con 0x55d4e9af7370 2024-09-19T09:03:08.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.634+0000 7f61cd7fa640 1 -- 172.21.15.19:0/4007121345 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f61dc02b640 con 0x55d4e9af7370 2024-09-19T09:03:08.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.634+0000 7f61ee46e740 1 -- 172.21.15.19:0/4007121345 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f61d4004040 con 0x55d4e9af7370 2024-09-19T09:03:08.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.634+0000 7f61cd7fa640 1 -- 172.21.15.19:0/4007121345 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f61dc02b840 con 0x55d4e9af7370 2024-09-19T09:03:08.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.634+0000 7f61ee46e740 10 client.17925 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:08.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.634+0000 7f61ee46e740 1 -- 172.21.15.19:0/4007121345 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55d4e9b71f60 con 0x55d4e9af7370 2024-09-19T09:03:08.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.634+0000 7f61cd7fa640 1 -- 172.21.15.19:0/4007121345 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f61d4004040 con 0x55d4e9af7370 2024-09-19T09:03:08.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.634+0000 7f61cd7fa640 1 -- 172.21.15.19:0/4007121345 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f61dc029020 con 0x55d4e9af7370 2024-09-19T09:03:08.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.634+0000 7f61ee46e740 10 client.17925 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:08.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.634+0000 7f61ee46e740 10 client.17925 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:08.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.634+0000 7f61ee46e740 20 client.17925 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:08.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.634+0000 7f61ee46e740 1 --2- 172.21.15.19:0/4007121345 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d4e9b726e0 0x55d4e9b74b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:08.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.634+0000 7f61ee46e740 4 client.17925 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:03:08.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.634+0000 7f61ee46e740 1 -- 172.21.15.19:0/4007121345 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d4e9a59d70 con 0x55d4e9b726e0 2024-09-19T09:03:08.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.635+0000 7f61e9e31640 1 --2- 172.21.15.19:0/4007121345 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d4e9b726e0 0x55d4e9b74b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:08.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.635+0000 7f61e9e31640 1 --2- 172.21.15.19:0/4007121345 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d4e9b726e0 0x55d4e9b74b00 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95609c839e0770a server_cookie=e18367fbee357aa7 in_seq=0 out_seq=0 2024-09-19T09:03:08.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.635+0000 7f61cd7fa640 10 client.17925 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:08.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.635+0000 7f61cd7fa640 1 -- 172.21.15.19:0/4007121345 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d4e9a59d70 con 0x55d4e9b726e0 2024-09-19T09:03:08.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.635+0000 7f61cd7fa640 10 client.17925 handle_command_reply: tid=0 2024-09-19T09:03:08.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.635+0000 7f61ee46e740 1 client.17925 shutdown 2024-09-19T09:03:08.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.635+0000 7f61ee46e740 1 -- 172.21.15.19:0/4007121345 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4e9af7370 msgr2=0x55d4e9afbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:08.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.635+0000 7f61ee46e740 1 --2- 172.21.15.19:0/4007121345 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4e9af7370 0x55d4e9afbc50 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f61dc012d10 tx=0x7f61dc004a40 comp rx=0 tx=0).stop 2024-09-19T09:03:08.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.636+0000 7f61ee46e740 1 -- 172.21.15.19:0/4007121345 shutdown_connections 2024-09-19T09:03:08.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.636+0000 7f61ee46e740 1 --2- 172.21.15.19:0/4007121345 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d4e9b726e0 0x55d4e9b74b00 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:08.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.636+0000 7f61ee46e740 1 --2- 172.21.15.19:0/4007121345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d4e9aedb40 0x55d4e9afb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:08.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.636+0000 7f61ee46e740 1 --2- 172.21.15.19:0/4007121345 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d4e9af7370 0x55d4e9afbc50 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:08.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.636+0000 7f61cd7fa640 0 client.17925 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:08.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.636+0000 7f61ee46e740 1 --2- 172.21.15.19:0/4007121345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d4e9aec5d0 0x55d4e9afb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:08.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.636+0000 7f61ee46e740 1 -- 172.21.15.19:0/4007121345 >> 172.21.15.19:0/4007121345 conn(0x55d4e9ab5310 msgr2=0x55d4e9ae7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:08.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.636+0000 7f61ee46e740 1 -- 172.21.15.19:0/4007121345 shutdown_connections 2024-09-19T09:03:08.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.636+0000 7f61ee46e740 1 -- 172.21.15.19:0/4007121345 wait complete. 2024-09-19T09:03:08.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.636+0000 7f61ee46e740 20 client.17925 trim_cache size 0 max 16384 2024-09-19T09:03:08.641 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:03:08.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.636+0000 7f61ec095640 1 -- 172.21.15.19:0/2931112815 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f61d00a32c0 msgr2=0x7f61d00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:08.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.636+0000 7f61ec095640 1 --2- 172.21.15.19:0/2931112815 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f61d00a32c0 0x7f61d00a5780 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f61dc005fd0 tx=0x7f61dc004ab0 comp rx=0 tx=0).stop 2024-09-19T09:03:08.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.636+0000 7f61ec095640 1 -- 172.21.15.19:0/2931112815 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61e4100310 msgr2=0x7f61e41984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:08.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.636+0000 7f61ec095640 1 --2- 172.21.15.19:0/2931112815 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61e4100310 0x7f61e41984d0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f61e000d770 tx=0x7f61e000dc30 comp rx=0 tx=0).stop 2024-09-19T09:03:08.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.636+0000 7f61ec095640 1 -- 172.21.15.19:0/2931112815 shutdown_connections 2024-09-19T09:03:08.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.636+0000 7f61ec095640 1 --2- 172.21.15.19:0/2931112815 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f61d00a32c0 0x7f61d00a5780 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:08.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.636+0000 7f61ec095640 1 --2- 172.21.15.19:0/2931112815 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61e4106f30 0x7f61e419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:08.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.636+0000 7f61ec095640 1 --2- 172.21.15.19:0/2931112815 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f61e4100cc0 0x7f61e4198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:08.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.636+0000 7f61ec095640 1 --2- 172.21.15.19:0/2931112815 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f61e4100310 0x7f61e41984d0 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:08.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.636+0000 7f61ec095640 1 -- 172.21.15.19:0/2931112815 >> 172.21.15.19:0/2931112815 conn(0x7f61e4077210 msgr2=0x7f61e4105810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:08.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.636+0000 7f61ec095640 1 -- 172.21.15.19:0/2931112815 shutdown_connections 2024-09-19T09:03:08.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:08.636+0000 7f61ec095640 1 -- 172.21.15.19:0/2931112815 wait complete. 2024-09-19T09:03:10.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:09 smithi019 ceph-mon[30976]: pgmap v667: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 43 op/s 2024-09-19T09:03:10.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:09 smithi155 ceph-mon[34921]: pgmap v667: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 43 op/s 2024-09-19T09:03:10.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:09 smithi203 ceph-mon[35450]: pgmap v667: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 KiB/s wr, 43 op/s 2024-09-19T09:03:10.384 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:03:10.384 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:03:10.652 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:11.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.177+0000 7f9f3c28b640 1 -- 172.21.15.19:0/789041584 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f341036e0 msgr2=0x7f9f34107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:11.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.177+0000 7f9f3c28b640 1 --2- 172.21.15.19:0/789041584 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f341036e0 0x7f9f34107b90 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f9f24009930 tx=0x7f9f2402a420 comp rx=0 tx=0).stop 2024-09-19T09:03:11.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.177+0000 7f9f3c28b640 1 -- 172.21.15.19:0/789041584 shutdown_connections 2024-09-19T09:03:11.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.177+0000 7f9f3c28b640 1 --2- 172.21.15.19:0/789041584 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f341082a0 0x7f9f3410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:11.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.177+0000 7f9f3c28b640 1 --2- 172.21.15.19:0/789041584 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f341036e0 0x7f9f34107b90 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:11.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.177+0000 7f9f3c28b640 1 --2- 172.21.15.19:0/789041584 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f34102d30 0x7f9f34103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:11.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.177+0000 7f9f3c28b640 1 -- 172.21.15.19:0/789041584 >> 172.21.15.19:0/789041584 conn(0x7f9f340fc7d0 msgr2=0x7f9f340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:11.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.177+0000 7f9f3c28b640 1 -- 172.21.15.19:0/789041584 shutdown_connections 2024-09-19T09:03:11.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.177+0000 7f9f3c28b640 1 -- 172.21.15.19:0/789041584 wait complete. 2024-09-19T09:03:11.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.178+0000 7f9f3c28b640 1 Processor -- start 2024-09-19T09:03:11.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.178+0000 7f9f3c28b640 1 -- start start 2024-09-19T09:03:11.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.178+0000 7f9f3c28b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f34102d30 0x7f9f34100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:11.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.178+0000 7f9f3c28b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f341036e0 0x7f9f34100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:11.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.178+0000 7f9f3c28b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f341082a0 0x7f9f34101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:11.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.178+0000 7f9f3c28b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9f34112090 con 0x7f9f34102d30 2024-09-19T09:03:11.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.178+0000 7f9f3c28b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9f34111f10 con 0x7f9f341082a0 2024-09-19T09:03:11.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.178+0000 7f9f3c28b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9f34112210 con 0x7f9f341036e0 2024-09-19T09:03:11.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.178+0000 7f9f3a027640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f34102d30 0x7f9f34100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:11.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.178+0000 7f9f3a027640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f34102d30 0x7f9f34100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49238/0 (socket says 172.21.15.19:49238) 2024-09-19T09:03:11.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.178+0000 7f9f3a027640 1 -- 172.21.15.19:0/1080509579 learned_addr learned my addr 172.21.15.19:0/1080509579 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:11.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.179+0000 7f9f3a828640 1 --2- 172.21.15.19:0/1080509579 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f341082a0 0x7f9f34101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:11.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.179+0000 7f9f39826640 1 --2- 172.21.15.19:0/1080509579 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f341036e0 0x7f9f34100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:11.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.179+0000 7f9f3a027640 1 -- 172.21.15.19:0/1080509579 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f341036e0 msgr2=0x7f9f34100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:11.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.179+0000 7f9f3a027640 1 --2- 172.21.15.19:0/1080509579 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f341036e0 0x7f9f34100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:11.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.179+0000 7f9f3a027640 1 -- 172.21.15.19:0/1080509579 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f341082a0 msgr2=0x7f9f34101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:11.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.179+0000 7f9f3a027640 1 --2- 172.21.15.19:0/1080509579 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f341082a0 0x7f9f34101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:11.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.179+0000 7f9f3a027640 1 -- 172.21.15.19:0/1080509579 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f341a6a50 con 0x7f9f34102d30 2024-09-19T09:03:11.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.179+0000 7f9f3a027640 1 --2- 172.21.15.19:0/1080509579 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f34102d30 0x7f9f34100990 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f9f3000d950 tx=0x7f9f3000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:11.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.179+0000 7f9f2b7fe640 1 -- 172.21.15.19:0/1080509579 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f30017030 con 0x7f9f34102d30 2024-09-19T09:03:11.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.179+0000 7f9f2b7fe640 1 -- 172.21.15.19:0/1080509579 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f30004020 con 0x7f9f34102d30 2024-09-19T09:03:11.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.179+0000 7f9f2b7fe640 1 -- 172.21.15.19:0/1080509579 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f300047a0 con 0x7f9f34102d30 2024-09-19T09:03:11.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.179+0000 7f9f3c28b640 1 -- 172.21.15.19:0/1080509579 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f341a6d40 con 0x7f9f34102d30 2024-09-19T09:03:11.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.179+0000 7f9f3c28b640 1 -- 172.21.15.19:0/1080509579 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f341a7240 con 0x7f9f34102d30 2024-09-19T09:03:11.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.182+0000 7f9f2b7fe640 1 -- 172.21.15.19:0/1080509579 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f9f300041d0 con 0x7f9f34102d30 2024-09-19T09:03:11.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.182+0000 7f9f3e664740 1 Processor -- start 2024-09-19T09:03:11.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.182+0000 7f9f3e664740 1 -- start start 2024-09-19T09:03:11.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.183+0000 7f9f3e664740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c26626ab60 0x55c26626af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:11.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.183+0000 7f9f3e664740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c26626b480 0x55c266275800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:11.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.183+0000 7f9f3e664740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c266275d40 0x55c266278130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:11.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.183+0000 7f9f3e664740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c2661d0280 con 0x55c26626b480 2024-09-19T09:03:11.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.183+0000 7f9f3e664740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55c266177b10 con 0x55c26626ab60 2024-09-19T09:03:11.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.183+0000 7f9f3e664740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c2661cc240 con 0x55c266275d40 2024-09-19T09:03:11.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.183+0000 7f9f3a027640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c26626b480 0x55c266275800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:11.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.183+0000 7f9f3a027640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c26626b480 0x55c266275800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49244/0 (socket says 172.21.15.19:49244) 2024-09-19T09:03:11.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.183+0000 7f9f3a027640 1 -- 172.21.15.19:0/3194839600 learned_addr learned my addr 172.21.15.19:0/3194839600 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:11.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.183+0000 7f9f39826640 1 --2- 172.21.15.19:0/3194839600 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c266275d40 0x55c266278130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:11.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.183+0000 7f9f3a828640 1 --2- 172.21.15.19:0/3194839600 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c26626ab60 0x55c26626af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:11.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.183+0000 7f9f2b7fe640 1 --2- 172.21.15.19:0/1080509579 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9f200a32c0 0x7f9f200a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:11.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.183+0000 7f9f3a027640 1 -- 172.21.15.19:0/3194839600 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c266275d40 msgr2=0x55c266278130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:11.188 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.183+0000 7f9f3a828640 1 --2- 172.21.15.19:0/1080509579 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9f200a32c0 0x7f9f200a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:11.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.183+0000 7f9f3a027640 1 --2- 172.21.15.19:0/3194839600 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c266275d40 0x55c266278130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:11.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.183+0000 7f9f3a027640 1 -- 172.21.15.19:0/3194839600 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c26626ab60 msgr2=0x55c26626af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:11.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.183+0000 7f9f3a027640 1 --2- 172.21.15.19:0/3194839600 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c26626ab60 0x55c26626af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:11.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.184+0000 7f9f2b7fe640 1 -- 172.21.15.19:0/1080509579 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f9f300cf260 con 0x7f9f34102d30 2024-09-19T09:03:11.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.184+0000 7f9f3a027640 1 -- 172.21.15.19:0/3194839600 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2661841f0 con 0x55c26626b480 2024-09-19T09:03:11.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.184+0000 7f9f39826640 1 --2- 172.21.15.19:0/3194839600 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c266275d40 0x55c266278130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:11.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.184+0000 7f9f3a027640 1 --2- 172.21.15.19:0/3194839600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c26626b480 0x55c266275800 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f9f300d2fd0 tx=0x7f9f30050ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43ce198210a231ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:11.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.184+0000 7f9f3a828640 1 --2- 172.21.15.19:0/1080509579 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9f200a32c0 0x7f9f200a5780 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c009fd0 tx=0x7f9f2c004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:11.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.184+0000 7f9f28dea640 1 -- 172.21.15.19:0/3194839600 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f3009b660 con 0x55c26626b480 2024-09-19T09:03:11.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.184+0000 7f9f28dea640 1 -- 172.21.15.19:0/3194839600 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f3009bf90 con 0x55c26626b480 2024-09-19T09:03:11.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.184+0000 7f9f28dea640 1 -- 172.21.15.19:0/3194839600 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f3009b1f0 con 0x55c26626b480 2024-09-19T09:03:11.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.185+0000 7f9f3e664740 1 -- 172.21.15.19:0/3194839600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c26626b480 msgr2=0x55c266275800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:11.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.185+0000 7f9f3e664740 1 --2- 172.21.15.19:0/3194839600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c26626b480 0x55c266275800 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f9f300d2fd0 tx=0x7f9f30050ba0 comp rx=0 tx=0).stop 2024-09-19T09:03:11.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.185+0000 7f9f3e664740 1 -- 172.21.15.19:0/3194839600 shutdown_connections 2024-09-19T09:03:11.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.185+0000 7f9f3e664740 1 --2- 172.21.15.19:0/3194839600 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c266275d40 0x55c266278130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:11.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.185+0000 7f9f3e664740 1 --2- 172.21.15.19:0/3194839600 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c26626b480 0x55c266275800 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:11.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.185+0000 7f9f3e664740 1 --2- 172.21.15.19:0/3194839600 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c26626ab60 0x55c26626af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:11.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.185+0000 7f9f3e664740 1 -- 172.21.15.19:0/3194839600 >> 172.21.15.19:0/3194839600 conn(0x55c2662670f0 msgr2=0x55c2662674d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:11.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.185+0000 7f9f3e664740 1 -- 172.21.15.19:0/3194839600 shutdown_connections 2024-09-19T09:03:11.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.185+0000 7f9f3e664740 1 -- 172.21.15.19:0/3194839600 wait complete. 2024-09-19T09:03:11.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.185+0000 7f9f3e664740 1 -- start start 2024-09-19T09:03:11.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.185+0000 7f9f3e664740 1 Processor -- start 2024-09-19T09:03:11.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.186+0000 7f9f3e664740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c26626ab60 0x55c266272c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:11.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.186+0000 7f9f3e664740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c26626b480 0x55c266273190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:11.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.186+0000 7f9f3e664740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c266275d40 0x55c2662736d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:11.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.186+0000 7f9f3e664740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c266278910 con 0x55c266275d40 2024-09-19T09:03:11.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.186+0000 7f9f3e664740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55c26618af10 con 0x55c26626ab60 2024-09-19T09:03:11.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.186+0000 7f9f3e664740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c266278a90 con 0x55c26626b480 2024-09-19T09:03:11.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.186+0000 7f9f3e664740 10 client.0 _ll_register_callbacks cb 0x55c266153a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:11.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.186+0000 7f9f3a828640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c266275d40 0x55c2662736d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:11.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.186+0000 7f9f3a828640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c266275d40 0x55c2662736d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49248/0 (socket says 172.21.15.19:49248) 2024-09-19T09:03:11.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.186+0000 7f9f3a828640 1 -- 172.21.15.19:0/2689051566 learned_addr learned my addr 172.21.15.19:0/2689051566 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:11.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.186+0000 7f9f39826640 1 --2- 172.21.15.19:0/2689051566 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c26626b480 0x55c266273190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:11.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.186+0000 7f9f3a027640 1 --2- 172.21.15.19:0/2689051566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c26626ab60 0x55c266272c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:11.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.186+0000 7f9f3a828640 1 -- 172.21.15.19:0/2689051566 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c26626b480 msgr2=0x55c266273190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:11.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.186+0000 7f9f3a828640 1 --2- 172.21.15.19:0/2689051566 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c26626b480 0x55c266273190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:11.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.186+0000 7f9f3a828640 1 -- 172.21.15.19:0/2689051566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c26626ab60 msgr2=0x55c266272c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:11.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.186+0000 7f9f3a828640 1 --2- 172.21.15.19:0/2689051566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c26626ab60 0x55c266272c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:11.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.186+0000 7f9f3a828640 1 -- 172.21.15.19:0/2689051566 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c265f416a0 con 0x55c266275d40 2024-09-19T09:03:11.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.186+0000 7f9f3a828640 1 --2- 172.21.15.19:0/2689051566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c266275d40 0x55c2662736d0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c00fab0 tx=0x7f9f2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cab48e79fd1cfdae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:11.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.186+0000 7f9f1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:11.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.187+0000 7f9f1dffb640 1 -- 172.21.15.19:0/2689051566 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c025070 con 0x55c266275d40 2024-09-19T09:03:11.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.187+0000 7f9f1dffb640 1 -- 172.21.15.19:0/2689051566 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f9f2c02a460 con 0x55c266275d40 2024-09-19T09:03:11.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.187+0000 7f9f3e664740 1 -- 172.21.15.19:0/2689051566 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f3009bf90 con 0x55c266275d40 2024-09-19T09:03:11.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.187+0000 7f9f1dffb640 1 -- 172.21.15.19:0/2689051566 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f9f2c02a660 con 0x55c266275d40 2024-09-19T09:03:11.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.187+0000 7f9f3e664740 10 client.17937 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:11.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.187+0000 7f9f3e664740 1 -- 172.21.15.19:0/2689051566 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55c2662845a0 con 0x55c266275d40 2024-09-19T09:03:11.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.187+0000 7f9f1dffb640 1 -- 172.21.15.19:0/2689051566 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f3009bf90 con 0x55c266275d40 2024-09-19T09:03:11.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.187+0000 7f9f1dffb640 1 -- 172.21.15.19:0/2689051566 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f9f2c0203d0 con 0x55c266275d40 2024-09-19T09:03:11.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.187+0000 7f9f3e664740 10 client.17937 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:11.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.187+0000 7f9f3e664740 10 client.17937 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:11.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.187+0000 7f9f3e664740 20 client.17937 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:11.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.187+0000 7f9f3e664740 1 --2- 172.21.15.19:0/2689051566 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55c266285a60 0x55c266287e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:11.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.187+0000 7f9f3e664740 4 client.17937 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:11.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.187+0000 7f9f3e664740 1 -- 172.21.15.19:0/2689051566 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2661dd7f0 con 0x55c266285a60 2024-09-19T09:03:11.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.188+0000 7f9f3a027640 1 --2- 172.21.15.19:0/2689051566 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55c266285a60 0x55c266287e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:11.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.188+0000 7f9f3a027640 1 --2- 172.21.15.19:0/2689051566 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55c266285a60 0x55c266287e90 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a370303aa71e953f server_cookie=d560fd39cfa14c21 in_seq=0 out_seq=0 2024-09-19T09:03:11.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.188+0000 7f9f1dffb640 10 client.17937 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:11.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.189+0000 7f9f1dffb640 1 -- 172.21.15.19:0/2689051566 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c2661dd7f0 con 0x55c266285a60 2024-09-19T09:03:11.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.189+0000 7f9f1dffb640 10 client.17937 handle_command_reply: tid=0 2024-09-19T09:03:11.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.189+0000 7f9f3e664740 1 client.17937 shutdown 2024-09-19T09:03:11.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.189+0000 7f9f3e664740 1 -- 172.21.15.19:0/2689051566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c266275d40 msgr2=0x55c2662736d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:11.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.189+0000 7f9f3e664740 1 --2- 172.21.15.19:0/2689051566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c266275d40 0x55c2662736d0 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c00fab0 tx=0x7f9f2c004a40 comp rx=0 tx=0).stop 2024-09-19T09:03:11.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.189+0000 7f9f3e664740 1 -- 172.21.15.19:0/2689051566 shutdown_connections 2024-09-19T09:03:11.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.189+0000 7f9f3e664740 1 --2- 172.21.15.19:0/2689051566 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55c266285a60 0x55c266287e90 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:11.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.189+0000 7f9f3e664740 1 --2- 172.21.15.19:0/2689051566 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c26626b480 0x55c266273190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:11.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.189+0000 7f9f1dffb640 0 client.17937 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:11.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.189+0000 7f9f3e664740 1 --2- 172.21.15.19:0/2689051566 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c266275d40 0x55c2662736d0 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:11.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.189+0000 7f9f3e664740 1 --2- 172.21.15.19:0/2689051566 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c26626ab60 0x55c266272c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:11.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.189+0000 7f9f3e664740 1 -- 172.21.15.19:0/2689051566 >> 172.21.15.19:0/2689051566 conn(0x55c2662670f0 msgr2=0x55c26626ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:11.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.189+0000 7f9f3e664740 1 -- 172.21.15.19:0/2689051566 shutdown_connections 2024-09-19T09:03:11.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.189+0000 7f9f3e664740 1 -- 172.21.15.19:0/2689051566 wait complete. 2024-09-19T09:03:11.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.189+0000 7f9f3e664740 20 client.17937 trim_cache size 0 max 16384 2024-09-19T09:03:11.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.206+0000 7f9f3e664740 1 Processor -- start 2024-09-19T09:03:11.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.206+0000 7f9f3e664740 1 -- start start 2024-09-19T09:03:11.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.207+0000 7f9f3e664740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c26626ab60 0x55c26628d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:11.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.207+0000 7f9f3e664740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c26626b480 0x55c26628dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:11.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.207+0000 7f9f3e664740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c266275d40 0x55c26626feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:11.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.207+0000 7f9f3e664740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9f341af7f0 con 0x55c266275d40 2024-09-19T09:03:11.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.207+0000 7f9f3e664740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9f341b1330 con 0x55c26626ab60 2024-09-19T09:03:11.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.207+0000 7f9f3e664740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9f341afec0 con 0x55c26626b480 2024-09-19T09:03:11.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.207+0000 7f9f3a828640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c266275d40 0x55c26626feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:11.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.207+0000 7f9f3a828640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c266275d40 0x55c26626feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49256/0 (socket says 172.21.15.19:49256) 2024-09-19T09:03:11.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.207+0000 7f9f3a828640 1 -- 172.21.15.19:0/3515970614 learned_addr learned my addr 172.21.15.19:0/3515970614 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:11.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.207+0000 7f9f39826640 1 --2- 172.21.15.19:0/3515970614 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c26626b480 0x55c26628dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:11.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.207+0000 7f9f3a027640 1 --2- 172.21.15.19:0/3515970614 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c26626ab60 0x55c26628d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:11.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.207+0000 7f9f3a828640 1 -- 172.21.15.19:0/3515970614 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c26626b480 msgr2=0x55c26628dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:11.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.207+0000 7f9f3a828640 1 --2- 172.21.15.19:0/3515970614 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c26626b480 0x55c26628dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:11.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.207+0000 7f9f3a828640 1 -- 172.21.15.19:0/3515970614 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c26626ab60 msgr2=0x55c26628d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:11.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.207+0000 7f9f3a828640 1 --2- 172.21.15.19:0/3515970614 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c26626ab60 0x55c26628d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:11.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.207+0000 7f9f3a828640 1 -- 172.21.15.19:0/3515970614 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c266266f20 con 0x55c266275d40 2024-09-19T09:03:11.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.207+0000 7f9f3a027640 1 --2- 172.21.15.19:0/3515970614 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c26626ab60 0x55c26628d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:11.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.207+0000 7f9f3a828640 1 --2- 172.21.15.19:0/3515970614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c266275d40 0x55c26626feb0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c013690 tx=0x7f9f2c0137e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5c3d34cdfbe94f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:11.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.207+0000 7f9f1ffff640 1 -- 172.21.15.19:0/3515970614 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c025070 con 0x55c266275d40 2024-09-19T09:03:11.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.207+0000 7f9f1ffff640 1 -- 172.21.15.19:0/3515970614 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f2c010800 con 0x55c266275d40 2024-09-19T09:03:11.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.207+0000 7f9f1ffff640 1 -- 172.21.15.19:0/3515970614 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c003c60 con 0x55c266275d40 2024-09-19T09:03:11.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.208+0000 7f9f3e664740 1 -- 172.21.15.19:0/3515970614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c266275d40 msgr2=0x55c26626feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:11.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.208+0000 7f9f3e664740 1 --2- 172.21.15.19:0/3515970614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c266275d40 0x55c26626feb0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c013690 tx=0x7f9f2c0137e0 comp rx=0 tx=0).stop 2024-09-19T09:03:11.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.208+0000 7f9f3e664740 1 -- 172.21.15.19:0/3515970614 shutdown_connections 2024-09-19T09:03:11.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.208+0000 7f9f3e664740 1 --2- 172.21.15.19:0/3515970614 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c26626b480 0x55c26628dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:11.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.208+0000 7f9f3e664740 1 --2- 172.21.15.19:0/3515970614 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c266275d40 0x55c26626feb0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:11.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.208+0000 7f9f3e664740 1 --2- 172.21.15.19:0/3515970614 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c26626ab60 0x55c26628d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:11.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.208+0000 7f9f3e664740 1 -- 172.21.15.19:0/3515970614 >> 172.21.15.19:0/3515970614 conn(0x55c2662670f0 msgr2=0x55c266274bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:11.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.208+0000 7f9f3e664740 1 -- 172.21.15.19:0/3515970614 shutdown_connections 2024-09-19T09:03:11.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.208+0000 7f9f3e664740 1 -- 172.21.15.19:0/3515970614 wait complete. 2024-09-19T09:03:11.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.208+0000 7f9f3e664740 1 -- start start 2024-09-19T09:03:11.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.208+0000 7f9f3e664740 1 Processor -- start 2024-09-19T09:03:11.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.209+0000 7f9f3e664740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c26626ab60 0x55c26627e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:11.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.209+0000 7f9f3e664740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c26626b480 0x55c26627a500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:11.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.209+0000 7f9f3e664740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c266275d40 0x55c26627aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:11.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.209+0000 7f9f3e664740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9f341b0c60 con 0x55c266275d40 2024-09-19T09:03:11.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.209+0000 7f9f3e664740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9f341b0590 con 0x55c26626b480 2024-09-19T09:03:11.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.209+0000 7f9f3e664740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9f341ad7d0 con 0x55c26626ab60 2024-09-19T09:03:11.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.209+0000 7f9f3e664740 10 client.0 _ll_register_callbacks cb 0x7f9f2c009ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:11.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.209+0000 7f9f3a828640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c266275d40 0x55c26627aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:11.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.209+0000 7f9f3a828640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c266275d40 0x55c26627aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49270/0 (socket says 172.21.15.19:49270) 2024-09-19T09:03:11.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.209+0000 7f9f3a828640 1 -- 172.21.15.19:0/757896023 learned_addr learned my addr 172.21.15.19:0/757896023 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:11.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.209+0000 7f9f39826640 1 --2- 172.21.15.19:0/757896023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c26626b480 0x55c26627a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:11.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.209+0000 7f9f3a027640 1 --2- 172.21.15.19:0/757896023 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c26626ab60 0x55c26627e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:11.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.209+0000 7f9f3a828640 1 -- 172.21.15.19:0/757896023 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c26626ab60 msgr2=0x55c26627e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:11.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.209+0000 7f9f3a828640 1 --2- 172.21.15.19:0/757896023 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c26626ab60 0x55c26627e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:11.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.209+0000 7f9f3a828640 1 -- 172.21.15.19:0/757896023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c26626b480 msgr2=0x55c26627a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:11.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.209+0000 7f9f3a828640 1 --2- 172.21.15.19:0/757896023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c26626b480 0x55c26627a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:11.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.209+0000 7f9f3a828640 1 -- 172.21.15.19:0/757896023 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c26627b000 con 0x55c266275d40 2024-09-19T09:03:11.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.209+0000 7f9f39826640 1 --2- 172.21.15.19:0/757896023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c26626b480 0x55c26627a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:11.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.210+0000 7f9f3a828640 1 --2- 172.21.15.19:0/757896023 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c266275d40 0x55c26627aa40 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c0138f0 tx=0x7f9f2c013450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc26ec13ee11dbae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:11.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.210+0000 7f9f1dffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:11.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.210+0000 7f9f1dffb640 1 -- 172.21.15.19:0/757896023 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f2c025070 con 0x55c266275d40 2024-09-19T09:03:11.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.210+0000 7f9f1dffb640 1 -- 172.21.15.19:0/757896023 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f9f2c020be0 con 0x55c266275d40 2024-09-19T09:03:11.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.210+0000 7f9f3e664740 1 -- 172.21.15.19:0/757896023 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f2c010800 con 0x55c266275d40 2024-09-19T09:03:11.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.210+0000 7f9f1dffb640 1 -- 172.21.15.19:0/757896023 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f9f2c020de0 con 0x55c266275d40 2024-09-19T09:03:11.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.210+0000 7f9f3e664740 10 client.17943 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:11.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.210+0000 7f9f3e664740 1 -- 172.21.15.19:0/757896023 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55c2662f1480 con 0x55c266275d40 2024-09-19T09:03:11.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.210+0000 7f9f1dffb640 1 -- 172.21.15.19:0/757896023 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f2c010800 con 0x55c266275d40 2024-09-19T09:03:11.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.210+0000 7f9f1dffb640 1 -- 172.21.15.19:0/757896023 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f9f2c0218f0 con 0x55c266275d40 2024-09-19T09:03:11.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.210+0000 7f9f3e664740 10 client.17943 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:11.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.210+0000 7f9f3e664740 10 client.17943 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:11.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.210+0000 7f9f3e664740 20 client.17943 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:11.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.210+0000 7f9f3e664740 1 --2- 172.21.15.19:0/757896023 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55c266285a60 0x55c2662f3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:11.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.210+0000 7f9f3e664740 4 client.17943 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:03:11.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.210+0000 7f9f3e664740 1 -- 172.21.15.19:0/757896023 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55c2661d7d00 con 0x55c266285a60 2024-09-19T09:03:11.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.211+0000 7f9f3a027640 1 --2- 172.21.15.19:0/757896023 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55c266285a60 0x55c2662f3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:11.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.211+0000 7f9f3a027640 1 --2- 172.21.15.19:0/757896023 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55c266285a60 0x55c2662f3af0 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93fb34f9d2bba19a server_cookie=52a0ed22bbded079 in_seq=0 out_seq=0 2024-09-19T09:03:11.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.211+0000 7f9f1dffb640 10 client.17943 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:11.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.212+0000 7f9f1dffb640 1 -- 172.21.15.19:0/757896023 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55c2661d7d00 con 0x55c266285a60 2024-09-19T09:03:11.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.212+0000 7f9f1dffb640 10 client.17943 handle_command_reply: tid=0 2024-09-19T09:03:11.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.212+0000 7f9f3e664740 1 client.17943 shutdown 2024-09-19T09:03:11.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.212+0000 7f9f3e664740 1 -- 172.21.15.19:0/757896023 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c266275d40 msgr2=0x55c26627aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:11.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.212+0000 7f9f3e664740 1 --2- 172.21.15.19:0/757896023 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c266275d40 0x55c26627aa40 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c0138f0 tx=0x7f9f2c013450 comp rx=0 tx=0).stop 2024-09-19T09:03:11.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.212+0000 7f9f3e664740 1 -- 172.21.15.19:0/757896023 shutdown_connections 2024-09-19T09:03:11.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.212+0000 7f9f3e664740 1 --2- 172.21.15.19:0/757896023 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55c266285a60 0x55c2662f3af0 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:11.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.212+0000 7f9f3e664740 1 --2- 172.21.15.19:0/757896023 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c266275d40 0x55c26627aa40 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:11.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.212+0000 7f9f1dffb640 0 client.17943 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:11.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.212+0000 7f9f3e664740 1 --2- 172.21.15.19:0/757896023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c26626b480 0x55c26627a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:11.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.212+0000 7f9f3e664740 1 --2- 172.21.15.19:0/757896023 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c26626ab60 0x55c26627e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:11.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.212+0000 7f9f3e664740 1 -- 172.21.15.19:0/757896023 >> 172.21.15.19:0/757896023 conn(0x55c2662670f0 msgr2=0x55c266272c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:11.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.212+0000 7f9f3e664740 1 -- 172.21.15.19:0/757896023 shutdown_connections 2024-09-19T09:03:11.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.212+0000 7f9f3e664740 1 -- 172.21.15.19:0/757896023 wait complete. 2024-09-19T09:03:11.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.212+0000 7f9f3e664740 20 client.17943 trim_cache size 0 max 16384 2024-09-19T09:03:11.220 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T09:03:11.220 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-19T09:03:11.220 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "9cacf0f3-5a23-42a5-9d18-a9d466a68cd1", 2024-09-19T09:03:11.220 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-19T09:03:11.220 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T09:03:11.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.213+0000 7f9f3c28b640 1 -- 172.21.15.19:0/1080509579 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9f200a32c0 msgr2=0x7f9f200a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:11.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.213+0000 7f9f3c28b640 1 --2- 172.21.15.19:0/1080509579 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9f200a32c0 0x7f9f200a5780 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c009fd0 tx=0x7f9f2c004ab0 comp rx=0 tx=0).stop 2024-09-19T09:03:11.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.213+0000 7f9f3c28b640 1 -- 172.21.15.19:0/1080509579 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f34102d30 msgr2=0x7f9f34100990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:11.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.213+0000 7f9f3c28b640 1 --2- 172.21.15.19:0/1080509579 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f34102d30 0x7f9f34100990 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f9f3000d950 tx=0x7f9f3000de10 comp rx=0 tx=0).stop 2024-09-19T09:03:11.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.213+0000 7f9f3c28b640 1 -- 172.21.15.19:0/1080509579 shutdown_connections 2024-09-19T09:03:11.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.213+0000 7f9f3c28b640 1 --2- 172.21.15.19:0/1080509579 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9f200a32c0 0x7f9f200a5780 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:11.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.213+0000 7f9f3c28b640 1 --2- 172.21.15.19:0/1080509579 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f341036e0 0x7f9f34100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:11.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.213+0000 7f9f3c28b640 1 --2- 172.21.15.19:0/1080509579 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f341082a0 0x7f9f34101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:11.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.213+0000 7f9f3c28b640 1 --2- 172.21.15.19:0/1080509579 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f34102d30 0x7f9f34100990 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:11.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.213+0000 7f9f3c28b640 1 -- 172.21.15.19:0/1080509579 >> 172.21.15.19:0/1080509579 conn(0x7f9f340fc7d0 msgr2=0x7f9f34105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:11.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.213+0000 7f9f3c28b640 1 -- 172.21.15.19:0/1080509579 shutdown_connections 2024-09-19T09:03:11.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:11.213+0000 7f9f3c28b640 1 -- 172.21.15.19:0/1080509579 wait complete. 2024-09-19T09:03:12.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:11 smithi019 ceph-mon[30976]: pgmap v668: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 40 op/s 2024-09-19T09:03:12.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:11 smithi019 ceph-mon[30976]: scrub queued for path: / 2024-09-19T09:03:12.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:11 smithi019 ceph-mon[30976]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:12.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:11 smithi019 ceph-mon[30976]: scrub summary: active paths [/] 2024-09-19T09:03:12.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:11 smithi019 ceph-mon[30976]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:12.137 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:03:12.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:11 smithi155 ceph-mon[34921]: pgmap v668: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 40 op/s 2024-09-19T09:03:12.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:11 smithi155 ceph-mon[34921]: scrub queued for path: / 2024-09-19T09:03:12.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:11 smithi155 ceph-mon[34921]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:12.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:11 smithi155 ceph-mon[34921]: scrub summary: active paths [/] 2024-09-19T09:03:12.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:11 smithi155 ceph-mon[34921]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:12.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:11 smithi203 ceph-mon[35450]: pgmap v668: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 KiB/s wr, 40 op/s 2024-09-19T09:03:12.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:11 smithi203 ceph-mon[35450]: scrub queued for path: / 2024-09-19T09:03:12.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:11 smithi203 ceph-mon[35450]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:12.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:11 smithi203 ceph-mon[35450]: scrub summary: active paths [/] 2024-09-19T09:03:12.233 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:11 smithi203 ceph-mon[35450]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:12.397 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:12.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.960+0000 7fc81ba14640 1 -- 172.21.15.19:0/1225319392 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc814106f10 msgr2=0x7fc81410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:12.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.960+0000 7fc81ba14640 1 --2- 172.21.15.19:0/1225319392 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc814106f10 0x7fc81410ea90 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fc80c009ca0 tx=0x7fc80c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:03:12.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.960+0000 7fc81ba14640 1 -- 172.21.15.19:0/1225319392 shutdown_connections 2024-09-19T09:03:12.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.960+0000 7fc81ba14640 1 --2- 172.21.15.19:0/1225319392 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc814106f10 0x7fc81410ea90 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:12.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.960+0000 7fc81ba14640 1 --2- 172.21.15.19:0/1225319392 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc814102790 0x7fc8141067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:12.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.960+0000 7fc81ba14640 1 --2- 172.21.15.19:0/1225319392 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc814101de0 0x7fc8141021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:12.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.960+0000 7fc81ba14640 1 -- 172.21.15.19:0/1225319392 >> 172.21.15.19:0/1225319392 conn(0x7fc8140fd8c0 msgr2=0x7fc8140ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:12.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.960+0000 7fc81ba14640 1 -- 172.21.15.19:0/1225319392 shutdown_connections 2024-09-19T09:03:12.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.960+0000 7fc81ba14640 1 -- 172.21.15.19:0/1225319392 wait complete. 2024-09-19T09:03:12.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.961+0000 7fc81ba14640 1 Processor -- start 2024-09-19T09:03:12.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.961+0000 7fc81ba14640 1 -- start start 2024-09-19T09:03:12.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.961+0000 7fc81ba14640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc814101de0 0x7fc81419a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:12.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.961+0000 7fc81ba14640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc814102790 0x7fc81419aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:12.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.961+0000 7fc81ba14640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc814106f10 0x7fc81419ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:12.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.961+0000 7fc81ba14640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc814111f70 con 0x7fc814101de0 2024-09-19T09:03:12.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.961+0000 7fc81ba14640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc814111df0 con 0x7fc814102790 2024-09-19T09:03:12.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.961+0000 7fc81ba14640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc8141120f0 con 0x7fc814106f10 2024-09-19T09:03:12.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.961+0000 7fc8197b0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc814101de0 0x7fc81419a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:12.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.961+0000 7fc8197b0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc814101de0 0x7fc81419a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49298/0 (socket says 172.21.15.19:49298) 2024-09-19T09:03:12.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.961+0000 7fc8197b0640 1 -- 172.21.15.19:0/1443804100 learned_addr learned my addr 172.21.15.19:0/1443804100 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:12.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.962+0000 7fc819fb1640 1 --2- 172.21.15.19:0/1443804100 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc814106f10 0x7fc81419ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:12.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.962+0000 7fc818faf640 1 --2- 172.21.15.19:0/1443804100 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc814102790 0x7fc81419aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:12.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.962+0000 7fc8197b0640 1 -- 172.21.15.19:0/1443804100 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc814106f10 msgr2=0x7fc81419ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:12.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.962+0000 7fc8197b0640 1 --2- 172.21.15.19:0/1443804100 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc814106f10 0x7fc81419ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:12.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.962+0000 7fc8197b0640 1 -- 172.21.15.19:0/1443804100 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc814102790 msgr2=0x7fc81419aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:12.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.962+0000 7fc8197b0640 1 --2- 172.21.15.19:0/1443804100 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc814102790 0x7fc81419aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:12.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.962+0000 7fc8197b0640 1 -- 172.21.15.19:0/1443804100 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc81419f500 con 0x7fc814101de0 2024-09-19T09:03:12.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.962+0000 7fc818faf640 1 --2- 172.21.15.19:0/1443804100 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc814102790 0x7fc81419aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:12.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.962+0000 7fc8197b0640 1 --2- 172.21.15.19:0/1443804100 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc814101de0 0x7fc81419a550 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fc81000d770 tx=0x7fc81000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:12.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.962+0000 7fc80a7fc640 1 -- 172.21.15.19:0/1443804100 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc810017070 con 0x7fc814101de0 2024-09-19T09:03:12.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.962+0000 7fc80a7fc640 1 -- 172.21.15.19:0/1443804100 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc810005500 con 0x7fc814101de0 2024-09-19T09:03:12.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.962+0000 7fc81ba14640 1 -- 172.21.15.19:0/1443804100 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc81419f7f0 con 0x7fc814101de0 2024-09-19T09:03:12.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.962+0000 7fc80a7fc640 1 -- 172.21.15.19:0/1443804100 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc810004e00 con 0x7fc814101de0 2024-09-19T09:03:12.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.962+0000 7fc81ba14640 1 -- 172.21.15.19:0/1443804100 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8141a70d0 con 0x7fc814101de0 2024-09-19T09:03:12.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.965+0000 7fc81dded740 1 Processor -- start 2024-09-19T09:03:12.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.965+0000 7fc81dded740 1 -- start start 2024-09-19T09:03:12.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.965+0000 7fc80a7fc640 1 -- 172.21.15.19:0/1443804100 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fc810004fa0 con 0x7fc814101de0 2024-09-19T09:03:12.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.966+0000 7fc81dded740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e01e17f4a0 0x55e01e17f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:12.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.966+0000 7fc81dded740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e01e17fdc0 0x55e01e18a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:12.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.966+0000 7fc81dded740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e01e18a680 0x55e01e18ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:12.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.966+0000 7fc81dded740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e01e0e52e0 con 0x55e01e17f4a0 2024-09-19T09:03:12.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.966+0000 7fc81dded740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55e01e08cce0 con 0x55e01e17fdc0 2024-09-19T09:03:12.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.966+0000 7fc81dded740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e01e0e12a0 con 0x55e01e18a680 2024-09-19T09:03:12.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.966+0000 7fc819fb1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e01e17f4a0 0x55e01e17f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:12.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.966+0000 7fc819fb1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e01e17f4a0 0x55e01e17f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49302/0 (socket says 172.21.15.19:49302) 2024-09-19T09:03:12.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.966+0000 7fc819fb1640 1 -- 172.21.15.19:0/2981742178 learned_addr learned my addr 172.21.15.19:0/2981742178 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:12.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.966+0000 7fc818faf640 1 --2- 172.21.15.19:0/2981742178 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e01e18a680 0x55e01e18ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:12.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.966+0000 7fc8197b0640 1 --2- 172.21.15.19:0/2981742178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e01e17fdc0 0x55e01e18a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:12.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.966+0000 7fc819fb1640 1 -- 172.21.15.19:0/2981742178 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e01e18a680 msgr2=0x55e01e18ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:12.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.966+0000 7fc819fb1640 1 --2- 172.21.15.19:0/2981742178 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e01e18a680 0x55e01e18ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:12.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.966+0000 7fc819fb1640 1 -- 172.21.15.19:0/2981742178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e01e17fdc0 msgr2=0x55e01e18a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:12.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.966+0000 7fc819fb1640 1 --2- 172.21.15.19:0/2981742178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e01e17fdc0 0x55e01e18a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:12.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.966+0000 7fc819fb1640 1 -- 172.21.15.19:0/2981742178 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e01e071440 con 0x55e01e17f4a0 2024-09-19T09:03:12.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.966+0000 7fc80a7fc640 1 --2- 172.21.15.19:0/1443804100 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc8000a32c0 0x7fc8000a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:12.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.966+0000 7fc819fb1640 1 --2- 172.21.15.19:0/2981742178 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e01e17f4a0 0x55e01e17f880 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fc80c005cc0 tx=0x7fc80c009930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa65d6cf5e5f0275 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:12.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.966+0000 7fc8197b0640 1 --2- 172.21.15.19:0/1443804100 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc8000a32c0 0x7fc8000a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:12.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.967+0000 7fc80a7fc640 1 -- 172.21.15.19:0/1443804100 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7fc8100cf3e0 con 0x7fc814101de0 2024-09-19T09:03:12.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.967+0000 7fc7ff7fe640 1 -- 172.21.15.19:0/2981742178 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80c003970 con 0x55e01e17f4a0 2024-09-19T09:03:12.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.967+0000 7fc7ff7fe640 1 -- 172.21.15.19:0/2981742178 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc80c036050 con 0x55e01e17f4a0 2024-09-19T09:03:12.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.967+0000 7fc7ff7fe640 1 -- 172.21.15.19:0/2981742178 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80c004400 con 0x55e01e17f4a0 2024-09-19T09:03:12.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.967+0000 7fc8197b0640 1 --2- 172.21.15.19:0/1443804100 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc8000a32c0 0x7fc8000a5780 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc810097e10 tx=0x7fc810086040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:12.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.967+0000 7fc81dded740 1 -- 172.21.15.19:0/2981742178 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e01e17f4a0 msgr2=0x55e01e17f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:12.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.967+0000 7fc81dded740 1 --2- 172.21.15.19:0/2981742178 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e01e17f4a0 0x55e01e17f880 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fc80c005cc0 tx=0x7fc80c009930 comp rx=0 tx=0).stop 2024-09-19T09:03:12.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.968+0000 7fc81dded740 1 -- 172.21.15.19:0/2981742178 shutdown_connections 2024-09-19T09:03:12.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.968+0000 7fc81dded740 1 --2- 172.21.15.19:0/2981742178 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e01e18a680 0x55e01e18ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:12.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.968+0000 7fc81dded740 1 --2- 172.21.15.19:0/2981742178 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e01e17fdc0 0x55e01e18a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:12.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.968+0000 7fc81dded740 1 --2- 172.21.15.19:0/2981742178 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e01e17f4a0 0x55e01e17f880 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:12.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.968+0000 7fc81dded740 1 -- 172.21.15.19:0/2981742178 >> 172.21.15.19:0/2981742178 conn(0x55e01e17ba30 msgr2=0x55e01e17be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:12.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.968+0000 7fc81dded740 1 -- 172.21.15.19:0/2981742178 shutdown_connections 2024-09-19T09:03:12.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.968+0000 7fc81dded740 1 -- 172.21.15.19:0/2981742178 wait complete. 2024-09-19T09:03:12.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.968+0000 7fc81dded740 1 -- start start 2024-09-19T09:03:12.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.968+0000 7fc81dded740 1 Processor -- start 2024-09-19T09:03:12.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.969+0000 7fc81dded740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e01e17f4a0 0x55e01e189f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:12.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.969+0000 7fc81dded740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e01e17fdc0 0x55e01e1871f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:12.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.969+0000 7fc81dded740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e01e18a680 0x55e01e187730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:12.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.969+0000 7fc81dded740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e01e18d0d0 con 0x55e01e18a680 2024-09-19T09:03:12.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.969+0000 7fc81dded740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55e01e0a0050 con 0x55e01e17f4a0 2024-09-19T09:03:12.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.969+0000 7fc81dded740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e01e18d250 con 0x55e01e17fdc0 2024-09-19T09:03:12.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.969+0000 7fc81dded740 10 client.0 _ll_register_callbacks cb 0x55e01e0e0160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:12.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.969+0000 7fc819fb1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e01e18a680 0x55e01e187730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:12.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.969+0000 7fc819fb1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e01e18a680 0x55e01e187730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49308/0 (socket says 172.21.15.19:49308) 2024-09-19T09:03:12.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.969+0000 7fc819fb1640 1 -- 172.21.15.19:0/2239710025 learned_addr learned my addr 172.21.15.19:0/2239710025 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:12.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.969+0000 7fc818faf640 1 --2- 172.21.15.19:0/2239710025 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e01e17fdc0 0x55e01e1871f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:12.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.969+0000 7fc819fb1640 1 --2- 172.21.15.19:0/2239710025 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e01e17f4a0 0x55e01e189f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:12.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.969+0000 7fc819fb1640 1 -- 172.21.15.19:0/2239710025 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e01e17fdc0 msgr2=0x55e01e1871f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:12.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.969+0000 7fc819fb1640 1 --2- 172.21.15.19:0/2239710025 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e01e17fdc0 0x55e01e1871f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:12.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.969+0000 7fc819fb1640 1 -- 172.21.15.19:0/2239710025 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e01e17f4a0 msgr2=0x55e01e189f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:12.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.969+0000 7fc819fb1640 1 --2- 172.21.15.19:0/2239710025 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e01e17f4a0 0x55e01e189f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:12.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.969+0000 7fc819fb1640 1 -- 172.21.15.19:0/2239710025 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e01de563c0 con 0x55e01e18a680 2024-09-19T09:03:12.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.969+0000 7fc819fb1640 1 --2- 172.21.15.19:0/2239710025 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e01e18a680 0x55e01e187730 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fc80c009bf0 tx=0x7fc80c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17769292757c833 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:12.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.969+0000 7fc7fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:12.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.970+0000 7fc7fcff9640 1 -- 172.21.15.19:0/2239710025 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80c055060 con 0x55e01e18a680 2024-09-19T09:03:12.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.970+0000 7fc7fcff9640 1 -- 172.21.15.19:0/2239710025 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7fc80c003970 con 0x55e01e18a680 2024-09-19T09:03:12.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.970+0000 7fc81dded740 1 -- 172.21.15.19:0/2239710025 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc80c036050 con 0x55e01e18a680 2024-09-19T09:03:12.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.970+0000 7fc7fcff9640 1 -- 172.21.15.19:0/2239710025 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fc80c003b70 con 0x55e01e18a680 2024-09-19T09:03:12.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.970+0000 7fc81dded740 10 client.17955 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:12.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.970+0000 7fc81dded740 1 -- 172.21.15.19:0/2239710025 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55e01e18d0d0 con 0x55e01e18a680 2024-09-19T09:03:12.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.970+0000 7fc7fcff9640 1 -- 172.21.15.19:0/2239710025 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc80c036050 con 0x55e01e18a680 2024-09-19T09:03:12.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.970+0000 7fc7fcff9640 1 -- 172.21.15.19:0/2239710025 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7fc80c04f040 con 0x55e01e18a680 2024-09-19T09:03:12.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.970+0000 7fc81dded740 10 client.17955 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:12.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.970+0000 7fc81dded740 10 client.17955 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:12.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.970+0000 7fc81dded740 20 client.17955 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:12.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.970+0000 7fc81dded740 1 --2- 172.21.15.19:0/2239710025 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e01e199c60 0x55e01e19c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:12.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.970+0000 7fc81dded740 4 client.17955 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:12.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.970+0000 7fc81dded740 1 -- 172.21.15.19:0/2239710025 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e01e0f2850 con 0x55e01e199c60 2024-09-19T09:03:12.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.971+0000 7fc818faf640 1 --2- 172.21.15.19:0/2239710025 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e01e199c60 0x55e01e19c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:12.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.971+0000 7fc818faf640 1 --2- 172.21.15.19:0/2239710025 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e01e199c60 0x55e01e19c050 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6700dce7b74c0351 server_cookie=4da023dde2a64e65 in_seq=0 out_seq=0 2024-09-19T09:03:12.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.971+0000 7fc7fcff9640 10 client.17955 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:12.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.972+0000 7fc7fcff9640 1 -- 172.21.15.19:0/2239710025 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e01e0f2850 con 0x55e01e199c60 2024-09-19T09:03:12.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.972+0000 7fc7fcff9640 10 client.17955 handle_command_reply: tid=0 2024-09-19T09:03:12.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.972+0000 7fc81dded740 1 client.17955 shutdown 2024-09-19T09:03:12.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.972+0000 7fc81dded740 1 -- 172.21.15.19:0/2239710025 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e01e18a680 msgr2=0x55e01e187730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:12.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.972+0000 7fc81dded740 1 --2- 172.21.15.19:0/2239710025 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e01e18a680 0x55e01e187730 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fc80c009bf0 tx=0x7fc80c004040 comp rx=0 tx=0).stop 2024-09-19T09:03:12.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.972+0000 7fc81dded740 1 -- 172.21.15.19:0/2239710025 shutdown_connections 2024-09-19T09:03:12.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.972+0000 7fc81dded740 1 --2- 172.21.15.19:0/2239710025 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e01e199c60 0x55e01e19c050 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:12.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.972+0000 7fc81dded740 1 --2- 172.21.15.19:0/2239710025 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e01e17fdc0 0x55e01e1871f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:12.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.972+0000 7fc7fcff9640 0 client.17955 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:12.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.972+0000 7fc81dded740 1 --2- 172.21.15.19:0/2239710025 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e01e18a680 0x55e01e187730 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:12.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.972+0000 7fc81dded740 1 --2- 172.21.15.19:0/2239710025 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e01e17f4a0 0x55e01e189f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:12.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.972+0000 7fc81dded740 1 -- 172.21.15.19:0/2239710025 >> 172.21.15.19:0/2239710025 conn(0x55e01e17ba30 msgr2=0x55e01e17ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:12.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.972+0000 7fc81dded740 1 -- 172.21.15.19:0/2239710025 shutdown_connections 2024-09-19T09:03:12.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.972+0000 7fc81dded740 1 -- 172.21.15.19:0/2239710025 wait complete. 2024-09-19T09:03:12.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.972+0000 7fc81dded740 20 client.17955 trim_cache size 0 max 16384 2024-09-19T09:03:12.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.990+0000 7fc81dded740 1 Processor -- start 2024-09-19T09:03:12.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.990+0000 7fc81dded740 1 -- start start 2024-09-19T09:03:12.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.990+0000 7fc81dded740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e01e17ba30 0x55e01e196330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:12.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.990+0000 7fc81dded740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e01e17f4a0 0x55e01e182900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:12.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.990+0000 7fc81dded740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e01e17fdc0 0x55e01e1861d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:12.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.990+0000 7fc81dded740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc8141af5e0 con 0x55e01e17f4a0 2024-09-19T09:03:12.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.990+0000 7fc81dded740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc8141b1120 con 0x55e01e17fdc0 2024-09-19T09:03:12.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.990+0000 7fc81dded740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc8141afcb0 con 0x55e01e17ba30 2024-09-19T09:03:12.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.990+0000 7fc818faf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e01e17f4a0 0x55e01e182900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:12.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.990+0000 7fc818faf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e01e17f4a0 0x55e01e182900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49318/0 (socket says 172.21.15.19:49318) 2024-09-19T09:03:12.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.990+0000 7fc818faf640 1 -- 172.21.15.19:0/3237369628 learned_addr learned my addr 172.21.15.19:0/3237369628 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:12.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.990+0000 7fc819fb1640 1 --2- 172.21.15.19:0/3237369628 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e01e17ba30 0x55e01e196330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:12.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.990+0000 7fc818faf640 1 -- 172.21.15.19:0/3237369628 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e01e17ba30 msgr2=0x55e01e196330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:12.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.990+0000 7fc818faf640 1 --2- 172.21.15.19:0/3237369628 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e01e17ba30 0x55e01e196330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:12.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.990+0000 7fc818faf640 1 -- 172.21.15.19:0/3237369628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e01e17fdc0 msgr2=0x55e01e1861d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:12.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.990+0000 7fc818faf640 1 --2- 172.21.15.19:0/3237369628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e01e17fdc0 0x55e01e1861d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:12.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.990+0000 7fc818faf640 1 -- 172.21.15.19:0/3237369628 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e01e17fbf0 con 0x55e01e17f4a0 2024-09-19T09:03:12.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.990+0000 7fc819fb1640 1 --2- 172.21.15.19:0/3237369628 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e01e17ba30 0x55e01e196330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:12.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.991+0000 7fc818faf640 1 --2- 172.21.15.19:0/3237369628 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e01e17f4a0 0x55e01e182900 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fc80400b340 tx=0x7fc80400bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50d58f39a6072ca2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:12.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.991+0000 7fc7feffd640 1 -- 172.21.15.19:0/3237369628 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc804005220 con 0x55e01e17f4a0 2024-09-19T09:03:12.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.991+0000 7fc7feffd640 1 -- 172.21.15.19:0/3237369628 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc804004c80 con 0x55e01e17f4a0 2024-09-19T09:03:12.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.991+0000 7fc7feffd640 1 -- 172.21.15.19:0/3237369628 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80401b9b0 con 0x55e01e17f4a0 2024-09-19T09:03:12.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.991+0000 7fc81dded740 1 -- 172.21.15.19:0/3237369628 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e01e17f4a0 msgr2=0x55e01e182900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:12.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.991+0000 7fc81dded740 1 --2- 172.21.15.19:0/3237369628 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e01e17f4a0 0x55e01e182900 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fc80400b340 tx=0x7fc80400bf90 comp rx=0 tx=0).stop 2024-09-19T09:03:12.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.991+0000 7fc81dded740 1 -- 172.21.15.19:0/3237369628 shutdown_connections 2024-09-19T09:03:12.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.991+0000 7fc81dded740 1 --2- 172.21.15.19:0/3237369628 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e01e17fdc0 0x55e01e1861d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:12.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.991+0000 7fc81dded740 1 --2- 172.21.15.19:0/3237369628 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e01e17f4a0 0x55e01e182900 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:12.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.991+0000 7fc81dded740 1 --2- 172.21.15.19:0/3237369628 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e01e17ba30 0x55e01e196330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:12.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.991+0000 7fc81dded740 1 -- 172.21.15.19:0/3237369628 >> 172.21.15.19:0/3237369628 conn(0x55e01e187890 msgr2=0x55e01e185ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:12.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.991+0000 7fc81dded740 1 -- 172.21.15.19:0/3237369628 shutdown_connections 2024-09-19T09:03:12.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.992+0000 7fc81dded740 1 -- 172.21.15.19:0/3237369628 wait complete. 2024-09-19T09:03:12.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.992+0000 7fc81dded740 1 -- start start 2024-09-19T09:03:12.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.992+0000 7fc81dded740 1 Processor -- start 2024-09-19T09:03:12.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.992+0000 7fc81dded740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e01e17ba30 0x55e01e192b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:12.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.992+0000 7fc81dded740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e01e17f4a0 0x55e01e18de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:12.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.992+0000 7fc81dded740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e01e17fdc0 0x55e01e18e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:12.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.992+0000 7fc81dded740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc8141b0a50 con 0x55e01e17f4a0 2024-09-19T09:03:12.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.992+0000 7fc81dded740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc8141b0380 con 0x55e01e17fdc0 2024-09-19T09:03:12.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.992+0000 7fc81dded740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc8141ad5c0 con 0x55e01e17ba30 2024-09-19T09:03:12.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.992+0000 7fc81dded740 10 client.0 _ll_register_callbacks cb 0x7fc8100d2cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:12.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.992+0000 7fc818faf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e01e17f4a0 0x55e01e18de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:12.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.992+0000 7fc818faf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e01e17f4a0 0x55e01e18de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49320/0 (socket says 172.21.15.19:49320) 2024-09-19T09:03:13.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.992+0000 7fc818faf640 1 -- 172.21.15.19:0/429740241 learned_addr learned my addr 172.21.15.19:0/429740241 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:13.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.992+0000 7fc819fb1640 1 --2- 172.21.15.19:0/429740241 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e01e17ba30 0x55e01e192b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:13.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.993+0000 7fc819fb1640 1 --2- 172.21.15.19:0/429740241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e01e17fdc0 0x55e01e18e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:13.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.993+0000 7fc818faf640 1 -- 172.21.15.19:0/429740241 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e01e17ba30 msgr2=0x55e01e192b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:13.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.993+0000 7fc818faf640 1 --2- 172.21.15.19:0/429740241 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e01e17ba30 0x55e01e192b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:13.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.993+0000 7fc818faf640 1 -- 172.21.15.19:0/429740241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e01e17fdc0 msgr2=0x55e01e18e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:13.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.993+0000 7fc818faf640 1 --2- 172.21.15.19:0/429740241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e01e17fdc0 0x55e01e18e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:13.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.993+0000 7fc818faf640 1 -- 172.21.15.19:0/429740241 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e01e18ebc0 con 0x55e01e17f4a0 2024-09-19T09:03:13.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.993+0000 7fc819fb1640 1 --2- 172.21.15.19:0/429740241 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e01e17ba30 0x55e01e192b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:13.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.993+0000 7fc818faf640 1 --2- 172.21.15.19:0/429740241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e01e17f4a0 0x55e01e18de80 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fc80401b5d0 tx=0x7fc8040048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a06d522650c9c99 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:13.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.993+0000 7fc7fcff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:13.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.993+0000 7fc7fcff9640 1 -- 172.21.15.19:0/429740241 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc804005430 con 0x55e01e17f4a0 2024-09-19T09:03:13.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.993+0000 7fc7fcff9640 1 -- 172.21.15.19:0/429740241 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7fc8040055d0 con 0x55e01e17f4a0 2024-09-19T09:03:13.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.993+0000 7fc81dded740 1 -- 172.21.15.19:0/429740241 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc804004c80 con 0x55e01e17f4a0 2024-09-19T09:03:13.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.994+0000 7fc7fcff9640 1 -- 172.21.15.19:0/429740241 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fc80401b730 con 0x55e01e17f4a0 2024-09-19T09:03:13.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.994+0000 7fc81dded740 10 client.17961 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:13.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.994+0000 7fc81dded740 1 -- 172.21.15.19:0/429740241 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55e01e204770 con 0x55e01e17f4a0 2024-09-19T09:03:13.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.994+0000 7fc7fcff9640 1 -- 172.21.15.19:0/429740241 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc804004c80 con 0x55e01e17f4a0 2024-09-19T09:03:13.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.994+0000 7fc7fcff9640 1 -- 172.21.15.19:0/429740241 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7fc8040258e0 con 0x55e01e17f4a0 2024-09-19T09:03:13.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.994+0000 7fc81dded740 10 client.17961 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:13.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.994+0000 7fc81dded740 10 client.17961 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:13.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.994+0000 7fc81dded740 20 client.17961 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:13.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.994+0000 7fc81dded740 1 --2- 172.21.15.19:0/429740241 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e01e18a680 0x55e01e206ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:13.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.994+0000 7fc81dded740 4 client.17961 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:03:13.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.994+0000 7fc81dded740 1 -- 172.21.15.19:0/429740241 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e01e0ecd60 con 0x55e01e18a680 2024-09-19T09:03:13.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.994+0000 7fc819fb1640 1 --2- 172.21.15.19:0/429740241 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e01e18a680 0x55e01e206ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:13.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.995+0000 7fc819fb1640 1 --2- 172.21.15.19:0/429740241 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e01e18a680 0x55e01e206ea0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=978429ba6d90e65f server_cookie=84a0678a6b5bdf79 in_seq=0 out_seq=0 2024-09-19T09:03:13.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.995+0000 7fc7fcff9640 10 client.17961 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:13.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.995+0000 7fc7fcff9640 1 -- 172.21.15.19:0/429740241 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55e01e0ecd60 con 0x55e01e18a680 2024-09-19T09:03:13.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.995+0000 7fc7fcff9640 10 client.17961 handle_command_reply: tid=0 2024-09-19T09:03:13.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.995+0000 7fc81dded740 1 client.17961 shutdown 2024-09-19T09:03:13.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.995+0000 7fc81dded740 1 -- 172.21.15.19:0/429740241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e01e17f4a0 msgr2=0x55e01e18de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:13.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.995+0000 7fc81dded740 1 --2- 172.21.15.19:0/429740241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e01e17f4a0 0x55e01e18de80 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fc80401b5d0 tx=0x7fc8040048f0 comp rx=0 tx=0).stop 2024-09-19T09:03:13.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.995+0000 7fc81dded740 1 -- 172.21.15.19:0/429740241 shutdown_connections 2024-09-19T09:03:13.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.995+0000 7fc81dded740 1 --2- 172.21.15.19:0/429740241 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e01e18a680 0x55e01e206ea0 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:13.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.995+0000 7fc81dded740 1 --2- 172.21.15.19:0/429740241 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e01e17fdc0 0x55e01e18e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:13.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.995+0000 7fc81dded740 1 --2- 172.21.15.19:0/429740241 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e01e17f4a0 0x55e01e18de80 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:13.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.995+0000 7fc7fcff9640 0 client.17961 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:13.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.995+0000 7fc81dded740 1 --2- 172.21.15.19:0/429740241 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e01e17ba30 0x55e01e192b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:13.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.995+0000 7fc81dded740 1 -- 172.21.15.19:0/429740241 >> 172.21.15.19:0/429740241 conn(0x55e01e187890 msgr2=0x55e01e1826d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:13.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.995+0000 7fc81dded740 1 -- 172.21.15.19:0/429740241 shutdown_connections 2024-09-19T09:03:13.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.995+0000 7fc81dded740 1 -- 172.21.15.19:0/429740241 wait complete. 2024-09-19T09:03:13.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.995+0000 7fc81dded740 20 client.17961 trim_cache size 0 max 16384 2024-09-19T09:03:13.003 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T09:03:13.003 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-19T09:03:13.003 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {} 2024-09-19T09:03:13.003 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T09:03:13.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.996+0000 7fc81ba14640 1 -- 172.21.15.19:0/1443804100 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc8000a32c0 msgr2=0x7fc8000a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:13.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.996+0000 7fc81ba14640 1 --2- 172.21.15.19:0/1443804100 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc8000a32c0 0x7fc8000a5780 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc810097e10 tx=0x7fc810086040 comp rx=0 tx=0).stop 2024-09-19T09:03:13.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.996+0000 7fc81ba14640 1 -- 172.21.15.19:0/1443804100 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc814101de0 msgr2=0x7fc81419a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:13.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.996+0000 7fc81ba14640 1 --2- 172.21.15.19:0/1443804100 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc814101de0 0x7fc81419a550 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fc81000d770 tx=0x7fc81000dc30 comp rx=0 tx=0).stop 2024-09-19T09:03:13.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.996+0000 7fc81ba14640 1 -- 172.21.15.19:0/1443804100 shutdown_connections 2024-09-19T09:03:13.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.996+0000 7fc81ba14640 1 --2- 172.21.15.19:0/1443804100 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc8000a32c0 0x7fc8000a5780 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:13.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.996+0000 7fc81ba14640 1 --2- 172.21.15.19:0/1443804100 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc814106f10 0x7fc81419ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:13.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.996+0000 7fc81ba14640 1 --2- 172.21.15.19:0/1443804100 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc814102790 0x7fc81419aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:13.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.996+0000 7fc81ba14640 1 --2- 172.21.15.19:0/1443804100 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc814101de0 0x7fc81419a550 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:13.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.996+0000 7fc81ba14640 1 -- 172.21.15.19:0/1443804100 >> 172.21.15.19:0/1443804100 conn(0x7fc8140fd8c0 msgr2=0x7fc8140fe550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:13.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.996+0000 7fc81ba14640 1 -- 172.21.15.19:0/1443804100 shutdown_connections 2024-09-19T09:03:13.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:12.996+0000 7fc81ba14640 1 -- 172.21.15.19:0/1443804100 wait complete. 2024-09-19T09:03:13.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:12 smithi019 ceph-mon[30976]: scrub summary: idle 2024-09-19T09:03:13.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:12 smithi155 ceph-mon[34921]: scrub summary: idle 2024-09-19T09:03:13.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:12 smithi203 ceph-mon[35450]: scrub summary: idle 2024-09-19T09:03:13.877 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:03:13.877 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:03:14.140 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:14.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:13 smithi155 ceph-mon[34921]: pgmap v669: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 39 op/s 2024-09-19T09:03:14.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:13 smithi203 ceph-mon[35450]: pgmap v669: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 39 op/s 2024-09-19T09:03:14.262 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:13 smithi019 ceph-mon[30976]: pgmap v669: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 11 KiB/s wr, 39 op/s 2024-09-19T09:03:14.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.630+0000 7f82cd0ca640 1 -- 172.21.15.19:0/2078017998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82c8101de0 msgr2=0x7f82c81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:14.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.630+0000 7f82cd0ca640 1 --2- 172.21.15.19:0/2078017998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82c8101de0 0x7f82c81021c0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f82b8009900 tx=0x7f82b802a410 comp rx=0 tx=0).stop 2024-09-19T09:03:14.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.630+0000 7f82cd0ca640 1 -- 172.21.15.19:0/2078017998 shutdown_connections 2024-09-19T09:03:14.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.630+0000 7f82cd0ca640 1 --2- 172.21.15.19:0/2078017998 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f82c8106f10 0x7f82c810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:14.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.630+0000 7f82cd0ca640 1 --2- 172.21.15.19:0/2078017998 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82c8102790 0x7f82c81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:14.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.630+0000 7f82cd0ca640 1 --2- 172.21.15.19:0/2078017998 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82c8101de0 0x7f82c81021c0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:14.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.630+0000 7f82cd0ca640 1 -- 172.21.15.19:0/2078017998 >> 172.21.15.19:0/2078017998 conn(0x7f82c80fd8c0 msgr2=0x7f82c80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:14.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.630+0000 7f82cd0ca640 1 -- 172.21.15.19:0/2078017998 shutdown_connections 2024-09-19T09:03:14.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.630+0000 7f82cd0ca640 1 -- 172.21.15.19:0/2078017998 wait complete. 2024-09-19T09:03:14.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.631+0000 7f82cd0ca640 1 Processor -- start 2024-09-19T09:03:14.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.631+0000 7f82cd0ca640 1 -- start start 2024-09-19T09:03:14.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.631+0000 7f82cd0ca640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82c8101de0 0x7f82c81984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:14.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.631+0000 7f82cd0ca640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f82c8102790 0x7f82c8198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:14.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.631+0000 7f82cd0ca640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82c8106f10 0x7f82c819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:14.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.631+0000 7f82cd0ca640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f82c8111f70 con 0x7f82c8101de0 2024-09-19T09:03:14.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.631+0000 7f82cd0ca640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f82c8111df0 con 0x7f82c8106f10 2024-09-19T09:03:14.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.631+0000 7f82cd0ca640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f82c81120f0 con 0x7f82c8102790 2024-09-19T09:03:14.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.632+0000 7f82c6d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82c8101de0 0x7f82c81984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:14.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.632+0000 7f82c6d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82c8101de0 0x7f82c81984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:49328/0 (socket says 172.21.15.19:49328) 2024-09-19T09:03:14.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.632+0000 7f82c6d9d640 1 -- 172.21.15.19:0/3778613904 learned_addr learned my addr 172.21.15.19:0/3778613904 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:14.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.632+0000 7f82be59c640 1 --2- 172.21.15.19:0/3778613904 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f82c8102790 0x7f82c8198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:14.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.632+0000 7f82c759e640 1 --2- 172.21.15.19:0/3778613904 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82c8106f10 0x7f82c819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:14.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.632+0000 7f82c6d9d640 1 -- 172.21.15.19:0/3778613904 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f82c8102790 msgr2=0x7f82c8198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:14.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.632+0000 7f82c6d9d640 1 --2- 172.21.15.19:0/3778613904 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f82c8102790 0x7f82c8198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:14.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.632+0000 7f82c6d9d640 1 -- 172.21.15.19:0/3778613904 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82c8106f10 msgr2=0x7f82c819cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:14.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.632+0000 7f82c6d9d640 1 --2- 172.21.15.19:0/3778613904 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82c8106f10 0x7f82c819cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:14.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.632+0000 7f82c6d9d640 1 -- 172.21.15.19:0/3778613904 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82c819d480 con 0x7f82c8101de0 2024-09-19T09:03:14.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.632+0000 7f82c6d9d640 1 --2- 172.21.15.19:0/3778613904 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82c8101de0 0x7f82c81984d0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f82b8006010 tx=0x7f82b80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:14.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.632+0000 7f82c4d99640 1 -- 172.21.15.19:0/3778613904 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b803f030 con 0x7f82c8101de0 2024-09-19T09:03:14.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.632+0000 7f82c4d99640 1 -- 172.21.15.19:0/3778613904 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82b8003ce0 con 0x7f82c8101de0 2024-09-19T09:03:14.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.632+0000 7f82cd0ca640 1 -- 172.21.15.19:0/3778613904 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82c819d710 con 0x7f82c8101de0 2024-09-19T09:03:14.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.632+0000 7f82c4d99640 1 -- 172.21.15.19:0/3778613904 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b8035070 con 0x7f82c8101de0 2024-09-19T09:03:14.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.632+0000 7f82cd0ca640 1 -- 172.21.15.19:0/3778613904 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82c81a5050 con 0x7f82c8101de0 2024-09-19T09:03:14.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.633+0000 7f82cd0ca640 1 -- 172.21.15.19:0/3778613904 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82c81032c0 con 0x7f82c8101de0 2024-09-19T09:03:14.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.634+0000 7f82c4d99640 1 -- 172.21.15.19:0/3778613904 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f82b8042030 con 0x7f82c8101de0 2024-09-19T09:03:14.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.635+0000 7f82c4d99640 1 --2- 172.21.15.19:0/3778613904 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f82b40a3240 0x7f82b40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:14.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.635+0000 7f82be59c640 1 --2- 172.21.15.19:0/3778613904 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f82b40a3240 0x7f82b40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:14.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.635+0000 7f82c4d99640 1 -- 172.21.15.19:0/3778613904 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f82b80effc0 con 0x7f82c8101de0 2024-09-19T09:03:14.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.636+0000 7f82be59c640 1 --2- 172.21.15.19:0/3778613904 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f82b40a3240 0x7f82b40a5700 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f82c8108900 tx=0x7f82b000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:14.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.639+0000 7f82c4d99640 1 -- 172.21.15.19:0/3778613904 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f82b80bcdb0 con 0x7f82c8101de0 2024-09-19T09:03:14.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.853+0000 7f82cd0ca640 1 -- 172.21.15.19:0/3778613904 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f82c810a0f0 con 0x7f82c8101de0 2024-09-19T09:03:14.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.854+0000 7f82c4d99640 1 -- 172.21.15.19:0/3778613904 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+11983 (secure 0 0 0) 0x7f82b80bc6b0 con 0x7f82c8101de0 2024-09-19T09:03:14.854 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T09:03:14.854 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":39,"btime":"2024-09-19T09:02:47:631181+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":17751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/3815927080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":3815927080},{"type":"v1","addr":"172.21.15.19:6839","nonce":3815927080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":39,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T09:02:47.631165+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26453":{"gid":26453,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/3907362737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3907362737},{"type":"v1","addr":"172.21.15.155:6835","nonce":3907362737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24469,24490,24464,24463]},"id":1}]} 2024-09-19T09:03:14.854 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 39 2024-09-19T09:03:14.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.856+0000 7f82cd0ca640 1 -- 172.21.15.19:0/3778613904 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f82b40a3240 msgr2=0x7f82b40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:14.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.856+0000 7f82cd0ca640 1 --2- 172.21.15.19:0/3778613904 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f82b40a3240 0x7f82b40a5700 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f82c8108900 tx=0x7f82b000b390 comp rx=0 tx=0).stop 2024-09-19T09:03:14.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.856+0000 7f82cd0ca640 1 -- 172.21.15.19:0/3778613904 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82c8101de0 msgr2=0x7f82c81984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:14.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.856+0000 7f82cd0ca640 1 --2- 172.21.15.19:0/3778613904 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82c8101de0 0x7f82c81984d0 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f82b8006010 tx=0x7f82b80042f0 comp rx=0 tx=0).stop 2024-09-19T09:03:14.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.856+0000 7f82cd0ca640 1 -- 172.21.15.19:0/3778613904 shutdown_connections 2024-09-19T09:03:14.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.856+0000 7f82cd0ca640 1 --2- 172.21.15.19:0/3778613904 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f82b40a3240 0x7f82b40a5700 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:14.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.856+0000 7f82cd0ca640 1 --2- 172.21.15.19:0/3778613904 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f82c8102790 0x7f82c8198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:14.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.856+0000 7f82cd0ca640 1 --2- 172.21.15.19:0/3778613904 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82c8106f10 0x7f82c819cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:14.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.856+0000 7f82cd0ca640 1 --2- 172.21.15.19:0/3778613904 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82c8101de0 0x7f82c81984d0 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:14.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.857+0000 7f82cd0ca640 1 -- 172.21.15.19:0/3778613904 >> 172.21.15.19:0/3778613904 conn(0x7f82c80fd8c0 msgr2=0x7f82c80fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:14.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.857+0000 7f82cd0ca640 1 -- 172.21.15.19:0/3778613904 shutdown_connections 2024-09-19T09:03:14.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:14.857+0000 7f82cd0ca640 1 -- 172.21.15.19:0/3778613904 wait complete. 2024-09-19T09:03:15.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.556+0000 7f83a9294640 1 -- 172.21.15.19:0/1422312843 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a4101c40 msgr2=0x7f83a41020c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:15.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.556+0000 7f83a9294640 1 --2- 172.21.15.19:0/1422312843 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a4101c40 0x7f83a41020c0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f8398009900 tx=0x7f839802a410 comp rx=0 tx=0).stop 2024-09-19T09:03:15.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.556+0000 7f83a9294640 1 -- 172.21.15.19:0/1422312843 shutdown_connections 2024-09-19T09:03:15.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.556+0000 7f83a9294640 1 --2- 172.21.15.19:0/1422312843 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83a4102600 0x7f83a4108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.558 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.556+0000 7f83a9294640 1 --2- 172.21.15.19:0/1422312843 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a4101c40 0x7f83a41020c0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.556+0000 7f83a9294640 1 --2- 172.21.15.19:0/1422312843 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83a4100a50 0x7f83a4100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.556+0000 7f83a9294640 1 -- 172.21.15.19:0/1422312843 >> 172.21.15.19:0/1422312843 conn(0x7f83a40fc1b0 msgr2=0x7f83a40fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:15.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.556+0000 7f83a9294640 1 -- 172.21.15.19:0/1422312843 shutdown_connections 2024-09-19T09:03:15.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.556+0000 7f83a9294640 1 -- 172.21.15.19:0/1422312843 wait complete. 2024-09-19T09:03:15.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.556+0000 7f83a9294640 1 Processor -- start 2024-09-19T09:03:15.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.557+0000 7f83a9294640 1 -- start start 2024-09-19T09:03:15.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.557+0000 7f83a9294640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83a4100a50 0x7f83a4104ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:15.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.557+0000 7f83a9294640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83a4101c40 0x7f83a41030f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:15.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.557+0000 7f83a9294640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a4102600 0x7f83a4103630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:15.559 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.557+0000 7f83a9294640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f83a410c700 con 0x7f83a4102600 2024-09-19T09:03:15.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.557+0000 7f83a9294640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f83a410c580 con 0x7f83a4100a50 2024-09-19T09:03:15.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.557+0000 7f83a9294640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f83a410c880 con 0x7f83a4101c40 2024-09-19T09:03:15.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.557+0000 7f83a37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a4102600 0x7f83a4103630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:15.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.557+0000 7f83a37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a4102600 0x7f83a4103630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54728/0 (socket says 172.21.15.19:54728) 2024-09-19T09:03:15.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.557+0000 7f83a37fe640 1 -- 172.21.15.19:0/3094729001 learned_addr learned my addr 172.21.15.19:0/3094729001 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:15.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.557+0000 7f83a27fc640 1 --2- 172.21.15.19:0/3094729001 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83a4101c40 0x7f83a41030f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:15.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.557+0000 7f83a2ffd640 1 --2- 172.21.15.19:0/3094729001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83a4100a50 0x7f83a4104ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:15.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.557+0000 7f83a37fe640 1 -- 172.21.15.19:0/3094729001 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83a4101c40 msgr2=0x7f83a41030f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:15.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.557+0000 7f83a37fe640 1 --2- 172.21.15.19:0/3094729001 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83a4101c40 0x7f83a41030f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.557+0000 7f83a37fe640 1 -- 172.21.15.19:0/3094729001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83a4100a50 msgr2=0x7f83a4104ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:15.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.557+0000 7f83a37fe640 1 --2- 172.21.15.19:0/3094729001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83a4100a50 0x7f83a4104ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.560 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.557+0000 7f83a37fe640 1 -- 172.21.15.19:0/3094729001 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a4103ec0 con 0x7f83a4102600 2024-09-19T09:03:15.561 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.557+0000 7f83a2ffd640 1 --2- 172.21.15.19:0/3094729001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83a4100a50 0x7f83a4104ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:15.561 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.558+0000 7f83a37fe640 1 --2- 172.21.15.19:0/3094729001 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a4102600 0x7f83a4103630 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f839c00eb10 tx=0x7f839c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:15.561 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.558+0000 7f838bfff640 1 -- 172.21.15.19:0/3094729001 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c004b20 con 0x7f83a4102600 2024-09-19T09:03:15.561 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.558+0000 7f838bfff640 1 -- 172.21.15.19:0/3094729001 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f839c004cc0 con 0x7f83a4102600 2024-09-19T09:03:15.561 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.558+0000 7f83a9294640 1 -- 172.21.15.19:0/3094729001 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83a41a1ee0 con 0x7f83a4102600 2024-09-19T09:03:15.561 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.558+0000 7f838bfff640 1 -- 172.21.15.19:0/3094729001 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c010760 con 0x7f83a4102600 2024-09-19T09:03:15.561 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.558+0000 7f83a9294640 1 -- 172.21.15.19:0/3094729001 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83a41a2340 con 0x7f83a4102600 2024-09-19T09:03:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.560+0000 7f838bfff640 1 -- 172.21.15.19:0/3094729001 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f839c010900 con 0x7f83a4102600 2024-09-19T09:03:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.560+0000 7f83ac030740 1 Processor -- start 2024-09-19T09:03:15.567 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.561+0000 7f83ac030740 1 -- start start 2024-09-19T09:03:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.561+0000 7f83ac030740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b484d3c9a0 0x55b484d3cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.561+0000 7f83ac030740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b484d3d2e0 0x55b484d41da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.561+0000 7f83ac030740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b484d42370 0x55b484d44830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.561+0000 7f83ac030740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b484ca02f0 con 0x55b484d3d2e0 2024-09-19T09:03:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.561+0000 7f83ac030740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b484c48270 con 0x55b484d42370 2024-09-19T09:03:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.561+0000 7f83ac030740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b484c9c2b0 con 0x55b484d3c9a0 2024-09-19T09:03:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.561+0000 7f83a2ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b484d3d2e0 0x55b484d41da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.561+0000 7f83a27fc640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b484d3c9a0 0x55b484d3cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.561+0000 7f83a27fc640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b484d3c9a0 0x55b484d3cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:49226/0 (socket says 172.21.15.19:49226) 2024-09-19T09:03:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.561+0000 7f83a27fc640 1 -- 172.21.15.19:0/1092320971 learned_addr learned my addr 172.21.15.19:0/1092320971 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.561+0000 7f838bfff640 1 --2- 172.21.15.19:0/3094729001 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f838c0a3370 0x7f838c0a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.561+0000 7f83a27fc640 1 --2- 172.21.15.19:0/1092320971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b484d42370 0x55b484d44830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:15.568 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.561+0000 7f83a37fe640 1 --2- 172.21.15.19:0/3094729001 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f838c0a3370 0x7f838c0a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.561+0000 7f83a27fc640 1 -- 172.21.15.19:0/1092320971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b484d42370 msgr2=0x55b484d44830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.561+0000 7f83a27fc640 1 --2- 172.21.15.19:0/1092320971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b484d42370 0x55b484d44830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.561+0000 7f83a27fc640 1 -- 172.21.15.19:0/1092320971 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b484d3d2e0 msgr2=0x55b484d41da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.561+0000 7f83a27fc640 1 --2- 172.21.15.19:0/1092320971 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b484d3d2e0 0x55b484d41da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.561+0000 7f83a27fc640 1 -- 172.21.15.19:0/1092320971 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b484c47340 con 0x55b484d3c9a0 2024-09-19T09:03:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.561+0000 7f838bfff640 1 -- 172.21.15.19:0/3094729001 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f839c0cff30 con 0x7f83a4102600 2024-09-19T09:03:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.561+0000 7f83a2ffd640 1 --2- 172.21.15.19:0/1092320971 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b484d3d2e0 0x55b484d41da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.562+0000 7f83a27fc640 1 --2- 172.21.15.19:0/1092320971 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b484d3c9a0 0x55b484d3cda0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8398009900 tx=0x7f8398005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e65ae6b59a594f63 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.562+0000 7f83a37fe640 1 --2- 172.21.15.19:0/3094729001 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f838c0a3370 0x7f838c0a5830 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f839c0cddb0 tx=0x7f839c07a040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.562+0000 7f83897fa640 1 -- 172.21.15.19:0/1092320971 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8398035070 con 0x55b484d3c9a0 2024-09-19T09:03:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.562+0000 7f83897fa640 1 -- 172.21.15.19:0/1092320971 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8398031c50 con 0x55b484d3c9a0 2024-09-19T09:03:15.569 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.562+0000 7f83897fa640 1 -- 172.21.15.19:0/1092320971 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8398003de0 con 0x55b484d3c9a0 2024-09-19T09:03:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.563+0000 7f83ac030740 1 -- 172.21.15.19:0/1092320971 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b484d3c9a0 msgr2=0x55b484d3cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.563+0000 7f83ac030740 1 --2- 172.21.15.19:0/1092320971 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b484d3c9a0 0x55b484d3cda0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8398009900 tx=0x7f8398005fd0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.563+0000 7f83ac030740 1 -- 172.21.15.19:0/1092320971 shutdown_connections 2024-09-19T09:03:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.563+0000 7f83ac030740 1 --2- 172.21.15.19:0/1092320971 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b484d42370 0x55b484d44830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.563+0000 7f83ac030740 1 --2- 172.21.15.19:0/1092320971 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b484d3d2e0 0x55b484d41da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.570 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.563+0000 7f83ac030740 1 --2- 172.21.15.19:0/1092320971 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b484d3c9a0 0x55b484d3cda0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.563+0000 7f83ac030740 1 -- 172.21.15.19:0/1092320971 >> 172.21.15.19:0/1092320971 conn(0x55b484d38010 msgr2=0x55b484d38410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.563+0000 7f83ac030740 1 -- 172.21.15.19:0/1092320971 shutdown_connections 2024-09-19T09:03:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.563+0000 7f83ac030740 1 -- 172.21.15.19:0/1092320971 wait complete. 2024-09-19T09:03:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.563+0000 7f83ac030740 1 -- start start 2024-09-19T09:03:15.571 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.563+0000 7f83ac030740 1 Processor -- start 2024-09-19T09:03:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.564+0000 7f83ac030740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b484d3c9a0 0x55b484d46bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.564+0000 7f83ac030740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b484d3d2e0 0x55b484d47110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.564+0000 7f83ac030740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b484d42370 0x55b484d4e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:15.572 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.564+0000 7f83ac030740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b484d452e0 con 0x55b484d3c9a0 2024-09-19T09:03:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.564+0000 7f83ac030740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b484c29290 con 0x55b484d42370 2024-09-19T09:03:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.564+0000 7f83ac030740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b484d45460 con 0x55b484d3d2e0 2024-09-19T09:03:15.573 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.564+0000 7f83ac030740 10 client.0 _ll_register_callbacks cb 0x55b484c5a140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.564+0000 7f83a27fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b484d3c9a0 0x55b484d46bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.564+0000 7f83a27fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b484d3c9a0 0x55b484d46bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54736/0 (socket says 172.21.15.19:54736) 2024-09-19T09:03:15.574 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.564+0000 7f83a27fc640 1 -- 172.21.15.19:0/2992053898 learned_addr learned my addr 172.21.15.19:0/2992053898 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:15.575 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.564+0000 7f83a2ffd640 1 --2- 172.21.15.19:0/2992053898 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b484d3d2e0 0x55b484d47110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:15.575 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.564+0000 7f83a27fc640 1 -- 172.21.15.19:0/2992053898 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b484d3d2e0 msgr2=0x55b484d47110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:15.575 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.564+0000 7f83a27fc640 1 --2- 172.21.15.19:0/2992053898 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b484d3d2e0 0x55b484d47110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.575 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.564+0000 7f83a27fc640 1 -- 172.21.15.19:0/2992053898 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b484d42370 msgr2=0x55b484d4e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:15.575 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.564+0000 7f83a27fc640 1 --2- 172.21.15.19:0/2992053898 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b484d42370 0x55b484d4e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.564+0000 7f83a27fc640 1 -- 172.21.15.19:0/2992053898 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4849b3210 con 0x55b484d3c9a0 2024-09-19T09:03:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.564+0000 7f83a27fc640 1 --2- 172.21.15.19:0/2992053898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b484d3c9a0 0x55b484d46bd0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f8398004350 tx=0x7f839802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e51b88db5107436 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.564+0000 7f8386ff5640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.564+0000 7f8386ff5640 1 -- 172.21.15.19:0/2992053898 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8398035050 con 0x55b484d3c9a0 2024-09-19T09:03:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.565+0000 7f8386ff5640 1 -- 172.21.15.19:0/2992053898 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f8398003b60 con 0x55b484d3c9a0 2024-09-19T09:03:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.565+0000 7f83ac030740 1 -- 172.21.15.19:0/2992053898 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8398031c50 con 0x55b484d3c9a0 2024-09-19T09:03:15.576 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.565+0000 7f8386ff5640 1 -- 172.21.15.19:0/2992053898 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f8398003d60 con 0x55b484d3c9a0 2024-09-19T09:03:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.565+0000 7f83ac030740 10 client.17979 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.565+0000 7f83ac030740 1 -- 172.21.15.19:0/2992053898 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55b484a7f620 con 0x55b484d3c9a0 2024-09-19T09:03:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.565+0000 7f8386ff5640 1 -- 172.21.15.19:0/2992053898 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8398031c50 con 0x55b484d3c9a0 2024-09-19T09:03:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.565+0000 7f8386ff5640 1 -- 172.21.15.19:0/2992053898 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f83980564e0 con 0x55b484d3c9a0 2024-09-19T09:03:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.565+0000 7f83ac030740 10 client.17979 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.565+0000 7f83ac030740 10 client.17979 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.565+0000 7f83ac030740 20 client.17979 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.565+0000 7f83ac030740 1 --2- 172.21.15.19:0/2992053898 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b484d52450 0x55b484d54840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.565+0000 7f83ac030740 4 client.17979 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:15.577 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.565+0000 7f83ac030740 1 -- 172.21.15.19:0/2992053898 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b484cada20 con 0x55b484d52450 2024-09-19T09:03:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.565+0000 7f83a2ffd640 1 --2- 172.21.15.19:0/2992053898 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b484d52450 0x55b484d54840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.566+0000 7f83a2ffd640 1 --2- 172.21.15.19:0/2992053898 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b484d52450 0x55b484d54840 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a44337bfe10b908 server_cookie=ebe7f7016476ef0d in_seq=0 out_seq=0 2024-09-19T09:03:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.566+0000 7f8386ff5640 10 client.17979 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.567+0000 7f8386ff5640 1 -- 172.21.15.19:0/2992053898 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b484cada20 con 0x55b484d52450 2024-09-19T09:03:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.567+0000 7f8386ff5640 10 client.17979 handle_command_reply: tid=0 2024-09-19T09:03:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.567+0000 7f83ac030740 1 client.17979 shutdown 2024-09-19T09:03:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.567+0000 7f83ac030740 1 -- 172.21.15.19:0/2992053898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b484d3c9a0 msgr2=0x55b484d46bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.567+0000 7f83ac030740 1 --2- 172.21.15.19:0/2992053898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b484d3c9a0 0x55b484d46bd0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f8398004350 tx=0x7f839802a410 comp rx=0 tx=0).stop 2024-09-19T09:03:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.567+0000 7f83ac030740 1 -- 172.21.15.19:0/2992053898 shutdown_connections 2024-09-19T09:03:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.567+0000 7f83ac030740 1 --2- 172.21.15.19:0/2992053898 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b484d52450 0x55b484d54840 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.567+0000 7f83ac030740 1 --2- 172.21.15.19:0/2992053898 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b484d3d2e0 0x55b484d47110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.567+0000 7f83ac030740 1 --2- 172.21.15.19:0/2992053898 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b484d42370 0x55b484d4e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.578 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.567+0000 7f8386ff5640 0 client.17979 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.567+0000 7f83ac030740 1 --2- 172.21.15.19:0/2992053898 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b484d3c9a0 0x55b484d46bd0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.567+0000 7f83ac030740 1 -- 172.21.15.19:0/2992053898 >> 172.21.15.19:0/2992053898 conn(0x55b484d38010 msgr2=0x55b484d39820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.567+0000 7f83ac030740 1 -- 172.21.15.19:0/2992053898 shutdown_connections 2024-09-19T09:03:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.567+0000 7f83ac030740 1 -- 172.21.15.19:0/2992053898 wait complete. 2024-09-19T09:03:15.579 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.567+0000 7f83ac030740 20 client.17979 trim_cache size 0 max 16384 2024-09-19T09:03:15.581 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T09:03:15.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.581+0000 7f83ac030740 1 Processor -- start 2024-09-19T09:03:15.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.581+0000 7f83ac030740 1 -- start start 2024-09-19T09:03:15.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.582+0000 7f83ac030740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b484d3c9a0 0x55b484d46ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:15.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.582+0000 7f83ac030740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b484d3d2e0 0x55b484d4e070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:15.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.582+0000 7f83ac030740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b484d42370 0x55b484d58fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:15.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.582+0000 7f83ac030740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f83a41ab0a0 con 0x55b484d3c9a0 2024-09-19T09:03:15.587 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.582+0000 7f83ac030740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f83a41acbe0 con 0x55b484d3d2e0 2024-09-19T09:03:15.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.582+0000 7f83ac030740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f83a41ab770 con 0x55b484d42370 2024-09-19T09:03:15.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.582+0000 7f83a27fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b484d3c9a0 0x55b484d46ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:15.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.582+0000 7f83a27fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b484d3c9a0 0x55b484d46ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54752/0 (socket says 172.21.15.19:54752) 2024-09-19T09:03:15.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.582+0000 7f83a27fc640 1 -- 172.21.15.19:0/2864652624 learned_addr learned my addr 172.21.15.19:0/2864652624 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:15.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.582+0000 7f83a2ffd640 1 --2- 172.21.15.19:0/2864652624 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b484d3d2e0 0x55b484d4e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:15.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.582+0000 7f83a27fc640 1 -- 172.21.15.19:0/2864652624 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b484d42370 msgr2=0x55b484d58fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:15.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.582+0000 7f83a27fc640 1 --2- 172.21.15.19:0/2864652624 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b484d42370 0x55b484d58fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.582+0000 7f83a27fc640 1 -- 172.21.15.19:0/2864652624 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b484d3d2e0 msgr2=0x55b484d4e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:15.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.582+0000 7f83a27fc640 1 --2- 172.21.15.19:0/2864652624 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b484d3d2e0 0x55b484d4e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.582+0000 7f83a27fc640 1 -- 172.21.15.19:0/2864652624 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b484d3d7c0 con 0x55b484d3c9a0 2024-09-19T09:03:15.588 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.582+0000 7f83a27fc640 1 --2- 172.21.15.19:0/2864652624 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b484d3c9a0 0x55b484d46ff0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f8398031610 tx=0x7f8398000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa7c69af720e174c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:15.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.582+0000 7f8388ff9640 1 -- 172.21.15.19:0/2864652624 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8398035040 con 0x55b484d3c9a0 2024-09-19T09:03:15.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.583+0000 7f8388ff9640 1 -- 172.21.15.19:0/2864652624 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f839804f030 con 0x55b484d3c9a0 2024-09-19T09:03:15.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.583+0000 7f8388ff9640 1 -- 172.21.15.19:0/2864652624 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8398031770 con 0x55b484d3c9a0 2024-09-19T09:03:15.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.583+0000 7f83ac030740 1 -- 172.21.15.19:0/2864652624 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b484d3c9a0 msgr2=0x55b484d46ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:15.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.583+0000 7f83ac030740 1 --2- 172.21.15.19:0/2864652624 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b484d3c9a0 0x55b484d46ff0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f8398031610 tx=0x7f8398000bc0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.583+0000 7f83ac030740 1 -- 172.21.15.19:0/2864652624 shutdown_connections 2024-09-19T09:03:15.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.583+0000 7f83ac030740 1 --2- 172.21.15.19:0/2864652624 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b484d42370 0x55b484d58fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.583+0000 7f83ac030740 1 --2- 172.21.15.19:0/2864652624 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b484d3d2e0 0x55b484d4e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.583+0000 7f83ac030740 1 --2- 172.21.15.19:0/2864652624 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b484d3c9a0 0x55b484d46ff0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.583+0000 7f83ac030740 1 -- 172.21.15.19:0/2864652624 >> 172.21.15.19:0/2864652624 conn(0x55b484d38010 msgr2=0x55b484d371c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:15.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.583+0000 7f83ac030740 1 -- 172.21.15.19:0/2864652624 shutdown_connections 2024-09-19T09:03:15.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.583+0000 7f83ac030740 1 -- 172.21.15.19:0/2864652624 wait complete. 2024-09-19T09:03:15.589 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.584+0000 7f83ac030740 1 -- start start 2024-09-19T09:03:15.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.584+0000 7f83ac030740 1 Processor -- start 2024-09-19T09:03:15.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.584+0000 7f83ac030740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b484d3c9a0 0x55b484d4bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:15.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.584+0000 7f83ac030740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b484d3d2e0 0x55b484d4c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:15.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.584+0000 7f83ac030740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b484d42370 0x55b484d4d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:15.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.584+0000 7f83ac030740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f83a41ac510 con 0x55b484d42370 2024-09-19T09:03:15.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.584+0000 7f83ac030740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f83a41abe40 con 0x55b484d3d2e0 2024-09-19T09:03:15.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.584+0000 7f83ac030740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f83a41a9080 con 0x55b484d3c9a0 2024-09-19T09:03:15.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.584+0000 7f83ac030740 10 client.0 _ll_register_callbacks cb 0x7f839400c370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:15.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.584+0000 7f83a27fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b484d42370 0x55b484d4d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:15.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.584+0000 7f83a27fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b484d42370 0x55b484d4d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54754/0 (socket says 172.21.15.19:54754) 2024-09-19T09:03:15.590 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.584+0000 7f83a27fc640 1 -- 172.21.15.19:0/3056205820 learned_addr learned my addr 172.21.15.19:0/3056205820 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:15.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.584+0000 7f83a2ffd640 1 --2- 172.21.15.19:0/3056205820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b484d3d2e0 0x55b484d4c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:15.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.584+0000 7f83a27fc640 1 --2- 172.21.15.19:0/3056205820 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b484d3c9a0 0x55b484d4bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:15.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.584+0000 7f83a27fc640 1 -- 172.21.15.19:0/3056205820 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b484d3c9a0 msgr2=0x55b484d4bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:15.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.584+0000 7f83a27fc640 1 --2- 172.21.15.19:0/3056205820 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b484d3c9a0 0x55b484d4bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.584+0000 7f83a27fc640 1 -- 172.21.15.19:0/3056205820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b484d3d2e0 msgr2=0x55b484d4c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:15.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.584+0000 7f83a27fc640 1 --2- 172.21.15.19:0/3056205820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b484d3d2e0 0x55b484d4c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.584+0000 7f83a27fc640 1 -- 172.21.15.19:0/3056205820 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b484d4d790 con 0x55b484d42370 2024-09-19T09:03:15.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.585+0000 7f83a2ffd640 1 --2- 172.21.15.19:0/3056205820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b484d3d2e0 0x55b484d4c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:15.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.585+0000 7f83a27fc640 1 --2- 172.21.15.19:0/3056205820 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b484d42370 0x55b484d4d180 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f83980096c0 tx=0x7f839802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24bec795bf47dab4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:15.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.585+0000 7f8386ff5640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:15.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.585+0000 7f8386ff5640 1 -- 172.21.15.19:0/3056205820 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8398035040 con 0x55b484d42370 2024-09-19T09:03:15.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.585+0000 7f8386ff5640 1 -- 172.21.15.19:0/3056205820 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f8398003ae0 con 0x55b484d42370 2024-09-19T09:03:15.591 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.585+0000 7f83ac030740 1 -- 172.21.15.19:0/3056205820 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f839804f030 con 0x55b484d42370 2024-09-19T09:03:15.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.585+0000 7f8386ff5640 1 -- 172.21.15.19:0/3056205820 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f83980318b0 con 0x55b484d42370 2024-09-19T09:03:15.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.585+0000 7f83ac030740 10 client.17985 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:15.592 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.585+0000 7f83ac030740 1 -- 172.21.15.19:0/3056205820 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55b484dbd480 con 0x55b484d42370 2024-09-19T09:03:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.585+0000 7f8386ff5640 1 -- 172.21.15.19:0/3056205820 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f839804f030 con 0x55b484d42370 2024-09-19T09:03:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.585+0000 7f8386ff5640 1 -- 172.21.15.19:0/3056205820 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f839805f4c0 con 0x55b484d42370 2024-09-19T09:03:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.585+0000 7f83ac030740 10 client.17985 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.585+0000 7f83ac030740 10 client.17985 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.585+0000 7f83ac030740 20 client.17985 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.586+0000 7f83ac030740 1 --2- 172.21.15.19:0/3056205820 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b484dbdde0 0x55b484dc0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.586+0000 7f83ac030740 4 client.17985 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:03:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.586+0000 7f83ac030740 1 -- 172.21.15.19:0/3056205820 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b484ca7d70 con 0x55b484dbdde0 2024-09-19T09:03:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.586+0000 7f83a2ffd640 1 --2- 172.21.15.19:0/3056205820 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b484dbdde0 0x55b484dc0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:15.593 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.586+0000 7f83a2ffd640 1 --2- 172.21.15.19:0/3056205820 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b484dbdde0 0x55b484dc0200 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9aefbce1771eeca server_cookie=f9da96611426ed76 in_seq=0 out_seq=0 2024-09-19T09:03:15.594 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.586+0000 7f8386ff5640 10 client.17985 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:15.606 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.605+0000 7f8386ff5640 1 -- 172.21.15.19:0/3056205820 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b484ca7d70 con 0x55b484dbdde0 2024-09-19T09:03:15.606 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.605+0000 7f8386ff5640 10 client.17985 handle_command_reply: tid=0 2024-09-19T09:03:15.606 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.605+0000 7f83ac030740 1 client.17985 shutdown 2024-09-19T09:03:15.606 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.605+0000 7f83ac030740 1 -- 172.21.15.19:0/3056205820 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b484d42370 msgr2=0x55b484d4d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:15.606 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.605+0000 7f83ac030740 1 --2- 172.21.15.19:0/3056205820 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b484d42370 0x55b484d4d180 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f83980096c0 tx=0x7f839802a410 comp rx=0 tx=0).stop 2024-09-19T09:03:15.606 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.605+0000 7f83ac030740 1 -- 172.21.15.19:0/3056205820 shutdown_connections 2024-09-19T09:03:15.606 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.605+0000 7f83ac030740 1 --2- 172.21.15.19:0/3056205820 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55b484dbdde0 0x55b484dc0200 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.606 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.605+0000 7f83ac030740 1 --2- 172.21.15.19:0/3056205820 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b484d42370 0x55b484d4d180 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.606 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.605+0000 7f83ac030740 1 --2- 172.21.15.19:0/3056205820 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b484d3d2e0 0x55b484d4c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.607 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.605+0000 7f8386ff5640 0 client.17985 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:15.607 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.605+0000 7f83ac030740 1 --2- 172.21.15.19:0/3056205820 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b484d3c9a0 0x55b484d4bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.607 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.605+0000 7f83ac030740 1 -- 172.21.15.19:0/3056205820 >> 172.21.15.19:0/3056205820 conn(0x55b484d38010 msgr2=0x55b484d38ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:15.607 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.605+0000 7f83ac030740 1 -- 172.21.15.19:0/3056205820 shutdown_connections 2024-09-19T09:03:15.607 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.605+0000 7f83ac030740 1 -- 172.21.15.19:0/3056205820 wait complete. 2024-09-19T09:03:15.607 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.605+0000 7f83ac030740 20 client.17985 trim_cache size 0 max 16384 2024-09-19T09:03:15.607 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T09:03:15.607 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T09:03:15.607 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T09:03:15.608 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T09:03:15.608 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.606+0000 7f83a9294640 1 -- 172.21.15.19:0/3094729001 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f838c0a3370 msgr2=0x7f838c0a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:15.609 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.606+0000 7f83a9294640 1 --2- 172.21.15.19:0/3094729001 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f838c0a3370 0x7f838c0a5830 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f839c0cddb0 tx=0x7f839c07a040 comp rx=0 tx=0).stop 2024-09-19T09:03:15.609 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.606+0000 7f83a9294640 1 -- 172.21.15.19:0/3094729001 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a4102600 msgr2=0x7f83a4103630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:15.609 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.606+0000 7f83a9294640 1 --2- 172.21.15.19:0/3094729001 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a4102600 0x7f83a4103630 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f839c00eb10 tx=0x7f839c00c2d0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.609 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.606+0000 7f83a9294640 1 -- 172.21.15.19:0/3094729001 shutdown_connections 2024-09-19T09:03:15.609 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.606+0000 7f83a9294640 1 --2- 172.21.15.19:0/3094729001 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f838c0a3370 0x7f838c0a5830 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.609 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.606+0000 7f83a9294640 1 --2- 172.21.15.19:0/3094729001 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f83a4101c40 0x7f83a41030f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.609 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.606+0000 7f83a9294640 1 --2- 172.21.15.19:0/3094729001 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f83a4102600 0x7f83a4103630 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.609 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.606+0000 7f83a9294640 1 --2- 172.21.15.19:0/3094729001 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f83a4100a50 0x7f83a4104ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:15.609 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.606+0000 7f83a9294640 1 -- 172.21.15.19:0/3094729001 >> 172.21.15.19:0/3094729001 conn(0x7f83a40fc1b0 msgr2=0x7f83a40fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:15.609 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.606+0000 7f83a9294640 1 -- 172.21.15.19:0/3094729001 shutdown_connections 2024-09-19T09:03:15.609 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:15.606+0000 7f83a9294640 1 -- 172.21.15.19:0/3094729001 wait complete. 2024-09-19T09:03:15.842 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:16.138 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:15 smithi019 ceph-mon[30976]: pgmap v670: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 4.6 KiB/s wr, 39 op/s 2024-09-19T09:03:16.138 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:15 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3778613904' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:16.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:15 smithi155 ceph-mon[34921]: pgmap v670: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 4.6 KiB/s wr, 39 op/s 2024-09-19T09:03:16.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:15 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3778613904' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:16.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:15 smithi203 ceph-mon[35450]: pgmap v670: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 4.6 KiB/s wr, 39 op/s 2024-09-19T09:03:16.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:15 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3778613904' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:16.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.360+0000 7fa7597df640 1 -- 172.21.15.19:0/1570016735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa754101de0 msgr2=0x7fa7541021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:16.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.360+0000 7fa7597df640 1 --2- 172.21.15.19:0/1570016735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa754101de0 0x7fa7541021c0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fa744009900 tx=0x7fa74402a410 comp rx=0 tx=0).stop 2024-09-19T09:03:16.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.360+0000 7fa7597df640 1 -- 172.21.15.19:0/1570016735 shutdown_connections 2024-09-19T09:03:16.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.360+0000 7fa7597df640 1 --2- 172.21.15.19:0/1570016735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa754102790 0x7fa7541067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.360+0000 7fa7597df640 1 --2- 172.21.15.19:0/1570016735 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa754106f10 0x7fa75410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.360+0000 7fa7597df640 1 --2- 172.21.15.19:0/1570016735 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa754101de0 0x7fa7541021c0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.360+0000 7fa7597df640 1 -- 172.21.15.19:0/1570016735 >> 172.21.15.19:0/1570016735 conn(0x7fa7540fd8c0 msgr2=0x7fa7540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:16.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.360+0000 7fa7597df640 1 -- 172.21.15.19:0/1570016735 shutdown_connections 2024-09-19T09:03:16.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.360+0000 7fa7597df640 1 -- 172.21.15.19:0/1570016735 wait complete. 2024-09-19T09:03:16.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.360+0000 7fa7597df640 1 Processor -- start 2024-09-19T09:03:16.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.361+0000 7fa7597df640 1 -- start start 2024-09-19T09:03:16.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.361+0000 7fa7597df640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa754101de0 0x7fa754198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:16.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.361+0000 7fa7597df640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa754102790 0x7fa754198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:16.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.361+0000 7fa7597df640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa754106f10 0x7fa75419cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:16.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.361+0000 7fa7597df640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa754111f70 con 0x7fa754102790 2024-09-19T09:03:16.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.361+0000 7fa7597df640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa754111df0 con 0x7fa754106f10 2024-09-19T09:03:16.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.361+0000 7fa7597df640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa7541120f0 con 0x7fa754101de0 2024-09-19T09:03:16.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.361+0000 7fa74bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa754102790 0x7fa754198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:16.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.361+0000 7fa74bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa754102790 0x7fa754198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54776/0 (socket says 172.21.15.19:54776) 2024-09-19T09:03:16.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.361+0000 7fa74bfff640 1 -- 172.21.15.19:0/3413662691 learned_addr learned my addr 172.21.15.19:0/3413662691 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:16.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.361+0000 7fa752ffd640 1 --2- 172.21.15.19:0/3413662691 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa754101de0 0x7fa754198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:16.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.361+0000 7fa7537fe640 1 --2- 172.21.15.19:0/3413662691 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa754106f10 0x7fa75419cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:16.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.361+0000 7fa74bfff640 1 -- 172.21.15.19:0/3413662691 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa754101de0 msgr2=0x7fa754198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:16.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.361+0000 7fa74bfff640 1 --2- 172.21.15.19:0/3413662691 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa754101de0 0x7fa754198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.361+0000 7fa74bfff640 1 -- 172.21.15.19:0/3413662691 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa754106f10 msgr2=0x7fa75419cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:16.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.361+0000 7fa74bfff640 1 --2- 172.21.15.19:0/3413662691 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa754106f10 0x7fa75419cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.361+0000 7fa74bfff640 1 -- 172.21.15.19:0/3413662691 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa75419d400 con 0x7fa754102790 2024-09-19T09:03:16.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.361+0000 7fa752ffd640 1 --2- 172.21.15.19:0/3413662691 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa754101de0 0x7fa754198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:16.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.361+0000 7fa74bfff640 1 --2- 172.21.15.19:0/3413662691 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa754102790 0x7fa754198990 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fa73c00c890 tx=0x7fa73c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:16.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.362+0000 7fa750ff9640 1 -- 172.21.15.19:0/3413662691 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73c004220 con 0x7fa754102790 2024-09-19T09:03:16.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.362+0000 7fa750ff9640 1 -- 172.21.15.19:0/3413662691 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa73c0043c0 con 0x7fa754102790 2024-09-19T09:03:16.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.362+0000 7fa750ff9640 1 -- 172.21.15.19:0/3413662691 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa73c0049e0 con 0x7fa754102790 2024-09-19T09:03:16.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.362+0000 7fa7597df640 1 -- 172.21.15.19:0/3413662691 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa75419d6f0 con 0x7fa754102790 2024-09-19T09:03:16.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.362+0000 7fa7597df640 1 -- 172.21.15.19:0/3413662691 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7541a4fd0 con 0x7fa754102790 2024-09-19T09:03:16.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.364+0000 7fa750ff9640 1 -- 172.21.15.19:0/3413662691 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fa73c0079b0 con 0x7fa754102790 2024-09-19T09:03:16.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.364+0000 7fa75bbb8740 1 Processor -- start 2024-09-19T09:03:16.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.364+0000 7fa75bbb8740 1 -- start start 2024-09-19T09:03:16.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.365+0000 7fa75bbb8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643feaefb40 0x5643feaee090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:16.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.365+0000 7fa75bbb8740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643feaee5d0 0x5643feaeea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:16.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.365+0000 7fa75bbb8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5643feaf9370 0x5643feafb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:16.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.365+0000 7fa75bbb8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5643fea542f0 con 0x5643feaf9370 2024-09-19T09:03:16.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.365+0000 7fa75bbb8740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5643fe9fbcf0 con 0x5643feaee5d0 2024-09-19T09:03:16.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.365+0000 7fa75bbb8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5643fea502b0 con 0x5643feaefb40 2024-09-19T09:03:16.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.365+0000 7fa74bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5643feaf9370 0x5643feafb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:16.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.365+0000 7fa74bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5643feaf9370 0x5643feafb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54778/0 (socket says 172.21.15.19:54778) 2024-09-19T09:03:16.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.365+0000 7fa74bfff640 1 -- 172.21.15.19:0/3159116324 learned_addr learned my addr 172.21.15.19:0/3159116324 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:16.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.365+0000 7fa7537fe640 1 --2- 172.21.15.19:0/3159116324 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643feaefb40 0x5643feaee090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:16.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.365+0000 7fa752ffd640 1 --2- 172.21.15.19:0/3159116324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643feaee5d0 0x5643feaeea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:16.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.365+0000 7fa750ff9640 1 --2- 172.21.15.19:0/3413662691 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa7400a3240 0x7fa7400a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:16.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.365+0000 7fa7537fe640 1 -- 172.21.15.19:0/3159116324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643feaee5d0 msgr2=0x5643feaeea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:16.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.365+0000 7fa7537fe640 1 --2- 172.21.15.19:0/3159116324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643feaee5d0 0x5643feaeea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.365+0000 7fa7537fe640 1 -- 172.21.15.19:0/3159116324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5643feaf9370 msgr2=0x5643feafb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:16.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.365+0000 7fa7537fe640 1 --2- 172.21.15.19:0/3159116324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5643feaf9370 0x5643feafb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.365+0000 7fa7537fe640 1 -- 172.21.15.19:0/3159116324 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643fe9e03a0 con 0x5643feaefb40 2024-09-19T09:03:16.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.365+0000 7fa750ff9640 1 -- 172.21.15.19:0/3413662691 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7fa73c0cfa30 con 0x7fa754102790 2024-09-19T09:03:16.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.365+0000 7fa74bfff640 1 --2- 172.21.15.19:0/3159116324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5643feaf9370 0x5643feafb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:16.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.366+0000 7fa7537fe640 1 --2- 172.21.15.19:0/3413662691 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa7400a3240 0x7fa7400a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:16.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.366+0000 7fa7537fe640 1 --2- 172.21.15.19:0/3159116324 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643feaefb40 0x5643feaee090 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa74c009ee0 tx=0x7fa74c010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f59fb3e9b943f06 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:16.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.366+0000 7fa7537fe640 1 --2- 172.21.15.19:0/3413662691 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa7400a3240 0x7fa7400a5700 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa74c020000 tx=0x7fa74c01d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:16.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.366+0000 7fa7497fa640 1 -- 172.21.15.19:0/3159116324 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa74c013e30 con 0x5643feaefb40 2024-09-19T09:03:16.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.366+0000 7fa7497fa640 1 -- 172.21.15.19:0/3159116324 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa74c013540 con 0x5643feaefb40 2024-09-19T09:03:16.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.366+0000 7fa7497fa640 1 -- 172.21.15.19:0/3159116324 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa74c011d70 con 0x5643feaefb40 2024-09-19T09:03:16.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.367+0000 7fa75bbb8740 1 -- 172.21.15.19:0/3159116324 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643feaefb40 msgr2=0x5643feaee090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:16.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.367+0000 7fa75bbb8740 1 --2- 172.21.15.19:0/3159116324 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643feaefb40 0x5643feaee090 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa74c009ee0 tx=0x7fa74c010740 comp rx=0 tx=0).stop 2024-09-19T09:03:16.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.367+0000 7fa75bbb8740 1 -- 172.21.15.19:0/3159116324 shutdown_connections 2024-09-19T09:03:16.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.367+0000 7fa75bbb8740 1 --2- 172.21.15.19:0/3159116324 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5643feaf9370 0x5643feafb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.367+0000 7fa75bbb8740 1 --2- 172.21.15.19:0/3159116324 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643feaee5d0 0x5643feaeea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.367+0000 7fa75bbb8740 1 --2- 172.21.15.19:0/3159116324 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643feaefb40 0x5643feaee090 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.367+0000 7fa75bbb8740 1 -- 172.21.15.19:0/3159116324 >> 172.21.15.19:0/3159116324 conn(0x5643feab7310 msgr2=0x5643feaeac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:16.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.367+0000 7fa75bbb8740 1 -- 172.21.15.19:0/3159116324 shutdown_connections 2024-09-19T09:03:16.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.367+0000 7fa75bbb8740 1 -- 172.21.15.19:0/3159116324 wait complete. 2024-09-19T09:03:16.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.367+0000 7fa75bbb8740 1 -- start start 2024-09-19T09:03:16.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.367+0000 7fa75bbb8740 1 Processor -- start 2024-09-19T09:03:16.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.368+0000 7fa75bbb8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643feaee5d0 0x5643feaf8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:16.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.368+0000 7fa75bbb8740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643feaefb40 0x5643feaf6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:16.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.368+0000 7fa75bbb8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5643feaf9370 0x5643feaf6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:16.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.368+0000 7fa75bbb8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5643feafc070 con 0x5643feaf9370 2024-09-19T09:03:16.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.368+0000 7fa75bbb8740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5643fea0f060 con 0x5643feaefb40 2024-09-19T09:03:16.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.368+0000 7fa75bbb8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5643feafc1f0 con 0x5643feaee5d0 2024-09-19T09:03:16.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.368+0000 7fa75bbb8740 10 client.0 _ll_register_callbacks cb 0x5643fe7628c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:16.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.368+0000 7fa7537fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5643feaf9370 0x5643feaf6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:16.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.368+0000 7fa7537fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5643feaf9370 0x5643feaf6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54784/0 (socket says 172.21.15.19:54784) 2024-09-19T09:03:16.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.368+0000 7fa7537fe640 1 -- 172.21.15.19:0/1627629032 learned_addr learned my addr 172.21.15.19:0/1627629032 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:16.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.368+0000 7fa752ffd640 1 --2- 172.21.15.19:0/1627629032 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643feaee5d0 0x5643feaf8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:16.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.368+0000 7fa74bfff640 1 --2- 172.21.15.19:0/1627629032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643feaefb40 0x5643feaf6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:16.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.368+0000 7fa7537fe640 1 -- 172.21.15.19:0/1627629032 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643feaee5d0 msgr2=0x5643feaf8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:16.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.368+0000 7fa7537fe640 1 --2- 172.21.15.19:0/1627629032 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643feaee5d0 0x5643feaf8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.368+0000 7fa7537fe640 1 -- 172.21.15.19:0/1627629032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643feaefb40 msgr2=0x5643feaf6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:16.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.368+0000 7fa7537fe640 1 --2- 172.21.15.19:0/1627629032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643feaefb40 0x5643feaf6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.368+0000 7fa7537fe640 1 -- 172.21.15.19:0/1627629032 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643fe7c53c0 con 0x5643feaf9370 2024-09-19T09:03:16.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.368+0000 7fa74bfff640 1 --2- 172.21.15.19:0/1627629032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643feaefb40 0x5643feaf6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:16.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.368+0000 7fa7537fe640 1 --2- 172.21.15.19:0/1627629032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5643feaf9370 0x5643feaf6800 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fa74c011d50 tx=0x7fa74c011d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a9ab95e1d95b03b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:16.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.368+0000 7fa73a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:16.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.368+0000 7fa73a7fc640 1 -- 172.21.15.19:0/1627629032 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa74c033060 con 0x5643feaf9370 2024-09-19T09:03:16.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.368+0000 7fa73a7fc640 1 -- 172.21.15.19:0/1627629032 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7fa74c004c50 con 0x5643feaf9370 2024-09-19T09:03:16.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.368+0000 7fa75bbb8740 1 -- 172.21.15.19:0/1627629032 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5643fea61860 con 0x5643feaf9370 2024-09-19T09:03:16.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.369+0000 7fa73a7fc640 1 -- 172.21.15.19:0/1627629032 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fa74c004e50 con 0x5643feaf9370 2024-09-19T09:03:16.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.369+0000 7fa75bbb8740 10 client.17997 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:16.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.369+0000 7fa75bbb8740 1 -- 172.21.15.19:0/1627629032 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5643feb07b80 con 0x5643feaf9370 2024-09-19T09:03:16.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.369+0000 7fa73a7fc640 1 -- 172.21.15.19:0/1627629032 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5643fea61860 con 0x5643feaf9370 2024-09-19T09:03:16.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.369+0000 7fa73a7fc640 1 -- 172.21.15.19:0/1627629032 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7fa74c00f040 con 0x5643feaf9370 2024-09-19T09:03:16.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.369+0000 7fa75bbb8740 10 client.17997 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:16.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.369+0000 7fa75bbb8740 10 client.17997 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T09:03:16.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.369+0000 7fa75bbb8740 20 client.17997 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:16.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.369+0000 7fa75bbb8740 1 --2- 172.21.15.19:0/1627629032 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5643feb08fe0 0x5643feb0b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:16.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.369+0000 7fa75bbb8740 4 client.17997 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:16.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.369+0000 7fa75bbb8740 1 -- 172.21.15.19:0/1627629032 --> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643fea5bd70 con 0x5643feb08fe0 2024-09-19T09:03:16.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.369+0000 7fa752ffd640 1 --2- 172.21.15.19:0/1627629032 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5643feb08fe0 0x5643feb0b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:16.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.370+0000 7fa752ffd640 1 --2- 172.21.15.19:0/1627629032 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5643feb08fe0 0x5643feb0b3d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b1953d7ab39c3841 server_cookie=b4960aa6fad54fb3 in_seq=0 out_seq=0 2024-09-19T09:03:16.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.370+0000 7fa73a7fc640 10 client.17997 ms_handle_connect on v2:172.21.15.203:6834/2702758353 2024-09-19T09:03:16.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.370+0000 7fa73a7fc640 1 -- 172.21.15.19:0/1627629032 <== mds.4 v2:172.21.15.203:6834/2702758353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5643fea5bd70 con 0x5643feb08fe0 2024-09-19T09:03:16.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.370+0000 7fa73a7fc640 10 client.17997 handle_command_reply: tid=0 2024-09-19T09:03:16.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.370+0000 7fa75bbb8740 1 client.17997 shutdown 2024-09-19T09:03:16.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.371+0000 7fa75bbb8740 1 -- 172.21.15.19:0/1627629032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5643feaf9370 msgr2=0x5643feaf6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:16.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.371+0000 7fa75bbb8740 1 --2- 172.21.15.19:0/1627629032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5643feaf9370 0x5643feaf6800 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fa74c011d50 tx=0x7fa74c011d80 comp rx=0 tx=0).stop 2024-09-19T09:03:16.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.371+0000 7fa75bbb8740 1 -- 172.21.15.19:0/1627629032 shutdown_connections 2024-09-19T09:03:16.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.371+0000 7fa75bbb8740 1 --2- 172.21.15.19:0/1627629032 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5643feb08fe0 0x5643feb0b3d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.371+0000 7fa75bbb8740 1 --2- 172.21.15.19:0/1627629032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5643feaf9370 0x5643feaf6800 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.371+0000 7fa75bbb8740 1 --2- 172.21.15.19:0/1627629032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643feaefb40 0x5643feaf6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.371+0000 7fa73a7fc640 0 client.17997 ms_handle_reset on v2:172.21.15.203:6834/2702758353 2024-09-19T09:03:16.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.371+0000 7fa75bbb8740 1 --2- 172.21.15.19:0/1627629032 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643feaee5d0 0x5643feaf8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.371+0000 7fa75bbb8740 1 -- 172.21.15.19:0/1627629032 >> 172.21.15.19:0/1627629032 conn(0x5643feab7310 msgr2=0x5643feaf0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:16.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.371+0000 7fa75bbb8740 1 -- 172.21.15.19:0/1627629032 shutdown_connections 2024-09-19T09:03:16.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.371+0000 7fa75bbb8740 1 -- 172.21.15.19:0/1627629032 wait complete. 2024-09-19T09:03:16.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.371+0000 7fa75bbb8740 20 client.17997 trim_cache size 0 max 16384 2024-09-19T09:03:16.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.384+0000 7fa75bbb8740 1 Processor -- start 2024-09-19T09:03:16.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.384+0000 7fa75bbb8740 1 -- start start 2024-09-19T09:03:16.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.384+0000 7fa75bbb8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643feaee5d0 0x5643feaf1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:16.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.384+0000 7fa75bbb8740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643feaefb40 0x5643feaf1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:16.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.384+0000 7fa75bbb8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5643feaf9370 0x5643feb10b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:16.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.384+0000 7fa75bbb8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa7541ad620 con 0x5643feaf9370 2024-09-19T09:03:16.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.384+0000 7fa75bbb8740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa7541af160 con 0x5643feaefb40 2024-09-19T09:03:16.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.384+0000 7fa75bbb8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa7541adcf0 con 0x5643feaee5d0 2024-09-19T09:03:16.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.384+0000 7fa7537fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5643feaf9370 0x5643feb10b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:16.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.384+0000 7fa7537fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5643feaf9370 0x5643feb10b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54800/0 (socket says 172.21.15.19:54800) 2024-09-19T09:03:16.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.384+0000 7fa7537fe640 1 -- 172.21.15.19:0/677489990 learned_addr learned my addr 172.21.15.19:0/677489990 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:16.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.385+0000 7fa74bfff640 1 --2- 172.21.15.19:0/677489990 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643feaefb40 0x5643feaf1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:16.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.385+0000 7fa752ffd640 1 --2- 172.21.15.19:0/677489990 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643feaee5d0 0x5643feaf1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:16.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.385+0000 7fa7537fe640 1 -- 172.21.15.19:0/677489990 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643feaee5d0 msgr2=0x5643feaf1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:16.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.385+0000 7fa7537fe640 1 --2- 172.21.15.19:0/677489990 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643feaee5d0 0x5643feaf1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.385+0000 7fa7537fe640 1 -- 172.21.15.19:0/677489990 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643feaefb40 msgr2=0x5643feaf1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:16.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.385+0000 7fa7537fe640 1 --2- 172.21.15.19:0/677489990 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643feaefb40 0x5643feaf1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.385+0000 7fa7537fe640 1 -- 172.21.15.19:0/677489990 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643feb0b960 con 0x5643feaf9370 2024-09-19T09:03:16.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.385+0000 7fa74bfff640 1 --2- 172.21.15.19:0/677489990 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643feaefb40 0x5643feaf1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:16.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.385+0000 7fa7537fe640 1 --2- 172.21.15.19:0/677489990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5643feaf9370 0x5643feb10b90 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fa74c011d20 tx=0x7fa74c010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61ce2191c0c4d520 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:16.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.385+0000 7fa748ff9640 1 -- 172.21.15.19:0/677489990 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa74c03e070 con 0x5643feaf9370 2024-09-19T09:03:16.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.385+0000 7fa748ff9640 1 -- 172.21.15.19:0/677489990 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa74c02a040 con 0x5643feaf9370 2024-09-19T09:03:16.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.385+0000 7fa748ff9640 1 -- 172.21.15.19:0/677489990 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa74c0058c0 con 0x5643feaf9370 2024-09-19T09:03:16.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.386+0000 7fa75bbb8740 1 -- 172.21.15.19:0/677489990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5643feaf9370 msgr2=0x5643feb10b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:16.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.386+0000 7fa75bbb8740 1 --2- 172.21.15.19:0/677489990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5643feaf9370 0x5643feb10b90 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fa74c011d20 tx=0x7fa74c010740 comp rx=0 tx=0).stop 2024-09-19T09:03:16.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.386+0000 7fa75bbb8740 1 -- 172.21.15.19:0/677489990 shutdown_connections 2024-09-19T09:03:16.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.386+0000 7fa75bbb8740 1 --2- 172.21.15.19:0/677489990 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5643feaf9370 0x5643feb10b90 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.386+0000 7fa75bbb8740 1 --2- 172.21.15.19:0/677489990 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643feaefb40 0x5643feaf1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.386+0000 7fa75bbb8740 1 --2- 172.21.15.19:0/677489990 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643feaee5d0 0x5643feaf1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.386+0000 7fa75bbb8740 1 -- 172.21.15.19:0/677489990 >> 172.21.15.19:0/677489990 conn(0x5643feab7310 msgr2=0x5643feaf5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:16.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.386+0000 7fa75bbb8740 1 -- 172.21.15.19:0/677489990 shutdown_connections 2024-09-19T09:03:16.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.386+0000 7fa75bbb8740 1 -- 172.21.15.19:0/677489990 wait complete. 2024-09-19T09:03:16.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.386+0000 7fa75bbb8740 1 -- start start 2024-09-19T09:03:16.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.386+0000 7fa75bbb8740 1 Processor -- start 2024-09-19T09:03:16.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.387+0000 7fa75bbb8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643feaee5d0 0x5643feb019d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:16.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.387+0000 7fa75bbb8740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643feaefb40 0x5643feafcd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:16.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.387+0000 7fa75bbb8740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5643feaf9370 0x5643feafd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:16.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.387+0000 7fa75bbb8740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa7541aea90 con 0x5643feaf9370 2024-09-19T09:03:16.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.387+0000 7fa75bbb8740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa7541ae3c0 con 0x5643feaefb40 2024-09-19T09:03:16.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.387+0000 7fa75bbb8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa7541ab600 con 0x5643feaee5d0 2024-09-19T09:03:16.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.387+0000 7fa75bbb8740 10 client.0 _ll_register_callbacks cb 0x7fa74c01f020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:16.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.387+0000 7fa7537fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5643feaf9370 0x5643feafd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:16.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.387+0000 7fa7537fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5643feaf9370 0x5643feafd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54814/0 (socket says 172.21.15.19:54814) 2024-09-19T09:03:16.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.387+0000 7fa7537fe640 1 -- 172.21.15.19:0/1383468899 learned_addr learned my addr 172.21.15.19:0/1383468899 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:16.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.387+0000 7fa752ffd640 1 --2- 172.21.15.19:0/1383468899 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643feaee5d0 0x5643feb019d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:16.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.387+0000 7fa74bfff640 1 --2- 172.21.15.19:0/1383468899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643feaefb40 0x5643feafcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:16.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.387+0000 7fa7537fe640 1 -- 172.21.15.19:0/1383468899 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643feaee5d0 msgr2=0x5643feb019d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:16.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.387+0000 7fa7537fe640 1 --2- 172.21.15.19:0/1383468899 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643feaee5d0 0x5643feb019d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.387+0000 7fa7537fe640 1 -- 172.21.15.19:0/1383468899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643feaefb40 msgr2=0x5643feafcd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:16.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.387+0000 7fa7537fe640 1 --2- 172.21.15.19:0/1383468899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643feaefb40 0x5643feafcd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.387+0000 7fa7537fe640 1 -- 172.21.15.19:0/1383468899 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643feaeb960 con 0x5643feaf9370 2024-09-19T09:03:16.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.387+0000 7fa74bfff640 1 --2- 172.21.15.19:0/1383468899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643feaefb40 0x5643feafcd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:16.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.387+0000 7fa7537fe640 1 --2- 172.21.15.19:0/1383468899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5643feaf9370 0x5643feafd240 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fa74c011f60 tx=0x7fa74c0051e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d05d1e01e7431 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:16.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.387+0000 7fa73a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:16.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.387+0000 7fa73a7fc640 1 -- 172.21.15.19:0/1383468899 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa74c046020 con 0x5643feaf9370 2024-09-19T09:03:16.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.387+0000 7fa73a7fc640 1 -- 172.21.15.19:0/1383468899 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7fa74c0058c0 con 0x5643feaf9370 2024-09-19T09:03:16.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.388+0000 7fa75bbb8740 1 -- 172.21.15.19:0/1383468899 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa74c02a040 con 0x5643feaf9370 2024-09-19T09:03:16.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.388+0000 7fa73a7fc640 1 -- 172.21.15.19:0/1383468899 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fa74c03e070 con 0x5643feaf9370 2024-09-19T09:03:16.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.388+0000 7fa75bbb8740 10 client.18003 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:16.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.388+0000 7fa75bbb8740 1 -- 172.21.15.19:0/1383468899 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5643feb737a0 con 0x5643feaf9370 2024-09-19T09:03:16.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.388+0000 7fa73a7fc640 1 -- 172.21.15.19:0/1383468899 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa74c02a040 con 0x5643feaf9370 2024-09-19T09:03:16.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.388+0000 7fa73a7fc640 1 -- 172.21.15.19:0/1383468899 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7fa74c011070 con 0x5643feaf9370 2024-09-19T09:03:16.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.388+0000 7fa75bbb8740 10 client.18003 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:16.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.388+0000 7fa75bbb8740 10 client.18003 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T09:03:16.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.388+0000 7fa75bbb8740 20 client.18003 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:16.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.388+0000 7fa75bbb8740 1 --2- 172.21.15.19:0/1383468899 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5643feb73cc0 0x5643feb760b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:16.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.388+0000 7fa75bbb8740 4 client.18003 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:03:16.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.388+0000 7fa75bbb8740 1 -- 172.21.15.19:0/1383468899 --> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5643fe9d8170 con 0x5643feb73cc0 2024-09-19T09:03:16.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.388+0000 7fa752ffd640 1 --2- 172.21.15.19:0/1383468899 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5643feb73cc0 0x5643feb760b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:16.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.389+0000 7fa752ffd640 1 --2- 172.21.15.19:0/1383468899 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5643feb73cc0 0x5643feb760b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=80ceebca1e7ad60f server_cookie=eb0a994bdd85f733 in_seq=0 out_seq=0 2024-09-19T09:03:16.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.389+0000 7fa73a7fc640 10 client.18003 ms_handle_connect on v2:172.21.15.203:6834/2702758353 2024-09-19T09:03:16.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.389+0000 7fa73a7fc640 1 -- 172.21.15.19:0/1383468899 <== mds.4 v2:172.21.15.203:6834/2702758353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5643fe9d8170 con 0x5643feb73cc0 2024-09-19T09:03:16.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.389+0000 7fa73a7fc640 10 client.18003 handle_command_reply: tid=0 2024-09-19T09:03:16.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.389+0000 7fa75bbb8740 1 client.18003 shutdown 2024-09-19T09:03:16.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.389+0000 7fa75bbb8740 1 -- 172.21.15.19:0/1383468899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5643feaf9370 msgr2=0x5643feafd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:16.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.389+0000 7fa75bbb8740 1 --2- 172.21.15.19:0/1383468899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5643feaf9370 0x5643feafd240 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fa74c011f60 tx=0x7fa74c0051e0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.389+0000 7fa75bbb8740 1 -- 172.21.15.19:0/1383468899 shutdown_connections 2024-09-19T09:03:16.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.389+0000 7fa75bbb8740 1 --2- 172.21.15.19:0/1383468899 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x5643feb73cc0 0x5643feb760b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.389+0000 7fa75bbb8740 1 --2- 172.21.15.19:0/1383468899 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5643feaf9370 0x5643feafd240 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.389+0000 7fa73a7fc640 0 client.18003 ms_handle_reset on v2:172.21.15.203:6834/2702758353 2024-09-19T09:03:16.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.389+0000 7fa75bbb8740 1 --2- 172.21.15.19:0/1383468899 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5643feaefb40 0x5643feafcd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.389+0000 7fa75bbb8740 1 --2- 172.21.15.19:0/1383468899 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5643feaee5d0 0x5643feb019d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.389+0000 7fa75bbb8740 1 -- 172.21.15.19:0/1383468899 >> 172.21.15.19:0/1383468899 conn(0x5643feab7310 msgr2=0x5643feaf78d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:16.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.389+0000 7fa75bbb8740 1 -- 172.21.15.19:0/1383468899 shutdown_connections 2024-09-19T09:03:16.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.389+0000 7fa75bbb8740 1 -- 172.21.15.19:0/1383468899 wait complete. 2024-09-19T09:03:16.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.390+0000 7fa75bbb8740 20 client.18003 trim_cache size 0 max 16384 2024-09-19T09:03:16.398 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:03:16.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.390+0000 7fa7597df640 1 -- 172.21.15.19:0/3413662691 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa7400a3240 msgr2=0x7fa7400a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:16.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.390+0000 7fa7597df640 1 --2- 172.21.15.19:0/3413662691 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa7400a3240 0x7fa7400a5700 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa74c020000 tx=0x7fa74c01d000 comp rx=0 tx=0).stop 2024-09-19T09:03:16.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.390+0000 7fa7597df640 1 -- 172.21.15.19:0/3413662691 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa754102790 msgr2=0x7fa754198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:16.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.390+0000 7fa7597df640 1 --2- 172.21.15.19:0/3413662691 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa754102790 0x7fa754198990 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fa73c00c890 tx=0x7fa73c00cd50 comp rx=0 tx=0).stop 2024-09-19T09:03:16.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.390+0000 7fa7597df640 1 -- 172.21.15.19:0/3413662691 shutdown_connections 2024-09-19T09:03:16.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.390+0000 7fa7597df640 1 --2- 172.21.15.19:0/3413662691 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa7400a3240 0x7fa7400a5700 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.390+0000 7fa7597df640 1 --2- 172.21.15.19:0/3413662691 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa754106f10 0x7fa75419cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.390+0000 7fa7597df640 1 --2- 172.21.15.19:0/3413662691 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa754102790 0x7fa754198990 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.390+0000 7fa7597df640 1 --2- 172.21.15.19:0/3413662691 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa754101de0 0x7fa754198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:16.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.390+0000 7fa7597df640 1 -- 172.21.15.19:0/3413662691 >> 172.21.15.19:0/3413662691 conn(0x7fa7540fd8c0 msgr2=0x7fa7540fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:16.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.390+0000 7fa7597df640 1 -- 172.21.15.19:0/3413662691 shutdown_connections 2024-09-19T09:03:16.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:16.390+0000 7fa7597df640 1 -- 172.21.15.19:0/3413662691 wait complete. 2024-09-19T09:03:17.029 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T09:03:17.329 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:17.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.812+0000 7f317a4a5640 1 -- 172.21.15.19:0/3444657114 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3174106f10 msgr2=0x7f317410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:17.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.812+0000 7f317a4a5640 1 --2- 172.21.15.19:0/3444657114 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3174106f10 0x7f317410ea90 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f316c009ca0 tx=0x7f316c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.812+0000 7f317a4a5640 1 -- 172.21.15.19:0/3444657114 shutdown_connections 2024-09-19T09:03:17.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.812+0000 7f317a4a5640 1 --2- 172.21.15.19:0/3444657114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3174102790 0x7f31741067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.812+0000 7f317a4a5640 1 --2- 172.21.15.19:0/3444657114 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3174106f10 0x7f317410ea90 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.812+0000 7f317a4a5640 1 --2- 172.21.15.19:0/3444657114 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3174101de0 0x7f31741021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.812+0000 7f317a4a5640 1 -- 172.21.15.19:0/3444657114 >> 172.21.15.19:0/3444657114 conn(0x7f31740fd8c0 msgr2=0x7f31740ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:17.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.812+0000 7f317a4a5640 1 -- 172.21.15.19:0/3444657114 shutdown_connections 2024-09-19T09:03:17.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.812+0000 7f317a4a5640 1 -- 172.21.15.19:0/3444657114 wait complete. 2024-09-19T09:03:17.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.812+0000 7f317a4a5640 1 Processor -- start 2024-09-19T09:03:17.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.812+0000 7f317a4a5640 1 -- start start 2024-09-19T09:03:17.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.813+0000 7f317a4a5640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3174101de0 0x7f3174198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:17.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.813+0000 7f317a4a5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3174102790 0x7f3174198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:17.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.813+0000 7f317a4a5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3174106f10 0x7f317419cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:17.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.813+0000 7f317a4a5640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3174111f70 con 0x7f3174106f10 2024-09-19T09:03:17.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.813+0000 7f317a4a5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3174111df0 con 0x7f3174102790 2024-09-19T09:03:17.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.813+0000 7f317a4a5640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f31741120f0 con 0x7f3174101de0 2024-09-19T09:03:17.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.813+0000 7f3178a42640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3174106f10 0x7f317419cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:17.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.813+0000 7f3178a42640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3174106f10 0x7f317419cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54832/0 (socket says 172.21.15.19:54832) 2024-09-19T09:03:17.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.813+0000 7f3178a42640 1 -- 172.21.15.19:0/4218028677 learned_addr learned my addr 172.21.15.19:0/4218028677 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:17.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.813+0000 7f3173fff640 1 --2- 172.21.15.19:0/4218028677 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3174101de0 0x7f3174198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:17.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.813+0000 7f316bfff640 1 --2- 172.21.15.19:0/4218028677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3174102790 0x7f3174198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:17.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.813+0000 7f3178a42640 1 -- 172.21.15.19:0/4218028677 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3174101de0 msgr2=0x7f3174198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:17.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.813+0000 7f3178a42640 1 --2- 172.21.15.19:0/4218028677 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3174101de0 0x7f3174198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.813+0000 7f3178a42640 1 -- 172.21.15.19:0/4218028677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3174102790 msgr2=0x7f3174198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:17.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.813+0000 7f3178a42640 1 --2- 172.21.15.19:0/4218028677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3174102790 0x7f3174198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.813+0000 7f3178a42640 1 -- 172.21.15.19:0/4218028677 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f317419d2e0 con 0x7f3174106f10 2024-09-19T09:03:17.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.813+0000 7f316bfff640 1 --2- 172.21.15.19:0/4218028677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3174102790 0x7f3174198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:17.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.813+0000 7f3178a42640 1 --2- 172.21.15.19:0/4218028677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3174106f10 0x7f317419cc00 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f316c031a60 tx=0x7f316c031a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:17.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.814+0000 7f3171ffb640 1 -- 172.21.15.19:0/4218028677 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c003b70 con 0x7f3174106f10 2024-09-19T09:03:17.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.814+0000 7f3171ffb640 1 -- 172.21.15.19:0/4218028677 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f316c003d10 con 0x7f3174106f10 2024-09-19T09:03:17.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.814+0000 7f3171ffb640 1 -- 172.21.15.19:0/4218028677 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316c004770 con 0x7f3174106f10 2024-09-19T09:03:17.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.814+0000 7f317a4a5640 1 -- 172.21.15.19:0/4218028677 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f317419d570 con 0x7f3174106f10 2024-09-19T09:03:17.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.814+0000 7f317a4a5640 1 -- 172.21.15.19:0/4218028677 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31741a4eb0 con 0x7f3174106f10 2024-09-19T09:03:17.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.816+0000 7f3171ffb640 1 -- 172.21.15.19:0/4218028677 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f316c02f790 con 0x7f3174106f10 2024-09-19T09:03:17.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.816+0000 7f317c87e740 1 Processor -- start 2024-09-19T09:03:17.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.817+0000 7f317c87e740 1 -- start start 2024-09-19T09:03:17.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.817+0000 7f317c87e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0a6fedb40 0x55e0a6fec090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:17.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.817+0000 7f317c87e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0a6fec5d0 0x55e0a6feca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:17.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.817+0000 7f317c87e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0a6ff7370 0x55e0a6ff9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:17.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.817+0000 7f317c87e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e0a6f522f0 con 0x55e0a6fedb40 2024-09-19T09:03:17.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.817+0000 7f317c87e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55e0a6ef9cf0 con 0x55e0a6fec5d0 2024-09-19T09:03:17.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.817+0000 7f317c87e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e0a6f4e2b0 con 0x55e0a6ff7370 2024-09-19T09:03:17.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.817+0000 7f316bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0a6fedb40 0x55e0a6fec090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:17.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.817+0000 7f316bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0a6fedb40 0x55e0a6fec090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54840/0 (socket says 172.21.15.19:54840) 2024-09-19T09:03:17.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.817+0000 7f316bfff640 1 -- 172.21.15.19:0/1822119245 learned_addr learned my addr 172.21.15.19:0/1822119245 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:17.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.817+0000 7f3173fff640 1 --2- 172.21.15.19:0/1822119245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0a6fec5d0 0x55e0a6feca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:17.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.817+0000 7f316bfff640 1 --2- 172.21.15.19:0/1822119245 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0a6ff7370 0x55e0a6ff9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:17.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.817+0000 7f3171ffb640 1 --2- 172.21.15.19:0/4218028677 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f31600a32c0 0x7f31600a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:17.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.817+0000 7f316bfff640 1 -- 172.21.15.19:0/1822119245 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0a6ff7370 msgr2=0x55e0a6ff9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:17.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.817+0000 7f316bfff640 1 --2- 172.21.15.19:0/1822119245 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0a6ff7370 0x55e0a6ff9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.817+0000 7f316bfff640 1 -- 172.21.15.19:0/1822119245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0a6fec5d0 msgr2=0x55e0a6feca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:17.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.817+0000 7f316bfff640 1 --2- 172.21.15.19:0/1822119245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0a6fec5d0 0x55e0a6feca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.817+0000 7f316bfff640 1 -- 172.21.15.19:0/1822119245 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0a6ede3a0 con 0x55e0a6fedb40 2024-09-19T09:03:17.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.817+0000 7f3178a42640 1 --2- 172.21.15.19:0/4218028677 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f31600a32c0 0x7f31600a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:17.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.818+0000 7f316bfff640 1 --2- 172.21.15.19:0/1822119245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0a6fedb40 0x55e0a6fec090 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f315c00bfc0 tx=0x7f315c00b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4ba6c8fa373968d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:17.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.818+0000 7f3171ffb640 1 -- 172.21.15.19:0/4218028677 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f316c0f0c50 con 0x7f3174106f10 2024-09-19T09:03:17.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.818+0000 7f316a7fc640 1 -- 172.21.15.19:0/1822119245 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315c012860 con 0x55e0a6fedb40 2024-09-19T09:03:17.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.818+0000 7f316a7fc640 1 -- 172.21.15.19:0/1822119245 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f315c011440 con 0x55e0a6fedb40 2024-09-19T09:03:17.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.818+0000 7f316a7fc640 1 -- 172.21.15.19:0/1822119245 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315c010610 con 0x55e0a6fedb40 2024-09-19T09:03:17.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.819+0000 7f317c87e740 1 -- 172.21.15.19:0/1822119245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0a6fedb40 msgr2=0x55e0a6fec090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:17.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.819+0000 7f317c87e740 1 --2- 172.21.15.19:0/1822119245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0a6fedb40 0x55e0a6fec090 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f315c00bfc0 tx=0x7f315c00b4c0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.819+0000 7f3178a42640 1 --2- 172.21.15.19:0/4218028677 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f31600a32c0 0x7f31600a5780 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f316c031b50 tx=0x7f316c0c1040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:17.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.819+0000 7f317c87e740 1 -- 172.21.15.19:0/1822119245 shutdown_connections 2024-09-19T09:03:17.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.819+0000 7f317c87e740 1 --2- 172.21.15.19:0/1822119245 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0a6ff7370 0x55e0a6ff9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.819+0000 7f317c87e740 1 --2- 172.21.15.19:0/1822119245 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0a6fec5d0 0x55e0a6feca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.819+0000 7f317c87e740 1 --2- 172.21.15.19:0/1822119245 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0a6fedb40 0x55e0a6fec090 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.819+0000 7f317c87e740 1 -- 172.21.15.19:0/1822119245 >> 172.21.15.19:0/1822119245 conn(0x55e0a6fb5310 msgr2=0x55e0a6fe8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:17.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.819+0000 7f317c87e740 1 -- 172.21.15.19:0/1822119245 shutdown_connections 2024-09-19T09:03:17.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.819+0000 7f317c87e740 1 -- 172.21.15.19:0/1822119245 wait complete. 2024-09-19T09:03:17.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.819+0000 7f317c87e740 1 -- start start 2024-09-19T09:03:17.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.819+0000 7f317c87e740 1 Processor -- start 2024-09-19T09:03:17.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.819+0000 7f317c87e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0a6fec5d0 0x55e0a6ff6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:17.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.819+0000 7f317c87e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0a6fedb40 0x55e0a6ff3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:17.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.819+0000 7f317c87e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0a6ff7370 0x55e0a6ff4530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:17.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.819+0000 7f317c87e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e0a6ffa070 con 0x55e0a6fedb40 2024-09-19T09:03:17.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.819+0000 7f317c87e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55e0a6f0d060 con 0x55e0a6ff7370 2024-09-19T09:03:17.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.819+0000 7f317c87e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e0a6ffa1f0 con 0x55e0a6fec5d0 2024-09-19T09:03:17.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.820+0000 7f317c87e740 10 client.0 _ll_register_callbacks cb 0x55e0a6c608c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:17.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.820+0000 7f3173fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0a6fedb40 0x55e0a6ff3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:17.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.820+0000 7f3173fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0a6fedb40 0x55e0a6ff3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54854/0 (socket says 172.21.15.19:54854) 2024-09-19T09:03:17.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.820+0000 7f3173fff640 1 -- 172.21.15.19:0/4046583211 learned_addr learned my addr 172.21.15.19:0/4046583211 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:17.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.820+0000 7f316bfff640 1 --2- 172.21.15.19:0/4046583211 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0a6fec5d0 0x55e0a6ff6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:17.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.820+0000 7f316bfff640 1 --2- 172.21.15.19:0/4046583211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0a6ff7370 0x55e0a6ff4530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:17.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.820+0000 7f3173fff640 1 -- 172.21.15.19:0/4046583211 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0a6fec5d0 msgr2=0x55e0a6ff6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:17.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.820+0000 7f3173fff640 1 --2- 172.21.15.19:0/4046583211 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0a6fec5d0 0x55e0a6ff6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.820+0000 7f3173fff640 1 -- 172.21.15.19:0/4046583211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0a6ff7370 msgr2=0x55e0a6ff4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:17.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.820+0000 7f3173fff640 1 --2- 172.21.15.19:0/4046583211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0a6ff7370 0x55e0a6ff4530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.820+0000 7f3173fff640 1 -- 172.21.15.19:0/4046583211 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0a6cc33c0 con 0x55e0a6fedb40 2024-09-19T09:03:17.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.820+0000 7f3173fff640 1 --2- 172.21.15.19:0/4046583211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0a6fedb40 0x55e0a6ff3fb0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f3164010a50 tx=0x7f3164010f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c321909294b21a7e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:17.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.820+0000 7f31537fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:17.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.820+0000 7f31537fe640 1 -- 172.21.15.19:0/4046583211 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316401e060 con 0x55e0a6fedb40 2024-09-19T09:03:17.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.820+0000 7f31537fe640 1 -- 172.21.15.19:0/4046583211 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f316400fbd0 con 0x55e0a6fedb40 2024-09-19T09:03:17.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.820+0000 7f317c87e740 1 -- 172.21.15.19:0/4046583211 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f315c011440 con 0x55e0a6fedb40 2024-09-19T09:03:17.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.821+0000 7f31537fe640 1 -- 172.21.15.19:0/4046583211 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f316400fdd0 con 0x55e0a6fedb40 2024-09-19T09:03:17.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.821+0000 7f317c87e740 10 client.18015 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:17.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.821+0000 7f317c87e740 1 -- 172.21.15.19:0/4046583211 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55e0a7005b00 con 0x55e0a6fedb40 2024-09-19T09:03:17.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.821+0000 7f31537fe640 1 -- 172.21.15.19:0/4046583211 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f315c011440 con 0x55e0a6fedb40 2024-09-19T09:03:17.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.821+0000 7f31537fe640 1 -- 172.21.15.19:0/4046583211 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f316400e610 con 0x55e0a6fedb40 2024-09-19T09:03:17.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.821+0000 7f317c87e740 10 client.18015 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:17.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.821+0000 7f317c87e740 10 client.18015 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-19T09:03:17.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.821+0000 7f317c87e740 20 client.18015 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:17.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.821+0000 7f317c87e740 1 --2- 172.21.15.19:0/4046583211 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55e0a7007010 0x55e0a7009430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:17.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.821+0000 7f317c87e740 4 client.18015 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:17.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.821+0000 7f317c87e740 1 -- 172.21.15.19:0/4046583211 --> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e0a6f5f860 con 0x55e0a7007010 2024-09-19T09:03:17.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.821+0000 7f316bfff640 1 --2- 172.21.15.19:0/4046583211 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55e0a7007010 0x55e0a7009430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:17.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.822+0000 7f31537fe640 10 client.18015 ms_handle_connect on v2:172.21.15.155:6836/3381010945 2024-09-19T09:03:17.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.822+0000 7f316bfff640 1 --2- 172.21.15.19:0/4046583211 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55e0a7007010 0x55e0a7009430 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1e809cb2a15d45af server_cookie=654c8123ee34708f in_seq=0 out_seq=0 2024-09-19T09:03:17.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.823+0000 7f31537fe640 1 -- 172.21.15.19:0/4046583211 <== mds.3 v2:172.21.15.155:6836/3381010945 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e0a6f5f860 con 0x55e0a7007010 2024-09-19T09:03:17.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.823+0000 7f31537fe640 10 client.18015 handle_command_reply: tid=0 2024-09-19T09:03:17.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.823+0000 7f317c87e740 1 client.18015 shutdown 2024-09-19T09:03:17.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.823+0000 7f317c87e740 1 -- 172.21.15.19:0/4046583211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0a6fedb40 msgr2=0x55e0a6ff3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:17.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.823+0000 7f317c87e740 1 --2- 172.21.15.19:0/4046583211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0a6fedb40 0x55e0a6ff3fb0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f3164010a50 tx=0x7f3164010f10 comp rx=0 tx=0).stop 2024-09-19T09:03:17.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.823+0000 7f317c87e740 1 -- 172.21.15.19:0/4046583211 shutdown_connections 2024-09-19T09:03:17.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.823+0000 7f317c87e740 1 --2- 172.21.15.19:0/4046583211 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55e0a7007010 0x55e0a7009430 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.823+0000 7f317c87e740 1 --2- 172.21.15.19:0/4046583211 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0a6ff7370 0x55e0a6ff4530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.823+0000 7f31537fe640 0 client.18015 ms_handle_reset on v2:172.21.15.155:6836/3381010945 2024-09-19T09:03:17.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.823+0000 7f317c87e740 1 --2- 172.21.15.19:0/4046583211 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0a6fedb40 0x55e0a6ff3fb0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.823+0000 7f317c87e740 1 --2- 172.21.15.19:0/4046583211 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0a6fec5d0 0x55e0a6ff6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.823+0000 7f317c87e740 1 -- 172.21.15.19:0/4046583211 >> 172.21.15.19:0/4046583211 conn(0x55e0a6fb5310 msgr2=0x55e0a6fee930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:17.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.823+0000 7f317c87e740 1 -- 172.21.15.19:0/4046583211 shutdown_connections 2024-09-19T09:03:17.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.823+0000 7f317c87e740 1 -- 172.21.15.19:0/4046583211 wait complete. 2024-09-19T09:03:17.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.823+0000 7f317c87e740 20 client.18015 trim_cache size 0 max 16384 2024-09-19T09:03:17.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.836+0000 7f317c87e740 1 Processor -- start 2024-09-19T09:03:17.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.836+0000 7f317c87e740 1 -- start start 2024-09-19T09:03:17.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.837+0000 7f317c87e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0a6fec5d0 0x55e0a7003310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:17.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.837+0000 7f317c87e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0a6fedb40 0x55e0a6fe3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:17.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.837+0000 7f317c87e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0a6ff7370 0x55e0a6ff2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:17.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.837+0000 7f317c87e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f31741ad380 con 0x55e0a6ff7370 2024-09-19T09:03:17.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.837+0000 7f317c87e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f31741aeec0 con 0x55e0a6fec5d0 2024-09-19T09:03:17.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.837+0000 7f317c87e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f31741ada50 con 0x55e0a6fedb40 2024-09-19T09:03:17.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.837+0000 7f316bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0a6ff7370 0x55e0a6ff2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:17.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.837+0000 7f316bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0a6ff7370 0x55e0a6ff2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54860/0 (socket says 172.21.15.19:54860) 2024-09-19T09:03:17.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.837+0000 7f316bfff640 1 -- 172.21.15.19:0/4014512931 learned_addr learned my addr 172.21.15.19:0/4014512931 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:17.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.837+0000 7f3173fff640 1 --2- 172.21.15.19:0/4014512931 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0a6fedb40 0x55e0a6fe3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:17.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.837+0000 7f316bfff640 1 --2- 172.21.15.19:0/4014512931 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0a6fec5d0 0x55e0a7003310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:17.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.837+0000 7f316bfff640 1 -- 172.21.15.19:0/4014512931 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0a6fedb40 msgr2=0x55e0a6fe3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:17.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.837+0000 7f316bfff640 1 --2- 172.21.15.19:0/4014512931 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0a6fedb40 0x55e0a6fe3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.837+0000 7f316bfff640 1 -- 172.21.15.19:0/4014512931 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0a6fec5d0 msgr2=0x55e0a7003310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:17.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.837+0000 7f316bfff640 1 --2- 172.21.15.19:0/4014512931 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0a6fec5d0 0x55e0a7003310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.837+0000 7f316bfff640 1 -- 172.21.15.19:0/4014512931 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e0a6fe9960 con 0x55e0a6ff7370 2024-09-19T09:03:17.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.837+0000 7f3173fff640 1 --2- 172.21.15.19:0/4014512931 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0a6fedb40 0x55e0a6fe3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:17.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.837+0000 7f316bfff640 1 --2- 172.21.15.19:0/4014512931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0a6ff7370 0x55e0a6ff2f90 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f315c00b7f0 tx=0x7f315c00b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eece0ba5f7891713 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:17.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.838+0000 7f3169ffb640 1 -- 172.21.15.19:0/4014512931 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315c026040 con 0x55e0a6ff7370 2024-09-19T09:03:17.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.838+0000 7f3169ffb640 1 -- 172.21.15.19:0/4014512931 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f315c011640 con 0x55e0a6ff7370 2024-09-19T09:03:17.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.838+0000 7f3169ffb640 1 -- 172.21.15.19:0/4014512931 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315c0105e0 con 0x55e0a6ff7370 2024-09-19T09:03:17.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.838+0000 7f317c87e740 1 -- 172.21.15.19:0/4014512931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0a6ff7370 msgr2=0x55e0a6ff2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:17.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.838+0000 7f317c87e740 1 --2- 172.21.15.19:0/4014512931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0a6ff7370 0x55e0a6ff2f90 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f315c00b7f0 tx=0x7f315c00b4c0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.838+0000 7f317c87e740 1 -- 172.21.15.19:0/4014512931 shutdown_connections 2024-09-19T09:03:17.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.838+0000 7f317c87e740 1 --2- 172.21.15.19:0/4014512931 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0a6fedb40 0x55e0a6fe3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.838+0000 7f317c87e740 1 --2- 172.21.15.19:0/4014512931 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0a6ff7370 0x55e0a6ff2f90 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.838+0000 7f317c87e740 1 --2- 172.21.15.19:0/4014512931 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0a6fec5d0 0x55e0a7003310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.838+0000 7f317c87e740 1 -- 172.21.15.19:0/4014512931 >> 172.21.15.19:0/4014512931 conn(0x55e0a6fb5310 msgr2=0x55e0a6ff2880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:17.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.838+0000 7f317c87e740 1 -- 172.21.15.19:0/4014512931 shutdown_connections 2024-09-19T09:03:17.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.838+0000 7f317c87e740 1 -- 172.21.15.19:0/4014512931 wait complete. 2024-09-19T09:03:17.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.839+0000 7f317c87e740 1 -- start start 2024-09-19T09:03:17.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.839+0000 7f317c87e740 1 Processor -- start 2024-09-19T09:03:17.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.839+0000 7f317c87e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0a6fec5d0 0x55e0a6ffb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:17.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.839+0000 7f317c87e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0a6fedb40 0x55e0a6ffb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:17.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.839+0000 7f317c87e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0a6ff7370 0x55e0a6ffbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:17.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.839+0000 7f317c87e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f31741ae7f0 con 0x55e0a6fedb40 2024-09-19T09:03:17.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.839+0000 7f317c87e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f31741ae120 con 0x55e0a6ff7370 2024-09-19T09:03:17.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.839+0000 7f317c87e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f31741ab360 con 0x55e0a6fec5d0 2024-09-19T09:03:17.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.839+0000 7f317c87e740 10 client.0 _ll_register_callbacks cb 0x7f316400a820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:17.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.839+0000 7f3173fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0a6fedb40 0x55e0a6ffb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:17.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.839+0000 7f3173fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0a6fedb40 0x55e0a6ffb680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54868/0 (socket says 172.21.15.19:54868) 2024-09-19T09:03:17.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.839+0000 7f3173fff640 1 -- 172.21.15.19:0/1421550223 learned_addr learned my addr 172.21.15.19:0/1421550223 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:17.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.840+0000 7f316bfff640 1 --2- 172.21.15.19:0/1421550223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0a6ff7370 0x55e0a6ffbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:17.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.840+0000 7f316bfff640 1 --2- 172.21.15.19:0/1421550223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0a6fec5d0 0x55e0a6ffb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:17.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.840+0000 7f3173fff640 1 -- 172.21.15.19:0/1421550223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0a6fec5d0 msgr2=0x55e0a6ffb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:17.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.840+0000 7f3173fff640 1 --2- 172.21.15.19:0/1421550223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0a6fec5d0 0x55e0a6ffb140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.840+0000 7f3173fff640 1 -- 172.21.15.19:0/1421550223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0a6ff7370 msgr2=0x55e0a6ffbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:17.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.840+0000 7f3173fff640 1 --2- 172.21.15.19:0/1421550223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0a6ff7370 0x55e0a6ffbbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.840+0000 7f3173fff640 1 -- 172.21.15.19:0/1421550223 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e0a6fef120 con 0x55e0a6fedb40 2024-09-19T09:03:17.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.840+0000 7f316bfff640 1 --2- 172.21.15.19:0/1421550223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0a6ff7370 0x55e0a6ffbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:17.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.840+0000 7f3173fff640 1 --2- 172.21.15.19:0/1421550223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0a6fedb40 0x55e0a6ffb680 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f3164025020 tx=0x7f316400efd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb4c19899513cd34 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:17.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.840+0000 7f31537fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:17.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.840+0000 7f31537fe640 1 -- 172.21.15.19:0/1421550223 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3164032060 con 0x55e0a6fedb40 2024-09-19T09:03:17.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.840+0000 7f31537fe640 1 -- 172.21.15.19:0/1421550223 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f316400fbd0 con 0x55e0a6fedb40 2024-09-19T09:03:17.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.840+0000 7f317c87e740 1 -- 172.21.15.19:0/1421550223 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f315c011640 con 0x55e0a6fedb40 2024-09-19T09:03:17.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.840+0000 7f31537fe640 1 -- 172.21.15.19:0/1421550223 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f3164029040 con 0x55e0a6fedb40 2024-09-19T09:03:17.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.840+0000 7f317c87e740 10 client.18021 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:17.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.840+0000 7f317c87e740 1 -- 172.21.15.19:0/1421550223 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55e0a7076130 con 0x55e0a6fedb40 2024-09-19T09:03:17.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.841+0000 7f31537fe640 1 -- 172.21.15.19:0/1421550223 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f315c011640 con 0x55e0a6fedb40 2024-09-19T09:03:17.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.841+0000 7f31537fe640 1 -- 172.21.15.19:0/1421550223 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f3164004660 con 0x55e0a6fedb40 2024-09-19T09:03:17.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.841+0000 7f317c87e740 10 client.18021 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:17.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.841+0000 7f317c87e740 10 client.18021 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-19T09:03:17.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.841+0000 7f317c87e740 20 client.18021 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:17.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.841+0000 7f317c87e740 1 --2- 172.21.15.19:0/1421550223 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55e0a7007010 0x55e0a7078840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:17.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.841+0000 7f317c87e740 4 client.18021 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:03:17.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.841+0000 7f317c87e740 1 -- 172.21.15.19:0/1421550223 --> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e0a6f59d70 con 0x55e0a7007010 2024-09-19T09:03:17.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.841+0000 7f316bfff640 1 --2- 172.21.15.19:0/1421550223 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55e0a7007010 0x55e0a7078840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:17.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.842+0000 7f316bfff640 1 --2- 172.21.15.19:0/1421550223 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55e0a7007010 0x55e0a7078840 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7888d42c5c21de3f server_cookie=93af94a689d48ea9 in_seq=0 out_seq=0 2024-09-19T09:03:17.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.842+0000 7f31537fe640 10 client.18021 ms_handle_connect on v2:172.21.15.155:6836/3381010945 2024-09-19T09:03:17.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.842+0000 7f31537fe640 1 -- 172.21.15.19:0/1421550223 <== mds.3 v2:172.21.15.155:6836/3381010945 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e0a6f59d70 con 0x55e0a7007010 2024-09-19T09:03:17.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.842+0000 7f31537fe640 10 client.18021 handle_command_reply: tid=0 2024-09-19T09:03:17.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.842+0000 7f317c87e740 1 client.18021 shutdown 2024-09-19T09:03:17.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.842+0000 7f317c87e740 1 -- 172.21.15.19:0/1421550223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0a6fedb40 msgr2=0x55e0a6ffb680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:17.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.842+0000 7f317c87e740 1 --2- 172.21.15.19:0/1421550223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0a6fedb40 0x55e0a6ffb680 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f3164025020 tx=0x7f316400efd0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.842+0000 7f317c87e740 1 -- 172.21.15.19:0/1421550223 shutdown_connections 2024-09-19T09:03:17.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.842+0000 7f317c87e740 1 --2- 172.21.15.19:0/1421550223 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55e0a7007010 0x55e0a7078840 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.842+0000 7f317c87e740 1 --2- 172.21.15.19:0/1421550223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e0a6ff7370 0x55e0a6ffbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.842+0000 7f317c87e740 1 --2- 172.21.15.19:0/1421550223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e0a6fedb40 0x55e0a6ffb680 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.842+0000 7f317c87e740 1 --2- 172.21.15.19:0/1421550223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e0a6fec5d0 0x55e0a6ffb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.842+0000 7f317c87e740 1 -- 172.21.15.19:0/1421550223 >> 172.21.15.19:0/1421550223 conn(0x55e0a6fb5310 msgr2=0x55e0a6ff30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:17.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.842+0000 7f31537fe640 0 client.18021 ms_handle_reset on v2:172.21.15.155:6836/3381010945 2024-09-19T09:03:17.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.842+0000 7f317c87e740 1 -- 172.21.15.19:0/1421550223 shutdown_connections 2024-09-19T09:03:17.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.842+0000 7f317c87e740 1 -- 172.21.15.19:0/1421550223 wait complete. 2024-09-19T09:03:17.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.842+0000 7f317c87e740 20 client.18021 trim_cache size 0 max 16384 2024-09-19T09:03:17.851 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:03:17.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.843+0000 7f317a4a5640 1 -- 172.21.15.19:0/4218028677 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f31600a32c0 msgr2=0x7f31600a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:17.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.843+0000 7f317a4a5640 1 --2- 172.21.15.19:0/4218028677 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f31600a32c0 0x7f31600a5780 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f316c031b50 tx=0x7f316c0c1040 comp rx=0 tx=0).stop 2024-09-19T09:03:17.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.843+0000 7f317a4a5640 1 -- 172.21.15.19:0/4218028677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3174106f10 msgr2=0x7f317419cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:17.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.843+0000 7f317a4a5640 1 --2- 172.21.15.19:0/4218028677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3174106f10 0x7f317419cc00 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f316c031a60 tx=0x7f316c031a90 comp rx=0 tx=0).stop 2024-09-19T09:03:17.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.843+0000 7f317a4a5640 1 -- 172.21.15.19:0/4218028677 shutdown_connections 2024-09-19T09:03:17.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.843+0000 7f317a4a5640 1 --2- 172.21.15.19:0/4218028677 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f31600a32c0 0x7f31600a5780 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.843+0000 7f317a4a5640 1 --2- 172.21.15.19:0/4218028677 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3174106f10 0x7f317419cc00 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.843+0000 7f317a4a5640 1 --2- 172.21.15.19:0/4218028677 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3174102790 0x7f3174198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.843+0000 7f317a4a5640 1 --2- 172.21.15.19:0/4218028677 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3174101de0 0x7f3174198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:17.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.843+0000 7f317a4a5640 1 -- 172.21.15.19:0/4218028677 >> 172.21.15.19:0/4218028677 conn(0x7f31740fd8c0 msgr2=0x7f31740febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:17.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.843+0000 7f317a4a5640 1 -- 172.21.15.19:0/4218028677 shutdown_connections 2024-09-19T09:03:17.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:17.843+0000 7f317a4a5640 1 -- 172.21.15.19:0/4218028677 wait complete. 2024-09-19T09:03:18.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:17 smithi019 ceph-mon[30976]: pgmap v671: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.0 KiB/s wr, 27 op/s 2024-09-19T09:03:18.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:17 smithi155 ceph-mon[34921]: pgmap v671: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.0 KiB/s wr, 27 op/s 2024-09-19T09:03:18.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:17 smithi203 ceph-mon[35450]: pgmap v671: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.0 KiB/s wr, 27 op/s 2024-09-19T09:03:18.666 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:03:18.924 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:19.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.406+0000 7f29f450c640 1 -- 172.21.15.19:0/1375722424 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29ec101300 msgr2=0x7f29ec10dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:19.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.406+0000 7f29f450c640 1 --2- 172.21.15.19:0/1375722424 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29ec101300 0x7f29ec10dfc0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f29dc009900 tx=0x7f29dc02a410 comp rx=0 tx=0).stop 2024-09-19T09:03:19.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.406+0000 7f29f450c640 1 -- 172.21.15.19:0/1375722424 shutdown_connections 2024-09-19T09:03:19.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.406+0000 7f29f450c640 1 --2- 172.21.15.19:0/1375722424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29ec10e500 0x7f29ec1108f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.406+0000 7f29f450c640 1 --2- 172.21.15.19:0/1375722424 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29ec101300 0x7f29ec10dfc0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.406+0000 7f29f450c640 1 --2- 172.21.15.19:0/1375722424 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f29ec100950 0x7f29ec100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.406+0000 7f29f450c640 1 -- 172.21.15.19:0/1375722424 >> 172.21.15.19:0/1375722424 conn(0x7f29ec0fc7a0 msgr2=0x7f29ec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:19.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.406+0000 7f29f450c640 1 -- 172.21.15.19:0/1375722424 shutdown_connections 2024-09-19T09:03:19.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.406+0000 7f29f450c640 1 -- 172.21.15.19:0/1375722424 wait complete. 2024-09-19T09:03:19.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.407+0000 7f29f450c640 1 Processor -- start 2024-09-19T09:03:19.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.407+0000 7f29f450c640 1 -- start start 2024-09-19T09:03:19.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.407+0000 7f29f450c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29ec100950 0x7f29ec19a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:19.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.407+0000 7f29f450c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29ec101300 0x7f29ec19ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:19.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.407+0000 7f29f450c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f29ec10e500 0x7f29ec19eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:19.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.407+0000 7f29f450c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f29ec114200 con 0x7f29ec101300 2024-09-19T09:03:19.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.407+0000 7f29f450c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f29ec114080 con 0x7f29ec100950 2024-09-19T09:03:19.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.407+0000 7f29f450c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f29ec114380 con 0x7f29ec10e500 2024-09-19T09:03:19.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.407+0000 7f29f1aa7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29ec101300 0x7f29ec19ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:19.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.407+0000 7f29f1aa7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29ec101300 0x7f29ec19ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54886/0 (socket says 172.21.15.19:54886) 2024-09-19T09:03:19.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.407+0000 7f29f1aa7640 1 -- 172.21.15.19:0/4040273366 learned_addr learned my addr 172.21.15.19:0/4040273366 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:19.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.407+0000 7f29f2aa9640 1 --2- 172.21.15.19:0/4040273366 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f29ec10e500 0x7f29ec19eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:19.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.407+0000 7f29f22a8640 1 --2- 172.21.15.19:0/4040273366 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29ec100950 0x7f29ec19a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:19.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.407+0000 7f29f1aa7640 1 -- 172.21.15.19:0/4040273366 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f29ec10e500 msgr2=0x7f29ec19eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:19.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.407+0000 7f29f1aa7640 1 --2- 172.21.15.19:0/4040273366 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f29ec10e500 0x7f29ec19eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.407+0000 7f29f1aa7640 1 -- 172.21.15.19:0/4040273366 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29ec100950 msgr2=0x7f29ec19a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:19.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.407+0000 7f29f1aa7640 1 --2- 172.21.15.19:0/4040273366 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29ec100950 0x7f29ec19a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.407+0000 7f29f1aa7640 1 -- 172.21.15.19:0/4040273366 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29ec19f6d0 con 0x7f29ec101300 2024-09-19T09:03:19.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.407+0000 7f29f22a8640 1 --2- 172.21.15.19:0/4040273366 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29ec100950 0x7f29ec19a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:19.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.408+0000 7f29f1aa7640 1 --2- 172.21.15.19:0/4040273366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29ec101300 0x7f29ec19ac60 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f29dc02a930 tx=0x7f29dc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:19.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.408+0000 7f29e37fe640 1 -- 172.21.15.19:0/4040273366 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29dc03f030 con 0x7f29ec101300 2024-09-19T09:03:19.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.408+0000 7f29f450c640 1 -- 172.21.15.19:0/4040273366 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29ec19f960 con 0x7f29ec101300 2024-09-19T09:03:19.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.408+0000 7f29e37fe640 1 -- 172.21.15.19:0/4040273366 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29dc003ce0 con 0x7f29ec101300 2024-09-19T09:03:19.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.408+0000 7f29e37fe640 1 -- 172.21.15.19:0/4040273366 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29dc035070 con 0x7f29ec101300 2024-09-19T09:03:19.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.408+0000 7f29f450c640 1 -- 172.21.15.19:0/4040273366 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29ec1a72a0 con 0x7f29ec101300 2024-09-19T09:03:19.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.410+0000 7f29e37fe640 1 -- 172.21.15.19:0/4040273366 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f29dc042030 con 0x7f29ec101300 2024-09-19T09:03:19.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.410+0000 7f29f68e5740 1 Processor -- start 2024-09-19T09:03:19.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.411+0000 7f29f68e5740 1 -- start start 2024-09-19T09:03:19.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.411+0000 7f29f68e5740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617849e2b40 0x5617849e1090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:19.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.411+0000 7f29f68e5740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617849e15d0 0x5617849e1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:19.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.411+0000 7f29e37fe640 1 --2- 172.21.15.19:0/4040273366 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f29d80a3240 0x7f29d80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:19.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.411+0000 7f29f68e5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617849ec370 0x5617849ee760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:19.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.411+0000 7f29f68e5740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5617849472f0 con 0x5617849e15d0 2024-09-19T09:03:19.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.411+0000 7f29f68e5740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5617848eecf0 con 0x5617849e2b40 2024-09-19T09:03:19.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.411+0000 7f29f68e5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5617849432b0 con 0x5617849ec370 2024-09-19T09:03:19.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.411+0000 7f29f22a8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617849e15d0 0x5617849e1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:19.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.411+0000 7f29f1aa7640 1 --2- 172.21.15.19:0/4040273366 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f29d80a3240 0x7f29d80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:19.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.411+0000 7f29f22a8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617849e15d0 0x5617849e1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54892/0 (socket says 172.21.15.19:54892) 2024-09-19T09:03:19.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.411+0000 7f29f22a8640 1 -- 172.21.15.19:0/3706131587 learned_addr learned my addr 172.21.15.19:0/3706131587 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:19.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.411+0000 7f29f2aa9640 1 --2- 172.21.15.19:0/3706131587 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617849e2b40 0x5617849e1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:19.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.411+0000 7f29e37fe640 1 -- 172.21.15.19:0/4040273366 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f29dc0efdf0 con 0x7f29ec101300 2024-09-19T09:03:19.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.411+0000 7f29f2aa9640 1 --2- 172.21.15.19:0/3706131587 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617849ec370 0x5617849ee760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:19.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.411+0000 7f29f22a8640 1 -- 172.21.15.19:0/3706131587 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617849ec370 msgr2=0x5617849ee760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:19.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.411+0000 7f29f22a8640 1 --2- 172.21.15.19:0/3706131587 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617849ec370 0x5617849ee760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.411+0000 7f29f22a8640 1 -- 172.21.15.19:0/3706131587 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617849e2b40 msgr2=0x5617849e1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:19.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.411+0000 7f29f22a8640 1 --2- 172.21.15.19:0/3706131587 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617849e2b40 0x5617849e1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.411+0000 7f29f22a8640 1 -- 172.21.15.19:0/3706131587 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617848d33a0 con 0x5617849e15d0 2024-09-19T09:03:19.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.411+0000 7f29f2aa9640 1 --2- 172.21.15.19:0/3706131587 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617849e2b40 0x5617849e1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:19.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.412+0000 7f29f22a8640 1 --2- 172.21.15.19:0/3706131587 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617849e15d0 0x5617849e1a10 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f29e800bd40 tx=0x7f29e800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562c314e06028989 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:19.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.412+0000 7f29f1aa7640 1 --2- 172.21.15.19:0/4040273366 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f29d80a3240 0x7f29d80a5700 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0b8820 tx=0x7f29dc086e00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:19.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.412+0000 7f29e0ff9640 1 -- 172.21.15.19:0/3706131587 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e8015070 con 0x5617849e15d0 2024-09-19T09:03:19.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.412+0000 7f29e0ff9640 1 -- 172.21.15.19:0/3706131587 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29e800be30 con 0x5617849e15d0 2024-09-19T09:03:19.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.412+0000 7f29e0ff9640 1 -- 172.21.15.19:0/3706131587 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e8011a10 con 0x5617849e15d0 2024-09-19T09:03:19.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.412+0000 7f29f68e5740 1 -- 172.21.15.19:0/3706131587 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617849e15d0 msgr2=0x5617849e1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:19.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.412+0000 7f29f68e5740 1 --2- 172.21.15.19:0/3706131587 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617849e15d0 0x5617849e1a10 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f29e800bd40 tx=0x7f29e800f730 comp rx=0 tx=0).stop 2024-09-19T09:03:19.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.413+0000 7f29f68e5740 1 -- 172.21.15.19:0/3706131587 shutdown_connections 2024-09-19T09:03:19.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.413+0000 7f29f68e5740 1 --2- 172.21.15.19:0/3706131587 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617849ec370 0x5617849ee760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.413+0000 7f29f68e5740 1 --2- 172.21.15.19:0/3706131587 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617849e15d0 0x5617849e1a10 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.413+0000 7f29f68e5740 1 --2- 172.21.15.19:0/3706131587 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617849e2b40 0x5617849e1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.413+0000 7f29f68e5740 1 -- 172.21.15.19:0/3706131587 >> 172.21.15.19:0/3706131587 conn(0x5617849aa310 msgr2=0x5617849ddc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:19.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.413+0000 7f29f68e5740 1 -- 172.21.15.19:0/3706131587 shutdown_connections 2024-09-19T09:03:19.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.413+0000 7f29f68e5740 1 -- 172.21.15.19:0/3706131587 wait complete. 2024-09-19T09:03:19.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.413+0000 7f29f68e5740 1 -- start start 2024-09-19T09:03:19.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.413+0000 7f29f68e5740 1 Processor -- start 2024-09-19T09:03:19.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.413+0000 7f29f68e5740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617849e15d0 0x5617849ebd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:19.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.413+0000 7f29f68e5740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617849e2b40 0x5617849e8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:19.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.413+0000 7f29f68e5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617849ec370 0x5617849e95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:19.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.413+0000 7f29f68e5740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5617849ef070 con 0x5617849e2b40 2024-09-19T09:03:19.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.413+0000 7f29f68e5740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x561784902060 con 0x5617849e15d0 2024-09-19T09:03:19.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.413+0000 7f29f68e5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5617849ef1f0 con 0x5617849ec370 2024-09-19T09:03:19.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.413+0000 7f29f68e5740 10 client.0 _ll_register_callbacks cb 0x5617846558c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:19.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.414+0000 7f29f22a8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617849e2b40 0x5617849e8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:19.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.414+0000 7f29f22a8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617849e2b40 0x5617849e8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54894/0 (socket says 172.21.15.19:54894) 2024-09-19T09:03:19.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.414+0000 7f29f22a8640 1 -- 172.21.15.19:0/818436457 learned_addr learned my addr 172.21.15.19:0/818436457 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:19.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.414+0000 7f29f2aa9640 1 --2- 172.21.15.19:0/818436457 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617849ec370 0x5617849e95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:19.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.414+0000 7f29f2aa9640 1 --2- 172.21.15.19:0/818436457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617849e15d0 0x5617849ebd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:19.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.414+0000 7f29f22a8640 1 -- 172.21.15.19:0/818436457 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617849ec370 msgr2=0x5617849e95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:19.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.414+0000 7f29f22a8640 1 --2- 172.21.15.19:0/818436457 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617849ec370 0x5617849e95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.414+0000 7f29f22a8640 1 -- 172.21.15.19:0/818436457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617849e15d0 msgr2=0x5617849ebd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:19.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.414+0000 7f29f22a8640 1 --2- 172.21.15.19:0/818436457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617849e15d0 0x5617849ebd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.414+0000 7f29f22a8640 1 -- 172.21.15.19:0/818436457 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617846b83c0 con 0x5617849e2b40 2024-09-19T09:03:19.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.414+0000 7f29f2aa9640 1 --2- 172.21.15.19:0/818436457 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617849ec370 0x5617849e95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:19.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.414+0000 7f29f22a8640 1 --2- 172.21.15.19:0/818436457 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617849e2b40 0x5617849e8ff0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f29e800bab0 tx=0x7f29e8011580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44a4a04a159d8066 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:19.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.414+0000 7f29d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:19.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.414+0000 7f29d5ffb640 1 -- 172.21.15.19:0/818436457 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e8028060 con 0x5617849e2b40 2024-09-19T09:03:19.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.414+0000 7f29f68e5740 1 -- 172.21.15.19:0/818436457 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29e800be30 con 0x5617849e2b40 2024-09-19T09:03:19.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.414+0000 7f29d5ffb640 1 -- 172.21.15.19:0/818436457 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f29e8005410 con 0x5617849e2b40 2024-09-19T09:03:19.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.414+0000 7f29d5ffb640 1 -- 172.21.15.19:0/818436457 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f29e8015070 con 0x5617849e2b40 2024-09-19T09:03:19.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.414+0000 7f29f68e5740 10 client.18033 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:19.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.415+0000 7f29f68e5740 1 -- 172.21.15.19:0/818436457 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5617849faae0 con 0x5617849e2b40 2024-09-19T09:03:19.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.415+0000 7f29d5ffb640 1 -- 172.21.15.19:0/818436457 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29e800be30 con 0x5617849e2b40 2024-09-19T09:03:19.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.415+0000 7f29d5ffb640 1 -- 172.21.15.19:0/818436457 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f29e8004bb0 con 0x5617849e2b40 2024-09-19T09:03:19.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.415+0000 7f29f68e5740 10 client.18033 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:19.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.415+0000 7f29f68e5740 10 client.18033 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T09:03:19.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.415+0000 7f29f68e5740 20 client.18033 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:19.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.415+0000 7f29f68e5740 1 --2- 172.21.15.19:0/818436457 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x5617849fbee0 0x5617849fe2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:19.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.415+0000 7f29f68e5740 4 client.18033 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:19.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.415+0000 7f29f68e5740 1 -- 172.21.15.19:0/818436457 --> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561784954860 con 0x5617849fbee0 2024-09-19T09:03:19.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.415+0000 7f29f2aa9640 1 --2- 172.21.15.19:0/818436457 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x5617849fbee0 0x5617849fe2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:19.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.416+0000 7f29f2aa9640 1 --2- 172.21.15.19:0/818436457 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x5617849fbee0 0x5617849fe2d0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7c0b63c8af5c7a96 server_cookie=c8ab4f642b287d3b in_seq=0 out_seq=0 2024-09-19T09:03:19.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.416+0000 7f29d5ffb640 10 client.18033 ms_handle_connect on v2:172.21.15.203:6836/3684671619 2024-09-19T09:03:19.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.416+0000 7f29d5ffb640 1 -- 172.21.15.19:0/818436457 <== mds.2 v2:172.21.15.203:6836/3684671619 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561784954860 con 0x5617849fbee0 2024-09-19T09:03:19.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.416+0000 7f29d5ffb640 10 client.18033 handle_command_reply: tid=0 2024-09-19T09:03:19.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.416+0000 7f29f68e5740 1 client.18033 shutdown 2024-09-19T09:03:19.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.417+0000 7f29f68e5740 1 -- 172.21.15.19:0/818436457 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617849e2b40 msgr2=0x5617849e8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:19.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.417+0000 7f29f68e5740 1 --2- 172.21.15.19:0/818436457 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617849e2b40 0x5617849e8ff0 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f29e800bab0 tx=0x7f29e8011580 comp rx=0 tx=0).stop 2024-09-19T09:03:19.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.417+0000 7f29f68e5740 1 -- 172.21.15.19:0/818436457 shutdown_connections 2024-09-19T09:03:19.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.417+0000 7f29f68e5740 1 --2- 172.21.15.19:0/818436457 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x5617849fbee0 0x5617849fe2d0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.417+0000 7f29f68e5740 1 --2- 172.21.15.19:0/818436457 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617849ec370 0x5617849e95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.417+0000 7f29f68e5740 1 --2- 172.21.15.19:0/818436457 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617849e2b40 0x5617849e8ff0 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.417+0000 7f29d5ffb640 0 client.18033 ms_handle_reset on v2:172.21.15.203:6836/3684671619 2024-09-19T09:03:19.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.417+0000 7f29f68e5740 1 --2- 172.21.15.19:0/818436457 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617849e15d0 0x5617849ebd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.417+0000 7f29f68e5740 1 -- 172.21.15.19:0/818436457 >> 172.21.15.19:0/818436457 conn(0x5617849aa310 msgr2=0x5617849e3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:19.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.417+0000 7f29f68e5740 1 -- 172.21.15.19:0/818436457 shutdown_connections 2024-09-19T09:03:19.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.417+0000 7f29f68e5740 1 -- 172.21.15.19:0/818436457 wait complete. 2024-09-19T09:03:19.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.417+0000 7f29f68e5740 20 client.18033 trim_cache size 0 max 16384 2024-09-19T09:03:19.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.430+0000 7f29f68e5740 1 Processor -- start 2024-09-19T09:03:19.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.430+0000 7f29f68e5740 1 -- start start 2024-09-19T09:03:19.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.430+0000 7f29f68e5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617849e15d0 0x5617849eaf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:19.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.430+0000 7f29f68e5740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617849e2b40 0x5617849e4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:19.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.430+0000 7f29f68e5740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617849ec370 0x5617849e4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:19.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.430+0000 7f29f68e5740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f29ec1af7b0 con 0x5617849e2b40 2024-09-19T09:03:19.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.430+0000 7f29f68e5740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f29ec1b12f0 con 0x5617849ec370 2024-09-19T09:03:19.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.430+0000 7f29f68e5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f29ec1afe80 con 0x5617849e15d0 2024-09-19T09:03:19.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.430+0000 7f29f22a8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617849e2b40 0x5617849e4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:19.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.431+0000 7f29f22a8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617849e2b40 0x5617849e4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54900/0 (socket says 172.21.15.19:54900) 2024-09-19T09:03:19.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.431+0000 7f29f22a8640 1 -- 172.21.15.19:0/2741125047 learned_addr learned my addr 172.21.15.19:0/2741125047 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:19.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.431+0000 7f29f2aa9640 1 --2- 172.21.15.19:0/2741125047 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617849e15d0 0x5617849eaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:19.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.431+0000 7f29f2aa9640 1 --2- 172.21.15.19:0/2741125047 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617849ec370 0x5617849e4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:19.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.431+0000 7f29f22a8640 1 -- 172.21.15.19:0/2741125047 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617849e15d0 msgr2=0x5617849eaf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:19.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.431+0000 7f29f22a8640 1 --2- 172.21.15.19:0/2741125047 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617849e15d0 0x5617849eaf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.431+0000 7f29f22a8640 1 -- 172.21.15.19:0/2741125047 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617849ec370 msgr2=0x5617849e4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:19.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.431+0000 7f29f22a8640 1 --2- 172.21.15.19:0/2741125047 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617849ec370 0x5617849e4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.431+0000 7f29f22a8640 1 -- 172.21.15.19:0/2741125047 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617849e9950 con 0x5617849e2b40 2024-09-19T09:03:19.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.431+0000 7f29f22a8640 1 --2- 172.21.15.19:0/2741125047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617849e2b40 0x5617849e4120 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f29e801a500 tx=0x7f29e800b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8f26f620553f08 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:19.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.431+0000 7f29d7fff640 1 -- 172.21.15.19:0/2741125047 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e8033020 con 0x5617849e2b40 2024-09-19T09:03:19.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.431+0000 7f29d7fff640 1 -- 172.21.15.19:0/2741125047 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29e800fc30 con 0x5617849e2b40 2024-09-19T09:03:19.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.431+0000 7f29d7fff640 1 -- 172.21.15.19:0/2741125047 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e8028070 con 0x5617849e2b40 2024-09-19T09:03:19.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.432+0000 7f29f68e5740 1 -- 172.21.15.19:0/2741125047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617849e2b40 msgr2=0x5617849e4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:19.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.432+0000 7f29f68e5740 1 --2- 172.21.15.19:0/2741125047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617849e2b40 0x5617849e4120 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f29e801a500 tx=0x7f29e800b660 comp rx=0 tx=0).stop 2024-09-19T09:03:19.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.432+0000 7f29f68e5740 1 -- 172.21.15.19:0/2741125047 shutdown_connections 2024-09-19T09:03:19.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.432+0000 7f29f68e5740 1 --2- 172.21.15.19:0/2741125047 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617849ec370 0x5617849e4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.432+0000 7f29f68e5740 1 --2- 172.21.15.19:0/2741125047 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617849e2b40 0x5617849e4120 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.432+0000 7f29f68e5740 1 --2- 172.21.15.19:0/2741125047 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617849e15d0 0x5617849eaf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.432+0000 7f29f68e5740 1 -- 172.21.15.19:0/2741125047 >> 172.21.15.19:0/2741125047 conn(0x5617849aa310 msgr2=0x5617849ea850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:19.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.432+0000 7f29f68e5740 1 -- 172.21.15.19:0/2741125047 shutdown_connections 2024-09-19T09:03:19.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.432+0000 7f29f68e5740 1 -- 172.21.15.19:0/2741125047 wait complete. 2024-09-19T09:03:19.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.432+0000 7f29f68e5740 1 -- start start 2024-09-19T09:03:19.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.432+0000 7f29f68e5740 1 Processor -- start 2024-09-19T09:03:19.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.433+0000 7f29f68e5740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617849e15d0 0x5617849f4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:19.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.433+0000 7f29f68e5740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617849e2b40 0x5617849e5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:19.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.433+0000 7f29f68e5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617849ec370 0x5617849e6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:19.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.433+0000 7f29f68e5740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f29ec1b0c20 con 0x5617849e15d0 2024-09-19T09:03:19.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.433+0000 7f29f68e5740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f29ec1b0550 con 0x5617849e2b40 2024-09-19T09:03:19.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.433+0000 7f29f68e5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f29ec1ad790 con 0x5617849ec370 2024-09-19T09:03:19.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.433+0000 7f29f68e5740 10 client.0 _ll_register_callbacks cb 0x7f29e800bbc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:19.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.433+0000 7f29f2aa9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617849e15d0 0x5617849f4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:19.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.433+0000 7f29f2aa9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617849e15d0 0x5617849f4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54914/0 (socket says 172.21.15.19:54914) 2024-09-19T09:03:19.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.433+0000 7f29f2aa9640 1 -- 172.21.15.19:0/532676301 learned_addr learned my addr 172.21.15.19:0/532676301 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:19.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.433+0000 7f29f2aa9640 1 --2- 172.21.15.19:0/532676301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617849ec370 0x5617849e6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:19.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.433+0000 7f29f22a8640 1 --2- 172.21.15.19:0/532676301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617849e2b40 0x5617849e5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:19.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.433+0000 7f29f2aa9640 1 -- 172.21.15.19:0/532676301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617849ec370 msgr2=0x5617849e6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:19.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.433+0000 7f29f2aa9640 1 --2- 172.21.15.19:0/532676301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617849ec370 0x5617849e6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.433+0000 7f29f2aa9640 1 -- 172.21.15.19:0/532676301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617849e2b40 msgr2=0x5617849e5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:19.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.433+0000 7f29f2aa9640 1 --2- 172.21.15.19:0/532676301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617849e2b40 0x5617849e5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.433+0000 7f29f2aa9640 1 -- 172.21.15.19:0/532676301 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617849e6970 con 0x5617849e15d0 2024-09-19T09:03:19.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.433+0000 7f29f2aa9640 1 --2- 172.21.15.19:0/532676301 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617849e15d0 0x5617849f4ac0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f29ec06a0f0 tx=0x7f29e800ffd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9bb4d3508aa429e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:19.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.433+0000 7f29d5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:19.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.434+0000 7f29d5ffb640 1 -- 172.21.15.19:0/532676301 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e402c060 con 0x5617849e15d0 2024-09-19T09:03:19.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.434+0000 7f29d5ffb640 1 -- 172.21.15.19:0/532676301 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f29e4019470 con 0x5617849e15d0 2024-09-19T09:03:19.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.434+0000 7f29f68e5740 1 -- 172.21.15.19:0/532676301 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29e800fc30 con 0x5617849e15d0 2024-09-19T09:03:19.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.434+0000 7f29d5ffb640 1 -- 172.21.15.19:0/532676301 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f29e4014040 con 0x5617849e15d0 2024-09-19T09:03:19.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.434+0000 7f29f68e5740 10 client.18039 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:19.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.434+0000 7f29f68e5740 1 -- 172.21.15.19:0/532676301 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x561784a66890 con 0x5617849e15d0 2024-09-19T09:03:19.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.434+0000 7f29d5ffb640 1 -- 172.21.15.19:0/532676301 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f29e800fc30 con 0x5617849e15d0 2024-09-19T09:03:19.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.434+0000 7f29d5ffb640 1 -- 172.21.15.19:0/532676301 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f29e4024040 con 0x5617849e15d0 2024-09-19T09:03:19.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.434+0000 7f29f68e5740 10 client.18039 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:19.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.434+0000 7f29f68e5740 10 client.18039 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T09:03:19.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.434+0000 7f29f68e5740 20 client.18039 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:19.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.434+0000 7f29f68e5740 1 --2- 172.21.15.19:0/532676301 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x561784a66f60 0x561784a69350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:19.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.434+0000 7f29f68e5740 4 client.18039 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:03:19.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.434+0000 7f29f68e5740 1 -- 172.21.15.19:0/532676301 --> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56178494ed70 con 0x561784a66f60 2024-09-19T09:03:19.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.434+0000 7f29f22a8640 1 --2- 172.21.15.19:0/532676301 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x561784a66f60 0x561784a69350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:19.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.435+0000 7f29f22a8640 1 --2- 172.21.15.19:0/532676301 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x561784a66f60 0x561784a69350 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9f33fdd59ff1a63 server_cookie=2e404b75c533a334 in_seq=0 out_seq=0 2024-09-19T09:03:19.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.435+0000 7f29d5ffb640 10 client.18039 ms_handle_connect on v2:172.21.15.203:6836/3684671619 2024-09-19T09:03:19.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.435+0000 7f29d5ffb640 1 -- 172.21.15.19:0/532676301 <== mds.2 v2:172.21.15.203:6836/3684671619 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56178494ed70 con 0x561784a66f60 2024-09-19T09:03:19.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.435+0000 7f29d5ffb640 10 client.18039 handle_command_reply: tid=0 2024-09-19T09:03:19.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.435+0000 7f29f68e5740 1 client.18039 shutdown 2024-09-19T09:03:19.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.435+0000 7f29f68e5740 1 -- 172.21.15.19:0/532676301 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617849e15d0 msgr2=0x5617849f4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:19.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.435+0000 7f29f68e5740 1 --2- 172.21.15.19:0/532676301 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617849e15d0 0x5617849f4ac0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f29ec06a0f0 tx=0x7f29e800ffd0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.435+0000 7f29f68e5740 1 -- 172.21.15.19:0/532676301 shutdown_connections 2024-09-19T09:03:19.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.435+0000 7f29f68e5740 1 --2- 172.21.15.19:0/532676301 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x561784a66f60 0x561784a69350 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.435+0000 7f29f68e5740 1 --2- 172.21.15.19:0/532676301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617849ec370 0x5617849e6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.435+0000 7f29f68e5740 1 --2- 172.21.15.19:0/532676301 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617849e2b40 0x5617849e5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.435+0000 7f29f68e5740 1 --2- 172.21.15.19:0/532676301 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617849e15d0 0x5617849f4ac0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.435+0000 7f29f68e5740 1 -- 172.21.15.19:0/532676301 >> 172.21.15.19:0/532676301 conn(0x5617849aa310 msgr2=0x5617849eb070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:19.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.435+0000 7f29d5ffb640 0 client.18039 ms_handle_reset on v2:172.21.15.203:6836/3684671619 2024-09-19T09:03:19.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.435+0000 7f29f68e5740 1 -- 172.21.15.19:0/532676301 shutdown_connections 2024-09-19T09:03:19.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.435+0000 7f29f68e5740 1 -- 172.21.15.19:0/532676301 wait complete. 2024-09-19T09:03:19.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.436+0000 7f29f68e5740 20 client.18039 trim_cache size 0 max 16384 2024-09-19T09:03:19.446 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:03:19.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.436+0000 7f29f450c640 1 -- 172.21.15.19:0/4040273366 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f29d80a3240 msgr2=0x7f29d80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:19.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.436+0000 7f29f450c640 1 --2- 172.21.15.19:0/4040273366 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f29d80a3240 0x7f29d80a5700 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f29dc0b8820 tx=0x7f29dc086e00 comp rx=0 tx=0).stop 2024-09-19T09:03:19.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.436+0000 7f29f450c640 1 -- 172.21.15.19:0/4040273366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29ec101300 msgr2=0x7f29ec19ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:19.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.436+0000 7f29f450c640 1 --2- 172.21.15.19:0/4040273366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29ec101300 0x7f29ec19ac60 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f29dc02a930 tx=0x7f29dc0042f0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.436+0000 7f29f450c640 1 -- 172.21.15.19:0/4040273366 shutdown_connections 2024-09-19T09:03:19.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.436+0000 7f29f450c640 1 --2- 172.21.15.19:0/4040273366 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f29d80a3240 0x7f29d80a5700 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.436+0000 7f29f450c640 1 --2- 172.21.15.19:0/4040273366 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f29ec10e500 0x7f29ec19eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.436+0000 7f29f450c640 1 --2- 172.21.15.19:0/4040273366 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f29ec101300 0x7f29ec19ac60 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.436+0000 7f29f450c640 1 --2- 172.21.15.19:0/4040273366 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f29ec100950 0x7f29ec19a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:19.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.436+0000 7f29f450c640 1 -- 172.21.15.19:0/4040273366 >> 172.21.15.19:0/4040273366 conn(0x7f29ec0fc7a0 msgr2=0x7f29ec0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:19.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.436+0000 7f29f450c640 1 -- 172.21.15.19:0/4040273366 shutdown_connections 2024-09-19T09:03:19.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:19.436+0000 7f29f450c640 1 -- 172.21.15.19:0/4040273366 wait complete. 2024-09-19T09:03:20.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:19 smithi019 ceph-mon[30976]: pgmap v672: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.1 KiB/s wr, 21 op/s 2024-09-19T09:03:20.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:19 smithi155 ceph-mon[34921]: pgmap v672: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.1 KiB/s wr, 21 op/s 2024-09-19T09:03:20.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:19 smithi203 ceph-mon[35450]: pgmap v672: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 4.1 KiB/s wr, 21 op/s 2024-09-19T09:03:20.329 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:03:20.587 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:21.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.101+0000 7ff9ec3e3640 1 -- 172.21.15.19:0/3671399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e4106a80 msgr2=0x7ff9e4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:21.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.101+0000 7ff9ec3e3640 1 --2- 172.21.15.19:0/3671399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e4106a80 0x7ff9e4106e60 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0009930 tx=0x7ff9e002a420 comp rx=0 tx=0).stop 2024-09-19T09:03:21.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.102+0000 7ff9ec3e3640 1 -- 172.21.15.19:0/3671399 shutdown_connections 2024-09-19T09:03:21.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.102+0000 7ff9ec3e3640 1 --2- 172.21.15.19:0/3671399 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9e4101420 0x7ff9e410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.102+0000 7ff9ec3e3640 1 --2- 172.21.15.19:0/3671399 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9e4100a80 0x7ff9e4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.102+0000 7ff9ec3e3640 1 --2- 172.21.15.19:0/3671399 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e4106a80 0x7ff9e4106e60 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.102+0000 7ff9ec3e3640 1 -- 172.21.15.19:0/3671399 >> 172.21.15.19:0/3671399 conn(0x7ff9e40fc7a0 msgr2=0x7ff9e40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:21.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.102+0000 7ff9ec3e3640 1 -- 172.21.15.19:0/3671399 shutdown_connections 2024-09-19T09:03:21.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.102+0000 7ff9ec3e3640 1 -- 172.21.15.19:0/3671399 wait complete. 2024-09-19T09:03:21.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.102+0000 7ff9ec3e3640 1 Processor -- start 2024-09-19T09:03:21.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.102+0000 7ff9ec3e3640 1 -- start start 2024-09-19T09:03:21.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.102+0000 7ff9ec3e3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e4100a80 0x7ff9e4102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.103+0000 7ff9ec3e3640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9e4101420 0x7ff9e4102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.103+0000 7ff9ec3e3640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9e4106a80 0x7ff9e41030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.103+0000 7ff9ec3e3640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e4110e80 con 0x7ff9e4100a80 2024-09-19T09:03:21.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.103+0000 7ff9ec3e3640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e4110d00 con 0x7ff9e4101420 2024-09-19T09:03:21.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.103+0000 7ff9ec3e3640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e4111000 con 0x7ff9e4106a80 2024-09-19T09:03:21.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.103+0000 7ff9ea17f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e4100a80 0x7ff9e4102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.103+0000 7ff9ea17f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e4100a80 0x7ff9e4102650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54926/0 (socket says 172.21.15.19:54926) 2024-09-19T09:03:21.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.103+0000 7ff9ea17f640 1 -- 172.21.15.19:0/1382821593 learned_addr learned my addr 172.21.15.19:0/1382821593 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:21.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.103+0000 7ff9ea980640 1 --2- 172.21.15.19:0/1382821593 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9e4106a80 0x7ff9e41030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.103+0000 7ff9e997e640 1 --2- 172.21.15.19:0/1382821593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9e4101420 0x7ff9e4102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.103+0000 7ff9ea17f640 1 -- 172.21.15.19:0/1382821593 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9e4106a80 msgr2=0x7ff9e41030d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:21.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.103+0000 7ff9ea17f640 1 --2- 172.21.15.19:0/1382821593 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9e4106a80 0x7ff9e41030d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.103+0000 7ff9ea17f640 1 -- 172.21.15.19:0/1382821593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9e4101420 msgr2=0x7ff9e4102b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:21.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.103+0000 7ff9ea17f640 1 --2- 172.21.15.19:0/1382821593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9e4101420 0x7ff9e4102b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.103+0000 7ff9ea17f640 1 -- 172.21.15.19:0/1382821593 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e41a6890 con 0x7ff9e4100a80 2024-09-19T09:03:21.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.103+0000 7ff9e997e640 1 --2- 172.21.15.19:0/1382821593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9e4101420 0x7ff9e4102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:21.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.103+0000 7ff9ea17f640 1 --2- 172.21.15.19:0/1382821593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e4100a80 0x7ff9e4102650 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0009a50 tx=0x7ff9e0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:21.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.103+0000 7ff9db7fe640 1 -- 172.21.15.19:0/1382821593 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e003f030 con 0x7ff9e4100a80 2024-09-19T09:03:21.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.103+0000 7ff9db7fe640 1 -- 172.21.15.19:0/1382821593 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9e0003ce0 con 0x7ff9e4100a80 2024-09-19T09:03:21.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.103+0000 7ff9ec3e3640 1 -- 172.21.15.19:0/1382821593 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9e41a6b20 con 0x7ff9e4100a80 2024-09-19T09:03:21.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.103+0000 7ff9db7fe640 1 -- 172.21.15.19:0/1382821593 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0035070 con 0x7ff9e4100a80 2024-09-19T09:03:21.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.104+0000 7ff9ec3e3640 1 -- 172.21.15.19:0/1382821593 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9e41a7000 con 0x7ff9e4100a80 2024-09-19T09:03:21.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.106+0000 7ff9db7fe640 1 -- 172.21.15.19:0/1382821593 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7ff9e0042030 con 0x7ff9e4100a80 2024-09-19T09:03:21.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.106+0000 7ff9ee7bc740 1 Processor -- start 2024-09-19T09:03:21.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.106+0000 7ff9ee7bc740 1 -- start start 2024-09-19T09:03:21.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.106+0000 7ff9ee7bc740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587a0b15b40 0x5587a0b14090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.106+0000 7ff9ee7bc740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587a0b145d0 0x5587a0b14a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.106+0000 7ff9ee7bc740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5587a0b1f370 0x5587a0b21760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.106+0000 7ff9ee7bc740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5587a0a7a2f0 con 0x5587a0b145d0 2024-09-19T09:03:21.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.106+0000 7ff9ee7bc740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5587a0a21cf0 con 0x5587a0b1f370 2024-09-19T09:03:21.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.106+0000 7ff9ee7bc740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5587a0a762b0 con 0x5587a0b15b40 2024-09-19T09:03:21.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.107+0000 7ff9ea17f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587a0b145d0 0x5587a0b14a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.107+0000 7ff9ea17f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587a0b145d0 0x5587a0b14a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54936/0 (socket says 172.21.15.19:54936) 2024-09-19T09:03:21.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.107+0000 7ff9ea17f640 1 -- 172.21.15.19:0/13369372 learned_addr learned my addr 172.21.15.19:0/13369372 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:21.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.107+0000 7ff9db7fe640 1 --2- 172.21.15.19:0/1382821593 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff9d00a3240 0x7ff9d00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.107+0000 7ff9e997e640 1 --2- 172.21.15.19:0/13369372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5587a0b1f370 0x5587a0b21760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.107+0000 7ff9ea980640 1 --2- 172.21.15.19:0/1382821593 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff9d00a3240 0x7ff9d00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.107+0000 7ff9ea980640 1 --2- 172.21.15.19:0/13369372 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587a0b15b40 0x5587a0b14090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.107+0000 7ff9db7fe640 1 -- 172.21.15.19:0/1382821593 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7ff9e00efe90 con 0x7ff9e4100a80 2024-09-19T09:03:21.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.107+0000 7ff9ea17f640 1 -- 172.21.15.19:0/13369372 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587a0b15b40 msgr2=0x5587a0b14090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:21.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.107+0000 7ff9ea17f640 1 --2- 172.21.15.19:0/13369372 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587a0b15b40 0x5587a0b14090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.107+0000 7ff9ea17f640 1 -- 172.21.15.19:0/13369372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5587a0b1f370 msgr2=0x5587a0b21760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:21.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.107+0000 7ff9ea17f640 1 --2- 172.21.15.19:0/13369372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5587a0b1f370 0x5587a0b21760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.107+0000 7ff9ea17f640 1 -- 172.21.15.19:0/13369372 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587a0a063a0 con 0x5587a0b145d0 2024-09-19T09:03:21.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.107+0000 7ff9ea980640 1 --2- 172.21.15.19:0/13369372 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587a0b15b40 0x5587a0b14090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:21.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.107+0000 7ff9ea17f640 1 --2- 172.21.15.19:0/13369372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587a0b145d0 0x5587a0b14a10 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00ed8e0 tx=0x7ff9e002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d59ccb007b375b3f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:21.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.107+0000 7ff9d8dea640 1 -- 172.21.15.19:0/13369372 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e00ede60 con 0x5587a0b145d0 2024-09-19T09:03:21.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.107+0000 7ff9ea980640 1 --2- 172.21.15.19:0/1382821593 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff9d00a3240 0x7ff9d00a5700 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc0077f0 tx=0x7ff9dc007a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:21.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.107+0000 7ff9d8dea640 1 -- 172.21.15.19:0/13369372 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9e00bcbc0 con 0x5587a0b145d0 2024-09-19T09:03:21.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.107+0000 7ff9d8dea640 1 -- 172.21.15.19:0/13369372 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e0049070 con 0x5587a0b145d0 2024-09-19T09:03:21.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.108+0000 7ff9ee7bc740 1 -- 172.21.15.19:0/13369372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587a0b145d0 msgr2=0x5587a0b14a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:21.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.108+0000 7ff9ee7bc740 1 --2- 172.21.15.19:0/13369372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587a0b145d0 0x5587a0b14a10 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7ff9e00ed8e0 tx=0x7ff9e002a420 comp rx=0 tx=0).stop 2024-09-19T09:03:21.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.108+0000 7ff9ee7bc740 1 -- 172.21.15.19:0/13369372 shutdown_connections 2024-09-19T09:03:21.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.108+0000 7ff9ee7bc740 1 --2- 172.21.15.19:0/13369372 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5587a0b1f370 0x5587a0b21760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.108+0000 7ff9ee7bc740 1 --2- 172.21.15.19:0/13369372 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587a0b145d0 0x5587a0b14a10 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.108+0000 7ff9ee7bc740 1 --2- 172.21.15.19:0/13369372 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587a0b15b40 0x5587a0b14090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.108+0000 7ff9ee7bc740 1 -- 172.21.15.19:0/13369372 >> 172.21.15.19:0/13369372 conn(0x5587a0add310 msgr2=0x5587a0b10c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:21.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.108+0000 7ff9ee7bc740 1 -- 172.21.15.19:0/13369372 shutdown_connections 2024-09-19T09:03:21.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.108+0000 7ff9ee7bc740 1 -- 172.21.15.19:0/13369372 wait complete. 2024-09-19T09:03:21.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.109+0000 7ff9ee7bc740 1 -- start start 2024-09-19T09:03:21.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.109+0000 7ff9ee7bc740 1 Processor -- start 2024-09-19T09:03:21.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.109+0000 7ff9ee7bc740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587a0b145d0 0x5587a0b1ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.109+0000 7ff9ee7bc740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587a0b15b40 0x5587a0b1c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.109+0000 7ff9ee7bc740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5587a0b1f370 0x5587a0b1c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.109+0000 7ff9ee7bc740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5587a0b21e30 con 0x5587a0b145d0 2024-09-19T09:03:21.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.109+0000 7ff9ee7bc740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5587a0a35060 con 0x5587a0b1f370 2024-09-19T09:03:21.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.109+0000 7ff9ee7bc740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5587a0b21fb0 con 0x5587a0b15b40 2024-09-19T09:03:21.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.109+0000 7ff9ee7bc740 10 client.0 _ll_register_callbacks cb 0x5587a07888c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:21.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.109+0000 7ff9ea17f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587a0b145d0 0x5587a0b1ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.109+0000 7ff9ea17f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587a0b145d0 0x5587a0b1ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54944/0 (socket says 172.21.15.19:54944) 2024-09-19T09:03:21.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.109+0000 7ff9ea17f640 1 -- 172.21.15.19:0/2322615321 learned_addr learned my addr 172.21.15.19:0/2322615321 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:21.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.109+0000 7ff9ea980640 1 --2- 172.21.15.19:0/2322615321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5587a0b1f370 0x5587a0b1c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.109+0000 7ff9e997e640 1 --2- 172.21.15.19:0/2322615321 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587a0b15b40 0x5587a0b1c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.109+0000 7ff9ea17f640 1 -- 172.21.15.19:0/2322615321 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587a0b15b40 msgr2=0x5587a0b1c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:21.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.109+0000 7ff9ea17f640 1 --2- 172.21.15.19:0/2322615321 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587a0b15b40 0x5587a0b1c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.109+0000 7ff9ea17f640 1 -- 172.21.15.19:0/2322615321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5587a0b1f370 msgr2=0x5587a0b1c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:21.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.109+0000 7ff9ea17f640 1 --2- 172.21.15.19:0/2322615321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5587a0b1f370 0x5587a0b1c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.109+0000 7ff9ea17f640 1 -- 172.21.15.19:0/2322615321 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587a07eb3c0 con 0x5587a0b145d0 2024-09-19T09:03:21.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.110+0000 7ff9ea17f640 1 --2- 172.21.15.19:0/2322615321 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587a0b145d0 0x5587a0b1ed60 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0000c00 tx=0x7ff9e00314b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=724808286500d2ad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:21.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.110+0000 7ff9cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:21.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.110+0000 7ff9cdffb640 1 -- 172.21.15.19:0/2322615321 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e00d5060 con 0x5587a0b145d0 2024-09-19T09:03:21.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.110+0000 7ff9cdffb640 1 -- 172.21.15.19:0/2322615321 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7ff9e00b8b30 con 0x5587a0b145d0 2024-09-19T09:03:21.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.110+0000 7ff9ee7bc740 1 -- 172.21.15.19:0/2322615321 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9e00bcbc0 con 0x5587a0b145d0 2024-09-19T09:03:21.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.110+0000 7ff9cdffb640 1 -- 172.21.15.19:0/2322615321 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7ff9e0049040 con 0x5587a0b145d0 2024-09-19T09:03:21.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.110+0000 7ff9ee7bc740 10 client.18051 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:21.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.110+0000 7ff9ee7bc740 1 -- 172.21.15.19:0/2322615321 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5587a0b21e30 con 0x5587a0b145d0 2024-09-19T09:03:21.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.110+0000 7ff9cdffb640 1 -- 172.21.15.19:0/2322615321 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9e00bcbc0 con 0x5587a0b145d0 2024-09-19T09:03:21.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.110+0000 7ff9cdffb640 1 -- 172.21.15.19:0/2322615321 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7ff9e00b8210 con 0x5587a0b145d0 2024-09-19T09:03:21.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.110+0000 7ff9ee7bc740 10 client.18051 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:21.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.110+0000 7ff9ee7bc740 10 client.18051 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:03:21.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.110+0000 7ff9ee7bc740 20 client.18051 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:21.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.110+0000 7ff9ee7bc740 1 --2- 172.21.15.19:0/2322615321 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x5587a0b2e9b0 0x5587a0b30dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.110+0000 7ff9ee7bc740 4 client.18051 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:21.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.110+0000 7ff9ee7bc740 1 -- 172.21.15.19:0/2322615321 --> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5587a0a87860 con 0x5587a0b2e9b0 2024-09-19T09:03:21.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.111+0000 7ff9e997e640 1 --2- 172.21.15.19:0/2322615321 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x5587a0b2e9b0 0x5587a0b30dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.111+0000 7ff9cdffb640 10 client.18051 ms_handle_connect on v2:172.21.15.203:6838/2547507299 2024-09-19T09:03:21.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.111+0000 7ff9e997e640 1 --2- 172.21.15.19:0/2322615321 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x5587a0b2e9b0 0x5587a0b30dd0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2ed13a6d99619f79 server_cookie=b513017b1143257b in_seq=0 out_seq=0 2024-09-19T09:03:21.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.112+0000 7ff9cdffb640 1 -- 172.21.15.19:0/2322615321 <== mds.1 v2:172.21.15.203:6838/2547507299 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5587a0a87860 con 0x5587a0b2e9b0 2024-09-19T09:03:21.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.112+0000 7ff9cdffb640 10 client.18051 handle_command_reply: tid=0 2024-09-19T09:03:21.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.112+0000 7ff9ee7bc740 1 client.18051 shutdown 2024-09-19T09:03:21.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.112+0000 7ff9ee7bc740 1 -- 172.21.15.19:0/2322615321 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587a0b145d0 msgr2=0x5587a0b1ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:21.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.112+0000 7ff9ee7bc740 1 --2- 172.21.15.19:0/2322615321 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587a0b145d0 0x5587a0b1ed60 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0000c00 tx=0x7ff9e00314b0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.112+0000 7ff9ee7bc740 1 -- 172.21.15.19:0/2322615321 shutdown_connections 2024-09-19T09:03:21.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.112+0000 7ff9ee7bc740 1 --2- 172.21.15.19:0/2322615321 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x5587a0b2e9b0 0x5587a0b30dd0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.112+0000 7ff9ee7bc740 1 --2- 172.21.15.19:0/2322615321 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587a0b15b40 0x5587a0b1c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.112+0000 7ff9ee7bc740 1 --2- 172.21.15.19:0/2322615321 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5587a0b1f370 0x5587a0b1c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.112+0000 7ff9ee7bc740 1 --2- 172.21.15.19:0/2322615321 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587a0b145d0 0x5587a0b1ed60 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.112+0000 7ff9ee7bc740 1 -- 172.21.15.19:0/2322615321 >> 172.21.15.19:0/2322615321 conn(0x5587a0add310 msgr2=0x5587a0b16990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:21.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.112+0000 7ff9cdffb640 0 client.18051 ms_handle_reset on v2:172.21.15.203:6838/2547507299 2024-09-19T09:03:21.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.112+0000 7ff9ee7bc740 1 -- 172.21.15.19:0/2322615321 shutdown_connections 2024-09-19T09:03:21.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.112+0000 7ff9ee7bc740 1 -- 172.21.15.19:0/2322615321 wait complete. 2024-09-19T09:03:21.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.112+0000 7ff9ee7bc740 20 client.18051 trim_cache size 0 max 16384 2024-09-19T09:03:21.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.125+0000 7ff9ee7bc740 1 Processor -- start 2024-09-19T09:03:21.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.125+0000 7ff9ee7bc740 1 -- start start 2024-09-19T09:03:21.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.125+0000 7ff9ee7bc740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5587a0b145d0 0x5587a0b2b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.126+0000 7ff9ee7bc740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587a0b15b40 0x5587a0b1aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.126+0000 7ff9ee7bc740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587a0b1f370 0x5587a0b17120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.126+0000 7ff9ee7bc740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e41af670 con 0x5587a0b1f370 2024-09-19T09:03:21.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.126+0000 7ff9ee7bc740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e41b11b0 con 0x5587a0b145d0 2024-09-19T09:03:21.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.126+0000 7ff9ee7bc740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e41afd40 con 0x5587a0b15b40 2024-09-19T09:03:21.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.126+0000 7ff9ea980640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587a0b1f370 0x5587a0b17120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.126+0000 7ff9ea980640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587a0b1f370 0x5587a0b17120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54946/0 (socket says 172.21.15.19:54946) 2024-09-19T09:03:21.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.126+0000 7ff9ea980640 1 -- 172.21.15.19:0/1470298852 learned_addr learned my addr 172.21.15.19:0/1470298852 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:21.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.126+0000 7ff9ea17f640 1 --2- 172.21.15.19:0/1470298852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5587a0b145d0 0x5587a0b2b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.126+0000 7ff9ea980640 1 -- 172.21.15.19:0/1470298852 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587a0b15b40 msgr2=0x5587a0b1aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:21.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.126+0000 7ff9ea980640 1 --2- 172.21.15.19:0/1470298852 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587a0b15b40 0x5587a0b1aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.126+0000 7ff9ea980640 1 -- 172.21.15.19:0/1470298852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5587a0b145d0 msgr2=0x5587a0b2b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:21.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.126+0000 7ff9ea980640 1 --2- 172.21.15.19:0/1470298852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5587a0b145d0 0x5587a0b2b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.126+0000 7ff9ea980640 1 -- 172.21.15.19:0/1470298852 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587a0b1a560 con 0x5587a0b1f370 2024-09-19T09:03:21.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.126+0000 7ff9ea17f640 1 --2- 172.21.15.19:0/1470298852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5587a0b145d0 0x5587a0b2b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:21.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.126+0000 7ff9ea980640 1 --2- 172.21.15.19:0/1470298852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587a0b1f370 0x5587a0b17120 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc013870 tx=0x7ff9dc014070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f83eb131d6d501e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:21.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.126+0000 7ff9cffff640 1 -- 172.21.15.19:0/1470298852 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc004d20 con 0x5587a0b1f370 2024-09-19T09:03:21.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.126+0000 7ff9cffff640 1 -- 172.21.15.19:0/1470298852 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9dc016070 con 0x5587a0b1f370 2024-09-19T09:03:21.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.126+0000 7ff9cffff640 1 -- 172.21.15.19:0/1470298852 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc0055d0 con 0x5587a0b1f370 2024-09-19T09:03:21.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.127+0000 7ff9ee7bc740 1 -- 172.21.15.19:0/1470298852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587a0b1f370 msgr2=0x5587a0b17120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:21.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.127+0000 7ff9ee7bc740 1 --2- 172.21.15.19:0/1470298852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587a0b1f370 0x5587a0b17120 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc013870 tx=0x7ff9dc014070 comp rx=0 tx=0).stop 2024-09-19T09:03:21.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.127+0000 7ff9ee7bc740 1 -- 172.21.15.19:0/1470298852 shutdown_connections 2024-09-19T09:03:21.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.127+0000 7ff9ee7bc740 1 --2- 172.21.15.19:0/1470298852 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587a0b15b40 0x5587a0b1aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.127+0000 7ff9ee7bc740 1 --2- 172.21.15.19:0/1470298852 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587a0b1f370 0x5587a0b17120 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.127+0000 7ff9ee7bc740 1 --2- 172.21.15.19:0/1470298852 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5587a0b145d0 0x5587a0b2b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.127+0000 7ff9ee7bc740 1 -- 172.21.15.19:0/1470298852 >> 172.21.15.19:0/1470298852 conn(0x5587a0add310 msgr2=0x5587a0b1a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:21.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.127+0000 7ff9ee7bc740 1 -- 172.21.15.19:0/1470298852 shutdown_connections 2024-09-19T09:03:21.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.127+0000 7ff9ee7bc740 1 -- 172.21.15.19:0/1470298852 wait complete. 2024-09-19T09:03:21.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.127+0000 7ff9ee7bc740 1 -- start start 2024-09-19T09:03:21.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.128+0000 7ff9ee7bc740 1 Processor -- start 2024-09-19T09:03:21.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.128+0000 7ff9ee7bc740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5587a0b145d0 0x5587a0b22660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.128+0000 7ff9ee7bc740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587a0b15b40 0x5587a0b22ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.128+0000 7ff9ee7bc740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587a0b1f370 0x5587a0b97660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.128+0000 7ff9ee7bc740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e41b0ae0 con 0x5587a0b1f370 2024-09-19T09:03:21.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.128+0000 7ff9ee7bc740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e41b0410 con 0x5587a0b145d0 2024-09-19T09:03:21.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.128+0000 7ff9ee7bc740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e41ad650 con 0x5587a0b15b40 2024-09-19T09:03:21.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.128+0000 7ff9ee7bc740 10 client.0 _ll_register_callbacks cb 0x7ff9d400c390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:21.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.128+0000 7ff9ea980640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587a0b1f370 0x5587a0b97660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.128+0000 7ff9ea980640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587a0b1f370 0x5587a0b97660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54954/0 (socket says 172.21.15.19:54954) 2024-09-19T09:03:21.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.128+0000 7ff9ea980640 1 -- 172.21.15.19:0/1120195142 learned_addr learned my addr 172.21.15.19:0/1120195142 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:21.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.128+0000 7ff9e997e640 1 --2- 172.21.15.19:0/1120195142 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587a0b15b40 0x5587a0b22ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.128+0000 7ff9ea17f640 1 --2- 172.21.15.19:0/1120195142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5587a0b145d0 0x5587a0b22660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.128+0000 7ff9ea980640 1 -- 172.21.15.19:0/1120195142 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587a0b15b40 msgr2=0x5587a0b22ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:21.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.128+0000 7ff9ea980640 1 --2- 172.21.15.19:0/1120195142 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587a0b15b40 0x5587a0b22ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.128+0000 7ff9ea980640 1 -- 172.21.15.19:0/1120195142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5587a0b145d0 msgr2=0x5587a0b22660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:21.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.128+0000 7ff9ea980640 1 --2- 172.21.15.19:0/1120195142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5587a0b145d0 0x5587a0b22660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.128+0000 7ff9ea980640 1 -- 172.21.15.19:0/1120195142 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587a0b97ba0 con 0x5587a0b1f370 2024-09-19T09:03:21.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.128+0000 7ff9ea17f640 1 --2- 172.21.15.19:0/1120195142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5587a0b145d0 0x5587a0b22660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:21.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.128+0000 7ff9e997e640 1 --2- 172.21.15.19:0/1120195142 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587a0b15b40 0x5587a0b22ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:21.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.128+0000 7ff9ea980640 1 --2- 172.21.15.19:0/1120195142 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587a0b1f370 0x5587a0b97660 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc005170 tx=0x7ff9dc0054a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee9d3b11eeb11019 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:21.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.129+0000 7ff9cdffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:21.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.129+0000 7ff9cdffb640 1 -- 172.21.15.19:0/1120195142 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc036060 con 0x5587a0b1f370 2024-09-19T09:03:21.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.129+0000 7ff9cdffb640 1 -- 172.21.15.19:0/1120195142 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7ff9dc005720 con 0x5587a0b1f370 2024-09-19T09:03:21.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.129+0000 7ff9ee7bc740 1 -- 172.21.15.19:0/1120195142 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9dc016070 con 0x5587a0b1f370 2024-09-19T09:03:21.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.129+0000 7ff9cdffb640 1 -- 172.21.15.19:0/1120195142 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7ff9dc013510 con 0x5587a0b1f370 2024-09-19T09:03:21.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.129+0000 7ff9ee7bc740 10 client.18057 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:21.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.129+0000 7ff9ee7bc740 1 -- 172.21.15.19:0/1120195142 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5587a0b98d80 con 0x5587a0b1f370 2024-09-19T09:03:21.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.129+0000 7ff9cdffb640 1 -- 172.21.15.19:0/1120195142 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff9dc016070 con 0x5587a0b1f370 2024-09-19T09:03:21.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.129+0000 7ff9cdffb640 1 -- 172.21.15.19:0/1120195142 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7ff9dc025030 con 0x5587a0b1f370 2024-09-19T09:03:21.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.129+0000 7ff9ee7bc740 10 client.18057 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:21.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.129+0000 7ff9ee7bc740 10 client.18057 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:03:21.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.129+0000 7ff9ee7bc740 20 client.18057 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:21.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.129+0000 7ff9ee7bc740 1 --2- 172.21.15.19:0/1120195142 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x5587a0b993f0 0x5587a0b9b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:21.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.129+0000 7ff9ee7bc740 4 client.18057 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:03:21.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.129+0000 7ff9ee7bc740 1 -- 172.21.15.19:0/1120195142 --> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5587a0a81d70 con 0x5587a0b993f0 2024-09-19T09:03:21.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.130+0000 7ff9ea17f640 1 --2- 172.21.15.19:0/1120195142 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x5587a0b993f0 0x5587a0b9b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:21.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.130+0000 7ff9cdffb640 10 client.18057 ms_handle_connect on v2:172.21.15.203:6838/2547507299 2024-09-19T09:03:21.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.130+0000 7ff9ea17f640 1 --2- 172.21.15.19:0/1120195142 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x5587a0b993f0 0x5587a0b9b810 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7f888a93bc6395d8 server_cookie=7cb8af740f2d1d5b in_seq=0 out_seq=0 2024-09-19T09:03:21.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.130+0000 7ff9cdffb640 1 -- 172.21.15.19:0/1120195142 <== mds.1 v2:172.21.15.203:6838/2547507299 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5587a0a81d70 con 0x5587a0b993f0 2024-09-19T09:03:21.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.130+0000 7ff9cdffb640 10 client.18057 handle_command_reply: tid=0 2024-09-19T09:03:21.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.130+0000 7ff9ee7bc740 1 client.18057 shutdown 2024-09-19T09:03:21.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.131+0000 7ff9ee7bc740 1 -- 172.21.15.19:0/1120195142 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587a0b1f370 msgr2=0x5587a0b97660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:21.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.131+0000 7ff9ee7bc740 1 --2- 172.21.15.19:0/1120195142 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587a0b1f370 0x5587a0b97660 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc005170 tx=0x7ff9dc0054a0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.131+0000 7ff9ee7bc740 1 -- 172.21.15.19:0/1120195142 shutdown_connections 2024-09-19T09:03:21.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.131+0000 7ff9ee7bc740 1 --2- 172.21.15.19:0/1120195142 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x5587a0b993f0 0x5587a0b9b810 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.131+0000 7ff9cdffb640 0 client.18057 ms_handle_reset on v2:172.21.15.203:6838/2547507299 2024-09-19T09:03:21.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.131+0000 7ff9ee7bc740 1 --2- 172.21.15.19:0/1120195142 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5587a0b15b40 0x5587a0b22ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.131+0000 7ff9ee7bc740 1 --2- 172.21.15.19:0/1120195142 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5587a0b1f370 0x5587a0b97660 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.131+0000 7ff9ee7bc740 1 --2- 172.21.15.19:0/1120195142 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5587a0b145d0 0x5587a0b22660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.131+0000 7ff9ee7bc740 1 -- 172.21.15.19:0/1120195142 >> 172.21.15.19:0/1120195142 conn(0x5587a0add310 msgr2=0x5587a0b1b100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:21.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.131+0000 7ff9ee7bc740 1 -- 172.21.15.19:0/1120195142 shutdown_connections 2024-09-19T09:03:21.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.131+0000 7ff9ee7bc740 1 -- 172.21.15.19:0/1120195142 wait complete. 2024-09-19T09:03:21.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.131+0000 7ff9ee7bc740 20 client.18057 trim_cache size 0 max 16384 2024-09-19T09:03:21.140 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:03:21.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.131+0000 7ff9ec3e3640 1 -- 172.21.15.19:0/1382821593 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff9d00a3240 msgr2=0x7ff9d00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:21.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.131+0000 7ff9ec3e3640 1 --2- 172.21.15.19:0/1382821593 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff9d00a3240 0x7ff9d00a5700 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc0077f0 tx=0x7ff9dc007a20 comp rx=0 tx=0).stop 2024-09-19T09:03:21.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.131+0000 7ff9ec3e3640 1 -- 172.21.15.19:0/1382821593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e4100a80 msgr2=0x7ff9e4102650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:21.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.131+0000 7ff9ec3e3640 1 --2- 172.21.15.19:0/1382821593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e4100a80 0x7ff9e4102650 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7ff9e0009a50 tx=0x7ff9e0004270 comp rx=0 tx=0).stop 2024-09-19T09:03:21.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.131+0000 7ff9ec3e3640 1 -- 172.21.15.19:0/1382821593 shutdown_connections 2024-09-19T09:03:21.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.132+0000 7ff9ec3e3640 1 --2- 172.21.15.19:0/1382821593 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff9d00a3240 0x7ff9d00a5700 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.132+0000 7ff9ec3e3640 1 --2- 172.21.15.19:0/1382821593 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff9e4106a80 0x7ff9e41030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.132+0000 7ff9ec3e3640 1 --2- 172.21.15.19:0/1382821593 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff9e4101420 0x7ff9e4102b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.132+0000 7ff9ec3e3640 1 --2- 172.21.15.19:0/1382821593 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff9e4100a80 0x7ff9e4102650 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:21.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.132+0000 7ff9ec3e3640 1 -- 172.21.15.19:0/1382821593 >> 172.21.15.19:0/1382821593 conn(0x7ff9e40fc7a0 msgr2=0x7ff9e406a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:21.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.132+0000 7ff9ec3e3640 1 -- 172.21.15.19:0/1382821593 shutdown_connections 2024-09-19T09:03:21.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:21.132+0000 7ff9ec3e3640 1 -- 172.21.15.19:0/1382821593 wait complete. 2024-09-19T09:03:21.929 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:03:22.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:21 smithi019 ceph-mon[30976]: pgmap v673: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.3 KiB/s wr, 16 op/s 2024-09-19T09:03:22.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:21 smithi155 ceph-mon[34921]: pgmap v673: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.3 KiB/s wr, 16 op/s 2024-09-19T09:03:22.187 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:22.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:21 smithi203 ceph-mon[35450]: pgmap v673: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.3 KiB/s wr, 16 op/s 2024-09-19T09:03:22.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.661+0000 7fe81c4b1640 1 -- 172.21.15.19:0/3795347494 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe814102dd0 msgr2=0x7fe8141031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:22.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.661+0000 7fe81c4b1640 1 --2- 172.21.15.19:0/3795347494 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe814102dd0 0x7fe8141031b0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fe804009930 tx=0x7fe80402a420 comp rx=0 tx=0).stop 2024-09-19T09:03:22.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.662+0000 7fe81c4b1640 1 -- 172.21.15.19:0/3795347494 shutdown_connections 2024-09-19T09:03:22.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.662+0000 7fe81c4b1640 1 --2- 172.21.15.19:0/3795347494 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe814108300 0x7fe81410ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.662+0000 7fe81c4b1640 1 --2- 172.21.15.19:0/3795347494 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe814103780 0x7fe814107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.662+0000 7fe81c4b1640 1 --2- 172.21.15.19:0/3795347494 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe814102dd0 0x7fe8141031b0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.662+0000 7fe81c4b1640 1 -- 172.21.15.19:0/3795347494 >> 172.21.15.19:0/3795347494 conn(0x7fe8140fc7d0 msgr2=0x7fe8140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:22.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.662+0000 7fe81c4b1640 1 -- 172.21.15.19:0/3795347494 shutdown_connections 2024-09-19T09:03:22.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.662+0000 7fe81c4b1640 1 -- 172.21.15.19:0/3795347494 wait complete. 2024-09-19T09:03:22.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.662+0000 7fe81c4b1640 1 Processor -- start 2024-09-19T09:03:22.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.662+0000 7fe81c4b1640 1 -- start start 2024-09-19T09:03:22.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.662+0000 7fe81c4b1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe814102dd0 0x7fe814100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:22.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.662+0000 7fe81c4b1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe814103780 0x7fe814100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:22.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.662+0000 7fe81c4b1640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe814108300 0x7fe8141014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:22.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.662+0000 7fe81c4b1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe8141120e0 con 0x7fe814102dd0 2024-09-19T09:03:22.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.662+0000 7fe81c4b1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe814111f60 con 0x7fe814103780 2024-09-19T09:03:22.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.662+0000 7fe81c4b1640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe814112260 con 0x7fe814108300 2024-09-19T09:03:22.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.663+0000 7fe81a24d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe814102dd0 0x7fe814100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:22.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.663+0000 7fe81a24d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe814102dd0 0x7fe814100a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54960/0 (socket says 172.21.15.19:54960) 2024-09-19T09:03:22.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.663+0000 7fe81a24d640 1 -- 172.21.15.19:0/2438342269 learned_addr learned my addr 172.21.15.19:0/2438342269 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:22.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.663+0000 7fe819a4c640 1 --2- 172.21.15.19:0/2438342269 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe814103780 0x7fe814100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:22.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.663+0000 7fe81aa4e640 1 --2- 172.21.15.19:0/2438342269 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe814108300 0x7fe8141014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:22.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.663+0000 7fe81a24d640 1 -- 172.21.15.19:0/2438342269 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe814108300 msgr2=0x7fe8141014b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:22.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.663+0000 7fe81a24d640 1 --2- 172.21.15.19:0/2438342269 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe814108300 0x7fe8141014b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.663+0000 7fe81a24d640 1 -- 172.21.15.19:0/2438342269 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe814103780 msgr2=0x7fe814100f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:22.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.663+0000 7fe81a24d640 1 --2- 172.21.15.19:0/2438342269 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe814103780 0x7fe814100f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.663+0000 7fe81a24d640 1 -- 172.21.15.19:0/2438342269 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8141a6a80 con 0x7fe814102dd0 2024-09-19T09:03:22.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.663+0000 7fe819a4c640 1 --2- 172.21.15.19:0/2438342269 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe814103780 0x7fe814100f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:22.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.663+0000 7fe81a24d640 1 --2- 172.21.15.19:0/2438342269 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe814102dd0 0x7fe814100a30 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fe80402a940 tx=0x7fe804003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:22.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.663+0000 7fe8137fe640 1 -- 172.21.15.19:0/2438342269 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80403f070 con 0x7fe814102dd0 2024-09-19T09:03:22.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.663+0000 7fe8137fe640 1 -- 172.21.15.19:0/2438342269 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe804031c90 con 0x7fe814102dd0 2024-09-19T09:03:22.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.663+0000 7fe81c4b1640 1 -- 172.21.15.19:0/2438342269 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8141a6d10 con 0x7fe814102dd0 2024-09-19T09:03:22.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.663+0000 7fe8137fe640 1 -- 172.21.15.19:0/2438342269 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe804035030 con 0x7fe814102dd0 2024-09-19T09:03:22.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.663+0000 7fe81c4b1640 1 -- 172.21.15.19:0/2438342269 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8141a71a0 con 0x7fe814102dd0 2024-09-19T09:03:22.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.665+0000 7fe8137fe640 1 -- 172.21.15.19:0/2438342269 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fe804042070 con 0x7fe814102dd0 2024-09-19T09:03:22.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.666+0000 7fe81e88a740 1 Processor -- start 2024-09-19T09:03:22.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.666+0000 7fe81e88a740 1 -- start start 2024-09-19T09:03:22.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.666+0000 7fe81e88a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55da8560fb40 0x55da8560e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:22.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.666+0000 7fe81e88a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8560e5d0 0x55da8560ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:22.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.666+0000 7fe81e88a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55da85619370 0x55da8561b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:22.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.666+0000 7fe81e88a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55da855742f0 con 0x55da8560e5d0 2024-09-19T09:03:22.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.666+0000 7fe81e88a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55da8551bcf0 con 0x55da8560fb40 2024-09-19T09:03:22.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.666+0000 7fe81e88a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55da855702b0 con 0x55da85619370 2024-09-19T09:03:22.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.666+0000 7fe81a24d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8560e5d0 0x55da8560ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:22.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.666+0000 7fe8137fe640 1 --2- 172.21.15.19:0/2438342269 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe7fc0a3240 0x7fe7fc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:22.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.666+0000 7fe81a24d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8560e5d0 0x55da8560ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54974/0 (socket says 172.21.15.19:54974) 2024-09-19T09:03:22.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.667+0000 7fe81a24d640 1 -- 172.21.15.19:0/2384426502 learned_addr learned my addr 172.21.15.19:0/2384426502 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:22.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.667+0000 7fe81aa4e640 1 --2- 172.21.15.19:0/2384426502 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55da8560fb40 0x55da8560e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:22.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.667+0000 7fe81aa4e640 1 --2- 172.21.15.19:0/2438342269 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe7fc0a3240 0x7fe7fc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:22.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.667+0000 7fe819a4c640 1 --2- 172.21.15.19:0/2384426502 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55da85619370 0x55da8561b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:22.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.667+0000 7fe8137fe640 1 -- 172.21.15.19:0/2438342269 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7fe8040f0150 con 0x7fe814102dd0 2024-09-19T09:03:22.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.667+0000 7fe81a24d640 1 -- 172.21.15.19:0/2384426502 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55da85619370 msgr2=0x55da8561b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:22.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.667+0000 7fe81a24d640 1 --2- 172.21.15.19:0/2384426502 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55da85619370 0x55da8561b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.667+0000 7fe81a24d640 1 -- 172.21.15.19:0/2384426502 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55da8560fb40 msgr2=0x55da8560e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:22.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.667+0000 7fe81a24d640 1 --2- 172.21.15.19:0/2384426502 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55da8560fb40 0x55da8560e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.667+0000 7fe81a24d640 1 -- 172.21.15.19:0/2384426502 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da855003a0 con 0x55da8560e5d0 2024-09-19T09:03:22.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.667+0000 7fe81aa4e640 1 --2- 172.21.15.19:0/2384426502 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55da8560fb40 0x55da8560e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:22.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.667+0000 7fe81a24d640 1 --2- 172.21.15.19:0/2384426502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8560e5d0 0x55da8560ea10 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fe8040edc60 tx=0x7fe804009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c24bbdbdec002910 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:22.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.667+0000 7fe810ff9640 1 -- 172.21.15.19:0/2384426502 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe804049030 con 0x55da8560e5d0 2024-09-19T09:03:22.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.667+0000 7fe810ff9640 1 -- 172.21.15.19:0/2384426502 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8040bce80 con 0x55da8560e5d0 2024-09-19T09:03:22.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.667+0000 7fe810ff9640 1 -- 172.21.15.19:0/2384426502 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8040bab50 con 0x55da8560e5d0 2024-09-19T09:03:22.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.667+0000 7fe81aa4e640 1 --2- 172.21.15.19:0/2438342269 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe7fc0a3240 0x7fe7fc0a5700 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe80c005c40 tx=0x7fe80c005bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:22.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.668+0000 7fe81e88a740 1 -- 172.21.15.19:0/2384426502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8560e5d0 msgr2=0x55da8560ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:22.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.668+0000 7fe81e88a740 1 --2- 172.21.15.19:0/2384426502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8560e5d0 0x55da8560ea10 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fe8040edc60 tx=0x7fe804009260 comp rx=0 tx=0).stop 2024-09-19T09:03:22.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.668+0000 7fe81e88a740 1 -- 172.21.15.19:0/2384426502 shutdown_connections 2024-09-19T09:03:22.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.668+0000 7fe81e88a740 1 --2- 172.21.15.19:0/2384426502 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55da85619370 0x55da8561b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.668+0000 7fe81e88a740 1 --2- 172.21.15.19:0/2384426502 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8560e5d0 0x55da8560ea10 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.668+0000 7fe81e88a740 1 --2- 172.21.15.19:0/2384426502 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55da8560fb40 0x55da8560e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.668+0000 7fe81e88a740 1 -- 172.21.15.19:0/2384426502 >> 172.21.15.19:0/2384426502 conn(0x55da855d7310 msgr2=0x55da8560ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:22.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.668+0000 7fe81e88a740 1 -- 172.21.15.19:0/2384426502 shutdown_connections 2024-09-19T09:03:22.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.668+0000 7fe81e88a740 1 -- 172.21.15.19:0/2384426502 wait complete. 2024-09-19T09:03:22.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.668+0000 7fe81e88a740 1 -- start start 2024-09-19T09:03:22.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.669+0000 7fe81e88a740 1 Processor -- start 2024-09-19T09:03:22.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.669+0000 7fe81e88a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8560e5d0 0x55da85618d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:22.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.669+0000 7fe81e88a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55da8560fb40 0x55da85615fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:22.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.669+0000 7fe81e88a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55da85619370 0x55da85616530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:22.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.669+0000 7fe81e88a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55da8561be30 con 0x55da8560e5d0 2024-09-19T09:03:22.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.669+0000 7fe81e88a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55da8552f060 con 0x55da8560fb40 2024-09-19T09:03:22.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.669+0000 7fe81e88a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55da8561bfb0 con 0x55da85619370 2024-09-19T09:03:22.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.669+0000 7fe81e88a740 10 client.0 _ll_register_callbacks cb 0x55da852828c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:22.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.669+0000 7fe81a24d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8560e5d0 0x55da85618d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:22.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.669+0000 7fe81a24d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8560e5d0 0x55da85618d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:54988/0 (socket says 172.21.15.19:54988) 2024-09-19T09:03:22.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.669+0000 7fe81a24d640 1 -- 172.21.15.19:0/2997826914 learned_addr learned my addr 172.21.15.19:0/2997826914 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:22.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.669+0000 7fe819a4c640 1 --2- 172.21.15.19:0/2997826914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55da8560fb40 0x55da85615fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:22.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.669+0000 7fe81a24d640 1 -- 172.21.15.19:0/2997826914 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55da85619370 msgr2=0x55da85616530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:22.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.669+0000 7fe81a24d640 1 --2- 172.21.15.19:0/2997826914 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55da85619370 0x55da85616530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.669+0000 7fe81a24d640 1 -- 172.21.15.19:0/2997826914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55da8560fb40 msgr2=0x55da85615fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:22.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.669+0000 7fe81a24d640 1 --2- 172.21.15.19:0/2997826914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55da8560fb40 0x55da85615fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.669+0000 7fe81a24d640 1 -- 172.21.15.19:0/2997826914 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da852e53c0 con 0x55da8560e5d0 2024-09-19T09:03:22.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.669+0000 7fe81a24d640 1 --2- 172.21.15.19:0/2997826914 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8560e5d0 0x55da85618d00 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fe8040edfd0 tx=0x7fe8040b8ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab52ba6cdb51e43 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:22.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.669+0000 7fe7f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:22.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.670+0000 7fe7f9ffb640 1 -- 172.21.15.19:0/2997826914 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe804049040 con 0x55da8560e5d0 2024-09-19T09:03:22.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.670+0000 7fe7f9ffb640 1 -- 172.21.15.19:0/2997826914 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7fe80403b5f0 con 0x55da8560e5d0 2024-09-19T09:03:22.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.670+0000 7fe81e88a740 1 -- 172.21.15.19:0/2997826914 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8040bce80 con 0x55da8560e5d0 2024-09-19T09:03:22.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.670+0000 7fe7f9ffb640 1 -- 172.21.15.19:0/2997826914 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fe8040bc780 con 0x55da8560e5d0 2024-09-19T09:03:22.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.670+0000 7fe81e88a740 10 client.18069 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:22.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.670+0000 7fe81e88a740 1 -- 172.21.15.19:0/2997826914 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55da8561be30 con 0x55da8560e5d0 2024-09-19T09:03:22.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.670+0000 7fe7f9ffb640 1 -- 172.21.15.19:0/2997826914 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8040bce80 con 0x55da8560e5d0 2024-09-19T09:03:22.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.670+0000 7fe7f9ffb640 1 -- 172.21.15.19:0/2997826914 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7fe8040bbbd0 con 0x55da8560e5d0 2024-09-19T09:03:22.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.670+0000 7fe81e88a740 10 client.18069 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:22.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.670+0000 7fe81e88a740 10 client.18069 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:22.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.670+0000 7fe81e88a740 20 client.18069 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:22.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.670+0000 7fe81e88a740 1 --2- 172.21.15.19:0/2997826914 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55da85628a70 0x55da8562aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:22.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.670+0000 7fe81e88a740 4 client.18069 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:22.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.670+0000 7fe81e88a740 1 -- 172.21.15.19:0/2997826914 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55da85581860 con 0x55da85628a70 2024-09-19T09:03:22.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.670+0000 7fe819a4c640 1 --2- 172.21.15.19:0/2997826914 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55da85628a70 0x55da8562aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:22.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.671+0000 7fe7f9ffb640 10 client.18069 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:22.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.671+0000 7fe819a4c640 1 --2- 172.21.15.19:0/2997826914 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55da85628a70 0x55da8562aea0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=861ae2a285c0ff93 server_cookie=329d59e5a67d240e in_seq=0 out_seq=0 2024-09-19T09:03:22.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.672+0000 7fe7f9ffb640 1 -- 172.21.15.19:0/2997826914 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55da85581860 con 0x55da85628a70 2024-09-19T09:03:22.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.672+0000 7fe7f9ffb640 10 client.18069 handle_command_reply: tid=0 2024-09-19T09:03:22.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.672+0000 7fe81e88a740 1 client.18069 shutdown 2024-09-19T09:03:22.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.672+0000 7fe81e88a740 1 -- 172.21.15.19:0/2997826914 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8560e5d0 msgr2=0x55da85618d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:22.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.672+0000 7fe81e88a740 1 --2- 172.21.15.19:0/2997826914 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8560e5d0 0x55da85618d00 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fe8040edfd0 tx=0x7fe8040b8ab0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.672+0000 7fe81e88a740 1 -- 172.21.15.19:0/2997826914 shutdown_connections 2024-09-19T09:03:22.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.672+0000 7fe81e88a740 1 --2- 172.21.15.19:0/2997826914 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55da85628a70 0x55da8562aea0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.672+0000 7fe81e88a740 1 --2- 172.21.15.19:0/2997826914 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55da85619370 0x55da85616530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.672+0000 7fe81e88a740 1 --2- 172.21.15.19:0/2997826914 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55da8560fb40 0x55da85615fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.672+0000 7fe81e88a740 1 --2- 172.21.15.19:0/2997826914 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8560e5d0 0x55da85618d00 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.672+0000 7fe81e88a740 1 -- 172.21.15.19:0/2997826914 >> 172.21.15.19:0/2997826914 conn(0x55da855d7310 msgr2=0x55da85610990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:22.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.672+0000 7fe7f9ffb640 0 client.18069 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:22.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.672+0000 7fe81e88a740 1 -- 172.21.15.19:0/2997826914 shutdown_connections 2024-09-19T09:03:22.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.672+0000 7fe81e88a740 1 -- 172.21.15.19:0/2997826914 wait complete. 2024-09-19T09:03:22.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.672+0000 7fe81e88a740 20 client.18069 trim_cache size 0 max 16384 2024-09-19T09:03:22.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.685+0000 7fe81e88a740 1 Processor -- start 2024-09-19T09:03:22.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.685+0000 7fe81e88a740 1 -- start start 2024-09-19T09:03:22.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.685+0000 7fe81e88a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8560e5d0 0x55da85624fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:22.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.685+0000 7fe81e88a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55da8560fb40 0x55da85611120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:22.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.685+0000 7fe81e88a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55da85619370 0x55da85611660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:22.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.685+0000 7fe81e88a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe8141af810 con 0x55da8560e5d0 2024-09-19T09:03:22.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.685+0000 7fe81e88a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe8141b1350 con 0x55da8560fb40 2024-09-19T09:03:22.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.685+0000 7fe81e88a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe8141afee0 con 0x55da85619370 2024-09-19T09:03:22.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.685+0000 7fe81a24d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8560e5d0 0x55da85624fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:22.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.685+0000 7fe81a24d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8560e5d0 0x55da85624fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55002/0 (socket says 172.21.15.19:55002) 2024-09-19T09:03:22.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.685+0000 7fe81a24d640 1 -- 172.21.15.19:0/3659913933 learned_addr learned my addr 172.21.15.19:0/3659913933 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:22.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.685+0000 7fe819a4c640 1 --2- 172.21.15.19:0/3659913933 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55da8560fb40 0x55da85611120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:22.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.685+0000 7fe81aa4e640 1 --2- 172.21.15.19:0/3659913933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55da85619370 0x55da85611660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:22.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.685+0000 7fe81a24d640 1 -- 172.21.15.19:0/3659913933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55da85619370 msgr2=0x55da85611660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:22.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.685+0000 7fe81a24d640 1 --2- 172.21.15.19:0/3659913933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55da85619370 0x55da85611660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.686+0000 7fe81a24d640 1 -- 172.21.15.19:0/3659913933 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55da8560fb40 msgr2=0x55da85611120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:22.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.686+0000 7fe81a24d640 1 --2- 172.21.15.19:0/3659913933 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55da8560fb40 0x55da85611120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.686+0000 7fe81a24d640 1 -- 172.21.15.19:0/3659913933 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da856168a0 con 0x55da8560e5d0 2024-09-19T09:03:22.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.686+0000 7fe81aa4e640 1 --2- 172.21.15.19:0/3659913933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55da85619370 0x55da85611660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:22.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.686+0000 7fe81a24d640 1 --2- 172.21.15.19:0/3659913933 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8560e5d0 0x55da85624fe0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fe8040c4ec0 tx=0x7fe804009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0f884c853ccc4c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:22.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.686+0000 7fe7fbfff640 1 -- 172.21.15.19:0/3659913933 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe804049070 con 0x55da8560e5d0 2024-09-19T09:03:22.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.686+0000 7fe7fbfff640 1 -- 172.21.15.19:0/3659913933 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8040bce80 con 0x55da8560e5d0 2024-09-19T09:03:22.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.686+0000 7fe7fbfff640 1 -- 172.21.15.19:0/3659913933 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80403b5f0 con 0x55da8560e5d0 2024-09-19T09:03:22.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.687+0000 7fe81e88a740 1 -- 172.21.15.19:0/3659913933 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8560e5d0 msgr2=0x55da85624fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:22.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.687+0000 7fe81e88a740 1 --2- 172.21.15.19:0/3659913933 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8560e5d0 0x55da85624fe0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fe8040c4ec0 tx=0x7fe804009260 comp rx=0 tx=0).stop 2024-09-19T09:03:22.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.687+0000 7fe81e88a740 1 -- 172.21.15.19:0/3659913933 shutdown_connections 2024-09-19T09:03:22.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.687+0000 7fe81e88a740 1 --2- 172.21.15.19:0/3659913933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55da85619370 0x55da85611660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.687+0000 7fe81e88a740 1 --2- 172.21.15.19:0/3659913933 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55da8560fb40 0x55da85611120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.687+0000 7fe81e88a740 1 --2- 172.21.15.19:0/3659913933 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da8560e5d0 0x55da85624fe0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.687+0000 7fe81e88a740 1 -- 172.21.15.19:0/3659913933 >> 172.21.15.19:0/3659913933 conn(0x55da855d7310 msgr2=0x55da85614f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:22.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.687+0000 7fe81e88a740 1 -- 172.21.15.19:0/3659913933 shutdown_connections 2024-09-19T09:03:22.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.687+0000 7fe81e88a740 1 -- 172.21.15.19:0/3659913933 wait complete. 2024-09-19T09:03:22.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.688+0000 7fe81e88a740 1 -- start start 2024-09-19T09:03:22.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.688+0000 7fe81e88a740 1 Processor -- start 2024-09-19T09:03:22.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.688+0000 7fe81e88a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55da8560e5d0 0x55da85621220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:22.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.688+0000 7fe81e88a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55da8560fb40 0x55da85621760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:22.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.688+0000 7fe81e88a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da85619370 0x55da856127e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:22.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.688+0000 7fe81e88a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe8141b0c80 con 0x55da85619370 2024-09-19T09:03:22.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.688+0000 7fe81e88a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe8141b05b0 con 0x55da8560fb40 2024-09-19T09:03:22.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.688+0000 7fe81e88a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe8141ad7f0 con 0x55da8560e5d0 2024-09-19T09:03:22.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.688+0000 7fe81e88a740 10 client.0 _ll_register_callbacks cb 0x7fe80800c390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:22.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.688+0000 7fe81aa4e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da85619370 0x55da856127e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:22.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.688+0000 7fe81aa4e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da85619370 0x55da856127e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55006/0 (socket says 172.21.15.19:55006) 2024-09-19T09:03:22.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.688+0000 7fe81aa4e640 1 -- 172.21.15.19:0/256942221 learned_addr learned my addr 172.21.15.19:0/256942221 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:22.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.688+0000 7fe819a4c640 1 --2- 172.21.15.19:0/256942221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55da8560fb40 0x55da85621760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:22.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.688+0000 7fe81a24d640 1 --2- 172.21.15.19:0/256942221 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55da8560e5d0 0x55da85621220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:22.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.689+0000 7fe81aa4e640 1 -- 172.21.15.19:0/256942221 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55da8560e5d0 msgr2=0x55da85621220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:22.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.689+0000 7fe81aa4e640 1 --2- 172.21.15.19:0/256942221 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55da8560e5d0 0x55da85621220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.689+0000 7fe81aa4e640 1 -- 172.21.15.19:0/256942221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55da8560fb40 msgr2=0x55da85621760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:22.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.689+0000 7fe81aa4e640 1 --2- 172.21.15.19:0/256942221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55da8560fb40 0x55da85621760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.689+0000 7fe81aa4e640 1 -- 172.21.15.19:0/256942221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da85612e20 con 0x55da85619370 2024-09-19T09:03:22.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.689+0000 7fe819a4c640 1 --2- 172.21.15.19:0/256942221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55da8560fb40 0x55da85621760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:22.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.689+0000 7fe81aa4e640 1 --2- 172.21.15.19:0/256942221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da85619370 0x55da856127e0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fe80c005cc0 tx=0x7fe80c009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35f21daa7d2b8d6b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:22.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.689+0000 7fe7f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:22.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.689+0000 7fe7f9ffb640 1 -- 172.21.15.19:0/256942221 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe80c01f750 con 0x55da85619370 2024-09-19T09:03:22.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.689+0000 7fe7f9ffb640 1 -- 172.21.15.19:0/256942221 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7fe80c01f8f0 con 0x55da85619370 2024-09-19T09:03:22.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.689+0000 7fe81e88a740 1 -- 172.21.15.19:0/256942221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe8040bce80 con 0x55da85619370 2024-09-19T09:03:22.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.689+0000 7fe7f9ffb640 1 -- 172.21.15.19:0/256942221 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fe80c01faf0 con 0x55da85619370 2024-09-19T09:03:22.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.689+0000 7fe81e88a740 10 client.18075 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:22.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.689+0000 7fe81e88a740 1 -- 172.21.15.19:0/256942221 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55da85693050 con 0x55da85619370 2024-09-19T09:03:22.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.689+0000 7fe7f9ffb640 1 -- 172.21.15.19:0/256942221 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe8040bce80 con 0x55da85619370 2024-09-19T09:03:22.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.690+0000 7fe7f9ffb640 1 -- 172.21.15.19:0/256942221 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7fe80c01c040 con 0x55da85619370 2024-09-19T09:03:22.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.690+0000 7fe81e88a740 10 client.18075 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:22.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.690+0000 7fe81e88a740 10 client.18075 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:22.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.690+0000 7fe81e88a740 20 client.18075 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:22.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.690+0000 7fe81e88a740 1 --2- 172.21.15.19:0/256942221 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55da85693800 0x55da85695c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:22.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.690+0000 7fe81e88a740 4 client.18075 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:03:22.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.690+0000 7fe81e88a740 1 -- 172.21.15.19:0/256942221 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55da8557bd70 con 0x55da85693800 2024-09-19T09:03:22.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.690+0000 7fe81a24d640 1 --2- 172.21.15.19:0/256942221 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55da85693800 0x55da85695c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:22.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.691+0000 7fe7f9ffb640 10 client.18075 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:22.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.691+0000 7fe81a24d640 1 --2- 172.21.15.19:0/256942221 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55da85693800 0x55da85695c20 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e13926e759712cee server_cookie=b9cc3719b53d074a in_seq=0 out_seq=0 2024-09-19T09:03:22.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.691+0000 7fe7f9ffb640 1 -- 172.21.15.19:0/256942221 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55da8557bd70 con 0x55da85693800 2024-09-19T09:03:22.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.691+0000 7fe7f9ffb640 10 client.18075 handle_command_reply: tid=0 2024-09-19T09:03:22.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.691+0000 7fe81e88a740 1 client.18075 shutdown 2024-09-19T09:03:22.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.691+0000 7fe81e88a740 1 -- 172.21.15.19:0/256942221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da85619370 msgr2=0x55da856127e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:22.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.691+0000 7fe81e88a740 1 --2- 172.21.15.19:0/256942221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da85619370 0x55da856127e0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fe80c005cc0 tx=0x7fe80c009620 comp rx=0 tx=0).stop 2024-09-19T09:03:22.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.691+0000 7fe81e88a740 1 -- 172.21.15.19:0/256942221 shutdown_connections 2024-09-19T09:03:22.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.691+0000 7fe81e88a740 1 --2- 172.21.15.19:0/256942221 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55da85693800 0x55da85695c20 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.691+0000 7fe81e88a740 1 --2- 172.21.15.19:0/256942221 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55da85619370 0x55da856127e0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.691+0000 7fe81e88a740 1 --2- 172.21.15.19:0/256942221 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55da8560fb40 0x55da85621760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.691+0000 7fe81e88a740 1 --2- 172.21.15.19:0/256942221 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55da8560e5d0 0x55da85621220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.691+0000 7fe81e88a740 1 -- 172.21.15.19:0/256942221 >> 172.21.15.19:0/256942221 conn(0x55da855d7310 msgr2=0x55da85614770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:22.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.691+0000 7fe7f9ffb640 0 client.18075 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:22.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.691+0000 7fe81e88a740 1 -- 172.21.15.19:0/256942221 shutdown_connections 2024-09-19T09:03:22.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.691+0000 7fe81e88a740 1 -- 172.21.15.19:0/256942221 wait complete. 2024-09-19T09:03:22.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.691+0000 7fe81e88a740 20 client.18075 trim_cache size 0 max 16384 2024-09-19T09:03:22.705 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:03:22.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.692+0000 7fe81c4b1640 1 -- 172.21.15.19:0/2438342269 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe7fc0a3240 msgr2=0x7fe7fc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:22.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.692+0000 7fe81c4b1640 1 --2- 172.21.15.19:0/2438342269 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe7fc0a3240 0x7fe7fc0a5700 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fe80c005c40 tx=0x7fe80c005bd0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.692+0000 7fe81c4b1640 1 -- 172.21.15.19:0/2438342269 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe814102dd0 msgr2=0x7fe814100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:22.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.692+0000 7fe81c4b1640 1 --2- 172.21.15.19:0/2438342269 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe814102dd0 0x7fe814100a30 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fe80402a940 tx=0x7fe804003b90 comp rx=0 tx=0).stop 2024-09-19T09:03:22.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.692+0000 7fe81c4b1640 1 -- 172.21.15.19:0/2438342269 shutdown_connections 2024-09-19T09:03:22.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.692+0000 7fe81c4b1640 1 --2- 172.21.15.19:0/2438342269 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe7fc0a3240 0x7fe7fc0a5700 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.692+0000 7fe81c4b1640 1 --2- 172.21.15.19:0/2438342269 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe814108300 0x7fe8141014b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.692+0000 7fe81c4b1640 1 --2- 172.21.15.19:0/2438342269 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe814103780 0x7fe814100f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.692+0000 7fe81c4b1640 1 --2- 172.21.15.19:0/2438342269 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe814102dd0 0x7fe814100a30 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:22.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.692+0000 7fe81c4b1640 1 -- 172.21.15.19:0/2438342269 >> 172.21.15.19:0/2438342269 conn(0x7fe8140fc7d0 msgr2=0x7fe814105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:22.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.692+0000 7fe81c4b1640 1 -- 172.21.15.19:0/2438342269 shutdown_connections 2024-09-19T09:03:22.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:22.692+0000 7fe81c4b1640 1 -- 172.21.15.19:0/2438342269 wait complete. 2024-09-19T09:03:23.360 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:03:23.623 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:23.998 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:23 smithi019 ceph-mon[30976]: pgmap v674: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 4.7 KiB/s wr, 17 op/s 2024-09-19T09:03:24.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.081+0000 7f461759e640 1 -- 172.21.15.19:0/259976303 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4618101270 msgr2=0x7f461810d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:24.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.081+0000 7f461759e640 1 --2- 172.21.15.19:0/259976303 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4618101270 0x7f461810d7a0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f4608009930 tx=0x7f460802a420 comp rx=0 tx=0).stop 2024-09-19T09:03:24.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.081+0000 7f461759e640 1 -- 172.21.15.19:0/259976303 shutdown_connections 2024-09-19T09:03:24.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.081+0000 7f461759e640 1 --2- 172.21.15.19:0/259976303 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46181008d0 0x7f4618100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.081+0000 7f461759e640 1 --2- 172.21.15.19:0/259976303 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4618101270 0x7f461810d7a0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.081+0000 7f461759e640 1 --2- 172.21.15.19:0/259976303 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46181068d0 0x7f4618106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.081+0000 7f461759e640 1 -- 172.21.15.19:0/259976303 >> 172.21.15.19:0/259976303 conn(0x7f46180fc630 msgr2=0x7f46180fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:24.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.081+0000 7f461759e640 1 -- 172.21.15.19:0/259976303 shutdown_connections 2024-09-19T09:03:24.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.081+0000 7f461759e640 1 -- 172.21.15.19:0/259976303 wait complete. 2024-09-19T09:03:24.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.082+0000 7f461759e640 1 Processor -- start 2024-09-19T09:03:24.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.082+0000 7f461759e640 1 -- start start 2024-09-19T09:03:24.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.082+0000 7f461759e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46181008d0 0x7f46181982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:24.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.082+0000 7f461759e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4618101270 0x7f46181987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:24.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.082+0000 7f461759e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46181068d0 0x7f461819cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:24.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.082+0000 7f461759e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4618110cd0 con 0x7f4618101270 2024-09-19T09:03:24.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.082+0000 7f461759e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4618110b50 con 0x7f46181008d0 2024-09-19T09:03:24.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.082+0000 7f461759e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4618110e50 con 0x7f46181068d0 2024-09-19T09:03:24.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.082+0000 7f4615d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4618101270 0x7f46181987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:24.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.082+0000 7f4615d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4618101270 0x7f46181987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:55018/0 (socket says 172.21.15.19:55018) 2024-09-19T09:03:24.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.082+0000 7f4615d9b640 1 -- 172.21.15.19:0/1316222962 learned_addr learned my addr 172.21.15.19:0/1316222962 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:24.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.083+0000 7f4616d9d640 1 --2- 172.21.15.19:0/1316222962 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46181068d0 0x7f461819cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:24.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.083+0000 7f461659c640 1 --2- 172.21.15.19:0/1316222962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46181008d0 0x7f46181982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:24.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.083+0000 7f4615d9b640 1 -- 172.21.15.19:0/1316222962 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46181068d0 msgr2=0x7f461819cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:24.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.083+0000 7f4615d9b640 1 --2- 172.21.15.19:0/1316222962 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46181068d0 0x7f461819cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.083+0000 7f4615d9b640 1 -- 172.21.15.19:0/1316222962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46181008d0 msgr2=0x7f46181982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:24.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.083+0000 7f4615d9b640 1 --2- 172.21.15.19:0/1316222962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46181008d0 0x7f46181982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.083+0000 7f4615d9b640 1 -- 172.21.15.19:0/1316222962 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f461819d250 con 0x7f4618101270 2024-09-19T09:03:24.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.083+0000 7f4615d9b640 1 --2- 172.21.15.19:0/1316222962 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4618101270 0x7f46181987e0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f460000e9f0 tx=0x7f460000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:24.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.083+0000 7f460f7fe640 1 -- 172.21.15.19:0/1316222962 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460000cd80 con 0x7f4618101270 2024-09-19T09:03:24.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.083+0000 7f460f7fe640 1 -- 172.21.15.19:0/1316222962 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4600010910 con 0x7f4618101270 2024-09-19T09:03:24.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.083+0000 7f461759e640 1 -- 172.21.15.19:0/1316222962 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f461819d540 con 0x7f4618101270 2024-09-19T09:03:24.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.083+0000 7f460f7fe640 1 -- 172.21.15.19:0/1316222962 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4600018990 con 0x7f4618101270 2024-09-19T09:03:24.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.083+0000 7f461759e640 1 -- 172.21.15.19:0/1316222962 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46181a4e20 con 0x7f4618101270 2024-09-19T09:03:24.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.084+0000 7f461759e640 1 -- 172.21.15.19:0/1316222962 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4618100d30 con 0x7f4618101270 2024-09-19T09:03:24.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.085+0000 7f460f7fe640 1 -- 172.21.15.19:0/1316222962 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f4600010ac0 con 0x7f4618101270 2024-09-19T09:03:24.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.086+0000 7f460f7fe640 1 --2- 172.21.15.19:0/1316222962 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f46040a3240 0x7f46040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:24.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.086+0000 7f461659c640 1 --2- 172.21.15.19:0/1316222962 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f46040a3240 0x7f46040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:24.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.086+0000 7f460f7fe640 1 -- 172.21.15.19:0/1316222962 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f46000cfc70 con 0x7f4618101270 2024-09-19T09:03:24.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.087+0000 7f461659c640 1 --2- 172.21.15.19:0/1316222962 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f46040a3240 0x7f46040a5700 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4610005fd0 tx=0x7f4610009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:24.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.090+0000 7f460f7fe640 1 -- 172.21.15.19:0/1316222962 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f460009c2f0 con 0x7f4618101270 2024-09-19T09:03:24.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:23 smithi155 ceph-mon[34921]: pgmap v674: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 4.7 KiB/s wr, 17 op/s 2024-09-19T09:03:24.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:23 smithi203 ceph-mon[35450]: pgmap v674: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 4.7 KiB/s wr, 17 op/s 2024-09-19T09:03:24.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.303+0000 7f461759e640 1 -- 172.21.15.19:0/1316222962 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f461802d7c0 con 0x7f4618101270 2024-09-19T09:03:24.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.304+0000 7f460f7fe640 1 -- 172.21.15.19:0/1316222962 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+11983 (secure 0 0 0) 0x7f46000a05f0 con 0x7f4618101270 2024-09-19T09:03:24.303 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T09:03:24.304 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":39,"btime":"2024-09-19T09:02:47:631181+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":17751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/3815927080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":3815927080},{"type":"v1","addr":"172.21.15.19:6839","nonce":3815927080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":39,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T09:02:47.631165+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26453":{"gid":26453,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/3907362737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3907362737},{"type":"v1","addr":"172.21.15.155:6835","nonce":3907362737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24469,24490,24464,24463]},"id":1}]} 2024-09-19T09:03:24.304 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 39 2024-09-19T09:03:24.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.306+0000 7f461759e640 1 -- 172.21.15.19:0/1316222962 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f46040a3240 msgr2=0x7f46040a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:24.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.306+0000 7f461759e640 1 --2- 172.21.15.19:0/1316222962 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f46040a3240 0x7f46040a5700 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4610005fd0 tx=0x7f4610009500 comp rx=0 tx=0).stop 2024-09-19T09:03:24.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.306+0000 7f461759e640 1 -- 172.21.15.19:0/1316222962 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4618101270 msgr2=0x7f46181987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:24.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.306+0000 7f461759e640 1 --2- 172.21.15.19:0/1316222962 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4618101270 0x7f46181987e0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f460000e9f0 tx=0x7f460000eeb0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.306+0000 7f461759e640 1 -- 172.21.15.19:0/1316222962 shutdown_connections 2024-09-19T09:03:24.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.306+0000 7f461759e640 1 --2- 172.21.15.19:0/1316222962 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f46040a3240 0x7f46040a5700 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.306+0000 7f461759e640 1 --2- 172.21.15.19:0/1316222962 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f46181068d0 0x7f461819cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.306+0000 7f461759e640 1 --2- 172.21.15.19:0/1316222962 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4618101270 0x7f46181987e0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.306+0000 7f461759e640 1 --2- 172.21.15.19:0/1316222962 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f46181008d0 0x7f46181982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:24.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.306+0000 7f461759e640 1 -- 172.21.15.19:0/1316222962 >> 172.21.15.19:0/1316222962 conn(0x7f46180fc630 msgr2=0x7f461806aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:24.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.306+0000 7f461759e640 1 -- 172.21.15.19:0/1316222962 shutdown_connections 2024-09-19T09:03:24.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:24.306+0000 7f461759e640 1 -- 172.21.15.19:0/1316222962 wait complete. 2024-09-19T09:03:24.578 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:03:24.578 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:03:24.986 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:24 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1316222962' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:25.017 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db --set-id 58095ad0 --release --await' 2024-09-19T09:03:25.017 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db --set-id 58095ad0 --release --await 2024-09-19T09:03:25.068 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:25.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:24 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1316222962' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:25.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:24 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1316222962' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:25.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.602+0000 7ff761b31640 1 -- 172.21.15.19:0/3595493585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff75c102ef0 msgr2=0x7ff75c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:25.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.602+0000 7ff761b31640 1 --2- 172.21.15.19:0/3595493585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff75c102ef0 0x7ff75c10da40 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7ff754009ca0 tx=0x7ff75402a950 comp rx=0 tx=0).stop 2024-09-19T09:03:25.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.602+0000 7ff761b31640 1 -- 172.21.15.19:0/3595493585 shutdown_connections 2024-09-19T09:03:25.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.602+0000 7ff761b31640 1 --2- 172.21.15.19:0/3595493585 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff75c102570 0x7ff75c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.602+0000 7ff761b31640 1 --2- 172.21.15.19:0/3595493585 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff75c102ef0 0x7ff75c10da40 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.602+0000 7ff761b31640 1 --2- 172.21.15.19:0/3595493585 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff75c100e20 0x7ff75c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.602+0000 7ff761b31640 1 -- 172.21.15.19:0/3595493585 >> 172.21.15.19:0/3595493585 conn(0x7ff75c0fc7d0 msgr2=0x7ff75c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:25.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.602+0000 7ff761b31640 1 -- 172.21.15.19:0/3595493585 shutdown_connections 2024-09-19T09:03:25.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.602+0000 7ff761b31640 1 -- 172.21.15.19:0/3595493585 wait complete. 2024-09-19T09:03:25.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.602+0000 7ff761b31640 1 Processor -- start 2024-09-19T09:03:25.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.603+0000 7ff761b31640 1 -- start start 2024-09-19T09:03:25.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.603+0000 7ff761b31640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff75c100e20 0x7ff75c197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:25.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.603+0000 7ff761b31640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff75c102570 0x7ff75c197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:25.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.603+0000 7ff761b31640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff75c102ef0 0x7ff75c19bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:25.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.603+0000 7ff761b31640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff75c110fc0 con 0x7ff75c102570 2024-09-19T09:03:25.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.603+0000 7ff761b31640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff75c110e40 con 0x7ff75c100e20 2024-09-19T09:03:25.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.603+0000 7ff761b31640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff75c111140 con 0x7ff75c102ef0 2024-09-19T09:03:25.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.603+0000 7ff75affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff75c102570 0x7ff75c197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:25.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.603+0000 7ff75affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff75c102570 0x7ff75c197980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42002/0 (socket says 172.21.15.19:42002) 2024-09-19T09:03:25.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.603+0000 7ff75affd640 1 -- 172.21.15.19:0/2647609919 learned_addr learned my addr 172.21.15.19:0/2647609919 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:25.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.603+0000 7ff75bfff640 1 --2- 172.21.15.19:0/2647609919 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff75c102ef0 0x7ff75c19bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:25.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.603+0000 7ff75b7fe640 1 --2- 172.21.15.19:0/2647609919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff75c100e20 0x7ff75c197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:25.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.604+0000 7ff75affd640 1 -- 172.21.15.19:0/2647609919 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff75c102ef0 msgr2=0x7ff75c19bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:25.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.604+0000 7ff75affd640 1 --2- 172.21.15.19:0/2647609919 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff75c102ef0 0x7ff75c19bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.604+0000 7ff75affd640 1 -- 172.21.15.19:0/2647609919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff75c100e20 msgr2=0x7ff75c197440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:25.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.604+0000 7ff75affd640 1 --2- 172.21.15.19:0/2647609919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff75c100e20 0x7ff75c197440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.604+0000 7ff75affd640 1 -- 172.21.15.19:0/2647609919 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff75c19c3f0 con 0x7ff75c102570 2024-09-19T09:03:25.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.604+0000 7ff75affd640 1 --2- 172.21.15.19:0/2647609919 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff75c102570 0x7ff75c197980 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7ff75000c970 tx=0x7ff75000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:25.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.604+0000 7ff758ff9640 1 -- 172.21.15.19:0/2647609919 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff750007bb0 con 0x7ff75c102570 2024-09-19T09:03:25.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.604+0000 7ff761b31640 1 -- 172.21.15.19:0/2647609919 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff75c19c6e0 con 0x7ff75c102570 2024-09-19T09:03:25.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.604+0000 7ff758ff9640 1 -- 172.21.15.19:0/2647609919 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff750007d50 con 0x7ff75c102570 2024-09-19T09:03:25.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.604+0000 7ff758ff9640 1 -- 172.21.15.19:0/2647609919 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75000f450 con 0x7ff75c102570 2024-09-19T09:03:25.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.605+0000 7ff761b31640 1 -- 172.21.15.19:0/2647609919 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff75c1a3fc0 con 0x7ff75c102570 2024-09-19T09:03:25.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.607+0000 7ff758ff9640 1 -- 172.21.15.19:0/2647609919 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7ff750004f40 con 0x7ff75c102570 2024-09-19T09:03:25.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.607+0000 7ff758ff9640 1 --2- 172.21.15.19:0/2647609919 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff7440a3240 0x7ff7440a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:25.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.608+0000 7ff763f0a740 1 Processor -- start 2024-09-19T09:03:25.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.608+0000 7ff75b7fe640 1 --2- 172.21.15.19:0/2647609919 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff7440a3240 0x7ff7440a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:25.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.608+0000 7ff763f0a740 1 -- start start 2024-09-19T09:03:25.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.608+0000 7ff758ff9640 1 -- 172.21.15.19:0/2647609919 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7ff7500cf5d0 con 0x7ff75c102570 2024-09-19T09:03:25.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.608+0000 7ff763f0a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccfc9d6d70 0x55ccfc9d7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:25.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.608+0000 7ff763f0a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfc9d7690 0x55ccfc9e1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:25.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.608+0000 7ff763f0a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfc9e1f50 0x55ccfc9e4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:25.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.608+0000 7ff763f0a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ccfc93a280 con 0x55ccfc9e1f50 2024-09-19T09:03:25.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.608+0000 7ff763f0a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55ccfc8e1b10 con 0x55ccfc9d6d70 2024-09-19T09:03:25.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.608+0000 7ff763f0a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ccfc936240 con 0x55ccfc9d7690 2024-09-19T09:03:25.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.608+0000 7ff75b7fe640 1 --2- 172.21.15.19:0/2647609919 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff7440a3240 0x7ff7440a5700 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff74c009990 tx=0x7ff74c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:25.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.608+0000 7ff75bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfc9e1f50 0x55ccfc9e4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:25.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.608+0000 7ff75bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfc9e1f50 0x55ccfc9e4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42014/0 (socket says 172.21.15.19:42014) 2024-09-19T09:03:25.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.608+0000 7ff75bfff640 1 -- 172.21.15.19:0/3396228424 learned_addr learned my addr 172.21.15.19:0/3396228424 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:25.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.608+0000 7ff75affd640 1 --2- 172.21.15.19:0/3396228424 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfc9d7690 0x55ccfc9e1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:25.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.608+0000 7ff75b7fe640 1 --2- 172.21.15.19:0/3396228424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccfc9d6d70 0x55ccfc9d7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:25.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.608+0000 7ff75bfff640 1 -- 172.21.15.19:0/3396228424 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfc9d7690 msgr2=0x55ccfc9e1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:25.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.609+0000 7ff75bfff640 1 --2- 172.21.15.19:0/3396228424 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfc9d7690 0x55ccfc9e1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.609+0000 7ff75bfff640 1 -- 172.21.15.19:0/3396228424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccfc9d6d70 msgr2=0x55ccfc9d7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:25.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.609+0000 7ff75bfff640 1 --2- 172.21.15.19:0/3396228424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccfc9d6d70 0x55ccfc9d7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.609+0000 7ff75bfff640 1 -- 172.21.15.19:0/3396228424 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccfc8ee1f0 con 0x55ccfc9e1f50 2024-09-19T09:03:25.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.609+0000 7ff75b7fe640 1 --2- 172.21.15.19:0/3396228424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccfc9d6d70 0x55ccfc9d7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:25.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.609+0000 7ff75bfff640 1 --2- 172.21.15.19:0/3396228424 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfc9e1f50 0x55ccfc9e4340 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7ff754035000 tx=0x7ff75402ff40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8883263712798878 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:25.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.609+0000 7ff741ffb640 1 -- 172.21.15.19:0/3396228424 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff754048070 con 0x55ccfc9e1f50 2024-09-19T09:03:25.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.609+0000 7ff741ffb640 1 -- 172.21.15.19:0/3396228424 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff75402faf0 con 0x55ccfc9e1f50 2024-09-19T09:03:25.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.609+0000 7ff741ffb640 1 -- 172.21.15.19:0/3396228424 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff754034040 con 0x55ccfc9e1f50 2024-09-19T09:03:25.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.610+0000 7ff763f0a740 1 -- 172.21.15.19:0/3396228424 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfc9e1f50 msgr2=0x55ccfc9e4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:25.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.610+0000 7ff763f0a740 1 --2- 172.21.15.19:0/3396228424 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfc9e1f50 0x55ccfc9e4340 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7ff754035000 tx=0x7ff75402ff40 comp rx=0 tx=0).stop 2024-09-19T09:03:25.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.610+0000 7ff763f0a740 1 -- 172.21.15.19:0/3396228424 shutdown_connections 2024-09-19T09:03:25.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.610+0000 7ff763f0a740 1 --2- 172.21.15.19:0/3396228424 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfc9d7690 0x55ccfc9e1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.610+0000 7ff763f0a740 1 --2- 172.21.15.19:0/3396228424 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfc9e1f50 0x55ccfc9e4340 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.610+0000 7ff763f0a740 1 --2- 172.21.15.19:0/3396228424 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccfc9d6d70 0x55ccfc9d7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.610+0000 7ff763f0a740 1 -- 172.21.15.19:0/3396228424 >> 172.21.15.19:0/3396228424 conn(0x55ccfc9d3300 msgr2=0x55ccfc9d36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:25.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.610+0000 7ff763f0a740 1 -- 172.21.15.19:0/3396228424 shutdown_connections 2024-09-19T09:03:25.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.610+0000 7ff763f0a740 1 -- 172.21.15.19:0/3396228424 wait complete. 2024-09-19T09:03:25.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.610+0000 7ff763f0a740 1 -- start start 2024-09-19T09:03:25.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.610+0000 7ff763f0a740 1 Processor -- start 2024-09-19T09:03:25.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.611+0000 7ff763f0a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfc9d6d70 0x55ccfc9dede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:25.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.611+0000 7ff763f0a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccfc9d7690 0x55ccfc9df320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:25.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.611+0000 7ff763f0a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfc9e1f50 0x55ccfc9df860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:25.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.611+0000 7ff763f0a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ccfc9e4b20 con 0x55ccfc9e1f50 2024-09-19T09:03:25.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.611+0000 7ff763f0a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55ccfc8f4f10 con 0x55ccfc9d7690 2024-09-19T09:03:25.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.611+0000 7ff763f0a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ccfc9e4ca0 con 0x55ccfc9d6d70 2024-09-19T09:03:25.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.611+0000 7ff763f0a740 10 client.0 _ll_register_callbacks cb 0x55ccfc8bda40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:25.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.611+0000 7ff75bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfc9e1f50 0x55ccfc9df860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:25.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.611+0000 7ff75bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfc9e1f50 0x55ccfc9df860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42030/0 (socket says 172.21.15.19:42030) 2024-09-19T09:03:25.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.611+0000 7ff75bfff640 1 -- 172.21.15.19:0/3215182578 learned_addr learned my addr 172.21.15.19:0/3215182578 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:25.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.611+0000 7ff75b7fe640 1 --2- 172.21.15.19:0/3215182578 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfc9d6d70 0x55ccfc9dede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:25.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.611+0000 7ff75affd640 1 --2- 172.21.15.19:0/3215182578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccfc9d7690 0x55ccfc9df320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:25.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.611+0000 7ff75bfff640 1 -- 172.21.15.19:0/3215182578 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfc9d6d70 msgr2=0x55ccfc9dede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:25.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.611+0000 7ff75bfff640 1 --2- 172.21.15.19:0/3215182578 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfc9d6d70 0x55ccfc9dede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.611+0000 7ff75bfff640 1 -- 172.21.15.19:0/3215182578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccfc9d7690 msgr2=0x55ccfc9df320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:25.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.611+0000 7ff75bfff640 1 --2- 172.21.15.19:0/3215182578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccfc9d7690 0x55ccfc9df320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.611+0000 7ff75bfff640 1 -- 172.21.15.19:0/3215182578 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ccfc6ab6a0 con 0x55ccfc9e1f50 2024-09-19T09:03:25.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.611+0000 7ff75affd640 1 --2- 172.21.15.19:0/3215182578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccfc9d7690 0x55ccfc9df320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:25.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.611+0000 7ff75bfff640 1 --2- 172.21.15.19:0/3215182578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfc9e1f50 0x55ccfc9df860 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7ff754009bf0 tx=0x7ff754003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4478df832551f1b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:25.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.611+0000 7ff73affd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:25.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.612+0000 7ff73affd640 1 -- 172.21.15.19:0/3215182578 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff754048030 con 0x55ccfc9e1f50 2024-09-19T09:03:25.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.612+0000 7ff73affd640 1 -- 172.21.15.19:0/3215182578 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7ff754040050 con 0x55ccfc9e1f50 2024-09-19T09:03:25.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.612+0000 7ff763f0a740 1 -- 172.21.15.19:0/3215182578 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff75402faf0 con 0x55ccfc9e1f50 2024-09-19T09:03:25.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.612+0000 7ff73affd640 1 -- 172.21.15.19:0/3215182578 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7ff754034040 con 0x55ccfc9e1f50 2024-09-19T09:03:25.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.612+0000 7ff763f0a740 10 client.18093 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:25.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.612+0000 7ff763f0a740 1 -- 172.21.15.19:0/3215182578 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55ccfc9f06d0 con 0x55ccfc9e1f50 2024-09-19T09:03:25.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.612+0000 7ff73affd640 1 -- 172.21.15.19:0/3215182578 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff75402faf0 con 0x55ccfc9e1f50 2024-09-19T09:03:25.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.612+0000 7ff73affd640 1 -- 172.21.15.19:0/3215182578 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7ff754030560 con 0x55ccfc9e1f50 2024-09-19T09:03:25.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.612+0000 7ff763f0a740 10 client.18093 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:25.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.612+0000 7ff763f0a740 10 client.18093 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:25.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.612+0000 7ff763f0a740 20 client.18093 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:25.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.612+0000 7ff763f0a740 1 --2- 172.21.15.19:0/3215182578 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ccfc9f1a20 0x55ccfc9f3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:25.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.612+0000 7ff763f0a740 4 client.18093 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:25.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.612+0000 7ff763f0a740 1 -- 172.21.15.19:0/3215182578 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ccfc9477f0 con 0x55ccfc9f1a20 2024-09-19T09:03:25.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.612+0000 7ff75b7fe640 1 --2- 172.21.15.19:0/3215182578 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ccfc9f1a20 0x55ccfc9f3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:25.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.613+0000 7ff73affd640 10 client.18093 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:25.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.613+0000 7ff75b7fe640 1 --2- 172.21.15.19:0/3215182578 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ccfc9f1a20 0x55ccfc9f3e10 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=293f6767de3ec9ac server_cookie=fcd51708a0661915 in_seq=0 out_seq=0 2024-09-19T09:03:25.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.613+0000 7ff73affd640 1 -- 172.21.15.19:0/3215182578 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ccfc9477f0 con 0x55ccfc9f1a20 2024-09-19T09:03:25.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.613+0000 7ff73affd640 10 client.18093 handle_command_reply: tid=0 2024-09-19T09:03:25.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.614+0000 7ff763f0a740 1 client.18093 shutdown 2024-09-19T09:03:25.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.614+0000 7ff763f0a740 1 -- 172.21.15.19:0/3215182578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfc9e1f50 msgr2=0x55ccfc9df860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:25.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.614+0000 7ff763f0a740 1 --2- 172.21.15.19:0/3215182578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfc9e1f50 0x55ccfc9df860 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7ff754009bf0 tx=0x7ff754003c20 comp rx=0 tx=0).stop 2024-09-19T09:03:25.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.614+0000 7ff763f0a740 1 -- 172.21.15.19:0/3215182578 shutdown_connections 2024-09-19T09:03:25.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.614+0000 7ff763f0a740 1 --2- 172.21.15.19:0/3215182578 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ccfc9f1a20 0x55ccfc9f3e10 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.614+0000 7ff763f0a740 1 --2- 172.21.15.19:0/3215182578 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfc9e1f50 0x55ccfc9df860 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.614+0000 7ff763f0a740 1 --2- 172.21.15.19:0/3215182578 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccfc9d7690 0x55ccfc9df320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.614+0000 7ff763f0a740 1 --2- 172.21.15.19:0/3215182578 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfc9d6d70 0x55ccfc9dede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.614+0000 7ff73affd640 0 client.18093 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:25.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.614+0000 7ff763f0a740 1 -- 172.21.15.19:0/3215182578 >> 172.21.15.19:0/3215182578 conn(0x55ccfc9d3300 msgr2=0x55ccfc9d0270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:25.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.614+0000 7ff763f0a740 1 -- 172.21.15.19:0/3215182578 shutdown_connections 2024-09-19T09:03:25.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.614+0000 7ff763f0a740 1 -- 172.21.15.19:0/3215182578 wait complete. 2024-09-19T09:03:25.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.614+0000 7ff763f0a740 20 client.18093 trim_cache size 0 max 16384 2024-09-19T09:03:25.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.632+0000 7ff763f0a740 1 Processor -- start 2024-09-19T09:03:25.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.632+0000 7ff763f0a740 1 -- start start 2024-09-19T09:03:25.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.632+0000 7ff763f0a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfc9d6d70 0x55ccfc9d97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:25.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.633+0000 7ff763f0a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfc9d7690 0x55ccfc9e0c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:25.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.633+0000 7ff763f0a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccfc9e1f50 0x55ccfc9f93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:25.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.633+0000 7ff763f0a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff75c1ab280 con 0x55ccfc9d7690 2024-09-19T09:03:25.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.633+0000 7ff763f0a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff75c1acdc0 con 0x55ccfc9e1f50 2024-09-19T09:03:25.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.633+0000 7ff763f0a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff75c1ab950 con 0x55ccfc9d6d70 2024-09-19T09:03:25.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.633+0000 7ff75affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfc9d7690 0x55ccfc9e0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:25.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.633+0000 7ff75affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfc9d7690 0x55ccfc9e0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42046/0 (socket says 172.21.15.19:42046) 2024-09-19T09:03:25.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.633+0000 7ff75affd640 1 -- 172.21.15.19:0/3598887102 learned_addr learned my addr 172.21.15.19:0/3598887102 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:25.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.633+0000 7ff75b7fe640 1 --2- 172.21.15.19:0/3598887102 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfc9d6d70 0x55ccfc9d97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:25.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.633+0000 7ff75bfff640 1 --2- 172.21.15.19:0/3598887102 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccfc9e1f50 0x55ccfc9f93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:25.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.633+0000 7ff75affd640 1 -- 172.21.15.19:0/3598887102 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfc9d6d70 msgr2=0x55ccfc9d97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:25.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.633+0000 7ff75affd640 1 --2- 172.21.15.19:0/3598887102 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfc9d6d70 0x55ccfc9d97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.633+0000 7ff75affd640 1 -- 172.21.15.19:0/3598887102 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccfc9e1f50 msgr2=0x55ccfc9f93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:25.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.633+0000 7ff75affd640 1 --2- 172.21.15.19:0/3598887102 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccfc9e1f50 0x55ccfc9f93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.633+0000 7ff75affd640 1 -- 172.21.15.19:0/3598887102 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ccfc9d2da0 con 0x55ccfc9d7690 2024-09-19T09:03:25.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.633+0000 7ff75b7fe640 1 --2- 172.21.15.19:0/3598887102 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfc9d6d70 0x55ccfc9d97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:25.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.633+0000 7ff75bfff640 1 --2- 172.21.15.19:0/3598887102 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccfc9e1f50 0x55ccfc9f93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:25.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.633+0000 7ff75affd640 1 --2- 172.21.15.19:0/3598887102 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfc9d7690 0x55ccfc9e0c40 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7ff7500cd130 tx=0x7ff7500ccfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1085c254391b7ae1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:25.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.633+0000 7ff7417fa640 1 -- 172.21.15.19:0/3598887102 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7500b2030 con 0x55ccfc9d7690 2024-09-19T09:03:25.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.633+0000 7ff7417fa640 1 -- 172.21.15.19:0/3598887102 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7500a4870 con 0x55ccfc9d7690 2024-09-19T09:03:25.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.633+0000 7ff7417fa640 1 -- 172.21.15.19:0/3598887102 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff75001d040 con 0x55ccfc9d7690 2024-09-19T09:03:25.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.634+0000 7ff763f0a740 1 -- 172.21.15.19:0/3598887102 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfc9d7690 msgr2=0x55ccfc9e0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:25.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.634+0000 7ff763f0a740 1 --2- 172.21.15.19:0/3598887102 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfc9d7690 0x55ccfc9e0c40 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7ff7500cd130 tx=0x7ff7500ccfb0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.634+0000 7ff763f0a740 1 -- 172.21.15.19:0/3598887102 shutdown_connections 2024-09-19T09:03:25.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.634+0000 7ff763f0a740 1 --2- 172.21.15.19:0/3598887102 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccfc9e1f50 0x55ccfc9f93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.634+0000 7ff763f0a740 1 --2- 172.21.15.19:0/3598887102 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfc9d7690 0x55ccfc9e0c40 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.634+0000 7ff763f0a740 1 --2- 172.21.15.19:0/3598887102 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfc9d6d70 0x55ccfc9d97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.634+0000 7ff763f0a740 1 -- 172.21.15.19:0/3598887102 >> 172.21.15.19:0/3598887102 conn(0x55ccfc9d3300 msgr2=0x55ccfc9e0530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:25.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.634+0000 7ff763f0a740 1 -- 172.21.15.19:0/3598887102 shutdown_connections 2024-09-19T09:03:25.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.634+0000 7ff763f0a740 1 -- 172.21.15.19:0/3598887102 wait complete. 2024-09-19T09:03:25.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.635+0000 7ff763f0a740 1 -- start start 2024-09-19T09:03:25.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.635+0000 7ff763f0a740 1 Processor -- start 2024-09-19T09:03:25.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.635+0000 7ff763f0a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccfc9d6d70 0x55ccfc9ea640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:25.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.635+0000 7ff763f0a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfc9d7690 0x55ccfc9dbb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:25.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.635+0000 7ff763f0a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfc9e1f50 0x55ccfc9dc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:25.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.635+0000 7ff763f0a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff75c1ac6f0 con 0x55ccfc9e1f50 2024-09-19T09:03:25.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.635+0000 7ff763f0a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff75c1ac020 con 0x55ccfc9d6d70 2024-09-19T09:03:25.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.635+0000 7ff763f0a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff75c1a9280 con 0x55ccfc9d7690 2024-09-19T09:03:25.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.635+0000 7ff763f0a740 10 client.0 _ll_register_callbacks cb 0x7ff754046070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:25.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.635+0000 7ff75bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfc9e1f50 0x55ccfc9dc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:25.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.635+0000 7ff75bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfc9e1f50 0x55ccfc9dc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42052/0 (socket says 172.21.15.19:42052) 2024-09-19T09:03:25.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.635+0000 7ff75bfff640 1 -- 172.21.15.19:0/1442647088 learned_addr learned my addr 172.21.15.19:0/1442647088 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:25.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.635+0000 7ff75b7fe640 1 --2- 172.21.15.19:0/1442647088 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccfc9d6d70 0x55ccfc9ea640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:25.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.635+0000 7ff75affd640 1 --2- 172.21.15.19:0/1442647088 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfc9d7690 0x55ccfc9dbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:25.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.635+0000 7ff75bfff640 1 -- 172.21.15.19:0/1442647088 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfc9d7690 msgr2=0x55ccfc9dbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:25.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.635+0000 7ff75bfff640 1 --2- 172.21.15.19:0/1442647088 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfc9d7690 0x55ccfc9dbb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.635+0000 7ff75bfff640 1 -- 172.21.15.19:0/1442647088 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccfc9d6d70 msgr2=0x55ccfc9ea640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:25.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.635+0000 7ff75bfff640 1 --2- 172.21.15.19:0/1442647088 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccfc9d6d70 0x55ccfc9ea640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.636+0000 7ff75bfff640 1 -- 172.21.15.19:0/1442647088 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ccfc9dc8d0 con 0x55ccfc9e1f50 2024-09-19T09:03:25.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.636+0000 7ff75b7fe640 1 --2- 172.21.15.19:0/1442647088 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccfc9d6d70 0x55ccfc9ea640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:25.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.636+0000 7ff75bfff640 1 --2- 172.21.15.19:0/1442647088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfc9e1f50 0x55ccfc9dc0a0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7ff754009ca0 tx=0x7ff75402f720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4e1fd7a0e0c0db5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:25.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.636+0000 7ff73affd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:25.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.636+0000 7ff73affd640 1 -- 172.21.15.19:0/1442647088 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff754048040 con 0x55ccfc9e1f50 2024-09-19T09:03:25.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.636+0000 7ff73affd640 1 -- 172.21.15.19:0/1442647088 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7ff754003c90 con 0x55ccfc9e1f50 2024-09-19T09:03:25.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.636+0000 7ff763f0a740 1 -- 172.21.15.19:0/1442647088 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff7500a4870 con 0x55ccfc9e1f50 2024-09-19T09:03:25.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.636+0000 7ff73affd640 1 -- 172.21.15.19:0/1442647088 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7ff75402fe90 con 0x55ccfc9e1f50 2024-09-19T09:03:25.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.636+0000 7ff763f0a740 10 client.18099 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:25.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.636+0000 7ff763f0a740 1 -- 172.21.15.19:0/1442647088 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55ccfca5c390 con 0x55ccfc9e1f50 2024-09-19T09:03:25.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.636+0000 7ff73affd640 1 -- 172.21.15.19:0/1442647088 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff7500a4870 con 0x55ccfc9e1f50 2024-09-19T09:03:25.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.636+0000 7ff73affd640 1 -- 172.21.15.19:0/1442647088 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7ff754030440 con 0x55ccfc9e1f50 2024-09-19T09:03:25.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.636+0000 7ff763f0a740 10 client.18099 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:25.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.637+0000 7ff763f0a740 10 client.18099 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:25.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.637+0000 7ff763f0a740 20 client.18099 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:25.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.637+0000 7ff763f0a740 1 --2- 172.21.15.19:0/1442647088 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ccfca5ca50 0x55ccfca5ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:25.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.637+0000 7ff763f0a740 4 client.18099 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:03:25.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.637+0000 7ff763f0a740 1 -- 172.21.15.19:0/1442647088 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ccfc941d00 con 0x55ccfca5ca50 2024-09-19T09:03:25.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.637+0000 7ff75b7fe640 1 --2- 172.21.15.19:0/1442647088 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ccfca5ca50 0x55ccfca5ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:25.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.637+0000 7ff73affd640 10 client.18099 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:25.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.637+0000 7ff75b7fe640 1 --2- 172.21.15.19:0/1442647088 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ccfca5ca50 0x55ccfca5ee40 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc92ac0630702e10 server_cookie=a68668a36a68a1c4 in_seq=0 out_seq=0 2024-09-19T09:03:25.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.638+0000 7ff73affd640 1 -- 172.21.15.19:0/1442647088 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ccfc941d00 con 0x55ccfca5ca50 2024-09-19T09:03:25.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.638+0000 7ff73affd640 10 client.18099 handle_command_reply: tid=0 2024-09-19T09:03:25.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.638+0000 7ff763f0a740 1 client.18099 shutdown 2024-09-19T09:03:25.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.638+0000 7ff763f0a740 1 -- 172.21.15.19:0/1442647088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfc9e1f50 msgr2=0x55ccfc9dc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:25.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.638+0000 7ff763f0a740 1 --2- 172.21.15.19:0/1442647088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfc9e1f50 0x55ccfc9dc0a0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7ff754009ca0 tx=0x7ff75402f720 comp rx=0 tx=0).stop 2024-09-19T09:03:25.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.639+0000 7ff763f0a740 1 -- 172.21.15.19:0/1442647088 shutdown_connections 2024-09-19T09:03:25.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.639+0000 7ff763f0a740 1 --2- 172.21.15.19:0/1442647088 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ccfca5ca50 0x55ccfca5ee40 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.639+0000 7ff763f0a740 1 --2- 172.21.15.19:0/1442647088 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ccfc9d7690 0x55ccfc9dbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.639+0000 7ff763f0a740 1 --2- 172.21.15.19:0/1442647088 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ccfc9e1f50 0x55ccfc9dc0a0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.639+0000 7ff73affd640 0 client.18099 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:25.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.639+0000 7ff763f0a740 1 --2- 172.21.15.19:0/1442647088 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ccfc9d6d70 0x55ccfc9ea640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.639+0000 7ff763f0a740 1 -- 172.21.15.19:0/1442647088 >> 172.21.15.19:0/1442647088 conn(0x55ccfc9d3300 msgr2=0x55ccfc9ddda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:25.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.639+0000 7ff763f0a740 1 -- 172.21.15.19:0/1442647088 shutdown_connections 2024-09-19T09:03:25.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.639+0000 7ff763f0a740 1 -- 172.21.15.19:0/1442647088 wait complete. 2024-09-19T09:03:25.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.639+0000 7ff763f0a740 20 client.18099 trim_cache size 0 max 16384 2024-09-19T09:03:25.652 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T09:03:25.652 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-19T09:03:25.652 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "df54833b-ec45-4e2e-9867-c7af7f2b35e2", 2024-09-19T09:03:25.652 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-19T09:03:25.652 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T09:03:25.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.639+0000 7ff761b31640 1 -- 172.21.15.19:0/2647609919 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff7440a3240 msgr2=0x7ff7440a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:25.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.639+0000 7ff761b31640 1 --2- 172.21.15.19:0/2647609919 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff7440a3240 0x7ff7440a5700 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff74c009990 tx=0x7ff74c009110 comp rx=0 tx=0).stop 2024-09-19T09:03:25.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.639+0000 7ff761b31640 1 -- 172.21.15.19:0/2647609919 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff75c102570 msgr2=0x7ff75c197980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:25.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.639+0000 7ff761b31640 1 --2- 172.21.15.19:0/2647609919 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff75c102570 0x7ff75c197980 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7ff75000c970 tx=0x7ff75000cd70 comp rx=0 tx=0).stop 2024-09-19T09:03:25.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.640+0000 7ff761b31640 1 -- 172.21.15.19:0/2647609919 shutdown_connections 2024-09-19T09:03:25.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.640+0000 7ff761b31640 1 --2- 172.21.15.19:0/2647609919 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff7440a3240 0x7ff7440a5700 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.640+0000 7ff761b31640 1 --2- 172.21.15.19:0/2647609919 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff75c102ef0 0x7ff75c19bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.640+0000 7ff761b31640 1 --2- 172.21.15.19:0/2647609919 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff75c102570 0x7ff75c197980 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.640+0000 7ff761b31640 1 --2- 172.21.15.19:0/2647609919 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff75c100e20 0x7ff75c197440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:25.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.640+0000 7ff761b31640 1 -- 172.21.15.19:0/2647609919 >> 172.21.15.19:0/2647609919 conn(0x7ff75c0fc7d0 msgr2=0x7ff75c106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:25.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.640+0000 7ff761b31640 1 -- 172.21.15.19:0/2647609919 shutdown_connections 2024-09-19T09:03:25.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:25.640+0000 7ff761b31640 1 -- 172.21.15.19:0/2647609919 wait complete. 2024-09-19T09:03:26.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:25 smithi155 ceph-mon[34921]: pgmap v675: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.1 KiB/s wr, 17 op/s 2024-09-19T09:03:26.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:25 smithi203 ceph-mon[35450]: pgmap v675: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.1 KiB/s wr, 17 op/s 2024-09-19T09:03:26.261 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:25 smithi019 ceph-mon[30976]: pgmap v675: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 3.1 KiB/s wr, 17 op/s 2024-09-19T09:03:26.434 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:03:26.494 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:26.910 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:26 smithi019 ceph-mon[30976]: scrub queued for path: / 2024-09-19T09:03:26.910 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:26 smithi019 ceph-mon[30976]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:26.910 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:26 smithi019 ceph-mon[30976]: scrub summary: active paths [/] 2024-09-19T09:03:26.910 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:26 smithi019 ceph-mon[30976]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:27.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.000+0000 7fb86722d640 1 -- 172.21.15.19:0/1111309894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb860102790 msgr2=0x7fb8601067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:27.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.000+0000 7fb86722d640 1 --2- 172.21.15.19:0/1111309894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb860102790 0x7fb8601067e0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fb854009900 tx=0x7fb85402a410 comp rx=0 tx=0).stop 2024-09-19T09:03:27.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.000+0000 7fb86722d640 1 -- 172.21.15.19:0/1111309894 shutdown_connections 2024-09-19T09:03:27.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.000+0000 7fb86722d640 1 --2- 172.21.15.19:0/1111309894 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb860106f10 0x7fb86010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.000+0000 7fb86722d640 1 --2- 172.21.15.19:0/1111309894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb860102790 0x7fb8601067e0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.000+0000 7fb86722d640 1 --2- 172.21.15.19:0/1111309894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb860101de0 0x7fb8601021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.000+0000 7fb86722d640 1 -- 172.21.15.19:0/1111309894 >> 172.21.15.19:0/1111309894 conn(0x7fb8600fd8c0 msgr2=0x7fb8600ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:27.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.001+0000 7fb86722d640 1 -- 172.21.15.19:0/1111309894 shutdown_connections 2024-09-19T09:03:27.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.001+0000 7fb86722d640 1 -- 172.21.15.19:0/1111309894 wait complete. 2024-09-19T09:03:27.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.001+0000 7fb86722d640 1 Processor -- start 2024-09-19T09:03:27.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.001+0000 7fb86722d640 1 -- start start 2024-09-19T09:03:27.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.001+0000 7fb86722d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb860101de0 0x7fb860198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:27.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.001+0000 7fb86722d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb860102790 0x7fb860198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:27.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.001+0000 7fb86722d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb860106f10 0x7fb86019ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:27.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.001+0000 7fb86722d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb860112010 con 0x7fb860106f10 2024-09-19T09:03:27.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.001+0000 7fb86722d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb860111e90 con 0x7fb860102790 2024-09-19T09:03:27.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.001+0000 7fb86722d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb860112190 con 0x7fb860101de0 2024-09-19T09:03:27.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.001+0000 7fb8657ca640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb860106f10 0x7fb86019ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:27.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.002+0000 7fb8657ca640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb860106f10 0x7fb86019ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42056/0 (socket says 172.21.15.19:42056) 2024-09-19T09:03:27.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.002+0000 7fb8657ca640 1 -- 172.21.15.19:0/4205513873 learned_addr learned my addr 172.21.15.19:0/4205513873 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:27.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.002+0000 7fb864fc9640 1 --2- 172.21.15.19:0/4205513873 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb860101de0 0x7fb860198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:27.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.002+0000 7fb85ffff640 1 --2- 172.21.15.19:0/4205513873 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb860102790 0x7fb860198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:27.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.002+0000 7fb8657ca640 1 -- 172.21.15.19:0/4205513873 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb860101de0 msgr2=0x7fb860198590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:27.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.002+0000 7fb8657ca640 1 --2- 172.21.15.19:0/4205513873 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb860101de0 0x7fb860198590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.002+0000 7fb8657ca640 1 -- 172.21.15.19:0/4205513873 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb860102790 msgr2=0x7fb860198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:27.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.002+0000 7fb8657ca640 1 --2- 172.21.15.19:0/4205513873 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb860102790 0x7fb860198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.002+0000 7fb8657ca640 1 -- 172.21.15.19:0/4205513873 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb86019d540 con 0x7fb860106f10 2024-09-19T09:03:27.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.002+0000 7fb85ffff640 1 --2- 172.21.15.19:0/4205513873 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb860102790 0x7fb860198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:27.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.002+0000 7fb8657ca640 1 --2- 172.21.15.19:0/4205513873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb860106f10 0x7fb86019ce60 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fb85800b970 tx=0x7fb85800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:27.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.002+0000 7fb85dffb640 1 -- 172.21.15.19:0/4205513873 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb858019070 con 0x7fb860106f10 2024-09-19T09:03:27.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.002+0000 7fb85dffb640 1 -- 172.21.15.19:0/4205513873 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb858014440 con 0x7fb860106f10 2024-09-19T09:03:27.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.002+0000 7fb86722d640 1 -- 172.21.15.19:0/4205513873 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb86019d830 con 0x7fb860106f10 2024-09-19T09:03:27.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.002+0000 7fb85dffb640 1 -- 172.21.15.19:0/4205513873 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8580075d0 con 0x7fb860106f10 2024-09-19T09:03:27.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.003+0000 7fb86722d640 1 -- 172.21.15.19:0/4205513873 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8601a5110 con 0x7fb860106f10 2024-09-19T09:03:27.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.005+0000 7fb85dffb640 1 -- 172.21.15.19:0/4205513873 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fb85801c070 con 0x7fb860106f10 2024-09-19T09:03:27.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.005+0000 7fb869606740 1 Processor -- start 2024-09-19T09:03:27.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.005+0000 7fb869606740 1 -- start start 2024-09-19T09:03:27.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.005+0000 7fb85dffb640 1 --2- 172.21.15.19:0/4205513873 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb8480a3240 0x7fb8480a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:27.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.005+0000 7fb869606740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d235dbf20 0x555d235dc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:27.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.005+0000 7fb869606740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d235dc840 0x555d235eb110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:27.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.005+0000 7fb869606740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555d235eb650 0x555d235eda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:27.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.005+0000 7fb869606740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x555d23541620 con 0x555d235dc840 2024-09-19T09:03:27.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.005+0000 7fb869606740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x555d234e8e50 con 0x555d235eb650 2024-09-19T09:03:27.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.005+0000 7fb869606740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x555d2353d5e0 con 0x555d235dbf20 2024-09-19T09:03:27.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.005+0000 7fb85ffff640 1 --2- 172.21.15.19:0/4205513873 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb8480a3240 0x7fb8480a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:27.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.005+0000 7fb85ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d235dc840 0x555d235eb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:27.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.006+0000 7fb85dffb640 1 -- 172.21.15.19:0/4205513873 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7fb8580ceef0 con 0x7fb860106f10 2024-09-19T09:03:27.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.006+0000 7fb85ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d235dc840 0x555d235eb110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42064/0 (socket says 172.21.15.19:42064) 2024-09-19T09:03:27.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.006+0000 7fb85ffff640 1 -- 172.21.15.19:0/4053061944 learned_addr learned my addr 172.21.15.19:0/4053061944 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:27.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.006+0000 7fb864fc9640 1 --2- 172.21.15.19:0/4053061944 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d235dbf20 0x555d235dc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:27.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.006+0000 7fb8657ca640 1 --2- 172.21.15.19:0/4053061944 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555d235eb650 0x555d235eda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:27.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.006+0000 7fb864fc9640 1 -- 172.21.15.19:0/4053061944 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555d235eb650 msgr2=0x555d235eda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:27.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.006+0000 7fb864fc9640 1 --2- 172.21.15.19:0/4053061944 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555d235eb650 0x555d235eda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.006+0000 7fb864fc9640 1 -- 172.21.15.19:0/4053061944 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d235dc840 msgr2=0x555d235eb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:27.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.006+0000 7fb864fc9640 1 --2- 172.21.15.19:0/4053061944 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d235dc840 0x555d235eb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.006+0000 7fb864fc9640 1 -- 172.21.15.19:0/4053061944 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d234d9d40 con 0x555d235dbf20 2024-09-19T09:03:27.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.006+0000 7fb85ffff640 1 --2- 172.21.15.19:0/4205513873 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb8480a3240 0x7fb8480a5700 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb8540096c0 tx=0x7fb8540314b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:27.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.006+0000 7fb864fc9640 1 --2- 172.21.15.19:0/4053061944 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d235dbf20 0x555d235dc300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb8500099a0 tx=0x7fb850009e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d3ee260a2067949 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:27.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.006+0000 7fb846ffd640 1 -- 172.21.15.19:0/4053061944 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb850017070 con 0x555d235dbf20 2024-09-19T09:03:27.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.007+0000 7fb846ffd640 1 -- 172.21.15.19:0/4053061944 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb850013470 con 0x555d235dbf20 2024-09-19T09:03:27.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.007+0000 7fb846ffd640 1 -- 172.21.15.19:0/4053061944 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb850012610 con 0x555d235dbf20 2024-09-19T09:03:27.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.007+0000 7fb869606740 1 -- 172.21.15.19:0/4053061944 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d235dbf20 msgr2=0x555d235dc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:27.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.007+0000 7fb869606740 1 --2- 172.21.15.19:0/4053061944 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d235dbf20 0x555d235dc300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb8500099a0 tx=0x7fb850009e60 comp rx=0 tx=0).stop 2024-09-19T09:03:27.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.007+0000 7fb869606740 1 -- 172.21.15.19:0/4053061944 shutdown_connections 2024-09-19T09:03:27.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.007+0000 7fb869606740 1 --2- 172.21.15.19:0/4053061944 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555d235eb650 0x555d235eda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.007+0000 7fb869606740 1 --2- 172.21.15.19:0/4053061944 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d235dc840 0x555d235eb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.007+0000 7fb869606740 1 --2- 172.21.15.19:0/4053061944 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d235dbf20 0x555d235dc300 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.007+0000 7fb869606740 1 -- 172.21.15.19:0/4053061944 >> 172.21.15.19:0/4053061944 conn(0x555d235d85f0 msgr2=0x555d235d89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:27.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.007+0000 7fb869606740 1 -- 172.21.15.19:0/4053061944 shutdown_connections 2024-09-19T09:03:27.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.007+0000 7fb869606740 1 -- 172.21.15.19:0/4053061944 wait complete. 2024-09-19T09:03:27.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.008+0000 7fb869606740 1 -- start start 2024-09-19T09:03:27.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.008+0000 7fb869606740 1 Processor -- start 2024-09-19T09:03:27.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.008+0000 7fb869606740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d235dbf20 0x555d235e8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:27.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.008+0000 7fb869606740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d235dc840 0x555d235e8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:27.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.008+0000 7fb869606740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555d235eb650 0x555d235e8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:27.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.008+0000 7fb869606740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x555d235ee220 con 0x555d235dbf20 2024-09-19T09:03:27.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.008+0000 7fb869606740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x555d234c9f10 con 0x555d235eb650 2024-09-19T09:03:27.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.008+0000 7fb869606740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x555d235ee3a0 con 0x555d235dc840 2024-09-19T09:03:27.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.008+0000 7fb869606740 10 client.0 _ll_register_callbacks cb 0x555d234eddb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:27.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.008+0000 7fb864fc9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d235dbf20 0x555d235e8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:27.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.009+0000 7fb864fc9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d235dbf20 0x555d235e8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42070/0 (socket says 172.21.15.19:42070) 2024-09-19T09:03:27.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.009+0000 7fb864fc9640 1 -- 172.21.15.19:0/225134676 learned_addr learned my addr 172.21.15.19:0/225134676 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:27.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.009+0000 7fb85ffff640 1 --2- 172.21.15.19:0/225134676 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d235dc840 0x555d235e8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:27.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.009+0000 7fb8657ca640 1 --2- 172.21.15.19:0/225134676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555d235eb650 0x555d235e8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:27.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.009+0000 7fb864fc9640 1 -- 172.21.15.19:0/225134676 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d235dc840 msgr2=0x555d235e8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:27.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.009+0000 7fb864fc9640 1 --2- 172.21.15.19:0/225134676 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d235dc840 0x555d235e8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.009+0000 7fb864fc9640 1 -- 172.21.15.19:0/225134676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555d235eb650 msgr2=0x555d235e8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:27.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.009+0000 7fb864fc9640 1 --2- 172.21.15.19:0/225134676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555d235eb650 0x555d235e8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.009+0000 7fb864fc9640 1 -- 172.21.15.19:0/225134676 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d23250580 con 0x555d235dbf20 2024-09-19T09:03:27.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.009+0000 7fb85ffff640 1 --2- 172.21.15.19:0/225134676 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d235dc840 0x555d235e8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:27.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.009+0000 7fb864fc9640 1 --2- 172.21.15.19:0/225134676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d235dbf20 0x555d235e8500 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fb850006e70 tx=0x7fb850006ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca5eb2c2f502c97 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:27.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.009+0000 7fb83ffff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:27.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.009+0000 7fb83ffff640 1 -- 172.21.15.19:0/225134676 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb850017050 con 0x555d235dbf20 2024-09-19T09:03:27.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.009+0000 7fb83ffff640 1 -- 172.21.15.19:0/225134676 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7fb85001c450 con 0x555d235dbf20 2024-09-19T09:03:27.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.009+0000 7fb869606740 1 -- 172.21.15.19:0/225134676 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb850013470 con 0x555d235dbf20 2024-09-19T09:03:27.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.009+0000 7fb83ffff640 1 -- 172.21.15.19:0/225134676 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fb85001c650 con 0x555d235dbf20 2024-09-19T09:03:27.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.009+0000 7fb869606740 10 client.18111 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:27.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.009+0000 7fb869606740 1 -- 172.21.15.19:0/225134676 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x555d2331a960 con 0x555d235dbf20 2024-09-19T09:03:27.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.010+0000 7fb83ffff640 1 -- 172.21.15.19:0/225134676 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb850013470 con 0x555d235dbf20 2024-09-19T09:03:27.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.010+0000 7fb83ffff640 1 -- 172.21.15.19:0/225134676 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7fb850026810 con 0x555d235dbf20 2024-09-19T09:03:27.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.010+0000 7fb869606740 10 client.18111 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:27.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.010+0000 7fb869606740 10 client.18111 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:03:27.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.010+0000 7fb869606740 20 client.18111 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:27.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.010+0000 7fb869606740 1 --2- 172.21.15.19:0/225134676 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x555d235fb110 0x555d235fd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:27.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.010+0000 7fb869606740 4 client.18111 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:27.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.010+0000 7fb869606740 1 -- 172.21.15.19:0/225134676 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d2354eb90 con 0x555d235fb110 2024-09-19T09:03:27.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.010+0000 7fb85ffff640 1 --2- 172.21.15.19:0/225134676 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x555d235fb110 0x555d235fd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:27.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.011+0000 7fb85ffff640 1 --2- 172.21.15.19:0/225134676 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x555d235fb110 0x555d235fd500 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba66ca44fb3a9356 server_cookie=13cf8381ea47df8d in_seq=0 out_seq=0 2024-09-19T09:03:27.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.011+0000 7fb83ffff640 10 client.18111 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:27.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.011+0000 7fb83ffff640 1 -- 172.21.15.19:0/225134676 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555d2354eb90 con 0x555d235fb110 2024-09-19T09:03:27.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.011+0000 7fb83ffff640 10 client.18111 handle_command_reply: tid=0 2024-09-19T09:03:27.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.011+0000 7fb869606740 1 client.18111 shutdown 2024-09-19T09:03:27.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.011+0000 7fb869606740 1 -- 172.21.15.19:0/225134676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d235dbf20 msgr2=0x555d235e8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:27.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.011+0000 7fb869606740 1 --2- 172.21.15.19:0/225134676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d235dbf20 0x555d235e8500 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fb850006e70 tx=0x7fb850006ea0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.011+0000 7fb869606740 1 -- 172.21.15.19:0/225134676 shutdown_connections 2024-09-19T09:03:27.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.011+0000 7fb869606740 1 --2- 172.21.15.19:0/225134676 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x555d235fb110 0x555d235fd500 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.011+0000 7fb869606740 1 --2- 172.21.15.19:0/225134676 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d235dc840 0x555d235e8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.011+0000 7fb869606740 1 --2- 172.21.15.19:0/225134676 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555d235eb650 0x555d235e8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.011+0000 7fb869606740 1 --2- 172.21.15.19:0/225134676 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d235dbf20 0x555d235e8500 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.011+0000 7fb869606740 1 -- 172.21.15.19:0/225134676 >> 172.21.15.19:0/225134676 conn(0x555d235d85f0 msgr2=0x555d235d7750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:27.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.012+0000 7fb83ffff640 0 client.18111 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:27.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.012+0000 7fb869606740 1 -- 172.21.15.19:0/225134676 shutdown_connections 2024-09-19T09:03:27.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.012+0000 7fb869606740 1 -- 172.21.15.19:0/225134676 wait complete. 2024-09-19T09:03:27.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.012+0000 7fb869606740 20 client.18111 trim_cache size 0 max 16384 2024-09-19T09:03:27.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.029+0000 7fb869606740 1 Processor -- start 2024-09-19T09:03:27.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.029+0000 7fb869606740 1 -- start start 2024-09-19T09:03:27.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.029+0000 7fb869606740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d235dbf20 0x555d235d7640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:27.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.029+0000 7fb869606740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d235dc840 0x555d23602bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:27.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.029+0000 7fb869606740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555d235eb650 0x555d23603100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:27.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.029+0000 7fb869606740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb8601ab4d0 con 0x555d235dbf20 2024-09-19T09:03:27.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.029+0000 7fb869606740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb8601ad010 con 0x555d235eb650 2024-09-19T09:03:27.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.029+0000 7fb869606740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb8601abba0 con 0x555d235dc840 2024-09-19T09:03:27.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.030+0000 7fb864fc9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d235dbf20 0x555d235d7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:27.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.030+0000 7fb864fc9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d235dbf20 0x555d235d7640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42080/0 (socket says 172.21.15.19:42080) 2024-09-19T09:03:27.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.030+0000 7fb864fc9640 1 -- 172.21.15.19:0/3426968404 learned_addr learned my addr 172.21.15.19:0/3426968404 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:27.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.030+0000 7fb85ffff640 1 --2- 172.21.15.19:0/3426968404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d235dc840 0x555d23602bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:27.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.030+0000 7fb8657ca640 1 --2- 172.21.15.19:0/3426968404 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555d235eb650 0x555d23603100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:27.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.030+0000 7fb864fc9640 1 -- 172.21.15.19:0/3426968404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d235dc840 msgr2=0x555d23602bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:27.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.030+0000 7fb864fc9640 1 --2- 172.21.15.19:0/3426968404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d235dc840 0x555d23602bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.030+0000 7fb864fc9640 1 -- 172.21.15.19:0/3426968404 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555d235eb650 msgr2=0x555d23603100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:27.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.030+0000 7fb864fc9640 1 --2- 172.21.15.19:0/3426968404 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555d235eb650 0x555d23603100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.030+0000 7fb864fc9640 1 -- 172.21.15.19:0/3426968404 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d235eae70 con 0x555d235dbf20 2024-09-19T09:03:27.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.030+0000 7fb864fc9640 1 --2- 172.21.15.19:0/3426968404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d235dbf20 0x555d235d7640 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fb8500046b0 tx=0x7fb850013f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d3eec0c472dd7a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:27.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.030+0000 7fb8467fc640 1 -- 172.21.15.19:0/3426968404 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb850017030 con 0x555d235dbf20 2024-09-19T09:03:27.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.030+0000 7fb8467fc640 1 -- 172.21.15.19:0/3426968404 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb850035070 con 0x555d235dbf20 2024-09-19T09:03:27.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.030+0000 7fb8467fc640 1 -- 172.21.15.19:0/3426968404 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb850013a90 con 0x555d235dbf20 2024-09-19T09:03:27.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.031+0000 7fb869606740 1 -- 172.21.15.19:0/3426968404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d235dbf20 msgr2=0x555d235d7640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:27.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.031+0000 7fb869606740 1 --2- 172.21.15.19:0/3426968404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d235dbf20 0x555d235d7640 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7fb8500046b0 tx=0x7fb850013f90 comp rx=0 tx=0).stop 2024-09-19T09:03:27.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.031+0000 7fb869606740 1 -- 172.21.15.19:0/3426968404 shutdown_connections 2024-09-19T09:03:27.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.031+0000 7fb869606740 1 --2- 172.21.15.19:0/3426968404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d235dc840 0x555d23602bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.031+0000 7fb869606740 1 --2- 172.21.15.19:0/3426968404 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555d235eb650 0x555d23603100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.031+0000 7fb869606740 1 --2- 172.21.15.19:0/3426968404 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d235dbf20 0x555d235d7640 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.031+0000 7fb869606740 1 -- 172.21.15.19:0/3426968404 >> 172.21.15.19:0/3426968404 conn(0x555d235d85f0 msgr2=0x555d235d6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:27.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.031+0000 7fb869606740 1 -- 172.21.15.19:0/3426968404 shutdown_connections 2024-09-19T09:03:27.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.031+0000 7fb869606740 1 -- 172.21.15.19:0/3426968404 wait complete. 2024-09-19T09:03:27.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.032+0000 7fb869606740 1 -- start start 2024-09-19T09:03:27.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.032+0000 7fb869606740 1 Processor -- start 2024-09-19T09:03:27.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.032+0000 7fb869606740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d235dbf20 0x555d235ef570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:27.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.032+0000 7fb869606740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555d235dc840 0x555d235efab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:27.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.032+0000 7fb869606740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d235eb650 0x555d235efff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:27.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.032+0000 7fb869606740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb8601ac940 con 0x555d235eb650 2024-09-19T09:03:27.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.032+0000 7fb869606740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb8601ac270 con 0x555d235dc840 2024-09-19T09:03:27.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.032+0000 7fb869606740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb8601a94d0 con 0x555d235dbf20 2024-09-19T09:03:27.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.032+0000 7fb869606740 10 client.0 _ll_register_callbacks cb 0x7fb850009f90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:27.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.032+0000 7fb8657ca640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d235eb650 0x555d235efff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:27.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.032+0000 7fb8657ca640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d235eb650 0x555d235efff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42096/0 (socket says 172.21.15.19:42096) 2024-09-19T09:03:27.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.032+0000 7fb8657ca640 1 -- 172.21.15.19:0/1074956388 learned_addr learned my addr 172.21.15.19:0/1074956388 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:27.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.032+0000 7fb85ffff640 1 --2- 172.21.15.19:0/1074956388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555d235dc840 0x555d235efab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:27.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.033+0000 7fb864fc9640 1 --2- 172.21.15.19:0/1074956388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d235dbf20 0x555d235ef570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:27.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.033+0000 7fb8657ca640 1 -- 172.21.15.19:0/1074956388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d235dbf20 msgr2=0x555d235ef570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:27.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.033+0000 7fb8657ca640 1 --2- 172.21.15.19:0/1074956388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d235dbf20 0x555d235ef570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.033+0000 7fb8657ca640 1 -- 172.21.15.19:0/1074956388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555d235dc840 msgr2=0x555d235efab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:27.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.033+0000 7fb8657ca640 1 --2- 172.21.15.19:0/1074956388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555d235dc840 0x555d235efab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.033+0000 7fb8657ca640 1 -- 172.21.15.19:0/1074956388 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d23664d30 con 0x555d235eb650 2024-09-19T09:03:27.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.033+0000 7fb8657ca640 1 --2- 172.21.15.19:0/1074956388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d235eb650 0x555d235efff0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fb858097ef0 tx=0x7fb85809bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1ecc6ac181f3c02 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:27.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.033+0000 7fb83ffff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:27.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.033+0000 7fb83ffff640 1 -- 172.21.15.19:0/1074956388 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8580b4060 con 0x555d235eb650 2024-09-19T09:03:27.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.033+0000 7fb83ffff640 1 -- 172.21.15.19:0/1074956388 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7fb8580149a0 con 0x555d235eb650 2024-09-19T09:03:27.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.033+0000 7fb869606740 1 -- 172.21.15.19:0/1074956388 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb850035070 con 0x555d235eb650 2024-09-19T09:03:27.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.033+0000 7fb83ffff640 1 -- 172.21.15.19:0/1074956388 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fb85809b520 con 0x555d235eb650 2024-09-19T09:03:27.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.033+0000 7fb869606740 10 client.18117 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:27.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.033+0000 7fb869606740 1 -- 172.21.15.19:0/1074956388 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x555d236660b0 con 0x555d235eb650 2024-09-19T09:03:27.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.034+0000 7fb83ffff640 1 -- 172.21.15.19:0/1074956388 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb850035070 con 0x555d235eb650 2024-09-19T09:03:27.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.034+0000 7fb83ffff640 1 -- 172.21.15.19:0/1074956388 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7fb85804e820 con 0x555d235eb650 2024-09-19T09:03:27.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.034+0000 7fb869606740 10 client.18117 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:27.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.034+0000 7fb869606740 10 client.18117 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:03:27.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.034+0000 7fb869606740 20 client.18117 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:27.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.034+0000 7fb869606740 1 --2- 172.21.15.19:0/1074956388 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x555d236667d0 0x555d23668bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:27.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.034+0000 7fb869606740 4 client.18117 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "58095ad0", "release": true, "await": true}] 2024-09-19T09:03:27.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.034+0000 7fb869606740 1 -- 172.21.15.19:0/1074956388 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "quiesce db", "set_id": "58095ad0", "release": true, "await": true}) -- 0x555d235490a0 con 0x555d236667d0 2024-09-19T09:03:27.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.034+0000 7fb864fc9640 1 --2- 172.21.15.19:0/1074956388 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x555d236667d0 0x555d23668bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:27.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.035+0000 7fb864fc9640 1 --2- 172.21.15.19:0/1074956388 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x555d236667d0 0x555d23668bf0 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=359a5c3ffbd424c8 server_cookie=3883b7ad3d119dec in_seq=0 out_seq=0 2024-09-19T09:03:27.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.035+0000 7fb83ffff640 10 client.18117 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:27.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.037+0000 7fb83ffff640 1 -- 172.21.15.19:0/1074956388 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x555d235490a0 con 0x555d236667d0 2024-09-19T09:03:27.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.037+0000 7fb83ffff640 10 client.18117 handle_command_reply: tid=0 2024-09-19T09:03:27.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.037+0000 7fb869606740 1 client.18117 shutdown 2024-09-19T09:03:27.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.038+0000 7fb869606740 1 -- 172.21.15.19:0/1074956388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d235eb650 msgr2=0x555d235efff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:27.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.038+0000 7fb869606740 1 --2- 172.21.15.19:0/1074956388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d235eb650 0x555d235efff0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fb858097ef0 tx=0x7fb85809bc20 comp rx=0 tx=0).stop 2024-09-19T09:03:27.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.038+0000 7fb869606740 1 -- 172.21.15.19:0/1074956388 shutdown_connections 2024-09-19T09:03:27.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.038+0000 7fb869606740 1 --2- 172.21.15.19:0/1074956388 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x555d236667d0 0x555d23668bf0 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.038+0000 7fb869606740 1 --2- 172.21.15.19:0/1074956388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x555d235eb650 0x555d235efff0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.038+0000 7fb869606740 1 --2- 172.21.15.19:0/1074956388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x555d235dc840 0x555d235efab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.038+0000 7fb83ffff640 0 client.18117 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:27.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.038+0000 7fb869606740 1 --2- 172.21.15.19:0/1074956388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d235dbf20 0x555d235ef570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.038+0000 7fb869606740 1 -- 172.21.15.19:0/1074956388 >> 172.21.15.19:0/1074956388 conn(0x555d235d85f0 msgr2=0x555d235e8ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:27.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.038+0000 7fb869606740 1 -- 172.21.15.19:0/1074956388 shutdown_connections 2024-09-19T09:03:27.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.038+0000 7fb869606740 1 -- 172.21.15.19:0/1074956388 wait complete. 2024-09-19T09:03:27.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.038+0000 7fb869606740 20 client.18117 trim_cache size 0 max 16384 2024-09-19T09:03:27.044 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T09:03:27.044 INFO:teuthology.orchestra.run.smithi019.stdout: "epoch": 39, 2024-09-19T09:03:27.044 INFO:teuthology.orchestra.run.smithi019.stdout: "leader": 24497, 2024-09-19T09:03:27.044 INFO:teuthology.orchestra.run.smithi019.stdout: "set_version": 36, 2024-09-19T09:03:27.044 INFO:teuthology.orchestra.run.smithi019.stdout: "sets": { 2024-09-19T09:03:27.044 INFO:teuthology.orchestra.run.smithi019.stdout: "58095ad0": { 2024-09-19T09:03:27.044 INFO:teuthology.orchestra.run.smithi019.stdout: "version": 36, 2024-09-19T09:03:27.044 INFO:teuthology.orchestra.run.smithi019.stdout: "age_ref": 0.0, 2024-09-19T09:03:27.044 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T09:03:27.044 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RELEASED", 2024-09-19T09:03:27.045 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T09:03:27.045 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:03:27.045 INFO:teuthology.orchestra.run.smithi019.stdout: "timeout": 90.0, 2024-09-19T09:03:27.045 INFO:teuthology.orchestra.run.smithi019.stdout: "expiration": 150.0, 2024-09-19T09:03:27.045 INFO:teuthology.orchestra.run.smithi019.stdout: "members": { 2024-09-19T09:03:27.045 INFO:teuthology.orchestra.run.smithi019.stdout: "file:/": { 2024-09-19T09:03:27.045 INFO:teuthology.orchestra.run.smithi019.stdout: "excluded": false, 2024-09-19T09:03:27.045 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T09:03:27.045 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RELEASED", 2024-09-19T09:03:27.045 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T09:03:27.045 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:03:27.045 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:03:27.045 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:03:27.046 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:03:27.046 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:03:27.046 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T09:03:27.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.039+0000 7fb86722d640 1 -- 172.21.15.19:0/4205513873 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb8480a3240 msgr2=0x7fb8480a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:27.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.039+0000 7fb86722d640 1 --2- 172.21.15.19:0/4205513873 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb8480a3240 0x7fb8480a5700 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fb8540096c0 tx=0x7fb8540314b0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.039+0000 7fb86722d640 1 -- 172.21.15.19:0/4205513873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb860106f10 msgr2=0x7fb86019ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:27.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.039+0000 7fb86722d640 1 --2- 172.21.15.19:0/4205513873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb860106f10 0x7fb86019ce60 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fb85800b970 tx=0x7fb85800bd70 comp rx=0 tx=0).stop 2024-09-19T09:03:27.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.039+0000 7fb86722d640 1 -- 172.21.15.19:0/4205513873 shutdown_connections 2024-09-19T09:03:27.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.039+0000 7fb86722d640 1 --2- 172.21.15.19:0/4205513873 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb8480a3240 0x7fb8480a5700 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.039+0000 7fb86722d640 1 --2- 172.21.15.19:0/4205513873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb860106f10 0x7fb86019ce60 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.039+0000 7fb86722d640 1 --2- 172.21.15.19:0/4205513873 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb860102790 0x7fb860198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.039+0000 7fb86722d640 1 --2- 172.21.15.19:0/4205513873 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb860101de0 0x7fb860198590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:27.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.039+0000 7fb86722d640 1 -- 172.21.15.19:0/4205513873 >> 172.21.15.19:0/4205513873 conn(0x7fb8600fd8c0 msgr2=0x7fb8600fed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:27.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.039+0000 7fb86722d640 1 -- 172.21.15.19:0/4205513873 shutdown_connections 2024-09-19T09:03:27.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:27.039+0000 7fb86722d640 1 -- 172.21.15.19:0/4205513873 wait complete. 2024-09-19T09:03:27.058 INFO:tasks.workunit:Running workunit fs/misc/filelock_interrupt.py... 2024-09-19T09:03:27.059 DEBUG:teuthology.orchestra.run.smithi019:workunit test fs/misc/filelock_interrupt.py> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/filelock_interrupt.py 2024-09-19T09:03:27.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:26 smithi155 ceph-mon[34921]: scrub queued for path: / 2024-09-19T09:03:27.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:26 smithi155 ceph-mon[34921]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:27.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:26 smithi155 ceph-mon[34921]: scrub summary: active paths [/] 2024-09-19T09:03:27.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:26 smithi155 ceph-mon[34921]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:27.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:26 smithi203 ceph-mon[35450]: scrub queued for path: / 2024-09-19T09:03:27.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:26 smithi203 ceph-mon[35450]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:27.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:26 smithi203 ceph-mon[35450]: scrub summary: active paths [/] 2024-09-19T09:03:27.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:26 smithi203 ceph-mon[35450]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:27.793 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:27.800 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '58095ad0', total seconds elapsed: 34.5 2024-09-19T09:03:27.800 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 30.0 2024-09-19T09:03:27.801 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:03:28.059 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:27 smithi019 ceph-mon[30976]: pgmap v676: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.5 KiB/s wr, 16 op/s 2024-09-19T09:03:28.059 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:27 smithi019 ceph-mon[30976]: scrub summary: idle 2024-09-19T09:03:28.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:27 smithi155 ceph-mon[34921]: pgmap v676: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.5 KiB/s wr, 16 op/s 2024-09-19T09:03:28.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:27 smithi155 ceph-mon[34921]: scrub summary: idle 2024-09-19T09:03:28.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:27 smithi203 ceph-mon[35450]: pgmap v676: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.5 KiB/s wr, 16 op/s 2024-09-19T09:03:28.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:27 smithi203 ceph-mon[35450]: scrub summary: idle 2024-09-19T09:03:28.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.306+0000 7f4d24236640 1 -- 172.21.15.19:0/3144516149 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d1c108300 msgr2=0x7f4d1c10ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:28.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.306+0000 7f4d24236640 1 --2- 172.21.15.19:0/3144516149 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d1c108300 0x7f4d1c10ec70 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f4d14009cd0 tx=0x7f4d1402a8d0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.306+0000 7f4d24236640 1 -- 172.21.15.19:0/3144516149 shutdown_connections 2024-09-19T09:03:28.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.306+0000 7f4d24236640 1 --2- 172.21.15.19:0/3144516149 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d1c103780 0x7f4d1c107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.306+0000 7f4d24236640 1 --2- 172.21.15.19:0/3144516149 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d1c108300 0x7f4d1c10ec70 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.306+0000 7f4d24236640 1 --2- 172.21.15.19:0/3144516149 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d1c102dd0 0x7f4d1c1031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.306+0000 7f4d24236640 1 -- 172.21.15.19:0/3144516149 >> 172.21.15.19:0/3144516149 conn(0x7f4d1c0fc7d0 msgr2=0x7f4d1c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:28.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.306+0000 7f4d24236640 1 -- 172.21.15.19:0/3144516149 shutdown_connections 2024-09-19T09:03:28.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.306+0000 7f4d24236640 1 -- 172.21.15.19:0/3144516149 wait complete. 2024-09-19T09:03:28.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.307+0000 7f4d24236640 1 Processor -- start 2024-09-19T09:03:28.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.307+0000 7f4d24236640 1 -- start start 2024-09-19T09:03:28.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.307+0000 7f4d24236640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d1c102dd0 0x7f4d1c198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.307+0000 7f4d24236640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d1c103780 0x7f4d1c198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.307+0000 7f4d24236640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d1c108300 0x7f4d1c19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.307+0000 7f4d24236640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c1120d0 con 0x7f4d1c102dd0 2024-09-19T09:03:28.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.307+0000 7f4d24236640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c111f50 con 0x7f4d1c103780 2024-09-19T09:03:28.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.307+0000 7f4d24236640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c112250 con 0x7f4d1c108300 2024-09-19T09:03:28.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.307+0000 7f4d21fd2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d1c102dd0 0x7f4d1c198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.307+0000 7f4d21fd2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d1c102dd0 0x7f4d1c198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42112/0 (socket says 172.21.15.19:42112) 2024-09-19T09:03:28.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.307+0000 7f4d21fd2640 1 -- 172.21.15.19:0/4011043186 learned_addr learned my addr 172.21.15.19:0/4011043186 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:28.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.307+0000 7f4d217d1640 1 --2- 172.21.15.19:0/4011043186 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d1c103780 0x7f4d1c198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.307+0000 7f4d21fd2640 1 -- 172.21.15.19:0/4011043186 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d1c108300 msgr2=0x7f4d1c19ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:28.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.307+0000 7f4d21fd2640 1 --2- 172.21.15.19:0/4011043186 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d1c108300 0x7f4d1c19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.307+0000 7f4d21fd2640 1 -- 172.21.15.19:0/4011043186 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d1c103780 msgr2=0x7f4d1c198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:28.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.307+0000 7f4d21fd2640 1 --2- 172.21.15.19:0/4011043186 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d1c103780 0x7f4d1c198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.307+0000 7f4d21fd2640 1 -- 172.21.15.19:0/4011043186 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d1c19d4e0 con 0x7f4d1c102dd0 2024-09-19T09:03:28.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.308+0000 7f4d21fd2640 1 --2- 172.21.15.19:0/4011043186 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d1c102dd0 0x7f4d1c198530 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f4d1800d950 tx=0x7f4d1800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:28.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.308+0000 7f4d12ffd640 1 -- 172.21.15.19:0/4011043186 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d18017070 con 0x7f4d1c102dd0 2024-09-19T09:03:28.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.308+0000 7f4d12ffd640 1 -- 172.21.15.19:0/4011043186 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d18009c30 con 0x7f4d1c102dd0 2024-09-19T09:03:28.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.308+0000 7f4d12ffd640 1 -- 172.21.15.19:0/4011043186 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1800f6b0 con 0x7f4d1c102dd0 2024-09-19T09:03:28.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.308+0000 7f4d24236640 1 -- 172.21.15.19:0/4011043186 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d1c19d7d0 con 0x7f4d1c102dd0 2024-09-19T09:03:28.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.308+0000 7f4d24236640 1 -- 172.21.15.19:0/4011043186 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d1c1a50b0 con 0x7f4d1c102dd0 2024-09-19T09:03:28.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.310+0000 7f4d12ffd640 1 -- 172.21.15.19:0/4011043186 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f4d180109d0 con 0x7f4d1c102dd0 2024-09-19T09:03:28.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.310+0000 7f4d2660f740 1 Processor -- start 2024-09-19T09:03:28.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.311+0000 7f4d2660f740 1 -- start start 2024-09-19T09:03:28.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.311+0000 7f4d2660f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c87cd9380 0x563c87cd9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.311+0000 7f4d2660f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c87cd9ca0 0x563c87ce8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.311+0000 7f4d2660f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c87ce8a90 0x563c87ceae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.311+0000 7f4d2660f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563c87c3f2e0 con 0x563c87ce8a90 2024-09-19T09:03:28.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.311+0000 7f4d2660f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x563c87be6ce0 con 0x563c87cd9380 2024-09-19T09:03:28.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.311+0000 7f4d2660f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563c87c3b2a0 con 0x563c87cd9ca0 2024-09-19T09:03:28.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.311+0000 7f4d12ffd640 1 --2- 172.21.15.19:0/4011043186 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4d080a3240 0x7f4d080a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.311+0000 7f4d217d1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c87ce8a90 0x563c87ceae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.311+0000 7f4d217d1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c87ce8a90 0x563c87ceae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42126/0 (socket says 172.21.15.19:42126) 2024-09-19T09:03:28.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.311+0000 7f4d217d1640 1 -- 172.21.15.19:0/3680638119 learned_addr learned my addr 172.21.15.19:0/3680638119 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:28.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.311+0000 7f4d227d3640 1 --2- 172.21.15.19:0/4011043186 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4d080a3240 0x7f4d080a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.311+0000 7f4d12ffd640 1 -- 172.21.15.19:0/4011043186 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f4d180cf6a0 con 0x7f4d1c102dd0 2024-09-19T09:03:28.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.311+0000 7f4d227d3640 1 --2- 172.21.15.19:0/3680638119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c87cd9380 0x563c87cd9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.311+0000 7f4d21fd2640 1 --2- 172.21.15.19:0/3680638119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c87cd9ca0 0x563c87ce8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.311+0000 7f4d217d1640 1 -- 172.21.15.19:0/3680638119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c87cd9ca0 msgr2=0x563c87ce8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:28.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.311+0000 7f4d217d1640 1 --2- 172.21.15.19:0/3680638119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c87cd9ca0 0x563c87ce8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.311+0000 7f4d217d1640 1 -- 172.21.15.19:0/3680638119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c87cd9380 msgr2=0x563c87cd9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:28.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.311+0000 7f4d217d1640 1 --2- 172.21.15.19:0/3680638119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c87cd9380 0x563c87cd9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.311+0000 7f4d217d1640 1 -- 172.21.15.19:0/3680638119 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c87bcb440 con 0x563c87ce8a90 2024-09-19T09:03:28.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.312+0000 7f4d217d1640 1 --2- 172.21.15.19:0/3680638119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c87ce8a90 0x563c87ceae80 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00bba0 tx=0x7f4d0c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fb0b5c19617323d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:28.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.312+0000 7f4d227d3640 1 --2- 172.21.15.19:0/4011043186 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4d080a3240 0x7f4d080a5700 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4d14009430 tx=0x7f4d140093c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:28.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.312+0000 7f4d07fff640 1 -- 172.21.15.19:0/3680638119 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c015070 con 0x563c87ce8a90 2024-09-19T09:03:28.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.312+0000 7f4d07fff640 1 -- 172.21.15.19:0/3680638119 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d0c01a940 con 0x563c87ce8a90 2024-09-19T09:03:28.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.312+0000 7f4d07fff640 1 -- 172.21.15.19:0/3680638119 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c0118e0 con 0x563c87ce8a90 2024-09-19T09:03:28.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.313+0000 7f4d2660f740 1 -- 172.21.15.19:0/3680638119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c87ce8a90 msgr2=0x563c87ceae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:28.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.313+0000 7f4d2660f740 1 --2- 172.21.15.19:0/3680638119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c87ce8a90 0x563c87ceae80 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00bba0 tx=0x7f4d0c00f730 comp rx=0 tx=0).stop 2024-09-19T09:03:28.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.313+0000 7f4d2660f740 1 -- 172.21.15.19:0/3680638119 shutdown_connections 2024-09-19T09:03:28.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.313+0000 7f4d2660f740 1 --2- 172.21.15.19:0/3680638119 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c87cd9ca0 0x563c87ce8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.313+0000 7f4d2660f740 1 --2- 172.21.15.19:0/3680638119 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c87ce8a90 0x563c87ceae80 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.313+0000 7f4d2660f740 1 --2- 172.21.15.19:0/3680638119 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c87cd9380 0x563c87cd9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.313+0000 7f4d2660f740 1 -- 172.21.15.19:0/3680638119 >> 172.21.15.19:0/3680638119 conn(0x563c87cd5a30 msgr2=0x563c87cd5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:28.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.313+0000 7f4d2660f740 1 -- 172.21.15.19:0/3680638119 shutdown_connections 2024-09-19T09:03:28.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.313+0000 7f4d2660f740 1 -- 172.21.15.19:0/3680638119 wait complete. 2024-09-19T09:03:28.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.313+0000 7f4d2660f740 1 -- start start 2024-09-19T09:03:28.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.313+0000 7f4d2660f740 1 Processor -- start 2024-09-19T09:03:28.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.314+0000 7f4d2660f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c87cd9380 0x563c87ce8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.314+0000 7f4d2660f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c87cd9ca0 0x563c87ce56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.314+0000 7f4d2660f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c87ce8a90 0x563c87ce5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.314+0000 7f4d2660f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563c87ceb660 con 0x563c87cd9ca0 2024-09-19T09:03:28.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.314+0000 7f4d2660f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x563c87bfa050 con 0x563c87ce8a90 2024-09-19T09:03:28.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.314+0000 7f4d2660f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563c87ceb7e0 con 0x563c87cd9380 2024-09-19T09:03:28.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.314+0000 7f4d2660f740 10 client.0 _ll_register_callbacks cb 0x563c87c3a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:28.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.314+0000 7f4d217d1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c87cd9ca0 0x563c87ce56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.314+0000 7f4d217d1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c87cd9ca0 0x563c87ce56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42132/0 (socket says 172.21.15.19:42132) 2024-09-19T09:03:28.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.314+0000 7f4d217d1640 1 -- 172.21.15.19:0/3223542169 learned_addr learned my addr 172.21.15.19:0/3223542169 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:28.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.314+0000 7f4d21fd2640 1 --2- 172.21.15.19:0/3223542169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c87cd9380 0x563c87ce8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.314+0000 7f4d227d3640 1 --2- 172.21.15.19:0/3223542169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c87ce8a90 0x563c87ce5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.314+0000 7f4d217d1640 1 -- 172.21.15.19:0/3223542169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c87cd9380 msgr2=0x563c87ce8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:28.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.314+0000 7f4d217d1640 1 --2- 172.21.15.19:0/3223542169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c87cd9380 0x563c87ce8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.314+0000 7f4d217d1640 1 -- 172.21.15.19:0/3223542169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c87ce8a90 msgr2=0x563c87ce5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:28.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.314+0000 7f4d217d1640 1 --2- 172.21.15.19:0/3223542169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c87ce8a90 0x563c87ce5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.314+0000 7f4d217d1640 1 -- 172.21.15.19:0/3223542169 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c879b03c0 con 0x563c87cd9ca0 2024-09-19T09:03:28.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.314+0000 7f4d227d3640 1 --2- 172.21.15.19:0/3223542169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c87ce8a90 0x563c87ce5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:28.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.314+0000 7f4d217d1640 1 --2- 172.21.15.19:0/3223542169 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c87cd9ca0 0x563c87ce56b0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00bec0 tx=0x7f4d0c00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab381c3334a8fc8f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:28.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.314+0000 7f4d057fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:28.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.315+0000 7f4d057fa640 1 -- 172.21.15.19:0/3223542169 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c028060 con 0x563c87cd9ca0 2024-09-19T09:03:28.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.315+0000 7f4d057fa640 1 -- 172.21.15.19:0/3223542169 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f4d0c01a6f0 con 0x563c87cd9ca0 2024-09-19T09:03:28.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.315+0000 7f4d2660f740 1 -- 172.21.15.19:0/3223542169 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d0c01a940 con 0x563c87cd9ca0 2024-09-19T09:03:28.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.315+0000 7f4d057fa640 1 -- 172.21.15.19:0/3223542169 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f4d0c015070 con 0x563c87cd9ca0 2024-09-19T09:03:28.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.315+0000 7f4d2660f740 10 client.18129 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:28.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.315+0000 7f4d2660f740 1 -- 172.21.15.19:0/3223542169 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x563c87cf6fe0 con 0x563c87cd9ca0 2024-09-19T09:03:28.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.315+0000 7f4d057fa640 1 -- 172.21.15.19:0/3223542169 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d0c01a940 con 0x563c87cd9ca0 2024-09-19T09:03:28.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.315+0000 7f4d057fa640 1 -- 172.21.15.19:0/3223542169 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f4d0c004840 con 0x563c87cd9ca0 2024-09-19T09:03:28.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.315+0000 7f4d2660f740 10 client.18129 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:28.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.315+0000 7f4d2660f740 10 client.18129 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:28.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.315+0000 7f4d2660f740 20 client.18129 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:28.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.315+0000 7f4d2660f740 1 --2- 172.21.15.19:0/3223542169 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563c87cf84a0 0x563c87cfa890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.315+0000 7f4d2660f740 4 client.18129 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:28.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.315+0000 7f4d2660f740 1 -- 172.21.15.19:0/3223542169 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c87c4c850 con 0x563c87cf84a0 2024-09-19T09:03:28.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.316+0000 7f4d21fd2640 1 --2- 172.21.15.19:0/3223542169 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563c87cf84a0 0x563c87cfa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.316+0000 7f4d057fa640 10 client.18129 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:28.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.316+0000 7f4d21fd2640 1 --2- 172.21.15.19:0/3223542169 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563c87cf84a0 0x563c87cfa890 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23b0a19db3c2f7ef server_cookie=f81534ea90391bf in_seq=0 out_seq=0 2024-09-19T09:03:28.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.317+0000 7f4d057fa640 1 -- 172.21.15.19:0/3223542169 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563c87c4c850 con 0x563c87cf84a0 2024-09-19T09:03:28.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.317+0000 7f4d057fa640 10 client.18129 handle_command_reply: tid=0 2024-09-19T09:03:28.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.317+0000 7f4d2660f740 1 client.18129 shutdown 2024-09-19T09:03:28.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.317+0000 7f4d2660f740 1 -- 172.21.15.19:0/3223542169 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c87cd9ca0 msgr2=0x563c87ce56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:28.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.317+0000 7f4d2660f740 1 --2- 172.21.15.19:0/3223542169 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c87cd9ca0 0x563c87ce56b0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00bec0 tx=0x7f4d0c00b8f0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.317+0000 7f4d2660f740 1 -- 172.21.15.19:0/3223542169 shutdown_connections 2024-09-19T09:03:28.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.317+0000 7f4d2660f740 1 --2- 172.21.15.19:0/3223542169 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563c87cf84a0 0x563c87cfa890 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.317+0000 7f4d2660f740 1 --2- 172.21.15.19:0/3223542169 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c87ce8a90 0x563c87ce5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.317+0000 7f4d2660f740 1 --2- 172.21.15.19:0/3223542169 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c87cd9ca0 0x563c87ce56b0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.317+0000 7f4d057fa640 0 client.18129 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:28.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.317+0000 7f4d2660f740 1 --2- 172.21.15.19:0/3223542169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c87cd9380 0x563c87ce8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.317+0000 7f4d2660f740 1 -- 172.21.15.19:0/3223542169 >> 172.21.15.19:0/3223542169 conn(0x563c87cd5a30 msgr2=0x563c87cdb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:28.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.317+0000 7f4d2660f740 1 -- 172.21.15.19:0/3223542169 shutdown_connections 2024-09-19T09:03:28.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.317+0000 7f4d2660f740 1 -- 172.21.15.19:0/3223542169 wait complete. 2024-09-19T09:03:28.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.317+0000 7f4d2660f740 20 client.18129 trim_cache size 0 max 16384 2024-09-19T09:03:28.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.334+0000 7f4d2660f740 1 Processor -- start 2024-09-19T09:03:28.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.334+0000 7f4d2660f740 1 -- start start 2024-09-19T09:03:28.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.335+0000 7f4d2660f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c87cd9380 0x563c87cf4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.335+0000 7f4d2660f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c87cd9ca0 0x563c87ce4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.335+0000 7f4d2660f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c87ce8a90 0x563c87cffe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.335+0000 7f4d2660f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c1ab390 con 0x563c87cd9ca0 2024-09-19T09:03:28.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.335+0000 7f4d2660f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c1aced0 con 0x563c87ce8a90 2024-09-19T09:03:28.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.335+0000 7f4d2660f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c1aba60 con 0x563c87cd9380 2024-09-19T09:03:28.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.335+0000 7f4d217d1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c87cd9ca0 0x563c87ce4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.335+0000 7f4d217d1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c87cd9ca0 0x563c87ce4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42140/0 (socket says 172.21.15.19:42140) 2024-09-19T09:03:28.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.335+0000 7f4d217d1640 1 -- 172.21.15.19:0/2516160800 learned_addr learned my addr 172.21.15.19:0/2516160800 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:28.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.335+0000 7f4d227d3640 1 --2- 172.21.15.19:0/2516160800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c87ce8a90 0x563c87cffe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.335+0000 7f4d21fd2640 1 --2- 172.21.15.19:0/2516160800 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c87cd9380 0x563c87cf4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.335+0000 7f4d217d1640 1 -- 172.21.15.19:0/2516160800 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c87cd9380 msgr2=0x563c87cf4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:28.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.335+0000 7f4d217d1640 1 --2- 172.21.15.19:0/2516160800 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c87cd9380 0x563c87cf4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.335+0000 7f4d217d1640 1 -- 172.21.15.19:0/2516160800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c87ce8a90 msgr2=0x563c87cffe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:28.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.335+0000 7f4d217d1640 1 --2- 172.21.15.19:0/2516160800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c87ce8a90 0x563c87cffe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.335+0000 7f4d217d1640 1 -- 172.21.15.19:0/2516160800 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c87cd5860 con 0x563c87cd9ca0 2024-09-19T09:03:28.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.335+0000 7f4d227d3640 1 --2- 172.21.15.19:0/2516160800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c87ce8a90 0x563c87cffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:28.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.335+0000 7f4d217d1640 1 --2- 172.21.15.19:0/2516160800 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c87cd9ca0 0x563c87ce4690 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00f770 tx=0x7f4d0c005b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea45265f1ad7859 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:28.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.335+0000 7f4d077fe640 1 -- 172.21.15.19:0/2516160800 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c033070 con 0x563c87cd9ca0 2024-09-19T09:03:28.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.335+0000 7f4d077fe640 1 -- 172.21.15.19:0/2516160800 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d0c0115f0 con 0x563c87cd9ca0 2024-09-19T09:03:28.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.335+0000 7f4d077fe640 1 -- 172.21.15.19:0/2516160800 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c01a6f0 con 0x563c87cd9ca0 2024-09-19T09:03:28.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.336+0000 7f4d2660f740 1 -- 172.21.15.19:0/2516160800 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c87cd9ca0 msgr2=0x563c87ce4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:28.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.336+0000 7f4d2660f740 1 --2- 172.21.15.19:0/2516160800 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c87cd9ca0 0x563c87ce4690 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00f770 tx=0x7f4d0c005b90 comp rx=0 tx=0).stop 2024-09-19T09:03:28.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.336+0000 7f4d2660f740 1 -- 172.21.15.19:0/2516160800 shutdown_connections 2024-09-19T09:03:28.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.336+0000 7f4d2660f740 1 --2- 172.21.15.19:0/2516160800 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c87ce8a90 0x563c87cffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.336+0000 7f4d2660f740 1 --2- 172.21.15.19:0/2516160800 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c87cd9ca0 0x563c87ce4690 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.336+0000 7f4d2660f740 1 --2- 172.21.15.19:0/2516160800 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c87cd9380 0x563c87cf4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.336+0000 7f4d2660f740 1 -- 172.21.15.19:0/2516160800 >> 172.21.15.19:0/2516160800 conn(0x563c87cd5a30 msgr2=0x563c87ce3f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:28.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.336+0000 7f4d2660f740 1 -- 172.21.15.19:0/2516160800 shutdown_connections 2024-09-19T09:03:28.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.336+0000 7f4d2660f740 1 -- 172.21.15.19:0/2516160800 wait complete. 2024-09-19T09:03:28.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.336+0000 7f4d2660f740 1 -- start start 2024-09-19T09:03:28.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.337+0000 7f4d2660f740 1 Processor -- start 2024-09-19T09:03:28.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.337+0000 7f4d2660f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c87cd9380 0x563c87cf0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.337+0000 7f4d2660f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c87cd9ca0 0x563c87cf1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.337+0000 7f4d2660f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c87ce8a90 0x563c87cec370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.337+0000 7f4d2660f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c1ac800 con 0x563c87cd9380 2024-09-19T09:03:28.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.337+0000 7f4d2660f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c1ac130 con 0x563c87ce8a90 2024-09-19T09:03:28.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.337+0000 7f4d2660f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c1a9370 con 0x563c87cd9ca0 2024-09-19T09:03:28.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.337+0000 7f4d2660f740 10 client.0 _ll_register_callbacks cb 0x7f4d0c00b9f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:28.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.337+0000 7f4d21fd2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c87cd9380 0x563c87cf0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.337+0000 7f4d21fd2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c87cd9380 0x563c87cf0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42150/0 (socket says 172.21.15.19:42150) 2024-09-19T09:03:28.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.337+0000 7f4d21fd2640 1 -- 172.21.15.19:0/3579541745 learned_addr learned my addr 172.21.15.19:0/3579541745 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:28.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.337+0000 7f4d227d3640 1 --2- 172.21.15.19:0/3579541745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c87ce8a90 0x563c87cec370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.337+0000 7f4d217d1640 1 --2- 172.21.15.19:0/3579541745 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c87cd9ca0 0x563c87cf1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.337+0000 7f4d21fd2640 1 -- 172.21.15.19:0/3579541745 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c87cd9ca0 msgr2=0x563c87cf1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:28.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.337+0000 7f4d21fd2640 1 --2- 172.21.15.19:0/3579541745 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c87cd9ca0 0x563c87cf1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.337+0000 7f4d21fd2640 1 -- 172.21.15.19:0/3579541745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c87ce8a90 msgr2=0x563c87cec370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:28.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.337+0000 7f4d21fd2640 1 --2- 172.21.15.19:0/3579541745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c87ce8a90 0x563c87cec370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.338+0000 7f4d21fd2640 1 -- 172.21.15.19:0/3579541745 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c87cd66c0 con 0x563c87cd9380 2024-09-19T09:03:28.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.338+0000 7f4d21fd2640 1 --2- 172.21.15.19:0/3579541745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c87cd9380 0x563c87cf0df0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f4d1809b970 tx=0x7f4d18005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=170d086f5515d807 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:28.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.338+0000 7f4d057fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:28.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.338+0000 7f4d057fa640 1 -- 172.21.15.19:0/3579541745 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d180b9060 con 0x563c87cd9380 2024-09-19T09:03:28.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.338+0000 7f4d057fa640 1 -- 172.21.15.19:0/3579541745 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f4d180982e0 con 0x563c87cd9380 2024-09-19T09:03:28.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.338+0000 7f4d2660f740 1 -- 172.21.15.19:0/3579541745 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d0c0115f0 con 0x563c87cd9380 2024-09-19T09:03:28.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.338+0000 7f4d057fa640 1 -- 172.21.15.19:0/3579541745 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f4d18020040 con 0x563c87cd9380 2024-09-19T09:03:28.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.338+0000 7f4d2660f740 10 client.18135 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:28.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.338+0000 7f4d2660f740 1 -- 172.21.15.19:0/3579541745 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x563c87d628c0 con 0x563c87cd9380 2024-09-19T09:03:28.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.338+0000 7f4d057fa640 1 -- 172.21.15.19:0/3579541745 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4d0c0115f0 con 0x563c87cd9380 2024-09-19T09:03:28.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.338+0000 7f4d057fa640 1 -- 172.21.15.19:0/3579541745 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f4d18010460 con 0x563c87cd9380 2024-09-19T09:03:28.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.338+0000 7f4d2660f740 10 client.18135 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:28.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.338+0000 7f4d2660f740 10 client.18135 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:28.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.338+0000 7f4d2660f740 20 client.18135 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:28.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.338+0000 7f4d2660f740 1 --2- 172.21.15.19:0/3579541745 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563c87d62f40 0x563c87d65380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.338+0000 7f4d2660f740 4 client.18135 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:03:28.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.338+0000 7f4d2660f740 1 -- 172.21.15.19:0/3579541745 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563c87c46d60 con 0x563c87d62f40 2024-09-19T09:03:28.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.339+0000 7f4d217d1640 1 --2- 172.21.15.19:0/3579541745 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563c87d62f40 0x563c87d65380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.339+0000 7f4d057fa640 10 client.18135 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:28.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.339+0000 7f4d217d1640 1 --2- 172.21.15.19:0/3579541745 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563c87d62f40 0x563c87d65380 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1d15fd80a95069e server_cookie=c89b81161004f09f in_seq=0 out_seq=0 2024-09-19T09:03:28.364 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T09:03:28.364 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-19T09:03:28.364 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {} 2024-09-19T09:03:28.364 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T09:03:28.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.339+0000 7f4d057fa640 1 -- 172.21.15.19:0/3579541745 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x563c87c46d60 con 0x563c87d62f40 2024-09-19T09:03:28.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.339+0000 7f4d057fa640 10 client.18135 handle_command_reply: tid=0 2024-09-19T09:03:28.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.339+0000 7f4d2660f740 1 client.18135 shutdown 2024-09-19T09:03:28.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.339+0000 7f4d2660f740 1 -- 172.21.15.19:0/3579541745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c87cd9380 msgr2=0x563c87cf0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:28.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.339+0000 7f4d2660f740 1 --2- 172.21.15.19:0/3579541745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c87cd9380 0x563c87cf0df0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f4d1809b970 tx=0x7f4d18005f90 comp rx=0 tx=0).stop 2024-09-19T09:03:28.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.340+0000 7f4d2660f740 1 -- 172.21.15.19:0/3579541745 shutdown_connections 2024-09-19T09:03:28.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.340+0000 7f4d2660f740 1 --2- 172.21.15.19:0/3579541745 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x563c87d62f40 0x563c87d65380 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.340+0000 7f4d2660f740 1 --2- 172.21.15.19:0/3579541745 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563c87cd9ca0 0x563c87cf1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.340+0000 7f4d2660f740 1 --2- 172.21.15.19:0/3579541745 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563c87ce8a90 0x563c87cec370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.340+0000 7f4d2660f740 1 --2- 172.21.15.19:0/3579541745 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563c87cd9380 0x563c87cf0df0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.340+0000 7f4d057fa640 0 client.18135 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:28.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.340+0000 7f4d2660f740 1 -- 172.21.15.19:0/3579541745 >> 172.21.15.19:0/3579541745 conn(0x563c87cd5a30 msgr2=0x563c87ce47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:28.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.340+0000 7f4d2660f740 1 -- 172.21.15.19:0/3579541745 shutdown_connections 2024-09-19T09:03:28.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.340+0000 7f4d2660f740 1 -- 172.21.15.19:0/3579541745 wait complete. 2024-09-19T09:03:28.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.340+0000 7f4d2660f740 20 client.18135 trim_cache size 0 max 16384 2024-09-19T09:03:28.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.340+0000 7f4d24236640 1 -- 172.21.15.19:0/4011043186 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4d080a3240 msgr2=0x7f4d080a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:28.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.340+0000 7f4d24236640 1 --2- 172.21.15.19:0/4011043186 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4d080a3240 0x7f4d080a5700 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4d14009430 tx=0x7f4d140093c0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.340+0000 7f4d24236640 1 -- 172.21.15.19:0/4011043186 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d1c102dd0 msgr2=0x7f4d1c198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:28.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.340+0000 7f4d24236640 1 --2- 172.21.15.19:0/4011043186 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d1c102dd0 0x7f4d1c198530 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f4d1800d950 tx=0x7f4d1800de10 comp rx=0 tx=0).stop 2024-09-19T09:03:28.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.340+0000 7f4d24236640 1 -- 172.21.15.19:0/4011043186 shutdown_connections 2024-09-19T09:03:28.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.340+0000 7f4d24236640 1 --2- 172.21.15.19:0/4011043186 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4d080a3240 0x7f4d080a5700 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.340+0000 7f4d24236640 1 --2- 172.21.15.19:0/4011043186 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4d1c108300 0x7f4d1c19ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.340+0000 7f4d24236640 1 --2- 172.21.15.19:0/4011043186 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4d1c103780 0x7f4d1c198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.340+0000 7f4d24236640 1 --2- 172.21.15.19:0/4011043186 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4d1c102dd0 0x7f4d1c198530 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.340+0000 7f4d24236640 1 -- 172.21.15.19:0/4011043186 >> 172.21.15.19:0/4011043186 conn(0x7f4d1c0fc7d0 msgr2=0x7f4d1c1063b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:28.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.340+0000 7f4d24236640 1 -- 172.21.15.19:0/4011043186 shutdown_connections 2024-09-19T09:03:28.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:28.340+0000 7f4d24236640 1 -- 172.21.15.19:0/4011043186 wait complete. 2024-09-19T09:03:28.700 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.698+0000 7f1908598640 1 -- 172.21.15.19:0/1184600237 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1900101c40 msgr2=0x7f19001020c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:28.700 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.698+0000 7f1908598640 1 --2- 172.21.15.19:0/1184600237 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1900101c40 0x7f19001020c0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f18f4009900 tx=0x7f18f402a410 comp rx=0 tx=0).stop 2024-09-19T09:03:28.700 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.698+0000 7f1908598640 1 -- 172.21.15.19:0/1184600237 shutdown_connections 2024-09-19T09:03:28.700 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.698+0000 7f1908598640 1 --2- 172.21.15.19:0/1184600237 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1900102600 0x7f1900108e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.700 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.698+0000 7f1908598640 1 --2- 172.21.15.19:0/1184600237 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1900101c40 0x7f19001020c0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.700 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.698+0000 7f1908598640 1 --2- 172.21.15.19:0/1184600237 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1900100a50 0x7f1900100e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.700 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.698+0000 7f1908598640 1 -- 172.21.15.19:0/1184600237 >> 172.21.15.19:0/1184600237 conn(0x7f19000fc1b0 msgr2=0x7f19000fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:28.700 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.698+0000 7f1908598640 1 -- 172.21.15.19:0/1184600237 shutdown_connections 2024-09-19T09:03:28.700 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.698+0000 7f1908598640 1 -- 172.21.15.19:0/1184600237 wait complete. 2024-09-19T09:03:28.700 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.698+0000 7f1908598640 1 Processor -- start 2024-09-19T09:03:28.701 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.698+0000 7f1908598640 1 -- start start 2024-09-19T09:03:28.701 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.699+0000 7f1908598640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1900100a50 0x7f190006ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.701 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.699+0000 7f1908598640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1900101c40 0x7f190019cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.701 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.699+0000 7f1908598640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1900102600 0x7f190019f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.701 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.699+0000 7f1908598640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f190010c6d0 con 0x7f1900102600 2024-09-19T09:03:28.701 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.699+0000 7f1908598640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f190010c550 con 0x7f1900100a50 2024-09-19T09:03:28.701 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.699+0000 7f1908598640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f190010c850 con 0x7f1900101c40 2024-09-19T09:03:28.701 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.699+0000 7f1906b35640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1900102600 0x7f190019f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.701 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.699+0000 7f1906b35640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1900102600 0x7f190019f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42158/0 (socket says 172.21.15.19:42158) 2024-09-19T09:03:28.701 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.699+0000 7f1906b35640 1 -- 172.21.15.19:0/2088795318 learned_addr learned my addr 172.21.15.19:0/2088795318 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:28.701 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.699+0000 7f1905b33640 1 --2- 172.21.15.19:0/2088795318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1900101c40 0x7f190019cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.702 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.699+0000 7f1906334640 1 --2- 172.21.15.19:0/2088795318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1900100a50 0x7f190006ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.702 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.699+0000 7f1906b35640 1 -- 172.21.15.19:0/2088795318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1900101c40 msgr2=0x7f190019cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:28.702 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.699+0000 7f1906b35640 1 --2- 172.21.15.19:0/2088795318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1900101c40 0x7f190019cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.702 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.699+0000 7f1906b35640 1 -- 172.21.15.19:0/2088795318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1900100a50 msgr2=0x7f190006ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:28.702 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.699+0000 7f1906b35640 1 --2- 172.21.15.19:0/2088795318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1900100a50 0x7f190006ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.702 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.699+0000 7f1906b35640 1 -- 172.21.15.19:0/2088795318 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f190019fa40 con 0x7f1900102600 2024-09-19T09:03:28.702 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.699+0000 7f1905b33640 1 --2- 172.21.15.19:0/2088795318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1900101c40 0x7f190019cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:28.702 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.699+0000 7f1906b35640 1 --2- 172.21.15.19:0/2088795318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1900102600 0x7f190019f130 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f18f800d750 tx=0x7f18f800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:28.702 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.699+0000 7f18ff7fe640 1 -- 172.21.15.19:0/2088795318 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f8017070 con 0x7f1900102600 2024-09-19T09:03:28.702 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.699+0000 7f18ff7fe640 1 -- 172.21.15.19:0/2088795318 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18f8005500 con 0x7f1900102600 2024-09-19T09:03:28.702 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.699+0000 7f1908598640 1 -- 172.21.15.19:0/2088795318 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f190019fcd0 con 0x7f1900102600 2024-09-19T09:03:28.702 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.699+0000 7f18ff7fe640 1 -- 172.21.15.19:0/2088795318 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f8004d90 con 0x7f1900102600 2024-09-19T09:03:28.702 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.699+0000 7f1908598640 1 -- 172.21.15.19:0/2088795318 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19001a01d0 con 0x7f1900102600 2024-09-19T09:03:28.709 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.702+0000 7f18ff7fe640 1 -- 172.21.15.19:0/2088795318 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f18f8004f30 con 0x7f1900102600 2024-09-19T09:03:28.709 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.702+0000 7f190b413740 1 Processor -- start 2024-09-19T09:03:28.709 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.703+0000 7f190b413740 1 -- start start 2024-09-19T09:03:28.709 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.703+0000 7f190b413740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e88c60bdb0 0x55e88c60c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.710 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.703+0000 7f190b413740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e88c60c6f0 0x55e88c6111b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.710 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.703+0000 7f190b413740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e88c611780 0x55e88c613c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.710 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.703+0000 7f190b413740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e88c56b2f0 con 0x55e88c611780 2024-09-19T09:03:28.710 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.703+0000 7f190b413740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55e88c513270 con 0x55e88c60c6f0 2024-09-19T09:03:28.710 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.703+0000 7f190b413740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e88c5672b0 con 0x55e88c60bdb0 2024-09-19T09:03:28.710 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.703+0000 7f1905b33640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e88c611780 0x55e88c613c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.710 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.703+0000 7f18ff7fe640 1 --2- 172.21.15.19:0/2088795318 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f18e80a32f0 0x7f18e80a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.710 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.703+0000 7f1906334640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e88c60c6f0 0x55e88c6111b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.710 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.703+0000 7f1905b33640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e88c611780 0x55e88c613c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42162/0 (socket says 172.21.15.19:42162) 2024-09-19T09:03:28.710 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.703+0000 7f1905b33640 1 -- 172.21.15.19:0/813515999 learned_addr learned my addr 172.21.15.19:0/813515999 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:28.710 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.703+0000 7f1905b33640 1 --2- 172.21.15.19:0/813515999 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e88c60bdb0 0x55e88c60c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.710 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.703+0000 7f1906b35640 1 --2- 172.21.15.19:0/2088795318 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f18e80a32f0 0x7f18e80a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.711 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.703+0000 7f18ff7fe640 1 -- 172.21.15.19:0/2088795318 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f18f80cf3d0 con 0x7f1900102600 2024-09-19T09:03:28.711 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.703+0000 7f1906334640 1 -- 172.21.15.19:0/813515999 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e88c60bdb0 msgr2=0x55e88c60c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:28.711 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.703+0000 7f1906334640 1 --2- 172.21.15.19:0/813515999 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e88c60bdb0 0x55e88c60c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.711 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.703+0000 7f1906334640 1 -- 172.21.15.19:0/813515999 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e88c611780 msgr2=0x55e88c613c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:28.711 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.703+0000 7f1906334640 1 --2- 172.21.15.19:0/813515999 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e88c611780 0x55e88c613c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.711 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.703+0000 7f1906334640 1 -- 172.21.15.19:0/813515999 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e88c512340 con 0x55e88c60c6f0 2024-09-19T09:03:28.711 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.703+0000 7f1905b33640 1 --2- 172.21.15.19:0/813515999 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e88c60bdb0 0x55e88c60c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:28.711 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.704+0000 7f1906334640 1 --2- 172.21.15.19:0/813515999 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e88c60c6f0 0x55e88c6111b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f18f0005fd0 tx=0x7f18f000f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de93e67985b48211 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:28.711 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.704+0000 7f1906b35640 1 --2- 172.21.15.19:0/2088795318 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f18e80a32f0 0x7f18e80a57b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f18f80cd250 tx=0x7f18f80bd040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:28.711 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.704+0000 7f18fcbfe640 1 -- 172.21.15.19:0/813515999 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f0004d20 con 0x55e88c60c6f0 2024-09-19T09:03:28.711 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.704+0000 7f18fcbfe640 1 -- 172.21.15.19:0/813515999 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18f0005500 con 0x55e88c60c6f0 2024-09-19T09:03:28.711 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.704+0000 7f18fcbfe640 1 -- 172.21.15.19:0/813515999 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f0011950 con 0x55e88c60c6f0 2024-09-19T09:03:28.711 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.705+0000 7f190b413740 1 -- 172.21.15.19:0/813515999 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e88c60c6f0 msgr2=0x55e88c6111b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:28.711 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.705+0000 7f190b413740 1 --2- 172.21.15.19:0/813515999 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e88c60c6f0 0x55e88c6111b0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f18f0005fd0 tx=0x7f18f000f730 comp rx=0 tx=0).stop 2024-09-19T09:03:28.712 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.705+0000 7f190b413740 1 -- 172.21.15.19:0/813515999 shutdown_connections 2024-09-19T09:03:28.712 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.705+0000 7f190b413740 1 --2- 172.21.15.19:0/813515999 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e88c611780 0x55e88c613c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.712 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.705+0000 7f190b413740 1 --2- 172.21.15.19:0/813515999 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e88c60c6f0 0x55e88c6111b0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.712 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.705+0000 7f190b413740 1 --2- 172.21.15.19:0/813515999 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e88c60bdb0 0x55e88c60c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.712 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.705+0000 7f190b413740 1 -- 172.21.15.19:0/813515999 >> 172.21.15.19:0/813515999 conn(0x55e88c603010 msgr2=0x55e88c603410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:28.712 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.705+0000 7f190b413740 1 -- 172.21.15.19:0/813515999 shutdown_connections 2024-09-19T09:03:28.712 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.705+0000 7f190b413740 1 -- 172.21.15.19:0/813515999 wait complete. 2024-09-19T09:03:28.712 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.706+0000 7f190b413740 1 -- start start 2024-09-19T09:03:28.712 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.706+0000 7f190b413740 1 Processor -- start 2024-09-19T09:03:28.712 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.706+0000 7f190b413740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e88c60bdb0 0x55e88c615fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.712 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.706+0000 7f190b413740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e88c60c6f0 0x55e88c6164f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.712 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.706+0000 7f190b413740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e88c611780 0x55e88c61d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.713 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.706+0000 7f190b413740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e88c614750 con 0x55e88c60bdb0 2024-09-19T09:03:28.713 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.706+0000 7f190b413740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55e88c4f4290 con 0x55e88c611780 2024-09-19T09:03:28.713 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.706+0000 7f190b413740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e88c6148d0 con 0x55e88c60c6f0 2024-09-19T09:03:28.713 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.706+0000 7f190b413740 10 client.0 _ll_register_callbacks cb 0x55e88c525140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:28.713 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.706+0000 7f1905b33640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e88c60bdb0 0x55e88c615fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.713 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.706+0000 7f1905b33640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e88c60bdb0 0x55e88c615fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42170/0 (socket says 172.21.15.19:42170) 2024-09-19T09:03:28.713 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.706+0000 7f1905b33640 1 -- 172.21.15.19:0/51536795 learned_addr learned my addr 172.21.15.19:0/51536795 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:28.713 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.706+0000 7f1905b33640 1 --2- 172.21.15.19:0/51536795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e88c611780 0x55e88c61d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.713 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.706+0000 7f1906334640 1 --2- 172.21.15.19:0/51536795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e88c60c6f0 0x55e88c6164f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.713 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.706+0000 7f1905b33640 1 -- 172.21.15.19:0/51536795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e88c60c6f0 msgr2=0x55e88c6164f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:28.713 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.706+0000 7f1905b33640 1 --2- 172.21.15.19:0/51536795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e88c60c6f0 0x55e88c6164f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.713 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.706+0000 7f1905b33640 1 -- 172.21.15.19:0/51536795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e88c611780 msgr2=0x55e88c61d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:28.714 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.706+0000 7f1905b33640 1 --2- 172.21.15.19:0/51536795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e88c611780 0x55e88c61d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.714 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.706+0000 7f1905b33640 1 -- 172.21.15.19:0/51536795 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e88c27e210 con 0x55e88c60bdb0 2024-09-19T09:03:28.714 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.707+0000 7f1906334640 1 --2- 172.21.15.19:0/51536795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e88c60c6f0 0x55e88c6164f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:28.714 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.707+0000 7f1905b33640 1 --2- 172.21.15.19:0/51536795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e88c60bdb0 0x55e88c615fb0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f18f40314e0 tx=0x7f18f402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e09835fed1f98e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:28.714 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.707+0000 7f18e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:28.714 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.707+0000 7f18e5ffb640 1 -- 172.21.15.19:0/51536795 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f4035040 con 0x55e88c60bdb0 2024-09-19T09:03:28.714 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.707+0000 7f18e5ffb640 1 -- 172.21.15.19:0/51536795 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f18f4005240 con 0x55e88c60bdb0 2024-09-19T09:03:28.714 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.707+0000 7f190b413740 1 -- 172.21.15.19:0/51536795 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18f0005500 con 0x55e88c60bdb0 2024-09-19T09:03:28.714 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.707+0000 7f18e5ffb640 1 -- 172.21.15.19:0/51536795 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f18f4051050 con 0x55e88c60bdb0 2024-09-19T09:03:28.714 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.707+0000 7f190b413740 10 client.18147 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:28.714 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.707+0000 7f190b413740 1 -- 172.21.15.19:0/51536795 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55e88c34a620 con 0x55e88c60bdb0 2024-09-19T09:03:28.714 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.707+0000 7f18e5ffb640 1 -- 172.21.15.19:0/51536795 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18f0005500 con 0x55e88c60bdb0 2024-09-19T09:03:28.714 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.707+0000 7f18e5ffb640 1 -- 172.21.15.19:0/51536795 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f18f403a070 con 0x55e88c60bdb0 2024-09-19T09:03:28.715 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.707+0000 7f190b413740 10 client.18147 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:28.715 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.707+0000 7f190b413740 10 client.18147 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:28.715 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.708+0000 7f190b413740 20 client.18147 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:28.715 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.708+0000 7f190b413740 1 --2- 172.21.15.19:0/51536795 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e88c621c20 0x55e88c624070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.715 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.708+0000 7f190b413740 4 client.18147 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:28.715 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.708+0000 7f190b413740 1 -- 172.21.15.19:0/51536795 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e88c578a20 con 0x55e88c621c20 2024-09-19T09:03:28.715 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.708+0000 7f1906334640 1 --2- 172.21.15.19:0/51536795 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e88c621c20 0x55e88c624070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.715 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.708+0000 7f18e5ffb640 10 client.18147 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:28.715 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.708+0000 7f1906334640 1 --2- 172.21.15.19:0/51536795 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e88c621c20 0x55e88c624070 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1733068a51191cfc server_cookie=87011efc9930809 in_seq=0 out_seq=0 2024-09-19T09:03:28.716 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.709+0000 7f18e5ffb640 1 -- 172.21.15.19:0/51536795 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e88c578a20 con 0x55e88c621c20 2024-09-19T09:03:28.716 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.709+0000 7f18e5ffb640 10 client.18147 handle_command_reply: tid=0 2024-09-19T09:03:28.716 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.709+0000 7f190b413740 1 client.18147 shutdown 2024-09-19T09:03:28.716 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.709+0000 7f190b413740 1 -- 172.21.15.19:0/51536795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e88c60bdb0 msgr2=0x55e88c615fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:28.716 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.709+0000 7f190b413740 1 --2- 172.21.15.19:0/51536795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e88c60bdb0 0x55e88c615fb0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f18f40314e0 tx=0x7f18f402a410 comp rx=0 tx=0).stop 2024-09-19T09:03:28.716 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.709+0000 7f190b413740 1 -- 172.21.15.19:0/51536795 shutdown_connections 2024-09-19T09:03:28.716 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.709+0000 7f190b413740 1 --2- 172.21.15.19:0/51536795 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e88c621c20 0x55e88c624070 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.716 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.709+0000 7f190b413740 1 --2- 172.21.15.19:0/51536795 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e88c60c6f0 0x55e88c6164f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.716 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.709+0000 7f190b413740 1 --2- 172.21.15.19:0/51536795 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e88c611780 0x55e88c61d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.716 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.709+0000 7f18e5ffb640 0 client.18147 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:28.716 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.709+0000 7f190b413740 1 --2- 172.21.15.19:0/51536795 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e88c60bdb0 0x55e88c615fb0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.716 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.709+0000 7f190b413740 1 -- 172.21.15.19:0/51536795 >> 172.21.15.19:0/51536795 conn(0x55e88c603010 msgr2=0x55e88c604820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:28.716 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.709+0000 7f190b413740 1 -- 172.21.15.19:0/51536795 shutdown_connections 2024-09-19T09:03:28.717 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.710+0000 7f190b413740 1 -- 172.21.15.19:0/51536795 wait complete. 2024-09-19T09:03:28.717 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.710+0000 7f190b413740 20 client.18147 trim_cache size 0 max 16384 2024-09-19T09:03:28.729 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.725+0000 7f190b413740 1 Processor -- start 2024-09-19T09:03:28.729 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.725+0000 7f190b413740 1 -- start start 2024-09-19T09:03:28.729 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.725+0000 7f190b413740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e88c60bdb0 0x55e88c6163d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.729 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.725+0000 7f190b413740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e88c60c6f0 0x55e88c61d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.729 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.725+0000 7f190b413740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e88c611780 0x55e88c628970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.729 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.725+0000 7f190b413740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f19001a6d30 con 0x55e88c60c6f0 2024-09-19T09:03:28.729 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.725+0000 7f190b413740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f19001a8870 con 0x55e88c611780 2024-09-19T09:03:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.725+0000 7f190b413740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f19001a7400 con 0x55e88c60bdb0 2024-09-19T09:03:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.725+0000 7f1906334640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e88c60c6f0 0x55e88c61d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.725+0000 7f1906334640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e88c60c6f0 0x55e88c61d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42174/0 (socket says 172.21.15.19:42174) 2024-09-19T09:03:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.725+0000 7f1906334640 1 -- 172.21.15.19:0/1649278599 learned_addr learned my addr 172.21.15.19:0/1649278599 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.725+0000 7f1905b33640 1 --2- 172.21.15.19:0/1649278599 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e88c60bdb0 0x55e88c6163d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.725+0000 7f1906334640 1 -- 172.21.15.19:0/1649278599 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e88c60bdb0 msgr2=0x55e88c6163d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.725+0000 7f1906334640 1 --2- 172.21.15.19:0/1649278599 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e88c60bdb0 0x55e88c6163d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.725+0000 7f1906334640 1 -- 172.21.15.19:0/1649278599 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e88c611780 msgr2=0x55e88c628970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.725+0000 7f1906334640 1 --2- 172.21.15.19:0/1649278599 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e88c611780 0x55e88c628970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.725+0000 7f1906334640 1 -- 172.21.15.19:0/1649278599 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e88c615af0 con 0x55e88c60c6f0 2024-09-19T09:03:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.725+0000 7f1906334640 1 --2- 172.21.15.19:0/1649278599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e88c60c6f0 0x55e88c61d4f0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f18f0005fd0 tx=0x7f18f0005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bf22c67a0ba7ccb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:28.730 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.726+0000 7f18e7fff640 1 -- 172.21.15.19:0/1649278599 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f0003b70 con 0x55e88c60c6f0 2024-09-19T09:03:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.726+0000 7f18e7fff640 1 -- 172.21.15.19:0/1649278599 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18f0003d10 con 0x55e88c60c6f0 2024-09-19T09:03:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.726+0000 7f18e7fff640 1 -- 172.21.15.19:0/1649278599 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f0027b50 con 0x55e88c60c6f0 2024-09-19T09:03:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.726+0000 7f190b413740 1 -- 172.21.15.19:0/1649278599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e88c60c6f0 msgr2=0x55e88c61d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.726+0000 7f190b413740 1 --2- 172.21.15.19:0/1649278599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e88c60c6f0 0x55e88c61d4f0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f18f0005fd0 tx=0x7f18f0005040 comp rx=0 tx=0).stop 2024-09-19T09:03:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.726+0000 7f190b413740 1 -- 172.21.15.19:0/1649278599 shutdown_connections 2024-09-19T09:03:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.726+0000 7f190b413740 1 --2- 172.21.15.19:0/1649278599 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e88c611780 0x55e88c628970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.726+0000 7f190b413740 1 --2- 172.21.15.19:0/1649278599 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e88c60c6f0 0x55e88c61d4f0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.726+0000 7f190b413740 1 --2- 172.21.15.19:0/1649278599 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e88c60bdb0 0x55e88c6163d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.726+0000 7f190b413740 1 -- 172.21.15.19:0/1649278599 >> 172.21.15.19:0/1649278599 conn(0x55e88c603010 msgr2=0x55e88c6046e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.726+0000 7f190b413740 1 -- 172.21.15.19:0/1649278599 shutdown_connections 2024-09-19T09:03:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.726+0000 7f190b413740 1 -- 172.21.15.19:0/1649278599 wait complete. 2024-09-19T09:03:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.727+0000 7f190b413740 1 -- start start 2024-09-19T09:03:28.731 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.727+0000 7f190b413740 1 Processor -- start 2024-09-19T09:03:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.727+0000 7f190b413740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e88c60bdb0 0x55e88c61b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.727+0000 7f190b413740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e88c60c6f0 0x55e88c61b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.727+0000 7f190b413740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e88c611780 0x55e88c61c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.727+0000 7f190b413740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f19001a81a0 con 0x55e88c60bdb0 2024-09-19T09:03:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.727+0000 7f190b413740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f19001a7ad0 con 0x55e88c611780 2024-09-19T09:03:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.727+0000 7f190b413740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f19001a4d10 con 0x55e88c60c6f0 2024-09-19T09:03:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.727+0000 7f190b413740 10 client.0 _ll_register_callbacks cb 0x7f18f4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.727+0000 7f1905b33640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e88c60bdb0 0x55e88c61b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.727+0000 7f1905b33640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e88c60bdb0 0x55e88c61b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42188/0 (socket says 172.21.15.19:42188) 2024-09-19T09:03:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.727+0000 7f1905b33640 1 -- 172.21.15.19:0/4124745460 learned_addr learned my addr 172.21.15.19:0/4124745460 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.727+0000 7f1905b33640 1 --2- 172.21.15.19:0/4124745460 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e88c611780 0x55e88c61c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.727+0000 7f1905b33640 1 -- 172.21.15.19:0/4124745460 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e88c60c6f0 msgr2=0x55e88c61b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:28.732 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.727+0000 7f1905b33640 1 --2- 172.21.15.19:0/4124745460 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e88c60c6f0 0x55e88c61b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.727+0000 7f1905b33640 1 -- 172.21.15.19:0/4124745460 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e88c611780 msgr2=0x55e88c61c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.727+0000 7f1905b33640 1 --2- 172.21.15.19:0/4124745460 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e88c611780 0x55e88c61c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.727+0000 7f1905b33640 1 -- 172.21.15.19:0/4124745460 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e88c61cff0 con 0x55e88c60bdb0 2024-09-19T09:03:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.728+0000 7f1905b33640 1 --2- 172.21.15.19:0/4124745460 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e88c60bdb0 0x55e88c61b490 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f18f4000c00 tx=0x7f18f4005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a6959b32b5b358b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.728+0000 7f18e5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.728+0000 7f18e5ffb640 1 -- 172.21.15.19:0/4124745460 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18f4035040 con 0x55e88c60bdb0 2024-09-19T09:03:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.728+0000 7f18e5ffb640 1 -- 172.21.15.19:0/4124745460 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f18f4031bd0 con 0x55e88c60bdb0 2024-09-19T09:03:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.728+0000 7f190b413740 1 -- 172.21.15.19:0/4124745460 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18f0003d10 con 0x55e88c60bdb0 2024-09-19T09:03:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.728+0000 7f18e5ffb640 1 -- 172.21.15.19:0/4124745460 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f18f4009520 con 0x55e88c60bdb0 2024-09-19T09:03:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.728+0000 7f190b413740 10 client.18153 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.728+0000 7f190b413740 1 -- 172.21.15.19:0/4124745460 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55e88c68d210 con 0x55e88c60bdb0 2024-09-19T09:03:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.728+0000 7f18e5ffb640 1 -- 172.21.15.19:0/4124745460 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18f0003d10 con 0x55e88c60bdb0 2024-09-19T09:03:28.733 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.728+0000 7f18e5ffb640 1 -- 172.21.15.19:0/4124745460 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f18f403a040 con 0x55e88c60bdb0 2024-09-19T09:03:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.728+0000 7f190b413740 10 client.18153 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.728+0000 7f190b413740 10 client.18153 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.728+0000 7f190b413740 20 client.18153 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.728+0000 7f190b413740 1 --2- 172.21.15.19:0/4124745460 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e88c68dba0 0x55e88c68ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.728+0000 7f190b413740 4 client.18153 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:03:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.728+0000 7f190b413740 1 -- 172.21.15.19:0/4124745460 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e88c572d70 con 0x55e88c68dba0 2024-09-19T09:03:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.729+0000 7f1906334640 1 --2- 172.21.15.19:0/4124745460 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e88c68dba0 0x55e88c68ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.729+0000 7f1906334640 1 --2- 172.21.15.19:0/4124745460 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e88c68dba0 0x55e88c68ffc0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6060b70559cf9fc server_cookie=4bfc9d803b9f5b8a in_seq=0 out_seq=0 2024-09-19T09:03:28.734 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.729+0000 7f18e5ffb640 10 client.18153 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:28.755 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.755+0000 7f18e5ffb640 1 -- 172.21.15.19:0/4124745460 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e88c572d70 con 0x55e88c68dba0 2024-09-19T09:03:28.755 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.755+0000 7f18e5ffb640 10 client.18153 handle_command_reply: tid=0 2024-09-19T09:03:28.755 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.755+0000 7f190b413740 1 client.18153 shutdown 2024-09-19T09:03:28.755 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.755+0000 7f190b413740 1 -- 172.21.15.19:0/4124745460 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e88c60bdb0 msgr2=0x55e88c61b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:28.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.755+0000 7f190b413740 1 --2- 172.21.15.19:0/4124745460 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e88c60bdb0 0x55e88c61b490 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f18f4000c00 tx=0x7f18f4005fd0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.755+0000 7f190b413740 1 -- 172.21.15.19:0/4124745460 shutdown_connections 2024-09-19T09:03:28.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.755+0000 7f190b413740 1 --2- 172.21.15.19:0/4124745460 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55e88c68dba0 0x55e88c68ffc0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.755+0000 7f190b413740 1 --2- 172.21.15.19:0/4124745460 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e88c60c6f0 0x55e88c61b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.755+0000 7f190b413740 1 --2- 172.21.15.19:0/4124745460 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e88c611780 0x55e88c61c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.755+0000 7f18e5ffb640 0 client.18153 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:28.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.755+0000 7f190b413740 1 --2- 172.21.15.19:0/4124745460 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e88c60bdb0 0x55e88c61b490 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.755+0000 7f190b413740 1 -- 172.21.15.19:0/4124745460 >> 172.21.15.19:0/4124745460 conn(0x55e88c603010 msgr2=0x55e88c603ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:28.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.755+0000 7f190b413740 1 -- 172.21.15.19:0/4124745460 shutdown_connections 2024-09-19T09:03:28.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.755+0000 7f190b413740 1 -- 172.21.15.19:0/4124745460 wait complete. 2024-09-19T09:03:28.756 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.755+0000 7f190b413740 20 client.18153 trim_cache size 0 max 16384 2024-09-19T09:03:28.757 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T09:03:28.757 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T09:03:28.757 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T09:03:28.757 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T09:03:28.758 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.756+0000 7f1908598640 1 -- 172.21.15.19:0/2088795318 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f18e80a32f0 msgr2=0x7f18e80a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:28.758 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.756+0000 7f1908598640 1 --2- 172.21.15.19:0/2088795318 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f18e80a32f0 0x7f18e80a57b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f18f80cd250 tx=0x7f18f80bd040 comp rx=0 tx=0).stop 2024-09-19T09:03:28.758 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.756+0000 7f1908598640 1 -- 172.21.15.19:0/2088795318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1900102600 msgr2=0x7f190019f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:28.758 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.756+0000 7f1908598640 1 --2- 172.21.15.19:0/2088795318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1900102600 0x7f190019f130 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f18f800d750 tx=0x7f18f800dc10 comp rx=0 tx=0).stop 2024-09-19T09:03:28.758 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.756+0000 7f1908598640 1 -- 172.21.15.19:0/2088795318 shutdown_connections 2024-09-19T09:03:28.758 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.756+0000 7f1908598640 1 --2- 172.21.15.19:0/2088795318 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f18e80a32f0 0x7f18e80a57b0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.758 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.756+0000 7f1908598640 1 --2- 172.21.15.19:0/2088795318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1900101c40 0x7f190019cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.758 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.756+0000 7f1908598640 1 --2- 172.21.15.19:0/2088795318 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1900102600 0x7f190019f130 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.758 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.756+0000 7f1908598640 1 --2- 172.21.15.19:0/2088795318 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1900100a50 0x7f190006ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:28.758 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.756+0000 7f1908598640 1 -- 172.21.15.19:0/2088795318 >> 172.21.15.19:0/2088795318 conn(0x7f19000fc1b0 msgr2=0x7f1900104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:28.759 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.756+0000 7f1908598640 1 -- 172.21.15.19:0/2088795318 shutdown_connections 2024-09-19T09:03:28.759 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:28.756+0000 7f1908598640 1 -- 172.21.15.19:0/2088795318 wait complete. 2024-09-19T09:03:29.151 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:03:29.151 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:03:29.170 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:29.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.656+0000 7ff4ac11d640 1 -- 172.21.15.19:0/890751983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4a4102570 msgr2=0x7ff4a41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:29.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.656+0000 7ff4ac11d640 1 --2- 172.21.15.19:0/890751983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4a4102570 0x7ff4a41029b0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7ff498009900 tx=0x7ff49802a480 comp rx=0 tx=0).stop 2024-09-19T09:03:29.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.657+0000 7ff4ac11d640 1 -- 172.21.15.19:0/890751983 shutdown_connections 2024-09-19T09:03:29.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.657+0000 7ff4ac11d640 1 --2- 172.21.15.19:0/890751983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4a4102ef0 0x7ff4a410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:29.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.657+0000 7ff4ac11d640 1 --2- 172.21.15.19:0/890751983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4a4102570 0x7ff4a41029b0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:29.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.657+0000 7ff4ac11d640 1 --2- 172.21.15.19:0/890751983 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff4a4100e20 0x7ff4a4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:29.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.657+0000 7ff4ac11d640 1 -- 172.21.15.19:0/890751983 >> 172.21.15.19:0/890751983 conn(0x7ff4a40fc7d0 msgr2=0x7ff4a40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:29.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.657+0000 7ff4ac11d640 1 -- 172.21.15.19:0/890751983 shutdown_connections 2024-09-19T09:03:29.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.657+0000 7ff4ac11d640 1 -- 172.21.15.19:0/890751983 wait complete. 2024-09-19T09:03:29.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.657+0000 7ff4ac11d640 1 Processor -- start 2024-09-19T09:03:29.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.658+0000 7ff4ac11d640 1 -- start start 2024-09-19T09:03:29.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.658+0000 7ff4ac11d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4a4100e20 0x7ff4a419a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:29.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.658+0000 7ff4ac11d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff4a4102570 0x7ff4a419ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:29.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.658+0000 7ff4ac11d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4a4102ef0 0x7ff4a419efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:29.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.658+0000 7ff4ac11d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a4110f80 con 0x7ff4a4100e20 2024-09-19T09:03:29.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.658+0000 7ff4ac11d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a4110e00 con 0x7ff4a4102ef0 2024-09-19T09:03:29.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.658+0000 7ff4ac11d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a4111100 con 0x7ff4a4102570 2024-09-19T09:03:29.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.658+0000 7ff4a9eb9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4a4100e20 0x7ff4a419a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:29.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.658+0000 7ff4a9eb9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4a4100e20 0x7ff4a419a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42204/0 (socket says 172.21.15.19:42204) 2024-09-19T09:03:29.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.658+0000 7ff4a9eb9640 1 -- 172.21.15.19:0/3290170972 learned_addr learned my addr 172.21.15.19:0/3290170972 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:29.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.658+0000 7ff4a96b8640 1 --2- 172.21.15.19:0/3290170972 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff4a4102570 0x7ff4a419ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:29.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.658+0000 7ff4aa6ba640 1 --2- 172.21.15.19:0/3290170972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4a4102ef0 0x7ff4a419efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:29.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.658+0000 7ff4a9eb9640 1 -- 172.21.15.19:0/3290170972 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff4a4102570 msgr2=0x7ff4a419ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:29.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.658+0000 7ff4a9eb9640 1 --2- 172.21.15.19:0/3290170972 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff4a4102570 0x7ff4a419ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:29.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.658+0000 7ff4a9eb9640 1 -- 172.21.15.19:0/3290170972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4a4102ef0 msgr2=0x7ff4a419efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:29.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.658+0000 7ff4a9eb9640 1 --2- 172.21.15.19:0/3290170972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4a4102ef0 0x7ff4a419efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:29.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.658+0000 7ff4a9eb9640 1 -- 172.21.15.19:0/3290170972 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4a419f680 con 0x7ff4a4100e20 2024-09-19T09:03:29.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.658+0000 7ff4a9eb9640 1 --2- 172.21.15.19:0/3290170972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4a4100e20 0x7ff4a419a6d0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7ff49400ea80 tx=0x7ff49400ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:29.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.659+0000 7ff4a2ffd640 1 -- 172.21.15.19:0/3290170972 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff49400ce40 con 0x7ff4a4100e20 2024-09-19T09:03:29.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.659+0000 7ff4ac11d640 1 -- 172.21.15.19:0/3290170972 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4a419f970 con 0x7ff4a4100e20 2024-09-19T09:03:29.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.659+0000 7ff4a2ffd640 1 -- 172.21.15.19:0/3290170972 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff494005020 con 0x7ff4a4100e20 2024-09-19T09:03:29.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.659+0000 7ff4a2ffd640 1 -- 172.21.15.19:0/3290170972 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff494011760 con 0x7ff4a4100e20 2024-09-19T09:03:29.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.659+0000 7ff4ac11d640 1 -- 172.21.15.19:0/3290170972 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4a41a7250 con 0x7ff4a4100e20 2024-09-19T09:03:29.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.660+0000 7ff4ac11d640 1 -- 172.21.15.19:0/3290170972 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4a4101200 con 0x7ff4a4100e20 2024-09-19T09:03:29.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.661+0000 7ff4a2ffd640 1 -- 172.21.15.19:0/3290170972 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7ff4940051d0 con 0x7ff4a4100e20 2024-09-19T09:03:29.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.661+0000 7ff4a2ffd640 1 --2- 172.21.15.19:0/3290170972 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff48c0a3240 0x7ff48c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:29.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.662+0000 7ff4a2ffd640 1 -- 172.21.15.19:0/3290170972 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7ff4940d0040 con 0x7ff4a4100e20 2024-09-19T09:03:29.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.662+0000 7ff4a96b8640 1 --2- 172.21.15.19:0/3290170972 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff48c0a3240 0x7ff48c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:29.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.662+0000 7ff4a96b8640 1 --2- 172.21.15.19:0/3290170972 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff48c0a3240 0x7ff48c0a5700 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4104c20 tx=0x7ff498005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:29.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.665+0000 7ff4a2ffd640 1 -- 172.21.15.19:0/3290170972 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff494016030 con 0x7ff4a4100e20 2024-09-19T09:03:29.714 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:29.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.884+0000 7ff4ac11d640 1 -- 172.21.15.19:0/3290170972 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff4a41a7420 con 0x7ff4a4100e20 2024-09-19T09:03:29.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.885+0000 7ff4a2ffd640 1 -- 172.21.15.19:0/3290170972 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+11983 (secure 0 0 0) 0x7ff49409cd70 con 0x7ff4a4100e20 2024-09-19T09:03:29.885 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T09:03:29.886 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":39,"btime":"2024-09-19T09:02:47:631181+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":17751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/3815927080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":3815927080},{"type":"v1","addr":"172.21.15.19:6839","nonce":3815927080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":39,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T09:02:47.631165+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26453":{"gid":26453,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/3907362737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3907362737},{"type":"v1","addr":"172.21.15.155:6835","nonce":3907362737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24469,24490,24464,24463]},"id":1}]} 2024-09-19T09:03:29.886 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 39 2024-09-19T09:03:29.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.887+0000 7ff4ac11d640 1 -- 172.21.15.19:0/3290170972 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff48c0a3240 msgr2=0x7ff48c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:29.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.887+0000 7ff4ac11d640 1 --2- 172.21.15.19:0/3290170972 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff48c0a3240 0x7ff48c0a5700 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4104c20 tx=0x7ff498005a20 comp rx=0 tx=0).stop 2024-09-19T09:03:29.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.887+0000 7ff4ac11d640 1 -- 172.21.15.19:0/3290170972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4a4100e20 msgr2=0x7ff4a419a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:29.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.887+0000 7ff4ac11d640 1 --2- 172.21.15.19:0/3290170972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4a4100e20 0x7ff4a419a6d0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7ff49400ea80 tx=0x7ff49400ef40 comp rx=0 tx=0).stop 2024-09-19T09:03:29.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.888+0000 7ff4ac11d640 1 -- 172.21.15.19:0/3290170972 shutdown_connections 2024-09-19T09:03:29.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.888+0000 7ff4ac11d640 1 --2- 172.21.15.19:0/3290170972 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff48c0a3240 0x7ff48c0a5700 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:29.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.888+0000 7ff4ac11d640 1 --2- 172.21.15.19:0/3290170972 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff4a4102570 0x7ff4a419ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:29.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.888+0000 7ff4ac11d640 1 --2- 172.21.15.19:0/3290170972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff4a4102ef0 0x7ff4a419efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:29.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.888+0000 7ff4ac11d640 1 --2- 172.21.15.19:0/3290170972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff4a4100e20 0x7ff4a419a6d0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:29.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.888+0000 7ff4ac11d640 1 -- 172.21.15.19:0/3290170972 >> 172.21.15.19:0/3290170972 conn(0x7ff4a40fc7d0 msgr2=0x7ff4a406a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:29.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.888+0000 7ff4ac11d640 1 -- 172.21.15.19:0/3290170972 shutdown_connections 2024-09-19T09:03:29.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:29.888+0000 7ff4ac11d640 1 -- 172.21.15.19:0/3290170972 wait complete. 2024-09-19T09:03:30.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:29 smithi155 ceph-mon[34921]: pgmap v677: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-09-19T09:03:30.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:29 smithi203 ceph-mon[35450]: pgmap v677: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-09-19T09:03:30.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:29 smithi019 ceph-mon[30976]: pgmap v677: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-09-19T09:03:30.640 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0' 2024-09-19T09:03:30.640 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db / --timeout 90 --expiration 150.0 --await-for 45.0 2024-09-19T09:03:30.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.869+0000 7f720402b640 1 -- 172.21.15.19:0/1743898247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71fc102570 msgr2=0x7f71fc1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:30.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.869+0000 7f720402b640 1 --2- 172.21.15.19:0/1743898247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71fc102570 0x7f71fc1029b0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f71ec009900 tx=0x7f71ec02a480 comp rx=0 tx=0).stop 2024-09-19T09:03:30.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.869+0000 7f720402b640 1 -- 172.21.15.19:0/1743898247 shutdown_connections 2024-09-19T09:03:30.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.869+0000 7f720402b640 1 --2- 172.21.15.19:0/1743898247 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71fc102ef0 0x7f71fc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:30.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.869+0000 7f720402b640 1 --2- 172.21.15.19:0/1743898247 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71fc102570 0x7f71fc1029b0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:30.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.869+0000 7f720402b640 1 --2- 172.21.15.19:0/1743898247 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71fc100e20 0x7f71fc101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:30.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.869+0000 7f720402b640 1 -- 172.21.15.19:0/1743898247 >> 172.21.15.19:0/1743898247 conn(0x7f71fc0fc7d0 msgr2=0x7f71fc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:30.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.869+0000 7f720402b640 1 -- 172.21.15.19:0/1743898247 shutdown_connections 2024-09-19T09:03:30.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.869+0000 7f720402b640 1 -- 172.21.15.19:0/1743898247 wait complete. 2024-09-19T09:03:30.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.870+0000 7f720402b640 1 Processor -- start 2024-09-19T09:03:30.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.870+0000 7f720402b640 1 -- start start 2024-09-19T09:03:30.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.870+0000 7f720402b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71fc100e20 0x7f71fc0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:30.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.870+0000 7f720402b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71fc102570 0x7f71fc0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:30.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.870+0000 7f720402b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71fc102ef0 0x7f71fc0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:30.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.870+0000 7f720402b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f71fc110f80 con 0x7f71fc102570 2024-09-19T09:03:30.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.870+0000 7f720402b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f71fc110e00 con 0x7f71fc100e20 2024-09-19T09:03:30.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.870+0000 7f720402b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f71fc111100 con 0x7f71fc102ef0 2024-09-19T09:03:30.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.870+0000 7f72015c6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71fc102570 0x7f71fc0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:30.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.871+0000 7f72015c6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71fc102570 0x7f71fc0fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42220/0 (socket says 172.21.15.19:42220) 2024-09-19T09:03:30.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.871+0000 7f72015c6640 1 -- 172.21.15.19:0/2670901467 learned_addr learned my addr 172.21.15.19:0/2670901467 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:30.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.871+0000 7f7201dc7640 1 --2- 172.21.15.19:0/2670901467 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71fc100e20 0x7f71fc0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:30.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.871+0000 7f72025c8640 1 --2- 172.21.15.19:0/2670901467 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71fc102ef0 0x7f71fc0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:30.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.871+0000 7f72015c6640 1 -- 172.21.15.19:0/2670901467 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71fc102ef0 msgr2=0x7f71fc0fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:30.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.871+0000 7f72015c6640 1 --2- 172.21.15.19:0/2670901467 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71fc102ef0 0x7f71fc0fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:30.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.871+0000 7f72015c6640 1 -- 172.21.15.19:0/2670901467 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71fc100e20 msgr2=0x7f71fc0fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:30.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.871+0000 7f72015c6640 1 --2- 172.21.15.19:0/2670901467 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71fc100e20 0x7f71fc0fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:30.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.871+0000 7f72015c6640 1 -- 172.21.15.19:0/2670901467 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71fc1a6990 con 0x7f71fc102570 2024-09-19T09:03:30.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.871+0000 7f72015c6640 1 --2- 172.21.15.19:0/2670901467 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71fc102570 0x7f71fc0fd1c0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f71ec006010 tx=0x7f71ec003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:30.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.871+0000 7f71f2ffd640 1 -- 172.21.15.19:0/2670901467 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ec03f070 con 0x7f71fc102570 2024-09-19T09:03:30.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.871+0000 7f720402b640 1 -- 172.21.15.19:0/2670901467 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71fc1a6c20 con 0x7f71fc102570 2024-09-19T09:03:30.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.871+0000 7f71f2ffd640 1 -- 172.21.15.19:0/2670901467 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f71ec031c30 con 0x7f71fc102570 2024-09-19T09:03:30.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.871+0000 7f71f2ffd640 1 -- 172.21.15.19:0/2670901467 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ec035030 con 0x7f71fc102570 2024-09-19T09:03:30.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.871+0000 7f720402b640 1 -- 172.21.15.19:0/2670901467 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71fc1a7150 con 0x7f71fc102570 2024-09-19T09:03:30.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.873+0000 7f720402b640 1 -- 172.21.15.19:0/2670901467 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71fc101200 con 0x7f71fc102570 2024-09-19T09:03:30.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.874+0000 7f71f2ffd640 1 -- 172.21.15.19:0/2670901467 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f71ec042070 con 0x7f71fc102570 2024-09-19T09:03:30.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.875+0000 7f71f2ffd640 1 --2- 172.21.15.19:0/2670901467 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f71e80a3240 0x7f71e80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:30.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.875+0000 7f7201dc7640 1 --2- 172.21.15.19:0/2670901467 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f71e80a3240 0x7f71e80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:30.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.875+0000 7f71f2ffd640 1 -- 172.21.15.19:0/2670901467 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f71ec0eff60 con 0x7f71fc102570 2024-09-19T09:03:30.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.876+0000 7f7201dc7640 1 --2- 172.21.15.19:0/2670901467 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f71e80a3240 0x7f71e80a5700 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f71f80058c0 tx=0x7f71f800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:30.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:30.880+0000 7f71f2ffd640 1 -- 172.21.15.19:0/2670901467 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f71ec0bc640 con 0x7f71fc102570 2024-09-19T09:03:30.974 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:31.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:30 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3290170972' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:31.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:31.111+0000 7f720402b640 1 -- 172.21.15.19:0/2670901467 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f71fc10a0a0 con 0x7f71fc102570 2024-09-19T09:03:31.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:31.112+0000 7f71f2ffd640 1 -- 172.21.15.19:0/2670901467 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+11983 (secure 0 0 0) 0x7f71ec0b8070 con 0x7f71fc102570 2024-09-19T09:03:31.112 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T09:03:31.112 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":39,"btime":"2024-09-19T09:02:47:631181+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":17751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/3815927080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":3815927080},{"type":"v1","addr":"172.21.15.19:6839","nonce":3815927080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":39,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T09:02:47.631165+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26453":{"gid":26453,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/3907362737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3907362737},{"type":"v1","addr":"172.21.15.155:6835","nonce":3907362737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24469,24490,24464,24463]},"id":1}]} 2024-09-19T09:03:31.112 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 39 2024-09-19T09:03:31.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:31.114+0000 7f720402b640 1 -- 172.21.15.19:0/2670901467 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f71e80a3240 msgr2=0x7f71e80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:31.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:31.114+0000 7f720402b640 1 --2- 172.21.15.19:0/2670901467 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f71e80a3240 0x7f71e80a5700 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f71f80058c0 tx=0x7f71f800a2d0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:31.114+0000 7f720402b640 1 -- 172.21.15.19:0/2670901467 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71fc102570 msgr2=0x7f71fc0fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:31.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:31.114+0000 7f720402b640 1 --2- 172.21.15.19:0/2670901467 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71fc102570 0x7f71fc0fd1c0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f71ec006010 tx=0x7f71ec003c10 comp rx=0 tx=0).stop 2024-09-19T09:03:31.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:31.114+0000 7f720402b640 1 -- 172.21.15.19:0/2670901467 shutdown_connections 2024-09-19T09:03:31.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:31.114+0000 7f720402b640 1 --2- 172.21.15.19:0/2670901467 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f71e80a3240 0x7f71e80a5700 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:31.114+0000 7f720402b640 1 --2- 172.21.15.19:0/2670901467 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f71fc102ef0 0x7f71fc0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:31.114+0000 7f720402b640 1 --2- 172.21.15.19:0/2670901467 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f71fc102570 0x7f71fc0fd1c0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:31.114+0000 7f720402b640 1 --2- 172.21.15.19:0/2670901467 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f71fc100e20 0x7f71fc0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:31.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:31.114+0000 7f720402b640 1 -- 172.21.15.19:0/2670901467 >> 172.21.15.19:0/2670901467 conn(0x7f71fc0fc7d0 msgr2=0x7f71fc06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:31.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:31.114+0000 7f720402b640 1 -- 172.21.15.19:0/2670901467 shutdown_connections 2024-09-19T09:03:31.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:31.114+0000 7f720402b640 1 -- 172.21.15.19:0/2670901467 wait complete. 2024-09-19T09:03:31.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:30 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3290170972' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:31.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:30 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3290170972' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:31.950 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T09:03:32.112 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:31 smithi019 ceph-mon[30976]: pgmap v678: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 2.0 KiB/s wr, 15 op/s 2024-09-19T09:03:32.112 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:31 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/2670901467' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:32.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.114+0000 7f49ba99e640 1 -- 172.21.15.19:0/896524450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49b4102df0 msgr2=0x7f49b41031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:32.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.114+0000 7f49ba99e640 1 --2- 172.21.15.19:0/896524450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49b4102df0 0x7f49b41031d0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f49a4009900 tx=0x7f49a402a410 comp rx=0 tx=0).stop 2024-09-19T09:03:32.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.114+0000 7f49ba99e640 1 -- 172.21.15.19:0/896524450 shutdown_connections 2024-09-19T09:03:32.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.114+0000 7f49ba99e640 1 --2- 172.21.15.19:0/896524450 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49b41037a0 0x7f49b410bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.114+0000 7f49ba99e640 1 --2- 172.21.15.19:0/896524450 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49b410c2f0 0x7f49b410e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.114+0000 7f49ba99e640 1 --2- 172.21.15.19:0/896524450 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49b4102df0 0x7f49b41031d0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.114+0000 7f49ba99e640 1 -- 172.21.15.19:0/896524450 >> 172.21.15.19:0/896524450 conn(0x7f49b40fc7d0 msgr2=0x7f49b40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:32.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.114+0000 7f49ba99e640 1 -- 172.21.15.19:0/896524450 shutdown_connections 2024-09-19T09:03:32.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.114+0000 7f49ba99e640 1 -- 172.21.15.19:0/896524450 wait complete. 2024-09-19T09:03:32.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.115+0000 7f49ba99e640 1 Processor -- start 2024-09-19T09:03:32.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.115+0000 7f49ba99e640 1 -- start start 2024-09-19T09:03:32.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.115+0000 7f49ba99e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49b4102df0 0x7f49b4100a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:32.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.115+0000 7f49ba99e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49b41037a0 0x7f49b4100f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:32.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.115+0000 7f49ba99e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49b410c2f0 0x7f49b41014d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:32.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.115+0000 7f49ba99e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f49b4112140 con 0x7f49b41037a0 2024-09-19T09:03:32.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.115+0000 7f49ba99e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f49b4111fc0 con 0x7f49b410c2f0 2024-09-19T09:03:32.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.115+0000 7f49ba99e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f49b41122c0 con 0x7f49b4102df0 2024-09-19T09:03:32.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.115+0000 7f49b37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49b41037a0 0x7f49b4100f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:32.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.115+0000 7f49b37fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49b41037a0 0x7f49b4100f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42252/0 (socket says 172.21.15.19:42252) 2024-09-19T09:03:32.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.115+0000 7f49b3fff640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49b4102df0 0x7f49b4100a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:32.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.115+0000 7f49b37fe640 1 -- 172.21.15.19:0/161288415 learned_addr learned my addr 172.21.15.19:0/161288415 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:32.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.115+0000 7f49b8f3b640 1 --2- 172.21.15.19:0/161288415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49b410c2f0 0x7f49b41014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:32.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.116+0000 7f49b37fe640 1 -- 172.21.15.19:0/161288415 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49b4102df0 msgr2=0x7f49b4100a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:32.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.116+0000 7f49b37fe640 1 --2- 172.21.15.19:0/161288415 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49b4102df0 0x7f49b4100a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.116+0000 7f49b37fe640 1 -- 172.21.15.19:0/161288415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49b410c2f0 msgr2=0x7f49b41014d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:32.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.116+0000 7f49b37fe640 1 --2- 172.21.15.19:0/161288415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49b410c2f0 0x7f49b41014d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.116+0000 7f49b37fe640 1 -- 172.21.15.19:0/161288415 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49b41a6b00 con 0x7f49b41037a0 2024-09-19T09:03:32.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.116+0000 7f49b37fe640 1 --2- 172.21.15.19:0/161288415 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49b41037a0 0x7f49b4100f90 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f49a800d740 tx=0x7f49a800db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:32.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.116+0000 7f49b17fa640 1 -- 172.21.15.19:0/161288415 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a8017070 con 0x7f49b41037a0 2024-09-19T09:03:32.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.116+0000 7f49ba99e640 1 -- 172.21.15.19:0/161288415 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49b41a6df0 con 0x7f49b41037a0 2024-09-19T09:03:32.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.116+0000 7f49b17fa640 1 -- 172.21.15.19:0/161288415 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49a8010460 con 0x7f49b41037a0 2024-09-19T09:03:32.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.117+0000 7f49b17fa640 1 -- 172.21.15.19:0/161288415 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a800f620 con 0x7f49b41037a0 2024-09-19T09:03:32.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.117+0000 7f49ba99e640 1 -- 172.21.15.19:0/161288415 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49b41a72f0 con 0x7f49b41037a0 2024-09-19T09:03:32.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.119+0000 7f49bcd77740 1 Processor -- start 2024-09-19T09:03:32.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.120+0000 7f49bcd77740 1 -- start start 2024-09-19T09:03:32.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.120+0000 7f49b17fa640 1 -- 172.21.15.19:0/161288415 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f49a801a070 con 0x7f49b41037a0 2024-09-19T09:03:32.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.120+0000 7f49bcd77740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619eafb3760 0x5619eafb3b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:32.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.120+0000 7f49bcd77740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619eafb4080 0x5619eafbe400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:32.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.120+0000 7f49bcd77740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619eafbe940 0x5619eafc0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:32.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.120+0000 7f49bcd77740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5619eaf192a0 con 0x5619eafb4080 2024-09-19T09:03:32.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.120+0000 7f49bcd77740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5619eaec0b10 con 0x5619eafbe940 2024-09-19T09:03:32.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.120+0000 7f49bcd77740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5619eaf15260 con 0x5619eafb3760 2024-09-19T09:03:32.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.120+0000 7f49b3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619eafb4080 0x5619eafbe400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:32.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.120+0000 7f49b3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619eafb4080 0x5619eafbe400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42254/0 (socket says 172.21.15.19:42254) 2024-09-19T09:03:32.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.120+0000 7f49b3fff640 1 -- 172.21.15.19:0/2069453260 learned_addr learned my addr 172.21.15.19:0/2069453260 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:32.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.120+0000 7f49b8f3b640 1 --2- 172.21.15.19:0/2069453260 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619eafb3760 0x5619eafb3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:32.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.120+0000 7f49b3fff640 1 -- 172.21.15.19:0/2069453260 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619eafb3760 msgr2=0x5619eafb3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:32.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.120+0000 7f49b3fff640 1 --2- 172.21.15.19:0/2069453260 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619eafb3760 0x5619eafb3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.120+0000 7f49b3fff640 1 -- 172.21.15.19:0/2069453260 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619eafbe940 msgr2=0x5619eafc0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:32.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.120+0000 7f49b3fff640 1 --2- 172.21.15.19:0/2069453260 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619eafbe940 0x5619eafc0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.120+0000 7f49b3fff640 1 -- 172.21.15.19:0/2069453260 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619eac8ab90 con 0x5619eafb4080 2024-09-19T09:03:32.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.120+0000 7f49b8f3b640 1 --2- 172.21.15.19:0/2069453260 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619eafb3760 0x5619eafb3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:32.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.121+0000 7f49b17fa640 1 --2- 172.21.15.19:0/161288415 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f499c0a32c0 0x7f499c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:32.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.121+0000 7f49b3fff640 1 --2- 172.21.15.19:0/2069453260 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619eafb4080 0x5619eafbe400 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f49a4009900 tx=0x7f49a4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61108e9e87c60120 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:32.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.121+0000 7f49b8f3b640 1 --2- 172.21.15.19:0/161288415 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f499c0a32c0 0x7f499c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:32.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.121+0000 7f49b17fa640 1 -- 172.21.15.19:0/161288415 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f49a80cf1d0 con 0x7f49b41037a0 2024-09-19T09:03:32.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.121+0000 7f499a7fc640 1 -- 172.21.15.19:0/2069453260 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a4035040 con 0x5619eafb4080 2024-09-19T09:03:32.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.121+0000 7f499a7fc640 1 -- 172.21.15.19:0/2069453260 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49a4005520 con 0x5619eafb4080 2024-09-19T09:03:32.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.121+0000 7f499a7fc640 1 -- 172.21.15.19:0/2069453260 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a4003850 con 0x5619eafb4080 2024-09-19T09:03:32.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.122+0000 7f49bcd77740 1 -- 172.21.15.19:0/2069453260 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619eafb4080 msgr2=0x5619eafbe400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:32.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.122+0000 7f49b8f3b640 1 --2- 172.21.15.19:0/161288415 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f499c0a32c0 0x7f499c0a5780 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f49ac005fd0 tx=0x7f49ac009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:32.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.122+0000 7f49bcd77740 1 --2- 172.21.15.19:0/2069453260 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619eafb4080 0x5619eafbe400 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f49a4009900 tx=0x7f49a4004040 comp rx=0 tx=0).stop 2024-09-19T09:03:32.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.122+0000 7f49bcd77740 1 -- 172.21.15.19:0/2069453260 shutdown_connections 2024-09-19T09:03:32.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.122+0000 7f49bcd77740 1 --2- 172.21.15.19:0/2069453260 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619eafbe940 0x5619eafc0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.122+0000 7f49bcd77740 1 --2- 172.21.15.19:0/2069453260 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619eafb4080 0x5619eafbe400 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.122+0000 7f49bcd77740 1 --2- 172.21.15.19:0/2069453260 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619eafb3760 0x5619eafb3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.122+0000 7f49bcd77740 1 -- 172.21.15.19:0/2069453260 >> 172.21.15.19:0/2069453260 conn(0x5619eafafcf0 msgr2=0x5619eafb00d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:32.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.122+0000 7f49bcd77740 1 -- 172.21.15.19:0/2069453260 shutdown_connections 2024-09-19T09:03:32.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.122+0000 7f49bcd77740 1 -- 172.21.15.19:0/2069453260 wait complete. 2024-09-19T09:03:32.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.122+0000 7f49bcd77740 1 -- start start 2024-09-19T09:03:32.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.123+0000 7f49bcd77740 1 Processor -- start 2024-09-19T09:03:32.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.123+0000 7f49bcd77740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619eafb3760 0x5619eafbb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:32.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.123+0000 7f49bcd77740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619eafb4080 0x5619eafbbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:32.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.123+0000 7f49bcd77740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619eafbe940 0x5619eafbc390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:32.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.123+0000 7f49bcd77740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5619eafc1510 con 0x5619eafb3760 2024-09-19T09:03:32.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.123+0000 7f49bcd77740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5619eaea16e0 con 0x5619eafbe940 2024-09-19T09:03:32.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.123+0000 7f49bcd77740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5619eafc1690 con 0x5619eafb4080 2024-09-19T09:03:32.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.123+0000 7f49bcd77740 10 client.0 _ll_register_callbacks cb 0x5619eaec5a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:32.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.123+0000 7f49b3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619eafb3760 0x5619eafbb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:32.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.123+0000 7f49b3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619eafb3760 0x5619eafbb910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42264/0 (socket says 172.21.15.19:42264) 2024-09-19T09:03:32.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.123+0000 7f49b3fff640 1 -- 172.21.15.19:0/2775190973 learned_addr learned my addr 172.21.15.19:0/2775190973 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:32.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.124+0000 7f49b8f3b640 1 --2- 172.21.15.19:0/2775190973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619eafbe940 0x5619eafbc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:32.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.124+0000 7f49b37fe640 1 --2- 172.21.15.19:0/2775190973 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619eafb4080 0x5619eafbbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:32.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.124+0000 7f49b3fff640 1 -- 172.21.15.19:0/2775190973 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619eafb4080 msgr2=0x5619eafbbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:32.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.124+0000 7f49b3fff640 1 --2- 172.21.15.19:0/2775190973 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619eafb4080 0x5619eafbbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.124+0000 7f49b3fff640 1 -- 172.21.15.19:0/2775190973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619eafbe940 msgr2=0x5619eafbc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:32.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.124+0000 7f49b3fff640 1 --2- 172.21.15.19:0/2775190973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619eafbe940 0x5619eafbc390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.124+0000 7f49b3fff640 1 -- 172.21.15.19:0/2775190973 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619eafcab20 con 0x5619eafb3760 2024-09-19T09:03:32.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.124+0000 7f49b8f3b640 1 --2- 172.21.15.19:0/2775190973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619eafbe940 0x5619eafbc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:32.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.124+0000 7f49b3fff640 1 --2- 172.21.15.19:0/2775190973 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619eafb3760 0x5619eafbb910 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f49a4004520 tx=0x7f49a402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d15afbbf1322e972 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:32.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.124+0000 7f49937fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:32.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.124+0000 7f49937fe640 1 -- 172.21.15.19:0/2775190973 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a4035050 con 0x5619eafb3760 2024-09-19T09:03:32.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.124+0000 7f49937fe640 1 -- 172.21.15.19:0/2775190973 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f49a4004e60 con 0x5619eafb3760 2024-09-19T09:03:32.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.124+0000 7f49bcd77740 1 -- 172.21.15.19:0/2775190973 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49a4005520 con 0x5619eafb3760 2024-09-19T09:03:32.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.125+0000 7f49937fe640 1 -- 172.21.15.19:0/2775190973 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f49a4009520 con 0x5619eafb3760 2024-09-19T09:03:32.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.125+0000 7f49bcd77740 10 client.18177 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:32.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.125+0000 7f49bcd77740 1 -- 172.21.15.19:0/2775190973 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5619eafcd490 con 0x5619eafb3760 2024-09-19T09:03:32.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.125+0000 7f49937fe640 1 -- 172.21.15.19:0/2775190973 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49a4005520 con 0x5619eafb3760 2024-09-19T09:03:32.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.125+0000 7f49937fe640 1 -- 172.21.15.19:0/2775190973 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f49a4003b40 con 0x5619eafb3760 2024-09-19T09:03:32.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.125+0000 7f49bcd77740 10 client.18177 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:32.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.125+0000 7f49bcd77740 10 client.18177 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:03:32.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.125+0000 7f49bcd77740 20 client.18177 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:32.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.125+0000 7f49bcd77740 1 --2- 172.21.15.19:0/2775190973 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5619eafce7e0 0x5619eafd0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:32.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.125+0000 7f49bcd77740 4 client.18177 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:32.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.125+0000 7f49bcd77740 1 -- 172.21.15.19:0/2775190973 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5619eaf269d0 con 0x5619eafce7e0 2024-09-19T09:03:32.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.125+0000 7f49b37fe640 1 --2- 172.21.15.19:0/2775190973 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5619eafce7e0 0x5619eafd0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:32.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.126+0000 7f49937fe640 10 client.18177 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:32.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.126+0000 7f49b37fe640 1 --2- 172.21.15.19:0/2775190973 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5619eafce7e0 0x5619eafd0bd0 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7927e69670b4013 server_cookie=744d5b15b3fa55e7 in_seq=0 out_seq=0 2024-09-19T09:03:32.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.126+0000 7f49937fe640 1 -- 172.21.15.19:0/2775190973 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5619eaf269d0 con 0x5619eafce7e0 2024-09-19T09:03:32.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.126+0000 7f49937fe640 10 client.18177 handle_command_reply: tid=0 2024-09-19T09:03:32.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.126+0000 7f49bcd77740 1 client.18177 shutdown 2024-09-19T09:03:32.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.127+0000 7f49bcd77740 1 -- 172.21.15.19:0/2775190973 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619eafb3760 msgr2=0x5619eafbb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:32.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.127+0000 7f49bcd77740 1 --2- 172.21.15.19:0/2775190973 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619eafb3760 0x5619eafbb910 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f49a4004520 tx=0x7f49a402a410 comp rx=0 tx=0).stop 2024-09-19T09:03:32.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.127+0000 7f49bcd77740 1 -- 172.21.15.19:0/2775190973 shutdown_connections 2024-09-19T09:03:32.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.127+0000 7f49bcd77740 1 --2- 172.21.15.19:0/2775190973 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5619eafce7e0 0x5619eafd0bd0 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.127+0000 7f49bcd77740 1 --2- 172.21.15.19:0/2775190973 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619eafb4080 0x5619eafbbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.127+0000 7f49bcd77740 1 --2- 172.21.15.19:0/2775190973 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619eafbe940 0x5619eafbc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.127+0000 7f49bcd77740 1 --2- 172.21.15.19:0/2775190973 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619eafb3760 0x5619eafbb910 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.127+0000 7f49bcd77740 1 -- 172.21.15.19:0/2775190973 >> 172.21.15.19:0/2775190973 conn(0x5619eafafcf0 msgr2=0x5619eafb59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:32.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.127+0000 7f49937fe640 0 client.18177 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:32.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.127+0000 7f49bcd77740 1 -- 172.21.15.19:0/2775190973 shutdown_connections 2024-09-19T09:03:32.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.127+0000 7f49bcd77740 1 -- 172.21.15.19:0/2775190973 wait complete. 2024-09-19T09:03:32.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.127+0000 7f49bcd77740 20 client.18177 trim_cache size 0 max 16384 2024-09-19T09:03:32.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.144+0000 7f49bcd77740 1 Processor -- start 2024-09-19T09:03:32.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.144+0000 7f49bcd77740 1 -- start start 2024-09-19T09:03:32.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.144+0000 7f49bcd77740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619eafb3760 0x5619eafd6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:32.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.144+0000 7f49bcd77740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619eafb4080 0x5619eafd66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:32.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.144+0000 7f49bcd77740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619eafbe940 0x5619eafb8b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:32.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.144+0000 7f49bcd77740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f49b41af710 con 0x5619eafb3760 2024-09-19T09:03:32.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.144+0000 7f49bcd77740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f49b41b1250 con 0x5619eafb4080 2024-09-19T09:03:32.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.144+0000 7f49bcd77740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f49b41afde0 con 0x5619eafbe940 2024-09-19T09:03:32.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.145+0000 7f49b3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619eafb3760 0x5619eafd6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:32.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.145+0000 7f49b3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619eafb3760 0x5619eafd6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42276/0 (socket says 172.21.15.19:42276) 2024-09-19T09:03:32.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.145+0000 7f49b3fff640 1 -- 172.21.15.19:0/2661051983 learned_addr learned my addr 172.21.15.19:0/2661051983 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:32.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.145+0000 7f49b37fe640 1 --2- 172.21.15.19:0/2661051983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619eafb4080 0x5619eafd66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:32.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.145+0000 7f49b3fff640 1 -- 172.21.15.19:0/2661051983 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619eafbe940 msgr2=0x5619eafb8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:32.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.145+0000 7f49b3fff640 1 --2- 172.21.15.19:0/2661051983 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619eafbe940 0x5619eafb8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.145+0000 7f49b3fff640 1 -- 172.21.15.19:0/2661051983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619eafb4080 msgr2=0x5619eafd66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:32.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.145+0000 7f49b3fff640 1 --2- 172.21.15.19:0/2661051983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619eafb4080 0x5619eafd66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.145+0000 7f49b3fff640 1 -- 172.21.15.19:0/2661051983 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5619eafb0e80 con 0x5619eafb3760 2024-09-19T09:03:32.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.145+0000 7f49b37fe640 1 --2- 172.21.15.19:0/2661051983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619eafb4080 0x5619eafd66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:32.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.145+0000 7f49b3fff640 1 --2- 172.21.15.19:0/2661051983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619eafb3760 0x5619eafd6170 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f49a40318b0 tx=0x7f49a4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de8b64c9a8e2788 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:32.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.145+0000 7f4999ffb640 1 -- 172.21.15.19:0/2661051983 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a405d030 con 0x5619eafb3760 2024-09-19T09:03:32.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.146+0000 7f4999ffb640 1 -- 172.21.15.19:0/2661051983 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49a4005850 con 0x5619eafb3760 2024-09-19T09:03:32.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.146+0000 7f4999ffb640 1 -- 172.21.15.19:0/2661051983 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a4035040 con 0x5619eafb3760 2024-09-19T09:03:32.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.146+0000 7f49bcd77740 1 -- 172.21.15.19:0/2661051983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619eafb3760 msgr2=0x5619eafd6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:32.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.146+0000 7f49bcd77740 1 --2- 172.21.15.19:0/2661051983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619eafb3760 0x5619eafd6170 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f49a40318b0 tx=0x7f49a4000bc0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.147+0000 7f49bcd77740 1 -- 172.21.15.19:0/2661051983 shutdown_connections 2024-09-19T09:03:32.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.147+0000 7f49bcd77740 1 --2- 172.21.15.19:0/2661051983 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619eafbe940 0x5619eafb8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.147+0000 7f49bcd77740 1 --2- 172.21.15.19:0/2661051983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619eafb4080 0x5619eafd66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.147+0000 7f49bcd77740 1 --2- 172.21.15.19:0/2661051983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619eafb3760 0x5619eafd6170 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.147+0000 7f49bcd77740 1 -- 172.21.15.19:0/2661051983 >> 172.21.15.19:0/2661051983 conn(0x5619eafafcf0 msgr2=0x5619eafb59d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:32.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.147+0000 7f49bcd77740 1 -- 172.21.15.19:0/2661051983 shutdown_connections 2024-09-19T09:03:32.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.147+0000 7f49bcd77740 1 -- 172.21.15.19:0/2661051983 wait complete. 2024-09-19T09:03:32.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.147+0000 7f49bcd77740 1 -- start start 2024-09-19T09:03:32.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.147+0000 7f49bcd77740 1 Processor -- start 2024-09-19T09:03:32.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.148+0000 7f49bcd77740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619eafb3760 0x5619eafc6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:32.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.148+0000 7f49bcd77740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619eafb4080 0x5619eafc38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:32.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.148+0000 7f49bcd77740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619eafbe940 0x5619eafc3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:32.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.148+0000 7f49bcd77740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f49b41b0b80 con 0x5619eafb3760 2024-09-19T09:03:32.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.148+0000 7f49bcd77740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f49b41b04b0 con 0x5619eafb4080 2024-09-19T09:03:32.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.148+0000 7f49bcd77740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f49b41ad6f0 con 0x5619eafbe940 2024-09-19T09:03:32.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.148+0000 7f49bcd77740 10 client.0 _ll_register_callbacks cb 0x7f49a40056d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:32.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.148+0000 7f49b3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619eafb3760 0x5619eafc6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:32.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.148+0000 7f49b3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619eafb3760 0x5619eafc6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42286/0 (socket says 172.21.15.19:42286) 2024-09-19T09:03:32.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.148+0000 7f49b37fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619eafb4080 0x5619eafc38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:32.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.148+0000 7f49b3fff640 1 -- 172.21.15.19:0/2136280185 learned_addr learned my addr 172.21.15.19:0/2136280185 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:32.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.148+0000 7f49b8f3b640 1 --2- 172.21.15.19:0/2136280185 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619eafbe940 0x5619eafc3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:32.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.148+0000 7f49b37fe640 1 -- 172.21.15.19:0/2136280185 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619eafbe940 msgr2=0x5619eafc3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:32.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.148+0000 7f49b37fe640 1 --2- 172.21.15.19:0/2136280185 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619eafbe940 0x5619eafc3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.148+0000 7f49b37fe640 1 -- 172.21.15.19:0/2136280185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619eafb3760 msgr2=0x5619eafc6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:32.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.148+0000 7f49b37fe640 1 --2- 172.21.15.19:0/2136280185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619eafb3760 0x5619eafc6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.148+0000 7f49b37fe640 1 -- 172.21.15.19:0/2136280185 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5619eafc4360 con 0x5619eafb4080 2024-09-19T09:03:32.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.148+0000 7f49b3fff640 1 --2- 172.21.15.19:0/2136280185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619eafb3760 0x5619eafc6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:32.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.148+0000 7f49b8f3b640 1 --2- 172.21.15.19:0/2136280185 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619eafbe940 0x5619eafc3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:32.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.149+0000 7f49b37fe640 1 --2- 172.21.15.19:0/2136280185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619eafb4080 0x5619eafc38e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x5619eafb1070 tx=0x7f49a8009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd38be565bd0ab80 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:32.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.149+0000 7f49937fe640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T09:03:32.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.149+0000 7f49937fe640 1 -- 172.21.15.19:0/2136280185 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a8021040 con 0x5619eafb4080 2024-09-19T09:03:32.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.149+0000 7f49937fe640 1 -- 172.21.15.19:0/2136280185 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f49a8010610 con 0x5619eafb4080 2024-09-19T09:03:32.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.149+0000 7f49bcd77740 1 -- 172.21.15.19:0/2136280185 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f49a4005850 con 0x5619eafb4080 2024-09-19T09:03:32.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.149+0000 7f49937fe640 1 -- 172.21.15.19:0/2136280185 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f49a80a4470 con 0x5619eafb4080 2024-09-19T09:03:32.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.149+0000 7f49bcd77740 10 client.27539 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:32.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.149+0000 7f49bcd77740 1 -- 172.21.15.19:0/2136280185 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5619eb039e40 con 0x5619eafb4080 2024-09-19T09:03:32.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.149+0000 7f49937fe640 1 -- 172.21.15.19:0/2136280185 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f49a80ba020 con 0x5619eafb4080 2024-09-19T09:03:32.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.150+0000 7f49937fe640 1 -- 172.21.15.19:0/2136280185 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f49a8084b50 con 0x5619eafb4080 2024-09-19T09:03:32.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.150+0000 7f49bcd77740 10 client.27539 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:32.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.150+0000 7f49bcd77740 10 client.27539 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:03:32.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.150+0000 7f49bcd77740 20 client.27539 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:32.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.150+0000 7f49bcd77740 1 --2- 172.21.15.19:0/2136280185 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5619eb03a660 0x5619eb03ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:32.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.150+0000 7f49bcd77740 4 client.27539 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}] 2024-09-19T09:03:32.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.150+0000 7f49bcd77740 1 -- 172.21.15.19:0/2136280185 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 150.0, "await_for": 45.0}) -- 0x7f49a4005850 con 0x5619eb03a660 2024-09-19T09:03:32.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.150+0000 7f49b3fff640 1 --2- 172.21.15.19:0/2136280185 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5619eb03a660 0x5619eb03ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:32.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.150+0000 7f49937fe640 10 client.27539 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:32.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.150+0000 7f49b3fff640 1 --2- 172.21.15.19:0/2136280185 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5619eb03a660 0x5619eb03ca80 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3de5a4b5e7ab8166 server_cookie=352b15bb6a93f489 in_seq=0 out_seq=0 2024-09-19T09:03:32.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.164+0000 7f49937fe640 1 -- 172.21.15.19:0/2136280185 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f49a4005850 con 0x5619eb03a660 2024-09-19T09:03:32.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.164+0000 7f49937fe640 10 client.27539 handle_command_reply: tid=0 2024-09-19T09:03:32.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.164+0000 7f49bcd77740 1 client.27539 shutdown 2024-09-19T09:03:32.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.164+0000 7f49bcd77740 1 -- 172.21.15.19:0/2136280185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619eafb4080 msgr2=0x5619eafc38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:32.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.164+0000 7f49bcd77740 1 --2- 172.21.15.19:0/2136280185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619eafb4080 0x5619eafc38e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x5619eafb1070 tx=0x7f49a8009f90 comp rx=0 tx=0).stop 2024-09-19T09:03:32.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.164+0000 7f49bcd77740 1 -- 172.21.15.19:0/2136280185 shutdown_connections 2024-09-19T09:03:32.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.164+0000 7f49bcd77740 1 --2- 172.21.15.19:0/2136280185 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5619eb03a660 0x5619eb03ca80 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.164+0000 7f49bcd77740 1 --2- 172.21.15.19:0/2136280185 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5619eafbe940 0x5619eafc3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.164+0000 7f49937fe640 0 client.27539 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:32.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.164+0000 7f49bcd77740 1 --2- 172.21.15.19:0/2136280185 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5619eafb4080 0x5619eafc38e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.164+0000 7f49bcd77740 1 --2- 172.21.15.19:0/2136280185 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5619eafb3760 0x5619eafc6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.164+0000 7f49bcd77740 1 -- 172.21.15.19:0/2136280185 >> 172.21.15.19:0/2136280185 conn(0x5619eafafcf0 msgr2=0x5619eafba0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:32.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.164+0000 7f49bcd77740 1 -- 172.21.15.19:0/2136280185 shutdown_connections 2024-09-19T09:03:32.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.164+0000 7f49bcd77740 1 -- 172.21.15.19:0/2136280185 wait complete. 2024-09-19T09:03:32.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.164+0000 7f49bcd77740 20 client.27539 trim_cache size 0 max 16384 2024-09-19T09:03:32.165 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T09:03:32.165 INFO:teuthology.orchestra.run.smithi019.stdout: "epoch": 39, 2024-09-19T09:03:32.166 INFO:teuthology.orchestra.run.smithi019.stdout: "leader": 24497, 2024-09-19T09:03:32.166 INFO:teuthology.orchestra.run.smithi019.stdout: "set_version": 38, 2024-09-19T09:03:32.166 INFO:teuthology.orchestra.run.smithi019.stdout: "sets": { 2024-09-19T09:03:32.166 INFO:teuthology.orchestra.run.smithi019.stdout: "a8b5c724": { 2024-09-19T09:03:32.166 INFO:teuthology.orchestra.run.smithi019.stdout: "version": 38, 2024-09-19T09:03:32.166 INFO:teuthology.orchestra.run.smithi019.stdout: "age_ref": 0.0, 2024-09-19T09:03:32.166 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T09:03:32.166 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "QUIESCED", 2024-09-19T09:03:32.166 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T09:03:32.166 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:03:32.166 INFO:teuthology.orchestra.run.smithi019.stdout: "timeout": 90.0, 2024-09-19T09:03:32.166 INFO:teuthology.orchestra.run.smithi019.stdout: "expiration": 150.0, 2024-09-19T09:03:32.166 INFO:teuthology.orchestra.run.smithi019.stdout: "members": { 2024-09-19T09:03:32.166 INFO:teuthology.orchestra.run.smithi019.stdout: "file:/": { 2024-09-19T09:03:32.166 INFO:teuthology.orchestra.run.smithi019.stdout: "excluded": false, 2024-09-19T09:03:32.167 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T09:03:32.167 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "QUIESCED", 2024-09-19T09:03:32.167 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T09:03:32.167 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:03:32.167 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:03:32.167 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:03:32.167 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:03:32.167 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:03:32.167 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T09:03:32.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.165+0000 7f49ba99e640 1 -- 172.21.15.19:0/161288415 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f499c0a32c0 msgr2=0x7f499c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:32.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.165+0000 7f49ba99e640 1 --2- 172.21.15.19:0/161288415 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f499c0a32c0 0x7f499c0a5780 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f49ac005fd0 tx=0x7f49ac009500 comp rx=0 tx=0).stop 2024-09-19T09:03:32.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.165+0000 7f49ba99e640 1 -- 172.21.15.19:0/161288415 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49b41037a0 msgr2=0x7f49b4100f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:32.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.165+0000 7f49ba99e640 1 --2- 172.21.15.19:0/161288415 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49b41037a0 0x7f49b4100f90 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f49a800d740 tx=0x7f49a800db40 comp rx=0 tx=0).stop 2024-09-19T09:03:32.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.165+0000 7f49ba99e640 1 -- 172.21.15.19:0/161288415 shutdown_connections 2024-09-19T09:03:32.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.165+0000 7f49ba99e640 1 --2- 172.21.15.19:0/161288415 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f499c0a32c0 0x7f499c0a5780 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.165+0000 7f49ba99e640 1 --2- 172.21.15.19:0/161288415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f49b410c2f0 0x7f49b41014d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.165+0000 7f49ba99e640 1 --2- 172.21.15.19:0/161288415 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f49b41037a0 0x7f49b4100f90 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.165+0000 7f49ba99e640 1 --2- 172.21.15.19:0/161288415 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f49b4102df0 0x7f49b4100a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:32.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.165+0000 7f49ba99e640 1 -- 172.21.15.19:0/161288415 >> 172.21.15.19:0/161288415 conn(0x7f49b40fc7d0 msgr2=0x7f49b40fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:32.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.165+0000 7f49ba99e640 1 -- 172.21.15.19:0/161288415 shutdown_connections 2024-09-19T09:03:32.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:32.165+0000 7f49ba99e640 1 -- 172.21.15.19:0/161288415 wait complete. 2024-09-19T09:03:32.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:31 smithi155 ceph-mon[34921]: pgmap v678: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 2.0 KiB/s wr, 15 op/s 2024-09-19T09:03:32.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:31 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/2670901467' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:32.231 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:31 smithi203 ceph-mon[35450]: pgmap v678: 97 pgs: 97 active+clean; 3.8 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 2.0 KiB/s wr, 15 op/s 2024-09-19T09:03:32.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:31 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/2670901467' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:32.931 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'a8b5c724', quiesce took 5.1 seconds. Will release after: 24.9 2024-09-19T09:03:32.957 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:33.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.432+0000 7f994d8f5640 1 -- 172.21.15.19:0/675274340 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9948102790 msgr2=0x7f99481067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:33.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.432+0000 7f994d8f5640 1 --2- 172.21.15.19:0/675274340 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9948102790 0x7f99481067e0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f993c009900 tx=0x7f993c02a410 comp rx=0 tx=0).stop 2024-09-19T09:03:33.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.432+0000 7f994d8f5640 1 -- 172.21.15.19:0/675274340 shutdown_connections 2024-09-19T09:03:33.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.432+0000 7f994d8f5640 1 --2- 172.21.15.19:0/675274340 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9948106f10 0x7f994810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.432+0000 7f994d8f5640 1 --2- 172.21.15.19:0/675274340 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9948102790 0x7f99481067e0 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.432+0000 7f994d8f5640 1 --2- 172.21.15.19:0/675274340 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9948101de0 0x7f99481021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.432+0000 7f994d8f5640 1 -- 172.21.15.19:0/675274340 >> 172.21.15.19:0/675274340 conn(0x7f99480fd8c0 msgr2=0x7f99480ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:33.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.432+0000 7f994d8f5640 1 -- 172.21.15.19:0/675274340 shutdown_connections 2024-09-19T09:03:33.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.432+0000 7f994d8f5640 1 -- 172.21.15.19:0/675274340 wait complete. 2024-09-19T09:03:33.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.433+0000 7f994d8f5640 1 Processor -- start 2024-09-19T09:03:33.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.433+0000 7f994d8f5640 1 -- start start 2024-09-19T09:03:33.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.433+0000 7f994d8f5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9948101de0 0x7f99480744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.433+0000 7f994d8f5640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9948102790 0x7f9948074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.433+0000 7f994d8f5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9948106f10 0x7f9948074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.433+0000 7f994d8f5640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9948111f70 con 0x7f9948106f10 2024-09-19T09:03:33.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.433+0000 7f994d8f5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9948111df0 con 0x7f9948101de0 2024-09-19T09:03:33.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.433+0000 7f994d8f5640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f99481120f0 con 0x7f9948102790 2024-09-19T09:03:33.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.433+0000 7f99477fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9948106f10 0x7f9948074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.434+0000 7f99477fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9948106f10 0x7f9948074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42300/0 (socket says 172.21.15.19:42300) 2024-09-19T09:03:33.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.434+0000 7f99477fe640 1 -- 172.21.15.19:0/4153404896 learned_addr learned my addr 172.21.15.19:0/4153404896 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:33.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.434+0000 7f9946ffd640 1 --2- 172.21.15.19:0/4153404896 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9948101de0 0x7f99480744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.434+0000 7f99467fc640 1 --2- 172.21.15.19:0/4153404896 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9948102790 0x7f9948074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.434+0000 7f99477fe640 1 -- 172.21.15.19:0/4153404896 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9948102790 msgr2=0x7f9948074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:33.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.434+0000 7f99477fe640 1 --2- 172.21.15.19:0/4153404896 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9948102790 0x7f9948074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.434+0000 7f99477fe640 1 -- 172.21.15.19:0/4153404896 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9948101de0 msgr2=0x7f99480744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:33.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.434+0000 7f99477fe640 1 --2- 172.21.15.19:0/4153404896 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9948101de0 0x7f99480744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.434+0000 7f99477fe640 1 -- 172.21.15.19:0/4153404896 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99481a68f0 con 0x7f9948106f10 2024-09-19T09:03:33.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.434+0000 7f99477fe640 1 --2- 172.21.15.19:0/4153404896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9948106f10 0x7f9948074f70 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f994000eb10 tx=0x7f994000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:33.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.434+0000 7f994c8f3640 1 -- 172.21.15.19:0/4153404896 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9940004b20 con 0x7f9948106f10 2024-09-19T09:03:33.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.434+0000 7f994c8f3640 1 -- 172.21.15.19:0/4153404896 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9940004cc0 con 0x7f9948106f10 2024-09-19T09:03:33.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.434+0000 7f994d8f5640 1 -- 172.21.15.19:0/4153404896 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99481a6be0 con 0x7f9948106f10 2024-09-19T09:03:33.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.434+0000 7f994c8f3640 1 -- 172.21.15.19:0/4153404896 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9940010760 con 0x7f9948106f10 2024-09-19T09:03:33.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.434+0000 7f994d8f5640 1 -- 172.21.15.19:0/4153404896 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99481a7120 con 0x7f9948106f10 2024-09-19T09:03:33.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.437+0000 7f994c8f3640 1 -- 172.21.15.19:0/4153404896 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f9940005020 con 0x7f9948106f10 2024-09-19T09:03:33.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.437+0000 7f994fcce740 1 Processor -- start 2024-09-19T09:03:33.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.437+0000 7f994fcce740 1 -- start start 2024-09-19T09:03:33.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.437+0000 7f994fcce740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0c0599b40 0x55f0c0598090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.437+0000 7f994fcce740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0c05985d0 0x55f0c0598a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.437+0000 7f994fcce740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0c05a3370 0x55f0c05a5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.437+0000 7f994fcce740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f0c04fe2f0 con 0x55f0c0599b40 2024-09-19T09:03:33.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.437+0000 7f994fcce740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f0c04a5cf0 con 0x55f0c05a3370 2024-09-19T09:03:33.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.437+0000 7f994fcce740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f0c04fa2b0 con 0x55f0c05985d0 2024-09-19T09:03:33.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.437+0000 7f99467fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0c0599b40 0x55f0c0598090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.437+0000 7f99467fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0c0599b40 0x55f0c0598090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42302/0 (socket says 172.21.15.19:42302) 2024-09-19T09:03:33.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.437+0000 7f99467fc640 1 -- 172.21.15.19:0/2355168925 learned_addr learned my addr 172.21.15.19:0/2355168925 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:33.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.438+0000 7f9946ffd640 1 --2- 172.21.15.19:0/2355168925 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0c05985d0 0x55f0c0598a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.438+0000 7f99467fc640 1 --2- 172.21.15.19:0/2355168925 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0c05a3370 0x55f0c05a5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.438+0000 7f994c8f3640 1 --2- 172.21.15.19:0/4153404896 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f99300a32c0 0x7f99300a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.438+0000 7f99467fc640 1 -- 172.21.15.19:0/2355168925 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0c05985d0 msgr2=0x55f0c0598a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:33.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.438+0000 7f99467fc640 1 --2- 172.21.15.19:0/2355168925 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0c05985d0 0x55f0c0598a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.438+0000 7f99467fc640 1 -- 172.21.15.19:0/2355168925 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0c05a3370 msgr2=0x55f0c05a5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:33.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.438+0000 7f99467fc640 1 --2- 172.21.15.19:0/2355168925 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0c05a3370 0x55f0c05a5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.438+0000 7f99467fc640 1 -- 172.21.15.19:0/2355168925 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0c048a3a0 con 0x55f0c0599b40 2024-09-19T09:03:33.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.438+0000 7f99477fe640 1 --2- 172.21.15.19:0/4153404896 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f99300a32c0 0x7f99300a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.438+0000 7f99467fc640 1 --2- 172.21.15.19:0/2355168925 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0c0599b40 0x55f0c0598090 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f993c031550 tx=0x7f993c005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6964d5b590835b51 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:33.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.438+0000 7f994c8f3640 1 -- 172.21.15.19:0/4153404896 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f99400cfe40 con 0x7f9948106f10 2024-09-19T09:03:33.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.438+0000 7f992dffb640 1 -- 172.21.15.19:0/2355168925 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993c043020 con 0x55f0c0599b40 2024-09-19T09:03:33.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.438+0000 7f992dffb640 1 -- 172.21.15.19:0/2355168925 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f993c031830 con 0x55f0c0599b40 2024-09-19T09:03:33.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.438+0000 7f992dffb640 1 -- 172.21.15.19:0/2355168925 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993c035070 con 0x55f0c0599b40 2024-09-19T09:03:33.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.439+0000 7f994fcce740 1 -- 172.21.15.19:0/2355168925 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0c0599b40 msgr2=0x55f0c0598090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:33.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.439+0000 7f99477fe640 1 --2- 172.21.15.19:0/4153404896 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f99300a32c0 0x7f99300a5780 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f99400988d0 tx=0x7f99400c7240 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:33.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.439+0000 7f994fcce740 1 --2- 172.21.15.19:0/2355168925 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0c0599b40 0x55f0c0598090 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f993c031550 tx=0x7f993c005b50 comp rx=0 tx=0).stop 2024-09-19T09:03:33.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.439+0000 7f994fcce740 1 -- 172.21.15.19:0/2355168925 shutdown_connections 2024-09-19T09:03:33.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.439+0000 7f994fcce740 1 --2- 172.21.15.19:0/2355168925 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0c05985d0 0x55f0c0598a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.439+0000 7f994fcce740 1 --2- 172.21.15.19:0/2355168925 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0c05a3370 0x55f0c05a5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.439+0000 7f994fcce740 1 --2- 172.21.15.19:0/2355168925 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0c0599b40 0x55f0c0598090 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.439+0000 7f994fcce740 1 -- 172.21.15.19:0/2355168925 >> 172.21.15.19:0/2355168925 conn(0x55f0c0561310 msgr2=0x55f0c0594c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:33.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.439+0000 7f994fcce740 1 -- 172.21.15.19:0/2355168925 shutdown_connections 2024-09-19T09:03:33.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.439+0000 7f994fcce740 1 -- 172.21.15.19:0/2355168925 wait complete. 2024-09-19T09:03:33.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.439+0000 7f994fcce740 1 -- start start 2024-09-19T09:03:33.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.440+0000 7f994fcce740 1 Processor -- start 2024-09-19T09:03:33.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.440+0000 7f994fcce740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0c05985d0 0x55f0c05a2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.440+0000 7f994fcce740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0c0599b40 0x55f0c059ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.440+0000 7f994fcce740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0c05a3370 0x55f0c05a0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.440+0000 7f994fcce740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f0c05a6010 con 0x55f0c05a3370 2024-09-19T09:03:33.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.440+0000 7f994fcce740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f0c04b9060 con 0x55f0c0599b40 2024-09-19T09:03:33.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.440+0000 7f994fcce740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f0c05a6190 con 0x55f0c05985d0 2024-09-19T09:03:33.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.440+0000 7f994fcce740 10 client.0 _ll_register_callbacks cb 0x55f0c020c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:33.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.440+0000 7f99467fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0c05a3370 0x55f0c05a0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.440+0000 7f99467fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0c05a3370 0x55f0c05a0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42312/0 (socket says 172.21.15.19:42312) 2024-09-19T09:03:33.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.440+0000 7f99467fc640 1 -- 172.21.15.19:0/3908163697 learned_addr learned my addr 172.21.15.19:0/3908163697 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:33.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.440+0000 7f9946ffd640 1 --2- 172.21.15.19:0/3908163697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0c0599b40 0x55f0c059ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.440+0000 7f99467fc640 1 --2- 172.21.15.19:0/3908163697 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0c05985d0 0x55f0c05a2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.440+0000 7f99467fc640 1 -- 172.21.15.19:0/3908163697 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0c05985d0 msgr2=0x55f0c05a2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:33.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.440+0000 7f99467fc640 1 --2- 172.21.15.19:0/3908163697 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0c05985d0 0x55f0c05a2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.440+0000 7f99467fc640 1 -- 172.21.15.19:0/3908163697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0c0599b40 msgr2=0x55f0c059ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:33.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.440+0000 7f99467fc640 1 --2- 172.21.15.19:0/3908163697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0c0599b40 0x55f0c059ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.447 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.440+0000 7f99467fc640 1 -- 172.21.15.19:0/3908163697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0c026f3c0 con 0x55f0c05a3370 2024-09-19T09:03:33.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.441+0000 7f99467fc640 1 --2- 172.21.15.19:0/3908163697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0c05a3370 0x55f0c05a0570 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f993c009690 tx=0x7f993c005380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae295b5981b5f435 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:33.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.441+0000 7f9926ffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:33.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.441+0000 7f9926ffd640 1 -- 172.21.15.19:0/3908163697 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993c054060 con 0x55f0c05a3370 2024-09-19T09:03:33.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.441+0000 7f9926ffd640 1 -- 172.21.15.19:0/3908163697 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f993c004460 con 0x55f0c05a3370 2024-09-19T09:03:33.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.441+0000 7f994fcce740 1 -- 172.21.15.19:0/3908163697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f993c031830 con 0x55f0c05a3370 2024-09-19T09:03:33.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.441+0000 7f9926ffd640 1 -- 172.21.15.19:0/3908163697 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f993c035070 con 0x55f0c05a3370 2024-09-19T09:03:33.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.441+0000 7f994fcce740 10 client.18195 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:33.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.441+0000 7f994fcce740 1 -- 172.21.15.19:0/3908163697 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55f0c05b1a90 con 0x55f0c05a3370 2024-09-19T09:03:33.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.441+0000 7f9926ffd640 1 -- 172.21.15.19:0/3908163697 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f993c031830 con 0x55f0c05a3370 2024-09-19T09:03:33.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.441+0000 7f9926ffd640 1 -- 172.21.15.19:0/3908163697 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f993c03a040 con 0x55f0c05a3370 2024-09-19T09:03:33.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.441+0000 7f994fcce740 10 client.18195 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:33.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.441+0000 7f994fcce740 10 client.18195 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T09:03:33.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.442+0000 7f994fcce740 20 client.18195 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:33.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.442+0000 7f994fcce740 1 --2- 172.21.15.19:0/3908163697 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55f0c05b2de0 0x55f0c05b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.442+0000 7f994fcce740 4 client.18195 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:33.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.442+0000 7f994fcce740 1 -- 172.21.15.19:0/3908163697 --> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f0c050b860 con 0x55f0c05b2de0 2024-09-19T09:03:33.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.442+0000 7f9946ffd640 1 --2- 172.21.15.19:0/3908163697 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55f0c05b2de0 0x55f0c05b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.442+0000 7f9946ffd640 1 --2- 172.21.15.19:0/3908163697 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55f0c05b2de0 0x55f0c05b51d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e6920b0961e08a3e server_cookie=35da719e5949addb in_seq=0 out_seq=0 2024-09-19T09:03:33.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.442+0000 7f9926ffd640 10 client.18195 ms_handle_connect on v2:172.21.15.203:6834/2702758353 2024-09-19T09:03:33.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.443+0000 7f9926ffd640 1 -- 172.21.15.19:0/3908163697 <== mds.4 v2:172.21.15.203:6834/2702758353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f0c050b860 con 0x55f0c05b2de0 2024-09-19T09:03:33.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.443+0000 7f9926ffd640 10 client.18195 handle_command_reply: tid=0 2024-09-19T09:03:33.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.443+0000 7f994fcce740 1 client.18195 shutdown 2024-09-19T09:03:33.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.443+0000 7f994fcce740 1 -- 172.21.15.19:0/3908163697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0c05a3370 msgr2=0x55f0c05a0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:33.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.443+0000 7f994fcce740 1 --2- 172.21.15.19:0/3908163697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0c05a3370 0x55f0c05a0570 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f993c009690 tx=0x7f993c005380 comp rx=0 tx=0).stop 2024-09-19T09:03:33.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.443+0000 7f994fcce740 1 -- 172.21.15.19:0/3908163697 shutdown_connections 2024-09-19T09:03:33.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.443+0000 7f994fcce740 1 --2- 172.21.15.19:0/3908163697 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55f0c05b2de0 0x55f0c05b51d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.443+0000 7f994fcce740 1 --2- 172.21.15.19:0/3908163697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0c05a3370 0x55f0c05a0570 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.443+0000 7f994fcce740 1 --2- 172.21.15.19:0/3908163697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0c0599b40 0x55f0c059ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.443+0000 7f994fcce740 1 --2- 172.21.15.19:0/3908163697 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0c05985d0 0x55f0c05a2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.443+0000 7f9926ffd640 0 client.18195 ms_handle_reset on v2:172.21.15.203:6834/2702758353 2024-09-19T09:03:33.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.443+0000 7f994fcce740 1 -- 172.21.15.19:0/3908163697 >> 172.21.15.19:0/3908163697 conn(0x55f0c0561310 msgr2=0x55f0c059a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:33.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.443+0000 7f994fcce740 1 -- 172.21.15.19:0/3908163697 shutdown_connections 2024-09-19T09:03:33.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.443+0000 7f994fcce740 1 -- 172.21.15.19:0/3908163697 wait complete. 2024-09-19T09:03:33.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.443+0000 7f994fcce740 20 client.18195 trim_cache size 0 max 16384 2024-09-19T09:03:33.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.456+0000 7f994fcce740 1 Processor -- start 2024-09-19T09:03:33.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.457+0000 7f994fcce740 1 -- start start 2024-09-19T09:03:33.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.457+0000 7f994fcce740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0c05985d0 0x55f0c0594d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.457+0000 7f994fcce740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0c0599b40 0x55f0c05b81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.457+0000 7f994fcce740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0c05a3370 0x55f0c05b8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.457+0000 7f994fcce740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f99481af6a0 con 0x55f0c0599b40 2024-09-19T09:03:33.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.457+0000 7f994fcce740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f99481b11e0 con 0x55f0c05a3370 2024-09-19T09:03:33.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.457+0000 7f994fcce740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f99481afd70 con 0x55f0c05985d0 2024-09-19T09:03:33.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.457+0000 7f9946ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0c0599b40 0x55f0c05b81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.457+0000 7f9946ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0c0599b40 0x55f0c05b81f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42322/0 (socket says 172.21.15.19:42322) 2024-09-19T09:03:33.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.457+0000 7f9946ffd640 1 -- 172.21.15.19:0/3044647851 learned_addr learned my addr 172.21.15.19:0/3044647851 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:33.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.457+0000 7f99467fc640 1 --2- 172.21.15.19:0/3044647851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0c05a3370 0x55f0c05b8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.457+0000 7f99467fc640 1 --2- 172.21.15.19:0/3044647851 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0c05985d0 0x55f0c0594d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.457+0000 7f9946ffd640 1 -- 172.21.15.19:0/3044647851 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0c05985d0 msgr2=0x55f0c0594d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:33.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.457+0000 7f9946ffd640 1 --2- 172.21.15.19:0/3044647851 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0c05985d0 0x55f0c0594d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.457+0000 7f9946ffd640 1 -- 172.21.15.19:0/3044647851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0c05a3370 msgr2=0x55f0c05b8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:33.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.457+0000 7f9946ffd640 1 --2- 172.21.15.19:0/3044647851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0c05a3370 0x55f0c05b8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.457+0000 7f9946ffd640 1 -- 172.21.15.19:0/3044647851 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0c059b120 con 0x55f0c0599b40 2024-09-19T09:03:33.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.457+0000 7f9946ffd640 1 --2- 172.21.15.19:0/3044647851 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0c0599b40 0x55f0c05b81f0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f9938005fd0 tx=0x7f99380039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca5647aaa3a056d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:33.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.458+0000 7f992d7fa640 1 -- 172.21.15.19:0/3044647851 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9938022070 con 0x55f0c0599b40 2024-09-19T09:03:33.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.458+0000 7f992d7fa640 1 -- 172.21.15.19:0/3044647851 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f993801d890 con 0x55f0c0599b40 2024-09-19T09:03:33.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.458+0000 7f992d7fa640 1 -- 172.21.15.19:0/3044647851 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9938015070 con 0x55f0c0599b40 2024-09-19T09:03:33.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.458+0000 7f994fcce740 1 -- 172.21.15.19:0/3044647851 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0c0599b40 msgr2=0x55f0c05b81f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:33.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.458+0000 7f994fcce740 1 --2- 172.21.15.19:0/3044647851 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0c0599b40 0x55f0c05b81f0 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f9938005fd0 tx=0x7f99380039c0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.458+0000 7f994fcce740 1 -- 172.21.15.19:0/3044647851 shutdown_connections 2024-09-19T09:03:33.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.458+0000 7f994fcce740 1 --2- 172.21.15.19:0/3044647851 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0c05a3370 0x55f0c05b8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.458+0000 7f994fcce740 1 --2- 172.21.15.19:0/3044647851 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0c0599b40 0x55f0c05b81f0 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.458+0000 7f994fcce740 1 --2- 172.21.15.19:0/3044647851 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0c05985d0 0x55f0c0594d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.458+0000 7f994fcce740 1 -- 172.21.15.19:0/3044647851 >> 172.21.15.19:0/3044647851 conn(0x55f0c0561310 msgr2=0x55f0c0594610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:33.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.458+0000 7f994fcce740 1 -- 172.21.15.19:0/3044647851 shutdown_connections 2024-09-19T09:03:33.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.458+0000 7f994fcce740 1 -- 172.21.15.19:0/3044647851 wait complete. 2024-09-19T09:03:33.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.459+0000 7f994fcce740 1 -- start start 2024-09-19T09:03:33.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.459+0000 7f994fcce740 1 Processor -- start 2024-09-19T09:03:33.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.459+0000 7f994fcce740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0c05985d0 0x55f0c05b8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.459+0000 7f994fcce740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0c0599b40 0x55f0c05b5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.459+0000 7f994fcce740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0c05a3370 0x55f0c05b5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.459+0000 7f994fcce740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f99481b0b10 con 0x55f0c05a3370 2024-09-19T09:03:33.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.459+0000 7f994fcce740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f99481b0440 con 0x55f0c0599b40 2024-09-19T09:03:33.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.459+0000 7f994fcce740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f99481ad680 con 0x55f0c05985d0 2024-09-19T09:03:33.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.459+0000 7f994fcce740 10 client.0 _ll_register_callbacks cb 0x7f993c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:33.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.459+0000 7f99467fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0c05a3370 0x55f0c05b5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.459+0000 7f99467fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0c05a3370 0x55f0c05b5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42328/0 (socket says 172.21.15.19:42328) 2024-09-19T09:03:33.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.459+0000 7f99467fc640 1 -- 172.21.15.19:0/816962787 learned_addr learned my addr 172.21.15.19:0/816962787 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:33.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.459+0000 7f9946ffd640 1 --2- 172.21.15.19:0/816962787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0c0599b40 0x55f0c05b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.459+0000 7f99467fc640 1 --2- 172.21.15.19:0/816962787 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0c05985d0 0x55f0c05b8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.460+0000 7f99467fc640 1 -- 172.21.15.19:0/816962787 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0c05985d0 msgr2=0x55f0c05b8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:33.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.460+0000 7f99467fc640 1 --2- 172.21.15.19:0/816962787 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0c05985d0 0x55f0c05b8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.460+0000 7f99467fc640 1 -- 172.21.15.19:0/816962787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0c0599b40 msgr2=0x55f0c05b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:33.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.460+0000 7f99467fc640 1 --2- 172.21.15.19:0/816962787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0c0599b40 0x55f0c05b5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.460+0000 7f99467fc640 1 -- 172.21.15.19:0/816962787 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0c05b6400 con 0x55f0c05a3370 2024-09-19T09:03:33.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.460+0000 7f9946ffd640 1 --2- 172.21.15.19:0/816962787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0c0599b40 0x55f0c05b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:33.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.460+0000 7f99467fc640 1 --2- 172.21.15.19:0/816962787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0c05a3370 0x55f0c05b5ec0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f993c0057c0 tx=0x7f993c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9230df454489f36 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:33.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.460+0000 7f9926ffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:33.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.460+0000 7f9926ffd640 1 -- 172.21.15.19:0/816962787 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993c05f070 con 0x55f0c05a3370 2024-09-19T09:03:33.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.460+0000 7f9926ffd640 1 -- 172.21.15.19:0/816962787 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f993c004460 con 0x55f0c05a3370 2024-09-19T09:03:33.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.460+0000 7f994fcce740 1 -- 172.21.15.19:0/816962787 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f993801d890 con 0x55f0c05a3370 2024-09-19T09:03:33.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.460+0000 7f9926ffd640 1 -- 172.21.15.19:0/816962787 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f993c054070 con 0x55f0c05a3370 2024-09-19T09:03:33.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.460+0000 7f994fcce740 10 client.18201 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:33.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.460+0000 7f994fcce740 1 -- 172.21.15.19:0/816962787 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55f0c061d410 con 0x55f0c05a3370 2024-09-19T09:03:33.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.460+0000 7f9926ffd640 1 -- 172.21.15.19:0/816962787 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f993801d890 con 0x55f0c05a3370 2024-09-19T09:03:33.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.461+0000 7f9926ffd640 1 -- 172.21.15.19:0/816962787 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f993c031980 con 0x55f0c05a3370 2024-09-19T09:03:33.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.461+0000 7f994fcce740 10 client.18201 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:33.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.461+0000 7f994fcce740 10 client.18201 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T09:03:33.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.461+0000 7f994fcce740 20 client.18201 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:33.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.461+0000 7f994fcce740 1 --2- 172.21.15.19:0/816962787 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55f0c061da70 0x55f0c061fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:33.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.461+0000 7f994fcce740 4 client.18201 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:03:33.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.461+0000 7f994fcce740 1 -- 172.21.15.19:0/816962787 --> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f0c0505d70 con 0x55f0c061da70 2024-09-19T09:03:33.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.461+0000 7f9946ffd640 1 --2- 172.21.15.19:0/816962787 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55f0c061da70 0x55f0c061fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:33.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.461+0000 7f9926ffd640 10 client.18201 ms_handle_connect on v2:172.21.15.203:6834/2702758353 2024-09-19T09:03:33.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.461+0000 7f9946ffd640 1 --2- 172.21.15.19:0/816962787 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55f0c061da70 0x55f0c061fe60 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d8de29a65f8bac92 server_cookie=dc37166bd8693198 in_seq=0 out_seq=0 2024-09-19T09:03:33.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.462+0000 7f9926ffd640 1 -- 172.21.15.19:0/816962787 <== mds.4 v2:172.21.15.203:6834/2702758353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f0c0505d70 con 0x55f0c061da70 2024-09-19T09:03:33.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.462+0000 7f9926ffd640 10 client.18201 handle_command_reply: tid=0 2024-09-19T09:03:33.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.462+0000 7f994fcce740 1 client.18201 shutdown 2024-09-19T09:03:33.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.462+0000 7f994fcce740 1 -- 172.21.15.19:0/816962787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0c05a3370 msgr2=0x55f0c05b5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:33.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.462+0000 7f994fcce740 1 --2- 172.21.15.19:0/816962787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0c05a3370 0x55f0c05b5ec0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f993c0057c0 tx=0x7f993c02a410 comp rx=0 tx=0).stop 2024-09-19T09:03:33.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.462+0000 7f994fcce740 1 -- 172.21.15.19:0/816962787 shutdown_connections 2024-09-19T09:03:33.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.462+0000 7f994fcce740 1 --2- 172.21.15.19:0/816962787 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55f0c061da70 0x55f0c061fe60 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.462+0000 7f994fcce740 1 --2- 172.21.15.19:0/816962787 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f0c05a3370 0x55f0c05b5ec0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.462+0000 7f9926ffd640 0 client.18201 ms_handle_reset on v2:172.21.15.203:6834/2702758353 2024-09-19T09:03:33.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.462+0000 7f994fcce740 1 --2- 172.21.15.19:0/816962787 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f0c0599b40 0x55f0c05b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.462+0000 7f994fcce740 1 --2- 172.21.15.19:0/816962787 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f0c05985d0 0x55f0c05b8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.462+0000 7f994fcce740 1 -- 172.21.15.19:0/816962787 >> 172.21.15.19:0/816962787 conn(0x55f0c0561310 msgr2=0x55f0c059a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:33.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.462+0000 7f994fcce740 1 -- 172.21.15.19:0/816962787 shutdown_connections 2024-09-19T09:03:33.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.462+0000 7f994fcce740 1 -- 172.21.15.19:0/816962787 wait complete. 2024-09-19T09:03:33.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.462+0000 7f994fcce740 20 client.18201 trim_cache size 0 max 16384 2024-09-19T09:03:33.471 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:03:33.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.462+0000 7f994d8f5640 1 -- 172.21.15.19:0/4153404896 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f99300a32c0 msgr2=0x7f99300a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:33.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.462+0000 7f994d8f5640 1 --2- 172.21.15.19:0/4153404896 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f99300a32c0 0x7f99300a5780 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f99400988d0 tx=0x7f99400c7240 comp rx=0 tx=0).stop 2024-09-19T09:03:33.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.462+0000 7f994d8f5640 1 -- 172.21.15.19:0/4153404896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9948106f10 msgr2=0x7f9948074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:33.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.462+0000 7f994d8f5640 1 --2- 172.21.15.19:0/4153404896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9948106f10 0x7f9948074f70 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f994000eb10 tx=0x7f994000c2d0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.463+0000 7f994d8f5640 1 -- 172.21.15.19:0/4153404896 shutdown_connections 2024-09-19T09:03:33.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.463+0000 7f994d8f5640 1 --2- 172.21.15.19:0/4153404896 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f99300a32c0 0x7f99300a5780 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.463+0000 7f994d8f5640 1 --2- 172.21.15.19:0/4153404896 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9948102790 0x7f9948074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.463+0000 7f994d8f5640 1 --2- 172.21.15.19:0/4153404896 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9948106f10 0x7f9948074f70 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.463+0000 7f994d8f5640 1 --2- 172.21.15.19:0/4153404896 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9948101de0 0x7f99480744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:33.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.463+0000 7f994d8f5640 1 -- 172.21.15.19:0/4153404896 >> 172.21.15.19:0/4153404896 conn(0x7f99480fd8c0 msgr2=0x7f99480fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:33.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.463+0000 7f994d8f5640 1 -- 172.21.15.19:0/4153404896 shutdown_connections 2024-09-19T09:03:33.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:33.463+0000 7f994d8f5640 1 -- 172.21.15.19:0/4153404896 wait complete. 2024-09-19T09:03:34.137 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:33 smithi019 ceph-mon[30976]: pgmap v679: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 5.3 KiB/s wr, 17 op/s 2024-09-19T09:03:34.166 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T09:03:34.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:33 smithi155 ceph-mon[34921]: pgmap v679: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 5.3 KiB/s wr, 17 op/s 2024-09-19T09:03:34.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:33 smithi203 ceph-mon[35450]: pgmap v679: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 5.3 KiB/s wr, 17 op/s 2024-09-19T09:03:34.463 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:34.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.919+0000 7f5f580fb640 1 -- 172.21.15.19:0/2956379384 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f50102da0 msgr2=0x7f5f50103180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:34.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.919+0000 7f5f580fb640 1 --2- 172.21.15.19:0/2956379384 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f50102da0 0x7f5f50103180 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c009900 tx=0x7f5f4c02a480 comp rx=0 tx=0).stop 2024-09-19T09:03:34.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.919+0000 7f5f580fb640 1 -- 172.21.15.19:0/2956379384 shutdown_connections 2024-09-19T09:03:34.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.919+0000 7f5f580fb640 1 --2- 172.21.15.19:0/2956379384 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f5010c180 0x7f5f5010e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.919+0000 7f5f580fb640 1 --2- 172.21.15.19:0/2956379384 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f501036c0 0x7f5f5010bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.919+0000 7f5f580fb640 1 --2- 172.21.15.19:0/2956379384 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f50102da0 0x7f5f50103180 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.919+0000 7f5f580fb640 1 -- 172.21.15.19:0/2956379384 >> 172.21.15.19:0/2956379384 conn(0x7f5f500fc7a0 msgr2=0x7f5f500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:34.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.919+0000 7f5f580fb640 1 -- 172.21.15.19:0/2956379384 shutdown_connections 2024-09-19T09:03:34.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.919+0000 7f5f580fb640 1 -- 172.21.15.19:0/2956379384 wait complete. 2024-09-19T09:03:34.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.920+0000 7f5f580fb640 1 Processor -- start 2024-09-19T09:03:34.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.920+0000 7f5f580fb640 1 -- start start 2024-09-19T09:03:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.920+0000 7f5f580fb640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f50102da0 0x7f5f50100a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.920+0000 7f5f580fb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f501036c0 0x7f5f50100f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.920+0000 7f5f580fb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f5010c180 0x7f5f50101480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.920+0000 7f5f580fb640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5f50112020 con 0x7f5f5010c180 2024-09-19T09:03:34.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.920+0000 7f5f580fb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5f50111ea0 con 0x7f5f501036c0 2024-09-19T09:03:34.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.920+0000 7f5f580fb640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5f501121a0 con 0x7f5f50102da0 2024-09-19T09:03:34.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.920+0000 7f5f56698640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f5010c180 0x7f5f50101480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:34.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.920+0000 7f5f56698640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f5010c180 0x7f5f50101480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42338/0 (socket says 172.21.15.19:42338) 2024-09-19T09:03:34.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.920+0000 7f5f56698640 1 -- 172.21.15.19:0/2341693738 learned_addr learned my addr 172.21.15.19:0/2341693738 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:34.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.920+0000 7f5f55e97640 1 --2- 172.21.15.19:0/2341693738 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f50102da0 0x7f5f50100a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:34.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.920+0000 7f5f55696640 1 --2- 172.21.15.19:0/2341693738 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f501036c0 0x7f5f50100f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:34.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.921+0000 7f5f56698640 1 -- 172.21.15.19:0/2341693738 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f50102da0 msgr2=0x7f5f50100a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:34.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.921+0000 7f5f56698640 1 --2- 172.21.15.19:0/2341693738 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f50102da0 0x7f5f50100a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.921+0000 7f5f56698640 1 -- 172.21.15.19:0/2341693738 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f501036c0 msgr2=0x7f5f50100f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:34.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.921+0000 7f5f56698640 1 --2- 172.21.15.19:0/2341693738 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f501036c0 0x7f5f50100f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.921+0000 7f5f56698640 1 -- 172.21.15.19:0/2341693738 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f501a6a60 con 0x7f5f5010c180 2024-09-19T09:03:34.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.921+0000 7f5f56698640 1 --2- 172.21.15.19:0/2341693738 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f5010c180 0x7f5f50101480 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f5f4800b970 tx=0x7f5f4800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:34.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.921+0000 7f5f46ffd640 1 -- 172.21.15.19:0/2341693738 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f48019070 con 0x7f5f5010c180 2024-09-19T09:03:34.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.921+0000 7f5f46ffd640 1 -- 172.21.15.19:0/2341693738 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f4800cb40 con 0x7f5f5010c180 2024-09-19T09:03:34.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.921+0000 7f5f580fb640 1 -- 172.21.15.19:0/2341693738 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f501a6d50 con 0x7f5f5010c180 2024-09-19T09:03:34.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.921+0000 7f5f46ffd640 1 -- 172.21.15.19:0/2341693738 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f48007650 con 0x7f5f5010c180 2024-09-19T09:03:34.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.921+0000 7f5f580fb640 1 -- 172.21.15.19:0/2341693738 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f501a72b0 con 0x7f5f5010c180 2024-09-19T09:03:34.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.924+0000 7f5f46ffd640 1 -- 172.21.15.19:0/2341693738 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f5f4801c070 con 0x7f5f5010c180 2024-09-19T09:03:34.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.924+0000 7f5f5a4d4740 1 Processor -- start 2024-09-19T09:03:34.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.924+0000 7f5f5a4d4740 1 -- start start 2024-09-19T09:03:34.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.925+0000 7f5f5a4d4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557039a11b40 0x557039a10090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:34.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.925+0000 7f5f5a4d4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557039a105d0 0x557039a10a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:34.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.925+0000 7f5f5a4d4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557039a1b370 0x557039a1d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:34.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.925+0000 7f5f5a4d4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5570399762f0 con 0x557039a11b40 2024-09-19T09:03:34.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.925+0000 7f5f5a4d4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55703991dcf0 con 0x557039a1b370 2024-09-19T09:03:34.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.925+0000 7f5f5a4d4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5570399722b0 con 0x557039a105d0 2024-09-19T09:03:34.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.925+0000 7f5f55696640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557039a11b40 0x557039a10090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:34.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.925+0000 7f5f55696640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557039a11b40 0x557039a10090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42352/0 (socket says 172.21.15.19:42352) 2024-09-19T09:03:34.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.925+0000 7f5f55696640 1 -- 172.21.15.19:0/1607453947 learned_addr learned my addr 172.21.15.19:0/1607453947 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:34.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.925+0000 7f5f55e97640 1 --2- 172.21.15.19:0/1607453947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557039a105d0 0x557039a10a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:34.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.925+0000 7f5f46ffd640 1 --2- 172.21.15.19:0/2341693738 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5f3c0a32c0 0x7f5f3c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:34.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.925+0000 7f5f55696640 1 -- 172.21.15.19:0/1607453947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557039a105d0 msgr2=0x557039a10a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:34.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.925+0000 7f5f55696640 1 --2- 172.21.15.19:0/1607453947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557039a105d0 0x557039a10a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.925+0000 7f5f55696640 1 -- 172.21.15.19:0/1607453947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557039a1b370 msgr2=0x557039a1d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:34.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.925+0000 7f5f55696640 1 --2- 172.21.15.19:0/1607453947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557039a1b370 0x557039a1d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.943 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.925+0000 7f5f55696640 1 -- 172.21.15.19:0/1607453947 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570399023a0 con 0x557039a11b40 2024-09-19T09:03:34.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.925+0000 7f5f55e97640 1 --2- 172.21.15.19:0/1607453947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557039a105d0 0x557039a10a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:34.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.925+0000 7f5f56698640 1 --2- 172.21.15.19:0/2341693738 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5f3c0a32c0 0x7f5f3c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:34.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.925+0000 7f5f46ffd640 1 -- 172.21.15.19:0/2341693738 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f5f480ceec0 con 0x7f5f5010c180 2024-09-19T09:03:34.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.925+0000 7f5f55696640 1 --2- 172.21.15.19:0/1607453947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557039a11b40 0x557039a10090 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f5f40006e10 tx=0x7f5f40009ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=778c120a3bba5968 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:34.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.926+0000 7f5f3bfff640 1 -- 172.21.15.19:0/1607453947 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4000fa60 con 0x557039a11b40 2024-09-19T09:03:34.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.926+0000 7f5f3bfff640 1 -- 172.21.15.19:0/1607453947 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f40010040 con 0x557039a11b40 2024-09-19T09:03:34.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.926+0000 7f5f3bfff640 1 -- 172.21.15.19:0/1607453947 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f400135f0 con 0x557039a11b40 2024-09-19T09:03:34.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.926+0000 7f5f5a4d4740 1 -- 172.21.15.19:0/1607453947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557039a11b40 msgr2=0x557039a10090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:34.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.926+0000 7f5f5a4d4740 1 --2- 172.21.15.19:0/1607453947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557039a11b40 0x557039a10090 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f5f40006e10 tx=0x7f5f40009ea0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.926+0000 7f5f56698640 1 --2- 172.21.15.19:0/2341693738 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5f3c0a32c0 0x7f5f3c0a5780 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5f4809b420 tx=0x7f5f48090970 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:34.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.926+0000 7f5f5a4d4740 1 -- 172.21.15.19:0/1607453947 shutdown_connections 2024-09-19T09:03:34.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.926+0000 7f5f5a4d4740 1 --2- 172.21.15.19:0/1607453947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557039a105d0 0x557039a10a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.926+0000 7f5f5a4d4740 1 --2- 172.21.15.19:0/1607453947 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557039a1b370 0x557039a1d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.949 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.926+0000 7f5f5a4d4740 1 --2- 172.21.15.19:0/1607453947 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557039a11b40 0x557039a10090 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.926+0000 7f5f5a4d4740 1 -- 172.21.15.19:0/1607453947 >> 172.21.15.19:0/1607453947 conn(0x5570399d9310 msgr2=0x557039a0cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:34.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.926+0000 7f5f5a4d4740 1 -- 172.21.15.19:0/1607453947 shutdown_connections 2024-09-19T09:03:34.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.926+0000 7f5f5a4d4740 1 -- 172.21.15.19:0/1607453947 wait complete. 2024-09-19T09:03:34.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.927+0000 7f5f5a4d4740 1 -- start start 2024-09-19T09:03:34.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.927+0000 7f5f5a4d4740 1 Processor -- start 2024-09-19T09:03:34.950 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.927+0000 7f5f5a4d4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557039a105d0 0x557039a1ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:34.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.927+0000 7f5f5a4d4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557039a11b40 0x557039a17fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:34.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.927+0000 7f5f5a4d4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557039a1b370 0x557039a18560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:34.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.927+0000 7f5f5a4d4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557039a1e070 con 0x557039a1b370 2024-09-19T09:03:34.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.927+0000 7f5f5a4d4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x557039931060 con 0x557039a11b40 2024-09-19T09:03:34.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.927+0000 7f5f5a4d4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557039a1e1f0 con 0x557039a105d0 2024-09-19T09:03:34.951 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.927+0000 7f5f5a4d4740 10 client.0 _ll_register_callbacks cb 0x5570396848c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:34.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.927+0000 7f5f55696640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557039a1b370 0x557039a18560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:34.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.927+0000 7f5f55696640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557039a1b370 0x557039a18560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42366/0 (socket says 172.21.15.19:42366) 2024-09-19T09:03:34.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.927+0000 7f5f55696640 1 -- 172.21.15.19:0/2105735813 learned_addr learned my addr 172.21.15.19:0/2105735813 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:34.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.928+0000 7f5f55696640 1 --2- 172.21.15.19:0/2105735813 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557039a105d0 0x557039a1ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:34.952 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.928+0000 7f5f55e97640 1 --2- 172.21.15.19:0/2105735813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557039a11b40 0x557039a17fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:34.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.928+0000 7f5f55696640 1 -- 172.21.15.19:0/2105735813 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557039a105d0 msgr2=0x557039a1ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:34.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.928+0000 7f5f55696640 1 --2- 172.21.15.19:0/2105735813 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557039a105d0 0x557039a1ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.928+0000 7f5f55696640 1 -- 172.21.15.19:0/2105735813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557039a11b40 msgr2=0x557039a17fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:34.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.928+0000 7f5f55696640 1 --2- 172.21.15.19:0/2105735813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557039a11b40 0x557039a17fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.953 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.928+0000 7f5f55696640 1 -- 172.21.15.19:0/2105735813 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5570396e73c0 con 0x557039a1b370 2024-09-19T09:03:34.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.928+0000 7f5f55696640 1 --2- 172.21.15.19:0/2105735813 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557039a1b370 0x557039a18560 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f5f40014680 tx=0x7f5f40014c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8deeb522adb3609a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:34.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.928+0000 7f5f397fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:34.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.928+0000 7f5f397fa640 1 -- 172.21.15.19:0/2105735813 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f400148f0 con 0x557039a1b370 2024-09-19T09:03:34.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.928+0000 7f5f397fa640 1 -- 172.21.15.19:0/2105735813 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f5f40020440 con 0x557039a1b370 2024-09-19T09:03:34.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.928+0000 7f5f5a4d4740 1 -- 172.21.15.19:0/2105735813 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f40010040 con 0x557039a1b370 2024-09-19T09:03:34.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.929+0000 7f5f397fa640 1 -- 172.21.15.19:0/2105735813 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f5f40020640 con 0x557039a1b370 2024-09-19T09:03:34.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.929+0000 7f5f5a4d4740 10 client.18213 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:34.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.929+0000 7f5f5a4d4740 1 -- 172.21.15.19:0/2105735813 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x557039a29af0 con 0x557039a1b370 2024-09-19T09:03:34.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.929+0000 7f5f397fa640 1 -- 172.21.15.19:0/2105735813 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f40010040 con 0x557039a1b370 2024-09-19T09:03:34.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.929+0000 7f5f397fa640 1 -- 172.21.15.19:0/2105735813 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f5f40013070 con 0x557039a1b370 2024-09-19T09:03:34.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.929+0000 7f5f5a4d4740 10 client.18213 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:34.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.929+0000 7f5f5a4d4740 10 client.18213 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-19T09:03:34.955 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.929+0000 7f5f5a4d4740 20 client.18213 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:34.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.929+0000 7f5f5a4d4740 1 --2- 172.21.15.19:0/2105735813 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x557039a2afb0 0x557039a2d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:34.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.929+0000 7f5f5a4d4740 4 client.18213 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:34.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.929+0000 7f5f5a4d4740 1 -- 172.21.15.19:0/2105735813 --> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557039983860 con 0x557039a2afb0 2024-09-19T09:03:34.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.930+0000 7f5f55e97640 1 --2- 172.21.15.19:0/2105735813 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x557039a2afb0 0x557039a2d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:34.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.930+0000 7f5f55e97640 1 --2- 172.21.15.19:0/2105735813 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x557039a2afb0 0x557039a2d3a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=464f095944a28d71 server_cookie=1cd4d80e40163eeb in_seq=0 out_seq=0 2024-09-19T09:03:34.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.930+0000 7f5f397fa640 10 client.18213 ms_handle_connect on v2:172.21.15.155:6836/3381010945 2024-09-19T09:03:34.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.931+0000 7f5f397fa640 1 -- 172.21.15.19:0/2105735813 <== mds.3 v2:172.21.15.155:6836/3381010945 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557039983860 con 0x557039a2afb0 2024-09-19T09:03:34.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.931+0000 7f5f397fa640 10 client.18213 handle_command_reply: tid=0 2024-09-19T09:03:34.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.931+0000 7f5f5a4d4740 1 client.18213 shutdown 2024-09-19T09:03:34.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.931+0000 7f5f5a4d4740 1 -- 172.21.15.19:0/2105735813 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557039a1b370 msgr2=0x557039a18560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:34.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.931+0000 7f5f5a4d4740 1 --2- 172.21.15.19:0/2105735813 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557039a1b370 0x557039a18560 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f5f40014680 tx=0x7f5f40014c30 comp rx=0 tx=0).stop 2024-09-19T09:03:34.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.931+0000 7f5f5a4d4740 1 -- 172.21.15.19:0/2105735813 shutdown_connections 2024-09-19T09:03:34.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.931+0000 7f5f5a4d4740 1 --2- 172.21.15.19:0/2105735813 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x557039a2afb0 0x557039a2d3a0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.931+0000 7f5f5a4d4740 1 --2- 172.21.15.19:0/2105735813 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557039a1b370 0x557039a18560 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.931+0000 7f5f5a4d4740 1 --2- 172.21.15.19:0/2105735813 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557039a11b40 0x557039a17fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.931+0000 7f5f397fa640 0 client.18213 ms_handle_reset on v2:172.21.15.155:6836/3381010945 2024-09-19T09:03:34.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.931+0000 7f5f5a4d4740 1 --2- 172.21.15.19:0/2105735813 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557039a105d0 0x557039a1ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.931+0000 7f5f5a4d4740 1 -- 172.21.15.19:0/2105735813 >> 172.21.15.19:0/2105735813 conn(0x5570399d9310 msgr2=0x557039a12930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:34.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.931+0000 7f5f5a4d4740 1 -- 172.21.15.19:0/2105735813 shutdown_connections 2024-09-19T09:03:34.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.931+0000 7f5f5a4d4740 1 -- 172.21.15.19:0/2105735813 wait complete. 2024-09-19T09:03:34.958 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.931+0000 7f5f5a4d4740 20 client.18213 trim_cache size 0 max 16384 2024-09-19T09:03:34.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.949+0000 7f5f5a4d4740 1 Processor -- start 2024-09-19T09:03:34.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.949+0000 7f5f5a4d4740 1 -- start start 2024-09-19T09:03:34.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.950+0000 7f5f5a4d4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557039a105d0 0x557039a27340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:34.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.950+0000 7f5f5a4d4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557039a11b40 0x557039a16fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:34.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.950+0000 7f5f5a4d4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557039a1b370 0x557039a32b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:34.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.950+0000 7f5f5a4d4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5f501af8a0 con 0x557039a11b40 2024-09-19T09:03:34.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.950+0000 7f5f5a4d4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5f501b13e0 con 0x557039a1b370 2024-09-19T09:03:34.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.950+0000 7f5f5a4d4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5f501aff70 con 0x557039a105d0 2024-09-19T09:03:34.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.950+0000 7f5f55e97640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557039a11b40 0x557039a16fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:34.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.950+0000 7f5f55e97640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557039a11b40 0x557039a16fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42382/0 (socket says 172.21.15.19:42382) 2024-09-19T09:03:34.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.950+0000 7f5f55e97640 1 -- 172.21.15.19:0/1761730329 learned_addr learned my addr 172.21.15.19:0/1761730329 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:34.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.950+0000 7f5f55696640 1 --2- 172.21.15.19:0/1761730329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557039a105d0 0x557039a27340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:34.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.950+0000 7f5f55696640 1 --2- 172.21.15.19:0/1761730329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557039a1b370 0x557039a32b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:34.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.950+0000 7f5f55e97640 1 -- 172.21.15.19:0/1761730329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557039a105d0 msgr2=0x557039a27340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:34.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.950+0000 7f5f55e97640 1 --2- 172.21.15.19:0/1761730329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557039a105d0 0x557039a27340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.950+0000 7f5f55e97640 1 -- 172.21.15.19:0/1761730329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557039a1b370 msgr2=0x557039a32b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:34.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.950+0000 7f5f55e97640 1 --2- 172.21.15.19:0/1761730329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557039a1b370 0x557039a32b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.950+0000 7f5f55e97640 1 -- 172.21.15.19:0/1761730329 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557039a0d960 con 0x557039a11b40 2024-09-19T09:03:34.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.950+0000 7f5f55696640 1 --2- 172.21.15.19:0/1761730329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557039a1b370 0x557039a32b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:34.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.950+0000 7f5f55e97640 1 --2- 172.21.15.19:0/1761730329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557039a11b40 0x557039a16fa0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c009900 tx=0x7f5f4c009610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=773ddb019ef4d57d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:34.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.951+0000 7f5f3b7fe640 1 -- 172.21.15.19:0/1761730329 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c048070 con 0x557039a11b40 2024-09-19T09:03:34.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.951+0000 7f5f3b7fe640 1 -- 172.21.15.19:0/1761730329 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f4c005500 con 0x557039a11b40 2024-09-19T09:03:34.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.951+0000 7f5f3b7fe640 1 -- 172.21.15.19:0/1761730329 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c035040 con 0x557039a11b40 2024-09-19T09:03:34.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.951+0000 7f5f5a4d4740 1 -- 172.21.15.19:0/1761730329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557039a11b40 msgr2=0x557039a16fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:34.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.951+0000 7f5f5a4d4740 1 --2- 172.21.15.19:0/1761730329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557039a11b40 0x557039a16fa0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c009900 tx=0x7f5f4c009610 comp rx=0 tx=0).stop 2024-09-19T09:03:34.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.952+0000 7f5f5a4d4740 1 -- 172.21.15.19:0/1761730329 shutdown_connections 2024-09-19T09:03:34.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.952+0000 7f5f5a4d4740 1 --2- 172.21.15.19:0/1761730329 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557039a1b370 0x557039a32b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.952+0000 7f5f5a4d4740 1 --2- 172.21.15.19:0/1761730329 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557039a11b40 0x557039a16fa0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.952+0000 7f5f5a4d4740 1 --2- 172.21.15.19:0/1761730329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557039a105d0 0x557039a27340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.952+0000 7f5f5a4d4740 1 -- 172.21.15.19:0/1761730329 >> 172.21.15.19:0/1761730329 conn(0x5570399d9310 msgr2=0x557039a16890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:34.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.952+0000 7f5f5a4d4740 1 -- 172.21.15.19:0/1761730329 shutdown_connections 2024-09-19T09:03:34.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.952+0000 7f5f5a4d4740 1 -- 172.21.15.19:0/1761730329 wait complete. 2024-09-19T09:03:34.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.952+0000 7f5f5a4d4740 1 -- start start 2024-09-19T09:03:34.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.952+0000 7f5f5a4d4740 1 Processor -- start 2024-09-19T09:03:34.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.952+0000 7f5f5a4d4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557039a105d0 0x557039a23d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:34.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.953+0000 7f5f5a4d4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557039a11b40 0x557039a14e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:34.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.953+0000 7f5f5a4d4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557039a1b370 0x557039a155c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:34.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.953+0000 7f5f5a4d4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5f501b0d10 con 0x557039a105d0 2024-09-19T09:03:34.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.953+0000 7f5f5a4d4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5f501b0640 con 0x557039a11b40 2024-09-19T09:03:34.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.953+0000 7f5f5a4d4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5f501ad880 con 0x557039a1b370 2024-09-19T09:03:34.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.953+0000 7f5f5a4d4740 10 client.0 _ll_register_callbacks cb 0x7f5f40009910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:34.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.953+0000 7f5f55696640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557039a105d0 0x557039a23d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:34.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.953+0000 7f5f55696640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557039a105d0 0x557039a23d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:42392/0 (socket says 172.21.15.19:42392) 2024-09-19T09:03:34.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.953+0000 7f5f55696640 1 -- 172.21.15.19:0/255313519 learned_addr learned my addr 172.21.15.19:0/255313519 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:34.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.953+0000 7f5f55e97640 1 --2- 172.21.15.19:0/255313519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557039a11b40 0x557039a14e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:34.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.953+0000 7f5f55696640 1 -- 172.21.15.19:0/255313519 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557039a1b370 msgr2=0x557039a155c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:34.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.953+0000 7f5f55696640 1 --2- 172.21.15.19:0/255313519 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557039a1b370 0x557039a155c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.953+0000 7f5f55696640 1 -- 172.21.15.19:0/255313519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557039a11b40 msgr2=0x557039a14e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:34.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.953+0000 7f5f55696640 1 --2- 172.21.15.19:0/255313519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557039a11b40 0x557039a14e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.953+0000 7f5f55696640 1 -- 172.21.15.19:0/255313519 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557039a13120 con 0x557039a105d0 2024-09-19T09:03:34.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.953+0000 7f5f55e97640 1 --2- 172.21.15.19:0/255313519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557039a11b40 0x557039a14e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:34.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.953+0000 7f5f55696640 1 --2- 172.21.15.19:0/255313519 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557039a105d0 0x557039a23d50 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f5f40004810 tx=0x7f5f40014b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0376c358c680e08 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:34.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.953+0000 7f5f397fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:34.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.953+0000 7f5f397fa640 1 -- 172.21.15.19:0/255313519 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4001fc30 con 0x557039a105d0 2024-09-19T09:03:34.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.953+0000 7f5f397fa640 1 -- 172.21.15.19:0/255313519 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f5f40020440 con 0x557039a105d0 2024-09-19T09:03:34.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.953+0000 7f5f5a4d4740 1 -- 172.21.15.19:0/255313519 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f4c005500 con 0x557039a105d0 2024-09-19T09:03:34.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.954+0000 7f5f397fa640 1 -- 172.21.15.19:0/255313519 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f5f4003f050 con 0x557039a105d0 2024-09-19T09:03:34.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.954+0000 7f5f5a4d4740 10 client.18219 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:34.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.954+0000 7f5f5a4d4740 1 -- 172.21.15.19:0/255313519 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x557039a95a60 con 0x557039a105d0 2024-09-19T09:03:34.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.954+0000 7f5f397fa640 1 -- 172.21.15.19:0/255313519 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5f4c005500 con 0x557039a105d0 2024-09-19T09:03:34.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.954+0000 7f5f397fa640 1 -- 172.21.15.19:0/255313519 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f5f40013040 con 0x557039a105d0 2024-09-19T09:03:34.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.954+0000 7f5f5a4d4740 10 client.18219 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:34.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.954+0000 7f5f5a4d4740 10 client.18219 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-19T09:03:34.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.954+0000 7f5f5a4d4740 20 client.18219 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:34.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.954+0000 7f5f5a4d4740 1 --2- 172.21.15.19:0/255313519 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x557039a95ee0 0x557039a982d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:34.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.954+0000 7f5f5a4d4740 4 client.18219 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:03:34.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.954+0000 7f5f5a4d4740 1 -- 172.21.15.19:0/255313519 --> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55703997dd70 con 0x557039a95ee0 2024-09-19T09:03:34.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.954+0000 7f5f55e97640 1 --2- 172.21.15.19:0/255313519 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x557039a95ee0 0x557039a982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:34.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.955+0000 7f5f397fa640 10 client.18219 ms_handle_connect on v2:172.21.15.155:6836/3381010945 2024-09-19T09:03:34.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.955+0000 7f5f55e97640 1 --2- 172.21.15.19:0/255313519 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x557039a95ee0 0x557039a982d0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=cc8ad615abb24503 server_cookie=da1739f76d63d83d in_seq=0 out_seq=0 2024-09-19T09:03:34.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.955+0000 7f5f397fa640 1 -- 172.21.15.19:0/255313519 <== mds.3 v2:172.21.15.155:6836/3381010945 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55703997dd70 con 0x557039a95ee0 2024-09-19T09:03:34.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.955+0000 7f5f397fa640 10 client.18219 handle_command_reply: tid=0 2024-09-19T09:03:34.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.955+0000 7f5f5a4d4740 1 client.18219 shutdown 2024-09-19T09:03:34.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.955+0000 7f5f5a4d4740 1 -- 172.21.15.19:0/255313519 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557039a105d0 msgr2=0x557039a23d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:34.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.955+0000 7f5f5a4d4740 1 --2- 172.21.15.19:0/255313519 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557039a105d0 0x557039a23d50 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f5f40004810 tx=0x7f5f40014b20 comp rx=0 tx=0).stop 2024-09-19T09:03:34.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.955+0000 7f5f5a4d4740 1 -- 172.21.15.19:0/255313519 shutdown_connections 2024-09-19T09:03:34.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.955+0000 7f5f5a4d4740 1 --2- 172.21.15.19:0/255313519 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x557039a95ee0 0x557039a982d0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.955+0000 7f5f5a4d4740 1 --2- 172.21.15.19:0/255313519 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557039a1b370 0x557039a155c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.955+0000 7f5f5a4d4740 1 --2- 172.21.15.19:0/255313519 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557039a11b40 0x557039a14e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.955+0000 7f5f5a4d4740 1 --2- 172.21.15.19:0/255313519 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557039a105d0 0x557039a23d50 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.955+0000 7f5f397fa640 0 client.18219 ms_handle_reset on v2:172.21.15.155:6836/3381010945 2024-09-19T09:03:34.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.955+0000 7f5f5a4d4740 1 -- 172.21.15.19:0/255313519 >> 172.21.15.19:0/255313519 conn(0x5570399d9310 msgr2=0x557039a170b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:34.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.955+0000 7f5f5a4d4740 1 -- 172.21.15.19:0/255313519 shutdown_connections 2024-09-19T09:03:34.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.955+0000 7f5f5a4d4740 1 -- 172.21.15.19:0/255313519 wait complete. 2024-09-19T09:03:34.978 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.956+0000 7f5f5a4d4740 20 client.18219 trim_cache size 0 max 16384 2024-09-19T09:03:34.978 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:03:34.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.956+0000 7f5f580fb640 1 -- 172.21.15.19:0/2341693738 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5f3c0a32c0 msgr2=0x7f5f3c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:34.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.956+0000 7f5f580fb640 1 --2- 172.21.15.19:0/2341693738 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5f3c0a32c0 0x7f5f3c0a5780 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5f4809b420 tx=0x7f5f48090970 comp rx=0 tx=0).stop 2024-09-19T09:03:34.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.956+0000 7f5f580fb640 1 -- 172.21.15.19:0/2341693738 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f5010c180 msgr2=0x7f5f50101480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:34.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.956+0000 7f5f580fb640 1 --2- 172.21.15.19:0/2341693738 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f5010c180 0x7f5f50101480 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f5f4800b970 tx=0x7f5f4800be30 comp rx=0 tx=0).stop 2024-09-19T09:03:34.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.956+0000 7f5f580fb640 1 -- 172.21.15.19:0/2341693738 shutdown_connections 2024-09-19T09:03:34.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.956+0000 7f5f580fb640 1 --2- 172.21.15.19:0/2341693738 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5f3c0a32c0 0x7f5f3c0a5780 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.956+0000 7f5f580fb640 1 --2- 172.21.15.19:0/2341693738 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5f5010c180 0x7f5f50101480 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.956+0000 7f5f580fb640 1 --2- 172.21.15.19:0/2341693738 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5f501036c0 0x7f5f50100f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.956+0000 7f5f580fb640 1 --2- 172.21.15.19:0/2341693738 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f50102da0 0x7f5f50100a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:34.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.956+0000 7f5f580fb640 1 -- 172.21.15.19:0/2341693738 >> 172.21.15.19:0/2341693738 conn(0x7f5f500fc7a0 msgr2=0x7f5f500fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:34.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.956+0000 7f5f580fb640 1 -- 172.21.15.19:0/2341693738 shutdown_connections 2024-09-19T09:03:34.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:34.956+0000 7f5f580fb640 1 -- 172.21.15.19:0/2341693738 wait complete. 2024-09-19T09:03:35.636 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:03:35.894 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:36.159 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:35 smithi019 ceph-mon[30976]: pgmap v680: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.6 KiB/s wr, 19 op/s 2024-09-19T09:03:36.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:35 smithi155 ceph-mon[34921]: pgmap v680: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.6 KiB/s wr, 19 op/s 2024-09-19T09:03:36.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:35 smithi203 ceph-mon[35450]: pgmap v680: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.6 KiB/s wr, 19 op/s 2024-09-19T09:03:36.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.378+0000 7feca2134640 1 -- 172.21.15.19:0/3332196115 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec9c102ef0 msgr2=0x7fec9c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:36.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.378+0000 7feca2134640 1 --2- 172.21.15.19:0/3332196115 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec9c102ef0 0x7fec9c10da40 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fec94009ca0 tx=0x7fec9402a950 comp rx=0 tx=0).stop 2024-09-19T09:03:36.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.379+0000 7feca2134640 1 -- 172.21.15.19:0/3332196115 shutdown_connections 2024-09-19T09:03:36.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.379+0000 7feca2134640 1 --2- 172.21.15.19:0/3332196115 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec9c102ef0 0x7fec9c10da40 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:36.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.379+0000 7feca2134640 1 --2- 172.21.15.19:0/3332196115 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec9c102570 0x7fec9c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:36.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.379+0000 7feca2134640 1 --2- 172.21.15.19:0/3332196115 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec9c100e20 0x7fec9c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:36.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.379+0000 7feca2134640 1 -- 172.21.15.19:0/3332196115 >> 172.21.15.19:0/3332196115 conn(0x7fec9c0fc7d0 msgr2=0x7fec9c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:36.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.379+0000 7feca2134640 1 -- 172.21.15.19:0/3332196115 shutdown_connections 2024-09-19T09:03:36.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.379+0000 7feca2134640 1 -- 172.21.15.19:0/3332196115 wait complete. 2024-09-19T09:03:36.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.379+0000 7feca2134640 1 Processor -- start 2024-09-19T09:03:36.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.379+0000 7feca2134640 1 -- start start 2024-09-19T09:03:36.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.379+0000 7feca2134640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec9c100e20 0x7fec9c19a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:36.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.379+0000 7feca2134640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec9c102570 0x7fec9c19aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:36.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.379+0000 7feca2134640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec9c102ef0 0x7fec9c19ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:36.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.379+0000 7feca2134640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fec9c110fa0 con 0x7fec9c102570 2024-09-19T09:03:36.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.379+0000 7feca2134640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fec9c110e20 con 0x7fec9c100e20 2024-09-19T09:03:36.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.379+0000 7feca2134640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fec9c111120 con 0x7fec9c102ef0 2024-09-19T09:03:36.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.380+0000 7fec93fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec9c102570 0x7fec9c19aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:36.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.380+0000 7fec93fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec9c102570 0x7fec9c19aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43920/0 (socket says 172.21.15.19:43920) 2024-09-19T09:03:36.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.380+0000 7fec93fff640 1 -- 172.21.15.19:0/3345738856 learned_addr learned my addr 172.21.15.19:0/3345738856 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:36.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.380+0000 7fec9bfff640 1 --2- 172.21.15.19:0/3345738856 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec9c102ef0 0x7fec9c19ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:36.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.380+0000 7fec9b7fe640 1 --2- 172.21.15.19:0/3345738856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec9c100e20 0x7fec9c19a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:36.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.380+0000 7fec93fff640 1 -- 172.21.15.19:0/3345738856 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec9c102ef0 msgr2=0x7fec9c19ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:36.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.380+0000 7fec93fff640 1 --2- 172.21.15.19:0/3345738856 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec9c102ef0 0x7fec9c19ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:36.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.380+0000 7fec93fff640 1 -- 172.21.15.19:0/3345738856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec9c100e20 msgr2=0x7fec9c19a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:36.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.380+0000 7fec93fff640 1 --2- 172.21.15.19:0/3345738856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec9c100e20 0x7fec9c19a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:36.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.380+0000 7fec93fff640 1 -- 172.21.15.19:0/3345738856 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec9c19f610 con 0x7fec9c102570 2024-09-19T09:03:36.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.380+0000 7fec9bfff640 1 --2- 172.21.15.19:0/3345738856 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec9c102ef0 0x7fec9c19ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:36.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.380+0000 7fec93fff640 1 --2- 172.21.15.19:0/3345738856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec9c102570 0x7fec9c19aba0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fec8400c920 tx=0x7fec8400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:36.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.380+0000 7fec997fa640 1 -- 172.21.15.19:0/3345738856 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec84007c70 con 0x7fec9c102570 2024-09-19T09:03:36.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.380+0000 7fec997fa640 1 -- 172.21.15.19:0/3345738856 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec84007e10 con 0x7fec9c102570 2024-09-19T09:03:36.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.380+0000 7feca2134640 1 -- 172.21.15.19:0/3345738856 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec9c19f900 con 0x7fec9c102570 2024-09-19T09:03:36.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.380+0000 7fec997fa640 1 -- 172.21.15.19:0/3345738856 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec84018890 con 0x7fec9c102570 2024-09-19T09:03:36.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.380+0000 7feca2134640 1 -- 172.21.15.19:0/3345738856 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec9c1a71e0 con 0x7fec9c102570 2024-09-19T09:03:36.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.383+0000 7feca450d740 1 Processor -- start 2024-09-19T09:03:36.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.383+0000 7fec997fa640 1 -- 172.21.15.19:0/3345738856 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fec84018a70 con 0x7fec9c102570 2024-09-19T09:03:36.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.384+0000 7feca450d740 1 -- start start 2024-09-19T09:03:36.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.384+0000 7feca450d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfe365bb40 0x55bfe365a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:36.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.384+0000 7feca450d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bfe365a5d0 0x55bfe365aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:36.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.384+0000 7feca450d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfe3665370 0x55bfe3667760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:36.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.384+0000 7feca450d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55bfe35c02f0 con 0x55bfe365a5d0 2024-09-19T09:03:36.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.384+0000 7feca450d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55bfe3567cf0 con 0x55bfe365bb40 2024-09-19T09:03:36.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.384+0000 7feca450d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55bfe35bc2b0 con 0x55bfe3665370 2024-09-19T09:03:36.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.384+0000 7fec9b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bfe365a5d0 0x55bfe365aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:36.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.384+0000 7fec9b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bfe365a5d0 0x55bfe365aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43922/0 (socket says 172.21.15.19:43922) 2024-09-19T09:03:36.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.384+0000 7fec9b7fe640 1 -- 172.21.15.19:0/752341165 learned_addr learned my addr 172.21.15.19:0/752341165 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:36.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.384+0000 7fec93fff640 1 --2- 172.21.15.19:0/752341165 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfe3665370 0x55bfe3667760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:36.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.384+0000 7fec9bfff640 1 --2- 172.21.15.19:0/752341165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfe365bb40 0x55bfe365a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:36.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.384+0000 7fec9b7fe640 1 -- 172.21.15.19:0/752341165 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfe3665370 msgr2=0x55bfe3667760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:36.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.384+0000 7fec9b7fe640 1 --2- 172.21.15.19:0/752341165 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfe3665370 0x55bfe3667760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:36.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.384+0000 7fec9b7fe640 1 -- 172.21.15.19:0/752341165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfe365bb40 msgr2=0x55bfe365a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:36.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.384+0000 7fec9b7fe640 1 --2- 172.21.15.19:0/752341165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfe365bb40 0x55bfe365a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:36.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.384+0000 7fec9b7fe640 1 -- 172.21.15.19:0/752341165 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfe354c3a0 con 0x55bfe365a5d0 2024-09-19T09:03:36.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.384+0000 7fec93fff640 1 --2- 172.21.15.19:0/752341165 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfe3665370 0x55bfe3667760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:36.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.384+0000 7fec997fa640 1 --2- 172.21.15.19:0/3345738856 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fec880a32c0 0x7fec880a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:36.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.384+0000 7fec9bfff640 1 --2- 172.21.15.19:0/3345738856 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fec880a32c0 0x7fec880a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:36.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.384+0000 7fec9b7fe640 1 --2- 172.21.15.19:0/752341165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bfe365a5d0 0x55bfe365aa10 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fec8c00b820 tx=0x7fec8c00bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e466ce06a1289dcc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:36.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.385+0000 7fec997fa640 1 -- 172.21.15.19:0/3345738856 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7fec840cfad0 con 0x7fec9c102570 2024-09-19T09:03:36.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.385+0000 7fec91ffb640 1 -- 172.21.15.19:0/752341165 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8c00d950 con 0x55bfe365a5d0 2024-09-19T09:03:36.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.385+0000 7fec91ffb640 1 -- 172.21.15.19:0/752341165 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec8c019070 con 0x55bfe365a5d0 2024-09-19T09:03:36.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.385+0000 7fec91ffb640 1 -- 172.21.15.19:0/752341165 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec8c0123e0 con 0x55bfe365a5d0 2024-09-19T09:03:36.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.385+0000 7feca450d740 1 -- 172.21.15.19:0/752341165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bfe365a5d0 msgr2=0x55bfe365aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:36.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.385+0000 7fec9bfff640 1 --2- 172.21.15.19:0/3345738856 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fec880a32c0 0x7fec880a5780 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fec94005cc0 tx=0x7fec94005c30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:36.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.385+0000 7feca450d740 1 --2- 172.21.15.19:0/752341165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bfe365a5d0 0x55bfe365aa10 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fec8c00b820 tx=0x7fec8c00bce0 comp rx=0 tx=0).stop 2024-09-19T09:03:36.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.385+0000 7feca450d740 1 -- 172.21.15.19:0/752341165 shutdown_connections 2024-09-19T09:03:36.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.385+0000 7feca450d740 1 --2- 172.21.15.19:0/752341165 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfe3665370 0x55bfe3667760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:36.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.385+0000 7feca450d740 1 --2- 172.21.15.19:0/752341165 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bfe365a5d0 0x55bfe365aa10 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:36.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.385+0000 7feca450d740 1 --2- 172.21.15.19:0/752341165 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfe365bb40 0x55bfe365a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:36.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.385+0000 7feca450d740 1 -- 172.21.15.19:0/752341165 >> 172.21.15.19:0/752341165 conn(0x55bfe3623310 msgr2=0x55bfe3656c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:36.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.385+0000 7feca450d740 1 -- 172.21.15.19:0/752341165 shutdown_connections 2024-09-19T09:03:36.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.385+0000 7feca450d740 1 -- 172.21.15.19:0/752341165 wait complete. 2024-09-19T09:03:36.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.386+0000 7feca450d740 1 -- start start 2024-09-19T09:03:36.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.386+0000 7feca450d740 1 Processor -- start 2024-09-19T09:03:36.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.386+0000 7feca450d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfe365a5d0 0x55bfe3664cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:36.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.386+0000 7feca450d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfe365bb40 0x55bfe3661f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:36.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.386+0000 7feca450d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bfe3665370 0x55bfe36624e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:36.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.386+0000 7feca450d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55bfe3668070 con 0x55bfe3665370 2024-09-19T09:03:36.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.386+0000 7feca450d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55bfe357b060 con 0x55bfe365bb40 2024-09-19T09:03:36.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.386+0000 7feca450d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55bfe36681f0 con 0x55bfe365a5d0 2024-09-19T09:03:36.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.386+0000 7feca450d740 10 client.0 _ll_register_callbacks cb 0x55bfe32ce8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:36.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.387+0000 7fec9bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bfe3665370 0x55bfe36624e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:36.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.387+0000 7fec9bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bfe3665370 0x55bfe36624e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43938/0 (socket says 172.21.15.19:43938) 2024-09-19T09:03:36.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.387+0000 7fec9bfff640 1 -- 172.21.15.19:0/3738405259 learned_addr learned my addr 172.21.15.19:0/3738405259 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:36.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.387+0000 7fec93fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfe365bb40 0x55bfe3661f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:36.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.387+0000 7fec9b7fe640 1 --2- 172.21.15.19:0/3738405259 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfe365a5d0 0x55bfe3664cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:36.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.387+0000 7fec9bfff640 1 -- 172.21.15.19:0/3738405259 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfe365a5d0 msgr2=0x55bfe3664cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:36.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.387+0000 7fec9bfff640 1 --2- 172.21.15.19:0/3738405259 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfe365a5d0 0x55bfe3664cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:36.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.387+0000 7fec9bfff640 1 -- 172.21.15.19:0/3738405259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfe365bb40 msgr2=0x55bfe3661f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:36.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.387+0000 7fec9bfff640 1 --2- 172.21.15.19:0/3738405259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfe365bb40 0x55bfe3661f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:36.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.387+0000 7fec9bfff640 1 -- 172.21.15.19:0/3738405259 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfe33313c0 con 0x55bfe3665370 2024-09-19T09:03:36.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.387+0000 7fec9bfff640 1 --2- 172.21.15.19:0/3738405259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bfe3665370 0x55bfe36624e0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fec94035000 tx=0x7fec9402a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bff829f37b368cfd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:36.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.387+0000 7fec7affd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:36.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.387+0000 7fec7affd640 1 -- 172.21.15.19:0/3738405259 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec94034040 con 0x55bfe3665370 2024-09-19T09:03:36.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.387+0000 7fec7affd640 1 -- 172.21.15.19:0/3738405259 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7fec94003fb0 con 0x55bfe3665370 2024-09-19T09:03:36.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.387+0000 7feca450d740 1 -- 172.21.15.19:0/3738405259 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec8c019070 con 0x55bfe3665370 2024-09-19T09:03:36.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.387+0000 7fec7affd640 1 -- 172.21.15.19:0/3738405259 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fec940041b0 con 0x55bfe3665370 2024-09-19T09:03:36.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.388+0000 7feca450d740 10 client.18231 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:36.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.388+0000 7feca450d740 1 -- 172.21.15.19:0/3738405259 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55bfe36739f0 con 0x55bfe3665370 2024-09-19T09:03:36.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.388+0000 7fec7affd640 1 -- 172.21.15.19:0/3738405259 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec8c019070 con 0x55bfe3665370 2024-09-19T09:03:36.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.388+0000 7fec7affd640 1 -- 172.21.15.19:0/3738405259 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7fec9405a020 con 0x55bfe3665370 2024-09-19T09:03:36.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.388+0000 7feca450d740 10 client.18231 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:36.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.388+0000 7feca450d740 10 client.18231 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T09:03:36.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.388+0000 7feca450d740 20 client.18231 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:36.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.388+0000 7feca450d740 1 --2- 172.21.15.19:0/3738405259 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55bfe3674e50 0x55bfe36772a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:36.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.388+0000 7feca450d740 4 client.18231 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:36.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.388+0000 7feca450d740 1 -- 172.21.15.19:0/3738405259 --> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bfe35cd860 con 0x55bfe3674e50 2024-09-19T09:03:36.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.388+0000 7fec9b7fe640 1 --2- 172.21.15.19:0/3738405259 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55bfe3674e50 0x55bfe36772a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:36.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.389+0000 7fec9b7fe640 1 --2- 172.21.15.19:0/3738405259 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55bfe3674e50 0x55bfe36772a0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5211e9a5e3bed6c4 server_cookie=abdbac6716bb483f in_seq=0 out_seq=0 2024-09-19T09:03:36.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.389+0000 7fec7affd640 10 client.18231 ms_handle_connect on v2:172.21.15.203:6836/3684671619 2024-09-19T09:03:36.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.389+0000 7fec7affd640 1 -- 172.21.15.19:0/3738405259 <== mds.2 v2:172.21.15.203:6836/3684671619 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bfe35cd860 con 0x55bfe3674e50 2024-09-19T09:03:36.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.389+0000 7fec7affd640 10 client.18231 handle_command_reply: tid=0 2024-09-19T09:03:36.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.389+0000 7feca450d740 1 client.18231 shutdown 2024-09-19T09:03:36.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.390+0000 7feca450d740 1 -- 172.21.15.19:0/3738405259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bfe3665370 msgr2=0x55bfe36624e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:36.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.390+0000 7feca450d740 1 --2- 172.21.15.19:0/3738405259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bfe3665370 0x55bfe36624e0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fec94035000 tx=0x7fec9402a950 comp rx=0 tx=0).stop 2024-09-19T09:03:36.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.390+0000 7feca450d740 1 -- 172.21.15.19:0/3738405259 shutdown_connections 2024-09-19T09:03:36.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.390+0000 7feca450d740 1 --2- 172.21.15.19:0/3738405259 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55bfe3674e50 0x55bfe36772a0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:36.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.390+0000 7feca450d740 1 --2- 172.21.15.19:0/3738405259 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bfe3665370 0x55bfe36624e0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:36.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.390+0000 7feca450d740 1 --2- 172.21.15.19:0/3738405259 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfe365bb40 0x55bfe3661f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:36.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.390+0000 7fec7affd640 0 client.18231 ms_handle_reset on v2:172.21.15.203:6836/3684671619 2024-09-19T09:03:36.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.390+0000 7feca450d740 1 --2- 172.21.15.19:0/3738405259 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfe365a5d0 0x55bfe3664cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:36.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.390+0000 7feca450d740 1 -- 172.21.15.19:0/3738405259 >> 172.21.15.19:0/3738405259 conn(0x55bfe3623310 msgr2=0x55bfe365c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:36.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.390+0000 7feca450d740 1 -- 172.21.15.19:0/3738405259 shutdown_connections 2024-09-19T09:03:36.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.390+0000 7feca450d740 1 -- 172.21.15.19:0/3738405259 wait complete. 2024-09-19T09:03:36.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.390+0000 7feca450d740 20 client.18231 trim_cache size 0 max 16384 2024-09-19T09:03:36.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.403+0000 7feca450d740 1 Processor -- start 2024-09-19T09:03:36.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.403+0000 7feca450d740 1 -- start start 2024-09-19T09:03:36.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.403+0000 7feca450d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfe365a5d0 0x55bfe3655bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:36.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.403+0000 7feca450d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bfe365bb40 0x55bfe365d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:36.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.403+0000 7feca450d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfe3665370 0x55bfe365d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:36.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.403+0000 7feca450d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fec9c1af730 con 0x55bfe365bb40 2024-09-19T09:03:36.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.403+0000 7feca450d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fec9c1b1270 con 0x55bfe365a5d0 2024-09-19T09:03:36.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.403+0000 7feca450d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fec9c1afe00 con 0x55bfe3665370 2024-09-19T09:03:36.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.403+0000 7fec93fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bfe365bb40 0x55bfe365d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:36.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.403+0000 7fec93fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bfe365bb40 0x55bfe365d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43944/0 (socket says 172.21.15.19:43944) 2024-09-19T09:03:36.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.403+0000 7fec93fff640 1 -- 172.21.15.19:0/2528574096 learned_addr learned my addr 172.21.15.19:0/2528574096 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:36.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.403+0000 7fec9bfff640 1 --2- 172.21.15.19:0/2528574096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfe3665370 0x55bfe365d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:36.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.403+0000 7fec9b7fe640 1 --2- 172.21.15.19:0/2528574096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfe365a5d0 0x55bfe3655bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:36.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.404+0000 7fec93fff640 1 -- 172.21.15.19:0/2528574096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfe3665370 msgr2=0x55bfe365d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:36.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.404+0000 7fec93fff640 1 --2- 172.21.15.19:0/2528574096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfe3665370 0x55bfe365d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:36.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.404+0000 7fec93fff640 1 -- 172.21.15.19:0/2528574096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfe365a5d0 msgr2=0x55bfe3655bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:36.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.404+0000 7fec93fff640 1 --2- 172.21.15.19:0/2528574096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfe365a5d0 0x55bfe3655bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:36.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.404+0000 7fec93fff640 1 -- 172.21.15.19:0/2528574096 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bfe36648f0 con 0x55bfe365bb40 2024-09-19T09:03:36.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.404+0000 7fec93fff640 1 --2- 172.21.15.19:0/2528574096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bfe365bb40 0x55bfe365d120 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fec84007590 tx=0x7fec84020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82b3e0ced40af8cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:36.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.404+0000 7fec917fa640 1 -- 172.21.15.19:0/2528574096 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec840a4d70 con 0x55bfe365bb40 2024-09-19T09:03:36.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.404+0000 7fec917fa640 1 -- 172.21.15.19:0/2528574096 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec8409a1a0 con 0x55bfe365bb40 2024-09-19T09:03:36.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.404+0000 7fec917fa640 1 -- 172.21.15.19:0/2528574096 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec840bc0b0 con 0x55bfe365bb40 2024-09-19T09:03:36.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.404+0000 7feca450d740 1 -- 172.21.15.19:0/2528574096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bfe365bb40 msgr2=0x55bfe365d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:36.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.404+0000 7feca450d740 1 --2- 172.21.15.19:0/2528574096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bfe365bb40 0x55bfe365d120 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fec84007590 tx=0x7fec84020000 comp rx=0 tx=0).stop 2024-09-19T09:03:36.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.405+0000 7feca450d740 1 -- 172.21.15.19:0/2528574096 shutdown_connections 2024-09-19T09:03:36.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.405+0000 7feca450d740 1 --2- 172.21.15.19:0/2528574096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfe3665370 0x55bfe365d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:36.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.405+0000 7feca450d740 1 --2- 172.21.15.19:0/2528574096 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bfe365bb40 0x55bfe365d120 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:36.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.405+0000 7feca450d740 1 --2- 172.21.15.19:0/2528574096 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfe365a5d0 0x55bfe3655bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:36.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.405+0000 7feca450d740 1 -- 172.21.15.19:0/2528574096 >> 172.21.15.19:0/2528574096 conn(0x55bfe3623310 msgr2=0x55bfe36554e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:36.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.405+0000 7feca450d740 1 -- 172.21.15.19:0/2528574096 shutdown_connections 2024-09-19T09:03:36.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.405+0000 7feca450d740 1 -- 172.21.15.19:0/2528574096 wait complete. 2024-09-19T09:03:36.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.405+0000 7feca450d740 1 -- start start 2024-09-19T09:03:36.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.405+0000 7feca450d740 1 Processor -- start 2024-09-19T09:03:36.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.405+0000 7feca450d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfe365a5d0 0x55bfe3669440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:36.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.405+0000 7feca450d740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bfe365bb40 0x55bfe3669980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:36.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.405+0000 7feca450d740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfe3665370 0x55bfe3669ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:36.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.405+0000 7feca450d740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fec9c1b0ba0 con 0x55bfe365bb40 2024-09-19T09:03:36.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.405+0000 7feca450d740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fec9c1b04d0 con 0x55bfe3665370 2024-09-19T09:03:36.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.405+0000 7feca450d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fec9c1ad710 con 0x55bfe365a5d0 2024-09-19T09:03:36.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.406+0000 7feca450d740 10 client.0 _ll_register_callbacks cb 0x7fec94009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:36.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.406+0000 7fec93fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bfe365bb40 0x55bfe3669980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:36.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.406+0000 7fec93fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bfe365bb40 0x55bfe3669980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43960/0 (socket says 172.21.15.19:43960) 2024-09-19T09:03:36.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.406+0000 7fec93fff640 1 -- 172.21.15.19:0/1983459641 learned_addr learned my addr 172.21.15.19:0/1983459641 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:36.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.406+0000 7fec9b7fe640 1 --2- 172.21.15.19:0/1983459641 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfe365a5d0 0x55bfe3669440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:36.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.406+0000 7fec9bfff640 1 --2- 172.21.15.19:0/1983459641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfe3665370 0x55bfe3669ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:36.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.406+0000 7fec93fff640 1 -- 172.21.15.19:0/1983459641 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfe365a5d0 msgr2=0x55bfe3669440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:36.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.406+0000 7fec93fff640 1 --2- 172.21.15.19:0/1983459641 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfe365a5d0 0x55bfe3669440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:36.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.406+0000 7fec93fff640 1 -- 172.21.15.19:0/1983459641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfe3665370 msgr2=0x55bfe3669ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:36.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.406+0000 7fec93fff640 1 --2- 172.21.15.19:0/1983459641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfe3665370 0x55bfe3669ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:36.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.406+0000 7fec93fff640 1 -- 172.21.15.19:0/1983459641 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bfe36ded90 con 0x55bfe365bb40 2024-09-19T09:03:36.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.406+0000 7fec9bfff640 1 --2- 172.21.15.19:0/1983459641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfe3665370 0x55bfe3669ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:36.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.406+0000 7fec93fff640 1 --2- 172.21.15.19:0/1983459641 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bfe365bb40 0x55bfe3669980 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fec84098ad0 tx=0x7fec8400ff30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2384d1123b614cef server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:36.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.406+0000 7fec7affd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:36.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.406+0000 7fec7affd640 1 -- 172.21.15.19:0/1983459641 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec84018d60 con 0x55bfe365bb40 2024-09-19T09:03:36.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.406+0000 7fec7affd640 1 -- 172.21.15.19:0/1983459641 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7fec840a0170 con 0x55bfe365bb40 2024-09-19T09:03:36.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.406+0000 7feca450d740 1 -- 172.21.15.19:0/1983459641 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec8409a1a0 con 0x55bfe365bb40 2024-09-19T09:03:36.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.406+0000 7fec7affd640 1 -- 172.21.15.19:0/1983459641 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fec840bc0b0 con 0x55bfe365bb40 2024-09-19T09:03:36.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.406+0000 7feca450d740 10 client.18237 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:36.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.406+0000 7feca450d740 1 -- 172.21.15.19:0/1983459641 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55bfe36e0090 con 0x55bfe365bb40 2024-09-19T09:03:36.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.407+0000 7fec7affd640 1 -- 172.21.15.19:0/1983459641 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fec8409a1a0 con 0x55bfe365bb40 2024-09-19T09:03:36.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.407+0000 7fec7affd640 1 -- 172.21.15.19:0/1983459641 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7fec8409b550 con 0x55bfe365bb40 2024-09-19T09:03:36.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.407+0000 7feca450d740 10 client.18237 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:36.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.407+0000 7feca450d740 10 client.18237 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T09:03:36.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.407+0000 7feca450d740 20 client.18237 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:36.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.407+0000 7feca450d740 1 --2- 172.21.15.19:0/1983459641 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55bfe36e06a0 0x55bfe36e2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:36.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.407+0000 7feca450d740 4 client.18237 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:03:36.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.407+0000 7feca450d740 1 -- 172.21.15.19:0/1983459641 --> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bfe35c7d70 con 0x55bfe36e06a0 2024-09-19T09:03:36.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.407+0000 7fec9b7fe640 1 --2- 172.21.15.19:0/1983459641 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55bfe36e06a0 0x55bfe36e2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:36.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.408+0000 7fec7affd640 10 client.18237 ms_handle_connect on v2:172.21.15.203:6836/3684671619 2024-09-19T09:03:36.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.408+0000 7fec9b7fe640 1 --2- 172.21.15.19:0/1983459641 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55bfe36e06a0 0x55bfe36e2a90 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=adfeb7a3a39cc12 server_cookie=d5d87f6399c8291a in_seq=0 out_seq=0 2024-09-19T09:03:36.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.408+0000 7fec7affd640 1 -- 172.21.15.19:0/1983459641 <== mds.2 v2:172.21.15.203:6836/3684671619 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bfe35c7d70 con 0x55bfe36e06a0 2024-09-19T09:03:36.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.408+0000 7fec7affd640 10 client.18237 handle_command_reply: tid=0 2024-09-19T09:03:36.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.408+0000 7feca450d740 1 client.18237 shutdown 2024-09-19T09:03:36.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.408+0000 7feca450d740 1 -- 172.21.15.19:0/1983459641 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bfe365bb40 msgr2=0x55bfe3669980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:36.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.408+0000 7feca450d740 1 --2- 172.21.15.19:0/1983459641 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bfe365bb40 0x55bfe3669980 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fec84098ad0 tx=0x7fec8400ff30 comp rx=0 tx=0).stop 2024-09-19T09:03:36.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.408+0000 7feca450d740 1 -- 172.21.15.19:0/1983459641 shutdown_connections 2024-09-19T09:03:36.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.408+0000 7feca450d740 1 --2- 172.21.15.19:0/1983459641 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55bfe36e06a0 0x55bfe36e2a90 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:36.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.408+0000 7feca450d740 1 --2- 172.21.15.19:0/1983459641 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55bfe3665370 0x55bfe3669ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:36.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.408+0000 7feca450d740 1 --2- 172.21.15.19:0/1983459641 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55bfe365bb40 0x55bfe3669980 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:36.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.408+0000 7fec7affd640 0 client.18237 ms_handle_reset on v2:172.21.15.203:6836/3684671619 2024-09-19T09:03:36.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.408+0000 7feca450d740 1 --2- 172.21.15.19:0/1983459641 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bfe365a5d0 0x55bfe3669440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:36.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.408+0000 7feca450d740 1 -- 172.21.15.19:0/1983459641 >> 172.21.15.19:0/1983459641 conn(0x55bfe3623310 msgr2=0x55bfe3664000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:36.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.408+0000 7feca450d740 1 -- 172.21.15.19:0/1983459641 shutdown_connections 2024-09-19T09:03:36.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.408+0000 7feca450d740 1 -- 172.21.15.19:0/1983459641 wait complete. 2024-09-19T09:03:36.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.408+0000 7feca450d740 20 client.18237 trim_cache size 0 max 16384 2024-09-19T09:03:36.414 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:03:36.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.409+0000 7feca2134640 1 -- 172.21.15.19:0/3345738856 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fec880a32c0 msgr2=0x7fec880a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:36.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.409+0000 7feca2134640 1 --2- 172.21.15.19:0/3345738856 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fec880a32c0 0x7fec880a5780 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fec94005cc0 tx=0x7fec94005c30 comp rx=0 tx=0).stop 2024-09-19T09:03:36.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.409+0000 7feca2134640 1 -- 172.21.15.19:0/3345738856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec9c102570 msgr2=0x7fec9c19aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:36.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.409+0000 7feca2134640 1 --2- 172.21.15.19:0/3345738856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec9c102570 0x7fec9c19aba0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fec8400c920 tx=0x7fec8400cde0 comp rx=0 tx=0).stop 2024-09-19T09:03:36.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.409+0000 7feca2134640 1 -- 172.21.15.19:0/3345738856 shutdown_connections 2024-09-19T09:03:36.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.409+0000 7feca2134640 1 --2- 172.21.15.19:0/3345738856 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fec880a32c0 0x7fec880a5780 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:36.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.409+0000 7feca2134640 1 --2- 172.21.15.19:0/3345738856 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec9c102ef0 0x7fec9c19ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:36.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.409+0000 7feca2134640 1 --2- 172.21.15.19:0/3345738856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fec9c102570 0x7fec9c19aba0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:36.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.409+0000 7feca2134640 1 --2- 172.21.15.19:0/3345738856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fec9c100e20 0x7fec9c19a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:36.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.409+0000 7feca2134640 1 -- 172.21.15.19:0/3345738856 >> 172.21.15.19:0/3345738856 conn(0x7fec9c0fc7d0 msgr2=0x7fec9c06a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:36.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.409+0000 7feca2134640 1 -- 172.21.15.19:0/3345738856 shutdown_connections 2024-09-19T09:03:36.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:36.409+0000 7feca2134640 1 -- 172.21.15.19:0/3345738856 wait complete. 2024-09-19T09:03:37.118 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:03:37.379 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:37.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.854+0000 7f2a534c9640 1 -- 172.21.15.19:0/2184638894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a4c102570 msgr2=0x7f2a4c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:37.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.854+0000 7f2a534c9640 1 --2- 172.21.15.19:0/2184638894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a4c102570 0x7f2a4c1029b0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f2a40009900 tx=0x7f2a4002a480 comp rx=0 tx=0).stop 2024-09-19T09:03:37.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.855+0000 7f2a534c9640 1 -- 172.21.15.19:0/2184638894 shutdown_connections 2024-09-19T09:03:37.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.855+0000 7f2a534c9640 1 --2- 172.21.15.19:0/2184638894 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a4c102ef0 0x7f2a4c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.855+0000 7f2a534c9640 1 --2- 172.21.15.19:0/2184638894 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a4c102570 0x7f2a4c1029b0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.855+0000 7f2a534c9640 1 --2- 172.21.15.19:0/2184638894 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a4c100e20 0x7f2a4c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.855+0000 7f2a534c9640 1 -- 172.21.15.19:0/2184638894 >> 172.21.15.19:0/2184638894 conn(0x7f2a4c0fc7d0 msgr2=0x7f2a4c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:37.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.855+0000 7f2a534c9640 1 -- 172.21.15.19:0/2184638894 shutdown_connections 2024-09-19T09:03:37.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.855+0000 7f2a534c9640 1 -- 172.21.15.19:0/2184638894 wait complete. 2024-09-19T09:03:37.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.855+0000 7f2a534c9640 1 Processor -- start 2024-09-19T09:03:37.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.855+0000 7f2a534c9640 1 -- start start 2024-09-19T09:03:37.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.856+0000 7f2a534c9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a4c100e20 0x7f2a4c197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:37.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.856+0000 7f2a534c9640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a4c102570 0x7f2a4c197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:37.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.856+0000 7f2a534c9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a4c102ef0 0x7f2a4c19bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:37.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.856+0000 7f2a534c9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c110fd0 con 0x7f2a4c102ef0 2024-09-19T09:03:37.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.856+0000 7f2a534c9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c110e50 con 0x7f2a4c100e20 2024-09-19T09:03:37.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.856+0000 7f2a534c9640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c111150 con 0x7f2a4c102570 2024-09-19T09:03:37.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.856+0000 7f2a51a66640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a4c102ef0 0x7f2a4c19bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:37.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.856+0000 7f2a51a66640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a4c102ef0 0x7f2a4c19bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43978/0 (socket says 172.21.15.19:43978) 2024-09-19T09:03:37.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.856+0000 7f2a51a66640 1 -- 172.21.15.19:0/2809012192 learned_addr learned my addr 172.21.15.19:0/2809012192 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:37.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.856+0000 7f2a51265640 1 --2- 172.21.15.19:0/2809012192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a4c100e20 0x7f2a4c197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:37.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.856+0000 7f2a50a64640 1 --2- 172.21.15.19:0/2809012192 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a4c102570 0x7f2a4c197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:37.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.856+0000 7f2a51a66640 1 -- 172.21.15.19:0/2809012192 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a4c102570 msgr2=0x7f2a4c197890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:37.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.856+0000 7f2a51a66640 1 --2- 172.21.15.19:0/2809012192 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a4c102570 0x7f2a4c197890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.856+0000 7f2a51a66640 1 -- 172.21.15.19:0/2809012192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a4c100e20 msgr2=0x7f2a4c197350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:37.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.856+0000 7f2a51a66640 1 --2- 172.21.15.19:0/2809012192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a4c100e20 0x7f2a4c197350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.856+0000 7f2a51a66640 1 -- 172.21.15.19:0/2809012192 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a4c19c300 con 0x7f2a4c102ef0 2024-09-19T09:03:37.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.856+0000 7f2a51a66640 1 --2- 172.21.15.19:0/2809012192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a4c102ef0 0x7f2a4c19bc20 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f2a4400c970 tx=0x7f2a4400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:37.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.856+0000 7f2a4a7fc640 1 -- 172.21.15.19:0/2809012192 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a44007bb0 con 0x7f2a4c102ef0 2024-09-19T09:03:37.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.857+0000 7f2a4a7fc640 1 -- 172.21.15.19:0/2809012192 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a44007d50 con 0x7f2a4c102ef0 2024-09-19T09:03:37.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.857+0000 7f2a534c9640 1 -- 172.21.15.19:0/2809012192 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a4c19c5f0 con 0x7f2a4c102ef0 2024-09-19T09:03:37.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.857+0000 7f2a4a7fc640 1 -- 172.21.15.19:0/2809012192 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a44018800 con 0x7f2a4c102ef0 2024-09-19T09:03:37.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.857+0000 7f2a534c9640 1 -- 172.21.15.19:0/2809012192 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a4c1a3ed0 con 0x7f2a4c102ef0 2024-09-19T09:03:37.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.859+0000 7f2a4a7fc640 1 -- 172.21.15.19:0/2809012192 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f2a4400fa50 con 0x7f2a4c102ef0 2024-09-19T09:03:37.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.859+0000 7f2a558a2740 1 Processor -- start 2024-09-19T09:03:37.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.859+0000 7f2a558a2740 1 -- start start 2024-09-19T09:03:37.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.859+0000 7f2a558a2740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eec5c8fb40 0x55eec5c8e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:37.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.859+0000 7f2a558a2740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eec5c8e5d0 0x55eec5c8ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:37.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.860+0000 7f2a558a2740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eec5c9b580 0x55eec5c9d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:37.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.860+0000 7f2a558a2740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55eec5bf42f0 con 0x55eec5c9b580 2024-09-19T09:03:37.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.860+0000 7f2a558a2740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55eec5b9bcf0 con 0x55eec5c8fb40 2024-09-19T09:03:37.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.860+0000 7f2a558a2740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55eec5bf02b0 con 0x55eec5c8e5d0 2024-09-19T09:03:37.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.860+0000 7f2a4a7fc640 1 --2- 172.21.15.19:0/2809012192 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2a340a32c0 0x7f2a340a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:37.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.860+0000 7f2a50a64640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eec5c9b580 0x55eec5c9d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:37.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.860+0000 7f2a50a64640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eec5c9b580 0x55eec5c9d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43990/0 (socket says 172.21.15.19:43990) 2024-09-19T09:03:37.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.860+0000 7f2a50a64640 1 -- 172.21.15.19:0/2895889853 learned_addr learned my addr 172.21.15.19:0/2895889853 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:37.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.860+0000 7f2a51a66640 1 --2- 172.21.15.19:0/2809012192 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2a340a32c0 0x7f2a340a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:37.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.860+0000 7f2a51265640 1 --2- 172.21.15.19:0/2895889853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eec5c8e5d0 0x55eec5c8ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:37.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.860+0000 7f2a50a64640 1 --2- 172.21.15.19:0/2895889853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eec5c8fb40 0x55eec5c8e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:37.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.860+0000 7f2a4a7fc640 1 -- 172.21.15.19:0/2809012192 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f2a440cf870 con 0x7f2a4c102ef0 2024-09-19T09:03:37.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.860+0000 7f2a50a64640 1 -- 172.21.15.19:0/2895889853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eec5c8e5d0 msgr2=0x55eec5c8ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:37.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.860+0000 7f2a50a64640 1 --2- 172.21.15.19:0/2895889853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eec5c8e5d0 0x55eec5c8ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.860+0000 7f2a50a64640 1 -- 172.21.15.19:0/2895889853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eec5c8fb40 msgr2=0x55eec5c8e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:37.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.860+0000 7f2a50a64640 1 --2- 172.21.15.19:0/2895889853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eec5c8fb40 0x55eec5c8e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.860+0000 7f2a50a64640 1 -- 172.21.15.19:0/2895889853 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eec5b803a0 con 0x55eec5c9b580 2024-09-19T09:03:37.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.860+0000 7f2a50a64640 1 --2- 172.21.15.19:0/2895889853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eec5c9b580 0x55eec5c9d970 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f2a40009900 tx=0x7f2a40009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500a8b2b08449421 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:37.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.860+0000 7f2a51a66640 1 --2- 172.21.15.19:0/2809012192 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2a340a32c0 0x7f2a340a5780 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2a4409bdd0 tx=0x7f2a44096780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:37.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.860+0000 7f2a337fe640 1 -- 172.21.15.19:0/2895889853 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a40035070 con 0x55eec5c9b580 2024-09-19T09:03:37.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.861+0000 7f2a337fe640 1 -- 172.21.15.19:0/2895889853 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a40005500 con 0x55eec5c9b580 2024-09-19T09:03:37.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.861+0000 7f2a337fe640 1 -- 172.21.15.19:0/2895889853 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a40003960 con 0x55eec5c9b580 2024-09-19T09:03:37.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.861+0000 7f2a558a2740 1 -- 172.21.15.19:0/2895889853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eec5c9b580 msgr2=0x55eec5c9d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:37.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.861+0000 7f2a558a2740 1 --2- 172.21.15.19:0/2895889853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eec5c9b580 0x55eec5c9d970 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f2a40009900 tx=0x7f2a40009560 comp rx=0 tx=0).stop 2024-09-19T09:03:37.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.861+0000 7f2a558a2740 1 -- 172.21.15.19:0/2895889853 shutdown_connections 2024-09-19T09:03:37.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.861+0000 7f2a558a2740 1 --2- 172.21.15.19:0/2895889853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eec5c8e5d0 0x55eec5c8ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.861+0000 7f2a558a2740 1 --2- 172.21.15.19:0/2895889853 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eec5c9b580 0x55eec5c9d970 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.861+0000 7f2a558a2740 1 --2- 172.21.15.19:0/2895889853 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eec5c8fb40 0x55eec5c8e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.861+0000 7f2a558a2740 1 -- 172.21.15.19:0/2895889853 >> 172.21.15.19:0/2895889853 conn(0x55eec5c57310 msgr2=0x55eec5c8ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:37.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.861+0000 7f2a558a2740 1 -- 172.21.15.19:0/2895889853 shutdown_connections 2024-09-19T09:03:37.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.861+0000 7f2a558a2740 1 -- 172.21.15.19:0/2895889853 wait complete. 2024-09-19T09:03:37.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.862+0000 7f2a558a2740 1 -- start start 2024-09-19T09:03:37.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.862+0000 7f2a558a2740 1 Processor -- start 2024-09-19T09:03:37.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.862+0000 7f2a558a2740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eec5c8e5d0 0x55eec5c9aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:37.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.862+0000 7f2a558a2740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eec5c8fb40 0x55eec5c981a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:37.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.862+0000 7f2a558a2740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eec5c9b580 0x55eec5c98700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:37.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.862+0000 7f2a558a2740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55eec5c9e220 con 0x55eec5c8fb40 2024-09-19T09:03:37.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.862+0000 7f2a558a2740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55eec5baf060 con 0x55eec5c8e5d0 2024-09-19T09:03:37.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.862+0000 7f2a558a2740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55eec5c9e3a0 con 0x55eec5c9b580 2024-09-19T09:03:37.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.862+0000 7f2a558a2740 10 client.0 _ll_register_callbacks cb 0x55eec59028c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:37.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.862+0000 7f2a51265640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eec5c8fb40 0x55eec5c981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:37.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.862+0000 7f2a51265640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eec5c8fb40 0x55eec5c981a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:43996/0 (socket says 172.21.15.19:43996) 2024-09-19T09:03:37.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.862+0000 7f2a51265640 1 -- 172.21.15.19:0/178912405 learned_addr learned my addr 172.21.15.19:0/178912405 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:37.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.863+0000 7f2a50a64640 1 --2- 172.21.15.19:0/178912405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eec5c8e5d0 0x55eec5c9aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:37.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.863+0000 7f2a50a64640 1 --2- 172.21.15.19:0/178912405 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eec5c9b580 0x55eec5c98700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:37.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.863+0000 7f2a51265640 1 -- 172.21.15.19:0/178912405 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eec5c9b580 msgr2=0x55eec5c98700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:37.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.863+0000 7f2a51265640 1 --2- 172.21.15.19:0/178912405 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eec5c9b580 0x55eec5c98700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.863+0000 7f2a51265640 1 -- 172.21.15.19:0/178912405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eec5c8e5d0 msgr2=0x55eec5c9aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:37.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.863+0000 7f2a51265640 1 --2- 172.21.15.19:0/178912405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eec5c8e5d0 0x55eec5c9aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.863+0000 7f2a51265640 1 -- 172.21.15.19:0/178912405 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eec59653c0 con 0x55eec5c8fb40 2024-09-19T09:03:37.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.863+0000 7f2a50a64640 1 --2- 172.21.15.19:0/178912405 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eec5c9b580 0x55eec5c98700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:37.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.863+0000 7f2a51265640 1 --2- 172.21.15.19:0/178912405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eec5c8fb40 0x55eec5c981a0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c010c00 tx=0x7f2a3c00f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eddc4c477cba694a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:37.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.863+0000 7f2a30ff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:37.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.863+0000 7f2a30ff9640 1 -- 172.21.15.19:0/178912405 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c00e5c0 con 0x55eec5c8fb40 2024-09-19T09:03:37.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.863+0000 7f2a30ff9640 1 -- 172.21.15.19:0/178912405 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f2a3c00e760 con 0x55eec5c8fb40 2024-09-19T09:03:37.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.863+0000 7f2a558a2740 1 -- 172.21.15.19:0/178912405 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a40005500 con 0x55eec5c8fb40 2024-09-19T09:03:37.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.863+0000 7f2a30ff9640 1 -- 172.21.15.19:0/178912405 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f2a3c00e960 con 0x55eec5c8fb40 2024-09-19T09:03:37.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.863+0000 7f2a558a2740 10 client.18249 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:37.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.863+0000 7f2a558a2740 1 -- 172.21.15.19:0/178912405 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55eec5ca9cc0 con 0x55eec5c8fb40 2024-09-19T09:03:37.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.863+0000 7f2a30ff9640 1 -- 172.21.15.19:0/178912405 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a40005500 con 0x55eec5c8fb40 2024-09-19T09:03:37.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.864+0000 7f2a30ff9640 1 -- 172.21.15.19:0/178912405 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f2a3c01ace0 con 0x55eec5c8fb40 2024-09-19T09:03:37.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.864+0000 7f2a558a2740 10 client.18249 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:37.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.864+0000 7f2a558a2740 10 client.18249 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:03:37.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.864+0000 7f2a558a2740 20 client.18249 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:37.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.864+0000 7f2a558a2740 1 --2- 172.21.15.19:0/178912405 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55eec5cab190 0x55eec5cad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:37.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.864+0000 7f2a558a2740 4 client.18249 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:37.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.864+0000 7f2a558a2740 1 -- 172.21.15.19:0/178912405 --> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eec5c01860 con 0x55eec5cab190 2024-09-19T09:03:37.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.864+0000 7f2a50a64640 1 --2- 172.21.15.19:0/178912405 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55eec5cab190 0x55eec5cad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:37.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.865+0000 7f2a50a64640 1 --2- 172.21.15.19:0/178912405 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55eec5cab190 0x55eec5cad5b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c817f8a99b2ffb3b server_cookie=fabf2be7cebe3c67 in_seq=0 out_seq=0 2024-09-19T09:03:37.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.865+0000 7f2a30ff9640 10 client.18249 ms_handle_connect on v2:172.21.15.203:6838/2547507299 2024-09-19T09:03:37.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.865+0000 7f2a30ff9640 1 -- 172.21.15.19:0/178912405 <== mds.1 v2:172.21.15.203:6838/2547507299 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eec5c01860 con 0x55eec5cab190 2024-09-19T09:03:37.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.865+0000 7f2a30ff9640 10 client.18249 handle_command_reply: tid=0 2024-09-19T09:03:37.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.865+0000 7f2a558a2740 1 client.18249 shutdown 2024-09-19T09:03:37.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.865+0000 7f2a558a2740 1 -- 172.21.15.19:0/178912405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eec5c8fb40 msgr2=0x55eec5c981a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:37.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.865+0000 7f2a558a2740 1 --2- 172.21.15.19:0/178912405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eec5c8fb40 0x55eec5c981a0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c010c00 tx=0x7f2a3c00f7f0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.866+0000 7f2a558a2740 1 -- 172.21.15.19:0/178912405 shutdown_connections 2024-09-19T09:03:37.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.866+0000 7f2a558a2740 1 --2- 172.21.15.19:0/178912405 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55eec5cab190 0x55eec5cad5b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.866+0000 7f2a558a2740 1 --2- 172.21.15.19:0/178912405 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eec5c9b580 0x55eec5c98700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.866+0000 7f2a30ff9640 0 client.18249 ms_handle_reset on v2:172.21.15.203:6838/2547507299 2024-09-19T09:03:37.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.866+0000 7f2a558a2740 1 --2- 172.21.15.19:0/178912405 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eec5c8fb40 0x55eec5c981a0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.866+0000 7f2a558a2740 1 --2- 172.21.15.19:0/178912405 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eec5c8e5d0 0x55eec5c9aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.866+0000 7f2a558a2740 1 -- 172.21.15.19:0/178912405 >> 172.21.15.19:0/178912405 conn(0x55eec5c57310 msgr2=0x55eec5c90960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:37.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.866+0000 7f2a558a2740 1 -- 172.21.15.19:0/178912405 shutdown_connections 2024-09-19T09:03:37.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.866+0000 7f2a558a2740 1 -- 172.21.15.19:0/178912405 wait complete. 2024-09-19T09:03:37.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.866+0000 7f2a558a2740 20 client.18249 trim_cache size 0 max 16384 2024-09-19T09:03:37.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.879+0000 7f2a558a2740 1 Processor -- start 2024-09-19T09:03:37.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.879+0000 7f2a558a2740 1 -- start start 2024-09-19T09:03:37.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.879+0000 7f2a558a2740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eec5c8e5d0 0x55eec5ca74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:37.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.879+0000 7f2a558a2740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eec5c8fb40 0x55eec5c85ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:37.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.879+0000 7f2a558a2740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eec5c9b580 0x55eec5c9a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:37.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.879+0000 7f2a558a2740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c1ab200 con 0x55eec5c8fb40 2024-09-19T09:03:37.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.879+0000 7f2a558a2740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c1acd40 con 0x55eec5c8e5d0 2024-09-19T09:03:37.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.879+0000 7f2a558a2740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c1ab8d0 con 0x55eec5c9b580 2024-09-19T09:03:37.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.880+0000 7f2a50a64640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eec5c8e5d0 0x55eec5ca74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:37.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.880+0000 7f2a50a64640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eec5c8e5d0 0x55eec5ca74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:34530/0 (socket says 172.21.15.19:34530) 2024-09-19T09:03:37.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.880+0000 7f2a50a64640 1 -- 172.21.15.19:0/1340599696 learned_addr learned my addr 172.21.15.19:0/1340599696 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:37.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.880+0000 7f2a51265640 1 --2- 172.21.15.19:0/1340599696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eec5c8fb40 0x55eec5c85ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:37.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.880+0000 7f2a50a64640 1 --2- 172.21.15.19:0/1340599696 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eec5c9b580 0x55eec5c9a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:37.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.880+0000 7f2a50a64640 1 -- 172.21.15.19:0/1340599696 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eec5c9b580 msgr2=0x55eec5c9a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:37.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.880+0000 7f2a50a64640 1 --2- 172.21.15.19:0/1340599696 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eec5c9b580 0x55eec5c9a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.880+0000 7f2a50a64640 1 -- 172.21.15.19:0/1340599696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eec5c8fb40 msgr2=0x55eec5c85ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:37.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.880+0000 7f2a50a64640 1 --2- 172.21.15.19:0/1340599696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eec5c8fb40 0x55eec5c85ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.880+0000 7f2a50a64640 1 -- 172.21.15.19:0/1340599696 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eec5c8ade0 con 0x55eec5c8e5d0 2024-09-19T09:03:37.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.880+0000 7f2a51265640 1 --2- 172.21.15.19:0/1340599696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eec5c8fb40 0x55eec5c85ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:37.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.880+0000 7f2a50a64640 1 --2- 172.21.15.19:0/1340599696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eec5c8e5d0 0x55eec5ca74f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55eec5c8f070 tx=0x7f2a4004c040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db421cc1b5d70779 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:37.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.880+0000 7f2a32ffd640 1 -- 172.21.15.19:0/1340599696 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a40035040 con 0x55eec5c8e5d0 2024-09-19T09:03:37.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.880+0000 7f2a32ffd640 1 -- 172.21.15.19:0/1340599696 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2a40004c60 con 0x55eec5c8e5d0 2024-09-19T09:03:37.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.880+0000 7f2a32ffd640 1 -- 172.21.15.19:0/1340599696 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a40003d40 con 0x55eec5c8e5d0 2024-09-19T09:03:37.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.881+0000 7f2a558a2740 1 -- 172.21.15.19:0/1340599696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eec5c8e5d0 msgr2=0x55eec5ca74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:37.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.881+0000 7f2a558a2740 1 --2- 172.21.15.19:0/1340599696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eec5c8e5d0 0x55eec5ca74f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55eec5c8f070 tx=0x7f2a4004c040 comp rx=0 tx=0).stop 2024-09-19T09:03:37.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.881+0000 7f2a558a2740 1 -- 172.21.15.19:0/1340599696 shutdown_connections 2024-09-19T09:03:37.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.881+0000 7f2a558a2740 1 --2- 172.21.15.19:0/1340599696 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eec5c9b580 0x55eec5c9a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.881+0000 7f2a558a2740 1 --2- 172.21.15.19:0/1340599696 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eec5c8fb40 0x55eec5c85ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.881+0000 7f2a558a2740 1 --2- 172.21.15.19:0/1340599696 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eec5c8e5d0 0x55eec5ca74f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.881+0000 7f2a558a2740 1 -- 172.21.15.19:0/1340599696 >> 172.21.15.19:0/1340599696 conn(0x55eec5c57310 msgr2=0x55eec5c99a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:37.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.881+0000 7f2a558a2740 1 -- 172.21.15.19:0/1340599696 shutdown_connections 2024-09-19T09:03:37.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.881+0000 7f2a558a2740 1 -- 172.21.15.19:0/1340599696 wait complete. 2024-09-19T09:03:37.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.882+0000 7f2a558a2740 1 -- start start 2024-09-19T09:03:37.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.882+0000 7f2a558a2740 1 Processor -- start 2024-09-19T09:03:37.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.882+0000 7f2a558a2740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eec5c8e5d0 0x55eec5ca3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:37.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.882+0000 7f2a558a2740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eec5c8fb40 0x55eec5ca3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:37.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.882+0000 7f2a558a2740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eec5c9b580 0x55eec5c94820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:37.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.882+0000 7f2a558a2740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c1ac670 con 0x55eec5c9b580 2024-09-19T09:03:37.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.882+0000 7f2a558a2740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c1abfa0 con 0x55eec5c8e5d0 2024-09-19T09:03:37.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.882+0000 7f2a558a2740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2a4c1a91e0 con 0x55eec5c8fb40 2024-09-19T09:03:37.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.882+0000 7f2a558a2740 10 client.0 _ll_register_callbacks cb 0x7f2a3c010810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:37.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.882+0000 7f2a50a64640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eec5c9b580 0x55eec5c94820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:37.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.882+0000 7f2a50a64640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eec5c9b580 0x55eec5c94820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44008/0 (socket says 172.21.15.19:44008) 2024-09-19T09:03:37.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.882+0000 7f2a50a64640 1 -- 172.21.15.19:0/2265106831 learned_addr learned my addr 172.21.15.19:0/2265106831 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:37.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.882+0000 7f2a50a64640 1 --2- 172.21.15.19:0/2265106831 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eec5c8e5d0 0x55eec5ca3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:37.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.883+0000 7f2a51265640 1 --2- 172.21.15.19:0/2265106831 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eec5c8fb40 0x55eec5ca3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:37.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.883+0000 7f2a50a64640 1 -- 172.21.15.19:0/2265106831 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eec5c8fb40 msgr2=0x55eec5ca3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:37.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.883+0000 7f2a50a64640 1 --2- 172.21.15.19:0/2265106831 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eec5c8fb40 0x55eec5ca3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.883+0000 7f2a50a64640 1 -- 172.21.15.19:0/2265106831 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eec5c8e5d0 msgr2=0x55eec5ca3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:37.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.883+0000 7f2a50a64640 1 --2- 172.21.15.19:0/2265106831 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eec5c8e5d0 0x55eec5ca3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.883+0000 7f2a50a64640 1 -- 172.21.15.19:0/2265106831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eec5c94d60 con 0x55eec5c9b580 2024-09-19T09:03:37.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.883+0000 7f2a50a64640 1 --2- 172.21.15.19:0/2265106831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eec5c9b580 0x55eec5c94820 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f2a40006010 tx=0x7f2a40003940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efe8b9db7064d42c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:37.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.883+0000 7f2a30ff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:37.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.883+0000 7f2a30ff9640 1 -- 172.21.15.19:0/2265106831 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a40035040 con 0x55eec5c9b580 2024-09-19T09:03:37.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.883+0000 7f2a558a2740 1 -- 172.21.15.19:0/2265106831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55eec5bfbd70 con 0x55eec5c9b580 2024-09-19T09:03:37.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.883+0000 7f2a30ff9640 1 -- 172.21.15.19:0/2265106831 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f2a400039e0 con 0x55eec5c9b580 2024-09-19T09:03:37.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.883+0000 7f2a30ff9640 1 -- 172.21.15.19:0/2265106831 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f2a40003be0 con 0x55eec5c9b580 2024-09-19T09:03:37.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.883+0000 7f2a558a2740 10 client.18255 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:37.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.883+0000 7f2a558a2740 1 -- 172.21.15.19:0/2265106831 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55eec5d15630 con 0x55eec5c9b580 2024-09-19T09:03:37.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.883+0000 7f2a30ff9640 1 -- 172.21.15.19:0/2265106831 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x55eec5bfbd70 con 0x55eec5c9b580 2024-09-19T09:03:37.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.884+0000 7f2a30ff9640 1 -- 172.21.15.19:0/2265106831 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f2a40053430 con 0x55eec5c9b580 2024-09-19T09:03:37.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.884+0000 7f2a558a2740 10 client.18255 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:37.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.884+0000 7f2a558a2740 10 client.18255 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:03:37.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.884+0000 7f2a558a2740 20 client.18255 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:37.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.884+0000 7f2a558a2740 1 --2- 172.21.15.19:0/2265106831 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55eec5d15800 0x55eec5d17bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:37.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.884+0000 7f2a558a2740 4 client.18255 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:03:37.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.884+0000 7f2a558a2740 1 -- 172.21.15.19:0/2265106831 --> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55eec5b78170 con 0x55eec5d15800 2024-09-19T09:03:37.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.884+0000 7f2a51265640 1 --2- 172.21.15.19:0/2265106831 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55eec5d15800 0x55eec5d17bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:37.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.884+0000 7f2a30ff9640 10 client.18255 ms_handle_connect on v2:172.21.15.203:6838/2547507299 2024-09-19T09:03:37.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.884+0000 7f2a51265640 1 --2- 172.21.15.19:0/2265106831 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55eec5d15800 0x55eec5d17bf0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=56f81bb919e90e48 server_cookie=71cd7f2c8d7c4557 in_seq=0 out_seq=0 2024-09-19T09:03:37.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.885+0000 7f2a30ff9640 1 -- 172.21.15.19:0/2265106831 <== mds.1 v2:172.21.15.203:6838/2547507299 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55eec5b78170 con 0x55eec5d15800 2024-09-19T09:03:37.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.885+0000 7f2a30ff9640 10 client.18255 handle_command_reply: tid=0 2024-09-19T09:03:37.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.885+0000 7f2a558a2740 1 client.18255 shutdown 2024-09-19T09:03:37.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.885+0000 7f2a558a2740 1 -- 172.21.15.19:0/2265106831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eec5c9b580 msgr2=0x55eec5c94820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:37.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.885+0000 7f2a558a2740 1 --2- 172.21.15.19:0/2265106831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eec5c9b580 0x55eec5c94820 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f2a40006010 tx=0x7f2a40003940 comp rx=0 tx=0).stop 2024-09-19T09:03:37.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.885+0000 7f2a558a2740 1 -- 172.21.15.19:0/2265106831 shutdown_connections 2024-09-19T09:03:37.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.885+0000 7f2a558a2740 1 --2- 172.21.15.19:0/2265106831 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55eec5d15800 0x55eec5d17bf0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.885+0000 7f2a558a2740 1 --2- 172.21.15.19:0/2265106831 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eec5c8fb40 0x55eec5ca3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.885+0000 7f2a558a2740 1 --2- 172.21.15.19:0/2265106831 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55eec5c9b580 0x55eec5c94820 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.885+0000 7f2a558a2740 1 --2- 172.21.15.19:0/2265106831 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55eec5c8e5d0 0x55eec5ca3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.885+0000 7f2a30ff9640 0 client.18255 ms_handle_reset on v2:172.21.15.203:6838/2547507299 2024-09-19T09:03:37.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.885+0000 7f2a558a2740 1 -- 172.21.15.19:0/2265106831 >> 172.21.15.19:0/2265106831 conn(0x55eec5c57310 msgr2=0x55eec5c9a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:37.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.885+0000 7f2a558a2740 1 -- 172.21.15.19:0/2265106831 shutdown_connections 2024-09-19T09:03:37.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.885+0000 7f2a558a2740 1 -- 172.21.15.19:0/2265106831 wait complete. 2024-09-19T09:03:37.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.885+0000 7f2a558a2740 20 client.18255 trim_cache size 0 max 16384 2024-09-19T09:03:37.896 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:03:37.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.886+0000 7f2a534c9640 1 -- 172.21.15.19:0/2809012192 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2a340a32c0 msgr2=0x7f2a340a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:37.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.886+0000 7f2a534c9640 1 --2- 172.21.15.19:0/2809012192 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2a340a32c0 0x7f2a340a5780 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2a4409bdd0 tx=0x7f2a44096780 comp rx=0 tx=0).stop 2024-09-19T09:03:37.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.886+0000 7f2a534c9640 1 -- 172.21.15.19:0/2809012192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a4c102ef0 msgr2=0x7f2a4c19bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:37.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.886+0000 7f2a534c9640 1 --2- 172.21.15.19:0/2809012192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a4c102ef0 0x7f2a4c19bc20 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f2a4400c970 tx=0x7f2a4400ce30 comp rx=0 tx=0).stop 2024-09-19T09:03:37.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.886+0000 7f2a534c9640 1 -- 172.21.15.19:0/2809012192 shutdown_connections 2024-09-19T09:03:37.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.886+0000 7f2a534c9640 1 --2- 172.21.15.19:0/2809012192 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2a340a32c0 0x7f2a340a5780 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.886+0000 7f2a534c9640 1 --2- 172.21.15.19:0/2809012192 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a4c102570 0x7f2a4c197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.886+0000 7f2a534c9640 1 --2- 172.21.15.19:0/2809012192 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2a4c102ef0 0x7f2a4c19bc20 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.886+0000 7f2a534c9640 1 --2- 172.21.15.19:0/2809012192 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2a4c100e20 0x7f2a4c197350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:37.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.886+0000 7f2a534c9640 1 -- 172.21.15.19:0/2809012192 >> 172.21.15.19:0/2809012192 conn(0x7f2a4c0fc7d0 msgr2=0x7f2a4c1067c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:37.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.886+0000 7f2a534c9640 1 -- 172.21.15.19:0/2809012192 shutdown_connections 2024-09-19T09:03:37.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:37.886+0000 7f2a534c9640 1 -- 172.21.15.19:0/2809012192 wait complete. 2024-09-19T09:03:38.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:37 smithi019 ceph-mon[30976]: pgmap v681: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.7 KiB/s wr, 18 op/s 2024-09-19T09:03:38.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:37 smithi155 ceph-mon[34921]: pgmap v681: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.7 KiB/s wr, 18 op/s 2024-09-19T09:03:38.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:37 smithi203 ceph-mon[35450]: pgmap v681: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.7 KiB/s wr, 18 op/s 2024-09-19T09:03:38.625 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:03:38.792 INFO:tasks.workunit.client.0.smithi019.stdout:ok 2024-09-19T09:03:38.796 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T09:03:38.796 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T09:03:38.893 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:39.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.398+0000 7fa0de3e4640 1 -- 172.21.15.19:0/2302366591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0d8101de0 msgr2=0x7fa0d81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:39.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.398+0000 7fa0de3e4640 1 --2- 172.21.15.19:0/2302366591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0d8101de0 0x7fa0d81021c0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8009900 tx=0x7fa0c802a410 comp rx=0 tx=0).stop 2024-09-19T09:03:39.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.398+0000 7fa0de3e4640 1 -- 172.21.15.19:0/2302366591 shutdown_connections 2024-09-19T09:03:39.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.398+0000 7fa0de3e4640 1 --2- 172.21.15.19:0/2302366591 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa0d8102790 0x7fa0d81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:39.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.398+0000 7fa0de3e4640 1 --2- 172.21.15.19:0/2302366591 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0d8106f10 0x7fa0d810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:39.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.398+0000 7fa0de3e4640 1 --2- 172.21.15.19:0/2302366591 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0d8101de0 0x7fa0d81021c0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:39.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.398+0000 7fa0de3e4640 1 -- 172.21.15.19:0/2302366591 >> 172.21.15.19:0/2302366591 conn(0x7fa0d80fd8c0 msgr2=0x7fa0d80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:39.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.398+0000 7fa0de3e4640 1 -- 172.21.15.19:0/2302366591 shutdown_connections 2024-09-19T09:03:39.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.398+0000 7fa0de3e4640 1 -- 172.21.15.19:0/2302366591 wait complete. 2024-09-19T09:03:39.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.399+0000 7fa0de3e4640 1 Processor -- start 2024-09-19T09:03:39.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.399+0000 7fa0de3e4640 1 -- start start 2024-09-19T09:03:39.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.399+0000 7fa0de3e4640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa0d8101de0 0x7fa0d81984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:39.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.399+0000 7fa0de3e4640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0d8102790 0x7fa0d8198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:39.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.399+0000 7fa0de3e4640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0d8106f10 0x7fa0d819cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:39.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.399+0000 7fa0de3e4640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d8111fb0 con 0x7fa0d8106f10 2024-09-19T09:03:39.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.399+0000 7fa0de3e4640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d8111e30 con 0x7fa0d8102790 2024-09-19T09:03:39.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.399+0000 7fa0de3e4640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d8112130 con 0x7fa0d8101de0 2024-09-19T09:03:39.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.399+0000 7fa0dc981640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0d8106f10 0x7fa0d819cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:39.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.399+0000 7fa0dc981640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0d8106f10 0x7fa0d819cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44016/0 (socket says 172.21.15.19:44016) 2024-09-19T09:03:39.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.399+0000 7fa0dc981640 1 -- 172.21.15.19:0/1152810717 learned_addr learned my addr 172.21.15.19:0/1152810717 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:39.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.400+0000 7fa0cffff640 1 --2- 172.21.15.19:0/1152810717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0d8102790 0x7fa0d8198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:39.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.400+0000 7fa0d7fff640 1 --2- 172.21.15.19:0/1152810717 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa0d8101de0 0x7fa0d81984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:39.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.400+0000 7fa0dc981640 1 -- 172.21.15.19:0/1152810717 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa0d8101de0 msgr2=0x7fa0d81984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:39.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.400+0000 7fa0dc981640 1 --2- 172.21.15.19:0/1152810717 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa0d8101de0 0x7fa0d81984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:39.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.400+0000 7fa0dc981640 1 -- 172.21.15.19:0/1152810717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0d8102790 msgr2=0x7fa0d8198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:39.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.400+0000 7fa0dc981640 1 --2- 172.21.15.19:0/1152810717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0d8102790 0x7fa0d8198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:39.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.400+0000 7fa0dc981640 1 -- 172.21.15.19:0/1152810717 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0d819d4a0 con 0x7fa0d8106f10 2024-09-19T09:03:39.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.400+0000 7fa0d7fff640 1 --2- 172.21.15.19:0/1152810717 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa0d8101de0 0x7fa0d81984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:39.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.400+0000 7fa0dc981640 1 --2- 172.21.15.19:0/1152810717 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0d8106f10 0x7fa0d819cdc0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fa0d000b970 tx=0x7fa0d000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:39.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.400+0000 7fa0d5ffb640 1 -- 172.21.15.19:0/1152810717 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d0019070 con 0x7fa0d8106f10 2024-09-19T09:03:39.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.400+0000 7fa0de3e4640 1 -- 172.21.15.19:0/1152810717 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0d819d790 con 0x7fa0d8106f10 2024-09-19T09:03:39.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.400+0000 7fa0d5ffb640 1 -- 172.21.15.19:0/1152810717 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0d000cb40 con 0x7fa0d8106f10 2024-09-19T09:03:39.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.400+0000 7fa0d5ffb640 1 -- 172.21.15.19:0/1152810717 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d0007650 con 0x7fa0d8106f10 2024-09-19T09:03:39.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.400+0000 7fa0de3e4640 1 -- 172.21.15.19:0/1152810717 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0d81a5070 con 0x7fa0d8106f10 2024-09-19T09:03:39.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.402+0000 7fa0d5ffb640 1 -- 172.21.15.19:0/1152810717 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fa0d001c070 con 0x7fa0d8106f10 2024-09-19T09:03:39.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.403+0000 7fa0e07bd740 1 Processor -- start 2024-09-19T09:03:39.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.403+0000 7fa0e07bd740 1 -- start start 2024-09-19T09:03:39.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.403+0000 7fa0e07bd740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d40881eb40 0x55d40881d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:39.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.403+0000 7fa0e07bd740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d40881d5d0 0x55d40881da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:39.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.403+0000 7fa0e07bd740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d408828370 0x55d40882a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:39.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.403+0000 7fa0e07bd740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d4087832f0 con 0x55d40881eb40 2024-09-19T09:03:39.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.403+0000 7fa0e07bd740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55d40872acf0 con 0x55d40881d5d0 2024-09-19T09:03:39.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.403+0000 7fa0e07bd740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d40877f2b0 con 0x55d408828370 2024-09-19T09:03:39.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.403+0000 7fa0cffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d40881eb40 0x55d40881d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:39.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.403+0000 7fa0cffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d40881eb40 0x55d40881d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44026/0 (socket says 172.21.15.19:44026) 2024-09-19T09:03:39.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.403+0000 7fa0cffff640 1 -- 172.21.15.19:0/3626708135 learned_addr learned my addr 172.21.15.19:0/3626708135 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:39.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.403+0000 7fa0d7fff640 1 --2- 172.21.15.19:0/3626708135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d40881d5d0 0x55d40881da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:39.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.404+0000 7fa0cffff640 1 -- 172.21.15.19:0/3626708135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d408828370 msgr2=0x55d40882a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:39.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.404+0000 7fa0cffff640 1 --2- 172.21.15.19:0/3626708135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d408828370 0x55d40882a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:39.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.404+0000 7fa0d5ffb640 1 --2- 172.21.15.19:0/1152810717 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa0c40a3240 0x7fa0c40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:39.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.404+0000 7fa0cffff640 1 -- 172.21.15.19:0/3626708135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d40881d5d0 msgr2=0x55d40881da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:39.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.404+0000 7fa0cffff640 1 --2- 172.21.15.19:0/3626708135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d40881d5d0 0x55d40881da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:39.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.404+0000 7fa0cffff640 1 -- 172.21.15.19:0/3626708135 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d40870f3a0 con 0x55d40881eb40 2024-09-19T09:03:39.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.404+0000 7fa0dc981640 1 --2- 172.21.15.19:0/1152810717 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa0c40a3240 0x7fa0c40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:39.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.404+0000 7fa0cffff640 1 --2- 172.21.15.19:0/3626708135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d40881eb40 0x55d40881d090 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fa0c000b790 tx=0x7fa0c000bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b10e678b8edf55 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:39.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.404+0000 7fa0d5ffb640 1 -- 172.21.15.19:0/1152810717 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7fa0d00ceef0 con 0x7fa0d8106f10 2024-09-19T09:03:39.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.404+0000 7fa0ce7fc640 1 -- 172.21.15.19:0/3626708135 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c000bea0 con 0x55d40881eb40 2024-09-19T09:03:39.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.404+0000 7fa0ce7fc640 1 -- 172.21.15.19:0/3626708135 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0c0016030 con 0x55d40881eb40 2024-09-19T09:03:39.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.404+0000 7fa0ce7fc640 1 -- 172.21.15.19:0/3626708135 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c0010430 con 0x55d40881eb40 2024-09-19T09:03:39.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.405+0000 7fa0e07bd740 1 -- 172.21.15.19:0/3626708135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d40881eb40 msgr2=0x55d40881d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:39.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.405+0000 7fa0e07bd740 1 --2- 172.21.15.19:0/3626708135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d40881eb40 0x55d40881d090 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fa0c000b790 tx=0x7fa0c000bc50 comp rx=0 tx=0).stop 2024-09-19T09:03:39.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.405+0000 7fa0dc981640 1 --2- 172.21.15.19:0/1152810717 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa0c40a3240 0x7fa0c40a5700 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa0d00a3c60 tx=0x7fa0d00664b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:39.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.405+0000 7fa0e07bd740 1 -- 172.21.15.19:0/3626708135 shutdown_connections 2024-09-19T09:03:39.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.405+0000 7fa0e07bd740 1 --2- 172.21.15.19:0/3626708135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d408828370 0x55d40882a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:39.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.405+0000 7fa0e07bd740 1 --2- 172.21.15.19:0/3626708135 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d40881d5d0 0x55d40881da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:39.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.405+0000 7fa0e07bd740 1 --2- 172.21.15.19:0/3626708135 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d40881eb40 0x55d40881d090 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:39.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.405+0000 7fa0e07bd740 1 -- 172.21.15.19:0/3626708135 >> 172.21.15.19:0/3626708135 conn(0x55d4087e6310 msgr2=0x55d408819c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:39.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.405+0000 7fa0e07bd740 1 -- 172.21.15.19:0/3626708135 shutdown_connections 2024-09-19T09:03:39.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.405+0000 7fa0e07bd740 1 -- 172.21.15.19:0/3626708135 wait complete. 2024-09-19T09:03:39.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.405+0000 7fa0e07bd740 1 -- start start 2024-09-19T09:03:39.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.405+0000 7fa0e07bd740 1 Processor -- start 2024-09-19T09:03:39.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.406+0000 7fa0e07bd740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d40881d5d0 0x55d408827de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:39.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.406+0000 7fa0e07bd740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d40881eb40 0x55d408825090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:39.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.406+0000 7fa0e07bd740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d408828370 0x55d4088257d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:39.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.406+0000 7fa0e07bd740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55d40882b010 con 0x55d408828370 2024-09-19T09:03:39.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.406+0000 7fa0e07bd740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55d40873e060 con 0x55d40881eb40 2024-09-19T09:03:39.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.406+0000 7fa0e07bd740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d40882b190 con 0x55d40881d5d0 2024-09-19T09:03:39.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.406+0000 7fa0e07bd740 10 client.0 _ll_register_callbacks cb 0x55d4084918c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:39.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.406+0000 7fa0cffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d408828370 0x55d4088257d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:39.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.406+0000 7fa0cffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d408828370 0x55d4088257d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44042/0 (socket says 172.21.15.19:44042) 2024-09-19T09:03:39.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.406+0000 7fa0cffff640 1 -- 172.21.15.19:0/1116569586 learned_addr learned my addr 172.21.15.19:0/1116569586 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:39.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.406+0000 7fa0d7fff640 1 --2- 172.21.15.19:0/1116569586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d40881eb40 0x55d408825090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:39.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.406+0000 7fa0cffff640 1 --2- 172.21.15.19:0/1116569586 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d40881d5d0 0x55d408827de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:39.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.406+0000 7fa0d7fff640 1 -- 172.21.15.19:0/1116569586 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d40881d5d0 msgr2=0x55d408827de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:39.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.406+0000 7fa0d7fff640 1 --2- 172.21.15.19:0/1116569586 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d40881d5d0 0x55d408827de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:39.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.406+0000 7fa0d7fff640 1 -- 172.21.15.19:0/1116569586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d408828370 msgr2=0x55d4088257d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:39.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.406+0000 7fa0d7fff640 1 --2- 172.21.15.19:0/1116569586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d408828370 0x55d4088257d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:39.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.406+0000 7fa0d7fff640 1 -- 172.21.15.19:0/1116569586 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4084f43c0 con 0x55d40881eb40 2024-09-19T09:03:39.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.406+0000 7fa0cffff640 1 --2- 172.21.15.19:0/1116569586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d408828370 0x55d4088257d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:39.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.407+0000 7fa0d7fff640 1 --2- 172.21.15.19:0/1116569586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d40881eb40 0x55d408825090 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8009230 tx=0x7fa0c80318d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f122594647a0ab5c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:39.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.407+0000 7fa0b77fe640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T09:03:39.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.407+0000 7fa0b77fe640 1 -- 172.21.15.19:0/1116569586 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8035070 con 0x55d40881eb40 2024-09-19T09:03:39.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.407+0000 7fa0e07bd740 1 -- 172.21.15.19:0/1116569586 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0c0016030 con 0x55d40881eb40 2024-09-19T09:03:39.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.407+0000 7fa0b77fe640 1 -- 172.21.15.19:0/1116569586 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7fa0c8004240 con 0x55d40881eb40 2024-09-19T09:03:39.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.407+0000 7fa0b77fe640 1 -- 172.21.15.19:0/1116569586 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fa0c8004440 con 0x55d40881eb40 2024-09-19T09:03:39.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.407+0000 7fa0e07bd740 10 client.27599 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:39.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.407+0000 7fa0e07bd740 1 -- 172.21.15.19:0/1116569586 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55d408836b90 con 0x55d40881eb40 2024-09-19T09:03:39.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.407+0000 7fa0b77fe640 1 -- 172.21.15.19:0/1116569586 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0c0016030 con 0x55d40881eb40 2024-09-19T09:03:39.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.407+0000 7fa0b77fe640 1 -- 172.21.15.19:0/1116569586 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7fa0c8004ae0 con 0x55d40881eb40 2024-09-19T09:03:39.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.408+0000 7fa0e07bd740 10 client.27599 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:39.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.408+0000 7fa0e07bd740 10 client.27599 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:39.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.408+0000 7fa0e07bd740 20 client.27599 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:39.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.408+0000 7fa0e07bd740 1 --2- 172.21.15.19:0/1116569586 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d408837fa0 0x55d40883a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:39.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.408+0000 7fa0e07bd740 4 client.27599 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:39.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.408+0000 7fa0e07bd740 1 -- 172.21.15.19:0/1116569586 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d408790860 con 0x55d408837fa0 2024-09-19T09:03:39.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.408+0000 7fa0cffff640 1 --2- 172.21.15.19:0/1116569586 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d408837fa0 0x55d40883a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:39.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.408+0000 7fa0cffff640 1 --2- 172.21.15.19:0/1116569586 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d408837fa0 0x55d40883a390 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1f23c6b44f2eb3c server_cookie=260c2e7a3b4e8797 in_seq=0 out_seq=0 2024-09-19T09:03:39.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.408+0000 7fa0b77fe640 10 client.27599 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:39.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.409+0000 7fa0b77fe640 1 -- 172.21.15.19:0/1116569586 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d408790860 con 0x55d408837fa0 2024-09-19T09:03:39.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.409+0000 7fa0b77fe640 10 client.27599 handle_command_reply: tid=0 2024-09-19T09:03:39.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.409+0000 7fa0e07bd740 1 client.27599 shutdown 2024-09-19T09:03:39.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.409+0000 7fa0e07bd740 1 -- 172.21.15.19:0/1116569586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d40881eb40 msgr2=0x55d408825090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:39.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.409+0000 7fa0e07bd740 1 --2- 172.21.15.19:0/1116569586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d40881eb40 0x55d408825090 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8009230 tx=0x7fa0c80318d0 comp rx=0 tx=0).stop 2024-09-19T09:03:39.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.409+0000 7fa0e07bd740 1 -- 172.21.15.19:0/1116569586 shutdown_connections 2024-09-19T09:03:39.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.409+0000 7fa0e07bd740 1 --2- 172.21.15.19:0/1116569586 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d408837fa0 0x55d40883a390 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:39.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.409+0000 7fa0e07bd740 1 --2- 172.21.15.19:0/1116569586 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d408828370 0x55d4088257d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:39.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.409+0000 7fa0e07bd740 1 --2- 172.21.15.19:0/1116569586 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d40881eb40 0x55d408825090 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:39.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.409+0000 7fa0b77fe640 0 client.27599 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:39.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.409+0000 7fa0e07bd740 1 --2- 172.21.15.19:0/1116569586 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d40881d5d0 0x55d408827de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:39.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.409+0000 7fa0e07bd740 1 -- 172.21.15.19:0/1116569586 >> 172.21.15.19:0/1116569586 conn(0x55d4087e6310 msgr2=0x55d40881f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:39.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.409+0000 7fa0e07bd740 1 -- 172.21.15.19:0/1116569586 shutdown_connections 2024-09-19T09:03:39.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.409+0000 7fa0e07bd740 1 -- 172.21.15.19:0/1116569586 wait complete. 2024-09-19T09:03:39.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.409+0000 7fa0e07bd740 20 client.27599 trim_cache size 0 max 16384 2024-09-19T09:03:39.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.423+0000 7fa0e07bd740 1 Processor -- start 2024-09-19T09:03:39.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.423+0000 7fa0e07bd740 1 -- start start 2024-09-19T09:03:39.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.423+0000 7fa0e07bd740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d40881d5d0 0x55d4088342b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:39.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.423+0000 7fa0e07bd740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d40881eb40 0x55d408827000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:39.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.423+0000 7fa0e07bd740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d408828370 0x55d408820120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:39.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.423+0000 7fa0e07bd740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d81ad510 con 0x55d408828370 2024-09-19T09:03:39.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.423+0000 7fa0e07bd740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d81af050 con 0x55d40881eb40 2024-09-19T09:03:39.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.423+0000 7fa0e07bd740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d81adbe0 con 0x55d40881d5d0 2024-09-19T09:03:39.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.423+0000 7fa0cffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d408828370 0x55d408820120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:39.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.423+0000 7fa0cffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d408828370 0x55d408820120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44058/0 (socket says 172.21.15.19:44058) 2024-09-19T09:03:39.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.423+0000 7fa0cffff640 1 -- 172.21.15.19:0/2157530116 learned_addr learned my addr 172.21.15.19:0/2157530116 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:39.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.423+0000 7fa0d7fff640 1 --2- 172.21.15.19:0/2157530116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d40881eb40 0x55d408827000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:39.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.423+0000 7fa0cffff640 1 --2- 172.21.15.19:0/2157530116 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d40881d5d0 0x55d4088342b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:39.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.423+0000 7fa0cffff640 1 -- 172.21.15.19:0/2157530116 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d40881d5d0 msgr2=0x55d4088342b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:39.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.423+0000 7fa0cffff640 1 --2- 172.21.15.19:0/2157530116 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d40881d5d0 0x55d4088342b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:39.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.423+0000 7fa0cffff640 1 -- 172.21.15.19:0/2157530116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d40881eb40 msgr2=0x55d408827000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:39.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.423+0000 7fa0cffff640 1 --2- 172.21.15.19:0/2157530116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d40881eb40 0x55d408827000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:39.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.423+0000 7fa0cffff640 1 -- 172.21.15.19:0/2157530116 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d408819ed0 con 0x55d408828370 2024-09-19T09:03:39.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.423+0000 7fa0d7fff640 1 --2- 172.21.15.19:0/2157530116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d40881eb40 0x55d408827000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:39.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.424+0000 7fa0cffff640 1 --2- 172.21.15.19:0/2157530116 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d408828370 0x55d408820120 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fa0c00058f0 tx=0x7fa0c0014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ec56617284e4cfb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:39.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.424+0000 7fa0cdffb640 1 -- 172.21.15.19:0/2157530116 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c0024040 con 0x55d408828370 2024-09-19T09:03:39.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.424+0000 7fa0cdffb640 1 -- 172.21.15.19:0/2157530116 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0c0016040 con 0x55d408828370 2024-09-19T09:03:39.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.424+0000 7fa0cdffb640 1 -- 172.21.15.19:0/2157530116 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c002c6b0 con 0x55d408828370 2024-09-19T09:03:39.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.425+0000 7fa0e07bd740 1 -- 172.21.15.19:0/2157530116 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d408828370 msgr2=0x55d408820120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:39.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.425+0000 7fa0e07bd740 1 --2- 172.21.15.19:0/2157530116 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d408828370 0x55d408820120 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fa0c00058f0 tx=0x7fa0c0014040 comp rx=0 tx=0).stop 2024-09-19T09:03:39.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.425+0000 7fa0e07bd740 1 -- 172.21.15.19:0/2157530116 shutdown_connections 2024-09-19T09:03:39.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.425+0000 7fa0e07bd740 1 --2- 172.21.15.19:0/2157530116 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d408828370 0x55d408820120 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:39.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.425+0000 7fa0e07bd740 1 --2- 172.21.15.19:0/2157530116 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d40881eb40 0x55d408827000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:39.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.425+0000 7fa0e07bd740 1 --2- 172.21.15.19:0/2157530116 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d40881d5d0 0x55d4088342b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:39.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.425+0000 7fa0e07bd740 1 -- 172.21.15.19:0/2157530116 >> 172.21.15.19:0/2157530116 conn(0x55d4087e6310 msgr2=0x55d4088268f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:39.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.425+0000 7fa0e07bd740 1 -- 172.21.15.19:0/2157530116 shutdown_connections 2024-09-19T09:03:39.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.425+0000 7fa0e07bd740 1 -- 172.21.15.19:0/2157530116 wait complete. 2024-09-19T09:03:39.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.425+0000 7fa0e07bd740 1 -- start start 2024-09-19T09:03:39.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.425+0000 7fa0e07bd740 1 Processor -- start 2024-09-19T09:03:39.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.426+0000 7fa0e07bd740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d40881d5d0 0x55d40889afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:39.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.426+0000 7fa0e07bd740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d40881eb40 0x55d40889b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:39.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.426+0000 7fa0e07bd740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d408828370 0x55d40889ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:39.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.426+0000 7fa0e07bd740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d81ae980 con 0x55d40881d5d0 2024-09-19T09:03:39.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.426+0000 7fa0e07bd740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d81ae2b0 con 0x55d408828370 2024-09-19T09:03:39.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.426+0000 7fa0e07bd740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d81ab4f0 con 0x55d40881eb40 2024-09-19T09:03:39.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.426+0000 7fa0e07bd740 10 client.0 _ll_register_callbacks cb 0x7fa0c8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:39.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.426+0000 7fa0cffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d40881d5d0 0x55d40889afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:39.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.426+0000 7fa0cffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d40881d5d0 0x55d40889afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44072/0 (socket says 172.21.15.19:44072) 2024-09-19T09:03:39.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.426+0000 7fa0cffff640 1 -- 172.21.15.19:0/3155389051 learned_addr learned my addr 172.21.15.19:0/3155389051 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:39.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.426+0000 7fa0d7fff640 1 --2- 172.21.15.19:0/3155389051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d40881eb40 0x55d40889b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:39.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.426+0000 7fa0cffff640 1 -- 172.21.15.19:0/3155389051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d40881eb40 msgr2=0x55d40889b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:39.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.426+0000 7fa0cffff640 1 --2- 172.21.15.19:0/3155389051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d40881eb40 0x55d40889b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:39.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.426+0000 7fa0cffff640 1 -- 172.21.15.19:0/3155389051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d408828370 msgr2=0x55d40889ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:39.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.426+0000 7fa0cffff640 1 --2- 172.21.15.19:0/3155389051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d408828370 0x55d40889ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:39.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.426+0000 7fa0cffff640 1 -- 172.21.15.19:0/3155389051 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d40882f700 con 0x55d40881d5d0 2024-09-19T09:03:39.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.426+0000 7fa0d7fff640 1 --2- 172.21.15.19:0/3155389051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d40881eb40 0x55d40889b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:39.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.426+0000 7fa0cffff640 1 --2- 172.21.15.19:0/3155389051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d40881d5d0 0x55d40889afb0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fa0c00039c0 tx=0x7fa0c0004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31f99b75acb4c706 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:39.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.426+0000 7fa0b77fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:39.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.426+0000 7fa0b77fe640 1 -- 172.21.15.19:0/3155389051 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c001b670 con 0x55d40881d5d0 2024-09-19T09:03:39.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.426+0000 7fa0e07bd740 1 -- 172.21.15.19:0/3155389051 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa0c0016040 con 0x55d40881d5d0 2024-09-19T09:03:39.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.426+0000 7fa0b77fe640 1 -- 172.21.15.19:0/3155389051 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7fa0c001b810 con 0x55d40881d5d0 2024-09-19T09:03:39.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.427+0000 7fa0b77fe640 1 -- 172.21.15.19:0/3155389051 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fa0c001ba10 con 0x55d40881d5d0 2024-09-19T09:03:39.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.427+0000 7fa0e07bd740 10 client.18273 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:39.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.427+0000 7fa0e07bd740 1 -- 172.21.15.19:0/3155389051 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55d408830a00 con 0x55d40881d5d0 2024-09-19T09:03:39.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.427+0000 7fa0b77fe640 1 -- 172.21.15.19:0/3155389051 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fa0c0016040 con 0x55d40881d5d0 2024-09-19T09:03:39.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.427+0000 7fa0b77fe640 1 -- 172.21.15.19:0/3155389051 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7fa0c0036450 con 0x55d40881d5d0 2024-09-19T09:03:39.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.427+0000 7fa0e07bd740 10 client.18273 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:39.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.427+0000 7fa0e07bd740 10 client.18273 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:39.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.427+0000 7fa0e07bd740 20 client.18273 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:39.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.427+0000 7fa0e07bd740 1 --2- 172.21.15.19:0/3155389051 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d4088a7040 0x55d4088a9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:39.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.427+0000 7fa0e07bd740 4 client.18273 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:03:39.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.427+0000 7fa0e07bd740 1 -- 172.21.15.19:0/3155389051 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d40878ad70 con 0x55d4088a7040 2024-09-19T09:03:39.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.427+0000 7fa0d7fff640 1 --2- 172.21.15.19:0/3155389051 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d4088a7040 0x55d4088a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:39.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.428+0000 7fa0b77fe640 10 client.18273 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:39.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.428+0000 7fa0d7fff640 1 --2- 172.21.15.19:0/3155389051 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d4088a7040 0x55d4088a9430 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45a4891ed3bb8c59 server_cookie=a63ac5e5a0445c8a in_seq=0 out_seq=0 2024-09-19T09:03:39.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.428+0000 7fa0b77fe640 1 -- 172.21.15.19:0/3155389051 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d40878ad70 con 0x55d4088a7040 2024-09-19T09:03:39.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.428+0000 7fa0b77fe640 10 client.18273 handle_command_reply: tid=0 2024-09-19T09:03:39.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.428+0000 7fa0e07bd740 1 client.18273 shutdown 2024-09-19T09:03:39.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.428+0000 7fa0e07bd740 1 -- 172.21.15.19:0/3155389051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d40881d5d0 msgr2=0x55d40889afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:39.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.428+0000 7fa0e07bd740 1 --2- 172.21.15.19:0/3155389051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d40881d5d0 0x55d40889afb0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fa0c00039c0 tx=0x7fa0c0004250 comp rx=0 tx=0).stop 2024-09-19T09:03:39.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.428+0000 7fa0e07bd740 1 -- 172.21.15.19:0/3155389051 shutdown_connections 2024-09-19T09:03:39.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.428+0000 7fa0e07bd740 1 --2- 172.21.15.19:0/3155389051 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55d4088a7040 0x55d4088a9430 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:39.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.428+0000 7fa0e07bd740 1 --2- 172.21.15.19:0/3155389051 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d40881eb40 0x55d40889b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:39.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.428+0000 7fa0b77fe640 0 client.18273 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:39.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.428+0000 7fa0e07bd740 1 --2- 172.21.15.19:0/3155389051 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55d408828370 0x55d40889ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:39.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.428+0000 7fa0e07bd740 1 --2- 172.21.15.19:0/3155389051 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55d40881d5d0 0x55d40889afb0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:39.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.428+0000 7fa0e07bd740 1 -- 172.21.15.19:0/3155389051 >> 172.21.15.19:0/3155389051 conn(0x55d4087e6310 msgr2=0x55d408827110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:39.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.428+0000 7fa0e07bd740 1 -- 172.21.15.19:0/3155389051 shutdown_connections 2024-09-19T09:03:39.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.428+0000 7fa0e07bd740 1 -- 172.21.15.19:0/3155389051 wait complete. 2024-09-19T09:03:39.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.428+0000 7fa0e07bd740 20 client.18273 trim_cache size 0 max 16384 2024-09-19T09:03:39.435 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:03:39.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.429+0000 7fa0de3e4640 1 -- 172.21.15.19:0/1152810717 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa0c40a3240 msgr2=0x7fa0c40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:39.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.429+0000 7fa0de3e4640 1 --2- 172.21.15.19:0/1152810717 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa0c40a3240 0x7fa0c40a5700 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa0d00a3c60 tx=0x7fa0d00664b0 comp rx=0 tx=0).stop 2024-09-19T09:03:39.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.429+0000 7fa0de3e4640 1 -- 172.21.15.19:0/1152810717 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0d8106f10 msgr2=0x7fa0d819cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:39.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.429+0000 7fa0de3e4640 1 --2- 172.21.15.19:0/1152810717 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0d8106f10 0x7fa0d819cdc0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fa0d000b970 tx=0x7fa0d000be30 comp rx=0 tx=0).stop 2024-09-19T09:03:39.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.429+0000 7fa0de3e4640 1 -- 172.21.15.19:0/1152810717 shutdown_connections 2024-09-19T09:03:39.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.429+0000 7fa0de3e4640 1 --2- 172.21.15.19:0/1152810717 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fa0c40a3240 0x7fa0c40a5700 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:39.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.429+0000 7fa0de3e4640 1 --2- 172.21.15.19:0/1152810717 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fa0d8106f10 0x7fa0d819cdc0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:39.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.429+0000 7fa0de3e4640 1 --2- 172.21.15.19:0/1152810717 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fa0d8102790 0x7fa0d8198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:39.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.429+0000 7fa0de3e4640 1 --2- 172.21.15.19:0/1152810717 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa0d8101de0 0x7fa0d81984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:39.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.429+0000 7fa0de3e4640 1 -- 172.21.15.19:0/1152810717 >> 172.21.15.19:0/1152810717 conn(0x7fa0d80fd8c0 msgr2=0x7fa0d80febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:39.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.429+0000 7fa0de3e4640 1 -- 172.21.15.19:0/1152810717 shutdown_connections 2024-09-19T09:03:39.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:39.429+0000 7fa0de3e4640 1 -- 172.21.15.19:0/1152810717 wait complete. 2024-09-19T09:03:40.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:39 smithi155 ceph-mon[34921]: pgmap v682: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 6.2 KiB/s wr, 17 op/s 2024-09-19T09:03:40.192 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:39 smithi019 ceph-mon[30976]: pgmap v682: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 6.2 KiB/s wr, 17 op/s 2024-09-19T09:03:40.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:39 smithi203 ceph-mon[35450]: pgmap v682: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 6.2 KiB/s wr, 17 op/s 2024-09-19T09:03:41.110 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:03:41.111 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:03:41.382 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:41.849 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.849+0000 7f6c19e77640 1 -- 172.21.15.19:0/166775829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c141025f0 msgr2=0x7f6c14108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:41.849 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.849+0000 7f6c19e77640 1 --2- 172.21.15.19:0/166775829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c141025f0 0x7f6c14108e80 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c009ca0 tx=0x7f6c0c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.849 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.849+0000 7f6c19e77640 1 -- 172.21.15.19:0/166775829 shutdown_connections 2024-09-19T09:03:41.849 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.849+0000 7f6c19e77640 1 --2- 172.21.15.19:0/166775829 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c14101c30 0x7f6c141020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.849 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.849+0000 7f6c19e77640 1 --2- 172.21.15.19:0/166775829 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c141025f0 0x7f6c14108e80 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.850 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.849+0000 7f6c19e77640 1 --2- 172.21.15.19:0/166775829 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c14100a40 0x7f6c14100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.850 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.849+0000 7f6c19e77640 1 -- 172.21.15.19:0/166775829 >> 172.21.15.19:0/166775829 conn(0x7f6c140fc1e0 msgr2=0x7f6c140fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:41.850 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.849+0000 7f6c19e77640 1 -- 172.21.15.19:0/166775829 shutdown_connections 2024-09-19T09:03:41.850 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.849+0000 7f6c19e77640 1 -- 172.21.15.19:0/166775829 wait complete. 2024-09-19T09:03:41.852 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.850+0000 7f6c19e77640 1 Processor -- start 2024-09-19T09:03:41.852 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.850+0000 7f6c19e77640 1 -- start start 2024-09-19T09:03:41.852 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.851+0000 7f6c19e77640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c14100a40 0x7f6c14196c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:41.852 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.851+0000 7f6c19e77640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c14101c30 0x7f6c141971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:41.852 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.851+0000 7f6c19e77640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c141025f0 0x7f6c1419e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:41.852 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.851+0000 7f6c19e77640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1410c6f0 con 0x7f6c14101c30 2024-09-19T09:03:41.852 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.851+0000 7f6c19e77640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1410c570 con 0x7f6c14100a40 2024-09-19T09:03:41.853 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.851+0000 7f6c19e77640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6c1410c870 con 0x7f6c141025f0 2024-09-19T09:03:41.853 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.851+0000 7f6c12ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c14101c30 0x7f6c141971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:41.853 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.851+0000 7f6c12ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c14101c30 0x7f6c141971b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44124/0 (socket says 172.21.15.19:44124) 2024-09-19T09:03:41.853 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.851+0000 7f6c12ffd640 1 -- 172.21.15.19:0/3161647488 learned_addr learned my addr 172.21.15.19:0/3161647488 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:41.853 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.851+0000 7f6c137fe640 1 --2- 172.21.15.19:0/3161647488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c14100a40 0x7f6c14196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:41.853 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.851+0000 7f6c13fff640 1 --2- 172.21.15.19:0/3161647488 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c141025f0 0x7f6c1419e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:41.853 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.851+0000 7f6c12ffd640 1 -- 172.21.15.19:0/3161647488 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c141025f0 msgr2=0x7f6c1419e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:41.853 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.851+0000 7f6c12ffd640 1 --2- 172.21.15.19:0/3161647488 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c141025f0 0x7f6c1419e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.853 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.851+0000 7f6c12ffd640 1 -- 172.21.15.19:0/3161647488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c14100a40 msgr2=0x7f6c14196c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.851+0000 7f6c12ffd640 1 --2- 172.21.15.19:0/3161647488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c14100a40 0x7f6c14196c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.851+0000 7f6c12ffd640 1 -- 172.21.15.19:0/3161647488 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c1419e880 con 0x7f6c14101c30 2024-09-19T09:03:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.851+0000 7f6c137fe640 1 --2- 172.21.15.19:0/3161647488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c14100a40 0x7f6c14196c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.852+0000 7f6c12ffd640 1 --2- 172.21.15.19:0/3161647488 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c14101c30 0x7f6c141971b0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f6c0800e9f0 tx=0x7f6c0800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.852+0000 7f6c10ff9640 1 -- 172.21.15.19:0/3161647488 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c0800cd80 con 0x7f6c14101c30 2024-09-19T09:03:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.852+0000 7f6c19e77640 1 -- 172.21.15.19:0/3161647488 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c1419eb70 con 0x7f6c14101c30 2024-09-19T09:03:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.852+0000 7f6c10ff9640 1 -- 172.21.15.19:0/3161647488 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c08010910 con 0x7f6c14101c30 2024-09-19T09:03:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.852+0000 7f6c10ff9640 1 -- 172.21.15.19:0/3161647488 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c080188f0 con 0x7f6c14101c30 2024-09-19T09:03:41.854 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.852+0000 7f6c19e77640 1 -- 172.21.15.19:0/3161647488 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c1419f0c0 con 0x7f6c14101c30 2024-09-19T09:03:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.855+0000 7f6c1cc0f740 1 Processor -- start 2024-09-19T09:03:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.855+0000 7f6c1cc0f740 1 -- start start 2024-09-19T09:03:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.855+0000 7f6c10ff9640 1 -- 172.21.15.19:0/3161647488 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f6c08010ac0 con 0x7f6c14101c30 2024-09-19T09:03:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.855+0000 7f6c1cc0f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560a33524e40 0x560a33525240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.855+0000 7f6c1cc0f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560a33523680 0x560a33523b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:41.856 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.855+0000 7f6c1cc0f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a33524040 0x560a3352b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:41.857 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.855+0000 7f6c1cc0f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560a334872f0 con 0x560a33524040 2024-09-19T09:03:41.857 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.855+0000 7f6c1cc0f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x560a3342f270 con 0x560a33524e40 2024-09-19T09:03:41.857 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.855+0000 7f6c1cc0f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560a334832b0 con 0x560a33523680 2024-09-19T09:03:41.857 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.855+0000 7f6c12ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a33524040 0x560a3352b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:41.857 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.856+0000 7f6c12ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a33524040 0x560a3352b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44130/0 (socket says 172.21.15.19:44130) 2024-09-19T09:03:41.857 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.856+0000 7f6c12ffd640 1 -- 172.21.15.19:0/845204503 learned_addr learned my addr 172.21.15.19:0/845204503 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:41.857 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.856+0000 7f6c13fff640 1 --2- 172.21.15.19:0/845204503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560a33524e40 0x560a33525240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:41.857 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.856+0000 7f6c12ffd640 1 -- 172.21.15.19:0/845204503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560a33523680 msgr2=0x560a33523b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:41.857 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.856+0000 7f6c137fe640 1 --2- 172.21.15.19:0/845204503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560a33523680 0x560a33523b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:41.857 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.856+0000 7f6c12ffd640 1 --2- 172.21.15.19:0/845204503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560a33523680 0x560a33523b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.857 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.856+0000 7f6c12ffd640 1 -- 172.21.15.19:0/845204503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560a33524e40 msgr2=0x560a33525240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:41.857 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.856+0000 7f6c12ffd640 1 --2- 172.21.15.19:0/845204503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560a33524e40 0x560a33525240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.857 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.856+0000 7f6c12ffd640 1 -- 172.21.15.19:0/845204503 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a3342e340 con 0x560a33524040 2024-09-19T09:03:41.857 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.856+0000 7f6c137fe640 1 --2- 172.21.15.19:0/845204503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560a33523680 0x560a33523b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:41.858 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.856+0000 7f6c13fff640 1 --2- 172.21.15.19:0/845204503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560a33524e40 0x560a33525240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:41.858 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.856+0000 7f6c10ff9640 1 --2- 172.21.15.19:0/3161647488 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6bfc0a32f0 0x7f6bfc0a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:41.858 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.856+0000 7f6c12ffd640 1 --2- 172.21.15.19:0/845204503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a33524040 0x560a3352b9f0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f6c080d3f30 tx=0x7f6c080d8570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af53c87e0dd32f74 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:41.858 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.856+0000 7f6c13fff640 1 --2- 172.21.15.19:0/3161647488 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6bfc0a32f0 0x7f6bfc0a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:41.858 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.856+0000 7f6bf9ffb640 1 -- 172.21.15.19:0/845204503 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c08098670 con 0x560a33524040 2024-09-19T09:03:41.858 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.856+0000 7f6bf9ffb640 1 -- 172.21.15.19:0/845204503 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c0809cb60 con 0x560a33524040 2024-09-19T09:03:41.858 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.856+0000 7f6bf9ffb640 1 -- 172.21.15.19:0/845204503 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c080a9080 con 0x560a33524040 2024-09-19T09:03:41.858 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.856+0000 7f6c10ff9640 1 -- 172.21.15.19:0/3161647488 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f6c080cfe90 con 0x7f6c14101c30 2024-09-19T09:03:41.862 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.857+0000 7f6c1cc0f740 1 -- 172.21.15.19:0/845204503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a33524040 msgr2=0x560a3352b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:41.862 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.857+0000 7f6c13fff640 1 --2- 172.21.15.19:0/3161647488 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6bfc0a32f0 0x7f6bfc0a57b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c006010 tx=0x7f6c0c031bb0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:41.862 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.857+0000 7f6c1cc0f740 1 --2- 172.21.15.19:0/845204503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a33524040 0x560a3352b9f0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f6c080d3f30 tx=0x7f6c080d8570 comp rx=0 tx=0).stop 2024-09-19T09:03:41.862 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.857+0000 7f6c1cc0f740 1 -- 172.21.15.19:0/845204503 shutdown_connections 2024-09-19T09:03:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.857+0000 7f6c1cc0f740 1 --2- 172.21.15.19:0/845204503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560a33523680 0x560a33523b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.857+0000 7f6c1cc0f740 1 --2- 172.21.15.19:0/845204503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a33524040 0x560a3352b9f0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.857+0000 7f6c1cc0f740 1 --2- 172.21.15.19:0/845204503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560a33524e40 0x560a33525240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.857+0000 7f6c1cc0f740 1 -- 172.21.15.19:0/845204503 >> 172.21.15.19:0/845204503 conn(0x560a3351f010 msgr2=0x560a3351f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.857+0000 7f6c1cc0f740 1 -- 172.21.15.19:0/845204503 shutdown_connections 2024-09-19T09:03:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.857+0000 7f6c1cc0f740 1 -- 172.21.15.19:0/845204503 wait complete. 2024-09-19T09:03:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.858+0000 7f6c1cc0f740 1 -- start start 2024-09-19T09:03:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.858+0000 7f6c1cc0f740 1 Processor -- start 2024-09-19T09:03:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.858+0000 7f6c1cc0f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a33523680 0x560a335362d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.858+0000 7f6c1cc0f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560a33524040 0x560a33536810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.858+0000 7f6c1cc0f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560a33524e40 0x560a3353d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:41.863 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.858+0000 7f6c1cc0f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x560a33534b10 con 0x560a33523680 2024-09-19T09:03:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.858+0000 7f6c1cc0f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x560a33410290 con 0x560a33524040 2024-09-19T09:03:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.858+0000 7f6c1cc0f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560a33534c90 con 0x560a33524e40 2024-09-19T09:03:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.858+0000 7f6c1cc0f740 10 client.0 _ll_register_callbacks cb 0x560a33441140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.858+0000 7f6c137fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a33523680 0x560a335362d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.858+0000 7f6c137fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a33523680 0x560a335362d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44146/0 (socket says 172.21.15.19:44146) 2024-09-19T09:03:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.858+0000 7f6c137fe640 1 -- 172.21.15.19:0/1118346509 learned_addr learned my addr 172.21.15.19:0/1118346509 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.858+0000 7f6c12ffd640 1 --2- 172.21.15.19:0/1118346509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560a33524040 0x560a33536810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.858+0000 7f6c13fff640 1 --2- 172.21.15.19:0/1118346509 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560a33524e40 0x560a3353d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.859+0000 7f6c137fe640 1 -- 172.21.15.19:0/1118346509 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560a33524e40 msgr2=0x560a3353d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.859+0000 7f6c137fe640 1 --2- 172.21.15.19:0/1118346509 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560a33524e40 0x560a3353d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.859+0000 7f6c137fe640 1 -- 172.21.15.19:0/1118346509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560a33524040 msgr2=0x560a33536810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.859+0000 7f6c137fe640 1 --2- 172.21.15.19:0/1118346509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560a33524040 0x560a33536810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.859+0000 7f6c137fe640 1 -- 172.21.15.19:0/1118346509 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a3319a210 con 0x560a33523680 2024-09-19T09:03:41.864 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.859+0000 7f6c137fe640 1 --2- 172.21.15.19:0/1118346509 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a33523680 0x560a335362d0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f6c040106d0 tx=0x7f6c04010b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12bd95976e5a192b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.859+0000 7f6bf2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.859+0000 7f6bf2ffd640 1 -- 172.21.15.19:0/1118346509 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c04017070 con 0x560a33523680 2024-09-19T09:03:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.859+0000 7f6c1cc0f740 1 -- 172.21.15.19:0/1118346509 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c0809cb60 con 0x560a33523680 2024-09-19T09:03:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.859+0000 7f6bf2ffd640 1 -- 172.21.15.19:0/1118346509 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f6c0400eb30 con 0x560a33523680 2024-09-19T09:03:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.859+0000 7f6bf2ffd640 1 -- 172.21.15.19:0/1118346509 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f6c0400ed30 con 0x560a33523680 2024-09-19T09:03:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.859+0000 7f6c1cc0f740 10 client.18297 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.859+0000 7f6c1cc0f740 1 -- 172.21.15.19:0/1118346509 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x560a33266620 con 0x560a33523680 2024-09-19T09:03:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.859+0000 7f6bf2ffd640 1 -- 172.21.15.19:0/1118346509 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c0809cb60 con 0x560a33523680 2024-09-19T09:03:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.860+0000 7f6bf2ffd640 1 -- 172.21.15.19:0/1118346509 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f6c0401b430 con 0x560a33523680 2024-09-19T09:03:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.860+0000 7f6c1cc0f740 10 client.18297 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.860+0000 7f6c1cc0f740 10 client.18297 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.860+0000 7f6c1cc0f740 20 client.18297 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.860+0000 7f6c1cc0f740 1 --2- 172.21.15.19:0/1118346509 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560a33541f30 0x560a335443a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:41.865 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.860+0000 7f6c1cc0f740 4 client.18297 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.860+0000 7f6c1cc0f740 1 -- 172.21.15.19:0/1118346509 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a33494a20 con 0x560a33541f30 2024-09-19T09:03:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.860+0000 7f6c12ffd640 1 --2- 172.21.15.19:0/1118346509 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560a33541f30 0x560a335443a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.860+0000 7f6bf2ffd640 10 client.18297 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:41.866 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.860+0000 7f6c12ffd640 1 --2- 172.21.15.19:0/1118346509 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560a33541f30 0x560a335443a0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3a310ffbed963fd server_cookie=fc523791023717de in_seq=0 out_seq=0 2024-09-19T09:03:41.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.838+0000 7f52a7f0b640 1 -- 172.21.15.19:0/2757939471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52a01036e0 msgr2=0x7f52a0107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:41.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.838+0000 7f52a7f0b640 1 --2- 172.21.15.19:0/2757939471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52a01036e0 0x7f52a0107b90 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f5290009930 tx=0x7f529002a420 comp rx=0 tx=0).stop 2024-09-19T09:03:41.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.838+0000 7f52a7f0b640 1 -- 172.21.15.19:0/2757939471 shutdown_connections 2024-09-19T09:03:41.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.838+0000 7f52a7f0b640 1 --2- 172.21.15.19:0/2757939471 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f52a01082a0 0x7f52a010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.838+0000 7f52a7f0b640 1 --2- 172.21.15.19:0/2757939471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52a01036e0 0x7f52a0107b90 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.838+0000 7f52a7f0b640 1 --2- 172.21.15.19:0/2757939471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52a0102d30 0x7f52a0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.838+0000 7f52a7f0b640 1 -- 172.21.15.19:0/2757939471 >> 172.21.15.19:0/2757939471 conn(0x7f52a00fc7d0 msgr2=0x7f52a00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:41.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.838+0000 7f52a7f0b640 1 -- 172.21.15.19:0/2757939471 shutdown_connections 2024-09-19T09:03:41.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.838+0000 7f52a7f0b640 1 -- 172.21.15.19:0/2757939471 wait complete. 2024-09-19T09:03:41.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.839+0000 7f52a7f0b640 1 Processor -- start 2024-09-19T09:03:41.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.839+0000 7f52a7f0b640 1 -- start start 2024-09-19T09:03:41.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.839+0000 7f52a7f0b640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f52a0102d30 0x7f52a01985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:41.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.839+0000 7f52a7f0b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52a01036e0 0x7f52a0198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:41.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.839+0000 7f52a7f0b640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52a01082a0 0x7f52a019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:41.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.839+0000 7f52a7f0b640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f52a0112060 con 0x7f52a01036e0 2024-09-19T09:03:41.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.839+0000 7f52a7f0b640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f52a0111ee0 con 0x7f52a01082a0 2024-09-19T09:03:41.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.839+0000 7f52a7f0b640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f52a01121e0 con 0x7f52a0102d30 2024-09-19T09:03:41.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.839+0000 7f52a54a6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52a01036e0 0x7f52a0198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:41.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.839+0000 7f52a54a6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52a01036e0 0x7f52a0198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44096/0 (socket says 172.21.15.19:44096) 2024-09-19T09:03:41.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.839+0000 7f52a54a6640 1 -- 172.21.15.19:0/2674206980 learned_addr learned my addr 172.21.15.19:0/2674206980 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:41.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.839+0000 7f52a5ca7640 1 --2- 172.21.15.19:0/2674206980 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f52a0102d30 0x7f52a01985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:41.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.839+0000 7f52a64a8640 1 --2- 172.21.15.19:0/2674206980 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52a01082a0 0x7f52a019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:41.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.839+0000 7f52a54a6640 1 -- 172.21.15.19:0/2674206980 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f52a0102d30 msgr2=0x7f52a01985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:41.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.840+0000 7f52a54a6640 1 --2- 172.21.15.19:0/2674206980 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f52a0102d30 0x7f52a01985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.840+0000 7f52a54a6640 1 -- 172.21.15.19:0/2674206980 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52a01082a0 msgr2=0x7f52a019ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:41.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.840+0000 7f52a54a6640 1 --2- 172.21.15.19:0/2674206980 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52a01082a0 0x7f52a019ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.840+0000 7f52a54a6640 1 -- 172.21.15.19:0/2674206980 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52a019d550 con 0x7f52a01036e0 2024-09-19T09:03:41.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.840+0000 7f52a54a6640 1 --2- 172.21.15.19:0/2674206980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52a01036e0 0x7f52a0198ae0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f5290005940 tx=0x7f52900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:41.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.840+0000 7f5296ffd640 1 -- 172.21.15.19:0/2674206980 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529003f030 con 0x7f52a01036e0 2024-09-19T09:03:41.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.840+0000 7f5296ffd640 1 -- 172.21.15.19:0/2674206980 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5290003ce0 con 0x7f52a01036e0 2024-09-19T09:03:41.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.840+0000 7f52a7f0b640 1 -- 172.21.15.19:0/2674206980 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52a019d7e0 con 0x7f52a01036e0 2024-09-19T09:03:41.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.840+0000 7f5296ffd640 1 -- 172.21.15.19:0/2674206980 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5290035070 con 0x7f52a01036e0 2024-09-19T09:03:41.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.840+0000 7f52a7f0b640 1 -- 172.21.15.19:0/2674206980 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52a01a5120 con 0x7f52a01036e0 2024-09-19T09:03:41.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.843+0000 7f52aa2e4740 1 Processor -- start 2024-09-19T09:03:41.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.843+0000 7f52aa2e4740 1 -- start start 2024-09-19T09:03:41.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.843+0000 7f52aa2e4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ec5701b60 0x559ec5701f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:41.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.843+0000 7f52aa2e4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559ec5702480 0x559ec570c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:41.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.843+0000 7f52aa2e4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ec570cd40 0x559ec570f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:41.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.843+0000 7f52aa2e4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559ec5667280 con 0x559ec5701b60 2024-09-19T09:03:41.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.843+0000 7f52aa2e4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559ec560eb10 con 0x559ec5702480 2024-09-19T09:03:41.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.843+0000 7f52aa2e4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559ec5663240 con 0x559ec570cd40 2024-09-19T09:03:41.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.843+0000 7f52a64a8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ec5701b60 0x559ec5701f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:41.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.843+0000 7f52a64a8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ec5701b60 0x559ec5701f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44100/0 (socket says 172.21.15.19:44100) 2024-09-19T09:03:41.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.843+0000 7f52a64a8640 1 -- 172.21.15.19:0/999995310 learned_addr learned my addr 172.21.15.19:0/999995310 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:41.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.843+0000 7f5296ffd640 1 -- 172.21.15.19:0/2674206980 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f5290042030 con 0x7f52a01036e0 2024-09-19T09:03:41.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.843+0000 7f52a5ca7640 1 --2- 172.21.15.19:0/999995310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559ec5702480 0x559ec570c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:41.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.844+0000 7f52a64a8640 1 -- 172.21.15.19:0/999995310 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ec570cd40 msgr2=0x559ec570f130 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T09:03:41.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.844+0000 7f52a64a8640 1 --2- 172.21.15.19:0/999995310 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ec570cd40 0x559ec570f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.844+0000 7f52a64a8640 1 -- 172.21.15.19:0/999995310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559ec5702480 msgr2=0x559ec570c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:41.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.844+0000 7f52a64a8640 1 --2- 172.21.15.19:0/999995310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559ec5702480 0x559ec570c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.844+0000 7f52a64a8640 1 -- 172.21.15.19:0/999995310 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ec561b1f0 con 0x559ec5701b60 2024-09-19T09:03:41.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.844+0000 7f52a5ca7640 1 --2- 172.21.15.19:0/999995310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559ec5702480 0x559ec570c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:41.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.844+0000 7f52a64a8640 1 --2- 172.21.15.19:0/999995310 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ec5701b60 0x559ec5701f40 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f5298009f70 tx=0x7f5298010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c39719b0dbd8668 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:41.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.844+0000 7f528bfff640 1 -- 172.21.15.19:0/999995310 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5298016070 con 0x559ec5701b60 2024-09-19T09:03:41.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.844+0000 7f528bfff640 1 -- 172.21.15.19:0/999995310 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5298004d20 con 0x559ec5701b60 2024-09-19T09:03:41.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.844+0000 7f528bfff640 1 -- 172.21.15.19:0/999995310 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5298012910 con 0x559ec5701b60 2024-09-19T09:03:41.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.844+0000 7f5296ffd640 1 --2- 172.21.15.19:0/2674206980 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f528c0a3240 0x7f528c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:41.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.844+0000 7f52a5ca7640 1 --2- 172.21.15.19:0/2674206980 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f528c0a3240 0x7f528c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:41.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.844+0000 7f5296ffd640 1 -- 172.21.15.19:0/2674206980 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f52900efd00 con 0x7f52a01036e0 2024-09-19T09:03:41.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.845+0000 7f52a5ca7640 1 --2- 172.21.15.19:0/2674206980 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f528c0a3240 0x7f528c0a5700 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x559ec56fef50 tx=0x7f529c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:41.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.845+0000 7f52aa2e4740 1 -- 172.21.15.19:0/999995310 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ec5701b60 msgr2=0x559ec5701f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:41.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.845+0000 7f52aa2e4740 1 --2- 172.21.15.19:0/999995310 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ec5701b60 0x559ec5701f40 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f5298009f70 tx=0x7f5298010800 comp rx=0 tx=0).stop 2024-09-19T09:03:41.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.845+0000 7f52aa2e4740 1 -- 172.21.15.19:0/999995310 shutdown_connections 2024-09-19T09:03:41.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.845+0000 7f52aa2e4740 1 --2- 172.21.15.19:0/999995310 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ec570cd40 0x559ec570f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.845+0000 7f52aa2e4740 1 --2- 172.21.15.19:0/999995310 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559ec5702480 0x559ec570c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.845+0000 7f52aa2e4740 1 --2- 172.21.15.19:0/999995310 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ec5701b60 0x559ec5701f40 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.845+0000 7f52aa2e4740 1 -- 172.21.15.19:0/999995310 >> 172.21.15.19:0/999995310 conn(0x559ec56fe0f0 msgr2=0x559ec56fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:41.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.845+0000 7f52aa2e4740 1 -- 172.21.15.19:0/999995310 shutdown_connections 2024-09-19T09:03:41.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.845+0000 7f52aa2e4740 1 -- 172.21.15.19:0/999995310 wait complete. 2024-09-19T09:03:41.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.845+0000 7f52aa2e4740 1 -- start start 2024-09-19T09:03:41.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.846+0000 7f52aa2e4740 1 Processor -- start 2024-09-19T09:03:41.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.846+0000 7f52aa2e4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559ec5701b60 0x559ec57112d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:41.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.846+0000 7f52aa2e4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ec5702480 0x559ec5711810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:41.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.846+0000 7f52aa2e4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ec570cd40 0x559ec57158e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:41.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.846+0000 7f52aa2e4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559ec570f910 con 0x559ec570cd40 2024-09-19T09:03:41.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.846+0000 7f52aa2e4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559ec5621f10 con 0x559ec5701b60 2024-09-19T09:03:41.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.846+0000 7f52aa2e4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559ec570fa90 con 0x559ec5702480 2024-09-19T09:03:41.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.846+0000 7f52aa2e4740 10 client.0 _ll_register_callbacks cb 0x559ec55eaa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:41.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.846+0000 7f52a64a8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ec570cd40 0x559ec57158e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:41.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.846+0000 7f52a64a8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ec570cd40 0x559ec57158e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44114/0 (socket says 172.21.15.19:44114) 2024-09-19T09:03:41.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.846+0000 7f52a64a8640 1 -- 172.21.15.19:0/4021034715 learned_addr learned my addr 172.21.15.19:0/4021034715 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:41.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.846+0000 7f52a5ca7640 1 --2- 172.21.15.19:0/4021034715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559ec5701b60 0x559ec57112d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:41.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.846+0000 7f52a54a6640 1 --2- 172.21.15.19:0/4021034715 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ec5702480 0x559ec5711810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:41.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.847+0000 7f52a64a8640 1 -- 172.21.15.19:0/4021034715 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ec5702480 msgr2=0x559ec5711810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:41.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.847+0000 7f52a64a8640 1 --2- 172.21.15.19:0/4021034715 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ec5702480 0x559ec5711810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.847+0000 7f52a64a8640 1 -- 172.21.15.19:0/4021034715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559ec5701b60 msgr2=0x559ec57112d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:41.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.847+0000 7f52a64a8640 1 --2- 172.21.15.19:0/4021034715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559ec5701b60 0x559ec57112d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.847+0000 7f52a64a8640 1 -- 172.21.15.19:0/4021034715 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ec53d86a0 con 0x559ec570cd40 2024-09-19T09:03:41.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.847+0000 7f52a64a8640 1 --2- 172.21.15.19:0/4021034715 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ec570cd40 0x559ec57158e0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f5298011010 tx=0x7f5298004c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29724043f1ea0d78 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:41.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.847+0000 7f52897fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:41.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.847+0000 7f52897fa640 1 -- 172.21.15.19:0/4021034715 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5298029060 con 0x559ec570cd40 2024-09-19T09:03:41.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.847+0000 7f52aa2e4740 1 -- 172.21.15.19:0/4021034715 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5298004d20 con 0x559ec570cd40 2024-09-19T09:03:41.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.847+0000 7f52897fa640 1 -- 172.21.15.19:0/4021034715 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f52980051e0 con 0x559ec570cd40 2024-09-19T09:03:41.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.847+0000 7f52897fa640 1 -- 172.21.15.19:0/4021034715 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f5298016070 con 0x559ec570cd40 2024-09-19T09:03:41.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.847+0000 7f52aa2e4740 10 client.18285 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:41.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.847+0000 7f52aa2e4740 1 -- 172.21.15.19:0/4021034715 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x559ec571fa40 con 0x559ec570cd40 2024-09-19T09:03:41.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.847+0000 7f52897fa640 1 -- 172.21.15.19:0/4021034715 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5298004d20 con 0x559ec570cd40 2024-09-19T09:03:41.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.848+0000 7f52897fa640 1 -- 172.21.15.19:0/4021034715 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f529800f040 con 0x559ec570cd40 2024-09-19T09:03:41.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.848+0000 7f52aa2e4740 10 client.18285 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:41.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.848+0000 7f52aa2e4740 10 client.18285 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:41.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.848+0000 7f52aa2e4740 20 client.18285 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:41.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.848+0000 7f52aa2e4740 1 --2- 172.21.15.19:0/4021034715 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x559ec5720e50 0x559ec5723240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:41.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.848+0000 7f52aa2e4740 4 client.18285 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:41.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.848+0000 7f52aa2e4740 1 -- 172.21.15.19:0/4021034715 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559ec56747f0 con 0x559ec5720e50 2024-09-19T09:03:41.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.848+0000 7f52a5ca7640 1 --2- 172.21.15.19:0/4021034715 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x559ec5720e50 0x559ec5723240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:41.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.849+0000 7f52a5ca7640 1 --2- 172.21.15.19:0/4021034715 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x559ec5720e50 0x559ec5723240 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a1f27b2fe547c60 server_cookie=ec4fc1d61f424e64 in_seq=0 out_seq=0 2024-09-19T09:03:41.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.849+0000 7f52897fa640 10 client.18285 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:41.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.849+0000 7f52897fa640 1 -- 172.21.15.19:0/4021034715 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559ec56747f0 con 0x559ec5720e50 2024-09-19T09:03:41.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.849+0000 7f52897fa640 10 client.18285 handle_command_reply: tid=0 2024-09-19T09:03:41.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.849+0000 7f52aa2e4740 1 client.18285 shutdown 2024-09-19T09:03:41.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.849+0000 7f52aa2e4740 1 -- 172.21.15.19:0/4021034715 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ec570cd40 msgr2=0x559ec57158e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:41.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.849+0000 7f52aa2e4740 1 --2- 172.21.15.19:0/4021034715 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ec570cd40 0x559ec57158e0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f5298011010 tx=0x7f5298004c50 comp rx=0 tx=0).stop 2024-09-19T09:03:41.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.850+0000 7f52aa2e4740 1 -- 172.21.15.19:0/4021034715 shutdown_connections 2024-09-19T09:03:41.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.850+0000 7f52aa2e4740 1 --2- 172.21.15.19:0/4021034715 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x559ec5720e50 0x559ec5723240 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.850+0000 7f52aa2e4740 1 --2- 172.21.15.19:0/4021034715 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ec5702480 0x559ec5711810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.850+0000 7f52aa2e4740 1 --2- 172.21.15.19:0/4021034715 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ec570cd40 0x559ec57158e0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.850+0000 7f52aa2e4740 1 --2- 172.21.15.19:0/4021034715 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559ec5701b60 0x559ec57112d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.850+0000 7f52aa2e4740 1 -- 172.21.15.19:0/4021034715 >> 172.21.15.19:0/4021034715 conn(0x559ec56fe0f0 msgr2=0x559ec5703e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:41.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.850+0000 7f52897fa640 0 client.18285 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:41.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.850+0000 7f52aa2e4740 1 -- 172.21.15.19:0/4021034715 shutdown_connections 2024-09-19T09:03:41.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.850+0000 7f52aa2e4740 1 -- 172.21.15.19:0/4021034715 wait complete. 2024-09-19T09:03:41.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.850+0000 7f52aa2e4740 20 client.18285 trim_cache size 0 max 16384 2024-09-19T09:03:41.876 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.861+0000 7f6bf2ffd640 1 -- 172.21.15.19:0/1118346509 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560a33494a20 con 0x560a33541f30 2024-09-19T09:03:41.876 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.861+0000 7f6bf2ffd640 10 client.18297 handle_command_reply: tid=0 2024-09-19T09:03:41.876 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.861+0000 7f6c1cc0f740 1 client.18297 shutdown 2024-09-19T09:03:41.876 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.861+0000 7f6c1cc0f740 1 -- 172.21.15.19:0/1118346509 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a33523680 msgr2=0x560a335362d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.861+0000 7f6c1cc0f740 1 --2- 172.21.15.19:0/1118346509 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a33523680 0x560a335362d0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f6c040106d0 tx=0x7f6c04010b90 comp rx=0 tx=0).stop 2024-09-19T09:03:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.861+0000 7f6c1cc0f740 1 -- 172.21.15.19:0/1118346509 shutdown_connections 2024-09-19T09:03:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.861+0000 7f6c1cc0f740 1 --2- 172.21.15.19:0/1118346509 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560a33541f30 0x560a335443a0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.861+0000 7f6c1cc0f740 1 --2- 172.21.15.19:0/1118346509 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560a33524e40 0x560a3353d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.861+0000 7f6c1cc0f740 1 --2- 172.21.15.19:0/1118346509 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560a33524040 0x560a33536810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.861+0000 7f6bf2ffd640 0 client.18297 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.861+0000 7f6c1cc0f740 1 --2- 172.21.15.19:0/1118346509 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a33523680 0x560a335362d0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.861+0000 7f6c1cc0f740 1 -- 172.21.15.19:0/1118346509 >> 172.21.15.19:0/1118346509 conn(0x560a3351f010 msgr2=0x560a33520820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.861+0000 7f6c1cc0f740 1 -- 172.21.15.19:0/1118346509 shutdown_connections 2024-09-19T09:03:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.861+0000 7f6c1cc0f740 1 -- 172.21.15.19:0/1118346509 wait complete. 2024-09-19T09:03:41.877 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.862+0000 7f6c1cc0f740 20 client.18297 trim_cache size 0 max 16384 2024-09-19T09:03:41.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.870+0000 7f52aa2e4740 1 Processor -- start 2024-09-19T09:03:41.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.870+0000 7f52aa2e4740 1 -- start start 2024-09-19T09:03:41.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.871+0000 7f52aa2e4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ec5701b60 0x559ec5715860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:41.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.871+0000 7f52aa2e4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559ec5702480 0x559ec57103b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:41.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.871+0000 7f52aa2e4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ec570cd40 0x559ec57287e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:41.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.871+0000 7f52aa2e4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f52a01ab370 con 0x559ec570cd40 2024-09-19T09:03:41.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.871+0000 7f52aa2e4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f52a01aceb0 con 0x559ec5702480 2024-09-19T09:03:41.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.871+0000 7f52aa2e4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f52a01aba40 con 0x559ec5701b60 2024-09-19T09:03:41.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.871+0000 7f52a5ca7640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ec5701b60 0x559ec5715860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:41.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.871+0000 7f52a64a8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ec570cd40 0x559ec57287e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:41.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.871+0000 7f52a5ca7640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ec5701b60 0x559ec5715860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:46008/0 (socket says 172.21.15.19:46008) 2024-09-19T09:03:41.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.871+0000 7f52a5ca7640 1 -- 172.21.15.19:0/205624472 learned_addr learned my addr 172.21.15.19:0/205624472 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:41.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.871+0000 7f52a54a6640 1 --2- 172.21.15.19:0/205624472 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559ec5702480 0x559ec57103b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:41.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.871+0000 7f52a5ca7640 1 -- 172.21.15.19:0/205624472 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559ec5702480 msgr2=0x559ec57103b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:41.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.871+0000 7f52a5ca7640 1 --2- 172.21.15.19:0/205624472 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559ec5702480 0x559ec57103b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.871+0000 7f52a5ca7640 1 -- 172.21.15.19:0/205624472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ec570cd40 msgr2=0x559ec57287e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:41.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.871+0000 7f52a5ca7640 1 --2- 172.21.15.19:0/205624472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ec570cd40 0x559ec57287e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.871+0000 7f52a5ca7640 1 -- 172.21.15.19:0/205624472 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559ec57022b0 con 0x559ec5701b60 2024-09-19T09:03:41.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.871+0000 7f52a5ca7640 1 --2- 172.21.15.19:0/205624472 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ec5701b60 0x559ec5715860 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f529c020420 tx=0x7f529c015000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f62e81207588c38d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:41.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.873+0000 7f528b7fe640 1 -- 172.21.15.19:0/205624472 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529c00ae00 con 0x559ec5701b60 2024-09-19T09:03:41.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.873+0000 7f528b7fe640 1 -- 172.21.15.19:0/205624472 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f529c02c030 con 0x559ec5701b60 2024-09-19T09:03:41.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.873+0000 7f528b7fe640 1 -- 172.21.15.19:0/205624472 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f529c028530 con 0x559ec5701b60 2024-09-19T09:03:41.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.874+0000 7f52aa2e4740 1 -- 172.21.15.19:0/205624472 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ec5701b60 msgr2=0x559ec5715860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:41.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.874+0000 7f52aa2e4740 1 --2- 172.21.15.19:0/205624472 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ec5701b60 0x559ec5715860 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f529c020420 tx=0x7f529c015000 comp rx=0 tx=0).stop 2024-09-19T09:03:41.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.874+0000 7f52aa2e4740 1 -- 172.21.15.19:0/205624472 shutdown_connections 2024-09-19T09:03:41.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.874+0000 7f52aa2e4740 1 --2- 172.21.15.19:0/205624472 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ec570cd40 0x559ec57287e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.874+0000 7f52aa2e4740 1 --2- 172.21.15.19:0/205624472 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559ec5702480 0x559ec57103b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.874+0000 7f52aa2e4740 1 --2- 172.21.15.19:0/205624472 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ec5701b60 0x559ec5715860 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.874+0000 7f52aa2e4740 1 -- 172.21.15.19:0/205624472 >> 172.21.15.19:0/205624472 conn(0x559ec56fe0f0 msgr2=0x559ec570fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:41.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.874+0000 7f52aa2e4740 1 -- 172.21.15.19:0/205624472 shutdown_connections 2024-09-19T09:03:41.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.874+0000 7f52aa2e4740 1 -- 172.21.15.19:0/205624472 wait complete. 2024-09-19T09:03:41.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.875+0000 7f52aa2e4740 1 -- start start 2024-09-19T09:03:41.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.875+0000 7f52aa2e4740 1 Processor -- start 2024-09-19T09:03:41.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.875+0000 7f52aa2e4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ec5701b60 0x559ec5719490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:41.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.875+0000 7f52aa2e4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ec5702480 0x559ec57199d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:41.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.875+0000 7f52aa2e4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559ec570cd40 0x559ec5783770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:41.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.875+0000 7f52aa2e4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f52a01ac7e0 con 0x559ec5702480 2024-09-19T09:03:41.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.875+0000 7f52aa2e4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f52a01ac110 con 0x559ec570cd40 2024-09-19T09:03:41.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.875+0000 7f52aa2e4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f52a01a9370 con 0x559ec5701b60 2024-09-19T09:03:41.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.875+0000 7f52aa2e4740 10 client.0 _ll_register_callbacks cb 0x7f5298009df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:41.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.875+0000 7f52a54a6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ec5702480 0x559ec57199d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:41.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.875+0000 7f52a54a6640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ec5702480 0x559ec57199d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44164/0 (socket says 172.21.15.19:44164) 2024-09-19T09:03:41.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.875+0000 7f52a54a6640 1 -- 172.21.15.19:0/3995802141 learned_addr learned my addr 172.21.15.19:0/3995802141 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:41.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.875+0000 7f52a64a8640 1 --2- 172.21.15.19:0/3995802141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559ec570cd40 0x559ec5783770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:41.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.875+0000 7f52a5ca7640 1 --2- 172.21.15.19:0/3995802141 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ec5701b60 0x559ec5719490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:41.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.876+0000 7f52a54a6640 1 -- 172.21.15.19:0/3995802141 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ec5701b60 msgr2=0x559ec5719490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:41.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.876+0000 7f52a54a6640 1 --2- 172.21.15.19:0/3995802141 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ec5701b60 0x559ec5719490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.876+0000 7f52a54a6640 1 -- 172.21.15.19:0/3995802141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559ec570cd40 msgr2=0x559ec5783770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:41.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.876+0000 7f52a54a6640 1 --2- 172.21.15.19:0/3995802141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559ec570cd40 0x559ec5783770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.876+0000 7f52a54a6640 1 -- 172.21.15.19:0/3995802141 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559ec5783fa0 con 0x559ec5702480 2024-09-19T09:03:41.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.876+0000 7f52a64a8640 1 --2- 172.21.15.19:0/3995802141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559ec570cd40 0x559ec5783770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:41.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.876+0000 7f52a54a6640 1 --2- 172.21.15.19:0/3995802141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ec5702480 0x559ec57199d0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f529004a000 tx=0x7f52900b8680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a876e93f8bbda4d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:41.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.876+0000 7f52897fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:41.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.876+0000 7f52897fa640 1 -- 172.21.15.19:0/3995802141 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5290049040 con 0x559ec5702480 2024-09-19T09:03:41.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.876+0000 7f52897fa640 1 -- 172.21.15.19:0/3995802141 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f52900b8a50 con 0x559ec5702480 2024-09-19T09:03:41.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.876+0000 7f52aa2e4740 1 -- 172.21.15.19:0/3995802141 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f529c02c030 con 0x559ec5702480 2024-09-19T09:03:41.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.876+0000 7f52897fa640 1 -- 172.21.15.19:0/3995802141 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f52900044e0 con 0x559ec5702480 2024-09-19T09:03:41.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.876+0000 7f52aa2e4740 10 client.18303 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:41.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.876+0000 7f52aa2e4740 1 -- 172.21.15.19:0/3995802141 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x559ec578c3b0 con 0x559ec5702480 2024-09-19T09:03:41.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.877+0000 7f52897fa640 1 -- 172.21.15.19:0/3995802141 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f529c02c030 con 0x559ec5702480 2024-09-19T09:03:41.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.877+0000 7f52897fa640 1 -- 172.21.15.19:0/3995802141 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f52900d5190 con 0x559ec5702480 2024-09-19T09:03:41.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.877+0000 7f52aa2e4740 10 client.18303 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:41.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.877+0000 7f52aa2e4740 10 client.18303 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:41.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.877+0000 7f52aa2e4740 20 client.18303 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:41.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.877+0000 7f52aa2e4740 1 --2- 172.21.15.19:0/3995802141 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x559ec578cb80 0x559ec578efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:41.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.877+0000 7f52aa2e4740 4 client.18303 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:03:41.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.877+0000 7f52aa2e4740 1 -- 172.21.15.19:0/3995802141 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559ec566ed00 con 0x559ec578cb80 2024-09-19T09:03:41.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.877+0000 7f52a5ca7640 1 --2- 172.21.15.19:0/3995802141 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x559ec578cb80 0x559ec578efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:41.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.878+0000 7f52897fa640 10 client.18303 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:41.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.878+0000 7f52a5ca7640 1 --2- 172.21.15.19:0/3995802141 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x559ec578cb80 0x559ec578efa0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=531a9ce423fb61bf server_cookie=ca4778840b57c222 in_seq=0 out_seq=0 2024-09-19T09:03:41.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.879+0000 7f52897fa640 1 -- 172.21.15.19:0/3995802141 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559ec566ed00 con 0x559ec578cb80 2024-09-19T09:03:41.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.879+0000 7f52897fa640 10 client.18303 handle_command_reply: tid=0 2024-09-19T09:03:41.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.879+0000 7f52aa2e4740 1 client.18303 shutdown 2024-09-19T09:03:41.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.879+0000 7f52aa2e4740 1 -- 172.21.15.19:0/3995802141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ec5702480 msgr2=0x559ec57199d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:41.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.879+0000 7f52aa2e4740 1 --2- 172.21.15.19:0/3995802141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ec5702480 0x559ec57199d0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f529004a000 tx=0x7f52900b8680 comp rx=0 tx=0).stop 2024-09-19T09:03:41.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.879+0000 7f52aa2e4740 1 -- 172.21.15.19:0/3995802141 shutdown_connections 2024-09-19T09:03:41.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.879+0000 7f52aa2e4740 1 --2- 172.21.15.19:0/3995802141 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x559ec578cb80 0x559ec578efa0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.879+0000 7f52aa2e4740 1 --2- 172.21.15.19:0/3995802141 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559ec570cd40 0x559ec5783770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.879+0000 7f52aa2e4740 1 --2- 172.21.15.19:0/3995802141 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559ec5702480 0x559ec57199d0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.879+0000 7f52897fa640 0 client.18303 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:41.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.879+0000 7f52aa2e4740 1 --2- 172.21.15.19:0/3995802141 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559ec5701b60 0x559ec5719490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.879+0000 7f52aa2e4740 1 -- 172.21.15.19:0/3995802141 >> 172.21.15.19:0/3995802141 conn(0x559ec56fe0f0 msgr2=0x559ec57035b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:41.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.879+0000 7f52aa2e4740 1 -- 172.21.15.19:0/3995802141 shutdown_connections 2024-09-19T09:03:41.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.879+0000 7f52aa2e4740 1 -- 172.21.15.19:0/3995802141 wait complete. 2024-09-19T09:03:41.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.880+0000 7f52aa2e4740 20 client.18303 trim_cache size 0 max 16384 2024-09-19T09:03:41.888 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.880+0000 7f6c1cc0f740 1 Processor -- start 2024-09-19T09:03:41.888 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.880+0000 7f6c1cc0f740 1 -- start start 2024-09-19T09:03:41.888 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T09:03:41.888 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-19T09:03:41.888 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "7a029f04-000c-4fae-9883-3a53b7fd2705", 2024-09-19T09:03:41.888 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-19T09:03:41.889 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T09:03:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.880+0000 7f6c1cc0f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560a33523680 0x560a33525810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.880+0000 7f6c1cc0f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560a33524040 0x560a3353d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.880+0000 7f6c1cc0f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a33524e40 0x560a33525d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.880+0000 7f6c1cc0f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6c141a6de0 con 0x560a33524e40 2024-09-19T09:03:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.880+0000 7f6c1cc0f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6c141a8920 con 0x560a33524040 2024-09-19T09:03:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.880+0000 7f6c1cc0f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6c141a74b0 con 0x560a33523680 2024-09-19T09:03:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.880+0000 7f6c13fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a33524e40 0x560a33525d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.880+0000 7f6c137fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560a33523680 0x560a33525810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.880+0000 7f6c12ffd640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560a33524040 0x560a3353d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:41.890 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.880+0000 7f6c137fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560a33523680 0x560a33525810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:46026/0 (socket says 172.21.15.19:46026) 2024-09-19T09:03:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.880+0000 7f6c137fe640 1 -- 172.21.15.19:0/3704417227 learned_addr learned my addr 172.21.15.19:0/3704417227 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.880+0000 7f6c13fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a33524e40 0x560a33525d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44180/0 (socket says 172.21.15.19:44180) 2024-09-19T09:03:41.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.880+0000 7f52a7f0b640 1 -- 172.21.15.19:0/2674206980 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f528c0a3240 msgr2=0x7f528c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:41.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.880+0000 7f52a7f0b640 1 --2- 172.21.15.19:0/2674206980 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f528c0a3240 0x7f528c0a5700 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x559ec56fef50 tx=0x7f529c00a2d0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.880+0000 7f52a7f0b640 1 -- 172.21.15.19:0/2674206980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52a01036e0 msgr2=0x7f52a0198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.881+0000 7f6c137fe640 1 -- 172.21.15.19:0/3704417227 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560a33524040 msgr2=0x560a3353d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.881+0000 7f6c137fe640 1 --2- 172.21.15.19:0/3704417227 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560a33524040 0x560a3353d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.891 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.881+0000 7f6c137fe640 1 -- 172.21.15.19:0/3704417227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a33524e40 msgr2=0x560a33525d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:41.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.880+0000 7f52a7f0b640 1 --2- 172.21.15.19:0/2674206980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52a01036e0 0x7f52a0198ae0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f5290005940 tx=0x7f52900042f0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.880+0000 7f52a7f0b640 1 -- 172.21.15.19:0/2674206980 shutdown_connections 2024-09-19T09:03:41.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.880+0000 7f52a7f0b640 1 --2- 172.21.15.19:0/2674206980 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f528c0a3240 0x7f528c0a5700 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.880+0000 7f52a7f0b640 1 --2- 172.21.15.19:0/2674206980 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f52a01082a0 0x7f52a019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.880+0000 7f52a7f0b640 1 --2- 172.21.15.19:0/2674206980 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f52a01036e0 0x7f52a0198ae0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.880+0000 7f52a7f0b640 1 --2- 172.21.15.19:0/2674206980 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f52a0102d30 0x7f52a01985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.880+0000 7f52a7f0b640 1 -- 172.21.15.19:0/2674206980 >> 172.21.15.19:0/2674206980 conn(0x7f52a00fc7d0 msgr2=0x7f52a0105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:41.893 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.881+0000 7f6c137fe640 1 --2- 172.21.15.19:0/3704417227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a33524e40 0x560a33525d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.893 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.881+0000 7f6c137fe640 1 -- 172.21.15.19:0/3704417227 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a3352b310 con 0x560a33523680 2024-09-19T09:03:41.893 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.881+0000 7f6c13fff640 1 --2- 172.21.15.19:0/3704417227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a33524e40 0x560a33525d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:41.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.881+0000 7f52a7f0b640 1 -- 172.21.15.19:0/2674206980 shutdown_connections 2024-09-19T09:03:41.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:41.881+0000 7f52a7f0b640 1 -- 172.21.15.19:0/2674206980 wait complete. 2024-09-19T09:03:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.881+0000 7f6c137fe640 1 --2- 172.21.15.19:0/3704417227 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560a33523680 0x560a33525810 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6c0400c010 tx=0x7f6c0400b630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b2ac860fee9559f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.881+0000 7f6bf97fa640 1 -- 172.21.15.19:0/3704417227 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c04000e60 con 0x560a33523680 2024-09-19T09:03:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.881+0000 7f6bf97fa640 1 -- 172.21.15.19:0/3704417227 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c0402a070 con 0x560a33523680 2024-09-19T09:03:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.881+0000 7f6bf97fa640 1 -- 172.21.15.19:0/3704417227 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c04017040 con 0x560a33523680 2024-09-19T09:03:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.882+0000 7f6c1cc0f740 1 -- 172.21.15.19:0/3704417227 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560a33523680 msgr2=0x560a33525810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.882+0000 7f6c1cc0f740 1 --2- 172.21.15.19:0/3704417227 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560a33523680 0x560a33525810 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6c0400c010 tx=0x7f6c0400b630 comp rx=0 tx=0).stop 2024-09-19T09:03:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.882+0000 7f6c1cc0f740 1 -- 172.21.15.19:0/3704417227 shutdown_connections 2024-09-19T09:03:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.882+0000 7f6c1cc0f740 1 --2- 172.21.15.19:0/3704417227 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a33524e40 0x560a33525d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.897 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.882+0000 7f6c1cc0f740 1 --2- 172.21.15.19:0/3704417227 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560a33524040 0x560a3353d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.882+0000 7f6c1cc0f740 1 --2- 172.21.15.19:0/3704417227 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560a33523680 0x560a33525810 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.882+0000 7f6c1cc0f740 1 -- 172.21.15.19:0/3704417227 >> 172.21.15.19:0/3704417227 conn(0x560a3351f010 msgr2=0x560a33536080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:41.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.882+0000 7f6c1cc0f740 1 -- 172.21.15.19:0/3704417227 shutdown_connections 2024-09-19T09:03:41.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.882+0000 7f6c1cc0f740 1 -- 172.21.15.19:0/3704417227 wait complete. 2024-09-19T09:03:41.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.882+0000 7f6c1cc0f740 1 -- start start 2024-09-19T09:03:41.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.883+0000 7f6c1cc0f740 1 Processor -- start 2024-09-19T09:03:41.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.883+0000 7f6c1cc0f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a33523680 0x560a335391c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:41.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.883+0000 7f6c1cc0f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560a33524040 0x560a33539700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:41.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.883+0000 7f6c1cc0f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560a33524e40 0x560a3353c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:41.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.883+0000 7f6c1cc0f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6c141a8250 con 0x560a33523680 2024-09-19T09:03:41.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.883+0000 7f6c1cc0f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6c141a7b80 con 0x560a33524040 2024-09-19T09:03:41.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.883+0000 7f6c1cc0f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6c141a4dc0 con 0x560a33524e40 2024-09-19T09:03:41.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.883+0000 7f6c1cc0f740 10 client.0 _ll_register_callbacks cb 0x7f6c0400b3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:41.898 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.883+0000 7f6c137fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a33523680 0x560a335391c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.883+0000 7f6c137fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a33523680 0x560a335391c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44196/0 (socket says 172.21.15.19:44196) 2024-09-19T09:03:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.883+0000 7f6c137fe640 1 -- 172.21.15.19:0/2855606190 learned_addr learned my addr 172.21.15.19:0/2855606190 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.883+0000 7f6c12ffd640 1 --2- 172.21.15.19:0/2855606190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560a33524040 0x560a33539700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.883+0000 7f6c13fff640 1 --2- 172.21.15.19:0/2855606190 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560a33524e40 0x560a3353c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.884+0000 7f6c137fe640 1 -- 172.21.15.19:0/2855606190 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560a33524e40 msgr2=0x560a3353c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.884+0000 7f6c137fe640 1 --2- 172.21.15.19:0/2855606190 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560a33524e40 0x560a3353c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.884+0000 7f6c137fe640 1 -- 172.21.15.19:0/2855606190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560a33524040 msgr2=0x560a33539700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.884+0000 7f6c137fe640 1 --2- 172.21.15.19:0/2855606190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560a33524040 0x560a33539700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.884+0000 7f6c137fe640 1 -- 172.21.15.19:0/2855606190 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a3353cd30 con 0x560a33523680 2024-09-19T09:03:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.884+0000 7f6c137fe640 1 --2- 172.21.15.19:0/2855606190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a33523680 0x560a335391c0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f6c0400b560 tx=0x7f6c04005970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d75e3d11fa814a9b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.884+0000 7f6bf2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.884+0000 7f6bf2ffd640 1 -- 172.21.15.19:0/2855606190 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c04035070 con 0x560a33523680 2024-09-19T09:03:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.884+0000 7f6c1cc0f740 1 -- 172.21.15.19:0/2855606190 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c0402a070 con 0x560a33523680 2024-09-19T09:03:41.899 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.884+0000 7f6bf2ffd640 1 -- 172.21.15.19:0/2855606190 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f6c04005040 con 0x560a33523680 2024-09-19T09:03:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.884+0000 7f6bf2ffd640 1 -- 172.21.15.19:0/2855606190 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f6c04041050 con 0x560a33523680 2024-09-19T09:03:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.884+0000 7f6c1cc0f740 10 client.18309 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.884+0000 7f6c1cc0f740 1 -- 172.21.15.19:0/2855606190 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x560a335acf80 con 0x560a33523680 2024-09-19T09:03:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.884+0000 7f6bf2ffd640 1 -- 172.21.15.19:0/2855606190 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6c0402a070 con 0x560a33523680 2024-09-19T09:03:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.884+0000 7f6bf2ffd640 1 -- 172.21.15.19:0/2855606190 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f6c04004a20 con 0x560a33523680 2024-09-19T09:03:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.885+0000 7f6c1cc0f740 10 client.18309 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.885+0000 7f6c1cc0f740 10 client.18309 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.885+0000 7f6c1cc0f740 20 client.18309 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.885+0000 7f6c1cc0f740 1 --2- 172.21.15.19:0/2855606190 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560a335ad870 0x560a335afc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.885+0000 7f6c1cc0f740 4 client.18309 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:03:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.885+0000 7f6c1cc0f740 1 -- 172.21.15.19:0/2855606190 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560a3348ed70 con 0x560a335ad870 2024-09-19T09:03:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.885+0000 7f6c12ffd640 1 --2- 172.21.15.19:0/2855606190 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560a335ad870 0x560a335afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:41.900 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.885+0000 7f6bf2ffd640 10 client.18309 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:41.901 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.885+0000 7f6c12ffd640 1 --2- 172.21.15.19:0/2855606190 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560a335ad870 0x560a335afc90 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7da7aedfa0f6f5e3 server_cookie=1e5815dd58a70b4e in_seq=0 out_seq=0 2024-09-19T09:03:41.902 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.902+0000 7f6bf2ffd640 1 -- 172.21.15.19:0/2855606190 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560a3348ed70 con 0x560a335ad870 2024-09-19T09:03:41.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.902+0000 7f6bf2ffd640 10 client.18309 handle_command_reply: tid=0 2024-09-19T09:03:41.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.902+0000 7f6c1cc0f740 1 client.18309 shutdown 2024-09-19T09:03:41.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.902+0000 7f6c1cc0f740 1 -- 172.21.15.19:0/2855606190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a33523680 msgr2=0x560a335391c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:41.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.902+0000 7f6c1cc0f740 1 --2- 172.21.15.19:0/2855606190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a33523680 0x560a335391c0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f6c0400b560 tx=0x7f6c04005970 comp rx=0 tx=0).stop 2024-09-19T09:03:41.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.902+0000 7f6c1cc0f740 1 -- 172.21.15.19:0/2855606190 shutdown_connections 2024-09-19T09:03:41.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.902+0000 7f6c1cc0f740 1 --2- 172.21.15.19:0/2855606190 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x560a335ad870 0x560a335afc90 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.902+0000 7f6c1cc0f740 1 --2- 172.21.15.19:0/2855606190 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560a33524e40 0x560a3353c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.902+0000 7f6bf2ffd640 0 client.18309 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:41.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.902+0000 7f6c1cc0f740 1 --2- 172.21.15.19:0/2855606190 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x560a33524040 0x560a33539700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.902+0000 7f6c1cc0f740 1 --2- 172.21.15.19:0/2855606190 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x560a33523680 0x560a335391c0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.902+0000 7f6c1cc0f740 1 -- 172.21.15.19:0/2855606190 >> 172.21.15.19:0/2855606190 conn(0x560a3351f010 msgr2=0x560a3351d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:41.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.903+0000 7f6c1cc0f740 1 -- 172.21.15.19:0/2855606190 shutdown_connections 2024-09-19T09:03:41.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.903+0000 7f6c1cc0f740 1 -- 172.21.15.19:0/2855606190 wait complete. 2024-09-19T09:03:41.903 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.903+0000 7f6c1cc0f740 20 client.18309 trim_cache size 0 max 16384 2024-09-19T09:03:41.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T09:03:41.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T09:03:41.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T09:03:41.904 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T09:03:41.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.903+0000 7f6c19e77640 1 -- 172.21.15.19:0/3161647488 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6bfc0a32f0 msgr2=0x7f6bfc0a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:41.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.903+0000 7f6c19e77640 1 --2- 172.21.15.19:0/3161647488 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6bfc0a32f0 0x7f6bfc0a57b0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c006010 tx=0x7f6c0c031bb0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.903+0000 7f6c19e77640 1 -- 172.21.15.19:0/3161647488 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c14101c30 msgr2=0x7f6c141971b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:41.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.903+0000 7f6c19e77640 1 --2- 172.21.15.19:0/3161647488 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c14101c30 0x7f6c141971b0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f6c0800e9f0 tx=0x7f6c0800eeb0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.903+0000 7f6c19e77640 1 -- 172.21.15.19:0/3161647488 shutdown_connections 2024-09-19T09:03:41.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.903+0000 7f6c19e77640 1 --2- 172.21.15.19:0/3161647488 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6bfc0a32f0 0x7f6bfc0a57b0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.903+0000 7f6c19e77640 1 --2- 172.21.15.19:0/3161647488 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c141025f0 0x7f6c1419e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.903+0000 7f6c19e77640 1 --2- 172.21.15.19:0/3161647488 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6c14101c30 0x7f6c141971b0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.903+0000 7f6c19e77640 1 --2- 172.21.15.19:0/3161647488 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6c14100a40 0x7f6c14196c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:41.905 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.903+0000 7f6c19e77640 1 -- 172.21.15.19:0/3161647488 >> 172.21.15.19:0/3161647488 conn(0x7f6c140fc1e0 msgr2=0x7f6c14104ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.903+0000 7f6c19e77640 1 -- 172.21.15.19:0/3161647488 shutdown_connections 2024-09-19T09:03:41.906 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:41.903+0000 7f6c19e77640 1 -- 172.21.15.19:0/3161647488 wait complete. 2024-09-19T09:03:42.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:41 smithi155 ceph-mon[34921]: pgmap v683: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.2 KiB/s wr, 17 op/s 2024-09-19T09:03:42.212 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:41 smithi019 ceph-mon[30976]: pgmap v683: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.2 KiB/s wr, 17 op/s 2024-09-19T09:03:42.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:41 smithi203 ceph-mon[35450]: pgmap v683: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.2 KiB/s wr, 17 op/s 2024-09-19T09:03:42.620 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:03:42.879 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:42.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:42 smithi155 ceph-mon[34921]: scrub queued for path: / 2024-09-19T09:03:42.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:42 smithi155 ceph-mon[34921]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:42.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:42 smithi155 ceph-mon[34921]: scrub summary: active paths [/] 2024-09-19T09:03:42.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:42 smithi155 ceph-mon[34921]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:42.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:42 smithi155 ceph-mon[34921]: scrub summary: idle 2024-09-19T09:03:43.140 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:42 smithi019 ceph-mon[30976]: scrub queued for path: / 2024-09-19T09:03:43.140 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:42 smithi019 ceph-mon[30976]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:43.140 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:42 smithi019 ceph-mon[30976]: scrub summary: active paths [/] 2024-09-19T09:03:43.140 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:42 smithi019 ceph-mon[30976]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:43.140 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:42 smithi019 ceph-mon[30976]: scrub summary: idle 2024-09-19T09:03:43.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:42 smithi203 ceph-mon[35450]: scrub queued for path: / 2024-09-19T09:03:43.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:42 smithi203 ceph-mon[35450]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:43.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:42 smithi203 ceph-mon[35450]: scrub summary: active paths [/] 2024-09-19T09:03:43.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:42 smithi203 ceph-mon[35450]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:43.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:42 smithi203 ceph-mon[35450]: scrub summary: idle 2024-09-19T09:03:43.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.435+0000 7f902cca8640 1 -- 172.21.15.19:0/250778668 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9028101de0 msgr2=0x7f90281021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:43.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.435+0000 7f902cca8640 1 --2- 172.21.15.19:0/250778668 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9028101de0 0x7f90281021c0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f9018009900 tx=0x7f901802a3f0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.435+0000 7f902cca8640 1 -- 172.21.15.19:0/250778668 shutdown_connections 2024-09-19T09:03:43.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.435+0000 7f902cca8640 1 --2- 172.21.15.19:0/250778668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9028106f10 0x7f902810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.435+0000 7f902cca8640 1 --2- 172.21.15.19:0/250778668 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9028102790 0x7f90281067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.435+0000 7f902cca8640 1 --2- 172.21.15.19:0/250778668 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9028101de0 0x7f90281021c0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.435+0000 7f902cca8640 1 -- 172.21.15.19:0/250778668 >> 172.21.15.19:0/250778668 conn(0x7f90280fd8c0 msgr2=0x7f90280ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:43.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.435+0000 7f902cca8640 1 -- 172.21.15.19:0/250778668 shutdown_connections 2024-09-19T09:03:43.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.435+0000 7f902cca8640 1 -- 172.21.15.19:0/250778668 wait complete. 2024-09-19T09:03:43.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.436+0000 7f902cca8640 1 Processor -- start 2024-09-19T09:03:43.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.436+0000 7f902cca8640 1 -- start start 2024-09-19T09:03:43.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.436+0000 7f902cca8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9028101de0 0x7f90280744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:43.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.436+0000 7f902cca8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9028102790 0x7f9028074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:43.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.436+0000 7f902cca8640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9028106f10 0x7f9028074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:43.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.437+0000 7f902cca8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9028111f90 con 0x7f9028101de0 2024-09-19T09:03:43.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.437+0000 7f902cca8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9028111e10 con 0x7f9028102790 2024-09-19T09:03:43.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.437+0000 7f902cca8640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9028112110 con 0x7f9028106f10 2024-09-19T09:03:43.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.437+0000 7f902659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9028101de0 0x7f90280744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:43.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.437+0000 7f902659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9028101de0 0x7f90280744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44220/0 (socket says 172.21.15.19:44220) 2024-09-19T09:03:43.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.437+0000 7f902659c640 1 -- 172.21.15.19:0/1455409900 learned_addr learned my addr 172.21.15.19:0/1455409900 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:43.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.437+0000 7f901dd9b640 1 --2- 172.21.15.19:0/1455409900 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9028102790 0x7f9028074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:43.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.437+0000 7f9026d9d640 1 --2- 172.21.15.19:0/1455409900 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9028106f10 0x7f9028074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:43.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.437+0000 7f902659c640 1 -- 172.21.15.19:0/1455409900 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9028106f10 msgr2=0x7f9028074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:43.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.437+0000 7f902659c640 1 --2- 172.21.15.19:0/1455409900 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9028106f10 0x7f9028074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.437+0000 7f902659c640 1 -- 172.21.15.19:0/1455409900 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9028102790 msgr2=0x7f9028074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:43.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.437+0000 7f902659c640 1 --2- 172.21.15.19:0/1455409900 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9028102790 0x7f9028074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.437+0000 7f902659c640 1 -- 172.21.15.19:0/1455409900 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90281a6890 con 0x7f9028101de0 2024-09-19T09:03:43.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.437+0000 7f902659c640 1 --2- 172.21.15.19:0/1455409900 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9028101de0 0x7f90280744f0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f9018005ab0 tx=0x7f90180042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:43.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.437+0000 7f901ffff640 1 -- 172.21.15.19:0/1455409900 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f901803f030 con 0x7f9028101de0 2024-09-19T09:03:43.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.437+0000 7f902cca8640 1 -- 172.21.15.19:0/1455409900 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90281a6b20 con 0x7f9028101de0 2024-09-19T09:03:43.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.437+0000 7f901ffff640 1 -- 172.21.15.19:0/1455409900 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9018003ce0 con 0x7f9028101de0 2024-09-19T09:03:43.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.437+0000 7f901ffff640 1 -- 172.21.15.19:0/1455409900 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9018035070 con 0x7f9028101de0 2024-09-19T09:03:43.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.438+0000 7f902cca8640 1 -- 172.21.15.19:0/1455409900 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90281a7000 con 0x7f9028101de0 2024-09-19T09:03:43.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.440+0000 7f901ffff640 1 -- 172.21.15.19:0/1455409900 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f9018042030 con 0x7f9028101de0 2024-09-19T09:03:43.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.440+0000 7f902f081740 1 Processor -- start 2024-09-19T09:03:43.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.440+0000 7f902f081740 1 -- start start 2024-09-19T09:03:43.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.440+0000 7f902f081740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddd73f34a0 0x55ddd73f3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:43.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.440+0000 7f902f081740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ddd73f3dc0 0x55ddd73fe140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:43.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.440+0000 7f902f081740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddd73fe680 0x55ddd7400a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:43.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.440+0000 7f902f081740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ddd73592e0 con 0x55ddd73fe680 2024-09-19T09:03:43.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.440+0000 7f902f081740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55ddd7300ce0 con 0x55ddd73f3dc0 2024-09-19T09:03:43.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.440+0000 7f902f081740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ddd73552a0 con 0x55ddd73f34a0 2024-09-19T09:03:43.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.441+0000 7f901ffff640 1 --2- 172.21.15.19:0/1455409900 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f90140a3240 0x7f90140a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:43.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.441+0000 7f901dd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddd73fe680 0x55ddd7400a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:43.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.441+0000 7f901dd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddd73fe680 0x55ddd7400a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44230/0 (socket says 172.21.15.19:44230) 2024-09-19T09:03:43.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.441+0000 7f901dd9b640 1 -- 172.21.15.19:0/3673355231 learned_addr learned my addr 172.21.15.19:0/3673355231 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:43.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.441+0000 7f9026d9d640 1 --2- 172.21.15.19:0/3673355231 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddd73f34a0 0x55ddd73f3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:43.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.441+0000 7f9026d9d640 1 --2- 172.21.15.19:0/1455409900 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f90140a3240 0x7f90140a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:43.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.441+0000 7f901ffff640 1 -- 172.21.15.19:0/1455409900 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f90180f01c0 con 0x7f9028101de0 2024-09-19T09:03:43.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.441+0000 7f902659c640 1 --2- 172.21.15.19:0/3673355231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ddd73f3dc0 0x55ddd73fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:43.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.441+0000 7f9026d9d640 1 -- 172.21.15.19:0/3673355231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ddd73f3dc0 msgr2=0x55ddd73fe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:43.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.441+0000 7f9026d9d640 1 --2- 172.21.15.19:0/3673355231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ddd73f3dc0 0x55ddd73fe140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.441+0000 7f9026d9d640 1 -- 172.21.15.19:0/3673355231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddd73fe680 msgr2=0x55ddd7400a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:43.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.441+0000 7f9026d9d640 1 --2- 172.21.15.19:0/3673355231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddd73fe680 0x55ddd7400a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.441+0000 7f9026d9d640 1 -- 172.21.15.19:0/3673355231 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddd72e5440 con 0x55ddd73f34a0 2024-09-19T09:03:43.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.441+0000 7f901dd9b640 1 --2- 172.21.15.19:0/3673355231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddd73fe680 0x55ddd7400a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:43.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.441+0000 7f9026d9d640 1 --2- 172.21.15.19:0/3673355231 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddd73f34a0 0x55ddd73f3880 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f902000b930 tx=0x7f902000bdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34b6c10bc19daad7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:43.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.441+0000 7f9026d9d640 1 --2- 172.21.15.19:0/1455409900 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f90140a3240 0x7f90140a5700 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f902000e000 tx=0x7f902001b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:43.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.442+0000 7f901cd99640 1 -- 172.21.15.19:0/3673355231 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90200199e0 con 0x55ddd73f34a0 2024-09-19T09:03:43.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.442+0000 7f901cd99640 1 -- 172.21.15.19:0/3673355231 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f902001d070 con 0x55ddd73f34a0 2024-09-19T09:03:43.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.442+0000 7f901cd99640 1 -- 172.21.15.19:0/3673355231 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9020022d80 con 0x55ddd73f34a0 2024-09-19T09:03:43.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.442+0000 7f902f081740 1 -- 172.21.15.19:0/3673355231 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddd73f34a0 msgr2=0x55ddd73f3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:43.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.442+0000 7f902f081740 1 --2- 172.21.15.19:0/3673355231 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddd73f34a0 0x55ddd73f3880 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f902000b930 tx=0x7f902000bdf0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.442+0000 7f902f081740 1 -- 172.21.15.19:0/3673355231 shutdown_connections 2024-09-19T09:03:43.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.442+0000 7f902f081740 1 --2- 172.21.15.19:0/3673355231 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddd73fe680 0x55ddd7400a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.442+0000 7f902f081740 1 --2- 172.21.15.19:0/3673355231 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ddd73f3dc0 0x55ddd73fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.442+0000 7f902f081740 1 --2- 172.21.15.19:0/3673355231 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddd73f34a0 0x55ddd73f3880 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.442+0000 7f902f081740 1 -- 172.21.15.19:0/3673355231 >> 172.21.15.19:0/3673355231 conn(0x55ddd73efa30 msgr2=0x55ddd73efe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:43.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.443+0000 7f902f081740 1 -- 172.21.15.19:0/3673355231 shutdown_connections 2024-09-19T09:03:43.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.443+0000 7f902f081740 1 -- 172.21.15.19:0/3673355231 wait complete. 2024-09-19T09:03:43.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.443+0000 7f902f081740 1 -- start start 2024-09-19T09:03:43.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.443+0000 7f902f081740 1 Processor -- start 2024-09-19T09:03:43.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.443+0000 7f902f081740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddd73f34a0 0x55ddd73fdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:43.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.443+0000 7f902f081740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddd73f3dc0 0x55ddd73fb280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:43.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.443+0000 7f902f081740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ddd73fe680 0x55ddd73fb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:43.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.443+0000 7f902f081740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55ddd7401250 con 0x55ddd73f34a0 2024-09-19T09:03:43.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.443+0000 7f902f081740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55ddd7314050 con 0x55ddd73fe680 2024-09-19T09:03:43.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.443+0000 7f902f081740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ddd74013d0 con 0x55ddd73f3dc0 2024-09-19T09:03:43.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.443+0000 7f902f081740 10 client.0 _ll_register_callbacks cb 0x55ddd7354160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:43.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.443+0000 7f902659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddd73f34a0 0x55ddd73fdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:43.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.443+0000 7f902659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddd73f34a0 0x55ddd73fdfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44238/0 (socket says 172.21.15.19:44238) 2024-09-19T09:03:43.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.443+0000 7f902659c640 1 -- 172.21.15.19:0/2840978661 learned_addr learned my addr 172.21.15.19:0/2840978661 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:43.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.444+0000 7f9026d9d640 1 --2- 172.21.15.19:0/2840978661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ddd73fe680 0x55ddd73fb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:43.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.444+0000 7f901dd9b640 1 --2- 172.21.15.19:0/2840978661 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddd73f3dc0 0x55ddd73fb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:43.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.444+0000 7f902659c640 1 -- 172.21.15.19:0/2840978661 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddd73f3dc0 msgr2=0x55ddd73fb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:43.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.444+0000 7f902659c640 1 --2- 172.21.15.19:0/2840978661 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddd73f3dc0 0x55ddd73fb280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.444+0000 7f902659c640 1 -- 172.21.15.19:0/2840978661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ddd73fe680 msgr2=0x55ddd73fb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:43.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.444+0000 7f902659c640 1 --2- 172.21.15.19:0/2840978661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ddd73fe680 0x55ddd73fb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.444+0000 7f902659c640 1 -- 172.21.15.19:0/2840978661 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddd70ca3c0 con 0x55ddd73f34a0 2024-09-19T09:03:43.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.444+0000 7f9026d9d640 1 --2- 172.21.15.19:0/2840978661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ddd73fe680 0x55ddd73fb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:43.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.444+0000 7f902659c640 1 --2- 172.21.15.19:0/2840978661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddd73f34a0 0x55ddd73fdfd0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f9018005940 tx=0x7f90180b8b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a595bd217d20180 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:43.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.444+0000 7f900dffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:43.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.444+0000 7f900dffb640 1 -- 172.21.15.19:0/2840978661 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9018049040 con 0x55ddd73f34a0 2024-09-19T09:03:43.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.444+0000 7f902f081740 1 -- 172.21.15.19:0/2840978661 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f902001d070 con 0x55ddd73f34a0 2024-09-19T09:03:43.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.444+0000 7f900dffb640 1 -- 172.21.15.19:0/2840978661 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f901803b460 con 0x55ddd73f34a0 2024-09-19T09:03:43.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.444+0000 7f900dffb640 1 -- 172.21.15.19:0/2840978661 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f90180bcef0 con 0x55ddd73f34a0 2024-09-19T09:03:43.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.444+0000 7f902f081740 10 client.18321 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:43.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.444+0000 7f902f081740 1 -- 172.21.15.19:0/2840978661 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55ddd740cc20 con 0x55ddd73f34a0 2024-09-19T09:03:43.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.444+0000 7f900dffb640 1 -- 172.21.15.19:0/2840978661 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f902001d070 con 0x55ddd73f34a0 2024-09-19T09:03:43.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.445+0000 7f900dffb640 1 -- 172.21.15.19:0/2840978661 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f90180b8e60 con 0x55ddd73f34a0 2024-09-19T09:03:43.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.445+0000 7f902f081740 10 client.18321 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:43.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.445+0000 7f902f081740 10 client.18321 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:43.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.445+0000 7f902f081740 20 client.18321 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:43.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.445+0000 7f902f081740 1 --2- 172.21.15.19:0/2840978661 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ddd740e030 0x55ddd7410460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:43.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.445+0000 7f902f081740 4 client.18321 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:43.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.445+0000 7f902f081740 1 -- 172.21.15.19:0/2840978661 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ddd7366850 con 0x55ddd740e030 2024-09-19T09:03:43.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.445+0000 7f901dd9b640 1 --2- 172.21.15.19:0/2840978661 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ddd740e030 0x55ddd7410460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:43.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.445+0000 7f900dffb640 10 client.18321 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:43.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.445+0000 7f901dd9b640 1 --2- 172.21.15.19:0/2840978661 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ddd740e030 0x55ddd7410460 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a2b958b1e216263 server_cookie=dffb4c76d6c875a3 in_seq=0 out_seq=0 2024-09-19T09:03:43.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.446+0000 7f900dffb640 1 -- 172.21.15.19:0/2840978661 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ddd7366850 con 0x55ddd740e030 2024-09-19T09:03:43.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.446+0000 7f900dffb640 10 client.18321 handle_command_reply: tid=0 2024-09-19T09:03:43.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.446+0000 7f902f081740 1 client.18321 shutdown 2024-09-19T09:03:43.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.446+0000 7f902f081740 1 -- 172.21.15.19:0/2840978661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddd73f34a0 msgr2=0x55ddd73fdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:43.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.446+0000 7f902f081740 1 --2- 172.21.15.19:0/2840978661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddd73f34a0 0x55ddd73fdfd0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f9018005940 tx=0x7f90180b8b50 comp rx=0 tx=0).stop 2024-09-19T09:03:43.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.446+0000 7f902f081740 1 -- 172.21.15.19:0/2840978661 shutdown_connections 2024-09-19T09:03:43.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.446+0000 7f902f081740 1 --2- 172.21.15.19:0/2840978661 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ddd740e030 0x55ddd7410460 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.446+0000 7f902f081740 1 --2- 172.21.15.19:0/2840978661 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddd73f3dc0 0x55ddd73fb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.446+0000 7f902f081740 1 --2- 172.21.15.19:0/2840978661 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ddd73fe680 0x55ddd73fb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.446+0000 7f900dffb640 0 client.18321 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:43.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.446+0000 7f902f081740 1 --2- 172.21.15.19:0/2840978661 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddd73f34a0 0x55ddd73fdfd0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.446+0000 7f902f081740 1 -- 172.21.15.19:0/2840978661 >> 172.21.15.19:0/2840978661 conn(0x55ddd73efa30 msgr2=0x55ddd73f5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:43.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.446+0000 7f902f081740 1 -- 172.21.15.19:0/2840978661 shutdown_connections 2024-09-19T09:03:43.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.446+0000 7f902f081740 1 -- 172.21.15.19:0/2840978661 wait complete. 2024-09-19T09:03:43.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.446+0000 7f902f081740 20 client.18321 trim_cache size 0 max 16384 2024-09-19T09:03:43.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.464+0000 7f902f081740 1 Processor -- start 2024-09-19T09:03:43.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.464+0000 7f902f081740 1 -- start start 2024-09-19T09:03:43.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.464+0000 7f902f081740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddd73f34a0 0x55ddd740a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:43.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.464+0000 7f902f081740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ddd73f3dc0 0x55ddd73eee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:43.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.464+0000 7f902f081740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddd73fe680 0x55ddd7406620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:43.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.464+0000 7f902f081740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f90281af580 con 0x55ddd73fe680 2024-09-19T09:03:43.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.464+0000 7f902f081740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f90281b10c0 con 0x55ddd73f3dc0 2024-09-19T09:03:43.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.464+0000 7f902f081740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f90281afc50 con 0x55ddd73f34a0 2024-09-19T09:03:43.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.465+0000 7f9026d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddd73fe680 0x55ddd7406620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:43.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.465+0000 7f9026d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddd73fe680 0x55ddd7406620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44254/0 (socket says 172.21.15.19:44254) 2024-09-19T09:03:43.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.465+0000 7f9026d9d640 1 -- 172.21.15.19:0/343681670 learned_addr learned my addr 172.21.15.19:0/343681670 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:43.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.465+0000 7f901dd9b640 1 --2- 172.21.15.19:0/343681670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ddd73f3dc0 0x55ddd73eee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:43.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.465+0000 7f902659c640 1 --2- 172.21.15.19:0/343681670 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddd73f34a0 0x55ddd740a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:43.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.465+0000 7f9026d9d640 1 -- 172.21.15.19:0/343681670 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddd73f34a0 msgr2=0x55ddd740a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:43.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.465+0000 7f9026d9d640 1 --2- 172.21.15.19:0/343681670 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddd73f34a0 0x55ddd740a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.465+0000 7f9026d9d640 1 -- 172.21.15.19:0/343681670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ddd73f3dc0 msgr2=0x55ddd73eee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:43.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.465+0000 7f9026d9d640 1 --2- 172.21.15.19:0/343681670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ddd73f3dc0 0x55ddd73eee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.465+0000 7f9026d9d640 1 -- 172.21.15.19:0/343681670 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddd73fbb50 con 0x55ddd73fe680 2024-09-19T09:03:43.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.465+0000 7f901dd9b640 1 --2- 172.21.15.19:0/343681670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ddd73f3dc0 0x55ddd73eee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:43.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.465+0000 7f9026d9d640 1 --2- 172.21.15.19:0/343681670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddd73fe680 0x55ddd7406620 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f9020004b90 tx=0x7f90200049c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e95b84b74985689 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:43.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.465+0000 7f900ffff640 1 -- 172.21.15.19:0/343681670 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9020031070 con 0x55ddd73fe680 2024-09-19T09:03:43.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.465+0000 7f900ffff640 1 -- 172.21.15.19:0/343681670 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f902001d040 con 0x55ddd73fe680 2024-09-19T09:03:43.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.465+0000 7f900ffff640 1 -- 172.21.15.19:0/343681670 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9020022aa0 con 0x55ddd73fe680 2024-09-19T09:03:43.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.466+0000 7f902f081740 1 -- 172.21.15.19:0/343681670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddd73fe680 msgr2=0x55ddd7406620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:43.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.466+0000 7f902f081740 1 --2- 172.21.15.19:0/343681670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddd73fe680 0x55ddd7406620 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f9020004b90 tx=0x7f90200049c0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.466+0000 7f902f081740 1 -- 172.21.15.19:0/343681670 shutdown_connections 2024-09-19T09:03:43.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.466+0000 7f902f081740 1 --2- 172.21.15.19:0/343681670 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddd73fe680 0x55ddd7406620 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.466+0000 7f902f081740 1 --2- 172.21.15.19:0/343681670 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ddd73f3dc0 0x55ddd73eee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.466+0000 7f902f081740 1 --2- 172.21.15.19:0/343681670 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddd73f34a0 0x55ddd740a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.466+0000 7f902f081740 1 -- 172.21.15.19:0/343681670 >> 172.21.15.19:0/343681670 conn(0x55ddd73efa30 msgr2=0x55ddd73fd300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:43.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.466+0000 7f902f081740 1 -- 172.21.15.19:0/343681670 shutdown_connections 2024-09-19T09:03:43.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.466+0000 7f902f081740 1 -- 172.21.15.19:0/343681670 wait complete. 2024-09-19T09:03:43.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.467+0000 7f902f081740 1 -- start start 2024-09-19T09:03:43.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.467+0000 7f902f081740 1 Processor -- start 2024-09-19T09:03:43.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.467+0000 7f902f081740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ddd73f34a0 0x55ddd7406b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:43.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.467+0000 7f902f081740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddd73f3dc0 0x55ddd7404f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:43.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.467+0000 7f902f081740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddd73fe680 0x55ddd74054a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:43.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.467+0000 7f902f081740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f90281b09f0 con 0x55ddd73f3dc0 2024-09-19T09:03:43.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.467+0000 7f902f081740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f90281b0320 con 0x55ddd73f34a0 2024-09-19T09:03:43.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.467+0000 7f902f081740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f90281ad560 con 0x55ddd73fe680 2024-09-19T09:03:43.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.467+0000 7f902f081740 10 client.0 _ll_register_callbacks cb 0x7f90180a7050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:43.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.467+0000 7f901dd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddd73f3dc0 0x55ddd7404f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:43.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.467+0000 7f901dd9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddd73f3dc0 0x55ddd7404f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44268/0 (socket says 172.21.15.19:44268) 2024-09-19T09:03:43.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.467+0000 7f901dd9b640 1 -- 172.21.15.19:0/3658538679 learned_addr learned my addr 172.21.15.19:0/3658538679 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:43.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.467+0000 7f9026d9d640 1 --2- 172.21.15.19:0/3658538679 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddd73fe680 0x55ddd74054a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:43.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.467+0000 7f902659c640 1 --2- 172.21.15.19:0/3658538679 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ddd73f34a0 0x55ddd7406b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:43.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.467+0000 7f901dd9b640 1 -- 172.21.15.19:0/3658538679 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddd73fe680 msgr2=0x55ddd74054a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:43.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.467+0000 7f901dd9b640 1 --2- 172.21.15.19:0/3658538679 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddd73fe680 0x55ddd74054a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.467+0000 7f901dd9b640 1 -- 172.21.15.19:0/3658538679 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ddd73f34a0 msgr2=0x55ddd7406b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:43.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.467+0000 7f901dd9b640 1 --2- 172.21.15.19:0/3658538679 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ddd73f34a0 0x55ddd7406b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.467+0000 7f901dd9b640 1 -- 172.21.15.19:0/3658538679 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddd7405ab0 con 0x55ddd73f3dc0 2024-09-19T09:03:43.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.467+0000 7f9026d9d640 1 --2- 172.21.15.19:0/3658538679 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddd73fe680 0x55ddd74054a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:43.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.468+0000 7f901dd9b640 1 --2- 172.21.15.19:0/3658538679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddd73f3dc0 0x55ddd7404f60 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f901000ad90 tx=0x7f9010012880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=337bd681c0913fb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:43.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.468+0000 7f900dffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:43.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.468+0000 7f900dffb640 1 -- 172.21.15.19:0/3658538679 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9010005220 con 0x55ddd73f3dc0 2024-09-19T09:03:43.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.468+0000 7f900dffb640 1 -- 172.21.15.19:0/3658538679 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f90100053c0 con 0x55ddd73f3dc0 2024-09-19T09:03:43.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.468+0000 7f902f081740 1 -- 172.21.15.19:0/3658538679 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f902001d040 con 0x55ddd73f3dc0 2024-09-19T09:03:43.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.468+0000 7f900dffb640 1 -- 172.21.15.19:0/3658538679 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f90100055c0 con 0x55ddd73f3dc0 2024-09-19T09:03:43.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.468+0000 7f902f081740 10 client.18327 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:43.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.468+0000 7f902f081740 1 -- 172.21.15.19:0/3658538679 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55ddd7479c50 con 0x55ddd73f3dc0 2024-09-19T09:03:43.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.468+0000 7f900dffb640 1 -- 172.21.15.19:0/3658538679 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f902001d040 con 0x55ddd73f3dc0 2024-09-19T09:03:43.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.468+0000 7f900dffb640 1 -- 172.21.15.19:0/3658538679 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f90100106d0 con 0x55ddd73f3dc0 2024-09-19T09:03:43.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.468+0000 7f902f081740 10 client.18327 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:43.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.468+0000 7f902f081740 10 client.18327 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:43.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.468+0000 7f902f081740 20 client.18327 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:43.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.468+0000 7f902f081740 1 --2- 172.21.15.19:0/3658538679 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ddd747a400 0x55ddd747c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:43.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.468+0000 7f902f081740 4 client.18327 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:03:43.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.468+0000 7f902f081740 1 -- 172.21.15.19:0/3658538679 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ddd7360d60 con 0x55ddd747a400 2024-09-19T09:03:43.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.469+0000 7f902659c640 1 --2- 172.21.15.19:0/3658538679 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ddd747a400 0x55ddd747c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:43.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.469+0000 7f902659c640 1 --2- 172.21.15.19:0/3658538679 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ddd747a400 0x55ddd747c820 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfb82fabeba641b0 server_cookie=494906348d49fa72 in_seq=0 out_seq=0 2024-09-19T09:03:43.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.469+0000 7f900dffb640 10 client.18327 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:43.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.469+0000 7f900dffb640 1 -- 172.21.15.19:0/3658538679 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ddd7360d60 con 0x55ddd747a400 2024-09-19T09:03:43.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.469+0000 7f900dffb640 10 client.18327 handle_command_reply: tid=0 2024-09-19T09:03:43.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.469+0000 7f902f081740 1 client.18327 shutdown 2024-09-19T09:03:43.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.469+0000 7f902f081740 1 -- 172.21.15.19:0/3658538679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddd73f3dc0 msgr2=0x55ddd7404f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:43.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.469+0000 7f902f081740 1 --2- 172.21.15.19:0/3658538679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddd73f3dc0 0x55ddd7404f60 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f901000ad90 tx=0x7f9010012880 comp rx=0 tx=0).stop 2024-09-19T09:03:43.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.469+0000 7f902f081740 1 -- 172.21.15.19:0/3658538679 shutdown_connections 2024-09-19T09:03:43.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.469+0000 7f902f081740 1 --2- 172.21.15.19:0/3658538679 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55ddd747a400 0x55ddd747c820 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.469+0000 7f902f081740 1 --2- 172.21.15.19:0/3658538679 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddd73fe680 0x55ddd74054a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.469+0000 7f902f081740 1 --2- 172.21.15.19:0/3658538679 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55ddd73f3dc0 0x55ddd7404f60 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.469+0000 7f900dffb640 0 client.18327 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:43.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.469+0000 7f902f081740 1 --2- 172.21.15.19:0/3658538679 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55ddd73f34a0 0x55ddd7406b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.469+0000 7f902f081740 1 -- 172.21.15.19:0/3658538679 >> 172.21.15.19:0/3658538679 conn(0x55ddd73efa30 msgr2=0x55ddd74094a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:43.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.469+0000 7f902f081740 1 -- 172.21.15.19:0/3658538679 shutdown_connections 2024-09-19T09:03:43.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.470+0000 7f902f081740 1 -- 172.21.15.19:0/3658538679 wait complete. 2024-09-19T09:03:43.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.470+0000 7f902f081740 20 client.18327 trim_cache size 0 max 16384 2024-09-19T09:03:43.482 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T09:03:43.482 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-19T09:03:43.482 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {} 2024-09-19T09:03:43.482 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T09:03:43.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.470+0000 7f902cca8640 1 -- 172.21.15.19:0/1455409900 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f90140a3240 msgr2=0x7f90140a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:43.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.470+0000 7f902cca8640 1 --2- 172.21.15.19:0/1455409900 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f90140a3240 0x7f90140a5700 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f902000e000 tx=0x7f902001b000 comp rx=0 tx=0).stop 2024-09-19T09:03:43.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.470+0000 7f902cca8640 1 -- 172.21.15.19:0/1455409900 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9028101de0 msgr2=0x7f90280744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:43.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.470+0000 7f902cca8640 1 --2- 172.21.15.19:0/1455409900 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9028101de0 0x7f90280744f0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f9018005ab0 tx=0x7f90180042f0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.470+0000 7f902cca8640 1 -- 172.21.15.19:0/1455409900 shutdown_connections 2024-09-19T09:03:43.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.470+0000 7f902cca8640 1 --2- 172.21.15.19:0/1455409900 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f90140a3240 0x7f90140a5700 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.470+0000 7f902cca8640 1 --2- 172.21.15.19:0/1455409900 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9028106f10 0x7f9028074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.470+0000 7f902cca8640 1 --2- 172.21.15.19:0/1455409900 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9028102790 0x7f9028074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.470+0000 7f902cca8640 1 --2- 172.21.15.19:0/1455409900 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9028101de0 0x7f90280744f0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:43.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.470+0000 7f902cca8640 1 -- 172.21.15.19:0/1455409900 >> 172.21.15.19:0/1455409900 conn(0x7f90280fd8c0 msgr2=0x7f90280fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:43.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.470+0000 7f902cca8640 1 -- 172.21.15.19:0/1455409900 shutdown_connections 2024-09-19T09:03:43.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:43.470+0000 7f902cca8640 1 -- 172.21.15.19:0/1455409900 wait complete. 2024-09-19T09:03:44.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:43 smithi155 ceph-mon[34921]: pgmap v684: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.2 KiB/s wr, 16 op/s 2024-09-19T09:03:44.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:43 smithi203 ceph-mon[35450]: pgmap v684: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.2 KiB/s wr, 16 op/s 2024-09-19T09:03:44.285 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:43 smithi019 ceph-mon[30976]: pgmap v684: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.2 KiB/s wr, 16 op/s 2024-09-19T09:03:44.317 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:03:44.318 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:03:44.590 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:45.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.045+0000 7f6366f22640 1 -- 172.21.15.19:0/1172828023 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6360102790 msgr2=0x7f63601067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:45.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.045+0000 7f6366f22640 1 --2- 172.21.15.19:0/1172828023 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6360102790 0x7f63601067e0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f6350009ca0 tx=0x7f635002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.045+0000 7f6366f22640 1 -- 172.21.15.19:0/1172828023 shutdown_connections 2024-09-19T09:03:45.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.045+0000 7f6366f22640 1 --2- 172.21.15.19:0/1172828023 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6360106f10 0x7f636010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.045+0000 7f6366f22640 1 --2- 172.21.15.19:0/1172828023 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6360102790 0x7f63601067e0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.045+0000 7f6366f22640 1 --2- 172.21.15.19:0/1172828023 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6360101de0 0x7f63601021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.045+0000 7f6366f22640 1 -- 172.21.15.19:0/1172828023 >> 172.21.15.19:0/1172828023 conn(0x7f63600fd8c0 msgr2=0x7f63600ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:45.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.045+0000 7f6366f22640 1 -- 172.21.15.19:0/1172828023 shutdown_connections 2024-09-19T09:03:45.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.045+0000 7f6366f22640 1 -- 172.21.15.19:0/1172828023 wait complete. 2024-09-19T09:03:45.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.046+0000 7f6366f22640 1 Processor -- start 2024-09-19T09:03:45.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.046+0000 7f6366f22640 1 -- start start 2024-09-19T09:03:45.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.046+0000 7f6366f22640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6360101de0 0x7f6360198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:45.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.046+0000 7f6366f22640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6360102790 0x7f6360198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:45.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.046+0000 7f6366f22640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6360106f10 0x7f636019ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:45.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.046+0000 7f6366f22640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6360111fc0 con 0x7f6360101de0 2024-09-19T09:03:45.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.046+0000 7f6366f22640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6360111e40 con 0x7f6360102790 2024-09-19T09:03:45.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.046+0000 7f6366f22640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6360112140 con 0x7f6360106f10 2024-09-19T09:03:45.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.046+0000 7f6364cbe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6360101de0 0x7f6360198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:45.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.046+0000 7f6364cbe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6360101de0 0x7f6360198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44290/0 (socket says 172.21.15.19:44290) 2024-09-19T09:03:45.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.046+0000 7f6364cbe640 1 -- 172.21.15.19:0/4099635588 learned_addr learned my addr 172.21.15.19:0/4099635588 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:45.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.046+0000 7f635ffff640 1 --2- 172.21.15.19:0/4099635588 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6360102790 0x7f6360198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:45.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.046+0000 7f63654bf640 1 --2- 172.21.15.19:0/4099635588 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6360106f10 0x7f636019ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:45.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.046+0000 7f6364cbe640 1 -- 172.21.15.19:0/4099635588 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6360106f10 msgr2=0x7f636019ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:45.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.046+0000 7f6364cbe640 1 --2- 172.21.15.19:0/4099635588 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6360106f10 0x7f636019ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.046+0000 7f6364cbe640 1 -- 172.21.15.19:0/4099635588 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6360102790 msgr2=0x7f6360198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:45.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.046+0000 7f6364cbe640 1 --2- 172.21.15.19:0/4099635588 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6360102790 0x7f6360198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.047+0000 7f6364cbe640 1 -- 172.21.15.19:0/4099635588 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f636019d3b0 con 0x7f6360101de0 2024-09-19T09:03:45.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.047+0000 7f63654bf640 1 --2- 172.21.15.19:0/4099635588 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6360106f10 0x7f636019ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:45.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.047+0000 7f6364cbe640 1 --2- 172.21.15.19:0/4099635588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6360101de0 0x7f6360198400 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f634800c970 tx=0x7f634800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:45.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.047+0000 7f635dffb640 1 -- 172.21.15.19:0/4099635588 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6348007bb0 con 0x7f6360101de0 2024-09-19T09:03:45.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.047+0000 7f6366f22640 1 -- 172.21.15.19:0/4099635588 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f636019d6a0 con 0x7f6360101de0 2024-09-19T09:03:45.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.047+0000 7f635dffb640 1 -- 172.21.15.19:0/4099635588 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6348007d50 con 0x7f6360101de0 2024-09-19T09:03:45.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.047+0000 7f635dffb640 1 -- 172.21.15.19:0/4099635588 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634800f450 con 0x7f6360101de0 2024-09-19T09:03:45.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.047+0000 7f6366f22640 1 -- 172.21.15.19:0/4099635588 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63601a4f80 con 0x7f6360101de0 2024-09-19T09:03:45.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.048+0000 7f6366f22640 1 -- 172.21.15.19:0/4099635588 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63601021c0 con 0x7f6360101de0 2024-09-19T09:03:45.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.049+0000 7f635dffb640 1 -- 172.21.15.19:0/4099635588 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f6348005020 con 0x7f6360101de0 2024-09-19T09:03:45.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.050+0000 7f635dffb640 1 --2- 172.21.15.19:0/4099635588 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f634c0a3240 0x7f634c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:45.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.050+0000 7f635ffff640 1 --2- 172.21.15.19:0/4099635588 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f634c0a3240 0x7f634c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:45.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.050+0000 7f635dffb640 1 -- 172.21.15.19:0/4099635588 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f63480cf6f0 con 0x7f6360101de0 2024-09-19T09:03:45.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.050+0000 7f635ffff640 1 --2- 172.21.15.19:0/4099635588 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f634c0a3240 0x7f634c0a5700 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6350006010 tx=0x7f63500093a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:45.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.054+0000 7f635dffb640 1 -- 172.21.15.19:0/4099635588 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6348014030 con 0x7f6360101de0 2024-09-19T09:03:45.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.270+0000 7f6366f22640 1 -- 172.21.15.19:0/4099635588 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f636010a150 con 0x7f6360101de0 2024-09-19T09:03:45.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.271+0000 7f635dffb640 1 -- 172.21.15.19:0/4099635588 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+11983 (secure 0 0 0) 0x7f634809c420 con 0x7f6360101de0 2024-09-19T09:03:45.271 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T09:03:45.271 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":39,"btime":"2024-09-19T09:02:47:631181+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":17751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/3815927080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":3815927080},{"type":"v1","addr":"172.21.15.19:6839","nonce":3815927080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":39,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T09:02:47.631165+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26453":{"gid":26453,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/3907362737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3907362737},{"type":"v1","addr":"172.21.15.155:6835","nonce":3907362737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24469,24490,24464,24463]},"id":1}]} 2024-09-19T09:03:45.271 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 39 2024-09-19T09:03:45.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.273+0000 7f6366f22640 1 -- 172.21.15.19:0/4099635588 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f634c0a3240 msgr2=0x7f634c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:45.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.273+0000 7f6366f22640 1 --2- 172.21.15.19:0/4099635588 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f634c0a3240 0x7f634c0a5700 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6350006010 tx=0x7f63500093a0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.273+0000 7f6366f22640 1 -- 172.21.15.19:0/4099635588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6360101de0 msgr2=0x7f6360198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:45.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.273+0000 7f6366f22640 1 --2- 172.21.15.19:0/4099635588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6360101de0 0x7f6360198400 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f634800c970 tx=0x7f634800ce30 comp rx=0 tx=0).stop 2024-09-19T09:03:45.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.273+0000 7f6366f22640 1 -- 172.21.15.19:0/4099635588 shutdown_connections 2024-09-19T09:03:45.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.273+0000 7f6366f22640 1 --2- 172.21.15.19:0/4099635588 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f634c0a3240 0x7f634c0a5700 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.273+0000 7f6366f22640 1 --2- 172.21.15.19:0/4099635588 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6360106f10 0x7f636019ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.273+0000 7f6366f22640 1 --2- 172.21.15.19:0/4099635588 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6360102790 0x7f6360198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.273+0000 7f6366f22640 1 --2- 172.21.15.19:0/4099635588 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6360101de0 0x7f6360198400 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:45.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.273+0000 7f6366f22640 1 -- 172.21.15.19:0/4099635588 >> 172.21.15.19:0/4099635588 conn(0x7f63600fd8c0 msgr2=0x7f63600febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:45.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.274+0000 7f6366f22640 1 -- 172.21.15.19:0/4099635588 shutdown_connections 2024-09-19T09:03:45.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:45.274+0000 7f6366f22640 1 -- 172.21.15.19:0/4099635588 wait complete. 2024-09-19T09:03:45.928 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:45 smithi019 ceph-mon[30976]: pgmap v685: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.2 KiB/s wr, 16 op/s 2024-09-19T09:03:45.928 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:45 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/4099635588' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:45.957 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T09:03:46.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:45 smithi155 ceph-mon[34921]: pgmap v685: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.2 KiB/s wr, 16 op/s 2024-09-19T09:03:46.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:45 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/4099635588' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:46.214 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:46.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:45 smithi203 ceph-mon[35450]: pgmap v685: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.2 KiB/s wr, 16 op/s 2024-09-19T09:03:46.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:45 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/4099635588' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:46.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.732+0000 7fd5b7862640 1 -- 172.21.15.19:0/2773898541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b010c590 msgr2=0x7fd5b010c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:46.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.732+0000 7fd5b7862640 1 --2- 172.21.15.19:0/2773898541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b010c590 0x7fd5b010c9f0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0009900 tx=0x7fd5a002a410 comp rx=0 tx=0).stop 2024-09-19T09:03:46.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.732+0000 7fd5b7862640 1 -- 172.21.15.19:0/2773898541 shutdown_connections 2024-09-19T09:03:46.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.732+0000 7fd5b7862640 1 --2- 172.21.15.19:0/2773898541 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd5b010cf30 0x7fd5b0119410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.732+0000 7fd5b7862640 1 --2- 172.21.15.19:0/2773898541 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b010c590 0x7fd5b010c9f0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.732+0000 7fd5b7862640 1 --2- 172.21.15.19:0/2773898541 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5b0112640 0x7fd5b0112a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.732+0000 7fd5b7862640 1 -- 172.21.15.19:0/2773898541 >> 172.21.15.19:0/2773898541 conn(0x7fd5b006cdc0 msgr2=0x7fd5b006d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:46.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.733+0000 7fd5b7862640 1 -- 172.21.15.19:0/2773898541 shutdown_connections 2024-09-19T09:03:46.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.733+0000 7fd5b7862640 1 -- 172.21.15.19:0/2773898541 wait complete. 2024-09-19T09:03:46.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.733+0000 7fd5b7862640 1 Processor -- start 2024-09-19T09:03:46.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.733+0000 7fd5b7862640 1 -- start start 2024-09-19T09:03:46.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.734+0000 7fd5b7862640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5b010c590 0x7fd5b01a2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:46.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.734+0000 7fd5b7862640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd5b010cf30 0x7fd5b01a3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:46.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.734+0000 7fd5b7862640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b0112640 0x7fd5b01a77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:46.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.734+0000 7fd5b7862640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b011c9a0 con 0x7fd5b0112640 2024-09-19T09:03:46.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.734+0000 7fd5b7862640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b011c820 con 0x7fd5b010c590 2024-09-19T09:03:46.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.734+0000 7fd5b7862640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b011cb20 con 0x7fd5b010cf30 2024-09-19T09:03:46.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.734+0000 7fd5b5dff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b0112640 0x7fd5b01a77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:46.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.734+0000 7fd5b5dff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b0112640 0x7fd5b01a77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35390/0 (socket says 172.21.15.19:35390) 2024-09-19T09:03:46.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.734+0000 7fd5b5dff640 1 -- 172.21.15.19:0/542420794 learned_addr learned my addr 172.21.15.19:0/542420794 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:46.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.734+0000 7fd5b55fe640 1 --2- 172.21.15.19:0/542420794 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5b010c590 0x7fd5b01a2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:46.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.734+0000 7fd5b4dfd640 1 --2- 172.21.15.19:0/542420794 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd5b010cf30 0x7fd5b01a3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:46.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.734+0000 7fd5b5dff640 1 -- 172.21.15.19:0/542420794 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd5b010cf30 msgr2=0x7fd5b01a3440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:46.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.734+0000 7fd5b5dff640 1 --2- 172.21.15.19:0/542420794 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd5b010cf30 0x7fd5b01a3440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.734+0000 7fd5b5dff640 1 -- 172.21.15.19:0/542420794 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5b010c590 msgr2=0x7fd5b01a2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:46.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.734+0000 7fd5b5dff640 1 --2- 172.21.15.19:0/542420794 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5b010c590 0x7fd5b01a2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.734+0000 7fd5b5dff640 1 -- 172.21.15.19:0/542420794 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5b01a7eb0 con 0x7fd5b0112640 2024-09-19T09:03:46.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.734+0000 7fd5b5dff640 1 --2- 172.21.15.19:0/542420794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b0112640 0x7fd5b01a77d0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fd5a800eaa0 tx=0x7fd5a800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:46.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.734+0000 7fd5a67fc640 1 -- 172.21.15.19:0/542420794 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a800cdb0 con 0x7fd5b0112640 2024-09-19T09:03:46.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.734+0000 7fd5a67fc640 1 -- 172.21.15.19:0/542420794 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5a8005020 con 0x7fd5b0112640 2024-09-19T09:03:46.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.734+0000 7fd5b7862640 1 -- 172.21.15.19:0/542420794 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5b01a81a0 con 0x7fd5b0112640 2024-09-19T09:03:46.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.734+0000 7fd5a67fc640 1 -- 172.21.15.19:0/542420794 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a80116b0 con 0x7fd5b0112640 2024-09-19T09:03:46.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.734+0000 7fd5b7862640 1 -- 172.21.15.19:0/542420794 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5b01afa80 con 0x7fd5b0112640 2024-09-19T09:03:46.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.737+0000 7fd5a67fc640 1 -- 172.21.15.19:0/542420794 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fd5a8005560 con 0x7fd5b0112640 2024-09-19T09:03:46.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.737+0000 7fd5b9c3b740 1 Processor -- start 2024-09-19T09:03:46.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.737+0000 7fd5b9c3b740 1 -- start start 2024-09-19T09:03:46.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.737+0000 7fd5b9c3b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563663379b40 0x563663378090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:46.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.737+0000 7fd5b9c3b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636633785d0 0x563663378a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:46.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.737+0000 7fd5b9c3b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563663383370 0x563663385760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:46.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.737+0000 7fd5b9c3b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5636632de2f0 con 0x5636633785d0 2024-09-19T09:03:46.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.737+0000 7fd5b9c3b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x563663285cf0 con 0x563663379b40 2024-09-19T09:03:46.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.737+0000 7fd5b9c3b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5636632da2b0 con 0x563663383370 2024-09-19T09:03:46.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.737+0000 7fd5b55fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636633785d0 0x563663378a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:46.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.738+0000 7fd5b55fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636633785d0 0x563663378a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35392/0 (socket says 172.21.15.19:35392) 2024-09-19T09:03:46.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.738+0000 7fd5b55fe640 1 -- 172.21.15.19:0/3122808536 learned_addr learned my addr 172.21.15.19:0/3122808536 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:46.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.738+0000 7fd5a67fc640 1 --2- 172.21.15.19:0/542420794 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd59c0a32c0 0x7fd59c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:46.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.738+0000 7fd5b4dfd640 1 --2- 172.21.15.19:0/3122808536 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563663383370 0x563663385760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:46.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.738+0000 7fd5b4dfd640 1 --2- 172.21.15.19:0/3122808536 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563663379b40 0x563663378090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:46.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.738+0000 7fd5b5dff640 1 --2- 172.21.15.19:0/542420794 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd59c0a32c0 0x7fd59c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:46.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.738+0000 7fd5b55fe640 1 -- 172.21.15.19:0/3122808536 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563663383370 msgr2=0x563663385760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:46.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.738+0000 7fd5b55fe640 1 --2- 172.21.15.19:0/3122808536 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563663383370 0x563663385760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.738+0000 7fd5b55fe640 1 -- 172.21.15.19:0/3122808536 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563663379b40 msgr2=0x563663378090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:46.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.738+0000 7fd5b55fe640 1 --2- 172.21.15.19:0/3122808536 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563663379b40 0x563663378090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.738+0000 7fd5b55fe640 1 -- 172.21.15.19:0/3122808536 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56366326a3a0 con 0x5636633785d0 2024-09-19T09:03:46.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.738+0000 7fd5a67fc640 1 -- 172.21.15.19:0/542420794 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7fd5a80cfa20 con 0x7fd5b0112640 2024-09-19T09:03:46.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.738+0000 7fd5b4dfd640 1 --2- 172.21.15.19:0/3122808536 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563663379b40 0x563663378090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:46.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.738+0000 7fd5b55fe640 1 --2- 172.21.15.19:0/3122808536 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636633785d0 0x563663378a10 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac00bc90 tx=0x7fd5ac0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e96f5cf976eec58 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:46.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.738+0000 7fd5b5dff640 1 --2- 172.21.15.19:0/542420794 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd59c0a32c0 0x7fd59c0a5780 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8018000 tx=0x7fd5a80214c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:46.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.738+0000 7fd59b7fe640 1 -- 172.21.15.19:0/3122808536 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac01c480 con 0x5636633785d0 2024-09-19T09:03:46.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.738+0000 7fd59b7fe640 1 -- 172.21.15.19:0/3122808536 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5ac01cb00 con 0x5636633785d0 2024-09-19T09:03:46.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.738+0000 7fd59b7fe640 1 -- 172.21.15.19:0/3122808536 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac011bb0 con 0x5636633785d0 2024-09-19T09:03:46.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.739+0000 7fd5b9c3b740 1 -- 172.21.15.19:0/3122808536 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636633785d0 msgr2=0x563663378a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:46.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.739+0000 7fd5b9c3b740 1 --2- 172.21.15.19:0/3122808536 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636633785d0 0x563663378a10 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac00bc90 tx=0x7fd5ac0107a0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.739+0000 7fd5b9c3b740 1 -- 172.21.15.19:0/3122808536 shutdown_connections 2024-09-19T09:03:46.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.739+0000 7fd5b9c3b740 1 --2- 172.21.15.19:0/3122808536 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563663383370 0x563663385760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.739+0000 7fd5b9c3b740 1 --2- 172.21.15.19:0/3122808536 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636633785d0 0x563663378a10 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.739+0000 7fd5b9c3b740 1 --2- 172.21.15.19:0/3122808536 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563663379b40 0x563663378090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.739+0000 7fd5b9c3b740 1 -- 172.21.15.19:0/3122808536 >> 172.21.15.19:0/3122808536 conn(0x563663341310 msgr2=0x563663374c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:46.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.739+0000 7fd5b9c3b740 1 -- 172.21.15.19:0/3122808536 shutdown_connections 2024-09-19T09:03:46.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.739+0000 7fd5b9c3b740 1 -- 172.21.15.19:0/3122808536 wait complete. 2024-09-19T09:03:46.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.739+0000 7fd5b9c3b740 1 -- start start 2024-09-19T09:03:46.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.740+0000 7fd5b9c3b740 1 Processor -- start 2024-09-19T09:03:46.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.740+0000 7fd5b9c3b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636633785d0 0x563663382d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:46.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.740+0000 7fd5b9c3b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563663379b40 0x56366337ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:46.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.740+0000 7fd5b9c3b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563663383370 0x5636633805d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:46.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.740+0000 7fd5b9c3b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x563663386070 con 0x5636633785d0 2024-09-19T09:03:46.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.740+0000 7fd5b9c3b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x563663299060 con 0x563663383370 2024-09-19T09:03:46.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.740+0000 7fd5b9c3b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5636633861f0 con 0x563663379b40 2024-09-19T09:03:46.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.740+0000 7fd5b9c3b740 10 client.0 _ll_register_callbacks cb 0x563662fec8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:46.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.740+0000 7fd5b4dfd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636633785d0 0x563663382d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:46.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.740+0000 7fd5b4dfd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636633785d0 0x563663382d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35404/0 (socket says 172.21.15.19:35404) 2024-09-19T09:03:46.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.740+0000 7fd5b4dfd640 1 -- 172.21.15.19:0/1949904134 learned_addr learned my addr 172.21.15.19:0/1949904134 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:46.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.740+0000 7fd5b55fe640 1 --2- 172.21.15.19:0/1949904134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563663379b40 0x56366337ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:46.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.740+0000 7fd5b4dfd640 1 --2- 172.21.15.19:0/1949904134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563663383370 0x5636633805d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:46.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.741+0000 7fd5b4dfd640 1 -- 172.21.15.19:0/1949904134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563663379b40 msgr2=0x56366337ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:46.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.741+0000 7fd5b4dfd640 1 --2- 172.21.15.19:0/1949904134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563663379b40 0x56366337ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.741+0000 7fd5b4dfd640 1 -- 172.21.15.19:0/1949904134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563663383370 msgr2=0x5636633805d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:46.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.741+0000 7fd5b4dfd640 1 --2- 172.21.15.19:0/1949904134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563663383370 0x5636633805d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.741+0000 7fd5b4dfd640 1 -- 172.21.15.19:0/1949904134 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56366304f3c0 con 0x5636633785d0 2024-09-19T09:03:46.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.741+0000 7fd5b4dfd640 1 --2- 172.21.15.19:0/1949904134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636633785d0 0x563663382d30 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fd5a00096c0 tx=0x7fd5a002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=986e6bb29109e0ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:46.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.741+0000 7fd598ff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:46.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.741+0000 7fd598ff9640 1 -- 172.21.15.19:0/1949904134 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a0035040 con 0x5636633785d0 2024-09-19T09:03:46.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.741+0000 7fd598ff9640 1 -- 172.21.15.19:0/1949904134 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7fd5a0003df0 con 0x5636633785d0 2024-09-19T09:03:46.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.741+0000 7fd5b9c3b740 1 -- 172.21.15.19:0/1949904134 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5ac01cb00 con 0x5636633785d0 2024-09-19T09:03:46.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.741+0000 7fd598ff9640 1 -- 172.21.15.19:0/1949904134 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fd5a0031540 con 0x5636633785d0 2024-09-19T09:03:46.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.741+0000 7fd5b9c3b740 10 client.18345 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:46.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.741+0000 7fd5b9c3b740 1 -- 172.21.15.19:0/1949904134 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x563663391a40 con 0x5636633785d0 2024-09-19T09:03:46.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.741+0000 7fd598ff9640 1 -- 172.21.15.19:0/1949904134 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5ac01cb00 con 0x5636633785d0 2024-09-19T09:03:46.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.741+0000 7fd598ff9640 1 -- 172.21.15.19:0/1949904134 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7fd5a004b760 con 0x5636633785d0 2024-09-19T09:03:46.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.742+0000 7fd5b9c3b740 10 client.18345 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:46.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.742+0000 7fd5b9c3b740 10 client.18345 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T09:03:46.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.742+0000 7fd5b9c3b740 20 client.18345 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:46.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.742+0000 7fd5b9c3b740 1 --2- 172.21.15.19:0/1949904134 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x563663392f00 0x5636633952f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:46.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.742+0000 7fd5b9c3b740 4 client.18345 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:46.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.742+0000 7fd5b9c3b740 1 -- 172.21.15.19:0/1949904134 --> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5636632eb860 con 0x563663392f00 2024-09-19T09:03:46.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.742+0000 7fd5b55fe640 1 --2- 172.21.15.19:0/1949904134 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x563663392f00 0x5636633952f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:46.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.742+0000 7fd598ff9640 10 client.18345 ms_handle_connect on v2:172.21.15.203:6834/2702758353 2024-09-19T09:03:46.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.742+0000 7fd5b55fe640 1 --2- 172.21.15.19:0/1949904134 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x563663392f00 0x5636633952f0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3af4ac253ed1b31d server_cookie=79f7f91826274ff0 in_seq=0 out_seq=0 2024-09-19T09:03:46.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.743+0000 7fd598ff9640 1 -- 172.21.15.19:0/1949904134 <== mds.4 v2:172.21.15.203:6834/2702758353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5636632eb860 con 0x563663392f00 2024-09-19T09:03:46.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.743+0000 7fd598ff9640 10 client.18345 handle_command_reply: tid=0 2024-09-19T09:03:46.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.743+0000 7fd5b9c3b740 1 client.18345 shutdown 2024-09-19T09:03:46.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.743+0000 7fd5b9c3b740 1 -- 172.21.15.19:0/1949904134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636633785d0 msgr2=0x563663382d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:46.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.743+0000 7fd5b9c3b740 1 --2- 172.21.15.19:0/1949904134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636633785d0 0x563663382d30 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fd5a00096c0 tx=0x7fd5a002a410 comp rx=0 tx=0).stop 2024-09-19T09:03:46.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.743+0000 7fd5b9c3b740 1 -- 172.21.15.19:0/1949904134 shutdown_connections 2024-09-19T09:03:46.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.743+0000 7fd5b9c3b740 1 --2- 172.21.15.19:0/1949904134 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x563663392f00 0x5636633952f0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.743+0000 7fd598ff9640 0 client.18345 ms_handle_reset on v2:172.21.15.203:6834/2702758353 2024-09-19T09:03:46.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.743+0000 7fd5b9c3b740 1 --2- 172.21.15.19:0/1949904134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563663379b40 0x56366337ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.743+0000 7fd5b9c3b740 1 --2- 172.21.15.19:0/1949904134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563663383370 0x5636633805d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.743+0000 7fd5b9c3b740 1 --2- 172.21.15.19:0/1949904134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636633785d0 0x563663382d30 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.743+0000 7fd5b9c3b740 1 -- 172.21.15.19:0/1949904134 >> 172.21.15.19:0/1949904134 conn(0x563663341310 msgr2=0x56366337a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:46.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.743+0000 7fd5b9c3b740 1 -- 172.21.15.19:0/1949904134 shutdown_connections 2024-09-19T09:03:46.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.743+0000 7fd5b9c3b740 1 -- 172.21.15.19:0/1949904134 wait complete. 2024-09-19T09:03:46.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.743+0000 7fd5b9c3b740 20 client.18345 trim_cache size 0 max 16384 2024-09-19T09:03:46.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.757+0000 7fd5b9c3b740 1 Processor -- start 2024-09-19T09:03:46.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.757+0000 7fd5b9c3b740 1 -- start start 2024-09-19T09:03:46.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.757+0000 7fd5b9c3b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636633785d0 0x563663381f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:46.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.757+0000 7fd5b9c3b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563663379b40 0x56366337b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:46.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.757+0000 7fd5b9c3b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563663383370 0x56366337b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:46.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.757+0000 7fd5b9c3b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b01b8020 con 0x5636633785d0 2024-09-19T09:03:46.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.757+0000 7fd5b9c3b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b01b9b60 con 0x563663379b40 2024-09-19T09:03:46.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.757+0000 7fd5b9c3b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b01b86f0 con 0x563663383370 2024-09-19T09:03:46.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.757+0000 7fd5b4dfd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636633785d0 0x563663381f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:46.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.757+0000 7fd5b4dfd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636633785d0 0x563663381f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35420/0 (socket says 172.21.15.19:35420) 2024-09-19T09:03:46.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.757+0000 7fd5b4dfd640 1 -- 172.21.15.19:0/3430880134 learned_addr learned my addr 172.21.15.19:0/3430880134 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:46.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.757+0000 7fd5b55fe640 1 --2- 172.21.15.19:0/3430880134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563663379b40 0x56366337b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:46.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.757+0000 7fd5b4dfd640 1 -- 172.21.15.19:0/3430880134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563663383370 msgr2=0x56366337b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:46.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.757+0000 7fd5b4dfd640 1 --2- 172.21.15.19:0/3430880134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563663383370 0x56366337b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.758+0000 7fd5b4dfd640 1 -- 172.21.15.19:0/3430880134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563663379b40 msgr2=0x56366337b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:46.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.758+0000 7fd5b4dfd640 1 --2- 172.21.15.19:0/3430880134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563663379b40 0x56366337b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.758+0000 7fd5b4dfd640 1 -- 172.21.15.19:0/3430880134 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5636633958d0 con 0x5636633785d0 2024-09-19T09:03:46.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.758+0000 7fd5b4dfd640 1 --2- 172.21.15.19:0/3430880134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636633785d0 0x563663381f50 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0001eb0 tx=0x7fd5a0004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada17371cec1743f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:46.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.758+0000 7fd59affd640 1 -- 172.21.15.19:0/3430880134 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a0035070 con 0x5636633785d0 2024-09-19T09:03:46.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.758+0000 7fd59affd640 1 -- 172.21.15.19:0/3430880134 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5a0005850 con 0x5636633785d0 2024-09-19T09:03:46.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.758+0000 7fd59affd640 1 -- 172.21.15.19:0/3430880134 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a0005580 con 0x5636633785d0 2024-09-19T09:03:46.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.759+0000 7fd5b9c3b740 1 -- 172.21.15.19:0/3430880134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636633785d0 msgr2=0x563663381f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:46.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.759+0000 7fd5b9c3b740 1 --2- 172.21.15.19:0/3430880134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636633785d0 0x563663381f50 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0001eb0 tx=0x7fd5a0004610 comp rx=0 tx=0).stop 2024-09-19T09:03:46.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.759+0000 7fd5b9c3b740 1 -- 172.21.15.19:0/3430880134 shutdown_connections 2024-09-19T09:03:46.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.759+0000 7fd5b9c3b740 1 --2- 172.21.15.19:0/3430880134 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563663383370 0x56366337b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.759+0000 7fd5b9c3b740 1 --2- 172.21.15.19:0/3430880134 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x563663379b40 0x56366337b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.759+0000 7fd5b9c3b740 1 --2- 172.21.15.19:0/3430880134 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5636633785d0 0x563663381f50 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.759+0000 7fd5b9c3b740 1 -- 172.21.15.19:0/3430880134 >> 172.21.15.19:0/3430880134 conn(0x563663341310 msgr2=0x563663381840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:46.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.759+0000 7fd5b9c3b740 1 -- 172.21.15.19:0/3430880134 shutdown_connections 2024-09-19T09:03:46.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.759+0000 7fd5b9c3b740 1 -- 172.21.15.19:0/3430880134 wait complete. 2024-09-19T09:03:46.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.759+0000 7fd5b9c3b740 1 -- start start 2024-09-19T09:03:46.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.759+0000 7fd5b9c3b740 1 Processor -- start 2024-09-19T09:03:46.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.759+0000 7fd5b9c3b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5636633785d0 0x56366338bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:46.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.759+0000 7fd5b9c3b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563663379b40 0x56366337cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:46.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.759+0000 7fd5b9c3b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563663383370 0x56366337d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:46.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.760+0000 7fd5b9c3b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b01b9490 con 0x563663379b40 2024-09-19T09:03:46.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.760+0000 7fd5b9c3b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b01b8dc0 con 0x5636633785d0 2024-09-19T09:03:46.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.760+0000 7fd5b9c3b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b01b6000 con 0x563663383370 2024-09-19T09:03:46.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.760+0000 7fd5b9c3b740 10 client.0 _ll_register_callbacks cb 0x7fd5a0009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:46.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.760+0000 7fd5b55fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563663379b40 0x56366337cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:46.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.760+0000 7fd5b55fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563663379b40 0x56366337cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35430/0 (socket says 172.21.15.19:35430) 2024-09-19T09:03:46.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.760+0000 7fd5b55fe640 1 -- 172.21.15.19:0/3762284478 learned_addr learned my addr 172.21.15.19:0/3762284478 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:46.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.760+0000 7fd5b4dfd640 1 --2- 172.21.15.19:0/3762284478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5636633785d0 0x56366338bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:46.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.760+0000 7fd5b4dfd640 1 --2- 172.21.15.19:0/3762284478 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563663383370 0x56366337d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:46.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.760+0000 7fd5b55fe640 1 -- 172.21.15.19:0/3762284478 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563663383370 msgr2=0x56366337d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:46.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.760+0000 7fd5b55fe640 1 --2- 172.21.15.19:0/3762284478 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563663383370 0x56366337d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.760+0000 7fd5b55fe640 1 -- 172.21.15.19:0/3762284478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5636633785d0 msgr2=0x56366338bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:46.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.760+0000 7fd5b55fe640 1 --2- 172.21.15.19:0/3762284478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5636633785d0 0x56366338bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.760+0000 7fd5b55fe640 1 -- 172.21.15.19:0/3762284478 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56366337d8f0 con 0x563663379b40 2024-09-19T09:03:46.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.760+0000 7fd5b55fe640 1 --2- 172.21.15.19:0/3762284478 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563663379b40 0x56366337cc70 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac00bc90 tx=0x7fd5ac011790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d93c057a822ab43a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:46.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.760+0000 7fd598ff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:46.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.760+0000 7fd598ff9640 1 -- 172.21.15.19:0/3762284478 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac0054e0 con 0x563663379b40 2024-09-19T09:03:46.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.760+0000 7fd598ff9640 1 -- 172.21.15.19:0/3762284478 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7fd5ac011800 con 0x563663379b40 2024-09-19T09:03:46.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.760+0000 7fd5b9c3b740 1 -- 172.21.15.19:0/3762284478 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5a0005850 con 0x563663379b40 2024-09-19T09:03:46.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.761+0000 7fd598ff9640 1 -- 172.21.15.19:0/3762284478 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fd5ac038050 con 0x563663379b40 2024-09-19T09:03:46.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.761+0000 7fd5b9c3b740 10 client.18351 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:46.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.761+0000 7fd5b9c3b740 1 -- 172.21.15.19:0/3762284478 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x5636633fda20 con 0x563663379b40 2024-09-19T09:03:46.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.761+0000 7fd598ff9640 1 -- 172.21.15.19:0/3762284478 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd5a0005850 con 0x563663379b40 2024-09-19T09:03:46.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.761+0000 7fd598ff9640 1 -- 172.21.15.19:0/3762284478 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7fd5ac003c20 con 0x563663379b40 2024-09-19T09:03:46.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.761+0000 7fd5b9c3b740 10 client.18351 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:46.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.761+0000 7fd5b9c3b740 10 client.18351 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T09:03:46.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.761+0000 7fd5b9c3b740 20 client.18351 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:46.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.761+0000 7fd5b9c3b740 1 --2- 172.21.15.19:0/3762284478 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x563663392f00 0x5636633fff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:46.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.761+0000 7fd5b9c3b740 4 client.18351 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:03:46.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.761+0000 7fd5b9c3b740 1 -- 172.21.15.19:0/3762284478 --> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5636632e5d70 con 0x563663392f00 2024-09-19T09:03:46.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.761+0000 7fd5b4dfd640 1 --2- 172.21.15.19:0/3762284478 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x563663392f00 0x5636633fff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:46.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.762+0000 7fd598ff9640 10 client.18351 ms_handle_connect on v2:172.21.15.203:6834/2702758353 2024-09-19T09:03:46.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.762+0000 7fd5b4dfd640 1 --2- 172.21.15.19:0/3762284478 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x563663392f00 0x5636633fff60 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a53d4dc4a286befc server_cookie=4e24e8d3f9d12009 in_seq=0 out_seq=0 2024-09-19T09:03:46.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.762+0000 7fd598ff9640 1 -- 172.21.15.19:0/3762284478 <== mds.4 v2:172.21.15.203:6834/2702758353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5636632e5d70 con 0x563663392f00 2024-09-19T09:03:46.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.762+0000 7fd598ff9640 10 client.18351 handle_command_reply: tid=0 2024-09-19T09:03:46.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.762+0000 7fd5b9c3b740 1 client.18351 shutdown 2024-09-19T09:03:46.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.762+0000 7fd5b9c3b740 1 -- 172.21.15.19:0/3762284478 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563663379b40 msgr2=0x56366337cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:46.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.762+0000 7fd5b9c3b740 1 --2- 172.21.15.19:0/3762284478 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563663379b40 0x56366337cc70 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac00bc90 tx=0x7fd5ac011790 comp rx=0 tx=0).stop 2024-09-19T09:03:46.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.762+0000 7fd5b9c3b740 1 -- 172.21.15.19:0/3762284478 shutdown_connections 2024-09-19T09:03:46.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.762+0000 7fd5b9c3b740 1 --2- 172.21.15.19:0/3762284478 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x563663392f00 0x5636633fff60 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.762+0000 7fd5b9c3b740 1 --2- 172.21.15.19:0/3762284478 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563663383370 0x56366337d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.762+0000 7fd5b9c3b740 1 --2- 172.21.15.19:0/3762284478 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x563663379b40 0x56366337cc70 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.762+0000 7fd5b9c3b740 1 --2- 172.21.15.19:0/3762284478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5636633785d0 0x56366338bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.762+0000 7fd5b9c3b740 1 -- 172.21.15.19:0/3762284478 >> 172.21.15.19:0/3762284478 conn(0x563663341310 msgr2=0x56366338e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:46.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.762+0000 7fd598ff9640 0 client.18351 ms_handle_reset on v2:172.21.15.203:6834/2702758353 2024-09-19T09:03:46.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.762+0000 7fd5b9c3b740 1 -- 172.21.15.19:0/3762284478 shutdown_connections 2024-09-19T09:03:46.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.762+0000 7fd5b9c3b740 1 -- 172.21.15.19:0/3762284478 wait complete. 2024-09-19T09:03:46.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.762+0000 7fd5b9c3b740 20 client.18351 trim_cache size 0 max 16384 2024-09-19T09:03:46.772 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:03:46.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.763+0000 7fd5b7862640 1 -- 172.21.15.19:0/542420794 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd59c0a32c0 msgr2=0x7fd59c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:46.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.763+0000 7fd5b7862640 1 --2- 172.21.15.19:0/542420794 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd59c0a32c0 0x7fd59c0a5780 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8018000 tx=0x7fd5a80214c0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.763+0000 7fd5b7862640 1 -- 172.21.15.19:0/542420794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b0112640 msgr2=0x7fd5b01a77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:46.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.763+0000 7fd5b7862640 1 --2- 172.21.15.19:0/542420794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b0112640 0x7fd5b01a77d0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fd5a800eaa0 tx=0x7fd5a800ef60 comp rx=0 tx=0).stop 2024-09-19T09:03:46.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.763+0000 7fd5b7862640 1 -- 172.21.15.19:0/542420794 shutdown_connections 2024-09-19T09:03:46.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.763+0000 7fd5b7862640 1 --2- 172.21.15.19:0/542420794 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd59c0a32c0 0x7fd59c0a5780 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.763+0000 7fd5b7862640 1 --2- 172.21.15.19:0/542420794 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd5b010cf30 0x7fd5b01a3440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.763+0000 7fd5b7862640 1 --2- 172.21.15.19:0/542420794 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd5b0112640 0x7fd5b01a77d0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.763+0000 7fd5b7862640 1 --2- 172.21.15.19:0/542420794 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd5b010c590 0x7fd5b01a2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:46.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.763+0000 7fd5b7862640 1 -- 172.21.15.19:0/542420794 >> 172.21.15.19:0/542420794 conn(0x7fd5b006cdc0 msgr2=0x7fd5b010af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:46.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.763+0000 7fd5b7862640 1 -- 172.21.15.19:0/542420794 shutdown_connections 2024-09-19T09:03:46.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:46.763+0000 7fd5b7862640 1 -- 172.21.15.19:0/542420794 wait complete. 2024-09-19T09:03:47.536 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T09:03:47.795 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:48.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:47 smithi155 ceph-mon[34921]: pgmap v686: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.4 KiB/s wr, 15 op/s 2024-09-19T09:03:48.218 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:47 smithi019 ceph-mon[30976]: pgmap v686: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.4 KiB/s wr, 15 op/s 2024-09-19T09:03:48.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:47 smithi203 ceph-mon[35450]: pgmap v686: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.4 KiB/s wr, 15 op/s 2024-09-19T09:03:48.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.303+0000 7fb4456f8640 1 -- 172.21.15.19:0/2699925737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb440102790 msgr2=0x7fb4401067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:48.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.303+0000 7fb4456f8640 1 --2- 172.21.15.19:0/2699925737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb440102790 0x7fb4401067e0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fb434009ca0 tx=0x7fb43402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.303+0000 7fb4456f8640 1 -- 172.21.15.19:0/2699925737 shutdown_connections 2024-09-19T09:03:48.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.303+0000 7fb4456f8640 1 --2- 172.21.15.19:0/2699925737 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb440106f10 0x7fb44010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.303+0000 7fb4456f8640 1 --2- 172.21.15.19:0/2699925737 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb440102790 0x7fb4401067e0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.303+0000 7fb4456f8640 1 --2- 172.21.15.19:0/2699925737 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb440101de0 0x7fb4401021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.303+0000 7fb4456f8640 1 -- 172.21.15.19:0/2699925737 >> 172.21.15.19:0/2699925737 conn(0x7fb4400fd8c0 msgr2=0x7fb4400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:48.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.303+0000 7fb4456f8640 1 -- 172.21.15.19:0/2699925737 shutdown_connections 2024-09-19T09:03:48.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.303+0000 7fb4456f8640 1 -- 172.21.15.19:0/2699925737 wait complete. 2024-09-19T09:03:48.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.304+0000 7fb4456f8640 1 Processor -- start 2024-09-19T09:03:48.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.304+0000 7fb4456f8640 1 -- start start 2024-09-19T09:03:48.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.304+0000 7fb4456f8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb440101de0 0x7fb440198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:48.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.304+0000 7fb4456f8640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb440102790 0x7fb4401989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:48.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.304+0000 7fb4456f8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb440106f10 0x7fb44019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:48.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.304+0000 7fb4456f8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb440111f70 con 0x7fb440106f10 2024-09-19T09:03:48.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.304+0000 7fb4456f8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb440111df0 con 0x7fb440101de0 2024-09-19T09:03:48.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.304+0000 7fb4456f8640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb4401120f0 con 0x7fb440102790 2024-09-19T09:03:48.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.304+0000 7fb43f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb440106f10 0x7fb44019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:48.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.304+0000 7fb43f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb440106f10 0x7fb44019cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35462/0 (socket says 172.21.15.19:35462) 2024-09-19T09:03:48.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.304+0000 7fb43f7fe640 1 -- 172.21.15.19:0/3930051918 learned_addr learned my addr 172.21.15.19:0/3930051918 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:48.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.304+0000 7fb43e7fc640 1 --2- 172.21.15.19:0/3930051918 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb440102790 0x7fb4401989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:48.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.304+0000 7fb43effd640 1 --2- 172.21.15.19:0/3930051918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb440101de0 0x7fb440198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:48.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.305+0000 7fb43f7fe640 1 -- 172.21.15.19:0/3930051918 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb440102790 msgr2=0x7fb4401989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:48.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.305+0000 7fb43f7fe640 1 --2- 172.21.15.19:0/3930051918 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb440102790 0x7fb4401989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.305+0000 7fb43f7fe640 1 -- 172.21.15.19:0/3930051918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb440101de0 msgr2=0x7fb440198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:48.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.305+0000 7fb43f7fe640 1 --2- 172.21.15.19:0/3930051918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb440101de0 0x7fb440198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.305+0000 7fb43f7fe640 1 -- 172.21.15.19:0/3930051918 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb44019d440 con 0x7fb440106f10 2024-09-19T09:03:48.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.305+0000 7fb43f7fe640 1 --2- 172.21.15.19:0/3930051918 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb440106f10 0x7fb44019cd60 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fb43800e970 tx=0x7fb43800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:48.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.305+0000 7fb427fff640 1 -- 172.21.15.19:0/3930051918 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43800ccc0 con 0x7fb440106f10 2024-09-19T09:03:48.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.305+0000 7fb427fff640 1 -- 172.21.15.19:0/3930051918 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb43800ce60 con 0x7fb440106f10 2024-09-19T09:03:48.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.305+0000 7fb4456f8640 1 -- 172.21.15.19:0/3930051918 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb44019d730 con 0x7fb440106f10 2024-09-19T09:03:48.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.305+0000 7fb427fff640 1 -- 172.21.15.19:0/3930051918 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb438010490 con 0x7fb440106f10 2024-09-19T09:03:48.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.305+0000 7fb4456f8640 1 -- 172.21.15.19:0/3930051918 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4401a5010 con 0x7fb440106f10 2024-09-19T09:03:48.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.307+0000 7fb447ad1740 1 Processor -- start 2024-09-19T09:03:48.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.307+0000 7fb427fff640 1 -- 172.21.15.19:0/3930051918 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fb438005020 con 0x7fb440106f10 2024-09-19T09:03:48.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.308+0000 7fb447ad1740 1 -- start start 2024-09-19T09:03:48.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.308+0000 7fb447ad1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56174e352b40 0x56174e351090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:48.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.308+0000 7fb447ad1740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56174e3515d0 0x56174e351a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:48.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.308+0000 7fb447ad1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56174e35c370 0x56174e35e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:48.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.308+0000 7fb447ad1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56174e2b72f0 con 0x56174e35c370 2024-09-19T09:03:48.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.308+0000 7fb447ad1740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56174e25ecf0 con 0x56174e3515d0 2024-09-19T09:03:48.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.308+0000 7fb447ad1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56174e2b32b0 con 0x56174e352b40 2024-09-19T09:03:48.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.308+0000 7fb43e7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56174e35c370 0x56174e35e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:48.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.308+0000 7fb43e7fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56174e35c370 0x56174e35e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35468/0 (socket says 172.21.15.19:35468) 2024-09-19T09:03:48.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.308+0000 7fb43e7fc640 1 -- 172.21.15.19:0/1910908269 learned_addr learned my addr 172.21.15.19:0/1910908269 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:48.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.308+0000 7fb43e7fc640 1 --2- 172.21.15.19:0/1910908269 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56174e352b40 0x56174e351090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:48.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.308+0000 7fb43effd640 1 --2- 172.21.15.19:0/1910908269 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56174e3515d0 0x56174e351a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:48.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.308+0000 7fb43e7fc640 1 -- 172.21.15.19:0/1910908269 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56174e352b40 msgr2=0x56174e351090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:48.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.308+0000 7fb43e7fc640 1 --2- 172.21.15.19:0/1910908269 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56174e352b40 0x56174e351090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.308+0000 7fb43e7fc640 1 -- 172.21.15.19:0/1910908269 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56174e3515d0 msgr2=0x56174e351a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:48.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.308+0000 7fb43e7fc640 1 --2- 172.21.15.19:0/1910908269 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56174e3515d0 0x56174e351a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.308+0000 7fb43e7fc640 1 -- 172.21.15.19:0/1910908269 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56174e2433a0 con 0x56174e35c370 2024-09-19T09:03:48.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.308+0000 7fb427fff640 1 --2- 172.21.15.19:0/3930051918 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb4280a3240 0x7fb4280a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:48.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.309+0000 7fb43e7fc640 1 --2- 172.21.15.19:0/1910908269 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56174e35c370 0x56174e35e760 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fb43402f540 tx=0x7fb43402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5770dac906957964 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:48.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.309+0000 7fb43effd640 1 --2- 172.21.15.19:0/3930051918 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb4280a3240 0x7fb4280a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:48.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.309+0000 7fb427fff640 1 -- 172.21.15.19:0/3930051918 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7fb4380cfca0 con 0x7fb440106f10 2024-09-19T09:03:48.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.309+0000 7fb4257fa640 1 -- 172.21.15.19:0/1910908269 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb434031450 con 0x56174e35c370 2024-09-19T09:03:48.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.309+0000 7fb4257fa640 1 -- 172.21.15.19:0/1910908269 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb434036050 con 0x56174e35c370 2024-09-19T09:03:48.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.309+0000 7fb4257fa640 1 -- 172.21.15.19:0/1910908269 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43402fe80 con 0x56174e35c370 2024-09-19T09:03:48.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.310+0000 7fb447ad1740 1 -- 172.21.15.19:0/1910908269 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56174e35c370 msgr2=0x56174e35e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:48.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.310+0000 7fb43effd640 1 --2- 172.21.15.19:0/3930051918 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb4280a3240 0x7fb4280a5700 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x56174e34eac0 tx=0x7fb43000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:48.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.310+0000 7fb447ad1740 1 --2- 172.21.15.19:0/1910908269 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56174e35c370 0x56174e35e760 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7fb43402f540 tx=0x7fb43402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.310+0000 7fb447ad1740 1 -- 172.21.15.19:0/1910908269 shutdown_connections 2024-09-19T09:03:48.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.310+0000 7fb447ad1740 1 --2- 172.21.15.19:0/1910908269 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56174e35c370 0x56174e35e760 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.310+0000 7fb447ad1740 1 --2- 172.21.15.19:0/1910908269 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56174e3515d0 0x56174e351a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.310+0000 7fb447ad1740 1 --2- 172.21.15.19:0/1910908269 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56174e352b40 0x56174e351090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.310+0000 7fb447ad1740 1 -- 172.21.15.19:0/1910908269 >> 172.21.15.19:0/1910908269 conn(0x56174e31a310 msgr2=0x56174e34dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:48.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.310+0000 7fb447ad1740 1 -- 172.21.15.19:0/1910908269 shutdown_connections 2024-09-19T09:03:48.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.310+0000 7fb447ad1740 1 -- 172.21.15.19:0/1910908269 wait complete. 2024-09-19T09:03:48.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.310+0000 7fb447ad1740 1 -- start start 2024-09-19T09:03:48.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.310+0000 7fb447ad1740 1 Processor -- start 2024-09-19T09:03:48.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.310+0000 7fb447ad1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56174e3515d0 0x56174e35bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:48.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.310+0000 7fb447ad1740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56174e352b40 0x56174e359020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:48.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.310+0000 7fb447ad1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56174e35c370 0x56174e359610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:48.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.310+0000 7fb447ad1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56174e35ee90 con 0x56174e3515d0 2024-09-19T09:03:48.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.310+0000 7fb447ad1740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56174e272060 con 0x56174e352b40 2024-09-19T09:03:48.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.310+0000 7fb447ad1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56174e35f010 con 0x56174e35c370 2024-09-19T09:03:48.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.310+0000 7fb447ad1740 10 client.0 _ll_register_callbacks cb 0x56174dfc58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:48.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.310+0000 7fb43effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56174e3515d0 0x56174e35bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:48.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.311+0000 7fb43effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56174e3515d0 0x56174e35bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35484/0 (socket says 172.21.15.19:35484) 2024-09-19T09:03:48.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.311+0000 7fb43effd640 1 -- 172.21.15.19:0/2085721337 learned_addr learned my addr 172.21.15.19:0/2085721337 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:48.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.311+0000 7fb43e7fc640 1 --2- 172.21.15.19:0/2085721337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56174e352b40 0x56174e359020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:48.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.311+0000 7fb43f7fe640 1 --2- 172.21.15.19:0/2085721337 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56174e35c370 0x56174e359610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:48.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.311+0000 7fb43effd640 1 -- 172.21.15.19:0/2085721337 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56174e35c370 msgr2=0x56174e359610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:48.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.311+0000 7fb43effd640 1 --2- 172.21.15.19:0/2085721337 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56174e35c370 0x56174e359610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.311+0000 7fb43effd640 1 -- 172.21.15.19:0/2085721337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56174e352b40 msgr2=0x56174e359020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:48.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.311+0000 7fb43effd640 1 --2- 172.21.15.19:0/2085721337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56174e352b40 0x56174e359020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.311+0000 7fb43effd640 1 -- 172.21.15.19:0/2085721337 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56174e0283c0 con 0x56174e3515d0 2024-09-19T09:03:48.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.311+0000 7fb43f7fe640 1 --2- 172.21.15.19:0/2085721337 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56174e35c370 0x56174e359610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:48.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.311+0000 7fb43effd640 1 --2- 172.21.15.19:0/2085721337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56174e3515d0 0x56174e35bd70 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fb430010ec0 tx=0x7fb4300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3b0112fc9b3f181 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:48.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.311+0000 7fb422ff5640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:48.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.311+0000 7fb422ff5640 1 -- 172.21.15.19:0/2085721337 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43002a060 con 0x56174e3515d0 2024-09-19T09:03:48.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.311+0000 7fb422ff5640 1 -- 172.21.15.19:0/2085721337 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7fb43001b460 con 0x56174e3515d0 2024-09-19T09:03:48.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.311+0000 7fb447ad1740 1 -- 172.21.15.19:0/2085721337 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb434036050 con 0x56174e3515d0 2024-09-19T09:03:48.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.311+0000 7fb422ff5640 1 -- 172.21.15.19:0/2085721337 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fb43001b660 con 0x56174e3515d0 2024-09-19T09:03:48.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.311+0000 7fb447ad1740 10 client.18363 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:48.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.311+0000 7fb447ad1740 1 -- 172.21.15.19:0/2085721337 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x56174e36a990 con 0x56174e3515d0 2024-09-19T09:03:48.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.312+0000 7fb422ff5640 1 -- 172.21.15.19:0/2085721337 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb434036050 con 0x56174e3515d0 2024-09-19T09:03:48.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.312+0000 7fb422ff5640 1 -- 172.21.15.19:0/2085721337 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7fb430019040 con 0x56174e3515d0 2024-09-19T09:03:48.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.312+0000 7fb447ad1740 10 client.18363 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:48.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.312+0000 7fb447ad1740 10 client.18363 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-19T09:03:48.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.312+0000 7fb447ad1740 20 client.18363 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:48.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.312+0000 7fb447ad1740 1 --2- 172.21.15.19:0/2085721337 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x56174e36be50 0x56174e36e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:48.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.312+0000 7fb447ad1740 4 client.18363 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:48.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.312+0000 7fb447ad1740 1 -- 172.21.15.19:0/2085721337 --> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56174e2c4860 con 0x56174e36be50 2024-09-19T09:03:48.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.312+0000 7fb43e7fc640 1 --2- 172.21.15.19:0/2085721337 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x56174e36be50 0x56174e36e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:48.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.313+0000 7fb43e7fc640 1 --2- 172.21.15.19:0/2085721337 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x56174e36be50 0x56174e36e240 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=52632b310fc5ea45 server_cookie=c0efac36ea6b01a5 in_seq=0 out_seq=0 2024-09-19T09:03:48.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.313+0000 7fb422ff5640 10 client.18363 ms_handle_connect on v2:172.21.15.155:6836/3381010945 2024-09-19T09:03:48.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.314+0000 7fb422ff5640 1 -- 172.21.15.19:0/2085721337 <== mds.3 v2:172.21.15.155:6836/3381010945 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56174e2c4860 con 0x56174e36be50 2024-09-19T09:03:48.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.314+0000 7fb422ff5640 10 client.18363 handle_command_reply: tid=0 2024-09-19T09:03:48.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.314+0000 7fb447ad1740 1 client.18363 shutdown 2024-09-19T09:03:48.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.314+0000 7fb447ad1740 1 -- 172.21.15.19:0/2085721337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56174e3515d0 msgr2=0x56174e35bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:48.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.314+0000 7fb447ad1740 1 --2- 172.21.15.19:0/2085721337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56174e3515d0 0x56174e35bd70 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fb430010ec0 tx=0x7fb4300046c0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.314+0000 7fb447ad1740 1 -- 172.21.15.19:0/2085721337 shutdown_connections 2024-09-19T09:03:48.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.314+0000 7fb447ad1740 1 --2- 172.21.15.19:0/2085721337 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x56174e36be50 0x56174e36e240 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.314+0000 7fb447ad1740 1 --2- 172.21.15.19:0/2085721337 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56174e35c370 0x56174e359610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.314+0000 7fb447ad1740 1 --2- 172.21.15.19:0/2085721337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56174e352b40 0x56174e359020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.314+0000 7fb422ff5640 0 client.18363 ms_handle_reset on v2:172.21.15.155:6836/3381010945 2024-09-19T09:03:48.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.314+0000 7fb447ad1740 1 --2- 172.21.15.19:0/2085721337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56174e3515d0 0x56174e35bd70 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.314+0000 7fb447ad1740 1 -- 172.21.15.19:0/2085721337 >> 172.21.15.19:0/2085721337 conn(0x56174e31a310 msgr2=0x56174e353960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:48.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.314+0000 7fb447ad1740 1 -- 172.21.15.19:0/2085721337 shutdown_connections 2024-09-19T09:03:48.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.314+0000 7fb447ad1740 1 -- 172.21.15.19:0/2085721337 wait complete. 2024-09-19T09:03:48.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.314+0000 7fb447ad1740 20 client.18363 trim_cache size 0 max 16384 2024-09-19T09:03:48.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.328+0000 7fb447ad1740 1 Processor -- start 2024-09-19T09:03:48.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.328+0000 7fb447ad1740 1 -- start start 2024-09-19T09:03:48.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.328+0000 7fb447ad1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56174e3515d0 0x56174e368130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:48.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.328+0000 7fb447ad1740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56174e352b40 0x56174e3588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:48.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.328+0000 7fb447ad1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56174e35c370 0x56174e35af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:48.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.328+0000 7fb447ad1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb4401ad610 con 0x56174e3515d0 2024-09-19T09:03:48.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.328+0000 7fb447ad1740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb4401af150 con 0x56174e352b40 2024-09-19T09:03:48.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.328+0000 7fb447ad1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb4401adce0 con 0x56174e35c370 2024-09-19T09:03:48.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.328+0000 7fb43effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56174e3515d0 0x56174e368130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:48.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.328+0000 7fb43effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56174e3515d0 0x56174e368130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35498/0 (socket says 172.21.15.19:35498) 2024-09-19T09:03:48.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.328+0000 7fb43effd640 1 -- 172.21.15.19:0/685709887 learned_addr learned my addr 172.21.15.19:0/685709887 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:48.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.328+0000 7fb43f7fe640 1 --2- 172.21.15.19:0/685709887 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56174e35c370 0x56174e35af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:48.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.328+0000 7fb43effd640 1 -- 172.21.15.19:0/685709887 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56174e35c370 msgr2=0x56174e35af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:48.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.328+0000 7fb43effd640 1 --2- 172.21.15.19:0/685709887 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56174e35c370 0x56174e35af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.328+0000 7fb43effd640 1 -- 172.21.15.19:0/685709887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56174e352b40 msgr2=0x56174e3588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:48.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.328+0000 7fb43effd640 1 --2- 172.21.15.19:0/685709887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56174e352b40 0x56174e3588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.328+0000 7fb43effd640 1 -- 172.21.15.19:0/685709887 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56174e357ff0 con 0x56174e3515d0 2024-09-19T09:03:48.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.328+0000 7fb43effd640 1 --2- 172.21.15.19:0/685709887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56174e3515d0 0x56174e368130 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fb430030b40 tx=0x7fb43001a3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb6a04a66d09590f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:48.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.329+0000 7fb424ff9640 1 -- 172.21.15.19:0/685709887 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb430035030 con 0x56174e3515d0 2024-09-19T09:03:48.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.329+0000 7fb424ff9640 1 -- 172.21.15.19:0/685709887 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb43001b460 con 0x56174e3515d0 2024-09-19T09:03:48.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.329+0000 7fb424ff9640 1 -- 172.21.15.19:0/685709887 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb430005040 con 0x56174e3515d0 2024-09-19T09:03:48.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.329+0000 7fb447ad1740 1 -- 172.21.15.19:0/685709887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56174e3515d0 msgr2=0x56174e368130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:48.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.329+0000 7fb447ad1740 1 --2- 172.21.15.19:0/685709887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56174e3515d0 0x56174e368130 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fb430030b40 tx=0x7fb43001a3c0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.329+0000 7fb447ad1740 1 -- 172.21.15.19:0/685709887 shutdown_connections 2024-09-19T09:03:48.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.329+0000 7fb447ad1740 1 --2- 172.21.15.19:0/685709887 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56174e35c370 0x56174e35af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.329+0000 7fb447ad1740 1 --2- 172.21.15.19:0/685709887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56174e352b40 0x56174e3588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.329+0000 7fb447ad1740 1 --2- 172.21.15.19:0/685709887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56174e3515d0 0x56174e368130 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.329+0000 7fb447ad1740 1 -- 172.21.15.19:0/685709887 >> 172.21.15.19:0/685709887 conn(0x56174e31a310 msgr2=0x56174e35a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:48.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.329+0000 7fb447ad1740 1 -- 172.21.15.19:0/685709887 shutdown_connections 2024-09-19T09:03:48.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.329+0000 7fb447ad1740 1 -- 172.21.15.19:0/685709887 wait complete. 2024-09-19T09:03:48.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.330+0000 7fb447ad1740 1 -- start start 2024-09-19T09:03:48.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.330+0000 7fb447ad1740 1 Processor -- start 2024-09-19T09:03:48.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.330+0000 7fb447ad1740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56174e3515d0 0x56174e3642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:48.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.330+0000 7fb447ad1740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56174e352b40 0x56174e3647e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:48.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.330+0000 7fb447ad1740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56174e35c370 0x56174e361270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:48.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.330+0000 7fb447ad1740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb4401aea80 con 0x56174e3515d0 2024-09-19T09:03:48.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.330+0000 7fb447ad1740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb4401ae3b0 con 0x56174e35c370 2024-09-19T09:03:48.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.330+0000 7fb447ad1740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb4401ab5f0 con 0x56174e352b40 2024-09-19T09:03:48.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.330+0000 7fb447ad1740 10 client.0 _ll_register_callbacks cb 0x7fb430010b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:48.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.330+0000 7fb43effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56174e3515d0 0x56174e3642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:48.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.330+0000 7fb43effd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56174e3515d0 0x56174e3642a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35500/0 (socket says 172.21.15.19:35500) 2024-09-19T09:03:48.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.330+0000 7fb43effd640 1 -- 172.21.15.19:0/1165872330 learned_addr learned my addr 172.21.15.19:0/1165872330 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:48.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.330+0000 7fb43e7fc640 1 --2- 172.21.15.19:0/1165872330 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56174e352b40 0x56174e3647e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:48.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.330+0000 7fb43f7fe640 1 --2- 172.21.15.19:0/1165872330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56174e35c370 0x56174e361270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:48.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.331+0000 7fb43effd640 1 -- 172.21.15.19:0/1165872330 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56174e352b40 msgr2=0x56174e3647e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:48.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.331+0000 7fb43effd640 1 --2- 172.21.15.19:0/1165872330 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56174e352b40 0x56174e3647e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.331+0000 7fb43effd640 1 -- 172.21.15.19:0/1165872330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56174e35c370 msgr2=0x56174e361270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:48.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.331+0000 7fb43effd640 1 --2- 172.21.15.19:0/1165872330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56174e35c370 0x56174e361270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.331+0000 7fb43effd640 1 -- 172.21.15.19:0/1165872330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56174e3617b0 con 0x56174e3515d0 2024-09-19T09:03:48.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.331+0000 7fb43f7fe640 1 --2- 172.21.15.19:0/1165872330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56174e35c370 0x56174e361270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:48.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.331+0000 7fb43e7fc640 1 --2- 172.21.15.19:0/1165872330 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56174e352b40 0x56174e3647e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:48.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.331+0000 7fb43effd640 1 --2- 172.21.15.19:0/1165872330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56174e3515d0 0x56174e3642a0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fb43001b630 tx=0x7fb43001dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dd51086270bfaa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:48.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.331+0000 7fb422ff5640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:48.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.331+0000 7fb422ff5640 1 -- 172.21.15.19:0/1165872330 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43003e030 con 0x56174e3515d0 2024-09-19T09:03:48.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.331+0000 7fb422ff5640 1 -- 172.21.15.19:0/1165872330 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7fb430004020 con 0x56174e3515d0 2024-09-19T09:03:48.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.331+0000 7fb447ad1740 1 -- 172.21.15.19:0/1165872330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb43001b460 con 0x56174e3515d0 2024-09-19T09:03:48.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.331+0000 7fb422ff5640 1 -- 172.21.15.19:0/1165872330 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fb43002a020 con 0x56174e3515d0 2024-09-19T09:03:48.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.331+0000 7fb447ad1740 10 client.18369 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:48.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.331+0000 7fb447ad1740 1 -- 172.21.15.19:0/1165872330 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x56174e3d7140 con 0x56174e3515d0 2024-09-19T09:03:48.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.331+0000 7fb422ff5640 1 -- 172.21.15.19:0/1165872330 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb43001b460 con 0x56174e3515d0 2024-09-19T09:03:48.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.331+0000 7fb422ff5640 1 -- 172.21.15.19:0/1165872330 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7fb430019040 con 0x56174e3515d0 2024-09-19T09:03:48.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.332+0000 7fb447ad1740 10 client.18369 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:48.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.332+0000 7fb447ad1740 10 client.18369 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-19T09:03:48.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.332+0000 7fb447ad1740 20 client.18369 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:48.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.332+0000 7fb447ad1740 1 --2- 172.21.15.19:0/1165872330 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x56174e3d7780 0x56174e3d9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:48.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.332+0000 7fb447ad1740 4 client.18369 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:03:48.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.332+0000 7fb447ad1740 1 -- 172.21.15.19:0/1165872330 --> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56174e2bed70 con 0x56174e3d7780 2024-09-19T09:03:48.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.332+0000 7fb43e7fc640 1 --2- 172.21.15.19:0/1165872330 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x56174e3d7780 0x56174e3d9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:48.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.332+0000 7fb43e7fc640 1 --2- 172.21.15.19:0/1165872330 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x56174e3d7780 0x56174e3d9b70 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b6cb7ba4f719f563 server_cookie=6ff6ff2bc1fbc6d in_seq=0 out_seq=0 2024-09-19T09:03:48.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.332+0000 7fb422ff5640 10 client.18369 ms_handle_connect on v2:172.21.15.155:6836/3381010945 2024-09-19T09:03:48.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.333+0000 7fb422ff5640 1 -- 172.21.15.19:0/1165872330 <== mds.3 v2:172.21.15.155:6836/3381010945 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56174e2bed70 con 0x56174e3d7780 2024-09-19T09:03:48.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.333+0000 7fb422ff5640 10 client.18369 handle_command_reply: tid=0 2024-09-19T09:03:48.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.333+0000 7fb447ad1740 1 client.18369 shutdown 2024-09-19T09:03:48.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.333+0000 7fb447ad1740 1 -- 172.21.15.19:0/1165872330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56174e3515d0 msgr2=0x56174e3642a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:48.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.333+0000 7fb447ad1740 1 --2- 172.21.15.19:0/1165872330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56174e3515d0 0x56174e3642a0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fb43001b630 tx=0x7fb43001dc60 comp rx=0 tx=0).stop 2024-09-19T09:03:48.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.333+0000 7fb447ad1740 1 -- 172.21.15.19:0/1165872330 shutdown_connections 2024-09-19T09:03:48.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.333+0000 7fb447ad1740 1 --2- 172.21.15.19:0/1165872330 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x56174e3d7780 0x56174e3d9b70 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.333+0000 7fb447ad1740 1 --2- 172.21.15.19:0/1165872330 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56174e352b40 0x56174e3647e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.333+0000 7fb447ad1740 1 --2- 172.21.15.19:0/1165872330 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56174e35c370 0x56174e361270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.333+0000 7fb447ad1740 1 --2- 172.21.15.19:0/1165872330 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56174e3515d0 0x56174e3642a0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.333+0000 7fb422ff5640 0 client.18369 ms_handle_reset on v2:172.21.15.155:6836/3381010945 2024-09-19T09:03:48.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.333+0000 7fb447ad1740 1 -- 172.21.15.19:0/1165872330 >> 172.21.15.19:0/1165872330 conn(0x56174e31a310 msgr2=0x56174e353110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:48.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.333+0000 7fb447ad1740 1 -- 172.21.15.19:0/1165872330 shutdown_connections 2024-09-19T09:03:48.362 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:03:48.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.333+0000 7fb447ad1740 1 -- 172.21.15.19:0/1165872330 wait complete. 2024-09-19T09:03:48.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.333+0000 7fb447ad1740 20 client.18369 trim_cache size 0 max 16384 2024-09-19T09:03:48.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.333+0000 7fb4456f8640 1 -- 172.21.15.19:0/3930051918 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb4280a3240 msgr2=0x7fb4280a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:48.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.333+0000 7fb4456f8640 1 --2- 172.21.15.19:0/3930051918 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb4280a3240 0x7fb4280a5700 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x56174e34eac0 tx=0x7fb43000a2d0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.333+0000 7fb4456f8640 1 -- 172.21.15.19:0/3930051918 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb440106f10 msgr2=0x7fb44019cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:48.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.333+0000 7fb4456f8640 1 --2- 172.21.15.19:0/3930051918 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb440106f10 0x7fb44019cd60 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7fb43800e970 tx=0x7fb43800ed70 comp rx=0 tx=0).stop 2024-09-19T09:03:48.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.334+0000 7fb4456f8640 1 -- 172.21.15.19:0/3930051918 shutdown_connections 2024-09-19T09:03:48.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.334+0000 7fb4456f8640 1 --2- 172.21.15.19:0/3930051918 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb4280a3240 0x7fb4280a5700 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.334+0000 7fb4456f8640 1 --2- 172.21.15.19:0/3930051918 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb440102790 0x7fb4401989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.334+0000 7fb4456f8640 1 --2- 172.21.15.19:0/3930051918 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb440106f10 0x7fb44019cd60 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.334+0000 7fb4456f8640 1 --2- 172.21.15.19:0/3930051918 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb440101de0 0x7fb440198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:48.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.334+0000 7fb4456f8640 1 -- 172.21.15.19:0/3930051918 >> 172.21.15.19:0/3930051918 conn(0x7fb4400fd8c0 msgr2=0x7fb4400fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:48.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.334+0000 7fb4456f8640 1 -- 172.21.15.19:0/3930051918 shutdown_connections 2024-09-19T09:03:48.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:48.334+0000 7fb4456f8640 1 -- 172.21.15.19:0/3930051918 wait complete. 2024-09-19T09:03:49.040 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:03:49.298 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:49.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.754+0000 7fcfee443640 1 -- 172.21.15.19:0/1435376322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfe8102d30 msgr2=0x7fcfe8103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:49.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.754+0000 7fcfee443640 1 --2- 172.21.15.19:0/1435376322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfe8102d30 0x7fcfe8103110 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8009930 tx=0x7fcfd802a420 comp rx=0 tx=0).stop 2024-09-19T09:03:49.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.754+0000 7fcfee443640 1 -- 172.21.15.19:0/1435376322 shutdown_connections 2024-09-19T09:03:49.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.754+0000 7fcfee443640 1 --2- 172.21.15.19:0/1435376322 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcfe81082a0 0x7fcfe810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.754+0000 7fcfee443640 1 --2- 172.21.15.19:0/1435376322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfe81036e0 0x7fcfe8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.754+0000 7fcfee443640 1 --2- 172.21.15.19:0/1435376322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfe8102d30 0x7fcfe8103110 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.754+0000 7fcfee443640 1 -- 172.21.15.19:0/1435376322 >> 172.21.15.19:0/1435376322 conn(0x7fcfe80fc7d0 msgr2=0x7fcfe80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:49.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.754+0000 7fcfee443640 1 -- 172.21.15.19:0/1435376322 shutdown_connections 2024-09-19T09:03:49.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.754+0000 7fcfee443640 1 -- 172.21.15.19:0/1435376322 wait complete. 2024-09-19T09:03:49.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.755+0000 7fcfee443640 1 Processor -- start 2024-09-19T09:03:49.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.755+0000 7fcfee443640 1 -- start start 2024-09-19T09:03:49.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.755+0000 7fcfee443640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfe8102d30 0x7fcfe81985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.755+0000 7fcfee443640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfe81036e0 0x7fcfe8198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.755+0000 7fcfee443640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcfe81082a0 0x7fcfe819ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.755+0000 7fcfee443640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe81120a0 con 0x7fcfe8102d30 2024-09-19T09:03:49.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.755+0000 7fcfee443640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe8111f20 con 0x7fcfe81036e0 2024-09-19T09:03:49.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.755+0000 7fcfee443640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe8112220 con 0x7fcfe81082a0 2024-09-19T09:03:49.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.755+0000 7fcfe7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfe8102d30 0x7fcfe81985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.755+0000 7fcfe7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfe8102d30 0x7fcfe81985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35514/0 (socket says 172.21.15.19:35514) 2024-09-19T09:03:49.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.755+0000 7fcfe7fff640 1 -- 172.21.15.19:0/3746760069 learned_addr learned my addr 172.21.15.19:0/3746760069 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:49.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.755+0000 7fcfe77fe640 1 --2- 172.21.15.19:0/3746760069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfe81036e0 0x7fcfe8198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.755+0000 7fcfec9e0640 1 --2- 172.21.15.19:0/3746760069 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcfe81082a0 0x7fcfe819ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.756+0000 7fcfe7fff640 1 -- 172.21.15.19:0/3746760069 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcfe81082a0 msgr2=0x7fcfe819ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:49.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.756+0000 7fcfe7fff640 1 --2- 172.21.15.19:0/3746760069 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcfe81082a0 0x7fcfe819ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.756+0000 7fcfe7fff640 1 -- 172.21.15.19:0/3746760069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfe81036e0 msgr2=0x7fcfe8198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:49.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.756+0000 7fcfe7fff640 1 --2- 172.21.15.19:0/3746760069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfe81036e0 0x7fcfe8198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.756+0000 7fcfe7fff640 1 -- 172.21.15.19:0/3746760069 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe819d570 con 0x7fcfe8102d30 2024-09-19T09:03:49.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.756+0000 7fcfe7fff640 1 --2- 172.21.15.19:0/3746760069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfe8102d30 0x7fcfe81985c0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8009230 tx=0x7fcfd8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:49.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.756+0000 7fcfe57fa640 1 -- 172.21.15.19:0/3746760069 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd803f030 con 0x7fcfe8102d30 2024-09-19T09:03:49.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.756+0000 7fcfee443640 1 -- 172.21.15.19:0/3746760069 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfe819d800 con 0x7fcfe8102d30 2024-09-19T09:03:49.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.756+0000 7fcfe57fa640 1 -- 172.21.15.19:0/3746760069 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfd8003ad0 con 0x7fcfe8102d30 2024-09-19T09:03:49.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.756+0000 7fcfe57fa640 1 -- 172.21.15.19:0/3746760069 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8035070 con 0x7fcfe8102d30 2024-09-19T09:03:49.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.756+0000 7fcfee443640 1 -- 172.21.15.19:0/3746760069 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfe81a5140 con 0x7fcfe8102d30 2024-09-19T09:03:49.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.758+0000 7fcfe57fa640 1 -- 172.21.15.19:0/3746760069 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fcfd8042030 con 0x7fcfe8102d30 2024-09-19T09:03:49.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.758+0000 7fcff081c740 1 Processor -- start 2024-09-19T09:03:49.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.759+0000 7fcff081c740 1 -- start start 2024-09-19T09:03:49.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.759+0000 7fcff081c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55feb0289b40 0x55feb0288090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.759+0000 7fcff081c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55feb02885d0 0x55feb0288a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.759+0000 7fcff081c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55feb0293370 0x55feb0295760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.759+0000 7fcff081c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55feb01ee2f0 con 0x55feb0293370 2024-09-19T09:03:49.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.759+0000 7fcff081c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55feb0195cf0 con 0x55feb02885d0 2024-09-19T09:03:49.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.759+0000 7fcff081c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55feb01ea2b0 con 0x55feb0289b40 2024-09-19T09:03:49.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.759+0000 7fcfe77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55feb0293370 0x55feb0295760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.759+0000 7fcfe77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55feb0293370 0x55feb0295760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35516/0 (socket says 172.21.15.19:35516) 2024-09-19T09:03:49.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.759+0000 7fcfe77fe640 1 -- 172.21.15.19:0/1646372258 learned_addr learned my addr 172.21.15.19:0/1646372258 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:49.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.759+0000 7fcfec9e0640 1 --2- 172.21.15.19:0/1646372258 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55feb0289b40 0x55feb0288090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.759+0000 7fcfe7fff640 1 --2- 172.21.15.19:0/1646372258 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55feb02885d0 0x55feb0288a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.759+0000 7fcfe57fa640 1 --2- 172.21.15.19:0/3746760069 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fcfd00a3240 0x7fcfd00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.759+0000 7fcfe77fe640 1 -- 172.21.15.19:0/1646372258 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55feb0289b40 msgr2=0x55feb0288090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:49.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.759+0000 7fcfe77fe640 1 --2- 172.21.15.19:0/1646372258 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55feb0289b40 0x55feb0288090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.759+0000 7fcfe77fe640 1 -- 172.21.15.19:0/1646372258 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55feb02885d0 msgr2=0x55feb0288a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:49.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.759+0000 7fcfe77fe640 1 --2- 172.21.15.19:0/1646372258 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55feb02885d0 0x55feb0288a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.759+0000 7fcfec9e0640 1 --2- 172.21.15.19:0/3746760069 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fcfd00a3240 0x7fcfd00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.759+0000 7fcfe77fe640 1 -- 172.21.15.19:0/1646372258 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55feb017a3a0 con 0x55feb0293370 2024-09-19T09:03:49.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.759+0000 7fcfe7fff640 1 --2- 172.21.15.19:0/1646372258 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55feb02885d0 0x55feb0288a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:49.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.759+0000 7fcfe57fa640 1 -- 172.21.15.19:0/3746760069 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7fcfd80ef9e0 con 0x7fcfe8102d30 2024-09-19T09:03:49.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.760+0000 7fcfe77fe640 1 --2- 172.21.15.19:0/1646372258 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55feb0293370 0x55feb0295760 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc00bc30 tx=0x7fcfdc0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a244e2b927f0e81d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:49.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.760+0000 7fcfce7fc640 1 -- 172.21.15.19:0/1646372258 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc01c480 con 0x55feb0293370 2024-09-19T09:03:49.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.760+0000 7fcfce7fc640 1 -- 172.21.15.19:0/1646372258 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfdc01cb00 con 0x55feb0293370 2024-09-19T09:03:49.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.760+0000 7fcfce7fc640 1 -- 172.21.15.19:0/1646372258 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc011ba0 con 0x55feb0293370 2024-09-19T09:03:49.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.760+0000 7fcfec9e0640 1 --2- 172.21.15.19:0/3746760069 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fcfd00a3240 0x7fcfd00a5700 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fcfe000a2c0 tx=0x7fcfe0004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:49.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.760+0000 7fcff081c740 1 -- 172.21.15.19:0/1646372258 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55feb0293370 msgr2=0x55feb0295760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:49.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.760+0000 7fcff081c740 1 --2- 172.21.15.19:0/1646372258 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55feb0293370 0x55feb0295760 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc00bc30 tx=0x7fcfdc0107a0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.761+0000 7fcff081c740 1 -- 172.21.15.19:0/1646372258 shutdown_connections 2024-09-19T09:03:49.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.761+0000 7fcff081c740 1 --2- 172.21.15.19:0/1646372258 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55feb0293370 0x55feb0295760 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.761+0000 7fcff081c740 1 --2- 172.21.15.19:0/1646372258 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55feb02885d0 0x55feb0288a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.761+0000 7fcff081c740 1 --2- 172.21.15.19:0/1646372258 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55feb0289b40 0x55feb0288090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.761+0000 7fcff081c740 1 -- 172.21.15.19:0/1646372258 >> 172.21.15.19:0/1646372258 conn(0x55feb0251310 msgr2=0x55feb0284c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:49.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.761+0000 7fcff081c740 1 -- 172.21.15.19:0/1646372258 shutdown_connections 2024-09-19T09:03:49.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.761+0000 7fcff081c740 1 -- 172.21.15.19:0/1646372258 wait complete. 2024-09-19T09:03:49.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.761+0000 7fcff081c740 1 -- start start 2024-09-19T09:03:49.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.761+0000 7fcff081c740 1 Processor -- start 2024-09-19T09:03:49.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.761+0000 7fcff081c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55feb02885d0 0x55feb0292d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.761+0000 7fcff081c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55feb0289b40 0x55feb028ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.761+0000 7fcff081c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55feb0293370 0x55feb0290570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.761+0000 7fcff081c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55feb0296070 con 0x55feb02885d0 2024-09-19T09:03:49.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.761+0000 7fcff081c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55feb01a9060 con 0x55feb0289b40 2024-09-19T09:03:49.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.761+0000 7fcff081c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55feb02961f0 con 0x55feb0293370 2024-09-19T09:03:49.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.762+0000 7fcff081c740 10 client.0 _ll_register_callbacks cb 0x55feafefc8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:49.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.762+0000 7fcfe7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55feb02885d0 0x55feb0292d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.762+0000 7fcfe7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55feb02885d0 0x55feb0292d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35518/0 (socket says 172.21.15.19:35518) 2024-09-19T09:03:49.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.762+0000 7fcfe7fff640 1 -- 172.21.15.19:0/412828839 learned_addr learned my addr 172.21.15.19:0/412828839 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:49.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.762+0000 7fcfe77fe640 1 --2- 172.21.15.19:0/412828839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55feb0289b40 0x55feb028ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.762+0000 7fcfe7fff640 1 -- 172.21.15.19:0/412828839 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55feb0293370 msgr2=0x55feb0290570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:49.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.762+0000 7fcfe7fff640 1 --2- 172.21.15.19:0/412828839 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55feb0293370 0x55feb0290570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.762+0000 7fcfe7fff640 1 -- 172.21.15.19:0/412828839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55feb0289b40 msgr2=0x55feb028ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:49.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.762+0000 7fcfe7fff640 1 --2- 172.21.15.19:0/412828839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55feb0289b40 0x55feb028ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.762+0000 7fcfe7fff640 1 -- 172.21.15.19:0/412828839 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55feaff5f3c0 con 0x55feb02885d0 2024-09-19T09:03:49.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.762+0000 7fcfe77fe640 1 --2- 172.21.15.19:0/412828839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55feb0289b40 0x55feb028ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:49.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.762+0000 7fcfe7fff640 1 --2- 172.21.15.19:0/412828839 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55feb02885d0 0x55feb0292d20 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fcfd80b8520 tx=0x7fcfd802a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5585c5992cca0932 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:49.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.762+0000 7fcfc77fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:49.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.762+0000 7fcfc77fe640 1 -- 172.21.15.19:0/412828839 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8049070 con 0x55feb02885d0 2024-09-19T09:03:49.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.762+0000 7fcfc77fe640 1 -- 172.21.15.19:0/412828839 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7fcfd803b460 con 0x55feb02885d0 2024-09-19T09:03:49.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.762+0000 7fcff081c740 1 -- 172.21.15.19:0/412828839 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfdc01cb00 con 0x55feb02885d0 2024-09-19T09:03:49.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.762+0000 7fcfc77fe640 1 -- 172.21.15.19:0/412828839 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fcfd80c4c80 con 0x55feb02885d0 2024-09-19T09:03:49.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.762+0000 7fcff081c740 10 client.18381 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:49.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.762+0000 7fcff081c740 1 -- 172.21.15.19:0/412828839 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55feb02a1ac0 con 0x55feb02885d0 2024-09-19T09:03:49.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.763+0000 7fcfc77fe640 1 -- 172.21.15.19:0/412828839 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfdc01cb00 con 0x55feb02885d0 2024-09-19T09:03:49.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.763+0000 7fcfc77fe640 1 -- 172.21.15.19:0/412828839 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7fcfd804c060 con 0x55feb02885d0 2024-09-19T09:03:49.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.763+0000 7fcff081c740 10 client.18381 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:49.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.763+0000 7fcff081c740 10 client.18381 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T09:03:49.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.763+0000 7fcff081c740 20 client.18381 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:49.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.763+0000 7fcff081c740 1 --2- 172.21.15.19:0/412828839 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55feb02a2f60 0x55feb02a53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.763+0000 7fcff081c740 4 client.18381 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:49.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.763+0000 7fcff081c740 1 -- 172.21.15.19:0/412828839 --> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55feb01fb860 con 0x55feb02a2f60 2024-09-19T09:03:49.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.763+0000 7fcfe77fe640 1 --2- 172.21.15.19:0/412828839 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55feb02a2f60 0x55feb02a53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.764+0000 7fcfe77fe640 1 --2- 172.21.15.19:0/412828839 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55feb02a2f60 0x55feb02a53f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4472b1dcfa2ccdb1 server_cookie=1f66f16ec14df8f3 in_seq=0 out_seq=0 2024-09-19T09:03:49.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.764+0000 7fcfc77fe640 10 client.18381 ms_handle_connect on v2:172.21.15.203:6836/3684671619 2024-09-19T09:03:49.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.764+0000 7fcfc77fe640 1 -- 172.21.15.19:0/412828839 <== mds.2 v2:172.21.15.203:6836/3684671619 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55feb01fb860 con 0x55feb02a2f60 2024-09-19T09:03:49.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.764+0000 7fcfc77fe640 10 client.18381 handle_command_reply: tid=0 2024-09-19T09:03:49.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.764+0000 7fcff081c740 1 client.18381 shutdown 2024-09-19T09:03:49.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.764+0000 7fcff081c740 1 -- 172.21.15.19:0/412828839 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55feb02885d0 msgr2=0x55feb0292d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:49.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.764+0000 7fcff081c740 1 --2- 172.21.15.19:0/412828839 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55feb02885d0 0x55feb0292d20 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fcfd80b8520 tx=0x7fcfd802a420 comp rx=0 tx=0).stop 2024-09-19T09:03:49.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.765+0000 7fcff081c740 1 -- 172.21.15.19:0/412828839 shutdown_connections 2024-09-19T09:03:49.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.765+0000 7fcff081c740 1 --2- 172.21.15.19:0/412828839 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55feb02a2f60 0x55feb02a53f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.765+0000 7fcff081c740 1 --2- 172.21.15.19:0/412828839 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55feb0293370 0x55feb0290570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.765+0000 7fcff081c740 1 --2- 172.21.15.19:0/412828839 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55feb0289b40 0x55feb028ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.765+0000 7fcff081c740 1 --2- 172.21.15.19:0/412828839 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55feb02885d0 0x55feb0292d20 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.765+0000 7fcff081c740 1 -- 172.21.15.19:0/412828839 >> 172.21.15.19:0/412828839 conn(0x55feb0251310 msgr2=0x55feb028a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:49.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.765+0000 7fcfc77fe640 0 client.18381 ms_handle_reset on v2:172.21.15.203:6836/3684671619 2024-09-19T09:03:49.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.765+0000 7fcff081c740 1 -- 172.21.15.19:0/412828839 shutdown_connections 2024-09-19T09:03:49.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.765+0000 7fcff081c740 1 -- 172.21.15.19:0/412828839 wait complete. 2024-09-19T09:03:49.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.765+0000 7fcff081c740 20 client.18381 trim_cache size 0 max 16384 2024-09-19T09:03:49.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.778+0000 7fcff081c740 1 Processor -- start 2024-09-19T09:03:49.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.778+0000 7fcff081c740 1 -- start start 2024-09-19T09:03:49.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.778+0000 7fcff081c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55feb02885d0 0x55feb029f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.778+0000 7fcff081c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55feb0289b40 0x55feb0283a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.778+0000 7fcff081c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55feb0293370 0x55feb0283f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.778+0000 7fcff081c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe81ad4f0 con 0x55feb0289b40 2024-09-19T09:03:49.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.778+0000 7fcff081c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe81af030 con 0x55feb0293370 2024-09-19T09:03:49.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.778+0000 7fcff081c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe81adbc0 con 0x55feb02885d0 2024-09-19T09:03:49.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.778+0000 7fcfe77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55feb0289b40 0x55feb0283a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.778+0000 7fcfe77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55feb0289b40 0x55feb0283a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35530/0 (socket says 172.21.15.19:35530) 2024-09-19T09:03:49.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.778+0000 7fcfe77fe640 1 -- 172.21.15.19:0/747202503 learned_addr learned my addr 172.21.15.19:0/747202503 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:49.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.778+0000 7fcfe7fff640 1 --2- 172.21.15.19:0/747202503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55feb02885d0 0x55feb029f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.778+0000 7fcfec9e0640 1 --2- 172.21.15.19:0/747202503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55feb0293370 0x55feb0283f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.778+0000 7fcfe77fe640 1 -- 172.21.15.19:0/747202503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55feb02885d0 msgr2=0x55feb029f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:49.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.778+0000 7fcfe77fe640 1 --2- 172.21.15.19:0/747202503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55feb02885d0 0x55feb029f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.778+0000 7fcfe77fe640 1 -- 172.21.15.19:0/747202503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55feb0293370 msgr2=0x55feb0283f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:49.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.778+0000 7fcfe77fe640 1 --2- 172.21.15.19:0/747202503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55feb0293370 0x55feb0283f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.778+0000 7fcfe77fe640 1 -- 172.21.15.19:0/747202503 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55feb028e520 con 0x55feb0289b40 2024-09-19T09:03:49.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.778+0000 7fcfe7fff640 1 --2- 172.21.15.19:0/747202503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55feb02885d0 0x55feb029f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:49.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.778+0000 7fcfec9e0640 1 --2- 172.21.15.19:0/747202503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55feb0293370 0x55feb0283f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:49.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.778+0000 7fcfe77fe640 1 --2- 172.21.15.19:0/747202503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55feb0289b40 0x55feb0283a20 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc00bc30 tx=0x7fcfdc00b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3499d791edfc8c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:49.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.779+0000 7fcfcdffb640 1 -- 172.21.15.19:0/747202503 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc030070 con 0x55feb0289b40 2024-09-19T09:03:49.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.779+0000 7fcfcdffb640 1 -- 172.21.15.19:0/747202503 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfdc0035f0 con 0x55feb0289b40 2024-09-19T09:03:49.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.779+0000 7fcfcdffb640 1 -- 172.21.15.19:0/747202503 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc01c6e0 con 0x55feb0289b40 2024-09-19T09:03:49.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.779+0000 7fcff081c740 1 -- 172.21.15.19:0/747202503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55feb0289b40 msgr2=0x55feb0283a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:49.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.779+0000 7fcff081c740 1 --2- 172.21.15.19:0/747202503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55feb0289b40 0x55feb0283a20 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc00bc30 tx=0x7fcfdc00b950 comp rx=0 tx=0).stop 2024-09-19T09:03:49.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.779+0000 7fcff081c740 1 -- 172.21.15.19:0/747202503 shutdown_connections 2024-09-19T09:03:49.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.779+0000 7fcff081c740 1 --2- 172.21.15.19:0/747202503 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55feb0293370 0x55feb0283f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.779+0000 7fcff081c740 1 --2- 172.21.15.19:0/747202503 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55feb0289b40 0x55feb0283a20 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.779+0000 7fcff081c740 1 --2- 172.21.15.19:0/747202503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55feb02885d0 0x55feb029f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.779+0000 7fcff081c740 1 -- 172.21.15.19:0/747202503 >> 172.21.15.19:0/747202503 conn(0x55feb0251310 msgr2=0x55feb0283310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:49.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.779+0000 7fcff081c740 1 -- 172.21.15.19:0/747202503 shutdown_connections 2024-09-19T09:03:49.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.779+0000 7fcff081c740 1 -- 172.21.15.19:0/747202503 wait complete. 2024-09-19T09:03:49.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.780+0000 7fcff081c740 1 -- start start 2024-09-19T09:03:49.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.780+0000 7fcff081c740 1 Processor -- start 2024-09-19T09:03:49.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.780+0000 7fcff081c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55feb02885d0 0x55feb0305e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.780+0000 7fcff081c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55feb0289b40 0x55feb0306380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.780+0000 7fcff081c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55feb0293370 0x55feb0309ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.780+0000 7fcff081c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe81ae960 con 0x55feb0289b40 2024-09-19T09:03:49.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.780+0000 7fcff081c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe81ae290 con 0x55feb0293370 2024-09-19T09:03:49.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.780+0000 7fcff081c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe81ab4d0 con 0x55feb02885d0 2024-09-19T09:03:49.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.780+0000 7fcff081c740 10 client.0 _ll_register_callbacks cb 0x7fcfd8009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:49.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.780+0000 7fcfe77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55feb0289b40 0x55feb0306380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.780+0000 7fcfe77fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55feb0289b40 0x55feb0306380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35532/0 (socket says 172.21.15.19:35532) 2024-09-19T09:03:49.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.780+0000 7fcfe77fe640 1 -- 172.21.15.19:0/1053594881 learned_addr learned my addr 172.21.15.19:0/1053594881 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:49.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.781+0000 7fcfec9e0640 1 --2- 172.21.15.19:0/1053594881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55feb0293370 0x55feb0309ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.781+0000 7fcfe7fff640 1 --2- 172.21.15.19:0/1053594881 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55feb02885d0 0x55feb0305e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.781+0000 7fcfe77fe640 1 -- 172.21.15.19:0/1053594881 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55feb02885d0 msgr2=0x55feb0305e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:49.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.781+0000 7fcfe77fe640 1 --2- 172.21.15.19:0/1053594881 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55feb02885d0 0x55feb0305e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.781+0000 7fcfe77fe640 1 -- 172.21.15.19:0/1053594881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55feb0293370 msgr2=0x55feb0309ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:49.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.781+0000 7fcfe77fe640 1 --2- 172.21.15.19:0/1053594881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55feb0293370 0x55feb0309ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.781+0000 7fcfe77fe640 1 -- 172.21.15.19:0/1053594881 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55feb030a570 con 0x55feb0289b40 2024-09-19T09:03:49.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.781+0000 7fcfe7fff640 1 --2- 172.21.15.19:0/1053594881 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55feb02885d0 0x55feb0305e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:49.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.781+0000 7fcfe77fe640 1 --2- 172.21.15.19:0/1053594881 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55feb0289b40 0x55feb0306380 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc0107e0 tx=0x7fcfdc005ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6556e61ec2e1d082 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:49.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.781+0000 7fcfc77fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:49.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.781+0000 7fcfc77fe640 1 -- 172.21.15.19:0/1053594881 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc039060 con 0x55feb0289b40 2024-09-19T09:03:49.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.781+0000 7fcfc77fe640 1 -- 172.21.15.19:0/1053594881 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7fcfdc005370 con 0x55feb0289b40 2024-09-19T09:03:49.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.781+0000 7fcff081c740 1 -- 172.21.15.19:0/1053594881 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfdc0035f0 con 0x55feb0289b40 2024-09-19T09:03:49.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.781+0000 7fcfc77fe640 1 -- 172.21.15.19:0/1053594881 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fcfdc030040 con 0x55feb0289b40 2024-09-19T09:03:49.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.781+0000 7fcff081c740 10 client.18387 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:49.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.781+0000 7fcff081c740 1 -- 172.21.15.19:0/1053594881 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55feb0312a50 con 0x55feb0289b40 2024-09-19T09:03:49.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.781+0000 7fcfc77fe640 1 -- 172.21.15.19:0/1053594881 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fcfdc0035f0 con 0x55feb0289b40 2024-09-19T09:03:49.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.782+0000 7fcfc77fe640 1 -- 172.21.15.19:0/1053594881 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7fcfdc01c810 con 0x55feb0289b40 2024-09-19T09:03:49.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.782+0000 7fcff081c740 10 client.18387 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:49.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.782+0000 7fcff081c740 10 client.18387 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T09:03:49.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.782+0000 7fcff081c740 20 client.18387 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:49.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.782+0000 7fcff081c740 1 --2- 172.21.15.19:0/1053594881 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55feb0312f80 0x55feb03153a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:49.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.782+0000 7fcff081c740 4 client.18387 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:03:49.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.782+0000 7fcff081c740 1 -- 172.21.15.19:0/1053594881 --> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55feb01f5d70 con 0x55feb0312f80 2024-09-19T09:03:49.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.782+0000 7fcfe7fff640 1 --2- 172.21.15.19:0/1053594881 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55feb0312f80 0x55feb03153a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:49.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.782+0000 7fcfe7fff640 1 --2- 172.21.15.19:0/1053594881 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55feb0312f80 0x55feb03153a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=31f087c084ff75ab server_cookie=c6e85625e34173db in_seq=0 out_seq=0 2024-09-19T09:03:49.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.782+0000 7fcfc77fe640 10 client.18387 ms_handle_connect on v2:172.21.15.203:6836/3684671619 2024-09-19T09:03:49.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.783+0000 7fcfc77fe640 1 -- 172.21.15.19:0/1053594881 <== mds.2 v2:172.21.15.203:6836/3684671619 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55feb01f5d70 con 0x55feb0312f80 2024-09-19T09:03:49.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.783+0000 7fcfc77fe640 10 client.18387 handle_command_reply: tid=0 2024-09-19T09:03:49.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.783+0000 7fcff081c740 1 client.18387 shutdown 2024-09-19T09:03:49.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.783+0000 7fcff081c740 1 -- 172.21.15.19:0/1053594881 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55feb0289b40 msgr2=0x55feb0306380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:49.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.783+0000 7fcff081c740 1 --2- 172.21.15.19:0/1053594881 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55feb0289b40 0x55feb0306380 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc0107e0 tx=0x7fcfdc005ed0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.783+0000 7fcff081c740 1 -- 172.21.15.19:0/1053594881 shutdown_connections 2024-09-19T09:03:49.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.783+0000 7fcff081c740 1 --2- 172.21.15.19:0/1053594881 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55feb0312f80 0x55feb03153a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.783+0000 7fcff081c740 1 --2- 172.21.15.19:0/1053594881 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55feb0293370 0x55feb0309ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.783+0000 7fcff081c740 1 --2- 172.21.15.19:0/1053594881 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55feb0289b40 0x55feb0306380 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.783+0000 7fcff081c740 1 --2- 172.21.15.19:0/1053594881 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55feb02885d0 0x55feb0305e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.783+0000 7fcff081c740 1 -- 172.21.15.19:0/1053594881 >> 172.21.15.19:0/1053594881 conn(0x55feb0251310 msgr2=0x55feb0283b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:49.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.783+0000 7fcfc77fe640 0 client.18387 ms_handle_reset on v2:172.21.15.203:6836/3684671619 2024-09-19T09:03:49.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.783+0000 7fcff081c740 1 -- 172.21.15.19:0/1053594881 shutdown_connections 2024-09-19T09:03:49.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.783+0000 7fcff081c740 1 -- 172.21.15.19:0/1053594881 wait complete. 2024-09-19T09:03:49.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.783+0000 7fcff081c740 20 client.18387 trim_cache size 0 max 16384 2024-09-19T09:03:49.792 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:03:49.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.784+0000 7fcfee443640 1 -- 172.21.15.19:0/3746760069 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fcfd00a3240 msgr2=0x7fcfd00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:49.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.784+0000 7fcfee443640 1 --2- 172.21.15.19:0/3746760069 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fcfd00a3240 0x7fcfd00a5700 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fcfe000a2c0 tx=0x7fcfe0004ab0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.784+0000 7fcfee443640 1 -- 172.21.15.19:0/3746760069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfe8102d30 msgr2=0x7fcfe81985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:49.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.784+0000 7fcfee443640 1 --2- 172.21.15.19:0/3746760069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfe8102d30 0x7fcfe81985c0 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8009230 tx=0x7fcfd8004270 comp rx=0 tx=0).stop 2024-09-19T09:03:49.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.784+0000 7fcfee443640 1 -- 172.21.15.19:0/3746760069 shutdown_connections 2024-09-19T09:03:49.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.784+0000 7fcfee443640 1 --2- 172.21.15.19:0/3746760069 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fcfd00a3240 0x7fcfd00a5700 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.784+0000 7fcfee443640 1 --2- 172.21.15.19:0/3746760069 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fcfe81082a0 0x7fcfe819ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.784+0000 7fcfee443640 1 --2- 172.21.15.19:0/3746760069 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fcfe81036e0 0x7fcfe8198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.784+0000 7fcfee443640 1 --2- 172.21.15.19:0/3746760069 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fcfe8102d30 0x7fcfe81985c0 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:49.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.784+0000 7fcfee443640 1 -- 172.21.15.19:0/3746760069 >> 172.21.15.19:0/3746760069 conn(0x7fcfe80fc7d0 msgr2=0x7fcfe8105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:49.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.784+0000 7fcfee443640 1 -- 172.21.15.19:0/3746760069 shutdown_connections 2024-09-19T09:03:49.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:49.784+0000 7fcfee443640 1 -- 172.21.15.19:0/3746760069 wait complete. 2024-09-19T09:03:50.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:49 smithi019 ceph-mon[30976]: pgmap v687: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.4 KiB/s wr, 14 op/s 2024-09-19T09:03:50.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:49 smithi155 ceph-mon[34921]: pgmap v687: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.4 KiB/s wr, 14 op/s 2024-09-19T09:03:50.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:49 smithi203 ceph-mon[35450]: pgmap v687: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.4 KiB/s wr, 14 op/s 2024-09-19T09:03:50.551 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:03:50.828 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:51.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:50 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:03:51.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:50 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:03:51.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:50 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:03:51.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:50 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:03:51.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:50 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:03:51.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:50 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:03:51.248 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:50 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:03:51.249 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:50 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:03:51.249 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:50 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:03:51.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.335+0000 7fbde01b5640 1 -- 172.21.15.19:0/1960070793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd8100e20 msgr2=0x7fbdd8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:51.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.335+0000 7fbde01b5640 1 --2- 172.21.15.19:0/1960070793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd8100e20 0x7fbdd8101200 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4009900 tx=0x7fbdd402a480 comp rx=0 tx=0).stop 2024-09-19T09:03:51.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.335+0000 7fbde01b5640 1 -- 172.21.15.19:0/1960070793 shutdown_connections 2024-09-19T09:03:51.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.335+0000 7fbde01b5640 1 --2- 172.21.15.19:0/1960070793 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbdd8102570 0x7fbdd81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.335+0000 7fbde01b5640 1 --2- 172.21.15.19:0/1960070793 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbdd8102ef0 0x7fbdd810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.335+0000 7fbde01b5640 1 --2- 172.21.15.19:0/1960070793 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd8100e20 0x7fbdd8101200 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.335+0000 7fbde01b5640 1 -- 172.21.15.19:0/1960070793 >> 172.21.15.19:0/1960070793 conn(0x7fbdd80fc7d0 msgr2=0x7fbdd80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:51.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.335+0000 7fbde01b5640 1 -- 172.21.15.19:0/1960070793 shutdown_connections 2024-09-19T09:03:51.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.335+0000 7fbde01b5640 1 -- 172.21.15.19:0/1960070793 wait complete. 2024-09-19T09:03:51.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.336+0000 7fbde01b5640 1 Processor -- start 2024-09-19T09:03:51.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.336+0000 7fbde01b5640 1 -- start start 2024-09-19T09:03:51.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.336+0000 7fbde01b5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd8100e20 0x7fbdd8199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:51.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.336+0000 7fbde01b5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbdd8102570 0x7fbdd8199880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:51.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.336+0000 7fbde01b5640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbdd8102ef0 0x7fbdd81a43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:51.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.336+0000 7fbde01b5640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd8110f80 con 0x7fbdd8100e20 2024-09-19T09:03:51.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.336+0000 7fbde01b5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd8110e00 con 0x7fbdd8102570 2024-09-19T09:03:51.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.336+0000 7fbde01b5640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd8111100 con 0x7fbdd8102ef0 2024-09-19T09:03:51.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.336+0000 7fbdddf51640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd8100e20 0x7fbdd8199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:51.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.336+0000 7fbdddf51640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd8100e20 0x7fbdd8199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35548/0 (socket says 172.21.15.19:35548) 2024-09-19T09:03:51.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.336+0000 7fbdddf51640 1 -- 172.21.15.19:0/3727515031 learned_addr learned my addr 172.21.15.19:0/3727515031 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:51.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.336+0000 7fbddd750640 1 --2- 172.21.15.19:0/3727515031 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbdd8102570 0x7fbdd8199880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:51.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.336+0000 7fbdde752640 1 --2- 172.21.15.19:0/3727515031 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbdd8102ef0 0x7fbdd81a43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:51.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.337+0000 7fbddd750640 1 -- 172.21.15.19:0/3727515031 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbdd8102ef0 msgr2=0x7fbdd81a43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:51.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.337+0000 7fbddd750640 1 --2- 172.21.15.19:0/3727515031 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbdd8102ef0 0x7fbdd81a43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.337+0000 7fbddd750640 1 -- 172.21.15.19:0/3727515031 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd8100e20 msgr2=0x7fbdd8199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:51.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.337+0000 7fbddd750640 1 --2- 172.21.15.19:0/3727515031 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd8100e20 0x7fbdd8199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.337+0000 7fbddd750640 1 -- 172.21.15.19:0/3727515031 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd81a4900 con 0x7fbdd8102570 2024-09-19T09:03:51.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.337+0000 7fbdddf51640 1 --2- 172.21.15.19:0/3727515031 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd8100e20 0x7fbdd8199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:51.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.337+0000 7fbddd750640 1 --2- 172.21.15.19:0/3727515031 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbdd8102570 0x7fbdd8199880 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800e9f0 tx=0x7fbdc800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:51.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.337+0000 7fbdceffd640 1 -- 172.21.15.19:0/3727515031 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc800ccc0 con 0x7fbdd8102570 2024-09-19T09:03:51.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.337+0000 7fbdceffd640 1 -- 172.21.15.19:0/3727515031 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbdc8005020 con 0x7fbdd8102570 2024-09-19T09:03:51.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.337+0000 7fbde01b5640 1 -- 172.21.15.19:0/3727515031 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdd81a4ad0 con 0x7fbdd8102570 2024-09-19T09:03:51.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.337+0000 7fbdceffd640 1 -- 172.21.15.19:0/3727515031 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc80049e0 con 0x7fbdd8102570 2024-09-19T09:03:51.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.337+0000 7fbde01b5640 1 -- 172.21.15.19:0/3727515031 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdd81a4fc0 con 0x7fbdd8102570 2024-09-19T09:03:51.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.340+0000 7fbdceffd640 1 -- 172.21.15.19:0/3727515031 <== mon.2 v2:172.21.15.155:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fbdc8005560 con 0x7fbdd8102570 2024-09-19T09:03:51.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.340+0000 7fbde258e740 1 Processor -- start 2024-09-19T09:03:51.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.340+0000 7fbde258e740 1 -- start start 2024-09-19T09:03:51.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.340+0000 7fbde258e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b3aceffb40 0x55b3acefe090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:51.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.340+0000 7fbde258e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b3acefe5d0 0x55b3acefea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:51.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.340+0000 7fbde258e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3acf0d780 0x55b3acf0fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:51.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.340+0000 7fbde258e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b3ace642f0 con 0x55b3acf0d780 2024-09-19T09:03:51.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.340+0000 7fbde258e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b3ace0bcf0 con 0x55b3aceffb40 2024-09-19T09:03:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.340+0000 7fbde258e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b3ace602b0 con 0x55b3acefe5d0 2024-09-19T09:03:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.340+0000 7fbddd750640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3acf0d780 0x55b3acf0fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.341+0000 7fbdddf51640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b3acefe5d0 0x55b3acefea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.341+0000 7fbdddf51640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b3acefe5d0 0x55b3acefea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:42730/0 (socket says 172.21.15.19:42730) 2024-09-19T09:03:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.341+0000 7fbdddf51640 1 -- 172.21.15.19:0/967559307 learned_addr learned my addr 172.21.15.19:0/967559307 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.341+0000 7fbdde752640 1 --2- 172.21.15.19:0/967559307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b3aceffb40 0x55b3acefe090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.341+0000 7fbdceffd640 1 --2- 172.21.15.19:0/3727515031 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbdc40a3240 0x7fbdc40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.341+0000 7fbdddf51640 1 -- 172.21.15.19:0/967559307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b3aceffb40 msgr2=0x55b3acefe090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.341+0000 7fbdddf51640 1 --2- 172.21.15.19:0/967559307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b3aceffb40 0x55b3acefe090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.341+0000 7fbdddf51640 1 -- 172.21.15.19:0/967559307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3acf0d780 msgr2=0x55b3acf0fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.341+0000 7fbdddf51640 1 --2- 172.21.15.19:0/967559307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3acf0d780 0x55b3acf0fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.341+0000 7fbdddf51640 1 -- 172.21.15.19:0/967559307 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3acdf03a0 con 0x55b3acefe5d0 2024-09-19T09:03:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.341+0000 7fbdde752640 1 --2- 172.21.15.19:0/3727515031 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbdc40a3240 0x7fbdc40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:51.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.341+0000 7fbdceffd640 1 -- 172.21.15.19:0/3727515031 <== mon.2 v2:172.21.15.155:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7fbdc80cf880 con 0x7fbdd8102570 2024-09-19T09:03:51.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.341+0000 7fbdddf51640 1 --2- 172.21.15.19:0/967559307 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b3acefe5d0 0x55b3acefea10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4009a20 tx=0x7fbdd4005e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2b5e8607e81f605 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:51.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.341+0000 7fbdc3fff640 1 -- 172.21.15.19:0/967559307 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd4040070 con 0x55b3acefe5d0 2024-09-19T09:03:51.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.341+0000 7fbdc3fff640 1 -- 172.21.15.19:0/967559307 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbdd4003cd0 con 0x55b3acefe5d0 2024-09-19T09:03:51.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.341+0000 7fbdc3fff640 1 -- 172.21.15.19:0/967559307 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd4035040 con 0x55b3acefe5d0 2024-09-19T09:03:51.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.342+0000 7fbde258e740 1 -- 172.21.15.19:0/967559307 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b3acefe5d0 msgr2=0x55b3acefea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:51.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.342+0000 7fbdde752640 1 --2- 172.21.15.19:0/3727515031 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbdc40a3240 0x7fbdc40a5700 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0005c40 tx=0x7fbdd0004a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:51.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.342+0000 7fbde258e740 1 --2- 172.21.15.19:0/967559307 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b3acefe5d0 0x55b3acefea10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4009a20 tx=0x7fbdd4005e80 comp rx=0 tx=0).stop 2024-09-19T09:03:51.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.342+0000 7fbde258e740 1 -- 172.21.15.19:0/967559307 shutdown_connections 2024-09-19T09:03:51.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.342+0000 7fbde258e740 1 --2- 172.21.15.19:0/967559307 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b3acefe5d0 0x55b3acefea10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.342+0000 7fbde258e740 1 --2- 172.21.15.19:0/967559307 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3acf0d780 0x55b3acf0fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.342+0000 7fbde258e740 1 --2- 172.21.15.19:0/967559307 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b3aceffb40 0x55b3acefe090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.342+0000 7fbde258e740 1 -- 172.21.15.19:0/967559307 >> 172.21.15.19:0/967559307 conn(0x55b3acec7310 msgr2=0x55b3acefac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:51.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.342+0000 7fbde258e740 1 -- 172.21.15.19:0/967559307 shutdown_connections 2024-09-19T09:03:51.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.342+0000 7fbde258e740 1 -- 172.21.15.19:0/967559307 wait complete. 2024-09-19T09:03:51.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.343+0000 7fbde258e740 1 -- start start 2024-09-19T09:03:51.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.343+0000 7fbde258e740 1 Processor -- start 2024-09-19T09:03:51.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.343+0000 7fbde258e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3acefe5d0 0x55b3acf0d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:51.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.343+0000 7fbde258e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b3aceffb40 0x55b3acf0a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:51.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.343+0000 7fbde258e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b3acf0d780 0x55b3acf0aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:51.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.343+0000 7fbde258e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55b3acf10420 con 0x55b3acefe5d0 2024-09-19T09:03:51.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.343+0000 7fbde258e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55b3ace1f060 con 0x55b3aceffb40 2024-09-19T09:03:51.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.343+0000 7fbde258e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b3acf105a0 con 0x55b3acf0d780 2024-09-19T09:03:51.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.343+0000 7fbde258e740 10 client.0 _ll_register_callbacks cb 0x55b3acb728c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:51.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.343+0000 7fbdddf51640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3acefe5d0 0x55b3acf0d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:51.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.343+0000 7fbdddf51640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3acefe5d0 0x55b3acf0d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35570/0 (socket says 172.21.15.19:35570) 2024-09-19T09:03:51.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.343+0000 7fbdddf51640 1 -- 172.21.15.19:0/770918161 learned_addr learned my addr 172.21.15.19:0/770918161 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:51.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.343+0000 7fbddd750640 1 --2- 172.21.15.19:0/770918161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b3aceffb40 0x55b3acf0a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:51.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.343+0000 7fbdde752640 1 --2- 172.21.15.19:0/770918161 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b3acf0d780 0x55b3acf0aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:51.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.344+0000 7fbdddf51640 1 -- 172.21.15.19:0/770918161 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b3acf0d780 msgr2=0x55b3acf0aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:51.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.344+0000 7fbdddf51640 1 --2- 172.21.15.19:0/770918161 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b3acf0d780 0x55b3acf0aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.344+0000 7fbdddf51640 1 -- 172.21.15.19:0/770918161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b3aceffb40 msgr2=0x55b3acf0a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:51.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.344+0000 7fbdddf51640 1 --2- 172.21.15.19:0/770918161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b3aceffb40 0x55b3acf0a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.344+0000 7fbdddf51640 1 -- 172.21.15.19:0/770918161 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3acbd53c0 con 0x55b3acefe5d0 2024-09-19T09:03:51.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.344+0000 7fbddd750640 1 --2- 172.21.15.19:0/770918161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b3aceffb40 0x55b3acf0a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:03:51.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.344+0000 7fbdddf51640 1 --2- 172.21.15.19:0/770918161 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3acefe5d0 0x55b3acf0d170 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4005770 tx=0x7fbdd40317f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c08811ca4872d85e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:51.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.344+0000 7fbdc17fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:51.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.344+0000 7fbdc17fa640 1 -- 172.21.15.19:0/770918161 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd404c020 con 0x55b3acefe5d0 2024-09-19T09:03:51.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.344+0000 7fbdc17fa640 1 -- 172.21.15.19:0/770918161 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7fbdd40035f0 con 0x55b3acefe5d0 2024-09-19T09:03:51.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.344+0000 7fbde258e740 1 -- 172.21.15.19:0/770918161 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbdd4003cd0 con 0x55b3acefe5d0 2024-09-19T09:03:51.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.344+0000 7fbdc17fa640 1 -- 172.21.15.19:0/770918161 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fbdd4035070 con 0x55b3acefe5d0 2024-09-19T09:03:51.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.344+0000 7fbde258e740 10 client.18399 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:51.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.344+0000 7fbde258e740 1 -- 172.21.15.19:0/770918161 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55b3acf1bec0 con 0x55b3acefe5d0 2024-09-19T09:03:51.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.344+0000 7fbdc17fa640 1 -- 172.21.15.19:0/770918161 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbdd4003cd0 con 0x55b3acefe5d0 2024-09-19T09:03:51.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.345+0000 7fbdc17fa640 1 -- 172.21.15.19:0/770918161 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7fbdd4045ad0 con 0x55b3acefe5d0 2024-09-19T09:03:51.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.345+0000 7fbde258e740 10 client.18399 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:51.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.345+0000 7fbde258e740 10 client.18399 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:03:51.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.345+0000 7fbde258e740 20 client.18399 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:51.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.345+0000 7fbde258e740 1 --2- 172.21.15.19:0/770918161 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55b3acf1d210 0x55b3acf1f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:51.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.345+0000 7fbde258e740 4 client.18399 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:51.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.345+0000 7fbde258e740 1 -- 172.21.15.19:0/770918161 --> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b3ace71860 con 0x55b3acf1d210 2024-09-19T09:03:51.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.345+0000 7fbddd750640 1 --2- 172.21.15.19:0/770918161 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55b3acf1d210 0x55b3acf1f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:51.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.345+0000 7fbddd750640 1 --2- 172.21.15.19:0/770918161 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55b3acf1d210 0x55b3acf1f600 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ede3523216c91e9a server_cookie=293acfb283490eb0 in_seq=0 out_seq=0 2024-09-19T09:03:51.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.345+0000 7fbdc17fa640 10 client.18399 ms_handle_connect on v2:172.21.15.203:6838/2547507299 2024-09-19T09:03:51.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.346+0000 7fbdc17fa640 1 -- 172.21.15.19:0/770918161 <== mds.1 v2:172.21.15.203:6838/2547507299 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b3ace71860 con 0x55b3acf1d210 2024-09-19T09:03:51.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.346+0000 7fbdc17fa640 10 client.18399 handle_command_reply: tid=0 2024-09-19T09:03:51.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.346+0000 7fbde258e740 1 client.18399 shutdown 2024-09-19T09:03:51.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.346+0000 7fbde258e740 1 -- 172.21.15.19:0/770918161 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3acefe5d0 msgr2=0x55b3acf0d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:51.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.346+0000 7fbde258e740 1 --2- 172.21.15.19:0/770918161 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3acefe5d0 0x55b3acf0d170 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4005770 tx=0x7fbdd40317f0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.346+0000 7fbde258e740 1 -- 172.21.15.19:0/770918161 shutdown_connections 2024-09-19T09:03:51.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.346+0000 7fbde258e740 1 --2- 172.21.15.19:0/770918161 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55b3acf1d210 0x55b3acf1f600 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.346+0000 7fbde258e740 1 --2- 172.21.15.19:0/770918161 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b3acf0d780 0x55b3acf0aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.346+0000 7fbde258e740 1 --2- 172.21.15.19:0/770918161 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b3aceffb40 0x55b3acf0a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.346+0000 7fbde258e740 1 --2- 172.21.15.19:0/770918161 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3acefe5d0 0x55b3acf0d170 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.346+0000 7fbdc17fa640 0 client.18399 ms_handle_reset on v2:172.21.15.203:6838/2547507299 2024-09-19T09:03:51.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.346+0000 7fbde258e740 1 -- 172.21.15.19:0/770918161 >> 172.21.15.19:0/770918161 conn(0x55b3acec7310 msgr2=0x55b3acf00960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:51.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.346+0000 7fbde258e740 1 -- 172.21.15.19:0/770918161 shutdown_connections 2024-09-19T09:03:51.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.346+0000 7fbde258e740 1 -- 172.21.15.19:0/770918161 wait complete. 2024-09-19T09:03:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.347+0000 7fbde258e740 20 client.18399 trim_cache size 0 max 16384 2024-09-19T09:03:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.359+0000 7fbde258e740 1 Processor -- start 2024-09-19T09:03:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.360+0000 7fbde258e740 1 -- start start 2024-09-19T09:03:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.360+0000 7fbde258e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b3acefe5d0 0x55b3acf22620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.360+0000 7fbde258e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3aceffb40 0x55b3acf22b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.360+0000 7fbde258e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b3acf0d780 0x55b3acf076a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.360+0000 7fbde258e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd81ab360 con 0x55b3aceffb40 2024-09-19T09:03:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.360+0000 7fbde258e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd81acea0 con 0x55b3acf0d780 2024-09-19T09:03:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.360+0000 7fbde258e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd81aba30 con 0x55b3acefe5d0 2024-09-19T09:03:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.360+0000 7fbddd750640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3aceffb40 0x55b3acf22b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.360+0000 7fbddd750640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3aceffb40 0x55b3acf22b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35582/0 (socket says 172.21.15.19:35582) 2024-09-19T09:03:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.360+0000 7fbddd750640 1 -- 172.21.15.19:0/3447867278 learned_addr learned my addr 172.21.15.19:0/3447867278 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:51.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.360+0000 7fbdddf51640 1 --2- 172.21.15.19:0/3447867278 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b3acefe5d0 0x55b3acf22620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:51.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.360+0000 7fbdde752640 1 --2- 172.21.15.19:0/3447867278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b3acf0d780 0x55b3acf076a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:51.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.360+0000 7fbddd750640 1 -- 172.21.15.19:0/3447867278 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b3acefe5d0 msgr2=0x55b3acf22620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:51.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.360+0000 7fbddd750640 1 --2- 172.21.15.19:0/3447867278 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b3acefe5d0 0x55b3acf22620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.360+0000 7fbddd750640 1 -- 172.21.15.19:0/3447867278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b3acf0d780 msgr2=0x55b3acf076a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:51.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.360+0000 7fbddd750640 1 --2- 172.21.15.19:0/3447867278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b3acf0d780 0x55b3acf076a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.360+0000 7fbddd750640 1 -- 172.21.15.19:0/3447867278 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b3acefb960 con 0x55b3aceffb40 2024-09-19T09:03:51.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.360+0000 7fbddd750640 1 --2- 172.21.15.19:0/3447867278 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3aceffb40 0x55b3acf22b60 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fbdc809bbb0 tx=0x7fbdc80d5550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20fef59a016171a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:51.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.360+0000 7fbdc37fe640 1 -- 172.21.15.19:0/3447867278 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc801c040 con 0x55b3aceffb40 2024-09-19T09:03:51.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.361+0000 7fbdc37fe640 1 -- 172.21.15.19:0/3447867278 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbdc80051d0 con 0x55b3aceffb40 2024-09-19T09:03:51.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.361+0000 7fbdc37fe640 1 -- 172.21.15.19:0/3447867278 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc80a4b20 con 0x55b3aceffb40 2024-09-19T09:03:51.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.361+0000 7fbde258e740 1 -- 172.21.15.19:0/3447867278 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3aceffb40 msgr2=0x55b3acf22b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:51.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.361+0000 7fbde258e740 1 --2- 172.21.15.19:0/3447867278 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3aceffb40 0x55b3acf22b60 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fbdc809bbb0 tx=0x7fbdc80d5550 comp rx=0 tx=0).stop 2024-09-19T09:03:51.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.361+0000 7fbde258e740 1 -- 172.21.15.19:0/3447867278 shutdown_connections 2024-09-19T09:03:51.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.361+0000 7fbde258e740 1 --2- 172.21.15.19:0/3447867278 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b3acf0d780 0x55b3acf076a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.361+0000 7fbde258e740 1 --2- 172.21.15.19:0/3447867278 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3aceffb40 0x55b3acf22b60 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.361+0000 7fbde258e740 1 --2- 172.21.15.19:0/3447867278 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b3acefe5d0 0x55b3acf22620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.361+0000 7fbde258e740 1 -- 172.21.15.19:0/3447867278 >> 172.21.15.19:0/3447867278 conn(0x55b3acec7310 msgr2=0x55b3acef5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:51.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.361+0000 7fbde258e740 1 -- 172.21.15.19:0/3447867278 shutdown_connections 2024-09-19T09:03:51.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.361+0000 7fbde258e740 1 -- 172.21.15.19:0/3447867278 wait complete. 2024-09-19T09:03:51.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.362+0000 7fbde258e740 1 -- start start 2024-09-19T09:03:51.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.362+0000 7fbde258e740 1 Processor -- start 2024-09-19T09:03:51.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.362+0000 7fbde258e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b3acefe5d0 0x55b3acf1fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:51.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.362+0000 7fbde258e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3aceffb40 0x55b3acf200e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:51.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.362+0000 7fbde258e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b3acf0d780 0x55b3acf85b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:51.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.362+0000 7fbde258e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd81ac7d0 con 0x55b3aceffb40 2024-09-19T09:03:51.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.362+0000 7fbde258e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd81ac100 con 0x55b3acf0d780 2024-09-19T09:03:51.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.362+0000 7fbde258e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd81a9340 con 0x55b3acefe5d0 2024-09-19T09:03:51.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.362+0000 7fbde258e740 10 client.0 _ll_register_callbacks cb 0x7fbdc80d5420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:51.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.362+0000 7fbddd750640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3aceffb40 0x55b3acf200e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:51.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.362+0000 7fbddd750640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3aceffb40 0x55b3acf200e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35594/0 (socket says 172.21.15.19:35594) 2024-09-19T09:03:51.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.362+0000 7fbddd750640 1 -- 172.21.15.19:0/3031470235 learned_addr learned my addr 172.21.15.19:0/3031470235 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:51.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.362+0000 7fbdddf51640 1 --2- 172.21.15.19:0/3031470235 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b3acefe5d0 0x55b3acf1fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:51.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.362+0000 7fbdde752640 1 --2- 172.21.15.19:0/3031470235 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b3acf0d780 0x55b3acf85b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:51.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.362+0000 7fbddd750640 1 -- 172.21.15.19:0/3031470235 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b3acefe5d0 msgr2=0x55b3acf1fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:51.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.362+0000 7fbddd750640 1 --2- 172.21.15.19:0/3031470235 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b3acefe5d0 0x55b3acf1fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.363+0000 7fbddd750640 1 -- 172.21.15.19:0/3031470235 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b3acf0d780 msgr2=0x55b3acf85b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:51.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.363+0000 7fbddd750640 1 --2- 172.21.15.19:0/3031470235 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b3acf0d780 0x55b3acf85b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.363+0000 7fbddd750640 1 -- 172.21.15.19:0/3031470235 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b3acf86080 con 0x55b3aceffb40 2024-09-19T09:03:51.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.363+0000 7fbddd750640 1 --2- 172.21.15.19:0/3031470235 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3aceffb40 0x55b3acf200e0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fbdc809be40 tx=0x7fbdc8005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2131692a6119897c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:51.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.363+0000 7fbdc17fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:51.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.363+0000 7fbdc17fa640 1 -- 172.21.15.19:0/3031470235 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc801c070 con 0x55b3aceffb40 2024-09-19T09:03:51.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.363+0000 7fbdc17fa640 1 -- 172.21.15.19:0/3031470235 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7fbdc809a1b0 con 0x55b3aceffb40 2024-09-19T09:03:51.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.363+0000 7fbde258e740 1 -- 172.21.15.19:0/3031470235 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbdc80051d0 con 0x55b3aceffb40 2024-09-19T09:03:51.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.363+0000 7fbdc17fa640 1 -- 172.21.15.19:0/3031470235 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fbdc80b9030 con 0x55b3aceffb40 2024-09-19T09:03:51.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.363+0000 7fbde258e740 10 client.18405 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:51.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.363+0000 7fbde258e740 1 -- 172.21.15.19:0/3031470235 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55b3acf87320 con 0x55b3aceffb40 2024-09-19T09:03:51.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.363+0000 7fbdc17fa640 1 -- 172.21.15.19:0/3031470235 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbdc80051d0 con 0x55b3aceffb40 2024-09-19T09:03:51.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.363+0000 7fbdc17fa640 1 -- 172.21.15.19:0/3031470235 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7fbdc80a4690 con 0x55b3aceffb40 2024-09-19T09:03:51.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.363+0000 7fbde258e740 10 client.18405 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:51.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.363+0000 7fbde258e740 10 client.18405 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:03:51.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.363+0000 7fbde258e740 20 client.18405 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:51.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.363+0000 7fbde258e740 1 --2- 172.21.15.19:0/3031470235 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55b3acf87a10 0x55b3acf89e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:51.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.363+0000 7fbde258e740 4 client.18405 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:03:51.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.363+0000 7fbde258e740 1 -- 172.21.15.19:0/3031470235 --> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b3ace6bd70 con 0x55b3acf87a10 2024-09-19T09:03:51.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.364+0000 7fbdddf51640 1 --2- 172.21.15.19:0/3031470235 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55b3acf87a10 0x55b3acf89e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:51.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.364+0000 7fbdc17fa640 10 client.18405 ms_handle_connect on v2:172.21.15.203:6838/2547507299 2024-09-19T09:03:51.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.364+0000 7fbdddf51640 1 --2- 172.21.15.19:0/3031470235 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55b3acf87a10 0x55b3acf89e30 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1327df8cf0ec1b0f server_cookie=1ede6eaf3ef02e8c in_seq=0 out_seq=0 2024-09-19T09:03:51.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.364+0000 7fbdc17fa640 1 -- 172.21.15.19:0/3031470235 <== mds.1 v2:172.21.15.203:6838/2547507299 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b3ace6bd70 con 0x55b3acf87a10 2024-09-19T09:03:51.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.364+0000 7fbdc17fa640 10 client.18405 handle_command_reply: tid=0 2024-09-19T09:03:51.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.364+0000 7fbde258e740 1 client.18405 shutdown 2024-09-19T09:03:51.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.364+0000 7fbde258e740 1 -- 172.21.15.19:0/3031470235 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3aceffb40 msgr2=0x55b3acf200e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:51.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.364+0000 7fbde258e740 1 --2- 172.21.15.19:0/3031470235 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3aceffb40 0x55b3acf200e0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fbdc809be40 tx=0x7fbdc8005c50 comp rx=0 tx=0).stop 2024-09-19T09:03:51.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.364+0000 7fbde258e740 1 -- 172.21.15.19:0/3031470235 shutdown_connections 2024-09-19T09:03:51.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.364+0000 7fbde258e740 1 --2- 172.21.15.19:0/3031470235 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55b3acf87a10 0x55b3acf89e30 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.364+0000 7fbde258e740 1 --2- 172.21.15.19:0/3031470235 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55b3acf0d780 0x55b3acf85b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.364+0000 7fbde258e740 1 --2- 172.21.15.19:0/3031470235 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55b3aceffb40 0x55b3acf200e0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.364+0000 7fbdc17fa640 0 client.18405 ms_handle_reset on v2:172.21.15.203:6838/2547507299 2024-09-19T09:03:51.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.364+0000 7fbde258e740 1 --2- 172.21.15.19:0/3031470235 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b3acefe5d0 0x55b3acf1fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.365+0000 7fbde258e740 1 -- 172.21.15.19:0/3031470235 >> 172.21.15.19:0/3031470235 conn(0x55b3acec7310 msgr2=0x55b3acf08cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:51.383 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:03:51.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.365+0000 7fbde258e740 1 -- 172.21.15.19:0/3031470235 shutdown_connections 2024-09-19T09:03:51.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.365+0000 7fbde258e740 1 -- 172.21.15.19:0/3031470235 wait complete. 2024-09-19T09:03:51.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.365+0000 7fbde258e740 20 client.18405 trim_cache size 0 max 16384 2024-09-19T09:03:51.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.365+0000 7fbde01b5640 1 -- 172.21.15.19:0/3727515031 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbdc40a3240 msgr2=0x7fbdc40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:51.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.365+0000 7fbde01b5640 1 --2- 172.21.15.19:0/3727515031 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbdc40a3240 0x7fbdc40a5700 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0005c40 tx=0x7fbdd0004a40 comp rx=0 tx=0).stop 2024-09-19T09:03:51.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.365+0000 7fbde01b5640 1 -- 172.21.15.19:0/3727515031 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbdd8102570 msgr2=0x7fbdd8199880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:51.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.365+0000 7fbde01b5640 1 --2- 172.21.15.19:0/3727515031 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbdd8102570 0x7fbdd8199880 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbdc800e9f0 tx=0x7fbdc800eeb0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.365+0000 7fbde01b5640 1 -- 172.21.15.19:0/3727515031 shutdown_connections 2024-09-19T09:03:51.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.365+0000 7fbde01b5640 1 --2- 172.21.15.19:0/3727515031 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbdc40a3240 0x7fbdc40a5700 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.365+0000 7fbde01b5640 1 --2- 172.21.15.19:0/3727515031 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbdd8102ef0 0x7fbdd81a43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.365+0000 7fbde01b5640 1 --2- 172.21.15.19:0/3727515031 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbdd8102570 0x7fbdd8199880 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.365+0000 7fbde01b5640 1 --2- 172.21.15.19:0/3727515031 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdd8100e20 0x7fbdd8199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:51.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.365+0000 7fbde01b5640 1 -- 172.21.15.19:0/3727515031 >> 172.21.15.19:0/3727515031 conn(0x7fbdd80fc7d0 msgr2=0x7fbdd80fe140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:51.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.365+0000 7fbde01b5640 1 -- 172.21.15.19:0/3727515031 shutdown_connections 2024-09-19T09:03:51.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:51.365+0000 7fbde01b5640 1 -- 172.21.15.19:0/3727515031 wait complete. 2024-09-19T09:03:52.059 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:03:52.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:51 smithi155 ceph-mon[34921]: pgmap v688: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.4 KiB/s wr, 15 op/s 2024-09-19T09:03:52.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:51 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:03:52.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:51 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:03:52.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:51 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:03:52.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:51 smithi203 ceph-mon[35450]: pgmap v688: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.4 KiB/s wr, 15 op/s 2024-09-19T09:03:52.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:51 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:03:52.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:51 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:03:52.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:51 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:03:52.315 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:52.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:51 smithi019 ceph-mon[30976]: pgmap v688: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.4 KiB/s wr, 15 op/s 2024-09-19T09:03:52.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:51 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:03:52.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:51 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:03:52.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:51 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:03:52.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.819+0000 7f379dcab640 1 -- 172.21.15.19:0/3306949749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3798100e20 msgr2=0x7f3798101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:52.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.819+0000 7f379dcab640 1 --2- 172.21.15.19:0/3306949749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3798100e20 0x7f3798101200 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f3788009ca0 tx=0x7f378802a950 comp rx=0 tx=0).stop 2024-09-19T09:03:52.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.819+0000 7f379dcab640 1 -- 172.21.15.19:0/3306949749 shutdown_connections 2024-09-19T09:03:52.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.819+0000 7f379dcab640 1 --2- 172.21.15.19:0/3306949749 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3798102570 0x7f37981029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:52.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.819+0000 7f379dcab640 1 --2- 172.21.15.19:0/3306949749 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3798102ef0 0x7f379810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:52.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.819+0000 7f379dcab640 1 --2- 172.21.15.19:0/3306949749 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3798100e20 0x7f3798101200 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:52.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.819+0000 7f379dcab640 1 -- 172.21.15.19:0/3306949749 >> 172.21.15.19:0/3306949749 conn(0x7f37980fc7d0 msgr2=0x7f37980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:52.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.819+0000 7f379dcab640 1 -- 172.21.15.19:0/3306949749 shutdown_connections 2024-09-19T09:03:52.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.819+0000 7f379dcab640 1 -- 172.21.15.19:0/3306949749 wait complete. 2024-09-19T09:03:52.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.819+0000 7f379dcab640 1 Processor -- start 2024-09-19T09:03:52.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.819+0000 7f379dcab640 1 -- start start 2024-09-19T09:03:52.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.820+0000 7f379dcab640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3798100e20 0x7f3798198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:52.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.820+0000 7f379dcab640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3798102570 0x7f3798198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:52.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.820+0000 7f379dcab640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3798102ef0 0x7f379819ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:52.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.820+0000 7f379dcab640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f37981120d0 con 0x7f3798102ef0 2024-09-19T09:03:52.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.820+0000 7f379dcab640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3798111f50 con 0x7f3798102570 2024-09-19T09:03:52.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.820+0000 7f379dcab640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3798112250 con 0x7f3798100e20 2024-09-19T09:03:52.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.820+0000 7f3797fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3798102ef0 0x7f379819ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:52.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.820+0000 7f3797fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3798102ef0 0x7f379819ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35612/0 (socket says 172.21.15.19:35612) 2024-09-19T09:03:52.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.820+0000 7f3797fff640 1 -- 172.21.15.19:0/663815743 learned_addr learned my addr 172.21.15.19:0/663815743 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:52.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.820+0000 7f37977fe640 1 --2- 172.21.15.19:0/663815743 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3798100e20 0x7f3798198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:52.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.820+0000 7f3796ffd640 1 --2- 172.21.15.19:0/663815743 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3798102570 0x7f3798198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:52.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.820+0000 7f3797fff640 1 -- 172.21.15.19:0/663815743 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3798100e20 msgr2=0x7f3798198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:52.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.820+0000 7f3797fff640 1 --2- 172.21.15.19:0/663815743 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3798100e20 0x7f3798198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:52.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.820+0000 7f3797fff640 1 -- 172.21.15.19:0/663815743 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3798102570 msgr2=0x7f3798198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:52.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.820+0000 7f3797fff640 1 --2- 172.21.15.19:0/663815743 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3798102570 0x7f3798198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:52.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.820+0000 7f3797fff640 1 -- 172.21.15.19:0/663815743 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f379819d4e0 con 0x7f3798102ef0 2024-09-19T09:03:52.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.820+0000 7f37977fe640 1 --2- 172.21.15.19:0/663815743 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3798100e20 0x7f3798198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:52.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.820+0000 7f3796ffd640 1 --2- 172.21.15.19:0/663815743 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3798102570 0x7f3798198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:52.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.820+0000 7f3797fff640 1 --2- 172.21.15.19:0/663815743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3798102ef0 0x7f379819ce00 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f379000d750 tx=0x7f379000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:52.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.821+0000 7f3794ff9640 1 -- 172.21.15.19:0/663815743 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3790017070 con 0x7f3798102ef0 2024-09-19T09:03:52.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.821+0000 7f379dcab640 1 -- 172.21.15.19:0/663815743 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f379819d7d0 con 0x7f3798102ef0 2024-09-19T09:03:52.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.821+0000 7f3794ff9640 1 -- 172.21.15.19:0/663815743 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3790005500 con 0x7f3798102ef0 2024-09-19T09:03:52.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.821+0000 7f3794ff9640 1 -- 172.21.15.19:0/663815743 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3790004d90 con 0x7f3798102ef0 2024-09-19T09:03:52.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.821+0000 7f379dcab640 1 -- 172.21.15.19:0/663815743 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37981a50b0 con 0x7f3798102ef0 2024-09-19T09:03:52.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.823+0000 7f3794ff9640 1 -- 172.21.15.19:0/663815743 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f3790004f30 con 0x7f3798102ef0 2024-09-19T09:03:52.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.823+0000 7f37a0084740 1 Processor -- start 2024-09-19T09:03:52.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.823+0000 7f37a0084740 1 -- start start 2024-09-19T09:03:52.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.823+0000 7f37a0084740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56468cc55b40 0x56468cc54090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:52.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.823+0000 7f37a0084740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56468cc545d0 0x56468cc54a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:52.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.823+0000 7f37a0084740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56468cc5f370 0x56468cc61760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:52.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.823+0000 7f37a0084740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56468cbba2f0 con 0x56468cc545d0 2024-09-19T09:03:52.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.823+0000 7f37a0084740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56468cb61cf0 con 0x56468cc5f370 2024-09-19T09:03:52.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.823+0000 7f37a0084740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56468cbb62b0 con 0x56468cc55b40 2024-09-19T09:03:52.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.824+0000 7f37977fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56468cc545d0 0x56468cc54a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:52.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.824+0000 7f37977fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56468cc545d0 0x56468cc54a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35620/0 (socket says 172.21.15.19:35620) 2024-09-19T09:03:52.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.824+0000 7f37977fe640 1 -- 172.21.15.19:0/3331604091 learned_addr learned my addr 172.21.15.19:0/3331604091 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:52.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.824+0000 7f3794ff9640 1 --2- 172.21.15.19:0/663815743 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f37840a3240 0x7f37840a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:52.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.824+0000 7f3796ffd640 1 --2- 172.21.15.19:0/3331604091 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56468cc55b40 0x56468cc54090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:52.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.824+0000 7f3796ffd640 1 --2- 172.21.15.19:0/3331604091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56468cc5f370 0x56468cc61760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:52.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.824+0000 7f3797fff640 1 --2- 172.21.15.19:0/663815743 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f37840a3240 0x7f37840a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:52.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.824+0000 7f3794ff9640 1 -- 172.21.15.19:0/663815743 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f37900cf450 con 0x7f3798102ef0 2024-09-19T09:03:52.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.824+0000 7f37977fe640 1 -- 172.21.15.19:0/3331604091 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56468cc55b40 msgr2=0x56468cc54090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:52.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.824+0000 7f37977fe640 1 --2- 172.21.15.19:0/3331604091 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56468cc55b40 0x56468cc54090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:52.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.824+0000 7f37977fe640 1 -- 172.21.15.19:0/3331604091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56468cc5f370 msgr2=0x56468cc61760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:52.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.824+0000 7f37977fe640 1 --2- 172.21.15.19:0/3331604091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56468cc5f370 0x56468cc61760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:52.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.824+0000 7f37977fe640 1 -- 172.21.15.19:0/3331604091 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56468cb463a0 con 0x56468cc545d0 2024-09-19T09:03:52.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.824+0000 7f37977fe640 1 --2- 172.21.15.19:0/3331604091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56468cc545d0 0x56468cc54a10 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f3788035000 tx=0x7f378802f770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd87a437d26c16 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:52.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.824+0000 7f3797fff640 1 --2- 172.21.15.19:0/663815743 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f37840a3240 0x7f37840a5700 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f37900983f0 tx=0x7f37900663b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:52.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.824+0000 7f378dffb640 1 -- 172.21.15.19:0/3331604091 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3788034040 con 0x56468cc545d0 2024-09-19T09:03:52.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.824+0000 7f378dffb640 1 -- 172.21.15.19:0/3331604091 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f378802fe10 con 0x56468cc545d0 2024-09-19T09:03:52.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.825+0000 7f378dffb640 1 -- 172.21.15.19:0/3331604091 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37880045d0 con 0x56468cc545d0 2024-09-19T09:03:52.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.825+0000 7f37a0084740 1 -- 172.21.15.19:0/3331604091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56468cc545d0 msgr2=0x56468cc54a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:52.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.825+0000 7f37a0084740 1 --2- 172.21.15.19:0/3331604091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56468cc545d0 0x56468cc54a10 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f3788035000 tx=0x7f378802f770 comp rx=0 tx=0).stop 2024-09-19T09:03:52.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.825+0000 7f37a0084740 1 -- 172.21.15.19:0/3331604091 shutdown_connections 2024-09-19T09:03:52.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.825+0000 7f37a0084740 1 --2- 172.21.15.19:0/3331604091 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56468cc5f370 0x56468cc61760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:52.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.825+0000 7f37a0084740 1 --2- 172.21.15.19:0/3331604091 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56468cc545d0 0x56468cc54a10 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:52.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.825+0000 7f37a0084740 1 --2- 172.21.15.19:0/3331604091 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56468cc55b40 0x56468cc54090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:52.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.825+0000 7f37a0084740 1 -- 172.21.15.19:0/3331604091 >> 172.21.15.19:0/3331604091 conn(0x56468cc1d310 msgr2=0x56468cc50c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:52.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.825+0000 7f37a0084740 1 -- 172.21.15.19:0/3331604091 shutdown_connections 2024-09-19T09:03:52.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.825+0000 7f37a0084740 1 -- 172.21.15.19:0/3331604091 wait complete. 2024-09-19T09:03:52.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.825+0000 7f37a0084740 1 -- start start 2024-09-19T09:03:52.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.826+0000 7f37a0084740 1 Processor -- start 2024-09-19T09:03:52.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.826+0000 7f37a0084740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56468cc545d0 0x56468cc5ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:52.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.826+0000 7f37a0084740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56468cc55b40 0x56468cc5bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:52.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.826+0000 7f37a0084740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56468cc5f370 0x56468cc5c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:52.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.826+0000 7f37a0084740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56468cc62010 con 0x56468cc55b40 2024-09-19T09:03:52.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.826+0000 7f37a0084740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56468cb75060 con 0x56468cc5f370 2024-09-19T09:03:52.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.826+0000 7f37a0084740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56468cc62190 con 0x56468cc545d0 2024-09-19T09:03:52.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.826+0000 7f37a0084740 10 client.0 _ll_register_callbacks cb 0x56468c8c88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:52.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.826+0000 7f37977fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56468cc55b40 0x56468cc5bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:52.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.826+0000 7f37977fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56468cc55b40 0x56468cc5bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35636/0 (socket says 172.21.15.19:35636) 2024-09-19T09:03:52.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.826+0000 7f37977fe640 1 -- 172.21.15.19:0/2876618415 learned_addr learned my addr 172.21.15.19:0/2876618415 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:52.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.826+0000 7f3796ffd640 1 --2- 172.21.15.19:0/2876618415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56468cc5f370 0x56468cc5c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:52.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.826+0000 7f3796ffd640 1 --2- 172.21.15.19:0/2876618415 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56468cc545d0 0x56468cc5ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:52.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.826+0000 7f37977fe640 1 -- 172.21.15.19:0/2876618415 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56468cc545d0 msgr2=0x56468cc5ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:52.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.826+0000 7f37977fe640 1 --2- 172.21.15.19:0/2876618415 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56468cc545d0 0x56468cc5ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:52.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.826+0000 7f37977fe640 1 -- 172.21.15.19:0/2876618415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56468cc5f370 msgr2=0x56468cc5c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:52.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.826+0000 7f37977fe640 1 --2- 172.21.15.19:0/2876618415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56468cc5f370 0x56468cc5c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:52.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.827+0000 7f37977fe640 1 -- 172.21.15.19:0/2876618415 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56468c92b3c0 con 0x56468cc55b40 2024-09-19T09:03:52.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.827+0000 7f3796ffd640 1 --2- 172.21.15.19:0/2876618415 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56468cc545d0 0x56468cc5ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:52.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.827+0000 7f37977fe640 1 --2- 172.21.15.19:0/2876618415 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56468cc55b40 0x56468cc5bfd0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f3788000f80 tx=0x7f378802fbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53dc7bdb911e7c91 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:52.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.827+0000 7f3776ffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:52.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.827+0000 7f3776ffd640 1 -- 172.21.15.19:0/2876618415 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3788053060 con 0x56468cc55b40 2024-09-19T09:03:52.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.827+0000 7f3776ffd640 1 -- 172.21.15.19:0/2876618415 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f37880047c0 con 0x56468cc55b40 2024-09-19T09:03:52.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.827+0000 7f37a0084740 1 -- 172.21.15.19:0/2876618415 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f378802fe10 con 0x56468cc55b40 2024-09-19T09:03:52.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.827+0000 7f3776ffd640 1 -- 172.21.15.19:0/2876618415 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f3788034050 con 0x56468cc55b40 2024-09-19T09:03:52.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.827+0000 7f37a0084740 10 client.18417 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:52.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.827+0000 7f37a0084740 1 -- 172.21.15.19:0/2876618415 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x56468cc62010 con 0x56468cc55b40 2024-09-19T09:03:52.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.827+0000 7f3776ffd640 1 -- 172.21.15.19:0/2876618415 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f378802fe10 con 0x56468cc55b40 2024-09-19T09:03:52.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.828+0000 7f3776ffd640 1 -- 172.21.15.19:0/2876618415 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f3788042070 con 0x56468cc55b40 2024-09-19T09:03:52.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.828+0000 7f37a0084740 10 client.18417 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:52.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.828+0000 7f37a0084740 10 client.18417 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:52.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.828+0000 7f37a0084740 20 client.18417 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:52.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.828+0000 7f37a0084740 1 --2- 172.21.15.19:0/2876618415 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56468cc6ebe0 0x56468cc70fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:52.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.828+0000 7f37a0084740 4 client.18417 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:52.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.828+0000 7f37a0084740 1 -- 172.21.15.19:0/2876618415 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56468cbc7860 con 0x56468cc6ebe0 2024-09-19T09:03:52.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.828+0000 7f3796ffd640 1 --2- 172.21.15.19:0/2876618415 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56468cc6ebe0 0x56468cc70fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:52.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.828+0000 7f3796ffd640 1 --2- 172.21.15.19:0/2876618415 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56468cc6ebe0 0x56468cc70fd0 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db58767a2c366065 server_cookie=c768503285346321 in_seq=0 out_seq=0 2024-09-19T09:03:52.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.828+0000 7f3776ffd640 10 client.18417 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:52.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.829+0000 7f3776ffd640 1 -- 172.21.15.19:0/2876618415 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56468cbc7860 con 0x56468cc6ebe0 2024-09-19T09:03:52.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.829+0000 7f3776ffd640 10 client.18417 handle_command_reply: tid=0 2024-09-19T09:03:52.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.829+0000 7f37a0084740 1 client.18417 shutdown 2024-09-19T09:03:52.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.829+0000 7f37a0084740 1 -- 172.21.15.19:0/2876618415 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56468cc55b40 msgr2=0x56468cc5bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:52.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.829+0000 7f37a0084740 1 --2- 172.21.15.19:0/2876618415 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56468cc55b40 0x56468cc5bfd0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f3788000f80 tx=0x7f378802fbe0 comp rx=0 tx=0).stop 2024-09-19T09:03:52.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.829+0000 7f37a0084740 1 -- 172.21.15.19:0/2876618415 shutdown_connections 2024-09-19T09:03:52.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.829+0000 7f37a0084740 1 --2- 172.21.15.19:0/2876618415 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56468cc6ebe0 0x56468cc70fd0 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:52.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.829+0000 7f37a0084740 1 --2- 172.21.15.19:0/2876618415 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56468cc5f370 0x56468cc5c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:52.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.829+0000 7f37a0084740 1 --2- 172.21.15.19:0/2876618415 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56468cc55b40 0x56468cc5bfd0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:52.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.829+0000 7f3776ffd640 0 client.18417 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:52.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.829+0000 7f37a0084740 1 --2- 172.21.15.19:0/2876618415 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56468cc545d0 0x56468cc5ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:52.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.829+0000 7f37a0084740 1 -- 172.21.15.19:0/2876618415 >> 172.21.15.19:0/2876618415 conn(0x56468cc1d310 msgr2=0x56468cc56960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:52.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.829+0000 7f37a0084740 1 -- 172.21.15.19:0/2876618415 shutdown_connections 2024-09-19T09:03:52.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.830+0000 7f37a0084740 1 -- 172.21.15.19:0/2876618415 wait complete. 2024-09-19T09:03:52.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.830+0000 7f37a0084740 20 client.18417 trim_cache size 0 max 16384 2024-09-19T09:03:52.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.843+0000 7f37a0084740 1 Processor -- start 2024-09-19T09:03:52.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.843+0000 7f37a0084740 1 -- start start 2024-09-19T09:03:52.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.843+0000 7f37a0084740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56468cc545d0 0x56468cc5b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:52.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.843+0000 7f37a0084740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56468cc55b40 0x56468cc60760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:52.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.843+0000 7f37a0084740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56468cc5f370 0x56468cc60ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:52.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.843+0000 7f37a0084740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f37981ad450 con 0x56468cc55b40 2024-09-19T09:03:52.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.843+0000 7f37a0084740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f37981aef90 con 0x56468cc5f370 2024-09-19T09:03:52.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.843+0000 7f37a0084740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f37981adb20 con 0x56468cc545d0 2024-09-19T09:03:52.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.843+0000 7f37977fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56468cc55b40 0x56468cc60760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:52.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.843+0000 7f37977fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56468cc55b40 0x56468cc60760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35642/0 (socket says 172.21.15.19:35642) 2024-09-19T09:03:52.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.843+0000 7f37977fe640 1 -- 172.21.15.19:0/2739801558 learned_addr learned my addr 172.21.15.19:0/2739801558 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:52.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.844+0000 7f3796ffd640 1 --2- 172.21.15.19:0/2739801558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56468cc5f370 0x56468cc60ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:52.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.844+0000 7f37977fe640 1 -- 172.21.15.19:0/2739801558 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56468cc545d0 msgr2=0x56468cc5b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:52.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.844+0000 7f37977fe640 1 --2- 172.21.15.19:0/2739801558 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56468cc545d0 0x56468cc5b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:52.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.844+0000 7f37977fe640 1 -- 172.21.15.19:0/2739801558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56468cc5f370 msgr2=0x56468cc60ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:52.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.844+0000 7f37977fe640 1 --2- 172.21.15.19:0/2739801558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56468cc5f370 0x56468cc60ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:52.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.844+0000 7f37977fe640 1 -- 172.21.15.19:0/2739801558 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56468cc5c8e0 con 0x56468cc55b40 2024-09-19T09:03:52.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.844+0000 7f3796ffd640 1 --2- 172.21.15.19:0/2739801558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56468cc5f370 0x56468cc60ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:52.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.844+0000 7f37977fe640 1 --2- 172.21.15.19:0/2739801558 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56468cc55b40 0x56468cc60760 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f378802a990 tx=0x7f3788009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9491cc978e14096 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:52.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.844+0000 7f378d7fa640 1 -- 172.21.15.19:0/2739801558 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f378805e070 con 0x56468cc55b40 2024-09-19T09:03:52.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.844+0000 7f378d7fa640 1 -- 172.21.15.19:0/2739801558 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3788003cf0 con 0x56468cc55b40 2024-09-19T09:03:52.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.844+0000 7f378d7fa640 1 -- 172.21.15.19:0/2739801558 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3788053070 con 0x56468cc55b40 2024-09-19T09:03:52.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.845+0000 7f37a0084740 1 -- 172.21.15.19:0/2739801558 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56468cc55b40 msgr2=0x56468cc60760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:52.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.845+0000 7f37a0084740 1 --2- 172.21.15.19:0/2739801558 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56468cc55b40 0x56468cc60760 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f378802a990 tx=0x7f3788009800 comp rx=0 tx=0).stop 2024-09-19T09:03:52.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.845+0000 7f37a0084740 1 -- 172.21.15.19:0/2739801558 shutdown_connections 2024-09-19T09:03:52.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.845+0000 7f37a0084740 1 --2- 172.21.15.19:0/2739801558 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56468cc5f370 0x56468cc60ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:52.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.845+0000 7f37a0084740 1 --2- 172.21.15.19:0/2739801558 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56468cc55b40 0x56468cc60760 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:52.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.845+0000 7f37a0084740 1 --2- 172.21.15.19:0/2739801558 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56468cc545d0 0x56468cc5b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:52.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.845+0000 7f37a0084740 1 -- 172.21.15.19:0/2739801558 >> 172.21.15.19:0/2739801558 conn(0x56468cc1d310 msgr2=0x56468cc5e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:52.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.845+0000 7f37a0084740 1 -- 172.21.15.19:0/2739801558 shutdown_connections 2024-09-19T09:03:52.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.845+0000 7f37a0084740 1 -- 172.21.15.19:0/2739801558 wait complete. 2024-09-19T09:03:52.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.845+0000 7f37a0084740 1 -- start start 2024-09-19T09:03:52.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.845+0000 7f37a0084740 1 Processor -- start 2024-09-19T09:03:52.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.846+0000 7f37a0084740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56468cc545d0 0x56468cc67d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:52.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.846+0000 7f37a0084740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56468cc55b40 0x56468cc76200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:52.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.846+0000 7f37a0084740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56468cc5f370 0x56468cc76940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:52.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.846+0000 7f37a0084740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f37981ae8c0 con 0x56468cc5f370 2024-09-19T09:03:52.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.846+0000 7f37a0084740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f37981ae1f0 con 0x56468cc55b40 2024-09-19T09:03:52.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.846+0000 7f37a0084740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f37981ab450 con 0x56468cc545d0 2024-09-19T09:03:52.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.846+0000 7f37a0084740 10 client.0 _ll_register_callbacks cb 0x7f378000dd80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:52.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.846+0000 7f3796ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56468cc5f370 0x56468cc76940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:52.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.846+0000 7f3796ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56468cc5f370 0x56468cc76940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35658/0 (socket says 172.21.15.19:35658) 2024-09-19T09:03:52.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.846+0000 7f3796ffd640 1 -- 172.21.15.19:0/1393639976 learned_addr learned my addr 172.21.15.19:0/1393639976 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:52.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.846+0000 7f3796ffd640 1 --2- 172.21.15.19:0/1393639976 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56468cc545d0 0x56468cc67d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:52.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.846+0000 7f37977fe640 1 --2- 172.21.15.19:0/1393639976 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56468cc55b40 0x56468cc76200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:52.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.846+0000 7f3796ffd640 1 -- 172.21.15.19:0/1393639976 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56468cc545d0 msgr2=0x56468cc67d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:52.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.846+0000 7f3796ffd640 1 --2- 172.21.15.19:0/1393639976 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56468cc545d0 0x56468cc67d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:52.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.846+0000 7f3796ffd640 1 -- 172.21.15.19:0/1393639976 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56468cc55b40 msgr2=0x56468cc76200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:52.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.846+0000 7f3796ffd640 1 --2- 172.21.15.19:0/1393639976 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56468cc55b40 0x56468cc76200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:52.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.846+0000 7f3796ffd640 1 -- 172.21.15.19:0/1393639976 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56468cc657a0 con 0x56468cc5f370 2024-09-19T09:03:52.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.846+0000 7f37977fe640 1 --2- 172.21.15.19:0/1393639976 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56468cc55b40 0x56468cc76200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:52.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.846+0000 7f3796ffd640 1 --2- 172.21.15.19:0/1393639976 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56468cc5f370 0x56468cc76940 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f378000d980 tx=0x7f378000d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caef1665019588d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:52.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.846+0000 7f3776ffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:52.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.846+0000 7f3776ffd640 1 -- 172.21.15.19:0/1393639976 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3780030060 con 0x56468cc5f370 2024-09-19T09:03:52.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.846+0000 7f3776ffd640 1 -- 172.21.15.19:0/1393639976 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f378001b040 con 0x56468cc5f370 2024-09-19T09:03:52.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.846+0000 7f37a0084740 1 -- 172.21.15.19:0/1393639976 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3788003cf0 con 0x56468cc5f370 2024-09-19T09:03:52.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.847+0000 7f3776ffd640 1 -- 172.21.15.19:0/1393639976 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f3780005020 con 0x56468cc5f370 2024-09-19T09:03:52.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.847+0000 7f37a0084740 10 client.18423 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:52.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.847+0000 7f37a0084740 1 -- 172.21.15.19:0/1393639976 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x56468ccd98b0 con 0x56468cc5f370 2024-09-19T09:03:52.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.847+0000 7f3776ffd640 1 -- 172.21.15.19:0/1393639976 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3788003cf0 con 0x56468cc5f370 2024-09-19T09:03:52.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.847+0000 7f3776ffd640 1 -- 172.21.15.19:0/1393639976 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f378001f5b0 con 0x56468cc5f370 2024-09-19T09:03:52.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.847+0000 7f37a0084740 10 client.18423 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:52.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.847+0000 7f37a0084740 10 client.18423 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:52.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.847+0000 7f37a0084740 20 client.18423 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:52.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.847+0000 7f37a0084740 1 --2- 172.21.15.19:0/1393639976 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56468ccd9fe0 0x56468ccdc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:52.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.847+0000 7f37a0084740 4 client.18423 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:03:52.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.847+0000 7f37a0084740 1 -- 172.21.15.19:0/1393639976 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56468cbc1d70 con 0x56468ccd9fe0 2024-09-19T09:03:52.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.847+0000 7f37977fe640 1 --2- 172.21.15.19:0/1393639976 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56468ccd9fe0 0x56468ccdc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:52.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.848+0000 7f37977fe640 1 --2- 172.21.15.19:0/1393639976 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56468ccd9fe0 0x56468ccdc400 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2aa0c36896a1f4c server_cookie=172cc71d1cd5bece in_seq=0 out_seq=0 2024-09-19T09:03:52.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.848+0000 7f3776ffd640 10 client.18423 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:52.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.848+0000 7f3776ffd640 1 -- 172.21.15.19:0/1393639976 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56468cbc1d70 con 0x56468ccd9fe0 2024-09-19T09:03:52.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.848+0000 7f3776ffd640 10 client.18423 handle_command_reply: tid=0 2024-09-19T09:03:52.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.848+0000 7f37a0084740 1 client.18423 shutdown 2024-09-19T09:03:52.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.848+0000 7f37a0084740 1 -- 172.21.15.19:0/1393639976 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56468cc5f370 msgr2=0x56468cc76940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:52.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.848+0000 7f37a0084740 1 --2- 172.21.15.19:0/1393639976 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56468cc5f370 0x56468cc76940 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f378000d980 tx=0x7f378000d360 comp rx=0 tx=0).stop 2024-09-19T09:03:52.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.848+0000 7f37a0084740 1 -- 172.21.15.19:0/1393639976 shutdown_connections 2024-09-19T09:03:52.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.848+0000 7f37a0084740 1 --2- 172.21.15.19:0/1393639976 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56468ccd9fe0 0x56468ccdc400 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:52.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.848+0000 7f37a0084740 1 --2- 172.21.15.19:0/1393639976 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56468cc5f370 0x56468cc76940 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:52.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.848+0000 7f37a0084740 1 --2- 172.21.15.19:0/1393639976 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56468cc55b40 0x56468cc76200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:52.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.848+0000 7f37a0084740 1 --2- 172.21.15.19:0/1393639976 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56468cc545d0 0x56468cc67d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:52.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.848+0000 7f37a0084740 1 -- 172.21.15.19:0/1393639976 >> 172.21.15.19:0/1393639976 conn(0x56468cc1d310 msgr2=0x56468cc4f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:52.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.848+0000 7f3776ffd640 0 client.18423 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:52.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.848+0000 7f37a0084740 1 -- 172.21.15.19:0/1393639976 shutdown_connections 2024-09-19T09:03:52.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.848+0000 7f37a0084740 1 -- 172.21.15.19:0/1393639976 wait complete. 2024-09-19T09:03:52.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.849+0000 7f37a0084740 20 client.18423 trim_cache size 0 max 16384 2024-09-19T09:03:52.856 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:03:52.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.849+0000 7f379dcab640 1 -- 172.21.15.19:0/663815743 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f37840a3240 msgr2=0x7f37840a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:52.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.849+0000 7f379dcab640 1 --2- 172.21.15.19:0/663815743 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f37840a3240 0x7f37840a5700 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f37900983f0 tx=0x7f37900663b0 comp rx=0 tx=0).stop 2024-09-19T09:03:52.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.849+0000 7f379dcab640 1 -- 172.21.15.19:0/663815743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3798102ef0 msgr2=0x7f379819ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:52.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.849+0000 7f379dcab640 1 --2- 172.21.15.19:0/663815743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3798102ef0 0x7f379819ce00 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f379000d750 tx=0x7f379000dc10 comp rx=0 tx=0).stop 2024-09-19T09:03:52.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.849+0000 7f379dcab640 1 -- 172.21.15.19:0/663815743 shutdown_connections 2024-09-19T09:03:52.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.849+0000 7f379dcab640 1 --2- 172.21.15.19:0/663815743 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f37840a3240 0x7f37840a5700 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:52.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.849+0000 7f379dcab640 1 --2- 172.21.15.19:0/663815743 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3798102ef0 0x7f379819ce00 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:52.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.849+0000 7f379dcab640 1 --2- 172.21.15.19:0/663815743 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3798102570 0x7f3798198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:52.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.849+0000 7f379dcab640 1 --2- 172.21.15.19:0/663815743 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3798100e20 0x7f3798198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:52.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.849+0000 7f379dcab640 1 -- 172.21.15.19:0/663815743 >> 172.21.15.19:0/663815743 conn(0x7f37980fc7d0 msgr2=0x7f37980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:52.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.849+0000 7f379dcab640 1 -- 172.21.15.19:0/663815743 shutdown_connections 2024-09-19T09:03:52.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:52.849+0000 7f379dcab640 1 -- 172.21.15.19:0/663815743 wait complete. 2024-09-19T09:03:54.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:53 smithi155 ceph-mon[34921]: pgmap v689: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.9 KiB/s wr, 16 op/s 2024-09-19T09:03:54.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:53 smithi203 ceph-mon[35450]: pgmap v689: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.9 KiB/s wr, 16 op/s 2024-09-19T09:03:54.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:53 smithi019 ceph-mon[30976]: pgmap v689: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.9 KiB/s wr, 16 op/s 2024-09-19T09:03:54.668 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:03:54.668 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:03:54.947 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:55.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.003+0000 7f9982f49640 1 -- 172.21.15.19:0/1811143949 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f997c102640 msgr2=0x7f997c104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:55.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.003+0000 7f9982f49640 1 --2- 172.21.15.19:0/1811143949 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f997c102640 0x7f997c104a30 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f9970009900 tx=0x7f997002a410 comp rx=0 tx=0).stop 2024-09-19T09:03:55.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.003+0000 7f9982f49640 1 -- 172.21.15.19:0/1811143949 shutdown_connections 2024-09-19T09:03:55.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.003+0000 7f9982f49640 1 --2- 172.21.15.19:0/1811143949 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f997c1078a0 0x7f997c109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.003+0000 7f9982f49640 1 --2- 172.21.15.19:0/1811143949 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f997c104f70 0x7f997c107360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.003+0000 7f9982f49640 1 --2- 172.21.15.19:0/1811143949 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f997c102640 0x7f997c104a30 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.003+0000 7f9982f49640 1 -- 172.21.15.19:0/1811143949 >> 172.21.15.19:0/1811143949 conn(0x7f997c0fc1e0 msgr2=0x7f997c0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:55.003 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.003+0000 7f9982f49640 1 -- 172.21.15.19:0/1811143949 shutdown_connections 2024-09-19T09:03:55.004 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.003+0000 7f9982f49640 1 -- 172.21.15.19:0/1811143949 wait complete. 2024-09-19T09:03:55.006 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.003+0000 7f9982f49640 1 Processor -- start 2024-09-19T09:03:55.006 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.004+0000 7f9982f49640 1 -- start start 2024-09-19T09:03:55.006 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.004+0000 7f9982f49640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f997c102640 0x7f997c197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.006 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.004+0000 7f9982f49640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f997c104f70 0x7f997c198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.007 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.004+0000 7f9982f49640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f997c1078a0 0x7f997c19f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.007 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.004+0000 7f9982f49640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f997c10d830 con 0x7f997c102640 2024-09-19T09:03:55.007 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.004+0000 7f9982f49640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f997c10d6b0 con 0x7f997c1078a0 2024-09-19T09:03:55.007 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.004+0000 7f9982f49640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f997c10d9b0 con 0x7f997c104f70 2024-09-19T09:03:55.007 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.004+0000 7f9980ce5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f997c102640 0x7f997c197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.007 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.004+0000 7f9980ce5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f997c102640 0x7f997c197e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35670/0 (socket says 172.21.15.19:35670) 2024-09-19T09:03:55.007 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.004+0000 7f9980ce5640 1 -- 172.21.15.19:0/1223371195 learned_addr learned my addr 172.21.15.19:0/1223371195 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:55.007 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.004+0000 7f997bfff640 1 --2- 172.21.15.19:0/1223371195 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f997c104f70 0x7f997c198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.007 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.004+0000 7f99814e6640 1 --2- 172.21.15.19:0/1223371195 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f997c1078a0 0x7f997c19f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.007 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.004+0000 7f9980ce5640 1 -- 172.21.15.19:0/1223371195 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f997c104f70 msgr2=0x7f997c198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:55.007 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.004+0000 7f9980ce5640 1 --2- 172.21.15.19:0/1223371195 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f997c104f70 0x7f997c198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.008 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.004+0000 7f9980ce5640 1 -- 172.21.15.19:0/1223371195 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f997c1078a0 msgr2=0x7f997c19f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:55.008 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.004+0000 7f9980ce5640 1 --2- 172.21.15.19:0/1223371195 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f997c1078a0 0x7f997c19f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.008 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.004+0000 7f9980ce5640 1 -- 172.21.15.19:0/1223371195 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f997c19fa50 con 0x7f997c102640 2024-09-19T09:03:55.008 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.004+0000 7f997bfff640 1 --2- 172.21.15.19:0/1223371195 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f997c104f70 0x7f997c198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:55.008 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.004+0000 7f99814e6640 1 --2- 172.21.15.19:0/1223371195 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f997c1078a0 0x7f997c19f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:55.008 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.004+0000 7f9980ce5640 1 --2- 172.21.15.19:0/1223371195 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f997c102640 0x7f997c197e30 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f9970009230 tx=0x7f9970031b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:55.008 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.004+0000 7f9979ffb640 1 -- 172.21.15.19:0/1223371195 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997003f030 con 0x7f997c102640 2024-09-19T09:03:55.008 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.004+0000 7f9979ffb640 1 -- 172.21.15.19:0/1223371195 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9970003ad0 con 0x7f997c102640 2024-09-19T09:03:55.008 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.004+0000 7f9979ffb640 1 -- 172.21.15.19:0/1223371195 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9970035070 con 0x7f997c102640 2024-09-19T09:03:55.008 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.004+0000 7f9982f49640 1 -- 172.21.15.19:0/1223371195 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f997c19fce0 con 0x7f997c102640 2024-09-19T09:03:55.009 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.005+0000 7f9982f49640 1 -- 172.21.15.19:0/1223371195 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f997c1a01d0 con 0x7f997c102640 2024-09-19T09:03:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.007+0000 7f9979ffb640 1 -- 172.21.15.19:0/1223371195 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f9970042030 con 0x7f997c102640 2024-09-19T09:03:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.007+0000 7f9985dba740 1 Processor -- start 2024-09-19T09:03:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.007+0000 7f9985dba740 1 -- start start 2024-09-19T09:03:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.007+0000 7f9985dba740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56354c9f49a0 0x56354c9f4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.007+0000 7f9985dba740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56354c9f52e0 0x56354c9f9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.007+0000 7f9985dba740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56354c9fa370 0x56354c9fc830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.007+0000 7f9985dba740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56354c9582f0 con 0x56354c9f52e0 2024-09-19T09:03:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.007+0000 7f9985dba740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56354c900270 con 0x56354c9fa370 2024-09-19T09:03:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.007+0000 7f9985dba740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56354c9542b0 con 0x56354c9f49a0 2024-09-19T09:03:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.007+0000 7f9980ce5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56354c9f52e0 0x56354c9f9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.008+0000 7f9980ce5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56354c9f52e0 0x56354c9f9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35672/0 (socket says 172.21.15.19:35672) 2024-09-19T09:03:55.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.008+0000 7f9980ce5640 1 -- 172.21.15.19:0/2760552273 learned_addr learned my addr 172.21.15.19:0/2760552273 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:55.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.008+0000 7f997bfff640 1 --2- 172.21.15.19:0/2760552273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56354c9fa370 0x56354c9fc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.008+0000 7f99814e6640 1 --2- 172.21.15.19:0/2760552273 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56354c9f49a0 0x56354c9f4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.008+0000 7f9980ce5640 1 -- 172.21.15.19:0/2760552273 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56354c9f49a0 msgr2=0x56354c9f4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:55.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.008+0000 7f9980ce5640 1 --2- 172.21.15.19:0/2760552273 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56354c9f49a0 0x56354c9f4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.008+0000 7f9980ce5640 1 -- 172.21.15.19:0/2760552273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56354c9fa370 msgr2=0x56354c9fc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:55.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.008+0000 7f9980ce5640 1 --2- 172.21.15.19:0/2760552273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56354c9fa370 0x56354c9fc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.008+0000 7f9979ffb640 1 --2- 172.21.15.19:0/1223371195 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f996c0a3370 0x7f996c0a5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.017 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.008+0000 7f9980ce5640 1 -- 172.21.15.19:0/2760552273 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56354c8ff340 con 0x56354c9f52e0 2024-09-19T09:03:55.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.008+0000 7f997bfff640 1 --2- 172.21.15.19:0/2760552273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56354c9fa370 0x56354c9fc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:55.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.008+0000 7f99814e6640 1 --2- 172.21.15.19:0/1223371195 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f996c0a3370 0x7f996c0a5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.008+0000 7f9980ce5640 1 --2- 172.21.15.19:0/2760552273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56354c9f52e0 0x56354c9f9da0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f99700bc910 tx=0x7f99700b8850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d475edefc2eefbd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:55.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.008+0000 7f9979ffb640 1 -- 172.21.15.19:0/1223371195 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f99700eff20 con 0x7f997c102640 2024-09-19T09:03:55.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.008+0000 7f9966ffd640 1 -- 172.21.15.19:0/2760552273 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9970049020 con 0x56354c9f52e0 2024-09-19T09:03:55.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.008+0000 7f9966ffd640 1 -- 172.21.15.19:0/2760552273 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f99700bc750 con 0x56354c9f52e0 2024-09-19T09:03:55.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.008+0000 7f9966ffd640 1 -- 172.21.15.19:0/2760552273 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99700bbe50 con 0x56354c9f52e0 2024-09-19T09:03:55.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.009+0000 7f9985dba740 1 -- 172.21.15.19:0/2760552273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56354c9f52e0 msgr2=0x56354c9f9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:55.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.009+0000 7f99814e6640 1 --2- 172.21.15.19:0/1223371195 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f996c0a3370 0x7f996c0a5830 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f997c06a980 tx=0x7f9974009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:55.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.009+0000 7f9985dba740 1 --2- 172.21.15.19:0/2760552273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56354c9f52e0 0x56354c9f9da0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f99700bc910 tx=0x7f99700b8850 comp rx=0 tx=0).stop 2024-09-19T09:03:55.018 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.009+0000 7f9985dba740 1 -- 172.21.15.19:0/2760552273 shutdown_connections 2024-09-19T09:03:55.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.009+0000 7f9985dba740 1 --2- 172.21.15.19:0/2760552273 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56354c9fa370 0x56354c9fc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.009+0000 7f9985dba740 1 --2- 172.21.15.19:0/2760552273 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56354c9f52e0 0x56354c9f9da0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.009+0000 7f9985dba740 1 --2- 172.21.15.19:0/2760552273 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56354c9f49a0 0x56354c9f4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.009+0000 7f9985dba740 1 -- 172.21.15.19:0/2760552273 >> 172.21.15.19:0/2760552273 conn(0x56354c9f0010 msgr2=0x56354c9f0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:55.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.009+0000 7f9985dba740 1 -- 172.21.15.19:0/2760552273 shutdown_connections 2024-09-19T09:03:55.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.009+0000 7f9985dba740 1 -- 172.21.15.19:0/2760552273 wait complete. 2024-09-19T09:03:55.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.009+0000 7f9985dba740 1 -- start start 2024-09-19T09:03:55.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.010+0000 7f9985dba740 1 Processor -- start 2024-09-19T09:03:55.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.010+0000 7f9985dba740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56354c9f49a0 0x56354c9fe7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.010+0000 7f9985dba740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56354c9f52e0 0x56354c9fed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.019 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.010+0000 7f9985dba740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56354c9fa370 0x56354ca05d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.020 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.010+0000 7f9985dba740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56354c9582f0 con 0x56354c9f49a0 2024-09-19T09:03:55.020 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.010+0000 7f9985dba740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56354c8e1290 con 0x56354c9f52e0 2024-09-19T09:03:55.020 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.010+0000 7f9985dba740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56354c9fd100 con 0x56354c9fa370 2024-09-19T09:03:55.020 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.010+0000 7f9985dba740 10 client.0 _ll_register_callbacks cb 0x56354c912140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:55.020 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.010+0000 7f9980ce5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56354c9f49a0 0x56354c9fe7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.020 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.010+0000 7f9980ce5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56354c9f49a0 0x56354c9fe7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35686/0 (socket says 172.21.15.19:35686) 2024-09-19T09:03:55.020 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.010+0000 7f9980ce5640 1 -- 172.21.15.19:0/486589347 learned_addr learned my addr 172.21.15.19:0/486589347 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:55.020 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.010+0000 7f99814e6640 1 --2- 172.21.15.19:0/486589347 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56354c9fa370 0x56354ca05d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.020 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.010+0000 7f997bfff640 1 --2- 172.21.15.19:0/486589347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56354c9f52e0 0x56354c9fed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.021 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.010+0000 7f9980ce5640 1 -- 172.21.15.19:0/486589347 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56354c9fa370 msgr2=0x56354ca05d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:55.021 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.010+0000 7f9980ce5640 1 --2- 172.21.15.19:0/486589347 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56354c9fa370 0x56354ca05d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.021 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.010+0000 7f9980ce5640 1 -- 172.21.15.19:0/486589347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56354c9f52e0 msgr2=0x56354c9fed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:55.021 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.010+0000 7f9980ce5640 1 --2- 172.21.15.19:0/486589347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56354c9f52e0 0x56354c9fed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.021 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.010+0000 7f9980ce5640 1 -- 172.21.15.19:0/486589347 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56354c66b210 con 0x56354c9f49a0 2024-09-19T09:03:55.021 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.010+0000 7f997bfff640 1 --2- 172.21.15.19:0/486589347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56354c9f52e0 0x56354c9fed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:55.021 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.011+0000 7f9980ce5640 1 --2- 172.21.15.19:0/486589347 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56354c9f49a0 0x56354c9fe7d0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f997003d040 tx=0x7f99700f37c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=104055509e412d17 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:55.021 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.011+0000 7f995bfff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:55.021 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.011+0000 7f995bfff640 1 -- 172.21.15.19:0/486589347 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9970049040 con 0x56354c9f49a0 2024-09-19T09:03:55.021 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.011+0000 7f995bfff640 1 -- 172.21.15.19:0/486589347 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f99700ba7f0 con 0x56354c9f49a0 2024-09-19T09:03:55.021 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.011+0000 7f9985dba740 1 -- 172.21.15.19:0/486589347 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56354c965a20 con 0x56354c9f49a0 2024-09-19T09:03:55.021 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.011+0000 7f995bfff640 1 -- 172.21.15.19:0/486589347 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f99700bbe50 con 0x56354c9f49a0 2024-09-19T09:03:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.011+0000 7f9985dba740 10 client.18435 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.011+0000 7f9985dba740 1 -- 172.21.15.19:0/486589347 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x56354c737620 con 0x56354c9f49a0 2024-09-19T09:03:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.011+0000 7f995bfff640 1 -- 172.21.15.19:0/486589347 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x56354c965a20 con 0x56354c9f49a0 2024-09-19T09:03:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.011+0000 7f995bfff640 1 -- 172.21.15.19:0/486589347 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f99700eda50 con 0x56354c9f49a0 2024-09-19T09:03:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.011+0000 7f9985dba740 10 client.18435 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.011+0000 7f9985dba740 10 client.18435 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.011+0000 7f9985dba740 20 client.18435 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.011+0000 7f9985dba740 1 --2- 172.21.15.19:0/486589347 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56354ca0a260 0x56354ca0c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.011+0000 7f9985dba740 4 client.18435 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.011+0000 7f9985dba740 1 -- 172.21.15.19:0/486589347 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56354c95fd70 con 0x56354ca0a260 2024-09-19T09:03:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.012+0000 7f997bfff640 1 --2- 172.21.15.19:0/486589347 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56354ca0a260 0x56354ca0c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.012+0000 7f995bfff640 10 client.18435 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.012+0000 7f997bfff640 1 --2- 172.21.15.19:0/486589347 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56354ca0a260 0x56354ca0c650 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f98434bdc7384b00 server_cookie=3255f0a686fd7a8f in_seq=0 out_seq=0 2024-09-19T09:03:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.013+0000 7f995bfff640 1 -- 172.21.15.19:0/486589347 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56354c95fd70 con 0x56354ca0a260 2024-09-19T09:03:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.013+0000 7f995bfff640 10 client.18435 handle_command_reply: tid=0 2024-09-19T09:03:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.013+0000 7f9985dba740 1 client.18435 shutdown 2024-09-19T09:03:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.013+0000 7f9985dba740 1 -- 172.21.15.19:0/486589347 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56354c9f49a0 msgr2=0x56354c9fe7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.013+0000 7f9985dba740 1 --2- 172.21.15.19:0/486589347 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56354c9f49a0 0x56354c9fe7d0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f997003d040 tx=0x7f99700f37c0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.013+0000 7f9985dba740 1 -- 172.21.15.19:0/486589347 shutdown_connections 2024-09-19T09:03:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.013+0000 7f9985dba740 1 --2- 172.21.15.19:0/486589347 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56354ca0a260 0x56354ca0c650 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.013+0000 7f9985dba740 1 --2- 172.21.15.19:0/486589347 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56354c9fa370 0x56354ca05d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.013+0000 7f995bfff640 0 client.18435 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:55.023 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.013+0000 7f9985dba740 1 --2- 172.21.15.19:0/486589347 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56354c9f52e0 0x56354c9fed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.024 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.013+0000 7f9985dba740 1 --2- 172.21.15.19:0/486589347 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56354c9f49a0 0x56354c9fe7d0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.024 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.013+0000 7f9985dba740 1 -- 172.21.15.19:0/486589347 >> 172.21.15.19:0/486589347 conn(0x56354c9f0010 msgr2=0x56354c9f1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:55.024 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.013+0000 7f9985dba740 1 -- 172.21.15.19:0/486589347 shutdown_connections 2024-09-19T09:03:55.024 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.013+0000 7f9985dba740 1 -- 172.21.15.19:0/486589347 wait complete. 2024-09-19T09:03:55.024 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.013+0000 7f9985dba740 20 client.18435 trim_cache size 0 max 16384 2024-09-19T09:03:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.028+0000 7f9985dba740 1 Processor -- start 2024-09-19T09:03:55.033 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.028+0000 7f9985dba740 1 -- start start 2024-09-19T09:03:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.028+0000 7f9985dba740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56354c9f49a0 0x56354c9feda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.028+0000 7f9985dba740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56354c9f52e0 0x56354ca05ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.028+0000 7f9985dba740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56354c9fa370 0x56354c9ef0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.028+0000 7f9985dba740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f997c1a8f70 con 0x56354c9f52e0 2024-09-19T09:03:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.028+0000 7f9985dba740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f997c1aaab0 con 0x56354c9fa370 2024-09-19T09:03:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.028+0000 7f9985dba740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f997c1a9640 con 0x56354c9f49a0 2024-09-19T09:03:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.028+0000 7f997bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56354c9f52e0 0x56354ca05ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.028+0000 7f997bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56354c9f52e0 0x56354ca05ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35696/0 (socket says 172.21.15.19:35696) 2024-09-19T09:03:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.028+0000 7f997bfff640 1 -- 172.21.15.19:0/2206257212 learned_addr learned my addr 172.21.15.19:0/2206257212 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:55.034 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.028+0000 7f99814e6640 1 --2- 172.21.15.19:0/2206257212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56354c9fa370 0x56354c9ef0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.028+0000 7f997bfff640 1 -- 172.21.15.19:0/2206257212 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56354c9f49a0 msgr2=0x56354c9feda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.028+0000 7f9980ce5640 1 --2- 172.21.15.19:0/2206257212 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56354c9f49a0 0x56354c9feda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.028+0000 7f997bfff640 1 --2- 172.21.15.19:0/2206257212 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56354c9f49a0 0x56354c9feda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.028+0000 7f997bfff640 1 -- 172.21.15.19:0/2206257212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56354c9fa370 msgr2=0x56354c9ef0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.028+0000 7f997bfff640 1 --2- 172.21.15.19:0/2206257212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56354c9fa370 0x56354c9ef0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.028+0000 7f997bfff640 1 -- 172.21.15.19:0/2206257212 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56354c9f9770 con 0x56354c9f52e0 2024-09-19T09:03:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.028+0000 7f9980ce5640 1 --2- 172.21.15.19:0/2206257212 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56354c9f49a0 0x56354c9feda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.029+0000 7f997bfff640 1 --2- 172.21.15.19:0/2206257212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56354c9f52e0 0x56354ca05ce0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f9968005fd0 tx=0x7f996800b440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=196efbf3a5030c46 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:55.035 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.029+0000 7f99667fc640 1 -- 172.21.15.19:0/2206257212 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9968004230 con 0x56354c9f52e0 2024-09-19T09:03:55.036 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.029+0000 7f99667fc640 1 -- 172.21.15.19:0/2206257212 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f996801e070 con 0x56354c9f52e0 2024-09-19T09:03:55.036 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.029+0000 7f99667fc640 1 -- 172.21.15.19:0/2206257212 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f996801a7f0 con 0x56354c9f52e0 2024-09-19T09:03:55.036 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.029+0000 7f9985dba740 1 -- 172.21.15.19:0/2206257212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56354c9f52e0 msgr2=0x56354ca05ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:55.036 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.029+0000 7f9985dba740 1 --2- 172.21.15.19:0/2206257212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56354c9f52e0 0x56354ca05ce0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f9968005fd0 tx=0x7f996800b440 comp rx=0 tx=0).stop 2024-09-19T09:03:55.036 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.029+0000 7f9985dba740 1 -- 172.21.15.19:0/2206257212 shutdown_connections 2024-09-19T09:03:55.036 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.029+0000 7f9985dba740 1 --2- 172.21.15.19:0/2206257212 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56354c9fa370 0x56354c9ef0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.036 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.029+0000 7f9985dba740 1 --2- 172.21.15.19:0/2206257212 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56354c9f52e0 0x56354ca05ce0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.036 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.029+0000 7f9985dba740 1 --2- 172.21.15.19:0/2206257212 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56354c9f49a0 0x56354c9feda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.036 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.029+0000 7f9985dba740 1 -- 172.21.15.19:0/2206257212 >> 172.21.15.19:0/2206257212 conn(0x56354c9f0010 msgr2=0x56354c9ee9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:55.036 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.029+0000 7f9985dba740 1 -- 172.21.15.19:0/2206257212 shutdown_connections 2024-09-19T09:03:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.030+0000 7f9985dba740 1 -- 172.21.15.19:0/2206257212 wait complete. 2024-09-19T09:03:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.030+0000 7f9985dba740 1 -- start start 2024-09-19T09:03:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.030+0000 7f9985dba740 1 Processor -- start 2024-09-19T09:03:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.030+0000 7f9985dba740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56354c9f49a0 0x56354ca034d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.030+0000 7f9985dba740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56354c9f52e0 0x56354ca03a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.030+0000 7f9985dba740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56354c9fa370 0x56354ca04a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.030+0000 7f9985dba740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f997c1aa3e0 con 0x56354c9f49a0 2024-09-19T09:03:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.030+0000 7f9985dba740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f997c1a9d10 con 0x56354c9f52e0 2024-09-19T09:03:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.030+0000 7f9985dba740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f997c1a6f50 con 0x56354c9fa370 2024-09-19T09:03:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.030+0000 7f9985dba740 10 client.0 _ll_register_callbacks cb 0x7f99700f3e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.030+0000 7f9980ce5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56354c9f49a0 0x56354ca034d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.037 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.030+0000 7f9980ce5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56354c9f49a0 0x56354ca034d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:35700/0 (socket says 172.21.15.19:35700) 2024-09-19T09:03:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.030+0000 7f9980ce5640 1 -- 172.21.15.19:0/2066571860 learned_addr learned my addr 172.21.15.19:0/2066571860 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.030+0000 7f99814e6640 1 --2- 172.21.15.19:0/2066571860 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56354c9fa370 0x56354ca04a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.031+0000 7f997bfff640 1 --2- 172.21.15.19:0/2066571860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56354c9f52e0 0x56354ca03a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.031+0000 7f9980ce5640 1 -- 172.21.15.19:0/2066571860 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56354c9fa370 msgr2=0x56354ca04a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.031+0000 7f9980ce5640 1 --2- 172.21.15.19:0/2066571860 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56354c9fa370 0x56354ca04a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.031+0000 7f9980ce5640 1 -- 172.21.15.19:0/2066571860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56354c9f52e0 msgr2=0x56354ca03a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.031+0000 7f9980ce5640 1 --2- 172.21.15.19:0/2066571860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56354c9f52e0 0x56354ca03a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.031+0000 7f9980ce5640 1 -- 172.21.15.19:0/2066571860 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56354ca05030 con 0x56354c9f49a0 2024-09-19T09:03:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.031+0000 7f9980ce5640 1 --2- 172.21.15.19:0/2066571860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56354c9f49a0 0x56354ca034d0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f99700ba7a0 tx=0x7f9970005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5e92b8046cfb13 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:55.038 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.031+0000 7f995bfff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.031+0000 7f995bfff640 1 -- 172.21.15.19:0/2066571860 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9970049070 con 0x56354c9f49a0 2024-09-19T09:03:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.031+0000 7f995bfff640 1 -- 172.21.15.19:0/2066571860 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f99700eda50 con 0x56354c9f49a0 2024-09-19T09:03:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.031+0000 7f9985dba740 1 -- 172.21.15.19:0/2066571860 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f996801e070 con 0x56354c9f49a0 2024-09-19T09:03:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.031+0000 7f995bfff640 1 -- 172.21.15.19:0/2066571860 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f99700bc030 con 0x56354c9f49a0 2024-09-19T09:03:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.031+0000 7f9985dba740 10 client.18441 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.031+0000 7f9985dba740 1 -- 172.21.15.19:0/2066571860 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x56354ca05030 con 0x56354c9f49a0 2024-09-19T09:03:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.031+0000 7f995bfff640 1 -- 172.21.15.19:0/2066571860 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f996801e070 con 0x56354c9f49a0 2024-09-19T09:03:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.032+0000 7f995bfff640 1 -- 172.21.15.19:0/2066571860 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f99700a0030 con 0x56354c9f49a0 2024-09-19T09:03:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.032+0000 7f9985dba740 10 client.18441 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.032+0000 7f9985dba740 10 client.18441 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:55.039 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.032+0000 7f9985dba740 20 client.18441 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.032+0000 7f9985dba740 1 --2- 172.21.15.19:0/2066571860 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56354ca0a260 0x56354ca77480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.032+0000 7f9985dba740 4 client.18441 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:03:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.032+0000 7f9985dba740 1 -- 172.21.15.19:0/2066571860 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56354c8dc900 con 0x56354ca0a260 2024-09-19T09:03:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.032+0000 7f997bfff640 1 --2- 172.21.15.19:0/2066571860 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56354ca0a260 0x56354ca77480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.032+0000 7f995bfff640 10 client.18441 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:55.040 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.032+0000 7f997bfff640 1 --2- 172.21.15.19:0/2066571860 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56354ca0a260 0x56354ca77480 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f5b143aebaece57 server_cookie=264eb74f5a8f146d in_seq=0 out_seq=0 2024-09-19T09:03:55.049 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.048+0000 7f995bfff640 1 -- 172.21.15.19:0/2066571860 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56354c8dc900 con 0x56354ca0a260 2024-09-19T09:03:55.049 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.048+0000 7f995bfff640 10 client.18441 handle_command_reply: tid=0 2024-09-19T09:03:55.049 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.048+0000 7f9985dba740 1 client.18441 shutdown 2024-09-19T09:03:55.049 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.048+0000 7f9985dba740 1 -- 172.21.15.19:0/2066571860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56354c9f49a0 msgr2=0x56354ca034d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:55.049 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.048+0000 7f9985dba740 1 --2- 172.21.15.19:0/2066571860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56354c9f49a0 0x56354ca034d0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f99700ba7a0 tx=0x7f9970005bc0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.049 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.048+0000 7f9985dba740 1 -- 172.21.15.19:0/2066571860 shutdown_connections 2024-09-19T09:03:55.049 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.048+0000 7f9985dba740 1 --2- 172.21.15.19:0/2066571860 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56354ca0a260 0x56354ca77480 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.049 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.048+0000 7f9985dba740 1 --2- 172.21.15.19:0/2066571860 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56354c9fa370 0x56354ca04a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.049 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.048+0000 7f995bfff640 0 client.18441 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.048+0000 7f9985dba740 1 --2- 172.21.15.19:0/2066571860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56354c9f52e0 0x56354ca03a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.048+0000 7f9985dba740 1 --2- 172.21.15.19:0/2066571860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56354c9f49a0 0x56354ca034d0 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.048+0000 7f9985dba740 1 -- 172.21.15.19:0/2066571860 >> 172.21.15.19:0/2066571860 conn(0x56354c9f0010 msgr2=0x56354c9ef1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.048+0000 7f9985dba740 1 -- 172.21.15.19:0/2066571860 shutdown_connections 2024-09-19T09:03:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.048+0000 7f9985dba740 1 -- 172.21.15.19:0/2066571860 wait complete. 2024-09-19T09:03:55.050 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.049+0000 7f9985dba740 20 client.18441 trim_cache size 0 max 16384 2024-09-19T09:03:55.051 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:{ 2024-09-19T09:03:55.051 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "message": "", 2024-09-19T09:03:55.051 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout: "return_code": 0 2024-09-19T09:03:55.051 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stdout:} 2024-09-19T09:03:55.052 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.049+0000 7f9982f49640 1 -- 172.21.15.19:0/1223371195 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f996c0a3370 msgr2=0x7f996c0a5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:55.052 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.049+0000 7f9982f49640 1 --2- 172.21.15.19:0/1223371195 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f996c0a3370 0x7f996c0a5830 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f997c06a980 tx=0x7f9974009500 comp rx=0 tx=0).stop 2024-09-19T09:03:55.052 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.049+0000 7f9982f49640 1 -- 172.21.15.19:0/1223371195 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f997c102640 msgr2=0x7f997c197e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:55.052 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.049+0000 7f9982f49640 1 --2- 172.21.15.19:0/1223371195 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f997c102640 0x7f997c197e30 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f9970009230 tx=0x7f9970031b60 comp rx=0 tx=0).stop 2024-09-19T09:03:55.052 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.049+0000 7f9982f49640 1 -- 172.21.15.19:0/1223371195 shutdown_connections 2024-09-19T09:03:55.052 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.049+0000 7f9982f49640 1 --2- 172.21.15.19:0/1223371195 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f996c0a3370 0x7f996c0a5830 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.052 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.049+0000 7f9982f49640 1 --2- 172.21.15.19:0/1223371195 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f997c104f70 0x7f997c198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.052 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.049+0000 7f9982f49640 1 --2- 172.21.15.19:0/1223371195 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f997c1078a0 0x7f997c19f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.053 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.049+0000 7f9982f49640 1 --2- 172.21.15.19:0/1223371195 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f997c102640 0x7f997c197e30 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.053 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.049+0000 7f9982f49640 1 -- 172.21.15.19:0/1223371195 >> 172.21.15.19:0/1223371195 conn(0x7f997c0fc1e0 msgr2=0x7f997c102ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:55.053 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.049+0000 7f9982f49640 1 -- 172.21.15.19:0/1223371195 shutdown_connections 2024-09-19T09:03:55.053 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:03:55.049+0000 7f9982f49640 1 -- 172.21.15.19:0/1223371195 wait complete. 2024-09-19T09:03:55.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.430+0000 7f5e9515e640 1 -- 172.21.15.19:0/3240744125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e90102d40 msgr2=0x7f5e90103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:55.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.430+0000 7f5e9515e640 1 --2- 172.21.15.19:0/3240744125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e90102d40 0x7f5e90103120 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f5e80009900 tx=0x7f5e8002a480 comp rx=0 tx=0).stop 2024-09-19T09:03:55.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.430+0000 7f5e9515e640 1 -- 172.21.15.19:0/3240744125 shutdown_connections 2024-09-19T09:03:55.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.431+0000 7f5e9515e640 1 --2- 172.21.15.19:0/3240744125 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e90103660 0x7f5e9010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.431+0000 7f5e9515e640 1 --2- 172.21.15.19:0/3240744125 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e9010c170 0x7f5e9010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.431+0000 7f5e9515e640 1 --2- 172.21.15.19:0/3240744125 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e90102d40 0x7f5e90103120 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.431+0000 7f5e9515e640 1 -- 172.21.15.19:0/3240744125 >> 172.21.15.19:0/3240744125 conn(0x7f5e900fc7a0 msgr2=0x7f5e900febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:55.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.431+0000 7f5e9515e640 1 -- 172.21.15.19:0/3240744125 shutdown_connections 2024-09-19T09:03:55.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.431+0000 7f5e9515e640 1 -- 172.21.15.19:0/3240744125 wait complete. 2024-09-19T09:03:55.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.431+0000 7f5e9515e640 1 Processor -- start 2024-09-19T09:03:55.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.432+0000 7f5e9515e640 1 -- start start 2024-09-19T09:03:55.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.432+0000 7f5e9515e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e90102d40 0x7f5e90198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.432+0000 7f5e9515e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e90103660 0x7f5e901989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.432+0000 7f5e9515e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e9010c170 0x7f5e9019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.432+0000 7f5e9515e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5e90111f70 con 0x7f5e9010c170 2024-09-19T09:03:55.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.432+0000 7f5e9515e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5e90111df0 con 0x7f5e90102d40 2024-09-19T09:03:55.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.432+0000 7f5e9515e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5e901120f0 con 0x7f5e90103660 2024-09-19T09:03:55.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.432+0000 7f5e8f59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e9010c170 0x7f5e9019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.432+0000 7f5e8ed9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e90102d40 0x7f5e90198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.432+0000 7f5e8f59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e9010c170 0x7f5e9019cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59132/0 (socket says 172.21.15.19:59132) 2024-09-19T09:03:55.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.432+0000 7f5e8f59e640 1 -- 172.21.15.19:0/3029299480 learned_addr learned my addr 172.21.15.19:0/3029299480 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:55.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.432+0000 7f5e8e59c640 1 --2- 172.21.15.19:0/3029299480 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e90103660 0x7f5e901989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.432+0000 7f5e8f59e640 1 -- 172.21.15.19:0/3029299480 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e90103660 msgr2=0x7f5e901989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:55.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.432+0000 7f5e8f59e640 1 --2- 172.21.15.19:0/3029299480 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e90103660 0x7f5e901989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.432+0000 7f5e8f59e640 1 -- 172.21.15.19:0/3029299480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e90102d40 msgr2=0x7f5e90198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:55.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.432+0000 7f5e8f59e640 1 --2- 172.21.15.19:0/3029299480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e90102d40 0x7f5e90198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.432+0000 7f5e8f59e640 1 -- 172.21.15.19:0/3029299480 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e9019d420 con 0x7f5e9010c170 2024-09-19T09:03:55.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.432+0000 7f5e8e59c640 1 --2- 172.21.15.19:0/3029299480 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e90103660 0x7f5e901989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:55.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.433+0000 7f5e8f59e640 1 --2- 172.21.15.19:0/3029299480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e9010c170 0x7f5e9019cd40 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f5e8800eaa0 tx=0x7f5e8800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:55.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.433+0000 7f5e77fff640 1 -- 172.21.15.19:0/3029299480 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8800cdb0 con 0x7f5e9010c170 2024-09-19T09:03:55.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.433+0000 7f5e77fff640 1 -- 172.21.15.19:0/3029299480 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e88005020 con 0x7f5e9010c170 2024-09-19T09:03:55.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.433+0000 7f5e77fff640 1 -- 172.21.15.19:0/3029299480 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e880116b0 con 0x7f5e9010c170 2024-09-19T09:03:55.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.433+0000 7f5e9515e640 1 -- 172.21.15.19:0/3029299480 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e9019d710 con 0x7f5e9010c170 2024-09-19T09:03:55.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.433+0000 7f5e9515e640 1 -- 172.21.15.19:0/3029299480 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e901a4ff0 con 0x7f5e9010c170 2024-09-19T09:03:55.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.435+0000 7f5e77fff640 1 -- 172.21.15.19:0/3029299480 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f5e88005560 con 0x7f5e9010c170 2024-09-19T09:03:55.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.435+0000 7f5e97537740 1 Processor -- start 2024-09-19T09:03:55.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.436+0000 7f5e97537740 1 -- start start 2024-09-19T09:03:55.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.436+0000 7f5e97537740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d86875b60 0x559d86875f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.436+0000 7f5e97537740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d86876480 0x559d86880800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.436+0000 7f5e97537740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559d86880d40 0x559d86883130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.436+0000 7f5e97537740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559d867db280 con 0x559d86875b60 2024-09-19T09:03:55.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.436+0000 7f5e97537740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559d86782b10 con 0x559d86876480 2024-09-19T09:03:55.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.436+0000 7f5e97537740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559d867d7240 con 0x559d86880d40 2024-09-19T09:03:55.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.436+0000 7f5e77fff640 1 --2- 172.21.15.19:0/3029299480 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5e780a3240 0x7f5e780a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.436+0000 7f5e8e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d86875b60 0x559d86875f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.436+0000 7f5e8e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d86875b60 0x559d86875f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59134/0 (socket says 172.21.15.19:59134) 2024-09-19T09:03:55.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.436+0000 7f5e8e59c640 1 -- 172.21.15.19:0/452921401 learned_addr learned my addr 172.21.15.19:0/452921401 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:55.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.436+0000 7f5e8f59e640 1 --2- 172.21.15.19:0/3029299480 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5e780a3240 0x7f5e780a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.436+0000 7f5e8ed9d640 1 --2- 172.21.15.19:0/452921401 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d86876480 0x559d86880800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.436+0000 7f5e8e59c640 1 -- 172.21.15.19:0/452921401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559d86880d40 msgr2=0x559d86883130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:55.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.436+0000 7f5e8e59c640 1 --2- 172.21.15.19:0/452921401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559d86880d40 0x559d86883130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.436+0000 7f5e8e59c640 1 -- 172.21.15.19:0/452921401 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d86876480 msgr2=0x559d86880800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:55.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.436+0000 7f5e8e59c640 1 --2- 172.21.15.19:0/452921401 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d86876480 0x559d86880800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.436+0000 7f5e8e59c640 1 -- 172.21.15.19:0/452921401 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d8678f1f0 con 0x559d86875b60 2024-09-19T09:03:55.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.436+0000 7f5e77fff640 1 -- 172.21.15.19:0/3029299480 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f5e880cfaf0 con 0x7f5e9010c170 2024-09-19T09:03:55.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.436+0000 7f5e8ed9d640 1 --2- 172.21.15.19:0/452921401 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d86876480 0x559d86880800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:55.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.437+0000 7f5e8e59c640 1 --2- 172.21.15.19:0/452921401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d86875b60 0x559d86875f40 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f5e8400bd40 tx=0x7f5e84011750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=300c3cbc26a000e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:55.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.437+0000 7f5e8f59e640 1 --2- 172.21.15.19:0/3029299480 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5e780a3240 0x7f5e780a5700 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5e8809c0b0 tx=0x7f5e8806efa0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:55.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.437+0000 7f5e757fa640 1 -- 172.21.15.19:0/452921401 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e84016070 con 0x559d86875b60 2024-09-19T09:03:55.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.437+0000 7f5e757fa640 1 -- 172.21.15.19:0/452921401 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e8401b940 con 0x559d86875b60 2024-09-19T09:03:55.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.437+0000 7f5e757fa640 1 -- 172.21.15.19:0/452921401 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e84012a30 con 0x559d86875b60 2024-09-19T09:03:55.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.437+0000 7f5e97537740 1 -- 172.21.15.19:0/452921401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d86875b60 msgr2=0x559d86875f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:55.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.437+0000 7f5e97537740 1 --2- 172.21.15.19:0/452921401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d86875b60 0x559d86875f40 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f5e8400bd40 tx=0x7f5e84011750 comp rx=0 tx=0).stop 2024-09-19T09:03:55.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.437+0000 7f5e97537740 1 -- 172.21.15.19:0/452921401 shutdown_connections 2024-09-19T09:03:55.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.437+0000 7f5e97537740 1 --2- 172.21.15.19:0/452921401 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559d86880d40 0x559d86883130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.437+0000 7f5e97537740 1 --2- 172.21.15.19:0/452921401 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d86876480 0x559d86880800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.437+0000 7f5e97537740 1 --2- 172.21.15.19:0/452921401 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d86875b60 0x559d86875f40 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.437+0000 7f5e97537740 1 -- 172.21.15.19:0/452921401 >> 172.21.15.19:0/452921401 conn(0x559d868720f0 msgr2=0x559d868724d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:55.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.437+0000 7f5e97537740 1 -- 172.21.15.19:0/452921401 shutdown_connections 2024-09-19T09:03:55.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.438+0000 7f5e97537740 1 -- 172.21.15.19:0/452921401 wait complete. 2024-09-19T09:03:55.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.438+0000 7f5e97537740 1 -- start start 2024-09-19T09:03:55.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.438+0000 7f5e97537740 1 Processor -- start 2024-09-19T09:03:55.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.438+0000 7f5e97537740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d86875b60 0x559d8687dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.438+0000 7f5e97537740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d86876480 0x559d8687e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.438+0000 7f5e97537740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559d86880d40 0x559d8687e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.438+0000 7f5e97537740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559d86883910 con 0x559d86876480 2024-09-19T09:03:55.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.438+0000 7f5e97537740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559d86795f10 con 0x559d86875b60 2024-09-19T09:03:55.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.438+0000 7f5e97537740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559d86883a90 con 0x559d86880d40 2024-09-19T09:03:55.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.438+0000 7f5e97537740 10 client.0 _ll_register_callbacks cb 0x559d8675ea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:55.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.438+0000 7f5e8ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d86876480 0x559d8687e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.438+0000 7f5e8ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d86876480 0x559d8687e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59138/0 (socket says 172.21.15.19:59138) 2024-09-19T09:03:55.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.438+0000 7f5e8ed9d640 1 -- 172.21.15.19:0/3431676546 learned_addr learned my addr 172.21.15.19:0/3431676546 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:55.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.438+0000 7f5e8e59c640 1 --2- 172.21.15.19:0/3431676546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d86875b60 0x559d8687dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.438+0000 7f5e8e59c640 1 --2- 172.21.15.19:0/3431676546 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559d86880d40 0x559d8687e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.439+0000 7f5e8ed9d640 1 -- 172.21.15.19:0/3431676546 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559d86880d40 msgr2=0x559d8687e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:55.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.439+0000 7f5e8ed9d640 1 --2- 172.21.15.19:0/3431676546 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559d86880d40 0x559d8687e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.439+0000 7f5e8ed9d640 1 -- 172.21.15.19:0/3431676546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d86875b60 msgr2=0x559d8687dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:55.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.439+0000 7f5e8ed9d640 1 --2- 172.21.15.19:0/3431676546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d86875b60 0x559d8687dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.439+0000 7f5e8ed9d640 1 -- 172.21.15.19:0/3431676546 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d8654c6a0 con 0x559d86876480 2024-09-19T09:03:55.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.439+0000 7f5e8e59c640 1 --2- 172.21.15.19:0/3431676546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d86875b60 0x559d8687dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:55.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.439+0000 7f5e8ed9d640 1 --2- 172.21.15.19:0/3431676546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d86876480 0x559d8687e150 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f5e80009900 tx=0x7f5e80031850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd06b00bb0132f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:55.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.439+0000 7f5e72ff5640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:55.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.439+0000 7f5e72ff5640 1 -- 172.21.15.19:0/3431676546 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e80035040 con 0x559d86876480 2024-09-19T09:03:55.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.439+0000 7f5e72ff5640 1 -- 172.21.15.19:0/3431676546 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f5e80004460 con 0x559d86876480 2024-09-19T09:03:55.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.439+0000 7f5e97537740 1 -- 172.21.15.19:0/3431676546 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e8401b940 con 0x559d86876480 2024-09-19T09:03:55.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.439+0000 7f5e72ff5640 1 -- 172.21.15.19:0/3431676546 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f5e800035f0 con 0x559d86876480 2024-09-19T09:03:55.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.439+0000 7f5e97537740 10 client.18453 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:55.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.439+0000 7f5e97537740 1 -- 172.21.15.19:0/3431676546 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x559d8688f480 con 0x559d86876480 2024-09-19T09:03:55.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.439+0000 7f5e72ff5640 1 -- 172.21.15.19:0/3431676546 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e8401b940 con 0x559d86876480 2024-09-19T09:03:55.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.440+0000 7f5e72ff5640 1 -- 172.21.15.19:0/3431676546 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f5e8003c960 con 0x559d86876480 2024-09-19T09:03:55.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.440+0000 7f5e97537740 10 client.18453 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:55.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.440+0000 7f5e97537740 10 client.18453 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:55.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.440+0000 7f5e97537740 20 client.18453 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:55.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.440+0000 7f5e97537740 1 --2- 172.21.15.19:0/3431676546 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x559d86890940 0x559d86892d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.440+0000 7f5e97537740 4 client.18453 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:55.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.440+0000 7f5e97537740 1 -- 172.21.15.19:0/3431676546 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d867e87f0 con 0x559d86890940 2024-09-19T09:03:55.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.440+0000 7f5e8e59c640 1 --2- 172.21.15.19:0/3431676546 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x559d86890940 0x559d86892d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.440+0000 7f5e72ff5640 10 client.18453 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:55.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.440+0000 7f5e8e59c640 1 --2- 172.21.15.19:0/3431676546 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x559d86890940 0x559d86892d30 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c84be9e4bea4e77e server_cookie=c305248a8132c811 in_seq=0 out_seq=0 2024-09-19T09:03:55.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.441+0000 7f5e72ff5640 1 -- 172.21.15.19:0/3431676546 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559d867e87f0 con 0x559d86890940 2024-09-19T09:03:55.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.441+0000 7f5e72ff5640 10 client.18453 handle_command_reply: tid=0 2024-09-19T09:03:55.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.441+0000 7f5e97537740 1 client.18453 shutdown 2024-09-19T09:03:55.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.441+0000 7f5e97537740 1 -- 172.21.15.19:0/3431676546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d86876480 msgr2=0x559d8687e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:55.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.441+0000 7f5e97537740 1 --2- 172.21.15.19:0/3431676546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d86876480 0x559d8687e150 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f5e80009900 tx=0x7f5e80031850 comp rx=0 tx=0).stop 2024-09-19T09:03:55.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.441+0000 7f5e97537740 1 -- 172.21.15.19:0/3431676546 shutdown_connections 2024-09-19T09:03:55.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.441+0000 7f5e97537740 1 --2- 172.21.15.19:0/3431676546 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x559d86890940 0x559d86892d30 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.441+0000 7f5e97537740 1 --2- 172.21.15.19:0/3431676546 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559d86880d40 0x559d8687e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.441+0000 7f5e97537740 1 --2- 172.21.15.19:0/3431676546 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d86876480 0x559d8687e150 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.441+0000 7f5e97537740 1 --2- 172.21.15.19:0/3431676546 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d86875b60 0x559d8687dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.441+0000 7f5e97537740 1 -- 172.21.15.19:0/3431676546 >> 172.21.15.19:0/3431676546 conn(0x559d868720f0 msgr2=0x559d86877e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:55.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.441+0000 7f5e72ff5640 0 client.18453 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:55.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.441+0000 7f5e97537740 1 -- 172.21.15.19:0/3431676546 shutdown_connections 2024-09-19T09:03:55.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.441+0000 7f5e97537740 1 -- 172.21.15.19:0/3431676546 wait complete. 2024-09-19T09:03:55.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.442+0000 7f5e97537740 20 client.18453 trim_cache size 0 max 16384 2024-09-19T09:03:55.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.459+0000 7f5e97537740 1 Processor -- start 2024-09-19T09:03:55.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.459+0000 7f5e97537740 1 -- start start 2024-09-19T09:03:55.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.459+0000 7f5e97537740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559d86875b60 0x559d868785c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.459+0000 7f5e97537740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d86876480 0x559d8687fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.459+0000 7f5e97537740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d86880d40 0x559d86898600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.459+0000 7f5e97537740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5e901ad5e0 con 0x559d86876480 2024-09-19T09:03:55.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.459+0000 7f5e97537740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5e901af120 con 0x559d86880d40 2024-09-19T09:03:55.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.459+0000 7f5e97537740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5e901adcb0 con 0x559d86875b60 2024-09-19T09:03:55.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.459+0000 7f5e8ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d86876480 0x559d8687fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.459+0000 7f5e8ed9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d86876480 0x559d8687fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59150/0 (socket says 172.21.15.19:59150) 2024-09-19T09:03:55.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.459+0000 7f5e8ed9d640 1 -- 172.21.15.19:0/257233345 learned_addr learned my addr 172.21.15.19:0/257233345 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:55.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.459+0000 7f5e8e59c640 1 --2- 172.21.15.19:0/257233345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d86880d40 0x559d86898600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.459+0000 7f5e8ed9d640 1 -- 172.21.15.19:0/257233345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559d86875b60 msgr2=0x559d868785c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:55.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.459+0000 7f5e8ed9d640 1 --2- 172.21.15.19:0/257233345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559d86875b60 0x559d868785c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.459+0000 7f5e8ed9d640 1 -- 172.21.15.19:0/257233345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d86880d40 msgr2=0x559d86898600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:55.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.459+0000 7f5e8ed9d640 1 --2- 172.21.15.19:0/257233345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d86880d40 0x559d86898600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.459+0000 7f5e8ed9d640 1 -- 172.21.15.19:0/257233345 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d868762b0 con 0x559d86876480 2024-09-19T09:03:55.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.460+0000 7f5e8e59c640 1 --2- 172.21.15.19:0/257233345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d86880d40 0x559d86898600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:55.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.460+0000 7f5e8ed9d640 1 --2- 172.21.15.19:0/257233345 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d86876480 0x559d8687fa70 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f5e8003cef0 tx=0x7f5e8002a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55026af0cf702b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:55.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.460+0000 7f5e74ff9640 1 -- 172.21.15.19:0/257233345 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e80035040 con 0x559d86876480 2024-09-19T09:03:55.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.460+0000 7f5e74ff9640 1 -- 172.21.15.19:0/257233345 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e80053070 con 0x559d86876480 2024-09-19T09:03:55.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.460+0000 7f5e74ff9640 1 -- 172.21.15.19:0/257233345 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e80000e60 con 0x559d86876480 2024-09-19T09:03:55.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.460+0000 7f5e97537740 1 -- 172.21.15.19:0/257233345 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d86876480 msgr2=0x559d8687fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:55.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.460+0000 7f5e97537740 1 --2- 172.21.15.19:0/257233345 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d86876480 0x559d8687fa70 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f5e8003cef0 tx=0x7f5e8002a480 comp rx=0 tx=0).stop 2024-09-19T09:03:55.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.460+0000 7f5e97537740 1 -- 172.21.15.19:0/257233345 shutdown_connections 2024-09-19T09:03:55.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.461+0000 7f5e97537740 1 --2- 172.21.15.19:0/257233345 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d86880d40 0x559d86898600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.461+0000 7f5e97537740 1 --2- 172.21.15.19:0/257233345 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d86876480 0x559d8687fa70 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.461+0000 7f5e97537740 1 --2- 172.21.15.19:0/257233345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559d86875b60 0x559d868785c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.461+0000 7f5e97537740 1 -- 172.21.15.19:0/257233345 >> 172.21.15.19:0/257233345 conn(0x559d868720f0 msgr2=0x559d8687f360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:55.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.461+0000 7f5e97537740 1 -- 172.21.15.19:0/257233345 shutdown_connections 2024-09-19T09:03:55.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.461+0000 7f5e97537740 1 -- 172.21.15.19:0/257233345 wait complete. 2024-09-19T09:03:55.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.461+0000 7f5e97537740 1 -- start start 2024-09-19T09:03:55.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.461+0000 7f5e97537740 1 Processor -- start 2024-09-19T09:03:55.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.461+0000 7f5e97537740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d86875b60 0x559d868890d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.461+0000 7f5e97537740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559d86876480 0x559d86889610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.461+0000 7f5e97537740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d86880d40 0x559d86884650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.461+0000 7f5e97537740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5e901aea50 con 0x559d86875b60 2024-09-19T09:03:55.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.461+0000 7f5e97537740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5e901ae380 con 0x559d86880d40 2024-09-19T09:03:55.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.461+0000 7f5e97537740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5e901ab5c0 con 0x559d86876480 2024-09-19T09:03:55.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.461+0000 7f5e97537740 10 client.0 _ll_register_callbacks cb 0x7f5e80005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:55.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.461+0000 7f5e8e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d86875b60 0x559d868890d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.462+0000 7f5e8e59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d86875b60 0x559d868890d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59164/0 (socket says 172.21.15.19:59164) 2024-09-19T09:03:55.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.462+0000 7f5e8e59c640 1 -- 172.21.15.19:0/1610622471 learned_addr learned my addr 172.21.15.19:0/1610622471 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:55.496 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T09:03:55.496 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-19T09:03:55.496 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "a250ea51-fdf0-44b5-84c5-eea5b1878b85", 2024-09-19T09:03:55.496 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-19T09:03:55.496 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T09:03:55.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.462+0000 7f5e8ed9d640 1 --2- 172.21.15.19:0/1610622471 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559d86876480 0x559d86889610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.462+0000 7f5e8e59c640 1 -- 172.21.15.19:0/1610622471 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559d86876480 msgr2=0x559d86889610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:55.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.462+0000 7f5e8e59c640 1 --2- 172.21.15.19:0/1610622471 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559d86876480 0x559d86889610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.462+0000 7f5e8e59c640 1 -- 172.21.15.19:0/1610622471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d86880d40 msgr2=0x559d86884650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:55.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.462+0000 7f5e8e59c640 1 --2- 172.21.15.19:0/1610622471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d86880d40 0x559d86884650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.462+0000 7f5e8e59c640 1 -- 172.21.15.19:0/1610622471 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d86884e80 con 0x559d86875b60 2024-09-19T09:03:55.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.462+0000 7f5e8e59c640 1 --2- 172.21.15.19:0/1610622471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d86875b60 0x559d868890d0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f5e84012540 tx=0x7f5e8400bb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6433c345777498 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:55.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.462+0000 7f5e72ff5640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:55.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.462+0000 7f5e72ff5640 1 -- 172.21.15.19:0/1610622471 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e84016040 con 0x559d86875b60 2024-09-19T09:03:55.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.462+0000 7f5e72ff5640 1 -- 172.21.15.19:0/1610622471 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f5e84005250 con 0x559d86875b60 2024-09-19T09:03:55.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.462+0000 7f5e97537740 1 -- 172.21.15.19:0/1610622471 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e80053070 con 0x559d86875b60 2024-09-19T09:03:55.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.462+0000 7f5e72ff5640 1 -- 172.21.15.19:0/1610622471 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f5e84005450 con 0x559d86875b60 2024-09-19T09:03:55.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.462+0000 7f5e97537740 10 client.18459 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:55.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.462+0000 7f5e97537740 1 -- 172.21.15.19:0/1610622471 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x559d868fb290 con 0x559d86875b60 2024-09-19T09:03:55.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.463+0000 7f5e72ff5640 1 -- 172.21.15.19:0/1610622471 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e80053070 con 0x559d86875b60 2024-09-19T09:03:55.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.463+0000 7f5e72ff5640 1 -- 172.21.15.19:0/1610622471 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f5e84032030 con 0x559d86875b60 2024-09-19T09:03:55.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.463+0000 7f5e97537740 10 client.18459 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:55.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.463+0000 7f5e97537740 10 client.18459 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:55.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.463+0000 7f5e97537740 20 client.18459 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:55.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.463+0000 7f5e97537740 1 --2- 172.21.15.19:0/1610622471 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x559d868fb870 0x559d868fdc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:55.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.463+0000 7f5e97537740 4 client.18459 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:03:55.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.463+0000 7f5e97537740 1 -- 172.21.15.19:0/1610622471 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x559d867e2d00 con 0x559d868fb870 2024-09-19T09:03:55.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.463+0000 7f5e8ed9d640 1 --2- 172.21.15.19:0/1610622471 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x559d868fb870 0x559d868fdc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:55.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.463+0000 7f5e72ff5640 10 client.18459 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:55.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.463+0000 7f5e8ed9d640 1 --2- 172.21.15.19:0/1610622471 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x559d868fb870 0x559d868fdc60 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c73e786a9000f0 server_cookie=89dc9bbfbd7a5ccf in_seq=0 out_seq=0 2024-09-19T09:03:55.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.465+0000 7f5e72ff5640 1 -- 172.21.15.19:0/1610622471 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x559d867e2d00 con 0x559d868fb870 2024-09-19T09:03:55.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.465+0000 7f5e72ff5640 10 client.18459 handle_command_reply: tid=0 2024-09-19T09:03:55.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.465+0000 7f5e97537740 1 client.18459 shutdown 2024-09-19T09:03:55.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.465+0000 7f5e97537740 1 -- 172.21.15.19:0/1610622471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d86875b60 msgr2=0x559d868890d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:55.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.465+0000 7f5e97537740 1 --2- 172.21.15.19:0/1610622471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d86875b60 0x559d868890d0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f5e84012540 tx=0x7f5e8400bb30 comp rx=0 tx=0).stop 2024-09-19T09:03:55.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.465+0000 7f5e97537740 1 -- 172.21.15.19:0/1610622471 shutdown_connections 2024-09-19T09:03:55.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.465+0000 7f5e97537740 1 --2- 172.21.15.19:0/1610622471 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x559d868fb870 0x559d868fdc60 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.465+0000 7f5e72ff5640 0 client.18459 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:55.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.465+0000 7f5e97537740 1 --2- 172.21.15.19:0/1610622471 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559d86876480 0x559d86889610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.465+0000 7f5e97537740 1 --2- 172.21.15.19:0/1610622471 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559d86880d40 0x559d86884650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.465+0000 7f5e97537740 1 --2- 172.21.15.19:0/1610622471 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559d86875b60 0x559d868890d0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.465+0000 7f5e97537740 1 -- 172.21.15.19:0/1610622471 >> 172.21.15.19:0/1610622471 conn(0x559d868720f0 msgr2=0x559d86871270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:55.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.465+0000 7f5e97537740 1 -- 172.21.15.19:0/1610622471 shutdown_connections 2024-09-19T09:03:55.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.465+0000 7f5e97537740 1 -- 172.21.15.19:0/1610622471 wait complete. 2024-09-19T09:03:55.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.465+0000 7f5e97537740 20 client.18459 trim_cache size 0 max 16384 2024-09-19T09:03:55.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.465+0000 7f5e9515e640 1 -- 172.21.15.19:0/3029299480 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5e780a3240 msgr2=0x7f5e780a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:55.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.465+0000 7f5e9515e640 1 --2- 172.21.15.19:0/3029299480 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5e780a3240 0x7f5e780a5700 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5e8809c0b0 tx=0x7f5e8806efa0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.465+0000 7f5e9515e640 1 -- 172.21.15.19:0/3029299480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e9010c170 msgr2=0x7f5e9019cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:55.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.465+0000 7f5e9515e640 1 --2- 172.21.15.19:0/3029299480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e9010c170 0x7f5e9019cd40 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f5e8800eaa0 tx=0x7f5e8800ef60 comp rx=0 tx=0).stop 2024-09-19T09:03:55.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.466+0000 7f5e9515e640 1 -- 172.21.15.19:0/3029299480 shutdown_connections 2024-09-19T09:03:55.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.466+0000 7f5e9515e640 1 --2- 172.21.15.19:0/3029299480 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5e780a3240 0x7f5e780a5700 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.466+0000 7f5e9515e640 1 --2- 172.21.15.19:0/3029299480 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e90103660 0x7f5e901989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.466+0000 7f5e9515e640 1 --2- 172.21.15.19:0/3029299480 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e9010c170 0x7f5e9019cd40 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.466+0000 7f5e9515e640 1 --2- 172.21.15.19:0/3029299480 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e90102d40 0x7f5e90198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:55.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.466+0000 7f5e9515e640 1 -- 172.21.15.19:0/3029299480 >> 172.21.15.19:0/3029299480 conn(0x7f5e900fc7a0 msgr2=0x7f5e900fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:55.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.466+0000 7f5e9515e640 1 -- 172.21.15.19:0/3029299480 shutdown_connections 2024-09-19T09:03:55.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:55.466+0000 7f5e9515e640 1 -- 172.21.15.19:0/3029299480 wait complete. 2024-09-19T09:03:56.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:55 smithi155 ceph-mon[34921]: pgmap v690: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 2.2 KiB/s wr, 16 op/s 2024-09-19T09:03:56.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:55 smithi203 ceph-mon[35450]: pgmap v690: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 2.2 KiB/s wr, 16 op/s 2024-09-19T09:03:56.285 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:55 smithi019 ceph-mon[30976]: pgmap v690: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 2.2 KiB/s wr, 16 op/s 2024-09-19T09:03:56.318 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:03:56.577 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:56.965 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:56 smithi019 ceph-mon[30976]: scrub queued for path: / 2024-09-19T09:03:56.965 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:56 smithi019 ceph-mon[30976]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:56.965 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:56 smithi019 ceph-mon[30976]: scrub summary: active paths [/] 2024-09-19T09:03:56.966 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:56 smithi019 ceph-mon[30976]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:57.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.048+0000 7f4106081640 1 -- 172.21.15.19:0/2264713547 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4100102d40 msgr2=0x7f4100103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:57.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.048+0000 7f4106081640 1 --2- 172.21.15.19:0/2264713547 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4100102d40 0x7f4100103120 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f40f0009900 tx=0x7f40f002a480 comp rx=0 tx=0).stop 2024-09-19T09:03:57.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.048+0000 7f4106081640 1 -- 172.21.15.19:0/2264713547 shutdown_connections 2024-09-19T09:03:57.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.048+0000 7f4106081640 1 --2- 172.21.15.19:0/2264713547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4100103660 0x7f410010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:57.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.048+0000 7f4106081640 1 --2- 172.21.15.19:0/2264713547 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f410010c170 0x7f410010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:57.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.048+0000 7f4106081640 1 --2- 172.21.15.19:0/2264713547 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4100102d40 0x7f4100103120 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:57.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.048+0000 7f4106081640 1 -- 172.21.15.19:0/2264713547 >> 172.21.15.19:0/2264713547 conn(0x7f41000fc7a0 msgr2=0x7f41000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:57.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.048+0000 7f4106081640 1 -- 172.21.15.19:0/2264713547 shutdown_connections 2024-09-19T09:03:57.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.048+0000 7f4106081640 1 -- 172.21.15.19:0/2264713547 wait complete. 2024-09-19T09:03:57.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.049+0000 7f4106081640 1 Processor -- start 2024-09-19T09:03:57.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.049+0000 7f4106081640 1 -- start start 2024-09-19T09:03:57.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.049+0000 7f4106081640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4100102d40 0x7f41001009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:57.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.049+0000 7f4106081640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4100103660 0x7f4100100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:57.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.049+0000 7f4106081640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f410010c170 0x7f4100101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:57.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.049+0000 7f4106081640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4100111fc0 con 0x7f4100103660 2024-09-19T09:03:57.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.049+0000 7f4106081640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4100111e40 con 0x7f4100102d40 2024-09-19T09:03:57.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.049+0000 7f4106081640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4100112140 con 0x7f410010c170 2024-09-19T09:03:57.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.049+0000 7f40f6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4100103660 0x7f4100100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:57.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.049+0000 7f40f6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4100103660 0x7f4100100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59194/0 (socket says 172.21.15.19:59194) 2024-09-19T09:03:57.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.049+0000 7f40f6ffd640 1 -- 172.21.15.19:0/506235331 learned_addr learned my addr 172.21.15.19:0/506235331 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:57.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.049+0000 7f40ff7fe640 1 --2- 172.21.15.19:0/506235331 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4100102d40 0x7f41001009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:57.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.049+0000 7f40fffff640 1 --2- 172.21.15.19:0/506235331 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f410010c170 0x7f4100101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:57.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.050+0000 7f40f6ffd640 1 -- 172.21.15.19:0/506235331 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f410010c170 msgr2=0x7f4100101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:57.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.050+0000 7f40f6ffd640 1 --2- 172.21.15.19:0/506235331 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f410010c170 0x7f4100101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:57.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.050+0000 7f40f6ffd640 1 -- 172.21.15.19:0/506235331 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4100102d40 msgr2=0x7f41001009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:57.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.050+0000 7f40f6ffd640 1 --2- 172.21.15.19:0/506235331 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4100102d40 0x7f41001009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:57.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.050+0000 7f40f6ffd640 1 -- 172.21.15.19:0/506235331 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41001a6900 con 0x7f4100103660 2024-09-19T09:03:57.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.050+0000 7f40fffff640 1 --2- 172.21.15.19:0/506235331 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f410010c170 0x7f4100101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:57.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.050+0000 7f40f6ffd640 1 --2- 172.21.15.19:0/506235331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4100103660 0x7f4100100ee0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f40e800d950 tx=0x7f40e800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:57.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.050+0000 7f40fd7fa640 1 -- 172.21.15.19:0/506235331 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e8017030 con 0x7f4100103660 2024-09-19T09:03:57.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.050+0000 7f40fd7fa640 1 -- 172.21.15.19:0/506235331 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40e8004020 con 0x7f4100103660 2024-09-19T09:03:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.050+0000 7f4106081640 1 -- 172.21.15.19:0/506235331 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41001a6bf0 con 0x7f4100103660 2024-09-19T09:03:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.050+0000 7f40fd7fa640 1 -- 172.21.15.19:0/506235331 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e80047a0 con 0x7f4100103660 2024-09-19T09:03:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.050+0000 7f4106081640 1 -- 172.21.15.19:0/506235331 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41001a7180 con 0x7f4100103660 2024-09-19T09:03:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.052+0000 7f40fd7fa640 1 -- 172.21.15.19:0/506235331 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f40e80041d0 con 0x7f4100103660 2024-09-19T09:03:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.053+0000 7f410845a740 1 Processor -- start 2024-09-19T09:03:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.053+0000 7f410845a740 1 -- start start 2024-09-19T09:03:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.053+0000 7f410845a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559df59f24a0 0x559df59f2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.053+0000 7f410845a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559df59f2dc0 0x559df59fd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.053+0000 7f410845a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df59fd680 0x559df59ffa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.053+0000 7f410845a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559df59582e0 con 0x559df59f24a0 2024-09-19T09:03:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.053+0000 7f410845a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559df58ffce0 con 0x559df59fd680 2024-09-19T09:03:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.053+0000 7f410845a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559df59542a0 con 0x559df59f2dc0 2024-09-19T09:03:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.053+0000 7f40fffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559df59f24a0 0x559df59f2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:57.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.053+0000 7f40fffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559df59f24a0 0x559df59f2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59200/0 (socket says 172.21.15.19:59200) 2024-09-19T09:03:57.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.053+0000 7f40fffff640 1 -- 172.21.15.19:0/1394710249 learned_addr learned my addr 172.21.15.19:0/1394710249 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:57.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.053+0000 7f40f6ffd640 1 --2- 172.21.15.19:0/1394710249 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df59fd680 0x559df59ffa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:57.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.053+0000 7f40ff7fe640 1 --2- 172.21.15.19:0/1394710249 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559df59f2dc0 0x559df59fd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:57.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.053+0000 7f40fd7fa640 1 --2- 172.21.15.19:0/506235331 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f40ec0a32c0 0x7f40ec0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:57.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.054+0000 7f40fffff640 1 -- 172.21.15.19:0/1394710249 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559df59f2dc0 msgr2=0x559df59fd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:57.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.054+0000 7f40fffff640 1 --2- 172.21.15.19:0/1394710249 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559df59f2dc0 0x559df59fd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:57.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.054+0000 7f40fffff640 1 -- 172.21.15.19:0/1394710249 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df59fd680 msgr2=0x559df59ffa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:57.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.054+0000 7f40fffff640 1 --2- 172.21.15.19:0/1394710249 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df59fd680 0x559df59ffa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:57.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.054+0000 7f40fffff640 1 -- 172.21.15.19:0/1394710249 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559df58e4440 con 0x559df59f24a0 2024-09-19T09:03:57.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.054+0000 7f40fd7fa640 1 -- 172.21.15.19:0/506235331 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f40e80cf230 con 0x7f4100103660 2024-09-19T09:03:57.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.054+0000 7f40fffff640 1 --2- 172.21.15.19:0/506235331 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f40ec0a32c0 0x7f40ec0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:57.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.054+0000 7f40fffff640 1 --2- 172.21.15.19:0/1394710249 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559df59f24a0 0x559df59f2880 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f40f8009fa0 tx=0x7f40f800f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac6c3e0b3b49569 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:57.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.054+0000 7f40f5ffb640 1 -- 172.21.15.19:0/1394710249 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f801a610 con 0x559df59f24a0 2024-09-19T09:03:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.054+0000 7f40f5ffb640 1 -- 172.21.15.19:0/1394710249 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40f801ac90 con 0x559df59f24a0 2024-09-19T09:03:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.054+0000 7f40f5ffb640 1 -- 172.21.15.19:0/1394710249 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f80109d0 con 0x559df59f24a0 2024-09-19T09:03:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.054+0000 7f40fffff640 1 --2- 172.21.15.19:0/506235331 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f40ec0a32c0 0x7f40ec0a5780 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f40f8020000 tx=0x7f40f801d000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.055+0000 7f410845a740 1 -- 172.21.15.19:0/1394710249 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559df59f24a0 msgr2=0x559df59f2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.055+0000 7f410845a740 1 --2- 172.21.15.19:0/1394710249 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559df59f24a0 0x559df59f2880 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f40f8009fa0 tx=0x7f40f800f7f0 comp rx=0 tx=0).stop 2024-09-19T09:03:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.055+0000 7f410845a740 1 -- 172.21.15.19:0/1394710249 shutdown_connections 2024-09-19T09:03:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.055+0000 7f410845a740 1 --2- 172.21.15.19:0/1394710249 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559df59f2dc0 0x559df59fd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.055+0000 7f410845a740 1 --2- 172.21.15.19:0/1394710249 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df59fd680 0x559df59ffa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.055+0000 7f410845a740 1 --2- 172.21.15.19:0/1394710249 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559df59f24a0 0x559df59f2880 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.055+0000 7f410845a740 1 -- 172.21.15.19:0/1394710249 >> 172.21.15.19:0/1394710249 conn(0x559df59eea30 msgr2=0x559df59eee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.055+0000 7f410845a740 1 -- 172.21.15.19:0/1394710249 shutdown_connections 2024-09-19T09:03:57.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.055+0000 7f410845a740 1 -- 172.21.15.19:0/1394710249 wait complete. 2024-09-19T09:03:57.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.055+0000 7f410845a740 1 -- start start 2024-09-19T09:03:57.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.055+0000 7f410845a740 1 Processor -- start 2024-09-19T09:03:57.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.056+0000 7f410845a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559df59f24a0 0x559df59fcf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:57.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.056+0000 7f410845a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df59f2dc0 0x559df59fa1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:57.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.056+0000 7f410845a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559df59fd680 0x559df59fa730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:57.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.056+0000 7f410845a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x559df5a00250 con 0x559df59f24a0 2024-09-19T09:03:57.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.056+0000 7f410845a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x559df5913050 con 0x559df59f2dc0 2024-09-19T09:03:57.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.056+0000 7f410845a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559df5a003d0 con 0x559df59fd680 2024-09-19T09:03:57.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.056+0000 7f410845a740 10 client.0 _ll_register_callbacks cb 0x559df5953160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:57.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.056+0000 7f40ff7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559df59f24a0 0x559df59fcf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:57.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.056+0000 7f40ff7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559df59f24a0 0x559df59fcf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59208/0 (socket says 172.21.15.19:59208) 2024-09-19T09:03:57.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.056+0000 7f40ff7fe640 1 -- 172.21.15.19:0/3190914838 learned_addr learned my addr 172.21.15.19:0/3190914838 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:57.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.056+0000 7f40fffff640 1 --2- 172.21.15.19:0/3190914838 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559df59fd680 0x559df59fa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:57.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.056+0000 7f40f6ffd640 1 --2- 172.21.15.19:0/3190914838 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df59f2dc0 0x559df59fa1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:57.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.056+0000 7f40ff7fe640 1 -- 172.21.15.19:0/3190914838 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559df59fd680 msgr2=0x559df59fa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:57.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.056+0000 7f40ff7fe640 1 --2- 172.21.15.19:0/3190914838 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559df59fd680 0x559df59fa730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:57.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.056+0000 7f40ff7fe640 1 -- 172.21.15.19:0/3190914838 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df59f2dc0 msgr2=0x559df59fa1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:57.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.056+0000 7f40ff7fe640 1 --2- 172.21.15.19:0/3190914838 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df59f2dc0 0x559df59fa1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:57.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.056+0000 7f40ff7fe640 1 -- 172.21.15.19:0/3190914838 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559df56c93c0 con 0x559df59f24a0 2024-09-19T09:03:57.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.056+0000 7f40ff7fe640 1 --2- 172.21.15.19:0/3190914838 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559df59f24a0 0x559df59fcf40 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f40f0009900 tx=0x7f40f0004580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ebb25ed06b9b75 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:57.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.056+0000 7f40deffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:57.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.056+0000 7f40deffd640 1 -- 172.21.15.19:0/3190914838 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f0035040 con 0x559df59f24a0 2024-09-19T09:03:57.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.057+0000 7f40deffd640 1 -- 172.21.15.19:0/3190914838 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f40f00054d0 con 0x559df59f24a0 2024-09-19T09:03:57.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.057+0000 7f410845a740 1 -- 172.21.15.19:0/3190914838 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40f801ac90 con 0x559df59f24a0 2024-09-19T09:03:57.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.057+0000 7f40deffd640 1 -- 172.21.15.19:0/3190914838 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f40f00046c0 con 0x559df59f24a0 2024-09-19T09:03:57.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.057+0000 7f410845a740 10 client.18471 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:57.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.057+0000 7f410845a740 1 -- 172.21.15.19:0/3190914838 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x559df5a0bba0 con 0x559df59f24a0 2024-09-19T09:03:57.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.057+0000 7f40deffd640 1 -- 172.21.15.19:0/3190914838 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40f801ac90 con 0x559df59f24a0 2024-09-19T09:03:57.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.057+0000 7f40deffd640 1 -- 172.21.15.19:0/3190914838 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f40f0003c00 con 0x559df59f24a0 2024-09-19T09:03:57.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.057+0000 7f410845a740 10 client.18471 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:57.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.057+0000 7f410845a740 10 client.18471 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:57.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.057+0000 7f410845a740 20 client.18471 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:57.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.057+0000 7f410845a740 1 --2- 172.21.15.19:0/3190914838 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x559df5a0d060 0x559df5a0f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:57.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.057+0000 7f410845a740 4 client.18471 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:03:57.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.057+0000 7f410845a740 1 -- 172.21.15.19:0/3190914838 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559df5965850 con 0x559df5a0d060 2024-09-19T09:03:57.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.057+0000 7f40f6ffd640 1 --2- 172.21.15.19:0/3190914838 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x559df5a0d060 0x559df5a0f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:57.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.058+0000 7f40deffd640 10 client.18471 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:57.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.058+0000 7f40f6ffd640 1 --2- 172.21.15.19:0/3190914838 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x559df5a0d060 0x559df5a0f490 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e2cbce83d9a05b9 server_cookie=1b253cde66e9d150 in_seq=0 out_seq=0 2024-09-19T09:03:57.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.059+0000 7f40deffd640 1 -- 172.21.15.19:0/3190914838 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559df5965850 con 0x559df5a0d060 2024-09-19T09:03:57.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.059+0000 7f40deffd640 10 client.18471 handle_command_reply: tid=0 2024-09-19T09:03:57.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.059+0000 7f410845a740 1 client.18471 shutdown 2024-09-19T09:03:57.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.059+0000 7f410845a740 1 -- 172.21.15.19:0/3190914838 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559df59f24a0 msgr2=0x559df59fcf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:57.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.059+0000 7f410845a740 1 --2- 172.21.15.19:0/3190914838 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559df59f24a0 0x559df59fcf40 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f40f0009900 tx=0x7f40f0004580 comp rx=0 tx=0).stop 2024-09-19T09:03:57.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.059+0000 7f410845a740 1 -- 172.21.15.19:0/3190914838 shutdown_connections 2024-09-19T09:03:57.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.059+0000 7f410845a740 1 --2- 172.21.15.19:0/3190914838 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x559df5a0d060 0x559df5a0f490 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:57.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.059+0000 7f410845a740 1 --2- 172.21.15.19:0/3190914838 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559df59fd680 0x559df59fa730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:57.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.059+0000 7f410845a740 1 --2- 172.21.15.19:0/3190914838 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df59f2dc0 0x559df59fa1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:57.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.059+0000 7f40deffd640 0 client.18471 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:57.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.059+0000 7f410845a740 1 --2- 172.21.15.19:0/3190914838 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559df59f24a0 0x559df59fcf40 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:57.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.059+0000 7f410845a740 1 -- 172.21.15.19:0/3190914838 >> 172.21.15.19:0/3190914838 conn(0x559df59eea30 msgr2=0x559df59f4710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:57.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.059+0000 7f410845a740 1 -- 172.21.15.19:0/3190914838 shutdown_connections 2024-09-19T09:03:57.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.059+0000 7f410845a740 1 -- 172.21.15.19:0/3190914838 wait complete. 2024-09-19T09:03:57.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.059+0000 7f410845a740 20 client.18471 trim_cache size 0 max 16384 2024-09-19T09:03:57.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.077+0000 7f410845a740 1 Processor -- start 2024-09-19T09:03:57.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.077+0000 7f410845a740 1 -- start start 2024-09-19T09:03:57.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.077+0000 7f410845a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559df59f24a0 0x559df5a094b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:57.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.077+0000 7f410845a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559df59f2dc0 0x559df5a14d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:57.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.077+0000 7f410845a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df59fd680 0x559df5a152a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:57.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.077+0000 7f410845a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f41001af6e0 con 0x559df59f2dc0 2024-09-19T09:03:57.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.077+0000 7f410845a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f41001b1220 con 0x559df59fd680 2024-09-19T09:03:57.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.077+0000 7f410845a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f41001afdb0 con 0x559df59f24a0 2024-09-19T09:03:57.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.078+0000 7f40f6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559df59f2dc0 0x559df5a14d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:57.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.078+0000 7f40f6ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559df59f2dc0 0x559df5a14d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59214/0 (socket says 172.21.15.19:59214) 2024-09-19T09:03:57.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.078+0000 7f40f6ffd640 1 -- 172.21.15.19:0/1710731840 learned_addr learned my addr 172.21.15.19:0/1710731840 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:57.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.078+0000 7f40fffff640 1 --2- 172.21.15.19:0/1710731840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df59fd680 0x559df5a152a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:57.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.078+0000 7f40ff7fe640 1 --2- 172.21.15.19:0/1710731840 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559df59f24a0 0x559df5a094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:57.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.078+0000 7f40f6ffd640 1 -- 172.21.15.19:0/1710731840 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559df59f24a0 msgr2=0x559df5a094b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:57.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.078+0000 7f40f6ffd640 1 --2- 172.21.15.19:0/1710731840 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559df59f24a0 0x559df5a094b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:57.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.078+0000 7f40f6ffd640 1 -- 172.21.15.19:0/1710731840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df59fd680 msgr2=0x559df5a152a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:57.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.078+0000 7f40f6ffd640 1 --2- 172.21.15.19:0/1710731840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df59fd680 0x559df5a152a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:57.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.078+0000 7f40f6ffd640 1 -- 172.21.15.19:0/1710731840 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559df59ee4d0 con 0x559df59f2dc0 2024-09-19T09:03:57.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.078+0000 7f40ff7fe640 1 --2- 172.21.15.19:0/1710731840 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559df59f24a0 0x559df5a094b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:57.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.078+0000 7f40f6ffd640 1 --2- 172.21.15.19:0/1710731840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559df59f2dc0 0x559df5a14d60 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f40e8009610 tx=0x7f40e8086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f64425d60f26ff9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:57.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.078+0000 7f40f57fa640 1 -- 172.21.15.19:0/1710731840 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e809b340 con 0x559df59f2dc0 2024-09-19T09:03:57.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.078+0000 7f40f57fa640 1 -- 172.21.15.19:0/1710731840 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40e809bf00 con 0x559df59f2dc0 2024-09-19T09:03:57.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.078+0000 7f40f57fa640 1 -- 172.21.15.19:0/1710731840 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e809b160 con 0x559df59f2dc0 2024-09-19T09:03:57.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.079+0000 7f410845a740 1 -- 172.21.15.19:0/1710731840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559df59f2dc0 msgr2=0x559df5a14d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:57.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.079+0000 7f410845a740 1 --2- 172.21.15.19:0/1710731840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559df59f2dc0 0x559df5a14d60 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f40e8009610 tx=0x7f40e8086040 comp rx=0 tx=0).stop 2024-09-19T09:03:57.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.079+0000 7f410845a740 1 -- 172.21.15.19:0/1710731840 shutdown_connections 2024-09-19T09:03:57.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.079+0000 7f410845a740 1 --2- 172.21.15.19:0/1710731840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df59fd680 0x559df5a152a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:57.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.079+0000 7f410845a740 1 --2- 172.21.15.19:0/1710731840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559df59f2dc0 0x559df5a14d60 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:57.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.079+0000 7f410845a740 1 --2- 172.21.15.19:0/1710731840 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559df59f24a0 0x559df5a094b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:57.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.079+0000 7f410845a740 1 -- 172.21.15.19:0/1710731840 >> 172.21.15.19:0/1710731840 conn(0x559df59eea30 msgr2=0x559df59f8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:57.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.079+0000 7f410845a740 1 -- 172.21.15.19:0/1710731840 shutdown_connections 2024-09-19T09:03:57.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.079+0000 7f410845a740 1 -- 172.21.15.19:0/1710731840 wait complete. 2024-09-19T09:03:57.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.079+0000 7f410845a740 1 -- start start 2024-09-19T09:03:57.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.080+0000 7f410845a740 1 Processor -- start 2024-09-19T09:03:57.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.080+0000 7f410845a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559df59f24a0 0x559df5a01470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:57.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.080+0000 7f410845a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df59f2dc0 0x559df5a019b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:57.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.080+0000 7f410845a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559df59fd680 0x559df5a01ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:57.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.080+0000 7f410845a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f41001b0b50 con 0x559df59fd680 2024-09-19T09:03:57.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.080+0000 7f410845a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f41001b0480 con 0x559df59f2dc0 2024-09-19T09:03:57.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.080+0000 7f410845a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f41001ad6c0 con 0x559df59f24a0 2024-09-19T09:03:57.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.080+0000 7f410845a740 10 client.0 _ll_register_callbacks cb 0x7f40f0009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:03:57.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.080+0000 7f40fffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559df59fd680 0x559df5a01ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:57.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.080+0000 7f40fffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559df59fd680 0x559df5a01ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59228/0 (socket says 172.21.15.19:59228) 2024-09-19T09:03:57.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.080+0000 7f40fffff640 1 -- 172.21.15.19:0/1329013422 learned_addr learned my addr 172.21.15.19:0/1329013422 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:57.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.080+0000 7f40ff7fe640 1 --2- 172.21.15.19:0/1329013422 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559df59f24a0 0x559df5a01470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:57.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.080+0000 7f40f6ffd640 1 --2- 172.21.15.19:0/1329013422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df59f2dc0 0x559df5a019b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:57.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.080+0000 7f40fffff640 1 -- 172.21.15.19:0/1329013422 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559df59f24a0 msgr2=0x559df5a01470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:57.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.080+0000 7f40fffff640 1 --2- 172.21.15.19:0/1329013422 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559df59f24a0 0x559df5a01470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:57.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.080+0000 7f40fffff640 1 -- 172.21.15.19:0/1329013422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df59f2dc0 msgr2=0x559df5a019b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:03:57.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.080+0000 7f40fffff640 1 --2- 172.21.15.19:0/1329013422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df59f2dc0 0x559df5a019b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:57.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.080+0000 7f40fffff640 1 -- 172.21.15.19:0/1329013422 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559df5a76e30 con 0x559df59fd680 2024-09-19T09:03:57.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.080+0000 7f40f6ffd640 1 --2- 172.21.15.19:0/1329013422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df59f2dc0 0x559df5a019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:57.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.081+0000 7f40fffff640 1 --2- 172.21.15.19:0/1329013422 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559df59fd680 0x559df5a01ef0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f40f8009280 tx=0x7f40f8010f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f26b3ddaf3aabd1a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:57.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.081+0000 7f40deffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:03:57.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.081+0000 7f40deffd640 1 -- 172.21.15.19:0/1329013422 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40f80094a0 con 0x559df59fd680 2024-09-19T09:03:57.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.081+0000 7f40deffd640 1 -- 172.21.15.19:0/1329013422 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f40f8012250 con 0x559df59fd680 2024-09-19T09:03:57.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.081+0000 7f410845a740 1 -- 172.21.15.19:0/1329013422 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40e809bf00 con 0x559df59fd680 2024-09-19T09:03:57.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.081+0000 7f40deffd640 1 -- 172.21.15.19:0/1329013422 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f40f80103d0 con 0x559df59fd680 2024-09-19T09:03:57.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.081+0000 7f410845a740 10 client.18477 fetch_fsmap learned FSMap version 39 2024-09-19T09:03:57.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.081+0000 7f410845a740 1 -- 172.21.15.19:0/1329013422 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x559df5a78090 con 0x559df59fd680 2024-09-19T09:03:57.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.081+0000 7f40deffd640 1 -- 172.21.15.19:0/1329013422 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f40e809bf00 con 0x559df59fd680 2024-09-19T09:03:57.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.081+0000 7f40deffd640 1 -- 172.21.15.19:0/1329013422 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f40f80257b0 con 0x559df59fd680 2024-09-19T09:03:57.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.081+0000 7f410845a740 10 client.18477 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:03:57.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.081+0000 7f410845a740 10 client.18477 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:03:57.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.081+0000 7f410845a740 20 client.18477 populate_metadata read hostname 'smithi019' 2024-09-19T09:03:57.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.081+0000 7f410845a740 1 --2- 172.21.15.19:0/1329013422 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x559df5a786a0 0x559df5a7aac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:57.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.081+0000 7f410845a740 4 client.18477 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:03:57.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.081+0000 7f410845a740 1 -- 172.21.15.19:0/1329013422 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559df595fd60 con 0x559df5a786a0 2024-09-19T09:03:57.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.082+0000 7f40ff7fe640 1 --2- 172.21.15.19:0/1329013422 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x559df5a786a0 0x559df5a7aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:57.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.082+0000 7f40ff7fe640 1 --2- 172.21.15.19:0/1329013422 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x559df5a786a0 0x559df5a7aac0 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7be3b2f354661c36 server_cookie=7f624e8fa0a03089 in_seq=0 out_seq=0 2024-09-19T09:03:57.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.082+0000 7f40deffd640 10 client.18477 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:57.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.082+0000 7f40deffd640 1 -- 172.21.15.19:0/1329013422 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559df595fd60 con 0x559df5a786a0 2024-09-19T09:03:57.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.082+0000 7f40deffd640 10 client.18477 handle_command_reply: tid=0 2024-09-19T09:03:57.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.082+0000 7f410845a740 1 client.18477 shutdown 2024-09-19T09:03:57.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.082+0000 7f410845a740 1 -- 172.21.15.19:0/1329013422 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559df59fd680 msgr2=0x559df5a01ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:57.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.083+0000 7f410845a740 1 --2- 172.21.15.19:0/1329013422 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559df59fd680 0x559df5a01ef0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f40f8009280 tx=0x7f40f8010f60 comp rx=0 tx=0).stop 2024-09-19T09:03:57.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.083+0000 7f410845a740 1 -- 172.21.15.19:0/1329013422 shutdown_connections 2024-09-19T09:03:57.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.083+0000 7f410845a740 1 --2- 172.21.15.19:0/1329013422 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x559df5a786a0 0x559df5a7aac0 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:57.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.083+0000 7f410845a740 1 --2- 172.21.15.19:0/1329013422 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x559df59fd680 0x559df5a01ef0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:57.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.083+0000 7f410845a740 1 --2- 172.21.15.19:0/1329013422 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x559df59f2dc0 0x559df5a019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:57.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.083+0000 7f410845a740 1 --2- 172.21.15.19:0/1329013422 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559df59f24a0 0x559df5a01470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:57.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.083+0000 7f40deffd640 0 client.18477 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:03:57.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.083+0000 7f410845a740 1 -- 172.21.15.19:0/1329013422 >> 172.21.15.19:0/1329013422 conn(0x559df59eea30 msgr2=0x559df59edb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:57.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.083+0000 7f410845a740 1 -- 172.21.15.19:0/1329013422 shutdown_connections 2024-09-19T09:03:57.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.083+0000 7f410845a740 1 -- 172.21.15.19:0/1329013422 wait complete. 2024-09-19T09:03:57.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.083+0000 7f410845a740 20 client.18477 trim_cache size 0 max 16384 2024-09-19T09:03:57.096 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T09:03:57.096 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-19T09:03:57.096 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {} 2024-09-19T09:03:57.096 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T09:03:57.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.083+0000 7f4106081640 1 -- 172.21.15.19:0/506235331 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f40ec0a32c0 msgr2=0x7f40ec0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:57.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.083+0000 7f4106081640 1 --2- 172.21.15.19:0/506235331 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f40ec0a32c0 0x7f40ec0a5780 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f40f8020000 tx=0x7f40f801d000 comp rx=0 tx=0).stop 2024-09-19T09:03:57.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.083+0000 7f4106081640 1 -- 172.21.15.19:0/506235331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4100103660 msgr2=0x7f4100100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:57.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.083+0000 7f4106081640 1 --2- 172.21.15.19:0/506235331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4100103660 0x7f4100100ee0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f40e800d950 tx=0x7f40e800de10 comp rx=0 tx=0).stop 2024-09-19T09:03:57.097 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.083+0000 7f4106081640 1 -- 172.21.15.19:0/506235331 shutdown_connections 2024-09-19T09:03:57.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.083+0000 7f4106081640 1 --2- 172.21.15.19:0/506235331 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f40ec0a32c0 0x7f40ec0a5780 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:57.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.083+0000 7f4106081640 1 --2- 172.21.15.19:0/506235331 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f410010c170 0x7f4100101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:57.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.083+0000 7f4106081640 1 --2- 172.21.15.19:0/506235331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4100103660 0x7f4100100ee0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:57.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.083+0000 7f4106081640 1 --2- 172.21.15.19:0/506235331 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4100102d40 0x7f41001009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:57.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.083+0000 7f4106081640 1 -- 172.21.15.19:0/506235331 >> 172.21.15.19:0/506235331 conn(0x7f41000fc7a0 msgr2=0x7f41000fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:57.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.084+0000 7f4106081640 1 -- 172.21.15.19:0/506235331 shutdown_connections 2024-09-19T09:03:57.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:57.084+0000 7f4106081640 1 -- 172.21.15.19:0/506235331 wait complete. 2024-09-19T09:03:57.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:56 smithi155 ceph-mon[34921]: scrub queued for path: / 2024-09-19T09:03:57.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:56 smithi155 ceph-mon[34921]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:57.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:56 smithi155 ceph-mon[34921]: scrub summary: active paths [/] 2024-09-19T09:03:57.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:56 smithi155 ceph-mon[34921]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:57.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:56 smithi203 ceph-mon[35450]: scrub queued for path: / 2024-09-19T09:03:57.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:56 smithi203 ceph-mon[35450]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:57.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:56 smithi203 ceph-mon[35450]: scrub summary: active paths [/] 2024-09-19T09:03:57.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:56 smithi203 ceph-mon[35450]: scrub summary: idle+waiting paths [/] 2024-09-19T09:03:57.833 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:03:57.913 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:03:57.914 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:03:58.108 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:58.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:57 smithi155 ceph-mon[34921]: pgmap v691: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.9 KiB/s wr, 13 op/s 2024-09-19T09:03:58.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:57 smithi155 ceph-mon[34921]: scrub summary: idle 2024-09-19T09:03:58.231 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:57 smithi019 ceph-mon[30976]: pgmap v691: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.9 KiB/s wr, 13 op/s 2024-09-19T09:03:58.231 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:57 smithi019 ceph-mon[30976]: scrub summary: idle 2024-09-19T09:03:58.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:57 smithi203 ceph-mon[35450]: pgmap v691: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.9 KiB/s wr, 13 op/s 2024-09-19T09:03:58.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:57 smithi203 ceph-mon[35450]: scrub summary: idle 2024-09-19T09:03:58.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.599+0000 7f64ef484640 1 -- 172.21.15.19:0/3269701584 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64e8102790 msgr2=0x7f64e81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:58.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.599+0000 7f64ef484640 1 --2- 172.21.15.19:0/3269701584 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64e8102790 0x7f64e81067e0 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f64d8009900 tx=0x7f64d802a410 comp rx=0 tx=0).stop 2024-09-19T09:03:58.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.599+0000 7f64ef484640 1 -- 172.21.15.19:0/3269701584 shutdown_connections 2024-09-19T09:03:58.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.599+0000 7f64ef484640 1 --2- 172.21.15.19:0/3269701584 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64e8106f10 0x7f64e810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:58.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.599+0000 7f64ef484640 1 --2- 172.21.15.19:0/3269701584 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64e8102790 0x7f64e81067e0 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:58.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.599+0000 7f64ef484640 1 --2- 172.21.15.19:0/3269701584 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f64e8101de0 0x7f64e81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:58.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.599+0000 7f64ef484640 1 -- 172.21.15.19:0/3269701584 >> 172.21.15.19:0/3269701584 conn(0x7f64e80fd8c0 msgr2=0x7f64e80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:58.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.599+0000 7f64ef484640 1 -- 172.21.15.19:0/3269701584 shutdown_connections 2024-09-19T09:03:58.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.599+0000 7f64ef484640 1 -- 172.21.15.19:0/3269701584 wait complete. 2024-09-19T09:03:58.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.600+0000 7f64ef484640 1 Processor -- start 2024-09-19T09:03:58.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.600+0000 7f64ef484640 1 -- start start 2024-09-19T09:03:58.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.600+0000 7f64ef484640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64e8101de0 0x7f64e80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:58.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.600+0000 7f64ef484640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64e8102790 0x7f64e8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:58.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.600+0000 7f64ef484640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f64e8106f10 0x7f64e8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:58.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.600+0000 7f64ef484640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f64e8111f90 con 0x7f64e8101de0 2024-09-19T09:03:58.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.600+0000 7f64ef484640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f64e8111e10 con 0x7f64e8102790 2024-09-19T09:03:58.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.600+0000 7f64ef484640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f64e8112110 con 0x7f64e8106f10 2024-09-19T09:03:58.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.600+0000 7f64ed220640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64e8101de0 0x7f64e80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:58.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.600+0000 7f64ed220640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64e8101de0 0x7f64e80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59250/0 (socket says 172.21.15.19:59250) 2024-09-19T09:03:58.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.600+0000 7f64ed220640 1 -- 172.21.15.19:0/3324888708 learned_addr learned my addr 172.21.15.19:0/3324888708 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:58.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.600+0000 7f64eca1f640 1 --2- 172.21.15.19:0/3324888708 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64e8102790 0x7f64e8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:58.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.601+0000 7f64eda21640 1 --2- 172.21.15.19:0/3324888708 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f64e8106f10 0x7f64e8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:58.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.601+0000 7f64ed220640 1 -- 172.21.15.19:0/3324888708 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f64e8106f10 msgr2=0x7f64e8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:58.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.601+0000 7f64ed220640 1 --2- 172.21.15.19:0/3324888708 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f64e8106f10 0x7f64e8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:58.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.601+0000 7f64ed220640 1 -- 172.21.15.19:0/3324888708 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64e8102790 msgr2=0x7f64e8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:58.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.601+0000 7f64ed220640 1 --2- 172.21.15.19:0/3324888708 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64e8102790 0x7f64e8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:58.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.601+0000 7f64ed220640 1 -- 172.21.15.19:0/3324888708 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64e81a6950 con 0x7f64e8101de0 2024-09-19T09:03:58.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.601+0000 7f64eca1f640 1 --2- 172.21.15.19:0/3324888708 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64e8102790 0x7f64e8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:58.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.601+0000 7f64ed220640 1 --2- 172.21.15.19:0/3324888708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64e8101de0 0x7f64e80744f0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f64e400b4a0 tx=0x7f64e400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:58.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.601+0000 7f64de7fc640 1 -- 172.21.15.19:0/3324888708 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e4014070 con 0x7f64e8101de0 2024-09-19T09:03:58.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.601+0000 7f64de7fc640 1 -- 172.21.15.19:0/3324888708 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f64e4010af0 con 0x7f64e8101de0 2024-09-19T09:03:58.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.601+0000 7f64ef484640 1 -- 172.21.15.19:0/3324888708 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64e81a6c40 con 0x7f64e8101de0 2024-09-19T09:03:58.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.601+0000 7f64de7fc640 1 -- 172.21.15.19:0/3324888708 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e4017d10 con 0x7f64e8101de0 2024-09-19T09:03:58.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.601+0000 7f64ef484640 1 -- 172.21.15.19:0/3324888708 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64e81a7180 con 0x7f64e8101de0 2024-09-19T09:03:58.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.602+0000 7f64ef484640 1 -- 172.21.15.19:0/3324888708 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64e81021c0 con 0x7f64e8101de0 2024-09-19T09:03:58.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.603+0000 7f64de7fc640 1 -- 172.21.15.19:0/3324888708 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f64e4017070 con 0x7f64e8101de0 2024-09-19T09:03:58.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.604+0000 7f64de7fc640 1 --2- 172.21.15.19:0/3324888708 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f64d40a32c0 0x7f64d40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:58.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.604+0000 7f64eca1f640 1 --2- 172.21.15.19:0/3324888708 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f64d40a32c0 0x7f64d40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:58.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.604+0000 7f64de7fc640 1 -- 172.21.15.19:0/3324888708 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f64e40ceca0 con 0x7f64e8101de0 2024-09-19T09:03:58.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.604+0000 7f64eca1f640 1 --2- 172.21.15.19:0/3324888708 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f64d40a32c0 0x7f64d40a5780 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f64e8075f80 tx=0x7f64d8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:58.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.608+0000 7f64de7fc640 1 -- 172.21.15.19:0/3324888708 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f64e409b9d0 con 0x7f64e8101de0 2024-09-19T09:03:58.623 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:03:58.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.824+0000 7f64ef484640 1 -- 172.21.15.19:0/3324888708 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f64e810a0f0 con 0x7f64e8101de0 2024-09-19T09:03:58.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.824+0000 7f64de7fc640 1 -- 172.21.15.19:0/3324888708 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+11983 (secure 0 0 0) 0x7f64e409b2d0 con 0x7f64e8101de0 2024-09-19T09:03:58.825 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T09:03:58.826 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":39,"btime":"2024-09-19T09:02:47:631181+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":17751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/3815927080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":3815927080},{"type":"v1","addr":"172.21.15.19:6839","nonce":3815927080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":39,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T09:02:47.631165+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26453":{"gid":26453,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/3907362737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3907362737},{"type":"v1","addr":"172.21.15.155:6835","nonce":3907362737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24469,24490,24464,24463]},"id":1}]} 2024-09-19T09:03:58.826 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 39 2024-09-19T09:03:58.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.826+0000 7f64ef484640 1 -- 172.21.15.19:0/3324888708 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f64d40a32c0 msgr2=0x7f64d40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:58.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.826+0000 7f64ef484640 1 --2- 172.21.15.19:0/3324888708 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f64d40a32c0 0x7f64d40a5780 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f64e8075f80 tx=0x7f64d8005a20 comp rx=0 tx=0).stop 2024-09-19T09:03:58.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.827+0000 7f64ef484640 1 -- 172.21.15.19:0/3324888708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64e8101de0 msgr2=0x7f64e80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:58.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.827+0000 7f64ef484640 1 --2- 172.21.15.19:0/3324888708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64e8101de0 0x7f64e80744f0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f64e400b4a0 tx=0x7f64e400b960 comp rx=0 tx=0).stop 2024-09-19T09:03:58.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.827+0000 7f64ef484640 1 -- 172.21.15.19:0/3324888708 shutdown_connections 2024-09-19T09:03:58.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.827+0000 7f64ef484640 1 --2- 172.21.15.19:0/3324888708 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f64d40a32c0 0x7f64d40a5780 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:58.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.827+0000 7f64ef484640 1 --2- 172.21.15.19:0/3324888708 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f64e8106f10 0x7f64e8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:58.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.827+0000 7f64ef484640 1 --2- 172.21.15.19:0/3324888708 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f64e8102790 0x7f64e8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:58.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.827+0000 7f64ef484640 1 --2- 172.21.15.19:0/3324888708 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f64e8101de0 0x7f64e80744f0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:58.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.827+0000 7f64ef484640 1 -- 172.21.15.19:0/3324888708 >> 172.21.15.19:0/3324888708 conn(0x7f64e80fd8c0 msgr2=0x7f64e80fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:58.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.827+0000 7f64ef484640 1 -- 172.21.15.19:0/3324888708 shutdown_connections 2024-09-19T09:03:58.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:58.827+0000 7f64ef484640 1 -- 172.21.15.19:0/3324888708 wait complete. 2024-09-19T09:03:59.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:58 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3324888708' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:59.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:58 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3324888708' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:59.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:58 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3324888708' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:03:59.629 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db --set-id a8b5c724 --release --await' 2024-09-19T09:03:59.629 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db --set-id a8b5c724 --release --await 2024-09-19T09:03:59.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.829+0000 7fecfa165640 1 -- 172.21.15.19:0/3484102648 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fecf4102ef0 msgr2=0x7fecf410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:59.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.829+0000 7fecfa165640 1 --2- 172.21.15.19:0/3484102648 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fecf4102ef0 0x7fecf410da40 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fecec009ca0 tx=0x7fecec02a950 comp rx=0 tx=0).stop 2024-09-19T09:03:59.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.829+0000 7fecfa165640 1 -- 172.21.15.19:0/3484102648 shutdown_connections 2024-09-19T09:03:59.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.829+0000 7fecfa165640 1 --2- 172.21.15.19:0/3484102648 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fecf4102ef0 0x7fecf410da40 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:59.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.829+0000 7fecfa165640 1 --2- 172.21.15.19:0/3484102648 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fecf4102570 0x7fecf41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:59.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.829+0000 7fecfa165640 1 --2- 172.21.15.19:0/3484102648 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fecf4100e20 0x7fecf4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:59.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.829+0000 7fecfa165640 1 -- 172.21.15.19:0/3484102648 >> 172.21.15.19:0/3484102648 conn(0x7fecf40fc7d0 msgr2=0x7fecf40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:03:59.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.829+0000 7fecfa165640 1 -- 172.21.15.19:0/3484102648 shutdown_connections 2024-09-19T09:03:59.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.829+0000 7fecfa165640 1 -- 172.21.15.19:0/3484102648 wait complete. 2024-09-19T09:03:59.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.830+0000 7fecfa165640 1 Processor -- start 2024-09-19T09:03:59.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.830+0000 7fecfa165640 1 -- start start 2024-09-19T09:03:59.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.830+0000 7fecfa165640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fecf4100e20 0x7fecf4197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:59.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.830+0000 7fecfa165640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fecf4102570 0x7fecf4197790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:59.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.830+0000 7fecfa165640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fecf4102ef0 0x7fecf419bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:59.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.830+0000 7fecfa165640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fecf4110fd0 con 0x7fecf4102ef0 2024-09-19T09:03:59.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.830+0000 7fecfa165640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fecf4110e50 con 0x7fecf4102570 2024-09-19T09:03:59.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.830+0000 7fecfa165640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fecf4111150 con 0x7fecf4100e20 2024-09-19T09:03:59.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.830+0000 7fecf3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fecf4102ef0 0x7fecf419bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:59.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.830+0000 7fecf3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fecf4102ef0 0x7fecf419bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59266/0 (socket says 172.21.15.19:59266) 2024-09-19T09:03:59.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.830+0000 7fecf3fff640 1 -- 172.21.15.19:0/520070294 learned_addr learned my addr 172.21.15.19:0/520070294 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:03:59.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.831+0000 7fecf2ffd640 1 --2- 172.21.15.19:0/520070294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fecf4102570 0x7fecf4197790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:59.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.831+0000 7fecf37fe640 1 --2- 172.21.15.19:0/520070294 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fecf4100e20 0x7fecf4197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:59.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.831+0000 7fecf3fff640 1 -- 172.21.15.19:0/520070294 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fecf4100e20 msgr2=0x7fecf4197250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:59.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.831+0000 7fecf3fff640 1 --2- 172.21.15.19:0/520070294 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fecf4100e20 0x7fecf4197250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:59.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.831+0000 7fecf3fff640 1 -- 172.21.15.19:0/520070294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fecf4102570 msgr2=0x7fecf4197790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:03:59.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.831+0000 7fecf3fff640 1 --2- 172.21.15.19:0/520070294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fecf4102570 0x7fecf4197790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:03:59.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.831+0000 7fecf3fff640 1 -- 172.21.15.19:0/520070294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf419c200 con 0x7fecf4102ef0 2024-09-19T09:03:59.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.831+0000 7fecf37fe640 1 --2- 172.21.15.19:0/520070294 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fecf4100e20 0x7fecf4197250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:03:59.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.831+0000 7fecf2ffd640 1 --2- 172.21.15.19:0/520070294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fecf4102570 0x7fecf4197790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:03:59.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.831+0000 7fecf3fff640 1 --2- 172.21.15.19:0/520070294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fecf4102ef0 0x7fecf419bb20 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fecec0098d0 tx=0x7fecec003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:59.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.832+0000 7fecf0ff9640 1 -- 172.21.15.19:0/520070294 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecec034040 con 0x7fecf4102ef0 2024-09-19T09:03:59.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.832+0000 7fecf0ff9640 1 -- 172.21.15.19:0/520070294 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fecec02fe10 con 0x7fecf4102ef0 2024-09-19T09:03:59.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.832+0000 7fecfa165640 1 -- 172.21.15.19:0/520070294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecf419c490 con 0x7fecf4102ef0 2024-09-19T09:03:59.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.832+0000 7fecf0ff9640 1 -- 172.21.15.19:0/520070294 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecec039450 con 0x7fecf4102ef0 2024-09-19T09:03:59.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.832+0000 7fecfa165640 1 -- 172.21.15.19:0/520070294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecf41a3dd0 con 0x7fecf4102ef0 2024-09-19T09:03:59.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.833+0000 7fecfa165640 1 -- 172.21.15.19:0/520070294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecf41021b0 con 0x7fecf4102ef0 2024-09-19T09:03:59.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.834+0000 7fecf0ff9640 1 -- 172.21.15.19:0/520070294 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fecec037020 con 0x7fecf4102ef0 2024-09-19T09:03:59.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.835+0000 7fecf0ff9640 1 --2- 172.21.15.19:0/520070294 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fecdc0a3240 0x7fecdc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:03:59.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.835+0000 7fecf37fe640 1 --2- 172.21.15.19:0/520070294 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fecdc0a3240 0x7fecdc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:03:59.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.835+0000 7fecf0ff9640 1 -- 172.21.15.19:0/520070294 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7fecec0f0a40 con 0x7fecf4102ef0 2024-09-19T09:03:59.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.836+0000 7fecf37fe640 1 --2- 172.21.15.19:0/520070294 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fecdc0a3240 0x7fecdc0a5700 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fece400baa0 tx=0x7fece4005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:03:59.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:03:59.840+0000 7fecf0ff9640 1 -- 172.21.15.19:0/520070294 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fecec0bd770 con 0x7fecf4102ef0 2024-09-19T09:03:59.902 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:00.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:00.062+0000 7fecfa165640 1 -- 172.21.15.19:0/520070294 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fecf41a3fa0 con 0x7fecf4102ef0 2024-09-19T09:04:00.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:00.062+0000 7fecf0ff9640 1 -- 172.21.15.19:0/520070294 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+11983 (secure 0 0 0) 0x7fecec0bd070 con 0x7fecf4102ef0 2024-09-19T09:04:00.064 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T09:04:00.064 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":39,"btime":"2024-09-19T09:02:47:631181+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":17751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/3815927080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":3815927080},{"type":"v1","addr":"172.21.15.19:6839","nonce":3815927080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":39,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T09:02:47.631165+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26453":{"gid":26453,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/3907362737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3907362737},{"type":"v1","addr":"172.21.15.155:6835","nonce":3907362737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24469,24490,24464,24463]},"id":1}]} 2024-09-19T09:04:00.064 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 39 2024-09-19T09:04:00.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:00.065+0000 7fecfa165640 1 -- 172.21.15.19:0/520070294 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fecdc0a3240 msgr2=0x7fecdc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:00.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:00.065+0000 7fecfa165640 1 --2- 172.21.15.19:0/520070294 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fecdc0a3240 0x7fecdc0a5700 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fece400baa0 tx=0x7fece4005d90 comp rx=0 tx=0).stop 2024-09-19T09:04:00.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:00.065+0000 7fecfa165640 1 -- 172.21.15.19:0/520070294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fecf4102ef0 msgr2=0x7fecf419bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:00.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:00.065+0000 7fecfa165640 1 --2- 172.21.15.19:0/520070294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fecf4102ef0 0x7fecf419bb20 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fecec0098d0 tx=0x7fecec003f10 comp rx=0 tx=0).stop 2024-09-19T09:04:00.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:00.065+0000 7fecfa165640 1 -- 172.21.15.19:0/520070294 shutdown_connections 2024-09-19T09:04:00.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:00.065+0000 7fecfa165640 1 --2- 172.21.15.19:0/520070294 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fecdc0a3240 0x7fecdc0a5700 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:00.065+0000 7fecfa165640 1 --2- 172.21.15.19:0/520070294 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fecf4102ef0 0x7fecf419bb20 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:00.065+0000 7fecfa165640 1 --2- 172.21.15.19:0/520070294 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fecf4102570 0x7fecf4197790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:00.065+0000 7fecfa165640 1 --2- 172.21.15.19:0/520070294 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fecf4100e20 0x7fecf4197250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:00.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:00.065+0000 7fecfa165640 1 -- 172.21.15.19:0/520070294 >> 172.21.15.19:0/520070294 conn(0x7fecf40fc7d0 msgr2=0x7fecf41056e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:00.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:00.065+0000 7fecfa165640 1 -- 172.21.15.19:0/520070294 shutdown_connections 2024-09-19T09:04:00.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:00.065+0000 7fecfa165640 1 -- 172.21.15.19:0/520070294 wait complete. 2024-09-19T09:04:00.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:03:59 smithi155 ceph-mon[34921]: pgmap v692: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-19T09:04:00.197 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:03:59 smithi019 ceph-mon[30976]: pgmap v692: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-19T09:04:00.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:03:59 smithi203 ceph-mon[35450]: pgmap v692: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-19T09:04:00.930 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T09:04:01.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:00 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/520070294' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:01.188 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:00 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/520070294' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:01.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.192+0000 7f6819ad2640 1 -- 172.21.15.19:0/747264175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6814102ef0 msgr2=0x7f681410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:01.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.192+0000 7f6819ad2640 1 --2- 172.21.15.19:0/747264175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6814102ef0 0x7f681410da40 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f680c009ca0 tx=0x7f680c02a950 comp rx=0 tx=0).stop 2024-09-19T09:04:01.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.193+0000 7f6819ad2640 1 -- 172.21.15.19:0/747264175 shutdown_connections 2024-09-19T09:04:01.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.193+0000 7f6819ad2640 1 --2- 172.21.15.19:0/747264175 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6814102ef0 0x7f681410da40 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.193+0000 7f6819ad2640 1 --2- 172.21.15.19:0/747264175 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6814102570 0x7f68141029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.193+0000 7f6819ad2640 1 --2- 172.21.15.19:0/747264175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6814100e20 0x7f6814101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.193+0000 7f6819ad2640 1 -- 172.21.15.19:0/747264175 >> 172.21.15.19:0/747264175 conn(0x7f68140fc7d0 msgr2=0x7f68140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:01.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.193+0000 7f6819ad2640 1 -- 172.21.15.19:0/747264175 shutdown_connections 2024-09-19T09:04:01.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.193+0000 7f6819ad2640 1 -- 172.21.15.19:0/747264175 wait complete. 2024-09-19T09:04:01.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.193+0000 7f6819ad2640 1 Processor -- start 2024-09-19T09:04:01.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.194+0000 7f6819ad2640 1 -- start start 2024-09-19T09:04:01.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.194+0000 7f6819ad2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6814100e20 0x7f6814199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:01.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.194+0000 7f6819ad2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6814102570 0x7f6814199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:01.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.194+0000 7f6819ad2640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6814102ef0 0x7f6814199df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:01.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.194+0000 7f6819ad2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6814110f80 con 0x7f6814102570 2024-09-19T09:04:01.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.194+0000 7f6819ad2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6814110e00 con 0x7f6814100e20 2024-09-19T09:04:01.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.194+0000 7f6819ad2640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6814111100 con 0x7f6814102ef0 2024-09-19T09:04:01.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.194+0000 7f6812ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6814102570 0x7f6814199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:01.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.194+0000 7f6812ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6814102570 0x7f6814199870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59282/0 (socket says 172.21.15.19:59282) 2024-09-19T09:04:01.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.194+0000 7f6812ffd640 1 -- 172.21.15.19:0/915780320 learned_addr learned my addr 172.21.15.19:0/915780320 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:01.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.194+0000 7f68137fe640 1 --2- 172.21.15.19:0/915780320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6814100e20 0x7f6814199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:01.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.194+0000 7f6813fff640 1 --2- 172.21.15.19:0/915780320 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6814102ef0 0x7f6814199df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:01.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.194+0000 7f6812ffd640 1 -- 172.21.15.19:0/915780320 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6814102ef0 msgr2=0x7f6814199df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:01.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.194+0000 7f6812ffd640 1 --2- 172.21.15.19:0/915780320 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6814102ef0 0x7f6814199df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.194+0000 7f6812ffd640 1 -- 172.21.15.19:0/915780320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6814100e20 msgr2=0x7f6814199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:01.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.194+0000 7f6812ffd640 1 --2- 172.21.15.19:0/915780320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6814100e20 0x7f6814199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.194+0000 7f6812ffd640 1 -- 172.21.15.19:0/915780320 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68141a4730 con 0x7f6814102570 2024-09-19T09:04:01.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.195+0000 7f6812ffd640 1 --2- 172.21.15.19:0/915780320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6814102570 0x7f6814199870 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f680800e9f0 tx=0x7f680800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:01.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.195+0000 7f6810ff9640 1 -- 172.21.15.19:0/915780320 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680800cd80 con 0x7f6814102570 2024-09-19T09:04:01.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.195+0000 7f6810ff9640 1 -- 172.21.15.19:0/915780320 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6808010910 con 0x7f6814102570 2024-09-19T09:04:01.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.195+0000 7f6819ad2640 1 -- 172.21.15.19:0/915780320 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68141a4a20 con 0x7f6814102570 2024-09-19T09:04:01.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.195+0000 7f6810ff9640 1 -- 172.21.15.19:0/915780320 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6808018990 con 0x7f6814102570 2024-09-19T09:04:01.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.195+0000 7f6819ad2640 1 -- 172.21.15.19:0/915780320 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68141a4fb0 con 0x7f6814102570 2024-09-19T09:04:01.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.197+0000 7f6810ff9640 1 -- 172.21.15.19:0/915780320 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f6808010ac0 con 0x7f6814102570 2024-09-19T09:04:01.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.197+0000 7f681beab740 1 Processor -- start 2024-09-19T09:04:01.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.197+0000 7f681beab740 1 -- start start 2024-09-19T09:04:01.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.198+0000 7f681beab740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557590eef060 0x557590eef440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:01.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.198+0000 7f681beab740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557590eef980 0x557590ef9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:01.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.198+0000 7f681beab740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557590efa240 0x557590efc630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:01.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.198+0000 7f681beab740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557590e54620 con 0x557590efa240 2024-09-19T09:04:01.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.198+0000 7f681beab740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x557590dfbe50 con 0x557590eef060 2024-09-19T09:04:01.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.198+0000 7f681beab740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557590e505e0 con 0x557590eef980 2024-09-19T09:04:01.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.198+0000 7f6810ff9640 1 --2- 172.21.15.19:0/915780320 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f67fc0a32c0 0x7f67fc0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:01.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.198+0000 7f6813fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557590eef060 0x557590eef440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:01.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.198+0000 7f6813fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557590eef060 0x557590eef440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:58658/0 (socket says 172.21.15.19:58658) 2024-09-19T09:04:01.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.198+0000 7f6813fff640 1 -- 172.21.15.19:0/221385972 learned_addr learned my addr 172.21.15.19:0/221385972 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:01.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.198+0000 7f68137fe640 1 --2- 172.21.15.19:0/221385972 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557590eef980 0x557590ef9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:01.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.198+0000 7f6810ff9640 1 -- 172.21.15.19:0/915780320 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f68080cfcd0 con 0x7f6814102570 2024-09-19T09:04:01.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.198+0000 7f6813fff640 1 --2- 172.21.15.19:0/915780320 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f67fc0a32c0 0x7f67fc0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:01.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.198+0000 7f6812ffd640 1 --2- 172.21.15.19:0/221385972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557590efa240 0x557590efc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:01.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.198+0000 7f68137fe640 1 -- 172.21.15.19:0/221385972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557590eef060 msgr2=0x557590eef440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:01.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.198+0000 7f68137fe640 1 --2- 172.21.15.19:0/221385972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557590eef060 0x557590eef440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.198+0000 7f68137fe640 1 -- 172.21.15.19:0/221385972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557590efa240 msgr2=0x557590efc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:01.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.198+0000 7f68137fe640 1 --2- 172.21.15.19:0/221385972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557590efa240 0x557590efc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.198+0000 7f68137fe640 1 -- 172.21.15.19:0/221385972 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557590decd40 con 0x557590eef980 2024-09-19T09:04:01.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.199+0000 7f68137fe640 1 --2- 172.21.15.19:0/221385972 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557590eef980 0x557590ef9d00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f680400bbe0 tx=0x7f680400f730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=954840719fdf19fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:01.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.199+0000 7f6813fff640 1 --2- 172.21.15.19:0/915780320 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f67fc0a32c0 0x7f67fc0a5780 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f680c009430 tx=0x7f680c02a950 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:01.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.199+0000 7f67f9ffb640 1 -- 172.21.15.19:0/221385972 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6804015070 con 0x557590eef980 2024-09-19T09:04:01.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.199+0000 7f67f9ffb640 1 -- 172.21.15.19:0/221385972 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68040035f0 con 0x557590eef980 2024-09-19T09:04:01.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.199+0000 7f67f9ffb640 1 -- 172.21.15.19:0/221385972 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68040116a0 con 0x557590eef980 2024-09-19T09:04:01.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.200+0000 7f681beab740 1 -- 172.21.15.19:0/221385972 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557590eef980 msgr2=0x557590ef9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:01.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.200+0000 7f681beab740 1 --2- 172.21.15.19:0/221385972 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557590eef980 0x557590ef9d00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f680400bbe0 tx=0x7f680400f730 comp rx=0 tx=0).stop 2024-09-19T09:04:01.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.200+0000 7f681beab740 1 -- 172.21.15.19:0/221385972 shutdown_connections 2024-09-19T09:04:01.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.200+0000 7f681beab740 1 --2- 172.21.15.19:0/221385972 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557590eef980 0x557590ef9d00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.200+0000 7f681beab740 1 --2- 172.21.15.19:0/221385972 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557590efa240 0x557590efc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.200+0000 7f681beab740 1 --2- 172.21.15.19:0/221385972 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557590eef060 0x557590eef440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.200+0000 7f681beab740 1 -- 172.21.15.19:0/221385972 >> 172.21.15.19:0/221385972 conn(0x557590eeb5f0 msgr2=0x557590eeb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:01.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.200+0000 7f681beab740 1 -- 172.21.15.19:0/221385972 shutdown_connections 2024-09-19T09:04:01.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.200+0000 7f681beab740 1 -- 172.21.15.19:0/221385972 wait complete. 2024-09-19T09:04:01.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.200+0000 7f681beab740 1 -- start start 2024-09-19T09:04:01.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.200+0000 7f681beab740 1 Processor -- start 2024-09-19T09:04:01.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.201+0000 7f681beab740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557590eef060 0x557590ef7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:01.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.201+0000 7f681beab740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557590eef980 0x557590ef7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:01.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.201+0000 7f681beab740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557590efa240 0x557590ef7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:01.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.201+0000 7f681beab740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x557590efce10 con 0x557590eef980 2024-09-19T09:04:01.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.201+0000 7f681beab740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x557590ddcf10 con 0x557590eef060 2024-09-19T09:04:01.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.201+0000 7f681beab740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557590efcf90 con 0x557590efa240 2024-09-19T09:04:01.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.201+0000 7f681beab740 10 client.0 _ll_register_callbacks cb 0x557590e00db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:01.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.201+0000 7f6812ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557590eef980 0x557590ef7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:01.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.201+0000 7f6812ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557590eef980 0x557590ef7690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59310/0 (socket says 172.21.15.19:59310) 2024-09-19T09:04:01.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.201+0000 7f6812ffd640 1 -- 172.21.15.19:0/4084670032 learned_addr learned my addr 172.21.15.19:0/4084670032 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:01.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.201+0000 7f6813fff640 1 --2- 172.21.15.19:0/4084670032 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557590efa240 0x557590ef7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:01.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.201+0000 7f68137fe640 1 --2- 172.21.15.19:0/4084670032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557590eef060 0x557590ef7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:01.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.201+0000 7f6812ffd640 1 -- 172.21.15.19:0/4084670032 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557590efa240 msgr2=0x557590ef7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:01.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.201+0000 7f6812ffd640 1 --2- 172.21.15.19:0/4084670032 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557590efa240 0x557590ef7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.201+0000 7f6812ffd640 1 -- 172.21.15.19:0/4084670032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557590eef060 msgr2=0x557590ef7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:01.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.201+0000 7f6812ffd640 1 --2- 172.21.15.19:0/4084670032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557590eef060 0x557590ef7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.201+0000 7f6812ffd640 1 -- 172.21.15.19:0/4084670032 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557590b63580 con 0x557590eef980 2024-09-19T09:04:01.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.201+0000 7f68137fe640 1 --2- 172.21.15.19:0/4084670032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557590eef060 0x557590ef7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:01.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.201+0000 7f6812ffd640 1 --2- 172.21.15.19:0/4084670032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557590eef980 0x557590ef7690 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f680809c230 tx=0x7f680809cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e5c8cf502e47b64 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:01.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.201+0000 7f67f2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:04:01.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.202+0000 7f67f2ffd640 1 -- 172.21.15.19:0/4084670032 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6808018d30 con 0x557590eef980 2024-09-19T09:04:01.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.202+0000 7f67f2ffd640 1 -- 172.21.15.19:0/4084670032 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f68080bc070 con 0x557590eef980 2024-09-19T09:04:01.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.202+0000 7f681beab740 1 -- 172.21.15.19:0/4084670032 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68040035f0 con 0x557590eef980 2024-09-19T09:04:01.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.202+0000 7f67f2ffd640 1 -- 172.21.15.19:0/4084670032 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f68080bc270 con 0x557590eef980 2024-09-19T09:04:01.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.202+0000 7f681beab740 10 client.18501 fetch_fsmap learned FSMap version 39 2024-09-19T09:04:01.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.202+0000 7f681beab740 1 -- 172.21.15.19:0/4084670032 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x557590c2d960 con 0x557590eef980 2024-09-19T09:04:01.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.202+0000 7f67f2ffd640 1 -- 172.21.15.19:0/4084670032 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f68040035f0 con 0x557590eef980 2024-09-19T09:04:01.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.202+0000 7f67f2ffd640 1 -- 172.21.15.19:0/4084670032 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f68080a02b0 con 0x557590eef980 2024-09-19T09:04:01.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.202+0000 7f681beab740 10 client.18501 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:04:01.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.202+0000 7f681beab740 10 client.18501 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:04:01.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.202+0000 7f681beab740 20 client.18501 populate_metadata read hostname 'smithi019' 2024-09-19T09:04:01.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.202+0000 7f681beab740 1 --2- 172.21.15.19:0/4084670032 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557590f09e30 0x557590f0c220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:01.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.202+0000 7f681beab740 4 client.18501 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:01.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.202+0000 7f681beab740 1 -- 172.21.15.19:0/4084670032 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557590e61b90 con 0x557590f09e30 2024-09-19T09:04:01.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.203+0000 7f68137fe640 1 --2- 172.21.15.19:0/4084670032 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557590f09e30 0x557590f0c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:01.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.203+0000 7f67f2ffd640 10 client.18501 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:04:01.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.203+0000 7f68137fe640 1 --2- 172.21.15.19:0/4084670032 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557590f09e30 0x557590f0c220 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9fca6608c2f4bf4 server_cookie=42190dab6d3dbed3 in_seq=0 out_seq=0 2024-09-19T09:04:01.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.204+0000 7f67f2ffd640 1 -- 172.21.15.19:0/4084670032 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557590e61b90 con 0x557590f09e30 2024-09-19T09:04:01.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.204+0000 7f67f2ffd640 10 client.18501 handle_command_reply: tid=0 2024-09-19T09:04:01.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.204+0000 7f681beab740 1 client.18501 shutdown 2024-09-19T09:04:01.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.204+0000 7f681beab740 1 -- 172.21.15.19:0/4084670032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557590eef980 msgr2=0x557590ef7690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:01.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.204+0000 7f681beab740 1 --2- 172.21.15.19:0/4084670032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557590eef980 0x557590ef7690 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f680809c230 tx=0x7f680809cae0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.204+0000 7f681beab740 1 -- 172.21.15.19:0/4084670032 shutdown_connections 2024-09-19T09:04:01.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.204+0000 7f681beab740 1 --2- 172.21.15.19:0/4084670032 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557590f09e30 0x557590f0c220 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.204+0000 7f681beab740 1 --2- 172.21.15.19:0/4084670032 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557590efa240 0x557590ef7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.204+0000 7f681beab740 1 --2- 172.21.15.19:0/4084670032 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557590eef980 0x557590ef7690 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.204+0000 7f681beab740 1 --2- 172.21.15.19:0/4084670032 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557590eef060 0x557590ef7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.204+0000 7f681beab740 1 -- 172.21.15.19:0/4084670032 >> 172.21.15.19:0/4084670032 conn(0x557590eeb5f0 msgr2=0x557590ef12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:01.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.204+0000 7f67f2ffd640 0 client.18501 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:04:01.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.204+0000 7f681beab740 1 -- 172.21.15.19:0/4084670032 shutdown_connections 2024-09-19T09:04:01.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.204+0000 7f681beab740 1 -- 172.21.15.19:0/4084670032 wait complete. 2024-09-19T09:04:01.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.205+0000 7f681beab740 20 client.18501 trim_cache size 0 max 16384 2024-09-19T09:04:01.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.223+0000 7f681beab740 1 Processor -- start 2024-09-19T09:04:01.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.223+0000 7f681beab740 1 -- start start 2024-09-19T09:04:01.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.223+0000 7f681beab740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557590eef060 0x557590ef2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:01.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.223+0000 7f681beab740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557590eef980 0x557590ef11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:01.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.223+0000 7f681beab740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557590efa240 0x557590f11af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:01.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.223+0000 7f681beab740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f68141ad610 con 0x557590efa240 2024-09-19T09:04:01.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.223+0000 7f681beab740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f68141af150 con 0x557590eef060 2024-09-19T09:04:01.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.223+0000 7f681beab740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f68141adce0 con 0x557590eef980 2024-09-19T09:04:01.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.223+0000 7f6813fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557590efa240 0x557590f11af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:01.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.223+0000 7f6813fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557590efa240 0x557590f11af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59316/0 (socket says 172.21.15.19:59316) 2024-09-19T09:04:01.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.223+0000 7f6813fff640 1 -- 172.21.15.19:0/2840993555 learned_addr learned my addr 172.21.15.19:0/2840993555 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:01.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.223+0000 7f6812ffd640 1 --2- 172.21.15.19:0/2840993555 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557590eef980 0x557590ef11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:01.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.223+0000 7f68137fe640 1 --2- 172.21.15.19:0/2840993555 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557590eef060 0x557590ef2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:01.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.224+0000 7f6813fff640 1 -- 172.21.15.19:0/2840993555 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557590eef980 msgr2=0x557590ef11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:01.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.224+0000 7f6813fff640 1 --2- 172.21.15.19:0/2840993555 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557590eef980 0x557590ef11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.224+0000 7f6813fff640 1 -- 172.21.15.19:0/2840993555 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557590eef060 msgr2=0x557590ef2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:01.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.224+0000 7f6813fff640 1 --2- 172.21.15.19:0/2840993555 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557590eef060 0x557590ef2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.224+0000 7f6813fff640 1 -- 172.21.15.19:0/2840993555 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557590ef9090 con 0x557590efa240 2024-09-19T09:04:01.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.224+0000 7f6812ffd640 1 --2- 172.21.15.19:0/2840993555 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557590eef980 0x557590ef11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:01.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.224+0000 7f68137fe640 1 --2- 172.21.15.19:0/2840993555 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557590eef060 0x557590ef2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:01.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.224+0000 7f6813fff640 1 --2- 172.21.15.19:0/2840993555 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557590efa240 0x557590f11af0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f680c004af0 tx=0x7f680c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13b3705b045d612a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:01.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.224+0000 7f67f97fa640 1 -- 172.21.15.19:0/2840993555 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680c04f020 con 0x557590efa240 2024-09-19T09:04:01.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.224+0000 7f67f97fa640 1 -- 172.21.15.19:0/2840993555 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f680c003c30 con 0x557590efa240 2024-09-19T09:04:01.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.224+0000 7f67f97fa640 1 -- 172.21.15.19:0/2840993555 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f680c034040 con 0x557590efa240 2024-09-19T09:04:01.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.225+0000 7f681beab740 1 -- 172.21.15.19:0/2840993555 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557590efa240 msgr2=0x557590f11af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:01.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.225+0000 7f681beab740 1 --2- 172.21.15.19:0/2840993555 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557590efa240 0x557590f11af0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f680c004af0 tx=0x7f680c004a40 comp rx=0 tx=0).stop 2024-09-19T09:04:01.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.225+0000 7f681beab740 1 -- 172.21.15.19:0/2840993555 shutdown_connections 2024-09-19T09:04:01.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.225+0000 7f681beab740 1 --2- 172.21.15.19:0/2840993555 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557590eef980 0x557590ef11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.225+0000 7f681beab740 1 --2- 172.21.15.19:0/2840993555 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557590efa240 0x557590f11af0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.225+0000 7f681beab740 1 --2- 172.21.15.19:0/2840993555 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557590eef060 0x557590ef2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.225+0000 7f681beab740 1 -- 172.21.15.19:0/2840993555 >> 172.21.15.19:0/2840993555 conn(0x557590eeb5f0 msgr2=0x557590ef0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:01.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.225+0000 7f681beab740 1 -- 172.21.15.19:0/2840993555 shutdown_connections 2024-09-19T09:04:01.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.225+0000 7f681beab740 1 -- 172.21.15.19:0/2840993555 wait complete. 2024-09-19T09:04:01.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.225+0000 7f681beab740 1 -- start start 2024-09-19T09:04:01.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.226+0000 7f681beab740 1 Processor -- start 2024-09-19T09:04:01.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.226+0000 7f681beab740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557590eef060 0x557590efe340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:01.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.226+0000 7f681beab740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557590eef980 0x557590efe880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:01.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.226+0000 7f681beab740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557590efa240 0x557590f73ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:01.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.226+0000 7f681beab740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f68141aea80 con 0x557590eef980 2024-09-19T09:04:01.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.226+0000 7f681beab740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f68141ae3b0 con 0x557590efa240 2024-09-19T09:04:01.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.226+0000 7f681beab740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f68141ab5f0 con 0x557590eef060 2024-09-19T09:04:01.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.226+0000 7f681beab740 10 client.0 _ll_register_callbacks cb 0x7f680809bc00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:01.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.226+0000 7f6812ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557590eef980 0x557590efe880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:01.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.226+0000 7f68137fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557590eef060 0x557590efe340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:01.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.226+0000 7f68137fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557590eef060 0x557590efe340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:49478/0 (socket says 172.21.15.19:49478) 2024-09-19T09:04:01.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.226+0000 7f6812ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557590eef980 0x557590efe880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59326/0 (socket says 172.21.15.19:59326) 2024-09-19T09:04:01.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.226+0000 7f68137fe640 1 -- 172.21.15.19:0/2080003727 learned_addr learned my addr 172.21.15.19:0/2080003727 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:01.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.226+0000 7f6813fff640 1 --2- 172.21.15.19:0/2080003727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557590efa240 0x557590f73ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:01.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.227+0000 7f68137fe640 1 -- 172.21.15.19:0/2080003727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557590efa240 msgr2=0x557590f73ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:01.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.227+0000 7f68137fe640 1 --2- 172.21.15.19:0/2080003727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557590efa240 0x557590f73ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.227+0000 7f68137fe640 1 -- 172.21.15.19:0/2080003727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557590eef980 msgr2=0x557590efe880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:01.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.227+0000 7f68137fe640 1 --2- 172.21.15.19:0/2080003727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557590eef980 0x557590efe880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.227+0000 7f68137fe640 1 -- 172.21.15.19:0/2080003727 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557590f74000 con 0x557590eef060 2024-09-19T09:04:01.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.227+0000 7f68137fe640 1 --2- 172.21.15.19:0/2080003727 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557590eef060 0x557590efe340 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f680400fc30 tx=0x7f680400b3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38358335a19d4c91 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:01.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.227+0000 7f67f2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T09:04:01.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.227+0000 7f67f2ffd640 1 -- 172.21.15.19:0/2080003727 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6804015040 con 0x557590eef060 2024-09-19T09:04:01.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.227+0000 7f67f2ffd640 1 -- 172.21.15.19:0/2080003727 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f68040041c0 con 0x557590eef060 2024-09-19T09:04:01.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.227+0000 7f681beab740 1 -- 172.21.15.19:0/2080003727 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f680c003c30 con 0x557590eef060 2024-09-19T09:04:01.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.227+0000 7f67f2ffd640 1 -- 172.21.15.19:0/2080003727 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f68040043c0 con 0x557590eef060 2024-09-19T09:04:01.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.227+0000 7f681beab740 10 client.27664 fetch_fsmap learned FSMap version 39 2024-09-19T09:04:01.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.227+0000 7f681beab740 1 -- 172.21.15.19:0/2080003727 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x557590f751f0 con 0x557590eef060 2024-09-19T09:04:01.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.228+0000 7f67f2ffd640 1 -- 172.21.15.19:0/2080003727 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f680c003c30 con 0x557590eef060 2024-09-19T09:04:01.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.228+0000 7f67f2ffd640 1 -- 172.21.15.19:0/2080003727 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f68040265f0 con 0x557590eef060 2024-09-19T09:04:01.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.228+0000 7f681beab740 10 client.27664 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:04:01.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.228+0000 7f681beab740 10 client.27664 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:04:01.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.228+0000 7f681beab740 20 client.27664 populate_metadata read hostname 'smithi019' 2024-09-19T09:04:01.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.228+0000 7f681beab740 1 --2- 172.21.15.19:0/2080003727 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557590f75640 0x557590f77a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:01.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.228+0000 7f681beab740 4 client.27664 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "a8b5c724", "release": true, "await": true}] 2024-09-19T09:04:01.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.228+0000 7f681beab740 1 -- 172.21.15.19:0/2080003727 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "quiesce db", "set_id": "a8b5c724", "release": true, "await": true}) -- 0x557590e5c0a0 con 0x557590f75640 2024-09-19T09:04:01.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.228+0000 7f6812ffd640 1 --2- 172.21.15.19:0/2080003727 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557590f75640 0x557590f77a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:01.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.229+0000 7f6812ffd640 1 --2- 172.21.15.19:0/2080003727 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557590f75640 0x557590f77a60 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f1acf1db5bea76b server_cookie=f50976f2ac9e88ba in_seq=0 out_seq=0 2024-09-19T09:04:01.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.229+0000 7f67f2ffd640 10 client.27664 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:04:01.233 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:00 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/520070294' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:01.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.233+0000 7f67f2ffd640 1 -- 172.21.15.19:0/2080003727 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x557590e5c0a0 con 0x557590f75640 2024-09-19T09:04:01.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.233+0000 7f67f2ffd640 10 client.27664 handle_command_reply: tid=0 2024-09-19T09:04:01.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.233+0000 7f681beab740 1 client.27664 shutdown 2024-09-19T09:04:01.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.233+0000 7f681beab740 1 -- 172.21.15.19:0/2080003727 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557590eef060 msgr2=0x557590efe340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:01.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.233+0000 7f681beab740 1 --2- 172.21.15.19:0/2080003727 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557590eef060 0x557590efe340 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f680400fc30 tx=0x7f680400b3a0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.233+0000 7f681beab740 1 -- 172.21.15.19:0/2080003727 shutdown_connections 2024-09-19T09:04:01.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.233+0000 7f681beab740 1 --2- 172.21.15.19:0/2080003727 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x557590f75640 0x557590f77a60 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.233+0000 7f681beab740 1 --2- 172.21.15.19:0/2080003727 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x557590efa240 0x557590f73ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.233+0000 7f681beab740 1 --2- 172.21.15.19:0/2080003727 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x557590eef980 0x557590efe880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.233+0000 7f681beab740 1 --2- 172.21.15.19:0/2080003727 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557590eef060 0x557590efe340 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.233+0000 7f681beab740 1 -- 172.21.15.19:0/2080003727 >> 172.21.15.19:0/2080003727 conn(0x557590eeb5f0 msgr2=0x557590eea750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:01.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.233+0000 7f67f2ffd640 0 client.27664 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:04:01.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.233+0000 7f681beab740 1 -- 172.21.15.19:0/2080003727 shutdown_connections 2024-09-19T09:04:01.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.233+0000 7f681beab740 1 -- 172.21.15.19:0/2080003727 wait complete. 2024-09-19T09:04:01.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.233+0000 7f681beab740 20 client.27664 trim_cache size 0 max 16384 2024-09-19T09:04:01.235 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T09:04:01.235 INFO:teuthology.orchestra.run.smithi019.stdout: "epoch": 39, 2024-09-19T09:04:01.236 INFO:teuthology.orchestra.run.smithi019.stdout: "leader": 24497, 2024-09-19T09:04:01.236 INFO:teuthology.orchestra.run.smithi019.stdout: "set_version": 40, 2024-09-19T09:04:01.236 INFO:teuthology.orchestra.run.smithi019.stdout: "sets": { 2024-09-19T09:04:01.236 INFO:teuthology.orchestra.run.smithi019.stdout: "a8b5c724": { 2024-09-19T09:04:01.236 INFO:teuthology.orchestra.run.smithi019.stdout: "version": 40, 2024-09-19T09:04:01.236 INFO:teuthology.orchestra.run.smithi019.stdout: "age_ref": 0.0, 2024-09-19T09:04:01.236 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T09:04:01.236 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RELEASED", 2024-09-19T09:04:01.236 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T09:04:01.236 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:04:01.236 INFO:teuthology.orchestra.run.smithi019.stdout: "timeout": 90.0, 2024-09-19T09:04:01.236 INFO:teuthology.orchestra.run.smithi019.stdout: "expiration": 150.0, 2024-09-19T09:04:01.236 INFO:teuthology.orchestra.run.smithi019.stdout: "members": { 2024-09-19T09:04:01.236 INFO:teuthology.orchestra.run.smithi019.stdout: "file:/": { 2024-09-19T09:04:01.237 INFO:teuthology.orchestra.run.smithi019.stdout: "excluded": false, 2024-09-19T09:04:01.237 INFO:teuthology.orchestra.run.smithi019.stdout: "state": { 2024-09-19T09:04:01.237 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RELEASED", 2024-09-19T09:04:01.237 INFO:teuthology.orchestra.run.smithi019.stdout: "age": 0.0 2024-09-19T09:04:01.237 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:04:01.237 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:04:01.237 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:04:01.237 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:04:01.237 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:04:01.237 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T09:04:01.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.234+0000 7f6819ad2640 1 -- 172.21.15.19:0/915780320 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f67fc0a32c0 msgr2=0x7f67fc0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:01.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.234+0000 7f6819ad2640 1 --2- 172.21.15.19:0/915780320 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f67fc0a32c0 0x7f67fc0a5780 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f680c009430 tx=0x7f680c02a950 comp rx=0 tx=0).stop 2024-09-19T09:04:01.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.234+0000 7f6819ad2640 1 -- 172.21.15.19:0/915780320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6814102570 msgr2=0x7f6814199870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:01.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.234+0000 7f6819ad2640 1 --2- 172.21.15.19:0/915780320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6814102570 0x7f6814199870 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f680800e9f0 tx=0x7f680800eeb0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.234+0000 7f6819ad2640 1 -- 172.21.15.19:0/915780320 shutdown_connections 2024-09-19T09:04:01.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.234+0000 7f6819ad2640 1 --2- 172.21.15.19:0/915780320 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f67fc0a32c0 0x7f67fc0a5780 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.234+0000 7f6819ad2640 1 --2- 172.21.15.19:0/915780320 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6814102ef0 0x7f6814199df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.234+0000 7f6819ad2640 1 --2- 172.21.15.19:0/915780320 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6814102570 0x7f6814199870 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.234+0000 7f6819ad2640 1 --2- 172.21.15.19:0/915780320 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6814100e20 0x7f6814199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:01.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.234+0000 7f6819ad2640 1 -- 172.21.15.19:0/915780320 >> 172.21.15.19:0/915780320 conn(0x7f68140fc7d0 msgr2=0x7f68140febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:01.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.234+0000 7f6819ad2640 1 -- 172.21.15.19:0/915780320 shutdown_connections 2024-09-19T09:04:01.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:01.234+0000 7f6819ad2640 1 -- 172.21.15.19:0/915780320 wait complete. 2024-09-19T09:04:01.246 INFO:tasks.workunit:Running workunit fs/misc/i_complete_vs_rename.sh... 2024-09-19T09:04:01.246 DEBUG:teuthology.orchestra.run.smithi019:workunit test fs/misc/i_complete_vs_rename.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/i_complete_vs_rename.sh 2024-09-19T09:04:01.302 INFO:tasks.workunit.client.0.smithi019.stdout:a 2024-09-19T09:04:01.302 INFO:tasks.workunit.client.0.smithi019.stdout:b 2024-09-19T09:04:01.302 INFO:tasks.workunit.client.0.smithi019.stdout:c 2024-09-19T09:04:01.302 INFO:tasks.workunit.client.0.smithi019.stdout:d 2024-09-19T09:04:01.332 INFO:tasks.workunit.client.0.smithi019.stderr:stat: cannot statx 'e': No such file or directory 2024-09-19T09:04:01.335 INFO:tasks.workunit.client.0.smithi019.stdout:attempting rename over existing file... 2024-09-19T09:04:01.383 INFO:tasks.workunit.client.0.smithi019.stdout:f 2024-09-19T09:04:01.384 INFO:tasks.workunit.client.0.smithi019.stdout:rename over existing file is okay 2024-09-19T09:04:01.384 INFO:tasks.workunit.client.0.smithi019.stdout:attempting rename over negative dentry... 2024-09-19T09:04:01.392 INFO:tasks.workunit.client.0.smithi019.stdout:e 2024-09-19T09:04:01.393 INFO:tasks.workunit.client.0.smithi019.stdout:rename over negative dentry is ok 2024-09-19T09:04:01.393 INFO:tasks.workunit.client.0.smithi019.stdout:OK 2024-09-19T09:04:01.393 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T09:04:01.393 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T09:04:01.460 INFO:tasks.workunit:Running workunit fs/misc/layout_vxattrs.sh... 2024-09-19T09:04:01.460 DEBUG:teuthology.orchestra.run.smithi019:workunit test fs/misc/layout_vxattrs.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/layout_vxattrs.sh 2024-09-19T09:04:01.532 INFO:tasks.workunit.client.0.smithi019.stderr:+ datapool= 2024-09-19T09:04:01.533 INFO:tasks.workunit.client.0.smithi019.stderr:+ dir=. 2024-09-19T09:04:01.533 INFO:tasks.workunit.client.0.smithi019.stderr:+ true 2024-09-19T09:04:01.533 INFO:tasks.workunit.client.0.smithi019.stdout:. 2024-09-19T09:04:01.534 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo . 2024-09-19T09:04:01.534 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfattr -n ceph.dir.layout.pool . --only-values 2024-09-19T09:04:01.534 INFO:tasks.workunit.client.0.smithi019.stderr:.: ceph.dir.layout.pool: No such attribute 2024-09-19T09:04:01.534 INFO:tasks.workunit.client.0.smithi019.stderr:+ datapool= 2024-09-19T09:04:01.534 INFO:tasks.workunit.client.0.smithi019.stderr:+ dir=./.. 2024-09-19T09:04:01.534 INFO:tasks.workunit.client.0.smithi019.stderr:+ true 2024-09-19T09:04:01.535 INFO:tasks.workunit.client.0.smithi019.stdout:./.. 2024-09-19T09:04:01.535 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo ./.. 2024-09-19T09:04:01.536 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfattr -n ceph.dir.layout.pool ./.. --only-values 2024-09-19T09:04:01.536 INFO:tasks.workunit.client.0.smithi019.stderr:./..: ceph.dir.layout.pool: No such attribute 2024-09-19T09:04:01.536 INFO:tasks.workunit.client.0.smithi019.stderr:+ datapool= 2024-09-19T09:04:01.536 INFO:tasks.workunit.client.0.smithi019.stderr:+ dir=./../.. 2024-09-19T09:04:01.536 INFO:tasks.workunit.client.0.smithi019.stderr:+ true 2024-09-19T09:04:01.536 INFO:tasks.workunit.client.0.smithi019.stdout:./../.. 2024-09-19T09:04:01.537 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo ./../.. 2024-09-19T09:04:01.537 INFO:tasks.workunit.client.0.smithi019.stderr:++ getfattr -n ceph.dir.layout.pool ./../.. --only-values 2024-09-19T09:04:01.537 INFO:tasks.workunit.client.0.smithi019.stderr:+ datapool=cephfs_data 2024-09-19T09:04:01.537 INFO:tasks.workunit.client.0.smithi019.stderr:+ break 2024-09-19T09:04:01.537 INFO:tasks.workunit.client.0.smithi019.stderr:+ rm -f file file2 2024-09-19T09:04:01.537 INFO:tasks.workunit.client.0.smithi019.stderr:+ touch file file2 2024-09-19T09:04:01.541 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout file 2024-09-19T09:04:01.542 INFO:tasks.workunit.client.0.smithi019.stdout:# file: file 2024-09-19T09:04:01.543 INFO:tasks.workunit.client.0.smithi019.stdout:ceph.file.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data" 2024-09-19T09:04:01.543 INFO:tasks.workunit.client.0.smithi019.stdout: 2024-09-19T09:04:01.543 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout file 2024-09-19T09:04:01.543 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q object_size= 2024-09-19T09:04:01.544 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout file 2024-09-19T09:04:01.544 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q stripe_count= 2024-09-19T09:04:01.546 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout file 2024-09-19T09:04:01.546 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q stripe_unit= 2024-09-19T09:04:01.548 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout file 2024-09-19T09:04:01.548 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q pool= 2024-09-19T09:04:01.549 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout.pool file 2024-09-19T09:04:01.550 INFO:tasks.workunit.client.0.smithi019.stdout:# file: file 2024-09-19T09:04:01.551 INFO:tasks.workunit.client.0.smithi019.stdout:ceph.file.layout.pool="cephfs_data" 2024-09-19T09:04:01.551 INFO:tasks.workunit.client.0.smithi019.stdout: 2024-09-19T09:04:01.551 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout.pool_namespace file 2024-09-19T09:04:01.552 INFO:tasks.workunit.client.0.smithi019.stdout:# file: file 2024-09-19T09:04:01.552 INFO:tasks.workunit.client.0.smithi019.stdout:ceph.file.layout.pool_namespace="" 2024-09-19T09:04:01.552 INFO:tasks.workunit.client.0.smithi019.stdout: 2024-09-19T09:04:01.552 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout.stripe_unit file 2024-09-19T09:04:01.553 INFO:tasks.workunit.client.0.smithi019.stdout:# file: file 2024-09-19T09:04:01.554 INFO:tasks.workunit.client.0.smithi019.stdout:ceph.file.layout.stripe_unit="4194304" 2024-09-19T09:04:01.554 INFO:tasks.workunit.client.0.smithi019.stdout: 2024-09-19T09:04:01.554 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout.stripe_count file 2024-09-19T09:04:01.555 INFO:tasks.workunit.client.0.smithi019.stdout:# file: file 2024-09-19T09:04:01.555 INFO:tasks.workunit.client.0.smithi019.stdout:ceph.file.layout.stripe_count="1" 2024-09-19T09:04:01.555 INFO:tasks.workunit.client.0.smithi019.stdout: 2024-09-19T09:04:01.555 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout.object_size file 2024-09-19T09:04:01.556 INFO:tasks.workunit.client.0.smithi019.stdout:# file: file 2024-09-19T09:04:01.556 INFO:tasks.workunit.client.0.smithi019.stdout:ceph.file.layout.object_size="4194304" 2024-09-19T09:04:01.556 INFO:tasks.workunit.client.0.smithi019.stdout: 2024-09-19T09:04:01.557 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout.bogus file 2024-09-19T09:04:01.557 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q 'No such attribute' 2024-09-19T09:04:01.558 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.dir.layout file 2024-09-19T09:04:01.559 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q 'No such attribute' 2024-09-19T09:04:01.559 INFO:tasks.workunit.client.0.smithi019.stderr:+ setfattr -n ceph.file.layout.stripe_unit -v 1048576 file2 2024-09-19T09:04:01.565 INFO:tasks.workunit.client.0.smithi019.stderr:+ setfattr -n ceph.file.layout.stripe_count -v 8 file2 2024-09-19T09:04:01.569 INFO:tasks.workunit.client.0.smithi019.stderr:+ setfattr -n ceph.file.layout.object_size -v 10485760 file2 2024-09-19T09:04:01.576 INFO:tasks.workunit.client.0.smithi019.stderr:+ setfattr -n ceph.file.layout.pool -v cephfs_data file2 2024-09-19T09:04:01.582 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout.pool file2 2024-09-19T09:04:01.582 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q cephfs_data 2024-09-19T09:04:01.584 INFO:tasks.workunit.client.0.smithi019.stderr:+ setfattr -n ceph.file.layout.pool_namespace -v foons file2 2024-09-19T09:04:01.589 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout.pool_namespace file2 2024-09-19T09:04:01.589 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q foons 2024-09-19T09:04:01.590 INFO:tasks.workunit.client.0.smithi019.stderr:+ setfattr -x ceph.file.layout.pool_namespace file2 2024-09-19T09:04:01.594 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout.pool_namespace file2 2024-09-19T09:04:01.594 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q -v foons 2024-09-19T09:04:01.595 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout.stripe_unit file2 2024-09-19T09:04:01.595 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q 1048576 2024-09-19T09:04:01.597 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout.stripe_count file2 2024-09-19T09:04:01.597 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q 8 2024-09-19T09:04:01.599 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout.object_size file2 2024-09-19T09:04:01.599 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q 10485760 2024-09-19T09:04:01.600 INFO:tasks.workunit.client.0.smithi019.stderr:+ setfattr -n ceph.file.layout -v 'stripe_unit=4194304 stripe_count=16 object_size=41943040 pool=cephfs_data pool_namespace=foons' file2 2024-09-19T09:04:01.605 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout.stripe_unit file2 2024-09-19T09:04:01.605 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q 4194304 2024-09-19T09:04:01.609 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout.stripe_count file2 2024-09-19T09:04:01.609 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q 16 2024-09-19T09:04:01.611 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout.object_size file2 2024-09-19T09:04:01.611 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q 41943040 2024-09-19T09:04:01.613 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout.pool file2 2024-09-19T09:04:01.613 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q cephfs_data 2024-09-19T09:04:01.614 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout.pool_namespace file2 2024-09-19T09:04:01.615 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q foons 2024-09-19T09:04:01.616 INFO:tasks.workunit.client.0.smithi019.stderr:+ setfattr -n ceph.file.layout -v stripe_unit=1048576 file2 2024-09-19T09:04:01.623 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout.stripe_unit file2 2024-09-19T09:04:01.623 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q 1048576 2024-09-19T09:04:01.625 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout.stripe_count file2 2024-09-19T09:04:01.625 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q 16 2024-09-19T09:04:01.627 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout.object_size file2 2024-09-19T09:04:01.627 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q 41943040 2024-09-19T09:04:01.629 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout.pool file2 2024-09-19T09:04:01.629 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q cephfs_data 2024-09-19T09:04:01.630 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout.pool_namespace file2 2024-09-19T09:04:01.630 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q foons 2024-09-19T09:04:01.632 INFO:tasks.workunit.client.0.smithi019.stderr:+ setfattr -n ceph.file.layout -v 'stripe_unit=2097152 stripe_count=4 object_size=2097152 pool=cephfs_data pool_namespace=barns' file2 2024-09-19T09:04:01.636 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout.stripe_unit file2 2024-09-19T09:04:01.636 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q 2097152 2024-09-19T09:04:01.638 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout.stripe_count file2 2024-09-19T09:04:01.638 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q 4 2024-09-19T09:04:01.639 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout.object_size file2 2024-09-19T09:04:01.640 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q 2097152 2024-09-19T09:04:01.641 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout.pool file2 2024-09-19T09:04:01.641 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q cephfs_data 2024-09-19T09:04:01.643 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout.pool_namespace file2 2024-09-19T09:04:01.643 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q barns 2024-09-19T09:04:01.645 INFO:tasks.workunit.client.0.smithi019.stderr:+ rm -f dir/file 2024-09-19T09:04:01.645 INFO:tasks.workunit.client.0.smithi019.stderr:+ rmdir dir 2024-09-19T09:04:01.646 INFO:tasks.workunit.client.0.smithi019.stderr:rmdir: failed to remove 'dir': No such file or directory 2024-09-19T09:04:01.646 INFO:tasks.workunit.client.0.smithi019.stderr:+ true 2024-09-19T09:04:01.646 INFO:tasks.workunit.client.0.smithi019.stderr:+ mkdir -p dir 2024-09-19T09:04:01.649 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -d -m - dir 2024-09-19T09:04:01.649 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q ceph.dir.layout 2024-09-19T09:04:01.650 INFO:tasks.workunit.client.0.smithi019.stderr:+ true 2024-09-19T09:04:01.650 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -d -m - dir 2024-09-19T09:04:01.650 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q ceph.file.layout 2024-09-19T09:04:01.651 INFO:tasks.workunit.client.0.smithi019.stderr:+ true 2024-09-19T09:04:01.651 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.dir.layout dir 2024-09-19T09:04:01.652 INFO:tasks.workunit.client.0.smithi019.stderr:dir: ceph.dir.layout: No such attribute 2024-09-19T09:04:01.652 INFO:tasks.workunit.client.0.smithi019.stderr:+ true 2024-09-19T09:04:01.652 INFO:tasks.workunit.client.0.smithi019.stderr:+ setfattr -n ceph.dir.layout.stripe_unit -v 1048576 dir 2024-09-19T09:04:01.657 INFO:tasks.workunit.client.0.smithi019.stderr:+ setfattr -n ceph.dir.layout.stripe_count -v 8 dir 2024-09-19T09:04:01.662 INFO:tasks.workunit.client.0.smithi019.stderr:+ setfattr -n ceph.dir.layout.object_size -v 10485760 dir 2024-09-19T09:04:01.667 INFO:tasks.workunit.client.0.smithi019.stderr:+ setfattr -n ceph.dir.layout.pool -v cephfs_data dir 2024-09-19T09:04:01.672 INFO:tasks.workunit.client.0.smithi019.stderr:+ setfattr -n ceph.dir.layout.pool_namespace -v dirns dir 2024-09-19T09:04:01.676 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.dir.layout dir 2024-09-19T09:04:01.678 INFO:tasks.workunit.client.0.smithi019.stdout:# file: dir 2024-09-19T09:04:01.678 INFO:tasks.workunit.client.0.smithi019.stdout:ceph.dir.layout="stripe_unit=1048576 stripe_count=8 object_size=10485760 pool=cephfs_data pool_namespace=dirns" 2024-09-19T09:04:01.678 INFO:tasks.workunit.client.0.smithi019.stdout: 2024-09-19T09:04:01.678 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.dir.layout dir 2024-09-19T09:04:01.679 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q object_size=10485760 2024-09-19T09:04:01.680 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.dir.layout dir 2024-09-19T09:04:01.680 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q stripe_count=8 2024-09-19T09:04:01.681 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.dir.layout dir 2024-09-19T09:04:01.681 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q stripe_unit=1048576 2024-09-19T09:04:01.683 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.dir.layout dir 2024-09-19T09:04:01.683 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q pool=cephfs_data 2024-09-19T09:04:01.685 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.dir.layout dir 2024-09-19T09:04:01.685 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q pool_namespace=dirns 2024-09-19T09:04:01.686 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.dir.layout.pool dir 2024-09-19T09:04:01.687 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q cephfs_data 2024-09-19T09:04:01.689 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.dir.layout.stripe_unit dir 2024-09-19T09:04:01.689 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q 1048576 2024-09-19T09:04:01.690 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.dir.layout.stripe_count dir 2024-09-19T09:04:01.690 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q 8 2024-09-19T09:04:01.692 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.dir.layout.object_size dir 2024-09-19T09:04:01.692 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q 10485760 2024-09-19T09:04:01.693 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.dir.layout.pool_namespace dir 2024-09-19T09:04:01.694 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q dirns 2024-09-19T09:04:01.695 INFO:tasks.workunit.client.0.smithi019.stderr:+ setfattr -n ceph.file.layout -v stripe_count=16 file2 2024-09-19T09:04:01.697 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout.stripe_count file2 2024-09-19T09:04:01.698 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q 16 2024-09-19T09:04:01.699 INFO:tasks.workunit.client.0.smithi019.stderr:+ setfattr -n ceph.file.layout -v 'object_size=10485760 stripe_count=8 stripe_unit=1048576 pool=cephfs_data pool_namespace=dirns' file2 2024-09-19T09:04:01.704 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout.stripe_count file2 2024-09-19T09:04:01.704 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q 8 2024-09-19T09:04:01.706 INFO:tasks.workunit.client.0.smithi019.stderr:+ touch dir/file 2024-09-19T09:04:01.708 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout.pool dir/file 2024-09-19T09:04:01.708 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q cephfs_data 2024-09-19T09:04:01.709 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout.stripe_unit dir/file 2024-09-19T09:04:01.709 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q 1048576 2024-09-19T09:04:01.711 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout.stripe_count dir/file 2024-09-19T09:04:01.711 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q 8 2024-09-19T09:04:01.713 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout.object_size dir/file 2024-09-19T09:04:01.713 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q 10485760 2024-09-19T09:04:01.714 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.file.layout.pool_namespace dir/file 2024-09-19T09:04:01.714 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q dirns 2024-09-19T09:04:01.715 INFO:tasks.workunit.client.0.smithi019.stderr:+ setfattr -x ceph.dir.layout.pool_namespace dir 2024-09-19T09:04:01.722 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.dir.layout dir 2024-09-19T09:04:01.722 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q -v pool_namespace=dirns 2024-09-19T09:04:01.723 INFO:tasks.workunit.client.0.smithi019.stderr:+ setfattr -x ceph.dir.layout dir 2024-09-19T09:04:01.727 INFO:tasks.workunit.client.0.smithi019.stderr:+ getfattr -n ceph.dir.layout dir 2024-09-19T09:04:01.727 INFO:tasks.workunit.client.0.smithi019.stderr:+ grep -q 'No such attribute' 2024-09-19T09:04:01.728 INFO:tasks.workunit.client.0.smithi019.stdout:OK 2024-09-19T09:04:01.728 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo OK 2024-09-19T09:04:01.729 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T09:04:01.729 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T09:04:01.776 INFO:tasks.workunit:Running workunit fs/misc/mkpool_layout_vxattrs.sh... 2024-09-19T09:04:01.776 DEBUG:teuthology.orchestra.run.smithi019:workunit test fs/misc/mkpool_layout_vxattrs.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/mkpool_layout_vxattrs.sh 2024-09-19T09:04:02.003 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:01 smithi019 ceph-mon[30976]: pgmap v693: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-09-19T09:04:02.011 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:02.040 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'a8b5c724', total seconds elapsed: 34.2 2024-09-19T09:04:02.130 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.129+0000 7f159942e640 1 -- 172.21.15.19:0/2718275884 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1594107840 msgr2=0x7f1594109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:02.130 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.129+0000 7f159942e640 1 --2- 172.21.15.19:0/2718275884 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1594107840 0x7f1594109cb0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f158c009ca0 tx=0x7f158c02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.130 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.129+0000 7f159942e640 1 -- 172.21.15.19:0/2718275884 shutdown_connections 2024-09-19T09:04:02.131 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.129+0000 7f159942e640 1 --2- 172.21.15.19:0/2718275884 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1594107840 0x7f1594109cb0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.131 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.129+0000 7f159942e640 1 --2- 172.21.15.19:0/2718275884 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1594104f10 0x7f1594107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.131 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.129+0000 7f159942e640 1 --2- 172.21.15.19:0/2718275884 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f15941025e0 0x7f15941049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.131 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.129+0000 7f159942e640 1 -- 172.21.15.19:0/2718275884 >> 172.21.15.19:0/2718275884 conn(0x7f15940fc1c0 msgr2=0x7f15940fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:02.131 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.129+0000 7f159942e640 1 -- 172.21.15.19:0/2718275884 shutdown_connections 2024-09-19T09:04:02.131 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.129+0000 7f159942e640 1 -- 172.21.15.19:0/2718275884 wait complete. 2024-09-19T09:04:02.133 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.130+0000 7f159942e640 1 Processor -- start 2024-09-19T09:04:02.133 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.130+0000 7f159942e640 1 -- start start 2024-09-19T09:04:02.133 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.130+0000 7f159942e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f15941025e0 0x7f1594101f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:02.133 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.130+0000 7f159942e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1594104f10 0x7f1594100590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:02.133 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.130+0000 7f159942e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1594107840 0x7f1594100ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:02.133 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.130+0000 7f159942e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f159410d820 con 0x7f1594104f10 2024-09-19T09:04:02.133 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.130+0000 7f159942e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f159410d6a0 con 0x7f1594107840 2024-09-19T09:04:02.133 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.130+0000 7f159942e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f159410d9a0 con 0x7f15941025e0 2024-09-19T09:04:02.134 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.130+0000 7f15927fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1594104f10 0x7f1594100590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:02.134 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.131+0000 7f15927fc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1594104f10 0x7f1594100590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59348/0 (socket says 172.21.15.19:59348) 2024-09-19T09:04:02.134 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.131+0000 7f15927fc640 1 -- 172.21.15.19:0/3936660127 learned_addr learned my addr 172.21.15.19:0/3936660127 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:02.134 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.131+0000 7f1592ffd640 1 --2- 172.21.15.19:0/3936660127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f15941025e0 0x7f1594101f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:02.134 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.131+0000 7f15937fe640 1 --2- 172.21.15.19:0/3936660127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1594107840 0x7f1594100ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:02.134 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.131+0000 7f15927fc640 1 -- 172.21.15.19:0/3936660127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f15941025e0 msgr2=0x7f1594101f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:02.134 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.131+0000 7f15927fc640 1 --2- 172.21.15.19:0/3936660127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f15941025e0 0x7f1594101f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.134 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.131+0000 7f15927fc640 1 -- 172.21.15.19:0/3936660127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1594107840 msgr2=0x7f1594100ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:02.134 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.131+0000 7f15927fc640 1 --2- 172.21.15.19:0/3936660127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1594107840 0x7f1594100ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.134 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.131+0000 7f15927fc640 1 -- 172.21.15.19:0/3936660127 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1594101360 con 0x7f1594104f10 2024-09-19T09:04:02.134 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.131+0000 7f15927fc640 1 --2- 172.21.15.19:0/3936660127 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1594104f10 0x7f1594100590 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f158800c970 tx=0x7f158800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:02.134 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.131+0000 7f157bfff640 1 -- 172.21.15.19:0/3936660127 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1588014070 con 0x7f1594104f10 2024-09-19T09:04:02.134 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.131+0000 7f157bfff640 1 -- 172.21.15.19:0/3936660127 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1588004440 con 0x7f1594104f10 2024-09-19T09:04:02.135 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.131+0000 7f159942e640 1 -- 172.21.15.19:0/3936660127 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15941a1fa0 con 0x7f1594104f10 2024-09-19T09:04:02.135 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.131+0000 7f157bfff640 1 -- 172.21.15.19:0/3936660127 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158800f450 con 0x7f1594104f10 2024-09-19T09:04:02.135 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.131+0000 7f159942e640 1 -- 172.21.15.19:0/3936660127 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15941a2460 con 0x7f1594104f10 2024-09-19T09:04:02.136 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.133+0000 7f157bfff640 1 -- 172.21.15.19:0/3936660127 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f1588017070 con 0x7f1594104f10 2024-09-19T09:04:02.136 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.134+0000 7f157bfff640 1 --2- 172.21.15.19:0/3936660127 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f157c0a3250 0x7f157c0a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:02.136 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.134+0000 7f157bfff640 1 -- 172.21.15.19:0/3936660127 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f15880cf840 con 0x7f1594104f10 2024-09-19T09:04:02.136 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.134+0000 7f1592ffd640 1 --2- 172.21.15.19:0/3936660127 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f157c0a3250 0x7f157c0a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:02.164 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.132+0000 7f159942e640 1 -- 172.21.15.19:0/3936660127 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15940fdcb0 con 0x7f1594104f10 2024-09-19T09:04:02.164 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.163+0000 7f1592ffd640 1 --2- 172.21.15.19:0/3936660127 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f157c0a3250 0x7f157c0a5710 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1584005fd0 tx=0x7f1584005e20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:02.168 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.168+0000 7f157bfff640 1 -- 172.21.15.19:0/3936660127 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f158801e020 con 0x7f1594104f10 2024-09-19T09:04:02.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:01 smithi155 ceph-mon[34921]: pgmap v693: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-09-19T09:04:02.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:01 smithi203 ceph-mon[35450]: pgmap v693: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.7 KiB/s wr, 14 op/s 2024-09-19T09:04:02.351 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.350+0000 7f159942e640 1 -- 172.21.15.19:0/3936660127 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "foo.212660", "pg_num": 8} v 0) -- 0x7f1594062df0 con 0x7f1594104f10 2024-09-19T09:04:02.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.516+0000 7f4df6624640 1 -- 172.21.15.19:0/3167999078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4df0100e20 msgr2=0x7f4df0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:02.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.516+0000 7f4df6624640 1 --2- 172.21.15.19:0/3167999078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4df0100e20 0x7f4df0101200 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009930 tx=0x7f4de002a4d0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.516+0000 7f4df6624640 1 -- 172.21.15.19:0/3167999078 shutdown_connections 2024-09-19T09:04:02.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.516+0000 7f4df6624640 1 --2- 172.21.15.19:0/3167999078 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4df0102ef0 0x7f4df010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.516+0000 7f4df6624640 1 --2- 172.21.15.19:0/3167999078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4df0102570 0x7f4df01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.516+0000 7f4df6624640 1 --2- 172.21.15.19:0/3167999078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4df0100e20 0x7f4df0101200 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.516+0000 7f4df6624640 1 -- 172.21.15.19:0/3167999078 >> 172.21.15.19:0/3167999078 conn(0x7f4df00fc7d0 msgr2=0x7f4df00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:02.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.516+0000 7f4df6624640 1 -- 172.21.15.19:0/3167999078 shutdown_connections 2024-09-19T09:04:02.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.516+0000 7f4df6624640 1 -- 172.21.15.19:0/3167999078 wait complete. 2024-09-19T09:04:02.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.516+0000 7f4df6624640 1 Processor -- start 2024-09-19T09:04:02.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.516+0000 7f4df6624640 1 -- start start 2024-09-19T09:04:02.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.517+0000 7f4df6624640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4df0100e20 0x7f4df019a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:02.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.517+0000 7f4df6624640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4df0102570 0x7f4df019ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:02.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.517+0000 7f4df6624640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4df0102ef0 0x7f4df019eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:02.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.517+0000 7f4df6624640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4df0110f80 con 0x7f4df0100e20 2024-09-19T09:04:02.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.517+0000 7f4df6624640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4df0110e00 con 0x7f4df0102ef0 2024-09-19T09:04:02.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.517+0000 7f4df6624640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4df0111100 con 0x7f4df0102570 2024-09-19T09:04:02.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.517+0000 7f4deffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4df0100e20 0x7f4df019a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:02.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.517+0000 7f4deffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4df0100e20 0x7f4df019a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59370/0 (socket says 172.21.15.19:59370) 2024-09-19T09:04:02.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.517+0000 7f4deffff640 1 -- 172.21.15.19:0/3820249363 learned_addr learned my addr 172.21.15.19:0/3820249363 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:02.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.517+0000 7f4df4bc1640 1 --2- 172.21.15.19:0/3820249363 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4df0102ef0 0x7f4df019eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:02.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.517+0000 7f4def7fe640 1 --2- 172.21.15.19:0/3820249363 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4df0102570 0x7f4df019ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:02.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.518+0000 7f4deffff640 1 -- 172.21.15.19:0/3820249363 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4df0102570 msgr2=0x7f4df019ac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:02.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.518+0000 7f4deffff640 1 --2- 172.21.15.19:0/3820249363 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4df0102570 0x7f4df019ac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.518+0000 7f4deffff640 1 -- 172.21.15.19:0/3820249363 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4df0102ef0 msgr2=0x7f4df019eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:02.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.518+0000 7f4deffff640 1 --2- 172.21.15.19:0/3820249363 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4df0102ef0 0x7f4df019eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.518+0000 7f4deffff640 1 -- 172.21.15.19:0/3820249363 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4df019f6d0 con 0x7f4df0100e20 2024-09-19T09:04:02.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.518+0000 7f4df4bc1640 1 --2- 172.21.15.19:0/3820249363 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4df0102ef0 0x7f4df019eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:02.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.518+0000 7f4deffff640 1 --2- 172.21.15.19:0/3820249363 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4df0100e20 0x7f4df019a720 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009230 tx=0x7f4de0004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:02.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.785+0000 7f4ded7fa640 1 -- 172.21.15.19:0/3820249363 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de003f030 con 0x7f4df0100e20 2024-09-19T09:04:02.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.785+0000 7f4df6624640 1 -- 172.21.15.19:0/3820249363 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4df019f960 con 0x7f4df0100e20 2024-09-19T09:04:02.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.785+0000 7f4ded7fa640 1 -- 172.21.15.19:0/3820249363 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4de0004440 con 0x7f4df0100e20 2024-09-19T09:04:02.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.785+0000 7f4ded7fa640 1 -- 172.21.15.19:0/3820249363 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de0035070 con 0x7f4df0100e20 2024-09-19T09:04:02.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.785+0000 7f4df6624640 1 -- 172.21.15.19:0/3820249363 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4df01a72a0 con 0x7f4df0100e20 2024-09-19T09:04:02.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.788+0000 7f4df89fd740 1 Processor -- start 2024-09-19T09:04:02.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.788+0000 7f4df89fd740 1 -- start start 2024-09-19T09:04:02.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.788+0000 7f4df89fd740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5e2dedb40 0x55c5e2dec090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:02.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.788+0000 7f4df89fd740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5e2dec5d0 0x55c5e2deca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:02.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.788+0000 7f4df89fd740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5e2df7370 0x55c5e2df9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:02.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.788+0000 7f4df89fd740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c5e2d522f0 con 0x55c5e2dec5d0 2024-09-19T09:04:02.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.788+0000 7f4df89fd740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55c5e2cf9cf0 con 0x55c5e2df7370 2024-09-19T09:04:02.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.788+0000 7f4df89fd740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c5e2d4e2b0 con 0x55c5e2dedb40 2024-09-19T09:04:02.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.788+0000 7f4def7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5e2df7370 0x55c5e2df9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:02.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.788+0000 7f4def7fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5e2df7370 0x55c5e2df9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:58728/0 (socket says 172.21.15.19:58728) 2024-09-19T09:04:02.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.788+0000 7f4def7fe640 1 -- 172.21.15.19:0/86007416 learned_addr learned my addr 172.21.15.19:0/86007416 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:02.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.788+0000 7f4df4bc1640 1 --2- 172.21.15.19:0/86007416 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5e2dedb40 0x55c5e2dec090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:02.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.788+0000 7f4def7fe640 1 -- 172.21.15.19:0/86007416 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5e2dedb40 msgr2=0x55c5e2dec090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:02.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.788+0000 7f4def7fe640 1 --2- 172.21.15.19:0/86007416 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5e2dedb40 0x55c5e2dec090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.788+0000 7f4def7fe640 1 -- 172.21.15.19:0/86007416 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5e2dec5d0 msgr2=0x55c5e2deca10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T09:04:02.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.788+0000 7f4def7fe640 1 --2- 172.21.15.19:0/86007416 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5e2dec5d0 0x55c5e2deca10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.788+0000 7f4def7fe640 1 -- 172.21.15.19:0/86007416 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5e2cde3a0 con 0x55c5e2df7370 2024-09-19T09:04:02.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.789+0000 7f4def7fe640 1 --2- 172.21.15.19:0/86007416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5e2df7370 0x55c5e2df9760 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4de4009c90 tx=0x7f4de4011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46fecd5f68c08b87 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:02.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.789+0000 7f4ded7fa640 1 -- 172.21.15.19:0/3820249363 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f4de0042030 con 0x7f4df0100e20 2024-09-19T09:04:02.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.789+0000 7f4dd67fc640 1 -- 172.21.15.19:0/86007416 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de401e070 con 0x55c5e2df7370 2024-09-19T09:04:02.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.789+0000 7f4dd67fc640 1 -- 172.21.15.19:0/86007416 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4de4019b10 con 0x55c5e2df7370 2024-09-19T09:04:02.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.789+0000 7f4dd67fc640 1 -- 172.21.15.19:0/86007416 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de400ea80 con 0x55c5e2df7370 2024-09-19T09:04:02.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.790+0000 7f4ded7fa640 1 --2- 172.21.15.19:0/3820249363 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4dd80a3240 0x7f4dd80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:02.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.790+0000 7f4df89fd740 1 -- 172.21.15.19:0/86007416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5e2df7370 msgr2=0x55c5e2df9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:02.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.790+0000 7f4df89fd740 1 --2- 172.21.15.19:0/86007416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5e2df7370 0x55c5e2df9760 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4de4009c90 tx=0x7f4de4011810 comp rx=0 tx=0).stop 2024-09-19T09:04:02.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.790+0000 7f4df4bc1640 1 --2- 172.21.15.19:0/3820249363 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4dd80a3240 0x7f4dd80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:02.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.790+0000 7f4ded7fa640 1 -- 172.21.15.19:0/3820249363 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f4de00efbe0 con 0x7f4df0100e20 2024-09-19T09:04:02.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.790+0000 7f4df89fd740 1 -- 172.21.15.19:0/86007416 shutdown_connections 2024-09-19T09:04:02.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.790+0000 7f4df89fd740 1 --2- 172.21.15.19:0/86007416 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5e2df7370 0x55c5e2df9760 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.790+0000 7f4df89fd740 1 --2- 172.21.15.19:0/86007416 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5e2dec5d0 0x55c5e2deca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.790+0000 7f4df89fd740 1 --2- 172.21.15.19:0/86007416 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5e2dedb40 0x55c5e2dec090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.790+0000 7f4df89fd740 1 -- 172.21.15.19:0/86007416 >> 172.21.15.19:0/86007416 conn(0x55c5e2db5310 msgr2=0x55c5e2de8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:02.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.790+0000 7f4df89fd740 1 -- 172.21.15.19:0/86007416 shutdown_connections 2024-09-19T09:04:02.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.790+0000 7f4df89fd740 1 -- 172.21.15.19:0/86007416 wait complete. 2024-09-19T09:04:02.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.790+0000 7f4df4bc1640 1 --2- 172.21.15.19:0/3820249363 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4dd80a3240 0x7f4dd80a5700 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4de8005fd0 tx=0x7f4de8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:02.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.790+0000 7f4df89fd740 1 -- start start 2024-09-19T09:04:02.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.791+0000 7f4df89fd740 1 Processor -- start 2024-09-19T09:04:02.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.791+0000 7f4df89fd740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5e2dec5d0 0x55c5e2df6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:02.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.791+0000 7f4df89fd740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5e2dedb40 0x55c5e2df4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:02.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.791+0000 7f4df89fd740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5e2df7370 0x55c5e2df4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:02.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.791+0000 7f4df89fd740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55c5e2dfa070 con 0x55c5e2dedb40 2024-09-19T09:04:02.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.791+0000 7f4df89fd740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55c5e2d0d060 con 0x55c5e2dec5d0 2024-09-19T09:04:02.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.791+0000 7f4df89fd740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c5e2dfa1f0 con 0x55c5e2df7370 2024-09-19T09:04:02.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.791+0000 7f4df89fd740 10 client.0 _ll_register_callbacks cb 0x55c5e2a608c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:02.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.791+0000 7f4deffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5e2dec5d0 0x55c5e2df6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:02.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.791+0000 7f4deffff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5e2dec5d0 0x55c5e2df6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:58730/0 (socket says 172.21.15.19:58730) 2024-09-19T09:04:02.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.791+0000 7f4deffff640 1 -- 172.21.15.19:0/1903769961 learned_addr learned my addr 172.21.15.19:0/1903769961 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:02.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.791+0000 7f4def7fe640 1 --2- 172.21.15.19:0/1903769961 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5e2dedb40 0x55c5e2df4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:02.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.791+0000 7f4df4bc1640 1 --2- 172.21.15.19:0/1903769961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5e2df7370 0x55c5e2df4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:02.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.791+0000 7f4deffff640 1 -- 172.21.15.19:0/1903769961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5e2df7370 msgr2=0x55c5e2df4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:02.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.791+0000 7f4deffff640 1 --2- 172.21.15.19:0/1903769961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5e2df7370 0x55c5e2df4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.791+0000 7f4deffff640 1 -- 172.21.15.19:0/1903769961 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5e2dedb40 msgr2=0x55c5e2df4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:02.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.791+0000 7f4deffff640 1 --2- 172.21.15.19:0/1903769961 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5e2dedb40 0x55c5e2df4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.791+0000 7f4deffff640 1 -- 172.21.15.19:0/1903769961 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5e2ac33c0 con 0x55c5e2dec5d0 2024-09-19T09:04:02.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.792+0000 7f4deffff640 1 --2- 172.21.15.19:0/1903769961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5e2dec5d0 0x55c5e2df6dc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009a50 tx=0x7f4de00bbec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d407f5755ceb7e72 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:02.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.792+0000 7f4dcf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T09:04:02.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.792+0000 7f4dcf7fe640 1 -- 172.21.15.19:0/1903769961 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de0049040 con 0x55c5e2dec5d0 2024-09-19T09:04:02.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.792+0000 7f4dcf7fe640 1 -- 172.21.15.19:0/1903769961 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f4de00c0150 con 0x55c5e2dec5d0 2024-09-19T09:04:02.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.792+0000 7f4df89fd740 1 -- 172.21.15.19:0/1903769961 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4de4019b10 con 0x55c5e2dec5d0 2024-09-19T09:04:02.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.792+0000 7f4dcf7fe640 1 -- 172.21.15.19:0/1903769961 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f4de00c0390 con 0x55c5e2dec5d0 2024-09-19T09:04:02.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.792+0000 7f4df89fd740 10 client.27791 fetch_fsmap learned FSMap version 39 2024-09-19T09:04:02.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.792+0000 7f4df89fd740 1 -- 172.21.15.19:0/1903769961 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55c5e2e05bb0 con 0x55c5e2dec5d0 2024-09-19T09:04:02.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.792+0000 7f4dcf7fe640 1 -- 172.21.15.19:0/1903769961 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4de4019b10 con 0x55c5e2dec5d0 2024-09-19T09:04:02.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.792+0000 7f4dcf7fe640 1 -- 172.21.15.19:0/1903769961 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f4de00c49f0 con 0x55c5e2dec5d0 2024-09-19T09:04:02.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.792+0000 7f4df89fd740 10 client.27791 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:04:02.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.792+0000 7f4df89fd740 10 client.27791 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T09:04:02.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.792+0000 7f4df89fd740 20 client.27791 populate_metadata read hostname 'smithi019' 2024-09-19T09:04:02.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.792+0000 7f4df89fd740 1 --2- 172.21.15.19:0/1903769961 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55c5e2e06fc0 0x55c5e2e093d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:02.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.793+0000 7f4df89fd740 4 client.27791 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:02.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.793+0000 7f4df89fd740 1 -- 172.21.15.19:0/1903769961 --> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c5e2d5f860 con 0x55c5e2e06fc0 2024-09-19T09:04:02.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.793+0000 7f4def7fe640 1 --2- 172.21.15.19:0/1903769961 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55c5e2e06fc0 0x55c5e2e093d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:02.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.793+0000 7f4def7fe640 1 --2- 172.21.15.19:0/1903769961 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55c5e2e06fc0 0x55c5e2e093d0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7bca05602927b69e server_cookie=23c72c86435c18bb in_seq=0 out_seq=0 2024-09-19T09:04:02.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.793+0000 7f4dcf7fe640 10 client.27791 ms_handle_connect on v2:172.21.15.203:6834/2702758353 2024-09-19T09:04:02.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.794+0000 7f4dcf7fe640 1 -- 172.21.15.19:0/1903769961 <== mds.4 v2:172.21.15.203:6834/2702758353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c5e2d5f860 con 0x55c5e2e06fc0 2024-09-19T09:04:02.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.794+0000 7f4dcf7fe640 10 client.27791 handle_command_reply: tid=0 2024-09-19T09:04:02.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.794+0000 7f4df89fd740 1 client.27791 shutdown 2024-09-19T09:04:02.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.794+0000 7f4df89fd740 1 -- 172.21.15.19:0/1903769961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5e2dec5d0 msgr2=0x55c5e2df6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:02.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.794+0000 7f4df89fd740 1 --2- 172.21.15.19:0/1903769961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5e2dec5d0 0x55c5e2df6dc0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009a50 tx=0x7f4de00bbec0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.794+0000 7f4df89fd740 1 -- 172.21.15.19:0/1903769961 shutdown_connections 2024-09-19T09:04:02.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.794+0000 7f4df89fd740 1 --2- 172.21.15.19:0/1903769961 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55c5e2e06fc0 0x55c5e2e093d0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.794+0000 7f4df89fd740 1 --2- 172.21.15.19:0/1903769961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5e2df7370 0x55c5e2df4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.794+0000 7f4df89fd740 1 --2- 172.21.15.19:0/1903769961 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5e2dedb40 0x55c5e2df4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.794+0000 7f4dcf7fe640 0 client.27791 ms_handle_reset on v2:172.21.15.203:6834/2702758353 2024-09-19T09:04:02.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.794+0000 7f4df89fd740 1 --2- 172.21.15.19:0/1903769961 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5e2dec5d0 0x55c5e2df6dc0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.794+0000 7f4df89fd740 1 -- 172.21.15.19:0/1903769961 >> 172.21.15.19:0/1903769961 conn(0x55c5e2db5310 msgr2=0x55c5e2dee930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:02.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.794+0000 7f4df89fd740 1 -- 172.21.15.19:0/1903769961 shutdown_connections 2024-09-19T09:04:02.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.794+0000 7f4df89fd740 1 -- 172.21.15.19:0/1903769961 wait complete. 2024-09-19T09:04:02.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.794+0000 7f4df89fd740 20 client.27791 trim_cache size 0 max 16384 2024-09-19T09:04:02.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.807+0000 7f4df89fd740 1 Processor -- start 2024-09-19T09:04:02.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.807+0000 7f4df89fd740 1 -- start start 2024-09-19T09:04:02.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.807+0000 7f4df89fd740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5e2dec5d0 0x55c5e2ded410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:02.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.807+0000 7f4df89fd740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5e2dedb40 0x55c5e2de7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:02.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.807+0000 7f4df89fd740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5e2df7370 0x55c5e2def120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:02.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.807+0000 7f4df89fd740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4df01af760 con 0x55c5e2dec5d0 2024-09-19T09:04:02.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.807+0000 7f4df89fd740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4df01b12a0 con 0x55c5e2df7370 2024-09-19T09:04:02.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.807+0000 7f4df89fd740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4df01afe30 con 0x55c5e2dedb40 2024-09-19T09:04:02.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.807+0000 7f4deffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5e2dec5d0 0x55c5e2ded410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:02.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.808+0000 7f4deffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5e2dec5d0 0x55c5e2ded410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59396/0 (socket says 172.21.15.19:59396) 2024-09-19T09:04:02.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.808+0000 7f4deffff640 1 -- 172.21.15.19:0/928896223 learned_addr learned my addr 172.21.15.19:0/928896223 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:02.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.808+0000 7f4deffff640 1 -- 172.21.15.19:0/928896223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5e2dedb40 msgr2=0x55c5e2de7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:02.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.808+0000 7f4def7fe640 1 --2- 172.21.15.19:0/928896223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5e2dedb40 0x55c5e2de7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:02.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.808+0000 7f4deffff640 1 --2- 172.21.15.19:0/928896223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5e2dedb40 0x55c5e2de7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.808+0000 7f4deffff640 1 -- 172.21.15.19:0/928896223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5e2df7370 msgr2=0x55c5e2def120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:02.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.808+0000 7f4df4bc1640 1 --2- 172.21.15.19:0/928896223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5e2df7370 0x55c5e2def120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:02.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.808+0000 7f4deffff640 1 --2- 172.21.15.19:0/928896223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5e2df7370 0x55c5e2def120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.808+0000 7f4deffff640 1 -- 172.21.15.19:0/928896223 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5e2de9960 con 0x55c5e2dec5d0 2024-09-19T09:04:02.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.808+0000 7f4df4bc1640 1 --2- 172.21.15.19:0/928896223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5e2df7370 0x55c5e2def120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:02.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.808+0000 7f4deffff640 1 --2- 172.21.15.19:0/928896223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5e2dec5d0 0x55c5e2ded410 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f4de00b8720 tx=0x7f4de00bbf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=428e312d004588e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:02.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.808+0000 7f4dd5ffb640 1 -- 172.21.15.19:0/928896223 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de0049030 con 0x55c5e2dec5d0 2024-09-19T09:04:02.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.808+0000 7f4dd5ffb640 1 -- 172.21.15.19:0/928896223 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4de00dae50 con 0x55c5e2dec5d0 2024-09-19T09:04:02.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.808+0000 7f4dd5ffb640 1 -- 172.21.15.19:0/928896223 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de00b8930 con 0x55c5e2dec5d0 2024-09-19T09:04:02.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.809+0000 7f4df89fd740 1 -- 172.21.15.19:0/928896223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5e2dec5d0 msgr2=0x55c5e2ded410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:02.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.809+0000 7f4df89fd740 1 --2- 172.21.15.19:0/928896223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5e2dec5d0 0x55c5e2ded410 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f4de00b8720 tx=0x7f4de00bbf30 comp rx=0 tx=0).stop 2024-09-19T09:04:02.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.809+0000 7f4df89fd740 1 -- 172.21.15.19:0/928896223 shutdown_connections 2024-09-19T09:04:02.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.809+0000 7f4df89fd740 1 --2- 172.21.15.19:0/928896223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5e2dedb40 0x55c5e2de7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.809+0000 7f4df89fd740 1 --2- 172.21.15.19:0/928896223 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5e2df7370 0x55c5e2def120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.809+0000 7f4df89fd740 1 --2- 172.21.15.19:0/928896223 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5e2dec5d0 0x55c5e2ded410 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.809+0000 7f4df89fd740 1 -- 172.21.15.19:0/928896223 >> 172.21.15.19:0/928896223 conn(0x55c5e2db5310 msgr2=0x55c5e2de74e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:02.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.809+0000 7f4df89fd740 1 -- 172.21.15.19:0/928896223 shutdown_connections 2024-09-19T09:04:02.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.809+0000 7f4df89fd740 1 -- 172.21.15.19:0/928896223 wait complete. 2024-09-19T09:04:02.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.809+0000 7f4df89fd740 1 -- start start 2024-09-19T09:04:02.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.809+0000 7f4df89fd740 1 Processor -- start 2024-09-19T09:04:02.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.810+0000 7f4df89fd740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5e2dec5d0 0x55c5e2df1000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:02.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.810+0000 7f4df89fd740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5e2dedb40 0x55c5e2df1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:02.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.810+0000 7f4df89fd740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5e2df7370 0x55c5e2df1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:02.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.810+0000 7f4df89fd740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4df01b0bd0 con 0x55c5e2df7370 2024-09-19T09:04:02.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.810+0000 7f4df89fd740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4df01b0500 con 0x55c5e2dec5d0 2024-09-19T09:04:02.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.810+0000 7f4df89fd740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4df01ad740 con 0x55c5e2dedb40 2024-09-19T09:04:02.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.810+0000 7f4df89fd740 10 client.0 _ll_register_callbacks cb 0x7f4de0009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:02.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.810+0000 7f4df4bc1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5e2df7370 0x55c5e2df1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:02.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.810+0000 7f4df4bc1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5e2df7370 0x55c5e2df1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59406/0 (socket says 172.21.15.19:59406) 2024-09-19T09:04:02.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.810+0000 7f4df4bc1640 1 -- 172.21.15.19:0/713034371 learned_addr learned my addr 172.21.15.19:0/713034371 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:02.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.810+0000 7f4def7fe640 1 --2- 172.21.15.19:0/713034371 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5e2dedb40 0x55c5e2df1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:02.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.810+0000 7f4deffff640 1 --2- 172.21.15.19:0/713034371 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5e2dec5d0 0x55c5e2df1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:02.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.810+0000 7f4df4bc1640 1 -- 172.21.15.19:0/713034371 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5e2dedb40 msgr2=0x55c5e2df1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:02.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.810+0000 7f4df4bc1640 1 --2- 172.21.15.19:0/713034371 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5e2dedb40 0x55c5e2df1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.810+0000 7f4df4bc1640 1 -- 172.21.15.19:0/713034371 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5e2dec5d0 msgr2=0x55c5e2df1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:02.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.810+0000 7f4df4bc1640 1 --2- 172.21.15.19:0/713034371 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5e2dec5d0 0x55c5e2df1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.810+0000 7f4df4bc1640 1 -- 172.21.15.19:0/713034371 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5e2e70c70 con 0x55c5e2df7370 2024-09-19T09:04:02.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.810+0000 7f4deffff640 1 --2- 172.21.15.19:0/713034371 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5e2dec5d0 0x55c5e2df1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:02.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.810+0000 7f4def7fe640 1 --2- 172.21.15.19:0/713034371 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5e2dedb40 0x55c5e2df1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:02.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.810+0000 7f4df4bc1640 1 --2- 172.21.15.19:0/713034371 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5e2df7370 0x55c5e2df1a80 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f4de800f9e0 tx=0x7f4de8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f4d0a47f8bd898 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:02.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.810+0000 7f4dcf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:04:02.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.811+0000 7f4dcf7fe640 1 -- 172.21.15.19:0/713034371 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de802e060 con 0x55c5e2df7370 2024-09-19T09:04:02.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.811+0000 7f4dcf7fe640 1 -- 172.21.15.19:0/713034371 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8211+0+0 (secure 0 0 0) 0x7f4de8004310 con 0x55c5e2df7370 2024-09-19T09:04:02.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.811+0000 7f4df89fd740 1 -- 172.21.15.19:0/713034371 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4de00dae50 con 0x55c5e2df7370 2024-09-19T09:04:02.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.811+0000 7f4dcf7fe640 1 -- 172.21.15.19:0/713034371 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7f4de8004510 con 0x55c5e2df7370 2024-09-19T09:04:02.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.811+0000 7f4df89fd740 10 client.18528 fetch_fsmap learned FSMap version 39 2024-09-19T09:04:02.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.811+0000 7f4df89fd740 1 -- 172.21.15.19:0/713034371 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) -- 0x55c5e2e71ea0 con 0x55c5e2df7370 2024-09-19T09:04:02.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.811+0000 7f4dcf7fe640 1 -- 172.21.15.19:0/713034371 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4de00dae50 con 0x55c5e2df7370 2024-09-19T09:04:02.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.811+0000 7f4dcf7fe640 1 -- 172.21.15.19:0/713034371 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 39) ==== 8362+0+0 (secure 0 0 0) 0x7f4de8028070 con 0x55c5e2df7370 2024-09-19T09:04:02.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.811+0000 7f4df89fd740 10 client.18528 fetch_fsmap finished waiting for FSMap version 39 2024-09-19T09:04:02.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.811+0000 7f4df89fd740 10 client.18528 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T09:04:02.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.811+0000 7f4df89fd740 20 client.18528 populate_metadata read hostname 'smithi019' 2024-09-19T09:04:02.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.811+0000 7f4df89fd740 1 --2- 172.21.15.19:0/713034371 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55c5e2e725c0 0x55c5e2e749b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:02.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.811+0000 7f4df89fd740 4 client.18528 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:04:02.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.811+0000 7f4df89fd740 1 -- 172.21.15.19:0/713034371 --> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c5e2d59d70 con 0x55c5e2e725c0 2024-09-19T09:04:02.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.812+0000 7f4deffff640 1 --2- 172.21.15.19:0/713034371 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55c5e2e725c0 0x55c5e2e749b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:02.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.812+0000 7f4deffff640 1 --2- 172.21.15.19:0/713034371 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55c5e2e725c0 0x55c5e2e749b0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=bad1f6d372026075 server_cookie=40dfd2bdc98b2c6b in_seq=0 out_seq=0 2024-09-19T09:04:02.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.812+0000 7f4dcf7fe640 10 client.18528 ms_handle_connect on v2:172.21.15.203:6834/2702758353 2024-09-19T09:04:02.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.812+0000 7f4dcf7fe640 1 -- 172.21.15.19:0/713034371 <== mds.4 v2:172.21.15.203:6834/2702758353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c5e2d59d70 con 0x55c5e2e725c0 2024-09-19T09:04:02.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.812+0000 7f4dcf7fe640 10 client.18528 handle_command_reply: tid=0 2024-09-19T09:04:02.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.812+0000 7f4df89fd740 1 client.18528 shutdown 2024-09-19T09:04:02.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.812+0000 7f4df89fd740 1 -- 172.21.15.19:0/713034371 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5e2df7370 msgr2=0x55c5e2df1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:02.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.812+0000 7f4df89fd740 1 --2- 172.21.15.19:0/713034371 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5e2df7370 0x55c5e2df1a80 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f4de800f9e0 tx=0x7f4de8004ab0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.812+0000 7f4df89fd740 1 -- 172.21.15.19:0/713034371 shutdown_connections 2024-09-19T09:04:02.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.812+0000 7f4df89fd740 1 --2- 172.21.15.19:0/713034371 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55c5e2e725c0 0x55c5e2e749b0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.812+0000 7f4df89fd740 1 --2- 172.21.15.19:0/713034371 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c5e2dedb40 0x55c5e2df1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.812+0000 7f4df89fd740 1 --2- 172.21.15.19:0/713034371 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55c5e2df7370 0x55c5e2df1a80 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.812+0000 7f4df89fd740 1 --2- 172.21.15.19:0/713034371 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55c5e2dec5d0 0x55c5e2df1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.813+0000 7f4dcf7fe640 0 client.18528 ms_handle_reset on v2:172.21.15.203:6834/2702758353 2024-09-19T09:04:02.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.813+0000 7f4df89fd740 1 -- 172.21.15.19:0/713034371 >> 172.21.15.19:0/713034371 conn(0x55c5e2db5310 msgr2=0x55c5e2de7d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:02.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.813+0000 7f4df89fd740 1 -- 172.21.15.19:0/713034371 shutdown_connections 2024-09-19T09:04:02.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.813+0000 7f4df89fd740 1 -- 172.21.15.19:0/713034371 wait complete. 2024-09-19T09:04:02.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.813+0000 7f4df89fd740 20 client.18528 trim_cache size 0 max 16384 2024-09-19T09:04:02.819 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:04:02.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.813+0000 7f4df6624640 1 -- 172.21.15.19:0/3820249363 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4dd80a3240 msgr2=0x7f4dd80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:02.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.813+0000 7f4df6624640 1 --2- 172.21.15.19:0/3820249363 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4dd80a3240 0x7f4dd80a5700 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4de8005fd0 tx=0x7f4de8009500 comp rx=0 tx=0).stop 2024-09-19T09:04:02.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.813+0000 7f4df6624640 1 -- 172.21.15.19:0/3820249363 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4df0100e20 msgr2=0x7f4df019a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:02.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.813+0000 7f4df6624640 1 --2- 172.21.15.19:0/3820249363 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4df0100e20 0x7f4df019a720 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009230 tx=0x7f4de0004040 comp rx=0 tx=0).stop 2024-09-19T09:04:02.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.813+0000 7f4df6624640 1 -- 172.21.15.19:0/3820249363 shutdown_connections 2024-09-19T09:04:02.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.813+0000 7f4df6624640 1 --2- 172.21.15.19:0/3820249363 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4dd80a3240 0x7f4dd80a5700 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.813+0000 7f4df6624640 1 --2- 172.21.15.19:0/3820249363 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4df0102570 0x7f4df019ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.813+0000 7f4df6624640 1 --2- 172.21.15.19:0/3820249363 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4df0102ef0 0x7f4df019eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.813+0000 7f4df6624640 1 --2- 172.21.15.19:0/3820249363 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4df0100e20 0x7f4df019a720 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:02.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.813+0000 7f4df6624640 1 -- 172.21.15.19:0/3820249363 >> 172.21.15.19:0/3820249363 conn(0x7f4df00fc7d0 msgr2=0x7f4df006a470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:02.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.813+0000 7f4df6624640 1 -- 172.21.15.19:0/3820249363 shutdown_connections 2024-09-19T09:04:02.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:02.813+0000 7f4df6624640 1 -- 172.21.15.19:0/3820249363 wait complete. 2024-09-19T09:04:02.923 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:02.923+0000 7f157bfff640 1 -- 172.21.15.19:0/3936660127 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "foo.212660", "pg_num": 8}]=0 pool 'foo.212660' created v85) ==== 123+0+0 (secure 0 0 0) 0x7f158809c570 con 0x7f1594104f10 2024-09-19T09:04:03.031 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.030+0000 7f159942e640 1 -- 172.21.15.19:0/3936660127 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "foo.212660", "pg_num": 8} v 0) -- 0x7f1594062fc0 con 0x7f1594104f10 2024-09-19T09:04:03.031 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.030+0000 7f157bfff640 1 -- 172.21.15.19:0/3936660127 <== mon.0 v2:172.21.15.19:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "foo.212660", "pg_num": 8}]=0 pool 'foo.212660' already exists v85) ==== 130+0+0 (secure 0 0 0) 0x7f158809be70 con 0x7f1594104f10 2024-09-19T09:04:03.031 INFO:tasks.workunit.client.0.smithi019.stderr:pool 'foo.212660' already exists 2024-09-19T09:04:03.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.032+0000 7f159942e640 1 -- 172.21.15.19:0/3936660127 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f157c0a3250 msgr2=0x7f157c0a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:03.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.032+0000 7f159942e640 1 --2- 172.21.15.19:0/3936660127 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f157c0a3250 0x7f157c0a5710 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1584005fd0 tx=0x7f1584005e20 comp rx=0 tx=0).stop 2024-09-19T09:04:03.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.032+0000 7f159942e640 1 -- 172.21.15.19:0/3936660127 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1594104f10 msgr2=0x7f1594100590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:03.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.032+0000 7f159942e640 1 --2- 172.21.15.19:0/3936660127 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1594104f10 0x7f1594100590 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f158800c970 tx=0x7f158800ce30 comp rx=0 tx=0).stop 2024-09-19T09:04:03.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.032+0000 7f159942e640 1 -- 172.21.15.19:0/3936660127 shutdown_connections 2024-09-19T09:04:03.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.032+0000 7f159942e640 1 --2- 172.21.15.19:0/3936660127 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f157c0a3250 0x7f157c0a5710 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:03.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.032+0000 7f159942e640 1 --2- 172.21.15.19:0/3936660127 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1594107840 0x7f1594100ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:03.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.032+0000 7f159942e640 1 --2- 172.21.15.19:0/3936660127 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1594104f10 0x7f1594100590 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:03.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.032+0000 7f159942e640 1 --2- 172.21.15.19:0/3936660127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f15941025e0 0x7f1594101f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:03.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.032+0000 7f159942e640 1 -- 172.21.15.19:0/3936660127 >> 172.21.15.19:0/3936660127 conn(0x7f15940fc1c0 msgr2=0x7f1594102e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:03.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.032+0000 7f159942e640 1 -- 172.21.15.19:0/3936660127 shutdown_connections 2024-09-19T09:04:03.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.032+0000 7f159942e640 1 -- 172.21.15.19:0/3936660127 wait complete. 2024-09-19T09:04:03.068 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:02 smithi019 ceph-mon[30976]: pgmap v694: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.1 KiB/s wr, 14 op/s 2024-09-19T09:04:03.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:02 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3936660127' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo.212660", "pg_num": 8}]: dispatch 2024-09-19T09:04:03.135 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.131+0000 7fe038352640 1 -- 172.21.15.19:0/1154664280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0301078a0 msgr2=0x7fe030109cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:03.135 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.131+0000 7fe038352640 1 --2- 172.21.15.19:0/1154664280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0301078a0 0x7fe030109cb0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fe028009ca0 tx=0x7fe02802a8c0 comp rx=0 tx=0).stop 2024-09-19T09:04:03.135 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.131+0000 7fe038352640 1 -- 172.21.15.19:0/1154664280 shutdown_connections 2024-09-19T09:04:03.135 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.131+0000 7fe038352640 1 --2- 172.21.15.19:0/1154664280 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe030104f70 0x7fe030107360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:03.135 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.131+0000 7fe038352640 1 --2- 172.21.15.19:0/1154664280 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe0301078a0 0x7fe030109cb0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:03.135 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.131+0000 7fe038352640 1 --2- 172.21.15.19:0/1154664280 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe030102640 0x7fe030104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:03.135 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.131+0000 7fe038352640 1 -- 172.21.15.19:0/1154664280 >> 172.21.15.19:0/1154664280 conn(0x7fe0300fc1c0 msgr2=0x7fe0300fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:03.135 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.131+0000 7fe038352640 1 -- 172.21.15.19:0/1154664280 shutdown_connections 2024-09-19T09:04:03.135 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.132+0000 7fe038352640 1 -- 172.21.15.19:0/1154664280 wait complete. 2024-09-19T09:04:03.135 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.132+0000 7fe038352640 1 Processor -- start 2024-09-19T09:04:03.135 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.132+0000 7fe038352640 1 -- start start 2024-09-19T09:04:03.136 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.132+0000 7fe038352640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe030102640 0x7fe030197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:03.136 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.132+0000 7fe038352640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe030104f70 0x7fe030198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:03.136 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.132+0000 7fe038352640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0301078a0 0x7fe03019f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:03.136 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.132+0000 7fe038352640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fe03010d820 con 0x7fe030102640 2024-09-19T09:04:03.136 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.132+0000 7fe038352640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fe03010d6a0 con 0x7fe030104f70 2024-09-19T09:04:03.136 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.132+0000 7fe038352640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe03010d9a0 con 0x7fe0301078a0 2024-09-19T09:04:03.136 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.132+0000 7fe0360ee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe030102640 0x7fe030197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:03.136 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.132+0000 7fe0360ee640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe030102640 0x7fe030197f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59418/0 (socket says 172.21.15.19:59418) 2024-09-19T09:04:03.136 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.132+0000 7fe0360ee640 1 -- 172.21.15.19:0/1681187927 learned_addr learned my addr 172.21.15.19:0/1681187927 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:03.136 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.133+0000 7fe0368ef640 1 --2- 172.21.15.19:0/1681187927 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0301078a0 0x7fe03019f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:03.136 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.133+0000 7fe0358ed640 1 --2- 172.21.15.19:0/1681187927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe030104f70 0x7fe030198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:03.136 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.133+0000 7fe0360ee640 1 -- 172.21.15.19:0/1681187927 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0301078a0 msgr2=0x7fe03019f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:03.136 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.133+0000 7fe0360ee640 1 --2- 172.21.15.19:0/1681187927 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0301078a0 0x7fe03019f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:03.137 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.133+0000 7fe0360ee640 1 -- 172.21.15.19:0/1681187927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe030104f70 msgr2=0x7fe030198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:03.137 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.133+0000 7fe0360ee640 1 --2- 172.21.15.19:0/1681187927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe030104f70 0x7fe030198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:03.137 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.133+0000 7fe0360ee640 1 -- 172.21.15.19:0/1681187927 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe03019fb40 con 0x7fe030102640 2024-09-19T09:04:03.137 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.133+0000 7fe0368ef640 1 --2- 172.21.15.19:0/1681187927 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0301078a0 0x7fe03019f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:03.137 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.133+0000 7fe0360ee640 1 --2- 172.21.15.19:0/1681187927 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe030102640 0x7fe030197f20 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fe02c00d950 tx=0x7fe02c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:03.137 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.133+0000 7fe0277fe640 1 -- 172.21.15.19:0/1681187927 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02c017070 con 0x7fe030102640 2024-09-19T09:04:03.137 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.133+0000 7fe038352640 1 -- 172.21.15.19:0/1681187927 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe03019fe30 con 0x7fe030102640 2024-09-19T09:04:03.138 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.133+0000 7fe0277fe640 1 -- 172.21.15.19:0/1681187927 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fe02c009c30 con 0x7fe030102640 2024-09-19T09:04:03.138 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.133+0000 7fe0277fe640 1 -- 172.21.15.19:0/1681187927 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe02c00f6b0 con 0x7fe030102640 2024-09-19T09:04:03.138 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.133+0000 7fe038352640 1 -- 172.21.15.19:0/1681187927 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0301a02f0 con 0x7fe030102640 2024-09-19T09:04:03.138 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.134+0000 7fe038352640 1 -- 172.21.15.19:0/1681187927 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0300fdcb0 con 0x7fe030102640 2024-09-19T09:04:03.138 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.136+0000 7fe0277fe640 1 -- 172.21.15.19:0/1681187927 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fe02c0109d0 con 0x7fe030102640 2024-09-19T09:04:03.139 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.136+0000 7fe0277fe640 1 --2- 172.21.15.19:0/1681187927 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe01c0a3250 0x7fe01c0a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:03.139 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.137+0000 7fe0358ed640 1 --2- 172.21.15.19:0/1681187927 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe01c0a3250 0x7fe01c0a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:03.139 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.137+0000 7fe0277fe640 1 -- 172.21.15.19:0/1681187927 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8560+0+0 (secure 0 0 0) 0x7fe02c0cf770 con 0x7fe030102640 2024-09-19T09:04:03.139 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.137+0000 7fe0358ed640 1 --2- 172.21.15.19:0/1681187927 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe01c0a3250 0x7fe01c0a5710 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe020005fd0 tx=0x7fe020005e20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:03.141 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.140+0000 7fe0277fe640 1 -- 172.21.15.19:0/1681187927 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe02c009de0 con 0x7fe030102640 2024-09-19T09:04:03.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:02 smithi155 ceph-mon[34921]: pgmap v694: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.1 KiB/s wr, 14 op/s 2024-09-19T09:04:03.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:02 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3936660127' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo.212660", "pg_num": 8}]: dispatch 2024-09-19T09:04:03.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:02 smithi203 ceph-mon[35450]: pgmap v694: 97 pgs: 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 2.1 KiB/s wr, 14 op/s 2024-09-19T09:04:03.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:02 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3936660127' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo.212660", "pg_num": 8}]: dispatch 2024-09-19T09:04:03.358 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.357+0000 7fe038352640 1 -- 172.21.15.19:0/1681187927 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.212660"} v 0) -- 0x7fe03002d7c0 con 0x7fe030102640 2024-09-19T09:04:03.633 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T09:04:03.890 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:03.926 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:03.925+0000 7fe0277fe640 1 -- 172.21.15.19:0/1681187927 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.212660"}]=0 added data pool 4 to fsmap v40) ==== 133+0+0 (secure 0 0 0) 0x7fe02c09c310 con 0x7fe030102640 2024-09-19T09:04:04.074 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.073+0000 7fe038352640 1 -- 172.21.15.19:0/1681187927 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.212660"} v 0) -- 0x7fe03002ce00 con 0x7fe030102640 2024-09-19T09:04:04.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.074+0000 7fe0277fe640 1 -- 172.21.15.19:0/1681187927 <== mon.0 v2:172.21.15.19:3300/0 8 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.212660"}]=-22 RADOS pool 'foo.212660' is already used by filesystem 'cephfs' as a 'data' pool for application 'cephfs' v40) ==== 211+0+0 (secure 0 0 0) 0x7fe02c09bc10 con 0x7fe030102640 2024-09-19T09:04:04.075 INFO:tasks.workunit.client.0.smithi019.stderr:Second attempt of previously successful command failed with EINVAL: RADOS pool 'foo.212660' is already used by filesystem 'cephfs' as a 'data' pool for application 'cephfs' 2024-09-19T09:04:04.075 INFO:tasks.workunit.client.0.smithi019.stderr:RADOS pool 'foo.212660' is already used by filesystem 'cephfs' as a 'data' pool for application 'cephfs' 2024-09-19T09:04:04.077 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.076+0000 7fe038352640 1 -- 172.21.15.19:0/1681187927 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe01c0a3250 msgr2=0x7fe01c0a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:04.077 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.076+0000 7fe038352640 1 --2- 172.21.15.19:0/1681187927 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe01c0a3250 0x7fe01c0a5710 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe020005fd0 tx=0x7fe020005e20 comp rx=0 tx=0).stop 2024-09-19T09:04:04.077 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.076+0000 7fe038352640 1 -- 172.21.15.19:0/1681187927 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe030102640 msgr2=0x7fe030197f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:04.078 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.076+0000 7fe038352640 1 --2- 172.21.15.19:0/1681187927 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe030102640 0x7fe030197f20 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7fe02c00d950 tx=0x7fe02c00de10 comp rx=0 tx=0).stop 2024-09-19T09:04:04.078 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.076+0000 7fe038352640 1 -- 172.21.15.19:0/1681187927 shutdown_connections 2024-09-19T09:04:04.078 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.076+0000 7fe038352640 1 --2- 172.21.15.19:0/1681187927 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fe01c0a3250 0x7fe01c0a5710 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.078 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.076+0000 7fe038352640 1 --2- 172.21.15.19:0/1681187927 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe0301078a0 0x7fe03019f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.078 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.076+0000 7fe038352640 1 --2- 172.21.15.19:0/1681187927 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fe030104f70 0x7fe030198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.078 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.076+0000 7fe038352640 1 --2- 172.21.15.19:0/1681187927 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fe030102640 0x7fe030197f20 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.078 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.076+0000 7fe038352640 1 -- 172.21.15.19:0/1681187927 >> 172.21.15.19:0/1681187927 conn(0x7fe0300fc1c0 msgr2=0x7fe030102ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:04.078 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.076+0000 7fe038352640 1 -- 172.21.15.19:0/1681187927 shutdown_connections 2024-09-19T09:04:04.078 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.076+0000 7fe038352640 1 -- 172.21.15.19:0/1681187927 wait complete. 2024-09-19T09:04:04.182 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:03 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3936660127' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "foo.212660", "pg_num": 8}]': finished 2024-09-19T09:04:04.183 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:03 smithi019 ceph-mon[30976]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T09:04:04.183 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:03 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3936660127' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo.212660", "pg_num": 8}]: dispatch 2024-09-19T09:04:04.183 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:03 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1681187927' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.212660"}]: dispatch 2024-09-19T09:04:04.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.184+0000 7f2e40eae640 1 -- 172.21.15.19:0/3986944478 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e3c1025d0 msgr2=0x7f2e3c1049c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:04.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.184+0000 7f2e40eae640 1 --2- 172.21.15.19:0/3986944478 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e3c1025d0 0x7f2e3c1049c0 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c009900 tx=0x7f2e2c02a410 comp rx=0 tx=0).stop 2024-09-19T09:04:04.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.184+0000 7f2e40eae640 1 -- 172.21.15.19:0/3986944478 shutdown_connections 2024-09-19T09:04:04.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.184+0000 7f2e40eae640 1 --2- 172.21.15.19:0/3986944478 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e3c107830 0x7f2e3c109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.186 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.184+0000 7f2e40eae640 1 --2- 172.21.15.19:0/3986944478 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e3c104f00 0x7f2e3c1072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.186 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.184+0000 7f2e40eae640 1 --2- 172.21.15.19:0/3986944478 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e3c1025d0 0x7f2e3c1049c0 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.186 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.184+0000 7f2e40eae640 1 -- 172.21.15.19:0/3986944478 >> 172.21.15.19:0/3986944478 conn(0x7f2e3c0fc1b0 msgr2=0x7f2e3c0fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:04.186 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.184+0000 7f2e40eae640 1 -- 172.21.15.19:0/3986944478 shutdown_connections 2024-09-19T09:04:04.186 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.184+0000 7f2e40eae640 1 -- 172.21.15.19:0/3986944478 wait complete. 2024-09-19T09:04:04.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.185+0000 7f2e40eae640 1 Processor -- start 2024-09-19T09:04:04.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.185+0000 7f2e40eae640 1 -- start start 2024-09-19T09:04:04.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.185+0000 7f2e40eae640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e3c1025d0 0x7f2e3c197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:04.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.185+0000 7f2e40eae640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e3c104f00 0x7f2e3c198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:04.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.185+0000 7f2e40eae640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e3c107830 0x7f2e3c19f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:04.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.185+0000 7f2e40eae640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3c10d840 con 0x7f2e3c104f00 2024-09-19T09:04:04.189 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.185+0000 7f2e40eae640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3c10d6c0 con 0x7f2e3c107830 2024-09-19T09:04:04.189 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.185+0000 7f2e40eae640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2e3c10d9c0 con 0x7f2e3c1025d0 2024-09-19T09:04:04.189 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.185+0000 7f2e39d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e3c104f00 0x7f2e3c198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:04.189 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.185+0000 7f2e39d9b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e3c104f00 0x7f2e3c198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59432/0 (socket says 172.21.15.19:59432) 2024-09-19T09:04:04.189 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.185+0000 7f2e39d9b640 1 -- 172.21.15.19:0/1730087354 learned_addr learned my addr 172.21.15.19:0/1730087354 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:04.189 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.185+0000 7f2e3a59c640 1 --2- 172.21.15.19:0/1730087354 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e3c1025d0 0x7f2e3c197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:04.189 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.186+0000 7f2e3ad9d640 1 --2- 172.21.15.19:0/1730087354 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e3c107830 0x7f2e3c19f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:04.189 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.186+0000 7f2e39d9b640 1 -- 172.21.15.19:0/1730087354 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e3c1025d0 msgr2=0x7f2e3c197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:04.189 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.186+0000 7f2e39d9b640 1 --2- 172.21.15.19:0/1730087354 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e3c1025d0 0x7f2e3c197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.189 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.186+0000 7f2e39d9b640 1 -- 172.21.15.19:0/1730087354 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e3c107830 msgr2=0x7f2e3c19f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:04.189 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.186+0000 7f2e39d9b640 1 --2- 172.21.15.19:0/1730087354 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e3c107830 0x7f2e3c19f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.186+0000 7f2e39d9b640 1 -- 172.21.15.19:0/1730087354 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e3c19fb40 con 0x7f2e3c104f00 2024-09-19T09:04:04.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.186+0000 7f2e39d9b640 1 --2- 172.21.15.19:0/1730087354 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e3c104f00 0x7f2e3c198460 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f2e3000d770 tx=0x7f2e3000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:04.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.186+0000 7f2e2b7fe640 1 -- 172.21.15.19:0/1730087354 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e30017070 con 0x7f2e3c104f00 2024-09-19T09:04:04.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.186+0000 7f2e2b7fe640 1 -- 172.21.15.19:0/1730087354 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2e30009c30 con 0x7f2e3c104f00 2024-09-19T09:04:04.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.186+0000 7f2e40eae640 1 -- 172.21.15.19:0/1730087354 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e3c19fe30 con 0x7f2e3c104f00 2024-09-19T09:04:04.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.186+0000 7f2e2b7fe640 1 -- 172.21.15.19:0/1730087354 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e3000f620 con 0x7f2e3c104f00 2024-09-19T09:04:04.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.186+0000 7f2e40eae640 1 -- 172.21.15.19:0/1730087354 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e3c1a0340 con 0x7f2e3c104f00 2024-09-19T09:04:04.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.187+0000 7f2e40eae640 1 -- 172.21.15.19:0/1730087354 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e3c0fdca0 con 0x7f2e3c104f00 2024-09-19T09:04:04.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.190+0000 7f2e2b7fe640 1 -- 172.21.15.19:0/1730087354 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f2e3001a070 con 0x7f2e3c104f00 2024-09-19T09:04:04.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.190+0000 7f2e2b7fe640 1 --2- 172.21.15.19:0/1730087354 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2e240a32d0 0x7f2e240a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:04.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.190+0000 7f2e3a59c640 1 --2- 172.21.15.19:0/1730087354 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2e240a32d0 0x7f2e240a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:04.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.191+0000 7f2e2b7fe640 1 -- 172.21.15.19:0/1730087354 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8592+0+0 (secure 0 0 0) 0x7f2e300cf460 con 0x7f2e3c104f00 2024-09-19T09:04:04.192 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.191+0000 7f2e3a59c640 1 --2- 172.21.15.19:0/1730087354 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2e240a32d0 0x7f2e240a5790 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c000c00 tx=0x7f2e2c0315d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:04.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.192+0000 7f2e2b7fe640 1 -- 172.21.15.19:0/1730087354 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2e30009de0 con 0x7f2e3c104f00 2024-09-19T09:04:04.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:03 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3936660127' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "foo.212660", "pg_num": 8}]': finished 2024-09-19T09:04:04.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:03 smithi203 ceph-mon[35450]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T09:04:04.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:03 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3936660127' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo.212660", "pg_num": 8}]: dispatch 2024-09-19T09:04:04.233 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:03 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1681187927' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.212660"}]: dispatch 2024-09-19T09:04:04.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.385+0000 7f82e0021640 1 -- 172.21.15.19:0/2203974841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82d8100e20 msgr2=0x7f82d8101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:04.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.385+0000 7f82e0021640 1 --2- 172.21.15.19:0/2203974841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82d8100e20 0x7f82d8101200 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f82d4009ca0 tx=0x7f82d402a950 comp rx=0 tx=0).stop 2024-09-19T09:04:04.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.385+0000 7f82e0021640 1 -- 172.21.15.19:0/2203974841 shutdown_connections 2024-09-19T09:04:04.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.385+0000 7f82e0021640 1 --2- 172.21.15.19:0/2203974841 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f82d8102ef0 0x7f82d810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.385+0000 7f82e0021640 1 --2- 172.21.15.19:0/2203974841 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82d8102570 0x7f82d81029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.385+0000 7f82e0021640 1 --2- 172.21.15.19:0/2203974841 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82d8100e20 0x7f82d8101200 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.385+0000 7f82e0021640 1 -- 172.21.15.19:0/2203974841 >> 172.21.15.19:0/2203974841 conn(0x7f82d80fc7d0 msgr2=0x7f82d80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:04.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.385+0000 7f82e0021640 1 -- 172.21.15.19:0/2203974841 shutdown_connections 2024-09-19T09:04:04.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.385+0000 7f82e0021640 1 -- 172.21.15.19:0/2203974841 wait complete. 2024-09-19T09:04:04.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.386+0000 7f82e0021640 1 Processor -- start 2024-09-19T09:04:04.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.386+0000 7f82e0021640 1 -- start start 2024-09-19T09:04:04.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.386+0000 7f82e0021640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f82d8100e20 0x7f82d80fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:04.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.386+0000 7f82e0021640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82d8102570 0x7f82d80fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:04.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.386+0000 7f82e0021640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82d8102ef0 0x7f82d80fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:04.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.386+0000 7f82e0021640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f82d8110f50 con 0x7f82d8102570 2024-09-19T09:04:04.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.386+0000 7f82e0021640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f82d8110dd0 con 0x7f82d8102ef0 2024-09-19T09:04:04.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.386+0000 7f82e0021640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f82d81110d0 con 0x7f82d8100e20 2024-09-19T09:04:04.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.386+0000 7f82dd5bc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82d8102570 0x7f82d80fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:04.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.386+0000 7f82dd5bc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82d8102570 0x7f82d80fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59450/0 (socket says 172.21.15.19:59450) 2024-09-19T09:04:04.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.386+0000 7f82dd5bc640 1 -- 172.21.15.19:0/3232081647 learned_addr learned my addr 172.21.15.19:0/3232081647 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:04.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.387+0000 7f82dddbd640 1 --2- 172.21.15.19:0/3232081647 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f82d8100e20 0x7f82d80fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:04.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.387+0000 7f82de5be640 1 --2- 172.21.15.19:0/3232081647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82d8102ef0 0x7f82d80fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:04.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.387+0000 7f82dd5bc640 1 -- 172.21.15.19:0/3232081647 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f82d8100e20 msgr2=0x7f82d80fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:04.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.387+0000 7f82dd5bc640 1 --2- 172.21.15.19:0/3232081647 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f82d8100e20 0x7f82d80fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.387+0000 7f82dd5bc640 1 -- 172.21.15.19:0/3232081647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82d8102ef0 msgr2=0x7f82d80fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:04.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.387+0000 7f82dd5bc640 1 --2- 172.21.15.19:0/3232081647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82d8102ef0 0x7f82d80fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.387+0000 7f82dd5bc640 1 -- 172.21.15.19:0/3232081647 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82d81a69e0 con 0x7f82d8102570 2024-09-19T09:04:04.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.387+0000 7f82de5be640 1 --2- 172.21.15.19:0/3232081647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82d8102ef0 0x7f82d80fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:04.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.387+0000 7f82dd5bc640 1 --2- 172.21.15.19:0/3232081647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82d8102570 0x7f82d80fd1c0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f82cc00d950 tx=0x7f82cc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:04.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.387+0000 7f82caffd640 1 -- 172.21.15.19:0/3232081647 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc017070 con 0x7f82d8102570 2024-09-19T09:04:04.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.387+0000 7f82e0021640 1 -- 172.21.15.19:0/3232081647 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82d81a6cd0 con 0x7f82d8102570 2024-09-19T09:04:04.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.387+0000 7f82caffd640 1 -- 172.21.15.19:0/3232081647 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82cc009c30 con 0x7f82d8102570 2024-09-19T09:04:04.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.387+0000 7f82caffd640 1 -- 172.21.15.19:0/3232081647 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc00f6b0 con 0x7f82d8102570 2024-09-19T09:04:04.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.387+0000 7f82e0021640 1 -- 172.21.15.19:0/3232081647 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82d81a71b0 con 0x7f82d8102570 2024-09-19T09:04:04.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.389+0000 7f82caffd640 1 -- 172.21.15.19:0/3232081647 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f82cc0109d0 con 0x7f82d8102570 2024-09-19T09:04:04.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.390+0000 7f82e23fa740 1 Processor -- start 2024-09-19T09:04:04.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.390+0000 7f82e23fa740 1 -- start start 2024-09-19T09:04:04.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.390+0000 7f82e23fa740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c20316b40 0x558c20315090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:04.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.390+0000 7f82e23fa740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c203155d0 0x558c20315a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:04.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.390+0000 7f82e23fa740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c20320370 0x558c20322760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:04.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.390+0000 7f82e23fa740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x558c2027b2f0 con 0x558c203155d0 2024-09-19T09:04:04.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.390+0000 7f82e23fa740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x558c20222cf0 con 0x558c20316b40 2024-09-19T09:04:04.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.390+0000 7f82e23fa740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558c202772b0 con 0x558c20320370 2024-09-19T09:04:04.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.390+0000 7f82caffd640 1 --2- 172.21.15.19:0/3232081647 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f82c40a3240 0x7f82c40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:04.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.391+0000 7f82dddbd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c203155d0 0x558c20315a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:04.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.391+0000 7f82dddbd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c203155d0 0x558c20315a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59460/0 (socket says 172.21.15.19:59460) 2024-09-19T09:04:04.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.391+0000 7f82dddbd640 1 -- 172.21.15.19:0/1350179386 learned_addr learned my addr 172.21.15.19:0/1350179386 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:04.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.391+0000 7f82dd5bc640 1 --2- 172.21.15.19:0/1350179386 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c20320370 0x558c20322760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:04.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.391+0000 7f82caffd640 1 -- 172.21.15.19:0/3232081647 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8592+0+0 (secure 0 0 0) 0x7f82cc0cf770 con 0x7f82d8102570 2024-09-19T09:04:04.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.391+0000 7f82de5be640 1 --2- 172.21.15.19:0/3232081647 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f82c40a3240 0x7f82c40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:04.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.391+0000 7f82de5be640 1 --2- 172.21.15.19:0/1350179386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c20316b40 0x558c20315090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:04.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.391+0000 7f82dddbd640 1 -- 172.21.15.19:0/1350179386 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c20320370 msgr2=0x558c20322760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:04.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.391+0000 7f82dddbd640 1 --2- 172.21.15.19:0/1350179386 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c20320370 0x558c20322760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.391+0000 7f82dddbd640 1 -- 172.21.15.19:0/1350179386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c20316b40 msgr2=0x558c20315090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:04.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.391+0000 7f82dddbd640 1 --2- 172.21.15.19:0/1350179386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c20316b40 0x558c20315090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.391+0000 7f82dddbd640 1 -- 172.21.15.19:0/1350179386 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c202073a0 con 0x558c203155d0 2024-09-19T09:04:04.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.391+0000 7f82de5be640 1 --2- 172.21.15.19:0/3232081647 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f82c40a3240 0x7f82c40a5700 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f82d0009460 tx=0x7f82d0013830 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:04.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.391+0000 7f82dddbd640 1 --2- 172.21.15.19:0/1350179386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c203155d0 0x558c20315a10 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f82d4035000 tx=0x7f82d4005f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33661d5e9c8c90d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:04.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.392+0000 7f82c3fff640 1 -- 172.21.15.19:0/1350179386 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d4034040 con 0x558c203155d0 2024-09-19T09:04:04.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.392+0000 7f82c3fff640 1 -- 172.21.15.19:0/1350179386 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82d402fb30 con 0x558c203155d0 2024-09-19T09:04:04.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.392+0000 7f82c3fff640 1 -- 172.21.15.19:0/1350179386 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d4004330 con 0x558c203155d0 2024-09-19T09:04:04.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.392+0000 7f82e23fa740 1 -- 172.21.15.19:0/1350179386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c203155d0 msgr2=0x558c20315a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:04.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.392+0000 7f82e23fa740 1 --2- 172.21.15.19:0/1350179386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c203155d0 0x558c20315a10 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f82d4035000 tx=0x7f82d4005f60 comp rx=0 tx=0).stop 2024-09-19T09:04:04.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.392+0000 7f82e23fa740 1 -- 172.21.15.19:0/1350179386 shutdown_connections 2024-09-19T09:04:04.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.392+0000 7f82e23fa740 1 --2- 172.21.15.19:0/1350179386 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c20320370 0x558c20322760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.392+0000 7f82e23fa740 1 --2- 172.21.15.19:0/1350179386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c203155d0 0x558c20315a10 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.392+0000 7f82e23fa740 1 --2- 172.21.15.19:0/1350179386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c20316b40 0x558c20315090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.392+0000 7f82e23fa740 1 -- 172.21.15.19:0/1350179386 >> 172.21.15.19:0/1350179386 conn(0x558c202de310 msgr2=0x558c20311c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:04.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.393+0000 7f82e23fa740 1 -- 172.21.15.19:0/1350179386 shutdown_connections 2024-09-19T09:04:04.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.393+0000 7f82e23fa740 1 -- 172.21.15.19:0/1350179386 wait complete. 2024-09-19T09:04:04.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.393+0000 7f82e23fa740 1 -- start start 2024-09-19T09:04:04.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.393+0000 7f82e23fa740 1 Processor -- start 2024-09-19T09:04:04.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.393+0000 7f82e23fa740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c203155d0 0x558c2031fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:04.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.393+0000 7f82e23fa740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c20316b40 0x558c2031cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:04.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.393+0000 7f82e23fa740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c20320370 0x558c2031d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:04.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.393+0000 7f82e23fa740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x558c20323010 con 0x558c20320370 2024-09-19T09:04:04.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.393+0000 7f82e23fa740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x558c20236060 con 0x558c203155d0 2024-09-19T09:04:04.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.393+0000 7f82e23fa740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558c20323190 con 0x558c20316b40 2024-09-19T09:04:04.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.394+0000 7f82e23fa740 10 client.0 _ll_register_callbacks cb 0x558c1ff898c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:04.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.394+0000 7f82de5be640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c20320370 0x558c2031d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:04.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.394+0000 7f82de5be640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c20320370 0x558c2031d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59464/0 (socket says 172.21.15.19:59464) 2024-09-19T09:04:04.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.394+0000 7f82de5be640 1 -- 172.21.15.19:0/1005906029 learned_addr learned my addr 172.21.15.19:0/1005906029 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:04.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.394+0000 7f82dddbd640 1 --2- 172.21.15.19:0/1005906029 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c203155d0 0x558c2031fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:04.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.394+0000 7f82dd5bc640 1 --2- 172.21.15.19:0/1005906029 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c20316b40 0x558c2031cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:04.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.394+0000 7f82de5be640 1 -- 172.21.15.19:0/1005906029 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c20316b40 msgr2=0x558c2031cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:04.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.394+0000 7f82de5be640 1 --2- 172.21.15.19:0/1005906029 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c20316b40 0x558c2031cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.394+0000 7f82de5be640 1 -- 172.21.15.19:0/1005906029 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c203155d0 msgr2=0x558c2031fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:04.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.394+0000 7f82de5be640 1 --2- 172.21.15.19:0/1005906029 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c203155d0 0x558c2031fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.394+0000 7f82de5be640 1 -- 172.21.15.19:0/1005906029 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c1ffec3c0 con 0x558c20320370 2024-09-19T09:04:04.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.394+0000 7f82de5be640 1 --2- 172.21.15.19:0/1005906029 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c20320370 0x558c2031d490 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f82d0009250 tx=0x7f82d0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27e2ff09301fffd0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:04.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.394+0000 7f82c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:04:04.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.394+0000 7f82c17fa640 1 -- 172.21.15.19:0/1005906029 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d0011970 con 0x558c20320370 2024-09-19T09:04:04.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.394+0000 7f82c17fa640 1 -- 172.21.15.19:0/1005906029 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8592+0+0 (secure 0 0 0) 0x7f82d0011b10 con 0x558c20320370 2024-09-19T09:04:04.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.394+0000 7f82e23fa740 1 -- 172.21.15.19:0/1005906029 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82d402fb30 con 0x558c20320370 2024-09-19T09:04:04.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.394+0000 7f82c17fa640 1 -- 172.21.15.19:0/1005906029 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f82d0030050 con 0x558c20320370 2024-09-19T09:04:04.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.394+0000 7f82e23fa740 10 client.18552 fetch_fsmap learned FSMap version 40 2024-09-19T09:04:04.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.395+0000 7f82e23fa740 1 -- 172.21.15.19:0/1005906029 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x558c2032ea00 con 0x558c20320370 2024-09-19T09:04:04.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.395+0000 7f82c17fa640 1 -- 172.21.15.19:0/1005906029 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82d402fb30 con 0x558c20320370 2024-09-19T09:04:04.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.395+0000 7f82c17fa640 1 -- 172.21.15.19:0/1005906029 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 40) ==== 8370+0+0 (secure 0 0 0) 0x7f82d000f3d0 con 0x558c20320370 2024-09-19T09:04:04.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.395+0000 7f82e23fa740 10 client.18552 fetch_fsmap finished waiting for FSMap version 40 2024-09-19T09:04:04.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.395+0000 7f82e23fa740 10 client.18552 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-19T09:04:04.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.395+0000 7f82e23fa740 20 client.18552 populate_metadata read hostname 'smithi019' 2024-09-19T09:04:04.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.395+0000 7f82e23fa740 1 --2- 172.21.15.19:0/1005906029 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x558c2032fec0 0x558c20332360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:04.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.395+0000 7f82e23fa740 4 client.18552 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:04.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.395+0000 7f82e23fa740 1 -- 172.21.15.19:0/1005906029 --> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c20288860 con 0x558c2032fec0 2024-09-19T09:04:04.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.395+0000 7f82dddbd640 1 --2- 172.21.15.19:0/1005906029 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x558c2032fec0 0x558c20332360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:04.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.396+0000 7f82c17fa640 10 client.18552 ms_handle_connect on v2:172.21.15.155:6836/3381010945 2024-09-19T09:04:04.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.396+0000 7f82dddbd640 1 --2- 172.21.15.19:0/1005906029 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x558c2032fec0 0x558c20332360 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ca485ca6005719f7 server_cookie=63faf9ad545161ce in_seq=0 out_seq=0 2024-09-19T09:04:04.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.396+0000 7f82c17fa640 1 -- 172.21.15.19:0/1005906029 <== mds.3 v2:172.21.15.155:6836/3381010945 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558c20288860 con 0x558c2032fec0 2024-09-19T09:04:04.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.396+0000 7f82c17fa640 10 client.18552 handle_command_reply: tid=0 2024-09-19T09:04:04.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.396+0000 7f82e23fa740 1 client.18552 shutdown 2024-09-19T09:04:04.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.397+0000 7f82e23fa740 1 -- 172.21.15.19:0/1005906029 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c20320370 msgr2=0x558c2031d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:04.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.397+0000 7f82e23fa740 1 --2- 172.21.15.19:0/1005906029 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c20320370 0x558c2031d490 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f82d0009250 tx=0x7f82d0019000 comp rx=0 tx=0).stop 2024-09-19T09:04:04.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.397+0000 7f82e23fa740 1 -- 172.21.15.19:0/1005906029 shutdown_connections 2024-09-19T09:04:04.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.397+0000 7f82e23fa740 1 --2- 172.21.15.19:0/1005906029 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x558c2032fec0 0x558c20332360 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.397+0000 7f82e23fa740 1 --2- 172.21.15.19:0/1005906029 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c20316b40 0x558c2031cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.397+0000 7f82e23fa740 1 --2- 172.21.15.19:0/1005906029 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c20320370 0x558c2031d490 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.397+0000 7f82c17fa640 0 client.18552 ms_handle_reset on v2:172.21.15.155:6836/3381010945 2024-09-19T09:04:04.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.397+0000 7f82e23fa740 1 --2- 172.21.15.19:0/1005906029 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c203155d0 0x558c2031fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.397+0000 7f82e23fa740 1 -- 172.21.15.19:0/1005906029 >> 172.21.15.19:0/1005906029 conn(0x558c202de310 msgr2=0x558c20317960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:04.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.397+0000 7f82e23fa740 1 -- 172.21.15.19:0/1005906029 shutdown_connections 2024-09-19T09:04:04.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.397+0000 7f82e23fa740 1 -- 172.21.15.19:0/1005906029 wait complete. 2024-09-19T09:04:04.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.397+0000 7f82e23fa740 20 client.18552 trim_cache size 0 max 16384 2024-09-19T09:04:04.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.410+0000 7f82e23fa740 1 Processor -- start 2024-09-19T09:04:04.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.410+0000 7f82e23fa740 1 -- start start 2024-09-19T09:04:04.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.410+0000 7f82e23fa740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c202de310 0x558c20311e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:04.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.410+0000 7f82e23fa740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c203155d0 0x558c2032c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:04.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.410+0000 7f82e23fa740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c20316b40 0x558c2031c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:04.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.410+0000 7f82e23fa740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f82d81afea0 con 0x558c203155d0 2024-09-19T09:04:04.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.410+0000 7f82e23fa740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f82d81b19e0 con 0x558c20316b40 2024-09-19T09:04:04.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.410+0000 7f82e23fa740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f82d81b0570 con 0x558c202de310 2024-09-19T09:04:04.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.410+0000 7f82dd5bc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c203155d0 0x558c2032c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:04.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.410+0000 7f82dd5bc640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c203155d0 0x558c2032c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59472/0 (socket says 172.21.15.19:59472) 2024-09-19T09:04:04.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.410+0000 7f82dd5bc640 1 -- 172.21.15.19:0/682045637 learned_addr learned my addr 172.21.15.19:0/682045637 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:04.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.410+0000 7f82dddbd640 1 --2- 172.21.15.19:0/682045637 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c202de310 0x558c20311e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:04.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.410+0000 7f82de5be640 1 --2- 172.21.15.19:0/682045637 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c20316b40 0x558c2031c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:04.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.410+0000 7f82dd5bc640 1 -- 172.21.15.19:0/682045637 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c202de310 msgr2=0x558c20311e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:04.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.411+0000 7f82dd5bc640 1 --2- 172.21.15.19:0/682045637 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c202de310 0x558c20311e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.411+0000 7f82dd5bc640 1 -- 172.21.15.19:0/682045637 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c20316b40 msgr2=0x558c2031c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:04.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.411+0000 7f82dd5bc640 1 --2- 172.21.15.19:0/682045637 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c20316b40 0x558c2031c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.411+0000 7f82dd5bc640 1 -- 172.21.15.19:0/682045637 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c20318b70 con 0x558c203155d0 2024-09-19T09:04:04.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.411+0000 7f82de5be640 1 --2- 172.21.15.19:0/682045637 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c20316b40 0x558c2031c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:04.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.411+0000 7f82dd5bc640 1 --2- 172.21.15.19:0/682045637 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c203155d0 0x558c2032c2b0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f82cc010fd0 tx=0x7f82cc01e770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=732e2be6ebd1a42a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:04.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.411+0000 7f82c37fe640 1 -- 172.21.15.19:0/682045637 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc020040 con 0x558c203155d0 2024-09-19T09:04:04.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.411+0000 7f82c37fe640 1 -- 172.21.15.19:0/682045637 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82cc09ffe0 con 0x558c203155d0 2024-09-19T09:04:04.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.411+0000 7f82c37fe640 1 -- 172.21.15.19:0/682045637 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82cc09b080 con 0x558c203155d0 2024-09-19T09:04:04.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.412+0000 7f82e23fa740 1 -- 172.21.15.19:0/682045637 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c203155d0 msgr2=0x558c2032c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:04.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.412+0000 7f82e23fa740 1 --2- 172.21.15.19:0/682045637 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c203155d0 0x558c2032c2b0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f82cc010fd0 tx=0x7f82cc01e770 comp rx=0 tx=0).stop 2024-09-19T09:04:04.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.412+0000 7f82e23fa740 1 -- 172.21.15.19:0/682045637 shutdown_connections 2024-09-19T09:04:04.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.412+0000 7f82e23fa740 1 --2- 172.21.15.19:0/682045637 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c20316b40 0x558c2031c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.412+0000 7f82e23fa740 1 --2- 172.21.15.19:0/682045637 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c203155d0 0x558c2032c2b0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.412+0000 7f82e23fa740 1 --2- 172.21.15.19:0/682045637 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c202de310 0x558c20311e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.412+0000 7f82e23fa740 1 -- 172.21.15.19:0/682045637 >> 172.21.15.19:0/682045637 conn(0x558c2031d5f0 msgr2=0x558c20311700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:04.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.412+0000 7f82e23fa740 1 -- 172.21.15.19:0/682045637 shutdown_connections 2024-09-19T09:04:04.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.412+0000 7f82e23fa740 1 -- 172.21.15.19:0/682045637 wait complete. 2024-09-19T09:04:04.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.412+0000 7f82e23fa740 1 -- start start 2024-09-19T09:04:04.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.412+0000 7f82e23fa740 1 Processor -- start 2024-09-19T09:04:04.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.412+0000 7f82e23fa740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c202de310 0x558c2031a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:04.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.413+0000 7f82e23fa740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c203155d0 0x558c2031a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:04.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.413+0000 7f82e23fa740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c20316b40 0x558c2031aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:04.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.413+0000 7f82e23fa740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f82d81b1310 con 0x558c20316b40 2024-09-19T09:04:04.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.413+0000 7f82e23fa740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f82d81b0c40 con 0x558c203155d0 2024-09-19T09:04:04.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.413+0000 7f82e23fa740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f82d81ade60 con 0x558c202de310 2024-09-19T09:04:04.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.413+0000 7f82e23fa740 10 client.0 _ll_register_callbacks cb 0x7f82d0009bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:04.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.413+0000 7f82dddbd640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c202de310 0x558c2031a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:04.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.413+0000 7f82de5be640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c20316b40 0x558c2031aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:04.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.413+0000 7f82de5be640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c20316b40 0x558c2031aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59476/0 (socket says 172.21.15.19:59476) 2024-09-19T09:04:04.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.413+0000 7f82de5be640 1 -- 172.21.15.19:0/3835171801 learned_addr learned my addr 172.21.15.19:0/3835171801 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:04.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.413+0000 7f82dd5bc640 1 --2- 172.21.15.19:0/3835171801 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c203155d0 0x558c2031a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:04.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.413+0000 7f82de5be640 1 -- 172.21.15.19:0/3835171801 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c202de310 msgr2=0x558c2031a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:04.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.413+0000 7f82de5be640 1 --2- 172.21.15.19:0/3835171801 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c202de310 0x558c2031a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.413+0000 7f82de5be640 1 -- 172.21.15.19:0/3835171801 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c203155d0 msgr2=0x558c2031a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:04.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.413+0000 7f82de5be640 1 --2- 172.21.15.19:0/3835171801 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c203155d0 0x558c2031a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.413+0000 7f82de5be640 1 -- 172.21.15.19:0/3835171801 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c20399e50 con 0x558c20316b40 2024-09-19T09:04:04.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.413+0000 7f82de5be640 1 --2- 172.21.15.19:0/3835171801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c20316b40 0x558c2031aba0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f82d0009750 tx=0x7f82d0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=517d8e684e2bfde5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:04.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.413+0000 7f82c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:04:04.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.413+0000 7f82c17fa640 1 -- 172.21.15.19:0/3835171801 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82d0038070 con 0x558c20316b40 2024-09-19T09:04:04.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.414+0000 7f82c17fa640 1 -- 172.21.15.19:0/3835171801 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8592+0+0 (secure 0 0 0) 0x7f82d000fc40 con 0x558c20316b40 2024-09-19T09:04:04.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.414+0000 7f82e23fa740 1 -- 172.21.15.19:0/3835171801 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f82cc09ffe0 con 0x558c20316b40 2024-09-19T09:04:04.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.414+0000 7f82c17fa640 1 -- 172.21.15.19:0/3835171801 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f82d0043050 con 0x558c20316b40 2024-09-19T09:04:04.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.414+0000 7f82e23fa740 10 client.18558 fetch_fsmap learned FSMap version 40 2024-09-19T09:04:04.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.414+0000 7f82e23fa740 1 -- 172.21.15.19:0/3835171801 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x558c2039b0c0 con 0x558c20316b40 2024-09-19T09:04:04.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.414+0000 7f82c17fa640 1 -- 172.21.15.19:0/3835171801 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f82cc09ffe0 con 0x558c20316b40 2024-09-19T09:04:04.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.414+0000 7f82c17fa640 1 -- 172.21.15.19:0/3835171801 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 40) ==== 8370+0+0 (secure 0 0 0) 0x7f82d00047a0 con 0x558c20316b40 2024-09-19T09:04:04.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.414+0000 7f82e23fa740 10 client.18558 fetch_fsmap finished waiting for FSMap version 40 2024-09-19T09:04:04.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.414+0000 7f82e23fa740 10 client.18558 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-19T09:04:04.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.414+0000 7f82e23fa740 20 client.18558 populate_metadata read hostname 'smithi019' 2024-09-19T09:04:04.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.414+0000 7f82e23fa740 1 --2- 172.21.15.19:0/3835171801 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x558c20320370 0x558c2039d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:04.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.414+0000 7f82e23fa740 4 client.18558 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:04:04.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.414+0000 7f82e23fa740 1 -- 172.21.15.19:0/3835171801 --> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558c20282d70 con 0x558c20320370 2024-09-19T09:04:04.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.414+0000 7f82dddbd640 1 --2- 172.21.15.19:0/3835171801 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x558c20320370 0x558c2039d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:04.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.415+0000 7f82dddbd640 1 --2- 172.21.15.19:0/3835171801 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x558c20320370 0x558c2039d850 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=33bead0007a5ba60 server_cookie=8bcae9aa3e3be413 in_seq=0 out_seq=0 2024-09-19T09:04:04.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.415+0000 7f82c17fa640 10 client.18558 ms_handle_connect on v2:172.21.15.155:6836/3381010945 2024-09-19T09:04:04.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.415+0000 7f82c17fa640 1 -- 172.21.15.19:0/3835171801 <== mds.3 v2:172.21.15.155:6836/3381010945 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558c20282d70 con 0x558c20320370 2024-09-19T09:04:04.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.415+0000 7f82c17fa640 10 client.18558 handle_command_reply: tid=0 2024-09-19T09:04:04.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.415+0000 7f82e23fa740 1 client.18558 shutdown 2024-09-19T09:04:04.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.415+0000 7f82e23fa740 1 -- 172.21.15.19:0/3835171801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c20316b40 msgr2=0x558c2031aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:04.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.415+0000 7f82e23fa740 1 --2- 172.21.15.19:0/3835171801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c20316b40 0x558c2031aba0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f82d0009750 tx=0x7f82d0004730 comp rx=0 tx=0).stop 2024-09-19T09:04:04.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.415+0000 7f82e23fa740 1 -- 172.21.15.19:0/3835171801 shutdown_connections 2024-09-19T09:04:04.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.415+0000 7f82e23fa740 1 --2- 172.21.15.19:0/3835171801 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x558c20320370 0x558c2039d850 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.415+0000 7f82e23fa740 1 --2- 172.21.15.19:0/3835171801 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c20316b40 0x558c2031aba0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.415+0000 7f82e23fa740 1 --2- 172.21.15.19:0/3835171801 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c203155d0 0x558c2031a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.415+0000 7f82e23fa740 1 --2- 172.21.15.19:0/3835171801 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c202de310 0x558c2031a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.415+0000 7f82c17fa640 0 client.18558 ms_handle_reset on v2:172.21.15.155:6836/3381010945 2024-09-19T09:04:04.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.415+0000 7f82e23fa740 1 -- 172.21.15.19:0/3835171801 >> 172.21.15.19:0/3835171801 conn(0x558c2031d5f0 msgr2=0x558c203104e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:04.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.415+0000 7f82e23fa740 1 -- 172.21.15.19:0/3835171801 shutdown_connections 2024-09-19T09:04:04.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.415+0000 7f82e23fa740 1 -- 172.21.15.19:0/3835171801 wait complete. 2024-09-19T09:04:04.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.415+0000 7f82e23fa740 20 client.18558 trim_cache size 0 max 16384 2024-09-19T09:04:04.421 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:04:04.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.416+0000 7f82e0021640 1 -- 172.21.15.19:0/3232081647 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f82c40a3240 msgr2=0x7f82c40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:04.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.416+0000 7f82e0021640 1 --2- 172.21.15.19:0/3232081647 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f82c40a3240 0x7f82c40a5700 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f82d0009460 tx=0x7f82d0013830 comp rx=0 tx=0).stop 2024-09-19T09:04:04.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.416+0000 7f82e0021640 1 -- 172.21.15.19:0/3232081647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82d8102570 msgr2=0x7f82d80fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:04.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.416+0000 7f82e0021640 1 --2- 172.21.15.19:0/3232081647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82d8102570 0x7f82d80fd1c0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f82cc00d950 tx=0x7f82cc00de10 comp rx=0 tx=0).stop 2024-09-19T09:04:04.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.416+0000 7f2e40eae640 1 -- 172.21.15.19:0/1730087354 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.212660"} v 0) -- 0x7f2e3c02d9e0 con 0x7f2e3c104f00 2024-09-19T09:04:04.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.416+0000 7f82e0021640 1 -- 172.21.15.19:0/3232081647 shutdown_connections 2024-09-19T09:04:04.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.416+0000 7f82e0021640 1 --2- 172.21.15.19:0/3232081647 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f82c40a3240 0x7f82c40a5700 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.416+0000 7f82e0021640 1 --2- 172.21.15.19:0/3232081647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f82d8102ef0 0x7f82d80fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.416+0000 7f82e0021640 1 --2- 172.21.15.19:0/3232081647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f82d8102570 0x7f82d80fd1c0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.416+0000 7f82e0021640 1 --2- 172.21.15.19:0/3232081647 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f82d8100e20 0x7f82d80fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:04.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.416+0000 7f82e0021640 1 -- 172.21.15.19:0/3232081647 >> 172.21.15.19:0/3232081647 conn(0x7f82d80fc7d0 msgr2=0x7f82d806a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:04.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.416+0000 7f82e0021640 1 -- 172.21.15.19:0/3232081647 shutdown_connections 2024-09-19T09:04:04.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:04.416+0000 7f82e0021640 1 -- 172.21.15.19:0/3232081647 wait complete. 2024-09-19T09:04:04.424 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:03 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3936660127' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "foo.212660", "pg_num": 8}]': finished 2024-09-19T09:04:04.424 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:03 smithi155 ceph-mon[34921]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T09:04:04.424 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:03 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3936660127' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo.212660", "pg_num": 8}]: dispatch 2024-09-19T09:04:04.424 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:03 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1681187927' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.212660"}]: dispatch 2024-09-19T09:04:04.938 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:04.937+0000 7f2e2b7fe640 1 -- 172.21.15.19:0/1730087354 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.212660"}]=0 removed data pool 4 from fsmap v41) ==== 136+0+0 (secure 0 0 0) 0x7f2e3009c0a0 con 0x7f2e3c104f00 2024-09-19T09:04:05.083 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:05.083+0000 7f2e40eae640 1 -- 172.21.15.19:0/1730087354 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.212660"} v 0) -- 0x7f2e3c062e60 con 0x7f2e3c104f00 2024-09-19T09:04:05.224 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:04 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1681187927' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.212660"}]': finished 2024-09-19T09:04:05.224 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:04 smithi019 ceph-mon[30976]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T09:04:05.224 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:04 smithi019 ceph-mon[30976]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:04:05.225 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:04 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1681187927' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.212660"}]: dispatch 2024-09-19T09:04:05.225 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:04 smithi019 ceph-mon[30976]: pgmap v697: 105 pgs: 8 unknown, 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.9 KiB/s wr, 15 op/s 2024-09-19T09:04:05.225 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:04 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1730087354' entity='client.admin' cmd=[{"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.212660"}]: dispatch 2024-09-19T09:04:05.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:04 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1681187927' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.212660"}]': finished 2024-09-19T09:04:05.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:04 smithi203 ceph-mon[35450]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T09:04:05.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:04 smithi203 ceph-mon[35450]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:04:05.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:04 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1681187927' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.212660"}]: dispatch 2024-09-19T09:04:05.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:04 smithi203 ceph-mon[35450]: pgmap v697: 105 pgs: 8 unknown, 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.9 KiB/s wr, 15 op/s 2024-09-19T09:04:05.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:04 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1730087354' entity='client.admin' cmd=[{"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.212660"}]: dispatch 2024-09-19T09:04:05.252 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:04:05.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:04 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1681187927' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.212660"}]': finished 2024-09-19T09:04:05.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:04 smithi155 ceph-mon[34921]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T09:04:05.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:04 smithi155 ceph-mon[34921]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:04:05.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:04 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1681187927' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "foo.212660"}]: dispatch 2024-09-19T09:04:05.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:04 smithi155 ceph-mon[34921]: pgmap v697: 105 pgs: 8 unknown, 97 active+clean; 3.9 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.9 KiB/s wr, 15 op/s 2024-09-19T09:04:05.424 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:04 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1730087354' entity='client.admin' cmd=[{"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.212660"}]: dispatch 2024-09-19T09:04:05.510 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:05.943 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:05.942+0000 7f2e2b7fe640 1 -- 172.21.15.19:0/1730087354 <== mon.0 v2:172.21.15.19:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.212660"}]=0 v42) ==== 106+0+0 (secure 0 0 0) 0x7f2e3009b9a0 con 0x7f2e3c104f00 2024-09-19T09:04:05.947 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:05.946+0000 7f2e40eae640 1 -- 172.21.15.19:0/1730087354 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2e240a32d0 msgr2=0x7f2e240a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:05.947 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:05.946+0000 7f2e40eae640 1 --2- 172.21.15.19:0/1730087354 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2e240a32d0 0x7f2e240a5790 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c000c00 tx=0x7f2e2c0315d0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.947 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:05.946+0000 7f2e40eae640 1 -- 172.21.15.19:0/1730087354 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e3c104f00 msgr2=0x7f2e3c198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:05.947 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:05.946+0000 7f2e40eae640 1 --2- 172.21.15.19:0/1730087354 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e3c104f00 0x7f2e3c198460 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f2e3000d770 tx=0x7f2e3000dc30 comp rx=0 tx=0).stop 2024-09-19T09:04:05.948 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:05.946+0000 7f2e40eae640 1 -- 172.21.15.19:0/1730087354 shutdown_connections 2024-09-19T09:04:05.948 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:05.946+0000 7f2e40eae640 1 --2- 172.21.15.19:0/1730087354 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f2e240a32d0 0x7f2e240a5790 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.948 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:05.946+0000 7f2e40eae640 1 --2- 172.21.15.19:0/1730087354 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2e3c107830 0x7f2e3c19f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.948 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:05.946+0000 7f2e40eae640 1 --2- 172.21.15.19:0/1730087354 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2e3c104f00 0x7f2e3c198460 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.948 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:05.946+0000 7f2e40eae640 1 --2- 172.21.15.19:0/1730087354 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e3c1025d0 0x7f2e3c197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.948 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:05.946+0000 7f2e40eae640 1 -- 172.21.15.19:0/1730087354 >> 172.21.15.19:0/1730087354 conn(0x7f2e3c0fc1b0 msgr2=0x7f2e3c103070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:05.948 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:05.946+0000 7f2e40eae640 1 -- 172.21.15.19:0/1730087354 shutdown_connections 2024-09-19T09:04:05.948 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:05.947+0000 7f2e40eae640 1 -- 172.21.15.19:0/1730087354 wait complete. 2024-09-19T09:04:05.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.979+0000 7fce9a775640 1 -- 172.21.15.19:0/2674618458 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce94102ef0 msgr2=0x7fce9410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:05.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.979+0000 7fce9a775640 1 --2- 172.21.15.19:0/2674618458 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce94102ef0 0x7fce9410da40 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fce8c009ca0 tx=0x7fce8c02a950 comp rx=0 tx=0).stop 2024-09-19T09:04:05.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.979+0000 7fce9a775640 1 -- 172.21.15.19:0/2674618458 shutdown_connections 2024-09-19T09:04:05.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.979+0000 7fce9a775640 1 --2- 172.21.15.19:0/2674618458 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce94102ef0 0x7fce9410da40 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.979+0000 7fce9a775640 1 --2- 172.21.15.19:0/2674618458 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce94102570 0x7fce941029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.979+0000 7fce9a775640 1 --2- 172.21.15.19:0/2674618458 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fce94100e20 0x7fce94101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.979+0000 7fce9a775640 1 -- 172.21.15.19:0/2674618458 >> 172.21.15.19:0/2674618458 conn(0x7fce940fc7d0 msgr2=0x7fce940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:05.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.979+0000 7fce9a775640 1 -- 172.21.15.19:0/2674618458 shutdown_connections 2024-09-19T09:04:05.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.979+0000 7fce9a775640 1 -- 172.21.15.19:0/2674618458 wait complete. 2024-09-19T09:04:05.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.980+0000 7fce9a775640 1 Processor -- start 2024-09-19T09:04:05.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.980+0000 7fce9a775640 1 -- start start 2024-09-19T09:04:05.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.980+0000 7fce9a775640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce94100e20 0x7fce94199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:05.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.980+0000 7fce9a775640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce94102570 0x7fce94199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:05.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.980+0000 7fce9a775640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fce94102ef0 0x7fce941a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:05.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.980+0000 7fce9a775640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fce94110fa0 con 0x7fce94102570 2024-09-19T09:04:05.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.980+0000 7fce9a775640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fce94110e20 con 0x7fce94100e20 2024-09-19T09:04:05.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.980+0000 7fce9a775640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fce94111120 con 0x7fce94102ef0 2024-09-19T09:04:05.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.980+0000 7fce937fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce94102570 0x7fce94199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:05.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.981+0000 7fce937fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce94102570 0x7fce94199890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45350/0 (socket says 172.21.15.19:45350) 2024-09-19T09:04:05.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.981+0000 7fce937fe640 1 -- 172.21.15.19:0/418034118 learned_addr learned my addr 172.21.15.19:0/418034118 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:05.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.981+0000 7fce93fff640 1 --2- 172.21.15.19:0/418034118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce94100e20 0x7fce94199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:05.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.981+0000 7fce98d12640 1 --2- 172.21.15.19:0/418034118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fce94102ef0 0x7fce941a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:05.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.981+0000 7fce937fe640 1 -- 172.21.15.19:0/418034118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fce94102ef0 msgr2=0x7fce941a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:05.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.981+0000 7fce937fe640 1 --2- 172.21.15.19:0/418034118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fce94102ef0 0x7fce941a43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.981+0000 7fce937fe640 1 -- 172.21.15.19:0/418034118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce94100e20 msgr2=0x7fce94199350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:05.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.981+0000 7fce937fe640 1 --2- 172.21.15.19:0/418034118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce94100e20 0x7fce94199350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.981+0000 7fce937fe640 1 -- 172.21.15.19:0/418034118 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce941a4910 con 0x7fce94102570 2024-09-19T09:04:05.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.981+0000 7fce937fe640 1 --2- 172.21.15.19:0/418034118 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce94102570 0x7fce94199890 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fce8800c890 tx=0x7fce8800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:05.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.981+0000 7fce917fa640 1 -- 172.21.15.19:0/418034118 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce88004220 con 0x7fce94102570 2024-09-19T09:04:05.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.981+0000 7fce9a775640 1 -- 172.21.15.19:0/418034118 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce941a4ae0 con 0x7fce94102570 2024-09-19T09:04:05.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.981+0000 7fce917fa640 1 -- 172.21.15.19:0/418034118 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce880043c0 con 0x7fce94102570 2024-09-19T09:04:05.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.981+0000 7fce917fa640 1 -- 172.21.15.19:0/418034118 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce88004a00 con 0x7fce94102570 2024-09-19T09:04:05.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.981+0000 7fce9a775640 1 -- 172.21.15.19:0/418034118 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce941a4ff0 con 0x7fce94102570 2024-09-19T09:04:05.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.983+0000 7fce917fa640 1 -- 172.21.15.19:0/418034118 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fce880079b0 con 0x7fce94102570 2024-09-19T09:04:05.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.984+0000 7fce9cb4e740 1 Processor -- start 2024-09-19T09:04:05.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.984+0000 7fce9cb4e740 1 -- start start 2024-09-19T09:04:05.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.984+0000 7fce917fa640 1 --2- 172.21.15.19:0/418034118 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fce7c0a3240 0x7fce7c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:05.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.984+0000 7fce9cb4e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3c16f7f50 0x55e3c16f64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:05.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.984+0000 7fce9cb4e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e3c16f69e0 0x55e3c16f6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:05.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.984+0000 7fce9cb4e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3c1701780 0x55e3c1703b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:05.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.984+0000 7fce9cb4e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e3c16582f0 con 0x55e3c1701780 2024-09-19T09:04:05.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.984+0000 7fce9cb4e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55e3c15ffcf0 con 0x55e3c16f7f50 2024-09-19T09:04:05.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.984+0000 7fce9cb4e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e3c16542b0 con 0x55e3c16f69e0 2024-09-19T09:04:05.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.984+0000 7fce98d12640 1 --2- 172.21.15.19:0/418034118 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fce7c0a3240 0x7fce7c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:05.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.985+0000 7fce98d12640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3c1701780 0x55e3c1703b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:05.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.985+0000 7fce98d12640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3c1701780 0x55e3c1703b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45356/0 (socket says 172.21.15.19:45356) 2024-09-19T09:04:05.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.985+0000 7fce93fff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3c16f7f50 0x55e3c16f64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:05.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.985+0000 7fce98d12640 1 -- 172.21.15.19:0/687077821 learned_addr learned my addr 172.21.15.19:0/687077821 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:05.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.985+0000 7fce937fe640 1 --2- 172.21.15.19:0/687077821 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e3c16f69e0 0x55e3c16f6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:05.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.985+0000 7fce917fa640 1 -- 172.21.15.19:0/418034118 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8592+0+0 (secure 0 0 0) 0x7fce880cf740 con 0x7fce94102570 2024-09-19T09:04:05.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.985+0000 7fce93fff640 1 -- 172.21.15.19:0/687077821 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e3c16f69e0 msgr2=0x55e3c16f6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:05.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.985+0000 7fce93fff640 1 --2- 172.21.15.19:0/687077821 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e3c16f69e0 0x55e3c16f6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.985+0000 7fce93fff640 1 -- 172.21.15.19:0/687077821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3c1701780 msgr2=0x55e3c1703b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:05.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.985+0000 7fce93fff640 1 --2- 172.21.15.19:0/687077821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3c1701780 0x55e3c1703b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:05.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.985+0000 7fce93fff640 1 -- 172.21.15.19:0/687077821 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3c15e43a0 con 0x55e3c16f7f50 2024-09-19T09:04:05.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.985+0000 7fce98d12640 1 --2- 172.21.15.19:0/687077821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3c1701780 0x55e3c1703b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:05.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.985+0000 7fce93fff640 1 --2- 172.21.15.19:0/687077821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3c16f7f50 0x55e3c16f64a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fce840099a0 tx=0x7fce84009e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd3c6af5be35ee79 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:05.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.985+0000 7fce98d12640 1 --2- 172.21.15.19:0/418034118 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fce7c0a3240 0x7fce7c0a5700 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x55e3c16f7480 tx=0x7fce8c005ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:05.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.985+0000 7fce7a7fc640 1 -- 172.21.15.19:0/687077821 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce84017070 con 0x55e3c16f7f50 2024-09-19T09:04:05.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.986+0000 7fce7a7fc640 1 -- 172.21.15.19:0/687077821 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce84013470 con 0x55e3c16f7f50 2024-09-19T09:04:05.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.986+0000 7fce7a7fc640 1 -- 172.21.15.19:0/687077821 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce84012610 con 0x55e3c16f7f50 2024-09-19T09:04:05.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.986+0000 7fce9cb4e740 1 -- 172.21.15.19:0/687077821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3c16f7f50 msgr2=0x55e3c16f64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:06.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.986+0000 7fce9cb4e740 1 --2- 172.21.15.19:0/687077821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3c16f7f50 0x55e3c16f64a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fce840099a0 tx=0x7fce84009e60 comp rx=0 tx=0).stop 2024-09-19T09:04:06.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.986+0000 7fce9cb4e740 1 -- 172.21.15.19:0/687077821 shutdown_connections 2024-09-19T09:04:06.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.986+0000 7fce9cb4e740 1 --2- 172.21.15.19:0/687077821 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e3c16f69e0 0x55e3c16f6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.986+0000 7fce9cb4e740 1 --2- 172.21.15.19:0/687077821 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3c1701780 0x55e3c1703b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.986+0000 7fce9cb4e740 1 --2- 172.21.15.19:0/687077821 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3c16f7f50 0x55e3c16f64a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.986+0000 7fce9cb4e740 1 -- 172.21.15.19:0/687077821 >> 172.21.15.19:0/687077821 conn(0x55e3c16bb310 msgr2=0x55e3c16f3070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:06.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.986+0000 7fce9cb4e740 1 -- 172.21.15.19:0/687077821 shutdown_connections 2024-09-19T09:04:06.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.986+0000 7fce9cb4e740 1 -- 172.21.15.19:0/687077821 wait complete. 2024-09-19T09:04:06.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.987+0000 7fce9cb4e740 1 -- start start 2024-09-19T09:04:06.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.987+0000 7fce9cb4e740 1 Processor -- start 2024-09-19T09:04:06.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.987+0000 7fce9cb4e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3c16f69e0 0x55e3c1701070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:06.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.987+0000 7fce9cb4e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3c16f7f50 0x55e3c16fe320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:06.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.987+0000 7fce9cb4e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e3c1701780 0x55e3c16fe860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:06.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.987+0000 7fce9cb4e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e3c1704480 con 0x55e3c16f69e0 2024-09-19T09:04:06.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.987+0000 7fce9cb4e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55e3c1613060 con 0x55e3c16f7f50 2024-09-19T09:04:06.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.987+0000 7fce9cb4e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e3c1704600 con 0x55e3c1701780 2024-09-19T09:04:06.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.987+0000 7fce9cb4e740 10 client.0 _ll_register_callbacks cb 0x55e3c13668c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:06.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.988+0000 7fce93fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3c16f69e0 0x55e3c1701070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:06.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.988+0000 7fce93fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3c16f69e0 0x55e3c1701070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45366/0 (socket says 172.21.15.19:45366) 2024-09-19T09:04:06.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.988+0000 7fce93fff640 1 -- 172.21.15.19:0/1714885361 learned_addr learned my addr 172.21.15.19:0/1714885361 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:06.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.988+0000 7fce937fe640 1 --2- 172.21.15.19:0/1714885361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3c16f7f50 0x55e3c16fe320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:06.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.988+0000 7fce98d12640 1 --2- 172.21.15.19:0/1714885361 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e3c1701780 0x55e3c16fe860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:06.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.988+0000 7fce93fff640 1 -- 172.21.15.19:0/1714885361 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e3c1701780 msgr2=0x55e3c16fe860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:06.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.988+0000 7fce93fff640 1 --2- 172.21.15.19:0/1714885361 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e3c1701780 0x55e3c16fe860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.988+0000 7fce93fff640 1 -- 172.21.15.19:0/1714885361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3c16f7f50 msgr2=0x55e3c16fe320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:06.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.988+0000 7fce93fff640 1 --2- 172.21.15.19:0/1714885361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3c16f7f50 0x55e3c16fe320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.988+0000 7fce93fff640 1 -- 172.21.15.19:0/1714885361 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3c13c93c0 con 0x55e3c16f69e0 2024-09-19T09:04:06.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.988+0000 7fce98d12640 1 --2- 172.21.15.19:0/1714885361 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e3c1701780 0x55e3c16fe860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:06.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.988+0000 7fce93fff640 1 --2- 172.21.15.19:0/1714885361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3c16f69e0 0x55e3c1701070 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fce84000c00 tx=0x7fce84013ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f1c19b6df4a82a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:06.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.988+0000 7fce737fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:04:06.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.988+0000 7fce737fe640 1 -- 172.21.15.19:0/1714885361 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce84017050 con 0x55e3c16f69e0 2024-09-19T09:04:06.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.988+0000 7fce9cb4e740 1 -- 172.21.15.19:0/1714885361 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce84013470 con 0x55e3c16f69e0 2024-09-19T09:04:06.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.988+0000 7fce737fe640 1 -- 172.21.15.19:0/1714885361 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8592+0+0 (secure 0 0 0) 0x7fce8401c450 con 0x55e3c16f69e0 2024-09-19T09:04:06.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.988+0000 7fce737fe640 1 -- 172.21.15.19:0/1714885361 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fce8401c650 con 0x55e3c16f69e0 2024-09-19T09:04:06.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.989+0000 7fce9cb4e740 10 client.18570 fetch_fsmap learned FSMap version 42 2024-09-19T09:04:06.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.989+0000 7fce9cb4e740 1 -- 172.21.15.19:0/1714885361 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55e3c170fe30 con 0x55e3c16f69e0 2024-09-19T09:04:06.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.989+0000 7fce737fe640 1 -- 172.21.15.19:0/1714885361 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce84013470 con 0x55e3c16f69e0 2024-09-19T09:04:06.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.989+0000 7fce737fe640 1 -- 172.21.15.19:0/1714885361 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 42) ==== 8362+0+0 (secure 0 0 0) 0x7fce84026860 con 0x55e3c16f69e0 2024-09-19T09:04:06.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.989+0000 7fce9cb4e740 10 client.18570 fetch_fsmap finished waiting for FSMap version 42 2024-09-19T09:04:06.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.989+0000 7fce9cb4e740 10 client.18570 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T09:04:06.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.989+0000 7fce9cb4e740 20 client.18570 populate_metadata read hostname 'smithi019' 2024-09-19T09:04:06.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.989+0000 7fce9cb4e740 1 --2- 172.21.15.19:0/1714885361 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55e3c17111e0 0x55e3c17135d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:06.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.989+0000 7fce9cb4e740 4 client.18570 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:06.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.989+0000 7fce9cb4e740 1 -- 172.21.15.19:0/1714885361 --> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e3c1665860 con 0x55e3c17111e0 2024-09-19T09:04:06.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.989+0000 7fce937fe640 1 --2- 172.21.15.19:0/1714885361 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55e3c17111e0 0x55e3c17135d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:06.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.990+0000 7fce937fe640 1 --2- 172.21.15.19:0/1714885361 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55e3c17111e0 0x55e3c17135d0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c6f877f3a937a378 server_cookie=d382c5658ed36949 in_seq=0 out_seq=0 2024-09-19T09:04:06.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.990+0000 7fce737fe640 10 client.18570 ms_handle_connect on v2:172.21.15.203:6836/3684671619 2024-09-19T09:04:06.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.991+0000 7fce737fe640 1 -- 172.21.15.19:0/1714885361 <== mds.2 v2:172.21.15.203:6836/3684671619 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e3c1665860 con 0x55e3c17111e0 2024-09-19T09:04:06.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.991+0000 7fce737fe640 10 client.18570 handle_command_reply: tid=0 2024-09-19T09:04:06.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.991+0000 7fce9cb4e740 1 client.18570 shutdown 2024-09-19T09:04:06.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.991+0000 7fce9cb4e740 1 -- 172.21.15.19:0/1714885361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3c16f69e0 msgr2=0x55e3c1701070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:06.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.991+0000 7fce9cb4e740 1 --2- 172.21.15.19:0/1714885361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3c16f69e0 0x55e3c1701070 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fce84000c00 tx=0x7fce84013ad0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.991+0000 7fce9cb4e740 1 -- 172.21.15.19:0/1714885361 shutdown_connections 2024-09-19T09:04:06.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.991+0000 7fce9cb4e740 1 --2- 172.21.15.19:0/1714885361 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55e3c17111e0 0x55e3c17135d0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.991+0000 7fce737fe640 0 client.18570 ms_handle_reset on v2:172.21.15.203:6836/3684671619 2024-09-19T09:04:06.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.991+0000 7fce9cb4e740 1 --2- 172.21.15.19:0/1714885361 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e3c1701780 0x55e3c16fe860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.991+0000 7fce9cb4e740 1 --2- 172.21.15.19:0/1714885361 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3c16f7f50 0x55e3c16fe320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.991+0000 7fce9cb4e740 1 --2- 172.21.15.19:0/1714885361 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3c16f69e0 0x55e3c1701070 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.991+0000 7fce9cb4e740 1 -- 172.21.15.19:0/1714885361 >> 172.21.15.19:0/1714885361 conn(0x55e3c16bb310 msgr2=0x55e3c16f8d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:06.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.991+0000 7fce9cb4e740 1 -- 172.21.15.19:0/1714885361 shutdown_connections 2024-09-19T09:04:06.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.991+0000 7fce9cb4e740 1 -- 172.21.15.19:0/1714885361 wait complete. 2024-09-19T09:04:06.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:05.991+0000 7fce9cb4e740 20 client.18570 trim_cache size 0 max 16384 2024-09-19T09:04:06.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.004+0000 7fce9cb4e740 1 Processor -- start 2024-09-19T09:04:06.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.004+0000 7fce9cb4e740 1 -- start start 2024-09-19T09:04:06.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.004+0000 7fce9cb4e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e3c16f69e0 0x55e3c170d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:06.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.004+0000 7fce9cb4e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3c16f7f50 0x55e3c16f9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:06.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.004+0000 7fce9cb4e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3c1701780 0x55e3c16f9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:06.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.004+0000 7fce9cb4e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fce941abb00 con 0x55e3c16f7f50 2024-09-19T09:04:06.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.004+0000 7fce9cb4e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fce941ad640 con 0x55e3c1701780 2024-09-19T09:04:06.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.004+0000 7fce9cb4e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fce941ac1d0 con 0x55e3c16f69e0 2024-09-19T09:04:06.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.005+0000 7fce937fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3c16f7f50 0x55e3c16f9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:06.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.005+0000 7fce937fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3c16f7f50 0x55e3c16f9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45370/0 (socket says 172.21.15.19:45370) 2024-09-19T09:04:06.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.005+0000 7fce937fe640 1 -- 172.21.15.19:0/2280492561 learned_addr learned my addr 172.21.15.19:0/2280492561 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:06.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.005+0000 7fce93fff640 1 --2- 172.21.15.19:0/2280492561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e3c16f69e0 0x55e3c170d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:06.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.005+0000 7fce98d12640 1 --2- 172.21.15.19:0/2280492561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3c1701780 0x55e3c16f9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:06.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.005+0000 7fce937fe640 1 -- 172.21.15.19:0/2280492561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e3c16f69e0 msgr2=0x55e3c170d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:06.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.005+0000 7fce937fe640 1 --2- 172.21.15.19:0/2280492561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e3c16f69e0 0x55e3c170d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.005+0000 7fce937fe640 1 -- 172.21.15.19:0/2280492561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3c1701780 msgr2=0x55e3c16f9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:06.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.005+0000 7fce937fe640 1 --2- 172.21.15.19:0/2280492561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3c1701780 0x55e3c16f9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.005+0000 7fce937fe640 1 -- 172.21.15.19:0/2280492561 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3c16f3d70 con 0x55e3c16f7f50 2024-09-19T09:04:06.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.005+0000 7fce937fe640 1 --2- 172.21.15.19:0/2280492561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3c16f7f50 0x55e3c16f9530 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fce880cd0e0 tx=0x7fce880ccfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ab591d0a224fa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:06.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.005+0000 7fce79ffb640 1 -- 172.21.15.19:0/2280492561 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8801d040 con 0x55e3c16f7f50 2024-09-19T09:04:06.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.005+0000 7fce79ffb640 1 -- 172.21.15.19:0/2280492561 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce8809bc00 con 0x55e3c16f7f50 2024-09-19T09:04:06.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.005+0000 7fce79ffb640 1 -- 172.21.15.19:0/2280492561 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce88007ca0 con 0x55e3c16f7f50 2024-09-19T09:04:06.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.006+0000 7fce9cb4e740 1 -- 172.21.15.19:0/2280492561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3c16f7f50 msgr2=0x55e3c16f9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:06.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.006+0000 7fce9cb4e740 1 --2- 172.21.15.19:0/2280492561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3c16f7f50 0x55e3c16f9530 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fce880cd0e0 tx=0x7fce880ccfb0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.006+0000 7fce9cb4e740 1 -- 172.21.15.19:0/2280492561 shutdown_connections 2024-09-19T09:04:06.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.006+0000 7fce9cb4e740 1 --2- 172.21.15.19:0/2280492561 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3c1701780 0x55e3c16f9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.006+0000 7fce9cb4e740 1 --2- 172.21.15.19:0/2280492561 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3c16f7f50 0x55e3c16f9530 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.006+0000 7fce9cb4e740 1 --2- 172.21.15.19:0/2280492561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e3c16f69e0 0x55e3c170d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.006+0000 7fce9cb4e740 1 -- 172.21.15.19:0/2280492561 >> 172.21.15.19:0/2280492561 conn(0x55e3c16bb310 msgr2=0x55e3c16fd2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:06.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.006+0000 7fce9cb4e740 1 -- 172.21.15.19:0/2280492561 shutdown_connections 2024-09-19T09:04:06.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.006+0000 7fce9cb4e740 1 -- 172.21.15.19:0/2280492561 wait complete. 2024-09-19T09:04:06.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.007+0000 7fce9cb4e740 1 -- start start 2024-09-19T09:04:06.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.007+0000 7fce9cb4e740 1 Processor -- start 2024-09-19T09:04:06.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.007+0000 7fce9cb4e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e3c16f69e0 0x55e3c170a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:06.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.007+0000 7fce9cb4e740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3c16f7f50 0x55e3c17053e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:06.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.007+0000 7fce9cb4e740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3c1701780 0x55e3c1705980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:06.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.007+0000 7fce9cb4e740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fce941acf70 con 0x55e3c16f7f50 2024-09-19T09:04:06.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.007+0000 7fce9cb4e740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fce941ac8a0 con 0x55e3c1701780 2024-09-19T09:04:06.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.007+0000 7fce9cb4e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fce941a9ae0 con 0x55e3c16f69e0 2024-09-19T09:04:06.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.007+0000 7fce9cb4e740 10 client.0 _ll_register_callbacks cb 0x7fce8c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:06.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.007+0000 7fce937fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3c16f7f50 0x55e3c17053e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:06.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.007+0000 7fce937fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3c16f7f50 0x55e3c17053e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45374/0 (socket says 172.21.15.19:45374) 2024-09-19T09:04:06.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.007+0000 7fce937fe640 1 -- 172.21.15.19:0/2112483180 learned_addr learned my addr 172.21.15.19:0/2112483180 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:06.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.007+0000 7fce93fff640 1 --2- 172.21.15.19:0/2112483180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e3c16f69e0 0x55e3c170a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:06.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.008+0000 7fce98d12640 1 --2- 172.21.15.19:0/2112483180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3c1701780 0x55e3c1705980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:06.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.008+0000 7fce937fe640 1 -- 172.21.15.19:0/2112483180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e3c16f69e0 msgr2=0x55e3c170a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:06.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.008+0000 7fce937fe640 1 --2- 172.21.15.19:0/2112483180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e3c16f69e0 0x55e3c170a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.008+0000 7fce937fe640 1 -- 172.21.15.19:0/2112483180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3c1701780 msgr2=0x55e3c1705980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:06.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.008+0000 7fce937fe640 1 --2- 172.21.15.19:0/2112483180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3c1701780 0x55e3c1705980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.008+0000 7fce937fe640 1 -- 172.21.15.19:0/2112483180 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3c17061b0 con 0x55e3c16f7f50 2024-09-19T09:04:06.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.008+0000 7fce98d12640 1 --2- 172.21.15.19:0/2112483180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3c1701780 0x55e3c1705980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:06.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.008+0000 7fce937fe640 1 --2- 172.21.15.19:0/2112483180 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3c16f7f50 0x55e3c17053e0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fce88005fd0 tx=0x7fce88007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb27a0a960ebc7f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:06.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.008+0000 7fce737fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:04:06.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.008+0000 7fce737fe640 1 -- 172.21.15.19:0/2112483180 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce8801d040 con 0x55e3c16f7f50 2024-09-19T09:04:06.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.008+0000 7fce737fe640 1 -- 172.21.15.19:0/2112483180 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8592+0+0 (secure 0 0 0) 0x7fce880cd1f0 con 0x55e3c16f7f50 2024-09-19T09:04:06.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.008+0000 7fce9cb4e740 1 -- 172.21.15.19:0/2112483180 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fce8809bc00 con 0x55e3c16f7f50 2024-09-19T09:04:06.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.008+0000 7fce737fe640 1 -- 172.21.15.19:0/2112483180 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7fce880a4870 con 0x55e3c16f7f50 2024-09-19T09:04:06.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.008+0000 7fce9cb4e740 10 client.18576 fetch_fsmap learned FSMap version 42 2024-09-19T09:04:06.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.008+0000 7fce9cb4e740 1 -- 172.21.15.19:0/2112483180 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x55e3c177bca0 con 0x55e3c16f7f50 2024-09-19T09:04:06.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.008+0000 7fce737fe640 1 -- 172.21.15.19:0/2112483180 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fce8809bc00 con 0x55e3c16f7f50 2024-09-19T09:04:06.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.009+0000 7fce737fe640 1 -- 172.21.15.19:0/2112483180 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 42) ==== 8362+0+0 (secure 0 0 0) 0x7fce8800d940 con 0x55e3c16f7f50 2024-09-19T09:04:06.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.009+0000 7fce9cb4e740 10 client.18576 fetch_fsmap finished waiting for FSMap version 42 2024-09-19T09:04:06.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.009+0000 7fce9cb4e740 10 client.18576 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T09:04:06.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.009+0000 7fce9cb4e740 20 client.18576 populate_metadata read hostname 'smithi019' 2024-09-19T09:04:06.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.009+0000 7fce9cb4e740 1 --2- 172.21.15.19:0/2112483180 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55e3c17111e0 0x55e3c177e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:06.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.009+0000 7fce9cb4e740 4 client.18576 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:04:06.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.009+0000 7fce9cb4e740 1 -- 172.21.15.19:0/2112483180 --> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e3c165fd70 con 0x55e3c17111e0 2024-09-19T09:04:06.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.009+0000 7fce93fff640 1 --2- 172.21.15.19:0/2112483180 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55e3c17111e0 0x55e3c177e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:06.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.009+0000 7fce93fff640 1 --2- 172.21.15.19:0/2112483180 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55e3c17111e0 0x55e3c177e3b0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=df129593fded6e16 server_cookie=156ffbeb8048ac37 in_seq=0 out_seq=0 2024-09-19T09:04:06.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.009+0000 7fce737fe640 10 client.18576 ms_handle_connect on v2:172.21.15.203:6836/3684671619 2024-09-19T09:04:06.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.009+0000 7fce737fe640 1 -- 172.21.15.19:0/2112483180 <== mds.2 v2:172.21.15.203:6836/3684671619 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e3c165fd70 con 0x55e3c17111e0 2024-09-19T09:04:06.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.009+0000 7fce737fe640 10 client.18576 handle_command_reply: tid=0 2024-09-19T09:04:06.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.009+0000 7fce9cb4e740 1 client.18576 shutdown 2024-09-19T09:04:06.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.010+0000 7fce9cb4e740 1 -- 172.21.15.19:0/2112483180 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3c16f7f50 msgr2=0x55e3c17053e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:06.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.010+0000 7fce9cb4e740 1 --2- 172.21.15.19:0/2112483180 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3c16f7f50 0x55e3c17053e0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fce88005fd0 tx=0x7fce88007f90 comp rx=0 tx=0).stop 2024-09-19T09:04:06.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.010+0000 7fce9cb4e740 1 -- 172.21.15.19:0/2112483180 shutdown_connections 2024-09-19T09:04:06.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.010+0000 7fce9cb4e740 1 --2- 172.21.15.19:0/2112483180 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x55e3c17111e0 0x55e3c177e3b0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.010+0000 7fce9cb4e740 1 --2- 172.21.15.19:0/2112483180 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e3c1701780 0x55e3c1705980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.010+0000 7fce9cb4e740 1 --2- 172.21.15.19:0/2112483180 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e3c16f7f50 0x55e3c17053e0 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.010+0000 7fce9cb4e740 1 --2- 172.21.15.19:0/2112483180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e3c16f69e0 0x55e3c170a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.010+0000 7fce9cb4e740 1 -- 172.21.15.19:0/2112483180 >> 172.21.15.19:0/2112483180 conn(0x55e3c16bb310 msgr2=0x55e3c16ed4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:06.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.010+0000 7fce737fe640 0 client.18576 ms_handle_reset on v2:172.21.15.203:6836/3684671619 2024-09-19T09:04:06.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.010+0000 7fce9cb4e740 1 -- 172.21.15.19:0/2112483180 shutdown_connections 2024-09-19T09:04:06.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.010+0000 7fce9cb4e740 1 -- 172.21.15.19:0/2112483180 wait complete. 2024-09-19T09:04:06.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.010+0000 7fce9cb4e740 20 client.18576 trim_cache size 0 max 16384 2024-09-19T09:04:06.016 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:04:06.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.011+0000 7fce9a775640 1 -- 172.21.15.19:0/418034118 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fce7c0a3240 msgr2=0x7fce7c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:06.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.011+0000 7fce9a775640 1 --2- 172.21.15.19:0/418034118 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fce7c0a3240 0x7fce7c0a5700 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x55e3c16f7480 tx=0x7fce8c005ef0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.011+0000 7fce9a775640 1 -- 172.21.15.19:0/418034118 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce94102570 msgr2=0x7fce94199890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:06.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.011+0000 7fce9a775640 1 --2- 172.21.15.19:0/418034118 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce94102570 0x7fce94199890 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fce8800c890 tx=0x7fce8800cc90 comp rx=0 tx=0).stop 2024-09-19T09:04:06.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.011+0000 7fce9a775640 1 -- 172.21.15.19:0/418034118 shutdown_connections 2024-09-19T09:04:06.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.011+0000 7fce9a775640 1 --2- 172.21.15.19:0/418034118 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fce7c0a3240 0x7fce7c0a5700 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.011+0000 7fce9a775640 1 --2- 172.21.15.19:0/418034118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fce94102ef0 0x7fce941a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.011+0000 7fce9a775640 1 --2- 172.21.15.19:0/418034118 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fce94102570 0x7fce94199890 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.011+0000 7fce9a775640 1 --2- 172.21.15.19:0/418034118 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fce94100e20 0x7fce94199350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.011+0000 7fce9a775640 1 -- 172.21.15.19:0/418034118 >> 172.21.15.19:0/418034118 conn(0x7fce940fc7d0 msgr2=0x7fce94106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:06.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.011+0000 7fce9a775640 1 -- 172.21.15.19:0/418034118 shutdown_connections 2024-09-19T09:04:06.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:06.011+0000 7fce9a775640 1 -- 172.21.15.19:0/418034118 wait complete. 2024-09-19T09:04:06.056 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.053+0000 7f750088d640 1 -- 172.21.15.19:0/668408837 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74fc107820 msgr2=0x7f74fc109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:06.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.053+0000 7f750088d640 1 --2- 172.21.15.19:0/668408837 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74fc107820 0x7f74fc109c90 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f74f4009900 tx=0x7f74f402a410 comp rx=0 tx=0).stop 2024-09-19T09:04:06.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.053+0000 7f750088d640 1 -- 172.21.15.19:0/668408837 shutdown_connections 2024-09-19T09:04:06.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.054+0000 7f750088d640 1 --2- 172.21.15.19:0/668408837 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74fc107820 0x7f74fc109c90 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.054+0000 7f750088d640 1 --2- 172.21.15.19:0/668408837 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74fc104ef0 0x7f74fc1072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.054+0000 7f750088d640 1 --2- 172.21.15.19:0/668408837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74fc1025c0 0x7f74fc1049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.054+0000 7f750088d640 1 -- 172.21.15.19:0/668408837 >> 172.21.15.19:0/668408837 conn(0x7f74fc0fc1e0 msgr2=0x7f74fc0fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:06.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.054+0000 7f750088d640 1 -- 172.21.15.19:0/668408837 shutdown_connections 2024-09-19T09:04:06.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.054+0000 7f750088d640 1 -- 172.21.15.19:0/668408837 wait complete. 2024-09-19T09:04:06.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.054+0000 7f750088d640 1 Processor -- start 2024-09-19T09:04:06.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.054+0000 7f750088d640 1 -- start start 2024-09-19T09:04:06.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.054+0000 7f750088d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74fc1025c0 0x7f74fc197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:06.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.054+0000 7f750088d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74fc104ef0 0x7f74fc1983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:06.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.054+0000 7f750088d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74fc107820 0x7f74fc19f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:06.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.054+0000 7f750088d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f74fc10d850 con 0x7f74fc1025c0 2024-09-19T09:04:06.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.054+0000 7f750088d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f74fc10d6d0 con 0x7f74fc104ef0 2024-09-19T09:04:06.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.054+0000 7f750088d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f74fc10d9d0 con 0x7f74fc107820 2024-09-19T09:04:06.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.055+0000 7f74fa59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74fc1025c0 0x7f74fc197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:06.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.055+0000 7f74fa59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74fc1025c0 0x7f74fc197e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45398/0 (socket says 172.21.15.19:45398) 2024-09-19T09:04:06.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.055+0000 7f74fa59c640 1 -- 172.21.15.19:0/3997252709 learned_addr learned my addr 172.21.15.19:0/3997252709 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:06.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.055+0000 7f74fad9d640 1 --2- 172.21.15.19:0/3997252709 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74fc107820 0x7f74fc19f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:06.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.055+0000 7f74f9d9b640 1 --2- 172.21.15.19:0/3997252709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74fc104ef0 0x7f74fc1983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:06.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.055+0000 7f74fa59c640 1 -- 172.21.15.19:0/3997252709 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74fc107820 msgr2=0x7f74fc19f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:06.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.055+0000 7f74fa59c640 1 --2- 172.21.15.19:0/3997252709 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74fc107820 0x7f74fc19f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.055+0000 7f74fa59c640 1 -- 172.21.15.19:0/3997252709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74fc104ef0 msgr2=0x7f74fc1983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:06.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.055+0000 7f74fa59c640 1 --2- 172.21.15.19:0/3997252709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74fc104ef0 0x7f74fc1983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:06.059 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.055+0000 7f74fa59c640 1 -- 172.21.15.19:0/3997252709 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74fc19faa0 con 0x7f74fc1025c0 2024-09-19T09:04:06.059 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.055+0000 7f74fa59c640 1 --2- 172.21.15.19:0/3997252709 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74fc1025c0 0x7f74fc197e80 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f74ec00c970 tx=0x7f74ec00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:06.059 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.055+0000 7f74eb7fe640 1 -- 172.21.15.19:0/3997252709 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ec007bb0 con 0x7f74fc1025c0 2024-09-19T09:04:06.059 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.055+0000 7f750088d640 1 -- 172.21.15.19:0/3997252709 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74fc19fd90 con 0x7f74fc1025c0 2024-09-19T09:04:06.059 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.055+0000 7f74eb7fe640 1 -- 172.21.15.19:0/3997252709 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f74ec007d50 con 0x7f74fc1025c0 2024-09-19T09:04:06.059 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.055+0000 7f74eb7fe640 1 -- 172.21.15.19:0/3997252709 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74ec00f450 con 0x7f74fc1025c0 2024-09-19T09:04:06.059 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.055+0000 7f750088d640 1 -- 172.21.15.19:0/3997252709 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74fc1a0220 con 0x7f74fc1025c0 2024-09-19T09:04:06.060 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.056+0000 7f750088d640 1 -- 172.21.15.19:0/3997252709 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74fc0fdcd0 con 0x7f74fc1025c0 2024-09-19T09:04:06.060 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.057+0000 7f74eb7fe640 1 -- 172.21.15.19:0/3997252709 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f74ec005020 con 0x7f74fc1025c0 2024-09-19T09:04:06.060 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.058+0000 7f74eb7fe640 1 --2- 172.21.15.19:0/3997252709 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f74e40a3250 0x7f74e40a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:06.060 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.058+0000 7f74f9d9b640 1 --2- 172.21.15.19:0/3997252709 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f74e40a3250 0x7f74e40a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:06.060 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.058+0000 7f74eb7fe640 1 -- 172.21.15.19:0/3997252709 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8592+0+0 (secure 0 0 0) 0x7f74ec0cf910 con 0x7f74fc1025c0 2024-09-19T09:04:06.060 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.059+0000 7f74f9d9b640 1 --2- 172.21.15.19:0/3997252709 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f74e40a3250 0x7f74e40a5710 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f74fc199390 tx=0x7f74f000a780 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:06.063 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.062+0000 7f74eb7fe640 1 -- 172.21.15.19:0/3997252709 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f74ec014030 con 0x7f74fc1025c0 2024-09-19T09:04:06.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:05 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1730087354' entity='client.admin' cmd='[{"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.212660"}]': finished 2024-09-19T09:04:06.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:05 smithi203 ceph-mon[35450]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T09:04:06.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:05 smithi203 ceph-mon[35450]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:04:06.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:05 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1730087354' entity='client.admin' cmd=[{"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.212660"}]: dispatch 2024-09-19T09:04:06.242 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.241+0000 7f750088d640 1 -- 172.21.15.19:0/3997252709 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "foo.212660", "pool2": "foo.212660", "yes_i_really_really_mean_it": true} v 0) -- 0x7f74fc062e90 con 0x7f74fc1025c0 2024-09-19T09:04:06.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:05 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1730087354' entity='client.admin' cmd='[{"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.212660"}]': finished 2024-09-19T09:04:06.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:05 smithi019 ceph-mon[30976]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T09:04:06.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:05 smithi019 ceph-mon[30976]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:04:06.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:05 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1730087354' entity='client.admin' cmd=[{"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.212660"}]: dispatch 2024-09-19T09:04:06.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:05 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1730087354' entity='client.admin' cmd='[{"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.212660"}]': finished 2024-09-19T09:04:06.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:05 smithi155 ceph-mon[34921]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T09:04:06.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:05 smithi155 ceph-mon[34921]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:04:06.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:05 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1730087354' entity='client.admin' cmd=[{"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.212660"}]: dispatch 2024-09-19T09:04:06.882 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:04:06.949 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:06.948+0000 7f74eb7fe640 1 -- 172.21.15.19:0/3997252709 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "foo.212660", "pool2": "foo.212660", "yes_i_really_really_mean_it": true}]=0 pool 'foo.212660' removed v88) ==== 166+0+0 (secure 0 0 0) 0x7f74ec09c4d0 con 0x7f74fc1025c0 2024-09-19T09:04:07.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:07.058+0000 7f750088d640 1 -- 172.21.15.19:0/3997252709 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "foo.212660", "pool2": "foo.212660", "yes_i_really_really_mean_it": true} v 0) -- 0x7f74fc02daa0 con 0x7f74fc1025c0 2024-09-19T09:04:07.059 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:07.058+0000 7f74eb7fe640 1 -- 172.21.15.19:0/3997252709 <== mon.0 v2:172.21.15.19:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "foo.212660", "pool2": "foo.212660", "yes_i_really_really_mean_it": true}]=0 pool 'foo.212660' does not exist v88) ==== 173+0+0 (secure 0 0 0) 0x7f74ec09bdd0 con 0x7f74fc1025c0 2024-09-19T09:04:07.059 INFO:tasks.workunit.client.0.smithi019.stderr:pool 'foo.212660' does not exist 2024-09-19T09:04:07.061 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:07.060+0000 7f750088d640 1 -- 172.21.15.19:0/3997252709 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f74e40a3250 msgr2=0x7f74e40a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:07.061 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:07.060+0000 7f750088d640 1 --2- 172.21.15.19:0/3997252709 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f74e40a3250 0x7f74e40a5710 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f74fc199390 tx=0x7f74f000a780 comp rx=0 tx=0).stop 2024-09-19T09:04:07.061 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:07.060+0000 7f750088d640 1 -- 172.21.15.19:0/3997252709 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74fc1025c0 msgr2=0x7f74fc197e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:07.061 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:07.060+0000 7f750088d640 1 --2- 172.21.15.19:0/3997252709 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74fc1025c0 0x7f74fc197e80 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f74ec00c970 tx=0x7f74ec00ce30 comp rx=0 tx=0).stop 2024-09-19T09:04:07.061 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:07.060+0000 7f750088d640 1 -- 172.21.15.19:0/3997252709 shutdown_connections 2024-09-19T09:04:07.062 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:07.060+0000 7f750088d640 1 --2- 172.21.15.19:0/3997252709 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f74e40a3250 0x7f74e40a5710 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.062 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:07.060+0000 7f750088d640 1 --2- 172.21.15.19:0/3997252709 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74fc107820 0x7f74fc19f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.062 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:07.060+0000 7f750088d640 1 --2- 172.21.15.19:0/3997252709 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f74fc104ef0 0x7f74fc1983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.062 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:07.060+0000 7f750088d640 1 --2- 172.21.15.19:0/3997252709 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f74fc1025c0 0x7f74fc197e80 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.062 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:07.060+0000 7f750088d640 1 -- 172.21.15.19:0/3997252709 >> 172.21.15.19:0/3997252709 conn(0x7f74fc0fc1e0 msgr2=0x7f74fc102e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:07.062 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:07.060+0000 7f750088d640 1 -- 172.21.15.19:0/3997252709 shutdown_connections 2024-09-19T09:04:07.062 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-19T09:04:07.060+0000 7f750088d640 1 -- 172.21.15.19:0/3997252709 wait complete. 2024-09-19T09:04:07.076 INFO:tasks.workunit.client.0.smithi019.stdout:OK 2024-09-19T09:04:07.077 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T09:04:07.077 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T09:04:07.103 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:06 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1730087354' entity='client.admin' cmd='[{"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.212660"}]': finished 2024-09-19T09:04:07.103 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:06 smithi019 ceph-mon[30976]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:04:07.103 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:06 smithi019 ceph-mon[30976]: pgmap v699: 105 pgs: 3 unknown, 102 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 36 KiB/s wr, 20 op/s 2024-09-19T09:04:07.103 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:06 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3997252709' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "foo.212660", "pool2": "foo.212660", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:04:07.112 INFO:tasks.workunit:Running workunit fs/misc/multiple_rsync.sh... 2024-09-19T09:04:07.113 DEBUG:teuthology.orchestra.run.smithi019:workunit test fs/misc/multiple_rsync.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/multiple_rsync.sh 2024-09-19T09:04:07.151 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:07.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:06 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1730087354' entity='client.admin' cmd='[{"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.212660"}]': finished 2024-09-19T09:04:07.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:06 smithi203 ceph-mon[35450]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:04:07.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:06 smithi203 ceph-mon[35450]: pgmap v699: 105 pgs: 3 unknown, 102 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 36 KiB/s wr, 20 op/s 2024-09-19T09:04:07.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:06 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3997252709' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "foo.212660", "pool2": "foo.212660", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:04:07.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:06 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1730087354' entity='client.admin' cmd='[{"prefix": "fs rm_data_pool", "fs_name": "cephfs", "pool": "foo.212660"}]': finished 2024-09-19T09:04:07.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:06 smithi155 ceph-mon[34921]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:04:07.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:06 smithi155 ceph-mon[34921]: pgmap v699: 105 pgs: 3 unknown, 102 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 36 KiB/s wr, 20 op/s 2024-09-19T09:04:07.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:06 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3997252709' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "foo.212660", "pool2": "foo.212660", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:04:07.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.656+0000 7f6cb74e1640 1 -- 172.21.15.19:0/2012023113 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cb0102d40 msgr2=0x7f6cb0103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:07.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.656+0000 7f6cb74e1640 1 --2- 172.21.15.19:0/2012023113 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cb0102d40 0x7f6cb0103120 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f6cac009900 tx=0x7f6cac02a480 comp rx=0 tx=0).stop 2024-09-19T09:04:07.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.656+0000 7f6cb74e1640 1 -- 172.21.15.19:0/2012023113 shutdown_connections 2024-09-19T09:04:07.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.656+0000 7f6cb74e1640 1 --2- 172.21.15.19:0/2012023113 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6cb0103660 0x7f6cb010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.656+0000 7f6cb74e1640 1 --2- 172.21.15.19:0/2012023113 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cb010c170 0x7f6cb010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.656+0000 7f6cb74e1640 1 --2- 172.21.15.19:0/2012023113 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cb0102d40 0x7f6cb0103120 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.656+0000 7f6cb74e1640 1 -- 172.21.15.19:0/2012023113 >> 172.21.15.19:0/2012023113 conn(0x7f6cb00fc7a0 msgr2=0x7f6cb00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:07.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.656+0000 7f6cb74e1640 1 -- 172.21.15.19:0/2012023113 shutdown_connections 2024-09-19T09:04:07.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.656+0000 7f6cb74e1640 1 -- 172.21.15.19:0/2012023113 wait complete. 2024-09-19T09:04:07.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.657+0000 7f6cb74e1640 1 Processor -- start 2024-09-19T09:04:07.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.657+0000 7f6cb74e1640 1 -- start start 2024-09-19T09:04:07.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.657+0000 7f6cb74e1640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cb0102d40 0x7f6cb0198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:07.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.657+0000 7f6cb74e1640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6cb0103660 0x7f6cb0198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:07.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.657+0000 7f6cb74e1640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cb010c170 0x7f6cb019ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:07.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.657+0000 7f6cb74e1640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb0111f70 con 0x7f6cb0102d40 2024-09-19T09:04:07.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.657+0000 7f6cb74e1640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb0111df0 con 0x7f6cb010c170 2024-09-19T09:04:07.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.657+0000 7f6cb74e1640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb01120f0 con 0x7f6cb0103660 2024-09-19T09:04:07.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.657+0000 7f6cb527d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cb0102d40 0x7f6cb0198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:07.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.658+0000 7f6cb527d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cb0102d40 0x7f6cb0198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45416/0 (socket says 172.21.15.19:45416) 2024-09-19T09:04:07.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.658+0000 7f6cb527d640 1 -- 172.21.15.19:0/3128686762 learned_addr learned my addr 172.21.15.19:0/3128686762 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:07.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.658+0000 7f6cb5a7e640 1 --2- 172.21.15.19:0/3128686762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cb010c170 0x7f6cb019ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:07.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.658+0000 7f6cb4a7c640 1 --2- 172.21.15.19:0/3128686762 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6cb0103660 0x7f6cb0198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:07.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.658+0000 7f6cb527d640 1 -- 172.21.15.19:0/3128686762 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6cb0103660 msgr2=0x7f6cb0198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:07.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.658+0000 7f6cb527d640 1 --2- 172.21.15.19:0/3128686762 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6cb0103660 0x7f6cb0198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.658+0000 7f6cb527d640 1 -- 172.21.15.19:0/3128686762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cb010c170 msgr2=0x7f6cb019ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:07.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.658+0000 7f6cb527d640 1 --2- 172.21.15.19:0/3128686762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cb010c170 0x7f6cb019ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.658+0000 7f6cb527d640 1 -- 172.21.15.19:0/3128686762 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cb019d3b0 con 0x7f6cb0102d40 2024-09-19T09:04:07.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.658+0000 7f6cb5a7e640 1 --2- 172.21.15.19:0/3128686762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cb010c170 0x7f6cb019ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:07.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.658+0000 7f6cb527d640 1 --2- 172.21.15.19:0/3128686762 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cb0102d40 0x7f6cb0198400 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f6cac006010 tx=0x7f6cac0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:07.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.658+0000 7f6ca67fc640 1 -- 172.21.15.19:0/3128686762 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac03f030 con 0x7f6cb0102d40 2024-09-19T09:04:07.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.658+0000 7f6ca67fc640 1 -- 172.21.15.19:0/3128686762 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cac003ce0 con 0x7f6cb0102d40 2024-09-19T09:04:07.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.658+0000 7f6cb74e1640 1 -- 172.21.15.19:0/3128686762 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cb019d640 con 0x7f6cb0102d40 2024-09-19T09:04:07.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.658+0000 7f6ca67fc640 1 -- 172.21.15.19:0/3128686762 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac035070 con 0x7f6cb0102d40 2024-09-19T09:04:07.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.658+0000 7f6cb74e1640 1 -- 172.21.15.19:0/3128686762 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cb01a4f80 con 0x7f6cb0102d40 2024-09-19T09:04:07.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.661+0000 7f6ca67fc640 1 -- 172.21.15.19:0/3128686762 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f6cac042030 con 0x7f6cb0102d40 2024-09-19T09:04:07.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.661+0000 7f6cb98ba740 1 Processor -- start 2024-09-19T09:04:07.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.661+0000 7f6cb98ba740 1 -- start start 2024-09-19T09:04:07.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.662+0000 7f6cb98ba740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5605b1ec6b40 0x5605b1ec5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:07.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.662+0000 7f6cb98ba740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605b1ec55d0 0x5605b1ec5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:07.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.662+0000 7f6cb98ba740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5605b1ed0370 0x5605b1ed2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:07.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.662+0000 7f6cb98ba740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5605b1e2b2f0 con 0x5605b1ec55d0 2024-09-19T09:04:07.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.662+0000 7f6cb98ba740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5605b1dd2cf0 con 0x5605b1ec6b40 2024-09-19T09:04:07.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.662+0000 7f6cb98ba740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5605b1e272b0 con 0x5605b1ed0370 2024-09-19T09:04:07.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.662+0000 7f6cb527d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605b1ec55d0 0x5605b1ec5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:07.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.662+0000 7f6cb527d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605b1ec55d0 0x5605b1ec5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45432/0 (socket says 172.21.15.19:45432) 2024-09-19T09:04:07.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.662+0000 7f6cb527d640 1 -- 172.21.15.19:0/171644752 learned_addr learned my addr 172.21.15.19:0/171644752 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:07.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.662+0000 7f6cb4a7c640 1 --2- 172.21.15.19:0/171644752 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5605b1ed0370 0x5605b1ed2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:07.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.662+0000 7f6cb5a7e640 1 --2- 172.21.15.19:0/171644752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5605b1ec6b40 0x5605b1ec5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:07.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.662+0000 7f6ca67fc640 1 --2- 172.21.15.19:0/3128686762 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6c9c0a32c0 0x7f6c9c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:07.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.662+0000 7f6cb5a7e640 1 --2- 172.21.15.19:0/3128686762 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6c9c0a32c0 0x7f6c9c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:07.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.662+0000 7f6cb527d640 1 -- 172.21.15.19:0/171644752 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5605b1ed0370 msgr2=0x5605b1ed2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:07.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.662+0000 7f6cb527d640 1 --2- 172.21.15.19:0/171644752 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5605b1ed0370 0x5605b1ed2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.662+0000 7f6cb527d640 1 -- 172.21.15.19:0/171644752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5605b1ec6b40 msgr2=0x5605b1ec5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:07.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.662+0000 7f6cb527d640 1 --2- 172.21.15.19:0/171644752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5605b1ec6b40 0x5605b1ec5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.662+0000 7f6cb527d640 1 -- 172.21.15.19:0/171644752 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605b1db73a0 con 0x5605b1ec55d0 2024-09-19T09:04:07.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.662+0000 7f6cb4a7c640 1 --2- 172.21.15.19:0/171644752 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5605b1ed0370 0x5605b1ed2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:07.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.662+0000 7f6ca67fc640 1 -- 172.21.15.19:0/3128686762 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f6cac0efe70 con 0x7f6cb0102d40 2024-09-19T09:04:07.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.662+0000 7f6cb527d640 1 --2- 172.21.15.19:0/171644752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605b1ec55d0 0x5605b1ec5a10 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f6cac0bc260 tx=0x7f6cac02a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4512381a4a24e15 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:07.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.663+0000 7f6cb5a7e640 1 --2- 172.21.15.19:0/3128686762 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6c9c0a32c0 0x7f6c9c0a5780 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8005fd0 tx=0x7f6ca8004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:07.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.663+0000 7f6c9b7fe640 1 -- 172.21.15.19:0/171644752 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac049030 con 0x5605b1ec55d0 2024-09-19T09:04:07.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.663+0000 7f6c9b7fe640 1 -- 172.21.15.19:0/171644752 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6cac03b580 con 0x5605b1ec55d0 2024-09-19T09:04:07.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.663+0000 7f6c9b7fe640 1 -- 172.21.15.19:0/171644752 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac0bcc60 con 0x5605b1ec55d0 2024-09-19T09:04:07.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.663+0000 7f6cb98ba740 1 -- 172.21.15.19:0/171644752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605b1ec55d0 msgr2=0x5605b1ec5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:07.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.663+0000 7f6cb98ba740 1 --2- 172.21.15.19:0/171644752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605b1ec55d0 0x5605b1ec5a10 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f6cac0bc260 tx=0x7f6cac02a480 comp rx=0 tx=0).stop 2024-09-19T09:04:07.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.663+0000 7f6cb98ba740 1 -- 172.21.15.19:0/171644752 shutdown_connections 2024-09-19T09:04:07.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.663+0000 7f6cb98ba740 1 --2- 172.21.15.19:0/171644752 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5605b1ed0370 0x5605b1ed2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.663+0000 7f6cb98ba740 1 --2- 172.21.15.19:0/171644752 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605b1ec55d0 0x5605b1ec5a10 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.663+0000 7f6cb98ba740 1 --2- 172.21.15.19:0/171644752 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5605b1ec6b40 0x5605b1ec5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.663+0000 7f6cb98ba740 1 -- 172.21.15.19:0/171644752 >> 172.21.15.19:0/171644752 conn(0x5605b1e8e310 msgr2=0x5605b1ec1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:07.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.663+0000 7f6cb98ba740 1 -- 172.21.15.19:0/171644752 shutdown_connections 2024-09-19T09:04:07.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.663+0000 7f6cb98ba740 1 -- 172.21.15.19:0/171644752 wait complete. 2024-09-19T09:04:07.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.664+0000 7f6cb98ba740 1 -- start start 2024-09-19T09:04:07.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.664+0000 7f6cb98ba740 1 Processor -- start 2024-09-19T09:04:07.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.664+0000 7f6cb98ba740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605b1ec55d0 0x5605b1ecfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:07.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.664+0000 7f6cb98ba740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5605b1ec6b40 0x5605b1eccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:07.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.664+0000 7f6cb98ba740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5605b1ed0370 0x5605b1ecd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:07.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.664+0000 7f6cb98ba740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5605b1e2b2f0 con 0x5605b1ec55d0 2024-09-19T09:04:07.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.664+0000 7f6cb98ba740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5605b1de6060 con 0x5605b1ed0370 2024-09-19T09:04:07.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.664+0000 7f6cb98ba740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5605b1ed2e30 con 0x5605b1ec6b40 2024-09-19T09:04:07.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.664+0000 7f6cb98ba740 10 client.0 _ll_register_callbacks cb 0x5605b1b398c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:07.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.665+0000 7f6cb527d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605b1ec55d0 0x5605b1ecfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:07.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.665+0000 7f6cb527d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605b1ec55d0 0x5605b1ecfa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45436/0 (socket says 172.21.15.19:45436) 2024-09-19T09:04:07.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.665+0000 7f6cb527d640 1 -- 172.21.15.19:0/724987633 learned_addr learned my addr 172.21.15.19:0/724987633 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:07.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.665+0000 7f6cb4a7c640 1 --2- 172.21.15.19:0/724987633 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5605b1ec6b40 0x5605b1eccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:07.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.665+0000 7f6cb5a7e640 1 --2- 172.21.15.19:0/724987633 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5605b1ed0370 0x5605b1ecd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:07.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.665+0000 7f6cb527d640 1 -- 172.21.15.19:0/724987633 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5605b1ec6b40 msgr2=0x5605b1eccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:07.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.665+0000 7f6cb527d640 1 --2- 172.21.15.19:0/724987633 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5605b1ec6b40 0x5605b1eccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.665+0000 7f6cb527d640 1 -- 172.21.15.19:0/724987633 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5605b1ed0370 msgr2=0x5605b1ecd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:07.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.665+0000 7f6cb527d640 1 --2- 172.21.15.19:0/724987633 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5605b1ed0370 0x5605b1ecd4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.665+0000 7f6cb527d640 1 -- 172.21.15.19:0/724987633 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605b1b9c3c0 con 0x5605b1ec55d0 2024-09-19T09:04:07.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.666+0000 7f6cb527d640 1 --2- 172.21.15.19:0/724987633 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605b1ec55d0 0x5605b1ecfa90 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f6cac0b8160 tx=0x7f6cac0baa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c959b0fd1986199 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:07.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.666+0000 7f6c98ff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:04:07.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.666+0000 7f6c98ff9640 1 -- 172.21.15.19:0/724987633 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cac049070 con 0x5605b1ec55d0 2024-09-19T09:04:07.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.666+0000 7f6c98ff9640 1 -- 172.21.15.19:0/724987633 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f6cac008740 con 0x5605b1ec55d0 2024-09-19T09:04:07.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.666+0000 7f6cb98ba740 1 -- 172.21.15.19:0/724987633 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5605b1e38860 con 0x5605b1ec55d0 2024-09-19T09:04:07.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.666+0000 7f6c98ff9640 1 -- 172.21.15.19:0/724987633 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f6cac03bcb0 con 0x5605b1ec55d0 2024-09-19T09:04:07.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.666+0000 7f6cb98ba740 10 client.18594 fetch_fsmap learned FSMap version 42 2024-09-19T09:04:07.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.666+0000 7f6cb98ba740 1 -- 172.21.15.19:0/724987633 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5605b1ed86f0 con 0x5605b1ec55d0 2024-09-19T09:04:07.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.666+0000 7f6c98ff9640 1 -- 172.21.15.19:0/724987633 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x5605b1e38860 con 0x5605b1ec55d0 2024-09-19T09:04:07.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.666+0000 7f6c98ff9640 1 -- 172.21.15.19:0/724987633 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 42) ==== 8362+0+0 (secure 0 0 0) 0x7f6cac008220 con 0x5605b1ec55d0 2024-09-19T09:04:07.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.666+0000 7f6cb98ba740 10 client.18594 fetch_fsmap finished waiting for FSMap version 42 2024-09-19T09:04:07.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.666+0000 7f6cb98ba740 10 client.18594 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:04:07.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.666+0000 7f6cb98ba740 20 client.18594 populate_metadata read hostname 'smithi019' 2024-09-19T09:04:07.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.666+0000 7f6cb98ba740 1 --2- 172.21.15.19:0/724987633 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x5605b1ed9b00 0x5605b1edbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:07.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.666+0000 7f6cb98ba740 4 client.18594 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:07.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.666+0000 7f6cb98ba740 1 -- 172.21.15.19:0/724987633 --> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605b1e32d70 con 0x5605b1ed9b00 2024-09-19T09:04:07.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.667+0000 7f6cb4a7c640 1 --2- 172.21.15.19:0/724987633 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x5605b1ed9b00 0x5605b1edbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:07.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.667+0000 7f6c98ff9640 10 client.18594 ms_handle_connect on v2:172.21.15.203:6838/2547507299 2024-09-19T09:04:07.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.667+0000 7f6cb4a7c640 1 --2- 172.21.15.19:0/724987633 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x5605b1ed9b00 0x5605b1edbf30 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=864291e95feabd9c server_cookie=ee362d8e14fc9b87 in_seq=0 out_seq=0 2024-09-19T09:04:07.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.668+0000 7f6c98ff9640 1 -- 172.21.15.19:0/724987633 <== mds.1 v2:172.21.15.203:6838/2547507299 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5605b1e32d70 con 0x5605b1ed9b00 2024-09-19T09:04:07.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.668+0000 7f6c98ff9640 10 client.18594 handle_command_reply: tid=0 2024-09-19T09:04:07.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.668+0000 7f6cb98ba740 1 client.18594 shutdown 2024-09-19T09:04:07.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.668+0000 7f6cb98ba740 1 -- 172.21.15.19:0/724987633 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605b1ec55d0 msgr2=0x5605b1ecfa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:07.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.668+0000 7f6cb98ba740 1 --2- 172.21.15.19:0/724987633 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605b1ec55d0 0x5605b1ecfa90 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f6cac0b8160 tx=0x7f6cac0baa70 comp rx=0 tx=0).stop 2024-09-19T09:04:07.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.668+0000 7f6cb98ba740 1 -- 172.21.15.19:0/724987633 shutdown_connections 2024-09-19T09:04:07.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.668+0000 7f6cb98ba740 1 --2- 172.21.15.19:0/724987633 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x5605b1ed9b00 0x5605b1edbf30 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.668+0000 7f6cb98ba740 1 --2- 172.21.15.19:0/724987633 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5605b1ec6b40 0x5605b1eccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.668+0000 7f6c98ff9640 0 client.18594 ms_handle_reset on v2:172.21.15.203:6838/2547507299 2024-09-19T09:04:07.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.668+0000 7f6cb98ba740 1 --2- 172.21.15.19:0/724987633 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5605b1ed0370 0x5605b1ecd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.668+0000 7f6cb98ba740 1 --2- 172.21.15.19:0/724987633 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605b1ec55d0 0x5605b1ecfa90 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.668+0000 7f6cb98ba740 1 -- 172.21.15.19:0/724987633 >> 172.21.15.19:0/724987633 conn(0x5605b1e8e310 msgr2=0x5605b1ec7930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:07.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.668+0000 7f6cb98ba740 1 -- 172.21.15.19:0/724987633 shutdown_connections 2024-09-19T09:04:07.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.668+0000 7f6cb98ba740 1 -- 172.21.15.19:0/724987633 wait complete. 2024-09-19T09:04:07.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.668+0000 7f6cb98ba740 20 client.18594 trim_cache size 0 max 16384 2024-09-19T09:04:07.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.681+0000 7f6cb98ba740 1 Processor -- start 2024-09-19T09:04:07.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.681+0000 7f6cb98ba740 1 -- start start 2024-09-19T09:04:07.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.681+0000 7f6cb98ba740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5605b1ec55d0 0x5605b1ec0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:07.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.681+0000 7f6cb98ba740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5605b1ec6b40 0x5605b1ee5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:07.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.681+0000 7f6cb98ba740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605b1ed0370 0x5605b1ec8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:07.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.681+0000 7f6cb98ba740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb01ab340 con 0x5605b1ed0370 2024-09-19T09:04:07.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.681+0000 7f6cb98ba740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb01ace80 con 0x5605b1ec6b40 2024-09-19T09:04:07.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.681+0000 7f6cb98ba740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb01aba10 con 0x5605b1ec55d0 2024-09-19T09:04:07.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.682+0000 7f6cb5a7e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605b1ed0370 0x5605b1ec8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:07.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.682+0000 7f6cb5a7e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605b1ed0370 0x5605b1ec8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45438/0 (socket says 172.21.15.19:45438) 2024-09-19T09:04:07.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.682+0000 7f6cb5a7e640 1 -- 172.21.15.19:0/2716081878 learned_addr learned my addr 172.21.15.19:0/2716081878 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:07.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.682+0000 7f6cb527d640 1 --2- 172.21.15.19:0/2716081878 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5605b1ec55d0 0x5605b1ec0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:07.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.682+0000 7f6cb4a7c640 1 --2- 172.21.15.19:0/2716081878 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5605b1ec6b40 0x5605b1ee5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:07.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.682+0000 7f6cb5a7e640 1 -- 172.21.15.19:0/2716081878 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5605b1ec55d0 msgr2=0x5605b1ec0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:07.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.682+0000 7f6cb5a7e640 1 --2- 172.21.15.19:0/2716081878 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5605b1ec55d0 0x5605b1ec0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.682+0000 7f6cb5a7e640 1 -- 172.21.15.19:0/2716081878 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5605b1ec6b40 msgr2=0x5605b1ee5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:07.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.682+0000 7f6cb5a7e640 1 --2- 172.21.15.19:0/2716081878 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5605b1ec6b40 0x5605b1ee5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.682+0000 7f6cb5a7e640 1 -- 172.21.15.19:0/2716081878 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605b1ecc010 con 0x5605b1ed0370 2024-09-19T09:04:07.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.682+0000 7f6cb527d640 1 --2- 172.21.15.19:0/2716081878 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5605b1ec55d0 0x5605b1ec0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:07.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.682+0000 7f6cb5a7e640 1 --2- 172.21.15.19:0/2716081878 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605b1ed0370 0x5605b1ec8120 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8009280 tx=0x7f6ca8009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13e67accb17804a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:07.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.682+0000 7f6c9affd640 1 -- 172.21.15.19:0/2716081878 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca801a070 con 0x5605b1ed0370 2024-09-19T09:04:07.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.682+0000 7f6c9affd640 1 -- 172.21.15.19:0/2716081878 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ca8011be0 con 0x5605b1ed0370 2024-09-19T09:04:07.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.682+0000 7f6c9affd640 1 -- 172.21.15.19:0/2716081878 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca8021660 con 0x5605b1ed0370 2024-09-19T09:04:07.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.683+0000 7f6cb98ba740 1 -- 172.21.15.19:0/2716081878 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605b1ed0370 msgr2=0x5605b1ec8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:07.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.683+0000 7f6cb98ba740 1 --2- 172.21.15.19:0/2716081878 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605b1ed0370 0x5605b1ec8120 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8009280 tx=0x7f6ca8009880 comp rx=0 tx=0).stop 2024-09-19T09:04:07.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.683+0000 7f6cb98ba740 1 -- 172.21.15.19:0/2716081878 shutdown_connections 2024-09-19T09:04:07.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.683+0000 7f6cb98ba740 1 --2- 172.21.15.19:0/2716081878 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605b1ed0370 0x5605b1ec8120 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.683+0000 7f6cb98ba740 1 --2- 172.21.15.19:0/2716081878 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5605b1ec6b40 0x5605b1ee5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.683+0000 7f6cb98ba740 1 --2- 172.21.15.19:0/2716081878 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5605b1ec55d0 0x5605b1ec0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.683+0000 7f6cb98ba740 1 -- 172.21.15.19:0/2716081878 >> 172.21.15.19:0/2716081878 conn(0x5605b1e8e310 msgr2=0x5605b1ecf030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:07.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.683+0000 7f6cb98ba740 1 -- 172.21.15.19:0/2716081878 shutdown_connections 2024-09-19T09:04:07.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.683+0000 7f6cb98ba740 1 -- 172.21.15.19:0/2716081878 wait complete. 2024-09-19T09:04:07.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.683+0000 7f6cb98ba740 1 -- start start 2024-09-19T09:04:07.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.683+0000 7f6cb98ba740 1 Processor -- start 2024-09-19T09:04:07.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.684+0000 7f6cb98ba740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5605b1ec55d0 0x5605b1edc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:07.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.684+0000 7f6cb98ba740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5605b1ec6b40 0x5605b1edc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:07.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.684+0000 7f6cb98ba740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605b1ed0370 0x5605b1edcf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:07.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.684+0000 7f6cb98ba740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb01ac7b0 con 0x5605b1ed0370 2024-09-19T09:04:07.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.684+0000 7f6cb98ba740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb01ac0e0 con 0x5605b1ec55d0 2024-09-19T09:04:07.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.684+0000 7f6cb98ba740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6cb01a9320 con 0x5605b1ec6b40 2024-09-19T09:04:07.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.684+0000 7f6cb98ba740 10 client.0 _ll_register_callbacks cb 0x7f6ca80096e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:07.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.684+0000 7f6cb5a7e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605b1ed0370 0x5605b1edcf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:07.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.684+0000 7f6cb5a7e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605b1ed0370 0x5605b1edcf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45448/0 (socket says 172.21.15.19:45448) 2024-09-19T09:04:07.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.684+0000 7f6cb5a7e640 1 -- 172.21.15.19:0/1393723 learned_addr learned my addr 172.21.15.19:0/1393723 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:07.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.684+0000 7f6cb4a7c640 1 --2- 172.21.15.19:0/1393723 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5605b1ec6b40 0x5605b1edc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:07.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.684+0000 7f6cb527d640 1 --2- 172.21.15.19:0/1393723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5605b1ec55d0 0x5605b1edc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:07.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.684+0000 7f6cb5a7e640 1 -- 172.21.15.19:0/1393723 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5605b1ec6b40 msgr2=0x5605b1edc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:07.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.684+0000 7f6cb5a7e640 1 --2- 172.21.15.19:0/1393723 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5605b1ec6b40 0x5605b1edc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.684+0000 7f6cb5a7e640 1 -- 172.21.15.19:0/1393723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5605b1ec55d0 msgr2=0x5605b1edc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:07.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.684+0000 7f6cb5a7e640 1 --2- 172.21.15.19:0/1393723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5605b1ec55d0 0x5605b1edc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.684+0000 7f6cb5a7e640 1 -- 172.21.15.19:0/1393723 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605b1f5ad40 con 0x5605b1ed0370 2024-09-19T09:04:07.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.684+0000 7f6cb527d640 1 --2- 172.21.15.19:0/1393723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5605b1ec55d0 0x5605b1edc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:07.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.685+0000 7f6cb5a7e640 1 --2- 172.21.15.19:0/1393723 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605b1ed0370 0x5605b1edcf20 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f6ca802bdc0 tx=0x7f6ca80097e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=375e08e19fbab1c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:07.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.685+0000 7f6c98ff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:04:07.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.685+0000 7f6c98ff9640 1 -- 172.21.15.19:0/1393723 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca801a070 con 0x5605b1ed0370 2024-09-19T09:04:07.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.685+0000 7f6c98ff9640 1 -- 172.21.15.19:0/1393723 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f6ca802b650 con 0x5605b1ed0370 2024-09-19T09:04:07.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.685+0000 7f6cb98ba740 1 -- 172.21.15.19:0/1393723 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6ca8011be0 con 0x5605b1ed0370 2024-09-19T09:04:07.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.685+0000 7f6c98ff9640 1 -- 172.21.15.19:0/1393723 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f6ca802be60 con 0x5605b1ed0370 2024-09-19T09:04:07.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.685+0000 7f6cb98ba740 10 client.18600 fetch_fsmap learned FSMap version 42 2024-09-19T09:04:07.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.685+0000 7f6cb98ba740 1 -- 172.21.15.19:0/1393723 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5605b1f5c020 con 0x5605b1ed0370 2024-09-19T09:04:07.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.685+0000 7f6c98ff9640 1 -- 172.21.15.19:0/1393723 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f6ca8011be0 con 0x5605b1ed0370 2024-09-19T09:04:07.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.685+0000 7f6c98ff9640 1 -- 172.21.15.19:0/1393723 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 42) ==== 8362+0+0 (secure 0 0 0) 0x7f6ca8032070 con 0x5605b1ed0370 2024-09-19T09:04:07.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.685+0000 7f6cb98ba740 10 client.18600 fetch_fsmap finished waiting for FSMap version 42 2024-09-19T09:04:07.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.685+0000 7f6cb98ba740 10 client.18600 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:04:07.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.685+0000 7f6cb98ba740 20 client.18600 populate_metadata read hostname 'smithi019' 2024-09-19T09:04:07.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.685+0000 7f6cb98ba740 1 --2- 172.21.15.19:0/1393723 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x5605b1ed9b00 0x5605b1f5e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:07.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.685+0000 7f6cb98ba740 4 client.18600 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:04:07.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.685+0000 7f6cb98ba740 1 -- 172.21.15.19:0/1393723 --> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5605b1daf170 con 0x5605b1ed9b00 2024-09-19T09:04:07.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.686+0000 7f6cb527d640 1 --2- 172.21.15.19:0/1393723 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x5605b1ed9b00 0x5605b1f5e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:07.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.686+0000 7f6c98ff9640 10 client.18600 ms_handle_connect on v2:172.21.15.203:6838/2547507299 2024-09-19T09:04:07.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.686+0000 7f6cb527d640 1 --2- 172.21.15.19:0/1393723 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x5605b1ed9b00 0x5605b1f5e670 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=95349e7d8e526d5e server_cookie=d83c63d868901460 in_seq=0 out_seq=0 2024-09-19T09:04:07.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.686+0000 7f6c98ff9640 1 -- 172.21.15.19:0/1393723 <== mds.1 v2:172.21.15.203:6838/2547507299 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5605b1daf170 con 0x5605b1ed9b00 2024-09-19T09:04:07.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.686+0000 7f6c98ff9640 10 client.18600 handle_command_reply: tid=0 2024-09-19T09:04:07.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.686+0000 7f6cb98ba740 1 client.18600 shutdown 2024-09-19T09:04:07.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.686+0000 7f6cb98ba740 1 -- 172.21.15.19:0/1393723 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605b1ed0370 msgr2=0x5605b1edcf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:07.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.686+0000 7f6cb98ba740 1 --2- 172.21.15.19:0/1393723 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605b1ed0370 0x5605b1edcf20 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f6ca802bdc0 tx=0x7f6ca80097e0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.686+0000 7f6cb98ba740 1 -- 172.21.15.19:0/1393723 shutdown_connections 2024-09-19T09:04:07.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.686+0000 7f6cb98ba740 1 --2- 172.21.15.19:0/1393723 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x5605b1ed9b00 0x5605b1f5e670 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.686+0000 7f6cb98ba740 1 --2- 172.21.15.19:0/1393723 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5605b1ec6b40 0x5605b1edc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.686+0000 7f6cb98ba740 1 --2- 172.21.15.19:0/1393723 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5605b1ed0370 0x5605b1edcf20 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.686+0000 7f6cb98ba740 1 --2- 172.21.15.19:0/1393723 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5605b1ec55d0 0x5605b1edc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.686+0000 7f6cb98ba740 1 -- 172.21.15.19:0/1393723 >> 172.21.15.19:0/1393723 conn(0x5605b1e8e310 msgr2=0x5605b1ece810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:07.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.686+0000 7f6c98ff9640 0 client.18600 ms_handle_reset on v2:172.21.15.203:6838/2547507299 2024-09-19T09:04:07.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.687+0000 7f6cb98ba740 1 -- 172.21.15.19:0/1393723 shutdown_connections 2024-09-19T09:04:07.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.687+0000 7f6cb98ba740 1 -- 172.21.15.19:0/1393723 wait complete. 2024-09-19T09:04:07.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.687+0000 7f6cb98ba740 20 client.18600 trim_cache size 0 max 16384 2024-09-19T09:04:07.693 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:04:07.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.687+0000 7f6cb74e1640 1 -- 172.21.15.19:0/3128686762 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6c9c0a32c0 msgr2=0x7f6c9c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:07.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.687+0000 7f6cb74e1640 1 --2- 172.21.15.19:0/3128686762 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6c9c0a32c0 0x7f6c9c0a5780 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f6ca8005fd0 tx=0x7f6ca8004ab0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.687+0000 7f6cb74e1640 1 -- 172.21.15.19:0/3128686762 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cb0102d40 msgr2=0x7f6cb0198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:07.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.687+0000 7f6cb74e1640 1 --2- 172.21.15.19:0/3128686762 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cb0102d40 0x7f6cb0198400 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f6cac006010 tx=0x7f6cac0042f0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.687+0000 7f6cb74e1640 1 -- 172.21.15.19:0/3128686762 shutdown_connections 2024-09-19T09:04:07.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.687+0000 7f6cb74e1640 1 --2- 172.21.15.19:0/3128686762 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f6c9c0a32c0 0x7f6c9c0a5780 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.687+0000 7f6cb74e1640 1 --2- 172.21.15.19:0/3128686762 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6cb0103660 0x7f6cb0198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.687+0000 7f6cb74e1640 1 --2- 172.21.15.19:0/3128686762 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f6cb010c170 0x7f6cb019ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.687+0000 7f6cb74e1640 1 --2- 172.21.15.19:0/3128686762 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f6cb0102d40 0x7f6cb0198400 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:07.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.687+0000 7f6cb74e1640 1 -- 172.21.15.19:0/3128686762 >> 172.21.15.19:0/3128686762 conn(0x7f6cb00fc7a0 msgr2=0x7f6cb00fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:07.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.687+0000 7f6cb74e1640 1 -- 172.21.15.19:0/3128686762 shutdown_connections 2024-09-19T09:04:07.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:07.687+0000 7f6cb74e1640 1 -- 172.21.15.19:0/3128686762 wait complete. 2024-09-19T09:04:08.139 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.138+0000 7ff7709fe640 1 -- 172.21.15.19:0/171749496 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff76c107660 msgr2=0x7ff76c109ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:08.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.138+0000 7ff7709fe640 1 --2- 172.21.15.19:0/171749496 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff76c107660 0x7ff76c109ad0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7ff764009ca0 tx=0x7ff76402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.138+0000 7ff7709fe640 1 -- 172.21.15.19:0/171749496 shutdown_connections 2024-09-19T09:04:08.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.138+0000 7ff7709fe640 1 --2- 172.21.15.19:0/171749496 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff76c104d30 0x7ff76c107120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.138+0000 7ff7709fe640 1 --2- 172.21.15.19:0/171749496 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff76c107660 0x7ff76c109ad0 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.138+0000 7ff7709fe640 1 --2- 172.21.15.19:0/171749496 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff76c102400 0x7ff76c1047f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.138+0000 7ff7709fe640 1 -- 172.21.15.19:0/171749496 >> 172.21.15.19:0/171749496 conn(0x7ff76c0fbfe0 msgr2=0x7ff76c0fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:08.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.138+0000 7ff7709fe640 1 -- 172.21.15.19:0/171749496 shutdown_connections 2024-09-19T09:04:08.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.138+0000 7ff7709fe640 1 -- 172.21.15.19:0/171749496 wait complete. 2024-09-19T09:04:08.140 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.139+0000 7ff7709fe640 1 Processor -- start 2024-09-19T09:04:08.142 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.139+0000 7ff7709fe640 1 -- start start 2024-09-19T09:04:08.142 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.139+0000 7ff7709fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff76c102400 0x7ff76c197d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.142 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.139+0000 7ff7709fe640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff76c104d30 0x7ff76c198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.143 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.139+0000 7ff7709fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff76c107660 0x7ff76c19f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.143 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.139+0000 7ff7709fe640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c10d690 con 0x7ff76c107660 2024-09-19T09:04:08.143 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.139+0000 7ff7709fe640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c10d510 con 0x7ff76c104d30 2024-09-19T09:04:08.143 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.139+0000 7ff7709fe640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c10d810 con 0x7ff76c102400 2024-09-19T09:04:08.143 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.140+0000 7ff76b59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff76c107660 0x7ff76c19f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.143 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.140+0000 7ff76b59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff76c107660 0x7ff76c19f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45468/0 (socket says 172.21.15.19:45468) 2024-09-19T09:04:08.143 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.140+0000 7ff76b59e640 1 -- 172.21.15.19:0/1515825706 learned_addr learned my addr 172.21.15.19:0/1515825706 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:08.143 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.140+0000 7ff76a59c640 1 --2- 172.21.15.19:0/1515825706 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff76c104d30 0x7ff76c198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.143 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.140+0000 7ff76ad9d640 1 --2- 172.21.15.19:0/1515825706 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff76c102400 0x7ff76c197d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.143 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.140+0000 7ff76b59e640 1 -- 172.21.15.19:0/1515825706 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff76c102400 msgr2=0x7ff76c197d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:08.143 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.140+0000 7ff76b59e640 1 --2- 172.21.15.19:0/1515825706 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff76c102400 0x7ff76c197d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.143 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.140+0000 7ff76b59e640 1 -- 172.21.15.19:0/1515825706 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff76c104d30 msgr2=0x7ff76c198250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:08.143 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.140+0000 7ff76b59e640 1 --2- 172.21.15.19:0/1515825706 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ff76c104d30 0x7ff76c198250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.144 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.140+0000 7ff76b59e640 1 -- 172.21.15.19:0/1515825706 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff76c19f920 con 0x7ff76c107660 2024-09-19T09:04:08.144 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.140+0000 7ff76ad9d640 1 --2- 172.21.15.19:0/1515825706 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff76c102400 0x7ff76c197d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:08.144 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.140+0000 7ff76b59e640 1 --2- 172.21.15.19:0/1515825706 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ff76c107660 0x7ff76c19f280 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7ff764009430 tx=0x7ff764031ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:08.144 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.140+0000 7ff753fff640 1 -- 172.21.15.19:0/1515825706 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff764003b70 con 0x7ff76c107660 2024-09-19T09:04:08.144 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.140+0000 7ff753fff640 1 -- 172.21.15.19:0/1515825706 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff764003d10 con 0x7ff76c107660 2024-09-19T09:04:08.144 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.140+0000 7ff7709fe640 1 -- 172.21.15.19:0/1515825706 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff76c19fbb0 con 0x7ff76c107660 2024-09-19T09:04:08.144 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.140+0000 7ff753fff640 1 -- 172.21.15.19:0/1515825706 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7640047e0 con 0x7ff76c107660 2024-09-19T09:04:08.144 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.140+0000 7ff7709fe640 1 -- 172.21.15.19:0/1515825706 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff76c1a0100 con 0x7ff76c107660 2024-09-19T09:04:08.150 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.142+0000 7ff753fff640 1 -- 172.21.15.19:0/1515825706 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7ff76402f790 con 0x7ff76c107660 2024-09-19T09:04:08.150 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.143+0000 7ff77406f740 1 Processor -- start 2024-09-19T09:04:08.150 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.143+0000 7ff77406f740 1 -- start start 2024-09-19T09:04:08.150 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.143+0000 7ff77406f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593aa1f8f80 0x5593aa1f9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.150 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.143+0000 7ff77406f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593aa1f98c0 0x5593aa1fe380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.150 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.143+0000 7ff77406f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593aa1fe950 0x5593aa200e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.150 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.143+0000 7ff77406f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5593aa1582f0 con 0x5593aa1fe950 2024-09-19T09:04:08.151 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.143+0000 7ff77406f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5593aa100270 con 0x5593aa1f98c0 2024-09-19T09:04:08.151 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.143+0000 7ff77406f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5593aa1542b0 con 0x5593aa1f8f80 2024-09-19T09:04:08.151 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.143+0000 7ff753fff640 1 --2- 172.21.15.19:0/1515825706 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff7540a3240 0x7ff7540a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.151 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.143+0000 7ff76a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593aa1fe950 0x5593aa200e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.151 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.143+0000 7ff76a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593aa1fe950 0x5593aa200e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45480/0 (socket says 172.21.15.19:45480) 2024-09-19T09:04:08.151 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.143+0000 7ff76ad9d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593aa1f98c0 0x5593aa1fe380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.151 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.143+0000 7ff76a59c640 1 -- 172.21.15.19:0/953343685 learned_addr learned my addr 172.21.15.19:0/953343685 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:08.151 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.143+0000 7ff76b59e640 1 --2- 172.21.15.19:0/1515825706 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff7540a3240 0x7ff7540a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.151 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.143+0000 7ff753fff640 1 -- 172.21.15.19:0/1515825706 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7ff7640f0e00 con 0x7ff76c107660 2024-09-19T09:04:08.151 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.143+0000 7ff76a59c640 1 --2- 172.21.15.19:0/953343685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593aa1f8f80 0x5593aa1f9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.144+0000 7ff76a59c640 1 -- 172.21.15.19:0/953343685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593aa1f8f80 msgr2=0x5593aa1f9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:08.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.144+0000 7ff76a59c640 1 --2- 172.21.15.19:0/953343685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593aa1f8f80 0x5593aa1f9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.144+0000 7ff76a59c640 1 -- 172.21.15.19:0/953343685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593aa1f98c0 msgr2=0x5593aa1fe380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:08.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.144+0000 7ff76a59c640 1 --2- 172.21.15.19:0/953343685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593aa1f98c0 0x5593aa1fe380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.144+0000 7ff76a59c640 1 -- 172.21.15.19:0/953343685 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593aa0ff340 con 0x5593aa1fe950 2024-09-19T09:04:08.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.144+0000 7ff76ad9d640 1 --2- 172.21.15.19:0/953343685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593aa1f98c0 0x5593aa1fe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:08.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.144+0000 7ff76b59e640 1 --2- 172.21.15.19:0/1515825706 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ff7540a3240 0x7ff7540a5700 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff7640c5b70 tx=0x7ff7640b2880 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:08.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.144+0000 7ff76a59c640 1 --2- 172.21.15.19:0/953343685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593aa1fe950 0x5593aa200e10 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7ff760009f50 tx=0x7ff7600095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8587a55102d090ed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:08.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.144+0000 7ff7517fa640 1 -- 172.21.15.19:0/953343685 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff760017470 con 0x5593aa1fe950 2024-09-19T09:04:08.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.144+0000 7ff7517fa640 1 -- 172.21.15.19:0/953343685 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff76001c070 con 0x5593aa1fe950 2024-09-19T09:04:08.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.144+0000 7ff7517fa640 1 -- 172.21.15.19:0/953343685 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff760015a00 con 0x5593aa1fe950 2024-09-19T09:04:08.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.145+0000 7ff77406f740 1 -- 172.21.15.19:0/953343685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593aa1fe950 msgr2=0x5593aa200e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:08.152 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.145+0000 7ff77406f740 1 --2- 172.21.15.19:0/953343685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593aa1fe950 0x5593aa200e10 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7ff760009f50 tx=0x7ff7600095c0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.145+0000 7ff77406f740 1 -- 172.21.15.19:0/953343685 shutdown_connections 2024-09-19T09:04:08.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.145+0000 7ff77406f740 1 --2- 172.21.15.19:0/953343685 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593aa1fe950 0x5593aa200e10 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.145+0000 7ff77406f740 1 --2- 172.21.15.19:0/953343685 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593aa1f98c0 0x5593aa1fe380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.145+0000 7ff77406f740 1 --2- 172.21.15.19:0/953343685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593aa1f8f80 0x5593aa1f9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.145+0000 7ff77406f740 1 -- 172.21.15.19:0/953343685 >> 172.21.15.19:0/953343685 conn(0x5593aa1f01e0 msgr2=0x5593aa1f05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:08.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.145+0000 7ff77406f740 1 -- 172.21.15.19:0/953343685 shutdown_connections 2024-09-19T09:04:08.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.145+0000 7ff77406f740 1 -- 172.21.15.19:0/953343685 wait complete. 2024-09-19T09:04:08.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.145+0000 7ff77406f740 1 -- start start 2024-09-19T09:04:08.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.145+0000 7ff77406f740 1 Processor -- start 2024-09-19T09:04:08.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.145+0000 7ff77406f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593aa1f8f80 0x5593aa2031d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.145+0000 7ff77406f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593aa1f98c0 0x5593aa203710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.145+0000 7ff77406f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593aa1fe950 0x5593aa20a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.145+0000 7ff77406f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5593aa201920 con 0x5593aa1fe950 2024-09-19T09:04:08.153 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.145+0000 7ff77406f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5593aa0e1290 con 0x5593aa1f8f80 2024-09-19T09:04:08.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.145+0000 7ff77406f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5593aa201aa0 con 0x5593aa1f98c0 2024-09-19T09:04:08.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.145+0000 7ff77406f740 10 client.0 _ll_register_callbacks cb 0x5593aa112140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:08.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.145+0000 7ff76a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593aa1fe950 0x5593aa20a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.146+0000 7ff76a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593aa1fe950 0x5593aa20a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45482/0 (socket says 172.21.15.19:45482) 2024-09-19T09:04:08.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.146+0000 7ff76a59c640 1 -- 172.21.15.19:0/2099783773 learned_addr learned my addr 172.21.15.19:0/2099783773 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:08.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.146+0000 7ff76a59c640 1 --2- 172.21.15.19:0/2099783773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593aa1f8f80 0x5593aa2031d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.146+0000 7ff76ad9d640 1 --2- 172.21.15.19:0/2099783773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593aa1f98c0 0x5593aa203710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.146+0000 7ff76a59c640 1 -- 172.21.15.19:0/2099783773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593aa1f98c0 msgr2=0x5593aa203710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:08.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.146+0000 7ff76a59c640 1 --2- 172.21.15.19:0/2099783773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593aa1f98c0 0x5593aa203710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.146+0000 7ff76a59c640 1 -- 172.21.15.19:0/2099783773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593aa1f8f80 msgr2=0x5593aa2031d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:08.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.146+0000 7ff76a59c640 1 --2- 172.21.15.19:0/2099783773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593aa1f8f80 0x5593aa2031d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.146+0000 7ff76a59c640 1 -- 172.21.15.19:0/2099783773 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593a9e6b210 con 0x5593aa1fe950 2024-09-19T09:04:08.154 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.146+0000 7ff76a59c640 1 --2- 172.21.15.19:0/2099783773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593aa1fe950 0x5593aa20a750 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x5593aa202700 tx=0x7ff760008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b764807570cf614 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:08.155 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.146+0000 7ff74eff5640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:04:08.155 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.146+0000 7ff74eff5640 1 -- 172.21.15.19:0/2099783773 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff760005bc0 con 0x5593aa1fe950 2024-09-19T09:04:08.155 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.146+0000 7ff77406f740 1 -- 172.21.15.19:0/2099783773 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff76001c070 con 0x5593aa1fe950 2024-09-19T09:04:08.155 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.146+0000 7ff74eff5640 1 -- 172.21.15.19:0/2099783773 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7ff760005d60 con 0x5593aa1fe950 2024-09-19T09:04:08.155 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.146+0000 7ff74eff5640 1 -- 172.21.15.19:0/2099783773 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7ff760010070 con 0x5593aa1fe950 2024-09-19T09:04:08.155 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.146+0000 7ff77406f740 10 client.18612 fetch_fsmap learned FSMap version 42 2024-09-19T09:04:08.155 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.146+0000 7ff77406f740 1 -- 172.21.15.19:0/2099783773 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5593a9f37620 con 0x5593aa1fe950 2024-09-19T09:04:08.155 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.147+0000 7ff74eff5640 1 -- 172.21.15.19:0/2099783773 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff76001c070 con 0x5593aa1fe950 2024-09-19T09:04:08.155 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.147+0000 7ff74eff5640 1 -- 172.21.15.19:0/2099783773 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 42) ==== 8362+0+0 (secure 0 0 0) 0x7ff760017600 con 0x5593aa1fe950 2024-09-19T09:04:08.155 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.147+0000 7ff77406f740 10 client.18612 fetch_fsmap finished waiting for FSMap version 42 2024-09-19T09:04:08.155 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.147+0000 7ff77406f740 10 client.18612 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:04:08.155 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.147+0000 7ff77406f740 20 client.18612 populate_metadata read hostname 'smithi019' 2024-09-19T09:04:08.155 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.147+0000 7ff77406f740 1 --2- 172.21.15.19:0/2099783773 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5593aa20eb70 0x5593aa210f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.156 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.147+0000 7ff77406f740 4 client.18612 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:08.156 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.147+0000 7ff77406f740 1 -- 172.21.15.19:0/2099783773 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5593aa165a20 con 0x5593aa20eb70 2024-09-19T09:04:08.156 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.147+0000 7ff76ad9d640 1 --2- 172.21.15.19:0/2099783773 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5593aa20eb70 0x5593aa210f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.156 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.147+0000 7ff76ad9d640 1 --2- 172.21.15.19:0/2099783773 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5593aa20eb70 0x5593aa210f60 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2d31721d5de2c83 server_cookie=c5bf0645e970fd90 in_seq=0 out_seq=0 2024-09-19T09:04:08.156 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.147+0000 7ff74eff5640 10 client.18612 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:04:08.156 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.148+0000 7ff74eff5640 1 -- 172.21.15.19:0/2099783773 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5593aa165a20 con 0x5593aa20eb70 2024-09-19T09:04:08.156 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.148+0000 7ff74eff5640 10 client.18612 handle_command_reply: tid=0 2024-09-19T09:04:08.156 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.148+0000 7ff77406f740 1 client.18612 shutdown 2024-09-19T09:04:08.156 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.148+0000 7ff77406f740 1 -- 172.21.15.19:0/2099783773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593aa1fe950 msgr2=0x5593aa20a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:08.156 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.148+0000 7ff77406f740 1 --2- 172.21.15.19:0/2099783773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593aa1fe950 0x5593aa20a750 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x5593aa202700 tx=0x7ff760008040 comp rx=0 tx=0).stop 2024-09-19T09:04:08.156 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.148+0000 7ff77406f740 1 -- 172.21.15.19:0/2099783773 shutdown_connections 2024-09-19T09:04:08.156 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.148+0000 7ff77406f740 1 --2- 172.21.15.19:0/2099783773 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5593aa20eb70 0x5593aa210f60 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.156 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.148+0000 7ff77406f740 1 --2- 172.21.15.19:0/2099783773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593aa1f98c0 0x5593aa203710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.148+0000 7ff77406f740 1 --2- 172.21.15.19:0/2099783773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593aa1fe950 0x5593aa20a750 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.148+0000 7ff74eff5640 0 client.18612 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:04:08.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.148+0000 7ff77406f740 1 --2- 172.21.15.19:0/2099783773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593aa1f8f80 0x5593aa2031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.148+0000 7ff77406f740 1 -- 172.21.15.19:0/2099783773 >> 172.21.15.19:0/2099783773 conn(0x5593aa1f01e0 msgr2=0x5593aa1f19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:08.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.148+0000 7ff77406f740 1 -- 172.21.15.19:0/2099783773 shutdown_connections 2024-09-19T09:04:08.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.148+0000 7ff77406f740 1 -- 172.21.15.19:0/2099783773 wait complete. 2024-09-19T09:04:08.157 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.149+0000 7ff77406f740 20 client.18612 trim_cache size 0 max 16384 2024-09-19T09:04:08.165 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.163+0000 7ff77406f740 1 Processor -- start 2024-09-19T09:04:08.165 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.163+0000 7ff77406f740 1 -- start start 2024-09-19T09:04:08.166 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.164+0000 7ff77406f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593aa1f8f80 0x5593aa1f17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.166 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.164+0000 7ff77406f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593aa1f98c0 0x5593aa1f1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.166 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.164+0000 7ff77406f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593aa1fe950 0x5593aa20a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.166 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.164+0000 7ff77406f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c1a6c50 con 0x5593aa1fe950 2024-09-19T09:04:08.166 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.164+0000 7ff77406f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c1a8790 con 0x5593aa1f8f80 2024-09-19T09:04:08.166 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.164+0000 7ff77406f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c1a7320 con 0x5593aa1f98c0 2024-09-19T09:04:08.166 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.164+0000 7ff76a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593aa1fe950 0x5593aa20a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.166 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.164+0000 7ff76a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593aa1fe950 0x5593aa20a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45498/0 (socket says 172.21.15.19:45498) 2024-09-19T09:04:08.166 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.164+0000 7ff76a59c640 1 -- 172.21.15.19:0/55639097 learned_addr learned my addr 172.21.15.19:0/55639097 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:08.166 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.164+0000 7ff76ad9d640 1 --2- 172.21.15.19:0/55639097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593aa1f98c0 0x5593aa1f1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.166 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.164+0000 7ff76a59c640 1 --2- 172.21.15.19:0/55639097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593aa1f8f80 0x5593aa1f17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.166 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.164+0000 7ff76a59c640 1 -- 172.21.15.19:0/55639097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593aa1f98c0 msgr2=0x5593aa1f1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:08.166 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.164+0000 7ff76a59c640 1 --2- 172.21.15.19:0/55639097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593aa1f98c0 0x5593aa1f1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.167 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.164+0000 7ff76a59c640 1 -- 172.21.15.19:0/55639097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593aa1f8f80 msgr2=0x5593aa1f17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:08.167 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.164+0000 7ff76a59c640 1 --2- 172.21.15.19:0/55639097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593aa1f8f80 0x5593aa1f17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.167 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.164+0000 7ff76a59c640 1 -- 172.21.15.19:0/55639097 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593aa2115e0 con 0x5593aa1fe950 2024-09-19T09:04:08.167 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.164+0000 7ff76a59c640 1 --2- 172.21.15.19:0/55639097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593aa1fe950 0x5593aa20a6c0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x5593aa202120 tx=0x7ff760015f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce8f913f2cd69d94 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:08.167 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.164+0000 7ff750ff9640 1 -- 172.21.15.19:0/55639097 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff760017470 con 0x5593aa1fe950 2024-09-19T09:04:08.167 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.165+0000 7ff750ff9640 1 -- 172.21.15.19:0/55639097 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff76001c070 con 0x5593aa1fe950 2024-09-19T09:04:08.167 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.165+0000 7ff750ff9640 1 -- 172.21.15.19:0/55639097 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff760031c10 con 0x5593aa1fe950 2024-09-19T09:04:08.170 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.165+0000 7ff77406f740 1 -- 172.21.15.19:0/55639097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593aa1fe950 msgr2=0x5593aa20a6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:08.170 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.165+0000 7ff77406f740 1 --2- 172.21.15.19:0/55639097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593aa1fe950 0x5593aa20a6c0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x5593aa202120 tx=0x7ff760015f30 comp rx=0 tx=0).stop 2024-09-19T09:04:08.170 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.165+0000 7ff77406f740 1 -- 172.21.15.19:0/55639097 shutdown_connections 2024-09-19T09:04:08.171 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.165+0000 7ff77406f740 1 --2- 172.21.15.19:0/55639097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593aa1f98c0 0x5593aa1f1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.171 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.165+0000 7ff77406f740 1 --2- 172.21.15.19:0/55639097 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593aa1fe950 0x5593aa20a6c0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.171 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.165+0000 7ff77406f740 1 --2- 172.21.15.19:0/55639097 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593aa1f8f80 0x5593aa1f17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.171 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.165+0000 7ff77406f740 1 -- 172.21.15.19:0/55639097 >> 172.21.15.19:0/55639097 conn(0x5593aa1f01e0 msgr2=0x5593aa1f1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:08.171 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.165+0000 7ff77406f740 1 -- 172.21.15.19:0/55639097 shutdown_connections 2024-09-19T09:04:08.171 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.165+0000 7ff77406f740 1 -- 172.21.15.19:0/55639097 wait complete. 2024-09-19T09:04:08.171 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.166+0000 7ff77406f740 1 -- start start 2024-09-19T09:04:08.171 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.166+0000 7ff77406f740 1 Processor -- start 2024-09-19T09:04:08.171 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.166+0000 7ff77406f740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593aa1f8f80 0x5593aa207dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.171 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.166+0000 7ff77406f740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593aa1f98c0 0x5593aa208310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.171 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.166+0000 7ff77406f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593aa1fe950 0x5593aa209230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.171 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.166+0000 7ff77406f740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c1a80c0 con 0x5593aa1f8f80 2024-09-19T09:04:08.171 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.166+0000 7ff77406f740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c1a79f0 con 0x5593aa1f98c0 2024-09-19T09:04:08.172 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.166+0000 7ff77406f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff76c1a4c30 con 0x5593aa1fe950 2024-09-19T09:04:08.172 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.166+0000 7ff77406f740 10 client.0 _ll_register_callbacks cb 0x7ff75c008390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:08.172 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.166+0000 7ff76a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593aa1f8f80 0x5593aa207dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.172 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.166+0000 7ff76a59c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593aa1f8f80 0x5593aa207dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45512/0 (socket says 172.21.15.19:45512) 2024-09-19T09:04:08.172 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.166+0000 7ff76a59c640 1 -- 172.21.15.19:0/4278767805 learned_addr learned my addr 172.21.15.19:0/4278767805 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:08.172 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.166+0000 7ff76ad9d640 1 --2- 172.21.15.19:0/4278767805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593aa1f98c0 0x5593aa208310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.172 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.166+0000 7ff76a59c640 1 -- 172.21.15.19:0/4278767805 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593aa1fe950 msgr2=0x5593aa209230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:08.172 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.166+0000 7ff76a59c640 1 --2- 172.21.15.19:0/4278767805 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593aa1fe950 0x5593aa209230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.172 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.166+0000 7ff76a59c640 1 -- 172.21.15.19:0/4278767805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593aa1f98c0 msgr2=0x5593aa208310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:08.172 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.166+0000 7ff76a59c640 1 --2- 172.21.15.19:0/4278767805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593aa1f98c0 0x5593aa208310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:08.172 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.166+0000 7ff76a59c640 1 -- 172.21.15.19:0/4278767805 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593aa209840 con 0x5593aa1f8f80 2024-09-19T09:04:08.172 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.166+0000 7ff76ad9d640 1 --2- 172.21.15.19:0/4278767805 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5593aa1f98c0 0x5593aa208310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:08.172 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.167+0000 7ff76a59c640 1 --2- 172.21.15.19:0/4278767805 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5593aa1f8f80 0x5593aa207dd0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7ff760010fd0 tx=0x7ff7600098f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66afdcae2cc485df server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:08.172 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.167+0000 7ff74eff5640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:04:08.173 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.167+0000 7ff74eff5640 1 -- 172.21.15.19:0/4278767805 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff760043020 con 0x5593aa1f8f80 2024-09-19T09:04:08.173 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.167+0000 7ff74eff5640 1 -- 172.21.15.19:0/4278767805 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7ff760005bc0 con 0x5593aa1f8f80 2024-09-19T09:04:08.173 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.167+0000 7ff77406f740 1 -- 172.21.15.19:0/4278767805 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff76001c070 con 0x5593aa1f8f80 2024-09-19T09:04:08.173 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.167+0000 7ff74eff5640 1 -- 172.21.15.19:0/4278767805 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7ff760017680 con 0x5593aa1f8f80 2024-09-19T09:04:08.173 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.167+0000 7ff77406f740 10 client.18618 fetch_fsmap learned FSMap version 42 2024-09-19T09:04:08.173 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.167+0000 7ff77406f740 1 -- 172.21.15.19:0/4278767805 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x5593aa279840 con 0x5593aa1f8f80 2024-09-19T09:04:08.173 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.167+0000 7ff74eff5640 1 -- 172.21.15.19:0/4278767805 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ff76001c070 con 0x5593aa1f8f80 2024-09-19T09:04:08.173 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.167+0000 7ff74eff5640 1 -- 172.21.15.19:0/4278767805 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 42) ==== 8362+0+0 (secure 0 0 0) 0x7ff7600063d0 con 0x5593aa1f8f80 2024-09-19T09:04:08.173 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.167+0000 7ff77406f740 10 client.18618 fetch_fsmap finished waiting for FSMap version 42 2024-09-19T09:04:08.173 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.167+0000 7ff77406f740 10 client.18618 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-09-19T09:04:08.173 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.167+0000 7ff77406f740 20 client.18618 populate_metadata read hostname 'smithi019' 2024-09-19T09:04:08.173 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.167+0000 7ff77406f740 1 --2- 172.21.15.19:0/4278767805 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5593aa27a0e0 0x5593aa27c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:08.173 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.167+0000 7ff77406f740 4 client.18618 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-09-19T09:04:08.174 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.167+0000 7ff77406f740 1 -- 172.21.15.19:0/4278767805 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5593aa15fd70 con 0x5593aa27a0e0 2024-09-19T09:04:08.174 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.168+0000 7ff76ad9d640 1 --2- 172.21.15.19:0/4278767805 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5593aa27a0e0 0x5593aa27c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:08.174 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.168+0000 7ff76ad9d640 1 --2- 172.21.15.19:0/4278767805 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5593aa27a0e0 0x5593aa27c500 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2307b04b0f9905b server_cookie=c2361908d275eda8 in_seq=0 out_seq=0 2024-09-19T09:04:08.174 INFO:teuthology.task.background_exec.ubuntu@smithi019.front.sepia.ceph.com.smithi019.stderr:2024-09-19T09:04:08.168+0000 7ff74eff5640 10 client.18618 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:04:08.190 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:04:08.190 INFO:tasks.workunit.client.0.smithi019.stderr:mkdir: cannot create directory ‘/home/ubuntu/cephtest/mnt.0/client.0/tmp’: Read-only file system 2024-09-19T09:04:08.191 INFO:tasks.workunit:Stopping ['fs/misc'] on client.0... 2024-09-19T09:04:08.191 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T09:04:08.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:07 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3997252709' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "foo.212660", "pool2": "foo.212660", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:04:08.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:07 smithi203 ceph-mon[35450]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T09:04:08.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:07 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3997252709' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "foo.212660", "pool2": "foo.212660", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:04:08.254 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:07 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3997252709' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "foo.212660", "pool2": "foo.212660", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:04:08.254 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:07 smithi019 ceph-mon[30976]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T09:04:08.254 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:07 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3997252709' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "foo.212660", "pool2": "foo.212660", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:04:08.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:07 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3997252709' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "foo.212660", "pool2": "foo.212660", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:04:08.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:07 smithi155 ceph-mon[34921]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T09:04:08.424 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:07 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3997252709' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "foo.212660", "pool2": "foo.212660", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:04:08.424 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 09:04:08 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-b[65837]: 2024-09-19T09:04:08.185+0000 7faf399c8640 -1 log_channel(cluster) log [ERR] : failed to store backtrace on ino 0x1000000c565 object, pool 2, errno -2 2024-09-19T09:04:08.424 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 09:04:08 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-b[65837]: 2024-09-19T09:04:08.185+0000 7faf399c8640 -1 mds.0.14 unhandled write error (2) No such file or directory, force readonly... 2024-09-19T09:04:08.424 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 09:04:08 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-b[65837]: 2024-09-19T09:04:08.186+0000 7faf399c8640 -1 log_channel(cluster) log [ERR] : failed to store backtrace on ino 0x1000000c56f object, pool 2, errno -2 2024-09-19T09:04:08.424 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 09:04:08 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-b[65837]: 2024-09-19T09:04:08.186+0000 7faf399c8640 -1 mds.0.14 unhandled write error (2) No such file or directory, force readonly... 2024-09-19T09:04:08.424 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 09:04:08 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-b[65837]: 2024-09-19T09:04:08.186+0000 7faf399c8640 -1 log_channel(cluster) log [ERR] : failed to store backtrace on ino 0x1000000c574 object, pool 2, errno -2 2024-09-19T09:04:08.424 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 09:04:08 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-b[65837]: 2024-09-19T09:04:08.186+0000 7faf399c8640 -1 mds.0.14 unhandled write error (2) No such file or directory, force readonly... 2024-09-19T09:04:08.425 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 09:04:08 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-b[65837]: 2024-09-19T09:04:08.187+0000 7faf399c8640 -1 mds.0.14 unhandled write error (2) No such file or directory, force readonly... 2024-09-19T09:04:08.551 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:04:08.857 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:09.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:08 smithi203 ceph-mon[35450]: failed to store backtrace on ino 0x1000000c565 object, pool 2, errno -2 2024-09-19T09:04:09.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:08 smithi203 ceph-mon[35450]: force file system read-only 2024-09-19T09:04:09.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:08 smithi203 ceph-mon[35450]: failed to store backtrace on ino 0x1000000c56f object, pool 2, errno -2 2024-09-19T09:04:09.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:08 smithi203 ceph-mon[35450]: failed to store backtrace on ino 0x1000000c574 object, pool 2, errno -2 2024-09-19T09:04:09.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:08 smithi203 ceph-mon[35450]: pgmap v701: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 19 op/s 2024-09-19T09:04:09.293 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:08 smithi019 ceph-mon[30976]: failed to store backtrace on ino 0x1000000c565 object, pool 2, errno -2 2024-09-19T09:04:09.293 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:08 smithi019 ceph-mon[30976]: force file system read-only 2024-09-19T09:04:09.293 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:08 smithi019 ceph-mon[30976]: failed to store backtrace on ino 0x1000000c56f object, pool 2, errno -2 2024-09-19T09:04:09.293 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:08 smithi019 ceph-mon[30976]: failed to store backtrace on ino 0x1000000c574 object, pool 2, errno -2 2024-09-19T09:04:09.293 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:08 smithi019 ceph-mon[30976]: pgmap v701: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 19 op/s 2024-09-19T09:04:09.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.377+0000 7ffb2e561640 1 -- 172.21.15.19:0/321053798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb28100e20 msgr2=0x7ffb28101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:09.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.377+0000 7ffb2e561640 1 --2- 172.21.15.19:0/321053798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb28100e20 0x7ffb28101200 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7ffb18009900 tx=0x7ffb1802a480 comp rx=0 tx=0).stop 2024-09-19T09:04:09.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.377+0000 7ffb2e561640 1 -- 172.21.15.19:0/321053798 shutdown_connections 2024-09-19T09:04:09.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.377+0000 7ffb2e561640 1 --2- 172.21.15.19:0/321053798 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffb28102570 0x7ffb281029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.377+0000 7ffb2e561640 1 --2- 172.21.15.19:0/321053798 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb28102ef0 0x7ffb2810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.377+0000 7ffb2e561640 1 --2- 172.21.15.19:0/321053798 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb28100e20 0x7ffb28101200 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.377+0000 7ffb2e561640 1 -- 172.21.15.19:0/321053798 >> 172.21.15.19:0/321053798 conn(0x7ffb280fc7d0 msgr2=0x7ffb280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:09.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.377+0000 7ffb2e561640 1 -- 172.21.15.19:0/321053798 shutdown_connections 2024-09-19T09:04:09.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.377+0000 7ffb2e561640 1 -- 172.21.15.19:0/321053798 wait complete. 2024-09-19T09:04:09.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.377+0000 7ffb2e561640 1 Processor -- start 2024-09-19T09:04:09.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.378+0000 7ffb2e561640 1 -- start start 2024-09-19T09:04:09.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.378+0000 7ffb2e561640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb28100e20 0x7ffb280fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:09.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.378+0000 7ffb2e561640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffb28102570 0x7ffb280fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:09.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.378+0000 7ffb2e561640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb28102ef0 0x7ffb280fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:09.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.378+0000 7ffb2e561640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ffb28110fa0 con 0x7ffb28102ef0 2024-09-19T09:04:09.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.378+0000 7ffb2e561640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ffb28110e20 con 0x7ffb28100e20 2024-09-19T09:04:09.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.378+0000 7ffb2e561640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ffb28111120 con 0x7ffb28102570 2024-09-19T09:04:09.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.378+0000 7ffb2cafe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb28102ef0 0x7ffb280fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:09.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.378+0000 7ffb2cafe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb28102ef0 0x7ffb280fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45534/0 (socket says 172.21.15.19:45534) 2024-09-19T09:04:09.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.378+0000 7ffb2cafe640 1 -- 172.21.15.19:0/312779463 learned_addr learned my addr 172.21.15.19:0/312779463 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:09.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.378+0000 7ffb27fff640 1 --2- 172.21.15.19:0/312779463 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb28100e20 0x7ffb280fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:09.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.378+0000 7ffb1ffff640 1 --2- 172.21.15.19:0/312779463 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffb28102570 0x7ffb280fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:09.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.378+0000 7ffb2cafe640 1 -- 172.21.15.19:0/312779463 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffb28102570 msgr2=0x7ffb280fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:09.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.378+0000 7ffb2cafe640 1 --2- 172.21.15.19:0/312779463 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffb28102570 0x7ffb280fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.378+0000 7ffb2cafe640 1 -- 172.21.15.19:0/312779463 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb28100e20 msgr2=0x7ffb280fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:09.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.378+0000 7ffb2cafe640 1 --2- 172.21.15.19:0/312779463 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb28100e20 0x7ffb280fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.378+0000 7ffb2cafe640 1 -- 172.21.15.19:0/312779463 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb281a6990 con 0x7ffb28102ef0 2024-09-19T09:04:09.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.379+0000 7ffb2cafe640 1 --2- 172.21.15.19:0/312779463 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb28102ef0 0x7ffb280fd700 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7ffb2000b970 tx=0x7ffb2000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:09.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.379+0000 7ffb25ffb640 1 -- 172.21.15.19:0/312779463 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb20019070 con 0x7ffb28102ef0 2024-09-19T09:04:09.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.379+0000 7ffb25ffb640 1 -- 172.21.15.19:0/312779463 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb2000cb40 con 0x7ffb28102ef0 2024-09-19T09:04:09.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.379+0000 7ffb25ffb640 1 -- 172.21.15.19:0/312779463 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb20007650 con 0x7ffb28102ef0 2024-09-19T09:04:09.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.379+0000 7ffb2e561640 1 -- 172.21.15.19:0/312779463 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb281a6c80 con 0x7ffb28102ef0 2024-09-19T09:04:09.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.379+0000 7ffb2e561640 1 -- 172.21.15.19:0/312779463 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb281a71c0 con 0x7ffb28102ef0 2024-09-19T09:04:09.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.381+0000 7ffb25ffb640 1 -- 172.21.15.19:0/312779463 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7ffb2001c070 con 0x7ffb28102ef0 2024-09-19T09:04:09.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.382+0000 7ffb3093a740 1 Processor -- start 2024-09-19T09:04:09.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.382+0000 7ffb3093a740 1 -- start start 2024-09-19T09:04:09.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.382+0000 7ffb3093a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56399fdb8b40 0x56399fdb7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:09.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.382+0000 7ffb3093a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56399fdb75d0 0x56399fdb7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:09.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.382+0000 7ffb3093a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56399fdc2370 0x56399fdc4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:09.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.382+0000 7ffb3093a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56399fd1d2f0 con 0x56399fdb75d0 2024-09-19T09:04:09.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.382+0000 7ffb3093a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56399fcc4cf0 con 0x56399fdc2370 2024-09-19T09:04:09.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.382+0000 7ffb3093a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56399fd192b0 con 0x56399fdb8b40 2024-09-19T09:04:09.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.382+0000 7ffb27fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56399fdb75d0 0x56399fdb7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:09.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.382+0000 7ffb27fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56399fdb75d0 0x56399fdb7a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45538/0 (socket says 172.21.15.19:45538) 2024-09-19T09:04:09.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.382+0000 7ffb27fff640 1 -- 172.21.15.19:0/622299647 learned_addr learned my addr 172.21.15.19:0/622299647 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:09.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.382+0000 7ffb1ffff640 1 --2- 172.21.15.19:0/622299647 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56399fdb8b40 0x56399fdb7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:09.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.382+0000 7ffb25ffb640 1 --2- 172.21.15.19:0/312779463 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ffb140a32c0 0x7ffb140a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:09.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.382+0000 7ffb1ffff640 1 --2- 172.21.15.19:0/622299647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56399fdc2370 0x56399fdc4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:09.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.382+0000 7ffb27fff640 1 -- 172.21.15.19:0/622299647 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56399fdb8b40 msgr2=0x56399fdb7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:09.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.382+0000 7ffb27fff640 1 --2- 172.21.15.19:0/622299647 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56399fdb8b40 0x56399fdb7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.382+0000 7ffb27fff640 1 -- 172.21.15.19:0/622299647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56399fdc2370 msgr2=0x56399fdc4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:09.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.382+0000 7ffb27fff640 1 --2- 172.21.15.19:0/622299647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56399fdc2370 0x56399fdc4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.382+0000 7ffb27fff640 1 -- 172.21.15.19:0/622299647 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56399fca93a0 con 0x56399fdb75d0 2024-09-19T09:04:09.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.382+0000 7ffb2cafe640 1 --2- 172.21.15.19:0/312779463 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ffb140a32c0 0x7ffb140a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:09.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.383+0000 7ffb25ffb640 1 -- 172.21.15.19:0/312779463 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7ffb200cee50 con 0x7ffb28102ef0 2024-09-19T09:04:09.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.383+0000 7ffb27fff640 1 --2- 172.21.15.19:0/622299647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56399fdb75d0 0x56399fdb7a10 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7ffb18009900 tx=0x7ffb18004200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d499e72a35d05f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:09.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.383+0000 7ffb1e7fc640 1 -- 172.21.15.19:0/622299647 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb18035030 con 0x56399fdb75d0 2024-09-19T09:04:09.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.383+0000 7ffb1e7fc640 1 -- 172.21.15.19:0/622299647 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb18040070 con 0x56399fdb75d0 2024-09-19T09:04:09.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.383+0000 7ffb1e7fc640 1 -- 172.21.15.19:0/622299647 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb18031ba0 con 0x56399fdb75d0 2024-09-19T09:04:09.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.384+0000 7ffb3093a740 1 -- 172.21.15.19:0/622299647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56399fdb75d0 msgr2=0x56399fdb7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:09.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.384+0000 7ffb2cafe640 1 --2- 172.21.15.19:0/312779463 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ffb140a32c0 0x7ffb140a5780 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ffb2009b230 tx=0x7ffb2000e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:09.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.384+0000 7ffb3093a740 1 --2- 172.21.15.19:0/622299647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56399fdb75d0 0x56399fdb7a10 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7ffb18009900 tx=0x7ffb18004200 comp rx=0 tx=0).stop 2024-09-19T09:04:09.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.384+0000 7ffb3093a740 1 -- 172.21.15.19:0/622299647 shutdown_connections 2024-09-19T09:04:09.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.384+0000 7ffb3093a740 1 --2- 172.21.15.19:0/622299647 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56399fdc2370 0x56399fdc4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.384+0000 7ffb3093a740 1 --2- 172.21.15.19:0/622299647 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56399fdb75d0 0x56399fdb7a10 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.384+0000 7ffb3093a740 1 --2- 172.21.15.19:0/622299647 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56399fdb8b40 0x56399fdb7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.384+0000 7ffb3093a740 1 -- 172.21.15.19:0/622299647 >> 172.21.15.19:0/622299647 conn(0x56399fd80310 msgr2=0x56399fdb3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:09.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.384+0000 7ffb3093a740 1 -- 172.21.15.19:0/622299647 shutdown_connections 2024-09-19T09:04:09.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.384+0000 7ffb3093a740 1 -- 172.21.15.19:0/622299647 wait complete. 2024-09-19T09:04:09.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.384+0000 7ffb3093a740 1 -- start start 2024-09-19T09:04:09.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.384+0000 7ffb3093a740 1 Processor -- start 2024-09-19T09:04:09.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.385+0000 7ffb3093a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56399fdb75d0 0x56399fdc1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:09.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.385+0000 7ffb3093a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56399fdb8b40 0x56399fdbf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:09.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.385+0000 7ffb3093a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56399fdc2370 0x56399fdbf610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:09.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.385+0000 7ffb3093a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56399fdc5010 con 0x56399fdc2370 2024-09-19T09:04:09.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.385+0000 7ffb3093a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56399fcd8060 con 0x56399fdb75d0 2024-09-19T09:04:09.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.385+0000 7ffb3093a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56399fdc5190 con 0x56399fdb8b40 2024-09-19T09:04:09.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.385+0000 7ffb3093a740 10 client.0 _ll_register_callbacks cb 0x56399fa2b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:09.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.385+0000 7ffb1ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56399fdc2370 0x56399fdbf610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:09.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.385+0000 7ffb1ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56399fdc2370 0x56399fdbf610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45550/0 (socket says 172.21.15.19:45550) 2024-09-19T09:04:09.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.385+0000 7ffb1ffff640 1 -- 172.21.15.19:0/3687738856 learned_addr learned my addr 172.21.15.19:0/3687738856 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:09.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.385+0000 7ffb27fff640 1 --2- 172.21.15.19:0/3687738856 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56399fdb8b40 0x56399fdbf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:09.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.385+0000 7ffb1ffff640 1 --2- 172.21.15.19:0/3687738856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56399fdb75d0 0x56399fdc1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:09.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.385+0000 7ffb1ffff640 1 -- 172.21.15.19:0/3687738856 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56399fdb8b40 msgr2=0x56399fdbf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:09.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.385+0000 7ffb1ffff640 1 --2- 172.21.15.19:0/3687738856 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56399fdb8b40 0x56399fdbf020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.385+0000 7ffb1ffff640 1 -- 172.21.15.19:0/3687738856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56399fdb75d0 msgr2=0x56399fdc1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:09.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.385+0000 7ffb1ffff640 1 --2- 172.21.15.19:0/3687738856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56399fdb75d0 0x56399fdc1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.385+0000 7ffb1ffff640 1 -- 172.21.15.19:0/3687738856 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56399fa8e3c0 con 0x56399fdc2370 2024-09-19T09:04:09.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.385+0000 7ffb1ffff640 1 --2- 172.21.15.19:0/3687738856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56399fdc2370 0x56399fdbf610 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7ffb1000ef80 tx=0x7ffb1000ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c501d008e34c59 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:09.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.385+0000 7ffb077fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:04:09.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.385+0000 7ffb077fe640 1 -- 172.21.15.19:0/3687738856 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1000de50 con 0x56399fdc2370 2024-09-19T09:04:09.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.385+0000 7ffb077fe640 1 -- 172.21.15.19:0/3687738856 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7ffb10010640 con 0x56399fdc2370 2024-09-19T09:04:09.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.385+0000 7ffb3093a740 1 -- 172.21.15.19:0/3687738856 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb18040070 con 0x56399fdc2370 2024-09-19T09:04:09.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.386+0000 7ffb077fe640 1 -- 172.21.15.19:0/3687738856 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7ffb10010840 con 0x56399fdc2370 2024-09-19T09:04:09.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.386+0000 7ffb3093a740 10 client.18630 fetch_fsmap learned FSMap version 42 2024-09-19T09:04:09.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.386+0000 7ffb3093a740 1 -- 172.21.15.19:0/3687738856 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x56399fdd0b40 con 0x56399fdc2370 2024-09-19T09:04:09.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.386+0000 7ffb077fe640 1 -- 172.21.15.19:0/3687738856 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb18040070 con 0x56399fdc2370 2024-09-19T09:04:09.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.386+0000 7ffb077fe640 1 -- 172.21.15.19:0/3687738856 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 42) ==== 8362+0+0 (secure 0 0 0) 0x7ffb1001ebb0 con 0x56399fdc2370 2024-09-19T09:04:09.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.386+0000 7ffb3093a740 10 client.18630 fetch_fsmap finished waiting for FSMap version 42 2024-09-19T09:04:09.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.386+0000 7ffb3093a740 10 client.18630 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:04:09.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.386+0000 7ffb3093a740 20 client.18630 populate_metadata read hostname 'smithi019' 2024-09-19T09:04:09.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.386+0000 7ffb3093a740 1 --2- 172.21.15.19:0/3687738856 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56399fdd1f50 0x56399fdd43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:09.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.386+0000 7ffb3093a740 4 client.18630 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:09.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.386+0000 7ffb3093a740 1 -- 172.21.15.19:0/3687738856 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56399fd2a860 con 0x56399fdd1f50 2024-09-19T09:04:09.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.386+0000 7ffb27fff640 1 --2- 172.21.15.19:0/3687738856 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56399fdd1f50 0x56399fdd43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:09.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.387+0000 7ffb27fff640 1 --2- 172.21.15.19:0/3687738856 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56399fdd1f50 0x56399fdd43b0 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f48ea783b0f8c526 server_cookie=185338ac1e0ec052 in_seq=0 out_seq=0 2024-09-19T09:04:09.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.387+0000 7ffb077fe640 10 client.18630 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:04:09.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.387+0000 7ffb077fe640 1 -- 172.21.15.19:0/3687738856 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56399fd2a860 con 0x56399fdd1f50 2024-09-19T09:04:09.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.387+0000 7ffb077fe640 10 client.18630 handle_command_reply: tid=0 2024-09-19T09:04:09.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.388+0000 7ffb3093a740 1 client.18630 shutdown 2024-09-19T09:04:09.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.388+0000 7ffb3093a740 1 -- 172.21.15.19:0/3687738856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56399fdc2370 msgr2=0x56399fdbf610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:09.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.388+0000 7ffb3093a740 1 --2- 172.21.15.19:0/3687738856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56399fdc2370 0x56399fdbf610 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7ffb1000ef80 tx=0x7ffb1000ea10 comp rx=0 tx=0).stop 2024-09-19T09:04:09.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.388+0000 7ffb3093a740 1 -- 172.21.15.19:0/3687738856 shutdown_connections 2024-09-19T09:04:09.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.388+0000 7ffb3093a740 1 --2- 172.21.15.19:0/3687738856 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56399fdd1f50 0x56399fdd43b0 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.388+0000 7ffb3093a740 1 --2- 172.21.15.19:0/3687738856 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56399fdb8b40 0x56399fdbf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.388+0000 7ffb3093a740 1 --2- 172.21.15.19:0/3687738856 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56399fdc2370 0x56399fdbf610 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.388+0000 7ffb3093a740 1 --2- 172.21.15.19:0/3687738856 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56399fdb75d0 0x56399fdc1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.388+0000 7ffb077fe640 0 client.18630 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:04:09.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.388+0000 7ffb3093a740 1 -- 172.21.15.19:0/3687738856 >> 172.21.15.19:0/3687738856 conn(0x56399fd80310 msgr2=0x56399fdb9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:09.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.388+0000 7ffb3093a740 1 -- 172.21.15.19:0/3687738856 shutdown_connections 2024-09-19T09:04:09.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.388+0000 7ffb3093a740 1 -- 172.21.15.19:0/3687738856 wait complete. 2024-09-19T09:04:09.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.388+0000 7ffb3093a740 20 client.18630 trim_cache size 0 max 16384 2024-09-19T09:04:09.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.401+0000 7ffb3093a740 1 Processor -- start 2024-09-19T09:04:09.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.401+0000 7ffb3093a740 1 -- start start 2024-09-19T09:04:09.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.401+0000 7ffb3093a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56399fdb75d0 0x56399fdc0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:09.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.401+0000 7ffb3093a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56399fdb8b40 0x56399fdba120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:09.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.401+0000 7ffb3093a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56399fdc2370 0x56399fdba660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:09.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.401+0000 7ffb3093a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ffb281af740 con 0x56399fdb8b40 2024-09-19T09:04:09.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.401+0000 7ffb3093a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ffb281b1280 con 0x56399fdb75d0 2024-09-19T09:04:09.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.401+0000 7ffb3093a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ffb281afe10 con 0x56399fdc2370 2024-09-19T09:04:09.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.401+0000 7ffb27fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56399fdb8b40 0x56399fdba120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:09.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.401+0000 7ffb27fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56399fdb8b40 0x56399fdba120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45556/0 (socket says 172.21.15.19:45556) 2024-09-19T09:04:09.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.401+0000 7ffb27fff640 1 -- 172.21.15.19:0/2512096285 learned_addr learned my addr 172.21.15.19:0/2512096285 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:09.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.402+0000 7ffb1ffff640 1 --2- 172.21.15.19:0/2512096285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56399fdc2370 0x56399fdba660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:09.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.402+0000 7ffb1ffff640 1 --2- 172.21.15.19:0/2512096285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56399fdb75d0 0x56399fdc0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:09.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.402+0000 7ffb27fff640 1 -- 172.21.15.19:0/2512096285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56399fdc2370 msgr2=0x56399fdba660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:09.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.402+0000 7ffb27fff640 1 --2- 172.21.15.19:0/2512096285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56399fdc2370 0x56399fdba660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.402+0000 7ffb27fff640 1 -- 172.21.15.19:0/2512096285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56399fdb75d0 msgr2=0x56399fdc0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:09.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.402+0000 7ffb27fff640 1 --2- 172.21.15.19:0/2512096285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56399fdb75d0 0x56399fdc0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.402+0000 7ffb27fff640 1 -- 172.21.15.19:0/2512096285 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56399fdbd570 con 0x56399fdb8b40 2024-09-19T09:04:09.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.402+0000 7ffb1ffff640 1 --2- 172.21.15.19:0/2512096285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56399fdb75d0 0x56399fdc0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:09.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.402+0000 7ffb27fff640 1 --2- 172.21.15.19:0/2512096285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56399fdb8b40 0x56399fdba120 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7ffb18009900 tx=0x7ffb180316e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e347c1ab6bbfae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:09.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.402+0000 7ffb1dffb640 1 -- 172.21.15.19:0/2512096285 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb18035040 con 0x56399fdb8b40 2024-09-19T09:04:09.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.402+0000 7ffb1dffb640 1 -- 172.21.15.19:0/2512096285 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb18040070 con 0x56399fdb8b40 2024-09-19T09:04:09.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.402+0000 7ffb1dffb640 1 -- 172.21.15.19:0/2512096285 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1804a040 con 0x56399fdb8b40 2024-09-19T09:04:09.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.403+0000 7ffb3093a740 1 -- 172.21.15.19:0/2512096285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56399fdb8b40 msgr2=0x56399fdba120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:09.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.403+0000 7ffb3093a740 1 --2- 172.21.15.19:0/2512096285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56399fdb8b40 0x56399fdba120 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7ffb18009900 tx=0x7ffb180316e0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.403+0000 7ffb3093a740 1 -- 172.21.15.19:0/2512096285 shutdown_connections 2024-09-19T09:04:09.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.403+0000 7ffb3093a740 1 --2- 172.21.15.19:0/2512096285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56399fdc2370 0x56399fdba660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.403+0000 7ffb3093a740 1 --2- 172.21.15.19:0/2512096285 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56399fdb8b40 0x56399fdba120 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.403+0000 7ffb3093a740 1 --2- 172.21.15.19:0/2512096285 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56399fdb75d0 0x56399fdc0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.403+0000 7ffb3093a740 1 -- 172.21.15.19:0/2512096285 >> 172.21.15.19:0/2512096285 conn(0x56399fd80310 msgr2=0x56399fdc0880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:09.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.403+0000 7ffb3093a740 1 -- 172.21.15.19:0/2512096285 shutdown_connections 2024-09-19T09:04:09.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.403+0000 7ffb3093a740 1 -- 172.21.15.19:0/2512096285 wait complete. 2024-09-19T09:04:09.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.403+0000 7ffb3093a740 1 -- start start 2024-09-19T09:04:09.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.404+0000 7ffb3093a740 1 Processor -- start 2024-09-19T09:04:09.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.404+0000 7ffb3093a740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56399fdb75d0 0x56399fdbbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:09.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.404+0000 7ffb3093a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56399fdb8b40 0x56399fdbc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:09.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.404+0000 7ffb3093a740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56399fdc2370 0x56399fdbc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:09.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.404+0000 7ffb3093a740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7ffb281b0bb0 con 0x56399fdb75d0 2024-09-19T09:04:09.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.404+0000 7ffb3093a740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7ffb281b04e0 con 0x56399fdc2370 2024-09-19T09:04:09.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.404+0000 7ffb3093a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ffb281ad720 con 0x56399fdb8b40 2024-09-19T09:04:09.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.404+0000 7ffb3093a740 10 client.0 _ll_register_callbacks cb 0x7ffb1000e930 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:09.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.404+0000 7ffb1ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56399fdb75d0 0x56399fdbbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:09.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.404+0000 7ffb1ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56399fdb75d0 0x56399fdbbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45570/0 (socket says 172.21.15.19:45570) 2024-09-19T09:04:09.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.404+0000 7ffb1ffff640 1 -- 172.21.15.19:0/1648254783 learned_addr learned my addr 172.21.15.19:0/1648254783 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:09.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.404+0000 7ffb27fff640 1 --2- 172.21.15.19:0/1648254783 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56399fdb8b40 0x56399fdbc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:09.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.404+0000 7ffb1ffff640 1 --2- 172.21.15.19:0/1648254783 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56399fdc2370 0x56399fdbc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:09.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.404+0000 7ffb1ffff640 1 -- 172.21.15.19:0/1648254783 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56399fdb8b40 msgr2=0x56399fdbc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:09.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.404+0000 7ffb1ffff640 1 --2- 172.21.15.19:0/1648254783 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56399fdb8b40 0x56399fdbc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.404+0000 7ffb1ffff640 1 -- 172.21.15.19:0/1648254783 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56399fdc2370 msgr2=0x56399fdbc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.404+0000 7ffb1ffff640 1 --2- 172.21.15.19:0/1648254783 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56399fdc2370 0x56399fdbc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.404+0000 7ffb1ffff640 1 -- 172.21.15.19:0/1648254783 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56399fe3bc50 con 0x56399fdb75d0 2024-09-19T09:04:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.405+0000 7ffb1ffff640 1 --2- 172.21.15.19:0/1648254783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56399fdb75d0 0x56399fdbbf60 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7ffb1000e010 tx=0x7ffb1000efb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eac3b85003fab27 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.405+0000 7ffb077fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:04:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.405+0000 7ffb077fe640 1 -- 172.21.15.19:0/1648254783 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1000de50 con 0x56399fdb75d0 2024-09-19T09:04:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.405+0000 7ffb077fe640 1 -- 172.21.15.19:0/1648254783 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7ffb10010640 con 0x56399fdb75d0 2024-09-19T09:04:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.405+0000 7ffb3093a740 1 -- 172.21.15.19:0/1648254783 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb18040070 con 0x56399fdb75d0 2024-09-19T09:04:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.405+0000 7ffb077fe640 1 -- 172.21.15.19:0/1648254783 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7ffb1001d610 con 0x56399fdb75d0 2024-09-19T09:04:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.405+0000 7ffb3093a740 10 client.18636 fetch_fsmap learned FSMap version 42 2024-09-19T09:04:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.405+0000 7ffb3093a740 1 -- 172.21.15.19:0/1648254783 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x56399fe3cdc0 con 0x56399fdb75d0 2024-09-19T09:04:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.405+0000 7ffb077fe640 1 -- 172.21.15.19:0/1648254783 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7ffb18040070 con 0x56399fdb75d0 2024-09-19T09:04:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.406+0000 7ffb077fe640 1 -- 172.21.15.19:0/1648254783 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 42) ==== 8362+0+0 (secure 0 0 0) 0x7ffb10005070 con 0x56399fdb75d0 2024-09-19T09:04:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.406+0000 7ffb3093a740 10 client.18636 fetch_fsmap finished waiting for FSMap version 42 2024-09-19T09:04:09.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.406+0000 7ffb3093a740 10 client.18636 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:04:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.406+0000 7ffb3093a740 20 client.18636 populate_metadata read hostname 'smithi019' 2024-09-19T09:04:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.406+0000 7ffb3093a740 1 --2- 172.21.15.19:0/1648254783 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56399fe3d530 0x56399fe3f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.406+0000 7ffb3093a740 4 client.18636 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:04:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.406+0000 7ffb3093a740 1 -- 172.21.15.19:0/1648254783 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56399fd24d70 con 0x56399fe3d530 2024-09-19T09:04:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.406+0000 7ffb27fff640 1 --2- 172.21.15.19:0/1648254783 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56399fe3d530 0x56399fe3f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.406+0000 7ffb27fff640 1 --2- 172.21.15.19:0/1648254783 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56399fe3d530 0x56399fe3f950 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bb8f9940b313ba5 server_cookie=ce4fc287739cf5c8 in_seq=0 out_seq=0 2024-09-19T09:04:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.406+0000 7ffb077fe640 10 client.18636 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:04:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.407+0000 7ffb077fe640 1 -- 172.21.15.19:0/1648254783 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56399fd24d70 con 0x56399fe3d530 2024-09-19T09:04:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.407+0000 7ffb077fe640 10 client.18636 handle_command_reply: tid=0 2024-09-19T09:04:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.407+0000 7ffb3093a740 1 client.18636 shutdown 2024-09-19T09:04:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.407+0000 7ffb3093a740 1 -- 172.21.15.19:0/1648254783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56399fdb75d0 msgr2=0x56399fdbbf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.407+0000 7ffb3093a740 1 --2- 172.21.15.19:0/1648254783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56399fdb75d0 0x56399fdbbf60 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7ffb1000e010 tx=0x7ffb1000efb0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.407+0000 7ffb3093a740 1 -- 172.21.15.19:0/1648254783 shutdown_connections 2024-09-19T09:04:09.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.407+0000 7ffb3093a740 1 --2- 172.21.15.19:0/1648254783 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56399fe3d530 0x56399fe3f950 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.407+0000 7ffb3093a740 1 --2- 172.21.15.19:0/1648254783 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56399fdb8b40 0x56399fdbc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.407+0000 7ffb3093a740 1 --2- 172.21.15.19:0/1648254783 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56399fdc2370 0x56399fdbc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.407+0000 7ffb3093a740 1 --2- 172.21.15.19:0/1648254783 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56399fdb75d0 0x56399fdbbf60 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.407+0000 7ffb077fe640 0 client.18636 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:04:09.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.407+0000 7ffb3093a740 1 -- 172.21.15.19:0/1648254783 >> 172.21.15.19:0/1648254783 conn(0x56399fd80310 msgr2=0x56399fdc10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:09.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.407+0000 7ffb3093a740 1 -- 172.21.15.19:0/1648254783 shutdown_connections 2024-09-19T09:04:09.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.407+0000 7ffb3093a740 1 -- 172.21.15.19:0/1648254783 wait complete. 2024-09-19T09:04:09.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.407+0000 7ffb3093a740 20 client.18636 trim_cache size 0 max 16384 2024-09-19T09:04:09.423 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:04:09.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.408+0000 7ffb2e561640 1 -- 172.21.15.19:0/312779463 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ffb140a32c0 msgr2=0x7ffb140a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:09.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.408+0000 7ffb2e561640 1 --2- 172.21.15.19:0/312779463 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ffb140a32c0 0x7ffb140a5780 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ffb2009b230 tx=0x7ffb2000e040 comp rx=0 tx=0).stop 2024-09-19T09:04:09.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.408+0000 7ffb2e561640 1 -- 172.21.15.19:0/312779463 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb28102ef0 msgr2=0x7ffb280fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:09.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.408+0000 7ffb2e561640 1 --2- 172.21.15.19:0/312779463 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb28102ef0 0x7ffb280fd700 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7ffb2000b970 tx=0x7ffb2000be30 comp rx=0 tx=0).stop 2024-09-19T09:04:09.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.408+0000 7ffb2e561640 1 -- 172.21.15.19:0/312779463 shutdown_connections 2024-09-19T09:04:09.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.408+0000 7ffb2e561640 1 --2- 172.21.15.19:0/312779463 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7ffb140a32c0 0x7ffb140a5780 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.408+0000 7ffb2e561640 1 --2- 172.21.15.19:0/312779463 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffb28102570 0x7ffb280fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.408+0000 7ffb2e561640 1 --2- 172.21.15.19:0/312779463 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7ffb28102ef0 0x7ffb280fd700 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.408+0000 7ffb2e561640 1 --2- 172.21.15.19:0/312779463 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7ffb28100e20 0x7ffb280fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:09.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.408+0000 7ffb2e561640 1 -- 172.21.15.19:0/312779463 >> 172.21.15.19:0/312779463 conn(0x7ffb280fc7d0 msgr2=0x7ffb2806a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:09.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.408+0000 7ffb2e561640 1 -- 172.21.15.19:0/312779463 shutdown_connections 2024-09-19T09:04:09.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:09.408+0000 7ffb2e561640 1 -- 172.21.15.19:0/312779463 wait complete. 2024-09-19T09:04:09.424 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:08 smithi155 ceph-mon[34921]: failed to store backtrace on ino 0x1000000c565 object, pool 2, errno -2 2024-09-19T09:04:09.424 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:08 smithi155 ceph-mon[34921]: force file system read-only 2024-09-19T09:04:09.425 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:08 smithi155 ceph-mon[34921]: failed to store backtrace on ino 0x1000000c56f object, pool 2, errno -2 2024-09-19T09:04:09.425 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:08 smithi155 ceph-mon[34921]: failed to store backtrace on ino 0x1000000c574 object, pool 2, errno -2 2024-09-19T09:04:09.425 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:08 smithi155 ceph-mon[34921]: pgmap v701: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 40 KiB/s wr, 19 op/s 2024-09-19T09:04:10.387 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/workunit.py", line 293, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi019 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/multiple_rsync.sh' 2024-09-19T09:04:12.023 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=63cbd47baf114be3aa4aee6c2e8152cf Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/workunit.py", line 293, in _spawn_on_all_clients with parallel() as p: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi019 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/multiple_rsync.sh' 2024-09-19T09:04:12.026 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-19T09:04:12.037 INFO:tasks.quiescer:joining Quiescers 2024-09-19T09:04:12.038 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-19T09:04:12.038 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:04:12.043 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T09:04:12.043 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T09:04:12.044 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:11 smithi203 ceph-mon[35450]: pgmap v702: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 35 KiB/s wr, 18 op/s 2024-09-19T09:04:12.044 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:11 smithi155 ceph-mon[34921]: pgmap v702: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 35 KiB/s wr, 18 op/s 2024-09-19T09:04:12.044 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:11 smithi019 ceph-mon[30976]: pgmap v702: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 35 KiB/s wr, 18 op/s 2024-09-19T09:04:12.325 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:12.330 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:13.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.800+0000 7f8e533ac640 1 -- 172.21.15.19:0/628990022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e4c10e480 msgr2=0x7f8e4c110870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:13.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.800+0000 7f8e533ac640 1 --2- 172.21.15.19:0/628990022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e4c10e480 0x7f8e4c110870 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f8e44009ca0 tx=0x7f8e4402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.800+0000 7f8e533ac640 1 -- 172.21.15.19:0/628990022 shutdown_connections 2024-09-19T09:04:13.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.800+0000 7f8e533ac640 1 --2- 172.21.15.19:0/628990022 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e4c10e480 0x7f8e4c110870 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.800+0000 7f8e533ac640 1 --2- 172.21.15.19:0/628990022 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e4c101280 0x7f8e4c10df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.800+0000 7f8e533ac640 1 --2- 172.21.15.19:0/628990022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8e4c1008d0 0x7f8e4c100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.800+0000 7f8e533ac640 1 -- 172.21.15.19:0/628990022 >> 172.21.15.19:0/628990022 conn(0x7f8e4c0fc7a0 msgr2=0x7f8e4c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:13.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.801+0000 7f8e533ac640 1 -- 172.21.15.19:0/628990022 shutdown_connections 2024-09-19T09:04:13.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.801+0000 7f8e533ac640 1 -- 172.21.15.19:0/628990022 wait complete. 2024-09-19T09:04:13.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.801+0000 7f8e533ac640 1 Processor -- start 2024-09-19T09:04:13.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.801+0000 7f8e533ac640 1 -- start start 2024-09-19T09:04:13.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.801+0000 7f8e533ac640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8e4c1008d0 0x7f8e4c19a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:13.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.801+0000 7f8e533ac640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e4c101280 0x7f8e4c19ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:13.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.801+0000 7f8e533ac640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e4c10e480 0x7f8e4c19efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:13.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.801+0000 7f8e533ac640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4c1141e0 con 0x7f8e4c10e480 2024-09-19T09:04:13.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.801+0000 7f8e533ac640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4c114060 con 0x7f8e4c101280 2024-09-19T09:04:13.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.801+0000 7f8e533ac640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4c114360 con 0x7f8e4c1008d0 2024-09-19T09:04:13.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.802+0000 7f8e51949640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e4c10e480 0x7f8e4c19efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:13.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.802+0000 7f8e51949640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e4c10e480 0x7f8e4c19efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45582/0 (socket says 172.21.15.19:45582) 2024-09-19T09:04:13.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.802+0000 7f8e51949640 1 -- 172.21.15.19:0/3644578490 learned_addr learned my addr 172.21.15.19:0/3644578490 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:13.084 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T09:04:13.084 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":42,"btime":"2024-09-19T09:04:05:938661+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":17751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/3815927080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":3815927080},{"type":"v1","addr":"172.21.15.19:6839","nonce":3815927080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T09:04:05.084913+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26453":{"gid":26453,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/3907362737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3907362737},{"type":"v1","addr":"172.21.15.155:6835","nonce":3907362737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24463,24464,24490,24469,24497]},"id":1}]} 2024-09-19T09:04:13.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.802+0000 7f8e50947640 1 --2- 172.21.15.19:0/3644578490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e4c101280 0x7f8e4c19ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:13.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.802+0000 7f8e51148640 1 --2- 172.21.15.19:0/3644578490 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8e4c1008d0 0x7f8e4c19a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:13.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.802+0000 7f8e51949640 1 -- 172.21.15.19:0/3644578490 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8e4c1008d0 msgr2=0x7f8e4c19a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:13.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.802+0000 7f8e51949640 1 --2- 172.21.15.19:0/3644578490 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8e4c1008d0 0x7f8e4c19a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.802+0000 7f8e51949640 1 -- 172.21.15.19:0/3644578490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e4c101280 msgr2=0x7f8e4c19ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:13.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.802+0000 7f8e51949640 1 --2- 172.21.15.19:0/3644578490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e4c101280 0x7f8e4c19ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.802+0000 7f8e51949640 1 -- 172.21.15.19:0/3644578490 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e4c19f690 con 0x7f8e4c10e480 2024-09-19T09:04:13.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.802+0000 7f8e51949640 1 --2- 172.21.15.19:0/3644578490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e4c10e480 0x7f8e4c19efb0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f8e4402ade0 tx=0x7f8e440319f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:13.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.802+0000 7f8e427fc640 1 -- 172.21.15.19:0/3644578490 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e44003b70 con 0x7f8e4c10e480 2024-09-19T09:04:13.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.802+0000 7f8e427fc640 1 -- 172.21.15.19:0/3644578490 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8e44003d10 con 0x7f8e4c10e480 2024-09-19T09:04:13.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.802+0000 7f8e427fc640 1 -- 172.21.15.19:0/3644578490 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4402fcf0 con 0x7f8e4c10e480 2024-09-19T09:04:13.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.802+0000 7f8e533ac640 1 -- 172.21.15.19:0/3644578490 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e4c19f920 con 0x7f8e4c10e480 2024-09-19T09:04:13.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.803+0000 7f8e533ac640 1 -- 172.21.15.19:0/3644578490 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e4c1a7260 con 0x7f8e4c10e480 2024-09-19T09:04:13.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.804+0000 7f8e533ac640 1 -- 172.21.15.19:0/3644578490 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e4c100cb0 con 0x7f8e4c10e480 2024-09-19T09:04:13.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.805+0000 7f8e427fc640 1 -- 172.21.15.19:0/3644578490 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f8e44004050 con 0x7f8e4c10e480 2024-09-19T09:04:13.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.805+0000 7f8e427fc640 1 --2- 172.21.15.19:0/3644578490 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8e380a32c0 0x7f8e380a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:13.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.805+0000 7f8e51148640 1 --2- 172.21.15.19:0/3644578490 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8e380a32c0 0x7f8e380a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:13.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.805+0000 7f8e427fc640 1 -- 172.21.15.19:0/3644578490 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f8e440f0b90 con 0x7f8e4c10e480 2024-09-19T09:04:13.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.806+0000 7f8e51148640 1 --2- 172.21.15.19:0/3644578490 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8e380a32c0 0x7f8e380a5780 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8e48005fd0 tx=0x7f8e4800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:13.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:12.809+0000 7f8e427fc640 1 -- 172.21.15.19:0/3644578490 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8e4402fe90 con 0x7f8e4c10e480 2024-09-19T09:04:13.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:13.024+0000 7f8e533ac640 1 -- 172.21.15.19:0/3644578490 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e4c109080 con 0x7f8e4c10e480 2024-09-19T09:04:13.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:13.025+0000 7f8e427fc640 1 -- 172.21.15.19:0/3644578490 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+11983 (secure 0 0 0) 0x7f8e440bda70 con 0x7f8e4c10e480 2024-09-19T09:04:13.088 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 42 2024-09-19T09:04:13.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:13.027+0000 7f8e533ac640 1 -- 172.21.15.19:0/3644578490 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8e380a32c0 msgr2=0x7f8e380a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:13.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:13.027+0000 7f8e533ac640 1 --2- 172.21.15.19:0/3644578490 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8e380a32c0 0x7f8e380a5780 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8e48005fd0 tx=0x7f8e4800b390 comp rx=0 tx=0).stop 2024-09-19T09:04:13.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:13.027+0000 7f8e533ac640 1 -- 172.21.15.19:0/3644578490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e4c10e480 msgr2=0x7f8e4c19efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:13.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:13.027+0000 7f8e533ac640 1 --2- 172.21.15.19:0/3644578490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e4c10e480 0x7f8e4c19efb0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f8e4402ade0 tx=0x7f8e440319f0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:13.027+0000 7f8e533ac640 1 -- 172.21.15.19:0/3644578490 shutdown_connections 2024-09-19T09:04:13.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:13.027+0000 7f8e533ac640 1 --2- 172.21.15.19:0/3644578490 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f8e380a32c0 0x7f8e380a5780 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:13.027+0000 7f8e533ac640 1 --2- 172.21.15.19:0/3644578490 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8e4c10e480 0x7f8e4c19efb0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:13.027+0000 7f8e533ac640 1 --2- 172.21.15.19:0/3644578490 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8e4c101280 0x7f8e4c19ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:13.027+0000 7f8e533ac640 1 --2- 172.21.15.19:0/3644578490 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8e4c1008d0 0x7f8e4c19a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:13.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:13.027+0000 7f8e533ac640 1 -- 172.21.15.19:0/3644578490 >> 172.21.15.19:0/3644578490 conn(0x7f8e4c0fc7a0 msgr2=0x7f8e4c0feb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:13.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:13.027+0000 7f8e533ac640 1 -- 172.21.15.19:0/3644578490 shutdown_connections 2024-09-19T09:04:13.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:13.027+0000 7f8e533ac640 1 -- 172.21.15.19:0/3644578490 wait complete. 2024-09-19T09:04:13.318 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:13 smithi019 ceph-mon[30976]: pgmap v703: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 34 KiB/s wr, 20 op/s 2024-09-19T09:04:13.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:13 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3644578490' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:13.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:13 smithi155 ceph-mon[34921]: pgmap v703: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 34 KiB/s wr, 20 op/s 2024-09-19T09:04:13.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:13 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3644578490' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:13.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:13 smithi203 ceph-mon[35450]: pgmap v703: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 34 KiB/s wr, 20 op/s 2024-09-19T09:04:13.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:13 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3644578490' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:13.821 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24497 quiesce db --cancel --all' 2024-09-19T09:04:13.821 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- timeout 105 ceph tell mds.24497 quiesce db --cancel --all 2024-09-19T09:04:14.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.148+0000 7f1f11b62640 1 -- 172.21.15.19:0/612301261 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f0c102790 msgr2=0x7f1f0c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:14.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.148+0000 7f1f11b62640 1 --2- 172.21.15.19:0/612301261 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f0c102790 0x7f1f0c1067e0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f1f00009900 tx=0x7f1f0002a410 comp rx=0 tx=0).stop 2024-09-19T09:04:14.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.148+0000 7f1f11b62640 1 -- 172.21.15.19:0/612301261 shutdown_connections 2024-09-19T09:04:14.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.148+0000 7f1f11b62640 1 --2- 172.21.15.19:0/612301261 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f0c106f10 0x7f1f0c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.148+0000 7f1f11b62640 1 --2- 172.21.15.19:0/612301261 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f0c102790 0x7f1f0c1067e0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.148+0000 7f1f11b62640 1 --2- 172.21.15.19:0/612301261 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1f0c101de0 0x7f1f0c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.148+0000 7f1f11b62640 1 -- 172.21.15.19:0/612301261 >> 172.21.15.19:0/612301261 conn(0x7f1f0c0fd8c0 msgr2=0x7f1f0c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:14.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.148+0000 7f1f11b62640 1 -- 172.21.15.19:0/612301261 shutdown_connections 2024-09-19T09:04:14.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.148+0000 7f1f11b62640 1 -- 172.21.15.19:0/612301261 wait complete. 2024-09-19T09:04:14.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.149+0000 7f1f11b62640 1 Processor -- start 2024-09-19T09:04:14.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.149+0000 7f1f11b62640 1 -- start start 2024-09-19T09:04:14.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.149+0000 7f1f11b62640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f0c101de0 0x7f1f0c198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:14.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.149+0000 7f1f11b62640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f0c102790 0x7f1f0c198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:14.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.149+0000 7f1f11b62640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1f0c106f10 0x7f1f0c19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:14.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.149+0000 7f1f11b62640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c111f70 con 0x7f1f0c101de0 2024-09-19T09:04:14.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.149+0000 7f1f11b62640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c111df0 con 0x7f1f0c102790 2024-09-19T09:04:14.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.149+0000 7f1f11b62640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c1120f0 con 0x7f1f0c106f10 2024-09-19T09:04:14.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.150+0000 7f1f0b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f0c101de0 0x7f1f0c198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:14.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.150+0000 7f1f0b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f0c101de0 0x7f1f0c198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45600/0 (socket says 172.21.15.19:45600) 2024-09-19T09:04:14.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.150+0000 7f1f0b7fe640 1 -- 172.21.15.19:0/3831854483 learned_addr learned my addr 172.21.15.19:0/3831854483 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:14.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.150+0000 7f1f0bfff640 1 --2- 172.21.15.19:0/3831854483 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1f0c106f10 0x7f1f0c19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:14.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.150+0000 7f1f0affd640 1 --2- 172.21.15.19:0/3831854483 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f0c102790 0x7f1f0c198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:14.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.150+0000 7f1f0b7fe640 1 -- 172.21.15.19:0/3831854483 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1f0c106f10 msgr2=0x7f1f0c19cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:14.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.150+0000 7f1f0b7fe640 1 --2- 172.21.15.19:0/3831854483 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1f0c106f10 0x7f1f0c19cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.150+0000 7f1f0b7fe640 1 -- 172.21.15.19:0/3831854483 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f0c102790 msgr2=0x7f1f0c198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:14.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.150+0000 7f1f0b7fe640 1 --2- 172.21.15.19:0/3831854483 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f0c102790 0x7f1f0c198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.150+0000 7f1f0b7fe640 1 -- 172.21.15.19:0/3831854483 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f0c19d400 con 0x7f1f0c101de0 2024-09-19T09:04:14.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.150+0000 7f1f0b7fe640 1 --2- 172.21.15.19:0/3831854483 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f0c101de0 0x7f1f0c198450 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f1efc00cce0 tx=0x7f1efc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:14.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.150+0000 7f1f08ff9640 1 -- 172.21.15.19:0/3831854483 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc004b20 con 0x7f1f0c101de0 2024-09-19T09:04:14.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.150+0000 7f1f08ff9640 1 -- 172.21.15.19:0/3831854483 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1efc004cc0 con 0x7f1f0c101de0 2024-09-19T09:04:14.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.150+0000 7f1f11b62640 1 -- 172.21.15.19:0/3831854483 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f0c19d6f0 con 0x7f1f0c101de0 2024-09-19T09:04:14.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.150+0000 7f1f08ff9640 1 -- 172.21.15.19:0/3831854483 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc00f7d0 con 0x7f1f0c101de0 2024-09-19T09:04:14.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.150+0000 7f1f11b62640 1 -- 172.21.15.19:0/3831854483 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f0c1a4fd0 con 0x7f1f0c101de0 2024-09-19T09:04:14.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.153+0000 7f1f08ff9640 1 -- 172.21.15.19:0/3831854483 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f1efc00f970 con 0x7f1f0c101de0 2024-09-19T09:04:14.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.153+0000 7f1f13f3b740 1 Processor -- start 2024-09-19T09:04:14.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.153+0000 7f1f13f3b740 1 -- start start 2024-09-19T09:04:14.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.153+0000 7f1f13f3b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f70dc7ba40 0x55f70dc7be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:14.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.153+0000 7f1f13f3b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f70dc7c360 0x55f70dc8ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:14.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.153+0000 7f1f13f3b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f70dc8b150 0x55f70dc8d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:14.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.153+0000 7f1f13f3b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f70dbe1280 con 0x55f70dc7ba40 2024-09-19T09:04:14.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.153+0000 7f1f13f3b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f70db88b10 con 0x55f70dc7c360 2024-09-19T09:04:14.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.153+0000 7f1f13f3b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f70dbdd240 con 0x55f70dc8b150 2024-09-19T09:04:14.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.153+0000 7f1f08ff9640 1 --2- 172.21.15.19:0/3831854483 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1ef40a3240 0x7f1ef40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:14.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.154+0000 7f1f0bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f70dc7ba40 0x55f70dc7be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:14.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.154+0000 7f1f0bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f70dc7ba40 0x55f70dc7be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45610/0 (socket says 172.21.15.19:45610) 2024-09-19T09:04:14.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.154+0000 7f1f0bfff640 1 -- 172.21.15.19:0/974477024 learned_addr learned my addr 172.21.15.19:0/974477024 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:14.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.154+0000 7f1f0b7fe640 1 --2- 172.21.15.19:0/974477024 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f70dc7c360 0x55f70dc8ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:14.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.154+0000 7f1f0bfff640 1 --2- 172.21.15.19:0/3831854483 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1ef40a3240 0x7f1ef40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:14.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.154+0000 7f1f08ff9640 1 -- 172.21.15.19:0/3831854483 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f1efc0cf920 con 0x7f1f0c101de0 2024-09-19T09:04:14.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.154+0000 7f1f0affd640 1 --2- 172.21.15.19:0/974477024 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f70dc8b150 0x55f70dc8d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:14.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.154+0000 7f1f0bfff640 1 -- 172.21.15.19:0/974477024 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f70dc8b150 msgr2=0x55f70dc8d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:14.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.154+0000 7f1f0bfff640 1 --2- 172.21.15.19:0/974477024 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f70dc8b150 0x55f70dc8d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.154+0000 7f1f0bfff640 1 -- 172.21.15.19:0/974477024 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f70dc7c360 msgr2=0x55f70dc8ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:14.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.154+0000 7f1f0bfff640 1 --2- 172.21.15.19:0/974477024 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f70dc7c360 0x55f70dc8ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.154+0000 7f1f0bfff640 1 -- 172.21.15.19:0/974477024 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f70db951f0 con 0x55f70dc7ba40 2024-09-19T09:04:14.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.154+0000 7f1f0affd640 1 --2- 172.21.15.19:0/974477024 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f70dc8b150 0x55f70dc8d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:14.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.154+0000 7f1f0bfff640 1 --2- 172.21.15.19:0/974477024 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f70dc7ba40 0x55f70dc7be20 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f1f040129f0 tx=0x7f1f04012eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b0e4bbb22e5414b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:14.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.154+0000 7f1f0bfff640 1 --2- 172.21.15.19:0/3831854483 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1ef40a3240 0x7f1ef40a5700 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1f04010740 tx=0x7f1f04017000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:14.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.154+0000 7f1ef1ffb640 1 -- 172.21.15.19:0/974477024 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f04024070 con 0x55f70dc7ba40 2024-09-19T09:04:14.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.154+0000 7f1ef1ffb640 1 -- 172.21.15.19:0/974477024 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f0400b9c0 con 0x55f70dc7ba40 2024-09-19T09:04:14.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.154+0000 7f1ef1ffb640 1 -- 172.21.15.19:0/974477024 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f04004cc0 con 0x55f70dc7ba40 2024-09-19T09:04:14.179 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.155+0000 7f1f13f3b740 1 -- 172.21.15.19:0/974477024 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f70dc7ba40 msgr2=0x55f70dc7be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:14.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.155+0000 7f1f13f3b740 1 --2- 172.21.15.19:0/974477024 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f70dc7ba40 0x55f70dc7be20 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f1f040129f0 tx=0x7f1f04012eb0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.155+0000 7f1f13f3b740 1 -- 172.21.15.19:0/974477024 shutdown_connections 2024-09-19T09:04:14.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.155+0000 7f1f13f3b740 1 --2- 172.21.15.19:0/974477024 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f70dc8b150 0x55f70dc8d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.155+0000 7f1f13f3b740 1 --2- 172.21.15.19:0/974477024 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f70dc7c360 0x55f70dc8ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.155+0000 7f1f13f3b740 1 --2- 172.21.15.19:0/974477024 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f70dc7ba40 0x55f70dc7be20 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.155+0000 7f1f13f3b740 1 -- 172.21.15.19:0/974477024 >> 172.21.15.19:0/974477024 conn(0x55f70dc780f0 msgr2=0x55f70dc784d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:14.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.155+0000 7f1f13f3b740 1 -- 172.21.15.19:0/974477024 shutdown_connections 2024-09-19T09:04:14.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.155+0000 7f1f13f3b740 1 -- 172.21.15.19:0/974477024 wait complete. 2024-09-19T09:04:14.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.155+0000 7f1f13f3b740 1 -- start start 2024-09-19T09:04:14.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.156+0000 7f1f13f3b740 1 Processor -- start 2024-09-19T09:04:14.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.156+0000 7f1f13f3b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f70dc7ba40 0x55f70dc880d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:14.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.156+0000 7f1f13f3b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f70dc7c360 0x55f70dc88610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:14.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.156+0000 7f1f13f3b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f70dc8b150 0x55f70dc88b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:14.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.156+0000 7f1f13f3b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55f70dc8dd20 con 0x55f70dc7ba40 2024-09-19T09:04:14.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.156+0000 7f1f13f3b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55f70db9bf10 con 0x55f70dc7c360 2024-09-19T09:04:14.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.156+0000 7f1f13f3b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f70dc8dea0 con 0x55f70dc8b150 2024-09-19T09:04:14.181 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.156+0000 7f1f13f3b740 10 client.0 _ll_register_callbacks cb 0x55f70db64a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:14.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.156+0000 7f1f0b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f70dc7ba40 0x55f70dc880d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:14.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.156+0000 7f1f0b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f70dc7ba40 0x55f70dc880d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45614/0 (socket says 172.21.15.19:45614) 2024-09-19T09:04:14.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.156+0000 7f1f0b7fe640 1 -- 172.21.15.19:0/2389510687 learned_addr learned my addr 172.21.15.19:0/2389510687 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:14.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.156+0000 7f1f0affd640 1 --2- 172.21.15.19:0/2389510687 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f70dc7c360 0x55f70dc88610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:14.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.156+0000 7f1f0bfff640 1 --2- 172.21.15.19:0/2389510687 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f70dc8b150 0x55f70dc88b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:14.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.156+0000 7f1f0b7fe640 1 -- 172.21.15.19:0/2389510687 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f70dc8b150 msgr2=0x55f70dc88b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:14.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.156+0000 7f1f0b7fe640 1 --2- 172.21.15.19:0/2389510687 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f70dc8b150 0x55f70dc88b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.156+0000 7f1f0b7fe640 1 -- 172.21.15.19:0/2389510687 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f70dc7c360 msgr2=0x55f70dc88610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:14.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.156+0000 7f1f0b7fe640 1 --2- 172.21.15.19:0/2389510687 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f70dc7c360 0x55f70dc88610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.156+0000 7f1f0b7fe640 1 -- 172.21.15.19:0/2389510687 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f70d9526a0 con 0x55f70dc7ba40 2024-09-19T09:04:14.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.157+0000 7f1f0b7fe640 1 --2- 172.21.15.19:0/2389510687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f70dc7ba40 0x55f70dc880d0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f1efc0989d0 tx=0x7f1efc0145e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=993a88a83edc22ed server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:14.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.157+0000 7f1eeaffd640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:04:14.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.157+0000 7f1eeaffd640 1 -- 172.21.15.19:0/2389510687 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc00fe60 con 0x55f70dc7ba40 2024-09-19T09:04:14.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.157+0000 7f1eeaffd640 1 -- 172.21.15.19:0/2389510687 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f1efc0a4730 con 0x55f70dc7ba40 2024-09-19T09:04:14.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.157+0000 7f1f13f3b740 1 -- 172.21.15.19:0/2389510687 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f0400b9c0 con 0x55f70dc7ba40 2024-09-19T09:04:14.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.157+0000 7f1eeaffd640 1 -- 172.21.15.19:0/2389510687 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f1efc09c000 con 0x55f70dc7ba40 2024-09-19T09:04:14.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.157+0000 7f1f13f3b740 10 client.18654 fetch_fsmap learned FSMap version 43 2024-09-19T09:04:14.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.157+0000 7f1f13f3b740 1 -- 172.21.15.19:0/2389510687 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55f70dc99a60 con 0x55f70dc7ba40 2024-09-19T09:04:14.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.157+0000 7f1eeaffd640 1 -- 172.21.15.19:0/2389510687 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f0400b9c0 con 0x55f70dc7ba40 2024-09-19T09:04:14.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.157+0000 7f1eeaffd640 1 -- 172.21.15.19:0/2389510687 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7f1efc0bac70 con 0x55f70dc7ba40 2024-09-19T09:04:14.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.157+0000 7f1f13f3b740 10 client.18654 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T09:04:14.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.157+0000 7f1f13f3b740 10 client.18654 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:04:14.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.157+0000 7f1f13f3b740 20 client.18654 populate_metadata read hostname 'smithi019' 2024-09-19T09:04:14.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.157+0000 7f1f13f3b740 1 --2- 172.21.15.19:0/2389510687 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55f70dc9af20 0x55f70dc9d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:14.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.157+0000 7f1f13f3b740 4 client.18654 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:14.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.157+0000 7f1f13f3b740 1 -- 172.21.15.19:0/2389510687 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f70dbee7f0 con 0x55f70dc9af20 2024-09-19T09:04:14.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.158+0000 7f1f0affd640 1 --2- 172.21.15.19:0/2389510687 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55f70dc9af20 0x55f70dc9d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:14.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.158+0000 7f1f0affd640 1 --2- 172.21.15.19:0/2389510687 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55f70dc9af20 0x55f70dc9d310 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee7d1fef7786907f server_cookie=56a5ada153bf34a9 in_seq=0 out_seq=0 2024-09-19T09:04:14.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.158+0000 7f1eeaffd640 10 client.18654 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:04:14.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.159+0000 7f1eeaffd640 1 -- 172.21.15.19:0/2389510687 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f70dbee7f0 con 0x55f70dc9af20 2024-09-19T09:04:14.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.159+0000 7f1eeaffd640 10 client.18654 handle_command_reply: tid=0 2024-09-19T09:04:14.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.159+0000 7f1f13f3b740 1 client.18654 shutdown 2024-09-19T09:04:14.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.159+0000 7f1f13f3b740 1 -- 172.21.15.19:0/2389510687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f70dc7ba40 msgr2=0x55f70dc880d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:14.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.159+0000 7f1f13f3b740 1 --2- 172.21.15.19:0/2389510687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f70dc7ba40 0x55f70dc880d0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f1efc0989d0 tx=0x7f1efc0145e0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.159+0000 7f1f13f3b740 1 -- 172.21.15.19:0/2389510687 shutdown_connections 2024-09-19T09:04:14.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.159+0000 7f1f13f3b740 1 --2- 172.21.15.19:0/2389510687 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55f70dc9af20 0x55f70dc9d310 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.159+0000 7f1f13f3b740 1 --2- 172.21.15.19:0/2389510687 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f70dc8b150 0x55f70dc88b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.159+0000 7f1f13f3b740 1 --2- 172.21.15.19:0/2389510687 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f70dc7c360 0x55f70dc88610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.159+0000 7f1f13f3b740 1 --2- 172.21.15.19:0/2389510687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f70dc7ba40 0x55f70dc880d0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.159+0000 7f1f13f3b740 1 -- 172.21.15.19:0/2389510687 >> 172.21.15.19:0/2389510687 conn(0x55f70dc780f0 msgr2=0x55f70dc7de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:14.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.159+0000 7f1eeaffd640 0 client.18654 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:04:14.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.159+0000 7f1f13f3b740 1 -- 172.21.15.19:0/2389510687 shutdown_connections 2024-09-19T09:04:14.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.159+0000 7f1f13f3b740 1 -- 172.21.15.19:0/2389510687 wait complete. 2024-09-19T09:04:14.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.159+0000 7f1f13f3b740 20 client.18654 trim_cache size 0 max 16384 2024-09-19T09:04:14.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.176+0000 7f1f13f3b740 1 Processor -- start 2024-09-19T09:04:14.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.177+0000 7f1f13f3b740 1 -- start start 2024-09-19T09:04:14.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.177+0000 7f1f13f3b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f70dc7ba40 0x55f70dca2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:14.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.177+0000 7f1f13f3b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f70dc7c360 0x55f70dca3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:14.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.177+0000 7f1f13f3b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f70dc8b150 0x55f70dc85330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:14.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.177+0000 7f1f13f3b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c1ab3a0 con 0x55f70dc8b150 2024-09-19T09:04:14.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.177+0000 7f1f13f3b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c1acee0 con 0x55f70dc7c360 2024-09-19T09:04:14.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.177+0000 7f1f13f3b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c1aba70 con 0x55f70dc7ba40 2024-09-19T09:04:14.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.177+0000 7f1f0bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f70dc8b150 0x55f70dc85330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:14.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.177+0000 7f1f0bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f70dc8b150 0x55f70dc85330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45626/0 (socket says 172.21.15.19:45626) 2024-09-19T09:04:14.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.177+0000 7f1f0bfff640 1 -- 172.21.15.19:0/2587783007 learned_addr learned my addr 172.21.15.19:0/2587783007 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:14.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.177+0000 7f1f0b7fe640 1 --2- 172.21.15.19:0/2587783007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f70dc7ba40 0x55f70dca2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:14.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.177+0000 7f1f0affd640 1 --2- 172.21.15.19:0/2587783007 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f70dc7c360 0x55f70dca3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:14.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.177+0000 7f1f0bfff640 1 -- 172.21.15.19:0/2587783007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f70dc7ba40 msgr2=0x55f70dca2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:14.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.177+0000 7f1f0bfff640 1 --2- 172.21.15.19:0/2587783007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f70dc7ba40 0x55f70dca2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.177+0000 7f1f0bfff640 1 -- 172.21.15.19:0/2587783007 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f70dc7c360 msgr2=0x55f70dca3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:14.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.177+0000 7f1f0bfff640 1 --2- 172.21.15.19:0/2587783007 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f70dc7c360 0x55f70dca3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.177+0000 7f1f0bfff640 1 -- 172.21.15.19:0/2587783007 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f70dc7c190 con 0x55f70dc8b150 2024-09-19T09:04:14.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.177+0000 7f1f0bfff640 1 --2- 172.21.15.19:0/2587783007 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f70dc8b150 0x55f70dc85330 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f1f0400b2e0 tx=0x7f1f0400b310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c19417b8bcf7eac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:14.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.178+0000 7f1ef17fa640 1 -- 172.21.15.19:0/2587783007 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f04024070 con 0x55f70dc8b150 2024-09-19T09:04:14.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.178+0000 7f1ef17fa640 1 -- 172.21.15.19:0/2587783007 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f0400b9c0 con 0x55f70dc8b150 2024-09-19T09:04:14.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.178+0000 7f1ef17fa640 1 -- 172.21.15.19:0/2587783007 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f0400dc60 con 0x55f70dc8b150 2024-09-19T09:04:14.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.178+0000 7f1f13f3b740 1 -- 172.21.15.19:0/2587783007 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f70dc8b150 msgr2=0x55f70dc85330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:14.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.178+0000 7f1f13f3b740 1 --2- 172.21.15.19:0/2587783007 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f70dc8b150 0x55f70dc85330 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f1f0400b2e0 tx=0x7f1f0400b310 comp rx=0 tx=0).stop 2024-09-19T09:04:14.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.178+0000 7f1f13f3b740 1 -- 172.21.15.19:0/2587783007 shutdown_connections 2024-09-19T09:04:14.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.178+0000 7f1f13f3b740 1 --2- 172.21.15.19:0/2587783007 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f70dc8b150 0x55f70dc85330 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.178+0000 7f1f13f3b740 1 --2- 172.21.15.19:0/2587783007 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f70dc7c360 0x55f70dca3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.178+0000 7f1f13f3b740 1 --2- 172.21.15.19:0/2587783007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f70dc7ba40 0x55f70dca2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.178+0000 7f1f13f3b740 1 -- 172.21.15.19:0/2587783007 >> 172.21.15.19:0/2587783007 conn(0x55f70dc780f0 msgr2=0x55f70dc8a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:14.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.178+0000 7f1f13f3b740 1 -- 172.21.15.19:0/2587783007 shutdown_connections 2024-09-19T09:04:14.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.178+0000 7f1f13f3b740 1 -- 172.21.15.19:0/2587783007 wait complete. 2024-09-19T09:04:14.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.179+0000 7f1f13f3b740 1 -- start start 2024-09-19T09:04:14.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.179+0000 7f1f13f3b740 1 Processor -- start 2024-09-19T09:04:14.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.179+0000 7f1f13f3b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f70dc7ba40 0x55f70dc8f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:14.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.179+0000 7f1f13f3b740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f70dc7c360 0x55f70dc8f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:14.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.179+0000 7f1f13f3b740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f70dc8b150 0x55f70dc8fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:14.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.179+0000 7f1f13f3b740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c1ac810 con 0x55f70dc7c360 2024-09-19T09:04:14.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.179+0000 7f1f13f3b740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c1ac140 con 0x55f70dc8b150 2024-09-19T09:04:14.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.179+0000 7f1f13f3b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1f0c1a9380 con 0x55f70dc7ba40 2024-09-19T09:04:14.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.179+0000 7f1f13f3b740 10 client.0 _ll_register_callbacks cb 0x7f1efc0077c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:14.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.180+0000 7f1f0affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f70dc7c360 0x55f70dc8f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:14.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.180+0000 7f1f0affd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f70dc7c360 0x55f70dc8f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:45640/0 (socket says 172.21.15.19:45640) 2024-09-19T09:04:14.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.180+0000 7f1f0b7fe640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f70dc7ba40 0x55f70dc8f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:14.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.180+0000 7f1f0affd640 1 -- 172.21.15.19:0/3142645573 learned_addr learned my addr 172.21.15.19:0/3142645573 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:14.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.180+0000 7f1f0bfff640 1 --2- 172.21.15.19:0/3142645573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f70dc8b150 0x55f70dc8fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:14.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.180+0000 7f1f0b7fe640 1 -- 172.21.15.19:0/3142645573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f70dc8b150 msgr2=0x55f70dc8fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:14.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.180+0000 7f1f0b7fe640 1 --2- 172.21.15.19:0/3142645573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f70dc8b150 0x55f70dc8fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.180+0000 7f1f0b7fe640 1 -- 172.21.15.19:0/3142645573 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f70dc7c360 msgr2=0x55f70dc8f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:14.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.180+0000 7f1f0b7fe640 1 --2- 172.21.15.19:0/3142645573 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f70dc7c360 0x55f70dc8f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.180+0000 7f1f0b7fe640 1 -- 172.21.15.19:0/3142645573 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f70dd04d60 con 0x55f70dc7ba40 2024-09-19T09:04:14.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.180+0000 7f1f0affd640 1 --2- 172.21.15.19:0/3142645573 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f70dc7c360 0x55f70dc8f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:14.198 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.180+0000 7f1f0bfff640 1 --2- 172.21.15.19:0/3142645573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f70dc8b150 0x55f70dc8fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:14.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.180+0000 7f1f0b7fe640 1 --2- 172.21.15.19:0/3142645573 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f70dc7ba40 0x55f70dc8f160 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1efc0a4690 tx=0x7f1efc0bae40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c3ca8b113df3b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:14.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.180+0000 7f1eeaffd640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-09-19T09:04:14.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.180+0000 7f1eeaffd640 1 -- 172.21.15.19:0/3142645573 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1efc07f060 con 0x55f70dc7ba40 2024-09-19T09:04:14.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.180+0000 7f1f13f3b740 1 -- 172.21.15.19:0/3142645573 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f0400b9c0 con 0x55f70dc7ba40 2024-09-19T09:04:14.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.180+0000 7f1eeaffd640 1 -- 172.21.15.19:0/3142645573 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f1efc09b450 con 0x55f70dc7ba40 2024-09-19T09:04:14.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.181+0000 7f1eeaffd640 1 -- 172.21.15.19:0/3142645573 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f1efc01d040 con 0x55f70dc7ba40 2024-09-19T09:04:14.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.181+0000 7f1f13f3b740 10 client.27787 fetch_fsmap learned FSMap version 43 2024-09-19T09:04:14.199 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.181+0000 7f1f13f3b740 1 -- 172.21.15.19:0/3142645573 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55f70dd06060 con 0x55f70dc7ba40 2024-09-19T09:04:14.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.181+0000 7f1eeaffd640 1 -- 172.21.15.19:0/3142645573 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1f0400b9c0 con 0x55f70dc7ba40 2024-09-19T09:04:14.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.181+0000 7f1eeaffd640 1 -- 172.21.15.19:0/3142645573 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7f1efc09aec0 con 0x55f70dc7ba40 2024-09-19T09:04:14.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.181+0000 7f1f13f3b740 10 client.27787 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T09:04:14.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.181+0000 7f1f13f3b740 10 client.27787 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:04:14.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.181+0000 7f1f13f3b740 20 client.27787 populate_metadata read hostname 'smithi019' 2024-09-19T09:04:14.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.181+0000 7f1f13f3b740 1 --2- 172.21.15.19:0/3142645573 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55f70dd06750 0x55f70dd08b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:14.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.181+0000 7f1f13f3b740 4 client.27787 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T09:04:14.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.181+0000 7f1f13f3b740 1 -- 172.21.15.19:0/3142645573 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f70dbe8d00 con 0x55f70dd06750 2024-09-19T09:04:14.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.181+0000 7f1f0affd640 1 --2- 172.21.15.19:0/3142645573 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55f70dd06750 0x55f70dd08b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:14.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.182+0000 7f1f0affd640 1 --2- 172.21.15.19:0/3142645573 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55f70dd06750 0x55f70dd08b70 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4c8717eb40846e0 server_cookie=347321b113860943 in_seq=0 out_seq=0 2024-09-19T09:04:14.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.182+0000 7f1eeaffd640 10 client.27787 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:04:14.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.183+0000 7f1eeaffd640 1 -- 172.21.15.19:0/3142645573 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f70dbe8d00 con 0x55f70dd06750 2024-09-19T09:04:14.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.183+0000 7f1eeaffd640 10 client.27787 handle_command_reply: tid=0 2024-09-19T09:04:14.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.183+0000 7f1f13f3b740 1 client.27787 shutdown 2024-09-19T09:04:14.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.183+0000 7f1f13f3b740 1 -- 172.21.15.19:0/3142645573 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f70dc7ba40 msgr2=0x55f70dc8f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:14.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.183+0000 7f1f13f3b740 1 --2- 172.21.15.19:0/3142645573 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f70dc7ba40 0x55f70dc8f160 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1efc0a4690 tx=0x7f1efc0bae40 comp rx=0 tx=0).stop 2024-09-19T09:04:14.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.183+0000 7f1f13f3b740 1 -- 172.21.15.19:0/3142645573 shutdown_connections 2024-09-19T09:04:14.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.183+0000 7f1f13f3b740 1 --2- 172.21.15.19:0/3142645573 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x55f70dd06750 0x55f70dd08b70 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.183+0000 7f1f13f3b740 1 --2- 172.21.15.19:0/3142645573 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55f70dc8b150 0x55f70dc8fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.183+0000 7f1f13f3b740 1 --2- 172.21.15.19:0/3142645573 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55f70dc7c360 0x55f70dc8f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.183+0000 7f1eeaffd640 0 client.27787 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:04:14.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.183+0000 7f1f13f3b740 1 --2- 172.21.15.19:0/3142645573 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f70dc7ba40 0x55f70dc8f160 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.183+0000 7f1f13f3b740 1 -- 172.21.15.19:0/3142645573 >> 172.21.15.19:0/3142645573 conn(0x55f70dc780f0 msgr2=0x55f70dc7d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:14.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.183+0000 7f1f13f3b740 1 -- 172.21.15.19:0/3142645573 shutdown_connections 2024-09-19T09:04:14.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.183+0000 7f1f13f3b740 1 -- 172.21.15.19:0/3142645573 wait complete. 2024-09-19T09:04:14.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.183+0000 7f1f13f3b740 20 client.27787 trim_cache size 0 max 16384 2024-09-19T09:04:14.203 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T09:04:14.203 INFO:teuthology.orchestra.run.smithi019.stdout: "return_code": 0, 2024-09-19T09:04:14.203 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_tag": "d09a6ea2-bf0c-4adb-97be-7e192ebb2414", 2024-09-19T09:04:14.203 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": "asynchronous" 2024-09-19T09:04:14.203 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T09:04:14.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.184+0000 7f1f11b62640 1 -- 172.21.15.19:0/3831854483 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1ef40a3240 msgr2=0x7f1ef40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:14.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.184+0000 7f1f11b62640 1 --2- 172.21.15.19:0/3831854483 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1ef40a3240 0x7f1ef40a5700 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1f04010740 tx=0x7f1f04017000 comp rx=0 tx=0).stop 2024-09-19T09:04:14.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.184+0000 7f1f11b62640 1 -- 172.21.15.19:0/3831854483 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f0c101de0 msgr2=0x7f1f0c198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:14.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.184+0000 7f1f11b62640 1 --2- 172.21.15.19:0/3831854483 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f0c101de0 0x7f1f0c198450 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f1efc00cce0 tx=0x7f1efc00a620 comp rx=0 tx=0).stop 2024-09-19T09:04:14.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.184+0000 7f1f11b62640 1 -- 172.21.15.19:0/3831854483 shutdown_connections 2024-09-19T09:04:14.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.184+0000 7f1f11b62640 1 --2- 172.21.15.19:0/3831854483 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1ef40a3240 0x7f1ef40a5700 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.184+0000 7f1f11b62640 1 --2- 172.21.15.19:0/3831854483 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1f0c106f10 0x7f1f0c19cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.184+0000 7f1f11b62640 1 --2- 172.21.15.19:0/3831854483 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1f0c102790 0x7f1f0c198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.184+0000 7f1f11b62640 1 --2- 172.21.15.19:0/3831854483 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1f0c101de0 0x7f1f0c198450 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:14.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.184+0000 7f1f11b62640 1 -- 172.21.15.19:0/3831854483 >> 172.21.15.19:0/3831854483 conn(0x7f1f0c0fd8c0 msgr2=0x7f1f0c0fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:14.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.184+0000 7f1f11b62640 1 -- 172.21.15.19:0/3831854483 shutdown_connections 2024-09-19T09:04:14.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:14.184+0000 7f1f11b62640 1 -- 172.21.15.19:0/3831854483 wait complete. 2024-09-19T09:04:14.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:14 smithi019 ceph-mon[30976]: Health check failed: 1 MDSs are read only (MDS_READ_ONLY) 2024-09-19T09:04:14.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:14 smithi019 ceph-mon[30976]: mds.? [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] up:active 2024-09-19T09:04:14.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:14 smithi019 ceph-mon[30976]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:04:14.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:14 smithi019 ceph-mon[30976]: scrub queued for path: / 2024-09-19T09:04:14.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:14 smithi019 ceph-mon[30976]: scrub summary: idle+waiting paths [/] 2024-09-19T09:04:14.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:14 smithi019 ceph-mon[30976]: scrub summary: active paths [/] 2024-09-19T09:04:14.320 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:14 smithi019 ceph-mon[30976]: scrub summary: idle+waiting paths [/] 2024-09-19T09:04:14.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:14 smithi155 ceph-mon[34921]: Health check failed: 1 MDSs are read only (MDS_READ_ONLY) 2024-09-19T09:04:14.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:14 smithi155 ceph-mon[34921]: mds.? [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] up:active 2024-09-19T09:04:14.674 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:14 smithi155 ceph-mon[34921]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:04:14.674 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:14 smithi155 ceph-mon[34921]: scrub queued for path: / 2024-09-19T09:04:14.674 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:14 smithi155 ceph-mon[34921]: scrub summary: idle+waiting paths [/] 2024-09-19T09:04:14.674 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:14 smithi155 ceph-mon[34921]: scrub summary: active paths [/] 2024-09-19T09:04:14.674 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:14 smithi155 ceph-mon[34921]: scrub summary: idle+waiting paths [/] 2024-09-19T09:04:14.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:14 smithi203 ceph-mon[35450]: Health check failed: 1 MDSs are read only (MDS_READ_ONLY) 2024-09-19T09:04:14.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:14 smithi203 ceph-mon[35450]: mds.? [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] up:active 2024-09-19T09:04:14.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:14 smithi203 ceph-mon[35450]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-19T09:04:14.733 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:14 smithi203 ceph-mon[35450]: scrub queued for path: / 2024-09-19T09:04:14.733 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:14 smithi203 ceph-mon[35450]: scrub summary: idle+waiting paths [/] 2024-09-19T09:04:14.733 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:14 smithi203 ceph-mon[35450]: scrub summary: active paths [/] 2024-09-19T09:04:14.733 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:14 smithi203 ceph-mon[35450]: scrub summary: idle+waiting paths [/] 2024-09-19T09:04:14.873 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:04:14.955 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:15.436 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:15 smithi019 ceph-mon[30976]: pgmap v704: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 KiB/s wr, 22 op/s 2024-09-19T09:04:15.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.434+0000 7f84762a8640 1 -- 172.21.15.19:0/2849985050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8470100a80 msgr2=0x7f8470100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:15.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.434+0000 7f84762a8640 1 --2- 172.21.15.19:0/2849985050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8470100a80 0x7f8470100ee0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f8458009930 tx=0x7f845802a420 comp rx=0 tx=0).stop 2024-09-19T09:04:15.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.434+0000 7f84762a8640 1 -- 172.21.15.19:0/2849985050 shutdown_connections 2024-09-19T09:04:15.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.434+0000 7f84762a8640 1 --2- 172.21.15.19:0/2849985050 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8470101420 0x7f847010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.434+0000 7f84762a8640 1 --2- 172.21.15.19:0/2849985050 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8470100a80 0x7f8470100ee0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.434+0000 7f84762a8640 1 --2- 172.21.15.19:0/2849985050 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8470106a80 0x7f8470106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.434+0000 7f84762a8640 1 -- 172.21.15.19:0/2849985050 >> 172.21.15.19:0/2849985050 conn(0x7f84700fc7a0 msgr2=0x7f84700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:15.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.434+0000 7f84762a8640 1 -- 172.21.15.19:0/2849985050 shutdown_connections 2024-09-19T09:04:15.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.434+0000 7f84762a8640 1 -- 172.21.15.19:0/2849985050 wait complete. 2024-09-19T09:04:15.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.435+0000 7f84762a8640 1 Processor -- start 2024-09-19T09:04:15.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.435+0000 7f84762a8640 1 -- start start 2024-09-19T09:04:15.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.435+0000 7f84762a8640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8470100a80 0x7f847019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:15.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.435+0000 7f84762a8640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8470101420 0x7f847019ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:15.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.435+0000 7f84762a8640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8470106a80 0x7f847019ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:15.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.435+0000 7f84762a8640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f8470110e80 con 0x7f8470101420 2024-09-19T09:04:15.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.435+0000 7f84762a8640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f8470110d00 con 0x7f8470106a80 2024-09-19T09:04:15.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.435+0000 7f84762a8640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8470111000 con 0x7f8470100a80 2024-09-19T09:04:15.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.436+0000 7f8467fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8470101420 0x7f847019ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:15.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.436+0000 7f8467fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8470101420 0x7f847019ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60906/0 (socket says 172.21.15.19:60906) 2024-09-19T09:04:15.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.436+0000 7f8467fff640 1 -- 172.21.15.19:0/1638475064 learned_addr learned my addr 172.21.15.19:0/1638475064 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:15.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.436+0000 7f846ffff640 1 --2- 172.21.15.19:0/1638475064 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8470100a80 0x7f847019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:15.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.436+0000 7f8474845640 1 --2- 172.21.15.19:0/1638475064 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8470106a80 0x7f847019ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:15.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.436+0000 7f8467fff640 1 -- 172.21.15.19:0/1638475064 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8470100a80 msgr2=0x7f847019a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:15.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.436+0000 7f8467fff640 1 --2- 172.21.15.19:0/1638475064 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8470100a80 0x7f847019a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.436+0000 7f8467fff640 1 -- 172.21.15.19:0/1638475064 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8470106a80 msgr2=0x7f847019ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:15.456 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.436+0000 7f8467fff640 1 --2- 172.21.15.19:0/1638475064 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8470106a80 0x7f847019ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.436+0000 7f8467fff640 1 -- 172.21.15.19:0/1638475064 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f847019f5f0 con 0x7f8470101420 2024-09-19T09:04:15.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.436+0000 7f846ffff640 1 --2- 172.21.15.19:0/1638475064 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8470100a80 0x7f847019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:15.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.436+0000 7f8474845640 1 --2- 172.21.15.19:0/1638475064 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8470106a80 0x7f847019ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:15.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.436+0000 7f8467fff640 1 --2- 172.21.15.19:0/1638475064 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8470101420 0x7f847019ab80 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f8458009230 tx=0x7f8458004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:15.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.436+0000 7f846dffb640 1 -- 172.21.15.19:0/1638475064 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f845803f030 con 0x7f8470101420 2024-09-19T09:04:15.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.436+0000 7f84762a8640 1 -- 172.21.15.19:0/1638475064 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f847019f880 con 0x7f8470101420 2024-09-19T09:04:15.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.436+0000 7f846dffb640 1 -- 172.21.15.19:0/1638475064 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8458003ad0 con 0x7f8470101420 2024-09-19T09:04:15.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.436+0000 7f846dffb640 1 -- 172.21.15.19:0/1638475064 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8458035070 con 0x7f8470101420 2024-09-19T09:04:15.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.436+0000 7f84762a8640 1 -- 172.21.15.19:0/1638475064 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84701a71c0 con 0x7f8470101420 2024-09-19T09:04:15.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.439+0000 7f846dffb640 1 -- 172.21.15.19:0/1638475064 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f8458042030 con 0x7f8470101420 2024-09-19T09:04:15.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.439+0000 7f8478681740 1 Processor -- start 2024-09-19T09:04:15.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.439+0000 7f8478681740 1 -- start start 2024-09-19T09:04:15.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.440+0000 7f8478681740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5631df9d1a00 0x5631df9d1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:15.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.440+0000 7f8478681740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631df9d2320 0x5631df9dc6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:15.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.440+0000 7f8478681740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5631df9dcbe0 0x5631df9defd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:15.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.440+0000 7f8478681740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5631df936200 con 0x5631df9d1a00 2024-09-19T09:04:15.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.440+0000 7f8478681740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5631df8dcdc0 con 0x5631df9dcbe0 2024-09-19T09:04:15.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.440+0000 7f8478681740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5631df9321c0 con 0x5631df9d2320 2024-09-19T09:04:15.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.440+0000 7f8474845640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5631df9d1a00 0x5631df9d1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:15.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.440+0000 7f8474845640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5631df9d1a00 0x5631df9d1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60910/0 (socket says 172.21.15.19:60910) 2024-09-19T09:04:15.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.440+0000 7f8474845640 1 -- 172.21.15.19:0/4254931322 learned_addr learned my addr 172.21.15.19:0/4254931322 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:15.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.440+0000 7f846dffb640 1 --2- 172.21.15.19:0/1638475064 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f845c0a3240 0x7f845c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:15.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.440+0000 7f8467fff640 1 --2- 172.21.15.19:0/4254931322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5631df9dcbe0 0x5631df9defd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:15.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.440+0000 7f846ffff640 1 --2- 172.21.15.19:0/4254931322 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631df9d2320 0x5631df9dc6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:15.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.440+0000 7f8474845640 1 -- 172.21.15.19:0/4254931322 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631df9d2320 msgr2=0x5631df9dc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:15.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.440+0000 7f8474845640 1 --2- 172.21.15.19:0/4254931322 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631df9d2320 0x5631df9dc6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.440+0000 7f8474845640 1 -- 172.21.15.19:0/4254931322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5631df9dcbe0 msgr2=0x5631df9defd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:15.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.440+0000 7f8474845640 1 --2- 172.21.15.19:0/4254931322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5631df9dcbe0 0x5631df9defd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.440+0000 7f8474845640 1 -- 172.21.15.19:0/4254931322 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631df6a7620 con 0x5631df9d1a00 2024-09-19T09:04:15.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.440+0000 7f8467fff640 1 --2- 172.21.15.19:0/4254931322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5631df9dcbe0 0x5631df9defd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:15.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.440+0000 7f846dffb640 1 -- 172.21.15.19:0/1638475064 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f84580efdd0 con 0x7f8470101420 2024-09-19T09:04:15.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.440+0000 7f8474845640 1 --2- 172.21.15.19:0/1638475064 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f845c0a3240 0x7f845c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:15.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.440+0000 7f8474845640 1 --2- 172.21.15.19:0/4254931322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5631df9d1a00 0x5631df9d1de0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f8468010620 tx=0x7f8468010ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58732fd602c7b72f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:15.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.441+0000 7f84667fc640 1 -- 172.21.15.19:0/4254931322 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8468019070 con 0x5631df9d1a00 2024-09-19T09:04:15.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.441+0000 7f84667fc640 1 -- 172.21.15.19:0/4254931322 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8468022070 con 0x5631df9d1a00 2024-09-19T09:04:15.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.441+0000 7f84667fc640 1 -- 172.21.15.19:0/4254931322 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8468026da0 con 0x5631df9d1a00 2024-09-19T09:04:15.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.441+0000 7f8478681740 1 -- 172.21.15.19:0/4254931322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5631df9d1a00 msgr2=0x5631df9d1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:15.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.441+0000 7f8474845640 1 --2- 172.21.15.19:0/1638475064 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f845c0a3240 0x7f845c0a5700 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8468021000 tx=0x7f846801f000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:15.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.441+0000 7f8478681740 1 --2- 172.21.15.19:0/4254931322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5631df9d1a00 0x5631df9d1de0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f8468010620 tx=0x7f8468010ae0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.441+0000 7f8478681740 1 -- 172.21.15.19:0/4254931322 shutdown_connections 2024-09-19T09:04:15.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.441+0000 7f8478681740 1 --2- 172.21.15.19:0/4254931322 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631df9d2320 0x5631df9dc6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.441+0000 7f8478681740 1 --2- 172.21.15.19:0/4254931322 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5631df9dcbe0 0x5631df9defd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.441+0000 7f8478681740 1 --2- 172.21.15.19:0/4254931322 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5631df9d1a00 0x5631df9d1de0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.441+0000 7f8478681740 1 -- 172.21.15.19:0/4254931322 >> 172.21.15.19:0/4254931322 conn(0x5631df9cdf90 msgr2=0x5631df9ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:15.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.441+0000 7f8478681740 1 -- 172.21.15.19:0/4254931322 shutdown_connections 2024-09-19T09:04:15.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.442+0000 7f8478681740 1 -- 172.21.15.19:0/4254931322 wait complete. 2024-09-19T09:04:15.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.442+0000 7f8478681740 1 -- start start 2024-09-19T09:04:15.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.442+0000 7f8478681740 1 Processor -- start 2024-09-19T09:04:15.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.442+0000 7f8478681740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5631df9d1a00 0x5631df9dc550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:15.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.442+0000 7f8478681740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5631df9d2320 0x5631df9d9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:15.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.442+0000 7f8478681740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631df9dcbe0 0x5631df9d9d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:15.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.442+0000 7f8478681740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5631df9df7b0 con 0x5631df9d2320 2024-09-19T09:04:15.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.442+0000 7f8478681740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5631df8d0c50 con 0x5631df9d1a00 2024-09-19T09:04:15.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.442+0000 7f8478681740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5631df9df930 con 0x5631df9dcbe0 2024-09-19T09:04:15.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.443+0000 7f8478681740 10 client.0 _ll_register_callbacks cb 0x5631df8e2ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:15.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.443+0000 7f8467fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5631df9d2320 0x5631df9d9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:15.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.443+0000 7f8467fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5631df9d2320 0x5631df9d9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60912/0 (socket says 172.21.15.19:60912) 2024-09-19T09:04:15.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.443+0000 7f8467fff640 1 -- 172.21.15.19:0/404395687 learned_addr learned my addr 172.21.15.19:0/404395687 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:15.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.443+0000 7f846ffff640 1 --2- 172.21.15.19:0/404395687 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5631df9d1a00 0x5631df9dc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:15.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.443+0000 7f8474845640 1 --2- 172.21.15.19:0/404395687 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631df9dcbe0 0x5631df9d9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:15.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.443+0000 7f8467fff640 1 -- 172.21.15.19:0/404395687 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631df9dcbe0 msgr2=0x5631df9d9d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:15.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.443+0000 7f8467fff640 1 --2- 172.21.15.19:0/404395687 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631df9dcbe0 0x5631df9d9d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.443+0000 7f8467fff640 1 -- 172.21.15.19:0/404395687 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5631df9d1a00 msgr2=0x5631df9dc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:15.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.443+0000 7f8467fff640 1 --2- 172.21.15.19:0/404395687 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5631df9d1a00 0x5631df9dc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.443+0000 7f8467fff640 1 -- 172.21.15.19:0/404395687 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631df9da590 con 0x5631df9d2320 2024-09-19T09:04:15.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.443+0000 7f8467fff640 1 --2- 172.21.15.19:0/404395687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5631df9d2320 0x5631df9d9800 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f84580bc390 tx=0x7f8458009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a64625eaf5b0eead server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:15.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.443+0000 7f844f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:04:15.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.443+0000 7f844f7fe640 1 -- 172.21.15.19:0/404395687 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8458049070 con 0x5631df9d2320 2024-09-19T09:04:15.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.443+0000 7f844f7fe640 1 -- 172.21.15.19:0/404395687 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f8458003c80 con 0x5631df9d2320 2024-09-19T09:04:15.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.443+0000 7f8478681740 1 -- 172.21.15.19:0/404395687 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8468022070 con 0x5631df9d2320 2024-09-19T09:04:15.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.443+0000 7f844f7fe640 1 -- 172.21.15.19:0/404395687 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f84580bbd60 con 0x5631df9d2320 2024-09-19T09:04:15.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.443+0000 7f8478681740 10 client.18672 fetch_fsmap learned FSMap version 43 2024-09-19T09:04:15.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.443+0000 7f8478681740 1 -- 172.21.15.19:0/404395687 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x5631df9eb360 con 0x5631df9d2320 2024-09-19T09:04:15.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.444+0000 7f844f7fe640 1 -- 172.21.15.19:0/404395687 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8468022070 con 0x5631df9d2320 2024-09-19T09:04:15.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.444+0000 7f844f7fe640 1 -- 172.21.15.19:0/404395687 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7f84580f2110 con 0x5631df9d2320 2024-09-19T09:04:15.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.444+0000 7f8478681740 10 client.18672 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T09:04:15.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.444+0000 7f8478681740 10 client.18672 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:04:15.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.444+0000 7f8478681740 20 client.18672 populate_metadata read hostname 'smithi019' 2024-09-19T09:04:15.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.444+0000 7f8478681740 1 --2- 172.21.15.19:0/404395687 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5631df9ec750 0x5631df9eeb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:15.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.444+0000 7f8478681740 4 client.18672 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:15.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.444+0000 7f8478681740 1 -- 172.21.15.19:0/404395687 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631df943770 con 0x5631df9ec750 2024-09-19T09:04:15.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.444+0000 7f846ffff640 1 --2- 172.21.15.19:0/404395687 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5631df9ec750 0x5631df9eeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:15.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.445+0000 7f846ffff640 1 --2- 172.21.15.19:0/404395687 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5631df9ec750 0x5631df9eeb60 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48cc38ec8c2acb22 server_cookie=e1ac49546556230 in_seq=0 out_seq=0 2024-09-19T09:04:15.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.445+0000 7f844f7fe640 10 client.18672 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:04:15.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.445+0000 7f844f7fe640 1 -- 172.21.15.19:0/404395687 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5631df943770 con 0x5631df9ec750 2024-09-19T09:04:15.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.445+0000 7f844f7fe640 10 client.18672 handle_command_reply: tid=0 2024-09-19T09:04:15.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.445+0000 7f8478681740 1 client.18672 shutdown 2024-09-19T09:04:15.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.445+0000 7f8478681740 1 -- 172.21.15.19:0/404395687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5631df9d2320 msgr2=0x5631df9d9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:15.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.445+0000 7f8478681740 1 --2- 172.21.15.19:0/404395687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5631df9d2320 0x5631df9d9800 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f84580bc390 tx=0x7f8458009620 comp rx=0 tx=0).stop 2024-09-19T09:04:15.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.445+0000 7f8478681740 1 -- 172.21.15.19:0/404395687 shutdown_connections 2024-09-19T09:04:15.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.445+0000 7f8478681740 1 --2- 172.21.15.19:0/404395687 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5631df9ec750 0x5631df9eeb60 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.445+0000 7f8478681740 1 --2- 172.21.15.19:0/404395687 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631df9dcbe0 0x5631df9d9d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.445+0000 7f8478681740 1 --2- 172.21.15.19:0/404395687 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5631df9d2320 0x5631df9d9800 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.445+0000 7f8478681740 1 --2- 172.21.15.19:0/404395687 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5631df9d1a00 0x5631df9dc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.445+0000 7f8478681740 1 -- 172.21.15.19:0/404395687 >> 172.21.15.19:0/404395687 conn(0x5631df9cdf90 msgr2=0x5631df9cd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:15.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.445+0000 7f844f7fe640 0 client.18672 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:04:15.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.446+0000 7f8478681740 1 -- 172.21.15.19:0/404395687 shutdown_connections 2024-09-19T09:04:15.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.446+0000 7f8478681740 1 -- 172.21.15.19:0/404395687 wait complete. 2024-09-19T09:04:15.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.446+0000 7f8478681740 20 client.18672 trim_cache size 0 max 16384 2024-09-19T09:04:15.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.467+0000 7f8478681740 1 Processor -- start 2024-09-19T09:04:15.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.467+0000 7f8478681740 1 -- start start 2024-09-19T09:04:15.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.467+0000 7f8478681740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631df9d1a00 0x5631df9e8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:15.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.467+0000 7f8478681740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5631df9dcbe0 0x5631df9d3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:15.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.467+0000 7f8478681740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5631df9db880 0x5631df9f4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:15.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.467+0000 7f8478681740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f84701af6e0 con 0x5631df9db880 2024-09-19T09:04:15.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.467+0000 7f8478681740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f84701b1220 con 0x5631df9dcbe0 2024-09-19T09:04:15.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.467+0000 7f8478681740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f84701afdb0 con 0x5631df9d1a00 2024-09-19T09:04:15.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.467+0000 7f8474845640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5631df9db880 0x5631df9f4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:15.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.467+0000 7f8474845640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5631df9db880 0x5631df9f4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60914/0 (socket says 172.21.15.19:60914) 2024-09-19T09:04:15.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.467+0000 7f8474845640 1 -- 172.21.15.19:0/1522430359 learned_addr learned my addr 172.21.15.19:0/1522430359 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:15.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.467+0000 7f8467fff640 1 --2- 172.21.15.19:0/1522430359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5631df9dcbe0 0x5631df9d3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:15.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.467+0000 7f846ffff640 1 --2- 172.21.15.19:0/1522430359 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631df9d1a00 0x5631df9e8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:15.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.468+0000 7f8474845640 1 -- 172.21.15.19:0/1522430359 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631df9d1a00 msgr2=0x5631df9e8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:15.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.468+0000 7f8474845640 1 --2- 172.21.15.19:0/1522430359 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631df9d1a00 0x5631df9e8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.468+0000 7f8474845640 1 -- 172.21.15.19:0/1522430359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5631df9dcbe0 msgr2=0x5631df9d3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:15.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.468+0000 7f8474845640 1 --2- 172.21.15.19:0/1522430359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5631df9dcbe0 0x5631df9d3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.468+0000 7f8474845640 1 -- 172.21.15.19:0/1522430359 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631df9c9730 con 0x5631df9db880 2024-09-19T09:04:15.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.468+0000 7f8474845640 1 --2- 172.21.15.19:0/1522430359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5631df9db880 0x5631df9f4430 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f8468005c40 tx=0x7f8468028000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=273bb96f67285446 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:15.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.468+0000 7f8465ffb640 1 -- 172.21.15.19:0/1522430359 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8468034070 con 0x5631df9db880 2024-09-19T09:04:15.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.468+0000 7f8465ffb640 1 -- 172.21.15.19:0/1522430359 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8468022070 con 0x5631df9db880 2024-09-19T09:04:15.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.468+0000 7f8465ffb640 1 -- 172.21.15.19:0/1522430359 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8468019030 con 0x5631df9db880 2024-09-19T09:04:15.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.469+0000 7f8478681740 1 -- 172.21.15.19:0/1522430359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5631df9db880 msgr2=0x5631df9f4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:15.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.469+0000 7f8478681740 1 --2- 172.21.15.19:0/1522430359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5631df9db880 0x5631df9f4430 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f8468005c40 tx=0x7f8468028000 comp rx=0 tx=0).stop 2024-09-19T09:04:15.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.469+0000 7f8478681740 1 -- 172.21.15.19:0/1522430359 shutdown_connections 2024-09-19T09:04:15.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.469+0000 7f8478681740 1 --2- 172.21.15.19:0/1522430359 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5631df9db880 0x5631df9f4430 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.469+0000 7f8478681740 1 --2- 172.21.15.19:0/1522430359 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5631df9dcbe0 0x5631df9d3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.469+0000 7f8478681740 1 --2- 172.21.15.19:0/1522430359 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631df9d1a00 0x5631df9e8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.469+0000 7f8478681740 1 -- 172.21.15.19:0/1522430359 >> 172.21.15.19:0/1522430359 conn(0x5631df9cdf90 msgr2=0x5631df9d3450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:15.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.469+0000 7f8478681740 1 -- 172.21.15.19:0/1522430359 shutdown_connections 2024-09-19T09:04:15.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.469+0000 7f8478681740 1 -- 172.21.15.19:0/1522430359 wait complete. 2024-09-19T09:04:15.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.469+0000 7f8478681740 1 -- start start 2024-09-19T09:04:15.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.470+0000 7f8478681740 1 Processor -- start 2024-09-19T09:04:15.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.470+0000 7f8478681740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5631df9d1a00 0x5631df9e1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:15.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.470+0000 7f8478681740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631df9db880 0x5631df9e15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:15.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.470+0000 7f8478681740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5631df9dcbe0 0x5631dfa56400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:15.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.470+0000 7f8478681740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f84701b0b50 con 0x5631df9d1a00 2024-09-19T09:04:15.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.470+0000 7f8478681740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f84701b0480 con 0x5631df9dcbe0 2024-09-19T09:04:15.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.470+0000 7f8478681740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f84701ad6c0 con 0x5631df9db880 2024-09-19T09:04:15.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.470+0000 7f8478681740 10 client.0 _ll_register_callbacks cb 0x7f84580b8cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:15.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.470+0000 7f846ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5631df9d1a00 0x5631df9e1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:15.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.470+0000 7f846ffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5631df9d1a00 0x5631df9e1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60920/0 (socket says 172.21.15.19:60920) 2024-09-19T09:04:15.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.470+0000 7f846ffff640 1 -- 172.21.15.19:0/2906019105 learned_addr learned my addr 172.21.15.19:0/2906019105 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:15.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.470+0000 7f8474845640 1 --2- 172.21.15.19:0/2906019105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5631df9dcbe0 0x5631dfa56400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:15.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.470+0000 7f8467fff640 1 --2- 172.21.15.19:0/2906019105 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631df9db880 0x5631df9e15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:15.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.471+0000 7f846ffff640 1 -- 172.21.15.19:0/2906019105 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631df9db880 msgr2=0x5631df9e15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:15.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.471+0000 7f846ffff640 1 --2- 172.21.15.19:0/2906019105 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631df9db880 0x5631df9e15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.471+0000 7f846ffff640 1 -- 172.21.15.19:0/2906019105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5631df9dcbe0 msgr2=0x5631dfa56400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:15.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.471+0000 7f846ffff640 1 --2- 172.21.15.19:0/2906019105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5631df9dcbe0 0x5631dfa56400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.471+0000 7f846ffff640 1 -- 172.21.15.19:0/2906019105 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631df9d2150 con 0x5631df9d1a00 2024-09-19T09:04:15.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.471+0000 7f846ffff640 1 --2- 172.21.15.19:0/2906019105 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5631df9d1a00 0x5631df9e1080 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x5631df9ef3d0 tx=0x7f8460014900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6bdb4bc46552a91 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:15.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.471+0000 7f844f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:04:15.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.471+0000 7f844f7fe640 1 -- 172.21.15.19:0/2906019105 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f846001e4b0 con 0x5631df9d1a00 2024-09-19T09:04:15.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.471+0000 7f844f7fe640 1 -- 172.21.15.19:0/2906019105 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f846001e650 con 0x5631df9d1a00 2024-09-19T09:04:15.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.471+0000 7f8478681740 1 -- 172.21.15.19:0/2906019105 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8468022070 con 0x5631df9d1a00 2024-09-19T09:04:15.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.471+0000 7f844f7fe640 1 -- 172.21.15.19:0/2906019105 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f846001e850 con 0x5631df9d1a00 2024-09-19T09:04:15.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.471+0000 7f8478681740 10 client.18678 fetch_fsmap learned FSMap version 43 2024-09-19T09:04:15.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.471+0000 7f8478681740 1 -- 172.21.15.19:0/2906019105 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x5631dfa57ac0 con 0x5631df9d1a00 2024-09-19T09:04:15.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.472+0000 7f844f7fe640 1 -- 172.21.15.19:0/2906019105 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8468022070 con 0x5631df9d1a00 2024-09-19T09:04:15.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.472+0000 7f844f7fe640 1 -- 172.21.15.19:0/2906019105 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7f8460012ce0 con 0x5631df9d1a00 2024-09-19T09:04:15.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.472+0000 7f8478681740 10 client.18678 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T09:04:15.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.472+0000 7f8478681740 10 client.18678 resolve_mds: validated gid 24497 aka daemon mds.b 2024-09-19T09:04:15.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.472+0000 7f8478681740 20 client.18678 populate_metadata read hostname 'smithi019' 2024-09-19T09:04:15.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.472+0000 7f8478681740 1 --2- 172.21.15.19:0/2906019105 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5631dfa58240 0x5631dfa5a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:15.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.472+0000 7f8478681740 4 client.18678 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-19T09:04:15.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.472+0000 7f8478681740 1 -- 172.21.15.19:0/2906019105 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x5631df93dc80 con 0x5631dfa58240 2024-09-19T09:04:15.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.472+0000 7f8467fff640 1 --2- 172.21.15.19:0/2906019105 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5631dfa58240 0x5631dfa5a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:15.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.473+0000 7f8467fff640 1 --2- 172.21.15.19:0/2906019105 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5631dfa58240 0x5631dfa5a660 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf1d687aeafa897e server_cookie=124be57a205e17af in_seq=0 out_seq=0 2024-09-19T09:04:15.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.473+0000 7f844f7fe640 10 client.18678 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:04:15.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.473+0000 7f844f7fe640 1 -- 172.21.15.19:0/2906019105 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x5631df93dc80 con 0x5631dfa58240 2024-09-19T09:04:15.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.473+0000 7f844f7fe640 10 client.18678 handle_command_reply: tid=0 2024-09-19T09:04:15.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.473+0000 7f8478681740 1 client.18678 shutdown 2024-09-19T09:04:15.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.473+0000 7f8478681740 1 -- 172.21.15.19:0/2906019105 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5631df9d1a00 msgr2=0x5631df9e1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:15.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.473+0000 7f8478681740 1 --2- 172.21.15.19:0/2906019105 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5631df9d1a00 0x5631df9e1080 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x5631df9ef3d0 tx=0x7f8460014900 comp rx=0 tx=0).stop 2024-09-19T09:04:15.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.473+0000 7f8478681740 1 -- 172.21.15.19:0/2906019105 shutdown_connections 2024-09-19T09:04:15.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.473+0000 7f8478681740 1 --2- 172.21.15.19:0/2906019105 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5631dfa58240 0x5631dfa5a660 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.473+0000 7f8478681740 1 --2- 172.21.15.19:0/2906019105 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631df9db880 0x5631df9e15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.473+0000 7f8478681740 1 --2- 172.21.15.19:0/2906019105 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5631df9dcbe0 0x5631dfa56400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.473+0000 7f8478681740 1 --2- 172.21.15.19:0/2906019105 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5631df9d1a00 0x5631df9e1080 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.473+0000 7f844f7fe640 0 client.18678 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:04:15.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.473+0000 7f8478681740 1 -- 172.21.15.19:0/2906019105 >> 172.21.15.19:0/2906019105 conn(0x5631df9cdf90 msgr2=0x5631df9d3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:15.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.474+0000 7f8478681740 1 -- 172.21.15.19:0/2906019105 shutdown_connections 2024-09-19T09:04:15.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.474+0000 7f8478681740 1 -- 172.21.15.19:0/2906019105 wait complete. 2024-09-19T09:04:15.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.474+0000 7f8478681740 20 client.18678 trim_cache size 0 max 16384 2024-09-19T09:04:15.485 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T09:04:15.485 INFO:teuthology.orchestra.run.smithi019.stdout: "epoch": 43, 2024-09-19T09:04:15.485 INFO:teuthology.orchestra.run.smithi019.stdout: "leader": 24497, 2024-09-19T09:04:15.485 INFO:teuthology.orchestra.run.smithi019.stdout: "set_version": 40, 2024-09-19T09:04:15.485 INFO:teuthology.orchestra.run.smithi019.stdout: "sets": {} 2024-09-19T09:04:15.486 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T09:04:15.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.474+0000 7f84762a8640 1 -- 172.21.15.19:0/1638475064 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f845c0a3240 msgr2=0x7f845c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:15.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.474+0000 7f84762a8640 1 --2- 172.21.15.19:0/1638475064 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f845c0a3240 0x7f845c0a5700 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f8468021000 tx=0x7f846801f000 comp rx=0 tx=0).stop 2024-09-19T09:04:15.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.474+0000 7f84762a8640 1 -- 172.21.15.19:0/1638475064 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8470101420 msgr2=0x7f847019ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:15.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.474+0000 7f84762a8640 1 --2- 172.21.15.19:0/1638475064 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8470101420 0x7f847019ab80 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f8458009230 tx=0x7f8458004270 comp rx=0 tx=0).stop 2024-09-19T09:04:15.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.474+0000 7f84762a8640 1 -- 172.21.15.19:0/1638475064 shutdown_connections 2024-09-19T09:04:15.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.474+0000 7f84762a8640 1 --2- 172.21.15.19:0/1638475064 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f845c0a3240 0x7f845c0a5700 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.474+0000 7f84762a8640 1 --2- 172.21.15.19:0/1638475064 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8470106a80 0x7f847019ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.474+0000 7f84762a8640 1 --2- 172.21.15.19:0/1638475064 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8470101420 0x7f847019ab80 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.474+0000 7f84762a8640 1 --2- 172.21.15.19:0/1638475064 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8470100a80 0x7f847019a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:15.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.474+0000 7f84762a8640 1 -- 172.21.15.19:0/1638475064 >> 172.21.15.19:0/1638475064 conn(0x7f84700fc7a0 msgr2=0x7f847006a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:15.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.475+0000 7f84762a8640 1 -- 172.21.15.19:0/1638475064 shutdown_connections 2024-09-19T09:04:15.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:15.475+0000 7f84762a8640 1 -- 172.21.15.19:0/1638475064 wait complete. 2024-09-19T09:04:15.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:15 smithi155 ceph-mon[34921]: pgmap v704: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 KiB/s wr, 22 op/s 2024-09-19T09:04:15.674 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:15.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:15 smithi203 ceph-mon[35450]: pgmap v704: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 31 KiB/s wr, 22 op/s 2024-09-19T09:04:16.184 INFO:tasks.quiescer:done joining Quiescers 2024-09-19T09:04:16.184 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-09-19T09:04:16.194 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi019.front.sepia.ceph.com 2024-09-19T09:04:16.203 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-19T09:04:16.231 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-19T09:04:16.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.683+0000 7f18202a9640 1 -- 172.21.15.19:0/2572787200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1818103660 msgr2=0x7f181810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:16.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.683+0000 7f18202a9640 1 --2- 172.21.15.19:0/2572787200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1818103660 0x7f181810bb50 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f1808009900 tx=0x7f180802a480 comp rx=0 tx=0).stop 2024-09-19T09:04:16.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.684+0000 7f18202a9640 1 -- 172.21.15.19:0/2572787200 shutdown_connections 2024-09-19T09:04:16.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.684+0000 7f18202a9640 1 --2- 172.21.15.19:0/2572787200 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f181810c170 0x7f181810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.684+0000 7f18202a9640 1 --2- 172.21.15.19:0/2572787200 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1818103660 0x7f181810bb50 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.684+0000 7f18202a9640 1 --2- 172.21.15.19:0/2572787200 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1818102d40 0x7f1818103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.684+0000 7f18202a9640 1 -- 172.21.15.19:0/2572787200 >> 172.21.15.19:0/2572787200 conn(0x7f18180fc7a0 msgr2=0x7f18180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:16.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.684+0000 7f18202a9640 1 -- 172.21.15.19:0/2572787200 shutdown_connections 2024-09-19T09:04:16.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.684+0000 7f18202a9640 1 -- 172.21.15.19:0/2572787200 wait complete. 2024-09-19T09:04:16.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.684+0000 7f18202a9640 1 Processor -- start 2024-09-19T09:04:16.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.684+0000 7f18202a9640 1 -- start start 2024-09-19T09:04:16.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.684+0000 7f18202a9640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1818102d40 0x7f18181983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:16.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.684+0000 7f18202a9640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1818103660 0x7f1818198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:16.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.684+0000 7f18202a9640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f181810c170 0x7f181819ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:16.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.684+0000 7f18202a9640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1818111f70 con 0x7f181810c170 2024-09-19T09:04:16.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.684+0000 7f18202a9640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1818111df0 con 0x7f1818103660 2024-09-19T09:04:16.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.684+0000 7f18202a9640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f18181120f0 con 0x7f1818102d40 2024-09-19T09:04:16.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.685+0000 7f181e846640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f181810c170 0x7f181819ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:16.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.685+0000 7f181e846640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f181810c170 0x7f181819ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60934/0 (socket says 172.21.15.19:60934) 2024-09-19T09:04:16.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.685+0000 7f181e846640 1 -- 172.21.15.19:0/4093147083 learned_addr learned my addr 172.21.15.19:0/4093147083 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:16.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.685+0000 7f181d844640 1 --2- 172.21.15.19:0/4093147083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1818103660 0x7f1818198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:16.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.685+0000 7f181e045640 1 --2- 172.21.15.19:0/4093147083 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1818102d40 0x7f18181983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:16.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.685+0000 7f181e846640 1 -- 172.21.15.19:0/4093147083 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1818102d40 msgr2=0x7f18181983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:16.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.685+0000 7f181e846640 1 --2- 172.21.15.19:0/4093147083 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1818102d40 0x7f18181983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.685+0000 7f181e846640 1 -- 172.21.15.19:0/4093147083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1818103660 msgr2=0x7f1818198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:16.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.685+0000 7f181e846640 1 --2- 172.21.15.19:0/4093147083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1818103660 0x7f1818198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.685+0000 7f181e846640 1 -- 172.21.15.19:0/4093147083 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f181819d390 con 0x7f181810c170 2024-09-19T09:04:16.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.685+0000 7f181e846640 1 --2- 172.21.15.19:0/4093147083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f181810c170 0x7f181819ccb0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f181000cce0 tx=0x7f181000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:16.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.685+0000 7f180f7fe640 1 -- 172.21.15.19:0/4093147083 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f181000f450 con 0x7f181810c170 2024-09-19T09:04:16.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.685+0000 7f18202a9640 1 -- 172.21.15.19:0/4093147083 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f181819d680 con 0x7f181810c170 2024-09-19T09:04:16.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.685+0000 7f180f7fe640 1 -- 172.21.15.19:0/4093147083 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f181000fad0 con 0x7f181810c170 2024-09-19T09:04:16.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.685+0000 7f180f7fe640 1 -- 172.21.15.19:0/4093147083 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1810018c10 con 0x7f181810c170 2024-09-19T09:04:16.696 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.685+0000 7f18202a9640 1 -- 172.21.15.19:0/4093147083 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18181a4f60 con 0x7f181810c170 2024-09-19T09:04:16.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.688+0000 7f180f7fe640 1 -- 172.21.15.19:0/4093147083 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f181000f5f0 con 0x7f181810c170 2024-09-19T09:04:16.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.688+0000 7f1822682740 1 Processor -- start 2024-09-19T09:04:16.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.688+0000 7f1822682740 1 -- start start 2024-09-19T09:04:16.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.688+0000 7f1822682740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56017ad584a0 0x56017ad58880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:16.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.688+0000 7f1822682740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56017ad58dc0 0x56017ad63140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:16.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.688+0000 7f1822682740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56017ad63680 0x56017ad65a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:16.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.688+0000 7f1822682740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56017acbe2e0 con 0x56017ad63680 2024-09-19T09:04:16.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.688+0000 7f1822682740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56017ac65ce0 con 0x56017ad584a0 2024-09-19T09:04:16.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.688+0000 7f1822682740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56017acba2a0 con 0x56017ad58dc0 2024-09-19T09:04:16.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.689+0000 7f181d844640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56017ad63680 0x56017ad65a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:16.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.689+0000 7f181d844640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56017ad63680 0x56017ad65a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60938/0 (socket says 172.21.15.19:60938) 2024-09-19T09:04:16.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.689+0000 7f181d844640 1 -- 172.21.15.19:0/1172194767 learned_addr learned my addr 172.21.15.19:0/1172194767 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:16.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.689+0000 7f181e045640 1 --2- 172.21.15.19:0/1172194767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56017ad58dc0 0x56017ad63140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:16.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.689+0000 7f180f7fe640 1 --2- 172.21.15.19:0/4093147083 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f18040a3240 0x7f18040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:16.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.689+0000 7f181d844640 1 --2- 172.21.15.19:0/1172194767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56017ad584a0 0x56017ad58880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:16.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.689+0000 7f181e045640 1 -- 172.21.15.19:0/1172194767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56017ad584a0 msgr2=0x56017ad58880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:16.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.689+0000 7f181e045640 1 --2- 172.21.15.19:0/1172194767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56017ad584a0 0x56017ad58880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.689+0000 7f181e045640 1 -- 172.21.15.19:0/1172194767 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56017ad63680 msgr2=0x56017ad65a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:16.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.689+0000 7f181e045640 1 --2- 172.21.15.19:0/1172194767 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56017ad63680 0x56017ad65a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.689+0000 7f181e045640 1 -- 172.21.15.19:0/1172194767 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56017ac4a440 con 0x56017ad58dc0 2024-09-19T09:04:16.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.689+0000 7f181e846640 1 --2- 172.21.15.19:0/4093147083 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f18040a3240 0x7f18040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:16.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.689+0000 7f180f7fe640 1 -- 172.21.15.19:0/4093147083 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f18100cfea0 con 0x7f181810c170 2024-09-19T09:04:16.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.689+0000 7f181e045640 1 --2- 172.21.15.19:0/1172194767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56017ad58dc0 0x56017ad63140 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f181400bbf0 tx=0x7f18140107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3f4864f056cfbcc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:16.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.689+0000 7f181e846640 1 --2- 172.21.15.19:0/4093147083 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f18040a3240 0x7f18040a5700 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f181000ccb0 tx=0x7f1810066ef0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:16.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.690+0000 7f180cdea640 1 -- 172.21.15.19:0/1172194767 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1814004030 con 0x56017ad58dc0 2024-09-19T09:04:16.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.690+0000 7f180cdea640 1 -- 172.21.15.19:0/1172194767 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18140041d0 con 0x56017ad58dc0 2024-09-19T09:04:16.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.690+0000 7f180cdea640 1 -- 172.21.15.19:0/1172194767 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1814011680 con 0x56017ad58dc0 2024-09-19T09:04:16.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.690+0000 7f1822682740 1 -- 172.21.15.19:0/1172194767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56017ad58dc0 msgr2=0x56017ad63140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:16.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.690+0000 7f1822682740 1 --2- 172.21.15.19:0/1172194767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56017ad58dc0 0x56017ad63140 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f181400bbf0 tx=0x7f18140107a0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.690+0000 7f1822682740 1 -- 172.21.15.19:0/1172194767 shutdown_connections 2024-09-19T09:04:16.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.690+0000 7f1822682740 1 --2- 172.21.15.19:0/1172194767 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56017ad58dc0 0x56017ad63140 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.690+0000 7f1822682740 1 --2- 172.21.15.19:0/1172194767 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56017ad63680 0x56017ad65a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.690+0000 7f1822682740 1 --2- 172.21.15.19:0/1172194767 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56017ad584a0 0x56017ad58880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.690+0000 7f1822682740 1 -- 172.21.15.19:0/1172194767 >> 172.21.15.19:0/1172194767 conn(0x56017ad54a30 msgr2=0x56017ad54e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:16.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.690+0000 7f1822682740 1 -- 172.21.15.19:0/1172194767 shutdown_connections 2024-09-19T09:04:16.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.690+0000 7f1822682740 1 -- 172.21.15.19:0/1172194767 wait complete. 2024-09-19T09:04:16.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.691+0000 7f1822682740 1 -- start start 2024-09-19T09:04:16.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.691+0000 7f1822682740 1 Processor -- start 2024-09-19T09:04:16.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.691+0000 7f1822682740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56017ad584a0 0x56017ad62f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:16.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.691+0000 7f1822682740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56017ad58dc0 0x56017ad601b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:16.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.691+0000 7f1822682740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56017ad63680 0x56017ad606f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:16.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.691+0000 7f1822682740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x56017ad66250 con 0x56017ad584a0 2024-09-19T09:04:16.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.691+0000 7f1822682740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x56017ac79050 con 0x56017ad63680 2024-09-19T09:04:16.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.691+0000 7f1822682740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56017ad663d0 con 0x56017ad58dc0 2024-09-19T09:04:16.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.691+0000 7f1822682740 10 client.0 _ll_register_callbacks cb 0x56017acb9160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:16.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.691+0000 7f181d844640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56017ad584a0 0x56017ad62f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:16.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.691+0000 7f181d844640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56017ad584a0 0x56017ad62f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60944/0 (socket says 172.21.15.19:60944) 2024-09-19T09:04:16.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.691+0000 7f181d844640 1 -- 172.21.15.19:0/3900561084 learned_addr learned my addr 172.21.15.19:0/3900561084 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:16.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.691+0000 7f181e045640 1 --2- 172.21.15.19:0/3900561084 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56017ad58dc0 0x56017ad601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:16.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.692+0000 7f181d844640 1 -- 172.21.15.19:0/3900561084 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56017ad58dc0 msgr2=0x56017ad601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:16.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.692+0000 7f181d844640 1 --2- 172.21.15.19:0/3900561084 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56017ad58dc0 0x56017ad601b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.692+0000 7f181d844640 1 -- 172.21.15.19:0/3900561084 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56017ad63680 msgr2=0x56017ad606f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:16.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.692+0000 7f181d844640 1 --2- 172.21.15.19:0/3900561084 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56017ad63680 0x56017ad606f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.692+0000 7f181d844640 1 -- 172.21.15.19:0/3900561084 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56017aa2f3c0 con 0x56017ad584a0 2024-09-19T09:04:16.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.692+0000 7f181e045640 1 --2- 172.21.15.19:0/3900561084 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56017ad58dc0 0x56017ad601b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:16.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.692+0000 7f181d844640 1 --2- 172.21.15.19:0/3900561084 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56017ad584a0 0x56017ad62f00 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f1808005940 tx=0x7f1808031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1524ea65809e092e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:16.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.692+0000 7f1801ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:04:16.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.692+0000 7f1801ffb640 1 -- 172.21.15.19:0/3900561084 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1808044070 con 0x56017ad584a0 2024-09-19T09:04:16.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.692+0000 7f1801ffb640 1 -- 172.21.15.19:0/3900561084 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f1808004240 con 0x56017ad584a0 2024-09-19T09:04:16.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.692+0000 7f1822682740 1 -- 172.21.15.19:0/3900561084 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18140041d0 con 0x56017ad584a0 2024-09-19T09:04:16.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.692+0000 7f1801ffb640 1 -- 172.21.15.19:0/3900561084 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f1808035040 con 0x56017ad584a0 2024-09-19T09:04:16.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.692+0000 7f1822682740 10 client.18690 fetch_fsmap learned FSMap version 43 2024-09-19T09:04:16.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.692+0000 7f1822682740 1 -- 172.21.15.19:0/3900561084 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x56017ad71b90 con 0x56017ad584a0 2024-09-19T09:04:16.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.693+0000 7f1801ffb640 1 -- 172.21.15.19:0/3900561084 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f18140041d0 con 0x56017ad584a0 2024-09-19T09:04:16.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.693+0000 7f1801ffb640 1 -- 172.21.15.19:0/3900561084 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7f1808004b20 con 0x56017ad584a0 2024-09-19T09:04:16.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.693+0000 7f1822682740 10 client.18690 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T09:04:16.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.693+0000 7f1822682740 10 client.18690 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:04:16.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.693+0000 7f1822682740 20 client.18690 populate_metadata read hostname 'smithi019' 2024-09-19T09:04:16.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.693+0000 7f1822682740 1 --2- 172.21.15.19:0/3900561084 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56017ad73050 0x56017ad75440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:16.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.693+0000 7f1822682740 4 client.18690 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:16.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.693+0000 7f1822682740 1 -- 172.21.15.19:0/3900561084 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56017accb850 con 0x56017ad73050 2024-09-19T09:04:16.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.693+0000 7f181e045640 1 --2- 172.21.15.19:0/3900561084 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56017ad73050 0x56017ad75440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:16.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.694+0000 7f181e045640 1 --2- 172.21.15.19:0/3900561084 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56017ad73050 0x56017ad75440 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e72ca3c52ab8e535 server_cookie=146f0bce3b246bce in_seq=0 out_seq=0 2024-09-19T09:04:16.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.694+0000 7f1801ffb640 10 client.18690 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:04:16.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.694+0000 7f1801ffb640 1 -- 172.21.15.19:0/3900561084 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56017accb850 con 0x56017ad73050 2024-09-19T09:04:16.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.694+0000 7f1801ffb640 10 client.18690 handle_command_reply: tid=0 2024-09-19T09:04:16.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.695+0000 7f1822682740 1 client.18690 shutdown 2024-09-19T09:04:16.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.695+0000 7f1822682740 1 -- 172.21.15.19:0/3900561084 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56017ad584a0 msgr2=0x56017ad62f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:16.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.695+0000 7f1822682740 1 --2- 172.21.15.19:0/3900561084 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56017ad584a0 0x56017ad62f00 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f1808005940 tx=0x7f1808031400 comp rx=0 tx=0).stop 2024-09-19T09:04:16.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.695+0000 7f1822682740 1 -- 172.21.15.19:0/3900561084 shutdown_connections 2024-09-19T09:04:16.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.695+0000 7f1822682740 1 --2- 172.21.15.19:0/3900561084 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56017ad73050 0x56017ad75440 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.695+0000 7f1822682740 1 --2- 172.21.15.19:0/3900561084 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56017ad58dc0 0x56017ad601b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.695+0000 7f1822682740 1 --2- 172.21.15.19:0/3900561084 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56017ad63680 0x56017ad606f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.695+0000 7f1822682740 1 --2- 172.21.15.19:0/3900561084 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56017ad584a0 0x56017ad62f00 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.695+0000 7f1822682740 1 -- 172.21.15.19:0/3900561084 >> 172.21.15.19:0/3900561084 conn(0x56017ad54a30 msgr2=0x56017ad5a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:16.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.695+0000 7f1801ffb640 0 client.18690 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:04:16.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.695+0000 7f1822682740 1 -- 172.21.15.19:0/3900561084 shutdown_connections 2024-09-19T09:04:16.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.695+0000 7f1822682740 1 -- 172.21.15.19:0/3900561084 wait complete. 2024-09-19T09:04:16.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.695+0000 7f1822682740 20 client.18690 trim_cache size 0 max 16384 2024-09-19T09:04:16.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.712+0000 7f1822682740 1 Processor -- start 2024-09-19T09:04:16.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.712+0000 7f1822682740 1 -- start start 2024-09-19T09:04:16.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.712+0000 7f1822682740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56017ad54a30 0x56017ad5ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:16.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.712+0000 7f1822682740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56017ad584a0 0x56017ad7ad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:16.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.712+0000 7f1822682740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56017ad58dc0 0x56017ad7b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:16.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.712+0000 7f1822682740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f18181ad4a0 con 0x56017ad54a30 2024-09-19T09:04:16.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.712+0000 7f1822682740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f18181aefe0 con 0x56017ad584a0 2024-09-19T09:04:16.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.712+0000 7f1822682740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f18181adb70 con 0x56017ad58dc0 2024-09-19T09:04:16.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.713+0000 7f181d844640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56017ad54a30 0x56017ad5ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:16.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.713+0000 7f181d844640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56017ad54a30 0x56017ad5ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60954/0 (socket says 172.21.15.19:60954) 2024-09-19T09:04:16.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.713+0000 7f181d844640 1 -- 172.21.15.19:0/2803689201 learned_addr learned my addr 172.21.15.19:0/2803689201 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:16.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.713+0000 7f181e045640 1 --2- 172.21.15.19:0/2803689201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56017ad584a0 0x56017ad7ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:16.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.713+0000 7f181d844640 1 -- 172.21.15.19:0/2803689201 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56017ad58dc0 msgr2=0x56017ad7b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:16.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.713+0000 7f181d844640 1 --2- 172.21.15.19:0/2803689201 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56017ad58dc0 0x56017ad7b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.713+0000 7f181d844640 1 -- 172.21.15.19:0/2803689201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56017ad584a0 msgr2=0x56017ad7ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:16.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.713+0000 7f181d844640 1 --2- 172.21.15.19:0/2803689201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56017ad584a0 0x56017ad7ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.713+0000 7f181d844640 1 -- 172.21.15.19:0/2803689201 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56017ad5f160 con 0x56017ad54a30 2024-09-19T09:04:16.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.713+0000 7f181e045640 1 --2- 172.21.15.19:0/2803689201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56017ad584a0 0x56017ad7ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:16.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.713+0000 7f181d844640 1 --2- 172.21.15.19:0/2803689201 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56017ad54a30 0x56017ad5ea80 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f1808006010 tx=0x7f18080315f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f7730d016713ce3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:16.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.713+0000 7f1803fff640 1 -- 172.21.15.19:0/2803689201 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1808059030 con 0x56017ad54a30 2024-09-19T09:04:16.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.713+0000 7f1803fff640 1 -- 172.21.15.19:0/2803689201 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1808004ba0 con 0x56017ad54a30 2024-09-19T09:04:16.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.713+0000 7f1803fff640 1 -- 172.21.15.19:0/2803689201 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1808044070 con 0x56017ad54a30 2024-09-19T09:04:16.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.714+0000 7f1822682740 1 -- 172.21.15.19:0/2803689201 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56017ad54a30 msgr2=0x56017ad5ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:16.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.714+0000 7f1822682740 1 --2- 172.21.15.19:0/2803689201 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56017ad54a30 0x56017ad5ea80 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f1808006010 tx=0x7f18080315f0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.714+0000 7f1822682740 1 -- 172.21.15.19:0/2803689201 shutdown_connections 2024-09-19T09:04:16.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.714+0000 7f1822682740 1 --2- 172.21.15.19:0/2803689201 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56017ad58dc0 0x56017ad7b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.714+0000 7f1822682740 1 --2- 172.21.15.19:0/2803689201 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56017ad584a0 0x56017ad7ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.714+0000 7f1822682740 1 --2- 172.21.15.19:0/2803689201 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56017ad54a30 0x56017ad5ea80 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.714+0000 7f1822682740 1 -- 172.21.15.19:0/2803689201 >> 172.21.15.19:0/2803689201 conn(0x56017ad60850 msgr2=0x56017ad53b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:16.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.714+0000 7f1822682740 1 -- 172.21.15.19:0/2803689201 shutdown_connections 2024-09-19T09:04:16.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.714+0000 7f1822682740 1 -- 172.21.15.19:0/2803689201 wait complete. 2024-09-19T09:04:16.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.714+0000 7f1822682740 1 -- start start 2024-09-19T09:04:16.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.714+0000 7f1822682740 1 Processor -- start 2024-09-19T09:04:16.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.715+0000 7f1822682740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56017ad54a30 0x56017ad6bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:16.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.715+0000 7f1822682740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56017ad584a0 0x56017ad692a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:16.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.715+0000 7f1822682740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56017ad58dc0 0x56017ad69a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:16.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.715+0000 7f1822682740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f18181ae910 con 0x56017ad58dc0 2024-09-19T09:04:16.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.715+0000 7f1822682740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f18181ae240 con 0x56017ad584a0 2024-09-19T09:04:16.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.715+0000 7f1822682740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f18181ab480 con 0x56017ad54a30 2024-09-19T09:04:16.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.715+0000 7f1822682740 10 client.0 _ll_register_callbacks cb 0x7f1808032d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:16.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.715+0000 7f181d844640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56017ad58dc0 0x56017ad69a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:16.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.715+0000 7f181d844640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56017ad58dc0 0x56017ad69a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:60962/0 (socket says 172.21.15.19:60962) 2024-09-19T09:04:16.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.715+0000 7f181d844640 1 -- 172.21.15.19:0/3794824840 learned_addr learned my addr 172.21.15.19:0/3794824840 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:16.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.715+0000 7f181d844640 1 --2- 172.21.15.19:0/3794824840 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56017ad54a30 0x56017ad6bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:16.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.715+0000 7f181e045640 1 --2- 172.21.15.19:0/3794824840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56017ad584a0 0x56017ad692a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:16.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.715+0000 7f181d844640 1 -- 172.21.15.19:0/3794824840 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56017ad54a30 msgr2=0x56017ad6bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:16.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.715+0000 7f181d844640 1 --2- 172.21.15.19:0/3794824840 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56017ad54a30 0x56017ad6bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.715+0000 7f181d844640 1 -- 172.21.15.19:0/3794824840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56017ad584a0 msgr2=0x56017ad692a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:16.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.715+0000 7f181d844640 1 --2- 172.21.15.19:0/3794824840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56017ad584a0 0x56017ad692a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.715+0000 7f181d844640 1 -- 172.21.15.19:0/3794824840 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56017addccf0 con 0x56017ad58dc0 2024-09-19T09:04:16.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.715+0000 7f181d844640 1 --2- 172.21.15.19:0/3794824840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56017ad58dc0 0x56017ad69a30 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f18080053e0 tx=0x7f180804c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2024441459528e0c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:16.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.715+0000 7f1801ffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:04:16.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.715+0000 7f1801ffb640 1 -- 172.21.15.19:0/3794824840 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1808044040 con 0x56017ad58dc0 2024-09-19T09:04:16.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.715+0000 7f1801ffb640 1 -- 172.21.15.19:0/3794824840 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f1808003b60 con 0x56017ad58dc0 2024-09-19T09:04:16.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.715+0000 7f1822682740 1 -- 172.21.15.19:0/3794824840 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1808004ba0 con 0x56017ad58dc0 2024-09-19T09:04:16.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.716+0000 7f1801ffb640 1 -- 172.21.15.19:0/3794824840 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f1808003d60 con 0x56017ad58dc0 2024-09-19T09:04:16.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.716+0000 7f1822682740 10 client.18696 fetch_fsmap learned FSMap version 43 2024-09-19T09:04:16.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.716+0000 7f1822682740 1 -- 172.21.15.19:0/3794824840 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x56017addde30 con 0x56017ad58dc0 2024-09-19T09:04:16.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.716+0000 7f1801ffb640 1 -- 172.21.15.19:0/3794824840 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1808004ba0 con 0x56017ad58dc0 2024-09-19T09:04:16.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.716+0000 7f1801ffb640 1 -- 172.21.15.19:0/3794824840 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7f180806b020 con 0x56017ad58dc0 2024-09-19T09:04:16.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.716+0000 7f1822682740 10 client.18696 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T09:04:16.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.716+0000 7f1822682740 10 client.18696 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:04:16.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.716+0000 7f1822682740 20 client.18696 populate_metadata read hostname 'smithi019' 2024-09-19T09:04:16.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.716+0000 7f1822682740 1 --2- 172.21.15.19:0/3794824840 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56017ad63680 0x56017ade0350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:16.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.716+0000 7f1822682740 4 client.18696 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:04:16.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.716+0000 7f1822682740 1 -- 172.21.15.19:0/3794824840 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56017acc5d60 con 0x56017ad63680 2024-09-19T09:04:16.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.716+0000 7f181e045640 1 --2- 172.21.15.19:0/3794824840 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56017ad63680 0x56017ade0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:16.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.717+0000 7f181e045640 1 --2- 172.21.15.19:0/3794824840 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56017ad63680 0x56017ade0350 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e75199769f21bf2a server_cookie=4b56e62fbeea2c1b in_seq=0 out_seq=0 2024-09-19T09:04:16.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.717+0000 7f1801ffb640 10 client.18696 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:04:16.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.717+0000 7f1801ffb640 1 -- 172.21.15.19:0/3794824840 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56017acc5d60 con 0x56017ad63680 2024-09-19T09:04:16.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.717+0000 7f1801ffb640 10 client.18696 handle_command_reply: tid=0 2024-09-19T09:04:16.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.717+0000 7f1822682740 1 client.18696 shutdown 2024-09-19T09:04:16.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.717+0000 7f1822682740 1 -- 172.21.15.19:0/3794824840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56017ad58dc0 msgr2=0x56017ad69a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:16.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.717+0000 7f1822682740 1 --2- 172.21.15.19:0/3794824840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56017ad58dc0 0x56017ad69a30 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f18080053e0 tx=0x7f180804c040 comp rx=0 tx=0).stop 2024-09-19T09:04:16.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.717+0000 7f1822682740 1 -- 172.21.15.19:0/3794824840 shutdown_connections 2024-09-19T09:04:16.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.717+0000 7f1822682740 1 --2- 172.21.15.19:0/3794824840 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x56017ad63680 0x56017ade0350 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.717+0000 7f1822682740 1 --2- 172.21.15.19:0/3794824840 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x56017ad58dc0 0x56017ad69a30 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.717+0000 7f1801ffb640 0 client.18696 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:04:16.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.717+0000 7f1822682740 1 --2- 172.21.15.19:0/3794824840 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x56017ad584a0 0x56017ad692a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.717+0000 7f1822682740 1 --2- 172.21.15.19:0/3794824840 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56017ad54a30 0x56017ad6bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.717+0000 7f1822682740 1 -- 172.21.15.19:0/3794824840 >> 172.21.15.19:0/3794824840 conn(0x56017ad60850 msgr2=0x56017ad53b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:16.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.717+0000 7f1822682740 1 -- 172.21.15.19:0/3794824840 shutdown_connections 2024-09-19T09:04:16.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.718+0000 7f1822682740 1 -- 172.21.15.19:0/3794824840 wait complete. 2024-09-19T09:04:16.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.718+0000 7f1822682740 20 client.18696 trim_cache size 0 max 16384 2024-09-19T09:04:16.728 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T09:04:16.729 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T09:04:16.729 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": { 2024-09-19T09:04:16.729 INFO:teuthology.orchestra.run.smithi019.stdout: "d09a6ea2-bf0c-4adb-97be-7e192ebb2414": { 2024-09-19T09:04:16.729 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-19T09:04:16.729 INFO:teuthology.orchestra.run.smithi019.stdout: "tag": "d09a6ea2-bf0c-4adb-97be-7e192ebb2414", 2024-09-19T09:04:16.729 INFO:teuthology.orchestra.run.smithi019.stdout: "options": "recursive,force" 2024-09-19T09:04:16.729 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:04:16.729 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:04:16.730 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T09:04:16.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.718+0000 7f18202a9640 1 -- 172.21.15.19:0/4093147083 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f18040a3240 msgr2=0x7f18040a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:16.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.718+0000 7f18202a9640 1 --2- 172.21.15.19:0/4093147083 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f18040a3240 0x7f18040a5700 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f181000ccb0 tx=0x7f1810066ef0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.718+0000 7f18202a9640 1 -- 172.21.15.19:0/4093147083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f181810c170 msgr2=0x7f181819ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:16.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.718+0000 7f18202a9640 1 --2- 172.21.15.19:0/4093147083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f181810c170 0x7f181819ccb0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f181000cce0 tx=0x7f181000a620 comp rx=0 tx=0).stop 2024-09-19T09:04:16.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.718+0000 7f18202a9640 1 -- 172.21.15.19:0/4093147083 shutdown_connections 2024-09-19T09:04:16.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.718+0000 7f18202a9640 1 --2- 172.21.15.19:0/4093147083 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f18040a3240 0x7f18040a5700 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.718+0000 7f18202a9640 1 --2- 172.21.15.19:0/4093147083 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f181810c170 0x7f181819ccb0 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.718+0000 7f18202a9640 1 --2- 172.21.15.19:0/4093147083 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1818103660 0x7f1818198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.718+0000 7f18202a9640 1 --2- 172.21.15.19:0/4093147083 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1818102d40 0x7f18181983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:16.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.718+0000 7f18202a9640 1 -- 172.21.15.19:0/4093147083 >> 172.21.15.19:0/4093147083 conn(0x7f18180fc7a0 msgr2=0x7f18180fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:16.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.718+0000 7f18202a9640 1 -- 172.21.15.19:0/4093147083 shutdown_connections 2024-09-19T09:04:16.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:16.718+0000 7f18202a9640 1 -- 172.21.15.19:0/4093147083 wait complete. 2024-09-19T09:04:17.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:17 smithi019 ceph-mon[30976]: pgmap v705: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.4 KiB/s wr, 17 op/s 2024-09-19T09:04:17.522 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:17 smithi019 ceph-mon[30976]: scrub summary: idle 2024-09-19T09:04:17.555 INFO:tasks.cephfs.filesystem:scrub status for tag:d09a6ea2-bf0c-4adb-97be-7e192ebb2414 - {'path': '/', 'tag': 'd09a6ea2-bf0c-4adb-97be-7e192ebb2414', 'options': 'recursive,force'} 2024-09-19T09:04:17.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:17 smithi155 ceph-mon[34921]: pgmap v705: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.4 KiB/s wr, 17 op/s 2024-09-19T09:04:17.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:17 smithi155 ceph-mon[34921]: scrub summary: idle 2024-09-19T09:04:17.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:17 smithi203 ceph-mon[35450]: pgmap v705: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.4 KiB/s wr, 17 op/s 2024-09-19T09:04:17.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:17 smithi203 ceph-mon[35450]: scrub summary: idle 2024-09-19T09:04:19.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:19 smithi019 ceph-mon[30976]: pgmap v706: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.6 KiB/s wr, 16 op/s 2024-09-19T09:04:19.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:19 smithi155 ceph-mon[34921]: pgmap v706: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.6 KiB/s wr, 16 op/s 2024-09-19T09:04:19.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:19 smithi203 ceph-mon[35450]: pgmap v706: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.6 KiB/s wr, 16 op/s 2024-09-19T09:04:21.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:21 smithi019 ceph-mon[30976]: pgmap v707: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 16 op/s 2024-09-19T09:04:21.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:21 smithi155 ceph-mon[34921]: pgmap v707: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 16 op/s 2024-09-19T09:04:21.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:21 smithi203 ceph-mon[35450]: pgmap v707: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 16 op/s 2024-09-19T09:04:23.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:23 smithi019 ceph-mon[30976]: pgmap v708: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 5.2 KiB/s wr, 15 op/s 2024-09-19T09:04:23.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:23 smithi155 ceph-mon[34921]: pgmap v708: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 5.2 KiB/s wr, 15 op/s 2024-09-19T09:04:23.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:23 smithi203 ceph-mon[35450]: pgmap v708: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 5.2 KiB/s wr, 15 op/s 2024-09-19T09:04:25.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:25 smithi019 ceph-mon[30976]: pgmap v709: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-19T09:04:25.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:25 smithi155 ceph-mon[34921]: pgmap v709: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-19T09:04:25.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:25 smithi203 ceph-mon[35450]: pgmap v709: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 938 B/s wr, 13 op/s 2024-09-19T09:04:27.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:27 smithi019 ceph-mon[30976]: pgmap v710: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-19T09:04:27.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:27 smithi155 ceph-mon[34921]: pgmap v710: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-19T09:04:27.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:27 smithi203 ceph-mon[35450]: pgmap v710: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-19T09:04:29.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:29 smithi019 ceph-mon[30976]: pgmap v711: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-19T09:04:29.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:29 smithi155 ceph-mon[34921]: pgmap v711: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-19T09:04:29.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:29 smithi203 ceph-mon[35450]: pgmap v711: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-19T09:04:31.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:31 smithi019 ceph-mon[30976]: pgmap v712: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-19T09:04:31.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:31 smithi155 ceph-mon[34921]: pgmap v712: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-19T09:04:31.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:31 smithi203 ceph-mon[35450]: pgmap v712: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s 2024-09-19T09:04:33.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:33 smithi019 ceph-mon[30976]: pgmap v713: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-19T09:04:33.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:33 smithi155 ceph-mon[34921]: pgmap v713: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-19T09:04:33.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:33 smithi203 ceph-mon[35450]: pgmap v713: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-19T09:04:35.569 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:35 smithi019 ceph-mon[30976]: pgmap v714: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:04:35.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:35 smithi155 ceph-mon[34921]: pgmap v714: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:04:35.732 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:35 smithi203 ceph-mon[35450]: pgmap v714: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:04:37.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:37 smithi155 ceph-mon[34921]: pgmap v715: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:04:37.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:37 smithi203 ceph-mon[35450]: pgmap v715: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:04:38.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:37 smithi019 ceph-mon[30976]: pgmap v715: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:04:39.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:39 smithi155 ceph-mon[34921]: pgmap v716: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:04:39.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:39 smithi203 ceph-mon[35450]: pgmap v716: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:04:40.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:39 smithi019 ceph-mon[30976]: pgmap v716: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:04:41.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:41 smithi155 ceph-mon[34921]: pgmap v717: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2024-09-19T09:04:41.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:41 smithi203 ceph-mon[35450]: pgmap v717: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2024-09-19T09:04:42.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:41 smithi019 ceph-mon[30976]: pgmap v717: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2024-09-19T09:04:43.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:43 smithi155 ceph-mon[34921]: pgmap v718: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-19T09:04:43.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:43 smithi203 ceph-mon[35450]: pgmap v718: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-19T09:04:44.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:43 smithi019 ceph-mon[30976]: pgmap v718: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-19T09:04:45.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:45 smithi155 ceph-mon[34921]: pgmap v719: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:04:45.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:45 smithi203 ceph-mon[35450]: pgmap v719: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:04:46.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:45 smithi019 ceph-mon[30976]: pgmap v719: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:04:47.557 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T09:04:47.834 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:47.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:47 smithi155 ceph-mon[34921]: pgmap v720: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:04:47.956 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:47 smithi019 ceph-mon[30976]: pgmap v720: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:04:47.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:47 smithi203 ceph-mon[35450]: pgmap v720: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:04:48.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.376+0000 7f9327873640 1 -- 172.21.15.19:0/3018044337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9320105f30 msgr2=0x7f93201063c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:48.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.376+0000 7f9327873640 1 --2- 172.21.15.19:0/3018044337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9320105f30 0x7f93201063c0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f9318009900 tx=0x7f931802a470 comp rx=0 tx=0).stop 2024-09-19T09:04:48.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.376+0000 7f9327873640 1 -- 172.21.15.19:0/3018044337 shutdown_connections 2024-09-19T09:04:48.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.376+0000 7f9327873640 1 --2- 172.21.15.19:0/3018044337 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9320101440 0x7f9320105910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:48.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.376+0000 7f9327873640 1 --2- 172.21.15.19:0/3018044337 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9320105f30 0x7f93201063c0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:48.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.376+0000 7f9327873640 1 --2- 172.21.15.19:0/3018044337 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9320100b20 0x7f9320100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:48.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.376+0000 7f9327873640 1 -- 172.21.15.19:0/3018044337 >> 172.21.15.19:0/3018044337 conn(0x7f93200fc790 msgr2=0x7f93200febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:48.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.376+0000 7f9327873640 1 -- 172.21.15.19:0/3018044337 shutdown_connections 2024-09-19T09:04:48.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.376+0000 7f9327873640 1 -- 172.21.15.19:0/3018044337 wait complete. 2024-09-19T09:04:48.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.376+0000 7f9327873640 1 Processor -- start 2024-09-19T09:04:48.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.377+0000 7f9327873640 1 -- start start 2024-09-19T09:04:48.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.377+0000 7f9327873640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9320100b20 0x7f93201a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:48.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.377+0000 7f9327873640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9320101440 0x7f93201a4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:48.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.377+0000 7f9327873640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9320105f30 0x7f932019e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:48.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.377+0000 7f9327873640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f93201185e0 con 0x7f9320105f30 2024-09-19T09:04:48.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.377+0000 7f9327873640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9320118460 con 0x7f9320100b20 2024-09-19T09:04:48.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.377+0000 7f9327873640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9320118760 con 0x7f9320101440 2024-09-19T09:04:48.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.377+0000 7f9325e10640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9320105f30 0x7f932019e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:48.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.377+0000 7f9325e10640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9320105f30 0x7f932019e8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59650/0 (socket says 172.21.15.19:59650) 2024-09-19T09:04:48.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.377+0000 7f9325e10640 1 -- 172.21.15.19:0/3907181773 learned_addr learned my addr 172.21.15.19:0/3907181773 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:48.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.377+0000 7f932560f640 1 --2- 172.21.15.19:0/3907181773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9320100b20 0x7f93201a46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:48.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.377+0000 7f9324e0e640 1 --2- 172.21.15.19:0/3907181773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9320101440 0x7f93201a4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:48.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.377+0000 7f9325e10640 1 -- 172.21.15.19:0/3907181773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9320101440 msgr2=0x7f93201a4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:48.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.377+0000 7f9325e10640 1 --2- 172.21.15.19:0/3907181773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9320101440 0x7f93201a4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:48.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.377+0000 7f9325e10640 1 -- 172.21.15.19:0/3907181773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9320100b20 msgr2=0x7f93201a46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:48.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.377+0000 7f9325e10640 1 --2- 172.21.15.19:0/3907181773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9320100b20 0x7f93201a46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:48.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.377+0000 7f9325e10640 1 -- 172.21.15.19:0/3907181773 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f932019efe0 con 0x7f9320105f30 2024-09-19T09:04:48.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.377+0000 7f9325e10640 1 --2- 172.21.15.19:0/3907181773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9320105f30 0x7f932019e8b0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f9318005ab0 tx=0x7f93180042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:48.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.378+0000 7f93167fc640 1 -- 172.21.15.19:0/3907181773 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931803f030 con 0x7f9320105f30 2024-09-19T09:04:48.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.378+0000 7f93167fc640 1 -- 172.21.15.19:0/3907181773 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9318003ce0 con 0x7f9320105f30 2024-09-19T09:04:48.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.378+0000 7f93167fc640 1 -- 172.21.15.19:0/3907181773 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9318035070 con 0x7f9320105f30 2024-09-19T09:04:48.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.378+0000 7f9327873640 1 -- 172.21.15.19:0/3907181773 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f932019f270 con 0x7f9320105f30 2024-09-19T09:04:48.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.378+0000 7f9327873640 1 -- 172.21.15.19:0/3907181773 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93201ab5c0 con 0x7f9320105f30 2024-09-19T09:04:48.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.380+0000 7f93167fc640 1 -- 172.21.15.19:0/3907181773 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f9318042030 con 0x7f9320105f30 2024-09-19T09:04:48.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.380+0000 7f9329c4c740 1 Processor -- start 2024-09-19T09:04:48.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.380+0000 7f9329c4c740 1 -- start start 2024-09-19T09:04:48.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.380+0000 7f9329c4c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617eb85f4a0 0x5617eb85f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:48.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.381+0000 7f9329c4c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617eb85fdc0 0x5617eb86a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:48.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.381+0000 7f9329c4c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617eb86a680 0x5617eb86ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:48.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.381+0000 7f9329c4c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5617eb7c52e0 con 0x5617eb85f4a0 2024-09-19T09:04:48.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.381+0000 7f9329c4c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5617eb76cce0 con 0x5617eb85fdc0 2024-09-19T09:04:48.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.381+0000 7f9329c4c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5617eb7c12a0 con 0x5617eb86a680 2024-09-19T09:04:48.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.381+0000 7f9324e0e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617eb85f4a0 0x5617eb85f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:48.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.381+0000 7f93167fc640 1 --2- 172.21.15.19:0/3907181773 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f930c0a32c0 0x7f930c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:48.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.381+0000 7f9324e0e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617eb85f4a0 0x5617eb85f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59654/0 (socket says 172.21.15.19:59654) 2024-09-19T09:04:48.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.381+0000 7f9324e0e640 1 -- 172.21.15.19:0/2625815331 learned_addr learned my addr 172.21.15.19:0/2625815331 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:48.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.381+0000 7f932560f640 1 --2- 172.21.15.19:0/2625815331 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617eb85fdc0 0x5617eb86a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:48.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.381+0000 7f9325e10640 1 --2- 172.21.15.19:0/3907181773 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f930c0a32c0 0x7f930c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:48.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.381+0000 7f9324e0e640 1 --2- 172.21.15.19:0/2625815331 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617eb86a680 0x5617eb86ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:48.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.381+0000 7f9324e0e640 1 -- 172.21.15.19:0/2625815331 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617eb86a680 msgr2=0x5617eb86ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:48.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.381+0000 7f9324e0e640 1 --2- 172.21.15.19:0/2625815331 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617eb86a680 0x5617eb86ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:48.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.381+0000 7f9324e0e640 1 -- 172.21.15.19:0/2625815331 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617eb85fdc0 msgr2=0x5617eb86a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:48.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.381+0000 7f9324e0e640 1 --2- 172.21.15.19:0/2625815331 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617eb85fdc0 0x5617eb86a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:48.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.381+0000 7f9324e0e640 1 -- 172.21.15.19:0/2625815331 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617eb751440 con 0x5617eb85f4a0 2024-09-19T09:04:48.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.381+0000 7f93167fc640 1 -- 172.21.15.19:0/3907181773 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f93180f0040 con 0x7f9320105f30 2024-09-19T09:04:48.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.381+0000 7f9324e0e640 1 --2- 172.21.15.19:0/2625815331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617eb85f4a0 0x5617eb85f880 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f931000bb30 tx=0x7f9310004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db2089b6fde3e528 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:48.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.381+0000 7f9325e10640 1 --2- 172.21.15.19:0/3907181773 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f930c0a32c0 0x7f930c0a5780 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f9318004650 tx=0x7f9318087100 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:48.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.382+0000 7f930b7fe640 1 -- 172.21.15.19:0/2625815331 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9310005020 con 0x5617eb85f4a0 2024-09-19T09:04:48.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.382+0000 7f930b7fe640 1 -- 172.21.15.19:0/2625815331 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93100056a0 con 0x5617eb85f4a0 2024-09-19T09:04:48.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.382+0000 7f930b7fe640 1 -- 172.21.15.19:0/2625815331 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93100106a0 con 0x5617eb85f4a0 2024-09-19T09:04:48.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.382+0000 7f9329c4c740 1 -- 172.21.15.19:0/2625815331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617eb85f4a0 msgr2=0x5617eb85f880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:48.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.382+0000 7f9329c4c740 1 --2- 172.21.15.19:0/2625815331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617eb85f4a0 0x5617eb85f880 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f931000bb30 tx=0x7f9310004610 comp rx=0 tx=0).stop 2024-09-19T09:04:48.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.382+0000 7f9329c4c740 1 -- 172.21.15.19:0/2625815331 shutdown_connections 2024-09-19T09:04:48.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.382+0000 7f9329c4c740 1 --2- 172.21.15.19:0/2625815331 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617eb86a680 0x5617eb86ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:48.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.382+0000 7f9329c4c740 1 --2- 172.21.15.19:0/2625815331 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617eb85fdc0 0x5617eb86a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:48.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.382+0000 7f9329c4c740 1 --2- 172.21.15.19:0/2625815331 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617eb85f4a0 0x5617eb85f880 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:48.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.382+0000 7f9329c4c740 1 -- 172.21.15.19:0/2625815331 >> 172.21.15.19:0/2625815331 conn(0x5617eb85ba30 msgr2=0x5617eb85be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:48.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.382+0000 7f9329c4c740 1 -- 172.21.15.19:0/2625815331 shutdown_connections 2024-09-19T09:04:48.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.382+0000 7f9329c4c740 1 -- 172.21.15.19:0/2625815331 wait complete. 2024-09-19T09:04:48.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.383+0000 7f9329c4c740 1 -- start start 2024-09-19T09:04:48.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.383+0000 7f9329c4c740 1 Processor -- start 2024-09-19T09:04:48.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.383+0000 7f9329c4c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617eb85f4a0 0x5617eb869f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:48.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.383+0000 7f9329c4c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617eb85fdc0 0x5617eb8671e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:48.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.383+0000 7f9329c4c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617eb86a680 0x5617eb867720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:48.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.383+0000 7f9329c4c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x5617eb86d250 con 0x5617eb85fdc0 2024-09-19T09:04:48.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.383+0000 7f9329c4c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x5617eb780050 con 0x5617eb85f4a0 2024-09-19T09:04:48.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.383+0000 7f9329c4c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5617eb86d3d0 con 0x5617eb86a680 2024-09-19T09:04:48.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.383+0000 7f9329c4c740 10 client.0 _ll_register_callbacks cb 0x5617eb7c0160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:48.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.383+0000 7f932560f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617eb85fdc0 0x5617eb8671e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:48.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.383+0000 7f932560f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617eb85fdc0 0x5617eb8671e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59668/0 (socket says 172.21.15.19:59668) 2024-09-19T09:04:48.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.383+0000 7f932560f640 1 -- 172.21.15.19:0/3492749684 learned_addr learned my addr 172.21.15.19:0/3492749684 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:48.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.383+0000 7f9324e0e640 1 --2- 172.21.15.19:0/3492749684 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617eb85f4a0 0x5617eb869f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:48.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.384+0000 7f9324e0e640 1 --2- 172.21.15.19:0/3492749684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617eb86a680 0x5617eb867720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:48.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.384+0000 7f932560f640 1 -- 172.21.15.19:0/3492749684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617eb86a680 msgr2=0x5617eb867720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:48.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.384+0000 7f932560f640 1 --2- 172.21.15.19:0/3492749684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617eb86a680 0x5617eb867720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:48.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.384+0000 7f932560f640 1 -- 172.21.15.19:0/3492749684 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617eb85f4a0 msgr2=0x5617eb869f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:48.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.384+0000 7f932560f640 1 --2- 172.21.15.19:0/3492749684 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617eb85f4a0 0x5617eb869f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:48.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.384+0000 7f932560f640 1 -- 172.21.15.19:0/3492749684 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617eb5363c0 con 0x5617eb85fdc0 2024-09-19T09:04:48.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.384+0000 7f9324e0e640 1 --2- 172.21.15.19:0/3492749684 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617eb85f4a0 0x5617eb869f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:48.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.384+0000 7f932560f640 1 --2- 172.21.15.19:0/3492749684 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617eb85fdc0 0x5617eb8671e0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f931c00ab30 tx=0x7f931c0111b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ab3fa1f71051ab5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:48.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.384+0000 7f9308ff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:04:48.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.384+0000 7f9308ff9640 1 -- 172.21.15.19:0/3492749684 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931c01a070 con 0x5617eb85fdc0 2024-09-19T09:04:48.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.384+0000 7f9329c4c740 1 -- 172.21.15.19:0/3492749684 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93100056a0 con 0x5617eb85fdc0 2024-09-19T09:04:48.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.384+0000 7f9308ff9640 1 -- 172.21.15.19:0/3492749684 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f931c011df0 con 0x5617eb85fdc0 2024-09-19T09:04:48.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.384+0000 7f9308ff9640 1 -- 172.21.15.19:0/3492749684 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f931c026050 con 0x5617eb85fdc0 2024-09-19T09:04:48.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.384+0000 7f9329c4c740 10 client.18708 fetch_fsmap learned FSMap version 43 2024-09-19T09:04:48.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.384+0000 7f9329c4c740 1 -- 172.21.15.19:0/3492749684 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x5617eb878bd0 con 0x5617eb85fdc0 2024-09-19T09:04:48.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.384+0000 7f9308ff9640 1 -- 172.21.15.19:0/3492749684 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f93100056a0 con 0x5617eb85fdc0 2024-09-19T09:04:48.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.385+0000 7f9308ff9640 1 -- 172.21.15.19:0/3492749684 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7f931c01e710 con 0x5617eb85fdc0 2024-09-19T09:04:48.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.385+0000 7f9329c4c740 10 client.18708 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T09:04:48.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.385+0000 7f9329c4c740 10 client.18708 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:04:48.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.385+0000 7f9329c4c740 20 client.18708 populate_metadata read hostname 'smithi019' 2024-09-19T09:04:48.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.385+0000 7f9329c4c740 1 --2- 172.21.15.19:0/3492749684 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5617eb87a170 0x5617eb87c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:48.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.385+0000 7f9329c4c740 4 client.18708 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:48.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.385+0000 7f9329c4c740 1 -- 172.21.15.19:0/3492749684 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617eb7d2850 con 0x5617eb87a170 2024-09-19T09:04:48.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.385+0000 7f9324e0e640 1 --2- 172.21.15.19:0/3492749684 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5617eb87a170 0x5617eb87c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:48.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.386+0000 7f9324e0e640 1 --2- 172.21.15.19:0/3492749684 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5617eb87a170 0x5617eb87c560 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21188d10a148dd84 server_cookie=d5a22a8dbcaa62ac in_seq=0 out_seq=0 2024-09-19T09:04:48.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.386+0000 7f9308ff9640 10 client.18708 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:04:48.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.386+0000 7f9308ff9640 1 -- 172.21.15.19:0/3492749684 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5617eb7d2850 con 0x5617eb87a170 2024-09-19T09:04:48.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.386+0000 7f9308ff9640 10 client.18708 handle_command_reply: tid=0 2024-09-19T09:04:48.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.386+0000 7f9329c4c740 1 client.18708 shutdown 2024-09-19T09:04:48.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.386+0000 7f9329c4c740 1 -- 172.21.15.19:0/3492749684 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617eb85fdc0 msgr2=0x5617eb8671e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:48.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.386+0000 7f9329c4c740 1 --2- 172.21.15.19:0/3492749684 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617eb85fdc0 0x5617eb8671e0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f931c00ab30 tx=0x7f931c0111b0 comp rx=0 tx=0).stop 2024-09-19T09:04:48.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.386+0000 7f9329c4c740 1 -- 172.21.15.19:0/3492749684 shutdown_connections 2024-09-19T09:04:48.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.386+0000 7f9329c4c740 1 --2- 172.21.15.19:0/3492749684 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5617eb87a170 0x5617eb87c560 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:48.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.386+0000 7f9329c4c740 1 --2- 172.21.15.19:0/3492749684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617eb86a680 0x5617eb867720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:48.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.386+0000 7f9329c4c740 1 --2- 172.21.15.19:0/3492749684 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617eb85fdc0 0x5617eb8671e0 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:48.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.386+0000 7f9329c4c740 1 --2- 172.21.15.19:0/3492749684 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617eb85f4a0 0x5617eb869f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:48.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.386+0000 7f9308ff9640 0 client.18708 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:04:48.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.386+0000 7f9329c4c740 1 -- 172.21.15.19:0/3492749684 >> 172.21.15.19:0/3492749684 conn(0x5617eb85ba30 msgr2=0x5617eb861760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:48.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.387+0000 7f9329c4c740 1 -- 172.21.15.19:0/3492749684 shutdown_connections 2024-09-19T09:04:48.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.387+0000 7f9329c4c740 1 -- 172.21.15.19:0/3492749684 wait complete. 2024-09-19T09:04:48.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.387+0000 7f9329c4c740 20 client.18708 trim_cache size 0 max 16384 2024-09-19T09:04:48.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.404+0000 7f9329c4c740 1 Processor -- start 2024-09-19T09:04:48.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.404+0000 7f9329c4c740 1 -- start start 2024-09-19T09:04:48.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.404+0000 7f9329c4c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617eb85f4a0 0x5617eb85be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:48.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.404+0000 7f9329c4c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617eb85fdc0 0x5617eb869150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:48.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.404+0000 7f9329c4c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617eb86a680 0x5617eb881d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:48.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.404+0000 7f9329c4c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f93201b3b90 con 0x5617eb86a680 2024-09-19T09:04:48.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.404+0000 7f9329c4c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f93201b56d0 con 0x5617eb85fdc0 2024-09-19T09:04:48.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.404+0000 7f9329c4c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f93201b4260 con 0x5617eb85f4a0 2024-09-19T09:04:48.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.404+0000 7f9324e0e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617eb86a680 0x5617eb881d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:48.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.404+0000 7f9324e0e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617eb86a680 0x5617eb881d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59680/0 (socket says 172.21.15.19:59680) 2024-09-19T09:04:48.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.404+0000 7f9324e0e640 1 -- 172.21.15.19:0/554387131 learned_addr learned my addr 172.21.15.19:0/554387131 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:48.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.404+0000 7f9324e0e640 1 -- 172.21.15.19:0/554387131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617eb85f4a0 msgr2=0x5617eb85be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:48.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.404+0000 7f9324e0e640 1 --2- 172.21.15.19:0/554387131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617eb85f4a0 0x5617eb85be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:48.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.404+0000 7f9324e0e640 1 -- 172.21.15.19:0/554387131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617eb85fdc0 msgr2=0x5617eb869150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:48.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.404+0000 7f9324e0e640 1 --2- 172.21.15.19:0/554387131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617eb85fdc0 0x5617eb869150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:48.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.404+0000 7f9324e0e640 1 -- 172.21.15.19:0/554387131 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617eb85fbf0 con 0x5617eb86a680 2024-09-19T09:04:48.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.404+0000 7f9324e0e640 1 --2- 172.21.15.19:0/554387131 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617eb86a680 0x5617eb881d90 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f9310003fd0 tx=0x7f9310004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f7413de1dc9f90 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:48.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.405+0000 7f930affd640 1 -- 172.21.15.19:0/554387131 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9310030070 con 0x5617eb86a680 2024-09-19T09:04:48.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.405+0000 7f930affd640 1 -- 172.21.15.19:0/554387131 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9310004b10 con 0x5617eb86a680 2024-09-19T09:04:48.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.405+0000 7f930affd640 1 -- 172.21.15.19:0/554387131 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f931002b950 con 0x5617eb86a680 2024-09-19T09:04:48.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.405+0000 7f9329c4c740 1 -- 172.21.15.19:0/554387131 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617eb86a680 msgr2=0x5617eb881d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:48.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.405+0000 7f9329c4c740 1 --2- 172.21.15.19:0/554387131 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617eb86a680 0x5617eb881d90 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f9310003fd0 tx=0x7f9310004d00 comp rx=0 tx=0).stop 2024-09-19T09:04:48.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.405+0000 7f9329c4c740 1 -- 172.21.15.19:0/554387131 shutdown_connections 2024-09-19T09:04:48.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.405+0000 7f9329c4c740 1 --2- 172.21.15.19:0/554387131 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617eb86a680 0x5617eb881d90 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:48.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.405+0000 7f9329c4c740 1 --2- 172.21.15.19:0/554387131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617eb85fdc0 0x5617eb869150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:48.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.405+0000 7f9329c4c740 1 --2- 172.21.15.19:0/554387131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617eb85f4a0 0x5617eb85be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:48.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.405+0000 7f9329c4c740 1 -- 172.21.15.19:0/554387131 >> 172.21.15.19:0/554387131 conn(0x5617eb85ba30 msgr2=0x5617eb868a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:48.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.405+0000 7f9329c4c740 1 -- 172.21.15.19:0/554387131 shutdown_connections 2024-09-19T09:04:48.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.405+0000 7f9329c4c740 1 -- 172.21.15.19:0/554387131 wait complete. 2024-09-19T09:04:48.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.406+0000 7f9329c4c740 1 -- start start 2024-09-19T09:04:48.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.406+0000 7f9329c4c740 1 Processor -- start 2024-09-19T09:04:48.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.406+0000 7f9329c4c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617eb85f4a0 0x5617eb872e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:48.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.406+0000 7f9329c4c740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617eb85fdc0 0x5617eb870180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:48.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.406+0000 7f9329c4c740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617eb86a680 0x5617eb870720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:48.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.406+0000 7f9329c4c740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f93201b5000 con 0x5617eb86a680 2024-09-19T09:04:48.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.406+0000 7f9329c4c740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f93201b4930 con 0x5617eb85fdc0 2024-09-19T09:04:48.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.406+0000 7f9329c4c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f93201b1b70 con 0x5617eb85f4a0 2024-09-19T09:04:48.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.406+0000 7f9329c4c740 10 client.0 _ll_register_callbacks cb 0x7f931c009b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:48.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.406+0000 7f9324e0e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617eb86a680 0x5617eb870720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:48.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.406+0000 7f9324e0e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617eb86a680 0x5617eb870720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59684/0 (socket says 172.21.15.19:59684) 2024-09-19T09:04:48.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.406+0000 7f9324e0e640 1 -- 172.21.15.19:0/491396772 learned_addr learned my addr 172.21.15.19:0/491396772 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:48.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.406+0000 7f932560f640 1 --2- 172.21.15.19:0/491396772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617eb85fdc0 0x5617eb870180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:48.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.406+0000 7f9324e0e640 1 -- 172.21.15.19:0/491396772 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617eb85f4a0 msgr2=0x5617eb872e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:48.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.406+0000 7f9324e0e640 1 --2- 172.21.15.19:0/491396772 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617eb85f4a0 0x5617eb872e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:48.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.406+0000 7f9324e0e640 1 -- 172.21.15.19:0/491396772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617eb85fdc0 msgr2=0x5617eb870180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:48.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.406+0000 7f9324e0e640 1 --2- 172.21.15.19:0/491396772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617eb85fdc0 0x5617eb870180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:48.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.406+0000 7f9324e0e640 1 -- 172.21.15.19:0/491396772 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617eb870f50 con 0x5617eb86a680 2024-09-19T09:04:48.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.407+0000 7f9324e0e640 1 --2- 172.21.15.19:0/491396772 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617eb86a680 0x5617eb870720 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f9310003fa0 tx=0x7f931000b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e1b8edbee1a855 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:48.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.407+0000 7f9308ff9640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:04:48.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.407+0000 7f9308ff9640 1 -- 172.21.15.19:0/491396772 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9310030040 con 0x5617eb86a680 2024-09-19T09:04:48.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.407+0000 7f9329c4c740 1 -- 172.21.15.19:0/491396772 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9310004b10 con 0x5617eb86a680 2024-09-19T09:04:48.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.407+0000 7f9308ff9640 1 -- 172.21.15.19:0/491396772 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f93100051d0 con 0x5617eb86a680 2024-09-19T09:04:48.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.407+0000 7f9308ff9640 1 -- 172.21.15.19:0/491396772 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f93100053d0 con 0x5617eb86a680 2024-09-19T09:04:48.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.407+0000 7f9329c4c740 10 client.18714 fetch_fsmap learned FSMap version 43 2024-09-19T09:04:48.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.407+0000 7f9329c4c740 1 -- 172.21.15.19:0/491396772 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x5617eb8e4e50 con 0x5617eb86a680 2024-09-19T09:04:48.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.407+0000 7f9308ff9640 1 -- 172.21.15.19:0/491396772 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9310004b10 con 0x5617eb86a680 2024-09-19T09:04:48.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.407+0000 7f9308ff9640 1 -- 172.21.15.19:0/491396772 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7f9310040020 con 0x5617eb86a680 2024-09-19T09:04:48.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.407+0000 7f9329c4c740 10 client.18714 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T09:04:48.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.407+0000 7f9329c4c740 10 client.18714 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:04:48.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.407+0000 7f9329c4c740 20 client.18714 populate_metadata read hostname 'smithi019' 2024-09-19T09:04:48.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.407+0000 7f9329c4c740 1 --2- 172.21.15.19:0/491396772 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5617eb8e52f0 0x5617eb8e7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:48.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.407+0000 7f9329c4c740 4 client.18714 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T09:04:48.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.407+0000 7f9329c4c740 1 -- 172.21.15.19:0/491396772 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5617eb7ccd60 con 0x5617eb8e52f0 2024-09-19T09:04:48.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.408+0000 7f932560f640 1 --2- 172.21.15.19:0/491396772 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5617eb8e52f0 0x5617eb8e7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:48.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.408+0000 7f932560f640 1 --2- 172.21.15.19:0/491396772 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5617eb8e52f0 0x5617eb8e7710 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc1c9e19852f8e04 server_cookie=ccbcd4994f63635f in_seq=0 out_seq=0 2024-09-19T09:04:48.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.408+0000 7f9308ff9640 10 client.18714 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:04:48.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.408+0000 7f9308ff9640 1 -- 172.21.15.19:0/491396772 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5617eb7ccd60 con 0x5617eb8e52f0 2024-09-19T09:04:48.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.408+0000 7f9308ff9640 10 client.18714 handle_command_reply: tid=0 2024-09-19T09:04:48.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.408+0000 7f9329c4c740 1 client.18714 shutdown 2024-09-19T09:04:48.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.408+0000 7f9329c4c740 1 -- 172.21.15.19:0/491396772 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617eb86a680 msgr2=0x5617eb870720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:48.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.408+0000 7f9329c4c740 1 --2- 172.21.15.19:0/491396772 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617eb86a680 0x5617eb870720 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f9310003fa0 tx=0x7f931000b7a0 comp rx=0 tx=0).stop 2024-09-19T09:04:48.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.408+0000 7f9329c4c740 1 -- 172.21.15.19:0/491396772 shutdown_connections 2024-09-19T09:04:48.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.408+0000 7f9329c4c740 1 --2- 172.21.15.19:0/491396772 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x5617eb8e52f0 0x5617eb8e7710 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:48.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.409+0000 7f9329c4c740 1 --2- 172.21.15.19:0/491396772 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x5617eb86a680 0x5617eb870720 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:48.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.409+0000 7f9329c4c740 1 --2- 172.21.15.19:0/491396772 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x5617eb85fdc0 0x5617eb870180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:48.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.409+0000 7f9329c4c740 1 --2- 172.21.15.19:0/491396772 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5617eb85f4a0 0x5617eb872e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:48.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.409+0000 7f9329c4c740 1 -- 172.21.15.19:0/491396772 >> 172.21.15.19:0/491396772 conn(0x5617eb85ba30 msgr2=0x5617eb869260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:48.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.409+0000 7f9308ff9640 0 client.18714 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:04:48.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.409+0000 7f9329c4c740 1 -- 172.21.15.19:0/491396772 shutdown_connections 2024-09-19T09:04:48.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.409+0000 7f9329c4c740 1 -- 172.21.15.19:0/491396772 wait complete. 2024-09-19T09:04:48.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.409+0000 7f9329c4c740 20 client.18714 trim_cache size 0 max 16384 2024-09-19T09:04:48.436 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T09:04:48.436 INFO:teuthology.orchestra.run.smithi019.stdout: "status": "no active scrubs running", 2024-09-19T09:04:48.436 INFO:teuthology.orchestra.run.smithi019.stdout: "scrubs": {} 2024-09-19T09:04:48.436 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T09:04:48.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.409+0000 7f9327873640 1 -- 172.21.15.19:0/3907181773 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f930c0a32c0 msgr2=0x7f930c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:48.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.409+0000 7f9327873640 1 --2- 172.21.15.19:0/3907181773 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f930c0a32c0 0x7f930c0a5780 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f9318004650 tx=0x7f9318087100 comp rx=0 tx=0).stop 2024-09-19T09:04:48.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.409+0000 7f9327873640 1 -- 172.21.15.19:0/3907181773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9320105f30 msgr2=0x7f932019e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:48.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.409+0000 7f9327873640 1 --2- 172.21.15.19:0/3907181773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9320105f30 0x7f932019e8b0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f9318005ab0 tx=0x7f93180042f0 comp rx=0 tx=0).stop 2024-09-19T09:04:48.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.409+0000 7f9327873640 1 -- 172.21.15.19:0/3907181773 shutdown_connections 2024-09-19T09:04:48.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.409+0000 7f9327873640 1 --2- 172.21.15.19:0/3907181773 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f930c0a32c0 0x7f930c0a5780 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:48.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.409+0000 7f9327873640 1 --2- 172.21.15.19:0/3907181773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9320101440 0x7f93201a4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:48.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.409+0000 7f9327873640 1 --2- 172.21.15.19:0/3907181773 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9320105f30 0x7f932019e8b0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:48.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.409+0000 7f9327873640 1 --2- 172.21.15.19:0/3907181773 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9320100b20 0x7f93201a46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:48.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.410+0000 7f9327873640 1 -- 172.21.15.19:0/3907181773 >> 172.21.15.19:0/3907181773 conn(0x7f93200fc790 msgr2=0x7f93201038b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:48.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.410+0000 7f9327873640 1 -- 172.21.15.19:0/3907181773 shutdown_connections 2024-09-19T09:04:48.438 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:48.410+0000 7f9327873640 1 -- 172.21.15.19:0/3907181773 wait complete. 2024-09-19T09:04:49.244 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T09:04:49.244 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:04:49.510 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:49.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:49 smithi155 ceph-mon[34921]: pgmap v721: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:04:49.928 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:49 smithi019 ceph-mon[30976]: pgmap v721: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:04:49.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:49 smithi203 ceph-mon[35450]: pgmap v721: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:04:50.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.009+0000 7f21358e7640 1 -- 172.21.15.19:0/2283434846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2130108300 msgr2=0x7f213010ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:50.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.009+0000 7f21358e7640 1 --2- 172.21.15.19:0/2283434846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2130108300 0x7f213010ec70 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f2128009cd0 tx=0x7f212802a8d0 comp rx=0 tx=0).stop 2024-09-19T09:04:50.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.009+0000 7f21358e7640 1 -- 172.21.15.19:0/2283434846 shutdown_connections 2024-09-19T09:04:50.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.009+0000 7f21358e7640 1 --2- 172.21.15.19:0/2283434846 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2130108300 0x7f213010ec70 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:50.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.009+0000 7f21358e7640 1 --2- 172.21.15.19:0/2283434846 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2130103780 0x7f2130107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:50.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.009+0000 7f21358e7640 1 --2- 172.21.15.19:0/2283434846 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2130102dd0 0x7f21301031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:50.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.009+0000 7f21358e7640 1 -- 172.21.15.19:0/2283434846 >> 172.21.15.19:0/2283434846 conn(0x7f21300fc7d0 msgr2=0x7f21300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:50.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.009+0000 7f21358e7640 1 -- 172.21.15.19:0/2283434846 shutdown_connections 2024-09-19T09:04:50.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.009+0000 7f21358e7640 1 -- 172.21.15.19:0/2283434846 wait complete. 2024-09-19T09:04:50.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.009+0000 7f21358e7640 1 Processor -- start 2024-09-19T09:04:50.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.010+0000 7f21358e7640 1 -- start start 2024-09-19T09:04:50.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.010+0000 7f21358e7640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2130102dd0 0x7f21301984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:50.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.010+0000 7f21358e7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2130103780 0x7f2130198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:50.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.010+0000 7f21358e7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2130108300 0x7f213019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:50.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.010+0000 7f21358e7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f21301120d0 con 0x7f2130108300 2024-09-19T09:04:50.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.010+0000 7f21358e7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f2130111f50 con 0x7f2130103780 2024-09-19T09:04:50.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.010+0000 7f21358e7640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2130112250 con 0x7f2130102dd0 2024-09-19T09:04:50.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.010+0000 7f212f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2130108300 0x7f213019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:50.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.010+0000 7f212f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2130108300 0x7f213019cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59696/0 (socket says 172.21.15.19:59696) 2024-09-19T09:04:50.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.010+0000 7f212f7fe640 1 -- 172.21.15.19:0/2028774133 learned_addr learned my addr 172.21.15.19:0/2028774133 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:50.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.010+0000 7f212e7fc640 1 --2- 172.21.15.19:0/2028774133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2130103780 0x7f2130198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:50.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.010+0000 7f212f7fe640 1 -- 172.21.15.19:0/2028774133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2130102dd0 msgr2=0x7f21301984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:50.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.010+0000 7f212effd640 1 --2- 172.21.15.19:0/2028774133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2130102dd0 0x7f21301984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:50.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.010+0000 7f212f7fe640 1 --2- 172.21.15.19:0/2028774133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2130102dd0 0x7f21301984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:50.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.010+0000 7f212f7fe640 1 -- 172.21.15.19:0/2028774133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2130103780 msgr2=0x7f2130198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:50.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.010+0000 7f212f7fe640 1 --2- 172.21.15.19:0/2028774133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2130103780 0x7f2130198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:50.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.010+0000 7f212f7fe640 1 -- 172.21.15.19:0/2028774133 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f213019d470 con 0x7f2130108300 2024-09-19T09:04:50.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.010+0000 7f212e7fc640 1 --2- 172.21.15.19:0/2028774133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2130103780 0x7f2130198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:50.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.010+0000 7f212effd640 1 --2- 172.21.15.19:0/2028774133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2130102dd0 0x7f21301984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:50.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.011+0000 7f212f7fe640 1 --2- 172.21.15.19:0/2028774133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2130108300 0x7f213019cd90 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f2128009ca0 tx=0x7f212802f420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:50.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.011+0000 7f21348e5640 1 -- 172.21.15.19:0/2028774133 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2128031860 con 0x7f2130108300 2024-09-19T09:04:50.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.011+0000 7f21348e5640 1 -- 172.21.15.19:0/2028774133 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f2128003e50 con 0x7f2130108300 2024-09-19T09:04:50.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.011+0000 7f21358e7640 1 -- 172.21.15.19:0/2028774133 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f213019d700 con 0x7f2130108300 2024-09-19T09:04:50.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.011+0000 7f21348e5640 1 -- 172.21.15.19:0/2028774133 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21280307f0 con 0x7f2130108300 2024-09-19T09:04:50.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.011+0000 7f21358e7640 1 -- 172.21.15.19:0/2028774133 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21301a5040 con 0x7f2130108300 2024-09-19T09:04:50.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.012+0000 7f21358e7640 1 -- 172.21.15.19:0/2028774133 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21301031b0 con 0x7f2130108300 2024-09-19T09:04:50.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.013+0000 7f21348e5640 1 -- 172.21.15.19:0/2028774133 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f21280041d0 con 0x7f2130108300 2024-09-19T09:04:50.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.014+0000 7f21348e5640 1 --2- 172.21.15.19:0/2028774133 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f21180a32c0 0x7f21180a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:50.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.014+0000 7f21348e5640 1 -- 172.21.15.19:0/2028774133 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f21280f0ac0 con 0x7f2130108300 2024-09-19T09:04:50.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.014+0000 7f212effd640 1 --2- 172.21.15.19:0/2028774133 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f21180a32c0 0x7f21180a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:50.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.014+0000 7f212effd640 1 --2- 172.21.15.19:0/2028774133 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f21180a32c0 0x7f21180a5780 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f212000baa0 tx=0x7f2120005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:50.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.017+0000 7f21348e5640 1 -- 172.21.15.19:0/2028774133 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f21280bd7f0 con 0x7f2130108300 2024-09-19T09:04:50.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.229+0000 7f21358e7640 1 -- 172.21.15.19:0/2028774133 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f213010a290 con 0x7f2130108300 2024-09-19T09:04:50.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.230+0000 7f21348e5640 1 -- 172.21.15.19:0/2028774133 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+11985 (secure 0 0 0) 0x7f21280bd0f0 con 0x7f2130108300 2024-09-19T09:04:50.231 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T09:04:50.232 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":43,"btime":"2024-09-19T09:04:13:255619+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":17751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/3815927080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":3815927080},{"type":"v1","addr":"172.21.15.19:6839","nonce":3815927080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":43,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T09:04:12.935193+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":213,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26453":{"gid":26453,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/3907362737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3907362737},{"type":"v1","addr":"172.21.15.155:6835","nonce":3907362737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24469,24490,24464,24463]},"id":1}]} 2024-09-19T09:04:50.232 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 43 2024-09-19T09:04:50.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.232+0000 7f21358e7640 1 -- 172.21.15.19:0/2028774133 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f21180a32c0 msgr2=0x7f21180a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:50.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.232+0000 7f21358e7640 1 --2- 172.21.15.19:0/2028774133 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f21180a32c0 0x7f21180a5780 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f212000baa0 tx=0x7f2120005d90 comp rx=0 tx=0).stop 2024-09-19T09:04:50.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.232+0000 7f21358e7640 1 -- 172.21.15.19:0/2028774133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2130108300 msgr2=0x7f213019cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:50.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.232+0000 7f21358e7640 1 --2- 172.21.15.19:0/2028774133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2130108300 0x7f213019cd90 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f2128009ca0 tx=0x7f212802f420 comp rx=0 tx=0).stop 2024-09-19T09:04:50.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.232+0000 7f21358e7640 1 -- 172.21.15.19:0/2028774133 shutdown_connections 2024-09-19T09:04:50.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.232+0000 7f21358e7640 1 --2- 172.21.15.19:0/2028774133 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f21180a32c0 0x7f21180a5780 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:50.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.232+0000 7f21358e7640 1 --2- 172.21.15.19:0/2028774133 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f2130108300 0x7f213019cd90 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:50.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.232+0000 7f21358e7640 1 --2- 172.21.15.19:0/2028774133 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f2130103780 0x7f2130198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:50.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.232+0000 7f21358e7640 1 --2- 172.21.15.19:0/2028774133 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2130102dd0 0x7f21301984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:50.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.232+0000 7f21358e7640 1 -- 172.21.15.19:0/2028774133 >> 172.21.15.19:0/2028774133 conn(0x7f21300fc7d0 msgr2=0x7f21300fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:50.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.232+0000 7f21358e7640 1 -- 172.21.15.19:0/2028774133 shutdown_connections 2024-09-19T09:04:50.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:50.232+0000 7f21358e7640 1 -- 172.21.15.19:0/2028774133 wait complete. 2024-09-19T09:04:50.816 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:50 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/2028774133' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:50.847 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-09-19T09:04:50.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:50 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/2028774133' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:50.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:50 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/2028774133' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:04:51.106 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:51.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.595+0000 7f45bc9f2640 1 -- 172.21.15.19:0/1297377242 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45b8102570 msgr2=0x7f45b81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:51.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.595+0000 7f45bc9f2640 1 --2- 172.21.15.19:0/1297377242 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45b8102570 0x7f45b81029b0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f45a0009900 tx=0x7f45a002a480 comp rx=0 tx=0).stop 2024-09-19T09:04:51.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.596+0000 7f45bc9f2640 1 -- 172.21.15.19:0/1297377242 shutdown_connections 2024-09-19T09:04:51.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.596+0000 7f45bc9f2640 1 --2- 172.21.15.19:0/1297377242 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f45b8102ef0 0x7f45b810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:51.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.596+0000 7f45bc9f2640 1 --2- 172.21.15.19:0/1297377242 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45b8102570 0x7f45b81029b0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:51.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.596+0000 7f45bc9f2640 1 --2- 172.21.15.19:0/1297377242 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45b8100e20 0x7f45b8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:51.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.596+0000 7f45bc9f2640 1 -- 172.21.15.19:0/1297377242 >> 172.21.15.19:0/1297377242 conn(0x7f45b80fc7d0 msgr2=0x7f45b80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:51.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.596+0000 7f45bc9f2640 1 -- 172.21.15.19:0/1297377242 shutdown_connections 2024-09-19T09:04:51.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.596+0000 7f45bc9f2640 1 -- 172.21.15.19:0/1297377242 wait complete. 2024-09-19T09:04:51.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.596+0000 7f45bc9f2640 1 Processor -- start 2024-09-19T09:04:51.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.596+0000 7f45bc9f2640 1 -- start start 2024-09-19T09:04:51.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.597+0000 7f45bc9f2640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45b8100e20 0x7f45b8199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:51.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.597+0000 7f45bc9f2640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45b8102570 0x7f45b8199890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:51.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.597+0000 7f45bc9f2640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f45b8102ef0 0x7f45b81a43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:51.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.597+0000 7f45bc9f2640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f45b8110f80 con 0x7f45b8100e20 2024-09-19T09:04:51.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.597+0000 7f45bc9f2640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f45b8110e00 con 0x7f45b8102570 2024-09-19T09:04:51.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.597+0000 7f45bc9f2640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f45b8111100 con 0x7f45b8102ef0 2024-09-19T09:04:51.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.597+0000 7f45b659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45b8100e20 0x7f45b8199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:51.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.597+0000 7f45b659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45b8100e20 0x7f45b8199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59726/0 (socket says 172.21.15.19:59726) 2024-09-19T09:04:51.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.597+0000 7f45b659c640 1 -- 172.21.15.19:0/799698568 learned_addr learned my addr 172.21.15.19:0/799698568 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:51.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.597+0000 7f45b6d9d640 1 --2- 172.21.15.19:0/799698568 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f45b8102ef0 0x7f45b81a43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:51.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.597+0000 7f45affff640 1 --2- 172.21.15.19:0/799698568 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45b8102570 0x7f45b8199890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:51.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.597+0000 7f45b659c640 1 -- 172.21.15.19:0/799698568 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f45b8102ef0 msgr2=0x7f45b81a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:51.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.597+0000 7f45b659c640 1 --2- 172.21.15.19:0/799698568 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f45b8102ef0 0x7f45b81a43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:51.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.597+0000 7f45b659c640 1 -- 172.21.15.19:0/799698568 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45b8102570 msgr2=0x7f45b8199890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:51.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.597+0000 7f45b659c640 1 --2- 172.21.15.19:0/799698568 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45b8102570 0x7f45b8199890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:51.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.597+0000 7f45b659c640 1 -- 172.21.15.19:0/799698568 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b81a4910 con 0x7f45b8100e20 2024-09-19T09:04:51.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.597+0000 7f45b659c640 1 --2- 172.21.15.19:0/799698568 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45b8100e20 0x7f45b8199350 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f45a800e9f0 tx=0x7f45a800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:51.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.597+0000 7f45af7fe640 1 -- 172.21.15.19:0/799698568 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a800cd80 con 0x7f45b8100e20 2024-09-19T09:04:51.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.598+0000 7f45bc9f2640 1 -- 172.21.15.19:0/799698568 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45b81a4ae0 con 0x7f45b8100e20 2024-09-19T09:04:51.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.598+0000 7f45af7fe640 1 -- 172.21.15.19:0/799698568 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45a8010910 con 0x7f45b8100e20 2024-09-19T09:04:51.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.598+0000 7f45af7fe640 1 -- 172.21.15.19:0/799698568 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a80188f0 con 0x7f45b8100e20 2024-09-19T09:04:51.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.598+0000 7f45bc9f2640 1 -- 172.21.15.19:0/799698568 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45b81a4ff0 con 0x7f45b8100e20 2024-09-19T09:04:51.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.601+0000 7f45af7fe640 1 -- 172.21.15.19:0/799698568 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f45a8010ac0 con 0x7f45b8100e20 2024-09-19T09:04:51.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.601+0000 7f45bedcb740 1 Processor -- start 2024-09-19T09:04:51.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.601+0000 7f45bedcb740 1 -- start start 2024-09-19T09:04:51.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.602+0000 7f45bedcb740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e2afda7b40 0x55e2afda6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:51.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.602+0000 7f45bedcb740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e2afda65d0 0x55e2afda6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:51.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.602+0000 7f45bedcb740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2afdb5780 0x55e2afdb7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:51.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.602+0000 7f45bedcb740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e2afd0c2f0 con 0x55e2afda7b40 2024-09-19T09:04:51.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.602+0000 7f45bedcb740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55e2afcb3cf0 con 0x55e2afdb5780 2024-09-19T09:04:51.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.602+0000 7f45bedcb740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e2afd082b0 con 0x55e2afda65d0 2024-09-19T09:04:51.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.602+0000 7f45af7fe640 1 --2- 172.21.15.19:0/799698568 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f45a40a32c0 0x7f45a40a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:51.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.602+0000 7f45b6d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e2afda7b40 0x55e2afda6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:51.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.602+0000 7f45affff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2afdb5780 0x55e2afdb7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:51.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.602+0000 7f45b6d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e2afda7b40 0x55e2afda6090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59734/0 (socket says 172.21.15.19:59734) 2024-09-19T09:04:51.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.602+0000 7f45b6d9d640 1 -- 172.21.15.19:0/3011280697 learned_addr learned my addr 172.21.15.19:0/3011280697 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:51.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.602+0000 7f45b6d9d640 1 --2- 172.21.15.19:0/799698568 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f45a40a32c0 0x7f45a40a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:51.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.602+0000 7f45b659c640 1 --2- 172.21.15.19:0/3011280697 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e2afda65d0 0x55e2afda6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:51.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.602+0000 7f45af7fe640 1 -- 172.21.15.19:0/799698568 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f45a80cfc30 con 0x7f45b8100e20 2024-09-19T09:04:51.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.602+0000 7f45affff640 1 -- 172.21.15.19:0/3011280697 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e2afda65d0 msgr2=0x55e2afda6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:51.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.602+0000 7f45affff640 1 --2- 172.21.15.19:0/3011280697 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e2afda65d0 0x55e2afda6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:51.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.602+0000 7f45affff640 1 -- 172.21.15.19:0/3011280697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e2afda7b40 msgr2=0x55e2afda6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:51.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.602+0000 7f45affff640 1 --2- 172.21.15.19:0/3011280697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e2afda7b40 0x55e2afda6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:51.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.602+0000 7f45affff640 1 -- 172.21.15.19:0/3011280697 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2afc983a0 con 0x55e2afdb5780 2024-09-19T09:04:51.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.603+0000 7f45affff640 1 --2- 172.21.15.19:0/3011280697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2afdb5780 0x55e2afdb7b70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f45a0005940 tx=0x7f45a0005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b402d9637e29534 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:51.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.603+0000 7f45b6d9d640 1 --2- 172.21.15.19:0/799698568 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f45a40a32c0 0x7f45a40a5780 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f45b00098b0 tx=0x7f45b0009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:51.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.604+0000 7f45acff9640 1 -- 172.21.15.19:0/3011280697 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a0035030 con 0x55e2afdb5780 2024-09-19T09:04:51.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.604+0000 7f45acff9640 1 -- 172.21.15.19:0/3011280697 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45a0040070 con 0x55e2afdb5780 2024-09-19T09:04:51.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.604+0000 7f45acff9640 1 -- 172.21.15.19:0/3011280697 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a0004df0 con 0x55e2afdb5780 2024-09-19T09:04:51.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.605+0000 7f45bedcb740 1 -- 172.21.15.19:0/3011280697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2afdb5780 msgr2=0x55e2afdb7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:51.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.605+0000 7f45bedcb740 1 --2- 172.21.15.19:0/3011280697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2afdb5780 0x55e2afdb7b70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f45a0005940 tx=0x7f45a0005e80 comp rx=0 tx=0).stop 2024-09-19T09:04:51.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.605+0000 7f45bedcb740 1 -- 172.21.15.19:0/3011280697 shutdown_connections 2024-09-19T09:04:51.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.605+0000 7f45bedcb740 1 --2- 172.21.15.19:0/3011280697 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e2afda65d0 0x55e2afda6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:51.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.605+0000 7f45bedcb740 1 --2- 172.21.15.19:0/3011280697 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2afdb5780 0x55e2afdb7b70 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:51.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.605+0000 7f45bedcb740 1 --2- 172.21.15.19:0/3011280697 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e2afda7b40 0x55e2afda6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:51.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.605+0000 7f45bedcb740 1 -- 172.21.15.19:0/3011280697 >> 172.21.15.19:0/3011280697 conn(0x55e2afd6f310 msgr2=0x55e2afda2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:51.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.605+0000 7f45bedcb740 1 -- 172.21.15.19:0/3011280697 shutdown_connections 2024-09-19T09:04:51.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.605+0000 7f45bedcb740 1 -- 172.21.15.19:0/3011280697 wait complete. 2024-09-19T09:04:51.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.606+0000 7f45bedcb740 1 -- start start 2024-09-19T09:04:51.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.606+0000 7f45bedcb740 1 Processor -- start 2024-09-19T09:04:51.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.606+0000 7f45bedcb740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e2afda65d0 0x55e2afdb5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:51.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.606+0000 7f45bedcb740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2afda7b40 0x55e2afdb23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:51.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.606+0000 7f45bedcb740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e2afdb5780 0x55e2afdb2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:51.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.606+0000 7f45bedcb740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55e2afdb8420 con 0x55e2afda65d0 2024-09-19T09:04:51.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.606+0000 7f45bedcb740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55e2afcc7060 con 0x55e2afda7b40 2024-09-19T09:04:51.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.606+0000 7f45bedcb740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e2afdb85a0 con 0x55e2afdb5780 2024-09-19T09:04:51.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.606+0000 7f45bedcb740 10 client.0 _ll_register_callbacks cb 0x55e2afa1a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:51.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.606+0000 7f45affff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2afda7b40 0x55e2afdb23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:51.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.606+0000 7f45b659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e2afda65d0 0x55e2afdb5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:51.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.606+0000 7f45affff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2afda7b40 0x55e2afdb23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:44222/0 (socket says 172.21.15.19:44222) 2024-09-19T09:04:51.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.606+0000 7f45affff640 1 -- 172.21.15.19:0/2167999131 learned_addr learned my addr 172.21.15.19:0/2167999131 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:51.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.606+0000 7f45b6d9d640 1 --2- 172.21.15.19:0/2167999131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e2afdb5780 0x55e2afdb2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:51.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.607+0000 7f45affff640 1 -- 172.21.15.19:0/2167999131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e2afdb5780 msgr2=0x55e2afdb2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:51.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.607+0000 7f45affff640 1 --2- 172.21.15.19:0/2167999131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e2afdb5780 0x55e2afdb2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:51.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.607+0000 7f45affff640 1 -- 172.21.15.19:0/2167999131 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e2afda65d0 msgr2=0x55e2afdb5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:51.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.607+0000 7f45affff640 1 --2- 172.21.15.19:0/2167999131 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e2afda65d0 0x55e2afdb5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:51.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.607+0000 7f45affff640 1 -- 172.21.15.19:0/2167999131 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2afa7d3c0 con 0x55e2afda7b40 2024-09-19T09:04:51.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.607+0000 7f45b659c640 1 --2- 172.21.15.19:0/2167999131 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e2afda65d0 0x55e2afdb5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:51.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.607+0000 7f45b6d9d640 1 --2- 172.21.15.19:0/2167999131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e2afdb5780 0x55e2afdb2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:51.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.607+0000 7f45affff640 1 --2- 172.21.15.19:0/2167999131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2afda7b40 0x55e2afdb23c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f45a0009900 tx=0x7f45a00044b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8485691313576bf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:51.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.607+0000 7f459dffb640 10 client.0 ms_handle_connect on v2:172.21.15.155:3300/0 2024-09-19T09:04:51.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.607+0000 7f459dffb640 1 -- 172.21.15.19:0/2167999131 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a0052060 con 0x55e2afda7b40 2024-09-19T09:04:51.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.607+0000 7f459dffb640 1 -- 172.21.15.19:0/2167999131 <== mon.2 v2:172.21.15.155:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f45a00037f0 con 0x55e2afda7b40 2024-09-19T09:04:51.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.607+0000 7f45bedcb740 1 -- 172.21.15.19:0/2167999131 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45a0040070 con 0x55e2afda7b40 2024-09-19T09:04:51.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.607+0000 7f459dffb640 1 -- 172.21.15.19:0/2167999131 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f45a0035050 con 0x55e2afda7b40 2024-09-19T09:04:51.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.607+0000 7f45bedcb740 10 client.27953 fetch_fsmap learned FSMap version 43 2024-09-19T09:04:51.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.607+0000 7f45bedcb740 1 -- 172.21.15.19:0/2167999131 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55e2afdc3e50 con 0x55e2afda7b40 2024-09-19T09:04:51.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.608+0000 7f459dffb640 1 -- 172.21.15.19:0/2167999131 <== mon.2 v2:172.21.15.155:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45a0040070 con 0x55e2afda7b40 2024-09-19T09:04:51.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.608+0000 7f459dffb640 1 -- 172.21.15.19:0/2167999131 <== mon.2 v2:172.21.15.155:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7f45a0005290 con 0x55e2afda7b40 2024-09-19T09:04:51.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.608+0000 7f45bedcb740 10 client.27953 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T09:04:51.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.608+0000 7f45bedcb740 10 client.27953 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T09:04:51.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.608+0000 7f45bedcb740 20 client.27953 populate_metadata read hostname 'smithi019' 2024-09-19T09:04:51.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.608+0000 7f45bedcb740 1 --2- 172.21.15.19:0/2167999131 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55e2afdc5350 0x55e2afdc7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:51.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.608+0000 7f45bedcb740 4 client.27953 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:51.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.608+0000 7f45bedcb740 1 -- 172.21.15.19:0/2167999131 --> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e2afd19860 con 0x55e2afdc5350 2024-09-19T09:04:51.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.608+0000 7f45b659c640 1 --2- 172.21.15.19:0/2167999131 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55e2afdc5350 0x55e2afdc7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:51.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.609+0000 7f45b659c640 1 --2- 172.21.15.19:0/2167999131 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55e2afdc5350 0x55e2afdc7780 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b00684fe37f6410 server_cookie=888784614fec3ea0 in_seq=0 out_seq=0 2024-09-19T09:04:51.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.609+0000 7f459dffb640 10 client.27953 ms_handle_connect on v2:172.21.15.203:6834/2702758353 2024-09-19T09:04:51.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.609+0000 7f459dffb640 1 -- 172.21.15.19:0/2167999131 <== mds.4 v2:172.21.15.203:6834/2702758353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e2afd19860 con 0x55e2afdc5350 2024-09-19T09:04:51.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.609+0000 7f459dffb640 10 client.27953 handle_command_reply: tid=0 2024-09-19T09:04:51.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.609+0000 7f45bedcb740 1 client.27953 shutdown 2024-09-19T09:04:51.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.609+0000 7f45bedcb740 1 -- 172.21.15.19:0/2167999131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2afda7b40 msgr2=0x55e2afdb23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:51.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.609+0000 7f45bedcb740 1 --2- 172.21.15.19:0/2167999131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2afda7b40 0x55e2afdb23c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f45a0009900 tx=0x7f45a00044b0 comp rx=0 tx=0).stop 2024-09-19T09:04:51.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.609+0000 7f45bedcb740 1 -- 172.21.15.19:0/2167999131 shutdown_connections 2024-09-19T09:04:51.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.609+0000 7f45bedcb740 1 --2- 172.21.15.19:0/2167999131 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55e2afdc5350 0x55e2afdc7780 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:51.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.609+0000 7f45bedcb740 1 --2- 172.21.15.19:0/2167999131 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e2afdb5780 0x55e2afdb2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:51.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.609+0000 7f45bedcb740 1 --2- 172.21.15.19:0/2167999131 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2afda7b40 0x55e2afdb23c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:51.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.609+0000 7f45bedcb740 1 --2- 172.21.15.19:0/2167999131 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e2afda65d0 0x55e2afdb5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:51.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.609+0000 7f45bedcb740 1 -- 172.21.15.19:0/2167999131 >> 172.21.15.19:0/2167999131 conn(0x55e2afd6f310 msgr2=0x55e2afda8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:51.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.610+0000 7f459dffb640 0 client.27953 ms_handle_reset on v2:172.21.15.203:6834/2702758353 2024-09-19T09:04:51.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.610+0000 7f45bedcb740 1 -- 172.21.15.19:0/2167999131 shutdown_connections 2024-09-19T09:04:51.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.610+0000 7f45bedcb740 1 -- 172.21.15.19:0/2167999131 wait complete. 2024-09-19T09:04:51.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.610+0000 7f45bedcb740 20 client.27953 trim_cache size 0 max 16384 2024-09-19T09:04:51.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.631+0000 7f45bedcb740 1 Processor -- start 2024-09-19T09:04:51.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.631+0000 7f45bedcb740 1 -- start start 2024-09-19T09:04:51.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.631+0000 7f45bedcb740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2afda65d0 0x55e2afdc16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:51.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.631+0000 7f45bedcb740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e2afda7b40 0x55e2afda7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:51.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.631+0000 7f45bedcb740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e2afdb5780 0x55e2afdad720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:51.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.631+0000 7f45bedcb740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f45b81ab320 con 0x55e2afdb5780 2024-09-19T09:04:51.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.631+0000 7f45bedcb740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f45b81ace60 con 0x55e2afda65d0 2024-09-19T09:04:51.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.631+0000 7f45bedcb740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f45b81ab9f0 con 0x55e2afda7b40 2024-09-19T09:04:51.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.631+0000 7f45b6d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e2afdb5780 0x55e2afdad720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:51.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.631+0000 7f45b659c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2afda65d0 0x55e2afdc16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:51.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.631+0000 7f45b659c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2afda65d0 0x55e2afdc16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.155:3300/0 says I am v2:172.21.15.19:44238/0 (socket says 172.21.15.19:44238) 2024-09-19T09:04:51.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.631+0000 7f45b659c640 1 -- 172.21.15.19:0/1210594993 learned_addr learned my addr 172.21.15.19:0/1210594993 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:51.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.631+0000 7f45b6d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e2afdb5780 0x55e2afdad720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59752/0 (socket says 172.21.15.19:59752) 2024-09-19T09:04:51.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.631+0000 7f45affff640 1 --2- 172.21.15.19:0/1210594993 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e2afda7b40 0x55e2afda7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:51.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.632+0000 7f45b659c640 1 -- 172.21.15.19:0/1210594993 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e2afda7b40 msgr2=0x55e2afda7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:51.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.632+0000 7f45b659c640 1 --2- 172.21.15.19:0/1210594993 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e2afda7b40 0x55e2afda7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:51.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.632+0000 7f45b659c640 1 -- 172.21.15.19:0/1210594993 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e2afdb5780 msgr2=0x55e2afdad720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:51.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.632+0000 7f45b659c640 1 --2- 172.21.15.19:0/1210594993 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e2afdb5780 0x55e2afdad720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:51.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.632+0000 7f45b659c640 1 -- 172.21.15.19:0/1210594993 --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2afda3960 con 0x55e2afda65d0 2024-09-19T09:04:51.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.632+0000 7f45b659c640 1 --2- 172.21.15.19:0/1210594993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2afda65d0 0x55e2afdc16c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f45a80cdab0 tx=0x7f45a80bc040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3371b98710d06e17 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:51.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.632+0000 7f459ffff640 1 -- 172.21.15.19:0/1210594993 <== mon.2 v2:172.21.15.155:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a80a0610 con 0x55e2afda65d0 2024-09-19T09:04:51.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.632+0000 7f459ffff640 1 -- 172.21.15.19:0/1210594993 <== mon.2 v2:172.21.15.155:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45a80a4ed0 con 0x55e2afda65d0 2024-09-19T09:04:51.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.632+0000 7f459ffff640 1 -- 172.21.15.19:0/1210594993 <== mon.2 v2:172.21.15.155:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a80bc310 con 0x55e2afda65d0 2024-09-19T09:04:51.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.633+0000 7f45bedcb740 1 -- 172.21.15.19:0/1210594993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2afda65d0 msgr2=0x55e2afdc16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:51.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.633+0000 7f45bedcb740 1 --2- 172.21.15.19:0/1210594993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2afda65d0 0x55e2afdc16c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f45a80cdab0 tx=0x7f45a80bc040 comp rx=0 tx=0).stop 2024-09-19T09:04:51.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.633+0000 7f45bedcb740 1 -- 172.21.15.19:0/1210594993 shutdown_connections 2024-09-19T09:04:51.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.633+0000 7f45bedcb740 1 --2- 172.21.15.19:0/1210594993 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e2afda7b40 0x55e2afda7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:51.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.633+0000 7f45bedcb740 1 --2- 172.21.15.19:0/1210594993 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e2afdb5780 0x55e2afdad720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:51.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.633+0000 7f45bedcb740 1 --2- 172.21.15.19:0/1210594993 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2afda65d0 0x55e2afdc16c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:51.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.633+0000 7f45bedcb740 1 -- 172.21.15.19:0/1210594993 >> 172.21.15.19:0/1210594993 conn(0x55e2afd6f310 msgr2=0x55e2afd9da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:51.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.633+0000 7f45bedcb740 1 -- 172.21.15.19:0/1210594993 shutdown_connections 2024-09-19T09:04:51.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.633+0000 7f45bedcb740 1 -- 172.21.15.19:0/1210594993 wait complete. 2024-09-19T09:04:51.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.633+0000 7f45bedcb740 1 -- start start 2024-09-19T09:04:51.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.633+0000 7f45bedcb740 1 Processor -- start 2024-09-19T09:04:51.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.634+0000 7f45bedcb740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e2afda65d0 0x55e2afdb87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:51.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.634+0000 7f45bedcb740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2afda7b40 0x55e2afdb8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:51.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.634+0000 7f45bedcb740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e2afdb5780 0x55e2afdb9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:51.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.634+0000 7f45bedcb740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f45b81ac790 con 0x55e2afda65d0 2024-09-19T09:04:51.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.634+0000 7f45bedcb740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f45b81ac0c0 con 0x55e2afda7b40 2024-09-19T09:04:51.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.634+0000 7f45bedcb740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f45b81a9320 con 0x55e2afdb5780 2024-09-19T09:04:51.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.634+0000 7f45bedcb740 10 client.0 _ll_register_callbacks cb 0x7f45b00123f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:51.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.634+0000 7f45b659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e2afda65d0 0x55e2afdb87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:51.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.634+0000 7f45affff640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2afda7b40 0x55e2afdb8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:51.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.634+0000 7f45b659c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e2afda65d0 0x55e2afdb87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59754/0 (socket says 172.21.15.19:59754) 2024-09-19T09:04:51.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.634+0000 7f45b659c640 1 -- 172.21.15.19:0/116191275 learned_addr learned my addr 172.21.15.19:0/116191275 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:51.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.634+0000 7f45b6d9d640 1 --2- 172.21.15.19:0/116191275 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e2afdb5780 0x55e2afdb9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:51.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.634+0000 7f45b659c640 1 -- 172.21.15.19:0/116191275 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e2afdb5780 msgr2=0x55e2afdb9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:51.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.634+0000 7f45b659c640 1 --2- 172.21.15.19:0/116191275 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e2afdb5780 0x55e2afdb9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:51.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.634+0000 7f45b659c640 1 -- 172.21.15.19:0/116191275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2afda7b40 msgr2=0x55e2afdb8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:51.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.634+0000 7f45b659c640 1 --2- 172.21.15.19:0/116191275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2afda7b40 0x55e2afdb8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:51.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.634+0000 7f45b659c640 1 -- 172.21.15.19:0/116191275 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2afda24f0 con 0x55e2afda65d0 2024-09-19T09:04:51.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.634+0000 7f45affff640 1 --2- 172.21.15.19:0/116191275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2afda7b40 0x55e2afdb8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:51.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.634+0000 7f45b659c640 1 --2- 172.21.15.19:0/116191275 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e2afda65d0 0x55e2afdb87f0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f45a800cfd0 tx=0x7f45a809c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd4a6411e8b98645 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:51.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.634+0000 7f459dffb640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:04:51.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.635+0000 7f459dffb640 1 -- 172.21.15.19:0/116191275 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45a80b5260 con 0x55e2afda65d0 2024-09-19T09:04:51.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.635+0000 7f459dffb640 1 -- 172.21.15.19:0/116191275 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f45a809a610 con 0x55e2afda65d0 2024-09-19T09:04:51.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.635+0000 7f45bedcb740 1 -- 172.21.15.19:0/116191275 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45a80a4ed0 con 0x55e2afda65d0 2024-09-19T09:04:51.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.635+0000 7f459dffb640 1 -- 172.21.15.19:0/116191275 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f45a80bc0b0 con 0x55e2afda65d0 2024-09-19T09:04:51.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.635+0000 7f45bedcb740 10 client.18738 fetch_fsmap learned FSMap version 43 2024-09-19T09:04:51.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.635+0000 7f45bedcb740 1 -- 172.21.15.19:0/116191275 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55e2afda6be0 con 0x55e2afda65d0 2024-09-19T09:04:51.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.635+0000 7f459dffb640 1 -- 172.21.15.19:0/116191275 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f45a80a4ed0 con 0x55e2afda65d0 2024-09-19T09:04:51.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.635+0000 7f459dffb640 1 -- 172.21.15.19:0/116191275 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7f45a809b880 con 0x55e2afda65d0 2024-09-19T09:04:51.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.635+0000 7f45bedcb740 10 client.18738 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T09:04:51.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.635+0000 7f45bedcb740 10 client.18738 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.f 2024-09-19T09:04:51.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.635+0000 7f45bedcb740 20 client.18738 populate_metadata read hostname 'smithi019' 2024-09-19T09:04:51.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.635+0000 7f45bedcb740 1 --2- 172.21.15.19:0/116191275 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55e2afe2f800 0x55e2afe31c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:51.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.635+0000 7f45bedcb740 4 client.18738 mds_command: new command op to 24463 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:04:51.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.635+0000 7f45bedcb740 1 -- 172.21.15.19:0/116191275 --> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e2afd13d70 con 0x55e2afe2f800 2024-09-19T09:04:51.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.636+0000 7f45affff640 1 --2- 172.21.15.19:0/116191275 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55e2afe2f800 0x55e2afe31c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:51.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.636+0000 7f45affff640 1 --2- 172.21.15.19:0/116191275 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55e2afe2f800 0x55e2afe31c20 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=56968b3090bf6cef server_cookie=2d3cc9932ebb3c7 in_seq=0 out_seq=0 2024-09-19T09:04:51.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.636+0000 7f459dffb640 10 client.18738 ms_handle_connect on v2:172.21.15.203:6834/2702758353 2024-09-19T09:04:51.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.636+0000 7f459dffb640 1 -- 172.21.15.19:0/116191275 <== mds.4 v2:172.21.15.203:6834/2702758353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e2afd13d70 con 0x55e2afe2f800 2024-09-19T09:04:51.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.636+0000 7f459dffb640 10 client.18738 handle_command_reply: tid=0 2024-09-19T09:04:51.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.636+0000 7f45bedcb740 1 client.18738 shutdown 2024-09-19T09:04:51.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.636+0000 7f45bedcb740 1 -- 172.21.15.19:0/116191275 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e2afda65d0 msgr2=0x55e2afdb87f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:51.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.636+0000 7f45bedcb740 1 --2- 172.21.15.19:0/116191275 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e2afda65d0 0x55e2afdb87f0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f45a800cfd0 tx=0x7f45a809c480 comp rx=0 tx=0).stop 2024-09-19T09:04:51.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.636+0000 7f45bedcb740 1 -- 172.21.15.19:0/116191275 shutdown_connections 2024-09-19T09:04:51.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.636+0000 7f45bedcb740 1 --2- 172.21.15.19:0/116191275 >> [v2:172.21.15.203:6834/2702758353,v1:172.21.15.203:6835/2702758353] conn(0x55e2afe2f800 0x55e2afe31c20 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:51.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.636+0000 7f45bedcb740 1 --2- 172.21.15.19:0/116191275 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e2afdb5780 0x55e2afdb9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:51.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.636+0000 7f45bedcb740 1 --2- 172.21.15.19:0/116191275 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55e2afda7b40 0x55e2afdb8d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:51.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.636+0000 7f45bedcb740 1 --2- 172.21.15.19:0/116191275 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55e2afda65d0 0x55e2afdb87f0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:51.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.636+0000 7f45bedcb740 1 -- 172.21.15.19:0/116191275 >> 172.21.15.19:0/116191275 conn(0x55e2afd6f310 msgr2=0x55e2afdad720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:51.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.636+0000 7f459dffb640 0 client.18738 ms_handle_reset on v2:172.21.15.203:6834/2702758353 2024-09-19T09:04:51.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.637+0000 7f45bedcb740 1 -- 172.21.15.19:0/116191275 shutdown_connections 2024-09-19T09:04:51.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.637+0000 7f45bedcb740 1 -- 172.21.15.19:0/116191275 wait complete. 2024-09-19T09:04:51.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.637+0000 7f45bedcb740 20 client.18738 trim_cache size 0 max 16384 2024-09-19T09:04:51.646 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:04:51.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.637+0000 7f45bc9f2640 1 -- 172.21.15.19:0/799698568 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f45a40a32c0 msgr2=0x7f45a40a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:51.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.637+0000 7f45bc9f2640 1 --2- 172.21.15.19:0/799698568 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f45a40a32c0 0x7f45a40a5780 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f45b00098b0 tx=0x7f45b0009600 comp rx=0 tx=0).stop 2024-09-19T09:04:51.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.637+0000 7f45bc9f2640 1 -- 172.21.15.19:0/799698568 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45b8100e20 msgr2=0x7f45b8199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:51.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.637+0000 7f45bc9f2640 1 --2- 172.21.15.19:0/799698568 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45b8100e20 0x7f45b8199350 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f45a800e9f0 tx=0x7f45a800eeb0 comp rx=0 tx=0).stop 2024-09-19T09:04:51.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.637+0000 7f45bc9f2640 1 -- 172.21.15.19:0/799698568 shutdown_connections 2024-09-19T09:04:51.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.637+0000 7f45bc9f2640 1 --2- 172.21.15.19:0/799698568 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f45a40a32c0 0x7f45a40a5780 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:51.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.637+0000 7f45bc9f2640 1 --2- 172.21.15.19:0/799698568 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f45b8102ef0 0x7f45b81a43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:51.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.637+0000 7f45bc9f2640 1 --2- 172.21.15.19:0/799698568 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f45b8102570 0x7f45b8199890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:51.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.637+0000 7f45bc9f2640 1 --2- 172.21.15.19:0/799698568 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f45b8100e20 0x7f45b8199350 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:51.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.637+0000 7f45bc9f2640 1 -- 172.21.15.19:0/799698568 >> 172.21.15.19:0/799698568 conn(0x7f45b80fc7d0 msgr2=0x7f45b80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:51.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.637+0000 7f45bc9f2640 1 -- 172.21.15.19:0/799698568 shutdown_connections 2024-09-19T09:04:51.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:51.637+0000 7f45bc9f2640 1 -- 172.21.15.19:0/799698568 wait complete. 2024-09-19T09:04:51.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:51 smithi019 ceph-mon[30976]: pgmap v722: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 9 op/s 2024-09-19T09:04:51.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:51 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:04:51.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:51 smithi155 ceph-mon[34921]: pgmap v722: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 9 op/s 2024-09-19T09:04:51.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:51 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:04:51.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:51 smithi203 ceph-mon[35450]: pgmap v722: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 9 op/s 2024-09-19T09:04:51.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:51 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T09:04:52.392 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-09-19T09:04:52.649 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:52.949 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:52 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:04:52.949 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:52 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:04:52.949 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:52 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:04:52.949 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:52 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:04:52.950 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:52 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:04:52.950 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:52 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:04:52.950 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:52 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:04:52.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:52 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:04:52.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:52 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:04:52.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:52 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:04:52.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:52 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:04:52.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:52 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:04:52.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:52 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:04:52.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:52 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:04:53.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:52 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:04:53.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:52 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:04:53.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:52 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:04:53.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:52 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:04:53.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:52 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T09:04:53.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:52 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T09:04:53.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:52 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' 2024-09-19T09:04:53.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.181+0000 7f50cfeda640 1 -- 172.21.15.19:0/4125250281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50c8101df0 msgr2=0x7f50c81021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:53.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.181+0000 7f50cfeda640 1 --2- 172.21.15.19:0/4125250281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50c8101df0 0x7f50c81021d0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f50c4009900 tx=0x7f50c402a410 comp rx=0 tx=0).stop 2024-09-19T09:04:53.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.181+0000 7f50cfeda640 1 -- 172.21.15.19:0/4125250281 shutdown_connections 2024-09-19T09:04:53.189 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.181+0000 7f50cfeda640 1 --2- 172.21.15.19:0/4125250281 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f50c8106f20 0x7f50c810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.181+0000 7f50cfeda640 1 --2- 172.21.15.19:0/4125250281 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50c81027a0 0x7f50c81067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.181+0000 7f50cfeda640 1 --2- 172.21.15.19:0/4125250281 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50c8101df0 0x7f50c81021d0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.181+0000 7f50cfeda640 1 -- 172.21.15.19:0/4125250281 >> 172.21.15.19:0/4125250281 conn(0x7f50c80fd8f0 msgr2=0x7f50c80ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:53.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.181+0000 7f50cfeda640 1 -- 172.21.15.19:0/4125250281 shutdown_connections 2024-09-19T09:04:53.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.181+0000 7f50cfeda640 1 -- 172.21.15.19:0/4125250281 wait complete. 2024-09-19T09:04:53.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.181+0000 7f50cfeda640 1 Processor -- start 2024-09-19T09:04:53.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.182+0000 7f50cfeda640 1 -- start start 2024-09-19T09:04:53.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.182+0000 7f50cfeda640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50c8101df0 0x7f50c80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:53.190 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.182+0000 7f50cfeda640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50c81027a0 0x7f50c8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:53.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.182+0000 7f50cfeda640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f50c8106f20 0x7f50c8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:53.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.182+0000 7f50cfeda640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f50c8111f80 con 0x7f50c8101df0 2024-09-19T09:04:53.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.182+0000 7f50cfeda640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f50c8111e00 con 0x7f50c81027a0 2024-09-19T09:04:53.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.182+0000 7f50cfeda640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f50c8112100 con 0x7f50c8106f20 2024-09-19T09:04:53.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.182+0000 7f50cdc76640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50c8101df0 0x7f50c80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:53.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.182+0000 7f50cdc76640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50c8101df0 0x7f50c80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59764/0 (socket says 172.21.15.19:59764) 2024-09-19T09:04:53.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.182+0000 7f50cdc76640 1 -- 172.21.15.19:0/1826727406 learned_addr learned my addr 172.21.15.19:0/1826727406 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:53.191 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.182+0000 7f50ce477640 1 --2- 172.21.15.19:0/1826727406 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f50c8106f20 0x7f50c8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:53.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.182+0000 7f50cdc76640 1 -- 172.21.15.19:0/1826727406 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f50c8106f20 msgr2=0x7f50c8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:53.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.182+0000 7f50cdc76640 1 --2- 172.21.15.19:0/1826727406 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f50c8106f20 0x7f50c8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.182+0000 7f50cdc76640 1 -- 172.21.15.19:0/1826727406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50c81027a0 msgr2=0x7f50c8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:53.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.182+0000 7f50cdc76640 1 --2- 172.21.15.19:0/1826727406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50c81027a0 0x7f50c8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.182+0000 7f50cdc76640 1 -- 172.21.15.19:0/1826727406 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50c81a6880 con 0x7f50c8101df0 2024-09-19T09:04:53.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.182+0000 7f50ce477640 1 --2- 172.21.15.19:0/1826727406 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f50c8106f20 0x7f50c8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:53.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.182+0000 7f50cdc76640 1 --2- 172.21.15.19:0/1826727406 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50c8101df0 0x7f50c80744f0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f50c4006010 tx=0x7f50c40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:53.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.182+0000 7f50beffd640 1 -- 172.21.15.19:0/1826727406 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c403f030 con 0x7f50c8101df0 2024-09-19T09:04:53.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.183+0000 7f50beffd640 1 -- 172.21.15.19:0/1826727406 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50c4003ce0 con 0x7f50c8101df0 2024-09-19T09:04:53.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.183+0000 7f50cfeda640 1 -- 172.21.15.19:0/1826727406 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50c81a6b10 con 0x7f50c8101df0 2024-09-19T09:04:53.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.183+0000 7f50beffd640 1 -- 172.21.15.19:0/1826727406 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c4035070 con 0x7f50c8101df0 2024-09-19T09:04:53.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.183+0000 7f50cfeda640 1 -- 172.21.15.19:0/1826727406 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50c81a6ff0 con 0x7f50c8101df0 2024-09-19T09:04:53.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.185+0000 7f50beffd640 1 -- 172.21.15.19:0/1826727406 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f50c4042030 con 0x7f50c8101df0 2024-09-19T09:04:53.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.185+0000 7f50d22b3740 1 Processor -- start 2024-09-19T09:04:53.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.185+0000 7f50d22b3740 1 -- start start 2024-09-19T09:04:53.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.186+0000 7f50d22b3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a65c3b5b40 0x55a65c3b4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:53.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.186+0000 7f50d22b3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a65c3b45d0 0x55a65c3b4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:53.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.186+0000 7f50d22b3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a65c3bf370 0x55a65c3c1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:53.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.186+0000 7f50d22b3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a65c31a2f0 con 0x55a65c3bf370 2024-09-19T09:04:53.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.186+0000 7f50d22b3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55a65c2c1cf0 con 0x55a65c3b5b40 2024-09-19T09:04:53.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.186+0000 7f50d22b3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a65c3162b0 con 0x55a65c3b45d0 2024-09-19T09:04:53.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.186+0000 7f50beffd640 1 --2- 172.21.15.19:0/1826727406 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f50b40a3240 0x7f50b40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:53.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.186+0000 7f50cd475640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a65c3bf370 0x55a65c3c1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:53.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.186+0000 7f50cdc76640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a65c3b45d0 0x55a65c3b4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:53.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.186+0000 7f50cd475640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a65c3bf370 0x55a65c3c1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59766/0 (socket says 172.21.15.19:59766) 2024-09-19T09:04:53.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.186+0000 7f50cdc76640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a65c3b45d0 0x55a65c3b4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.19:43684/0 (socket says 172.21.15.19:43684) 2024-09-19T09:04:53.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.186+0000 7f50cd475640 1 -- 172.21.15.19:0/982576992 learned_addr learned my addr 172.21.15.19:0/982576992 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:53.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.186+0000 7f50ce477640 1 --2- 172.21.15.19:0/1826727406 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f50b40a3240 0x7f50b40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:53.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.186+0000 7f50ce477640 1 --2- 172.21.15.19:0/982576992 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a65c3b5b40 0x55a65c3b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:53.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.186+0000 7f50cd475640 1 -- 172.21.15.19:0/982576992 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a65c3b45d0 msgr2=0x55a65c3b4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:53.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.186+0000 7f50cd475640 1 --2- 172.21.15.19:0/982576992 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a65c3b45d0 0x55a65c3b4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.186+0000 7f50cd475640 1 -- 172.21.15.19:0/982576992 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a65c3b5b40 msgr2=0x55a65c3b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:53.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.186+0000 7f50cd475640 1 --2- 172.21.15.19:0/982576992 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a65c3b5b40 0x55a65c3b4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.186+0000 7f50cd475640 1 -- 172.21.15.19:0/982576992 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a65c2a63a0 con 0x55a65c3bf370 2024-09-19T09:04:53.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.186+0000 7f50beffd640 1 -- 172.21.15.19:0/1826727406 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f50c40eff20 con 0x7f50c8101df0 2024-09-19T09:04:53.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.186+0000 7f50ce477640 1 --2- 172.21.15.19:0/982576992 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a65c3b5b40 0x55a65c3b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:53.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.187+0000 7f50cd475640 1 --2- 172.21.15.19:0/982576992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a65c3bf370 0x55a65c3c1760 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f50b800bae0 tx=0x7f50b800d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87a8e991265b0d9c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:53.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.187+0000 7f50ce477640 1 --2- 172.21.15.19:0/1826727406 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f50b40a3240 0x7f50b40a5700 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f50c0009fd0 tx=0x7f50c0009540 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:53.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.187+0000 7f50b3fff640 1 -- 172.21.15.19:0/982576992 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b8016070 con 0x55a65c3bf370 2024-09-19T09:04:53.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.187+0000 7f50b3fff640 1 -- 172.21.15.19:0/982576992 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50b8005500 con 0x55a65c3bf370 2024-09-19T09:04:53.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.187+0000 7f50b3fff640 1 -- 172.21.15.19:0/982576992 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50b8010460 con 0x55a65c3bf370 2024-09-19T09:04:53.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.187+0000 7f50d22b3740 1 -- 172.21.15.19:0/982576992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a65c3bf370 msgr2=0x55a65c3c1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:53.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.187+0000 7f50d22b3740 1 --2- 172.21.15.19:0/982576992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a65c3bf370 0x55a65c3c1760 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f50b800bae0 tx=0x7f50b800d2e0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.188+0000 7f50d22b3740 1 -- 172.21.15.19:0/982576992 shutdown_connections 2024-09-19T09:04:53.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.188+0000 7f50d22b3740 1 --2- 172.21.15.19:0/982576992 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a65c3b45d0 0x55a65c3b4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.188+0000 7f50d22b3740 1 --2- 172.21.15.19:0/982576992 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a65c3bf370 0x55a65c3c1760 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.188+0000 7f50d22b3740 1 --2- 172.21.15.19:0/982576992 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a65c3b5b40 0x55a65c3b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.188+0000 7f50d22b3740 1 -- 172.21.15.19:0/982576992 >> 172.21.15.19:0/982576992 conn(0x55a65c37d310 msgr2=0x55a65c3b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:53.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.188+0000 7f50d22b3740 1 -- 172.21.15.19:0/982576992 shutdown_connections 2024-09-19T09:04:53.197 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.188+0000 7f50d22b3740 1 -- 172.21.15.19:0/982576992 wait complete. 2024-09-19T09:04:53.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.189+0000 7f50d22b3740 1 -- start start 2024-09-19T09:04:53.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.189+0000 7f50d22b3740 1 Processor -- start 2024-09-19T09:04:53.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.189+0000 7f50d22b3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a65c3b45d0 0x55a65c3becc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:53.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.189+0000 7f50d22b3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a65c3b5b40 0x55a65c3bbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:53.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.189+0000 7f50d22b3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a65c3bf370 0x55a65c3bc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:53.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.189+0000 7f50d22b3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55a65c3c2070 con 0x55a65c3b45d0 2024-09-19T09:04:53.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.189+0000 7f50d22b3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55a65c2d5060 con 0x55a65c3bf370 2024-09-19T09:04:53.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.189+0000 7f50d22b3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a65c3c21f0 con 0x55a65c3b5b40 2024-09-19T09:04:53.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.189+0000 7f50d22b3740 10 client.0 _ll_register_callbacks cb 0x55a65c0288c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:53.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.190+0000 7f50cdc76640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a65c3b45d0 0x55a65c3becc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:53.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.190+0000 7f50cdc76640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a65c3b45d0 0x55a65c3becc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59778/0 (socket says 172.21.15.19:59778) 2024-09-19T09:04:53.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.190+0000 7f50cdc76640 1 -- 172.21.15.19:0/2240066138 learned_addr learned my addr 172.21.15.19:0/2240066138 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:53.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.190+0000 7f50cd475640 1 --2- 172.21.15.19:0/2240066138 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a65c3b5b40 0x55a65c3bbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:53.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.190+0000 7f50ce477640 1 --2- 172.21.15.19:0/2240066138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a65c3bf370 0x55a65c3bc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:53.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.190+0000 7f50cdc76640 1 -- 172.21.15.19:0/2240066138 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a65c3b5b40 msgr2=0x55a65c3bbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:53.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.190+0000 7f50cdc76640 1 --2- 172.21.15.19:0/2240066138 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a65c3b5b40 0x55a65c3bbf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.190+0000 7f50cdc76640 1 -- 172.21.15.19:0/2240066138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a65c3bf370 msgr2=0x55a65c3bc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:53.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.190+0000 7f50cdc76640 1 --2- 172.21.15.19:0/2240066138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a65c3bf370 0x55a65c3bc4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.190+0000 7f50cdc76640 1 -- 172.21.15.19:0/2240066138 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a65c08b3c0 con 0x55a65c3b45d0 2024-09-19T09:04:53.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.190+0000 7f50cdc76640 1 --2- 172.21.15.19:0/2240066138 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a65c3b45d0 0x55a65c3becc0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f50c40b8f80 tx=0x7f50c408c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3946270cf443aece server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.190+0000 7f50b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:04:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.190+0000 7f50b17fa640 1 -- 172.21.15.19:0/2240066138 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c4049040 con 0x55a65c3b45d0 2024-09-19T09:04:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.190+0000 7f50b17fa640 1 -- 172.21.15.19:0/2240066138 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f50c408e020 con 0x55a65c3b45d0 2024-09-19T09:04:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.190+0000 7f50d22b3740 1 -- 172.21.15.19:0/2240066138 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50b8005500 con 0x55a65c3b45d0 2024-09-19T09:04:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.190+0000 7f50b17fa640 1 -- 172.21.15.19:0/2240066138 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f50c40b8850 con 0x55a65c3b45d0 2024-09-19T09:04:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.190+0000 7f50d22b3740 10 client.18750 fetch_fsmap learned FSMap version 43 2024-09-19T09:04:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.190+0000 7f50d22b3740 1 -- 172.21.15.19:0/2240066138 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55a65c3cda80 con 0x55a65c3b45d0 2024-09-19T09:04:53.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.191+0000 7f50b17fa640 1 -- 172.21.15.19:0/2240066138 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50b8005500 con 0x55a65c3b45d0 2024-09-19T09:04:53.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.191+0000 7f50b17fa640 1 -- 172.21.15.19:0/2240066138 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7f50c40bc810 con 0x55a65c3b45d0 2024-09-19T09:04:53.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.191+0000 7f50d22b3740 10 client.18750 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T09:04:53.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.191+0000 7f50d22b3740 10 client.18750 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-19T09:04:53.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.191+0000 7f50d22b3740 20 client.18750 populate_metadata read hostname 'smithi019' 2024-09-19T09:04:53.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.191+0000 7f50d22b3740 1 --2- 172.21.15.19:0/2240066138 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55a65c3ceec0 0x55a65c3d1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:53.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.191+0000 7f50d22b3740 4 client.18750 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:53.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.191+0000 7f50d22b3740 1 -- 172.21.15.19:0/2240066138 --> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a65c327860 con 0x55a65c3ceec0 2024-09-19T09:04:53.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.191+0000 7f50cd475640 1 --2- 172.21.15.19:0/2240066138 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55a65c3ceec0 0x55a65c3d1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:53.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.192+0000 7f50cd475640 1 --2- 172.21.15.19:0/2240066138 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55a65c3ceec0 0x55a65c3d1350 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4ac69ebd40a5ecee server_cookie=58a7ee318f6f9058 in_seq=0 out_seq=0 2024-09-19T09:04:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.192+0000 7f50b17fa640 10 client.18750 ms_handle_connect on v2:172.21.15.155:6836/3381010945 2024-09-19T09:04:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.192+0000 7f50b17fa640 1 -- 172.21.15.19:0/2240066138 <== mds.3 v2:172.21.15.155:6836/3381010945 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a65c327860 con 0x55a65c3ceec0 2024-09-19T09:04:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.192+0000 7f50b17fa640 10 client.18750 handle_command_reply: tid=0 2024-09-19T09:04:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.192+0000 7f50d22b3740 1 client.18750 shutdown 2024-09-19T09:04:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.193+0000 7f50d22b3740 1 -- 172.21.15.19:0/2240066138 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a65c3b45d0 msgr2=0x55a65c3becc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.193+0000 7f50d22b3740 1 --2- 172.21.15.19:0/2240066138 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a65c3b45d0 0x55a65c3becc0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f50c40b8f80 tx=0x7f50c408c2e0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.193+0000 7f50d22b3740 1 -- 172.21.15.19:0/2240066138 shutdown_connections 2024-09-19T09:04:53.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.193+0000 7f50d22b3740 1 --2- 172.21.15.19:0/2240066138 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55a65c3ceec0 0x55a65c3d1350 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.193+0000 7f50d22b3740 1 --2- 172.21.15.19:0/2240066138 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a65c3b5b40 0x55a65c3bbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.193+0000 7f50d22b3740 1 --2- 172.21.15.19:0/2240066138 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a65c3bf370 0x55a65c3bc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.193+0000 7f50d22b3740 1 --2- 172.21.15.19:0/2240066138 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a65c3b45d0 0x55a65c3becc0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.193+0000 7f50b17fa640 0 client.18750 ms_handle_reset on v2:172.21.15.155:6836/3381010945 2024-09-19T09:04:53.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.193+0000 7f50d22b3740 1 -- 172.21.15.19:0/2240066138 >> 172.21.15.19:0/2240066138 conn(0x55a65c37d310 msgr2=0x55a65c3b6960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:53.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.193+0000 7f50d22b3740 1 -- 172.21.15.19:0/2240066138 shutdown_connections 2024-09-19T09:04:53.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.193+0000 7f50d22b3740 1 -- 172.21.15.19:0/2240066138 wait complete. 2024-09-19T09:04:53.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.193+0000 7f50d22b3740 20 client.18750 trim_cache size 0 max 16384 2024-09-19T09:04:53.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.206+0000 7f50d22b3740 1 Processor -- start 2024-09-19T09:04:53.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.206+0000 7f50d22b3740 1 -- start start 2024-09-19T09:04:53.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.206+0000 7f50d22b3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a65c3b45d0 0x55a65c3cb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:53.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.206+0000 7f50d22b3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a65c3b5b40 0x55a65c3b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:53.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.206+0000 7f50d22b3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a65c3bf370 0x55a65c3c0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:53.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.206+0000 7f50d22b3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f50c81af6d0 con 0x55a65c3b45d0 2024-09-19T09:04:53.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.206+0000 7f50d22b3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f50c81b1210 con 0x55a65c3bf370 2024-09-19T09:04:53.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.206+0000 7f50d22b3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f50c81afda0 con 0x55a65c3b5b40 2024-09-19T09:04:53.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.206+0000 7f50cdc76640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a65c3b45d0 0x55a65c3cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:53.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.206+0000 7f50cdc76640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a65c3b45d0 0x55a65c3cb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59794/0 (socket says 172.21.15.19:59794) 2024-09-19T09:04:53.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.206+0000 7f50cdc76640 1 -- 172.21.15.19:0/1304798040 learned_addr learned my addr 172.21.15.19:0/1304798040 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:53.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.206+0000 7f50cd475640 1 --2- 172.21.15.19:0/1304798040 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a65c3b5b40 0x55a65c3b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:53.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.206+0000 7f50ce477640 1 --2- 172.21.15.19:0/1304798040 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a65c3bf370 0x55a65c3c0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:53.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.206+0000 7f50cdc76640 1 -- 172.21.15.19:0/1304798040 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a65c3b5b40 msgr2=0x55a65c3b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:53.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.206+0000 7f50cdc76640 1 --2- 172.21.15.19:0/1304798040 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a65c3b5b40 0x55a65c3b3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.206+0000 7f50cdc76640 1 -- 172.21.15.19:0/1304798040 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a65c3bf370 msgr2=0x55a65c3c0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:53.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.206+0000 7f50cdc76640 1 --2- 172.21.15.19:0/1304798040 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a65c3bf370 0x55a65c3c0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.206+0000 7f50cdc76640 1 -- 172.21.15.19:0/1304798040 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a65c3ba4c0 con 0x55a65c3b45d0 2024-09-19T09:04:53.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.206+0000 7f50cd475640 1 --2- 172.21.15.19:0/1304798040 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a65c3b5b40 0x55a65c3b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:53.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.207+0000 7f50ce477640 1 --2- 172.21.15.19:0/1304798040 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a65c3bf370 0x55a65c3c0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:53.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.207+0000 7f50cdc76640 1 --2- 172.21.15.19:0/1304798040 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a65c3b45d0 0x55a65c3cb310 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f50c4032c00 tx=0x7f50c40b8250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aeed8a841e999f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:53.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.207+0000 7f50b37fe640 1 -- 172.21.15.19:0/1304798040 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c4049070 con 0x55a65c3b45d0 2024-09-19T09:04:53.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.207+0000 7f50b37fe640 1 -- 172.21.15.19:0/1304798040 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50c40bccb0 con 0x55a65c3b45d0 2024-09-19T09:04:53.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.207+0000 7f50b37fe640 1 -- 172.21.15.19:0/1304798040 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c403bcb0 con 0x55a65c3b45d0 2024-09-19T09:04:53.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.207+0000 7f50d22b3740 1 -- 172.21.15.19:0/1304798040 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a65c3b45d0 msgr2=0x55a65c3cb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:53.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.207+0000 7f50d22b3740 1 --2- 172.21.15.19:0/1304798040 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a65c3b45d0 0x55a65c3cb310 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f50c4032c00 tx=0x7f50c40b8250 comp rx=0 tx=0).stop 2024-09-19T09:04:53.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.207+0000 7f50d22b3740 1 -- 172.21.15.19:0/1304798040 shutdown_connections 2024-09-19T09:04:53.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.207+0000 7f50d22b3740 1 --2- 172.21.15.19:0/1304798040 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a65c3b5b40 0x55a65c3b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.207+0000 7f50d22b3740 1 --2- 172.21.15.19:0/1304798040 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a65c3bf370 0x55a65c3c0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.208+0000 7f50d22b3740 1 --2- 172.21.15.19:0/1304798040 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a65c3b45d0 0x55a65c3cb310 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.208+0000 7f50d22b3740 1 -- 172.21.15.19:0/1304798040 >> 172.21.15.19:0/1304798040 conn(0x55a65c37d310 msgr2=0x55a65c3bb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:53.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.208+0000 7f50d22b3740 1 -- 172.21.15.19:0/1304798040 shutdown_connections 2024-09-19T09:04:53.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.208+0000 7f50d22b3740 1 -- 172.21.15.19:0/1304798040 wait complete. 2024-09-19T09:04:53.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.208+0000 7f50d22b3740 1 -- start start 2024-09-19T09:04:53.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.208+0000 7f50d22b3740 1 Processor -- start 2024-09-19T09:04:53.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.208+0000 7f50d22b3740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a65c3b45d0 0x55a65c3c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:53.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.208+0000 7f50d22b3740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a65c3b5b40 0x55a65c3d6540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:53.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.208+0000 7f50d22b3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a65c3bf370 0x55a65c3d6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:53.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.209+0000 7f50d22b3740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f50c81b0b40 con 0x55a65c3b45d0 2024-09-19T09:04:53.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.209+0000 7f50d22b3740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f50c81b0470 con 0x55a65c3b5b40 2024-09-19T09:04:53.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.209+0000 7f50d22b3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f50c81ad6b0 con 0x55a65c3bf370 2024-09-19T09:04:53.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.209+0000 7f50cdc76640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a65c3b45d0 0x55a65c3c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:53.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.209+0000 7f50d22b3740 10 client.0 _ll_register_callbacks cb 0x7f50c4005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:53.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.209+0000 7f50cdc76640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a65c3b45d0 0x55a65c3c7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59798/0 (socket says 172.21.15.19:59798) 2024-09-19T09:04:53.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.209+0000 7f50cdc76640 1 -- 172.21.15.19:0/3464320530 learned_addr learned my addr 172.21.15.19:0/3464320530 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:53.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.209+0000 7f50cd475640 1 --2- 172.21.15.19:0/3464320530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a65c3b5b40 0x55a65c3d6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:53.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.209+0000 7f50ce477640 1 --2- 172.21.15.19:0/3464320530 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a65c3bf370 0x55a65c3d6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:53.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.209+0000 7f50cdc76640 1 -- 172.21.15.19:0/3464320530 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a65c3bf370 msgr2=0x55a65c3d6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:53.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.209+0000 7f50cdc76640 1 --2- 172.21.15.19:0/3464320530 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a65c3bf370 0x55a65c3d6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.209+0000 7f50cdc76640 1 -- 172.21.15.19:0/3464320530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a65c3b5b40 msgr2=0x55a65c3d6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:53.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.209+0000 7f50cdc76640 1 --2- 172.21.15.19:0/3464320530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a65c3b5b40 0x55a65c3d6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.209+0000 7f50cdc76640 1 -- 172.21.15.19:0/3464320530 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a65c3d7340 con 0x55a65c3b45d0 2024-09-19T09:04:53.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.209+0000 7f50cdc76640 1 --2- 172.21.15.19:0/3464320530 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a65c3b45d0 0x55a65c3c7c90 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f50c4005940 tx=0x7f50c40c09e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19fa02bd71ac1f93 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:53.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.209+0000 7f50b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:04:53.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.209+0000 7f50b17fa640 1 -- 172.21.15.19:0/3464320530 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50c4049070 con 0x55a65c3b45d0 2024-09-19T09:04:53.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.209+0000 7f50b17fa640 1 -- 172.21.15.19:0/3464320530 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f50c40bbc00 con 0x55a65c3b45d0 2024-09-19T09:04:53.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.209+0000 7f50d22b3740 1 -- 172.21.15.19:0/3464320530 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f50c40bccb0 con 0x55a65c3b45d0 2024-09-19T09:04:53.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.210+0000 7f50b17fa640 1 -- 172.21.15.19:0/3464320530 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f50c40bbf10 con 0x55a65c3b45d0 2024-09-19T09:04:53.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.210+0000 7f50d22b3740 10 client.18756 fetch_fsmap learned FSMap version 43 2024-09-19T09:04:53.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.210+0000 7f50d22b3740 1 -- 172.21.15.19:0/3464320530 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55a65c3d7340 con 0x55a65c3b45d0 2024-09-19T09:04:53.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.210+0000 7f50b17fa640 1 -- 172.21.15.19:0/3464320530 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f50c40bccb0 con 0x55a65c3b45d0 2024-09-19T09:04:53.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.210+0000 7f50b17fa640 1 -- 172.21.15.19:0/3464320530 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7f50c40bb470 con 0x55a65c3b45d0 2024-09-19T09:04:53.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.210+0000 7f50d22b3740 10 client.18756 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T09:04:53.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.210+0000 7f50d22b3740 10 client.18756 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.h 2024-09-19T09:04:53.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.210+0000 7f50d22b3740 20 client.18756 populate_metadata read hostname 'smithi019' 2024-09-19T09:04:53.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.210+0000 7f50d22b3740 1 --2- 172.21.15.19:0/3464320530 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55a65c442600 0x55a65c4449f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:53.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.210+0000 7f50d22b3740 4 client.18756 mds_command: new command op to 24464 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:04:53.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.210+0000 7f50d22b3740 1 -- 172.21.15.19:0/3464320530 --> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a65c321d70 con 0x55a65c442600 2024-09-19T09:04:53.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.210+0000 7f50cd475640 1 --2- 172.21.15.19:0/3464320530 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55a65c442600 0x55a65c4449f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:53.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.211+0000 7f50cd475640 1 --2- 172.21.15.19:0/3464320530 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55a65c442600 0x55a65c4449f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8a44785481605f4c server_cookie=94312e1880d04022 in_seq=0 out_seq=0 2024-09-19T09:04:53.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.211+0000 7f50b17fa640 10 client.18756 ms_handle_connect on v2:172.21.15.155:6836/3381010945 2024-09-19T09:04:53.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.211+0000 7f50b17fa640 1 -- 172.21.15.19:0/3464320530 <== mds.3 v2:172.21.15.155:6836/3381010945 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a65c321d70 con 0x55a65c442600 2024-09-19T09:04:53.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.211+0000 7f50b17fa640 10 client.18756 handle_command_reply: tid=0 2024-09-19T09:04:53.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.211+0000 7f50d22b3740 1 client.18756 shutdown 2024-09-19T09:04:53.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.211+0000 7f50d22b3740 1 -- 172.21.15.19:0/3464320530 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a65c3b45d0 msgr2=0x55a65c3c7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:53.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.211+0000 7f50d22b3740 1 --2- 172.21.15.19:0/3464320530 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a65c3b45d0 0x55a65c3c7c90 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f50c4005940 tx=0x7f50c40c09e0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.211+0000 7f50d22b3740 1 -- 172.21.15.19:0/3464320530 shutdown_connections 2024-09-19T09:04:53.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.211+0000 7f50d22b3740 1 --2- 172.21.15.19:0/3464320530 >> [v2:172.21.15.155:6836/3381010945,v1:172.21.15.155:6837/3381010945] conn(0x55a65c442600 0x55a65c4449f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.211+0000 7f50d22b3740 1 --2- 172.21.15.19:0/3464320530 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a65c3bf370 0x55a65c3d6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.211+0000 7f50d22b3740 1 --2- 172.21.15.19:0/3464320530 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55a65c3b5b40 0x55a65c3d6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.211+0000 7f50b17fa640 0 client.18756 ms_handle_reset on v2:172.21.15.155:6836/3381010945 2024-09-19T09:04:53.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.211+0000 7f50d22b3740 1 --2- 172.21.15.19:0/3464320530 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55a65c3b45d0 0x55a65c3c7c90 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.211+0000 7f50d22b3740 1 -- 172.21.15.19:0/3464320530 >> 172.21.15.19:0/3464320530 conn(0x55a65c37d310 msgr2=0x55a65c3bac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:53.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.211+0000 7f50d22b3740 1 -- 172.21.15.19:0/3464320530 shutdown_connections 2024-09-19T09:04:53.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.211+0000 7f50d22b3740 1 -- 172.21.15.19:0/3464320530 wait complete. 2024-09-19T09:04:53.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.211+0000 7f50d22b3740 20 client.18756 trim_cache size 0 max 16384 2024-09-19T09:04:53.223 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:04:53.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.212+0000 7f50cfeda640 1 -- 172.21.15.19:0/1826727406 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f50b40a3240 msgr2=0x7f50b40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:53.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.212+0000 7f50cfeda640 1 --2- 172.21.15.19:0/1826727406 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f50b40a3240 0x7f50b40a5700 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f50c0009fd0 tx=0x7f50c0009540 comp rx=0 tx=0).stop 2024-09-19T09:04:53.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.212+0000 7f50cfeda640 1 -- 172.21.15.19:0/1826727406 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50c8101df0 msgr2=0x7f50c80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:53.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.212+0000 7f50cfeda640 1 --2- 172.21.15.19:0/1826727406 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50c8101df0 0x7f50c80744f0 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f50c4006010 tx=0x7f50c40042f0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.212+0000 7f50cfeda640 1 -- 172.21.15.19:0/1826727406 shutdown_connections 2024-09-19T09:04:53.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.212+0000 7f50cfeda640 1 --2- 172.21.15.19:0/1826727406 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f50b40a3240 0x7f50b40a5700 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.212+0000 7f50cfeda640 1 --2- 172.21.15.19:0/1826727406 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f50c8106f20 0x7f50c8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.212+0000 7f50cfeda640 1 --2- 172.21.15.19:0/1826727406 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f50c81027a0 0x7f50c8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.212+0000 7f50cfeda640 1 --2- 172.21.15.19:0/1826727406 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f50c8101df0 0x7f50c80744f0 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:53.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.212+0000 7f50cfeda640 1 -- 172.21.15.19:0/1826727406 >> 172.21.15.19:0/1826727406 conn(0x7f50c80fd8f0 msgr2=0x7f50c80fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:53.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.212+0000 7f50cfeda640 1 -- 172.21.15.19:0/1826727406 shutdown_connections 2024-09-19T09:04:53.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:53.212+0000 7f50cfeda640 1 -- 172.21.15.19:0/1826727406 wait complete. 2024-09-19T09:04:53.943 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:53 smithi019 ceph-mon[30976]: pgmap v723: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2024-09-19T09:04:53.944 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T09:04:53.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:53 smithi203 ceph-mon[35450]: pgmap v723: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2024-09-19T09:04:54.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:53 smithi155 ceph-mon[34921]: pgmap v723: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2024-09-19T09:04:54.207 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:54.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.723+0000 7f0612a60640 1 -- 172.21.15.19:0/222416873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f060c106f10 msgr2=0x7f060c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:54.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.723+0000 7f0612a60640 1 --2- 172.21.15.19:0/222416873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f060c106f10 0x7f060c10ea90 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f0604009ca0 tx=0x7f060402a8c0 comp rx=0 tx=0).stop 2024-09-19T09:04:54.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.723+0000 7f0612a60640 1 -- 172.21.15.19:0/222416873 shutdown_connections 2024-09-19T09:04:54.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.723+0000 7f0612a60640 1 --2- 172.21.15.19:0/222416873 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f060c102790 0x7f060c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:54.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.723+0000 7f0612a60640 1 --2- 172.21.15.19:0/222416873 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f060c106f10 0x7f060c10ea90 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:54.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.723+0000 7f0612a60640 1 --2- 172.21.15.19:0/222416873 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f060c101de0 0x7f060c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:54.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.723+0000 7f0612a60640 1 -- 172.21.15.19:0/222416873 >> 172.21.15.19:0/222416873 conn(0x7f060c0fd880 msgr2=0x7f060c0ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:54.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.723+0000 7f0612a60640 1 -- 172.21.15.19:0/222416873 shutdown_connections 2024-09-19T09:04:54.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.723+0000 7f0612a60640 1 -- 172.21.15.19:0/222416873 wait complete. 2024-09-19T09:04:54.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.724+0000 7f0612a60640 1 Processor -- start 2024-09-19T09:04:54.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.724+0000 7f0612a60640 1 -- start start 2024-09-19T09:04:54.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.724+0000 7f0612a60640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f060c101de0 0x7f060c198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:54.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.724+0000 7f0612a60640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f060c102790 0x7f060c1988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:54.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.724+0000 7f0612a60640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f060c106f10 0x7f060c19cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:54.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.724+0000 7f0612a60640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f060c111f70 con 0x7f060c101de0 2024-09-19T09:04:54.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.724+0000 7f0612a60640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f060c111df0 con 0x7f060c106f10 2024-09-19T09:04:54.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.724+0000 7f0612a60640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f060c1120f0 con 0x7f060c102790 2024-09-19T09:04:54.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.724+0000 7f060bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f060c101de0 0x7f060c198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:54.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.724+0000 7f060bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f060c101de0 0x7f060c198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59828/0 (socket says 172.21.15.19:59828) 2024-09-19T09:04:54.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.724+0000 7f060bfff640 1 -- 172.21.15.19:0/2543326932 learned_addr learned my addr 172.21.15.19:0/2543326932 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:54.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.725+0000 7f0610ffd640 1 --2- 172.21.15.19:0/2543326932 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f060c106f10 0x7f060c19cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:54.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.725+0000 7f0603fff640 1 --2- 172.21.15.19:0/2543326932 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f060c102790 0x7f060c1988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:54.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.725+0000 7f060bfff640 1 -- 172.21.15.19:0/2543326932 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f060c102790 msgr2=0x7f060c1988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:54.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.725+0000 7f060bfff640 1 --2- 172.21.15.19:0/2543326932 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f060c102790 0x7f060c1988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:54.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.725+0000 7f060bfff640 1 -- 172.21.15.19:0/2543326932 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f060c106f10 msgr2=0x7f060c19cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:54.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.725+0000 7f060bfff640 1 --2- 172.21.15.19:0/2543326932 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f060c106f10 0x7f060c19cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:54.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.725+0000 7f060bfff640 1 -- 172.21.15.19:0/2543326932 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f060c19d340 con 0x7f060c101de0 2024-09-19T09:04:54.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.725+0000 7f0603fff640 1 --2- 172.21.15.19:0/2543326932 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f060c102790 0x7f060c1988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:54.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.725+0000 7f060bfff640 1 --2- 172.21.15.19:0/2543326932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f060c101de0 0x7f060c198390 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f05fc00c920 tx=0x7f05fc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:54.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.725+0000 7f0609ffb640 1 -- 172.21.15.19:0/2543326932 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05fc007c70 con 0x7f060c101de0 2024-09-19T09:04:54.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.725+0000 7f0609ffb640 1 -- 172.21.15.19:0/2543326932 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05fc007e10 con 0x7f060c101de0 2024-09-19T09:04:54.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.725+0000 7f0612a60640 1 -- 172.21.15.19:0/2543326932 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f060c19d630 con 0x7f060c101de0 2024-09-19T09:04:54.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.725+0000 7f0609ffb640 1 -- 172.21.15.19:0/2543326932 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05fc018890 con 0x7f060c101de0 2024-09-19T09:04:54.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.725+0000 7f0612a60640 1 -- 172.21.15.19:0/2543326932 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f060c1a4f10 con 0x7f060c101de0 2024-09-19T09:04:54.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.727+0000 7f0609ffb640 1 -- 172.21.15.19:0/2543326932 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f05fc018a70 con 0x7f060c101de0 2024-09-19T09:04:54.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.728+0000 7f0614e39740 1 Processor -- start 2024-09-19T09:04:54.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.728+0000 7f0614e39740 1 -- start start 2024-09-19T09:04:54.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.728+0000 7f0614e39740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c14f28b40 0x558c14f27090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:54.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.728+0000 7f0614e39740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c14f275d0 0x558c14f27a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:54.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.728+0000 7f0614e39740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c14f32370 0x558c14f34760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:54.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.728+0000 7f0614e39740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x558c14e8d2f0 con 0x558c14f32370 2024-09-19T09:04:54.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.728+0000 7f0614e39740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x558c14e34cf0 con 0x558c14f275d0 2024-09-19T09:04:54.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.728+0000 7f0614e39740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558c14e892b0 con 0x558c14f28b40 2024-09-19T09:04:54.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.728+0000 7f0603fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c14f32370 0x558c14f34760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:54.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.728+0000 7f0603fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c14f32370 0x558c14f34760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59832/0 (socket says 172.21.15.19:59832) 2024-09-19T09:04:54.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.728+0000 7f0603fff640 1 -- 172.21.15.19:0/3409464639 learned_addr learned my addr 172.21.15.19:0/3409464639 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:54.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.728+0000 7f0609ffb640 1 --2- 172.21.15.19:0/2543326932 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f05f80a3240 0x7f05f80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:54.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.728+0000 7f060bfff640 1 --2- 172.21.15.19:0/3409464639 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c14f275d0 0x558c14f27a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:54.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.728+0000 7f0610ffd640 1 --2- 172.21.15.19:0/3409464639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c14f28b40 0x558c14f27090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:54.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.728+0000 7f0610ffd640 1 --2- 172.21.15.19:0/2543326932 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f05f80a3240 0x7f05f80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:54.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.729+0000 7f0603fff640 1 -- 172.21.15.19:0/3409464639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c14f28b40 msgr2=0x558c14f27090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:54.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.729+0000 7f0603fff640 1 --2- 172.21.15.19:0/3409464639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c14f28b40 0x558c14f27090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:54.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.729+0000 7f0603fff640 1 -- 172.21.15.19:0/3409464639 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c14f275d0 msgr2=0x558c14f27a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:54.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.729+0000 7f0603fff640 1 --2- 172.21.15.19:0/3409464639 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c14f275d0 0x558c14f27a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:54.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.729+0000 7f0609ffb640 1 -- 172.21.15.19:0/2543326932 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f05fc0cfb60 con 0x7f060c101de0 2024-09-19T09:04:54.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.729+0000 7f0603fff640 1 -- 172.21.15.19:0/3409464639 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c14e193a0 con 0x558c14f32370 2024-09-19T09:04:54.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.729+0000 7f0610ffd640 1 --2- 172.21.15.19:0/3409464639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c14f28b40 0x558c14f27090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:54.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.729+0000 7f0603fff640 1 --2- 172.21.15.19:0/3409464639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c14f32370 0x558c14f34760 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f05f400bb60 tx=0x7f05f400d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a4a04b079e08d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:54.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.729+0000 7f06027fc640 1 -- 172.21.15.19:0/3409464639 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f400be60 con 0x558c14f32370 2024-09-19T09:04:54.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.729+0000 7f0610ffd640 1 --2- 172.21.15.19:0/2543326932 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f05f80a3240 0x7f05f80a5700 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0604005fe0 tx=0x7f06040095c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:54.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.729+0000 7f06027fc640 1 -- 172.21.15.19:0/3409464639 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05f4017b00 con 0x558c14f32370 2024-09-19T09:04:54.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.729+0000 7f06027fc640 1 -- 172.21.15.19:0/3409464639 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f400fc50 con 0x558c14f32370 2024-09-19T09:04:54.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.730+0000 7f0614e39740 1 -- 172.21.15.19:0/3409464639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c14f32370 msgr2=0x558c14f34760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:54.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.730+0000 7f0614e39740 1 --2- 172.21.15.19:0/3409464639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c14f32370 0x558c14f34760 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f05f400bb60 tx=0x7f05f400d710 comp rx=0 tx=0).stop 2024-09-19T09:04:54.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.730+0000 7f0614e39740 1 -- 172.21.15.19:0/3409464639 shutdown_connections 2024-09-19T09:04:54.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.730+0000 7f0614e39740 1 --2- 172.21.15.19:0/3409464639 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c14f32370 0x558c14f34760 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:54.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.730+0000 7f0614e39740 1 --2- 172.21.15.19:0/3409464639 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c14f275d0 0x558c14f27a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:54.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.730+0000 7f0614e39740 1 --2- 172.21.15.19:0/3409464639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c14f28b40 0x558c14f27090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:54.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.730+0000 7f0614e39740 1 -- 172.21.15.19:0/3409464639 >> 172.21.15.19:0/3409464639 conn(0x558c14ef0310 msgr2=0x558c14f23c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:54.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.730+0000 7f0614e39740 1 -- 172.21.15.19:0/3409464639 shutdown_connections 2024-09-19T09:04:54.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.730+0000 7f0614e39740 1 -- 172.21.15.19:0/3409464639 wait complete. 2024-09-19T09:04:54.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.730+0000 7f0614e39740 1 -- start start 2024-09-19T09:04:54.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.730+0000 7f0614e39740 1 Processor -- start 2024-09-19T09:04:54.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.731+0000 7f0614e39740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c14f275d0 0x558c14f31cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:54.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.731+0000 7f0614e39740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c14f28b40 0x558c14f2ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:54.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.731+0000 7f0614e39740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c14f32370 0x558c14f2f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:54.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.731+0000 7f0614e39740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x558c14f39480 con 0x558c14f275d0 2024-09-19T09:04:54.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.731+0000 7f0614e39740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x558c14e48060 con 0x558c14f28b40 2024-09-19T09:04:54.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.731+0000 7f0614e39740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558c14f39600 con 0x558c14f32370 2024-09-19T09:04:54.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.731+0000 7f0614e39740 10 client.0 _ll_register_callbacks cb 0x558c14b9b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:54.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.731+0000 7f060bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c14f275d0 0x558c14f31cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:54.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.731+0000 7f060bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c14f275d0 0x558c14f31cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59844/0 (socket says 172.21.15.19:59844) 2024-09-19T09:04:54.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.731+0000 7f060bfff640 1 -- 172.21.15.19:0/3238651078 learned_addr learned my addr 172.21.15.19:0/3238651078 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:54.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.731+0000 7f0610ffd640 1 --2- 172.21.15.19:0/3238651078 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c14f32370 0x558c14f2f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:54.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.731+0000 7f0603fff640 1 --2- 172.21.15.19:0/3238651078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c14f28b40 0x558c14f2ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:54.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.731+0000 7f060bfff640 1 -- 172.21.15.19:0/3238651078 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c14f32370 msgr2=0x558c14f2f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:54.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.731+0000 7f060bfff640 1 --2- 172.21.15.19:0/3238651078 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c14f32370 0x558c14f2f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:54.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.731+0000 7f060bfff640 1 -- 172.21.15.19:0/3238651078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c14f28b40 msgr2=0x558c14f2ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:54.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.731+0000 7f060bfff640 1 --2- 172.21.15.19:0/3238651078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c14f28b40 0x558c14f2ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:54.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.731+0000 7f060bfff640 1 -- 172.21.15.19:0/3238651078 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c14bfe3c0 con 0x558c14f275d0 2024-09-19T09:04:54.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.731+0000 7f060bfff640 1 --2- 172.21.15.19:0/3238651078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c14f275d0 0x558c14f31cd0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f05fc00c8f0 tx=0x7f05fc020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2af2452863a1ff2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:54.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.731+0000 7f05eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:04:54.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.731+0000 7f05eb7fe640 1 -- 172.21.15.19:0/3238651078 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05fc09c130 con 0x558c14f275d0 2024-09-19T09:04:54.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.731+0000 7f05eb7fe640 1 -- 172.21.15.19:0/3238651078 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f05fc00fb30 con 0x558c14f275d0 2024-09-19T09:04:54.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.732+0000 7f0614e39740 1 -- 172.21.15.19:0/3238651078 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05f4017b00 con 0x558c14f275d0 2024-09-19T09:04:54.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.732+0000 7f05eb7fe640 1 -- 172.21.15.19:0/3238651078 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f05fc0b5120 con 0x558c14f275d0 2024-09-19T09:04:54.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.732+0000 7f0614e39740 10 client.18768 fetch_fsmap learned FSMap version 43 2024-09-19T09:04:54.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.732+0000 7f0614e39740 1 -- 172.21.15.19:0/3238651078 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x558c14f44e90 con 0x558c14f275d0 2024-09-19T09:04:54.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.732+0000 7f05eb7fe640 1 -- 172.21.15.19:0/3238651078 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f05f4017b00 con 0x558c14f275d0 2024-09-19T09:04:54.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.732+0000 7f05eb7fe640 1 -- 172.21.15.19:0/3238651078 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7f05fc0a4910 con 0x558c14f275d0 2024-09-19T09:04:54.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.732+0000 7f0614e39740 10 client.18768 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T09:04:54.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.732+0000 7f0614e39740 10 client.18768 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T09:04:54.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.732+0000 7f0614e39740 20 client.18768 populate_metadata read hostname 'smithi019' 2024-09-19T09:04:54.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.732+0000 7f0614e39740 1 --2- 172.21.15.19:0/3238651078 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x558c14f462a0 0x558c14f486f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:54.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.732+0000 7f0614e39740 4 client.18768 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:54.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.732+0000 7f0614e39740 1 -- 172.21.15.19:0/3238651078 --> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558c14e9a860 con 0x558c14f462a0 2024-09-19T09:04:54.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.732+0000 7f0603fff640 1 --2- 172.21.15.19:0/3238651078 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x558c14f462a0 0x558c14f486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:54.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.733+0000 7f0603fff640 1 --2- 172.21.15.19:0/3238651078 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x558c14f462a0 0x558c14f486f0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=78a19c9111d738e5 server_cookie=cf15db038b677e6b in_seq=0 out_seq=0 2024-09-19T09:04:54.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.733+0000 7f05eb7fe640 10 client.18768 ms_handle_connect on v2:172.21.15.203:6836/3684671619 2024-09-19T09:04:54.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.734+0000 7f05eb7fe640 1 -- 172.21.15.19:0/3238651078 <== mds.2 v2:172.21.15.203:6836/3684671619 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558c14e9a860 con 0x558c14f462a0 2024-09-19T09:04:54.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.734+0000 7f05eb7fe640 10 client.18768 handle_command_reply: tid=0 2024-09-19T09:04:54.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.734+0000 7f0614e39740 1 client.18768 shutdown 2024-09-19T09:04:54.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.734+0000 7f0614e39740 1 -- 172.21.15.19:0/3238651078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c14f275d0 msgr2=0x558c14f31cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:54.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.734+0000 7f0614e39740 1 --2- 172.21.15.19:0/3238651078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c14f275d0 0x558c14f31cd0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f05fc00c8f0 tx=0x7f05fc020000 comp rx=0 tx=0).stop 2024-09-19T09:04:54.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.734+0000 7f0614e39740 1 -- 172.21.15.19:0/3238651078 shutdown_connections 2024-09-19T09:04:54.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.734+0000 7f0614e39740 1 --2- 172.21.15.19:0/3238651078 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x558c14f462a0 0x558c14f486f0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:54.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.734+0000 7f0614e39740 1 --2- 172.21.15.19:0/3238651078 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c14f32370 0x558c14f2f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:54.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.734+0000 7f0614e39740 1 --2- 172.21.15.19:0/3238651078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c14f28b40 0x558c14f2ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:54.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.734+0000 7f05eb7fe640 0 client.18768 ms_handle_reset on v2:172.21.15.203:6836/3684671619 2024-09-19T09:04:54.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.734+0000 7f0614e39740 1 --2- 172.21.15.19:0/3238651078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c14f275d0 0x558c14f31cd0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:54.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.734+0000 7f0614e39740 1 -- 172.21.15.19:0/3238651078 >> 172.21.15.19:0/3238651078 conn(0x558c14ef0310 msgr2=0x558c14f29960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:54.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.734+0000 7f0614e39740 1 -- 172.21.15.19:0/3238651078 shutdown_connections 2024-09-19T09:04:54.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.734+0000 7f0614e39740 1 -- 172.21.15.19:0/3238651078 wait complete. 2024-09-19T09:04:54.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.734+0000 7f0614e39740 20 client.18768 trim_cache size 0 max 16384 2024-09-19T09:04:54.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.747+0000 7f0614e39740 1 Processor -- start 2024-09-19T09:04:54.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.747+0000 7f0614e39740 1 -- start start 2024-09-19T09:04:54.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.747+0000 7f0614e39740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c14f275d0 0x558c14f42720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:54.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.747+0000 7f0614e39740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c14f28b40 0x558c14f28300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:54.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.747+0000 7f0614e39740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c14f32370 0x558c14f33760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:54.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.747+0000 7f0614e39740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f060c1ab230 con 0x558c14f32370 2024-09-19T09:04:54.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.747+0000 7f0614e39740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f060c1acd70 con 0x558c14f28b40 2024-09-19T09:04:54.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.747+0000 7f0614e39740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f060c1ab900 con 0x558c14f275d0 2024-09-19T09:04:54.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.747+0000 7f0610ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c14f32370 0x558c14f33760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:54.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.747+0000 7f0610ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c14f32370 0x558c14f33760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59854/0 (socket says 172.21.15.19:59854) 2024-09-19T09:04:54.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.747+0000 7f0610ffd640 1 -- 172.21.15.19:0/2105058891 learned_addr learned my addr 172.21.15.19:0/2105058891 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:54.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.747+0000 7f060bfff640 1 --2- 172.21.15.19:0/2105058891 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c14f275d0 0x558c14f42720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:54.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.748+0000 7f0603fff640 1 --2- 172.21.15.19:0/2105058891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c14f28b40 0x558c14f28300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:54.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.748+0000 7f0610ffd640 1 -- 172.21.15.19:0/2105058891 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c14f275d0 msgr2=0x558c14f42720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:54.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.748+0000 7f0610ffd640 1 --2- 172.21.15.19:0/2105058891 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c14f275d0 0x558c14f42720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:54.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.748+0000 7f0610ffd640 1 -- 172.21.15.19:0/2105058891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c14f28b40 msgr2=0x558c14f28300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:54.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.748+0000 7f0610ffd640 1 --2- 172.21.15.19:0/2105058891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c14f28b40 0x558c14f28300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:54.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.748+0000 7f0610ffd640 1 -- 172.21.15.19:0/2105058891 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558c14f2d4d0 con 0x558c14f32370 2024-09-19T09:04:54.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.748+0000 7f060bfff640 1 --2- 172.21.15.19:0/2105058891 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c14f275d0 0x558c14f42720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:54.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.748+0000 7f0610ffd640 1 --2- 172.21.15.19:0/2105058891 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c14f32370 0x558c14f33760 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f0604009ca0 tx=0x7f0604042000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b979bd44e91895a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:54.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.748+0000 7f0601ffb640 1 -- 172.21.15.19:0/2105058891 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0604043070 con 0x558c14f32370 2024-09-19T09:04:54.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.748+0000 7f0601ffb640 1 -- 172.21.15.19:0/2105058891 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0604036040 con 0x558c14f32370 2024-09-19T09:04:54.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.748+0000 7f0601ffb640 1 -- 172.21.15.19:0/2105058891 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0604030a30 con 0x558c14f32370 2024-09-19T09:04:54.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.749+0000 7f0614e39740 1 -- 172.21.15.19:0/2105058891 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c14f32370 msgr2=0x558c14f33760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:54.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.749+0000 7f0614e39740 1 --2- 172.21.15.19:0/2105058891 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c14f32370 0x558c14f33760 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f0604009ca0 tx=0x7f0604042000 comp rx=0 tx=0).stop 2024-09-19T09:04:54.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.749+0000 7f0614e39740 1 -- 172.21.15.19:0/2105058891 shutdown_connections 2024-09-19T09:04:54.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.749+0000 7f0614e39740 1 --2- 172.21.15.19:0/2105058891 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c14f32370 0x558c14f33760 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:54.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.749+0000 7f0614e39740 1 --2- 172.21.15.19:0/2105058891 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c14f28b40 0x558c14f28300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:54.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.749+0000 7f0614e39740 1 --2- 172.21.15.19:0/2105058891 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c14f275d0 0x558c14f42720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:54.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.749+0000 7f0614e39740 1 -- 172.21.15.19:0/2105058891 >> 172.21.15.19:0/2105058891 conn(0x558c14ef0310 msgr2=0x558c14f1ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:54.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.749+0000 7f0614e39740 1 -- 172.21.15.19:0/2105058891 shutdown_connections 2024-09-19T09:04:54.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.749+0000 7f0614e39740 1 -- 172.21.15.19:0/2105058891 wait complete. 2024-09-19T09:04:54.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.749+0000 7f0614e39740 1 -- start start 2024-09-19T09:04:54.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.749+0000 7f0614e39740 1 Processor -- start 2024-09-19T09:04:54.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.749+0000 7f0614e39740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c14f275d0 0x558c14f4d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:54.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.749+0000 7f0614e39740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c14f28b40 0x558c14f4da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:54.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.749+0000 7f0614e39740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c14f32370 0x558c14f3d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:54.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.749+0000 7f0614e39740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f060c1ac6a0 con 0x558c14f275d0 2024-09-19T09:04:54.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.749+0000 7f0614e39740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f060c1abfd0 con 0x558c14f28b40 2024-09-19T09:04:54.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.749+0000 7f0614e39740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f060c1a9210 con 0x558c14f32370 2024-09-19T09:04:54.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.749+0000 7f0614e39740 10 client.0 _ll_register_callbacks cb 0x7f05fc09bf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:54.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.750+0000 7f060bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c14f275d0 0x558c14f4d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:54.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.750+0000 7f060bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c14f275d0 0x558c14f4d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:59866/0 (socket says 172.21.15.19:59866) 2024-09-19T09:04:54.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.750+0000 7f060bfff640 1 -- 172.21.15.19:0/2806242220 learned_addr learned my addr 172.21.15.19:0/2806242220 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:54.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.750+0000 7f0610ffd640 1 --2- 172.21.15.19:0/2806242220 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c14f32370 0x558c14f3d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:54.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.750+0000 7f0603fff640 1 --2- 172.21.15.19:0/2806242220 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c14f28b40 0x558c14f4da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:54.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.750+0000 7f060bfff640 1 -- 172.21.15.19:0/2806242220 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c14f32370 msgr2=0x558c14f3d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:54.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.750+0000 7f060bfff640 1 --2- 172.21.15.19:0/2806242220 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c14f32370 0x558c14f3d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:54.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.750+0000 7f060bfff640 1 -- 172.21.15.19:0/2806242220 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c14f28b40 msgr2=0x558c14f4da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:54.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.750+0000 7f060bfff640 1 --2- 172.21.15.19:0/2806242220 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c14f28b40 0x558c14f4da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:54.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.750+0000 7f060bfff640 1 -- 172.21.15.19:0/2806242220 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558c14f3ded0 con 0x558c14f275d0 2024-09-19T09:04:54.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.750+0000 7f0603fff640 1 --2- 172.21.15.19:0/2806242220 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c14f28b40 0x558c14f4da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:54.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.750+0000 7f0610ffd640 1 --2- 172.21.15.19:0/2806242220 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c14f32370 0x558c14f3d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:54.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.750+0000 7f060bfff640 1 --2- 172.21.15.19:0/2806242220 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c14f275d0 0x558c14f4d500 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f05fc0cff20 tx=0x7f05fc0cfe00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=177c5ec3ee720a66 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:54.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.750+0000 7f05eb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:04:54.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.750+0000 7f05eb7fe640 1 -- 172.21.15.19:0/2806242220 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05fc09ba90 con 0x558c14f275d0 2024-09-19T09:04:54.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.750+0000 7f05eb7fe640 1 -- 172.21.15.19:0/2806242220 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f05fc09b580 con 0x558c14f275d0 2024-09-19T09:04:54.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.750+0000 7f0614e39740 1 -- 172.21.15.19:0/2806242220 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0604036040 con 0x558c14f275d0 2024-09-19T09:04:54.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.750+0000 7f05eb7fe640 1 -- 172.21.15.19:0/2806242220 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f05fc09bc70 con 0x558c14f275d0 2024-09-19T09:04:54.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.750+0000 7f0614e39740 10 client.18774 fetch_fsmap learned FSMap version 43 2024-09-19T09:04:54.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.750+0000 7f0614e39740 1 -- 172.21.15.19:0/2806242220 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x558c14f3f170 con 0x558c14f275d0 2024-09-19T09:04:54.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.751+0000 7f05eb7fe640 1 -- 172.21.15.19:0/2806242220 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f0604036040 con 0x558c14f275d0 2024-09-19T09:04:54.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.751+0000 7f05eb7fe640 1 -- 172.21.15.19:0/2806242220 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7f05fc0cdad0 con 0x558c14f275d0 2024-09-19T09:04:54.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.751+0000 7f0614e39740 10 client.18774 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T09:04:54.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.751+0000 7f0614e39740 10 client.18774 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-09-19T09:04:54.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.751+0000 7f0614e39740 20 client.18774 populate_metadata read hostname 'smithi019' 2024-09-19T09:04:54.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.751+0000 7f0614e39740 1 --2- 172.21.15.19:0/2806242220 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x558c14fb1110 0x558c14fb3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:54.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.751+0000 7f0614e39740 4 client.18774 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:04:54.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.751+0000 7f0614e39740 1 -- 172.21.15.19:0/2806242220 --> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558c14e94d70 con 0x558c14fb1110 2024-09-19T09:04:54.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.751+0000 7f0603fff640 1 --2- 172.21.15.19:0/2806242220 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x558c14fb1110 0x558c14fb3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:54.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.751+0000 7f05eb7fe640 10 client.18774 ms_handle_connect on v2:172.21.15.203:6836/3684671619 2024-09-19T09:04:54.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.751+0000 7f0603fff640 1 --2- 172.21.15.19:0/2806242220 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x558c14fb1110 0x558c14fb3500 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6ec7a2672dd160a6 server_cookie=983d6d5af0b99502 in_seq=0 out_seq=0 2024-09-19T09:04:54.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.752+0000 7f05eb7fe640 1 -- 172.21.15.19:0/2806242220 <== mds.2 v2:172.21.15.203:6836/3684671619 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558c14e94d70 con 0x558c14fb1110 2024-09-19T09:04:54.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.752+0000 7f05eb7fe640 10 client.18774 handle_command_reply: tid=0 2024-09-19T09:04:54.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.752+0000 7f0614e39740 1 client.18774 shutdown 2024-09-19T09:04:54.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.752+0000 7f0614e39740 1 -- 172.21.15.19:0/2806242220 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c14f275d0 msgr2=0x558c14f4d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:54.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.752+0000 7f0614e39740 1 --2- 172.21.15.19:0/2806242220 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c14f275d0 0x558c14f4d500 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f05fc0cff20 tx=0x7f05fc0cfe00 comp rx=0 tx=0).stop 2024-09-19T09:04:54.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.752+0000 7f0614e39740 1 -- 172.21.15.19:0/2806242220 shutdown_connections 2024-09-19T09:04:54.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.752+0000 7f0614e39740 1 --2- 172.21.15.19:0/2806242220 >> [v2:172.21.15.203:6836/3684671619,v1:172.21.15.203:6837/3684671619] conn(0x558c14fb1110 0x558c14fb3500 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:54.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.752+0000 7f0614e39740 1 --2- 172.21.15.19:0/2806242220 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558c14f32370 0x558c14f3d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:54.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.752+0000 7f0614e39740 1 --2- 172.21.15.19:0/2806242220 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x558c14f28b40 0x558c14f4da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:54.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.752+0000 7f0614e39740 1 --2- 172.21.15.19:0/2806242220 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x558c14f275d0 0x558c14f4d500 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:54.783 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:04:54.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.752+0000 7f0614e39740 1 -- 172.21.15.19:0/2806242220 >> 172.21.15.19:0/2806242220 conn(0x558c14ef0310 msgr2=0x558c14f2d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:54.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.752+0000 7f05eb7fe640 0 client.18774 ms_handle_reset on v2:172.21.15.203:6836/3684671619 2024-09-19T09:04:54.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.752+0000 7f0614e39740 1 -- 172.21.15.19:0/2806242220 shutdown_connections 2024-09-19T09:04:54.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.752+0000 7f0614e39740 1 -- 172.21.15.19:0/2806242220 wait complete. 2024-09-19T09:04:54.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.752+0000 7f0614e39740 20 client.18774 trim_cache size 0 max 16384 2024-09-19T09:04:54.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.753+0000 7f0612a60640 1 -- 172.21.15.19:0/2543326932 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f05f80a3240 msgr2=0x7f05f80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:54.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.753+0000 7f0612a60640 1 --2- 172.21.15.19:0/2543326932 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f05f80a3240 0x7f05f80a5700 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f0604005fe0 tx=0x7f06040095c0 comp rx=0 tx=0).stop 2024-09-19T09:04:54.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.753+0000 7f0612a60640 1 -- 172.21.15.19:0/2543326932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f060c101de0 msgr2=0x7f060c198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:54.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.753+0000 7f0612a60640 1 --2- 172.21.15.19:0/2543326932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f060c101de0 0x7f060c198390 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f05fc00c920 tx=0x7f05fc00cde0 comp rx=0 tx=0).stop 2024-09-19T09:04:54.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.753+0000 7f0612a60640 1 -- 172.21.15.19:0/2543326932 shutdown_connections 2024-09-19T09:04:54.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.753+0000 7f0612a60640 1 --2- 172.21.15.19:0/2543326932 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f05f80a3240 0x7f05f80a5700 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:54.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.753+0000 7f0612a60640 1 --2- 172.21.15.19:0/2543326932 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f060c102790 0x7f060c1988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:54.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.753+0000 7f0612a60640 1 --2- 172.21.15.19:0/2543326932 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f060c106f10 0x7f060c19cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:54.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.753+0000 7f0612a60640 1 --2- 172.21.15.19:0/2543326932 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f060c101de0 0x7f060c198390 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:54.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.753+0000 7f0612a60640 1 -- 172.21.15.19:0/2543326932 >> 172.21.15.19:0/2543326932 conn(0x7f060c0fd880 msgr2=0x7f060c0fe380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:54.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.753+0000 7f0612a60640 1 -- 172.21.15.19:0/2543326932 shutdown_connections 2024-09-19T09:04:54.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:54.753+0000 7f0612a60640 1 -- 172.21.15.19:0/2543326932 wait complete. 2024-09-19T09:04:55.545 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T09:04:55.806 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:55.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:55 smithi019 ceph-mon[30976]: pgmap v724: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-19T09:04:55.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:55 smithi203 ceph-mon[35450]: pgmap v724: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-19T09:04:56.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:55 smithi155 ceph-mon[34921]: pgmap v724: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-19T09:04:56.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.298+0000 7f9aa24a7640 1 -- 172.21.15.19:0/683606386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a9c103660 msgr2=0x7f9a9c10bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:56.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.298+0000 7f9aa24a7640 1 --2- 172.21.15.19:0/683606386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a9c103660 0x7f9a9c10bb50 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f9a90009900 tx=0x7f9a9002a480 comp rx=0 tx=0).stop 2024-09-19T09:04:56.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.298+0000 7f9aa24a7640 1 -- 172.21.15.19:0/683606386 shutdown_connections 2024-09-19T09:04:56.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.298+0000 7f9aa24a7640 1 --2- 172.21.15.19:0/683606386 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a9c10c170 0x7f9a9c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:56.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.298+0000 7f9aa24a7640 1 --2- 172.21.15.19:0/683606386 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a9c103660 0x7f9a9c10bb50 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:56.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.298+0000 7f9aa24a7640 1 --2- 172.21.15.19:0/683606386 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a9c102d40 0x7f9a9c103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:56.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.298+0000 7f9aa24a7640 1 -- 172.21.15.19:0/683606386 >> 172.21.15.19:0/683606386 conn(0x7f9a9c0fc7a0 msgr2=0x7f9a9c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:56.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.298+0000 7f9aa24a7640 1 -- 172.21.15.19:0/683606386 shutdown_connections 2024-09-19T09:04:56.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.298+0000 7f9aa24a7640 1 -- 172.21.15.19:0/683606386 wait complete. 2024-09-19T09:04:56.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.299+0000 7f9aa24a7640 1 Processor -- start 2024-09-19T09:04:56.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.299+0000 7f9aa24a7640 1 -- start start 2024-09-19T09:04:56.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.299+0000 7f9aa24a7640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a9c102d40 0x7f9a9c1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:56.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.300+0000 7f9aa24a7640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a9c103660 0x7f9a9c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:56.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.300+0000 7f9aa24a7640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a9c10c170 0x7f9a9c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:56.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.300+0000 7f9aa24a7640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9c111f70 con 0x7f9a9c10c170 2024-09-19T09:04:56.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.300+0000 7f9aa24a7640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9c111df0 con 0x7f9a9c103660 2024-09-19T09:04:56.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.300+0000 7f9aa24a7640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9c1120f0 con 0x7f9a9c102d40 2024-09-19T09:04:56.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.300+0000 7f9aa0a44640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a9c10c170 0x7f9a9c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:56.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.300+0000 7f9aa0a44640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a9c10c170 0x7f9a9c101420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56826/0 (socket says 172.21.15.19:56826) 2024-09-19T09:04:56.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.300+0000 7f9aa0a44640 1 -- 172.21.15.19:0/1462441774 learned_addr learned my addr 172.21.15.19:0/1462441774 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:56.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.300+0000 7f9a9bfff640 1 --2- 172.21.15.19:0/1462441774 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a9c102d40 0x7f9a9c1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:56.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.300+0000 7f9a9b7fe640 1 --2- 172.21.15.19:0/1462441774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a9c103660 0x7f9a9c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:56.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.300+0000 7f9aa0a44640 1 -- 172.21.15.19:0/1462441774 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a9c102d40 msgr2=0x7f9a9c1009a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:56.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.300+0000 7f9aa0a44640 1 --2- 172.21.15.19:0/1462441774 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a9c102d40 0x7f9a9c1009a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:56.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.300+0000 7f9aa0a44640 1 -- 172.21.15.19:0/1462441774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a9c103660 msgr2=0x7f9a9c100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:56.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.300+0000 7f9aa0a44640 1 --2- 172.21.15.19:0/1462441774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a9c103660 0x7f9a9c100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:56.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.300+0000 7f9aa0a44640 1 -- 172.21.15.19:0/1462441774 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a9c1a6980 con 0x7f9a9c10c170 2024-09-19T09:04:56.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.300+0000 7f9aa0a44640 1 --2- 172.21.15.19:0/1462441774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a9c10c170 0x7f9a9c101420 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f9a9400eaa0 tx=0x7f9a9400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:56.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.300+0000 7f9a997fa640 1 -- 172.21.15.19:0/1462441774 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9400cdb0 con 0x7f9a9c10c170 2024-09-19T09:04:56.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.300+0000 7f9aa24a7640 1 -- 172.21.15.19:0/1462441774 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a9c1a6c70 con 0x7f9a9c10c170 2024-09-19T09:04:56.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.300+0000 7f9a997fa640 1 -- 172.21.15.19:0/1462441774 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a94005020 con 0x7f9a9c10c170 2024-09-19T09:04:56.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.300+0000 7f9a997fa640 1 -- 172.21.15.19:0/1462441774 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a940116b0 con 0x7f9a9c10c170 2024-09-19T09:04:56.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.300+0000 7f9aa24a7640 1 -- 172.21.15.19:0/1462441774 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a9c1a7160 con 0x7f9a9c10c170 2024-09-19T09:04:56.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.303+0000 7f9a997fa640 1 -- 172.21.15.19:0/1462441774 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f9a94005560 con 0x7f9a9c10c170 2024-09-19T09:04:56.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.303+0000 7f9aa4880740 1 Processor -- start 2024-09-19T09:04:56.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.303+0000 7f9aa4880740 1 -- start start 2024-09-19T09:04:56.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.303+0000 7f9aa4880740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55964d749b40 0x55964d748090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:56.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.303+0000 7f9aa4880740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55964d7485d0 0x55964d748a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:56.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.303+0000 7f9aa4880740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55964d753370 0x55964d755760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:56.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.303+0000 7f9aa4880740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55964d6ae2f0 con 0x55964d7485d0 2024-09-19T09:04:56.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.303+0000 7f9aa4880740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55964d655cf0 con 0x55964d749b40 2024-09-19T09:04:56.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.303+0000 7f9aa4880740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55964d6aa2b0 con 0x55964d753370 2024-09-19T09:04:56.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.303+0000 7f9a9bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55964d7485d0 0x55964d748a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:56.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.303+0000 7f9a9bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55964d7485d0 0x55964d748a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56838/0 (socket says 172.21.15.19:56838) 2024-09-19T09:04:56.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.303+0000 7f9a9bfff640 1 -- 172.21.15.19:0/3240637078 learned_addr learned my addr 172.21.15.19:0/3240637078 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:56.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.303+0000 7f9a997fa640 1 --2- 172.21.15.19:0/1462441774 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9a840a3240 0x7f9a840a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:56.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.304+0000 7f9aa0a44640 1 --2- 172.21.15.19:0/1462441774 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9a840a3240 0x7f9a840a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:56.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.304+0000 7f9a9bfff640 1 -- 172.21.15.19:0/3240637078 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55964d753370 msgr2=0x55964d755760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:56.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.304+0000 7f9a9bfff640 1 --2- 172.21.15.19:0/3240637078 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55964d753370 0x55964d755760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:56.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.304+0000 7f9a9bfff640 1 -- 172.21.15.19:0/3240637078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55964d749b40 msgr2=0x55964d748090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:56.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.304+0000 7f9a9bfff640 1 --2- 172.21.15.19:0/3240637078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55964d749b40 0x55964d748090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:56.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.304+0000 7f9a997fa640 1 -- 172.21.15.19:0/1462441774 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f9a940cfbc0 con 0x7f9a9c10c170 2024-09-19T09:04:56.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.304+0000 7f9a9bfff640 1 -- 172.21.15.19:0/3240637078 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55964d63a3a0 con 0x55964d7485d0 2024-09-19T09:04:56.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.304+0000 7f9a9bfff640 1 --2- 172.21.15.19:0/3240637078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55964d7485d0 0x55964d748a10 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c00cbf0 tx=0x7f9a8c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cde67074702b82de server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:56.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.304+0000 7f9aa0a44640 1 --2- 172.21.15.19:0/1462441774 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9a840a3240 0x7f9a840a5700 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f9a940cda40 tx=0x7f9a940bc040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:56.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.304+0000 7f9a827fc640 1 -- 172.21.15.19:0/3240637078 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c010630 con 0x55964d7485d0 2024-09-19T09:04:56.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.304+0000 7f9a827fc640 1 -- 172.21.15.19:0/3240637078 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a8c010cb0 con 0x55964d7485d0 2024-09-19T09:04:56.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.304+0000 7f9a827fc640 1 -- 172.21.15.19:0/3240637078 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c00fc60 con 0x55964d7485d0 2024-09-19T09:04:56.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.305+0000 7f9aa4880740 1 -- 172.21.15.19:0/3240637078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55964d7485d0 msgr2=0x55964d748a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:56.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.305+0000 7f9aa4880740 1 --2- 172.21.15.19:0/3240637078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55964d7485d0 0x55964d748a10 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c00cbf0 tx=0x7f9a8c00e720 comp rx=0 tx=0).stop 2024-09-19T09:04:56.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.305+0000 7f9aa4880740 1 -- 172.21.15.19:0/3240637078 shutdown_connections 2024-09-19T09:04:56.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.305+0000 7f9aa4880740 1 --2- 172.21.15.19:0/3240637078 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55964d753370 0x55964d755760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:56.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.305+0000 7f9aa4880740 1 --2- 172.21.15.19:0/3240637078 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55964d7485d0 0x55964d748a10 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:56.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.305+0000 7f9aa4880740 1 --2- 172.21.15.19:0/3240637078 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55964d749b40 0x55964d748090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:56.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.305+0000 7f9aa4880740 1 -- 172.21.15.19:0/3240637078 >> 172.21.15.19:0/3240637078 conn(0x55964d711310 msgr2=0x55964d744c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:56.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.305+0000 7f9aa4880740 1 -- 172.21.15.19:0/3240637078 shutdown_connections 2024-09-19T09:04:56.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.305+0000 7f9aa4880740 1 -- 172.21.15.19:0/3240637078 wait complete. 2024-09-19T09:04:56.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.305+0000 7f9aa4880740 1 -- start start 2024-09-19T09:04:56.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.305+0000 7f9aa4880740 1 Processor -- start 2024-09-19T09:04:56.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.306+0000 7f9aa4880740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55964d7485d0 0x55964d752d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:56.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.306+0000 7f9aa4880740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55964d749b40 0x55964d74fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:56.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.306+0000 7f9aa4880740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55964d753370 0x55964d7505e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:56.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.306+0000 7f9aa4880740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x55964d756070 con 0x55964d749b40 2024-09-19T09:04:56.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.306+0000 7f9aa4880740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x55964d669060 con 0x55964d753370 2024-09-19T09:04:56.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.306+0000 7f9aa4880740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55964d7561f0 con 0x55964d7485d0 2024-09-19T09:04:56.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.306+0000 7f9aa4880740 10 client.0 _ll_register_callbacks cb 0x55964d3bc8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:56.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.306+0000 7f9a9bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55964d749b40 0x55964d74fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:56.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.306+0000 7f9a9bfff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55964d749b40 0x55964d74fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56846/0 (socket says 172.21.15.19:56846) 2024-09-19T09:04:56.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.306+0000 7f9a9bfff640 1 -- 172.21.15.19:0/2239316545 learned_addr learned my addr 172.21.15.19:0/2239316545 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:56.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.306+0000 7f9a9b7fe640 1 --2- 172.21.15.19:0/2239316545 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55964d7485d0 0x55964d752d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:56.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.306+0000 7f9a9bfff640 1 -- 172.21.15.19:0/2239316545 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55964d7485d0 msgr2=0x55964d752d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:56.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.306+0000 7f9a9b7fe640 1 --2- 172.21.15.19:0/2239316545 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55964d753370 0x55964d7505e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:56.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.306+0000 7f9a9bfff640 1 --2- 172.21.15.19:0/2239316545 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55964d7485d0 0x55964d752d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:56.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.306+0000 7f9a9bfff640 1 -- 172.21.15.19:0/2239316545 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55964d753370 msgr2=0x55964d7505e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:56.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.306+0000 7f9a9bfff640 1 --2- 172.21.15.19:0/2239316545 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55964d753370 0x55964d7505e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:56.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.306+0000 7f9a9bfff640 1 -- 172.21.15.19:0/2239316545 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55964d41f3c0 con 0x55964d749b40 2024-09-19T09:04:56.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.306+0000 7f9a9bfff640 1 --2- 172.21.15.19:0/2239316545 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55964d749b40 0x55964d74fff0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c00f7e0 tx=0x7f9a8c00f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31bdc540fccbfe1c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:56.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.306+0000 7f9a7b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:04:56.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.306+0000 7f9a7b7fe640 1 -- 172.21.15.19:0/2239316545 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a8c010e60 con 0x55964d749b40 2024-09-19T09:04:56.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.307+0000 7f9a7b7fe640 1 -- 172.21.15.19:0/2239316545 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f9a8c005250 con 0x55964d749b40 2024-09-19T09:04:56.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.307+0000 7f9aa4880740 1 -- 172.21.15.19:0/2239316545 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a8c010cb0 con 0x55964d749b40 2024-09-19T09:04:56.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.307+0000 7f9a7b7fe640 1 -- 172.21.15.19:0/2239316545 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f9a8c00c7f0 con 0x55964d749b40 2024-09-19T09:04:56.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.307+0000 7f9aa4880740 10 client.18786 fetch_fsmap learned FSMap version 43 2024-09-19T09:04:56.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.307+0000 7f9aa4880740 1 -- 172.21.15.19:0/2239316545 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55964d761b10 con 0x55964d749b40 2024-09-19T09:04:56.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.307+0000 7f9a7b7fe640 1 -- 172.21.15.19:0/2239316545 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a8c010cb0 con 0x55964d749b40 2024-09-19T09:04:56.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.307+0000 7f9a7b7fe640 1 -- 172.21.15.19:0/2239316545 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7f9a8c004920 con 0x55964d749b40 2024-09-19T09:04:56.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.307+0000 7f9aa4880740 10 client.18786 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T09:04:56.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.307+0000 7f9aa4880740 10 client.18786 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:04:56.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.307+0000 7f9aa4880740 20 client.18786 populate_metadata read hostname 'smithi019' 2024-09-19T09:04:56.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.307+0000 7f9aa4880740 1 --2- 172.21.15.19:0/2239316545 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55964d762e60 0x55964d765250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:56.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.307+0000 7f9aa4880740 4 client.18786 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:56.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.307+0000 7f9aa4880740 1 -- 172.21.15.19:0/2239316545 --> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55964d6bb860 con 0x55964d762e60 2024-09-19T09:04:56.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.308+0000 7f9a9b7fe640 1 --2- 172.21.15.19:0/2239316545 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55964d762e60 0x55964d765250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:56.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.308+0000 7f9a9b7fe640 1 --2- 172.21.15.19:0/2239316545 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55964d762e60 0x55964d765250 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b3ae5f802b48e07f server_cookie=f5038df824b0bf25 in_seq=0 out_seq=0 2024-09-19T09:04:56.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.308+0000 7f9a7b7fe640 10 client.18786 ms_handle_connect on v2:172.21.15.203:6838/2547507299 2024-09-19T09:04:56.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.309+0000 7f9a7b7fe640 1 -- 172.21.15.19:0/2239316545 <== mds.1 v2:172.21.15.203:6838/2547507299 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55964d6bb860 con 0x55964d762e60 2024-09-19T09:04:56.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.309+0000 7f9a7b7fe640 10 client.18786 handle_command_reply: tid=0 2024-09-19T09:04:56.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.309+0000 7f9aa4880740 1 client.18786 shutdown 2024-09-19T09:04:56.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.309+0000 7f9aa4880740 1 -- 172.21.15.19:0/2239316545 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55964d749b40 msgr2=0x55964d74fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:56.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.309+0000 7f9aa4880740 1 --2- 172.21.15.19:0/2239316545 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55964d749b40 0x55964d74fff0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c00f7e0 tx=0x7f9a8c00f640 comp rx=0 tx=0).stop 2024-09-19T09:04:56.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.309+0000 7f9aa4880740 1 -- 172.21.15.19:0/2239316545 shutdown_connections 2024-09-19T09:04:56.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.309+0000 7f9aa4880740 1 --2- 172.21.15.19:0/2239316545 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55964d762e60 0x55964d765250 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:56.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.309+0000 7f9aa4880740 1 --2- 172.21.15.19:0/2239316545 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55964d753370 0x55964d7505e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:56.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.309+0000 7f9aa4880740 1 --2- 172.21.15.19:0/2239316545 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55964d749b40 0x55964d74fff0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:56.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.309+0000 7f9a7b7fe640 0 client.18786 ms_handle_reset on v2:172.21.15.203:6838/2547507299 2024-09-19T09:04:56.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.309+0000 7f9aa4880740 1 --2- 172.21.15.19:0/2239316545 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55964d7485d0 0x55964d752d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:56.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.309+0000 7f9aa4880740 1 -- 172.21.15.19:0/2239316545 >> 172.21.15.19:0/2239316545 conn(0x55964d711310 msgr2=0x55964d74a930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:56.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.309+0000 7f9aa4880740 1 -- 172.21.15.19:0/2239316545 shutdown_connections 2024-09-19T09:04:56.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.309+0000 7f9aa4880740 1 -- 172.21.15.19:0/2239316545 wait complete. 2024-09-19T09:04:56.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.309+0000 7f9aa4880740 20 client.18786 trim_cache size 0 max 16384 2024-09-19T09:04:56.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.322+0000 7f9aa4880740 1 Processor -- start 2024-09-19T09:04:56.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.322+0000 7f9aa4880740 1 -- start start 2024-09-19T09:04:56.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.323+0000 7f9aa4880740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55964d7485d0 0x55964d75f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:56.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.323+0000 7f9aa4880740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55964d749b40 0x55964d73fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:56.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.323+0000 7f9aa4880740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55964d753370 0x55964d74eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:56.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.323+0000 7f9aa4880740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9c1af7f0 con 0x55964d7485d0 2024-09-19T09:04:56.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.323+0000 7f9aa4880740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9c1b1330 con 0x55964d753370 2024-09-19T09:04:56.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.323+0000 7f9aa4880740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9c1afec0 con 0x55964d749b40 2024-09-19T09:04:56.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.323+0000 7f9a9b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55964d7485d0 0x55964d75f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:56.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.323+0000 7f9a9b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55964d7485d0 0x55964d75f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56850/0 (socket says 172.21.15.19:56850) 2024-09-19T09:04:56.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.323+0000 7f9a9b7fe640 1 -- 172.21.15.19:0/4134637028 learned_addr learned my addr 172.21.15.19:0/4134637028 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:56.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.323+0000 7f9a9bfff640 1 --2- 172.21.15.19:0/4134637028 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55964d749b40 0x55964d73fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:56.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.323+0000 7f9a9b7fe640 1 -- 172.21.15.19:0/4134637028 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55964d749b40 msgr2=0x55964d73fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:56.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.323+0000 7f9a9b7fe640 1 --2- 172.21.15.19:0/4134637028 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55964d749b40 0x55964d73fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:56.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.323+0000 7f9a9b7fe640 1 -- 172.21.15.19:0/4134637028 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55964d753370 msgr2=0x55964d74eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:56.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.323+0000 7f9a9b7fe640 1 --2- 172.21.15.19:0/4134637028 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55964d753370 0x55964d74eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:56.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.323+0000 7f9a9b7fe640 1 -- 172.21.15.19:0/4134637028 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55964d744de0 con 0x55964d7485d0 2024-09-19T09:04:56.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.323+0000 7f9a9bfff640 1 --2- 172.21.15.19:0/4134637028 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55964d749b40 0x55964d73fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:56.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.323+0000 7f9a9b7fe640 1 --2- 172.21.15.19:0/4134637028 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55964d7485d0 0x55964d75f340 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f9a9002a4c0 tx=0x7f9a90005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b200cb49dc44652b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:56.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.323+0000 7f9a81ffb640 1 -- 172.21.15.19:0/4134637028 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a90048020 con 0x55964d7485d0 2024-09-19T09:04:56.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.323+0000 7f9a81ffb640 1 -- 172.21.15.19:0/4134637028 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a90005520 con 0x55964d7485d0 2024-09-19T09:04:56.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.324+0000 7f9a81ffb640 1 -- 172.21.15.19:0/4134637028 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a90035040 con 0x55964d7485d0 2024-09-19T09:04:56.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.324+0000 7f9aa4880740 1 -- 172.21.15.19:0/4134637028 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55964d7485d0 msgr2=0x55964d75f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:56.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.324+0000 7f9aa4880740 1 --2- 172.21.15.19:0/4134637028 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55964d7485d0 0x55964d75f340 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f9a9002a4c0 tx=0x7f9a90005fd0 comp rx=0 tx=0).stop 2024-09-19T09:04:56.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.324+0000 7f9aa4880740 1 -- 172.21.15.19:0/4134637028 shutdown_connections 2024-09-19T09:04:56.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.324+0000 7f9aa4880740 1 --2- 172.21.15.19:0/4134637028 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55964d749b40 0x55964d73fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:56.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.324+0000 7f9aa4880740 1 --2- 172.21.15.19:0/4134637028 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55964d753370 0x55964d74eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:56.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.324+0000 7f9aa4880740 1 --2- 172.21.15.19:0/4134637028 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55964d7485d0 0x55964d75f340 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:56.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.324+0000 7f9aa4880740 1 -- 172.21.15.19:0/4134637028 >> 172.21.15.19:0/4134637028 conn(0x55964d711310 msgr2=0x55964d74e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:56.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.324+0000 7f9aa4880740 1 -- 172.21.15.19:0/4134637028 shutdown_connections 2024-09-19T09:04:56.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.324+0000 7f9aa4880740 1 -- 172.21.15.19:0/4134637028 wait complete. 2024-09-19T09:04:56.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.324+0000 7f9aa4880740 1 -- start start 2024-09-19T09:04:56.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.325+0000 7f9aa4880740 1 Processor -- start 2024-09-19T09:04:56.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.325+0000 7f9aa4880740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55964d7485d0 0x55964d75b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:56.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.325+0000 7f9aa4880740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55964d749b40 0x55964d75bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:56.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.325+0000 7f9aa4880740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55964d753370 0x55964d74c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:56.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.325+0000 7f9aa4880740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9c1b0c60 con 0x55964d7485d0 2024-09-19T09:04:56.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.325+0000 7f9aa4880740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9c1b0590 con 0x55964d753370 2024-09-19T09:04:56.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.325+0000 7f9aa4880740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9c1ad7d0 con 0x55964d749b40 2024-09-19T09:04:56.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.325+0000 7f9aa4880740 10 client.0 _ll_register_callbacks cb 0x7f9a8c014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:56.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.325+0000 7f9a9b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55964d7485d0 0x55964d75b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:56.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.325+0000 7f9a9b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55964d7485d0 0x55964d75b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56852/0 (socket says 172.21.15.19:56852) 2024-09-19T09:04:56.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.325+0000 7f9a9b7fe640 1 -- 172.21.15.19:0/3080863060 learned_addr learned my addr 172.21.15.19:0/3080863060 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:56.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.325+0000 7f9a9b7fe640 1 --2- 172.21.15.19:0/3080863060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55964d753370 0x55964d74c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:56.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.325+0000 7f9a9bfff640 1 --2- 172.21.15.19:0/3080863060 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55964d749b40 0x55964d75bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:56.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.325+0000 7f9a9b7fe640 1 -- 172.21.15.19:0/3080863060 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55964d749b40 msgr2=0x55964d75bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:56.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.325+0000 7f9a9b7fe640 1 --2- 172.21.15.19:0/3080863060 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55964d749b40 0x55964d75bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:56.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.325+0000 7f9a9b7fe640 1 -- 172.21.15.19:0/3080863060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55964d753370 msgr2=0x55964d74c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:56.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.325+0000 7f9a9b7fe640 1 --2- 172.21.15.19:0/3080863060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55964d753370 0x55964d74c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:56.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.325+0000 7f9a9b7fe640 1 -- 172.21.15.19:0/3080863060 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55964d74ceb0 con 0x55964d7485d0 2024-09-19T09:04:56.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.326+0000 7f9a9b7fe640 1 --2- 172.21.15.19:0/3080863060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55964d7485d0 0x55964d75b690 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f9a9002a9a0 tx=0x7f9a90005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3c33273d940b71d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:56.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.326+0000 7f9a7b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:04:56.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.326+0000 7f9a7b7fe640 1 -- 172.21.15.19:0/3080863060 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a90054020 con 0x55964d7485d0 2024-09-19T09:04:56.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.326+0000 7f9a7b7fe640 1 -- 172.21.15.19:0/3080863060 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f9a900050f0 con 0x55964d7485d0 2024-09-19T09:04:56.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.326+0000 7f9aa4880740 1 -- 172.21.15.19:0/3080863060 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a90005520 con 0x55964d7485d0 2024-09-19T09:04:56.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.326+0000 7f9a7b7fe640 1 -- 172.21.15.19:0/3080863060 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7f9a90048070 con 0x55964d7485d0 2024-09-19T09:04:56.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.326+0000 7f9aa4880740 10 client.18792 fetch_fsmap learned FSMap version 43 2024-09-19T09:04:56.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.326+0000 7f9aa4880740 1 -- 172.21.15.19:0/3080863060 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x55964d7cd2f0 con 0x55964d7485d0 2024-09-19T09:04:56.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.326+0000 7f9a7b7fe640 1 -- 172.21.15.19:0/3080863060 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9a90005520 con 0x55964d7485d0 2024-09-19T09:04:56.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.326+0000 7f9a7b7fe640 1 -- 172.21.15.19:0/3080863060 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7f9a9003a040 con 0x55964d7485d0 2024-09-19T09:04:56.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.326+0000 7f9aa4880740 10 client.18792 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T09:04:56.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.326+0000 7f9aa4880740 10 client.18792 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-09-19T09:04:56.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.326+0000 7f9aa4880740 20 client.18792 populate_metadata read hostname 'smithi019' 2024-09-19T09:04:56.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.326+0000 7f9aa4880740 1 --2- 172.21.15.19:0/3080863060 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55964d7cd9e0 0x55964d7cfe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:56.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.326+0000 7f9aa4880740 4 client.18792 mds_command: new command op to 24490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:04:56.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.326+0000 7f9aa4880740 1 -- 172.21.15.19:0/3080863060 --> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55964d6b5d70 con 0x55964d7cd9e0 2024-09-19T09:04:56.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.327+0000 7f9a9bfff640 1 --2- 172.21.15.19:0/3080863060 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55964d7cd9e0 0x55964d7cfe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:56.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.327+0000 7f9a7b7fe640 10 client.18792 ms_handle_connect on v2:172.21.15.203:6838/2547507299 2024-09-19T09:04:56.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.327+0000 7f9a9bfff640 1 --2- 172.21.15.19:0/3080863060 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55964d7cd9e0 0x55964d7cfe00 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9228415a59169520 server_cookie=9cc26e4d4ea7f73e in_seq=0 out_seq=0 2024-09-19T09:04:56.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.327+0000 7f9a7b7fe640 1 -- 172.21.15.19:0/3080863060 <== mds.1 v2:172.21.15.203:6838/2547507299 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55964d6b5d70 con 0x55964d7cd9e0 2024-09-19T09:04:56.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.327+0000 7f9a7b7fe640 10 client.18792 handle_command_reply: tid=0 2024-09-19T09:04:56.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.328+0000 7f9aa4880740 1 client.18792 shutdown 2024-09-19T09:04:56.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.328+0000 7f9aa4880740 1 -- 172.21.15.19:0/3080863060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55964d7485d0 msgr2=0x55964d75b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:56.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.328+0000 7f9aa4880740 1 --2- 172.21.15.19:0/3080863060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55964d7485d0 0x55964d75b690 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f9a9002a9a0 tx=0x7f9a90005be0 comp rx=0 tx=0).stop 2024-09-19T09:04:56.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.328+0000 7f9aa4880740 1 -- 172.21.15.19:0/3080863060 shutdown_connections 2024-09-19T09:04:56.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.328+0000 7f9aa4880740 1 --2- 172.21.15.19:0/3080863060 >> [v2:172.21.15.203:6838/2547507299,v1:172.21.15.203:6839/2547507299] conn(0x55964d7cd9e0 0x55964d7cfe00 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:56.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.328+0000 7f9aa4880740 1 --2- 172.21.15.19:0/3080863060 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55964d749b40 0x55964d75bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:56.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.328+0000 7f9aa4880740 1 --2- 172.21.15.19:0/3080863060 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x55964d753370 0x55964d74c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:56.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.328+0000 7f9aa4880740 1 --2- 172.21.15.19:0/3080863060 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x55964d7485d0 0x55964d75b690 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:56.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.328+0000 7f9aa4880740 1 -- 172.21.15.19:0/3080863060 >> 172.21.15.19:0/3080863060 conn(0x55964d711310 msgr2=0x55964d74e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:56.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.328+0000 7f9a7b7fe640 0 client.18792 ms_handle_reset on v2:172.21.15.203:6838/2547507299 2024-09-19T09:04:56.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.328+0000 7f9aa4880740 1 -- 172.21.15.19:0/3080863060 shutdown_connections 2024-09-19T09:04:56.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.328+0000 7f9aa4880740 1 -- 172.21.15.19:0/3080863060 wait complete. 2024-09-19T09:04:56.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.328+0000 7f9aa4880740 20 client.18792 trim_cache size 0 max 16384 2024-09-19T09:04:56.341 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:04:56.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.328+0000 7f9aa24a7640 1 -- 172.21.15.19:0/1462441774 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9a840a3240 msgr2=0x7f9a840a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:56.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.328+0000 7f9aa24a7640 1 --2- 172.21.15.19:0/1462441774 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9a840a3240 0x7f9a840a5700 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f9a940cda40 tx=0x7f9a940bc040 comp rx=0 tx=0).stop 2024-09-19T09:04:56.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.328+0000 7f9aa24a7640 1 -- 172.21.15.19:0/1462441774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a9c10c170 msgr2=0x7f9a9c101420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:56.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.328+0000 7f9aa24a7640 1 --2- 172.21.15.19:0/1462441774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a9c10c170 0x7f9a9c101420 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f9a9400eaa0 tx=0x7f9a9400ef60 comp rx=0 tx=0).stop 2024-09-19T09:04:56.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.329+0000 7f9aa24a7640 1 -- 172.21.15.19:0/1462441774 shutdown_connections 2024-09-19T09:04:56.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.329+0000 7f9aa24a7640 1 --2- 172.21.15.19:0/1462441774 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9a840a3240 0x7f9a840a5700 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:56.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.329+0000 7f9aa24a7640 1 --2- 172.21.15.19:0/1462441774 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9a9c10c170 0x7f9a9c101420 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:56.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.329+0000 7f9aa24a7640 1 --2- 172.21.15.19:0/1462441774 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9a9c103660 0x7f9a9c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:56.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.329+0000 7f9aa24a7640 1 --2- 172.21.15.19:0/1462441774 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9a9c102d40 0x7f9a9c1009a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:56.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.329+0000 7f9aa24a7640 1 -- 172.21.15.19:0/1462441774 >> 172.21.15.19:0/1462441774 conn(0x7f9a9c0fc7a0 msgr2=0x7f9a9c0fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:56.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.329+0000 7f9aa24a7640 1 -- 172.21.15.19:0/1462441774 shutdown_connections 2024-09-19T09:04:56.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:56.329+0000 7f9aa24a7640 1 -- 172.21.15.19:0/1462441774 wait complete. 2024-09-19T09:04:57.076 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T09:04:57.338 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:04:57.727 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:57 smithi019 ceph-mon[30976]: pgmap v725: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-19T09:04:57.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.810+0000 7fbdfadcb640 1 -- 172.21.15.19:0/2608968876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdf4102d40 msgr2=0x7fbdf4103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:57.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.810+0000 7fbdfadcb640 1 --2- 172.21.15.19:0/2608968876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdf4102d40 0x7fbdf4103120 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7fbde4009900 tx=0x7fbde402a480 comp rx=0 tx=0).stop 2024-09-19T09:04:57.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.810+0000 7fbdfadcb640 1 -- 172.21.15.19:0/2608968876 shutdown_connections 2024-09-19T09:04:57.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.810+0000 7fbdfadcb640 1 --2- 172.21.15.19:0/2608968876 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbdf410c170 0x7fbdf410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:57.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.810+0000 7fbdfadcb640 1 --2- 172.21.15.19:0/2608968876 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbdf4103660 0x7fbdf410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:57.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.810+0000 7fbdfadcb640 1 --2- 172.21.15.19:0/2608968876 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdf4102d40 0x7fbdf4103120 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:57.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.810+0000 7fbdfadcb640 1 -- 172.21.15.19:0/2608968876 >> 172.21.15.19:0/2608968876 conn(0x7fbdf40fc7a0 msgr2=0x7fbdf40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:57.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.810+0000 7fbdfadcb640 1 -- 172.21.15.19:0/2608968876 shutdown_connections 2024-09-19T09:04:57.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.810+0000 7fbdfadcb640 1 -- 172.21.15.19:0/2608968876 wait complete. 2024-09-19T09:04:57.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.811+0000 7fbdfadcb640 1 Processor -- start 2024-09-19T09:04:57.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.811+0000 7fbdfadcb640 1 -- start start 2024-09-19T09:04:57.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.811+0000 7fbdfadcb640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbdf4102d40 0x7fbdf4198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:57.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.811+0000 7fbdfadcb640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdf4103660 0x7fbdf4198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:57.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.811+0000 7fbdfadcb640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbdf410c170 0x7fbdf419cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:57.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.811+0000 7fbdfadcb640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf4111fc0 con 0x7fbdf4103660 2024-09-19T09:04:57.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.811+0000 7fbdfadcb640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf4111e40 con 0x7fbdf410c170 2024-09-19T09:04:57.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.811+0000 7fbdfadcb640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf4112140 con 0x7fbdf4102d40 2024-09-19T09:04:57.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.811+0000 7fbdf3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdf4103660 0x7fbdf4198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:57.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.811+0000 7fbdf3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdf4103660 0x7fbdf4198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56884/0 (socket says 172.21.15.19:56884) 2024-09-19T09:04:57.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.811+0000 7fbdf3fff640 1 -- 172.21.15.19:0/1841588430 learned_addr learned my addr 172.21.15.19:0/1841588430 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:57.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.812+0000 7fbdf9368640 1 --2- 172.21.15.19:0/1841588430 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbdf410c170 0x7fbdf419cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:57.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.812+0000 7fbdf8b67640 1 --2- 172.21.15.19:0/1841588430 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbdf4102d40 0x7fbdf4198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:57.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.812+0000 7fbdf3fff640 1 -- 172.21.15.19:0/1841588430 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbdf4102d40 msgr2=0x7fbdf4198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:57.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.812+0000 7fbdf3fff640 1 --2- 172.21.15.19:0/1841588430 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbdf4102d40 0x7fbdf4198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:57.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.812+0000 7fbdf3fff640 1 -- 172.21.15.19:0/1841588430 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbdf410c170 msgr2=0x7fbdf419cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:57.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.812+0000 7fbdf3fff640 1 --2- 172.21.15.19:0/1841588430 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbdf410c170 0x7fbdf419cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:57.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.812+0000 7fbdf3fff640 1 -- 172.21.15.19:0/1841588430 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdf419d3f0 con 0x7fbdf4103660 2024-09-19T09:04:57.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.812+0000 7fbdf8b67640 1 --2- 172.21.15.19:0/1841588430 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbdf4102d40 0x7fbdf4198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:57.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.812+0000 7fbdf3fff640 1 --2- 172.21.15.19:0/1841588430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdf4103660 0x7fbdf4198980 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fbde800d740 tx=0x7fbde800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:57.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.812+0000 7fbdf1ffb640 1 -- 172.21.15.19:0/1841588430 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde8017070 con 0x7fbdf4103660 2024-09-19T09:04:57.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.812+0000 7fbdfadcb640 1 -- 172.21.15.19:0/1841588430 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdf419d6e0 con 0x7fbdf4103660 2024-09-19T09:04:57.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.812+0000 7fbdf1ffb640 1 -- 172.21.15.19:0/1841588430 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbde800de50 con 0x7fbdf4103660 2024-09-19T09:04:57.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.812+0000 7fbdf1ffb640 1 -- 172.21.15.19:0/1841588430 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde800f620 con 0x7fbdf4103660 2024-09-19T09:04:57.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.812+0000 7fbdfadcb640 1 -- 172.21.15.19:0/1841588430 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdf41a4fc0 con 0x7fbdf4103660 2024-09-19T09:04:57.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.814+0000 7fbdf1ffb640 1 -- 172.21.15.19:0/1841588430 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fbde8009c30 con 0x7fbdf4103660 2024-09-19T09:04:57.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.815+0000 7fbdfd1a4740 1 Processor -- start 2024-09-19T09:04:57.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.815+0000 7fbdf1ffb640 1 --2- 172.21.15.19:0/1841588430 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbddc0a3240 0x7fbddc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:57.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.815+0000 7fbdfd1a4740 1 -- start start 2024-09-19T09:04:57.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.815+0000 7fbdf8b67640 1 --2- 172.21.15.19:0/1841588430 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbddc0a3240 0x7fbddc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:57.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.815+0000 7fbdf1ffb640 1 -- 172.21.15.19:0/1841588430 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7fbde80cf560 con 0x7fbdf4103660 2024-09-19T09:04:57.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.815+0000 7fbdfd1a4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561c45bb7b40 0x561c45bb6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:57.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.815+0000 7fbdfd1a4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561c45bb65d0 0x561c45bb6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:57.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.816+0000 7fbdfd1a4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561c45bc5780 0x561c45bc7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:57.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.816+0000 7fbdfd1a4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x561c45b1c2f0 con 0x561c45bc5780 2024-09-19T09:04:57.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.816+0000 7fbdfd1a4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x561c45ac3cf0 con 0x561c45bb65d0 2024-09-19T09:04:57.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.816+0000 7fbdfd1a4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x561c45b182b0 con 0x561c45bb7b40 2024-09-19T09:04:57.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.816+0000 7fbdf9368640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561c45bc5780 0x561c45bc7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:57.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.816+0000 7fbdf9368640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561c45bc5780 0x561c45bc7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56888/0 (socket says 172.21.15.19:56888) 2024-09-19T09:04:57.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.816+0000 7fbdf9368640 1 -- 172.21.15.19:0/1537212620 learned_addr learned my addr 172.21.15.19:0/1537212620 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:57.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.816+0000 7fbdf8b67640 1 --2- 172.21.15.19:0/1537212620 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561c45bb7b40 0x561c45bb6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:57.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.816+0000 7fbdf3fff640 1 --2- 172.21.15.19:0/1537212620 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561c45bb65d0 0x561c45bb6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:57.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.816+0000 7fbdf8b67640 1 --2- 172.21.15.19:0/1841588430 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbddc0a3240 0x7fbddc0a5700 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fbde4000c00 tx=0x7fbde4005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:57.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.816+0000 7fbdf9368640 1 -- 172.21.15.19:0/1537212620 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561c45bb7b40 msgr2=0x561c45bb6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:57.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.816+0000 7fbdf9368640 1 --2- 172.21.15.19:0/1537212620 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561c45bb7b40 0x561c45bb6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:57.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.816+0000 7fbdf9368640 1 -- 172.21.15.19:0/1537212620 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561c45bb65d0 msgr2=0x561c45bb6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:57.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.816+0000 7fbdf9368640 1 --2- 172.21.15.19:0/1537212620 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561c45bb65d0 0x561c45bb6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:57.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.816+0000 7fbdf9368640 1 -- 172.21.15.19:0/1537212620 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c45aa83a0 con 0x561c45bc5780 2024-09-19T09:04:57.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.816+0000 7fbdf9368640 1 --2- 172.21.15.19:0/1537212620 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561c45bc5780 0x561c45bc7b70 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fbdec009f70 tx=0x7fbdec010800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=519a2306f67c0f53 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:57.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.816+0000 7fbddaffd640 1 -- 172.21.15.19:0/1537212620 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdec016070 con 0x561c45bc5780 2024-09-19T09:04:57.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.816+0000 7fbddaffd640 1 -- 172.21.15.19:0/1537212620 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbdec004d20 con 0x561c45bc5780 2024-09-19T09:04:57.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.817+0000 7fbddaffd640 1 -- 172.21.15.19:0/1537212620 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdec012850 con 0x561c45bc5780 2024-09-19T09:04:57.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.817+0000 7fbdfd1a4740 1 -- 172.21.15.19:0/1537212620 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561c45bc5780 msgr2=0x561c45bc7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:57.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.817+0000 7fbdfd1a4740 1 --2- 172.21.15.19:0/1537212620 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561c45bc5780 0x561c45bc7b70 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fbdec009f70 tx=0x7fbdec010800 comp rx=0 tx=0).stop 2024-09-19T09:04:57.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.817+0000 7fbdfd1a4740 1 -- 172.21.15.19:0/1537212620 shutdown_connections 2024-09-19T09:04:57.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.817+0000 7fbdfd1a4740 1 --2- 172.21.15.19:0/1537212620 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561c45bc5780 0x561c45bc7b70 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:57.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.817+0000 7fbdfd1a4740 1 --2- 172.21.15.19:0/1537212620 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561c45bb65d0 0x561c45bb6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:57.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.817+0000 7fbdfd1a4740 1 --2- 172.21.15.19:0/1537212620 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561c45bb7b40 0x561c45bb6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:57.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.817+0000 7fbdfd1a4740 1 -- 172.21.15.19:0/1537212620 >> 172.21.15.19:0/1537212620 conn(0x561c45b7f310 msgr2=0x561c45bb2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:57.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.817+0000 7fbdfd1a4740 1 -- 172.21.15.19:0/1537212620 shutdown_connections 2024-09-19T09:04:57.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.817+0000 7fbdfd1a4740 1 -- 172.21.15.19:0/1537212620 wait complete. 2024-09-19T09:04:57.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.818+0000 7fbdfd1a4740 1 -- start start 2024-09-19T09:04:57.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.818+0000 7fbdfd1a4740 1 Processor -- start 2024-09-19T09:04:57.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.818+0000 7fbdfd1a4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561c45bb65d0 0x561c45bc5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:57.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.818+0000 7fbdfd1a4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561c45bb7b40 0x561c45bc23e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:57.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.818+0000 7fbdfd1a4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561c45bc5780 0x561c45bc2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:57.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.818+0000 7fbdfd1a4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x561c45bc8480 con 0x561c45bb7b40 2024-09-19T09:04:57.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.818+0000 7fbdfd1a4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x561c45ad7060 con 0x561c45bb65d0 2024-09-19T09:04:57.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.818+0000 7fbdfd1a4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x561c45bc8600 con 0x561c45bc5780 2024-09-19T09:04:57.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.818+0000 7fbdfd1a4740 10 client.0 _ll_register_callbacks cb 0x561c4582a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:57.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.818+0000 7fbdf3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561c45bb7b40 0x561c45bc23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:57.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.818+0000 7fbdf3fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561c45bb7b40 0x561c45bc23e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56898/0 (socket says 172.21.15.19:56898) 2024-09-19T09:04:57.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.818+0000 7fbdf3fff640 1 -- 172.21.15.19:0/4039447041 learned_addr learned my addr 172.21.15.19:0/4039447041 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:57.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.818+0000 7fbdf8b67640 1 --2- 172.21.15.19:0/4039447041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561c45bb65d0 0x561c45bc5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:57.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.819+0000 7fbdf9368640 1 --2- 172.21.15.19:0/4039447041 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561c45bc5780 0x561c45bc2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:57.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.819+0000 7fbdf3fff640 1 -- 172.21.15.19:0/4039447041 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561c45bc5780 msgr2=0x561c45bc2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:57.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.819+0000 7fbdf3fff640 1 --2- 172.21.15.19:0/4039447041 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561c45bc5780 0x561c45bc2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:57.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.819+0000 7fbdf3fff640 1 -- 172.21.15.19:0/4039447041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561c45bb65d0 msgr2=0x561c45bc5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:57.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.819+0000 7fbdf3fff640 1 --2- 172.21.15.19:0/4039447041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561c45bb65d0 0x561c45bc5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:57.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.819+0000 7fbdf3fff640 1 -- 172.21.15.19:0/4039447041 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c4588d3c0 con 0x561c45bb7b40 2024-09-19T09:04:57.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.819+0000 7fbdf9368640 1 --2- 172.21.15.19:0/4039447041 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561c45bc5780 0x561c45bc2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:57.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.819+0000 7fbdf8b67640 1 --2- 172.21.15.19:0/4039447041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561c45bb65d0 0x561c45bc5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T09:04:57.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.819+0000 7fbdf3fff640 1 --2- 172.21.15.19:0/4039447041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561c45bb7b40 0x561c45bc23e0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fbde8000c00 tx=0x7fbde809b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124bc648905ebee0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:57.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.819+0000 7fbdd3fff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:04:57.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.819+0000 7fbdd3fff640 1 -- 172.21.15.19:0/4039447041 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde809ce60 con 0x561c45bb7b40 2024-09-19T09:04:57.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.819+0000 7fbdd3fff640 1 -- 172.21.15.19:0/4039447041 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7fbde80cf0f0 con 0x561c45bb7b40 2024-09-19T09:04:57.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.819+0000 7fbdfd1a4740 1 -- 172.21.15.19:0/4039447041 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbdec004d20 con 0x561c45bb7b40 2024-09-19T09:04:57.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.819+0000 7fbdd3fff640 1 -- 172.21.15.19:0/4039447041 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fbde8020070 con 0x561c45bb7b40 2024-09-19T09:04:57.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.819+0000 7fbdfd1a4740 10 client.18804 fetch_fsmap learned FSMap version 43 2024-09-19T09:04:57.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.819+0000 7fbdfd1a4740 1 -- 172.21.15.19:0/4039447041 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x561c45bd3ed0 con 0x561c45bb7b40 2024-09-19T09:04:57.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.819+0000 7fbdd3fff640 1 -- 172.21.15.19:0/4039447041 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbdec004d20 con 0x561c45bb7b40 2024-09-19T09:04:57.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.820+0000 7fbdd3fff640 1 -- 172.21.15.19:0/4039447041 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7fbde809af80 con 0x561c45bb7b40 2024-09-19T09:04:57.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.820+0000 7fbdfd1a4740 10 client.18804 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T09:04:57.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.820+0000 7fbdfd1a4740 10 client.18804 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:04:57.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.820+0000 7fbdfd1a4740 20 client.18804 populate_metadata read hostname 'smithi019' 2024-09-19T09:04:57.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.820+0000 7fbdfd1a4740 1 --2- 172.21.15.19:0/4039447041 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x561c45bd5430 0x561c45bd7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:57.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.820+0000 7fbdfd1a4740 4 client.18804 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T09:04:57.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.820+0000 7fbdfd1a4740 1 -- 172.21.15.19:0/4039447041 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c45b29860 con 0x561c45bd5430 2024-09-19T09:04:57.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.820+0000 7fbdf8b67640 1 --2- 172.21.15.19:0/4039447041 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x561c45bd5430 0x561c45bd7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:57.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.821+0000 7fbdf8b67640 1 --2- 172.21.15.19:0/4039447041 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x561c45bd5430 0x561c45bd7870 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c4cd985a187e86c server_cookie=32eba241cc25649c in_seq=0 out_seq=0 2024-09-19T09:04:57.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.821+0000 7fbdd3fff640 10 client.18804 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:04:57.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.821+0000 7fbdd3fff640 1 -- 172.21.15.19:0/4039447041 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561c45b29860 con 0x561c45bd5430 2024-09-19T09:04:57.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.821+0000 7fbdd3fff640 10 client.18804 handle_command_reply: tid=0 2024-09-19T09:04:57.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.821+0000 7fbdfd1a4740 1 client.18804 shutdown 2024-09-19T09:04:57.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.821+0000 7fbdfd1a4740 1 -- 172.21.15.19:0/4039447041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561c45bb7b40 msgr2=0x561c45bc23e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:57.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.821+0000 7fbdfd1a4740 1 --2- 172.21.15.19:0/4039447041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561c45bb7b40 0x561c45bc23e0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fbde8000c00 tx=0x7fbde809b900 comp rx=0 tx=0).stop 2024-09-19T09:04:57.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.822+0000 7fbdfd1a4740 1 -- 172.21.15.19:0/4039447041 shutdown_connections 2024-09-19T09:04:57.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.822+0000 7fbdfd1a4740 1 --2- 172.21.15.19:0/4039447041 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x561c45bd5430 0x561c45bd7870 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:57.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.822+0000 7fbdfd1a4740 1 --2- 172.21.15.19:0/4039447041 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561c45bc5780 0x561c45bc2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:57.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.822+0000 7fbdfd1a4740 1 --2- 172.21.15.19:0/4039447041 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561c45bb7b40 0x561c45bc23e0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:57.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.822+0000 7fbdd3fff640 0 client.18804 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:04:57.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.822+0000 7fbdfd1a4740 1 --2- 172.21.15.19:0/4039447041 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561c45bb65d0 0x561c45bc5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:57.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.822+0000 7fbdfd1a4740 1 -- 172.21.15.19:0/4039447041 >> 172.21.15.19:0/4039447041 conn(0x561c45b7f310 msgr2=0x561c45bb8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:57.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.822+0000 7fbdfd1a4740 1 -- 172.21.15.19:0/4039447041 shutdown_connections 2024-09-19T09:04:57.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.822+0000 7fbdfd1a4740 1 -- 172.21.15.19:0/4039447041 wait complete. 2024-09-19T09:04:57.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.822+0000 7fbdfd1a4740 20 client.18804 trim_cache size 0 max 16384 2024-09-19T09:04:57.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.835+0000 7fbdfd1a4740 1 Processor -- start 2024-09-19T09:04:57.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.835+0000 7fbdfd1a4740 1 -- start start 2024-09-19T09:04:57.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.835+0000 7fbdfd1a4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561c45bb65d0 0x561c45bd1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:57.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.835+0000 7fbdfd1a4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561c45bb7b40 0x561c45bc13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:57.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.835+0000 7fbdfd1a4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561c45bc5780 0x561c45bdd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:57.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.835+0000 7fbdfd1a4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf41ab3d0 con 0x561c45bb65d0 2024-09-19T09:04:57.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.835+0000 7fbdfd1a4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf41acf10 con 0x561c45bc5780 2024-09-19T09:04:57.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.835+0000 7fbdfd1a4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf41abaa0 con 0x561c45bb7b40 2024-09-19T09:04:57.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.835+0000 7fbdf8b67640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561c45bb65d0 0x561c45bd1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:57.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.835+0000 7fbdf8b67640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561c45bb65d0 0x561c45bd1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56906/0 (socket says 172.21.15.19:56906) 2024-09-19T09:04:57.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.835+0000 7fbdf8b67640 1 -- 172.21.15.19:0/1846269048 learned_addr learned my addr 172.21.15.19:0/1846269048 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:57.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.835+0000 7fbdf8b67640 1 -- 172.21.15.19:0/1846269048 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561c45bb7b40 msgr2=0x561c45bc13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:57.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.835+0000 7fbdf3fff640 1 --2- 172.21.15.19:0/1846269048 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561c45bb7b40 0x561c45bc13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:57.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.835+0000 7fbdf9368640 1 --2- 172.21.15.19:0/1846269048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561c45bc5780 0x561c45bdd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:57.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.835+0000 7fbdf8b67640 1 --2- 172.21.15.19:0/1846269048 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561c45bb7b40 0x561c45bc13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:57.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.835+0000 7fbdf8b67640 1 -- 172.21.15.19:0/1846269048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561c45bc5780 msgr2=0x561c45bdd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:57.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.835+0000 7fbdf8b67640 1 --2- 172.21.15.19:0/1846269048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561c45bc5780 0x561c45bdd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:57.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.835+0000 7fbdf8b67640 1 -- 172.21.15.19:0/1846269048 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c45bb73a0 con 0x561c45bb65d0 2024-09-19T09:04:57.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.835+0000 7fbdf3fff640 1 --2- 172.21.15.19:0/1846269048 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561c45bb7b40 0x561c45bc13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:57.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.835+0000 7fbdf9368640 1 --2- 172.21.15.19:0/1846269048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561c45bc5780 0x561c45bdd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:57.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.836+0000 7fbdf8b67640 1 --2- 172.21.15.19:0/1846269048 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561c45bb65d0 0x561c45bd1720 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fbde4005ab0 tx=0x7fbde403c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de2e5e8573c9177b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:57.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.836+0000 7fbdda7fc640 1 -- 172.21.15.19:0/1846269048 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde4035050 con 0x561c45bb65d0 2024-09-19T09:04:57.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.836+0000 7fbdda7fc640 1 -- 172.21.15.19:0/1846269048 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbde40325c0 con 0x561c45bb65d0 2024-09-19T09:04:57.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.836+0000 7fbdda7fc640 1 -- 172.21.15.19:0/1846269048 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde4003850 con 0x561c45bb65d0 2024-09-19T09:04:57.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.836+0000 7fbdfd1a4740 1 -- 172.21.15.19:0/1846269048 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561c45bb65d0 msgr2=0x561c45bd1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:57.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.836+0000 7fbdfd1a4740 1 --2- 172.21.15.19:0/1846269048 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561c45bb65d0 0x561c45bd1720 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fbde4005ab0 tx=0x7fbde403c000 comp rx=0 tx=0).stop 2024-09-19T09:04:57.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.836+0000 7fbdfd1a4740 1 -- 172.21.15.19:0/1846269048 shutdown_connections 2024-09-19T09:04:57.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.836+0000 7fbdfd1a4740 1 --2- 172.21.15.19:0/1846269048 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561c45bb7b40 0x561c45bc13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:57.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.836+0000 7fbdfd1a4740 1 --2- 172.21.15.19:0/1846269048 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561c45bc5780 0x561c45bdd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:57.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.836+0000 7fbdfd1a4740 1 --2- 172.21.15.19:0/1846269048 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561c45bb65d0 0x561c45bd1720 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:57.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.836+0000 7fbdfd1a4740 1 -- 172.21.15.19:0/1846269048 >> 172.21.15.19:0/1846269048 conn(0x561c45b7f310 msgr2=0x561c45bc0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:57.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.837+0000 7fbdfd1a4740 1 -- 172.21.15.19:0/1846269048 shutdown_connections 2024-09-19T09:04:57.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.837+0000 7fbdfd1a4740 1 -- 172.21.15.19:0/1846269048 wait complete. 2024-09-19T09:04:57.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.837+0000 7fbdfd1a4740 1 -- start start 2024-09-19T09:04:57.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.837+0000 7fbdfd1a4740 1 Processor -- start 2024-09-19T09:04:57.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.837+0000 7fbdfd1a4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561c45bb65d0 0x561c45bce120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:57.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.837+0000 7fbdfd1a4740 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561c45bb7b40 0x561c45bc9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:57.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.837+0000 7fbdfd1a4740 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561c45bc5780 0x561c45bc9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:57.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.837+0000 7fbdfd1a4740 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf41ac840 con 0x561c45bc5780 2024-09-19T09:04:57.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.837+0000 7fbdfd1a4740 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf41ac170 con 0x561c45bb7b40 2024-09-19T09:04:57.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.837+0000 7fbdfd1a4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf41a93b0 con 0x561c45bb65d0 2024-09-19T09:04:57.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.838+0000 7fbdfd1a4740 10 client.0 _ll_register_callbacks cb 0x7fbde809b720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T09:04:57.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.838+0000 7fbdf9368640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561c45bc5780 0x561c45bc9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:57.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.838+0000 7fbdf9368640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561c45bc5780 0x561c45bc9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56914/0 (socket says 172.21.15.19:56914) 2024-09-19T09:04:57.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.838+0000 7fbdf9368640 1 -- 172.21.15.19:0/777638286 learned_addr learned my addr 172.21.15.19:0/777638286 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:57.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.838+0000 7fbdf3fff640 1 --2- 172.21.15.19:0/777638286 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561c45bb7b40 0x561c45bc9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:57.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.838+0000 7fbdf8b67640 1 --2- 172.21.15.19:0/777638286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561c45bb65d0 0x561c45bce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:57.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.838+0000 7fbdf9368640 1 -- 172.21.15.19:0/777638286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561c45bb65d0 msgr2=0x561c45bce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:57.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.838+0000 7fbdf9368640 1 --2- 172.21.15.19:0/777638286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561c45bb65d0 0x561c45bce120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:57.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.838+0000 7fbdf9368640 1 -- 172.21.15.19:0/777638286 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561c45bb7b40 msgr2=0x561c45bc9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T09:04:57.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.838+0000 7fbdf9368640 1 --2- 172.21.15.19:0/777638286 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561c45bb7b40 0x561c45bc9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:57.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.838+0000 7fbdf9368640 1 -- 172.21.15.19:0/777638286 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c45bb3960 con 0x561c45bc5780 2024-09-19T09:04:57.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.838+0000 7fbdf9368640 1 --2- 172.21.15.19:0/777638286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561c45bc5780 0x561c45bc9a60 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fbdec009f70 tx=0x7fbdec003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2551f607bac2719 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:57.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.838+0000 7fbdd3fff640 10 client.0 ms_handle_connect on v2:172.21.15.19:3300/0 2024-09-19T09:04:57.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.838+0000 7fbdd3fff640 1 -- 172.21.15.19:0/777638286 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdec016040 con 0x561c45bc5780 2024-09-19T09:04:57.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.838+0000 7fbdd3fff640 1 -- 172.21.15.19:0/777638286 <== mon.0 v2:172.21.15.19:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7fbdec0052c0 con 0x561c45bc5780 2024-09-19T09:04:57.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.838+0000 7fbdfd1a4740 1 -- 172.21.15.19:0/777638286 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbde40325c0 con 0x561c45bc5780 2024-09-19T09:04:57.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.839+0000 7fbdd3fff640 1 -- 172.21.15.19:0/777638286 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) ==== 24+0+0 (secure 0 0 0) 0x7fbdec0054c0 con 0x561c45bc5780 2024-09-19T09:04:57.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.839+0000 7fbdfd1a4740 10 client.18810 fetch_fsmap learned FSMap version 43 2024-09-19T09:04:57.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.839+0000 7fbdfd1a4740 1 -- 172.21.15.19:0/777638286 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) -- 0x561c45c3fff0 con 0x561c45bc5780 2024-09-19T09:04:57.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.839+0000 7fbdd3fff640 1 -- 172.21.15.19:0/777638286 <== mon.0 v2:172.21.15.19:3300/0 4 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fbde40325c0 con 0x561c45bc5780 2024-09-19T09:04:57.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.839+0000 7fbdd3fff640 1 -- 172.21.15.19:0/777638286 <== mon.0 v2:172.21.15.19:3300/0 5 ==== fsmap(e 43) ==== 8362+0+0 (secure 0 0 0) 0x7fbdec00f040 con 0x561c45bc5780 2024-09-19T09:04:57.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.839+0000 7fbdfd1a4740 10 client.18810 fetch_fsmap finished waiting for FSMap version 43 2024-09-19T09:04:57.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.839+0000 7fbdfd1a4740 10 client.18810 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T09:04:57.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.839+0000 7fbdfd1a4740 20 client.18810 populate_metadata read hostname 'smithi019' 2024-09-19T09:04:57.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.839+0000 7fbdfd1a4740 1 --2- 172.21.15.19:0/777638286 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x561c45c405b0 0x561c45c429d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:57.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.839+0000 7fbdfd1a4740 4 client.18810 mds_command: new command op to 24497 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T09:04:57.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.839+0000 7fbdfd1a4740 1 -- 172.21.15.19:0/777638286 --> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561c45b23d70 con 0x561c45c405b0 2024-09-19T09:04:57.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.839+0000 7fbdf8b67640 1 --2- 172.21.15.19:0/777638286 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x561c45c405b0 0x561c45c429d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:57.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.840+0000 7fbdf8b67640 1 --2- 172.21.15.19:0/777638286 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x561c45c405b0 0x561c45c429d0 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91b8ea07bf381f55 server_cookie=ff205a1acd79b4a3 in_seq=0 out_seq=0 2024-09-19T09:04:57.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.840+0000 7fbdd3fff640 10 client.18810 ms_handle_connect on v2:172.21.15.155:6838/1224030981 2024-09-19T09:04:57.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.840+0000 7fbdd3fff640 1 -- 172.21.15.19:0/777638286 <== mds.0 v2:172.21.15.155:6838/1224030981 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561c45b23d70 con 0x561c45c405b0 2024-09-19T09:04:57.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.840+0000 7fbdd3fff640 10 client.18810 handle_command_reply: tid=0 2024-09-19T09:04:57.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.840+0000 7fbdfd1a4740 1 client.18810 shutdown 2024-09-19T09:04:57.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.840+0000 7fbdfd1a4740 1 -- 172.21.15.19:0/777638286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561c45bc5780 msgr2=0x561c45bc9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:57.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.840+0000 7fbdfd1a4740 1 --2- 172.21.15.19:0/777638286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561c45bc5780 0x561c45bc9a60 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fbdec009f70 tx=0x7fbdec003ba0 comp rx=0 tx=0).stop 2024-09-19T09:04:57.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.840+0000 7fbdfd1a4740 1 -- 172.21.15.19:0/777638286 shutdown_connections 2024-09-19T09:04:57.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.840+0000 7fbdfd1a4740 1 --2- 172.21.15.19:0/777638286 >> [v2:172.21.15.155:6838/1224030981,v1:172.21.15.155:6839/1224030981] conn(0x561c45c405b0 0x561c45c429d0 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:57.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.840+0000 7fbdfd1a4740 1 --2- 172.21.15.19:0/777638286 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x561c45bc5780 0x561c45bc9a60 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:57.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.840+0000 7fbdfd1a4740 1 --2- 172.21.15.19:0/777638286 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x561c45bb7b40 0x561c45bc9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:57.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.840+0000 7fbdd3fff640 0 client.18810 ms_handle_reset on v2:172.21.15.155:6838/1224030981 2024-09-19T09:04:57.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.840+0000 7fbdfd1a4740 1 --2- 172.21.15.19:0/777638286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561c45bb65d0 0x561c45bce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:57.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.840+0000 7fbdfd1a4740 1 -- 172.21.15.19:0/777638286 >> 172.21.15.19:0/777638286 conn(0x561c45b7f310 msgr2=0x561c45bc14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:57.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.840+0000 7fbdfd1a4740 1 -- 172.21.15.19:0/777638286 shutdown_connections 2024-09-19T09:04:57.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.840+0000 7fbdfd1a4740 1 -- 172.21.15.19:0/777638286 wait complete. 2024-09-19T09:04:57.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.840+0000 7fbdfd1a4740 20 client.18810 trim_cache size 0 max 16384 2024-09-19T09:04:57.858 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-19T09:04:57.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.841+0000 7fbdfadcb640 1 -- 172.21.15.19:0/1841588430 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbddc0a3240 msgr2=0x7fbddc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:57.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.841+0000 7fbdfadcb640 1 --2- 172.21.15.19:0/1841588430 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbddc0a3240 0x7fbddc0a5700 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fbde4000c00 tx=0x7fbde4005a40 comp rx=0 tx=0).stop 2024-09-19T09:04:57.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.841+0000 7fbdfadcb640 1 -- 172.21.15.19:0/1841588430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdf4103660 msgr2=0x7fbdf4198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:57.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.841+0000 7fbdfadcb640 1 --2- 172.21.15.19:0/1841588430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdf4103660 0x7fbdf4198980 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fbde800d740 tx=0x7fbde800dc00 comp rx=0 tx=0).stop 2024-09-19T09:04:57.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.841+0000 7fbdfadcb640 1 -- 172.21.15.19:0/1841588430 shutdown_connections 2024-09-19T09:04:57.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.841+0000 7fbdfadcb640 1 --2- 172.21.15.19:0/1841588430 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fbddc0a3240 0x7fbddc0a5700 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:57.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.841+0000 7fbdfadcb640 1 --2- 172.21.15.19:0/1841588430 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fbdf410c170 0x7fbdf419cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:57.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.841+0000 7fbdfadcb640 1 --2- 172.21.15.19:0/1841588430 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fbdf4103660 0x7fbdf4198980 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:57.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.841+0000 7fbdfadcb640 1 --2- 172.21.15.19:0/1841588430 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbdf4102d40 0x7fbdf4198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:57.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.841+0000 7fbdfadcb640 1 -- 172.21.15.19:0/1841588430 >> 172.21.15.19:0/1841588430 conn(0x7fbdf40fc7a0 msgr2=0x7fbdf40fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:57.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.841+0000 7fbdfadcb640 1 -- 172.21.15.19:0/1841588430 shutdown_connections 2024-09-19T09:04:57.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:57.841+0000 7fbdfadcb640 1 -- 172.21.15.19:0/1841588430 wait complete. 2024-09-19T09:04:57.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:57 smithi203 ceph-mon[35450]: pgmap v725: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-19T09:04:58.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:57 smithi155 ceph-mon[34921]: pgmap v725: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-19T09:04:58.548 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-19T09:04:58.555 INFO:tasks.fwd_scrub:done joining 2024-09-19T09:04:58.555 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-19T09:04:58.566 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T09:04:58.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.673+0000 7f7c7d12a640 1 -- 172.21.15.19:0/425891260 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c781025c0 msgr2=0x7f7c78108e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:58.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.673+0000 7f7c7d12a640 1 --2- 172.21.15.19:0/425891260 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c781025c0 0x7f7c78108e50 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f7c70009ca0 tx=0x7f7c7002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.673+0000 7f7c7d12a640 1 -- 172.21.15.19:0/425891260 shutdown_connections 2024-09-19T09:04:58.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.673+0000 7f7c7d12a640 1 --2- 172.21.15.19:0/425891260 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c781025c0 0x7f7c78108e50 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.673+0000 7f7c7d12a640 1 --2- 172.21.15.19:0/425891260 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c78101c00 0x7f7c78102080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.673+0000 7f7c7d12a640 1 --2- 172.21.15.19:0/425891260 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c78100a10 0x7f7c78100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.673+0000 7f7c7d12a640 1 -- 172.21.15.19:0/425891260 >> 172.21.15.19:0/425891260 conn(0x7f7c780fc170 msgr2=0x7f7c780fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:58.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.673+0000 7f7c7d12a640 1 -- 172.21.15.19:0/425891260 shutdown_connections 2024-09-19T09:04:58.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.673+0000 7f7c7d12a640 1 -- 172.21.15.19:0/425891260 wait complete. 2024-09-19T09:04:58.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.673+0000 7f7c7d12a640 1 Processor -- start 2024-09-19T09:04:58.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.674+0000 7f7c7d12a640 1 -- start start 2024-09-19T09:04:58.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.674+0000 7f7c7d12a640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c78100a10 0x7f7c781049a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:58.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.674+0000 7f7c7d12a640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c78101c00 0x7f7c78102fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:58.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.674+0000 7f7c7d12a640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c781025c0 0x7f7c78103520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:58.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.674+0000 7f7c7d12a640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7810c670 con 0x7f7c78100a10 2024-09-19T09:04:58.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.674+0000 7f7c7d12a640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7810c4f0 con 0x7f7c78101c00 2024-09-19T09:04:58.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.674+0000 7f7c7d12a640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7810c7f0 con 0x7f7c781025c0 2024-09-19T09:04:58.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.674+0000 7f7c76d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c78100a10 0x7f7c781049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:58.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.674+0000 7f7c76d9d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c78100a10 0x7f7c781049a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56928/0 (socket says 172.21.15.19:56928) 2024-09-19T09:04:58.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.674+0000 7f7c76d9d640 1 -- 172.21.15.19:0/2477925889 learned_addr learned my addr 172.21.15.19:0/2477925889 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:58.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.674+0000 7f7c7659c640 1 --2- 172.21.15.19:0/2477925889 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c78101c00 0x7f7c78102fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:58.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.674+0000 7f7c7759e640 1 --2- 172.21.15.19:0/2477925889 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c781025c0 0x7f7c78103520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:58.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.674+0000 7f7c76d9d640 1 -- 172.21.15.19:0/2477925889 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c781025c0 msgr2=0x7f7c78103520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:58.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.674+0000 7f7c76d9d640 1 --2- 172.21.15.19:0/2477925889 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c781025c0 0x7f7c78103520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.674+0000 7f7c76d9d640 1 -- 172.21.15.19:0/2477925889 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c78101c00 msgr2=0x7f7c78102fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:58.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.674+0000 7f7c76d9d640 1 --2- 172.21.15.19:0/2477925889 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c78101c00 0x7f7c78102fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.674+0000 7f7c76d9d640 1 -- 172.21.15.19:0/2477925889 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c78103db0 con 0x7f7c78100a10 2024-09-19T09:04:58.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.674+0000 7f7c7759e640 1 --2- 172.21.15.19:0/2477925889 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c781025c0 0x7f7c78103520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:04:58.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.674+0000 7f7c76d9d640 1 --2- 172.21.15.19:0/2477925889 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c78100a10 0x7f7c781049a0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f7c6800d770 tx=0x7f7c6800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:58.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.675+0000 7f7c5ffff640 1 -- 172.21.15.19:0/2477925889 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c68017070 con 0x7f7c78100a10 2024-09-19T09:04:58.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.675+0000 7f7c5ffff640 1 -- 172.21.15.19:0/2477925889 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7c68009c30 con 0x7f7c78100a10 2024-09-19T09:04:58.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.675+0000 7f7c7d12a640 1 -- 172.21.15.19:0/2477925889 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c781a1f00 con 0x7f7c78100a10 2024-09-19T09:04:58.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.675+0000 7f7c5ffff640 1 -- 172.21.15.19:0/2477925889 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c68003dd0 con 0x7f7c78100a10 2024-09-19T09:04:58.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.675+0000 7f7c7d12a640 1 -- 172.21.15.19:0/2477925889 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c781a2310 con 0x7f7c78100a10 2024-09-19T09:04:58.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.676+0000 7f7c7d12a640 1 -- 172.21.15.19:0/2477925889 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c781a2600 con 0x7f7c78100a10 2024-09-19T09:04:58.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.677+0000 7f7c5ffff640 1 -- 172.21.15.19:0/2477925889 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f7c68003fb0 con 0x7f7c78100a10 2024-09-19T09:04:58.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.677+0000 7f7c5ffff640 1 --2- 172.21.15.19:0/2477925889 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7c600a3250 0x7f7c600a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:58.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.678+0000 7f7c7659c640 1 --2- 172.21.15.19:0/2477925889 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7c600a3250 0x7f7c600a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:58.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.678+0000 7f7c5ffff640 1 -- 172.21.15.19:0/2477925889 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f7c680cf5f0 con 0x7f7c78100a10 2024-09-19T09:04:58.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.678+0000 7f7c7659c640 1 --2- 172.21.15.19:0/2477925889 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7c600a3250 0x7f7c600a5710 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7c78104710 tx=0x7f7c6c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:58.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.681+0000 7f7c5ffff640 1 -- 172.21.15.19:0/2477925889 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7c68009de0 con 0x7f7c78100a10 2024-09-19T09:04:58.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.858+0000 7f7c7d12a640 1 -- 172.21.15.19:0/2477925889 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7c781a2a20 con 0x7f7c78100a10 2024-09-19T09:04:58.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.859+0000 7f7c5ffff640 1 -- 172.21.15.19:0/2477925889 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22651 (secure 0 0 0) 0x7f7c6809c320 con 0x7f7c78100a10 2024-09-19T09:04:58.861 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T09:04:58.861 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":88,"fsid":"f26c9d84-7662-11ef-bceb-c7b262605968","created":"2024-09-19T08:42:32.324073+0000","modified":"2024-09-19T09:04:06.944574+0000","last_up_change":"2024-09-19T08:49:24.764960+0000","last_in_change":"2024-09-19T08:49:01.062919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:45:36.232910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:50:12.615884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:50:14.854513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81c7bb06-5b13-4ee0-9290-d779faac1b91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6803","nonce":3397146732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6805","nonce":3397146732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6809","nonce":3397146732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6807","nonce":3397146732}]},"public_addr":"172.21.15.19:6803/3397146732","cluster_addr":"172.21.15.19:6805/3397146732","heartbeat_back_addr":"172.21.15.19:6809/3397146732","heartbeat_front_addr":"172.21.15.19:6807/3397146732","state":["exists","up"]},{"osd":1,"uuid":"24c145e6-5252-4708-8f25-5ce041e8251e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6801","nonce":2011043685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6803","nonce":2011043685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6807","nonce":2011043685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6805","nonce":2011043685}]},"public_addr":"172.21.15.155:6801/2011043685","cluster_addr":"172.21.15.155:6803/2011043685","heartbeat_back_addr":"172.21.15.155:6807/2011043685","heartbeat_front_addr":"172.21.15.155:6805/2011043685","state":["exists","up"]},{"osd":2,"uuid":"99cefd33-0675-495f-8871-2e6fdead0c3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6801","nonce":3358994623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6803","nonce":3358994623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6807","nonce":3358994623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6805","nonce":3358994623}]},"public_addr":"172.21.15.203:6801/3358994623","cluster_addr":"172.21.15.203:6803/3358994623","heartbeat_back_addr":"172.21.15.203:6807/3358994623","heartbeat_front_addr":"172.21.15.203:6805/3358994623","state":["exists","up"]},{"osd":3,"uuid":"8f46c16c-f17e-484a-8b66-6dbf135f34c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6811","nonce":176445576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6813","nonce":176445576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6817","nonce":176445576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6815","nonce":176445576}]},"public_addr":"172.21.15.19:6811/176445576","cluster_addr":"172.21.15.19:6813/176445576","heartbeat_back_addr":"172.21.15.19:6817/176445576","heartbeat_front_addr":"172.21.15.19:6815/176445576","state":["exists","up"]},{"osd":4,"uuid":"411b0423-1317-4e82-bc01-b5f55b391bc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6809","nonce":2163087792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6811","nonce":2163087792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6815","nonce":2163087792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6813","nonce":2163087792}]},"public_addr":"172.21.15.155:6809/2163087792","cluster_addr":"172.21.15.155:6811/2163087792","heartbeat_back_addr":"172.21.15.155:6815/2163087792","heartbeat_front_addr":"172.21.15.155:6813/2163087792","state":["exists","up"]},{"osd":5,"uuid":"057c073e-569f-4c6e-9602-e1169ad4dd8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6809","nonce":334881465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6811","nonce":334881465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6815","nonce":334881465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6813","nonce":334881465}]},"public_addr":"172.21.15.203:6809/334881465","cluster_addr":"172.21.15.203:6811/334881465","heartbeat_back_addr":"172.21.15.203:6815/334881465","heartbeat_front_addr":"172.21.15.203:6813/334881465","state":["exists","up"]},{"osd":6,"uuid":"40418f13-823e-4f94-a427-84781abbcb5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6819","nonce":2669779791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6821","nonce":2669779791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6825","nonce":2669779791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6823","nonce":2669779791}]},"public_addr":"172.21.15.19:6819/2669779791","cluster_addr":"172.21.15.19:6821/2669779791","heartbeat_back_addr":"172.21.15.19:6825/2669779791","heartbeat_front_addr":"172.21.15.19:6823/2669779791","state":["exists","up"]},{"osd":7,"uuid":"ad15f762-aeab-4167-a63d-6c9f9b89b9c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6817","nonce":3169455907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6819","nonce":3169455907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6823","nonce":3169455907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6821","nonce":3169455907}]},"public_addr":"172.21.15.155:6817/3169455907","cluster_addr":"172.21.15.155:6819/3169455907","heartbeat_back_addr":"172.21.15.155:6823/3169455907","heartbeat_front_addr":"172.21.15.155:6821/3169455907","state":["exists","up"]},{"osd":8,"uuid":"23cf8ea2-29d6-43d8-a05b-7822f4bbf254","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6817","nonce":1062999528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6819","nonce":1062999528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6823","nonce":1062999528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6821","nonce":1062999528}]},"public_addr":"172.21.15.203:6817/1062999528","cluster_addr":"172.21.15.203:6819/1062999528","heartbeat_back_addr":"172.21.15.203:6823/1062999528","heartbeat_front_addr":"172.21.15.203:6821/1062999528","state":["exists","up"]},{"osd":9,"uuid":"e851e605-2d17-4fbf-b783-2138133edd06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6827","nonce":574664786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6829","nonce":574664786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6833","nonce":574664786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6831","nonce":574664786}]},"public_addr":"172.21.15.19:6827/574664786","cluster_addr":"172.21.15.19:6829/574664786","heartbeat_back_addr":"172.21.15.19:6833/574664786","heartbeat_front_addr":"172.21.15.19:6831/574664786","state":["exists","up"]},{"osd":10,"uuid":"cc770717-91bd-4494-9103-6db8214b5872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6825","nonce":2242158832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6827","nonce":2242158832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6831","nonce":2242158832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6829","nonce":2242158832}]},"public_addr":"172.21.15.155:6825/2242158832","cluster_addr":"172.21.15.155:6827/2242158832","heartbeat_back_addr":"172.21.15.155:6831/2242158832","heartbeat_front_addr":"172.21.15.155:6829/2242158832","state":["exists","up"]},{"osd":11,"uuid":"6c237db9-5d79-47bc-8ff6-60d09d721d5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6825","nonce":522943955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6827","nonce":522943955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6831","nonce":522943955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6829","nonce":522943955}]},"public_addr":"172.21.15.203:6825/522943955","cluster_addr":"172.21.15.203:6827/522943955","heartbeat_back_addr":"172.21.15.203:6831/522943955","heartbeat_front_addr":"172.21.15.203:6829/522943955","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:44:44.656414+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:09.339183+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:33.245452+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:59.449025+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:46:24.831213+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:46:49.189780+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:47:13.493628+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:47:39.478247+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:05.089875+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:30.722878+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:56.951834+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:22.894678+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6801/4266644067":"2024-09-20T08:43:21.732222+0000","172.21.15.19:0/1398782170":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6800/4266644067":"2024-09-20T08:43:21.732222+0000","172.21.15.19:0/34162461":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6801/1764769529":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/2910961714":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6800/1764769529":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/820792769":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/560203138":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/809642328":"2024-09-20T08:42:56.618773+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:04:58.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.861+0000 7f7c7d12a640 1 -- 172.21.15.19:0/2477925889 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7c600a3250 msgr2=0x7f7c600a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:58.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.861+0000 7f7c7d12a640 1 --2- 172.21.15.19:0/2477925889 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7c600a3250 0x7f7c600a5710 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7c78104710 tx=0x7f7c6c00b390 comp rx=0 tx=0).stop 2024-09-19T09:04:58.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.861+0000 7f7c7d12a640 1 -- 172.21.15.19:0/2477925889 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c78100a10 msgr2=0x7f7c781049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:58.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.861+0000 7f7c7d12a640 1 --2- 172.21.15.19:0/2477925889 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c78100a10 0x7f7c781049a0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f7c6800d770 tx=0x7f7c6800dc30 comp rx=0 tx=0).stop 2024-09-19T09:04:58.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.862+0000 7f7c7d12a640 1 -- 172.21.15.19:0/2477925889 shutdown_connections 2024-09-19T09:04:58.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.862+0000 7f7c7d12a640 1 --2- 172.21.15.19:0/2477925889 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7c600a3250 0x7f7c600a5710 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.862+0000 7f7c7d12a640 1 --2- 172.21.15.19:0/2477925889 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7c781025c0 0x7f7c78103520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.862+0000 7f7c7d12a640 1 --2- 172.21.15.19:0/2477925889 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7c78101c00 0x7f7c78102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.862+0000 7f7c7d12a640 1 --2- 172.21.15.19:0/2477925889 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7c78100a10 0x7f7c781049a0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.862+0000 7f7c7d12a640 1 -- 172.21.15.19:0/2477925889 >> 172.21.15.19:0/2477925889 conn(0x7f7c780fc170 msgr2=0x7f7c780fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:58.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.862+0000 7f7c7d12a640 1 -- 172.21.15.19:0/2477925889 shutdown_connections 2024-09-19T09:04:58.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.862+0000 7f7c7d12a640 1 -- 172.21.15.19:0/2477925889 wait complete. 2024-09-19T09:04:58.874 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T08:45:36.232910+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T08:50:12.615884+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T08:50:14.854513+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T09:04:58.874 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T09:04:58.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.980+0000 7f860feaf640 1 -- 172.21.15.19:0/1862061117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86081025e0 msgr2=0x7f8608108e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:58.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.980+0000 7f860feaf640 1 --2- 172.21.15.19:0/1862061117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86081025e0 0x7f8608108e70 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f8600009ca0 tx=0x7f860002a8c0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.980+0000 7f860feaf640 1 -- 172.21.15.19:0/1862061117 shutdown_connections 2024-09-19T09:04:58.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.980+0000 7f860feaf640 1 --2- 172.21.15.19:0/1862061117 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8608101c20 0x7f86081020a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.980+0000 7f860feaf640 1 --2- 172.21.15.19:0/1862061117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f86081025e0 0x7f8608108e70 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.980+0000 7f860feaf640 1 --2- 172.21.15.19:0/1862061117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8608100a30 0x7f8608100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.980+0000 7f860feaf640 1 -- 172.21.15.19:0/1862061117 >> 172.21.15.19:0/1862061117 conn(0x7f86080fc1b0 msgr2=0x7f86080fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:58.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.980+0000 7f860feaf640 1 -- 172.21.15.19:0/1862061117 shutdown_connections 2024-09-19T09:04:58.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.980+0000 7f860feaf640 1 -- 172.21.15.19:0/1862061117 wait complete. 2024-09-19T09:04:58.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.981+0000 7f860feaf640 1 Processor -- start 2024-09-19T09:04:58.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.981+0000 7f860feaf640 1 -- start start 2024-09-19T09:04:58.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.981+0000 7f860feaf640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8608100a30 0x7f86081049c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:58.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.981+0000 7f860feaf640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8608101c20 0x7f8608103000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:58.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.981+0000 7f860feaf640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f86081025e0 0x7f8608103540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:58.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.981+0000 7f860feaf640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f860810c690 con 0x7f8608100a30 2024-09-19T09:04:58.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.981+0000 7f860feaf640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f860810c510 con 0x7f8608101c20 2024-09-19T09:04:58.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.981+0000 7f860feaf640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f860810c810 con 0x7f86081025e0 2024-09-19T09:04:58.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.981+0000 7f860dc4b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8608100a30 0x7f86081049c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:58.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.981+0000 7f860dc4b640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8608100a30 0x7f86081049c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56950/0 (socket says 172.21.15.19:56950) 2024-09-19T09:04:58.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.981+0000 7f860dc4b640 1 -- 172.21.15.19:0/1983305581 learned_addr learned my addr 172.21.15.19:0/1983305581 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:58.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.981+0000 7f860d44a640 1 --2- 172.21.15.19:0/1983305581 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8608101c20 0x7f8608103000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:58.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.981+0000 7f860dc4b640 1 -- 172.21.15.19:0/1983305581 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f86081025e0 msgr2=0x7f8608103540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:58.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.981+0000 7f860e44c640 1 --2- 172.21.15.19:0/1983305581 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f86081025e0 0x7f8608103540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:58.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.981+0000 7f860dc4b640 1 --2- 172.21.15.19:0/1983305581 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f86081025e0 0x7f8608103540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.981+0000 7f860dc4b640 1 -- 172.21.15.19:0/1983305581 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8608101c20 msgr2=0x7f8608103000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:58.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.981+0000 7f860dc4b640 1 --2- 172.21.15.19:0/1983305581 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8608101c20 0x7f8608103000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:58.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.981+0000 7f860dc4b640 1 -- 172.21.15.19:0/1983305581 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8608103dd0 con 0x7f8608100a30 2024-09-19T09:04:58.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.981+0000 7f860dc4b640 1 --2- 172.21.15.19:0/1983305581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8608100a30 0x7f86081049c0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f860400d770 tx=0x7f860400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:58.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.982+0000 7f85feffd640 1 -- 172.21.15.19:0/1983305581 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8604017070 con 0x7f8608100a30 2024-09-19T09:04:58.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.982+0000 7f85feffd640 1 -- 172.21.15.19:0/1983305581 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f8604009c30 con 0x7f8608100a30 2024-09-19T09:04:58.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.982+0000 7f860feaf640 1 -- 172.21.15.19:0/1983305581 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86081a1fe0 con 0x7f8608100a30 2024-09-19T09:04:58.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.982+0000 7f85feffd640 1 -- 172.21.15.19:0/1983305581 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8604003dd0 con 0x7f8608100a30 2024-09-19T09:04:58.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.982+0000 7f860feaf640 1 -- 172.21.15.19:0/1983305581 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86081a24a0 con 0x7f8608100a30 2024-09-19T09:04:58.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.983+0000 7f860feaf640 1 -- 172.21.15.19:0/1983305581 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86081a2760 con 0x7f8608100a30 2024-09-19T09:04:58.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.984+0000 7f85feffd640 1 -- 172.21.15.19:0/1983305581 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f8604003fb0 con 0x7f8608100a30 2024-09-19T09:04:58.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.985+0000 7f85feffd640 1 --2- 172.21.15.19:0/1983305581 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f85f40a32d0 0x7f85f40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:58.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.985+0000 7f860d44a640 1 --2- 172.21.15.19:0/1983305581 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f85f40a32d0 0x7f85f40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:58.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.985+0000 7f85feffd640 1 -- 172.21.15.19:0/1983305581 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f86040cf340 con 0x7f8608100a30 2024-09-19T09:04:58.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.985+0000 7f860d44a640 1 --2- 172.21.15.19:0/1983305581 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f85f40a32d0 0x7f85f40a5790 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8608104730 tx=0x7f85f800b590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:58.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:58.989+0000 7f85feffd640 1 -- 172.21.15.19:0/1983305581 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8604009de0 con 0x7f8608100a30 2024-09-19T09:04:59.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.169+0000 7f860feaf640 1 -- 172.21.15.19:0/1983305581 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f86081a29d0 con 0x7f8608100a30 2024-09-19T09:04:59.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.169+0000 7f85feffd640 1 -- 172.21.15.19:0/1983305581 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) ==== 93+0+10 (secure 0 0 0) 0x7f860409c070 con 0x7f8608100a30 2024-09-19T09:04:59.170 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 1 2024-09-19T09:04:59.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.171+0000 7f860feaf640 1 -- 172.21.15.19:0/1983305581 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f85f40a32d0 msgr2=0x7f85f40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:59.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.171+0000 7f860feaf640 1 --2- 172.21.15.19:0/1983305581 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f85f40a32d0 0x7f85f40a5790 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8608104730 tx=0x7f85f800b590 comp rx=0 tx=0).stop 2024-09-19T09:04:59.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.171+0000 7f860feaf640 1 -- 172.21.15.19:0/1983305581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8608100a30 msgr2=0x7f86081049c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:59.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.171+0000 7f860feaf640 1 --2- 172.21.15.19:0/1983305581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8608100a30 0x7f86081049c0 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f860400d770 tx=0x7f860400dc30 comp rx=0 tx=0).stop 2024-09-19T09:04:59.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.171+0000 7f860feaf640 1 -- 172.21.15.19:0/1983305581 shutdown_connections 2024-09-19T09:04:59.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.171+0000 7f860feaf640 1 --2- 172.21.15.19:0/1983305581 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f85f40a32d0 0x7f85f40a5790 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:59.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.171+0000 7f860feaf640 1 --2- 172.21.15.19:0/1983305581 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f86081025e0 0x7f8608103540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:59.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.171+0000 7f860feaf640 1 --2- 172.21.15.19:0/1983305581 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f8608101c20 0x7f8608103000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:59.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.171+0000 7f860feaf640 1 --2- 172.21.15.19:0/1983305581 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f8608100a30 0x7f86081049c0 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:59.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.171+0000 7f860feaf640 1 -- 172.21.15.19:0/1983305581 >> 172.21.15.19:0/1983305581 conn(0x7f86080fc1b0 msgr2=0x7f860806a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:59.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.171+0000 7f860feaf640 1 -- 172.21.15.19:0/1983305581 shutdown_connections 2024-09-19T09:04:59.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.171+0000 7f860feaf640 1 -- 172.21.15.19:0/1983305581 wait complete. 2024-09-19T09:04:59.183 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T09:04:59.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.289+0000 7f7abc5ed640 1 -- 172.21.15.19:0/2660140332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ab4107870 msgr2=0x7f7ab4109c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:59.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.289+0000 7f7abc5ed640 1 --2- 172.21.15.19:0/2660140332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ab4107870 0x7f7ab4109c80 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f7aac009ca0 tx=0x7f7aac02a8c0 comp rx=0 tx=0).stop 2024-09-19T09:04:59.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.289+0000 7f7abc5ed640 1 -- 172.21.15.19:0/2660140332 shutdown_connections 2024-09-19T09:04:59.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.289+0000 7f7abc5ed640 1 --2- 172.21.15.19:0/2660140332 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ab4104f40 0x7f7ab4107330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:59.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.289+0000 7f7abc5ed640 1 --2- 172.21.15.19:0/2660140332 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ab4107870 0x7f7ab4109c80 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:59.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.289+0000 7f7abc5ed640 1 --2- 172.21.15.19:0/2660140332 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ab4102610 0x7f7ab4104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:59.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.289+0000 7f7abc5ed640 1 -- 172.21.15.19:0/2660140332 >> 172.21.15.19:0/2660140332 conn(0x7f7ab40fc1b0 msgr2=0x7f7ab40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:59.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.289+0000 7f7abc5ed640 1 -- 172.21.15.19:0/2660140332 shutdown_connections 2024-09-19T09:04:59.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.289+0000 7f7abc5ed640 1 -- 172.21.15.19:0/2660140332 wait complete. 2024-09-19T09:04:59.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.290+0000 7f7abc5ed640 1 Processor -- start 2024-09-19T09:04:59.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.290+0000 7f7abc5ed640 1 -- start start 2024-09-19T09:04:59.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.290+0000 7f7abc5ed640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ab4102610 0x7f7ab4101f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:59.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.290+0000 7f7abc5ed640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ab4104f40 0x7f7ab41005c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:59.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.290+0000 7f7abc5ed640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ab4107870 0x7f7ab4100b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:59.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.290+0000 7f7abc5ed640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab410d7d0 con 0x7f7ab4104f40 2024-09-19T09:04:59.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.290+0000 7f7abc5ed640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab410d650 con 0x7f7ab4102610 2024-09-19T09:04:59.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.290+0000 7f7abc5ed640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab410d950 con 0x7f7ab4107870 2024-09-19T09:04:59.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.290+0000 7f7ab9b88640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ab4104f40 0x7f7ab41005c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:59.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.290+0000 7f7ab9b88640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ab4104f40 0x7f7ab41005c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56970/0 (socket says 172.21.15.19:56970) 2024-09-19T09:04:59.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.290+0000 7f7ab9b88640 1 -- 172.21.15.19:0/2290051117 learned_addr learned my addr 172.21.15.19:0/2290051117 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:59.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.290+0000 7f7aba389640 1 --2- 172.21.15.19:0/2290051117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ab4102610 0x7f7ab4101f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:59.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.290+0000 7f7abab8a640 1 --2- 172.21.15.19:0/2290051117 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ab4107870 0x7f7ab4100b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:59.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.290+0000 7f7ab9b88640 1 -- 172.21.15.19:0/2290051117 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ab4107870 msgr2=0x7f7ab4100b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:59.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.290+0000 7f7ab9b88640 1 --2- 172.21.15.19:0/2290051117 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ab4107870 0x7f7ab4100b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:59.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.290+0000 7f7ab9b88640 1 -- 172.21.15.19:0/2290051117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ab4102610 msgr2=0x7f7ab4101f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:59.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.290+0000 7f7ab9b88640 1 --2- 172.21.15.19:0/2290051117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ab4102610 0x7f7ab4101f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:59.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.290+0000 7f7ab9b88640 1 -- 172.21.15.19:0/2290051117 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ab4101390 con 0x7f7ab4104f40 2024-09-19T09:04:59.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.291+0000 7f7ab9b88640 1 --2- 172.21.15.19:0/2290051117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ab4104f40 0x7f7ab41005c0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f7aa400d770 tx=0x7f7aa400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:59.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.291+0000 7f7aab7fe640 1 -- 172.21.15.19:0/2290051117 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4017070 con 0x7f7ab4104f40 2024-09-19T09:04:59.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.291+0000 7f7aab7fe640 1 -- 172.21.15.19:0/2290051117 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f7aa4009c30 con 0x7f7ab4104f40 2024-09-19T09:04:59.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.291+0000 7f7abc5ed640 1 -- 172.21.15.19:0/2290051117 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ab41a1fb0 con 0x7f7ab4104f40 2024-09-19T09:04:59.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.291+0000 7f7aab7fe640 1 -- 172.21.15.19:0/2290051117 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa400f620 con 0x7f7ab4104f40 2024-09-19T09:04:59.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.291+0000 7f7abc5ed640 1 -- 172.21.15.19:0/2290051117 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ab41a2470 con 0x7f7ab4104f40 2024-09-19T09:04:59.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.292+0000 7f7abc5ed640 1 -- 172.21.15.19:0/2290051117 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ab40fdca0 con 0x7f7ab4104f40 2024-09-19T09:04:59.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.293+0000 7f7aab7fe640 1 -- 172.21.15.19:0/2290051117 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f7aa401a070 con 0x7f7ab4104f40 2024-09-19T09:04:59.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.294+0000 7f7aab7fe640 1 --2- 172.21.15.19:0/2290051117 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7aa00a3250 0x7f7aa00a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:59.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.294+0000 7f7aab7fe640 1 -- 172.21.15.19:0/2290051117 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f7aa40cf460 con 0x7f7ab4104f40 2024-09-19T09:04:59.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.294+0000 7f7aba389640 1 --2- 172.21.15.19:0/2290051117 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7aa00a3250 0x7f7aa00a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:59.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.294+0000 7f7aba389640 1 --2- 172.21.15.19:0/2290051117 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7aa00a3250 0x7f7aa00a5710 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0009bd0 tx=0x7f7ab0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:59.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.298+0000 7f7aab7fe640 1 -- 172.21.15.19:0/2290051117 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7aa4009de0 con 0x7f7ab4104f40 2024-09-19T09:04:59.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.474+0000 7f7abc5ed640 1 -- 172.21.15.19:0/2290051117 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7ab4062df0 con 0x7f7ab4104f40 2024-09-19T09:04:59.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.474+0000 7f7aab7fe640 1 -- 172.21.15.19:0/2290051117 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) ==== 104+0+11 (secure 0 0 0) 0x7f7aa409c130 con 0x7f7ab4104f40 2024-09-19T09:04:59.475 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 32 2024-09-19T09:04:59.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.476+0000 7f7abc5ed640 1 -- 172.21.15.19:0/2290051117 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7aa00a3250 msgr2=0x7f7aa00a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:59.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.476+0000 7f7abc5ed640 1 --2- 172.21.15.19:0/2290051117 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7aa00a3250 0x7f7aa00a5710 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f7ab0009bd0 tx=0x7f7ab0005f90 comp rx=0 tx=0).stop 2024-09-19T09:04:59.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.476+0000 7f7abc5ed640 1 -- 172.21.15.19:0/2290051117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ab4104f40 msgr2=0x7f7ab41005c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:59.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.476+0000 7f7abc5ed640 1 --2- 172.21.15.19:0/2290051117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ab4104f40 0x7f7ab41005c0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f7aa400d770 tx=0x7f7aa400dc30 comp rx=0 tx=0).stop 2024-09-19T09:04:59.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.476+0000 7f7abc5ed640 1 -- 172.21.15.19:0/2290051117 shutdown_connections 2024-09-19T09:04:59.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.476+0000 7f7abc5ed640 1 --2- 172.21.15.19:0/2290051117 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f7aa00a3250 0x7f7aa00a5710 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:59.478 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.476+0000 7f7abc5ed640 1 --2- 172.21.15.19:0/2290051117 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ab4107870 0x7f7ab4100b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:59.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.476+0000 7f7abc5ed640 1 --2- 172.21.15.19:0/2290051117 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f7ab4104f40 0x7f7ab41005c0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:59.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.476+0000 7f7abc5ed640 1 --2- 172.21.15.19:0/2290051117 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f7ab4102610 0x7f7ab4101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:59.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.476+0000 7f7abc5ed640 1 -- 172.21.15.19:0/2290051117 >> 172.21.15.19:0/2290051117 conn(0x7f7ab40fc1b0 msgr2=0x7f7ab4102eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:59.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.476+0000 7f7abc5ed640 1 -- 172.21.15.19:0/2290051117 shutdown_connections 2024-09-19T09:04:59.479 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.476+0000 7f7abc5ed640 1 -- 172.21.15.19:0/2290051117 wait complete. 2024-09-19T09:04:59.488 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T09:04:59.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.594+0000 7f5e4c16d640 1 -- 172.21.15.19:0/372565887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e44100a00 msgr2=0x7f5e44100e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:59.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.594+0000 7f5e4c16d640 1 --2- 172.21.15.19:0/372565887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e44100a00 0x7f5e44100e00 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f5e40009900 tx=0x7f5e4002a410 comp rx=0 tx=0).stop 2024-09-19T09:04:59.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.594+0000 7f5e4c16d640 1 -- 172.21.15.19:0/372565887 shutdown_connections 2024-09-19T09:04:59.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.594+0000 7f5e4c16d640 1 --2- 172.21.15.19:0/372565887 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e441025b0 0x7f5e44108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:59.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.594+0000 7f5e4c16d640 1 --2- 172.21.15.19:0/372565887 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e44101bf0 0x7f5e44102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:59.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.594+0000 7f5e4c16d640 1 --2- 172.21.15.19:0/372565887 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e44100a00 0x7f5e44100e00 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:59.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.594+0000 7f5e4c16d640 1 -- 172.21.15.19:0/372565887 >> 172.21.15.19:0/372565887 conn(0x7f5e440fc140 msgr2=0x7f5e440fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:59.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.594+0000 7f5e4c16d640 1 -- 172.21.15.19:0/372565887 shutdown_connections 2024-09-19T09:04:59.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.594+0000 7f5e4c16d640 1 -- 172.21.15.19:0/372565887 wait complete. 2024-09-19T09:04:59.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.594+0000 7f5e4c16d640 1 Processor -- start 2024-09-19T09:04:59.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.594+0000 7f5e4c16d640 1 -- start start 2024-09-19T09:04:59.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.595+0000 7f5e4c16d640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e44100a00 0x7f5e4410b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:59.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.595+0000 7f5e4c16d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e44101bf0 0x7f5e441099c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:59.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.595+0000 7f5e4c16d640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e441025b0 0x7f5e44109f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:59.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.595+0000 7f5e4c16d640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4410d830 con 0x7f5e44101bf0 2024-09-19T09:04:59.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.595+0000 7f5e4c16d640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4410d6b0 con 0x7f5e44100a00 2024-09-19T09:04:59.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.595+0000 7f5e4c16d640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4410d9b0 con 0x7f5e441025b0 2024-09-19T09:04:59.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.595+0000 7f5e49708640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e44101bf0 0x7f5e441099c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:59.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.595+0000 7f5e49708640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e44101bf0 0x7f5e441099c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:56988/0 (socket says 172.21.15.19:56988) 2024-09-19T09:04:59.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.595+0000 7f5e49708640 1 -- 172.21.15.19:0/2307332408 learned_addr learned my addr 172.21.15.19:0/2307332408 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:59.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.595+0000 7f5e4a70a640 1 --2- 172.21.15.19:0/2307332408 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e441025b0 0x7f5e44109f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:59.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.595+0000 7f5e49f09640 1 --2- 172.21.15.19:0/2307332408 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e44100a00 0x7f5e4410b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:59.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.595+0000 7f5e49708640 1 -- 172.21.15.19:0/2307332408 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e441025b0 msgr2=0x7f5e44109f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:59.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.595+0000 7f5e49708640 1 --2- 172.21.15.19:0/2307332408 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e441025b0 0x7f5e44109f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:59.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.595+0000 7f5e49708640 1 -- 172.21.15.19:0/2307332408 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e44100a00 msgr2=0x7f5e4410b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:59.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.595+0000 7f5e49708640 1 --2- 172.21.15.19:0/2307332408 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e44100a00 0x7f5e4410b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:59.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.595+0000 7f5e49708640 1 -- 172.21.15.19:0/2307332408 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e4410a790 con 0x7f5e44101bf0 2024-09-19T09:04:59.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.595+0000 7f5e49f09640 1 --2- 172.21.15.19:0/2307332408 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e44100a00 0x7f5e4410b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T09:04:59.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.595+0000 7f5e49708640 1 --2- 172.21.15.19:0/2307332408 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e44101bf0 0x7f5e441099c0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f5e3400d950 tx=0x7f5e3400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:59.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.595+0000 7f5e3affd640 1 -- 172.21.15.19:0/2307332408 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e34017070 con 0x7f5e44101bf0 2024-09-19T09:04:59.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.595+0000 7f5e3affd640 1 -- 172.21.15.19:0/2307332408 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f5e34009c30 con 0x7f5e44101bf0 2024-09-19T09:04:59.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.595+0000 7f5e3affd640 1 -- 172.21.15.19:0/2307332408 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3400f6b0 con 0x7f5e44101bf0 2024-09-19T09:04:59.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.595+0000 7f5e4c16d640 1 -- 172.21.15.19:0/2307332408 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e441a1fd0 con 0x7f5e44101bf0 2024-09-19T09:04:59.601 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.595+0000 7f5e4c16d640 1 -- 172.21.15.19:0/2307332408 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e441a2430 con 0x7f5e44101bf0 2024-09-19T09:04:59.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.596+0000 7f5e4c16d640 1 -- 172.21.15.19:0/2307332408 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e44107e30 con 0x7f5e44101bf0 2024-09-19T09:04:59.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.597+0000 7f5e3affd640 1 -- 172.21.15.19:0/2307332408 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f5e340109d0 con 0x7f5e44101bf0 2024-09-19T09:04:59.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.598+0000 7f5e3affd640 1 --2- 172.21.15.19:0/2307332408 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5e300a3250 0x7f5e300a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:59.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.598+0000 7f5e3affd640 1 -- 172.21.15.19:0/2307332408 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f5e340cf580 con 0x7f5e44101bf0 2024-09-19T09:04:59.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.598+0000 7f5e49f09640 1 --2- 172.21.15.19:0/2307332408 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5e300a3250 0x7f5e300a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:59.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.599+0000 7f5e49f09640 1 --2- 172.21.15.19:0/2307332408 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5e300a3250 0x7f5e300a5710 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5e4002a930 tx=0x7f5e40000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:59.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.602+0000 7f5e3affd640 1 -- 172.21.15.19:0/2307332408 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5e34009de0 con 0x7f5e44101bf0 2024-09-19T09:04:59.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.779+0000 7f5e4c16d640 1 -- 172.21.15.19:0/2307332408 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5e44062f30 con 0x7f5e44101bf0 2024-09-19T09:04:59.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.780+0000 7f5e3affd640 1 -- 172.21.15.19:0/2307332408 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) ==== 100+0+11 (secure 0 0 0) 0x7f5e3409c2b0 con 0x7f5e44101bf0 2024-09-19T09:04:59.781 INFO:teuthology.orchestra.run.smithi019.stdout:pg_num: 64 2024-09-19T09:04:59.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.781+0000 7f5e4c16d640 1 -- 172.21.15.19:0/2307332408 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5e300a3250 msgr2=0x7f5e300a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:59.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.781+0000 7f5e4c16d640 1 --2- 172.21.15.19:0/2307332408 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5e300a3250 0x7f5e300a5710 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f5e4002a930 tx=0x7f5e40000bc0 comp rx=0 tx=0).stop 2024-09-19T09:04:59.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.781+0000 7f5e4c16d640 1 -- 172.21.15.19:0/2307332408 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e44101bf0 msgr2=0x7f5e441099c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:59.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.781+0000 7f5e4c16d640 1 --2- 172.21.15.19:0/2307332408 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e44101bf0 0x7f5e441099c0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f5e3400d950 tx=0x7f5e3400de10 comp rx=0 tx=0).stop 2024-09-19T09:04:59.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.782+0000 7f5e4c16d640 1 -- 172.21.15.19:0/2307332408 shutdown_connections 2024-09-19T09:04:59.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.782+0000 7f5e4c16d640 1 --2- 172.21.15.19:0/2307332408 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f5e300a3250 0x7f5e300a5710 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:59.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.782+0000 7f5e4c16d640 1 --2- 172.21.15.19:0/2307332408 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e441025b0 0x7f5e44109f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:59.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.782+0000 7f5e4c16d640 1 --2- 172.21.15.19:0/2307332408 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f5e44101bf0 0x7f5e441099c0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:59.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.782+0000 7f5e4c16d640 1 --2- 172.21.15.19:0/2307332408 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f5e44100a00 0x7f5e4410b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:59.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.782+0000 7f5e4c16d640 1 -- 172.21.15.19:0/2307332408 >> 172.21.15.19:0/2307332408 conn(0x7f5e440fc140 msgr2=0x7f5e44105000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:59.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.782+0000 7f5e4c16d640 1 -- 172.21.15.19:0/2307332408 shutdown_connections 2024-09-19T09:04:59.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.782+0000 7f5e4c16d640 1 -- 172.21.15.19:0/2307332408 wait complete. 2024-09-19T09:04:59.792 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:59 smithi019 ceph-mon[30976]: pgmap v726: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-09-19T09:04:59.793 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:59 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/2477925889' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:04:59.793 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:59 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1983305581' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:04:59.793 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:04:59 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/2290051117' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:04:59.794 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-19T09:04:59.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.896+0000 7fd76de5e640 1 -- 172.21.15.19:0/1460532397 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd768101b30 msgr2=0x7fd768101f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:59.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.896+0000 7fd76de5e640 1 --2- 172.21.15.19:0/1460532397 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd768101b30 0x7fd768101f30 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fd758009900 tx=0x7fd75802a410 comp rx=0 tx=0).stop 2024-09-19T09:04:59.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.897+0000 7fd76de5e640 1 -- 172.21.15.19:0/1460532397 shutdown_connections 2024-09-19T09:04:59.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.897+0000 7fd76de5e640 1 --2- 172.21.15.19:0/1460532397 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd7681036e0 0x7fd768109f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:59.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.897+0000 7fd76de5e640 1 --2- 172.21.15.19:0/1460532397 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd768102d20 0x7fd7681031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:59.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.897+0000 7fd76de5e640 1 --2- 172.21.15.19:0/1460532397 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd768101b30 0x7fd768101f30 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:59.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.897+0000 7fd76de5e640 1 -- 172.21.15.19:0/1460532397 >> 172.21.15.19:0/1460532397 conn(0x7fd7680fd2b0 msgr2=0x7fd7680ff6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:04:59.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.897+0000 7fd76de5e640 1 -- 172.21.15.19:0/1460532397 shutdown_connections 2024-09-19T09:04:59.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.897+0000 7fd76de5e640 1 -- 172.21.15.19:0/1460532397 wait complete. 2024-09-19T09:04:59.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.897+0000 7fd76de5e640 1 Processor -- start 2024-09-19T09:04:59.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.897+0000 7fd76de5e640 1 -- start start 2024-09-19T09:04:59.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.897+0000 7fd76de5e640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd768101b30 0x7fd768197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:59.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.897+0000 7fd76de5e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd768102d20 0x7fd768198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:59.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.897+0000 7fd76de5e640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7681036e0 0x7fd76819f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:59.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.897+0000 7fd76de5e640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fd76810d7b0 con 0x7fd768102d20 2024-09-19T09:04:59.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.897+0000 7fd76de5e640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fd76810d630 con 0x7fd7681036e0 2024-09-19T09:04:59.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.897+0000 7fd76de5e640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd76810d930 con 0x7fd768101b30 2024-09-19T09:04:59.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.898+0000 7fd766ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd768102d20 0x7fd768198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:59.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.898+0000 7fd766ffd640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd768102d20 0x7fd768198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:57004/0 (socket says 172.21.15.19:57004) 2024-09-19T09:04:59.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.898+0000 7fd766ffd640 1 -- 172.21.15.19:0/2370951160 learned_addr learned my addr 172.21.15.19:0/2370951160 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:04:59.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.898+0000 7fd7677fe640 1 --2- 172.21.15.19:0/2370951160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd768101b30 0x7fd768197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:59.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.898+0000 7fd767fff640 1 --2- 172.21.15.19:0/2370951160 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7681036e0 0x7fd76819f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:59.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.898+0000 7fd766ffd640 1 -- 172.21.15.19:0/2370951160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd768101b30 msgr2=0x7fd768197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:59.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.898+0000 7fd766ffd640 1 --2- 172.21.15.19:0/2370951160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd768101b30 0x7fd768197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:59.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.898+0000 7fd766ffd640 1 -- 172.21.15.19:0/2370951160 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7681036e0 msgr2=0x7fd76819f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:04:59.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.898+0000 7fd766ffd640 1 --2- 172.21.15.19:0/2370951160 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7681036e0 0x7fd76819f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:04:59.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.898+0000 7fd766ffd640 1 -- 172.21.15.19:0/2370951160 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd76819fa20 con 0x7fd768102d20 2024-09-19T09:04:59.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.898+0000 7fd766ffd640 1 --2- 172.21.15.19:0/2370951160 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd768102d20 0x7fd768198340 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fd75000c920 tx=0x7fd75000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:59.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.898+0000 7fd764ff9640 1 -- 172.21.15.19:0/2370951160 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd750007c70 con 0x7fd768102d20 2024-09-19T09:04:59.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.898+0000 7fd764ff9640 1 -- 172.21.15.19:0/2370951160 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fd750007e10 con 0x7fd768102d20 2024-09-19T09:04:59.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.898+0000 7fd76de5e640 1 -- 172.21.15.19:0/2370951160 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd76819fd10 con 0x7fd768102d20 2024-09-19T09:04:59.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.898+0000 7fd764ff9640 1 -- 172.21.15.19:0/2370951160 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd750018890 con 0x7fd768102d20 2024-09-19T09:04:59.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.898+0000 7fd76de5e640 1 -- 172.21.15.19:0/2370951160 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7681a0200 con 0x7fd768102d20 2024-09-19T09:04:59.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.899+0000 7fd76de5e640 1 -- 172.21.15.19:0/2370951160 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd768108ea0 con 0x7fd768102d20 2024-09-19T09:04:59.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.900+0000 7fd764ff9640 1 -- 172.21.15.19:0/2370951160 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fd750018a70 con 0x7fd768102d20 2024-09-19T09:04:59.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.901+0000 7fd764ff9640 1 --2- 172.21.15.19:0/2370951160 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd7540a3250 0x7fd7540a5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:04:59.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.901+0000 7fd764ff9640 1 -- 172.21.15.19:0/2370951160 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7fd7500cfa50 con 0x7fd768102d20 2024-09-19T09:04:59.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.901+0000 7fd7677fe640 1 --2- 172.21.15.19:0/2370951160 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd7540a3250 0x7fd7540a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:04:59.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.902+0000 7fd7677fe640 1 --2- 172.21.15.19:0/2370951160 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd7540a3250 0x7fd7540a5710 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd758005ab0 tx=0x7fd758000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:04:59.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:04:59.905+0000 7fd764ff9640 1 -- 172.21.15.19:0/2370951160 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd750014030 con 0x7fd768102d20 2024-09-19T09:04:59.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:59 smithi203 ceph-mon[35450]: pgmap v726: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-09-19T09:04:59.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:59 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/2477925889' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:04:59.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:59 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1983305581' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:04:59.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:04:59 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/2290051117' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:05:00.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:00.132+0000 7fd76de5e640 1 -- 172.21.15.19:0/2370951160 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7fd768062e90 con 0x7fd768102d20 2024-09-19T09:05:00.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:00.140+0000 7fd764ff9640 1 -- 172.21.15.19:0/2370951160 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v20) ==== 81+0+742339 (secure 0 0 0) 0x7fd75009c780 con 0x7fd768102d20 2024-09-19T09:05:00.155 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T09:05:00.156 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T09:05:00.156 INFO:teuthology.orchestra.run.smithi019.stdout: "epoch": 20, 2024-09-19T09:05:00.156 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.156 INFO:teuthology.orchestra.run.smithi019.stdout: "active_gid": 14150, 2024-09-19T09:05:00.156 INFO:teuthology.orchestra.run.smithi019.stdout: "active_name": "x", 2024-09-19T09:05:00.156 INFO:teuthology.orchestra.run.smithi019.stdout: "active_addrs": { 2024-09-19T09:05:00.156 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-19T09:05:00.157 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.157 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-19T09:05:00.157 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6800", 2024-09-19T09:05:00.157 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1181234346 2024-09-19T09:05:00.157 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.157 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.157 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v1", 2024-09-19T09:05:00.157 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:6801", 2024-09-19T09:05:00.157 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1181234346 2024-09-19T09:05:00.158 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.158 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-19T09:05:00.158 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.158 INFO:teuthology.orchestra.run.smithi019.stdout: "active_addr": "172.21.15.19:6801/1181234346", 2024-09-19T09:05:00.158 INFO:teuthology.orchestra.run.smithi019.stdout: "active_change": "2024-09-19T08:43:21.732368+0000", 2024-09-19T09:05:00.158 INFO:teuthology.orchestra.run.smithi019.stdout: "active_mgr_features": 4540701547738038271, 2024-09-19T09:05:00.158 INFO:teuthology.orchestra.run.smithi019.stdout: "available": true, 2024-09-19T09:05:00.158 INFO:teuthology.orchestra.run.smithi019.stdout: "standbys": [ 2024-09-19T09:05:00.159 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.159 INFO:teuthology.orchestra.run.smithi019.stdout: "gid": 24109, 2024-09-19T09:05:00.159 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "z", 2024-09-19T09:05:00.159 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_features": 4540701547738038271, 2024-09-19T09:05:00.159 INFO:teuthology.orchestra.run.smithi019.stdout: "available_modules": [ 2024-09-19T09:05:00.159 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.159 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "alerts", 2024-09-19T09:05:00.159 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:00.159 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:00.160 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:00.160 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-19T09:05:00.160 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-19T09:05:00.160 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:00.160 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.160 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.160 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-19T09:05:00.160 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.161 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.161 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.161 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T09:05:00.161 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.161 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.161 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.161 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.161 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:00.162 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:00.162 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.162 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.162 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.162 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.162 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.162 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.162 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.162 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.163 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.163 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.163 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.163 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.163 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.163 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.163 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.163 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.164 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.164 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.164 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.164 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:00.164 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:00.164 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.164 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.164 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.164 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.165 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.165 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.165 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.165 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.165 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.165 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.165 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.166 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.166 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:00.166 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:00.166 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.166 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.166 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.166 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:00.166 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.167 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.167 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.167 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.167 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.167 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.167 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.167 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.168 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.168 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.168 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.168 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.168 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.168 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.168 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.169 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:00.169 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:00.169 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.169 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.169 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.169 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.169 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.169 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.169 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.170 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.170 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.170 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.170 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.170 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.170 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_destination": { 2024-09-19T09:05:00.170 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_destination", 2024-09-19T09:05:00.170 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.170 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.171 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.171 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.171 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.171 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.171 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.171 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Email address to send alerts to", 2024-09-19T09:05:00.171 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.171 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.172 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.172 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.172 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_from_name": { 2024-09-19T09:05:00.172 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_from_name", 2024-09-19T09:05:00.172 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.172 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.172 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.172 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "Ceph", 2024-09-19T09:05:00.173 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.173 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.173 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.173 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Email From: name", 2024-09-19T09:05:00.173 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.173 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.173 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.173 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.173 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_host": { 2024-09-19T09:05:00.174 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_host", 2024-09-19T09:05:00.174 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.174 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.174 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.174 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.174 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.174 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.174 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.175 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "SMTP server", 2024-09-19T09:05:00.175 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.175 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.175 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.175 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.175 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_password": { 2024-09-19T09:05:00.175 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_password", 2024-09-19T09:05:00.175 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.175 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.176 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.176 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.176 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.176 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.176 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.176 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Password to authenticate with", 2024-09-19T09:05:00.176 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.177 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.177 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.177 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.177 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_port": { 2024-09-19T09:05:00.177 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_port", 2024-09-19T09:05:00.177 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.177 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.177 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.177 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "465", 2024-09-19T09:05:00.178 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.178 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.178 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.178 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "SMTP port", 2024-09-19T09:05:00.178 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.178 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.178 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.178 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.179 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_sender": { 2024-09-19T09:05:00.179 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_sender", 2024-09-19T09:05:00.179 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.179 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.179 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.179 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.179 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.179 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.180 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.180 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "SMTP envelope sender", 2024-09-19T09:05:00.180 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.180 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.180 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.180 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.180 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_ssl": { 2024-09-19T09:05:00.181 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_ssl", 2024-09-19T09:05:00.181 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.181 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.181 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.181 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.181 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.181 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.182 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.182 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T09:05:00.182 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.182 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.182 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.182 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.182 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_user": { 2024-09-19T09:05:00.182 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_user", 2024-09-19T09:05:00.183 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.183 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.183 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.183 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.183 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.183 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.183 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.183 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "User to authenticate as", 2024-09-19T09:05:00.183 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.184 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.184 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.184 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.184 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.184 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.184 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.184 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "balancer", 2024-09-19T09:05:00.185 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:00.185 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:00.185 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:00.185 INFO:teuthology.orchestra.run.smithi019.stdout: "active": { 2024-09-19T09:05:00.185 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "active", 2024-09-19T09:05:00.185 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.185 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.185 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.186 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.186 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.186 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.186 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.186 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T09:05:00.186 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.186 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.186 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.186 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.187 INFO:teuthology.orchestra.run.smithi019.stdout: "begin_time": { 2024-09-19T09:05:00.187 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "begin_time", 2024-09-19T09:05:00.187 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.187 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.187 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.187 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0000", 2024-09-19T09:05:00.187 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.187 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.188 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.188 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T09:05:00.188 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:05:00.188 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.188 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.188 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.188 INFO:teuthology.orchestra.run.smithi019.stdout: "begin_weekday": { 2024-09-19T09:05:00.188 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "begin_weekday", 2024-09-19T09:05:00.189 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-19T09:05:00.189 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.189 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.189 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-19T09:05:00.189 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "0", 2024-09-19T09:05:00.189 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "6", 2024-09-19T09:05:00.189 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.189 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T09:05:00.190 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:05:00.190 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.190 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.190 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.190 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_compat_max_iterations": { 2024-09-19T09:05:00.190 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crush_compat_max_iterations", 2024-09-19T09:05:00.190 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-19T09:05:00.190 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.191 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.191 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "25", 2024-09-19T09:05:00.191 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1", 2024-09-19T09:05:00.191 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "250", 2024-09-19T09:05:00.191 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.191 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T09:05:00.191 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.191 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.192 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.192 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.192 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_compat_metrics": { 2024-09-19T09:05:00.192 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crush_compat_metrics", 2024-09-19T09:05:00.192 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.192 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.192 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.192 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T09:05:00.193 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.193 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.193 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.193 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T09:05:00.193 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T09:05:00.193 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.193 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.193 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.194 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_compat_step": { 2024-09-19T09:05:00.194 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crush_compat_step", 2024-09-19T09:05:00.194 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-19T09:05:00.194 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.194 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.194 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0.5", 2024-09-19T09:05:00.194 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "0.001", 2024-09-19T09:05:00.194 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "0.999", 2024-09-19T09:05:00.194 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.195 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "aggressiveness of optimization", 2024-09-19T09:05:00.195 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T09:05:00.195 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.195 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.195 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.195 INFO:teuthology.orchestra.run.smithi019.stdout: "end_time": { 2024-09-19T09:05:00.195 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "end_time", 2024-09-19T09:05:00.196 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.196 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.196 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.196 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "2359", 2024-09-19T09:05:00.196 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.196 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.196 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.196 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T09:05:00.196 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:05:00.197 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.197 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.197 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.197 INFO:teuthology.orchestra.run.smithi019.stdout: "end_weekday": { 2024-09-19T09:05:00.197 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "end_weekday", 2024-09-19T09:05:00.197 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-19T09:05:00.197 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.198 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.198 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-19T09:05:00.198 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "0", 2024-09-19T09:05:00.198 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "6", 2024-09-19T09:05:00.198 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.198 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T09:05:00.198 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:05:00.198 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.199 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.199 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.199 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:00.199 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:00.199 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.199 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.199 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.199 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.199 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.200 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.200 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.200 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.200 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.200 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.200 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.200 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.200 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.201 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.201 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.201 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.201 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.201 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.201 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.201 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:00.201 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:00.201 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.202 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.202 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.202 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.202 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.202 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.202 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.202 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.203 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.203 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.203 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.203 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.203 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:00.203 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:00.204 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.204 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.204 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.204 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:00.204 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.204 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.204 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.204 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.205 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.205 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.205 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.205 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.205 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.205 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.205 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.205 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.206 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.206 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.206 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.206 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:00.206 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:00.206 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.206 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.206 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.207 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.207 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.207 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.207 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.207 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.207 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.207 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.207 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.207 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.208 INFO:teuthology.orchestra.run.smithi019.stdout: "min_score": { 2024-09-19T09:05:00.208 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "min_score", 2024-09-19T09:05:00.208 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-19T09:05:00.208 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.208 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.208 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-19T09:05:00.208 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.208 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.209 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.209 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T09:05:00.209 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.209 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.209 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.209 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.209 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": { 2024-09-19T09:05:00.209 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mode", 2024-09-19T09:05:00.210 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.210 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.210 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.210 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "upmap", 2024-09-19T09:05:00.210 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.210 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.210 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.210 INFO:teuthology.orchestra.run.smithi019.stdout: "crush-compat", 2024-09-19T09:05:00.211 INFO:teuthology.orchestra.run.smithi019.stdout: "none", 2024-09-19T09:05:00.211 INFO:teuthology.orchestra.run.smithi019.stdout: "read", 2024-09-19T09:05:00.211 INFO:teuthology.orchestra.run.smithi019.stdout: "upmap", 2024-09-19T09:05:00.211 INFO:teuthology.orchestra.run.smithi019.stdout: "upmap-read" 2024-09-19T09:05:00.211 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.211 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Balancer mode", 2024-09-19T09:05:00.211 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.211 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.211 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.212 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.212 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_ids": { 2024-09-19T09:05:00.212 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "pool_ids", 2024-09-19T09:05:00.212 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.212 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.212 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.212 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.212 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.213 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.213 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.213 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T09:05:00.213 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.213 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.213 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.213 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.213 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-19T09:05:00.214 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-19T09:05:00.214 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:00.214 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.214 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.214 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-19T09:05:00.214 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.214 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.214 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.215 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T09:05:00.215 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.215 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.215 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.215 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.215 INFO:teuthology.orchestra.run.smithi019.stdout: "upmap_max_deviation": { 2024-09-19T09:05:00.215 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "upmap_max_deviation", 2024-09-19T09:05:00.215 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.216 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.216 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.216 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-19T09:05:00.216 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1", 2024-09-19T09:05:00.216 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.216 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.216 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T09:05:00.216 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T09:05:00.216 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.217 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.217 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.217 INFO:teuthology.orchestra.run.smithi019.stdout: "upmap_max_optimizations": { 2024-09-19T09:05:00.217 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "upmap_max_optimizations", 2024-09-19T09:05:00.217 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-19T09:05:00.217 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.217 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.217 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-19T09:05:00.218 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.218 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.218 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.218 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T09:05:00.218 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.218 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.218 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.219 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.219 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.219 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.219 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.219 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cephadm", 2024-09-19T09:05:00.219 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:00.219 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:00.219 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:00.220 INFO:teuthology.orchestra.run.smithi019.stdout: "agent_down_multiplier": { 2024-09-19T09:05:00.220 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "agent_down_multiplier", 2024-09-19T09:05:00.220 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-19T09:05:00.220 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.220 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.220 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "3.0", 2024-09-19T09:05:00.220 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.220 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.221 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.221 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T09:05:00.221 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.221 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.221 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.221 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.221 INFO:teuthology.orchestra.run.smithi019.stdout: "agent_refresh_rate": { 2024-09-19T09:05:00.221 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "agent_refresh_rate", 2024-09-19T09:05:00.222 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:00.222 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.222 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.222 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "20", 2024-09-19T09:05:00.222 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.222 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.222 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.222 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T09:05:00.223 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.223 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.223 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.223 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.223 INFO:teuthology.orchestra.run.smithi019.stdout: "agent_starting_port": { 2024-09-19T09:05:00.223 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "agent_starting_port", 2024-09-19T09:05:00.223 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.223 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.224 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.224 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "4721", 2024-09-19T09:05:00.224 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.224 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.224 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.224 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T09:05:00.225 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.225 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.225 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.225 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.225 INFO:teuthology.orchestra.run.smithi019.stdout: "allow_ptrace": { 2024-09-19T09:05:00.225 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "allow_ptrace", 2024-09-19T09:05:00.225 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.225 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.226 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.226 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.226 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.226 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.226 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.226 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T09:05:00.226 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T09:05:00.226 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.226 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.227 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.227 INFO:teuthology.orchestra.run.smithi019.stdout: "autotune_interval": { 2024-09-19T09:05:00.227 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "autotune_interval", 2024-09-19T09:05:00.227 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:00.227 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.227 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.227 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-19T09:05:00.227 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.228 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.228 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.228 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T09:05:00.228 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.228 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.228 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.228 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.228 INFO:teuthology.orchestra.run.smithi019.stdout: "autotune_memory_target_ratio": { 2024-09-19T09:05:00.229 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T09:05:00.229 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-19T09:05:00.229 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.229 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.229 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0.7", 2024-09-19T09:05:00.229 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.229 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.229 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.230 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T09:05:00.230 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.230 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.230 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.230 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.230 INFO:teuthology.orchestra.run.smithi019.stdout: "cephadm_log_destination": { 2024-09-19T09:05:00.230 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cephadm_log_destination", 2024-09-19T09:05:00.230 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.230 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.231 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.231 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.231 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.231 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.231 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.231 INFO:teuthology.orchestra.run.smithi019.stdout: "file", 2024-09-19T09:05:00.231 INFO:teuthology.orchestra.run.smithi019.stdout: "file,syslog", 2024-09-19T09:05:00.231 INFO:teuthology.orchestra.run.smithi019.stdout: "syslog" 2024-09-19T09:05:00.232 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.232 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T09:05:00.232 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.232 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.232 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.232 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.232 INFO:teuthology.orchestra.run.smithi019.stdout: "cgroups_split": { 2024-09-19T09:05:00.232 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cgroups_split", 2024-09-19T09:05:00.233 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.233 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.233 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.233 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.233 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.233 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.233 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.233 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T09:05:00.233 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.234 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.234 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.234 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.234 INFO:teuthology.orchestra.run.smithi019.stdout: "config_checks_enabled": { 2024-09-19T09:05:00.234 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "config_checks_enabled", 2024-09-19T09:05:00.234 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.234 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.234 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.235 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.235 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.235 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.235 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.235 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T09:05:00.235 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.235 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.235 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.236 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.236 INFO:teuthology.orchestra.run.smithi019.stdout: "config_dashboard": { 2024-09-19T09:05:00.236 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "config_dashboard", 2024-09-19T09:05:00.236 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.236 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.236 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.236 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.236 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.236 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.237 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.237 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T09:05:00.237 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.237 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.237 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.237 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.237 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_alertmanager": { 2024-09-19T09:05:00.237 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_alertmanager", 2024-09-19T09:05:00.238 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.238 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.238 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.238 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T09:05:00.238 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.238 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.238 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.238 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Prometheus container image", 2024-09-19T09:05:00.238 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.239 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.239 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.239 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.239 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_base": { 2024-09-19T09:05:00.239 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_base", 2024-09-19T09:05:00.239 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.239 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.239 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.240 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T09:05:00.240 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.240 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.240 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.240 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Container image name, without the tag", 2024-09-19T09:05:00.240 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.240 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.240 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.241 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.241 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_elasticsearch": { 2024-09-19T09:05:00.241 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_elasticsearch", 2024-09-19T09:05:00.241 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.241 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.241 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.241 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T09:05:00.241 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.241 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.242 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.242 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "elasticsearch container image", 2024-09-19T09:05:00.242 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.242 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.242 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.242 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.242 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_grafana": { 2024-09-19T09:05:00.242 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_grafana", 2024-09-19T09:05:00.243 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.243 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.243 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.243 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T09:05:00.243 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.243 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.243 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.243 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Prometheus container image", 2024-09-19T09:05:00.243 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.244 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.244 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.244 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.244 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_haproxy": { 2024-09-19T09:05:00.244 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_haproxy", 2024-09-19T09:05:00.244 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.244 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.244 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.245 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T09:05:00.245 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.245 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.245 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.245 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "HAproxy container image", 2024-09-19T09:05:00.245 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.245 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.246 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.246 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.246 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_jaeger_agent": { 2024-09-19T09:05:00.246 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_jaeger_agent", 2024-09-19T09:05:00.246 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.246 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.246 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.246 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T09:05:00.247 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.247 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.247 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.247 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Jaeger agent container image", 2024-09-19T09:05:00.247 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.247 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.247 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.247 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.247 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_jaeger_collector": { 2024-09-19T09:05:00.248 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_jaeger_collector", 2024-09-19T09:05:00.248 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.248 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.248 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.248 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T09:05:00.248 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.248 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.248 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.249 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Jaeger collector container image", 2024-09-19T09:05:00.249 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.249 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.249 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.249 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.249 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_jaeger_query": { 2024-09-19T09:05:00.249 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_jaeger_query", 2024-09-19T09:05:00.249 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.250 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.250 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.250 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T09:05:00.250 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.250 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.250 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.250 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Jaeger query container image", 2024-09-19T09:05:00.250 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.250 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.251 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.251 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.251 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_keepalived": { 2024-09-19T09:05:00.251 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_keepalived", 2024-09-19T09:05:00.251 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.251 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.251 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.251 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T09:05:00.252 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.252 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.252 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.252 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Keepalived container image", 2024-09-19T09:05:00.252 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.252 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.252 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.252 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.253 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_loki": { 2024-09-19T09:05:00.253 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_loki", 2024-09-19T09:05:00.253 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.253 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.253 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.253 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T09:05:00.253 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.253 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.254 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.254 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Loki container image", 2024-09-19T09:05:00.254 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.254 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.254 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.254 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.254 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_node_exporter": { 2024-09-19T09:05:00.254 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_node_exporter", 2024-09-19T09:05:00.254 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.255 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.255 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.255 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T09:05:00.255 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.255 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.255 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.255 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Prometheus container image", 2024-09-19T09:05:00.255 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.256 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.256 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.256 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.256 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_nvmeof": { 2024-09-19T09:05:00.256 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_nvmeof", 2024-09-19T09:05:00.256 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.256 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.256 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.256 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T09:05:00.257 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.257 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.257 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.257 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Nvme-of container image", 2024-09-19T09:05:00.257 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.257 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.257 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.257 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.258 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_prometheus": { 2024-09-19T09:05:00.258 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_prometheus", 2024-09-19T09:05:00.258 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.258 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.258 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.258 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T09:05:00.258 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.258 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.258 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.259 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Prometheus container image", 2024-09-19T09:05:00.259 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.259 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.259 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.259 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.259 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_promtail": { 2024-09-19T09:05:00.259 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_promtail", 2024-09-19T09:05:00.259 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.260 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.260 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.260 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T09:05:00.260 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.260 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.260 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.260 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Promtail container image", 2024-09-19T09:05:00.260 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.261 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.261 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.261 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.261 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_samba": { 2024-09-19T09:05:00.261 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_samba", 2024-09-19T09:05:00.261 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.261 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.261 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.262 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T09:05:00.262 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.262 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.262 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.262 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Samba/SMB container image", 2024-09-19T09:05:00.262 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.262 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.262 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.262 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.263 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_snmp_gateway": { 2024-09-19T09:05:00.263 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_snmp_gateway", 2024-09-19T09:05:00.263 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.263 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.263 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.263 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T09:05:00.263 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.263 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.264 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.264 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "SNMP Gateway container image", 2024-09-19T09:05:00.264 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.264 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.264 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.264 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.264 INFO:teuthology.orchestra.run.smithi019.stdout: "container_init": { 2024-09-19T09:05:00.264 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_init", 2024-09-19T09:05:00.264 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.265 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.265 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.265 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.265 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.265 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.265 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.265 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T09:05:00.266 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.266 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.266 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.266 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.266 INFO:teuthology.orchestra.run.smithi019.stdout: "daemon_cache_timeout": { 2024-09-19T09:05:00.266 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "daemon_cache_timeout", 2024-09-19T09:05:00.266 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:00.266 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.267 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.267 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-19T09:05:00.267 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.267 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.267 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.267 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T09:05:00.267 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.267 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.268 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.268 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.268 INFO:teuthology.orchestra.run.smithi019.stdout: "default_cephadm_command_timeout": { 2024-09-19T09:05:00.268 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T09:05:00.268 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.268 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.268 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.269 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "900", 2024-09-19T09:05:00.269 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.269 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.269 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.269 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T09:05:00.269 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.269 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.269 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.269 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.270 INFO:teuthology.orchestra.run.smithi019.stdout: "default_registry": { 2024-09-19T09:05:00.270 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "default_registry", 2024-09-19T09:05:00.270 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.270 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.270 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.270 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "docker.io", 2024-09-19T09:05:00.270 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.270 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.271 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.271 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T09:05:00.271 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.271 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.271 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.271 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.271 INFO:teuthology.orchestra.run.smithi019.stdout: "device_cache_timeout": { 2024-09-19T09:05:00.271 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "device_cache_timeout", 2024-09-19T09:05:00.272 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:00.272 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.272 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.272 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "1800", 2024-09-19T09:05:00.272 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.272 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.272 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.272 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "seconds to cache device inventory", 2024-09-19T09:05:00.273 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.273 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.273 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.273 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.273 INFO:teuthology.orchestra.run.smithi019.stdout: "device_enhanced_scan": { 2024-09-19T09:05:00.273 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "device_enhanced_scan", 2024-09-19T09:05:00.273 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.273 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.274 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.274 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.274 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.274 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.274 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.274 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T09:05:00.274 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.274 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.275 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.275 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.275 INFO:teuthology.orchestra.run.smithi019.stdout: "facts_cache_timeout": { 2024-09-19T09:05:00.275 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "facts_cache_timeout", 2024-09-19T09:05:00.275 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:00.275 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.275 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.275 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-19T09:05:00.275 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.276 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.276 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.276 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "seconds to cache host facts data", 2024-09-19T09:05:00.276 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.276 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.276 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.276 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.277 INFO:teuthology.orchestra.run.smithi019.stdout: "grafana_dashboards_path": { 2024-09-19T09:05:00.277 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "grafana_dashboards_path", 2024-09-19T09:05:00.277 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.277 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.277 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.277 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T09:05:00.277 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.277 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.278 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.278 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T09:05:00.278 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.278 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.278 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.278 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.278 INFO:teuthology.orchestra.run.smithi019.stdout: "host_check_interval": { 2024-09-19T09:05:00.278 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "host_check_interval", 2024-09-19T09:05:00.278 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:00.279 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.279 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.279 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-19T09:05:00.279 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.279 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.279 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.279 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to perform a host check", 2024-09-19T09:05:00.279 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.280 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.280 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.280 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.280 INFO:teuthology.orchestra.run.smithi019.stdout: "hw_monitoring": { 2024-09-19T09:05:00.280 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "hw_monitoring", 2024-09-19T09:05:00.280 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.280 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.280 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.281 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.281 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.281 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.281 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.281 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T09:05:00.281 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.281 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.281 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.282 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.282 INFO:teuthology.orchestra.run.smithi019.stdout: "inventory_list_all": { 2024-09-19T09:05:00.282 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "inventory_list_all", 2024-09-19T09:05:00.282 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.282 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.282 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.282 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.282 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.283 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.283 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.283 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T09:05:00.283 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.283 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.283 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.283 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.283 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:00.284 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:00.284 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.284 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.284 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.284 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.284 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.284 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.284 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.285 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.285 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.285 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.285 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.285 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.285 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.285 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.285 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.286 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.286 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.286 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.286 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.286 INFO:teuthology.orchestra.run.smithi019.stdout: "log_refresh_metadata": { 2024-09-19T09:05:00.286 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_refresh_metadata", 2024-09-19T09:05:00.286 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.286 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.287 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.287 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.287 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.287 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.287 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.287 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T09:05:00.287 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.287 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.288 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.288 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.288 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:00.288 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:00.288 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.288 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.288 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.288 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.289 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.289 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.289 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.289 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T09:05:00.289 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.289 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.289 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.289 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.290 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:00.290 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:00.290 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.290 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.290 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.290 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:00.290 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.290 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.291 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.291 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.291 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.291 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.291 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.291 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.291 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.291 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.292 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.292 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.292 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.292 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.292 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.292 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:00.292 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:00.292 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.293 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.293 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.293 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.293 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.293 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.293 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.293 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.293 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.293 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.294 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.294 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.294 INFO:teuthology.orchestra.run.smithi019.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T09:05:00.294 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T09:05:00.294 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.294 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.294 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.294 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.295 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.295 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.295 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.295 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T09:05:00.295 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.295 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.295 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.295 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.296 INFO:teuthology.orchestra.run.smithi019.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T09:05:00.296 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T09:05:00.296 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.296 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.296 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.296 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "*", 2024-09-19T09:05:00.296 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.296 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.297 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.297 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T09:05:00.297 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.297 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.297 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.297 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.297 INFO:teuthology.orchestra.run.smithi019.stdout: "max_count_per_host": { 2024-09-19T09:05:00.297 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_count_per_host", 2024-09-19T09:05:00.298 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.298 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.298 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.298 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-19T09:05:00.298 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.298 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.298 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.298 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "max number of daemons per service per host", 2024-09-19T09:05:00.298 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.299 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.299 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.299 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.299 INFO:teuthology.orchestra.run.smithi019.stdout: "max_osd_draining_count": { 2024-09-19T09:05:00.299 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_osd_draining_count", 2024-09-19T09:05:00.299 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.299 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.299 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.300 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-19T09:05:00.300 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.300 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.300 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.300 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T09:05:00.300 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.300 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.300 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.301 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.301 INFO:teuthology.orchestra.run.smithi019.stdout: "migration_current": { 2024-09-19T09:05:00.301 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "migration_current", 2024-09-19T09:05:00.301 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.301 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.301 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.301 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.301 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.301 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.302 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.302 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "internal - do not modify", 2024-09-19T09:05:00.302 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.302 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.302 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.302 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.302 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": { 2024-09-19T09:05:00.302 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mode", 2024-09-19T09:05:00.303 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.303 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.303 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.303 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "root", 2024-09-19T09:05:00.303 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.303 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.303 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.303 INFO:teuthology.orchestra.run.smithi019.stdout: "cephadm-package", 2024-09-19T09:05:00.304 INFO:teuthology.orchestra.run.smithi019.stdout: "root" 2024-09-19T09:05:00.304 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.304 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T09:05:00.304 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.304 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.304 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.304 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.304 INFO:teuthology.orchestra.run.smithi019.stdout: "oob_default_addr": { 2024-09-19T09:05:00.305 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "oob_default_addr", 2024-09-19T09:05:00.305 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.305 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.305 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.305 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "169.254.1.1", 2024-09-19T09:05:00.305 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.305 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.305 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.305 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T09:05:00.306 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.306 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.306 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.306 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.306 INFO:teuthology.orchestra.run.smithi019.stdout: "prometheus_alerts_path": { 2024-09-19T09:05:00.306 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "prometheus_alerts_path", 2024-09-19T09:05:00.306 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.306 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.307 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.307 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T09:05:00.307 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.307 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.307 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.307 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T09:05:00.307 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.307 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.308 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.308 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.308 INFO:teuthology.orchestra.run.smithi019.stdout: "registry_insecure": { 2024-09-19T09:05:00.308 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "registry_insecure", 2024-09-19T09:05:00.308 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.308 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.308 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.308 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.309 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.309 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.309 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.309 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T09:05:00.309 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.309 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.309 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.309 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.310 INFO:teuthology.orchestra.run.smithi019.stdout: "registry_password": { 2024-09-19T09:05:00.310 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "registry_password", 2024-09-19T09:05:00.310 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.310 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.310 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.310 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.310 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.310 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.310 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.311 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T09:05:00.311 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.311 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.311 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.311 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.311 INFO:teuthology.orchestra.run.smithi019.stdout: "registry_url": { 2024-09-19T09:05:00.311 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "registry_url", 2024-09-19T09:05:00.311 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.312 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.312 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.312 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.312 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.312 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.312 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.312 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T09:05:00.312 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.313 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.313 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.313 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.313 INFO:teuthology.orchestra.run.smithi019.stdout: "registry_username": { 2024-09-19T09:05:00.313 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "registry_username", 2024-09-19T09:05:00.313 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.313 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.313 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.313 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.314 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.314 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.314 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.314 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T09:05:00.314 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.314 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.314 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.314 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.314 INFO:teuthology.orchestra.run.smithi019.stdout: "secure_monitoring_stack": { 2024-09-19T09:05:00.315 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "secure_monitoring_stack", 2024-09-19T09:05:00.315 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.315 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.315 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.315 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.315 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.315 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.315 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.316 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T09:05:00.316 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.316 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.316 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.316 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.316 INFO:teuthology.orchestra.run.smithi019.stdout: "service_discovery_port": { 2024-09-19T09:05:00.316 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "service_discovery_port", 2024-09-19T09:05:00.316 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.317 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.317 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.317 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8765", 2024-09-19T09:05:00.317 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.317 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.317 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.317 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "cephadm service discovery port", 2024-09-19T09:05:00.317 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.318 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.318 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.318 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.318 INFO:teuthology.orchestra.run.smithi019.stdout: "ssh_config_file": { 2024-09-19T09:05:00.318 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ssh_config_file", 2024-09-19T09:05:00.318 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.318 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.318 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.318 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.319 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.319 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.319 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.319 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T09:05:00.319 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.319 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.319 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.319 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.320 INFO:teuthology.orchestra.run.smithi019.stdout: "use_agent": { 2024-09-19T09:05:00.320 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "use_agent", 2024-09-19T09:05:00.320 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.320 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.320 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.320 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.320 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.320 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.320 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.321 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T09:05:00.321 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.322 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.322 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.322 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.323 INFO:teuthology.orchestra.run.smithi019.stdout: "use_repo_digest": { 2024-09-19T09:05:00.323 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "use_repo_digest", 2024-09-19T09:05:00.323 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.323 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.324 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.324 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.324 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.324 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.325 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.325 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T09:05:00.325 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.325 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.326 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.326 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.326 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_on_failed_host_check": { 2024-09-19T09:05:00.326 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_on_failed_host_check", 2024-09-19T09:05:00.326 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.326 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.326 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.327 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.327 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.327 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.327 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.327 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T09:05:00.327 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.327 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.327 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.328 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.328 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_on_stray_daemons": { 2024-09-19T09:05:00.328 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_on_stray_daemons", 2024-09-19T09:05:00.328 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.328 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.328 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.328 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.328 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.329 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.329 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.329 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T09:05:00.329 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.329 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.329 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.329 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.329 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_on_stray_hosts": { 2024-09-19T09:05:00.329 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_on_stray_hosts", 2024-09-19T09:05:00.330 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.330 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.330 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.330 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.330 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.330 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.330 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.330 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T09:05:00.331 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.331 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.331 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.331 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.331 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.331 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.331 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.331 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crash", 2024-09-19T09:05:00.331 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:00.332 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:00.332 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:00.332 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:00.332 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:00.332 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.332 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.332 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.333 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.333 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.333 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.333 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.333 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.333 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.333 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.333 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.334 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.334 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.334 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.334 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.334 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.334 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.334 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.334 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.334 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:00.335 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:00.335 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.335 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.335 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.335 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.335 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.335 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.335 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.336 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.336 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.336 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.336 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.336 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.336 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:00.336 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:00.336 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.337 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.337 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.337 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:00.337 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.337 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.337 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.337 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.337 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.337 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.338 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.338 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.338 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.338 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.338 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.338 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.338 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.338 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.339 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.339 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:00.339 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:00.339 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.340 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.340 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.340 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.340 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.340 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.340 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.341 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.341 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.341 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.341 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.341 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.341 INFO:teuthology.orchestra.run.smithi019.stdout: "retain_interval": { 2024-09-19T09:05:00.342 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "retain_interval", 2024-09-19T09:05:00.342 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:00.342 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.342 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.342 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "31536000", 2024-09-19T09:05:00.342 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.342 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.342 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.343 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T09:05:00.343 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.343 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.343 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.343 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.343 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_recent_interval": { 2024-09-19T09:05:00.344 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_recent_interval", 2024-09-19T09:05:00.344 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:00.344 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.344 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.344 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "1209600", 2024-09-19T09:05:00.344 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.344 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.345 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.345 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T09:05:00.345 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.345 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.345 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.346 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.346 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.346 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.347 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.347 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "dashboard", 2024-09-19T09:05:00.347 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:00.347 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:00.348 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:00.348 INFO:teuthology.orchestra.run.smithi019.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T09:05:00.348 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T09:05:00.348 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.349 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.349 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.349 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-19T09:05:00.349 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.349 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.350 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.350 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.351 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.351 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.351 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.351 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.352 INFO:teuthology.orchestra.run.smithi019.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T09:05:00.352 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T09:05:00.352 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.352 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.353 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.353 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.353 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.354 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.354 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.354 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.354 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.354 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.356 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.356 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.357 INFO:teuthology.orchestra.run.smithi019.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T09:05:00.357 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T09:05:00.357 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.358 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.358 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.358 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.358 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.359 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.359 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.359 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.360 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.360 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.360 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.360 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.361 INFO:teuthology.orchestra.run.smithi019.stdout: "AUDIT_API_ENABLED": { 2024-09-19T09:05:00.361 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T09:05:00.361 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.361 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.362 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.362 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.362 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.362 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.362 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.363 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.363 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.363 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.363 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.363 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.364 INFO:teuthology.orchestra.run.smithi019.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T09:05:00.364 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T09:05:00.364 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.364 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.365 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.365 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.365 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.365 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.365 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.366 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.366 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.366 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.366 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.366 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.366 INFO:teuthology.orchestra.run.smithi019.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T09:05:00.366 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T09:05:00.367 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.367 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.367 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.367 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.367 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.367 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.367 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.367 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.367 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.368 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.368 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.368 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.368 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T09:05:00.368 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T09:05:00.368 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.368 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.369 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.369 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.369 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.369 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.369 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.369 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.369 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.369 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.370 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.370 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.370 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T09:05:00.370 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T09:05:00.370 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.370 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.370 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.370 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.370 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.371 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.371 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.371 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.371 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.371 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.371 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.371 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.371 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T09:05:00.372 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T09:05:00.372 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.372 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.372 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.372 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.372 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.372 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.372 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.373 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.373 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.373 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.373 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.373 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.373 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T09:05:00.373 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T09:05:00.373 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.373 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.374 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.374 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.374 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.374 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.374 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.374 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.374 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.374 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.375 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.375 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.375 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T09:05:00.375 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T09:05:00.375 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.375 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.375 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.376 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.376 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.376 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.376 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.376 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.376 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.376 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.377 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.377 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.377 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T09:05:00.377 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T09:05:00.377 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.377 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.377 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.377 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.377 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.378 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.378 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.378 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.378 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.378 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.378 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.378 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.378 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T09:05:00.379 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T09:05:00.379 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.379 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.379 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.379 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.379 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.379 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.379 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.379 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.380 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.380 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.380 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.380 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.380 INFO:teuthology.orchestra.run.smithi019.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T09:05:00.380 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T09:05:00.380 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.380 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.381 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.381 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.381 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.381 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.381 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.381 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.381 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.381 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.381 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.382 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.382 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T09:05:00.382 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T09:05:00.382 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.382 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.382 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.382 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "admin", 2024-09-19T09:05:00.382 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.382 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.383 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.383 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.383 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.383 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.383 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.383 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.383 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T09:05:00.383 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T09:05:00.384 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.384 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.384 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.384 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.384 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.384 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.384 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.384 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.385 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.385 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.385 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.385 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.385 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_API_URL": { 2024-09-19T09:05:00.385 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_API_URL", 2024-09-19T09:05:00.385 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.385 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.385 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.386 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.386 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.386 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.386 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.386 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.386 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.386 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.386 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.387 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.387 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T09:05:00.387 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T09:05:00.387 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.387 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.387 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.387 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "admin", 2024-09-19T09:05:00.387 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.387 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.388 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.388 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.388 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.388 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.388 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.388 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.388 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T09:05:00.388 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T09:05:00.389 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.389 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.389 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.389 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.389 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.389 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.389 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.389 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.390 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.390 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.390 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.390 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.390 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T09:05:00.390 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T09:05:00.390 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.390 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.391 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.391 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.391 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.391 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.391 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.391 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.391 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.391 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.392 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.392 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.392 INFO:teuthology.orchestra.run.smithi019.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T09:05:00.392 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T09:05:00.392 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.392 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.392 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.392 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.392 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.393 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.393 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.393 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.393 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.393 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.394 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.394 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.394 INFO:teuthology.orchestra.run.smithi019.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T09:05:00.394 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T09:05:00.394 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.394 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.394 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.394 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.394 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.395 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.395 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.395 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.395 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.395 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.395 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.396 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.396 INFO:teuthology.orchestra.run.smithi019.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T09:05:00.396 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T09:05:00.396 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.396 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.397 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.397 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.397 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.397 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.397 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.397 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.397 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.398 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.398 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.398 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.398 INFO:teuthology.orchestra.run.smithi019.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T09:05:00.398 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T09:05:00.398 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.398 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.398 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.399 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.399 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.399 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.399 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.399 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.399 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.399 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.399 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.400 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.400 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T09:05:00.400 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T09:05:00.400 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.400 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.400 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.400 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.400 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.400 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.401 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.401 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.401 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.401 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.401 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.401 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.401 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T09:05:00.401 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T09:05:00.401 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.402 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.402 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.402 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.402 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.402 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.402 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.402 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.402 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.403 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.403 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.403 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.403 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T09:05:00.403 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T09:05:00.403 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.403 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.403 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.404 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.404 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.404 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.404 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.404 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.404 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.404 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.404 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.404 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.405 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T09:05:00.405 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T09:05:00.405 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.405 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.405 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.405 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.405 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.405 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.406 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.406 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.406 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.406 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.406 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.406 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.406 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T09:05:00.406 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T09:05:00.406 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.407 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.407 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.407 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.407 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.407 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.407 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.407 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.408 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.408 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.408 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.408 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.408 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T09:05:00.408 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T09:05:00.408 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.409 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.409 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.409 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.409 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.409 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.409 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.409 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.409 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.410 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.410 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.410 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.410 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T09:05:00.410 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T09:05:00.410 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.410 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.410 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.410 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.411 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.411 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.411 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.411 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.411 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.411 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.411 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.411 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.412 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T09:05:00.412 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T09:05:00.412 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.412 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.412 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.412 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.412 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.412 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.413 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.413 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.413 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.413 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.413 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.413 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.413 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T09:05:00.413 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T09:05:00.414 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.414 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.414 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.414 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T09:05:00.414 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.414 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.414 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.414 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.415 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.415 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.415 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.415 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.415 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T09:05:00.415 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T09:05:00.415 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.415 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.415 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.416 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-19T09:05:00.416 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.416 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.416 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.416 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.416 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.416 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.416 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.417 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.417 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T09:05:00.417 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T09:05:00.417 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.417 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.417 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.417 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8", 2024-09-19T09:05:00.417 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.417 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.418 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.418 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.418 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.418 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.418 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.418 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.418 INFO:teuthology.orchestra.run.smithi019.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T09:05:00.418 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T09:05:00.419 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.419 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.419 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.419 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "45", 2024-09-19T09:05:00.419 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.419 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.419 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.419 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.419 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.420 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.420 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.420 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.420 INFO:teuthology.orchestra.run.smithi019.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T09:05:00.420 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T09:05:00.420 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.420 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.420 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.421 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.421 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.421 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.421 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.421 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.421 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.421 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.421 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.422 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.422 INFO:teuthology.orchestra.run.smithi019.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T09:05:00.422 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T09:05:00.422 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.422 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.422 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.422 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "admin", 2024-09-19T09:05:00.422 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.422 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.423 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.423 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.423 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.423 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.423 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.423 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.423 INFO:teuthology.orchestra.run.smithi019.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T09:05:00.423 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T09:05:00.424 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.424 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.424 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.424 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.424 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.424 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.424 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.424 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.424 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.425 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.425 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.425 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.425 INFO:teuthology.orchestra.run.smithi019.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T09:05:00.425 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T09:05:00.425 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.425 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.425 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.425 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.426 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.426 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.426 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.426 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.426 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.426 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.426 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.426 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.427 INFO:teuthology.orchestra.run.smithi019.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T09:05:00.427 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T09:05:00.427 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.427 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.427 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.427 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-19T09:05:00.427 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.427 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.427 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.428 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.428 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.428 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.428 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.428 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.428 INFO:teuthology.orchestra.run.smithi019.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T09:05:00.428 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T09:05:00.428 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.429 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.429 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.429 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-19T09:05:00.429 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.429 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.429 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.429 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.429 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.430 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.430 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.430 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.430 INFO:teuthology.orchestra.run.smithi019.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T09:05:00.430 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T09:05:00.430 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.430 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.430 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.430 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-19T09:05:00.431 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.431 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.431 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.431 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.431 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.431 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.431 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.431 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.431 INFO:teuthology.orchestra.run.smithi019.stdout: "cross_origin_url": { 2024-09-19T09:05:00.432 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cross_origin_url", 2024-09-19T09:05:00.432 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.432 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.432 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.432 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.432 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.432 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.432 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.433 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.433 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.433 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.433 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.433 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.433 INFO:teuthology.orchestra.run.smithi019.stdout: "crt_file": { 2024-09-19T09:05:00.433 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crt_file", 2024-09-19T09:05:00.433 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.433 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.434 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.434 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.434 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.434 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.434 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.434 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.434 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.434 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.435 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.435 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.435 INFO:teuthology.orchestra.run.smithi019.stdout: "debug": { 2024-09-19T09:05:00.435 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "debug", 2024-09-19T09:05:00.435 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.435 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.435 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.436 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.436 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.436 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.436 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.436 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Enable/disable debug options", 2024-09-19T09:05:00.436 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.436 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.436 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.437 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.437 INFO:teuthology.orchestra.run.smithi019.stdout: "jwt_token_ttl": { 2024-09-19T09:05:00.437 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "jwt_token_ttl", 2024-09-19T09:05:00.437 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.437 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.437 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.437 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "28800", 2024-09-19T09:05:00.437 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.438 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.438 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.438 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.438 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.438 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.438 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.438 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.438 INFO:teuthology.orchestra.run.smithi019.stdout: "key_file": { 2024-09-19T09:05:00.439 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "key_file", 2024-09-19T09:05:00.439 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.439 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.439 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.439 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.439 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.439 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.439 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.439 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.440 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.440 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.440 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.440 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.440 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:00.440 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:00.440 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.441 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.441 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.441 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.441 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.441 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.441 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.442 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.442 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.442 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.442 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.442 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.442 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.442 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.442 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.442 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.443 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.443 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.443 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.443 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:00.443 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:00.443 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.444 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.444 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.444 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.444 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.444 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.444 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.444 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.444 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.445 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.445 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.445 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.445 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:00.445 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:00.445 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.445 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.445 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.446 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:00.446 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.446 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.446 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.446 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.446 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.447 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.447 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.447 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.447 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.447 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.447 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.447 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.447 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.448 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.448 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.448 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:00.448 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:00.448 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.448 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.448 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.448 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.449 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.449 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.449 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.449 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.449 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.449 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.449 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.449 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.450 INFO:teuthology.orchestra.run.smithi019.stdout: "motd": { 2024-09-19T09:05:00.450 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "motd", 2024-09-19T09:05:00.450 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.450 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.450 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.450 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.450 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.450 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.450 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.451 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "The message of the day", 2024-09-19T09:05:00.451 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.451 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.451 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.451 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.451 INFO:teuthology.orchestra.run.smithi019.stdout: "redirect_resolve_ip_addr": { 2024-09-19T09:05:00.451 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T09:05:00.451 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.452 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.452 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.452 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.452 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.452 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.452 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.452 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.452 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.453 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.453 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.453 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.453 INFO:teuthology.orchestra.run.smithi019.stdout: "server_addr": { 2024-09-19T09:05:00.453 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_addr", 2024-09-19T09:05:00.453 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.453 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.453 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.453 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "::", 2024-09-19T09:05:00.454 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.454 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.454 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.454 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.454 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.454 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.454 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.454 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.455 INFO:teuthology.orchestra.run.smithi019.stdout: "server_port": { 2024-09-19T09:05:00.455 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_port", 2024-09-19T09:05:00.455 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.455 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.455 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.455 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8080", 2024-09-19T09:05:00.455 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.455 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.455 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.456 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.456 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.456 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.456 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.456 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.456 INFO:teuthology.orchestra.run.smithi019.stdout: "ssl": { 2024-09-19T09:05:00.456 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ssl", 2024-09-19T09:05:00.456 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.457 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.457 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.457 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.457 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.457 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.457 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.457 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.457 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.458 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.458 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.458 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.458 INFO:teuthology.orchestra.run.smithi019.stdout: "ssl_server_port": { 2024-09-19T09:05:00.458 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ssl_server_port", 2024-09-19T09:05:00.458 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.458 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.458 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.459 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8443", 2024-09-19T09:05:00.459 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.459 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.459 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.459 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.459 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.459 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.459 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.460 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.460 INFO:teuthology.orchestra.run.smithi019.stdout: "standby_behaviour": { 2024-09-19T09:05:00.460 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "standby_behaviour", 2024-09-19T09:05:00.460 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.460 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.460 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.460 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "redirect", 2024-09-19T09:05:00.461 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.461 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.461 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.461 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.461 INFO:teuthology.orchestra.run.smithi019.stdout: "redirect" 2024-09-19T09:05:00.461 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.461 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.461 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.462 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.462 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.462 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.462 INFO:teuthology.orchestra.run.smithi019.stdout: "standby_error_status_code": { 2024-09-19T09:05:00.462 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "standby_error_status_code", 2024-09-19T09:05:00.462 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.462 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.462 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.463 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "500", 2024-09-19T09:05:00.463 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "400", 2024-09-19T09:05:00.463 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "599", 2024-09-19T09:05:00.463 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.463 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.463 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.463 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.463 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.463 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.464 INFO:teuthology.orchestra.run.smithi019.stdout: "url_prefix": { 2024-09-19T09:05:00.464 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "url_prefix", 2024-09-19T09:05:00.464 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.464 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.464 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.464 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.464 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.464 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.465 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.465 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.465 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.465 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.465 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.465 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.465 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.465 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.465 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.466 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "devicehealth", 2024-09-19T09:05:00.466 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:00.466 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:00.466 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:00.466 INFO:teuthology.orchestra.run.smithi019.stdout: "enable_monitoring": { 2024-09-19T09:05:00.466 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "enable_monitoring", 2024-09-19T09:05:00.466 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.466 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.467 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.467 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.467 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.467 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.467 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.467 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "monitor device health metrics", 2024-09-19T09:05:00.467 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.467 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.467 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.468 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.468 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:00.468 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:00.468 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.468 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.468 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.468 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.468 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.469 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.469 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.469 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.469 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.469 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.469 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.469 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.469 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.470 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.470 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.470 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.470 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.470 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.470 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.470 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:00.470 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:00.470 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.471 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.471 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.471 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.471 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.471 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.471 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.471 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.471 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.471 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.472 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.472 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.472 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:00.472 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:00.472 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.472 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.472 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.472 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:00.473 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.473 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.473 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.473 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.473 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.473 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.473 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.473 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.473 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.474 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.474 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.474 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.474 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.474 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.474 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.474 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:00.474 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:00.475 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.475 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.475 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.475 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.475 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.475 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.475 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.475 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.475 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.476 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.476 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.476 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.476 INFO:teuthology.orchestra.run.smithi019.stdout: "mark_out_threshold": { 2024-09-19T09:05:00.476 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mark_out_threshold", 2024-09-19T09:05:00.476 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:00.476 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.476 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.477 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "2419200", 2024-09-19T09:05:00.477 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.477 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.477 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.477 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T09:05:00.477 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.477 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.477 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.478 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.478 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_name": { 2024-09-19T09:05:00.478 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "pool_name", 2024-09-19T09:05:00.478 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.478 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.478 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.478 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "device_health_metrics", 2024-09-19T09:05:00.478 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.478 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.479 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.479 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T09:05:00.479 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.479 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.479 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.479 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.479 INFO:teuthology.orchestra.run.smithi019.stdout: "retention_period": { 2024-09-19T09:05:00.479 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "retention_period", 2024-09-19T09:05:00.480 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:00.480 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.480 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.480 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "15552000", 2024-09-19T09:05:00.480 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.480 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.480 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.480 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how long to retain device health metrics", 2024-09-19T09:05:00.481 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.481 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.481 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.481 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.481 INFO:teuthology.orchestra.run.smithi019.stdout: "scrape_frequency": { 2024-09-19T09:05:00.481 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "scrape_frequency", 2024-09-19T09:05:00.481 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:00.481 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.482 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.482 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "86400", 2024-09-19T09:05:00.482 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.482 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.482 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.482 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T09:05:00.482 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.483 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.483 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.483 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.483 INFO:teuthology.orchestra.run.smithi019.stdout: "self_heal": { 2024-09-19T09:05:00.483 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "self_heal", 2024-09-19T09:05:00.483 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.483 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.483 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.483 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.484 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.484 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.484 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.484 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T09:05:00.484 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.484 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.484 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.484 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.485 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-19T09:05:00.485 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-19T09:05:00.485 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:00.485 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.485 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.485 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-19T09:05:00.485 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.485 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.486 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.486 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T09:05:00.486 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.486 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.486 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.486 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.486 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_threshold": { 2024-09-19T09:05:00.486 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_threshold", 2024-09-19T09:05:00.487 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:00.487 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.487 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.487 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "7257600", 2024-09-19T09:05:00.487 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.487 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.487 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.487 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T09:05:00.487 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.488 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.488 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.488 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.488 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.488 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.488 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.488 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "diskprediction_local", 2024-09-19T09:05:00.489 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:00.489 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:00.489 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:00.489 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:00.489 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:00.489 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.489 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.489 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.489 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.490 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.490 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.490 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.490 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.490 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.490 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.490 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.490 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.491 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.491 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.491 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.491 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.491 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.491 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.491 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.491 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:00.492 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:00.492 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.492 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.492 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.492 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.492 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.492 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.492 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.492 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.493 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.493 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.493 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.493 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.493 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:00.493 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:00.493 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.493 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.494 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.494 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:00.494 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.494 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.494 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.494 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.494 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.494 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.495 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.495 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.495 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.495 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.495 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.495 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.495 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.495 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.495 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.496 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:00.496 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:00.496 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.496 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.496 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.496 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.496 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.496 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.497 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.497 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.497 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.497 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.497 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.497 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.497 INFO:teuthology.orchestra.run.smithi019.stdout: "predict_interval": { 2024-09-19T09:05:00.497 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "predict_interval", 2024-09-19T09:05:00.497 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.498 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.498 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.498 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "86400", 2024-09-19T09:05:00.498 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.498 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.498 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.498 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.498 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.499 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.499 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.499 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.499 INFO:teuthology.orchestra.run.smithi019.stdout: "predictor_model": { 2024-09-19T09:05:00.499 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "predictor_model", 2024-09-19T09:05:00.499 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.499 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.499 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.499 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "prophetstor", 2024-09-19T09:05:00.500 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.500 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.500 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.500 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.500 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.500 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.500 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.500 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.500 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-19T09:05:00.501 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-19T09:05:00.501 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.501 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.501 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.501 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-19T09:05:00.501 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.501 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.501 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.502 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.502 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.502 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.502 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.502 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.502 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.502 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.502 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.503 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "influx", 2024-09-19T09:05:00.503 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": false, 2024-09-19T09:05:00.503 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "influxdb python module not found", 2024-09-19T09:05:00.503 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:00.503 INFO:teuthology.orchestra.run.smithi019.stdout: "batch_size": { 2024-09-19T09:05:00.503 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "batch_size", 2024-09-19T09:05:00.503 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.503 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.503 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.504 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5000", 2024-09-19T09:05:00.504 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.504 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.504 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.504 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T09:05:00.504 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.504 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.504 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.505 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.505 INFO:teuthology.orchestra.run.smithi019.stdout: "database": { 2024-09-19T09:05:00.505 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "database", 2024-09-19T09:05:00.505 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.505 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.505 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.505 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "ceph", 2024-09-19T09:05:00.505 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.506 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.506 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.506 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T09:05:00.506 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.506 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.506 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.506 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.506 INFO:teuthology.orchestra.run.smithi019.stdout: "hostname": { 2024-09-19T09:05:00.506 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "hostname", 2024-09-19T09:05:00.507 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.507 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.507 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.507 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.507 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.507 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.507 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.507 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "InfluxDB server hostname", 2024-09-19T09:05:00.508 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.508 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.508 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.508 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.508 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-19T09:05:00.508 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-19T09:05:00.509 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:00.509 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.509 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.509 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "30", 2024-09-19T09:05:00.509 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "5", 2024-09-19T09:05:00.509 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.509 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.509 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T09:05:00.510 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.510 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.510 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.510 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.510 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:00.510 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:00.510 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.510 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.511 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.511 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.511 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.511 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.511 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.511 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.511 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.511 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.512 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.512 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.512 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.512 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.512 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.512 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.512 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.512 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.513 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.513 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:00.513 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:00.513 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.513 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.513 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.513 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.513 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.513 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.514 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.514 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.514 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.514 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.514 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.514 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.514 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:00.514 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:00.515 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.515 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.515 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.515 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:00.515 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.515 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.515 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.515 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.515 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.516 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.516 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.516 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.516 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.516 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.516 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.516 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.516 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.517 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.517 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.517 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:00.517 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:00.517 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.517 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.517 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.517 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.517 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.518 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.518 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.518 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.518 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.518 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.518 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.518 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.518 INFO:teuthology.orchestra.run.smithi019.stdout: "password": { 2024-09-19T09:05:00.519 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "password", 2024-09-19T09:05:00.519 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.519 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.519 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.519 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.519 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.519 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.519 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.520 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "password of InfluxDB server user", 2024-09-19T09:05:00.520 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.520 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.520 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.520 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.520 INFO:teuthology.orchestra.run.smithi019.stdout: "port": { 2024-09-19T09:05:00.520 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "port", 2024-09-19T09:05:00.520 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.521 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.521 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.521 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8086", 2024-09-19T09:05:00.521 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.521 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.521 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.521 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "InfluxDB server port", 2024-09-19T09:05:00.521 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.522 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.522 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.522 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.522 INFO:teuthology.orchestra.run.smithi019.stdout: "ssl": { 2024-09-19T09:05:00.522 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ssl", 2024-09-19T09:05:00.522 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.522 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.522 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.523 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "false", 2024-09-19T09:05:00.523 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.523 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.523 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.523 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:05:00.523 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.523 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.523 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.524 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.524 INFO:teuthology.orchestra.run.smithi019.stdout: "threads": { 2024-09-19T09:05:00.524 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "threads", 2024-09-19T09:05:00.524 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.524 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.524 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.524 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-19T09:05:00.524 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1", 2024-09-19T09:05:00.525 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "32", 2024-09-19T09:05:00.525 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.525 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T09:05:00.525 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.525 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.525 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.525 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.525 INFO:teuthology.orchestra.run.smithi019.stdout: "username": { 2024-09-19T09:05:00.526 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "username", 2024-09-19T09:05:00.526 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.526 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.526 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.526 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.526 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.526 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.526 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.527 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "username of InfluxDB server user", 2024-09-19T09:05:00.527 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.527 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.527 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.527 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.527 INFO:teuthology.orchestra.run.smithi019.stdout: "verify_ssl": { 2024-09-19T09:05:00.527 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "verify_ssl", 2024-09-19T09:05:00.528 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.528 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.528 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.528 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "true", 2024-09-19T09:05:00.528 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.528 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.528 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.528 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:05:00.528 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.529 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.529 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.529 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.529 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.529 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.529 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.529 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "insights", 2024-09-19T09:05:00.529 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:00.530 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:00.530 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:00.530 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:00.530 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:00.530 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.530 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.530 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.530 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.531 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.531 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.531 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.531 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.531 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.531 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.531 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.531 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.532 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.532 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.532 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.532 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.532 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.532 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.532 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.532 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:00.533 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:00.533 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.533 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.533 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.533 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.533 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.533 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.533 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.533 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.534 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.534 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.534 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.534 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.534 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:00.534 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:00.534 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.534 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.534 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.535 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:00.535 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.535 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.535 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.535 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.535 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.535 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.535 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.536 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.536 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.536 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.536 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.536 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.536 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.536 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.536 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.536 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:00.537 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:00.537 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.537 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.537 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.537 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.537 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.537 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.537 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.538 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.538 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.538 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.538 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.538 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.538 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.538 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.538 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.538 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "iostat", 2024-09-19T09:05:00.539 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:00.539 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:00.539 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:00.539 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:00.539 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:00.539 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.539 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.539 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.539 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.540 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.540 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.540 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.540 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.540 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.540 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.540 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.540 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.541 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.541 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.541 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.541 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.541 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.541 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.541 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.542 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:00.542 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:00.542 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.542 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.542 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.542 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.542 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.542 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.543 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.543 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.543 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.543 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.543 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.543 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.543 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:00.543 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:00.544 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.544 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.544 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.544 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:00.544 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.544 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.544 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.544 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.544 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.545 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.545 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.545 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.545 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.545 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.545 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.545 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.545 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.546 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.546 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.546 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:00.546 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:00.546 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.546 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.546 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.546 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.547 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.547 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.547 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.547 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.547 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.547 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.547 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.547 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.547 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.548 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.548 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.548 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "k8sevents", 2024-09-19T09:05:00.548 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:00.548 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:00.548 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:00.548 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_event_retention_days": { 2024-09-19T09:05:00.548 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ceph_event_retention_days", 2024-09-19T09:05:00.548 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.549 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.549 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.549 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "7", 2024-09-19T09:05:00.549 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.549 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.549 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.549 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T09:05:00.549 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.549 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.550 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.550 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.550 INFO:teuthology.orchestra.run.smithi019.stdout: "config_check_secs": { 2024-09-19T09:05:00.550 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "config_check_secs", 2024-09-19T09:05:00.550 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.550 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.550 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.550 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-19T09:05:00.551 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "10", 2024-09-19T09:05:00.551 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.551 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.551 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T09:05:00.551 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.551 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.551 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.552 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.552 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:00.552 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:00.552 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.552 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.552 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.552 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.552 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.552 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.553 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.553 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.553 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.553 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.553 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.553 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.553 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.553 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.554 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.554 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.554 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.554 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.554 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.554 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:00.554 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:00.554 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.555 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.556 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.557 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.557 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.557 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.557 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.557 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.557 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.557 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.557 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.558 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.558 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:00.558 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:00.558 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.558 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.558 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.558 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:00.558 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.559 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.559 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.559 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.559 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.559 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.559 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.559 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.559 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.559 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.560 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.560 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.560 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.560 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.560 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.560 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:00.560 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:00.560 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.561 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.561 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.561 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.561 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.561 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.561 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.561 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.561 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.562 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.562 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.562 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.562 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.562 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.562 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.562 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "localpool", 2024-09-19T09:05:00.562 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:00.562 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:00.563 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:00.563 INFO:teuthology.orchestra.run.smithi019.stdout: "failure_domain": { 2024-09-19T09:05:00.563 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "failure_domain", 2024-09-19T09:05:00.563 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.563 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.563 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.563 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "host", 2024-09-19T09:05:00.563 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.564 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.564 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.564 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "failure domain for any created local pool", 2024-09-19T09:05:00.564 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T09:05:00.564 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.564 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.564 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.564 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:00.565 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:00.565 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.565 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.565 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.565 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.565 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.565 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.565 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.566 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.566 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.566 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.566 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.566 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.566 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.566 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.566 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.566 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.567 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.567 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.567 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.567 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:00.567 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:00.567 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.567 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.567 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.568 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.568 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.568 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.568 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.568 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.568 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.568 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.568 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.569 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.569 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:00.569 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:00.569 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.569 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.569 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.569 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:00.569 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.569 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.570 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.570 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.570 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.570 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.570 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.570 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.570 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.570 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.571 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.571 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.571 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.571 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.571 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.571 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:00.571 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:00.571 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.571 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.572 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.572 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.572 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.572 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.572 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.572 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.572 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.572 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.573 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.573 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.573 INFO:teuthology.orchestra.run.smithi019.stdout: "min_size": { 2024-09-19T09:05:00.573 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "min_size", 2024-09-19T09:05:00.573 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.573 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.573 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.573 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.573 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.574 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.574 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.574 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "default min_size for any created local pool", 2024-09-19T09:05:00.574 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T09:05:00.574 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.574 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.574 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.574 INFO:teuthology.orchestra.run.smithi019.stdout: "num_rep": { 2024-09-19T09:05:00.574 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "num_rep", 2024-09-19T09:05:00.575 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.575 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.575 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.575 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "3", 2024-09-19T09:05:00.575 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.575 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.575 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.576 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "default replica count for any created local pool", 2024-09-19T09:05:00.576 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.576 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.576 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.576 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.576 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num": { 2024-09-19T09:05:00.576 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "pg_num", 2024-09-19T09:05:00.576 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.577 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.577 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.577 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "128", 2024-09-19T09:05:00.577 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.577 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.577 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.577 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T09:05:00.577 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.577 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.578 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.578 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.578 INFO:teuthology.orchestra.run.smithi019.stdout: "prefix": { 2024-09-19T09:05:00.578 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "prefix", 2024-09-19T09:05:00.578 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.578 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.578 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.578 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.579 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.579 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.579 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.579 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "name prefix for any created local pool", 2024-09-19T09:05:00.579 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.579 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.579 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.579 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.580 INFO:teuthology.orchestra.run.smithi019.stdout: "subtree": { 2024-09-19T09:05:00.580 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "subtree", 2024-09-19T09:05:00.580 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.580 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.580 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.580 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "rack", 2024-09-19T09:05:00.580 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.580 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.580 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.581 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T09:05:00.581 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T09:05:00.581 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.581 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.581 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.581 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.581 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.582 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.582 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mds_autoscaler", 2024-09-19T09:05:00.582 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:00.582 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:00.582 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:00.582 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:00.582 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:00.582 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.582 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.583 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.583 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.583 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.583 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.583 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.583 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.583 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.583 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.584 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.584 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.584 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.584 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.584 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.584 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.584 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.584 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.584 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.585 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:00.585 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:00.585 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.585 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.585 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.585 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.585 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.585 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.586 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.586 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.586 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.586 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.586 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.586 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.586 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:00.586 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:00.587 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.587 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.587 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.587 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:00.587 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.587 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.587 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.587 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.587 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.588 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.588 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.588 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.588 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.588 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.588 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.588 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.588 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.588 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.589 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.589 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:00.589 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:00.589 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.589 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.589 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.589 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.589 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.590 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.590 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.590 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.590 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.590 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.590 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.590 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.590 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.590 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.591 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.591 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mirroring", 2024-09-19T09:05:00.591 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:00.591 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:00.591 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:00.591 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:00.591 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:00.591 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.592 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.592 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.592 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.592 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.592 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.592 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.592 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.592 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.593 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.593 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.593 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.593 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.593 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.593 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.593 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.593 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.593 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.594 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.594 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:00.594 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:00.594 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.594 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.594 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.594 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.594 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.595 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.595 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.595 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.595 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.595 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.595 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.595 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.595 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:00.596 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:00.596 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.596 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.596 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.596 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:00.596 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.596 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.596 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.597 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.597 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.597 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.597 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.597 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.597 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.597 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.597 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.598 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.598 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.598 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.598 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.598 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:00.598 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:00.598 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.598 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.599 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.599 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.599 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.599 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.599 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.599 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.599 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.599 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.600 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.600 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.600 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.600 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.600 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.600 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "nfs", 2024-09-19T09:05:00.600 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:00.600 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:00.601 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:00.601 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:00.601 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:00.601 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.601 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.601 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.601 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.601 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.601 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.602 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.602 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.602 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.602 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.602 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.602 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.602 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.602 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.603 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.603 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.603 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.603 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.603 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.603 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:00.603 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:00.603 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.604 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.604 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.604 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.604 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.604 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.604 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.604 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.604 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.605 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.605 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.605 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.605 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:00.605 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:00.605 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.605 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.605 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.605 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:00.606 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.606 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.606 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.606 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.606 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.606 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.606 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.606 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.607 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.607 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.607 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.607 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.607 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.607 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.607 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.607 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:00.607 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:00.608 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.608 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.608 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.608 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.608 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.608 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.609 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.609 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.609 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.609 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.609 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.609 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.609 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.609 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.609 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.610 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "orchestrator", 2024-09-19T09:05:00.610 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:00.610 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:00.610 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:00.610 INFO:teuthology.orchestra.run.smithi019.stdout: "fail_fs": { 2024-09-19T09:05:00.610 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "fail_fs", 2024-09-19T09:05:00.610 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.610 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.610 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.611 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.611 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.611 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.611 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.611 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T09:05:00.611 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.611 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.611 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.612 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.612 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:00.612 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:00.612 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.612 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.612 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.612 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.612 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.613 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.613 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.613 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.613 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.613 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.613 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.613 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.613 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.614 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.614 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.614 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.614 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.614 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.614 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.614 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:00.614 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:00.614 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.615 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.615 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.615 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.615 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.615 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.615 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.615 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.615 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.616 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.616 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.616 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.616 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:00.616 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:00.616 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.616 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.616 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.617 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:00.617 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.617 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.617 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.617 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.617 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.617 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.617 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.618 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.618 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.618 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.618 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.618 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.618 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.618 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.618 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.618 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:00.619 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:00.619 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.619 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.619 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.619 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.619 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.619 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.619 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.620 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.620 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.620 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.620 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.620 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.620 INFO:teuthology.orchestra.run.smithi019.stdout: "orchestrator": { 2024-09-19T09:05:00.620 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "orchestrator", 2024-09-19T09:05:00.620 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.620 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.621 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.621 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.621 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.621 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.621 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.621 INFO:teuthology.orchestra.run.smithi019.stdout: "cephadm", 2024-09-19T09:05:00.621 INFO:teuthology.orchestra.run.smithi019.stdout: "rook", 2024-09-19T09:05:00.621 INFO:teuthology.orchestra.run.smithi019.stdout: "test_orchestrator" 2024-09-19T09:05:00.622 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.622 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Orchestrator backend", 2024-09-19T09:05:00.622 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.622 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.622 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.622 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.622 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.622 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.623 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.623 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "osd_perf_query", 2024-09-19T09:05:00.623 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:00.623 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:00.623 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:00.623 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:00.623 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:00.623 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.623 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.624 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.624 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.624 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.624 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.624 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.624 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.624 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.624 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.625 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.625 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.625 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.625 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.625 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.625 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.625 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.625 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.626 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.626 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:00.626 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:00.626 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.626 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.626 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.626 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.626 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.627 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.627 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.627 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.627 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.627 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.627 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.627 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.627 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:00.628 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:00.628 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.628 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.628 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.628 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:00.628 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.628 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.628 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.629 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.629 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.629 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.629 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.629 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.629 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.629 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.629 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.630 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.630 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.630 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.630 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.630 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:00.630 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:00.630 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.630 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.631 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.631 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.631 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.631 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.631 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.631 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.631 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.631 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.632 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.632 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.632 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.632 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.632 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.632 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "osd_support", 2024-09-19T09:05:00.632 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:00.632 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:00.633 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:00.633 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:00.633 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:00.633 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.633 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.633 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.633 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.633 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.634 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.634 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.634 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.634 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.634 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.634 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.634 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.634 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.634 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.635 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.635 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.635 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.635 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.635 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.635 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:00.635 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:00.635 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.636 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.636 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.636 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.636 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.636 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.636 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.636 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.636 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.637 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.637 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.637 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.637 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:00.637 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:00.637 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.637 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.637 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.638 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:00.638 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.638 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.638 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.638 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.638 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.638 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.638 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.639 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.639 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.639 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.639 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.639 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.639 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.639 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.639 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.640 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:00.640 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:00.640 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.640 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.640 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.640 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.640 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.640 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.641 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.641 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.641 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.641 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.641 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.641 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.641 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.641 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.641 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.642 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "pg_autoscaler", 2024-09-19T09:05:00.642 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:00.642 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:00.642 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:00.642 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:00.642 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:00.642 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.642 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.643 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.643 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.643 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.643 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.643 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.643 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.643 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.643 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.644 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.644 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.644 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.644 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.644 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.644 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.644 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.644 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.645 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.645 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:00.645 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:00.645 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.645 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.645 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.645 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.645 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.645 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.646 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.646 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.646 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.646 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.646 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.646 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.646 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:00.646 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:00.647 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.647 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.647 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.647 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:00.647 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.647 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.647 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.647 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.648 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.648 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.648 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.648 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.648 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.648 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.648 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.648 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.649 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.649 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.649 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.649 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:00.649 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:00.649 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.649 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.649 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.650 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.650 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.650 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.650 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.650 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.650 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.650 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.650 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.651 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.651 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-19T09:05:00.651 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-19T09:05:00.651 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:00.651 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.651 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.651 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-19T09:05:00.651 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.651 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.652 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.652 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.652 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.652 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.652 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.652 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.652 INFO:teuthology.orchestra.run.smithi019.stdout: "threshold": { 2024-09-19T09:05:00.652 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "threshold", 2024-09-19T09:05:00.653 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-19T09:05:00.653 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.653 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.653 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "3.0", 2024-09-19T09:05:00.653 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1.0", 2024-09-19T09:05:00.653 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.653 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.653 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "scaling threshold", 2024-09-19T09:05:00.654 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T09:05:00.654 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.654 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.654 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.654 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.654 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.654 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.654 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "progress", 2024-09-19T09:05:00.654 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:00.655 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:00.655 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:00.655 INFO:teuthology.orchestra.run.smithi019.stdout: "allow_pg_recovery_event": { 2024-09-19T09:05:00.655 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "allow_pg_recovery_event", 2024-09-19T09:05:00.655 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.655 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.655 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.655 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.656 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.656 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.656 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.656 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T09:05:00.656 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.656 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.656 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.656 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.657 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": { 2024-09-19T09:05:00.657 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "enabled", 2024-09-19T09:05:00.657 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.657 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.657 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.657 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.657 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.657 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.657 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.658 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.658 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.658 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.658 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.658 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.658 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:00.658 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:00.658 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.659 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.659 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.659 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.659 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.659 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.659 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.659 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.659 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.660 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.660 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.660 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.660 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.660 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.660 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.660 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.660 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.661 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.661 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.661 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:00.661 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:00.661 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.661 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.661 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.661 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.661 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.662 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.662 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.662 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.662 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.662 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.662 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.662 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.662 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:00.663 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:00.663 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.663 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.663 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.663 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:00.663 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.663 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.663 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.664 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.664 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.664 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.664 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.664 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.664 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.664 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.664 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.665 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.665 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.665 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.665 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.665 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:00.665 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:00.665 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.665 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.665 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.666 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.666 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.666 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.666 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.666 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.666 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.666 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.666 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.667 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.667 INFO:teuthology.orchestra.run.smithi019.stdout: "max_completed_events": { 2024-09-19T09:05:00.667 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_completed_events", 2024-09-19T09:05:00.667 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.667 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.667 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.667 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "50", 2024-09-19T09:05:00.667 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.668 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.668 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.668 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "number of past completed events to remember", 2024-09-19T09:05:00.668 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.668 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.668 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.668 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.668 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-19T09:05:00.669 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-19T09:05:00.669 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:00.669 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.669 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.669 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-19T09:05:00.669 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.669 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.669 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.670 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how long the module is going to sleep", 2024-09-19T09:05:00.670 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.670 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.670 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.670 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.670 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.670 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.670 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.671 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "prometheus", 2024-09-19T09:05:00.671 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:00.671 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:00.671 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:00.671 INFO:teuthology.orchestra.run.smithi019.stdout: "cache": { 2024-09-19T09:05:00.671 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cache", 2024-09-19T09:05:00.671 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.671 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.671 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.672 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.672 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.672 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.672 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.672 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.672 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.672 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.672 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.673 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.673 INFO:teuthology.orchestra.run.smithi019.stdout: "exclude_perf_counters": { 2024-09-19T09:05:00.673 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "exclude_perf_counters", 2024-09-19T09:05:00.673 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.673 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.673 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.673 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.673 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.674 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.674 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.674 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T09:05:00.674 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T09:05:00.674 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.674 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.674 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.674 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:00.675 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:00.675 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.675 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.675 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.675 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.675 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.675 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.675 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.675 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.676 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.676 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.676 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.676 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.676 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.676 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.676 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.676 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.677 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.677 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.677 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.677 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:00.677 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:00.677 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.677 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.677 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.678 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.678 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.678 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.678 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.678 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.678 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.678 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.678 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.679 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.679 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:00.679 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:00.679 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.679 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.679 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.679 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:00.679 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.680 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.680 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.680 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.680 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.680 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.680 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.680 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.680 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.681 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.681 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.681 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.681 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.681 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.681 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.681 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:00.681 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:00.681 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.682 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.682 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.682 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.682 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.682 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.682 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.682 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.682 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.683 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.683 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.683 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.683 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_stats_pools": { 2024-09-19T09:05:00.683 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rbd_stats_pools", 2024-09-19T09:05:00.683 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.683 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.683 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.684 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.684 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.684 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.684 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.684 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.684 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.684 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.684 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.684 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.685 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T09:05:00.685 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T09:05:00.685 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.685 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.685 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.685 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "300", 2024-09-19T09:05:00.685 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.685 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.686 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.686 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.686 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.686 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.686 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.686 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.686 INFO:teuthology.orchestra.run.smithi019.stdout: "scrape_interval": { 2024-09-19T09:05:00.686 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "scrape_interval", 2024-09-19T09:05:00.686 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-19T09:05:00.687 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.687 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.687 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "15.0", 2024-09-19T09:05:00.687 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.687 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.687 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.687 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.687 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.688 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.688 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.688 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.688 INFO:teuthology.orchestra.run.smithi019.stdout: "server_addr": { 2024-09-19T09:05:00.688 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_addr", 2024-09-19T09:05:00.688 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.688 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.688 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.688 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "::", 2024-09-19T09:05:00.689 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.689 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.689 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.689 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T09:05:00.689 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.689 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.689 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.689 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.690 INFO:teuthology.orchestra.run.smithi019.stdout: "server_port": { 2024-09-19T09:05:00.690 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_port", 2024-09-19T09:05:00.690 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.690 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.690 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.690 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "9283", 2024-09-19T09:05:00.690 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.690 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.690 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.691 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T09:05:00.691 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.691 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.691 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.691 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.691 INFO:teuthology.orchestra.run.smithi019.stdout: "stale_cache_strategy": { 2024-09-19T09:05:00.691 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "stale_cache_strategy", 2024-09-19T09:05:00.692 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.692 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.692 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.692 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "log", 2024-09-19T09:05:00.692 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.692 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.692 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.692 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.693 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.693 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.693 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.693 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.693 INFO:teuthology.orchestra.run.smithi019.stdout: "standby_behaviour": { 2024-09-19T09:05:00.693 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "standby_behaviour", 2024-09-19T09:05:00.693 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.693 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.693 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.694 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "default", 2024-09-19T09:05:00.694 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.694 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.694 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.694 INFO:teuthology.orchestra.run.smithi019.stdout: "default", 2024-09-19T09:05:00.694 INFO:teuthology.orchestra.run.smithi019.stdout: "error" 2024-09-19T09:05:00.694 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.694 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.695 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.695 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.695 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.695 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.695 INFO:teuthology.orchestra.run.smithi019.stdout: "standby_error_status_code": { 2024-09-19T09:05:00.695 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "standby_error_status_code", 2024-09-19T09:05:00.695 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.695 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.696 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.696 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "500", 2024-09-19T09:05:00.696 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "400", 2024-09-19T09:05:00.696 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "599", 2024-09-19T09:05:00.696 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.696 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.696 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.696 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.696 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.697 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.697 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.697 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.697 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.697 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rbd_support", 2024-09-19T09:05:00.697 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:00.697 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:00.697 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:00.698 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:00.698 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:00.698 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.698 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.698 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.698 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.698 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.698 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.699 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.699 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.699 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.699 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.699 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.699 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.699 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.699 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.699 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.700 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.700 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.700 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.700 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.700 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:00.700 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:00.700 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.700 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.701 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.701 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.701 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.701 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.701 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.701 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.701 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.701 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.701 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.702 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.702 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:00.702 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:00.702 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.702 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.702 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.702 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:00.702 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.702 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.703 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.703 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.703 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.703 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.703 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.703 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.703 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.703 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.704 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.704 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.704 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.704 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.704 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.704 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:00.704 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:00.704 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.705 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.705 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.705 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.705 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.705 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.705 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.705 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.705 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.705 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.706 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.706 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.706 INFO:teuthology.orchestra.run.smithi019.stdout: "max_concurrent_snap_create": { 2024-09-19T09:05:00.706 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_concurrent_snap_create", 2024-09-19T09:05:00.706 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.706 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.706 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.706 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-19T09:05:00.707 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.707 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.707 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.707 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.707 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.707 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.707 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.707 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.707 INFO:teuthology.orchestra.run.smithi019.stdout: "mirror_snapshot_schedule": { 2024-09-19T09:05:00.708 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T09:05:00.708 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.708 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.708 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.708 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.708 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.709 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.709 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.709 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.709 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.709 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.709 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.709 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.709 INFO:teuthology.orchestra.run.smithi019.stdout: "trash_purge_schedule": { 2024-09-19T09:05:00.710 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "trash_purge_schedule", 2024-09-19T09:05:00.710 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.710 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.710 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.710 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.710 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.710 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.710 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.711 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.711 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.711 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.711 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.711 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.711 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.711 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.711 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.711 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "restful", 2024-09-19T09:05:00.712 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:00.712 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:00.712 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:00.712 INFO:teuthology.orchestra.run.smithi019.stdout: "enable_auth": { 2024-09-19T09:05:00.712 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "enable_auth", 2024-09-19T09:05:00.712 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.712 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.712 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.713 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.713 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.713 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.713 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.713 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.713 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.713 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.713 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.714 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.714 INFO:teuthology.orchestra.run.smithi019.stdout: "key_file": { 2024-09-19T09:05:00.714 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "key_file", 2024-09-19T09:05:00.714 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.714 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.714 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.714 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.714 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.714 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.715 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.715 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.715 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.715 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.715 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.715 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.716 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:00.716 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:00.716 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.716 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.716 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.716 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.716 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.716 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.717 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.717 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.717 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.717 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.717 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.717 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.717 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.717 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.718 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.718 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.718 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.718 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.718 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.718 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:00.718 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:00.718 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.718 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.719 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.719 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.719 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.719 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.719 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.719 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.719 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.719 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.720 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.720 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.720 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:00.720 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:00.720 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.720 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.720 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.720 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:00.720 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.721 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.721 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.721 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.721 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.721 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.721 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.721 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.721 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.721 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.722 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.722 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.722 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.722 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.722 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.722 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:00.722 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:00.722 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.723 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.723 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.723 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.723 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.723 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.723 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.723 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.723 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.723 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.724 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.724 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.724 INFO:teuthology.orchestra.run.smithi019.stdout: "server_addr": { 2024-09-19T09:05:00.724 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_addr", 2024-09-19T09:05:00.724 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.724 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.724 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.724 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.725 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.725 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.725 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.725 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.725 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.725 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.725 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.725 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.725 INFO:teuthology.orchestra.run.smithi019.stdout: "server_port": { 2024-09-19T09:05:00.726 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_port", 2024-09-19T09:05:00.726 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.726 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.726 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.726 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.726 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.726 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.726 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.727 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.727 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.727 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.727 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.727 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.727 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.727 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.727 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.728 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rgw", 2024-09-19T09:05:00.728 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:00.728 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:00.728 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:00.728 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:00.728 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:00.728 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.728 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.729 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.729 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.729 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.729 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.729 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.729 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.729 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.729 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.730 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.730 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.730 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.730 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.730 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.730 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.730 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.730 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.731 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.731 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:00.731 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:00.731 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.731 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.731 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.731 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.731 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.731 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.732 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.732 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.732 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.732 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.732 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.732 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.732 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:00.732 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:00.733 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.733 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.733 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.733 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:00.733 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.733 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.733 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.733 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.734 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.734 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.734 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.734 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.734 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.734 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.734 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.734 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.735 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.735 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.735 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.735 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:00.735 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:00.735 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.735 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.735 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.736 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.736 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.736 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.736 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.736 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.736 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.736 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.736 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.737 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.737 INFO:teuthology.orchestra.run.smithi019.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T09:05:00.737 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T09:05:00.737 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.737 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.737 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.737 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-19T09:05:00.738 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.738 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.738 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.738 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T09:05:00.738 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.738 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.738 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.738 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.739 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.739 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.739 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.739 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rook", 2024-09-19T09:05:00.739 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:00.739 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:00.739 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:00.740 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:00.740 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:00.740 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.740 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.740 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.740 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.740 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.740 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.740 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.741 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.741 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.741 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.741 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.741 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.741 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.741 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.741 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.742 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.742 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.742 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.742 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.742 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:00.742 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:00.742 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.742 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.743 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.743 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.743 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.743 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.743 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.743 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.743 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.743 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.743 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.744 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.744 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:00.744 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:00.744 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.744 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.744 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.744 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:00.744 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.745 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.745 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.745 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.745 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.745 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.745 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.745 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.745 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.745 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.746 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.746 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.746 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.746 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.746 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.746 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:00.746 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:00.746 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.747 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.747 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.747 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.747 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.747 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.747 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.747 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.747 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.747 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.748 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.748 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.748 INFO:teuthology.orchestra.run.smithi019.stdout: "storage_class": { 2024-09-19T09:05:00.748 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "storage_class", 2024-09-19T09:05:00.748 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.748 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.748 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.748 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "local", 2024-09-19T09:05:00.749 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.749 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.749 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.749 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T09:05:00.749 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.749 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.749 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.749 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.749 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.750 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.750 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.750 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "selftest", 2024-09-19T09:05:00.750 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:00.750 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:00.750 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:00.750 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:00.750 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:00.751 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.751 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.751 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.751 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.751 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.751 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.751 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.751 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.751 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.752 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.752 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.752 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.752 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.752 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.752 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.752 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.752 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.753 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.753 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.753 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:00.753 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:00.753 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.753 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.753 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.753 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.753 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.754 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.754 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.754 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.754 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.754 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.754 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.754 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.754 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:00.754 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:00.755 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.755 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.755 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.755 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:00.755 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.755 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.755 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.755 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.756 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.756 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.756 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.756 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.756 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.756 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.756 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.756 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.756 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.757 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.757 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.757 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:00.757 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:00.757 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.757 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.757 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.757 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.758 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.758 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.758 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.758 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.758 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.758 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.758 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.758 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.759 INFO:teuthology.orchestra.run.smithi019.stdout: "roption1": { 2024-09-19T09:05:00.759 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "roption1", 2024-09-19T09:05:00.759 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.760 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.760 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.760 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.760 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.760 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.760 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.760 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.760 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.761 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.761 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.761 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.761 INFO:teuthology.orchestra.run.smithi019.stdout: "roption2": { 2024-09-19T09:05:00.761 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "roption2", 2024-09-19T09:05:00.761 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.761 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.761 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.762 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "xyz", 2024-09-19T09:05:00.762 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.762 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.762 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.762 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.762 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.762 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.762 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.763 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.763 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption1": { 2024-09-19T09:05:00.763 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption1", 2024-09-19T09:05:00.763 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.763 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.763 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.763 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.764 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.764 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.764 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.764 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.764 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.764 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.764 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.764 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.765 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption2": { 2024-09-19T09:05:00.765 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption2", 2024-09-19T09:05:00.765 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.765 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.765 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.765 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.765 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.765 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.765 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.766 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.766 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.766 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.766 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.766 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.766 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption3": { 2024-09-19T09:05:00.766 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption3", 2024-09-19T09:05:00.766 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-19T09:05:00.767 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.767 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.767 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.767 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.767 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.767 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.767 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.767 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.768 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.768 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.768 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.768 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption4": { 2024-09-19T09:05:00.768 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption4", 2024-09-19T09:05:00.768 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.768 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.768 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.769 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.769 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.769 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.769 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.769 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.769 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.769 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.769 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.770 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.770 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption5": { 2024-09-19T09:05:00.770 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption5", 2024-09-19T09:05:00.770 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.770 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.770 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.770 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.770 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.771 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.771 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.771 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.771 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.771 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.771 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.771 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.771 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption6": { 2024-09-19T09:05:00.772 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption6", 2024-09-19T09:05:00.772 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.772 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.772 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.772 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.772 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.772 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.772 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.772 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.773 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.773 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.773 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.773 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.773 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption7": { 2024-09-19T09:05:00.773 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption7", 2024-09-19T09:05:00.773 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.773 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.774 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.774 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.774 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1", 2024-09-19T09:05:00.774 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "42", 2024-09-19T09:05:00.774 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.774 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.774 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.774 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.774 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.775 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.775 INFO:teuthology.orchestra.run.smithi019.stdout: "testkey": { 2024-09-19T09:05:00.775 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "testkey", 2024-09-19T09:05:00.775 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.775 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.775 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.775 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.775 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.775 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.776 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.776 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.776 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.776 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.776 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.776 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.776 INFO:teuthology.orchestra.run.smithi019.stdout: "testlkey": { 2024-09-19T09:05:00.776 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "testlkey", 2024-09-19T09:05:00.777 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.777 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.777 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.777 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.777 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.777 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.777 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.777 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.778 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.778 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.778 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.778 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.778 INFO:teuthology.orchestra.run.smithi019.stdout: "testnewline": { 2024-09-19T09:05:00.778 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "testnewline", 2024-09-19T09:05:00.778 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.778 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.778 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.779 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.779 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.779 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.779 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.779 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.779 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.779 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.779 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.780 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.780 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.780 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.780 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.780 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "snap_schedule", 2024-09-19T09:05:00.780 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:00.780 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:00.780 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:00.780 INFO:teuthology.orchestra.run.smithi019.stdout: "allow_m_granularity": { 2024-09-19T09:05:00.781 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "allow_m_granularity", 2024-09-19T09:05:00.781 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.781 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.781 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.781 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.781 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.781 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.781 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.782 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T09:05:00.782 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.782 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.782 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.782 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.782 INFO:teuthology.orchestra.run.smithi019.stdout: "dump_on_update": { 2024-09-19T09:05:00.782 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "dump_on_update", 2024-09-19T09:05:00.782 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.782 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.783 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.783 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.783 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.783 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.783 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.783 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "dump database to debug log on update", 2024-09-19T09:05:00.783 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.783 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.783 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.784 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.784 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:00.784 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:00.784 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.784 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.784 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.784 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.784 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.785 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.785 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.785 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.785 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.785 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.785 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.785 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.785 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.785 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.786 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.786 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.786 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.786 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.786 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.786 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:00.786 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:00.787 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.787 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.787 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.787 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.787 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.787 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.787 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.787 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.787 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.788 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.788 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.788 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.788 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:00.788 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:00.788 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.788 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.788 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.789 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:00.789 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.789 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.789 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.789 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.789 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.789 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.789 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.789 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.790 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.790 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.790 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.790 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.790 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.790 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.790 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.790 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:00.791 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:00.791 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.791 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.791 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.791 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.791 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.791 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.791 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.792 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.792 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.792 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.792 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.792 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.792 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.792 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.792 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.793 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "stats", 2024-09-19T09:05:00.793 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:00.793 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:00.793 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:00.793 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:00.793 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:00.793 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.793 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.793 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.794 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.794 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.794 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.794 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.794 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.794 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.794 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.794 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.795 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.795 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.795 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.795 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.795 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.795 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.795 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.795 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.796 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:00.796 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:00.796 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.796 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.796 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.796 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.796 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.796 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.796 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.797 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.797 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.797 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.797 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.797 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.797 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:00.797 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:00.797 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.798 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.798 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.798 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:00.798 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.798 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.798 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.798 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.798 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.799 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.799 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.799 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.799 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.799 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.799 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.799 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.799 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.800 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.800 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.800 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:00.800 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:00.800 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.800 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.800 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.800 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.801 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.801 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.801 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.801 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.801 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.801 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.801 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.801 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.801 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.802 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.802 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.802 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "status", 2024-09-19T09:05:00.802 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:00.802 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:00.802 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:00.802 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:00.802 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:00.803 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.803 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.803 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.803 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.803 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.803 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.803 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.803 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.803 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.804 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.804 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.804 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.804 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.804 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.804 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.804 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.804 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.805 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.805 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.805 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:00.805 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:00.805 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.805 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.805 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.805 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.805 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.806 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.806 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.806 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.806 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.806 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.806 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.806 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.806 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:00.807 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:00.807 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.807 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.807 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.807 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:00.807 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.807 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.807 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.807 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.808 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.808 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.808 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.808 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.808 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.808 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.808 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.808 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.809 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.809 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.809 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.809 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:00.809 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:00.809 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.810 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.810 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.810 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.810 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.810 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.810 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.810 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.810 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.811 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.811 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.811 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.811 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.811 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.811 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.811 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "telegraf", 2024-09-19T09:05:00.811 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:00.812 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:00.812 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:00.812 INFO:teuthology.orchestra.run.smithi019.stdout: "address": { 2024-09-19T09:05:00.812 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "address", 2024-09-19T09:05:00.812 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.812 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.812 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.812 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T09:05:00.813 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.813 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.813 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.813 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.813 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.813 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.813 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.813 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.813 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-19T09:05:00.814 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-19T09:05:00.814 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:00.814 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.814 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.814 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "15", 2024-09-19T09:05:00.814 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.814 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.814 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.815 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.815 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.815 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.815 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.815 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.815 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:00.815 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:00.815 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.816 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.816 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.816 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.816 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.816 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.816 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.816 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.816 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.817 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.817 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.817 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.817 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.817 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.817 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.817 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.817 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.818 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.818 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.818 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:00.818 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:00.818 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.818 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.818 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.818 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.818 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.819 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.819 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.819 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.819 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.819 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.819 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.819 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.819 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:00.820 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:00.820 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.820 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.820 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.820 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:00.820 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.820 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.820 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.821 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.821 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.821 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.821 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.821 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.821 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.821 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.821 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.821 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.822 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.822 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.822 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.822 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:00.822 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:00.822 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.822 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.822 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.823 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.823 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.823 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.823 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.823 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.823 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.823 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.823 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.824 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.824 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.824 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.824 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.824 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "telemetry", 2024-09-19T09:05:00.824 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:00.824 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:00.824 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:00.825 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_basic": { 2024-09-19T09:05:00.825 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_basic", 2024-09-19T09:05:00.825 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.825 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.825 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.825 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.825 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.825 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.825 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.826 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T09:05:00.826 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.826 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.826 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.826 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.826 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_crash": { 2024-09-19T09:05:00.826 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_crash", 2024-09-19T09:05:00.826 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.827 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.827 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.827 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.827 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.827 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.827 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.827 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T09:05:00.827 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.827 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.828 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.828 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.828 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_device": { 2024-09-19T09:05:00.828 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_device", 2024-09-19T09:05:00.828 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.828 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.828 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.828 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.829 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.829 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.829 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.829 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T09:05:00.829 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.829 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.829 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.829 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.830 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_ident": { 2024-09-19T09:05:00.830 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_ident", 2024-09-19T09:05:00.830 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.830 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.830 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.830 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.830 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.830 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.831 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.831 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T09:05:00.831 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.831 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.831 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.831 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.831 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_perf": { 2024-09-19T09:05:00.831 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_perf", 2024-09-19T09:05:00.832 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.832 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.832 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.832 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.832 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.832 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.832 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.832 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T09:05:00.833 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.833 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.833 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.833 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.833 INFO:teuthology.orchestra.run.smithi019.stdout: "contact": { 2024-09-19T09:05:00.833 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "contact", 2024-09-19T09:05:00.833 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.833 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.834 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.834 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.834 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.834 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.834 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.834 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.834 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.834 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.835 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.835 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.835 INFO:teuthology.orchestra.run.smithi019.stdout: "description": { 2024-09-19T09:05:00.835 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "description", 2024-09-19T09:05:00.835 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.835 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.835 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.835 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.836 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.836 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.836 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.836 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.836 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.836 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.836 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.836 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.837 INFO:teuthology.orchestra.run.smithi019.stdout: "device_url": { 2024-09-19T09:05:00.837 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "device_url", 2024-09-19T09:05:00.837 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.837 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.837 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.837 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T09:05:00.837 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.837 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.838 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.838 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.838 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.838 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.838 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.838 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.838 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": { 2024-09-19T09:05:00.838 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "enabled", 2024-09-19T09:05:00.839 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.839 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.839 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.839 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.839 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.839 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.839 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.839 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.840 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.840 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.840 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.840 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.840 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-19T09:05:00.840 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-19T09:05:00.840 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.840 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.841 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.841 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "24", 2024-09-19T09:05:00.841 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "8", 2024-09-19T09:05:00.841 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.841 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.841 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.841 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.841 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.842 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.842 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.842 INFO:teuthology.orchestra.run.smithi019.stdout: "last_opt_revision": { 2024-09-19T09:05:00.842 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "last_opt_revision", 2024-09-19T09:05:00.842 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.842 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.842 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.842 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "1", 2024-09-19T09:05:00.843 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.843 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.843 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.843 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.843 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.843 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.843 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.843 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.843 INFO:teuthology.orchestra.run.smithi019.stdout: "leaderboard": { 2024-09-19T09:05:00.844 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "leaderboard", 2024-09-19T09:05:00.844 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.844 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.844 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.844 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.844 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.844 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.844 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.845 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.845 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.845 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.845 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.845 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.845 INFO:teuthology.orchestra.run.smithi019.stdout: "leaderboard_description": { 2024-09-19T09:05:00.845 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "leaderboard_description", 2024-09-19T09:05:00.845 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.846 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.846 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.846 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.846 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.846 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.846 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.846 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.846 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.846 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.847 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.847 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.847 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:00.847 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:00.847 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.847 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.847 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.847 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.848 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.848 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.848 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.848 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.848 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.848 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.848 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.848 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.849 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.849 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.849 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.849 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.849 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.849 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.849 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.849 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:00.849 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:00.850 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.850 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.850 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.850 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.850 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.850 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.850 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.850 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.851 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.851 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.851 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.851 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.851 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:00.851 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:00.851 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.851 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.852 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.852 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:00.852 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.852 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.852 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.852 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.852 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.852 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.853 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.853 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.853 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.853 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.853 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.853 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.853 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.853 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.854 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.854 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:00.854 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:00.854 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.854 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.854 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.854 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.854 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.855 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.855 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.855 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.855 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.855 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.855 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.855 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.855 INFO:teuthology.orchestra.run.smithi019.stdout: "organization": { 2024-09-19T09:05:00.855 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "organization", 2024-09-19T09:05:00.856 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.856 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.856 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.856 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.856 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.856 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.856 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.856 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.857 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.857 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.857 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.857 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.857 INFO:teuthology.orchestra.run.smithi019.stdout: "proxy": { 2024-09-19T09:05:00.857 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "proxy", 2024-09-19T09:05:00.857 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.857 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.858 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.858 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.858 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.858 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.858 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.858 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.858 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.858 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.859 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.859 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.859 INFO:teuthology.orchestra.run.smithi019.stdout: "url": { 2024-09-19T09:05:00.859 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "url", 2024-09-19T09:05:00.859 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.859 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.859 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.859 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T09:05:00.859 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.860 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.860 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.860 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.860 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.860 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.860 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.860 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.860 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.861 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.861 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.861 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "test_orchestrator", 2024-09-19T09:05:00.861 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:00.861 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:00.861 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:00.861 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:00.861 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:00.862 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.862 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.862 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.862 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.862 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.862 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.862 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.862 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.862 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.863 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.863 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.863 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.863 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.863 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.863 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.863 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.863 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.863 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.864 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.864 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:00.864 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:00.864 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.864 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.864 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.864 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.864 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.865 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.865 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.865 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.865 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.865 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.865 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.865 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.865 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:00.865 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:00.866 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.866 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.866 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.866 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:00.866 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.866 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.866 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.866 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.867 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.867 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.867 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.867 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.867 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.867 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.867 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.867 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.868 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.868 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.868 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.868 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:00.868 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:00.868 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.868 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.868 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.868 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.869 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.869 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.869 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.869 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.869 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.869 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.869 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.869 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.870 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.870 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.870 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.870 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "volumes", 2024-09-19T09:05:00.870 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:00.870 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:00.870 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:00.870 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:00.870 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:00.871 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.871 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.871 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.871 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.871 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.871 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.871 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.871 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.872 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.872 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.872 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.872 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.872 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.872 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.872 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.872 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.872 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.873 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.873 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.873 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:00.873 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:00.873 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.873 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.873 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.873 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.874 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.874 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.874 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.874 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.874 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.874 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.874 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.874 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.875 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:00.875 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:00.875 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.875 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.875 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.875 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:00.875 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.875 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.876 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.876 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.876 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.876 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.876 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.876 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.876 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.876 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.877 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.877 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.877 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.877 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.877 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.877 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:00.877 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:00.877 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.878 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.878 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.878 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.878 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.878 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.878 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.878 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.878 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.878 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.879 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.879 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.879 INFO:teuthology.orchestra.run.smithi019.stdout: "max_concurrent_clones": { 2024-09-19T09:05:00.879 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_concurrent_clones", 2024-09-19T09:05:00.879 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.879 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.879 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.879 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "4", 2024-09-19T09:05:00.880 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.880 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.880 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.880 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T09:05:00.880 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.880 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.880 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.880 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.881 INFO:teuthology.orchestra.run.smithi019.stdout: "periodic_async_work": { 2024-09-19T09:05:00.881 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "periodic_async_work", 2024-09-19T09:05:00.881 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.881 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.881 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.881 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.881 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.881 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.882 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.882 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Periodically check for async work", 2024-09-19T09:05:00.882 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.882 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.882 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.882 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.882 INFO:teuthology.orchestra.run.smithi019.stdout: "snapshot_clone_delay": { 2024-09-19T09:05:00.882 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "snapshot_clone_delay", 2024-09-19T09:05:00.882 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.883 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.883 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.883 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-19T09:05:00.883 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.883 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.883 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.883 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T09:05:00.883 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.884 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.884 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.884 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.884 INFO:teuthology.orchestra.run.smithi019.stdout: "snapshot_clone_no_wait": { 2024-09-19T09:05:00.884 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T09:05:00.884 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.884 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.884 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.885 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.885 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.885 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.885 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.885 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T09:05:00.885 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.885 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.885 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.885 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.886 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.886 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.886 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.886 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "zabbix", 2024-09-19T09:05:00.886 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:00.886 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:00.886 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:00.886 INFO:teuthology.orchestra.run.smithi019.stdout: "discovery_interval": { 2024-09-19T09:05:00.887 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "discovery_interval", 2024-09-19T09:05:00.887 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-19T09:05:00.887 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.887 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.887 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "100", 2024-09-19T09:05:00.887 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.887 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.887 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.888 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.888 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.888 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.888 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.888 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.888 INFO:teuthology.orchestra.run.smithi019.stdout: "identifier": { 2024-09-19T09:05:00.888 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "identifier", 2024-09-19T09:05:00.888 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.889 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.889 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.889 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.889 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.889 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.889 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.889 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.889 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.889 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.890 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.890 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.890 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-19T09:05:00.890 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-19T09:05:00.890 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:00.890 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.890 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.890 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-19T09:05:00.891 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.891 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.891 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.891 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.891 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.891 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.891 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.891 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.891 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:00.892 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:00.892 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.892 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.892 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.892 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.892 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.892 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.892 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.893 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.893 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.893 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.893 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.893 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.893 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.893 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.893 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.893 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.894 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.894 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.894 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.894 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:00.894 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:00.894 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.894 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.894 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.894 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.895 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.895 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.895 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.895 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.895 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.895 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.895 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.895 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.896 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:00.896 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:00.896 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.896 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.896 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.896 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:00.896 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.896 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.897 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.897 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.897 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.897 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.897 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.897 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.897 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.897 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.897 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.898 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.898 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.898 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.898 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.898 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:00.898 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:00.898 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.898 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.899 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.899 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.899 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.899 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.899 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.899 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.899 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.899 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.899 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.900 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.900 INFO:teuthology.orchestra.run.smithi019.stdout: "zabbix_host": { 2024-09-19T09:05:00.900 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "zabbix_host", 2024-09-19T09:05:00.900 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.900 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.900 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.900 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.900 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.901 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.901 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.901 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.901 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.901 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.901 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.901 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.901 INFO:teuthology.orchestra.run.smithi019.stdout: "zabbix_port": { 2024-09-19T09:05:00.902 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "zabbix_port", 2024-09-19T09:05:00.902 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.902 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.902 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.902 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10051", 2024-09-19T09:05:00.902 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.902 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.902 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.902 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.903 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.903 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.903 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.903 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.903 INFO:teuthology.orchestra.run.smithi019.stdout: "zabbix_sender": { 2024-09-19T09:05:00.903 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "zabbix_sender", 2024-09-19T09:05:00.903 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.903 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.904 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.904 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T09:05:00.904 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.904 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.904 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.904 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.904 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.904 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.905 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.905 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.905 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.905 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.905 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-19T09:05:00.905 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.905 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.905 INFO:teuthology.orchestra.run.smithi019.stdout: "gid": 24110, 2024-09-19T09:05:00.905 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "y", 2024-09-19T09:05:00.906 INFO:teuthology.orchestra.run.smithi019.stdout: "mgr_features": 4540701547738038271, 2024-09-19T09:05:00.906 INFO:teuthology.orchestra.run.smithi019.stdout: "available_modules": [ 2024-09-19T09:05:00.906 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.906 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "alerts", 2024-09-19T09:05:00.906 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:00.906 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:00.906 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:00.906 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-19T09:05:00.907 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-19T09:05:00.907 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:00.907 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.907 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.907 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-19T09:05:00.907 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.907 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.907 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.908 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T09:05:00.908 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.908 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.908 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.908 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.908 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:00.908 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:00.908 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.908 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.909 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.909 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.909 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.909 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.909 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.909 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.909 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.909 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.910 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.910 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.910 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.910 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.910 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.910 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.910 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.910 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.911 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.911 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:00.911 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:00.911 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.911 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.911 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.911 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.911 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.911 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.912 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.912 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.912 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.912 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.912 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.912 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.912 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:00.912 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:00.913 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.913 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.913 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.913 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:00.913 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.913 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.913 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.913 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.914 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.914 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.914 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.914 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.914 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.914 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.914 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.914 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.915 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.915 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.915 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.915 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:00.915 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:00.915 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.915 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.915 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.916 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.916 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.916 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.916 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.916 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.916 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.916 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.916 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.917 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.917 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_destination": { 2024-09-19T09:05:00.917 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_destination", 2024-09-19T09:05:00.917 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.917 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.917 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.917 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.917 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.917 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.918 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.918 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Email address to send alerts to", 2024-09-19T09:05:00.918 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.918 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.918 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.918 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.918 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_from_name": { 2024-09-19T09:05:00.918 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_from_name", 2024-09-19T09:05:00.919 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.919 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.919 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.919 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "Ceph", 2024-09-19T09:05:00.919 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.919 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.919 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.919 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Email From: name", 2024-09-19T09:05:00.919 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.920 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.920 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.920 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.920 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_host": { 2024-09-19T09:05:00.920 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_host", 2024-09-19T09:05:00.920 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.920 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.921 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.921 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.921 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.921 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.921 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.921 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "SMTP server", 2024-09-19T09:05:00.921 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.921 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.922 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.922 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.922 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_password": { 2024-09-19T09:05:00.922 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_password", 2024-09-19T09:05:00.922 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.922 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.922 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.922 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.922 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.923 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.923 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.923 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Password to authenticate with", 2024-09-19T09:05:00.923 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.923 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.923 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.923 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.923 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_port": { 2024-09-19T09:05:00.924 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_port", 2024-09-19T09:05:00.924 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.924 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.924 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.924 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "465", 2024-09-19T09:05:00.924 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.924 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.924 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.925 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "SMTP port", 2024-09-19T09:05:00.925 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.925 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.925 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.925 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.925 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_sender": { 2024-09-19T09:05:00.925 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_sender", 2024-09-19T09:05:00.925 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.926 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.926 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.926 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.926 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.926 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.926 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.926 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "SMTP envelope sender", 2024-09-19T09:05:00.926 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.927 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.927 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.927 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.927 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_ssl": { 2024-09-19T09:05:00.927 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_ssl", 2024-09-19T09:05:00.927 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.927 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.928 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.928 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.928 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.928 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.928 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.928 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T09:05:00.928 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.928 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.928 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.929 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.929 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_user": { 2024-09-19T09:05:00.929 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_user", 2024-09-19T09:05:00.929 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.929 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.929 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.929 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.929 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.930 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.930 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.930 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "User to authenticate as", 2024-09-19T09:05:00.930 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.930 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.930 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.930 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.930 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.931 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.931 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.931 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "balancer", 2024-09-19T09:05:00.931 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:00.931 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:00.931 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:00.931 INFO:teuthology.orchestra.run.smithi019.stdout: "active": { 2024-09-19T09:05:00.931 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "active", 2024-09-19T09:05:00.931 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.932 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.932 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.932 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.932 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.932 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.932 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.932 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T09:05:00.932 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.933 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.933 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.933 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.933 INFO:teuthology.orchestra.run.smithi019.stdout: "begin_time": { 2024-09-19T09:05:00.933 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "begin_time", 2024-09-19T09:05:00.933 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.933 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.933 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.934 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0000", 2024-09-19T09:05:00.934 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.934 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.934 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.934 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T09:05:00.934 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:05:00.934 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.934 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.934 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.935 INFO:teuthology.orchestra.run.smithi019.stdout: "begin_weekday": { 2024-09-19T09:05:00.935 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "begin_weekday", 2024-09-19T09:05:00.935 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-19T09:05:00.935 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.935 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.935 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-19T09:05:00.935 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "0", 2024-09-19T09:05:00.935 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "6", 2024-09-19T09:05:00.936 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.936 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T09:05:00.936 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:05:00.936 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.936 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.936 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.936 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_compat_max_iterations": { 2024-09-19T09:05:00.936 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crush_compat_max_iterations", 2024-09-19T09:05:00.937 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-19T09:05:00.937 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.937 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.937 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "25", 2024-09-19T09:05:00.937 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1", 2024-09-19T09:05:00.937 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "250", 2024-09-19T09:05:00.937 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.937 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T09:05:00.937 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.938 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.938 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.938 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.938 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_compat_metrics": { 2024-09-19T09:05:00.938 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crush_compat_metrics", 2024-09-19T09:05:00.938 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.938 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.938 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.939 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T09:05:00.939 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.939 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.939 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.939 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T09:05:00.939 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T09:05:00.939 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.939 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.939 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.940 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_compat_step": { 2024-09-19T09:05:00.940 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crush_compat_step", 2024-09-19T09:05:00.940 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-19T09:05:00.940 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.940 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.940 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0.5", 2024-09-19T09:05:00.940 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "0.001", 2024-09-19T09:05:00.940 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "0.999", 2024-09-19T09:05:00.941 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.941 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "aggressiveness of optimization", 2024-09-19T09:05:00.941 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T09:05:00.941 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.941 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.941 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.941 INFO:teuthology.orchestra.run.smithi019.stdout: "end_time": { 2024-09-19T09:05:00.941 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "end_time", 2024-09-19T09:05:00.942 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.942 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.942 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.942 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "2359", 2024-09-19T09:05:00.942 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.942 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.942 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.942 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T09:05:00.942 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:05:00.943 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.943 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.943 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.943 INFO:teuthology.orchestra.run.smithi019.stdout: "end_weekday": { 2024-09-19T09:05:00.943 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "end_weekday", 2024-09-19T09:05:00.943 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-19T09:05:00.943 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.943 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.944 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-19T09:05:00.944 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "0", 2024-09-19T09:05:00.944 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "6", 2024-09-19T09:05:00.944 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.944 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T09:05:00.944 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:05:00.944 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.944 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.944 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.945 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:00.945 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:00.945 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.945 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.945 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.945 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.945 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.945 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.946 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.946 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.946 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.946 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.946 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.946 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.946 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.946 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.947 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.947 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.947 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.947 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.947 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.947 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:00.947 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:00.947 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.948 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.948 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.948 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.948 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.948 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.948 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.948 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.948 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.949 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.949 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.949 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.949 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:00.949 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:00.949 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.949 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.949 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.950 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:00.950 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.950 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.950 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.950 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:00.950 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:00.950 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:00.950 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:00.951 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:00.951 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:00.951 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.951 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.951 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.951 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.951 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.951 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.951 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:00.952 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:00.952 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.952 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.952 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.952 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.952 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.952 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.952 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.953 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:00.953 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.953 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.953 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.953 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.953 INFO:teuthology.orchestra.run.smithi019.stdout: "min_score": { 2024-09-19T09:05:00.953 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "min_score", 2024-09-19T09:05:00.953 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-19T09:05:00.954 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.954 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.954 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-19T09:05:00.954 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.954 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.954 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.954 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T09:05:00.954 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.954 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.955 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.955 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.955 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": { 2024-09-19T09:05:00.955 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mode", 2024-09-19T09:05:00.955 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.955 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.955 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.955 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "upmap", 2024-09-19T09:05:00.956 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.956 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.956 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.956 INFO:teuthology.orchestra.run.smithi019.stdout: "crush-compat", 2024-09-19T09:05:00.956 INFO:teuthology.orchestra.run.smithi019.stdout: "none", 2024-09-19T09:05:00.956 INFO:teuthology.orchestra.run.smithi019.stdout: "read", 2024-09-19T09:05:00.956 INFO:teuthology.orchestra.run.smithi019.stdout: "upmap", 2024-09-19T09:05:00.956 INFO:teuthology.orchestra.run.smithi019.stdout: "upmap-read" 2024-09-19T09:05:00.957 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.957 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Balancer mode", 2024-09-19T09:05:00.957 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.957 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.957 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.957 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.957 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_ids": { 2024-09-19T09:05:00.957 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "pool_ids", 2024-09-19T09:05:00.957 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.958 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.958 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.958 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.958 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.958 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.958 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.958 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T09:05:00.958 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.959 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.959 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.959 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.959 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-19T09:05:00.959 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-19T09:05:00.959 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:00.959 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.959 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.959 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-19T09:05:00.960 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.960 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.960 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.960 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T09:05:00.960 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.960 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.960 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.960 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.960 INFO:teuthology.orchestra.run.smithi019.stdout: "upmap_max_deviation": { 2024-09-19T09:05:00.961 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "upmap_max_deviation", 2024-09-19T09:05:00.961 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.961 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.961 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.961 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-19T09:05:00.961 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1", 2024-09-19T09:05:00.961 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.961 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.962 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T09:05:00.962 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T09:05:00.962 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.962 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.962 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.962 INFO:teuthology.orchestra.run.smithi019.stdout: "upmap_max_optimizations": { 2024-09-19T09:05:00.962 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "upmap_max_optimizations", 2024-09-19T09:05:00.962 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-19T09:05:00.963 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.963 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.963 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-19T09:05:00.963 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.963 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.963 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.963 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T09:05:00.963 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.963 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.964 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.964 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.964 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:00.964 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.964 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:00.964 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cephadm", 2024-09-19T09:05:00.964 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:00.964 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:00.964 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:00.965 INFO:teuthology.orchestra.run.smithi019.stdout: "agent_down_multiplier": { 2024-09-19T09:05:00.965 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "agent_down_multiplier", 2024-09-19T09:05:00.965 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-19T09:05:00.965 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.965 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.965 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "3.0", 2024-09-19T09:05:00.965 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.965 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.966 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.966 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T09:05:00.966 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.966 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.966 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.966 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.966 INFO:teuthology.orchestra.run.smithi019.stdout: "agent_refresh_rate": { 2024-09-19T09:05:00.966 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "agent_refresh_rate", 2024-09-19T09:05:00.967 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:00.967 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.967 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.967 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "20", 2024-09-19T09:05:00.967 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.967 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.967 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.967 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T09:05:00.968 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.968 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.968 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.968 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.968 INFO:teuthology.orchestra.run.smithi019.stdout: "agent_starting_port": { 2024-09-19T09:05:00.968 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "agent_starting_port", 2024-09-19T09:05:00.968 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:00.968 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.968 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.969 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "4721", 2024-09-19T09:05:00.969 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.969 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.969 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.969 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T09:05:00.969 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.969 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.970 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.970 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.970 INFO:teuthology.orchestra.run.smithi019.stdout: "allow_ptrace": { 2024-09-19T09:05:00.970 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "allow_ptrace", 2024-09-19T09:05:00.970 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.970 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.970 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.970 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.970 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.971 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.971 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.971 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T09:05:00.971 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T09:05:00.971 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.971 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.971 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.971 INFO:teuthology.orchestra.run.smithi019.stdout: "autotune_interval": { 2024-09-19T09:05:00.972 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "autotune_interval", 2024-09-19T09:05:00.972 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:00.972 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.972 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.972 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-19T09:05:00.972 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.972 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.972 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.972 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T09:05:00.973 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.973 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.973 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.973 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.973 INFO:teuthology.orchestra.run.smithi019.stdout: "autotune_memory_target_ratio": { 2024-09-19T09:05:00.973 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T09:05:00.973 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-19T09:05:00.973 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.974 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.974 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0.7", 2024-09-19T09:05:00.974 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.974 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.974 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.974 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T09:05:00.974 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.974 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.975 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.975 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.975 INFO:teuthology.orchestra.run.smithi019.stdout: "cephadm_log_destination": { 2024-09-19T09:05:00.975 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cephadm_log_destination", 2024-09-19T09:05:00.975 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.975 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.975 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.975 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:00.975 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.976 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.976 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:00.976 INFO:teuthology.orchestra.run.smithi019.stdout: "file", 2024-09-19T09:05:00.976 INFO:teuthology.orchestra.run.smithi019.stdout: "file,syslog", 2024-09-19T09:05:00.976 INFO:teuthology.orchestra.run.smithi019.stdout: "syslog" 2024-09-19T09:05:00.976 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:00.976 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T09:05:00.976 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.977 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.977 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.977 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.977 INFO:teuthology.orchestra.run.smithi019.stdout: "cgroups_split": { 2024-09-19T09:05:00.977 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cgroups_split", 2024-09-19T09:05:00.977 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.977 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.977 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.977 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.978 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.978 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.978 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.978 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T09:05:00.978 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.978 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.978 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.978 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.979 INFO:teuthology.orchestra.run.smithi019.stdout: "config_checks_enabled": { 2024-09-19T09:05:00.979 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "config_checks_enabled", 2024-09-19T09:05:00.979 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.979 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.979 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.979 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:00.979 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.979 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.980 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.980 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T09:05:00.980 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.980 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.980 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.980 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.980 INFO:teuthology.orchestra.run.smithi019.stdout: "config_dashboard": { 2024-09-19T09:05:00.980 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "config_dashboard", 2024-09-19T09:05:00.981 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:00.981 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.981 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.981 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:00.981 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.981 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.981 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.981 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T09:05:00.982 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.982 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.982 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.982 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.982 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_alertmanager": { 2024-09-19T09:05:00.982 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_alertmanager", 2024-09-19T09:05:00.982 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.982 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.982 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.983 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T09:05:00.983 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.983 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.983 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.983 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Prometheus container image", 2024-09-19T09:05:00.983 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.983 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.983 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.984 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.984 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_base": { 2024-09-19T09:05:00.984 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_base", 2024-09-19T09:05:00.984 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.984 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.984 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:00.984 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T09:05:00.984 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.985 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.985 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.985 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Container image name, without the tag", 2024-09-19T09:05:00.985 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.985 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.985 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.985 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.985 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_elasticsearch": { 2024-09-19T09:05:00.985 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_elasticsearch", 2024-09-19T09:05:00.986 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.986 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.986 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.986 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T09:05:00.986 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.986 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.986 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.986 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "elasticsearch container image", 2024-09-19T09:05:00.987 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.987 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.987 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.987 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.987 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_grafana": { 2024-09-19T09:05:00.987 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_grafana", 2024-09-19T09:05:00.987 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.987 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.988 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.988 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T09:05:00.988 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.988 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.988 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.988 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Prometheus container image", 2024-09-19T09:05:00.988 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.988 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.988 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.989 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.989 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_haproxy": { 2024-09-19T09:05:00.989 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_haproxy", 2024-09-19T09:05:00.989 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.989 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.989 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.989 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T09:05:00.990 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.990 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.990 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.990 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "HAproxy container image", 2024-09-19T09:05:00.990 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.990 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.990 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.990 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.990 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_jaeger_agent": { 2024-09-19T09:05:00.991 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_jaeger_agent", 2024-09-19T09:05:00.991 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.991 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.991 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.991 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T09:05:00.991 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.991 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.991 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.992 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Jaeger agent container image", 2024-09-19T09:05:00.992 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.992 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.992 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.992 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.992 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_jaeger_collector": { 2024-09-19T09:05:00.992 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_jaeger_collector", 2024-09-19T09:05:00.992 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.992 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.993 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.993 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T09:05:00.993 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.993 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.993 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.993 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Jaeger collector container image", 2024-09-19T09:05:00.993 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.993 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.994 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.994 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.994 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_jaeger_query": { 2024-09-19T09:05:00.994 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_jaeger_query", 2024-09-19T09:05:00.994 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.994 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.994 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.994 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T09:05:00.995 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.995 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.995 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.995 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Jaeger query container image", 2024-09-19T09:05:00.995 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.995 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.995 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.995 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.995 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_keepalived": { 2024-09-19T09:05:00.996 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_keepalived", 2024-09-19T09:05:00.996 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.996 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.996 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.996 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T09:05:00.996 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.996 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.996 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.997 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Keepalived container image", 2024-09-19T09:05:00.997 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.997 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.997 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.997 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.997 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_loki": { 2024-09-19T09:05:00.997 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_loki", 2024-09-19T09:05:00.997 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.998 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.998 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:00.998 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T09:05:00.998 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:00.998 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:00.998 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:00.998 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Loki container image", 2024-09-19T09:05:00.998 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:00.999 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:00.999 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:00.999 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:00.999 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_node_exporter": { 2024-09-19T09:05:00.999 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_node_exporter", 2024-09-19T09:05:00.999 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:00.999 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:00.999 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.000 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T09:05:01.000 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.000 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.000 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.000 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Prometheus container image", 2024-09-19T09:05:01.000 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.000 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.000 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.001 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.001 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_nvmeof": { 2024-09-19T09:05:01.001 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_nvmeof", 2024-09-19T09:05:01.001 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.001 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.001 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.001 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T09:05:01.001 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.001 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.002 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.002 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Nvme-of container image", 2024-09-19T09:05:01.002 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.002 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.002 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.002 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.002 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_prometheus": { 2024-09-19T09:05:01.002 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_prometheus", 2024-09-19T09:05:01.003 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.003 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.003 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.003 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T09:05:01.003 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.003 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.003 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.003 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Prometheus container image", 2024-09-19T09:05:01.004 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.004 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.004 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.004 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.004 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_promtail": { 2024-09-19T09:05:01.004 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_promtail", 2024-09-19T09:05:01.004 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.004 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.005 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.005 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T09:05:01.005 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.005 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.005 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.005 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Promtail container image", 2024-09-19T09:05:01.005 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.005 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.006 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.006 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.006 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_samba": { 2024-09-19T09:05:01.006 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_samba", 2024-09-19T09:05:01.006 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.006 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.006 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.006 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T09:05:01.006 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.007 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.007 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.007 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Samba/SMB container image", 2024-09-19T09:05:01.007 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.007 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.007 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.007 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.007 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_snmp_gateway": { 2024-09-19T09:05:01.007 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_snmp_gateway", 2024-09-19T09:05:01.008 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.008 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.008 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.008 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T09:05:01.008 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.008 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.008 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.008 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "SNMP Gateway container image", 2024-09-19T09:05:01.009 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.009 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.009 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.009 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.009 INFO:teuthology.orchestra.run.smithi019.stdout: "container_init": { 2024-09-19T09:05:01.009 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_init", 2024-09-19T09:05:01.009 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.009 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.010 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.010 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.010 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.010 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.010 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.010 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T09:05:01.010 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.010 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.011 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.011 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.011 INFO:teuthology.orchestra.run.smithi019.stdout: "daemon_cache_timeout": { 2024-09-19T09:05:01.011 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "daemon_cache_timeout", 2024-09-19T09:05:01.011 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:01.011 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.011 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.011 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-19T09:05:01.012 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.012 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.012 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.012 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T09:05:01.012 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.012 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.012 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.012 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.012 INFO:teuthology.orchestra.run.smithi019.stdout: "default_cephadm_command_timeout": { 2024-09-19T09:05:01.013 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T09:05:01.013 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.013 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.013 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.013 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "900", 2024-09-19T09:05:01.013 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.013 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.013 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.014 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T09:05:01.014 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.014 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.014 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.014 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.014 INFO:teuthology.orchestra.run.smithi019.stdout: "default_registry": { 2024-09-19T09:05:01.014 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "default_registry", 2024-09-19T09:05:01.014 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.015 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.015 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.015 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "docker.io", 2024-09-19T09:05:01.015 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.015 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.015 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.015 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T09:05:01.015 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.016 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.016 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.016 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.016 INFO:teuthology.orchestra.run.smithi019.stdout: "device_cache_timeout": { 2024-09-19T09:05:01.016 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "device_cache_timeout", 2024-09-19T09:05:01.016 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:01.016 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.016 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.017 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "1800", 2024-09-19T09:05:01.017 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.017 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.017 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.017 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "seconds to cache device inventory", 2024-09-19T09:05:01.017 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.017 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.017 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: "device_enhanced_scan": { 2024-09-19T09:05:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "device_enhanced_scan", 2024-09-19T09:05:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.018 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.019 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.019 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T09:05:01.019 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.019 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.019 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.019 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.019 INFO:teuthology.orchestra.run.smithi019.stdout: "facts_cache_timeout": { 2024-09-19T09:05:01.019 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "facts_cache_timeout", 2024-09-19T09:05:01.020 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:01.020 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.020 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.020 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-19T09:05:01.020 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.020 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.020 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.020 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "seconds to cache host facts data", 2024-09-19T09:05:01.021 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.021 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.021 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.021 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.021 INFO:teuthology.orchestra.run.smithi019.stdout: "grafana_dashboards_path": { 2024-09-19T09:05:01.021 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "grafana_dashboards_path", 2024-09-19T09:05:01.021 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.021 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.022 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.022 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T09:05:01.022 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.022 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.022 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.022 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T09:05:01.022 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.022 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.023 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.023 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.023 INFO:teuthology.orchestra.run.smithi019.stdout: "host_check_interval": { 2024-09-19T09:05:01.023 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "host_check_interval", 2024-09-19T09:05:01.023 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:01.023 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.023 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.023 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-19T09:05:01.024 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.024 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.024 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.024 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to perform a host check", 2024-09-19T09:05:01.024 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.024 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.024 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.024 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.025 INFO:teuthology.orchestra.run.smithi019.stdout: "hw_monitoring": { 2024-09-19T09:05:01.025 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "hw_monitoring", 2024-09-19T09:05:01.025 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.025 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.025 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.025 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.025 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.025 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.025 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.026 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T09:05:01.026 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.026 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.026 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.026 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.026 INFO:teuthology.orchestra.run.smithi019.stdout: "inventory_list_all": { 2024-09-19T09:05:01.026 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "inventory_list_all", 2024-09-19T09:05:01.026 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.027 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.027 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.027 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.027 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.027 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.027 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.027 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T09:05:01.027 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.028 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.028 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.028 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.028 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.028 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.028 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.028 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.028 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.029 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.029 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.029 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.029 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.029 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.029 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.029 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.029 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.030 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.030 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.030 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.030 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.030 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.030 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.030 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.030 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.030 INFO:teuthology.orchestra.run.smithi019.stdout: "log_refresh_metadata": { 2024-09-19T09:05:01.031 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_refresh_metadata", 2024-09-19T09:05:01.031 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.031 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.031 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.031 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.031 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.031 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.032 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.032 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T09:05:01.032 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.032 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.032 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.032 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.032 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.032 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.033 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.033 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.033 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.033 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.033 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.033 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.033 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.033 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T09:05:01.033 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.034 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.034 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.034 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.034 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.034 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.034 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.034 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.034 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.035 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.035 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.035 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.035 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.035 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.035 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.035 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.035 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.035 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.036 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.036 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.036 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.036 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.036 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.036 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.036 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.036 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.037 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.037 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.037 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.037 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.037 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.037 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.037 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.037 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.038 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.038 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.038 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.038 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.038 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.038 INFO:teuthology.orchestra.run.smithi019.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T09:05:01.038 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T09:05:01.038 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.038 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.039 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.039 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.039 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.039 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.039 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.039 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T09:05:01.039 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.039 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.040 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.040 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.040 INFO:teuthology.orchestra.run.smithi019.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T09:05:01.040 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T09:05:01.040 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.040 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.040 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.040 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "*", 2024-09-19T09:05:01.041 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.041 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.041 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.041 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T09:05:01.041 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.041 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.041 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.041 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.041 INFO:teuthology.orchestra.run.smithi019.stdout: "max_count_per_host": { 2024-09-19T09:05:01.042 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_count_per_host", 2024-09-19T09:05:01.042 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.042 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.042 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.042 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-19T09:05:01.042 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.042 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.042 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.043 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "max number of daemons per service per host", 2024-09-19T09:05:01.043 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.043 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.043 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.043 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.043 INFO:teuthology.orchestra.run.smithi019.stdout: "max_osd_draining_count": { 2024-09-19T09:05:01.043 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_osd_draining_count", 2024-09-19T09:05:01.043 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.044 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.044 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.044 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-19T09:05:01.044 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.044 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.044 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.044 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T09:05:01.044 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.045 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.045 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.045 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.045 INFO:teuthology.orchestra.run.smithi019.stdout: "migration_current": { 2024-09-19T09:05:01.045 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "migration_current", 2024-09-19T09:05:01.045 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.045 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.045 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.045 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.046 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.046 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.046 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.046 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "internal - do not modify", 2024-09-19T09:05:01.046 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.046 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.046 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.046 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.047 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": { 2024-09-19T09:05:01.047 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mode", 2024-09-19T09:05:01.047 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.047 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.047 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.047 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "root", 2024-09-19T09:05:01.047 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.047 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.048 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.048 INFO:teuthology.orchestra.run.smithi019.stdout: "cephadm-package", 2024-09-19T09:05:01.048 INFO:teuthology.orchestra.run.smithi019.stdout: "root" 2024-09-19T09:05:01.048 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.048 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T09:05:01.048 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.048 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.048 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.048 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.049 INFO:teuthology.orchestra.run.smithi019.stdout: "oob_default_addr": { 2024-09-19T09:05:01.049 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "oob_default_addr", 2024-09-19T09:05:01.049 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.049 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.049 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.049 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "169.254.1.1", 2024-09-19T09:05:01.049 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.049 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.050 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.050 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T09:05:01.050 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.050 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.050 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.050 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.050 INFO:teuthology.orchestra.run.smithi019.stdout: "prometheus_alerts_path": { 2024-09-19T09:05:01.050 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "prometheus_alerts_path", 2024-09-19T09:05:01.051 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.051 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.051 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.051 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T09:05:01.051 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.051 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.051 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.051 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T09:05:01.051 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.052 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.052 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.052 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.052 INFO:teuthology.orchestra.run.smithi019.stdout: "registry_insecure": { 2024-09-19T09:05:01.052 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "registry_insecure", 2024-09-19T09:05:01.052 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.052 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.053 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.053 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.053 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.053 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.053 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.053 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T09:05:01.053 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.053 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.053 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.054 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.054 INFO:teuthology.orchestra.run.smithi019.stdout: "registry_password": { 2024-09-19T09:05:01.054 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "registry_password", 2024-09-19T09:05:01.054 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.054 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.054 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.054 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.054 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.055 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.055 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.055 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T09:05:01.055 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.055 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.055 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.055 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.055 INFO:teuthology.orchestra.run.smithi019.stdout: "registry_url": { 2024-09-19T09:05:01.055 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "registry_url", 2024-09-19T09:05:01.056 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.056 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.056 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.056 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.056 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.056 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.056 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.056 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T09:05:01.057 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.057 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.057 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.057 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.057 INFO:teuthology.orchestra.run.smithi019.stdout: "registry_username": { 2024-09-19T09:05:01.057 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "registry_username", 2024-09-19T09:05:01.057 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.057 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.058 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.058 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.058 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.058 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.058 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.058 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T09:05:01.058 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.058 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.059 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.059 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.059 INFO:teuthology.orchestra.run.smithi019.stdout: "secure_monitoring_stack": { 2024-09-19T09:05:01.059 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "secure_monitoring_stack", 2024-09-19T09:05:01.059 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.059 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.059 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.059 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.060 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.060 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.060 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.060 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T09:05:01.060 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.060 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.060 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.060 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.060 INFO:teuthology.orchestra.run.smithi019.stdout: "service_discovery_port": { 2024-09-19T09:05:01.061 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "service_discovery_port", 2024-09-19T09:05:01.061 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.061 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.061 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.061 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8765", 2024-09-19T09:05:01.061 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.061 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.061 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.062 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "cephadm service discovery port", 2024-09-19T09:05:01.062 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.062 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.062 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.062 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.062 INFO:teuthology.orchestra.run.smithi019.stdout: "ssh_config_file": { 2024-09-19T09:05:01.062 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ssh_config_file", 2024-09-19T09:05:01.062 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.063 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.063 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.063 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.063 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.063 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.063 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.063 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T09:05:01.064 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.064 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.064 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.064 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.064 INFO:teuthology.orchestra.run.smithi019.stdout: "use_agent": { 2024-09-19T09:05:01.064 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "use_agent", 2024-09-19T09:05:01.064 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.064 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.065 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.065 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.065 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.065 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.065 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.065 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T09:05:01.065 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.065 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.065 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.066 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.066 INFO:teuthology.orchestra.run.smithi019.stdout: "use_repo_digest": { 2024-09-19T09:05:01.066 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "use_repo_digest", 2024-09-19T09:05:01.066 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.066 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.066 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.066 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.067 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.067 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.067 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.067 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T09:05:01.067 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.067 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.067 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.067 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.067 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_on_failed_host_check": { 2024-09-19T09:05:01.068 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_on_failed_host_check", 2024-09-19T09:05:01.068 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.068 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.068 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.068 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.068 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.068 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.068 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.069 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T09:05:01.069 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.069 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.069 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.069 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.069 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_on_stray_daemons": { 2024-09-19T09:05:01.069 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_on_stray_daemons", 2024-09-19T09:05:01.069 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.069 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.070 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.070 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.070 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.070 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.070 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.070 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T09:05:01.070 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.070 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.071 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.071 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.071 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_on_stray_hosts": { 2024-09-19T09:05:01.071 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_on_stray_hosts", 2024-09-19T09:05:01.071 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.071 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.071 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.071 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.071 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.072 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.072 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.072 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T09:05:01.072 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.072 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.072 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.072 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.073 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.073 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.073 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.073 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crash", 2024-09-19T09:05:01.073 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.073 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.073 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.073 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.073 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.074 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.074 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.074 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.074 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.074 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.074 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.074 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.074 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.075 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.075 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.075 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.075 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.075 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.075 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.075 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.075 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.075 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.076 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.076 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.076 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.076 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.076 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.076 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.076 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.076 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.077 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.077 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.077 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.077 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.077 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.077 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.077 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.077 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.077 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.078 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.078 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.078 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.078 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.078 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.078 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.078 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.078 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.079 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.079 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.079 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.079 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.079 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.079 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.079 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.079 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.080 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.080 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.080 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.080 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.080 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.080 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.080 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.080 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.081 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.081 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.081 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.081 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.081 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.081 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.081 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.081 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.081 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.082 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.082 INFO:teuthology.orchestra.run.smithi019.stdout: "retain_interval": { 2024-09-19T09:05:01.082 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "retain_interval", 2024-09-19T09:05:01.082 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:01.082 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.082 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.082 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "31536000", 2024-09-19T09:05:01.082 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.083 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.083 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.083 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T09:05:01.083 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.083 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.083 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.083 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.083 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_recent_interval": { 2024-09-19T09:05:01.084 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_recent_interval", 2024-09-19T09:05:01.084 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:01.084 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.084 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.084 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "1209600", 2024-09-19T09:05:01.084 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.084 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.084 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.084 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T09:05:01.085 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.085 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.085 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.085 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.085 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.085 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.085 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.085 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "dashboard", 2024-09-19T09:05:01.086 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.086 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.086 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.086 INFO:teuthology.orchestra.run.smithi019.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T09:05:01.086 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T09:05:01.086 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.086 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.086 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.086 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-19T09:05:01.087 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.087 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.087 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.087 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.087 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.087 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.087 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.087 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.088 INFO:teuthology.orchestra.run.smithi019.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T09:05:01.088 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T09:05:01.088 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.088 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.088 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.088 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.088 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.088 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.088 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.089 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.089 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.089 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.089 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.089 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.089 INFO:teuthology.orchestra.run.smithi019.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T09:05:01.089 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T09:05:01.089 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.090 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.090 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.090 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.090 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.090 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.090 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.090 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.090 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.091 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.091 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.091 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.091 INFO:teuthology.orchestra.run.smithi019.stdout: "AUDIT_API_ENABLED": { 2024-09-19T09:05:01.091 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T09:05:01.091 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.091 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.091 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.091 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.092 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.092 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.092 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.092 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.092 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.092 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.092 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.092 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.093 INFO:teuthology.orchestra.run.smithi019.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T09:05:01.093 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T09:05:01.093 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.093 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.093 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.093 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.093 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.093 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.094 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.094 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.094 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.094 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.094 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.094 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.094 INFO:teuthology.orchestra.run.smithi019.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T09:05:01.094 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T09:05:01.094 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.095 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.095 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.095 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.095 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.095 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.095 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.095 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.096 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.096 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.096 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.096 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.096 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T09:05:01.096 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T09:05:01.096 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.096 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.097 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.097 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.097 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.097 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.097 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.097 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.097 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.097 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.098 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.098 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.098 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T09:05:01.098 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T09:05:01.098 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.098 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.098 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.098 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.098 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.099 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.099 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.099 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.099 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.099 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.099 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.099 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.099 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T09:05:01.100 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T09:05:01.100 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.100 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.100 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.100 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.100 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.100 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.100 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.101 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.101 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.101 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.101 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.101 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.101 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T09:05:01.101 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T09:05:01.101 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.101 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.102 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.102 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.102 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.102 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.102 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.102 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.102 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.102 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.103 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.103 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.103 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T09:05:01.103 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T09:05:01.103 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.103 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.103 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.103 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.103 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.104 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.104 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.104 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.104 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.104 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.104 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.104 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.104 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T09:05:01.105 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T09:05:01.105 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.105 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.105 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.105 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.105 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.105 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.105 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.105 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.106 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.106 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.106 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.106 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.106 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T09:05:01.106 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T09:05:01.106 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.106 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.106 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.107 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.107 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.107 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.107 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.107 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.107 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.107 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.107 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.108 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.108 INFO:teuthology.orchestra.run.smithi019.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T09:05:01.108 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T09:05:01.108 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.108 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.108 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.108 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.108 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.108 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.109 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.109 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.109 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.109 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.109 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.109 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.109 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T09:05:01.109 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T09:05:01.110 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.110 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.110 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.110 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "admin", 2024-09-19T09:05:01.110 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.110 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.110 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.110 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.110 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.111 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.111 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.111 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.111 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T09:05:01.111 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T09:05:01.111 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.111 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.111 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.112 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.112 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.112 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.112 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.112 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.112 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.112 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.112 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.112 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.113 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_API_URL": { 2024-09-19T09:05:01.113 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_API_URL", 2024-09-19T09:05:01.113 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.113 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.113 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.113 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.113 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.113 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.114 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.114 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.114 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.114 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.114 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.114 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.114 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T09:05:01.114 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T09:05:01.115 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.115 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.115 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.115 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "admin", 2024-09-19T09:05:01.115 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.115 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.115 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.115 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.116 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.116 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.116 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.116 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.116 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T09:05:01.116 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T09:05:01.116 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.116 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.117 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.117 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.117 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.117 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.117 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.117 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.117 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.117 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.118 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.118 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.118 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T09:05:01.118 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T09:05:01.118 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.118 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.118 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.118 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.119 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.119 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.119 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.119 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.119 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.119 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.119 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.119 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.120 INFO:teuthology.orchestra.run.smithi019.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T09:05:01.120 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T09:05:01.120 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.120 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.120 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.120 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.120 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.120 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.121 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.121 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.121 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.121 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.121 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.121 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.121 INFO:teuthology.orchestra.run.smithi019.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T09:05:01.121 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T09:05:01.122 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.122 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.122 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.122 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.122 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.122 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.122 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.122 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.123 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.123 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.123 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.123 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.123 INFO:teuthology.orchestra.run.smithi019.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T09:05:01.123 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T09:05:01.123 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.123 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.123 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.124 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.124 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.124 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.124 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.124 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.124 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.124 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.124 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.125 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.125 INFO:teuthology.orchestra.run.smithi019.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T09:05:01.125 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T09:05:01.125 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.125 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.125 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.125 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.125 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.126 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.126 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.126 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.126 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.126 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.126 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.126 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.126 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T09:05:01.126 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T09:05:01.127 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.127 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.127 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.127 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.127 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.127 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.127 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.127 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.128 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.128 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.128 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.128 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.128 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T09:05:01.128 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T09:05:01.128 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.128 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.128 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.129 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.129 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.129 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.129 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.129 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.129 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.129 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.129 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.130 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.130 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T09:05:01.130 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T09:05:01.130 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.130 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.130 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.130 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.130 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.131 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.131 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.131 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.131 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.131 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.131 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.131 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.131 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T09:05:01.131 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T09:05:01.132 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.132 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.132 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.132 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.132 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.132 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.132 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.132 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.133 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.133 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.133 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.133 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.133 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T09:05:01.133 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T09:05:01.133 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.133 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.133 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.134 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.134 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.134 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.134 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.134 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.134 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.134 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.134 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.135 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.135 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T09:05:01.135 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T09:05:01.135 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.135 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.135 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.135 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.135 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.136 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.136 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.136 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.136 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.136 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.136 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.136 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.136 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T09:05:01.137 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T09:05:01.137 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.137 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.137 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.137 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.137 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.137 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.137 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.137 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.138 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.138 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.138 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.138 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.138 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T09:05:01.138 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T09:05:01.138 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.138 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.139 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.139 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.139 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.139 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.139 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.139 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.139 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.139 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.140 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.140 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.140 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T09:05:01.140 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T09:05:01.140 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.140 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.140 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.140 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T09:05:01.141 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.141 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.141 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.141 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.141 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.141 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.141 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.141 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.141 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T09:05:01.142 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T09:05:01.142 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.142 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.142 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.142 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-19T09:05:01.142 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.142 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.142 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.143 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.143 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.143 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.143 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.143 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.143 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T09:05:01.143 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T09:05:01.143 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.144 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.144 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.144 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8", 2024-09-19T09:05:01.144 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.144 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.144 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.144 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.144 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.145 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.145 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.145 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.145 INFO:teuthology.orchestra.run.smithi019.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T09:05:01.145 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T09:05:01.145 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.145 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.145 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.145 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "45", 2024-09-19T09:05:01.146 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.146 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.146 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.146 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.146 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.146 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.146 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.146 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.147 INFO:teuthology.orchestra.run.smithi019.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T09:05:01.147 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T09:05:01.147 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.147 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.147 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.147 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.147 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.147 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.148 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.148 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.148 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.148 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.148 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.148 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.148 INFO:teuthology.orchestra.run.smithi019.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T09:05:01.148 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T09:05:01.148 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.149 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.149 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.149 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "admin", 2024-09-19T09:05:01.149 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.149 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.149 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.149 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.149 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.150 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.150 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.150 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.150 INFO:teuthology.orchestra.run.smithi019.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T09:05:01.150 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T09:05:01.150 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.150 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.150 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.151 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.151 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.151 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.151 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.151 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.151 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.151 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.151 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.151 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.152 INFO:teuthology.orchestra.run.smithi019.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T09:05:01.152 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T09:05:01.152 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.152 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.152 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.152 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.152 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.152 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.153 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.153 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.153 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.153 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.153 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.153 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.153 INFO:teuthology.orchestra.run.smithi019.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T09:05:01.153 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T09:05:01.153 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.154 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.154 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.154 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-19T09:05:01.154 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.154 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.154 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.154 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.154 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.155 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.155 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.155 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.155 INFO:teuthology.orchestra.run.smithi019.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T09:05:01.155 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T09:05:01.155 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.155 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.155 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.156 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-19T09:05:01.156 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.156 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.156 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.156 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.156 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.156 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.156 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.156 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.157 INFO:teuthology.orchestra.run.smithi019.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T09:05:01.157 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T09:05:01.157 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.157 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.157 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.157 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-19T09:05:01.157 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.157 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.158 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.158 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.158 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.158 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.158 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.158 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.158 INFO:teuthology.orchestra.run.smithi019.stdout: "cross_origin_url": { 2024-09-19T09:05:01.158 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cross_origin_url", 2024-09-19T09:05:01.158 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.159 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.159 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.159 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.159 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.159 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.159 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.159 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.159 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.160 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.160 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.160 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.160 INFO:teuthology.orchestra.run.smithi019.stdout: "crt_file": { 2024-09-19T09:05:01.160 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crt_file", 2024-09-19T09:05:01.160 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.160 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.160 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.161 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.161 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.161 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.161 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.161 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.161 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.161 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.162 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.162 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.162 INFO:teuthology.orchestra.run.smithi019.stdout: "debug": { 2024-09-19T09:05:01.162 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "debug", 2024-09-19T09:05:01.162 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.162 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.162 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.162 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.162 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.163 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.163 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.163 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Enable/disable debug options", 2024-09-19T09:05:01.163 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.163 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.163 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.163 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.163 INFO:teuthology.orchestra.run.smithi019.stdout: "jwt_token_ttl": { 2024-09-19T09:05:01.164 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "jwt_token_ttl", 2024-09-19T09:05:01.164 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.164 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.164 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.164 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "28800", 2024-09-19T09:05:01.164 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.164 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.164 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.165 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.165 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.165 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.165 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.165 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.165 INFO:teuthology.orchestra.run.smithi019.stdout: "key_file": { 2024-09-19T09:05:01.165 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "key_file", 2024-09-19T09:05:01.167 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.168 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.168 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.168 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.168 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.168 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.168 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.168 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.169 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.169 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.169 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.169 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.169 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.169 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.169 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.169 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.169 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.170 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.170 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.170 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.170 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.170 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.170 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.170 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.170 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.171 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.171 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.171 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.171 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.171 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.171 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.171 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.171 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.172 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.172 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.172 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.172 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.172 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.172 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.172 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.172 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.172 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.173 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.173 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.173 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.173 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.173 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.173 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.173 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.173 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.174 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.174 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.174 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.174 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.174 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.174 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.174 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.174 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.174 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.175 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.175 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.175 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.175 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.175 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.175 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.175 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.175 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.176 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.176 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.176 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.176 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.176 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.176 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.176 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.176 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.176 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.177 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.177 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.177 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.177 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.177 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.177 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.177 INFO:teuthology.orchestra.run.smithi019.stdout: "motd": { 2024-09-19T09:05:01.177 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "motd", 2024-09-19T09:05:01.178 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.178 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.178 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.178 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.178 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.178 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.178 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.178 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "The message of the day", 2024-09-19T09:05:01.178 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.179 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.179 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.179 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.179 INFO:teuthology.orchestra.run.smithi019.stdout: "redirect_resolve_ip_addr": { 2024-09-19T09:05:01.179 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T09:05:01.179 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.179 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.179 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.180 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.180 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.180 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.180 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.180 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.180 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.180 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.180 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.180 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.181 INFO:teuthology.orchestra.run.smithi019.stdout: "server_addr": { 2024-09-19T09:05:01.181 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_addr", 2024-09-19T09:05:01.181 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.181 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.181 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.181 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "::", 2024-09-19T09:05:01.181 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.181 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.182 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.182 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.182 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.182 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.182 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.182 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.182 INFO:teuthology.orchestra.run.smithi019.stdout: "server_port": { 2024-09-19T09:05:01.182 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_port", 2024-09-19T09:05:01.182 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.183 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.183 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.183 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8080", 2024-09-19T09:05:01.183 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.183 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.183 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.183 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.183 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.184 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.184 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.184 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.184 INFO:teuthology.orchestra.run.smithi019.stdout: "ssl": { 2024-09-19T09:05:01.184 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ssl", 2024-09-19T09:05:01.184 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.184 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.184 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.184 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.185 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.185 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.185 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.185 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.185 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.185 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.185 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.185 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.186 INFO:teuthology.orchestra.run.smithi019.stdout: "ssl_server_port": { 2024-09-19T09:05:01.186 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ssl_server_port", 2024-09-19T09:05:01.186 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.186 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.186 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.186 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8443", 2024-09-19T09:05:01.186 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.186 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.187 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.187 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.187 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.187 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.187 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.187 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.187 INFO:teuthology.orchestra.run.smithi019.stdout: "standby_behaviour": { 2024-09-19T09:05:01.187 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "standby_behaviour", 2024-09-19T09:05:01.188 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.188 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.188 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.188 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "redirect", 2024-09-19T09:05:01.188 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.188 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.188 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.188 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.188 INFO:teuthology.orchestra.run.smithi019.stdout: "redirect" 2024-09-19T09:05:01.189 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.189 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.189 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.189 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.189 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.189 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.189 INFO:teuthology.orchestra.run.smithi019.stdout: "standby_error_status_code": { 2024-09-19T09:05:01.189 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "standby_error_status_code", 2024-09-19T09:05:01.190 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.190 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.190 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.190 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "500", 2024-09-19T09:05:01.190 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "400", 2024-09-19T09:05:01.190 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "599", 2024-09-19T09:05:01.190 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.190 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.191 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.191 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.191 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.191 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.191 INFO:teuthology.orchestra.run.smithi019.stdout: "url_prefix": { 2024-09-19T09:05:01.191 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "url_prefix", 2024-09-19T09:05:01.191 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.191 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.192 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.192 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.192 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.192 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.192 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.192 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.192 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.192 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.193 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.193 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.193 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.193 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.193 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.193 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "devicehealth", 2024-09-19T09:05:01.193 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.193 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.193 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.194 INFO:teuthology.orchestra.run.smithi019.stdout: "enable_monitoring": { 2024-09-19T09:05:01.194 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "enable_monitoring", 2024-09-19T09:05:01.194 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.194 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.194 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.194 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.194 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.194 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.195 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.195 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "monitor device health metrics", 2024-09-19T09:05:01.195 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.195 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.195 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.195 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.195 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.195 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.195 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.196 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.196 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.196 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.196 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.196 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.196 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.196 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.196 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.197 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.197 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.197 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.197 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.197 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.197 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.197 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.197 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.197 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.198 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.198 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.198 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.198 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.198 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.198 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.198 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.198 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.199 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.199 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.199 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.199 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.199 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.199 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.199 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.199 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.200 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.200 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.200 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.200 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.200 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.200 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.200 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.200 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.201 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.201 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.201 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.201 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.201 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.201 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.201 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.201 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.202 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.202 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.202 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.202 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.202 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.202 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.202 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.202 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.202 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.203 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.203 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.203 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.203 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.203 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.203 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.203 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.203 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.204 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.204 INFO:teuthology.orchestra.run.smithi019.stdout: "mark_out_threshold": { 2024-09-19T09:05:01.204 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mark_out_threshold", 2024-09-19T09:05:01.204 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:01.204 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.204 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.204 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "2419200", 2024-09-19T09:05:01.204 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.205 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.205 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.205 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T09:05:01.205 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.205 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.205 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.205 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.205 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_name": { 2024-09-19T09:05:01.206 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "pool_name", 2024-09-19T09:05:01.206 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.206 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.206 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.206 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "device_health_metrics", 2024-09-19T09:05:01.206 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.206 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.206 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.207 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T09:05:01.207 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.207 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.207 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.207 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.207 INFO:teuthology.orchestra.run.smithi019.stdout: "retention_period": { 2024-09-19T09:05:01.207 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "retention_period", 2024-09-19T09:05:01.207 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:01.207 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.208 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.208 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "15552000", 2024-09-19T09:05:01.208 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.208 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.208 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.208 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how long to retain device health metrics", 2024-09-19T09:05:01.208 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.208 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.209 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.209 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.209 INFO:teuthology.orchestra.run.smithi019.stdout: "scrape_frequency": { 2024-09-19T09:05:01.209 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "scrape_frequency", 2024-09-19T09:05:01.209 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:01.209 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.209 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.209 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "86400", 2024-09-19T09:05:01.210 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.210 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.210 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.210 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T09:05:01.210 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.210 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.210 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.210 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.211 INFO:teuthology.orchestra.run.smithi019.stdout: "self_heal": { 2024-09-19T09:05:01.211 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "self_heal", 2024-09-19T09:05:01.211 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.211 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.211 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.211 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.211 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.211 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.211 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.212 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T09:05:01.212 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.212 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.212 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.212 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.212 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-19T09:05:01.212 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-19T09:05:01.212 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:01.213 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.213 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.213 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-19T09:05:01.213 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.213 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.213 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.213 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T09:05:01.213 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.214 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.214 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.214 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.214 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_threshold": { 2024-09-19T09:05:01.214 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_threshold", 2024-09-19T09:05:01.214 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:01.214 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.214 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.214 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "7257600", 2024-09-19T09:05:01.215 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.215 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.215 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.215 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T09:05:01.215 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.215 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.215 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.215 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.215 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.216 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.216 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.216 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "diskprediction_local", 2024-09-19T09:05:01.216 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.216 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.216 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.216 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.216 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.217 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.217 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.217 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.217 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.217 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.217 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.217 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.217 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.218 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.218 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.218 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.218 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.218 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.218 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.218 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.218 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.219 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.219 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.219 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.219 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.219 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.219 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.219 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.219 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.219 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.220 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.220 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.220 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.220 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.220 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.220 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.220 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.220 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.221 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.221 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.221 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.221 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.221 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.221 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.221 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.221 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.221 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.222 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.222 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.222 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.222 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.222 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.222 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.222 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.222 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.223 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.223 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.223 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.223 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.223 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.223 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.223 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.223 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.223 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.224 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.224 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.224 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.224 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.224 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.224 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.224 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.224 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.225 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.225 INFO:teuthology.orchestra.run.smithi019.stdout: "predict_interval": { 2024-09-19T09:05:01.225 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "predict_interval", 2024-09-19T09:05:01.225 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.225 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.225 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.225 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "86400", 2024-09-19T09:05:01.225 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.225 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.226 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.226 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.226 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.226 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.226 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.226 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.226 INFO:teuthology.orchestra.run.smithi019.stdout: "predictor_model": { 2024-09-19T09:05:01.226 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "predictor_model", 2024-09-19T09:05:01.227 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.227 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.227 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.227 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "prophetstor", 2024-09-19T09:05:01.227 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.227 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.227 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.227 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.228 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.228 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.228 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.228 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.228 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-19T09:05:01.228 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-19T09:05:01.228 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.228 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.228 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.229 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-19T09:05:01.229 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.229 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.229 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.229 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.229 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.229 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.229 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.230 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.230 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.230 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.230 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.230 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "influx", 2024-09-19T09:05:01.230 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": false, 2024-09-19T09:05:01.230 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "influxdb python module not found", 2024-09-19T09:05:01.230 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.231 INFO:teuthology.orchestra.run.smithi019.stdout: "batch_size": { 2024-09-19T09:05:01.231 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "batch_size", 2024-09-19T09:05:01.231 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.231 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.231 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.231 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5000", 2024-09-19T09:05:01.231 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.231 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.231 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.232 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T09:05:01.232 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.232 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.232 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.232 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.232 INFO:teuthology.orchestra.run.smithi019.stdout: "database": { 2024-09-19T09:05:01.232 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "database", 2024-09-19T09:05:01.233 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.233 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.233 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.233 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "ceph", 2024-09-19T09:05:01.233 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.233 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.233 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.233 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T09:05:01.234 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.234 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.234 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.234 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.234 INFO:teuthology.orchestra.run.smithi019.stdout: "hostname": { 2024-09-19T09:05:01.234 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "hostname", 2024-09-19T09:05:01.234 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.234 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.234 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.235 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.235 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.235 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.235 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.235 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "InfluxDB server hostname", 2024-09-19T09:05:01.235 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.235 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.235 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.236 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.236 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-19T09:05:01.236 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-19T09:05:01.236 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:01.236 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.236 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.236 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "30", 2024-09-19T09:05:01.236 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "5", 2024-09-19T09:05:01.237 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.237 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.237 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T09:05:01.237 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.237 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.237 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.237 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.237 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.238 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.238 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.238 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.238 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.238 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.238 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.238 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.238 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.239 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.239 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.239 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.239 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.239 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.239 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.239 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.239 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.240 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.240 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.240 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.240 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.240 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.240 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.240 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.240 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.240 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.241 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.241 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.241 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.241 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.241 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.241 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.241 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.241 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.242 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.242 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.242 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.242 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.242 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.242 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.242 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.242 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.242 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.243 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.243 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.243 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.243 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.243 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.243 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.243 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.243 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.244 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.244 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.244 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.244 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.244 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.244 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.244 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.244 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.245 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.245 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.245 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.245 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.245 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.245 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.245 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.245 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.245 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.246 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.246 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.246 INFO:teuthology.orchestra.run.smithi019.stdout: "password": { 2024-09-19T09:05:01.246 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "password", 2024-09-19T09:05:01.246 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.246 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.246 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.246 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.246 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.247 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.247 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.247 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "password of InfluxDB server user", 2024-09-19T09:05:01.247 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.247 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.247 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.247 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.247 INFO:teuthology.orchestra.run.smithi019.stdout: "port": { 2024-09-19T09:05:01.248 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "port", 2024-09-19T09:05:01.248 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.248 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.248 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.248 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8086", 2024-09-19T09:05:01.248 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.248 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.248 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.249 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "InfluxDB server port", 2024-09-19T09:05:01.249 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.249 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.249 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.249 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.249 INFO:teuthology.orchestra.run.smithi019.stdout: "ssl": { 2024-09-19T09:05:01.249 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ssl", 2024-09-19T09:05:01.249 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.250 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.250 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.250 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "false", 2024-09-19T09:05:01.250 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.250 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.250 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.250 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:05:01.250 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.250 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.251 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.251 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.251 INFO:teuthology.orchestra.run.smithi019.stdout: "threads": { 2024-09-19T09:05:01.251 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "threads", 2024-09-19T09:05:01.251 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.251 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.251 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.251 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-19T09:05:01.251 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1", 2024-09-19T09:05:01.252 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "32", 2024-09-19T09:05:01.252 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.252 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T09:05:01.252 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.252 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.252 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.252 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.252 INFO:teuthology.orchestra.run.smithi019.stdout: "username": { 2024-09-19T09:05:01.253 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "username", 2024-09-19T09:05:01.253 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.253 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.253 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.253 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.253 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.253 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.253 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.254 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "username of InfluxDB server user", 2024-09-19T09:05:01.254 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.254 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.254 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.254 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.254 INFO:teuthology.orchestra.run.smithi019.stdout: "verify_ssl": { 2024-09-19T09:05:01.254 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "verify_ssl", 2024-09-19T09:05:01.254 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.255 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.255 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.255 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "true", 2024-09-19T09:05:01.255 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.255 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.255 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.255 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:05:01.255 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.256 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.256 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.256 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.256 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.256 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.256 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.256 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "insights", 2024-09-19T09:05:01.256 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.256 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.257 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.257 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.257 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.257 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.257 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.257 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.257 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.257 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.258 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.258 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.258 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.258 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.258 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.258 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.258 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.258 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.259 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.259 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.259 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.259 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.259 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.259 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.259 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.259 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.260 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.260 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.260 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.260 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.260 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.260 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.260 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.260 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.261 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.261 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.261 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.261 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.261 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.261 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.261 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.261 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.262 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.262 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.262 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.262 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.262 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.262 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.262 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.262 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.263 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.263 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.263 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.263 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.263 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.263 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.263 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.263 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.264 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.264 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.264 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.264 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.264 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.264 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.264 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.264 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.264 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.265 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.265 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.265 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.265 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.265 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.265 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.265 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.265 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.266 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.266 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "iostat", 2024-09-19T09:05:01.266 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.266 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.266 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.266 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.266 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.266 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.266 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.267 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.267 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.267 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.267 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.267 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.267 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.267 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.267 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.268 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.268 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.268 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.268 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.268 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.268 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.268 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.268 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.269 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.269 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.269 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.269 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.269 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.269 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.269 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.269 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.269 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.270 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.270 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.270 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.270 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.270 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.270 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.270 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.270 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.271 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.271 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.271 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.271 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.271 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.271 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.271 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.271 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.271 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.272 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.272 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.272 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.272 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.272 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.272 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.272 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.272 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.273 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.273 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.273 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.273 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.273 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.273 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.273 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.273 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.274 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.274 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.274 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.274 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.274 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.274 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.274 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.274 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.274 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.275 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.275 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.275 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "k8sevents", 2024-09-19T09:05:01.275 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.275 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.275 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.275 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_event_retention_days": { 2024-09-19T09:05:01.275 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ceph_event_retention_days", 2024-09-19T09:05:01.276 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.276 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.276 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.276 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "7", 2024-09-19T09:05:01.276 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.276 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.276 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.276 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T09:05:01.276 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.277 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.277 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.277 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.277 INFO:teuthology.orchestra.run.smithi019.stdout: "config_check_secs": { 2024-09-19T09:05:01.277 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "config_check_secs", 2024-09-19T09:05:01.277 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.277 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.277 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.278 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-19T09:05:01.278 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "10", 2024-09-19T09:05:01.278 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.278 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.278 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T09:05:01.278 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.278 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.278 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.279 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.279 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.279 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.279 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.279 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.279 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.279 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.279 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.280 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.280 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.280 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.280 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.280 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.280 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.280 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.280 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.281 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.281 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.281 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.281 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.281 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.281 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.281 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.281 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.281 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.282 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.282 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.282 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.282 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.282 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.282 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.282 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.282 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.282 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.283 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.283 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.283 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.283 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.283 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.283 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.283 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.283 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.284 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.284 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.284 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.284 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.284 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.284 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.284 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.284 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.284 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.285 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.285 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.285 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.285 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.285 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.285 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.285 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.285 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.286 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.286 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.286 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.286 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.286 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.286 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.286 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.286 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.287 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.287 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.287 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.287 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.287 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.287 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.287 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.287 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "localpool", 2024-09-19T09:05:01.287 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.288 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.288 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.288 INFO:teuthology.orchestra.run.smithi019.stdout: "failure_domain": { 2024-09-19T09:05:01.288 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "failure_domain", 2024-09-19T09:05:01.288 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.288 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.288 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.288 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "host", 2024-09-19T09:05:01.289 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.289 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.289 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.289 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "failure domain for any created local pool", 2024-09-19T09:05:01.289 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T09:05:01.289 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.289 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.289 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.289 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.290 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.290 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.290 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.290 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.290 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.290 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.290 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.290 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.291 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.291 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.291 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.291 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.291 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.291 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.291 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.291 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.291 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.292 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.292 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.292 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.292 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.292 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.292 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.292 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.292 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.293 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.293 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.293 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.293 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.293 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.293 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.293 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.293 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.293 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.294 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.294 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.294 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.294 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.294 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.294 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.294 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.294 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.295 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.295 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.295 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.295 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.295 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.295 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.295 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.295 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.295 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.296 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.296 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.296 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.296 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.296 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.296 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.296 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.297 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.297 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.297 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.297 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.297 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.297 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.297 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.297 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.298 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.298 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.298 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.298 INFO:teuthology.orchestra.run.smithi019.stdout: "min_size": { 2024-09-19T09:05:01.298 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "min_size", 2024-09-19T09:05:01.298 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.298 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.298 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.299 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.299 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.299 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.299 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.299 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "default min_size for any created local pool", 2024-09-19T09:05:01.299 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T09:05:01.299 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.299 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.299 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.300 INFO:teuthology.orchestra.run.smithi019.stdout: "num_rep": { 2024-09-19T09:05:01.300 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "num_rep", 2024-09-19T09:05:01.300 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.300 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.300 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.301 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "3", 2024-09-19T09:05:01.301 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.301 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.301 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.301 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "default replica count for any created local pool", 2024-09-19T09:05:01.301 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.301 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.301 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.301 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.302 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num": { 2024-09-19T09:05:01.302 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "pg_num", 2024-09-19T09:05:01.302 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.302 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.302 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.302 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "128", 2024-09-19T09:05:01.302 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.302 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.303 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.303 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T09:05:01.303 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.303 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.303 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.303 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.303 INFO:teuthology.orchestra.run.smithi019.stdout: "prefix": { 2024-09-19T09:05:01.303 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "prefix", 2024-09-19T09:05:01.304 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.304 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.304 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.304 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.304 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.304 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.304 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.304 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "name prefix for any created local pool", 2024-09-19T09:05:01.305 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.305 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.305 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.305 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.305 INFO:teuthology.orchestra.run.smithi019.stdout: "subtree": { 2024-09-19T09:05:01.305 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "subtree", 2024-09-19T09:05:01.305 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.305 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.305 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.306 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "rack", 2024-09-19T09:05:01.306 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.306 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.306 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.306 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T09:05:01.306 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T09:05:01.306 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.306 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.306 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.307 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.307 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.307 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.307 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mds_autoscaler", 2024-09-19T09:05:01.307 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.307 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.307 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.307 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.308 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.308 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.308 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.308 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.308 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.308 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.308 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.308 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.308 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.309 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.309 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.309 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.309 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.309 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.309 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.309 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.309 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.310 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.310 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.310 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.310 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.310 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.310 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.310 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.310 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.311 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.311 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.311 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.311 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.311 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.311 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.311 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.311 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.311 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.312 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.312 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.312 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.312 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.312 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.312 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.312 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.312 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.313 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.313 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.313 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.313 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.313 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.313 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.313 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.313 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.314 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.314 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.314 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.314 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.314 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.314 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.314 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.314 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.315 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.315 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.315 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.315 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.315 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.315 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.315 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.315 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.315 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.316 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.316 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.316 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.316 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.316 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.316 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mirroring", 2024-09-19T09:05:01.316 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.317 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.317 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.317 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.317 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.317 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.317 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.317 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.317 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.318 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.318 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.318 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.318 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.318 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.318 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.318 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.318 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.319 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.319 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.319 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.319 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.319 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.319 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.319 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.319 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.319 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.320 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.320 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.320 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.320 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.320 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.320 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.320 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.320 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.321 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.321 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.321 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.321 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.321 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.321 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.321 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.321 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.322 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.322 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.322 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.322 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.322 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.322 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.322 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.322 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.322 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.323 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.323 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.323 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.323 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.323 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.323 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.323 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.323 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.324 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.324 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.324 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.324 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.324 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.324 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.324 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.324 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.325 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.325 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.325 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.325 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.325 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.325 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.325 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.325 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.326 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.326 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "nfs", 2024-09-19T09:05:01.326 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.326 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.326 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.326 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.326 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.326 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.327 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.327 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.327 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.327 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.327 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.327 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.327 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.327 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.327 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.328 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.328 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.328 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.328 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.328 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.328 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.328 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.328 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.329 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.329 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.329 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.329 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.329 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.329 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.329 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.329 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.330 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.330 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.330 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.330 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.330 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.330 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.330 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.330 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.331 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.331 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.331 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.331 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.331 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.331 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.331 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.331 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.331 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.332 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.332 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.332 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.332 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.332 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.332 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.332 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.332 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.333 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.333 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.333 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.333 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.333 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.333 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.333 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.333 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.334 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.334 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.334 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.334 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.334 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.334 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.334 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.334 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.334 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.335 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.335 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.335 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.335 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "orchestrator", 2024-09-19T09:05:01.335 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.335 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.335 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.335 INFO:teuthology.orchestra.run.smithi019.stdout: "fail_fs": { 2024-09-19T09:05:01.336 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "fail_fs", 2024-09-19T09:05:01.336 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.336 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.336 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.336 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.336 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.336 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.336 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.336 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T09:05:01.337 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.337 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.337 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.337 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.337 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.337 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.337 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.337 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.338 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.338 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.338 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.338 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.338 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.338 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.338 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.338 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.339 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.339 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.339 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.339 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.339 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.339 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.339 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.339 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.340 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.340 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.340 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.340 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.340 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.340 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.340 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.340 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.341 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.341 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.341 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.341 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.341 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.341 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.341 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.341 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.342 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.342 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.342 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.342 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.342 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.342 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.342 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.342 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.343 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.343 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.343 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.343 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.343 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.343 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.343 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.343 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.343 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.344 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.344 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.344 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.344 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.344 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.344 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.344 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.344 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.345 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.345 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.345 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.345 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.345 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.345 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.345 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.345 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.346 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.346 INFO:teuthology.orchestra.run.smithi019.stdout: "orchestrator": { 2024-09-19T09:05:01.346 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "orchestrator", 2024-09-19T09:05:01.346 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.346 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.346 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.346 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.346 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.346 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.347 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.347 INFO:teuthology.orchestra.run.smithi019.stdout: "cephadm", 2024-09-19T09:05:01.347 INFO:teuthology.orchestra.run.smithi019.stdout: "rook", 2024-09-19T09:05:01.347 INFO:teuthology.orchestra.run.smithi019.stdout: "test_orchestrator" 2024-09-19T09:05:01.347 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.347 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Orchestrator backend", 2024-09-19T09:05:01.347 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.347 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.348 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.348 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.348 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.348 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.348 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.348 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "osd_perf_query", 2024-09-19T09:05:01.348 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.349 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.349 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.349 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.349 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.349 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.349 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.349 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.349 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.350 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.350 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.350 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.350 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.350 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.350 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.350 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.350 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.351 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.351 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.351 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.351 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.351 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.351 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.351 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.351 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.351 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.352 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.352 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.352 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.352 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.352 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.352 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.352 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.352 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.352 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.353 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.353 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.353 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.353 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.353 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.353 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.353 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.353 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.354 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.354 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.354 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.354 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.354 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.354 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.354 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.354 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.354 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.355 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.355 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.355 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.355 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.355 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.355 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.355 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.355 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.356 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.356 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.356 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.356 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.356 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.356 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.356 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.356 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.357 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.357 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.357 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.357 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.357 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.357 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.357 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.357 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.358 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "osd_support", 2024-09-19T09:05:01.358 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.358 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.358 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.358 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.358 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.358 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.358 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.358 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.359 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.359 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.359 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.359 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.359 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.359 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.359 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.359 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.360 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.360 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.360 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.360 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.360 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.360 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.360 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.360 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.361 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.361 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.361 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.361 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.361 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.361 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.361 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.361 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.362 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.362 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.362 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.362 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.362 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.362 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.362 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.362 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.362 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.363 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.363 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.363 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.363 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.363 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.363 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.363 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.363 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.363 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.364 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.364 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.364 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.364 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.364 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.364 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.364 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.364 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.365 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.365 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.365 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.365 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.365 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.365 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.365 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.365 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.366 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.366 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.366 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.366 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.366 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.366 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.366 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.366 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.366 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.367 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.367 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "pg_autoscaler", 2024-09-19T09:05:01.367 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.367 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.367 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.367 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.367 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.367 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.368 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.368 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.368 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.368 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.368 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.368 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.368 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.368 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.369 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.369 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.369 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.369 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.369 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.369 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.369 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.369 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.370 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.370 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.370 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.370 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.370 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.370 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.370 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.370 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.371 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.371 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.371 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.371 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.371 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.371 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.371 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.371 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.372 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.372 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.372 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.372 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.372 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.372 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.372 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.372 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.372 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.373 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.373 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.373 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.373 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.373 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.373 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.373 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.373 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.374 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.374 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.374 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.374 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.374 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.374 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.376 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.376 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.376 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.376 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.376 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.376 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.376 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.376 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.377 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.377 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.377 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.377 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.377 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-19T09:05:01.377 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-19T09:05:01.377 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:01.377 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.378 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.378 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-19T09:05:01.378 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.378 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.378 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.378 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.378 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.378 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.378 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.379 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.379 INFO:teuthology.orchestra.run.smithi019.stdout: "threshold": { 2024-09-19T09:05:01.379 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "threshold", 2024-09-19T09:05:01.379 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-19T09:05:01.379 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.379 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.379 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "3.0", 2024-09-19T09:05:01.379 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1.0", 2024-09-19T09:05:01.380 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.380 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.380 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "scaling threshold", 2024-09-19T09:05:01.380 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T09:05:01.380 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.380 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.380 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.380 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.380 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.381 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.381 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "progress", 2024-09-19T09:05:01.381 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.381 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.381 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.381 INFO:teuthology.orchestra.run.smithi019.stdout: "allow_pg_recovery_event": { 2024-09-19T09:05:01.381 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "allow_pg_recovery_event", 2024-09-19T09:05:01.381 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.382 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.382 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.382 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.382 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.382 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.382 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.382 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T09:05:01.382 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.382 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.383 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.383 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.383 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": { 2024-09-19T09:05:01.383 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "enabled", 2024-09-19T09:05:01.383 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.383 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.383 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.383 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.384 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.384 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.384 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.384 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.384 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.384 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.384 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.384 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.384 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.385 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.385 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.385 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.385 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.385 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.385 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.385 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.385 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.386 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.386 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.386 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.386 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.386 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.386 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.386 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.386 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.386 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.387 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.387 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.387 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.387 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.387 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.387 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.387 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.387 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.387 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.388 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.388 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.388 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.388 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.388 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.388 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.388 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.388 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.389 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.389 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.389 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.389 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.389 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.389 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.389 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.389 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.389 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.390 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.390 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.390 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.390 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.390 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.390 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.390 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.390 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.391 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.391 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.391 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.391 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.391 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.391 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.391 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.391 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.392 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.392 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.392 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.392 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.392 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.392 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.392 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.392 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.393 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.393 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.393 INFO:teuthology.orchestra.run.smithi019.stdout: "max_completed_events": { 2024-09-19T09:05:01.393 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_completed_events", 2024-09-19T09:05:01.393 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.393 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.393 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.393 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "50", 2024-09-19T09:05:01.393 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.394 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.394 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.394 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "number of past completed events to remember", 2024-09-19T09:05:01.394 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.394 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.394 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.394 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.394 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-19T09:05:01.395 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-19T09:05:01.395 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:01.395 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.395 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.395 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-19T09:05:01.395 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.395 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.395 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.396 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how long the module is going to sleep", 2024-09-19T09:05:01.396 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.396 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.396 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.396 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.396 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.396 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.396 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.397 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "prometheus", 2024-09-19T09:05:01.397 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.397 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.397 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.397 INFO:teuthology.orchestra.run.smithi019.stdout: "cache": { 2024-09-19T09:05:01.397 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cache", 2024-09-19T09:05:01.397 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.397 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.398 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.398 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.398 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.398 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.398 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.398 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.398 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.398 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.399 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.399 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.399 INFO:teuthology.orchestra.run.smithi019.stdout: "exclude_perf_counters": { 2024-09-19T09:05:01.399 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "exclude_perf_counters", 2024-09-19T09:05:01.399 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.399 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.399 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.399 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.399 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.400 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.400 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.400 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T09:05:01.400 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T09:05:01.400 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.400 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.400 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.400 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.401 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.401 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.401 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.401 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.401 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.401 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.401 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.401 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.402 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.402 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.402 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.402 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.402 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.402 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.402 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.402 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.403 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.403 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.403 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.403 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.403 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.403 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.403 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.403 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.403 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.404 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.404 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.404 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.404 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.404 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.404 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.404 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.404 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.405 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.405 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.405 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.405 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.405 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.405 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.405 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.405 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.405 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.406 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.406 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.406 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.406 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.406 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.406 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.406 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.406 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.407 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.407 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.407 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.407 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.407 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.407 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.407 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.407 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.407 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.408 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.408 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.408 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.408 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.408 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.408 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.408 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.408 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.408 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.409 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.409 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_stats_pools": { 2024-09-19T09:05:01.409 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rbd_stats_pools", 2024-09-19T09:05:01.409 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.409 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.409 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.409 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.409 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.410 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.410 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.410 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.410 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.410 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.410 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.410 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.410 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T09:05:01.411 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T09:05:01.411 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.411 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.411 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.411 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "300", 2024-09-19T09:05:01.411 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.411 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.411 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.411 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.412 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.412 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.412 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.412 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.412 INFO:teuthology.orchestra.run.smithi019.stdout: "scrape_interval": { 2024-09-19T09:05:01.412 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "scrape_interval", 2024-09-19T09:05:01.412 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-19T09:05:01.412 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.412 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.413 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "15.0", 2024-09-19T09:05:01.413 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.413 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.413 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.413 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.413 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.413 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.413 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.414 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.414 INFO:teuthology.orchestra.run.smithi019.stdout: "server_addr": { 2024-09-19T09:05:01.414 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_addr", 2024-09-19T09:05:01.414 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.414 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.414 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.414 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "::", 2024-09-19T09:05:01.414 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.415 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.415 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.415 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T09:05:01.415 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.415 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.415 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.415 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.415 INFO:teuthology.orchestra.run.smithi019.stdout: "server_port": { 2024-09-19T09:05:01.415 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_port", 2024-09-19T09:05:01.416 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.416 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.416 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.416 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "9283", 2024-09-19T09:05:01.416 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.416 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.416 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.416 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T09:05:01.417 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.417 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.417 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.417 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.417 INFO:teuthology.orchestra.run.smithi019.stdout: "stale_cache_strategy": { 2024-09-19T09:05:01.417 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "stale_cache_strategy", 2024-09-19T09:05:01.417 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.417 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.418 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.418 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "log", 2024-09-19T09:05:01.418 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.418 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.418 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.418 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.418 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.418 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.419 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.419 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.419 INFO:teuthology.orchestra.run.smithi019.stdout: "standby_behaviour": { 2024-09-19T09:05:01.419 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "standby_behaviour", 2024-09-19T09:05:01.419 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.419 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.419 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.419 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "default", 2024-09-19T09:05:01.419 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.420 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.420 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.420 INFO:teuthology.orchestra.run.smithi019.stdout: "default", 2024-09-19T09:05:01.420 INFO:teuthology.orchestra.run.smithi019.stdout: "error" 2024-09-19T09:05:01.420 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.420 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.420 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.420 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.421 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.421 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.421 INFO:teuthology.orchestra.run.smithi019.stdout: "standby_error_status_code": { 2024-09-19T09:05:01.421 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "standby_error_status_code", 2024-09-19T09:05:01.421 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.421 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.421 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.421 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "500", 2024-09-19T09:05:01.421 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "400", 2024-09-19T09:05:01.422 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "599", 2024-09-19T09:05:01.422 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.422 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.422 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.422 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.422 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.422 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.422 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.423 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.423 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.423 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rbd_support", 2024-09-19T09:05:01.423 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.423 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.423 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.423 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.423 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.424 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.424 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.424 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.424 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.424 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.424 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.424 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.424 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.424 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.425 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.425 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.425 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.425 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.425 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.425 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.425 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.425 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.426 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.426 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.426 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.426 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.426 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.426 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.426 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.426 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.426 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.427 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.427 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.427 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.427 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.427 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.427 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.427 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.427 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.428 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.428 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.428 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.428 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.428 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.428 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.428 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.428 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.428 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.429 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.429 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.429 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.429 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.429 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.429 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.429 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.429 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.430 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.430 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.430 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.430 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.430 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.430 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.430 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.430 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.430 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.431 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.431 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.431 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.431 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.431 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.431 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.431 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.431 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.432 INFO:teuthology.orchestra.run.smithi019.stdout: "max_concurrent_snap_create": { 2024-09-19T09:05:01.432 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_concurrent_snap_create", 2024-09-19T09:05:01.432 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.432 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.432 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.432 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-19T09:05:01.432 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.432 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.432 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.433 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.433 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.433 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.433 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.433 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.433 INFO:teuthology.orchestra.run.smithi019.stdout: "mirror_snapshot_schedule": { 2024-09-19T09:05:01.433 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T09:05:01.433 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.433 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.434 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.434 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.434 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.434 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.434 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.434 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.434 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.434 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.435 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.435 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.435 INFO:teuthology.orchestra.run.smithi019.stdout: "trash_purge_schedule": { 2024-09-19T09:05:01.435 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "trash_purge_schedule", 2024-09-19T09:05:01.435 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.435 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.435 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.435 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.435 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.436 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.436 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.436 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.436 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.436 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.436 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.436 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.436 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.437 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.437 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.437 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "restful", 2024-09-19T09:05:01.437 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.437 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.437 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.437 INFO:teuthology.orchestra.run.smithi019.stdout: "enable_auth": { 2024-09-19T09:05:01.437 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "enable_auth", 2024-09-19T09:05:01.438 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.438 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.438 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.438 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.438 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.438 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.438 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.438 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.439 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.439 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.439 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.439 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.439 INFO:teuthology.orchestra.run.smithi019.stdout: "key_file": { 2024-09-19T09:05:01.439 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "key_file", 2024-09-19T09:05:01.439 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.439 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.439 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.440 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.440 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.440 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.440 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.440 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.440 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.440 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.441 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.441 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.441 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.441 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.441 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.441 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.441 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.441 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.442 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.442 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.442 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.442 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.442 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.442 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.442 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.442 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.442 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.443 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.443 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.443 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.443 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.443 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.443 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.443 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.443 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.444 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.444 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.444 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.444 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.444 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.444 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.444 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.444 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.445 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.445 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.445 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.445 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.445 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.445 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.445 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.445 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.446 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.446 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.446 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.446 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.446 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.446 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.446 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.446 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.446 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.447 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.447 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.447 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.447 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.447 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.447 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.447 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.447 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.448 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.448 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.448 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.448 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.448 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.448 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.448 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.448 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.448 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.449 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.449 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.449 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.449 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.449 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.449 INFO:teuthology.orchestra.run.smithi019.stdout: "server_addr": { 2024-09-19T09:05:01.449 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_addr", 2024-09-19T09:05:01.449 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.450 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.450 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.450 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.450 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.450 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.450 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.450 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.450 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.451 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.451 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.451 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.451 INFO:teuthology.orchestra.run.smithi019.stdout: "server_port": { 2024-09-19T09:05:01.451 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_port", 2024-09-19T09:05:01.451 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.451 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.451 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.451 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.452 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.452 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.452 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.452 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.452 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.452 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.452 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.452 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.453 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.453 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.453 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.453 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rgw", 2024-09-19T09:05:01.453 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.453 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.453 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.453 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.453 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.454 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.454 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.454 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.454 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.454 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.454 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.454 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.454 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.455 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.455 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.455 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.455 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.455 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.455 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.455 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.455 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.455 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.456 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.456 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.456 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.456 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.456 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.456 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.456 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.456 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.457 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.457 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.457 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.457 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.457 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.457 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.457 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.457 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.458 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.458 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.458 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.458 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.458 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.458 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.458 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.458 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.459 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.459 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.459 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.459 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.459 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.459 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.459 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.459 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.459 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.460 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.460 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.460 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.460 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.460 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.460 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.460 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.460 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.461 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.461 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.461 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.461 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.461 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.461 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.461 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.461 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.461 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.462 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.462 INFO:teuthology.orchestra.run.smithi019.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T09:05:01.462 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T09:05:01.462 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.462 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.462 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.462 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-19T09:05:01.462 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.463 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.463 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.463 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T09:05:01.463 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.463 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.463 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.463 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.463 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.464 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.464 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.464 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rook", 2024-09-19T09:05:01.464 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.464 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.464 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.464 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.464 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.464 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.465 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.465 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.465 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.465 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.465 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.465 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.465 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.465 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.466 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.466 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.466 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.466 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.466 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.466 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.466 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.466 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.466 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.467 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.467 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.467 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.467 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.467 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.467 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.467 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.467 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.468 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.468 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.468 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.468 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.468 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.468 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.468 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.468 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.468 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.469 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.469 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.469 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.469 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.469 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.469 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.469 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.469 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.470 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.470 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.470 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.470 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.470 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.470 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.470 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.470 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.470 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.471 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.471 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.471 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.471 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.471 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.471 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.471 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.471 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.472 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.472 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.472 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.472 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.472 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.472 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.472 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.472 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.472 INFO:teuthology.orchestra.run.smithi019.stdout: "storage_class": { 2024-09-19T09:05:01.473 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "storage_class", 2024-09-19T09:05:01.473 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.473 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.473 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.473 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "local", 2024-09-19T09:05:01.473 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.473 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.473 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.474 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T09:05:01.474 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.474 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.474 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.474 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.474 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.474 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.474 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.474 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "selftest", 2024-09-19T09:05:01.475 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.475 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.475 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.475 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.475 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.475 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.475 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.475 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.475 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.476 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.476 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.476 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.476 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.476 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.476 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.476 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.476 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.477 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.477 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.477 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.477 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.477 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.477 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.477 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.477 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.477 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.478 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.478 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.478 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.478 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.478 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.478 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.478 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.478 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.479 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.479 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.479 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.479 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.479 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.479 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.479 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.479 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.480 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.480 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.480 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.480 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.480 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.480 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.480 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.480 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.481 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.481 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.481 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.481 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.481 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.481 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.481 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.481 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.482 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.482 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.482 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.482 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.482 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.482 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.482 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.482 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.482 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.483 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.483 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.483 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.483 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.483 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.483 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.483 INFO:teuthology.orchestra.run.smithi019.stdout: "roption1": { 2024-09-19T09:05:01.483 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "roption1", 2024-09-19T09:05:01.484 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.484 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.484 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.484 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.484 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.484 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.484 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.484 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.485 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.485 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.485 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.485 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.485 INFO:teuthology.orchestra.run.smithi019.stdout: "roption2": { 2024-09-19T09:05:01.485 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "roption2", 2024-09-19T09:05:01.485 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.485 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.485 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.486 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "xyz", 2024-09-19T09:05:01.486 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.486 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.486 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.486 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.486 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.486 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.486 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.487 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.487 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption1": { 2024-09-19T09:05:01.487 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption1", 2024-09-19T09:05:01.487 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.487 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.487 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.487 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.487 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.488 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.488 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.488 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.488 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.488 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.488 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.488 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.488 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption2": { 2024-09-19T09:05:01.489 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption2", 2024-09-19T09:05:01.489 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.489 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.489 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.489 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.489 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.489 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.489 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.489 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.490 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.490 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.490 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.490 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.490 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption3": { 2024-09-19T09:05:01.490 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption3", 2024-09-19T09:05:01.490 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-19T09:05:01.490 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.491 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.491 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.491 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.491 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.491 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.491 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.491 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.491 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.491 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.492 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.492 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption4": { 2024-09-19T09:05:01.492 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption4", 2024-09-19T09:05:01.492 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.492 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.492 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.492 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.492 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.495 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.495 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.495 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.495 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.496 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.496 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.496 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.496 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption5": { 2024-09-19T09:05:01.496 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption5", 2024-09-19T09:05:01.496 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.496 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.496 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.497 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.497 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.497 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.497 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.497 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.497 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.497 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.497 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.498 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.498 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption6": { 2024-09-19T09:05:01.498 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption6", 2024-09-19T09:05:01.498 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.498 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.498 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.498 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.498 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.499 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.499 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.499 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.499 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.499 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.499 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.499 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.499 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption7": { 2024-09-19T09:05:01.499 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption7", 2024-09-19T09:05:01.500 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.500 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.500 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.500 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.500 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1", 2024-09-19T09:05:01.500 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "42", 2024-09-19T09:05:01.500 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.500 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.501 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.501 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.501 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.501 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.501 INFO:teuthology.orchestra.run.smithi019.stdout: "testkey": { 2024-09-19T09:05:01.501 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "testkey", 2024-09-19T09:05:01.501 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.501 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.502 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.502 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.502 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.502 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.502 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.502 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.502 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.502 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.502 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.503 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.503 INFO:teuthology.orchestra.run.smithi019.stdout: "testlkey": { 2024-09-19T09:05:01.503 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "testlkey", 2024-09-19T09:05:01.503 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.503 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.503 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.503 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.503 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.504 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.504 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.504 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.504 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.504 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.504 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.504 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.504 INFO:teuthology.orchestra.run.smithi019.stdout: "testnewline": { 2024-09-19T09:05:01.504 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "testnewline", 2024-09-19T09:05:01.505 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.505 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.505 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.505 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.505 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.505 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.505 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.505 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.506 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.506 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.506 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.506 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.506 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.506 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.506 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.506 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "snap_schedule", 2024-09-19T09:05:01.506 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.507 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.507 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.507 INFO:teuthology.orchestra.run.smithi019.stdout: "allow_m_granularity": { 2024-09-19T09:05:01.507 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "allow_m_granularity", 2024-09-19T09:05:01.507 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.507 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.507 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.507 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.508 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.508 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.508 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.508 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T09:05:01.508 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.508 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.508 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.508 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.508 INFO:teuthology.orchestra.run.smithi019.stdout: "dump_on_update": { 2024-09-19T09:05:01.509 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "dump_on_update", 2024-09-19T09:05:01.509 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.509 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.509 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.509 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.509 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.509 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.509 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.510 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "dump database to debug log on update", 2024-09-19T09:05:01.510 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.510 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.510 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.510 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.510 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.510 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.510 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.511 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.511 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.511 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.511 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.511 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.511 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.511 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.511 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.512 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.512 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.512 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.512 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.512 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.512 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.512 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.512 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.513 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.513 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.513 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.513 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.513 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.513 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.513 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.513 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.514 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.514 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.514 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.514 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.514 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.514 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.514 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.514 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.514 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.515 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.515 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.515 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.515 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.515 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.515 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.515 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.515 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.516 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.516 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.516 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.516 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.516 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.516 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.516 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.516 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.517 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.517 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.517 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.517 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.517 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.517 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.517 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.517 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.518 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.518 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.518 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.518 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.518 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.518 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.518 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.518 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.518 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.519 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.519 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.519 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.519 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.519 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "stats", 2024-09-19T09:05:01.519 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.519 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.519 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.520 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.520 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.520 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.520 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.520 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.520 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.520 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.520 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.521 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.521 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.521 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.521 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.521 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.521 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.521 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.521 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.521 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.522 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.522 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.522 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.522 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.522 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.522 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.522 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.522 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.523 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.523 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.523 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.523 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.523 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.523 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.523 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.523 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.523 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.524 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.524 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.524 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.524 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.524 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.524 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.524 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.525 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.525 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.525 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.525 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.525 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.525 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.525 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.525 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.525 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.526 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.526 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.526 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.526 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.526 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.526 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.526 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.526 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.527 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.527 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.527 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.527 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.527 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.527 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.527 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.527 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.527 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.528 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.528 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.528 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.528 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.528 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.528 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.528 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "status", 2024-09-19T09:05:01.528 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.529 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.529 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.529 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.529 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.529 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.529 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.529 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.529 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.529 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.530 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.530 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.530 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.530 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.530 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.530 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.530 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.530 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.531 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.531 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.531 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.531 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.531 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.531 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.531 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.531 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.532 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.532 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.532 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.532 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.532 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.532 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.532 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.532 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.532 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.533 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.533 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.533 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.533 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.533 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.533 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.533 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.533 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.534 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.534 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.534 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.534 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.534 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.534 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.534 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.534 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.535 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.535 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.535 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.535 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.535 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.535 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.535 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.535 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.536 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.536 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.536 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.536 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.536 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.536 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.536 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.537 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.537 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.537 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.537 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.537 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.537 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.537 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.537 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.538 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.538 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.538 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "telegraf", 2024-09-19T09:05:01.538 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.538 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.538 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.538 INFO:teuthology.orchestra.run.smithi019.stdout: "address": { 2024-09-19T09:05:01.538 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "address", 2024-09-19T09:05:01.539 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.539 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.539 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.539 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T09:05:01.539 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.539 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.539 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.539 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.539 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.540 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.540 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.540 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.540 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-19T09:05:01.540 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-19T09:05:01.540 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:01.540 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.540 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.541 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "15", 2024-09-19T09:05:01.541 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.541 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.541 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.541 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.541 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.541 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.541 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.542 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.542 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.542 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.542 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.542 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.542 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.542 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.542 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.542 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.543 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.543 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.543 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.543 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.543 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.543 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.543 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.543 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.544 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.544 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.544 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.544 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.544 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.544 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.544 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.544 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.545 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.545 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.545 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.545 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.545 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.545 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.545 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.545 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.545 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.546 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.546 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.546 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.546 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.546 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.546 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.546 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.546 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.547 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.547 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.547 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.547 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.547 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.547 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.547 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.547 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.547 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.548 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.548 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.548 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.548 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.548 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.548 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.548 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.548 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.549 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.549 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.549 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.549 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.549 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.549 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.549 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.549 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.550 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.550 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.550 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.550 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.550 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.550 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.550 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.550 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "telemetry", 2024-09-19T09:05:01.551 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.551 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.551 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.551 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_basic": { 2024-09-19T09:05:01.551 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_basic", 2024-09-19T09:05:01.551 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.551 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.551 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.552 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.552 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.552 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.552 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.552 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T09:05:01.552 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.552 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.552 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.553 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.553 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_crash": { 2024-09-19T09:05:01.553 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_crash", 2024-09-19T09:05:01.553 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.553 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.553 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.553 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.553 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.554 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.554 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.554 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T09:05:01.554 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.554 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.554 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.554 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.554 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_device": { 2024-09-19T09:05:01.554 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_device", 2024-09-19T09:05:01.555 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.555 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.555 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.555 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.555 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.555 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.555 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.556 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T09:05:01.556 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.556 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.556 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.556 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.556 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_ident": { 2024-09-19T09:05:01.556 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_ident", 2024-09-19T09:05:01.556 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.557 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.557 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.557 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.557 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.557 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.557 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.557 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T09:05:01.557 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.558 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.558 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.558 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.558 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_perf": { 2024-09-19T09:05:01.558 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_perf", 2024-09-19T09:05:01.558 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.558 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.558 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.558 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.559 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.559 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.559 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.559 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T09:05:01.559 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.559 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.559 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.559 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.560 INFO:teuthology.orchestra.run.smithi019.stdout: "contact": { 2024-09-19T09:05:01.560 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "contact", 2024-09-19T09:05:01.560 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.560 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.560 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.560 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.560 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.560 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.561 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.561 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.561 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.561 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.561 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.561 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.561 INFO:teuthology.orchestra.run.smithi019.stdout: "description": { 2024-09-19T09:05:01.561 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "description", 2024-09-19T09:05:01.562 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.562 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.562 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.562 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.562 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.562 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.562 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.562 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.563 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.563 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.563 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.563 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.563 INFO:teuthology.orchestra.run.smithi019.stdout: "device_url": { 2024-09-19T09:05:01.563 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "device_url", 2024-09-19T09:05:01.563 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.563 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.563 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.564 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T09:05:01.564 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.564 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.564 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.564 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.564 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.564 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.564 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.565 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.565 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": { 2024-09-19T09:05:01.565 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "enabled", 2024-09-19T09:05:01.565 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.565 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.565 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.565 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.565 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.566 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.566 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.566 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.566 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.566 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.566 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.566 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.566 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-19T09:05:01.566 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-19T09:05:01.567 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.567 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.567 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.567 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "24", 2024-09-19T09:05:01.567 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "8", 2024-09-19T09:05:01.567 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.567 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.567 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.568 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.568 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.568 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.568 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.568 INFO:teuthology.orchestra.run.smithi019.stdout: "last_opt_revision": { 2024-09-19T09:05:01.568 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "last_opt_revision", 2024-09-19T09:05:01.568 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.568 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.568 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.569 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "1", 2024-09-19T09:05:01.569 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.569 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.569 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.569 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.569 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.569 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.569 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.570 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.570 INFO:teuthology.orchestra.run.smithi019.stdout: "leaderboard": { 2024-09-19T09:05:01.570 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "leaderboard", 2024-09-19T09:05:01.570 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.570 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.570 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.570 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.570 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.571 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.571 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.571 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.571 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.571 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.571 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.571 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.571 INFO:teuthology.orchestra.run.smithi019.stdout: "leaderboard_description": { 2024-09-19T09:05:01.572 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "leaderboard_description", 2024-09-19T09:05:01.572 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.572 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.572 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.572 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.572 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.572 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.572 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.572 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.573 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.573 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.573 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.573 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.573 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.573 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.573 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.573 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.574 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.574 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.574 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.574 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.574 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.574 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.574 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.574 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.574 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.575 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.575 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.575 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.575 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.575 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.575 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.575 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.575 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.576 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.576 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.576 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.576 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.576 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.576 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.576 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.576 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.576 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.577 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.577 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.577 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.577 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.577 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.577 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.577 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.577 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.578 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.578 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.578 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.578 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.578 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.578 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.578 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.580 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.580 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.580 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.580 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.580 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.580 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.581 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.581 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.581 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.581 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.581 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.581 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.581 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.581 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.582 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.582 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.582 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.582 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.582 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.582 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.582 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.582 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.582 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.583 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.583 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.583 INFO:teuthology.orchestra.run.smithi019.stdout: "organization": { 2024-09-19T09:05:01.583 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "organization", 2024-09-19T09:05:01.583 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.583 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.583 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.583 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.584 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.584 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.584 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.584 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.584 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.584 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.584 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.584 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.585 INFO:teuthology.orchestra.run.smithi019.stdout: "proxy": { 2024-09-19T09:05:01.585 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "proxy", 2024-09-19T09:05:01.585 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.585 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.585 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.585 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.585 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.585 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.586 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.586 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.586 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.586 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.586 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.586 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.586 INFO:teuthology.orchestra.run.smithi019.stdout: "url": { 2024-09-19T09:05:01.586 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "url", 2024-09-19T09:05:01.586 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.587 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.587 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.587 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T09:05:01.587 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.587 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.587 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.587 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.587 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.588 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.588 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.588 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.588 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.588 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.588 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.588 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "test_orchestrator", 2024-09-19T09:05:01.588 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.588 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.589 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.589 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.589 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.589 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.589 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.589 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.589 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.589 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.590 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.590 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.590 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.590 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.590 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.590 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.590 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.590 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.590 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.591 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.591 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.591 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.591 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.591 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.591 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.591 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.591 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.592 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.592 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.592 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.592 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.592 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.592 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.592 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.592 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.593 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.593 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.593 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.593 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.593 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.593 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.593 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.593 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.593 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.594 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.594 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.594 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.594 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.594 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.594 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.594 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.594 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.595 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.595 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.595 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.595 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.595 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.595 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.595 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.595 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.595 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.596 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.596 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.596 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.596 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.596 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.596 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.596 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.596 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.597 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.597 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.597 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.597 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.597 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.597 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.597 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.597 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "volumes", 2024-09-19T09:05:01.598 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.598 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.598 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.598 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.598 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.598 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.598 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.598 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.598 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.599 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.599 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.599 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.599 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.599 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.599 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.599 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.599 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.600 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.600 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.600 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.600 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.600 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.600 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.600 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.600 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.600 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.601 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.601 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.601 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.601 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.601 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.601 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.601 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.601 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.602 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.602 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.602 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.602 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.602 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.602 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.602 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.602 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.602 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.603 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.603 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.603 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.603 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.603 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.603 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.603 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.603 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.604 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.604 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.604 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.604 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.604 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.604 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.604 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.604 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.605 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.605 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.605 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.605 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.605 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.605 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.605 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.605 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.605 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.606 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.606 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.606 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.606 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.606 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.606 INFO:teuthology.orchestra.run.smithi019.stdout: "max_concurrent_clones": { 2024-09-19T09:05:01.606 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_concurrent_clones", 2024-09-19T09:05:01.606 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.607 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.607 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.607 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "4", 2024-09-19T09:05:01.607 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.607 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.607 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.607 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T09:05:01.607 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.608 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.608 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.608 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.608 INFO:teuthology.orchestra.run.smithi019.stdout: "periodic_async_work": { 2024-09-19T09:05:01.608 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "periodic_async_work", 2024-09-19T09:05:01.608 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.608 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.608 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.609 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.609 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.609 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.609 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.609 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Periodically check for async work", 2024-09-19T09:05:01.609 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.609 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.609 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.610 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.610 INFO:teuthology.orchestra.run.smithi019.stdout: "snapshot_clone_delay": { 2024-09-19T09:05:01.610 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "snapshot_clone_delay", 2024-09-19T09:05:01.610 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.610 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.610 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.610 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-19T09:05:01.610 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.610 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.611 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.611 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T09:05:01.611 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.611 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.611 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.611 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.611 INFO:teuthology.orchestra.run.smithi019.stdout: "snapshot_clone_no_wait": { 2024-09-19T09:05:01.611 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T09:05:01.612 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.612 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.612 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.612 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.612 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.612 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.612 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.612 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T09:05:01.613 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.613 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.613 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.613 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.613 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.613 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.613 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.614 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "zabbix", 2024-09-19T09:05:01.614 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.614 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.614 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.614 INFO:teuthology.orchestra.run.smithi019.stdout: "discovery_interval": { 2024-09-19T09:05:01.614 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "discovery_interval", 2024-09-19T09:05:01.614 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-19T09:05:01.614 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.615 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.615 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "100", 2024-09-19T09:05:01.615 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.615 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.615 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.615 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.615 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.615 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.616 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.616 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.616 INFO:teuthology.orchestra.run.smithi019.stdout: "identifier": { 2024-09-19T09:05:01.616 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "identifier", 2024-09-19T09:05:01.616 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.616 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.616 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.616 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.616 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.617 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.617 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.617 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.617 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.617 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.617 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.617 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.617 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-19T09:05:01.618 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-19T09:05:01.618 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:01.618 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.618 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.618 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-19T09:05:01.618 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.618 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.618 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.619 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.619 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.619 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.619 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.619 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.619 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.619 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.619 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.619 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.620 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.620 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.620 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.620 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.620 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.620 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.620 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.620 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.621 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.621 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.621 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.621 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.621 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.621 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.621 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.621 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.622 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.622 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.622 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.622 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.622 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.622 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.622 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.622 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.622 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.623 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.623 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.623 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.623 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.623 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.623 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.623 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.623 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.624 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.624 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.624 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.624 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.624 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.624 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.624 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.624 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.624 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.625 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.625 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.625 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.625 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.625 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.625 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.625 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.625 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.626 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.626 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.626 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.626 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.626 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.626 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.626 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.626 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.627 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.627 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.627 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.627 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.627 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.627 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.627 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.627 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.627 INFO:teuthology.orchestra.run.smithi019.stdout: "zabbix_host": { 2024-09-19T09:05:01.628 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "zabbix_host", 2024-09-19T09:05:01.628 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.628 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.628 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.628 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.628 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.628 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.628 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.628 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.629 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.629 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.629 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.629 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.629 INFO:teuthology.orchestra.run.smithi019.stdout: "zabbix_port": { 2024-09-19T09:05:01.629 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "zabbix_port", 2024-09-19T09:05:01.629 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.629 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.630 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.630 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10051", 2024-09-19T09:05:01.630 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.630 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.630 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.630 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.630 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.630 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.631 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.631 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.631 INFO:teuthology.orchestra.run.smithi019.stdout: "zabbix_sender": { 2024-09-19T09:05:01.631 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "zabbix_sender", 2024-09-19T09:05:01.631 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.631 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.631 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.631 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T09:05:01.632 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.632 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.632 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.632 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.632 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.632 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.632 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.632 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.633 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.633 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.633 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-19T09:05:01.633 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.633 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.633 INFO:teuthology.orchestra.run.smithi019.stdout: "modules": [ 2024-09-19T09:05:01.633 INFO:teuthology.orchestra.run.smithi019.stdout: "cephadm", 2024-09-19T09:05:01.633 INFO:teuthology.orchestra.run.smithi019.stdout: "dashboard", 2024-09-19T09:05:01.633 INFO:teuthology.orchestra.run.smithi019.stdout: "iostat", 2024-09-19T09:05:01.634 INFO:teuthology.orchestra.run.smithi019.stdout: "nfs", 2024-09-19T09:05:01.634 INFO:teuthology.orchestra.run.smithi019.stdout: "restful" 2024-09-19T09:05:01.634 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.634 INFO:teuthology.orchestra.run.smithi019.stdout: "available_modules": [ 2024-09-19T09:05:01.634 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.634 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "alerts", 2024-09-19T09:05:01.634 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.634 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.634 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.635 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-19T09:05:01.635 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-19T09:05:01.635 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:01.635 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.635 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.635 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-19T09:05:01.635 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.635 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.636 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.636 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T09:05:01.636 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.636 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.636 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.636 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.636 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.636 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.637 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.637 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.637 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.637 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.637 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.637 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.637 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.637 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.637 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.638 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.638 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.638 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.638 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.638 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.638 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.638 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.638 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.639 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.639 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.639 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.639 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.639 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.639 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.639 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.639 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.639 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.640 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.640 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.640 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.640 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.640 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.640 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.640 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.640 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.641 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.641 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.641 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.641 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.641 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.641 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.641 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.641 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.642 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.642 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.642 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.642 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.642 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.642 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.642 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.642 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.643 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.643 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.643 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.643 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.643 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.643 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.643 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.643 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.643 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.644 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.644 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.644 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.644 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.644 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.644 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.644 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.644 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.645 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.645 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_destination": { 2024-09-19T09:05:01.645 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_destination", 2024-09-19T09:05:01.645 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.645 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.645 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.645 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.645 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.646 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.646 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.646 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Email address to send alerts to", 2024-09-19T09:05:01.646 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.646 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.646 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.646 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.646 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_from_name": { 2024-09-19T09:05:01.646 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_from_name", 2024-09-19T09:05:01.647 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.647 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.647 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.647 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "Ceph", 2024-09-19T09:05:01.647 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.647 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.647 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.647 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Email From: name", 2024-09-19T09:05:01.647 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.648 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.648 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.648 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.648 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_host": { 2024-09-19T09:05:01.648 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_host", 2024-09-19T09:05:01.648 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.648 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.648 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.649 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.649 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.649 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.649 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.649 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "SMTP server", 2024-09-19T09:05:01.649 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.649 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.649 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.650 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.650 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_password": { 2024-09-19T09:05:01.650 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_password", 2024-09-19T09:05:01.650 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.650 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.650 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.650 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.650 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.650 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.651 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.651 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Password to authenticate with", 2024-09-19T09:05:01.651 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.651 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.651 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.651 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.651 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_port": { 2024-09-19T09:05:01.651 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_port", 2024-09-19T09:05:01.651 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.652 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.652 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.652 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "465", 2024-09-19T09:05:01.652 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.652 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.652 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.652 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "SMTP port", 2024-09-19T09:05:01.652 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.653 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.653 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.653 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.653 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_sender": { 2024-09-19T09:05:01.653 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_sender", 2024-09-19T09:05:01.653 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.653 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.653 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.654 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.654 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.654 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.654 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.654 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "SMTP envelope sender", 2024-09-19T09:05:01.654 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.654 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.654 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.654 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.655 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_ssl": { 2024-09-19T09:05:01.655 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_ssl", 2024-09-19T09:05:01.655 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.655 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.655 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.655 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.655 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.655 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.656 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.656 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T09:05:01.656 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.656 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.656 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.656 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.656 INFO:teuthology.orchestra.run.smithi019.stdout: "smtp_user": { 2024-09-19T09:05:01.656 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "smtp_user", 2024-09-19T09:05:01.656 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.657 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.657 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.657 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.657 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.657 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.657 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.657 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "User to authenticate as", 2024-09-19T09:05:01.657 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.658 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.658 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.658 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.658 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.658 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.658 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.658 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "balancer", 2024-09-19T09:05:01.658 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.659 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.659 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.659 INFO:teuthology.orchestra.run.smithi019.stdout: "active": { 2024-09-19T09:05:01.659 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "active", 2024-09-19T09:05:01.659 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.659 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.659 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.659 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.659 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.660 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.660 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.660 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T09:05:01.660 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.660 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.660 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.660 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.660 INFO:teuthology.orchestra.run.smithi019.stdout: "begin_time": { 2024-09-19T09:05:01.661 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "begin_time", 2024-09-19T09:05:01.661 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.661 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.661 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.661 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0000", 2024-09-19T09:05:01.661 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.661 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.661 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.662 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T09:05:01.662 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:05:01.662 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.662 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.662 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.662 INFO:teuthology.orchestra.run.smithi019.stdout: "begin_weekday": { 2024-09-19T09:05:01.662 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "begin_weekday", 2024-09-19T09:05:01.662 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-19T09:05:01.663 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.663 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.663 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-19T09:05:01.663 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "0", 2024-09-19T09:05:01.663 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "6", 2024-09-19T09:05:01.663 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.663 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T09:05:01.663 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:05:01.664 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.664 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.664 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.664 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_compat_max_iterations": { 2024-09-19T09:05:01.664 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crush_compat_max_iterations", 2024-09-19T09:05:01.664 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-19T09:05:01.664 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.664 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.665 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "25", 2024-09-19T09:05:01.665 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1", 2024-09-19T09:05:01.665 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "250", 2024-09-19T09:05:01.665 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.665 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T09:05:01.665 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.665 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.665 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.666 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.666 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_compat_metrics": { 2024-09-19T09:05:01.666 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crush_compat_metrics", 2024-09-19T09:05:01.666 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.666 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.666 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.666 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T09:05:01.666 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.666 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.667 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.667 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T09:05:01.667 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T09:05:01.667 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.667 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.667 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.667 INFO:teuthology.orchestra.run.smithi019.stdout: "crush_compat_step": { 2024-09-19T09:05:01.667 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crush_compat_step", 2024-09-19T09:05:01.668 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-19T09:05:01.668 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.668 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.668 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0.5", 2024-09-19T09:05:01.668 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "0.001", 2024-09-19T09:05:01.668 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "0.999", 2024-09-19T09:05:01.668 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.668 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "aggressiveness of optimization", 2024-09-19T09:05:01.669 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T09:05:01.669 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.669 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.669 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.669 INFO:teuthology.orchestra.run.smithi019.stdout: "end_time": { 2024-09-19T09:05:01.669 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "end_time", 2024-09-19T09:05:01.669 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.669 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.669 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.670 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "2359", 2024-09-19T09:05:01.670 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.670 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.670 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.670 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T09:05:01.670 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T09:05:01.670 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.671 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.671 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.671 INFO:teuthology.orchestra.run.smithi019.stdout: "end_weekday": { 2024-09-19T09:05:01.671 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "end_weekday", 2024-09-19T09:05:01.671 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-19T09:05:01.671 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.671 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.671 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-19T09:05:01.671 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "0", 2024-09-19T09:05:01.672 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "6", 2024-09-19T09:05:01.672 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.672 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T09:05:01.672 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T09:05:01.672 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.672 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.672 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.672 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.673 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.673 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.673 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.673 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.673 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.673 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.673 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.673 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.673 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.674 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.674 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.674 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.674 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.674 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.674 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.674 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.674 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.675 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.675 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.675 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.675 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.675 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.675 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.675 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.675 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.675 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.676 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.676 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.676 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.676 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.676 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.676 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.676 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.677 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.677 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.677 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.677 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.677 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.677 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.677 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.677 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.677 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.678 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.678 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.678 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.678 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.678 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.678 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.678 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.678 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.678 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.679 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.679 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.679 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.679 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.679 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.679 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.679 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.679 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.680 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.680 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.680 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.680 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.680 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.680 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.680 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.680 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.680 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.681 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.681 INFO:teuthology.orchestra.run.smithi019.stdout: "min_score": { 2024-09-19T09:05:01.681 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "min_score", 2024-09-19T09:05:01.681 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-19T09:05:01.681 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.681 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.681 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-19T09:05:01.681 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.682 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.682 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.682 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T09:05:01.682 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.682 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.682 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.682 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.682 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": { 2024-09-19T09:05:01.682 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mode", 2024-09-19T09:05:01.683 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.683 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.683 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.683 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "upmap", 2024-09-19T09:05:01.683 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.683 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.683 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.683 INFO:teuthology.orchestra.run.smithi019.stdout: "crush-compat", 2024-09-19T09:05:01.684 INFO:teuthology.orchestra.run.smithi019.stdout: "none", 2024-09-19T09:05:01.684 INFO:teuthology.orchestra.run.smithi019.stdout: "read", 2024-09-19T09:05:01.684 INFO:teuthology.orchestra.run.smithi019.stdout: "upmap", 2024-09-19T09:05:01.684 INFO:teuthology.orchestra.run.smithi019.stdout: "upmap-read" 2024-09-19T09:05:01.684 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.684 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Balancer mode", 2024-09-19T09:05:01.684 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.684 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.685 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.685 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.685 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_ids": { 2024-09-19T09:05:01.685 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "pool_ids", 2024-09-19T09:05:01.685 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.685 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.685 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.685 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.685 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.686 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.686 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.686 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T09:05:01.686 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.686 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.686 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.686 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.686 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-19T09:05:01.687 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-19T09:05:01.687 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:01.687 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.687 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.687 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-19T09:05:01.687 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.687 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.687 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.688 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T09:05:01.688 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.688 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.688 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.688 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.688 INFO:teuthology.orchestra.run.smithi019.stdout: "upmap_max_deviation": { 2024-09-19T09:05:01.688 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "upmap_max_deviation", 2024-09-19T09:05:01.688 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.688 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.689 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.689 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-19T09:05:01.689 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1", 2024-09-19T09:05:01.689 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.689 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.689 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T09:05:01.689 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T09:05:01.689 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.690 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.690 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.690 INFO:teuthology.orchestra.run.smithi019.stdout: "upmap_max_optimizations": { 2024-09-19T09:05:01.690 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "upmap_max_optimizations", 2024-09-19T09:05:01.690 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-19T09:05:01.690 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.690 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.690 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-19T09:05:01.691 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.691 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.691 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.691 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T09:05:01.691 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.691 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.691 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.691 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.691 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.692 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.692 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.692 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cephadm", 2024-09-19T09:05:01.692 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.692 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.692 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.692 INFO:teuthology.orchestra.run.smithi019.stdout: "agent_down_multiplier": { 2024-09-19T09:05:01.692 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "agent_down_multiplier", 2024-09-19T09:05:01.692 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-19T09:05:01.693 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.693 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.693 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "3.0", 2024-09-19T09:05:01.693 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.693 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.693 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.693 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T09:05:01.693 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.694 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.694 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.694 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.694 INFO:teuthology.orchestra.run.smithi019.stdout: "agent_refresh_rate": { 2024-09-19T09:05:01.694 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "agent_refresh_rate", 2024-09-19T09:05:01.694 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:01.694 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.694 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.694 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "20", 2024-09-19T09:05:01.695 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.695 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.695 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.695 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T09:05:01.695 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.695 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.695 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.695 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.696 INFO:teuthology.orchestra.run.smithi019.stdout: "agent_starting_port": { 2024-09-19T09:05:01.696 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "agent_starting_port", 2024-09-19T09:05:01.696 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.696 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.696 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.696 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "4721", 2024-09-19T09:05:01.696 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.696 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.696 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.697 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T09:05:01.697 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.697 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.697 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.697 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.697 INFO:teuthology.orchestra.run.smithi019.stdout: "allow_ptrace": { 2024-09-19T09:05:01.697 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "allow_ptrace", 2024-09-19T09:05:01.697 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.698 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.698 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.698 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.698 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.698 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.698 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.698 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T09:05:01.698 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T09:05:01.698 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.699 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.699 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.699 INFO:teuthology.orchestra.run.smithi019.stdout: "autotune_interval": { 2024-09-19T09:05:01.699 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "autotune_interval", 2024-09-19T09:05:01.699 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:01.699 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.699 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.699 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-19T09:05:01.700 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.700 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.700 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.700 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T09:05:01.700 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.700 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.700 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.700 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.700 INFO:teuthology.orchestra.run.smithi019.stdout: "autotune_memory_target_ratio": { 2024-09-19T09:05:01.701 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T09:05:01.701 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-19T09:05:01.701 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.701 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.701 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0.7", 2024-09-19T09:05:01.701 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.701 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.701 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.702 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T09:05:01.702 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.702 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.702 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.702 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.702 INFO:teuthology.orchestra.run.smithi019.stdout: "cephadm_log_destination": { 2024-09-19T09:05:01.702 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cephadm_log_destination", 2024-09-19T09:05:01.702 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.702 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.703 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.703 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.703 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.703 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.703 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.703 INFO:teuthology.orchestra.run.smithi019.stdout: "file", 2024-09-19T09:05:01.703 INFO:teuthology.orchestra.run.smithi019.stdout: "file,syslog", 2024-09-19T09:05:01.703 INFO:teuthology.orchestra.run.smithi019.stdout: "syslog" 2024-09-19T09:05:01.704 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.704 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T09:05:01.704 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.704 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.704 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.704 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.704 INFO:teuthology.orchestra.run.smithi019.stdout: "cgroups_split": { 2024-09-19T09:05:01.704 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cgroups_split", 2024-09-19T09:05:01.704 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.705 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.705 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.705 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.705 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.705 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.705 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.705 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T09:05:01.705 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.706 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.706 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.706 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.706 INFO:teuthology.orchestra.run.smithi019.stdout: "config_checks_enabled": { 2024-09-19T09:05:01.706 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "config_checks_enabled", 2024-09-19T09:05:01.706 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.706 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.706 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.707 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.707 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.707 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.707 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.707 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T09:05:01.707 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.707 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.707 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.708 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.708 INFO:teuthology.orchestra.run.smithi019.stdout: "config_dashboard": { 2024-09-19T09:05:01.708 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "config_dashboard", 2024-09-19T09:05:01.708 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.708 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.708 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.708 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.708 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.709 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.709 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.709 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T09:05:01.709 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.709 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.709 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.709 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.709 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_alertmanager": { 2024-09-19T09:05:01.710 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_alertmanager", 2024-09-19T09:05:01.710 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.710 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.710 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.710 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T09:05:01.710 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.710 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.710 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.710 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Prometheus container image", 2024-09-19T09:05:01.711 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.711 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.711 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.711 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.711 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_base": { 2024-09-19T09:05:01.711 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_base", 2024-09-19T09:05:01.711 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.711 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.712 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.712 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T09:05:01.712 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.712 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.712 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.712 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Container image name, without the tag", 2024-09-19T09:05:01.712 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.712 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.713 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.713 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.713 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_elasticsearch": { 2024-09-19T09:05:01.713 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_elasticsearch", 2024-09-19T09:05:01.713 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.713 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.713 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.713 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T09:05:01.713 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.714 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.714 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.714 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "elasticsearch container image", 2024-09-19T09:05:01.714 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.714 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.714 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.714 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.714 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_grafana": { 2024-09-19T09:05:01.715 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_grafana", 2024-09-19T09:05:01.715 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.715 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.715 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.715 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T09:05:01.715 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.715 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.715 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.716 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Prometheus container image", 2024-09-19T09:05:01.716 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.716 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.716 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.716 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.716 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_haproxy": { 2024-09-19T09:05:01.716 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_haproxy", 2024-09-19T09:05:01.716 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.717 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.717 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.717 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T09:05:01.717 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.717 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.717 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.717 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "HAproxy container image", 2024-09-19T09:05:01.717 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.717 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.718 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.718 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.718 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_jaeger_agent": { 2024-09-19T09:05:01.718 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_jaeger_agent", 2024-09-19T09:05:01.718 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.718 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.718 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.718 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T09:05:01.719 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.719 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.719 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.719 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Jaeger agent container image", 2024-09-19T09:05:01.719 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.719 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.719 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.719 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.719 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_jaeger_collector": { 2024-09-19T09:05:01.720 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_jaeger_collector", 2024-09-19T09:05:01.720 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.720 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.720 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.720 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T09:05:01.720 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.720 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.720 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.721 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Jaeger collector container image", 2024-09-19T09:05:01.721 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.721 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.721 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.721 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.721 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_jaeger_query": { 2024-09-19T09:05:01.721 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_jaeger_query", 2024-09-19T09:05:01.721 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.721 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.722 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.722 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T09:05:01.722 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.722 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.722 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.722 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Jaeger query container image", 2024-09-19T09:05:01.722 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.722 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.723 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.723 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.723 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_keepalived": { 2024-09-19T09:05:01.723 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_keepalived", 2024-09-19T09:05:01.723 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.723 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.723 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.723 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T09:05:01.723 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.724 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.724 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.724 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Keepalived container image", 2024-09-19T09:05:01.724 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.724 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.724 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.724 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.724 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_loki": { 2024-09-19T09:05:01.725 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_loki", 2024-09-19T09:05:01.725 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.725 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.725 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.725 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T09:05:01.725 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.725 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.725 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.726 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Loki container image", 2024-09-19T09:05:01.726 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.726 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.726 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.726 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.726 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_node_exporter": { 2024-09-19T09:05:01.726 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_node_exporter", 2024-09-19T09:05:01.726 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.726 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.727 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.727 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T09:05:01.727 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.727 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.727 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.727 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Prometheus container image", 2024-09-19T09:05:01.727 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.727 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.727 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.728 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.728 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_nvmeof": { 2024-09-19T09:05:01.728 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_nvmeof", 2024-09-19T09:05:01.728 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.728 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.728 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.728 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T09:05:01.728 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.729 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.729 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.729 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Nvme-of container image", 2024-09-19T09:05:01.729 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.729 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.729 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.729 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.729 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_prometheus": { 2024-09-19T09:05:01.730 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_prometheus", 2024-09-19T09:05:01.730 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.730 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.730 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.730 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T09:05:01.730 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.730 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.730 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.730 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Prometheus container image", 2024-09-19T09:05:01.731 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.731 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.731 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.731 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.731 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_promtail": { 2024-09-19T09:05:01.731 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_promtail", 2024-09-19T09:05:01.731 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.731 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.732 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.732 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T09:05:01.732 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.732 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.732 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.732 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Promtail container image", 2024-09-19T09:05:01.732 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.732 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.733 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.733 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.733 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_samba": { 2024-09-19T09:05:01.733 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_samba", 2024-09-19T09:05:01.733 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.733 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.733 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.733 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T09:05:01.734 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.734 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.734 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.734 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Samba/SMB container image", 2024-09-19T09:05:01.734 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.734 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.734 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.734 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.735 INFO:teuthology.orchestra.run.smithi019.stdout: "container_image_snmp_gateway": { 2024-09-19T09:05:01.735 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_image_snmp_gateway", 2024-09-19T09:05:01.735 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.735 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.735 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.735 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T09:05:01.735 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.735 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.735 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.736 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "SNMP Gateway container image", 2024-09-19T09:05:01.736 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.736 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.736 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.736 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.736 INFO:teuthology.orchestra.run.smithi019.stdout: "container_init": { 2024-09-19T09:05:01.736 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "container_init", 2024-09-19T09:05:01.736 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.737 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.737 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.737 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.737 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.737 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.737 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.737 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T09:05:01.737 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.737 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.738 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.738 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.738 INFO:teuthology.orchestra.run.smithi019.stdout: "daemon_cache_timeout": { 2024-09-19T09:05:01.738 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "daemon_cache_timeout", 2024-09-19T09:05:01.738 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:01.738 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.738 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.738 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-19T09:05:01.739 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.739 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.739 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.739 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T09:05:01.739 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.739 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.739 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.739 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.740 INFO:teuthology.orchestra.run.smithi019.stdout: "default_cephadm_command_timeout": { 2024-09-19T09:05:01.740 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T09:05:01.740 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.740 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.740 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.740 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "900", 2024-09-19T09:05:01.740 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.740 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.741 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.741 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T09:05:01.741 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.741 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.741 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.741 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.741 INFO:teuthology.orchestra.run.smithi019.stdout: "default_registry": { 2024-09-19T09:05:01.741 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "default_registry", 2024-09-19T09:05:01.741 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.742 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.742 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.742 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "docker.io", 2024-09-19T09:05:01.742 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.742 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.742 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.742 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T09:05:01.742 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.743 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.743 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.743 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.743 INFO:teuthology.orchestra.run.smithi019.stdout: "device_cache_timeout": { 2024-09-19T09:05:01.743 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "device_cache_timeout", 2024-09-19T09:05:01.743 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:01.743 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.743 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.743 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "1800", 2024-09-19T09:05:01.744 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.744 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.744 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.744 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "seconds to cache device inventory", 2024-09-19T09:05:01.744 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.744 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.744 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.744 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.745 INFO:teuthology.orchestra.run.smithi019.stdout: "device_enhanced_scan": { 2024-09-19T09:05:01.745 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "device_enhanced_scan", 2024-09-19T09:05:01.745 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.745 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.745 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.745 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.745 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.745 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.746 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.746 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T09:05:01.746 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.746 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.746 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.746 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.746 INFO:teuthology.orchestra.run.smithi019.stdout: "facts_cache_timeout": { 2024-09-19T09:05:01.746 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "facts_cache_timeout", 2024-09-19T09:05:01.747 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:01.747 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.747 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.747 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-19T09:05:01.747 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.747 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.747 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.747 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "seconds to cache host facts data", 2024-09-19T09:05:01.747 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.748 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.748 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.748 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.748 INFO:teuthology.orchestra.run.smithi019.stdout: "grafana_dashboards_path": { 2024-09-19T09:05:01.748 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "grafana_dashboards_path", 2024-09-19T09:05:01.748 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.748 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.748 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.749 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T09:05:01.749 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.749 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.749 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.749 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T09:05:01.749 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.749 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.749 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.750 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.750 INFO:teuthology.orchestra.run.smithi019.stdout: "host_check_interval": { 2024-09-19T09:05:01.750 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "host_check_interval", 2024-09-19T09:05:01.750 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:01.750 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.750 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.750 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-19T09:05:01.750 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.751 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.751 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.751 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to perform a host check", 2024-09-19T09:05:01.751 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.751 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.751 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.751 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.751 INFO:teuthology.orchestra.run.smithi019.stdout: "hw_monitoring": { 2024-09-19T09:05:01.751 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "hw_monitoring", 2024-09-19T09:05:01.752 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.752 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.752 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.752 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.752 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.752 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.752 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.752 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T09:05:01.753 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.753 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.753 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.753 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.753 INFO:teuthology.orchestra.run.smithi019.stdout: "inventory_list_all": { 2024-09-19T09:05:01.753 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "inventory_list_all", 2024-09-19T09:05:01.753 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.753 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.754 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.754 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.754 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.754 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.754 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.754 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T09:05:01.754 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.754 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.755 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.755 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.755 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.755 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.755 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.755 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.755 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.755 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.755 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.756 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.756 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.756 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.756 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.756 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.756 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.756 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.756 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.757 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.757 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.757 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.757 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.757 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.757 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.757 INFO:teuthology.orchestra.run.smithi019.stdout: "log_refresh_metadata": { 2024-09-19T09:05:01.758 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_refresh_metadata", 2024-09-19T09:05:01.758 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.758 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.758 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.758 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.758 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.758 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.758 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.758 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T09:05:01.759 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.759 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.759 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.759 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.759 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.759 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.759 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.759 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.760 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.760 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.760 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.760 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.760 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.760 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T09:05:01.760 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.760 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.760 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.761 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.761 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.761 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.761 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.761 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.761 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.761 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.761 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.762 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.762 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.762 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.762 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.762 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.762 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.762 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.762 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.763 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.763 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.763 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.763 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.763 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.763 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.763 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.763 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.763 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.764 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.764 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.764 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.764 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.764 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.764 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.764 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.764 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.765 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.765 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.765 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.765 INFO:teuthology.orchestra.run.smithi019.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T09:05:01.765 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T09:05:01.765 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.765 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.765 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.766 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.766 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.766 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.766 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.766 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T09:05:01.766 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.766 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.766 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.767 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.767 INFO:teuthology.orchestra.run.smithi019.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T09:05:01.767 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T09:05:01.767 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.767 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.767 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.767 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "*", 2024-09-19T09:05:01.767 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.767 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.768 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.768 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T09:05:01.768 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.768 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.768 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.768 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.768 INFO:teuthology.orchestra.run.smithi019.stdout: "max_count_per_host": { 2024-09-19T09:05:01.768 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_count_per_host", 2024-09-19T09:05:01.769 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.769 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.769 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.769 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-19T09:05:01.769 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.769 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.769 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.769 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "max number of daemons per service per host", 2024-09-19T09:05:01.770 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.770 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.770 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.770 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.770 INFO:teuthology.orchestra.run.smithi019.stdout: "max_osd_draining_count": { 2024-09-19T09:05:01.770 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_osd_draining_count", 2024-09-19T09:05:01.770 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.770 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.770 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.771 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-19T09:05:01.771 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.771 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.771 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.771 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T09:05:01.771 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.771 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.771 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.771 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.772 INFO:teuthology.orchestra.run.smithi019.stdout: "migration_current": { 2024-09-19T09:05:01.772 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "migration_current", 2024-09-19T09:05:01.772 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.772 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.772 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.772 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.772 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.772 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.773 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.773 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "internal - do not modify", 2024-09-19T09:05:01.773 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.773 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.773 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.773 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.773 INFO:teuthology.orchestra.run.smithi019.stdout: "mode": { 2024-09-19T09:05:01.773 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mode", 2024-09-19T09:05:01.774 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.774 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.774 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.774 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "root", 2024-09-19T09:05:01.774 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.774 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.774 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.774 INFO:teuthology.orchestra.run.smithi019.stdout: "cephadm-package", 2024-09-19T09:05:01.774 INFO:teuthology.orchestra.run.smithi019.stdout: "root" 2024-09-19T09:05:01.775 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.775 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T09:05:01.775 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.775 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.775 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.775 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.775 INFO:teuthology.orchestra.run.smithi019.stdout: "oob_default_addr": { 2024-09-19T09:05:01.775 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "oob_default_addr", 2024-09-19T09:05:01.776 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.776 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.776 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.776 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "169.254.1.1", 2024-09-19T09:05:01.776 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.776 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.776 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.776 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T09:05:01.776 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.777 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.777 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.777 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.777 INFO:teuthology.orchestra.run.smithi019.stdout: "prometheus_alerts_path": { 2024-09-19T09:05:01.777 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "prometheus_alerts_path", 2024-09-19T09:05:01.777 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.777 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.777 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.778 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T09:05:01.778 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.778 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.778 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.778 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T09:05:01.778 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.778 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.778 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.778 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.779 INFO:teuthology.orchestra.run.smithi019.stdout: "registry_insecure": { 2024-09-19T09:05:01.779 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "registry_insecure", 2024-09-19T09:05:01.779 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.779 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.779 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.779 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.779 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.779 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.780 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.780 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T09:05:01.780 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.780 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.780 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.780 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.780 INFO:teuthology.orchestra.run.smithi019.stdout: "registry_password": { 2024-09-19T09:05:01.780 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "registry_password", 2024-09-19T09:05:01.780 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.781 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.781 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.781 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.781 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.781 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.781 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.781 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T09:05:01.781 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.782 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.782 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.782 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.782 INFO:teuthology.orchestra.run.smithi019.stdout: "registry_url": { 2024-09-19T09:05:01.782 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "registry_url", 2024-09-19T09:05:01.782 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.782 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.782 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.783 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.783 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.783 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.783 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.783 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T09:05:01.783 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.783 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.783 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.784 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.784 INFO:teuthology.orchestra.run.smithi019.stdout: "registry_username": { 2024-09-19T09:05:01.784 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "registry_username", 2024-09-19T09:05:01.784 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.784 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.784 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.784 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.784 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.785 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.785 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.785 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T09:05:01.785 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.785 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.785 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.785 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.785 INFO:teuthology.orchestra.run.smithi019.stdout: "secure_monitoring_stack": { 2024-09-19T09:05:01.786 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "secure_monitoring_stack", 2024-09-19T09:05:01.786 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.786 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.786 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.786 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.786 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.786 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.786 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.787 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T09:05:01.787 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.787 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.787 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.787 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.787 INFO:teuthology.orchestra.run.smithi019.stdout: "service_discovery_port": { 2024-09-19T09:05:01.787 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "service_discovery_port", 2024-09-19T09:05:01.787 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.787 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.788 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.788 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8765", 2024-09-19T09:05:01.788 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.788 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.788 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.788 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "cephadm service discovery port", 2024-09-19T09:05:01.788 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.788 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.789 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.789 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.789 INFO:teuthology.orchestra.run.smithi019.stdout: "ssh_config_file": { 2024-09-19T09:05:01.789 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ssh_config_file", 2024-09-19T09:05:01.789 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.789 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.789 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.789 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.790 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.790 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.790 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.790 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T09:05:01.790 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.790 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.790 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.790 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.791 INFO:teuthology.orchestra.run.smithi019.stdout: "use_agent": { 2024-09-19T09:05:01.791 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "use_agent", 2024-09-19T09:05:01.791 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.791 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.791 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.791 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.791 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.791 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.791 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.792 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T09:05:01.792 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.792 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.792 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.792 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.792 INFO:teuthology.orchestra.run.smithi019.stdout: "use_repo_digest": { 2024-09-19T09:05:01.792 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "use_repo_digest", 2024-09-19T09:05:01.792 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.793 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.793 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.793 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.793 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.793 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.793 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.793 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T09:05:01.793 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.794 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.794 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.794 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.794 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_on_failed_host_check": { 2024-09-19T09:05:01.794 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_on_failed_host_check", 2024-09-19T09:05:01.794 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.794 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.794 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.794 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.795 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.795 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.795 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.795 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T09:05:01.795 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.795 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.795 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.795 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.796 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_on_stray_daemons": { 2024-09-19T09:05:01.796 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_on_stray_daemons", 2024-09-19T09:05:01.796 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.796 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.796 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.796 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.796 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.796 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.797 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.797 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T09:05:01.797 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.797 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.797 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.797 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.797 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_on_stray_hosts": { 2024-09-19T09:05:01.797 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_on_stray_hosts", 2024-09-19T09:05:01.798 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.798 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.798 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.798 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.798 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.798 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.798 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.798 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T09:05:01.798 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.799 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.799 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.799 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.799 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.799 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.799 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.799 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crash", 2024-09-19T09:05:01.799 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.800 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.800 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.800 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.800 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.800 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.800 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.800 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.800 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.801 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.801 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.801 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.801 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.801 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.801 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.801 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.801 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.802 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.802 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.802 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.802 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.802 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.802 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.802 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.802 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.803 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.803 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.803 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.803 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.803 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.803 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.803 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.803 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.804 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.804 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.804 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.804 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.804 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.804 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.804 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.804 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.805 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.805 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.805 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.805 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.805 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.805 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.805 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.805 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.806 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.806 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.806 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.806 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.806 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.806 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.806 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.806 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.806 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.807 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.807 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.807 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.807 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.807 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.807 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.807 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.807 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.808 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.808 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.808 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.808 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.808 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.808 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.808 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.808 INFO:teuthology.orchestra.run.smithi019.stdout: "retain_interval": { 2024-09-19T09:05:01.809 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "retain_interval", 2024-09-19T09:05:01.809 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:01.809 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.809 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.809 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "31536000", 2024-09-19T09:05:01.809 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.809 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.810 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.810 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T09:05:01.810 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.810 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.810 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.810 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.810 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_recent_interval": { 2024-09-19T09:05:01.810 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_recent_interval", 2024-09-19T09:05:01.811 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:01.811 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.811 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.811 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "1209600", 2024-09-19T09:05:01.811 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.811 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.811 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.811 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T09:05:01.812 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.812 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.812 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.812 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.812 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.812 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.812 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.812 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "dashboard", 2024-09-19T09:05:01.813 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.813 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.813 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.813 INFO:teuthology.orchestra.run.smithi019.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T09:05:01.813 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T09:05:01.813 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.813 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.813 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.814 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-19T09:05:01.814 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.814 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.814 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.814 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.814 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.814 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.814 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.815 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.815 INFO:teuthology.orchestra.run.smithi019.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T09:05:01.815 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T09:05:01.815 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.815 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.815 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.815 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.815 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.816 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.816 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.816 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.816 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.816 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.816 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.816 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.816 INFO:teuthology.orchestra.run.smithi019.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T09:05:01.817 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T09:05:01.817 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.817 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.817 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.817 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.817 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.817 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.817 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.817 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.818 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.818 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.818 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.818 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.818 INFO:teuthology.orchestra.run.smithi019.stdout: "AUDIT_API_ENABLED": { 2024-09-19T09:05:01.818 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T09:05:01.818 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.818 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.819 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.819 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.819 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.819 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.819 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.819 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.819 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.819 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.820 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.820 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.820 INFO:teuthology.orchestra.run.smithi019.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T09:05:01.820 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T09:05:01.820 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.820 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.820 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.820 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.820 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.821 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.821 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.821 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.821 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.821 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.821 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.821 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.821 INFO:teuthology.orchestra.run.smithi019.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T09:05:01.822 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T09:05:01.822 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.822 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.822 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.822 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.822 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.822 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.822 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.823 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.823 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.823 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.823 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.823 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.823 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T09:05:01.823 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T09:05:01.823 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.823 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.824 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.824 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.824 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.824 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.824 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.824 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.824 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.824 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.825 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.825 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.825 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T09:05:01.825 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T09:05:01.825 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.825 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.825 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.825 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.825 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.826 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.826 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.826 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.826 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.826 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.826 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.826 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.826 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T09:05:01.827 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T09:05:01.827 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.827 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.827 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.827 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.827 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.827 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.827 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.828 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.828 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.828 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.828 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.828 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.828 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T09:05:01.828 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T09:05:01.828 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.828 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.829 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.829 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.829 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.829 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.829 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.829 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.829 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.829 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.830 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.830 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.830 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T09:05:01.830 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T09:05:01.830 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.830 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.830 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.830 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.831 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.831 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.831 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.831 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.831 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.831 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.831 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.831 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.831 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T09:05:01.832 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T09:05:01.832 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.832 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.832 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.832 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.832 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.832 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.832 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.833 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.833 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.833 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.833 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.833 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.833 INFO:teuthology.orchestra.run.smithi019.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T09:05:01.833 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T09:05:01.833 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.833 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.834 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.834 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.834 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.834 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.834 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.834 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.834 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.834 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.835 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.835 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.835 INFO:teuthology.orchestra.run.smithi019.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T09:05:01.835 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T09:05:01.835 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.835 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.835 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.835 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.836 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.836 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.836 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.836 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.836 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.836 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.836 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.836 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.837 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T09:05:01.837 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T09:05:01.837 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.837 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.837 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.837 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "admin", 2024-09-19T09:05:01.837 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.837 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.837 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.838 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.838 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.838 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.838 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.838 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.838 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T09:05:01.838 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T09:05:01.838 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.839 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.839 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.839 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.839 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.839 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.839 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.839 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.839 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.839 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.840 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.840 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.840 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_API_URL": { 2024-09-19T09:05:01.840 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_API_URL", 2024-09-19T09:05:01.840 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.840 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.840 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.840 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.841 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.841 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.841 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.841 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.841 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.841 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.841 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.841 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.841 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T09:05:01.842 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T09:05:01.842 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.842 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.842 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.842 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "admin", 2024-09-19T09:05:01.842 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.842 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.842 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.843 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.843 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.843 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.843 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.843 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.843 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T09:05:01.843 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T09:05:01.843 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.844 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.844 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.844 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.844 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.844 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.844 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.844 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.844 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.844 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.845 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.845 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.845 INFO:teuthology.orchestra.run.smithi019.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T09:05:01.845 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T09:05:01.845 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.845 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.845 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.845 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.846 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.846 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.846 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.846 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.846 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.846 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.846 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.846 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.846 INFO:teuthology.orchestra.run.smithi019.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T09:05:01.847 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T09:05:01.847 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.847 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.847 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.847 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.847 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.847 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.847 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.848 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.848 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.848 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.848 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.848 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.848 INFO:teuthology.orchestra.run.smithi019.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T09:05:01.848 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T09:05:01.848 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.848 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.849 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.849 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.849 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.849 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.849 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.849 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.849 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.849 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.850 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.850 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.850 INFO:teuthology.orchestra.run.smithi019.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T09:05:01.850 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T09:05:01.850 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.850 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.850 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.850 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.851 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.851 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.851 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.851 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.851 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.851 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.851 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.851 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.851 INFO:teuthology.orchestra.run.smithi019.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T09:05:01.852 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T09:05:01.852 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.852 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.852 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.852 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.852 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.852 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.852 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.853 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.853 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.853 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.853 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.853 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.853 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T09:05:01.853 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T09:05:01.853 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.853 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.854 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.854 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.854 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.854 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.854 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.854 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.854 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.854 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.855 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.855 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.855 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T09:05:01.855 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T09:05:01.855 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.855 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.855 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.855 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.855 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.856 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.856 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.856 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.856 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.856 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.856 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.856 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.856 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T09:05:01.857 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T09:05:01.857 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.857 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.857 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.857 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.857 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.857 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.857 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.858 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.858 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.858 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.858 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.858 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.858 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T09:05:01.858 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T09:05:01.858 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.858 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.859 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.859 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.859 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.859 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.859 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.859 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.859 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.859 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.860 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.860 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.860 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T09:05:01.860 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T09:05:01.860 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.860 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.860 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.860 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.860 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.861 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.861 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.861 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.861 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.861 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.861 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.861 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.861 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T09:05:01.862 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T09:05:01.862 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.862 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.862 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.862 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.862 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.862 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.862 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.863 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.863 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.863 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.863 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.863 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.863 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T09:05:01.863 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T09:05:01.863 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.863 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.864 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.864 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.864 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.864 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.864 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.864 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.864 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.864 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.865 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.865 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.865 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T09:05:01.865 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T09:05:01.865 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.865 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.865 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.865 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.866 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.866 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.866 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.866 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.866 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.866 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.866 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.866 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.866 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T09:05:01.867 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T09:05:01.867 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.867 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.867 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.867 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T09:05:01.867 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.867 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.867 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.868 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.868 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.868 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.868 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.868 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.868 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T09:05:01.868 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T09:05:01.868 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.869 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.869 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.869 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-19T09:05:01.869 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.869 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.869 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.869 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.869 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.869 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.870 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.870 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.870 INFO:teuthology.orchestra.run.smithi019.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T09:05:01.870 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T09:05:01.870 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.870 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.870 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.870 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8", 2024-09-19T09:05:01.871 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.871 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.871 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.871 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.871 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.871 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.871 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.871 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.872 INFO:teuthology.orchestra.run.smithi019.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T09:05:01.872 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T09:05:01.872 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.872 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.872 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.872 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "45", 2024-09-19T09:05:01.872 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.872 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.873 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.873 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.873 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.873 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.873 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.873 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.873 INFO:teuthology.orchestra.run.smithi019.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T09:05:01.873 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T09:05:01.874 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.874 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.874 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.874 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.874 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.874 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.874 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.874 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.874 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.875 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.875 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.875 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.875 INFO:teuthology.orchestra.run.smithi019.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T09:05:01.875 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T09:05:01.875 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.875 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.875 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.876 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "admin", 2024-09-19T09:05:01.876 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.876 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.876 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.876 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.876 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.876 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.876 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.877 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.877 INFO:teuthology.orchestra.run.smithi019.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T09:05:01.877 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T09:05:01.877 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.877 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.877 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.877 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.877 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.877 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.878 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.878 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.878 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.878 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.878 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.878 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.878 INFO:teuthology.orchestra.run.smithi019.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T09:05:01.878 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T09:05:01.879 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.879 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.879 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.879 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.879 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.879 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.879 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.879 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.879 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.880 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.880 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.880 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.880 INFO:teuthology.orchestra.run.smithi019.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T09:05:01.880 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T09:05:01.880 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.880 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.880 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.881 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-19T09:05:01.881 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.881 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.881 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.881 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.881 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.881 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.881 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.881 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.882 INFO:teuthology.orchestra.run.smithi019.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T09:05:01.882 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T09:05:01.882 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.882 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.882 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.882 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-19T09:05:01.882 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.882 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.883 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.883 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.883 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.883 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.883 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.883 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.883 INFO:teuthology.orchestra.run.smithi019.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T09:05:01.883 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T09:05:01.883 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.884 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.884 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.884 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-19T09:05:01.884 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.884 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.884 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.884 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.884 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.885 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.885 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.885 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.885 INFO:teuthology.orchestra.run.smithi019.stdout: "cross_origin_url": { 2024-09-19T09:05:01.885 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cross_origin_url", 2024-09-19T09:05:01.885 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.885 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.885 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.886 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.886 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.886 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.886 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.886 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.886 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.886 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.886 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.886 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.887 INFO:teuthology.orchestra.run.smithi019.stdout: "crt_file": { 2024-09-19T09:05:01.887 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "crt_file", 2024-09-19T09:05:01.887 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.887 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.887 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.887 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.887 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.887 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.888 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.888 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.888 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.888 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.888 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.888 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.888 INFO:teuthology.orchestra.run.smithi019.stdout: "debug": { 2024-09-19T09:05:01.888 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "debug", 2024-09-19T09:05:01.889 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.889 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.889 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.889 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.889 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.889 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.889 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.889 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Enable/disable debug options", 2024-09-19T09:05:01.890 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.890 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.890 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.890 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.890 INFO:teuthology.orchestra.run.smithi019.stdout: "jwt_token_ttl": { 2024-09-19T09:05:01.890 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "jwt_token_ttl", 2024-09-19T09:05:01.890 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.890 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.891 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.891 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "28800", 2024-09-19T09:05:01.891 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.891 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.891 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.891 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.891 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.891 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.892 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.892 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.892 INFO:teuthology.orchestra.run.smithi019.stdout: "key_file": { 2024-09-19T09:05:01.892 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "key_file", 2024-09-19T09:05:01.892 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.892 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.892 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.892 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.893 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.893 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.893 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.893 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.893 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.893 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.893 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.893 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.894 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.894 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.894 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.894 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.894 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.894 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.894 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.894 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.894 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.895 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.895 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.895 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.895 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.895 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.895 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.895 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.895 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.895 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.896 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.896 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.896 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.896 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.896 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.896 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.896 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.896 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.897 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.897 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.897 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.897 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.897 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.897 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.897 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.897 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.898 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.898 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.898 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.898 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.898 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.898 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.898 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.898 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.899 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.899 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.899 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.899 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.899 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.899 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.899 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.899 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.899 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.900 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.900 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.900 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.900 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.900 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.900 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.900 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.901 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.901 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.901 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.901 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.901 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.901 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.901 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.901 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.901 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.902 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.902 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.902 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.902 INFO:teuthology.orchestra.run.smithi019.stdout: "motd": { 2024-09-19T09:05:01.902 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "motd", 2024-09-19T09:05:01.902 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.902 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.902 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.903 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.903 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.903 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.903 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.903 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "The message of the day", 2024-09-19T09:05:01.903 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.903 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.903 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.904 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.904 INFO:teuthology.orchestra.run.smithi019.stdout: "redirect_resolve_ip_addr": { 2024-09-19T09:05:01.904 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T09:05:01.904 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.904 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.904 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.904 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.904 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.904 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.905 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.905 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.905 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.905 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.905 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.905 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.905 INFO:teuthology.orchestra.run.smithi019.stdout: "server_addr": { 2024-09-19T09:05:01.905 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_addr", 2024-09-19T09:05:01.906 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.906 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.906 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.906 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "::", 2024-09-19T09:05:01.906 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.906 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.906 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.906 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.906 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.907 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.907 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.907 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.907 INFO:teuthology.orchestra.run.smithi019.stdout: "server_port": { 2024-09-19T09:05:01.907 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_port", 2024-09-19T09:05:01.907 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.907 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.907 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.908 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8080", 2024-09-19T09:05:01.908 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.908 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.908 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.908 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.908 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.908 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.908 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.908 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.909 INFO:teuthology.orchestra.run.smithi019.stdout: "ssl": { 2024-09-19T09:05:01.909 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ssl", 2024-09-19T09:05:01.909 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.909 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.909 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.909 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.909 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.909 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.910 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.910 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.910 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.910 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.910 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.910 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.910 INFO:teuthology.orchestra.run.smithi019.stdout: "ssl_server_port": { 2024-09-19T09:05:01.910 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ssl_server_port", 2024-09-19T09:05:01.910 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.911 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.911 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.911 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8443", 2024-09-19T09:05:01.911 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.911 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.911 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.911 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.911 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.912 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.912 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.912 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.912 INFO:teuthology.orchestra.run.smithi019.stdout: "standby_behaviour": { 2024-09-19T09:05:01.912 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "standby_behaviour", 2024-09-19T09:05:01.912 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.912 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.912 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.913 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "redirect", 2024-09-19T09:05:01.913 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.913 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.913 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.913 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.913 INFO:teuthology.orchestra.run.smithi019.stdout: "redirect" 2024-09-19T09:05:01.913 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.913 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.913 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.914 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.914 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.914 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.914 INFO:teuthology.orchestra.run.smithi019.stdout: "standby_error_status_code": { 2024-09-19T09:05:01.914 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "standby_error_status_code", 2024-09-19T09:05:01.914 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.914 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.914 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.915 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "500", 2024-09-19T09:05:01.915 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "400", 2024-09-19T09:05:01.915 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "599", 2024-09-19T09:05:01.915 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.915 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.915 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.915 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.915 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.915 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.916 INFO:teuthology.orchestra.run.smithi019.stdout: "url_prefix": { 2024-09-19T09:05:01.916 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "url_prefix", 2024-09-19T09:05:01.916 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.916 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.916 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.916 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.916 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.916 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.917 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.917 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.917 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.917 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.917 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.917 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.917 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.917 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.917 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.918 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "devicehealth", 2024-09-19T09:05:01.918 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.918 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.918 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.918 INFO:teuthology.orchestra.run.smithi019.stdout: "enable_monitoring": { 2024-09-19T09:05:01.918 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "enable_monitoring", 2024-09-19T09:05:01.918 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.918 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.919 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.919 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.919 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.919 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.919 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.919 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "monitor device health metrics", 2024-09-19T09:05:01.919 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.919 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.920 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.920 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.920 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.920 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.920 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.920 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.920 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.920 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.921 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.921 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.921 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.921 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.921 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.921 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.921 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.921 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.921 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.922 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.922 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.922 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.922 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.922 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.922 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.922 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.922 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.923 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.923 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.923 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.923 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.923 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.923 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.923 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.923 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.923 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.924 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.924 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.924 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.924 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.924 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.924 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.924 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.924 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.925 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.925 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.925 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.925 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.925 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.925 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.925 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.925 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.926 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.926 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.926 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.926 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.926 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.926 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.926 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.926 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.927 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.927 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.927 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.927 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.927 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.927 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.927 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.927 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.928 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.928 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.928 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.928 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.928 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.928 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.928 INFO:teuthology.orchestra.run.smithi019.stdout: "mark_out_threshold": { 2024-09-19T09:05:01.928 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mark_out_threshold", 2024-09-19T09:05:01.929 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:01.929 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.929 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.929 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "2419200", 2024-09-19T09:05:01.929 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.929 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.929 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.929 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T09:05:01.930 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.930 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.930 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.930 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.930 INFO:teuthology.orchestra.run.smithi019.stdout: "pool_name": { 2024-09-19T09:05:01.930 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "pool_name", 2024-09-19T09:05:01.930 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.930 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.930 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.931 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "device_health_metrics", 2024-09-19T09:05:01.931 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.931 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.931 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.931 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T09:05:01.931 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.931 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.931 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.932 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.932 INFO:teuthology.orchestra.run.smithi019.stdout: "retention_period": { 2024-09-19T09:05:01.932 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "retention_period", 2024-09-19T09:05:01.932 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:01.932 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.932 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.932 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "15552000", 2024-09-19T09:05:01.932 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.932 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.933 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.933 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how long to retain device health metrics", 2024-09-19T09:05:01.933 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.933 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.933 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.933 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.933 INFO:teuthology.orchestra.run.smithi019.stdout: "scrape_frequency": { 2024-09-19T09:05:01.933 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "scrape_frequency", 2024-09-19T09:05:01.934 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:01.934 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.934 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.934 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "86400", 2024-09-19T09:05:01.934 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.934 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.934 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.934 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T09:05:01.935 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.935 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.935 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.935 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.935 INFO:teuthology.orchestra.run.smithi019.stdout: "self_heal": { 2024-09-19T09:05:01.935 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "self_heal", 2024-09-19T09:05:01.935 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.935 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.935 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.936 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:01.936 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.936 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.936 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.936 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T09:05:01.936 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.936 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.936 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.937 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.937 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-19T09:05:01.937 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-19T09:05:01.937 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:01.937 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.937 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.937 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-19T09:05:01.937 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.937 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.938 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.938 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T09:05:01.938 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.938 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.938 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.938 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.938 INFO:teuthology.orchestra.run.smithi019.stdout: "warn_threshold": { 2024-09-19T09:05:01.938 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "warn_threshold", 2024-09-19T09:05:01.939 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:01.939 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.939 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.939 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "7257600", 2024-09-19T09:05:01.939 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.939 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.939 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.939 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T09:05:01.940 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.940 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.940 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.940 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.940 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.940 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.940 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.940 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "diskprediction_local", 2024-09-19T09:05:01.941 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.941 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.941 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.941 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.941 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.941 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.941 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.941 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.942 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.942 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.942 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.942 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.942 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.942 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.942 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.942 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.942 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.943 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.943 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.943 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.943 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.943 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.943 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.943 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.943 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.944 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.944 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.944 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.944 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.944 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.944 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.944 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.944 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.944 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.945 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.945 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.945 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.945 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.945 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.945 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.946 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.946 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.946 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.946 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.946 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.946 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.946 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.946 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.946 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.947 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.947 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.947 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.947 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.947 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.947 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.947 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.947 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.948 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.948 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.948 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.948 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.948 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.948 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.948 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.948 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.949 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.949 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.949 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.949 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.949 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.949 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.949 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.949 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.950 INFO:teuthology.orchestra.run.smithi019.stdout: "predict_interval": { 2024-09-19T09:05:01.950 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "predict_interval", 2024-09-19T09:05:01.950 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.950 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.950 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.950 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "86400", 2024-09-19T09:05:01.950 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.951 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.951 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.951 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.951 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.951 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.951 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.951 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.951 INFO:teuthology.orchestra.run.smithi019.stdout: "predictor_model": { 2024-09-19T09:05:01.951 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "predictor_model", 2024-09-19T09:05:01.952 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.952 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.952 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.952 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "prophetstor", 2024-09-19T09:05:01.952 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.952 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.952 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.952 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.953 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.953 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.953 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.953 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.953 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-19T09:05:01.953 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-19T09:05:01.953 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.953 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.954 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.954 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "600", 2024-09-19T09:05:01.954 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.954 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.954 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.954 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.954 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.954 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.955 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.955 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.955 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.955 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.955 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.955 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "influx", 2024-09-19T09:05:01.955 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": false, 2024-09-19T09:05:01.955 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "influxdb python module not found", 2024-09-19T09:05:01.956 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.956 INFO:teuthology.orchestra.run.smithi019.stdout: "batch_size": { 2024-09-19T09:05:01.956 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "batch_size", 2024-09-19T09:05:01.956 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.956 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.956 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.956 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5000", 2024-09-19T09:05:01.956 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.957 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.957 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.957 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T09:05:01.957 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.957 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.957 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.957 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.957 INFO:teuthology.orchestra.run.smithi019.stdout: "database": { 2024-09-19T09:05:01.957 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "database", 2024-09-19T09:05:01.958 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.958 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.958 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.958 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "ceph", 2024-09-19T09:05:01.958 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.958 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.958 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.959 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T09:05:01.959 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.959 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.959 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.959 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.959 INFO:teuthology.orchestra.run.smithi019.stdout: "hostname": { 2024-09-19T09:05:01.959 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "hostname", 2024-09-19T09:05:01.959 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.960 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.960 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.960 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.960 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.960 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.960 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.960 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "InfluxDB server hostname", 2024-09-19T09:05:01.960 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.961 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.961 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.961 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.961 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-19T09:05:01.961 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-19T09:05:01.961 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:01.961 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.961 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.961 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "30", 2024-09-19T09:05:01.962 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "5", 2024-09-19T09:05:01.962 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.962 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.962 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T09:05:01.962 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.962 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.962 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.962 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.963 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.963 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.963 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.963 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.963 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.963 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.963 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.963 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.964 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.964 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.964 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.964 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.964 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.964 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.964 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.964 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.964 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.965 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.965 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.965 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.965 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.965 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.965 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.965 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.965 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.966 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.966 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.966 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.966 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.966 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.966 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.966 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.966 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.967 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.967 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.967 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.967 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.967 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.967 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.967 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.967 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.967 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.968 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.968 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.968 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.968 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.968 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.968 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.968 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.968 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.969 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.969 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.969 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.969 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.969 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.969 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.969 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.969 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.969 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.970 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.970 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.970 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.970 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.970 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.970 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.970 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.970 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.971 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.971 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.971 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.971 INFO:teuthology.orchestra.run.smithi019.stdout: "password": { 2024-09-19T09:05:01.971 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "password", 2024-09-19T09:05:01.971 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.971 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.971 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.971 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.972 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.972 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.972 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.972 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "password of InfluxDB server user", 2024-09-19T09:05:01.972 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.972 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.972 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.972 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.973 INFO:teuthology.orchestra.run.smithi019.stdout: "port": { 2024-09-19T09:05:01.973 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "port", 2024-09-19T09:05:01.973 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.973 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.973 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.973 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "8086", 2024-09-19T09:05:01.973 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.973 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.974 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.974 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "InfluxDB server port", 2024-09-19T09:05:01.974 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.974 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.974 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.974 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.974 INFO:teuthology.orchestra.run.smithi019.stdout: "ssl": { 2024-09-19T09:05:01.974 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ssl", 2024-09-19T09:05:01.974 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.975 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.975 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.975 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "false", 2024-09-19T09:05:01.975 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.975 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.975 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.975 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:05:01.975 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.976 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.976 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.976 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.976 INFO:teuthology.orchestra.run.smithi019.stdout: "threads": { 2024-09-19T09:05:01.976 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "threads", 2024-09-19T09:05:01.976 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:01.976 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.976 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.977 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-19T09:05:01.977 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1", 2024-09-19T09:05:01.977 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "32", 2024-09-19T09:05:01.977 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.977 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T09:05:01.977 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.977 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.977 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.977 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.978 INFO:teuthology.orchestra.run.smithi019.stdout: "username": { 2024-09-19T09:05:01.978 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "username", 2024-09-19T09:05:01.978 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.978 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.978 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.978 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.978 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.978 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.979 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.979 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "username of InfluxDB server user", 2024-09-19T09:05:01.979 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.979 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.979 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.979 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.979 INFO:teuthology.orchestra.run.smithi019.stdout: "verify_ssl": { 2024-09-19T09:05:01.979 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "verify_ssl", 2024-09-19T09:05:01.979 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.980 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.980 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:01.980 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "true", 2024-09-19T09:05:01.980 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.980 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.980 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.980 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T09:05:01.980 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.981 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.981 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.981 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.981 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.981 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.981 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.981 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "insights", 2024-09-19T09:05:01.981 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.982 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.982 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.982 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.982 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.982 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.982 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.982 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.982 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.982 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.983 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.983 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.983 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.983 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.983 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.983 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.983 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.983 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.984 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.984 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.984 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.984 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.984 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.984 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.984 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.984 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.984 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.985 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.985 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.985 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.985 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.985 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.985 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.985 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.985 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.986 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.986 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.986 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.986 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.986 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.986 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.988 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.988 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.988 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.988 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.988 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.988 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.989 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.989 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.989 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.989 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.989 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.989 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.989 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.989 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.989 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.990 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.990 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.990 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.990 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.990 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.990 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.990 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.990 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.991 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.991 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.991 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.991 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.991 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.991 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.991 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.991 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.991 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.992 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:01.992 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.992 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:01.992 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "iostat", 2024-09-19T09:05:01.992 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:01.992 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:01.992 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:01.992 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:01.993 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:01.993 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.993 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.993 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.993 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:01.993 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.993 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.993 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.994 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.994 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.994 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.994 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.994 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.994 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.994 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.994 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.994 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.995 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.995 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.995 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.995 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:01.995 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:01.995 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.995 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.995 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.996 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:01.996 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.996 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.996 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:01.996 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.996 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.996 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.996 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.996 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.997 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:01.997 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:01.997 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:01.997 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:01.997 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:01.997 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:01.997 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:01.997 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:01.998 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:01.998 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:01.998 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:01.998 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:01.998 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:01.998 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:01.998 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:01.998 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:01.998 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:01.999 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:01.999 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:01.999 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:01.999 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:01.999 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:01.999 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:01.999 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:01.999 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.000 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.000 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.000 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.000 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.000 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.000 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.000 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.000 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.001 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.001 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.001 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.001 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.001 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:02.001 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "k8sevents", 2024-09-19T09:05:02.001 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:02.001 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:02.002 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:02.002 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_event_retention_days": { 2024-09-19T09:05:02.002 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "ceph_event_retention_days", 2024-09-19T09:05:02.002 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:02.002 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.002 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.002 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "7", 2024-09-19T09:05:02.002 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.003 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.003 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.003 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T09:05:02.003 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.003 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.003 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.003 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.003 INFO:teuthology.orchestra.run.smithi019.stdout: "config_check_secs": { 2024-09-19T09:05:02.004 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "config_check_secs", 2024-09-19T09:05:02.004 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:02.004 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.004 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.004 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-19T09:05:02.004 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "10", 2024-09-19T09:05:02.004 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.004 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.005 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T09:05:02.005 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.005 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.005 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.005 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.005 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:02.005 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:02.005 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.006 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.006 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.006 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.006 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.006 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.006 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.006 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.006 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.007 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.007 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.007 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.007 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.007 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.007 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.007 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.007 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.008 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.008 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.008 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:02.008 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:02.008 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.008 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.008 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.008 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.008 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.009 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.009 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.009 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.009 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.009 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.009 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.009 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.009 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:02.010 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:02.010 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.010 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.010 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.010 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:02.010 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.010 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.010 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.011 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.011 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.011 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.011 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.011 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.011 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.011 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.011 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.011 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.012 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.012 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.012 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.012 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:02.012 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:02.012 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.012 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.012 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.013 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.013 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.013 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.013 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.013 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.013 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.013 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.013 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.014 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.014 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.014 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.014 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:02.014 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "localpool", 2024-09-19T09:05:02.014 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:02.014 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:02.014 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:02.014 INFO:teuthology.orchestra.run.smithi019.stdout: "failure_domain": { 2024-09-19T09:05:02.015 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "failure_domain", 2024-09-19T09:05:02.015 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.015 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.015 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.015 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "host", 2024-09-19T09:05:02.015 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.015 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.015 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.016 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "failure domain for any created local pool", 2024-09-19T09:05:02.016 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T09:05:02.016 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.016 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.016 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.016 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:02.016 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:02.016 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.017 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.017 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.017 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.017 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.017 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.017 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.017 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.017 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.018 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.018 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.018 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.018 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.018 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.018 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.018 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.018 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.019 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.019 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.019 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:02.019 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:02.019 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.019 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.019 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.019 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.020 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.020 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.020 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.020 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.020 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.020 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.020 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.020 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.021 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:02.021 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:02.021 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.021 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.021 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.021 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:02.021 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.021 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.021 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.022 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.022 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.022 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.022 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.022 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.022 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.022 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.022 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.022 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.023 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.023 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.023 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.023 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:02.023 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:02.023 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.023 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.023 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.024 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.024 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.024 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.024 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.024 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.024 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.024 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.024 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.024 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.025 INFO:teuthology.orchestra.run.smithi019.stdout: "min_size": { 2024-09-19T09:05:02.025 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "min_size", 2024-09-19T09:05:02.025 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:02.025 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.025 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.025 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.025 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.025 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.026 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.026 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "default min_size for any created local pool", 2024-09-19T09:05:02.026 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T09:05:02.026 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.026 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.026 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.026 INFO:teuthology.orchestra.run.smithi019.stdout: "num_rep": { 2024-09-19T09:05:02.026 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "num_rep", 2024-09-19T09:05:02.026 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:02.027 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.027 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.027 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "3", 2024-09-19T09:05:02.027 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.027 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.027 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.027 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "default replica count for any created local pool", 2024-09-19T09:05:02.027 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.028 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.028 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.028 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.028 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_num": { 2024-09-19T09:05:02.028 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "pg_num", 2024-09-19T09:05:02.028 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:02.028 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.028 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.029 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "128", 2024-09-19T09:05:02.029 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.029 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.029 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.029 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T09:05:02.029 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.029 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.029 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.029 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.030 INFO:teuthology.orchestra.run.smithi019.stdout: "prefix": { 2024-09-19T09:05:02.030 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "prefix", 2024-09-19T09:05:02.030 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.030 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.030 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.030 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.030 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.030 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.031 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.031 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "name prefix for any created local pool", 2024-09-19T09:05:02.031 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.031 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.031 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.031 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.031 INFO:teuthology.orchestra.run.smithi019.stdout: "subtree": { 2024-09-19T09:05:02.031 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "subtree", 2024-09-19T09:05:02.032 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.032 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.032 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.032 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "rack", 2024-09-19T09:05:02.032 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.032 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.032 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.032 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T09:05:02.032 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T09:05:02.033 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.033 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.033 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.033 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.033 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.033 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:02.033 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mds_autoscaler", 2024-09-19T09:05:02.033 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:02.034 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:02.034 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:02.034 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:02.034 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:02.034 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.034 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.034 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.034 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.034 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.035 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.035 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.035 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.035 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.035 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.035 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.035 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.035 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.035 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.036 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.036 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.036 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.036 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.036 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.036 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:02.036 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:02.036 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.037 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.037 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.037 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.037 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.037 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.037 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.037 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.037 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.038 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.038 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.038 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.038 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:02.038 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:02.038 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.038 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.038 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.038 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:02.039 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.039 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.039 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.039 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.039 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.039 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.039 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.039 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.040 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.040 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.040 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.040 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.040 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.040 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.040 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.040 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:02.040 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:02.041 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.041 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.041 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.041 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.041 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.041 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.041 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.041 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.042 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.042 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.042 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.042 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.042 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.042 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.042 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:02.042 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mirroring", 2024-09-19T09:05:02.043 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:02.043 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:02.043 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:02.043 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:02.043 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:02.043 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.043 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.043 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.043 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.044 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.044 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.044 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.044 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.044 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.044 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.044 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.044 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.045 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.045 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.045 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.045 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.045 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.045 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.045 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.045 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:02.046 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:02.046 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.046 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.046 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.046 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.046 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.046 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.046 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.046 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.047 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.047 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.047 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.047 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.047 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:02.047 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:02.047 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.047 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.048 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.048 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:02.048 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.048 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.048 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.048 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.048 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.048 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.048 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.049 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.049 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.049 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.049 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.049 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.049 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.049 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.049 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.050 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:02.050 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:02.050 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.050 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.050 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.050 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.050 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.050 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.050 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.051 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.051 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.051 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.051 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.051 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.051 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.051 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.051 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:02.052 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "nfs", 2024-09-19T09:05:02.052 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:02.052 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:02.052 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:02.052 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:02.052 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:02.052 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.052 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.053 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.053 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.053 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.053 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.053 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.053 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.053 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.053 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.054 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.054 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.054 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.054 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.054 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.054 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.054 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.054 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.054 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.055 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:02.055 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:02.055 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.055 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.055 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.055 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.055 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.055 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.056 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.056 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.056 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.056 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.056 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.056 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.056 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:02.056 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:02.057 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.057 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.057 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.057 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:02.057 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.057 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.057 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.057 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.058 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.058 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.058 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.058 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.058 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.058 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.058 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.058 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.058 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.059 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.059 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.059 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:02.059 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:02.059 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.059 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.059 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.059 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.060 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.060 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.060 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.060 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.060 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.060 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.060 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.060 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.061 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.061 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.061 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:02.061 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "orchestrator", 2024-09-19T09:05:02.061 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:02.061 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:02.061 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:02.061 INFO:teuthology.orchestra.run.smithi019.stdout: "fail_fs": { 2024-09-19T09:05:02.061 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "fail_fs", 2024-09-19T09:05:02.062 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.062 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.062 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.062 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.062 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.062 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.062 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.062 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T09:05:02.063 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.063 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.063 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.063 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.063 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:02.063 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:02.063 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.063 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.063 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.064 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.064 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.064 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.064 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.064 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.064 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.064 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.064 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.065 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.065 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.065 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.065 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.065 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.065 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.065 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.065 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.066 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:02.066 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:02.066 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.066 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.066 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.066 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.066 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.066 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.066 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.067 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.067 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.067 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.067 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.067 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.067 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:02.067 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:02.067 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.068 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.068 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.068 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:02.068 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.068 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.068 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.068 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.068 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.068 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.069 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.069 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.069 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.069 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.069 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.069 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.069 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.069 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.070 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.070 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:02.070 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:02.070 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.070 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.070 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.070 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.070 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.070 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.071 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.071 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.071 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.071 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.071 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.071 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.071 INFO:teuthology.orchestra.run.smithi019.stdout: "orchestrator": { 2024-09-19T09:05:02.071 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "orchestrator", 2024-09-19T09:05:02.072 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.072 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.072 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.072 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.072 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.072 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.072 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.072 INFO:teuthology.orchestra.run.smithi019.stdout: "cephadm", 2024-09-19T09:05:02.072 INFO:teuthology.orchestra.run.smithi019.stdout: "rook", 2024-09-19T09:05:02.073 INFO:teuthology.orchestra.run.smithi019.stdout: "test_orchestrator" 2024-09-19T09:05:02.073 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.073 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Orchestrator backend", 2024-09-19T09:05:02.073 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.073 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.073 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.073 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.073 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.074 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.074 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:02.074 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "osd_perf_query", 2024-09-19T09:05:02.074 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:02.074 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:02.074 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:02.074 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:02.074 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:02.074 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.075 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.075 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.075 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.075 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.075 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.075 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.075 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.075 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.076 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.076 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.076 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.076 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.076 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.076 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.076 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.076 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.076 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.077 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.077 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:02.077 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:02.077 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.077 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.077 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.077 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.077 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.078 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.078 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.078 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.078 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.078 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.078 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.078 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.078 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:02.079 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:02.079 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.079 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.079 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.079 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:02.079 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.079 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.079 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.079 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.080 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.080 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.080 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.080 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.080 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.080 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.080 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.080 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.080 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.081 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.081 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.081 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:02.081 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:02.081 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.081 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.081 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.081 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.082 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.082 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.082 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.082 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.082 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.082 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.082 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.082 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.082 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.083 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.083 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:02.083 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "osd_support", 2024-09-19T09:05:02.083 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:02.083 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:02.083 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:02.083 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:02.083 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:02.083 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.084 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.084 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.084 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.084 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.084 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.084 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.084 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.084 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.085 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.085 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.085 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.085 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.085 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.085 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.085 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.085 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.086 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.086 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.086 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:02.086 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:02.086 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.086 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.086 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.086 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.086 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.087 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.087 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.087 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.087 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.087 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.087 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.087 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.087 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:02.087 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:02.088 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.088 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.088 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.088 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:02.088 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.088 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.088 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.088 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.089 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.089 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.089 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.089 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.089 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.089 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.089 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.089 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.090 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.090 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.090 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.090 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:02.090 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:02.090 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.090 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.090 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.091 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.091 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.091 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.091 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.091 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.091 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.091 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.091 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.092 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.092 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.092 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.092 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:02.092 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "pg_autoscaler", 2024-09-19T09:05:02.092 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:02.092 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:02.092 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:02.093 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:02.093 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:02.093 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.093 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.093 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.093 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.093 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.093 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.094 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.094 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.094 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.094 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.094 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.094 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.094 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.094 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.094 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.095 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.095 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.095 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.095 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.095 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:02.095 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:02.095 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.096 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.096 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.096 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.096 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.096 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.096 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.096 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.096 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.097 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.097 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.097 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.097 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:02.097 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:02.097 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.097 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.097 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.098 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:02.098 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.098 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.098 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.098 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.098 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.098 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.098 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.099 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.099 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.099 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.099 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.099 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.099 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.099 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.099 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.100 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:02.100 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:02.100 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.100 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.100 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.100 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.100 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.100 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.101 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.101 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.101 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.101 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.101 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.101 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.101 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-19T09:05:02.101 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-19T09:05:02.102 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:02.102 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.102 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.102 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-19T09:05:02.102 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.102 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.102 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.102 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.102 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.103 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.103 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.103 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.103 INFO:teuthology.orchestra.run.smithi019.stdout: "threshold": { 2024-09-19T09:05:02.103 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "threshold", 2024-09-19T09:05:02.103 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-19T09:05:02.103 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.103 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.104 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "3.0", 2024-09-19T09:05:02.104 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1.0", 2024-09-19T09:05:02.104 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.104 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.104 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "scaling threshold", 2024-09-19T09:05:02.104 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T09:05:02.104 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.104 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.104 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.105 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.105 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.105 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:02.105 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "progress", 2024-09-19T09:05:02.105 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:02.105 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:02.105 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:02.105 INFO:teuthology.orchestra.run.smithi019.stdout: "allow_pg_recovery_event": { 2024-09-19T09:05:02.106 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "allow_pg_recovery_event", 2024-09-19T09:05:02.106 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.106 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.106 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.106 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.106 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.106 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.106 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.106 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T09:05:02.107 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.107 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.107 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.107 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.107 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": { 2024-09-19T09:05:02.107 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "enabled", 2024-09-19T09:05:02.107 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.107 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.108 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.108 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:02.108 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.108 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.108 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.108 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.108 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.108 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.109 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.109 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.109 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:02.109 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:02.109 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.109 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.109 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.109 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.109 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.110 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.110 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.110 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.110 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.110 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.110 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.110 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.110 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.110 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.111 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.111 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.111 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.111 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.111 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.111 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:02.111 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:02.111 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.112 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.112 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.112 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.112 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.112 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.112 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.112 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.112 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.112 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.113 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.113 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.113 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:02.113 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:02.113 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.113 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.113 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.113 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:02.114 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.114 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.114 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.114 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.114 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.114 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.114 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.114 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.114 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.115 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.115 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.115 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.115 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.115 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.115 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.115 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:02.115 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:02.115 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.116 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.116 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.116 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.116 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.116 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.116 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.116 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.116 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.117 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.117 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.117 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.117 INFO:teuthology.orchestra.run.smithi019.stdout: "max_completed_events": { 2024-09-19T09:05:02.117 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_completed_events", 2024-09-19T09:05:02.117 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:02.117 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.117 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.118 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "50", 2024-09-19T09:05:02.118 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.118 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.118 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.118 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "number of past completed events to remember", 2024-09-19T09:05:02.118 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.118 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.118 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.118 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.119 INFO:teuthology.orchestra.run.smithi019.stdout: "sleep_interval": { 2024-09-19T09:05:02.119 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "sleep_interval", 2024-09-19T09:05:02.119 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:02.119 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.119 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.119 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-19T09:05:02.119 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.119 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.120 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.120 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "how long the module is going to sleep", 2024-09-19T09:05:02.120 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.120 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.120 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.120 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.120 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.120 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.121 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:02.121 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "prometheus", 2024-09-19T09:05:02.121 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:02.121 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:02.121 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:02.121 INFO:teuthology.orchestra.run.smithi019.stdout: "cache": { 2024-09-19T09:05:02.121 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "cache", 2024-09-19T09:05:02.121 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.121 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.122 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.122 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:02.122 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.122 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.122 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.122 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.122 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.122 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.123 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.123 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.123 INFO:teuthology.orchestra.run.smithi019.stdout: "exclude_perf_counters": { 2024-09-19T09:05:02.123 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "exclude_perf_counters", 2024-09-19T09:05:02.123 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.123 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.123 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.123 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:02.124 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.124 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.124 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.124 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T09:05:02.124 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T09:05:02.124 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.124 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.124 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.125 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:02.125 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:02.125 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.125 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.125 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.125 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.125 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.125 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.126 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.126 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.126 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.126 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.126 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.126 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.126 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.126 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.127 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.127 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.127 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.127 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.127 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.127 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:02.127 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:02.127 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.127 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.128 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.128 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.128 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.128 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.128 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.128 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.128 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.128 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.129 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.129 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.129 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:02.129 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:02.129 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.129 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.129 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.129 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:02.130 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.130 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.130 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.130 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.130 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.130 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.130 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.130 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.130 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.131 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.131 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.131 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.131 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.131 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.131 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.131 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:02.131 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:02.132 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.132 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.132 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.132 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.132 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.132 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.132 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.132 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.132 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.133 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.133 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.133 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.133 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_stats_pools": { 2024-09-19T09:05:02.133 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rbd_stats_pools", 2024-09-19T09:05:02.133 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.133 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.133 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.134 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.134 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.134 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.134 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.134 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.134 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.134 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.134 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.134 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.135 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T09:05:02.135 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T09:05:02.135 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:02.135 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.135 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.135 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "300", 2024-09-19T09:05:02.135 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.135 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.136 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.136 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.136 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.136 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.136 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.136 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.136 INFO:teuthology.orchestra.run.smithi019.stdout: "scrape_interval": { 2024-09-19T09:05:02.136 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "scrape_interval", 2024-09-19T09:05:02.136 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-19T09:05:02.137 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.137 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.137 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "15.0", 2024-09-19T09:05:02.137 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.137 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.137 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.137 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.137 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.138 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.138 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.138 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.138 INFO:teuthology.orchestra.run.smithi019.stdout: "server_addr": { 2024-09-19T09:05:02.138 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_addr", 2024-09-19T09:05:02.138 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.138 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.138 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.138 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "::", 2024-09-19T09:05:02.139 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.139 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.139 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.139 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T09:05:02.139 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.139 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.139 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.139 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.139 INFO:teuthology.orchestra.run.smithi019.stdout: "server_port": { 2024-09-19T09:05:02.140 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_port", 2024-09-19T09:05:02.140 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:02.140 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.140 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.140 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "9283", 2024-09-19T09:05:02.140 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.140 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.140 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.141 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T09:05:02.141 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.141 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.141 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.141 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.141 INFO:teuthology.orchestra.run.smithi019.stdout: "stale_cache_strategy": { 2024-09-19T09:05:02.141 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "stale_cache_strategy", 2024-09-19T09:05:02.141 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.142 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.142 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.142 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "log", 2024-09-19T09:05:02.142 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.142 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.142 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.142 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.142 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.142 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.143 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.143 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.143 INFO:teuthology.orchestra.run.smithi019.stdout: "standby_behaviour": { 2024-09-19T09:05:02.143 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "standby_behaviour", 2024-09-19T09:05:02.143 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.143 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.143 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.143 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "default", 2024-09-19T09:05:02.144 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.144 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.144 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.144 INFO:teuthology.orchestra.run.smithi019.stdout: "default", 2024-09-19T09:05:02.144 INFO:teuthology.orchestra.run.smithi019.stdout: "error" 2024-09-19T09:05:02.144 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.144 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.144 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.145 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.145 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.145 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.145 INFO:teuthology.orchestra.run.smithi019.stdout: "standby_error_status_code": { 2024-09-19T09:05:02.145 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "standby_error_status_code", 2024-09-19T09:05:02.145 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:02.145 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.145 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.145 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "500", 2024-09-19T09:05:02.146 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "400", 2024-09-19T09:05:02.146 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "599", 2024-09-19T09:05:02.146 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.146 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.146 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.146 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.146 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.146 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.147 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.147 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.147 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:02.147 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rbd_support", 2024-09-19T09:05:02.147 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:02.147 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:02.147 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:02.147 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:02.147 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:02.148 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.148 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.148 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.148 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.148 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.148 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.148 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.148 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.149 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.149 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.149 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.149 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.149 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.149 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.149 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.149 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.149 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.150 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.150 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.150 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:02.150 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:02.150 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.150 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.150 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.150 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.151 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.151 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.151 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.151 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.151 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.151 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.151 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.151 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.152 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:02.152 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:02.152 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.152 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.152 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.152 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:02.152 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.152 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.152 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.153 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.153 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.153 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.153 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.153 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.153 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.153 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.153 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.154 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.154 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.154 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.154 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.154 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:02.154 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:02.154 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.154 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.154 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.155 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.155 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.155 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.155 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.155 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.155 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.155 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.155 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.156 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.156 INFO:teuthology.orchestra.run.smithi019.stdout: "max_concurrent_snap_create": { 2024-09-19T09:05:02.156 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_concurrent_snap_create", 2024-09-19T09:05:02.156 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:02.156 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.156 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.156 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10", 2024-09-19T09:05:02.156 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.156 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.157 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.157 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.157 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.157 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.157 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.157 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.157 INFO:teuthology.orchestra.run.smithi019.stdout: "mirror_snapshot_schedule": { 2024-09-19T09:05:02.157 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T09:05:02.158 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.158 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.158 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.158 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.158 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.158 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.158 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.158 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.158 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.159 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.159 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.159 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.159 INFO:teuthology.orchestra.run.smithi019.stdout: "trash_purge_schedule": { 2024-09-19T09:05:02.159 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "trash_purge_schedule", 2024-09-19T09:05:02.159 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.159 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.159 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.160 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.160 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.160 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.160 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.160 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.160 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.160 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.160 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.160 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.161 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.161 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.161 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:02.161 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "restful", 2024-09-19T09:05:02.161 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:02.161 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:02.161 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:02.161 INFO:teuthology.orchestra.run.smithi019.stdout: "enable_auth": { 2024-09-19T09:05:02.162 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "enable_auth", 2024-09-19T09:05:02.162 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.162 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.162 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.162 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:02.162 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.162 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.162 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.162 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.163 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.163 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.163 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.163 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.163 INFO:teuthology.orchestra.run.smithi019.stdout: "key_file": { 2024-09-19T09:05:02.163 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "key_file", 2024-09-19T09:05:02.163 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.163 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.164 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.164 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.164 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.164 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.164 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.164 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.164 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.164 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.165 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.165 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.165 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:02.165 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:02.165 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.165 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.165 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.165 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.165 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.166 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.166 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.166 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.166 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.166 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.166 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.166 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.166 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.166 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.167 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.167 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.167 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.167 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.167 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.167 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:02.167 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:02.167 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.168 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.168 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.168 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.168 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.168 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.168 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.168 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.168 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.168 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.169 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.169 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.169 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:02.169 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:02.169 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.169 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.169 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.169 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:02.170 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.170 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.170 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.170 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.170 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.170 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.170 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.170 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.170 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.171 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.171 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.171 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.171 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.171 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.171 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.171 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:02.171 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:02.172 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.172 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.172 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.172 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.172 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.172 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.172 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.172 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.173 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.173 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.173 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.173 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.173 INFO:teuthology.orchestra.run.smithi019.stdout: "server_addr": { 2024-09-19T09:05:02.173 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_addr", 2024-09-19T09:05:02.173 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.173 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.174 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.174 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.174 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.174 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.174 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.174 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.174 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.174 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.174 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.175 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.175 INFO:teuthology.orchestra.run.smithi019.stdout: "server_port": { 2024-09-19T09:05:02.175 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "server_port", 2024-09-19T09:05:02.175 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.175 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.175 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.175 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.175 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.175 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.176 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.176 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.176 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.176 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.176 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.176 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.176 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.176 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.177 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:02.177 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rgw", 2024-09-19T09:05:02.177 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:02.177 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:02.177 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:02.177 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:02.177 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:02.177 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.178 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.178 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.178 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.178 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.178 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.178 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.178 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.178 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.179 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.179 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.179 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.179 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.179 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.179 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.179 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.179 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.179 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.180 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.180 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:02.180 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:02.180 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.180 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.180 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.180 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.180 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.181 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.181 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.181 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.181 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.181 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.181 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.181 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.181 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:02.182 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:02.182 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.182 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.182 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.182 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:02.182 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.182 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.182 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.183 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.183 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.183 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.183 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.183 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.183 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.183 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.183 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.184 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.184 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.184 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.184 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.184 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:02.184 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:02.184 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.184 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.185 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.185 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.185 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.185 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.185 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.185 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.185 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.185 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.186 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.186 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.186 INFO:teuthology.orchestra.run.smithi019.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T09:05:02.186 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T09:05:02.186 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:02.186 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.186 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.186 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "5", 2024-09-19T09:05:02.186 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.187 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.187 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.187 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T09:05:02.187 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.187 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.187 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.187 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.187 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.188 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.188 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:02.188 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rook", 2024-09-19T09:05:02.188 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:02.188 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:02.188 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:02.188 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:02.188 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:02.189 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.189 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.189 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.189 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.189 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.189 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.189 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.189 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.190 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.190 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.190 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.190 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.190 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.190 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.190 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.190 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.191 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.191 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.191 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.191 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:02.191 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:02.191 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.191 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.191 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.191 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.192 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.192 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.192 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.192 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.192 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.192 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.192 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.192 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.193 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:02.193 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:02.193 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.193 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.193 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.193 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:02.193 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.193 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.194 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.194 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.194 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.194 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.194 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.194 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.194 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.194 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.194 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.195 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.195 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.195 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.195 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.195 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:02.195 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:02.195 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.195 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.196 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.196 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.196 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.196 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.196 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.196 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.196 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.196 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.197 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.197 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.197 INFO:teuthology.orchestra.run.smithi019.stdout: "storage_class": { 2024-09-19T09:05:02.197 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "storage_class", 2024-09-19T09:05:02.197 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.197 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.197 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.197 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "local", 2024-09-19T09:05:02.200 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.200 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.200 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.200 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T09:05:02.200 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.200 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.201 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.201 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.201 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.201 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.201 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:02.201 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "selftest", 2024-09-19T09:05:02.201 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:02.201 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:02.201 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:02.202 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:02.202 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:02.202 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.202 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.202 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.202 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.202 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.202 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.203 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.203 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.203 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.203 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.203 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.203 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.203 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.203 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.204 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.204 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.204 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.204 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.204 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.204 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:02.204 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:02.204 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.205 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.205 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.205 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.205 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.205 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.205 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.205 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.205 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.205 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.206 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.206 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.206 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:02.206 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:02.206 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.206 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.206 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.207 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:02.207 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.207 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.207 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.207 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.207 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.207 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.207 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.207 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.208 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.208 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.208 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.208 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.208 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.208 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.208 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.208 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:02.209 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:02.209 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.209 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.209 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.209 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.209 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.209 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.209 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.210 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.210 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.210 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.210 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.210 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.210 INFO:teuthology.orchestra.run.smithi019.stdout: "roption1": { 2024-09-19T09:05:02.210 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "roption1", 2024-09-19T09:05:02.210 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.210 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.211 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.211 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.211 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.211 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.211 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.211 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.211 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.211 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.212 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.212 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.212 INFO:teuthology.orchestra.run.smithi019.stdout: "roption2": { 2024-09-19T09:05:02.212 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "roption2", 2024-09-19T09:05:02.212 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.212 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.212 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.212 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "xyz", 2024-09-19T09:05:02.212 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.213 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.213 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.213 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.213 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.213 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.213 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.213 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.213 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption1": { 2024-09-19T09:05:02.214 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption1", 2024-09-19T09:05:02.214 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.214 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.214 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.214 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.214 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.214 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.214 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.214 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.215 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.215 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.215 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.215 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.215 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption2": { 2024-09-19T09:05:02.215 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption2", 2024-09-19T09:05:02.215 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:02.215 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.216 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.216 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.216 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.216 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.216 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.216 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.216 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.216 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.216 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.217 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.217 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption3": { 2024-09-19T09:05:02.217 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption3", 2024-09-19T09:05:02.217 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "float", 2024-09-19T09:05:02.217 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.217 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.217 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.217 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.218 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.218 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.218 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.218 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.218 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.218 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.218 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.218 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption4": { 2024-09-19T09:05:02.218 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption4", 2024-09-19T09:05:02.219 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.219 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.219 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.219 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.219 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.219 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.219 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.219 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.220 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.220 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.220 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.220 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.220 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption5": { 2024-09-19T09:05:02.220 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption5", 2024-09-19T09:05:02.220 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.220 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.220 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.221 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.221 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.221 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.221 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.221 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.221 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.221 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.221 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.222 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.222 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption6": { 2024-09-19T09:05:02.222 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption6", 2024-09-19T09:05:02.222 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.222 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.222 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.222 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:02.222 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.223 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.223 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.223 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.223 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.223 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.223 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.223 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.223 INFO:teuthology.orchestra.run.smithi019.stdout: "rwoption7": { 2024-09-19T09:05:02.223 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rwoption7", 2024-09-19T09:05:02.224 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:02.224 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.224 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.224 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.224 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "1", 2024-09-19T09:05:02.224 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "42", 2024-09-19T09:05:02.224 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.224 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.225 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.225 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.225 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.225 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.225 INFO:teuthology.orchestra.run.smithi019.stdout: "testkey": { 2024-09-19T09:05:02.225 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "testkey", 2024-09-19T09:05:02.225 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.225 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.225 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.226 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.226 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.226 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.226 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.226 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.226 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.226 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.226 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.227 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.227 INFO:teuthology.orchestra.run.smithi019.stdout: "testlkey": { 2024-09-19T09:05:02.227 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "testlkey", 2024-09-19T09:05:02.227 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.227 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.227 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.227 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.227 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.227 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.228 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.228 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.228 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.228 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.228 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.228 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.228 INFO:teuthology.orchestra.run.smithi019.stdout: "testnewline": { 2024-09-19T09:05:02.228 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "testnewline", 2024-09-19T09:05:02.229 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.229 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.229 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.229 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.229 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.229 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.229 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.229 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.230 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.230 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.230 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.230 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.230 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.230 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.230 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:02.230 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "snap_schedule", 2024-09-19T09:05:02.230 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:02.231 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:02.231 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:02.231 INFO:teuthology.orchestra.run.smithi019.stdout: "allow_m_granularity": { 2024-09-19T09:05:02.231 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "allow_m_granularity", 2024-09-19T09:05:02.231 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.231 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.231 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.231 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.232 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.232 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.232 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.232 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T09:05:02.232 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.232 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.232 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.232 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.233 INFO:teuthology.orchestra.run.smithi019.stdout: "dump_on_update": { 2024-09-19T09:05:02.233 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "dump_on_update", 2024-09-19T09:05:02.233 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.233 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.233 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.233 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.233 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.233 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.233 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.234 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "dump database to debug log on update", 2024-09-19T09:05:02.234 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.234 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.234 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.234 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.234 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:02.234 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:02.234 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.235 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.235 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.235 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.235 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.235 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.235 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.235 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.235 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.236 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.236 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.236 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.236 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.236 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.236 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.236 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.236 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.236 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.237 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.237 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:02.237 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:02.237 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.237 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.237 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.237 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.237 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.238 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.238 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.238 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.238 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.238 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.238 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.238 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.238 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:02.239 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:02.239 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.239 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.239 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.239 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:02.239 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.239 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.239 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.239 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.240 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.240 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.240 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.240 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.240 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.240 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.240 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.240 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.241 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.241 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.241 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.241 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:02.241 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:02.241 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.241 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.241 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.241 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.242 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.242 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.242 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.242 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.242 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.242 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.242 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.242 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.243 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.243 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.243 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:02.243 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "stats", 2024-09-19T09:05:02.243 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:02.243 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:02.243 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:02.243 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:02.244 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:02.244 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.244 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.244 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.244 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.244 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.244 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.244 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.244 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.245 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.245 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.245 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.245 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.245 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.245 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.245 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.245 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.246 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.246 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.246 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.246 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:02.246 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:02.246 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.246 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.246 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.247 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.247 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.247 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.247 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.247 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.247 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.247 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.247 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.248 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.248 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:02.248 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:02.248 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.248 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.248 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.248 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:02.248 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.248 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.249 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.249 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.249 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.249 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.249 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.249 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.249 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.249 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.250 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.250 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.250 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.250 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.250 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.250 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:02.250 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:02.250 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.251 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.251 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.251 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.251 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.251 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.251 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.251 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.251 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.251 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.252 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.252 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.252 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.252 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.252 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:02.252 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "status", 2024-09-19T09:05:02.252 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:02.252 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:02.253 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:02.253 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:02.253 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:02.253 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.253 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.253 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.253 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.253 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.254 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.254 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.254 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.254 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.254 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.254 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.254 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.254 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.254 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.255 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.255 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.255 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.255 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.255 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.255 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:02.255 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:02.255 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.256 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.256 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.256 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.256 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.256 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.256 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.256 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.256 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.256 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.257 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.257 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.257 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:02.257 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:02.257 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.257 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.257 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.257 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:02.258 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.258 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.258 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.258 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.258 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.258 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.258 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.258 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.259 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.259 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.259 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.259 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.259 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.259 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.259 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.259 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:02.259 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:02.260 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.260 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.260 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.260 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.260 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.260 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.260 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.260 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.261 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.261 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.261 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.261 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.261 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.261 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.261 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:02.261 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "telegraf", 2024-09-19T09:05:02.262 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:02.262 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:02.262 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:02.262 INFO:teuthology.orchestra.run.smithi019.stdout: "address": { 2024-09-19T09:05:02.262 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "address", 2024-09-19T09:05:02.262 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.262 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.262 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.263 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T09:05:02.263 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.263 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.263 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.263 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.263 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.263 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.263 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.263 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.264 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-19T09:05:02.264 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-19T09:05:02.264 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:02.264 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.264 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.264 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "15", 2024-09-19T09:05:02.264 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.264 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.265 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.265 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.265 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.265 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.265 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.265 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.265 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:02.265 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:02.266 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.266 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.266 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.266 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.266 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.266 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.266 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.266 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.266 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.267 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.267 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.267 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.267 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.267 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.267 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.267 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.267 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.268 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.268 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.268 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:02.268 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:02.268 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.268 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.268 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.268 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.269 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.269 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.269 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.269 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.269 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.269 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.269 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.269 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.269 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:02.270 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:02.270 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.270 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.270 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.270 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:02.270 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.270 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.270 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.271 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.271 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.271 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.271 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.271 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.271 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.271 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.271 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.271 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.272 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.272 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.272 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.272 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:02.272 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:02.272 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.272 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.272 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.273 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.273 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.273 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.273 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.273 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.273 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.273 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.273 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.274 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.274 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.274 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.274 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:02.274 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "telemetry", 2024-09-19T09:05:02.274 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:02.274 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:02.274 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:02.274 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_basic": { 2024-09-19T09:05:02.275 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_basic", 2024-09-19T09:05:02.275 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.275 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.275 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.275 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:02.275 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.275 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.275 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.276 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T09:05:02.276 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.276 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.276 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.276 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.276 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_crash": { 2024-09-19T09:05:02.276 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_crash", 2024-09-19T09:05:02.276 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.277 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.277 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.277 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:02.277 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.277 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.277 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.277 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T09:05:02.277 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.277 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.278 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.278 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.278 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_device": { 2024-09-19T09:05:02.278 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_device", 2024-09-19T09:05:02.278 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.278 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.278 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.278 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:02.279 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.279 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.279 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.279 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T09:05:02.279 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.279 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.279 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.279 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.279 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_ident": { 2024-09-19T09:05:02.280 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_ident", 2024-09-19T09:05:02.280 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.280 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.280 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.280 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.280 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.280 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.280 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.281 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T09:05:02.281 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.281 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.281 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.281 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.281 INFO:teuthology.orchestra.run.smithi019.stdout: "channel_perf": { 2024-09-19T09:05:02.281 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "channel_perf", 2024-09-19T09:05:02.281 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.282 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.282 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.282 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.282 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.282 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.282 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.282 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T09:05:02.282 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.283 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.283 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.283 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.283 INFO:teuthology.orchestra.run.smithi019.stdout: "contact": { 2024-09-19T09:05:02.283 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "contact", 2024-09-19T09:05:02.283 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.283 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.283 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.283 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.284 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.284 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.284 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.284 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.284 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.284 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.284 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.284 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.285 INFO:teuthology.orchestra.run.smithi019.stdout: "description": { 2024-09-19T09:05:02.285 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "description", 2024-09-19T09:05:02.285 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.285 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.285 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.285 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.285 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.285 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.285 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.286 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.286 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.286 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.286 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.286 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.286 INFO:teuthology.orchestra.run.smithi019.stdout: "device_url": { 2024-09-19T09:05:02.286 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "device_url", 2024-09-19T09:05:02.286 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.287 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.287 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.287 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T09:05:02.287 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.287 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.287 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.287 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.287 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.288 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.288 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.288 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.288 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": { 2024-09-19T09:05:02.288 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "enabled", 2024-09-19T09:05:02.288 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.288 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.288 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.288 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.289 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.289 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.289 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.289 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.289 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.289 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.289 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.289 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.290 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-19T09:05:02.290 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-19T09:05:02.290 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:02.290 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.290 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.290 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "24", 2024-09-19T09:05:02.290 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "8", 2024-09-19T09:05:02.290 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.290 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.291 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.291 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.291 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.291 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.291 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.291 INFO:teuthology.orchestra.run.smithi019.stdout: "last_opt_revision": { 2024-09-19T09:05:02.291 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "last_opt_revision", 2024-09-19T09:05:02.291 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:02.292 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.292 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.292 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "1", 2024-09-19T09:05:02.292 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.292 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.292 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.292 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.292 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.293 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.293 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.293 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.293 INFO:teuthology.orchestra.run.smithi019.stdout: "leaderboard": { 2024-09-19T09:05:02.293 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "leaderboard", 2024-09-19T09:05:02.293 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.293 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.293 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.294 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.294 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.294 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.294 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.294 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.294 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.294 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.294 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.294 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.295 INFO:teuthology.orchestra.run.smithi019.stdout: "leaderboard_description": { 2024-09-19T09:05:02.295 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "leaderboard_description", 2024-09-19T09:05:02.295 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.295 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.295 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.295 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.295 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.295 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.296 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.296 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.296 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.296 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.296 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.296 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.296 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:02.296 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:02.297 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.297 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.297 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.297 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.297 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.297 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.297 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.297 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.297 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.298 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.298 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.298 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.298 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.298 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.298 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.298 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.298 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.299 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.299 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.299 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:02.299 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:02.299 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.299 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.299 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.299 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.299 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.300 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.300 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.300 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.300 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.300 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.300 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.300 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.300 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:02.301 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:02.301 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.301 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.301 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.301 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:02.301 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.301 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.302 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.302 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.302 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.302 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.302 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.302 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.302 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.302 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.303 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.303 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.303 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.303 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.303 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.303 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:02.303 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:02.303 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.303 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.304 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.304 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.304 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.304 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.304 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.304 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.304 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.304 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.305 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.305 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.305 INFO:teuthology.orchestra.run.smithi019.stdout: "organization": { 2024-09-19T09:05:02.305 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "organization", 2024-09-19T09:05:02.305 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.305 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.305 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.305 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.306 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.306 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.306 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.306 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.306 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.306 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.306 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.306 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.307 INFO:teuthology.orchestra.run.smithi019.stdout: "proxy": { 2024-09-19T09:05:02.307 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "proxy", 2024-09-19T09:05:02.307 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.307 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.307 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.307 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.307 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.307 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.308 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.308 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.308 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.308 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.308 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.308 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.308 INFO:teuthology.orchestra.run.smithi019.stdout: "url": { 2024-09-19T09:05:02.308 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "url", 2024-09-19T09:05:02.309 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.309 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.309 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.309 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T09:05:02.309 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.309 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.309 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.309 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.310 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.310 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.310 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.310 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.310 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.310 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.310 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:02.310 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "test_orchestrator", 2024-09-19T09:05:02.311 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:02.311 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:02.311 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:02.311 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:02.311 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:02.311 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.311 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.311 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.312 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.312 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.312 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.312 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.312 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.312 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.312 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.312 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.313 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.313 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.313 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.313 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.313 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.313 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.313 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.313 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.314 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:02.314 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:02.314 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.314 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.314 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.314 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.314 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.314 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.314 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.315 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.315 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.315 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.315 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.315 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.315 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:02.315 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:02.316 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.316 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.316 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.316 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:02.316 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.316 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.316 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.316 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.317 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.317 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.317 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.317 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.317 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.317 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.317 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.317 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.317 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.318 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.318 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.318 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:02.318 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:02.318 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.318 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.318 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.318 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.319 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.319 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.319 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.319 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.319 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.319 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.319 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.319 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.320 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.320 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.320 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:02.320 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "volumes", 2024-09-19T09:05:02.320 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:02.320 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:02.320 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:02.320 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:02.321 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:02.321 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.321 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.321 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.321 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.321 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.321 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.321 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.322 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.322 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.322 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.322 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.322 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.322 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.322 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.322 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.322 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.323 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.323 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.323 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.323 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:02.323 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:02.323 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.323 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.323 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.324 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.324 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.324 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.324 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.324 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.324 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.324 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.324 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.325 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.325 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:02.325 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:02.325 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.325 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.325 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.325 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:02.325 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.325 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.326 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.326 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.326 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.326 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.326 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.326 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.326 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.326 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.327 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.327 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.327 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.327 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.327 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.327 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:02.327 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:02.327 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.327 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.328 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.328 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.328 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.328 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.328 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.328 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.328 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.328 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.329 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.329 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.329 INFO:teuthology.orchestra.run.smithi019.stdout: "max_concurrent_clones": { 2024-09-19T09:05:02.329 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "max_concurrent_clones", 2024-09-19T09:05:02.329 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:02.329 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.329 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.329 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "4", 2024-09-19T09:05:02.330 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.330 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.330 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.330 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T09:05:02.330 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.330 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.330 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.330 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.331 INFO:teuthology.orchestra.run.smithi019.stdout: "periodic_async_work": { 2024-09-19T09:05:02.331 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "periodic_async_work", 2024-09-19T09:05:02.331 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.331 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.331 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.331 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.331 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.331 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.332 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.332 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Periodically check for async work", 2024-09-19T09:05:02.332 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.332 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.332 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.332 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.332 INFO:teuthology.orchestra.run.smithi019.stdout: "snapshot_clone_delay": { 2024-09-19T09:05:02.332 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "snapshot_clone_delay", 2024-09-19T09:05:02.332 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:02.333 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.333 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.333 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "0", 2024-09-19T09:05:02.333 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.333 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.333 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.333 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T09:05:02.333 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.334 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.334 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.334 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.334 INFO:teuthology.orchestra.run.smithi019.stdout: "snapshot_clone_no_wait": { 2024-09-19T09:05:02.334 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T09:05:02.334 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.334 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.334 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.335 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "True", 2024-09-19T09:05:02.335 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.335 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.335 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.335 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T09:05:02.335 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.335 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.335 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.336 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.336 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.336 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.336 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:02.336 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "zabbix", 2024-09-19T09:05:02.336 INFO:teuthology.orchestra.run.smithi019.stdout: "can_run": true, 2024-09-19T09:05:02.336 INFO:teuthology.orchestra.run.smithi019.stdout: "error_string": "", 2024-09-19T09:05:02.336 INFO:teuthology.orchestra.run.smithi019.stdout: "module_options": { 2024-09-19T09:05:02.337 INFO:teuthology.orchestra.run.smithi019.stdout: "discovery_interval": { 2024-09-19T09:05:02.337 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "discovery_interval", 2024-09-19T09:05:02.337 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "uint", 2024-09-19T09:05:02.337 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.337 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.337 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "100", 2024-09-19T09:05:02.337 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.337 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.338 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.338 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.338 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.338 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.338 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.338 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.338 INFO:teuthology.orchestra.run.smithi019.stdout: "identifier": { 2024-09-19T09:05:02.338 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "identifier", 2024-09-19T09:05:02.339 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.339 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.339 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.339 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.339 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.339 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.339 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.339 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.340 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.340 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.340 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.340 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.340 INFO:teuthology.orchestra.run.smithi019.stdout: "interval": { 2024-09-19T09:05:02.340 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "interval", 2024-09-19T09:05:02.340 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "secs", 2024-09-19T09:05:02.340 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.340 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.341 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "60", 2024-09-19T09:05:02.341 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.341 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.341 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.341 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.341 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.341 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.341 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.342 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.342 INFO:teuthology.orchestra.run.smithi019.stdout: "log_level": { 2024-09-19T09:05:02.342 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_level", 2024-09-19T09:05:02.342 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.342 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.342 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.342 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.342 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.343 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.343 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.343 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.343 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.343 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.343 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.343 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.343 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.344 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.344 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.344 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.344 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.344 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.344 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.344 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster": { 2024-09-19T09:05:02.344 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster", 2024-09-19T09:05:02.345 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.345 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.345 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.345 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.345 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.345 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.345 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.345 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.345 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.346 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.346 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.346 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.346 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_cluster_level": { 2024-09-19T09:05:02.346 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_cluster_level", 2024-09-19T09:05:02.346 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.346 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.346 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.347 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "info", 2024-09-19T09:05:02.347 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.347 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.347 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [ 2024-09-19T09:05:02.347 INFO:teuthology.orchestra.run.smithi019.stdout: "", 2024-09-19T09:05:02.347 INFO:teuthology.orchestra.run.smithi019.stdout: "critical", 2024-09-19T09:05:02.347 INFO:teuthology.orchestra.run.smithi019.stdout: "debug", 2024-09-19T09:05:02.347 INFO:teuthology.orchestra.run.smithi019.stdout: "error", 2024-09-19T09:05:02.348 INFO:teuthology.orchestra.run.smithi019.stdout: "info", 2024-09-19T09:05:02.348 INFO:teuthology.orchestra.run.smithi019.stdout: "warning" 2024-09-19T09:05:02.348 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.348 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.348 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.348 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.348 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.348 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.349 INFO:teuthology.orchestra.run.smithi019.stdout: "log_to_file": { 2024-09-19T09:05:02.349 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "log_to_file", 2024-09-19T09:05:02.349 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "bool", 2024-09-19T09:05:02.349 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.349 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 1, 2024-09-19T09:05:02.349 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "False", 2024-09-19T09:05:02.349 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.349 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.349 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.350 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.350 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.350 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.350 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.350 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.350 INFO:teuthology.orchestra.run.smithi019.stdout: "zabbix_host": { 2024-09-19T09:05:02.350 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "zabbix_host", 2024-09-19T09:05:02.350 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.351 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.351 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.351 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "", 2024-09-19T09:05:02.351 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.351 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.351 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.351 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.351 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.352 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.352 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.352 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.352 INFO:teuthology.orchestra.run.smithi019.stdout: "zabbix_port": { 2024-09-19T09:05:02.352 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "zabbix_port", 2024-09-19T09:05:02.352 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "int", 2024-09-19T09:05:02.352 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.352 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.353 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "10051", 2024-09-19T09:05:02.353 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.353 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.353 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.353 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.353 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.353 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.353 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.353 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.354 INFO:teuthology.orchestra.run.smithi019.stdout: "zabbix_sender": { 2024-09-19T09:05:02.354 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "zabbix_sender", 2024-09-19T09:05:02.354 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "str", 2024-09-19T09:05:02.354 INFO:teuthology.orchestra.run.smithi019.stdout: "level": "advanced", 2024-09-19T09:05:02.354 INFO:teuthology.orchestra.run.smithi019.stdout: "flags": 0, 2024-09-19T09:05:02.354 INFO:teuthology.orchestra.run.smithi019.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T09:05:02.354 INFO:teuthology.orchestra.run.smithi019.stdout: "min": "", 2024-09-19T09:05:02.354 INFO:teuthology.orchestra.run.smithi019.stdout: "max": "", 2024-09-19T09:05:02.355 INFO:teuthology.orchestra.run.smithi019.stdout: "enum_allowed": [], 2024-09-19T09:05:02.355 INFO:teuthology.orchestra.run.smithi019.stdout: "desc": "", 2024-09-19T09:05:02.355 INFO:teuthology.orchestra.run.smithi019.stdout: "long_desc": "", 2024-09-19T09:05:02.355 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-19T09:05:02.355 INFO:teuthology.orchestra.run.smithi019.stdout: "see_also": [] 2024-09-19T09:05:02.355 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.355 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.355 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.355 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.356 INFO:teuthology.orchestra.run.smithi019.stdout: "services": { 2024-09-19T09:05:02.356 INFO:teuthology.orchestra.run.smithi019.stdout: "dashboard": "https://172.21.15.19:8443/" 2024-09-19T09:05:02.356 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.356 INFO:teuthology.orchestra.run.smithi019.stdout: "always_on_modules": { 2024-09-19T09:05:02.356 INFO:teuthology.orchestra.run.smithi019.stdout: "octopus": [ 2024-09-19T09:05:02.356 INFO:teuthology.orchestra.run.smithi019.stdout: "balancer", 2024-09-19T09:05:02.356 INFO:teuthology.orchestra.run.smithi019.stdout: "crash", 2024-09-19T09:05:02.357 INFO:teuthology.orchestra.run.smithi019.stdout: "devicehealth", 2024-09-19T09:05:02.357 INFO:teuthology.orchestra.run.smithi019.stdout: "orchestrator", 2024-09-19T09:05:02.357 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscaler", 2024-09-19T09:05:02.357 INFO:teuthology.orchestra.run.smithi019.stdout: "progress", 2024-09-19T09:05:02.357 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_support", 2024-09-19T09:05:02.357 INFO:teuthology.orchestra.run.smithi019.stdout: "status", 2024-09-19T09:05:02.357 INFO:teuthology.orchestra.run.smithi019.stdout: "telemetry", 2024-09-19T09:05:02.357 INFO:teuthology.orchestra.run.smithi019.stdout: "volumes" 2024-09-19T09:05:02.357 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.358 INFO:teuthology.orchestra.run.smithi019.stdout: "pacific": [ 2024-09-19T09:05:02.358 INFO:teuthology.orchestra.run.smithi019.stdout: "balancer", 2024-09-19T09:05:02.358 INFO:teuthology.orchestra.run.smithi019.stdout: "crash", 2024-09-19T09:05:02.358 INFO:teuthology.orchestra.run.smithi019.stdout: "devicehealth", 2024-09-19T09:05:02.358 INFO:teuthology.orchestra.run.smithi019.stdout: "orchestrator", 2024-09-19T09:05:02.358 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscaler", 2024-09-19T09:05:02.358 INFO:teuthology.orchestra.run.smithi019.stdout: "progress", 2024-09-19T09:05:02.358 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_support", 2024-09-19T09:05:02.359 INFO:teuthology.orchestra.run.smithi019.stdout: "status", 2024-09-19T09:05:02.359 INFO:teuthology.orchestra.run.smithi019.stdout: "telemetry", 2024-09-19T09:05:02.359 INFO:teuthology.orchestra.run.smithi019.stdout: "volumes" 2024-09-19T09:05:02.359 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.359 INFO:teuthology.orchestra.run.smithi019.stdout: "quincy": [ 2024-09-19T09:05:02.359 INFO:teuthology.orchestra.run.smithi019.stdout: "balancer", 2024-09-19T09:05:02.359 INFO:teuthology.orchestra.run.smithi019.stdout: "crash", 2024-09-19T09:05:02.359 INFO:teuthology.orchestra.run.smithi019.stdout: "devicehealth", 2024-09-19T09:05:02.359 INFO:teuthology.orchestra.run.smithi019.stdout: "orchestrator", 2024-09-19T09:05:02.360 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscaler", 2024-09-19T09:05:02.360 INFO:teuthology.orchestra.run.smithi019.stdout: "progress", 2024-09-19T09:05:02.360 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_support", 2024-09-19T09:05:02.360 INFO:teuthology.orchestra.run.smithi019.stdout: "status", 2024-09-19T09:05:02.360 INFO:teuthology.orchestra.run.smithi019.stdout: "telemetry", 2024-09-19T09:05:02.360 INFO:teuthology.orchestra.run.smithi019.stdout: "volumes" 2024-09-19T09:05:02.360 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.360 INFO:teuthology.orchestra.run.smithi019.stdout: "reef": [ 2024-09-19T09:05:02.361 INFO:teuthology.orchestra.run.smithi019.stdout: "balancer", 2024-09-19T09:05:02.361 INFO:teuthology.orchestra.run.smithi019.stdout: "crash", 2024-09-19T09:05:02.361 INFO:teuthology.orchestra.run.smithi019.stdout: "devicehealth", 2024-09-19T09:05:02.361 INFO:teuthology.orchestra.run.smithi019.stdout: "orchestrator", 2024-09-19T09:05:02.361 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscaler", 2024-09-19T09:05:02.361 INFO:teuthology.orchestra.run.smithi019.stdout: "progress", 2024-09-19T09:05:02.361 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_support", 2024-09-19T09:05:02.361 INFO:teuthology.orchestra.run.smithi019.stdout: "status", 2024-09-19T09:05:02.362 INFO:teuthology.orchestra.run.smithi019.stdout: "telemetry", 2024-09-19T09:05:02.362 INFO:teuthology.orchestra.run.smithi019.stdout: "volumes" 2024-09-19T09:05:02.362 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-19T09:05:02.362 INFO:teuthology.orchestra.run.smithi019.stdout: "squid": [ 2024-09-19T09:05:02.362 INFO:teuthology.orchestra.run.smithi019.stdout: "balancer", 2024-09-19T09:05:02.362 INFO:teuthology.orchestra.run.smithi019.stdout: "crash", 2024-09-19T09:05:02.362 INFO:teuthology.orchestra.run.smithi019.stdout: "devicehealth", 2024-09-19T09:05:02.362 INFO:teuthology.orchestra.run.smithi019.stdout: "orchestrator", 2024-09-19T09:05:02.362 INFO:teuthology.orchestra.run.smithi019.stdout: "pg_autoscaler", 2024-09-19T09:05:02.363 INFO:teuthology.orchestra.run.smithi019.stdout: "progress", 2024-09-19T09:05:02.363 INFO:teuthology.orchestra.run.smithi019.stdout: "rbd_support", 2024-09-19T09:05:02.363 INFO:teuthology.orchestra.run.smithi019.stdout: "status", 2024-09-19T09:05:02.363 INFO:teuthology.orchestra.run.smithi019.stdout: "telemetry", 2024-09-19T09:05:02.363 INFO:teuthology.orchestra.run.smithi019.stdout: "volumes" 2024-09-19T09:05:02.363 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-19T09:05:02.363 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.363 INFO:teuthology.orchestra.run.smithi019.stdout: "last_failure_osd_epoch": 3, 2024-09-19T09:05:02.363 INFO:teuthology.orchestra.run.smithi019.stdout: "active_clients": [ 2024-09-19T09:05:02.364 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:02.364 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "devicehealth", 2024-09-19T09:05:02.364 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-19T09:05:02.364 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:02.364 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-19T09:05:02.364 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:0", 2024-09-19T09:05:02.364 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 3056300595 2024-09-19T09:05:02.364 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.365 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-19T09:05:02.365 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.365 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:02.365 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "libcephsqlite", 2024-09-19T09:05:02.365 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-19T09:05:02.365 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:02.365 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-19T09:05:02.365 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:0", 2024-09-19T09:05:02.365 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 424182441 2024-09-19T09:05:02.366 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.366 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-19T09:05:02.366 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.366 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:02.366 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "rbd_support", 2024-09-19T09:05:02.366 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-19T09:05:02.366 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:02.366 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-19T09:05:02.367 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:0", 2024-09-19T09:05:02.367 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 621811985 2024-09-19T09:05:02.367 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.367 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-19T09:05:02.367 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:02.367 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:02.367 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "volumes", 2024-09-19T09:05:02.367 INFO:teuthology.orchestra.run.smithi019.stdout: "addrvec": [ 2024-09-19T09:05:02.367 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-19T09:05:02.368 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "v2", 2024-09-19T09:05:02.368 INFO:teuthology.orchestra.run.smithi019.stdout: "addr": "172.21.15.19:0", 2024-09-19T09:05:02.368 INFO:teuthology.orchestra.run.smithi019.stdout: "nonce": 1818352476 2024-09-19T09:05:02.368 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.368 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-19T09:05:02.368 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:02.368 INFO:teuthology.orchestra.run.smithi019.stdout: ] 2024-09-19T09:05:02.368 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T09:05:02.370 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:00 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/2307332408' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:05:02.370 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:00 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/2370951160' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T09:05:02.370 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:01 smithi203 ceph-mon[35450]: pgmap v727: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 9 op/s 2024-09-19T09:05:02.371 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:59 smithi155 ceph-mon[34921]: pgmap v726: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-09-19T09:05:02.371 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:59 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/2477925889' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:05:02.371 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:59 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1983305581' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T09:05:02.371 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:04:59 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/2290051117' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T09:05:02.371 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:00 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/2307332408' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:05:02.371 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:00 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/2370951160' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T09:05:02.371 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:01 smithi155 ceph-mon[34921]: pgmap v727: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 9 op/s 2024-09-19T09:05:02.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:00.146+0000 7fd76de5e640 1 -- 172.21.15.19:0/2370951160 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd7540a3250 msgr2=0x7fd7540a5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:02.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:00.146+0000 7fd76de5e640 1 --2- 172.21.15.19:0/2370951160 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd7540a3250 0x7fd7540a5710 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd758005ab0 tx=0x7fd758000bc0 comp rx=0 tx=0).stop 2024-09-19T09:05:02.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:00.146+0000 7fd76de5e640 1 -- 172.21.15.19:0/2370951160 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd768102d20 msgr2=0x7fd768198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:02.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:00.146+0000 7fd76de5e640 1 --2- 172.21.15.19:0/2370951160 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd768102d20 0x7fd768198340 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fd75000c920 tx=0x7fd75000cde0 comp rx=0 tx=0).stop 2024-09-19T09:05:02.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:00.146+0000 7fd76de5e640 1 -- 172.21.15.19:0/2370951160 shutdown_connections 2024-09-19T09:05:02.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:00.146+0000 7fd76de5e640 1 --2- 172.21.15.19:0/2370951160 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fd7540a3250 0x7fd7540a5710 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:02.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:00.146+0000 7fd76de5e640 1 --2- 172.21.15.19:0/2370951160 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fd7681036e0 0x7fd76819f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:02.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:00.146+0000 7fd76de5e640 1 --2- 172.21.15.19:0/2370951160 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fd768102d20 0x7fd768198340 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:02.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:00.146+0000 7fd76de5e640 1 --2- 172.21.15.19:0/2370951160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd768101b30 0x7fd768197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:02.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:00.146+0000 7fd76de5e640 1 -- 172.21.15.19:0/2370951160 >> 172.21.15.19:0/2370951160 conn(0x7fd7680fd2b0 msgr2=0x7fd768106070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:02.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:00.146+0000 7fd76de5e640 1 -- 172.21.15.19:0/2370951160 shutdown_connections 2024-09-19T09:05:02.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:00.146+0000 7fd76de5e640 1 -- 172.21.15.19:0/2370951160 wait complete. 2024-09-19T09:05:02.381 DEBUG:tasks.check_counter:Getting stats from a 2024-09-19T09:05:02.381 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-19T09:05:02.382 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:00 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/2307332408' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T09:05:02.382 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:00 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/2370951160' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T09:05:02.382 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:01 smithi019 ceph-mon[30976]: pgmap v727: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 9 op/s 2024-09-19T09:05:02.651 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:03.273 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T09:05:03.274 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:05:03.274 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 1147, 2024-09-19T09:05:03.274 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 1126, 2024-09-19T09:05:03.274 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 1178274, 2024-09-19T09:05:03.274 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 428098, 2024-09-19T09:05:03.274 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 5, 2024-09-19T09:05:03.274 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 1, 2024-09-19T09:05:03.275 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.125851523, 2024-09-19T09:05:03.275 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.054889590, 2024-09-19T09:05:03.275 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.045504909, 2024-09-19T09:05:03.275 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.022490556, 2024-09-19T09:05:03.275 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:05:03.275 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 1125, 2024-09-19T09:05:03.275 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.067235441, 2024-09-19T09:05:03.275 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000059764 2024-09-19T09:05:03.276 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.276 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:05:03.276 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.276 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.276 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.276 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.276 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 885200, 2024-09-19T09:05:03.276 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 151120 2024-09-19T09:05:03.277 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.277 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:05:03.277 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 1646, 2024-09-19T09:05:03.277 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 1829, 2024-09-19T09:05:03.277 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 420260, 2024-09-19T09:05:03.277 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 926223, 2024-09-19T09:05:03.277 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 5, 2024-09-19T09:05:03.277 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 4, 2024-09-19T09:05:03.278 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.106819519, 2024-09-19T09:05:03.278 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.036514685, 2024-09-19T09:05:03.278 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.025703011, 2024-09-19T09:05:03.278 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.036220526, 2024-09-19T09:05:03.278 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:05:03.278 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 1827, 2024-09-19T09:05:03.278 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.055971791, 2024-09-19T09:05:03.278 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000030635 2024-09-19T09:05:03.279 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.279 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:05:03.279 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.279 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.279 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.279 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.279 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:05:03.279 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 403056 2024-09-19T09:05:03.280 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.280 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:05:03.280 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 8, 2024-09-19T09:05:03.280 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 8, 2024-09-19T09:05:03.280 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 4701, 2024-09-19T09:05:03.280 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 1732, 2024-09-19T09:05:03.280 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 5, 2024-09-19T09:05:03.280 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 4, 2024-09-19T09:05:03.280 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.003544455, 2024-09-19T09:05:03.281 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.000110076, 2024-09-19T09:05:03.281 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.003285187, 2024-09-19T09:05:03.281 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.000078786, 2024-09-19T09:05:03.281 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:05:03.281 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 7, 2024-09-19T09:05:03.281 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.007213005, 2024-09-19T09:05:03.281 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.001030429 2024-09-19T09:05:03.282 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.282 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:05:03.282 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.282 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.282 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.283 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.283 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 3072, 2024-09-19T09:05:03.283 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T09:05:03.283 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.283 INFO:teuthology.orchestra.run.smithi019.stdout: "cct": { 2024-09-19T09:05:03.283 INFO:teuthology.orchestra.run.smithi019.stdout: "total_workers": 1, 2024-09-19T09:05:03.283 INFO:teuthology.orchestra.run.smithi019.stdout: "unhealthy_workers": 0 2024-09-19T09:05:03.283 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.284 INFO:teuthology.orchestra.run.smithi019.stdout: "finisher-MDSRank": { 2024-09-19T09:05:03.284 INFO:teuthology.orchestra.run.smithi019.stdout: "queue_len": 0, 2024-09-19T09:05:03.284 INFO:teuthology.orchestra.run.smithi019.stdout: "complete_latency": { 2024-09-19T09:05:03.284 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 4252, 2024-09-19T09:05:03.284 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.095270936, 2024-09-19T09:05:03.284 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000022406 2024-09-19T09:05:03.284 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:03.284 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.285 INFO:teuthology.orchestra.run.smithi019.stdout: "finisher-PurgeQueue": { 2024-09-19T09:05:03.285 INFO:teuthology.orchestra.run.smithi019.stdout: "queue_len": 0, 2024-09-19T09:05:03.285 INFO:teuthology.orchestra.run.smithi019.stdout: "complete_latency": { 2024-09-19T09:05:03.285 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.285 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.285 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.285 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:03.285 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.286 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": { 2024-09-19T09:05:03.286 INFO:teuthology.orchestra.run.smithi019.stdout: "request": 0, 2024-09-19T09:05:03.286 INFO:teuthology.orchestra.run.smithi019.stdout: "reply": 0, 2024-09-19T09:05:03.286 INFO:teuthology.orchestra.run.smithi019.stdout: "reply_latency": { 2024-09-19T09:05:03.286 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.286 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.286 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.287 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.287 INFO:teuthology.orchestra.run.smithi019.stdout: "slow_reply": 0, 2024-09-19T09:05:03.287 INFO:teuthology.orchestra.run.smithi019.stdout: "forward": 0, 2024-09-19T09:05:03.287 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_fetch_complete": 0, 2024-09-19T09:05:03.287 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_fetch_keys": 0, 2024-09-19T09:05:03.287 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_commit": 0, 2024-09-19T09:05:03.287 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_split": 0, 2024-09-19T09:05:03.287 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_merge": 0, 2024-09-19T09:05:03.287 INFO:teuthology.orchestra.run.smithi019.stdout: "inodes": 0, 2024-09-19T09:05:03.288 INFO:teuthology.orchestra.run.smithi019.stdout: "inodes_top": 0, 2024-09-19T09:05:03.288 INFO:teuthology.orchestra.run.smithi019.stdout: "inodes_bottom": 0, 2024-09-19T09:05:03.288 INFO:teuthology.orchestra.run.smithi019.stdout: "inodes_pin_tail": 0, 2024-09-19T09:05:03.288 INFO:teuthology.orchestra.run.smithi019.stdout: "inodes_pinned": 0, 2024-09-19T09:05:03.288 INFO:teuthology.orchestra.run.smithi019.stdout: "inodes_expired": 0, 2024-09-19T09:05:03.288 INFO:teuthology.orchestra.run.smithi019.stdout: "inodes_with_caps": 0, 2024-09-19T09:05:03.288 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": 0, 2024-09-19T09:05:03.289 INFO:teuthology.orchestra.run.smithi019.stdout: "subtrees": 1, 2024-09-19T09:05:03.289 INFO:teuthology.orchestra.run.smithi019.stdout: "traverse": 0, 2024-09-19T09:05:03.289 INFO:teuthology.orchestra.run.smithi019.stdout: "traverse_hit": 0, 2024-09-19T09:05:03.289 INFO:teuthology.orchestra.run.smithi019.stdout: "traverse_forward": 0, 2024-09-19T09:05:03.289 INFO:teuthology.orchestra.run.smithi019.stdout: "traverse_discover": 0, 2024-09-19T09:05:03.289 INFO:teuthology.orchestra.run.smithi019.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:05:03.289 INFO:teuthology.orchestra.run.smithi019.stdout: "traverse_remote_ino": 0, 2024-09-19T09:05:03.289 INFO:teuthology.orchestra.run.smithi019.stdout: "traverse_lock": 0, 2024-09-19T09:05:03.289 INFO:teuthology.orchestra.run.smithi019.stdout: "load_cent": 0, 2024-09-19T09:05:03.290 INFO:teuthology.orchestra.run.smithi019.stdout: "q": 0, 2024-09-19T09:05:03.290 INFO:teuthology.orchestra.run.smithi019.stdout: "exported": 0, 2024-09-19T09:05:03.290 INFO:teuthology.orchestra.run.smithi019.stdout: "exported_inodes": 0, 2024-09-19T09:05:03.290 INFO:teuthology.orchestra.run.smithi019.stdout: "imported": 0, 2024-09-19T09:05:03.290 INFO:teuthology.orchestra.run.smithi019.stdout: "imported_inodes": 0, 2024-09-19T09:05:03.290 INFO:teuthology.orchestra.run.smithi019.stdout: "openino_dir_fetch": 0, 2024-09-19T09:05:03.290 INFO:teuthology.orchestra.run.smithi019.stdout: "openino_backtrace_fetch": 0, 2024-09-19T09:05:03.290 INFO:teuthology.orchestra.run.smithi019.stdout: "openino_peer_discover": 0, 2024-09-19T09:05:03.291 INFO:teuthology.orchestra.run.smithi019.stdout: "root_rfiles": 0, 2024-09-19T09:05:03.291 INFO:teuthology.orchestra.run.smithi019.stdout: "root_rbytes": 0, 2024-09-19T09:05:03.291 INFO:teuthology.orchestra.run.smithi019.stdout: "root_rsnaps": 0, 2024-09-19T09:05:03.291 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T09:05:03.291 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_set_tag": 0, 2024-09-19T09:05:03.291 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:05:03.291 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:05:03.292 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:05:03.292 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:05:03.292 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:05:03.292 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_file_inodes": 0, 2024-09-19T09:05:03.292 INFO:teuthology.orchestra.run.smithi019.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:05:03.292 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T09:05:03.292 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_cap_op_grant": 0, 2024-09-19T09:05:03.292 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:05:03.293 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:05:03.293 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:05:03.293 INFO:teuthology.orchestra.run.smithi019.stdout: "handle_client_caps": 0, 2024-09-19T09:05:03.293 INFO:teuthology.orchestra.run.smithi019.stdout: "handle_client_caps_dirty": 0, 2024-09-19T09:05:03.293 INFO:teuthology.orchestra.run.smithi019.stdout: "handle_client_cap_release": 0, 2024-09-19T09:05:03.293 INFO:teuthology.orchestra.run.smithi019.stdout: "process_request_cap_release": 0 2024-09-19T09:05:03.293 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.294 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache": { 2024-09-19T09:05:03.294 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_update": 0, 2024-09-19T09:05:03.294 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_update_receipt": 0, 2024-09-19T09:05:03.294 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_try_discover": 0, 2024-09-19T09:05:03.294 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_send_discover": 0, 2024-09-19T09:05:03.294 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_handle_discover": 0, 2024-09-19T09:05:03.294 INFO:teuthology.orchestra.run.smithi019.stdout: "num_strays": 0, 2024-09-19T09:05:03.294 INFO:teuthology.orchestra.run.smithi019.stdout: "num_strays_delayed": 0, 2024-09-19T09:05:03.295 INFO:teuthology.orchestra.run.smithi019.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:05:03.295 INFO:teuthology.orchestra.run.smithi019.stdout: "strays_created": 0, 2024-09-19T09:05:03.295 INFO:teuthology.orchestra.run.smithi019.stdout: "strays_enqueued": 0, 2024-09-19T09:05:03.295 INFO:teuthology.orchestra.run.smithi019.stdout: "strays_reintegrated": 0, 2024-09-19T09:05:03.295 INFO:teuthology.orchestra.run.smithi019.stdout: "strays_migrated": 0, 2024-09-19T09:05:03.295 INFO:teuthology.orchestra.run.smithi019.stdout: "num_recovering_processing": 0, 2024-09-19T09:05:03.295 INFO:teuthology.orchestra.run.smithi019.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:05:03.295 INFO:teuthology.orchestra.run.smithi019.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:05:03.296 INFO:teuthology.orchestra.run.smithi019.stdout: "recovery_started": 0, 2024-09-19T09:05:03.296 INFO:teuthology.orchestra.run.smithi019.stdout: "recovery_completed": 0, 2024-09-19T09:05:03.296 INFO:teuthology.orchestra.run.smithi019.stdout: "ireq_quiesce_path": 0, 2024-09-19T09:05:03.296 INFO:teuthology.orchestra.run.smithi019.stdout: "ireq_quiesce_inode": 0, 2024-09-19T09:05:03.296 INFO:teuthology.orchestra.run.smithi019.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:05:03.296 INFO:teuthology.orchestra.run.smithi019.stdout: "ireq_exportdir": 0, 2024-09-19T09:05:03.296 INFO:teuthology.orchestra.run.smithi019.stdout: "ireq_flush": 0, 2024-09-19T09:05:03.296 INFO:teuthology.orchestra.run.smithi019.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:05:03.297 INFO:teuthology.orchestra.run.smithi019.stdout: "ireq_fragstats": 0, 2024-09-19T09:05:03.297 INFO:teuthology.orchestra.run.smithi019.stdout: "ireq_inodestats": 0 2024-09-19T09:05:03.297 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.297 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log": { 2024-09-19T09:05:03.297 INFO:teuthology.orchestra.run.smithi019.stdout: "evlrg": 0, 2024-09-19T09:05:03.297 INFO:teuthology.orchestra.run.smithi019.stdout: "evadd": 0, 2024-09-19T09:05:03.297 INFO:teuthology.orchestra.run.smithi019.stdout: "evex": 0, 2024-09-19T09:05:03.298 INFO:teuthology.orchestra.run.smithi019.stdout: "evtrm": 0, 2024-09-19T09:05:03.298 INFO:teuthology.orchestra.run.smithi019.stdout: "ev": 5, 2024-09-19T09:05:03.298 INFO:teuthology.orchestra.run.smithi019.stdout: "evexg": 0, 2024-09-19T09:05:03.298 INFO:teuthology.orchestra.run.smithi019.stdout: "evexd": 0, 2024-09-19T09:05:03.298 INFO:teuthology.orchestra.run.smithi019.stdout: "segadd": 0, 2024-09-19T09:05:03.298 INFO:teuthology.orchestra.run.smithi019.stdout: "segex": 0, 2024-09-19T09:05:03.298 INFO:teuthology.orchestra.run.smithi019.stdout: "segtrm": 0, 2024-09-19T09:05:03.299 INFO:teuthology.orchestra.run.smithi019.stdout: "seg": 2, 2024-09-19T09:05:03.299 INFO:teuthology.orchestra.run.smithi019.stdout: "segmjr": 2, 2024-09-19T09:05:03.299 INFO:teuthology.orchestra.run.smithi019.stdout: "segexg": 0, 2024-09-19T09:05:03.299 INFO:teuthology.orchestra.run.smithi019.stdout: "segexd": 0, 2024-09-19T09:05:03.299 INFO:teuthology.orchestra.run.smithi019.stdout: "expos": 4194304, 2024-09-19T09:05:03.299 INFO:teuthology.orchestra.run.smithi019.stdout: "wrpos": 4195734, 2024-09-19T09:05:03.299 INFO:teuthology.orchestra.run.smithi019.stdout: "rdpos": 4195426, 2024-09-19T09:05:03.299 INFO:teuthology.orchestra.run.smithi019.stdout: "jlat": { 2024-09-19T09:05:03.299 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.300 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.300 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.300 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.300 INFO:teuthology.orchestra.run.smithi019.stdout: "replayed": 5 2024-09-19T09:05:03.300 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.300 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_mem": { 2024-09-19T09:05:03.300 INFO:teuthology.orchestra.run.smithi019.stdout: "ino": 3, 2024-09-19T09:05:03.301 INFO:teuthology.orchestra.run.smithi019.stdout: "ino+": 3, 2024-09-19T09:05:03.301 INFO:teuthology.orchestra.run.smithi019.stdout: "ino-": 0, 2024-09-19T09:05:03.301 INFO:teuthology.orchestra.run.smithi019.stdout: "dir": 1, 2024-09-19T09:05:03.301 INFO:teuthology.orchestra.run.smithi019.stdout: "dir+": 1, 2024-09-19T09:05:03.301 INFO:teuthology.orchestra.run.smithi019.stdout: "dir-": 0, 2024-09-19T09:05:03.301 INFO:teuthology.orchestra.run.smithi019.stdout: "dn": 0, 2024-09-19T09:05:03.301 INFO:teuthology.orchestra.run.smithi019.stdout: "dn+": 0, 2024-09-19T09:05:03.301 INFO:teuthology.orchestra.run.smithi019.stdout: "dn-": 0, 2024-09-19T09:05:03.301 INFO:teuthology.orchestra.run.smithi019.stdout: "cap": 0, 2024-09-19T09:05:03.302 INFO:teuthology.orchestra.run.smithi019.stdout: "cap+": 0, 2024-09-19T09:05:03.302 INFO:teuthology.orchestra.run.smithi019.stdout: "cap-": 0, 2024-09-19T09:05:03.302 INFO:teuthology.orchestra.run.smithi019.stdout: "rss": 48564, 2024-09-19T09:05:03.302 INFO:teuthology.orchestra.run.smithi019.stdout: "heap": 215328 2024-09-19T09:05:03.302 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.302 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_server": { 2024-09-19T09:05:03.302 INFO:teuthology.orchestra.run.smithi019.stdout: "dispatch_client_request": 0, 2024-09-19T09:05:03.302 INFO:teuthology.orchestra.run.smithi019.stdout: "dispatch_server_request": 0, 2024-09-19T09:05:03.303 INFO:teuthology.orchestra.run.smithi019.stdout: "handle_client_request": 0, 2024-09-19T09:05:03.303 INFO:teuthology.orchestra.run.smithi019.stdout: "handle_client_session": 0, 2024-09-19T09:05:03.303 INFO:teuthology.orchestra.run.smithi019.stdout: "handle_peer_request": 0, 2024-09-19T09:05:03.303 INFO:teuthology.orchestra.run.smithi019.stdout: "req_create_latency": { 2024-09-19T09:05:03.303 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.303 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.303 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.303 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.303 INFO:teuthology.orchestra.run.smithi019.stdout: "req_getattr_latency": { 2024-09-19T09:05:03.304 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.304 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.304 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.304 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.304 INFO:teuthology.orchestra.run.smithi019.stdout: "req_getfilelock_latency": { 2024-09-19T09:05:03.304 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.304 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.304 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.305 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.305 INFO:teuthology.orchestra.run.smithi019.stdout: "req_link_latency": { 2024-09-19T09:05:03.305 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.305 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.305 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.305 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.305 INFO:teuthology.orchestra.run.smithi019.stdout: "req_lookup_latency": { 2024-09-19T09:05:03.305 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.306 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.306 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.306 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.306 INFO:teuthology.orchestra.run.smithi019.stdout: "req_lookuphash_latency": { 2024-09-19T09:05:03.306 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.306 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.306 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.306 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.307 INFO:teuthology.orchestra.run.smithi019.stdout: "req_lookupino_latency": { 2024-09-19T09:05:03.307 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.307 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.307 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.307 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.307 INFO:teuthology.orchestra.run.smithi019.stdout: "req_lookupname_latency": { 2024-09-19T09:05:03.307 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.307 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.308 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.308 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.308 INFO:teuthology.orchestra.run.smithi019.stdout: "req_lookupparent_latency": { 2024-09-19T09:05:03.308 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.308 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.308 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.308 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.308 INFO:teuthology.orchestra.run.smithi019.stdout: "req_lookupsnap_latency": { 2024-09-19T09:05:03.309 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.309 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.309 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.309 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.309 INFO:teuthology.orchestra.run.smithi019.stdout: "req_lssnap_latency": { 2024-09-19T09:05:03.309 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.309 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.309 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.309 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.310 INFO:teuthology.orchestra.run.smithi019.stdout: "req_mkdir_latency": { 2024-09-19T09:05:03.310 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.311 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.311 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.311 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.311 INFO:teuthology.orchestra.run.smithi019.stdout: "req_mknod_latency": { 2024-09-19T09:05:03.311 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.311 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.311 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.312 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.312 INFO:teuthology.orchestra.run.smithi019.stdout: "req_mksnap_latency": { 2024-09-19T09:05:03.312 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.312 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.312 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.312 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.312 INFO:teuthology.orchestra.run.smithi019.stdout: "req_open_latency": { 2024-09-19T09:05:03.312 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.312 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.313 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.313 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.313 INFO:teuthology.orchestra.run.smithi019.stdout: "req_readdir_latency": { 2024-09-19T09:05:03.313 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.313 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.313 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.313 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.313 INFO:teuthology.orchestra.run.smithi019.stdout: "req_rename_latency": { 2024-09-19T09:05:03.314 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.314 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.314 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.314 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.314 INFO:teuthology.orchestra.run.smithi019.stdout: "req_renamesnap_latency": { 2024-09-19T09:05:03.314 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.314 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.314 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.314 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.315 INFO:teuthology.orchestra.run.smithi019.stdout: "req_snapdiff_latency": { 2024-09-19T09:05:03.315 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.315 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.315 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.315 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.315 INFO:teuthology.orchestra.run.smithi019.stdout: "req_rmdir_latency": { 2024-09-19T09:05:03.315 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.315 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.316 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.316 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.316 INFO:teuthology.orchestra.run.smithi019.stdout: "req_rmsnap_latency": { 2024-09-19T09:05:03.316 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.316 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.316 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.316 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.316 INFO:teuthology.orchestra.run.smithi019.stdout: "req_rmxattr_latency": { 2024-09-19T09:05:03.317 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.317 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.317 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.317 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.317 INFO:teuthology.orchestra.run.smithi019.stdout: "req_setattr_latency": { 2024-09-19T09:05:03.317 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.317 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.318 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.318 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.318 INFO:teuthology.orchestra.run.smithi019.stdout: "req_setdirlayout_latency": { 2024-09-19T09:05:03.318 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.318 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.318 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.318 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.318 INFO:teuthology.orchestra.run.smithi019.stdout: "req_setfilelock_latency": { 2024-09-19T09:05:03.319 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.319 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.319 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.319 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.319 INFO:teuthology.orchestra.run.smithi019.stdout: "req_setlayout_latency": { 2024-09-19T09:05:03.320 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.320 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.320 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.320 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.320 INFO:teuthology.orchestra.run.smithi019.stdout: "req_setxattr_latency": { 2024-09-19T09:05:03.320 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.320 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.320 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.321 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.321 INFO:teuthology.orchestra.run.smithi019.stdout: "req_symlink_latency": { 2024-09-19T09:05:03.321 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.321 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.321 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.321 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.321 INFO:teuthology.orchestra.run.smithi019.stdout: "req_unlink_latency": { 2024-09-19T09:05:03.321 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.322 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.322 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.322 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.322 INFO:teuthology.orchestra.run.smithi019.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:05:03.322 INFO:teuthology.orchestra.run.smithi019.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:05:03.322 INFO:teuthology.orchestra.run.smithi019.stdout: "req_getvxattr_latency": { 2024-09-19T09:05:03.322 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.322 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.323 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.323 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:03.323 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.323 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_sessions": { 2024-09-19T09:05:03.323 INFO:teuthology.orchestra.run.smithi019.stdout: "session_count": 1, 2024-09-19T09:05:03.323 INFO:teuthology.orchestra.run.smithi019.stdout: "session_add": 2, 2024-09-19T09:05:03.323 INFO:teuthology.orchestra.run.smithi019.stdout: "session_remove": 1, 2024-09-19T09:05:03.323 INFO:teuthology.orchestra.run.smithi019.stdout: "sessions_open": 1, 2024-09-19T09:05:03.323 INFO:teuthology.orchestra.run.smithi019.stdout: "sessions_stale": 0, 2024-09-19T09:05:03.324 INFO:teuthology.orchestra.run.smithi019.stdout: "total_load": 0, 2024-09-19T09:05:03.324 INFO:teuthology.orchestra.run.smithi019.stdout: "average_load": 0, 2024-09-19T09:05:03.324 INFO:teuthology.orchestra.run.smithi019.stdout: "avg_session_uptime": 1829, 2024-09-19T09:05:03.324 INFO:teuthology.orchestra.run.smithi019.stdout: "mdthresh_evicted": 0 2024-09-19T09:05:03.324 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.324 INFO:teuthology.orchestra.run.smithi019.stdout: "mempool": { 2024-09-19T09:05:03.325 INFO:teuthology.orchestra.run.smithi019.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:05:03.325 INFO:teuthology.orchestra.run.smithi019.stdout: "bloom_filter_items": 0, 2024-09-19T09:05:03.325 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:05:03.325 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:05:03.325 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:05:03.325 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:05:03.325 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:05:03.325 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:05:03.326 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:05:03.326 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:05:03.326 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:05:03.326 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:05:03.326 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:05:03.326 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:05:03.326 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:05:03.326 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_items": 0, 2024-09-19T09:05:03.326 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:05:03.327 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_blob_items": 0, 2024-09-19T09:05:03.327 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:05:03.327 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:05:03.327 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:05:03.327 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:05:03.327 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:05:03.327 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:05:03.328 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:05:03.328 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_txc_items": 0, 2024-09-19T09:05:03.328 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:05:03.328 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:05:03.328 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:05:03.328 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_items": 0, 2024-09-19T09:05:03.328 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_bytes": 0, 2024-09-19T09:05:03.329 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_items": 0, 2024-09-19T09:05:03.329 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:05:03.329 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:05:03.329 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:05:03.329 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:05:03.329 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_anon_bytes": 198494, 2024-09-19T09:05:03.329 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_anon_items": 55, 2024-09-19T09:05:03.330 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:05:03.330 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_meta_items": 0, 2024-09-19T09:05:03.330 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_bytes": 0, 2024-09-19T09:05:03.330 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_items": 0, 2024-09-19T09:05:03.330 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:05:03.330 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mapbl_items": 0, 2024-09-19T09:05:03.330 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:05:03.330 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pglog_items": 0, 2024-09-19T09:05:03.331 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_bytes": 7496, 2024-09-19T09:05:03.331 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_items": 154, 2024-09-19T09:05:03.331 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:05:03.331 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:05:03.331 INFO:teuthology.orchestra.run.smithi019.stdout: "pgmap_bytes": 0, 2024-09-19T09:05:03.331 INFO:teuthology.orchestra.run.smithi019.stdout: "pgmap_items": 0, 2024-09-19T09:05:03.331 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_co_bytes": 8512, 2024-09-19T09:05:03.331 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_co_items": 13, 2024-09-19T09:05:03.331 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_1_bytes": 0, 2024-09-19T09:05:03.332 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_1_items": 0, 2024-09-19T09:05:03.332 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_2_bytes": 0, 2024-09-19T09:05:03.332 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_2_items": 0 2024-09-19T09:05:03.332 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.332 INFO:teuthology.orchestra.run.smithi019.stdout: "objecter": { 2024-09-19T09:05:03.332 INFO:teuthology.orchestra.run.smithi019.stdout: "op_active": 0, 2024-09-19T09:05:03.332 INFO:teuthology.orchestra.run.smithi019.stdout: "op_laggy": 0, 2024-09-19T09:05:03.332 INFO:teuthology.orchestra.run.smithi019.stdout: "op_send": 2520, 2024-09-19T09:05:03.333 INFO:teuthology.orchestra.run.smithi019.stdout: "op_send_bytes": 21, 2024-09-19T09:05:03.333 INFO:teuthology.orchestra.run.smithi019.stdout: "op_resend": 3, 2024-09-19T09:05:03.333 INFO:teuthology.orchestra.run.smithi019.stdout: "op_reply": 2520, 2024-09-19T09:05:03.333 INFO:teuthology.orchestra.run.smithi019.stdout: "op_latency": { 2024-09-19T09:05:03.333 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 2520, 2024-09-19T09:05:03.333 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 5.801951515, 2024-09-19T09:05:03.333 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.002302361 2024-09-19T09:05:03.333 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.333 INFO:teuthology.orchestra.run.smithi019.stdout: "op_inflight": 0, 2024-09-19T09:05:03.334 INFO:teuthology.orchestra.run.smithi019.stdout: "oplen_avg": { 2024-09-19T09:05:03.334 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 2520, 2024-09-19T09:05:03.334 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 2521 2024-09-19T09:05:03.334 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.334 INFO:teuthology.orchestra.run.smithi019.stdout: "op": 2520, 2024-09-19T09:05:03.334 INFO:teuthology.orchestra.run.smithi019.stdout: "op_r": 2520, 2024-09-19T09:05:03.334 INFO:teuthology.orchestra.run.smithi019.stdout: "op_w": 0, 2024-09-19T09:05:03.334 INFO:teuthology.orchestra.run.smithi019.stdout: "op_rmw": 0, 2024-09-19T09:05:03.335 INFO:teuthology.orchestra.run.smithi019.stdout: "op_pg": 0, 2024-09-19T09:05:03.335 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_stat": 1640, 2024-09-19T09:05:03.335 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_create": 0, 2024-09-19T09:05:03.335 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_read": 878, 2024-09-19T09:05:03.335 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_write": 0, 2024-09-19T09:05:03.335 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_writefull": 0, 2024-09-19T09:05:03.335 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_writesame": 0, 2024-09-19T09:05:03.335 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_append": 0, 2024-09-19T09:05:03.335 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_zero": 0, 2024-09-19T09:05:03.336 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_truncate": 0, 2024-09-19T09:05:03.336 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_delete": 0, 2024-09-19T09:05:03.336 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_mapext": 0, 2024-09-19T09:05:03.336 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_sparse_read": 0, 2024-09-19T09:05:03.336 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_clonerange": 0, 2024-09-19T09:05:03.336 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_getxattr": 1, 2024-09-19T09:05:03.336 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_setxattr": 0, 2024-09-19T09:05:03.336 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:05:03.336 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_rmxattr": 0, 2024-09-19T09:05:03.337 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:05:03.337 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_call": 0, 2024-09-19T09:05:03.337 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_watch": 0, 2024-09-19T09:05:03.337 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_notify": 0, 2024-09-19T09:05:03.337 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:05:03.337 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_pgls": 0, 2024-09-19T09:05:03.337 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:05:03.337 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_other": 0, 2024-09-19T09:05:03.338 INFO:teuthology.orchestra.run.smithi019.stdout: "linger_active": 0, 2024-09-19T09:05:03.338 INFO:teuthology.orchestra.run.smithi019.stdout: "linger_send": 0, 2024-09-19T09:05:03.338 INFO:teuthology.orchestra.run.smithi019.stdout: "linger_resend": 0, 2024-09-19T09:05:03.338 INFO:teuthology.orchestra.run.smithi019.stdout: "linger_ping": 0, 2024-09-19T09:05:03.338 INFO:teuthology.orchestra.run.smithi019.stdout: "poolop_active": 0, 2024-09-19T09:05:03.338 INFO:teuthology.orchestra.run.smithi019.stdout: "poolop_send": 0, 2024-09-19T09:05:03.338 INFO:teuthology.orchestra.run.smithi019.stdout: "poolop_resend": 0, 2024-09-19T09:05:03.338 INFO:teuthology.orchestra.run.smithi019.stdout: "poolstat_active": 0, 2024-09-19T09:05:03.339 INFO:teuthology.orchestra.run.smithi019.stdout: "poolstat_send": 0, 2024-09-19T09:05:03.339 INFO:teuthology.orchestra.run.smithi019.stdout: "poolstat_resend": 0, 2024-09-19T09:05:03.339 INFO:teuthology.orchestra.run.smithi019.stdout: "statfs_active": 0, 2024-09-19T09:05:03.339 INFO:teuthology.orchestra.run.smithi019.stdout: "statfs_send": 0, 2024-09-19T09:05:03.339 INFO:teuthology.orchestra.run.smithi019.stdout: "statfs_resend": 0, 2024-09-19T09:05:03.339 INFO:teuthology.orchestra.run.smithi019.stdout: "command_active": 0, 2024-09-19T09:05:03.339 INFO:teuthology.orchestra.run.smithi019.stdout: "command_send": 0, 2024-09-19T09:05:03.339 INFO:teuthology.orchestra.run.smithi019.stdout: "command_resend": 0, 2024-09-19T09:05:03.340 INFO:teuthology.orchestra.run.smithi019.stdout: "map_epoch": 88, 2024-09-19T09:05:03.340 INFO:teuthology.orchestra.run.smithi019.stdout: "map_full": 0, 2024-09-19T09:05:03.340 INFO:teuthology.orchestra.run.smithi019.stdout: "map_inc": 8, 2024-09-19T09:05:03.340 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_sessions": 6, 2024-09-19T09:05:03.341 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_session_open": 6, 2024-09-19T09:05:03.341 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_session_close": 0, 2024-09-19T09:05:03.341 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_laggy": 0, 2024-09-19T09:05:03.341 INFO:teuthology.orchestra.run.smithi019.stdout: "omap_wr": 0, 2024-09-19T09:05:03.342 INFO:teuthology.orchestra.run.smithi019.stdout: "omap_rd": 2, 2024-09-19T09:05:03.342 INFO:teuthology.orchestra.run.smithi019.stdout: "omap_del": 0 2024-09-19T09:05:03.342 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.342 INFO:teuthology.orchestra.run.smithi019.stdout: "oft": { 2024-09-19T09:05:03.342 INFO:teuthology.orchestra.run.smithi019.stdout: "omap_total_objs": 0, 2024-09-19T09:05:03.342 INFO:teuthology.orchestra.run.smithi019.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:05:03.343 INFO:teuthology.orchestra.run.smithi019.stdout: "omap_total_updates": 0, 2024-09-19T09:05:03.343 INFO:teuthology.orchestra.run.smithi019.stdout: "omap_total_removes": 0 2024-09-19T09:05:03.343 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.343 INFO:teuthology.orchestra.run.smithi019.stdout: "osd-slow-ops": { 2024-09-19T09:05:03.343 INFO:teuthology.orchestra.run.smithi019.stdout: "slow_ops_count": 0 2024-09-19T09:05:03.343 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.343 INFO:teuthology.orchestra.run.smithi019.stdout: "purge_queue": { 2024-09-19T09:05:03.343 INFO:teuthology.orchestra.run.smithi019.stdout: "pq_executing_ops": 0, 2024-09-19T09:05:03.344 INFO:teuthology.orchestra.run.smithi019.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T09:05:03.344 INFO:teuthology.orchestra.run.smithi019.stdout: "pq_executing": 0, 2024-09-19T09:05:03.344 INFO:teuthology.orchestra.run.smithi019.stdout: "pq_executing_high_water": 0, 2024-09-19T09:05:03.344 INFO:teuthology.orchestra.run.smithi019.stdout: "pq_executed_ops": 0, 2024-09-19T09:05:03.345 INFO:teuthology.orchestra.run.smithi019.stdout: "pq_executed": 0, 2024-09-19T09:05:03.345 INFO:teuthology.orchestra.run.smithi019.stdout: "pq_item_in_journal": 0 2024-09-19T09:05:03.345 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.346 INFO:teuthology.orchestra.run.smithi019.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:05:03.346 INFO:teuthology.orchestra.run.smithi019.stdout: "val": 0, 2024-09-19T09:05:03.346 INFO:teuthology.orchestra.run.smithi019.stdout: "max": 104857600, 2024-09-19T09:05:03.346 INFO:teuthology.orchestra.run.smithi019.stdout: "get_started": 0, 2024-09-19T09:05:03.347 INFO:teuthology.orchestra.run.smithi019.stdout: "get": 2797, 2024-09-19T09:05:03.347 INFO:teuthology.orchestra.run.smithi019.stdout: "get_sum": 1334400, 2024-09-19T09:05:03.347 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:03.347 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_success": 2797, 2024-09-19T09:05:03.347 INFO:teuthology.orchestra.run.smithi019.stdout: "take": 0, 2024-09-19T09:05:03.347 INFO:teuthology.orchestra.run.smithi019.stdout: "take_sum": 0, 2024-09-19T09:05:03.347 INFO:teuthology.orchestra.run.smithi019.stdout: "put": 2797, 2024-09-19T09:05:03.348 INFO:teuthology.orchestra.run.smithi019.stdout: "put_sum": 1334400, 2024-09-19T09:05:03.348 INFO:teuthology.orchestra.run.smithi019.stdout: "wait": { 2024-09-19T09:05:03.348 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.348 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.349 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.349 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:03.349 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.349 INFO:teuthology.orchestra.run.smithi019.stdout: "throttle-objecter_bytes": { 2024-09-19T09:05:03.350 INFO:teuthology.orchestra.run.smithi019.stdout: "val": 0, 2024-09-19T09:05:03.350 INFO:teuthology.orchestra.run.smithi019.stdout: "max": 104857600, 2024-09-19T09:05:03.350 INFO:teuthology.orchestra.run.smithi019.stdout: "get_started": 0, 2024-09-19T09:05:03.350 INFO:teuthology.orchestra.run.smithi019.stdout: "get": 0, 2024-09-19T09:05:03.350 INFO:teuthology.orchestra.run.smithi019.stdout: "get_sum": 0, 2024-09-19T09:05:03.350 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:03.350 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_success": 0, 2024-09-19T09:05:03.350 INFO:teuthology.orchestra.run.smithi019.stdout: "take": 2520, 2024-09-19T09:05:03.351 INFO:teuthology.orchestra.run.smithi019.stdout: "take_sum": 1435, 2024-09-19T09:05:03.351 INFO:teuthology.orchestra.run.smithi019.stdout: "put": 2520, 2024-09-19T09:05:03.351 INFO:teuthology.orchestra.run.smithi019.stdout: "put_sum": 1435, 2024-09-19T09:05:03.351 INFO:teuthology.orchestra.run.smithi019.stdout: "wait": { 2024-09-19T09:05:03.351 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.351 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.351 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.352 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:03.352 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.352 INFO:teuthology.orchestra.run.smithi019.stdout: "throttle-objecter_ops": { 2024-09-19T09:05:03.352 INFO:teuthology.orchestra.run.smithi019.stdout: "val": 0, 2024-09-19T09:05:03.352 INFO:teuthology.orchestra.run.smithi019.stdout: "max": 1024, 2024-09-19T09:05:03.352 INFO:teuthology.orchestra.run.smithi019.stdout: "get_started": 0, 2024-09-19T09:05:03.352 INFO:teuthology.orchestra.run.smithi019.stdout: "get": 0, 2024-09-19T09:05:03.352 INFO:teuthology.orchestra.run.smithi019.stdout: "get_sum": 0, 2024-09-19T09:05:03.353 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:03.353 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_success": 0, 2024-09-19T09:05:03.353 INFO:teuthology.orchestra.run.smithi019.stdout: "take": 2520, 2024-09-19T09:05:03.353 INFO:teuthology.orchestra.run.smithi019.stdout: "take_sum": 2520, 2024-09-19T09:05:03.353 INFO:teuthology.orchestra.run.smithi019.stdout: "put": 2520, 2024-09-19T09:05:03.353 INFO:teuthology.orchestra.run.smithi019.stdout: "put_sum": 2520, 2024-09-19T09:05:03.353 INFO:teuthology.orchestra.run.smithi019.stdout: "wait": { 2024-09-19T09:05:03.353 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.353 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.354 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.354 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:03.354 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.354 INFO:teuthology.orchestra.run.smithi019.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:05:03.354 INFO:teuthology.orchestra.run.smithi019.stdout: "val": 0, 2024-09-19T09:05:03.354 INFO:teuthology.orchestra.run.smithi019.stdout: "max": 3758096384, 2024-09-19T09:05:03.354 INFO:teuthology.orchestra.run.smithi019.stdout: "get_started": 0, 2024-09-19T09:05:03.354 INFO:teuthology.orchestra.run.smithi019.stdout: "get": 0, 2024-09-19T09:05:03.354 INFO:teuthology.orchestra.run.smithi019.stdout: "get_sum": 0, 2024-09-19T09:05:03.355 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:03.355 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_success": 0, 2024-09-19T09:05:03.355 INFO:teuthology.orchestra.run.smithi019.stdout: "take": 0, 2024-09-19T09:05:03.355 INFO:teuthology.orchestra.run.smithi019.stdout: "take_sum": 0, 2024-09-19T09:05:03.355 INFO:teuthology.orchestra.run.smithi019.stdout: "put": 0, 2024-09-19T09:05:03.355 INFO:teuthology.orchestra.run.smithi019.stdout: "put_sum": 0, 2024-09-19T09:05:03.355 INFO:teuthology.orchestra.run.smithi019.stdout: "wait": { 2024-09-19T09:05:03.356 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.356 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.356 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.356 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:03.356 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:03.357 INFO:teuthology.orchestra.run.smithi019.stdout: "throttle-write_buf_throttle-0x55d8ff832b40": { 2024-09-19T09:05:03.357 INFO:teuthology.orchestra.run.smithi019.stdout: "val": 0, 2024-09-19T09:05:03.357 INFO:teuthology.orchestra.run.smithi019.stdout: "max": 3758096384, 2024-09-19T09:05:03.357 INFO:teuthology.orchestra.run.smithi019.stdout: "get_started": 0, 2024-09-19T09:05:03.357 INFO:teuthology.orchestra.run.smithi019.stdout: "get": 0, 2024-09-19T09:05:03.357 INFO:teuthology.orchestra.run.smithi019.stdout: "get_sum": 0, 2024-09-19T09:05:03.357 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:03.357 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_success": 0, 2024-09-19T09:05:03.358 INFO:teuthology.orchestra.run.smithi019.stdout: "take": 0, 2024-09-19T09:05:03.358 INFO:teuthology.orchestra.run.smithi019.stdout: "take_sum": 0, 2024-09-19T09:05:03.358 INFO:teuthology.orchestra.run.smithi019.stdout: "put": 0, 2024-09-19T09:05:03.358 INFO:teuthology.orchestra.run.smithi019.stdout: "put_sum": 0, 2024-09-19T09:05:03.358 INFO:teuthology.orchestra.run.smithi019.stdout: "wait": { 2024-09-19T09:05:03.358 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:03.358 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:03.359 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:03.359 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:03.359 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:03.359 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T09:05:03.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:03 smithi203 ceph-mon[35450]: pgmap v728: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-19T09:05:04.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:03 smithi019 ceph-mon[30976]: pgmap v728: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-19T09:05:04.101 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-19T09:05:04.101 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-19T09:05:04.102 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2024-09-19T09:05:04.102 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2024-09-19T09:05:04.102 INFO:tasks.check_counter:Daemon mds.a mds.dir_split=0 2024-09-19T09:05:04.102 DEBUG:tasks.check_counter:Getting stats from d 2024-09-19T09:05:04.102 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-19T09:05:04.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:03 smithi155 ceph-mon[34921]: pgmap v728: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-19T09:05:04.360 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:04.884 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T09:05:04.884 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:05:04.884 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 252, 2024-09-19T09:05:04.885 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 247, 2024-09-19T09:05:04.885 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 766000, 2024-09-19T09:05:04.885 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 152080, 2024-09-19T09:05:04.885 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 4, 2024-09-19T09:05:04.886 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 0, 2024-09-19T09:05:04.886 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.037054181, 2024-09-19T09:05:04.886 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.016442247, 2024-09-19T09:05:04.886 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.024855952, 2024-09-19T09:05:04.886 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:05:04.887 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:05:04.887 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 246, 2024-09-19T09:05:04.887 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.011731231, 2024-09-19T09:05:04.887 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000047687 2024-09-19T09:05:04.888 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:04.888 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:05:04.888 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:04.888 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:04.889 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:04.889 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:04.892 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 766000, 2024-09-19T09:05:04.892 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 152080 2024-09-19T09:05:04.892 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:04.892 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:05:04.892 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 6, 2024-09-19T09:05:04.893 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 191, 2024-09-19T09:05:04.893 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 3392, 2024-09-19T09:05:04.893 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 191248, 2024-09-19T09:05:04.893 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 4, 2024-09-19T09:05:04.893 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 2, 2024-09-19T09:05:04.894 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.016981424, 2024-09-19T09:05:04.894 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.011408387, 2024-09-19T09:05:04.894 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.003758885, 2024-09-19T09:05:04.894 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:05:04.894 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:05:04.895 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 190, 2024-09-19T09:05:04.895 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.013054537, 2024-09-19T09:05:04.895 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000068708 2024-09-19T09:05:04.895 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:04.895 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:05:04.896 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:04.896 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:04.896 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:04.897 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:04.897 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 3392, 2024-09-19T09:05:04.897 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 191248 2024-09-19T09:05:04.897 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:04.898 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:05:04.898 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 0, 2024-09-19T09:05:04.898 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 2, 2024-09-19T09:05:04.899 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 0, 2024-09-19T09:05:04.899 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 0, 2024-09-19T09:05:04.899 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 2, 2024-09-19T09:05:04.899 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 1, 2024-09-19T09:05:04.899 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.000422580, 2024-09-19T09:05:04.900 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T09:05:04.900 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.000338128, 2024-09-19T09:05:04.900 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:05:04.900 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:05:04.900 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:04.900 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:04.900 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:04.900 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:04.901 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:05:04.901 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:04.901 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:04.901 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:04.901 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:04.901 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:05:04.901 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:05:04.901 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:04.902 INFO:teuthology.orchestra.run.smithi019.stdout: "cct": { 2024-09-19T09:05:04.902 INFO:teuthology.orchestra.run.smithi019.stdout: "total_workers": 0, 2024-09-19T09:05:04.902 INFO:teuthology.orchestra.run.smithi019.stdout: "unhealthy_workers": 0 2024-09-19T09:05:04.902 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:04.902 INFO:teuthology.orchestra.run.smithi019.stdout: "mempool": { 2024-09-19T09:05:04.902 INFO:teuthology.orchestra.run.smithi019.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:05:04.902 INFO:teuthology.orchestra.run.smithi019.stdout: "bloom_filter_items": 0, 2024-09-19T09:05:04.902 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:05:04.903 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:05:04.903 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:05:04.903 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:05:04.903 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:05:04.904 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:05:04.904 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:05:04.904 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:05:04.904 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:05:04.905 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:05:04.905 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:05:04.905 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:05:04.906 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:05:04.906 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_items": 0, 2024-09-19T09:05:04.906 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:05:04.906 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_blob_items": 0, 2024-09-19T09:05:04.906 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:05:04.906 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:05:04.906 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:05:04.906 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:05:04.907 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:05:04.907 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:05:04.907 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:05:04.907 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_txc_items": 0, 2024-09-19T09:05:04.907 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:05:04.907 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:05:04.907 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:05:04.907 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_items": 0, 2024-09-19T09:05:04.907 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_bytes": 0, 2024-09-19T09:05:04.908 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_items": 0, 2024-09-19T09:05:04.908 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:05:04.908 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:05:04.908 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:05:04.908 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:05:04.908 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_anon_bytes": 147977, 2024-09-19T09:05:04.908 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_anon_items": 29, 2024-09-19T09:05:04.908 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:05:04.909 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_meta_items": 0, 2024-09-19T09:05:04.909 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_bytes": 0, 2024-09-19T09:05:04.909 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_items": 0, 2024-09-19T09:05:04.909 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:05:04.909 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mapbl_items": 0, 2024-09-19T09:05:04.909 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:05:04.909 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pglog_items": 0, 2024-09-19T09:05:04.909 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_bytes": 0, 2024-09-19T09:05:04.909 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_items": 0, 2024-09-19T09:05:04.910 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:05:04.910 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:05:04.910 INFO:teuthology.orchestra.run.smithi019.stdout: "pgmap_bytes": 0, 2024-09-19T09:05:04.910 INFO:teuthology.orchestra.run.smithi019.stdout: "pgmap_items": 0, 2024-09-19T09:05:04.910 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_co_bytes": 928, 2024-09-19T09:05:04.910 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_co_items": 2, 2024-09-19T09:05:04.911 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_1_bytes": 0, 2024-09-19T09:05:04.911 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_1_items": 0, 2024-09-19T09:05:04.911 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_2_bytes": 0, 2024-09-19T09:05:04.911 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_2_items": 0 2024-09-19T09:05:04.911 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:04.911 INFO:teuthology.orchestra.run.smithi019.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:05:04.911 INFO:teuthology.orchestra.run.smithi019.stdout: "val": 0, 2024-09-19T09:05:04.911 INFO:teuthology.orchestra.run.smithi019.stdout: "max": 104857600, 2024-09-19T09:05:04.911 INFO:teuthology.orchestra.run.smithi019.stdout: "get_started": 0, 2024-09-19T09:05:04.912 INFO:teuthology.orchestra.run.smithi019.stdout: "get": 254, 2024-09-19T09:05:04.912 INFO:teuthology.orchestra.run.smithi019.stdout: "get_sum": 730399, 2024-09-19T09:05:04.912 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:04.912 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_success": 254, 2024-09-19T09:05:04.912 INFO:teuthology.orchestra.run.smithi019.stdout: "take": 0, 2024-09-19T09:05:04.912 INFO:teuthology.orchestra.run.smithi019.stdout: "take_sum": 0, 2024-09-19T09:05:04.912 INFO:teuthology.orchestra.run.smithi019.stdout: "put": 254, 2024-09-19T09:05:04.912 INFO:teuthology.orchestra.run.smithi019.stdout: "put_sum": 730399, 2024-09-19T09:05:04.913 INFO:teuthology.orchestra.run.smithi019.stdout: "wait": { 2024-09-19T09:05:04.913 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:04.913 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:04.913 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:04.913 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:04.913 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:04.913 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T09:05:05.510 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-19T09:05:05.511 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-19T09:05:05.511 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-19T09:05:05.511 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-19T09:05:05.511 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.d 2024-09-19T09:05:05.511 DEBUG:tasks.check_counter:Getting stats from g 2024-09-19T09:05:05.511 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-19T09:05:05.770 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:05.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:05 smithi019 ceph-mon[30976]: pgmap v729: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:05:05.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:05 smithi203 ceph-mon[35450]: pgmap v729: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:05:06.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:05 smithi155 ceph-mon[34921]: pgmap v729: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-19T09:05:06.256 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T09:05:06.256 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:05:06.256 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 42, 2024-09-19T09:05:06.256 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 41, 2024-09-19T09:05:06.256 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 152416, 2024-09-19T09:05:06.257 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 24016, 2024-09-19T09:05:06.257 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 4, 2024-09-19T09:05:06.257 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 0, 2024-09-19T09:05:06.257 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.007854122, 2024-09-19T09:05:06.257 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.002713109, 2024-09-19T09:05:06.258 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.005481625, 2024-09-19T09:05:06.258 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:05:06.258 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:05:06.258 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 40, 2024-09-19T09:05:06.258 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.002487018, 2024-09-19T09:05:06.258 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000062175 2024-09-19T09:05:06.258 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:06.259 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:05:06.259 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:06.259 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:06.259 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:06.259 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:06.259 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 152416, 2024-09-19T09:05:06.259 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 24016 2024-09-19T09:05:06.259 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:06.259 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:05:06.260 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 1, 2024-09-19T09:05:06.260 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 31, 2024-09-19T09:05:06.260 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 160, 2024-09-19T09:05:06.260 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 84048, 2024-09-19T09:05:06.260 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 3, 2024-09-19T09:05:06.260 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 2, 2024-09-19T09:05:06.260 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.003402734, 2024-09-19T09:05:06.260 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.001754760, 2024-09-19T09:05:06.261 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.001217035, 2024-09-19T09:05:06.261 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:05:06.261 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:05:06.261 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 29, 2024-09-19T09:05:06.261 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.001553675, 2024-09-19T09:05:06.261 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000053575 2024-09-19T09:05:06.261 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:06.261 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:05:06.262 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:06.262 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:06.262 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:06.262 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:06.262 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:05:06.262 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 84048 2024-09-19T09:05:06.263 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:06.263 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:05:06.263 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 4, 2024-09-19T09:05:06.263 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 4, 2024-09-19T09:05:06.263 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 3072, 2024-09-19T09:05:06.263 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 448, 2024-09-19T09:05:06.263 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 2, 2024-09-19T09:05:06.263 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 1, 2024-09-19T09:05:06.264 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.002382542, 2024-09-19T09:05:06.264 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.000046643, 2024-09-19T09:05:06.264 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.002315304, 2024-09-19T09:05:06.264 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T09:05:06.264 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:05:06.265 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 3, 2024-09-19T09:05:06.265 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.004336772, 2024-09-19T09:05:06.265 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.001445590 2024-09-19T09:05:06.265 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:06.265 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:05:06.265 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:06.265 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:06.266 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:06.266 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:06.266 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 3072, 2024-09-19T09:05:06.266 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T09:05:06.266 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:06.266 INFO:teuthology.orchestra.run.smithi019.stdout: "cct": { 2024-09-19T09:05:06.266 INFO:teuthology.orchestra.run.smithi019.stdout: "total_workers": 0, 2024-09-19T09:05:06.267 INFO:teuthology.orchestra.run.smithi019.stdout: "unhealthy_workers": 0 2024-09-19T09:05:06.267 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:06.267 INFO:teuthology.orchestra.run.smithi019.stdout: "mempool": { 2024-09-19T09:05:06.267 INFO:teuthology.orchestra.run.smithi019.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:05:06.267 INFO:teuthology.orchestra.run.smithi019.stdout: "bloom_filter_items": 0, 2024-09-19T09:05:06.267 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:05:06.267 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:05:06.268 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:05:06.268 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:05:06.268 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:05:06.268 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:05:06.268 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:05:06.268 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:05:06.268 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:05:06.268 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:05:06.269 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:05:06.269 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:05:06.269 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:05:06.269 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_items": 0, 2024-09-19T09:05:06.269 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:05:06.269 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_blob_items": 0, 2024-09-19T09:05:06.269 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:05:06.270 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:05:06.270 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:05:06.270 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:05:06.270 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:05:06.270 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:05:06.270 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:05:06.270 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_txc_items": 0, 2024-09-19T09:05:06.271 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:05:06.271 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:05:06.271 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:05:06.271 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_items": 0, 2024-09-19T09:05:06.271 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_bytes": 0, 2024-09-19T09:05:06.271 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_items": 0, 2024-09-19T09:05:06.271 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:05:06.271 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:05:06.272 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:05:06.272 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:05:06.272 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_anon_bytes": 148039, 2024-09-19T09:05:06.272 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_anon_items": 25, 2024-09-19T09:05:06.272 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:05:06.272 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_meta_items": 0, 2024-09-19T09:05:06.272 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_bytes": 0, 2024-09-19T09:05:06.273 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_items": 0, 2024-09-19T09:05:06.273 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:05:06.273 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mapbl_items": 0, 2024-09-19T09:05:06.273 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:05:06.273 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pglog_items": 0, 2024-09-19T09:05:06.273 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_bytes": 0, 2024-09-19T09:05:06.273 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_items": 0, 2024-09-19T09:05:06.274 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:05:06.274 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:05:06.274 INFO:teuthology.orchestra.run.smithi019.stdout: "pgmap_bytes": 0, 2024-09-19T09:05:06.274 INFO:teuthology.orchestra.run.smithi019.stdout: "pgmap_items": 0, 2024-09-19T09:05:06.274 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_co_bytes": 928, 2024-09-19T09:05:06.274 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_co_items": 2, 2024-09-19T09:05:06.274 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_1_bytes": 0, 2024-09-19T09:05:06.274 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_1_items": 0, 2024-09-19T09:05:06.275 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_2_bytes": 0, 2024-09-19T09:05:06.275 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_2_items": 0 2024-09-19T09:05:06.275 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:06.275 INFO:teuthology.orchestra.run.smithi019.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:05:06.275 INFO:teuthology.orchestra.run.smithi019.stdout: "val": 0, 2024-09-19T09:05:06.275 INFO:teuthology.orchestra.run.smithi019.stdout: "max": 104857600, 2024-09-19T09:05:06.275 INFO:teuthology.orchestra.run.smithi019.stdout: "get_started": 0, 2024-09-19T09:05:06.276 INFO:teuthology.orchestra.run.smithi019.stdout: "get": 43, 2024-09-19T09:05:06.276 INFO:teuthology.orchestra.run.smithi019.stdout: "get_sum": 146526, 2024-09-19T09:05:06.276 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:06.276 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_success": 43, 2024-09-19T09:05:06.276 INFO:teuthology.orchestra.run.smithi019.stdout: "take": 0, 2024-09-19T09:05:06.276 INFO:teuthology.orchestra.run.smithi019.stdout: "take_sum": 0, 2024-09-19T09:05:06.276 INFO:teuthology.orchestra.run.smithi019.stdout: "put": 43, 2024-09-19T09:05:06.277 INFO:teuthology.orchestra.run.smithi019.stdout: "put_sum": 146526, 2024-09-19T09:05:06.277 INFO:teuthology.orchestra.run.smithi019.stdout: "wait": { 2024-09-19T09:05:06.277 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:06.277 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:06.277 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:06.277 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:06.277 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:06.278 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T09:05:07.000 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-19T09:05:07.000 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-19T09:05:07.000 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-09-19T09:05:07.001 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-09-19T09:05:07.001 WARNING:tasks.check_counter:Counter 'mds.dir_split' not found on daemon mds.g 2024-09-19T09:05:07.001 DEBUG:tasks.check_counter:Getting stats from j 2024-09-19T09:05:07.001 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-19T09:05:07.264 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:07.750 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-19T09:05:07.750 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:05:07.750 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 2538, 2024-09-19T09:05:07.750 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 2540, 2024-09-19T09:05:07.750 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 719469, 2024-09-19T09:05:07.750 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 807091, 2024-09-19T09:05:07.751 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 6, 2024-09-19T09:05:07.751 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 2, 2024-09-19T09:05:07.751 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.191940271, 2024-09-19T09:05:07.751 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.056023550, 2024-09-19T09:05:07.751 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.050471241, 2024-09-19T09:05:07.751 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.070351371, 2024-09-19T09:05:07.751 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:05:07.751 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 2538, 2024-09-19T09:05:07.752 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.081935776, 2024-09-19T09:05:07.752 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000032283 2024-09-19T09:05:07.752 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.752 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:05:07.752 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.752 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.752 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.752 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.753 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:05:07.753 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:05:07.753 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.753 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:05:07.753 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 283, 2024-09-19T09:05:07.753 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 263, 2024-09-19T09:05:07.753 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 887388, 2024-09-19T09:05:07.753 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 155658, 2024-09-19T09:05:07.754 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 3, 2024-09-19T09:05:07.754 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 2, 2024-09-19T09:05:07.754 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.033018701, 2024-09-19T09:05:07.754 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.012452261, 2024-09-19T09:05:07.754 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.026674195, 2024-09-19T09:05:07.754 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.000061505, 2024-09-19T09:05:07.754 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:05:07.754 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 262, 2024-09-19T09:05:07.755 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.012261598, 2024-09-19T09:05:07.755 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000046799 2024-09-19T09:05:07.755 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.755 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:05:07.755 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.755 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.755 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.755 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.755 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 886832, 2024-09-19T09:05:07.756 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 154960 2024-09-19T09:05:07.756 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.756 INFO:teuthology.orchestra.run.smithi019.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:05:07.756 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_messages": 7, 2024-09-19T09:05:07.756 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages": 193, 2024-09-19T09:05:07.756 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_bytes": 3660, 2024-09-19T09:05:07.756 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_bytes": 494718, 2024-09-19T09:05:07.756 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_created_connections": 5, 2024-09-19T09:05:07.757 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_active_connections": 3, 2024-09-19T09:05:07.757 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_total_time": 0.016868405, 2024-09-19T09:05:07.757 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_send_time": 0.010885710, 2024-09-19T09:05:07.757 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_recv_time": 0.004232225, 2024-09-19T09:05:07.757 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_running_fast_dispatch_time": 0.000022580, 2024-09-19T09:05:07.757 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:05:07.757 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 192, 2024-09-19T09:05:07.757 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.013996331, 2024-09-19T09:05:07.758 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000072897 2024-09-19T09:05:07.758 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.758 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:05:07.758 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.758 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.758 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.758 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.758 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_recv_encrypted_bytes": 3392, 2024-09-19T09:05:07.759 INFO:teuthology.orchestra.run.smithi019.stdout: "msgr_send_encrypted_bytes": 494400 2024-09-19T09:05:07.759 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.759 INFO:teuthology.orchestra.run.smithi019.stdout: "cct": { 2024-09-19T09:05:07.759 INFO:teuthology.orchestra.run.smithi019.stdout: "total_workers": 1, 2024-09-19T09:05:07.759 INFO:teuthology.orchestra.run.smithi019.stdout: "unhealthy_workers": 0 2024-09-19T09:05:07.759 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.759 INFO:teuthology.orchestra.run.smithi019.stdout: "finisher-MDSRank": { 2024-09-19T09:05:07.759 INFO:teuthology.orchestra.run.smithi019.stdout: "queue_len": 0, 2024-09-19T09:05:07.759 INFO:teuthology.orchestra.run.smithi019.stdout: "complete_latency": { 2024-09-19T09:05:07.760 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 4282, 2024-09-19T09:05:07.760 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.107129435, 2024-09-19T09:05:07.760 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000025018 2024-09-19T09:05:07.760 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:07.760 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.760 INFO:teuthology.orchestra.run.smithi019.stdout: "finisher-PurgeQueue": { 2024-09-19T09:05:07.760 INFO:teuthology.orchestra.run.smithi019.stdout: "queue_len": 0, 2024-09-19T09:05:07.760 INFO:teuthology.orchestra.run.smithi019.stdout: "complete_latency": { 2024-09-19T09:05:07.761 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.761 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.761 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.761 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:07.761 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.761 INFO:teuthology.orchestra.run.smithi019.stdout: "mds": { 2024-09-19T09:05:07.761 INFO:teuthology.orchestra.run.smithi019.stdout: "request": 0, 2024-09-19T09:05:07.761 INFO:teuthology.orchestra.run.smithi019.stdout: "reply": 0, 2024-09-19T09:05:07.762 INFO:teuthology.orchestra.run.smithi019.stdout: "reply_latency": { 2024-09-19T09:05:07.762 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.762 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.762 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.762 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.762 INFO:teuthology.orchestra.run.smithi019.stdout: "slow_reply": 0, 2024-09-19T09:05:07.762 INFO:teuthology.orchestra.run.smithi019.stdout: "forward": 0, 2024-09-19T09:05:07.762 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_fetch_complete": 0, 2024-09-19T09:05:07.762 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_fetch_keys": 0, 2024-09-19T09:05:07.763 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_commit": 0, 2024-09-19T09:05:07.763 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_split": 0, 2024-09-19T09:05:07.763 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_merge": 0, 2024-09-19T09:05:07.763 INFO:teuthology.orchestra.run.smithi019.stdout: "inodes": 0, 2024-09-19T09:05:07.763 INFO:teuthology.orchestra.run.smithi019.stdout: "inodes_top": 0, 2024-09-19T09:05:07.763 INFO:teuthology.orchestra.run.smithi019.stdout: "inodes_bottom": 0, 2024-09-19T09:05:07.763 INFO:teuthology.orchestra.run.smithi019.stdout: "inodes_pin_tail": 0, 2024-09-19T09:05:07.763 INFO:teuthology.orchestra.run.smithi019.stdout: "inodes_pinned": 0, 2024-09-19T09:05:07.764 INFO:teuthology.orchestra.run.smithi019.stdout: "inodes_expired": 0, 2024-09-19T09:05:07.764 INFO:teuthology.orchestra.run.smithi019.stdout: "inodes_with_caps": 0, 2024-09-19T09:05:07.764 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": 0, 2024-09-19T09:05:07.764 INFO:teuthology.orchestra.run.smithi019.stdout: "subtrees": 1, 2024-09-19T09:05:07.764 INFO:teuthology.orchestra.run.smithi019.stdout: "traverse": 0, 2024-09-19T09:05:07.764 INFO:teuthology.orchestra.run.smithi019.stdout: "traverse_hit": 0, 2024-09-19T09:05:07.764 INFO:teuthology.orchestra.run.smithi019.stdout: "traverse_forward": 0, 2024-09-19T09:05:07.764 INFO:teuthology.orchestra.run.smithi019.stdout: "traverse_discover": 0, 2024-09-19T09:05:07.765 INFO:teuthology.orchestra.run.smithi019.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:05:07.765 INFO:teuthology.orchestra.run.smithi019.stdout: "traverse_remote_ino": 0, 2024-09-19T09:05:07.765 INFO:teuthology.orchestra.run.smithi019.stdout: "traverse_lock": 0, 2024-09-19T09:05:07.765 INFO:teuthology.orchestra.run.smithi019.stdout: "load_cent": 0, 2024-09-19T09:05:07.765 INFO:teuthology.orchestra.run.smithi019.stdout: "q": 0, 2024-09-19T09:05:07.765 INFO:teuthology.orchestra.run.smithi019.stdout: "exported": 0, 2024-09-19T09:05:07.765 INFO:teuthology.orchestra.run.smithi019.stdout: "exported_inodes": 0, 2024-09-19T09:05:07.765 INFO:teuthology.orchestra.run.smithi019.stdout: "imported": 0, 2024-09-19T09:05:07.766 INFO:teuthology.orchestra.run.smithi019.stdout: "imported_inodes": 0, 2024-09-19T09:05:07.766 INFO:teuthology.orchestra.run.smithi019.stdout: "openino_dir_fetch": 0, 2024-09-19T09:05:07.766 INFO:teuthology.orchestra.run.smithi019.stdout: "openino_backtrace_fetch": 0, 2024-09-19T09:05:07.766 INFO:teuthology.orchestra.run.smithi019.stdout: "openino_peer_discover": 0, 2024-09-19T09:05:07.766 INFO:teuthology.orchestra.run.smithi019.stdout: "root_rfiles": 0, 2024-09-19T09:05:07.766 INFO:teuthology.orchestra.run.smithi019.stdout: "root_rbytes": 0, 2024-09-19T09:05:07.766 INFO:teuthology.orchestra.run.smithi019.stdout: "root_rsnaps": 0, 2024-09-19T09:05:07.766 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T09:05:07.767 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_set_tag": 0, 2024-09-19T09:05:07.767 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:05:07.767 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:05:07.767 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:05:07.767 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:05:07.767 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:05:07.767 INFO:teuthology.orchestra.run.smithi019.stdout: "scrub_file_inodes": 0, 2024-09-19T09:05:07.767 INFO:teuthology.orchestra.run.smithi019.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:05:07.768 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T09:05:07.768 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_cap_op_grant": 0, 2024-09-19T09:05:07.768 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:05:07.768 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:05:07.768 INFO:teuthology.orchestra.run.smithi019.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:05:07.768 INFO:teuthology.orchestra.run.smithi019.stdout: "handle_client_caps": 0, 2024-09-19T09:05:07.768 INFO:teuthology.orchestra.run.smithi019.stdout: "handle_client_caps_dirty": 0, 2024-09-19T09:05:07.768 INFO:teuthology.orchestra.run.smithi019.stdout: "handle_client_cap_release": 0, 2024-09-19T09:05:07.769 INFO:teuthology.orchestra.run.smithi019.stdout: "process_request_cap_release": 0 2024-09-19T09:05:07.769 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.769 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_cache": { 2024-09-19T09:05:07.769 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_update": 0, 2024-09-19T09:05:07.769 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_update_receipt": 0, 2024-09-19T09:05:07.769 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_try_discover": 0, 2024-09-19T09:05:07.769 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_send_discover": 0, 2024-09-19T09:05:07.769 INFO:teuthology.orchestra.run.smithi019.stdout: "dir_handle_discover": 0, 2024-09-19T09:05:07.769 INFO:teuthology.orchestra.run.smithi019.stdout: "num_strays": 0, 2024-09-19T09:05:07.770 INFO:teuthology.orchestra.run.smithi019.stdout: "num_strays_delayed": 0, 2024-09-19T09:05:07.770 INFO:teuthology.orchestra.run.smithi019.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:05:07.770 INFO:teuthology.orchestra.run.smithi019.stdout: "strays_created": 0, 2024-09-19T09:05:07.770 INFO:teuthology.orchestra.run.smithi019.stdout: "strays_enqueued": 0, 2024-09-19T09:05:07.770 INFO:teuthology.orchestra.run.smithi019.stdout: "strays_reintegrated": 0, 2024-09-19T09:05:07.770 INFO:teuthology.orchestra.run.smithi019.stdout: "strays_migrated": 0, 2024-09-19T09:05:07.770 INFO:teuthology.orchestra.run.smithi019.stdout: "num_recovering_processing": 0, 2024-09-19T09:05:07.770 INFO:teuthology.orchestra.run.smithi019.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:05:07.771 INFO:teuthology.orchestra.run.smithi019.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:05:07.771 INFO:teuthology.orchestra.run.smithi019.stdout: "recovery_started": 0, 2024-09-19T09:05:07.771 INFO:teuthology.orchestra.run.smithi019.stdout: "recovery_completed": 0, 2024-09-19T09:05:07.771 INFO:teuthology.orchestra.run.smithi019.stdout: "ireq_quiesce_path": 0, 2024-09-19T09:05:07.771 INFO:teuthology.orchestra.run.smithi019.stdout: "ireq_quiesce_inode": 0, 2024-09-19T09:05:07.771 INFO:teuthology.orchestra.run.smithi019.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:05:07.771 INFO:teuthology.orchestra.run.smithi019.stdout: "ireq_exportdir": 0, 2024-09-19T09:05:07.771 INFO:teuthology.orchestra.run.smithi019.stdout: "ireq_flush": 0, 2024-09-19T09:05:07.772 INFO:teuthology.orchestra.run.smithi019.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:05:07.772 INFO:teuthology.orchestra.run.smithi019.stdout: "ireq_fragstats": 0, 2024-09-19T09:05:07.772 INFO:teuthology.orchestra.run.smithi019.stdout: "ireq_inodestats": 0 2024-09-19T09:05:07.772 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.772 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_log": { 2024-09-19T09:05:07.772 INFO:teuthology.orchestra.run.smithi019.stdout: "evlrg": 0, 2024-09-19T09:05:07.772 INFO:teuthology.orchestra.run.smithi019.stdout: "evadd": 0, 2024-09-19T09:05:07.772 INFO:teuthology.orchestra.run.smithi019.stdout: "evex": 0, 2024-09-19T09:05:07.773 INFO:teuthology.orchestra.run.smithi019.stdout: "evtrm": 0, 2024-09-19T09:05:07.773 INFO:teuthology.orchestra.run.smithi019.stdout: "ev": 5, 2024-09-19T09:05:07.773 INFO:teuthology.orchestra.run.smithi019.stdout: "evexg": 0, 2024-09-19T09:05:07.773 INFO:teuthology.orchestra.run.smithi019.stdout: "evexd": 0, 2024-09-19T09:05:07.773 INFO:teuthology.orchestra.run.smithi019.stdout: "segadd": 0, 2024-09-19T09:05:07.773 INFO:teuthology.orchestra.run.smithi019.stdout: "segex": 0, 2024-09-19T09:05:07.773 INFO:teuthology.orchestra.run.smithi019.stdout: "segtrm": 0, 2024-09-19T09:05:07.773 INFO:teuthology.orchestra.run.smithi019.stdout: "seg": 2, 2024-09-19T09:05:07.774 INFO:teuthology.orchestra.run.smithi019.stdout: "segmjr": 2, 2024-09-19T09:05:07.774 INFO:teuthology.orchestra.run.smithi019.stdout: "segexg": 0, 2024-09-19T09:05:07.774 INFO:teuthology.orchestra.run.smithi019.stdout: "segexd": 0, 2024-09-19T09:05:07.774 INFO:teuthology.orchestra.run.smithi019.stdout: "expos": 4194304, 2024-09-19T09:05:07.774 INFO:teuthology.orchestra.run.smithi019.stdout: "wrpos": 4195734, 2024-09-19T09:05:07.774 INFO:teuthology.orchestra.run.smithi019.stdout: "rdpos": 4195593, 2024-09-19T09:05:07.774 INFO:teuthology.orchestra.run.smithi019.stdout: "jlat": { 2024-09-19T09:05:07.774 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.775 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.775 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.775 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.775 INFO:teuthology.orchestra.run.smithi019.stdout: "replayed": 5 2024-09-19T09:05:07.775 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.775 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_mem": { 2024-09-19T09:05:07.775 INFO:teuthology.orchestra.run.smithi019.stdout: "ino": 3, 2024-09-19T09:05:07.775 INFO:teuthology.orchestra.run.smithi019.stdout: "ino+": 3, 2024-09-19T09:05:07.775 INFO:teuthology.orchestra.run.smithi019.stdout: "ino-": 0, 2024-09-19T09:05:07.776 INFO:teuthology.orchestra.run.smithi019.stdout: "dir": 1, 2024-09-19T09:05:07.776 INFO:teuthology.orchestra.run.smithi019.stdout: "dir+": 1, 2024-09-19T09:05:07.776 INFO:teuthology.orchestra.run.smithi019.stdout: "dir-": 0, 2024-09-19T09:05:07.776 INFO:teuthology.orchestra.run.smithi019.stdout: "dn": 0, 2024-09-19T09:05:07.776 INFO:teuthology.orchestra.run.smithi019.stdout: "dn+": 0, 2024-09-19T09:05:07.776 INFO:teuthology.orchestra.run.smithi019.stdout: "dn-": 0, 2024-09-19T09:05:07.776 INFO:teuthology.orchestra.run.smithi019.stdout: "cap": 0, 2024-09-19T09:05:07.776 INFO:teuthology.orchestra.run.smithi019.stdout: "cap+": 0, 2024-09-19T09:05:07.777 INFO:teuthology.orchestra.run.smithi019.stdout: "cap-": 0, 2024-09-19T09:05:07.777 INFO:teuthology.orchestra.run.smithi019.stdout: "rss": 48704, 2024-09-19T09:05:07.777 INFO:teuthology.orchestra.run.smithi019.stdout: "heap": 215328 2024-09-19T09:05:07.777 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.777 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_server": { 2024-09-19T09:05:07.777 INFO:teuthology.orchestra.run.smithi019.stdout: "dispatch_client_request": 0, 2024-09-19T09:05:07.777 INFO:teuthology.orchestra.run.smithi019.stdout: "dispatch_server_request": 0, 2024-09-19T09:05:07.777 INFO:teuthology.orchestra.run.smithi019.stdout: "handle_client_request": 0, 2024-09-19T09:05:07.778 INFO:teuthology.orchestra.run.smithi019.stdout: "handle_client_session": 0, 2024-09-19T09:05:07.778 INFO:teuthology.orchestra.run.smithi019.stdout: "handle_peer_request": 0, 2024-09-19T09:05:07.778 INFO:teuthology.orchestra.run.smithi019.stdout: "req_create_latency": { 2024-09-19T09:05:07.778 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.778 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.778 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.778 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.778 INFO:teuthology.orchestra.run.smithi019.stdout: "req_getattr_latency": { 2024-09-19T09:05:07.779 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.779 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.779 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.779 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.779 INFO:teuthology.orchestra.run.smithi019.stdout: "req_getfilelock_latency": { 2024-09-19T09:05:07.779 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.779 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.779 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.780 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.780 INFO:teuthology.orchestra.run.smithi019.stdout: "req_link_latency": { 2024-09-19T09:05:07.780 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.780 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.780 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.780 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.780 INFO:teuthology.orchestra.run.smithi019.stdout: "req_lookup_latency": { 2024-09-19T09:05:07.780 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.781 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.781 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.781 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.781 INFO:teuthology.orchestra.run.smithi019.stdout: "req_lookuphash_latency": { 2024-09-19T09:05:07.781 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.781 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.781 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.781 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.782 INFO:teuthology.orchestra.run.smithi019.stdout: "req_lookupino_latency": { 2024-09-19T09:05:07.782 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.782 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.782 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.782 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.782 INFO:teuthology.orchestra.run.smithi019.stdout: "req_lookupname_latency": { 2024-09-19T09:05:07.782 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.782 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.783 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.783 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.783 INFO:teuthology.orchestra.run.smithi019.stdout: "req_lookupparent_latency": { 2024-09-19T09:05:07.783 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.783 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.783 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.783 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.783 INFO:teuthology.orchestra.run.smithi019.stdout: "req_lookupsnap_latency": { 2024-09-19T09:05:07.784 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.784 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.784 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.784 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.784 INFO:teuthology.orchestra.run.smithi019.stdout: "req_lssnap_latency": { 2024-09-19T09:05:07.784 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.784 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.784 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.785 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.785 INFO:teuthology.orchestra.run.smithi019.stdout: "req_mkdir_latency": { 2024-09-19T09:05:07.785 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.785 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.786 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.786 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.786 INFO:teuthology.orchestra.run.smithi019.stdout: "req_mknod_latency": { 2024-09-19T09:05:07.786 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.786 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.786 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.786 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.787 INFO:teuthology.orchestra.run.smithi019.stdout: "req_mksnap_latency": { 2024-09-19T09:05:07.787 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.787 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.787 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.787 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.787 INFO:teuthology.orchestra.run.smithi019.stdout: "req_open_latency": { 2024-09-19T09:05:07.787 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.787 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.787 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.788 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.788 INFO:teuthology.orchestra.run.smithi019.stdout: "req_readdir_latency": { 2024-09-19T09:05:07.788 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.788 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.788 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.788 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.788 INFO:teuthology.orchestra.run.smithi019.stdout: "req_rename_latency": { 2024-09-19T09:05:07.789 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.789 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.789 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.789 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.789 INFO:teuthology.orchestra.run.smithi019.stdout: "req_renamesnap_latency": { 2024-09-19T09:05:07.789 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.789 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.789 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.789 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.790 INFO:teuthology.orchestra.run.smithi019.stdout: "req_snapdiff_latency": { 2024-09-19T09:05:07.790 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.790 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.790 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.790 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.790 INFO:teuthology.orchestra.run.smithi019.stdout: "req_rmdir_latency": { 2024-09-19T09:05:07.790 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.790 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.791 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.791 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.791 INFO:teuthology.orchestra.run.smithi019.stdout: "req_rmsnap_latency": { 2024-09-19T09:05:07.791 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.791 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.791 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.791 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.791 INFO:teuthology.orchestra.run.smithi019.stdout: "req_rmxattr_latency": { 2024-09-19T09:05:07.792 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.792 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.792 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.792 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.792 INFO:teuthology.orchestra.run.smithi019.stdout: "req_setattr_latency": { 2024-09-19T09:05:07.792 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.792 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.792 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.793 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.793 INFO:teuthology.orchestra.run.smithi019.stdout: "req_setdirlayout_latency": { 2024-09-19T09:05:07.793 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.793 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.793 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.793 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.793 INFO:teuthology.orchestra.run.smithi019.stdout: "req_setfilelock_latency": { 2024-09-19T09:05:07.793 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.794 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.794 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.794 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.794 INFO:teuthology.orchestra.run.smithi019.stdout: "req_setlayout_latency": { 2024-09-19T09:05:07.794 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.794 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.794 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.794 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.795 INFO:teuthology.orchestra.run.smithi019.stdout: "req_setxattr_latency": { 2024-09-19T09:05:07.795 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.795 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.795 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.795 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.795 INFO:teuthology.orchestra.run.smithi019.stdout: "req_symlink_latency": { 2024-09-19T09:05:07.796 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.796 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.796 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.796 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.796 INFO:teuthology.orchestra.run.smithi019.stdout: "req_unlink_latency": { 2024-09-19T09:05:07.796 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.796 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.796 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.797 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.797 INFO:teuthology.orchestra.run.smithi019.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:05:07.797 INFO:teuthology.orchestra.run.smithi019.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:05:07.797 INFO:teuthology.orchestra.run.smithi019.stdout: "req_getvxattr_latency": { 2024-09-19T09:05:07.797 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.797 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.797 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.797 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:07.798 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.798 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_sessions": { 2024-09-19T09:05:07.798 INFO:teuthology.orchestra.run.smithi019.stdout: "session_count": 1, 2024-09-19T09:05:07.798 INFO:teuthology.orchestra.run.smithi019.stdout: "session_add": 2, 2024-09-19T09:05:07.798 INFO:teuthology.orchestra.run.smithi019.stdout: "session_remove": 1, 2024-09-19T09:05:07.798 INFO:teuthology.orchestra.run.smithi019.stdout: "sessions_open": 2, 2024-09-19T09:05:07.798 INFO:teuthology.orchestra.run.smithi019.stdout: "sessions_stale": 0, 2024-09-19T09:05:07.798 INFO:teuthology.orchestra.run.smithi019.stdout: "total_load": 0, 2024-09-19T09:05:07.799 INFO:teuthology.orchestra.run.smithi019.stdout: "average_load": 0, 2024-09-19T09:05:07.799 INFO:teuthology.orchestra.run.smithi019.stdout: "avg_session_uptime": 2889, 2024-09-19T09:05:07.799 INFO:teuthology.orchestra.run.smithi019.stdout: "mdthresh_evicted": 0 2024-09-19T09:05:07.799 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.799 INFO:teuthology.orchestra.run.smithi019.stdout: "mempool": { 2024-09-19T09:05:07.799 INFO:teuthology.orchestra.run.smithi019.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:05:07.799 INFO:teuthology.orchestra.run.smithi019.stdout: "bloom_filter_items": 0, 2024-09-19T09:05:07.799 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:05:07.799 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:05:07.800 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:05:07.800 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:05:07.800 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:05:07.800 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:05:07.800 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:05:07.800 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:05:07.800 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:05:07.800 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:05:07.801 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:05:07.801 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:05:07.801 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:05:07.801 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_extent_items": 0, 2024-09-19T09:05:07.801 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:05:07.801 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_blob_items": 0, 2024-09-19T09:05:07.801 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:05:07.801 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:05:07.802 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:05:07.802 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:05:07.802 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:05:07.802 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:05:07.802 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:05:07.802 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_txc_items": 0, 2024-09-19T09:05:07.802 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:05:07.802 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:05:07.803 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:05:07.803 INFO:teuthology.orchestra.run.smithi019.stdout: "bluestore_writing_items": 0, 2024-09-19T09:05:07.803 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_bytes": 0, 2024-09-19T09:05:07.803 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_items": 0, 2024-09-19T09:05:07.803 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:05:07.803 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:05:07.803 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:05:07.803 INFO:teuthology.orchestra.run.smithi019.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:05:07.804 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_anon_bytes": 183102, 2024-09-19T09:05:07.804 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_anon_items": 48, 2024-09-19T09:05:07.804 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:05:07.804 INFO:teuthology.orchestra.run.smithi019.stdout: "buffer_meta_items": 0, 2024-09-19T09:05:07.804 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_bytes": 0, 2024-09-19T09:05:07.804 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_items": 0, 2024-09-19T09:05:07.804 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:05:07.804 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_mapbl_items": 0, 2024-09-19T09:05:07.805 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:05:07.805 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_pglog_items": 0, 2024-09-19T09:05:07.805 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_bytes": 7496, 2024-09-19T09:05:07.805 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_items": 154, 2024-09-19T09:05:07.805 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:05:07.805 INFO:teuthology.orchestra.run.smithi019.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:05:07.805 INFO:teuthology.orchestra.run.smithi019.stdout: "pgmap_bytes": 0, 2024-09-19T09:05:07.805 INFO:teuthology.orchestra.run.smithi019.stdout: "pgmap_items": 0, 2024-09-19T09:05:07.806 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_co_bytes": 8512, 2024-09-19T09:05:07.806 INFO:teuthology.orchestra.run.smithi019.stdout: "mds_co_items": 13, 2024-09-19T09:05:07.806 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_1_bytes": 0, 2024-09-19T09:05:07.806 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_1_items": 0, 2024-09-19T09:05:07.806 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_2_bytes": 0, 2024-09-19T09:05:07.806 INFO:teuthology.orchestra.run.smithi019.stdout: "unittest_2_items": 0 2024-09-19T09:05:07.806 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.806 INFO:teuthology.orchestra.run.smithi019.stdout: "objecter": { 2024-09-19T09:05:07.807 INFO:teuthology.orchestra.run.smithi019.stdout: "op_active": 0, 2024-09-19T09:05:07.807 INFO:teuthology.orchestra.run.smithi019.stdout: "op_laggy": 0, 2024-09-19T09:05:07.807 INFO:teuthology.orchestra.run.smithi019.stdout: "op_send": 2541, 2024-09-19T09:05:07.807 INFO:teuthology.orchestra.run.smithi019.stdout: "op_send_bytes": 21, 2024-09-19T09:05:07.807 INFO:teuthology.orchestra.run.smithi019.stdout: "op_resend": 3, 2024-09-19T09:05:07.807 INFO:teuthology.orchestra.run.smithi019.stdout: "op_reply": 2541, 2024-09-19T09:05:07.807 INFO:teuthology.orchestra.run.smithi019.stdout: "op_latency": { 2024-09-19T09:05:07.807 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 2541, 2024-09-19T09:05:07.808 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 2.160981985, 2024-09-19T09:05:07.808 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000850445 2024-09-19T09:05:07.808 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.808 INFO:teuthology.orchestra.run.smithi019.stdout: "op_inflight": 0, 2024-09-19T09:05:07.808 INFO:teuthology.orchestra.run.smithi019.stdout: "oplen_avg": { 2024-09-19T09:05:07.808 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 2541, 2024-09-19T09:05:07.808 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 2542 2024-09-19T09:05:07.808 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.809 INFO:teuthology.orchestra.run.smithi019.stdout: "op": 2541, 2024-09-19T09:05:07.809 INFO:teuthology.orchestra.run.smithi019.stdout: "op_r": 2541, 2024-09-19T09:05:07.809 INFO:teuthology.orchestra.run.smithi019.stdout: "op_w": 0, 2024-09-19T09:05:07.809 INFO:teuthology.orchestra.run.smithi019.stdout: "op_rmw": 0, 2024-09-19T09:05:07.809 INFO:teuthology.orchestra.run.smithi019.stdout: "op_pg": 0, 2024-09-19T09:05:07.809 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_stat": 1654, 2024-09-19T09:05:07.809 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_create": 0, 2024-09-19T09:05:07.809 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_read": 885, 2024-09-19T09:05:07.809 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_write": 0, 2024-09-19T09:05:07.810 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_writefull": 0, 2024-09-19T09:05:07.810 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_writesame": 0, 2024-09-19T09:05:07.810 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_append": 0, 2024-09-19T09:05:07.810 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_zero": 0, 2024-09-19T09:05:07.810 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_truncate": 0, 2024-09-19T09:05:07.810 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_delete": 0, 2024-09-19T09:05:07.810 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_mapext": 0, 2024-09-19T09:05:07.810 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_sparse_read": 0, 2024-09-19T09:05:07.811 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_clonerange": 0, 2024-09-19T09:05:07.811 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_getxattr": 1, 2024-09-19T09:05:07.811 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_setxattr": 0, 2024-09-19T09:05:07.811 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:05:07.811 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_rmxattr": 0, 2024-09-19T09:05:07.811 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:05:07.811 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_call": 0, 2024-09-19T09:05:07.811 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_watch": 0, 2024-09-19T09:05:07.812 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_notify": 0, 2024-09-19T09:05:07.812 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:05:07.812 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_pgls": 0, 2024-09-19T09:05:07.812 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:05:07.812 INFO:teuthology.orchestra.run.smithi019.stdout: "osdop_other": 0, 2024-09-19T09:05:07.812 INFO:teuthology.orchestra.run.smithi019.stdout: "linger_active": 0, 2024-09-19T09:05:07.813 INFO:teuthology.orchestra.run.smithi019.stdout: "linger_send": 0, 2024-09-19T09:05:07.813 INFO:teuthology.orchestra.run.smithi019.stdout: "linger_resend": 0, 2024-09-19T09:05:07.813 INFO:teuthology.orchestra.run.smithi019.stdout: "linger_ping": 0, 2024-09-19T09:05:07.813 INFO:teuthology.orchestra.run.smithi019.stdout: "poolop_active": 0, 2024-09-19T09:05:07.813 INFO:teuthology.orchestra.run.smithi019.stdout: "poolop_send": 0, 2024-09-19T09:05:07.813 INFO:teuthology.orchestra.run.smithi019.stdout: "poolop_resend": 0, 2024-09-19T09:05:07.813 INFO:teuthology.orchestra.run.smithi019.stdout: "poolstat_active": 0, 2024-09-19T09:05:07.813 INFO:teuthology.orchestra.run.smithi019.stdout: "poolstat_send": 0, 2024-09-19T09:05:07.814 INFO:teuthology.orchestra.run.smithi019.stdout: "poolstat_resend": 0, 2024-09-19T09:05:07.814 INFO:teuthology.orchestra.run.smithi019.stdout: "statfs_active": 0, 2024-09-19T09:05:07.814 INFO:teuthology.orchestra.run.smithi019.stdout: "statfs_send": 0, 2024-09-19T09:05:07.814 INFO:teuthology.orchestra.run.smithi019.stdout: "statfs_resend": 0, 2024-09-19T09:05:07.814 INFO:teuthology.orchestra.run.smithi019.stdout: "command_active": 0, 2024-09-19T09:05:07.814 INFO:teuthology.orchestra.run.smithi019.stdout: "command_send": 0, 2024-09-19T09:05:07.814 INFO:teuthology.orchestra.run.smithi019.stdout: "command_resend": 0, 2024-09-19T09:05:07.814 INFO:teuthology.orchestra.run.smithi019.stdout: "map_epoch": 88, 2024-09-19T09:05:07.815 INFO:teuthology.orchestra.run.smithi019.stdout: "map_full": 0, 2024-09-19T09:05:07.815 INFO:teuthology.orchestra.run.smithi019.stdout: "map_inc": 8, 2024-09-19T09:05:07.815 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_sessions": 4, 2024-09-19T09:05:07.816 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_session_open": 4, 2024-09-19T09:05:07.816 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_session_close": 0, 2024-09-19T09:05:07.816 INFO:teuthology.orchestra.run.smithi019.stdout: "osd_laggy": 0, 2024-09-19T09:05:07.816 INFO:teuthology.orchestra.run.smithi019.stdout: "omap_wr": 0, 2024-09-19T09:05:07.816 INFO:teuthology.orchestra.run.smithi019.stdout: "omap_rd": 2, 2024-09-19T09:05:07.816 INFO:teuthology.orchestra.run.smithi019.stdout: "omap_del": 0 2024-09-19T09:05:07.816 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.816 INFO:teuthology.orchestra.run.smithi019.stdout: "oft": { 2024-09-19T09:05:07.817 INFO:teuthology.orchestra.run.smithi019.stdout: "omap_total_objs": 0, 2024-09-19T09:05:07.817 INFO:teuthology.orchestra.run.smithi019.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:05:07.817 INFO:teuthology.orchestra.run.smithi019.stdout: "omap_total_updates": 0, 2024-09-19T09:05:07.817 INFO:teuthology.orchestra.run.smithi019.stdout: "omap_total_removes": 0 2024-09-19T09:05:07.817 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.817 INFO:teuthology.orchestra.run.smithi019.stdout: "osd-slow-ops": { 2024-09-19T09:05:07.817 INFO:teuthology.orchestra.run.smithi019.stdout: "slow_ops_count": 0 2024-09-19T09:05:07.817 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.818 INFO:teuthology.orchestra.run.smithi019.stdout: "purge_queue": { 2024-09-19T09:05:07.818 INFO:teuthology.orchestra.run.smithi019.stdout: "pq_executing_ops": 0, 2024-09-19T09:05:07.818 INFO:teuthology.orchestra.run.smithi019.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T09:05:07.818 INFO:teuthology.orchestra.run.smithi019.stdout: "pq_executing": 0, 2024-09-19T09:05:07.818 INFO:teuthology.orchestra.run.smithi019.stdout: "pq_executing_high_water": 0, 2024-09-19T09:05:07.818 INFO:teuthology.orchestra.run.smithi019.stdout: "pq_executed_ops": 0, 2024-09-19T09:05:07.818 INFO:teuthology.orchestra.run.smithi019.stdout: "pq_executed": 0, 2024-09-19T09:05:07.818 INFO:teuthology.orchestra.run.smithi019.stdout: "pq_item_in_journal": 0 2024-09-19T09:05:07.819 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.819 INFO:teuthology.orchestra.run.smithi019.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:05:07.819 INFO:teuthology.orchestra.run.smithi019.stdout: "val": 0, 2024-09-19T09:05:07.819 INFO:teuthology.orchestra.run.smithi019.stdout: "max": 104857600, 2024-09-19T09:05:07.819 INFO:teuthology.orchestra.run.smithi019.stdout: "get_started": 0, 2024-09-19T09:05:07.819 INFO:teuthology.orchestra.run.smithi019.stdout: "get": 2824, 2024-09-19T09:05:07.819 INFO:teuthology.orchestra.run.smithi019.stdout: "get_sum": 1338897, 2024-09-19T09:05:07.819 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:07.820 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_success": 2824, 2024-09-19T09:05:07.820 INFO:teuthology.orchestra.run.smithi019.stdout: "take": 0, 2024-09-19T09:05:07.820 INFO:teuthology.orchestra.run.smithi019.stdout: "take_sum": 0, 2024-09-19T09:05:07.820 INFO:teuthology.orchestra.run.smithi019.stdout: "put": 2824, 2024-09-19T09:05:07.820 INFO:teuthology.orchestra.run.smithi019.stdout: "put_sum": 1338897, 2024-09-19T09:05:07.820 INFO:teuthology.orchestra.run.smithi019.stdout: "wait": { 2024-09-19T09:05:07.820 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.820 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.821 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.821 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:07.821 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.821 INFO:teuthology.orchestra.run.smithi019.stdout: "throttle-objecter_bytes": { 2024-09-19T09:05:07.821 INFO:teuthology.orchestra.run.smithi019.stdout: "val": 0, 2024-09-19T09:05:07.821 INFO:teuthology.orchestra.run.smithi019.stdout: "max": 104857600, 2024-09-19T09:05:07.821 INFO:teuthology.orchestra.run.smithi019.stdout: "get_started": 0, 2024-09-19T09:05:07.821 INFO:teuthology.orchestra.run.smithi019.stdout: "get": 0, 2024-09-19T09:05:07.822 INFO:teuthology.orchestra.run.smithi019.stdout: "get_sum": 0, 2024-09-19T09:05:07.822 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:07.822 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_success": 0, 2024-09-19T09:05:07.822 INFO:teuthology.orchestra.run.smithi019.stdout: "take": 2541, 2024-09-19T09:05:07.822 INFO:teuthology.orchestra.run.smithi019.stdout: "take_sum": 1435, 2024-09-19T09:05:07.822 INFO:teuthology.orchestra.run.smithi019.stdout: "put": 2541, 2024-09-19T09:05:07.822 INFO:teuthology.orchestra.run.smithi019.stdout: "put_sum": 1435, 2024-09-19T09:05:07.822 INFO:teuthology.orchestra.run.smithi019.stdout: "wait": { 2024-09-19T09:05:07.823 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.823 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.823 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.823 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:07.823 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.823 INFO:teuthology.orchestra.run.smithi019.stdout: "throttle-objecter_ops": { 2024-09-19T09:05:07.823 INFO:teuthology.orchestra.run.smithi019.stdout: "val": 0, 2024-09-19T09:05:07.823 INFO:teuthology.orchestra.run.smithi019.stdout: "max": 1024, 2024-09-19T09:05:07.824 INFO:teuthology.orchestra.run.smithi019.stdout: "get_started": 0, 2024-09-19T09:05:07.824 INFO:teuthology.orchestra.run.smithi019.stdout: "get": 0, 2024-09-19T09:05:07.824 INFO:teuthology.orchestra.run.smithi019.stdout: "get_sum": 0, 2024-09-19T09:05:07.824 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:07.824 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_success": 0, 2024-09-19T09:05:07.824 INFO:teuthology.orchestra.run.smithi019.stdout: "take": 2541, 2024-09-19T09:05:07.824 INFO:teuthology.orchestra.run.smithi019.stdout: "take_sum": 2541, 2024-09-19T09:05:07.824 INFO:teuthology.orchestra.run.smithi019.stdout: "put": 2541, 2024-09-19T09:05:07.825 INFO:teuthology.orchestra.run.smithi019.stdout: "put_sum": 2541, 2024-09-19T09:05:07.825 INFO:teuthology.orchestra.run.smithi019.stdout: "wait": { 2024-09-19T09:05:07.825 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.825 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.825 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.825 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:07.825 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.825 INFO:teuthology.orchestra.run.smithi019.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:05:07.825 INFO:teuthology.orchestra.run.smithi019.stdout: "val": 0, 2024-09-19T09:05:07.826 INFO:teuthology.orchestra.run.smithi019.stdout: "max": 3758096384, 2024-09-19T09:05:07.826 INFO:teuthology.orchestra.run.smithi019.stdout: "get_started": 0, 2024-09-19T09:05:07.826 INFO:teuthology.orchestra.run.smithi019.stdout: "get": 0, 2024-09-19T09:05:07.826 INFO:teuthology.orchestra.run.smithi019.stdout: "get_sum": 0, 2024-09-19T09:05:07.826 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:07.826 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_success": 0, 2024-09-19T09:05:07.826 INFO:teuthology.orchestra.run.smithi019.stdout: "take": 0, 2024-09-19T09:05:07.826 INFO:teuthology.orchestra.run.smithi019.stdout: "take_sum": 0, 2024-09-19T09:05:07.827 INFO:teuthology.orchestra.run.smithi019.stdout: "put": 0, 2024-09-19T09:05:07.827 INFO:teuthology.orchestra.run.smithi019.stdout: "put_sum": 0, 2024-09-19T09:05:07.827 INFO:teuthology.orchestra.run.smithi019.stdout: "wait": { 2024-09-19T09:05:07.827 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.827 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.827 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.827 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:07.827 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-19T09:05:07.828 INFO:teuthology.orchestra.run.smithi019.stdout: "throttle-write_buf_throttle-0x562015dccb40": { 2024-09-19T09:05:07.828 INFO:teuthology.orchestra.run.smithi019.stdout: "val": 0, 2024-09-19T09:05:07.828 INFO:teuthology.orchestra.run.smithi019.stdout: "max": 3758096384, 2024-09-19T09:05:07.828 INFO:teuthology.orchestra.run.smithi019.stdout: "get_started": 0, 2024-09-19T09:05:07.828 INFO:teuthology.orchestra.run.smithi019.stdout: "get": 0, 2024-09-19T09:05:07.828 INFO:teuthology.orchestra.run.smithi019.stdout: "get_sum": 0, 2024-09-19T09:05:07.828 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:07.828 INFO:teuthology.orchestra.run.smithi019.stdout: "get_or_fail_success": 0, 2024-09-19T09:05:07.829 INFO:teuthology.orchestra.run.smithi019.stdout: "take": 0, 2024-09-19T09:05:07.829 INFO:teuthology.orchestra.run.smithi019.stdout: "take_sum": 0, 2024-09-19T09:05:07.829 INFO:teuthology.orchestra.run.smithi019.stdout: "put": 0, 2024-09-19T09:05:07.829 INFO:teuthology.orchestra.run.smithi019.stdout: "put_sum": 0, 2024-09-19T09:05:07.829 INFO:teuthology.orchestra.run.smithi019.stdout: "wait": { 2024-09-19T09:05:07.829 INFO:teuthology.orchestra.run.smithi019.stdout: "avgcount": 0, 2024-09-19T09:05:07.829 INFO:teuthology.orchestra.run.smithi019.stdout: "sum": 0.000000000, 2024-09-19T09:05:07.829 INFO:teuthology.orchestra.run.smithi019.stdout: "avgtime": 0.000000000 2024-09-19T09:05:07.829 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:07.830 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-19T09:05:07.830 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-19T09:05:07.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:07 smithi203 ceph-mon[35450]: pgmap v730: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:05:08.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:07 smithi019 ceph-mon[30976]: pgmap v730: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:05:08.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:07 smithi155 ceph-mon[34921]: pgmap v730: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-19T09:05:08.567 INFO:tasks.check_counter:Daemon mds.j mds.exported=0 2024-09-19T09:05:08.567 INFO:tasks.check_counter:Daemon mds.j mds.imported=0 2024-09-19T09:05:08.567 INFO:tasks.check_counter:Daemon mds.j mds_cache.dir_update=0 2024-09-19T09:05:08.567 INFO:tasks.check_counter:Daemon mds.j mds_cache.dir_update_receipt=0 2024-09-19T09:05:08.568 INFO:tasks.check_counter:Daemon mds.j mds.dir_split=0 2024-09-19T09:05:08.568 DEBUG:tasks.check_counter:Getting stats from b 2024-09-19T09:05:08.568 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-19T09:05:08.892 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:05:09.474 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-09-19T09:05:09.475 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:05:09.475 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 121379, 2024-09-19T09:05:09.475 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 134400, 2024-09-19T09:05:09.475 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 51341000, 2024-09-19T09:05:09.475 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 531413648, 2024-09-19T09:05:09.475 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 66, 2024-09-19T09:05:09.475 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 5, 2024-09-19T09:05:09.475 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 7.685298613, 2024-09-19T09:05:09.476 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 2.834992812, 2024-09-19T09:05:09.476 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 1.892972747, 2024-09-19T09:05:09.476 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 2.570966982, 2024-09-19T09:05:09.476 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:05:09.476 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 134398, 2024-09-19T09:05:09.476 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 50.048581167, 2024-09-19T09:05:09.476 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000372390 2024-09-19T09:05:09.476 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.477 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:05:09.477 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 39093, 2024-09-19T09:05:09.477 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.005809483, 2024-09-19T09:05:09.477 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000148 2024-09-19T09:05:09.477 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.477 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:05:09.477 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:05:09.477 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.478 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:05:09.478 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 364579, 2024-09-19T09:05:09.478 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 594511, 2024-09-19T09:05:09.478 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 155085260, 2024-09-19T09:05:09.478 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 595044342, 2024-09-19T09:05:09.478 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 19, 2024-09-19T09:05:09.478 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 6, 2024-09-19T09:05:09.478 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 24.024856076, 2024-09-19T09:05:09.479 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 10.662477596, 2024-09-19T09:05:09.479 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 129.824256941, 2024-09-19T09:05:09.479 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 3.741377336, 2024-09-19T09:05:09.479 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:05:09.479 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 594508, 2024-09-19T09:05:09.479 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 122.289868406, 2024-09-19T09:05:09.479 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000205699 2024-09-19T09:05:09.479 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.479 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:05:09.480 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 553655, 2024-09-19T09:05:09.480 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.072174395, 2024-09-19T09:05:09.480 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000130 2024-09-19T09:05:09.480 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.480 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 81054752, 2024-09-19T09:05:09.481 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 297355808 2024-09-19T09:05:09.481 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.481 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:05:09.481 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 77819, 2024-09-19T09:05:09.481 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 90985, 2024-09-19T09:05:09.481 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 30657908, 2024-09-19T09:05:09.481 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 456266257, 2024-09-19T09:05:09.481 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 191, 2024-09-19T09:05:09.482 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 6, 2024-09-19T09:05:09.482 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 6.235558005, 2024-09-19T09:05:09.482 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 2.762802304, 2024-09-19T09:05:09.482 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 1.445810514, 2024-09-19T09:05:09.482 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 1.771687156, 2024-09-19T09:05:09.482 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:05:09.482 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 90986, 2024-09-19T09:05:09.482 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 38.271186641, 2024-09-19T09:05:09.483 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000420627 2024-09-19T09:05:09.483 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.483 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:05:09.483 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 39520, 2024-09-19T09:05:09.483 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.006146441, 2024-09-19T09:05:09.483 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000155 2024-09-19T09:05:09.483 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.483 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 34928, 2024-09-19T09:05:09.484 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 503488 2024-09-19T09:05:09.484 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.484 INFO:teuthology.orchestra.run.smithi155.stdout: "cct": { 2024-09-19T09:05:09.484 INFO:teuthology.orchestra.run.smithi155.stdout: "total_workers": 1, 2024-09-19T09:05:09.484 INFO:teuthology.orchestra.run.smithi155.stdout: "unhealthy_workers": 0 2024-09-19T09:05:09.484 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.484 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-MDSRank": { 2024-09-19T09:05:09.484 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2024-09-19T09:05:09.485 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2024-09-19T09:05:09.485 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 101374, 2024-09-19T09:05:09.485 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 316.073074827, 2024-09-19T09:05:09.485 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.003117890 2024-09-19T09:05:09.485 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T09:05:09.485 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.485 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-PurgeQueue": { 2024-09-19T09:05:09.485 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2024-09-19T09:05:09.486 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2024-09-19T09:05:09.486 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 87623, 2024-09-19T09:05:09.486 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 68.133635377, 2024-09-19T09:05:09.486 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000777577 2024-09-19T09:05:09.486 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T09:05:09.486 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.486 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": { 2024-09-19T09:05:09.486 INFO:teuthology.orchestra.run.smithi155.stdout: "request": 152968, 2024-09-19T09:05:09.486 INFO:teuthology.orchestra.run.smithi155.stdout: "reply": 152941, 2024-09-19T09:05:09.487 INFO:teuthology.orchestra.run.smithi155.stdout: "reply_latency": { 2024-09-19T09:05:09.487 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 152941, 2024-09-19T09:05:09.487 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 1908.474733663, 2024-09-19T09:05:09.487 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.012478503 2024-09-19T09:05:09.487 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.487 INFO:teuthology.orchestra.run.smithi155.stdout: "slow_reply": 0, 2024-09-19T09:05:09.487 INFO:teuthology.orchestra.run.smithi155.stdout: "forward": 27, 2024-09-19T09:05:09.487 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_fetch_complete": 0, 2024-09-19T09:05:09.488 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_fetch_keys": 0, 2024-09-19T09:05:09.488 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_commit": 29481, 2024-09-19T09:05:09.488 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_split": 384, 2024-09-19T09:05:09.488 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_merge": 202, 2024-09-19T09:05:09.488 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes": 1987, 2024-09-19T09:05:09.488 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_top": 1377, 2024-09-19T09:05:09.488 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_bottom": 610, 2024-09-19T09:05:09.488 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pin_tail": 0, 2024-09-19T09:05:09.489 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pinned": 20, 2024-09-19T09:05:09.489 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_expired": 4, 2024-09-19T09:05:09.489 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_with_caps": 2, 2024-09-19T09:05:09.489 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": 2, 2024-09-19T09:05:09.489 INFO:teuthology.orchestra.run.smithi155.stdout: "subtrees": 3, 2024-09-19T09:05:09.489 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse": 203610, 2024-09-19T09:05:09.489 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_hit": 203127, 2024-09-19T09:05:09.489 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_forward": 27, 2024-09-19T09:05:09.490 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_discover": 1, 2024-09-19T09:05:09.490 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:05:09.490 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_remote_ino": 0, 2024-09-19T09:05:09.490 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_lock": 0, 2024-09-19T09:05:09.490 INFO:teuthology.orchestra.run.smithi155.stdout: "load_cent": 0, 2024-09-19T09:05:09.490 INFO:teuthology.orchestra.run.smithi155.stdout: "q": 0, 2024-09-19T09:05:09.490 INFO:teuthology.orchestra.run.smithi155.stdout: "exported": 1, 2024-09-19T09:05:09.490 INFO:teuthology.orchestra.run.smithi155.stdout: "exported_inodes": 2, 2024-09-19T09:05:09.491 INFO:teuthology.orchestra.run.smithi155.stdout: "imported": 1, 2024-09-19T09:05:09.491 INFO:teuthology.orchestra.run.smithi155.stdout: "imported_inodes": 1, 2024-09-19T09:05:09.491 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_dir_fetch": 0, 2024-09-19T09:05:09.491 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_backtrace_fetch": 149939, 2024-09-19T09:05:09.491 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_peer_discover": 0, 2024-09-19T09:05:09.491 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rfiles": 4, 2024-09-19T09:05:09.492 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rbytes": 234, 2024-09-19T09:05:09.492 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rsnaps": 0, 2024-09-19T09:05:09.492 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_backtrace_fetch": 149939, 2024-09-19T09:05:09.492 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_set_tag": 0, 2024-09-19T09:05:09.492 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:05:09.492 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:05:09.492 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_dir_inodes": 156, 2024-09-19T09:05:09.493 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_dir_base_inodes": 14, 2024-09-19T09:05:09.493 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_dirfrag_rstats": 142, 2024-09-19T09:05:09.493 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_file_inodes": 149783, 2024-09-19T09:05:09.493 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_inode_file_caps": 9, 2024-09-19T09:05:09.493 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_revoke": 34903, 2024-09-19T09:05:09.493 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_grant": 100394, 2024-09-19T09:05:09.493 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_trunc": 1, 2024-09-19T09:05:09.493 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:05:09.494 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:05:09.494 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_caps": 52631, 2024-09-19T09:05:09.494 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_caps_dirty": 50349, 2024-09-19T09:05:09.494 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_cap_release": 2102, 2024-09-19T09:05:09.494 INFO:teuthology.orchestra.run.smithi155.stdout: "process_request_cap_release": 52744 2024-09-19T09:05:09.494 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.494 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_cache": { 2024-09-19T09:05:09.494 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_update": 10279, 2024-09-19T09:05:09.495 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_update_receipt": 3, 2024-09-19T09:05:09.495 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_try_discover": 2, 2024-09-19T09:05:09.495 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_send_discover": 2, 2024-09-19T09:05:09.495 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_handle_discover": 10316, 2024-09-19T09:05:09.495 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays": 3, 2024-09-19T09:05:09.495 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_delayed": 0, 2024-09-19T09:05:09.495 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:05:09.495 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_created": 50039, 2024-09-19T09:05:09.496 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_enqueued": 50036, 2024-09-19T09:05:09.496 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_reintegrated": 0, 2024-09-19T09:05:09.496 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_migrated": 0, 2024-09-19T09:05:09.496 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_processing": 0, 2024-09-19T09:05:09.496 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:05:09.496 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:05:09.496 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_started": 0, 2024-09-19T09:05:09.496 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_completed": 0, 2024-09-19T09:05:09.497 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_quiesce_path": 10, 2024-09-19T09:05:09.497 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_quiesce_inode": 134585, 2024-09-19T09:05:09.497 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_enqueue_scrub": 14, 2024-09-19T09:05:09.497 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_exportdir": 1, 2024-09-19T09:05:09.497 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_flush": 0, 2024-09-19T09:05:09.497 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragmentdir": 773, 2024-09-19T09:05:09.497 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragstats": 0, 2024-09-19T09:05:09.497 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_inodestats": 0 2024-09-19T09:05:09.498 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.498 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_log": { 2024-09-19T09:05:09.498 INFO:teuthology.orchestra.run.smithi155.stdout: "evlrg": 6, 2024-09-19T09:05:09.498 INFO:teuthology.orchestra.run.smithi155.stdout: "evadd": 206570, 2024-09-19T09:05:09.498 INFO:teuthology.orchestra.run.smithi155.stdout: "evex": 206461, 2024-09-19T09:05:09.498 INFO:teuthology.orchestra.run.smithi155.stdout: "evtrm": 206461, 2024-09-19T09:05:09.498 INFO:teuthology.orchestra.run.smithi155.stdout: "ev": 109, 2024-09-19T09:05:09.498 INFO:teuthology.orchestra.run.smithi155.stdout: "evexg": 101, 2024-09-19T09:05:09.499 INFO:teuthology.orchestra.run.smithi155.stdout: "evexd": 6, 2024-09-19T09:05:09.499 INFO:teuthology.orchestra.run.smithi155.stdout: "segadd": 278, 2024-09-19T09:05:09.499 INFO:teuthology.orchestra.run.smithi155.stdout: "segex": 276, 2024-09-19T09:05:09.499 INFO:teuthology.orchestra.run.smithi155.stdout: "segtrm": 276, 2024-09-19T09:05:09.499 INFO:teuthology.orchestra.run.smithi155.stdout: "seg": 2, 2024-09-19T09:05:09.499 INFO:teuthology.orchestra.run.smithi155.stdout: "segmjr": 2, 2024-09-19T09:05:09.499 INFO:teuthology.orchestra.run.smithi155.stdout: "segexg": 1, 2024-09-19T09:05:09.499 INFO:teuthology.orchestra.run.smithi155.stdout: "segexd": 1, 2024-09-19T09:05:09.500 INFO:teuthology.orchestra.run.smithi155.stdout: "expos": 471612048, 2024-09-19T09:05:09.500 INFO:teuthology.orchestra.run.smithi155.stdout: "wrpos": 471853124, 2024-09-19T09:05:09.500 INFO:teuthology.orchestra.run.smithi155.stdout: "rdpos": 0, 2024-09-19T09:05:09.500 INFO:teuthology.orchestra.run.smithi155.stdout: "jlat": { 2024-09-19T09:05:09.500 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 34818, 2024-09-19T09:05:09.500 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 25744.378058955, 2024-09-19T09:05:09.500 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.739398531 2024-09-19T09:05:09.500 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.501 INFO:teuthology.orchestra.run.smithi155.stdout: "replayed": 0 2024-09-19T09:05:09.501 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.501 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_mem": { 2024-09-19T09:05:09.501 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 29, 2024-09-19T09:05:09.501 INFO:teuthology.orchestra.run.smithi155.stdout: "ino+": 50082, 2024-09-19T09:05:09.502 INFO:teuthology.orchestra.run.smithi155.stdout: "ino-": 50053, 2024-09-19T09:05:09.502 INFO:teuthology.orchestra.run.smithi155.stdout: "dir": 59, 2024-09-19T09:05:09.502 INFO:teuthology.orchestra.run.smithi155.stdout: "dir+": 3317, 2024-09-19T09:05:09.502 INFO:teuthology.orchestra.run.smithi155.stdout: "dir-": 3258, 2024-09-19T09:05:09.502 INFO:teuthology.orchestra.run.smithi155.stdout: "dn": 1987, 2024-09-19T09:05:09.502 INFO:teuthology.orchestra.run.smithi155.stdout: "dn+": 100099, 2024-09-19T09:05:09.502 INFO:teuthology.orchestra.run.smithi155.stdout: "dn-": 98112, 2024-09-19T09:05:09.502 INFO:teuthology.orchestra.run.smithi155.stdout: "cap": 2, 2024-09-19T09:05:09.502 INFO:teuthology.orchestra.run.smithi155.stdout: "cap+": 124737, 2024-09-19T09:05:09.503 INFO:teuthology.orchestra.run.smithi155.stdout: "cap-": 124735, 2024-09-19T09:05:09.503 INFO:teuthology.orchestra.run.smithi155.stdout: "rss": 251156, 2024-09-19T09:05:09.503 INFO:teuthology.orchestra.run.smithi155.stdout: "heap": 231712 2024-09-19T09:05:09.503 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.503 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_server": { 2024-09-19T09:05:09.503 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_client_request": 156222, 2024-09-19T09:05:09.503 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_server_request": 3, 2024-09-19T09:05:09.503 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_request": 152968, 2024-09-19T09:05:09.504 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_session": 22, 2024-09-19T09:05:09.504 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_peer_request": 22, 2024-09-19T09:05:09.504 INFO:teuthology.orchestra.run.smithi155.stdout: "req_create_latency": { 2024-09-19T09:05:09.504 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 50024, 2024-09-19T09:05:09.504 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 797.788632268, 2024-09-19T09:05:09.504 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.015948117 2024-09-19T09:05:09.504 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.505 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getattr_latency": { 2024-09-19T09:05:09.505 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 150, 2024-09-19T09:05:09.505 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.101607927, 2024-09-19T09:05:09.505 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000677386 2024-09-19T09:05:09.505 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.505 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getfilelock_latency": { 2024-09-19T09:05:09.505 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:09.505 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:09.505 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:09.506 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.506 INFO:teuthology.orchestra.run.smithi155.stdout: "req_link_latency": { 2024-09-19T09:05:09.506 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:09.506 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:09.506 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:09.506 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.506 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookup_latency": { 2024-09-19T09:05:09.506 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 50024, 2024-09-19T09:05:09.507 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 291.016332944, 2024-09-19T09:05:09.507 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.005817534 2024-09-19T09:05:09.507 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.507 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookuphash_latency": { 2024-09-19T09:05:09.507 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:09.507 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:09.507 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:09.508 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.508 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupino_latency": { 2024-09-19T09:05:09.508 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:09.508 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:09.508 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:09.508 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.508 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupname_latency": { 2024-09-19T09:05:09.508 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:09.509 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:09.509 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:09.509 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.509 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupparent_latency": { 2024-09-19T09:05:09.509 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:09.509 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:09.509 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:09.509 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.510 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupsnap_latency": { 2024-09-19T09:05:09.510 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:09.510 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:09.511 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:09.511 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.511 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lssnap_latency": { 2024-09-19T09:05:09.511 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:09.511 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:09.511 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:09.511 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.512 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mkdir_latency": { 2024-09-19T09:05:09.512 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 29, 2024-09-19T09:05:09.512 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.053415000, 2024-09-19T09:05:09.512 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.001841896 2024-09-19T09:05:09.512 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.512 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mknod_latency": { 2024-09-19T09:05:09.512 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:09.512 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:09.513 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:09.513 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.513 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mksnap_latency": { 2024-09-19T09:05:09.513 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:09.513 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:09.513 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:09.513 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.513 INFO:teuthology.orchestra.run.smithi155.stdout: "req_open_latency": { 2024-09-19T09:05:09.514 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1, 2024-09-19T09:05:09.514 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000367605, 2024-09-19T09:05:09.514 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000367605 2024-09-19T09:05:09.514 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.514 INFO:teuthology.orchestra.run.smithi155.stdout: "req_readdir_latency": { 2024-09-19T09:05:09.514 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 2616, 2024-09-19T09:05:09.514 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 115.948135936, 2024-09-19T09:05:09.514 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.044322681 2024-09-19T09:05:09.515 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.515 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rename_latency": { 2024-09-19T09:05:09.515 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 4, 2024-09-19T09:05:09.515 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.006344303, 2024-09-19T09:05:09.515 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.001586075 2024-09-19T09:05:09.515 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.515 INFO:teuthology.orchestra.run.smithi155.stdout: "req_renamesnap_latency": { 2024-09-19T09:05:09.515 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:09.516 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:09.516 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:09.516 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.516 INFO:teuthology.orchestra.run.smithi155.stdout: "req_snapdiff_latency": { 2024-09-19T09:05:09.516 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:09.516 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:09.516 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:09.516 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.517 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmdir_latency": { 2024-09-19T09:05:09.517 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 19, 2024-09-19T09:05:09.517 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.264348659, 2024-09-19T09:05:09.517 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.013913087 2024-09-19T09:05:09.517 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.517 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmsnap_latency": { 2024-09-19T09:05:09.517 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:09.518 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:09.518 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:09.518 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.518 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmxattr_latency": { 2024-09-19T09:05:09.518 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 3, 2024-09-19T09:05:09.518 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.011379215, 2024-09-19T09:05:09.518 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.003793071 2024-09-19T09:05:09.518 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.519 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setattr_latency": { 2024-09-19T09:05:09.519 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 4, 2024-09-19T09:05:09.519 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.007217886, 2024-09-19T09:05:09.519 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.001804471 2024-09-19T09:05:09.519 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.519 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setdirlayout_latency": { 2024-09-19T09:05:09.519 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:09.519 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:09.520 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:09.520 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.520 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setfilelock_latency": { 2024-09-19T09:05:09.520 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 22, 2024-09-19T09:05:09.520 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 10.028931293, 2024-09-19T09:05:09.520 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.455860513 2024-09-19T09:05:09.520 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.520 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setlayout_latency": { 2024-09-19T09:05:09.521 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:09.521 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:09.521 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:09.521 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.521 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setxattr_latency": { 2024-09-19T09:05:09.521 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 24, 2024-09-19T09:05:09.521 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.086451226, 2024-09-19T09:05:09.521 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.003602134 2024-09-19T09:05:09.522 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.522 INFO:teuthology.orchestra.run.smithi155.stdout: "req_symlink_latency": { 2024-09-19T09:05:09.522 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:09.522 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:09.522 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:09.522 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.522 INFO:teuthology.orchestra.run.smithi155.stdout: "req_unlink_latency": { 2024-09-19T09:05:09.522 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 50019, 2024-09-19T09:05:09.523 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 693.160977714, 2024-09-19T09:05:09.523 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.013857953 2024-09-19T09:05:09.523 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.523 INFO:teuthology.orchestra.run.smithi155.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:05:09.523 INFO:teuthology.orchestra.run.smithi155.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:05:09.523 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getvxattr_latency": { 2024-09-19T09:05:09.523 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 2, 2024-09-19T09:05:09.523 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000591687, 2024-09-19T09:05:09.524 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000295843 2024-09-19T09:05:09.524 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T09:05:09.524 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.524 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_sessions": { 2024-09-19T09:05:09.524 INFO:teuthology.orchestra.run.smithi155.stdout: "session_count": 1, 2024-09-19T09:05:09.524 INFO:teuthology.orchestra.run.smithi155.stdout: "session_add": 3, 2024-09-19T09:05:09.524 INFO:teuthology.orchestra.run.smithi155.stdout: "session_remove": 2, 2024-09-19T09:05:09.524 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_open": 1, 2024-09-19T09:05:09.525 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_stale": 0, 2024-09-19T09:05:09.525 INFO:teuthology.orchestra.run.smithi155.stdout: "total_load": 17907, 2024-09-19T09:05:09.525 INFO:teuthology.orchestra.run.smithi155.stdout: "average_load": 17907, 2024-09-19T09:05:09.525 INFO:teuthology.orchestra.run.smithi155.stdout: "avg_session_uptime": 778, 2024-09-19T09:05:09.525 INFO:teuthology.orchestra.run.smithi155.stdout: "mdthresh_evicted": 0 2024-09-19T09:05:09.525 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.525 INFO:teuthology.orchestra.run.smithi155.stdout: "mempool": { 2024-09-19T09:05:09.525 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:05:09.525 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_items": 0, 2024-09-19T09:05:09.526 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:05:09.526 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:05:09.526 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:05:09.526 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:05:09.526 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:05:09.526 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:05:09.526 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:05:09.526 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:05:09.527 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:05:09.527 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:05:09.527 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:05:09.527 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:05:09.527 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:05:09.527 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_extent_items": 0, 2024-09-19T09:05:09.527 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:05:09.527 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_blob_items": 0, 2024-09-19T09:05:09.528 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:05:09.528 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:05:09.528 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:05:09.528 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:05:09.528 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:05:09.528 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:05:09.528 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:05:09.528 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_items": 0, 2024-09-19T09:05:09.529 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:05:09.529 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:05:09.529 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:05:09.529 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_items": 0, 2024-09-19T09:05:09.529 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_bytes": 0, 2024-09-19T09:05:09.529 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_items": 0, 2024-09-19T09:05:09.529 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:05:09.529 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:05:09.530 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:05:09.530 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:05:09.530 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_bytes": 312014, 2024-09-19T09:05:09.530 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_items": 118, 2024-09-19T09:05:09.530 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_bytes": 176, 2024-09-19T09:05:09.530 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_items": 2, 2024-09-19T09:05:09.530 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_bytes": 0, 2024-09-19T09:05:09.530 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_items": 0, 2024-09-19T09:05:09.531 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:05:09.531 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_items": 0, 2024-09-19T09:05:09.531 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:05:09.531 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_items": 0, 2024-09-19T09:05:09.531 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_bytes": 7496, 2024-09-19T09:05:09.531 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_items": 154, 2024-09-19T09:05:09.531 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:05:09.531 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:05:09.532 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_bytes": 0, 2024-09-19T09:05:09.532 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_items": 0, 2024-09-19T09:05:09.532 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_bytes": 1666135, 2024-09-19T09:05:09.532 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_items": 23122, 2024-09-19T09:05:09.532 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_bytes": 0, 2024-09-19T09:05:09.532 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_items": 0, 2024-09-19T09:05:09.532 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_bytes": 0, 2024-09-19T09:05:09.532 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_items": 0 2024-09-19T09:05:09.533 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.533 INFO:teuthology.orchestra.run.smithi155.stdout: "objecter": { 2024-09-19T09:05:09.533 INFO:teuthology.orchestra.run.smithi155.stdout: "op_active": 0, 2024-09-19T09:05:09.533 INFO:teuthology.orchestra.run.smithi155.stdout: "op_laggy": 0, 2024-09-19T09:05:09.533 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send": 327895, 2024-09-19T09:05:09.533 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send_bytes": 600749748, 2024-09-19T09:05:09.533 INFO:teuthology.orchestra.run.smithi155.stdout: "op_resend": 37, 2024-09-19T09:05:09.534 INFO:teuthology.orchestra.run.smithi155.stdout: "op_reply": 327895, 2024-09-19T09:05:09.534 INFO:teuthology.orchestra.run.smithi155.stdout: "op_latency": { 2024-09-19T09:05:09.534 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 327895, 2024-09-19T09:05:09.534 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 29459.536554827, 2024-09-19T09:05:09.534 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.089844421 2024-09-19T09:05:09.534 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.534 INFO:teuthology.orchestra.run.smithi155.stdout: "op_inflight": 0, 2024-09-19T09:05:09.534 INFO:teuthology.orchestra.run.smithi155.stdout: "oplen_avg": { 2024-09-19T09:05:09.534 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 327897, 2024-09-19T09:05:09.535 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 488835 2024-09-19T09:05:09.535 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.535 INFO:teuthology.orchestra.run.smithi155.stdout: "op": 327897, 2024-09-19T09:05:09.535 INFO:teuthology.orchestra.run.smithi155.stdout: "op_r": 150456, 2024-09-19T09:05:09.535 INFO:teuthology.orchestra.run.smithi155.stdout: "op_w": 177441, 2024-09-19T09:05:09.535 INFO:teuthology.orchestra.run.smithi155.stdout: "op_rmw": 0, 2024-09-19T09:05:09.535 INFO:teuthology.orchestra.run.smithi155.stdout: "op_pg": 0, 2024-09-19T09:05:09.535 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_stat": 26179, 2024-09-19T09:05:09.535 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_create": 57847, 2024-09-19T09:05:09.536 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_read": 503, 2024-09-19T09:05:09.536 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_write": 35308, 2024-09-19T09:05:09.536 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writefull": 349, 2024-09-19T09:05:09.536 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writesame": 0, 2024-09-19T09:05:09.536 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_append": 0, 2024-09-19T09:05:09.536 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_zero": 0, 2024-09-19T09:05:09.536 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_truncate": 24, 2024-09-19T09:05:09.537 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_delete": 54061, 2024-09-19T09:05:09.537 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_mapext": 0, 2024-09-19T09:05:09.537 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_sparse_read": 0, 2024-09-19T09:05:09.537 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_clonerange": 0, 2024-09-19T09:05:09.537 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_getxattr": 149953, 2024-09-19T09:05:09.537 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_setxattr": 115693, 2024-09-19T09:05:09.537 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:05:09.537 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_rmxattr": 0, 2024-09-19T09:05:09.538 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:05:09.538 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_call": 0, 2024-09-19T09:05:09.538 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_watch": 0, 2024-09-19T09:05:09.538 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_notify": 0, 2024-09-19T09:05:09.538 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:05:09.538 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls": 0, 2024-09-19T09:05:09.538 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:05:09.538 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_other": 1, 2024-09-19T09:05:09.539 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_active": 0, 2024-09-19T09:05:09.539 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_send": 0, 2024-09-19T09:05:09.539 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_resend": 0, 2024-09-19T09:05:09.539 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_ping": 0, 2024-09-19T09:05:09.539 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_active": 0, 2024-09-19T09:05:09.539 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_send": 0, 2024-09-19T09:05:09.539 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_resend": 0, 2024-09-19T09:05:09.539 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_active": 0, 2024-09-19T09:05:09.539 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_send": 0, 2024-09-19T09:05:09.540 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_resend": 0, 2024-09-19T09:05:09.540 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_active": 0, 2024-09-19T09:05:09.540 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_send": 0, 2024-09-19T09:05:09.540 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_resend": 0, 2024-09-19T09:05:09.540 INFO:teuthology.orchestra.run.smithi155.stdout: "command_active": 0, 2024-09-19T09:05:09.540 INFO:teuthology.orchestra.run.smithi155.stdout: "command_send": 0, 2024-09-19T09:05:09.540 INFO:teuthology.orchestra.run.smithi155.stdout: "command_resend": 0, 2024-09-19T09:05:09.540 INFO:teuthology.orchestra.run.smithi155.stdout: "map_epoch": 88, 2024-09-19T09:05:09.541 INFO:teuthology.orchestra.run.smithi155.stdout: "map_full": 0, 2024-09-19T09:05:09.541 INFO:teuthology.orchestra.run.smithi155.stdout: "map_inc": 8, 2024-09-19T09:05:09.541 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_sessions": 12, 2024-09-19T09:05:09.541 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_open": 12, 2024-09-19T09:05:09.541 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_close": 0, 2024-09-19T09:05:09.541 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_laggy": 0, 2024-09-19T09:05:09.541 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_wr": 48032, 2024-09-19T09:05:09.542 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_rd": 0, 2024-09-19T09:05:09.542 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_del": 885 2024-09-19T09:05:09.542 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.542 INFO:teuthology.orchestra.run.smithi155.stdout: "oft": { 2024-09-19T09:05:09.542 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_objs": 1, 2024-09-19T09:05:09.542 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:05:09.542 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_updates": 0, 2024-09-19T09:05:09.542 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_removes": 0 2024-09-19T09:05:09.542 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.543 INFO:teuthology.orchestra.run.smithi155.stdout: "osd-slow-ops": { 2024-09-19T09:05:09.543 INFO:teuthology.orchestra.run.smithi155.stdout: "slow_ops_count": 133462 2024-09-19T09:05:09.543 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.543 INFO:teuthology.orchestra.run.smithi155.stdout: "purge_queue": { 2024-09-19T09:05:09.543 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops": 0, 2024-09-19T09:05:09.543 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops_high_water": 69, 2024-09-19T09:05:09.543 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing": 0, 2024-09-19T09:05:09.543 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_high_water": 6, 2024-09-19T09:05:09.544 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executed_ops": 50143, 2024-09-19T09:05:09.544 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executed": 50036, 2024-09-19T09:05:09.544 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_item_in_journal": 0 2024-09-19T09:05:09.544 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.544 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:05:09.544 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2024-09-19T09:05:09.544 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2024-09-19T09:05:09.544 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2024-09-19T09:05:09.545 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 563773, 2024-09-19T09:05:09.545 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 176174239, 2024-09-19T09:05:09.545 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:09.545 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 563773, 2024-09-19T09:05:09.545 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2024-09-19T09:05:09.545 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2024-09-19T09:05:09.545 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 563773, 2024-09-19T09:05:09.545 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 176174239, 2024-09-19T09:05:09.546 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2024-09-19T09:05:09.546 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:09.546 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:09.546 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:09.546 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T09:05:09.546 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.546 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_bytes": { 2024-09-19T09:05:09.546 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2024-09-19T09:05:09.546 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2024-09-19T09:05:09.547 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2024-09-19T09:05:09.547 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2024-09-19T09:05:09.547 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2024-09-19T09:05:09.547 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:09.547 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2024-09-19T09:05:09.547 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 327897, 2024-09-19T09:05:09.547 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 605803623, 2024-09-19T09:05:09.547 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 327897, 2024-09-19T09:05:09.548 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 605803623, 2024-09-19T09:05:09.548 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2024-09-19T09:05:09.548 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:09.548 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:09.548 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:09.548 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T09:05:09.548 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.548 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_ops": { 2024-09-19T09:05:09.549 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2024-09-19T09:05:09.549 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 1024, 2024-09-19T09:05:09.549 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2024-09-19T09:05:09.549 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2024-09-19T09:05:09.549 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2024-09-19T09:05:09.549 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:09.549 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2024-09-19T09:05:09.549 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 327897, 2024-09-19T09:05:09.550 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 327897, 2024-09-19T09:05:09.550 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 327897, 2024-09-19T09:05:09.550 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 327897, 2024-09-19T09:05:09.550 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2024-09-19T09:05:09.550 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:09.550 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:09.550 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:09.550 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T09:05:09.551 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.551 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:05:09.551 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2024-09-19T09:05:09.551 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2024-09-19T09:05:09.551 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2024-09-19T09:05:09.551 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 50036, 2024-09-19T09:05:09.551 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 5053726, 2024-09-19T09:05:09.551 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:09.551 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 50036, 2024-09-19T09:05:09.552 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2024-09-19T09:05:09.552 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2024-09-19T09:05:09.552 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 490, 2024-09-19T09:05:09.552 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 5053726, 2024-09-19T09:05:09.552 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2024-09-19T09:05:09.552 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:09.552 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:09.552 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:09.553 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T09:05:09.553 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:09.553 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle-0x562040d92960": { 2024-09-19T09:05:09.553 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2024-09-19T09:05:09.553 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2024-09-19T09:05:09.553 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2024-09-19T09:05:09.553 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 206570, 2024-09-19T09:05:09.553 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 467658820, 2024-09-19T09:05:09.554 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:09.554 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 206570, 2024-09-19T09:05:09.554 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2024-09-19T09:05:09.554 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2024-09-19T09:05:09.554 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 34818, 2024-09-19T09:05:09.554 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 467658820, 2024-09-19T09:05:09.554 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2024-09-19T09:05:09.554 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:09.555 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:09.555 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:09.555 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T09:05:09.555 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T09:05:09.555 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-09-19T09:05:09.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:09 smithi203 ceph-mon[35450]: pgmap v731: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:05:10.051 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:09 smithi155 ceph-mon[34921]: pgmap v731: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:05:10.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:09 smithi019 ceph-mon[30976]: pgmap v731: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-19T09:05:10.259 INFO:tasks.check_counter:Daemon mds.b mds.exported=1 2024-09-19T09:05:10.259 INFO:tasks.check_counter:Daemon mds.b mds.imported=1 2024-09-19T09:05:10.259 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=10279 2024-09-19T09:05:10.260 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=3 2024-09-19T09:05:10.260 INFO:tasks.check_counter:Daemon mds.b mds.dir_split=384 2024-09-19T09:05:10.260 DEBUG:tasks.check_counter:Getting stats from e 2024-09-19T09:05:10.260 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-19T09:05:10.506 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:05:11.021 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-09-19T09:05:11.022 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:05:11.022 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 318, 2024-09-19T09:05:11.022 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 318, 2024-09-19T09:05:11.022 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 6381369, 2024-09-19T09:05:11.022 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 100310, 2024-09-19T09:05:11.022 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 7, 2024-09-19T09:05:11.023 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 3, 2024-09-19T09:05:11.023 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.038542393, 2024-09-19T09:05:11.023 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.010431248, 2024-09-19T09:05:11.023 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.015669026, 2024-09-19T09:05:11.023 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.008589088, 2024-09-19T09:05:11.023 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:05:11.023 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 317, 2024-09-19T09:05:11.023 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.017630557, 2024-09-19T09:05:11.024 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000055616 2024-09-19T09:05:11.024 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.024 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:05:11.024 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.024 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.024 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.024 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.024 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 3072, 2024-09-19T09:05:11.025 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T09:05:11.025 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.025 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:05:11.025 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 140, 2024-09-19T09:05:11.025 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 135, 2024-09-19T09:05:11.025 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 12816872, 2024-09-19T09:05:11.025 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 71044, 2024-09-19T09:05:11.025 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 5, 2024-09-19T09:05:11.026 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 4, 2024-09-19T09:05:11.026 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.027999821, 2024-09-19T09:05:11.026 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.006052794, 2024-09-19T09:05:11.026 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.023586200, 2024-09-19T09:05:11.026 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.000648915, 2024-09-19T09:05:11.029 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:05:11.029 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 134, 2024-09-19T09:05:11.029 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.010234897, 2024-09-19T09:05:11.029 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000076379 2024-09-19T09:05:11.030 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.030 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:05:11.030 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.030 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.030 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.030 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.030 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 215808, 2024-09-19T09:05:11.030 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 63664 2024-09-19T09:05:11.030 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.031 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:05:11.031 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 136, 2024-09-19T09:05:11.031 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 213, 2024-09-19T09:05:11.031 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 8664374, 2024-09-19T09:05:11.031 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 191395, 2024-09-19T09:05:11.031 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 5, 2024-09-19T09:05:11.031 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 4, 2024-09-19T09:05:11.031 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.026124520, 2024-09-19T09:05:11.032 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.006092778, 2024-09-19T09:05:11.032 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.013345626, 2024-09-19T09:05:11.032 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.004823226, 2024-09-19T09:05:11.032 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:05:11.032 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 211, 2024-09-19T09:05:11.032 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.009021734, 2024-09-19T09:05:11.032 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000042757 2024-09-19T09:05:11.032 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.032 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:05:11.033 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.033 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.033 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.033 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.033 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-19T09:05:11.033 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 148464 2024-09-19T09:05:11.033 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.033 INFO:teuthology.orchestra.run.smithi155.stdout: "cct": { 2024-09-19T09:05:11.034 INFO:teuthology.orchestra.run.smithi155.stdout: "total_workers": 1, 2024-09-19T09:05:11.034 INFO:teuthology.orchestra.run.smithi155.stdout: "unhealthy_workers": 0 2024-09-19T09:05:11.034 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.034 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-MDSRank": { 2024-09-19T09:05:11.034 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2024-09-19T09:05:11.034 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2024-09-19T09:05:11.034 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 739, 2024-09-19T09:05:11.034 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.075341465, 2024-09-19T09:05:11.035 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000101950 2024-09-19T09:05:11.035 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T09:05:11.035 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.035 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-PurgeQueue": { 2024-09-19T09:05:11.035 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2024-09-19T09:05:11.035 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2024-09-19T09:05:11.035 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.035 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.035 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.036 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T09:05:11.036 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.036 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": { 2024-09-19T09:05:11.036 INFO:teuthology.orchestra.run.smithi155.stdout: "request": 0, 2024-09-19T09:05:11.036 INFO:teuthology.orchestra.run.smithi155.stdout: "reply": 0, 2024-09-19T09:05:11.036 INFO:teuthology.orchestra.run.smithi155.stdout: "reply_latency": { 2024-09-19T09:05:11.036 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.036 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.037 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.037 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.037 INFO:teuthology.orchestra.run.smithi155.stdout: "slow_reply": 0, 2024-09-19T09:05:11.037 INFO:teuthology.orchestra.run.smithi155.stdout: "forward": 0, 2024-09-19T09:05:11.037 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_fetch_complete": 0, 2024-09-19T09:05:11.037 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_fetch_keys": 0, 2024-09-19T09:05:11.037 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_commit": 0, 2024-09-19T09:05:11.037 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_split": 0, 2024-09-19T09:05:11.038 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_merge": 0, 2024-09-19T09:05:11.038 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes": 9404, 2024-09-19T09:05:11.038 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_top": 6554, 2024-09-19T09:05:11.038 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_bottom": 2850, 2024-09-19T09:05:11.038 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pin_tail": 0, 2024-09-19T09:05:11.038 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pinned": 41, 2024-09-19T09:05:11.038 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_expired": 0, 2024-09-19T09:05:11.038 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_with_caps": 0, 2024-09-19T09:05:11.039 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": 0, 2024-09-19T09:05:11.039 INFO:teuthology.orchestra.run.smithi155.stdout: "subtrees": 2, 2024-09-19T09:05:11.039 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse": 0, 2024-09-19T09:05:11.039 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_hit": 0, 2024-09-19T09:05:11.039 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_forward": 0, 2024-09-19T09:05:11.039 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_discover": 0, 2024-09-19T09:05:11.039 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:05:11.039 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_remote_ino": 0, 2024-09-19T09:05:11.039 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_lock": 0, 2024-09-19T09:05:11.040 INFO:teuthology.orchestra.run.smithi155.stdout: "load_cent": 0, 2024-09-19T09:05:11.040 INFO:teuthology.orchestra.run.smithi155.stdout: "q": 0, 2024-09-19T09:05:11.040 INFO:teuthology.orchestra.run.smithi155.stdout: "exported": 0, 2024-09-19T09:05:11.040 INFO:teuthology.orchestra.run.smithi155.stdout: "exported_inodes": 0, 2024-09-19T09:05:11.040 INFO:teuthology.orchestra.run.smithi155.stdout: "imported": 0, 2024-09-19T09:05:11.040 INFO:teuthology.orchestra.run.smithi155.stdout: "imported_inodes": 0, 2024-09-19T09:05:11.040 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_dir_fetch": 0, 2024-09-19T09:05:11.040 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_backtrace_fetch": 0, 2024-09-19T09:05:11.041 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_peer_discover": 0, 2024-09-19T09:05:11.041 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rfiles": 4, 2024-09-19T09:05:11.041 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rbytes": 234, 2024-09-19T09:05:11.041 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rsnaps": 0, 2024-09-19T09:05:11.041 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T09:05:11.041 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_set_tag": 0, 2024-09-19T09:05:11.041 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:05:11.042 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:05:11.042 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:05:11.042 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:05:11.042 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:05:11.042 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_file_inodes": 0, 2024-09-19T09:05:11.042 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:05:11.042 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T09:05:11.042 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_grant": 0, 2024-09-19T09:05:11.042 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:05:11.043 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:05:11.043 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:05:11.043 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_caps": 0, 2024-09-19T09:05:11.043 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_caps_dirty": 0, 2024-09-19T09:05:11.043 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_cap_release": 0, 2024-09-19T09:05:11.043 INFO:teuthology.orchestra.run.smithi155.stdout: "process_request_cap_release": 0 2024-09-19T09:05:11.043 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.043 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_cache": { 2024-09-19T09:05:11.044 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_update": 0, 2024-09-19T09:05:11.044 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_update_receipt": 0, 2024-09-19T09:05:11.044 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_try_discover": 0, 2024-09-19T09:05:11.044 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_send_discover": 0, 2024-09-19T09:05:11.044 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_handle_discover": 0, 2024-09-19T09:05:11.044 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays": 0, 2024-09-19T09:05:11.044 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_delayed": 0, 2024-09-19T09:05:11.044 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:05:11.045 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_created": 0, 2024-09-19T09:05:11.045 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_enqueued": 0, 2024-09-19T09:05:11.045 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_reintegrated": 0, 2024-09-19T09:05:11.045 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_migrated": 0, 2024-09-19T09:05:11.045 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_processing": 0, 2024-09-19T09:05:11.045 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:05:11.045 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:05:11.045 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_started": 0, 2024-09-19T09:05:11.046 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_completed": 0, 2024-09-19T09:05:11.046 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_quiesce_path": 0, 2024-09-19T09:05:11.046 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_quiesce_inode": 0, 2024-09-19T09:05:11.046 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:05:11.046 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_exportdir": 0, 2024-09-19T09:05:11.046 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_flush": 0, 2024-09-19T09:05:11.046 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:05:11.046 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragstats": 0, 2024-09-19T09:05:11.047 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_inodestats": 0 2024-09-19T09:05:11.047 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.047 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_log": { 2024-09-19T09:05:11.047 INFO:teuthology.orchestra.run.smithi155.stdout: "evlrg": 0, 2024-09-19T09:05:11.047 INFO:teuthology.orchestra.run.smithi155.stdout: "evadd": 0, 2024-09-19T09:05:11.047 INFO:teuthology.orchestra.run.smithi155.stdout: "evex": 0, 2024-09-19T09:05:11.047 INFO:teuthology.orchestra.run.smithi155.stdout: "evtrm": 0, 2024-09-19T09:05:11.047 INFO:teuthology.orchestra.run.smithi155.stdout: "ev": 15626, 2024-09-19T09:05:11.048 INFO:teuthology.orchestra.run.smithi155.stdout: "evexg": 0, 2024-09-19T09:05:11.048 INFO:teuthology.orchestra.run.smithi155.stdout: "evexd": 0, 2024-09-19T09:05:11.048 INFO:teuthology.orchestra.run.smithi155.stdout: "segadd": 0, 2024-09-19T09:05:11.048 INFO:teuthology.orchestra.run.smithi155.stdout: "segex": 0, 2024-09-19T09:05:11.048 INFO:teuthology.orchestra.run.smithi155.stdout: "segtrm": 0, 2024-09-19T09:05:11.048 INFO:teuthology.orchestra.run.smithi155.stdout: "seg": 2, 2024-09-19T09:05:11.048 INFO:teuthology.orchestra.run.smithi155.stdout: "segmjr": 8, 2024-09-19T09:05:11.048 INFO:teuthology.orchestra.run.smithi155.stdout: "segexg": 0, 2024-09-19T09:05:11.049 INFO:teuthology.orchestra.run.smithi155.stdout: "segexd": 0, 2024-09-19T09:05:11.049 INFO:teuthology.orchestra.run.smithi155.stdout: "expos": 471612048, 2024-09-19T09:05:11.049 INFO:teuthology.orchestra.run.smithi155.stdout: "wrpos": 471853124, 2024-09-19T09:05:11.049 INFO:teuthology.orchestra.run.smithi155.stdout: "rdpos": 471851676, 2024-09-19T09:05:11.049 INFO:teuthology.orchestra.run.smithi155.stdout: "jlat": { 2024-09-19T09:05:11.049 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.050 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.050 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.050 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.050 INFO:teuthology.orchestra.run.smithi155.stdout: "replayed": 15626 2024-09-19T09:05:11.050 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.050 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_mem": { 2024-09-19T09:05:11.050 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 21, 2024-09-19T09:05:11.050 INFO:teuthology.orchestra.run.smithi155.stdout: "ino+": 6023, 2024-09-19T09:05:11.050 INFO:teuthology.orchestra.run.smithi155.stdout: "ino-": 6002, 2024-09-19T09:05:11.051 INFO:teuthology.orchestra.run.smithi155.stdout: "dir": 55, 2024-09-19T09:05:11.051 INFO:teuthology.orchestra.run.smithi155.stdout: "dir+": 447, 2024-09-19T09:05:11.051 INFO:teuthology.orchestra.run.smithi155.stdout: "dir-": 392, 2024-09-19T09:05:11.051 INFO:teuthology.orchestra.run.smithi155.stdout: "dn": 9404, 2024-09-19T09:05:11.051 INFO:teuthology.orchestra.run.smithi155.stdout: "dn+": 15397, 2024-09-19T09:05:11.051 INFO:teuthology.orchestra.run.smithi155.stdout: "dn-": 5993, 2024-09-19T09:05:11.051 INFO:teuthology.orchestra.run.smithi155.stdout: "cap": 0, 2024-09-19T09:05:11.051 INFO:teuthology.orchestra.run.smithi155.stdout: "cap+": 0, 2024-09-19T09:05:11.052 INFO:teuthology.orchestra.run.smithi155.stdout: "cap-": 0, 2024-09-19T09:05:11.052 INFO:teuthology.orchestra.run.smithi155.stdout: "rss": 67868, 2024-09-19T09:05:11.052 INFO:teuthology.orchestra.run.smithi155.stdout: "heap": 215328 2024-09-19T09:05:11.052 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.052 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_server": { 2024-09-19T09:05:11.052 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_client_request": 0, 2024-09-19T09:05:11.052 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_server_request": 0, 2024-09-19T09:05:11.052 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_request": 0, 2024-09-19T09:05:11.053 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_session": 0, 2024-09-19T09:05:11.053 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_peer_request": 0, 2024-09-19T09:05:11.053 INFO:teuthology.orchestra.run.smithi155.stdout: "req_create_latency": { 2024-09-19T09:05:11.053 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.053 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.053 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.053 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.053 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getattr_latency": { 2024-09-19T09:05:11.053 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.054 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.054 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.054 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.054 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getfilelock_latency": { 2024-09-19T09:05:11.054 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.054 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.054 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.054 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.054 INFO:teuthology.orchestra.run.smithi155.stdout: "req_link_latency": { 2024-09-19T09:05:11.055 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.055 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.055 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.055 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.055 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookup_latency": { 2024-09-19T09:05:11.055 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.055 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.055 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.056 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.056 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookuphash_latency": { 2024-09-19T09:05:11.056 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.056 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.056 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.056 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.056 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupino_latency": { 2024-09-19T09:05:11.056 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.057 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.057 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.057 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.057 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupname_latency": { 2024-09-19T09:05:11.057 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.057 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.057 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.057 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.057 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupparent_latency": { 2024-09-19T09:05:11.058 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.058 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.058 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.058 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.058 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupsnap_latency": { 2024-09-19T09:05:11.058 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.058 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.059 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.059 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.059 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lssnap_latency": { 2024-09-19T09:05:11.059 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.059 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.059 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.059 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.060 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mkdir_latency": { 2024-09-19T09:05:11.060 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.060 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.060 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.061 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.061 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mknod_latency": { 2024-09-19T09:05:11.061 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.061 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.061 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.061 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.061 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mksnap_latency": { 2024-09-19T09:05:11.061 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.062 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.062 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.062 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.062 INFO:teuthology.orchestra.run.smithi155.stdout: "req_open_latency": { 2024-09-19T09:05:11.062 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.062 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.062 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.062 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.063 INFO:teuthology.orchestra.run.smithi155.stdout: "req_readdir_latency": { 2024-09-19T09:05:11.063 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.063 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.063 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.063 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.063 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rename_latency": { 2024-09-19T09:05:11.063 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.063 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.064 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.064 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.064 INFO:teuthology.orchestra.run.smithi155.stdout: "req_renamesnap_latency": { 2024-09-19T09:05:11.064 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.064 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.064 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.064 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.064 INFO:teuthology.orchestra.run.smithi155.stdout: "req_snapdiff_latency": { 2024-09-19T09:05:11.064 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.065 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.065 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.065 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.065 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmdir_latency": { 2024-09-19T09:05:11.065 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.065 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.065 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.065 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.066 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmsnap_latency": { 2024-09-19T09:05:11.066 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.066 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.066 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.066 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.066 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmxattr_latency": { 2024-09-19T09:05:11.066 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.066 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.067 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.067 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.067 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setattr_latency": { 2024-09-19T09:05:11.067 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.067 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.067 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.067 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.067 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setdirlayout_latency": { 2024-09-19T09:05:11.067 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.068 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.068 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.068 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.068 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setfilelock_latency": { 2024-09-19T09:05:11.068 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.068 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.068 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.068 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.069 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setlayout_latency": { 2024-09-19T09:05:11.069 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.069 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.069 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.069 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.069 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setxattr_latency": { 2024-09-19T09:05:11.069 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.069 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.069 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.070 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.070 INFO:teuthology.orchestra.run.smithi155.stdout: "req_symlink_latency": { 2024-09-19T09:05:11.070 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.070 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.070 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.070 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.070 INFO:teuthology.orchestra.run.smithi155.stdout: "req_unlink_latency": { 2024-09-19T09:05:11.070 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.071 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.071 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.071 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.071 INFO:teuthology.orchestra.run.smithi155.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:05:11.071 INFO:teuthology.orchestra.run.smithi155.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:05:11.071 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getvxattr_latency": { 2024-09-19T09:05:11.071 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.071 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.071 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.072 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T09:05:11.072 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.072 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_sessions": { 2024-09-19T09:05:11.072 INFO:teuthology.orchestra.run.smithi155.stdout: "session_count": 1, 2024-09-19T09:05:11.072 INFO:teuthology.orchestra.run.smithi155.stdout: "session_add": 1, 2024-09-19T09:05:11.072 INFO:teuthology.orchestra.run.smithi155.stdout: "session_remove": 0, 2024-09-19T09:05:11.072 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_open": 0, 2024-09-19T09:05:11.072 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_stale": 0, 2024-09-19T09:05:11.072 INFO:teuthology.orchestra.run.smithi155.stdout: "total_load": 0, 2024-09-19T09:05:11.073 INFO:teuthology.orchestra.run.smithi155.stdout: "average_load": 0, 2024-09-19T09:05:11.073 INFO:teuthology.orchestra.run.smithi155.stdout: "avg_session_uptime": 2072, 2024-09-19T09:05:11.073 INFO:teuthology.orchestra.run.smithi155.stdout: "mdthresh_evicted": 0 2024-09-19T09:05:11.073 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.073 INFO:teuthology.orchestra.run.smithi155.stdout: "mempool": { 2024-09-19T09:05:11.073 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:05:11.073 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_items": 0, 2024-09-19T09:05:11.073 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:05:11.074 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:05:11.074 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:05:11.074 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:05:11.074 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:05:11.074 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:05:11.074 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:05:11.074 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:05:11.074 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:05:11.075 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:05:11.075 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:05:11.075 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:05:11.075 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:05:11.075 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_extent_items": 0, 2024-09-19T09:05:11.075 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:05:11.075 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_blob_items": 0, 2024-09-19T09:05:11.075 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:05:11.076 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:05:11.076 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:05:11.076 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:05:11.076 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:05:11.076 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:05:11.076 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:05:11.076 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_items": 0, 2024-09-19T09:05:11.076 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:05:11.076 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:05:11.077 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:05:11.077 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_items": 0, 2024-09-19T09:05:11.077 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_bytes": 0, 2024-09-19T09:05:11.077 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_items": 0, 2024-09-19T09:05:11.077 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:05:11.077 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:05:11.077 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:05:11.077 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:05:11.078 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_bytes": 215426, 2024-09-19T09:05:11.078 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_items": 66, 2024-09-19T09:05:11.078 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:05:11.078 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_items": 0, 2024-09-19T09:05:11.078 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_bytes": 0, 2024-09-19T09:05:11.078 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_items": 0, 2024-09-19T09:05:11.078 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:05:11.078 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_items": 0, 2024-09-19T09:05:11.078 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:05:11.079 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_items": 0, 2024-09-19T09:05:11.079 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_bytes": 7496, 2024-09-19T09:05:11.079 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_items": 154, 2024-09-19T09:05:11.079 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:05:11.079 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:05:11.079 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_bytes": 0, 2024-09-19T09:05:11.079 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_items": 0, 2024-09-19T09:05:11.079 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_bytes": 6716922, 2024-09-19T09:05:11.079 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_items": 34930, 2024-09-19T09:05:11.080 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_bytes": 0, 2024-09-19T09:05:11.080 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_items": 0, 2024-09-19T09:05:11.080 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_bytes": 0, 2024-09-19T09:05:11.080 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_items": 0 2024-09-19T09:05:11.080 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.080 INFO:teuthology.orchestra.run.smithi155.stdout: "objecter": { 2024-09-19T09:05:11.080 INFO:teuthology.orchestra.run.smithi155.stdout: "op_active": 0, 2024-09-19T09:05:11.080 INFO:teuthology.orchestra.run.smithi155.stdout: "op_laggy": 0, 2024-09-19T09:05:11.081 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send": 472, 2024-09-19T09:05:11.081 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send_bytes": 26, 2024-09-19T09:05:11.081 INFO:teuthology.orchestra.run.smithi155.stdout: "op_resend": 4, 2024-09-19T09:05:11.081 INFO:teuthology.orchestra.run.smithi155.stdout: "op_reply": 472, 2024-09-19T09:05:11.081 INFO:teuthology.orchestra.run.smithi155.stdout: "op_latency": { 2024-09-19T09:05:11.081 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 472, 2024-09-19T09:05:11.081 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.387991955, 2024-09-19T09:05:11.081 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000822016 2024-09-19T09:05:11.081 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.082 INFO:teuthology.orchestra.run.smithi155.stdout: "op_inflight": 0, 2024-09-19T09:05:11.082 INFO:teuthology.orchestra.run.smithi155.stdout: "oplen_avg": { 2024-09-19T09:05:11.082 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 472, 2024-09-19T09:05:11.082 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 473 2024-09-19T09:05:11.082 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.082 INFO:teuthology.orchestra.run.smithi155.stdout: "op": 472, 2024-09-19T09:05:11.082 INFO:teuthology.orchestra.run.smithi155.stdout: "op_r": 472, 2024-09-19T09:05:11.082 INFO:teuthology.orchestra.run.smithi155.stdout: "op_w": 0, 2024-09-19T09:05:11.083 INFO:teuthology.orchestra.run.smithi155.stdout: "op_rmw": 0, 2024-09-19T09:05:11.083 INFO:teuthology.orchestra.run.smithi155.stdout: "op_pg": 0, 2024-09-19T09:05:11.083 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_stat": 288, 2024-09-19T09:05:11.083 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_create": 0, 2024-09-19T09:05:11.083 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_read": 181, 2024-09-19T09:05:11.083 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_write": 0, 2024-09-19T09:05:11.083 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writefull": 0, 2024-09-19T09:05:11.083 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writesame": 0, 2024-09-19T09:05:11.083 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_append": 0, 2024-09-19T09:05:11.084 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_zero": 0, 2024-09-19T09:05:11.084 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_truncate": 0, 2024-09-19T09:05:11.084 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_delete": 0, 2024-09-19T09:05:11.084 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_mapext": 0, 2024-09-19T09:05:11.084 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_sparse_read": 0, 2024-09-19T09:05:11.084 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_clonerange": 0, 2024-09-19T09:05:11.084 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_getxattr": 2, 2024-09-19T09:05:11.084 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_setxattr": 0, 2024-09-19T09:05:11.085 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:05:11.085 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_rmxattr": 0, 2024-09-19T09:05:11.085 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:05:11.085 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_call": 0, 2024-09-19T09:05:11.085 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_watch": 0, 2024-09-19T09:05:11.085 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_notify": 0, 2024-09-19T09:05:11.085 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:05:11.085 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls": 0, 2024-09-19T09:05:11.086 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:05:11.086 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_other": 0, 2024-09-19T09:05:11.086 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_active": 0, 2024-09-19T09:05:11.086 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_send": 0, 2024-09-19T09:05:11.086 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_resend": 0, 2024-09-19T09:05:11.086 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_ping": 0, 2024-09-19T09:05:11.086 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_active": 0, 2024-09-19T09:05:11.087 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_send": 0, 2024-09-19T09:05:11.087 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_resend": 0, 2024-09-19T09:05:11.087 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_active": 0, 2024-09-19T09:05:11.087 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_send": 0, 2024-09-19T09:05:11.087 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_resend": 0, 2024-09-19T09:05:11.087 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_active": 0, 2024-09-19T09:05:11.087 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_send": 0, 2024-09-19T09:05:11.087 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_resend": 0, 2024-09-19T09:05:11.088 INFO:teuthology.orchestra.run.smithi155.stdout: "command_active": 0, 2024-09-19T09:05:11.088 INFO:teuthology.orchestra.run.smithi155.stdout: "command_send": 0, 2024-09-19T09:05:11.088 INFO:teuthology.orchestra.run.smithi155.stdout: "command_resend": 0, 2024-09-19T09:05:11.088 INFO:teuthology.orchestra.run.smithi155.stdout: "map_epoch": 88, 2024-09-19T09:05:11.088 INFO:teuthology.orchestra.run.smithi155.stdout: "map_full": 0, 2024-09-19T09:05:11.088 INFO:teuthology.orchestra.run.smithi155.stdout: "map_inc": 4, 2024-09-19T09:05:11.089 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_sessions": 8, 2024-09-19T09:05:11.089 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_open": 8, 2024-09-19T09:05:11.089 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_close": 0, 2024-09-19T09:05:11.089 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_laggy": 0, 2024-09-19T09:05:11.089 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_wr": 0, 2024-09-19T09:05:11.089 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_rd": 2, 2024-09-19T09:05:11.089 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_del": 0 2024-09-19T09:05:11.089 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.090 INFO:teuthology.orchestra.run.smithi155.stdout: "oft": { 2024-09-19T09:05:11.090 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_objs": 0, 2024-09-19T09:05:11.090 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:05:11.090 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_updates": 0, 2024-09-19T09:05:11.090 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_removes": 0 2024-09-19T09:05:11.090 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.090 INFO:teuthology.orchestra.run.smithi155.stdout: "osd-slow-ops": { 2024-09-19T09:05:11.090 INFO:teuthology.orchestra.run.smithi155.stdout: "slow_ops_count": 0 2024-09-19T09:05:11.090 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.091 INFO:teuthology.orchestra.run.smithi155.stdout: "purge_queue": { 2024-09-19T09:05:11.091 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops": 0, 2024-09-19T09:05:11.091 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T09:05:11.091 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing": 0, 2024-09-19T09:05:11.091 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_high_water": 0, 2024-09-19T09:05:11.091 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executed_ops": 0, 2024-09-19T09:05:11.091 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executed": 0, 2024-09-19T09:05:11.091 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_item_in_journal": 0 2024-09-19T09:05:11.092 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.092 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:05:11.092 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2024-09-19T09:05:11.092 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2024-09-19T09:05:11.092 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2024-09-19T09:05:11.092 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 590, 2024-09-19T09:05:11.092 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 27800472, 2024-09-19T09:05:11.092 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:11.093 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 590, 2024-09-19T09:05:11.093 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2024-09-19T09:05:11.093 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2024-09-19T09:05:11.093 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 590, 2024-09-19T09:05:11.093 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 27800472, 2024-09-19T09:05:11.093 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2024-09-19T09:05:11.093 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.093 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.094 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.094 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T09:05:11.094 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.094 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_bytes": { 2024-09-19T09:05:11.094 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2024-09-19T09:05:11.094 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2024-09-19T09:05:11.094 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2024-09-19T09:05:11.094 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2024-09-19T09:05:11.094 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2024-09-19T09:05:11.095 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:11.095 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2024-09-19T09:05:11.095 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 472, 2024-09-19T09:05:11.095 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 27499203, 2024-09-19T09:05:11.095 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 472, 2024-09-19T09:05:11.095 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 27499203, 2024-09-19T09:05:11.095 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2024-09-19T09:05:11.095 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.096 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.096 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.096 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T09:05:11.096 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.096 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_ops": { 2024-09-19T09:05:11.096 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2024-09-19T09:05:11.096 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 1024, 2024-09-19T09:05:11.096 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2024-09-19T09:05:11.097 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2024-09-19T09:05:11.097 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2024-09-19T09:05:11.097 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:11.097 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2024-09-19T09:05:11.097 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 472, 2024-09-19T09:05:11.097 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 472, 2024-09-19T09:05:11.098 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 472, 2024-09-19T09:05:11.098 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 472, 2024-09-19T09:05:11.098 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2024-09-19T09:05:11.098 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.098 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.098 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.098 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T09:05:11.099 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.099 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:05:11.099 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2024-09-19T09:05:11.099 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2024-09-19T09:05:11.099 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2024-09-19T09:05:11.099 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2024-09-19T09:05:11.099 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2024-09-19T09:05:11.099 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:11.100 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2024-09-19T09:05:11.100 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2024-09-19T09:05:11.100 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2024-09-19T09:05:11.100 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 0, 2024-09-19T09:05:11.100 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 0, 2024-09-19T09:05:11.101 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2024-09-19T09:05:11.101 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.101 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.101 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.101 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T09:05:11.101 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:11.101 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle-0x5597088a6b40": { 2024-09-19T09:05:11.101 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2024-09-19T09:05:11.102 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2024-09-19T09:05:11.102 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2024-09-19T09:05:11.102 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2024-09-19T09:05:11.102 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2024-09-19T09:05:11.102 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:11.102 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2024-09-19T09:05:11.102 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2024-09-19T09:05:11.102 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2024-09-19T09:05:11.103 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 0, 2024-09-19T09:05:11.103 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 0, 2024-09-19T09:05:11.103 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2024-09-19T09:05:11.103 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:11.103 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:11.103 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:11.103 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T09:05:11.103 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T09:05:11.104 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-09-19T09:05:11.777 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-19T09:05:11.777 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-19T09:05:11.778 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-19T09:05:11.778 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-19T09:05:11.778 INFO:tasks.check_counter:Daemon mds.e mds.dir_split=0 2024-09-19T09:05:11.778 DEBUG:tasks.check_counter:Getting stats from h 2024-09-19T09:05:11.778 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-19T09:05:11.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:11 smithi203 ceph-mon[35450]: pgmap v732: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2024-09-19T09:05:12.027 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:05:12.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:11 smithi019 ceph-mon[30976]: pgmap v732: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2024-09-19T09:05:12.147 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:11 smithi155 ceph-mon[34921]: pgmap v732: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 9 op/s 2024-09-19T09:05:12.548 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-09-19T09:05:12.548 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:05:12.548 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 9548, 2024-09-19T09:05:12.549 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 9549, 2024-09-19T09:05:12.549 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 3047345, 2024-09-19T09:05:12.549 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 1699733, 2024-09-19T09:05:12.549 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 36, 2024-09-19T09:05:12.549 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 5, 2024-09-19T09:05:12.549 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.641430835, 2024-09-19T09:05:12.549 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.233102407, 2024-09-19T09:05:12.550 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.549693811, 2024-09-19T09:05:12.550 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.000534670, 2024-09-19T09:05:12.550 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:05:12.550 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 9547, 2024-09-19T09:05:12.550 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.166983778, 2024-09-19T09:05:12.550 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000017490 2024-09-19T09:05:12.550 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.550 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:05:12.551 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 19013, 2024-09-19T09:05:12.551 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.002424011, 2024-09-19T09:05:12.551 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000127 2024-09-19T09:05:12.551 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.551 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 3037712, 2024-09-19T09:05:12.551 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 1371520 2024-09-19T09:05:12.551 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.551 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:05:12.552 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 59, 2024-09-19T09:05:12.552 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 224, 2024-09-19T09:05:12.552 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 44834, 2024-09-19T09:05:12.552 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 597456, 2024-09-19T09:05:12.552 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 14, 2024-09-19T09:05:12.552 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 5, 2024-09-19T09:05:12.552 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.018102101, 2024-09-19T09:05:12.553 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.008177359, 2024-09-19T09:05:12.553 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.008496850, 2024-09-19T09:05:12.553 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.000274658, 2024-09-19T09:05:12.553 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:05:12.553 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 223, 2024-09-19T09:05:12.553 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.024627511, 2024-09-19T09:05:12.554 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000110437 2024-09-19T09:05:12.554 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.554 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:05:12.554 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 54, 2024-09-19T09:05:12.554 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000007346, 2024-09-19T09:05:12.554 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000136 2024-09-19T09:05:12.554 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.554 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 3392, 2024-09-19T09:05:12.555 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 495664 2024-09-19T09:05:12.555 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.555 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:05:12.555 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 13575, 2024-09-19T09:05:12.555 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 7021, 2024-09-19T09:05:12.555 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 147274340, 2024-09-19T09:05:12.555 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 1430764, 2024-09-19T09:05:12.555 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 8, 2024-09-19T09:05:12.556 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 5, 2024-09-19T09:05:12.556 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.664977374, 2024-09-19T09:05:12.556 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.281283010, 2024-09-19T09:05:12.556 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.510067083, 2024-09-19T09:05:12.556 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.024002634, 2024-09-19T09:05:12.556 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:05:12.556 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 7020, 2024-09-19T09:05:12.556 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.138473589, 2024-09-19T09:05:12.557 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000019725 2024-09-19T09:05:12.557 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.557 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:05:12.557 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 19628, 2024-09-19T09:05:12.557 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.002817381, 2024-09-19T09:05:12.557 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000143 2024-09-19T09:05:12.558 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.558 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 904992, 2024-09-19T09:05:12.558 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 158320 2024-09-19T09:05:12.558 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.558 INFO:teuthology.orchestra.run.smithi155.stdout: "cct": { 2024-09-19T09:05:12.559 INFO:teuthology.orchestra.run.smithi155.stdout: "total_workers": 1, 2024-09-19T09:05:12.559 INFO:teuthology.orchestra.run.smithi155.stdout: "unhealthy_workers": 0 2024-09-19T09:05:12.559 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.559 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-MDSRank": { 2024-09-19T09:05:12.559 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2024-09-19T09:05:12.559 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2024-09-19T09:05:12.559 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 57, 2024-09-19T09:05:12.559 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.001399812, 2024-09-19T09:05:12.559 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000024558 2024-09-19T09:05:12.560 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T09:05:12.560 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.560 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-PurgeQueue": { 2024-09-19T09:05:12.560 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2024-09-19T09:05:12.560 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2024-09-19T09:05:12.560 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 2, 2024-09-19T09:05:12.560 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000011024, 2024-09-19T09:05:12.561 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000005512 2024-09-19T09:05:12.561 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T09:05:12.561 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.561 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": { 2024-09-19T09:05:12.561 INFO:teuthology.orchestra.run.smithi155.stdout: "request": 9478, 2024-09-19T09:05:12.561 INFO:teuthology.orchestra.run.smithi155.stdout: "reply": 5, 2024-09-19T09:05:12.561 INFO:teuthology.orchestra.run.smithi155.stdout: "reply_latency": { 2024-09-19T09:05:12.561 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 5, 2024-09-19T09:05:12.561 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 3.255433839, 2024-09-19T09:05:12.562 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.651086767 2024-09-19T09:05:12.562 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.562 INFO:teuthology.orchestra.run.smithi155.stdout: "slow_reply": 0, 2024-09-19T09:05:12.562 INFO:teuthology.orchestra.run.smithi155.stdout: "forward": 9473, 2024-09-19T09:05:12.562 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_fetch_complete": 0, 2024-09-19T09:05:12.562 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_fetch_keys": 0, 2024-09-19T09:05:12.562 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_commit": 11, 2024-09-19T09:05:12.562 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_split": 0, 2024-09-19T09:05:12.563 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_merge": 0, 2024-09-19T09:05:12.563 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes": 21, 2024-09-19T09:05:12.563 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_top": 3, 2024-09-19T09:05:12.563 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_bottom": 18, 2024-09-19T09:05:12.563 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pin_tail": 0, 2024-09-19T09:05:12.563 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pinned": 14, 2024-09-19T09:05:12.563 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_expired": 31, 2024-09-19T09:05:12.563 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_with_caps": 1, 2024-09-19T09:05:12.564 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": 1, 2024-09-19T09:05:12.564 INFO:teuthology.orchestra.run.smithi155.stdout: "subtrees": 4, 2024-09-19T09:05:12.564 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse": 12083, 2024-09-19T09:05:12.564 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_hit": 2593, 2024-09-19T09:05:12.564 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_forward": 9472, 2024-09-19T09:05:12.564 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_discover": 9, 2024-09-19T09:05:12.564 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:05:12.564 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_remote_ino": 0, 2024-09-19T09:05:12.565 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_lock": 2, 2024-09-19T09:05:12.565 INFO:teuthology.orchestra.run.smithi155.stdout: "load_cent": 0, 2024-09-19T09:05:12.565 INFO:teuthology.orchestra.run.smithi155.stdout: "q": 0, 2024-09-19T09:05:12.565 INFO:teuthology.orchestra.run.smithi155.stdout: "exported": 0, 2024-09-19T09:05:12.565 INFO:teuthology.orchestra.run.smithi155.stdout: "exported_inodes": 0, 2024-09-19T09:05:12.565 INFO:teuthology.orchestra.run.smithi155.stdout: "imported": 0, 2024-09-19T09:05:12.565 INFO:teuthology.orchestra.run.smithi155.stdout: "imported_inodes": 0, 2024-09-19T09:05:12.565 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_dir_fetch": 0, 2024-09-19T09:05:12.565 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_backtrace_fetch": 0, 2024-09-19T09:05:12.566 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_peer_discover": 0, 2024-09-19T09:05:12.566 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rfiles": 4, 2024-09-19T09:05:12.566 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rbytes": 234, 2024-09-19T09:05:12.566 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rsnaps": 0, 2024-09-19T09:05:12.566 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T09:05:12.566 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_set_tag": 0, 2024-09-19T09:05:12.566 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:05:12.566 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:05:12.567 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:05:12.567 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:05:12.567 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:05:12.567 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_file_inodes": 0, 2024-09-19T09:05:12.567 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:05:12.567 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_revoke": 2, 2024-09-19T09:05:12.567 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_grant": 1, 2024-09-19T09:05:12.567 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:05:12.567 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:05:12.568 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:05:12.568 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_caps": 3, 2024-09-19T09:05:12.568 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_caps_dirty": 0, 2024-09-19T09:05:12.568 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_cap_release": 1, 2024-09-19T09:05:12.568 INFO:teuthology.orchestra.run.smithi155.stdout: "process_request_cap_release": 1 2024-09-19T09:05:12.568 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.568 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_cache": { 2024-09-19T09:05:12.569 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_update": 0, 2024-09-19T09:05:12.569 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_update_receipt": 5146, 2024-09-19T09:05:12.569 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_try_discover": 2577, 2024-09-19T09:05:12.569 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_send_discover": 2579, 2024-09-19T09:05:12.569 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_handle_discover": 0, 2024-09-19T09:05:12.569 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays": 0, 2024-09-19T09:05:12.569 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_delayed": 0, 2024-09-19T09:05:12.569 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:05:12.570 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_created": 0, 2024-09-19T09:05:12.570 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_enqueued": 0, 2024-09-19T09:05:12.570 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_reintegrated": 0, 2024-09-19T09:05:12.570 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_migrated": 0, 2024-09-19T09:05:12.570 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_processing": 0, 2024-09-19T09:05:12.570 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:05:12.570 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:05:12.570 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_started": 0, 2024-09-19T09:05:12.570 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_completed": 0, 2024-09-19T09:05:12.571 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_quiesce_path": 10, 2024-09-19T09:05:12.571 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_quiesce_inode": 91, 2024-09-19T09:05:12.571 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:05:12.571 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_exportdir": 0, 2024-09-19T09:05:12.571 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_flush": 0, 2024-09-19T09:05:12.571 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:05:12.571 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragstats": 0, 2024-09-19T09:05:12.571 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_inodestats": 0 2024-09-19T09:05:12.572 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.572 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_log": { 2024-09-19T09:05:12.572 INFO:teuthology.orchestra.run.smithi155.stdout: "evlrg": 0, 2024-09-19T09:05:12.572 INFO:teuthology.orchestra.run.smithi155.stdout: "evadd": 5, 2024-09-19T09:05:12.572 INFO:teuthology.orchestra.run.smithi155.stdout: "evex": 0, 2024-09-19T09:05:12.572 INFO:teuthology.orchestra.run.smithi155.stdout: "evtrm": 0, 2024-09-19T09:05:12.572 INFO:teuthology.orchestra.run.smithi155.stdout: "ev": 5, 2024-09-19T09:05:12.572 INFO:teuthology.orchestra.run.smithi155.stdout: "evexg": 0, 2024-09-19T09:05:12.573 INFO:teuthology.orchestra.run.smithi155.stdout: "evexd": 0, 2024-09-19T09:05:12.573 INFO:teuthology.orchestra.run.smithi155.stdout: "segadd": 2, 2024-09-19T09:05:12.573 INFO:teuthology.orchestra.run.smithi155.stdout: "segex": 0, 2024-09-19T09:05:12.573 INFO:teuthology.orchestra.run.smithi155.stdout: "segtrm": 0, 2024-09-19T09:05:12.573 INFO:teuthology.orchestra.run.smithi155.stdout: "seg": 2, 2024-09-19T09:05:12.573 INFO:teuthology.orchestra.run.smithi155.stdout: "segmjr": 2, 2024-09-19T09:05:12.573 INFO:teuthology.orchestra.run.smithi155.stdout: "segexg": 0, 2024-09-19T09:05:12.574 INFO:teuthology.orchestra.run.smithi155.stdout: "segexd": 0, 2024-09-19T09:05:12.574 INFO:teuthology.orchestra.run.smithi155.stdout: "expos": 4194304, 2024-09-19T09:05:12.574 INFO:teuthology.orchestra.run.smithi155.stdout: "wrpos": 4195734, 2024-09-19T09:05:12.574 INFO:teuthology.orchestra.run.smithi155.stdout: "rdpos": 0, 2024-09-19T09:05:12.574 INFO:teuthology.orchestra.run.smithi155.stdout: "jlat": { 2024-09-19T09:05:12.574 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 4, 2024-09-19T09:05:12.574 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.007265445, 2024-09-19T09:05:12.574 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.001816361 2024-09-19T09:05:12.575 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.575 INFO:teuthology.orchestra.run.smithi155.stdout: "replayed": 0 2024-09-19T09:05:12.575 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.575 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_mem": { 2024-09-19T09:05:12.575 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 26, 2024-09-19T09:05:12.575 INFO:teuthology.orchestra.run.smithi155.stdout: "ino+": 46, 2024-09-19T09:05:12.575 INFO:teuthology.orchestra.run.smithi155.stdout: "ino-": 20, 2024-09-19T09:05:12.576 INFO:teuthology.orchestra.run.smithi155.stdout: "dir": 32, 2024-09-19T09:05:12.576 INFO:teuthology.orchestra.run.smithi155.stdout: "dir+": 2810, 2024-09-19T09:05:12.576 INFO:teuthology.orchestra.run.smithi155.stdout: "dir-": 2778, 2024-09-19T09:05:12.576 INFO:teuthology.orchestra.run.smithi155.stdout: "dn": 21, 2024-09-19T09:05:12.576 INFO:teuthology.orchestra.run.smithi155.stdout: "dn+": 52, 2024-09-19T09:05:12.576 INFO:teuthology.orchestra.run.smithi155.stdout: "dn-": 31, 2024-09-19T09:05:12.576 INFO:teuthology.orchestra.run.smithi155.stdout: "cap": 1, 2024-09-19T09:05:12.576 INFO:teuthology.orchestra.run.smithi155.stdout: "cap+": 3, 2024-09-19T09:05:12.577 INFO:teuthology.orchestra.run.smithi155.stdout: "cap-": 2, 2024-09-19T09:05:12.577 INFO:teuthology.orchestra.run.smithi155.stdout: "rss": 59972, 2024-09-19T09:05:12.577 INFO:teuthology.orchestra.run.smithi155.stdout: "heap": 223520 2024-09-19T09:05:12.577 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.577 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_server": { 2024-09-19T09:05:12.577 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_client_request": 9481, 2024-09-19T09:05:12.577 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_server_request": 2, 2024-09-19T09:05:12.578 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_request": 9478, 2024-09-19T09:05:12.578 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_session": 15, 2024-09-19T09:05:12.578 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_peer_request": 4, 2024-09-19T09:05:12.578 INFO:teuthology.orchestra.run.smithi155.stdout: "req_create_latency": { 2024-09-19T09:05:12.578 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:12.578 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:12.578 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:12.579 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.579 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getattr_latency": { 2024-09-19T09:05:12.579 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1, 2024-09-19T09:05:12.579 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000170437, 2024-09-19T09:05:12.579 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000170437 2024-09-19T09:05:12.579 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.579 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getfilelock_latency": { 2024-09-19T09:05:12.580 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:12.580 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:12.580 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:12.580 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.580 INFO:teuthology.orchestra.run.smithi155.stdout: "req_link_latency": { 2024-09-19T09:05:12.580 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:12.581 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:12.581 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:12.581 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.581 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookup_latency": { 2024-09-19T09:05:12.581 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 3, 2024-09-19T09:05:12.581 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 3.255142151, 2024-09-19T09:05:12.581 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 1.085047383 2024-09-19T09:05:12.581 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.582 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookuphash_latency": { 2024-09-19T09:05:12.582 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:12.582 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:12.582 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:12.582 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.582 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupino_latency": { 2024-09-19T09:05:12.582 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1, 2024-09-19T09:05:12.583 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000121251, 2024-09-19T09:05:12.583 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000121251 2024-09-19T09:05:12.583 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.583 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupname_latency": { 2024-09-19T09:05:12.583 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:12.583 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:12.583 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:12.583 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.584 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupparent_latency": { 2024-09-19T09:05:12.584 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:12.584 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:12.584 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:12.584 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.584 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupsnap_latency": { 2024-09-19T09:05:12.584 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:12.585 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:12.585 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:12.585 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.585 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lssnap_latency": { 2024-09-19T09:05:12.585 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:12.585 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:12.585 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:12.585 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.586 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mkdir_latency": { 2024-09-19T09:05:12.586 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:12.586 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:12.587 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:12.587 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.587 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mknod_latency": { 2024-09-19T09:05:12.587 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:12.587 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:12.587 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:12.587 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.588 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mksnap_latency": { 2024-09-19T09:05:12.588 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:12.588 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:12.588 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:12.588 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.588 INFO:teuthology.orchestra.run.smithi155.stdout: "req_open_latency": { 2024-09-19T09:05:12.589 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:12.589 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:12.589 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:12.589 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.589 INFO:teuthology.orchestra.run.smithi155.stdout: "req_readdir_latency": { 2024-09-19T09:05:12.589 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:12.589 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:12.589 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:12.590 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.590 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rename_latency": { 2024-09-19T09:05:12.590 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:12.590 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:12.590 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:12.590 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.591 INFO:teuthology.orchestra.run.smithi155.stdout: "req_renamesnap_latency": { 2024-09-19T09:05:12.591 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:12.591 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:12.591 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:12.591 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.591 INFO:teuthology.orchestra.run.smithi155.stdout: "req_snapdiff_latency": { 2024-09-19T09:05:12.591 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:12.592 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:12.592 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:12.592 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.592 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmdir_latency": { 2024-09-19T09:05:12.592 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:12.592 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:12.592 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:12.592 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.593 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmsnap_latency": { 2024-09-19T09:05:12.593 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:12.593 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:12.593 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:12.593 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.593 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmxattr_latency": { 2024-09-19T09:05:12.593 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:12.593 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:12.593 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:12.594 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.594 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setattr_latency": { 2024-09-19T09:05:12.594 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:12.594 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:12.594 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:12.594 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.594 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setdirlayout_latency": { 2024-09-19T09:05:12.594 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:12.595 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:12.595 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:12.595 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.595 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setfilelock_latency": { 2024-09-19T09:05:12.595 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:12.595 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:12.595 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:12.595 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.595 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setlayout_latency": { 2024-09-19T09:05:12.596 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:12.596 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:12.596 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:12.596 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.596 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setxattr_latency": { 2024-09-19T09:05:12.596 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:12.596 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:12.596 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:12.597 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.597 INFO:teuthology.orchestra.run.smithi155.stdout: "req_symlink_latency": { 2024-09-19T09:05:12.597 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:12.597 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:12.597 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:12.597 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.597 INFO:teuthology.orchestra.run.smithi155.stdout: "req_unlink_latency": { 2024-09-19T09:05:12.597 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:12.598 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:12.598 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:12.598 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.598 INFO:teuthology.orchestra.run.smithi155.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:05:12.598 INFO:teuthology.orchestra.run.smithi155.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:05:12.598 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getvxattr_latency": { 2024-09-19T09:05:12.598 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:12.598 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:12.598 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:12.599 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T09:05:12.599 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.599 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_sessions": { 2024-09-19T09:05:12.599 INFO:teuthology.orchestra.run.smithi155.stdout: "session_count": 1, 2024-09-19T09:05:12.599 INFO:teuthology.orchestra.run.smithi155.stdout: "session_add": 2, 2024-09-19T09:05:12.599 INFO:teuthology.orchestra.run.smithi155.stdout: "session_remove": 1, 2024-09-19T09:05:12.599 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_open": 1, 2024-09-19T09:05:12.599 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_stale": 0, 2024-09-19T09:05:12.600 INFO:teuthology.orchestra.run.smithi155.stdout: "total_load": 1, 2024-09-19T09:05:12.600 INFO:teuthology.orchestra.run.smithi155.stdout: "average_load": 1, 2024-09-19T09:05:12.600 INFO:teuthology.orchestra.run.smithi155.stdout: "avg_session_uptime": 756, 2024-09-19T09:05:12.600 INFO:teuthology.orchestra.run.smithi155.stdout: "mdthresh_evicted": 0 2024-09-19T09:05:12.600 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.600 INFO:teuthology.orchestra.run.smithi155.stdout: "mempool": { 2024-09-19T09:05:12.600 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:05:12.600 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_items": 0, 2024-09-19T09:05:12.601 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:05:12.601 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:05:12.601 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:05:12.601 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:05:12.601 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:05:12.601 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:05:12.601 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:05:12.601 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:05:12.601 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:05:12.602 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:05:12.602 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:05:12.602 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:05:12.602 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:05:12.602 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_extent_items": 0, 2024-09-19T09:05:12.602 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:05:12.602 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_blob_items": 0, 2024-09-19T09:05:12.603 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:05:12.603 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:05:12.603 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:05:12.603 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:05:12.603 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:05:12.603 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:05:12.603 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:05:12.603 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_items": 0, 2024-09-19T09:05:12.603 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:05:12.604 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:05:12.604 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:05:12.604 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_items": 0, 2024-09-19T09:05:12.604 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_bytes": 0, 2024-09-19T09:05:12.604 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_items": 0, 2024-09-19T09:05:12.604 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:05:12.604 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:05:12.604 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:05:12.605 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:05:12.605 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_bytes": 255404, 2024-09-19T09:05:12.605 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_items": 89, 2024-09-19T09:05:12.605 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:05:12.605 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_items": 0, 2024-09-19T09:05:12.605 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_bytes": 0, 2024-09-19T09:05:12.605 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_items": 0, 2024-09-19T09:05:12.605 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:05:12.606 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_items": 0, 2024-09-19T09:05:12.606 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:05:12.606 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_items": 0, 2024-09-19T09:05:12.606 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_bytes": 7496, 2024-09-19T09:05:12.606 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_items": 154, 2024-09-19T09:05:12.606 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:05:12.606 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:05:12.606 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_bytes": 0, 2024-09-19T09:05:12.607 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_items": 0, 2024-09-19T09:05:12.607 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_bytes": 115694, 2024-09-19T09:05:12.607 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_items": 431, 2024-09-19T09:05:12.607 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_bytes": 0, 2024-09-19T09:05:12.607 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_items": 0, 2024-09-19T09:05:12.607 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_bytes": 0, 2024-09-19T09:05:12.607 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_items": 0 2024-09-19T09:05:12.607 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.608 INFO:teuthology.orchestra.run.smithi155.stdout: "objecter": { 2024-09-19T09:05:12.608 INFO:teuthology.orchestra.run.smithi155.stdout: "op_active": 0, 2024-09-19T09:05:12.608 INFO:teuthology.orchestra.run.smithi155.stdout: "op_laggy": 0, 2024-09-19T09:05:12.608 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send": 44, 2024-09-19T09:05:12.608 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send_bytes": 12371, 2024-09-19T09:05:12.608 INFO:teuthology.orchestra.run.smithi155.stdout: "op_resend": 32, 2024-09-19T09:05:12.608 INFO:teuthology.orchestra.run.smithi155.stdout: "op_reply": 44, 2024-09-19T09:05:12.608 INFO:teuthology.orchestra.run.smithi155.stdout: "op_latency": { 2024-09-19T09:05:12.608 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 44, 2024-09-19T09:05:12.609 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.216995440, 2024-09-19T09:05:12.609 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.004931714 2024-09-19T09:05:12.609 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.609 INFO:teuthology.orchestra.run.smithi155.stdout: "op_inflight": 0, 2024-09-19T09:05:12.609 INFO:teuthology.orchestra.run.smithi155.stdout: "oplen_avg": { 2024-09-19T09:05:12.609 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 44, 2024-09-19T09:05:12.609 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 70 2024-09-19T09:05:12.609 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.610 INFO:teuthology.orchestra.run.smithi155.stdout: "op": 44, 2024-09-19T09:05:12.610 INFO:teuthology.orchestra.run.smithi155.stdout: "op_r": 0, 2024-09-19T09:05:12.610 INFO:teuthology.orchestra.run.smithi155.stdout: "op_w": 44, 2024-09-19T09:05:12.610 INFO:teuthology.orchestra.run.smithi155.stdout: "op_rmw": 0, 2024-09-19T09:05:12.610 INFO:teuthology.orchestra.run.smithi155.stdout: "op_pg": 0, 2024-09-19T09:05:12.610 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_stat": 0, 2024-09-19T09:05:12.610 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_create": 10, 2024-09-19T09:05:12.610 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_read": 0, 2024-09-19T09:05:12.611 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_write": 4, 2024-09-19T09:05:12.611 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writefull": 7, 2024-09-19T09:05:12.611 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writesame": 0, 2024-09-19T09:05:12.611 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_append": 0, 2024-09-19T09:05:12.611 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_zero": 0, 2024-09-19T09:05:12.611 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_truncate": 0, 2024-09-19T09:05:12.611 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_delete": 6, 2024-09-19T09:05:12.611 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_mapext": 0, 2024-09-19T09:05:12.611 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_sparse_read": 0, 2024-09-19T09:05:12.612 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_clonerange": 0, 2024-09-19T09:05:12.612 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_getxattr": 0, 2024-09-19T09:05:12.612 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_setxattr": 20, 2024-09-19T09:05:12.612 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:05:12.612 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_rmxattr": 0, 2024-09-19T09:05:12.612 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:05:12.612 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_call": 0, 2024-09-19T09:05:12.612 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_watch": 0, 2024-09-19T09:05:12.613 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_notify": 0, 2024-09-19T09:05:12.613 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:05:12.613 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls": 0, 2024-09-19T09:05:12.613 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:05:12.613 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_other": 0, 2024-09-19T09:05:12.613 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_active": 0, 2024-09-19T09:05:12.613 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_send": 0, 2024-09-19T09:05:12.613 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_resend": 0, 2024-09-19T09:05:12.614 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_ping": 0, 2024-09-19T09:05:12.614 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_active": 0, 2024-09-19T09:05:12.614 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_send": 0, 2024-09-19T09:05:12.614 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_resend": 0, 2024-09-19T09:05:12.614 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_active": 0, 2024-09-19T09:05:12.614 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_send": 0, 2024-09-19T09:05:12.614 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_resend": 0, 2024-09-19T09:05:12.614 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_active": 0, 2024-09-19T09:05:12.614 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_send": 0, 2024-09-19T09:05:12.615 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_resend": 0, 2024-09-19T09:05:12.615 INFO:teuthology.orchestra.run.smithi155.stdout: "command_active": 0, 2024-09-19T09:05:12.615 INFO:teuthology.orchestra.run.smithi155.stdout: "command_send": 0, 2024-09-19T09:05:12.615 INFO:teuthology.orchestra.run.smithi155.stdout: "command_resend": 0, 2024-09-19T09:05:12.615 INFO:teuthology.orchestra.run.smithi155.stdout: "map_epoch": 88, 2024-09-19T09:05:12.615 INFO:teuthology.orchestra.run.smithi155.stdout: "map_full": 0, 2024-09-19T09:05:12.615 INFO:teuthology.orchestra.run.smithi155.stdout: "map_inc": 8, 2024-09-19T09:05:12.615 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_sessions": 9, 2024-09-19T09:05:12.616 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_open": 9, 2024-09-19T09:05:12.616 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_close": 0, 2024-09-19T09:05:12.616 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_laggy": 0, 2024-09-19T09:05:12.616 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_wr": 20, 2024-09-19T09:05:12.616 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_rd": 0, 2024-09-19T09:05:12.616 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_del": 3 2024-09-19T09:05:12.616 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.616 INFO:teuthology.orchestra.run.smithi155.stdout: "oft": { 2024-09-19T09:05:12.617 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_objs": 1, 2024-09-19T09:05:12.617 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:05:12.617 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_updates": 0, 2024-09-19T09:05:12.617 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_removes": 0 2024-09-19T09:05:12.617 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.617 INFO:teuthology.orchestra.run.smithi155.stdout: "osd-slow-ops": { 2024-09-19T09:05:12.617 INFO:teuthology.orchestra.run.smithi155.stdout: "slow_ops_count": 75 2024-09-19T09:05:12.617 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.618 INFO:teuthology.orchestra.run.smithi155.stdout: "purge_queue": { 2024-09-19T09:05:12.618 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops": 0, 2024-09-19T09:05:12.618 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T09:05:12.618 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing": 0, 2024-09-19T09:05:12.618 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_high_water": 0, 2024-09-19T09:05:12.618 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executed_ops": 0, 2024-09-19T09:05:12.618 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executed": 0, 2024-09-19T09:05:12.618 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_item_in_journal": 0 2024-09-19T09:05:12.619 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.619 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:05:12.619 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2024-09-19T09:05:12.619 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2024-09-19T09:05:12.619 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2024-09-19T09:05:12.620 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 23178, 2024-09-19T09:05:12.620 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 147861373, 2024-09-19T09:05:12.620 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:12.620 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 23178, 2024-09-19T09:05:12.620 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2024-09-19T09:05:12.620 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2024-09-19T09:05:12.620 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 23178, 2024-09-19T09:05:12.620 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 147861373, 2024-09-19T09:05:12.621 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2024-09-19T09:05:12.621 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:12.621 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:12.621 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:12.621 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T09:05:12.621 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.621 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_bytes": { 2024-09-19T09:05:12.621 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2024-09-19T09:05:12.622 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2024-09-19T09:05:12.622 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2024-09-19T09:05:12.622 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2024-09-19T09:05:12.622 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2024-09-19T09:05:12.622 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:12.622 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2024-09-19T09:05:12.622 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 44, 2024-09-19T09:05:12.622 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 12371, 2024-09-19T09:05:12.623 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 44, 2024-09-19T09:05:12.623 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 12371, 2024-09-19T09:05:12.623 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2024-09-19T09:05:12.623 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:12.623 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:12.623 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:12.623 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T09:05:12.623 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.623 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_ops": { 2024-09-19T09:05:12.624 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2024-09-19T09:05:12.624 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 1024, 2024-09-19T09:05:12.624 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2024-09-19T09:05:12.624 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2024-09-19T09:05:12.624 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2024-09-19T09:05:12.624 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:12.624 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2024-09-19T09:05:12.624 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 44, 2024-09-19T09:05:12.625 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 44, 2024-09-19T09:05:12.625 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 44, 2024-09-19T09:05:12.625 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 44, 2024-09-19T09:05:12.625 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2024-09-19T09:05:12.625 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:12.625 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:12.625 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:12.625 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T09:05:12.626 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.626 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:05:12.626 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2024-09-19T09:05:12.626 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2024-09-19T09:05:12.626 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2024-09-19T09:05:12.626 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2024-09-19T09:05:12.626 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2024-09-19T09:05:12.626 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:12.627 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2024-09-19T09:05:12.627 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2024-09-19T09:05:12.627 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2024-09-19T09:05:12.627 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 0, 2024-09-19T09:05:12.627 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 0, 2024-09-19T09:05:12.627 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2024-09-19T09:05:12.627 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:12.627 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:12.627 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:12.628 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T09:05:12.628 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:12.628 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle-0x5564dc014960": { 2024-09-19T09:05:12.628 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2024-09-19T09:05:12.628 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2024-09-19T09:05:12.628 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2024-09-19T09:05:12.628 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 5, 2024-09-19T09:05:12.628 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 1430, 2024-09-19T09:05:12.629 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:12.629 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 5, 2024-09-19T09:05:12.629 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2024-09-19T09:05:12.629 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2024-09-19T09:05:12.629 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 4, 2024-09-19T09:05:12.629 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 1430, 2024-09-19T09:05:12.629 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2024-09-19T09:05:12.629 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:12.630 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:12.630 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:12.630 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T09:05:12.632 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T09:05:12.632 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-09-19T09:05:13.409 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-09-19T09:05:13.410 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-09-19T09:05:13.410 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=0 2024-09-19T09:05:13.410 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=5146 2024-09-19T09:05:13.410 INFO:tasks.check_counter:Daemon mds.h mds.dir_split=0 2024-09-19T09:05:13.410 DEBUG:tasks.check_counter:Getting stats from k 2024-09-19T09:05:13.411 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-19T09:05:13.654 INFO:teuthology.orchestra.run.smithi155.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T09:05:13.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:13 smithi203 ceph-mon[35450]: pgmap v733: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-19T09:05:14.054 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:13 smithi155 ceph-mon[34921]: pgmap v733: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-19T09:05:14.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:13 smithi019 ceph-mon[30976]: pgmap v733: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-09-19T09:05:14.172 INFO:teuthology.orchestra.run.smithi155.stdout:{ 2024-09-19T09:05:14.172 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:05:14.172 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 927, 2024-09-19T09:05:14.173 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 929, 2024-09-19T09:05:14.173 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 1006070, 2024-09-19T09:05:14.173 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 294850, 2024-09-19T09:05:14.173 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 6, 2024-09-19T09:05:14.173 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 2, 2024-09-19T09:05:14.173 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.076259267, 2024-09-19T09:05:14.174 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.030212083, 2024-09-19T09:05:14.174 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.018986513, 2024-09-19T09:05:14.174 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.019809457, 2024-09-19T09:05:14.174 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:05:14.174 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 927, 2024-09-19T09:05:14.174 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.031634100, 2024-09-19T09:05:14.174 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000034125 2024-09-19T09:05:14.175 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.175 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:05:14.175 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.175 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.175 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.175 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.176 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:05:14.176 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:05:14.176 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.176 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:05:14.176 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 802, 2024-09-19T09:05:14.176 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 992, 2024-09-19T09:05:14.176 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 197142, 2024-09-19T09:05:14.176 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 750325, 2024-09-19T09:05:14.177 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 6, 2024-09-19T09:05:14.177 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 4, 2024-09-19T09:05:14.177 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.076074569, 2024-09-19T09:05:14.177 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.027212721, 2024-09-19T09:05:14.177 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.016344289, 2024-09-19T09:05:14.177 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.024741955, 2024-09-19T09:05:14.178 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:05:14.178 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 990, 2024-09-19T09:05:14.178 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.035383352, 2024-09-19T09:05:14.178 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000035740 2024-09-19T09:05:14.178 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.178 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:05:14.178 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.178 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.179 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.179 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.179 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T09:05:14.179 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 495920 2024-09-19T09:05:14.179 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.179 INFO:teuthology.orchestra.run.smithi155.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:05:14.179 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_messages": 1170, 2024-09-19T09:05:14.179 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages": 1148, 2024-09-19T09:05:14.180 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_bytes": 1187072, 2024-09-19T09:05:14.180 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_bytes": 437804, 2024-09-19T09:05:14.180 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_created_connections": 3, 2024-09-19T09:05:14.180 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_active_connections": 2, 2024-09-19T09:05:14.180 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_total_time": 0.127813294, 2024-09-19T09:05:14.180 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_send_time": 0.043985019, 2024-09-19T09:05:14.180 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_recv_time": 0.055509653, 2024-09-19T09:05:14.180 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_running_fast_dispatch_time": 0.028174349, 2024-09-19T09:05:14.181 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:05:14.181 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 1148, 2024-09-19T09:05:14.181 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.060681853, 2024-09-19T09:05:14.181 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000052858 2024-09-19T09:05:14.181 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.181 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:05:14.181 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.182 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.182 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.182 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.182 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_recv_encrypted_bytes": 890720, 2024-09-19T09:05:14.182 INFO:teuthology.orchestra.run.smithi155.stdout: "msgr_send_encrypted_bytes": 157328 2024-09-19T09:05:14.182 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.182 INFO:teuthology.orchestra.run.smithi155.stdout: "cct": { 2024-09-19T09:05:14.182 INFO:teuthology.orchestra.run.smithi155.stdout: "total_workers": 1, 2024-09-19T09:05:14.183 INFO:teuthology.orchestra.run.smithi155.stdout: "unhealthy_workers": 0 2024-09-19T09:05:14.183 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.183 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-MDSRank": { 2024-09-19T09:05:14.183 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2024-09-19T09:05:14.183 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2024-09-19T09:05:14.183 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 4350, 2024-09-19T09:05:14.183 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.110034475, 2024-09-19T09:05:14.183 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000025295 2024-09-19T09:05:14.184 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T09:05:14.184 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.184 INFO:teuthology.orchestra.run.smithi155.stdout: "finisher-PurgeQueue": { 2024-09-19T09:05:14.184 INFO:teuthology.orchestra.run.smithi155.stdout: "queue_len": 0, 2024-09-19T09:05:14.184 INFO:teuthology.orchestra.run.smithi155.stdout: "complete_latency": { 2024-09-19T09:05:14.184 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.184 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.184 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.185 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T09:05:14.185 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.185 INFO:teuthology.orchestra.run.smithi155.stdout: "mds": { 2024-09-19T09:05:14.185 INFO:teuthology.orchestra.run.smithi155.stdout: "request": 0, 2024-09-19T09:05:14.185 INFO:teuthology.orchestra.run.smithi155.stdout: "reply": 0, 2024-09-19T09:05:14.185 INFO:teuthology.orchestra.run.smithi155.stdout: "reply_latency": { 2024-09-19T09:05:14.185 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.185 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.185 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.186 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.186 INFO:teuthology.orchestra.run.smithi155.stdout: "slow_reply": 0, 2024-09-19T09:05:14.186 INFO:teuthology.orchestra.run.smithi155.stdout: "forward": 0, 2024-09-19T09:05:14.186 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_fetch_complete": 0, 2024-09-19T09:05:14.186 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_fetch_keys": 0, 2024-09-19T09:05:14.186 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_commit": 0, 2024-09-19T09:05:14.187 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_split": 0, 2024-09-19T09:05:14.187 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_merge": 0, 2024-09-19T09:05:14.187 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes": 103, 2024-09-19T09:05:14.187 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_top": 0, 2024-09-19T09:05:14.187 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_bottom": 103, 2024-09-19T09:05:14.187 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pin_tail": 0, 2024-09-19T09:05:14.187 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_pinned": 103, 2024-09-19T09:05:14.187 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_expired": 0, 2024-09-19T09:05:14.188 INFO:teuthology.orchestra.run.smithi155.stdout: "inodes_with_caps": 0, 2024-09-19T09:05:14.188 INFO:teuthology.orchestra.run.smithi155.stdout: "caps": 0, 2024-09-19T09:05:14.188 INFO:teuthology.orchestra.run.smithi155.stdout: "subtrees": 1, 2024-09-19T09:05:14.188 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse": 0, 2024-09-19T09:05:14.188 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_hit": 0, 2024-09-19T09:05:14.188 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_forward": 0, 2024-09-19T09:05:14.188 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_discover": 0, 2024-09-19T09:05:14.188 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:05:14.189 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_remote_ino": 0, 2024-09-19T09:05:14.189 INFO:teuthology.orchestra.run.smithi155.stdout: "traverse_lock": 0, 2024-09-19T09:05:14.189 INFO:teuthology.orchestra.run.smithi155.stdout: "load_cent": 0, 2024-09-19T09:05:14.189 INFO:teuthology.orchestra.run.smithi155.stdout: "q": 0, 2024-09-19T09:05:14.189 INFO:teuthology.orchestra.run.smithi155.stdout: "exported": 0, 2024-09-19T09:05:14.189 INFO:teuthology.orchestra.run.smithi155.stdout: "exported_inodes": 0, 2024-09-19T09:05:14.189 INFO:teuthology.orchestra.run.smithi155.stdout: "imported": 0, 2024-09-19T09:05:14.189 INFO:teuthology.orchestra.run.smithi155.stdout: "imported_inodes": 0, 2024-09-19T09:05:14.190 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_dir_fetch": 0, 2024-09-19T09:05:14.190 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_backtrace_fetch": 0, 2024-09-19T09:05:14.190 INFO:teuthology.orchestra.run.smithi155.stdout: "openino_peer_discover": 0, 2024-09-19T09:05:14.190 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rfiles": 0, 2024-09-19T09:05:14.190 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rbytes": 0, 2024-09-19T09:05:14.190 INFO:teuthology.orchestra.run.smithi155.stdout: "root_rsnaps": 0, 2024-09-19T09:05:14.190 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T09:05:14.191 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_set_tag": 0, 2024-09-19T09:05:14.191 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:05:14.191 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:05:14.191 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:05:14.191 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:05:14.191 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:05:14.192 INFO:teuthology.orchestra.run.smithi155.stdout: "scrub_file_inodes": 0, 2024-09-19T09:05:14.192 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:05:14.192 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T09:05:14.192 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_grant": 0, 2024-09-19T09:05:14.192 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:05:14.192 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:05:14.192 INFO:teuthology.orchestra.run.smithi155.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:05:14.192 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_caps": 0, 2024-09-19T09:05:14.193 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_caps_dirty": 0, 2024-09-19T09:05:14.193 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_cap_release": 0, 2024-09-19T09:05:14.193 INFO:teuthology.orchestra.run.smithi155.stdout: "process_request_cap_release": 0 2024-09-19T09:05:14.193 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.193 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_cache": { 2024-09-19T09:05:14.193 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_update": 0, 2024-09-19T09:05:14.193 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_update_receipt": 0, 2024-09-19T09:05:14.194 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_try_discover": 0, 2024-09-19T09:05:14.194 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_send_discover": 0, 2024-09-19T09:05:14.194 INFO:teuthology.orchestra.run.smithi155.stdout: "dir_handle_discover": 0, 2024-09-19T09:05:14.195 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays": 0, 2024-09-19T09:05:14.195 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_delayed": 0, 2024-09-19T09:05:14.195 INFO:teuthology.orchestra.run.smithi155.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:05:14.195 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_created": 0, 2024-09-19T09:05:14.195 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_enqueued": 0, 2024-09-19T09:05:14.195 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_reintegrated": 0, 2024-09-19T09:05:14.195 INFO:teuthology.orchestra.run.smithi155.stdout: "strays_migrated": 0, 2024-09-19T09:05:14.196 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_processing": 0, 2024-09-19T09:05:14.196 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:05:14.196 INFO:teuthology.orchestra.run.smithi155.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:05:14.196 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_started": 0, 2024-09-19T09:05:14.197 INFO:teuthology.orchestra.run.smithi155.stdout: "recovery_completed": 0, 2024-09-19T09:05:14.197 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_quiesce_path": 0, 2024-09-19T09:05:14.197 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_quiesce_inode": 0, 2024-09-19T09:05:14.198 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:05:14.198 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_exportdir": 0, 2024-09-19T09:05:14.198 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_flush": 0, 2024-09-19T09:05:14.198 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:05:14.198 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_fragstats": 0, 2024-09-19T09:05:14.198 INFO:teuthology.orchestra.run.smithi155.stdout: "ireq_inodestats": 0 2024-09-19T09:05:14.199 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.199 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_log": { 2024-09-19T09:05:14.199 INFO:teuthology.orchestra.run.smithi155.stdout: "evlrg": 0, 2024-09-19T09:05:14.199 INFO:teuthology.orchestra.run.smithi155.stdout: "evadd": 0, 2024-09-19T09:05:14.199 INFO:teuthology.orchestra.run.smithi155.stdout: "evex": 0, 2024-09-19T09:05:14.199 INFO:teuthology.orchestra.run.smithi155.stdout: "evtrm": 0, 2024-09-19T09:05:14.199 INFO:teuthology.orchestra.run.smithi155.stdout: "ev": 340, 2024-09-19T09:05:14.199 INFO:teuthology.orchestra.run.smithi155.stdout: "evexg": 0, 2024-09-19T09:05:14.200 INFO:teuthology.orchestra.run.smithi155.stdout: "evexd": 0, 2024-09-19T09:05:14.200 INFO:teuthology.orchestra.run.smithi155.stdout: "segadd": 0, 2024-09-19T09:05:14.200 INFO:teuthology.orchestra.run.smithi155.stdout: "segex": 0, 2024-09-19T09:05:14.200 INFO:teuthology.orchestra.run.smithi155.stdout: "segtrm": 0, 2024-09-19T09:05:14.200 INFO:teuthology.orchestra.run.smithi155.stdout: "seg": 2, 2024-09-19T09:05:14.200 INFO:teuthology.orchestra.run.smithi155.stdout: "segmjr": 2, 2024-09-19T09:05:14.200 INFO:teuthology.orchestra.run.smithi155.stdout: "segexg": 0, 2024-09-19T09:05:14.200 INFO:teuthology.orchestra.run.smithi155.stdout: "segexd": 0, 2024-09-19T09:05:14.201 INFO:teuthology.orchestra.run.smithi155.stdout: "expos": 4194304, 2024-09-19T09:05:14.201 INFO:teuthology.orchestra.run.smithi155.stdout: "wrpos": 4957533, 2024-09-19T09:05:14.201 INFO:teuthology.orchestra.run.smithi155.stdout: "rdpos": 4956395, 2024-09-19T09:05:14.201 INFO:teuthology.orchestra.run.smithi155.stdout: "jlat": { 2024-09-19T09:05:14.201 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.201 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.201 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.201 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.202 INFO:teuthology.orchestra.run.smithi155.stdout: "replayed": 340 2024-09-19T09:05:14.202 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.202 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_mem": { 2024-09-19T09:05:14.202 INFO:teuthology.orchestra.run.smithi155.stdout: "ino": 4, 2024-09-19T09:05:14.202 INFO:teuthology.orchestra.run.smithi155.stdout: "ino+": 114, 2024-09-19T09:05:14.202 INFO:teuthology.orchestra.run.smithi155.stdout: "ino-": 110, 2024-09-19T09:05:14.202 INFO:teuthology.orchestra.run.smithi155.stdout: "dir": 2, 2024-09-19T09:05:14.202 INFO:teuthology.orchestra.run.smithi155.stdout: "dir+": 113, 2024-09-19T09:05:14.203 INFO:teuthology.orchestra.run.smithi155.stdout: "dir-": 111, 2024-09-19T09:05:14.203 INFO:teuthology.orchestra.run.smithi155.stdout: "dn": 103, 2024-09-19T09:05:14.203 INFO:teuthology.orchestra.run.smithi155.stdout: "dn+": 113, 2024-09-19T09:05:14.203 INFO:teuthology.orchestra.run.smithi155.stdout: "dn-": 10, 2024-09-19T09:05:14.203 INFO:teuthology.orchestra.run.smithi155.stdout: "cap": 0, 2024-09-19T09:05:14.203 INFO:teuthology.orchestra.run.smithi155.stdout: "cap+": 0, 2024-09-19T09:05:14.203 INFO:teuthology.orchestra.run.smithi155.stdout: "cap-": 0, 2024-09-19T09:05:14.204 INFO:teuthology.orchestra.run.smithi155.stdout: "rss": 48804, 2024-09-19T09:05:14.204 INFO:teuthology.orchestra.run.smithi155.stdout: "heap": 215328 2024-09-19T09:05:14.204 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.204 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_server": { 2024-09-19T09:05:14.204 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_client_request": 0, 2024-09-19T09:05:14.204 INFO:teuthology.orchestra.run.smithi155.stdout: "dispatch_server_request": 0, 2024-09-19T09:05:14.204 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_request": 0, 2024-09-19T09:05:14.204 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_client_session": 0, 2024-09-19T09:05:14.205 INFO:teuthology.orchestra.run.smithi155.stdout: "handle_peer_request": 0, 2024-09-19T09:05:14.205 INFO:teuthology.orchestra.run.smithi155.stdout: "req_create_latency": { 2024-09-19T09:05:14.205 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.205 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.205 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.205 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.205 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getattr_latency": { 2024-09-19T09:05:14.205 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.206 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.206 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.206 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.206 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getfilelock_latency": { 2024-09-19T09:05:14.206 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.206 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.206 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.206 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.207 INFO:teuthology.orchestra.run.smithi155.stdout: "req_link_latency": { 2024-09-19T09:05:14.207 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.207 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.207 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.207 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.207 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookup_latency": { 2024-09-19T09:05:14.207 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.207 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.208 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.208 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.208 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookuphash_latency": { 2024-09-19T09:05:14.208 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.208 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.208 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.208 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.208 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupino_latency": { 2024-09-19T09:05:14.209 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.209 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.209 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.209 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.210 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupname_latency": { 2024-09-19T09:05:14.210 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.211 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.211 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.211 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.211 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupparent_latency": { 2024-09-19T09:05:14.212 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.212 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.212 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.212 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.213 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lookupsnap_latency": { 2024-09-19T09:05:14.213 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.213 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.213 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.214 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.214 INFO:teuthology.orchestra.run.smithi155.stdout: "req_lssnap_latency": { 2024-09-19T09:05:14.214 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.215 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.215 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.215 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.215 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mkdir_latency": { 2024-09-19T09:05:14.216 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.216 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.216 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.216 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.217 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mknod_latency": { 2024-09-19T09:05:14.217 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.217 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.217 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.217 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.218 INFO:teuthology.orchestra.run.smithi155.stdout: "req_mksnap_latency": { 2024-09-19T09:05:14.218 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.218 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.218 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.219 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.219 INFO:teuthology.orchestra.run.smithi155.stdout: "req_open_latency": { 2024-09-19T09:05:14.219 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.219 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.220 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.220 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.220 INFO:teuthology.orchestra.run.smithi155.stdout: "req_readdir_latency": { 2024-09-19T09:05:14.221 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.221 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.221 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.221 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.222 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rename_latency": { 2024-09-19T09:05:14.222 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.222 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.223 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.223 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.223 INFO:teuthology.orchestra.run.smithi155.stdout: "req_renamesnap_latency": { 2024-09-19T09:05:14.223 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.223 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.224 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.224 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.224 INFO:teuthology.orchestra.run.smithi155.stdout: "req_snapdiff_latency": { 2024-09-19T09:05:14.224 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.224 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.225 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.225 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.225 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmdir_latency": { 2024-09-19T09:05:14.225 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.225 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.226 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.226 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.226 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmsnap_latency": { 2024-09-19T09:05:14.226 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.227 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.227 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.227 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.227 INFO:teuthology.orchestra.run.smithi155.stdout: "req_rmxattr_latency": { 2024-09-19T09:05:14.228 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.228 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.228 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.229 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.229 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setattr_latency": { 2024-09-19T09:05:14.229 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.230 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.230 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.230 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.231 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setdirlayout_latency": { 2024-09-19T09:05:14.231 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.231 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.231 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.231 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.231 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setfilelock_latency": { 2024-09-19T09:05:14.231 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.232 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.232 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.232 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.232 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setlayout_latency": { 2024-09-19T09:05:14.232 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.232 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.232 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.233 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.233 INFO:teuthology.orchestra.run.smithi155.stdout: "req_setxattr_latency": { 2024-09-19T09:05:14.233 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.233 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.233 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.233 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.233 INFO:teuthology.orchestra.run.smithi155.stdout: "req_symlink_latency": { 2024-09-19T09:05:14.234 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.234 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.234 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.234 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.234 INFO:teuthology.orchestra.run.smithi155.stdout: "req_unlink_latency": { 2024-09-19T09:05:14.234 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.235 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.235 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.235 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.235 INFO:teuthology.orchestra.run.smithi155.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:05:14.235 INFO:teuthology.orchestra.run.smithi155.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:05:14.235 INFO:teuthology.orchestra.run.smithi155.stdout: "req_getvxattr_latency": { 2024-09-19T09:05:14.235 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.235 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.236 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.236 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T09:05:14.236 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.236 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_sessions": { 2024-09-19T09:05:14.236 INFO:teuthology.orchestra.run.smithi155.stdout: "session_count": 1, 2024-09-19T09:05:14.236 INFO:teuthology.orchestra.run.smithi155.stdout: "session_add": 3, 2024-09-19T09:05:14.236 INFO:teuthology.orchestra.run.smithi155.stdout: "session_remove": 2, 2024-09-19T09:05:14.237 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_open": 2, 2024-09-19T09:05:14.237 INFO:teuthology.orchestra.run.smithi155.stdout: "sessions_stale": 0, 2024-09-19T09:05:14.237 INFO:teuthology.orchestra.run.smithi155.stdout: "total_load": 0, 2024-09-19T09:05:14.237 INFO:teuthology.orchestra.run.smithi155.stdout: "average_load": 0, 2024-09-19T09:05:14.237 INFO:teuthology.orchestra.run.smithi155.stdout: "avg_session_uptime": 3367, 2024-09-19T09:05:14.237 INFO:teuthology.orchestra.run.smithi155.stdout: "mdthresh_evicted": 0 2024-09-19T09:05:14.238 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.238 INFO:teuthology.orchestra.run.smithi155.stdout: "mempool": { 2024-09-19T09:05:14.238 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:05:14.238 INFO:teuthology.orchestra.run.smithi155.stdout: "bloom_filter_items": 0, 2024-09-19T09:05:14.238 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:05:14.239 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:05:14.239 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:05:14.239 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:05:14.239 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:05:14.239 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:05:14.239 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:05:14.239 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:05:14.239 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:05:14.240 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:05:14.240 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:05:14.240 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:05:14.240 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:05:14.240 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_extent_items": 0, 2024-09-19T09:05:14.240 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:05:14.240 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_blob_items": 0, 2024-09-19T09:05:14.240 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:05:14.241 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:05:14.241 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:05:14.241 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:05:14.241 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:05:14.242 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:05:14.242 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:05:14.242 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_txc_items": 0, 2024-09-19T09:05:14.242 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:05:14.242 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:05:14.242 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:05:14.242 INFO:teuthology.orchestra.run.smithi155.stdout: "bluestore_writing_items": 0, 2024-09-19T09:05:14.242 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_bytes": 0, 2024-09-19T09:05:14.243 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_items": 0, 2024-09-19T09:05:14.243 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:05:14.243 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:05:14.243 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:05:14.243 INFO:teuthology.orchestra.run.smithi155.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:05:14.243 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_bytes": 189384, 2024-09-19T09:05:14.243 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_anon_items": 50, 2024-09-19T09:05:14.243 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:05:14.244 INFO:teuthology.orchestra.run.smithi155.stdout: "buffer_meta_items": 0, 2024-09-19T09:05:14.244 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_bytes": 0, 2024-09-19T09:05:14.244 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_items": 0, 2024-09-19T09:05:14.244 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:05:14.244 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_mapbl_items": 0, 2024-09-19T09:05:14.244 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:05:14.244 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_pglog_items": 0, 2024-09-19T09:05:14.244 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_bytes": 7496, 2024-09-19T09:05:14.245 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_items": 154, 2024-09-19T09:05:14.245 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:05:14.245 INFO:teuthology.orchestra.run.smithi155.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:05:14.245 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_bytes": 0, 2024-09-19T09:05:14.245 INFO:teuthology.orchestra.run.smithi155.stdout: "pgmap_items": 0, 2024-09-19T09:05:14.245 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_bytes": 84568, 2024-09-19T09:05:14.245 INFO:teuthology.orchestra.run.smithi155.stdout: "mds_co_items": 441, 2024-09-19T09:05:14.246 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_bytes": 0, 2024-09-19T09:05:14.246 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_1_items": 0, 2024-09-19T09:05:14.246 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_bytes": 0, 2024-09-19T09:05:14.246 INFO:teuthology.orchestra.run.smithi155.stdout: "unittest_2_items": 0 2024-09-19T09:05:14.246 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.246 INFO:teuthology.orchestra.run.smithi155.stdout: "objecter": { 2024-09-19T09:05:14.246 INFO:teuthology.orchestra.run.smithi155.stdout: "op_active": 0, 2024-09-19T09:05:14.246 INFO:teuthology.orchestra.run.smithi155.stdout: "op_laggy": 0, 2024-09-19T09:05:14.246 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send": 2609, 2024-09-19T09:05:14.247 INFO:teuthology.orchestra.run.smithi155.stdout: "op_send_bytes": 21, 2024-09-19T09:05:14.247 INFO:teuthology.orchestra.run.smithi155.stdout: "op_resend": 3, 2024-09-19T09:05:14.247 INFO:teuthology.orchestra.run.smithi155.stdout: "op_reply": 2609, 2024-09-19T09:05:14.247 INFO:teuthology.orchestra.run.smithi155.stdout: "op_latency": { 2024-09-19T09:05:14.247 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 2609, 2024-09-19T09:05:14.247 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 5.307886139, 2024-09-19T09:05:14.247 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.002034452 2024-09-19T09:05:14.247 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.248 INFO:teuthology.orchestra.run.smithi155.stdout: "op_inflight": 0, 2024-09-19T09:05:14.248 INFO:teuthology.orchestra.run.smithi155.stdout: "oplen_avg": { 2024-09-19T09:05:14.248 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 2609, 2024-09-19T09:05:14.248 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 2610 2024-09-19T09:05:14.249 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.249 INFO:teuthology.orchestra.run.smithi155.stdout: "op": 2609, 2024-09-19T09:05:14.249 INFO:teuthology.orchestra.run.smithi155.stdout: "op_r": 2609, 2024-09-19T09:05:14.249 INFO:teuthology.orchestra.run.smithi155.stdout: "op_w": 0, 2024-09-19T09:05:14.249 INFO:teuthology.orchestra.run.smithi155.stdout: "op_rmw": 0, 2024-09-19T09:05:14.249 INFO:teuthology.orchestra.run.smithi155.stdout: "op_pg": 0, 2024-09-19T09:05:14.249 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_stat": 1680, 2024-09-19T09:05:14.250 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_create": 0, 2024-09-19T09:05:14.250 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_read": 927, 2024-09-19T09:05:14.250 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_write": 0, 2024-09-19T09:05:14.250 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writefull": 0, 2024-09-19T09:05:14.250 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_writesame": 0, 2024-09-19T09:05:14.250 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_append": 0, 2024-09-19T09:05:14.250 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_zero": 0, 2024-09-19T09:05:14.250 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_truncate": 0, 2024-09-19T09:05:14.251 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_delete": 0, 2024-09-19T09:05:14.251 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_mapext": 0, 2024-09-19T09:05:14.251 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_sparse_read": 0, 2024-09-19T09:05:14.251 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_clonerange": 0, 2024-09-19T09:05:14.251 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_getxattr": 1, 2024-09-19T09:05:14.251 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_setxattr": 0, 2024-09-19T09:05:14.251 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:05:14.251 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_rmxattr": 0, 2024-09-19T09:05:14.252 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:05:14.252 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_call": 0, 2024-09-19T09:05:14.252 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_watch": 0, 2024-09-19T09:05:14.252 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_notify": 0, 2024-09-19T09:05:14.252 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:05:14.252 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls": 0, 2024-09-19T09:05:14.252 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:05:14.252 INFO:teuthology.orchestra.run.smithi155.stdout: "osdop_other": 0, 2024-09-19T09:05:14.253 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_active": 0, 2024-09-19T09:05:14.253 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_send": 0, 2024-09-19T09:05:14.253 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_resend": 0, 2024-09-19T09:05:14.253 INFO:teuthology.orchestra.run.smithi155.stdout: "linger_ping": 0, 2024-09-19T09:05:14.253 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_active": 0, 2024-09-19T09:05:14.253 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_send": 0, 2024-09-19T09:05:14.253 INFO:teuthology.orchestra.run.smithi155.stdout: "poolop_resend": 0, 2024-09-19T09:05:14.253 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_active": 0, 2024-09-19T09:05:14.254 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_send": 0, 2024-09-19T09:05:14.254 INFO:teuthology.orchestra.run.smithi155.stdout: "poolstat_resend": 0, 2024-09-19T09:05:14.254 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_active": 0, 2024-09-19T09:05:14.254 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_send": 0, 2024-09-19T09:05:14.254 INFO:teuthology.orchestra.run.smithi155.stdout: "statfs_resend": 0, 2024-09-19T09:05:14.254 INFO:teuthology.orchestra.run.smithi155.stdout: "command_active": 0, 2024-09-19T09:05:14.254 INFO:teuthology.orchestra.run.smithi155.stdout: "command_send": 0, 2024-09-19T09:05:14.254 INFO:teuthology.orchestra.run.smithi155.stdout: "command_resend": 0, 2024-09-19T09:05:14.255 INFO:teuthology.orchestra.run.smithi155.stdout: "map_epoch": 88, 2024-09-19T09:05:14.255 INFO:teuthology.orchestra.run.smithi155.stdout: "map_full": 0, 2024-09-19T09:05:14.255 INFO:teuthology.orchestra.run.smithi155.stdout: "map_inc": 8, 2024-09-19T09:05:14.255 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_sessions": 5, 2024-09-19T09:05:14.255 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_open": 5, 2024-09-19T09:05:14.255 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_session_close": 0, 2024-09-19T09:05:14.255 INFO:teuthology.orchestra.run.smithi155.stdout: "osd_laggy": 0, 2024-09-19T09:05:14.255 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_wr": 0, 2024-09-19T09:05:14.255 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_rd": 2, 2024-09-19T09:05:14.256 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_del": 0 2024-09-19T09:05:14.256 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.256 INFO:teuthology.orchestra.run.smithi155.stdout: "oft": { 2024-09-19T09:05:14.256 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_objs": 0, 2024-09-19T09:05:14.256 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:05:14.256 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_updates": 0, 2024-09-19T09:05:14.256 INFO:teuthology.orchestra.run.smithi155.stdout: "omap_total_removes": 0 2024-09-19T09:05:14.257 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.257 INFO:teuthology.orchestra.run.smithi155.stdout: "osd-slow-ops": { 2024-09-19T09:05:14.257 INFO:teuthology.orchestra.run.smithi155.stdout: "slow_ops_count": 0 2024-09-19T09:05:14.257 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.258 INFO:teuthology.orchestra.run.smithi155.stdout: "purge_queue": { 2024-09-19T09:05:14.258 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops": 0, 2024-09-19T09:05:14.258 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T09:05:14.258 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing": 0, 2024-09-19T09:05:14.258 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executing_high_water": 0, 2024-09-19T09:05:14.258 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executed_ops": 0, 2024-09-19T09:05:14.258 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_executed": 0, 2024-09-19T09:05:14.258 INFO:teuthology.orchestra.run.smithi155.stdout: "pq_item_in_journal": 0 2024-09-19T09:05:14.259 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.259 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:05:14.259 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2024-09-19T09:05:14.259 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2024-09-19T09:05:14.259 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2024-09-19T09:05:14.259 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 2895, 2024-09-19T09:05:14.259 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 2112118, 2024-09-19T09:05:14.259 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:14.260 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 2895, 2024-09-19T09:05:14.260 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2024-09-19T09:05:14.260 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2024-09-19T09:05:14.260 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 2895, 2024-09-19T09:05:14.260 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 2112118, 2024-09-19T09:05:14.260 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2024-09-19T09:05:14.260 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.260 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.261 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.261 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T09:05:14.261 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.261 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_bytes": { 2024-09-19T09:05:14.261 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2024-09-19T09:05:14.261 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 104857600, 2024-09-19T09:05:14.261 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2024-09-19T09:05:14.261 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2024-09-19T09:05:14.262 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2024-09-19T09:05:14.262 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:14.262 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2024-09-19T09:05:14.262 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 2609, 2024-09-19T09:05:14.262 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 763234, 2024-09-19T09:05:14.262 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 2609, 2024-09-19T09:05:14.262 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 763234, 2024-09-19T09:05:14.262 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2024-09-19T09:05:14.263 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.263 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.263 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.263 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T09:05:14.263 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.263 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-objecter_ops": { 2024-09-19T09:05:14.263 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2024-09-19T09:05:14.263 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 1024, 2024-09-19T09:05:14.264 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2024-09-19T09:05:14.264 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2024-09-19T09:05:14.264 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2024-09-19T09:05:14.264 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:14.264 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2024-09-19T09:05:14.264 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 2609, 2024-09-19T09:05:14.264 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 2609, 2024-09-19T09:05:14.264 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 2609, 2024-09-19T09:05:14.265 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 2609, 2024-09-19T09:05:14.265 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2024-09-19T09:05:14.265 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.265 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.265 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.265 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T09:05:14.265 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.265 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:05:14.265 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2024-09-19T09:05:14.266 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2024-09-19T09:05:14.266 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2024-09-19T09:05:14.266 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2024-09-19T09:05:14.266 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2024-09-19T09:05:14.266 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:14.266 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2024-09-19T09:05:14.266 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2024-09-19T09:05:14.266 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2024-09-19T09:05:14.267 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 0, 2024-09-19T09:05:14.267 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 0, 2024-09-19T09:05:14.267 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2024-09-19T09:05:14.267 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.267 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.267 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.267 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T09:05:14.267 INFO:teuthology.orchestra.run.smithi155.stdout: }, 2024-09-19T09:05:14.268 INFO:teuthology.orchestra.run.smithi155.stdout: "throttle-write_buf_throttle-0x55ae4d0d0b40": { 2024-09-19T09:05:14.268 INFO:teuthology.orchestra.run.smithi155.stdout: "val": 0, 2024-09-19T09:05:14.268 INFO:teuthology.orchestra.run.smithi155.stdout: "max": 3758096384, 2024-09-19T09:05:14.268 INFO:teuthology.orchestra.run.smithi155.stdout: "get_started": 0, 2024-09-19T09:05:14.268 INFO:teuthology.orchestra.run.smithi155.stdout: "get": 0, 2024-09-19T09:05:14.268 INFO:teuthology.orchestra.run.smithi155.stdout: "get_sum": 0, 2024-09-19T09:05:14.268 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:14.268 INFO:teuthology.orchestra.run.smithi155.stdout: "get_or_fail_success": 0, 2024-09-19T09:05:14.269 INFO:teuthology.orchestra.run.smithi155.stdout: "take": 0, 2024-09-19T09:05:14.269 INFO:teuthology.orchestra.run.smithi155.stdout: "take_sum": 0, 2024-09-19T09:05:14.269 INFO:teuthology.orchestra.run.smithi155.stdout: "put": 0, 2024-09-19T09:05:14.269 INFO:teuthology.orchestra.run.smithi155.stdout: "put_sum": 0, 2024-09-19T09:05:14.269 INFO:teuthology.orchestra.run.smithi155.stdout: "wait": { 2024-09-19T09:05:14.269 INFO:teuthology.orchestra.run.smithi155.stdout: "avgcount": 0, 2024-09-19T09:05:14.269 INFO:teuthology.orchestra.run.smithi155.stdout: "sum": 0.000000000, 2024-09-19T09:05:14.269 INFO:teuthology.orchestra.run.smithi155.stdout: "avgtime": 0.000000000 2024-09-19T09:05:14.270 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T09:05:14.270 INFO:teuthology.orchestra.run.smithi155.stdout: } 2024-09-19T09:05:14.270 INFO:teuthology.orchestra.run.smithi155.stdout:} 2024-09-19T09:05:15.083 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-19T09:05:15.084 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-19T09:05:15.084 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-09-19T09:05:15.084 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2024-09-19T09:05:15.084 INFO:tasks.check_counter:Daemon mds.k mds.dir_split=0 2024-09-19T09:05:15.084 DEBUG:tasks.check_counter:Getting stats from c 2024-09-19T09:05:15.084 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-19T09:05:15.344 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:05:15.895 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-19T09:05:15.896 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:05:15.896 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 13682, 2024-09-19T09:05:15.896 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 7188, 2024-09-19T09:05:15.896 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 147327392, 2024-09-19T09:05:15.896 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 2284383, 2024-09-19T09:05:15.896 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 11, 2024-09-19T09:05:15.896 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 4, 2024-09-19T09:05:15.897 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.714560034, 2024-09-19T09:05:15.897 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.239239106, 2024-09-19T09:05:15.897 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.654508148, 2024-09-19T09:05:15.897 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.008177474, 2024-09-19T09:05:15.897 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:05:15.897 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 7190, 2024-09-19T09:05:15.897 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.172223461, 2024-09-19T09:05:15.897 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000023953 2024-09-19T09:05:15.898 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.898 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:05:15.898 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 19736, 2024-09-19T09:05:15.898 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.002942834, 2024-09-19T09:05:15.898 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000149 2024-09-19T09:05:15.898 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.898 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 913808, 2024-09-19T09:05:15.898 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 160896 2024-09-19T09:05:15.899 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.899 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:05:15.899 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 191, 2024-09-19T09:05:15.899 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 397, 2024-09-19T09:05:15.899 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 65837, 2024-09-19T09:05:15.899 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 918683, 2024-09-19T09:05:15.899 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 36, 2024-09-19T09:05:15.899 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 10, 2024-09-19T09:05:15.900 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.037490002, 2024-09-19T09:05:15.900 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.014226746, 2024-09-19T09:05:15.900 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.015759506, 2024-09-19T09:05:15.900 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.004145877, 2024-09-19T09:05:15.900 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:05:15.900 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 395, 2024-09-19T09:05:15.900 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.029397328, 2024-09-19T09:05:15.901 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000074423 2024-09-19T09:05:15.901 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.901 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:05:15.901 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 79, 2024-09-19T09:05:15.901 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000015880, 2024-09-19T09:05:15.901 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000201 2024-09-19T09:05:15.901 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.901 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 1248, 2024-09-19T09:05:15.902 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 497776 2024-09-19T09:05:15.902 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.902 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:05:15.902 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 10014, 2024-09-19T09:05:15.902 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 10330, 2024-09-19T09:05:15.902 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 3244214, 2024-09-19T09:05:15.902 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 1897470, 2024-09-19T09:05:15.902 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 16, 2024-09-19T09:05:15.903 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 7, 2024-09-19T09:05:15.903 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.915977623, 2024-09-19T09:05:15.903 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.342361066, 2024-09-19T09:05:15.903 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.809618604, 2024-09-19T09:05:15.903 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.004297597, 2024-09-19T09:05:15.903 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:05:15.903 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 10326, 2024-09-19T09:05:15.903 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.190854635, 2024-09-19T09:05:15.904 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000018482 2024-09-19T09:05:15.904 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.904 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:05:15.904 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 19885, 2024-09-19T09:05:15.904 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.003015685, 2024-09-19T09:05:15.904 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000151 2024-09-19T09:05:15.904 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.904 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 3169712, 2024-09-19T09:05:15.905 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 1720592 2024-09-19T09:05:15.905 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.905 INFO:teuthology.orchestra.run.smithi203.stdout: "cct": { 2024-09-19T09:05:15.905 INFO:teuthology.orchestra.run.smithi203.stdout: "total_workers": 1, 2024-09-19T09:05:15.905 INFO:teuthology.orchestra.run.smithi203.stdout: "unhealthy_workers": 0 2024-09-19T09:05:15.905 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.905 INFO:teuthology.orchestra.run.smithi203.stdout: "finisher-MDSRank": { 2024-09-19T09:05:15.905 INFO:teuthology.orchestra.run.smithi203.stdout: "queue_len": 0, 2024-09-19T09:05:15.906 INFO:teuthology.orchestra.run.smithi203.stdout: "complete_latency": { 2024-09-19T09:05:15.906 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 197, 2024-09-19T09:05:15.906 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.122908023, 2024-09-19T09:05:15.906 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000623898 2024-09-19T09:05:15.906 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T09:05:15.906 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.906 INFO:teuthology.orchestra.run.smithi203.stdout: "finisher-PurgeQueue": { 2024-09-19T09:05:15.906 INFO:teuthology.orchestra.run.smithi203.stdout: "queue_len": 0, 2024-09-19T09:05:15.906 INFO:teuthology.orchestra.run.smithi203.stdout: "complete_latency": { 2024-09-19T09:05:15.907 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 387, 2024-09-19T09:05:15.907 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.014037255, 2024-09-19T09:05:15.907 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000036271 2024-09-19T09:05:15.907 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T09:05:15.907 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.907 INFO:teuthology.orchestra.run.smithi203.stdout: "mds": { 2024-09-19T09:05:15.907 INFO:teuthology.orchestra.run.smithi203.stdout: "request": 9774, 2024-09-19T09:05:15.908 INFO:teuthology.orchestra.run.smithi203.stdout: "reply": 317, 2024-09-19T09:05:15.908 INFO:teuthology.orchestra.run.smithi203.stdout: "reply_latency": { 2024-09-19T09:05:15.908 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 317, 2024-09-19T09:05:15.908 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 17.747627468, 2024-09-19T09:05:15.908 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.055986206 2024-09-19T09:05:15.908 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.908 INFO:teuthology.orchestra.run.smithi203.stdout: "slow_reply": 0, 2024-09-19T09:05:15.908 INFO:teuthology.orchestra.run.smithi203.stdout: "forward": 9457, 2024-09-19T09:05:15.908 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_fetch_complete": 0, 2024-09-19T09:05:15.909 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_fetch_keys": 0, 2024-09-19T09:05:15.909 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_commit": 11, 2024-09-19T09:05:15.909 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_split": 0, 2024-09-19T09:05:15.909 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_merge": 0, 2024-09-19T09:05:15.909 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes": 19, 2024-09-19T09:05:15.909 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_top": 2, 2024-09-19T09:05:15.909 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_bottom": 7, 2024-09-19T09:05:15.910 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_pin_tail": 10, 2024-09-19T09:05:15.910 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_pinned": 15, 2024-09-19T09:05:15.910 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_expired": 31, 2024-09-19T09:05:15.910 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_with_caps": 1, 2024-09-19T09:05:15.910 INFO:teuthology.orchestra.run.smithi203.stdout: "caps": 1, 2024-09-19T09:05:15.910 INFO:teuthology.orchestra.run.smithi203.stdout: "subtrees": 3, 2024-09-19T09:05:15.910 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse": 12500, 2024-09-19T09:05:15.910 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_hit": 2833, 2024-09-19T09:05:15.911 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_forward": 9457, 2024-09-19T09:05:15.911 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_discover": 9, 2024-09-19T09:05:15.911 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:05:15.911 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_remote_ino": 0, 2024-09-19T09:05:15.911 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_lock": 1, 2024-09-19T09:05:15.911 INFO:teuthology.orchestra.run.smithi203.stdout: "load_cent": 0, 2024-09-19T09:05:15.911 INFO:teuthology.orchestra.run.smithi203.stdout: "q": 0, 2024-09-19T09:05:15.911 INFO:teuthology.orchestra.run.smithi203.stdout: "exported": 1, 2024-09-19T09:05:15.912 INFO:teuthology.orchestra.run.smithi203.stdout: "exported_inodes": 1, 2024-09-19T09:05:15.912 INFO:teuthology.orchestra.run.smithi203.stdout: "imported": 1, 2024-09-19T09:05:15.912 INFO:teuthology.orchestra.run.smithi203.stdout: "imported_inodes": 2, 2024-09-19T09:05:15.912 INFO:teuthology.orchestra.run.smithi203.stdout: "openino_dir_fetch": 0, 2024-09-19T09:05:15.912 INFO:teuthology.orchestra.run.smithi203.stdout: "openino_backtrace_fetch": 1, 2024-09-19T09:05:15.912 INFO:teuthology.orchestra.run.smithi203.stdout: "openino_peer_discover": 0, 2024-09-19T09:05:15.912 INFO:teuthology.orchestra.run.smithi203.stdout: "root_rfiles": 4, 2024-09-19T09:05:15.912 INFO:teuthology.orchestra.run.smithi203.stdout: "root_rbytes": 234, 2024-09-19T09:05:15.913 INFO:teuthology.orchestra.run.smithi203.stdout: "root_rsnaps": 0, 2024-09-19T09:05:15.913 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_backtrace_fetch": 1, 2024-09-19T09:05:15.913 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_set_tag": 0, 2024-09-19T09:05:15.913 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:05:15.913 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:05:15.913 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_dir_inodes": 1, 2024-09-19T09:05:15.913 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:05:15.913 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_dirfrag_rstats": 1, 2024-09-19T09:05:15.914 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_file_inodes": 0, 2024-09-19T09:05:15.914 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:05:15.914 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_revoke": 12, 2024-09-19T09:05:15.914 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_grant": 113, 2024-09-19T09:05:15.914 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:05:15.914 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:05:15.914 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:05:15.914 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_caps": 12, 2024-09-19T09:05:15.914 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_caps_dirty": 1, 2024-09-19T09:05:15.915 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_cap_release": 25, 2024-09-19T09:05:15.915 INFO:teuthology.orchestra.run.smithi203.stdout: "process_request_cap_release": 105 2024-09-19T09:05:15.915 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.915 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_cache": { 2024-09-19T09:05:15.915 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_update": 1, 2024-09-19T09:05:15.915 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_update_receipt": 5149, 2024-09-19T09:05:15.915 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_try_discover": 2579, 2024-09-19T09:05:15.916 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_send_discover": 2579, 2024-09-19T09:05:15.916 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_handle_discover": 2, 2024-09-19T09:05:15.916 INFO:teuthology.orchestra.run.smithi203.stdout: "num_strays": 0, 2024-09-19T09:05:15.916 INFO:teuthology.orchestra.run.smithi203.stdout: "num_strays_delayed": 0, 2024-09-19T09:05:15.916 INFO:teuthology.orchestra.run.smithi203.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:05:15.916 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_created": 102, 2024-09-19T09:05:15.917 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_enqueued": 102, 2024-09-19T09:05:15.917 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_reintegrated": 0, 2024-09-19T09:05:15.917 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_migrated": 0, 2024-09-19T09:05:15.917 INFO:teuthology.orchestra.run.smithi203.stdout: "num_recovering_processing": 0, 2024-09-19T09:05:15.917 INFO:teuthology.orchestra.run.smithi203.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:05:15.917 INFO:teuthology.orchestra.run.smithi203.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:05:15.917 INFO:teuthology.orchestra.run.smithi203.stdout: "recovery_started": 0, 2024-09-19T09:05:15.918 INFO:teuthology.orchestra.run.smithi203.stdout: "recovery_completed": 0, 2024-09-19T09:05:15.918 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_quiesce_path": 10, 2024-09-19T09:05:15.918 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_quiesce_inode": 86, 2024-09-19T09:05:15.918 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:05:15.918 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_exportdir": 1, 2024-09-19T09:05:15.918 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_flush": 0, 2024-09-19T09:05:15.918 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:05:15.919 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_fragstats": 0, 2024-09-19T09:05:15.919 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_inodestats": 0 2024-09-19T09:05:15.919 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.919 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_log": { 2024-09-19T09:05:15.919 INFO:teuthology.orchestra.run.smithi203.stdout: "evlrg": 0, 2024-09-19T09:05:15.919 INFO:teuthology.orchestra.run.smithi203.stdout: "evadd": 340, 2024-09-19T09:05:15.919 INFO:teuthology.orchestra.run.smithi203.stdout: "evex": 0, 2024-09-19T09:05:15.919 INFO:teuthology.orchestra.run.smithi203.stdout: "evtrm": 0, 2024-09-19T09:05:15.920 INFO:teuthology.orchestra.run.smithi203.stdout: "ev": 340, 2024-09-19T09:05:15.920 INFO:teuthology.orchestra.run.smithi203.stdout: "evexg": 0, 2024-09-19T09:05:15.920 INFO:teuthology.orchestra.run.smithi203.stdout: "evexd": 0, 2024-09-19T09:05:15.920 INFO:teuthology.orchestra.run.smithi203.stdout: "segadd": 2, 2024-09-19T09:05:15.920 INFO:teuthology.orchestra.run.smithi203.stdout: "segex": 0, 2024-09-19T09:05:15.920 INFO:teuthology.orchestra.run.smithi203.stdout: "segtrm": 0, 2024-09-19T09:05:15.920 INFO:teuthology.orchestra.run.smithi203.stdout: "seg": 2, 2024-09-19T09:05:15.920 INFO:teuthology.orchestra.run.smithi203.stdout: "segmjr": 2, 2024-09-19T09:05:15.921 INFO:teuthology.orchestra.run.smithi203.stdout: "segexg": 0, 2024-09-19T09:05:15.921 INFO:teuthology.orchestra.run.smithi203.stdout: "segexd": 0, 2024-09-19T09:05:15.921 INFO:teuthology.orchestra.run.smithi203.stdout: "expos": 4194304, 2024-09-19T09:05:15.921 INFO:teuthology.orchestra.run.smithi203.stdout: "wrpos": 4957533, 2024-09-19T09:05:15.921 INFO:teuthology.orchestra.run.smithi203.stdout: "rdpos": 0, 2024-09-19T09:05:15.921 INFO:teuthology.orchestra.run.smithi203.stdout: "jlat": { 2024-09-19T09:05:15.921 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 51, 2024-09-19T09:05:15.922 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.113460639, 2024-09-19T09:05:15.922 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.002224718 2024-09-19T09:05:15.922 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.922 INFO:teuthology.orchestra.run.smithi203.stdout: "replayed": 0 2024-09-19T09:05:15.922 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.922 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_mem": { 2024-09-19T09:05:15.922 INFO:teuthology.orchestra.run.smithi203.stdout: "ino": 23, 2024-09-19T09:05:15.923 INFO:teuthology.orchestra.run.smithi203.stdout: "ino+": 145, 2024-09-19T09:05:15.923 INFO:teuthology.orchestra.run.smithi203.stdout: "ino-": 122, 2024-09-19T09:05:15.923 INFO:teuthology.orchestra.run.smithi203.stdout: "dir": 29, 2024-09-19T09:05:15.923 INFO:teuthology.orchestra.run.smithi203.stdout: "dir+": 2910, 2024-09-19T09:05:15.923 INFO:teuthology.orchestra.run.smithi203.stdout: "dir-": 2881, 2024-09-19T09:05:15.923 INFO:teuthology.orchestra.run.smithi203.stdout: "dn": 19, 2024-09-19T09:05:15.923 INFO:teuthology.orchestra.run.smithi203.stdout: "dn+": 153, 2024-09-19T09:05:15.923 INFO:teuthology.orchestra.run.smithi203.stdout: "dn-": 134, 2024-09-19T09:05:15.924 INFO:teuthology.orchestra.run.smithi203.stdout: "cap": 1, 2024-09-19T09:05:15.924 INFO:teuthology.orchestra.run.smithi203.stdout: "cap+": 106, 2024-09-19T09:05:15.924 INFO:teuthology.orchestra.run.smithi203.stdout: "cap-": 105, 2024-09-19T09:05:15.924 INFO:teuthology.orchestra.run.smithi203.stdout: "rss": 64300, 2024-09-19T09:05:15.924 INFO:teuthology.orchestra.run.smithi203.stdout: "heap": 223520 2024-09-19T09:05:15.924 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.924 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_server": { 2024-09-19T09:05:15.924 INFO:teuthology.orchestra.run.smithi203.stdout: "dispatch_client_request": 9792, 2024-09-19T09:05:15.924 INFO:teuthology.orchestra.run.smithi203.stdout: "dispatch_server_request": 2, 2024-09-19T09:05:15.925 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_request": 9774, 2024-09-19T09:05:15.925 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_session": 19, 2024-09-19T09:05:15.925 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_peer_request": 6, 2024-09-19T09:05:15.925 INFO:teuthology.orchestra.run.smithi203.stdout: "req_create_latency": { 2024-09-19T09:05:15.925 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:15.925 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:15.925 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:15.925 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.926 INFO:teuthology.orchestra.run.smithi203.stdout: "req_getattr_latency": { 2024-09-19T09:05:15.926 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 2, 2024-09-19T09:05:15.926 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.006144832, 2024-09-19T09:05:15.926 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.003072416 2024-09-19T09:05:15.926 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.926 INFO:teuthology.orchestra.run.smithi203.stdout: "req_getfilelock_latency": { 2024-09-19T09:05:15.926 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:15.926 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:15.926 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:15.927 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.927 INFO:teuthology.orchestra.run.smithi203.stdout: "req_link_latency": { 2024-09-19T09:05:15.927 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:15.927 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:15.927 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:15.927 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.927 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookup_latency": { 2024-09-19T09:05:15.927 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 112, 2024-09-19T09:05:15.928 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 1.038581672, 2024-09-19T09:05:15.928 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.009273050 2024-09-19T09:05:15.928 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.928 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookuphash_latency": { 2024-09-19T09:05:15.928 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:15.928 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:15.928 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:15.928 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.929 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupino_latency": { 2024-09-19T09:05:15.929 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:15.929 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:15.929 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:15.929 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.929 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupname_latency": { 2024-09-19T09:05:15.929 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:15.929 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:15.930 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:15.930 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.930 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupparent_latency": { 2024-09-19T09:05:15.930 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:15.930 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:15.930 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:15.930 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.930 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupsnap_latency": { 2024-09-19T09:05:15.930 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:15.931 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:15.931 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:15.931 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.931 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lssnap_latency": { 2024-09-19T09:05:15.931 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:15.931 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:15.932 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:15.932 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.932 INFO:teuthology.orchestra.run.smithi203.stdout: "req_mkdir_latency": { 2024-09-19T09:05:15.932 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 100, 2024-09-19T09:05:15.933 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.081665467, 2024-09-19T09:05:15.933 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000816654 2024-09-19T09:05:15.933 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.933 INFO:teuthology.orchestra.run.smithi203.stdout: "req_mknod_latency": { 2024-09-19T09:05:15.933 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:15.933 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:15.933 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:15.933 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.934 INFO:teuthology.orchestra.run.smithi203.stdout: "req_mksnap_latency": { 2024-09-19T09:05:15.934 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:15.934 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:15.934 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:15.934 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.934 INFO:teuthology.orchestra.run.smithi203.stdout: "req_open_latency": { 2024-09-19T09:05:15.934 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:15.934 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:15.935 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:15.935 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.935 INFO:teuthology.orchestra.run.smithi203.stdout: "req_readdir_latency": { 2024-09-19T09:05:15.935 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:15.935 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:15.935 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:15.935 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.935 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rename_latency": { 2024-09-19T09:05:15.936 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:15.936 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:15.936 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:15.936 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.936 INFO:teuthology.orchestra.run.smithi203.stdout: "req_renamesnap_latency": { 2024-09-19T09:05:15.936 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:15.936 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:15.937 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:15.937 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.937 INFO:teuthology.orchestra.run.smithi203.stdout: "req_snapdiff_latency": { 2024-09-19T09:05:15.937 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:15.937 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:15.937 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:15.937 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.937 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rmdir_latency": { 2024-09-19T09:05:15.937 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 102, 2024-09-19T09:05:15.938 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 16.619753780, 2024-09-19T09:05:15.938 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.162938762 2024-09-19T09:05:15.938 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.938 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rmsnap_latency": { 2024-09-19T09:05:15.938 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:15.938 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:15.938 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:15.938 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.939 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rmxattr_latency": { 2024-09-19T09:05:15.939 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:15.939 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:15.939 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:15.939 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.939 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setattr_latency": { 2024-09-19T09:05:15.939 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:15.939 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:15.939 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:15.940 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.940 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setdirlayout_latency": { 2024-09-19T09:05:15.940 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:15.940 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:15.940 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:15.940 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.940 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setfilelock_latency": { 2024-09-19T09:05:15.940 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:15.941 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:15.941 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:15.941 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.941 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setlayout_latency": { 2024-09-19T09:05:15.941 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:15.941 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:15.941 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:15.941 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.942 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setxattr_latency": { 2024-09-19T09:05:15.942 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 1, 2024-09-19T09:05:15.942 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.001481717, 2024-09-19T09:05:15.942 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.001481717 2024-09-19T09:05:15.942 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.942 INFO:teuthology.orchestra.run.smithi203.stdout: "req_symlink_latency": { 2024-09-19T09:05:15.942 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:15.942 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:15.943 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:15.943 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.943 INFO:teuthology.orchestra.run.smithi203.stdout: "req_unlink_latency": { 2024-09-19T09:05:15.943 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:15.943 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:15.943 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:15.943 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.943 INFO:teuthology.orchestra.run.smithi203.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:05:15.943 INFO:teuthology.orchestra.run.smithi203.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:05:15.944 INFO:teuthology.orchestra.run.smithi203.stdout: "req_getvxattr_latency": { 2024-09-19T09:05:15.944 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:15.944 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:15.944 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:15.944 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T09:05:15.944 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.944 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_sessions": { 2024-09-19T09:05:15.944 INFO:teuthology.orchestra.run.smithi203.stdout: "session_count": 1, 2024-09-19T09:05:15.945 INFO:teuthology.orchestra.run.smithi203.stdout: "session_add": 3, 2024-09-19T09:05:15.945 INFO:teuthology.orchestra.run.smithi203.stdout: "session_remove": 2, 2024-09-19T09:05:15.945 INFO:teuthology.orchestra.run.smithi203.stdout: "sessions_open": 1, 2024-09-19T09:05:15.945 INFO:teuthology.orchestra.run.smithi203.stdout: "sessions_stale": 0, 2024-09-19T09:05:15.945 INFO:teuthology.orchestra.run.smithi203.stdout: "total_load": 1, 2024-09-19T09:05:15.945 INFO:teuthology.orchestra.run.smithi203.stdout: "average_load": 1, 2024-09-19T09:05:15.945 INFO:teuthology.orchestra.run.smithi203.stdout: "avg_session_uptime": 783, 2024-09-19T09:05:15.945 INFO:teuthology.orchestra.run.smithi203.stdout: "mdthresh_evicted": 0 2024-09-19T09:05:15.946 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.946 INFO:teuthology.orchestra.run.smithi203.stdout: "mempool": { 2024-09-19T09:05:15.946 INFO:teuthology.orchestra.run.smithi203.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:05:15.946 INFO:teuthology.orchestra.run.smithi203.stdout: "bloom_filter_items": 0, 2024-09-19T09:05:15.946 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:05:15.946 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:05:15.946 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:05:15.946 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:05:15.946 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:05:15.947 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:05:15.947 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:05:15.947 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:05:15.947 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:05:15.947 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:05:15.947 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:05:15.947 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:05:15.947 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:05:15.947 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_extent_items": 0, 2024-09-19T09:05:15.948 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:05:15.948 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_blob_items": 0, 2024-09-19T09:05:15.948 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:05:15.948 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:05:15.948 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:05:15.948 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:05:15.948 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:05:15.949 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:05:15.949 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:05:15.949 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_txc_items": 0, 2024-09-19T09:05:15.949 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:05:15.949 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:05:15.949 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:05:15.949 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_items": 0, 2024-09-19T09:05:15.949 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_bytes": 0, 2024-09-19T09:05:15.949 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_items": 0, 2024-09-19T09:05:15.950 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:05:15.950 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:05:15.950 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:05:15.950 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:05:15.950 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_anon_bytes": 296540, 2024-09-19T09:05:15.950 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_anon_items": 109, 2024-09-19T09:05:15.950 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:05:15.950 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_meta_items": 0, 2024-09-19T09:05:15.950 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_bytes": 0, 2024-09-19T09:05:15.951 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_items": 0, 2024-09-19T09:05:15.951 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:05:15.951 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_mapbl_items": 0, 2024-09-19T09:05:15.951 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:05:15.951 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_pglog_items": 0, 2024-09-19T09:05:15.951 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_bytes": 7496, 2024-09-19T09:05:15.951 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_items": 154, 2024-09-19T09:05:15.952 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:05:15.952 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:05:15.952 INFO:teuthology.orchestra.run.smithi203.stdout: "pgmap_bytes": 0, 2024-09-19T09:05:15.952 INFO:teuthology.orchestra.run.smithi203.stdout: "pgmap_items": 0, 2024-09-19T09:05:15.952 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_co_bytes": 104798, 2024-09-19T09:05:15.952 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_co_items": 438, 2024-09-19T09:05:15.952 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_1_bytes": 0, 2024-09-19T09:05:15.952 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_1_items": 0, 2024-09-19T09:05:15.953 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_2_bytes": 0, 2024-09-19T09:05:15.953 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_2_items": 0 2024-09-19T09:05:15.953 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.953 INFO:teuthology.orchestra.run.smithi203.stdout: "objecter": { 2024-09-19T09:05:15.953 INFO:teuthology.orchestra.run.smithi203.stdout: "op_active": 0, 2024-09-19T09:05:15.953 INFO:teuthology.orchestra.run.smithi203.stdout: "op_laggy": 0, 2024-09-19T09:05:15.953 INFO:teuthology.orchestra.run.smithi203.stdout: "op_send": 385, 2024-09-19T09:05:15.953 INFO:teuthology.orchestra.run.smithi203.stdout: "op_send_bytes": 795456, 2024-09-19T09:05:15.954 INFO:teuthology.orchestra.run.smithi203.stdout: "op_resend": 30, 2024-09-19T09:05:15.954 INFO:teuthology.orchestra.run.smithi203.stdout: "op_reply": 385, 2024-09-19T09:05:15.954 INFO:teuthology.orchestra.run.smithi203.stdout: "op_latency": { 2024-09-19T09:05:15.954 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 385, 2024-09-19T09:05:15.954 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.766980714, 2024-09-19T09:05:15.954 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.001992157 2024-09-19T09:05:15.954 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.954 INFO:teuthology.orchestra.run.smithi203.stdout: "op_inflight": 0, 2024-09-19T09:05:15.955 INFO:teuthology.orchestra.run.smithi203.stdout: "oplen_avg": { 2024-09-19T09:05:15.955 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 385, 2024-09-19T09:05:15.955 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 463 2024-09-19T09:05:15.955 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.955 INFO:teuthology.orchestra.run.smithi203.stdout: "op": 385, 2024-09-19T09:05:15.955 INFO:teuthology.orchestra.run.smithi203.stdout: "op_r": 51, 2024-09-19T09:05:15.955 INFO:teuthology.orchestra.run.smithi203.stdout: "op_w": 334, 2024-09-19T09:05:15.955 INFO:teuthology.orchestra.run.smithi203.stdout: "op_rmw": 0, 2024-09-19T09:05:15.956 INFO:teuthology.orchestra.run.smithi203.stdout: "op_pg": 0, 2024-09-19T09:05:15.956 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_stat": 0, 2024-09-19T09:05:15.956 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_create": 10, 2024-09-19T09:05:15.956 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_read": 50, 2024-09-19T09:05:15.956 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_write": 101, 2024-09-19T09:05:15.956 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_writefull": 45, 2024-09-19T09:05:15.956 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_writesame": 0, 2024-09-19T09:05:15.956 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_append": 0, 2024-09-19T09:05:15.956 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_zero": 0, 2024-09-19T09:05:15.957 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_truncate": 0, 2024-09-19T09:05:15.957 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_delete": 114, 2024-09-19T09:05:15.957 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_mapext": 0, 2024-09-19T09:05:15.957 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_sparse_read": 0, 2024-09-19T09:05:15.957 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_clonerange": 0, 2024-09-19T09:05:15.957 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_getxattr": 1, 2024-09-19T09:05:15.957 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_setxattr": 20, 2024-09-19T09:05:15.957 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:05:15.958 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_rmxattr": 0, 2024-09-19T09:05:15.958 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:05:15.958 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_call": 0, 2024-09-19T09:05:15.958 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_watch": 0, 2024-09-19T09:05:15.958 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_notify": 0, 2024-09-19T09:05:15.958 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:05:15.958 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_pgls": 0, 2024-09-19T09:05:15.958 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:05:15.959 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_other": 0, 2024-09-19T09:05:15.959 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_active": 0, 2024-09-19T09:05:15.959 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_send": 0, 2024-09-19T09:05:15.959 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_resend": 0, 2024-09-19T09:05:15.959 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_ping": 0, 2024-09-19T09:05:15.959 INFO:teuthology.orchestra.run.smithi203.stdout: "poolop_active": 0, 2024-09-19T09:05:15.959 INFO:teuthology.orchestra.run.smithi203.stdout: "poolop_send": 0, 2024-09-19T09:05:15.960 INFO:teuthology.orchestra.run.smithi203.stdout: "poolop_resend": 0, 2024-09-19T09:05:15.960 INFO:teuthology.orchestra.run.smithi203.stdout: "poolstat_active": 0, 2024-09-19T09:05:15.960 INFO:teuthology.orchestra.run.smithi203.stdout: "poolstat_send": 0, 2024-09-19T09:05:15.960 INFO:teuthology.orchestra.run.smithi203.stdout: "poolstat_resend": 0, 2024-09-19T09:05:15.960 INFO:teuthology.orchestra.run.smithi203.stdout: "statfs_active": 0, 2024-09-19T09:05:15.960 INFO:teuthology.orchestra.run.smithi203.stdout: "statfs_send": 0, 2024-09-19T09:05:15.960 INFO:teuthology.orchestra.run.smithi203.stdout: "statfs_resend": 0, 2024-09-19T09:05:15.961 INFO:teuthology.orchestra.run.smithi203.stdout: "command_active": 0, 2024-09-19T09:05:15.961 INFO:teuthology.orchestra.run.smithi203.stdout: "command_send": 0, 2024-09-19T09:05:15.961 INFO:teuthology.orchestra.run.smithi203.stdout: "command_resend": 0, 2024-09-19T09:05:15.961 INFO:teuthology.orchestra.run.smithi203.stdout: "map_epoch": 88, 2024-09-19T09:05:15.961 INFO:teuthology.orchestra.run.smithi203.stdout: "map_full": 0, 2024-09-19T09:05:15.961 INFO:teuthology.orchestra.run.smithi203.stdout: "map_inc": 8, 2024-09-19T09:05:15.961 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_sessions": 11, 2024-09-19T09:05:15.961 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_session_open": 11, 2024-09-19T09:05:15.961 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_session_close": 0, 2024-09-19T09:05:15.962 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_laggy": 0, 2024-09-19T09:05:15.962 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_wr": 99, 2024-09-19T09:05:15.962 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_rd": 0, 2024-09-19T09:05:15.962 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_del": 23 2024-09-19T09:05:15.962 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.962 INFO:teuthology.orchestra.run.smithi203.stdout: "oft": { 2024-09-19T09:05:15.962 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_objs": 1, 2024-09-19T09:05:15.963 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:05:15.963 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_updates": 0, 2024-09-19T09:05:15.963 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_removes": 0 2024-09-19T09:05:15.963 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.963 INFO:teuthology.orchestra.run.smithi203.stdout: "osd-slow-ops": { 2024-09-19T09:05:15.963 INFO:teuthology.orchestra.run.smithi203.stdout: "slow_ops_count": 68 2024-09-19T09:05:15.963 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.964 INFO:teuthology.orchestra.run.smithi203.stdout: "purge_queue": { 2024-09-19T09:05:15.964 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing_ops": 0, 2024-09-19T09:05:15.964 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing_ops_high_water": 6, 2024-09-19T09:05:15.964 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing": 0, 2024-09-19T09:05:15.964 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing_high_water": 6, 2024-09-19T09:05:15.965 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executed_ops": 102, 2024-09-19T09:05:15.965 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executed": 102, 2024-09-19T09:05:15.965 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_item_in_journal": 0 2024-09-19T09:05:15.965 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.965 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:05:15.965 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-09-19T09:05:15.965 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 104857600, 2024-09-19T09:05:15.966 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-09-19T09:05:15.966 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 23883, 2024-09-19T09:05:15.966 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 148051774, 2024-09-19T09:05:15.966 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:15.966 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 23883, 2024-09-19T09:05:15.966 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 0, 2024-09-19T09:05:15.966 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 0, 2024-09-19T09:05:15.966 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 23883, 2024-09-19T09:05:15.967 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 148051774, 2024-09-19T09:05:15.967 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-09-19T09:05:15.967 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:15.967 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:15.967 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:15.967 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T09:05:15.967 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.967 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-objecter_bytes": { 2024-09-19T09:05:15.968 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-09-19T09:05:15.968 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 104857600, 2024-09-19T09:05:15.968 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-09-19T09:05:15.968 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 0, 2024-09-19T09:05:15.968 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 0, 2024-09-19T09:05:15.968 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:15.968 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 0, 2024-09-19T09:05:15.968 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 385, 2024-09-19T09:05:15.969 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 805758, 2024-09-19T09:05:15.969 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 385, 2024-09-19T09:05:15.969 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 805758, 2024-09-19T09:05:15.969 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-09-19T09:05:15.969 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:15.969 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:15.969 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:15.970 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T09:05:15.970 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.970 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-objecter_ops": { 2024-09-19T09:05:15.970 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-09-19T09:05:15.970 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 1024, 2024-09-19T09:05:15.970 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-09-19T09:05:15.970 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 0, 2024-09-19T09:05:15.971 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 0, 2024-09-19T09:05:15.971 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:15.971 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 0, 2024-09-19T09:05:15.971 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 385, 2024-09-19T09:05:15.971 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 385, 2024-09-19T09:05:15.971 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 385, 2024-09-19T09:05:15.971 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 385, 2024-09-19T09:05:15.972 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-09-19T09:05:15.972 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:15.972 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:15.972 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:15.972 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T09:05:15.972 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.972 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:05:15.973 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-09-19T09:05:15.973 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 3758096384, 2024-09-19T09:05:15.973 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-09-19T09:05:15.973 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 102, 2024-09-19T09:05:15.973 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 10302, 2024-09-19T09:05:15.973 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:15.973 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 102, 2024-09-19T09:05:15.973 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 0, 2024-09-19T09:05:15.973 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 0, 2024-09-19T09:05:15.974 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 50, 2024-09-19T09:05:15.974 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 10302, 2024-09-19T09:05:15.974 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-09-19T09:05:15.974 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:15.974 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:15.974 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:15.974 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T09:05:15.975 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:15.975 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-write_buf_throttle-0x55cbd215c960": { 2024-09-19T09:05:15.975 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-09-19T09:05:15.975 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 3758096384, 2024-09-19T09:05:15.975 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-09-19T09:05:15.975 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 340, 2024-09-19T09:05:15.975 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 763229, 2024-09-19T09:05:15.975 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:15.976 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 340, 2024-09-19T09:05:15.976 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 0, 2024-09-19T09:05:15.976 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 0, 2024-09-19T09:05:15.976 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 51, 2024-09-19T09:05:15.976 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 763229, 2024-09-19T09:05:15.976 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-09-19T09:05:15.976 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:15.976 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:15.977 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:15.977 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T09:05:15.977 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T09:05:15.977 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-19T09:05:16.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:15 smithi019 ceph-mon[30976]: pgmap v734: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-19T09:05:16.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:15 smithi155 ceph-mon[34921]: pgmap v734: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-19T09:05:16.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:15 smithi203 ceph-mon[35450]: pgmap v734: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-09-19T09:05:16.861 INFO:tasks.check_counter:Daemon mds.c mds.exported=1 2024-09-19T09:05:16.861 INFO:tasks.check_counter:Daemon mds.c mds.imported=1 2024-09-19T09:05:16.861 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=1 2024-09-19T09:05:16.862 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=5149 2024-09-19T09:05:16.862 INFO:tasks.check_counter:Daemon mds.c mds.dir_split=0 2024-09-19T09:05:16.862 DEBUG:tasks.check_counter:Getting stats from f 2024-09-19T09:05:16.862 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-19T09:05:17.110 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:05:17.603 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-19T09:05:17.604 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:05:17.604 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 85, 2024-09-19T09:05:17.604 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 70, 2024-09-19T09:05:17.604 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 46735, 2024-09-19T09:05:17.604 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 397452, 2024-09-19T09:05:17.604 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 40, 2024-09-19T09:05:17.604 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 7, 2024-09-19T09:05:17.605 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.018286459, 2024-09-19T09:05:17.605 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.002189563, 2024-09-19T09:05:17.605 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.012939868, 2024-09-19T09:05:17.605 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.000412876, 2024-09-19T09:05:17.605 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:05:17.605 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 66, 2024-09-19T09:05:17.605 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.011664929, 2024-09-19T09:05:17.606 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000176741 2024-09-19T09:05:17.606 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.606 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:05:17.606 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 85, 2024-09-19T09:05:17.606 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000010979, 2024-09-19T09:05:17.606 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000129 2024-09-19T09:05:17.606 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.606 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 928, 2024-09-19T09:05:17.607 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 736 2024-09-19T09:05:17.607 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.607 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:05:17.607 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 13569, 2024-09-19T09:05:17.607 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 7016, 2024-09-19T09:05:17.607 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 147268278, 2024-09-19T09:05:17.607 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 1392140, 2024-09-19T09:05:17.607 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 6, 2024-09-19T09:05:17.608 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 4, 2024-09-19T09:05:17.608 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.656968944, 2024-09-19T09:05:17.608 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.219836037, 2024-09-19T09:05:17.608 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.616695061, 2024-09-19T09:05:17.608 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.005285732, 2024-09-19T09:05:17.608 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:05:17.608 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 7017, 2024-09-19T09:05:17.608 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.175248749, 2024-09-19T09:05:17.609 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000024974 2024-09-19T09:05:17.609 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.609 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:05:17.609 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 19619, 2024-09-19T09:05:17.609 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.002810664, 2024-09-19T09:05:17.609 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000143 2024-09-19T09:05:17.609 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.609 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 899552, 2024-09-19T09:05:17.610 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 160400 2024-09-19T09:05:17.610 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.610 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:05:17.610 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 35, 2024-09-19T09:05:17.610 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 221, 2024-09-19T09:05:17.610 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 9840, 2024-09-19T09:05:17.610 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 555757, 2024-09-19T09:05:17.610 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 12, 2024-09-19T09:05:17.611 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 5, 2024-09-19T09:05:17.611 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.024063250, 2024-09-19T09:05:17.612 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.009991870, 2024-09-19T09:05:17.612 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.011406925, 2024-09-19T09:05:17.612 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.000354586, 2024-09-19T09:05:17.612 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:05:17.612 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 220, 2024-09-19T09:05:17.612 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.031047315, 2024-09-19T09:05:17.612 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000141124 2024-09-19T09:05:17.612 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.613 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:05:17.613 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 24, 2024-09-19T09:05:17.613 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000004439, 2024-09-19T09:05:17.613 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000184 2024-09-19T09:05:17.613 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.613 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 5184, 2024-09-19T09:05:17.613 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 499328 2024-09-19T09:05:17.613 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.614 INFO:teuthology.orchestra.run.smithi203.stdout: "cct": { 2024-09-19T09:05:17.614 INFO:teuthology.orchestra.run.smithi203.stdout: "total_workers": 1, 2024-09-19T09:05:17.614 INFO:teuthology.orchestra.run.smithi203.stdout: "unhealthy_workers": 0 2024-09-19T09:05:17.614 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.614 INFO:teuthology.orchestra.run.smithi203.stdout: "finisher-MDSRank": { 2024-09-19T09:05:17.614 INFO:teuthology.orchestra.run.smithi203.stdout: "queue_len": 0, 2024-09-19T09:05:17.614 INFO:teuthology.orchestra.run.smithi203.stdout: "complete_latency": { 2024-09-19T09:05:17.614 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 30, 2024-09-19T09:05:17.615 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.002571343, 2024-09-19T09:05:17.615 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000085711 2024-09-19T09:05:17.615 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T09:05:17.615 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.615 INFO:teuthology.orchestra.run.smithi203.stdout: "finisher-PurgeQueue": { 2024-09-19T09:05:17.615 INFO:teuthology.orchestra.run.smithi203.stdout: "queue_len": 0, 2024-09-19T09:05:17.615 INFO:teuthology.orchestra.run.smithi203.stdout: "complete_latency": { 2024-09-19T09:05:17.616 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 2, 2024-09-19T09:05:17.616 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000010709, 2024-09-19T09:05:17.616 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000005354 2024-09-19T09:05:17.616 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T09:05:17.617 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.617 INFO:teuthology.orchestra.run.smithi203.stdout: "mds": { 2024-09-19T09:05:17.617 INFO:teuthology.orchestra.run.smithi203.stdout: "request": 0, 2024-09-19T09:05:17.617 INFO:teuthology.orchestra.run.smithi203.stdout: "reply": 0, 2024-09-19T09:05:17.617 INFO:teuthology.orchestra.run.smithi203.stdout: "reply_latency": { 2024-09-19T09:05:17.617 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:17.617 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:17.617 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:17.618 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.618 INFO:teuthology.orchestra.run.smithi203.stdout: "slow_reply": 0, 2024-09-19T09:05:17.618 INFO:teuthology.orchestra.run.smithi203.stdout: "forward": 0, 2024-09-19T09:05:17.618 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_fetch_complete": 0, 2024-09-19T09:05:17.618 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_fetch_keys": 0, 2024-09-19T09:05:17.618 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_commit": 11, 2024-09-19T09:05:17.618 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_split": 0, 2024-09-19T09:05:17.619 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_merge": 0, 2024-09-19T09:05:17.619 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes": 21, 2024-09-19T09:05:17.619 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_top": 3, 2024-09-19T09:05:17.619 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_bottom": 18, 2024-09-19T09:05:17.619 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_pin_tail": 0, 2024-09-19T09:05:17.619 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_pinned": 14, 2024-09-19T09:05:17.620 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_expired": 31, 2024-09-19T09:05:17.620 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_with_caps": 0, 2024-09-19T09:05:17.620 INFO:teuthology.orchestra.run.smithi203.stdout: "caps": 0, 2024-09-19T09:05:17.620 INFO:teuthology.orchestra.run.smithi203.stdout: "subtrees": 4, 2024-09-19T09:05:17.620 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse": 2600, 2024-09-19T09:05:17.620 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_hit": 2592, 2024-09-19T09:05:17.621 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_forward": 0, 2024-09-19T09:05:17.621 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_discover": 8, 2024-09-19T09:05:17.621 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:05:17.621 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_remote_ino": 0, 2024-09-19T09:05:17.621 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_lock": 0, 2024-09-19T09:05:17.621 INFO:teuthology.orchestra.run.smithi203.stdout: "load_cent": 0, 2024-09-19T09:05:17.621 INFO:teuthology.orchestra.run.smithi203.stdout: "q": 0, 2024-09-19T09:05:17.621 INFO:teuthology.orchestra.run.smithi203.stdout: "exported": 0, 2024-09-19T09:05:17.622 INFO:teuthology.orchestra.run.smithi203.stdout: "exported_inodes": 0, 2024-09-19T09:05:17.622 INFO:teuthology.orchestra.run.smithi203.stdout: "imported": 0, 2024-09-19T09:05:17.622 INFO:teuthology.orchestra.run.smithi203.stdout: "imported_inodes": 0, 2024-09-19T09:05:17.622 INFO:teuthology.orchestra.run.smithi203.stdout: "openino_dir_fetch": 0, 2024-09-19T09:05:17.622 INFO:teuthology.orchestra.run.smithi203.stdout: "openino_backtrace_fetch": 0, 2024-09-19T09:05:17.622 INFO:teuthology.orchestra.run.smithi203.stdout: "openino_peer_discover": 0, 2024-09-19T09:05:17.622 INFO:teuthology.orchestra.run.smithi203.stdout: "root_rfiles": 4, 2024-09-19T09:05:17.622 INFO:teuthology.orchestra.run.smithi203.stdout: "root_rbytes": 234, 2024-09-19T09:05:17.623 INFO:teuthology.orchestra.run.smithi203.stdout: "root_rsnaps": 0, 2024-09-19T09:05:17.623 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T09:05:17.623 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_set_tag": 0, 2024-09-19T09:05:17.623 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:05:17.623 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:05:17.623 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:05:17.623 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:05:17.623 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:05:17.623 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_file_inodes": 0, 2024-09-19T09:05:17.624 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:05:17.624 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T09:05:17.624 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_grant": 0, 2024-09-19T09:05:17.624 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:05:17.624 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:05:17.624 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:05:17.624 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_caps": 0, 2024-09-19T09:05:17.624 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_caps_dirty": 0, 2024-09-19T09:05:17.625 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_cap_release": 0, 2024-09-19T09:05:17.625 INFO:teuthology.orchestra.run.smithi203.stdout: "process_request_cap_release": 0 2024-09-19T09:05:17.625 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.625 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_cache": { 2024-09-19T09:05:17.625 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_update": 0, 2024-09-19T09:05:17.625 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_update_receipt": 5148, 2024-09-19T09:05:17.625 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_try_discover": 2578, 2024-09-19T09:05:17.625 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_send_discover": 2579, 2024-09-19T09:05:17.625 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_handle_discover": 0, 2024-09-19T09:05:17.626 INFO:teuthology.orchestra.run.smithi203.stdout: "num_strays": 0, 2024-09-19T09:05:17.626 INFO:teuthology.orchestra.run.smithi203.stdout: "num_strays_delayed": 0, 2024-09-19T09:05:17.626 INFO:teuthology.orchestra.run.smithi203.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:05:17.626 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_created": 0, 2024-09-19T09:05:17.626 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_enqueued": 0, 2024-09-19T09:05:17.626 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_reintegrated": 0, 2024-09-19T09:05:17.626 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_migrated": 0, 2024-09-19T09:05:17.626 INFO:teuthology.orchestra.run.smithi203.stdout: "num_recovering_processing": 0, 2024-09-19T09:05:17.627 INFO:teuthology.orchestra.run.smithi203.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:05:17.627 INFO:teuthology.orchestra.run.smithi203.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:05:17.627 INFO:teuthology.orchestra.run.smithi203.stdout: "recovery_started": 0, 2024-09-19T09:05:17.627 INFO:teuthology.orchestra.run.smithi203.stdout: "recovery_completed": 0, 2024-09-19T09:05:17.627 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_quiesce_path": 10, 2024-09-19T09:05:17.627 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_quiesce_inode": 91, 2024-09-19T09:05:17.627 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:05:17.627 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_exportdir": 0, 2024-09-19T09:05:17.627 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_flush": 0, 2024-09-19T09:05:17.628 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:05:17.628 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_fragstats": 0, 2024-09-19T09:05:17.628 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_inodestats": 0 2024-09-19T09:05:17.628 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.628 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_log": { 2024-09-19T09:05:17.628 INFO:teuthology.orchestra.run.smithi203.stdout: "evlrg": 0, 2024-09-19T09:05:17.628 INFO:teuthology.orchestra.run.smithi203.stdout: "evadd": 5, 2024-09-19T09:05:17.628 INFO:teuthology.orchestra.run.smithi203.stdout: "evex": 0, 2024-09-19T09:05:17.629 INFO:teuthology.orchestra.run.smithi203.stdout: "evtrm": 0, 2024-09-19T09:05:17.629 INFO:teuthology.orchestra.run.smithi203.stdout: "ev": 5, 2024-09-19T09:05:17.629 INFO:teuthology.orchestra.run.smithi203.stdout: "evexg": 0, 2024-09-19T09:05:17.629 INFO:teuthology.orchestra.run.smithi203.stdout: "evexd": 0, 2024-09-19T09:05:17.629 INFO:teuthology.orchestra.run.smithi203.stdout: "segadd": 2, 2024-09-19T09:05:17.629 INFO:teuthology.orchestra.run.smithi203.stdout: "segex": 0, 2024-09-19T09:05:17.629 INFO:teuthology.orchestra.run.smithi203.stdout: "segtrm": 0, 2024-09-19T09:05:17.629 INFO:teuthology.orchestra.run.smithi203.stdout: "seg": 2, 2024-09-19T09:05:17.630 INFO:teuthology.orchestra.run.smithi203.stdout: "segmjr": 2, 2024-09-19T09:05:17.630 INFO:teuthology.orchestra.run.smithi203.stdout: "segexg": 0, 2024-09-19T09:05:17.630 INFO:teuthology.orchestra.run.smithi203.stdout: "segexd": 0, 2024-09-19T09:05:17.630 INFO:teuthology.orchestra.run.smithi203.stdout: "expos": 4194304, 2024-09-19T09:05:17.630 INFO:teuthology.orchestra.run.smithi203.stdout: "wrpos": 4195734, 2024-09-19T09:05:17.630 INFO:teuthology.orchestra.run.smithi203.stdout: "rdpos": 0, 2024-09-19T09:05:17.630 INFO:teuthology.orchestra.run.smithi203.stdout: "jlat": { 2024-09-19T09:05:17.630 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 4, 2024-09-19T09:05:17.631 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.007604892, 2024-09-19T09:05:17.631 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.001901223 2024-09-19T09:05:17.631 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.631 INFO:teuthology.orchestra.run.smithi203.stdout: "replayed": 0 2024-09-19T09:05:17.631 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.631 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_mem": { 2024-09-19T09:05:17.631 INFO:teuthology.orchestra.run.smithi203.stdout: "ino": 26, 2024-09-19T09:05:17.632 INFO:teuthology.orchestra.run.smithi203.stdout: "ino+": 46, 2024-09-19T09:05:17.632 INFO:teuthology.orchestra.run.smithi203.stdout: "ino-": 20, 2024-09-19T09:05:17.632 INFO:teuthology.orchestra.run.smithi203.stdout: "dir": 32, 2024-09-19T09:05:17.632 INFO:teuthology.orchestra.run.smithi203.stdout: "dir+": 2811, 2024-09-19T09:05:17.632 INFO:teuthology.orchestra.run.smithi203.stdout: "dir-": 2779, 2024-09-19T09:05:17.632 INFO:teuthology.orchestra.run.smithi203.stdout: "dn": 21, 2024-09-19T09:05:17.632 INFO:teuthology.orchestra.run.smithi203.stdout: "dn+": 52, 2024-09-19T09:05:17.632 INFO:teuthology.orchestra.run.smithi203.stdout: "dn-": 31, 2024-09-19T09:05:17.633 INFO:teuthology.orchestra.run.smithi203.stdout: "cap": 0, 2024-09-19T09:05:17.633 INFO:teuthology.orchestra.run.smithi203.stdout: "cap+": 0, 2024-09-19T09:05:17.633 INFO:teuthology.orchestra.run.smithi203.stdout: "cap-": 0, 2024-09-19T09:05:17.633 INFO:teuthology.orchestra.run.smithi203.stdout: "rss": 59520, 2024-09-19T09:05:17.633 INFO:teuthology.orchestra.run.smithi203.stdout: "heap": 223520 2024-09-19T09:05:17.634 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.634 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_server": { 2024-09-19T09:05:17.634 INFO:teuthology.orchestra.run.smithi203.stdout: "dispatch_client_request": 0, 2024-09-19T09:05:17.634 INFO:teuthology.orchestra.run.smithi203.stdout: "dispatch_server_request": 2, 2024-09-19T09:05:17.634 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_request": 0, 2024-09-19T09:05:17.634 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_session": 14, 2024-09-19T09:05:17.635 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_peer_request": 4, 2024-09-19T09:05:17.635 INFO:teuthology.orchestra.run.smithi203.stdout: "req_create_latency": { 2024-09-19T09:05:17.635 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:17.635 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:17.635 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:17.635 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.635 INFO:teuthology.orchestra.run.smithi203.stdout: "req_getattr_latency": { 2024-09-19T09:05:17.635 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:17.636 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:17.636 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:17.636 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.636 INFO:teuthology.orchestra.run.smithi203.stdout: "req_getfilelock_latency": { 2024-09-19T09:05:17.636 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:17.636 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:17.636 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:17.637 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.637 INFO:teuthology.orchestra.run.smithi203.stdout: "req_link_latency": { 2024-09-19T09:05:17.637 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:17.637 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:17.637 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:17.637 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.637 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookup_latency": { 2024-09-19T09:05:17.637 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:17.638 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:17.638 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:17.638 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.638 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookuphash_latency": { 2024-09-19T09:05:17.638 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:17.638 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:17.638 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:17.638 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.639 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupino_latency": { 2024-09-19T09:05:17.639 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:17.639 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:17.639 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:17.639 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.639 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupname_latency": { 2024-09-19T09:05:17.639 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:17.639 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:17.639 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:17.640 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.640 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupparent_latency": { 2024-09-19T09:05:17.640 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:17.640 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:17.640 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:17.641 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.641 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupsnap_latency": { 2024-09-19T09:05:17.641 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:17.641 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:17.641 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:17.641 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.641 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lssnap_latency": { 2024-09-19T09:05:17.641 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:17.642 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:17.642 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:17.642 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.642 INFO:teuthology.orchestra.run.smithi203.stdout: "req_mkdir_latency": { 2024-09-19T09:05:17.643 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:17.643 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:17.644 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:17.644 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.644 INFO:teuthology.orchestra.run.smithi203.stdout: "req_mknod_latency": { 2024-09-19T09:05:17.644 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:17.644 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:17.644 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:17.645 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.645 INFO:teuthology.orchestra.run.smithi203.stdout: "req_mksnap_latency": { 2024-09-19T09:05:17.645 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:17.645 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:17.645 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:17.645 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.645 INFO:teuthology.orchestra.run.smithi203.stdout: "req_open_latency": { 2024-09-19T09:05:17.646 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:17.646 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:17.646 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:17.646 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.646 INFO:teuthology.orchestra.run.smithi203.stdout: "req_readdir_latency": { 2024-09-19T09:05:17.646 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:17.646 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:17.646 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:17.647 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.647 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rename_latency": { 2024-09-19T09:05:17.647 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:17.647 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:17.647 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:17.647 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.647 INFO:teuthology.orchestra.run.smithi203.stdout: "req_renamesnap_latency": { 2024-09-19T09:05:17.647 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:17.648 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:17.648 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:17.648 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.648 INFO:teuthology.orchestra.run.smithi203.stdout: "req_snapdiff_latency": { 2024-09-19T09:05:17.648 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:17.648 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:17.649 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:17.649 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.649 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rmdir_latency": { 2024-09-19T09:05:17.649 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:17.649 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:17.649 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:17.649 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.650 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rmsnap_latency": { 2024-09-19T09:05:17.650 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:17.650 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:17.650 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:17.650 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.650 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rmxattr_latency": { 2024-09-19T09:05:17.650 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:17.650 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:17.651 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:17.651 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.651 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setattr_latency": { 2024-09-19T09:05:17.651 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:17.651 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:17.651 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:17.651 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.651 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setdirlayout_latency": { 2024-09-19T09:05:17.652 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:17.652 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:17.652 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:17.652 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.652 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setfilelock_latency": { 2024-09-19T09:05:17.652 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:17.652 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:17.652 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:17.653 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.653 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setlayout_latency": { 2024-09-19T09:05:17.653 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:17.653 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:17.653 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:17.653 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.653 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setxattr_latency": { 2024-09-19T09:05:17.653 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:17.654 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:17.654 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:17.654 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.654 INFO:teuthology.orchestra.run.smithi203.stdout: "req_symlink_latency": { 2024-09-19T09:05:17.654 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:17.654 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:17.654 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:17.654 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.655 INFO:teuthology.orchestra.run.smithi203.stdout: "req_unlink_latency": { 2024-09-19T09:05:17.655 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:17.655 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:17.655 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:17.655 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.655 INFO:teuthology.orchestra.run.smithi203.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:05:17.655 INFO:teuthology.orchestra.run.smithi203.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:05:17.655 INFO:teuthology.orchestra.run.smithi203.stdout: "req_getvxattr_latency": { 2024-09-19T09:05:17.656 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:17.656 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:17.656 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:17.656 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T09:05:17.656 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.656 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_sessions": { 2024-09-19T09:05:17.656 INFO:teuthology.orchestra.run.smithi203.stdout: "session_count": 1, 2024-09-19T09:05:17.656 INFO:teuthology.orchestra.run.smithi203.stdout: "session_add": 2, 2024-09-19T09:05:17.657 INFO:teuthology.orchestra.run.smithi203.stdout: "session_remove": 1, 2024-09-19T09:05:17.657 INFO:teuthology.orchestra.run.smithi203.stdout: "sessions_open": 1, 2024-09-19T09:05:17.657 INFO:teuthology.orchestra.run.smithi203.stdout: "sessions_stale": 0, 2024-09-19T09:05:17.657 INFO:teuthology.orchestra.run.smithi203.stdout: "total_load": 0, 2024-09-19T09:05:17.657 INFO:teuthology.orchestra.run.smithi203.stdout: "average_load": 0, 2024-09-19T09:05:17.657 INFO:teuthology.orchestra.run.smithi203.stdout: "avg_session_uptime": 697, 2024-09-19T09:05:17.657 INFO:teuthology.orchestra.run.smithi203.stdout: "mdthresh_evicted": 0 2024-09-19T09:05:17.657 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.658 INFO:teuthology.orchestra.run.smithi203.stdout: "mempool": { 2024-09-19T09:05:17.658 INFO:teuthology.orchestra.run.smithi203.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:05:17.658 INFO:teuthology.orchestra.run.smithi203.stdout: "bloom_filter_items": 0, 2024-09-19T09:05:17.658 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:05:17.658 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:05:17.658 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:05:17.659 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:05:17.659 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:05:17.659 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:05:17.659 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:05:17.659 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:05:17.659 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:05:17.659 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:05:17.659 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:05:17.660 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:05:17.660 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:05:17.660 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_extent_items": 0, 2024-09-19T09:05:17.660 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:05:17.660 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_blob_items": 0, 2024-09-19T09:05:17.660 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:05:17.660 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:05:17.660 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:05:17.661 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:05:17.661 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:05:17.661 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:05:17.661 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:05:17.661 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_txc_items": 0, 2024-09-19T09:05:17.661 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:05:17.661 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:05:17.661 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:05:17.662 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_items": 0, 2024-09-19T09:05:17.662 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_bytes": 0, 2024-09-19T09:05:17.662 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_items": 0, 2024-09-19T09:05:17.662 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:05:17.662 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:05:17.662 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:05:17.662 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:05:17.663 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_anon_bytes": 230524, 2024-09-19T09:05:17.663 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_anon_items": 79, 2024-09-19T09:05:17.663 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:05:17.663 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_meta_items": 0, 2024-09-19T09:05:17.663 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_bytes": 0, 2024-09-19T09:05:17.663 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_items": 0, 2024-09-19T09:05:17.663 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:05:17.664 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_mapbl_items": 0, 2024-09-19T09:05:17.664 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:05:17.664 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_pglog_items": 0, 2024-09-19T09:05:17.664 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_bytes": 7496, 2024-09-19T09:05:17.664 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_items": 154, 2024-09-19T09:05:17.664 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:05:17.664 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:05:17.664 INFO:teuthology.orchestra.run.smithi203.stdout: "pgmap_bytes": 0, 2024-09-19T09:05:17.665 INFO:teuthology.orchestra.run.smithi203.stdout: "pgmap_items": 0, 2024-09-19T09:05:17.665 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_co_bytes": 115294, 2024-09-19T09:05:17.665 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_co_items": 425, 2024-09-19T09:05:17.665 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_1_bytes": 0, 2024-09-19T09:05:17.665 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_1_items": 0, 2024-09-19T09:05:17.665 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_2_bytes": 0, 2024-09-19T09:05:17.665 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_2_items": 0 2024-09-19T09:05:17.665 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.666 INFO:teuthology.orchestra.run.smithi203.stdout: "objecter": { 2024-09-19T09:05:17.666 INFO:teuthology.orchestra.run.smithi203.stdout: "op_active": 0, 2024-09-19T09:05:17.666 INFO:teuthology.orchestra.run.smithi203.stdout: "op_laggy": 0, 2024-09-19T09:05:17.666 INFO:teuthology.orchestra.run.smithi203.stdout: "op_send": 40, 2024-09-19T09:05:17.666 INFO:teuthology.orchestra.run.smithi203.stdout: "op_send_bytes": 11732, 2024-09-19T09:05:17.666 INFO:teuthology.orchestra.run.smithi203.stdout: "op_resend": 33, 2024-09-19T09:05:17.666 INFO:teuthology.orchestra.run.smithi203.stdout: "op_reply": 40, 2024-09-19T09:05:17.666 INFO:teuthology.orchestra.run.smithi203.stdout: "op_latency": { 2024-09-19T09:05:17.667 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 40, 2024-09-19T09:05:17.667 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.214994659, 2024-09-19T09:05:17.667 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.005374866 2024-09-19T09:05:17.667 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.667 INFO:teuthology.orchestra.run.smithi203.stdout: "op_inflight": 0, 2024-09-19T09:05:17.667 INFO:teuthology.orchestra.run.smithi203.stdout: "oplen_avg": { 2024-09-19T09:05:17.667 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 40, 2024-09-19T09:05:17.667 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 62 2024-09-19T09:05:17.668 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.668 INFO:teuthology.orchestra.run.smithi203.stdout: "op": 40, 2024-09-19T09:05:17.668 INFO:teuthology.orchestra.run.smithi203.stdout: "op_r": 0, 2024-09-19T09:05:17.668 INFO:teuthology.orchestra.run.smithi203.stdout: "op_w": 40, 2024-09-19T09:05:17.668 INFO:teuthology.orchestra.run.smithi203.stdout: "op_rmw": 0, 2024-09-19T09:05:17.668 INFO:teuthology.orchestra.run.smithi203.stdout: "op_pg": 0, 2024-09-19T09:05:17.668 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_stat": 0, 2024-09-19T09:05:17.668 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_create": 10, 2024-09-19T09:05:17.668 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_read": 0, 2024-09-19T09:05:17.669 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_write": 4, 2024-09-19T09:05:17.669 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_writefull": 7, 2024-09-19T09:05:17.669 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_writesame": 0, 2024-09-19T09:05:17.669 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_append": 0, 2024-09-19T09:05:17.669 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_zero": 0, 2024-09-19T09:05:17.669 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_truncate": 0, 2024-09-19T09:05:17.670 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_delete": 6, 2024-09-19T09:05:17.670 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_mapext": 0, 2024-09-19T09:05:17.670 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_sparse_read": 0, 2024-09-19T09:05:17.670 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_clonerange": 0, 2024-09-19T09:05:17.670 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_getxattr": 0, 2024-09-19T09:05:17.670 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_setxattr": 20, 2024-09-19T09:05:17.671 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:05:17.671 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_rmxattr": 0, 2024-09-19T09:05:17.671 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:05:17.671 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_call": 0, 2024-09-19T09:05:17.671 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_watch": 0, 2024-09-19T09:05:17.671 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_notify": 0, 2024-09-19T09:05:17.671 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:05:17.671 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_pgls": 0, 2024-09-19T09:05:17.672 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:05:17.672 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_other": 0, 2024-09-19T09:05:17.672 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_active": 0, 2024-09-19T09:05:17.672 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_send": 0, 2024-09-19T09:05:17.672 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_resend": 0, 2024-09-19T09:05:17.672 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_ping": 0, 2024-09-19T09:05:17.672 INFO:teuthology.orchestra.run.smithi203.stdout: "poolop_active": 0, 2024-09-19T09:05:17.673 INFO:teuthology.orchestra.run.smithi203.stdout: "poolop_send": 0, 2024-09-19T09:05:17.673 INFO:teuthology.orchestra.run.smithi203.stdout: "poolop_resend": 0, 2024-09-19T09:05:17.673 INFO:teuthology.orchestra.run.smithi203.stdout: "poolstat_active": 0, 2024-09-19T09:05:17.673 INFO:teuthology.orchestra.run.smithi203.stdout: "poolstat_send": 0, 2024-09-19T09:05:17.673 INFO:teuthology.orchestra.run.smithi203.stdout: "poolstat_resend": 0, 2024-09-19T09:05:17.673 INFO:teuthology.orchestra.run.smithi203.stdout: "statfs_active": 0, 2024-09-19T09:05:17.673 INFO:teuthology.orchestra.run.smithi203.stdout: "statfs_send": 0, 2024-09-19T09:05:17.673 INFO:teuthology.orchestra.run.smithi203.stdout: "statfs_resend": 0, 2024-09-19T09:05:17.674 INFO:teuthology.orchestra.run.smithi203.stdout: "command_active": 0, 2024-09-19T09:05:17.674 INFO:teuthology.orchestra.run.smithi203.stdout: "command_send": 0, 2024-09-19T09:05:17.674 INFO:teuthology.orchestra.run.smithi203.stdout: "command_resend": 0, 2024-09-19T09:05:17.674 INFO:teuthology.orchestra.run.smithi203.stdout: "map_epoch": 88, 2024-09-19T09:05:17.674 INFO:teuthology.orchestra.run.smithi203.stdout: "map_full": 0, 2024-09-19T09:05:17.674 INFO:teuthology.orchestra.run.smithi203.stdout: "map_inc": 8, 2024-09-19T09:05:17.674 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_sessions": 9, 2024-09-19T09:05:17.674 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_session_open": 9, 2024-09-19T09:05:17.675 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_session_close": 0, 2024-09-19T09:05:17.675 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_laggy": 0, 2024-09-19T09:05:17.675 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_wr": 14, 2024-09-19T09:05:17.676 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_rd": 0, 2024-09-19T09:05:17.676 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_del": 1 2024-09-19T09:05:17.676 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.676 INFO:teuthology.orchestra.run.smithi203.stdout: "oft": { 2024-09-19T09:05:17.676 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_objs": 1, 2024-09-19T09:05:17.676 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:05:17.676 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_updates": 0, 2024-09-19T09:05:17.676 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_removes": 0 2024-09-19T09:05:17.677 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.677 INFO:teuthology.orchestra.run.smithi203.stdout: "osd-slow-ops": { 2024-09-19T09:05:17.677 INFO:teuthology.orchestra.run.smithi203.stdout: "slow_ops_count": 75 2024-09-19T09:05:17.677 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.677 INFO:teuthology.orchestra.run.smithi203.stdout: "purge_queue": { 2024-09-19T09:05:17.677 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing_ops": 0, 2024-09-19T09:05:17.677 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T09:05:17.677 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing": 0, 2024-09-19T09:05:17.678 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing_high_water": 0, 2024-09-19T09:05:17.678 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executed_ops": 0, 2024-09-19T09:05:17.678 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executed": 0, 2024-09-19T09:05:17.678 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_item_in_journal": 0 2024-09-19T09:05:17.678 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.678 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:05:17.678 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-09-19T09:05:17.678 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 104857600, 2024-09-19T09:05:17.679 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-09-19T09:05:17.679 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 13685, 2024-09-19T09:05:17.679 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 146073622, 2024-09-19T09:05:17.679 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:17.679 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 13685, 2024-09-19T09:05:17.679 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 0, 2024-09-19T09:05:17.679 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 0, 2024-09-19T09:05:17.679 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 13685, 2024-09-19T09:05:17.680 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 146073622, 2024-09-19T09:05:17.680 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-09-19T09:05:17.680 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:17.680 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:17.680 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:17.680 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T09:05:17.680 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.680 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-objecter_bytes": { 2024-09-19T09:05:17.681 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-09-19T09:05:17.681 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 104857600, 2024-09-19T09:05:17.681 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-09-19T09:05:17.681 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 0, 2024-09-19T09:05:17.681 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 0, 2024-09-19T09:05:17.681 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:17.681 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 0, 2024-09-19T09:05:17.681 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 40, 2024-09-19T09:05:17.681 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 11732, 2024-09-19T09:05:17.682 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 40, 2024-09-19T09:05:17.682 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 11732, 2024-09-19T09:05:17.682 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-09-19T09:05:17.682 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:17.682 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:17.682 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:17.682 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T09:05:17.682 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.683 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-objecter_ops": { 2024-09-19T09:05:17.683 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-09-19T09:05:17.683 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 1024, 2024-09-19T09:05:17.683 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-09-19T09:05:17.683 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 0, 2024-09-19T09:05:17.683 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 0, 2024-09-19T09:05:17.683 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:17.683 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 0, 2024-09-19T09:05:17.684 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 40, 2024-09-19T09:05:17.684 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 40, 2024-09-19T09:05:17.684 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 40, 2024-09-19T09:05:17.684 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 40, 2024-09-19T09:05:17.684 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-09-19T09:05:17.684 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:17.684 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:17.684 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:17.685 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T09:05:17.685 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.685 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:05:17.685 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-09-19T09:05:17.685 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 3758096384, 2024-09-19T09:05:17.685 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-09-19T09:05:17.685 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 0, 2024-09-19T09:05:17.686 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 0, 2024-09-19T09:05:17.686 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:17.686 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 0, 2024-09-19T09:05:17.686 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 0, 2024-09-19T09:05:17.686 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 0, 2024-09-19T09:05:17.686 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 0, 2024-09-19T09:05:17.686 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 0, 2024-09-19T09:05:17.686 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-09-19T09:05:17.686 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:17.687 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:17.687 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:17.687 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T09:05:17.687 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:17.687 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-write_buf_throttle-0x55a38e4a4960": { 2024-09-19T09:05:17.687 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-09-19T09:05:17.687 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 3758096384, 2024-09-19T09:05:17.688 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-09-19T09:05:17.688 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 5, 2024-09-19T09:05:17.688 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 1430, 2024-09-19T09:05:17.688 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:17.688 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 5, 2024-09-19T09:05:17.688 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 0, 2024-09-19T09:05:17.688 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 0, 2024-09-19T09:05:17.688 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 4, 2024-09-19T09:05:17.688 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 1430, 2024-09-19T09:05:17.689 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-09-19T09:05:17.689 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:17.689 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:17.689 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:17.689 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T09:05:17.689 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T09:05:17.689 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-19T09:05:17.965 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:17 smithi203 ceph-mon[35450]: pgmap v735: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-19T09:05:18.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:17 smithi019 ceph-mon[30976]: pgmap v735: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-19T09:05:18.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:17 smithi155 ceph-mon[34921]: pgmap v735: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-09-19T09:05:18.391 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-19T09:05:18.392 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-19T09:05:18.392 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-19T09:05:18.392 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=5148 2024-09-19T09:05:18.392 INFO:tasks.check_counter:Daemon mds.f mds.dir_split=0 2024-09-19T09:05:18.392 DEBUG:tasks.check_counter:Getting stats from i 2024-09-19T09:05:18.393 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-19T09:05:18.636 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:05:19.124 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-19T09:05:19.124 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:05:19.125 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 22858, 2024-09-19T09:05:19.125 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 16350, 2024-09-19T09:05:19.125 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 149436622, 2024-09-19T09:05:19.125 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 2636477, 2024-09-19T09:05:19.125 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 9, 2024-09-19T09:05:19.125 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 4, 2024-09-19T09:05:19.125 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 1.520728114, 2024-09-19T09:05:19.126 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.535278821, 2024-09-19T09:05:19.126 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 1.376869003, 2024-09-19T09:05:19.126 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.006040357, 2024-09-19T09:05:19.126 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:05:19.126 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 16348, 2024-09-19T09:05:19.127 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.315749631, 2024-09-19T09:05:19.127 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000019314 2024-09-19T09:05:19.127 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.127 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:05:19.127 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 38698, 2024-09-19T09:05:19.127 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.005835779, 2024-09-19T09:05:19.127 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000150 2024-09-19T09:05:19.127 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.128 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 3064800, 2024-09-19T09:05:19.128 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 1392416 2024-09-19T09:05:19.128 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.128 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:05:19.128 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 95, 2024-09-19T09:05:19.128 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 261, 2024-09-19T09:05:19.128 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 51598, 2024-09-19T09:05:19.128 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 857842, 2024-09-19T09:05:19.129 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 42, 2024-09-19T09:05:19.129 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 7, 2024-09-19T09:05:19.129 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.029780764, 2024-09-19T09:05:19.129 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.009983126, 2024-09-19T09:05:19.129 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.017611572, 2024-09-19T09:05:19.129 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.000239797, 2024-09-19T09:05:19.129 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:05:19.129 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 260, 2024-09-19T09:05:19.130 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.025991057, 2024-09-19T09:05:19.130 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000099965 2024-09-19T09:05:19.130 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.130 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:05:19.130 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 103, 2024-09-19T09:05:19.130 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000013606, 2024-09-19T09:05:19.130 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000132 2024-09-19T09:05:19.130 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.131 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 6608, 2024-09-19T09:05:19.131 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 415200 2024-09-19T09:05:19.131 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.131 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:05:19.131 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 331, 2024-09-19T09:05:19.131 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 303, 2024-09-19T09:05:19.131 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 918411, 2024-09-19T09:05:19.131 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 171270, 2024-09-19T09:05:19.132 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 6, 2024-09-19T09:05:19.132 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 5, 2024-09-19T09:05:19.132 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.041985982, 2024-09-19T09:05:19.132 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.017554586, 2024-09-19T09:05:19.132 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.030402332, 2024-09-19T09:05:19.132 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.000499582, 2024-09-19T09:05:19.132 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:05:19.133 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 302, 2024-09-19T09:05:19.133 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.027527828, 2024-09-19T09:05:19.133 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000091151 2024-09-19T09:05:19.133 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.133 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:05:19.133 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:19.133 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:19.133 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:19.134 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.134 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 914432, 2024-09-19T09:05:19.134 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 158960 2024-09-19T09:05:19.134 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.134 INFO:teuthology.orchestra.run.smithi203.stdout: "cct": { 2024-09-19T09:05:19.134 INFO:teuthology.orchestra.run.smithi203.stdout: "total_workers": 1, 2024-09-19T09:05:19.134 INFO:teuthology.orchestra.run.smithi203.stdout: "unhealthy_workers": 0 2024-09-19T09:05:19.134 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.135 INFO:teuthology.orchestra.run.smithi203.stdout: "finisher-MDSRank": { 2024-09-19T09:05:19.135 INFO:teuthology.orchestra.run.smithi203.stdout: "queue_len": 0, 2024-09-19T09:05:19.135 INFO:teuthology.orchestra.run.smithi203.stdout: "complete_latency": { 2024-09-19T09:05:19.135 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 56, 2024-09-19T09:05:19.135 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.001824211, 2024-09-19T09:05:19.135 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000032575 2024-09-19T09:05:19.135 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T09:05:19.135 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.135 INFO:teuthology.orchestra.run.smithi203.stdout: "finisher-PurgeQueue": { 2024-09-19T09:05:19.136 INFO:teuthology.orchestra.run.smithi203.stdout: "queue_len": 0, 2024-09-19T09:05:19.136 INFO:teuthology.orchestra.run.smithi203.stdout: "complete_latency": { 2024-09-19T09:05:19.136 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 2, 2024-09-19T09:05:19.136 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000013477, 2024-09-19T09:05:19.136 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000006738 2024-09-19T09:05:19.136 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T09:05:19.136 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.137 INFO:teuthology.orchestra.run.smithi203.stdout: "mds": { 2024-09-19T09:05:19.137 INFO:teuthology.orchestra.run.smithi203.stdout: "request": 9555, 2024-09-19T09:05:19.137 INFO:teuthology.orchestra.run.smithi203.stdout: "reply": 8, 2024-09-19T09:05:19.137 INFO:teuthology.orchestra.run.smithi203.stdout: "reply_latency": { 2024-09-19T09:05:19.137 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 8, 2024-09-19T09:05:19.137 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 1.897025047, 2024-09-19T09:05:19.137 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.237128130 2024-09-19T09:05:19.138 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.138 INFO:teuthology.orchestra.run.smithi203.stdout: "slow_reply": 0, 2024-09-19T09:05:19.138 INFO:teuthology.orchestra.run.smithi203.stdout: "forward": 9547, 2024-09-19T09:05:19.139 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_fetch_complete": 0, 2024-09-19T09:05:19.139 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_fetch_keys": 0, 2024-09-19T09:05:19.139 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_commit": 11, 2024-09-19T09:05:19.139 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_split": 0, 2024-09-19T09:05:19.140 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_merge": 0, 2024-09-19T09:05:19.140 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes": 21, 2024-09-19T09:05:19.140 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_top": 3, 2024-09-19T09:05:19.140 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_bottom": 18, 2024-09-19T09:05:19.141 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_pin_tail": 0, 2024-09-19T09:05:19.141 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_pinned": 15, 2024-09-19T09:05:19.141 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_expired": 31, 2024-09-19T09:05:19.141 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_with_caps": 3, 2024-09-19T09:05:19.141 INFO:teuthology.orchestra.run.smithi203.stdout: "caps": 3, 2024-09-19T09:05:19.141 INFO:teuthology.orchestra.run.smithi203.stdout: "subtrees": 4, 2024-09-19T09:05:19.142 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse": 12162, 2024-09-19T09:05:19.142 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_hit": 2603, 2024-09-19T09:05:19.142 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_forward": 9544, 2024-09-19T09:05:19.142 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_discover": 8, 2024-09-19T09:05:19.142 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:05:19.142 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_remote_ino": 0, 2024-09-19T09:05:19.142 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_lock": 2, 2024-09-19T09:05:19.143 INFO:teuthology.orchestra.run.smithi203.stdout: "load_cent": 0, 2024-09-19T09:05:19.143 INFO:teuthology.orchestra.run.smithi203.stdout: "q": 0, 2024-09-19T09:05:19.143 INFO:teuthology.orchestra.run.smithi203.stdout: "exported": 0, 2024-09-19T09:05:19.143 INFO:teuthology.orchestra.run.smithi203.stdout: "exported_inodes": 0, 2024-09-19T09:05:19.143 INFO:teuthology.orchestra.run.smithi203.stdout: "imported": 0, 2024-09-19T09:05:19.144 INFO:teuthology.orchestra.run.smithi203.stdout: "imported_inodes": 0, 2024-09-19T09:05:19.144 INFO:teuthology.orchestra.run.smithi203.stdout: "openino_dir_fetch": 0, 2024-09-19T09:05:19.144 INFO:teuthology.orchestra.run.smithi203.stdout: "openino_backtrace_fetch": 0, 2024-09-19T09:05:19.144 INFO:teuthology.orchestra.run.smithi203.stdout: "openino_peer_discover": 0, 2024-09-19T09:05:19.144 INFO:teuthology.orchestra.run.smithi203.stdout: "root_rfiles": 4, 2024-09-19T09:05:19.144 INFO:teuthology.orchestra.run.smithi203.stdout: "root_rbytes": 234, 2024-09-19T09:05:19.144 INFO:teuthology.orchestra.run.smithi203.stdout: "root_rsnaps": 0, 2024-09-19T09:05:19.145 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T09:05:19.145 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_set_tag": 0, 2024-09-19T09:05:19.145 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:05:19.145 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:05:19.145 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:05:19.145 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:05:19.145 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:05:19.145 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_file_inodes": 0, 2024-09-19T09:05:19.145 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:05:19.146 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_revoke": 18, 2024-09-19T09:05:19.146 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_grant": 15, 2024-09-19T09:05:19.146 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:05:19.146 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:05:19.146 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:05:19.146 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_caps": 19, 2024-09-19T09:05:19.146 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_caps_dirty": 0, 2024-09-19T09:05:19.146 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_cap_release": 1, 2024-09-19T09:05:19.147 INFO:teuthology.orchestra.run.smithi203.stdout: "process_request_cap_release": 3 2024-09-19T09:05:19.147 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.147 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_cache": { 2024-09-19T09:05:19.147 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_update": 0, 2024-09-19T09:05:19.147 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_update_receipt": 5148, 2024-09-19T09:05:19.148 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_try_discover": 2578, 2024-09-19T09:05:19.148 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_send_discover": 2579, 2024-09-19T09:05:19.148 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_handle_discover": 0, 2024-09-19T09:05:19.148 INFO:teuthology.orchestra.run.smithi203.stdout: "num_strays": 0, 2024-09-19T09:05:19.148 INFO:teuthology.orchestra.run.smithi203.stdout: "num_strays_delayed": 0, 2024-09-19T09:05:19.149 INFO:teuthology.orchestra.run.smithi203.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:05:19.149 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_created": 0, 2024-09-19T09:05:19.149 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_enqueued": 0, 2024-09-19T09:05:19.149 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_reintegrated": 0, 2024-09-19T09:05:19.149 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_migrated": 0, 2024-09-19T09:05:19.149 INFO:teuthology.orchestra.run.smithi203.stdout: "num_recovering_processing": 0, 2024-09-19T09:05:19.149 INFO:teuthology.orchestra.run.smithi203.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:05:19.149 INFO:teuthology.orchestra.run.smithi203.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:05:19.150 INFO:teuthology.orchestra.run.smithi203.stdout: "recovery_started": 0, 2024-09-19T09:05:19.150 INFO:teuthology.orchestra.run.smithi203.stdout: "recovery_completed": 0, 2024-09-19T09:05:19.150 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_quiesce_path": 10, 2024-09-19T09:05:19.150 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_quiesce_inode": 91, 2024-09-19T09:05:19.150 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:05:19.151 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_exportdir": 0, 2024-09-19T09:05:19.151 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_flush": 0, 2024-09-19T09:05:19.151 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:05:19.151 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_fragstats": 0, 2024-09-19T09:05:19.151 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_inodestats": 0 2024-09-19T09:05:19.151 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.151 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_log": { 2024-09-19T09:05:19.151 INFO:teuthology.orchestra.run.smithi203.stdout: "evlrg": 0, 2024-09-19T09:05:19.152 INFO:teuthology.orchestra.run.smithi203.stdout: "evadd": 5, 2024-09-19T09:05:19.152 INFO:teuthology.orchestra.run.smithi203.stdout: "evex": 0, 2024-09-19T09:05:19.152 INFO:teuthology.orchestra.run.smithi203.stdout: "evtrm": 0, 2024-09-19T09:05:19.152 INFO:teuthology.orchestra.run.smithi203.stdout: "ev": 5, 2024-09-19T09:05:19.152 INFO:teuthology.orchestra.run.smithi203.stdout: "evexg": 0, 2024-09-19T09:05:19.152 INFO:teuthology.orchestra.run.smithi203.stdout: "evexd": 0, 2024-09-19T09:05:19.152 INFO:teuthology.orchestra.run.smithi203.stdout: "segadd": 2, 2024-09-19T09:05:19.152 INFO:teuthology.orchestra.run.smithi203.stdout: "segex": 0, 2024-09-19T09:05:19.153 INFO:teuthology.orchestra.run.smithi203.stdout: "segtrm": 0, 2024-09-19T09:05:19.153 INFO:teuthology.orchestra.run.smithi203.stdout: "seg": 2, 2024-09-19T09:05:19.153 INFO:teuthology.orchestra.run.smithi203.stdout: "segmjr": 2, 2024-09-19T09:05:19.153 INFO:teuthology.orchestra.run.smithi203.stdout: "segexg": 0, 2024-09-19T09:05:19.153 INFO:teuthology.orchestra.run.smithi203.stdout: "segexd": 0, 2024-09-19T09:05:19.153 INFO:teuthology.orchestra.run.smithi203.stdout: "expos": 4194304, 2024-09-19T09:05:19.153 INFO:teuthology.orchestra.run.smithi203.stdout: "wrpos": 4195734, 2024-09-19T09:05:19.154 INFO:teuthology.orchestra.run.smithi203.stdout: "rdpos": 0, 2024-09-19T09:05:19.154 INFO:teuthology.orchestra.run.smithi203.stdout: "jlat": { 2024-09-19T09:05:19.154 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 4, 2024-09-19T09:05:19.154 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.007134073, 2024-09-19T09:05:19.154 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.001783518 2024-09-19T09:05:19.154 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.154 INFO:teuthology.orchestra.run.smithi203.stdout: "replayed": 0 2024-09-19T09:05:19.154 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.155 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_mem": { 2024-09-19T09:05:19.155 INFO:teuthology.orchestra.run.smithi203.stdout: "ino": 26, 2024-09-19T09:05:19.155 INFO:teuthology.orchestra.run.smithi203.stdout: "ino+": 46, 2024-09-19T09:05:19.155 INFO:teuthology.orchestra.run.smithi203.stdout: "ino-": 20, 2024-09-19T09:05:19.155 INFO:teuthology.orchestra.run.smithi203.stdout: "dir": 32, 2024-09-19T09:05:19.155 INFO:teuthology.orchestra.run.smithi203.stdout: "dir+": 2811, 2024-09-19T09:05:19.155 INFO:teuthology.orchestra.run.smithi203.stdout: "dir-": 2779, 2024-09-19T09:05:19.155 INFO:teuthology.orchestra.run.smithi203.stdout: "dn": 21, 2024-09-19T09:05:19.156 INFO:teuthology.orchestra.run.smithi203.stdout: "dn+": 52, 2024-09-19T09:05:19.156 INFO:teuthology.orchestra.run.smithi203.stdout: "dn-": 31, 2024-09-19T09:05:19.156 INFO:teuthology.orchestra.run.smithi203.stdout: "cap": 3, 2024-09-19T09:05:19.156 INFO:teuthology.orchestra.run.smithi203.stdout: "cap+": 7, 2024-09-19T09:05:19.156 INFO:teuthology.orchestra.run.smithi203.stdout: "cap-": 4, 2024-09-19T09:05:19.156 INFO:teuthology.orchestra.run.smithi203.stdout: "rss": 60280, 2024-09-19T09:05:19.157 INFO:teuthology.orchestra.run.smithi203.stdout: "heap": 223520 2024-09-19T09:05:19.157 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.157 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_server": { 2024-09-19T09:05:19.157 INFO:teuthology.orchestra.run.smithi203.stdout: "dispatch_client_request": 9560, 2024-09-19T09:05:19.157 INFO:teuthology.orchestra.run.smithi203.stdout: "dispatch_server_request": 2, 2024-09-19T09:05:19.157 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_request": 9555, 2024-09-19T09:05:19.157 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_session": 15, 2024-09-19T09:05:19.157 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_peer_request": 5, 2024-09-19T09:05:19.157 INFO:teuthology.orchestra.run.smithi203.stdout: "req_create_latency": { 2024-09-19T09:05:19.158 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:19.158 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:19.158 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:19.158 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.158 INFO:teuthology.orchestra.run.smithi203.stdout: "req_getattr_latency": { 2024-09-19T09:05:19.158 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 1, 2024-09-19T09:05:19.159 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.001507111, 2024-09-19T09:05:19.159 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.001507111 2024-09-19T09:05:19.159 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.159 INFO:teuthology.orchestra.run.smithi203.stdout: "req_getfilelock_latency": { 2024-09-19T09:05:19.159 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:19.159 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:19.159 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:19.159 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.160 INFO:teuthology.orchestra.run.smithi203.stdout: "req_link_latency": { 2024-09-19T09:05:19.160 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:19.160 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:19.160 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:19.160 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.160 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookup_latency": { 2024-09-19T09:05:19.160 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 6, 2024-09-19T09:05:19.161 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 1.895354103, 2024-09-19T09:05:19.161 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.315892350 2024-09-19T09:05:19.161 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.161 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookuphash_latency": { 2024-09-19T09:05:19.161 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:19.161 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:19.161 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:19.161 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.162 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupino_latency": { 2024-09-19T09:05:19.162 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 1, 2024-09-19T09:05:19.162 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000163833, 2024-09-19T09:05:19.162 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000163833 2024-09-19T09:05:19.162 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.162 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupname_latency": { 2024-09-19T09:05:19.162 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:19.162 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:19.162 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:19.163 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.163 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupparent_latency": { 2024-09-19T09:05:19.163 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:19.163 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:19.163 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:19.163 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.163 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupsnap_latency": { 2024-09-19T09:05:19.163 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:19.164 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:19.164 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:19.164 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.164 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lssnap_latency": { 2024-09-19T09:05:19.164 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:19.164 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:19.164 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:19.165 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.165 INFO:teuthology.orchestra.run.smithi203.stdout: "req_mkdir_latency": { 2024-09-19T09:05:19.165 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:19.166 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:19.166 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:19.166 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.166 INFO:teuthology.orchestra.run.smithi203.stdout: "req_mknod_latency": { 2024-09-19T09:05:19.166 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:19.166 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:19.167 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:19.167 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.167 INFO:teuthology.orchestra.run.smithi203.stdout: "req_mksnap_latency": { 2024-09-19T09:05:19.167 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:19.168 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:19.168 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:19.168 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.168 INFO:teuthology.orchestra.run.smithi203.stdout: "req_open_latency": { 2024-09-19T09:05:19.168 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:19.169 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:19.169 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:19.169 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.169 INFO:teuthology.orchestra.run.smithi203.stdout: "req_readdir_latency": { 2024-09-19T09:05:19.169 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:19.169 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:19.169 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:19.169 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.170 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rename_latency": { 2024-09-19T09:05:19.170 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:19.170 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:19.170 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:19.170 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.170 INFO:teuthology.orchestra.run.smithi203.stdout: "req_renamesnap_latency": { 2024-09-19T09:05:19.170 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:19.170 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:19.171 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:19.171 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.171 INFO:teuthology.orchestra.run.smithi203.stdout: "req_snapdiff_latency": { 2024-09-19T09:05:19.171 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:19.171 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:19.171 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:19.171 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.172 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rmdir_latency": { 2024-09-19T09:05:19.172 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:19.172 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:19.172 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:19.172 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.172 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rmsnap_latency": { 2024-09-19T09:05:19.172 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:19.172 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:19.173 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:19.173 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.173 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rmxattr_latency": { 2024-09-19T09:05:19.173 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:19.173 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:19.173 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:19.173 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.173 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setattr_latency": { 2024-09-19T09:05:19.174 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:19.174 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:19.174 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:19.174 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.174 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setdirlayout_latency": { 2024-09-19T09:05:19.174 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:19.174 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:19.174 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:19.175 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.175 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setfilelock_latency": { 2024-09-19T09:05:19.175 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:19.175 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:19.175 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:19.175 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.175 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setlayout_latency": { 2024-09-19T09:05:19.175 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:19.175 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:19.176 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:19.176 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.176 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setxattr_latency": { 2024-09-19T09:05:19.176 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:19.176 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:19.176 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:19.176 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.176 INFO:teuthology.orchestra.run.smithi203.stdout: "req_symlink_latency": { 2024-09-19T09:05:19.177 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:19.177 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:19.177 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:19.177 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.177 INFO:teuthology.orchestra.run.smithi203.stdout: "req_unlink_latency": { 2024-09-19T09:05:19.177 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:19.177 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:19.177 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:19.178 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.178 INFO:teuthology.orchestra.run.smithi203.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:05:19.178 INFO:teuthology.orchestra.run.smithi203.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:05:19.178 INFO:teuthology.orchestra.run.smithi203.stdout: "req_getvxattr_latency": { 2024-09-19T09:05:19.178 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:19.178 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:19.178 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:19.178 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T09:05:19.179 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.179 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_sessions": { 2024-09-19T09:05:19.179 INFO:teuthology.orchestra.run.smithi203.stdout: "session_count": 1, 2024-09-19T09:05:19.179 INFO:teuthology.orchestra.run.smithi203.stdout: "session_add": 2, 2024-09-19T09:05:19.179 INFO:teuthology.orchestra.run.smithi203.stdout: "session_remove": 1, 2024-09-19T09:05:19.179 INFO:teuthology.orchestra.run.smithi203.stdout: "sessions_open": 1, 2024-09-19T09:05:19.179 INFO:teuthology.orchestra.run.smithi203.stdout: "sessions_stale": 0, 2024-09-19T09:05:19.179 INFO:teuthology.orchestra.run.smithi203.stdout: "total_load": 2, 2024-09-19T09:05:19.179 INFO:teuthology.orchestra.run.smithi203.stdout: "average_load": 2, 2024-09-19T09:05:19.180 INFO:teuthology.orchestra.run.smithi203.stdout: "avg_session_uptime": 764, 2024-09-19T09:05:19.180 INFO:teuthology.orchestra.run.smithi203.stdout: "mdthresh_evicted": 0 2024-09-19T09:05:19.180 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.180 INFO:teuthology.orchestra.run.smithi203.stdout: "mempool": { 2024-09-19T09:05:19.180 INFO:teuthology.orchestra.run.smithi203.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:05:19.180 INFO:teuthology.orchestra.run.smithi203.stdout: "bloom_filter_items": 0, 2024-09-19T09:05:19.180 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:05:19.180 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:05:19.181 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:05:19.181 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:05:19.181 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:05:19.181 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:05:19.181 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:05:19.181 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:05:19.181 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:05:19.181 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:05:19.182 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:05:19.182 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:05:19.182 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:05:19.182 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_extent_items": 0, 2024-09-19T09:05:19.183 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:05:19.183 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_blob_items": 0, 2024-09-19T09:05:19.183 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:05:19.183 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:05:19.184 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:05:19.184 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:05:19.184 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:05:19.184 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:05:19.185 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:05:19.185 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_txc_items": 0, 2024-09-19T09:05:19.185 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:05:19.185 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:05:19.185 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:05:19.186 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_items": 0, 2024-09-19T09:05:19.186 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_bytes": 0, 2024-09-19T09:05:19.186 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_items": 0, 2024-09-19T09:05:19.186 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:05:19.187 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:05:19.187 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:05:19.187 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:05:19.187 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_anon_bytes": 254636, 2024-09-19T09:05:19.188 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_anon_items": 88, 2024-09-19T09:05:19.188 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:05:19.188 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_meta_items": 0, 2024-09-19T09:05:19.188 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_bytes": 0, 2024-09-19T09:05:19.189 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_items": 0, 2024-09-19T09:05:19.189 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:05:19.189 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_mapbl_items": 0, 2024-09-19T09:05:19.189 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:05:19.190 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_pglog_items": 0, 2024-09-19T09:05:19.190 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_bytes": 7496, 2024-09-19T09:05:19.190 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_items": 154, 2024-09-19T09:05:19.190 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:05:19.190 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:05:19.190 INFO:teuthology.orchestra.run.smithi203.stdout: "pgmap_bytes": 0, 2024-09-19T09:05:19.190 INFO:teuthology.orchestra.run.smithi203.stdout: "pgmap_items": 0, 2024-09-19T09:05:19.191 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_co_bytes": 116550, 2024-09-19T09:05:19.191 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_co_items": 450, 2024-09-19T09:05:19.191 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_1_bytes": 0, 2024-09-19T09:05:19.191 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_1_items": 0, 2024-09-19T09:05:19.191 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_2_bytes": 0, 2024-09-19T09:05:19.191 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_2_items": 0 2024-09-19T09:05:19.191 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.191 INFO:teuthology.orchestra.run.smithi203.stdout: "objecter": { 2024-09-19T09:05:19.192 INFO:teuthology.orchestra.run.smithi203.stdout: "op_active": 0, 2024-09-19T09:05:19.192 INFO:teuthology.orchestra.run.smithi203.stdout: "op_laggy": 0, 2024-09-19T09:05:19.192 INFO:teuthology.orchestra.run.smithi203.stdout: "op_send": 47, 2024-09-19T09:05:19.192 INFO:teuthology.orchestra.run.smithi203.stdout: "op_send_bytes": 12913, 2024-09-19T09:05:19.192 INFO:teuthology.orchestra.run.smithi203.stdout: "op_resend": 32, 2024-09-19T09:05:19.192 INFO:teuthology.orchestra.run.smithi203.stdout: "op_reply": 47, 2024-09-19T09:05:19.192 INFO:teuthology.orchestra.run.smithi203.stdout: "op_latency": { 2024-09-19T09:05:19.192 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 47, 2024-09-19T09:05:19.193 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.225994379, 2024-09-19T09:05:19.193 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.004808391 2024-09-19T09:05:19.193 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.193 INFO:teuthology.orchestra.run.smithi203.stdout: "op_inflight": 0, 2024-09-19T09:05:19.193 INFO:teuthology.orchestra.run.smithi203.stdout: "oplen_avg": { 2024-09-19T09:05:19.193 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 47, 2024-09-19T09:05:19.193 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 75 2024-09-19T09:05:19.193 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.194 INFO:teuthology.orchestra.run.smithi203.stdout: "op": 47, 2024-09-19T09:05:19.194 INFO:teuthology.orchestra.run.smithi203.stdout: "op_r": 0, 2024-09-19T09:05:19.194 INFO:teuthology.orchestra.run.smithi203.stdout: "op_w": 47, 2024-09-19T09:05:19.194 INFO:teuthology.orchestra.run.smithi203.stdout: "op_rmw": 0, 2024-09-19T09:05:19.194 INFO:teuthology.orchestra.run.smithi203.stdout: "op_pg": 0, 2024-09-19T09:05:19.194 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_stat": 0, 2024-09-19T09:05:19.194 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_create": 10, 2024-09-19T09:05:19.194 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_read": 0, 2024-09-19T09:05:19.195 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_write": 4, 2024-09-19T09:05:19.195 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_writefull": 8, 2024-09-19T09:05:19.195 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_writesame": 0, 2024-09-19T09:05:19.195 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_append": 0, 2024-09-19T09:05:19.195 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_zero": 0, 2024-09-19T09:05:19.195 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_truncate": 0, 2024-09-19T09:05:19.195 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_delete": 6, 2024-09-19T09:05:19.195 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_mapext": 0, 2024-09-19T09:05:19.196 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_sparse_read": 0, 2024-09-19T09:05:19.196 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_clonerange": 0, 2024-09-19T09:05:19.196 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_getxattr": 0, 2024-09-19T09:05:19.196 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_setxattr": 20, 2024-09-19T09:05:19.196 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:05:19.196 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_rmxattr": 0, 2024-09-19T09:05:19.196 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:05:19.197 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_call": 0, 2024-09-19T09:05:19.197 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_watch": 0, 2024-09-19T09:05:19.197 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_notify": 0, 2024-09-19T09:05:19.197 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:05:19.197 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_pgls": 0, 2024-09-19T09:05:19.197 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:05:19.197 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_other": 0, 2024-09-19T09:05:19.197 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_active": 0, 2024-09-19T09:05:19.197 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_send": 0, 2024-09-19T09:05:19.198 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_resend": 0, 2024-09-19T09:05:19.198 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_ping": 0, 2024-09-19T09:05:19.198 INFO:teuthology.orchestra.run.smithi203.stdout: "poolop_active": 0, 2024-09-19T09:05:19.198 INFO:teuthology.orchestra.run.smithi203.stdout: "poolop_send": 0, 2024-09-19T09:05:19.198 INFO:teuthology.orchestra.run.smithi203.stdout: "poolop_resend": 0, 2024-09-19T09:05:19.198 INFO:teuthology.orchestra.run.smithi203.stdout: "poolstat_active": 0, 2024-09-19T09:05:19.199 INFO:teuthology.orchestra.run.smithi203.stdout: "poolstat_send": 0, 2024-09-19T09:05:19.199 INFO:teuthology.orchestra.run.smithi203.stdout: "poolstat_resend": 0, 2024-09-19T09:05:19.199 INFO:teuthology.orchestra.run.smithi203.stdout: "statfs_active": 0, 2024-09-19T09:05:19.199 INFO:teuthology.orchestra.run.smithi203.stdout: "statfs_send": 0, 2024-09-19T09:05:19.199 INFO:teuthology.orchestra.run.smithi203.stdout: "statfs_resend": 0, 2024-09-19T09:05:19.199 INFO:teuthology.orchestra.run.smithi203.stdout: "command_active": 0, 2024-09-19T09:05:19.199 INFO:teuthology.orchestra.run.smithi203.stdout: "command_send": 0, 2024-09-19T09:05:19.199 INFO:teuthology.orchestra.run.smithi203.stdout: "command_resend": 0, 2024-09-19T09:05:19.200 INFO:teuthology.orchestra.run.smithi203.stdout: "map_epoch": 88, 2024-09-19T09:05:19.200 INFO:teuthology.orchestra.run.smithi203.stdout: "map_full": 0, 2024-09-19T09:05:19.200 INFO:teuthology.orchestra.run.smithi203.stdout: "map_inc": 8, 2024-09-19T09:05:19.200 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_sessions": 10, 2024-09-19T09:05:19.200 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_session_open": 10, 2024-09-19T09:05:19.200 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_session_close": 0, 2024-09-19T09:05:19.200 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_laggy": 0, 2024-09-19T09:05:19.201 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_wr": 25, 2024-09-19T09:05:19.201 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_rd": 0, 2024-09-19T09:05:19.201 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_del": 2 2024-09-19T09:05:19.201 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.201 INFO:teuthology.orchestra.run.smithi203.stdout: "oft": { 2024-09-19T09:05:19.201 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_objs": 1, 2024-09-19T09:05:19.201 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:05:19.201 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_updates": 0, 2024-09-19T09:05:19.202 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_removes": 0 2024-09-19T09:05:19.202 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.202 INFO:teuthology.orchestra.run.smithi203.stdout: "osd-slow-ops": { 2024-09-19T09:05:19.202 INFO:teuthology.orchestra.run.smithi203.stdout: "slow_ops_count": 75 2024-09-19T09:05:19.202 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.202 INFO:teuthology.orchestra.run.smithi203.stdout: "purge_queue": { 2024-09-19T09:05:19.202 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing_ops": 0, 2024-09-19T09:05:19.202 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T09:05:19.203 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing": 0, 2024-09-19T09:05:19.203 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing_high_water": 0, 2024-09-19T09:05:19.203 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executed_ops": 0, 2024-09-19T09:05:19.203 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executed": 0, 2024-09-19T09:05:19.203 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_item_in_journal": 0 2024-09-19T09:05:19.203 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.203 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:05:19.203 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-09-19T09:05:19.203 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 104857600, 2024-09-19T09:05:19.204 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-09-19T09:05:19.204 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 23280, 2024-09-19T09:05:19.204 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 147888143, 2024-09-19T09:05:19.204 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:19.204 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 23280, 2024-09-19T09:05:19.204 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 0, 2024-09-19T09:05:19.205 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 0, 2024-09-19T09:05:19.205 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 23280, 2024-09-19T09:05:19.205 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 147888143, 2024-09-19T09:05:19.205 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-09-19T09:05:19.205 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:19.205 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:19.205 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:19.205 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T09:05:19.206 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.206 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-objecter_bytes": { 2024-09-19T09:05:19.206 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-09-19T09:05:19.206 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 104857600, 2024-09-19T09:05:19.206 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-09-19T09:05:19.206 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 0, 2024-09-19T09:05:19.206 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 0, 2024-09-19T09:05:19.207 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:19.207 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 0, 2024-09-19T09:05:19.207 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 47, 2024-09-19T09:05:19.207 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 12913, 2024-09-19T09:05:19.207 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 47, 2024-09-19T09:05:19.207 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 12913, 2024-09-19T09:05:19.207 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-09-19T09:05:19.208 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:19.208 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:19.208 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:19.208 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T09:05:19.208 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.208 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-objecter_ops": { 2024-09-19T09:05:19.208 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-09-19T09:05:19.209 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 1024, 2024-09-19T09:05:19.209 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-09-19T09:05:19.209 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 0, 2024-09-19T09:05:19.209 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 0, 2024-09-19T09:05:19.210 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:19.210 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 0, 2024-09-19T09:05:19.210 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 47, 2024-09-19T09:05:19.210 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 47, 2024-09-19T09:05:19.210 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 47, 2024-09-19T09:05:19.210 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 47, 2024-09-19T09:05:19.211 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-09-19T09:05:19.211 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:19.211 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:19.211 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:19.211 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T09:05:19.211 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.212 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:05:19.212 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-09-19T09:05:19.212 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 3758096384, 2024-09-19T09:05:19.212 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-09-19T09:05:19.213 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 0, 2024-09-19T09:05:19.213 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 0, 2024-09-19T09:05:19.213 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:19.213 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 0, 2024-09-19T09:05:19.214 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 0, 2024-09-19T09:05:19.214 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 0, 2024-09-19T09:05:19.214 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 0, 2024-09-19T09:05:19.214 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 0, 2024-09-19T09:05:19.214 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-09-19T09:05:19.214 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:19.215 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:19.215 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:19.215 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T09:05:19.215 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:19.215 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-write_buf_throttle-0x557f0e136960": { 2024-09-19T09:05:19.215 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-09-19T09:05:19.215 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 3758096384, 2024-09-19T09:05:19.215 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-09-19T09:05:19.216 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 5, 2024-09-19T09:05:19.216 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 1430, 2024-09-19T09:05:19.216 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:19.216 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 5, 2024-09-19T09:05:19.216 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 0, 2024-09-19T09:05:19.216 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 0, 2024-09-19T09:05:19.217 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 4, 2024-09-19T09:05:19.217 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 1430, 2024-09-19T09:05:19.217 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-09-19T09:05:19.217 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:19.217 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:19.217 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:19.218 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T09:05:19.218 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T09:05:19.218 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-19T09:05:19.887 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:19 smithi203 ceph-mon[35450]: pgmap v736: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-09-19T09:05:19.914 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-09-19T09:05:19.914 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-09-19T09:05:19.914 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=0 2024-09-19T09:05:19.914 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=5148 2024-09-19T09:05:19.914 INFO:tasks.check_counter:Daemon mds.i mds.dir_split=0 2024-09-19T09:05:19.915 DEBUG:tasks.check_counter:Getting stats from l 2024-09-19T09:05:19.915 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-19T09:05:20.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:19 smithi019 ceph-mon[30976]: pgmap v736: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-09-19T09:05:20.158 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T09:05:20.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:19 smithi155 ceph-mon[34921]: pgmap v736: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-09-19T09:05:20.653 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-09-19T09:05:20.653 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T09:05:20.653 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 1785, 2024-09-19T09:05:20.654 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 1787, 2024-09-19T09:05:20.654 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 534915, 2024-09-19T09:05:20.654 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 567631, 2024-09-19T09:05:20.654 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 6, 2024-09-19T09:05:20.654 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 2, 2024-09-19T09:05:20.654 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.175503843, 2024-09-19T09:05:20.654 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.062108539, 2024-09-19T09:05:20.654 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.044083402, 2024-09-19T09:05:20.655 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.053184462, 2024-09-19T09:05:20.655 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:05:20.655 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 1785, 2024-09-19T09:05:20.655 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.074253913, 2024-09-19T09:05:20.655 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000041598 2024-09-19T09:05:20.655 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.655 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:05:20.655 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.656 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.656 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.656 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.656 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T09:05:20.656 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T09:05:20.656 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.656 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T09:05:20.656 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 1099, 2024-09-19T09:05:20.656 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 1077, 2024-09-19T09:05:20.657 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 1090930, 2024-09-19T09:05:20.657 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 415938, 2024-09-19T09:05:20.657 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 4, 2024-09-19T09:05:20.657 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 3, 2024-09-19T09:05:20.657 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.118294464, 2024-09-19T09:05:20.657 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.045171676, 2024-09-19T09:05:20.657 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.048555458, 2024-09-19T09:05:20.657 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.025384893, 2024-09-19T09:05:20.658 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:05:20.658 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 1077, 2024-09-19T09:05:20.658 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.048716064, 2024-09-19T09:05:20.658 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000045233 2024-09-19T09:05:20.658 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.658 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:05:20.658 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.658 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.658 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.659 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.659 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 891264, 2024-09-19T09:05:20.659 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 158608 2024-09-19T09:05:20.659 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.659 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T09:05:20.659 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 3, 2024-09-19T09:05:20.660 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 195, 2024-09-19T09:05:20.660 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 588, 2024-09-19T09:05:20.660 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 499822, 2024-09-19T09:05:20.660 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 5, 2024-09-19T09:05:20.660 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 3, 2024-09-19T09:05:20.660 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.010994783, 2024-09-19T09:05:20.660 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.007691807, 2024-09-19T09:05:20.660 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.001405524, 2024-09-19T09:05:20.661 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.000047184, 2024-09-19T09:05:20.661 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T09:05:20.661 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 193, 2024-09-19T09:05:20.661 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.012693188, 2024-09-19T09:05:20.661 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000065767 2024-09-19T09:05:20.661 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.661 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-09-19T09:05:20.661 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.661 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.662 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.662 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.662 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T09:05:20.662 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 499504 2024-09-19T09:05:20.662 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.662 INFO:teuthology.orchestra.run.smithi203.stdout: "cct": { 2024-09-19T09:05:20.662 INFO:teuthology.orchestra.run.smithi203.stdout: "total_workers": 1, 2024-09-19T09:05:20.662 INFO:teuthology.orchestra.run.smithi203.stdout: "unhealthy_workers": 0 2024-09-19T09:05:20.663 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.663 INFO:teuthology.orchestra.run.smithi203.stdout: "finisher-MDSRank": { 2024-09-19T09:05:20.663 INFO:teuthology.orchestra.run.smithi203.stdout: "queue_len": 0, 2024-09-19T09:05:20.663 INFO:teuthology.orchestra.run.smithi203.stdout: "complete_latency": { 2024-09-19T09:05:20.663 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 4269, 2024-09-19T09:05:20.663 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.116790455, 2024-09-19T09:05:20.663 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000027357 2024-09-19T09:05:20.664 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T09:05:20.664 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.664 INFO:teuthology.orchestra.run.smithi203.stdout: "finisher-PurgeQueue": { 2024-09-19T09:05:20.664 INFO:teuthology.orchestra.run.smithi203.stdout: "queue_len": 0, 2024-09-19T09:05:20.664 INFO:teuthology.orchestra.run.smithi203.stdout: "complete_latency": { 2024-09-19T09:05:20.664 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.664 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.664 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.665 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T09:05:20.665 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.665 INFO:teuthology.orchestra.run.smithi203.stdout: "mds": { 2024-09-19T09:05:20.665 INFO:teuthology.orchestra.run.smithi203.stdout: "request": 0, 2024-09-19T09:05:20.665 INFO:teuthology.orchestra.run.smithi203.stdout: "reply": 0, 2024-09-19T09:05:20.665 INFO:teuthology.orchestra.run.smithi203.stdout: "reply_latency": { 2024-09-19T09:05:20.665 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.665 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.666 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.666 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.666 INFO:teuthology.orchestra.run.smithi203.stdout: "slow_reply": 0, 2024-09-19T09:05:20.666 INFO:teuthology.orchestra.run.smithi203.stdout: "forward": 0, 2024-09-19T09:05:20.666 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_fetch_complete": 0, 2024-09-19T09:05:20.666 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_fetch_keys": 0, 2024-09-19T09:05:20.666 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_commit": 0, 2024-09-19T09:05:20.666 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_split": 0, 2024-09-19T09:05:20.666 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_merge": 0, 2024-09-19T09:05:20.667 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes": 0, 2024-09-19T09:05:20.667 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_top": 0, 2024-09-19T09:05:20.667 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_bottom": 0, 2024-09-19T09:05:20.667 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_pin_tail": 0, 2024-09-19T09:05:20.667 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_pinned": 0, 2024-09-19T09:05:20.667 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_expired": 0, 2024-09-19T09:05:20.667 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_with_caps": 0, 2024-09-19T09:05:20.667 INFO:teuthology.orchestra.run.smithi203.stdout: "caps": 0, 2024-09-19T09:05:20.668 INFO:teuthology.orchestra.run.smithi203.stdout: "subtrees": 1, 2024-09-19T09:05:20.668 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse": 0, 2024-09-19T09:05:20.668 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_hit": 0, 2024-09-19T09:05:20.668 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_forward": 0, 2024-09-19T09:05:20.668 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_discover": 0, 2024-09-19T09:05:20.668 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_dir_fetch": 0, 2024-09-19T09:05:20.668 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_remote_ino": 0, 2024-09-19T09:05:20.668 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_lock": 0, 2024-09-19T09:05:20.669 INFO:teuthology.orchestra.run.smithi203.stdout: "load_cent": 0, 2024-09-19T09:05:20.669 INFO:teuthology.orchestra.run.smithi203.stdout: "q": 0, 2024-09-19T09:05:20.669 INFO:teuthology.orchestra.run.smithi203.stdout: "exported": 0, 2024-09-19T09:05:20.669 INFO:teuthology.orchestra.run.smithi203.stdout: "exported_inodes": 0, 2024-09-19T09:05:20.669 INFO:teuthology.orchestra.run.smithi203.stdout: "imported": 0, 2024-09-19T09:05:20.669 INFO:teuthology.orchestra.run.smithi203.stdout: "imported_inodes": 0, 2024-09-19T09:05:20.669 INFO:teuthology.orchestra.run.smithi203.stdout: "openino_dir_fetch": 0, 2024-09-19T09:05:20.669 INFO:teuthology.orchestra.run.smithi203.stdout: "openino_backtrace_fetch": 0, 2024-09-19T09:05:20.670 INFO:teuthology.orchestra.run.smithi203.stdout: "openino_peer_discover": 0, 2024-09-19T09:05:20.670 INFO:teuthology.orchestra.run.smithi203.stdout: "root_rfiles": 0, 2024-09-19T09:05:20.670 INFO:teuthology.orchestra.run.smithi203.stdout: "root_rbytes": 0, 2024-09-19T09:05:20.670 INFO:teuthology.orchestra.run.smithi203.stdout: "root_rsnaps": 0, 2024-09-19T09:05:20.670 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T09:05:20.670 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_set_tag": 0, 2024-09-19T09:05:20.670 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T09:05:20.670 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_inotable_repaired": 0, 2024-09-19T09:05:20.670 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_dir_inodes": 0, 2024-09-19T09:05:20.671 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T09:05:20.671 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T09:05:20.671 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_file_inodes": 0, 2024-09-19T09:05:20.671 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_inode_file_caps": 0, 2024-09-19T09:05:20.671 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T09:05:20.671 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_grant": 0, 2024-09-19T09:05:20.671 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T09:05:20.671 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T09:05:20.672 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T09:05:20.672 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_caps": 0, 2024-09-19T09:05:20.672 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_caps_dirty": 0, 2024-09-19T09:05:20.672 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_cap_release": 0, 2024-09-19T09:05:20.672 INFO:teuthology.orchestra.run.smithi203.stdout: "process_request_cap_release": 0 2024-09-19T09:05:20.672 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.672 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_cache": { 2024-09-19T09:05:20.672 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_update": 0, 2024-09-19T09:05:20.672 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_update_receipt": 0, 2024-09-19T09:05:20.673 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_try_discover": 0, 2024-09-19T09:05:20.673 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_send_discover": 0, 2024-09-19T09:05:20.673 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_handle_discover": 0, 2024-09-19T09:05:20.673 INFO:teuthology.orchestra.run.smithi203.stdout: "num_strays": 0, 2024-09-19T09:05:20.673 INFO:teuthology.orchestra.run.smithi203.stdout: "num_strays_delayed": 0, 2024-09-19T09:05:20.673 INFO:teuthology.orchestra.run.smithi203.stdout: "num_strays_enqueuing": 0, 2024-09-19T09:05:20.673 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_created": 0, 2024-09-19T09:05:20.673 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_enqueued": 0, 2024-09-19T09:05:20.674 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_reintegrated": 0, 2024-09-19T09:05:20.674 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_migrated": 0, 2024-09-19T09:05:20.674 INFO:teuthology.orchestra.run.smithi203.stdout: "num_recovering_processing": 0, 2024-09-19T09:05:20.674 INFO:teuthology.orchestra.run.smithi203.stdout: "num_recovering_enqueued": 0, 2024-09-19T09:05:20.674 INFO:teuthology.orchestra.run.smithi203.stdout: "num_recovering_prioritized": 0, 2024-09-19T09:05:20.674 INFO:teuthology.orchestra.run.smithi203.stdout: "recovery_started": 0, 2024-09-19T09:05:20.674 INFO:teuthology.orchestra.run.smithi203.stdout: "recovery_completed": 0, 2024-09-19T09:05:20.674 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_quiesce_path": 0, 2024-09-19T09:05:20.674 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_quiesce_inode": 0, 2024-09-19T09:05:20.675 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T09:05:20.675 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_exportdir": 0, 2024-09-19T09:05:20.675 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_flush": 0, 2024-09-19T09:05:20.675 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_fragmentdir": 0, 2024-09-19T09:05:20.675 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_fragstats": 0, 2024-09-19T09:05:20.675 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_inodestats": 0 2024-09-19T09:05:20.675 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.675 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_log": { 2024-09-19T09:05:20.676 INFO:teuthology.orchestra.run.smithi203.stdout: "evlrg": 0, 2024-09-19T09:05:20.676 INFO:teuthology.orchestra.run.smithi203.stdout: "evadd": 0, 2024-09-19T09:05:20.676 INFO:teuthology.orchestra.run.smithi203.stdout: "evex": 0, 2024-09-19T09:05:20.676 INFO:teuthology.orchestra.run.smithi203.stdout: "evtrm": 0, 2024-09-19T09:05:20.676 INFO:teuthology.orchestra.run.smithi203.stdout: "ev": 5, 2024-09-19T09:05:20.676 INFO:teuthology.orchestra.run.smithi203.stdout: "evexg": 0, 2024-09-19T09:05:20.676 INFO:teuthology.orchestra.run.smithi203.stdout: "evexd": 0, 2024-09-19T09:05:20.676 INFO:teuthology.orchestra.run.smithi203.stdout: "segadd": 0, 2024-09-19T09:05:20.677 INFO:teuthology.orchestra.run.smithi203.stdout: "segex": 0, 2024-09-19T09:05:20.677 INFO:teuthology.orchestra.run.smithi203.stdout: "segtrm": 0, 2024-09-19T09:05:20.677 INFO:teuthology.orchestra.run.smithi203.stdout: "seg": 2, 2024-09-19T09:05:20.677 INFO:teuthology.orchestra.run.smithi203.stdout: "segmjr": 2, 2024-09-19T09:05:20.677 INFO:teuthology.orchestra.run.smithi203.stdout: "segexg": 0, 2024-09-19T09:05:20.677 INFO:teuthology.orchestra.run.smithi203.stdout: "segexd": 0, 2024-09-19T09:05:20.677 INFO:teuthology.orchestra.run.smithi203.stdout: "expos": 4194304, 2024-09-19T09:05:20.677 INFO:teuthology.orchestra.run.smithi203.stdout: "wrpos": 4195734, 2024-09-19T09:05:20.677 INFO:teuthology.orchestra.run.smithi203.stdout: "rdpos": 4195426, 2024-09-19T09:05:20.678 INFO:teuthology.orchestra.run.smithi203.stdout: "jlat": { 2024-09-19T09:05:20.678 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.678 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.678 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.678 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.678 INFO:teuthology.orchestra.run.smithi203.stdout: "replayed": 5 2024-09-19T09:05:20.678 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.678 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_mem": { 2024-09-19T09:05:20.679 INFO:teuthology.orchestra.run.smithi203.stdout: "ino": 3, 2024-09-19T09:05:20.679 INFO:teuthology.orchestra.run.smithi203.stdout: "ino+": 3, 2024-09-19T09:05:20.679 INFO:teuthology.orchestra.run.smithi203.stdout: "ino-": 0, 2024-09-19T09:05:20.679 INFO:teuthology.orchestra.run.smithi203.stdout: "dir": 1, 2024-09-19T09:05:20.679 INFO:teuthology.orchestra.run.smithi203.stdout: "dir+": 1, 2024-09-19T09:05:20.679 INFO:teuthology.orchestra.run.smithi203.stdout: "dir-": 0, 2024-09-19T09:05:20.679 INFO:teuthology.orchestra.run.smithi203.stdout: "dn": 0, 2024-09-19T09:05:20.679 INFO:teuthology.orchestra.run.smithi203.stdout: "dn+": 0, 2024-09-19T09:05:20.679 INFO:teuthology.orchestra.run.smithi203.stdout: "dn-": 0, 2024-09-19T09:05:20.680 INFO:teuthology.orchestra.run.smithi203.stdout: "cap": 0, 2024-09-19T09:05:20.680 INFO:teuthology.orchestra.run.smithi203.stdout: "cap+": 0, 2024-09-19T09:05:20.680 INFO:teuthology.orchestra.run.smithi203.stdout: "cap-": 0, 2024-09-19T09:05:20.680 INFO:teuthology.orchestra.run.smithi203.stdout: "rss": 48868, 2024-09-19T09:05:20.680 INFO:teuthology.orchestra.run.smithi203.stdout: "heap": 215328 2024-09-19T09:05:20.680 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.680 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_server": { 2024-09-19T09:05:20.680 INFO:teuthology.orchestra.run.smithi203.stdout: "dispatch_client_request": 0, 2024-09-19T09:05:20.681 INFO:teuthology.orchestra.run.smithi203.stdout: "dispatch_server_request": 0, 2024-09-19T09:05:20.681 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_request": 0, 2024-09-19T09:05:20.681 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_session": 0, 2024-09-19T09:05:20.681 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_peer_request": 0, 2024-09-19T09:05:20.681 INFO:teuthology.orchestra.run.smithi203.stdout: "req_create_latency": { 2024-09-19T09:05:20.681 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.681 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.681 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.681 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.682 INFO:teuthology.orchestra.run.smithi203.stdout: "req_getattr_latency": { 2024-09-19T09:05:20.682 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.682 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.682 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.682 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.682 INFO:teuthology.orchestra.run.smithi203.stdout: "req_getfilelock_latency": { 2024-09-19T09:05:20.682 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.682 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.683 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.683 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.683 INFO:teuthology.orchestra.run.smithi203.stdout: "req_link_latency": { 2024-09-19T09:05:20.683 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.683 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.683 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.683 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.683 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookup_latency": { 2024-09-19T09:05:20.684 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.684 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.684 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.684 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.684 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookuphash_latency": { 2024-09-19T09:05:20.684 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.684 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.684 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.684 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.685 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupino_latency": { 2024-09-19T09:05:20.685 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.685 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.685 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.685 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.685 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupname_latency": { 2024-09-19T09:05:20.685 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.685 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.686 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.686 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.686 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupparent_latency": { 2024-09-19T09:05:20.686 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.686 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.686 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.686 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.686 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupsnap_latency": { 2024-09-19T09:05:20.686 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.687 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.687 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.687 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.687 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lssnap_latency": { 2024-09-19T09:05:20.687 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.687 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.687 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.687 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.688 INFO:teuthology.orchestra.run.smithi203.stdout: "req_mkdir_latency": { 2024-09-19T09:05:20.688 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.689 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.689 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.689 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.689 INFO:teuthology.orchestra.run.smithi203.stdout: "req_mknod_latency": { 2024-09-19T09:05:20.689 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.689 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.689 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.689 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.690 INFO:teuthology.orchestra.run.smithi203.stdout: "req_mksnap_latency": { 2024-09-19T09:05:20.691 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.691 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.691 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.691 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.691 INFO:teuthology.orchestra.run.smithi203.stdout: "req_open_latency": { 2024-09-19T09:05:20.691 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.691 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.691 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.692 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.692 INFO:teuthology.orchestra.run.smithi203.stdout: "req_readdir_latency": { 2024-09-19T09:05:20.692 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.692 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.692 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.692 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.692 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rename_latency": { 2024-09-19T09:05:20.692 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.693 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.693 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.693 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.693 INFO:teuthology.orchestra.run.smithi203.stdout: "req_renamesnap_latency": { 2024-09-19T09:05:20.693 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.693 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.693 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.693 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.694 INFO:teuthology.orchestra.run.smithi203.stdout: "req_snapdiff_latency": { 2024-09-19T09:05:20.694 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.694 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.694 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.694 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.694 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rmdir_latency": { 2024-09-19T09:05:20.694 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.694 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.694 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.695 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.695 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rmsnap_latency": { 2024-09-19T09:05:20.695 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.695 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.695 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.695 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.695 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rmxattr_latency": { 2024-09-19T09:05:20.695 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.696 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.696 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.696 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.696 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setattr_latency": { 2024-09-19T09:05:20.696 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.696 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.696 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.696 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.697 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setdirlayout_latency": { 2024-09-19T09:05:20.697 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.697 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.697 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.697 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.697 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setfilelock_latency": { 2024-09-19T09:05:20.697 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.697 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.697 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.698 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.698 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setlayout_latency": { 2024-09-19T09:05:20.698 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.698 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.698 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.698 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.699 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setxattr_latency": { 2024-09-19T09:05:20.699 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.699 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.699 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.699 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.700 INFO:teuthology.orchestra.run.smithi203.stdout: "req_symlink_latency": { 2024-09-19T09:05:20.700 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.700 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.701 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.701 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.701 INFO:teuthology.orchestra.run.smithi203.stdout: "req_unlink_latency": { 2024-09-19T09:05:20.701 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.701 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.701 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.701 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.770 INFO:teuthology.orchestra.run.smithi203.stdout: "cap_revoke_eviction": 0, 2024-09-19T09:05:20.770 INFO:teuthology.orchestra.run.smithi203.stdout: "cap_acquisition_throttle": 0, 2024-09-19T09:05:20.770 INFO:teuthology.orchestra.run.smithi203.stdout: "req_getvxattr_latency": { 2024-09-19T09:05:20.770 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.770 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.770 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.770 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T09:05:20.771 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.771 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_sessions": { 2024-09-19T09:05:20.771 INFO:teuthology.orchestra.run.smithi203.stdout: "session_count": 1, 2024-09-19T09:05:20.771 INFO:teuthology.orchestra.run.smithi203.stdout: "session_add": 2, 2024-09-19T09:05:20.771 INFO:teuthology.orchestra.run.smithi203.stdout: "session_remove": 1, 2024-09-19T09:05:20.771 INFO:teuthology.orchestra.run.smithi203.stdout: "sessions_open": 1, 2024-09-19T09:05:20.771 INFO:teuthology.orchestra.run.smithi203.stdout: "sessions_stale": 0, 2024-09-19T09:05:20.771 INFO:teuthology.orchestra.run.smithi203.stdout: "total_load": 0, 2024-09-19T09:05:20.771 INFO:teuthology.orchestra.run.smithi203.stdout: "average_load": 0, 2024-09-19T09:05:20.772 INFO:teuthology.orchestra.run.smithi203.stdout: "avg_session_uptime": 2070, 2024-09-19T09:05:20.772 INFO:teuthology.orchestra.run.smithi203.stdout: "mdthresh_evicted": 0 2024-09-19T09:05:20.772 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.772 INFO:teuthology.orchestra.run.smithi203.stdout: "mempool": { 2024-09-19T09:05:20.772 INFO:teuthology.orchestra.run.smithi203.stdout: "bloom_filter_bytes": 0, 2024-09-19T09:05:20.772 INFO:teuthology.orchestra.run.smithi203.stdout: "bloom_filter_items": 0, 2024-09-19T09:05:20.772 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T09:05:20.772 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_alloc_items": 0, 2024-09-19T09:05:20.773 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T09:05:20.773 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_data_items": 0, 2024-09-19T09:05:20.773 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T09:05:20.773 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T09:05:20.773 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T09:05:20.773 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T09:05:20.773 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T09:05:20.773 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_other_items": 0, 2024-09-19T09:05:20.773 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T09:05:20.774 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T09:05:20.774 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_extent_bytes": 0, 2024-09-19T09:05:20.774 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_extent_items": 0, 2024-09-19T09:05:20.774 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_blob_bytes": 0, 2024-09-19T09:05:20.774 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_blob_items": 0, 2024-09-19T09:05:20.774 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T09:05:20.774 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T09:05:20.774 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T09:05:20.775 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T09:05:20.775 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T09:05:20.775 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_fsck_items": 0, 2024-09-19T09:05:20.775 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_txc_bytes": 0, 2024-09-19T09:05:20.775 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_txc_items": 0, 2024-09-19T09:05:20.775 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T09:05:20.775 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T09:05:20.775 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_bytes": 0, 2024-09-19T09:05:20.775 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_items": 0, 2024-09-19T09:05:20.776 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_bytes": 0, 2024-09-19T09:05:20.776 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_items": 0, 2024-09-19T09:05:20.776 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T09:05:20.776 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_reader_items": 0, 2024-09-19T09:05:20.776 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T09:05:20.776 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_writer_items": 0, 2024-09-19T09:05:20.776 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_anon_bytes": 190151, 2024-09-19T09:05:20.776 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_anon_items": 51, 2024-09-19T09:05:20.777 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_meta_bytes": 0, 2024-09-19T09:05:20.777 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_meta_items": 0, 2024-09-19T09:05:20.777 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_bytes": 0, 2024-09-19T09:05:20.777 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_items": 0, 2024-09-19T09:05:20.777 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_mapbl_bytes": 0, 2024-09-19T09:05:20.777 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_mapbl_items": 0, 2024-09-19T09:05:20.777 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_pglog_bytes": 0, 2024-09-19T09:05:20.777 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_pglog_items": 0, 2024-09-19T09:05:20.778 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_bytes": 7496, 2024-09-19T09:05:20.778 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_items": 154, 2024-09-19T09:05:20.778 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T09:05:20.778 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_mapping_items": 0, 2024-09-19T09:05:20.778 INFO:teuthology.orchestra.run.smithi203.stdout: "pgmap_bytes": 0, 2024-09-19T09:05:20.778 INFO:teuthology.orchestra.run.smithi203.stdout: "pgmap_items": 0, 2024-09-19T09:05:20.778 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_co_bytes": 8512, 2024-09-19T09:05:20.778 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_co_items": 13, 2024-09-19T09:05:20.778 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_1_bytes": 0, 2024-09-19T09:05:20.779 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_1_items": 0, 2024-09-19T09:05:20.779 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_2_bytes": 0, 2024-09-19T09:05:20.779 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_2_items": 0 2024-09-19T09:05:20.779 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.779 INFO:teuthology.orchestra.run.smithi203.stdout: "objecter": { 2024-09-19T09:05:20.779 INFO:teuthology.orchestra.run.smithi203.stdout: "op_active": 0, 2024-09-19T09:05:20.779 INFO:teuthology.orchestra.run.smithi203.stdout: "op_laggy": 0, 2024-09-19T09:05:20.779 INFO:teuthology.orchestra.run.smithi203.stdout: "op_send": 2595, 2024-09-19T09:05:20.780 INFO:teuthology.orchestra.run.smithi203.stdout: "op_send_bytes": 21, 2024-09-19T09:05:20.780 INFO:teuthology.orchestra.run.smithi203.stdout: "op_resend": 3, 2024-09-19T09:05:20.780 INFO:teuthology.orchestra.run.smithi203.stdout: "op_reply": 2595, 2024-09-19T09:05:20.780 INFO:teuthology.orchestra.run.smithi203.stdout: "op_latency": { 2024-09-19T09:05:20.780 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 2595, 2024-09-19T09:05:20.780 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 3.026921773, 2024-09-19T09:05:20.780 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.001166443 2024-09-19T09:05:20.780 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.780 INFO:teuthology.orchestra.run.smithi203.stdout: "op_inflight": 0, 2024-09-19T09:05:20.781 INFO:teuthology.orchestra.run.smithi203.stdout: "oplen_avg": { 2024-09-19T09:05:20.781 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 2595, 2024-09-19T09:05:20.781 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 2596 2024-09-19T09:05:20.781 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.781 INFO:teuthology.orchestra.run.smithi203.stdout: "op": 2595, 2024-09-19T09:05:20.781 INFO:teuthology.orchestra.run.smithi203.stdout: "op_r": 2595, 2024-09-19T09:05:20.781 INFO:teuthology.orchestra.run.smithi203.stdout: "op_w": 0, 2024-09-19T09:05:20.781 INFO:teuthology.orchestra.run.smithi203.stdout: "op_rmw": 0, 2024-09-19T09:05:20.782 INFO:teuthology.orchestra.run.smithi203.stdout: "op_pg": 0, 2024-09-19T09:05:20.782 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_stat": 1696, 2024-09-19T09:05:20.782 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_create": 0, 2024-09-19T09:05:20.782 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_read": 897, 2024-09-19T09:05:20.782 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_write": 0, 2024-09-19T09:05:20.782 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_writefull": 0, 2024-09-19T09:05:20.782 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_writesame": 0, 2024-09-19T09:05:20.782 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_append": 0, 2024-09-19T09:05:20.783 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_zero": 0, 2024-09-19T09:05:20.783 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_truncate": 0, 2024-09-19T09:05:20.783 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_delete": 0, 2024-09-19T09:05:20.783 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_mapext": 0, 2024-09-19T09:05:20.783 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_sparse_read": 0, 2024-09-19T09:05:20.783 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_clonerange": 0, 2024-09-19T09:05:20.783 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_getxattr": 1, 2024-09-19T09:05:20.783 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_setxattr": 0, 2024-09-19T09:05:20.784 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_cmpxattr": 0, 2024-09-19T09:05:20.784 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_rmxattr": 0, 2024-09-19T09:05:20.784 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_resetxattrs": 0, 2024-09-19T09:05:20.784 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_call": 0, 2024-09-19T09:05:20.784 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_watch": 0, 2024-09-19T09:05:20.784 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_notify": 0, 2024-09-19T09:05:20.784 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T09:05:20.784 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_pgls": 0, 2024-09-19T09:05:20.785 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_pgls_filter": 0, 2024-09-19T09:05:20.785 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_other": 0, 2024-09-19T09:05:20.785 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_active": 0, 2024-09-19T09:05:20.785 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_send": 0, 2024-09-19T09:05:20.785 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_resend": 0, 2024-09-19T09:05:20.785 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_ping": 0, 2024-09-19T09:05:20.786 INFO:teuthology.orchestra.run.smithi203.stdout: "poolop_active": 0, 2024-09-19T09:05:20.786 INFO:teuthology.orchestra.run.smithi203.stdout: "poolop_send": 0, 2024-09-19T09:05:20.786 INFO:teuthology.orchestra.run.smithi203.stdout: "poolop_resend": 0, 2024-09-19T09:05:20.787 INFO:teuthology.orchestra.run.smithi203.stdout: "poolstat_active": 0, 2024-09-19T09:05:20.787 INFO:teuthology.orchestra.run.smithi203.stdout: "poolstat_send": 0, 2024-09-19T09:05:20.787 INFO:teuthology.orchestra.run.smithi203.stdout: "poolstat_resend": 0, 2024-09-19T09:05:20.787 INFO:teuthology.orchestra.run.smithi203.stdout: "statfs_active": 0, 2024-09-19T09:05:20.787 INFO:teuthology.orchestra.run.smithi203.stdout: "statfs_send": 0, 2024-09-19T09:05:20.787 INFO:teuthology.orchestra.run.smithi203.stdout: "statfs_resend": 0, 2024-09-19T09:05:20.787 INFO:teuthology.orchestra.run.smithi203.stdout: "command_active": 0, 2024-09-19T09:05:20.787 INFO:teuthology.orchestra.run.smithi203.stdout: "command_send": 0, 2024-09-19T09:05:20.788 INFO:teuthology.orchestra.run.smithi203.stdout: "command_resend": 0, 2024-09-19T09:05:20.788 INFO:teuthology.orchestra.run.smithi203.stdout: "map_epoch": 88, 2024-09-19T09:05:20.788 INFO:teuthology.orchestra.run.smithi203.stdout: "map_full": 0, 2024-09-19T09:05:20.788 INFO:teuthology.orchestra.run.smithi203.stdout: "map_inc": 8, 2024-09-19T09:05:20.788 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_sessions": 5, 2024-09-19T09:05:20.788 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_session_open": 5, 2024-09-19T09:05:20.788 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_session_close": 0, 2024-09-19T09:05:20.788 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_laggy": 0, 2024-09-19T09:05:20.788 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_wr": 0, 2024-09-19T09:05:20.789 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_rd": 2, 2024-09-19T09:05:20.789 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_del": 0 2024-09-19T09:05:20.789 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.789 INFO:teuthology.orchestra.run.smithi203.stdout: "oft": { 2024-09-19T09:05:20.789 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_objs": 0, 2024-09-19T09:05:20.789 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_kv_pairs": 0, 2024-09-19T09:05:20.789 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_updates": 0, 2024-09-19T09:05:20.789 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_removes": 0 2024-09-19T09:05:20.790 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.790 INFO:teuthology.orchestra.run.smithi203.stdout: "osd-slow-ops": { 2024-09-19T09:05:20.790 INFO:teuthology.orchestra.run.smithi203.stdout: "slow_ops_count": 0 2024-09-19T09:05:20.790 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.790 INFO:teuthology.orchestra.run.smithi203.stdout: "purge_queue": { 2024-09-19T09:05:20.790 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing_ops": 0, 2024-09-19T09:05:20.790 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T09:05:20.790 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing": 0, 2024-09-19T09:05:20.790 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing_high_water": 0, 2024-09-19T09:05:20.791 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executed_ops": 0, 2024-09-19T09:05:20.791 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executed": 0, 2024-09-19T09:05:20.791 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_item_in_journal": 0 2024-09-19T09:05:20.791 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.791 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T09:05:20.791 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-09-19T09:05:20.791 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 104857600, 2024-09-19T09:05:20.791 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-09-19T09:05:20.792 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 2883, 2024-09-19T09:05:20.792 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 1349243, 2024-09-19T09:05:20.792 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:20.792 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 2883, 2024-09-19T09:05:20.792 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 0, 2024-09-19T09:05:20.792 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 0, 2024-09-19T09:05:20.792 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 2883, 2024-09-19T09:05:20.792 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 1349243, 2024-09-19T09:05:20.792 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-09-19T09:05:20.793 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.793 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.793 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.793 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T09:05:20.793 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.793 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-objecter_bytes": { 2024-09-19T09:05:20.793 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-09-19T09:05:20.793 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 104857600, 2024-09-19T09:05:20.793 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-09-19T09:05:20.794 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 0, 2024-09-19T09:05:20.794 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 0, 2024-09-19T09:05:20.794 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:20.794 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 0, 2024-09-19T09:05:20.794 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 2595, 2024-09-19T09:05:20.794 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 1435, 2024-09-19T09:05:20.794 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 2595, 2024-09-19T09:05:20.794 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 1435, 2024-09-19T09:05:20.795 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-09-19T09:05:20.795 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.795 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.795 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.795 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T09:05:20.795 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.795 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-objecter_ops": { 2024-09-19T09:05:20.795 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-09-19T09:05:20.795 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 1024, 2024-09-19T09:05:20.796 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-09-19T09:05:20.796 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 0, 2024-09-19T09:05:20.796 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 0, 2024-09-19T09:05:20.796 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:20.796 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 0, 2024-09-19T09:05:20.796 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 2595, 2024-09-19T09:05:20.796 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 2595, 2024-09-19T09:05:20.796 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 2595, 2024-09-19T09:05:20.797 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 2595, 2024-09-19T09:05:20.797 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-09-19T09:05:20.797 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.797 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.797 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.797 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T09:05:20.797 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.797 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-write_buf_throttle": { 2024-09-19T09:05:20.798 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-09-19T09:05:20.798 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 3758096384, 2024-09-19T09:05:20.798 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-09-19T09:05:20.798 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 0, 2024-09-19T09:05:20.798 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 0, 2024-09-19T09:05:20.798 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:20.798 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 0, 2024-09-19T09:05:20.798 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 0, 2024-09-19T09:05:20.798 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 0, 2024-09-19T09:05:20.799 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 0, 2024-09-19T09:05:20.799 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 0, 2024-09-19T09:05:20.799 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-09-19T09:05:20.799 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.799 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.799 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.799 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T09:05:20.799 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-09-19T09:05:20.799 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-write_buf_throttle-0x55f77daf0b40": { 2024-09-19T09:05:20.800 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-09-19T09:05:20.800 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 3758096384, 2024-09-19T09:05:20.800 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-09-19T09:05:20.800 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 0, 2024-09-19T09:05:20.800 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 0, 2024-09-19T09:05:20.800 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-09-19T09:05:20.800 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 0, 2024-09-19T09:05:20.800 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 0, 2024-09-19T09:05:20.801 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 0, 2024-09-19T09:05:20.801 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 0, 2024-09-19T09:05:20.801 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 0, 2024-09-19T09:05:20.801 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-09-19T09:05:20.801 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-09-19T09:05:20.801 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-09-19T09:05:20.801 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-09-19T09:05:20.801 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T09:05:20.801 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-09-19T09:05:20.802 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-09-19T09:05:21.421 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-19T09:05:21.422 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-19T09:05:21.422 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-09-19T09:05:21.422 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-09-19T09:05:21.422 INFO:tasks.check_counter:Daemon mds.l mds.dir_split=0 2024-09-19T09:05:21.422 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-19T09:05:21.437 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-19T09:05:21.437 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-19T09:05:21.438 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:05:21.468 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-19T09:05:21.468 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T09:05:21.530 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T09:05:21.839 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:21.960 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:21 smithi019 ceph-mon[30976]: pgmap v737: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 9 op/s 2024-09-19T09:05:22.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:21 smithi155 ceph-mon[34921]: pgmap v737: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 9 op/s 2024-09-19T09:05:22.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:21 smithi203 ceph-mon[35450]: pgmap v737: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 9 op/s 2024-09-19T09:05:22.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.331+0000 7f4cec080640 1 -- 172.21.15.19:0/3133607325 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ce4102790 msgr2=0x7f4ce41067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:22.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.331+0000 7f4cec080640 1 --2- 172.21.15.19:0/3133607325 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ce4102790 0x7f4ce41067e0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4009900 tx=0x7f4cd402a410 comp rx=0 tx=0).stop 2024-09-19T09:05:22.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.331+0000 7f4cec080640 1 -- 172.21.15.19:0/3133607325 shutdown_connections 2024-09-19T09:05:22.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.331+0000 7f4cec080640 1 --2- 172.21.15.19:0/3133607325 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4ce4106f10 0x7f4ce410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.331+0000 7f4cec080640 1 --2- 172.21.15.19:0/3133607325 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ce4102790 0x7f4ce41067e0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.331+0000 7f4cec080640 1 --2- 172.21.15.19:0/3133607325 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ce4101de0 0x7f4ce41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.331+0000 7f4cec080640 1 -- 172.21.15.19:0/3133607325 >> 172.21.15.19:0/3133607325 conn(0x7f4ce40fd8c0 msgr2=0x7f4ce40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:22.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.331+0000 7f4cec080640 1 -- 172.21.15.19:0/3133607325 shutdown_connections 2024-09-19T09:05:22.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.331+0000 7f4cec080640 1 -- 172.21.15.19:0/3133607325 wait complete. 2024-09-19T09:05:22.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.332+0000 7f4cec080640 1 Processor -- start 2024-09-19T09:05:22.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.332+0000 7f4cec080640 1 -- start start 2024-09-19T09:05:22.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.332+0000 7f4cec080640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ce4101de0 0x7f4ce40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:22.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.332+0000 7f4cec080640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4ce4102790 0x7f4ce4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:22.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.332+0000 7f4cec080640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ce4106f10 0x7f4ce4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:22.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.332+0000 7f4cec080640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce4111f90 con 0x7f4ce4106f10 2024-09-19T09:05:22.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.332+0000 7f4cec080640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce4111e10 con 0x7f4ce4101de0 2024-09-19T09:05:22.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.332+0000 7f4cec080640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce4112110 con 0x7f4ce4102790 2024-09-19T09:05:22.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.332+0000 7f4cea61d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ce4106f10 0x7f4ce4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:22.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.332+0000 7f4cea61d640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ce4106f10 0x7f4ce4074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44392/0 (socket says 172.21.15.19:44392) 2024-09-19T09:05:22.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.332+0000 7f4cea61d640 1 -- 172.21.15.19:0/1896846489 learned_addr learned my addr 172.21.15.19:0/1896846489 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:05:22.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.332+0000 7f4ce961b640 1 --2- 172.21.15.19:0/1896846489 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4ce4102790 0x7f4ce4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:22.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.332+0000 7f4ce9e1c640 1 --2- 172.21.15.19:0/1896846489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ce4101de0 0x7f4ce40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:22.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.332+0000 7f4cea61d640 1 -- 172.21.15.19:0/1896846489 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4ce4102790 msgr2=0x7f4ce4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:22.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.332+0000 7f4cea61d640 1 --2- 172.21.15.19:0/1896846489 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4ce4102790 0x7f4ce4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.332+0000 7f4cea61d640 1 -- 172.21.15.19:0/1896846489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ce4101de0 msgr2=0x7f4ce40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:22.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.332+0000 7f4cea61d640 1 --2- 172.21.15.19:0/1896846489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ce4101de0 0x7f4ce40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.332+0000 7f4cea61d640 1 -- 172.21.15.19:0/1896846489 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce41a6930 con 0x7f4ce4106f10 2024-09-19T09:05:22.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.333+0000 7f4cea61d640 1 --2- 172.21.15.19:0/1896846489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ce4106f10 0x7f4ce4074f70 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc00b970 tx=0x7f4cdc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:22.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.333+0000 7f4cdaffd640 1 -- 172.21.15.19:0/1896846489 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc019070 con 0x7f4ce4106f10 2024-09-19T09:05:22.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.333+0000 7f4cec080640 1 -- 172.21.15.19:0/1896846489 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ce41a6c20 con 0x7f4ce4106f10 2024-09-19T09:05:22.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.333+0000 7f4cdaffd640 1 -- 172.21.15.19:0/1896846489 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f4cdc00cb40 con 0x7f4ce4106f10 2024-09-19T09:05:22.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.333+0000 7f4cdaffd640 1 -- 172.21.15.19:0/1896846489 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc007610 con 0x7f4ce4106f10 2024-09-19T09:05:22.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.333+0000 7f4cec080640 1 -- 172.21.15.19:0/1896846489 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ce41a71b0 con 0x7f4ce4106f10 2024-09-19T09:05:22.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.334+0000 7f4cec080640 1 -- 172.21.15.19:0/1896846489 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ce41021c0 con 0x7f4ce4106f10 2024-09-19T09:05:22.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.335+0000 7f4cdaffd640 1 -- 172.21.15.19:0/1896846489 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f4cdc01c070 con 0x7f4ce4106f10 2024-09-19T09:05:22.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.336+0000 7f4cdaffd640 1 --2- 172.21.15.19:0/1896846489 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4cd00a3240 0x7f4cd00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:22.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.336+0000 7f4ce9e1c640 1 --2- 172.21.15.19:0/1896846489 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4cd00a3240 0x7f4cd00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:22.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.336+0000 7f4cdaffd640 1 -- 172.21.15.19:0/1896846489 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f4cdc0cf430 con 0x7f4ce4106f10 2024-09-19T09:05:22.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.336+0000 7f4ce9e1c640 1 --2- 172.21.15.19:0/1896846489 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4cd00a3240 0x7f4cd00a5700 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0005fd0 tx=0x7f4ce0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:22.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.339+0000 7f4cdaffd640 1 -- 172.21.15.19:0/1896846489 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4cdc09c100 con 0x7f4ce4106f10 2024-09-19T09:05:22.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.527+0000 7f4cec080640 1 -- 172.21.15.19:0/1896846489 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4ce410a0f0 con 0x7f4ce4106f10 2024-09-19T09:05:22.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.528+0000 7f4cdaffd640 1 -- 172.21.15.19:0/1896846489 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v88) ==== 81+0+587 (secure 0 0 0) 0x7f4cdc09ba00 con 0x7f4ce4106f10 2024-09-19T09:05:22.528 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6801/4266644067 2024-09-20T08:43:21.732222+0000 2024-09-19T09:05:22.528 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:0/1398782170 2024-09-20T08:43:21.732222+0000 2024-09-19T09:05:22.529 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6800/4266644067 2024-09-20T08:43:21.732222+0000 2024-09-19T09:05:22.529 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:0/34162461 2024-09-20T08:43:21.732222+0000 2024-09-19T09:05:22.529 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6801/1764769529 2024-09-20T08:42:56.618773+0000 2024-09-19T09:05:22.529 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:0/2910961714 2024-09-20T08:43:21.732222+0000 2024-09-19T09:05:22.529 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:6800/1764769529 2024-09-20T08:42:56.618773+0000 2024-09-19T09:05:22.529 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:0/820792769 2024-09-20T08:42:56.618773+0000 2024-09-19T09:05:22.529 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:0/560203138 2024-09-20T08:42:56.618773+0000 2024-09-19T09:05:22.529 INFO:teuthology.orchestra.run.smithi019.stdout:172.21.15.19:0/809642328 2024-09-20T08:42:56.618773+0000 2024-09-19T09:05:22.530 INFO:teuthology.orchestra.run.smithi019.stderr:listed 10 entries 2024-09-19T09:05:22.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.530+0000 7f4cec080640 1 -- 172.21.15.19:0/1896846489 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4cd00a3240 msgr2=0x7f4cd00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:22.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.530+0000 7f4cec080640 1 --2- 172.21.15.19:0/1896846489 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4cd00a3240 0x7f4cd00a5700 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0005fd0 tx=0x7f4ce0005850 comp rx=0 tx=0).stop 2024-09-19T09:05:22.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.530+0000 7f4cec080640 1 -- 172.21.15.19:0/1896846489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ce4106f10 msgr2=0x7f4ce4074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:22.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.530+0000 7f4cec080640 1 --2- 172.21.15.19:0/1896846489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ce4106f10 0x7f4ce4074f70 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc00b970 tx=0x7f4cdc00be30 comp rx=0 tx=0).stop 2024-09-19T09:05:22.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.530+0000 7f4cec080640 1 -- 172.21.15.19:0/1896846489 shutdown_connections 2024-09-19T09:05:22.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.530+0000 7f4cec080640 1 --2- 172.21.15.19:0/1896846489 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f4cd00a3240 0x7f4cd00a5700 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.530+0000 7f4cec080640 1 --2- 172.21.15.19:0/1896846489 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4ce4102790 0x7f4ce4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.530+0000 7f4cec080640 1 --2- 172.21.15.19:0/1896846489 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f4ce4106f10 0x7f4ce4074f70 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.530+0000 7f4cec080640 1 --2- 172.21.15.19:0/1896846489 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f4ce4101de0 0x7f4ce40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:22.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.530+0000 7f4cec080640 1 -- 172.21.15.19:0/1896846489 >> 172.21.15.19:0/1896846489 conn(0x7f4ce40fd8c0 msgr2=0x7f4ce40fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:22.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.530+0000 7f4cec080640 1 -- 172.21.15.19:0/1896846489 shutdown_connections 2024-09-19T09:05:22.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:22.530+0000 7f4cec080640 1 -- 172.21.15.19:0/1896846489 wait complete. 2024-09-19T09:05:22.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:22 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1896846489' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:05:23.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:22 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1896846489' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:05:23.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:22 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1896846489' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T09:05:23.345 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-19T09:05:23.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:05:23.345 DEBUG:teuthology.orchestra.run.smithi019:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-19T09:05:23.403 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi019.front.sepia.ceph.com 2024-09-19T09:05:23.403 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:05:23.403 DEBUG:teuthology.orchestra.run.smithi019:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T09:05:23.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:05:23.449 DEBUG:teuthology.orchestra.run.smithi019:> ip netns list 2024-09-19T09:05:23.519 INFO:teuthology.orchestra.run.smithi019.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T09:05:23.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:05:23.520 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T09:05:23.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T09:05:23.546 DEBUG:teuthology.orchestra.run.smithi019:> sudo ip link delete ceph-brx 2024-09-19T09:05:23.642 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-19T09:05:23.667 INFO:tasks.cephadm:Teardown begin 2024-09-19T09:05:23.667 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T09:05:23.667 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:05:23.925 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:24.048 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:23 smithi019 ceph-mon[30976]: pgmap v738: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2024-09-19T09:05:24.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:23 smithi155 ceph-mon[34921]: pgmap v738: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2024-09-19T09:05:24.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:23 smithi203 ceph-mon[35450]: pgmap v738: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 10 op/s 2024-09-19T09:05:24.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.402+0000 7fcede05c640 1 -- 172.21.15.19:0/1411925492 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fced81027a0 msgr2=0x7fced81067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:24.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.402+0000 7fcede05c640 1 --2- 172.21.15.19:0/1411925492 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fced81027a0 0x7fced81067f0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fcec0009900 tx=0x7fcec002a410 comp rx=0 tx=0).stop 2024-09-19T09:05:24.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.402+0000 7fcede05c640 1 -- 172.21.15.19:0/1411925492 shutdown_connections 2024-09-19T09:05:24.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.402+0000 7fcede05c640 1 --2- 172.21.15.19:0/1411925492 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fced8106f20 0x7fced810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.402+0000 7fcede05c640 1 --2- 172.21.15.19:0/1411925492 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fced81027a0 0x7fced81067f0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.402+0000 7fcede05c640 1 --2- 172.21.15.19:0/1411925492 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fced8101df0 0x7fced81021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.402+0000 7fcede05c640 1 -- 172.21.15.19:0/1411925492 >> 172.21.15.19:0/1411925492 conn(0x7fced80fd8b0 msgr2=0x7fced80ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:24.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.402+0000 7fcede05c640 1 -- 172.21.15.19:0/1411925492 shutdown_connections 2024-09-19T09:05:24.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.402+0000 7fcede05c640 1 -- 172.21.15.19:0/1411925492 wait complete. 2024-09-19T09:05:24.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.402+0000 7fcede05c640 1 Processor -- start 2024-09-19T09:05:24.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.402+0000 7fcede05c640 1 -- start start 2024-09-19T09:05:24.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.403+0000 7fcede05c640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fced8101df0 0x7fced80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:24.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.403+0000 7fcede05c640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fced81027a0 0x7fced8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:24.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.403+0000 7fcede05c640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fced8106f20 0x7fced8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:24.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.403+0000 7fcede05c640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fced8111f40 con 0x7fced8106f20 2024-09-19T09:05:24.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.403+0000 7fcede05c640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fced8111dc0 con 0x7fced8101df0 2024-09-19T09:05:24.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.403+0000 7fcede05c640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fced81120c0 con 0x7fced81027a0 2024-09-19T09:05:24.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.403+0000 7fced7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fced8106f20 0x7fced8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:24.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.403+0000 7fced7fff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fced8106f20 0x7fced8074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:44406/0 (socket says 172.21.15.19:44406) 2024-09-19T09:05:24.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.403+0000 7fced7fff640 1 -- 172.21.15.19:0/3740889860 learned_addr learned my addr 172.21.15.19:0/3740889860 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:05:24.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.403+0000 7fcecffff640 1 --2- 172.21.15.19:0/3740889860 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fced81027a0 0x7fced8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:24.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.403+0000 7fced77fe640 1 --2- 172.21.15.19:0/3740889860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fced8101df0 0x7fced80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:24.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.403+0000 7fced7fff640 1 -- 172.21.15.19:0/3740889860 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fced81027a0 msgr2=0x7fced8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:24.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.403+0000 7fced7fff640 1 --2- 172.21.15.19:0/3740889860 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fced81027a0 0x7fced8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.403+0000 7fced7fff640 1 -- 172.21.15.19:0/3740889860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fced8101df0 msgr2=0x7fced80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:24.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.403+0000 7fced7fff640 1 --2- 172.21.15.19:0/3740889860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fced8101df0 0x7fced80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.403+0000 7fced7fff640 1 -- 172.21.15.19:0/3740889860 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced81a68c0 con 0x7fced8106f20 2024-09-19T09:05:24.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.403+0000 7fced7fff640 1 --2- 172.21.15.19:0/3740889860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fced8106f20 0x7fced8074f70 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fced000eaa0 tx=0x7fced000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:24.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.403+0000 7fced57fa640 1 -- 172.21.15.19:0/3740889860 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced000cdb0 con 0x7fced8106f20 2024-09-19T09:05:24.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.404+0000 7fcede05c640 1 -- 172.21.15.19:0/3740889860 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fced81a6bb0 con 0x7fced8106f20 2024-09-19T09:05:24.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.404+0000 7fced57fa640 1 -- 172.21.15.19:0/3740889860 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fced0005020 con 0x7fced8106f20 2024-09-19T09:05:24.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.404+0000 7fced57fa640 1 -- 172.21.15.19:0/3740889860 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced00116b0 con 0x7fced8106f20 2024-09-19T09:05:24.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.404+0000 7fcede05c640 1 -- 172.21.15.19:0/3740889860 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fced81a70c0 con 0x7fced8106f20 2024-09-19T09:05:24.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.404+0000 7fcede05c640 1 -- 172.21.15.19:0/3740889860 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fced81021d0 con 0x7fced8106f20 2024-09-19T09:05:24.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.406+0000 7fced57fa640 1 -- 172.21.15.19:0/3740889860 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fced0005560 con 0x7fced8106f20 2024-09-19T09:05:24.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.406+0000 7fced57fa640 1 --2- 172.21.15.19:0/3740889860 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fcec40a3240 0x7fcec40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:24.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.406+0000 7fced77fe640 1 --2- 172.21.15.19:0/3740889860 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fcec40a3240 0x7fcec40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:24.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.407+0000 7fced57fa640 1 -- 172.21.15.19:0/3740889860 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7fced00cfa60 con 0x7fced8106f20 2024-09-19T09:05:24.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.407+0000 7fced77fe640 1 --2- 172.21.15.19:0/3740889860 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fcec40a3240 0x7fcec40a5700 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fcec800bbe0 tx=0x7fcec800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:24.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.410+0000 7fced57fa640 1 -- 172.21.15.19:0/3740889860 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fced0016030 con 0x7fced8106f20 2024-09-19T09:05:24.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.624+0000 7fcede05c640 1 -- 172.21.15.19:0/3740889860 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fced802d7c0 con 0x7fced8106f20 2024-09-19T09:05:24.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.625+0000 7fced57fa640 1 -- 172.21.15.19:0/3740889860 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+11985 (secure 0 0 0) 0x7fced009c140 con 0x7fced8106f20 2024-09-19T09:05:24.626 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T09:05:24.626 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":43,"btime":"2024-09-19T09:04:13:255619+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":17751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/3815927080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":3815927080},{"type":"v1","addr":"172.21.15.19:6839","nonce":3815927080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":43,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T09:04:12.935193+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":213,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26453":{"gid":26453,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/3907362737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3907362737},{"type":"v1","addr":"172.21.15.155:6835","nonce":3907362737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24469,24490,24464,24463]},"id":1}]} 2024-09-19T09:05:24.627 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 43 2024-09-19T09:05:24.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.627+0000 7fcede05c640 1 -- 172.21.15.19:0/3740889860 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fcec40a3240 msgr2=0x7fcec40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:24.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.627+0000 7fcede05c640 1 --2- 172.21.15.19:0/3740889860 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fcec40a3240 0x7fcec40a5700 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fcec800bbe0 tx=0x7fcec800b390 comp rx=0 tx=0).stop 2024-09-19T09:05:24.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.627+0000 7fcede05c640 1 -- 172.21.15.19:0/3740889860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fced8106f20 msgr2=0x7fced8074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:24.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.627+0000 7fcede05c640 1 --2- 172.21.15.19:0/3740889860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fced8106f20 0x7fced8074f70 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7fced000eaa0 tx=0x7fced000ef60 comp rx=0 tx=0).stop 2024-09-19T09:05:24.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.628+0000 7fcede05c640 1 -- 172.21.15.19:0/3740889860 shutdown_connections 2024-09-19T09:05:24.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.628+0000 7fcede05c640 1 --2- 172.21.15.19:0/3740889860 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fcec40a3240 0x7fcec40a5700 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.628+0000 7fcede05c640 1 --2- 172.21.15.19:0/3740889860 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fced81027a0 0x7fced8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.628+0000 7fcede05c640 1 --2- 172.21.15.19:0/3740889860 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fced8106f20 0x7fced8074f70 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.628+0000 7fcede05c640 1 --2- 172.21.15.19:0/3740889860 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fced8101df0 0x7fced80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:24.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.628+0000 7fcede05c640 1 -- 172.21.15.19:0/3740889860 >> 172.21.15.19:0/3740889860 conn(0x7fced80fd8b0 msgr2=0x7fced80fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:24.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.628+0000 7fcede05c640 1 -- 172.21.15.19:0/3740889860 shutdown_connections 2024-09-19T09:05:24.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:24.628+0000 7fcede05c640 1 -- 172.21.15.19:0/3740889860 wait complete. 2024-09-19T09:05:25.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:24 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3740889860' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:05:25.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:24 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3740889860' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:05:25.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:24 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3740889860' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:05:25.321 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T09:05:25.581 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:25.977 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:25 smithi019 ceph-mon[30976]: pgmap v739: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-19T09:05:26.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.059+0000 7f3847526640 1 -- 172.21.15.19:0/1721971099 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3840102790 msgr2=0x7f38401067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:26.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.059+0000 7f3847526640 1 --2- 172.21.15.19:0/1721971099 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3840102790 0x7f38401067e0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f3830009900 tx=0x7f383002a410 comp rx=0 tx=0).stop 2024-09-19T09:05:26.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.059+0000 7f3847526640 1 -- 172.21.15.19:0/1721971099 shutdown_connections 2024-09-19T09:05:26.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.059+0000 7f3847526640 1 --2- 172.21.15.19:0/1721971099 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3840106f10 0x7f384010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:26.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.059+0000 7f3847526640 1 --2- 172.21.15.19:0/1721971099 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3840102790 0x7f38401067e0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:26.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.059+0000 7f3847526640 1 --2- 172.21.15.19:0/1721971099 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3840101de0 0x7f38401021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:26.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.059+0000 7f3847526640 1 -- 172.21.15.19:0/1721971099 >> 172.21.15.19:0/1721971099 conn(0x7f38400fd8c0 msgr2=0x7f38400ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:26.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.059+0000 7f3847526640 1 -- 172.21.15.19:0/1721971099 shutdown_connections 2024-09-19T09:05:26.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.059+0000 7f3847526640 1 -- 172.21.15.19:0/1721971099 wait complete. 2024-09-19T09:05:26.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.060+0000 7f3847526640 1 Processor -- start 2024-09-19T09:05:26.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.060+0000 7f3847526640 1 -- start start 2024-09-19T09:05:26.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.060+0000 7f3847526640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3840101de0 0x7f3840198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:26.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.060+0000 7f3847526640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3840102790 0x7f3840198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:26.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.060+0000 7f3847526640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3840106f10 0x7f384019cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:26.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.060+0000 7f3847526640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f3840111fc0 con 0x7f3840106f10 2024-09-19T09:05:26.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.060+0000 7f3847526640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f3840111e40 con 0x7f3840102790 2024-09-19T09:05:26.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.060+0000 7f3847526640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3840112140 con 0x7f3840101de0 2024-09-19T09:05:26.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.060+0000 7f3845ac3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3840106f10 0x7f384019cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:26.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.060+0000 7f3845ac3640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3840106f10 0x7f384019cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47800/0 (socket says 172.21.15.19:47800) 2024-09-19T09:05:26.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.060+0000 7f3845ac3640 1 -- 172.21.15.19:0/1152766058 learned_addr learned my addr 172.21.15.19:0/1152766058 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:05:26.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.060+0000 7f38452c2640 1 --2- 172.21.15.19:0/1152766058 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3840101de0 0x7f3840198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:26.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.060+0000 7f3844ac1640 1 --2- 172.21.15.19:0/1152766058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3840102790 0x7f3840198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:26.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.060+0000 7f3845ac3640 1 -- 172.21.15.19:0/1152766058 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3840101de0 msgr2=0x7f3840198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:26.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.060+0000 7f3845ac3640 1 --2- 172.21.15.19:0/1152766058 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3840101de0 0x7f3840198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:26.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.060+0000 7f3845ac3640 1 -- 172.21.15.19:0/1152766058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3840102790 msgr2=0x7f3840198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:26.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.060+0000 7f3845ac3640 1 --2- 172.21.15.19:0/1152766058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3840102790 0x7f3840198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:26.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.060+0000 7f3845ac3640 1 -- 172.21.15.19:0/1152766058 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f384019d4d0 con 0x7f3840106f10 2024-09-19T09:05:26.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.061+0000 7f3845ac3640 1 --2- 172.21.15.19:0/1152766058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3840106f10 0x7f384019cdf0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f383800eaa0 tx=0x7f383800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:26.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.061+0000 7f38367fc640 1 -- 172.21.15.19:0/1152766058 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f383800cdb0 con 0x7f3840106f10 2024-09-19T09:05:26.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.061+0000 7f3847526640 1 -- 172.21.15.19:0/1152766058 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f384019d7c0 con 0x7f3840106f10 2024-09-19T09:05:26.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.061+0000 7f38367fc640 1 -- 172.21.15.19:0/1152766058 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f3838005020 con 0x7f3840106f10 2024-09-19T09:05:26.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.061+0000 7f38367fc640 1 -- 172.21.15.19:0/1152766058 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38380116d0 con 0x7f3840106f10 2024-09-19T09:05:26.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.061+0000 7f3847526640 1 -- 172.21.15.19:0/1152766058 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38401a50a0 con 0x7f3840106f10 2024-09-19T09:05:26.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.062+0000 7f3847526640 1 -- 172.21.15.19:0/1152766058 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38401021c0 con 0x7f3840106f10 2024-09-19T09:05:26.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.063+0000 7f38367fc640 1 -- 172.21.15.19:0/1152766058 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f38380054d0 con 0x7f3840106f10 2024-09-19T09:05:26.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.064+0000 7f38367fc640 1 --2- 172.21.15.19:0/1152766058 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f382c0a3240 0x7f382c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:26.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.064+0000 7f38452c2640 1 --2- 172.21.15.19:0/1152766058 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f382c0a3240 0x7f382c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:26.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.064+0000 7f38367fc640 1 -- 172.21.15.19:0/1152766058 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f38380cfbc0 con 0x7f3840106f10 2024-09-19T09:05:26.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.064+0000 7f38452c2640 1 --2- 172.21.15.19:0/1152766058 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f382c0a3240 0x7f382c0a5700 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f383c005fd0 tx=0x7f383c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:26.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.068+0000 7f38367fc640 1 -- 172.21.15.19:0/1152766058 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3838016030 con 0x7f3840106f10 2024-09-19T09:05:26.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:25 smithi155 ceph-mon[34921]: pgmap v739: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-19T09:05:26.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:25 smithi203 ceph-mon[35450]: pgmap v739: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 341 B/s wr, 10 op/s 2024-09-19T09:05:26.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.284+0000 7f3847526640 1 -- 172.21.15.19:0/1152766058 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f384010a150 con 0x7f3840106f10 2024-09-19T09:05:26.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.284+0000 7f38367fc640 1 -- 172.21.15.19:0/1152766058 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+11985 (secure 0 0 0) 0x7f383809c890 con 0x7f3840106f10 2024-09-19T09:05:26.285 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T09:05:26.285 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":43,"btime":"2024-09-19T09:04:13:255619+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6837/1501683219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6836","nonce":1501683219},{"type":"v1","addr":"172.21.15.19:6837","nonce":1501683219}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":17751,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.19:6839/3815927080","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6838","nonce":3815927080},{"type":"v1","addr":"172.21.15.19:6839","nonce":3815927080}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":43,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T08:50:16.477197+0000","modified":"2024-09-19T09:04:12.935193+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24497,"mds_1":24490,"mds_2":24469,"mds_3":24464,"mds_4":24463},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14619":{"gid":14619,"name":"a","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6841/1973648402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6840","nonce":1973648402},{"type":"v1","addr":"172.21.15.19:6841","nonce":1973648402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"l","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/471920691","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":471920691},{"type":"v1","addr":"172.21.15.203:6833","nonce":471920691}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24419":{"gid":24419,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6833/3575511501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6832","nonce":3575511501},{"type":"v1","addr":"172.21.15.155:6833","nonce":3575511501}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24431":{"gid":24431,"name":"j","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.19:6835/805488508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6834","nonce":805488508},{"type":"v1","addr":"172.21.15.19:6835","nonce":805488508}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24463":{"gid":24463,"name":"f","rank":4,"incarnation":25,"state":"up:active","state_seq":11,"addr":"172.21.15.203:6835/2702758353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2702758353},{"type":"v1","addr":"172.21.15.203:6835","nonce":2702758353}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24464":{"gid":24464,"name":"h","rank":3,"incarnation":23,"state":"up:active","state_seq":9,"addr":"172.21.15.155:6837/3381010945","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6836","nonce":3381010945},{"type":"v1","addr":"172.21.15.155:6837","nonce":3381010945}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":10,"addr":"172.21.15.203:6837/3684671619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3684671619},{"type":"v1","addr":"172.21.15.203:6837","nonce":3684671619}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24490":{"gid":24490,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.203:6839/2547507299","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":2547507299},{"type":"v1","addr":"172.21.15.203:6839","nonce":2547507299}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24497":{"gid":24497,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":213,"addr":"172.21.15.155:6839/1224030981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6838","nonce":1224030981},{"type":"v1","addr":"172.21.15.155:6839","nonce":1224030981}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_26453":{"gid":26453,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.155:6835/3907362737","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6834","nonce":3907362737},{"type":"v1","addr":"172.21.15.155:6835","nonce":3907362737}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24497,"qdb_cluster":[24497,24469,24490,24464,24463]},"id":1}]} 2024-09-19T09:05:26.285 INFO:teuthology.orchestra.run.smithi019.stderr:dumped fsmap epoch 43 2024-09-19T09:05:26.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.287+0000 7f3847526640 1 -- 172.21.15.19:0/1152766058 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f382c0a3240 msgr2=0x7f382c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:26.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.287+0000 7f3847526640 1 --2- 172.21.15.19:0/1152766058 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f382c0a3240 0x7f382c0a5700 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f383c005fd0 tx=0x7f383c005850 comp rx=0 tx=0).stop 2024-09-19T09:05:26.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.287+0000 7f3847526640 1 -- 172.21.15.19:0/1152766058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3840106f10 msgr2=0x7f384019cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:26.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.287+0000 7f3847526640 1 --2- 172.21.15.19:0/1152766058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3840106f10 0x7f384019cdf0 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f383800eaa0 tx=0x7f383800ef60 comp rx=0 tx=0).stop 2024-09-19T09:05:26.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.287+0000 7f3847526640 1 -- 172.21.15.19:0/1152766058 shutdown_connections 2024-09-19T09:05:26.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.287+0000 7f3847526640 1 --2- 172.21.15.19:0/1152766058 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f382c0a3240 0x7f382c0a5700 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:26.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.287+0000 7f3847526640 1 --2- 172.21.15.19:0/1152766058 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f3840106f10 0x7f384019cdf0 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:26.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.287+0000 7f3847526640 1 --2- 172.21.15.19:0/1152766058 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f3840102790 0x7f3840198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:26.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.287+0000 7f3847526640 1 --2- 172.21.15.19:0/1152766058 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3840101de0 0x7f3840198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:26.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.287+0000 7f3847526640 1 -- 172.21.15.19:0/1152766058 >> 172.21.15.19:0/1152766058 conn(0x7f38400fd8c0 msgr2=0x7f38400fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:26.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.287+0000 7f3847526640 1 -- 172.21.15.19:0/1152766058 shutdown_connections 2024-09-19T09:05:26.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:26.287+0000 7f3847526640 1 -- 172.21.15.19:0/1152766058 wait complete. 2024-09-19T09:05:26.949 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:26 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1152766058' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:05:26.980 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T09:05:27.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:26 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1152766058' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:05:27.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:26 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1152766058' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T09:05:27.238 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:27.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.702+0000 7f1735f5f640 1 -- 172.21.15.19:0/871571554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1730102790 msgr2=0x7f17301067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:27.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.702+0000 7f1735f5f640 1 --2- 172.21.15.19:0/871571554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1730102790 0x7f17301067e0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f1724009900 tx=0x7f172402a410 comp rx=0 tx=0).stop 2024-09-19T09:05:27.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.703+0000 7f1735f5f640 1 -- 172.21.15.19:0/871571554 shutdown_connections 2024-09-19T09:05:27.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.703+0000 7f1735f5f640 1 --2- 172.21.15.19:0/871571554 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1730106f10 0x7f173010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.703+0000 7f1735f5f640 1 --2- 172.21.15.19:0/871571554 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1730102790 0x7f17301067e0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.703+0000 7f1735f5f640 1 --2- 172.21.15.19:0/871571554 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1730101de0 0x7f17301021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.703+0000 7f1735f5f640 1 -- 172.21.15.19:0/871571554 >> 172.21.15.19:0/871571554 conn(0x7f17300fd8c0 msgr2=0x7f17300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:27.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.703+0000 7f1735f5f640 1 -- 172.21.15.19:0/871571554 shutdown_connections 2024-09-19T09:05:27.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.703+0000 7f1735f5f640 1 -- 172.21.15.19:0/871571554 wait complete. 2024-09-19T09:05:27.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.703+0000 7f1735f5f640 1 Processor -- start 2024-09-19T09:05:27.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.703+0000 7f1735f5f640 1 -- start start 2024-09-19T09:05:27.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.704+0000 7f1735f5f640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1730101de0 0x7f1730198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:27.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.704+0000 7f1735f5f640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1730102790 0x7f1730198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:27.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.704+0000 7f1735f5f640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1730106f10 0x7f173019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:27.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.704+0000 7f1735f5f640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1730111f70 con 0x7f1730101de0 2024-09-19T09:05:27.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.704+0000 7f1735f5f640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1730111df0 con 0x7f1730102790 2024-09-19T09:05:27.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.704+0000 7f1735f5f640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f17301120f0 con 0x7f1730106f10 2024-09-19T09:05:27.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.704+0000 7f172f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1730101de0 0x7f1730198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:27.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.704+0000 7f172f7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1730101de0 0x7f1730198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47812/0 (socket says 172.21.15.19:47812) 2024-09-19T09:05:27.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.704+0000 7f172f7fe640 1 -- 172.21.15.19:0/162667388 learned_addr learned my addr 172.21.15.19:0/162667388 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:05:27.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.704+0000 7f172ffff640 1 --2- 172.21.15.19:0/162667388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1730106f10 0x7f173019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:27.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.704+0000 7f172effd640 1 --2- 172.21.15.19:0/162667388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1730102790 0x7f1730198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:27.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.704+0000 7f172f7fe640 1 -- 172.21.15.19:0/162667388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1730106f10 msgr2=0x7f173019cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:27.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.704+0000 7f172f7fe640 1 --2- 172.21.15.19:0/162667388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1730106f10 0x7f173019cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.704+0000 7f172f7fe640 1 -- 172.21.15.19:0/162667388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1730102790 msgr2=0x7f1730198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:27.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.704+0000 7f172f7fe640 1 --2- 172.21.15.19:0/162667388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1730102790 0x7f1730198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.704+0000 7f172f7fe640 1 -- 172.21.15.19:0/162667388 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f173019d4c0 con 0x7f1730101de0 2024-09-19T09:05:27.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.704+0000 7f172f7fe640 1 --2- 172.21.15.19:0/162667388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1730101de0 0x7f1730198510 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f172000d770 tx=0x7f172000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:27.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.704+0000 7f172cff9640 1 -- 172.21.15.19:0/162667388 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1720017070 con 0x7f1730101de0 2024-09-19T09:05:27.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.704+0000 7f1735f5f640 1 -- 172.21.15.19:0/162667388 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f173019d7b0 con 0x7f1730101de0 2024-09-19T09:05:27.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.704+0000 7f172cff9640 1 -- 172.21.15.19:0/162667388 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1720005500 con 0x7f1730101de0 2024-09-19T09:05:27.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.704+0000 7f172cff9640 1 -- 172.21.15.19:0/162667388 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1720004e00 con 0x7f1730101de0 2024-09-19T09:05:27.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.704+0000 7f1735f5f640 1 -- 172.21.15.19:0/162667388 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17301a5090 con 0x7f1730101de0 2024-09-19T09:05:27.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.705+0000 7f1735f5f640 1 -- 172.21.15.19:0/162667388 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17301021c0 con 0x7f1730101de0 2024-09-19T09:05:27.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.707+0000 7f172cff9640 1 -- 172.21.15.19:0/162667388 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f1720004fa0 con 0x7f1730101de0 2024-09-19T09:05:27.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.707+0000 7f172cff9640 1 --2- 172.21.15.19:0/162667388 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f17180a3240 0x7f17180a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:27.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.707+0000 7f172cff9640 1 -- 172.21.15.19:0/162667388 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7f17200cf7b0 con 0x7f1730101de0 2024-09-19T09:05:27.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.707+0000 7f172effd640 1 --2- 172.21.15.19:0/162667388 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f17180a3240 0x7f17180a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:27.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.708+0000 7f172effd640 1 --2- 172.21.15.19:0/162667388 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f17180a3240 0x7f17180a5700 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1730108900 tx=0x7f1724005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:27.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.711+0000 7f172cff9640 1 -- 172.21.15.19:0/162667388 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f172009c4e0 con 0x7f1730101de0 2024-09-19T09:05:27.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.890+0000 7f1735f5f640 1 -- 172.21.15.19:0/162667388 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f173010a150 con 0x7f1730101de0 2024-09-19T09:05:27.891 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:27 smithi019 ceph-mon[30976]: pgmap v740: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-19T09:05:27.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.892+0000 7f172cff9640 1 -- 172.21.15.19:0/162667388 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22651 (secure 0 0 0) 0x7f172009bde0 con 0x7f1730101de0 2024-09-19T09:05:27.892 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-19T09:05:27.893 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":88,"fsid":"f26c9d84-7662-11ef-bceb-c7b262605968","created":"2024-09-19T08:42:32.324073+0000","modified":"2024-09-19T09:04:06.944574+0000","last_up_change":"2024-09-19T08:49:24.764960+0000","last_in_change":"2024-09-19T08:49:01.062919+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T08:45:36.232910+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T08:50:12.615884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T08:50:14.854513+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81c7bb06-5b13-4ee0-9290-d779faac1b91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6803","nonce":3397146732}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6805","nonce":3397146732}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6809","nonce":3397146732}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6806","nonce":3397146732},{"type":"v1","addr":"172.21.15.19:6807","nonce":3397146732}]},"public_addr":"172.21.15.19:6803/3397146732","cluster_addr":"172.21.15.19:6805/3397146732","heartbeat_back_addr":"172.21.15.19:6809/3397146732","heartbeat_front_addr":"172.21.15.19:6807/3397146732","state":["exists","up"]},{"osd":1,"uuid":"24c145e6-5252-4708-8f25-5ce041e8251e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6800","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6801","nonce":2011043685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6802","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6803","nonce":2011043685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6806","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6807","nonce":2011043685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6804","nonce":2011043685},{"type":"v1","addr":"172.21.15.155:6805","nonce":2011043685}]},"public_addr":"172.21.15.155:6801/2011043685","cluster_addr":"172.21.15.155:6803/2011043685","heartbeat_back_addr":"172.21.15.155:6807/2011043685","heartbeat_front_addr":"172.21.15.155:6805/2011043685","state":["exists","up"]},{"osd":2,"uuid":"99cefd33-0675-495f-8871-2e6fdead0c3a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6801","nonce":3358994623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6803","nonce":3358994623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6807","nonce":3358994623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":3358994623},{"type":"v1","addr":"172.21.15.203:6805","nonce":3358994623}]},"public_addr":"172.21.15.203:6801/3358994623","cluster_addr":"172.21.15.203:6803/3358994623","heartbeat_back_addr":"172.21.15.203:6807/3358994623","heartbeat_front_addr":"172.21.15.203:6805/3358994623","state":["exists","up"]},{"osd":3,"uuid":"8f46c16c-f17e-484a-8b66-6dbf135f34c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6811","nonce":176445576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6813","nonce":176445576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6817","nonce":176445576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":176445576},{"type":"v1","addr":"172.21.15.19:6815","nonce":176445576}]},"public_addr":"172.21.15.19:6811/176445576","cluster_addr":"172.21.15.19:6813/176445576","heartbeat_back_addr":"172.21.15.19:6817/176445576","heartbeat_front_addr":"172.21.15.19:6815/176445576","state":["exists","up"]},{"osd":4,"uuid":"411b0423-1317-4e82-bc01-b5f55b391bc7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6808","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6809","nonce":2163087792}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6810","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6811","nonce":2163087792}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6814","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6815","nonce":2163087792}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6812","nonce":2163087792},{"type":"v1","addr":"172.21.15.155:6813","nonce":2163087792}]},"public_addr":"172.21.15.155:6809/2163087792","cluster_addr":"172.21.15.155:6811/2163087792","heartbeat_back_addr":"172.21.15.155:6815/2163087792","heartbeat_front_addr":"172.21.15.155:6813/2163087792","state":["exists","up"]},{"osd":5,"uuid":"057c073e-569f-4c6e-9602-e1169ad4dd8e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6809","nonce":334881465}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6811","nonce":334881465}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6815","nonce":334881465}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":334881465},{"type":"v1","addr":"172.21.15.203:6813","nonce":334881465}]},"public_addr":"172.21.15.203:6809/334881465","cluster_addr":"172.21.15.203:6811/334881465","heartbeat_back_addr":"172.21.15.203:6815/334881465","heartbeat_front_addr":"172.21.15.203:6813/334881465","state":["exists","up"]},{"osd":6,"uuid":"40418f13-823e-4f94-a427-84781abbcb5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6819","nonce":2669779791}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6821","nonce":2669779791}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6825","nonce":2669779791}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":2669779791},{"type":"v1","addr":"172.21.15.19:6823","nonce":2669779791}]},"public_addr":"172.21.15.19:6819/2669779791","cluster_addr":"172.21.15.19:6821/2669779791","heartbeat_back_addr":"172.21.15.19:6825/2669779791","heartbeat_front_addr":"172.21.15.19:6823/2669779791","state":["exists","up"]},{"osd":7,"uuid":"ad15f762-aeab-4167-a63d-6c9f9b89b9c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6816","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6817","nonce":3169455907}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6818","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6819","nonce":3169455907}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6822","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6823","nonce":3169455907}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6820","nonce":3169455907},{"type":"v1","addr":"172.21.15.155:6821","nonce":3169455907}]},"public_addr":"172.21.15.155:6817/3169455907","cluster_addr":"172.21.15.155:6819/3169455907","heartbeat_back_addr":"172.21.15.155:6823/3169455907","heartbeat_front_addr":"172.21.15.155:6821/3169455907","state":["exists","up"]},{"osd":8,"uuid":"23cf8ea2-29d6-43d8-a05b-7822f4bbf254","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6817","nonce":1062999528}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6819","nonce":1062999528}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6823","nonce":1062999528}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":1062999528},{"type":"v1","addr":"172.21.15.203:6821","nonce":1062999528}]},"public_addr":"172.21.15.203:6817/1062999528","cluster_addr":"172.21.15.203:6819/1062999528","heartbeat_back_addr":"172.21.15.203:6823/1062999528","heartbeat_front_addr":"172.21.15.203:6821/1062999528","state":["exists","up"]},{"osd":9,"uuid":"e851e605-2d17-4fbf-b783-2138133edd06","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6827","nonce":574664786}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6829","nonce":574664786}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6832","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6833","nonce":574664786}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":574664786},{"type":"v1","addr":"172.21.15.19:6831","nonce":574664786}]},"public_addr":"172.21.15.19:6827/574664786","cluster_addr":"172.21.15.19:6829/574664786","heartbeat_back_addr":"172.21.15.19:6833/574664786","heartbeat_front_addr":"172.21.15.19:6831/574664786","state":["exists","up"]},{"osd":10,"uuid":"cc770717-91bd-4494-9103-6db8214b5872","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6824","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6825","nonce":2242158832}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6826","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6827","nonce":2242158832}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6830","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6831","nonce":2242158832}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.155:6828","nonce":2242158832},{"type":"v1","addr":"172.21.15.155:6829","nonce":2242158832}]},"public_addr":"172.21.15.155:6825/2242158832","cluster_addr":"172.21.15.155:6827/2242158832","heartbeat_back_addr":"172.21.15.155:6831/2242158832","heartbeat_front_addr":"172.21.15.155:6829/2242158832","state":["exists","up"]},{"osd":11,"uuid":"6c237db9-5d79-47bc-8ff6-60d09d721d5d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":74,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6825","nonce":522943955}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6827","nonce":522943955}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6831","nonce":522943955}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":522943955},{"type":"v1","addr":"172.21.15.203:6829","nonce":522943955}]},"public_addr":"172.21.15.203:6825/522943955","cluster_addr":"172.21.15.203:6827/522943955","heartbeat_back_addr":"172.21.15.203:6831/522943955","heartbeat_front_addr":"172.21.15.203:6829/522943955","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:44:44.656414+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:09.339183+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:33.245452+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:45:59.449025+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:46:24.831213+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:46:49.189780+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:47:13.493628+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:47:39.478247+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:05.089875+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:30.722878+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:48:56.951834+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T08:49:22.894678+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.16","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1f","mappings":[{"from":7,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":8}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.19:6801/4266644067":"2024-09-20T08:43:21.732222+0000","172.21.15.19:0/1398782170":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6800/4266644067":"2024-09-20T08:43:21.732222+0000","172.21.15.19:0/34162461":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6801/1764769529":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/2910961714":"2024-09-20T08:43:21.732222+0000","172.21.15.19:6800/1764769529":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/820792769":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/560203138":"2024-09-20T08:42:56.618773+0000","172.21.15.19:0/809642328":"2024-09-20T08:42:56.618773+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T09:05:27.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.894+0000 7f1735f5f640 1 -- 172.21.15.19:0/162667388 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f17180a3240 msgr2=0x7f17180a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:27.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.894+0000 7f1735f5f640 1 --2- 172.21.15.19:0/162667388 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f17180a3240 0x7f17180a5700 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1730108900 tx=0x7f1724005a20 comp rx=0 tx=0).stop 2024-09-19T09:05:27.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.894+0000 7f1735f5f640 1 -- 172.21.15.19:0/162667388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1730101de0 msgr2=0x7f1730198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:27.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.894+0000 7f1735f5f640 1 --2- 172.21.15.19:0/162667388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1730101de0 0x7f1730198510 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f172000d770 tx=0x7f172000dc30 comp rx=0 tx=0).stop 2024-09-19T09:05:27.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.894+0000 7f1735f5f640 1 -- 172.21.15.19:0/162667388 shutdown_connections 2024-09-19T09:05:27.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.894+0000 7f1735f5f640 1 --2- 172.21.15.19:0/162667388 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f17180a3240 0x7f17180a5700 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.894+0000 7f1735f5f640 1 --2- 172.21.15.19:0/162667388 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1730106f10 0x7f173019cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.894+0000 7f1735f5f640 1 --2- 172.21.15.19:0/162667388 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1730102790 0x7f1730198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.894+0000 7f1735f5f640 1 --2- 172.21.15.19:0/162667388 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1730101de0 0x7f1730198510 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:27.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.894+0000 7f1735f5f640 1 -- 172.21.15.19:0/162667388 >> 172.21.15.19:0/162667388 conn(0x7f17300fd8c0 msgr2=0x7f17300fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:27.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.895+0000 7f1735f5f640 1 -- 172.21.15.19:0/162667388 shutdown_connections 2024-09-19T09:05:27.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:27.895+0000 7f1735f5f640 1 -- 172.21.15.19:0/162667388 wait complete. 2024-09-19T09:05:28.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:27 smithi155 ceph-mon[34921]: pgmap v740: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-19T09:05:28.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:27 smithi203 ceph-mon[35450]: pgmap v740: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 767 B/s wr, 11 op/s 2024-09-19T09:05:28.549 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs fail cephfs 2024-09-19T09:05:28.814 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:29.038 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:28 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/162667388' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:05:29.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:28 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/162667388' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:05:29.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:28 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/162667388' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T09:05:29.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.265+0000 7fb3a50b5640 1 -- 172.21.15.19:0/1464699521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3a0102ef0 msgr2=0x7fb3a010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:29.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.265+0000 7fb3a50b5640 1 --2- 172.21.15.19:0/1464699521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3a0102ef0 0x7fb3a010da40 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fb398009ca0 tx=0x7fb39802a950 comp rx=0 tx=0).stop 2024-09-19T09:05:29.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.265+0000 7fb3a50b5640 1 -- 172.21.15.19:0/1464699521 shutdown_connections 2024-09-19T09:05:29.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.265+0000 7fb3a50b5640 1 --2- 172.21.15.19:0/1464699521 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb3a0102570 0x7fb3a01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:29.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.265+0000 7fb3a50b5640 1 --2- 172.21.15.19:0/1464699521 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3a0102ef0 0x7fb3a010da40 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:29.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.265+0000 7fb3a50b5640 1 --2- 172.21.15.19:0/1464699521 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3a0100e20 0x7fb3a0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:29.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.266+0000 7fb3a50b5640 1 -- 172.21.15.19:0/1464699521 >> 172.21.15.19:0/1464699521 conn(0x7fb3a00fc7d0 msgr2=0x7fb3a00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:29.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.266+0000 7fb3a50b5640 1 -- 172.21.15.19:0/1464699521 shutdown_connections 2024-09-19T09:05:29.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.266+0000 7fb3a50b5640 1 -- 172.21.15.19:0/1464699521 wait complete. 2024-09-19T09:05:29.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.266+0000 7fb3a50b5640 1 Processor -- start 2024-09-19T09:05:29.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.267+0000 7fb3a50b5640 1 -- start start 2024-09-19T09:05:29.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.267+0000 7fb3a50b5640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb3a0100e20 0x7fb3a01983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:29.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.267+0000 7fb3a50b5640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3a0102570 0x7fb3a0198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:29.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.267+0000 7fb3a50b5640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3a0102ef0 0x7fb3a019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:29.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.267+0000 7fb3a50b5640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a0110f80 con 0x7fb3a0102ef0 2024-09-19T09:05:29.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.267+0000 7fb3a50b5640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a0110e00 con 0x7fb3a0102570 2024-09-19T09:05:29.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.267+0000 7fb3a50b5640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a0111100 con 0x7fb3a0100e20 2024-09-19T09:05:29.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.267+0000 7fb39f59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3a0102ef0 0x7fb3a019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:29.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.267+0000 7fb39f59e640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3a0102ef0 0x7fb3a019ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47842/0 (socket says 172.21.15.19:47842) 2024-09-19T09:05:29.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.267+0000 7fb39f59e640 1 -- 172.21.15.19:0/1944849952 learned_addr learned my addr 172.21.15.19:0/1944849952 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:05:29.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.267+0000 7fb39ed9d640 1 --2- 172.21.15.19:0/1944849952 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb3a0100e20 0x7fb3a01983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:29.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.267+0000 7fb39e59c640 1 --2- 172.21.15.19:0/1944849952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3a0102570 0x7fb3a0198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:29.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.267+0000 7fb39f59e640 1 -- 172.21.15.19:0/1944849952 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb3a0100e20 msgr2=0x7fb3a01983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:29.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.267+0000 7fb39f59e640 1 --2- 172.21.15.19:0/1944849952 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb3a0100e20 0x7fb3a01983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:29.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.267+0000 7fb39f59e640 1 -- 172.21.15.19:0/1944849952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3a0102570 msgr2=0x7fb3a0198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:29.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.267+0000 7fb39f59e640 1 --2- 172.21.15.19:0/1944849952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3a0102570 0x7fb3a0198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:29.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.267+0000 7fb39f59e640 1 -- 172.21.15.19:0/1944849952 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a019d3a0 con 0x7fb3a0102ef0 2024-09-19T09:05:29.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.268+0000 7fb39f59e640 1 --2- 172.21.15.19:0/1944849952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3a0102ef0 0x7fb3a019ccc0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fb398006010 tx=0x7fb39802f6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:29.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.268+0000 7fb387fff640 1 -- 172.21.15.19:0/1944849952 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb398034040 con 0x7fb3a0102ef0 2024-09-19T09:05:29.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.268+0000 7fb3a50b5640 1 -- 172.21.15.19:0/1944849952 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3a019d630 con 0x7fb3a0102ef0 2024-09-19T09:05:29.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.268+0000 7fb387fff640 1 -- 172.21.15.19:0/1944849952 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fb398003e00 con 0x7fb3a0102ef0 2024-09-19T09:05:29.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.268+0000 7fb387fff640 1 -- 172.21.15.19:0/1944849952 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb398045480 con 0x7fb3a0102ef0 2024-09-19T09:05:29.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.268+0000 7fb3a50b5640 1 -- 172.21.15.19:0/1944849952 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3a01a4f70 con 0x7fb3a0102ef0 2024-09-19T09:05:29.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.269+0000 7fb3a50b5640 1 -- 172.21.15.19:0/1944849952 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3a0101200 con 0x7fb3a0102ef0 2024-09-19T09:05:29.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.271+0000 7fb387fff640 1 -- 172.21.15.19:0/1944849952 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fb398037020 con 0x7fb3a0102ef0 2024-09-19T09:05:29.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.271+0000 7fb387fff640 1 --2- 172.21.15.19:0/1944849952 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb3880a3240 0x7fb3880a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:29.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.271+0000 7fb39ed9d640 1 --2- 172.21.15.19:0/1944849952 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb3880a3240 0x7fb3880a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:29.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.271+0000 7fb387fff640 1 -- 172.21.15.19:0/1944849952 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8211+0+0 (secure 0 0 0) 0x7fb3980f09b0 con 0x7fb3a0102ef0 2024-09-19T09:05:29.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.272+0000 7fb39ed9d640 1 --2- 172.21.15.19:0/1944849952 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb3880a3240 0x7fb3880a5700 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb39000abe0 tx=0x7fb39000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:29.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.274+0000 7fb387fff640 1 -- 172.21.15.19:0/1944849952 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb3980bd6e0 con 0x7fb3a0102ef0 2024-09-19T09:05:29.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.491+0000 7fb3a50b5640 1 -- 172.21.15.19:0/1944849952 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb3a010a0a0 con 0x7fb3a0102ef0 2024-09-19T09:05:29.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.493+0000 7fb387fff640 1 -- 172.21.15.19:0/1944849952 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v44) ==== 161+0+0 (secure 0 0 0) 0x7fb3980bcfe0 con 0x7fb3a0102ef0 2024-09-19T09:05:29.493 INFO:teuthology.orchestra.run.smithi019.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T09:05:29.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.498+0000 7fb3a50b5640 1 -- 172.21.15.19:0/1944849952 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb3880a3240 msgr2=0x7fb3880a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:29.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.498+0000 7fb3a50b5640 1 --2- 172.21.15.19:0/1944849952 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb3880a3240 0x7fb3880a5700 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb39000abe0 tx=0x7fb39000a2d0 comp rx=0 tx=0).stop 2024-09-19T09:05:29.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.498+0000 7fb3a50b5640 1 -- 172.21.15.19:0/1944849952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3a0102ef0 msgr2=0x7fb3a019ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:29.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.498+0000 7fb3a50b5640 1 --2- 172.21.15.19:0/1944849952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3a0102ef0 0x7fb3a019ccc0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fb398006010 tx=0x7fb39802f6f0 comp rx=0 tx=0).stop 2024-09-19T09:05:29.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.506+0000 7fb3a50b5640 1 -- 172.21.15.19:0/1944849952 shutdown_connections 2024-09-19T09:05:29.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.506+0000 7fb3a50b5640 1 --2- 172.21.15.19:0/1944849952 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fb3880a3240 0x7fb3880a5700 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:29.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.506+0000 7fb3a50b5640 1 --2- 172.21.15.19:0/1944849952 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fb3a0102ef0 0x7fb3a019ccc0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:29.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.506+0000 7fb3a50b5640 1 --2- 172.21.15.19:0/1944849952 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fb3a0102570 0x7fb3a0198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:29.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.506+0000 7fb3a50b5640 1 --2- 172.21.15.19:0/1944849952 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb3a0100e20 0x7fb3a01983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:29.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.506+0000 7fb3a50b5640 1 -- 172.21.15.19:0/1944849952 >> 172.21.15.19:0/1944849952 conn(0x7fb3a00fc7d0 msgr2=0x7fb3a006a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:29.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.510+0000 7fb3a50b5640 1 -- 172.21.15.19:0/1944849952 shutdown_connections 2024-09-19T09:05:29.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:29.510+0000 7fb3a50b5640 1 -- 172.21.15.19:0/1944849952 wait complete. 2024-09-19T09:05:29.572 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:29 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mon-a[30972]: 2024-09-19T09:05:29.492+0000 7fd2f78c2640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:05:29.573 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 19 09:05:29 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-a[72333]: ignoring --setuser ceph since I am not root 2024-09-19T09:05:29.573 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 19 09:05:29 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-a[72333]: ignoring --setgroup ceph since I am not root 2024-09-19T09:05:29.777 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 19 09:05:29 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-h[65524]: ignoring --setuser ceph since I am not root 2024-09-19T09:05:29.778 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 19 09:05:29 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-h[65524]: ignoring --setgroup ceph since I am not root 2024-09-19T09:05:29.778 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 19 09:05:29 smithi155 ceph-mds[65528]: -- 172.21.15.155:0/2622303700 <== mon.2 v2:172.21.15.155:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55eefc2b5860 con 0x55eefc292800 2024-09-19T09:05:29.778 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 19 09:05:29 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-h[65524]: starting mds.h at 2024-09-19T09:05:29.778 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 19 09:05:29 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-k[64908]: ignoring --setuser ceph since I am not root 2024-09-19T09:05:29.779 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 19 09:05:29 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-k[64908]: ignoring --setgroup ceph since I am not root 2024-09-19T09:05:29.779 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 19 09:05:29 smithi155 ceph-mds[64912]: -- 172.21.15.155:0/461560629 <== mon.2 v2:172.21.15.155:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56324fe2b860 con 0x56324fe09400 2024-09-19T09:05:29.779 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 19 09:05:29 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-k[64908]: starting mds.k at 2024-09-19T09:05:29.779 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 09:05:29 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-e[68808]: ignoring --setuser ceph since I am not root 2024-09-19T09:05:29.779 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 09:05:29 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-e[68808]: ignoring --setgroup ceph since I am not root 2024-09-19T09:05:29.780 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 09:05:29 smithi155 ceph-mds[68812]: -- 172.21.15.155:0/1165515347 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556c009db860 con 0x556c009b9000 2024-09-19T09:05:29.780 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 09:05:29 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-e[68808]: starting mds.e at 2024-09-19T09:05:29.780 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 09:05:29 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-b[65837]: -7511> 2024-09-19T09:04:08.185+0000 7faf399c8640 -1 log_channel(cluster) log [ERR] : failed to store backtrace on ino 0x1000000c565 object, pool 2, errno -2 2024-09-19T09:05:29.780 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 09:05:29 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-b[65837]: -7510> 2024-09-19T09:04:08.185+0000 7faf399c8640 -1 mds.0.14 unhandled write error (2) No such file or directory, force readonly... 2024-09-19T09:05:29.780 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 09:05:29 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-b[65837]: -7275> 2024-09-19T09:04:08.186+0000 7faf399c8640 -1 log_channel(cluster) log [ERR] : failed to store backtrace on ino 0x1000000c56f object, pool 2, errno -2 2024-09-19T09:05:29.781 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 09:05:29 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-b[65837]: -7274> 2024-09-19T09:04:08.186+0000 7faf399c8640 -1 mds.0.14 unhandled write error (2) No such file or directory, force readonly... 2024-09-19T09:05:29.781 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 09:05:29 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-b[65837]: -7267> 2024-09-19T09:04:08.186+0000 7faf399c8640 -1 log_channel(cluster) log [ERR] : failed to store backtrace on ino 0x1000000c574 object, pool 2, errno -2 2024-09-19T09:05:29.781 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 09:05:29 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-b[65837]: -7266> 2024-09-19T09:04:08.186+0000 7faf399c8640 -1 mds.0.14 unhandled write error (2) No such file or directory, force readonly... 2024-09-19T09:05:29.781 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 09:05:29 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-b[65837]: -7073> 2024-09-19T09:04:08.187+0000 7faf399c8640 -1 mds.0.14 unhandled write error (2) No such file or directory, force readonly... 2024-09-19T09:05:29.781 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 09:05:29 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-b[65837]: ignoring --setuser ceph since I am not root 2024-09-19T09:05:29.781 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 09:05:29 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-b[65837]: ignoring --setgroup ceph since I am not root 2024-09-19T09:05:29.781 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 09:05:29 smithi155 ceph-mds[65841]: -- 172.21.15.155:0/2939578542 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f9d4353860 con 0x55f9d4331400 2024-09-19T09:05:29.781 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 09:05:29 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-b[65837]: starting mds.b at 2024-09-19T09:05:29.982 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 09:05:29 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-i[66059]: ignoring --setuser ceph since I am not root 2024-09-19T09:05:29.982 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 09:05:29 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-i[66059]: ignoring --setgroup ceph since I am not root 2024-09-19T09:05:29.982 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 09:05:29 smithi203 ceph-mds[66063]: -- 172.21.15.203:0/2561835175 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e8d35d7860 con 0x55e8d35b5400 2024-09-19T09:05:29.982 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 09:05:29 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-i[66059]: starting mds.i at 2024-09-19T09:05:29.983 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 09:05:29 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-c[65758]: ignoring --setuser ceph since I am not root 2024-09-19T09:05:29.983 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 09:05:29 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-c[65758]: ignoring --setgroup ceph since I am not root 2024-09-19T09:05:29.983 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 09:05:29 smithi203 ceph-mds[65762]: -- 172.21.15.203:0/2116872865 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ea960d9860 con 0x55ea960b7000 2024-09-19T09:05:29.983 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 09:05:29 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-c[65758]: starting mds.c at 2024-09-19T09:05:29.984 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 09:05:29 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-f[65455]: ignoring --setuser ceph since I am not root 2024-09-19T09:05:29.984 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 09:05:29 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-f[65455]: ignoring --setgroup ceph since I am not root 2024-09-19T09:05:29.984 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 09:05:29 smithi203 ceph-mds[65459]: -- 172.21.15.203:0/1853847922 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5590123bd860 con 0x55901239b400 2024-09-19T09:05:29.984 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 09:05:29 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-f[65455]: starting mds.f at 2024-09-19T09:05:29.984 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:29 smithi203 ceph-mon[35450]: pgmap v741: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-19T09:05:29.984 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:29 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1944849952' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T09:05:29.985 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:29 smithi203 ceph-mon[35450]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T09:05:29.985 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:29 smithi203 ceph-mon[35450]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:05:29.985 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:29 smithi203 ceph-mon[35450]: Health check cleared: MDS_READ_ONLY (was: 1 MDSs are read only) 2024-09-19T09:05:29.985 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:29 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1944849952' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T09:05:29.985 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:29 smithi203 ceph-mon[35450]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T09:05:29.985 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:29 smithi203 ceph-mon[35450]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-19T09:05:29.985 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 09:05:29 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-l[65150]: ignoring --setuser ceph since I am not root 2024-09-19T09:05:29.986 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 09:05:29 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-l[65150]: ignoring --setgroup ceph since I am not root 2024-09-19T09:05:29.986 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 09:05:29 smithi203 ceph-mds[65154]: -- 172.21.15.203:0/4199491387 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55aa715bfc20 con 0x55aa7159d000 2024-09-19T09:05:29.986 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 09:05:29 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-l[65150]: starting mds.l at 2024-09-19T09:05:29.986 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 19 09:05:29 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-j[70727]: ignoring --setuser ceph since I am not root 2024-09-19T09:05:29.987 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 19 09:05:29 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-j[70727]: ignoring --setgroup ceph since I am not root 2024-09-19T09:05:29.987 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 19 09:05:29 smithi019 ceph-mds[70749]: -- 172.21.15.19:0/3945964833 <== mon.0 v2:172.21.15.19:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559806f41c20 con 0x559806f1f400 2024-09-19T09:05:29.987 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 19 09:05:29 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-j[70727]: starting mds.j at 2024-09-19T09:05:29.987 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:29 smithi019 ceph-mon[30976]: pgmap v741: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-19T09:05:29.987 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:29 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1944849952' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T09:05:29.987 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:29 smithi019 ceph-mon[30976]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T09:05:29.988 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:29 smithi019 ceph-mon[30976]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:05:29.988 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:29 smithi019 ceph-mon[30976]: Health check cleared: MDS_READ_ONLY (was: 1 MDSs are read only) 2024-09-19T09:05:29.988 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:29 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1944849952' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T09:05:29.988 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:29 smithi019 ceph-mon[30976]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T09:05:29.988 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:29 smithi019 ceph-mon[30976]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-19T09:05:29.988 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 19 09:05:29 smithi019 ceph-mds[72337]: -- 172.21.15.19:0/2829128512 <== mon.0 v2:172.21.15.19:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56069f69d860 con 0x56069f67b000 2024-09-19T09:05:29.989 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 19 09:05:29 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-a[72333]: starting mds.a at 2024-09-19T09:05:30.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:29 smithi155 ceph-mon[34921]: pgmap v741: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 938 B/s wr, 10 op/s 2024-09-19T09:05:30.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:29 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1944849952' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T09:05:30.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:29 smithi155 ceph-mon[34921]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T09:05:30.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:29 smithi155 ceph-mon[34921]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T09:05:30.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:29 smithi155 ceph-mon[34921]: Health check cleared: MDS_READ_ONLY (was: 1 MDSs are read only) 2024-09-19T09:05:30.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:29 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1944849952' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T09:05:30.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:29 smithi155 ceph-mon[34921]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T09:05:30.174 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:29 smithi155 ceph-mon[34921]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-19T09:05:30.432 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T09:05:30.694 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:31.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.179+0000 7f9f428e0640 1 -- 172.21.15.19:0/1178681983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f3c102570 msgr2=0x7f9f3c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:31.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.179+0000 7f9f428e0640 1 --2- 172.21.15.19:0/1178681983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f3c102570 0x7f9f3c1029b0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f9f30009900 tx=0x7f9f3002a480 comp rx=0 tx=0).stop 2024-09-19T09:05:31.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.179+0000 7f9f428e0640 1 -- 172.21.15.19:0/1178681983 shutdown_connections 2024-09-19T09:05:31.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.179+0000 7f9f428e0640 1 --2- 172.21.15.19:0/1178681983 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f3c102ef0 0x7f9f3c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:31.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.179+0000 7f9f428e0640 1 --2- 172.21.15.19:0/1178681983 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f3c102570 0x7f9f3c1029b0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:31.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.179+0000 7f9f428e0640 1 --2- 172.21.15.19:0/1178681983 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f3c100e20 0x7f9f3c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:31.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.179+0000 7f9f428e0640 1 -- 172.21.15.19:0/1178681983 >> 172.21.15.19:0/1178681983 conn(0x7f9f3c0fc7d0 msgr2=0x7f9f3c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:31.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.179+0000 7f9f428e0640 1 -- 172.21.15.19:0/1178681983 shutdown_connections 2024-09-19T09:05:31.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.179+0000 7f9f428e0640 1 -- 172.21.15.19:0/1178681983 wait complete. 2024-09-19T09:05:31.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.179+0000 7f9f428e0640 1 Processor -- start 2024-09-19T09:05:31.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.180+0000 7f9f428e0640 1 -- start start 2024-09-19T09:05:31.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.180+0000 7f9f428e0640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f3c100e20 0x7f9f3c1984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:31.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.180+0000 7f9f428e0640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f3c102570 0x7f9f3c198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:31.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.180+0000 7f9f428e0640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f3c102ef0 0x7f9f3c19cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:31.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.180+0000 7f9f428e0640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f9f3c110f80 con 0x7f9f3c102570 2024-09-19T09:05:31.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.180+0000 7f9f428e0640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f9f3c110e00 con 0x7f9f3c102ef0 2024-09-19T09:05:31.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.180+0000 7f9f428e0640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9f3c111100 con 0x7f9f3c100e20 2024-09-19T09:05:31.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.180+0000 7f9f3b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f3c102570 0x7f9f3c198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:31.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.180+0000 7f9f3b7fe640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f3c102570 0x7f9f3c198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47918/0 (socket says 172.21.15.19:47918) 2024-09-19T09:05:31.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.180+0000 7f9f3b7fe640 1 -- 172.21.15.19:0/3666455730 learned_addr learned my addr 172.21.15.19:0/3666455730 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:05:31.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.180+0000 7f9f3bfff640 1 --2- 172.21.15.19:0/3666455730 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f3c100e20 0x7f9f3c1984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:31.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.180+0000 7f9f40e7d640 1 --2- 172.21.15.19:0/3666455730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f3c102ef0 0x7f9f3c19cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:31.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.180+0000 7f9f3b7fe640 1 -- 172.21.15.19:0/3666455730 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f3c100e20 msgr2=0x7f9f3c1984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:31.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.180+0000 7f9f3b7fe640 1 --2- 172.21.15.19:0/3666455730 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f3c100e20 0x7f9f3c1984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:31.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.180+0000 7f9f3b7fe640 1 -- 172.21.15.19:0/3666455730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f3c102ef0 msgr2=0x7f9f3c19cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:31.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.180+0000 7f9f3b7fe640 1 --2- 172.21.15.19:0/3666455730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f3c102ef0 0x7f9f3c19cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:31.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.180+0000 7f9f3b7fe640 1 -- 172.21.15.19:0/3666455730 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f3c19d480 con 0x7f9f3c102570 2024-09-19T09:05:31.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.181+0000 7f9f3b7fe640 1 --2- 172.21.15.19:0/3666455730 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f3c102570 0x7f9f3c198a10 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f9f30006010 tx=0x7f9f30003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:31.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.181+0000 7f9f397fa640 1 -- 172.21.15.19:0/3666455730 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f3003f070 con 0x7f9f3c102570 2024-09-19T09:05:31.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.181+0000 7f9f397fa640 1 -- 172.21.15.19:0/3666455730 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f9f30031c30 con 0x7f9f3c102570 2024-09-19T09:05:31.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.181+0000 7f9f428e0640 1 -- 172.21.15.19:0/3666455730 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f3c19d710 con 0x7f9f3c102570 2024-09-19T09:05:31.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.181+0000 7f9f397fa640 1 -- 172.21.15.19:0/3666455730 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f30035030 con 0x7f9f3c102570 2024-09-19T09:05:31.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.181+0000 7f9f428e0640 1 -- 172.21.15.19:0/3666455730 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f3c1a5050 con 0x7f9f3c102570 2024-09-19T09:05:31.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.182+0000 7f9f428e0640 1 -- 172.21.15.19:0/3666455730 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f3c101200 con 0x7f9f3c102570 2024-09-19T09:05:31.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.183+0000 7f9f397fa640 1 -- 172.21.15.19:0/3666455730 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f9f30042070 con 0x7f9f3c102570 2024-09-19T09:05:31.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.184+0000 7f9f397fa640 1 --2- 172.21.15.19:0/3666455730 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9f240a3240 0x7f9f240a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:31.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.184+0000 7f9f3bfff640 1 --2- 172.21.15.19:0/3666455730 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9f240a3240 0x7f9f240a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:31.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.184+0000 7f9f397fa640 1 -- 172.21.15.19:0/3666455730 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8641+0+0 (secure 0 0 0) 0x7f9f300f0720 con 0x7f9f3c102570 2024-09-19T09:05:31.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.185+0000 7f9f3bfff640 1 --2- 172.21.15.19:0/3666455730 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9f240a3240 0x7f9f240a5700 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c005fd0 tx=0x7f9f2c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:31.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.188+0000 7f9f397fa640 1 -- 172.21.15.19:0/3666455730 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9f30031de0 con 0x7f9f3c102570 2024-09-19T09:05:31.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.400+0000 7f9f428e0640 1 -- 172.21.15.19:0/3666455730 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f9f3c10a0a0 con 0x7f9f3c102570 2024-09-19T09:05:31.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.780+0000 7f9f397fa640 1 -- 172.21.15.19:0/3666455730 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v46) ==== 104+0+0 (secure 0 0 0) 0x7f9f300bccb0 con 0x7f9f3c102570 2024-09-19T09:05:31.781 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:31 smithi019 ceph-mon[30976]: pgmap v743: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-19T09:05:31.781 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:31 smithi019 ceph-mon[30976]: mds.? [v2:172.21.15.203:6832/4015302426,v1:172.21.15.203:6833/4015302426] up:boot 2024-09-19T09:05:31.781 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:31 smithi019 ceph-mon[30976]: mds.? [v2:172.21.15.203:6834/515749815,v1:172.21.15.203:6835/515749815] up:boot 2024-09-19T09:05:31.781 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:31 smithi019 ceph-mon[30976]: mds.? [v2:172.21.15.203:6836/3635770206,v1:172.21.15.203:6837/3635770206] up:boot 2024-09-19T09:05:31.781 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:31 smithi019 ceph-mon[30976]: mds.? [v2:172.21.15.203:6838/2658519949,v1:172.21.15.203:6839/2658519949] up:boot 2024-09-19T09:05:31.782 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:31 smithi019 ceph-mon[30976]: mds.? [v2:172.21.15.155:6832/2268341367,v1:172.21.15.155:6833/2268341367] up:boot 2024-09-19T09:05:31.782 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:31 smithi019 ceph-mon[30976]: mds.? [v2:172.21.15.155:6834/1895972056,v1:172.21.15.155:6837/1895972056] up:boot 2024-09-19T09:05:31.782 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:31 smithi019 ceph-mon[30976]: mds.? [v2:172.21.15.155:6835/3301940010,v1:172.21.15.155:6838/3301940010] up:boot 2024-09-19T09:05:31.782 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:31 smithi019 ceph-mon[30976]: mds.? [v2:172.21.15.155:6836/138435148,v1:172.21.15.155:6839/138435148] up:boot 2024-09-19T09:05:31.782 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:31 smithi019 ceph-mon[30976]: mds.? [v2:172.21.15.19:6834/1449885717,v1:172.21.15.19:6840/1449885717] up:boot 2024-09-19T09:05:31.782 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:31 smithi019 ceph-mon[30976]: mds.? [v2:172.21.15.19:6835/3905185363,v1:172.21.15.19:6841/3905185363] up:boot 2024-09-19T09:05:31.782 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:31 smithi019 ceph-mon[30976]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-19T09:05:31.782 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:31 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:05:31.783 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:31 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T09:05:31.783 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:31 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:05:31.783 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:31 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:05:31.783 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:31 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T09:05:31.783 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:31 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:05:31.783 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:31 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:05:31.783 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:31 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:05:31.783 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:31 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T09:05:31.783 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:31 smithi019 ceph-mon[30976]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T09:05:31.784 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:31 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3666455730' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:05:31.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.782+0000 7f9f428e0640 1 -- 172.21.15.19:0/3666455730 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9f240a3240 msgr2=0x7f9f240a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:31.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.783+0000 7f9f428e0640 1 --2- 172.21.15.19:0/3666455730 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9f240a3240 0x7f9f240a5700 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f9f2c005fd0 tx=0x7f9f2c00b390 comp rx=0 tx=0).stop 2024-09-19T09:05:31.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.783+0000 7f9f428e0640 1 -- 172.21.15.19:0/3666455730 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f3c102570 msgr2=0x7f9f3c198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:31.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.783+0000 7f9f428e0640 1 --2- 172.21.15.19:0/3666455730 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f3c102570 0x7f9f3c198a10 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f9f30006010 tx=0x7f9f30003c10 comp rx=0 tx=0).stop 2024-09-19T09:05:31.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.783+0000 7f9f428e0640 1 -- 172.21.15.19:0/3666455730 shutdown_connections 2024-09-19T09:05:31.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.783+0000 7f9f428e0640 1 --2- 172.21.15.19:0/3666455730 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f9f240a3240 0x7f9f240a5700 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:31.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.783+0000 7f9f428e0640 1 --2- 172.21.15.19:0/3666455730 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f9f3c102ef0 0x7f9f3c19cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:31.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.783+0000 7f9f428e0640 1 --2- 172.21.15.19:0/3666455730 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f9f3c102570 0x7f9f3c198a10 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:31.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.783+0000 7f9f428e0640 1 --2- 172.21.15.19:0/3666455730 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9f3c100e20 0x7f9f3c1984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:31.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.783+0000 7f9f428e0640 1 -- 172.21.15.19:0/3666455730 >> 172.21.15.19:0/3666455730 conn(0x7f9f3c0fc7d0 msgr2=0x7f9f3c06a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:31.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.783+0000 7f9f428e0640 1 -- 172.21.15.19:0/3666455730 shutdown_connections 2024-09-19T09:05:31.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:31.783+0000 7f9f428e0640 1 -- 172.21.15.19:0/3666455730 wait complete. 2024-09-19T09:05:31.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:31 smithi155 ceph-mon[34921]: pgmap v743: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-19T09:05:31.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:31 smithi155 ceph-mon[34921]: mds.? [v2:172.21.15.203:6832/4015302426,v1:172.21.15.203:6833/4015302426] up:boot 2024-09-19T09:05:31.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:31 smithi155 ceph-mon[34921]: mds.? [v2:172.21.15.203:6834/515749815,v1:172.21.15.203:6835/515749815] up:boot 2024-09-19T09:05:31.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:31 smithi155 ceph-mon[34921]: mds.? [v2:172.21.15.203:6836/3635770206,v1:172.21.15.203:6837/3635770206] up:boot 2024-09-19T09:05:31.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:31 smithi155 ceph-mon[34921]: mds.? [v2:172.21.15.203:6838/2658519949,v1:172.21.15.203:6839/2658519949] up:boot 2024-09-19T09:05:31.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:31 smithi155 ceph-mon[34921]: mds.? [v2:172.21.15.155:6832/2268341367,v1:172.21.15.155:6833/2268341367] up:boot 2024-09-19T09:05:31.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:31 smithi155 ceph-mon[34921]: mds.? [v2:172.21.15.155:6834/1895972056,v1:172.21.15.155:6837/1895972056] up:boot 2024-09-19T09:05:31.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:31 smithi155 ceph-mon[34921]: mds.? [v2:172.21.15.155:6835/3301940010,v1:172.21.15.155:6838/3301940010] up:boot 2024-09-19T09:05:31.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:31 smithi155 ceph-mon[34921]: mds.? [v2:172.21.15.155:6836/138435148,v1:172.21.15.155:6839/138435148] up:boot 2024-09-19T09:05:31.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:31 smithi155 ceph-mon[34921]: mds.? [v2:172.21.15.19:6834/1449885717,v1:172.21.15.19:6840/1449885717] up:boot 2024-09-19T09:05:31.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:31 smithi155 ceph-mon[34921]: mds.? [v2:172.21.15.19:6835/3905185363,v1:172.21.15.19:6841/3905185363] up:boot 2024-09-19T09:05:31.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:31 smithi155 ceph-mon[34921]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-19T09:05:31.925 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:31 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:05:31.926 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:31 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T09:05:31.926 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:31 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:05:31.926 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:31 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:05:31.926 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:31 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T09:05:31.926 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:31 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:05:31.926 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:31 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:05:31.926 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:31 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:05:31.926 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:31 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T09:05:31.926 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:31 smithi155 ceph-mon[34921]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T09:05:31.927 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:31 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3666455730' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:05:31.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:31 smithi203 ceph-mon[35450]: pgmap v743: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-19T09:05:31.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:31 smithi203 ceph-mon[35450]: mds.? [v2:172.21.15.203:6832/4015302426,v1:172.21.15.203:6833/4015302426] up:boot 2024-09-19T09:05:31.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:31 smithi203 ceph-mon[35450]: mds.? [v2:172.21.15.203:6834/515749815,v1:172.21.15.203:6835/515749815] up:boot 2024-09-19T09:05:31.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:31 smithi203 ceph-mon[35450]: mds.? [v2:172.21.15.203:6836/3635770206,v1:172.21.15.203:6837/3635770206] up:boot 2024-09-19T09:05:31.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:31 smithi203 ceph-mon[35450]: mds.? [v2:172.21.15.203:6838/2658519949,v1:172.21.15.203:6839/2658519949] up:boot 2024-09-19T09:05:31.984 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:31 smithi203 ceph-mon[35450]: mds.? [v2:172.21.15.155:6832/2268341367,v1:172.21.15.155:6833/2268341367] up:boot 2024-09-19T09:05:31.984 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:31 smithi203 ceph-mon[35450]: mds.? [v2:172.21.15.155:6834/1895972056,v1:172.21.15.155:6837/1895972056] up:boot 2024-09-19T09:05:31.984 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:31 smithi203 ceph-mon[35450]: mds.? [v2:172.21.15.155:6835/3301940010,v1:172.21.15.155:6838/3301940010] up:boot 2024-09-19T09:05:31.984 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:31 smithi203 ceph-mon[35450]: mds.? [v2:172.21.15.155:6836/138435148,v1:172.21.15.155:6839/138435148] up:boot 2024-09-19T09:05:31.984 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:31 smithi203 ceph-mon[35450]: mds.? [v2:172.21.15.19:6834/1449885717,v1:172.21.15.19:6840/1449885717] up:boot 2024-09-19T09:05:31.984 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:31 smithi203 ceph-mon[35450]: mds.? [v2:172.21.15.19:6835/3905185363,v1:172.21.15.19:6841/3905185363] up:boot 2024-09-19T09:05:31.985 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:31 smithi203 ceph-mon[35450]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-19T09:05:31.985 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:31 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T09:05:31.985 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:31 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T09:05:31.985 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:31 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T09:05:31.985 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:31 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T09:05:31.985 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:31 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T09:05:31.985 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:31 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T09:05:31.985 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:31 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T09:05:31.985 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:31 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T09:05:31.986 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:31 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T09:05:31.986 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:31 smithi203 ceph-mon[35450]: from='mgr.14150 172.21.15.19:0/1267850692' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T09:05:31.986 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:31 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3666455730' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T09:05:32.474 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T09:05:32.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:32 smithi155 ceph-mon[34921]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T09:05:32.674 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:32 smithi155 ceph-mon[34921]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T09:05:32.674 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:32 smithi155 ceph-mon[34921]: Cluster is now healthy 2024-09-19T09:05:32.674 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:32 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/3666455730' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:05:32.674 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:32 smithi155 ceph-mon[34921]: fsmap 12 up:standby 2024-09-19T09:05:32.742 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:32.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:32 smithi019 ceph-mon[30976]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T09:05:32.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:32 smithi019 ceph-mon[30976]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T09:05:32.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:32 smithi019 ceph-mon[30976]: Cluster is now healthy 2024-09-19T09:05:32.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:32 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/3666455730' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:05:32.819 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:32 smithi019 ceph-mon[30976]: fsmap 12 up:standby 2024-09-19T09:05:32.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:32 smithi203 ceph-mon[35450]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T09:05:32.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:32 smithi203 ceph-mon[35450]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T09:05:32.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:32 smithi203 ceph-mon[35450]: Cluster is now healthy 2024-09-19T09:05:32.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:32 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/3666455730' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T09:05:32.983 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:32 smithi203 ceph-mon[35450]: fsmap 12 up:standby 2024-09-19T09:05:33.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.228+0000 7fc2a6a69640 1 -- 172.21.15.19:0/3688001376 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a0102d40 msgr2=0x7fc2a0103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:33.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.228+0000 7fc2a6a69640 1 --2- 172.21.15.19:0/3688001376 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a0102d40 0x7fc2a0103120 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fc298009ca0 tx=0x7fc29802a950 comp rx=0 tx=0).stop 2024-09-19T09:05:33.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.228+0000 7fc2a6a69640 1 -- 172.21.15.19:0/3688001376 shutdown_connections 2024-09-19T09:05:33.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.228+0000 7fc2a6a69640 1 --2- 172.21.15.19:0/3688001376 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2a0103660 0x7fc2a010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.228+0000 7fc2a6a69640 1 --2- 172.21.15.19:0/3688001376 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2a010c170 0x7fc2a010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.228+0000 7fc2a6a69640 1 --2- 172.21.15.19:0/3688001376 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a0102d40 0x7fc2a0103120 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.229+0000 7fc2a6a69640 1 -- 172.21.15.19:0/3688001376 >> 172.21.15.19:0/3688001376 conn(0x7fc2a00fc7a0 msgr2=0x7fc2a00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:33.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.229+0000 7fc2a6a69640 1 -- 172.21.15.19:0/3688001376 shutdown_connections 2024-09-19T09:05:33.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.229+0000 7fc2a6a69640 1 -- 172.21.15.19:0/3688001376 wait complete. 2024-09-19T09:05:33.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.229+0000 7fc2a6a69640 1 Processor -- start 2024-09-19T09:05:33.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.229+0000 7fc2a6a69640 1 -- start start 2024-09-19T09:05:33.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.229+0000 7fc2a6a69640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a0102d40 0x7fc2a0198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:33.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.229+0000 7fc2a6a69640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2a0103660 0x7fc2a0198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:33.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.230+0000 7fc2a6a69640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2a010c170 0x7fc2a019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:33.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.230+0000 7fc2a6a69640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a0111f70 con 0x7fc2a0102d40 2024-09-19T09:05:33.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.230+0000 7fc2a6a69640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a0111df0 con 0x7fc2a010c170 2024-09-19T09:05:33.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.230+0000 7fc2a6a69640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc2a01120f0 con 0x7fc2a0103660 2024-09-19T09:05:33.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.230+0000 7fc2a4805640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a0102d40 0x7fc2a0198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:33.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.230+0000 7fc2a4805640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a0102d40 0x7fc2a0198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47940/0 (socket says 172.21.15.19:47940) 2024-09-19T09:05:33.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.230+0000 7fc2a4805640 1 -- 172.21.15.19:0/1934758248 learned_addr learned my addr 172.21.15.19:0/1934758248 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:05:33.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.230+0000 7fc2a5006640 1 --2- 172.21.15.19:0/1934758248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2a010c170 0x7fc2a019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:33.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.230+0000 7fc29ffff640 1 --2- 172.21.15.19:0/1934758248 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2a0103660 0x7fc2a0198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:33.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.230+0000 7fc2a4805640 1 -- 172.21.15.19:0/1934758248 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2a0103660 msgr2=0x7fc2a0198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:33.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.230+0000 7fc2a4805640 1 --2- 172.21.15.19:0/1934758248 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2a0103660 0x7fc2a0198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.230+0000 7fc2a4805640 1 -- 172.21.15.19:0/1934758248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2a010c170 msgr2=0x7fc2a019cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:33.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.230+0000 7fc2a4805640 1 --2- 172.21.15.19:0/1934758248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2a010c170 0x7fc2a019cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.230+0000 7fc2a4805640 1 -- 172.21.15.19:0/1934758248 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2a019d3e0 con 0x7fc2a0102d40 2024-09-19T09:05:33.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.230+0000 7fc2a4805640 1 --2- 172.21.15.19:0/1934758248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a0102d40 0x7fc2a0198430 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fc298005cc0 tx=0x7fc29802f630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:33.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.230+0000 7fc29dffb640 1 -- 172.21.15.19:0/1934758248 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc298034040 con 0x7fc2a0102d40 2024-09-19T09:05:33.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.230+0000 7fc2a6a69640 1 -- 172.21.15.19:0/1934758248 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2a019d670 con 0x7fc2a0102d40 2024-09-19T09:05:33.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.230+0000 7fc29dffb640 1 -- 172.21.15.19:0/1934758248 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7fc298030920 con 0x7fc2a0102d40 2024-09-19T09:05:33.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.230+0000 7fc29dffb640 1 -- 172.21.15.19:0/1934758248 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc298004830 con 0x7fc2a0102d40 2024-09-19T09:05:33.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.231+0000 7fc2a6a69640 1 -- 172.21.15.19:0/1934758248 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2a01a4fb0 con 0x7fc2a0102d40 2024-09-19T09:05:33.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.232+0000 7fc2a6a69640 1 -- 172.21.15.19:0/1934758248 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2a0103120 con 0x7fc2a0102d40 2024-09-19T09:05:33.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.233+0000 7fc29dffb640 1 -- 172.21.15.19:0/1934758248 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7fc298037020 con 0x7fc2a0102d40 2024-09-19T09:05:33.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.233+0000 7fc29dffb640 1 --2- 172.21.15.19:0/1934758248 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc2880a3240 0x7fc2880a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:33.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.234+0000 7fc29dffb640 1 -- 172.21.15.19:0/1934758248 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8641+0+0 (secure 0 0 0) 0x7fc2980f0cd0 con 0x7fc2a0102d40 2024-09-19T09:05:33.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.234+0000 7fc29ffff640 1 --2- 172.21.15.19:0/1934758248 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc2880a3240 0x7fc2880a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:33.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.234+0000 7fc29ffff640 1 --2- 172.21.15.19:0/1934758248 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc2880a3240 0x7fc2880a5700 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fc2a010d640 tx=0x7fc29400a560 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:33.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.237+0000 7fc29dffb640 1 -- 172.21.15.19:0/1934758248 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc298081210 con 0x7fc2a0102d40 2024-09-19T09:05:33.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.412+0000 7fc2a6a69640 1 -- 172.21.15.19:0/1934758248 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc2a01071e0 con 0x7fc2a0102d40 2024-09-19T09:05:33.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.787+0000 7fc29dffb640 1 -- 172.21.15.19:0/1934758248 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v90) ==== 181+0+0 (secure 0 0 0) 0x7fc2980bd850 con 0x7fc2a0102d40 2024-09-19T09:05:33.787 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_metadata' removed 2024-09-19T09:05:33.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.790+0000 7fc2a6a69640 1 -- 172.21.15.19:0/1934758248 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc2880a3240 msgr2=0x7fc2880a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:33.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.790+0000 7fc2a6a69640 1 --2- 172.21.15.19:0/1934758248 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc2880a3240 0x7fc2880a5700 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fc2a010d640 tx=0x7fc29400a560 comp rx=0 tx=0).stop 2024-09-19T09:05:33.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.790+0000 7fc2a6a69640 1 -- 172.21.15.19:0/1934758248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a0102d40 msgr2=0x7fc2a0198430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:33.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.790+0000 7fc2a6a69640 1 --2- 172.21.15.19:0/1934758248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a0102d40 0x7fc2a0198430 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fc298005cc0 tx=0x7fc29802f630 comp rx=0 tx=0).stop 2024-09-19T09:05:33.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.790+0000 7fc2a6a69640 1 -- 172.21.15.19:0/1934758248 shutdown_connections 2024-09-19T09:05:33.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.790+0000 7fc2a6a69640 1 --2- 172.21.15.19:0/1934758248 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7fc2880a3240 0x7fc2880a5700 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.790+0000 7fc2a6a69640 1 --2- 172.21.15.19:0/1934758248 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2a0103660 0x7fc2a0198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.790+0000 7fc2a6a69640 1 --2- 172.21.15.19:0/1934758248 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7fc2a010c170 0x7fc2a019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.790+0000 7fc2a6a69640 1 --2- 172.21.15.19:0/1934758248 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7fc2a0102d40 0x7fc2a0198430 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:33.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.790+0000 7fc2a6a69640 1 -- 172.21.15.19:0/1934758248 >> 172.21.15.19:0/1934758248 conn(0x7fc2a00fc7a0 msgr2=0x7fc2a00fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:33.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.790+0000 7fc2a6a69640 1 -- 172.21.15.19:0/1934758248 shutdown_connections 2024-09-19T09:05:33.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:33.790+0000 7fc2a6a69640 1 -- 172.21.15.19:0/1934758248 wait complete. 2024-09-19T09:05:34.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:33 smithi019 ceph-mon[30976]: pgmap v744: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-19T09:05:34.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:33 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1934758248' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:05:34.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:33 smithi155 ceph-mon[34921]: pgmap v744: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-19T09:05:34.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:33 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1934758248' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:05:34.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:33 smithi203 ceph-mon[35450]: pgmap v744: 97 pgs: 97 active+clean; 4.1 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-19T09:05:34.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:33 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1934758248' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:05:34.487 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid f26c9d84-7662-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T09:05:34.743 INFO:teuthology.orchestra.run.smithi019.stderr:Inferring config /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T09:05:35.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:34 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1934758248' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:05:35.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:34 smithi019 ceph-mon[30976]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T09:05:35.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:34 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1934758248' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:05:35.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:34 smithi155 ceph-mon[34921]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T09:05:35.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.188+0000 7f1ec7240640 1 -- 172.21.15.19:0/983895254 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ec0102e00 msgr2=0x7f1ec01031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:35.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.188+0000 7f1ec7240640 1 --2- 172.21.15.19:0/983895254 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ec0102e00 0x7f1ec01031e0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4009900 tx=0x7f1eb402a480 comp rx=0 tx=0).stop 2024-09-19T09:05:35.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.188+0000 7f1ec7240640 1 -- 172.21.15.19:0/983895254 shutdown_connections 2024-09-19T09:05:35.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.188+0000 7f1ec7240640 1 --2- 172.21.15.19:0/983895254 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ec0103720 0x7f1ec010bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.188+0000 7f1ec7240640 1 --2- 172.21.15.19:0/983895254 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ec010c1a0 0x7f1ec010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.188+0000 7f1ec7240640 1 --2- 172.21.15.19:0/983895254 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ec0102e00 0x7f1ec01031e0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.188+0000 7f1ec7240640 1 -- 172.21.15.19:0/983895254 >> 172.21.15.19:0/983895254 conn(0x7f1ec00fc7a0 msgr2=0x7f1ec00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:35.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.188+0000 7f1ec7240640 1 -- 172.21.15.19:0/983895254 shutdown_connections 2024-09-19T09:05:35.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.188+0000 7f1ec7240640 1 -- 172.21.15.19:0/983895254 wait complete. 2024-09-19T09:05:35.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.189+0000 7f1ec7240640 1 Processor -- start 2024-09-19T09:05:35.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.189+0000 7f1ec7240640 1 -- start start 2024-09-19T09:05:35.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.189+0000 7f1ec7240640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ec0102e00 0x7f1ec01984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:35.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.189+0000 7f1ec7240640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ec0103720 0x7f1ec0198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:35.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.189+0000 7f1ec7240640 1 --2- >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ec010c1a0 0x7f1ec019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:35.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.189+0000 7f1ec7240640 1 -- --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec0111f70 con 0x7f1ec0103720 2024-09-19T09:05:35.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.189+0000 7f1ec7240640 1 -- --> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec0111df0 con 0x7f1ec010c1a0 2024-09-19T09:05:35.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.189+0000 7f1ec7240640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec01120f0 con 0x7f1ec0102e00 2024-09-19T09:05:35.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.189+0000 7f1ebffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ec0103720 0x7f1ec0198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:35.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.189+0000 7f1ebffff640 1 --2- >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ec0103720 0x7f1ec0198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.19:3300/0 says I am v2:172.21.15.19:47964/0 (socket says 172.21.15.19:47964) 2024-09-19T09:05:35.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.189+0000 7f1ebffff640 1 -- 172.21.15.19:0/1822742960 learned_addr learned my addr 172.21.15.19:0/1822742960 (peer_addr_for_me v2:172.21.15.19:0/0) 2024-09-19T09:05:35.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.190+0000 7f1ec57dd640 1 --2- 172.21.15.19:0/1822742960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ec010c1a0 0x7f1ec019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:35.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.190+0000 7f1ec4fdc640 1 --2- 172.21.15.19:0/1822742960 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ec0102e00 0x7f1ec01984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:35.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.190+0000 7f1ebffff640 1 -- 172.21.15.19:0/1822742960 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ec0102e00 msgr2=0x7f1ec01984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:35.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.190+0000 7f1ebffff640 1 --2- 172.21.15.19:0/1822742960 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ec0102e00 0x7f1ec01984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.190+0000 7f1ebffff640 1 -- 172.21.15.19:0/1822742960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ec010c1a0 msgr2=0x7f1ec019cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:35.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.190+0000 7f1ebffff640 1 --2- 172.21.15.19:0/1822742960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ec010c1a0 0x7f1ec019cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.190+0000 7f1ebffff640 1 -- 172.21.15.19:0/1822742960 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec019d470 con 0x7f1ec0103720 2024-09-19T09:05:35.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.190+0000 7f1ec57dd640 1 --2- 172.21.15.19:0/1822742960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ec010c1a0 0x7f1ec019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T09:05:35.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.190+0000 7f1ebffff640 1 --2- 172.21.15.19:0/1822742960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ec0103720 0x7f1ec0198a00 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f1eac00d770 tx=0x7f1eac00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:35.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.190+0000 7f1ebdffb640 1 -- 172.21.15.19:0/1822742960 <== mon.0 v2:172.21.15.19:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eac017070 con 0x7f1ec0103720 2024-09-19T09:05:35.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.190+0000 7f1ec7240640 1 -- 172.21.15.19:0/1822742960 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ec019d760 con 0x7f1ec0103720 2024-09-19T09:05:35.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.190+0000 7f1ebdffb640 1 -- 172.21.15.19:0/1822742960 <== mon.0 v2:172.21.15.19:3300/0 2 ==== config(27 keys) ==== 1140+0+0 (secure 0 0 0) 0x7f1eac005500 con 0x7f1ec0103720 2024-09-19T09:05:35.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.190+0000 7f1ebdffb640 1 -- 172.21.15.19:0/1822742960 <== mon.0 v2:172.21.15.19:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eac004e00 con 0x7f1ec0103720 2024-09-19T09:05:35.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.190+0000 7f1ec7240640 1 -- 172.21.15.19:0/1822742960 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ec01a5040 con 0x7f1ec0103720 2024-09-19T09:05:35.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.191+0000 7f1ec7240640 1 -- 172.21.15.19:0/1822742960 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ec01031e0 con 0x7f1ec0103720 2024-09-19T09:05:35.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.192+0000 7f1ebdffb640 1 -- 172.21.15.19:0/1822742960 <== mon.0 v2:172.21.15.19:3300/0 4 ==== mgrmap(e 20) ==== 138355+0+0 (secure 0 0 0) 0x7f1eac004fa0 con 0x7f1ec0103720 2024-09-19T09:05:35.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.193+0000 7f1ebdffb640 1 --2- 172.21.15.19:0/1822742960 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1eb00a3240 0x7f1eb00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T09:05:35.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.193+0000 7f1ec4fdc640 1 --2- 172.21.15.19:0/1822742960 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1eb00a3240 0x7f1eb00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T09:05:35.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.193+0000 7f1ebdffb640 1 -- 172.21.15.19:0/1822742960 <== mon.0 v2:172.21.15.19:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8087+0+0 (secure 0 0 0) 0x7f1eac0cf360 con 0x7f1ec0103720 2024-09-19T09:05:35.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.194+0000 7f1ec4fdc640 1 --2- 172.21.15.19:0/1822742960 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1eb00a3240 0x7f1eb00a5700 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4005ab0 tx=0x7f1eb4005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T09:05:35.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.197+0000 7f1ebdffb640 1 -- 172.21.15.19:0/1822742960 <== mon.0 v2:172.21.15.19:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1eac09c160 con 0x7f1ec0103720 2024-09-19T09:05:35.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:34 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1934758248' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:05:35.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:34 smithi203 ceph-mon[35450]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T09:05:35.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.377+0000 7f1ec7240640 1 -- 172.21.15.19:0/1822742960 --> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1ec0107280 con 0x7f1ec0103720 2024-09-19T09:05:35.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.794+0000 7f1ebdffb640 1 -- 172.21.15.19:0/1822742960 <== mon.0 v2:172.21.15.19:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v91) ==== 169+0+0 (secure 0 0 0) 0x7f1eac09ba60 con 0x7f1ec0103720 2024-09-19T09:05:35.795 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'cephfs_data' removed 2024-09-19T09:05:35.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.798+0000 7f1ec7240640 1 -- 172.21.15.19:0/1822742960 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1eb00a3240 msgr2=0x7f1eb00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:35.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.798+0000 7f1ec7240640 1 --2- 172.21.15.19:0/1822742960 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1eb00a3240 0x7f1eb00a5700 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4005ab0 tx=0x7f1eb4005a20 comp rx=0 tx=0).stop 2024-09-19T09:05:35.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.798+0000 7f1ec7240640 1 -- 172.21.15.19:0/1822742960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ec0103720 msgr2=0x7f1ec0198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T09:05:35.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.798+0000 7f1ec7240640 1 --2- 172.21.15.19:0/1822742960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ec0103720 0x7f1ec0198a00 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f1eac00d770 tx=0x7f1eac00dc30 comp rx=0 tx=0).stop 2024-09-19T09:05:35.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.798+0000 7f1ec7240640 1 -- 172.21.15.19:0/1822742960 shutdown_connections 2024-09-19T09:05:35.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.798+0000 7f1ec7240640 1 --2- 172.21.15.19:0/1822742960 >> [v2:172.21.15.19:6800/1181234346,v1:172.21.15.19:6801/1181234346] conn(0x7f1eb00a3240 0x7f1eb00a5700 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.798+0000 7f1ec7240640 1 --2- 172.21.15.19:0/1822742960 >> [v2:172.21.15.155:3300/0,v1:172.21.15.155:6789/0] conn(0x7f1ec010c1a0 0x7f1ec019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.798+0000 7f1ec7240640 1 --2- 172.21.15.19:0/1822742960 >> [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] conn(0x7f1ec0103720 0x7f1ec0198a00 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.798+0000 7f1ec7240640 1 --2- 172.21.15.19:0/1822742960 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ec0102e00 0x7f1ec01984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T09:05:35.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.798+0000 7f1ec7240640 1 -- 172.21.15.19:0/1822742960 >> 172.21.15.19:0/1822742960 conn(0x7f1ec00fc7a0 msgr2=0x7f1ec00fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T09:05:35.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.799+0000 7f1ec7240640 1 -- 172.21.15.19:0/1822742960 shutdown_connections 2024-09-19T09:05:35.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-19T09:05:35.799+0000 7f1ec7240640 1 -- 172.21.15.19:0/1822742960 wait complete. 2024-09-19T09:05:36.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:35 smithi019 ceph-mon[30976]: pgmap v746: 65 pgs: 65 active+clean; 577 KiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:05:36.069 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:35 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1822742960' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:05:36.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:35 smithi155 ceph-mon[34921]: pgmap v746: 65 pgs: 65 active+clean; 577 KiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:05:36.173 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:35 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1822742960' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:05:36.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:35 smithi203 ceph-mon[35450]: pgmap v746: 65 pgs: 65 active+clean; 577 KiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T09:05:36.232 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:35 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1822742960' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T09:05:36.529 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:05:36.565 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:05:36.620 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:05:36.650 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-19T09:05:36.651 DEBUG:teuthology.orchestra.run.smithi019:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T09:05:36.677 DEBUG:teuthology.orchestra.run.smithi155:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T09:05:36.694 DEBUG:teuthology.orchestra.run.smithi203:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T09:05:36.711 INFO:tasks.cephadm:Stopping all daemons... 2024-09-19T09:05:36.711 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-19T09:05:36.711 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mon.a 2024-09-19T09:05:36.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:36 smithi155 ceph-mon[34921]: from='client.? 172.21.15.19:0/1822742960' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:05:36.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:36 smithi155 ceph-mon[34921]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T09:05:36.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:36 smithi203 ceph-mon[35450]: from='client.? 172.21.15.19:0/1822742960' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:05:36.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:36 smithi203 ceph-mon[35450]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T09:05:37.046 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:36 smithi019 systemd[1]: Stopping Ceph mon.a for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T09:05:37.046 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:36 smithi019 ceph-mon[30976]: from='client.? 172.21.15.19:0/1822742960' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T09:05:37.046 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:36 smithi019 ceph-mon[30976]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T09:05:37.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:37 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mon-a[30972]: 2024-09-19T09:05:37.045+0000 7fd2fd0cd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:05:37.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:37 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mon-a[30972]: 2024-09-19T09:05:37.045+0000 7fd2fd0cd640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-19T09:05:37.319 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:37 smithi019 podman[216835]: 2024-09-19 09:05:37.116605857 +0000 UTC m=+0.210311336 container died 2c489516c9ba6b602856940abbb705674af09db6dbc36bcdeb12831ca6749885 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:05:37.821 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:37 smithi019 podman[216835]: 2024-09-19 09:05:37.570999645 +0000 UTC m=+0.664705124 container cleanup 2c489516c9ba6b602856940abbb705674af09db6dbc36bcdeb12831ca6749885 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mon-a, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-19T09:05:37.821 INFO:journalctl@ceph.mon.a.smithi019.stdout:Sep 19 09:05:37 smithi019 bash[216835]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mon-a 2024-09-19T09:05:38.086 DEBUG:teuthology.orchestra.run.smithi019:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mon.a.service' 2024-09-19T09:05:38.142 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:05:38.142 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-19T09:05:38.142 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-19T09:05:38.143 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mon.b 2024-09-19T09:05:38.423 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:38 smithi155 systemd[1]: Stopping Ceph mon.b for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T09:05:38.923 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:38 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mon-b[34917]: 2024-09-19T09:05:38.506+0000 7f1200b80640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:05:38.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:38 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mon-b[34917]: 2024-09-19T09:05:38.506+0000 7f1200b80640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-19T09:05:38.924 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:38 smithi155 podman[70665]: 2024-09-19 09:05:38.721394539 +0000 UTC m=+0.344763928 container died 8405faf5060a2edf5680c2717a46178f0ed60058a826c21778a808a6051e139c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mon-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-19T09:05:39.408 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:39 smithi155 podman[70665]: 2024-09-19 09:05:39.164864356 +0000 UTC m=+0.788233787 container cleanup 8405faf5060a2edf5680c2717a46178f0ed60058a826c21778a808a6051e139c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mon-b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-19T09:05:39.408 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:39 smithi155 bash[70665]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mon-b 2024-09-19T09:05:39.619 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mon.b.service' 2024-09-19T09:05:39.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:39 smithi155 podman[70680]: 2024-09-19 09:05:39.408042465 +0000 UTC m=+0.673482579 container remove 8405faf5060a2edf5680c2717a46178f0ed60058a826c21778a808a6051e139c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mon-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True) 2024-09-19T09:05:39.673 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:39 smithi155 systemd[1]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mon.b.service: Deactivated successfully. 2024-09-19T09:05:39.674 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:39 smithi155 systemd[1]: Stopped Ceph mon.b for f26c9d84-7662-11ef-bceb-c7b262605968. 2024-09-19T09:05:39.674 INFO:journalctl@ceph.mon.b.smithi155.stdout:Sep 19 09:05:39 smithi155 systemd[1]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mon.b.service: Consumed 13.248s CPU time. 2024-09-19T09:05:39.689 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:05:39.689 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-19T09:05:39.690 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-19T09:05:39.690 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mon.c 2024-09-19T09:05:39.982 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:39 smithi203 systemd[1]: Stopping Ceph mon.c for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T09:05:40.247 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:39 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mon-c[35446]: 2024-09-19T09:05:39.991+0000 7fdfb6582640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:05:40.248 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:39 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mon-c[35446]: 2024-09-19T09:05:39.991+0000 7fdfb6582640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-19T09:05:40.546 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:40 smithi203 podman[70605]: 2024-09-19 09:05:40.246762261 +0000 UTC m=+0.361364636 container died 2a82357b0af23ca0c42fc74b6a15d6a3c8d31c63470195235e9e3a2a06b29809 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mon-c, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-19T09:05:40.889 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:40 smithi203 podman[70605]: 2024-09-19 09:05:40.629479071 +0000 UTC m=+0.744081446 container cleanup 2a82357b0af23ca0c42fc74b6a15d6a3c8d31c63470195235e9e3a2a06b29809 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mon-c, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:05:40.890 INFO:journalctl@ceph.mon.c.smithi203.stdout:Sep 19 09:05:40 smithi203 bash[70605]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mon-c 2024-09-19T09:05:41.069 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mon.c.service' 2024-09-19T09:05:41.117 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:05:41.117 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-19T09:05:41.117 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-19T09:05:41.118 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mgr.x 2024-09-19T09:05:41.447 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 09:05:41 smithi019 systemd[1]: Stopping Ceph mgr.x for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T09:05:41.794 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 09:05:41 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T09:05:41.446+0000 7f9b94c03640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:05:41.795 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 09:05:41 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x[31201]: 2024-09-19T09:05:41.446+0000 7f9b94c03640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-19T09:05:41.795 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 09:05:41 smithi019 podman[216956]: 2024-09-19 09:05:41.477529393 +0000 UTC m=+0.163344750 container died b2a9fb49f940394e6d77befbfac18a641bfdbdcb3f484a233c5fd23958dc324d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=) 2024-09-19T09:05:42.069 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 09:05:41 smithi019 podman[216956]: 2024-09-19 09:05:41.893749974 +0000 UTC m=+0.579565323 container cleanup b2a9fb49f940394e6d77befbfac18a641bfdbdcb3f484a233c5fd23958dc324d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:05:42.069 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 09:05:41 smithi019 bash[216956]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x 2024-09-19T09:05:42.409 DEBUG:teuthology.orchestra.run.smithi019:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-19T09:05:42.431 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 09:05:42 smithi019 podman[216968]: 2024-09-19 09:05:42.162778055 +0000 UTC m=+0.681334457 container remove b2a9fb49f940394e6d77befbfac18a641bfdbdcb3f484a233c5fd23958dc324d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-19T09:05:42.432 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 09:05:42 smithi019 systemd[1]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mgr.x.service: Deactivated successfully. 2024-09-19T09:05:42.432 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 09:05:42 smithi019 systemd[1]: Stopped Ceph mgr.x for f26c9d84-7662-11ef-bceb-c7b262605968. 2024-09-19T09:05:42.432 INFO:journalctl@ceph.mgr.x.smithi019.stdout:Sep 19 09:05:42 smithi019 systemd[1]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mgr.x.service: Consumed 48.661s CPU time. 2024-09-19T09:05:42.444 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:05:42.445 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-19T09:05:42.445 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-19T09:05:42.445 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mgr.y 2024-09-19T09:05:42.730 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 09:05:42 smithi155 systemd[1]: Stopping Ceph mgr.y for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T09:05:43.087 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 09:05:42 smithi155 podman[70790]: 2024-09-19 09:05:42.798573634 +0000 UTC m=+0.149400194 container died 517ec88276f731d3a7f8bba79b92f2cc4ad84516592e1b9fc01938c0321528e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-y, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T09:05:43.423 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 09:05:43 smithi155 podman[70790]: 2024-09-19 09:05:43.195195629 +0000 UTC m=+0.546022189 container cleanup 517ec88276f731d3a7f8bba79b92f2cc4ad84516592e1b9fc01938c0321528e3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-y, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-19T09:05:43.423 INFO:journalctl@ceph.mgr.y.smithi155.stdout:Sep 19 09:05:43 smithi155 bash[70790]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-y 2024-09-19T09:05:43.609 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-19T09:05:43.645 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:05:43.645 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-19T09:05:43.645 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-19T09:05:43.646 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mgr.z 2024-09-19T09:05:43.982 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 09:05:43 smithi203 systemd[1]: Stopping Ceph mgr.z for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T09:05:44.328 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 09:05:44 smithi203 podman[70739]: 2024-09-19 09:05:44.031641733 +0000 UTC m=+0.181935876 container died 48cdd72c29a0054964c79e331510eb3d2153a1acf8b7c85636d3f278b036ab10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-z, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-19T09:05:44.671 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 09:05:44 smithi203 podman[70739]: 2024-09-19 09:05:44.419578726 +0000 UTC m=+0.569872868 container cleanup 48cdd72c29a0054964c79e331510eb3d2153a1acf8b7c85636d3f278b036ab10 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-z, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0) 2024-09-19T09:05:44.671 INFO:journalctl@ceph.mgr.z.smithi203.stdout:Sep 19 09:05:44 smithi203 bash[70739]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mgr-z 2024-09-19T09:05:44.803 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-19T09:05:44.839 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:05:44.839 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-19T09:05:44.840 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-19T09:05:44.840 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ceph-f26c9d84-7662-11ef-bceb-c7b262605968@osd.0 2024-09-19T09:05:45.165 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 19 09:05:44 smithi019 systemd[1]: Stopping Ceph osd.0 for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T09:05:45.569 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 19 09:05:45 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-0[44431]: 2024-09-19T09:05:45.165+0000 7f7488fac640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:05:45.569 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 19 09:05:45 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-0[44431]: 2024-09-19T09:05:45.165+0000 7f7488fac640 -1 osd.0 91 *** Got signal Terminated *** 2024-09-19T09:05:45.569 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 19 09:05:45 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-0[44431]: 2024-09-19T09:05:45.165+0000 7f7488fac640 -1 osd.0 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:05:50.819 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 19 09:05:50 smithi019 podman[217077]: 2024-09-19 09:05:50.503861048 +0000 UTC m=+5.460523546 container died e5c7c432051e46967dfc30ec125ec9415c3dc0ecd450021404c068531fb499d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-19T09:05:51.320 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 19 09:05:51 smithi019 podman[217077]: 2024-09-19 09:05:51.033202003 +0000 UTC m=+5.989864534 container cleanup e5c7c432051e46967dfc30ec125ec9415c3dc0ecd450021404c068531fb499d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-19T09:05:51.321 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 19 09:05:51 smithi019 bash[217077]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-0 2024-09-19T09:05:51.627 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 19 09:05:51 smithi019 podman[217093]: 2024-09-19 09:05:51.3770819 +0000 UTC m=+0.868678188 container remove e5c7c432051e46967dfc30ec125ec9415c3dc0ecd450021404c068531fb499d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:05:51.952 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 19 09:05:51 smithi019 podman[217182]: 2024-09-19 09:05:51.732346966 +0000 UTC m=+0.016520993 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:05:51.952 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 19 09:05:51 smithi019 podman[217182]: 2024-09-19 09:05:51.837066589 +0000 UTC m=+0.121240610 container create 7a50a26a171b5b6a45b7f2b149f6f187c5fc72aa809e1d567e29ccb6bba55f1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-19T09:05:52.239 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 19 09:05:52 smithi019 podman[217182]: 2024-09-19 09:05:52.072996667 +0000 UTC m=+0.357170686 container init 7a50a26a171b5b6a45b7f2b149f6f187c5fc72aa809e1d567e29ccb6bba55f1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-19T09:05:52.240 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 19 09:05:52 smithi019 podman[217182]: 2024-09-19 09:05:52.076578281 +0000 UTC m=+0.360752306 container start 7a50a26a171b5b6a45b7f2b149f6f187c5fc72aa809e1d567e29ccb6bba55f1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:05:52.240 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 19 09:05:52 smithi019 podman[217182]: 2024-09-19 09:05:52.239978401 +0000 UTC m=+0.524152486 container attach 7a50a26a171b5b6a45b7f2b149f6f187c5fc72aa809e1d567e29ccb6bba55f1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-19T09:05:53.569 INFO:journalctl@ceph.osd.0.smithi019.stdout:Sep 19 09:05:53 smithi019 podman[217182]: 2024-09-19 09:05:53.231955334 +0000 UTC m=+1.516129369 container died 7a50a26a171b5b6a45b7f2b149f6f187c5fc72aa809e1d567e29ccb6bba55f1a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-0-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:05:54.026 DEBUG:teuthology.orchestra.run.smithi019:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@osd.0.service' 2024-09-19T09:05:54.073 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:05:54.073 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-19T09:05:54.074 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-19T09:05:54.074 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-f26c9d84-7662-11ef-bceb-c7b262605968@osd.1 2024-09-19T09:05:54.400 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 09:05:54 smithi155 systemd[1]: Stopping Ceph osd.1 for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T09:05:54.673 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 09:05:54 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-1[39384]: 2024-09-19T09:05:54.399+0000 7fbe59c5e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:05:54.674 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 09:05:54 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-1[39384]: 2024-09-19T09:05:54.399+0000 7fbe59c5e640 -1 osd.1 91 *** Got signal Terminated *** 2024-09-19T09:05:54.674 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 09:05:54 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-1[39384]: 2024-09-19T09:05:54.399+0000 7fbe59c5e640 -1 osd.1 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:06:00.260 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 09:05:59 smithi155 podman[70915]: 2024-09-19 09:05:59.95343938 +0000 UTC m=+5.674621516 container died 1be9374314d6c51e82e378347c73c027a86745860ad2b5a3ca9c75e74aa1330b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-1, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD) 2024-09-19T09:06:00.634 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 09:06:00 smithi155 podman[70915]: 2024-09-19 09:06:00.358135713 +0000 UTC m=+6.079317851 container cleanup 1be9374314d6c51e82e378347c73c027a86745860ad2b5a3ca9c75e74aa1330b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-1, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-19T09:06:00.634 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 09:06:00 smithi155 bash[70915]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-1 2024-09-19T09:06:00.923 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 09:06:00 smithi155 podman[70931]: 2024-09-19 09:06:00.634573289 +0000 UTC m=+0.677889401 container remove 1be9374314d6c51e82e378347c73c027a86745860ad2b5a3ca9c75e74aa1330b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-1, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-19T09:06:01.263 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 09:06:00 smithi155 podman[71024]: 2024-09-19 09:06:00.88288014 +0000 UTC m=+0.015907989 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:06:01.263 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 09:06:01 smithi155 podman[71024]: 2024-09-19 09:06:01.010692632 +0000 UTC m=+0.143720469 container create 552fb6ccc8bfccc1386872dbf7d6ce3559b6a103b26b29b4fde58c97c82a9551 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-19T09:06:01.583 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 09:06:01 smithi155 podman[71024]: 2024-09-19 09:06:01.263203379 +0000 UTC m=+0.396231170 container init 552fb6ccc8bfccc1386872dbf7d6ce3559b6a103b26b29b4fde58c97c82a9551 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-19T09:06:01.584 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 09:06:01 smithi155 podman[71024]: 2024-09-19 09:06:01.267009394 +0000 UTC m=+0.400037187 container start 552fb6ccc8bfccc1386872dbf7d6ce3559b6a103b26b29b4fde58c97c82a9551 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T09:06:01.584 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 09:06:01 smithi155 podman[71024]: 2024-09-19 09:06:01.38003685 +0000 UTC m=+0.513064642 container attach 552fb6ccc8bfccc1386872dbf7d6ce3559b6a103b26b29b4fde58c97c82a9551 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:06:01.923 INFO:journalctl@ceph.osd.1.smithi155.stdout:Sep 19 09:06:01 smithi155 podman[71024]: 2024-09-19 09:06:01.584059349 +0000 UTC m=+0.717087140 container died 552fb6ccc8bfccc1386872dbf7d6ce3559b6a103b26b29b4fde58c97c82a9551 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True) 2024-09-19T09:06:02.283 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@osd.1.service' 2024-09-19T09:06:02.323 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:06:02.323 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-19T09:06:02.323 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-19T09:06:02.323 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-f26c9d84-7662-11ef-bceb-c7b262605968@osd.2 2024-09-19T09:06:02.633 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 09:06:02 smithi203 systemd[1]: Stopping Ceph osd.2 for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T09:06:02.982 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 09:06:02 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-2[40419]: 2024-09-19T09:06:02.632+0000 7f9ce34d4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:06:02.982 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 09:06:02 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-2[40419]: 2024-09-19T09:06:02.632+0000 7f9ce34d4640 -1 osd.2 91 *** Got signal Terminated *** 2024-09-19T09:06:02.982 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 09:06:02 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-2[40419]: 2024-09-19T09:06:02.632+0000 7f9ce34d4640 -1 osd.2 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:06:08.292 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 09:06:08 smithi203 podman[70858]: 2024-09-19 09:06:08.018335758 +0000 UTC m=+5.507758148 container died 21aeed39b95726643a0a3b0fd0b8500057ad846351c801c60cde0b7721e9353e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-19T09:06:08.643 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 09:06:08 smithi203 podman[70858]: 2024-09-19 09:06:08.391405108 +0000 UTC m=+5.880827529 container cleanup 21aeed39b95726643a0a3b0fd0b8500057ad846351c801c60cde0b7721e9353e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T09:06:08.643 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 09:06:08 smithi203 bash[70858]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-2 2024-09-19T09:06:08.956 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 09:06:08 smithi203 podman[70873]: 2024-09-19 09:06:08.643126483 +0000 UTC m=+0.627814602 container remove 21aeed39b95726643a0a3b0fd0b8500057ad846351c801c60cde0b7721e9353e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-19T09:06:09.213 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 09:06:08 smithi203 podman[70964]: 2024-09-19 09:06:08.859251511 +0000 UTC m=+0.016790969 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:06:09.213 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 09:06:08 smithi203 podman[70964]: 2024-09-19 09:06:08.977583543 +0000 UTC m=+0.135122987 container create 83f954d8c54f06215655305f550fa207781a93404664522ecee47aceed24a66a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-19T09:06:09.482 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 09:06:09 smithi203 podman[70964]: 2024-09-19 09:06:09.213636996 +0000 UTC m=+0.371176444 container init 83f954d8c54f06215655305f550fa207781a93404664522ecee47aceed24a66a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-19T09:06:09.483 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 09:06:09 smithi203 podman[70964]: 2024-09-19 09:06:09.217215145 +0000 UTC m=+0.374754597 container start 83f954d8c54f06215655305f550fa207781a93404664522ecee47aceed24a66a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-19T09:06:09.483 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 09:06:09 smithi203 podman[70964]: 2024-09-19 09:06:09.364541618 +0000 UTC m=+0.522081074 container attach 83f954d8c54f06215655305f550fa207781a93404664522ecee47aceed24a66a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-19T09:06:09.483 INFO:journalctl@ceph.osd.2.smithi203.stdout:Sep 19 09:06:09 smithi203 podman[70964]: 2024-09-19 09:06:09.412348663 +0000 UTC m=+0.569888107 container died 83f954d8c54f06215655305f550fa207781a93404664522ecee47aceed24a66a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:06:10.036 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@osd.2.service' 2024-09-19T09:06:10.078 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:06:10.078 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-19T09:06:10.078 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-19T09:06:10.079 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ceph-f26c9d84-7662-11ef-bceb-c7b262605968@osd.3 2024-09-19T09:06:10.398 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 19 09:06:10 smithi019 systemd[1]: Stopping Ceph osd.3 for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T09:06:10.667 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 19 09:06:10 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-3[51303]: 2024-09-19T09:06:10.396+0000 7f774b478640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:06:10.668 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 19 09:06:10 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-3[51303]: 2024-09-19T09:06:10.396+0000 7f774b478640 -1 osd.3 91 *** Got signal Terminated *** 2024-09-19T09:06:10.668 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 19 09:06:10 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-3[51303]: 2024-09-19T09:06:10.396+0000 7f774b478640 -1 osd.3 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:06:11.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:10 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:10.761+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:12.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:11 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:11.735+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:12.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:12 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:12.079+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:13.069 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 19 09:06:12 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-3[51303]: 2024-09-19T09:06:12.685+0000 7f7743a86640 -1 osd.3 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:47.912644+0000 front 2024-09-19T09:05:47.912825+0000 (oldest deadline 2024-09-19T09:06:12.612735+0000) 2024-09-19T09:06:13.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:12 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:12.717+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:13.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:13 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:13.106+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:13.666 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:13 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:13.339+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.636392+0000 front 2024-09-19T09:05:49.636336+0000 (oldest deadline 2024-09-19T09:06:12.536469+0000) 2024-09-19T09:06:14.069 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 19 09:06:13 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-3[51303]: 2024-09-19T09:06:13.665+0000 7f7743a86640 -1 osd.3 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:47.912644+0000 front 2024-09-19T09:05:47.912825+0000 (oldest deadline 2024-09-19T09:06:12.612735+0000) 2024-09-19T09:06:14.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:13 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:13.701+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:14.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:14 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:14.129+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:14.695 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:14 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:14.355+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.636392+0000 front 2024-09-19T09:05:49.636336+0000 (oldest deadline 2024-09-19T09:06:12.536469+0000) 2024-09-19T09:06:15.069 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 19 09:06:14 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-3[51303]: 2024-09-19T09:06:14.704+0000 7f7743a86640 -1 osd.3 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:47.912644+0000 front 2024-09-19T09:05:47.912825+0000 (oldest deadline 2024-09-19T09:06:12.612735+0000) 2024-09-19T09:06:15.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:14 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:14.694+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:15.232 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:14 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:14.762+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:15.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:15 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:15.080+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:15.569 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:15 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:15.309+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.636392+0000 front 2024-09-19T09:05:49.636336+0000 (oldest deadline 2024-09-19T09:06:12.536469+0000) 2024-09-19T09:06:15.732 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:15 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T09:06:15.375+0000 7f2b62826640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.507700+0000 front 2024-09-19T09:05:49.507494+0000 (oldest deadline 2024-09-19T09:06:14.807401+0000) 2024-09-19T09:06:16.073 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:15 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:15.714+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:16.074 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 19 09:06:15 smithi019 podman[217287]: 2024-09-19 09:06:15.832878284 +0000 UTC m=+5.556433735 container died 70c8830d2c3f4cc59d34265120dbc78d8cd9887318d2c80b57f4cc36b3ce0ea0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-3, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T09:06:16.232 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:15 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:15.794+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:16.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:16 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:16.110+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:16.569 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 19 09:06:16 smithi019 podman[217287]: 2024-09-19 09:06:16.356378138 +0000 UTC m=+6.079933587 container cleanup 70c8830d2c3f4cc59d34265120dbc78d8cd9887318d2c80b57f4cc36b3ce0ea0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-3, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4) 2024-09-19T09:06:16.570 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 19 09:06:16 smithi019 bash[217287]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-3 2024-09-19T09:06:16.570 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:16 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:16.311+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.636392+0000 front 2024-09-19T09:05:49.636336+0000 (oldest deadline 2024-09-19T09:06:12.536469+0000) 2024-09-19T09:06:16.732 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:16 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T09:06:16.335+0000 7f2b62826640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.507700+0000 front 2024-09-19T09:05:49.507494+0000 (oldest deadline 2024-09-19T09:06:14.807401+0000) 2024-09-19T09:06:17.010 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 19 09:06:16 smithi019 podman[217314]: 2024-09-19 09:06:16.599599138 +0000 UTC m=+0.765305920 container remove 70c8830d2c3f4cc59d34265120dbc78d8cd9887318d2c80b57f4cc36b3ce0ea0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T09:06:17.011 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:16 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:16.754+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:17.232 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:16 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:16.795+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:17.269 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 19 09:06:17 smithi019 podman[217403]: 2024-09-19 09:06:16.913723312 +0000 UTC m=+0.016459823 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:06:17.270 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 19 09:06:17 smithi019 podman[217403]: 2024-09-19 09:06:17.034172491 +0000 UTC m=+0.136909033 container create 706a69668998b74c0741829d8a76605163f3a5cf3bbd0dafaf904a9d06101abf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-19T09:06:17.270 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 19 09:06:17 smithi019 podman[217403]: 2024-09-19 09:06:17.269944789 +0000 UTC m=+0.372681300 container init 706a69668998b74c0741829d8a76605163f3a5cf3bbd0dafaf904a9d06101abf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-19T09:06:17.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:17 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:17.142+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:17.569 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:17 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:17.336+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.636392+0000 front 2024-09-19T09:05:49.636336+0000 (oldest deadline 2024-09-19T09:06:12.536469+0000) 2024-09-19T09:06:17.569 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 19 09:06:17 smithi019 podman[217403]: 2024-09-19 09:06:17.273353035 +0000 UTC m=+0.376089537 container start 706a69668998b74c0741829d8a76605163f3a5cf3bbd0dafaf904a9d06101abf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-19T09:06:17.569 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 19 09:06:17 smithi019 podman[217403]: 2024-09-19 09:06:17.386765299 +0000 UTC m=+0.489501811 container attach 706a69668998b74c0741829d8a76605163f3a5cf3bbd0dafaf904a9d06101abf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T09:06:17.570 INFO:journalctl@ceph.osd.3.smithi019.stdout:Sep 19 09:06:17 smithi019 podman[217403]: 2024-09-19 09:06:17.468436087 +0000 UTC m=+0.571172598 container died 706a69668998b74c0741829d8a76605163f3a5cf3bbd0dafaf904a9d06101abf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:06:17.732 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:17 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T09:06:17.333+0000 7f2b62826640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.507700+0000 front 2024-09-19T09:05:49.507494+0000 (oldest deadline 2024-09-19T09:06:14.807401+0000) 2024-09-19T09:06:18.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:17 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:17.760+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:18.232 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:17 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:17.780+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:18.235 DEBUG:teuthology.orchestra.run.smithi019:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@osd.3.service' 2024-09-19T09:06:18.278 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:06:18.279 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-19T09:06:18.279 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-19T09:06:18.279 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-f26c9d84-7662-11ef-bceb-c7b262605968@osd.4 2024-09-19T09:06:18.569 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:18 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:18.288+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.636392+0000 front 2024-09-19T09:05:49.636336+0000 (oldest deadline 2024-09-19T09:06:12.536469+0000) 2024-09-19T09:06:18.595 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 09:06:18 smithi155 systemd[1]: Stopping Ceph osd.4 for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T09:06:18.596 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:18 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:18.190+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:18.733 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:18 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T09:06:18.294+0000 7f2b62826640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.507700+0000 front 2024-09-19T09:05:49.507494+0000 (oldest deadline 2024-09-19T09:06:14.807401+0000) 2024-09-19T09:06:18.923 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 09:06:18 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-4[46282]: 2024-09-19T09:06:18.595+0000 7f64469c2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:06:18.923 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 09:06:18 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-4[46282]: 2024-09-19T09:06:18.595+0000 7f64469c2640 -1 osd.4 91 *** Got signal Terminated *** 2024-09-19T09:06:18.924 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 09:06:18 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-4[46282]: 2024-09-19T09:06:18.595+0000 7f64469c2640 -1 osd.4 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:06:19.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:18 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:18.748+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:19.232 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:18 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:18.774+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:19.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:19 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:19.171+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:19.569 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:19 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:19.251+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.636392+0000 front 2024-09-19T09:05:49.636336+0000 (oldest deadline 2024-09-19T09:06:12.536469+0000) 2024-09-19T09:06:19.732 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:19 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T09:06:19.321+0000 7f2b62826640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.507700+0000 front 2024-09-19T09:05:49.507494+0000 (oldest deadline 2024-09-19T09:06:14.807401+0000) 2024-09-19T09:06:20.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:19 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:19.758+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:20.232 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:19 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:19.787+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:20.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:20 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:20.171+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:20.569 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:20 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:20.248+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.636392+0000 front 2024-09-19T09:05:49.636336+0000 (oldest deadline 2024-09-19T09:06:12.536469+0000) 2024-09-19T09:06:20.732 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:20 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T09:06:20.300+0000 7f2b62826640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.507700+0000 front 2024-09-19T09:05:49.507494+0000 (oldest deadline 2024-09-19T09:06:14.807401+0000) 2024-09-19T09:06:21.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:20 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:20.753+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:21.232 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:20 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:20.801+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:21.569 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:21 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:21.244+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.636392+0000 front 2024-09-19T09:05:49.636336+0000 (oldest deadline 2024-09-19T09:06:12.536469+0000) 2024-09-19T09:06:21.673 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:21 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:21.212+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:21.732 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:21 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T09:06:21.254+0000 7f2b62826640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.507700+0000 front 2024-09-19T09:05:49.507494+0000 (oldest deadline 2024-09-19T09:06:14.807401+0000) 2024-09-19T09:06:21.732 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:21 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T09:06:21.254+0000 7f2b62826640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:54.807907+0000 front 2024-09-19T09:05:54.808011+0000 (oldest deadline 2024-09-19T09:06:20.707937+0000) 2024-09-19T09:06:22.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:21 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:21.727+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:22.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:21 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:21.727+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:22.232 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:21 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:21.796+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:22.233 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:21 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:21.796+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:22.423 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:22 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:22.036+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.164918+0000 front 2024-09-19T09:05:58.164858+0000 (oldest deadline 2024-09-19T09:06:21.665006+0000) 2024-09-19T09:06:22.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:22 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:22.162+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:22.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:22 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:22.162+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:22.569 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:22 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:22.241+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.636392+0000 front 2024-09-19T09:05:49.636336+0000 (oldest deadline 2024-09-19T09:06:12.536469+0000) 2024-09-19T09:06:22.732 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:22 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T09:06:22.268+0000 7f2b62826640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.507700+0000 front 2024-09-19T09:05:49.507494+0000 (oldest deadline 2024-09-19T09:06:14.807401+0000) 2024-09-19T09:06:22.732 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:22 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T09:06:22.268+0000 7f2b62826640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:54.807907+0000 front 2024-09-19T09:05:54.808011+0000 (oldest deadline 2024-09-19T09:06:20.707937+0000) 2024-09-19T09:06:23.006 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 09:06:22 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-4[46282]: 2024-09-19T09:06:22.714+0000 7f6442fd8640 -1 osd.4 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.099949+0000 front 2024-09-19T09:05:57.100037+0000 (oldest deadline 2024-09-19T09:06:21.799863+0000) 2024-09-19T09:06:23.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:22 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:22.715+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:23.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:22 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:22.715+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:23.232 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:22 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:22.770+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:23.232 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:22 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:22.770+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:23.423 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:23 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:23.005+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.164918+0000 front 2024-09-19T09:05:58.164858+0000 (oldest deadline 2024-09-19T09:06:21.665006+0000) 2024-09-19T09:06:23.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:23 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:23.169+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:23.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:23 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:23.169+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:23.569 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:23 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:23.219+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.636392+0000 front 2024-09-19T09:05:49.636336+0000 (oldest deadline 2024-09-19T09:06:12.536469+0000) 2024-09-19T09:06:23.727 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:23 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T09:06:23.273+0000 7f2b62826640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.507700+0000 front 2024-09-19T09:05:49.507494+0000 (oldest deadline 2024-09-19T09:06:14.807401+0000) 2024-09-19T09:06:23.727 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:23 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T09:06:23.273+0000 7f2b62826640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:54.807907+0000 front 2024-09-19T09:05:54.808011+0000 (oldest deadline 2024-09-19T09:06:20.707937+0000) 2024-09-19T09:06:23.728 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:23 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:23.396+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.721815+0000 front 2024-09-19T09:05:57.721787+0000 (oldest deadline 2024-09-19T09:06:23.021782+0000) 2024-09-19T09:06:23.982 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:23 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:23.727+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:23.982 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:23 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:23.727+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:24.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:23 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:23.763+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:24.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:23 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:23.763+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:24.423 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:24 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:24.046+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.164918+0000 front 2024-09-19T09:05:58.164858+0000 (oldest deadline 2024-09-19T09:06:21.665006+0000) 2024-09-19T09:06:24.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:24 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:24.149+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:24.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:24 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:24.149+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:24.424 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 09:06:24 smithi155 podman[71138]: 2024-09-19 09:06:24.107998926 +0000 UTC m=+5.630189866 container died 4a5eb9db31bf0a27367b5c318f47f3c20d6eb897068ed0e2fbaaf2e53415670b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-4, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-19T09:06:24.569 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:24 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:24.255+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.636392+0000 front 2024-09-19T09:05:49.636336+0000 (oldest deadline 2024-09-19T09:06:12.536469+0000) 2024-09-19T09:06:24.709 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:24 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T09:06:24.272+0000 7f2b62826640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.507700+0000 front 2024-09-19T09:05:49.507494+0000 (oldest deadline 2024-09-19T09:06:14.807401+0000) 2024-09-19T09:06:24.709 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:24 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T09:06:24.272+0000 7f2b62826640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:54.807907+0000 front 2024-09-19T09:05:54.808011+0000 (oldest deadline 2024-09-19T09:06:20.707937+0000) 2024-09-19T09:06:24.709 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:24 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:24.404+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.721815+0000 front 2024-09-19T09:05:57.721787+0000 (oldest deadline 2024-09-19T09:06:23.021782+0000) 2024-09-19T09:06:24.771 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 09:06:24 smithi155 podman[71138]: 2024-09-19 09:06:24.51165 +0000 UTC m=+6.033840940 container cleanup 4a5eb9db31bf0a27367b5c318f47f3c20d6eb897068ed0e2fbaaf2e53415670b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:06:24.771 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 09:06:24 smithi155 bash[71138]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-4 2024-09-19T09:06:24.982 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:24 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:24.708+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:24.982 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:24 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:24.708+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:25.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:24 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:24.763+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:25.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:24 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:24.763+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:25.087 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 09:06:24 smithi155 podman[71154]: 2024-09-19 09:06:24.771102641 +0000 UTC m=+0.664645849 container remove 4a5eb9db31bf0a27367b5c318f47f3c20d6eb897068ed0e2fbaaf2e53415670b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-09-19T09:06:25.382 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:25 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:25.086+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.164918+0000 front 2024-09-19T09:05:58.164858+0000 (oldest deadline 2024-09-19T09:06:21.665006+0000) 2024-09-19T09:06:25.383 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 09:06:25 smithi155 podman[71241]: 2024-09-19 09:06:25.026305412 +0000 UTC m=+0.015998803 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:06:25.383 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 09:06:25 smithi155 podman[71241]: 2024-09-19 09:06:25.138746231 +0000 UTC m=+0.128439608 container create 6e92662604c2f22fa1f0747ae6be66986a52295aa56668830f4ead2188aa6b75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T09:06:25.383 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:25 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:25.117+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:25.383 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:25 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:25.117+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:25.569 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:25 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:25.281+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.636392+0000 front 2024-09-19T09:05:49.636336+0000 (oldest deadline 2024-09-19T09:06:12.536469+0000) 2024-09-19T09:06:25.569 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:25 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:25.281+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.337843+0000 front 2024-09-19T09:05:58.337979+0000 (oldest deadline 2024-09-19T09:06:24.738551+0000) 2024-09-19T09:06:25.674 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 09:06:25 smithi155 podman[71241]: 2024-09-19 09:06:25.383092258 +0000 UTC m=+0.372785642 container init 6e92662604c2f22fa1f0747ae6be66986a52295aa56668830f4ead2188aa6b75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-19T09:06:25.674 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 09:06:25 smithi155 podman[71241]: 2024-09-19 09:06:25.386381522 +0000 UTC m=+0.376074897 container start 6e92662604c2f22fa1f0747ae6be66986a52295aa56668830f4ead2188aa6b75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2) 2024-09-19T09:06:25.674 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 09:06:25 smithi155 podman[71241]: 2024-09-19 09:06:25.483236319 +0000 UTC m=+0.472929695 container attach 6e92662604c2f22fa1f0747ae6be66986a52295aa56668830f4ead2188aa6b75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-4-deactivate, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:06:25.674 INFO:journalctl@ceph.osd.4.smithi155.stdout:Sep 19 09:06:25 smithi155 podman[71241]: 2024-09-19 09:06:25.573494268 +0000 UTC m=+0.563187643 container died 6e92662604c2f22fa1f0747ae6be66986a52295aa56668830f4ead2188aa6b75 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-19T09:06:25.719 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:25 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:25.427+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.721815+0000 front 2024-09-19T09:05:57.721787+0000 (oldest deadline 2024-09-19T09:06:23.021782+0000) 2024-09-19T09:06:25.720 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:25 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T09:06:25.270+0000 7f2b62826640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.507700+0000 front 2024-09-19T09:05:49.507494+0000 (oldest deadline 2024-09-19T09:06:14.807401+0000) 2024-09-19T09:06:25.720 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:25 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T09:06:25.270+0000 7f2b62826640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:54.807907+0000 front 2024-09-19T09:05:54.808011+0000 (oldest deadline 2024-09-19T09:06:20.707937+0000) 2024-09-19T09:06:25.982 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:25 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:25.719+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:25.982 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:25 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:25.719+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:26.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:25 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:25.747+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:26.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:25 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:25.747+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:26.258 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:26 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:26.119+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.164918+0000 front 2024-09-19T09:05:58.164858+0000 (oldest deadline 2024-09-19T09:06:21.665006+0000) 2024-09-19T09:06:26.258 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:26 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:26.087+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:26.258 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:26 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:26.087+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:26.286 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@osd.4.service' 2024-09-19T09:06:26.328 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:06:26.328 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-19T09:06:26.329 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-19T09:06:26.329 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-f26c9d84-7662-11ef-bceb-c7b262605968@osd.5 2024-09-19T09:06:26.569 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:26 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:26.315+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.636392+0000 front 2024-09-19T09:05:49.636336+0000 (oldest deadline 2024-09-19T09:06:12.536469+0000) 2024-09-19T09:06:26.569 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:26 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:26.315+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.337843+0000 front 2024-09-19T09:05:58.337979+0000 (oldest deadline 2024-09-19T09:06:24.738551+0000) 2024-09-19T09:06:26.647 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:26 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:26.463+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.721815+0000 front 2024-09-19T09:05:57.721787+0000 (oldest deadline 2024-09-19T09:06:23.021782+0000) 2024-09-19T09:06:26.648 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:26 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T09:06:26.312+0000 7f2b62826640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.507700+0000 front 2024-09-19T09:05:49.507494+0000 (oldest deadline 2024-09-19T09:06:14.807401+0000) 2024-09-19T09:06:26.648 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:26 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T09:06:26.312+0000 7f2b62826640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:54.807907+0000 front 2024-09-19T09:05:54.808011+0000 (oldest deadline 2024-09-19T09:06:20.707937+0000) 2024-09-19T09:06:26.648 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:26 smithi203 systemd[1]: Stopping Ceph osd.5 for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T09:06:26.648 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:26 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T09:06:26.646+0000 7f2b6a218640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:06:26.982 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:26 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T09:06:26.646+0000 7f2b6a218640 -1 osd.5 91 *** Got signal Terminated *** 2024-09-19T09:06:26.982 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:26 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T09:06:26.646+0000 7f2b6a218640 -1 osd.5 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:06:26.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:26 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:26.768+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:26.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:26 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:26.768+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:27.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:26 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:26.734+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:27.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:26 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:26.734+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:27.423 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:27 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:27.092+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.164918+0000 front 2024-09-19T09:05:58.164858+0000 (oldest deadline 2024-09-19T09:06:21.665006+0000) 2024-09-19T09:06:27.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:27 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:27.135+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:27.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:27 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:27.135+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:27.569 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:27 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:27.271+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.636392+0000 front 2024-09-19T09:05:49.636336+0000 (oldest deadline 2024-09-19T09:06:12.536469+0000) 2024-09-19T09:06:27.569 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:27 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:27.271+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.337843+0000 front 2024-09-19T09:05:58.337979+0000 (oldest deadline 2024-09-19T09:06:24.738551+0000) 2024-09-19T09:06:27.732 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:27 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:27.462+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.721815+0000 front 2024-09-19T09:05:57.721787+0000 (oldest deadline 2024-09-19T09:06:23.021782+0000) 2024-09-19T09:06:27.732 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:27 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T09:06:27.300+0000 7f2b62826640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.507700+0000 front 2024-09-19T09:05:49.507494+0000 (oldest deadline 2024-09-19T09:06:14.807401+0000) 2024-09-19T09:06:27.733 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:27 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T09:06:27.300+0000 7f2b62826640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:54.807907+0000 front 2024-09-19T09:05:54.808011+0000 (oldest deadline 2024-09-19T09:06:20.707937+0000) 2024-09-19T09:06:28.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:27 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:27.782+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:28.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:27 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:27.782+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:28.232 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:27 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:27.750+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:28.232 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:27 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:27.750+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:28.423 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:28 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:28.067+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.164918+0000 front 2024-09-19T09:05:58.164858+0000 (oldest deadline 2024-09-19T09:06:21.665006+0000) 2024-09-19T09:06:28.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:28 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:28.140+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:28.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:28 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:28.140+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:28.569 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:28 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:28.260+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.636392+0000 front 2024-09-19T09:05:49.636336+0000 (oldest deadline 2024-09-19T09:06:12.536469+0000) 2024-09-19T09:06:28.569 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:28 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:28.260+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.337843+0000 front 2024-09-19T09:05:58.337979+0000 (oldest deadline 2024-09-19T09:06:24.738551+0000) 2024-09-19T09:06:28.732 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:28 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:28.511+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.721815+0000 front 2024-09-19T09:05:57.721787+0000 (oldest deadline 2024-09-19T09:06:23.021782+0000) 2024-09-19T09:06:28.732 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:28 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T09:06:28.289+0000 7f2b62826640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.507700+0000 front 2024-09-19T09:05:49.507494+0000 (oldest deadline 2024-09-19T09:06:14.807401+0000) 2024-09-19T09:06:28.733 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:28 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T09:06:28.289+0000 7f2b62826640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:54.807907+0000 front 2024-09-19T09:05:54.808011+0000 (oldest deadline 2024-09-19T09:06:20.707937+0000) 2024-09-19T09:06:28.733 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:28 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T09:06:28.289+0000 7f2b62826640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:01.808938+0000 front 2024-09-19T09:06:01.808968+0000 (oldest deadline 2024-09-19T09:06:28.209658+0000) 2024-09-19T09:06:29.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:28 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:28.802+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:29.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:28 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:28.802+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:29.232 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:28 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:28.780+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:29.232 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:28 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:28.780+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:29.423 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:29 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:29.059+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.164918+0000 front 2024-09-19T09:05:58.164858+0000 (oldest deadline 2024-09-19T09:06:21.665006+0000) 2024-09-19T09:06:29.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:29 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:29.181+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:29.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:29 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:29.181+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:29.569 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:29 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:29.282+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.636392+0000 front 2024-09-19T09:05:49.636336+0000 (oldest deadline 2024-09-19T09:06:12.536469+0000) 2024-09-19T09:06:29.569 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:29 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:29.282+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.337843+0000 front 2024-09-19T09:05:58.337979+0000 (oldest deadline 2024-09-19T09:06:24.738551+0000) 2024-09-19T09:06:29.732 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:29 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:29.537+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.721815+0000 front 2024-09-19T09:05:57.721787+0000 (oldest deadline 2024-09-19T09:06:23.021782+0000) 2024-09-19T09:06:29.732 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:29 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T09:06:29.296+0000 7f2b62826640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.507700+0000 front 2024-09-19T09:05:49.507494+0000 (oldest deadline 2024-09-19T09:06:14.807401+0000) 2024-09-19T09:06:29.732 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:29 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T09:06:29.296+0000 7f2b62826640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:54.807907+0000 front 2024-09-19T09:05:54.808011+0000 (oldest deadline 2024-09-19T09:06:20.707937+0000) 2024-09-19T09:06:29.733 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:29 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T09:06:29.296+0000 7f2b62826640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:01.808938+0000 front 2024-09-19T09:06:01.808968+0000 (oldest deadline 2024-09-19T09:06:28.209658+0000) 2024-09-19T09:06:30.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:29 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:29.807+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:30.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:29 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:29.807+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:30.232 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:29 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:29.742+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:30.232 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:29 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:29.742+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:30.423 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:30 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:30.060+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.164918+0000 front 2024-09-19T09:05:58.164858+0000 (oldest deadline 2024-09-19T09:06:21.665006+0000) 2024-09-19T09:06:30.423 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:30 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:30.060+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.965905+0000 front 2024-09-19T09:06:06.965869+0000 (oldest deadline 2024-09-19T09:06:29.265999+0000) 2024-09-19T09:06:30.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:30 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:30.147+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:30.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:30 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:30.147+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:30.717 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:30 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:30.488+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.721815+0000 front 2024-09-19T09:05:57.721787+0000 (oldest deadline 2024-09-19T09:06:23.021782+0000) 2024-09-19T09:06:30.718 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:30 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T09:06:30.318+0000 7f2b62826640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.507700+0000 front 2024-09-19T09:05:49.507494+0000 (oldest deadline 2024-09-19T09:06:14.807401+0000) 2024-09-19T09:06:30.718 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:30 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T09:06:30.318+0000 7f2b62826640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:54.807907+0000 front 2024-09-19T09:05:54.808011+0000 (oldest deadline 2024-09-19T09:06:20.707937+0000) 2024-09-19T09:06:30.718 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:30 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T09:06:30.318+0000 7f2b62826640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:01.808938+0000 front 2024-09-19T09:06:01.808968+0000 (oldest deadline 2024-09-19T09:06:28.209658+0000) 2024-09-19T09:06:30.819 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:30 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:30.322+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.636392+0000 front 2024-09-19T09:05:49.636336+0000 (oldest deadline 2024-09-19T09:06:12.536469+0000) 2024-09-19T09:06:30.819 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:30 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:30.322+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.337843+0000 front 2024-09-19T09:05:58.337979+0000 (oldest deadline 2024-09-19T09:06:24.738551+0000) 2024-09-19T09:06:30.982 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:30 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:30.717+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:30.982 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:30 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:30.717+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:31.319 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:30 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:30.852+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:31.319 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:30 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:30.852+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:31.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:31 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:31.194+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:31.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:31 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:31.194+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:31.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:31 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:31.194+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:06:31.424 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:31 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:31.110+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.164918+0000 front 2024-09-19T09:05:58.164858+0000 (oldest deadline 2024-09-19T09:06:21.665006+0000) 2024-09-19T09:06:31.424 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:31 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:31.110+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.965905+0000 front 2024-09-19T09:06:06.965869+0000 (oldest deadline 2024-09-19T09:06:29.265999+0000) 2024-09-19T09:06:31.732 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:31 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:31.505+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.721815+0000 front 2024-09-19T09:05:57.721787+0000 (oldest deadline 2024-09-19T09:06:23.021782+0000) 2024-09-19T09:06:31.732 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:31 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:31.505+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:03.022116+0000 front 2024-09-19T09:06:03.022187+0000 (oldest deadline 2024-09-19T09:06:30.622946+0000) 2024-09-19T09:06:31.733 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:31 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T09:06:31.363+0000 7f2b62826640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.507700+0000 front 2024-09-19T09:05:49.507494+0000 (oldest deadline 2024-09-19T09:06:14.807401+0000) 2024-09-19T09:06:31.733 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:31 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T09:06:31.363+0000 7f2b62826640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:54.807907+0000 front 2024-09-19T09:05:54.808011+0000 (oldest deadline 2024-09-19T09:06:20.707937+0000) 2024-09-19T09:06:31.733 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:31 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5[47287]: 2024-09-19T09:06:31.363+0000 7f2b62826640 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:01.808938+0000 front 2024-09-19T09:06:01.808968+0000 (oldest deadline 2024-09-19T09:06:28.209658+0000) 2024-09-19T09:06:31.819 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:31 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:31.349+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.636392+0000 front 2024-09-19T09:05:49.636336+0000 (oldest deadline 2024-09-19T09:06:12.536469+0000) 2024-09-19T09:06:31.819 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:31 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:31.349+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.337843+0000 front 2024-09-19T09:05:58.337979+0000 (oldest deadline 2024-09-19T09:06:24.738551+0000) 2024-09-19T09:06:32.194 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:31 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:31.752+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:32.194 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:31 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:31.752+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:32.195 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:31 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:31.752+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:06:32.319 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:31 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:31.862+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:32.319 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:31 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:31.862+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:32.341 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:32 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:32.069+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.164918+0000 front 2024-09-19T09:05:58.164858+0000 (oldest deadline 2024-09-19T09:06:21.665006+0000) 2024-09-19T09:06:32.342 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:32 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:32.069+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.965905+0000 front 2024-09-19T09:06:06.965869+0000 (oldest deadline 2024-09-19T09:06:29.265999+0000) 2024-09-19T09:06:32.342 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:32 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:32.187+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:32.342 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:32 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:32.187+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:32.342 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:32 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:32.187+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:06:32.482 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:32 smithi203 podman[71078]: 2024-09-19 09:06:32.194764605 +0000 UTC m=+5.666886292 container died fe22e1985f0ea8839d12eedbe190a12e2de14342e90dcbb080eec6200412095e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-19T09:06:32.755 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:32 smithi203 podman[71078]: 2024-09-19 09:06:32.580858917 +0000 UTC m=+6.052980581 container cleanup fe22e1985f0ea8839d12eedbe190a12e2de14342e90dcbb080eec6200412095e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-19T09:06:32.755 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:32 smithi203 bash[71078]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5 2024-09-19T09:06:32.756 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:32 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:32.544+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.721815+0000 front 2024-09-19T09:05:57.721787+0000 (oldest deadline 2024-09-19T09:06:23.021782+0000) 2024-09-19T09:06:32.756 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:32 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:32.544+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:03.022116+0000 front 2024-09-19T09:06:03.022187+0000 (oldest deadline 2024-09-19T09:06:30.622946+0000) 2024-09-19T09:06:32.819 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:32 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:32.364+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.636392+0000 front 2024-09-19T09:05:49.636336+0000 (oldest deadline 2024-09-19T09:06:12.536469+0000) 2024-09-19T09:06:32.819 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:32 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:32.364+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.337843+0000 front 2024-09-19T09:05:58.337979+0000 (oldest deadline 2024-09-19T09:06:24.738551+0000) 2024-09-19T09:06:32.819 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:32 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:32.364+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:05.840012+0000 front 2024-09-19T09:06:05.839858+0000 (oldest deadline 2024-09-19T09:06:31.739819+0000) 2024-09-19T09:06:33.191 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:32 smithi203 podman[71096]: 2024-09-19 09:06:32.832808983 +0000 UTC m=+0.632522708 container remove fe22e1985f0ea8839d12eedbe190a12e2de14342e90dcbb080eec6200412095e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-19T09:06:33.192 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:32 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:32.755+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:33.192 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:32 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:32.755+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:33.192 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:32 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:32.755+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:06:33.319 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:32 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:32.894+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:33.319 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:32 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:32.894+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:33.319 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:32 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:32.894+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.447536+0000 front 2024-09-19T09:06:06.447621+0000 (oldest deadline 2024-09-19T09:06:32.347547+0000) 2024-09-19T09:06:33.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:33 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:33.151+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:33.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:33 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:33.151+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:33.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:33 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:33.151+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:06:33.424 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:33 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:33.086+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.164918+0000 front 2024-09-19T09:05:58.164858+0000 (oldest deadline 2024-09-19T09:06:21.665006+0000) 2024-09-19T09:06:33.424 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:33 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:33.086+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.965905+0000 front 2024-09-19T09:06:06.965869+0000 (oldest deadline 2024-09-19T09:06:29.265999+0000) 2024-09-19T09:06:33.482 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:33 smithi203 podman[71183]: 2024-09-19 09:06:33.094366844 +0000 UTC m=+0.015652719 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:06:33.483 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:33 smithi203 podman[71183]: 2024-09-19 09:06:33.191919094 +0000 UTC m=+0.113204961 container create 88c8f801fcfdfb315600e39d6f1baea75d7b368632fae3e825f6024a04b99651 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-19T09:06:33.483 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:33 smithi203 podman[71183]: 2024-09-19 09:06:33.4029263 +0000 UTC m=+0.324212167 container init 88c8f801fcfdfb315600e39d6f1baea75d7b368632fae3e825f6024a04b99651 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-19T09:06:33.483 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:33 smithi203 podman[71183]: 2024-09-19 09:06:33.40645321 +0000 UTC m=+0.327739077 container start 88c8f801fcfdfb315600e39d6f1baea75d7b368632fae3e825f6024a04b99651 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:06:33.819 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:33 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:33.379+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.636392+0000 front 2024-09-19T09:05:49.636336+0000 (oldest deadline 2024-09-19T09:06:12.536469+0000) 2024-09-19T09:06:33.819 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:33 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:33.379+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.337843+0000 front 2024-09-19T09:05:58.337979+0000 (oldest deadline 2024-09-19T09:06:24.738551+0000) 2024-09-19T09:06:33.819 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:33 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:33.379+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:05.840012+0000 front 2024-09-19T09:06:05.839858+0000 (oldest deadline 2024-09-19T09:06:31.739819+0000) 2024-09-19T09:06:33.915 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:33 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:33.568+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.721815+0000 front 2024-09-19T09:05:57.721787+0000 (oldest deadline 2024-09-19T09:06:23.021782+0000) 2024-09-19T09:06:33.915 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:33 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:33.568+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:03.022116+0000 front 2024-09-19T09:06:03.022187+0000 (oldest deadline 2024-09-19T09:06:30.622946+0000) 2024-09-19T09:06:33.916 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:33 smithi203 podman[71183]: 2024-09-19 09:06:33.511592608 +0000 UTC m=+0.432878480 container attach 88c8f801fcfdfb315600e39d6f1baea75d7b368632fae3e825f6024a04b99651 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T09:06:33.916 INFO:journalctl@ceph.osd.5.smithi203.stdout:Sep 19 09:06:33 smithi203 podman[71183]: 2024-09-19 09:06:33.600120057 +0000 UTC m=+0.521405924 container died 88c8f801fcfdfb315600e39d6f1baea75d7b368632fae3e825f6024a04b99651 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True) 2024-09-19T09:06:33.916 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:33 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:33.720+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:33.916 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:33 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:33.720+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:33.916 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:33 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:33.720+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:06:34.233 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@osd.5.service' 2024-09-19T09:06:34.274 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:06:34.274 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-19T09:06:34.274 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-19T09:06:34.275 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ceph-f26c9d84-7662-11ef-bceb-c7b262605968@osd.6 2024-09-19T09:06:34.303 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:33 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:33.918+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:34.303 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:33 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:33.918+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:34.303 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:33 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:33.918+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.447536+0000 front 2024-09-19T09:06:06.447621+0000 (oldest deadline 2024-09-19T09:06:32.347547+0000) 2024-09-19T09:06:34.423 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:34 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:34.038+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.164918+0000 front 2024-09-19T09:05:58.164858+0000 (oldest deadline 2024-09-19T09:06:21.665006+0000) 2024-09-19T09:06:34.423 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:34 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:34.038+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.965905+0000 front 2024-09-19T09:06:06.965869+0000 (oldest deadline 2024-09-19T09:06:29.265999+0000) 2024-09-19T09:06:34.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:34 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:34.197+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:34.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:34 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:34.197+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:34.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:34 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:34.197+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:06:34.569 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:34 smithi019 systemd[1]: Stopping Ceph osd.6 for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T09:06:34.569 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:34 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:34.370+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.636392+0000 front 2024-09-19T09:05:49.636336+0000 (oldest deadline 2024-09-19T09:06:12.536469+0000) 2024-09-19T09:06:34.569 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:34 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:34.370+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.337843+0000 front 2024-09-19T09:05:58.337979+0000 (oldest deadline 2024-09-19T09:06:24.738551+0000) 2024-09-19T09:06:34.570 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:34 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:34.370+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:05.840012+0000 front 2024-09-19T09:06:05.839858+0000 (oldest deadline 2024-09-19T09:06:31.739819+0000) 2024-09-19T09:06:34.883 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:34 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:34.601+0000 7f7dfd5c9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:06:34.883 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:34 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:34.601+0000 7f7dfd5c9640 -1 osd.6 91 *** Got signal Terminated *** 2024-09-19T09:06:34.883 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:34 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:34.601+0000 7f7dfd5c9640 -1 osd.6 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:06:34.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:34 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:34.602+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.721815+0000 front 2024-09-19T09:05:57.721787+0000 (oldest deadline 2024-09-19T09:06:23.021782+0000) 2024-09-19T09:06:34.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:34 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:34.602+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:03.022116+0000 front 2024-09-19T09:06:03.022187+0000 (oldest deadline 2024-09-19T09:06:30.622946+0000) 2024-09-19T09:06:34.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:34 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:34.683+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:34.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:34 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:34.683+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:34.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:34 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:34.683+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:06:35.319 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:34 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:34.882+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:35.319 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:34 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:34.882+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:35.319 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:34 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:34.882+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.447536+0000 front 2024-09-19T09:06:06.447621+0000 (oldest deadline 2024-09-19T09:06:32.347547+0000) 2024-09-19T09:06:35.423 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:35 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:35.055+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.164918+0000 front 2024-09-19T09:05:58.164858+0000 (oldest deadline 2024-09-19T09:06:21.665006+0000) 2024-09-19T09:06:35.423 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:35 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:35.055+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.965905+0000 front 2024-09-19T09:06:06.965869+0000 (oldest deadline 2024-09-19T09:06:29.265999+0000) 2024-09-19T09:06:35.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:35 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:35.160+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:35.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:35 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:35.160+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:35.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:35 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:35.160+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:06:35.819 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:35 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:35.353+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.636392+0000 front 2024-09-19T09:05:49.636336+0000 (oldest deadline 2024-09-19T09:06:12.536469+0000) 2024-09-19T09:06:35.819 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:35 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:35.353+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.337843+0000 front 2024-09-19T09:05:58.337979+0000 (oldest deadline 2024-09-19T09:06:24.738551+0000) 2024-09-19T09:06:35.819 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:35 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:35.353+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:05.840012+0000 front 2024-09-19T09:06:05.839858+0000 (oldest deadline 2024-09-19T09:06:31.739819+0000) 2024-09-19T09:06:35.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:35 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:35.564+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.721815+0000 front 2024-09-19T09:05:57.721787+0000 (oldest deadline 2024-09-19T09:06:23.021782+0000) 2024-09-19T09:06:35.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:35 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:35.564+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:03.022116+0000 front 2024-09-19T09:06:03.022187+0000 (oldest deadline 2024-09-19T09:06:30.622946+0000) 2024-09-19T09:06:35.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:35 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:35.698+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:35.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:35 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:35.698+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:35.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:35 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:35.698+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:06:36.319 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:35 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:35.898+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:36.319 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:35 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:35.898+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:36.320 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:35 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:35.898+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.447536+0000 front 2024-09-19T09:06:06.447621+0000 (oldest deadline 2024-09-19T09:06:32.347547+0000) 2024-09-19T09:06:36.320 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:35 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:35.898+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.348020+0000 front 2024-09-19T09:06:12.348057+0000 (oldest deadline 2024-09-19T09:06:35.848012+0000) 2024-09-19T09:06:36.423 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:36 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:36.047+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.164918+0000 front 2024-09-19T09:05:58.164858+0000 (oldest deadline 2024-09-19T09:06:21.665006+0000) 2024-09-19T09:06:36.423 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:36 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:36.047+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.965905+0000 front 2024-09-19T09:06:06.965869+0000 (oldest deadline 2024-09-19T09:06:29.265999+0000) 2024-09-19T09:06:36.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:36 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:36.171+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:36.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:36 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:36.171+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:36.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:36 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:36.171+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:06:36.819 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:36 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:36.394+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.636392+0000 front 2024-09-19T09:05:49.636336+0000 (oldest deadline 2024-09-19T09:06:12.536469+0000) 2024-09-19T09:06:36.819 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:36 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:36.394+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.337843+0000 front 2024-09-19T09:05:58.337979+0000 (oldest deadline 2024-09-19T09:06:24.738551+0000) 2024-09-19T09:06:36.819 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:36 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:36.394+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:05.840012+0000 front 2024-09-19T09:06:05.839858+0000 (oldest deadline 2024-09-19T09:06:31.739819+0000) 2024-09-19T09:06:36.819 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:36 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:36.394+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.740059+0000 front 2024-09-19T09:06:11.740078+0000 (oldest deadline 2024-09-19T09:06:35.840212+0000) 2024-09-19T09:06:36.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:36 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:36.612+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.721815+0000 front 2024-09-19T09:05:57.721787+0000 (oldest deadline 2024-09-19T09:06:23.021782+0000) 2024-09-19T09:06:36.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:36 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:36.612+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:03.022116+0000 front 2024-09-19T09:06:03.022187+0000 (oldest deadline 2024-09-19T09:06:30.622946+0000) 2024-09-19T09:06:36.982 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:36 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:36.698+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:36.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:36 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:36.698+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:36.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:36 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:36.698+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:06:37.319 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:36 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:36.861+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:37.319 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:36 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:36.861+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:37.319 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:36 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:36.861+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.447536+0000 front 2024-09-19T09:06:06.447621+0000 (oldest deadline 2024-09-19T09:06:32.347547+0000) 2024-09-19T09:06:37.319 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:36 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:36.861+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.348020+0000 front 2024-09-19T09:06:12.348057+0000 (oldest deadline 2024-09-19T09:06:35.848012+0000) 2024-09-19T09:06:37.423 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:37 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:37.039+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.164918+0000 front 2024-09-19T09:05:58.164858+0000 (oldest deadline 2024-09-19T09:06:21.665006+0000) 2024-09-19T09:06:37.423 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:37 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:37.039+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.965905+0000 front 2024-09-19T09:06:06.965869+0000 (oldest deadline 2024-09-19T09:06:29.265999+0000) 2024-09-19T09:06:37.424 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:37 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:37.039+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.767006+0000 front 2024-09-19T09:06:12.767130+0000 (oldest deadline 2024-09-19T09:06:36.767570+0000) 2024-09-19T09:06:37.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:37 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:37.155+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:37.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:37 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:37.155+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:37.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:37 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:37.155+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:06:37.819 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:37 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:37.376+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.636392+0000 front 2024-09-19T09:05:49.636336+0000 (oldest deadline 2024-09-19T09:06:12.536469+0000) 2024-09-19T09:06:37.819 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:37 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:37.376+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.337843+0000 front 2024-09-19T09:05:58.337979+0000 (oldest deadline 2024-09-19T09:06:24.738551+0000) 2024-09-19T09:06:37.819 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:37 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:37.376+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:05.840012+0000 front 2024-09-19T09:06:05.839858+0000 (oldest deadline 2024-09-19T09:06:31.739819+0000) 2024-09-19T09:06:37.819 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:37 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:37.376+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.740059+0000 front 2024-09-19T09:06:11.740078+0000 (oldest deadline 2024-09-19T09:06:35.840212+0000) 2024-09-19T09:06:37.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:37 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:37.571+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.721815+0000 front 2024-09-19T09:05:57.721787+0000 (oldest deadline 2024-09-19T09:06:23.021782+0000) 2024-09-19T09:06:37.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:37 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:37.571+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:03.022116+0000 front 2024-09-19T09:06:03.022187+0000 (oldest deadline 2024-09-19T09:06:30.622946+0000) 2024-09-19T09:06:37.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:37 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:37.571+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.724056+0000 front 2024-09-19T09:06:11.724093+0000 (oldest deadline 2024-09-19T09:06:37.024205+0000) 2024-09-19T09:06:37.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:37 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:37.692+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:37.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:37 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:37.692+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:37.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:37 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:37.692+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:06:38.319 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:37 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:37.873+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:38.319 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:37 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:37.873+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:38.319 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:37 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:37.873+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.447536+0000 front 2024-09-19T09:06:06.447621+0000 (oldest deadline 2024-09-19T09:06:32.347547+0000) 2024-09-19T09:06:38.320 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:37 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:37.873+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.348020+0000 front 2024-09-19T09:06:12.348057+0000 (oldest deadline 2024-09-19T09:06:35.848012+0000) 2024-09-19T09:06:38.423 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:38 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:38.088+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.164918+0000 front 2024-09-19T09:05:58.164858+0000 (oldest deadline 2024-09-19T09:06:21.665006+0000) 2024-09-19T09:06:38.424 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:38 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:38.088+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.965905+0000 front 2024-09-19T09:06:06.965869+0000 (oldest deadline 2024-09-19T09:06:29.265999+0000) 2024-09-19T09:06:38.424 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:38 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:38.088+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.767006+0000 front 2024-09-19T09:06:12.767130+0000 (oldest deadline 2024-09-19T09:06:36.767570+0000) 2024-09-19T09:06:38.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:38 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:38.203+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:38.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:38 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:38.203+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:38.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:38 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:38.203+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:06:38.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:38 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:38.203+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.303831+0000 front 2024-09-19T09:06:11.304084+0000 (oldest deadline 2024-09-19T09:06:37.203943+0000) 2024-09-19T09:06:38.819 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:38 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:38.327+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.636392+0000 front 2024-09-19T09:05:49.636336+0000 (oldest deadline 2024-09-19T09:06:12.536469+0000) 2024-09-19T09:06:38.819 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:38 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:38.327+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.337843+0000 front 2024-09-19T09:05:58.337979+0000 (oldest deadline 2024-09-19T09:06:24.738551+0000) 2024-09-19T09:06:38.819 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:38 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:38.327+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:05.840012+0000 front 2024-09-19T09:06:05.839858+0000 (oldest deadline 2024-09-19T09:06:31.739819+0000) 2024-09-19T09:06:38.820 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:38 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:38.327+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.740059+0000 front 2024-09-19T09:06:11.740078+0000 (oldest deadline 2024-09-19T09:06:35.840212+0000) 2024-09-19T09:06:38.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:38 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:38.547+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.721815+0000 front 2024-09-19T09:05:57.721787+0000 (oldest deadline 2024-09-19T09:06:23.021782+0000) 2024-09-19T09:06:38.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:38 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:38.547+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:03.022116+0000 front 2024-09-19T09:06:03.022187+0000 (oldest deadline 2024-09-19T09:06:30.622946+0000) 2024-09-19T09:06:38.983 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:38 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:38.547+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.724056+0000 front 2024-09-19T09:06:11.724093+0000 (oldest deadline 2024-09-19T09:06:37.024205+0000) 2024-09-19T09:06:38.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:38 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:38.649+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:38.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:38 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:38.649+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:38.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:38 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:38.649+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:06:38.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:38 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:38.649+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:06:39.319 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:38 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:38.828+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:39.319 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:38 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:38.828+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:39.319 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:38 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:38.828+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.447536+0000 front 2024-09-19T09:06:06.447621+0000 (oldest deadline 2024-09-19T09:06:32.347547+0000) 2024-09-19T09:06:39.319 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:38 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:38.828+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.348020+0000 front 2024-09-19T09:06:12.348057+0000 (oldest deadline 2024-09-19T09:06:35.848012+0000) 2024-09-19T09:06:39.423 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:39 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:39.067+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.164918+0000 front 2024-09-19T09:05:58.164858+0000 (oldest deadline 2024-09-19T09:06:21.665006+0000) 2024-09-19T09:06:39.423 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:39 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:39.067+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.965905+0000 front 2024-09-19T09:06:06.965869+0000 (oldest deadline 2024-09-19T09:06:29.265999+0000) 2024-09-19T09:06:39.424 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:39 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:39.067+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.767006+0000 front 2024-09-19T09:06:12.767130+0000 (oldest deadline 2024-09-19T09:06:36.767570+0000) 2024-09-19T09:06:39.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:39 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:39.222+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:39.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:39 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:39.222+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:39.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:39 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:39.222+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:06:39.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:39 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:39.222+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.303831+0000 front 2024-09-19T09:06:11.304084+0000 (oldest deadline 2024-09-19T09:06:37.203943+0000) 2024-09-19T09:06:39.783 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:39 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:39.327+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:49.636392+0000 front 2024-09-19T09:05:49.636336+0000 (oldest deadline 2024-09-19T09:06:12.536469+0000) 2024-09-19T09:06:39.783 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:39 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:39.327+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.337843+0000 front 2024-09-19T09:05:58.337979+0000 (oldest deadline 2024-09-19T09:06:24.738551+0000) 2024-09-19T09:06:39.783 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:39 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:39.327+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:05.840012+0000 front 2024-09-19T09:06:05.839858+0000 (oldest deadline 2024-09-19T09:06:31.739819+0000) 2024-09-19T09:06:39.783 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:39 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6[58222]: 2024-09-19T09:06:39.327+0000 7f7df9bdf640 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.740059+0000 front 2024-09-19T09:06:11.740078+0000 (oldest deadline 2024-09-19T09:06:35.840212+0000) 2024-09-19T09:06:39.884 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:39 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:39.544+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.721815+0000 front 2024-09-19T09:05:57.721787+0000 (oldest deadline 2024-09-19T09:06:23.021782+0000) 2024-09-19T09:06:39.884 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:39 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:39.544+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:03.022116+0000 front 2024-09-19T09:06:03.022187+0000 (oldest deadline 2024-09-19T09:06:30.622946+0000) 2024-09-19T09:06:39.884 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:39 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:39.544+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.724056+0000 front 2024-09-19T09:06:11.724093+0000 (oldest deadline 2024-09-19T09:06:37.024205+0000) 2024-09-19T09:06:39.884 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:39 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:39.631+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:39.885 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:39 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:39.631+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:39.885 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:39 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:39.631+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:06:39.885 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:39 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:39.631+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:06:40.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:39 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:39.782+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:40.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:39 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:39.782+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:40.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:39 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:39.782+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.447536+0000 front 2024-09-19T09:06:06.447621+0000 (oldest deadline 2024-09-19T09:06:32.347547+0000) 2024-09-19T09:06:40.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:39 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:39.782+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.348020+0000 front 2024-09-19T09:06:12.348057+0000 (oldest deadline 2024-09-19T09:06:35.848012+0000) 2024-09-19T09:06:40.423 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:40 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:40.085+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.164918+0000 front 2024-09-19T09:05:58.164858+0000 (oldest deadline 2024-09-19T09:06:21.665006+0000) 2024-09-19T09:06:40.423 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:40 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:40.085+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.965905+0000 front 2024-09-19T09:06:06.965869+0000 (oldest deadline 2024-09-19T09:06:29.265999+0000) 2024-09-19T09:06:40.424 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:40 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:40.085+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.767006+0000 front 2024-09-19T09:06:12.767130+0000 (oldest deadline 2024-09-19T09:06:36.767570+0000) 2024-09-19T09:06:40.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:40 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:40.186+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:40.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:40 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:40.186+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:40.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:40 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:40.186+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:06:40.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:40 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:40.186+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.303831+0000 front 2024-09-19T09:06:11.304084+0000 (oldest deadline 2024-09-19T09:06:37.203943+0000) 2024-09-19T09:06:40.436 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:40 smithi019 podman[217504]: 2024-09-19 09:06:40.112156903 +0000 UTC m=+5.632905695 container died 1944c2d51f1eb811007a5952b6b687226f460ba799edf9454f949118378287a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True) 2024-09-19T09:06:40.819 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:40 smithi019 podman[217504]: 2024-09-19 09:06:40.635859026 +0000 UTC m=+6.156607851 container cleanup 1944c2d51f1eb811007a5952b6b687226f460ba799edf9454f949118378287a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-19T09:06:40.819 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:40 smithi019 bash[217504]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6 2024-09-19T09:06:40.899 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:40 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:40.587+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.721815+0000 front 2024-09-19T09:05:57.721787+0000 (oldest deadline 2024-09-19T09:06:23.021782+0000) 2024-09-19T09:06:40.899 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:40 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:40.587+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:03.022116+0000 front 2024-09-19T09:06:03.022187+0000 (oldest deadline 2024-09-19T09:06:30.622946+0000) 2024-09-19T09:06:40.900 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:40 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:40.587+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.724056+0000 front 2024-09-19T09:06:11.724093+0000 (oldest deadline 2024-09-19T09:06:37.024205+0000) 2024-09-19T09:06:40.900 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:40 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:40.672+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:40.900 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:40 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:40.672+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:40.900 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:40 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:40.672+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:06:40.900 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:40 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:40.672+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:06:41.319 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:40 smithi019 podman[217522]: 2024-09-19 09:06:40.920953756 +0000 UTC m=+0.804444473 container remove 1944c2d51f1eb811007a5952b6b687226f460ba799edf9454f949118378287a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-19T09:06:41.319 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:40 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:40.823+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:41.319 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:40 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:40.823+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:41.319 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:40 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:40.823+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.447536+0000 front 2024-09-19T09:06:06.447621+0000 (oldest deadline 2024-09-19T09:06:32.347547+0000) 2024-09-19T09:06:41.320 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:40 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:40.823+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.348020+0000 front 2024-09-19T09:06:12.348057+0000 (oldest deadline 2024-09-19T09:06:35.848012+0000) 2024-09-19T09:06:41.423 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:41 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:41.095+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.164918+0000 front 2024-09-19T09:05:58.164858+0000 (oldest deadline 2024-09-19T09:06:21.665006+0000) 2024-09-19T09:06:41.424 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:41 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:41.095+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.965905+0000 front 2024-09-19T09:06:06.965869+0000 (oldest deadline 2024-09-19T09:06:29.265999+0000) 2024-09-19T09:06:41.424 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:41 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:41.095+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.767006+0000 front 2024-09-19T09:06:12.767130+0000 (oldest deadline 2024-09-19T09:06:36.767570+0000) 2024-09-19T09:06:41.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:41 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:41.168+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:41.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:41 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:41.168+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:41.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:41 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:41.168+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:06:41.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:41 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:41.168+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.303831+0000 front 2024-09-19T09:06:11.304084+0000 (oldest deadline 2024-09-19T09:06:37.203943+0000) 2024-09-19T09:06:41.632 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:41 smithi019 podman[217612]: 2024-09-19 09:06:41.27012219 +0000 UTC m=+0.016484216 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:06:41.633 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:41 smithi019 podman[217612]: 2024-09-19 09:06:41.396761507 +0000 UTC m=+0.143123532 container create 99468e3d1b978b7f7f55e76c64c56194ddadf011560b172def4425ce77ad53eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-19T09:06:41.633 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:41 smithi019 podman[217612]: 2024-09-19 09:06:41.632919999 +0000 UTC m=+0.379282034 container init 99468e3d1b978b7f7f55e76c64c56194ddadf011560b172def4425ce77ad53eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-19T09:06:41.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:41 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:41.631+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.721815+0000 front 2024-09-19T09:05:57.721787+0000 (oldest deadline 2024-09-19T09:06:23.021782+0000) 2024-09-19T09:06:41.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:41 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:41.631+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:03.022116+0000 front 2024-09-19T09:06:03.022187+0000 (oldest deadline 2024-09-19T09:06:30.622946+0000) 2024-09-19T09:06:41.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:41 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:41.631+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.724056+0000 front 2024-09-19T09:06:11.724093+0000 (oldest deadline 2024-09-19T09:06:37.024205+0000) 2024-09-19T09:06:41.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:41 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:41.623+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:41.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:41 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:41.623+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:41.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:41 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:41.623+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:06:41.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:41 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:41.623+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:06:42.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:41 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:41.837+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:42.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:41 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:41.837+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:42.070 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:41 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:41.837+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.447536+0000 front 2024-09-19T09:06:06.447621+0000 (oldest deadline 2024-09-19T09:06:32.347547+0000) 2024-09-19T09:06:42.070 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:41 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:41.837+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.348020+0000 front 2024-09-19T09:06:12.348057+0000 (oldest deadline 2024-09-19T09:06:35.848012+0000) 2024-09-19T09:06:42.070 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:41 smithi019 podman[217612]: 2024-09-19 09:06:41.636347591 +0000 UTC m=+0.382709616 container start 99468e3d1b978b7f7f55e76c64c56194ddadf011560b172def4425ce77ad53eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:06:42.070 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:41 smithi019 podman[217612]: 2024-09-19 09:06:41.707868311 +0000 UTC m=+0.454230339 container attach 99468e3d1b978b7f7f55e76c64c56194ddadf011560b172def4425ce77ad53eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-19T09:06:42.070 INFO:journalctl@ceph.osd.6.smithi019.stdout:Sep 19 09:06:41 smithi019 podman[217612]: 2024-09-19 09:06:41.828814276 +0000 UTC m=+0.575176304 container died 99468e3d1b978b7f7f55e76c64c56194ddadf011560b172def4425ce77ad53eb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-6-deactivate, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-19T09:06:42.423 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:42 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:42.110+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.164918+0000 front 2024-09-19T09:05:58.164858+0000 (oldest deadline 2024-09-19T09:06:21.665006+0000) 2024-09-19T09:06:42.423 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:42 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:42.110+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.965905+0000 front 2024-09-19T09:06:06.965869+0000 (oldest deadline 2024-09-19T09:06:29.265999+0000) 2024-09-19T09:06:42.424 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:42 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:42.110+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.767006+0000 front 2024-09-19T09:06:12.767130+0000 (oldest deadline 2024-09-19T09:06:36.767570+0000) 2024-09-19T09:06:42.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:42 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:42.141+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:42.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:42 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:42.141+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:42.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:42 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:42.141+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:06:42.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:42 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:42.141+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.303831+0000 front 2024-09-19T09:06:11.304084+0000 (oldest deadline 2024-09-19T09:06:37.203943+0000) 2024-09-19T09:06:42.620 DEBUG:teuthology.orchestra.run.smithi019:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@osd.6.service' 2024-09-19T09:06:42.706 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:06:42.707 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-19T09:06:42.707 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-19T09:06:42.707 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-f26c9d84-7662-11ef-bceb-c7b262605968@osd.7 2024-09-19T09:06:42.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:42 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:42.621+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.721815+0000 front 2024-09-19T09:05:57.721787+0000 (oldest deadline 2024-09-19T09:06:23.021782+0000) 2024-09-19T09:06:42.983 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:42 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:42.621+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:03.022116+0000 front 2024-09-19T09:06:03.022187+0000 (oldest deadline 2024-09-19T09:06:30.622946+0000) 2024-09-19T09:06:42.983 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:42 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:42.621+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.724056+0000 front 2024-09-19T09:06:11.724093+0000 (oldest deadline 2024-09-19T09:06:37.024205+0000) 2024-09-19T09:06:42.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:42 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:42.611+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:42.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:42 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:42.611+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:42.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:42 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:42.611+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:06:42.984 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:42 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:42.611+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:06:43.023 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:42 smithi155 systemd[1]: Stopping Ceph osd.7 for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T09:06:43.319 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:42 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:42.879+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:43.319 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:42 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:42.879+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:43.319 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:42 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:42.879+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.447536+0000 front 2024-09-19T09:06:06.447621+0000 (oldest deadline 2024-09-19T09:06:32.347547+0000) 2024-09-19T09:06:43.319 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:42 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:42.879+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.348020+0000 front 2024-09-19T09:06:12.348057+0000 (oldest deadline 2024-09-19T09:06:35.848012+0000) 2024-09-19T09:06:43.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:43 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:43.140+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:43.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:43 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:43.140+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:43.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:43 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:43.140+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:06:43.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:43 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:43.140+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.303831+0000 front 2024-09-19T09:06:11.304084+0000 (oldest deadline 2024-09-19T09:06:37.203943+0000) 2024-09-19T09:06:43.424 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:43 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:43.022+0000 7fbd8cb6f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:06:43.424 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:43 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:43.022+0000 7fbd8cb6f640 -1 osd.7 91 *** Got signal Terminated *** 2024-09-19T09:06:43.424 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:43 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:43.022+0000 7fbd8cb6f640 -1 osd.7 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:06:43.425 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:43 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:43.101+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.164918+0000 front 2024-09-19T09:05:58.164858+0000 (oldest deadline 2024-09-19T09:06:21.665006+0000) 2024-09-19T09:06:43.425 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:43 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:43.101+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.965905+0000 front 2024-09-19T09:06:06.965869+0000 (oldest deadline 2024-09-19T09:06:29.265999+0000) 2024-09-19T09:06:43.425 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:43 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:43.101+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.767006+0000 front 2024-09-19T09:06:12.767130+0000 (oldest deadline 2024-09-19T09:06:36.767570+0000) 2024-09-19T09:06:43.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:43 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:43.666+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.721815+0000 front 2024-09-19T09:05:57.721787+0000 (oldest deadline 2024-09-19T09:06:23.021782+0000) 2024-09-19T09:06:43.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:43 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:43.666+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:03.022116+0000 front 2024-09-19T09:06:03.022187+0000 (oldest deadline 2024-09-19T09:06:30.622946+0000) 2024-09-19T09:06:43.983 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:43 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:43.666+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.724056+0000 front 2024-09-19T09:06:11.724093+0000 (oldest deadline 2024-09-19T09:06:37.024205+0000) 2024-09-19T09:06:43.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:43 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:43.644+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:43.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:43 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:43.644+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:43.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:43 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:43.644+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:06:43.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:43 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:43.644+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:06:44.319 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:43 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:43.891+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:44.319 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:43 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:43.891+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:44.319 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:43 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:43.891+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.447536+0000 front 2024-09-19T09:06:06.447621+0000 (oldest deadline 2024-09-19T09:06:32.347547+0000) 2024-09-19T09:06:44.319 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:43 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:43.891+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.348020+0000 front 2024-09-19T09:06:12.348057+0000 (oldest deadline 2024-09-19T09:06:35.848012+0000) 2024-09-19T09:06:44.423 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:44 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:44.090+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.164918+0000 front 2024-09-19T09:05:58.164858+0000 (oldest deadline 2024-09-19T09:06:21.665006+0000) 2024-09-19T09:06:44.424 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:44 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:44.090+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.965905+0000 front 2024-09-19T09:06:06.965869+0000 (oldest deadline 2024-09-19T09:06:29.265999+0000) 2024-09-19T09:06:44.424 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:44 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:44.090+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.767006+0000 front 2024-09-19T09:06:12.767130+0000 (oldest deadline 2024-09-19T09:06:36.767570+0000) 2024-09-19T09:06:44.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:44 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:44.184+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:44.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:44 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:44.184+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:44.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:44 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:44.184+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:06:44.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:44 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:44.184+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.303831+0000 front 2024-09-19T09:06:11.304084+0000 (oldest deadline 2024-09-19T09:06:37.203943+0000) 2024-09-19T09:06:44.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:44 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:44.651+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.721815+0000 front 2024-09-19T09:05:57.721787+0000 (oldest deadline 2024-09-19T09:06:23.021782+0000) 2024-09-19T09:06:44.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:44 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:44.651+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:03.022116+0000 front 2024-09-19T09:06:03.022187+0000 (oldest deadline 2024-09-19T09:06:30.622946+0000) 2024-09-19T09:06:44.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:44 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:44.651+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.724056+0000 front 2024-09-19T09:06:11.724093+0000 (oldest deadline 2024-09-19T09:06:37.024205+0000) 2024-09-19T09:06:44.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:44 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:44.629+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:44.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:44 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:44.629+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:44.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:44 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:44.629+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:06:44.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:44 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:44.629+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:06:45.319 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:44 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:44.851+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:45.319 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:44 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:44.851+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:45.319 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:44 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:44.851+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.447536+0000 front 2024-09-19T09:06:06.447621+0000 (oldest deadline 2024-09-19T09:06:32.347547+0000) 2024-09-19T09:06:45.320 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:44 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:44.851+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.348020+0000 front 2024-09-19T09:06:12.348057+0000 (oldest deadline 2024-09-19T09:06:35.848012+0000) 2024-09-19T09:06:45.423 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:45 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:45.098+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.164918+0000 front 2024-09-19T09:05:58.164858+0000 (oldest deadline 2024-09-19T09:06:21.665006+0000) 2024-09-19T09:06:45.423 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:45 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:45.098+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.965905+0000 front 2024-09-19T09:06:06.965869+0000 (oldest deadline 2024-09-19T09:06:29.265999+0000) 2024-09-19T09:06:45.424 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:45 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:45.098+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.767006+0000 front 2024-09-19T09:06:12.767130+0000 (oldest deadline 2024-09-19T09:06:36.767570+0000) 2024-09-19T09:06:45.424 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:45 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:45.098+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:19.068601+0000 front 2024-09-19T09:06:19.068536+0000 (oldest deadline 2024-09-19T09:06:44.269027+0000) 2024-09-19T09:06:45.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:45 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:45.231+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:45.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:45 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:45.231+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:45.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:45 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:45.231+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:06:45.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:45 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:45.231+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.303831+0000 front 2024-09-19T09:06:11.304084+0000 (oldest deadline 2024-09-19T09:06:37.203943+0000) 2024-09-19T09:06:45.425 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:45 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:45.231+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.104935+0000 front 2024-09-19T09:06:23.104953+0000 (oldest deadline 2024-09-19T09:06:44.805080+0000) 2024-09-19T09:06:45.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:45 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:45.622+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.721815+0000 front 2024-09-19T09:05:57.721787+0000 (oldest deadline 2024-09-19T09:06:23.021782+0000) 2024-09-19T09:06:45.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:45 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:45.622+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:03.022116+0000 front 2024-09-19T09:06:03.022187+0000 (oldest deadline 2024-09-19T09:06:30.622946+0000) 2024-09-19T09:06:45.983 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:45 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:45.622+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.724056+0000 front 2024-09-19T09:06:11.724093+0000 (oldest deadline 2024-09-19T09:06:37.024205+0000) 2024-09-19T09:06:45.983 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:45 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:45.622+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.425591+0000 front 2024-09-19T09:06:23.425619+0000 (oldest deadline 2024-09-19T09:06:45.125658+0000) 2024-09-19T09:06:45.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:45 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:45.608+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:45.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:45 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:45.608+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:45.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:45 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:45.608+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:06:45.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:45 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:45.608+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:06:46.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:45 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:45.814+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:46.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:45 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:45.814+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:46.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:45 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:45.814+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.447536+0000 front 2024-09-19T09:06:06.447621+0000 (oldest deadline 2024-09-19T09:06:32.347547+0000) 2024-09-19T09:06:46.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:45 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:45.814+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.348020+0000 front 2024-09-19T09:06:12.348057+0000 (oldest deadline 2024-09-19T09:06:35.848012+0000) 2024-09-19T09:06:46.423 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:46 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:46.056+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.164918+0000 front 2024-09-19T09:05:58.164858+0000 (oldest deadline 2024-09-19T09:06:21.665006+0000) 2024-09-19T09:06:46.424 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:46 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:46.056+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.965905+0000 front 2024-09-19T09:06:06.965869+0000 (oldest deadline 2024-09-19T09:06:29.265999+0000) 2024-09-19T09:06:46.424 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:46 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:46.056+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.767006+0000 front 2024-09-19T09:06:12.767130+0000 (oldest deadline 2024-09-19T09:06:36.767570+0000) 2024-09-19T09:06:46.424 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:46 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:46.056+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:19.068601+0000 front 2024-09-19T09:06:19.068536+0000 (oldest deadline 2024-09-19T09:06:44.269027+0000) 2024-09-19T09:06:46.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:46 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:46.275+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:46.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:46 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:46.275+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:46.425 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:46 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:46.275+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:06:46.425 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:46 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:46.275+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.303831+0000 front 2024-09-19T09:06:11.304084+0000 (oldest deadline 2024-09-19T09:06:37.203943+0000) 2024-09-19T09:06:46.425 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:46 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:46.275+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.104935+0000 front 2024-09-19T09:06:23.104953+0000 (oldest deadline 2024-09-19T09:06:44.805080+0000) 2024-09-19T09:06:46.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:46 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:46.606+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.721815+0000 front 2024-09-19T09:05:57.721787+0000 (oldest deadline 2024-09-19T09:06:23.021782+0000) 2024-09-19T09:06:46.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:46 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:46.606+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:03.022116+0000 front 2024-09-19T09:06:03.022187+0000 (oldest deadline 2024-09-19T09:06:30.622946+0000) 2024-09-19T09:06:46.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:46 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:46.606+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.724056+0000 front 2024-09-19T09:06:11.724093+0000 (oldest deadline 2024-09-19T09:06:37.024205+0000) 2024-09-19T09:06:46.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:46 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:46.606+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.425591+0000 front 2024-09-19T09:06:23.425619+0000 (oldest deadline 2024-09-19T09:06:45.125658+0000) 2024-09-19T09:06:46.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:46 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:46.576+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:46.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:46 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:46.576+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:46.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:46 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:46.576+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:06:46.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:46 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:46.576+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:06:46.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:46 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:46.576+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:20.510478+0000 front 2024-09-19T09:06:20.510419+0000 (oldest deadline 2024-09-19T09:06:46.410260+0000) 2024-09-19T09:06:47.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:46 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:46.774+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:47.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:46 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:46.774+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:47.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:46 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:46.774+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.447536+0000 front 2024-09-19T09:06:06.447621+0000 (oldest deadline 2024-09-19T09:06:32.347547+0000) 2024-09-19T09:06:47.070 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:46 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:46.774+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.348020+0000 front 2024-09-19T09:06:12.348057+0000 (oldest deadline 2024-09-19T09:06:35.848012+0000) 2024-09-19T09:06:47.423 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:47 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:47.051+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:58.164918+0000 front 2024-09-19T09:05:58.164858+0000 (oldest deadline 2024-09-19T09:06:21.665006+0000) 2024-09-19T09:06:47.424 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:47 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:47.051+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.965905+0000 front 2024-09-19T09:06:06.965869+0000 (oldest deadline 2024-09-19T09:06:29.265999+0000) 2024-09-19T09:06:47.424 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:47 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:47.051+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.767006+0000 front 2024-09-19T09:06:12.767130+0000 (oldest deadline 2024-09-19T09:06:36.767570+0000) 2024-09-19T09:06:47.424 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:47 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7[53205]: 2024-09-19T09:06:47.051+0000 7fbd89185640 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:19.068601+0000 front 2024-09-19T09:06:19.068536+0000 (oldest deadline 2024-09-19T09:06:44.269027+0000) 2024-09-19T09:06:47.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:47 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:47.298+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:47.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:47 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:47.298+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:47.425 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:47 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:47.298+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:06:47.425 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:47 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:47.298+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.303831+0000 front 2024-09-19T09:06:11.304084+0000 (oldest deadline 2024-09-19T09:06:37.203943+0000) 2024-09-19T09:06:47.425 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:47 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:47.298+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.104935+0000 front 2024-09-19T09:06:23.104953+0000 (oldest deadline 2024-09-19T09:06:44.805080+0000) 2024-09-19T09:06:47.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:47 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:47.617+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.721815+0000 front 2024-09-19T09:05:57.721787+0000 (oldest deadline 2024-09-19T09:06:23.021782+0000) 2024-09-19T09:06:47.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:47 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:47.617+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:03.022116+0000 front 2024-09-19T09:06:03.022187+0000 (oldest deadline 2024-09-19T09:06:30.622946+0000) 2024-09-19T09:06:47.983 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:47 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:47.617+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.724056+0000 front 2024-09-19T09:06:11.724093+0000 (oldest deadline 2024-09-19T09:06:37.024205+0000) 2024-09-19T09:06:47.983 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:47 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:47.617+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.425591+0000 front 2024-09-19T09:06:23.425619+0000 (oldest deadline 2024-09-19T09:06:45.125658+0000) 2024-09-19T09:06:47.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:47 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:47.561+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:47.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:47 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:47.561+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:47.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:47 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:47.561+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:06:47.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:47 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:47.561+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:06:47.984 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:47 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:47.561+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:20.510478+0000 front 2024-09-19T09:06:20.510419+0000 (oldest deadline 2024-09-19T09:06:46.410260+0000) 2024-09-19T09:06:48.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:47 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:47.808+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:48.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:47 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:47.808+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:48.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:47 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:47.808+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.447536+0000 front 2024-09-19T09:06:06.447621+0000 (oldest deadline 2024-09-19T09:06:32.347547+0000) 2024-09-19T09:06:48.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:47 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:47.808+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.348020+0000 front 2024-09-19T09:06:12.348057+0000 (oldest deadline 2024-09-19T09:06:35.848012+0000) 2024-09-19T09:06:48.673 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:48 smithi155 podman[71354]: 2024-09-19 09:06:48.482244622 +0000 UTC m=+5.583107279 container died 9502dd6e2d5d51f5cb946d5295248285d8a9d29a3ce429f5cb60cc2cf67cd1bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2) 2024-09-19T09:06:48.674 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:48 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:48.251+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:48.674 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:48 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:48.251+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:48.674 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:48 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:48.251+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:06:48.674 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:48 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:48.251+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.303831+0000 front 2024-09-19T09:06:11.304084+0000 (oldest deadline 2024-09-19T09:06:37.203943+0000) 2024-09-19T09:06:48.674 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:48 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:48.251+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.104935+0000 front 2024-09-19T09:06:23.104953+0000 (oldest deadline 2024-09-19T09:06:44.805080+0000) 2024-09-19T09:06:48.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:48 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:48.627+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.721815+0000 front 2024-09-19T09:05:57.721787+0000 (oldest deadline 2024-09-19T09:06:23.021782+0000) 2024-09-19T09:06:48.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:48 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:48.627+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:03.022116+0000 front 2024-09-19T09:06:03.022187+0000 (oldest deadline 2024-09-19T09:06:30.622946+0000) 2024-09-19T09:06:48.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:48 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:48.627+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.724056+0000 front 2024-09-19T09:06:11.724093+0000 (oldest deadline 2024-09-19T09:06:37.024205+0000) 2024-09-19T09:06:48.983 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:48 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:48.627+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.425591+0000 front 2024-09-19T09:06:23.425619+0000 (oldest deadline 2024-09-19T09:06:45.125658+0000) 2024-09-19T09:06:48.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:48 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:48.584+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:48.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:48 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:48.584+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:48.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:48 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:48.584+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:06:48.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:48 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:48.584+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:06:48.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:48 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:48.584+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:20.510478+0000 front 2024-09-19T09:06:20.510419+0000 (oldest deadline 2024-09-19T09:06:46.410260+0000) 2024-09-19T09:06:49.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:48 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:48.768+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:49.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:48 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:48.768+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:49.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:48 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:48.768+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.447536+0000 front 2024-09-19T09:06:06.447621+0000 (oldest deadline 2024-09-19T09:06:32.347547+0000) 2024-09-19T09:06:49.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:48 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:48.768+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.348020+0000 front 2024-09-19T09:06:12.348057+0000 (oldest deadline 2024-09-19T09:06:35.848012+0000) 2024-09-19T09:06:49.140 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:48 smithi155 podman[71354]: 2024-09-19 09:06:48.872501564 +0000 UTC m=+5.973364213 container cleanup 9502dd6e2d5d51f5cb946d5295248285d8a9d29a3ce429f5cb60cc2cf67cd1bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:06:49.140 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:48 smithi155 bash[71354]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7 2024-09-19T09:06:49.423 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:49 smithi155 podman[71370]: 2024-09-19 09:06:49.140386417 +0000 UTC m=+0.655152161 container remove 9502dd6e2d5d51f5cb946d5295248285d8a9d29a3ce429f5cb60cc2cf67cd1bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-19T09:06:49.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:49 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:49.252+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:49.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:49 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:49.252+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:49.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:49 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:49.252+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:06:49.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:49 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:49.252+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.303831+0000 front 2024-09-19T09:06:11.304084+0000 (oldest deadline 2024-09-19T09:06:37.203943+0000) 2024-09-19T09:06:49.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:49 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:49.252+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.104935+0000 front 2024-09-19T09:06:23.104953+0000 (oldest deadline 2024-09-19T09:06:44.805080+0000) 2024-09-19T09:06:49.785 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:49 smithi155 podman[71457]: 2024-09-19 09:06:49.393265898 +0000 UTC m=+0.016290009 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:06:49.786 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:49 smithi155 podman[71457]: 2024-09-19 09:06:49.533095084 +0000 UTC m=+0.156119222 container create be42218cf2da754b972e5a0eca28505547ee95f16dca14ee50b75b5f5c9027c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-19T09:06:49.786 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:49 smithi155 podman[71457]: 2024-09-19 09:06:49.785530358 +0000 UTC m=+0.408554463 container init be42218cf2da754b972e5a0eca28505547ee95f16dca14ee50b75b5f5c9027c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:06:49.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:49 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:49.600+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.721815+0000 front 2024-09-19T09:05:57.721787+0000 (oldest deadline 2024-09-19T09:06:23.021782+0000) 2024-09-19T09:06:49.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:49 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:49.600+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:03.022116+0000 front 2024-09-19T09:06:03.022187+0000 (oldest deadline 2024-09-19T09:06:30.622946+0000) 2024-09-19T09:06:49.983 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:49 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:49.600+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.724056+0000 front 2024-09-19T09:06:11.724093+0000 (oldest deadline 2024-09-19T09:06:37.024205+0000) 2024-09-19T09:06:49.983 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:49 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:49.600+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.425591+0000 front 2024-09-19T09:06:23.425619+0000 (oldest deadline 2024-09-19T09:06:45.125658+0000) 2024-09-19T09:06:49.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:49 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:49.551+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:49.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:49 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:49.551+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:49.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:49 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:49.551+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:06:49.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:49 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:49.551+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:06:49.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:49 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:49.551+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:20.510478+0000 front 2024-09-19T09:06:20.510419+0000 (oldest deadline 2024-09-19T09:06:46.410260+0000) 2024-09-19T09:06:50.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:49 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:49.749+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:50.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:49 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:49.749+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:50.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:49 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:49.749+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.447536+0000 front 2024-09-19T09:06:06.447621+0000 (oldest deadline 2024-09-19T09:06:32.347547+0000) 2024-09-19T09:06:50.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:49 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:49.749+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.348020+0000 front 2024-09-19T09:06:12.348057+0000 (oldest deadline 2024-09-19T09:06:35.848012+0000) 2024-09-19T09:06:50.173 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:49 smithi155 podman[71457]: 2024-09-19 09:06:49.789129604 +0000 UTC m=+0.412153708 container start be42218cf2da754b972e5a0eca28505547ee95f16dca14ee50b75b5f5c9027c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-19T09:06:50.174 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:49 smithi155 podman[71457]: 2024-09-19 09:06:49.885510369 +0000 UTC m=+0.508534473 container attach be42218cf2da754b972e5a0eca28505547ee95f16dca14ee50b75b5f5c9027c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-19T09:06:50.174 INFO:journalctl@ceph.osd.7.smithi155.stdout:Sep 19 09:06:49 smithi155 podman[71457]: 2024-09-19 09:06:49.980652192 +0000 UTC m=+0.603676288 container died be42218cf2da754b972e5a0eca28505547ee95f16dca14ee50b75b5f5c9027c4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-19T09:06:50.647 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:50 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:50.259+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:50.648 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:50 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:50.259+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:50.648 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:50 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:50.259+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:06:50.648 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:50 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:50.259+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.303831+0000 front 2024-09-19T09:06:11.304084+0000 (oldest deadline 2024-09-19T09:06:37.203943+0000) 2024-09-19T09:06:50.648 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:50 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:50.259+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.104935+0000 front 2024-09-19T09:06:23.104953+0000 (oldest deadline 2024-09-19T09:06:44.805080+0000) 2024-09-19T09:06:50.671 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@osd.7.service' 2024-09-19T09:06:50.710 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:06:50.711 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-19T09:06:50.711 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-19T09:06:50.711 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-f26c9d84-7662-11ef-bceb-c7b262605968@osd.8 2024-09-19T09:06:50.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:50 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:50.599+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.721815+0000 front 2024-09-19T09:05:57.721787+0000 (oldest deadline 2024-09-19T09:06:23.021782+0000) 2024-09-19T09:06:50.983 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:50 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:50.599+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:03.022116+0000 front 2024-09-19T09:06:03.022187+0000 (oldest deadline 2024-09-19T09:06:30.622946+0000) 2024-09-19T09:06:50.983 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:50 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:50.599+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.724056+0000 front 2024-09-19T09:06:11.724093+0000 (oldest deadline 2024-09-19T09:06:37.024205+0000) 2024-09-19T09:06:50.983 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:50 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:50.599+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.425591+0000 front 2024-09-19T09:06:23.425619+0000 (oldest deadline 2024-09-19T09:06:45.125658+0000) 2024-09-19T09:06:50.983 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:50 smithi203 systemd[1]: Stopping Ceph osd.8 for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T09:06:50.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:50 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:50.599+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:50.984 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:50 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:50.599+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:50.984 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:50 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:50.599+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:06:50.984 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:50 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:50.599+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:06:50.984 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:50 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:50.599+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:20.510478+0000 front 2024-09-19T09:06:20.510419+0000 (oldest deadline 2024-09-19T09:06:46.410260+0000) 2024-09-19T09:06:51.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:50 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:50.727+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:51.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:50 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:50.727+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:51.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:50 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:50.727+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.447536+0000 front 2024-09-19T09:06:06.447621+0000 (oldest deadline 2024-09-19T09:06:32.347547+0000) 2024-09-19T09:06:51.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:50 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:50.727+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.348020+0000 front 2024-09-19T09:06:12.348057+0000 (oldest deadline 2024-09-19T09:06:35.848012+0000) 2024-09-19T09:06:51.482 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:51 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:51.026+0000 7ff2a255b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:06:51.482 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:51 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:51.026+0000 7ff2a255b640 -1 osd.8 91 *** Got signal Terminated *** 2024-09-19T09:06:51.483 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:51 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:51.026+0000 7ff2a255b640 -1 osd.8 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:06:51.673 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:51 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:51.242+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:51.673 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:51 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:51.242+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:51.674 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:51 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:51.242+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:06:51.674 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:51 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:51.242+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.303831+0000 front 2024-09-19T09:06:11.304084+0000 (oldest deadline 2024-09-19T09:06:37.203943+0000) 2024-09-19T09:06:51.674 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:51 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:51.242+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.104935+0000 front 2024-09-19T09:06:23.104953+0000 (oldest deadline 2024-09-19T09:06:44.805080+0000) 2024-09-19T09:06:51.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:51 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:51.643+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.721815+0000 front 2024-09-19T09:05:57.721787+0000 (oldest deadline 2024-09-19T09:06:23.021782+0000) 2024-09-19T09:06:51.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:51 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:51.643+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:03.022116+0000 front 2024-09-19T09:06:03.022187+0000 (oldest deadline 2024-09-19T09:06:30.622946+0000) 2024-09-19T09:06:51.983 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:51 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:51.643+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.724056+0000 front 2024-09-19T09:06:11.724093+0000 (oldest deadline 2024-09-19T09:06:37.024205+0000) 2024-09-19T09:06:51.983 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:51 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:51.643+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.425591+0000 front 2024-09-19T09:06:23.425619+0000 (oldest deadline 2024-09-19T09:06:45.125658+0000) 2024-09-19T09:06:51.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:51 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:51.559+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:51.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:51 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:51.559+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:51.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:51 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:51.559+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:06:51.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:51 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:51.559+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:06:51.984 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:51 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:51.559+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:20.510478+0000 front 2024-09-19T09:06:20.510419+0000 (oldest deadline 2024-09-19T09:06:46.410260+0000) 2024-09-19T09:06:52.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:51 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:51.742+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:52.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:51 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:51.742+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:52.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:51 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:51.742+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.447536+0000 front 2024-09-19T09:06:06.447621+0000 (oldest deadline 2024-09-19T09:06:32.347547+0000) 2024-09-19T09:06:52.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:51 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:51.742+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.348020+0000 front 2024-09-19T09:06:12.348057+0000 (oldest deadline 2024-09-19T09:06:35.848012+0000) 2024-09-19T09:06:52.673 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:52 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:52.280+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:52.674 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:52 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:52.280+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:52.674 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:52 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:52.280+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:06:52.674 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:52 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:52.280+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.303831+0000 front 2024-09-19T09:06:11.304084+0000 (oldest deadline 2024-09-19T09:06:37.203943+0000) 2024-09-19T09:06:52.674 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:52 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:52.280+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.104935+0000 front 2024-09-19T09:06:23.104953+0000 (oldest deadline 2024-09-19T09:06:44.805080+0000) 2024-09-19T09:06:52.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:52 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:52.596+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.721815+0000 front 2024-09-19T09:05:57.721787+0000 (oldest deadline 2024-09-19T09:06:23.021782+0000) 2024-09-19T09:06:52.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:52 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:52.596+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:03.022116+0000 front 2024-09-19T09:06:03.022187+0000 (oldest deadline 2024-09-19T09:06:30.622946+0000) 2024-09-19T09:06:52.983 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:52 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:52.596+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.724056+0000 front 2024-09-19T09:06:11.724093+0000 (oldest deadline 2024-09-19T09:06:37.024205+0000) 2024-09-19T09:06:52.983 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:52 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:52.596+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.425591+0000 front 2024-09-19T09:06:23.425619+0000 (oldest deadline 2024-09-19T09:06:45.125658+0000) 2024-09-19T09:06:52.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:52 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:52.511+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:52.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:52 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:52.511+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:52.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:52 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:52.511+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:06:52.984 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:52 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:52.511+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:06:52.984 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:52 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:52.511+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:20.510478+0000 front 2024-09-19T09:06:20.510419+0000 (oldest deadline 2024-09-19T09:06:46.410260+0000) 2024-09-19T09:06:53.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:52 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:52.696+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:53.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:52 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:52.696+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:53.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:52 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:52.696+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.447536+0000 front 2024-09-19T09:06:06.447621+0000 (oldest deadline 2024-09-19T09:06:32.347547+0000) 2024-09-19T09:06:53.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:52 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:52.696+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.348020+0000 front 2024-09-19T09:06:12.348057+0000 (oldest deadline 2024-09-19T09:06:35.848012+0000) 2024-09-19T09:06:53.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:52 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:52.696+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.950495+0000 front 2024-09-19T09:06:30.950456+0000 (oldest deadline 2024-09-19T09:06:52.550615+0000) 2024-09-19T09:06:53.673 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:53 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:53.237+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:53.673 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:53 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:53.237+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:53.674 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:53 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:53.237+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:06:53.674 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:53 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:53.237+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.303831+0000 front 2024-09-19T09:06:11.304084+0000 (oldest deadline 2024-09-19T09:06:37.203943+0000) 2024-09-19T09:06:53.674 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:53 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:53.237+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.104935+0000 front 2024-09-19T09:06:23.104953+0000 (oldest deadline 2024-09-19T09:06:44.805080+0000) 2024-09-19T09:06:53.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:53 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:53.636+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.721815+0000 front 2024-09-19T09:05:57.721787+0000 (oldest deadline 2024-09-19T09:06:23.021782+0000) 2024-09-19T09:06:53.983 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:53 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:53.636+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:03.022116+0000 front 2024-09-19T09:06:03.022187+0000 (oldest deadline 2024-09-19T09:06:30.622946+0000) 2024-09-19T09:06:53.983 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:53 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:53.636+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.724056+0000 front 2024-09-19T09:06:11.724093+0000 (oldest deadline 2024-09-19T09:06:37.024205+0000) 2024-09-19T09:06:53.983 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:53 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:53.636+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.425591+0000 front 2024-09-19T09:06:23.425619+0000 (oldest deadline 2024-09-19T09:06:45.125658+0000) 2024-09-19T09:06:53.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:53 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:53.521+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:53.984 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:53 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:53.521+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:53.984 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:53 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:53.521+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:06:53.984 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:53 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:53.522+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:06:53.984 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:53 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:53.522+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:20.510478+0000 front 2024-09-19T09:06:20.510419+0000 (oldest deadline 2024-09-19T09:06:46.410260+0000) 2024-09-19T09:06:54.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:53 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:53.673+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:54.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:53 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:53.673+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:54.070 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:53 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:53.673+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.447536+0000 front 2024-09-19T09:06:06.447621+0000 (oldest deadline 2024-09-19T09:06:32.347547+0000) 2024-09-19T09:06:54.070 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:53 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:53.673+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.348020+0000 front 2024-09-19T09:06:12.348057+0000 (oldest deadline 2024-09-19T09:06:35.848012+0000) 2024-09-19T09:06:54.070 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:53 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:53.673+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.950495+0000 front 2024-09-19T09:06:30.950456+0000 (oldest deadline 2024-09-19T09:06:52.550615+0000) 2024-09-19T09:06:54.673 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:54 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:54.226+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:54.673 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:54 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:54.226+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:54.674 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:54 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:54.226+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:06:54.674 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:54 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:54.226+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.303831+0000 front 2024-09-19T09:06:11.304084+0000 (oldest deadline 2024-09-19T09:06:37.203943+0000) 2024-09-19T09:06:54.674 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:54 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:54.226+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.104935+0000 front 2024-09-19T09:06:23.104953+0000 (oldest deadline 2024-09-19T09:06:44.805080+0000) 2024-09-19T09:06:54.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:54 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:54.654+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.721815+0000 front 2024-09-19T09:05:57.721787+0000 (oldest deadline 2024-09-19T09:06:23.021782+0000) 2024-09-19T09:06:54.983 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:54 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:54.654+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:03.022116+0000 front 2024-09-19T09:06:03.022187+0000 (oldest deadline 2024-09-19T09:06:30.622946+0000) 2024-09-19T09:06:54.983 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:54 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:54.654+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.724056+0000 front 2024-09-19T09:06:11.724093+0000 (oldest deadline 2024-09-19T09:06:37.024205+0000) 2024-09-19T09:06:54.983 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:54 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:54.654+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.425591+0000 front 2024-09-19T09:06:23.425619+0000 (oldest deadline 2024-09-19T09:06:45.125658+0000) 2024-09-19T09:06:54.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:54 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:54.508+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:54.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:54 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:54.508+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:54.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:54 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:54.508+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:06:54.984 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:54 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:54.508+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:06:54.984 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:54 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:54.508+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:20.510478+0000 front 2024-09-19T09:06:20.510419+0000 (oldest deadline 2024-09-19T09:06:46.410260+0000) 2024-09-19T09:06:55.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:54 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:54.715+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:55.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:54 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:54.715+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:55.070 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:54 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:54.715+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.447536+0000 front 2024-09-19T09:06:06.447621+0000 (oldest deadline 2024-09-19T09:06:32.347547+0000) 2024-09-19T09:06:55.070 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:54 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:54.715+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.348020+0000 front 2024-09-19T09:06:12.348057+0000 (oldest deadline 2024-09-19T09:06:35.848012+0000) 2024-09-19T09:06:55.070 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:54 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:54.715+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.950495+0000 front 2024-09-19T09:06:30.950456+0000 (oldest deadline 2024-09-19T09:06:52.550615+0000) 2024-09-19T09:06:55.673 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:55 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:55.189+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:55.673 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:55 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:55.189+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:55.674 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:55 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:55.189+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:06:55.674 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:55 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:55.189+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.303831+0000 front 2024-09-19T09:06:11.304084+0000 (oldest deadline 2024-09-19T09:06:37.203943+0000) 2024-09-19T09:06:55.674 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:55 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:55.189+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.104935+0000 front 2024-09-19T09:06:23.104953+0000 (oldest deadline 2024-09-19T09:06:44.805080+0000) 2024-09-19T09:06:55.982 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:55 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:55.704+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.721815+0000 front 2024-09-19T09:05:57.721787+0000 (oldest deadline 2024-09-19T09:06:23.021782+0000) 2024-09-19T09:06:55.983 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:55 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:55.704+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:03.022116+0000 front 2024-09-19T09:06:03.022187+0000 (oldest deadline 2024-09-19T09:06:30.622946+0000) 2024-09-19T09:06:55.983 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:55 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:55.704+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.724056+0000 front 2024-09-19T09:06:11.724093+0000 (oldest deadline 2024-09-19T09:06:37.024205+0000) 2024-09-19T09:06:55.983 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:55 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:55.704+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.425591+0000 front 2024-09-19T09:06:23.425619+0000 (oldest deadline 2024-09-19T09:06:45.125658+0000) 2024-09-19T09:06:55.983 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:55 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8[53794]: 2024-09-19T09:06:55.704+0000 7ff29ab69640 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:26.127013+0000 front 2024-09-19T09:06:26.126996+0000 (oldest deadline 2024-09-19T09:06:54.927571+0000) 2024-09-19T09:06:55.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:55 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:55.527+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:55.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:55 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:55.527+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:55.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:55 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:55.527+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:06:55.984 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:55 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:55.527+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:06:55.984 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:55 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:55.527+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:20.510478+0000 front 2024-09-19T09:06:20.510419+0000 (oldest deadline 2024-09-19T09:06:46.410260+0000) 2024-09-19T09:06:55.984 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:55 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:55.527+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.311920+0000 front 2024-09-19T09:06:30.312008+0000 (oldest deadline 2024-09-19T09:06:55.011969+0000) 2024-09-19T09:06:56.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:55 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:55.694+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:56.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:55 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:55.694+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:56.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:55 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:55.694+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.447536+0000 front 2024-09-19T09:06:06.447621+0000 (oldest deadline 2024-09-19T09:06:32.347547+0000) 2024-09-19T09:06:56.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:55 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:55.694+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.348020+0000 front 2024-09-19T09:06:12.348057+0000 (oldest deadline 2024-09-19T09:06:35.848012+0000) 2024-09-19T09:06:56.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:55 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:55.694+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.950495+0000 front 2024-09-19T09:06:30.950456+0000 (oldest deadline 2024-09-19T09:06:52.550615+0000) 2024-09-19T09:06:56.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:56 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:56.142+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:56.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:56 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:56.142+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:56.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:56 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:56.142+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:06:56.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:56 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:56.142+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.303831+0000 front 2024-09-19T09:06:11.304084+0000 (oldest deadline 2024-09-19T09:06:37.203943+0000) 2024-09-19T09:06:56.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:56 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:56.142+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.104935+0000 front 2024-09-19T09:06:23.104953+0000 (oldest deadline 2024-09-19T09:06:44.805080+0000) 2024-09-19T09:06:56.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:56 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:56.142+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.706182+0000 front 2024-09-19T09:06:30.706117+0000 (oldest deadline 2024-09-19T09:06:55.906497+0000) 2024-09-19T09:06:56.794 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:56 smithi203 podman[71298]: 2024-09-19 09:06:56.531010848 +0000 UTC m=+5.625232435 container died 8137ccabee0149b1c1fb0fb21005300e6e69ae3e9555d64a7306770fa560a867 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4) 2024-09-19T09:06:56.795 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:56 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:56.522+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:56.795 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:56 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:56.522+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:56.795 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:56 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:56.522+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:06:56.795 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:56 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:56.522+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:06:56.795 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:56 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:56.522+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:20.510478+0000 front 2024-09-19T09:06:20.510419+0000 (oldest deadline 2024-09-19T09:06:46.410260+0000) 2024-09-19T09:06:56.796 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:56 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:56.522+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.311920+0000 front 2024-09-19T09:06:30.312008+0000 (oldest deadline 2024-09-19T09:06:55.011969+0000) 2024-09-19T09:06:57.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:56 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:56.690+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:57.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:56 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:56.690+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:57.070 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:56 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:56.690+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.447536+0000 front 2024-09-19T09:06:06.447621+0000 (oldest deadline 2024-09-19T09:06:32.347547+0000) 2024-09-19T09:06:57.070 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:56 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:56.690+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.348020+0000 front 2024-09-19T09:06:12.348057+0000 (oldest deadline 2024-09-19T09:06:35.848012+0000) 2024-09-19T09:06:57.070 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:56 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:56.690+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.950495+0000 front 2024-09-19T09:06:30.950456+0000 (oldest deadline 2024-09-19T09:06:52.550615+0000) 2024-09-19T09:06:57.162 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:56 smithi203 podman[71298]: 2024-09-19 09:06:56.886068853 +0000 UTC m=+5.980290439 container cleanup 8137ccabee0149b1c1fb0fb21005300e6e69ae3e9555d64a7306770fa560a867 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-19T09:06:57.162 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:56 smithi203 bash[71298]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8 2024-09-19T09:06:57.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:57 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:57.167+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:57.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:57 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:57.167+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:57.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:57 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:57.167+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:06:57.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:57 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:57.167+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.303831+0000 front 2024-09-19T09:06:11.304084+0000 (oldest deadline 2024-09-19T09:06:37.203943+0000) 2024-09-19T09:06:57.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:57 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:57.167+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.104935+0000 front 2024-09-19T09:06:23.104953+0000 (oldest deadline 2024-09-19T09:06:44.805080+0000) 2024-09-19T09:06:57.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:57 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:57.167+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.706182+0000 front 2024-09-19T09:06:30.706117+0000 (oldest deadline 2024-09-19T09:06:55.906497+0000) 2024-09-19T09:06:57.482 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:57 smithi203 podman[71316]: 2024-09-19 09:06:57.162414972 +0000 UTC m=+0.626757152 container remove 8137ccabee0149b1c1fb0fb21005300e6e69ae3e9555d64a7306770fa560a867 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-19T09:06:57.749 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:57 smithi203 podman[71404]: 2024-09-19 09:06:57.398990272 +0000 UTC m=+0.015555099 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:06:57.750 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:57 smithi203 podman[71404]: 2024-09-19 09:06:57.513314117 +0000 UTC m=+0.129878947 container create 7c297f4ac968db9015ce63d9383bfd75c2f8f81e3f467bafcb408e18b3ba7fd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-19T09:06:57.750 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:57 smithi203 podman[71404]: 2024-09-19 09:06:57.749419242 +0000 UTC m=+0.365984069 container init 7c297f4ac968db9015ce63d9383bfd75c2f8f81e3f467bafcb408e18b3ba7fd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-19T09:06:57.750 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:57 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:57.557+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:57.751 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:57 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:57.557+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:57.751 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:57 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:57.557+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:06:57.751 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:57 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:57.557+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:06:57.751 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:57 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:57.557+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:20.510478+0000 front 2024-09-19T09:06:20.510419+0000 (oldest deadline 2024-09-19T09:06:46.410260+0000) 2024-09-19T09:06:57.752 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:57 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:57.557+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.311920+0000 front 2024-09-19T09:06:30.312008+0000 (oldest deadline 2024-09-19T09:06:55.011969+0000) 2024-09-19T09:06:58.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:57 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:57.691+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:58.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:57 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:57.691+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:58.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:57 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:57.691+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.447536+0000 front 2024-09-19T09:06:06.447621+0000 (oldest deadline 2024-09-19T09:06:32.347547+0000) 2024-09-19T09:06:58.070 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:57 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:57.691+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.348020+0000 front 2024-09-19T09:06:12.348057+0000 (oldest deadline 2024-09-19T09:06:35.848012+0000) 2024-09-19T09:06:58.070 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:57 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:57.691+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.950495+0000 front 2024-09-19T09:06:30.950456+0000 (oldest deadline 2024-09-19T09:06:52.550615+0000) 2024-09-19T09:06:58.232 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:57 smithi203 podman[71404]: 2024-09-19 09:06:57.753064384 +0000 UTC m=+0.369629216 container start 7c297f4ac968db9015ce63d9383bfd75c2f8f81e3f467bafcb408e18b3ba7fd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-19T09:06:58.233 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:57 smithi203 podman[71404]: 2024-09-19 09:06:57.816408257 +0000 UTC m=+0.432973086 container attach 7c297f4ac968db9015ce63d9383bfd75c2f8f81e3f467bafcb408e18b3ba7fd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:06:58.233 INFO:journalctl@ceph.osd.8.smithi203.stdout:Sep 19 09:06:57 smithi203 podman[71404]: 2024-09-19 09:06:57.93957145 +0000 UTC m=+0.556136278 container died 7c297f4ac968db9015ce63d9383bfd75c2f8f81e3f467bafcb408e18b3ba7fd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:06:58.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:58 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:58.123+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:58.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:58 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:58.123+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:58.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:58 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:58.123+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:06:58.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:58 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:58.123+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.303831+0000 front 2024-09-19T09:06:11.304084+0000 (oldest deadline 2024-09-19T09:06:37.203943+0000) 2024-09-19T09:06:58.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:58 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:58.123+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.104935+0000 front 2024-09-19T09:06:23.104953+0000 (oldest deadline 2024-09-19T09:06:44.805080+0000) 2024-09-19T09:06:58.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:58 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:58.123+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.706182+0000 front 2024-09-19T09:06:30.706117+0000 (oldest deadline 2024-09-19T09:06:55.906497+0000) 2024-09-19T09:06:58.564 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@osd.8.service' 2024-09-19T09:06:58.604 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:06:58.605 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-19T09:06:58.605 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-19T09:06:58.605 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ceph-f26c9d84-7662-11ef-bceb-c7b262605968@osd.9 2024-09-19T09:06:58.939 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:58 smithi019 systemd[1]: Stopping Ceph osd.9 for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T09:06:58.940 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:58 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:58.736+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:06:58.940 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:58 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:58.736+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:06:58.940 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:58 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:58.736+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.447536+0000 front 2024-09-19T09:06:06.447621+0000 (oldest deadline 2024-09-19T09:06:32.347547+0000) 2024-09-19T09:06:58.940 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:58 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:58.736+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.348020+0000 front 2024-09-19T09:06:12.348057+0000 (oldest deadline 2024-09-19T09:06:35.848012+0000) 2024-09-19T09:06:58.940 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:58 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:58.736+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.950495+0000 front 2024-09-19T09:06:30.950456+0000 (oldest deadline 2024-09-19T09:06:52.550615+0000) 2024-09-19T09:06:58.940 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:58 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:58.938+0000 7f2bf257b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:06:58.941 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:58 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:58.938+0000 7f2bf257b640 -1 osd.9 91 *** Got signal Terminated *** 2024-09-19T09:06:58.941 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:58 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:58.938+0000 7f2bf257b640 -1 osd.9 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:06:58.982 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:58 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:58.581+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:58.982 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:58 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:58.581+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:58.982 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:58 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:58.581+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:06:58.982 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:58 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:58.581+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:06:58.982 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:58 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:58.581+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:20.510478+0000 front 2024-09-19T09:06:20.510419+0000 (oldest deadline 2024-09-19T09:06:46.410260+0000) 2024-09-19T09:06:58.982 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:58 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:58.581+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.311920+0000 front 2024-09-19T09:06:30.312008+0000 (oldest deadline 2024-09-19T09:06:55.011969+0000) 2024-09-19T09:06:59.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:59 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:59.113+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:06:59.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:59 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:59.113+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:06:59.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:59 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:59.113+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:06:59.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:59 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:59.113+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.303831+0000 front 2024-09-19T09:06:11.304084+0000 (oldest deadline 2024-09-19T09:06:37.203943+0000) 2024-09-19T09:06:59.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:59 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:59.113+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.104935+0000 front 2024-09-19T09:06:23.104953+0000 (oldest deadline 2024-09-19T09:06:44.805080+0000) 2024-09-19T09:06:59.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:06:59 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:06:59.113+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.706182+0000 front 2024-09-19T09:06:30.706117+0000 (oldest deadline 2024-09-19T09:06:55.906497+0000) 2024-09-19T09:06:59.982 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:59 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:59.565+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:06:59.982 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:59 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:59.565+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:06:59.982 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:59 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:59.565+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:06:59.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:59 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:59.565+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:06:59.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:59 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:59.565+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:20.510478+0000 front 2024-09-19T09:06:20.510419+0000 (oldest deadline 2024-09-19T09:06:46.410260+0000) 2024-09-19T09:06:59.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:06:59 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:06:59.565+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.311920+0000 front 2024-09-19T09:06:30.312008+0000 (oldest deadline 2024-09-19T09:06:55.011969+0000) 2024-09-19T09:07:00.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:59 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:59.709+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:07:00.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:59 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:59.709+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:07:00.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:59 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:59.709+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.447536+0000 front 2024-09-19T09:06:06.447621+0000 (oldest deadline 2024-09-19T09:06:32.347547+0000) 2024-09-19T09:07:00.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:59 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:59.709+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.348020+0000 front 2024-09-19T09:06:12.348057+0000 (oldest deadline 2024-09-19T09:06:35.848012+0000) 2024-09-19T09:07:00.070 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:06:59 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:06:59.709+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.950495+0000 front 2024-09-19T09:06:30.950456+0000 (oldest deadline 2024-09-19T09:06:52.550615+0000) 2024-09-19T09:07:00.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:00 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:00.130+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:07:00.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:00 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:00.130+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:07:00.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:00 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:00.130+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:07:00.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:00 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:00.130+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.303831+0000 front 2024-09-19T09:06:11.304084+0000 (oldest deadline 2024-09-19T09:06:37.203943+0000) 2024-09-19T09:07:00.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:00 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:00.130+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.104935+0000 front 2024-09-19T09:06:23.104953+0000 (oldest deadline 2024-09-19T09:06:44.805080+0000) 2024-09-19T09:07:00.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:00 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:00.130+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.706182+0000 front 2024-09-19T09:06:30.706117+0000 (oldest deadline 2024-09-19T09:06:55.906497+0000) 2024-09-19T09:07:00.982 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:00 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:00.534+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:07:00.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:00 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:00.534+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:07:00.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:00 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:00.534+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:07:00.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:00 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:00.534+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:07:00.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:00 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:00.534+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:20.510478+0000 front 2024-09-19T09:06:20.510419+0000 (oldest deadline 2024-09-19T09:06:46.410260+0000) 2024-09-19T09:07:00.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:00 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:00.534+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.311920+0000 front 2024-09-19T09:06:30.312008+0000 (oldest deadline 2024-09-19T09:06:55.011969+0000) 2024-09-19T09:07:01.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:07:00 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:07:00.711+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:07:01.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:07:00 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:07:00.711+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:07:01.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:07:00 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:07:00.711+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.447536+0000 front 2024-09-19T09:06:06.447621+0000 (oldest deadline 2024-09-19T09:06:32.347547+0000) 2024-09-19T09:07:01.070 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:07:00 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:07:00.711+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.348020+0000 front 2024-09-19T09:06:12.348057+0000 (oldest deadline 2024-09-19T09:06:35.848012+0000) 2024-09-19T09:07:01.070 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:07:00 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:07:00.711+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.950495+0000 front 2024-09-19T09:06:30.950456+0000 (oldest deadline 2024-09-19T09:06:52.550615+0000) 2024-09-19T09:07:01.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:01 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:01.141+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:07:01.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:01 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:01.141+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:07:01.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:01 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:01.141+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:07:01.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:01 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:01.141+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.303831+0000 front 2024-09-19T09:06:11.304084+0000 (oldest deadline 2024-09-19T09:06:37.203943+0000) 2024-09-19T09:07:01.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:01 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:01.141+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.104935+0000 front 2024-09-19T09:06:23.104953+0000 (oldest deadline 2024-09-19T09:06:44.805080+0000) 2024-09-19T09:07:01.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:01 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:01.141+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.706182+0000 front 2024-09-19T09:06:30.706117+0000 (oldest deadline 2024-09-19T09:06:55.906497+0000) 2024-09-19T09:07:01.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:01 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:01.141+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-19T09:06:35.907208+0000 front 2024-09-19T09:06:35.907260+0000 (oldest deadline 2024-09-19T09:07:00.607067+0000) 2024-09-19T09:07:01.982 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:01 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:01.507+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:07:01.982 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:01 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:01.507+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:07:01.982 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:01 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:01.507+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:07:01.982 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:01 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:01.507+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:07:01.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:01 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:01.507+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:20.510478+0000 front 2024-09-19T09:06:20.510419+0000 (oldest deadline 2024-09-19T09:06:46.410260+0000) 2024-09-19T09:07:01.983 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:01 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:01.507+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.311920+0000 front 2024-09-19T09:06:30.312008+0000 (oldest deadline 2024-09-19T09:06:55.011969+0000) 2024-09-19T09:07:02.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:07:01 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:07:01.754+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:07:02.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:07:01 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:07:01.754+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:07:02.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:07:01 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:07:01.754+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.447536+0000 front 2024-09-19T09:06:06.447621+0000 (oldest deadline 2024-09-19T09:06:32.347547+0000) 2024-09-19T09:07:02.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:07:01 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:07:01.754+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.348020+0000 front 2024-09-19T09:06:12.348057+0000 (oldest deadline 2024-09-19T09:06:35.848012+0000) 2024-09-19T09:07:02.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:07:01 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:07:01.754+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.950495+0000 front 2024-09-19T09:06:30.950456+0000 (oldest deadline 2024-09-19T09:06:52.550615+0000) 2024-09-19T09:07:02.070 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:07:01 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:07:01.754+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-19T09:06:39.452557+0000 front 2024-09-19T09:06:39.452518+0000 (oldest deadline 2024-09-19T09:07:01.152496+0000) 2024-09-19T09:07:02.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:02 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:02.152+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:07:02.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:02 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:02.152+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:07:02.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:02 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:02.152+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:07:02.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:02 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:02.152+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.303831+0000 front 2024-09-19T09:06:11.304084+0000 (oldest deadline 2024-09-19T09:06:37.203943+0000) 2024-09-19T09:07:02.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:02 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:02.152+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.104935+0000 front 2024-09-19T09:06:23.104953+0000 (oldest deadline 2024-09-19T09:06:44.805080+0000) 2024-09-19T09:07:02.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:02 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:02.152+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.706182+0000 front 2024-09-19T09:06:30.706117+0000 (oldest deadline 2024-09-19T09:06:55.906497+0000) 2024-09-19T09:07:02.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:02 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:02.152+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-19T09:06:35.907208+0000 front 2024-09-19T09:06:35.907260+0000 (oldest deadline 2024-09-19T09:07:00.607067+0000) 2024-09-19T09:07:02.732 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:02 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:02.469+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:07:02.732 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:02 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:02.469+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:07:02.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:02 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:02.469+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:07:02.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:02 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:02.469+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:07:02.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:02 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:02.469+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:20.510478+0000 front 2024-09-19T09:06:20.510419+0000 (oldest deadline 2024-09-19T09:06:46.410260+0000) 2024-09-19T09:07:02.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:02 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:02.469+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.311920+0000 front 2024-09-19T09:06:30.312008+0000 (oldest deadline 2024-09-19T09:06:55.011969+0000) 2024-09-19T09:07:03.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:07:02 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:07:02.736+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:07:03.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:07:02 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:07:02.736+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:07:03.070 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:07:02 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:07:02.736+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.447536+0000 front 2024-09-19T09:06:06.447621+0000 (oldest deadline 2024-09-19T09:06:32.347547+0000) 2024-09-19T09:07:03.070 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:07:02 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:07:02.736+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.348020+0000 front 2024-09-19T09:06:12.348057+0000 (oldest deadline 2024-09-19T09:06:35.848012+0000) 2024-09-19T09:07:03.070 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:07:02 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:07:02.736+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.950495+0000 front 2024-09-19T09:06:30.950456+0000 (oldest deadline 2024-09-19T09:06:52.550615+0000) 2024-09-19T09:07:03.070 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:07:02 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:07:02.736+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-19T09:06:39.452557+0000 front 2024-09-19T09:06:39.452518+0000 (oldest deadline 2024-09-19T09:07:01.152496+0000) 2024-09-19T09:07:03.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:03 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:03.106+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:07:03.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:03 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:03.106+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:07:03.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:03 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:03.106+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:07:03.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:03 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:03.106+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.303831+0000 front 2024-09-19T09:06:11.304084+0000 (oldest deadline 2024-09-19T09:06:37.203943+0000) 2024-09-19T09:07:03.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:03 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:03.106+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.104935+0000 front 2024-09-19T09:06:23.104953+0000 (oldest deadline 2024-09-19T09:06:44.805080+0000) 2024-09-19T09:07:03.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:03 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:03.106+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.706182+0000 front 2024-09-19T09:06:30.706117+0000 (oldest deadline 2024-09-19T09:06:55.906497+0000) 2024-09-19T09:07:03.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:03 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:03.106+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-19T09:06:35.907208+0000 front 2024-09-19T09:06:35.907260+0000 (oldest deadline 2024-09-19T09:07:00.607067+0000) 2024-09-19T09:07:03.732 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:03 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:03.426+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:07:03.732 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:03 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:03.426+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:07:03.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:03 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:03.426+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:07:03.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:03 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:03.426+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:07:03.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:03 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:03.426+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:20.510478+0000 front 2024-09-19T09:06:20.510419+0000 (oldest deadline 2024-09-19T09:06:46.410260+0000) 2024-09-19T09:07:03.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:03 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:03.426+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.311920+0000 front 2024-09-19T09:06:30.312008+0000 (oldest deadline 2024-09-19T09:06:55.011969+0000) 2024-09-19T09:07:04.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:07:03 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:07:03.753+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:46.643908+0000 front 2024-09-19T09:05:46.644133+0000 (oldest deadline 2024-09-19T09:06:10.744296+0000) 2024-09-19T09:07:04.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:07:03 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:07:03.753+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:57.646388+0000 front 2024-09-19T09:05:57.646163+0000 (oldest deadline 2024-09-19T09:06:21.146381+0000) 2024-09-19T09:07:04.070 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:07:03 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:07:03.753+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.447536+0000 front 2024-09-19T09:06:06.447621+0000 (oldest deadline 2024-09-19T09:06:32.347547+0000) 2024-09-19T09:07:04.070 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:07:03 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:07:03.753+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:12.348020+0000 front 2024-09-19T09:06:12.348057+0000 (oldest deadline 2024-09-19T09:06:35.848012+0000) 2024-09-19T09:07:04.070 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:07:03 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:07:03.753+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.950495+0000 front 2024-09-19T09:06:30.950456+0000 (oldest deadline 2024-09-19T09:06:52.550615+0000) 2024-09-19T09:07:04.070 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:07:03 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9[65142]: 2024-09-19T09:07:03.753+0000 7f2beab89640 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-19T09:06:39.452557+0000 front 2024-09-19T09:06:39.452518+0000 (oldest deadline 2024-09-19T09:07:01.152496+0000) 2024-09-19T09:07:04.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:04 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:04.145+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:07:04.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:04 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:04.145+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:07:04.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:04 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:04.145+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:07:04.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:04 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:04.145+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.303831+0000 front 2024-09-19T09:06:11.304084+0000 (oldest deadline 2024-09-19T09:06:37.203943+0000) 2024-09-19T09:07:04.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:04 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:04.145+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.104935+0000 front 2024-09-19T09:06:23.104953+0000 (oldest deadline 2024-09-19T09:06:44.805080+0000) 2024-09-19T09:07:04.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:04 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:04.145+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.706182+0000 front 2024-09-19T09:06:30.706117+0000 (oldest deadline 2024-09-19T09:06:55.906497+0000) 2024-09-19T09:07:04.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:04 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:04.145+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-19T09:06:35.907208+0000 front 2024-09-19T09:06:35.907260+0000 (oldest deadline 2024-09-19T09:07:00.607067+0000) 2024-09-19T09:07:04.607 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:07:04 smithi019 podman[217714]: 2024-09-19 09:07:04.332720198 +0000 UTC m=+5.513094418 container died 98bec916f416616d200b116d622e6e0e597dbbec98d1a535ef175b4dc3be0c74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-19T09:07:04.732 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:04 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:04.422+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:07:04.732 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:04 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:04.422+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:07:04.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:04 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:04.422+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:07:04.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:04 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:04.422+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:07:04.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:04 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:04.422+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:20.510478+0000 front 2024-09-19T09:06:20.510419+0000 (oldest deadline 2024-09-19T09:06:46.410260+0000) 2024-09-19T09:07:04.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:04 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:04.422+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.311920+0000 front 2024-09-19T09:06:30.312008+0000 (oldest deadline 2024-09-19T09:06:55.011969+0000) 2024-09-19T09:07:05.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:07:04 smithi019 podman[217714]: 2024-09-19 09:07:04.805956332 +0000 UTC m=+5.986330587 container cleanup 98bec916f416616d200b116d622e6e0e597dbbec98d1a535ef175b4dc3be0c74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T09:07:05.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:07:04 smithi019 bash[217714]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9 2024-09-19T09:07:05.417 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:07:05 smithi019 podman[217730]: 2024-09-19 09:07:05.098847575 +0000 UTC m=+0.768605142 container remove 98bec916f416616d200b116d622e6e0e597dbbec98d1a535ef175b4dc3be0c74 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD) 2024-09-19T09:07:05.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:05 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:05.135+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:07:05.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:05 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:05.135+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:07:05.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:05 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:05.135+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:07:05.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:05 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:05.135+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.303831+0000 front 2024-09-19T09:06:11.304084+0000 (oldest deadline 2024-09-19T09:06:37.203943+0000) 2024-09-19T09:07:05.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:05 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:05.135+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.104935+0000 front 2024-09-19T09:06:23.104953+0000 (oldest deadline 2024-09-19T09:06:44.805080+0000) 2024-09-19T09:07:05.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:05 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:05.135+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.706182+0000 front 2024-09-19T09:06:30.706117+0000 (oldest deadline 2024-09-19T09:06:55.906497+0000) 2024-09-19T09:07:05.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:05 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:05.135+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-19T09:06:35.907208+0000 front 2024-09-19T09:06:35.907260+0000 (oldest deadline 2024-09-19T09:07:00.607067+0000) 2024-09-19T09:07:05.710 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:07:05 smithi019 podman[217819]: 2024-09-19 09:07:05.319761792 +0000 UTC m=+0.016438044 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:07:05.711 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:07:05 smithi019 podman[217819]: 2024-09-19 09:07:05.432940107 +0000 UTC m=+0.129616351 container create 9109dd5f2b0df1a5e29959b3fb6b383e0739f1a6710db09ba0e22be1831d38f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:07:05.711 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:07:05 smithi019 podman[217819]: 2024-09-19 09:07:05.652201347 +0000 UTC m=+0.348877592 container init 9109dd5f2b0df1a5e29959b3fb6b383e0739f1a6710db09ba0e22be1831d38f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-19T09:07:05.711 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:07:05 smithi019 podman[217819]: 2024-09-19 09:07:05.656124473 +0000 UTC m=+0.352800715 container start 9109dd5f2b0df1a5e29959b3fb6b383e0739f1a6710db09ba0e22be1831d38f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True) 2024-09-19T09:07:05.711 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:07:05 smithi019 podman[217819]: 2024-09-19 09:07:05.710581946 +0000 UTC m=+0.407258197 container attach 9109dd5f2b0df1a5e29959b3fb6b383e0739f1a6710db09ba0e22be1831d38f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9-deactivate, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:07:05.732 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:05 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:05.422+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:07:05.732 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:05 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:05.422+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:07:05.732 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:05 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:05.422+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:07:05.732 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:05 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:05.422+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:07:05.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:05 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:05.422+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:20.510478+0000 front 2024-09-19T09:06:20.510419+0000 (oldest deadline 2024-09-19T09:06:46.410260+0000) 2024-09-19T09:07:05.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:05 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:05.422+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.311920+0000 front 2024-09-19T09:06:30.312008+0000 (oldest deadline 2024-09-19T09:06:55.011969+0000) 2024-09-19T09:07:06.069 INFO:journalctl@ceph.osd.9.smithi019.stdout:Sep 19 09:07:05 smithi019 podman[217819]: 2024-09-19 09:07:05.852713393 +0000 UTC m=+0.549389644 container died 9109dd5f2b0df1a5e29959b3fb6b383e0739f1a6710db09ba0e22be1831d38f2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T09:07:06.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:06 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:06.157+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:07:06.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:06 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:06.157+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:07:06.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:06 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:06.157+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:07:06.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:06 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:06.157+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.303831+0000 front 2024-09-19T09:06:11.304084+0000 (oldest deadline 2024-09-19T09:06:37.203943+0000) 2024-09-19T09:07:06.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:06 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:06.157+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.104935+0000 front 2024-09-19T09:06:23.104953+0000 (oldest deadline 2024-09-19T09:06:44.805080+0000) 2024-09-19T09:07:06.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:06 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:06.157+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.706182+0000 front 2024-09-19T09:06:30.706117+0000 (oldest deadline 2024-09-19T09:06:55.906497+0000) 2024-09-19T09:07:06.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:06 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:06.157+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-19T09:06:35.907208+0000 front 2024-09-19T09:06:35.907260+0000 (oldest deadline 2024-09-19T09:07:00.607067+0000) 2024-09-19T09:07:06.486 DEBUG:teuthology.orchestra.run.smithi019:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@osd.9.service' 2024-09-19T09:07:06.528 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:07:06.528 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-19T09:07:06.528 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-19T09:07:06.529 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-f26c9d84-7662-11ef-bceb-c7b262605968@osd.10 2024-09-19T09:07:06.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:06 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:06.401+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:07:06.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:06 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:06.401+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:07:06.734 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:06 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:06.401+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:07:06.734 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:06 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:06.401+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:07:06.734 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:06 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:06.401+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:20.510478+0000 front 2024-09-19T09:06:20.510419+0000 (oldest deadline 2024-09-19T09:06:46.410260+0000) 2024-09-19T09:07:06.734 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:06 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:06.401+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.311920+0000 front 2024-09-19T09:06:30.312008+0000 (oldest deadline 2024-09-19T09:06:55.011969+0000) 2024-09-19T09:07:06.842 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:06 smithi155 systemd[1]: Stopping Ceph osd.10 for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T09:07:06.842 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:06 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:06.841+0000 7f5a28aef640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:07:06.842 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:06 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:06.841+0000 7f5a28aef640 -1 osd.10 91 *** Got signal Terminated *** 2024-09-19T09:07:07.114 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:06 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:06.841+0000 7f5a28aef640 -1 osd.10 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:07:07.114 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:07 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:07.114+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:07:07.115 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:07 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:07.114+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:07:07.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:07 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:07.114+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:07:07.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:07 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:07.114+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.303831+0000 front 2024-09-19T09:06:11.304084+0000 (oldest deadline 2024-09-19T09:06:37.203943+0000) 2024-09-19T09:07:07.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:07 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:07.114+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.104935+0000 front 2024-09-19T09:06:23.104953+0000 (oldest deadline 2024-09-19T09:06:44.805080+0000) 2024-09-19T09:07:07.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:07 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:07.114+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.706182+0000 front 2024-09-19T09:06:30.706117+0000 (oldest deadline 2024-09-19T09:06:55.906497+0000) 2024-09-19T09:07:07.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:07 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:07.114+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-19T09:06:35.907208+0000 front 2024-09-19T09:06:35.907260+0000 (oldest deadline 2024-09-19T09:07:00.607067+0000) 2024-09-19T09:07:07.732 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:07 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:07.429+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:07:07.732 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:07 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:07.429+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:07:07.732 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:07 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:07.429+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:07:07.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:07 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:07.429+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:07:07.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:07 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:07.429+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:20.510478+0000 front 2024-09-19T09:06:20.510419+0000 (oldest deadline 2024-09-19T09:06:46.410260+0000) 2024-09-19T09:07:07.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:07 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:07.429+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.311920+0000 front 2024-09-19T09:06:30.312008+0000 (oldest deadline 2024-09-19T09:06:55.011969+0000) 2024-09-19T09:07:08.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:08 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:08.125+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:07:08.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:08 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:08.125+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:07:08.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:08 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:08.125+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:07:08.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:08 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:08.125+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.303831+0000 front 2024-09-19T09:06:11.304084+0000 (oldest deadline 2024-09-19T09:06:37.203943+0000) 2024-09-19T09:07:08.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:08 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:08.125+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.104935+0000 front 2024-09-19T09:06:23.104953+0000 (oldest deadline 2024-09-19T09:06:44.805080+0000) 2024-09-19T09:07:08.425 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:08 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:08.125+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.706182+0000 front 2024-09-19T09:06:30.706117+0000 (oldest deadline 2024-09-19T09:06:55.906497+0000) 2024-09-19T09:07:08.425 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:08 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:08.125+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-19T09:06:35.907208+0000 front 2024-09-19T09:06:35.907260+0000 (oldest deadline 2024-09-19T09:07:00.607067+0000) 2024-09-19T09:07:08.732 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:08 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:08.385+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:07:08.732 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:08 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:08.385+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:07:08.732 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:08 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:08.385+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:07:08.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:08 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:08.385+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:07:08.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:08 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:08.385+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:20.510478+0000 front 2024-09-19T09:06:20.510419+0000 (oldest deadline 2024-09-19T09:06:46.410260+0000) 2024-09-19T09:07:08.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:08 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:08.386+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.311920+0000 front 2024-09-19T09:06:30.312008+0000 (oldest deadline 2024-09-19T09:06:55.011969+0000) 2024-09-19T09:07:09.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:09 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:09.133+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:07:09.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:09 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:09.133+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:07:09.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:09 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:09.133+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:07:09.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:09 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:09.133+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.303831+0000 front 2024-09-19T09:06:11.304084+0000 (oldest deadline 2024-09-19T09:06:37.203943+0000) 2024-09-19T09:07:09.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:09 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:09.133+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.104935+0000 front 2024-09-19T09:06:23.104953+0000 (oldest deadline 2024-09-19T09:06:44.805080+0000) 2024-09-19T09:07:09.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:09 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:09.133+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.706182+0000 front 2024-09-19T09:06:30.706117+0000 (oldest deadline 2024-09-19T09:06:55.906497+0000) 2024-09-19T09:07:09.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:09 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:09.133+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-19T09:06:35.907208+0000 front 2024-09-19T09:06:35.907260+0000 (oldest deadline 2024-09-19T09:07:00.607067+0000) 2024-09-19T09:07:09.634 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:09 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:09.336+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:07:09.634 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:09 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:09.336+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:07:09.634 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:09 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:09.336+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:07:09.634 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:09 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:09.336+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:07:09.634 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:09 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:09.336+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:20.510478+0000 front 2024-09-19T09:06:20.510419+0000 (oldest deadline 2024-09-19T09:06:46.410260+0000) 2024-09-19T09:07:09.634 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:09 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:09.336+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.311920+0000 front 2024-09-19T09:06:30.312008+0000 (oldest deadline 2024-09-19T09:06:55.011969+0000) 2024-09-19T09:07:10.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:10 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:10.088+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:07:10.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:10 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:10.088+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:07:10.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:10 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:10.088+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:07:10.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:10 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:10.088+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.303831+0000 front 2024-09-19T09:06:11.304084+0000 (oldest deadline 2024-09-19T09:06:37.203943+0000) 2024-09-19T09:07:10.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:10 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:10.088+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.104935+0000 front 2024-09-19T09:06:23.104953+0000 (oldest deadline 2024-09-19T09:06:44.805080+0000) 2024-09-19T09:07:10.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:10 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:10.088+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.706182+0000 front 2024-09-19T09:06:30.706117+0000 (oldest deadline 2024-09-19T09:06:55.906497+0000) 2024-09-19T09:07:10.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:10 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:10.088+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-19T09:06:35.907208+0000 front 2024-09-19T09:06:35.907260+0000 (oldest deadline 2024-09-19T09:07:00.607067+0000) 2024-09-19T09:07:10.732 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:10 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:10.336+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:07:10.732 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:10 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:10.336+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:07:10.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:10 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:10.336+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:07:10.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:10 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:10.336+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:07:10.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:10 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:10.336+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:20.510478+0000 front 2024-09-19T09:06:20.510419+0000 (oldest deadline 2024-09-19T09:06:46.410260+0000) 2024-09-19T09:07:10.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:10 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:10.336+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.311920+0000 front 2024-09-19T09:06:30.312008+0000 (oldest deadline 2024-09-19T09:06:55.011969+0000) 2024-09-19T09:07:11.389 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:11 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:11.078+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.100194+0000 front 2024-09-19T09:05:48.100182+0000 (oldest deadline 2024-09-19T09:06:11.500528+0000) 2024-09-19T09:07:11.389 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:11 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:11.078+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.101788+0000 front 2024-09-19T09:05:59.101711+0000 (oldest deadline 2024-09-19T09:06:22.001834+0000) 2024-09-19T09:07:11.389 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:11 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:11.078+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.103005+0000 front 2024-09-19T09:06:06.103224+0000 (oldest deadline 2024-09-19T09:06:30.802844+0000) 2024-09-19T09:07:11.389 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:11 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:11.078+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:11.303831+0000 front 2024-09-19T09:06:11.304084+0000 (oldest deadline 2024-09-19T09:06:37.203943+0000) 2024-09-19T09:07:11.389 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:11 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:11.078+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:23.104935+0000 front 2024-09-19T09:06:23.104953+0000 (oldest deadline 2024-09-19T09:06:44.805080+0000) 2024-09-19T09:07:11.389 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:11 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:11.078+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.706182+0000 front 2024-09-19T09:06:30.706117+0000 (oldest deadline 2024-09-19T09:06:55.906497+0000) 2024-09-19T09:07:11.390 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:11 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10[60206]: 2024-09-19T09:07:11.078+0000 7f5a210fd640 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.19:6822 osd.6 since back 2024-09-19T09:06:35.907208+0000 front 2024-09-19T09:06:35.907260+0000 (oldest deadline 2024-09-19T09:07:00.607067+0000) 2024-09-19T09:07:11.732 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:11 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:11.336+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:07:11.732 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:11 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:11.336+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:07:11.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:11 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:11.336+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:07:11.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:11 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:11.336+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:07:11.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:11 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:11.336+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:20.510478+0000 front 2024-09-19T09:06:20.510419+0000 (oldest deadline 2024-09-19T09:06:46.410260+0000) 2024-09-19T09:07:11.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:11 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:11.336+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.311920+0000 front 2024-09-19T09:06:30.312008+0000 (oldest deadline 2024-09-19T09:06:55.011969+0000) 2024-09-19T09:07:12.475 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:12 smithi155 podman[71570]: 2024-09-19 09:07:12.212746276 +0000 UTC m=+5.481775008 container died bd16a8bddee9225d1e94202c7282753231c931c8de7e47e50c7a5f8230306840 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-2f599a4, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-19T09:07:12.732 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:12 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:12.334+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:07:12.732 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:12 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:12.334+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:07:12.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:12 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:12.334+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:07:12.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:12 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:12.334+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:07:12.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:12 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:12.334+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:20.510478+0000 front 2024-09-19T09:06:20.510419+0000 (oldest deadline 2024-09-19T09:06:46.410260+0000) 2024-09-19T09:07:12.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:12 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:12.334+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.311920+0000 front 2024-09-19T09:06:30.312008+0000 (oldest deadline 2024-09-19T09:06:55.011969+0000) 2024-09-19T09:07:12.859 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:12 smithi155 podman[71570]: 2024-09-19 09:07:12.574442432 +0000 UTC m=+5.843471173 container cleanup bd16a8bddee9225d1e94202c7282753231c931c8de7e47e50c7a5f8230306840 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-19T09:07:12.859 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:12 smithi155 bash[71570]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10 2024-09-19T09:07:13.165 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:12 smithi155 podman[71585]: 2024-09-19 09:07:12.859154754 +0000 UTC m=+0.646835034 container remove bd16a8bddee9225d1e94202c7282753231c931c8de7e47e50c7a5f8230306840 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True) 2024-09-19T09:07:13.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:13 smithi155 podman[71673]: 2024-09-19 09:07:13.068027251 +0000 UTC m=+0.015433326 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:07:13.423 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:13 smithi155 podman[71673]: 2024-09-19 09:07:13.16807712 +0000 UTC m=+0.115483245 container create 217f7da31bcda74748cb7c8074a27ce229d2a427fe2bfcc106f7a9f1e9a793e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10-deactivate, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:07:13.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:13 smithi155 podman[71673]: 2024-09-19 09:07:13.378951792 +0000 UTC m=+0.326357863 container init 217f7da31bcda74748cb7c8074a27ce229d2a427fe2bfcc106f7a9f1e9a793e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-19T09:07:13.424 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:13 smithi155 podman[71673]: 2024-09-19 09:07:13.38245292 +0000 UTC m=+0.329858992 container start 217f7da31bcda74748cb7c8074a27ce229d2a427fe2bfcc106f7a9f1e9a793e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4) 2024-09-19T09:07:13.732 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:13 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:13.321+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:07:13.732 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:13 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:13.321+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:07:13.732 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:13 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:13.321+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:07:13.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:13 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:13.321+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:07:13.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:13 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:13.321+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:20.510478+0000 front 2024-09-19T09:06:20.510419+0000 (oldest deadline 2024-09-19T09:06:46.410260+0000) 2024-09-19T09:07:13.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:13 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:13.321+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.311920+0000 front 2024-09-19T09:06:30.312008+0000 (oldest deadline 2024-09-19T09:06:55.011969+0000) 2024-09-19T09:07:13.923 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:13 smithi155 podman[71673]: 2024-09-19 09:07:13.470307406 +0000 UTC m=+0.417713488 container attach 217f7da31bcda74748cb7c8074a27ce229d2a427fe2bfcc106f7a9f1e9a793e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T09:07:13.923 INFO:journalctl@ceph.osd.10.smithi155.stdout:Sep 19 09:07:13 smithi155 podman[71673]: 2024-09-19 09:07:13.570304308 +0000 UTC m=+0.517710379 container died 217f7da31bcda74748cb7c8074a27ce229d2a427fe2bfcc106f7a9f1e9a793e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-19T09:07:14.231 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@osd.10.service' 2024-09-19T09:07:14.274 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:07:14.274 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-19T09:07:14.274 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-19T09:07:14.275 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-f26c9d84-7662-11ef-bceb-c7b262605968@osd.11 2024-09-19T09:07:14.615 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:14 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:14.275+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:07:14.615 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:14 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:14.275+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:07:14.615 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:14 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:14.275+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:07:14.615 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:14 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:14.275+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:07:14.616 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:14 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:14.275+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:20.510478+0000 front 2024-09-19T09:06:20.510419+0000 (oldest deadline 2024-09-19T09:06:46.410260+0000) 2024-09-19T09:07:14.616 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:14 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:14.275+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.311920+0000 front 2024-09-19T09:06:30.312008+0000 (oldest deadline 2024-09-19T09:06:55.011969+0000) 2024-09-19T09:07:14.616 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:14 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:14.275+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6820 osd.7 since back 2024-09-19T09:06:47.814182+0000 front 2024-09-19T09:06:47.814121+0000 (oldest deadline 2024-09-19T09:07:13.714085+0000) 2024-09-19T09:07:14.616 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:14 smithi203 systemd[1]: Stopping Ceph osd.11 for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T09:07:14.982 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:14 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:14.614+0000 7fa2998a4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:07:14.982 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:14 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:14.614+0000 7fa2998a4640 -1 osd.11 91 *** Got signal Terminated *** 2024-09-19T09:07:14.982 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:14 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:14.614+0000 7fa2998a4640 -1 osd.11 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T09:07:15.732 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:15 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:15.290+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:07:15.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:15 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:15.290+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:07:15.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:15 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:15.290+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:07:15.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:15 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:15.290+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:07:15.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:15 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:15.290+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:20.510478+0000 front 2024-09-19T09:06:20.510419+0000 (oldest deadline 2024-09-19T09:06:46.410260+0000) 2024-09-19T09:07:15.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:15 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:15.290+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.311920+0000 front 2024-09-19T09:06:30.312008+0000 (oldest deadline 2024-09-19T09:06:55.011969+0000) 2024-09-19T09:07:15.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:15 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:15.290+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6820 osd.7 since back 2024-09-19T09:06:47.814182+0000 front 2024-09-19T09:06:47.814121+0000 (oldest deadline 2024-09-19T09:07:13.714085+0000) 2024-09-19T09:07:16.732 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:16 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:16.285+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:07:16.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:16 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:16.285+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:07:16.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:16 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:16.285+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:07:16.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:16 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:16.285+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:07:16.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:16 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:16.285+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:20.510478+0000 front 2024-09-19T09:06:20.510419+0000 (oldest deadline 2024-09-19T09:06:46.410260+0000) 2024-09-19T09:07:16.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:16 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:16.285+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.311920+0000 front 2024-09-19T09:06:30.312008+0000 (oldest deadline 2024-09-19T09:06:55.011969+0000) 2024-09-19T09:07:16.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:16 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:16.285+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6820 osd.7 since back 2024-09-19T09:06:47.814182+0000 front 2024-09-19T09:06:47.814121+0000 (oldest deadline 2024-09-19T09:07:13.714085+0000) 2024-09-19T09:07:17.732 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:17 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:17.235+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:07:17.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:17 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:17.235+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:07:17.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:17 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:17.235+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:07:17.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:17 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:17.235+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:07:17.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:17 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:17.235+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:20.510478+0000 front 2024-09-19T09:06:20.510419+0000 (oldest deadline 2024-09-19T09:06:46.410260+0000) 2024-09-19T09:07:17.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:17 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:17.235+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.311920+0000 front 2024-09-19T09:06:30.312008+0000 (oldest deadline 2024-09-19T09:06:55.011969+0000) 2024-09-19T09:07:17.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:17 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:17.235+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6820 osd.7 since back 2024-09-19T09:06:47.814182+0000 front 2024-09-19T09:06:47.814121+0000 (oldest deadline 2024-09-19T09:07:13.714085+0000) 2024-09-19T09:07:18.482 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:18 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:18.229+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:07:18.483 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:18 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:18.229+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:07:18.483 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:18 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:18.229+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:07:18.483 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:18 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:18.229+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:07:18.483 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:18 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:18.229+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:20.510478+0000 front 2024-09-19T09:06:20.510419+0000 (oldest deadline 2024-09-19T09:06:46.410260+0000) 2024-09-19T09:07:18.483 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:18 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:18.229+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.311920+0000 front 2024-09-19T09:06:30.312008+0000 (oldest deadline 2024-09-19T09:06:55.011969+0000) 2024-09-19T09:07:18.483 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:18 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:18.229+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6820 osd.7 since back 2024-09-19T09:06:47.814182+0000 front 2024-09-19T09:06:47.814121+0000 (oldest deadline 2024-09-19T09:07:13.714085+0000) 2024-09-19T09:07:19.732 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:19 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:19.234+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6806 osd.0 since back 2024-09-19T09:05:48.704956+0000 front 2024-09-19T09:05:48.704859+0000 (oldest deadline 2024-09-19T09:06:14.604716+0000) 2024-09-19T09:07:19.732 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:19 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:19.234+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6804 osd.1 since back 2024-09-19T09:05:59.305660+0000 front 2024-09-19T09:05:59.305683+0000 (oldest deadline 2024-09-19T09:06:20.906080+0000) 2024-09-19T09:07:19.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:19 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:19.234+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-09-19T09:06:06.707341+0000 front 2024-09-19T09:06:06.707407+0000 (oldest deadline 2024-09-19T09:06:30.807470+0000) 2024-09-19T09:07:19.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:19 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:19.234+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.19:6814 osd.3 since back 2024-09-19T09:06:13.509332+0000 front 2024-09-19T09:06:13.509373+0000 (oldest deadline 2024-09-19T09:06:38.209219+0000) 2024-09-19T09:07:19.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:19 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:19.234+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6812 osd.4 since back 2024-09-19T09:06:20.510478+0000 front 2024-09-19T09:06:20.510419+0000 (oldest deadline 2024-09-19T09:06:46.410260+0000) 2024-09-19T09:07:19.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:19 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:19.234+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-09-19T09:06:30.311920+0000 front 2024-09-19T09:06:30.312008+0000 (oldest deadline 2024-09-19T09:06:55.011969+0000) 2024-09-19T09:07:19.733 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:19 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11[60489]: 2024-09-19T09:07:19.234+0000 7fa295eba640 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.155:6820 osd.7 since back 2024-09-19T09:06:47.814182+0000 front 2024-09-19T09:06:47.814121+0000 (oldest deadline 2024-09-19T09:07:13.714085+0000) 2024-09-19T09:07:20.449 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:20 smithi203 podman[71519]: 2024-09-19 09:07:20.182680795 +0000 UTC m=+5.713861931 container died 73caf4b0f6685b82e3c2ca2fe2f66aaef812be99737ba0f291e82b2b9062d463 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=) 2024-09-19T09:07:20.732 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:20 smithi203 podman[71519]: 2024-09-19 09:07:20.531020858 +0000 UTC m=+6.062202063 container cleanup 73caf4b0f6685b82e3c2ca2fe2f66aaef812be99737ba0f291e82b2b9062d463 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:07:20.732 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:20 smithi203 bash[71519]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11 2024-09-19T09:07:21.097 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:20 smithi203 podman[71534]: 2024-09-19 09:07:20.782347597 +0000 UTC m=+0.598110788 container remove 73caf4b0f6685b82e3c2ca2fe2f66aaef812be99737ba0f291e82b2b9062d463 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T09:07:21.394 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:21 smithi203 podman[71625]: 2024-09-19 09:07:20.999873267 +0000 UTC m=+0.015436791 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T09:07:21.394 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:21 smithi203 podman[71625]: 2024-09-19 09:07:21.108268446 +0000 UTC m=+0.123832001 container create d0713e8fa0bd3bd7e3c981d105b3a5906169d23cb5f45b8cf2f2211d350ebdba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-19T09:07:21.394 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:21 smithi203 podman[71625]: 2024-09-19 09:07:21.319241193 +0000 UTC m=+0.334804706 container init d0713e8fa0bd3bd7e3c981d105b3a5906169d23cb5f45b8cf2f2211d350ebdba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:07:21.395 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:21 smithi203 podman[71625]: 2024-09-19 09:07:21.322583875 +0000 UTC m=+0.338147399 container start d0713e8fa0bd3bd7e3c981d105b3a5906169d23cb5f45b8cf2f2211d350ebdba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-19T09:07:21.395 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:21 smithi203 podman[71625]: 2024-09-19 09:07:21.394305915 +0000 UTC m=+0.409869430 container attach d0713e8fa0bd3bd7e3c981d105b3a5906169d23cb5f45b8cf2f2211d350ebdba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:07:21.732 INFO:journalctl@ceph.osd.11.smithi203.stdout:Sep 19 09:07:21 smithi203 podman[71625]: 2024-09-19 09:07:21.514883378 +0000 UTC m=+0.530446898 container died d0713e8fa0bd3bd7e3c981d105b3a5906169d23cb5f45b8cf2f2211d350ebdba (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-19T09:07:22.235 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@osd.11.service' 2024-09-19T09:07:22.276 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:07:22.276 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-19T09:07:22.276 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-19T09:07:22.276 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.a 2024-09-19T09:07:22.569 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 19 09:07:22 smithi019 systemd[1]: Stopping Ceph mds.a for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T09:07:23.069 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 19 09:07:22 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-a[72333]: 2024-09-19T09:07:22.583+0000 7f6302f70640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:07:23.069 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 19 09:07:22 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-a[72333]: 2024-09-19T09:07:22.583+0000 7f6302f70640 -1 mds.a *** got signal Terminated *** 2024-09-19T09:07:25.992 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 19 09:07:25 smithi019 podman[217944]: 2024-09-19 09:07:25.609802846 +0000 UTC m=+3.127648230 container died 0f6edd0d91194edf52c01426a700948fa8c21b98fb2ad0dad5572f92937e9a88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-a, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T09:07:26.319 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 19 09:07:26 smithi019 podman[217944]: 2024-09-19 09:07:26.141139893 +0000 UTC m=+3.658985325 container cleanup 0f6edd0d91194edf52c01426a700948fa8c21b98fb2ad0dad5572f92937e9a88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-a, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-19T09:07:26.319 INFO:journalctl@ceph.mds.a.smithi019.stdout:Sep 19 09:07:26 smithi019 bash[217944]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-a 2024-09-19T09:07:26.580 DEBUG:teuthology.orchestra.run.smithi019:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.a.service' 2024-09-19T09:07:26.617 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:07:26.617 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-19T09:07:26.618 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-19T09:07:26.618 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.d 2024-09-19T09:07:26.954 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 19 09:07:26 smithi019 systemd[1]: Stopping Ceph mds.d for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T09:07:27.319 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 19 09:07:26 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-d[71142]: 2024-09-19T09:07:26.953+0000 7fd8390bc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:07:27.319 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 19 09:07:26 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-d[71142]: 2024-09-19T09:07:26.953+0000 7fd8390bc640 -1 mds.d *** got signal Terminated *** 2024-09-19T09:07:31.254 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 19 09:07:30 smithi019 podman[218065]: 2024-09-19 09:07:30.969862258 +0000 UTC m=+4.116679520 container died d7a2d18f594e3e241be696d83b2b29a9aef7a8ab0817f268f2353d9cfd45b434 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-19T09:07:31.569 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 19 09:07:31 smithi019 podman[218065]: 2024-09-19 09:07:31.328475299 +0000 UTC m=+4.475292558 container cleanup d7a2d18f594e3e241be696d83b2b29a9aef7a8ab0817f268f2353d9cfd45b434 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-d, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:07:31.569 INFO:journalctl@ceph.mds.d.smithi019.stdout:Sep 19 09:07:31 smithi019 bash[218065]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-d 2024-09-19T09:07:31.778 DEBUG:teuthology.orchestra.run.smithi019:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.d.service' 2024-09-19T09:07:31.813 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:07:31.813 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-19T09:07:31.813 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-19T09:07:31.814 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.g 2024-09-19T09:07:32.133 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:07:31 smithi019 systemd[1]: Stopping Ceph mds.g for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T09:07:32.569 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:07:32 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-g[205495]: 2024-09-19T09:07:32.132+0000 7fa3432d0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:07:32.569 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:07:32 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-g[205495]: 2024-09-19T09:07:32.132+0000 7fa3432d0640 -1 mds.g *** got signal Terminated *** 2024-09-19T09:07:35.390 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:07:35 smithi019 podman[218186]: 2024-09-19 09:07:35.136414171 +0000 UTC m=+3.097717045 container died f83aaeebe936bf13065721668f4fa528b3093b78aa4854deb06e315c8ccea37e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-g, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-19T09:07:35.766 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:07:35 smithi019 podman[218186]: 2024-09-19 09:07:35.565470411 +0000 UTC m=+3.526773286 container cleanup f83aaeebe936bf13065721668f4fa528b3093b78aa4854deb06e315c8ccea37e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-19T09:07:35.767 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:07:35 smithi019 bash[218186]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-g 2024-09-19T09:07:36.007 DEBUG:teuthology.orchestra.run.smithi019:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.g.service' 2024-09-19T09:07:36.029 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:07:35 smithi019 podman[218199]: 2024-09-19 09:07:35.766807507 +0000 UTC m=+0.623740096 container remove f83aaeebe936bf13065721668f4fa528b3093b78aa4854deb06e315c8ccea37e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-g, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-19T09:07:36.029 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:07:36 smithi019 systemd[1]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.g.service: Deactivated successfully. 2024-09-19T09:07:36.030 INFO:journalctl@ceph.mds.g.smithi019.stdout:Sep 19 09:07:36 smithi019 systemd[1]: Stopped Ceph mds.g for f26c9d84-7662-11ef-bceb-c7b262605968. 2024-09-19T09:07:36.041 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:07:36.041 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-19T09:07:36.041 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-19T09:07:36.041 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.j 2024-09-19T09:07:36.319 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 19 09:07:36 smithi019 systemd[1]: Stopping Ceph mds.j for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T09:07:36.819 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 19 09:07:36 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-j[70727]: 2024-09-19T09:07:36.377+0000 7f8c9fa16640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:07:36.819 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 19 09:07:36 smithi019 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-j[70727]: 2024-09-19T09:07:36.377+0000 7f8c9fa16640 -1 mds.j *** got signal Terminated *** 2024-09-19T09:07:37.870 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 19 09:07:37 smithi019 podman[218307]: 2024-09-19 09:07:37.606529424 +0000 UTC m=+1.344137128 container died ea2658f680ce482dd74808837bbddc4ee96782f5bdbd906f7b32e401cf9d3236 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-j, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T09:07:38.145 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 19 09:07:37 smithi019 podman[218307]: 2024-09-19 09:07:37.952871246 +0000 UTC m=+1.690478939 container cleanup ea2658f680ce482dd74808837bbddc4ee96782f5bdbd906f7b32e401cf9d3236 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-j, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:07:38.145 INFO:journalctl@ceph.mds.j.smithi019.stdout:Sep 19 09:07:37 smithi019 bash[218307]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-j 2024-09-19T09:07:38.371 DEBUG:teuthology.orchestra.run.smithi019:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.j.service' 2024-09-19T09:07:38.403 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:07:38.403 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-19T09:07:38.404 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-19T09:07:38.404 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.b 2024-09-19T09:07:38.707 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 09:07:38 smithi155 systemd[1]: Stopping Ceph mds.b for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T09:07:38.973 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 09:07:38 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-b[65837]: 2024-09-19T09:07:38.706+0000 7fcd99322640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:07:38.973 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 09:07:38 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-b[65837]: 2024-09-19T09:07:38.706+0000 7fcd99322640 -1 mds.b *** got signal Terminated *** 2024-09-19T09:07:41.874 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 09:07:41 smithi155 podman[71778]: 2024-09-19 09:07:41.589636551 +0000 UTC m=+2.986549682 container died 8ec6d2ddad3c9b3e58a2d030a7d557ebf64926da40fb67166f0d7091b9794c6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2) 2024-09-19T09:07:42.173 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 09:07:41 smithi155 podman[71778]: 2024-09-19 09:07:41.982066856 +0000 UTC m=+3.378979986 container cleanup 8ec6d2ddad3c9b3e58a2d030a7d557ebf64926da40fb67166f0d7091b9794c6d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-b, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-19T09:07:42.173 INFO:journalctl@ceph.mds.b.smithi155.stdout:Sep 19 09:07:41 smithi155 bash[71778]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-b 2024-09-19T09:07:42.419 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.b.service' 2024-09-19T09:07:42.455 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:07:42.455 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-19T09:07:42.455 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-19T09:07:42.456 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.e 2024-09-19T09:07:42.794 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 09:07:42 smithi155 systemd[1]: Stopping Ceph mds.e for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T09:07:43.173 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 09:07:42 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-e[68808]: 2024-09-19T09:07:42.793+0000 7f71aecc0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:07:43.173 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 09:07:42 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-e[68808]: 2024-09-19T09:07:42.793+0000 7f71aecc0640 -1 mds.e *** got signal Terminated *** 2024-09-19T09:07:45.877 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 09:07:45 smithi155 podman[71907]: 2024-09-19 09:07:45.581971222 +0000 UTC m=+2.912695010 container died b8d118788cbe26ea4ea9cfa793d01584f0a586bd599dc0b168ddf1d7b4466cc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-e, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:07:46.173 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 09:07:45 smithi155 podman[71907]: 2024-09-19 09:07:45.960237109 +0000 UTC m=+3.290960888 container cleanup b8d118788cbe26ea4ea9cfa793d01584f0a586bd599dc0b168ddf1d7b4466cc6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-e, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T09:07:46.173 INFO:journalctl@ceph.mds.e.smithi155.stdout:Sep 19 09:07:45 smithi155 bash[71907]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-e 2024-09-19T09:07:46.385 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.e.service' 2024-09-19T09:07:46.418 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:07:46.419 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-19T09:07:46.419 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-19T09:07:46.419 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.h 2024-09-19T09:07:46.923 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 19 09:07:46 smithi155 systemd[1]: Stopping Ceph mds.h for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T09:07:46.923 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 19 09:07:46 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-h[65524]: 2024-09-19T09:07:46.721+0000 7fc9c6608640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:07:46.923 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 19 09:07:46 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-h[65524]: 2024-09-19T09:07:46.721+0000 7fc9c6608640 -1 mds.h *** got signal Terminated *** 2024-09-19T09:07:49.841 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 19 09:07:49 smithi155 podman[72029]: 2024-09-19 09:07:49.586858545 +0000 UTC m=+2.953948107 container died 609fef8bb1bd4688b42976ab9436d46d706ff7c9f1e89c040644d8054fcd9cfd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-19T09:07:50.148 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 19 09:07:49 smithi155 podman[72029]: 2024-09-19 09:07:49.905564641 +0000 UTC m=+3.272654202 container cleanup 609fef8bb1bd4688b42976ab9436d46d706ff7c9f1e89c040644d8054fcd9cfd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-h, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-19T09:07:50.148 INFO:journalctl@ceph.mds.h.smithi155.stdout:Sep 19 09:07:49 smithi155 bash[72029]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-h 2024-09-19T09:07:50.374 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.h.service' 2024-09-19T09:07:50.406 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:07:50.406 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-19T09:07:50.407 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-19T09:07:50.407 DEBUG:teuthology.orchestra.run.smithi155:> sudo systemctl stop ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.k 2024-09-19T09:07:50.673 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 19 09:07:50 smithi155 systemd[1]: Stopping Ceph mds.k for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T09:07:51.173 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 19 09:07:50 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-k[64908]: 2024-09-19T09:07:50.709+0000 7f10ccfb3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:07:51.173 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 19 09:07:50 smithi155 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-k[64908]: 2024-09-19T09:07:50.709+0000 7f10ccfb3640 -1 mds.k *** got signal Terminated *** 2024-09-19T09:07:53.859 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 19 09:07:53 smithi155 podman[72152]: 2024-09-19 09:07:53.586189393 +0000 UTC m=+2.966941841 container died 4e4dcdc47989dcf1497398007fc143654d2fd4fff6fa8c36fb7792c6f296b8fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-k, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-19T09:07:54.173 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 19 09:07:53 smithi155 podman[72152]: 2024-09-19 09:07:53.942130051 +0000 UTC m=+3.322882482 container cleanup 4e4dcdc47989dcf1497398007fc143654d2fd4fff6fa8c36fb7792c6f296b8fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-k, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T09:07:54.174 INFO:journalctl@ceph.mds.k.smithi155.stdout:Sep 19 09:07:53 smithi155 bash[72152]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-k 2024-09-19T09:07:54.341 DEBUG:teuthology.orchestra.run.smithi155:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.k.service' 2024-09-19T09:07:54.374 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:07:54.374 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-19T09:07:54.374 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-19T09:07:54.375 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.c 2024-09-19T09:07:54.732 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 09:07:54 smithi203 systemd[1]: Stopping Ceph mds.c for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T09:07:54.994 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 09:07:54 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-c[65758]: 2024-09-19T09:07:54.872+0000 7f5484345640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:07:54.994 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 09:07:54 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-c[65758]: 2024-09-19T09:07:54.872+0000 7f5484345640 -1 mds.c *** got signal Terminated *** 2024-09-19T09:07:57.983 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 09:07:57 smithi203 podman[71728]: 2024-09-19 09:07:57.566459828 +0000 UTC m=+2.998083466 container died e7da5fc02f01a531241c31e010689ab99770b6c162202020b22cdfd820b3c6fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-c, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-19T09:07:58.399 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 09:07:58 smithi203 podman[71728]: 2024-09-19 09:07:58.172403679 +0000 UTC m=+3.604027320 container cleanup e7da5fc02f01a531241c31e010689ab99770b6c162202020b22cdfd820b3c6fc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-c, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:07:58.399 INFO:journalctl@ceph.mds.c.smithi203.stdout:Sep 19 09:07:58 smithi203 bash[71728]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-c 2024-09-19T09:07:58.543 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.c.service' 2024-09-19T09:07:58.580 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:07:58.580 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-19T09:07:58.580 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-19T09:07:58.580 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.f 2024-09-19T09:07:58.982 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 09:07:58 smithi203 systemd[1]: Stopping Ceph mds.f for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T09:07:58.982 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 09:07:58 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-f[65455]: 2024-09-19T09:07:58.885+0000 7fcfa245d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:07:58.983 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 09:07:58 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-f[65455]: 2024-09-19T09:07:58.885+0000 7fcfa245d640 -1 mds.f *** got signal Terminated *** 2024-09-19T09:08:01.861 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 09:08:01 smithi203 podman[71863]: 2024-09-19 09:08:01.558816417 +0000 UTC m=+2.758406920 container died 6cb766f17c95e3cb628268e6552fbed60668c8fa15b82cda13f68ec15d6dcb8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-f, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T09:08:02.169 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 09:08:01 smithi203 podman[71863]: 2024-09-19 09:08:01.935323228 +0000 UTC m=+3.134913730 container cleanup 6cb766f17c95e3cb628268e6552fbed60668c8fa15b82cda13f68ec15d6dcb8f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-f, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True) 2024-09-19T09:08:02.170 INFO:journalctl@ceph.mds.f.smithi203.stdout:Sep 19 09:08:01 smithi203 bash[71863]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-f 2024-09-19T09:08:02.317 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.f.service' 2024-09-19T09:08:02.350 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:08:02.351 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-19T09:08:02.351 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-19T09:08:02.351 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.i 2024-09-19T09:08:02.732 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 09:08:02 smithi203 systemd[1]: Stopping Ceph mds.i for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T09:08:02.732 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 09:08:02 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-i[66059]: 2024-09-19T09:08:02.664+0000 7f3ed8e54640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:08:02.733 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 09:08:02 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-i[66059]: 2024-09-19T09:08:02.664+0000 7f3ed8e54640 -1 mds.i *** got signal Terminated *** 2024-09-19T09:08:05.732 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 09:08:05 smithi203 podman[71984]: 2024-09-19 09:08:05.577238145 +0000 UTC m=+3.008992612 container died 6d3c36377a0ea8151eae48c689d8c02af9536232ce2a58e5da8830f6e749e9d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-i, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-19T09:08:06.215 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 09:08:05 smithi203 podman[71984]: 2024-09-19 09:08:05.95576166 +0000 UTC m=+3.387516127 container cleanup 6d3c36377a0ea8151eae48c689d8c02af9536232ce2a58e5da8830f6e749e9d4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-i, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-19T09:08:06.215 INFO:journalctl@ceph.mds.i.smithi203.stdout:Sep 19 09:08:05 smithi203 bash[71984]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-i 2024-09-19T09:08:06.358 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.i.service' 2024-09-19T09:08:06.390 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:08:06.391 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-19T09:08:06.391 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-19T09:08:06.391 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.l 2024-09-19T09:08:06.732 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 09:08:06 smithi203 systemd[1]: Stopping Ceph mds.l for f26c9d84-7662-11ef-bceb-c7b262605968... 2024-09-19T09:08:06.732 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 09:08:06 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-l[65150]: 2024-09-19T09:08:06.700+0000 7f368733f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T09:08:06.733 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 09:08:06 smithi203 ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-l[65150]: 2024-09-19T09:08:06.700+0000 7f368733f640 -1 mds.l *** got signal Terminated *** 2024-09-19T09:08:09.851 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 09:08:09 smithi203 podman[72104]: 2024-09-19 09:08:09.562473543 +0000 UTC m=+2.957371210 container died d54305bb0683f5b9b1eb0c3503bc9e11587924e7b9db125f38b79af72c045655 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-l, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-19T09:08:09.852 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 09:08:09 smithi203 podman[72104]: 2024-09-19 09:08:09.85161136 +0000 UTC m=+3.246509027 container cleanup d54305bb0683f5b9b1eb0c3503bc9e11587924e7b9db125f38b79af72c045655 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-l, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T09:08:10.188 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 09:08:09 smithi203 bash[72104]: ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-l 2024-09-19T09:08:10.188 INFO:journalctl@ceph.mds.l.smithi203.stdout:Sep 19 09:08:10 smithi203 podman[72118]: 2024-09-19 09:08:10.086097983 +0000 UTC m=+0.516739006 container remove d54305bb0683f5b9b1eb0c3503bc9e11587924e7b9db125f38b79af72c045655 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-f26c9d84-7662-11ef-bceb-c7b262605968-mds-l, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T09:08:10.207 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f26c9d84-7662-11ef-bceb-c7b262605968@mds.l.service' 2024-09-19T09:08:10.238 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T09:08:10.239 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-19T09:08:10.239 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f26c9d84-7662-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T09:08:10.454 INFO:teuthology.orchestra.run.smithi019.stdout:Deleting cluster with fsid: f26c9d84-7662-11ef-bceb-c7b262605968 2024-09-19T09:08:13.741 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f26c9d84-7662-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T09:08:13.944 INFO:teuthology.orchestra.run.smithi155.stdout:Deleting cluster with fsid: f26c9d84-7662-11ef-bceb-c7b262605968 2024-09-19T09:08:16.506 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f26c9d84-7662-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T09:08:16.707 INFO:teuthology.orchestra.run.smithi203.stdout:Deleting cluster with fsid: f26c9d84-7662-11ef-bceb-c7b262605968 2024-09-19T09:08:19.057 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:08:19.093 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:08:19.125 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T09:08:19.153 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-19T09:08:19.156 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911866/remote/smithi019/crash 2024-09-19T09:08:19.157 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/crash -- . 2024-09-19T09:08:19.199 INFO:teuthology.orchestra.run.smithi019.stderr:tar: /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T09:08:19.199 INFO:teuthology.orchestra.run.smithi019.stderr:tar: Error is not recoverable: exiting now 2024-09-19T09:08:19.202 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911866/remote/smithi155/crash 2024-09-19T09:08:19.203 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/crash -- . 2024-09-19T09:08:19.243 INFO:teuthology.orchestra.run.smithi155.stderr:tar: /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T09:08:19.243 INFO:teuthology.orchestra.run.smithi155.stderr:tar: Error is not recoverable: exiting now 2024-09-19T09:08:19.246 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911866/remote/smithi203/crash 2024-09-19T09:08:19.247 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/crash -- . 2024-09-19T09:08:19.283 INFO:teuthology.orchestra.run.smithi203.stderr:tar: /var/lib/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T09:08:19.283 INFO:teuthology.orchestra.run.smithi203.stderr:tar: Error is not recoverable: exiting now 2024-09-19T09:08:19.284 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-19T09:08:19.285 DEBUG:teuthology.orchestra.run.smithi019:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-19T09:08:19.367 INFO:teuthology.orchestra.run.smithi019.stdout:2024-09-19T09:04:08.186148+0000 mds.b (mds.0) 66 : cluster [ERR] failed to store backtrace on ino 0x1000000c565 object, pool 2, errno -2 2024-09-19T09:08:19.368 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-09-19T09:08:19.368 INFO:tasks.cephadm:Compressing logs... 2024-09-19T09:08:19.368 DEBUG:teuthology.orchestra.run.smithi019:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T09:08:19.372 DEBUG:teuthology.orchestra.run.smithi155:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T09:08:19.375 DEBUG:teuthology.orchestra.run.smithi203:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T09:08:19.401 INFO:teuthology.orchestra.run.smithi155.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-osd.10.log 2024-09-19T09:08:19.401 INFO:teuthology.orchestra.run.smithi155.stderr:: No such file or directory 2024-09-19T09:08:19.401 INFO:teuthology.orchestra.run.smithi155.stderr:gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-19T09:08:19.402 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-19T09:08:19.402 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T09:08:19.411 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mds.b.log 2024-09-19T09:08:19.411 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mds.k.log 2024-09-19T09:08:19.411 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-19T09:08:19.411 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T09:08:19.411 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T09:08:19.411 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-19T09:08:19.412 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph.log 2024-09-19T09:08:19.412 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mds.h.log 2024-09-19T09:08:19.412 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-19T09:08:19.412 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mds.e.log 2024-09-19T09:08:19.412 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T09:08:19.415 INFO:teuthology.orchestra.run.smithi203.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T09:08:19.415 INFO:teuthology.orchestra.run.smithi203.stderr:: No such file or directory 2024-09-19T09:08:19.415 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T09:08:19.415 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mds.i.log 2024-09-19T09:08:19.415 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-volume.log: /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-19T09:08:19.416 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T09:08:19.416 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-osd.11.log 2024-09-19T09:08:19.416 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mon.c.log: /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-19T09:08:19.416 INFO:teuthology.orchestra.run.smithi203.stderr: 82.6% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T09:08:19.416 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-19T09:08:19.416 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-osd.2.log: --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph.log 2024-09-19T09:08:19.417 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mds.l.log 2024-09-19T09:08:19.417 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph.log: 90.5% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T09:08:19.417 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-osd.8.log 2024-09-19T09:08:19.417 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mds.l.log: 86.6% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T09:08:19.417 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mgr.z.log 2024-09-19T09:08:19.417 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-osd.8.log: 90.9% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T09:08:19.417 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mds.c.log 2024-09-19T09:08:19.423 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mgr.z.log: 93.0% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mgr.z.log.gz 2024-09-19T09:08:19.423 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mds.f.log 2024-09-19T09:08:19.432 INFO:teuthology.orchestra.run.smithi019.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose --: No such file or directory 2024-09-19T09:08:19.432 INFO:teuthology.orchestra.run.smithi019.stderr: /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-19T09:08:19.434 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T09:08:19.444 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-osd.9.log 2024-09-19T09:08:19.445 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T09:08:19.445 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-osd.0.log: /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T09:08:19.445 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mds.a.log 2024-09-19T09:08:19.446 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T09:08:19.446 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-19T09:08:19.446 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mds.g.log 2024-09-19T09:08:19.446 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-19T09:08:19.447 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph.log 2024-09-19T09:08:19.447 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mds.d.log 2024-09-19T09:08:19.447 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-19T09:08:19.447 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mds.j.log 2024-09-19T09:08:19.448 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-19T09:08:19.448 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T09:08:19.448 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 86.6% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T09:08:19.457 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T09:08:19.480 INFO:teuthology.orchestra.run.smithi203.stderr: 94.4% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mds.l.log.gz 2024-09-19T09:08:19.502 INFO:teuthology.orchestra.run.smithi155.stderr:/var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 82.7% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T09:08:19.517 INFO:teuthology.orchestra.run.smithi019.stderr: 82.6% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T09:08:19.527 INFO:teuthology.orchestra.run.smithi155.stderr: 90.5% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T09:08:19.553 INFO:teuthology.orchestra.run.smithi155.stderr: 86.6% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T09:08:19.561 INFO:teuthology.orchestra.run.smithi155.stderr: 92.9% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-19T09:08:19.609 INFO:teuthology.orchestra.run.smithi019.stderr: 94.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T09:08:19.721 INFO:teuthology.orchestra.run.smithi019.stderr: 90.3% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T09:08:19.738 INFO:teuthology.orchestra.run.smithi019.stderr: 94.7% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mds.d.log.gz 2024-09-19T09:08:19.795 INFO:teuthology.orchestra.run.smithi019.stderr: 90.9% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T09:08:19.897 INFO:teuthology.orchestra.run.smithi203.stderr: 91.8% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-19T09:08:19.950 INFO:teuthology.orchestra.run.smithi019.stderr: 94.5% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mds.a.log.gz 2024-09-19T09:08:20.012 INFO:teuthology.orchestra.run.smithi019.stderr: 94.5% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mds.j.log.gz 2024-09-19T09:08:20.184 INFO:teuthology.orchestra.run.smithi155.stderr: 94.0% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mds.k.log.gz 2024-09-19T09:08:20.185 INFO:teuthology.orchestra.run.smithi155.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T09:08:20.271 INFO:teuthology.orchestra.run.smithi155.stderr: 90.9% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T09:08:20.805 INFO:teuthology.orchestra.run.smithi019.stderr: 89.9% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-19T09:08:22.512 INFO:teuthology.orchestra.run.smithi155.stderr: 91.8% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-19T09:08:24.240 INFO:teuthology.orchestra.run.smithi019.stderr: 90.3% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-19T09:08:24.359 INFO:teuthology.orchestra.run.smithi203.stderr: 93.8% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mds.i.log.gz 2024-09-19T09:08:26.456 INFO:teuthology.orchestra.run.smithi203.stderr: 93.8% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mds.f.log.gz 2024-09-19T09:08:27.180 INFO:teuthology.orchestra.run.smithi203.stderr: 93.8% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mds.c.log.gz 2024-09-19T09:08:28.212 INFO:teuthology.orchestra.run.smithi019.stderr: 94.5% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mds.g.log.gz 2024-09-19T09:08:32.119 INFO:teuthology.orchestra.run.smithi203.stderr: 92.8% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-19T09:08:32.203 INFO:teuthology.orchestra.run.smithi203.stderr: 92.6% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-osd.11.log.gz 2024-09-19T09:08:33.387 INFO:teuthology.orchestra.run.smithi203.stderr: 92.5% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-19T09:08:34.603 INFO:teuthology.orchestra.run.smithi019.stderr: 92.6% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-19T09:08:35.066 INFO:teuthology.orchestra.run.smithi019.stderr: 92.6% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-osd.9.log.gz 2024-09-19T09:08:36.171 INFO:teuthology.orchestra.run.smithi203.stderr: 92.1% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-osd.8.log.gz 2024-09-19T09:08:36.173 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-09-19T09:08:36.173 INFO:teuthology.orchestra.run.smithi203.stderr:real 0m16.783s 2024-09-19T09:08:36.173 INFO:teuthology.orchestra.run.smithi203.stderr:user 1m14.104s 2024-09-19T09:08:36.174 INFO:teuthology.orchestra.run.smithi203.stderr:sys 0m2.320s 2024-09-19T09:08:37.039 INFO:teuthology.orchestra.run.smithi019.stderr: 93.0% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-19T09:08:38.765 INFO:teuthology.orchestra.run.smithi155.stderr: 92.7% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-19T09:08:39.434 INFO:teuthology.orchestra.run.smithi019.stderr: 92.6% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-19T09:08:39.436 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-19T09:08:39.436 INFO:teuthology.orchestra.run.smithi019.stderr:real 0m20.050s 2024-09-19T09:08:39.436 INFO:teuthology.orchestra.run.smithi019.stderr:user 0m56.047s 2024-09-19T09:08:39.437 INFO:teuthology.orchestra.run.smithi019.stderr:sys 0m1.819s 2024-09-19T09:09:13.164 INFO:teuthology.orchestra.run.smithi155.stderr: 94.9% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mds.e.log.gz 2024-09-19T09:09:21.806 INFO:teuthology.orchestra.run.smithi155.stderr: 92.1% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-osd.10.log.gz 2024-09-19T09:09:22.335 INFO:teuthology.orchestra.run.smithi155.stderr: 92.5% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-19T09:09:23.048 INFO:teuthology.orchestra.run.smithi155.stderr: 93.8% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mds.h.log.gz 2024-09-19T09:09:27.874 INFO:teuthology.orchestra.run.smithi155.stderr: 92.9% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-19T09:13:13.682 INFO:teuthology.orchestra.run.smithi155.stderr: 93.6% -- replaced with /var/log/ceph/f26c9d84-7662-11ef-bceb-c7b262605968/ceph-mds.b.log.gz 2024-09-19T09:13:13.684 INFO:teuthology.orchestra.run.smithi155.stderr: 2024-09-19T09:13:13.684 INFO:teuthology.orchestra.run.smithi155.stderr:real 4m54.294s 2024-09-19T09:13:13.684 INFO:teuthology.orchestra.run.smithi155.stderr:user 4m39.355s 2024-09-19T09:13:13.685 INFO:teuthology.orchestra.run.smithi155.stderr:sys 0m10.008s 2024-09-19T09:13:13.685 INFO:tasks.cephadm:Archiving logs... 2024-09-19T09:13:13.686 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911866/remote/smithi019/log 2024-09-19T09:13:13.687 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T09:13:21.790 DEBUG:teuthology.misc:Transferring archived files from smithi155:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911866/remote/smithi155/log 2024-09-19T09:13:21.791 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T09:14:04.699 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911866/remote/smithi203/log 2024-09-19T09:14:04.701 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T09:14:14.445 INFO:tasks.cephadm:Removing cluster... 2024-09-19T09:14:14.446 DEBUG:teuthology.orchestra.run.smithi019:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f26c9d84-7662-11ef-bceb-c7b262605968 --force 2024-09-19T09:14:14.658 INFO:teuthology.orchestra.run.smithi019.stdout:Deleting cluster with fsid: f26c9d84-7662-11ef-bceb-c7b262605968 2024-09-19T09:14:15.010 DEBUG:teuthology.orchestra.run.smithi155:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f26c9d84-7662-11ef-bceb-c7b262605968 --force 2024-09-19T09:14:15.615 INFO:teuthology.orchestra.run.smithi155.stdout:Deleting cluster with fsid: f26c9d84-7662-11ef-bceb-c7b262605968 2024-09-19T09:14:16.154 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f26c9d84-7662-11ef-bceb-c7b262605968 --force 2024-09-19T09:14:16.358 INFO:teuthology.orchestra.run.smithi203.stdout:Deleting cluster with fsid: f26c9d84-7662-11ef-bceb-c7b262605968 2024-09-19T09:14:16.978 INFO:tasks.cephadm:Removing cephadm ... 2024-09-19T09:14:16.978 DEBUG:teuthology.orchestra.run.smithi019:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T09:14:17.004 DEBUG:teuthology.orchestra.run.smithi155:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T09:14:17.023 DEBUG:teuthology.orchestra.run.smithi203:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T09:14:17.039 INFO:tasks.cephadm:Teardown complete 2024-09-19T09:14:17.039 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T09:14:17.049 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T09:14:17.050 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T09:14:17.052 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T09:14:17.066 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T09:14:17.187 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T09:14:17.198 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T09:14:17.198 DEBUG:teuthology.orchestra.run.smithi019:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:14:17.201 DEBUG:teuthology.orchestra.run.smithi155:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:14:17.203 DEBUG:teuthology.orchestra.run.smithi203:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T09:14:17.214 INFO:teuthology.orchestra.run.smithi019.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:14:17.216 INFO:teuthology.orchestra.run.smithi155.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:14:17.217 INFO:teuthology.orchestra.run.smithi203.stderr:bash: line 1: ntpq: command not found 2024-09-19T09:14:17.219 INFO:teuthology.orchestra.run.smithi019.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:14:17.219 INFO:teuthology.orchestra.run.smithi019.stdout:=============================================================================== 2024-09-19T09:14:17.219 INFO:teuthology.orchestra.run.smithi019.stdout:^* hv01.front.sepia.ceph.com 3 6 377 13 +1515us[+1515us] +/- 53ms 2024-09-19T09:14:17.219 INFO:teuthology.orchestra.run.smithi019.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 15 -2729us[-2730us] +/- 52ms 2024-09-19T09:14:17.219 INFO:teuthology.orchestra.run.smithi019.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 15 +1851us[+1850us] +/- 76ms 2024-09-19T09:14:17.219 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:14:17.222 INFO:teuthology.orchestra.run.smithi203.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:14:17.222 INFO:teuthology.orchestra.run.smithi203.stdout:=============================================================================== 2024-09-19T09:14:17.222 INFO:teuthology.orchestra.run.smithi203.stdout:^* hv01.front.sepia.ceph.com 3 6 377 12 +1470us[+1439us] +/- 53ms 2024-09-19T09:14:17.222 INFO:teuthology.orchestra.run.smithi203.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 9 -2762us[-2762us] +/- 53ms 2024-09-19T09:14:17.222 INFO:teuthology.orchestra.run.smithi203.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 12 +1805us[+1774us] +/- 76ms 2024-09-19T09:14:17.222 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:14:17.267 INFO:teuthology.orchestra.run.smithi155.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T09:14:17.267 INFO:teuthology.orchestra.run.smithi155.stdout:=============================================================================== 2024-09-19T09:14:17.267 INFO:teuthology.orchestra.run.smithi155.stdout:^* hv01.front.sepia.ceph.com 3 6 377 13 +1502us[+1496us] +/- 53ms 2024-09-19T09:14:17.268 INFO:teuthology.orchestra.run.smithi155.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 16 -2745us[-2751us] +/- 52ms 2024-09-19T09:14:17.268 INFO:teuthology.orchestra.run.smithi155.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 14 +1838us[+1832us] +/- 76ms 2024-09-19T09:14:17.268 INFO:teuthology.orchestra.run.smithi155.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T09:14:17.268 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T09:14:17.278 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T09:14:17.279 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T09:14:17.303 DEBUG:teuthology.orchestra.run.smithi019:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T09:14:17.467 DEBUG:teuthology.orchestra.run.smithi155:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T09:14:17.562 DEBUG:teuthology.orchestra.run.smithi203:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T09:14:17.629 DEBUG:teuthology.orchestra.run.smithi019:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:14:17.661 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:14:17.661 DEBUG:teuthology.orchestra.run.smithi155:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:14:17.691 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:14:17.691 DEBUG:teuthology.orchestra.run.smithi203:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T09:14:17.719 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:14:17.719 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T09:14:17.730 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T09:14:17.782 INFO:teuthology.task.internal:Duration was 2332.560361 seconds 2024-09-19T09:14:17.782 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T09:14:17.829 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T09:14:17.829 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T09:14:17.832 DEBUG:teuthology.orchestra.run.smithi155:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T09:14:17.834 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T09:14:17.873 INFO:teuthology.orchestra.run.smithi203.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:14:17.890 INFO:teuthology.orchestra.run.smithi155.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:14:17.907 INFO:teuthology.orchestra.run.smithi019.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T09:14:18.272 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T09:14:18.272 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi019.front.sepia.ceph.com 2024-09-19T09:14:18.273 DEBUG:teuthology.orchestra.run.smithi019:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T09:14:18.294 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi155.front.sepia.ceph.com 2024-09-19T09:14:18.294 DEBUG:teuthology.orchestra.run.smithi155:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T09:14:18.325 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi203.front.sepia.ceph.com 2024-09-19T09:14:18.325 DEBUG:teuthology.orchestra.run.smithi203:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T09:14:18.355 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T09:14:18.355 DEBUG:teuthology.orchestra.run.smithi019:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T09:14:18.357 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T09:14:18.368 DEBUG:teuthology.orchestra.run.smithi203:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T09:14:18.422 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T09:14:18.422 DEBUG:teuthology.orchestra.run.smithi019:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T09:14:18.426 DEBUG:teuthology.orchestra.run.smithi155:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T09:14:18.439 DEBUG:teuthology.orchestra.run.smithi203:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T09:14:19.790 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T09:14:19.803 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T09:14:19.803 DEBUG:teuthology.orchestra.run.smithi019:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T09:14:19.829 DEBUG:teuthology.orchestra.run.smithi155:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T09:14:19.874 DEBUG:teuthology.orchestra.run.smithi203:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T09:14:19.905 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T09:14:19.916 DEBUG:teuthology.orchestra.run.smithi019:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:14:19.918 DEBUG:teuthology.orchestra.run.smithi155:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:14:19.921 DEBUG:teuthology.orchestra.run.smithi203:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:14:19.951 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern = core 2024-09-19T09:14:19.959 INFO:teuthology.orchestra.run.smithi155.stdout:kernel.core_pattern = core 2024-09-19T09:14:19.973 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern = core 2024-09-19T09:14:20.011 DEBUG:teuthology.orchestra.run.smithi019:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:14:20.026 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:14:20.026 DEBUG:teuthology.orchestra.run.smithi155:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:14:20.043 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:14:20.043 DEBUG:teuthology.orchestra.run.smithi203:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T09:14:20.067 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T09:14:20.067 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T09:14:20.079 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T09:14:20.080 DEBUG:teuthology.misc:Transferring archived files from smithi019:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911866/remote/smithi019 2024-09-19T09:14:20.080 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T09:14:20.145 DEBUG:teuthology.misc:Transferring archived files from smithi155:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911866/remote/smithi155 2024-09-19T09:14:20.145 DEBUG:teuthology.orchestra.run.smithi155:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T09:14:20.185 DEBUG:teuthology.misc:Transferring archived files from smithi203:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911866/remote/smithi203 2024-09-19T09:14:20.185 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T09:14:20.224 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T09:14:20.224 DEBUG:teuthology.orchestra.run.smithi019:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T09:14:20.227 DEBUG:teuthology.orchestra.run.smithi155:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T09:14:20.230 DEBUG:teuthology.orchestra.run.smithi203:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T09:14:20.274 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T09:14:20.288 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T09:14:20.289 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T09:14:20.338 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T09:14:20.338 DEBUG:teuthology.orchestra.run.smithi019:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T09:14:20.341 DEBUG:teuthology.orchestra.run.smithi155:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T09:14:20.344 DEBUG:teuthology.orchestra.run.smithi203:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T09:14:20.354 INFO:teuthology.orchestra.run.smithi019.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 09:14 /home/ubuntu/cephtest 2024-09-19T09:14:20.359 INFO:teuthology.orchestra.run.smithi155.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 09:14 /home/ubuntu/cephtest 2024-09-19T09:14:20.360 INFO:teuthology.orchestra.run.smithi203.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 09:14 /home/ubuntu/cephtest 2024-09-19T09:14:20.361 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T09:14:20.388 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T09:14:20.493 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/misc}} duration: 2332.5603609085083 failure_reason: 'Command failed (workunit test fs/misc/multiple_rsync.sh) on smithi019 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/multiple_rsync.sh''' flavor: default owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=63cbd47baf114be3aa4aee6c2e8152cf status: fail success: false 2024-09-19T09:14:20.494 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T09:14:20.573 INFO:teuthology.run:FAIL